-- Logs begin at Tue 2022-10-04 17:45:25 UTC, end at Tue 2022-10-04 20:18:32 UTC. -- Oct 04 18:20:05.757483 n-d-851028-13 systemd[1]: Starting Devstack devstack@n-api.service... Oct 04 18:20:05.766639 n-d-851028-13 devstack@n-api.service[106313]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 04 18:20:05.768684 n-d-851028-13 devstack@n-api.service[106313]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Oct 4 18:20:05 2022] *** Oct 04 18:20:05.768684 n-d-851028-13 devstack@n-api.service[106313]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 04 18:20:05.768684 n-d-851028-13 devstack@n-api.service[106313]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 04 18:20:05.768684 n-d-851028-13 devstack@n-api.service[106313]: nodename: n-d-851028-13 Oct 04 18:20:05.768684 n-d-851028-13 devstack@n-api.service[106313]: machine: x86_64 Oct 04 18:20:05.768684 n-d-851028-13 devstack@n-api.service[106313]: clock source: unix Oct 04 18:20:05.768684 n-d-851028-13 devstack@n-api.service[106313]: pcre jit disabled Oct 04 18:20:05.768684 n-d-851028-13 devstack@n-api.service[106313]: detected number of CPU cores: 4 Oct 04 18:20:05.768684 n-d-851028-13 devstack@n-api.service[106313]: current working directory: / Oct 04 18:20:05.768684 n-d-851028-13 devstack@n-api.service[106313]: detected binary path: /usr/bin/uwsgi-core Oct 04 18:20:05.769417 n-d-851028-13 devstack@n-api.service[106313]: your processes number limit is 47680 Oct 04 18:20:05.769417 n-d-851028-13 devstack@n-api.service[106313]: your memory page size is 4096 bytes Oct 04 18:20:05.769417 n-d-851028-13 devstack@n-api.service[106313]: detected max file descriptor number: 2048 Oct 04 18:20:05.769417 n-d-851028-13 devstack@n-api.service[106313]: lock engine: pthread robust mutexes Oct 04 18:20:05.769417 n-d-851028-13 devstack@n-api.service[106313]: thunder lock: enabled Oct 04 18:20:05.769417 n-d-851028-13 devstack@n-api.service[106313]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 04 18:20:05.770522 n-d-851028-13 devstack@n-api.service[106313]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 04 18:20:05.808995 n-d-851028-13 devstack@n-api.service[106313]: Python main interpreter initialized at 0x55dde8b279c0 Oct 04 18:20:05.808995 n-d-851028-13 devstack@n-api.service[106313]: python threads support enabled Oct 04 18:20:05.808995 n-d-851028-13 devstack@n-api.service[106313]: your server socket listen backlog is limited to 100 connections Oct 04 18:20:05.808995 n-d-851028-13 devstack@n-api.service[106313]: your mercy for graceful operations on workers is 90 seconds Oct 04 18:20:05.809435 n-d-851028-13 devstack@n-api.service[106313]: mapped 403077 bytes (393 KB) for 2 cores Oct 04 18:20:05.809555 n-d-851028-13 devstack@n-api.service[106313]: *** Operational MODE: preforking *** Oct 04 18:20:05.810275 n-d-851028-13 devstack@n-api.service[106313]: *** uWSGI is running in multiple interpreter mode *** Oct 04 18:20:05.810275 n-d-851028-13 devstack@n-api.service[106313]: spawned uWSGI master process (pid: 106313) Oct 04 18:20:05.810481 n-d-851028-13 systemd[1]: Started Devstack devstack@n-api.service. Oct 04 18:20:05.811140 n-d-851028-13 devstack@n-api.service[106313]: spawned uWSGI worker 1 (pid: 106314, cores: 1) Oct 04 18:20:05.811367 n-d-851028-13 devstack@n-api.service[106313]: spawned uWSGI worker 2 (pid: 106315, cores: 1) Oct 04 18:20:05.811534 n-d-851028-13 devstack@n-api.service[106313]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 04 18:20:06.490392 n-d-851028-13 devstack@n-api.service[106315]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 04 18:20:06.491459 n-d-851028-13 devstack@n-api.service[106314]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 04 18:20:07.579234 n-d-851028-13 devstack@n-api.service[106315]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 18:20:07.579234 n-d-851028-13 devstack@n-api.service[106315]: from cryptography.utils import int_from_bytes Oct 04 18:20:07.579948 n-d-851028-13 devstack@n-api.service[106315]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 18:20:07.579948 n-d-851028-13 devstack@n-api.service[106315]: from cryptography.utils import int_from_bytes Oct 04 18:20:07.586522 n-d-851028-13 devstack@n-api.service[106314]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 18:20:07.586522 n-d-851028-13 devstack@n-api.service[106314]: from cryptography.utils import int_from_bytes Oct 04 18:20:07.587056 n-d-851028-13 devstack@n-api.service[106314]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 18:20:07.587056 n-d-851028-13 devstack@n-api.service[106314]: from cryptography.utils import int_from_bytes Oct 04 18:20:10.100153 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 04 18:20:10.100712 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 04 18:20:10.100929 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 04 18:20:10.101316 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 04 18:20:10.101571 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 04 18:20:10.101954 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.102274 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.102453 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 04 18:20:10.102826 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.102916 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 04 18:20:10.102996 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.103201 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.103295 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 04 18:20:10.103505 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.103606 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 04 18:20:10.103818 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.103914 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 04 18:20:10.104139 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.104239 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.104460 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.104561 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.104716 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.104810 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.105026 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.105153 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.105372 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-851028-13 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.105478 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.105686 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.105772 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.105986 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.106129 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.106314 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.106447 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.106625 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.106750 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.106922 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.107057 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.107238 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.107363 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.107537 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.107689 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-851028-13 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.107905 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.108057 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.108211 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.108452 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.108552 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.108756 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.108856 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.109062 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.109173 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.109418 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.109517 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.109729 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.109826 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.110034 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.110230 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.110352 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.110543 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.110639 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.110850 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.110957 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.111163 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.111266 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.111499 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.111652 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-851028-13 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.111816 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.111939 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.112125 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.112244 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.112446 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.112540 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.112754 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.112941 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.113103 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.113279 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.113444 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.113601 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.113793 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-851028-13 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.113947 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.114111 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.114237 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.114425 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.114544 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.114738 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.114825 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.115065 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.115153 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.115427 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.115527 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.115692 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.115781 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.115991 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.116138 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.116293 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.116428 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.116651 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.116796 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.116927 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.117085 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.117239 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.117362 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.117506 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.117632 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.117753 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.117915 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.118054 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.118222 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.118332 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.118531 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.118651 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.118842 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.118968 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.119161 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.119248 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.119451 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.119552 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.119766 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.119853 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.120015 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.120109 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.120343 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.120439 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.120648 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.120745 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.120945 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.121030 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.121271 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.121362 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.121544 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.121632 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.122357 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.122495 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.122682 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.122772 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.122982 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.123077 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.123295 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.123392 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.123601 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.123694 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.123910 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.123997 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.124216 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.124313 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.124521 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.124608 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.124828 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.124916 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.43 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.125155 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.125260 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.43 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.125459 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.125590 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.125776 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.125906 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.126097 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.126296 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.126385 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.126465 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.126699 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.126844 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.127012 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.127150 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.127317 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.127456 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.43 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.127618 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.127757 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.43 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.127921 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.128059 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.128235 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.128388 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.128599 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.128744 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.128892 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.129026 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.129200 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.129332 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.129466 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.129611 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.129753 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.129891 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.130033 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.130169 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.130303 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.130444 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.130576 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.130715 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.130854 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.131000 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.131135 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.131300 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.131436 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.131567 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.131702 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.131845 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.131999 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.132148 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.132300 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.132431 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.132601 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.132730 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.132899 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.133036 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.133224 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.133370 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.133527 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.133674 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.133830 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.133982 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.134135 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.134290 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.134449 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.134598 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.134763 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.134905 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.135063 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.135212 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.135363 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.135518 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.135682 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.135821 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.135961 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.136129 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.136269 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.136436 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.136570 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.136740 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.136866 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.137059 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.137214 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.137957 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.138103 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.138268 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.138401 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.138576 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.138793 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.138922 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.139052 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.139181 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.139312 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.139482 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.139619 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.139779 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.139919 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.140080 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.140212 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.140392 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.140526 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.140694 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.140828 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.140993 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.141157 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.141319 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.141432 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.141630 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.141861 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.143217 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.143361 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.143549 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.143676 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.143859 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.143994 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.144171 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.144296 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.144493 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.144648 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.144804 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.144938 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.145138 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.145266 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.145438 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.145563 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.145792 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.145927 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.146049 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.146171 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.146333 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.146466 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.146641 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.146775 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.146948 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.147075 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.147250 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.147386 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.147556 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.147682 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.147879 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.148021 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.148190 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.148327 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.148499 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.148625 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.148807 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.148927 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.149132 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.149248 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:20:10.149456 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.149545 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.149764 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.149861 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.150071 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.150178 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.150379 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.150466 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.150690 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.150777 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.151004 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.151093 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.151328 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.151416 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.151639 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.151727 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.151951 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.152039 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.152263 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.152362 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.152569 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.152656 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.152881 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.152969 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.153241 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.153344 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.153559 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.153645 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.153866 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.153955 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.154196 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.154283 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.154520 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.154609 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.154838 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.154990 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.155154 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.155292 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.155468 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.155596 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.155771 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.155973 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.156100 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.156223 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.156368 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.156501 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.156703 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.156844 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.157009 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.157182 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.157340 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.157493 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.157654 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.157789 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.157959 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.158086 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.158274 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.158416 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.158582 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.158716 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.158932 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.159069 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.159204 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.159340 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.159474 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.159598 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.159777 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.159960 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.160119 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.160316 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.160526 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.160688 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.160821 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.160946 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.161077 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.161232 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.161356 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.161493 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.161619 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.161742 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.161919 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.162055 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.162224 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.162351 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.162529 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.162663 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.162829 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.163044 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.163173 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.163304 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.163436 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.163701 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.163998 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.164311 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.164637 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.164771 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.164938 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.165078 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.165302 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.165431 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.165603 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.165743 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.165908 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.166121 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.166256 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.166380 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.166508 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.166631 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.166787 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.166924 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.167094 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.167398 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.167697 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.168015 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.168319 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.168452 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.169199 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.169312 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.169522 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.169622 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.169833 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.169933 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.170134 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.170231 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.170442 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.170540 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.170751 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.170895 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.171055 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.171194 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.171360 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.171510 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.171654 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.171800 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.171968 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.172104 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.172278 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.172416 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.172568 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.172704 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.172883 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.173020 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.173226 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.173328 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.173524 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.173611 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.173843 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.173939 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.174154 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.174249 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.174460 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.174548 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.174756 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.174842 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.175060 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.175157 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.175362 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.175457 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.175659 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.175745 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.175956 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.176056 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.176260 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.176358 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.176612 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.176759 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.176855 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.176938 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.177157 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.177252 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.177456 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.177542 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.177752 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.177842 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.178065 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.178153 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.178368 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.178455 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.178746 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.178837 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.178953 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.179041 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.179250 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.179337 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.179587 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.179686 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.179888 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.179977 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.180223 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.180326 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.180524 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.180611 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.180829 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.180923 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.181154 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.181258 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.181468 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.181564 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.181774 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.181861 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.182076 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.182170 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.182376 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.182462 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.182677 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.182763 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.182976 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.183072 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.183286 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.183372 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.183590 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.183679 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.183892 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.183980 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.184248 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.184847 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.185082 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.185189 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.185442 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.185537 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.185749 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.185835 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.186048 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.186135 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.186359 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.186695 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.187024 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.187335 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.187650 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.187737 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.187958 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.188047 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.188266 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.188353 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.188571 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.188671 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.188875 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.188962 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.189212 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.189305 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.189520 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.189666 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.189833 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.189921 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.190138 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.190227 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.190450 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.190546 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.190752 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.190840 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.191068 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.191154 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.191372 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.191609 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.191912 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.192031 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.192120 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.192201 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.192279 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.192367 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.192571 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.192659 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.192889 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.192975 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.193216 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.193342 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.193525 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.193613 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.193844 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.193930 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.194151 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.194358 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.194445 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.194550 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.194748 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.194873 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.195047 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.195187 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.195352 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.195498 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.195655 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.195811 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.196097 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.196186 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.196425 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.196574 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.196736 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.196833 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.197054 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.197183 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.197389 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.197486 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.197714 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.197810 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.198026 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.198112 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.198325 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.198412 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.198630 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.198730 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.198948 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.199037 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.199253 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.199341 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.199569 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.199664 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.199907 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.199995 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.200207 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.200304 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.200506 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.200594 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.200824 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.200910 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.201146 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.201259 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.201451 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.201547 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.201752 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.201844 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.202050 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.202141 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.202370 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.202468 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.202685 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.202775 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.202986 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.203078 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.203293 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.203397 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.203601 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.203696 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.203902 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.203997 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.204208 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.204295 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.204513 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.204599 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.204816 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.204915 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.205149 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.205239 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.205465 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.205565 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.205768 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.205865 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.206074 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.206162 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.206378 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.206462 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.206684 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.206781 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.206989 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.207076 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.207305 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.207392 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.207610 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.207707 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.207913 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.207999 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.208216 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.208308 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.208513 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.208610 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.208819 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.208914 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.209167 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.209274 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.209473 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.209724 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.209974 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.210063 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.210131 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.210392 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.210482 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.210706 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.210793 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.211013 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.211108 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.211322 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.211419 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.211643 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.211732 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.211957 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.212045 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.212266 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.212353 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.212830 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.212923 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.213153 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.213253 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.213462 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.213557 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.213768 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.213859 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.214075 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.214171 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.214379 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.214480 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.214678 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.214766 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.214980 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.215069 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.215278 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.215373 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.215609 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.215692 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.215913 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.216000 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.216212 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.216480 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.216606 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.216815 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.216911 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.217145 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.217253 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.217446 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.217535 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.217756 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.217843 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.218075 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.218177 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.218379 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.218476 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.218680 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.218767 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.218979 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.219065 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.219278 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.219367 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.219614 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.219699 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.219914 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.220000 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.220218 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.220306 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.220530 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.220618 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.220835 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.220921 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.221158 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.221250 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.221465 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.221564 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.221773 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.221869 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.222079 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.222165 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.222380 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.222515 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.222680 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.222789 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.222990 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.223144 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.223275 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.223404 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.223574 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.223747 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.223897 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.224004 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.224167 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.224264 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.224473 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.224571 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.224778 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.224873 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.225076 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.225193 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.225404 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.225610 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.225706 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.225782 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.226015 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.226103 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.226319 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.226415 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.226619 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.226764 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.226919 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.227007 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.227223 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.227311 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.227525 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.227613 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.227822 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.227909 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.228126 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.228215 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.228423 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.228569 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.228734 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.228879 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.229034 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.229207 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.229358 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.229521 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.229657 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.229831 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.229963 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.230135 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.230264 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.230447 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.230562 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.230758 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.230880 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.231676 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.231769 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.231989 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.232085 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.232293 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.232381 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.232610 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.232699 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.232893 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.233061 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.233217 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.233308 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.233523 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.233622 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.233843 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.234063 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.234148 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.234227 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.234440 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.234538 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.234744 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.234841 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.235040 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.235128 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.235345 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.235433 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.235646 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.235741 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.235947 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.236034 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.236242 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.236329 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.236541 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.236629 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.236837 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.236928 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.237151 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.237254 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.237452 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.237543 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.237752 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.237839 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.238058 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.238143 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.238357 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.238459 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.238655 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.238742 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.238952 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.239038 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.239255 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.239350 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.239558 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.239645 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.239860 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.239957 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.240169 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.240257 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.240491 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.240579 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.240802 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.240897 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.241102 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.241204 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.241431 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.241518 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.241734 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.241833 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.242031 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.242117 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.242332 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.242436 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.242634 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.242728 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.242932 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.243018 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.243230 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.243315 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.243530 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.243624 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.243831 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.243909 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.244131 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.244208 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.244435 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.244512 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.244747 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.244833 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.245053 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.245193 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.245382 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.245473 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.245682 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.245768 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.245986 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.246073 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.246291 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.246393 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.246594 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.246683 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.246947 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.247064 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.247251 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.247343 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.247593 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.247697 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.247849 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.247950 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.248152 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.248243 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.248457 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.248551 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.248760 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.248861 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.249058 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.249167 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.249386 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.249474 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.249690 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.249793 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.249986 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.250074 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.250287 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.250374 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.250595 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.250691 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.250895 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.250982 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.251196 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.251283 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.251494 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.251582 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.251797 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.251888 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.252093 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.252181 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.252419 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.252514 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.252727 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.252815 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.253036 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.253143 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.253369 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.253460 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.253679 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.253766 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.253988 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.254076 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.254294 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.254390 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.254602 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.254696 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.254901 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.255002 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.255213 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.255300 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.255521 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.255615 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.255826 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.255924 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.256135 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.256223 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.256445 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.256533 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.256795 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.256902 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.257055 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.257182 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.257395 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.257472 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.257694 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.257779 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.257994 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.258082 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.258293 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.258381 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.258599 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.258687 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.258897 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.258982 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.259215 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.259327 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.259627 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.259716 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.259933 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.260021 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.260233 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.260319 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.260540 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.260635 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.260851 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.260946 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.261188 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.261280 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.261506 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.261597 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.261855 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.262007 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.262162 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.262761 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.262997 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.263074 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.263308 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.263396 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.263615 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.263760 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.263935 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.264024 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.264236 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.264324 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.264545 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.264644 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.264851 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.264937 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.265171 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.265290 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.265482 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.265571 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.265785 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.265882 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.266102 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.266188 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.266404 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.266491 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.266727 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.266824 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.267120 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.267208 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.267426 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.267514 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.267737 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.267850 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.268056 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.268150 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.268358 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.268451 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.268659 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.268763 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.268965 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.269056 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.269290 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.269382 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.269592 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.269685 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.269911 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.270002 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.270213 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.270304 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.270524 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.270620 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.270828 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.270918 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.271128 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.271230 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.271430 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.271522 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.271737 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.271834 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.272050 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.272219 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.272357 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.272442 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.272675 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.272761 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.272984 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.273085 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.273327 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.273419 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.273644 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.273751 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.273947 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.274045 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.274264 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.274351 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.274577 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.274667 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.274863 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.274980 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.275159 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.275295 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.275455 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.275605 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.275799 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.275907 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.276101 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.276197 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.276417 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.276505 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.276740 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.276830 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.277064 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.277171 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.277395 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.277485 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.277724 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.277829 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.278090 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.278245 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.278413 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.278568 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.278720 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.278851 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.279042 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.279132 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.279352 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.279449 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.279676 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.279796 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.279973 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.280067 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.280277 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.280376 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.280576 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.280664 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.280876 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.280974 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.281201 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.281309 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.281509 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.281598 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.281807 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.281895 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.282106 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.282196 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.282404 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.282500 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.282722 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.282817 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.283020 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.283109 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.283337 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.283426 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.283640 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.283735 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.283940 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.284072 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.284240 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.284330 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.284538 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.284627 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.284874 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.284966 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.285198 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.285290 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.285523 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.285624 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.285833 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.285921 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.286149 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.286238 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.286460 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.286561 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.286764 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.286852 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.287071 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.287158 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.287376 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.287471 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.287684 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.287772 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.287990 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.288076 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.288299 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.288412 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.288596 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.288683 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.288897 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.288983 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.289225 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.289318 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.289533 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.289619 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.289841 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.290080 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.290186 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.290404 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.290492 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.290712 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.290803 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.291018 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.291116 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.291324 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.291420 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.291631 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.291719 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.291938 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.292038 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.292244 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.292361 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.292549 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.292676 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.292853 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.293003 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.293177 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.293348 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.294011 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.294292 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.294393 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.294615 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.294702 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.294935 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.295022 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.295253 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.295360 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.295564 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.295651 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.295878 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.295966 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.296233 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.296327 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.296504 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.296592 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.296821 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.296909 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.297135 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.297226 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.297509 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.297701 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.297791 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.298033 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.298123 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.298346 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.298456 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.298653 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.298749 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.298962 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.299055 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.299267 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.299369 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.299571 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.299671 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.299875 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.299969 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.300181 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.300272 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.300484 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.300574 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.300791 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.300889 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.301134 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.301228 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.301452 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.301625 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.301763 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.301847 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.302072 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.302159 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.302379 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.302484 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.302706 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.302893 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.303025 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.303206 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.303341 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.303538 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.303702 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.303861 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.304022 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.304184 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.304333 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.304498 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.304631 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.304811 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.304950 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.305234 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.305343 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.305460 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.305592 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.305768 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.305911 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.306076 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.306228 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.306381 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.306542 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.306681 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.306855 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.306996 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.307165 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.307301 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.307479 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.307599 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.307794 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.307913 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.308123 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.308214 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.308466 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.308726 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.308820 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.309068 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.309244 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.309451 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.309543 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.309769 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.309873 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.310089 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.310296 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.310386 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.310615 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.310706 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.310953 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.311044 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.311280 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.311370 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.311581 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.311679 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.311893 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.311985 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.312197 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.312287 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.312497 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.312588 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.312796 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.312888 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.313101 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.313210 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.313425 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.313530 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.313725 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.313823 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.314029 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.314122 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.314376 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.314481 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.314646 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.314749 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.314945 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.315034 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.315244 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.315345 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.315542 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.315630 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.315853 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.316080 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.316178 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.316429 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.316524 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.316726 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.316814 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.317024 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.317148 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.317355 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.317444 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.317654 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.317741 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.317959 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.318057 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.318258 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.318354 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.318566 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.318664 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.318888 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.318988 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.319201 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.319290 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.319498 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.319588 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.319800 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.319906 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.320103 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.320189 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.320398 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.320496 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.320706 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.320796 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.321008 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.321098 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.321342 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.321432 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.321645 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.321735 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.321949 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.322049 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.322260 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.322357 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.322567 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.322707 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.322873 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.323102 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.323192 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.323435 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.323533 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.323753 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.323841 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.324062 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.324158 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.324367 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.324456 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.324678 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.325410 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.325531 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.325619 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.325836 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.325926 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.326161 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.326250 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.326469 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.326566 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.326778 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.326868 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.327088 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.327246 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.327381 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.327495 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.327692 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.327815 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.327999 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.328144 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.328302 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.328402 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.328621 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.328761 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.328907 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.328996 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.329236 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.329345 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.329543 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.329641 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.329848 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.329936 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.330152 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.330249 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.330458 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.330553 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.330767 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.331020 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.331186 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.331361 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.331461 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.331684 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.331780 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.332003 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.332099 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.332318 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.332407 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.332627 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.332713 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.332930 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.333028 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.333259 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.333349 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.333568 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.333657 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.333881 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.333970 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.334190 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.334286 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.334502 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.334579 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.334801 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.334889 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.335108 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.335419 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.335558 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.335729 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.335827 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.336039 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.336126 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.336352 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.336441 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.336662 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.336753 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.336975 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.337062 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.337310 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.337400 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.337885 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.337977 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.338194 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.338326 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.338500 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.338588 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.338827 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.338917 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.339146 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.339233 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.339464 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.339551 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.339782 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.339871 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.340084 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.340171 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.340404 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.340640 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.340728 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.340809 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.341028 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.341171 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.341370 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.341477 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.341677 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.341765 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.341978 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.342066 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.342280 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.342376 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.342587 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.342722 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.342890 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.343192 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.343287 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.343495 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.343582 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.343795 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.343884 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.344099 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.344204 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.344400 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.344487 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.344701 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.344838 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.345002 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.345215 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.345330 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.345533 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.345620 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.345854 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.345959 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.346167 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.346255 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.346498 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.346594 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.346798 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.346895 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.347096 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.347185 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.347395 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.347491 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.347695 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.347793 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.348021 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.348146 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.348345 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.348431 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.348652 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.348748 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.348969 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.349056 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.349306 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.349395 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.349613 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.349703 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.349915 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.350009 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.350223 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.350310 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.350528 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.350617 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.350833 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.350921 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.351135 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.351221 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.351437 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.351524 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.351744 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.351840 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.352047 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.352134 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.352351 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.352438 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.352651 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.352737 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.352955 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.353049 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.353278 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.353380 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.353581 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.353678 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.353889 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.353985 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.354192 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.354280 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.354498 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.354586 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.354801 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.354972 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.355105 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.355193 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.355407 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.355496 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.355713 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.355808 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.356652 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.356754 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.356886 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.356974 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.357225 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.357318 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.357535 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.357623 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.357843 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.357931 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.358151 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.358241 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.358462 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.358550 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.358768 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.358859 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.359074 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.359171 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.359383 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.359470 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.359693 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.359788 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.360015 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.360101 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.360329 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.360416 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.360631 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.360794 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.360940 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.361026 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.361291 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.361393 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.361605 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.361703 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.361932 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.362028 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.362260 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.362349 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.362567 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.362664 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.362893 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.362983 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.363210 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.363300 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.363511 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.363599 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.363752 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 04 18:20:10.363848 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.364132 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.364462 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.364774 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.365085 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.365417 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.365728 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.366040 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.366355 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.366669 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.366979 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.367294 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.367609 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.367937 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.368264 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.368575 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.368901 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.369263 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.369613 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.369926 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.370269 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.370600 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.370915 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.371230 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.371543 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:20:10.371844 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 04 18:20:10.518749 n-d-851028-13 devstack@n-api.service[106315]: INFO dbcounter [None req-945ad59a-3754-4b20-854f-d8fa82067a1b None None] Registered counter for database nova_api Oct 04 18:20:10.526855 n-d-851028-13 devstack@n-api.service[106314]: INFO dbcounter [None req-fbf9711c-0b2e-4476-aa4e-7dd95395b553 None None] Registered counter for database nova_api Oct 04 18:20:10.539556 n-d-851028-13 devstack@n-api.service[106315]: DEBUG oslo_db.sqlalchemy.engines [None req-945ad59a-3754-4b20-854f-d8fa82067a1b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106315) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 18:20:10.547274 n-d-851028-13 devstack@n-api.service[106315]: DEBUG dbcounter [-] [106315] Writer thread running {{(pid=106315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 18:20:10.548077 n-d-851028-13 devstack@n-api.service[106314]: DEBUG oslo_db.sqlalchemy.engines [None req-fbf9711c-0b2e-4476-aa4e-7dd95395b553 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106314) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 18:20:10.554710 n-d-851028-13 devstack@n-api.service[106314]: DEBUG dbcounter [-] [106314] Writer thread running {{(pid=106314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 18:20:10.604502 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.context [None req-945ad59a-3754-4b20-854f-d8fa82067a1b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),66287c68-6a08-453f-953b-bd2446fe0d25(cell1) {{(pid=106315) load_cells /opt/stack/nova/nova/context.py:464}} Oct 04 18:20:10.608457 n-d-851028-13 devstack@n-api.service[106315]: DEBUG oslo_concurrency.lockutils [None req-945ad59a-3754-4b20-854f-d8fa82067a1b None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:10.608931 n-d-851028-13 devstack@n-api.service[106315]: DEBUG oslo_concurrency.lockutils [None req-945ad59a-3754-4b20-854f-d8fa82067a1b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:10.610506 n-d-851028-13 devstack@n-api.service[106315]: DEBUG oslo_concurrency.lockutils [None req-945ad59a-3754-4b20-854f-d8fa82067a1b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:10.611221 n-d-851028-13 devstack@n-api.service[106315]: DEBUG oslo_concurrency.lockutils [None req-945ad59a-3754-4b20-854f-d8fa82067a1b None None] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:10.611443 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.context [None req-fbf9711c-0b2e-4476-aa4e-7dd95395b553 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),66287c68-6a08-453f-953b-bd2446fe0d25(cell1) {{(pid=106314) load_cells /opt/stack/nova/nova/context.py:464}} Oct 04 18:20:10.611665 n-d-851028-13 devstack@n-api.service[106315]: DEBUG oslo_concurrency.lockutils [None req-945ad59a-3754-4b20-854f-d8fa82067a1b None None] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:10.613638 n-d-851028-13 devstack@n-api.service[106315]: DEBUG oslo_concurrency.lockutils [None req-945ad59a-3754-4b20-854f-d8fa82067a1b None None] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:10.615321 n-d-851028-13 devstack@n-api.service[106314]: DEBUG oslo_concurrency.lockutils [None req-fbf9711c-0b2e-4476-aa4e-7dd95395b553 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:10.615609 n-d-851028-13 devstack@n-api.service[106315]: INFO dbcounter [None req-945ad59a-3754-4b20-854f-d8fa82067a1b None None] Registered counter for database nova_cell0 Oct 04 18:20:10.615800 n-d-851028-13 devstack@n-api.service[106314]: DEBUG oslo_concurrency.lockutils [None req-fbf9711c-0b2e-4476-aa4e-7dd95395b553 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:10.617384 n-d-851028-13 devstack@n-api.service[106314]: DEBUG oslo_concurrency.lockutils [None req-fbf9711c-0b2e-4476-aa4e-7dd95395b553 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:10.618111 n-d-851028-13 devstack@n-api.service[106314]: DEBUG oslo_concurrency.lockutils [None req-fbf9711c-0b2e-4476-aa4e-7dd95395b553 None None] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:10.618563 n-d-851028-13 devstack@n-api.service[106314]: DEBUG oslo_concurrency.lockutils [None req-fbf9711c-0b2e-4476-aa4e-7dd95395b553 None None] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:10.619649 n-d-851028-13 devstack@n-api.service[106315]: INFO dbcounter [None req-945ad59a-3754-4b20-854f-d8fa82067a1b None None] Registered counter for database nova_cell1 Oct 04 18:20:10.620522 n-d-851028-13 devstack@n-api.service[106314]: DEBUG oslo_concurrency.lockutils [None req-fbf9711c-0b2e-4476-aa4e-7dd95395b553 None None] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:10.623069 n-d-851028-13 devstack@n-api.service[106314]: INFO dbcounter [None req-fbf9711c-0b2e-4476-aa4e-7dd95395b553 None None] Registered counter for database nova_cell0 Oct 04 18:20:10.627125 n-d-851028-13 devstack@n-api.service[106314]: INFO dbcounter [None req-fbf9711c-0b2e-4476-aa4e-7dd95395b553 None None] Registered counter for database nova_cell1 Oct 04 18:20:10.627335 n-d-851028-13 devstack@n-api.service[106315]: DEBUG oslo_db.sqlalchemy.engines [None req-945ad59a-3754-4b20-854f-d8fa82067a1b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106315) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 18:20:10.629570 n-d-851028-13 devstack@n-api.service[106315]: DEBUG oslo_db.sqlalchemy.engines [None req-945ad59a-3754-4b20-854f-d8fa82067a1b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106315) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 18:20:10.636470 n-d-851028-13 devstack@n-api.service[106314]: DEBUG oslo_db.sqlalchemy.engines [None req-fbf9711c-0b2e-4476-aa4e-7dd95395b553 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106314) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 18:20:10.636725 n-d-851028-13 devstack@n-api.service[106315]: DEBUG dbcounter [-] [106315] Writer thread running {{(pid=106315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 18:20:10.638435 n-d-851028-13 devstack@n-api.service[106314]: DEBUG oslo_db.sqlalchemy.engines [None req-fbf9711c-0b2e-4476-aa4e-7dd95395b553 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106314) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 18:20:10.638651 n-d-851028-13 devstack@n-api.service[106315]: DEBUG dbcounter [-] [106315] Writer thread running {{(pid=106315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 18:20:10.645172 n-d-851028-13 devstack@n-api.service[106314]: DEBUG dbcounter [-] [106314] Writer thread running {{(pid=106314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 18:20:10.646705 n-d-851028-13 devstack@n-api.service[106314]: DEBUG dbcounter [-] [106314] Writer thread running {{(pid=106314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 18:20:10.785562 n-d-851028-13 devstack@n-api.service[106315]: INFO dbcounter [None req-945ad59a-3754-4b20-854f-d8fa82067a1b None None] Registered counter for database nova_cell0 Oct 04 18:20:10.796073 n-d-851028-13 devstack@n-api.service[106315]: DEBUG oslo_db.sqlalchemy.engines [None req-945ad59a-3754-4b20-854f-d8fa82067a1b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106315) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 18:20:10.796286 n-d-851028-13 devstack@n-api.service[106314]: INFO dbcounter [None req-fbf9711c-0b2e-4476-aa4e-7dd95395b553 None None] Registered counter for database nova_cell0 Oct 04 18:20:10.800841 n-d-851028-13 devstack@n-api.service[106315]: DEBUG dbcounter [-] [106315] Writer thread running {{(pid=106315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 18:20:10.805055 n-d-851028-13 devstack@n-api.service[106314]: DEBUG oslo_db.sqlalchemy.engines [None req-fbf9711c-0b2e-4476-aa4e-7dd95395b553 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106314) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 18:20:10.809978 n-d-851028-13 devstack@n-api.service[106314]: DEBUG dbcounter [-] [106314] Writer thread running {{(pid=106314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 18:20:11.145895 n-d-851028-13 devstack@n-api.service[106314]: WARNING keystonemiddleware.auth_token [None req-fbf9711c-0b2e-4476-aa4e-7dd95395b553 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 04 18:20:11.151929 n-d-851028-13 devstack@n-api.service[106315]: WARNING keystonemiddleware.auth_token [None req-945ad59a-3754-4b20-854f-d8fa82067a1b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 04 18:20:11.153398 n-d-851028-13 devstack@n-api.service[106314]: WARNING keystonemiddleware.auth_token [None req-fbf9711c-0b2e-4476-aa4e-7dd95395b553 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 04 18:20:11.159730 n-d-851028-13 devstack@n-api.service[106315]: WARNING keystonemiddleware.auth_token [None req-945ad59a-3754-4b20-854f-d8fa82067a1b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 04 18:20:11.494215 n-d-851028-13 devstack@n-api.service[106314]: WARNING keystonemiddleware.auth_token [None req-fbf9711c-0b2e-4476-aa4e-7dd95395b553 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 04 18:20:11.500174 n-d-851028-13 devstack@n-api.service[106314]: WARNING keystonemiddleware.auth_token [None req-fbf9711c-0b2e-4476-aa4e-7dd95395b553 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 04 18:20:11.505474 n-d-851028-13 devstack@n-api.service[106314]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55dde8b279c0 pid: 106314 (default app) Oct 04 18:20:11.507561 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi [None req-fbf9711c-0b2e-4476-aa4e-7dd95395b553 None None] Calling method '>' {{(pid=106314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:11.508769 n-d-851028-13 devstack@n-api.service[106315]: WARNING keystonemiddleware.auth_token [None req-945ad59a-3754-4b20-854f-d8fa82067a1b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 04 18:20:11.508957 n-d-851028-13 devstack@n-api.service[106314]: INFO nova.api.openstack.requestlog [None req-fbf9711c-0b2e-4476-aa4e-7dd95395b553 None None] 10.222.0.43 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001755 Oct 04 18:20:11.509258 n-d-851028-13 devstack@n-api.service[106314]: [pid: 106314|app: 0|req: 1/1] 10.222.0.43 () {50 vars in 788 bytes} [Tue Oct 4 18:20:11 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:20:11.515081 n-d-851028-13 devstack@n-api.service[106315]: WARNING keystonemiddleware.auth_token [None req-945ad59a-3754-4b20-854f-d8fa82067a1b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 04 18:20:11.520475 n-d-851028-13 devstack@n-api.service[106315]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55dde8b279c0 pid: 106315 (default app) Oct 04 18:21:36.428568 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi [None req-fbf9711c-0b2e-4476-aa4e-7dd95395b553 None None] Calling method '>' {{(pid=106314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:36.429622 n-d-851028-13 devstack@n-api.service[106314]: INFO nova.api.openstack.requestlog [None req-fbf9711c-0b2e-4476-aa4e-7dd95395b553 None None] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001635 Oct 04 18:21:36.430031 n-d-851028-13 devstack@n-api.service[106314]: [pid: 106314|app: 0|req: 2/2] 10.222.0.43 () {54 vars in 931 bytes} [Tue Oct 4 18:21:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:21:36.447464 n-d-851028-13 devstack@n-api.service[106315]: DEBUG dbcounter [-] [106315] Writing DB stats nova_api:SELECT=3 {{(pid=106315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:21:36.448867 n-d-851028-13 devstack@n-api.service[106315]: DEBUG dbcounter [-] [106315] Writing DB stats nova_cell0:SELECT=3 {{(pid=106315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:21:36.449655 n-d-851028-13 devstack@n-api.service[106315]: DEBUG dbcounter [-] [106315] Writing DB stats nova_cell1:SELECT=3 {{(pid=106315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:21:36.450581 n-d-851028-13 devstack@n-api.service[106315]: DEBUG dbcounter [-] [106315] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:21:37.509200 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi [None req-4f84bedc-6b05-435d-a1fe-a2e4849bbbd2 admin admin] Calling method '>' {{(pid=106315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:37.549020 n-d-851028-13 devstack@n-api.service[106315]: INFO nova.api.openstack.requestlog [None req-4f84bedc-6b05-435d-a1fe-a2e4849bbbd2 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 1.111985 Oct 04 18:21:37.553384 n-d-851028-13 devstack@n-api.service[106315]: [pid: 106315|app: 0|req: 1/3] 10.222.0.43 () {60 vars in 1292 bytes} [Tue Oct 4 18:21:36 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 1114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:40.312503 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi [None req-fbf9711c-0b2e-4476-aa4e-7dd95395b553 None None] Calling method '>' {{(pid=106314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:40.313751 n-d-851028-13 devstack@n-api.service[106314]: INFO nova.api.openstack.requestlog [None req-fbf9711c-0b2e-4476-aa4e-7dd95395b553 None None] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Oct 04 18:21:40.314575 n-d-851028-13 devstack@n-api.service[106314]: [pid: 106314|app: 0|req: 3/4] 10.222.0.43 () {54 vars in 931 bytes} [Tue Oct 4 18:21:40 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:21:40.885149 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi [None req-69f9f8dd-0fa7-4a9d-ab29-a8d18089eff9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "c1", "rxtx_factor": 1.0, "swap": 0, "ram": 256, "name": "cirros256", "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "os-flavor-access:is_public": true}} {{(pid=106315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:21:40.940131 n-d-851028-13 devstack@n-api.service[106315]: INFO nova.api.openstack.requestlog [None req-69f9f8dd-0fa7-4a9d-ab29-a8d18089eff9 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.614963 Oct 04 18:21:40.940740 n-d-851028-13 devstack@n-api.service[106315]: [pid: 106315|app: 0|req: 2/5] 10.222.0.43 () {64 vars in 1283 bytes} [Tue Oct 4 18:21:40 2022] POST /compute/v2.1/flavors => generated 407 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:21:41.239351 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi [None req-6e2637d4-9096-4ad9-8c43-663cbbc8bba5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:21:41.265841 n-d-851028-13 devstack@n-api.service[106314]: DEBUG dbcounter [-] [106314] Writing DB stats nova_api:SELECT=3 {{(pid=106314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:21:41.266581 n-d-851028-13 devstack@n-api.service[106314]: DEBUG dbcounter [-] [106314] Writing DB stats nova_cell0:SELECT=3 {{(pid=106314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:21:41.267294 n-d-851028-13 devstack@n-api.service[106314]: DEBUG dbcounter [-] [106314] Writing DB stats nova_cell1:SELECT=3 {{(pid=106314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:21:41.268008 n-d-851028-13 devstack@n-api.service[106314]: DEBUG dbcounter [-] [106314] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:21:41.320958 n-d-851028-13 devstack@n-api.service[106314]: INFO nova.api.openstack.requestlog [None req-6e2637d4-9096-4ad9-8c43-663cbbc8bba5 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.370991 Oct 04 18:21:41.321941 n-d-851028-13 devstack@n-api.service[106314]: [pid: 106314|app: 0|req: 4/6] 10.222.0.43 () {64 vars in 1336 bytes} [Tue Oct 4 18:21:40 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:44.276323 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi [None req-69f9f8dd-0fa7-4a9d-ab29-a8d18089eff9 admin admin] Calling method '>' {{(pid=106315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:44.277289 n-d-851028-13 devstack@n-api.service[106315]: INFO nova.api.openstack.requestlog [None req-69f9f8dd-0fa7-4a9d-ab29-a8d18089eff9 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Oct 04 18:21:44.277649 n-d-851028-13 devstack@n-api.service[106315]: [pid: 106315|app: 0|req: 3/7] 10.222.0.43 () {54 vars in 931 bytes} [Tue Oct 4 18:21:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:21:45.301271 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi [None req-bf157e1b-0e36-402f-a2cf-c29e1b5c07c8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds512M", "disk": 5, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0, "id": "d1", "vcpus": 1}} {{(pid=106314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:21:45.380102 n-d-851028-13 devstack@n-api.service[106314]: INFO nova.api.openstack.requestlog [None req-bf157e1b-0e36-402f-a2cf-c29e1b5c07c8 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 1.095353 Oct 04 18:21:45.380988 n-d-851028-13 devstack@n-api.service[106314]: [pid: 106314|app: 0|req: 5/8] 10.222.0.43 () {64 vars in 1283 bytes} [Tue Oct 4 18:21:44 2022] POST /compute/v2.1/flavors => generated 404 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 18:21:45.400191 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi [None req-117bba41-4bee-4b43-b160-dcad008e7626 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:21:45.498877 n-d-851028-13 devstack@n-api.service[106315]: INFO nova.api.openstack.requestlog [None req-117bba41-4bee-4b43-b160-dcad008e7626 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.103367 Oct 04 18:21:45.500395 n-d-851028-13 devstack@n-api.service[106315]: [pid: 106315|app: 0|req: 4/9] 10.222.0.43 () {64 vars in 1336 bytes} [Tue Oct 4 18:21:45 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:48.556245 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi [None req-bf157e1b-0e36-402f-a2cf-c29e1b5c07c8 admin admin] Calling method '>' {{(pid=106314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:48.558108 n-d-851028-13 devstack@n-api.service[106314]: INFO nova.api.openstack.requestlog [None req-bf157e1b-0e36-402f-a2cf-c29e1b5c07c8 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002398 Oct 04 18:21:48.559010 n-d-851028-13 devstack@n-api.service[106314]: [pid: 106314|app: 0|req: 6/10] 10.222.0.43 () {54 vars in 931 bytes} [Tue Oct 4 18:21:48 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:21:49.121399 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi [None req-a39a4d28-ac7c-4a3d-bf77-29c536ab8c00 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 1, "ram": 1024, "id": "d2", "disk": 10, "swap": 0}} {{(pid=106315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:21:49.143387 n-d-851028-13 devstack@n-api.service[106315]: INFO nova.api.openstack.requestlog [None req-a39a4d28-ac7c-4a3d-bf77-29c536ab8c00 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.577435 Oct 04 18:21:49.152125 n-d-851028-13 devstack@n-api.service[106315]: [pid: 106315|app: 0|req: 5/11] 10.222.0.43 () {64 vars in 1283 bytes} [Tue Oct 4 18:21:48 2022] POST /compute/v2.1/flavors => generated 404 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:21:49.163132 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi [None req-73238b53-faf9-4313-9bb8-74d043b3ee11 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:21:49.206406 n-d-851028-13 devstack@n-api.service[106314]: INFO nova.api.openstack.requestlog [None req-73238b53-faf9-4313-9bb8-74d043b3ee11 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.048135 Oct 04 18:21:49.216886 n-d-851028-13 devstack@n-api.service[106314]: [pid: 106314|app: 0|req: 7/12] 10.222.0.43 () {64 vars in 1336 bytes} [Tue Oct 4 18:21:49 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:52.150333 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi [None req-a39a4d28-ac7c-4a3d-bf77-29c536ab8c00 admin admin] Calling method '>' {{(pid=106315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:52.151364 n-d-851028-13 devstack@n-api.service[106315]: INFO nova.api.openstack.requestlog [None req-a39a4d28-ac7c-4a3d-bf77-29c536ab8c00 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 Oct 04 18:21:52.151784 n-d-851028-13 devstack@n-api.service[106315]: [pid: 106315|app: 0|req: 6/13] 10.222.0.43 () {54 vars in 931 bytes} [Tue Oct 4 18:21:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:21:52.619872 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi [None req-3e0736d7-ef3c-493c-8b54-ae8f4b97821e admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "ds2G", "rxtx_factor": 1.0, "swap": 0, "disk": 10, "vcpus": 2, "ram": 2048, "id": "d3", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=106314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:21:52.644334 n-d-851028-13 devstack@n-api.service[106314]: INFO nova.api.openstack.requestlog [None req-3e0736d7-ef3c-493c-8b54-ae8f4b97821e admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.486509 Oct 04 18:21:52.645925 n-d-851028-13 devstack@n-api.service[106314]: [pid: 106314|app: 0|req: 8/14] 10.222.0.43 () {64 vars in 1283 bytes} [Tue Oct 4 18:21:52 2022] POST /compute/v2.1/flavors => generated 404 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 18:21:52.658109 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi [None req-68e03587-7b43-463c-8e8c-3b7445167d76 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:21:52.688906 n-d-851028-13 devstack@n-api.service[106315]: INFO nova.api.openstack.requestlog [None req-68e03587-7b43-463c-8e8c-3b7445167d76 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034666 Oct 04 18:21:52.689818 n-d-851028-13 devstack@n-api.service[106315]: [pid: 106315|app: 0|req: 7/15] 10.222.0.43 () {64 vars in 1336 bytes} [Tue Oct 4 18:21:52 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:21:55.499001 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi [None req-3e0736d7-ef3c-493c-8b54-ae8f4b97821e admin admin] Calling method '>' {{(pid=106314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:55.501040 n-d-851028-13 devstack@n-api.service[106314]: INFO nova.api.openstack.requestlog [None req-3e0736d7-ef3c-493c-8b54-ae8f4b97821e admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002497 Oct 04 18:21:55.504164 n-d-851028-13 devstack@n-api.service[106314]: [pid: 106314|app: 0|req: 9/16] 10.222.0.43 () {54 vars in 931 bytes} [Tue Oct 4 18:21:55 2022] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:21:56.159653 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi [None req-e588d251-cd0c-48e8-97e2-39ae3a941621 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "id": "d4", "name": "ds4G", "rxtx_factor": 1.0, "swap": 0, "vcpus": 4, "disk": 20, "os-flavor-access:is_public": true, "ram": 4096}} {{(pid=106315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:21:56.192662 n-d-851028-13 devstack@n-api.service[106315]: INFO nova.api.openstack.requestlog [None req-e588d251-cd0c-48e8-97e2-39ae3a941621 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.683875 Oct 04 18:21:56.207733 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi [None req-ffbc0c0a-8257-4c0e-9e36-f96e5b80f977 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:21:56.214751 n-d-851028-13 devstack@n-api.service[106315]: [pid: 106315|app: 0|req: 8/17] 10.222.0.43 () {64 vars in 1283 bytes} [Tue Oct 4 18:21:55 2022] POST /compute/v2.1/flavors => generated 404 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:21:56.245479 n-d-851028-13 devstack@n-api.service[106314]: INFO nova.api.openstack.requestlog [None req-ffbc0c0a-8257-4c0e-9e36-f96e5b80f977 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.040845 Oct 04 18:21:56.247090 n-d-851028-13 devstack@n-api.service[106314]: [pid: 106314|app: 0|req: 10/18] 10.222.0.43 () {64 vars in 1336 bytes} [Tue Oct 4 18:21:56 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:21:59.012188 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi [None req-e588d251-cd0c-48e8-97e2-39ae3a941621 admin admin] Calling method '>' {{(pid=106315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:59.014115 n-d-851028-13 devstack@n-api.service[106315]: INFO nova.api.openstack.requestlog [None req-e588d251-cd0c-48e8-97e2-39ae3a941621 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002824 Oct 04 18:21:59.015416 n-d-851028-13 devstack@n-api.service[106315]: [pid: 106315|app: 0|req: 9/19] 10.222.0.43 () {54 vars in 931 bytes} [Tue Oct 4 18:21:59 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:21:59.459168 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi [None req-3908da9b-1aa5-42f2-8b82-38f76bb0bbb1 admin admin] Calling method '>' {{(pid=106314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:59.486719 n-d-851028-13 devstack@n-api.service[106314]: INFO nova.api.openstack.requestlog [None req-3908da9b-1aa5-42f2-8b82-38f76bb0bbb1 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.463146 Oct 04 18:21:59.487343 n-d-851028-13 devstack@n-api.service[106314]: [pid: 106314|app: 0|req: 11/20] 10.222.0.43 () {60 vars in 1292 bytes} [Tue Oct 4 18:21:59 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:22:02.572301 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi [None req-e588d251-cd0c-48e8-97e2-39ae3a941621 admin admin] Calling method '>' {{(pid=106315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:02.573279 n-d-851028-13 devstack@n-api.service[106315]: INFO nova.api.openstack.requestlog [None req-e588d251-cd0c-48e8-97e2-39ae3a941621 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001486 Oct 04 18:22:02.573691 n-d-851028-13 devstack@n-api.service[106315]: [pid: 106315|app: 0|req: 10/21] 10.222.0.43 () {54 vars in 931 bytes} [Tue Oct 4 18:22:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:22:03.152954 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi [None req-062c8d7e-fa7f-46e4-a95d-2dc827231a6c admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 1, "ram": 512, "name": "m1.tiny", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "1", "os-flavor-access:is_public": true, "vcpus": 1, "swap": 0}} {{(pid=106314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:22:03.172726 n-d-851028-13 devstack@n-api.service[106314]: INFO nova.api.openstack.requestlog [None req-062c8d7e-fa7f-46e4-a95d-2dc827231a6c admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.592238 Oct 04 18:22:03.173319 n-d-851028-13 devstack@n-api.service[106314]: [pid: 106314|app: 0|req: 12/22] 10.222.0.43 () {64 vars in 1283 bytes} [Tue Oct 4 18:22:02 2022] POST /compute/v2.1/flavors => generated 402 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:22:03.185542 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi [None req-432be48c-70a8-43c8-bbd2-ee917d1a18b4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:22:03.215684 n-d-851028-13 devstack@n-api.service[106315]: INFO nova.api.openstack.requestlog [None req-432be48c-70a8-43c8-bbd2-ee917d1a18b4 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033738 Oct 04 18:22:03.216453 n-d-851028-13 devstack@n-api.service[106315]: [pid: 106315|app: 0|req: 11/23] 10.222.0.43 () {64 vars in 1333 bytes} [Tue Oct 4 18:22:03 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:05.838956 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi [None req-062c8d7e-fa7f-46e4-a95d-2dc827231a6c admin admin] Calling method '>' {{(pid=106314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:05.839995 n-d-851028-13 devstack@n-api.service[106314]: INFO nova.api.openstack.requestlog [None req-062c8d7e-fa7f-46e4-a95d-2dc827231a6c admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001489 Oct 04 18:22:05.840391 n-d-851028-13 devstack@n-api.service[106314]: [pid: 106314|app: 0|req: 13/24] 10.222.0.43 () {54 vars in 931 bytes} [Tue Oct 4 18:22:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:22:06.282055 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi [None req-5d87886d-9a49-4131-a5a7-9e19c0b614c5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "m1.small", "vcpus": 1, "rxtx_factor": 1.0, "ram": 2048, "swap": 0, "disk": 20, "id": "2"}} {{(pid=106315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:22:06.301124 n-d-851028-13 devstack@n-api.service[106315]: INFO nova.api.openstack.requestlog [None req-5d87886d-9a49-4131-a5a7-9e19c0b614c5 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.452809 Oct 04 18:22:06.301712 n-d-851028-13 devstack@n-api.service[106315]: [pid: 106315|app: 0|req: 12/25] 10.222.0.43 () {64 vars in 1283 bytes} [Tue Oct 4 18:22:05 2022] POST /compute/v2.1/flavors => generated 405 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:22:06.319865 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi [None req-d1fd6e9a-a27a-4969-84d2-9c7c5ddb749e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:22:06.339322 n-d-851028-13 devstack@n-api.service[106314]: INFO nova.api.openstack.requestlog [None req-d1fd6e9a-a27a-4969-84d2-9c7c5ddb749e admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028827 Oct 04 18:22:06.339909 n-d-851028-13 devstack@n-api.service[106314]: [pid: 106314|app: 0|req: 14/26] 10.222.0.43 () {64 vars in 1333 bytes} [Tue Oct 4 18:22:06 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:09.062417 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi [None req-5d87886d-9a49-4131-a5a7-9e19c0b614c5 admin admin] Calling method '>' {{(pid=106315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:09.063425 n-d-851028-13 devstack@n-api.service[106315]: INFO nova.api.openstack.requestlog [None req-5d87886d-9a49-4131-a5a7-9e19c0b614c5 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001492 Oct 04 18:22:09.064035 n-d-851028-13 devstack@n-api.service[106315]: [pid: 106315|app: 0|req: 13/27] 10.222.0.43 () {54 vars in 931 bytes} [Tue Oct 4 18:22:09 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:22:09.545699 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi [None req-8e960bd8-1ec0-4203-8225-10581b8aff51 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "ram": 4096, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "3", "swap": 0, "name": "m1.medium", "rxtx_factor": 1.0, "disk": 40}} {{(pid=106314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:22:09.571059 n-d-851028-13 devstack@n-api.service[106314]: INFO nova.api.openstack.requestlog [None req-8e960bd8-1ec0-4203-8225-10581b8aff51 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.499635 Oct 04 18:22:09.571929 n-d-851028-13 devstack@n-api.service[106314]: [pid: 106314|app: 0|req: 15/28] 10.222.0.43 () {64 vars in 1283 bytes} [Tue Oct 4 18:22:09 2022] POST /compute/v2.1/flavors => generated 406 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:22:09.585705 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi [None req-a9df4a9b-180d-4f0f-b4a0-726636925569 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:22:09.590793 n-d-851028-13 devstack@n-api.service[106315]: DEBUG dbcounter [-] [106315] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=106315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:22:09.622736 n-d-851028-13 devstack@n-api.service[106315]: INFO nova.api.openstack.requestlog [None req-a9df4a9b-180d-4f0f-b4a0-726636925569 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.041717 Oct 04 18:22:09.623969 n-d-851028-13 devstack@n-api.service[106315]: [pid: 106315|app: 0|req: 14/29] 10.222.0.43 () {64 vars in 1333 bytes} [Tue Oct 4 18:22:09 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:12.483066 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi [None req-8e960bd8-1ec0-4203-8225-10581b8aff51 admin admin] Calling method '>' {{(pid=106314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:12.484762 n-d-851028-13 devstack@n-api.service[106314]: INFO nova.api.openstack.requestlog [None req-8e960bd8-1ec0-4203-8225-10581b8aff51 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002221 Oct 04 18:22:12.485193 n-d-851028-13 devstack@n-api.service[106314]: [pid: 106314|app: 0|req: 16/30] 10.222.0.43 () {54 vars in 931 bytes} [Tue Oct 4 18:22:12 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:22:13.044749 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi [None req-633bce7e-8d51-4dc3-b4b4-07b507d99b9a admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "ram": 8192, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 80, "id": "4", "name": "m1.large"}} {{(pid=106315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:22:13.084030 n-d-851028-13 devstack@n-api.service[106315]: INFO nova.api.openstack.requestlog [None req-633bce7e-8d51-4dc3-b4b4-07b507d99b9a admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.590365 Oct 04 18:22:13.093037 n-d-851028-13 devstack@n-api.service[106315]: [pid: 106315|app: 0|req: 15/31] 10.222.0.43 () {64 vars in 1283 bytes} [Tue Oct 4 18:22:12 2022] POST /compute/v2.1/flavors => generated 405 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 18:22:13.099195 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi [None req-36eaf660-f7be-4b9b-8bda-e736ed95f1a3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:22:13.105394 n-d-851028-13 devstack@n-api.service[106314]: DEBUG dbcounter [-] [106314] Writing DB stats nova_api:SELECT=39,nova_api:SAVEPOINT=4,nova_api:INSERT=8,nova_api:RELEASE=4 {{(pid=106314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:22:13.131674 n-d-851028-13 devstack@n-api.service[106314]: INFO nova.api.openstack.requestlog [None req-36eaf660-f7be-4b9b-8bda-e736ed95f1a3 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036782 Oct 04 18:22:13.132679 n-d-851028-13 devstack@n-api.service[106314]: [pid: 106314|app: 0|req: 17/32] 10.222.0.43 () {64 vars in 1333 bytes} [Tue Oct 4 18:22:13 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:15.963646 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi [None req-633bce7e-8d51-4dc3-b4b4-07b507d99b9a admin admin] Calling method '>' {{(pid=106315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:15.964587 n-d-851028-13 devstack@n-api.service[106315]: INFO nova.api.openstack.requestlog [None req-633bce7e-8d51-4dc3-b4b4-07b507d99b9a admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001501 Oct 04 18:22:15.964994 n-d-851028-13 devstack@n-api.service[106315]: [pid: 106315|app: 0|req: 16/33] 10.222.0.43 () {54 vars in 931 bytes} [Tue Oct 4 18:22:15 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:22:16.504855 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi [None req-4e414775-66d5-4fe2-981a-608805d72f11 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 16384, "os-flavor-access:is_public": true, "disk": 160, "name": "m1.xlarge", "vcpus": 8, "id": "5", "rxtx_factor": 1.0}} {{(pid=106314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:22:16.529881 n-d-851028-13 devstack@n-api.service[106314]: INFO nova.api.openstack.requestlog [None req-4e414775-66d5-4fe2-981a-608805d72f11 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.557485 Oct 04 18:22:16.533165 n-d-851028-13 devstack@n-api.service[106314]: [pid: 106314|app: 0|req: 18/34] 10.222.0.43 () {64 vars in 1283 bytes} [Tue Oct 4 18:22:15 2022] POST /compute/v2.1/flavors => generated 408 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:22:16.543243 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi [None req-96791233-17e0-45a0-bd38-07754a5ac3d4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:22:16.570660 n-d-851028-13 devstack@n-api.service[106315]: INFO nova.api.openstack.requestlog [None req-96791233-17e0-45a0-bd38-07754a5ac3d4 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031049 Oct 04 18:22:16.571560 n-d-851028-13 devstack@n-api.service[106315]: [pid: 106315|app: 0|req: 17/35] 10.222.0.43 () {64 vars in 1333 bytes} [Tue Oct 4 18:22:16 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:37.101668 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi [None req-4e414775-66d5-4fe2-981a-608805d72f11 admin admin] Calling method '>' {{(pid=106314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:37.102678 n-d-851028-13 devstack@n-api.service[106314]: INFO nova.api.openstack.requestlog [None req-4e414775-66d5-4fe2-981a-608805d72f11 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001528 Oct 04 18:22:37.103072 n-d-851028-13 devstack@n-api.service[106314]: [pid: 106314|app: 0|req: 19/36] 10.222.0.43 () {54 vars in 931 bytes} [Tue Oct 4 18:22:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:22:37.113797 n-d-851028-13 devstack@n-api.service[106315]: DEBUG dbcounter [-] [106315] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=106315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:22:37.499685 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi [None req-7e9f8fd1-2c31-4c9e-99d1-3d048b39c1d1 admin admin] Calling method '>' {{(pid=106315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:37.518833 n-d-851028-13 devstack@n-api.service[106315]: INFO nova.api.openstack.requestlog [None req-7e9f8fd1-2c31-4c9e-99d1-3d048b39c1d1 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.409593 Oct 04 18:22:37.519384 n-d-851028-13 devstack@n-api.service[106315]: [pid: 106315|app: 0|req: 18/37] 10.222.0.43 () {60 vars in 1292 bytes} [Tue Oct 4 18:22:37 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:22:38.834694 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi [None req-4e414775-66d5-4fe2-981a-608805d72f11 admin admin] Calling method '>' {{(pid=106314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:38.835710 n-d-851028-13 devstack@n-api.service[106314]: INFO nova.api.openstack.requestlog [None req-4e414775-66d5-4fe2-981a-608805d72f11 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001481 Oct 04 18:22:38.836133 n-d-851028-13 devstack@n-api.service[106314]: [pid: 106314|app: 0|req: 20/38] 10.222.0.43 () {56 vars in 1074 bytes} [Tue Oct 4 18:22:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:22:39.376597 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi [None req-f5e57fed-8129-4b88-9e6c-1a59f2594bba admin admin] Calling method '>' {{(pid=106315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:39.381980 n-d-851028-13 devstack@n-api.service[106315]: INFO nova.api.openstack.wsgi [None req-f5e57fed-8129-4b88-9e6c-1a59f2594bba admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 04 18:22:39.385214 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi [None req-f5e57fed-8129-4b88-9e6c-1a59f2594bba admin admin] Request method failure captured: Oct 04 18:22:39.385214 n-d-851028-13 devstack@n-api.service[106315]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 04 18:22:39.385214 n-d-851028-13 devstack@n-api.service[106315]: Accept: application/json Oct 04 18:22:39.385214 n-d-851028-13 devstack@n-api.service[106315]: Accept-Encoding: gzip, deflate Oct 04 18:22:39.385214 n-d-851028-13 devstack@n-api.service[106315]: Connection: keep-alive Oct 04 18:22:39.385214 n-d-851028-13 devstack@n-api.service[106315]: Content-Length: 0 Oct 04 18:22:39.385214 n-d-851028-13 devstack@n-api.service[106315]: Host: 10.222.0.43 Oct 04 18:22:39.385214 n-d-851028-13 devstack@n-api.service[106315]: Openstack-Api-Version: compute 2.92 Oct 04 18:22:39.385214 n-d-851028-13 devstack@n-api.service[106315]: Openstack-System-Scope: None Oct 04 18:22:39.385214 n-d-851028-13 devstack@n-api.service[106315]: User-Agent: python-novaclient Oct 04 18:22:39.385214 n-d-851028-13 devstack@n-api.service[106315]: X-Auth-Token: gAAAAABjPHnuOsZcI1-AYgyGSCfy4daK7jw4Ao--51RCqs5Kos_-GxJmBG4nH5icy4cjBI5N9lyPRbJLOrr9dD-cqUCd9CF4wLCifPPKZjYTm4uUpKpr57HEb3xBc4Bc3mQh7iiJqmpEmfX1HjTuy7kVKDkZCiWljW3DIWQhAsHXGho8zS6AWuY Oct 04 18:22:39.385214 n-d-851028-13 devstack@n-api.service[106315]: X-Domain-Id: None Oct 04 18:22:39.385214 n-d-851028-13 devstack@n-api.service[106315]: X-Domain-Name: None Oct 04 18:22:39.385214 n-d-851028-13 devstack@n-api.service[106315]: X-Identity-Status: Confirmed Oct 04 18:22:39.385214 n-d-851028-13 devstack@n-api.service[106315]: X-Is-Admin-Project: True Oct 04 18:22:39.385214 n-d-851028-13 devstack@n-api.service[106315]: X-Openstack-Nova-Api-Version: 2.92 Oct 04 18:22:39.385214 n-d-851028-13 devstack@n-api.service[106315]: X-Project-Domain-Id: default Oct 04 18:22:39.385214 n-d-851028-13 devstack@n-api.service[106315]: X-Project-Domain-Name: Default Oct 04 18:22:39.385214 n-d-851028-13 devstack@n-api.service[106315]: X-Project-Id: ebc51fee132346e3a9b98c1d4182768c Oct 04 18:22:39.385214 n-d-851028-13 devstack@n-api.service[106315]: X-Project-Name: admin Oct 04 18:22:39.385214 n-d-851028-13 devstack@n-api.service[106315]: X-Role: member,admin,reader Oct 04 18:22:39.385214 n-d-851028-13 devstack@n-api.service[106315]: X-Roles: member,admin,reader Oct 04 18:22:39.386958 n-d-851028-13 devstack@n-api.service[106315]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/ebc51fee132346e3a9b98c1d4182768c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_ebc51fee132346e3a9b98c1d4182768c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ebc51fee132346e3a9b98c1d4182768c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ebc51fee132346e3a9b98c1d4182768c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:22:39.386958 n-d-851028-13 devstack@n-api.service[106315]: X-Tenant: admin Oct 04 18:22:39.386958 n-d-851028-13 devstack@n-api.service[106315]: X-Tenant-Id: ebc51fee132346e3a9b98c1d4182768c Oct 04 18:22:39.386958 n-d-851028-13 devstack@n-api.service[106315]: X-Tenant-Name: admin Oct 04 18:22:39.386958 n-d-851028-13 devstack@n-api.service[106315]: X-User: admin Oct 04 18:22:39.386958 n-d-851028-13 devstack@n-api.service[106315]: X-User-Domain-Id: default Oct 04 18:22:39.386958 n-d-851028-13 devstack@n-api.service[106315]: X-User-Domain-Name: Default Oct 04 18:22:39.386958 n-d-851028-13 devstack@n-api.service[106315]: X-User-Id: 2b44626252bf448c9675c7795de7cc87 Oct 04 18:22:39.386958 n-d-851028-13 devstack@n-api.service[106315]: X-User-Name: admin Oct 04 18:22:39.386958 n-d-851028-13 devstack@n-api.service[106315]: method: > Oct 04 18:22:39.386958 n-d-851028-13 devstack@n-api.service[106315]: exception: Flavor 42 could not be found. Oct 04 18:22:39.386958 n-d-851028-13 devstack@n-api.service[106315]: action_args: {'id': '42'} Oct 04 18:22:39.386958 n-d-851028-13 devstack@n-api.service[106315]: {{(pid=106315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:22:39.386958 n-d-851028-13 devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:22:39.388025 n-d-851028-13 devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 04 18:22:39.388025 n-d-851028-13 devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 04 18:22:39.388025 n-d-851028-13 devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 04 18:22:39.388025 n-d-851028-13 devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 04 18:22:39.388025 n-d-851028-13 devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 18:22:39.388025 n-d-851028-13 devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 18:22:39.388025 n-d-851028-13 devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 04 18:22:39.388025 n-d-851028-13 devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 04 18:22:39.388025 n-d-851028-13 devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 04 18:22:39.388025 n-d-851028-13 devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:22:39.388025 n-d-851028-13 devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 04 18:22:39.388025 n-d-851028-13 devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 04 18:22:39.388025 n-d-851028-13 devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 04 18:22:39.388025 n-d-851028-13 devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi Oct 04 18:22:39.388025 n-d-851028-13 devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:22:39.388025 n-d-851028-13 devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi Oct 04 18:22:39.388025 n-d-851028-13 devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:22:39.388025 n-d-851028-13 devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:22:39.388025 n-d-851028-13 devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:22:39.389207 n-d-851028-13 devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:22:39.389207 n-d-851028-13 devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:22:39.389207 n-d-851028-13 devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:22:39.389207 n-d-851028-13 devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:22:39.389207 n-d-851028-13 devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 04 18:22:39.389207 n-d-851028-13 devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:22:39.389207 n-d-851028-13 devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 04 18:22:39.389207 n-d-851028-13 devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi Oct 04 18:22:39.389207 n-d-851028-13 devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:22:39.389207 n-d-851028-13 devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi Oct 04 18:22:39.389207 n-d-851028-13 devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:22:39.389207 n-d-851028-13 devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:22:39.389207 n-d-851028-13 devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:22:39.389207 n-d-851028-13 devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:22:39.389207 n-d-851028-13 devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:22:39.389207 n-d-851028-13 devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 04 18:22:39.389207 n-d-851028-13 devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi Oct 04 18:22:39.389207 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi [None req-f5e57fed-8129-4b88-9e6c-1a59f2594bba admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106315) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:22:39.390343 n-d-851028-13 devstack@n-api.service[106315]: INFO nova.api.openstack.requestlog [None req-f5e57fed-8129-4b88-9e6c-1a59f2594bba admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.393325 Oct 04 18:22:39.390343 n-d-851028-13 devstack@n-api.service[106315]: [pid: 106315|app: 0|req: 19/39] 10.222.0.43 () {60 vars in 1190 bytes} [Tue Oct 4 18:22:38 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 394 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 04 18:22:39.396619 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi [None req-3d95be60-a68e-483c-84d5-3660abebce5b admin admin] Calling method '>' {{(pid=106314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:39.400628 n-d-851028-13 devstack@n-api.service[106314]: DEBUG dbcounter [-] [106314] Writing DB stats nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:INSERT=2,nova_api:RELEASE=1 {{(pid=106314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:22:39.420118 n-d-851028-13 devstack@n-api.service[106314]: INFO nova.api.openstack.requestlog [None req-3d95be60-a68e-483c-84d5-3660abebce5b admin admin] 10.222.0.43 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.027071 Oct 04 18:22:39.420672 n-d-851028-13 devstack@n-api.service[106314]: [pid: 106314|app: 0|req: 21/40] 10.222.0.43 () {60 vars in 1210 bytes} [Tue Oct 4 18:22:39 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:22:39.432223 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi [None req-4740785c-deca-47ae-b3b1-82bed1e6cc3e admin admin] Calling method '>' {{(pid=106315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:39.453935 n-d-851028-13 devstack@n-api.service[106315]: INFO nova.api.openstack.requestlog [None req-4740785c-deca-47ae-b3b1-82bed1e6cc3e admin admin] 10.222.0.43 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026136 Oct 04 18:22:39.454513 n-d-851028-13 devstack@n-api.service[106315]: [pid: 106315|app: 0|req: 20/41] 10.222.0.43 () {60 vars in 1210 bytes} [Tue Oct 4 18:22:39 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:22:39.465223 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi [None req-6f3004c2-79f2-4099-866f-336c4819a4d2 admin admin] Calling method '>' {{(pid=106314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:39.470826 n-d-851028-13 devstack@n-api.service[106314]: INFO nova.api.openstack.wsgi [None req-6f3004c2-79f2-4099-866f-336c4819a4d2 admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 04 18:22:39.474670 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi [None req-6f3004c2-79f2-4099-866f-336c4819a4d2 admin admin] Request method failure captured: Oct 04 18:22:39.474670 n-d-851028-13 devstack@n-api.service[106314]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 04 18:22:39.474670 n-d-851028-13 devstack@n-api.service[106314]: Accept: application/json Oct 04 18:22:39.474670 n-d-851028-13 devstack@n-api.service[106314]: Accept-Encoding: gzip, deflate Oct 04 18:22:39.474670 n-d-851028-13 devstack@n-api.service[106314]: Connection: keep-alive Oct 04 18:22:39.474670 n-d-851028-13 devstack@n-api.service[106314]: Content-Length: 0 Oct 04 18:22:39.474670 n-d-851028-13 devstack@n-api.service[106314]: Host: 10.222.0.43 Oct 04 18:22:39.474670 n-d-851028-13 devstack@n-api.service[106314]: Openstack-Api-Version: compute 2.92 Oct 04 18:22:39.474670 n-d-851028-13 devstack@n-api.service[106314]: Openstack-System-Scope: None Oct 04 18:22:39.474670 n-d-851028-13 devstack@n-api.service[106314]: User-Agent: python-novaclient Oct 04 18:22:39.474670 n-d-851028-13 devstack@n-api.service[106314]: X-Auth-Token: gAAAAABjPHnuOsZcI1-AYgyGSCfy4daK7jw4Ao--51RCqs5Kos_-GxJmBG4nH5icy4cjBI5N9lyPRbJLOrr9dD-cqUCd9CF4wLCifPPKZjYTm4uUpKpr57HEb3xBc4Bc3mQh7iiJqmpEmfX1HjTuy7kVKDkZCiWljW3DIWQhAsHXGho8zS6AWuY Oct 04 18:22:39.474670 n-d-851028-13 devstack@n-api.service[106314]: X-Domain-Id: None Oct 04 18:22:39.474670 n-d-851028-13 devstack@n-api.service[106314]: X-Domain-Name: None Oct 04 18:22:39.474670 n-d-851028-13 devstack@n-api.service[106314]: X-Identity-Status: Confirmed Oct 04 18:22:39.474670 n-d-851028-13 devstack@n-api.service[106314]: X-Is-Admin-Project: True Oct 04 18:22:39.474670 n-d-851028-13 devstack@n-api.service[106314]: X-Openstack-Nova-Api-Version: 2.92 Oct 04 18:22:39.474670 n-d-851028-13 devstack@n-api.service[106314]: X-Project-Domain-Id: default Oct 04 18:22:39.474670 n-d-851028-13 devstack@n-api.service[106314]: X-Project-Domain-Name: Default Oct 04 18:22:39.474670 n-d-851028-13 devstack@n-api.service[106314]: X-Project-Id: ebc51fee132346e3a9b98c1d4182768c Oct 04 18:22:39.474670 n-d-851028-13 devstack@n-api.service[106314]: X-Project-Name: admin Oct 04 18:22:39.474670 n-d-851028-13 devstack@n-api.service[106314]: X-Role: member,admin,reader Oct 04 18:22:39.474670 n-d-851028-13 devstack@n-api.service[106314]: X-Roles: member,admin,reader Oct 04 18:22:39.476364 n-d-851028-13 devstack@n-api.service[106314]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/ebc51fee132346e3a9b98c1d4182768c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_ebc51fee132346e3a9b98c1d4182768c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ebc51fee132346e3a9b98c1d4182768c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ebc51fee132346e3a9b98c1d4182768c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:22:39.476364 n-d-851028-13 devstack@n-api.service[106314]: X-Tenant: admin Oct 04 18:22:39.476364 n-d-851028-13 devstack@n-api.service[106314]: X-Tenant-Id: ebc51fee132346e3a9b98c1d4182768c Oct 04 18:22:39.476364 n-d-851028-13 devstack@n-api.service[106314]: X-Tenant-Name: admin Oct 04 18:22:39.476364 n-d-851028-13 devstack@n-api.service[106314]: X-User: admin Oct 04 18:22:39.476364 n-d-851028-13 devstack@n-api.service[106314]: X-User-Domain-Id: default Oct 04 18:22:39.476364 n-d-851028-13 devstack@n-api.service[106314]: X-User-Domain-Name: Default Oct 04 18:22:39.476364 n-d-851028-13 devstack@n-api.service[106314]: X-User-Id: 2b44626252bf448c9675c7795de7cc87 Oct 04 18:22:39.476364 n-d-851028-13 devstack@n-api.service[106314]: X-User-Name: admin Oct 04 18:22:39.476364 n-d-851028-13 devstack@n-api.service[106314]: method: > Oct 04 18:22:39.476364 n-d-851028-13 devstack@n-api.service[106314]: exception: Flavor 42 could not be found. Oct 04 18:22:39.476364 n-d-851028-13 devstack@n-api.service[106314]: action_args: {'id': '42'} Oct 04 18:22:39.476364 n-d-851028-13 devstack@n-api.service[106314]: {{(pid=106314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:22:39.476364 n-d-851028-13 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:22:39.477239 n-d-851028-13 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 04 18:22:39.477239 n-d-851028-13 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 04 18:22:39.477239 n-d-851028-13 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 04 18:22:39.477239 n-d-851028-13 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 04 18:22:39.477239 n-d-851028-13 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 18:22:39.477239 n-d-851028-13 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 18:22:39.477239 n-d-851028-13 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 04 18:22:39.477239 n-d-851028-13 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 04 18:22:39.477239 n-d-851028-13 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 04 18:22:39.477239 n-d-851028-13 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:22:39.477239 n-d-851028-13 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 04 18:22:39.477239 n-d-851028-13 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 04 18:22:39.477239 n-d-851028-13 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 04 18:22:39.477239 n-d-851028-13 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi Oct 04 18:22:39.477239 n-d-851028-13 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:22:39.477239 n-d-851028-13 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi Oct 04 18:22:39.477239 n-d-851028-13 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:22:39.477239 n-d-851028-13 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:22:39.477239 n-d-851028-13 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:22:39.478467 n-d-851028-13 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:22:39.478467 n-d-851028-13 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:22:39.478467 n-d-851028-13 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:22:39.478467 n-d-851028-13 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:22:39.478467 n-d-851028-13 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 04 18:22:39.478467 n-d-851028-13 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:22:39.478467 n-d-851028-13 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 04 18:22:39.478467 n-d-851028-13 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi Oct 04 18:22:39.478467 n-d-851028-13 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:22:39.478467 n-d-851028-13 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi Oct 04 18:22:39.478467 n-d-851028-13 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:22:39.478467 n-d-851028-13 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:22:39.478467 n-d-851028-13 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:22:39.478467 n-d-851028-13 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:22:39.478467 n-d-851028-13 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:22:39.478467 n-d-851028-13 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 04 18:22:39.478467 n-d-851028-13 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi Oct 04 18:22:39.478467 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi [None req-6f3004c2-79f2-4099-866f-336c4819a4d2 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106314) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:22:39.479707 n-d-851028-13 devstack@n-api.service[106314]: INFO nova.api.openstack.requestlog [None req-6f3004c2-79f2-4099-866f-336c4819a4d2 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.014955 Oct 04 18:22:39.479707 n-d-851028-13 devstack@n-api.service[106314]: [pid: 106314|app: 0|req: 22/42] 10.222.0.43 () {60 vars in 1190 bytes} [Tue Oct 4 18:22:39 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 04 18:22:40.725671 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi [None req-4740785c-deca-47ae-b3b1-82bed1e6cc3e admin admin] Calling method '>' {{(pid=106315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:40.726732 n-d-851028-13 devstack@n-api.service[106315]: INFO nova.api.openstack.requestlog [None req-4740785c-deca-47ae-b3b1-82bed1e6cc3e admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001530 Oct 04 18:22:40.727128 n-d-851028-13 devstack@n-api.service[106315]: [pid: 106315|app: 0|req: 21/43] 10.222.0.43 () {56 vars in 1074 bytes} [Tue Oct 4 18:22:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:22:41.387781 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi [None req-ad02c3ca-56f2-4962-91be-6520fd4d0f51 admin admin] Calling method '>' {{(pid=106314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:41.392753 n-d-851028-13 devstack@n-api.service[106314]: INFO nova.api.openstack.wsgi [None req-ad02c3ca-56f2-4962-91be-6520fd4d0f51 admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 04 18:22:41.394269 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi [None req-ad02c3ca-56f2-4962-91be-6520fd4d0f51 admin admin] Request method failure captured: Oct 04 18:22:41.394269 n-d-851028-13 devstack@n-api.service[106314]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 04 18:22:41.394269 n-d-851028-13 devstack@n-api.service[106314]: Accept: application/json Oct 04 18:22:41.394269 n-d-851028-13 devstack@n-api.service[106314]: Accept-Encoding: gzip, deflate Oct 04 18:22:41.394269 n-d-851028-13 devstack@n-api.service[106314]: Connection: keep-alive Oct 04 18:22:41.394269 n-d-851028-13 devstack@n-api.service[106314]: Content-Length: 0 Oct 04 18:22:41.394269 n-d-851028-13 devstack@n-api.service[106314]: Host: 10.222.0.43 Oct 04 18:22:41.394269 n-d-851028-13 devstack@n-api.service[106314]: Openstack-Api-Version: compute 2.92 Oct 04 18:22:41.394269 n-d-851028-13 devstack@n-api.service[106314]: Openstack-System-Scope: None Oct 04 18:22:41.394269 n-d-851028-13 devstack@n-api.service[106314]: User-Agent: python-novaclient Oct 04 18:22:41.394269 n-d-851028-13 devstack@n-api.service[106314]: X-Auth-Token: gAAAAABjPHnwgjsZlluFf23Wd4B8UlvNXJyF4ZG8FfgF0jDp21DGLktqLiEofZcW13P8htTbpoobT2eGXMKNo_mncwAp3SRzgtAr_NSVLN7blCqZHeh68MF2z9iR1bOr-gzO2N_NVEv7jjTNRfD0IFL7xGo30mkM14dnCj5caCIcAmatxc18keQ Oct 04 18:22:41.394269 n-d-851028-13 devstack@n-api.service[106314]: X-Domain-Id: None Oct 04 18:22:41.394269 n-d-851028-13 devstack@n-api.service[106314]: X-Domain-Name: None Oct 04 18:22:41.394269 n-d-851028-13 devstack@n-api.service[106314]: X-Identity-Status: Confirmed Oct 04 18:22:41.394269 n-d-851028-13 devstack@n-api.service[106314]: X-Is-Admin-Project: True Oct 04 18:22:41.394269 n-d-851028-13 devstack@n-api.service[106314]: X-Openstack-Nova-Api-Version: 2.92 Oct 04 18:22:41.394269 n-d-851028-13 devstack@n-api.service[106314]: X-Project-Domain-Id: default Oct 04 18:22:41.394269 n-d-851028-13 devstack@n-api.service[106314]: X-Project-Domain-Name: Default Oct 04 18:22:41.394269 n-d-851028-13 devstack@n-api.service[106314]: X-Project-Id: ebc51fee132346e3a9b98c1d4182768c Oct 04 18:22:41.394269 n-d-851028-13 devstack@n-api.service[106314]: X-Project-Name: admin Oct 04 18:22:41.394269 n-d-851028-13 devstack@n-api.service[106314]: X-Role: member,admin,reader Oct 04 18:22:41.394269 n-d-851028-13 devstack@n-api.service[106314]: X-Roles: member,admin,reader Oct 04 18:22:41.396017 n-d-851028-13 devstack@n-api.service[106314]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/ebc51fee132346e3a9b98c1d4182768c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_ebc51fee132346e3a9b98c1d4182768c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ebc51fee132346e3a9b98c1d4182768c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ebc51fee132346e3a9b98c1d4182768c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:22:41.396017 n-d-851028-13 devstack@n-api.service[106314]: X-Tenant: admin Oct 04 18:22:41.396017 n-d-851028-13 devstack@n-api.service[106314]: X-Tenant-Id: ebc51fee132346e3a9b98c1d4182768c Oct 04 18:22:41.396017 n-d-851028-13 devstack@n-api.service[106314]: X-Tenant-Name: admin Oct 04 18:22:41.396017 n-d-851028-13 devstack@n-api.service[106314]: X-User: admin Oct 04 18:22:41.396017 n-d-851028-13 devstack@n-api.service[106314]: X-User-Domain-Id: default Oct 04 18:22:41.396017 n-d-851028-13 devstack@n-api.service[106314]: X-User-Domain-Name: Default Oct 04 18:22:41.396017 n-d-851028-13 devstack@n-api.service[106314]: X-User-Id: 2b44626252bf448c9675c7795de7cc87 Oct 04 18:22:41.396017 n-d-851028-13 devstack@n-api.service[106314]: X-User-Name: admin Oct 04 18:22:41.396017 n-d-851028-13 devstack@n-api.service[106314]: method: > Oct 04 18:22:41.396017 n-d-851028-13 devstack@n-api.service[106314]: exception: Flavor 84 could not be found. Oct 04 18:22:41.396017 n-d-851028-13 devstack@n-api.service[106314]: action_args: {'id': '84'} Oct 04 18:22:41.396017 n-d-851028-13 devstack@n-api.service[106314]: {{(pid=106314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:22:41.396017 n-d-851028-13 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:22:41.397187 n-d-851028-13 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 04 18:22:41.397187 n-d-851028-13 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 04 18:22:41.397187 n-d-851028-13 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 04 18:22:41.397187 n-d-851028-13 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 04 18:22:41.397187 n-d-851028-13 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 18:22:41.397187 n-d-851028-13 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 18:22:41.397187 n-d-851028-13 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 04 18:22:41.397187 n-d-851028-13 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 04 18:22:41.397187 n-d-851028-13 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 04 18:22:41.397187 n-d-851028-13 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:22:41.397187 n-d-851028-13 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 04 18:22:41.397187 n-d-851028-13 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 04 18:22:41.397187 n-d-851028-13 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 04 18:22:41.397187 n-d-851028-13 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi Oct 04 18:22:41.397187 n-d-851028-13 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:22:41.397187 n-d-851028-13 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi Oct 04 18:22:41.397187 n-d-851028-13 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:22:41.397187 n-d-851028-13 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:22:41.397187 n-d-851028-13 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:22:41.398689 n-d-851028-13 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:22:41.398689 n-d-851028-13 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:22:41.398689 n-d-851028-13 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:22:41.398689 n-d-851028-13 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:22:41.398689 n-d-851028-13 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 04 18:22:41.398689 n-d-851028-13 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:22:41.398689 n-d-851028-13 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 04 18:22:41.398689 n-d-851028-13 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi Oct 04 18:22:41.398689 n-d-851028-13 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:22:41.398689 n-d-851028-13 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi Oct 04 18:22:41.398689 n-d-851028-13 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:22:41.398689 n-d-851028-13 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:22:41.398689 n-d-851028-13 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:22:41.398689 n-d-851028-13 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:22:41.398689 n-d-851028-13 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:22:41.398689 n-d-851028-13 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 04 18:22:41.398689 n-d-851028-13 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi Oct 04 18:22:41.398689 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi [None req-ad02c3ca-56f2-4962-91be-6520fd4d0f51 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106314) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:22:41.400257 n-d-851028-13 devstack@n-api.service[106314]: INFO nova.api.openstack.requestlog [None req-ad02c3ca-56f2-4962-91be-6520fd4d0f51 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.530525 Oct 04 18:22:41.400257 n-d-851028-13 devstack@n-api.service[106314]: [pid: 106314|app: 0|req: 23/44] 10.222.0.43 () {60 vars in 1190 bytes} [Tue Oct 4 18:22:40 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 532 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 04 18:22:41.405380 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi [None req-056f847e-c5e3-4fae-8d9c-b14f020ff689 admin admin] Calling method '>' {{(pid=106315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:41.421306 n-d-851028-13 devstack@n-api.service[106315]: INFO nova.api.openstack.requestlog [None req-056f847e-c5e3-4fae-8d9c-b14f020ff689 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019370 Oct 04 18:22:41.421887 n-d-851028-13 devstack@n-api.service[106315]: [pid: 106315|app: 0|req: 22/45] 10.222.0.43 () {60 vars in 1210 bytes} [Tue Oct 4 18:22:41 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:22:41.431568 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi [None req-6dfb9695-ed16-4619-bf15-b551071d6588 admin admin] Calling method '>' {{(pid=106314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:41.447190 n-d-851028-13 devstack@n-api.service[106314]: INFO nova.api.openstack.requestlog [None req-6dfb9695-ed16-4619-bf15-b551071d6588 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019158 Oct 04 18:22:41.447714 n-d-851028-13 devstack@n-api.service[106314]: [pid: 106314|app: 0|req: 24/46] 10.222.0.43 () {60 vars in 1210 bytes} [Tue Oct 4 18:22:41 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:22:41.458052 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi [None req-dfdf595d-5feb-41ca-88ca-dc7100912c30 admin admin] Calling method '>' {{(pid=106315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:41.463114 n-d-851028-13 devstack@n-api.service[106315]: INFO nova.api.openstack.wsgi [None req-dfdf595d-5feb-41ca-88ca-dc7100912c30 admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 04 18:22:41.464600 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi [None req-dfdf595d-5feb-41ca-88ca-dc7100912c30 admin admin] Request method failure captured: Oct 04 18:22:41.464600 n-d-851028-13 devstack@n-api.service[106315]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 04 18:22:41.464600 n-d-851028-13 devstack@n-api.service[106315]: Accept: application/json Oct 04 18:22:41.464600 n-d-851028-13 devstack@n-api.service[106315]: Accept-Encoding: gzip, deflate Oct 04 18:22:41.464600 n-d-851028-13 devstack@n-api.service[106315]: Connection: keep-alive Oct 04 18:22:41.464600 n-d-851028-13 devstack@n-api.service[106315]: Content-Length: 0 Oct 04 18:22:41.464600 n-d-851028-13 devstack@n-api.service[106315]: Host: 10.222.0.43 Oct 04 18:22:41.464600 n-d-851028-13 devstack@n-api.service[106315]: Openstack-Api-Version: compute 2.92 Oct 04 18:22:41.464600 n-d-851028-13 devstack@n-api.service[106315]: Openstack-System-Scope: None Oct 04 18:22:41.464600 n-d-851028-13 devstack@n-api.service[106315]: User-Agent: python-novaclient Oct 04 18:22:41.464600 n-d-851028-13 devstack@n-api.service[106315]: X-Auth-Token: gAAAAABjPHnwgjsZlluFf23Wd4B8UlvNXJyF4ZG8FfgF0jDp21DGLktqLiEofZcW13P8htTbpoobT2eGXMKNo_mncwAp3SRzgtAr_NSVLN7blCqZHeh68MF2z9iR1bOr-gzO2N_NVEv7jjTNRfD0IFL7xGo30mkM14dnCj5caCIcAmatxc18keQ Oct 04 18:22:41.464600 n-d-851028-13 devstack@n-api.service[106315]: X-Domain-Id: None Oct 04 18:22:41.464600 n-d-851028-13 devstack@n-api.service[106315]: X-Domain-Name: None Oct 04 18:22:41.464600 n-d-851028-13 devstack@n-api.service[106315]: X-Identity-Status: Confirmed Oct 04 18:22:41.464600 n-d-851028-13 devstack@n-api.service[106315]: X-Is-Admin-Project: True Oct 04 18:22:41.464600 n-d-851028-13 devstack@n-api.service[106315]: X-Openstack-Nova-Api-Version: 2.92 Oct 04 18:22:41.464600 n-d-851028-13 devstack@n-api.service[106315]: X-Project-Domain-Id: default Oct 04 18:22:41.464600 n-d-851028-13 devstack@n-api.service[106315]: X-Project-Domain-Name: Default Oct 04 18:22:41.464600 n-d-851028-13 devstack@n-api.service[106315]: X-Project-Id: ebc51fee132346e3a9b98c1d4182768c Oct 04 18:22:41.464600 n-d-851028-13 devstack@n-api.service[106315]: X-Project-Name: admin Oct 04 18:22:41.464600 n-d-851028-13 devstack@n-api.service[106315]: X-Role: member,admin,reader Oct 04 18:22:41.464600 n-d-851028-13 devstack@n-api.service[106315]: X-Roles: member,admin,reader Oct 04 18:22:41.466137 n-d-851028-13 devstack@n-api.service[106315]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/ebc51fee132346e3a9b98c1d4182768c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_ebc51fee132346e3a9b98c1d4182768c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ebc51fee132346e3a9b98c1d4182768c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ebc51fee132346e3a9b98c1d4182768c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:22:41.466137 n-d-851028-13 devstack@n-api.service[106315]: X-Tenant: admin Oct 04 18:22:41.466137 n-d-851028-13 devstack@n-api.service[106315]: X-Tenant-Id: ebc51fee132346e3a9b98c1d4182768c Oct 04 18:22:41.466137 n-d-851028-13 devstack@n-api.service[106315]: X-Tenant-Name: admin Oct 04 18:22:41.466137 n-d-851028-13 devstack@n-api.service[106315]: X-User: admin Oct 04 18:22:41.466137 n-d-851028-13 devstack@n-api.service[106315]: X-User-Domain-Id: default Oct 04 18:22:41.466137 n-d-851028-13 devstack@n-api.service[106315]: X-User-Domain-Name: Default Oct 04 18:22:41.466137 n-d-851028-13 devstack@n-api.service[106315]: X-User-Id: 2b44626252bf448c9675c7795de7cc87 Oct 04 18:22:41.466137 n-d-851028-13 devstack@n-api.service[106315]: X-User-Name: admin Oct 04 18:22:41.466137 n-d-851028-13 devstack@n-api.service[106315]: method: > Oct 04 18:22:41.466137 n-d-851028-13 devstack@n-api.service[106315]: exception: Flavor 84 could not be found. Oct 04 18:22:41.466137 n-d-851028-13 devstack@n-api.service[106315]: action_args: {'id': '84'} Oct 04 18:22:41.466137 n-d-851028-13 devstack@n-api.service[106315]: {{(pid=106315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:22:41.466137 n-d-851028-13 devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:22:41.466976 n-d-851028-13 devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 04 18:22:41.466976 n-d-851028-13 devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 04 18:22:41.466976 n-d-851028-13 devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 04 18:22:41.466976 n-d-851028-13 devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 04 18:22:41.466976 n-d-851028-13 devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 18:22:41.466976 n-d-851028-13 devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 18:22:41.466976 n-d-851028-13 devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 04 18:22:41.466976 n-d-851028-13 devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 04 18:22:41.466976 n-d-851028-13 devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 04 18:22:41.466976 n-d-851028-13 devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:22:41.466976 n-d-851028-13 devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 04 18:22:41.466976 n-d-851028-13 devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 04 18:22:41.466976 n-d-851028-13 devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 04 18:22:41.466976 n-d-851028-13 devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi Oct 04 18:22:41.466976 n-d-851028-13 devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:22:41.466976 n-d-851028-13 devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi Oct 04 18:22:41.466976 n-d-851028-13 devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:22:41.466976 n-d-851028-13 devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:22:41.466976 n-d-851028-13 devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:22:41.468660 n-d-851028-13 devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:22:41.468660 n-d-851028-13 devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:22:41.468660 n-d-851028-13 devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:22:41.468660 n-d-851028-13 devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:22:41.468660 n-d-851028-13 devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 04 18:22:41.468660 n-d-851028-13 devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:22:41.468660 n-d-851028-13 devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 04 18:22:41.468660 n-d-851028-13 devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi Oct 04 18:22:41.468660 n-d-851028-13 devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:22:41.468660 n-d-851028-13 devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi Oct 04 18:22:41.468660 n-d-851028-13 devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:22:41.468660 n-d-851028-13 devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:22:41.468660 n-d-851028-13 devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:22:41.468660 n-d-851028-13 devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:22:41.468660 n-d-851028-13 devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:22:41.468660 n-d-851028-13 devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 04 18:22:41.468660 n-d-851028-13 devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi Oct 04 18:22:41.468660 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi [None req-dfdf595d-5feb-41ca-88ca-dc7100912c30 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106315) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:22:41.470093 n-d-851028-13 devstack@n-api.service[106315]: INFO nova.api.openstack.requestlog [None req-dfdf595d-5feb-41ca-88ca-dc7100912c30 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.012392 Oct 04 18:22:41.470093 n-d-851028-13 devstack@n-api.service[106315]: [pid: 106315|app: 0|req: 23/47] 10.222.0.43 () {60 vars in 1190 bytes} [Tue Oct 4 18:22:41 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 04 18:22:42.689323 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi [None req-6dfb9695-ed16-4619-bf15-b551071d6588 admin admin] Calling method '>' {{(pid=106314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:42.691158 n-d-851028-13 devstack@n-api.service[106314]: INFO nova.api.openstack.requestlog [None req-6dfb9695-ed16-4619-bf15-b551071d6588 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002283 Oct 04 18:22:42.691551 n-d-851028-13 devstack@n-api.service[106314]: [pid: 106314|app: 0|req: 25/48] 10.222.0.43 () {56 vars in 1074 bytes} [Tue Oct 4 18:22:42 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:22:43.216009 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi [None req-53ac9735-43ef-4fb6-8478-42d9f953513a admin admin] Calling method '>' {{(pid=106315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:43.221930 n-d-851028-13 devstack@n-api.service[106315]: INFO nova.api.openstack.wsgi [None req-53ac9735-43ef-4fb6-8478-42d9f953513a admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 04 18:22:43.223415 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi [None req-53ac9735-43ef-4fb6-8478-42d9f953513a admin admin] Request method failure captured: Oct 04 18:22:43.223415 n-d-851028-13 devstack@n-api.service[106315]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 04 18:22:43.223415 n-d-851028-13 devstack@n-api.service[106315]: Accept: application/json Oct 04 18:22:43.223415 n-d-851028-13 devstack@n-api.service[106315]: Accept-Encoding: gzip, deflate Oct 04 18:22:43.223415 n-d-851028-13 devstack@n-api.service[106315]: Connection: keep-alive Oct 04 18:22:43.223415 n-d-851028-13 devstack@n-api.service[106315]: Content-Length: 0 Oct 04 18:22:43.223415 n-d-851028-13 devstack@n-api.service[106315]: Host: 10.222.0.43 Oct 04 18:22:43.223415 n-d-851028-13 devstack@n-api.service[106315]: Openstack-Api-Version: compute 2.92 Oct 04 18:22:43.223415 n-d-851028-13 devstack@n-api.service[106315]: Openstack-System-Scope: None Oct 04 18:22:43.223415 n-d-851028-13 devstack@n-api.service[106315]: User-Agent: python-novaclient Oct 04 18:22:43.223415 n-d-851028-13 devstack@n-api.service[106315]: X-Auth-Token: gAAAAABjPHnyTdETCfBBvamzZFfEMIZtKb3gvN1BihGH5xg8x5vujFPqlCefacU2xMDH20-_Yehtp8AAXpecs1iSoX1YKCwGsXHUZtB7WYgjNJhhIeRl67R6S5XhsGxNZkAwPF7NiIxlwAikU8hoVpT20eh3oj-w0CWqi4zzBQyz8Ik3rrgk0JI Oct 04 18:22:43.223415 n-d-851028-13 devstack@n-api.service[106315]: X-Domain-Id: None Oct 04 18:22:43.223415 n-d-851028-13 devstack@n-api.service[106315]: X-Domain-Name: None Oct 04 18:22:43.223415 n-d-851028-13 devstack@n-api.service[106315]: X-Identity-Status: Confirmed Oct 04 18:22:43.223415 n-d-851028-13 devstack@n-api.service[106315]: X-Is-Admin-Project: True Oct 04 18:22:43.223415 n-d-851028-13 devstack@n-api.service[106315]: X-Openstack-Nova-Api-Version: 2.92 Oct 04 18:22:43.223415 n-d-851028-13 devstack@n-api.service[106315]: X-Project-Domain-Id: default Oct 04 18:22:43.223415 n-d-851028-13 devstack@n-api.service[106315]: X-Project-Domain-Name: Default Oct 04 18:22:43.223415 n-d-851028-13 devstack@n-api.service[106315]: X-Project-Id: ebc51fee132346e3a9b98c1d4182768c Oct 04 18:22:43.223415 n-d-851028-13 devstack@n-api.service[106315]: X-Project-Name: admin Oct 04 18:22:43.223415 n-d-851028-13 devstack@n-api.service[106315]: X-Role: member,admin,reader Oct 04 18:22:43.223415 n-d-851028-13 devstack@n-api.service[106315]: X-Roles: member,admin,reader Oct 04 18:22:43.224964 n-d-851028-13 devstack@n-api.service[106315]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/ebc51fee132346e3a9b98c1d4182768c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_ebc51fee132346e3a9b98c1d4182768c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ebc51fee132346e3a9b98c1d4182768c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ebc51fee132346e3a9b98c1d4182768c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:22:43.224964 n-d-851028-13 devstack@n-api.service[106315]: X-Tenant: admin Oct 04 18:22:43.224964 n-d-851028-13 devstack@n-api.service[106315]: X-Tenant-Id: ebc51fee132346e3a9b98c1d4182768c Oct 04 18:22:43.224964 n-d-851028-13 devstack@n-api.service[106315]: X-Tenant-Name: admin Oct 04 18:22:43.224964 n-d-851028-13 devstack@n-api.service[106315]: X-User: admin Oct 04 18:22:43.224964 n-d-851028-13 devstack@n-api.service[106315]: X-User-Domain-Id: default Oct 04 18:22:43.224964 n-d-851028-13 devstack@n-api.service[106315]: X-User-Domain-Name: Default Oct 04 18:22:43.224964 n-d-851028-13 devstack@n-api.service[106315]: X-User-Id: 2b44626252bf448c9675c7795de7cc87 Oct 04 18:22:43.224964 n-d-851028-13 devstack@n-api.service[106315]: X-User-Name: admin Oct 04 18:22:43.224964 n-d-851028-13 devstack@n-api.service[106315]: method: > Oct 04 18:22:43.224964 n-d-851028-13 devstack@n-api.service[106315]: exception: Flavor 451 could not be found. Oct 04 18:22:43.224964 n-d-851028-13 devstack@n-api.service[106315]: action_args: {'id': '451'} Oct 04 18:22:43.224964 n-d-851028-13 devstack@n-api.service[106315]: {{(pid=106315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:22:43.224964 n-d-851028-13 devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:22:43.226040 n-d-851028-13 devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 04 18:22:43.226040 n-d-851028-13 devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 04 18:22:43.226040 n-d-851028-13 devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 04 18:22:43.226040 n-d-851028-13 devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 04 18:22:43.226040 n-d-851028-13 devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 18:22:43.226040 n-d-851028-13 devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 18:22:43.226040 n-d-851028-13 devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 04 18:22:43.226040 n-d-851028-13 devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 04 18:22:43.226040 n-d-851028-13 devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 04 18:22:43.226040 n-d-851028-13 devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:22:43.226040 n-d-851028-13 devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 04 18:22:43.226040 n-d-851028-13 devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 04 18:22:43.226040 n-d-851028-13 devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 04 18:22:43.226040 n-d-851028-13 devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi Oct 04 18:22:43.226040 n-d-851028-13 devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:22:43.226040 n-d-851028-13 devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi Oct 04 18:22:43.226040 n-d-851028-13 devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:22:43.226040 n-d-851028-13 devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:22:43.226040 n-d-851028-13 devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:22:43.227332 n-d-851028-13 devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:22:43.227332 n-d-851028-13 devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:22:43.227332 n-d-851028-13 devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:22:43.227332 n-d-851028-13 devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:22:43.227332 n-d-851028-13 devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 04 18:22:43.227332 n-d-851028-13 devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:22:43.227332 n-d-851028-13 devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 04 18:22:43.227332 n-d-851028-13 devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi Oct 04 18:22:43.227332 n-d-851028-13 devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:22:43.227332 n-d-851028-13 devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi Oct 04 18:22:43.227332 n-d-851028-13 devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:22:43.227332 n-d-851028-13 devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:22:43.227332 n-d-851028-13 devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:22:43.227332 n-d-851028-13 devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:22:43.227332 n-d-851028-13 devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:22:43.227332 n-d-851028-13 devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 04 18:22:43.227332 n-d-851028-13 devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi Oct 04 18:22:43.227332 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi [None req-53ac9735-43ef-4fb6-8478-42d9f953513a admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106315) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:22:43.228636 n-d-851028-13 devstack@n-api.service[106315]: INFO nova.api.openstack.requestlog [None req-53ac9735-43ef-4fb6-8478-42d9f953513a admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.394117 Oct 04 18:22:43.228636 n-d-851028-13 devstack@n-api.service[106315]: [pid: 106315|app: 0|req: 24/49] 10.222.0.43 () {60 vars in 1193 bytes} [Tue Oct 4 18:22:42 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 395 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 04 18:22:43.234573 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi [None req-81493d99-c7d4-4c08-9af1-5f29edc9ef0f admin admin] Calling method '>' {{(pid=106314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:43.249688 n-d-851028-13 devstack@n-api.service[106314]: INFO nova.api.openstack.requestlog [None req-81493d99-c7d4-4c08-9af1-5f29edc9ef0f admin admin] 10.222.0.43 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018736 Oct 04 18:22:43.250206 n-d-851028-13 devstack@n-api.service[106314]: [pid: 106314|app: 0|req: 26/50] 10.222.0.43 () {60 vars in 1210 bytes} [Tue Oct 4 18:22:43 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:22:43.260282 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi [None req-57b6ff29-5bb8-4c4d-a39f-022a41b558e1 admin admin] Calling method '>' {{(pid=106315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:43.275097 n-d-851028-13 devstack@n-api.service[106315]: INFO nova.api.openstack.requestlog [None req-57b6ff29-5bb8-4c4d-a39f-022a41b558e1 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018321 Oct 04 18:22:43.275625 n-d-851028-13 devstack@n-api.service[106315]: [pid: 106315|app: 0|req: 25/51] 10.222.0.43 () {60 vars in 1210 bytes} [Tue Oct 4 18:22:43 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:22:43.284760 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi [None req-b916e075-2134-4cd3-9a3c-daef779903af admin admin] Calling method '>' {{(pid=106314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:43.289684 n-d-851028-13 devstack@n-api.service[106314]: INFO nova.api.openstack.wsgi [None req-b916e075-2134-4cd3-9a3c-daef779903af admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 04 18:22:43.291173 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi [None req-b916e075-2134-4cd3-9a3c-daef779903af admin admin] Request method failure captured: Oct 04 18:22:43.291173 n-d-851028-13 devstack@n-api.service[106314]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 04 18:22:43.291173 n-d-851028-13 devstack@n-api.service[106314]: Accept: application/json Oct 04 18:22:43.291173 n-d-851028-13 devstack@n-api.service[106314]: Accept-Encoding: gzip, deflate Oct 04 18:22:43.291173 n-d-851028-13 devstack@n-api.service[106314]: Connection: keep-alive Oct 04 18:22:43.291173 n-d-851028-13 devstack@n-api.service[106314]: Content-Length: 0 Oct 04 18:22:43.291173 n-d-851028-13 devstack@n-api.service[106314]: Host: 10.222.0.43 Oct 04 18:22:43.291173 n-d-851028-13 devstack@n-api.service[106314]: Openstack-Api-Version: compute 2.92 Oct 04 18:22:43.291173 n-d-851028-13 devstack@n-api.service[106314]: Openstack-System-Scope: None Oct 04 18:22:43.291173 n-d-851028-13 devstack@n-api.service[106314]: User-Agent: python-novaclient Oct 04 18:22:43.291173 n-d-851028-13 devstack@n-api.service[106314]: X-Auth-Token: gAAAAABjPHnyTdETCfBBvamzZFfEMIZtKb3gvN1BihGH5xg8x5vujFPqlCefacU2xMDH20-_Yehtp8AAXpecs1iSoX1YKCwGsXHUZtB7WYgjNJhhIeRl67R6S5XhsGxNZkAwPF7NiIxlwAikU8hoVpT20eh3oj-w0CWqi4zzBQyz8Ik3rrgk0JI Oct 04 18:22:43.291173 n-d-851028-13 devstack@n-api.service[106314]: X-Domain-Id: None Oct 04 18:22:43.291173 n-d-851028-13 devstack@n-api.service[106314]: X-Domain-Name: None Oct 04 18:22:43.291173 n-d-851028-13 devstack@n-api.service[106314]: X-Identity-Status: Confirmed Oct 04 18:22:43.291173 n-d-851028-13 devstack@n-api.service[106314]: X-Is-Admin-Project: True Oct 04 18:22:43.291173 n-d-851028-13 devstack@n-api.service[106314]: X-Openstack-Nova-Api-Version: 2.92 Oct 04 18:22:43.291173 n-d-851028-13 devstack@n-api.service[106314]: X-Project-Domain-Id: default Oct 04 18:22:43.291173 n-d-851028-13 devstack@n-api.service[106314]: X-Project-Domain-Name: Default Oct 04 18:22:43.291173 n-d-851028-13 devstack@n-api.service[106314]: X-Project-Id: ebc51fee132346e3a9b98c1d4182768c Oct 04 18:22:43.291173 n-d-851028-13 devstack@n-api.service[106314]: X-Project-Name: admin Oct 04 18:22:43.291173 n-d-851028-13 devstack@n-api.service[106314]: X-Role: member,admin,reader Oct 04 18:22:43.291173 n-d-851028-13 devstack@n-api.service[106314]: X-Roles: member,admin,reader Oct 04 18:22:43.292703 n-d-851028-13 devstack@n-api.service[106314]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/ebc51fee132346e3a9b98c1d4182768c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_ebc51fee132346e3a9b98c1d4182768c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ebc51fee132346e3a9b98c1d4182768c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ebc51fee132346e3a9b98c1d4182768c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:22:43.292703 n-d-851028-13 devstack@n-api.service[106314]: X-Tenant: admin Oct 04 18:22:43.292703 n-d-851028-13 devstack@n-api.service[106314]: X-Tenant-Id: ebc51fee132346e3a9b98c1d4182768c Oct 04 18:22:43.292703 n-d-851028-13 devstack@n-api.service[106314]: X-Tenant-Name: admin Oct 04 18:22:43.292703 n-d-851028-13 devstack@n-api.service[106314]: X-User: admin Oct 04 18:22:43.292703 n-d-851028-13 devstack@n-api.service[106314]: X-User-Domain-Id: default Oct 04 18:22:43.292703 n-d-851028-13 devstack@n-api.service[106314]: X-User-Domain-Name: Default Oct 04 18:22:43.292703 n-d-851028-13 devstack@n-api.service[106314]: X-User-Id: 2b44626252bf448c9675c7795de7cc87 Oct 04 18:22:43.292703 n-d-851028-13 devstack@n-api.service[106314]: X-User-Name: admin Oct 04 18:22:43.292703 n-d-851028-13 devstack@n-api.service[106314]: method: > Oct 04 18:22:43.292703 n-d-851028-13 devstack@n-api.service[106314]: exception: Flavor 451 could not be found. Oct 04 18:22:43.292703 n-d-851028-13 devstack@n-api.service[106314]: action_args: {'id': '451'} Oct 04 18:22:43.292703 n-d-851028-13 devstack@n-api.service[106314]: {{(pid=106314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:22:43.292703 n-d-851028-13 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:22:43.293724 n-d-851028-13 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 04 18:22:43.293724 n-d-851028-13 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 04 18:22:43.293724 n-d-851028-13 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 04 18:22:43.293724 n-d-851028-13 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 04 18:22:43.293724 n-d-851028-13 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 18:22:43.293724 n-d-851028-13 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 18:22:43.293724 n-d-851028-13 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 04 18:22:43.293724 n-d-851028-13 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 04 18:22:43.293724 n-d-851028-13 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 04 18:22:43.293724 n-d-851028-13 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:22:43.293724 n-d-851028-13 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 04 18:22:43.293724 n-d-851028-13 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 04 18:22:43.293724 n-d-851028-13 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 04 18:22:43.293724 n-d-851028-13 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi Oct 04 18:22:43.293724 n-d-851028-13 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:22:43.293724 n-d-851028-13 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi Oct 04 18:22:43.293724 n-d-851028-13 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:22:43.293724 n-d-851028-13 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:22:43.293724 n-d-851028-13 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:22:43.295088 n-d-851028-13 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:22:43.295088 n-d-851028-13 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:22:43.295088 n-d-851028-13 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:22:43.295088 n-d-851028-13 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:22:43.295088 n-d-851028-13 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 04 18:22:43.295088 n-d-851028-13 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:22:43.295088 n-d-851028-13 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 04 18:22:43.295088 n-d-851028-13 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi Oct 04 18:22:43.295088 n-d-851028-13 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:22:43.295088 n-d-851028-13 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi Oct 04 18:22:43.295088 n-d-851028-13 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:22:43.295088 n-d-851028-13 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:22:43.295088 n-d-851028-13 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:22:43.295088 n-d-851028-13 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:22:43.295088 n-d-851028-13 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:22:43.295088 n-d-851028-13 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 04 18:22:43.295088 n-d-851028-13 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi Oct 04 18:22:43.295088 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi [None req-b916e075-2134-4cd3-9a3c-daef779903af admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106314) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:22:43.296432 n-d-851028-13 devstack@n-api.service[106314]: INFO nova.api.openstack.requestlog [None req-b916e075-2134-4cd3-9a3c-daef779903af admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.011246 Oct 04 18:22:43.296432 n-d-851028-13 devstack@n-api.service[106314]: [pid: 106314|app: 0|req: 27/52] 10.222.0.43 () {60 vars in 1193 bytes} [Tue Oct 4 18:22:43 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 04 18:22:44.554304 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi [None req-57b6ff29-5bb8-4c4d-a39f-022a41b558e1 admin admin] Calling method '>' {{(pid=106315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:44.555339 n-d-851028-13 devstack@n-api.service[106315]: INFO nova.api.openstack.requestlog [None req-57b6ff29-5bb8-4c4d-a39f-022a41b558e1 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001494 Oct 04 18:22:44.555726 n-d-851028-13 devstack@n-api.service[106315]: [pid: 106315|app: 0|req: 26/53] 10.222.0.43 () {56 vars in 1074 bytes} [Tue Oct 4 18:22:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:22:45.100929 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi [None req-4267d646-3d4f-4ae1-9923-cd3da503caa7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:22:45.120295 n-d-851028-13 devstack@n-api.service[106314]: INFO nova.api.openstack.requestlog [None req-4267d646-3d4f-4ae1-9923-cd3da503caa7 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.426305 Oct 04 18:22:45.120852 n-d-851028-13 devstack@n-api.service[106314]: [pid: 106314|app: 0|req: 28/54] 10.222.0.43 () {64 vars in 1235 bytes} [Tue Oct 4 18:22:44 2022] POST /compute/v2.1/flavors => generated 404 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:22:46.339820 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi [None req-57b6ff29-5bb8-4c4d-a39f-022a41b558e1 admin admin] Calling method '>' {{(pid=106315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:46.340827 n-d-851028-13 devstack@n-api.service[106315]: INFO nova.api.openstack.requestlog [None req-57b6ff29-5bb8-4c4d-a39f-022a41b558e1 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001495 Oct 04 18:22:46.341252 n-d-851028-13 devstack@n-api.service[106315]: [pid: 106315|app: 0|req: 27/55] 10.222.0.43 () {56 vars in 1074 bytes} [Tue Oct 4 18:22:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:22:46.882218 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi [None req-15e5f399-d552-4700-ab57-a7085d830a08 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:22:46.900838 n-d-851028-13 devstack@n-api.service[106314]: INFO nova.api.openstack.requestlog [None req-15e5f399-d552-4700-ab57-a7085d830a08 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.423652 Oct 04 18:22:46.901450 n-d-851028-13 devstack@n-api.service[106314]: [pid: 106314|app: 0|req: 29/56] 10.222.0.43 () {64 vars in 1235 bytes} [Tue Oct 4 18:22:46 2022] POST /compute/v2.1/flavors => generated 405 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:22:48.141627 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi [None req-57b6ff29-5bb8-4c4d-a39f-022a41b558e1 admin admin] Calling method '>' {{(pid=106315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:48.143308 n-d-851028-13 devstack@n-api.service[106315]: INFO nova.api.openstack.requestlog [None req-57b6ff29-5bb8-4c4d-a39f-022a41b558e1 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 Oct 04 18:22:48.143743 n-d-851028-13 devstack@n-api.service[106315]: [pid: 106315|app: 0|req: 28/57] 10.222.0.43 () {56 vars in 1074 bytes} [Tue Oct 4 18:22:48 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:22:48.664321 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi [None req-dc40fbbd-c42f-466c-a404-0d05ce74aae1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:22:48.683217 n-d-851028-13 devstack@n-api.service[106314]: INFO nova.api.openstack.requestlog [None req-dc40fbbd-c42f-466c-a404-0d05ce74aae1 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.399532 Oct 04 18:22:48.683777 n-d-851028-13 devstack@n-api.service[106314]: [pid: 106314|app: 0|req: 30/58] 10.222.0.43 () {64 vars in 1235 bytes} [Tue Oct 4 18:22:48 2022] POST /compute/v2.1/flavors => generated 407 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:22:49.905795 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi [None req-57b6ff29-5bb8-4c4d-a39f-022a41b558e1 admin admin] Calling method '>' {{(pid=106315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:49.906851 n-d-851028-13 devstack@n-api.service[106315]: INFO nova.api.openstack.requestlog [None req-57b6ff29-5bb8-4c4d-a39f-022a41b558e1 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001516 Oct 04 18:22:49.907251 n-d-851028-13 devstack@n-api.service[106315]: [pid: 106315|app: 0|req: 29/59] 10.222.0.43 () {56 vars in 1074 bytes} [Tue Oct 4 18:22:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:22:50.431138 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi [None req-33550149-1f06-4b17-8485-1a0929f157de admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:22:50.449382 n-d-851028-13 devstack@n-api.service[106314]: INFO nova.api.openstack.requestlog [None req-33550149-1f06-4b17-8485-1a0929f157de admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.404821 Oct 04 18:22:50.449929 n-d-851028-13 devstack@n-api.service[106314]: [pid: 106314|app: 0|req: 31/60] 10.222.0.43 () {64 vars in 1235 bytes} [Tue Oct 4 18:22:50 2022] POST /compute/v2.1/flavors => generated 409 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:22:51.725881 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi [None req-57b6ff29-5bb8-4c4d-a39f-022a41b558e1 admin admin] Calling method '>' {{(pid=106315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:51.726943 n-d-851028-13 devstack@n-api.service[106315]: INFO nova.api.openstack.requestlog [None req-57b6ff29-5bb8-4c4d-a39f-022a41b558e1 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001527 Oct 04 18:22:51.727381 n-d-851028-13 devstack@n-api.service[106315]: [pid: 106315|app: 0|req: 30/61] 10.222.0.43 () {56 vars in 1074 bytes} [Tue Oct 4 18:22:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:22:52.286731 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi [None req-848e1dd2-51fa-4024-a0c9-aed327564f8b admin admin] Calling method '>' {{(pid=106314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:52.308289 n-d-851028-13 devstack@n-api.service[106314]: INFO nova.api.openstack.requestlog [None req-848e1dd2-51fa-4024-a0c9-aed327564f8b admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.435719 Oct 04 18:22:52.308860 n-d-851028-13 devstack@n-api.service[106314]: [pid: 106314|app: 0|req: 32/62] 10.222.0.43 () {60 vars in 1202 bytes} [Tue Oct 4 18:22:51 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:23:50.769312 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi [None req-57b6ff29-5bb8-4c4d-a39f-022a41b558e1 admin admin] Calling method '>' {{(pid=106315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:50.770347 n-d-851028-13 devstack@n-api.service[106315]: INFO nova.api.openstack.requestlog [None req-57b6ff29-5bb8-4c4d-a39f-022a41b558e1 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001529 Oct 04 18:23:50.770781 n-d-851028-13 devstack@n-api.service[106315]: [pid: 106315|app: 0|req: 31/63] 10.222.0.43 () {54 vars in 931 bytes} [Tue Oct 4 18:23:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:23:50.783698 n-d-851028-13 devstack@n-api.service[106314]: DEBUG dbcounter [-] [106314] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=106314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:23:51.193216 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi [None req-3feb5732-719a-403c-b0d3-bea28b8e7f9a admin admin] Calling method '>' {{(pid=106314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:51.214634 n-d-851028-13 devstack@n-api.service[106314]: INFO nova.api.openstack.requestlog [None req-3feb5732-719a-403c-b0d3-bea28b8e7f9a admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.437180 Oct 04 18:23:51.215185 n-d-851028-13 devstack@n-api.service[106314]: [pid: 106314|app: 0|req: 33/64] 10.222.0.43 () {60 vars in 1292 bytes} [Tue Oct 4 18:23:50 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:23:51.236012 n-d-851028-13 devstack@n-api.service[106315]: DEBUG dbcounter [-] [106315] Writing DB stats nova_api:SELECT=14 {{(pid=106315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:23:51.240293 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi [None req-c404fcb6-4e99-47e8-bc15-864fd26dec1a admin admin] Calling method '>' {{(pid=106315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:51.248834 n-d-851028-13 devstack@n-api.service[106315]: INFO nova.api.openstack.requestlog [None req-c404fcb6-4e99-47e8-bc15-864fd26dec1a admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.014239 Oct 04 18:23:51.249422 n-d-851028-13 devstack@n-api.service[106315]: [pid: 106315|app: 0|req: 32/65] 10.222.0.43 () {60 vars in 1283 bytes} [Tue Oct 4 18:23:51 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:51.261491 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi [None req-71c731df-3bfb-4de4-9830-e17b302809f3 admin admin] Calling method '>' {{(pid=106314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:51.269404 n-d-851028-13 devstack@n-api.service[106314]: INFO nova.api.openstack.requestlog [None req-71c731df-3bfb-4de4-9830-e17b302809f3 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011651 Oct 04 18:23:51.269946 n-d-851028-13 devstack@n-api.service[106314]: [pid: 106314|app: 0|req: 34/66] 10.222.0.43 () {60 vars in 1286 bytes} [Tue Oct 4 18:23:51 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:51.281701 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi [None req-5791a973-6c4f-4512-9d89-9752aef28073 admin admin] Calling method '>' {{(pid=106315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:51.288934 n-d-851028-13 devstack@n-api.service[106315]: INFO nova.api.openstack.requestlog [None req-5791a973-6c4f-4512-9d89-9752aef28073 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010988 Oct 04 18:23:51.289520 n-d-851028-13 devstack@n-api.service[106315]: [pid: 106315|app: 0|req: 33/67] 10.222.0.43 () {60 vars in 1286 bytes} [Tue Oct 4 18:23:51 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:51.300858 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi [None req-a3afe5ce-23fa-4a9d-b68c-c7375c414bb5 admin admin] Calling method '>' {{(pid=106314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:51.308232 n-d-851028-13 devstack@n-api.service[106314]: INFO nova.api.openstack.requestlog [None req-a3afe5ce-23fa-4a9d-b68c-c7375c414bb5 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010911 Oct 04 18:23:51.308764 n-d-851028-13 devstack@n-api.service[106314]: [pid: 106314|app: 0|req: 35/68] 10.222.0.43 () {60 vars in 1283 bytes} [Tue Oct 4 18:23:51 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:29.931028 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi [None req-5791a973-6c4f-4512-9d89-9752aef28073 admin admin] Calling method '>' {{(pid=106315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:29.932172 n-d-851028-13 devstack@n-api.service[106315]: INFO nova.api.openstack.requestlog [None req-5791a973-6c4f-4512-9d89-9752aef28073 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001585 Oct 04 18:29:29.932579 n-d-851028-13 devstack@n-api.service[106315]: [pid: 106315|app: 0|req: 34/69] 10.222.0.43 () {56 vars in 1074 bytes} [Tue Oct 4 18:29:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:29:30.072648 n-d-851028-13 devstack@n-api.service[106314]: DEBUG dbcounter [-] [106314] Writing DB stats nova_api:SELECT=6 {{(pid=106314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:29:30.218874 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi [None req-8194aa36-8d04-4b26-87a2-d273df60ca6d admin admin] Calling method '>' {{(pid=106314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:30.223574 n-d-851028-13 devstack@n-api.service[106314]: DEBUG oslo_concurrency.lockutils [None req-8194aa36-8d04-4b26-87a2-d273df60ca6d admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:30.224048 n-d-851028-13 devstack@n-api.service[106314]: DEBUG oslo_concurrency.lockutils [None req-8194aa36-8d04-4b26-87a2-d273df60ca6d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:30.224480 n-d-851028-13 devstack@n-api.service[106314]: DEBUG oslo_concurrency.lockutils [None req-8194aa36-8d04-4b26-87a2-d273df60ca6d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:30.225902 n-d-851028-13 devstack@n-api.service[106314]: DEBUG oslo_concurrency.lockutils [None req-8194aa36-8d04-4b26-87a2-d273df60ca6d admin admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:30.226354 n-d-851028-13 devstack@n-api.service[106314]: DEBUG oslo_concurrency.lockutils [None req-8194aa36-8d04-4b26-87a2-d273df60ca6d admin admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:30.226770 n-d-851028-13 devstack@n-api.service[106314]: DEBUG oslo_concurrency.lockutils [None req-8194aa36-8d04-4b26-87a2-d273df60ca6d admin admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:30.264608 n-d-851028-13 devstack@n-api.service[106314]: INFO nova.api.openstack.requestlog [None req-8194aa36-8d04-4b26-87a2-d273df60ca6d admin admin] 10.222.0.43 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.92 time: 0.193045 Oct 04 18:29:30.265191 n-d-851028-13 devstack@n-api.service[106314]: [pid: 106314|app: 0|req: 36/70] 10.222.0.43 () {60 vars in 1193 bytes} [Tue Oct 4 18:29:30 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:29:31.369462 n-d-851028-13 devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi [None req-5791a973-6c4f-4512-9d89-9752aef28073 admin admin] Calling method '>' {{(pid=106315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:31.370471 n-d-851028-13 devstack@n-api.service[106315]: INFO nova.api.openstack.requestlog [None req-5791a973-6c4f-4512-9d89-9752aef28073 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Oct 04 18:29:31.371143 n-d-851028-13 devstack@n-api.service[106315]: [pid: 106315|app: 0|req: 35/71] 10.222.0.43 () {56 vars in 1074 bytes} [Tue Oct 4 18:29:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:29:31.563631 n-d-851028-13 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi [None req-29d30535-818a-4d24-89b0-137ec0c9a3f4 admin admin] Calling method '>' {{(pid=106314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:31.567585 n-d-851028-13 devstack@n-api.service[106314]: DEBUG oslo_concurrency.lockutils [None req-29d30535-818a-4d24-89b0-137ec0c9a3f4 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:31.568100 n-d-851028-13 devstack@n-api.service[106314]: DEBUG oslo_concurrency.lockutils [None req-29d30535-818a-4d24-89b0-137ec0c9a3f4 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:31.568995 n-d-851028-13 devstack@n-api.service[106314]: DEBUG oslo_concurrency.lockutils [None req-29d30535-818a-4d24-89b0-137ec0c9a3f4 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:31.569748 n-d-851028-13 devstack@n-api.service[106314]: DEBUG oslo_concurrency.lockutils [None req-29d30535-818a-4d24-89b0-137ec0c9a3f4 admin admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:31.570543 n-d-851028-13 devstack@n-api.service[106314]: DEBUG oslo_concurrency.lockutils [None req-29d30535-818a-4d24-89b0-137ec0c9a3f4 admin admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:31.570543 n-d-851028-13 devstack@n-api.service[106314]: DEBUG oslo_concurrency.lockutils [None req-29d30535-818a-4d24-89b0-137ec0c9a3f4 admin admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:31.595369 n-d-851028-13 devstack@n-api.service[106314]: INFO nova.api.openstack.requestlog [None req-29d30535-818a-4d24-89b0-137ec0c9a3f4 admin admin] 10.222.0.43 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.92 time: 0.086527 Oct 04 18:29:31.595940 n-d-851028-13 devstack@n-api.service[106314]: [pid: 106314|app: 0|req: 37/72] 10.222.0.43 () {60 vars in 1193 bytes} [Tue Oct 4 18:29:31 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:30:22.439169 n-d-851028-13 systemd[1]: Stopping Devstack devstack@n-api.service... Oct 04 18:30:22.439693 n-d-851028-13 devstack@n-api.service[106313]: Tue Oct 4 18:30:22 2022 - graceful shutdown triggered... Oct 04 18:30:22.440162 n-d-851028-13 devstack@n-api.service[106315]: Gracefully killing worker 2 (pid: 106315)... Oct 04 18:30:22.440900 n-d-851028-13 devstack@n-api.service[106314]: Gracefully killing worker 1 (pid: 106314)... Oct 04 18:30:22.567693 n-d-851028-13 devstack@n-api.service[106315]: DEBUG dbcounter [-] [106315] Writing DB stats nova_api:SELECT=4 {{(pid=106315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:30:23.439837 n-d-851028-13 devstack@n-api.service[106313]: worker 1 buried after 1 seconds Oct 04 18:30:23.439837 n-d-851028-13 devstack@n-api.service[106313]: worker 2 buried after 1 seconds Oct 04 18:30:23.441226 n-d-851028-13 devstack@n-api.service[106313]: goodbye to uWSGI. Oct 04 18:30:23.442272 n-d-851028-13 systemd[1]: devstack@n-api.service: Succeeded. Oct 04 18:30:23.442836 n-d-851028-13 systemd[1]: Stopped Devstack devstack@n-api.service. Oct 04 18:30:23.445549 n-d-851028-13 systemd[1]: Starting Devstack devstack@n-api.service... Oct 04 18:30:23.459097 n-d-851028-13 devstack@n-api.service[123584]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 04 18:30:23.480029 n-d-851028-13 devstack@n-api.service[123584]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Oct 4 18:30:23 2022] *** Oct 04 18:30:23.480029 n-d-851028-13 devstack@n-api.service[123584]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 04 18:30:23.480029 n-d-851028-13 devstack@n-api.service[123584]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 04 18:30:23.480029 n-d-851028-13 devstack@n-api.service[123584]: nodename: n-d-851028-13 Oct 04 18:30:23.480029 n-d-851028-13 devstack@n-api.service[123584]: machine: x86_64 Oct 04 18:30:23.480029 n-d-851028-13 devstack@n-api.service[123584]: clock source: unix Oct 04 18:30:23.480029 n-d-851028-13 devstack@n-api.service[123584]: pcre jit disabled Oct 04 18:30:23.480029 n-d-851028-13 devstack@n-api.service[123584]: detected number of CPU cores: 4 Oct 04 18:30:23.480029 n-d-851028-13 devstack@n-api.service[123584]: current working directory: / Oct 04 18:30:23.480029 n-d-851028-13 devstack@n-api.service[123584]: detected binary path: /usr/bin/uwsgi-core Oct 04 18:30:23.480029 n-d-851028-13 devstack@n-api.service[123584]: your processes number limit is 47680 Oct 04 18:30:23.480029 n-d-851028-13 devstack@n-api.service[123584]: your memory page size is 4096 bytes Oct 04 18:30:23.480029 n-d-851028-13 devstack@n-api.service[123584]: detected max file descriptor number: 2048 Oct 04 18:30:23.480029 n-d-851028-13 devstack@n-api.service[123584]: lock engine: pthread robust mutexes Oct 04 18:30:23.481307 n-d-851028-13 devstack@n-api.service[123584]: thunder lock: enabled Oct 04 18:30:23.481307 n-d-851028-13 devstack@n-api.service[123584]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 04 18:30:23.481307 n-d-851028-13 devstack@n-api.service[123584]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 04 18:30:23.523978 n-d-851028-13 devstack@n-api.service[123584]: Python main interpreter initialized at 0x558acfc689c0 Oct 04 18:30:23.523978 n-d-851028-13 devstack@n-api.service[123584]: python threads support enabled Oct 04 18:30:23.523978 n-d-851028-13 devstack@n-api.service[123584]: your server socket listen backlog is limited to 100 connections Oct 04 18:30:23.523978 n-d-851028-13 devstack@n-api.service[123584]: your mercy for graceful operations on workers is 90 seconds Oct 04 18:30:23.524559 n-d-851028-13 devstack@n-api.service[123584]: mapped 403077 bytes (393 KB) for 2 cores Oct 04 18:30:23.524713 n-d-851028-13 devstack@n-api.service[123584]: *** Operational MODE: preforking *** Oct 04 18:30:23.524940 n-d-851028-13 devstack@n-api.service[123584]: *** uWSGI is running in multiple interpreter mode *** Oct 04 18:30:23.524940 n-d-851028-13 devstack@n-api.service[123584]: spawned uWSGI master process (pid: 123584) Oct 04 18:30:23.525183 n-d-851028-13 systemd[1]: Started Devstack devstack@n-api.service. Oct 04 18:30:23.525777 n-d-851028-13 devstack@n-api.service[123584]: spawned uWSGI worker 1 (pid: 123595, cores: 1) Oct 04 18:30:23.526146 n-d-851028-13 devstack@n-api.service[123584]: spawned uWSGI worker 2 (pid: 123596, cores: 1) Oct 04 18:30:23.526563 n-d-851028-13 devstack@n-api.service[123584]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 04 18:30:24.194875 n-d-851028-13 devstack@n-api.service[123596]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 04 18:30:24.204777 n-d-851028-13 devstack@n-api.service[123595]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 04 18:30:25.396078 n-d-851028-13 devstack@n-api.service[123596]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 18:30:25.396078 n-d-851028-13 devstack@n-api.service[123596]: from cryptography.utils import int_from_bytes Oct 04 18:30:25.397024 n-d-851028-13 devstack@n-api.service[123596]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 18:30:25.397024 n-d-851028-13 devstack@n-api.service[123596]: from cryptography.utils import int_from_bytes Oct 04 18:30:25.398171 n-d-851028-13 devstack@n-api.service[123595]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 18:30:25.398171 n-d-851028-13 devstack@n-api.service[123595]: from cryptography.utils import int_from_bytes Oct 04 18:30:25.398619 n-d-851028-13 devstack@n-api.service[123595]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 18:30:25.398619 n-d-851028-13 devstack@n-api.service[123595]: from cryptography.utils import int_from_bytes Oct 04 18:30:27.945028 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 04 18:30:27.945677 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 04 18:30:27.945889 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 04 18:30:27.946255 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 04 18:30:27.946518 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 04 18:30:27.946915 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.947246 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.947577 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.948653 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.948653 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.948838 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.949022 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.949378 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.949713 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.950183 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.950690 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.951039 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-851028-13 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.951374 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.951691 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.952196 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.952468 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.952780 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.953188 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.953451 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.954091 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.954611 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.955066 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.955841 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.956133 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.956458 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.956876 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.957236 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.957556 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.958030 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.958188 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.958609 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-851028-13 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.960001 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.960001 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.960001 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.960001 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.960588 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.960588 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.960878 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.961297 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.961621 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.961875 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.962208 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.962530 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.962854 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.963166 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.963485 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.963797 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.964130 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.964441 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.964751 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.965008 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.965369 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.965700 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.966033 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.966364 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.966619 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.966876 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.967201 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.967534 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.967847 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.968166 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.968478 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.968787 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.969166 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.969597 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.969920 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.970236 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.970563 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.971500 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.971784 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.971969 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 04 18:30:27.972564 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.972716 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 04 18:30:27.972863 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.973015 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 04 18:30:27.973217 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.43 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.973217 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.43 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.974129 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 04 18:30:27.974374 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.974613 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 04 18:30:27.974879 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.975104 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.975284 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.975284 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.975582 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.975781 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.975941 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.975941 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.976223 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.976385 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.976531 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.976735 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.976978 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.977230 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.977440 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.977615 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.977762 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.977915 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.978095 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.979695 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.979818 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.979917 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.980020 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.980115 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-851028-13 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.980213 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.980304 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.980398 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.980501 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.980595 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.980679 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.980773 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.980865 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.980960 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.981040 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.981362 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.981463 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.981562 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.981650 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.981732 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.981732 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.981887 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.981995 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.982086 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.982180 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.982259 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.982352 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.982436 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.982519 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.982600 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.982697 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.982787 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.982878 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.982960 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.983045 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.983138 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.983237 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.983328 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.983421 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.983511 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.983595 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.983754 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.983842 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.983925 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-851028-13 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.984011 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.984169 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.984272 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.984489 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.984592 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.985156 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.985296 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.985384 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.985466 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.985545 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.985623 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.985859 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.986012 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.986188 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.986591 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.986698 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.986904 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.987059 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.987247 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.987355 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.987571 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.987689 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.987895 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.988006 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.988220 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.988347 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.988529 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.988661 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.988876 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.988981 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.989178 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.989447 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.989544 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.991257 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.991394 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.991475 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.991566 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.991566 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.991743 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.991861 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.991990 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.992082 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.992082 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.992233 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.992314 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.992397 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.992476 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.992549 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.992625 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.992625 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.992771 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.992849 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.992922 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.992999 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.993503 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.993676 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.993834 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.993980 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.994124 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.994492 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.994654 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.994808 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.994962 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.995116 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.995282 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.995435 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.995590 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:27.995744 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.995900 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:27.996060 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.996060 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.996350 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:27.996493 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.996643 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:27.996796 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.996940 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:27.997094 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.997408 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:27.997408 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:27.997699 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.43 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.997699 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.43 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.997983 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:27.998136 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.998289 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:27.998439 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.998598 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:27.998742 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.998885 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:27.999034 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.999196 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:27.999348 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.999501 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:27.999652 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:27.999802 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:27.999945 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:28.000096 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.000247 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:28.000401 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.000552 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:28.000703 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.000857 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:28.001001 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.001189 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:28.001347 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.001493 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:28.001643 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.001793 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:28.001971 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.002130 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:28.002274 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.002425 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:28.002577 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.002721 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:28.002870 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.003032 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:28.003199 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.003461 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:28.003613 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.003765 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:28.003910 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.004066 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:28.004219 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.004382 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:28.007226 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.007399 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:28.007568 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.007728 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:28.007889 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.008034 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:28.008177 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.008319 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:28.008319 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:28.008612 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.008793 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:28.009042 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.009276 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:28.009502 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.009725 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:28.009931 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.010139 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:28.010367 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.011913 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:28.012153 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.012592 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:28.012816 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.013043 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:28.015150 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.015397 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:28.015599 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.015783 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:28.016024 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.016420 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:28.016586 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.016756 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:28.016910 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.017087 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:28.017292 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.017462 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:28.018120 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.018280 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:28.018708 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.018874 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:28.019020 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.019179 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:28.019333 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.019487 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:28.019652 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.019797 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:28.019941 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.020093 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:28.020251 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.020403 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:28.020548 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.020691 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:28.020835 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.020977 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:28.021273 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.021427 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:28.021578 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.021741 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:28.021886 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.022029 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:28.022186 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.022337 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:28.022482 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.022625 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:28.022767 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.022910 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:28.022910 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:28.023201 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.023345 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:28.023499 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.023649 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:28.023649 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:28.023950 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.024095 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:28.024238 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.024388 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:28.024532 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.024707 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:28.025125 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.025281 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:28.025281 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:28.025570 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.025725 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:30:28.025878 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.026031 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.026245 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.026403 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.026561 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.026713 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.026871 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.027024 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.027168 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.027311 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.027456 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.027611 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.027775 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.027918 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.028061 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.028204 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.028347 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.028499 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.028643 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.028786 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.028938 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.029081 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.029348 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.029506 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.029670 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.029817 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.029967 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.030111 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.030268 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.030412 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.030554 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.030704 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.030849 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.030999 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.031163 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.031316 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.031467 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.031628 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.031772 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.031924 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.032077 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.034050 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.034209 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.034300 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.034405 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.034503 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.034598 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.034682 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.034773 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.034861 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.034962 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.035052 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.035052 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.035196 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.035269 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.035341 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.035420 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.035522 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.035608 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.035682 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.035754 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.035833 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.035905 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.036007 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.036092 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.036166 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.036244 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.036406 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.036510 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.036605 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.036679 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.036757 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.036830 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.036909 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.036991 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.037073 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.037207 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.037304 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.037391 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.037473 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.037616 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.037725 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.037801 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.037882 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.037962 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.038043 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.038135 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.038210 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.038289 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.038361 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.038456 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.038581 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.038581 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.038581 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.038581 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.038581 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.038581 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.038581 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.038581 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.039201 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.039284 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.039364 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.039437 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.039519 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.039593 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.039672 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.039753 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.039832 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.039913 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.039999 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.039999 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.040139 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.040226 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.040306 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.040386 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.040473 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.040546 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.040546 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.040685 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.040685 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.040829 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.040911 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.040983 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.041055 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.041154 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.041244 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.041326 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.041408 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.041481 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.041552 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.041686 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.041995 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.042085 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.042167 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.042254 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.042254 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.042254 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.042483 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.042645 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.042742 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.042966 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.043250 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.043354 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.043453 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.043647 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.044489 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.044596 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.044673 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.044752 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.044825 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.044912 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.044912 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.045054 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.045261 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.045342 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.045566 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.045698 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.046044 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.046527 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.046626 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.046712 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.046900 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.047044 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.047244 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.047382 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.047571 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.047712 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.047902 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.048026 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.048221 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.048352 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.048546 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.048684 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.048893 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.049019 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.049259 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.049470 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.049599 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.049814 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.049946 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.050142 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.050264 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.050457 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.050594 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.050777 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.050910 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.051082 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.051206 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.051391 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.051537 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.052424 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.052572 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.052714 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.052850 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.052982 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.053281 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.053386 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.053482 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.053578 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.053703 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.053854 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.053948 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.054035 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.054120 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.054204 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.054322 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.054424 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.054512 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.054605 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.054738 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.054838 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.055045 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.055190 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.055286 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.055418 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.055611 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.055732 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.055930 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.056085 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.056243 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.056433 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.056567 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.056763 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.056896 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.057094 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.057240 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.057566 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.057883 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.058202 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.058537 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.058858 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.059671 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.059861 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.060006 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.060150 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.060307 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.060441 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.060634 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.060782 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.060782 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.061044 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.061451 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.061590 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.061729 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.061729 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.061991 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.062296 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.062750 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.062970 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.063130 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.063418 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.063724 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.064061 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.064399 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.064770 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.064878 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.065227 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.065670 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.066017 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.066349 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.066685 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.067044 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.067378 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.067551 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.067704 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.067924 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.068101 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.068292 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.068449 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.068640 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.068989 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.069211 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.069376 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.069610 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.069776 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.070015 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.070176 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.070346 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.070677 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.070856 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.071014 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.071265 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.071420 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.071637 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.071828 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.071997 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.072266 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.072429 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.072679 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.072923 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.073246 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.073433 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.073615 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.073805 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.073984 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.074581 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.074749 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.074901 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.074901 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.075195 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.075350 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.075506 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.075663 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.075811 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.075979 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.076128 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.076282 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.076429 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.076584 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.076741 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.076896 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.077044 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.077290 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.077533 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.077692 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.077857 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.078005 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.078174 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.078322 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.078477 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.078656 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.078845 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.079004 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.079152 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.079299 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.079460 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.079608 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.079763 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.079922 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.080071 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.080745 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.080909 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.081086 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.081299 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.081459 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.081608 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.081764 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.081921 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.082069 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.082225 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.082380 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.082529 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.082685 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.082966 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.083122 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.083297 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.083541 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.083695 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.083853 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.084003 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.084149 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.084734 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.084899 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.085063 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.085271 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.085425 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.085583 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.085732 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.085885 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.086042 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.086198 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.086355 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.086511 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.086659 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.086813 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.086970 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.087126 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.087315 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.087479 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.087628 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.087782 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.087940 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.088096 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.088244 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.088391 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.088550 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.088707 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.088864 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.089019 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.089226 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.089389 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.089557 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.089722 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.089879 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.090033 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.090181 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.090181 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.090531 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.090787 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.090947 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.091097 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.091252 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.091409 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.091557 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.091727 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.091876 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.091876 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.092174 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.092322 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.092478 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.092627 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.092774 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.092774 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.093222 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.093222 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.093543 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.093795 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.093795 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.094107 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.094262 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.094908 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.095088 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.095421 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.096373 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.096700 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.097023 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.098558 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.098759 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.098759 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.099085 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.099252 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.099413 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.099413 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.099745 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.100088 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.100424 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.100534 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.100761 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.100908 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.101091 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.101370 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.101653 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.101750 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.102042 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.102146 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.102527 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.102643 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.102743 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.102967 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.103099 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.103306 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.103411 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.103626 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.103733 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.103960 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.104078 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.104284 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.104380 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.105077 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.105236 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.105236 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.105421 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.105518 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.105703 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.105800 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.106223 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.106348 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.106498 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.106704 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.106829 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.107216 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.107315 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.107552 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.107659 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.107909 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.108082 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.108195 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.108462 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.108568 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.108836 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.108933 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.109317 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.109441 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.109534 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.109806 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.109926 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.110145 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.110241 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.110465 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.110571 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.110802 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.111125 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.111434 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.111546 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.111777 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.111883 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.112110 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.112207 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.112438 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.112542 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.112752 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.112847 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.113072 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.113255 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.113461 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.113581 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.113748 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.113883 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.114091 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.114209 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.114520 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.114860 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.115333 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.115433 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.115433 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.115606 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.115704 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.115883 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.116014 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.116121 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.116337 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.116464 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.116653 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.116897 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.117003 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.117333 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.117433 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.117652 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.117764 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.117985 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.118097 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.118310 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.118406 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.118626 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.118734 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.118943 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.119038 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.119420 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.119530 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.119619 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.119715 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.119870 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.119975 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.120188 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.120320 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.120639 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.120751 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.120959 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.121056 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.121377 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.121476 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.121699 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.121796 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.122020 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.122116 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.122339 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.122434 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.122688 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.123009 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.123115 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.124009 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.124155 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.124288 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.124288 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.124623 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.124861 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.125433 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.125814 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.126154 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.126477 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.127335 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.127839 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.127949 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.128237 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.128359 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.128459 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.128678 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.128783 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.129031 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.129160 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.129400 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.129503 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.129734 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.129836 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.130054 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.130157 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.130393 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.130498 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.130738 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.130841 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.131090 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.131197 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.131458 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.131591 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.131799 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.131989 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.132158 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.132325 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.132491 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.132655 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.132867 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.133030 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.133248 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.133493 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.133811 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.134146 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.134469 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.134776 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.135056 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.135657 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.135829 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.135987 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.136150 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.136305 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.136470 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.136633 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.136789 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.136952 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.137134 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.137300 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.137469 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.137636 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.137800 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.137963 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.138118 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.138273 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.138440 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.138602 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.138845 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.139007 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.139171 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.139326 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.139500 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.139668 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.139834 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.139988 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.140150 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.140313 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.140469 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.140623 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.140785 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.140941 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.141103 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.141356 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.141514 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.141674 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.141860 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.142054 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.142224 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.142395 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.143141 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.143410 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.143631 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.143803 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.143962 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.144133 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.144432 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.144610 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.144766 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.144932 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.145221 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.145875 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.145875 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.146220 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.146330 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.146430 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.146615 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.146615 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.146786 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.146869 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.146944 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.147209 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.147478 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.147640 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.147797 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.147954 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.148108 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.148263 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.148407 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.148551 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.148729 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.148886 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.149047 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.149346 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.149453 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.149696 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.150151 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.150477 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.150800 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.150925 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.151117 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.151258 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.151440 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.151631 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.151762 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.151960 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.152113 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.152303 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.152443 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.152656 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.152798 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.153003 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.153308 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.153436 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.153679 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.153795 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.154004 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.154101 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.154330 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.154449 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.154656 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.154872 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.154980 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.155250 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.155369 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.155534 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.155755 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.155872 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.156082 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.156187 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.156405 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.156524 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.156720 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.156817 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.157036 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.157239 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.157409 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.157697 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.157810 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.158017 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.158125 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.158946 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.159047 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.159222 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.159389 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.159554 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.159712 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.159866 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.160132 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.160247 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.160495 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.160601 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.160811 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.160918 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.184858 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.184858 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.184858 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.184858 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.185963 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.186153 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.186866 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.187125 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.187125 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.187125 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.187125 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.188190 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.188374 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.188374 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.188721 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.188895 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.189081 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.189261 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.189453 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.189596 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.189728 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.189871 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.190004 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.190136 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.190525 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.190525 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.190853 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.190853 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.191104 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.191236 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.191378 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.191552 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.191694 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.191694 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.191943 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.192073 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.192202 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.192341 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.192474 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.192777 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.192777 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.193033 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.193219 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.193369 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.193369 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.193621 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.193752 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.193884 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.194024 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.194157 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.194289 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.194422 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.194553 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.194685 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.194824 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.194971 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.195146 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.195283 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.195528 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.195670 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.195879 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.195879 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.196134 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.196266 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.196399 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.196539 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.196672 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.196672 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.196672 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.196672 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.197384 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.197578 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.197738 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.197738 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.198199 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.199039 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.199320 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.199583 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.199779 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.199978 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.200257 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.200538 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.200820 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.201101 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.201429 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.201691 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.201891 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.202030 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.202166 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.202298 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.202442 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.202577 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.202723 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.203471 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.203621 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.203757 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.203902 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.204037 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.204169 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.204301 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.204435 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.204567 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.204708 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.204843 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.204987 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.205820 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.205820 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.205820 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.205820 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.206339 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.206472 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.206472 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.206724 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.206864 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.206864 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.206864 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.207386 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.207386 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.207706 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.207841 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.207841 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.208135 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.208370 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.208513 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.208776 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.208776 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.208776 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.209246 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.209371 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.209512 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.209641 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.209777 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.209903 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.210027 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.210027 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.210265 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.210389 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.210520 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.210647 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.210781 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.210904 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.211026 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.211159 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.211294 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.211294 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.211526 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.211649 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.211770 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.211893 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.212025 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.212149 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.212271 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.212271 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.212502 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.212633 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.212768 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.212891 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.212891 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.212891 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.212891 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.212891 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.212891 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.212891 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.213657 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.213784 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.213784 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.214030 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.214157 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.214291 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.214417 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.214540 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.214686 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.214891 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.215078 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.215235 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.215403 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.215558 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.215695 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.215832 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.216031 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.216031 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.216283 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.216407 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.216538 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.216662 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.216786 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.216908 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.217031 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.217214 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.217536 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.217665 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.217785 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.217908 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.217908 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.218150 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.218237 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.218237 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.218504 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.218504 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.218504 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.218504 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.218504 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.218787 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.219116 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.219205 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.220352 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.220502 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.220630 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.221367 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.221543 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.221670 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.221795 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.222246 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.222327 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.222446 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.222570 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.222702 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.222702 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.222904 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.222904 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.222904 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.223056 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.223056 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.223056 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.223056 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.223346 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.223457 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.223562 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.223689 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.223762 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.223822 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.223880 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.224008 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.224114 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.224411 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.224578 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.224730 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.224860 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.225002 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.225170 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.225312 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.225439 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.225563 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.225563 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.225807 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.225930 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.226078 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.227112 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.227205 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.227279 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.227351 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.227432 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.227530 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.227598 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.227668 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.227739 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.227810 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.227880 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.227959 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.227959 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.227959 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.229828 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.229828 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.229986 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.229986 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.229986 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.229986 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.229986 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.230295 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.230374 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.230447 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.230505 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.230505 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.230505 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.230505 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.230741 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.230741 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.230871 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.230871 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.231003 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.231003 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.231133 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.231133 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.231133 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.231133 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.231133 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.231133 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.231477 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.231550 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.231619 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.231690 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.231868 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.231955 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.232199 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.232275 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.232522 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.232599 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.232857 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.233101 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.233205 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.233500 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.233577 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.233833 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.233910 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.235581 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.235684 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.235684 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.235819 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.235890 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.235971 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.235971 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.236105 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.236176 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.236245 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.237356 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.237468 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.237538 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.237599 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.237682 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.237742 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.237800 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.237867 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.237928 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.237985 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.238043 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.238100 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.238100 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.238213 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.238270 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.238327 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.239159 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.239253 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.239324 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.239386 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.239386 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.239487 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.239544 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.239600 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.239831 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.239980 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.240148 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.240286 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.240459 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.240609 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.240778 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.240916 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.241138 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.241282 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.241449 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.241601 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.241764 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.241987 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.242131 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.242265 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.242406 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.242539 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.242683 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.242816 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.242980 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.243120 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.243306 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.243490 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.243631 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.243819 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.243959 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.244182 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.244330 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.244500 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.244648 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.244813 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.244953 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.245223 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.245382 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.245517 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.245648 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.245819 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.245957 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.246098 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.246233 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.246400 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.246538 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.246715 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.246870 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.247013 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.247147 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.247341 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.247641 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.247790 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.247984 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.248134 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.248326 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.248552 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.248799 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.249350 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.249623 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.249846 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.250275 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.250423 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.250558 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.250690 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.250833 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.250970 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.251104 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.251237 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.251370 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.251502 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.251648 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.251648 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.251913 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.252574 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.252708 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.252841 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.252983 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.253989 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.253989 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.254264 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.254399 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.254540 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.254675 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.254675 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.254675 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.255055 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.255189 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.255189 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.255450 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.255757 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.256084 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.256405 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.256735 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.262632 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.262818 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.262978 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.263121 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.263261 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.263413 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.263413 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.263674 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.264088 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.265518 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.265678 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.265882 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.266023 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.266158 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.266295 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.266518 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.266714 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.266865 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.267000 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.267134 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.267267 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.267400 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.267533 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.268266 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.268520 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.268722 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.268866 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.269011 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.269183 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.269916 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.270073 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.270209 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.270343 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.270638 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.270896 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.270896 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.270896 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.270896 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.270896 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.273470 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.273612 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.273612 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.273612 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.273612 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.274137 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.274137 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.274415 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.274554 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.274873 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.275016 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.275157 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.275157 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.275456 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.275599 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.275739 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.275877 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.276015 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.276226 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.276369 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.276507 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.276646 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.276786 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.276786 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.277058 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.278313 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.278513 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.278513 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.278513 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.279336 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.279920 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.280083 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.280083 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.280083 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.280083 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.280083 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.280083 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.280083 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.280083 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.281457 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.281596 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.281976 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.282127 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 04 18:30:28.282269 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.282269 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.282269 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.282269 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.282269 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.282269 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.282269 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.282269 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.283364 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.283364 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.283364 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.283364 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.283364 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.283364 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.293619 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.293619 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.294700 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.295111 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.295474 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.295852 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.296213 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.296561 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.296923 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.297564 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.297912 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.298066 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.298332 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.298788 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.299226 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.303321 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.303321 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.303321 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.305991 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.306503 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.307285 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.307642 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.308042 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.308592 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.311324 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.311324 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.311324 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.311324 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.311943 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.312130 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.312508 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.312892 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.314974 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.314974 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.314974 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.314974 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.316425 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.316425 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.316425 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.318085 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.318085 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:30:28.318085 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 04 18:30:28.376051 n-d-851028-13 devstack@n-api.service[123595]: INFO dbcounter [None req-8f11c36a-5bc9-4587-b2ca-6e32fb386f20 None None] Registered counter for database nova_api Oct 04 18:30:28.404260 n-d-851028-13 devstack@n-api.service[123596]: INFO dbcounter [None req-70689259-2797-4ace-bba9-85266f58b475 None None] Registered counter for database nova_api Oct 04 18:30:28.404470 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_db.sqlalchemy.engines [None req-8f11c36a-5bc9-4587-b2ca-6e32fb386f20 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123595) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 18:30:28.414959 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writer thread running {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 18:30:28.428637 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_db.sqlalchemy.engines [None req-70689259-2797-4ace-bba9-85266f58b475 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123596) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 18:30:28.435867 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writer thread running {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 18:30:28.485448 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.context [None req-8f11c36a-5bc9-4587-b2ca-6e32fb386f20 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),66287c68-6a08-453f-953b-bd2446fe0d25(cell1) {{(pid=123595) load_cells /opt/stack/nova/nova/context.py:464}} Oct 04 18:30:28.491390 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8f11c36a-5bc9-4587-b2ca-6e32fb386f20 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:28.491902 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8f11c36a-5bc9-4587-b2ca-6e32fb386f20 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:28.494803 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8f11c36a-5bc9-4587-b2ca-6e32fb386f20 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:28.496770 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8f11c36a-5bc9-4587-b2ca-6e32fb386f20 None None] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:28.497713 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8f11c36a-5bc9-4587-b2ca-6e32fb386f20 None None] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:28.501741 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8f11c36a-5bc9-4587-b2ca-6e32fb386f20 None None] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:28.504967 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.context [None req-70689259-2797-4ace-bba9-85266f58b475 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),66287c68-6a08-453f-953b-bd2446fe0d25(cell1) {{(pid=123596) load_cells /opt/stack/nova/nova/context.py:464}} Oct 04 18:30:28.505324 n-d-851028-13 devstack@n-api.service[123595]: INFO dbcounter [None req-8f11c36a-5bc9-4587-b2ca-6e32fb386f20 None None] Registered counter for database nova_cell0 Oct 04 18:30:28.509596 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-70689259-2797-4ace-bba9-85266f58b475 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:28.510091 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-70689259-2797-4ace-bba9-85266f58b475 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:28.510344 n-d-851028-13 devstack@n-api.service[123595]: INFO dbcounter [None req-8f11c36a-5bc9-4587-b2ca-6e32fb386f20 None None] Registered counter for database nova_cell1 Oct 04 18:30:28.512350 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-70689259-2797-4ace-bba9-85266f58b475 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:28.513226 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-70689259-2797-4ace-bba9-85266f58b475 None None] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:28.513631 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-70689259-2797-4ace-bba9-85266f58b475 None None] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:28.515872 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-70689259-2797-4ace-bba9-85266f58b475 None None] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:28.518202 n-d-851028-13 devstack@n-api.service[123596]: INFO dbcounter [None req-70689259-2797-4ace-bba9-85266f58b475 None None] Registered counter for database nova_cell0 Oct 04 18:30:28.523172 n-d-851028-13 devstack@n-api.service[123596]: INFO dbcounter [None req-70689259-2797-4ace-bba9-85266f58b475 None None] Registered counter for database nova_cell1 Oct 04 18:30:28.523720 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_db.sqlalchemy.engines [None req-8f11c36a-5bc9-4587-b2ca-6e32fb386f20 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123595) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 18:30:28.525027 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_db.sqlalchemy.engines [None req-8f11c36a-5bc9-4587-b2ca-6e32fb386f20 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123595) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 18:30:28.536186 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writer thread running {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 18:30:28.536363 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_db.sqlalchemy.engines [None req-70689259-2797-4ace-bba9-85266f58b475 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123596) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 18:30:28.538815 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_db.sqlalchemy.engines [None req-70689259-2797-4ace-bba9-85266f58b475 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123596) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 18:30:28.547289 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writer thread running {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 18:30:28.547777 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writer thread running {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 18:30:28.549895 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writer thread running {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 18:30:28.745032 n-d-851028-13 devstack@n-api.service[123596]: INFO dbcounter [None req-70689259-2797-4ace-bba9-85266f58b475 None None] Registered counter for database nova_cell0 Oct 04 18:30:28.745243 n-d-851028-13 devstack@n-api.service[123595]: INFO dbcounter [None req-8f11c36a-5bc9-4587-b2ca-6e32fb386f20 None None] Registered counter for database nova_cell0 Oct 04 18:30:28.754215 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_db.sqlalchemy.engines [None req-8f11c36a-5bc9-4587-b2ca-6e32fb386f20 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123595) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 18:30:28.759883 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_db.sqlalchemy.engines [None req-70689259-2797-4ace-bba9-85266f58b475 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123596) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 18:30:28.761913 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writer thread running {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 18:30:28.767770 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writer thread running {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 18:30:29.110294 n-d-851028-13 devstack@n-api.service[123595]: WARNING keystonemiddleware.auth_token [None req-8f11c36a-5bc9-4587-b2ca-6e32fb386f20 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 04 18:30:29.118567 n-d-851028-13 devstack@n-api.service[123595]: WARNING keystonemiddleware.auth_token [None req-8f11c36a-5bc9-4587-b2ca-6e32fb386f20 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 04 18:30:29.150863 n-d-851028-13 devstack@n-api.service[123596]: WARNING keystonemiddleware.auth_token [None req-70689259-2797-4ace-bba9-85266f58b475 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 04 18:30:29.159093 n-d-851028-13 devstack@n-api.service[123596]: WARNING keystonemiddleware.auth_token [None req-70689259-2797-4ace-bba9-85266f58b475 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 04 18:30:29.475970 n-d-851028-13 devstack@n-api.service[123595]: WARNING keystonemiddleware.auth_token [None req-8f11c36a-5bc9-4587-b2ca-6e32fb386f20 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 04 18:30:29.482351 n-d-851028-13 devstack@n-api.service[123595]: WARNING keystonemiddleware.auth_token [None req-8f11c36a-5bc9-4587-b2ca-6e32fb386f20 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 04 18:30:29.487817 n-d-851028-13 devstack@n-api.service[123595]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x558acfc689c0 pid: 123595 (default app) Oct 04 18:30:29.541021 n-d-851028-13 devstack@n-api.service[123596]: WARNING keystonemiddleware.auth_token [None req-70689259-2797-4ace-bba9-85266f58b475 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 04 18:30:29.547497 n-d-851028-13 devstack@n-api.service[123596]: WARNING keystonemiddleware.auth_token [None req-70689259-2797-4ace-bba9-85266f58b475 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 04 18:30:29.553719 n-d-851028-13 devstack@n-api.service[123596]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x558acfc689c0 pid: 123596 (default app) Oct 04 18:31:11.037458 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_api:SELECT=3 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:31:11.038724 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=3 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:31:11.039774 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=3 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:31:11.040777 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=3 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:31:12.449485 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_api:SELECT=3 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:31:12.451673 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=3 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:31:12.453789 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=3 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:31:12.455007 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=3 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:31:12.954877 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-9cd613aa-93e3-415c-8747-a617a14dc23b tempest-AggregatesAdminTestJSON-1163717784 tempest-AggregatesAdminTestJSON-1163717784-project-admin] Calling method '.version_select at 0x7fb22570bf70>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:12.963721 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-9cd613aa-93e3-415c-8747-a617a14dc23b tempest-AggregatesAdminTestJSON-1163717784 tempest-AggregatesAdminTestJSON-1163717784-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),66287c68-6a08-453f-953b-bd2446fe0d25(cell1) {{(pid=123595) load_cells /opt/stack/nova/nova/compute/api.py:319}} Oct 04 18:31:12.964706 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9cd613aa-93e3-415c-8747-a617a14dc23b tempest-AggregatesAdminTestJSON-1163717784 tempest-AggregatesAdminTestJSON-1163717784-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:12.965388 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9cd613aa-93e3-415c-8747-a617a14dc23b tempest-AggregatesAdminTestJSON-1163717784 tempest-AggregatesAdminTestJSON-1163717784-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:12.965999 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9cd613aa-93e3-415c-8747-a617a14dc23b tempest-AggregatesAdminTestJSON-1163717784 tempest-AggregatesAdminTestJSON-1163717784-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:12.998289 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9cd613aa-93e3-415c-8747-a617a14dc23b tempest-AggregatesAdminTestJSON-1163717784 tempest-AggregatesAdminTestJSON-1163717784-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:12.998997 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9cd613aa-93e3-415c-8747-a617a14dc23b tempest-AggregatesAdminTestJSON-1163717784 tempest-AggregatesAdminTestJSON-1163717784-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:13.000251 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9cd613aa-93e3-415c-8747-a617a14dc23b tempest-AggregatesAdminTestJSON-1163717784 tempest-AggregatesAdminTestJSON-1163717784-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:13.018667 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9cd613aa-93e3-415c-8747-a617a14dc23b tempest-AggregatesAdminTestJSON-1163717784 tempest-AggregatesAdminTestJSON-1163717784-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:13.019153 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9cd613aa-93e3-415c-8747-a617a14dc23b tempest-AggregatesAdminTestJSON-1163717784 tempest-AggregatesAdminTestJSON-1163717784-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:13.019591 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9cd613aa-93e3-415c-8747-a617a14dc23b tempest-AggregatesAdminTestJSON-1163717784 tempest-AggregatesAdminTestJSON-1163717784-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:13.026513 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-9cd613aa-93e3-415c-8747-a617a14dc23b tempest-AggregatesAdminTestJSON-1163717784 tempest-AggregatesAdminTestJSON-1163717784-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1507 microversion: 2.1 time: 1.994820 Oct 04 18:31:13.027420 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1/1] 10.222.0.43 () {58 vars in 1167 bytes} [Tue Oct 4 18:31:11 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1507 bytes in 1998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:13.302619 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-e1aa04b0-f5b1-44a7-922f-e64d16fbf558 tempest-AZAdminV2TestJSON-511483381 tempest-AZAdminV2TestJSON-511483381-project-admin] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:13.305499 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e1aa04b0-f5b1-44a7-922f-e64d16fbf558 tempest-AZAdminV2TestJSON-511483381 tempest-AZAdminV2TestJSON-511483381-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:13.306003 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e1aa04b0-f5b1-44a7-922f-e64d16fbf558 tempest-AZAdminV2TestJSON-511483381 tempest-AZAdminV2TestJSON-511483381-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:13.306452 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e1aa04b0-f5b1-44a7-922f-e64d16fbf558 tempest-AZAdminV2TestJSON-511483381 tempest-AZAdminV2TestJSON-511483381-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:13.307200 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e1aa04b0-f5b1-44a7-922f-e64d16fbf558 tempest-AZAdminV2TestJSON-511483381 tempest-AZAdminV2TestJSON-511483381-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:13.307654 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e1aa04b0-f5b1-44a7-922f-e64d16fbf558 tempest-AZAdminV2TestJSON-511483381 tempest-AZAdminV2TestJSON-511483381-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:13.308084 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e1aa04b0-f5b1-44a7-922f-e64d16fbf558 tempest-AZAdminV2TestJSON-511483381 tempest-AZAdminV2TestJSON-511483381-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:13.387932 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-e1aa04b0-f5b1-44a7-922f-e64d16fbf558 tempest-AZAdminV2TestJSON-511483381 tempest-AZAdminV2TestJSON-511483381-project-admin] 10.222.0.43 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.359159 Oct 04 18:31:13.389340 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2/2] 10.222.0.43 () {58 vars in 1164 bytes} [Tue Oct 4 18:31:13 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:31:13.801281 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-79a561bb-19d7-4bd1-8bdb-533b7b42785f tempest-AggregatesAdminTestV241-1809718964 tempest-AggregatesAdminTestV241-1809718964-project-admin] Calling method '.version_select at 0x7fb2255f8a60>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:13.806968 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-79a561bb-19d7-4bd1-8bdb-533b7b42785f tempest-AggregatesAdminTestV241-1809718964 tempest-AggregatesAdminTestV241-1809718964-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:13.809741 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-79a561bb-19d7-4bd1-8bdb-533b7b42785f tempest-AggregatesAdminTestV241-1809718964 tempest-AggregatesAdminTestV241-1809718964-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:13.813011 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-79a561bb-19d7-4bd1-8bdb-533b7b42785f tempest-AggregatesAdminTestV241-1809718964 tempest-AggregatesAdminTestV241-1809718964-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:13.842836 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-b7f0f2d8-b448-41a7-9525-2a10a0f67556 tempest-AZAdminNegativeTestJSON-786104994 tempest-AZAdminNegativeTestJSON-786104994-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:13.845178 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-b7f0f2d8-b448-41a7-9525-2a10a0f67556 tempest-AZAdminNegativeTestJSON-786104994 tempest-AZAdminNegativeTestJSON-786104994-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': 'ad2004128dfd46fcbfc2105ebef64d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7456895c7ebb4668aa921403db7068d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:13.848829 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-b7f0f2d8-b448-41a7-9525-2a10a0f67556 tempest-AZAdminNegativeTestJSON-786104994 tempest-AZAdminNegativeTestJSON-786104994-project] Request method failure captured: Oct 04 18:31:13.848829 n-d-851028-13 devstack@n-api.service[123596]: request: GET /compute/v2.1/os-availability-zone/detail HTTP/1.1 Oct 04 18:31:13.848829 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:31:13.848829 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:31:13.848829 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:31:13.848829 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 18:31:13.848829 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:31:13.848829 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:31:13.848829 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:31:13.848829 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:31:13.848829 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPHvt198HEyX-nByl0pwM2d0-vEZ2v622KPXte9sKipD1ivpVKmuWkjZrCOPcc92UTONM6aGZ9AJbBurQepEHQoMwlZkKhDMIR19FUyKIAo2ogVAerEWuVMKeVDtpj4IjWwKLc83FP_BI_mGDOyLgHL1hK8isQ1JLVhJudshwXiOBaoo Oct 04 18:31:13.848829 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:31:13.848829 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:31:13.848829 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:31:13.848829 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:31:13.848829 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:31:13.848829 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:31:13.848829 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: 7456895c7ebb4668aa921403db7068d9 Oct 04 18:31:13.848829 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-AZAdminNegativeTestJSON-786104994 Oct 04 18:31:13.848829 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 18:31:13.848829 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 18:31:13.850136 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/7456895c7ebb4668aa921403db7068d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_7456895c7ebb4668aa921403db7068d9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/7456895c7ebb4668aa921403db7068d9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/7456895c7ebb4668aa921403db7068d9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:31:13.850136 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-AZAdminNegativeTestJSON-786104994 Oct 04 18:31:13.850136 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: 7456895c7ebb4668aa921403db7068d9 Oct 04 18:31:13.850136 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-AZAdminNegativeTestJSON-786104994 Oct 04 18:31:13.850136 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-AZAdminNegativeTestJSON-786104994-project Oct 04 18:31:13.850136 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:31:13.850136 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:31:13.850136 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: ad2004128dfd46fcbfc2105ebef64d57 Oct 04 18:31:13.850136 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-AZAdminNegativeTestJSON-786104994-project Oct 04 18:31:13.850136 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 18:31:13.850136 n-d-851028-13 devstack@n-api.service[123596]: exception: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 04 18:31:13.850136 n-d-851028-13 devstack@n-api.service[123596]: action_args: {} Oct 04 18:31:13.850728 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:31:13.850728 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:31:13.850728 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:31:13.850728 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:31:13.850728 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:31:13.850728 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:31:13.850728 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:31:13.850728 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:31:13.850728 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/availability_zone.py", line 117, in detail Oct 04 18:31:13.850728 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi context.can(az_policies.POLICY_ROOT % 'detail', target={}) Oct 04 18:31:13.850728 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 18:31:13.850728 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 18:31:13.850728 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 18:31:13.850728 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 18:31:13.850728 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:31:13.850728 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:31:13.850728 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:31:13.850728 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:31:13.850728 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 18:31:13.851642 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 18:31:13.851642 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 18:31:13.851642 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 18:31:13.851642 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 18:31:13.851642 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 18:31:13.851642 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 04 18:31:13.851642 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:31:13.851642 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:31:13.851642 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:31:13.851642 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:31:13.851642 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:31:13.851642 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:31:13.851642 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 18:31:13.851642 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 18:31:13.851642 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 04 18:31:13.851642 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:31:13.851642 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-b7f0f2d8-b448-41a7-9525-2a10a0f67556 tempest-AZAdminNegativeTestJSON-786104994 tempest-AZAdminNegativeTestJSON-786104994-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:31:13.852477 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-b7f0f2d8-b448-41a7-9525-2a10a0f67556 tempest-AZAdminNegativeTestJSON-786104994 tempest-AZAdminNegativeTestJSON-786104994-project] 10.222.0.43 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 1.415523 Oct 04 18:31:13.862835 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1/3] 10.222.0.43 () {58 vars in 1185 bytes} [Tue Oct 4 18:31:12 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 1430 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:31:13.865864 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-79a561bb-19d7-4bd1-8bdb-533b7b42785f tempest-AggregatesAdminTestV241-1809718964 tempest-AggregatesAdminTestV241-1809718964-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:13.866641 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-79a561bb-19d7-4bd1-8bdb-533b7b42785f tempest-AggregatesAdminTestV241-1809718964 tempest-AggregatesAdminTestV241-1809718964-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:13.867291 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-79a561bb-19d7-4bd1-8bdb-533b7b42785f tempest-AggregatesAdminTestV241-1809718964 tempest-AggregatesAdminTestV241-1809718964-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:13.872300 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-bcbf6ea8-04ab-4c77-9ac8-6b4bdb9ea2d8 tempest-AggregatesAdminTestJSON-1163717784 tempest-AggregatesAdminTestJSON-1163717784-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-2114698090", "name": "tempest-test_aggregate-1057334348"}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:31:13.881481 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-79a561bb-19d7-4bd1-8bdb-533b7b42785f tempest-AggregatesAdminTestV241-1809718964 tempest-AggregatesAdminTestV241-1809718964-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:13.883312 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-79a561bb-19d7-4bd1-8bdb-533b7b42785f tempest-AggregatesAdminTestV241-1809718964 tempest-AggregatesAdminTestV241-1809718964-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:13.883968 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-79a561bb-19d7-4bd1-8bdb-533b7b42785f tempest-AggregatesAdminTestV241-1809718964 tempest-AggregatesAdminTestV241-1809718964-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:13.897640 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-79a561bb-19d7-4bd1-8bdb-533b7b42785f tempest-AggregatesAdminTestV241-1809718964 tempest-AggregatesAdminTestV241-1809718964-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1427 microversion: 2.41 time: 0.506736 Oct 04 18:31:13.898901 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3/4] 10.222.0.43 () {60 vars in 1208 bytes} [Tue Oct 4 18:31:13 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1427 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:31:13.914595 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.objects.aggregate [None req-bcbf6ea8-04ab-4c77-9ac8-6b4bdb9ea2d8 tempest-AggregatesAdminTestJSON-1163717784 tempest-AggregatesAdminTestJSON-1163717784-project-admin] Generated uuid 43e0c12e-e82d-460a-bccc-c1e269fbffaa for aggregate {{(pid=123596) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 18:31:14.018670 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-bcbf6ea8-04ab-4c77-9ac8-6b4bdb9ea2d8 tempest-AggregatesAdminTestJSON-1163717784 tempest-AggregatesAdminTestJSON-1163717784-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.150698 Oct 04 18:31:14.020191 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2/5] 10.222.0.43 () {60 vars in 1165 bytes} [Tue Oct 4 18:31:13 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:31:14.035481 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-0d2bc53e-9efb-45e5-96b9-903783a0bf0e tempest-AZAdminV2TestJSON-511483381 tempest-AZAdminV2TestJSON-511483381-project-admin] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:14.039234 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0d2bc53e-9efb-45e5-96b9-903783a0bf0e tempest-AZAdminV2TestJSON-511483381 tempest-AZAdminV2TestJSON-511483381-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:14.044019 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0d2bc53e-9efb-45e5-96b9-903783a0bf0e tempest-AZAdminV2TestJSON-511483381 tempest-AZAdminV2TestJSON-511483381-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:14.044620 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0d2bc53e-9efb-45e5-96b9-903783a0bf0e tempest-AZAdminV2TestJSON-511483381 tempest-AZAdminV2TestJSON-511483381-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:14.047497 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0d2bc53e-9efb-45e5-96b9-903783a0bf0e tempest-AZAdminV2TestJSON-511483381 tempest-AZAdminV2TestJSON-511483381-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:14.048092 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0d2bc53e-9efb-45e5-96b9-903783a0bf0e tempest-AZAdminV2TestJSON-511483381 tempest-AZAdminV2TestJSON-511483381-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:14.049737 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0d2bc53e-9efb-45e5-96b9-903783a0bf0e tempest-AZAdminV2TestJSON-511483381 tempest-AZAdminV2TestJSON-511483381-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:14.178121 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-0d2bc53e-9efb-45e5-96b9-903783a0bf0e tempest-AZAdminV2TestJSON-511483381 tempest-AZAdminV2TestJSON-511483381-project-admin] 10.222.0.43 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 615 microversion: 2.1 time: 0.156657 Oct 04 18:31:14.182586 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3/6] 10.222.0.43 () {58 vars in 1185 bytes} [Tue Oct 4 18:31:14 2022] GET /compute/v2.1/os-availability-zone/detail => generated 615 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:31:14.449851 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-5f150262-028a-4de0-a0fc-88f2c3967f33 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-829181213", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452"}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:31:14.666464 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-e2e3b17d-ff52-4136-a79c-100f1fa04d97 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1293374724", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452"}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:31:15.679140 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.network.neutron [None req-5f150262-028a-4de0-a0fc-88f2c3967f33 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] validate_networks() for None {{(pid=123595) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:31:15.736018 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.network.neutron [None req-e2e3b17d-ff52-4136-a79c-100f1fa04d97 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] validate_networks() for None {{(pid=123596) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:31:16.129393 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-5f150262-028a-4de0-a0fc-88f2c3967f33 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Flavor limits 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:31:16.130059 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-5f150262-028a-4de0-a0fc-88f2c3967f33 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Image limits 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:31:16.130701 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-5f150262-028a-4de0-a0fc-88f2c3967f33 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Flavor pref 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:31:16.131109 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-5f150262-028a-4de0-a0fc-88f2c3967f33 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Image pref 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:31:16.131515 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-5f150262-028a-4de0-a0fc-88f2c3967f33 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:31:16.148192 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5f150262-028a-4de0-a0fc-88f2c3967f33 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:16.148679 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5f150262-028a-4de0-a0fc-88f2c3967f33 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:16.149134 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5f150262-028a-4de0-a0fc-88f2c3967f33 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:16.149864 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5f150262-028a-4de0-a0fc-88f2c3967f33 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:16.150920 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5f150262-028a-4de0-a0fc-88f2c3967f33 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:16.151910 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5f150262-028a-4de0-a0fc-88f2c3967f33 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:16.202759 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-5f150262-028a-4de0-a0fc-88f2c3967f33 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Getting quotas for project 1753b9ee9a644e409a1efd0c9e7c152c. Resources: {'ram', 'cores', 'instances'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:31:16.213207 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-5f150262-028a-4de0-a0fc-88f2c3967f33 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Getting quotas for user 459e65f14af049bba311453d6a86360b and project 1753b9ee9a644e409a1efd0c9e7c152c. Resources: {'ram', 'cores', 'instances'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:31:16.239455 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-5f150262-028a-4de0-a0fc-88f2c3967f33 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Going to run 1 instances... {{(pid=123595) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:31:16.242960 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-5f150262-028a-4de0-a0fc-88f2c3967f33 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] [instance: 968f1c40-0d51-403e-9609-8eb62b9060bb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e8943ec5-4038-4d4b-b9b9-2415a79f5243',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:31:16.369830 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-5f150262-028a-4de0-a0fc-88f2c3967f33 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.469465 Oct 04 18:31:16.372278 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 4/7] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 18:31:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 2473 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:31:16.379123 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-f0080125-86e1-4cfb-a6df-0c95045591f1 tempest-AggregatesAdminTestJSON-1163717784 tempest-AggregatesAdminTestJSON-1163717784-project-admin] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:16.413048 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-f0080125-86e1-4cfb-a6df-0c95045591f1 tempest-AggregatesAdminTestJSON-1163717784 tempest-AggregatesAdminTestJSON-1163717784-project-admin] 10.222.0.43 "GET /compute/v2.1/os-aggregates" status: 200 len: 303 microversion: 2.1 time: 0.036910 Oct 04 18:31:16.414032 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 5/8] 10.222.0.43 () {58 vars in 1143 bytes} [Tue Oct 4 18:31:16 2022] GET /compute/v2.1/os-aggregates => generated 303 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:31:16.757523 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-e2e3b17d-ff52-4136-a79c-100f1fa04d97 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Flavor limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:31:16.757987 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-e2e3b17d-ff52-4136-a79c-100f1fa04d97 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Image limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:31:16.758257 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-e2e3b17d-ff52-4136-a79c-100f1fa04d97 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Flavor pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:31:16.758591 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-e2e3b17d-ff52-4136-a79c-100f1fa04d97 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Image pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:31:16.758913 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-e2e3b17d-ff52-4136-a79c-100f1fa04d97 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:31:16.796755 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e2e3b17d-ff52-4136-a79c-100f1fa04d97 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:16.797547 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e2e3b17d-ff52-4136-a79c-100f1fa04d97 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:16.798047 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e2e3b17d-ff52-4136-a79c-100f1fa04d97 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:16.803036 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e2e3b17d-ff52-4136-a79c-100f1fa04d97 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:16.804058 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e2e3b17d-ff52-4136-a79c-100f1fa04d97 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:16.804817 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e2e3b17d-ff52-4136-a79c-100f1fa04d97 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:16.891555 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-e2e3b17d-ff52-4136-a79c-100f1fa04d97 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Getting quotas for project e7adedcdb9c3485ea2738c00e25aa3fd. Resources: {'ram', 'cores', 'instances'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:31:16.903948 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-e2e3b17d-ff52-4136-a79c-100f1fa04d97 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Getting quotas for user a7db99f361654711bea7f1b2c404d312 and project e7adedcdb9c3485ea2738c00e25aa3fd. Resources: {'ram', 'cores', 'instances'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:31:16.935809 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-e2e3b17d-ff52-4136-a79c-100f1fa04d97 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Going to run 1 instances... {{(pid=123596) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:31:16.938048 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-5edaf5f3-959c-494d-86cb-9aa16a65f55a tempest-HostsAdminTestJSON-1163831172 tempest-HostsAdminTestJSON-1163831172-project-admin] Calling method '.version_select at 0x7fb224bb35e0>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:16.943798 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5edaf5f3-959c-494d-86cb-9aa16a65f55a tempest-HostsAdminTestJSON-1163831172 tempest-HostsAdminTestJSON-1163831172-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:16.944391 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-e2e3b17d-ff52-4136-a79c-100f1fa04d97 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] [instance: b36499e0-9405-4153-a581-13c1bd9d43eb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e8943ec5-4038-4d4b-b9b9-2415a79f5243',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123596) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:31:16.944831 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5edaf5f3-959c-494d-86cb-9aa16a65f55a tempest-HostsAdminTestJSON-1163831172 tempest-HostsAdminTestJSON-1163831172-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:16.948250 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5edaf5f3-959c-494d-86cb-9aa16a65f55a tempest-HostsAdminTestJSON-1163831172 tempest-HostsAdminTestJSON-1163831172-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:16.949536 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5edaf5f3-959c-494d-86cb-9aa16a65f55a tempest-HostsAdminTestJSON-1163831172 tempest-HostsAdminTestJSON-1163831172-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:16.950285 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5edaf5f3-959c-494d-86cb-9aa16a65f55a tempest-HostsAdminTestJSON-1163831172 tempest-HostsAdminTestJSON-1163831172-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:16.956059 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5edaf5f3-959c-494d-86cb-9aa16a65f55a tempest-HostsAdminTestJSON-1163831172 tempest-HostsAdminTestJSON-1163831172-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:17.026700 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-5edaf5f3-959c-494d-86cb-9aa16a65f55a tempest-HostsAdminTestJSON-1163831172 tempest-HostsAdminTestJSON-1163831172-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hosts" status: 200 len: 381 microversion: 2.1 time: 0.604262 Oct 04 18:31:17.028658 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 6/9] 10.222.0.43 () {58 vars in 1128 bytes} [Tue Oct 4 18:31:16 2022] GET /compute/v2.1/os-hosts => generated 381 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:31:17.039740 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-295bb54e-249e-42c1-b8db-a510c6189df2 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:17.053592 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-295bb54e-249e-42c1-b8db-a510c6189df2 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] [instance: 968f1c40-0d51-403e-9609-8eb62b9060bb] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:17.076181 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-e2e3b17d-ff52-4136-a79c-100f1fa04d97 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.892131 Oct 04 18:31:17.079144 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 4/10] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 18:31:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 2896 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:31:17.094545 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-2117a684-2a71-40e4-bdae-10d807de7a66 tempest-AggregatesAdminTestJSON-1163717784 tempest-AggregatesAdminTestJSON-1163717784-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-851028-13"}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:31:17.171787 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2117a684-2a71-40e4-bdae-10d807de7a66 tempest-AggregatesAdminTestJSON-1163717784 tempest-AggregatesAdminTestJSON-1163717784-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:17.172587 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2117a684-2a71-40e4-bdae-10d807de7a66 tempest-AggregatesAdminTestJSON-1163717784 tempest-AggregatesAdminTestJSON-1163717784-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:17.173346 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2117a684-2a71-40e4-bdae-10d807de7a66 tempest-AggregatesAdminTestJSON-1163717784 tempest-AggregatesAdminTestJSON-1163717784-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:17.336115 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-295bb54e-249e-42c1-b8db-a510c6189df2 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '459e65f14af049bba311453d6a86360b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1753b9ee9a644e409a1efd0c9e7c152c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:17.372080 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-295bb54e-249e-42c1-b8db-a510c6189df2 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] 10.222.0.43 "GET /compute/v2.1/servers/968f1c40-0d51-403e-9609-8eb62b9060bb" status: 200 len: 1219 microversion: 2.1 time: 0.340831 Oct 04 18:31:17.375644 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 7/11] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:17 2022] GET /compute/v2.1/servers/968f1c40-0d51-403e-9609-8eb62b9060bb => generated 1219 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:17.397477 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-3b7a70db-c0ae-4541-a46d-1ae03a86234b tempest-HostsAdminTestJSON-1163831172 tempest-HostsAdminTestJSON-1163831172-project-admin] Calling method '.version_select at 0x7fb224bced30>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:17.409332 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3b7a70db-c0ae-4541-a46d-1ae03a86234b tempest-HostsAdminTestJSON-1163831172 tempest-HostsAdminTestJSON-1163831172-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:17.410818 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3b7a70db-c0ae-4541-a46d-1ae03a86234b tempest-HostsAdminTestJSON-1163831172 tempest-HostsAdminTestJSON-1163831172-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:17.412306 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3b7a70db-c0ae-4541-a46d-1ae03a86234b tempest-HostsAdminTestJSON-1163831172 tempest-HostsAdminTestJSON-1163831172-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:17.414271 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3b7a70db-c0ae-4541-a46d-1ae03a86234b tempest-HostsAdminTestJSON-1163831172 tempest-HostsAdminTestJSON-1163831172-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:17.415076 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3b7a70db-c0ae-4541-a46d-1ae03a86234b tempest-HostsAdminTestJSON-1163831172 tempest-HostsAdminTestJSON-1163831172-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:17.417029 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3b7a70db-c0ae-4541-a46d-1ae03a86234b tempest-HostsAdminTestJSON-1163831172 tempest-HostsAdminTestJSON-1163831172-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:17.519306 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-3b7a70db-c0ae-4541-a46d-1ae03a86234b tempest-HostsAdminTestJSON-1163831172 tempest-HostsAdminTestJSON-1163831172-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 403 microversion: 2.1 time: 0.141717 Oct 04 18:31:17.521481 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 8/12] 10.222.0.43 () {58 vars in 1139 bytes} [Tue Oct 4 18:31:17 2022] GET /compute/v2.1/os-hosts?zone= => generated 403 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:31:17.527348 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-e20ae6a2-27f4-4663-a019-1eb7aad05b22 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:17.528029 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-e20ae6a2-27f4-4663-a019-1eb7aad05b22 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] [instance: b36499e0-9405-4153-a581-13c1bd9d43eb] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:17.739060 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-e20ae6a2-27f4-4663-a019-1eb7aad05b22 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7db99f361654711bea7f1b2c404d312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7adedcdb9c3485ea2738c00e25aa3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:17.754872 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-e20ae6a2-27f4-4663-a019-1eb7aad05b22 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] 10.222.0.43 "GET /compute/v2.1/servers/b36499e0-9405-4153-a581-13c1bd9d43eb" status: 200 len: 1217 microversion: 2.1 time: 0.229809 Oct 04 18:31:17.769192 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 9/13] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:17 2022] GET /compute/v2.1/servers/b36499e0-9405-4153-a581-13c1bd9d43eb => generated 1217 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:17.779772 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-73ede3ab-316b-448b-a7e4-d75c61ba75cb tempest-HostsAdminTestJSON-1163831172 tempest-HostsAdminTestJSON-1163831172-project-admin] Calling method '.version_select at 0x7fb224b7eee0>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:17.788347 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-73ede3ab-316b-448b-a7e4-d75c61ba75cb tempest-HostsAdminTestJSON-1163831172 tempest-HostsAdminTestJSON-1163831172-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:17.791271 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-73ede3ab-316b-448b-a7e4-d75c61ba75cb tempest-HostsAdminTestJSON-1163831172 tempest-HostsAdminTestJSON-1163831172-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:17.795404 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-73ede3ab-316b-448b-a7e4-d75c61ba75cb tempest-HostsAdminTestJSON-1163831172 tempest-HostsAdminTestJSON-1163831172-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:17.799488 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-73ede3ab-316b-448b-a7e4-d75c61ba75cb tempest-HostsAdminTestJSON-1163831172 tempest-HostsAdminTestJSON-1163831172-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:17.800511 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-73ede3ab-316b-448b-a7e4-d75c61ba75cb tempest-HostsAdminTestJSON-1163831172 tempest-HostsAdminTestJSON-1163831172-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:17.803591 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-73ede3ab-316b-448b-a7e4-d75c61ba75cb tempest-HostsAdminTestJSON-1163831172 tempest-HostsAdminTestJSON-1163831172-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:17.963040 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-73ede3ab-316b-448b-a7e4-d75c61ba75cb tempest-HostsAdminTestJSON-1163831172 tempest-HostsAdminTestJSON-1163831172-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.202674 Oct 04 18:31:17.967005 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 10/14] 10.222.0.43 () {58 vars in 1145 bytes} [Tue Oct 4 18:31:17 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:31:18.093531 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-2117a684-2a71-40e4-bdae-10d807de7a66 tempest-AggregatesAdminTestJSON-1163717784 tempest-AggregatesAdminTestJSON-1163717784-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 316 microversion: 2.1 time: 1.009906 Oct 04 18:31:18.094636 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 5/15] 10.222.0.43 () {60 vars in 1191 bytes} [Tue Oct 4 18:31:17 2022] POST /compute/v2.1/os-aggregates/1/action => generated 316 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:31:18.395775 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-7c4d4d50-855f-47dd-b89b-f95ca9bdeb60 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:18.396405 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-7c4d4d50-855f-47dd-b89b-f95ca9bdeb60 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] [instance: 968f1c40-0d51-403e-9609-8eb62b9060bb] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:18.531815 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-7c4d4d50-855f-47dd-b89b-f95ca9bdeb60 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '459e65f14af049bba311453d6a86360b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1753b9ee9a644e409a1efd0c9e7c152c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:18.548243 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-7c4d4d50-855f-47dd-b89b-f95ca9bdeb60 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] 10.222.0.43 "GET /compute/v2.1/servers/968f1c40-0d51-403e-9609-8eb62b9060bb" status: 200 len: 1219 microversion: 2.1 time: 0.153303 Oct 04 18:31:18.566716 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 11/16] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:18 2022] GET /compute/v2.1/servers/968f1c40-0d51-403e-9609-8eb62b9060bb => generated 1219 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:18.793990 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-6d723f25-b88f-4d7d-9aaa-69bc2e2a9fad tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:18.796349 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-6d723f25-b88f-4d7d-9aaa-69bc2e2a9fad tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] [instance: b36499e0-9405-4153-a581-13c1bd9d43eb] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:18.815290 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6d723f25-b88f-4d7d-9aaa-69bc2e2a9fad tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:18.815759 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6d723f25-b88f-4d7d-9aaa-69bc2e2a9fad tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:18.816825 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6d723f25-b88f-4d7d-9aaa-69bc2e2a9fad tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:18.819229 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6d723f25-b88f-4d7d-9aaa-69bc2e2a9fad tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:18.821063 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6d723f25-b88f-4d7d-9aaa-69bc2e2a9fad tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:18.821572 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6d723f25-b88f-4d7d-9aaa-69bc2e2a9fad tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:18.868912 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-14ee344f-6925-42af-9ac3-43f4501c38dc tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-739264063", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452", "availability_zone": "tempest-test_az-2114698090"}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:31:18.891783 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-14ee344f-6925-42af-9ac3-43f4501c38dc tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:18.891783 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-14ee344f-6925-42af-9ac3-43f4501c38dc tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:18.891783 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-14ee344f-6925-42af-9ac3-43f4501c38dc tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:18.891783 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-14ee344f-6925-42af-9ac3-43f4501c38dc tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:18.892356 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-14ee344f-6925-42af-9ac3-43f4501c38dc tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:18.892356 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-14ee344f-6925-42af-9ac3-43f4501c38dc tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:19.003971 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.network.neutron [None req-14ee344f-6925-42af-9ac3-43f4501c38dc tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] validate_networks() for None {{(pid=123596) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:31:19.248060 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-6d723f25-b88f-4d7d-9aaa-69bc2e2a9fad tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7db99f361654711bea7f1b2c404d312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7adedcdb9c3485ea2738c00e25aa3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:19.271444 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-6d723f25-b88f-4d7d-9aaa-69bc2e2a9fad tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] 10.222.0.43 "GET /compute/v2.1/servers/b36499e0-9405-4153-a581-13c1bd9d43eb" status: 200 len: 1221 microversion: 2.1 time: 0.486997 Oct 04 18:31:19.301433 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 12/17] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:18 2022] GET /compute/v2.1/servers/b36499e0-9405-4153-a581-13c1bd9d43eb => generated 1221 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:19.455298 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-14ee344f-6925-42af-9ac3-43f4501c38dc tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Flavor limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:31:19.456541 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-14ee344f-6925-42af-9ac3-43f4501c38dc tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Image limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:31:19.457503 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-14ee344f-6925-42af-9ac3-43f4501c38dc tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Flavor pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:31:19.458162 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-14ee344f-6925-42af-9ac3-43f4501c38dc tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Image pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:31:19.458817 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-14ee344f-6925-42af-9ac3-43f4501c38dc tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:31:19.475990 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-14ee344f-6925-42af-9ac3-43f4501c38dc tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:19.476756 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-14ee344f-6925-42af-9ac3-43f4501c38dc tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:19.477477 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-14ee344f-6925-42af-9ac3-43f4501c38dc tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:19.478552 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-14ee344f-6925-42af-9ac3-43f4501c38dc tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:19.479439 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-14ee344f-6925-42af-9ac3-43f4501c38dc tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:19.480665 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-14ee344f-6925-42af-9ac3-43f4501c38dc tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:19.507322 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-14ee344f-6925-42af-9ac3-43f4501c38dc tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Getting quotas for project e21d25b0c2c34c33ab70844c8bf0cf97. Resources: {'ram', 'cores', 'instances'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:31:19.512409 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-14ee344f-6925-42af-9ac3-43f4501c38dc tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Getting quotas for user 99862180a0f2408c806bab348d78709a and project e21d25b0c2c34c33ab70844c8bf0cf97. Resources: {'ram', 'cores', 'instances'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:31:19.527427 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-14ee344f-6925-42af-9ac3-43f4501c38dc tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Going to run 1 instances... {{(pid=123596) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:31:19.530926 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-14ee344f-6925-42af-9ac3-43f4501c38dc tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] [instance: 3b8abc08-2a0d-44a6-bdee-3b356bcfb7a1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e8943ec5-4038-4d4b-b9b9-2415a79f5243',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123596) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:31:19.583480 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-84cba8c2-bf0d-436f-a8d7-91b85b1022b0 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:19.584100 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-84cba8c2-bf0d-436f-a8d7-91b85b1022b0 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] [instance: 968f1c40-0d51-403e-9609-8eb62b9060bb] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:19.595591 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-84cba8c2-bf0d-436f-a8d7-91b85b1022b0 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:19.596089 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-84cba8c2-bf0d-436f-a8d7-91b85b1022b0 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:19.596531 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-84cba8c2-bf0d-436f-a8d7-91b85b1022b0 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:19.606905 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-84cba8c2-bf0d-436f-a8d7-91b85b1022b0 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:19.607539 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-84cba8c2-bf0d-436f-a8d7-91b85b1022b0 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:19.608529 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-84cba8c2-bf0d-436f-a8d7-91b85b1022b0 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:19.646076 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-14ee344f-6925-42af-9ac3-43f4501c38dc tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.130914 Oct 04 18:31:19.647394 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 6/18] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 18:31:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 1143 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 18:31:19.658788 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-e7525579-76e6-4cbb-815c-7e1978168513 tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:19.659279 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-e7525579-76e6-4cbb-815c-7e1978168513 tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] [instance: 3b8abc08-2a0d-44a6-bdee-3b356bcfb7a1] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:19.754543 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-84cba8c2-bf0d-436f-a8d7-91b85b1022b0 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '459e65f14af049bba311453d6a86360b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1753b9ee9a644e409a1efd0c9e7c152c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:19.764912 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-84cba8c2-bf0d-436f-a8d7-91b85b1022b0 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] 10.222.0.43 "GET /compute/v2.1/servers/968f1c40-0d51-403e-9609-8eb62b9060bb" status: 200 len: 1215 microversion: 2.1 time: 0.185700 Oct 04 18:31:19.765488 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 13/19] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:19 2022] GET /compute/v2.1/servers/968f1c40-0d51-403e-9609-8eb62b9060bb => generated 1215 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:31:19.834922 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-e7525579-76e6-4cbb-815c-7e1978168513 tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99862180a0f2408c806bab348d78709a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21d25b0c2c34c33ab70844c8bf0cf97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:19.861180 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-e7525579-76e6-4cbb-815c-7e1978168513 tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] 10.222.0.43 "GET /compute/v2.1/servers/3b8abc08-2a0d-44a6-bdee-3b356bcfb7a1" status: 200 len: 1242 microversion: 2.1 time: 0.202033 Oct 04 18:31:19.866685 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 7/20] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:19 2022] GET /compute/v2.1/servers/3b8abc08-2a0d-44a6-bdee-3b356bcfb7a1 => generated 1242 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:20.301723 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-30f6d243-562a-43c5-b29b-fefbaa97db95 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:20.303319 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-30f6d243-562a-43c5-b29b-fefbaa97db95 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] [instance: b36499e0-9405-4153-a581-13c1bd9d43eb] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:20.316806 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-30f6d243-562a-43c5-b29b-fefbaa97db95 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:20.318804 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-30f6d243-562a-43c5-b29b-fefbaa97db95 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:20.319958 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-30f6d243-562a-43c5-b29b-fefbaa97db95 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:20.323169 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-30f6d243-562a-43c5-b29b-fefbaa97db95 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:20.323964 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-30f6d243-562a-43c5-b29b-fefbaa97db95 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:20.324633 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-30f6d243-562a-43c5-b29b-fefbaa97db95 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:20.573430 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-30f6d243-562a-43c5-b29b-fefbaa97db95 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7db99f361654711bea7f1b2c404d312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7adedcdb9c3485ea2738c00e25aa3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:20.593210 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-30f6d243-562a-43c5-b29b-fefbaa97db95 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] 10.222.0.43 "GET /compute/v2.1/servers/b36499e0-9405-4153-a581-13c1bd9d43eb" status: 200 len: 1287 microversion: 2.1 time: 0.297570 Oct 04 18:31:20.609419 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 14/21] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:20 2022] GET /compute/v2.1/servers/b36499e0-9405-4153-a581-13c1bd9d43eb => generated 1287 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:20.792374 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-0c14c2cc-524c-447e-ad58-8df1e32ebd55 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:20.797917 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-0c14c2cc-524c-447e-ad58-8df1e32ebd55 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] [instance: 968f1c40-0d51-403e-9609-8eb62b9060bb] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:20.825923 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0c14c2cc-524c-447e-ad58-8df1e32ebd55 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:20.827464 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0c14c2cc-524c-447e-ad58-8df1e32ebd55 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:20.829495 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0c14c2cc-524c-447e-ad58-8df1e32ebd55 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:20.835768 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0c14c2cc-524c-447e-ad58-8df1e32ebd55 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:20.836734 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0c14c2cc-524c-447e-ad58-8df1e32ebd55 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:20.838581 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0c14c2cc-524c-447e-ad58-8df1e32ebd55 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:20.887836 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-9d5ff195-9e1c-4ebe-b69d-45e6b2701c26 tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:20.888584 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-9d5ff195-9e1c-4ebe-b69d-45e6b2701c26 tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] [instance: 3b8abc08-2a0d-44a6-bdee-3b356bcfb7a1] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:20.900890 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9d5ff195-9e1c-4ebe-b69d-45e6b2701c26 tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:20.901507 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9d5ff195-9e1c-4ebe-b69d-45e6b2701c26 tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:20.907198 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9d5ff195-9e1c-4ebe-b69d-45e6b2701c26 tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:20.908011 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9d5ff195-9e1c-4ebe-b69d-45e6b2701c26 tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:20.908494 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9d5ff195-9e1c-4ebe-b69d-45e6b2701c26 tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:20.908943 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9d5ff195-9e1c-4ebe-b69d-45e6b2701c26 tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:21.130943 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-9d5ff195-9e1c-4ebe-b69d-45e6b2701c26 tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99862180a0f2408c806bab348d78709a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21d25b0c2c34c33ab70844c8bf0cf97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:21.141659 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-9d5ff195-9e1c-4ebe-b69d-45e6b2701c26 tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] 10.222.0.43 "GET /compute/v2.1/servers/3b8abc08-2a0d-44a6-bdee-3b356bcfb7a1" status: 200 len: 1234 microversion: 2.1 time: 0.257943 Oct 04 18:31:21.165667 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 15/22] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:20 2022] GET /compute/v2.1/servers/3b8abc08-2a0d-44a6-bdee-3b356bcfb7a1 => generated 1234 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:21.622180 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-0c14c2cc-524c-447e-ad58-8df1e32ebd55 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '459e65f14af049bba311453d6a86360b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1753b9ee9a644e409a1efd0c9e7c152c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:21.625412 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-19f0644d-cf61-4a82-9818-2330745bb6b7 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:21.627800 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-19f0644d-cf61-4a82-9818-2330745bb6b7 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] [instance: b36499e0-9405-4153-a581-13c1bd9d43eb] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:21.645867 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-19f0644d-cf61-4a82-9818-2330745bb6b7 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:21.646646 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-19f0644d-cf61-4a82-9818-2330745bb6b7 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:21.647701 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-19f0644d-cf61-4a82-9818-2330745bb6b7 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:21.651502 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-19f0644d-cf61-4a82-9818-2330745bb6b7 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:21.652186 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-19f0644d-cf61-4a82-9818-2330745bb6b7 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:21.653173 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-19f0644d-cf61-4a82-9818-2330745bb6b7 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:21.662525 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-0c14c2cc-524c-447e-ad58-8df1e32ebd55 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] 10.222.0.43 "GET /compute/v2.1/servers/968f1c40-0d51-403e-9609-8eb62b9060bb" status: 200 len: 1279 microversion: 2.1 time: 0.877252 Oct 04 18:31:21.663470 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 8/23] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:20 2022] GET /compute/v2.1/servers/968f1c40-0d51-403e-9609-8eb62b9060bb => generated 1279 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:21.893903 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-19f0644d-cf61-4a82-9818-2330745bb6b7 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7db99f361654711bea7f1b2c404d312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7adedcdb9c3485ea2738c00e25aa3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:21.909224 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-19f0644d-cf61-4a82-9818-2330745bb6b7 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] 10.222.0.43 "GET /compute/v2.1/servers/b36499e0-9405-4153-a581-13c1bd9d43eb" status: 200 len: 1275 microversion: 2.1 time: 0.286813 Oct 04 18:31:21.910988 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 16/24] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:21 2022] GET /compute/v2.1/servers/b36499e0-9405-4153-a581-13c1bd9d43eb => generated 1275 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:22.173029 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-13980ba9-4727-439b-b2df-fd51ef437d6f tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:22.173807 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-13980ba9-4727-439b-b2df-fd51ef437d6f tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] [instance: 3b8abc08-2a0d-44a6-bdee-3b356bcfb7a1] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:22.192322 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-13980ba9-4727-439b-b2df-fd51ef437d6f tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:22.195976 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-13980ba9-4727-439b-b2df-fd51ef437d6f tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:22.195976 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-13980ba9-4727-439b-b2df-fd51ef437d6f tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:22.198636 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-13980ba9-4727-439b-b2df-fd51ef437d6f tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:22.199377 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-13980ba9-4727-439b-b2df-fd51ef437d6f tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:22.201068 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-13980ba9-4727-439b-b2df-fd51ef437d6f tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:22.437012 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-13980ba9-4727-439b-b2df-fd51ef437d6f tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99862180a0f2408c806bab348d78709a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21d25b0c2c34c33ab70844c8bf0cf97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:22.475346 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-13980ba9-4727-439b-b2df-fd51ef437d6f tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] 10.222.0.43 "GET /compute/v2.1/servers/3b8abc08-2a0d-44a6-bdee-3b356bcfb7a1" status: 200 len: 1296 microversion: 2.1 time: 0.306686 Oct 04 18:31:22.480339 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 9/25] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:22 2022] GET /compute/v2.1/servers/3b8abc08-2a0d-44a6-bdee-3b356bcfb7a1 => generated 1296 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:22.711135 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-9440f526-be52-4bda-a609-c569591f3d7d tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:22.712609 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-9440f526-be52-4bda-a609-c569591f3d7d tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] [instance: 968f1c40-0d51-403e-9609-8eb62b9060bb] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:22.725132 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9440f526-be52-4bda-a609-c569591f3d7d tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:22.745129 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9440f526-be52-4bda-a609-c569591f3d7d tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:22.745900 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9440f526-be52-4bda-a609-c569591f3d7d tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:22.752584 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9440f526-be52-4bda-a609-c569591f3d7d tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:22.759252 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9440f526-be52-4bda-a609-c569591f3d7d tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:22.761104 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9440f526-be52-4bda-a609-c569591f3d7d tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:22.955843 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-047fcb97-36de-49ff-97e2-9ddd6fbad2db tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:22.957392 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-047fcb97-36de-49ff-97e2-9ddd6fbad2db tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] [instance: b36499e0-9405-4153-a581-13c1bd9d43eb] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:22.997902 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-047fcb97-36de-49ff-97e2-9ddd6fbad2db tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:23.000751 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-047fcb97-36de-49ff-97e2-9ddd6fbad2db tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:23.007283 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-047fcb97-36de-49ff-97e2-9ddd6fbad2db tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:23.013201 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-047fcb97-36de-49ff-97e2-9ddd6fbad2db tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:23.020479 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-047fcb97-36de-49ff-97e2-9ddd6fbad2db tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:23.025190 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-047fcb97-36de-49ff-97e2-9ddd6fbad2db tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:23.559780 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-9440f526-be52-4bda-a609-c569591f3d7d tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '459e65f14af049bba311453d6a86360b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1753b9ee9a644e409a1efd0c9e7c152c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:23.592758 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-9440f526-be52-4bda-a609-c569591f3d7d tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] 10.222.0.43 "GET /compute/v2.1/servers/968f1c40-0d51-403e-9609-8eb62b9060bb" status: 200 len: 1277 microversion: 2.1 time: 0.886779 Oct 04 18:31:23.595334 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 17/26] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:22 2022] GET /compute/v2.1/servers/968f1c40-0d51-403e-9609-8eb62b9060bb => generated 1277 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:31:23.608393 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-1bdf007f-4a89-4a8d-9085-dc7b49efa79e tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:23.610174 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-1bdf007f-4a89-4a8d-9085-dc7b49efa79e tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] [instance: 3b8abc08-2a0d-44a6-bdee-3b356bcfb7a1] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:23.630436 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1bdf007f-4a89-4a8d-9085-dc7b49efa79e tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:23.631217 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1bdf007f-4a89-4a8d-9085-dc7b49efa79e tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:23.632844 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1bdf007f-4a89-4a8d-9085-dc7b49efa79e tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:23.635159 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1bdf007f-4a89-4a8d-9085-dc7b49efa79e tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:23.636226 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1bdf007f-4a89-4a8d-9085-dc7b49efa79e tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:23.637385 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1bdf007f-4a89-4a8d-9085-dc7b49efa79e tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:24.117763 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-047fcb97-36de-49ff-97e2-9ddd6fbad2db tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7db99f361654711bea7f1b2c404d312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7adedcdb9c3485ea2738c00e25aa3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:24.136673 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-047fcb97-36de-49ff-97e2-9ddd6fbad2db tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] 10.222.0.43 "GET /compute/v2.1/servers/b36499e0-9405-4153-a581-13c1bd9d43eb" status: 200 len: 1275 microversion: 2.1 time: 1.189033 Oct 04 18:31:24.137497 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 10/27] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:22 2022] GET /compute/v2.1/servers/b36499e0-9405-4153-a581-13c1bd9d43eb => generated 1275 bytes in 1191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:31:24.540525 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-1bdf007f-4a89-4a8d-9085-dc7b49efa79e tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99862180a0f2408c806bab348d78709a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21d25b0c2c34c33ab70844c8bf0cf97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:24.567320 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-1bdf007f-4a89-4a8d-9085-dc7b49efa79e tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] 10.222.0.43 "GET /compute/v2.1/servers/3b8abc08-2a0d-44a6-bdee-3b356bcfb7a1" status: 200 len: 1296 microversion: 2.1 time: 0.968445 Oct 04 18:31:24.569097 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 18/28] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:23 2022] GET /compute/v2.1/servers/3b8abc08-2a0d-44a6-bdee-3b356bcfb7a1 => generated 1296 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:24.596242 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-c91a51d8-137a-4c6a-9d10-df68dd94b35f tempest-HypervisorAdminUnderV252Test-149310526 tempest-HypervisorAdminUnderV252Test-149310526-project-admin] Calling method '.version_select at 0x7fb22564c3a0>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:24.608534 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-c91a51d8-137a-4c6a-9d10-df68dd94b35f tempest-HypervisorAdminUnderV252Test-149310526 tempest-HypervisorAdminUnderV252Test-149310526-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),66287c68-6a08-453f-953b-bd2446fe0d25(cell1) {{(pid=123596) load_cells /opt/stack/nova/nova/compute/api.py:319}} Oct 04 18:31:24.609885 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c91a51d8-137a-4c6a-9d10-df68dd94b35f tempest-HypervisorAdminUnderV252Test-149310526 tempest-HypervisorAdminUnderV252Test-149310526-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:24.610705 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c91a51d8-137a-4c6a-9d10-df68dd94b35f tempest-HypervisorAdminUnderV252Test-149310526 tempest-HypervisorAdminUnderV252Test-149310526-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:24.611478 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c91a51d8-137a-4c6a-9d10-df68dd94b35f tempest-HypervisorAdminUnderV252Test-149310526 tempest-HypervisorAdminUnderV252Test-149310526-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:24.646159 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c91a51d8-137a-4c6a-9d10-df68dd94b35f tempest-HypervisorAdminUnderV252Test-149310526 tempest-HypervisorAdminUnderV252Test-149310526-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:24.647787 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c91a51d8-137a-4c6a-9d10-df68dd94b35f tempest-HypervisorAdminUnderV252Test-149310526 tempest-HypervisorAdminUnderV252Test-149310526-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:24.648627 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c91a51d8-137a-4c6a-9d10-df68dd94b35f tempest-HypervisorAdminUnderV252Test-149310526 tempest-HypervisorAdminUnderV252Test-149310526-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:24.663787 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c91a51d8-137a-4c6a-9d10-df68dd94b35f tempest-HypervisorAdminUnderV252Test-149310526 tempest-HypervisorAdminUnderV252Test-149310526-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:24.664853 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c91a51d8-137a-4c6a-9d10-df68dd94b35f tempest-HypervisorAdminUnderV252Test-149310526 tempest-HypervisorAdminUnderV252Test-149310526-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:24.666108 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c91a51d8-137a-4c6a-9d10-df68dd94b35f tempest-HypervisorAdminUnderV252Test-149310526 tempest-HypervisorAdminUnderV252Test-149310526-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:24.682539 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-c91a51d8-137a-4c6a-9d10-df68dd94b35f tempest-HypervisorAdminUnderV252Test-149310526 tempest-HypervisorAdminUnderV252Test-149310526-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.498616 Oct 04 18:31:24.684081 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 11/29] 10.222.0.43 () {58 vars in 1146 bytes} [Tue Oct 4 18:31:24 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:31:24.698477 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-3221dd88-056e-4458-a39e-bb25adc6df30 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:24.699341 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-3221dd88-056e-4458-a39e-bb25adc6df30 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] [instance: 968f1c40-0d51-403e-9609-8eb62b9060bb] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:24.709814 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3221dd88-056e-4458-a39e-bb25adc6df30 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:24.711382 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3221dd88-056e-4458-a39e-bb25adc6df30 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:24.713143 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3221dd88-056e-4458-a39e-bb25adc6df30 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:24.714443 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3221dd88-056e-4458-a39e-bb25adc6df30 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:24.715188 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3221dd88-056e-4458-a39e-bb25adc6df30 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:24.715949 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3221dd88-056e-4458-a39e-bb25adc6df30 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:24.773244 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-7ecb2301-46d8-433e-8c7d-c5d5af12fbbc tempest-FlavorsAdminTestJSON-2030826664 tempest-FlavorsAdminTestJSON-2030826664-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-237920621", "id": 687261333, "os-flavor-access:is_public": "True"}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:31:24.880829 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-7ecb2301-46d8-433e-8c7d-c5d5af12fbbc tempest-FlavorsAdminTestJSON-2030826664 tempest-FlavorsAdminTestJSON-2030826664-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 426 microversion: 2.1 time: 0.291031 Oct 04 18:31:24.882260 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 19/30] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 18:31:24 2022] POST /compute/v2.1/flavors => generated 426 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:31:24.894344 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-fafaafbf-6746-44e5-8434-03ea7c51a9cd tempest-HypervisorAdminUnderV252Test-149310526 tempest-HypervisorAdminUnderV252Test-149310526-project-admin] Calling method '.version_select at 0x7fb224a9cb80>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:24.899052 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fafaafbf-6746-44e5-8434-03ea7c51a9cd tempest-HypervisorAdminUnderV252Test-149310526 tempest-HypervisorAdminUnderV252Test-149310526-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:24.900615 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fafaafbf-6746-44e5-8434-03ea7c51a9cd tempest-HypervisorAdminUnderV252Test-149310526 tempest-HypervisorAdminUnderV252Test-149310526-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:24.902137 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fafaafbf-6746-44e5-8434-03ea7c51a9cd tempest-HypervisorAdminUnderV252Test-149310526 tempest-HypervisorAdminUnderV252Test-149310526-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:25.006268 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fafaafbf-6746-44e5-8434-03ea7c51a9cd tempest-HypervisorAdminUnderV252Test-149310526 tempest-HypervisorAdminUnderV252Test-149310526-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:25.010364 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fafaafbf-6746-44e5-8434-03ea7c51a9cd tempest-HypervisorAdminUnderV252Test-149310526 tempest-HypervisorAdminUnderV252Test-149310526-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:25.012024 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fafaafbf-6746-44e5-8434-03ea7c51a9cd tempest-HypervisorAdminUnderV252Test-149310526 tempest-HypervisorAdminUnderV252Test-149310526-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:25.150550 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fafaafbf-6746-44e5-8434-03ea7c51a9cd tempest-HypervisorAdminUnderV252Test-149310526 tempest-HypervisorAdminUnderV252Test-149310526-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:25.153966 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fafaafbf-6746-44e5-8434-03ea7c51a9cd tempest-HypervisorAdminUnderV252Test-149310526 tempest-HypervisorAdminUnderV252Test-149310526-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:25.154662 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fafaafbf-6746-44e5-8434-03ea7c51a9cd tempest-HypervisorAdminUnderV252Test-149310526 tempest-HypervisorAdminUnderV252Test-149310526-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:25.174637 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-fafaafbf-6746-44e5-8434-03ea7c51a9cd tempest-HypervisorAdminUnderV252Test-149310526 tempest-HypervisorAdminUnderV252Test-149310526-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hypervisors/n-h2-851028-13/servers" status: 200 len: 197 microversion: 2.1 time: 0.285986 Oct 04 18:31:25.179972 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 20/31] 10.222.0.43 () {58 vars in 1215 bytes} [Tue Oct 4 18:31:24 2022] GET /compute/v2.1/os-hypervisors/n-h2-851028-13/servers => generated 197 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:31:25.198455 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-738dec6c-242b-4d0b-aab7-4e314e4816b7 tempest-FlavorsAdminTestJSON-2030826664 tempest-FlavorsAdminTestJSON-2030826664-project-admin] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:25.264308 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-738dec6c-242b-4d0b-aab7-4e314e4816b7 tempest-FlavorsAdminTestJSON-2030826664 tempest-FlavorsAdminTestJSON-2030826664-project-admin] 10.222.0.43 "DELETE /compute/v2.1/flavors/687261333" status: 202 len: 0 microversion: 2.1 time: 0.074732 Oct 04 18:31:25.265023 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 21/32] 10.222.0.43 () {58 vars in 1158 bytes} [Tue Oct 4 18:31:25 2022] DELETE /compute/v2.1/flavors/687261333 => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:31:25.275606 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-84b0b679-cf20-4d3f-a017-ae293aebf685 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:25.280722 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-84b0b679-cf20-4d3f-a017-ae293aebf685 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] [instance: b36499e0-9405-4153-a581-13c1bd9d43eb] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:25.295174 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-84b0b679-cf20-4d3f-a017-ae293aebf685 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:25.295684 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-84b0b679-cf20-4d3f-a017-ae293aebf685 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:25.300042 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-84b0b679-cf20-4d3f-a017-ae293aebf685 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:25.301651 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-84b0b679-cf20-4d3f-a017-ae293aebf685 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:25.304133 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-84b0b679-cf20-4d3f-a017-ae293aebf685 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:25.304666 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-84b0b679-cf20-4d3f-a017-ae293aebf685 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:25.338531 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-3221dd88-056e-4458-a39e-bb25adc6df30 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '459e65f14af049bba311453d6a86360b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1753b9ee9a644e409a1efd0c9e7c152c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:25.371728 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-3221dd88-056e-4458-a39e-bb25adc6df30 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] 10.222.0.43 "GET /compute/v2.1/servers/968f1c40-0d51-403e-9609-8eb62b9060bb" status: 200 len: 1277 microversion: 2.1 time: 0.685778 Oct 04 18:31:25.376499 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 12/33] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:24 2022] GET /compute/v2.1/servers/968f1c40-0d51-403e-9609-8eb62b9060bb => generated 1277 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:25.405475 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-c8025cc6-437d-4fd0-8878-49dbad0a62a8 tempest-HypervisorAdminUnderV252Test-149310526 tempest-HypervisorAdminUnderV252Test-149310526-project-admin] Calling method '.version_select at 0x7fb224a4dc10>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:25.414439 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c8025cc6-437d-4fd0-8878-49dbad0a62a8 tempest-HypervisorAdminUnderV252Test-149310526 tempest-HypervisorAdminUnderV252Test-149310526-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:25.415302 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c8025cc6-437d-4fd0-8878-49dbad0a62a8 tempest-HypervisorAdminUnderV252Test-149310526 tempest-HypervisorAdminUnderV252Test-149310526-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:25.415969 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c8025cc6-437d-4fd0-8878-49dbad0a62a8 tempest-HypervisorAdminUnderV252Test-149310526 tempest-HypervisorAdminUnderV252Test-149310526-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:25.483004 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c8025cc6-437d-4fd0-8878-49dbad0a62a8 tempest-HypervisorAdminUnderV252Test-149310526 tempest-HypervisorAdminUnderV252Test-149310526-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:25.509572 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c8025cc6-437d-4fd0-8878-49dbad0a62a8 tempest-HypervisorAdminUnderV252Test-149310526 tempest-HypervisorAdminUnderV252Test-149310526-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:25.517396 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c8025cc6-437d-4fd0-8878-49dbad0a62a8 tempest-HypervisorAdminUnderV252Test-149310526 tempest-HypervisorAdminUnderV252Test-149310526-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:25.583008 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c8025cc6-437d-4fd0-8878-49dbad0a62a8 tempest-HypervisorAdminUnderV252Test-149310526 tempest-HypervisorAdminUnderV252Test-149310526-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:25.583746 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c8025cc6-437d-4fd0-8878-49dbad0a62a8 tempest-HypervisorAdminUnderV252Test-149310526 tempest-HypervisorAdminUnderV252Test-149310526-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:25.593132 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c8025cc6-437d-4fd0-8878-49dbad0a62a8 tempest-HypervisorAdminUnderV252Test-149310526 tempest-HypervisorAdminUnderV252Test-149310526-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:25.633638 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-c8025cc6-437d-4fd0-8878-49dbad0a62a8 tempest-HypervisorAdminUnderV252Test-149310526 tempest-HypervisorAdminUnderV252Test-149310526-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.249750 Oct 04 18:31:25.645898 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 13/34] 10.222.0.43 () {58 vars in 1146 bytes} [Tue Oct 4 18:31:25 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:31:25.661780 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-28984869-cc4c-4014-ad26-633911da6374 tempest-FlavorsAdminTestJSON-2030826664 tempest-FlavorsAdminTestJSON-2030826664-project-admin] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:25.703959 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-84b0b679-cf20-4d3f-a017-ae293aebf685 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7db99f361654711bea7f1b2c404d312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7adedcdb9c3485ea2738c00e25aa3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:25.719049 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-84b0b679-cf20-4d3f-a017-ae293aebf685 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] 10.222.0.43 "GET /compute/v2.1/servers/b36499e0-9405-4153-a581-13c1bd9d43eb" status: 200 len: 1275 microversion: 2.1 time: 0.452492 Oct 04 18:31:25.722403 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 22/35] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:25 2022] GET /compute/v2.1/servers/b36499e0-9405-4153-a581-13c1bd9d43eb => generated 1275 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:25.764281 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-5379ec0b-966d-4d80-a34f-9295e16578f4 tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:25.765531 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-5379ec0b-966d-4d80-a34f-9295e16578f4 tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] [instance: 3b8abc08-2a0d-44a6-bdee-3b356bcfb7a1] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:25.809704 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5379ec0b-966d-4d80-a34f-9295e16578f4 tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:25.810778 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5379ec0b-966d-4d80-a34f-9295e16578f4 tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:25.811277 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5379ec0b-966d-4d80-a34f-9295e16578f4 tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:25.817593 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5379ec0b-966d-4d80-a34f-9295e16578f4 tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:25.818079 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5379ec0b-966d-4d80-a34f-9295e16578f4 tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:25.818579 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5379ec0b-966d-4d80-a34f-9295e16578f4 tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:25.833521 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-28984869-cc4c-4014-ad26-633911da6374 tempest-FlavorsAdminTestJSON-2030826664 tempest-FlavorsAdminTestJSON-2030826664-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.185809 Oct 04 18:31:25.836575 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 14/36] 10.222.0.43 () {58 vars in 1146 bytes} [Tue Oct 4 18:31:25 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:25.844877 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-05635f65-595a-4edb-89b2-b2952266547b tempest-HypervisorAdminUnderV252Test-149310526 tempest-HypervisorAdminUnderV252Test-149310526-project-admin] Calling method '.version_select at 0x7fb224a980d0>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:25.852665 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-05635f65-595a-4edb-89b2-b2952266547b tempest-HypervisorAdminUnderV252Test-149310526 tempest-HypervisorAdminUnderV252Test-149310526-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:25.853401 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-05635f65-595a-4edb-89b2-b2952266547b tempest-HypervisorAdminUnderV252Test-149310526 tempest-HypervisorAdminUnderV252Test-149310526-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:25.854037 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-05635f65-595a-4edb-89b2-b2952266547b tempest-HypervisorAdminUnderV252Test-149310526 tempest-HypervisorAdminUnderV252Test-149310526-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:25.947315 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-05635f65-595a-4edb-89b2-b2952266547b tempest-HypervisorAdminUnderV252Test-149310526 tempest-HypervisorAdminUnderV252Test-149310526-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:25.948132 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-05635f65-595a-4edb-89b2-b2952266547b tempest-HypervisorAdminUnderV252Test-149310526 tempest-HypervisorAdminUnderV252Test-149310526-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:25.948730 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-05635f65-595a-4edb-89b2-b2952266547b tempest-HypervisorAdminUnderV252Test-149310526 tempest-HypervisorAdminUnderV252Test-149310526-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:25.963104 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-05635f65-595a-4edb-89b2-b2952266547b tempest-HypervisorAdminUnderV252Test-149310526 tempest-HypervisorAdminUnderV252Test-149310526-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hypervisors/n-h2-851028-13/search" status: 200 len: 105 microversion: 2.1 time: 0.125129 Oct 04 18:31:25.992875 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-5379ec0b-966d-4d80-a34f-9295e16578f4 tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99862180a0f2408c806bab348d78709a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21d25b0c2c34c33ab70844c8bf0cf97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:26.002224 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 15/37] 10.222.0.43 () {58 vars in 1212 bytes} [Tue Oct 4 18:31:25 2022] GET /compute/v2.1/os-hypervisors/n-h2-851028-13/search => generated 105 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:31:26.034763 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-99994cd0-5735-45b2-8968-e5afd6d514f4 tempest-FlavorsAdminTestJSON-2030826664 tempest-FlavorsAdminTestJSON-2030826664-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-787912095", "id": 383508821, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:31:26.040241 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-5379ec0b-966d-4d80-a34f-9295e16578f4 tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] 10.222.0.43 "GET /compute/v2.1/servers/3b8abc08-2a0d-44a6-bdee-3b356bcfb7a1" status: 200 len: 1296 microversion: 2.1 time: 0.293680 Oct 04 18:31:26.043093 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 23/38] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:25 2022] GET /compute/v2.1/servers/3b8abc08-2a0d-44a6-bdee-3b356bcfb7a1 => generated 1296 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:26.207593 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-99994cd0-5735-45b2-8968-e5afd6d514f4 tempest-FlavorsAdminTestJSON-2030826664 tempest-FlavorsAdminTestJSON-2030826664-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.201784 Oct 04 18:31:26.237296 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-82566ccd-d472-4274-945d-587e19e14a94 tempest-FlavorsAdminTestJSON-2030826664 tempest-FlavorsAdminTestJSON-2030826664-project-admin] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:26.249718 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 16/39] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 18:31:26 2022] POST /compute/v2.1/flavors => generated 413 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:31:26.413310 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-9d8bb5be-d916-4d56-8dce-d7b73f52821c tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:26.414919 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-9d8bb5be-d916-4d56-8dce-d7b73f52821c tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] [instance: 968f1c40-0d51-403e-9609-8eb62b9060bb] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:26.419256 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-82566ccd-d472-4274-945d-587e19e14a94 tempest-FlavorsAdminTestJSON-2030826664 tempest-FlavorsAdminTestJSON-2030826664-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 5394 microversion: 2.1 time: 0.194913 Oct 04 18:31:26.446709 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 24/40] 10.222.0.43 () {58 vars in 1146 bytes} [Tue Oct 4 18:31:26 2022] GET /compute/v2.1/flavors/detail => generated 5394 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:26.448681 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9d8bb5be-d916-4d56-8dce-d7b73f52821c tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:26.449423 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9d8bb5be-d916-4d56-8dce-d7b73f52821c tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:26.450186 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9d8bb5be-d916-4d56-8dce-d7b73f52821c tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:26.451073 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9d8bb5be-d916-4d56-8dce-d7b73f52821c tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:26.453195 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9d8bb5be-d916-4d56-8dce-d7b73f52821c tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:26.455984 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9d8bb5be-d916-4d56-8dce-d7b73f52821c tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:26.478589 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-68cb40c5-b631-4cc5-a639-9dc99e30f7cb tempest-FlavorsAdminTestJSON-2030826664 tempest-FlavorsAdminTestJSON-2030826664-project-admin] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:26.569023 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-68cb40c5-b631-4cc5-a639-9dc99e30f7cb tempest-FlavorsAdminTestJSON-2030826664 tempest-FlavorsAdminTestJSON-2030826664-project-admin] 10.222.0.43 "DELETE /compute/v2.1/flavors/383508821" status: 202 len: 0 microversion: 2.1 time: 0.096466 Oct 04 18:31:26.575363 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 25/41] 10.222.0.43 () {58 vars in 1158 bytes} [Tue Oct 4 18:31:26 2022] DELETE /compute/v2.1/flavors/383508821 => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:31:26.599630 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-e01f00e4-8086-4ae1-a044-737b6b82c8d2 tempest-FlavorsAdminTestJSON-2030826664 tempest-FlavorsAdminTestJSON-2030826664-project-admin] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:26.629199 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=4,nova_api:DELETE=6 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:31:26.747253 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-e01f00e4-8086-4ae1-a044-737b6b82c8d2 tempest-FlavorsAdminTestJSON-2030826664 tempest-FlavorsAdminTestJSON-2030826664-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.166754 Oct 04 18:31:26.760081 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 26/42] 10.222.0.43 () {58 vars in 1146 bytes} [Tue Oct 4 18:31:26 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:26.767009 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-c2f9ca0a-13fc-4250-b2eb-9fa3d12f09c0 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:26.788150 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-c2f9ca0a-13fc-4250-b2eb-9fa3d12f09c0 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] [instance: b36499e0-9405-4153-a581-13c1bd9d43eb] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:26.825444 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c2f9ca0a-13fc-4250-b2eb-9fa3d12f09c0 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:26.826065 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c2f9ca0a-13fc-4250-b2eb-9fa3d12f09c0 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:26.835773 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c2f9ca0a-13fc-4250-b2eb-9fa3d12f09c0 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:26.836691 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c2f9ca0a-13fc-4250-b2eb-9fa3d12f09c0 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:26.837225 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c2f9ca0a-13fc-4250-b2eb-9fa3d12f09c0 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:26.837678 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c2f9ca0a-13fc-4250-b2eb-9fa3d12f09c0 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:26.872904 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-9d8bb5be-d916-4d56-8dce-d7b73f52821c tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '459e65f14af049bba311453d6a86360b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1753b9ee9a644e409a1efd0c9e7c152c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:26.894427 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-9d8bb5be-d916-4d56-8dce-d7b73f52821c tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] 10.222.0.43 "GET /compute/v2.1/servers/968f1c40-0d51-403e-9609-8eb62b9060bb" status: 200 len: 1277 microversion: 2.1 time: 0.492920 Oct 04 18:31:26.896608 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 17/43] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:26 2022] GET /compute/v2.1/servers/968f1c40-0d51-403e-9609-8eb62b9060bb => generated 1277 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:26.902150 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-c27798b9-edc7-4369-b367-0ce837a52299 tempest-FlavorsAdminTestJSON-2030826664 tempest-FlavorsAdminTestJSON-2030826664-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1354698900", "id": 2130927190, "os-flavor-access:is_public": "True"}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:31:26.959604 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-c27798b9-edc7-4369-b367-0ce837a52299 tempest-FlavorsAdminTestJSON-2030826664 tempest-FlavorsAdminTestJSON-2030826664-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 429 microversion: 2.1 time: 0.061382 Oct 04 18:31:26.962792 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 18/44] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 18:31:26 2022] POST /compute/v2.1/flavors => generated 429 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:31:26.980101 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-e08f4716-43cf-48ac-b427-b5cb41cfda9f tempest-FlavorsAdminTestJSON-2030826664 tempest-FlavorsAdminTestJSON-2030826664-project-admin] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:27.104085 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=11,nova_api:DELETE=2 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:31:27.114286 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-e08f4716-43cf-48ac-b427-b5cb41cfda9f tempest-FlavorsAdminTestJSON-2030826664 tempest-FlavorsAdminTestJSON-2030826664-project-admin] 10.222.0.43 "DELETE /compute/v2.1/flavors/2130927190" status: 202 len: 0 microversion: 2.1 time: 0.141858 Oct 04 18:31:27.121459 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 19/45] 10.222.0.43 () {58 vars in 1161 bytes} [Tue Oct 4 18:31:26 2022] DELETE /compute/v2.1/flavors/2130927190 => generated 0 bytes in 150 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:31:27.136337 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-b795dfa1-4a53-4520-a4c2-b56fb5139459 tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:27.137518 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-b795dfa1-4a53-4520-a4c2-b56fb5139459 tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] [instance: 3b8abc08-2a0d-44a6-bdee-3b356bcfb7a1] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:27.152077 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b795dfa1-4a53-4520-a4c2-b56fb5139459 tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:27.153410 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b795dfa1-4a53-4520-a4c2-b56fb5139459 tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:27.154201 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b795dfa1-4a53-4520-a4c2-b56fb5139459 tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:27.155714 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b795dfa1-4a53-4520-a4c2-b56fb5139459 tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:27.161308 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b795dfa1-4a53-4520-a4c2-b56fb5139459 tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:27.162665 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b795dfa1-4a53-4520-a4c2-b56fb5139459 tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:27.507069 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-b795dfa1-4a53-4520-a4c2-b56fb5139459 tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99862180a0f2408c806bab348d78709a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21d25b0c2c34c33ab70844c8bf0cf97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:27.515482 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-b795dfa1-4a53-4520-a4c2-b56fb5139459 tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] 10.222.0.43 "GET /compute/v2.1/servers/3b8abc08-2a0d-44a6-bdee-3b356bcfb7a1" status: 200 len: 1296 microversion: 2.1 time: 0.392634 Oct 04 18:31:27.533225 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 20/46] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:27 2022] GET /compute/v2.1/servers/3b8abc08-2a0d-44a6-bdee-3b356bcfb7a1 => generated 1296 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:27.550998 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-90f3d4ba-90bd-4d00-a3e4-a326be3d972a tempest-FlavorsAdminTestJSON-2030826664 tempest-FlavorsAdminTestJSON-2030826664-project-admin] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:27.731724 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-90f3d4ba-90bd-4d00-a3e4-a326be3d972a tempest-FlavorsAdminTestJSON-2030826664 tempest-FlavorsAdminTestJSON-2030826664-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.196322 Oct 04 18:31:27.756300 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 21/47] 10.222.0.43 () {58 vars in 1146 bytes} [Tue Oct 4 18:31:27 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:27.778986 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-2a6ba9a2-c6ae-4761-a4d2-2db64cbeb4a1 tempest-FlavorsAdminTestJSON-2030826664 tempest-FlavorsAdminTestJSON-2030826664-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-65669573", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:31:27.855425 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=10 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:31:27.856554 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-2a6ba9a2-c6ae-4761-a4d2-2db64cbeb4a1 tempest-FlavorsAdminTestJSON-2030826664 tempest-FlavorsAdminTestJSON-2030826664-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 505 microversion: 2.1 time: 0.082100 Oct 04 18:31:27.871321 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 22/48] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 18:31:27 2022] POST /compute/v2.1/flavors => generated 505 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:31:27.888075 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-1d661515-a0d2-4c29-baba-a312b30a44e9 tempest-FlavorsAdminTestJSON-2030826664 tempest-FlavorsAdminTestJSON-2030826664-project-admin] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:27.911221 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-c2f9ca0a-13fc-4250-b2eb-9fa3d12f09c0 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7db99f361654711bea7f1b2c404d312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7adedcdb9c3485ea2738c00e25aa3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:27.926938 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-1d661515-a0d2-4c29-baba-a312b30a44e9 tempest-FlavorsAdminTestJSON-2030826664 tempest-FlavorsAdminTestJSON-2030826664-project-admin] 10.222.0.43 "DELETE /compute/v2.1/flavors/5e4dd7cd-f5e0-4e77-bcb9-972edf0a6af7" status: 202 len: 0 microversion: 2.1 time: 0.053643 Oct 04 18:31:27.927197 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-c2f9ca0a-13fc-4250-b2eb-9fa3d12f09c0 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] 10.222.0.43 "GET /compute/v2.1/servers/b36499e0-9405-4153-a581-13c1bd9d43eb" status: 200 len: 1317 microversion: 2.1 time: 1.163800 Oct 04 18:31:27.929765 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 27/49] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:26 2022] GET /compute/v2.1/servers/b36499e0-9405-4153-a581-13c1bd9d43eb => generated 1317 bytes in 1167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:27.938633 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 23/50] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 18:31:27 2022] DELETE /compute/v2.1/flavors/5e4dd7cd-f5e0-4e77-bcb9-972edf0a6af7 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:31:27.944772 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-c98fd2b3-9c6d-4149-9f0b-42a02bcf8c5c tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:27.947061 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-c98fd2b3-9c6d-4149-9f0b-42a02bcf8c5c tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] [instance: 968f1c40-0d51-403e-9609-8eb62b9060bb] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:27.958983 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-9e7d5eb4-3669-4843-b247-6cf23f4d23e1 tempest-FlavorsAdminTestJSON-2030826664 tempest-FlavorsAdminTestJSON-2030826664-project-admin] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:27.993411 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c98fd2b3-9c6d-4149-9f0b-42a02bcf8c5c tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:27.994210 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c98fd2b3-9c6d-4149-9f0b-42a02bcf8c5c tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:27.994682 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c98fd2b3-9c6d-4149-9f0b-42a02bcf8c5c tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:28.001482 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c98fd2b3-9c6d-4149-9f0b-42a02bcf8c5c tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:28.004039 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c98fd2b3-9c6d-4149-9f0b-42a02bcf8c5c tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:28.004894 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c98fd2b3-9c6d-4149-9f0b-42a02bcf8c5c tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:28.035014 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-9e7d5eb4-3669-4843-b247-6cf23f4d23e1 tempest-FlavorsAdminTestJSON-2030826664 tempest-FlavorsAdminTestJSON-2030826664-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.094905 Oct 04 18:31:28.052871 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 24/51] 10.222.0.43 () {58 vars in 1146 bytes} [Tue Oct 4 18:31:27 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:28.072405 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-0aef85c8-8336-416f-9963-da26d5ca303a tempest-FlavorsAdminTestJSON-2030826664 tempest-FlavorsAdminTestJSON-2030826664-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1604627725", "id": "1c11329b-caab-4201-a1a8-3211b72f9b20", "os-flavor-access:is_public": "True"}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:31:28.118119 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-0aef85c8-8336-416f-9963-da26d5ca303a tempest-FlavorsAdminTestJSON-2030826664 tempest-FlavorsAdminTestJSON-2030826664-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.056729 Oct 04 18:31:28.135861 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 25/52] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 18:31:28 2022] POST /compute/v2.1/flavors => generated 507 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:31:28.150824 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-db747e1e-a2ab-44a7-8c5a-52d7cee1e390 tempest-FlavorsAdminTestJSON-2030826664 tempest-FlavorsAdminTestJSON-2030826664-project-admin] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:28.214062 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-db747e1e-a2ab-44a7-8c5a-52d7cee1e390 tempest-FlavorsAdminTestJSON-2030826664 tempest-FlavorsAdminTestJSON-2030826664-project-admin] 10.222.0.43 "DELETE /compute/v2.1/flavors/1c11329b-caab-4201-a1a8-3211b72f9b20" status: 202 len: 0 microversion: 2.1 time: 0.075951 Oct 04 18:31:28.224143 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 26/53] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 18:31:28 2022] DELETE /compute/v2.1/flavors/1c11329b-caab-4201-a1a8-3211b72f9b20 => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:31:28.253081 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-43c886d6-3f3b-46bf-9581-a9aa11efd733 tempest-FlavorsAdminTestJSON-2030826664 tempest-FlavorsAdminTestJSON-2030826664-project-admin] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:28.283245 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-c98fd2b3-9c6d-4149-9f0b-42a02bcf8c5c tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '459e65f14af049bba311453d6a86360b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1753b9ee9a644e409a1efd0c9e7c152c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:28.299668 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-c98fd2b3-9c6d-4149-9f0b-42a02bcf8c5c tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] 10.222.0.43 "GET /compute/v2.1/servers/968f1c40-0d51-403e-9609-8eb62b9060bb" status: 200 len: 1277 microversion: 2.1 time: 0.365321 Oct 04 18:31:28.306501 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 28/54] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:27 2022] GET /compute/v2.1/servers/968f1c40-0d51-403e-9609-8eb62b9060bb => generated 1277 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:28.347983 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-43c886d6-3f3b-46bf-9581-a9aa11efd733 tempest-FlavorsAdminTestJSON-2030826664 tempest-FlavorsAdminTestJSON-2030826664-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.120441 Oct 04 18:31:28.349296 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 27/55] 10.222.0.43 () {58 vars in 1146 bytes} [Tue Oct 4 18:31:28 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:28.382610 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-6298de66-c38e-4773-93de-52836b00828b tempest-FlavorsAdminTestJSON-2030826664 tempest-FlavorsAdminTestJSON-2030826664-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1731179636", "id": 457066629, "os-flavor-access:is_public": "True"}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:31:28.423706 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-6298de66-c38e-4773-93de-52836b00828b tempest-FlavorsAdminTestJSON-2030826664 tempest-FlavorsAdminTestJSON-2030826664-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.044844 Oct 04 18:31:28.436173 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 29/56] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 18:31:28 2022] POST /compute/v2.1/flavors => generated 411 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:31:28.448251 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-43fdc038-1639-43a7-8380-a9b076fff3c0 tempest-FlavorsAdminTestJSON-2030826664 tempest-FlavorsAdminTestJSON-2030826664-project-admin] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:28.477530 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-43fdc038-1639-43a7-8380-a9b076fff3c0 tempest-FlavorsAdminTestJSON-2030826664 tempest-FlavorsAdminTestJSON-2030826664-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/457066629" status: 200 len: 411 microversion: 2.1 time: 0.037096 Oct 04 18:31:28.491125 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 28/57] 10.222.0.43 () {58 vars in 1155 bytes} [Tue Oct 4 18:31:28 2022] GET /compute/v2.1/flavors/457066629 => generated 411 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:31:28.540132 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=12 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:31:28.585404 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-c3a65252-9866-4cec-bb39-b9900d96e87e tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:28.587606 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-c3a65252-9866-4cec-bb39-b9900d96e87e tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] [instance: 3b8abc08-2a0d-44a6-bdee-3b356bcfb7a1] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:28.609825 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c3a65252-9866-4cec-bb39-b9900d96e87e tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:28.619906 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c3a65252-9866-4cec-bb39-b9900d96e87e tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:28.621356 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c3a65252-9866-4cec-bb39-b9900d96e87e tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:28.622620 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c3a65252-9866-4cec-bb39-b9900d96e87e tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:28.625224 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c3a65252-9866-4cec-bb39-b9900d96e87e tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:28.627068 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c3a65252-9866-4cec-bb39-b9900d96e87e tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:28.819832 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-c3a65252-9866-4cec-bb39-b9900d96e87e tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99862180a0f2408c806bab348d78709a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21d25b0c2c34c33ab70844c8bf0cf97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:28.864695 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-c3a65252-9866-4cec-bb39-b9900d96e87e tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] 10.222.0.43 "GET /compute/v2.1/servers/3b8abc08-2a0d-44a6-bdee-3b356bcfb7a1" status: 200 len: 1296 microversion: 2.1 time: 0.288813 Oct 04 18:31:28.871367 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 29/58] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:28 2022] GET /compute/v2.1/servers/3b8abc08-2a0d-44a6-bdee-3b356bcfb7a1 => generated 1296 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:28.953407 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-3335fe26-e683-4be5-94ed-047d2a53c583 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:28.954037 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-3335fe26-e683-4be5-94ed-047d2a53c583 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] [instance: b36499e0-9405-4153-a581-13c1bd9d43eb] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:28.966774 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3335fe26-e683-4be5-94ed-047d2a53c583 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:28.967474 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3335fe26-e683-4be5-94ed-047d2a53c583 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:28.967851 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3335fe26-e683-4be5-94ed-047d2a53c583 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:28.968443 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3335fe26-e683-4be5-94ed-047d2a53c583 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:28.968892 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3335fe26-e683-4be5-94ed-047d2a53c583 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:28.969357 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3335fe26-e683-4be5-94ed-047d2a53c583 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:29.156115 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-1869a368-ab11-457d-8a65-49ac4db95396 tempest-FlavorsAdminTestJSON-857655491 tempest-FlavorsAdminTestJSON-857655491-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:29.253512 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-1869a368-ab11-457d-8a65-49ac4db95396 tempest-FlavorsAdminTestJSON-857655491 tempest-FlavorsAdminTestJSON-857655491-project] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 5392 microversion: 2.1 time: 0.762832 Oct 04 18:31:29.279722 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 30/59] 10.222.0.43 () {58 vars in 1146 bytes} [Tue Oct 4 18:31:28 2022] GET /compute/v2.1/flavors/detail => generated 5392 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:29.290860 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-1911bbd5-3e14-42e8-b67d-8b3dd5c1434e tempest-FlavorsAdminTestJSON-2030826664 tempest-FlavorsAdminTestJSON-2030826664-project-admin] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:29.326488 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-1911bbd5-3e14-42e8-b67d-8b3dd5c1434e tempest-FlavorsAdminTestJSON-2030826664 tempest-FlavorsAdminTestJSON-2030826664-project-admin] 10.222.0.43 "DELETE /compute/v2.1/flavors/457066629" status: 202 len: 0 microversion: 2.1 time: 0.044005 Oct 04 18:31:29.328542 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 31/60] 10.222.0.43 () {58 vars in 1158 bytes} [Tue Oct 4 18:31:29 2022] DELETE /compute/v2.1/flavors/457066629 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:31:29.345717 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-c4d595d7-fca2-42a1-9671-e6833afff6f9 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:29.346656 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-c4d595d7-fca2-42a1-9671-e6833afff6f9 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] [instance: 968f1c40-0d51-403e-9609-8eb62b9060bb] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:29.358038 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c4d595d7-fca2-42a1-9671-e6833afff6f9 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:29.358915 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c4d595d7-fca2-42a1-9671-e6833afff6f9 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:29.359667 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c4d595d7-fca2-42a1-9671-e6833afff6f9 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:29.362258 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c4d595d7-fca2-42a1-9671-e6833afff6f9 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:29.364105 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c4d595d7-fca2-42a1-9671-e6833afff6f9 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:29.366077 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c4d595d7-fca2-42a1-9671-e6833afff6f9 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:29.411618 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=100 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:31:29.470753 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-3335fe26-e683-4be5-94ed-047d2a53c583 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7db99f361654711bea7f1b2c404d312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7adedcdb9c3485ea2738c00e25aa3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:29.483997 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-3335fe26-e683-4be5-94ed-047d2a53c583 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] 10.222.0.43 "GET /compute/v2.1/servers/b36499e0-9405-4153-a581-13c1bd9d43eb" status: 200 len: 1317 microversion: 2.1 time: 0.535158 Oct 04 18:31:29.485782 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 30/61] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:28 2022] GET /compute/v2.1/servers/b36499e0-9405-4153-a581-13c1bd9d43eb => generated 1317 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:31:29.492548 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-954a3698-df2f-4436-bff9-ae26a6473036 tempest-FlavorsAdminTestJSON-2030826664 tempest-FlavorsAdminTestJSON-2030826664-project-admin] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:29.514571 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=8 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:31:29.531354 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-954a3698-df2f-4436-bff9-ae26a6473036 tempest-FlavorsAdminTestJSON-2030826664 tempest-FlavorsAdminTestJSON-2030826664-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.043664 Oct 04 18:31:29.544371 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 31/62] 10.222.0.43 () {58 vars in 1146 bytes} [Tue Oct 4 18:31:29 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:29.606599 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-b6947722-8764-4a6c-84f4-a3c658974e0e tempest-FlavorsAdminTestJSON-2030826664 tempest-FlavorsAdminTestJSON-2030826664-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1943145082", "id": 1467282495, "os-flavor-access:is_public": "False"}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:31:29.673723 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-b6947722-8764-4a6c-84f4-a3c658974e0e tempest-FlavorsAdminTestJSON-2030826664 tempest-FlavorsAdminTestJSON-2030826664-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.106541 Oct 04 18:31:29.681359 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 32/63] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 18:31:29 2022] POST /compute/v2.1/flavors => generated 430 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:31:29.703624 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-8f73b3ce-41ab-4a76-9006-1b659de9c7de tempest-FlavorsAdminTestJSON-857655491 tempest-FlavorsAdminTestJSON-857655491-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "1467282495"}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:31:29.721553 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-8f73b3ce-41ab-4a76-9006-1b659de9c7de tempest-FlavorsAdminTestJSON-857655491 tempest-FlavorsAdminTestJSON-857655491-project] HTTP exception thrown: Flavor 1467282495 could not be found. Oct 04 18:31:29.725973 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-8f73b3ce-41ab-4a76-9006-1b659de9c7de tempest-FlavorsAdminTestJSON-857655491 tempest-FlavorsAdminTestJSON-857655491-project] Request method failure captured: Oct 04 18:31:29.725973 n-d-851028-13 devstack@n-api.service[123596]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 18:31:29.725973 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:31:29.725973 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:31:29.725973 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:31:29.725973 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 107 Oct 04 18:31:29.725973 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:31:29.725973 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:31:29.725973 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:31:29.725973 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:31:29.725973 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPHv5bz3uzyCDxGgWjWFVNiO4NtrLeuzvP58DhYTOSbmCaqXXweaMMtwXR5dMR1ds6o9Q8BiYilYeh1Wb1fZyZTnaz7K5KEMDjgzZYZ2Fq1GRonIdbYp-9qxRzC4K29v8oS2Emde8LP9HNeMpuUgz3zr1qhPoZZP8vA-7IW8WY4pgK8Y Oct 04 18:31:29.725973 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:31:29.725973 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:31:29.725973 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:31:29.725973 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:31:29.725973 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:31:29.725973 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:31:29.725973 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: 52d29eb565814c2b8363e7c41af37549 Oct 04 18:31:29.725973 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-FlavorsAdminTestJSON-857655491 Oct 04 18:31:29.725973 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 18:31:29.725973 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 18:31:29.727477 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/52d29eb565814c2b8363e7c41af37549"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_52d29eb565814c2b8363e7c41af37549"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/52d29eb565814c2b8363e7c41af37549"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/52d29eb565814c2b8363e7c41af37549"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:31:29.727477 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-FlavorsAdminTestJSON-857655491 Oct 04 18:31:29.727477 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: 52d29eb565814c2b8363e7c41af37549 Oct 04 18:31:29.727477 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-FlavorsAdminTestJSON-857655491 Oct 04 18:31:29.727477 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-FlavorsAdminTestJSON-857655491-project Oct 04 18:31:29.727477 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:31:29.727477 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:31:29.727477 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 24e78adec9ac42388c73af97711717f0 Oct 04 18:31:29.727477 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-FlavorsAdminTestJSON-857655491-project Oct 04 18:31:29.727477 n-d-851028-13 devstack@n-api.service[123596]: Oct 04 18:31:29.727477 n-d-851028-13 devstack@n-api.service[123596]: {"server": {"name": "test", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "1467282495"}} Oct 04 18:31:29.727477 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 18:31:29.727477 n-d-851028-13 devstack@n-api.service[123596]: exception: Flavor 1467282495 could not be found. Oct 04 18:31:29.728441 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'body': {'server': {'name': 'test', 'imageRef': 'e8943ec5-4038-4d4b-b9b9-2415a79f5243', 'flavorRef': '1467282495'}}} Oct 04 18:31:29.728441 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:31:29.728441 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:31:29.728441 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Oct 04 18:31:29.728441 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Oct 04 18:31:29.728441 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 04 18:31:29.728441 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 04 18:31:29.728441 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 18:31:29.728441 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 18:31:29.728441 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 04 18:31:29.728441 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 04 18:31:29.728441 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 04 18:31:29.728441 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:31:29.728441 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 04 18:31:29.728441 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 04 18:31:29.728441 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 1467282495 could not be found. Oct 04 18:31:29.728441 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:31:29.728441 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:31:29.728441 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:31:29.728441 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:31:29.729837 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:31:29.729837 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:31:29.729837 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:31:29.729837 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:31:29.729837 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:31:29.729837 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:31:29.729837 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:31:29.729837 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:31:29.729837 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:31:29.729837 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:31:29.729837 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:31:29.729837 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:31:29.729837 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 18:31:29.729837 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 04 18:31:29.729837 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 04 18:31:29.729837 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 1467282495 could not be found. Oct 04 18:31:29.729837 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:31:29.729837 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:31:29.729837 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:31:29.729837 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:31:29.729837 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:31:29.731085 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:31:29.731085 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:31:29.731085 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:31:29.731085 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1467282495 could not be found. Oct 04 18:31:29.731085 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:31:29.733396 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-8f73b3ce-41ab-4a76-9006-1b659de9c7de tempest-FlavorsAdminTestJSON-857655491 tempest-FlavorsAdminTestJSON-857655491-project] Returning 400 to user: Flavor 1467282495 could not be found. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:31:29.734471 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-8f73b3ce-41ab-4a76-9006-1b659de9c7de tempest-FlavorsAdminTestJSON-857655491 tempest-FlavorsAdminTestJSON-857655491-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 400 len: 81 microversion: 2.1 time: 0.047637 Oct 04 18:31:29.735661 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 33/64] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 18:31:29 2022] POST /compute/v2.1/servers => generated 81 bytes in 49 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 04 18:31:29.763060 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-5c426092-e588-4211-b76c-32c62feb433d tempest-FlavorsAdminTestJSON-2030826664 tempest-FlavorsAdminTestJSON-2030826664-project-admin] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:29.824662 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-5c426092-e588-4211-b76c-32c62feb433d tempest-FlavorsAdminTestJSON-2030826664 tempest-FlavorsAdminTestJSON-2030826664-project-admin] 10.222.0.43 "DELETE /compute/v2.1/flavors/1467282495" status: 202 len: 0 microversion: 2.1 time: 0.075725 Oct 04 18:31:29.832267 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 34/65] 10.222.0.43 () {58 vars in 1161 bytes} [Tue Oct 4 18:31:29 2022] DELETE /compute/v2.1/flavors/1467282495 => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:31:29.846799 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-9f555249-b98e-46aa-8334-3257ab2a74b5 tempest-FlavorsAdminTestJSON-2030826664 tempest-FlavorsAdminTestJSON-2030826664-project-admin] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:29.862335 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=14 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:31:29.909674 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-9f555249-b98e-46aa-8334-3257ab2a74b5 tempest-FlavorsAdminTestJSON-2030826664 tempest-FlavorsAdminTestJSON-2030826664-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.070229 Oct 04 18:31:29.910787 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 35/66] 10.222.0.43 () {58 vars in 1146 bytes} [Tue Oct 4 18:31:29 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:29.926167 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-15f48be8-8666-48ab-8503-2eaf6b12f65a tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:29.926826 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-15f48be8-8666-48ab-8503-2eaf6b12f65a tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] [instance: 3b8abc08-2a0d-44a6-bdee-3b356bcfb7a1] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:29.947131 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-15f48be8-8666-48ab-8503-2eaf6b12f65a tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:29.947868 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-15f48be8-8666-48ab-8503-2eaf6b12f65a tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:29.948555 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-15f48be8-8666-48ab-8503-2eaf6b12f65a tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:29.949662 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-15f48be8-8666-48ab-8503-2eaf6b12f65a tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:29.950336 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-15f48be8-8666-48ab-8503-2eaf6b12f65a tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:29.950979 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-15f48be8-8666-48ab-8503-2eaf6b12f65a tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:30.141335 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-15f48be8-8666-48ab-8503-2eaf6b12f65a tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99862180a0f2408c806bab348d78709a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21d25b0c2c34c33ab70844c8bf0cf97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:30.167119 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-15f48be8-8666-48ab-8503-2eaf6b12f65a tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] 10.222.0.43 "GET /compute/v2.1/servers/3b8abc08-2a0d-44a6-bdee-3b356bcfb7a1" status: 200 len: 1296 microversion: 2.1 time: 0.254613 Oct 04 18:31:30.171466 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 36/67] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:29 2022] GET /compute/v2.1/servers/3b8abc08-2a0d-44a6-bdee-3b356bcfb7a1 => generated 1296 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:30.183921 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-18c9ce79-7832-4269-8550-dba6c6f61e0e tempest-FlavorsAdminTestJSON-2030826664 tempest-FlavorsAdminTestJSON-2030826664-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-373433555", "id": 1513519700, "os-flavor-access:is_public": "False"}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:31:30.220460 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-18c9ce79-7832-4269-8550-dba6c6f61e0e tempest-FlavorsAdminTestJSON-2030826664 tempest-FlavorsAdminTestJSON-2030826664-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.045721 Oct 04 18:31:30.221448 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 37/68] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 18:31:30 2022] POST /compute/v2.1/flavors => generated 414 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:31:30.238386 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-df4ef47c-e9fe-4dfa-a4d0-9b302f8b9d91 tempest-FlavorsAdminTestJSON-2030826664 tempest-FlavorsAdminTestJSON-2030826664-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1173879708", "id": 1721698149, "os-flavor-access:is_public": "True"}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:31:30.286305 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-c4d595d7-fca2-42a1-9671-e6833afff6f9 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '459e65f14af049bba311453d6a86360b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1753b9ee9a644e409a1efd0c9e7c152c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:30.289779 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-df4ef47c-e9fe-4dfa-a4d0-9b302f8b9d91 tempest-FlavorsAdminTestJSON-2030826664 tempest-FlavorsAdminTestJSON-2030826664-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.050766 Oct 04 18:31:30.293266 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 38/69] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 18:31:30 2022] POST /compute/v2.1/flavors => generated 414 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:31:30.297719 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-c4d595d7-fca2-42a1-9671-e6833afff6f9 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] 10.222.0.43 "GET /compute/v2.1/servers/968f1c40-0d51-403e-9609-8eb62b9060bb" status: 200 len: 1319 microversion: 2.1 time: 0.961205 Oct 04 18:31:30.304700 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 32/70] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:29 2022] GET /compute/v2.1/servers/968f1c40-0d51-403e-9609-8eb62b9060bb => generated 1319 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:30.333943 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-1c2f92e7-f94b-4101-8b30-e3cdaf75352f tempest-FlavorsAdminTestJSON-2030826664 tempest-FlavorsAdminTestJSON-2030826664-project-admin] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:30.418917 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-1c2f92e7-f94b-4101-8b30-e3cdaf75352f tempest-FlavorsAdminTestJSON-2030826664 tempest-FlavorsAdminTestJSON-2030826664-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 417 microversion: 2.1 time: 0.106911 Oct 04 18:31:30.424011 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 39/71] 10.222.0.43 () {58 vars in 1169 bytes} [Tue Oct 4 18:31:30 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 417 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:31:30.442752 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-11a5ff8d-8cb6-491e-88fc-449b4d5c964e tempest-FlavorsAdminTestJSON-2030826664 tempest-FlavorsAdminTestJSON-2030826664-project-admin] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:30.518360 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-fdd66036-9247-4889-aba6-e1b293d7c81f tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:30.519455 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-fdd66036-9247-4889-aba6-e1b293d7c81f tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] [instance: b36499e0-9405-4153-a581-13c1bd9d43eb] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:30.530564 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-11a5ff8d-8cb6-491e-88fc-449b4d5c964e tempest-FlavorsAdminTestJSON-2030826664 tempest-FlavorsAdminTestJSON-2030826664-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 417 microversion: 2.1 time: 0.094322 Oct 04 18:31:30.539431 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 33/72] 10.222.0.43 () {58 vars in 1177 bytes} [Tue Oct 4 18:31:30 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 417 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:31:30.555702 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fdd66036-9247-4889-aba6-e1b293d7c81f tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:30.558885 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fdd66036-9247-4889-aba6-e1b293d7c81f tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:30.561429 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fdd66036-9247-4889-aba6-e1b293d7c81f tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:30.566621 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-695bf463-fc61-4429-9a89-4a6fe98bd2aa tempest-FlavorsAdminTestJSON-2030826664 tempest-FlavorsAdminTestJSON-2030826664-project-admin] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:30.568602 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fdd66036-9247-4889-aba6-e1b293d7c81f tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:30.576029 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fdd66036-9247-4889-aba6-e1b293d7c81f tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:30.579424 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fdd66036-9247-4889-aba6-e1b293d7c81f tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:30.607620 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-695bf463-fc61-4429-9a89-4a6fe98bd2aa tempest-FlavorsAdminTestJSON-2030826664 tempest-FlavorsAdminTestJSON-2030826664-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 417 microversion: 2.1 time: 0.058381 Oct 04 18:31:30.612301 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 34/73] 10.222.0.43 () {58 vars in 1171 bytes} [Tue Oct 4 18:31:30 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 417 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:31:30.633590 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-da8c8e34-a55a-489f-8526-dfe8c975061c tempest-FlavorsAdminTestJSON-2030826664 tempest-FlavorsAdminTestJSON-2030826664-project-admin] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:30.684921 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-da8c8e34-a55a-489f-8526-dfe8c975061c tempest-FlavorsAdminTestJSON-2030826664 tempest-FlavorsAdminTestJSON-2030826664-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 417 microversion: 2.1 time: 0.063679 Oct 04 18:31:30.690505 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 35/74] 10.222.0.43 () {58 vars in 1169 bytes} [Tue Oct 4 18:31:30 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 417 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:31:30.717795 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-a219470a-ced8-4e92-ac17-3990d59a9c07 tempest-FlavorsAdminTestJSON-2030826664 tempest-FlavorsAdminTestJSON-2030826664-project-admin] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:30.765990 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-a219470a-ced8-4e92-ac17-3990d59a9c07 tempest-FlavorsAdminTestJSON-2030826664 tempest-FlavorsAdminTestJSON-2030826664-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 5395 microversion: 2.1 time: 0.056983 Oct 04 18:31:30.768088 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 36/75] 10.222.0.43 () {58 vars in 1169 bytes} [Tue Oct 4 18:31:30 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 5395 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:30.798437 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-d8408963-34a2-4d9c-98b4-7aff64326843 tempest-FlavorsAdminTestJSON-2030826664 tempest-FlavorsAdminTestJSON-2030826664-project-admin] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:30.877511 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-d8408963-34a2-4d9c-98b4-7aff64326843 tempest-FlavorsAdminTestJSON-2030826664 tempest-FlavorsAdminTestJSON-2030826664-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 5395 microversion: 2.1 time: 0.090038 Oct 04 18:31:30.883443 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 37/76] 10.222.0.43 () {58 vars in 1175 bytes} [Tue Oct 4 18:31:30 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 5395 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:31:30.911633 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-3ac4632a-b068-4505-94d2-91d1081ac988 tempest-FlavorsAdminTestJSON-2030826664 tempest-FlavorsAdminTestJSON-2030826664-project-admin] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:30.952034 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-3ac4632a-b068-4505-94d2-91d1081ac988 tempest-FlavorsAdminTestJSON-2030826664 tempest-FlavorsAdminTestJSON-2030826664-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 5395 microversion: 2.1 time: 0.050134 Oct 04 18:31:30.953871 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 38/77] 10.222.0.43 () {58 vars in 1173 bytes} [Tue Oct 4 18:31:30 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 5395 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:30.983510 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-623ea4a7-06d6-4d44-b555-d924aa831d62 tempest-FlavorsAdminTestJSON-2030826664 tempest-FlavorsAdminTestJSON-2030826664-project-admin] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:30.998311 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-fdd66036-9247-4889-aba6-e1b293d7c81f tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7db99f361654711bea7f1b2c404d312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7adedcdb9c3485ea2738c00e25aa3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:31.011618 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-fdd66036-9247-4889-aba6-e1b293d7c81f tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] 10.222.0.43 "GET /compute/v2.1/servers/b36499e0-9405-4153-a581-13c1bd9d43eb" status: 200 len: 1317 microversion: 2.1 time: 0.502827 Oct 04 18:31:31.013948 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 40/78] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:30 2022] GET /compute/v2.1/servers/b36499e0-9405-4153-a581-13c1bd9d43eb => generated 1317 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:31.029155 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-623ea4a7-06d6-4d44-b555-d924aa831d62 tempest-FlavorsAdminTestJSON-2030826664 tempest-FlavorsAdminTestJSON-2030826664-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 5395 microversion: 2.1 time: 0.050975 Oct 04 18:31:31.030692 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 39/79] 10.222.0.43 () {58 vars in 1169 bytes} [Tue Oct 4 18:31:30 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 5395 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:31.051968 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-cc6798f9-f400-4873-8a2a-91114caa27c8 tempest-FlavorsAdminTestJSON-2030826664 tempest-FlavorsAdminTestJSON-2030826664-project-admin] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:31.093661 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-cc6798f9-f400-4873-8a2a-91114caa27c8 tempest-FlavorsAdminTestJSON-2030826664 tempest-FlavorsAdminTestJSON-2030826664-project-admin] 10.222.0.43 "DELETE /compute/v2.1/flavors/1721698149" status: 202 len: 0 microversion: 2.1 time: 0.046177 Oct 04 18:31:31.098276 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 41/80] 10.222.0.43 () {58 vars in 1161 bytes} [Tue Oct 4 18:31:31 2022] DELETE /compute/v2.1/flavors/1721698149 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:31:31.106925 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-4b508fc0-8a87-491c-939b-d74b1c1b7de8 tempest-FlavorsAdminTestJSON-2030826664 tempest-FlavorsAdminTestJSON-2030826664-project-admin] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:31.182248 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-4b508fc0-8a87-491c-939b-d74b1c1b7de8 tempest-FlavorsAdminTestJSON-2030826664 tempest-FlavorsAdminTestJSON-2030826664-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.082447 Oct 04 18:31:31.196661 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 40/81] 10.222.0.43 () {58 vars in 1146 bytes} [Tue Oct 4 18:31:31 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:31.209365 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-bfc29f61-c453-4ee6-ad95-b7048afc641c tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:31.212510 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-bfc29f61-c453-4ee6-ad95-b7048afc641c tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] [instance: 3b8abc08-2a0d-44a6-bdee-3b356bcfb7a1] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:31.241599 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-f32095f3-7ce6-4288-9dfc-79d234f62425 tempest-FlavorsAdminTestJSON-2030826664 tempest-FlavorsAdminTestJSON-2030826664-project-admin] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:31.246595 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bfc29f61-c453-4ee6-ad95-b7048afc641c tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:31.250713 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bfc29f61-c453-4ee6-ad95-b7048afc641c tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:31.258855 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bfc29f61-c453-4ee6-ad95-b7048afc641c tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:31.259680 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bfc29f61-c453-4ee6-ad95-b7048afc641c tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:31.263876 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bfc29f61-c453-4ee6-ad95-b7048afc641c tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:31.265856 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bfc29f61-c453-4ee6-ad95-b7048afc641c tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:31.293080 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-f32095f3-7ce6-4288-9dfc-79d234f62425 tempest-FlavorsAdminTestJSON-2030826664 tempest-FlavorsAdminTestJSON-2030826664-project-admin] 10.222.0.43 "DELETE /compute/v2.1/flavors/1513519700" status: 202 len: 0 microversion: 2.1 time: 0.076132 Oct 04 18:31:31.299411 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 41/82] 10.222.0.43 () {58 vars in 1161 bytes} [Tue Oct 4 18:31:31 2022] DELETE /compute/v2.1/flavors/1513519700 => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:31:31.323006 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-10bbb8dd-9ddc-4c69-8534-90bd3e9f3136 tempest-FlavorsAdminTestJSON-2030826664 tempest-FlavorsAdminTestJSON-2030826664-project-admin] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:31.398953 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-10bbb8dd-9ddc-4c69-8534-90bd3e9f3136 tempest-FlavorsAdminTestJSON-2030826664 tempest-FlavorsAdminTestJSON-2030826664-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.097883 Oct 04 18:31:31.399937 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 42/83] 10.222.0.43 () {58 vars in 1146 bytes} [Tue Oct 4 18:31:31 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:31.405670 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-1d0deed7-d6ab-4beb-9600-1357531fb551 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:31.411893 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-1d0deed7-d6ab-4beb-9600-1357531fb551 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] [instance: 968f1c40-0d51-403e-9609-8eb62b9060bb] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:31.433437 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-bfc29f61-c453-4ee6-ad95-b7048afc641c tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99862180a0f2408c806bab348d78709a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21d25b0c2c34c33ab70844c8bf0cf97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:31.444689 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1d0deed7-d6ab-4beb-9600-1357531fb551 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:31.445634 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1d0deed7-d6ab-4beb-9600-1357531fb551 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:31.446344 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1d0deed7-d6ab-4beb-9600-1357531fb551 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:31.447288 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1d0deed7-d6ab-4beb-9600-1357531fb551 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:31.448004 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-bfc29f61-c453-4ee6-ad95-b7048afc641c tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] 10.222.0.43 "GET /compute/v2.1/servers/3b8abc08-2a0d-44a6-bdee-3b356bcfb7a1" status: 200 len: 1296 microversion: 2.1 time: 0.248516 Oct 04 18:31:31.448116 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1d0deed7-d6ab-4beb-9600-1357531fb551 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:31.450783 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1d0deed7-d6ab-4beb-9600-1357531fb551 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:31.454975 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 42/84] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:31 2022] GET /compute/v2.1/servers/3b8abc08-2a0d-44a6-bdee-3b356bcfb7a1 => generated 1296 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:31.517391 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-62c82478-a999-4b57-81b4-f060339f9ecd tempest-FlavorsAdminTestJSON-2030826664 tempest-FlavorsAdminTestJSON-2030826664-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-957958983", "id": 1834124222, "os-flavor-access:is_public": "False"}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:31:31.563266 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-62c82478-a999-4b57-81b4-f060339f9ecd tempest-FlavorsAdminTestJSON-2030826664 tempest-FlavorsAdminTestJSON-2030826664-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.105436 Oct 04 18:31:31.567833 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 43/85] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 18:31:31 2022] POST /compute/v2.1/flavors => generated 414 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:31:31.585201 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-7611bc09-af22-4881-a98b-2f3491e9323b tempest-FlavorsAdminTestJSON-2030826664 tempest-FlavorsAdminTestJSON-2030826664-project-admin] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:31.620427 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-7611bc09-af22-4881-a98b-2f3491e9323b tempest-FlavorsAdminTestJSON-2030826664 tempest-FlavorsAdminTestJSON-2030826664-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.043418 Oct 04 18:31:31.621800 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 44/86] 10.222.0.43 () {58 vars in 1146 bytes} [Tue Oct 4 18:31:31 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:31:31.648293 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-1836e05d-f023-4e38-9a04-256967cb3cf9 tempest-FlavorsAdminTestJSON-857655491 tempest-FlavorsAdminTestJSON-857655491-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:31.714943 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-1836e05d-f023-4e38-9a04-256967cb3cf9 tempest-FlavorsAdminTestJSON-857655491 tempest-FlavorsAdminTestJSON-857655491-project] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.074582 Oct 04 18:31:31.719418 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 45/87] 10.222.0.43 () {58 vars in 1146 bytes} [Tue Oct 4 18:31:31 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:31.746268 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-bc9ae5e6-c807-4345-af76-6e515a22d8d3 tempest-FlavorsAdminTestJSON-2030826664 tempest-FlavorsAdminTestJSON-2030826664-project-admin] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:31.780504 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-bc9ae5e6-c807-4345-af76-6e515a22d8d3 tempest-FlavorsAdminTestJSON-2030826664 tempest-FlavorsAdminTestJSON-2030826664-project-admin] 10.222.0.43 "DELETE /compute/v2.1/flavors/1834124222" status: 202 len: 0 microversion: 2.1 time: 0.040414 Oct 04 18:31:31.786103 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 46/88] 10.222.0.43 () {58 vars in 1161 bytes} [Tue Oct 4 18:31:31 2022] DELETE /compute/v2.1/flavors/1834124222 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:31:31.797071 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-6cf60eab-fe6c-4853-bab1-1b322bdd0b8c tempest-FlavorsAdminTestJSON-2030826664 tempest-FlavorsAdminTestJSON-2030826664-project-admin] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:31.847981 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-6cf60eab-fe6c-4853-bab1-1b322bdd0b8c tempest-FlavorsAdminTestJSON-2030826664 tempest-FlavorsAdminTestJSON-2030826664-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.059646 Oct 04 18:31:31.862823 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 47/89] 10.222.0.43 () {58 vars in 1146 bytes} [Tue Oct 4 18:31:31 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:31.875398 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f502e390-a625-4764-8772-cdffaf7b62c0 tempest-FlavorsAdminTestJSON-2030826664 tempest-FlavorsAdminTestJSON-2030826664-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-970436507", "id": 2119459668, "os-flavor-access:is_public": "True"}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:31:31.918686 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-f502e390-a625-4764-8772-cdffaf7b62c0 tempest-FlavorsAdminTestJSON-2030826664 tempest-FlavorsAdminTestJSON-2030826664-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.048634 Oct 04 18:31:31.929987 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 48/90] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 18:31:31 2022] POST /compute/v2.1/flavors => generated 413 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:31:31.936206 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-8f018cf9-98fb-4c6e-b746-72f844de98a1 tempest-FlavorsAdminTestJSON-857655491 tempest-FlavorsAdminTestJSON-857655491-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:31.977740 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_api:SELECT=77,nova_api:DELETE=16,nova_api:INSERT=7 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:31:32.004115 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-8f018cf9-98fb-4c6e-b746-72f844de98a1 tempest-FlavorsAdminTestJSON-857655491 tempest-FlavorsAdminTestJSON-857655491-project] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 5394 microversion: 2.1 time: 0.072687 Oct 04 18:31:32.027806 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 49/91] 10.222.0.43 () {58 vars in 1146 bytes} [Tue Oct 4 18:31:31 2022] GET /compute/v2.1/flavors/detail => generated 5394 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:32.045159 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-1ae35d0e-ea32-4b63-bd2b-2eacae8d5d14 tempest-FlavorsAdminTestJSON-2030826664 tempest-FlavorsAdminTestJSON-2030826664-project-admin] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:32.098664 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-1ae35d0e-ea32-4b63-bd2b-2eacae8d5d14 tempest-FlavorsAdminTestJSON-2030826664 tempest-FlavorsAdminTestJSON-2030826664-project-admin] 10.222.0.43 "DELETE /compute/v2.1/flavors/2119459668" status: 202 len: 0 microversion: 2.1 time: 0.058006 Oct 04 18:31:32.105953 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 50/92] 10.222.0.43 () {58 vars in 1161 bytes} [Tue Oct 4 18:31:32 2022] DELETE /compute/v2.1/flavors/2119459668 => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:31:32.123251 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-eb100e4c-ec07-401c-a5c4-008986bff4bf tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:32.127813 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-eb100e4c-ec07-401c-a5c4-008986bff4bf tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] [instance: b36499e0-9405-4153-a581-13c1bd9d43eb] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:32.146807 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-eb100e4c-ec07-401c-a5c4-008986bff4bf tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:32.147482 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-eb100e4c-ec07-401c-a5c4-008986bff4bf tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:32.147955 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-eb100e4c-ec07-401c-a5c4-008986bff4bf tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:32.148951 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-eb100e4c-ec07-401c-a5c4-008986bff4bf tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:32.151824 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-eb100e4c-ec07-401c-a5c4-008986bff4bf tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:32.152361 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-eb100e4c-ec07-401c-a5c4-008986bff4bf tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:32.315952 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-1d0deed7-d6ab-4beb-9600-1357531fb551 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '459e65f14af049bba311453d6a86360b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1753b9ee9a644e409a1efd0c9e7c152c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:32.324985 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-1d0deed7-d6ab-4beb-9600-1357531fb551 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] 10.222.0.43 "GET /compute/v2.1/servers/968f1c40-0d51-403e-9609-8eb62b9060bb" status: 200 len: 1319 microversion: 2.1 time: 0.923716 Oct 04 18:31:32.330073 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 43/93] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:31 2022] GET /compute/v2.1/servers/968f1c40-0d51-403e-9609-8eb62b9060bb => generated 1319 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:32.336098 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-139f086c-131d-456d-9fb5-d3efd62fa052 tempest-FlavorsAdminTestJSON-2030826664 tempest-FlavorsAdminTestJSON-2030826664-project-admin] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:32.408504 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-139f086c-131d-456d-9fb5-d3efd62fa052 tempest-FlavorsAdminTestJSON-2030826664 tempest-FlavorsAdminTestJSON-2030826664-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.076441 Oct 04 18:31:32.427003 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 44/94] 10.222.0.43 () {58 vars in 1146 bytes} [Tue Oct 4 18:31:32 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:32.483110 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-af663fd2-e6af-4114-b61f-608faef4f4ca tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:32.484386 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-af663fd2-e6af-4114-b61f-608faef4f4ca tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] [instance: 3b8abc08-2a0d-44a6-bdee-3b356bcfb7a1] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:32.506495 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-af663fd2-e6af-4114-b61f-608faef4f4ca tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:32.508968 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-af663fd2-e6af-4114-b61f-608faef4f4ca tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:32.511875 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-af663fd2-e6af-4114-b61f-608faef4f4ca tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:32.512977 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-af663fd2-e6af-4114-b61f-608faef4f4ca tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:32.516587 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-af663fd2-e6af-4114-b61f-608faef4f4ca tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:32.517454 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-af663fd2-e6af-4114-b61f-608faef4f4ca tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:32.599308 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-eb100e4c-ec07-401c-a5c4-008986bff4bf tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7db99f361654711bea7f1b2c404d312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7adedcdb9c3485ea2738c00e25aa3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:32.604484 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=100 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:31:32.626949 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-eb100e4c-ec07-401c-a5c4-008986bff4bf tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] 10.222.0.43 "GET /compute/v2.1/servers/b36499e0-9405-4153-a581-13c1bd9d43eb" status: 200 len: 1317 microversion: 2.1 time: 0.519799 Oct 04 18:31:32.627732 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 51/95] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:32 2022] GET /compute/v2.1/servers/b36499e0-9405-4153-a581-13c1bd9d43eb => generated 1317 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:33.364446 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-59d51f5e-1707-4cba-86d6-277a27b75c0e tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:33.365357 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-59d51f5e-1707-4cba-86d6-277a27b75c0e tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] [instance: 968f1c40-0d51-403e-9609-8eb62b9060bb] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:33.375968 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-59d51f5e-1707-4cba-86d6-277a27b75c0e tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:33.376465 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-59d51f5e-1707-4cba-86d6-277a27b75c0e tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:33.376909 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-59d51f5e-1707-4cba-86d6-277a27b75c0e tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:33.377765 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-59d51f5e-1707-4cba-86d6-277a27b75c0e tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:33.378267 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-59d51f5e-1707-4cba-86d6-277a27b75c0e tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:33.387905 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-59d51f5e-1707-4cba-86d6-277a27b75c0e tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:34.102545 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-af663fd2-e6af-4114-b61f-608faef4f4ca tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99862180a0f2408c806bab348d78709a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21d25b0c2c34c33ab70844c8bf0cf97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:34.116953 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-af663fd2-e6af-4114-b61f-608faef4f4ca tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] 10.222.0.43 "GET /compute/v2.1/servers/3b8abc08-2a0d-44a6-bdee-3b356bcfb7a1" status: 200 len: 1338 microversion: 2.1 time: 1.640124 Oct 04 18:31:34.118719 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-59d51f5e-1707-4cba-86d6-277a27b75c0e tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '459e65f14af049bba311453d6a86360b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1753b9ee9a644e409a1efd0c9e7c152c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:34.123176 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 45/96] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:32 2022] GET /compute/v2.1/servers/3b8abc08-2a0d-44a6-bdee-3b356bcfb7a1 => generated 1338 bytes in 1649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:31:34.147992 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-5a9c30ed-a98d-4b26-a970-0a89973bd13d tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:34.151043 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-5a9c30ed-a98d-4b26-a970-0a89973bd13d tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] [instance: b36499e0-9405-4153-a581-13c1bd9d43eb] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:34.153781 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-59d51f5e-1707-4cba-86d6-277a27b75c0e tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] 10.222.0.43 "GET /compute/v2.1/servers/968f1c40-0d51-403e-9609-8eb62b9060bb" status: 200 len: 1319 microversion: 2.1 time: 0.802247 Oct 04 18:31:34.155752 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 52/97] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:33 2022] GET /compute/v2.1/servers/968f1c40-0d51-403e-9609-8eb62b9060bb => generated 1319 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:31:34.177346 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5a9c30ed-a98d-4b26-a970-0a89973bd13d tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:34.182128 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5a9c30ed-a98d-4b26-a970-0a89973bd13d tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:34.184807 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5a9c30ed-a98d-4b26-a970-0a89973bd13d tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:34.186632 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5a9c30ed-a98d-4b26-a970-0a89973bd13d tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:34.187448 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5a9c30ed-a98d-4b26-a970-0a89973bd13d tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:34.195333 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5a9c30ed-a98d-4b26-a970-0a89973bd13d tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:35.144438 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-3ad522e8-cada-4ffc-82fd-d067e32a90e8 tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:35.145744 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-3ad522e8-cada-4ffc-82fd-d067e32a90e8 tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] [instance: 3b8abc08-2a0d-44a6-bdee-3b356bcfb7a1] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:35.170417 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3ad522e8-cada-4ffc-82fd-d067e32a90e8 tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:35.171591 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3ad522e8-cada-4ffc-82fd-d067e32a90e8 tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:35.172715 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3ad522e8-cada-4ffc-82fd-d067e32a90e8 tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:35.179057 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3ad522e8-cada-4ffc-82fd-d067e32a90e8 tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:35.183517 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3ad522e8-cada-4ffc-82fd-d067e32a90e8 tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:35.184227 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3ad522e8-cada-4ffc-82fd-d067e32a90e8 tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:35.619639 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-5a9c30ed-a98d-4b26-a970-0a89973bd13d tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7db99f361654711bea7f1b2c404d312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7adedcdb9c3485ea2738c00e25aa3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:35.653992 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-5a9c30ed-a98d-4b26-a970-0a89973bd13d tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] 10.222.0.43 "GET /compute/v2.1/servers/b36499e0-9405-4153-a581-13c1bd9d43eb" status: 200 len: 1317 microversion: 2.1 time: 1.529213 Oct 04 18:31:35.661813 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 46/98] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:34 2022] GET /compute/v2.1/servers/b36499e0-9405-4153-a581-13c1bd9d43eb => generated 1317 bytes in 1539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:35.692879 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-ffa59228-0847-47b9-b37c-25884dfb9470 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:35.694676 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-ffa59228-0847-47b9-b37c-25884dfb9470 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] [instance: 968f1c40-0d51-403e-9609-8eb62b9060bb] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:35.742637 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ffa59228-0847-47b9-b37c-25884dfb9470 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:35.745641 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ffa59228-0847-47b9-b37c-25884dfb9470 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:35.746530 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ffa59228-0847-47b9-b37c-25884dfb9470 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:35.750588 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ffa59228-0847-47b9-b37c-25884dfb9470 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:35.752138 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ffa59228-0847-47b9-b37c-25884dfb9470 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:35.754440 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ffa59228-0847-47b9-b37c-25884dfb9470 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:35.799344 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-3ad522e8-cada-4ffc-82fd-d067e32a90e8 tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99862180a0f2408c806bab348d78709a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21d25b0c2c34c33ab70844c8bf0cf97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:35.817427 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-3ad522e8-cada-4ffc-82fd-d067e32a90e8 tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] 10.222.0.43 "GET /compute/v2.1/servers/3b8abc08-2a0d-44a6-bdee-3b356bcfb7a1" status: 200 len: 1338 microversion: 2.1 time: 0.676940 Oct 04 18:31:35.820316 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 53/99] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:35 2022] GET /compute/v2.1/servers/3b8abc08-2a0d-44a6-bdee-3b356bcfb7a1 => generated 1338 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:31:36.686685 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f3b166de-2379-4e7b-92dd-597e09443c26 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:36.688377 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-f3b166de-2379-4e7b-92dd-597e09443c26 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] [instance: b36499e0-9405-4153-a581-13c1bd9d43eb] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:36.712182 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f3b166de-2379-4e7b-92dd-597e09443c26 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:36.713149 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f3b166de-2379-4e7b-92dd-597e09443c26 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:36.713859 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f3b166de-2379-4e7b-92dd-597e09443c26 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:36.714902 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f3b166de-2379-4e7b-92dd-597e09443c26 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:36.715429 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f3b166de-2379-4e7b-92dd-597e09443c26 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:36.718603 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f3b166de-2379-4e7b-92dd-597e09443c26 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:37.031659 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-ffa59228-0847-47b9-b37c-25884dfb9470 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '459e65f14af049bba311453d6a86360b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1753b9ee9a644e409a1efd0c9e7c152c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:37.078380 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-ffa59228-0847-47b9-b37c-25884dfb9470 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] 10.222.0.43 "GET /compute/v2.1/servers/968f1c40-0d51-403e-9609-8eb62b9060bb" status: 200 len: 1319 microversion: 2.1 time: 1.415125 Oct 04 18:31:37.087600 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 47/100] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:35 2022] GET /compute/v2.1/servers/968f1c40-0d51-403e-9609-8eb62b9060bb => generated 1319 bytes in 1425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:37.095254 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-f3b166de-2379-4e7b-92dd-597e09443c26 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7db99f361654711bea7f1b2c404d312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7adedcdb9c3485ea2738c00e25aa3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:37.110687 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-6d14c020-3d1f-48cf-8f8c-8c3368ae9205 tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:37.123590 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-f3b166de-2379-4e7b-92dd-597e09443c26 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] 10.222.0.43 "GET /compute/v2.1/servers/b36499e0-9405-4153-a581-13c1bd9d43eb" status: 200 len: 1317 microversion: 2.1 time: 0.434731 Oct 04 18:31:37.125902 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-6d14c020-3d1f-48cf-8f8c-8c3368ae9205 tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] [instance: 3b8abc08-2a0d-44a6-bdee-3b356bcfb7a1] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:37.129387 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 54/101] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:36 2022] GET /compute/v2.1/servers/b36499e0-9405-4153-a581-13c1bd9d43eb => generated 1317 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:37.162809 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6d14c020-3d1f-48cf-8f8c-8c3368ae9205 tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:37.164868 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6d14c020-3d1f-48cf-8f8c-8c3368ae9205 tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:37.166025 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6d14c020-3d1f-48cf-8f8c-8c3368ae9205 tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:37.167643 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6d14c020-3d1f-48cf-8f8c-8c3368ae9205 tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:37.168664 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6d14c020-3d1f-48cf-8f8c-8c3368ae9205 tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:37.170216 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6d14c020-3d1f-48cf-8f8c-8c3368ae9205 tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:37.961953 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-b2cc98ec-4f6f-42e1-8235-0b83e468e488 tempest-HypervisorAdminNegativeUnderV252Test-812527148 tempest-HypervisorAdminNegativeUnderV252Test-812527148-project-admin] Calling method '.version_select at 0x7fb224960e50>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:37.963376 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b2cc98ec-4f6f-42e1-8235-0b83e468e488 tempest-HypervisorAdminNegativeUnderV252Test-812527148 tempest-HypervisorAdminNegativeUnderV252Test-812527148-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:37.963875 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b2cc98ec-4f6f-42e1-8235-0b83e468e488 tempest-HypervisorAdminNegativeUnderV252Test-812527148 tempest-HypervisorAdminNegativeUnderV252Test-812527148-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:37.964324 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b2cc98ec-4f6f-42e1-8235-0b83e468e488 tempest-HypervisorAdminNegativeUnderV252Test-812527148 tempest-HypervisorAdminNegativeUnderV252Test-812527148-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:38.015092 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b2cc98ec-4f6f-42e1-8235-0b83e468e488 tempest-HypervisorAdminNegativeUnderV252Test-812527148 tempest-HypervisorAdminNegativeUnderV252Test-812527148-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:38.015596 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b2cc98ec-4f6f-42e1-8235-0b83e468e488 tempest-HypervisorAdminNegativeUnderV252Test-812527148 tempest-HypervisorAdminNegativeUnderV252Test-812527148-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:38.016050 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b2cc98ec-4f6f-42e1-8235-0b83e468e488 tempest-HypervisorAdminNegativeUnderV252Test-812527148 tempest-HypervisorAdminNegativeUnderV252Test-812527148-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:38.071485 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b2cc98ec-4f6f-42e1-8235-0b83e468e488 tempest-HypervisorAdminNegativeUnderV252Test-812527148 tempest-HypervisorAdminNegativeUnderV252Test-812527148-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:38.073251 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b2cc98ec-4f6f-42e1-8235-0b83e468e488 tempest-HypervisorAdminNegativeUnderV252Test-812527148 tempest-HypervisorAdminNegativeUnderV252Test-812527148-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:38.076140 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b2cc98ec-4f6f-42e1-8235-0b83e468e488 tempest-HypervisorAdminNegativeUnderV252Test-812527148 tempest-HypervisorAdminNegativeUnderV252Test-812527148-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:38.093458 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-b2cc98ec-4f6f-42e1-8235-0b83e468e488 tempest-HypervisorAdminNegativeUnderV252Test-812527148 tempest-HypervisorAdminNegativeUnderV252Test-812527148-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.959330 Oct 04 18:31:38.100268 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 55/102] 10.222.0.43 () {58 vars in 1146 bytes} [Tue Oct 4 18:31:37 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:31:38.653638 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-0f84eefc-ac22-4e87-aa41-27ad390a2cc8 tempest-HypervisorAdminNegativeUnderV252Test-1727428088 tempest-HypervisorAdminNegativeUnderV252Test-1727428088-project] Calling method '.version_select at 0x7fb224960ca0>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:38.657605 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-0f84eefc-ac22-4e87-aa41-27ad390a2cc8 tempest-HypervisorAdminNegativeUnderV252Test-1727428088 tempest-HypervisorAdminNegativeUnderV252Test-1727428088-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': '69ecc40918e9417db84fb635500330d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ad3918f19784c32ae6a812dabfeaf09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:38.668928 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-0f84eefc-ac22-4e87-aa41-27ad390a2cc8 tempest-HypervisorAdminNegativeUnderV252Test-1727428088 tempest-HypervisorAdminNegativeUnderV252Test-1727428088-project] Request method failure captured: Oct 04 18:31:38.668928 n-d-851028-13 devstack@n-api.service[123596]: request: GET /compute/v2.1/os-hypervisors/n-h2-851028-13/search HTTP/1.1 Oct 04 18:31:38.668928 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:31:38.668928 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:31:38.668928 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:31:38.668928 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 18:31:38.668928 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:31:38.668928 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:31:38.668928 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:31:38.668928 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:31:38.668928 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPHwGhaPvTw-mChnm9jSeffRJp51e672RJEFJ_vS1DIn4RtEnbWJm2DxMzLP57KvoErFpkVCShOZkD5NlNW8Fz8kQLJF_RChiP8nYY0UqgUYt6gXhz1DdARaLIm9DzoO2I9FpZAuGLmsFQcYsSt5-8eCIzPCYXOfqz-QkUVJ5YfUE1mA Oct 04 18:31:38.668928 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:31:38.668928 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:31:38.668928 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:31:38.668928 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:31:38.668928 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:31:38.668928 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:31:38.668928 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: 5ad3918f19784c32ae6a812dabfeaf09 Oct 04 18:31:38.668928 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1727428088 Oct 04 18:31:38.668928 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 18:31:38.668928 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 18:31:38.672628 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/5ad3918f19784c32ae6a812dabfeaf09"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_5ad3918f19784c32ae6a812dabfeaf09"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5ad3918f19784c32ae6a812dabfeaf09"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5ad3918f19784c32ae6a812dabfeaf09"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:31:38.672628 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1727428088 Oct 04 18:31:38.672628 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: 5ad3918f19784c32ae6a812dabfeaf09 Oct 04 18:31:38.672628 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1727428088 Oct 04 18:31:38.672628 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1727428088-project Oct 04 18:31:38.672628 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:31:38.672628 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:31:38.672628 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 69ecc40918e9417db84fb635500330d7 Oct 04 18:31:38.672628 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1727428088-project Oct 04 18:31:38.672628 n-d-851028-13 devstack@n-api.service[123596]: method: Oct 04 18:31:38.672628 n-d-851028-13 devstack@n-api.service[123596]: exception: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 04 18:31:38.672628 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': 'n-h2-851028-13'} Oct 04 18:31:38.674085 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:31:38.674085 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:31:38.674085 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:31:38.674085 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:31:38.674085 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:31:38.674085 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:31:38.674085 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:31:38.674085 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:31:38.674085 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:31:38.674085 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:31:38.674085 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 439, in search Oct 04 18:31:38.674085 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'search', target={}) Oct 04 18:31:38.674085 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 18:31:38.674085 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 18:31:38.674085 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 18:31:38.674085 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 18:31:38.674085 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:31:38.674085 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:31:38.674085 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:31:38.675681 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:31:38.675681 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 18:31:38.675681 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 18:31:38.675681 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 18:31:38.675681 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 18:31:38.675681 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 18:31:38.675681 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 18:31:38.675681 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 04 18:31:38.675681 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:31:38.675681 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:31:38.675681 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:31:38.675681 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:31:38.675681 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:31:38.675681 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:31:38.675681 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 18:31:38.675681 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 18:31:38.675681 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 04 18:31:38.675681 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:31:38.683510 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-0f84eefc-ac22-4e87-aa41-27ad390a2cc8 tempest-HypervisorAdminNegativeUnderV252Test-1727428088 tempest-HypervisorAdminNegativeUnderV252Test-1727428088-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:31:38.688738 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-0f84eefc-ac22-4e87-aa41-27ad390a2cc8 tempest-HypervisorAdminNegativeUnderV252Test-1727428088 tempest-HypervisorAdminNegativeUnderV252Test-1727428088-project] 10.222.0.43 "GET /compute/v2.1/os-hypervisors/n-h2-851028-13/search" status: 403 len: 117 microversion: 2.1 time: 0.579510 Oct 04 18:31:38.691627 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 56/103] 10.222.0.43 () {58 vars in 1212 bytes} [Tue Oct 4 18:31:38 2022] GET /compute/v2.1/os-hypervisors/n-h2-851028-13/search => generated 117 bytes in 586 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:31:38.705425 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-091faf48-e71d-4a2f-87bd-198f142cfc41 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:38.707000 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-091faf48-e71d-4a2f-87bd-198f142cfc41 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] [instance: 968f1c40-0d51-403e-9609-8eb62b9060bb] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:38.730852 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-091faf48-e71d-4a2f-87bd-198f142cfc41 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:38.732975 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-091faf48-e71d-4a2f-87bd-198f142cfc41 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:38.734299 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-091faf48-e71d-4a2f-87bd-198f142cfc41 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:38.735836 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-091faf48-e71d-4a2f-87bd-198f142cfc41 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:38.739589 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-091faf48-e71d-4a2f-87bd-198f142cfc41 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:38.740206 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-091faf48-e71d-4a2f-87bd-198f142cfc41 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:38.884842 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-6d14c020-3d1f-48cf-8f8c-8c3368ae9205 tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99862180a0f2408c806bab348d78709a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21d25b0c2c34c33ab70844c8bf0cf97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:38.897414 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-6d14c020-3d1f-48cf-8f8c-8c3368ae9205 tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] 10.222.0.43 "GET /compute/v2.1/servers/3b8abc08-2a0d-44a6-bdee-3b356bcfb7a1" status: 200 len: 1338 microversion: 2.1 time: 1.806937 Oct 04 18:31:38.898092 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 48/104] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:37 2022] GET /compute/v2.1/servers/3b8abc08-2a0d-44a6-bdee-3b356bcfb7a1 => generated 1338 bytes in 1808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:38.915784 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-3afcdc67-d473-4b62-8f64-ecc7a8479816 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:38.923917 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-3afcdc67-d473-4b62-8f64-ecc7a8479816 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] [instance: b36499e0-9405-4153-a581-13c1bd9d43eb] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:38.969409 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3afcdc67-d473-4b62-8f64-ecc7a8479816 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:38.985773 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3afcdc67-d473-4b62-8f64-ecc7a8479816 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:38.988254 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3afcdc67-d473-4b62-8f64-ecc7a8479816 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.030s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:38.989404 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3afcdc67-d473-4b62-8f64-ecc7a8479816 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:39.002086 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3afcdc67-d473-4b62-8f64-ecc7a8479816 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:39.017291 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3afcdc67-d473-4b62-8f64-ecc7a8479816 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:39.186914 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-091faf48-e71d-4a2f-87bd-198f142cfc41 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '459e65f14af049bba311453d6a86360b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1753b9ee9a644e409a1efd0c9e7c152c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:39.195144 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-091faf48-e71d-4a2f-87bd-198f142cfc41 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] 10.222.0.43 "GET /compute/v2.1/servers/968f1c40-0d51-403e-9609-8eb62b9060bb" status: 200 len: 1319 microversion: 2.1 time: 0.501796 Oct 04 18:31:39.195760 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 57/105] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:38 2022] GET /compute/v2.1/servers/968f1c40-0d51-403e-9609-8eb62b9060bb => generated 1319 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:39.705002 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-3e55d2fe-b7c3-4ef1-beaf-5b2a352aa01e req-afb9595c-d8a9-409b-b550-f7a314f5afb4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b36499e0-9405-4153-a581-13c1bd9d43eb", "tag": "7e660be0-d7f2-4b01-9122-66b33a304293"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:31:39.748390 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-3e55d2fe-b7c3-4ef1-beaf-5b2a352aa01e req-afb9595c-d8a9-409b-b550-f7a314f5afb4 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:39.751135 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-3e55d2fe-b7c3-4ef1-beaf-5b2a352aa01e req-afb9595c-d8a9-409b-b550-f7a314f5afb4 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:39.754076 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-3e55d2fe-b7c3-4ef1-beaf-5b2a352aa01e req-afb9595c-d8a9-409b-b550-f7a314f5afb4 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:39.816656 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-3e55d2fe-b7c3-4ef1-beaf-5b2a352aa01e req-afb9595c-d8a9-409b-b550-f7a314f5afb4 service nova] Creating event network-changed:7e660be0-d7f2-4b01-9122-66b33a304293 for instance b36499e0-9405-4153-a581-13c1bd9d43eb on n-h1-851028-13 Oct 04 18:31:39.818646 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-3e55d2fe-b7c3-4ef1-beaf-5b2a352aa01e req-afb9595c-d8a9-409b-b550-f7a314f5afb4 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=123596) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 04 18:31:39.820277 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-3e55d2fe-b7c3-4ef1-beaf-5b2a352aa01e req-afb9595c-d8a9-409b-b550-f7a314f5afb4 service nova] Acquired lock "compute-rpcapi-router" {{(pid=123596) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 04 18:31:39.822894 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3eb3d3d5-6e4d-4344-af89-704f978eb6f7 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:39.824648 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3eb3d3d5-6e4d-4344-af89-704f978eb6f7 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:39.826318 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3eb3d3d5-6e4d-4344-af89-704f978eb6f7 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:39.828293 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3eb3d3d5-6e4d-4344-af89-704f978eb6f7 None None] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:39.829638 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3eb3d3d5-6e4d-4344-af89-704f978eb6f7 None None] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:39.830690 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3eb3d3d5-6e4d-4344-af89-704f978eb6f7 None None] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:39.850592 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.compute.rpcapi [None req-3eb3d3d5-6e4d-4344-af89-704f978eb6f7 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 04 18:31:39.852556 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3eb3d3d5-6e4d-4344-af89-704f978eb6f7 None None] Releasing lock "compute-rpcapi-router" {{(pid=123596) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 04 18:31:39.896195 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-3eb3d3d5-6e4d-4344-af89-704f978eb6f7 None None] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.693513 Oct 04 18:31:39.897890 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 58/106] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:31:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:31:39.908486 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-e5fcc6fe-cea3-40c3-9fba-6a3d86ea8da4 tempest-HypervisorAdminNegativeUnderV252Test-812527148 tempest-HypervisorAdminNegativeUnderV252Test-812527148-project-admin] Calling method '.version_select at 0x7fb224960ee0>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:39.912413 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e5fcc6fe-cea3-40c3-9fba-6a3d86ea8da4 tempest-HypervisorAdminNegativeUnderV252Test-812527148 tempest-HypervisorAdminNegativeUnderV252Test-812527148-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:39.914512 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e5fcc6fe-cea3-40c3-9fba-6a3d86ea8da4 tempest-HypervisorAdminNegativeUnderV252Test-812527148 tempest-HypervisorAdminNegativeUnderV252Test-812527148-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:39.915841 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e5fcc6fe-cea3-40c3-9fba-6a3d86ea8da4 tempest-HypervisorAdminNegativeUnderV252Test-812527148 tempest-HypervisorAdminNegativeUnderV252Test-812527148-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:39.928899 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-e5fcc6fe-cea3-40c3-9fba-6a3d86ea8da4 tempest-HypervisorAdminNegativeUnderV252Test-812527148 tempest-HypervisorAdminNegativeUnderV252Test-812527148-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 04 18:31:39.930937 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-e5fcc6fe-cea3-40c3-9fba-6a3d86ea8da4 tempest-HypervisorAdminNegativeUnderV252Test-812527148 tempest-HypervisorAdminNegativeUnderV252Test-812527148-project-admin] Request method failure captured: Oct 04 18:31:39.930937 n-d-851028-13 devstack@n-api.service[123596]: request: GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search HTTP/1.1 Oct 04 18:31:39.930937 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:31:39.930937 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:31:39.930937 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:31:39.930937 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 18:31:39.930937 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:31:39.930937 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:31:39.930937 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:31:39.930937 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:31:39.930937 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPHwIkb8S4ivDhBxiayAAPMjA0JPk9QacYXSi3Qh15T_tynrA8y3KHM7RMo21XpFJ_he-UnQbfMDIPCTngUTZ4-QiFvWx3QbvX4Achyn7vCTl6VdaBkYr4TTI2m87JQP0zvq4mfgoXAX1Nh043fgs7g3HVunwITU7ctKPTZvyVskxy2c Oct 04 18:31:39.930937 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:31:39.930937 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:31:39.930937 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:31:39.930937 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:31:39.930937 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:31:39.930937 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:31:39.930937 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: 549c27d8818848f58f07666edd6c1d71 Oct 04 18:31:39.930937 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-812527148 Oct 04 18:31:39.930937 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,admin,reader Oct 04 18:31:39.930937 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,admin,reader Oct 04 18:31:39.932227 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/549c27d8818848f58f07666edd6c1d71"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_549c27d8818848f58f07666edd6c1d71"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/549c27d8818848f58f07666edd6c1d71"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/549c27d8818848f58f07666edd6c1d71"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:31:39.932227 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-812527148 Oct 04 18:31:39.932227 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: 549c27d8818848f58f07666edd6c1d71 Oct 04 18:31:39.932227 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-812527148 Oct 04 18:31:39.932227 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-812527148-project-admin Oct 04 18:31:39.932227 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:31:39.932227 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:31:39.932227 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 6838cd3fb53a43c2bdd825d67f034d2b Oct 04 18:31:39.932227 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-812527148-project-admin Oct 04 18:31:39.932227 n-d-851028-13 devstack@n-api.service[123596]: method: Oct 04 18:31:39.932227 n-d-851028-13 devstack@n-api.service[123596]: exception: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 04 18:31:39.932227 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': 'nonexistent_hypervisor_name'} Oct 04 18:31:39.933025 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:31:39.933025 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:31:39.933025 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:31:39.933025 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:31:39.933025 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:31:39.933025 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:31:39.933025 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:31:39.933025 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:31:39.933025 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:31:39.933025 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:31:39.933025 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 443, in search Oct 04 18:31:39.933025 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Oct 04 18:31:39.933025 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Oct 04 18:31:39.933025 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 04 18:31:39.933025 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 04 18:31:39.933025 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:31:39.933025 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:31:39.933025 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:31:39.933025 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:31:39.933025 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:31:39.936060 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:31:39.936060 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:31:39.936060 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:31:39.936060 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 04 18:31:39.936060 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:31:39.938106 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-e5fcc6fe-cea3-40c3-9fba-6a3d86ea8da4 tempest-HypervisorAdminNegativeUnderV252Test-812527148 tempest-HypervisorAdminNegativeUnderV252Test-812527148-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:31:39.939290 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-e5fcc6fe-cea3-40c3-9fba-6a3d86ea8da4 tempest-HypervisorAdminNegativeUnderV252Test-812527148 tempest-HypervisorAdminNegativeUnderV252Test-812527148-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.039472 Oct 04 18:31:39.940424 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 59/107] 10.222.0.43 () {58 vars in 1251 bytes} [Tue Oct 4 18:31:39 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:31:39.956692 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f3752952-0bfe-42b1-9ab8-2b3a61c8e578 tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:39.958151 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-f3752952-0bfe-42b1-9ab8-2b3a61c8e578 tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] [instance: 3b8abc08-2a0d-44a6-bdee-3b356bcfb7a1] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:39.967990 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f3752952-0bfe-42b1-9ab8-2b3a61c8e578 tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:39.969264 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f3752952-0bfe-42b1-9ab8-2b3a61c8e578 tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:39.970688 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f3752952-0bfe-42b1-9ab8-2b3a61c8e578 tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:39.972055 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f3752952-0bfe-42b1-9ab8-2b3a61c8e578 tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:39.973560 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f3752952-0bfe-42b1-9ab8-2b3a61c8e578 tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:39.974500 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f3752952-0bfe-42b1-9ab8-2b3a61c8e578 tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:40.235727 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-f3752952-0bfe-42b1-9ab8-2b3a61c8e578 tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99862180a0f2408c806bab348d78709a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21d25b0c2c34c33ab70844c8bf0cf97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:40.251415 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-f3752952-0bfe-42b1-9ab8-2b3a61c8e578 tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] 10.222.0.43 "GET /compute/v2.1/servers/3b8abc08-2a0d-44a6-bdee-3b356bcfb7a1" status: 200 len: 1338 microversion: 2.1 time: 0.309316 Oct 04 18:31:40.253085 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 60/108] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:39 2022] GET /compute/v2.1/servers/3b8abc08-2a0d-44a6-bdee-3b356bcfb7a1 => generated 1338 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:40.259071 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-df40065a-12bc-46a7-925f-82caed3e22a7 tempest-HypervisorAdminNegativeUnderV252Test-812527148 tempest-HypervisorAdminNegativeUnderV252Test-812527148-project-admin] Calling method '.version_select at 0x7fb2249609d0>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:40.261538 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-df40065a-12bc-46a7-925f-82caed3e22a7 tempest-HypervisorAdminNegativeUnderV252Test-812527148 tempest-HypervisorAdminNegativeUnderV252Test-812527148-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:40.262529 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-df40065a-12bc-46a7-925f-82caed3e22a7 tempest-HypervisorAdminNegativeUnderV252Test-812527148 tempest-HypervisorAdminNegativeUnderV252Test-812527148-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:40.263889 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-df40065a-12bc-46a7-925f-82caed3e22a7 tempest-HypervisorAdminNegativeUnderV252Test-812527148 tempest-HypervisorAdminNegativeUnderV252Test-812527148-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:40.289448 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-df40065a-12bc-46a7-925f-82caed3e22a7 tempest-HypervisorAdminNegativeUnderV252Test-812527148 tempest-HypervisorAdminNegativeUnderV252Test-812527148-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:40.290594 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-df40065a-12bc-46a7-925f-82caed3e22a7 tempest-HypervisorAdminNegativeUnderV252Test-812527148 tempest-HypervisorAdminNegativeUnderV252Test-812527148-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:40.291326 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-df40065a-12bc-46a7-925f-82caed3e22a7 tempest-HypervisorAdminNegativeUnderV252Test-812527148 tempest-HypervisorAdminNegativeUnderV252Test-812527148-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:40.306558 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-df40065a-12bc-46a7-925f-82caed3e22a7 tempest-HypervisorAdminNegativeUnderV252Test-812527148 tempest-HypervisorAdminNegativeUnderV252Test-812527148-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:40.307274 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-df40065a-12bc-46a7-925f-82caed3e22a7 tempest-HypervisorAdminNegativeUnderV252Test-812527148 tempest-HypervisorAdminNegativeUnderV252Test-812527148-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:40.308231 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-df40065a-12bc-46a7-925f-82caed3e22a7 tempest-HypervisorAdminNegativeUnderV252Test-812527148 tempest-HypervisorAdminNegativeUnderV252Test-812527148-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:40.319870 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-df40065a-12bc-46a7-925f-82caed3e22a7 tempest-HypervisorAdminNegativeUnderV252Test-812527148 tempest-HypervisorAdminNegativeUnderV252Test-812527148-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.064837 Oct 04 18:31:40.321061 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 61/109] 10.222.0.43 () {58 vars in 1146 bytes} [Tue Oct 4 18:31:40 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:31:40.327943 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f8ba03ce-4b26-4138-8bc1-01940c58794a tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:40.329259 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-f8ba03ce-4b26-4138-8bc1-01940c58794a tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] [instance: 968f1c40-0d51-403e-9609-8eb62b9060bb] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:40.340622 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f8ba03ce-4b26-4138-8bc1-01940c58794a tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:40.342566 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f8ba03ce-4b26-4138-8bc1-01940c58794a tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:40.343368 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f8ba03ce-4b26-4138-8bc1-01940c58794a tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:40.345578 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f8ba03ce-4b26-4138-8bc1-01940c58794a tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:40.347053 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f8ba03ce-4b26-4138-8bc1-01940c58794a tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:40.348124 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f8ba03ce-4b26-4138-8bc1-01940c58794a tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:40.355350 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-3afcdc67-d473-4b62-8f64-ecc7a8479816 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7db99f361654711bea7f1b2c404d312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7adedcdb9c3485ea2738c00e25aa3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:40.366129 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-3afcdc67-d473-4b62-8f64-ecc7a8479816 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] 10.222.0.43 "GET /compute/v2.1/servers/b36499e0-9405-4153-a581-13c1bd9d43eb" status: 200 len: 1317 microversion: 2.1 time: 1.454142 Oct 04 18:31:40.371080 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 49/110] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:38 2022] GET /compute/v2.1/servers/b36499e0-9405-4153-a581-13c1bd9d43eb => generated 1317 bytes in 1460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:40.376670 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-55a1da79-d5c3-4a0a-82b5-8a3680afb3ed tempest-HypervisorAdminNegativeUnderV252Test-1727428088 tempest-HypervisorAdminNegativeUnderV252Test-1727428088-project] Calling method '.version_select at 0x7fb2249f78b0>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:40.379034 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-55a1da79-d5c3-4a0a-82b5-8a3680afb3ed tempest-HypervisorAdminNegativeUnderV252Test-1727428088 tempest-HypervisorAdminNegativeUnderV252Test-1727428088-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': '69ecc40918e9417db84fb635500330d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ad3918f19784c32ae6a812dabfeaf09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:40.404628 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-55a1da79-d5c3-4a0a-82b5-8a3680afb3ed tempest-HypervisorAdminNegativeUnderV252Test-1727428088 tempest-HypervisorAdminNegativeUnderV252Test-1727428088-project] Request method failure captured: Oct 04 18:31:40.404628 n-d-851028-13 devstack@n-api.service[123595]: request: GET /compute/v2.1/os-hypervisors/1/servers HTTP/1.1 Oct 04 18:31:40.404628 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 18:31:40.404628 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 18:31:40.404628 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 18:31:40.404628 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 0 Oct 04 18:31:40.404628 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 18:31:40.404628 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 18:31:40.404628 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 18:31:40.404628 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 18:31:40.404628 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPHwGhaPvTw-mChnm9jSeffRJp51e672RJEFJ_vS1DIn4RtEnbWJm2DxMzLP57KvoErFpkVCShOZkD5NlNW8Fz8kQLJF_RChiP8nYY0UqgUYt6gXhz1DdARaLIm9DzoO2I9FpZAuGLmsFQcYsSt5-8eCIzPCYXOfqz-QkUVJ5YfUE1mA Oct 04 18:31:40.404628 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 18:31:40.404628 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 18:31:40.404628 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 18:31:40.404628 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 18:31:40.404628 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 18:31:40.404628 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 18:31:40.404628 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: 5ad3918f19784c32ae6a812dabfeaf09 Oct 04 18:31:40.404628 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1727428088 Oct 04 18:31:40.404628 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 18:31:40.404628 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 18:31:40.406130 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/5ad3918f19784c32ae6a812dabfeaf09"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_5ad3918f19784c32ae6a812dabfeaf09"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5ad3918f19784c32ae6a812dabfeaf09"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5ad3918f19784c32ae6a812dabfeaf09"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:31:40.406130 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1727428088 Oct 04 18:31:40.406130 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: 5ad3918f19784c32ae6a812dabfeaf09 Oct 04 18:31:40.406130 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1727428088 Oct 04 18:31:40.406130 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1727428088-project Oct 04 18:31:40.406130 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 18:31:40.406130 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 18:31:40.406130 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: 69ecc40918e9417db84fb635500330d7 Oct 04 18:31:40.406130 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1727428088-project Oct 04 18:31:40.406130 n-d-851028-13 devstack@n-api.service[123595]: method: Oct 04 18:31:40.406130 n-d-851028-13 devstack@n-api.service[123595]: exception: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 04 18:31:40.406130 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': '1'} Oct 04 18:31:40.406909 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:31:40.406909 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:31:40.406909 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:31:40.406909 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:31:40.406909 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:31:40.406909 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:31:40.406909 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:31:40.406909 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:31:40.406909 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:31:40.406909 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:31:40.406909 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 478, in servers Oct 04 18:31:40.406909 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'servers', target={}) Oct 04 18:31:40.406909 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 18:31:40.406909 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 18:31:40.406909 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 18:31:40.406909 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 18:31:40.406909 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:31:40.406909 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:31:40.406909 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:31:40.408063 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:31:40.408063 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 18:31:40.408063 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 18:31:40.408063 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 18:31:40.408063 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 18:31:40.408063 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 18:31:40.408063 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 18:31:40.408063 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 04 18:31:40.408063 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:31:40.408063 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:31:40.408063 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:31:40.408063 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:31:40.408063 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:31:40.408063 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:31:40.408063 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 18:31:40.408063 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 18:31:40.408063 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 04 18:31:40.408063 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:31:40.420434 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-55a1da79-d5c3-4a0a-82b5-8a3680afb3ed tempest-HypervisorAdminNegativeUnderV252Test-1727428088 tempest-HypervisorAdminNegativeUnderV252Test-1727428088-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:31:40.422456 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-55a1da79-d5c3-4a0a-82b5-8a3680afb3ed tempest-HypervisorAdminNegativeUnderV252Test-1727428088 tempest-HypervisorAdminNegativeUnderV252Test-1727428088-project] 10.222.0.43 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.050154 Oct 04 18:31:40.424943 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 50/111] 10.222.0.43 () {58 vars in 1176 bytes} [Tue Oct 4 18:31:40 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 52 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:31:40.450332 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-e6371bfc-d8fe-4be1-9a38-5e8a87af4777 tempest-HypervisorAdminNegativeUnderV252Test-812527148 tempest-HypervisorAdminNegativeUnderV252Test-812527148-project-admin] Calling method '.version_select at 0x7fb2249c5dc0>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:40.452568 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e6371bfc-d8fe-4be1-9a38-5e8a87af4777 tempest-HypervisorAdminNegativeUnderV252Test-812527148 tempest-HypervisorAdminNegativeUnderV252Test-812527148-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:40.453454 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e6371bfc-d8fe-4be1-9a38-5e8a87af4777 tempest-HypervisorAdminNegativeUnderV252Test-812527148 tempest-HypervisorAdminNegativeUnderV252Test-812527148-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:40.454142 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e6371bfc-d8fe-4be1-9a38-5e8a87af4777 tempest-HypervisorAdminNegativeUnderV252Test-812527148 tempest-HypervisorAdminNegativeUnderV252Test-812527148-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:40.463684 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-e6371bfc-d8fe-4be1-9a38-5e8a87af4777 tempest-HypervisorAdminNegativeUnderV252Test-812527148 tempest-HypervisorAdminNegativeUnderV252Test-812527148-project-admin] HTTP exception thrown: No hypervisor matching '70e33729-8ebc-4683-a99f-17aad5502e92' could be found. Oct 04 18:31:40.471906 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-e6371bfc-d8fe-4be1-9a38-5e8a87af4777 tempest-HypervisorAdminNegativeUnderV252Test-812527148 tempest-HypervisorAdminNegativeUnderV252Test-812527148-project-admin] Request method failure captured: Oct 04 18:31:40.471906 n-d-851028-13 devstack@n-api.service[123595]: request: GET /compute/v2.1/os-hypervisors/70e33729-8ebc-4683-a99f-17aad5502e92/servers HTTP/1.1 Oct 04 18:31:40.471906 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 18:31:40.471906 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 18:31:40.471906 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 18:31:40.471906 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 0 Oct 04 18:31:40.471906 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 18:31:40.471906 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 18:31:40.471906 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 18:31:40.471906 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 18:31:40.471906 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPHwIkb8S4ivDhBxiayAAPMjA0JPk9QacYXSi3Qh15T_tynrA8y3KHM7RMo21XpFJ_he-UnQbfMDIPCTngUTZ4-QiFvWx3QbvX4Achyn7vCTl6VdaBkYr4TTI2m87JQP0zvq4mfgoXAX1Nh043fgs7g3HVunwITU7ctKPTZvyVskxy2c Oct 04 18:31:40.471906 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 18:31:40.471906 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 18:31:40.471906 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 18:31:40.471906 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 18:31:40.471906 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 18:31:40.471906 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 18:31:40.471906 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: 549c27d8818848f58f07666edd6c1d71 Oct 04 18:31:40.471906 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-812527148 Oct 04 18:31:40.471906 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,admin,reader Oct 04 18:31:40.471906 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,admin,reader Oct 04 18:31:40.473346 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/549c27d8818848f58f07666edd6c1d71"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_549c27d8818848f58f07666edd6c1d71"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/549c27d8818848f58f07666edd6c1d71"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/549c27d8818848f58f07666edd6c1d71"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:31:40.473346 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-812527148 Oct 04 18:31:40.473346 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: 549c27d8818848f58f07666edd6c1d71 Oct 04 18:31:40.473346 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-812527148 Oct 04 18:31:40.473346 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-812527148-project-admin Oct 04 18:31:40.473346 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 18:31:40.473346 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 18:31:40.473346 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: 6838cd3fb53a43c2bdd825d67f034d2b Oct 04 18:31:40.473346 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-812527148-project-admin Oct 04 18:31:40.473346 n-d-851028-13 devstack@n-api.service[123595]: method: Oct 04 18:31:40.473346 n-d-851028-13 devstack@n-api.service[123595]: exception: No hypervisor matching '70e33729-8ebc-4683-a99f-17aad5502e92' could be found. Oct 04 18:31:40.473346 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': '70e33729-8ebc-4683-a99f-17aad5502e92'} Oct 04 18:31:40.474095 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:31:40.474095 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:31:40.474095 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:31:40.474095 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:31:40.474095 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:31:40.474095 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:31:40.474095 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:31:40.474095 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:31:40.474095 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:31:40.474095 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:31:40.474095 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 482, in servers Oct 04 18:31:40.474095 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Oct 04 18:31:40.474095 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Oct 04 18:31:40.474095 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 04 18:31:40.474095 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching '70e33729-8ebc-4683-a99f-17aad5502e92' could be found. Oct 04 18:31:40.474095 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:31:40.474095 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:31:40.474095 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:31:40.474095 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:31:40.475345 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:31:40.475345 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:31:40.475345 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:31:40.475345 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:31:40.475345 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching '70e33729-8ebc-4683-a99f-17aad5502e92' could be found. Oct 04 18:31:40.475345 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:31:40.476622 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-e6371bfc-d8fe-4be1-9a38-5e8a87af4777 tempest-HypervisorAdminNegativeUnderV252Test-812527148 tempest-HypervisorAdminNegativeUnderV252Test-812527148-project-admin] Returning 404 to user: No hypervisor matching '70e33729-8ebc-4683-a99f-17aad5502e92' could be found. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:31:40.477741 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-e6371bfc-d8fe-4be1-9a38-5e8a87af4777 tempest-HypervisorAdminNegativeUnderV252Test-812527148 tempest-HypervisorAdminNegativeUnderV252Test-812527148-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hypervisors/70e33729-8ebc-4683-a99f-17aad5502e92/servers" status: 404 len: 123 microversion: 2.1 time: 0.046194 Oct 04 18:31:40.478795 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 51/112] 10.222.0.43 () {58 vars in 1281 bytes} [Tue Oct 4 18:31:40 2022] GET /compute/v2.1/os-hypervisors/70e33729-8ebc-4683-a99f-17aad5502e92/servers => generated 123 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:31:40.688588 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-f8ba03ce-4b26-4138-8bc1-01940c58794a tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '459e65f14af049bba311453d6a86360b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1753b9ee9a644e409a1efd0c9e7c152c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:40.702893 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-f8ba03ce-4b26-4138-8bc1-01940c58794a tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] 10.222.0.43 "GET /compute/v2.1/servers/968f1c40-0d51-403e-9609-8eb62b9060bb" status: 200 len: 1319 microversion: 2.1 time: 0.380415 Oct 04 18:31:40.704138 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 62/113] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:40 2022] GET /compute/v2.1/servers/968f1c40-0d51-403e-9609-8eb62b9060bb => generated 1319 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:40.762236 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-4c8e016e-7099-4918-9d53-f1c1e4dfa9c2 tempest-FlavorMetadataValidation-1114523865 tempest-FlavorMetadataValidation-1114523865-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-782709273", "id": 1716797980, "os-flavor-access:is_public": "True"}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:31:40.803195 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-4c8e016e-7099-4918-9d53-f1c1e4dfa9c2 tempest-FlavorMetadataValidation-1114523865 tempest-FlavorMetadataValidation-1114523865-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 470 microversion: 2.86 time: 0.322983 Oct 04 18:31:40.805721 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 52/114] 10.222.0.43 () {62 vars in 1188 bytes} [Tue Oct 4 18:31:40 2022] POST /compute/v2.1/flavors => generated 470 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:31:40.821289 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-2ba83ed2-5d88-44a9-93b4-e66b9610649c tempest-FlavorMetadataValidation-1114523865 tempest-FlavorMetadataValidation-1114523865-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:31:41.108050 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-2ba83ed2-5d88-44a9-93b4-e66b9610649c tempest-FlavorMetadataValidation-1114523865 tempest-FlavorMetadataValidation-1114523865-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors/1716797980/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.291003 Oct 04 18:31:41.108734 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 63/115] 10.222.0.43 () {62 vars in 1265 bytes} [Tue Oct 4 18:31:40 2022] POST /compute/v2.1/flavors/1716797980/os-extra_specs => generated 62 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:41.120036 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-480ca188-1a8e-45d6-84c2-0e731e6e1daf tempest-FlavorMetadataValidation-1114523865 tempest-FlavorMetadataValidation-1114523865-project-admin] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:41.147421 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-480ca188-1a8e-45d6-84c2-0e731e6e1daf tempest-FlavorMetadataValidation-1114523865 tempest-FlavorMetadataValidation-1114523865-project-admin] 10.222.0.43 "DELETE /compute/v2.1/flavors/1716797980" status: 202 len: 0 microversion: 2.86 time: 0.031316 Oct 04 18:31:41.149150 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 53/116] 10.222.0.43 () {60 vars in 1202 bytes} [Tue Oct 4 18:31:41 2022] DELETE /compute/v2.1/flavors/1716797980 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 04 18:31:41.160239 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-da0151d8-b32a-435b-9a0e-68548610377b tempest-FlavorMetadataValidation-1114523865 tempest-FlavorMetadataValidation-1114523865-project-admin] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:41.185857 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-da0151d8-b32a-435b-9a0e-68548610377b tempest-FlavorMetadataValidation-1114523865 tempest-FlavorMetadataValidation-1114523865-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.86 time: 0.030897 Oct 04 18:31:41.190528 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 64/117] 10.222.0.43 () {60 vars in 1187 bytes} [Tue Oct 4 18:31:41 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:31:41.277292 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-76c3bccf-e557-4c51-9af2-32a97b8ca140 tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:41.278816 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-76c3bccf-e557-4c51-9af2-32a97b8ca140 tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] [instance: 3b8abc08-2a0d-44a6-bdee-3b356bcfb7a1] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:41.288969 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-76c3bccf-e557-4c51-9af2-32a97b8ca140 tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:41.290127 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-76c3bccf-e557-4c51-9af2-32a97b8ca140 tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:41.292339 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-76c3bccf-e557-4c51-9af2-32a97b8ca140 tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:41.293720 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-76c3bccf-e557-4c51-9af2-32a97b8ca140 tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:41.294388 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-76c3bccf-e557-4c51-9af2-32a97b8ca140 tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:41.295521 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-76c3bccf-e557-4c51-9af2-32a97b8ca140 tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:41.411731 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-4028e9c1-7b82-4ec6-89fc-6936d4659daf tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:41.414444 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-4028e9c1-7b82-4ec6-89fc-6936d4659daf tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] [instance: b36499e0-9405-4153-a581-13c1bd9d43eb] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:41.431281 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4028e9c1-7b82-4ec6-89fc-6936d4659daf tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:41.432711 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4028e9c1-7b82-4ec6-89fc-6936d4659daf tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:41.434012 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4028e9c1-7b82-4ec6-89fc-6936d4659daf tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:41.435932 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4028e9c1-7b82-4ec6-89fc-6936d4659daf tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:41.437167 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4028e9c1-7b82-4ec6-89fc-6936d4659daf tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:41.438839 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4028e9c1-7b82-4ec6-89fc-6936d4659daf tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:41.784574 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-4028e9c1-7b82-4ec6-89fc-6936d4659daf tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7db99f361654711bea7f1b2c404d312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7adedcdb9c3485ea2738c00e25aa3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:41.798773 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-4028e9c1-7b82-4ec6-89fc-6936d4659daf tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] 10.222.0.43 "GET /compute/v2.1/servers/b36499e0-9405-4153-a581-13c1bd9d43eb" status: 200 len: 1317 microversion: 2.1 time: 0.403711 Oct 04 18:31:41.814018 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 65/118] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:41 2022] GET /compute/v2.1/servers/b36499e0-9405-4153-a581-13c1bd9d43eb => generated 1317 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:41.820549 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-76c3bccf-e557-4c51-9af2-32a97b8ca140 tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99862180a0f2408c806bab348d78709a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21d25b0c2c34c33ab70844c8bf0cf97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:41.824252 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-b9788912-c200-4ea1-882e-ba4577dddbf9 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:41.825398 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-b9788912-c200-4ea1-882e-ba4577dddbf9 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] [instance: 968f1c40-0d51-403e-9609-8eb62b9060bb] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:41.835809 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-76c3bccf-e557-4c51-9af2-32a97b8ca140 tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] 10.222.0.43 "GET /compute/v2.1/servers/3b8abc08-2a0d-44a6-bdee-3b356bcfb7a1" status: 200 len: 1338 microversion: 2.1 time: 0.562971 Oct 04 18:31:41.838269 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b9788912-c200-4ea1-882e-ba4577dddbf9 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:41.838909 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 54/119] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:41 2022] GET /compute/v2.1/servers/3b8abc08-2a0d-44a6-bdee-3b356bcfb7a1 => generated 1338 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:41.840093 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b9788912-c200-4ea1-882e-ba4577dddbf9 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:41.840569 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b9788912-c200-4ea1-882e-ba4577dddbf9 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:41.842398 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b9788912-c200-4ea1-882e-ba4577dddbf9 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:41.842861 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b9788912-c200-4ea1-882e-ba4577dddbf9 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:41.843481 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b9788912-c200-4ea1-882e-ba4577dddbf9 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:41.963416 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-17a8c6f7-cea2-4017-aae3-ff710b69963f req-a8bcd0b5-fc0e-4567-b12b-1dc4fdae7765 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "968f1c40-0d51-403e-9609-8eb62b9060bb", "tag": "cc38f863-bfa1-46ba-a469-894c955bcca9"}, {"name": "network-changed", "server_uuid": "3b8abc08-2a0d-44a6-bdee-3b356bcfb7a1", "tag": "01a0afe5-e001-4cdd-8a9a-6146c9782fc2"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:31:41.994074 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-17a8c6f7-cea2-4017-aae3-ff710b69963f req-a8bcd0b5-fc0e-4567-b12b-1dc4fdae7765 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:41.994933 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-17a8c6f7-cea2-4017-aae3-ff710b69963f req-a8bcd0b5-fc0e-4567-b12b-1dc4fdae7765 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:41.998925 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-17a8c6f7-cea2-4017-aae3-ff710b69963f req-a8bcd0b5-fc0e-4567-b12b-1dc4fdae7765 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:42.036696 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-17a8c6f7-cea2-4017-aae3-ff710b69963f req-a8bcd0b5-fc0e-4567-b12b-1dc4fdae7765 service nova] Creating event network-changed:cc38f863-bfa1-46ba-a469-894c955bcca9 for instance 968f1c40-0d51-403e-9609-8eb62b9060bb on n-h1-851028-13 Oct 04 18:31:42.037509 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-17a8c6f7-cea2-4017-aae3-ff710b69963f req-a8bcd0b5-fc0e-4567-b12b-1dc4fdae7765 service nova] Creating event network-changed:01a0afe5-e001-4cdd-8a9a-6146c9782fc2 for instance 3b8abc08-2a0d-44a6-bdee-3b356bcfb7a1 on n-h2-851028-13 Oct 04 18:31:42.038139 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-17a8c6f7-cea2-4017-aae3-ff710b69963f req-a8bcd0b5-fc0e-4567-b12b-1dc4fdae7765 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=123595) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 04 18:31:42.038648 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-17a8c6f7-cea2-4017-aae3-ff710b69963f req-a8bcd0b5-fc0e-4567-b12b-1dc4fdae7765 service nova] Acquired lock "compute-rpcapi-router" {{(pid=123595) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 04 18:31:42.040027 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a628217c-4830-440a-8d63-f4d88bf92037 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:42.040653 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a628217c-4830-440a-8d63-f4d88bf92037 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:42.041314 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a628217c-4830-440a-8d63-f4d88bf92037 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:42.042142 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a628217c-4830-440a-8d63-f4d88bf92037 None None] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:42.042685 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a628217c-4830-440a-8d63-f4d88bf92037 None None] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:42.043328 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a628217c-4830-440a-8d63-f4d88bf92037 None None] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:42.056695 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.compute.rpcapi [None req-a628217c-4830-440a-8d63-f4d88bf92037 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 04 18:31:42.058022 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a628217c-4830-440a-8d63-f4d88bf92037 None None] Releasing lock "compute-rpcapi-router" {{(pid=123595) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 04 18:31:42.088576 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-a628217c-4830-440a-8d63-f4d88bf92037 None None] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.133625 Oct 04 18:31:42.092606 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 55/120] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:31:41 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:31:42.093723 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-b9788912-c200-4ea1-882e-ba4577dddbf9 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '459e65f14af049bba311453d6a86360b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1753b9ee9a644e409a1efd0c9e7c152c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:42.102676 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-b9788912-c200-4ea1-882e-ba4577dddbf9 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] 10.222.0.43 "GET /compute/v2.1/servers/968f1c40-0d51-403e-9609-8eb62b9060bb" status: 200 len: 1319 microversion: 2.1 time: 0.287179 Oct 04 18:31:42.104232 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 66/121] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:41 2022] GET /compute/v2.1/servers/968f1c40-0d51-403e-9609-8eb62b9060bb => generated 1319 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:42.835761 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-53ac087c-9f6b-4b31-bf6e-622c9402f70c tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:42.843120 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-53ac087c-9f6b-4b31-bf6e-622c9402f70c tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] [instance: b36499e0-9405-4153-a581-13c1bd9d43eb] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:42.861732 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-53ac087c-9f6b-4b31-bf6e-622c9402f70c tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:42.867383 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-53ac087c-9f6b-4b31-bf6e-622c9402f70c tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:42.870964 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-53ac087c-9f6b-4b31-bf6e-622c9402f70c tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:42.872580 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-53ac087c-9f6b-4b31-bf6e-622c9402f70c tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:42.874228 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-53ac087c-9f6b-4b31-bf6e-622c9402f70c tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:42.875227 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-53ac087c-9f6b-4b31-bf6e-622c9402f70c tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:42.998104 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-ee53449c-eb33-4289-ad94-e77629ce4667 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:43.021656 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-ee53449c-eb33-4289-ad94-e77629ce4667 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] 10.222.0.43 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.460035 Oct 04 18:31:43.022599 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 56/122] 10.222.0.43 () {58 vars in 1137 bytes} [Tue Oct 4 18:31:42 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:31:43.036662 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-3d850b0d-d64b-44f6-90ec-639465f05d7b tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:43.038867 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-3d850b0d-d64b-44f6-90ec-639465f05d7b tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] [instance: 3b8abc08-2a0d-44a6-bdee-3b356bcfb7a1] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:43.050931 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3d850b0d-d64b-44f6-90ec-639465f05d7b tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:43.052268 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3d850b0d-d64b-44f6-90ec-639465f05d7b tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:43.053389 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3d850b0d-d64b-44f6-90ec-639465f05d7b tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:43.055209 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3d850b0d-d64b-44f6-90ec-639465f05d7b tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:43.056467 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3d850b0d-d64b-44f6-90ec-639465f05d7b tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:43.057731 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3d850b0d-d64b-44f6-90ec-639465f05d7b tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:43.326594 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-53ac087c-9f6b-4b31-bf6e-622c9402f70c tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7db99f361654711bea7f1b2c404d312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7adedcdb9c3485ea2738c00e25aa3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:43.340607 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-53ac087c-9f6b-4b31-bf6e-622c9402f70c tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] 10.222.0.43 "GET /compute/v2.1/servers/b36499e0-9405-4153-a581-13c1bd9d43eb" status: 200 len: 1317 microversion: 2.1 time: 0.515191 Oct 04 18:31:43.344910 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 67/123] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:42 2022] GET /compute/v2.1/servers/b36499e0-9405-4153-a581-13c1bd9d43eb => generated 1317 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:43.743289 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-ff47e2c4-b40a-4fae-959b-327c72fe50fd tempest-ServersWithSpecificFlavorTestJSON-952303503 tempest-ServersWithSpecificFlavorTestJSON-952303503-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-1595331461", "id": 1259901898, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:31:43.860333 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-ff47e2c4-b40a-4fae-959b-327c72fe50fd tempest-ServersWithSpecificFlavorTestJSON-952303503 tempest-ServersWithSpecificFlavorTestJSON-952303503-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 425 microversion: 2.1 time: 0.511865 Oct 04 18:31:43.874172 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 68/124] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 18:31:43 2022] POST /compute/v2.1/flavors => generated 425 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:31:43.884770 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-06689687-ccc8-4522-9cf5-08809f485a51 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:43.894865 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-06689687-ccc8-4522-9cf5-08809f485a51 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] [instance: 968f1c40-0d51-403e-9609-8eb62b9060bb] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:43.919742 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-06689687-ccc8-4522-9cf5-08809f485a51 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:43.920303 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-06689687-ccc8-4522-9cf5-08809f485a51 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:43.920745 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-06689687-ccc8-4522-9cf5-08809f485a51 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:43.926163 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-06689687-ccc8-4522-9cf5-08809f485a51 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:43.926709 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-06689687-ccc8-4522-9cf5-08809f485a51 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:43.931041 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-06689687-ccc8-4522-9cf5-08809f485a51 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:44.114293 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-3d850b0d-d64b-44f6-90ec-639465f05d7b tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99862180a0f2408c806bab348d78709a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21d25b0c2c34c33ab70844c8bf0cf97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:44.132799 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-3d850b0d-d64b-44f6-90ec-639465f05d7b tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] 10.222.0.43 "GET /compute/v2.1/servers/3b8abc08-2a0d-44a6-bdee-3b356bcfb7a1" status: 200 len: 1338 microversion: 2.1 time: 1.106304 Oct 04 18:31:44.138928 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 57/125] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:43 2022] GET /compute/v2.1/servers/3b8abc08-2a0d-44a6-bdee-3b356bcfb7a1 => generated 1338 bytes in 1116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:44.157692 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-6acd5283-6ede-4cac-8251-3ff8a601d348 tempest-ServersWithSpecificFlavorTestJSON-952303503 tempest-ServersWithSpecificFlavorTestJSON-952303503-project-admin] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:44.216409 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-6acd5283-6ede-4cac-8251-3ff8a601d348 tempest-ServersWithSpecificFlavorTestJSON-952303503 tempest-ServersWithSpecificFlavorTestJSON-952303503-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.072389 Oct 04 18:31:44.224077 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 58/126] 10.222.0.43 () {58 vars in 1182 bytes} [Tue Oct 4 18:31:44 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:31:44.236176 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-27a78960-847a-40ae-8e3c-5283446d38d3 tempest-ServersWithSpecificFlavorTestJSON-952303503 tempest-ServersWithSpecificFlavorTestJSON-952303503-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-1138596416", "id": 312702730, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:31:44.295491 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-27a78960-847a-40ae-8e3c-5283446d38d3 tempest-ServersWithSpecificFlavorTestJSON-952303503 tempest-ServersWithSpecificFlavorTestJSON-952303503-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 422 microversion: 2.1 time: 0.067478 Oct 04 18:31:44.299543 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 59/127] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 18:31:44 2022] POST /compute/v2.1/flavors => generated 422 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:31:44.320229 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-10c2b9cb-ee04-40b0-b3d7-36c904c2c6c5 tempest-ServersWithSpecificFlavorTestJSON-952303503 tempest-ServersWithSpecificFlavorTestJSON-952303503-project-admin] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:44.340539 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-10c2b9cb-ee04-40b0-b3d7-36c904c2c6c5 tempest-ServersWithSpecificFlavorTestJSON-952303503 tempest-ServersWithSpecificFlavorTestJSON-952303503-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.028766 Oct 04 18:31:44.342558 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 60/128] 10.222.0.43 () {58 vars in 1182 bytes} [Tue Oct 4 18:31:44 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 04 18:31:44.358560 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-064aad4d-a705-460e-a1ce-a0e57cbf01ad tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Action: 'create', calling method: .version_select at 0x7fb2249c5e50>, body: {"keypair": {"name": "tempest-keypair-1885965875", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHmCg1zBnaQ2To1VQLAR728g0V1KsjESQlI5gP5yTK01+92guAoOMblZMMjgFhlGjQVH6o4/SlKjFa4IxuiMDWwVMRwqSrA359Jtf3VRNKKuwNBTA7QlsVs3WRh+KQZRTA=="}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:31:44.437927 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-06689687-ccc8-4522-9cf5-08809f485a51 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '459e65f14af049bba311453d6a86360b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1753b9ee9a644e409a1efd0c9e7c152c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:44.451624 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-064aad4d-a705-460e-a1ce-a0e57cbf01ad tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Getting quotas for project 82c615a05e8a4cd086f2e580529fb1d4. Resources: {'key_pairs'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:31:44.460453 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-064aad4d-a705-460e-a1ce-a0e57cbf01ad tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Getting quotas for user f8ea2088d8124b149187a1c140d3be88 and project 82c615a05e8a4cd086f2e580529fb1d4. Resources: {'key_pairs'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:31:44.472063 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-06689687-ccc8-4522-9cf5-08809f485a51 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] 10.222.0.43 "GET /compute/v2.1/servers/968f1c40-0d51-403e-9609-8eb62b9060bb" status: 200 len: 1319 microversion: 2.1 time: 0.584860 Oct 04 18:31:44.492958 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 69/129] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:43 2022] GET /compute/v2.1/servers/968f1c40-0d51-403e-9609-8eb62b9060bb => generated 1319 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:44.500214 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-7e35769c-d494-431b-8b28-1eb2c659e452 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:44.501391 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-7e35769c-d494-431b-8b28-1eb2c659e452 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] [instance: b36499e0-9405-4153-a581-13c1bd9d43eb] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:44.517683 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7e35769c-d494-431b-8b28-1eb2c659e452 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:44.519690 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7e35769c-d494-431b-8b28-1eb2c659e452 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:44.520413 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7e35769c-d494-431b-8b28-1eb2c659e452 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:44.521734 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7e35769c-d494-431b-8b28-1eb2c659e452 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:44.522857 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7e35769c-d494-431b-8b28-1eb2c659e452 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:44.529626 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7e35769c-d494-431b-8b28-1eb2c659e452 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:44.582634 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-064aad4d-a705-460e-a1ce-a0e57cbf01ad tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.229377 Oct 04 18:31:44.586441 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 61/130] 10.222.0.43 () {60 vars in 1159 bytes} [Tue Oct 4 18:31:44 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:31:44.893838 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-7e35769c-d494-431b-8b28-1eb2c659e452 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7db99f361654711bea7f1b2c404d312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7adedcdb9c3485ea2738c00e25aa3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:44.902770 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-7e35769c-d494-431b-8b28-1eb2c659e452 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] 10.222.0.43 "GET /compute/v2.1/servers/b36499e0-9405-4153-a581-13c1bd9d43eb" status: 200 len: 1317 microversion: 2.1 time: 0.408281 Oct 04 18:31:44.906102 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 70/131] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:44 2022] GET /compute/v2.1/servers/b36499e0-9405-4153-a581-13c1bd9d43eb => generated 1317 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:45.171181 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-0425d25f-8e8a-4b66-b91d-a5d9563d4006 tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:45.173240 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-0425d25f-8e8a-4b66-b91d-a5d9563d4006 tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] [instance: 3b8abc08-2a0d-44a6-bdee-3b356bcfb7a1] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:45.196239 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0425d25f-8e8a-4b66-b91d-a5d9563d4006 tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:45.197424 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0425d25f-8e8a-4b66-b91d-a5d9563d4006 tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:45.202098 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0425d25f-8e8a-4b66-b91d-a5d9563d4006 tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:45.203771 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0425d25f-8e8a-4b66-b91d-a5d9563d4006 tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:45.204657 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0425d25f-8e8a-4b66-b91d-a5d9563d4006 tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:45.210493 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0425d25f-8e8a-4b66-b91d-a5d9563d4006 tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:45.496941 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-132628f8-acbd-4aa8-b2ab-6d9146962b25 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:45.497742 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-132628f8-acbd-4aa8-b2ab-6d9146962b25 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] [instance: 968f1c40-0d51-403e-9609-8eb62b9060bb] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:45.513706 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-132628f8-acbd-4aa8-b2ab-6d9146962b25 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:45.515944 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-132628f8-acbd-4aa8-b2ab-6d9146962b25 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:45.519477 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-132628f8-acbd-4aa8-b2ab-6d9146962b25 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:45.520585 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-132628f8-acbd-4aa8-b2ab-6d9146962b25 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:45.521518 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-132628f8-acbd-4aa8-b2ab-6d9146962b25 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:45.523430 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-132628f8-acbd-4aa8-b2ab-6d9146962b25 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:45.632762 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-0425d25f-8e8a-4b66-b91d-a5d9563d4006 tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99862180a0f2408c806bab348d78709a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21d25b0c2c34c33ab70844c8bf0cf97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:45.696084 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-0425d25f-8e8a-4b66-b91d-a5d9563d4006 tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] 10.222.0.43 "GET /compute/v2.1/servers/3b8abc08-2a0d-44a6-bdee-3b356bcfb7a1" status: 200 len: 1338 microversion: 2.1 time: 0.532977 Oct 04 18:31:45.696725 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 62/132] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:45 2022] GET /compute/v2.1/servers/3b8abc08-2a0d-44a6-bdee-3b356bcfb7a1 => generated 1338 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:45.941141 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-b5a6f134-b56b-47b2-99e6-a1ca99bf4ac8 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:45.943765 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-b5a6f134-b56b-47b2-99e6-a1ca99bf4ac8 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] [instance: b36499e0-9405-4153-a581-13c1bd9d43eb] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:45.946383 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=4,nova_api:DELETE=9 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:31:45.974084 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b5a6f134-b56b-47b2-99e6-a1ca99bf4ac8 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:45.975455 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b5a6f134-b56b-47b2-99e6-a1ca99bf4ac8 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:45.976256 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b5a6f134-b56b-47b2-99e6-a1ca99bf4ac8 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:45.980084 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b5a6f134-b56b-47b2-99e6-a1ca99bf4ac8 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:45.980786 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b5a6f134-b56b-47b2-99e6-a1ca99bf4ac8 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:45.993369 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b5a6f134-b56b-47b2-99e6-a1ca99bf4ac8 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:46.081172 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-132628f8-acbd-4aa8-b2ab-6d9146962b25 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '459e65f14af049bba311453d6a86360b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1753b9ee9a644e409a1efd0c9e7c152c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:46.090940 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-132628f8-acbd-4aa8-b2ab-6d9146962b25 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] 10.222.0.43 "GET /compute/v2.1/servers/968f1c40-0d51-403e-9609-8eb62b9060bb" status: 200 len: 1319 microversion: 2.1 time: 0.597745 Oct 04 18:31:46.091541 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 71/133] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:45 2022] GET /compute/v2.1/servers/968f1c40-0d51-403e-9609-8eb62b9060bb => generated 1319 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:46.383445 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-b5a6f134-b56b-47b2-99e6-a1ca99bf4ac8 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7db99f361654711bea7f1b2c404d312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7adedcdb9c3485ea2738c00e25aa3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:46.397291 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-b5a6f134-b56b-47b2-99e6-a1ca99bf4ac8 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] 10.222.0.43 "GET /compute/v2.1/servers/b36499e0-9405-4153-a581-13c1bd9d43eb" status: 200 len: 1317 microversion: 2.1 time: 0.460402 Oct 04 18:31:46.400390 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 63/134] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:45 2022] GET /compute/v2.1/servers/b36499e0-9405-4153-a581-13c1bd9d43eb => generated 1317 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:31:46.734026 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-5b503ffb-382f-4f56-91a7-3728241bd754 tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:46.735243 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-5b503ffb-382f-4f56-91a7-3728241bd754 tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] [instance: 3b8abc08-2a0d-44a6-bdee-3b356bcfb7a1] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:46.751929 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5b503ffb-382f-4f56-91a7-3728241bd754 tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:46.752474 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5b503ffb-382f-4f56-91a7-3728241bd754 tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:46.755020 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5b503ffb-382f-4f56-91a7-3728241bd754 tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:46.756893 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5b503ffb-382f-4f56-91a7-3728241bd754 tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:46.757589 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5b503ffb-382f-4f56-91a7-3728241bd754 tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:46.758225 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5b503ffb-382f-4f56-91a7-3728241bd754 tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:47.023544 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-5b503ffb-382f-4f56-91a7-3728241bd754 tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99862180a0f2408c806bab348d78709a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21d25b0c2c34c33ab70844c8bf0cf97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:47.043240 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-5b503ffb-382f-4f56-91a7-3728241bd754 tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] 10.222.0.43 "GET /compute/v2.1/servers/3b8abc08-2a0d-44a6-bdee-3b356bcfb7a1" status: 200 len: 1338 microversion: 2.1 time: 0.322805 Oct 04 18:31:47.046125 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 72/135] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:46 2022] GET /compute/v2.1/servers/3b8abc08-2a0d-44a6-bdee-3b356bcfb7a1 => generated 1338 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:47.118569 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-4e219f3b-453c-432b-98db-bfeb09ec09e4 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:47.119425 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-4e219f3b-453c-432b-98db-bfeb09ec09e4 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] [instance: 968f1c40-0d51-403e-9609-8eb62b9060bb] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:47.135335 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4e219f3b-453c-432b-98db-bfeb09ec09e4 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:47.136396 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4e219f3b-453c-432b-98db-bfeb09ec09e4 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:47.137226 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4e219f3b-453c-432b-98db-bfeb09ec09e4 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:47.140202 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4e219f3b-453c-432b-98db-bfeb09ec09e4 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:47.142303 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4e219f3b-453c-432b-98db-bfeb09ec09e4 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:47.143527 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4e219f3b-453c-432b-98db-bfeb09ec09e4 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:47.670640 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-4e219f3b-453c-432b-98db-bfeb09ec09e4 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '459e65f14af049bba311453d6a86360b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1753b9ee9a644e409a1efd0c9e7c152c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:47.694607 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-4e219f3b-453c-432b-98db-bfeb09ec09e4 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] 10.222.0.43 "GET /compute/v2.1/servers/968f1c40-0d51-403e-9609-8eb62b9060bb" status: 200 len: 1319 microversion: 2.1 time: 0.582217 Oct 04 18:31:47.695578 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 64/136] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:47 2022] GET /compute/v2.1/servers/968f1c40-0d51-403e-9609-8eb62b9060bb => generated 1319 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:47.767252 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-61c0fe7e-4fd6-4f81-bb5e-5a87db5436ba tempest-NetworksTest-1862915061 tempest-NetworksTest-1862915061-project-admin] Calling method '.version_select at 0x7fb224960670>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:47.792724 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-d560f4f9-0857-437f-b7ea-b88a551f2f27 tempest-FlavorsExtraSpecsNegativeTestJSON-1029440622 tempest-FlavorsExtraSpecsNegativeTestJSON-1029440622-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-220664179", "ram": 512, "vcpus": 1, "disk": 10, "id": 1120690851, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:31:47.825476 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-d560f4f9-0857-437f-b7ea-b88a551f2f27 tempest-FlavorsExtraSpecsNegativeTestJSON-1029440622 tempest-FlavorsExtraSpecsNegativeTestJSON-1029440622-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.120085 Oct 04 18:31:47.837437 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 65/137] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 18:31:47 2022] POST /compute/v2.1/flavors => generated 415 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:31:47.837437 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-29d69365-3b0f-4f82-b5c2-86b0b17c16f6 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:47.837437 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-29d69365-3b0f-4f82-b5c2-86b0b17c16f6 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] [instance: b36499e0-9405-4153-a581-13c1bd9d43eb] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:47.846171 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-29d69365-3b0f-4f82-b5c2-86b0b17c16f6 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:47.846925 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-29d69365-3b0f-4f82-b5c2-86b0b17c16f6 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:47.847703 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-29d69365-3b0f-4f82-b5c2-86b0b17c16f6 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:47.850374 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-29d69365-3b0f-4f82-b5c2-86b0b17c16f6 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:47.850819 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-29d69365-3b0f-4f82-b5c2-86b0b17c16f6 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:47.851886 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-29d69365-3b0f-4f82-b5c2-86b0b17c16f6 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:47.921766 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-61c0fe7e-4fd6-4f81-bb5e-5a87db5436ba tempest-NetworksTest-1862915061 tempest-NetworksTest-1862915061-project-admin] 10.222.0.43 "GET /compute/v2.1/os-networks" status: 200 len: 3327 microversion: 2.1 time: 0.604008 Oct 04 18:31:47.923230 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 73/138] 10.222.0.43 () {58 vars in 1137 bytes} [Tue Oct 4 18:31:47 2022] GET /compute/v2.1/os-networks => generated 3327 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:48.035247 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-29d69365-3b0f-4f82-b5c2-86b0b17c16f6 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7db99f361654711bea7f1b2c404d312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7adedcdb9c3485ea2738c00e25aa3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:48.053889 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-29d69365-3b0f-4f82-b5c2-86b0b17c16f6 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] 10.222.0.43 "GET /compute/v2.1/servers/b36499e0-9405-4153-a581-13c1bd9d43eb" status: 200 len: 1317 microversion: 2.1 time: 0.225858 Oct 04 18:31:48.054595 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 66/139] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:47 2022] GET /compute/v2.1/servers/b36499e0-9405-4153-a581-13c1bd9d43eb => generated 1317 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:48.060059 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-55623c84-8344-4a47-9410-7e3cb4ae9316 tempest-NetworksTest-1862915061 tempest-NetworksTest-1862915061-project-admin] Calling method '.version_select at 0x7fb2248e39d0>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:48.060784 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-b79a660c-4e69-483e-a9cf-199910cadc0c tempest-FlavorsExtraSpecsNegativeTestJSON-1597335372 tempest-FlavorsExtraSpecsNegativeTestJSON-1597335372-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:48.072130 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-b79a660c-4e69-483e-a9cf-199910cadc0c tempest-FlavorsExtraSpecsNegativeTestJSON-1597335372 tempest-FlavorsExtraSpecsNegativeTestJSON-1597335372-project] HTTP exception thrown: Flavor 1120690851 has no extra specs with key hw:cpu_thread_policy. Oct 04 18:31:48.074686 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-b79a660c-4e69-483e-a9cf-199910cadc0c tempest-FlavorsExtraSpecsNegativeTestJSON-1597335372 tempest-FlavorsExtraSpecsNegativeTestJSON-1597335372-project] Request method failure captured: Oct 04 18:31:48.074686 n-d-851028-13 devstack@n-api.service[123596]: request: GET /compute/v2.1/flavors/1120690851/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Oct 04 18:31:48.074686 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:31:48.074686 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:31:48.074686 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:31:48.074686 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 18:31:48.074686 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:31:48.074686 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:31:48.074686 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:31:48.074686 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:31:48.074686 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPHwSWWVmSKq44NA2a6A7unW0jM0sUrXpV_3SnJnD7cRSiUVsixy_Nk-rmsEelWXTNGG0HQaiosq9ARFsT_HpVEwHG65IYSYuUAxqO39KbJwgCqlIdo7TaeCQR6-V2nR8hKBOSMCFCVGAP-39qrDOw_wAV1ut30VlmnCONhJ0ccxNgiU Oct 04 18:31:48.074686 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:31:48.074686 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:31:48.074686 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:31:48.074686 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:31:48.074686 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:31:48.074686 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:31:48.074686 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: 782f0565d7d34c44ba3c9112d84692b6 Oct 04 18:31:48.074686 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1597335372 Oct 04 18:31:48.074686 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 18:31:48.074686 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 18:31:48.076035 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/782f0565d7d34c44ba3c9112d84692b6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_782f0565d7d34c44ba3c9112d84692b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/782f0565d7d34c44ba3c9112d84692b6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/782f0565d7d34c44ba3c9112d84692b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:31:48.076035 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1597335372 Oct 04 18:31:48.076035 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: 782f0565d7d34c44ba3c9112d84692b6 Oct 04 18:31:48.076035 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1597335372 Oct 04 18:31:48.076035 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1597335372-project Oct 04 18:31:48.076035 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:31:48.076035 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:31:48.076035 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: feb594089fab459bb6c6c6ce6ac57a79 Oct 04 18:31:48.076035 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1597335372-project Oct 04 18:31:48.076035 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 18:31:48.076035 n-d-851028-13 devstack@n-api.service[123596]: exception: Flavor 1120690851 has no extra specs with key hw:cpu_thread_policy. Oct 04 18:31:48.076819 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'flavor_id': '1120690851', 'id': 'hw:cpu_thread_policy'} Oct 04 18:31:48.076819 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:31:48.076819 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:31:48.076819 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 115, in show Oct 04 18:31:48.076819 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return {id: flavor.extra_specs[id]} Oct 04 18:31:48.076819 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Oct 04 18:31:48.076819 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:31:48.076819 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:31:48.076819 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:31:48.076819 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:31:48.076819 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:31:48.076819 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:31:48.076819 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:31:48.076819 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:31:48.076819 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:31:48.076819 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:31:48.076819 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 120, in show Oct 04 18:31:48.076819 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 04 18:31:48.076819 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 1120690851 has no extra specs with key hw:cpu_thread_policy. Oct 04 18:31:48.076819 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:31:48.076819 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:31:48.076819 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:31:48.078052 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:31:48.078052 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:31:48.078052 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:31:48.078052 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:31:48.078052 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:31:48.078052 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1120690851 has no extra specs with key hw:cpu_thread_policy. Oct 04 18:31:48.078052 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:31:48.078052 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-b79a660c-4e69-483e-a9cf-199910cadc0c tempest-FlavorsExtraSpecsNegativeTestJSON-1597335372 tempest-FlavorsExtraSpecsNegativeTestJSON-1597335372-project] Returning 404 to user: Flavor 1120690851 has no extra specs with key hw:cpu_thread_policy. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:31:48.078052 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-b79a660c-4e69-483e-a9cf-199910cadc0c tempest-FlavorsExtraSpecsNegativeTestJSON-1597335372 tempest-FlavorsExtraSpecsNegativeTestJSON-1597335372-project] 10.222.0.43 "GET /compute/v2.1/flavors/1120690851/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.152241 Oct 04 18:31:48.078052 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 74/140] 10.222.0.43 () {58 vars in 1266 bytes} [Tue Oct 4 18:31:47 2022] GET /compute/v2.1/flavors/1120690851/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 154 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:31:48.087145 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-fd559619-ecbd-42c3-bfbc-d232c5bdee78 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1877372692", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "312702730", "adminPass": "***", "networks": [{"uuid": "82bb2889-3863-48eb-88d8-9122cbd1ee80"}], "security_groups": [{"name": "tempest-securitygroup--901927384"}], "key_name": "tempest-keypair-1885965875", "user_data": "}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:31:48.219128 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-55623c84-8344-4a47-9410-7e3cb4ae9316 tempest-NetworksTest-1862915061 tempest-NetworksTest-1862915061-project-admin] 10.222.0.43 "GET /compute/v2.1/os-networks/73f4d4fd-920f-4232-90c7-c4abfd77b225" status: 200 len: 652 microversion: 2.1 time: 0.163104 Oct 04 18:31:48.220241 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 67/141] 10.222.0.43 () {58 vars in 1248 bytes} [Tue Oct 4 18:31:48 2022] GET /compute/v2.1/os-networks/73f4d4fd-920f-4232-90c7-c4abfd77b225 => generated 652 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:31:48.232547 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-4acf05b9-126b-45b9-b718-3af2eaec5714 tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:48.233161 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-4acf05b9-126b-45b9-b718-3af2eaec5714 tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] [instance: 3b8abc08-2a0d-44a6-bdee-3b356bcfb7a1] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:48.240421 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4acf05b9-126b-45b9-b718-3af2eaec5714 tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:48.241309 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4acf05b9-126b-45b9-b718-3af2eaec5714 tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:48.242232 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4acf05b9-126b-45b9-b718-3af2eaec5714 tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:48.243582 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4acf05b9-126b-45b9-b718-3af2eaec5714 tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:48.244389 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4acf05b9-126b-45b9-b718-3af2eaec5714 tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:48.245220 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4acf05b9-126b-45b9-b718-3af2eaec5714 tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:48.284695 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.network.neutron [None req-fd559619-ecbd-42c3-bfbc-d232c5bdee78 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] validate_networks() for [('82bb2889-3863-48eb-88d8-9122cbd1ee80', None, None, None, None, None)] {{(pid=123596) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:31:48.470364 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-4acf05b9-126b-45b9-b718-3af2eaec5714 tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99862180a0f2408c806bab348d78709a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21d25b0c2c34c33ab70844c8bf0cf97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:48.487146 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-4acf05b9-126b-45b9-b718-3af2eaec5714 tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] 10.222.0.43 "GET /compute/v2.1/servers/3b8abc08-2a0d-44a6-bdee-3b356bcfb7a1" status: 200 len: 1338 microversion: 2.1 time: 0.260279 Oct 04 18:31:48.489203 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 68/142] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:48 2022] GET /compute/v2.1/servers/3b8abc08-2a0d-44a6-bdee-3b356bcfb7a1 => generated 1338 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:48.498839 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-1f4d6866-735e-4841-886a-a16ed0bfc108 tempest-FlavorsExtraSpecsNegativeTestJSON-1597335372 tempest-FlavorsExtraSpecsNegativeTestJSON-1597335372-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:31:48.507315 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-1f4d6866-735e-4841-886a-a16ed0bfc108 tempest-FlavorsExtraSpecsNegativeTestJSON-1597335372 tempest-FlavorsExtraSpecsNegativeTestJSON-1597335372-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': 'feb594089fab459bb6c6c6ce6ac57a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782f0565d7d34c44ba3c9112d84692b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:48.514593 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-1f4d6866-735e-4841-886a-a16ed0bfc108 tempest-FlavorsExtraSpecsNegativeTestJSON-1597335372 tempest-FlavorsExtraSpecsNegativeTestJSON-1597335372-project] Request method failure captured: Oct 04 18:31:48.514593 n-d-851028-13 devstack@n-api.service[123595]: request: POST /compute/v2.1/flavors/1120690851/os-extra_specs HTTP/1.1 Oct 04 18:31:48.514593 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 18:31:48.514593 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 18:31:48.514593 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 18:31:48.514593 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 66 Oct 04 18:31:48.514593 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 18:31:48.514593 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 18:31:48.514593 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 18:31:48.514593 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 18:31:48.514593 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPHwSWWVmSKq44NA2a6A7unW0jM0sUrXpV_3SnJnD7cRSiUVsixy_Nk-rmsEelWXTNGG0HQaiosq9ARFsT_HpVEwHG65IYSYuUAxqO39KbJwgCqlIdo7TaeCQR6-V2nR8hKBOSMCFCVGAP-39qrDOw_wAV1ut30VlmnCONhJ0ccxNgiU Oct 04 18:31:48.514593 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 18:31:48.514593 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 18:31:48.514593 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 18:31:48.514593 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 18:31:48.514593 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 18:31:48.514593 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 18:31:48.514593 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: 782f0565d7d34c44ba3c9112d84692b6 Oct 04 18:31:48.514593 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1597335372 Oct 04 18:31:48.514593 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 18:31:48.514593 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 18:31:48.517394 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/782f0565d7d34c44ba3c9112d84692b6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_782f0565d7d34c44ba3c9112d84692b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/782f0565d7d34c44ba3c9112d84692b6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/782f0565d7d34c44ba3c9112d84692b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:31:48.517394 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1597335372 Oct 04 18:31:48.517394 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: 782f0565d7d34c44ba3c9112d84692b6 Oct 04 18:31:48.517394 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1597335372 Oct 04 18:31:48.517394 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1597335372-project Oct 04 18:31:48.517394 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 18:31:48.517394 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 18:31:48.517394 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: feb594089fab459bb6c6c6ce6ac57a79 Oct 04 18:31:48.517394 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1597335372-project Oct 04 18:31:48.517394 n-d-851028-13 devstack@n-api.service[123595]: Oct 04 18:31:48.517394 n-d-851028-13 devstack@n-api.service[123595]: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} Oct 04 18:31:48.517394 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 18:31:48.518936 n-d-851028-13 devstack@n-api.service[123595]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 04 18:31:48.518936 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'flavor_id': '1120690851', 'body': {'extra_specs': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}}} Oct 04 18:31:48.518936 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:31:48.518936 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:31:48.518936 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:31:48.518936 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:31:48.518936 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:31:48.518936 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:31:48.518936 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:31:48.518936 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:31:48.518936 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:31:48.518936 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:31:48.518936 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 73, in create Oct 04 18:31:48.518936 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'create', target={}) Oct 04 18:31:48.518936 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 18:31:48.518936 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 18:31:48.518936 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 18:31:48.518936 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 18:31:48.518936 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:31:48.521070 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:31:48.521070 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:31:48.521070 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:31:48.521070 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 18:31:48.521070 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 18:31:48.521070 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 18:31:48.521070 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 18:31:48.521070 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 18:31:48.521070 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 18:31:48.521070 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 04 18:31:48.521070 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:31:48.521070 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:31:48.521070 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:31:48.521070 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:31:48.521070 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:31:48.521070 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:31:48.521070 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 18:31:48.521070 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 18:31:48.521070 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 04 18:31:48.521070 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:31:48.525924 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-1f4d6866-735e-4841-886a-a16ed0bfc108 tempest-FlavorsExtraSpecsNegativeTestJSON-1597335372 tempest-FlavorsExtraSpecsNegativeTestJSON-1597335372-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:31:48.527134 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-1f4d6866-735e-4841-886a-a16ed0bfc108 tempest-FlavorsExtraSpecsNegativeTestJSON-1597335372 tempest-FlavorsExtraSpecsNegativeTestJSON-1597335372-project] 10.222.0.43 "POST /compute/v2.1/flavors/1120690851/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.036290 Oct 04 18:31:48.528738 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 69/143] 10.222.0.43 () {60 vars in 1224 bytes} [Tue Oct 4 18:31:48 2022] POST /compute/v2.1/flavors/1120690851/os-extra_specs => generated 124 bytes in 39 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:31:48.534958 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-72ca195e-06dc-4454-9895-c9f7b3d7c5a5 tempest-NetworksTest-1862915061 tempest-NetworksTest-1862915061-project-admin] Calling method '.version_select at 0x7fb2248e35e0>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:48.766357 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-72ca195e-06dc-4454-9895-c9f7b3d7c5a5 tempest-NetworksTest-1862915061 tempest-NetworksTest-1862915061-project-admin] 10.222.0.43 "GET /compute/v2.1/os-networks" status: 200 len: 3327 microversion: 2.1 time: 0.236365 Oct 04 18:31:48.767546 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 70/144] 10.222.0.43 () {58 vars in 1137 bytes} [Tue Oct 4 18:31:48 2022] GET /compute/v2.1/os-networks => generated 3327 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:48.880263 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-34be8683-b33b-4879-89b2-6b6962a573b3 req-4a51b641-df0f-4339-9e94-4e6aca3b7948 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b36499e0-9405-4153-a581-13c1bd9d43eb", "name": "network-vif-plugged", "status": "completed", "tag": "7e660be0-d7f2-4b01-9122-66b33a304293"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:31:48.894090 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-34be8683-b33b-4879-89b2-6b6962a573b3 req-4a51b641-df0f-4339-9e94-4e6aca3b7948 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:48.894666 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-34be8683-b33b-4879-89b2-6b6962a573b3 req-4a51b641-df0f-4339-9e94-4e6aca3b7948 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:48.895167 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-34be8683-b33b-4879-89b2-6b6962a573b3 req-4a51b641-df0f-4339-9e94-4e6aca3b7948 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:48.908498 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-34be8683-b33b-4879-89b2-6b6962a573b3 req-4a51b641-df0f-4339-9e94-4e6aca3b7948 service nova] Creating event network-vif-plugged:7e660be0-d7f2-4b01-9122-66b33a304293 for instance b36499e0-9405-4153-a581-13c1bd9d43eb on n-h1-851028-13 Oct 04 18:31:48.914390 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-34be8683-b33b-4879-89b2-6b6962a573b3 req-4a51b641-df0f-4339-9e94-4e6aca3b7948 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.144997 Oct 04 18:31:48.915255 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 71/145] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:31:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:31:48.922764 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-7406990c-de71-4f96-8d2f-a2afc1d7e163 tempest-FlavorsExtraSpecsNegativeTestJSON-1029440622 tempest-FlavorsExtraSpecsNegativeTestJSON-1029440622-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:31:48.973908 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-7406990c-de71-4f96-8d2f-a2afc1d7e163 tempest-FlavorsExtraSpecsNegativeTestJSON-1029440622 tempest-FlavorsExtraSpecsNegativeTestJSON-1029440622-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors/1120690851/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.056803 Oct 04 18:31:48.980560 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 72/146] 10.222.0.43 () {60 vars in 1224 bytes} [Tue Oct 4 18:31:48 2022] POST /compute/v2.1/flavors/1120690851/os-extra_specs => generated 66 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:31:48.988213 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-6224ceeb-d484-42d8-bbef-3b5beb361872 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:48.989180 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-6224ceeb-d484-42d8-bbef-3b5beb361872 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] [instance: 968f1c40-0d51-403e-9609-8eb62b9060bb] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:48.998407 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6224ceeb-d484-42d8-bbef-3b5beb361872 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:48.999169 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6224ceeb-d484-42d8-bbef-3b5beb361872 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:48.999777 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6224ceeb-d484-42d8-bbef-3b5beb361872 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:49.001303 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6224ceeb-d484-42d8-bbef-3b5beb361872 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:49.001919 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6224ceeb-d484-42d8-bbef-3b5beb361872 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:49.002697 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6224ceeb-d484-42d8-bbef-3b5beb361872 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:49.251219 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-fd559619-ecbd-42c3-bfbc-d232c5bdee78 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Flavor limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:31:49.253666 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-fd559619-ecbd-42c3-bfbc-d232c5bdee78 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Image limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:31:49.255184 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-fd559619-ecbd-42c3-bfbc-d232c5bdee78 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Flavor pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:31:49.255864 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-fd559619-ecbd-42c3-bfbc-d232c5bdee78 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Image pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:31:49.256627 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-fd559619-ecbd-42c3-bfbc-d232c5bdee78 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:31:49.267147 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-6224ceeb-d484-42d8-bbef-3b5beb361872 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '459e65f14af049bba311453d6a86360b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1753b9ee9a644e409a1efd0c9e7c152c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:49.275965 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fd559619-ecbd-42c3-bfbc-d232c5bdee78 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:49.276820 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fd559619-ecbd-42c3-bfbc-d232c5bdee78 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:49.277461 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fd559619-ecbd-42c3-bfbc-d232c5bdee78 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:49.279130 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-6224ceeb-d484-42d8-bbef-3b5beb361872 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] 10.222.0.43 "GET /compute/v2.1/servers/968f1c40-0d51-403e-9609-8eb62b9060bb" status: 200 len: 1319 microversion: 2.1 time: 0.296257 Oct 04 18:31:49.279661 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fd559619-ecbd-42c3-bfbc-d232c5bdee78 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:49.281285 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fd559619-ecbd-42c3-bfbc-d232c5bdee78 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:49.282068 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 73/147] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:48 2022] GET /compute/v2.1/servers/968f1c40-0d51-403e-9609-8eb62b9060bb => generated 1319 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:49.293438 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fd559619-ecbd-42c3-bfbc-d232c5bdee78 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:49.294080 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-f2e6a69c-0a77-4d85-a8d2-bab350d9c037 tempest-FlavorsExtraSpecsNegativeTestJSON-1597335372 tempest-FlavorsExtraSpecsNegativeTestJSON-1597335372-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:49.299865 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-f2e6a69c-0a77-4d85-a8d2-bab350d9c037 tempest-FlavorsExtraSpecsNegativeTestJSON-1597335372 tempest-FlavorsExtraSpecsNegativeTestJSON-1597335372-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': 'feb594089fab459bb6c6c6ce6ac57a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782f0565d7d34c44ba3c9112d84692b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:49.302898 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-f2e6a69c-0a77-4d85-a8d2-bab350d9c037 tempest-FlavorsExtraSpecsNegativeTestJSON-1597335372 tempest-FlavorsExtraSpecsNegativeTestJSON-1597335372-project] Request method failure captured: Oct 04 18:31:49.302898 n-d-851028-13 devstack@n-api.service[123595]: request: DELETE /compute/v2.1/flavors/1120690851/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 04 18:31:49.302898 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 18:31:49.302898 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 18:31:49.302898 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 18:31:49.302898 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 0 Oct 04 18:31:49.302898 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 18:31:49.302898 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 18:31:49.302898 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 18:31:49.302898 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 18:31:49.302898 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPHwSWWVmSKq44NA2a6A7unW0jM0sUrXpV_3SnJnD7cRSiUVsixy_Nk-rmsEelWXTNGG0HQaiosq9ARFsT_HpVEwHG65IYSYuUAxqO39KbJwgCqlIdo7TaeCQR6-V2nR8hKBOSMCFCVGAP-39qrDOw_wAV1ut30VlmnCONhJ0ccxNgiU Oct 04 18:31:49.302898 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 18:31:49.302898 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 18:31:49.302898 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 18:31:49.302898 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 18:31:49.302898 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 18:31:49.302898 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 18:31:49.302898 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: 782f0565d7d34c44ba3c9112d84692b6 Oct 04 18:31:49.302898 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1597335372 Oct 04 18:31:49.302898 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 18:31:49.302898 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 18:31:49.304160 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/782f0565d7d34c44ba3c9112d84692b6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_782f0565d7d34c44ba3c9112d84692b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/782f0565d7d34c44ba3c9112d84692b6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/782f0565d7d34c44ba3c9112d84692b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:31:49.304160 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1597335372 Oct 04 18:31:49.304160 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: 782f0565d7d34c44ba3c9112d84692b6 Oct 04 18:31:49.304160 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1597335372 Oct 04 18:31:49.304160 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1597335372-project Oct 04 18:31:49.304160 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 18:31:49.304160 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 18:31:49.304160 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: feb594089fab459bb6c6c6ce6ac57a79 Oct 04 18:31:49.304160 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1597335372-project Oct 04 18:31:49.304160 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 18:31:49.304160 n-d-851028-13 devstack@n-api.service[123595]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 04 18:31:49.304764 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'flavor_id': '1120690851', 'id': 'hw:numa_nodes'} Oct 04 18:31:49.304764 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:31:49.304764 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:31:49.304764 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:31:49.304764 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:31:49.304764 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:31:49.304764 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:31:49.304764 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:31:49.304764 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:31:49.304764 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 129, in delete Oct 04 18:31:49.304764 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'delete', target={}) Oct 04 18:31:49.304764 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 18:31:49.304764 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 18:31:49.304764 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 18:31:49.304764 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 18:31:49.304764 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:31:49.304764 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:31:49.304764 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:31:49.304764 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:31:49.304764 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 18:31:49.306086 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 18:31:49.306086 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 18:31:49.306086 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 18:31:49.306086 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 18:31:49.306086 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 18:31:49.306086 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 04 18:31:49.306086 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:31:49.306086 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:31:49.306086 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:31:49.306086 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:31:49.306086 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:31:49.306086 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:31:49.306086 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 18:31:49.306086 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 18:31:49.306086 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 04 18:31:49.306086 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:31:49.307460 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-f2e6a69c-0a77-4d85-a8d2-bab350d9c037 tempest-FlavorsExtraSpecsNegativeTestJSON-1597335372 tempest-FlavorsExtraSpecsNegativeTestJSON-1597335372-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:31:49.309533 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-f2e6a69c-0a77-4d85-a8d2-bab350d9c037 tempest-FlavorsExtraSpecsNegativeTestJSON-1597335372 tempest-FlavorsExtraSpecsNegativeTestJSON-1597335372-project] 10.222.0.43 "DELETE /compute/v2.1/flavors/1120690851/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.024549 Oct 04 18:31:49.311143 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 74/148] 10.222.0.43 () {58 vars in 1248 bytes} [Tue Oct 4 18:31:49 2022] DELETE /compute/v2.1/flavors/1120690851/os-extra_specs/hw:numa_nodes => generated 124 bytes in 29 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:31:49.323581 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-d59b3151-d2fe-41b0-9115-155abc8c78c3 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:49.324303 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-d59b3151-d2fe-41b0-9115-155abc8c78c3 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] [instance: b36499e0-9405-4153-a581-13c1bd9d43eb] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:49.328595 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-fd559619-ecbd-42c3-bfbc-d232c5bdee78 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Getting quotas for project 82c615a05e8a4cd086f2e580529fb1d4. Resources: {'ram', 'cores', 'instances'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:31:49.334619 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-fd559619-ecbd-42c3-bfbc-d232c5bdee78 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Getting quotas for user f8ea2088d8124b149187a1c140d3be88 and project 82c615a05e8a4cd086f2e580529fb1d4. Resources: {'ram', 'cores', 'instances'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:31:49.348066 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d59b3151-d2fe-41b0-9115-155abc8c78c3 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:49.354615 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-fd559619-ecbd-42c3-bfbc-d232c5bdee78 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Going to run 1 instances... {{(pid=123596) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:31:49.358872 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-fd559619-ecbd-42c3-bfbc-d232c5bdee78 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] [instance: 9b19b908-7870-477b-9be7-7d260d59b183] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e8943ec5-4038-4d4b-b9b9-2415a79f5243',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123596) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:31:49.364886 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d59b3151-d2fe-41b0-9115-155abc8c78c3 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:49.366360 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d59b3151-d2fe-41b0-9115-155abc8c78c3 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:49.367102 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d59b3151-d2fe-41b0-9115-155abc8c78c3 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:49.370076 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d59b3151-d2fe-41b0-9115-155abc8c78c3 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:49.370801 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d59b3151-d2fe-41b0-9115-155abc8c78c3 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:49.427624 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-fd559619-ecbd-42c3-bfbc-d232c5bdee78 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.348702 Oct 04 18:31:49.429230 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 75/149] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 18:31:48 2022] POST /compute/v2.1/servers => generated 401 bytes in 1351 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:31:49.443542 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-c76e17dd-10d7-4ffe-9181-31abeaad3ca9 tempest-FlavorsExtraSpecsNegativeTestJSON-1029440622 tempest-FlavorsExtraSpecsNegativeTestJSON-1029440622-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:31:49.478537 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-c76e17dd-10d7-4ffe-9181-31abeaad3ca9 tempest-FlavorsExtraSpecsNegativeTestJSON-1029440622 tempest-FlavorsExtraSpecsNegativeTestJSON-1029440622-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors/1120690851/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.039366 Oct 04 18:31:49.480193 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 76/150] 10.222.0.43 () {60 vars in 1224 bytes} [Tue Oct 4 18:31:49 2022] POST /compute/v2.1/flavors/1120690851/os-extra_specs => generated 66 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:31:49.493559 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-c427943d-bae3-46e7-ab5e-073f6fc1974c tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:49.496112 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-c427943d-bae3-46e7-ab5e-073f6fc1974c tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] [instance: 9b19b908-7870-477b-9be7-7d260d59b183] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:49.576087 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-d59b3151-d2fe-41b0-9115-155abc8c78c3 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7db99f361654711bea7f1b2c404d312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7adedcdb9c3485ea2738c00e25aa3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:49.579661 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=100 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:31:49.591666 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-d59b3151-d2fe-41b0-9115-155abc8c78c3 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] 10.222.0.43 "GET /compute/v2.1/servers/b36499e0-9405-4153-a581-13c1bd9d43eb" status: 200 len: 1317 microversion: 2.1 time: 0.277810 Oct 04 18:31:49.592424 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 75/151] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:49 2022] GET /compute/v2.1/servers/b36499e0-9405-4153-a581-13c1bd9d43eb => generated 1317 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:49.604118 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-d2681b63-d35a-4a04-b5e9-421a74eb1d04 tempest-FlavorsExtraSpecsNegativeTestJSON-1597335372 tempest-FlavorsExtraSpecsNegativeTestJSON-1597335372-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:31:49.607891 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-d2681b63-d35a-4a04-b5e9-421a74eb1d04 tempest-FlavorsExtraSpecsNegativeTestJSON-1597335372 tempest-FlavorsExtraSpecsNegativeTestJSON-1597335372-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': 'feb594089fab459bb6c6c6ce6ac57a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782f0565d7d34c44ba3c9112d84692b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:49.609539 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-d2681b63-d35a-4a04-b5e9-421a74eb1d04 tempest-FlavorsExtraSpecsNegativeTestJSON-1597335372 tempest-FlavorsExtraSpecsNegativeTestJSON-1597335372-project] Request method failure captured: Oct 04 18:31:49.609539 n-d-851028-13 devstack@n-api.service[123595]: request: PUT /compute/v2.1/flavors/1120690851/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 04 18:31:49.609539 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 18:31:49.609539 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 18:31:49.609539 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 18:31:49.609539 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 22 Oct 04 18:31:49.609539 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 18:31:49.609539 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 18:31:49.609539 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 18:31:49.609539 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 18:31:49.609539 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPHwSWWVmSKq44NA2a6A7unW0jM0sUrXpV_3SnJnD7cRSiUVsixy_Nk-rmsEelWXTNGG0HQaiosq9ARFsT_HpVEwHG65IYSYuUAxqO39KbJwgCqlIdo7TaeCQR6-V2nR8hKBOSMCFCVGAP-39qrDOw_wAV1ut30VlmnCONhJ0ccxNgiU Oct 04 18:31:49.609539 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 18:31:49.609539 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 18:31:49.609539 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 18:31:49.609539 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 18:31:49.609539 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 18:31:49.609539 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 18:31:49.609539 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: 782f0565d7d34c44ba3c9112d84692b6 Oct 04 18:31:49.609539 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1597335372 Oct 04 18:31:49.609539 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 18:31:49.609539 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 18:31:49.611006 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/782f0565d7d34c44ba3c9112d84692b6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_782f0565d7d34c44ba3c9112d84692b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/782f0565d7d34c44ba3c9112d84692b6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/782f0565d7d34c44ba3c9112d84692b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:31:49.611006 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1597335372 Oct 04 18:31:49.611006 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: 782f0565d7d34c44ba3c9112d84692b6 Oct 04 18:31:49.611006 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1597335372 Oct 04 18:31:49.611006 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1597335372-project Oct 04 18:31:49.611006 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 18:31:49.611006 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 18:31:49.611006 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: feb594089fab459bb6c6c6ce6ac57a79 Oct 04 18:31:49.611006 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1597335372-project Oct 04 18:31:49.611006 n-d-851028-13 devstack@n-api.service[123595]: Oct 04 18:31:49.611006 n-d-851028-13 devstack@n-api.service[123595]: {"hw:numa_nodes": "1"} Oct 04 18:31:49.611006 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 18:31:49.611006 n-d-851028-13 devstack@n-api.service[123595]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 04 18:31:49.611862 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'flavor_id': '1120690851', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1'}} Oct 04 18:31:49.611862 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:31:49.611862 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:31:49.611862 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:31:49.611862 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:31:49.611862 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:31:49.611862 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:31:49.611862 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:31:49.611862 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:31:49.611862 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:31:49.611862 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:31:49.611862 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 91, in update Oct 04 18:31:49.611862 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'update', target={}) Oct 04 18:31:49.611862 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 18:31:49.611862 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 18:31:49.611862 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 18:31:49.611862 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 18:31:49.611862 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:31:49.611862 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:31:49.613055 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:31:49.613055 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:31:49.613055 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 18:31:49.613055 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 18:31:49.613055 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 18:31:49.613055 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 18:31:49.613055 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 18:31:49.613055 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 18:31:49.613055 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 04 18:31:49.613055 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:31:49.613055 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:31:49.613055 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:31:49.613055 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:31:49.613055 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:31:49.613055 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:31:49.613055 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 18:31:49.613055 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 18:31:49.613055 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 04 18:31:49.613055 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:31:49.617971 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-d2681b63-d35a-4a04-b5e9-421a74eb1d04 tempest-FlavorsExtraSpecsNegativeTestJSON-1597335372 tempest-FlavorsExtraSpecsNegativeTestJSON-1597335372-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:31:49.619157 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-d2681b63-d35a-4a04-b5e9-421a74eb1d04 tempest-FlavorsExtraSpecsNegativeTestJSON-1597335372 tempest-FlavorsExtraSpecsNegativeTestJSON-1597335372-project] 10.222.0.43 "PUT /compute/v2.1/flavors/1120690851/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.025634 Oct 04 18:31:49.625536 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 76/152] 10.222.0.43 () {60 vars in 1265 bytes} [Tue Oct 4 18:31:49 2022] PUT /compute/v2.1/flavors/1120690851/os-extra_specs/hw:numa_nodes => generated 124 bytes in 32 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:31:49.634001 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-67edb05f-7bff-4cdc-b07e-71a565e63b4a tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:49.636850 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-67edb05f-7bff-4cdc-b07e-71a565e63b4a tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] [instance: 3b8abc08-2a0d-44a6-bdee-3b356bcfb7a1] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:49.643667 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-c427943d-bae3-46e7-ab5e-073f6fc1974c tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ea2088d8124b149187a1c140d3be88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82c615a05e8a4cd086f2e580529fb1d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:49.648941 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-67edb05f-7bff-4cdc-b07e-71a565e63b4a tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:49.649679 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-67edb05f-7bff-4cdc-b07e-71a565e63b4a tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:49.650694 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-67edb05f-7bff-4cdc-b07e-71a565e63b4a tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:49.651717 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-67edb05f-7bff-4cdc-b07e-71a565e63b4a tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:49.652228 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-c427943d-bae3-46e7-ab5e-073f6fc1974c tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] 10.222.0.43 "GET /compute/v2.1/servers/9b19b908-7870-477b-9be7-7d260d59b183" status: 200 len: 1263 microversion: 2.1 time: 0.164540 Oct 04 18:31:49.652602 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-67edb05f-7bff-4cdc-b07e-71a565e63b4a tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:49.653604 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-67edb05f-7bff-4cdc-b07e-71a565e63b4a tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:49.672068 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 77/153] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:49 2022] GET /compute/v2.1/servers/9b19b908-7870-477b-9be7-7d260d59b183 => generated 1263 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:49.679273 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-e3887469-7ba8-4244-a00f-90f0f2616de4 tempest-FlavorsExtraSpecsNegativeTestJSON-1029440622 tempest-FlavorsExtraSpecsNegativeTestJSON-1029440622-project-admin] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:49.684433 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_api:SELECT=83,nova_api:DELETE=3,nova_api:SAVEPOINT=4,nova_api:INSERT=6,nova_api:RELEASE=4 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:31:49.700525 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-e3887469-7ba8-4244-a00f-90f0f2616de4 tempest-FlavorsExtraSpecsNegativeTestJSON-1029440622 tempest-FlavorsExtraSpecsNegativeTestJSON-1029440622-project-admin] HTTP exception thrown: Flavor 1120690851 has no extra specs with key hw:cpu_thread_policy. Oct 04 18:31:49.704785 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-e3887469-7ba8-4244-a00f-90f0f2616de4 tempest-FlavorsExtraSpecsNegativeTestJSON-1029440622 tempest-FlavorsExtraSpecsNegativeTestJSON-1029440622-project-admin] Request method failure captured: Oct 04 18:31:49.704785 n-d-851028-13 devstack@n-api.service[123596]: request: DELETE /compute/v2.1/flavors/1120690851/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Oct 04 18:31:49.704785 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:31:49.704785 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:31:49.704785 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:31:49.704785 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 18:31:49.704785 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:31:49.704785 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:31:49.704785 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:31:49.704785 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:31:49.704785 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPHwTrvw2Tc3EhHe5Pzt2btHKE1JlRlewJCQHwiFUTZmUNWFyX7Ivl5MCVYwwp1RhAs5IloPWc7kskNbcq66HGQS8rMRbRHzQGy5sPOGWw2qYRqIa1va93BA-uYC6eqHm7JwMnUozbFBSUGXLs2c6xE3nFtx3qQEC2V8MgU1FIIF9T7E Oct 04 18:31:49.704785 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:31:49.704785 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:31:49.704785 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:31:49.704785 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:31:49.704785 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:31:49.704785 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:31:49.704785 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: ad832f1cecff446887de47efe664b418 Oct 04 18:31:49.704785 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1029440622 Oct 04 18:31:49.704785 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,admin,reader Oct 04 18:31:49.704785 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,admin,reader Oct 04 18:31:49.706665 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/ad832f1cecff446887de47efe664b418"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_ad832f1cecff446887de47efe664b418"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ad832f1cecff446887de47efe664b418"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ad832f1cecff446887de47efe664b418"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:31:49.706665 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1029440622 Oct 04 18:31:49.706665 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: ad832f1cecff446887de47efe664b418 Oct 04 18:31:49.706665 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1029440622 Oct 04 18:31:49.706665 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1029440622-project-admin Oct 04 18:31:49.706665 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:31:49.706665 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:31:49.706665 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 8deb39ed208b43ee93210d663cde5531 Oct 04 18:31:49.706665 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1029440622-project-admin Oct 04 18:31:49.706665 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 18:31:49.706665 n-d-851028-13 devstack@n-api.service[123596]: exception: Flavor 1120690851 has no extra specs with key hw:cpu_thread_policy. Oct 04 18:31:49.707805 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'flavor_id': '1120690851', 'id': 'hw:cpu_thread_policy'} Oct 04 18:31:49.707805 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:31:49.707805 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:31:49.707805 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 132, in delete Oct 04 18:31:49.707805 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi del flavor.extra_specs[id] Oct 04 18:31:49.707805 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Oct 04 18:31:49.707805 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:31:49.707805 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:31:49.707805 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:31:49.707805 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:31:49.707805 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:31:49.707805 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:31:49.707805 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:31:49.707805 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:31:49.707805 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:31:49.707805 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:31:49.707805 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 141, in delete Oct 04 18:31:49.707805 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 04 18:31:49.707805 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 1120690851 has no extra specs with key hw:cpu_thread_policy. Oct 04 18:31:49.707805 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:31:49.707805 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:31:49.707805 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:31:49.709889 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:31:49.709889 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:31:49.709889 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:31:49.709889 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:31:49.709889 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:31:49.709889 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1120690851 has no extra specs with key hw:cpu_thread_policy. Oct 04 18:31:49.709889 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:31:49.709889 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-e3887469-7ba8-4244-a00f-90f0f2616de4 tempest-FlavorsExtraSpecsNegativeTestJSON-1029440622 tempest-FlavorsExtraSpecsNegativeTestJSON-1029440622-project-admin] Returning 404 to user: Flavor 1120690851 has no extra specs with key hw:cpu_thread_policy. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:31:49.709889 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-e3887469-7ba8-4244-a00f-90f0f2616de4 tempest-FlavorsExtraSpecsNegativeTestJSON-1029440622 tempest-FlavorsExtraSpecsNegativeTestJSON-1029440622-project-admin] 10.222.0.43 "DELETE /compute/v2.1/flavors/1120690851/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.033150 Oct 04 18:31:49.709889 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 78/154] 10.222.0.43 () {58 vars in 1269 bytes} [Tue Oct 4 18:31:49 2022] DELETE /compute/v2.1/flavors/1120690851/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:31:49.728314 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-0a6f4ead-f1b9-433c-9e12-8189a9393f0d tempest-FlavorsExtraSpecsNegativeTestJSON-1029440622 tempest-FlavorsExtraSpecsNegativeTestJSON-1029440622-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:31:49.743120 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-0a6f4ead-f1b9-433c-9e12-8189a9393f0d tempest-FlavorsExtraSpecsNegativeTestJSON-1029440622 tempest-FlavorsExtraSpecsNegativeTestJSON-1029440622-project-admin] HTTP exception thrown: Request body and URI mismatch Oct 04 18:31:49.744612 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-0a6f4ead-f1b9-433c-9e12-8189a9393f0d tempest-FlavorsExtraSpecsNegativeTestJSON-1029440622 tempest-FlavorsExtraSpecsNegativeTestJSON-1029440622-project-admin] Request method failure captured: Oct 04 18:31:49.744612 n-d-851028-13 devstack@n-api.service[123596]: request: PUT /compute/v2.1/flavors/1120690851/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 04 18:31:49.744612 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:31:49.744612 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:31:49.744612 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:31:49.744612 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 27 Oct 04 18:31:49.744612 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:31:49.744612 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:31:49.744612 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:31:49.744612 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:31:49.744612 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPHwTrvw2Tc3EhHe5Pzt2btHKE1JlRlewJCQHwiFUTZmUNWFyX7Ivl5MCVYwwp1RhAs5IloPWc7kskNbcq66HGQS8rMRbRHzQGy5sPOGWw2qYRqIa1va93BA-uYC6eqHm7JwMnUozbFBSUGXLs2c6xE3nFtx3qQEC2V8MgU1FIIF9T7E Oct 04 18:31:49.744612 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:31:49.744612 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:31:49.744612 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:31:49.744612 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:31:49.744612 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:31:49.744612 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:31:49.744612 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: ad832f1cecff446887de47efe664b418 Oct 04 18:31:49.744612 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1029440622 Oct 04 18:31:49.744612 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,admin,reader Oct 04 18:31:49.744612 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,admin,reader Oct 04 18:31:49.746016 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/ad832f1cecff446887de47efe664b418"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_ad832f1cecff446887de47efe664b418"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ad832f1cecff446887de47efe664b418"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ad832f1cecff446887de47efe664b418"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:31:49.746016 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1029440622 Oct 04 18:31:49.746016 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: ad832f1cecff446887de47efe664b418 Oct 04 18:31:49.746016 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1029440622 Oct 04 18:31:49.746016 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1029440622-project-admin Oct 04 18:31:49.746016 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:31:49.746016 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:31:49.746016 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 8deb39ed208b43ee93210d663cde5531 Oct 04 18:31:49.746016 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1029440622-project-admin Oct 04 18:31:49.746016 n-d-851028-13 devstack@n-api.service[123596]: Oct 04 18:31:49.746016 n-d-851028-13 devstack@n-api.service[123596]: {"hw:cpu_policy": "shared"} Oct 04 18:31:49.746016 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 18:31:49.746016 n-d-851028-13 devstack@n-api.service[123596]: exception: Request body and URI mismatch Oct 04 18:31:49.746834 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'flavor_id': '1120690851', 'id': 'hw:numa_nodes', 'body': {'hw:cpu_policy': 'shared'}} Oct 04 18:31:49.746834 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:31:49.746834 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:31:49.746834 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:31:49.746834 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:31:49.746834 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:31:49.746834 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:31:49.746834 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:31:49.746834 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:31:49.746834 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:31:49.746834 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:31:49.746834 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 96, in update Oct 04 18:31:49.746834 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=expl) Oct 04 18:31:49.746834 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Request body and URI mismatch Oct 04 18:31:49.746834 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:31:49.746834 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:31:49.746834 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:31:49.746834 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:31:49.746834 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:31:49.746834 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:31:49.748014 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:31:49.748014 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:31:49.748014 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Request body and URI mismatch Oct 04 18:31:49.748014 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:31:49.748014 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-0a6f4ead-f1b9-433c-9e12-8189a9393f0d tempest-FlavorsExtraSpecsNegativeTestJSON-1029440622 tempest-FlavorsExtraSpecsNegativeTestJSON-1029440622-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:31:49.748014 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-0a6f4ead-f1b9-433c-9e12-8189a9393f0d tempest-FlavorsExtraSpecsNegativeTestJSON-1029440622 tempest-FlavorsExtraSpecsNegativeTestJSON-1029440622-project-admin] 10.222.0.43 "PUT /compute/v2.1/flavors/1120690851/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.032764 Oct 04 18:31:49.748014 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 79/155] 10.222.0.43 () {60 vars in 1265 bytes} [Tue Oct 4 18:31:49 2022] PUT /compute/v2.1/flavors/1120690851/os-extra_specs/hw:numa_nodes => generated 73 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 04 18:31:49.760570 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-1d561081-b54b-4db2-b015-803c2cc0a3cc tempest-FlavorsExtraSpecsNegativeTestJSON-1029440622 tempest-FlavorsExtraSpecsNegativeTestJSON-1029440622-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:31:49.778843 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-1d561081-b54b-4db2-b015-803c2cc0a3cc tempest-FlavorsExtraSpecsNegativeTestJSON-1029440622 tempest-FlavorsExtraSpecsNegativeTestJSON-1029440622-project-admin] Request method failure captured: Oct 04 18:31:49.778843 n-d-851028-13 devstack@n-api.service[123596]: request: PUT /compute/v2.1/flavors/1120690851/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 04 18:31:49.778843 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:31:49.778843 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:31:49.778843 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:31:49.778843 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 49 Oct 04 18:31:49.778843 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:31:49.778843 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:31:49.778843 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:31:49.778843 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:31:49.778843 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPHwTrvw2Tc3EhHe5Pzt2btHKE1JlRlewJCQHwiFUTZmUNWFyX7Ivl5MCVYwwp1RhAs5IloPWc7kskNbcq66HGQS8rMRbRHzQGy5sPOGWw2qYRqIa1va93BA-uYC6eqHm7JwMnUozbFBSUGXLs2c6xE3nFtx3qQEC2V8MgU1FIIF9T7E Oct 04 18:31:49.778843 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:31:49.778843 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:31:49.778843 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:31:49.778843 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:31:49.778843 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:31:49.778843 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:31:49.778843 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: ad832f1cecff446887de47efe664b418 Oct 04 18:31:49.778843 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1029440622 Oct 04 18:31:49.778843 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,admin,reader Oct 04 18:31:49.778843 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,admin,reader Oct 04 18:31:49.780195 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/ad832f1cecff446887de47efe664b418"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_ad832f1cecff446887de47efe664b418"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ad832f1cecff446887de47efe664b418"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ad832f1cecff446887de47efe664b418"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:31:49.780195 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1029440622 Oct 04 18:31:49.780195 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: ad832f1cecff446887de47efe664b418 Oct 04 18:31:49.780195 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1029440622 Oct 04 18:31:49.780195 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1029440622-project-admin Oct 04 18:31:49.780195 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:31:49.780195 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:31:49.780195 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 8deb39ed208b43ee93210d663cde5531 Oct 04 18:31:49.780195 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1029440622-project-admin Oct 04 18:31:49.780195 n-d-851028-13 devstack@n-api.service[123596]: Oct 04 18:31:49.780195 n-d-851028-13 devstack@n-api.service[123596]: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} Oct 04 18:31:49.780195 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 18:31:49.780957 n-d-851028-13 devstack@n-api.service[123596]: exception: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 04 18:31:49.780957 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'flavor_id': '1120690851', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}} Oct 04 18:31:49.780957 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:31:49.780957 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:31:49.780957 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:31:49.780957 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:31:49.780957 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:31:49.780957 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:31:49.780957 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 04 18:31:49.780957 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:31:49.780957 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Failed validating 'maxProperties' in schema: Oct 04 18:31:49.780957 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 04 18:31:49.780957 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi 'maxProperties': 1, Oct 04 18:31:49.780957 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi 'minProperties': 1, Oct 04 18:31:49.780957 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 04 18:31:49.780957 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi 'type': ['string', Oct 04 18:31:49.780957 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi 'number']}}, Oct 04 18:31:49.780957 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 04 18:31:49.780957 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:31:49.780957 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi On instance: Oct 04 18:31:49.780957 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi {'hw:cpu_policy': 'shared', 'hw:numa_nodes': '1'} Oct 04 18:31:49.780957 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:31:49.782338 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:31:49.782338 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:31:49.782338 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:31:49.782338 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:31:49.782338 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:31:49.782338 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:31:49.782338 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:31:49.782338 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:31:49.782338 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:31:49.782338 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 18:31:49.782338 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 18:31:49.782338 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:31:49.782338 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:31:49.782338 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:31:49.782338 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:31:49.782338 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 04 18:31:49.782338 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:31:49.782338 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:31:49.782338 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:31:49.782338 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:31:49.783624 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:31:49.783624 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:31:49.783624 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:31:49.783624 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:31:49.783624 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 04 18:31:49.783624 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:31:49.783624 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-1d561081-b54b-4db2-b015-803c2cc0a3cc tempest-FlavorsExtraSpecsNegativeTestJSON-1029440622 tempest-FlavorsExtraSpecsNegativeTestJSON-1029440622-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:31:49.787633 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-1d561081-b54b-4db2-b015-803c2cc0a3cc tempest-FlavorsExtraSpecsNegativeTestJSON-1029440622 tempest-FlavorsExtraSpecsNegativeTestJSON-1029440622-project-admin] 10.222.0.43 "PUT /compute/v2.1/flavors/1120690851/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.033546 Oct 04 18:31:49.792818 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 80/156] 10.222.0.43 () {60 vars in 1265 bytes} [Tue Oct 4 18:31:49 2022] PUT /compute/v2.1/flavors/1120690851/os-extra_specs/hw:numa_nodes => generated 117 bytes in 41 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:31:49.806699 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-8dfb4c26-8d86-4184-9f68-714cb238ae53 tempest-FlavorsExtraSpecsNegativeTestJSON-1029440622 tempest-FlavorsExtraSpecsNegativeTestJSON-1029440622-project-admin] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:49.834110 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-8dfb4c26-8d86-4184-9f68-714cb238ae53 tempest-FlavorsExtraSpecsNegativeTestJSON-1029440622 tempest-FlavorsExtraSpecsNegativeTestJSON-1029440622-project-admin] 10.222.0.43 "DELETE /compute/v2.1/flavors/1120690851" status: 202 len: 0 microversion: 2.1 time: 0.030745 Oct 04 18:31:49.834525 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 81/157] 10.222.0.43 () {58 vars in 1161 bytes} [Tue Oct 4 18:31:49 2022] DELETE /compute/v2.1/flavors/1120690851 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 18:31:49.842081 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-c4f631bb-c5e1-44f0-9da7-8e6d5721cb44 tempest-FlavorsExtraSpecsNegativeTestJSON-1029440622 tempest-FlavorsExtraSpecsNegativeTestJSON-1029440622-project-admin] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:49.885646 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-c4f631bb-c5e1-44f0-9da7-8e6d5721cb44 tempest-FlavorsExtraSpecsNegativeTestJSON-1029440622 tempest-FlavorsExtraSpecsNegativeTestJSON-1029440622-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 5818 microversion: 2.1 time: 0.047208 Oct 04 18:31:49.886283 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 82/158] 10.222.0.43 () {58 vars in 1146 bytes} [Tue Oct 4 18:31:49 2022] GET /compute/v2.1/flavors/detail => generated 5818 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:49.945409 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-67edb05f-7bff-4cdc-b07e-71a565e63b4a tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99862180a0f2408c806bab348d78709a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21d25b0c2c34c33ab70844c8bf0cf97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:49.955595 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-67edb05f-7bff-4cdc-b07e-71a565e63b4a tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] 10.222.0.43 "GET /compute/v2.1/servers/3b8abc08-2a0d-44a6-bdee-3b356bcfb7a1" status: 200 len: 1338 microversion: 2.1 time: 0.328100 Oct 04 18:31:49.956651 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 77/159] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:49 2022] GET /compute/v2.1/servers/3b8abc08-2a0d-44a6-bdee-3b356bcfb7a1 => generated 1338 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:50.308049 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-7fd21b7a-5e80-4b6b-8eb2-2b0be4b266be tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:50.309704 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-7fd21b7a-5e80-4b6b-8eb2-2b0be4b266be tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] [instance: 968f1c40-0d51-403e-9609-8eb62b9060bb] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:50.317159 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7fd21b7a-5e80-4b6b-8eb2-2b0be4b266be tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:50.318115 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7fd21b7a-5e80-4b6b-8eb2-2b0be4b266be tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:50.318661 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7fd21b7a-5e80-4b6b-8eb2-2b0be4b266be tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:50.319475 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7fd21b7a-5e80-4b6b-8eb2-2b0be4b266be tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:50.320475 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7fd21b7a-5e80-4b6b-8eb2-2b0be4b266be tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:50.320881 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7fd21b7a-5e80-4b6b-8eb2-2b0be4b266be tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:50.329750 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=100 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:31:50.549043 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-7fd21b7a-5e80-4b6b-8eb2-2b0be4b266be tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '459e65f14af049bba311453d6a86360b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1753b9ee9a644e409a1efd0c9e7c152c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:50.561588 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-7fd21b7a-5e80-4b6b-8eb2-2b0be4b266be tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] 10.222.0.43 "GET /compute/v2.1/servers/968f1c40-0d51-403e-9609-8eb62b9060bb" status: 200 len: 1319 microversion: 2.1 time: 0.257551 Oct 04 18:31:50.562760 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 83/160] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:50 2022] GET /compute/v2.1/servers/968f1c40-0d51-403e-9609-8eb62b9060bb => generated 1319 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:31:50.621644 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-5329241d-8ce0-47c7-a14d-61620afd3f55 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:50.622554 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-5329241d-8ce0-47c7-a14d-61620afd3f55 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] [instance: b36499e0-9405-4153-a581-13c1bd9d43eb] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:50.632137 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5329241d-8ce0-47c7-a14d-61620afd3f55 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:50.633328 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5329241d-8ce0-47c7-a14d-61620afd3f55 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:50.633931 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5329241d-8ce0-47c7-a14d-61620afd3f55 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:50.635348 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5329241d-8ce0-47c7-a14d-61620afd3f55 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:50.636107 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5329241d-8ce0-47c7-a14d-61620afd3f55 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:50.636915 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5329241d-8ce0-47c7-a14d-61620afd3f55 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:50.680788 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-09715de0-e883-43fd-9597-5b16957d2859 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:50.681432 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-09715de0-e883-43fd-9597-5b16957d2859 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] [instance: 9b19b908-7870-477b-9be7-7d260d59b183] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:50.688572 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-09715de0-e883-43fd-9597-5b16957d2859 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:50.689065 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-09715de0-e883-43fd-9597-5b16957d2859 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:50.689539 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-09715de0-e883-43fd-9597-5b16957d2859 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:50.690612 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-09715de0-e883-43fd-9597-5b16957d2859 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:50.691071 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-09715de0-e883-43fd-9597-5b16957d2859 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:50.691496 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-09715de0-e883-43fd-9597-5b16957d2859 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:50.760179 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-09715de0-e883-43fd-9597-5b16957d2859 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ea2088d8124b149187a1c140d3be88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82c615a05e8a4cd086f2e580529fb1d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:50.770151 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-09715de0-e883-43fd-9597-5b16957d2859 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] 10.222.0.43 "GET /compute/v2.1/servers/9b19b908-7870-477b-9be7-7d260d59b183" status: 200 len: 1337 microversion: 2.1 time: 0.093846 Oct 04 18:31:50.770743 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 84/161] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:50 2022] GET /compute/v2.1/servers/9b19b908-7870-477b-9be7-7d260d59b183 => generated 1337 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:31:50.893182 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-5329241d-8ce0-47c7-a14d-61620afd3f55 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7db99f361654711bea7f1b2c404d312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7adedcdb9c3485ea2738c00e25aa3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:50.904073 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-5329241d-8ce0-47c7-a14d-61620afd3f55 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] 10.222.0.43 "GET /compute/v2.1/servers/b36499e0-9405-4153-a581-13c1bd9d43eb" status: 200 len: 1317 microversion: 2.1 time: 0.287082 Oct 04 18:31:50.905771 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 78/162] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:50 2022] GET /compute/v2.1/servers/b36499e0-9405-4153-a581-13c1bd9d43eb => generated 1317 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:50.940691 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-39f98ec0-b4a3-46ea-a60b-ef4167d58f42 req-26e0359e-32d1-4d51-b7ee-096cda62cc22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b8abc08-2a0d-44a6-bdee-3b356bcfb7a1", "name": "network-vif-plugged", "status": "completed", "tag": "01a0afe5-e001-4cdd-8a9a-6146c9782fc2"}, {"server_uuid": "968f1c40-0d51-403e-9609-8eb62b9060bb", "name": "network-vif-plugged", "status": "completed", "tag": "cc38f863-bfa1-46ba-a469-894c955bcca9"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:31:50.958916 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-39f98ec0-b4a3-46ea-a60b-ef4167d58f42 req-26e0359e-32d1-4d51-b7ee-096cda62cc22 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:50.960122 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-39f98ec0-b4a3-46ea-a60b-ef4167d58f42 req-26e0359e-32d1-4d51-b7ee-096cda62cc22 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:50.960927 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-39f98ec0-b4a3-46ea-a60b-ef4167d58f42 req-26e0359e-32d1-4d51-b7ee-096cda62cc22 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:50.983106 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-5032fcd3-e77e-47fa-aa61-89e357875de7 tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:50.983956 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-5032fcd3-e77e-47fa-aa61-89e357875de7 tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] [instance: 3b8abc08-2a0d-44a6-bdee-3b356bcfb7a1] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:50.990847 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-39f98ec0-b4a3-46ea-a60b-ef4167d58f42 req-26e0359e-32d1-4d51-b7ee-096cda62cc22 service nova] Creating event network-vif-plugged:01a0afe5-e001-4cdd-8a9a-6146c9782fc2 for instance 3b8abc08-2a0d-44a6-bdee-3b356bcfb7a1 on n-h2-851028-13 Oct 04 18:31:50.991703 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-39f98ec0-b4a3-46ea-a60b-ef4167d58f42 req-26e0359e-32d1-4d51-b7ee-096cda62cc22 service nova] Creating event network-vif-plugged:cc38f863-bfa1-46ba-a469-894c955bcca9 for instance 968f1c40-0d51-403e-9609-8eb62b9060bb on n-h1-851028-13 Oct 04 18:31:50.994588 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5032fcd3-e77e-47fa-aa61-89e357875de7 tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:50.995180 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5032fcd3-e77e-47fa-aa61-89e357875de7 tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:50.996112 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5032fcd3-e77e-47fa-aa61-89e357875de7 tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:50.997754 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5032fcd3-e77e-47fa-aa61-89e357875de7 tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:50.998376 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5032fcd3-e77e-47fa-aa61-89e357875de7 tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:50.998819 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5032fcd3-e77e-47fa-aa61-89e357875de7 tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:51.005989 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-39f98ec0-b4a3-46ea-a60b-ef4167d58f42 req-26e0359e-32d1-4d51-b7ee-096cda62cc22 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.069809 Oct 04 18:31:51.007342 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 85/163] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:31:50 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:31:51.410953 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-5032fcd3-e77e-47fa-aa61-89e357875de7 tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99862180a0f2408c806bab348d78709a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21d25b0c2c34c33ab70844c8bf0cf97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:51.435452 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-5032fcd3-e77e-47fa-aa61-89e357875de7 tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] 10.222.0.43 "GET /compute/v2.1/servers/3b8abc08-2a0d-44a6-bdee-3b356bcfb7a1" status: 200 len: 1338 microversion: 2.1 time: 0.457013 Oct 04 18:31:51.436255 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 79/164] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:50 2022] GET /compute/v2.1/servers/3b8abc08-2a0d-44a6-bdee-3b356bcfb7a1 => generated 1338 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:51.591939 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-a5b5fb67-8369-44a8-84fd-5a9497e0b52d tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:51.593234 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-a5b5fb67-8369-44a8-84fd-5a9497e0b52d tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] [instance: 968f1c40-0d51-403e-9609-8eb62b9060bb] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:51.604737 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a5b5fb67-8369-44a8-84fd-5a9497e0b52d tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:51.604982 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a5b5fb67-8369-44a8-84fd-5a9497e0b52d tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:51.605637 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a5b5fb67-8369-44a8-84fd-5a9497e0b52d tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:51.606412 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a5b5fb67-8369-44a8-84fd-5a9497e0b52d tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:51.606872 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a5b5fb67-8369-44a8-84fd-5a9497e0b52d tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:51.607298 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a5b5fb67-8369-44a8-84fd-5a9497e0b52d tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:51.794382 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-e8553e48-caf0-438b-912a-785a8df4fe44 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:51.795011 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-e8553e48-caf0-438b-912a-785a8df4fe44 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] [instance: 9b19b908-7870-477b-9be7-7d260d59b183] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:51.804353 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e8553e48-caf0-438b-912a-785a8df4fe44 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:51.805827 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e8553e48-caf0-438b-912a-785a8df4fe44 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:51.807090 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e8553e48-caf0-438b-912a-785a8df4fe44 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:51.809561 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e8553e48-caf0-438b-912a-785a8df4fe44 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:51.810884 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e8553e48-caf0-438b-912a-785a8df4fe44 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:51.811911 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e8553e48-caf0-438b-912a-785a8df4fe44 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:51.977319 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-e8553e48-caf0-438b-912a-785a8df4fe44 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ea2088d8124b149187a1c140d3be88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82c615a05e8a4cd086f2e580529fb1d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:51.991341 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-e8553e48-caf0-438b-912a-785a8df4fe44 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] 10.222.0.43 "GET /compute/v2.1/servers/9b19b908-7870-477b-9be7-7d260d59b183" status: 200 len: 1343 microversion: 2.1 time: 0.200649 Oct 04 18:31:51.993917 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 80/165] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:51 2022] GET /compute/v2.1/servers/9b19b908-7870-477b-9be7-7d260d59b183 => generated 1343 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:52.003510 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-2e321295-f16e-41c7-b2cf-2c139299dc32 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:52.004234 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-2e321295-f16e-41c7-b2cf-2c139299dc32 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] [instance: b36499e0-9405-4153-a581-13c1bd9d43eb] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:52.015686 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2e321295-f16e-41c7-b2cf-2c139299dc32 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:52.016871 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2e321295-f16e-41c7-b2cf-2c139299dc32 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:52.017551 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2e321295-f16e-41c7-b2cf-2c139299dc32 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:52.018505 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2e321295-f16e-41c7-b2cf-2c139299dc32 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:52.019154 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2e321295-f16e-41c7-b2cf-2c139299dc32 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:52.019769 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2e321295-f16e-41c7-b2cf-2c139299dc32 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:52.063452 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=2 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:31:52.109563 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-a5b5fb67-8369-44a8-84fd-5a9497e0b52d tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '459e65f14af049bba311453d6a86360b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1753b9ee9a644e409a1efd0c9e7c152c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:52.124097 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-a5b5fb67-8369-44a8-84fd-5a9497e0b52d tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] 10.222.0.43 "GET /compute/v2.1/servers/968f1c40-0d51-403e-9609-8eb62b9060bb" status: 200 len: 1319 microversion: 2.1 time: 0.537787 Oct 04 18:31:52.128208 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 86/166] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:51 2022] GET /compute/v2.1/servers/968f1c40-0d51-403e-9609-8eb62b9060bb => generated 1319 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:52.341819 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-2e321295-f16e-41c7-b2cf-2c139299dc32 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7db99f361654711bea7f1b2c404d312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7adedcdb9c3485ea2738c00e25aa3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:52.356129 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-2e321295-f16e-41c7-b2cf-2c139299dc32 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] 10.222.0.43 "GET /compute/v2.1/servers/b36499e0-9405-4153-a581-13c1bd9d43eb" status: 200 len: 1467 microversion: 2.1 time: 0.358771 Oct 04 18:31:52.356944 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 81/167] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:51 2022] GET /compute/v2.1/servers/b36499e0-9405-4153-a581-13c1bd9d43eb => generated 1467 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:52.475054 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-932fd98e-b235-43e7-8bc9-a96fcdfe3bc6 tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:52.476564 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-932fd98e-b235-43e7-8bc9-a96fcdfe3bc6 tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] [instance: 3b8abc08-2a0d-44a6-bdee-3b356bcfb7a1] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:52.490446 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-932fd98e-b235-43e7-8bc9-a96fcdfe3bc6 tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:52.491545 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-932fd98e-b235-43e7-8bc9-a96fcdfe3bc6 tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:52.492330 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-932fd98e-b235-43e7-8bc9-a96fcdfe3bc6 tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:52.493551 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-932fd98e-b235-43e7-8bc9-a96fcdfe3bc6 tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:52.495421 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-932fd98e-b235-43e7-8bc9-a96fcdfe3bc6 tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:52.498007 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-932fd98e-b235-43e7-8bc9-a96fcdfe3bc6 tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:52.736270 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-932fd98e-b235-43e7-8bc9-a96fcdfe3bc6 tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99862180a0f2408c806bab348d78709a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21d25b0c2c34c33ab70844c8bf0cf97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:52.750952 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-932fd98e-b235-43e7-8bc9-a96fcdfe3bc6 tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] 10.222.0.43 "GET /compute/v2.1/servers/3b8abc08-2a0d-44a6-bdee-3b356bcfb7a1" status: 200 len: 1338 microversion: 2.1 time: 0.291250 Oct 04 18:31:52.752512 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 82/168] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:52 2022] GET /compute/v2.1/servers/3b8abc08-2a0d-44a6-bdee-3b356bcfb7a1 => generated 1338 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:52.770867 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-9d1dfb48-e7f5-4f77-bc24-7a504fc9dd61 tempest-ServersOnMultiNodesTest-1245420526 tempest-ServersOnMultiNodesTest-1245420526-project-admin] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:52.775775 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-9d1dfb48-e7f5-4f77-bc24-7a504fc9dd61 tempest-ServersOnMultiNodesTest-1245420526 tempest-ServersOnMultiNodesTest-1245420526-project-admin] [instance: b36499e0-9405-4153-a581-13c1bd9d43eb] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:52.787006 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9d1dfb48-e7f5-4f77-bc24-7a504fc9dd61 tempest-ServersOnMultiNodesTest-1245420526 tempest-ServersOnMultiNodesTest-1245420526-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:52.788028 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9d1dfb48-e7f5-4f77-bc24-7a504fc9dd61 tempest-ServersOnMultiNodesTest-1245420526 tempest-ServersOnMultiNodesTest-1245420526-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:52.789895 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9d1dfb48-e7f5-4f77-bc24-7a504fc9dd61 tempest-ServersOnMultiNodesTest-1245420526 tempest-ServersOnMultiNodesTest-1245420526-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:52.791330 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9d1dfb48-e7f5-4f77-bc24-7a504fc9dd61 tempest-ServersOnMultiNodesTest-1245420526 tempest-ServersOnMultiNodesTest-1245420526-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:52.793425 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9d1dfb48-e7f5-4f77-bc24-7a504fc9dd61 tempest-ServersOnMultiNodesTest-1245420526 tempest-ServersOnMultiNodesTest-1245420526-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:52.795341 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9d1dfb48-e7f5-4f77-bc24-7a504fc9dd61 tempest-ServersOnMultiNodesTest-1245420526 tempest-ServersOnMultiNodesTest-1245420526-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:53.016903 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-d936a10c-6d12-46de-a107-24af2ac4a3a8 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:53.018317 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-d936a10c-6d12-46de-a107-24af2ac4a3a8 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] [instance: 9b19b908-7870-477b-9be7-7d260d59b183] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:53.035188 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d936a10c-6d12-46de-a107-24af2ac4a3a8 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:53.037003 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d936a10c-6d12-46de-a107-24af2ac4a3a8 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:53.039251 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d936a10c-6d12-46de-a107-24af2ac4a3a8 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:53.050044 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d936a10c-6d12-46de-a107-24af2ac4a3a8 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:53.050555 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d936a10c-6d12-46de-a107-24af2ac4a3a8 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:53.051001 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d936a10c-6d12-46de-a107-24af2ac4a3a8 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:53.314633 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-9d1dfb48-e7f5-4f77-bc24-7a504fc9dd61 tempest-ServersOnMultiNodesTest-1245420526 tempest-ServersOnMultiNodesTest-1245420526-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/b36499e0-9405-4153-a581-13c1bd9d43eb" status: 200 len: 1620 microversion: 2.1 time: 0.933087 Oct 04 18:31:53.321286 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 87/169] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:52 2022] GET /compute/v2.1/servers/b36499e0-9405-4153-a581-13c1bd9d43eb => generated 1620 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:53.329540 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-d7555f68-5918-4f17-aaf5-608741d093db tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:53.332906 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-d7555f68-5918-4f17-aaf5-608741d093db tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] [instance: 968f1c40-0d51-403e-9609-8eb62b9060bb] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:53.354031 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d7555f68-5918-4f17-aaf5-608741d093db tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:53.355030 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d7555f68-5918-4f17-aaf5-608741d093db tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:53.356291 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d7555f68-5918-4f17-aaf5-608741d093db tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:53.358067 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d7555f68-5918-4f17-aaf5-608741d093db tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:53.360373 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d7555f68-5918-4f17-aaf5-608741d093db tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:53.360983 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d7555f68-5918-4f17-aaf5-608741d093db tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:53.486984 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-d936a10c-6d12-46de-a107-24af2ac4a3a8 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ea2088d8124b149187a1c140d3be88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82c615a05e8a4cd086f2e580529fb1d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:53.499822 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-d936a10c-6d12-46de-a107-24af2ac4a3a8 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] 10.222.0.43 "GET /compute/v2.1/servers/9b19b908-7870-477b-9be7-7d260d59b183" status: 200 len: 1410 microversion: 2.1 time: 0.486302 Oct 04 18:31:53.499822 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 83/170] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:53 2022] GET /compute/v2.1/servers/9b19b908-7870-477b-9be7-7d260d59b183 => generated 1410 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:53.510925 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-1add1b23-dc64-42de-a374-a6ab8ba798a1 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Action: 'create', calling method: .version_select at 0x7fb2248959d0>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-168502429", "policies": ["affinity"]}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:31:53.561849 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-1add1b23-dc64-42de-a374-a6ab8ba798a1 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Getting quotas for project e7adedcdb9c3485ea2738c00e25aa3fd. Resources: {'server_groups'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:31:53.568450 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-1add1b23-dc64-42de-a374-a6ab8ba798a1 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Getting quotas for user a7db99f361654711bea7f1b2c404d312 and project e7adedcdb9c3485ea2738c00e25aa3fd. Resources: {'server_groups'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:31:53.584846 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-d7555f68-5918-4f17-aaf5-608741d093db tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '459e65f14af049bba311453d6a86360b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1753b9ee9a644e409a1efd0c9e7c152c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:53.599514 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-d7555f68-5918-4f17-aaf5-608741d093db tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] 10.222.0.43 "GET /compute/v2.1/servers/968f1c40-0d51-403e-9609-8eb62b9060bb" status: 200 len: 1469 microversion: 2.1 time: 0.275731 Oct 04 18:31:53.603207 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 88/171] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:53 2022] GET /compute/v2.1/servers/968f1c40-0d51-403e-9609-8eb62b9060bb => generated 1469 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:53.669020 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-1add1b23-dc64-42de-a374-a6ab8ba798a1 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Getting quotas for project e7adedcdb9c3485ea2738c00e25aa3fd. Resources: {'server_groups'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:31:53.675261 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-1add1b23-dc64-42de-a374-a6ab8ba798a1 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Getting quotas for user a7db99f361654711bea7f1b2c404d312 and project e7adedcdb9c3485ea2738c00e25aa3fd. Resources: {'server_groups'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:31:53.696376 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-1add1b23-dc64-42de-a374-a6ab8ba798a1 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] 10.222.0.43 "POST /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.191473 Oct 04 18:31:53.697993 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 84/172] 10.222.0.43 () {60 vars in 1174 bytes} [Tue Oct 4 18:31:53 2022] POST /compute/v2.1/os-server-groups => generated 187 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:31:53.787498 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-5763dd4c-ff1b-4953-b13f-df6f4a0d494f tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:53.789070 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-5763dd4c-ff1b-4953-b13f-df6f4a0d494f tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] [instance: 3b8abc08-2a0d-44a6-bdee-3b356bcfb7a1] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:53.798669 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5763dd4c-ff1b-4953-b13f-df6f4a0d494f tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:53.800033 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5763dd4c-ff1b-4953-b13f-df6f4a0d494f tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:53.801761 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5763dd4c-ff1b-4953-b13f-df6f4a0d494f tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:53.802504 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5763dd4c-ff1b-4953-b13f-df6f4a0d494f tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:53.802968 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5763dd4c-ff1b-4953-b13f-df6f4a0d494f tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:53.803401 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5763dd4c-ff1b-4953-b13f-df6f4a0d494f tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:53.940531 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-2bb74af0-7a2c-429f-a287-c91d76f63de3 tempest-DeleteServersAdminTestJSON-1863575440 tempest-DeleteServersAdminTestJSON-1863575440-project-admin] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:53.941957 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-2bb74af0-7a2c-429f-a287-c91d76f63de3 tempest-DeleteServersAdminTestJSON-1863575440 tempest-DeleteServersAdminTestJSON-1863575440-project-admin] [instance: 968f1c40-0d51-403e-9609-8eb62b9060bb] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:53.949689 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2bb74af0-7a2c-429f-a287-c91d76f63de3 tempest-DeleteServersAdminTestJSON-1863575440 tempest-DeleteServersAdminTestJSON-1863575440-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:53.950518 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2bb74af0-7a2c-429f-a287-c91d76f63de3 tempest-DeleteServersAdminTestJSON-1863575440 tempest-DeleteServersAdminTestJSON-1863575440-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:53.951227 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2bb74af0-7a2c-429f-a287-c91d76f63de3 tempest-DeleteServersAdminTestJSON-1863575440 tempest-DeleteServersAdminTestJSON-1863575440-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:53.952177 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2bb74af0-7a2c-429f-a287-c91d76f63de3 tempest-DeleteServersAdminTestJSON-1863575440 tempest-DeleteServersAdminTestJSON-1863575440-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:53.953128 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2bb74af0-7a2c-429f-a287-c91d76f63de3 tempest-DeleteServersAdminTestJSON-1863575440 tempest-DeleteServersAdminTestJSON-1863575440-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:53.953670 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2bb74af0-7a2c-429f-a287-c91d76f63de3 tempest-DeleteServersAdminTestJSON-1863575440 tempest-DeleteServersAdminTestJSON-1863575440-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:53.988323 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-2bb74af0-7a2c-429f-a287-c91d76f63de3 tempest-DeleteServersAdminTestJSON-1863575440 tempest-DeleteServersAdminTestJSON-1863575440-project-admin] [instance: 968f1c40-0d51-403e-9609-8eb62b9060bb] Going to try to terminate instance {{(pid=123596) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:31:54.019896 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-5763dd4c-ff1b-4953-b13f-df6f4a0d494f tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99862180a0f2408c806bab348d78709a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21d25b0c2c34c33ab70844c8bf0cf97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:54.028507 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-5763dd4c-ff1b-4953-b13f-df6f4a0d494f tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] 10.222.0.43 "GET /compute/v2.1/servers/3b8abc08-2a0d-44a6-bdee-3b356bcfb7a1" status: 200 len: 1488 microversion: 2.1 time: 0.251790 Oct 04 18:31:54.029423 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 85/173] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:53 2022] GET /compute/v2.1/servers/3b8abc08-2a0d-44a6-bdee-3b356bcfb7a1 => generated 1488 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:54.034954 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-86e5ac2a-0406-47b5-b810-c6219fa011c7 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1983056412", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "2e541515-72cb-4ea1-b049-ec95de4faec4"}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:31:54.154967 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.network.neutron [None req-86e5ac2a-0406-47b5-b810-c6219fa011c7 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] validate_networks() for None {{(pid=123595) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:31:54.232191 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-2bb74af0-7a2c-429f-a287-c91d76f63de3 tempest-DeleteServersAdminTestJSON-1863575440 tempest-DeleteServersAdminTestJSON-1863575440-project-admin] 10.222.0.43 "DELETE /compute/v2.1/servers/968f1c40-0d51-403e-9609-8eb62b9060bb" status: 204 len: 0 microversion: 2.1 time: 0.605855 Oct 04 18:31:54.233767 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 89/174] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 18:31:53 2022] DELETE /compute/v2.1/servers/968f1c40-0d51-403e-9609-8eb62b9060bb => generated 0 bytes in 609 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:31:54.243445 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-46b605dd-ee67-4916-9b67-746b71e467b6 tempest-AggregatesAdminTestJSON-1163717784 tempest-AggregatesAdminTestJSON-1163717784-project-admin] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:54.245828 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-46b605dd-ee67-4916-9b67-746b71e467b6 tempest-AggregatesAdminTestJSON-1163717784 tempest-AggregatesAdminTestJSON-1163717784-project-admin] [instance: 3b8abc08-2a0d-44a6-bdee-3b356bcfb7a1] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:54.257419 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-46b605dd-ee67-4916-9b67-746b71e467b6 tempest-AggregatesAdminTestJSON-1163717784 tempest-AggregatesAdminTestJSON-1163717784-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:54.265420 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-46b605dd-ee67-4916-9b67-746b71e467b6 tempest-AggregatesAdminTestJSON-1163717784 tempest-AggregatesAdminTestJSON-1163717784-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:54.265420 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-46b605dd-ee67-4916-9b67-746b71e467b6 tempest-AggregatesAdminTestJSON-1163717784 tempest-AggregatesAdminTestJSON-1163717784-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:54.265420 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-46b605dd-ee67-4916-9b67-746b71e467b6 tempest-AggregatesAdminTestJSON-1163717784 tempest-AggregatesAdminTestJSON-1163717784-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:54.265420 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-46b605dd-ee67-4916-9b67-746b71e467b6 tempest-AggregatesAdminTestJSON-1163717784 tempest-AggregatesAdminTestJSON-1163717784-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:54.265770 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-46b605dd-ee67-4916-9b67-746b71e467b6 tempest-AggregatesAdminTestJSON-1163717784 tempest-AggregatesAdminTestJSON-1163717784-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:54.639227 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-46b605dd-ee67-4916-9b67-746b71e467b6 tempest-AggregatesAdminTestJSON-1163717784 tempest-AggregatesAdminTestJSON-1163717784-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/3b8abc08-2a0d-44a6-bdee-3b356bcfb7a1" status: 200 len: 1641 microversion: 2.1 time: 0.403664 Oct 04 18:31:54.641539 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 90/175] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:54 2022] GET /compute/v2.1/servers/3b8abc08-2a0d-44a6-bdee-3b356bcfb7a1 => generated 1641 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:54.648770 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-68965f36-addb-4090-bb92-5dc0e7cb7c3e req-8a980586-777f-4da0-b24d-b240b9bab0c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b19b908-7870-477b-9be7-7d260d59b183", "tag": "1b942ddb-54b7-42fd-90da-3d92df57749c"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:31:54.666092 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-68965f36-addb-4090-bb92-5dc0e7cb7c3e req-8a980586-777f-4da0-b24d-b240b9bab0c3 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:54.666752 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-68965f36-addb-4090-bb92-5dc0e7cb7c3e req-8a980586-777f-4da0-b24d-b240b9bab0c3 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:54.667266 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-68965f36-addb-4090-bb92-5dc0e7cb7c3e req-8a980586-777f-4da0-b24d-b240b9bab0c3 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:54.672408 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-86e5ac2a-0406-47b5-b810-c6219fa011c7 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Flavor limits 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:31:54.673100 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-86e5ac2a-0406-47b5-b810-c6219fa011c7 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Image limits 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:31:54.674265 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-86e5ac2a-0406-47b5-b810-c6219fa011c7 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Flavor pref 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:31:54.674835 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-86e5ac2a-0406-47b5-b810-c6219fa011c7 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Image pref 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:31:54.675575 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-86e5ac2a-0406-47b5-b810-c6219fa011c7 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:31:54.678750 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-68965f36-addb-4090-bb92-5dc0e7cb7c3e req-8a980586-777f-4da0-b24d-b240b9bab0c3 service nova] Creating event network-changed:1b942ddb-54b7-42fd-90da-3d92df57749c for instance 9b19b908-7870-477b-9be7-7d260d59b183 on n-h2-851028-13 Oct 04 18:31:54.688412 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-68965f36-addb-4090-bb92-5dc0e7cb7c3e req-8a980586-777f-4da0-b24d-b240b9bab0c3 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045601 Oct 04 18:31:54.689464 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 91/176] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:31:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:31:54.695727 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-70242759-c776-407e-92d0-6031a14dd413 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:54.696668 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-70242759-c776-407e-92d0-6031a14dd413 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] [instance: 968f1c40-0d51-403e-9609-8eb62b9060bb] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:54.703658 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-70242759-c776-407e-92d0-6031a14dd413 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:54.704554 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-70242759-c776-407e-92d0-6031a14dd413 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:54.705171 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-70242759-c776-407e-92d0-6031a14dd413 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:54.706045 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-70242759-c776-407e-92d0-6031a14dd413 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:54.706645 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-70242759-c776-407e-92d0-6031a14dd413 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:54.707218 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-70242759-c776-407e-92d0-6031a14dd413 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:54.707334 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-86e5ac2a-0406-47b5-b810-c6219fa011c7 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:54.708050 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-86e5ac2a-0406-47b5-b810-c6219fa011c7 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:54.708498 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-86e5ac2a-0406-47b5-b810-c6219fa011c7 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:54.709267 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-86e5ac2a-0406-47b5-b810-c6219fa011c7 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:54.709790 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-86e5ac2a-0406-47b5-b810-c6219fa011c7 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:54.710674 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-86e5ac2a-0406-47b5-b810-c6219fa011c7 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:54.732882 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-86e5ac2a-0406-47b5-b810-c6219fa011c7 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Getting quotas for project e7adedcdb9c3485ea2738c00e25aa3fd. Resources: {'ram', 'cores', 'instances'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:31:54.738620 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-86e5ac2a-0406-47b5-b810-c6219fa011c7 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Getting quotas for user a7db99f361654711bea7f1b2c404d312 and project e7adedcdb9c3485ea2738c00e25aa3fd. Resources: {'ram', 'cores', 'instances'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:31:54.751455 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-86e5ac2a-0406-47b5-b810-c6219fa011c7 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Going to run 2 instances... {{(pid=123595) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:31:54.754489 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-86e5ac2a-0406-47b5-b810-c6219fa011c7 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] [instance: 4311d976-991e-4ab1-9d5e-d654aa7d0b08] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e8943ec5-4038-4d4b-b9b9-2415a79f5243',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:31:54.807791 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-86e5ac2a-0406-47b5-b810-c6219fa011c7 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=123595) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Oct 04 18:31:54.847437 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-86e5ac2a-0406-47b5-b810-c6219fa011c7 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Getting quotas for project e7adedcdb9c3485ea2738c00e25aa3fd. Resources: {'server_group_members'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:31:54.856039 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-86e5ac2a-0406-47b5-b810-c6219fa011c7 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Getting quotas for user a7db99f361654711bea7f1b2c404d312 and project e7adedcdb9c3485ea2738c00e25aa3fd. Resources: {'server_group_members'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:31:54.858041 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=8,nova_api:SAVEPOINT=2,nova_api:RELEASE=2 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:31:54.890919 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-70242759-c776-407e-92d0-6031a14dd413 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '459e65f14af049bba311453d6a86360b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1753b9ee9a644e409a1efd0c9e7c152c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:54.899839 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-70242759-c776-407e-92d0-6031a14dd413 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] 10.222.0.43 "GET /compute/v2.1/servers/968f1c40-0d51-403e-9609-8eb62b9060bb" status: 200 len: 1475 microversion: 2.1 time: 0.208975 Oct 04 18:31:54.900630 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 92/177] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:54 2022] GET /compute/v2.1/servers/968f1c40-0d51-403e-9609-8eb62b9060bb => generated 1475 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:54.924593 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-d0966055-d265-4027-9db0-40f272f8edee tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:54.925372 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-d0966055-d265-4027-9db0-40f272f8edee tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] [instance: 9b19b908-7870-477b-9be7-7d260d59b183] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:54.934065 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d0966055-d265-4027-9db0-40f272f8edee tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:54.934701 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d0966055-d265-4027-9db0-40f272f8edee tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:54.935779 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d0966055-d265-4027-9db0-40f272f8edee tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:54.936053 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d0966055-d265-4027-9db0-40f272f8edee tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:54.936501 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d0966055-d265-4027-9db0-40f272f8edee tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:54.939666 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d0966055-d265-4027-9db0-40f272f8edee tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:54.962502 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-86e5ac2a-0406-47b5-b810-c6219fa011c7 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Getting quotas for project e7adedcdb9c3485ea2738c00e25aa3fd. Resources: {'server_group_members'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:31:54.967860 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-86e5ac2a-0406-47b5-b810-c6219fa011c7 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Getting quotas for user a7db99f361654711bea7f1b2c404d312 and project e7adedcdb9c3485ea2738c00e25aa3fd. Resources: {'server_group_members'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:31:54.982437 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-86e5ac2a-0406-47b5-b810-c6219fa011c7 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] [instance: c4b812d5-f2ff-41c7-b912-3d19d752340b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e8943ec5-4038-4d4b-b9b9-2415a79f5243',instance=,instance_uuid=4311d976-991e-4ab1-9d5e-d654aa7d0b08,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:31:55.048624 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-86e5ac2a-0406-47b5-b810-c6219fa011c7 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Getting quotas for project e7adedcdb9c3485ea2738c00e25aa3fd. Resources: {'server_group_members'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:31:55.053498 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-86e5ac2a-0406-47b5-b810-c6219fa011c7 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Getting quotas for user a7db99f361654711bea7f1b2c404d312 and project e7adedcdb9c3485ea2738c00e25aa3fd. Resources: {'server_group_members'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:31:55.109165 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-d0966055-d265-4027-9db0-40f272f8edee tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ea2088d8124b149187a1c140d3be88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82c615a05e8a4cd086f2e580529fb1d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:55.114800 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-86e5ac2a-0406-47b5-b810-c6219fa011c7 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Getting quotas for project e7adedcdb9c3485ea2738c00e25aa3fd. Resources: {'server_group_members'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:31:55.118329 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-d0966055-d265-4027-9db0-40f272f8edee tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] 10.222.0.43 "GET /compute/v2.1/servers/9b19b908-7870-477b-9be7-7d260d59b183" status: 200 len: 1410 microversion: 2.1 time: 0.202688 Oct 04 18:31:55.118908 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-86e5ac2a-0406-47b5-b810-c6219fa011c7 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Getting quotas for user a7db99f361654711bea7f1b2c404d312 and project e7adedcdb9c3485ea2738c00e25aa3fd. Resources: {'server_group_members'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:31:55.119031 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 93/178] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:54 2022] GET /compute/v2.1/servers/9b19b908-7870-477b-9be7-7d260d59b183 => generated 1410 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:55.156765 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-86e5ac2a-0406-47b5-b810-c6219fa011c7 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.124159 Oct 04 18:31:55.161301 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 86/179] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 18:31:54 2022] POST /compute/v2.1/servers => generated 32 bytes in 1128 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Oct 04 18:31:55.164702 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-6e963867-ee85-4a8c-b71f-ffc1b0676a22 tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:55.165236 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-6e963867-ee85-4a8c-b71f-ffc1b0676a22 tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] [instance: 3b8abc08-2a0d-44a6-bdee-3b356bcfb7a1] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:55.172325 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6e963867-ee85-4a8c-b71f-ffc1b0676a22 tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:55.172819 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6e963867-ee85-4a8c-b71f-ffc1b0676a22 tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:55.173292 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6e963867-ee85-4a8c-b71f-ffc1b0676a22 tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:55.174010 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6e963867-ee85-4a8c-b71f-ffc1b0676a22 tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:55.174464 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6e963867-ee85-4a8c-b71f-ffc1b0676a22 tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:55.175032 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6e963867-ee85-4a8c-b71f-ffc1b0676a22 tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:55.201328 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-6e963867-ee85-4a8c-b71f-ffc1b0676a22 tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] [instance: 3b8abc08-2a0d-44a6-bdee-3b356bcfb7a1] Going to try to terminate instance {{(pid=123595) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:31:55.332763 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-eadbff3f-b26a-4ef4-b931-631ad94ef5e4 tempest-QuotasAdminTestV257-783260342 tempest-QuotasAdminTestV257-783260342-project-admin] Action: 'update', calling method: .version_select at 0x7fb2247041f0>, body: {"quota_set": {"ram": "5120"}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:31:55.346083 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-6e963867-ee85-4a8c-b71f-ffc1b0676a22 tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] 10.222.0.43 "DELETE /compute/v2.1/servers/3b8abc08-2a0d-44a6-bdee-3b356bcfb7a1" status: 204 len: 0 microversion: 2.1 time: 0.184753 Oct 04 18:31:55.349945 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 87/180] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 18:31:55 2022] DELETE /compute/v2.1/servers/3b8abc08-2a0d-44a6-bdee-3b356bcfb7a1 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:31:55.428051 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-eadbff3f-b26a-4ef4-b931-631ad94ef5e4 tempest-QuotasAdminTestV257-783260342 tempest-QuotasAdminTestV257-783260342-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:55.431409 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-eadbff3f-b26a-4ef4-b931-631ad94ef5e4 tempest-QuotasAdminTestV257-783260342 tempest-QuotasAdminTestV257-783260342-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:55.432042 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-eadbff3f-b26a-4ef4-b931-631ad94ef5e4 tempest-QuotasAdminTestV257-783260342 tempest-QuotasAdminTestV257-783260342-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:55.436412 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-13712210-61e4-46ad-8184-7c4a6b943a5c tempest-HypervisorAdminTestJSON-1887154395 tempest-HypervisorAdminTestJSON-1887154395-project-admin] Calling method '.version_select at 0x7fb2248bf160>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:55.437720 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-eadbff3f-b26a-4ef4-b931-631ad94ef5e4 tempest-QuotasAdminTestV257-783260342 tempest-QuotasAdminTestV257-783260342-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:55.438274 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-eadbff3f-b26a-4ef4-b931-631ad94ef5e4 tempest-QuotasAdminTestV257-783260342 tempest-QuotasAdminTestV257-783260342-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:55.438495 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-13712210-61e4-46ad-8184-7c4a6b943a5c tempest-HypervisorAdminTestJSON-1887154395 tempest-HypervisorAdminTestJSON-1887154395-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:55.438837 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-eadbff3f-b26a-4ef4-b931-631ad94ef5e4 tempest-QuotasAdminTestV257-783260342 tempest-QuotasAdminTestV257-783260342-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:55.438979 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-13712210-61e4-46ad-8184-7c4a6b943a5c tempest-HypervisorAdminTestJSON-1887154395 tempest-HypervisorAdminTestJSON-1887154395-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:55.439419 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-13712210-61e4-46ad-8184-7c4a6b943a5c tempest-HypervisorAdminTestJSON-1887154395 tempest-HypervisorAdminTestJSON-1887154395-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:55.454369 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-13712210-61e4-46ad-8184-7c4a6b943a5c tempest-HypervisorAdminTestJSON-1887154395 tempest-HypervisorAdminTestJSON-1887154395-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:55.455082 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-13712210-61e4-46ad-8184-7c4a6b943a5c tempest-HypervisorAdminTestJSON-1887154395 tempest-HypervisorAdminTestJSON-1887154395-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:55.455530 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-13712210-61e4-46ad-8184-7c4a6b943a5c tempest-HypervisorAdminTestJSON-1887154395 tempest-HypervisorAdminTestJSON-1887154395-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:55.469834 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-13712210-61e4-46ad-8184-7c4a6b943a5c tempest-HypervisorAdminTestJSON-1887154395 tempest-HypervisorAdminTestJSON-1887154395-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:55.471004 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-13712210-61e4-46ad-8184-7c4a6b943a5c tempest-HypervisorAdminTestJSON-1887154395 tempest-HypervisorAdminTestJSON-1887154395-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:55.472220 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-13712210-61e4-46ad-8184-7c4a6b943a5c tempest-HypervisorAdminTestJSON-1887154395 tempest-HypervisorAdminTestJSON-1887154395-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:55.486586 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-13712210-61e4-46ad-8184-7c4a6b943a5c tempest-HypervisorAdminTestJSON-1887154395 tempest-HypervisorAdminTestJSON-1887154395-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.138427 Oct 04 18:31:55.494716 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 88/181] 10.222.0.43 () {58 vars in 1146 bytes} [Tue Oct 4 18:31:55 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:31:55.500036 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-d0752ef7-2de8-4903-8c24-5791ca34fe39 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:55.505692 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-d0752ef7-2de8-4903-8c24-5791ca34fe39 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a7db99f361654711bea7f1b2c404d312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7adedcdb9c3485ea2738c00e25aa3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:55.507155 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-d0752ef7-2de8-4903-8c24-5791ca34fe39 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Searching by: {'deleted': False, 'project_id': 'e7adedcdb9c3485ea2738c00e25aa3fd'} {{(pid=123595) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:31:55.530438 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d0752ef7-2de8-4903-8c24-5791ca34fe39 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:55.531337 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d0752ef7-2de8-4903-8c24-5791ca34fe39 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:55.531795 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d0752ef7-2de8-4903-8c24-5791ca34fe39 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:55.532600 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d0752ef7-2de8-4903-8c24-5791ca34fe39 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:55.533057 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d0752ef7-2de8-4903-8c24-5791ca34fe39 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:55.533514 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d0752ef7-2de8-4903-8c24-5791ca34fe39 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:55.724377 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-eadbff3f-b26a-4ef4-b931-631ad94ef5e4 tempest-QuotasAdminTestV257-783260342 tempest-QuotasAdminTestV257-783260342-project-admin] 10.222.0.43 "PUT /compute/v2.1/os-quota-sets/d503155b0ea04423a2e962276ad3cc8d" status: 200 len: 148 microversion: 2.57 time: 0.603436 Oct 04 18:31:55.731827 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 94/182] 10.222.0.43 () {62 vars in 1303 bytes} [Tue Oct 4 18:31:55 2022] PUT /compute/v2.1/os-quota-sets/d503155b0ea04423a2e962276ad3cc8d => generated 148 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:31:55.735262 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-592ad3f1-9431-4760-9554-b5f000b2e994 tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:55.750902 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-592ad3f1-9431-4760-9554-b5f000b2e994 tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] [instance: 3b8abc08-2a0d-44a6-bdee-3b356bcfb7a1] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:55.773919 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-592ad3f1-9431-4760-9554-b5f000b2e994 tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:55.774819 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-592ad3f1-9431-4760-9554-b5f000b2e994 tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:55.775576 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-592ad3f1-9431-4760-9554-b5f000b2e994 tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:55.776868 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-592ad3f1-9431-4760-9554-b5f000b2e994 tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:55.778296 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-592ad3f1-9431-4760-9554-b5f000b2e994 tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:55.786476 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-592ad3f1-9431-4760-9554-b5f000b2e994 tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:55.800656 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.multi_cell_list [None req-d0752ef7-2de8-4903-8c24-5791ca34fe39 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Listed batch of 1 results from cell out of 998 limit. Returned 1 total so far. {{(pid=123595) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 18:31:55.974514 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-592ad3f1-9431-4760-9554-b5f000b2e994 tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99862180a0f2408c806bab348d78709a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21d25b0c2c34c33ab70844c8bf0cf97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:55.979018 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-d0752ef7-2de8-4903-8c24-5791ca34fe39 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] 10.222.0.43 "GET /compute/v2.1/servers" status: 200 len: 1004 microversion: 2.1 time: 0.482833 Oct 04 18:31:55.980807 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 89/183] 10.222.0.43 () {58 vars in 1125 bytes} [Tue Oct 4 18:31:55 2022] GET /compute/v2.1/servers => generated 1004 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:55.989696 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-7e947a53-114c-4c45-9dee-cc3ba1ff1400 tempest-HypervisorAdminTestJSON-1887154395 tempest-HypervisorAdminTestJSON-1887154395-project-admin] Calling method '.version_select at 0x7fb224bb3040>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:55.993601 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7e947a53-114c-4c45-9dee-cc3ba1ff1400 tempest-HypervisorAdminTestJSON-1887154395 tempest-HypervisorAdminTestJSON-1887154395-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:55.994409 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7e947a53-114c-4c45-9dee-cc3ba1ff1400 tempest-HypervisorAdminTestJSON-1887154395 tempest-HypervisorAdminTestJSON-1887154395-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:55.995156 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7e947a53-114c-4c45-9dee-cc3ba1ff1400 tempest-HypervisorAdminTestJSON-1887154395 tempest-HypervisorAdminTestJSON-1887154395-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:55.995683 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-592ad3f1-9431-4760-9554-b5f000b2e994 tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] 10.222.0.43 "GET /compute/v2.1/servers/3b8abc08-2a0d-44a6-bdee-3b356bcfb7a1" status: 200 len: 1494 microversion: 2.1 time: 0.268601 Oct 04 18:31:55.996838 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 95/184] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:55 2022] GET /compute/v2.1/servers/3b8abc08-2a0d-44a6-bdee-3b356bcfb7a1 => generated 1494 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:56.002121 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-43436163-b469-4306-9ae1-2d88cbe9234e tempest-QuotasAdminTestV257-783260342 tempest-QuotasAdminTestV257-783260342-project-admin] Calling method '.version_select at 0x7fb224948dc0>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:56.038706 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7e947a53-114c-4c45-9dee-cc3ba1ff1400 tempest-HypervisorAdminTestJSON-1887154395 tempest-HypervisorAdminTestJSON-1887154395-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:56.040160 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7e947a53-114c-4c45-9dee-cc3ba1ff1400 tempest-HypervisorAdminTestJSON-1887154395 tempest-HypervisorAdminTestJSON-1887154395-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:56.045017 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7e947a53-114c-4c45-9dee-cc3ba1ff1400 tempest-HypervisorAdminTestJSON-1887154395 tempest-HypervisorAdminTestJSON-1887154395-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:56.070469 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7e947a53-114c-4c45-9dee-cc3ba1ff1400 tempest-HypervisorAdminTestJSON-1887154395 tempest-HypervisorAdminTestJSON-1887154395-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:56.071428 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7e947a53-114c-4c45-9dee-cc3ba1ff1400 tempest-HypervisorAdminTestJSON-1887154395 tempest-HypervisorAdminTestJSON-1887154395-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:56.071699 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7e947a53-114c-4c45-9dee-cc3ba1ff1400 tempest-HypervisorAdminTestJSON-1887154395 tempest-HypervisorAdminTestJSON-1887154395-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:56.082519 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-7e947a53-114c-4c45-9dee-cc3ba1ff1400 tempest-HypervisorAdminTestJSON-1887154395 tempest-HypervisorAdminTestJSON-1887154395-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1509 microversion: 2.1 time: 0.099818 Oct 04 18:31:56.084974 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 90/185] 10.222.0.43 () {58 vars in 1167 bytes} [Tue Oct 4 18:31:55 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1509 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:56.090788 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-8e68a2fb-ecaa-4c5d-9a97-41145614436d tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:56.092417 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-8e68a2fb-ecaa-4c5d-9a97-41145614436d tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] [instance: 968f1c40-0d51-403e-9609-8eb62b9060bb] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:56.102873 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8e68a2fb-ecaa-4c5d-9a97-41145614436d tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:56.103697 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8e68a2fb-ecaa-4c5d-9a97-41145614436d tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:56.104803 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8e68a2fb-ecaa-4c5d-9a97-41145614436d tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:56.106843 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8e68a2fb-ecaa-4c5d-9a97-41145614436d tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:56.107642 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8e68a2fb-ecaa-4c5d-9a97-41145614436d tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:56.108572 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8e68a2fb-ecaa-4c5d-9a97-41145614436d tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:56.133835 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-43436163-b469-4306-9ae1-2d88cbe9234e tempest-QuotasAdminTestV257-783260342 tempest-QuotasAdminTestV257-783260342-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:56.135056 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-43436163-b469-4306-9ae1-2d88cbe9234e tempest-QuotasAdminTestV257-783260342 tempest-QuotasAdminTestV257-783260342-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:56.138509 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-43436163-b469-4306-9ae1-2d88cbe9234e tempest-QuotasAdminTestV257-783260342 tempest-QuotasAdminTestV257-783260342-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:56.139692 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-43436163-b469-4306-9ae1-2d88cbe9234e tempest-QuotasAdminTestV257-783260342 tempest-QuotasAdminTestV257-783260342-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:56.140471 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-43436163-b469-4306-9ae1-2d88cbe9234e tempest-QuotasAdminTestV257-783260342 tempest-QuotasAdminTestV257-783260342-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:56.141186 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-43436163-b469-4306-9ae1-2d88cbe9234e tempest-QuotasAdminTestV257-783260342 tempest-QuotasAdminTestV257-783260342-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:56.165817 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-43436163-b469-4306-9ae1-2d88cbe9234e tempest-QuotasAdminTestV257-783260342 tempest-QuotasAdminTestV257-783260342-project-admin] 10.222.0.43 "GET /compute/v2.1/os-quota-sets/d503155b0ea04423a2e962276ad3cc8d/detail" status: 200 len: 463 microversion: 2.57 time: 0.167693 Oct 04 18:31:56.166445 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 96/186] 10.222.0.43 () {60 vars in 1304 bytes} [Tue Oct 4 18:31:55 2022] GET /compute/v2.1/os-quota-sets/d503155b0ea04423a2e962276ad3cc8d/detail => generated 463 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:31:56.181888 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-071957d6-f73a-4dbb-9eb9-661cf14d871a tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:56.182687 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-071957d6-f73a-4dbb-9eb9-661cf14d871a tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] [instance: c4b812d5-f2ff-41c7-b912-3d19d752340b] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:56.290265 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-071957d6-f73a-4dbb-9eb9-661cf14d871a tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7db99f361654711bea7f1b2c404d312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7adedcdb9c3485ea2738c00e25aa3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:56.299357 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-071957d6-f73a-4dbb-9eb9-661cf14d871a tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] 10.222.0.43 "GET /compute/v2.1/servers/c4b812d5-f2ff-41c7-b912-3d19d752340b" status: 200 len: 1219 microversion: 2.1 time: 0.122019 Oct 04 18:31:56.300634 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 97/187] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:56 2022] GET /compute/v2.1/servers/c4b812d5-f2ff-41c7-b912-3d19d752340b => generated 1219 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:56.305347 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-b149eaf4-f171-453d-8199-fda7b7cdd408 tempest-HypervisorAdminTestJSON-1887154395 tempest-HypervisorAdminTestJSON-1887154395-project-admin] Calling method '.version_select at 0x7fb225ea7d30>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:56.307953 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b149eaf4-f171-453d-8199-fda7b7cdd408 tempest-HypervisorAdminTestJSON-1887154395 tempest-HypervisorAdminTestJSON-1887154395-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:56.308516 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b149eaf4-f171-453d-8199-fda7b7cdd408 tempest-HypervisorAdminTestJSON-1887154395 tempest-HypervisorAdminTestJSON-1887154395-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:56.309544 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b149eaf4-f171-453d-8199-fda7b7cdd408 tempest-HypervisorAdminTestJSON-1887154395 tempest-HypervisorAdminTestJSON-1887154395-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:56.333934 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b149eaf4-f171-453d-8199-fda7b7cdd408 tempest-HypervisorAdminTestJSON-1887154395 tempest-HypervisorAdminTestJSON-1887154395-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:56.334445 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b149eaf4-f171-453d-8199-fda7b7cdd408 tempest-HypervisorAdminTestJSON-1887154395 tempest-HypervisorAdminTestJSON-1887154395-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:56.334943 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b149eaf4-f171-453d-8199-fda7b7cdd408 tempest-HypervisorAdminTestJSON-1887154395 tempest-HypervisorAdminTestJSON-1887154395-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:56.352130 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b149eaf4-f171-453d-8199-fda7b7cdd408 tempest-HypervisorAdminTestJSON-1887154395 tempest-HypervisorAdminTestJSON-1887154395-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:56.352674 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b149eaf4-f171-453d-8199-fda7b7cdd408 tempest-HypervisorAdminTestJSON-1887154395 tempest-HypervisorAdminTestJSON-1887154395-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:56.353147 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b149eaf4-f171-453d-8199-fda7b7cdd408 tempest-HypervisorAdminTestJSON-1887154395 tempest-HypervisorAdminTestJSON-1887154395-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:56.363490 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-b149eaf4-f171-453d-8199-fda7b7cdd408 tempest-HypervisorAdminTestJSON-1887154395 tempest-HypervisorAdminTestJSON-1887154395-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.062079 Oct 04 18:31:56.364141 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 98/188] 10.222.0.43 () {58 vars in 1146 bytes} [Tue Oct 4 18:31:56 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:31:56.370004 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-8ea89d54-dfef-4b75-bd7c-8fa489987469 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:56.370004 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-8ea89d54-dfef-4b75-bd7c-8fa489987469 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] [instance: 9b19b908-7870-477b-9be7-7d260d59b183] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:56.379102 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8ea89d54-dfef-4b75-bd7c-8fa489987469 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:56.379708 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8ea89d54-dfef-4b75-bd7c-8fa489987469 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:56.380154 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8ea89d54-dfef-4b75-bd7c-8fa489987469 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:56.380872 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8ea89d54-dfef-4b75-bd7c-8fa489987469 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:56.381584 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8ea89d54-dfef-4b75-bd7c-8fa489987469 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:56.382018 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8ea89d54-dfef-4b75-bd7c-8fa489987469 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:56.453432 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-8e68a2fb-ecaa-4c5d-9a97-41145614436d tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '459e65f14af049bba311453d6a86360b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1753b9ee9a644e409a1efd0c9e7c152c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:56.463332 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-8e68a2fb-ecaa-4c5d-9a97-41145614436d tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] 10.222.0.43 "GET /compute/v2.1/servers/968f1c40-0d51-403e-9609-8eb62b9060bb" status: 200 len: 1475 microversion: 2.1 time: 0.376997 Oct 04 18:31:56.477144 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 91/189] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:56 2022] GET /compute/v2.1/servers/968f1c40-0d51-403e-9609-8eb62b9060bb => generated 1475 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:56.477144 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-d56546f7-93fd-4908-b415-108eb5bf8f77 tempest-HypervisorAdminTestJSON-1887154395 tempest-HypervisorAdminTestJSON-1887154395-project-admin] Calling method '.version_select at 0x7fb225ea3d30>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:56.477144 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d56546f7-93fd-4908-b415-108eb5bf8f77 tempest-HypervisorAdminTestJSON-1887154395 tempest-HypervisorAdminTestJSON-1887154395-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:56.477144 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d56546f7-93fd-4908-b415-108eb5bf8f77 tempest-HypervisorAdminTestJSON-1887154395 tempest-HypervisorAdminTestJSON-1887154395-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:56.477550 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d56546f7-93fd-4908-b415-108eb5bf8f77 tempest-HypervisorAdminTestJSON-1887154395 tempest-HypervisorAdminTestJSON-1887154395-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:56.497530 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d56546f7-93fd-4908-b415-108eb5bf8f77 tempest-HypervisorAdminTestJSON-1887154395 tempest-HypervisorAdminTestJSON-1887154395-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:56.498130 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d56546f7-93fd-4908-b415-108eb5bf8f77 tempest-HypervisorAdminTestJSON-1887154395 tempest-HypervisorAdminTestJSON-1887154395-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:56.498546 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d56546f7-93fd-4908-b415-108eb5bf8f77 tempest-HypervisorAdminTestJSON-1887154395 tempest-HypervisorAdminTestJSON-1887154395-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:56.507221 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-d56546f7-93fd-4908-b415-108eb5bf8f77 tempest-HypervisorAdminTestJSON-1887154395 tempest-HypervisorAdminTestJSON-1887154395-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 760 microversion: 2.1 time: 0.041857 Oct 04 18:31:56.508142 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 92/190] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Oct 4 18:31:56 2022] GET /compute/v2.1/os-hypervisors/1 => generated 760 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:31:56.513192 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-c5f05b56-3361-4c49-8e95-269530cb5321 tempest-QuotasAdminTestV257-783260342 tempest-QuotasAdminTestV257-783260342-project-admin] Action: 'update', calling method: .version_select at 0x7fb224a52700>, body: {"quota_set": {"ram": "2048"}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:31:56.600529 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c5f05b56-3361-4c49-8e95-269530cb5321 tempest-QuotasAdminTestV257-783260342 tempest-QuotasAdminTestV257-783260342-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:56.601236 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c5f05b56-3361-4c49-8e95-269530cb5321 tempest-QuotasAdminTestV257-783260342 tempest-QuotasAdminTestV257-783260342-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:56.601806 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c5f05b56-3361-4c49-8e95-269530cb5321 tempest-QuotasAdminTestV257-783260342 tempest-QuotasAdminTestV257-783260342-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:56.602617 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c5f05b56-3361-4c49-8e95-269530cb5321 tempest-QuotasAdminTestV257-783260342 tempest-QuotasAdminTestV257-783260342-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:56.603479 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c5f05b56-3361-4c49-8e95-269530cb5321 tempest-QuotasAdminTestV257-783260342 tempest-QuotasAdminTestV257-783260342-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:56.604119 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c5f05b56-3361-4c49-8e95-269530cb5321 tempest-QuotasAdminTestV257-783260342 tempest-QuotasAdminTestV257-783260342-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:56.616875 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-8ea89d54-dfef-4b75-bd7c-8fa489987469 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ea2088d8124b149187a1c140d3be88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82c615a05e8a4cd086f2e580529fb1d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:56.628848 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-8ea89d54-dfef-4b75-bd7c-8fa489987469 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] 10.222.0.43 "GET /compute/v2.1/servers/9b19b908-7870-477b-9be7-7d260d59b183" status: 200 len: 1410 microversion: 2.1 time: 0.263645 Oct 04 18:31:56.632132 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 99/191] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:56 2022] GET /compute/v2.1/servers/9b19b908-7870-477b-9be7-7d260d59b183 => generated 1410 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:56.645094 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-ba5b9c1d-a889-4e8f-a562-608d03b129fa tempest-HypervisorAdminTestJSON-1887154395 tempest-HypervisorAdminTestJSON-1887154395-project-admin] Calling method '.version_select at 0x7fb224704280>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:56.648523 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ba5b9c1d-a889-4e8f-a562-608d03b129fa tempest-HypervisorAdminTestJSON-1887154395 tempest-HypervisorAdminTestJSON-1887154395-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:56.649349 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ba5b9c1d-a889-4e8f-a562-608d03b129fa tempest-HypervisorAdminTestJSON-1887154395 tempest-HypervisorAdminTestJSON-1887154395-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:56.650891 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ba5b9c1d-a889-4e8f-a562-608d03b129fa tempest-HypervisorAdminTestJSON-1887154395 tempest-HypervisorAdminTestJSON-1887154395-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:56.675361 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-ba5b9c1d-a889-4e8f-a562-608d03b129fa tempest-HypervisorAdminTestJSON-1887154395 tempest-HypervisorAdminTestJSON-1887154395-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 263 microversion: 2.1 time: 0.042072 Oct 04 18:31:56.680940 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 100/192] 10.222.0.43 () {58 vars in 1179 bytes} [Tue Oct 4 18:31:56 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 263 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:31:56.681263 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c5f05b56-3361-4c49-8e95-269530cb5321 tempest-QuotasAdminTestV257-783260342 tempest-QuotasAdminTestV257-783260342-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:56.681263 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c5f05b56-3361-4c49-8e95-269530cb5321 tempest-QuotasAdminTestV257-783260342 tempest-QuotasAdminTestV257-783260342-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:56.681263 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c5f05b56-3361-4c49-8e95-269530cb5321 tempest-QuotasAdminTestV257-783260342 tempest-QuotasAdminTestV257-783260342-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:56.681263 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c5f05b56-3361-4c49-8e95-269530cb5321 tempest-QuotasAdminTestV257-783260342 tempest-QuotasAdminTestV257-783260342-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:56.681824 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c5f05b56-3361-4c49-8e95-269530cb5321 tempest-QuotasAdminTestV257-783260342 tempest-QuotasAdminTestV257-783260342-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:56.681824 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c5f05b56-3361-4c49-8e95-269530cb5321 tempest-QuotasAdminTestV257-783260342 tempest-QuotasAdminTestV257-783260342-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:56.692466 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:31:56.695917 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-4b99bb46-3634-4a1e-95ca-a9c64675bdd9 tempest-HypervisorAdminTestJSON-1887154395 tempest-HypervisorAdminTestJSON-1887154395-project-admin] Calling method '.version_select at 0x7fb224704dc0>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:56.698935 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4b99bb46-3634-4a1e-95ca-a9c64675bdd9 tempest-HypervisorAdminTestJSON-1887154395 tempest-HypervisorAdminTestJSON-1887154395-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:56.700196 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4b99bb46-3634-4a1e-95ca-a9c64675bdd9 tempest-HypervisorAdminTestJSON-1887154395 tempest-HypervisorAdminTestJSON-1887154395-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:56.700956 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4b99bb46-3634-4a1e-95ca-a9c64675bdd9 tempest-HypervisorAdminTestJSON-1887154395 tempest-HypervisorAdminTestJSON-1887154395-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:56.720893 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4b99bb46-3634-4a1e-95ca-a9c64675bdd9 tempest-HypervisorAdminTestJSON-1887154395 tempest-HypervisorAdminTestJSON-1887154395-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:56.721740 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4b99bb46-3634-4a1e-95ca-a9c64675bdd9 tempest-HypervisorAdminTestJSON-1887154395 tempest-HypervisorAdminTestJSON-1887154395-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:56.722504 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4b99bb46-3634-4a1e-95ca-a9c64675bdd9 tempest-HypervisorAdminTestJSON-1887154395 tempest-HypervisorAdminTestJSON-1887154395-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:56.737383 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4b99bb46-3634-4a1e-95ca-a9c64675bdd9 tempest-HypervisorAdminTestJSON-1887154395 tempest-HypervisorAdminTestJSON-1887154395-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:56.737972 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4b99bb46-3634-4a1e-95ca-a9c64675bdd9 tempest-HypervisorAdminTestJSON-1887154395 tempest-HypervisorAdminTestJSON-1887154395-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:56.738480 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4b99bb46-3634-4a1e-95ca-a9c64675bdd9 tempest-HypervisorAdminTestJSON-1887154395 tempest-HypervisorAdminTestJSON-1887154395-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:56.745285 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-4b99bb46-3634-4a1e-95ca-a9c64675bdd9 tempest-HypervisorAdminTestJSON-1887154395 tempest-HypervisorAdminTestJSON-1887154395-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.055055 Oct 04 18:31:56.749158 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 101/193] 10.222.0.43 () {58 vars in 1146 bytes} [Tue Oct 4 18:31:56 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:31:56.757594 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-7938be64-a25d-475e-aca8-7f2b55a85af5 tempest-HypervisorAdminTestJSON-1887154395 tempest-HypervisorAdminTestJSON-1887154395-project-admin] Calling method '.version_select at 0x7fb2247049d0>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:56.759766 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7938be64-a25d-475e-aca8-7f2b55a85af5 tempest-HypervisorAdminTestJSON-1887154395 tempest-HypervisorAdminTestJSON-1887154395-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:56.760401 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7938be64-a25d-475e-aca8-7f2b55a85af5 tempest-HypervisorAdminTestJSON-1887154395 tempest-HypervisorAdminTestJSON-1887154395-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:56.761019 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7938be64-a25d-475e-aca8-7f2b55a85af5 tempest-HypervisorAdminTestJSON-1887154395 tempest-HypervisorAdminTestJSON-1887154395-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:56.770178 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-c5f05b56-3361-4c49-8e95-269530cb5321 tempest-QuotasAdminTestV257-783260342 tempest-QuotasAdminTestV257-783260342-project-admin] 10.222.0.43 "PUT /compute/v2.1/os-quota-sets/d503155b0ea04423a2e962276ad3cc8d?user_id=d47a88c0ed77437c978f4a86c10ecbf9" status: 200 len: 148 microversion: 2.57 time: 0.259726 Oct 04 18:31:56.771439 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 93/194] 10.222.0.43 () {62 vars in 1384 bytes} [Tue Oct 4 18:31:56 2022] PUT /compute/v2.1/os-quota-sets/d503155b0ea04423a2e962276ad3cc8d?user_id=d47a88c0ed77437c978f4a86c10ecbf9 => generated 148 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:31:56.787985 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7938be64-a25d-475e-aca8-7f2b55a85af5 tempest-HypervisorAdminTestJSON-1887154395 tempest-HypervisorAdminTestJSON-1887154395-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:56.789329 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7938be64-a25d-475e-aca8-7f2b55a85af5 tempest-HypervisorAdminTestJSON-1887154395 tempest-HypervisorAdminTestJSON-1887154395-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:56.790385 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7938be64-a25d-475e-aca8-7f2b55a85af5 tempest-HypervisorAdminTestJSON-1887154395 tempest-HypervisorAdminTestJSON-1887154395-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:56.795788 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-8c3d2afc-3fcf-436a-a745-a33383cdbe67 tempest-QuotasAdminTestV257-783260342 tempest-QuotasAdminTestV257-783260342-project-admin] Calling method '.version_select at 0x7fb2247c8dc0>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:56.797435 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:31:56.814825 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-7938be64-a25d-475e-aca8-7f2b55a85af5 tempest-HypervisorAdminTestJSON-1887154395 tempest-HypervisorAdminTestJSON-1887154395-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 760 microversion: 2.1 time: 0.061218 Oct 04 18:31:56.816143 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 102/195] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Oct 4 18:31:56 2022] GET /compute/v2.1/os-hypervisors/1 => generated 760 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:31:56.839239 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-d85c5988-9710-4b4d-a0b8-77e4aaaae0c1 tempest-HypervisorAdminTestJSON-1887154395 tempest-HypervisorAdminTestJSON-1887154395-project-admin] Calling method '.version_select at 0x7fb224704a60>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:56.842447 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d85c5988-9710-4b4d-a0b8-77e4aaaae0c1 tempest-HypervisorAdminTestJSON-1887154395 tempest-HypervisorAdminTestJSON-1887154395-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:56.843095 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d85c5988-9710-4b4d-a0b8-77e4aaaae0c1 tempest-HypervisorAdminTestJSON-1887154395 tempest-HypervisorAdminTestJSON-1887154395-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:56.843684 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d85c5988-9710-4b4d-a0b8-77e4aaaae0c1 tempest-HypervisorAdminTestJSON-1887154395 tempest-HypervisorAdminTestJSON-1887154395-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:56.865174 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d85c5988-9710-4b4d-a0b8-77e4aaaae0c1 tempest-HypervisorAdminTestJSON-1887154395 tempest-HypervisorAdminTestJSON-1887154395-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:56.870339 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d85c5988-9710-4b4d-a0b8-77e4aaaae0c1 tempest-HypervisorAdminTestJSON-1887154395 tempest-HypervisorAdminTestJSON-1887154395-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:56.870887 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d85c5988-9710-4b4d-a0b8-77e4aaaae0c1 tempest-HypervisorAdminTestJSON-1887154395 tempest-HypervisorAdminTestJSON-1887154395-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:56.878783 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-d85c5988-9710-4b4d-a0b8-77e4aaaae0c1 tempest-HypervisorAdminTestJSON-1887154395 tempest-HypervisorAdminTestJSON-1887154395-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 760 microversion: 2.1 time: 0.044401 Oct 04 18:31:56.879841 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 103/196] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Oct 4 18:31:56 2022] GET /compute/v2.1/os-hypervisors/2 => generated 760 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:31:56.893483 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-8c3d2afc-3fcf-436a-a745-a33383cdbe67 tempest-QuotasAdminTestV257-783260342 tempest-QuotasAdminTestV257-783260342-project-admin] 10.222.0.43 "GET /compute/v2.1/os-quota-sets/d503155b0ea04423a2e962276ad3cc8d?user_id=d47a88c0ed77437c978f4a86c10ecbf9" status: 200 len: 190 microversion: 2.57 time: 0.113790 Oct 04 18:31:56.894270 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 94/197] 10.222.0.43 () {60 vars in 1364 bytes} [Tue Oct 4 18:31:56 2022] GET /compute/v2.1/os-quota-sets/d503155b0ea04423a2e962276ad3cc8d?user_id=d47a88c0ed77437c978f4a86c10ecbf9 => generated 190 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 18:31:56.894738 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-13b943da-e1f5-4c92-aff8-cf6e2bacf788 tempest-HypervisorAdminTestJSON-1887154395 tempest-HypervisorAdminTestJSON-1887154395-project-admin] Calling method '.version_select at 0x7fb225b43ee0>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:56.896422 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-13b943da-e1f5-4c92-aff8-cf6e2bacf788 tempest-HypervisorAdminTestJSON-1887154395 tempest-HypervisorAdminTestJSON-1887154395-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:56.896935 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-13b943da-e1f5-4c92-aff8-cf6e2bacf788 tempest-HypervisorAdminTestJSON-1887154395 tempest-HypervisorAdminTestJSON-1887154395-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:56.897418 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-13b943da-e1f5-4c92-aff8-cf6e2bacf788 tempest-HypervisorAdminTestJSON-1887154395 tempest-HypervisorAdminTestJSON-1887154395-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:56.925009 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-13b943da-e1f5-4c92-aff8-cf6e2bacf788 tempest-HypervisorAdminTestJSON-1887154395 tempest-HypervisorAdminTestJSON-1887154395-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:56.925845 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-13b943da-e1f5-4c92-aff8-cf6e2bacf788 tempest-HypervisorAdminTestJSON-1887154395 tempest-HypervisorAdminTestJSON-1887154395-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:56.925963 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-13b943da-e1f5-4c92-aff8-cf6e2bacf788 tempest-HypervisorAdminTestJSON-1887154395 tempest-HypervisorAdminTestJSON-1887154395-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:56.941834 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-13b943da-e1f5-4c92-aff8-cf6e2bacf788 tempest-HypervisorAdminTestJSON-1887154395 tempest-HypervisorAdminTestJSON-1887154395-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:56.942496 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-13b943da-e1f5-4c92-aff8-cf6e2bacf788 tempest-HypervisorAdminTestJSON-1887154395 tempest-HypervisorAdminTestJSON-1887154395-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:56.942930 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-13b943da-e1f5-4c92-aff8-cf6e2bacf788 tempest-HypervisorAdminTestJSON-1887154395 tempest-HypervisorAdminTestJSON-1887154395-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:56.992710 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-13b943da-e1f5-4c92-aff8-cf6e2bacf788 tempest-HypervisorAdminTestJSON-1887154395 tempest-HypervisorAdminTestJSON-1887154395-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 176 microversion: 2.1 time: 0.101180 Oct 04 18:31:56.993764 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 104/198] 10.222.0.43 () {58 vars in 1173 bytes} [Tue Oct 4 18:31:56 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 176 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:31:57.035002 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-12e3ce58-a58e-43c1-baec-c835d50fa2fe tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:57.035724 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-12e3ce58-a58e-43c1-baec-c835d50fa2fe tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] [instance: 3b8abc08-2a0d-44a6-bdee-3b356bcfb7a1] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:57.053122 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-12e3ce58-a58e-43c1-baec-c835d50fa2fe tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:57.053642 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-12e3ce58-a58e-43c1-baec-c835d50fa2fe tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:57.054493 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-12e3ce58-a58e-43c1-baec-c835d50fa2fe tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:57.056481 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-12e3ce58-a58e-43c1-baec-c835d50fa2fe tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:57.057419 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-12e3ce58-a58e-43c1-baec-c835d50fa2fe tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:57.058178 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-12e3ce58-a58e-43c1-baec-c835d50fa2fe tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:57.064159 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-c753d750-6288-44e9-bb57-4c84b0cbfa61 req-82f79952-0624-4622-9e2e-8a58ba3e62da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "968f1c40-0d51-403e-9609-8eb62b9060bb", "name": "network-vif-deleted", "tag": "cc38f863-bfa1-46ba-a469-894c955bcca9"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:31:57.155631 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-c753d750-6288-44e9-bb57-4c84b0cbfa61 req-82f79952-0624-4622-9e2e-8a58ba3e62da service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:57.156905 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-c753d750-6288-44e9-bb57-4c84b0cbfa61 req-82f79952-0624-4622-9e2e-8a58ba3e62da service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:57.157539 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-c753d750-6288-44e9-bb57-4c84b0cbfa61 req-82f79952-0624-4622-9e2e-8a58ba3e62da service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:57.174346 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-c753d750-6288-44e9-bb57-4c84b0cbfa61 req-82f79952-0624-4622-9e2e-8a58ba3e62da service nova] Creating event network-vif-deleted:cc38f863-bfa1-46ba-a469-894c955bcca9 for instance 968f1c40-0d51-403e-9609-8eb62b9060bb on n-h1-851028-13 Oct 04 18:31:57.179905 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-c753d750-6288-44e9-bb57-4c84b0cbfa61 req-82f79952-0624-4622-9e2e-8a58ba3e62da service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121936 Oct 04 18:31:57.181021 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 105/199] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:31:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:31:57.289383 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-12e3ce58-a58e-43c1-baec-c835d50fa2fe tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99862180a0f2408c806bab348d78709a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21d25b0c2c34c33ab70844c8bf0cf97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:57.299039 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-12e3ce58-a58e-43c1-baec-c835d50fa2fe tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] 10.222.0.43 "GET /compute/v2.1/servers/3b8abc08-2a0d-44a6-bdee-3b356bcfb7a1" status: 200 len: 1494 microversion: 2.1 time: 0.268392 Oct 04 18:31:57.303204 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 95/200] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:57 2022] GET /compute/v2.1/servers/3b8abc08-2a0d-44a6-bdee-3b356bcfb7a1 => generated 1494 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:57.328254 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-bd483d88-7ee2-4ed5-9002-8c5b2ffae219 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:57.329332 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-bd483d88-7ee2-4ed5-9002-8c5b2ffae219 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] [instance: c4b812d5-f2ff-41c7-b912-3d19d752340b] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:57.344750 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bd483d88-7ee2-4ed5-9002-8c5b2ffae219 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:57.345278 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bd483d88-7ee2-4ed5-9002-8c5b2ffae219 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:57.345844 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bd483d88-7ee2-4ed5-9002-8c5b2ffae219 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:57.346626 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bd483d88-7ee2-4ed5-9002-8c5b2ffae219 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:57.347153 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bd483d88-7ee2-4ed5-9002-8c5b2ffae219 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:57.347701 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bd483d88-7ee2-4ed5-9002-8c5b2ffae219 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:57.488098 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-dbc4e65b-58cb-4ab4-9ec8-a7802746531c tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:57.490195 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-dbc4e65b-58cb-4ab4-9ec8-a7802746531c tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] [instance: 968f1c40-0d51-403e-9609-8eb62b9060bb] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:57.504556 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dbc4e65b-58cb-4ab4-9ec8-a7802746531c tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:57.505180 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dbc4e65b-58cb-4ab4-9ec8-a7802746531c tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:57.505523 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dbc4e65b-58cb-4ab4-9ec8-a7802746531c tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:57.506245 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dbc4e65b-58cb-4ab4-9ec8-a7802746531c tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:57.506761 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dbc4e65b-58cb-4ab4-9ec8-a7802746531c tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:57.507228 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dbc4e65b-58cb-4ab4-9ec8-a7802746531c tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:57.592634 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:31:57.597426 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dbc4e65b-58cb-4ab4-9ec8-a7802746531c tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:57.600387 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dbc4e65b-58cb-4ab4-9ec8-a7802746531c tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:57.601552 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dbc4e65b-58cb-4ab4-9ec8-a7802746531c tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:57.603348 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.objects.instance [None req-dbc4e65b-58cb-4ab4-9ec8-a7802746531c tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lazy-loading 'fault' on Instance uuid 968f1c40-0d51-403e-9609-8eb62b9060bb {{(pid=123595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:31:57.607426 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-bd483d88-7ee2-4ed5-9002-8c5b2ffae219 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7db99f361654711bea7f1b2c404d312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7adedcdb9c3485ea2738c00e25aa3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:57.636003 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-bd483d88-7ee2-4ed5-9002-8c5b2ffae219 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] 10.222.0.43 "GET /compute/v2.1/servers/c4b812d5-f2ff-41c7-b912-3d19d752340b" status: 200 len: 1215 microversion: 2.1 time: 0.314040 Oct 04 18:31:57.646375 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 106/201] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:57 2022] GET /compute/v2.1/servers/c4b812d5-f2ff-41c7-b912-3d19d752340b => generated 1215 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:57.660856 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-e88b12d6-eee2-4e22-b0b8-1eef65c4a66f tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:57.664246 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-e88b12d6-eee2-4e22-b0b8-1eef65c4a66f tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] [instance: 9b19b908-7870-477b-9be7-7d260d59b183] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:57.679077 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e88b12d6-eee2-4e22-b0b8-1eef65c4a66f tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:57.679983 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e88b12d6-eee2-4e22-b0b8-1eef65c4a66f tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:57.680643 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e88b12d6-eee2-4e22-b0b8-1eef65c4a66f tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:57.684385 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e88b12d6-eee2-4e22-b0b8-1eef65c4a66f tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:57.686400 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e88b12d6-eee2-4e22-b0b8-1eef65c4a66f tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:57.687971 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e88b12d6-eee2-4e22-b0b8-1eef65c4a66f tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:57.936881 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-dbc4e65b-58cb-4ab4-9ec8-a7802746531c tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '459e65f14af049bba311453d6a86360b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1753b9ee9a644e409a1efd0c9e7c152c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:57.952669 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-dbc4e65b-58cb-4ab4-9ec8-a7802746531c tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] 10.222.0.43 "GET /compute/v2.1/servers/968f1c40-0d51-403e-9609-8eb62b9060bb" status: 200 len: 1309 microversion: 2.1 time: 0.467631 Oct 04 18:31:57.954855 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 96/202] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:57 2022] GET /compute/v2.1/servers/968f1c40-0d51-403e-9609-8eb62b9060bb => generated 1309 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:58.112950 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-e88b12d6-eee2-4e22-b0b8-1eef65c4a66f tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ea2088d8124b149187a1c140d3be88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82c615a05e8a4cd086f2e580529fb1d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:58.126775 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-e88b12d6-eee2-4e22-b0b8-1eef65c4a66f tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] 10.222.0.43 "GET /compute/v2.1/servers/9b19b908-7870-477b-9be7-7d260d59b183" status: 200 len: 1410 microversion: 2.1 time: 0.469689 Oct 04 18:31:58.141689 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 107/203] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:57 2022] GET /compute/v2.1/servers/9b19b908-7870-477b-9be7-7d260d59b183 => generated 1410 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:31:58.331798 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-560a8055-35da-4756-b651-7ad7ca85d770 tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:58.334358 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-560a8055-35da-4756-b651-7ad7ca85d770 tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] [instance: 3b8abc08-2a0d-44a6-bdee-3b356bcfb7a1] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:58.346235 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-560a8055-35da-4756-b651-7ad7ca85d770 tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:58.349278 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-560a8055-35da-4756-b651-7ad7ca85d770 tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:58.349906 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-560a8055-35da-4756-b651-7ad7ca85d770 tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:58.352223 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-560a8055-35da-4756-b651-7ad7ca85d770 tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:58.352864 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-560a8055-35da-4756-b651-7ad7ca85d770 tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:58.355347 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-560a8055-35da-4756-b651-7ad7ca85d770 tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:58.674230 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f98c092a-f5d9-40f4-acb5-90fee905e96c tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:58.675685 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-f98c092a-f5d9-40f4-acb5-90fee905e96c tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] [instance: c4b812d5-f2ff-41c7-b912-3d19d752340b] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:58.693374 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f98c092a-f5d9-40f4-acb5-90fee905e96c tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:58.694658 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f98c092a-f5d9-40f4-acb5-90fee905e96c tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:58.699804 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f98c092a-f5d9-40f4-acb5-90fee905e96c tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:58.700987 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f98c092a-f5d9-40f4-acb5-90fee905e96c tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:58.701935 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f98c092a-f5d9-40f4-acb5-90fee905e96c tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:58.702453 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f98c092a-f5d9-40f4-acb5-90fee905e96c tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:58.773087 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-560a8055-35da-4756-b651-7ad7ca85d770 tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99862180a0f2408c806bab348d78709a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21d25b0c2c34c33ab70844c8bf0cf97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:58.783373 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-560a8055-35da-4756-b651-7ad7ca85d770 tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] 10.222.0.43 "GET /compute/v2.1/servers/3b8abc08-2a0d-44a6-bdee-3b356bcfb7a1" status: 200 len: 1494 microversion: 2.1 time: 0.455762 Oct 04 18:31:58.784398 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 97/204] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:58 2022] GET /compute/v2.1/servers/3b8abc08-2a0d-44a6-bdee-3b356bcfb7a1 => generated 1494 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:31:58.979715 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-48b8e02e-c3c3-4c4d-be62-e2b7db70928b tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:58.982853 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-48b8e02e-c3c3-4c4d-be62-e2b7db70928b tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] [instance: 968f1c40-0d51-403e-9609-8eb62b9060bb] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:59.010515 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-48b8e02e-c3c3-4c4d-be62-e2b7db70928b tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:59.022890 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-48b8e02e-c3c3-4c4d-be62-e2b7db70928b tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:59.023836 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-48b8e02e-c3c3-4c4d-be62-e2b7db70928b tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:59.024744 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-48b8e02e-c3c3-4c4d-be62-e2b7db70928b tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:59.033628 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-48b8e02e-c3c3-4c4d-be62-e2b7db70928b tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:59.037530 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-48b8e02e-c3c3-4c4d-be62-e2b7db70928b tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:59.126437 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-48b8e02e-c3c3-4c4d-be62-e2b7db70928b tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:59.131352 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-48b8e02e-c3c3-4c4d-be62-e2b7db70928b tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:59.134525 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-48b8e02e-c3c3-4c4d-be62-e2b7db70928b tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:59.136396 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.objects.instance [None req-48b8e02e-c3c3-4c4d-be62-e2b7db70928b tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lazy-loading 'fault' on Instance uuid 968f1c40-0d51-403e-9609-8eb62b9060bb {{(pid=123595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:31:59.191991 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-f98c092a-f5d9-40f4-acb5-90fee905e96c tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7db99f361654711bea7f1b2c404d312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7adedcdb9c3485ea2738c00e25aa3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:59.209229 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-f98c092a-f5d9-40f4-acb5-90fee905e96c tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] 10.222.0.43 "GET /compute/v2.1/servers/c4b812d5-f2ff-41c7-b912-3d19d752340b" status: 200 len: 1289 microversion: 2.1 time: 0.538710 Oct 04 18:31:59.211728 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 108/205] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:58 2022] GET /compute/v2.1/servers/c4b812d5-f2ff-41c7-b912-3d19d752340b => generated 1289 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:59.235515 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-84e2aef1-36b8-470a-a536-d7c390ec06ed tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:59.239399 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-84e2aef1-36b8-470a-a536-d7c390ec06ed tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] [instance: 9b19b908-7870-477b-9be7-7d260d59b183] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:59.256912 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-84e2aef1-36b8-470a-a536-d7c390ec06ed tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:59.262459 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-84e2aef1-36b8-470a-a536-d7c390ec06ed tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:59.263583 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-84e2aef1-36b8-470a-a536-d7c390ec06ed tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:59.266611 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-84e2aef1-36b8-470a-a536-d7c390ec06ed tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:59.268236 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-84e2aef1-36b8-470a-a536-d7c390ec06ed tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:59.271836 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-84e2aef1-36b8-470a-a536-d7c390ec06ed tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:59.342045 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-48b8e02e-c3c3-4c4d-be62-e2b7db70928b tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '459e65f14af049bba311453d6a86360b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1753b9ee9a644e409a1efd0c9e7c152c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:59.352800 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-48b8e02e-c3c3-4c4d-be62-e2b7db70928b tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] 10.222.0.43 "GET /compute/v2.1/servers/968f1c40-0d51-403e-9609-8eb62b9060bb" status: 200 len: 1309 microversion: 2.1 time: 0.375782 Oct 04 18:31:59.369000 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 98/206] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:58 2022] GET /compute/v2.1/servers/968f1c40-0d51-403e-9609-8eb62b9060bb => generated 1309 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:31:59.536369 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-84e2aef1-36b8-470a-a536-d7c390ec06ed tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ea2088d8124b149187a1c140d3be88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82c615a05e8a4cd086f2e580529fb1d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:59.551829 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-84e2aef1-36b8-470a-a536-d7c390ec06ed tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] 10.222.0.43 "GET /compute/v2.1/servers/9b19b908-7870-477b-9be7-7d260d59b183" status: 200 len: 1410 microversion: 2.1 time: 0.338853 Oct 04 18:31:59.552424 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 109/207] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:59 2022] GET /compute/v2.1/servers/9b19b908-7870-477b-9be7-7d260d59b183 => generated 1410 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:59.816166 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-e8c57a71-46d7-4055-9166-bc603c293d29 tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:59.816983 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-e8c57a71-46d7-4055-9166-bc603c293d29 tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] [instance: 3b8abc08-2a0d-44a6-bdee-3b356bcfb7a1] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:59.824621 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e8c57a71-46d7-4055-9166-bc603c293d29 tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:59.825414 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e8c57a71-46d7-4055-9166-bc603c293d29 tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:59.825922 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e8c57a71-46d7-4055-9166-bc603c293d29 tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:59.826962 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e8c57a71-46d7-4055-9166-bc603c293d29 tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:59.835333 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-eb1e217e-da6e-4ea9-b5cf-8c51db5e2148 req-7bbb94b7-513f-4b7d-8f3f-59f98690b5aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b8abc08-2a0d-44a6-bdee-3b356bcfb7a1", "name": "network-vif-deleted", "tag": "01a0afe5-e001-4cdd-8a9a-6146c9782fc2"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:31:59.842772 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e8c57a71-46d7-4055-9166-bc603c293d29 tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:59.843684 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e8c57a71-46d7-4055-9166-bc603c293d29 tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:59.853034 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-eb1e217e-da6e-4ea9-b5cf-8c51db5e2148 req-7bbb94b7-513f-4b7d-8f3f-59f98690b5aa service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:59.856482 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-eb1e217e-da6e-4ea9-b5cf-8c51db5e2148 req-7bbb94b7-513f-4b7d-8f3f-59f98690b5aa service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:59.857329 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-eb1e217e-da6e-4ea9-b5cf-8c51db5e2148 req-7bbb94b7-513f-4b7d-8f3f-59f98690b5aa service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:59.877670 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-eb1e217e-da6e-4ea9-b5cf-8c51db5e2148 req-7bbb94b7-513f-4b7d-8f3f-59f98690b5aa service nova] Creating event network-vif-deleted:01a0afe5-e001-4cdd-8a9a-6146c9782fc2 for instance 3b8abc08-2a0d-44a6-bdee-3b356bcfb7a1 on n-h2-851028-13 Oct 04 18:31:59.884095 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-eb1e217e-da6e-4ea9-b5cf-8c51db5e2148 req-7bbb94b7-513f-4b7d-8f3f-59f98690b5aa service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.341569 Oct 04 18:31:59.889899 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 99/208] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:31:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:31:59.907774 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e8c57a71-46d7-4055-9166-bc603c293d29 tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:59.908495 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e8c57a71-46d7-4055-9166-bc603c293d29 tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:59.908943 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e8c57a71-46d7-4055-9166-bc603c293d29 tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:59.909476 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.objects.instance [None req-e8c57a71-46d7-4055-9166-bc603c293d29 tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Lazy-loading 'fault' on Instance uuid 3b8abc08-2a0d-44a6-bdee-3b356bcfb7a1 {{(pid=123596) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:31:59.988738 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-e8c57a71-46d7-4055-9166-bc603c293d29 tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99862180a0f2408c806bab348d78709a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21d25b0c2c34c33ab70844c8bf0cf97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:00.002808 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-e8c57a71-46d7-4055-9166-bc603c293d29 tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] 10.222.0.43 "GET /compute/v2.1/servers/3b8abc08-2a0d-44a6-bdee-3b356bcfb7a1" status: 200 len: 1328 microversion: 2.1 time: 0.192536 Oct 04 18:32:00.004389 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 110/209] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:59 2022] GET /compute/v2.1/servers/3b8abc08-2a0d-44a6-bdee-3b356bcfb7a1 => generated 1328 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:00.234108 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-4fcec569-a466-4081-9e82-fac897b89606 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:00.236228 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-4fcec569-a466-4081-9e82-fac897b89606 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] [instance: c4b812d5-f2ff-41c7-b912-3d19d752340b] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:00.249810 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4fcec569-a466-4081-9e82-fac897b89606 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:00.270102 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4fcec569-a466-4081-9e82-fac897b89606 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:00.270556 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4fcec569-a466-4081-9e82-fac897b89606 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:00.277026 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4fcec569-a466-4081-9e82-fac897b89606 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:00.277990 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4fcec569-a466-4081-9e82-fac897b89606 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:00.281837 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4fcec569-a466-4081-9e82-fac897b89606 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:00.375964 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-924886aa-217c-4b48-8538-90fa0390e08e tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:00.376532 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-924886aa-217c-4b48-8538-90fa0390e08e tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] [instance: 968f1c40-0d51-403e-9609-8eb62b9060bb] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:00.389397 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-924886aa-217c-4b48-8538-90fa0390e08e tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:00.389899 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-924886aa-217c-4b48-8538-90fa0390e08e tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:00.393521 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-924886aa-217c-4b48-8538-90fa0390e08e tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:00.394283 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-924886aa-217c-4b48-8538-90fa0390e08e tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:00.394751 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-924886aa-217c-4b48-8538-90fa0390e08e tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:00.395177 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-924886aa-217c-4b48-8538-90fa0390e08e tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:00.437273 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-924886aa-217c-4b48-8538-90fa0390e08e tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] HTTP exception thrown: Instance 968f1c40-0d51-403e-9609-8eb62b9060bb could not be found. Oct 04 18:32:00.446267 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-924886aa-217c-4b48-8538-90fa0390e08e tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Request method failure captured: Oct 04 18:32:00.446267 n-d-851028-13 devstack@n-api.service[123596]: request: GET /compute/v2.1/servers/968f1c40-0d51-403e-9609-8eb62b9060bb HTTP/1.1 Oct 04 18:32:00.446267 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:32:00.446267 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:32:00.446267 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:32:00.446267 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 18:32:00.446267 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:32:00.446267 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:32:00.446267 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:32:00.446267 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:32:00.446267 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPHvt3Y6rNVLSMdy9xAbvM1SwrzHCmiOroJJTfX2qOHmf77BMWdMfcNsjcH76qCiZQUjwzTPz2lfj1VfZRsPFlmxuLNjSVGxiKGgUEHY1S2tJ0UdIN5RuK_OrynSy71at-I0VBgCzGqOWM-CuMd25KoO0Uju4Ps6lF9ju13TEpSGJYdM Oct 04 18:32:00.446267 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:32:00.446267 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:32:00.446267 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:32:00.446267 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:32:00.446267 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:32:00.446267 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:32:00.446267 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: 1753b9ee9a644e409a1efd0c9e7c152c Oct 04 18:32:00.446267 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1925649271 Oct 04 18:32:00.446267 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 18:32:00.446267 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 18:32:00.447579 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/1753b9ee9a644e409a1efd0c9e7c152c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_1753b9ee9a644e409a1efd0c9e7c152c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1753b9ee9a644e409a1efd0c9e7c152c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1753b9ee9a644e409a1efd0c9e7c152c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:32:00.447579 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-DeleteServersAdminTestJSON-1925649271 Oct 04 18:32:00.447579 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: 1753b9ee9a644e409a1efd0c9e7c152c Oct 04 18:32:00.447579 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1925649271 Oct 04 18:32:00.447579 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-DeleteServersAdminTestJSON-1925649271-project Oct 04 18:32:00.447579 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:32:00.447579 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:32:00.447579 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 459e65f14af049bba311453d6a86360b Oct 04 18:32:00.447579 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-DeleteServersAdminTestJSON-1925649271-project Oct 04 18:32:00.447579 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 18:32:00.447579 n-d-851028-13 devstack@n-api.service[123596]: exception: Instance 968f1c40-0d51-403e-9609-8eb62b9060bb could not be found. Oct 04 18:32:00.447579 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': '968f1c40-0d51-403e-9609-8eb62b9060bb'} Oct 04 18:32:00.448238 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:32:00.448238 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:00.448238 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:32:00.448238 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:32:00.448238 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:32:00.448238 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:32:00.448238 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:32:00.448238 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:32:00.448238 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:32:00.448238 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:32:00.448238 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 968f1c40-0d51-403e-9609-8eb62b9060bb could not be found. Oct 04 18:32:00.448238 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:32:00.448238 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:00.448238 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:32:00.448238 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:00.448238 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:32:00.448238 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:32:00.448238 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:32:00.448238 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:32:00.448238 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:32:00.449973 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:32:00.449973 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:32:00.449973 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:32:00.449973 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:32:00.449973 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:32:00.449973 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:32:00.449973 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:32:00.449973 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 968f1c40-0d51-403e-9609-8eb62b9060bb could not be found. Oct 04 18:32:00.449973 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:32:00.449973 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:00.449973 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:32:00.449973 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:00.449973 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:32:00.449973 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:32:00.449973 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:32:00.449973 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:32:00.449973 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 968f1c40-0d51-403e-9609-8eb62b9060bb could not be found. Oct 04 18:32:00.449973 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:32:00.453502 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-924886aa-217c-4b48-8538-90fa0390e08e tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Returning 404 to user: Instance 968f1c40-0d51-403e-9609-8eb62b9060bb could not be found. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:32:00.454696 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-924886aa-217c-4b48-8538-90fa0390e08e tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] 10.222.0.43 "GET /compute/v2.1/servers/968f1c40-0d51-403e-9609-8eb62b9060bb" status: 404 len: 111 microversion: 2.1 time: 0.082653 Oct 04 18:32:00.455840 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 111/210] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:00 2022] GET /compute/v2.1/servers/968f1c40-0d51-403e-9609-8eb62b9060bb => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:32:00.558065 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-4fcec569-a466-4081-9e82-fac897b89606 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7db99f361654711bea7f1b2c404d312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7adedcdb9c3485ea2738c00e25aa3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:00.570785 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-4fcec569-a466-4081-9e82-fac897b89606 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] 10.222.0.43 "GET /compute/v2.1/servers/c4b812d5-f2ff-41c7-b912-3d19d752340b" status: 200 len: 1277 microversion: 2.1 time: 0.341225 Oct 04 18:32:00.579522 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-7ce7c8e1-2fee-4bd6-a087-616054133adb tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:00.580707 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-7ce7c8e1-2fee-4bd6-a087-616054133adb tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] [instance: 9b19b908-7870-477b-9be7-7d260d59b183] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:00.586696 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 100/211] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:00 2022] GET /compute/v2.1/servers/c4b812d5-f2ff-41c7-b912-3d19d752340b => generated 1277 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:00.590753 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7ce7c8e1-2fee-4bd6-a087-616054133adb tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:00.592539 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7ce7c8e1-2fee-4bd6-a087-616054133adb tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:00.593481 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7ce7c8e1-2fee-4bd6-a087-616054133adb tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:00.595041 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7ce7c8e1-2fee-4bd6-a087-616054133adb tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:00.595859 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7ce7c8e1-2fee-4bd6-a087-616054133adb tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:00.596340 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7ce7c8e1-2fee-4bd6-a087-616054133adb tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:00.624689 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-b3329f6d-cb5f-4483-ba32-3e83fbb21255 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-750140536", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452"}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:00.713321 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.network.neutron [None req-b3329f6d-cb5f-4483-ba32-3e83fbb21255 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] validate_networks() for None {{(pid=123595) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:32:00.873960 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-7ce7c8e1-2fee-4bd6-a087-616054133adb tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ea2088d8124b149187a1c140d3be88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82c615a05e8a4cd086f2e580529fb1d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:00.887611 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-7ce7c8e1-2fee-4bd6-a087-616054133adb tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] 10.222.0.43 "GET /compute/v2.1/servers/9b19b908-7870-477b-9be7-7d260d59b183" status: 200 len: 1410 microversion: 2.1 time: 0.315280 Oct 04 18:32:00.888537 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 112/212] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:00 2022] GET /compute/v2.1/servers/9b19b908-7870-477b-9be7-7d260d59b183 => generated 1410 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:32:01.033607 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-2253b895-6af8-493c-b842-960c869222cd tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:01.034337 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-2253b895-6af8-493c-b842-960c869222cd tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] [instance: 3b8abc08-2a0d-44a6-bdee-3b356bcfb7a1] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:01.046841 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=3,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:32:01.076352 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2253b895-6af8-493c-b842-960c869222cd tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:01.077464 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2253b895-6af8-493c-b842-960c869222cd tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:01.078304 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2253b895-6af8-493c-b842-960c869222cd tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:01.079440 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2253b895-6af8-493c-b842-960c869222cd tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:01.081607 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2253b895-6af8-493c-b842-960c869222cd tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:01.082754 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2253b895-6af8-493c-b842-960c869222cd tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:01.105302 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-2253b895-6af8-493c-b842-960c869222cd tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] HTTP exception thrown: Instance 3b8abc08-2a0d-44a6-bdee-3b356bcfb7a1 could not be found. Oct 04 18:32:01.107171 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-2253b895-6af8-493c-b842-960c869222cd tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Request method failure captured: Oct 04 18:32:01.107171 n-d-851028-13 devstack@n-api.service[123596]: request: GET /compute/v2.1/servers/3b8abc08-2a0d-44a6-bdee-3b356bcfb7a1 HTTP/1.1 Oct 04 18:32:01.107171 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:32:01.107171 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:32:01.107171 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:32:01.107171 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 18:32:01.107171 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:32:01.107171 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:32:01.107171 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:32:01.107171 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:32:01.107171 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPHvsyFmG_T606P-dfv6KzFhrZkk8yk9-mTKsSQqucUaWYCKPyGbfiZ0bYfXTetWSiXh1RZxYOxCn_uu5T_YkWy7gjml1c8mjSK0P9lItqZ3TCu0BqNr2SwMdgloJOuo0_PaGrXsZS5kZPOqF-lf29AHSEtO1TIeXm7xSmBZ-KbOpN4s Oct 04 18:32:01.107171 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:32:01.107171 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:32:01.107171 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:32:01.107171 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:32:01.107171 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:32:01.107171 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:32:01.107171 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: e21d25b0c2c34c33ab70844c8bf0cf97 Oct 04 18:32:01.107171 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-AggregatesAdminTestJSON-340173063 Oct 04 18:32:01.107171 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 18:32:01.107171 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 18:32:01.108464 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/e21d25b0c2c34c33ab70844c8bf0cf97"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_e21d25b0c2c34c33ab70844c8bf0cf97"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/e21d25b0c2c34c33ab70844c8bf0cf97"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/e21d25b0c2c34c33ab70844c8bf0cf97"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:32:01.108464 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-AggregatesAdminTestJSON-340173063 Oct 04 18:32:01.108464 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: e21d25b0c2c34c33ab70844c8bf0cf97 Oct 04 18:32:01.108464 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-340173063 Oct 04 18:32:01.108464 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-AggregatesAdminTestJSON-340173063-project Oct 04 18:32:01.108464 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:32:01.108464 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:32:01.108464 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 99862180a0f2408c806bab348d78709a Oct 04 18:32:01.108464 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-AggregatesAdminTestJSON-340173063-project Oct 04 18:32:01.108464 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 18:32:01.108464 n-d-851028-13 devstack@n-api.service[123596]: exception: Instance 3b8abc08-2a0d-44a6-bdee-3b356bcfb7a1 could not be found. Oct 04 18:32:01.108464 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': '3b8abc08-2a0d-44a6-bdee-3b356bcfb7a1'} Oct 04 18:32:01.109154 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:32:01.109154 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:01.109154 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:32:01.109154 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:32:01.109154 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:32:01.109154 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:32:01.109154 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:32:01.109154 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:32:01.109154 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:32:01.109154 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:32:01.109154 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b8abc08-2a0d-44a6-bdee-3b356bcfb7a1 could not be found. Oct 04 18:32:01.109154 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:32:01.109154 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:01.109154 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:32:01.109154 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:01.109154 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:32:01.109154 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:32:01.109154 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:32:01.109154 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:32:01.109154 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:32:01.110224 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:32:01.110224 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:32:01.110224 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:32:01.110224 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:32:01.110224 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:32:01.110224 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:32:01.110224 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:32:01.110224 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b8abc08-2a0d-44a6-bdee-3b356bcfb7a1 could not be found. Oct 04 18:32:01.110224 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:32:01.110224 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:01.110224 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:32:01.110224 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:01.110224 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:32:01.110224 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:32:01.110224 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:32:01.110224 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:32:01.110224 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b8abc08-2a0d-44a6-bdee-3b356bcfb7a1 could not be found. Oct 04 18:32:01.110224 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:32:01.112522 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-2253b895-6af8-493c-b842-960c869222cd tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Returning 404 to user: Instance 3b8abc08-2a0d-44a6-bdee-3b356bcfb7a1 could not be found. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:32:01.112522 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-2253b895-6af8-493c-b842-960c869222cd tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] 10.222.0.43 "GET /compute/v2.1/servers/3b8abc08-2a0d-44a6-bdee-3b356bcfb7a1" status: 404 len: 111 microversion: 2.1 time: 0.080728 Oct 04 18:32:01.113815 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 113/213] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:01 2022] GET /compute/v2.1/servers/3b8abc08-2a0d-44a6-bdee-3b356bcfb7a1 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:32:01.121992 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-67d41541-1870-4a40-ae8a-6d53eebaa647 tempest-AggregatesAdminTestJSON-1163717784 tempest-AggregatesAdminTestJSON-1163717784-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-851028-13"}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:01.137310 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-67d41541-1870-4a40-ae8a-6d53eebaa647 tempest-AggregatesAdminTestJSON-1163717784 tempest-AggregatesAdminTestJSON-1163717784-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:01.137930 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-67d41541-1870-4a40-ae8a-6d53eebaa647 tempest-AggregatesAdminTestJSON-1163717784 tempest-AggregatesAdminTestJSON-1163717784-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:01.138450 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-67d41541-1870-4a40-ae8a-6d53eebaa647 tempest-AggregatesAdminTestJSON-1163717784 tempest-AggregatesAdminTestJSON-1163717784-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:01.356704 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-67d41541-1870-4a40-ae8a-6d53eebaa647 tempest-AggregatesAdminTestJSON-1163717784 tempest-AggregatesAdminTestJSON-1163717784-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 300 microversion: 2.1 time: 0.240111 Oct 04 18:32:01.358963 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 114/214] 10.222.0.43 () {60 vars in 1191 bytes} [Tue Oct 4 18:32:01 2022] POST /compute/v2.1/os-aggregates/1/action => generated 300 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:32:01.378081 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-1db541ec-d325-4f30-b69c-908a79c1b3e8 req-333d8bd1-a2a2-4249-b232-3adbf31b7b75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b19b908-7870-477b-9be7-7d260d59b183", "name": "network-vif-plugged", "status": "completed", "tag": "1b942ddb-54b7-42fd-90da-3d92df57749c"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:01.388613 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-1db541ec-d325-4f30-b69c-908a79c1b3e8 req-333d8bd1-a2a2-4249-b232-3adbf31b7b75 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:01.389433 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-1db541ec-d325-4f30-b69c-908a79c1b3e8 req-333d8bd1-a2a2-4249-b232-3adbf31b7b75 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:01.390044 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-1db541ec-d325-4f30-b69c-908a79c1b3e8 req-333d8bd1-a2a2-4249-b232-3adbf31b7b75 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:01.401517 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-1db541ec-d325-4f30-b69c-908a79c1b3e8 req-333d8bd1-a2a2-4249-b232-3adbf31b7b75 service nova] Creating event network-vif-plugged:1b942ddb-54b7-42fd-90da-3d92df57749c for instance 9b19b908-7870-477b-9be7-7d260d59b183 on n-h2-851028-13 Oct 04 18:32:01.407251 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-1db541ec-d325-4f30-b69c-908a79c1b3e8 req-333d8bd1-a2a2-4249-b232-3adbf31b7b75 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044076 Oct 04 18:32:01.410942 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 115/215] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:32:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:32:01.416159 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-ac4414b6-1f27-4121-8240-eb136720aeb3 tempest-AggregatesAdminTestJSON-1163717784 tempest-AggregatesAdminTestJSON-1163717784-project-admin] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:01.449866 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-ac4414b6-1f27-4121-8240-eb136720aeb3 tempest-AggregatesAdminTestJSON-1163717784 tempest-AggregatesAdminTestJSON-1163717784-project-admin] 10.222.0.43 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.1 time: 0.037098 Oct 04 18:32:01.452922 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 116/216] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Oct 4 18:32:01 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 18:32:01.465931 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-fb79b23e-0b4a-4a79-a2f1-10cbb69528ab tempest-AggregatesAdminTestJSON-1163717784 tempest-AggregatesAdminTestJSON-1163717784-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-86663224"}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:01.469639 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.objects.aggregate [None req-fb79b23e-0b4a-4a79-a2f1-10cbb69528ab tempest-AggregatesAdminTestJSON-1163717784 tempest-AggregatesAdminTestJSON-1163717784-project-admin] Generated uuid 606bb5b4-97bb-493c-983a-b3f9f6c5f246 for aggregate {{(pid=123596) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 18:32:01.499813 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-fb79b23e-0b4a-4a79-a2f1-10cbb69528ab tempest-AggregatesAdminTestJSON-1163717784 tempest-AggregatesAdminTestJSON-1163717784-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates" status: 200 len: 196 microversion: 2.1 time: 0.038307 Oct 04 18:32:01.507307 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 117/217] 10.222.0.43 () {60 vars in 1164 bytes} [Tue Oct 4 18:32:01 2022] POST /compute/v2.1/os-aggregates => generated 196 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:32:01.518961 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-0afa3ee3-9472-4734-98e6-d4f93f810888 tempest-AggregatesAdminTestJSON-1163717784 tempest-AggregatesAdminTestJSON-1163717784-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-851028-13"}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:01.548360 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0afa3ee3-9472-4734-98e6-d4f93f810888 tempest-AggregatesAdminTestJSON-1163717784 tempest-AggregatesAdminTestJSON-1163717784-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:01.548857 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0afa3ee3-9472-4734-98e6-d4f93f810888 tempest-AggregatesAdminTestJSON-1163717784 tempest-AggregatesAdminTestJSON-1163717784-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:01.549432 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0afa3ee3-9472-4734-98e6-d4f93f810888 tempest-AggregatesAdminTestJSON-1163717784 tempest-AggregatesAdminTestJSON-1163717784-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:01.696907 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-b3329f6d-cb5f-4483-ba32-3e83fbb21255 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Flavor limits 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:32:01.698039 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-b3329f6d-cb5f-4483-ba32-3e83fbb21255 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Image limits 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:32:01.700358 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-b3329f6d-cb5f-4483-ba32-3e83fbb21255 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Flavor pref 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:32:01.701013 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-b3329f6d-cb5f-4483-ba32-3e83fbb21255 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Image pref 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:32:01.701590 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-b3329f6d-cb5f-4483-ba32-3e83fbb21255 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:32:01.714075 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b3329f6d-cb5f-4483-ba32-3e83fbb21255 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:01.714613 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b3329f6d-cb5f-4483-ba32-3e83fbb21255 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:01.715060 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b3329f6d-cb5f-4483-ba32-3e83fbb21255 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:01.715872 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b3329f6d-cb5f-4483-ba32-3e83fbb21255 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:01.716336 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b3329f6d-cb5f-4483-ba32-3e83fbb21255 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:01.717028 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b3329f6d-cb5f-4483-ba32-3e83fbb21255 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:01.751900 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-0afa3ee3-9472-4734-98e6-d4f93f810888 tempest-AggregatesAdminTestJSON-1163717784 tempest-AggregatesAdminTestJSON-1163717784-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 241 microversion: 2.1 time: 0.243310 Oct 04 18:32:01.751993 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-b3329f6d-cb5f-4483-ba32-3e83fbb21255 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Getting quotas for project 1753b9ee9a644e409a1efd0c9e7c152c. Resources: {'ram', 'cores', 'instances'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:32:01.752646 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 118/218] 10.222.0.43 () {60 vars in 1191 bytes} [Tue Oct 4 18:32:01 2022] POST /compute/v2.1/os-aggregates/2/action => generated 241 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:32:01.758992 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-25e0226e-8342-4baa-b829-bc0cee24edd2 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:01.761738 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-25e0226e-8342-4baa-b829-bc0cee24edd2 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] [instance: c4b812d5-f2ff-41c7-b912-3d19d752340b] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:01.766119 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-b3329f6d-cb5f-4483-ba32-3e83fbb21255 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Getting quotas for user 459e65f14af049bba311453d6a86360b and project 1753b9ee9a644e409a1efd0c9e7c152c. Resources: {'ram', 'cores', 'instances'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:32:01.779103 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-25e0226e-8342-4baa-b829-bc0cee24edd2 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:01.779966 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-25e0226e-8342-4baa-b829-bc0cee24edd2 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:01.782183 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-25e0226e-8342-4baa-b829-bc0cee24edd2 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:01.784273 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-25e0226e-8342-4baa-b829-bc0cee24edd2 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:01.785588 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-25e0226e-8342-4baa-b829-bc0cee24edd2 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:01.787490 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-25e0226e-8342-4baa-b829-bc0cee24edd2 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:01.789627 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-b3329f6d-cb5f-4483-ba32-3e83fbb21255 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Going to run 1 instances... {{(pid=123595) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:32:01.796270 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-b3329f6d-cb5f-4483-ba32-3e83fbb21255 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] [instance: b249a7cd-d1ee-4a74-a93d-9991ba84785f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e8943ec5-4038-4d4b-b9b9-2415a79f5243',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:32:01.905842 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-b3329f6d-cb5f-4483-ba32-3e83fbb21255 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.286025 Oct 04 18:32:01.912351 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 101/219] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 18:32:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 1288 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:32:01.913465 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-10927568-e3b2-491d-a3f4-91d29d5f67f7 tempest-AggregatesAdminTestJSON-1163717784 tempest-AggregatesAdminTestJSON-1163717784-project-admin] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:01.966347 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-10927568-e3b2-491d-a3f4-91d29d5f67f7 tempest-AggregatesAdminTestJSON-1163717784 tempest-AggregatesAdminTestJSON-1163717784-project-admin] 10.222.0.43 "GET /compute/v2.1/os-aggregates/2" status: 200 len: 241 microversion: 2.1 time: 0.055459 Oct 04 18:32:01.983338 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 102/220] 10.222.0.43 () {58 vars in 1149 bytes} [Tue Oct 4 18:32:01 2022] GET /compute/v2.1/os-aggregates/2 => generated 241 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:32:02.005009 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-bd5a2337-a840-4531-ac6c-713cee1f31f9 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:02.006282 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-bd5a2337-a840-4531-ac6c-713cee1f31f9 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] [instance: 9b19b908-7870-477b-9be7-7d260d59b183] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:02.019488 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bd5a2337-a840-4531-ac6c-713cee1f31f9 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:02.032677 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bd5a2337-a840-4531-ac6c-713cee1f31f9 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:02.034567 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bd5a2337-a840-4531-ac6c-713cee1f31f9 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:02.035531 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bd5a2337-a840-4531-ac6c-713cee1f31f9 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:02.037420 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bd5a2337-a840-4531-ac6c-713cee1f31f9 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:02.038308 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bd5a2337-a840-4531-ac6c-713cee1f31f9 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:02.079495 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-25e0226e-8342-4baa-b829-bc0cee24edd2 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7db99f361654711bea7f1b2c404d312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7adedcdb9c3485ea2738c00e25aa3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:02.091162 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-25e0226e-8342-4baa-b829-bc0cee24edd2 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] 10.222.0.43 "GET /compute/v2.1/servers/c4b812d5-f2ff-41c7-b912-3d19d752340b" status: 200 len: 1319 microversion: 2.1 time: 0.337133 Oct 04 18:32:02.092281 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 119/221] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:01 2022] GET /compute/v2.1/servers/c4b812d5-f2ff-41c7-b912-3d19d752340b => generated 1319 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:02.097517 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-7a480bca-e86b-4764-8376-3830f971313d tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:02.098414 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-7a480bca-e86b-4764-8376-3830f971313d tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] [instance: b249a7cd-d1ee-4a74-a93d-9991ba84785f] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:02.219417 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-7a480bca-e86b-4764-8376-3830f971313d tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '459e65f14af049bba311453d6a86360b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1753b9ee9a644e409a1efd0c9e7c152c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:02.229390 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-7a480bca-e86b-4764-8376-3830f971313d tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] 10.222.0.43 "GET /compute/v2.1/servers/b249a7cd-d1ee-4a74-a93d-9991ba84785f" status: 200 len: 1219 microversion: 2.1 time: 0.135854 Oct 04 18:32:02.247031 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 120/222] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:02 2022] GET /compute/v2.1/servers/b249a7cd-d1ee-4a74-a93d-9991ba84785f => generated 1219 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:02.253944 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-436ec4d4-e5da-4058-b292-609145cc1249 tempest-AggregatesAdminTestJSON-1163717784 tempest-AggregatesAdminTestJSON-1163717784-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-851028-13"}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:02.269736 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-436ec4d4-e5da-4058-b292-609145cc1249 tempest-AggregatesAdminTestJSON-1163717784 tempest-AggregatesAdminTestJSON-1163717784-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:02.270360 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-436ec4d4-e5da-4058-b292-609145cc1249 tempest-AggregatesAdminTestJSON-1163717784 tempest-AggregatesAdminTestJSON-1163717784-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:02.271615 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-436ec4d4-e5da-4058-b292-609145cc1249 tempest-AggregatesAdminTestJSON-1163717784 tempest-AggregatesAdminTestJSON-1163717784-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:02.493846 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-436ec4d4-e5da-4058-b292-609145cc1249 tempest-AggregatesAdminTestJSON-1163717784 tempest-AggregatesAdminTestJSON-1163717784-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 225 microversion: 2.1 time: 0.245439 Oct 04 18:32:02.497492 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 121/223] 10.222.0.43 () {60 vars in 1191 bytes} [Tue Oct 4 18:32:02 2022] POST /compute/v2.1/os-aggregates/2/action => generated 225 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:32:02.510297 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-7566520d-f2f0-4763-a080-0c10e06a7cab tempest-AggregatesAdminTestJSON-1163717784 tempest-AggregatesAdminTestJSON-1163717784-project-admin] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:02.568390 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-7566520d-f2f0-4763-a080-0c10e06a7cab tempest-AggregatesAdminTestJSON-1163717784 tempest-AggregatesAdminTestJSON-1163717784-project-admin] 10.222.0.43 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.063018 Oct 04 18:32:02.573439 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 122/224] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Oct 4 18:32:02 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Oct 04 18:32:02.583602 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-4e4ddd8a-5e37-461d-a610-46a58b59194e tempest-AggregatesAdminTestJSON-1163717784 tempest-AggregatesAdminTestJSON-1163717784-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1989982662"}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:02.593763 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.objects.aggregate [None req-4e4ddd8a-5e37-461d-a610-46a58b59194e tempest-AggregatesAdminTestJSON-1163717784 tempest-AggregatesAdminTestJSON-1163717784-project-admin] Generated uuid a3243108-3598-452f-a17e-908967ee255d for aggregate {{(pid=123596) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 18:32:02.636083 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-4e4ddd8a-5e37-461d-a610-46a58b59194e tempest-AggregatesAdminTestJSON-1163717784 tempest-AggregatesAdminTestJSON-1163717784-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.055726 Oct 04 18:32:02.637099 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 123/225] 10.222.0.43 () {60 vars in 1164 bytes} [Tue Oct 4 18:32:02 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:32:02.648843 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-9c37029e-56a2-423e-b42b-4a873823c3e8 tempest-AggregatesAdminTestJSON-1163717784 tempest-AggregatesAdminTestJSON-1163717784-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-851028-13"}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:02.681999 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9c37029e-56a2-423e-b42b-4a873823c3e8 tempest-AggregatesAdminTestJSON-1163717784 tempest-AggregatesAdminTestJSON-1163717784-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:02.682601 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-bd5a2337-a840-4531-ac6c-713cee1f31f9 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ea2088d8124b149187a1c140d3be88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82c615a05e8a4cd086f2e580529fb1d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:02.684470 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9c37029e-56a2-423e-b42b-4a873823c3e8 tempest-AggregatesAdminTestJSON-1163717784 tempest-AggregatesAdminTestJSON-1163717784-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:02.686202 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9c37029e-56a2-423e-b42b-4a873823c3e8 tempest-AggregatesAdminTestJSON-1163717784 tempest-AggregatesAdminTestJSON-1163717784-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:02.700448 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-bd5a2337-a840-4531-ac6c-713cee1f31f9 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] 10.222.0.43 "GET /compute/v2.1/servers/9b19b908-7870-477b-9be7-7d260d59b183" status: 200 len: 1388 microversion: 2.1 time: 0.715354 Oct 04 18:32:02.701064 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 103/226] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:01 2022] GET /compute/v2.1/servers/9b19b908-7870-477b-9be7-7d260d59b183 => generated 1388 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:02.947236 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-9c37029e-56a2-423e-b42b-4a873823c3e8 tempest-AggregatesAdminTestJSON-1163717784 tempest-AggregatesAdminTestJSON-1163717784-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 243 microversion: 2.1 time: 0.303075 Oct 04 18:32:02.948187 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 124/227] 10.222.0.43 () {60 vars in 1191 bytes} [Tue Oct 4 18:32:02 2022] POST /compute/v2.1/os-aggregates/3/action => generated 243 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:32:02.960825 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-f447545c-9dbf-4a60-b762-bb6361f8742a tempest-AggregatesAdminTestJSON-1163717784 tempest-AggregatesAdminTestJSON-1163717784-project-admin] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:02.985896 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-f447545c-9dbf-4a60-b762-bb6361f8742a tempest-AggregatesAdminTestJSON-1163717784 tempest-AggregatesAdminTestJSON-1163717784-project-admin] 10.222.0.43 "GET /compute/v2.1/os-aggregates" status: 200 len: 246 microversion: 2.1 time: 0.027110 Oct 04 18:32:02.987533 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 104/228] 10.222.0.43 () {58 vars in 1143 bytes} [Tue Oct 4 18:32:02 2022] GET /compute/v2.1/os-aggregates => generated 246 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:32:03.001247 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-e07938ff-81b1-446a-9f11-f5dc82b90a39 tempest-AggregatesAdminTestJSON-1163717784 tempest-AggregatesAdminTestJSON-1163717784-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-851028-13"}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:03.018340 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-14b50e75-4753-4571-ba02-b5c348bdd3e6 req-35ffaf89-ac1d-439a-80b7-fc9280451fc3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4311d976-991e-4ab1-9d5e-d654aa7d0b08", "tag": "b89d6e48-3869-4b43-a6d0-a6c0d069cdd9"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:03.047999 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e07938ff-81b1-446a-9f11-f5dc82b90a39 tempest-AggregatesAdminTestJSON-1163717784 tempest-AggregatesAdminTestJSON-1163717784-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:03.048855 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e07938ff-81b1-446a-9f11-f5dc82b90a39 tempest-AggregatesAdminTestJSON-1163717784 tempest-AggregatesAdminTestJSON-1163717784-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:03.049529 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e07938ff-81b1-446a-9f11-f5dc82b90a39 tempest-AggregatesAdminTestJSON-1163717784 tempest-AggregatesAdminTestJSON-1163717784-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:03.065126 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-14b50e75-4753-4571-ba02-b5c348bdd3e6 req-35ffaf89-ac1d-439a-80b7-fc9280451fc3 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:03.066079 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-14b50e75-4753-4571-ba02-b5c348bdd3e6 req-35ffaf89-ac1d-439a-80b7-fc9280451fc3 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:03.066673 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-14b50e75-4753-4571-ba02-b5c348bdd3e6 req-35ffaf89-ac1d-439a-80b7-fc9280451fc3 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:03.088940 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-14b50e75-4753-4571-ba02-b5c348bdd3e6 req-35ffaf89-ac1d-439a-80b7-fc9280451fc3 service nova] Creating event network-changed:b89d6e48-3869-4b43-a6d0-a6c0d069cdd9 for instance 4311d976-991e-4ab1-9d5e-d654aa7d0b08 on n-h1-851028-13 Oct 04 18:32:03.097809 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-14b50e75-4753-4571-ba02-b5c348bdd3e6 req-35ffaf89-ac1d-439a-80b7-fc9280451fc3 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086121 Oct 04 18:32:03.099470 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 105/229] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:32:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:32:03.116348 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-52e85118-9c07-4b74-bfd4-ad3a8a7110e1 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:03.120502 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-52e85118-9c07-4b74-bfd4-ad3a8a7110e1 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] [instance: c4b812d5-f2ff-41c7-b912-3d19d752340b] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:03.132357 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-52e85118-9c07-4b74-bfd4-ad3a8a7110e1 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:03.133046 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-52e85118-9c07-4b74-bfd4-ad3a8a7110e1 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:03.134158 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-52e85118-9c07-4b74-bfd4-ad3a8a7110e1 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:03.136713 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-52e85118-9c07-4b74-bfd4-ad3a8a7110e1 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:03.137227 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-52e85118-9c07-4b74-bfd4-ad3a8a7110e1 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:03.139365 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-52e85118-9c07-4b74-bfd4-ad3a8a7110e1 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:03.286939 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-e07938ff-81b1-446a-9f11-f5dc82b90a39 tempest-AggregatesAdminTestJSON-1163717784 tempest-AggregatesAdminTestJSON-1163717784-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 227 microversion: 2.1 time: 0.290888 Oct 04 18:32:03.288349 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 125/230] 10.222.0.43 () {60 vars in 1191 bytes} [Tue Oct 4 18:32:02 2022] POST /compute/v2.1/os-aggregates/3/action => generated 227 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:32:03.294441 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-6ba47073-fe67-416e-b221-7b3d0cc4a991 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:03.295567 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-6ba47073-fe67-416e-b221-7b3d0cc4a991 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] [instance: b249a7cd-d1ee-4a74-a93d-9991ba84785f] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:03.304600 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6ba47073-fe67-416e-b221-7b3d0cc4a991 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:03.305347 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6ba47073-fe67-416e-b221-7b3d0cc4a991 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:03.305865 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6ba47073-fe67-416e-b221-7b3d0cc4a991 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:03.306644 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6ba47073-fe67-416e-b221-7b3d0cc4a991 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:03.307325 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6ba47073-fe67-416e-b221-7b3d0cc4a991 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:03.307888 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6ba47073-fe67-416e-b221-7b3d0cc4a991 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:03.407680 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-6ba47073-fe67-416e-b221-7b3d0cc4a991 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '459e65f14af049bba311453d6a86360b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1753b9ee9a644e409a1efd0c9e7c152c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:03.424761 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-6ba47073-fe67-416e-b221-7b3d0cc4a991 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] 10.222.0.43 "GET /compute/v2.1/servers/b249a7cd-d1ee-4a74-a93d-9991ba84785f" status: 200 len: 1271 microversion: 2.1 time: 0.134773 Oct 04 18:32:03.425841 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 126/231] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:03 2022] GET /compute/v2.1/servers/b249a7cd-d1ee-4a74-a93d-9991ba84785f => generated 1271 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:03.430633 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-daad1a86-6c61-4871-a092-fe8f6687f7e4 tempest-AggregatesAdminTestJSON-1163717784 tempest-AggregatesAdminTestJSON-1163717784-project-admin] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:03.486839 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-daad1a86-6c61-4871-a092-fe8f6687f7e4 tempest-AggregatesAdminTestJSON-1163717784 tempest-AggregatesAdminTestJSON-1163717784-project-admin] 10.222.0.43 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.1 time: 0.059745 Oct 04 18:32:03.502449 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 127/232] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Oct 4 18:32:03 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 18:32:03.515126 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f1f15f10-11ba-4b52-85cc-2c6293670b31 tempest-AggregatesAdminTestJSON-1163717784 tempest-AggregatesAdminTestJSON-1163717784-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-438076754"}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:03.518929 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.objects.aggregate [None req-f1f15f10-11ba-4b52-85cc-2c6293670b31 tempest-AggregatesAdminTestJSON-1163717784 tempest-AggregatesAdminTestJSON-1163717784-project-admin] Generated uuid da3a547d-fc3a-492a-aee3-2347950c2e1f for aggregate {{(pid=123596) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 18:32:03.547508 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-f1f15f10-11ba-4b52-85cc-2c6293670b31 tempest-AggregatesAdminTestJSON-1163717784 tempest-AggregatesAdminTestJSON-1163717784-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.038317 Oct 04 18:32:03.548619 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 128/233] 10.222.0.43 () {60 vars in 1164 bytes} [Tue Oct 4 18:32:03 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:32:03.560454 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-90162df9-b633-4e52-8726-34dc349c78ec tempest-AggregatesAdminTestJSON-1163717784 tempest-AggregatesAdminTestJSON-1163717784-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-851028-13"}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:03.577346 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-90162df9-b633-4e52-8726-34dc349c78ec tempest-AggregatesAdminTestJSON-1163717784 tempest-AggregatesAdminTestJSON-1163717784-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:03.578169 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-90162df9-b633-4e52-8726-34dc349c78ec tempest-AggregatesAdminTestJSON-1163717784 tempest-AggregatesAdminTestJSON-1163717784-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:03.578806 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-90162df9-b633-4e52-8726-34dc349c78ec tempest-AggregatesAdminTestJSON-1163717784 tempest-AggregatesAdminTestJSON-1163717784-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:03.649403 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-52e85118-9c07-4b74-bfd4-ad3a8a7110e1 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7db99f361654711bea7f1b2c404d312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7adedcdb9c3485ea2738c00e25aa3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:03.659281 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-52e85118-9c07-4b74-bfd4-ad3a8a7110e1 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] 10.222.0.43 "GET /compute/v2.1/servers/c4b812d5-f2ff-41c7-b912-3d19d752340b" status: 200 len: 1319 microversion: 2.1 time: 0.546836 Oct 04 18:32:03.679569 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 106/234] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:03 2022] GET /compute/v2.1/servers/c4b812d5-f2ff-41c7-b912-3d19d752340b => generated 1319 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:03.723930 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-9d0cdf8d-0f2c-47b7-b65a-b421a074205c tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:03.724560 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-9d0cdf8d-0f2c-47b7-b65a-b421a074205c tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] [instance: 9b19b908-7870-477b-9be7-7d260d59b183] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:03.733237 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9d0cdf8d-0f2c-47b7-b65a-b421a074205c tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:03.734069 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9d0cdf8d-0f2c-47b7-b65a-b421a074205c tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:03.734745 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9d0cdf8d-0f2c-47b7-b65a-b421a074205c tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:03.736482 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9d0cdf8d-0f2c-47b7-b65a-b421a074205c tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:03.737413 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9d0cdf8d-0f2c-47b7-b65a-b421a074205c tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:03.738078 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9d0cdf8d-0f2c-47b7-b65a-b421a074205c tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:03.754750 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-90162df9-b633-4e52-8726-34dc349c78ec tempest-AggregatesAdminTestJSON-1163717784 tempest-AggregatesAdminTestJSON-1163717784-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 242 microversion: 2.1 time: 0.198806 Oct 04 18:32:03.755352 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 129/235] 10.222.0.43 () {60 vars in 1191 bytes} [Tue Oct 4 18:32:03 2022] POST /compute/v2.1/os-aggregates/4/action => generated 242 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:32:03.770074 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-ea13490f-ec08-43b3-b81d-223d98ca4fff tempest-AggregatesAdminTestJSON-1163717784 tempest-AggregatesAdminTestJSON-1163717784-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-851028-13"}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:03.802035 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ea13490f-ec08-43b3-b81d-223d98ca4fff tempest-AggregatesAdminTestJSON-1163717784 tempest-AggregatesAdminTestJSON-1163717784-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:03.802900 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ea13490f-ec08-43b3-b81d-223d98ca4fff tempest-AggregatesAdminTestJSON-1163717784 tempest-AggregatesAdminTestJSON-1163717784-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:03.803543 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ea13490f-ec08-43b3-b81d-223d98ca4fff tempest-AggregatesAdminTestJSON-1163717784 tempest-AggregatesAdminTestJSON-1163717784-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:04.042901 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-ea13490f-ec08-43b3-b81d-223d98ca4fff tempest-AggregatesAdminTestJSON-1163717784 tempest-AggregatesAdminTestJSON-1163717784-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 226 microversion: 2.1 time: 0.276018 Oct 04 18:32:04.055541 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 130/236] 10.222.0.43 () {60 vars in 1191 bytes} [Tue Oct 4 18:32:03 2022] POST /compute/v2.1/os-aggregates/4/action => generated 226 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:32:04.076398 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-e9659c75-dd73-46c1-8382-7f600b011702 tempest-AggregatesAdminTestJSON-1163717784 tempest-AggregatesAdminTestJSON-1163717784-project-admin] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:04.138824 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-9d0cdf8d-0f2c-47b7-b65a-b421a074205c tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ea2088d8124b149187a1c140d3be88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82c615a05e8a4cd086f2e580529fb1d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:04.142251 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-e9659c75-dd73-46c1-8382-7f600b011702 tempest-AggregatesAdminTestJSON-1163717784 tempest-AggregatesAdminTestJSON-1163717784-project-admin] 10.222.0.43 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.086286 Oct 04 18:32:04.143640 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 131/237] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Oct 4 18:32:04 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 18:32:04.147920 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-9d0cdf8d-0f2c-47b7-b65a-b421a074205c tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] 10.222.0.43 "GET /compute/v2.1/servers/9b19b908-7870-477b-9be7-7d260d59b183" status: 200 len: 1587 microversion: 2.1 time: 0.427676 Oct 04 18:32:04.156167 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 107/238] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:03 2022] GET /compute/v2.1/servers/9b19b908-7870-477b-9be7-7d260d59b183 => generated 1587 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:32:04.170952 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-63a9ec91-56ea-4782-896b-e5fd33a2e6ea tempest-AggregatesAdminTestJSON-1163717784 tempest-AggregatesAdminTestJSON-1163717784-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1364138243"}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:04.179687 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.objects.aggregate [None req-63a9ec91-56ea-4782-896b-e5fd33a2e6ea tempest-AggregatesAdminTestJSON-1163717784 tempest-AggregatesAdminTestJSON-1163717784-project-admin] Generated uuid cb4b07a2-1710-4277-ab2e-b82639e0c067 for aggregate {{(pid=123596) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 18:32:04.184628 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-5eaf6df3-ae56-4990-adcd-b483807c3111 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:04.185614 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-5eaf6df3-ae56-4990-adcd-b483807c3111 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] [instance: 9b19b908-7870-477b-9be7-7d260d59b183] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:04.197913 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_api:SELECT=81,nova_api:DELETE=12,nova_api:INSERT=7 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:32:04.201790 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5eaf6df3-ae56-4990-adcd-b483807c3111 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:04.202511 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5eaf6df3-ae56-4990-adcd-b483807c3111 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:04.203689 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5eaf6df3-ae56-4990-adcd-b483807c3111 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:04.205018 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5eaf6df3-ae56-4990-adcd-b483807c3111 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:04.207605 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5eaf6df3-ae56-4990-adcd-b483807c3111 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:04.208228 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5eaf6df3-ae56-4990-adcd-b483807c3111 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:04.226231 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-63a9ec91-56ea-4782-896b-e5fd33a2e6ea tempest-AggregatesAdminTestJSON-1163717784 tempest-AggregatesAdminTestJSON-1163717784-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.074958 Oct 04 18:32:04.227674 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 132/239] 10.222.0.43 () {60 vars in 1164 bytes} [Tue Oct 4 18:32:04 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:32:04.255655 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-2dbdde09-c0d5-4d22-ac5b-100c9707e5da tempest-AggregatesAdminTestV241-1809718964 tempest-AggregatesAdminTestV241-1809718964-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1667774686"}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:04.263377 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.objects.aggregate [None req-2dbdde09-c0d5-4d22-ac5b-100c9707e5da tempest-AggregatesAdminTestV241-1809718964 tempest-AggregatesAdminTestV241-1809718964-project-admin] Generated uuid d264a2d9-7fc7-4787-b3b3-869049d39cd8 for aggregate {{(pid=123596) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 18:32:04.298522 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-2dbdde09-c0d5-4d22-ac5b-100c9707e5da tempest-AggregatesAdminTestV241-1809718964 tempest-AggregatesAdminTestV241-1809718964-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates" status: 200 len: 246 microversion: 2.41 time: 0.069735 Oct 04 18:32:04.299612 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 133/240] 10.222.0.43 () {62 vars in 1205 bytes} [Tue Oct 4 18:32:04 2022] POST /compute/v2.1/os-aggregates => generated 246 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:32:04.304499 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-65ab52bc-ac01-46a0-bafc-bdde4f703db0 tempest-AggregatesAdminTestJSON-1163717784 tempest-AggregatesAdminTestJSON-1163717784-project-admin] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:04.329741 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-65ab52bc-ac01-46a0-bafc-bdde4f703db0 tempest-AggregatesAdminTestJSON-1163717784 tempest-AggregatesAdminTestJSON-1163717784-project-admin] 10.222.0.43 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.029001 Oct 04 18:32:04.333856 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 134/241] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Oct 4 18:32:04 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 18:32:04.359651 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-5eaf6df3-ae56-4990-adcd-b483807c3111 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] 10.222.0.43 "GET /compute/v2.1/servers/9b19b908-7870-477b-9be7-7d260d59b183/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.179536 Oct 04 18:32:04.360404 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 108/242] 10.222.0.43 () {58 vars in 1275 bytes} [Tue Oct 4 18:32:04 2022] GET /compute/v2.1/servers/9b19b908-7870-477b-9be7-7d260d59b183/os-interface => generated 284 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:32:04.368424 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-35973e17-4c9d-4cc8-990b-73a2ebd29276 tempest-AggregatesAdminTestV241-1809718964 tempest-AggregatesAdminTestV241-1809718964-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-271499"}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:04.515205 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-35973e17-4c9d-4cc8-990b-73a2ebd29276 tempest-AggregatesAdminTestV241-1809718964 tempest-AggregatesAdminTestV241-1809718964-project-admin] 10.222.0.43 "PUT /compute/v2.1/os-aggregates/6" status: 200 len: 295 microversion: 2.41 time: 0.153519 Oct 04 18:32:04.515830 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 109/243] 10.222.0.43 () {62 vars in 1210 bytes} [Tue Oct 4 18:32:04 2022] PUT /compute/v2.1/os-aggregates/6 => generated 295 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:32:04.520671 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-00cc31fd-61fb-46f0-8428-9b35f1795cbc tempest-AggregatesAdminTestJSON-1163717784 tempest-AggregatesAdminTestJSON-1163717784-project-admin] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:04.530009 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-00cc31fd-61fb-46f0-8428-9b35f1795cbc tempest-AggregatesAdminTestJSON-1163717784 tempest-AggregatesAdminTestJSON-1163717784-project-admin] HTTP exception thrown: Aggregate 5 could not be found. Oct 04 18:32:04.539537 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-00cc31fd-61fb-46f0-8428-9b35f1795cbc tempest-AggregatesAdminTestJSON-1163717784 tempest-AggregatesAdminTestJSON-1163717784-project-admin] Request method failure captured: Oct 04 18:32:04.539537 n-d-851028-13 devstack@n-api.service[123595]: request: GET /compute/v2.1/os-aggregates/5 HTTP/1.1 Oct 04 18:32:04.539537 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 18:32:04.539537 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 18:32:04.539537 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 18:32:04.539537 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 0 Oct 04 18:32:04.539537 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 18:32:04.539537 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 18:32:04.539537 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 18:32:04.539537 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 18:32:04.539537 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPHvu-dcbDdMcTg-li6hOYmAehdfaeV4blYGwnFLiKnPz4yCysrB24V-kx4VUx--gORd_xrfj9e9nwTig-nWLrPYuvt_Yuyc2fdsjqBAlkImkAo7Bg1uWiOPx8WNKE7UPM1zBuDSvrOGXUUZmskLOeCUQF-8Ht9nddyt_H9XK14MXw9w Oct 04 18:32:04.539537 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 18:32:04.539537 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 18:32:04.539537 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 18:32:04.539537 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 18:32:04.539537 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 18:32:04.539537 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 18:32:04.539537 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: d7ac7d10e76a46b5bb37151ede27eede Oct 04 18:32:04.539537 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-AggregatesAdminTestJSON-1163717784 Oct 04 18:32:04.539537 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,admin,reader Oct 04 18:32:04.539537 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,admin,reader Oct 04 18:32:04.540792 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/d7ac7d10e76a46b5bb37151ede27eede"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_d7ac7d10e76a46b5bb37151ede27eede"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d7ac7d10e76a46b5bb37151ede27eede"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d7ac7d10e76a46b5bb37151ede27eede"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:32:04.540792 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-AggregatesAdminTestJSON-1163717784 Oct 04 18:32:04.540792 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: d7ac7d10e76a46b5bb37151ede27eede Oct 04 18:32:04.540792 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1163717784 Oct 04 18:32:04.540792 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-AggregatesAdminTestJSON-1163717784-project-admin Oct 04 18:32:04.540792 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 18:32:04.540792 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 18:32:04.540792 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: e522cd6e77e1454dab2d38ad32278532 Oct 04 18:32:04.540792 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-AggregatesAdminTestJSON-1163717784-project-admin Oct 04 18:32:04.540792 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 18:32:04.540792 n-d-851028-13 devstack@n-api.service[123595]: exception: Aggregate 5 could not be found. Oct 04 18:32:04.540792 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': '5'} Oct 04 18:32:04.540792 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:32:04.541557 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:04.541557 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 04 18:32:04.541557 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 04 18:32:04.541557 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Oct 04 18:32:04.541557 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 04 18:32:04.541557 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 18:32:04.541557 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 18:32:04.541557 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 04 18:32:04.541557 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 04 18:32:04.541557 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 18:32:04.541557 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 18:32:04.541557 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 04 18:32:04.541557 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 04 18:32:04.541557 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 5 could not be found. Oct 04 18:32:04.541557 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:32:04.541557 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:04.541557 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:32:04.541557 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:04.541557 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:32:04.542719 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:32:04.542719 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:32:04.542719 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:32:04.542719 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:32:04.542719 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:32:04.542719 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 04 18:32:04.542719 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:32:04.542719 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 5 could not be found. Oct 04 18:32:04.542719 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:32:04.542719 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:04.542719 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:32:04.542719 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:04.542719 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:32:04.542719 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:32:04.542719 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:32:04.542719 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:32:04.542719 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 5 could not be found. Oct 04 18:32:04.542719 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:32:04.543794 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-00cc31fd-61fb-46f0-8428-9b35f1795cbc tempest-AggregatesAdminTestJSON-1163717784 tempest-AggregatesAdminTestJSON-1163717784-project-admin] Returning 404 to user: Aggregate 5 could not be found. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:32:04.543794 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-00cc31fd-61fb-46f0-8428-9b35f1795cbc tempest-AggregatesAdminTestJSON-1163717784 tempest-AggregatesAdminTestJSON-1163717784-project-admin] 10.222.0.43 "GET /compute/v2.1/os-aggregates/5" status: 404 len: 77 microversion: 2.1 time: 0.024372 Oct 04 18:32:04.543794 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 110/244] 10.222.0.43 () {58 vars in 1149 bytes} [Tue Oct 4 18:32:04 2022] GET /compute/v2.1/os-aggregates/5 => generated 77 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:32:04.549007 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-2b866fb2-f218-467e-a123-038f907ac9af tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:04.549669 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-2b866fb2-f218-467e-a123-038f907ac9af tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] [instance: b249a7cd-d1ee-4a74-a93d-9991ba84785f] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:04.558937 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2b866fb2-f218-467e-a123-038f907ac9af tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:04.559433 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2b866fb2-f218-467e-a123-038f907ac9af tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:04.559909 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2b866fb2-f218-467e-a123-038f907ac9af tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:04.560962 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2b866fb2-f218-467e-a123-038f907ac9af tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:04.561542 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2b866fb2-f218-467e-a123-038f907ac9af tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:04.562532 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2b866fb2-f218-467e-a123-038f907ac9af tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:04.581097 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-7b3c62dc-1734-4de9-9c92-9bbe154b4eec tempest-QuotasAdminNegativeTest-2112941160 tempest-QuotasAdminNegativeTest-2112941160-project-admin] Calling method '.version_select at 0x7fb2249f93a0>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:04.665163 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-7b3c62dc-1734-4de9-9c92-9bbe154b4eec tempest-QuotasAdminNegativeTest-2112941160 tempest-QuotasAdminNegativeTest-2112941160-project-admin] 10.222.0.43 "GET /compute/v2.1/os-quota-sets/e1fb34a4be434fa2962daf5525d632e8" status: 200 len: 371 microversion: 2.1 time: 0.332698 Oct 04 18:32:04.673636 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 135/245] 10.222.0.43 () {58 vars in 1242 bytes} [Tue Oct 4 18:32:04 2022] GET /compute/v2.1/os-quota-sets/e1fb34a4be434fa2962daf5525d632e8 => generated 371 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:32:04.679018 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-2e01c442-3941-4a20-bc2f-6771236f6dea tempest-AggregatesAdminTestV241-1809718964 tempest-AggregatesAdminTestV241-1809718964-project-admin] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:04.688281 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-2e01c442-3941-4a20-bc2f-6771236f6dea tempest-AggregatesAdminTestV241-1809718964 tempest-AggregatesAdminTestV241-1809718964-project-admin] 10.222.0.43 "GET /compute/v2.1/os-aggregates/6" status: 200 len: 295 microversion: 2.41 time: 0.013261 Oct 04 18:32:04.689201 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 136/246] 10.222.0.43 () {60 vars in 1190 bytes} [Tue Oct 4 18:32:04 2022] GET /compute/v2.1/os-aggregates/6 => generated 295 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:32:04.694167 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-38474e3b-c1c7-44e0-ae61-69d84ad19000 tempest-AggregatesAdminTestJSON-1163717784 tempest-AggregatesAdminTestJSON-1163717784-project-admin] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:04.712107 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-38474e3b-c1c7-44e0-ae61-69d84ad19000 tempest-AggregatesAdminTestJSON-1163717784 tempest-AggregatesAdminTestJSON-1163717784-project-admin] HTTP exception thrown: Aggregate 5 could not be found. Oct 04 18:32:04.716297 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-38474e3b-c1c7-44e0-ae61-69d84ad19000 tempest-AggregatesAdminTestJSON-1163717784 tempest-AggregatesAdminTestJSON-1163717784-project-admin] Request method failure captured: Oct 04 18:32:04.716297 n-d-851028-13 devstack@n-api.service[123596]: request: DELETE /compute/v2.1/os-aggregates/5 HTTP/1.1 Oct 04 18:32:04.716297 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:32:04.716297 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:32:04.716297 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:32:04.716297 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 18:32:04.716297 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:32:04.716297 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:32:04.716297 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:32:04.716297 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:32:04.716297 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPHvu-dcbDdMcTg-li6hOYmAehdfaeV4blYGwnFLiKnPz4yCysrB24V-kx4VUx--gORd_xrfj9e9nwTig-nWLrPYuvt_Yuyc2fdsjqBAlkImkAo7Bg1uWiOPx8WNKE7UPM1zBuDSvrOGXUUZmskLOeCUQF-8Ht9nddyt_H9XK14MXw9w Oct 04 18:32:04.716297 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:32:04.716297 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:32:04.716297 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:32:04.716297 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:32:04.716297 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:32:04.716297 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:32:04.716297 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: d7ac7d10e76a46b5bb37151ede27eede Oct 04 18:32:04.716297 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-AggregatesAdminTestJSON-1163717784 Oct 04 18:32:04.716297 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,admin,reader Oct 04 18:32:04.716297 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,admin,reader Oct 04 18:32:04.717644 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/d7ac7d10e76a46b5bb37151ede27eede"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_d7ac7d10e76a46b5bb37151ede27eede"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d7ac7d10e76a46b5bb37151ede27eede"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d7ac7d10e76a46b5bb37151ede27eede"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:32:04.717644 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-AggregatesAdminTestJSON-1163717784 Oct 04 18:32:04.717644 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: d7ac7d10e76a46b5bb37151ede27eede Oct 04 18:32:04.717644 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1163717784 Oct 04 18:32:04.717644 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-AggregatesAdminTestJSON-1163717784-project-admin Oct 04 18:32:04.717644 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:32:04.717644 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:32:04.717644 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: e522cd6e77e1454dab2d38ad32278532 Oct 04 18:32:04.717644 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-AggregatesAdminTestJSON-1163717784-project-admin Oct 04 18:32:04.717644 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 18:32:04.717644 n-d-851028-13 devstack@n-api.service[123596]: exception: Aggregate 5 could not be found. Oct 04 18:32:04.717644 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': '5'} Oct 04 18:32:04.717644 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:32:04.718376 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:04.718376 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 04 18:32:04.718376 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 04 18:32:04.718376 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 04 18:32:04.718376 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 04 18:32:04.718376 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:32:04.718376 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:32:04.718376 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:32:04.718376 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:32:04.718376 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 04 18:32:04.718376 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 04 18:32:04.718376 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Oct 04 18:32:04.718376 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 04 18:32:04.718376 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 18:32:04.718376 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 18:32:04.718376 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 04 18:32:04.718376 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 04 18:32:04.718376 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 18:32:04.718376 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 18:32:04.720089 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 04 18:32:04.720089 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 04 18:32:04.720089 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 5 could not be found. Oct 04 18:32:04.720089 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:32:04.720089 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:04.720089 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:32:04.720089 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:04.720089 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:32:04.720089 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:32:04.720089 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:32:04.720089 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:32:04.720089 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:32:04.720089 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:32:04.720089 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 04 18:32:04.720089 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:32:04.720089 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 5 could not be found. Oct 04 18:32:04.720089 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:32:04.720089 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:04.720089 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:32:04.720089 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:04.720089 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:32:04.724980 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:32:04.724980 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:32:04.724980 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:32:04.724980 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 5 could not be found. Oct 04 18:32:04.724980 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:32:04.724980 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-38474e3b-c1c7-44e0-ae61-69d84ad19000 tempest-AggregatesAdminTestJSON-1163717784 tempest-AggregatesAdminTestJSON-1163717784-project-admin] Returning 404 to user: Aggregate 5 could not be found. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:32:04.724980 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-38474e3b-c1c7-44e0-ae61-69d84ad19000 tempest-AggregatesAdminTestJSON-1163717784 tempest-AggregatesAdminTestJSON-1163717784-project-admin] 10.222.0.43 "DELETE /compute/v2.1/os-aggregates/5" status: 404 len: 77 microversion: 2.1 time: 0.027434 Oct 04 18:32:04.724980 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 137/247] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Oct 4 18:32:04 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 77 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:32:04.724980 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-dc7fdde1-4b63-42bd-ac9b-638c2efd6e54 tempest-QuotasAdminNegativeTest-2112941160 tempest-QuotasAdminNegativeTest-2112941160-project-admin] Action: 'update', calling method: .version_select at 0x7fb224556790>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:04.800128 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dc7fdde1-4b63-42bd-ac9b-638c2efd6e54 tempest-QuotasAdminNegativeTest-2112941160 tempest-QuotasAdminNegativeTest-2112941160-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:04.800617 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dc7fdde1-4b63-42bd-ac9b-638c2efd6e54 tempest-QuotasAdminNegativeTest-2112941160 tempest-QuotasAdminNegativeTest-2112941160-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:04.801135 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dc7fdde1-4b63-42bd-ac9b-638c2efd6e54 tempest-QuotasAdminNegativeTest-2112941160 tempest-QuotasAdminNegativeTest-2112941160-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:04.801943 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dc7fdde1-4b63-42bd-ac9b-638c2efd6e54 tempest-QuotasAdminNegativeTest-2112941160 tempest-QuotasAdminNegativeTest-2112941160-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:04.802404 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dc7fdde1-4b63-42bd-ac9b-638c2efd6e54 tempest-QuotasAdminNegativeTest-2112941160 tempest-QuotasAdminNegativeTest-2112941160-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:04.802836 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dc7fdde1-4b63-42bd-ac9b-638c2efd6e54 tempest-QuotasAdminNegativeTest-2112941160 tempest-QuotasAdminNegativeTest-2112941160-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:04.875848 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-dc7fdde1-4b63-42bd-ac9b-638c2efd6e54 tempest-QuotasAdminNegativeTest-2112941160 tempest-QuotasAdminNegativeTest-2112941160-project-admin] 10.222.0.43 "PUT /compute/v2.1/os-quota-sets/e1fb34a4be434fa2962daf5525d632e8" status: 200 len: 328 microversion: 2.1 time: 0.155970 Oct 04 18:32:04.889155 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 138/248] 10.222.0.43 () {60 vars in 1262 bytes} [Tue Oct 4 18:32:04 2022] PUT /compute/v2.1/os-quota-sets/e1fb34a4be434fa2962daf5525d632e8 => generated 328 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:32:04.889155 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-3a0bf66a-ddbc-4764-9352-38c4c6fd6c23 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:04.889155 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-3a0bf66a-ddbc-4764-9352-38c4c6fd6c23 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] [instance: c4b812d5-f2ff-41c7-b912-3d19d752340b] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:04.916978 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3a0bf66a-ddbc-4764-9352-38c4c6fd6c23 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:04.919034 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3a0bf66a-ddbc-4764-9352-38c4c6fd6c23 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:04.919569 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3a0bf66a-ddbc-4764-9352-38c4c6fd6c23 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:04.920681 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3a0bf66a-ddbc-4764-9352-38c4c6fd6c23 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:04.921995 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3a0bf66a-ddbc-4764-9352-38c4c6fd6c23 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:04.922677 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3a0bf66a-ddbc-4764-9352-38c4c6fd6c23 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:04.927607 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=100 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:32:04.941866 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-2b866fb2-f218-467e-a123-038f907ac9af tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '459e65f14af049bba311453d6a86360b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1753b9ee9a644e409a1efd0c9e7c152c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:04.953385 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-2b866fb2-f218-467e-a123-038f907ac9af tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] 10.222.0.43 "GET /compute/v2.1/servers/b249a7cd-d1ee-4a74-a93d-9991ba84785f" status: 200 len: 1277 microversion: 2.1 time: 0.407216 Oct 04 18:32:04.954075 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 111/249] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:04 2022] GET /compute/v2.1/servers/b249a7cd-d1ee-4a74-a93d-9991ba84785f => generated 1277 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:04.971589 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-cf550342-379e-4d59-ab2d-9b0282c952d8 tempest-AggregatesAdminTestV241-1809718964 tempest-AggregatesAdminTestV241-1809718964-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-851028-13"}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:04.989862 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cf550342-379e-4d59-ab2d-9b0282c952d8 tempest-AggregatesAdminTestV241-1809718964 tempest-AggregatesAdminTestV241-1809718964-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:04.990718 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cf550342-379e-4d59-ab2d-9b0282c952d8 tempest-AggregatesAdminTestV241-1809718964 tempest-AggregatesAdminTestV241-1809718964-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:04.991411 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cf550342-379e-4d59-ab2d-9b0282c952d8 tempest-AggregatesAdminTestV241-1809718964 tempest-AggregatesAdminTestV241-1809718964-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:05.461536 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-cf550342-379e-4d59-ab2d-9b0282c952d8 tempest-AggregatesAdminTestV241-1809718964 tempest-AggregatesAdminTestV241-1809718964-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates/6/action" status: 200 len: 311 microversion: 2.41 time: 0.504233 Oct 04 18:32:05.462357 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 112/250] 10.222.0.43 () {62 vars in 1232 bytes} [Tue Oct 4 18:32:04 2022] POST /compute/v2.1/os-aggregates/6/action => generated 311 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:32:05.477098 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-8a51a674-c00c-4afb-afff-83d9fdd6e29e tempest-AggregatesAdminTestJSON-1163717784 tempest-AggregatesAdminTestJSON-1163717784-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-155094213", "name": "tempest-test_aggregate-1012917728"}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:05.500405 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.objects.aggregate [None req-8a51a674-c00c-4afb-afff-83d9fdd6e29e tempest-AggregatesAdminTestJSON-1163717784 tempest-AggregatesAdminTestJSON-1163717784-project-admin] Generated uuid d35d0c88-8c13-4103-bbf8-1c7689c74bce for aggregate {{(pid=123595) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 18:32:05.549028 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-8a51a674-c00c-4afb-afff-83d9fdd6e29e tempest-AggregatesAdminTestJSON-1163717784 tempest-AggregatesAdminTestJSON-1163717784-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.076542 Oct 04 18:32:05.550011 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 113/251] 10.222.0.43 () {60 vars in 1165 bytes} [Tue Oct 4 18:32:05 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:32:05.651134 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-15e607b4-75bc-4309-82a6-b0295fbbda08 tempest-QuotasAdminNegativeTest-2139852703 tempest-QuotasAdminNegativeTest-2139852703-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1885252085", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452"}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:05.725037 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.network.neutron [None req-15e607b4-75bc-4309-82a6-b0295fbbda08 tempest-QuotasAdminNegativeTest-2139852703 tempest-QuotasAdminNegativeTest-2139852703-project] validate_networks() for None {{(pid=123595) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:32:05.764921 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-3a0bf66a-ddbc-4764-9352-38c4c6fd6c23 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7db99f361654711bea7f1b2c404d312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7adedcdb9c3485ea2738c00e25aa3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:05.779544 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-3a0bf66a-ddbc-4764-9352-38c4c6fd6c23 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] 10.222.0.43 "GET /compute/v2.1/servers/c4b812d5-f2ff-41c7-b912-3d19d752340b" status: 200 len: 1319 microversion: 2.1 time: 0.901139 Oct 04 18:32:05.784238 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 139/252] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:04 2022] GET /compute/v2.1/servers/c4b812d5-f2ff-41c7-b912-3d19d752340b => generated 1319 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:05.791757 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-6a18c5cc-4951-4cd8-bf39-48860e318106 req-67da61d8-b9a6-476e-bcc7-5e4eec54ed8e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4b812d5-f2ff-41c7-b912-3d19d752340b", "tag": "67d0d477-8fa7-442f-a5da-9f7866a73c5b"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:05.818359 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-6a18c5cc-4951-4cd8-bf39-48860e318106 req-67da61d8-b9a6-476e-bcc7-5e4eec54ed8e service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:05.818836 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-6a18c5cc-4951-4cd8-bf39-48860e318106 req-67da61d8-b9a6-476e-bcc7-5e4eec54ed8e service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:05.819517 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-6a18c5cc-4951-4cd8-bf39-48860e318106 req-67da61d8-b9a6-476e-bcc7-5e4eec54ed8e service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:05.844470 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-6a18c5cc-4951-4cd8-bf39-48860e318106 req-67da61d8-b9a6-476e-bcc7-5e4eec54ed8e service nova] Creating event network-changed:67d0d477-8fa7-442f-a5da-9f7866a73c5b for instance c4b812d5-f2ff-41c7-b912-3d19d752340b on n-h1-851028-13 Oct 04 18:32:05.858986 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-6a18c5cc-4951-4cd8-bf39-48860e318106 req-67da61d8-b9a6-476e-bcc7-5e4eec54ed8e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073118 Oct 04 18:32:05.862823 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 140/253] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:32:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:32:05.873011 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-0485482c-bc38-44cf-a12f-3ea8c1d98f8e tempest-AggregatesAdminTestV241-1809718964 tempest-AggregatesAdminTestV241-1809718964-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-851028-13"}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:05.896192 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0485482c-bc38-44cf-a12f-3ea8c1d98f8e tempest-AggregatesAdminTestV241-1809718964 tempest-AggregatesAdminTestV241-1809718964-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:05.897205 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0485482c-bc38-44cf-a12f-3ea8c1d98f8e tempest-AggregatesAdminTestV241-1809718964 tempest-AggregatesAdminTestV241-1809718964-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:05.897491 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0485482c-bc38-44cf-a12f-3ea8c1d98f8e tempest-AggregatesAdminTestV241-1809718964 tempest-AggregatesAdminTestV241-1809718964-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:06.106760 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-0485482c-bc38-44cf-a12f-3ea8c1d98f8e tempest-AggregatesAdminTestV241-1809718964 tempest-AggregatesAdminTestV241-1809718964-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates/6/action" status: 200 len: 295 microversion: 2.41 time: 0.242609 Oct 04 18:32:06.107687 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 141/254] 10.222.0.43 () {62 vars in 1232 bytes} [Tue Oct 4 18:32:05 2022] POST /compute/v2.1/os-aggregates/6/action => generated 295 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:32:06.115923 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-ba8e3146-419b-45e2-ad8f-0ed1a631d930 tempest-AggregatesAdminTestJSON-1163717784 tempest-AggregatesAdminTestJSON-1163717784-project-admin] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:06.190701 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-ba8e3146-419b-45e2-ad8f-0ed1a631d930 tempest-AggregatesAdminTestJSON-1163717784 tempest-AggregatesAdminTestJSON-1163717784-project-admin] 10.222.0.43 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.081682 Oct 04 18:32:06.192383 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 142/255] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Oct 4 18:32:06 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 18:32:06.198397 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-251fc653-6381-4d25-9845-69613f1b9e0f tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:06.199470 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-251fc653-6381-4d25-9845-69613f1b9e0f tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] [instance: b249a7cd-d1ee-4a74-a93d-9991ba84785f] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:06.210587 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-251fc653-6381-4d25-9845-69613f1b9e0f tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:06.212996 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-251fc653-6381-4d25-9845-69613f1b9e0f tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:06.213631 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-251fc653-6381-4d25-9845-69613f1b9e0f tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:06.215662 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-251fc653-6381-4d25-9845-69613f1b9e0f tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:06.216206 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-251fc653-6381-4d25-9845-69613f1b9e0f tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:06.216765 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-251fc653-6381-4d25-9845-69613f1b9e0f tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:06.412698 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-15e607b4-75bc-4309-82a6-b0295fbbda08 tempest-QuotasAdminNegativeTest-2139852703 tempest-QuotasAdminNegativeTest-2139852703-project] Flavor limits 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:32:06.413696 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-15e607b4-75bc-4309-82a6-b0295fbbda08 tempest-QuotasAdminNegativeTest-2139852703 tempest-QuotasAdminNegativeTest-2139852703-project] Image limits 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:32:06.414640 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-15e607b4-75bc-4309-82a6-b0295fbbda08 tempest-QuotasAdminNegativeTest-2139852703 tempest-QuotasAdminNegativeTest-2139852703-project] Flavor pref 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:32:06.415098 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-15e607b4-75bc-4309-82a6-b0295fbbda08 tempest-QuotasAdminNegativeTest-2139852703 tempest-QuotasAdminNegativeTest-2139852703-project] Image pref 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:32:06.415642 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-15e607b4-75bc-4309-82a6-b0295fbbda08 tempest-QuotasAdminNegativeTest-2139852703 tempest-QuotasAdminNegativeTest-2139852703-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:32:06.425947 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-15e607b4-75bc-4309-82a6-b0295fbbda08 tempest-QuotasAdminNegativeTest-2139852703 tempest-QuotasAdminNegativeTest-2139852703-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:06.426560 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-15e607b4-75bc-4309-82a6-b0295fbbda08 tempest-QuotasAdminNegativeTest-2139852703 tempest-QuotasAdminNegativeTest-2139852703-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:06.427121 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-15e607b4-75bc-4309-82a6-b0295fbbda08 tempest-QuotasAdminNegativeTest-2139852703 tempest-QuotasAdminNegativeTest-2139852703-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:06.428043 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-15e607b4-75bc-4309-82a6-b0295fbbda08 tempest-QuotasAdminNegativeTest-2139852703 tempest-QuotasAdminNegativeTest-2139852703-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:06.428735 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-15e607b4-75bc-4309-82a6-b0295fbbda08 tempest-QuotasAdminNegativeTest-2139852703 tempest-QuotasAdminNegativeTest-2139852703-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:06.429793 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-15e607b4-75bc-4309-82a6-b0295fbbda08 tempest-QuotasAdminNegativeTest-2139852703 tempest-QuotasAdminNegativeTest-2139852703-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:06.455550 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-15e607b4-75bc-4309-82a6-b0295fbbda08 tempest-QuotasAdminNegativeTest-2139852703 tempest-QuotasAdminNegativeTest-2139852703-project] Getting quotas for project e1fb34a4be434fa2962daf5525d632e8. Resources: {'ram', 'cores', 'instances'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:32:06.462915 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-15e607b4-75bc-4309-82a6-b0295fbbda08 tempest-QuotasAdminNegativeTest-2139852703 tempest-QuotasAdminNegativeTest-2139852703-project] Getting quotas for user 64b8087484564483be1e8cfa6def5046 and project e1fb34a4be434fa2962daf5525d632e8. Resources: {'ram', 'cores', 'instances'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:32:06.477066 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.utils [None req-15e607b4-75bc-4309-82a6-b0295fbbda08 tempest-QuotasAdminNegativeTest-2139852703 tempest-QuotasAdminNegativeTest-2139852703-project] cores quota exceeded for e1fb34a4be434fa2962daf5525d632e8, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=123595) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 04 18:32:06.483275 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-15e607b4-75bc-4309-82a6-b0295fbbda08 tempest-QuotasAdminNegativeTest-2139852703 tempest-QuotasAdminNegativeTest-2139852703-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 04 18:32:06.491309 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-15e607b4-75bc-4309-82a6-b0295fbbda08 tempest-QuotasAdminNegativeTest-2139852703 tempest-QuotasAdminNegativeTest-2139852703-project] Request method failure captured: Oct 04 18:32:06.491309 n-d-851028-13 devstack@n-api.service[123595]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 18:32:06.491309 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 18:32:06.491309 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 18:32:06.491309 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 18:32:06.491309 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 145 Oct 04 18:32:06.491309 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 18:32:06.491309 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 18:32:06.491309 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 18:32:06.491309 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 18:32:06.491309 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPHwi-Ua_l9iiJ14QYxx8rlPrtrTabG5h00Sutrbgr8lSdpttgEFgjCIdpoBaZlpID3aDCKN1kV0uwD4Pw1SB-uO0q2CLOoam6vMvxCekTYvBf2-D-6i8RWJCnOk2evqGnv_v8oE3FjuTVJ917OjclJR9XFwiZKV4lqkYLb9lMkfvMiM Oct 04 18:32:06.491309 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 18:32:06.491309 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 18:32:06.491309 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 18:32:06.491309 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 18:32:06.491309 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 18:32:06.491309 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 18:32:06.491309 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: e1fb34a4be434fa2962daf5525d632e8 Oct 04 18:32:06.491309 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-QuotasAdminNegativeTest-2139852703 Oct 04 18:32:06.491309 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 18:32:06.491309 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 18:32:06.492493 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/e1fb34a4be434fa2962daf5525d632e8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_e1fb34a4be434fa2962daf5525d632e8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/e1fb34a4be434fa2962daf5525d632e8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/e1fb34a4be434fa2962daf5525d632e8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:32:06.492493 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-QuotasAdminNegativeTest-2139852703 Oct 04 18:32:06.492493 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: e1fb34a4be434fa2962daf5525d632e8 Oct 04 18:32:06.492493 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-2139852703 Oct 04 18:32:06.492493 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-QuotasAdminNegativeTest-2139852703-project Oct 04 18:32:06.492493 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 18:32:06.492493 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 18:32:06.492493 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: 64b8087484564483be1e8cfa6def5046 Oct 04 18:32:06.492493 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-QuotasAdminNegativeTest-2139852703-project Oct 04 18:32:06.492493 n-d-851028-13 devstack@n-api.service[123595]: Oct 04 18:32:06.492493 n-d-851028-13 devstack@n-api.service[123595]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1885252085", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452"}} Oct 04 18:32:06.492493 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 18:32:06.493246 n-d-851028-13 devstack@n-api.service[123595]: exception: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 04 18:32:06.493246 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1885252085', 'imageRef': 'e8943ec5-4038-4d4b-b9b9-2415a79f5243', 'flavorRef': '452'}}} Oct 04 18:32:06.493246 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:32:06.493246 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:06.493246 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 04 18:32:06.493246 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 04 18:32:06.493246 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 18:32:06.493246 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 18:32:06.493246 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 04 18:32:06.493246 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc Oct 04 18:32:06.493246 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 04 18:32:06.493246 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 04 18:32:06.493246 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 18:32:06.493246 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 18:32:06.493246 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 04 18:32:06.493246 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 04 18:32:06.493246 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 04 18:32:06.493246 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 04 18:32:06.494198 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 04 18:32:06.494198 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 04 18:32:06.494198 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Oct 04 18:32:06.494198 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:32:06.494198 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:06.494198 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:32:06.494198 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:06.494198 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 18:32:06.494198 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 18:32:06.494198 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 18:32:06.494198 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 18:32:06.494198 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 04 18:32:06.494198 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 04 18:32:06.494198 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 04 18:32:06.494198 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 04 18:32:06.494198 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 04 18:32:06.494198 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 04 18:32:06.494198 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 04 18:32:06.494198 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:32:06.494198 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:06.494198 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:32:06.496690 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:06.496690 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:32:06.496690 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:32:06.496690 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:32:06.496690 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:32:06.496690 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:32:06.496690 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:32:06.496690 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:32:06.496690 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:32:06.496690 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:32:06.496690 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:32:06.496690 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:32:06.496690 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:32:06.496690 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 18:32:06.496690 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 04 18:32:06.496690 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 04 18:32:06.496690 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 04 18:32:06.496690 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:32:06.496690 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:06.496690 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:32:06.496690 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:06.499043 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:32:06.499043 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:32:06.499043 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:32:06.499043 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:32:06.499043 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 04 18:32:06.499043 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:32:06.499043 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-15e607b4-75bc-4309-82a6-b0295fbbda08 tempest-QuotasAdminNegativeTest-2139852703 tempest-QuotasAdminNegativeTest-2139852703-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:32:06.499043 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-15e607b4-75bc-4309-82a6-b0295fbbda08 tempest-QuotasAdminNegativeTest-2139852703 tempest-QuotasAdminNegativeTest-2139852703-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 0.941999 Oct 04 18:32:06.499043 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 114/256] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 18:32:05 2022] POST /compute/v2.1/servers => generated 111 bytes in 944 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:32:06.506735 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-87059331-cbfc-4caa-9add-ed8350a6b302 tempest-AggregatesAdminTestV241-1809718964 tempest-AggregatesAdminTestV241-1809718964-project-admin] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:06.539505 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-87059331-cbfc-4caa-9add-ed8350a6b302 tempest-AggregatesAdminTestV241-1809718964 tempest-AggregatesAdminTestV241-1809718964-project-admin] 10.222.0.43 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.41 time: 0.042670 Oct 04 18:32:06.540792 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 115/257] 10.222.0.43 () {60 vars in 1193 bytes} [Tue Oct 4 18:32:06 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:32:06.547583 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-4735cb2c-1468-4b5c-9a16-988256f81fd7 tempest-AggregatesAdminTestJSON-1163717784 tempest-AggregatesAdminTestJSON-1163717784-project-admin] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:06.561531 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-4735cb2c-1468-4b5c-9a16-988256f81fd7 tempest-AggregatesAdminTestJSON-1163717784 tempest-AggregatesAdminTestJSON-1163717784-project-admin] HTTP exception thrown: Aggregate 7 could not be found. Oct 04 18:32:06.564589 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-4735cb2c-1468-4b5c-9a16-988256f81fd7 tempest-AggregatesAdminTestJSON-1163717784 tempest-AggregatesAdminTestJSON-1163717784-project-admin] Request method failure captured: Oct 04 18:32:06.564589 n-d-851028-13 devstack@n-api.service[123595]: request: GET /compute/v2.1/os-aggregates/7 HTTP/1.1 Oct 04 18:32:06.564589 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 18:32:06.564589 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 18:32:06.564589 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 18:32:06.564589 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 0 Oct 04 18:32:06.564589 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 18:32:06.564589 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 18:32:06.564589 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 18:32:06.564589 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 18:32:06.564589 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPHvu-dcbDdMcTg-li6hOYmAehdfaeV4blYGwnFLiKnPz4yCysrB24V-kx4VUx--gORd_xrfj9e9nwTig-nWLrPYuvt_Yuyc2fdsjqBAlkImkAo7Bg1uWiOPx8WNKE7UPM1zBuDSvrOGXUUZmskLOeCUQF-8Ht9nddyt_H9XK14MXw9w Oct 04 18:32:06.564589 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 18:32:06.564589 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 18:32:06.564589 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 18:32:06.564589 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 18:32:06.564589 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 18:32:06.564589 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 18:32:06.564589 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: d7ac7d10e76a46b5bb37151ede27eede Oct 04 18:32:06.564589 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-AggregatesAdminTestJSON-1163717784 Oct 04 18:32:06.564589 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,admin,reader Oct 04 18:32:06.564589 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,admin,reader Oct 04 18:32:06.565989 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/d7ac7d10e76a46b5bb37151ede27eede"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_d7ac7d10e76a46b5bb37151ede27eede"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d7ac7d10e76a46b5bb37151ede27eede"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d7ac7d10e76a46b5bb37151ede27eede"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:32:06.565989 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-AggregatesAdminTestJSON-1163717784 Oct 04 18:32:06.565989 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: d7ac7d10e76a46b5bb37151ede27eede Oct 04 18:32:06.565989 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1163717784 Oct 04 18:32:06.565989 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-AggregatesAdminTestJSON-1163717784-project-admin Oct 04 18:32:06.565989 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 18:32:06.565989 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 18:32:06.565989 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: e522cd6e77e1454dab2d38ad32278532 Oct 04 18:32:06.565989 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-AggregatesAdminTestJSON-1163717784-project-admin Oct 04 18:32:06.565989 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 18:32:06.565989 n-d-851028-13 devstack@n-api.service[123595]: exception: Aggregate 7 could not be found. Oct 04 18:32:06.565989 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': '7'} Oct 04 18:32:06.565989 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:32:06.566829 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:06.566829 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 04 18:32:06.566829 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 04 18:32:06.566829 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Oct 04 18:32:06.566829 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 04 18:32:06.566829 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 18:32:06.566829 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 18:32:06.566829 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 04 18:32:06.566829 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 04 18:32:06.566829 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 18:32:06.566829 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 18:32:06.566829 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 04 18:32:06.566829 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 04 18:32:06.566829 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 7 could not be found. Oct 04 18:32:06.566829 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:32:06.566829 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:06.566829 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:32:06.566829 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:06.566829 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:32:06.567837 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:32:06.567837 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:32:06.567837 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:32:06.567837 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:32:06.567837 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:32:06.567837 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 04 18:32:06.567837 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:32:06.567837 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 7 could not be found. Oct 04 18:32:06.567837 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:32:06.567837 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:06.567837 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:32:06.567837 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:06.567837 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:32:06.567837 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:32:06.567837 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:32:06.567837 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:32:06.567837 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 7 could not be found. Oct 04 18:32:06.567837 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:32:06.568940 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-4735cb2c-1468-4b5c-9a16-988256f81fd7 tempest-AggregatesAdminTestJSON-1163717784 tempest-AggregatesAdminTestJSON-1163717784-project-admin] Returning 404 to user: Aggregate 7 could not be found. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:32:06.568940 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-4735cb2c-1468-4b5c-9a16-988256f81fd7 tempest-AggregatesAdminTestJSON-1163717784 tempest-AggregatesAdminTestJSON-1163717784-project-admin] 10.222.0.43 "GET /compute/v2.1/os-aggregates/7" status: 404 len: 77 microversion: 2.1 time: 0.023412 Oct 04 18:32:06.568940 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 116/258] 10.222.0.43 () {58 vars in 1149 bytes} [Tue Oct 4 18:32:06 2022] GET /compute/v2.1/os-aggregates/7 => generated 77 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:32:06.574498 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-e723397d-0a65-473a-96b2-7c3515d32e8e tempest-QuotasAdminNegativeTest-2112941160 tempest-QuotasAdminNegativeTest-2112941160-project-admin] Action: 'update', calling method: .version_select at 0x7fb2244fae50>, body: {"quota_set": {"cores": 20}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:06.663452 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e723397d-0a65-473a-96b2-7c3515d32e8e tempest-QuotasAdminNegativeTest-2112941160 tempest-QuotasAdminNegativeTest-2112941160-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:06.664377 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e723397d-0a65-473a-96b2-7c3515d32e8e tempest-QuotasAdminNegativeTest-2112941160 tempest-QuotasAdminNegativeTest-2112941160-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:06.665029 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e723397d-0a65-473a-96b2-7c3515d32e8e tempest-QuotasAdminNegativeTest-2112941160 tempest-QuotasAdminNegativeTest-2112941160-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:06.666077 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e723397d-0a65-473a-96b2-7c3515d32e8e tempest-QuotasAdminNegativeTest-2112941160 tempest-QuotasAdminNegativeTest-2112941160-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:06.666756 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e723397d-0a65-473a-96b2-7c3515d32e8e tempest-QuotasAdminNegativeTest-2112941160 tempest-QuotasAdminNegativeTest-2112941160-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:06.667443 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e723397d-0a65-473a-96b2-7c3515d32e8e tempest-QuotasAdminNegativeTest-2112941160 tempest-QuotasAdminNegativeTest-2112941160-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:06.727604 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-251fc653-6381-4d25-9845-69613f1b9e0f tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '459e65f14af049bba311453d6a86360b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1753b9ee9a644e409a1efd0c9e7c152c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:06.739261 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-251fc653-6381-4d25-9845-69613f1b9e0f tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] 10.222.0.43 "GET /compute/v2.1/servers/b249a7cd-d1ee-4a74-a93d-9991ba84785f" status: 200 len: 1319 microversion: 2.1 time: 0.545582 Oct 04 18:32:06.739868 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 143/259] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:06 2022] GET /compute/v2.1/servers/b249a7cd-d1ee-4a74-a93d-9991ba84785f => generated 1319 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:06.741570 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=7,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:32:06.757393 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-d911f24f-84a3-4992-b2c3-e22a4e55c68b tempest-HostsAdminTestJSON-1163831172 tempest-HostsAdminTestJSON-1163831172-project-admin] Calling method '.version_select at 0x7fb224774160>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:06.763606 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d911f24f-84a3-4992-b2c3-e22a4e55c68b tempest-HostsAdminTestJSON-1163831172 tempest-HostsAdminTestJSON-1163831172-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:06.764334 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d911f24f-84a3-4992-b2c3-e22a4e55c68b tempest-HostsAdminTestJSON-1163831172 tempest-HostsAdminTestJSON-1163831172-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:06.766905 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d911f24f-84a3-4992-b2c3-e22a4e55c68b tempest-HostsAdminTestJSON-1163831172 tempest-HostsAdminTestJSON-1163831172-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:06.768466 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d911f24f-84a3-4992-b2c3-e22a4e55c68b tempest-HostsAdminTestJSON-1163831172 tempest-HostsAdminTestJSON-1163831172-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:06.770472 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d911f24f-84a3-4992-b2c3-e22a4e55c68b tempest-HostsAdminTestJSON-1163831172 tempest-HostsAdminTestJSON-1163831172-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:06.771329 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d911f24f-84a3-4992-b2c3-e22a4e55c68b tempest-HostsAdminTestJSON-1163831172 tempest-HostsAdminTestJSON-1163831172-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:06.782872 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-e723397d-0a65-473a-96b2-7c3515d32e8e tempest-QuotasAdminNegativeTest-2112941160 tempest-QuotasAdminNegativeTest-2112941160-project-admin] 10.222.0.43 "PUT /compute/v2.1/os-quota-sets/e1fb34a4be434fa2962daf5525d632e8" status: 200 len: 329 microversion: 2.1 time: 0.212989 Oct 04 18:32:06.794525 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 117/260] 10.222.0.43 () {60 vars in 1262 bytes} [Tue Oct 4 18:32:06 2022] PUT /compute/v2.1/os-quota-sets/e1fb34a4be434fa2962daf5525d632e8 => generated 329 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:32:06.812029 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-79a78cec-75cc-476e-9eae-a0b3964a0203 tempest-AggregatesAdminTestJSON-1163717784 tempest-AggregatesAdminTestJSON-1163717784-project-admin] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:06.832950 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-79a78cec-75cc-476e-9eae-a0b3964a0203 tempest-AggregatesAdminTestJSON-1163717784 tempest-AggregatesAdminTestJSON-1163717784-project-admin] HTTP exception thrown: Aggregate 7 could not be found. Oct 04 18:32:06.836067 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-79a78cec-75cc-476e-9eae-a0b3964a0203 tempest-AggregatesAdminTestJSON-1163717784 tempest-AggregatesAdminTestJSON-1163717784-project-admin] Request method failure captured: Oct 04 18:32:06.836067 n-d-851028-13 devstack@n-api.service[123595]: request: DELETE /compute/v2.1/os-aggregates/7 HTTP/1.1 Oct 04 18:32:06.836067 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 18:32:06.836067 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 18:32:06.836067 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 18:32:06.836067 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 0 Oct 04 18:32:06.836067 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 18:32:06.836067 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 18:32:06.836067 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 18:32:06.836067 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 18:32:06.836067 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPHvu-dcbDdMcTg-li6hOYmAehdfaeV4blYGwnFLiKnPz4yCysrB24V-kx4VUx--gORd_xrfj9e9nwTig-nWLrPYuvt_Yuyc2fdsjqBAlkImkAo7Bg1uWiOPx8WNKE7UPM1zBuDSvrOGXUUZmskLOeCUQF-8Ht9nddyt_H9XK14MXw9w Oct 04 18:32:06.836067 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 18:32:06.836067 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 18:32:06.836067 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 18:32:06.836067 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 18:32:06.836067 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 18:32:06.836067 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 18:32:06.836067 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: d7ac7d10e76a46b5bb37151ede27eede Oct 04 18:32:06.836067 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-AggregatesAdminTestJSON-1163717784 Oct 04 18:32:06.836067 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,admin,reader Oct 04 18:32:06.836067 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,admin,reader Oct 04 18:32:06.837326 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/d7ac7d10e76a46b5bb37151ede27eede"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_d7ac7d10e76a46b5bb37151ede27eede"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d7ac7d10e76a46b5bb37151ede27eede"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d7ac7d10e76a46b5bb37151ede27eede"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:32:06.837326 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-AggregatesAdminTestJSON-1163717784 Oct 04 18:32:06.837326 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: d7ac7d10e76a46b5bb37151ede27eede Oct 04 18:32:06.837326 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1163717784 Oct 04 18:32:06.837326 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-AggregatesAdminTestJSON-1163717784-project-admin Oct 04 18:32:06.837326 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 18:32:06.837326 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 18:32:06.837326 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: e522cd6e77e1454dab2d38ad32278532 Oct 04 18:32:06.837326 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-AggregatesAdminTestJSON-1163717784-project-admin Oct 04 18:32:06.837326 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 18:32:06.837326 n-d-851028-13 devstack@n-api.service[123595]: exception: Aggregate 7 could not be found. Oct 04 18:32:06.837326 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': '7'} Oct 04 18:32:06.837326 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:32:06.838056 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:06.838056 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 04 18:32:06.838056 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 04 18:32:06.838056 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 04 18:32:06.838056 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 04 18:32:06.838056 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:32:06.838056 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:32:06.838056 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:32:06.838056 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:32:06.838056 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 04 18:32:06.838056 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 04 18:32:06.838056 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Oct 04 18:32:06.838056 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 04 18:32:06.838056 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 18:32:06.838056 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 18:32:06.838056 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 04 18:32:06.838056 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 04 18:32:06.838056 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 18:32:06.838056 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 18:32:06.839253 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 04 18:32:06.839253 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 04 18:32:06.839253 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 7 could not be found. Oct 04 18:32:06.839253 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:32:06.839253 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:06.839253 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:32:06.839253 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:06.839253 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:32:06.839253 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:32:06.839253 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:32:06.839253 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:32:06.839253 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:32:06.839253 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:32:06.839253 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 04 18:32:06.839253 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:32:06.839253 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 7 could not be found. Oct 04 18:32:06.839253 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:32:06.839253 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:06.839253 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:32:06.839253 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:06.839253 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:32:06.840328 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:32:06.840328 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:32:06.840328 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:32:06.840328 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 7 could not be found. Oct 04 18:32:06.840328 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:32:06.845028 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-79a78cec-75cc-476e-9eae-a0b3964a0203 tempest-AggregatesAdminTestJSON-1163717784 tempest-AggregatesAdminTestJSON-1163717784-project-admin] Returning 404 to user: Aggregate 7 could not be found. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:32:06.846414 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-79a78cec-75cc-476e-9eae-a0b3964a0203 tempest-AggregatesAdminTestJSON-1163717784 tempest-AggregatesAdminTestJSON-1163717784-project-admin] 10.222.0.43 "DELETE /compute/v2.1/os-aggregates/7" status: 404 len: 77 microversion: 2.1 time: 0.049778 Oct 04 18:32:06.846977 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-d911f24f-84a3-4992-b2c3-e22a4e55c68b tempest-HostsAdminTestJSON-1163831172 tempest-HostsAdminTestJSON-1163831172-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hosts" status: 200 len: 381 microversion: 2.1 time: 0.101730 Oct 04 18:32:06.847735 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 118/261] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Oct 4 18:32:06 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 77 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:32:06.854464 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-9a312ad8-bc7c-402d-a849-e87f2a486e13 tempest-QuotasAdminNegativeTest-2112941160 tempest-QuotasAdminNegativeTest-2112941160-project-admin] Calling method '.version_select at 0x7fb2244850d0>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:06.855527 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 144/262] 10.222.0.43 () {58 vars in 1128 bytes} [Tue Oct 4 18:32:06 2022] GET /compute/v2.1/os-hosts => generated 381 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:32:06.865233 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-be0e5d61-0db2-4976-b4a6-e2f5049e0c64 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:06.865781 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-be0e5d61-0db2-4976-b4a6-e2f5049e0c64 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] [instance: c4b812d5-f2ff-41c7-b912-3d19d752340b] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:06.885232 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-be0e5d61-0db2-4976-b4a6-e2f5049e0c64 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:06.885895 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-be0e5d61-0db2-4976-b4a6-e2f5049e0c64 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:06.886558 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-be0e5d61-0db2-4976-b4a6-e2f5049e0c64 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:06.888205 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-be0e5d61-0db2-4976-b4a6-e2f5049e0c64 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:06.888852 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-be0e5d61-0db2-4976-b4a6-e2f5049e0c64 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:06.889489 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-be0e5d61-0db2-4976-b4a6-e2f5049e0c64 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:07.171160 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-9a312ad8-bc7c-402d-a849-e87f2a486e13 tempest-QuotasAdminNegativeTest-2112941160 tempest-QuotasAdminNegativeTest-2112941160-project-admin] 10.222.0.43 "GET /compute/v2.1/os-quota-sets/e1fb34a4be434fa2962daf5525d632e8" status: 200 len: 371 microversion: 2.1 time: 0.321984 Oct 04 18:32:07.172314 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 119/263] 10.222.0.43 () {58 vars in 1242 bytes} [Tue Oct 4 18:32:06 2022] GET /compute/v2.1/os-quota-sets/e1fb34a4be434fa2962daf5525d632e8 => generated 371 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:32:07.177939 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-5231ba79-e458-401f-a9ff-b5872f75b2bf tempest-HostsAdminTestJSON-1163831172 tempest-HostsAdminTestJSON-1163831172-project-admin] Calling method '.version_select at 0x7fb2244851f0>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:07.185208 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5231ba79-e458-401f-a9ff-b5872f75b2bf tempest-HostsAdminTestJSON-1163831172 tempest-HostsAdminTestJSON-1163831172-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:07.186019 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5231ba79-e458-401f-a9ff-b5872f75b2bf tempest-HostsAdminTestJSON-1163831172 tempest-HostsAdminTestJSON-1163831172-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:07.187186 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5231ba79-e458-401f-a9ff-b5872f75b2bf tempest-HostsAdminTestJSON-1163831172 tempest-HostsAdminTestJSON-1163831172-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:07.188398 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5231ba79-e458-401f-a9ff-b5872f75b2bf tempest-HostsAdminTestJSON-1163831172 tempest-HostsAdminTestJSON-1163831172-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:07.188907 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5231ba79-e458-401f-a9ff-b5872f75b2bf tempest-HostsAdminTestJSON-1163831172 tempest-HostsAdminTestJSON-1163831172-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:07.189398 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5231ba79-e458-401f-a9ff-b5872f75b2bf tempest-HostsAdminTestJSON-1163831172 tempest-HostsAdminTestJSON-1163831172-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:07.222800 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-5231ba79-e458-401f-a9ff-b5872f75b2bf tempest-HostsAdminTestJSON-1163831172 tempest-HostsAdminTestJSON-1163831172-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 239 microversion: 2.1 time: 0.049057 Oct 04 18:32:07.223437 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 120/264] 10.222.0.43 () {58 vars in 1155 bytes} [Tue Oct 4 18:32:07 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 239 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:32:07.230917 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-38e3f441-320d-45cc-a14d-9486af55eb6b tempest-AggregatesAdminTestJSON-1163717784 tempest-AggregatesAdminTestJSON-1163717784-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1493404050"}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:07.234387 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.objects.aggregate [None req-38e3f441-320d-45cc-a14d-9486af55eb6b tempest-AggregatesAdminTestJSON-1163717784 tempest-AggregatesAdminTestJSON-1163717784-project-admin] Generated uuid b201aa54-4f80-41ec-b719-f7828e14bcfa for aggregate {{(pid=123595) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 18:32:07.296061 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-38e3f441-320d-45cc-a14d-9486af55eb6b tempest-AggregatesAdminTestJSON-1163717784 tempest-AggregatesAdminTestJSON-1163717784-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.071238 Oct 04 18:32:07.296701 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 121/265] 10.222.0.43 () {60 vars in 1164 bytes} [Tue Oct 4 18:32:07 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:32:07.302667 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-7c23b153-c8f6-4c14-94d2-8dfa0e766fa0 tempest-QuotasAdminNegativeTest-2112941160 tempest-QuotasAdminNegativeTest-2112941160-project-admin] Action: 'update', calling method: .version_select at 0x7fb2244858b0>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:07.367423 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-be0e5d61-0db2-4976-b4a6-e2f5049e0c64 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7db99f361654711bea7f1b2c404d312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7adedcdb9c3485ea2738c00e25aa3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:07.378930 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-be0e5d61-0db2-4976-b4a6-e2f5049e0c64 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] 10.222.0.43 "GET /compute/v2.1/servers/c4b812d5-f2ff-41c7-b912-3d19d752340b" status: 200 len: 1319 microversion: 2.1 time: 0.521733 Oct 04 18:32:07.382287 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 145/266] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:06 2022] GET /compute/v2.1/servers/c4b812d5-f2ff-41c7-b912-3d19d752340b => generated 1319 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:07.401942 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7c23b153-c8f6-4c14-94d2-8dfa0e766fa0 tempest-QuotasAdminNegativeTest-2112941160 tempest-QuotasAdminNegativeTest-2112941160-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:07.402577 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7c23b153-c8f6-4c14-94d2-8dfa0e766fa0 tempest-QuotasAdminNegativeTest-2112941160 tempest-QuotasAdminNegativeTest-2112941160-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:07.403040 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7c23b153-c8f6-4c14-94d2-8dfa0e766fa0 tempest-QuotasAdminNegativeTest-2112941160 tempest-QuotasAdminNegativeTest-2112941160-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:07.404207 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7c23b153-c8f6-4c14-94d2-8dfa0e766fa0 tempest-QuotasAdminNegativeTest-2112941160 tempest-QuotasAdminNegativeTest-2112941160-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:07.404679 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7c23b153-c8f6-4c14-94d2-8dfa0e766fa0 tempest-QuotasAdminNegativeTest-2112941160 tempest-QuotasAdminNegativeTest-2112941160-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:07.405595 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7c23b153-c8f6-4c14-94d2-8dfa0e766fa0 tempest-QuotasAdminNegativeTest-2112941160 tempest-QuotasAdminNegativeTest-2112941160-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:07.415479 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-cae48ac3-90b4-4371-b2fb-307c39621e33 tempest-HostsAdminTestJSON-1163831172 tempest-HostsAdminTestJSON-1163831172-project-admin] Calling method '.version_select at 0x7fb2249603a0>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:07.419911 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cae48ac3-90b4-4371-b2fb-307c39621e33 tempest-HostsAdminTestJSON-1163831172 tempest-HostsAdminTestJSON-1163831172-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:07.426181 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cae48ac3-90b4-4371-b2fb-307c39621e33 tempest-HostsAdminTestJSON-1163831172 tempest-HostsAdminTestJSON-1163831172-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:07.426901 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cae48ac3-90b4-4371-b2fb-307c39621e33 tempest-HostsAdminTestJSON-1163831172 tempest-HostsAdminTestJSON-1163831172-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:07.428166 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cae48ac3-90b4-4371-b2fb-307c39621e33 tempest-HostsAdminTestJSON-1163831172 tempest-HostsAdminTestJSON-1163831172-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:07.428839 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cae48ac3-90b4-4371-b2fb-307c39621e33 tempest-HostsAdminTestJSON-1163831172 tempest-HostsAdminTestJSON-1163831172-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:07.429493 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cae48ac3-90b4-4371-b2fb-307c39621e33 tempest-HostsAdminTestJSON-1163831172 tempest-HostsAdminTestJSON-1163831172-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:07.490428 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-7c23b153-c8f6-4c14-94d2-8dfa0e766fa0 tempest-QuotasAdminNegativeTest-2112941160 tempest-QuotasAdminNegativeTest-2112941160-project-admin] 10.222.0.43 "PUT /compute/v2.1/os-quota-sets/e1fb34a4be434fa2962daf5525d632e8" status: 200 len: 328 microversion: 2.1 time: 0.192068 Oct 04 18:32:07.505147 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 122/267] 10.222.0.43 () {60 vars in 1262 bytes} [Tue Oct 4 18:32:07 2022] PUT /compute/v2.1/os-quota-sets/e1fb34a4be434fa2962daf5525d632e8 => generated 328 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:32:07.505348 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-cae48ac3-90b4-4371-b2fb-307c39621e33 tempest-HostsAdminTestJSON-1163831172 tempest-HostsAdminTestJSON-1163831172-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hosts" status: 200 len: 381 microversion: 2.1 time: 0.101288 Oct 04 18:32:07.505348 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 146/268] 10.222.0.43 () {58 vars in 1128 bytes} [Tue Oct 4 18:32:07 2022] GET /compute/v2.1/os-hosts => generated 381 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:32:07.505484 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-d68120b6-3e25-4a03-be2a-b730e6745612 tempest-AggregatesAdminTestJSON-1163717784 tempest-AggregatesAdminTestJSON-1163717784-project-admin] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:07.514759 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-2c999a9c-6beb-4ab6-bef3-b09dceea1f6b tempest-HostsAdminTestJSON-1163831172 tempest-HostsAdminTestJSON-1163831172-project-admin] Calling method '.version_select at 0x7fb2248a3b80>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:07.531104 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2c999a9c-6beb-4ab6-bef3-b09dceea1f6b tempest-HostsAdminTestJSON-1163831172 tempest-HostsAdminTestJSON-1163831172-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:07.531228 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-d68120b6-3e25-4a03-be2a-b730e6745612 tempest-AggregatesAdminTestJSON-1163717784 tempest-AggregatesAdminTestJSON-1163717784-project-admin] 10.222.0.43 "GET /compute/v2.1/os-aggregates/8" status: 200 len: 227 microversion: 2.1 time: 0.038202 Oct 04 18:32:07.531683 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2c999a9c-6beb-4ab6-bef3-b09dceea1f6b tempest-HostsAdminTestJSON-1163831172 tempest-HostsAdminTestJSON-1163831172-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:07.531880 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 123/269] 10.222.0.43 () {58 vars in 1149 bytes} [Tue Oct 4 18:32:07 2022] GET /compute/v2.1/os-aggregates/8 => generated 227 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:32:07.540926 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2c999a9c-6beb-4ab6-bef3-b09dceea1f6b tempest-HostsAdminTestJSON-1163831172 tempest-HostsAdminTestJSON-1163831172-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:07.559385 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-dcab7a15-3c47-4a00-9d21-095dd9d6c937 tempest-AggregatesAdminTestJSON-1163717784 tempest-AggregatesAdminTestJSON-1163717784-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:07.575238 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2c999a9c-6beb-4ab6-bef3-b09dceea1f6b tempest-HostsAdminTestJSON-1163831172 tempest-HostsAdminTestJSON-1163831172-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:07.575732 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2c999a9c-6beb-4ab6-bef3-b09dceea1f6b tempest-HostsAdminTestJSON-1163831172 tempest-HostsAdminTestJSON-1163831172-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:07.576170 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2c999a9c-6beb-4ab6-bef3-b09dceea1f6b tempest-HostsAdminTestJSON-1163831172 tempest-HostsAdminTestJSON-1163831172-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:07.644202 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-dcab7a15-3c47-4a00-9d21-095dd9d6c937 tempest-AggregatesAdminTestJSON-1163717784 tempest-AggregatesAdminTestJSON-1163717784-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates/8/action" status: 200 len: 265 microversion: 2.1 time: 0.093143 Oct 04 18:32:07.646907 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 124/270] 10.222.0.43 () {60 vars in 1191 bytes} [Tue Oct 4 18:32:07 2022] POST /compute/v2.1/os-aggregates/8/action => generated 265 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:32:07.653614 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-2c999a9c-6beb-4ab6-bef3-b09dceea1f6b tempest-HostsAdminTestJSON-1163831172 tempest-HostsAdminTestJSON-1163831172-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hosts/n-h2-851028-13" status: 200 len: 603 microversion: 2.1 time: 0.145631 Oct 04 18:32:07.660001 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-1b768648-d8e7-4012-bbea-671a89fdd8f0 tempest-AggregatesAdminTestJSON-1163717784 tempest-AggregatesAdminTestJSON-1163717784-project-admin] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:07.660943 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 147/271] 10.222.0.43 () {58 vars in 1173 bytes} [Tue Oct 4 18:32:07 2022] GET /compute/v2.1/os-hosts/n-h2-851028-13 => generated 603 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:32:07.670417 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-0cdd1d35-8b8e-479c-afdf-c0ae875c0bd6 tempest-HostsAdminTestJSON-1163831172 tempest-HostsAdminTestJSON-1163831172-project-admin] Calling method '.version_select at 0x7fb2245b6a60>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:07.681576 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-1b768648-d8e7-4012-bbea-671a89fdd8f0 tempest-AggregatesAdminTestJSON-1163717784 tempest-AggregatesAdminTestJSON-1163717784-project-admin] 10.222.0.43 "GET /compute/v2.1/os-aggregates/8" status: 200 len: 241 microversion: 2.1 time: 0.026007 Oct 04 18:32:07.683982 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 125/272] 10.222.0.43 () {58 vars in 1149 bytes} [Tue Oct 4 18:32:07 2022] GET /compute/v2.1/os-aggregates/8 => generated 241 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:32:07.693888 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0cdd1d35-8b8e-479c-afdf-c0ae875c0bd6 tempest-HostsAdminTestJSON-1163831172 tempest-HostsAdminTestJSON-1163831172-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:07.694953 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0cdd1d35-8b8e-479c-afdf-c0ae875c0bd6 tempest-HostsAdminTestJSON-1163831172 tempest-HostsAdminTestJSON-1163831172-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:07.695792 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0cdd1d35-8b8e-479c-afdf-c0ae875c0bd6 tempest-HostsAdminTestJSON-1163831172 tempest-HostsAdminTestJSON-1163831172-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:07.701460 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-dea25abc-081f-44c4-9bb3-f0d43068f52b tempest-AggregatesAdminTestJSON-1163717784 tempest-AggregatesAdminTestJSON-1163717784-project-admin] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:07.746316 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0cdd1d35-8b8e-479c-afdf-c0ae875c0bd6 tempest-HostsAdminTestJSON-1163831172 tempest-HostsAdminTestJSON-1163831172-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:07.747556 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0cdd1d35-8b8e-479c-afdf-c0ae875c0bd6 tempest-HostsAdminTestJSON-1163831172 tempest-HostsAdminTestJSON-1163831172-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:07.748412 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0cdd1d35-8b8e-479c-afdf-c0ae875c0bd6 tempest-HostsAdminTestJSON-1163831172 tempest-HostsAdminTestJSON-1163831172-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:07.769519 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-dea25abc-081f-44c4-9bb3-f0d43068f52b tempest-AggregatesAdminTestJSON-1163717784 tempest-AggregatesAdminTestJSON-1163717784-project-admin] 10.222.0.43 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.074496 Oct 04 18:32:07.770123 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 126/273] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Oct 4 18:32:07 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Oct 04 18:32:07.785080 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-cd0157c2-5e1c-4e20-8233-9cec45e23148 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:07.785928 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-cd0157c2-5e1c-4e20-8233-9cec45e23148 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] [instance: b249a7cd-d1ee-4a74-a93d-9991ba84785f] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:07.809350 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cd0157c2-5e1c-4e20-8233-9cec45e23148 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:07.812222 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cd0157c2-5e1c-4e20-8233-9cec45e23148 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:07.812683 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cd0157c2-5e1c-4e20-8233-9cec45e23148 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:07.813575 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cd0157c2-5e1c-4e20-8233-9cec45e23148 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:07.817391 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cd0157c2-5e1c-4e20-8233-9cec45e23148 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:07.819054 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cd0157c2-5e1c-4e20-8233-9cec45e23148 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:07.822962 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-0cdd1d35-8b8e-479c-afdf-c0ae875c0bd6 tempest-HostsAdminTestJSON-1163831172 tempest-HostsAdminTestJSON-1163831172-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hosts/n-h1-851028-13" status: 200 len: 471 microversion: 2.1 time: 0.158124 Oct 04 18:32:07.834132 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 148/274] 10.222.0.43 () {58 vars in 1173 bytes} [Tue Oct 4 18:32:07 2022] GET /compute/v2.1/os-hosts/n-h1-851028-13 => generated 471 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:32:07.842143 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-fe2ee4a9-4c0d-4c34-9149-0d81353e491b tempest-AggregatesAdminTestJSON-1163717784 tempest-AggregatesAdminTestJSON-1163717784-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-588404377", "availability_zone": "tempest-test_az-1876913161"}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:07.871010 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.objects.aggregate [None req-fe2ee4a9-4c0d-4c34-9149-0d81353e491b tempest-AggregatesAdminTestJSON-1163717784 tempest-AggregatesAdminTestJSON-1163717784-project-admin] Generated uuid 62592d21-4d95-4474-bc41-62280212f625 for aggregate {{(pid=123596) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 18:32:07.929281 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-fe2ee4a9-4c0d-4c34-9149-0d81353e491b tempest-AggregatesAdminTestJSON-1163717784 tempest-AggregatesAdminTestJSON-1163717784-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.092948 Oct 04 18:32:07.930229 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 149/275] 10.222.0.43 () {60 vars in 1165 bytes} [Tue Oct 4 18:32:07 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:32:07.937986 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-4c8912de-a75a-4b88-8220-35aada6fa795 tempest-QuotasAdminNegativeTest-2139852703 tempest-QuotasAdminNegativeTest-2139852703-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1686673962", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452"}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:08.038526 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.network.neutron [None req-4c8912de-a75a-4b88-8220-35aada6fa795 tempest-QuotasAdminNegativeTest-2139852703 tempest-QuotasAdminNegativeTest-2139852703-project] validate_networks() for None {{(pid=123596) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:32:08.503544 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-cd0157c2-5e1c-4e20-8233-9cec45e23148 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '459e65f14af049bba311453d6a86360b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1753b9ee9a644e409a1efd0c9e7c152c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:08.518023 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-cd0157c2-5e1c-4e20-8233-9cec45e23148 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] 10.222.0.43 "GET /compute/v2.1/servers/b249a7cd-d1ee-4a74-a93d-9991ba84785f" status: 200 len: 1319 microversion: 2.1 time: 0.746762 Oct 04 18:32:08.518622 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 127/276] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:07 2022] GET /compute/v2.1/servers/b249a7cd-d1ee-4a74-a93d-9991ba84785f => generated 1319 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:08.523919 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-15eae551-760f-4e41-a404-b3927280cdcd tempest-AggregatesAdminTestJSON-1163717784 tempest-AggregatesAdminTestJSON-1163717784-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-588404377_new", "availability_zone": "tempest-test_az-1876913161_new"}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:08.657683 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-15eae551-760f-4e41-a404-b3927280cdcd tempest-AggregatesAdminTestJSON-1163717784 tempest-AggregatesAdminTestJSON-1163717784-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:08.658182 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-15eae551-760f-4e41-a404-b3927280cdcd tempest-AggregatesAdminTestJSON-1163717784 tempest-AggregatesAdminTestJSON-1163717784-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:08.658627 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-15eae551-760f-4e41-a404-b3927280cdcd tempest-AggregatesAdminTestJSON-1163717784 tempest-AggregatesAdminTestJSON-1163717784-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:08.771179 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-15eae551-760f-4e41-a404-b3927280cdcd tempest-AggregatesAdminTestJSON-1163717784 tempest-AggregatesAdminTestJSON-1163717784-project-admin] 10.222.0.43 "PUT /compute/v2.1/os-aggregates/9" status: 200 len: 335 microversion: 2.1 time: 0.251397 Oct 04 18:32:08.771792 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 128/277] 10.222.0.43 () {60 vars in 1170 bytes} [Tue Oct 4 18:32:08 2022] PUT /compute/v2.1/os-aggregates/9 => generated 335 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:32:08.777958 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-46786cbc-69f2-4e81-880e-ec0c631c0223 req-3b5725e7-ca83-44c2-b50a-500a21c87ad8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b249a7cd-d1ee-4a74-a93d-9991ba84785f", "tag": "cf5a1845-85d4-4127-adb0-9778baba06db"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:08.797829 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-46786cbc-69f2-4e81-880e-ec0c631c0223 req-3b5725e7-ca83-44c2-b50a-500a21c87ad8 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:08.799024 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-46786cbc-69f2-4e81-880e-ec0c631c0223 req-3b5725e7-ca83-44c2-b50a-500a21c87ad8 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:08.799024 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-46786cbc-69f2-4e81-880e-ec0c631c0223 req-3b5725e7-ca83-44c2-b50a-500a21c87ad8 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:08.810683 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-46786cbc-69f2-4e81-880e-ec0c631c0223 req-3b5725e7-ca83-44c2-b50a-500a21c87ad8 service nova] Creating event network-changed:cf5a1845-85d4-4127-adb0-9778baba06db for instance b249a7cd-d1ee-4a74-a93d-9991ba84785f on n-h2-851028-13 Oct 04 18:32:08.818164 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-46786cbc-69f2-4e81-880e-ec0c631c0223 req-3b5725e7-ca83-44c2-b50a-500a21c87ad8 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042945 Oct 04 18:32:08.818164 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 129/278] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:32:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:32:08.824357 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-7bdc2c18-25ce-4f3b-90b9-7970654cc0e3 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:08.825066 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-7bdc2c18-25ce-4f3b-90b9-7970654cc0e3 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] [instance: 9b19b908-7870-477b-9be7-7d260d59b183] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:08.832400 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7bdc2c18-25ce-4f3b-90b9-7970654cc0e3 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:08.832896 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7bdc2c18-25ce-4f3b-90b9-7970654cc0e3 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:08.833386 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7bdc2c18-25ce-4f3b-90b9-7970654cc0e3 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:08.834250 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7bdc2c18-25ce-4f3b-90b9-7970654cc0e3 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:08.834718 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7bdc2c18-25ce-4f3b-90b9-7970654cc0e3 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:08.835147 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7bdc2c18-25ce-4f3b-90b9-7970654cc0e3 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:09.202424 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-7bdc2c18-25ce-4f3b-90b9-7970654cc0e3 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ea2088d8124b149187a1c140d3be88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82c615a05e8a4cd086f2e580529fb1d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:09.213551 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-7bdc2c18-25ce-4f3b-90b9-7970654cc0e3 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] 10.222.0.43 "GET /compute/v2.1/servers/9b19b908-7870-477b-9be7-7d260d59b183" status: 200 len: 1587 microversion: 2.1 time: 0.394225 Oct 04 18:32:09.221436 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 130/279] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:08 2022] GET /compute/v2.1/servers/9b19b908-7870-477b-9be7-7d260d59b183 => generated 1587 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:09.227862 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-60bf6363-909f-4294-8409-fbc5a1824811 req-d8f76aaa-b660-4238-a93f-0adb045f071e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b19b908-7870-477b-9be7-7d260d59b183", "tag": "1b942ddb-54b7-42fd-90da-3d92df57749c"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:09.247649 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-4c8912de-a75a-4b88-8220-35aada6fa795 tempest-QuotasAdminNegativeTest-2139852703 tempest-QuotasAdminNegativeTest-2139852703-project] Flavor limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:32:09.248228 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-4c8912de-a75a-4b88-8220-35aada6fa795 tempest-QuotasAdminNegativeTest-2139852703 tempest-QuotasAdminNegativeTest-2139852703-project] Image limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:32:09.248930 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-4c8912de-a75a-4b88-8220-35aada6fa795 tempest-QuotasAdminNegativeTest-2139852703 tempest-QuotasAdminNegativeTest-2139852703-project] Flavor pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:32:09.249375 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-4c8912de-a75a-4b88-8220-35aada6fa795 tempest-QuotasAdminNegativeTest-2139852703 tempest-QuotasAdminNegativeTest-2139852703-project] Image pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:32:09.249797 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-4c8912de-a75a-4b88-8220-35aada6fa795 tempest-QuotasAdminNegativeTest-2139852703 tempest-QuotasAdminNegativeTest-2139852703-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:32:09.257877 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-60bf6363-909f-4294-8409-fbc5a1824811 req-d8f76aaa-b660-4238-a93f-0adb045f071e service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:09.258375 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-60bf6363-909f-4294-8409-fbc5a1824811 req-d8f76aaa-b660-4238-a93f-0adb045f071e service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:09.258820 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-60bf6363-909f-4294-8409-fbc5a1824811 req-d8f76aaa-b660-4238-a93f-0adb045f071e service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:09.265239 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4c8912de-a75a-4b88-8220-35aada6fa795 tempest-QuotasAdminNegativeTest-2139852703 tempest-QuotasAdminNegativeTest-2139852703-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:09.266093 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4c8912de-a75a-4b88-8220-35aada6fa795 tempest-QuotasAdminNegativeTest-2139852703 tempest-QuotasAdminNegativeTest-2139852703-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:09.275001 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-60bf6363-909f-4294-8409-fbc5a1824811 req-d8f76aaa-b660-4238-a93f-0adb045f071e service nova] Creating event network-changed:1b942ddb-54b7-42fd-90da-3d92df57749c for instance 9b19b908-7870-477b-9be7-7d260d59b183 on n-h2-851028-13 Oct 04 18:32:09.277699 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4c8912de-a75a-4b88-8220-35aada6fa795 tempest-QuotasAdminNegativeTest-2139852703 tempest-QuotasAdminNegativeTest-2139852703-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:09.278541 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4c8912de-a75a-4b88-8220-35aada6fa795 tempest-QuotasAdminNegativeTest-2139852703 tempest-QuotasAdminNegativeTest-2139852703-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:09.279189 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4c8912de-a75a-4b88-8220-35aada6fa795 tempest-QuotasAdminNegativeTest-2139852703 tempest-QuotasAdminNegativeTest-2139852703-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:09.279781 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4c8912de-a75a-4b88-8220-35aada6fa795 tempest-QuotasAdminNegativeTest-2139852703 tempest-QuotasAdminNegativeTest-2139852703-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:09.283570 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-60bf6363-909f-4294-8409-fbc5a1824811 req-d8f76aaa-b660-4238-a93f-0adb045f071e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060481 Oct 04 18:32:09.284185 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 131/280] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:32:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:32:09.295212 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-b7005e39-450e-4976-aefe-e65b605c7a8d tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:09.301700 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-b7005e39-450e-4976-aefe-e65b605c7a8d tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] [instance: c4b812d5-f2ff-41c7-b912-3d19d752340b] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:09.316066 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b7005e39-450e-4976-aefe-e65b605c7a8d tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:09.317044 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b7005e39-450e-4976-aefe-e65b605c7a8d tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:09.319498 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b7005e39-450e-4976-aefe-e65b605c7a8d tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:09.319671 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-4c8912de-a75a-4b88-8220-35aada6fa795 tempest-QuotasAdminNegativeTest-2139852703 tempest-QuotasAdminNegativeTest-2139852703-project] Getting quotas for project e1fb34a4be434fa2962daf5525d632e8. Resources: {'ram', 'cores', 'instances'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:32:09.324824 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-4c8912de-a75a-4b88-8220-35aada6fa795 tempest-QuotasAdminNegativeTest-2139852703 tempest-QuotasAdminNegativeTest-2139852703-project] Getting quotas for user 64b8087484564483be1e8cfa6def5046 and project e1fb34a4be434fa2962daf5525d632e8. Resources: {'ram', 'cores', 'instances'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:32:09.325346 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b7005e39-450e-4976-aefe-e65b605c7a8d tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:09.326085 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b7005e39-450e-4976-aefe-e65b605c7a8d tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:09.326776 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b7005e39-450e-4976-aefe-e65b605c7a8d tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:09.333220 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=100 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:32:09.357177 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.utils [None req-4c8912de-a75a-4b88-8220-35aada6fa795 tempest-QuotasAdminNegativeTest-2139852703 tempest-QuotasAdminNegativeTest-2139852703-project] instances quota exceeded for e1fb34a4be434fa2962daf5525d632e8, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=123596) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 04 18:32:09.358029 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-4c8912de-a75a-4b88-8220-35aada6fa795 tempest-QuotasAdminNegativeTest-2139852703 tempest-QuotasAdminNegativeTest-2139852703-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 04 18:32:09.361603 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-4c8912de-a75a-4b88-8220-35aada6fa795 tempest-QuotasAdminNegativeTest-2139852703 tempest-QuotasAdminNegativeTest-2139852703-project] Request method failure captured: Oct 04 18:32:09.361603 n-d-851028-13 devstack@n-api.service[123596]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 18:32:09.361603 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:32:09.361603 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:32:09.361603 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:32:09.361603 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 145 Oct 04 18:32:09.361603 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:32:09.361603 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:32:09.361603 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:32:09.361603 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:32:09.361603 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPHwi-Ua_l9iiJ14QYxx8rlPrtrTabG5h00Sutrbgr8lSdpttgEFgjCIdpoBaZlpID3aDCKN1kV0uwD4Pw1SB-uO0q2CLOoam6vMvxCekTYvBf2-D-6i8RWJCnOk2evqGnv_v8oE3FjuTVJ917OjclJR9XFwiZKV4lqkYLb9lMkfvMiM Oct 04 18:32:09.361603 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:32:09.361603 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:32:09.361603 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:32:09.361603 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:32:09.361603 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:32:09.361603 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:32:09.361603 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: e1fb34a4be434fa2962daf5525d632e8 Oct 04 18:32:09.361603 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-QuotasAdminNegativeTest-2139852703 Oct 04 18:32:09.361603 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 18:32:09.361603 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 18:32:09.362920 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/e1fb34a4be434fa2962daf5525d632e8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_e1fb34a4be434fa2962daf5525d632e8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/e1fb34a4be434fa2962daf5525d632e8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/e1fb34a4be434fa2962daf5525d632e8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:32:09.362920 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-QuotasAdminNegativeTest-2139852703 Oct 04 18:32:09.362920 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: e1fb34a4be434fa2962daf5525d632e8 Oct 04 18:32:09.362920 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-2139852703 Oct 04 18:32:09.362920 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-QuotasAdminNegativeTest-2139852703-project Oct 04 18:32:09.362920 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:32:09.362920 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:32:09.362920 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 64b8087484564483be1e8cfa6def5046 Oct 04 18:32:09.362920 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-QuotasAdminNegativeTest-2139852703-project Oct 04 18:32:09.362920 n-d-851028-13 devstack@n-api.service[123596]: Oct 04 18:32:09.362920 n-d-851028-13 devstack@n-api.service[123596]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1686673962", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452"}} Oct 04 18:32:09.362920 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 18:32:09.363590 n-d-851028-13 devstack@n-api.service[123596]: exception: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 04 18:32:09.363590 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1686673962', 'imageRef': 'e8943ec5-4038-4d4b-b9b9-2415a79f5243', 'flavorRef': '452'}}} Oct 04 18:32:09.363590 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:32:09.363590 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:09.363590 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 04 18:32:09.363590 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 04 18:32:09.363590 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 18:32:09.363590 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 18:32:09.363590 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 04 18:32:09.363590 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc Oct 04 18:32:09.363590 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 04 18:32:09.363590 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 04 18:32:09.363590 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 18:32:09.363590 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 18:32:09.363590 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 04 18:32:09.363590 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 04 18:32:09.363590 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 04 18:32:09.363590 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 04 18:32:09.365181 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 04 18:32:09.365181 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 04 18:32:09.365181 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['instances'] Oct 04 18:32:09.365181 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:32:09.365181 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:09.365181 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:32:09.365181 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:09.365181 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 18:32:09.365181 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 18:32:09.365181 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 18:32:09.365181 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 18:32:09.365181 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 04 18:32:09.365181 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 04 18:32:09.365181 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 04 18:32:09.365181 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 04 18:32:09.365181 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 04 18:32:09.365181 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 04 18:32:09.365181 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 04 18:32:09.365181 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:32:09.365181 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:09.365181 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:32:09.366333 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:09.366333 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:32:09.366333 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:32:09.366333 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:32:09.366333 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:32:09.366333 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:32:09.366333 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:32:09.366333 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:32:09.366333 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:32:09.366333 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:32:09.366333 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:32:09.366333 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:32:09.366333 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:32:09.366333 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 18:32:09.366333 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 04 18:32:09.366333 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 04 18:32:09.366333 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 04 18:32:09.366333 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:32:09.366333 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:09.366333 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:32:09.366333 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:09.368954 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:32:09.368954 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:32:09.368954 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:32:09.368954 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:32:09.368954 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 04 18:32:09.368954 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:32:09.368954 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-4c8912de-a75a-4b88-8220-35aada6fa795 tempest-QuotasAdminNegativeTest-2139852703 tempest-QuotasAdminNegativeTest-2139852703-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:32:09.368954 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-4c8912de-a75a-4b88-8220-35aada6fa795 tempest-QuotasAdminNegativeTest-2139852703 tempest-QuotasAdminNegativeTest-2139852703-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 1.430319 Oct 04 18:32:09.368954 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 150/281] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 18:32:07 2022] POST /compute/v2.1/servers => generated 119 bytes in 1431 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:32:09.371592 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-9131e9bb-9593-45cb-90d1-84fa229b04a5 tempest-AggregatesAdminTestJSON-1163717784 tempest-AggregatesAdminTestJSON-1163717784-project-admin] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:09.410391 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-9131e9bb-9593-45cb-90d1-84fa229b04a5 tempest-AggregatesAdminTestJSON-1163717784 tempest-AggregatesAdminTestJSON-1163717784-project-admin] 10.222.0.43 "GET /compute/v2.1/os-aggregates" status: 200 len: 338 microversion: 2.1 time: 0.043333 Oct 04 18:32:09.412514 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 151/282] 10.222.0.43 () {58 vars in 1143 bytes} [Tue Oct 4 18:32:09 2022] GET /compute/v2.1/os-aggregates => generated 338 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:32:09.429581 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-dab9a7bc-f765-4910-84d4-18da33a8ca65 tempest-QuotasAdminNegativeTest-2112941160 tempest-QuotasAdminNegativeTest-2112941160-project-admin] Action: 'update', calling method: .version_select at 0x7fb224774670>, body: {"quota_set": {"instances": 10}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:09.746596 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-b7005e39-450e-4976-aefe-e65b605c7a8d tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7db99f361654711bea7f1b2c404d312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7adedcdb9c3485ea2738c00e25aa3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:09.758821 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-b7005e39-450e-4976-aefe-e65b605c7a8d tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] 10.222.0.43 "GET /compute/v2.1/servers/c4b812d5-f2ff-41c7-b912-3d19d752340b" status: 200 len: 1319 microversion: 2.1 time: 0.467428 Oct 04 18:32:09.767227 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 132/283] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:09 2022] GET /compute/v2.1/servers/c4b812d5-f2ff-41c7-b912-3d19d752340b => generated 1319 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:09.785543 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-da6cbf5e-c6b7-418b-b825-05e2a04b13c8 tempest-AggregatesAdminTestJSON-1163717784 tempest-AggregatesAdminTestJSON-1163717784-project-admin] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:09.830063 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-da6cbf5e-c6b7-418b-b825-05e2a04b13c8 tempest-AggregatesAdminTestJSON-1163717784 tempest-AggregatesAdminTestJSON-1163717784-project-admin] 10.222.0.43 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.061263 Oct 04 18:32:09.832875 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 133/284] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Oct 4 18:32:09 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 18:32:09.843510 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-68ae2ce6-2e6a-4efa-9ecc-b1af82eddc05 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:09.850620 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-68ae2ce6-2e6a-4efa-9ecc-b1af82eddc05 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] [instance: b249a7cd-d1ee-4a74-a93d-9991ba84785f] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:09.865596 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-68ae2ce6-2e6a-4efa-9ecc-b1af82eddc05 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:09.866846 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-68ae2ce6-2e6a-4efa-9ecc-b1af82eddc05 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:09.868063 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-68ae2ce6-2e6a-4efa-9ecc-b1af82eddc05 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:09.869709 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-68ae2ce6-2e6a-4efa-9ecc-b1af82eddc05 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:09.870918 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-68ae2ce6-2e6a-4efa-9ecc-b1af82eddc05 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:09.871493 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-68ae2ce6-2e6a-4efa-9ecc-b1af82eddc05 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:10.079859 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=39 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:32:10.086718 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dab9a7bc-f765-4910-84d4-18da33a8ca65 tempest-QuotasAdminNegativeTest-2112941160 tempest-QuotasAdminNegativeTest-2112941160-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:10.087216 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dab9a7bc-f765-4910-84d4-18da33a8ca65 tempest-QuotasAdminNegativeTest-2112941160 tempest-QuotasAdminNegativeTest-2112941160-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:10.087655 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dab9a7bc-f765-4910-84d4-18da33a8ca65 tempest-QuotasAdminNegativeTest-2112941160 tempest-QuotasAdminNegativeTest-2112941160-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:10.088390 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dab9a7bc-f765-4910-84d4-18da33a8ca65 tempest-QuotasAdminNegativeTest-2112941160 tempest-QuotasAdminNegativeTest-2112941160-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:10.089470 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dab9a7bc-f765-4910-84d4-18da33a8ca65 tempest-QuotasAdminNegativeTest-2112941160 tempest-QuotasAdminNegativeTest-2112941160-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:10.089907 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dab9a7bc-f765-4910-84d4-18da33a8ca65 tempest-QuotasAdminNegativeTest-2112941160 tempest-QuotasAdminNegativeTest-2112941160-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:10.112817 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=17 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:32:10.134550 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=4,nova_api:DELETE=5 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:32:10.192866 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-dab9a7bc-f765-4910-84d4-18da33a8ca65 tempest-QuotasAdminNegativeTest-2112941160 tempest-QuotasAdminNegativeTest-2112941160-project-admin] 10.222.0.43 "PUT /compute/v2.1/os-quota-sets/e1fb34a4be434fa2962daf5525d632e8" status: 200 len: 329 microversion: 2.1 time: 0.778340 Oct 04 18:32:10.198385 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 152/285] 10.222.0.43 () {60 vars in 1262 bytes} [Tue Oct 4 18:32:09 2022] PUT /compute/v2.1/os-quota-sets/e1fb34a4be434fa2962daf5525d632e8 => generated 329 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:32:10.205429 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-d9f43c7a-7bf6-4ca1-b4ed-88d63c2ebbbb tempest-AggregatesAdminTestJSON-1163717784 tempest-AggregatesAdminTestJSON-1163717784-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1653753935"}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:10.207522 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.objects.aggregate [None req-d9f43c7a-7bf6-4ca1-b4ed-88d63c2ebbbb tempest-AggregatesAdminTestJSON-1163717784 tempest-AggregatesAdminTestJSON-1163717784-project-admin] Generated uuid 218ecda3-db00-43f9-b201-972640b174a0 for aggregate {{(pid=123596) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 18:32:10.219756 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-68ae2ce6-2e6a-4efa-9ecc-b1af82eddc05 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '459e65f14af049bba311453d6a86360b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1753b9ee9a644e409a1efd0c9e7c152c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:10.235539 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-68ae2ce6-2e6a-4efa-9ecc-b1af82eddc05 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] 10.222.0.43 "GET /compute/v2.1/servers/b249a7cd-d1ee-4a74-a93d-9991ba84785f" status: 200 len: 1319 microversion: 2.1 time: 0.400830 Oct 04 18:32:10.236694 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 134/286] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:09 2022] GET /compute/v2.1/servers/b249a7cd-d1ee-4a74-a93d-9991ba84785f => generated 1319 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:10.243315 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-a18488b0-df79-42a2-8c5d-734112dc6eb1 req-4829c4bc-c48e-4dcf-b96d-a1cfe72915ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4311d976-991e-4ab1-9d5e-d654aa7d0b08", "name": "network-vif-plugged", "status": "completed", "tag": "b89d6e48-3869-4b43-a6d0-a6c0d069cdd9"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:10.264616 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-d9f43c7a-7bf6-4ca1-b4ed-88d63c2ebbbb tempest-AggregatesAdminTestJSON-1163717784 tempest-AggregatesAdminTestJSON-1163717784-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.064637 Oct 04 18:32:10.265390 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 153/287] 10.222.0.43 () {60 vars in 1164 bytes} [Tue Oct 4 18:32:10 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:32:10.266530 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-a18488b0-df79-42a2-8c5d-734112dc6eb1 req-4829c4bc-c48e-4dcf-b96d-a1cfe72915ea service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:10.270682 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-a18488b0-df79-42a2-8c5d-734112dc6eb1 req-4829c4bc-c48e-4dcf-b96d-a1cfe72915ea service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:10.271000 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-9304d8fe-a071-45f5-b5e2-015e55c077b8 tempest-QuotasAdminNegativeTest-2112941160 tempest-QuotasAdminNegativeTest-2112941160-project-admin] Calling method '.version_select at 0x7fb2244aa790>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:10.271537 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-a18488b0-df79-42a2-8c5d-734112dc6eb1 req-4829c4bc-c48e-4dcf-b96d-a1cfe72915ea service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:10.307820 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-a18488b0-df79-42a2-8c5d-734112dc6eb1 req-4829c4bc-c48e-4dcf-b96d-a1cfe72915ea service nova] Creating event network-vif-plugged:b89d6e48-3869-4b43-a6d0-a6c0d069cdd9 for instance 4311d976-991e-4ab1-9d5e-d654aa7d0b08 on n-h1-851028-13 Oct 04 18:32:10.315381 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-a18488b0-df79-42a2-8c5d-734112dc6eb1 req-4829c4bc-c48e-4dcf-b96d-a1cfe72915ea service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076826 Oct 04 18:32:10.316905 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 135/288] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:32:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:32:10.322693 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-44ddd175-108a-4116-8cd0-976d4374644e tempest-AggregatesAdminTestJSON-1163717784 tempest-AggregatesAdminTestJSON-1163717784-project-admin] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:10.332055 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-44ddd175-108a-4116-8cd0-976d4374644e tempest-AggregatesAdminTestJSON-1163717784 tempest-AggregatesAdminTestJSON-1163717784-project-admin] 10.222.0.43 "GET /compute/v2.1/os-aggregates" status: 200 len: 231 microversion: 2.1 time: 0.013814 Oct 04 18:32:10.333291 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 136/289] 10.222.0.43 () {58 vars in 1143 bytes} [Tue Oct 4 18:32:10 2022] GET /compute/v2.1/os-aggregates => generated 231 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:32:10.353021 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-95ad95f0-57da-4075-af42-ac86fb505966 tempest-AggregatesAdminTestJSON-1163717784 tempest-AggregatesAdminTestJSON-1163717784-project-admin] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:10.407758 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-95ad95f0-57da-4075-af42-ac86fb505966 tempest-AggregatesAdminTestJSON-1163717784 tempest-AggregatesAdminTestJSON-1163717784-project-admin] 10.222.0.43 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.066142 Oct 04 18:32:10.415148 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 137/290] 10.222.0.43 () {58 vars in 1155 bytes} [Tue Oct 4 18:32:10 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 18:32:10.422588 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-ff9ff033-dcf3-4b2a-907f-96493be566f5 tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:10.423219 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-ff9ff033-dcf3-4b2a-907f-96493be566f5 tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] [instance: 3b8abc08-2a0d-44a6-bdee-3b356bcfb7a1] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:10.442615 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ff9ff033-dcf3-4b2a-907f-96493be566f5 tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:10.443121 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ff9ff033-dcf3-4b2a-907f-96493be566f5 tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:10.444329 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ff9ff033-dcf3-4b2a-907f-96493be566f5 tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:10.445314 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ff9ff033-dcf3-4b2a-907f-96493be566f5 tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:10.445771 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ff9ff033-dcf3-4b2a-907f-96493be566f5 tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:10.446252 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ff9ff033-dcf3-4b2a-907f-96493be566f5 tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:10.463512 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-ff9ff033-dcf3-4b2a-907f-96493be566f5 tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] HTTP exception thrown: Instance 3b8abc08-2a0d-44a6-bdee-3b356bcfb7a1 could not be found. Oct 04 18:32:10.467094 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-ff9ff033-dcf3-4b2a-907f-96493be566f5 tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Request method failure captured: Oct 04 18:32:10.467094 n-d-851028-13 devstack@n-api.service[123595]: request: DELETE /compute/v2.1/servers/3b8abc08-2a0d-44a6-bdee-3b356bcfb7a1 HTTP/1.1 Oct 04 18:32:10.467094 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 18:32:10.467094 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 18:32:10.467094 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 18:32:10.467094 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 0 Oct 04 18:32:10.467094 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 18:32:10.467094 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 18:32:10.467094 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 18:32:10.467094 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 18:32:10.467094 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPHvsyFmG_T606P-dfv6KzFhrZkk8yk9-mTKsSQqucUaWYCKPyGbfiZ0bYfXTetWSiXh1RZxYOxCn_uu5T_YkWy7gjml1c8mjSK0P9lItqZ3TCu0BqNr2SwMdgloJOuo0_PaGrXsZS5kZPOqF-lf29AHSEtO1TIeXm7xSmBZ-KbOpN4s Oct 04 18:32:10.467094 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 18:32:10.467094 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 18:32:10.467094 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 18:32:10.467094 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 18:32:10.467094 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 18:32:10.467094 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 18:32:10.467094 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: e21d25b0c2c34c33ab70844c8bf0cf97 Oct 04 18:32:10.467094 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-AggregatesAdminTestJSON-340173063 Oct 04 18:32:10.467094 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 18:32:10.467094 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 18:32:10.468686 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/e21d25b0c2c34c33ab70844c8bf0cf97"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_e21d25b0c2c34c33ab70844c8bf0cf97"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/e21d25b0c2c34c33ab70844c8bf0cf97"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/e21d25b0c2c34c33ab70844c8bf0cf97"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:32:10.468686 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-AggregatesAdminTestJSON-340173063 Oct 04 18:32:10.468686 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: e21d25b0c2c34c33ab70844c8bf0cf97 Oct 04 18:32:10.468686 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-340173063 Oct 04 18:32:10.468686 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-AggregatesAdminTestJSON-340173063-project Oct 04 18:32:10.468686 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 18:32:10.468686 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 18:32:10.468686 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: 99862180a0f2408c806bab348d78709a Oct 04 18:32:10.468686 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-AggregatesAdminTestJSON-340173063-project Oct 04 18:32:10.468686 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 18:32:10.468686 n-d-851028-13 devstack@n-api.service[123595]: exception: Instance 3b8abc08-2a0d-44a6-bdee-3b356bcfb7a1 could not be found. Oct 04 18:32:10.468686 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': '3b8abc08-2a0d-44a6-bdee-3b356bcfb7a1'} Oct 04 18:32:10.469558 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:32:10.469558 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:10.469558 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:32:10.469558 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:32:10.469558 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:32:10.469558 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:32:10.469558 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:32:10.469558 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:32:10.469558 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:32:10.469558 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:32:10.469558 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b8abc08-2a0d-44a6-bdee-3b356bcfb7a1 could not be found. Oct 04 18:32:10.469558 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:32:10.469558 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:10.469558 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:32:10.469558 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:10.469558 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:32:10.469558 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:32:10.469558 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:32:10.469558 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:32:10.469558 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:32:10.470965 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:32:10.470965 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:32:10.470965 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:32:10.470965 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:32:10.470965 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:32:10.470965 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:32:10.470965 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:32:10.470965 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:32:10.470965 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:32:10.470965 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b8abc08-2a0d-44a6-bdee-3b356bcfb7a1 could not be found. Oct 04 18:32:10.470965 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:32:10.470965 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:10.470965 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:32:10.470965 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:10.470965 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:32:10.470965 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:32:10.470965 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:32:10.470965 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:32:10.470965 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b8abc08-2a0d-44a6-bdee-3b356bcfb7a1 could not be found. Oct 04 18:32:10.470965 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:32:10.472367 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-ff9ff033-dcf3-4b2a-907f-96493be566f5 tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Returning 404 to user: Instance 3b8abc08-2a0d-44a6-bdee-3b356bcfb7a1 could not be found. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:32:10.472367 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-ff9ff033-dcf3-4b2a-907f-96493be566f5 tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] 10.222.0.43 "DELETE /compute/v2.1/servers/3b8abc08-2a0d-44a6-bdee-3b356bcfb7a1" status: 404 len: 111 microversion: 2.1 time: 0.052072 Oct 04 18:32:10.474572 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 138/291] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 18:32:10 2022] DELETE /compute/v2.1/servers/3b8abc08-2a0d-44a6-bdee-3b356bcfb7a1 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:32:10.489255 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-497f8e1d-3680-4a51-a30c-0a8a07e87ae8 tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:10.490722 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-497f8e1d-3680-4a51-a30c-0a8a07e87ae8 tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] [instance: 3b8abc08-2a0d-44a6-bdee-3b356bcfb7a1] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:10.509666 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-497f8e1d-3680-4a51-a30c-0a8a07e87ae8 tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:10.510175 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-497f8e1d-3680-4a51-a30c-0a8a07e87ae8 tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:10.510623 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-497f8e1d-3680-4a51-a30c-0a8a07e87ae8 tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:10.511863 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-497f8e1d-3680-4a51-a30c-0a8a07e87ae8 tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:10.512323 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-497f8e1d-3680-4a51-a30c-0a8a07e87ae8 tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:10.512755 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-497f8e1d-3680-4a51-a30c-0a8a07e87ae8 tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:10.566822 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-497f8e1d-3680-4a51-a30c-0a8a07e87ae8 tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] HTTP exception thrown: Instance 3b8abc08-2a0d-44a6-bdee-3b356bcfb7a1 could not be found. Oct 04 18:32:10.574734 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-497f8e1d-3680-4a51-a30c-0a8a07e87ae8 tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Request method failure captured: Oct 04 18:32:10.574734 n-d-851028-13 devstack@n-api.service[123595]: request: GET /compute/v2.1/servers/3b8abc08-2a0d-44a6-bdee-3b356bcfb7a1 HTTP/1.1 Oct 04 18:32:10.574734 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 18:32:10.574734 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 18:32:10.574734 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 18:32:10.574734 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 0 Oct 04 18:32:10.574734 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 18:32:10.574734 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 18:32:10.574734 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 18:32:10.574734 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 18:32:10.574734 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPHvsyFmG_T606P-dfv6KzFhrZkk8yk9-mTKsSQqucUaWYCKPyGbfiZ0bYfXTetWSiXh1RZxYOxCn_uu5T_YkWy7gjml1c8mjSK0P9lItqZ3TCu0BqNr2SwMdgloJOuo0_PaGrXsZS5kZPOqF-lf29AHSEtO1TIeXm7xSmBZ-KbOpN4s Oct 04 18:32:10.574734 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 18:32:10.574734 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 18:32:10.574734 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 18:32:10.574734 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 18:32:10.574734 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 18:32:10.574734 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 18:32:10.574734 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: e21d25b0c2c34c33ab70844c8bf0cf97 Oct 04 18:32:10.574734 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-AggregatesAdminTestJSON-340173063 Oct 04 18:32:10.574734 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 18:32:10.574734 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 18:32:10.575983 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/e21d25b0c2c34c33ab70844c8bf0cf97"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_e21d25b0c2c34c33ab70844c8bf0cf97"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/e21d25b0c2c34c33ab70844c8bf0cf97"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/e21d25b0c2c34c33ab70844c8bf0cf97"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:32:10.575983 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-AggregatesAdminTestJSON-340173063 Oct 04 18:32:10.575983 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: e21d25b0c2c34c33ab70844c8bf0cf97 Oct 04 18:32:10.575983 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-340173063 Oct 04 18:32:10.575983 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-AggregatesAdminTestJSON-340173063-project Oct 04 18:32:10.575983 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 18:32:10.575983 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 18:32:10.575983 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: 99862180a0f2408c806bab348d78709a Oct 04 18:32:10.575983 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-AggregatesAdminTestJSON-340173063-project Oct 04 18:32:10.575983 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 18:32:10.575983 n-d-851028-13 devstack@n-api.service[123595]: exception: Instance 3b8abc08-2a0d-44a6-bdee-3b356bcfb7a1 could not be found. Oct 04 18:32:10.575983 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': '3b8abc08-2a0d-44a6-bdee-3b356bcfb7a1'} Oct 04 18:32:10.576636 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:32:10.576636 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:10.576636 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:32:10.576636 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:32:10.576636 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:32:10.576636 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:32:10.576636 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:32:10.576636 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:32:10.576636 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:32:10.576636 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:32:10.576636 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b8abc08-2a0d-44a6-bdee-3b356bcfb7a1 could not be found. Oct 04 18:32:10.576636 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:32:10.576636 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:10.576636 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:32:10.576636 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:10.576636 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:32:10.576636 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:32:10.576636 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:32:10.576636 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:32:10.576636 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:32:10.581641 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:32:10.581641 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:32:10.581641 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:32:10.581641 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:32:10.581641 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:32:10.581641 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:32:10.581641 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:32:10.581641 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b8abc08-2a0d-44a6-bdee-3b356bcfb7a1 could not be found. Oct 04 18:32:10.581641 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:32:10.581641 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:10.581641 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:32:10.581641 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:10.581641 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:32:10.581641 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:32:10.581641 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:32:10.581641 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:32:10.581641 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b8abc08-2a0d-44a6-bdee-3b356bcfb7a1 could not be found. Oct 04 18:32:10.581641 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:32:10.582628 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-497f8e1d-3680-4a51-a30c-0a8a07e87ae8 tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] Returning 404 to user: Instance 3b8abc08-2a0d-44a6-bdee-3b356bcfb7a1 could not be found. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:32:10.582628 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-497f8e1d-3680-4a51-a30c-0a8a07e87ae8 tempest-AggregatesAdminTestJSON-340173063 tempest-AggregatesAdminTestJSON-340173063-project] 10.222.0.43 "GET /compute/v2.1/servers/3b8abc08-2a0d-44a6-bdee-3b356bcfb7a1" status: 404 len: 111 microversion: 2.1 time: 0.100763 Oct 04 18:32:10.582628 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 139/292] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:10 2022] GET /compute/v2.1/servers/3b8abc08-2a0d-44a6-bdee-3b356bcfb7a1 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:32:10.583771 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-9304d8fe-a071-45f5-b5e2-015e55c077b8 tempest-QuotasAdminNegativeTest-2112941160 tempest-QuotasAdminNegativeTest-2112941160-project-admin] 10.222.0.43 "GET /compute/v2.1/os-quota-sets/e1fb34a4be434fa2962daf5525d632e8" status: 200 len: 371 microversion: 2.1 time: 0.317340 Oct 04 18:32:10.591455 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 154/293] 10.222.0.43 () {58 vars in 1242 bytes} [Tue Oct 4 18:32:10 2022] GET /compute/v2.1/os-quota-sets/e1fb34a4be434fa2962daf5525d632e8 => generated 371 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:32:10.596036 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-7ada593d-61b9-4ec1-86c9-7e8846e93d45 tempest-QuotasAdminNegativeTest-2112941160 tempest-QuotasAdminNegativeTest-2112941160-project-admin] Action: 'update', calling method: .version_select at 0x7fb22448d550>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:10.799027 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-51f779f8-5dff-4353-a2ba-a2940ba5de18 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:10.799862 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-51f779f8-5dff-4353-a2ba-a2940ba5de18 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] [instance: c4b812d5-f2ff-41c7-b912-3d19d752340b] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:10.808498 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-51f779f8-5dff-4353-a2ba-a2940ba5de18 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:10.813779 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-51f779f8-5dff-4353-a2ba-a2940ba5de18 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:10.814448 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-51f779f8-5dff-4353-a2ba-a2940ba5de18 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:10.815428 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-51f779f8-5dff-4353-a2ba-a2940ba5de18 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:10.816136 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-51f779f8-5dff-4353-a2ba-a2940ba5de18 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:10.821511 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-51f779f8-5dff-4353-a2ba-a2940ba5de18 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:11.318858 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=81 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:32:11.331627 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7ada593d-61b9-4ec1-86c9-7e8846e93d45 tempest-QuotasAdminNegativeTest-2112941160 tempest-QuotasAdminNegativeTest-2112941160-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:11.332333 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7ada593d-61b9-4ec1-86c9-7e8846e93d45 tempest-QuotasAdminNegativeTest-2112941160 tempest-QuotasAdminNegativeTest-2112941160-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:11.332977 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7ada593d-61b9-4ec1-86c9-7e8846e93d45 tempest-QuotasAdminNegativeTest-2112941160 tempest-QuotasAdminNegativeTest-2112941160-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:11.334127 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7ada593d-61b9-4ec1-86c9-7e8846e93d45 tempest-QuotasAdminNegativeTest-2112941160 tempest-QuotasAdminNegativeTest-2112941160-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:11.334952 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7ada593d-61b9-4ec1-86c9-7e8846e93d45 tempest-QuotasAdminNegativeTest-2112941160 tempest-QuotasAdminNegativeTest-2112941160-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:11.335550 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7ada593d-61b9-4ec1-86c9-7e8846e93d45 tempest-QuotasAdminNegativeTest-2112941160 tempest-QuotasAdminNegativeTest-2112941160-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:11.455735 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_api:UPDATE=3,nova_api:SELECT=88,nova_api:INSERT=3,nova_api:DELETE=6 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:32:11.481990 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-51f779f8-5dff-4353-a2ba-a2940ba5de18 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7db99f361654711bea7f1b2c404d312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7adedcdb9c3485ea2738c00e25aa3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:11.493375 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-51f779f8-5dff-4353-a2ba-a2940ba5de18 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] 10.222.0.43 "GET /compute/v2.1/servers/c4b812d5-f2ff-41c7-b912-3d19d752340b" status: 200 len: 1319 microversion: 2.1 time: 0.698349 Oct 04 18:32:11.497838 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 155/294] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:10 2022] GET /compute/v2.1/servers/c4b812d5-f2ff-41c7-b912-3d19d752340b => generated 1319 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:32:11.518314 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-921f7b1d-e2e5-456f-8eb8-946ce02a45d3 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:11.518932 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-921f7b1d-e2e5-456f-8eb8-946ce02a45d3 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] [instance: b249a7cd-d1ee-4a74-a93d-9991ba84785f] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:11.528270 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-7ada593d-61b9-4ec1-86c9-7e8846e93d45 tempest-QuotasAdminNegativeTest-2112941160 tempest-QuotasAdminNegativeTest-2112941160-project-admin] 10.222.0.43 "PUT /compute/v2.1/os-quota-sets/e1fb34a4be434fa2962daf5525d632e8" status: 200 len: 325 microversion: 2.1 time: 0.935961 Oct 04 18:32:11.528812 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 140/295] 10.222.0.43 () {60 vars in 1262 bytes} [Tue Oct 4 18:32:10 2022] PUT /compute/v2.1/os-quota-sets/e1fb34a4be434fa2962daf5525d632e8 => generated 325 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:32:11.542473 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-921f7b1d-e2e5-456f-8eb8-946ce02a45d3 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:11.542983 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-921f7b1d-e2e5-456f-8eb8-946ce02a45d3 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:11.543426 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-921f7b1d-e2e5-456f-8eb8-946ce02a45d3 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:11.544144 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-921f7b1d-e2e5-456f-8eb8-946ce02a45d3 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:11.544774 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-921f7b1d-e2e5-456f-8eb8-946ce02a45d3 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:11.545258 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-921f7b1d-e2e5-456f-8eb8-946ce02a45d3 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:11.781409 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-ff260955-712d-4eda-884b-f98db570b20d tempest-QuotasAdminNegativeTest-2139852703 tempest-QuotasAdminNegativeTest-2139852703-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-7778234", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452"}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:11.859524 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.network.neutron [None req-ff260955-712d-4eda-884b-f98db570b20d tempest-QuotasAdminNegativeTest-2139852703 tempest-QuotasAdminNegativeTest-2139852703-project] validate_networks() for None {{(pid=123595) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:32:12.180559 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-921f7b1d-e2e5-456f-8eb8-946ce02a45d3 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '459e65f14af049bba311453d6a86360b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1753b9ee9a644e409a1efd0c9e7c152c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:12.192091 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-921f7b1d-e2e5-456f-8eb8-946ce02a45d3 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] 10.222.0.43 "GET /compute/v2.1/servers/b249a7cd-d1ee-4a74-a93d-9991ba84785f" status: 200 len: 1319 microversion: 2.1 time: 0.692828 Oct 04 18:32:12.205937 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 156/296] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:11 2022] GET /compute/v2.1/servers/b249a7cd-d1ee-4a74-a93d-9991ba84785f => generated 1319 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:12.436417 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-ff260955-712d-4eda-884b-f98db570b20d tempest-QuotasAdminNegativeTest-2139852703 tempest-QuotasAdminNegativeTest-2139852703-project] Flavor limits 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:32:12.437225 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-ff260955-712d-4eda-884b-f98db570b20d tempest-QuotasAdminNegativeTest-2139852703 tempest-QuotasAdminNegativeTest-2139852703-project] Image limits 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:32:12.437586 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-ff260955-712d-4eda-884b-f98db570b20d tempest-QuotasAdminNegativeTest-2139852703 tempest-QuotasAdminNegativeTest-2139852703-project] Flavor pref 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:32:12.437997 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-ff260955-712d-4eda-884b-f98db570b20d tempest-QuotasAdminNegativeTest-2139852703 tempest-QuotasAdminNegativeTest-2139852703-project] Image pref 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:32:12.438409 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-ff260955-712d-4eda-884b-f98db570b20d tempest-QuotasAdminNegativeTest-2139852703 tempest-QuotasAdminNegativeTest-2139852703-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:32:12.458544 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ff260955-712d-4eda-884b-f98db570b20d tempest-QuotasAdminNegativeTest-2139852703 tempest-QuotasAdminNegativeTest-2139852703-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:12.460494 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ff260955-712d-4eda-884b-f98db570b20d tempest-QuotasAdminNegativeTest-2139852703 tempest-QuotasAdminNegativeTest-2139852703-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:12.462277 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ff260955-712d-4eda-884b-f98db570b20d tempest-QuotasAdminNegativeTest-2139852703 tempest-QuotasAdminNegativeTest-2139852703-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:12.465426 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ff260955-712d-4eda-884b-f98db570b20d tempest-QuotasAdminNegativeTest-2139852703 tempest-QuotasAdminNegativeTest-2139852703-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:12.466150 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ff260955-712d-4eda-884b-f98db570b20d tempest-QuotasAdminNegativeTest-2139852703 tempest-QuotasAdminNegativeTest-2139852703-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:12.466846 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ff260955-712d-4eda-884b-f98db570b20d tempest-QuotasAdminNegativeTest-2139852703 tempest-QuotasAdminNegativeTest-2139852703-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:12.522560 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f3b94da1-3a0c-4e91-b2e4-98cc4066cfd7 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:12.523759 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-f3b94da1-3a0c-4e91-b2e4-98cc4066cfd7 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] [instance: c4b812d5-f2ff-41c7-b912-3d19d752340b] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:12.525412 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-ff260955-712d-4eda-884b-f98db570b20d tempest-QuotasAdminNegativeTest-2139852703 tempest-QuotasAdminNegativeTest-2139852703-project] Getting quotas for project e1fb34a4be434fa2962daf5525d632e8. Resources: {'ram', 'cores', 'instances'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:32:12.533721 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f3b94da1-3a0c-4e91-b2e4-98cc4066cfd7 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:12.535217 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f3b94da1-3a0c-4e91-b2e4-98cc4066cfd7 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:12.536523 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-ff260955-712d-4eda-884b-f98db570b20d tempest-QuotasAdminNegativeTest-2139852703 tempest-QuotasAdminNegativeTest-2139852703-project] Getting quotas for user 64b8087484564483be1e8cfa6def5046 and project e1fb34a4be434fa2962daf5525d632e8. Resources: {'ram', 'cores', 'instances'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:32:12.537075 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f3b94da1-3a0c-4e91-b2e4-98cc4066cfd7 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:12.537966 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f3b94da1-3a0c-4e91-b2e4-98cc4066cfd7 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:12.539843 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f3b94da1-3a0c-4e91-b2e4-98cc4066cfd7 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:12.540363 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f3b94da1-3a0c-4e91-b2e4-98cc4066cfd7 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:12.567001 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.utils [None req-ff260955-712d-4eda-884b-f98db570b20d tempest-QuotasAdminNegativeTest-2139852703 tempest-QuotasAdminNegativeTest-2139852703-project] ram quota exceeded for e1fb34a4be434fa2962daf5525d632e8, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=123595) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 04 18:32:12.567804 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-ff260955-712d-4eda-884b-f98db570b20d tempest-QuotasAdminNegativeTest-2139852703 tempest-QuotasAdminNegativeTest-2139852703-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 04 18:32:12.571664 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-ff260955-712d-4eda-884b-f98db570b20d tempest-QuotasAdminNegativeTest-2139852703 tempest-QuotasAdminNegativeTest-2139852703-project] Request method failure captured: Oct 04 18:32:12.571664 n-d-851028-13 devstack@n-api.service[123595]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 18:32:12.571664 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 18:32:12.571664 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 18:32:12.571664 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 18:32:12.571664 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 142 Oct 04 18:32:12.571664 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 18:32:12.571664 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 18:32:12.571664 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 18:32:12.571664 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 18:32:12.571664 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPHwi-Ua_l9iiJ14QYxx8rlPrtrTabG5h00Sutrbgr8lSdpttgEFgjCIdpoBaZlpID3aDCKN1kV0uwD4Pw1SB-uO0q2CLOoam6vMvxCekTYvBf2-D-6i8RWJCnOk2evqGnv_v8oE3FjuTVJ917OjclJR9XFwiZKV4lqkYLb9lMkfvMiM Oct 04 18:32:12.571664 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 18:32:12.571664 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 18:32:12.571664 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 18:32:12.571664 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 18:32:12.571664 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 18:32:12.571664 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 18:32:12.571664 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: e1fb34a4be434fa2962daf5525d632e8 Oct 04 18:32:12.571664 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-QuotasAdminNegativeTest-2139852703 Oct 04 18:32:12.571664 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 18:32:12.571664 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 18:32:12.573787 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/e1fb34a4be434fa2962daf5525d632e8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_e1fb34a4be434fa2962daf5525d632e8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/e1fb34a4be434fa2962daf5525d632e8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/e1fb34a4be434fa2962daf5525d632e8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:32:12.573787 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-QuotasAdminNegativeTest-2139852703 Oct 04 18:32:12.573787 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: e1fb34a4be434fa2962daf5525d632e8 Oct 04 18:32:12.573787 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-2139852703 Oct 04 18:32:12.573787 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-QuotasAdminNegativeTest-2139852703-project Oct 04 18:32:12.573787 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 18:32:12.573787 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 18:32:12.573787 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: 64b8087484564483be1e8cfa6def5046 Oct 04 18:32:12.573787 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-QuotasAdminNegativeTest-2139852703-project Oct 04 18:32:12.573787 n-d-851028-13 devstack@n-api.service[123595]: Oct 04 18:32:12.573787 n-d-851028-13 devstack@n-api.service[123595]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-7778234", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452"}} Oct 04 18:32:12.573787 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 18:32:12.574679 n-d-851028-13 devstack@n-api.service[123595]: exception: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 04 18:32:12.574679 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-7778234', 'imageRef': 'e8943ec5-4038-4d4b-b9b9-2415a79f5243', 'flavorRef': '452'}}} Oct 04 18:32:12.574679 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:32:12.574679 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:12.574679 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 04 18:32:12.574679 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 04 18:32:12.574679 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 18:32:12.574679 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 18:32:12.574679 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 04 18:32:12.574679 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc Oct 04 18:32:12.574679 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 04 18:32:12.574679 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 04 18:32:12.574679 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 18:32:12.574679 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 18:32:12.574679 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 04 18:32:12.574679 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 04 18:32:12.574679 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 04 18:32:12.574679 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 04 18:32:12.575919 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 04 18:32:12.575919 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 04 18:32:12.575919 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Oct 04 18:32:12.575919 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:32:12.575919 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:12.575919 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:32:12.575919 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:12.575919 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 18:32:12.575919 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 18:32:12.575919 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 18:32:12.575919 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 18:32:12.575919 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 04 18:32:12.575919 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 04 18:32:12.575919 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 04 18:32:12.575919 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 04 18:32:12.575919 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 04 18:32:12.575919 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 04 18:32:12.575919 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 04 18:32:12.575919 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:32:12.575919 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:12.575919 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:32:12.577771 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:12.577771 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:32:12.577771 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:32:12.577771 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:32:12.577771 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:32:12.577771 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:32:12.577771 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:32:12.577771 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:32:12.577771 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:32:12.577771 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:32:12.577771 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:32:12.577771 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:32:12.577771 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:32:12.577771 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 18:32:12.577771 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 04 18:32:12.577771 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 04 18:32:12.577771 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 04 18:32:12.577771 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:32:12.577771 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:12.577771 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:32:12.577771 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:12.580337 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:32:12.580337 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:32:12.580337 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:32:12.580337 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:32:12.580337 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 04 18:32:12.580337 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:32:12.585633 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-ff260955-712d-4eda-884b-f98db570b20d tempest-QuotasAdminNegativeTest-2139852703 tempest-QuotasAdminNegativeTest-2139852703-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:32:12.587906 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-ff260955-712d-4eda-884b-f98db570b20d tempest-QuotasAdminNegativeTest-2139852703 tempest-QuotasAdminNegativeTest-2139852703-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 0.811261 Oct 04 18:32:12.590518 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 141/297] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 18:32:11 2022] POST /compute/v2.1/servers => generated 110 bytes in 816 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:32:12.605130 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-79854a12-692c-4ea0-a3ee-ac33ff528cfc tempest-QuotasAdminNegativeTest-2112941160 tempest-QuotasAdminNegativeTest-2112941160-project-admin] Action: 'update', calling method: .version_select at 0x7fb22448d3a0>, body: {"quota_set": {"ram": 51200}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:12.955380 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-f3b94da1-3a0c-4e91-b2e4-98cc4066cfd7 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7db99f361654711bea7f1b2c404d312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7adedcdb9c3485ea2738c00e25aa3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:12.972936 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-f3b94da1-3a0c-4e91-b2e4-98cc4066cfd7 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] 10.222.0.43 "GET /compute/v2.1/servers/c4b812d5-f2ff-41c7-b912-3d19d752340b" status: 200 len: 1319 microversion: 2.1 time: 0.454580 Oct 04 18:32:12.980687 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 157/298] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:12 2022] GET /compute/v2.1/servers/c4b812d5-f2ff-41c7-b912-3d19d752340b => generated 1319 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:32:13.020312 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-79854a12-692c-4ea0-a3ee-ac33ff528cfc tempest-QuotasAdminNegativeTest-2112941160 tempest-QuotasAdminNegativeTest-2112941160-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:13.032494 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-79854a12-692c-4ea0-a3ee-ac33ff528cfc tempest-QuotasAdminNegativeTest-2112941160 tempest-QuotasAdminNegativeTest-2112941160-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:13.036775 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-79854a12-692c-4ea0-a3ee-ac33ff528cfc tempest-QuotasAdminNegativeTest-2112941160 tempest-QuotasAdminNegativeTest-2112941160-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:13.037892 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-79854a12-692c-4ea0-a3ee-ac33ff528cfc tempest-QuotasAdminNegativeTest-2112941160 tempest-QuotasAdminNegativeTest-2112941160-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:13.038850 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-79854a12-692c-4ea0-a3ee-ac33ff528cfc tempest-QuotasAdminNegativeTest-2112941160 tempest-QuotasAdminNegativeTest-2112941160-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:13.039439 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-79854a12-692c-4ea0-a3ee-ac33ff528cfc tempest-QuotasAdminNegativeTest-2112941160 tempest-QuotasAdminNegativeTest-2112941160-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:13.119364 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-79854a12-692c-4ea0-a3ee-ac33ff528cfc tempest-QuotasAdminNegativeTest-2112941160 tempest-QuotasAdminNegativeTest-2112941160-project-admin] 10.222.0.43 "PUT /compute/v2.1/os-quota-sets/e1fb34a4be434fa2962daf5525d632e8" status: 200 len: 329 microversion: 2.1 time: 0.523457 Oct 04 18:32:13.130640 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 142/299] 10.222.0.43 () {60 vars in 1262 bytes} [Tue Oct 4 18:32:12 2022] PUT /compute/v2.1/os-quota-sets/e1fb34a4be434fa2962daf5525d632e8 => generated 329 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:32:13.135142 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-04914c56-656a-4bfe-b144-2c18f0928198 tempest-QuotasAdminNegativeTest-2139852703 tempest-QuotasAdminNegativeTest-2139852703-project] Action: 'update', calling method: .version_select at 0x7fb2244b6550>, body: {"quota_set": {"ram": 0}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:13.141014 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-04914c56-656a-4bfe-b144-2c18f0928198 tempest-QuotasAdminNegativeTest-2139852703 tempest-QuotasAdminNegativeTest-2139852703-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': '64b8087484564483be1e8cfa6def5046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1fb34a4be434fa2962daf5525d632e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:13.143376 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-04914c56-656a-4bfe-b144-2c18f0928198 tempest-QuotasAdminNegativeTest-2139852703 tempest-QuotasAdminNegativeTest-2139852703-project] Request method failure captured: Oct 04 18:32:13.143376 n-d-851028-13 devstack@n-api.service[123596]: request: PUT /compute/v2.1/os-quota-sets/e1fb34a4be434fa2962daf5525d632e8 HTTP/1.1 Oct 04 18:32:13.143376 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:32:13.143376 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:32:13.143376 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:32:13.143376 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 25 Oct 04 18:32:13.143376 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:32:13.143376 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:32:13.143376 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:32:13.143376 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:32:13.143376 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPHwi-Ua_l9iiJ14QYxx8rlPrtrTabG5h00Sutrbgr8lSdpttgEFgjCIdpoBaZlpID3aDCKN1kV0uwD4Pw1SB-uO0q2CLOoam6vMvxCekTYvBf2-D-6i8RWJCnOk2evqGnv_v8oE3FjuTVJ917OjclJR9XFwiZKV4lqkYLb9lMkfvMiM Oct 04 18:32:13.143376 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:32:13.143376 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:32:13.143376 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:32:13.143376 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:32:13.143376 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:32:13.143376 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:32:13.143376 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: e1fb34a4be434fa2962daf5525d632e8 Oct 04 18:32:13.143376 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-QuotasAdminNegativeTest-2139852703 Oct 04 18:32:13.143376 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 18:32:13.143376 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 18:32:13.144550 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/e1fb34a4be434fa2962daf5525d632e8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_e1fb34a4be434fa2962daf5525d632e8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/e1fb34a4be434fa2962daf5525d632e8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/e1fb34a4be434fa2962daf5525d632e8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:32:13.144550 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-QuotasAdminNegativeTest-2139852703 Oct 04 18:32:13.144550 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: e1fb34a4be434fa2962daf5525d632e8 Oct 04 18:32:13.144550 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-2139852703 Oct 04 18:32:13.144550 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-QuotasAdminNegativeTest-2139852703-project Oct 04 18:32:13.144550 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:32:13.144550 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:32:13.144550 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 64b8087484564483be1e8cfa6def5046 Oct 04 18:32:13.144550 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-QuotasAdminNegativeTest-2139852703-project Oct 04 18:32:13.144550 n-d-851028-13 devstack@n-api.service[123596]: Oct 04 18:32:13.144550 n-d-851028-13 devstack@n-api.service[123596]: {"quota_set": {"ram": 0}} Oct 04 18:32:13.144550 n-d-851028-13 devstack@n-api.service[123596]: method: Oct 04 18:32:13.144550 n-d-851028-13 devstack@n-api.service[123596]: exception: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 04 18:32:13.144550 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': 'e1fb34a4be434fa2962daf5525d632e8', 'body': {'quota_set': {'ram': 0}}} Oct 04 18:32:13.145387 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:32:13.145387 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:13.145387 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:32:13.145387 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:32:13.145387 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:32:13.145387 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:32:13.145387 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:32:13.145387 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:32:13.145387 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:32:13.145387 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:32:13.145387 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:32:13.145387 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:32:13.145387 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 170, in update Oct 04 18:32:13.145387 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return self._update(req, id, body, []) Oct 04 18:32:13.145387 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 18:32:13.145387 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:32:13.145387 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 18:32:13.145387 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:32:13.145387 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 189, in _update Oct 04 18:32:13.146433 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi context.can(qs_policies.POLICY_ROOT % 'update', {'project_id': id}) Oct 04 18:32:13.146433 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 18:32:13.146433 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 18:32:13.146433 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 18:32:13.146433 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 18:32:13.146433 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:32:13.146433 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:32:13.146433 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:32:13.146433 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:32:13.146433 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 18:32:13.146433 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 18:32:13.146433 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 18:32:13.146433 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 18:32:13.146433 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 18:32:13.146433 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 18:32:13.146433 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 04 18:32:13.146433 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:32:13.146433 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:13.146433 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:32:13.146433 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:13.149389 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:32:13.149389 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:32:13.149389 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 18:32:13.149389 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 18:32:13.149389 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 04 18:32:13.149389 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:32:13.149389 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-04914c56-656a-4bfe-b144-2c18f0928198 tempest-QuotasAdminNegativeTest-2139852703 tempest-QuotasAdminNegativeTest-2139852703-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:32:13.149389 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-04914c56-656a-4bfe-b144-2c18f0928198 tempest-QuotasAdminNegativeTest-2139852703 tempest-QuotasAdminNegativeTest-2139852703-project] 10.222.0.43 "PUT /compute/v2.1/os-quota-sets/e1fb34a4be434fa2962daf5525d632e8" status: 403 len: 116 microversion: 2.1 time: 0.014422 Oct 04 18:32:13.155872 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 158/300] 10.222.0.43 () {60 vars in 1262 bytes} [Tue Oct 4 18:32:13 2022] PUT /compute/v2.1/os-quota-sets/e1fb34a4be434fa2962daf5525d632e8 => generated 116 bytes in 26 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:32:13.234750 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-923659a1-e0ba-41c6-bcb6-a5d784c194fb tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:13.235504 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-923659a1-e0ba-41c6-bcb6-a5d784c194fb tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] [instance: b249a7cd-d1ee-4a74-a93d-9991ba84785f] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:13.245706 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-923659a1-e0ba-41c6-bcb6-a5d784c194fb tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:13.246541 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-923659a1-e0ba-41c6-bcb6-a5d784c194fb tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:13.247386 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-923659a1-e0ba-41c6-bcb6-a5d784c194fb tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:13.248667 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-923659a1-e0ba-41c6-bcb6-a5d784c194fb tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:13.250288 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-923659a1-e0ba-41c6-bcb6-a5d784c194fb tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:13.250959 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-923659a1-e0ba-41c6-bcb6-a5d784c194fb tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:13.504606 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-923659a1-e0ba-41c6-bcb6-a5d784c194fb tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '459e65f14af049bba311453d6a86360b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1753b9ee9a644e409a1efd0c9e7c152c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:13.534462 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-923659a1-e0ba-41c6-bcb6-a5d784c194fb tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] 10.222.0.43 "GET /compute/v2.1/servers/b249a7cd-d1ee-4a74-a93d-9991ba84785f" status: 200 len: 1319 microversion: 2.1 time: 0.302465 Oct 04 18:32:13.545357 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 143/301] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:13 2022] GET /compute/v2.1/servers/b249a7cd-d1ee-4a74-a93d-9991ba84785f => generated 1319 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:13.929071 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-186e9d6a-3127-434f-a689-50b063843072 req-e5d22c73-f92a-4e86-a046-c143f2d4c329 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4b812d5-f2ff-41c7-b912-3d19d752340b", "name": "network-vif-plugged", "status": "completed", "tag": "67d0d477-8fa7-442f-a5da-9f7866a73c5b"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:13.983111 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-186e9d6a-3127-434f-a689-50b063843072 req-e5d22c73-f92a-4e86-a046-c143f2d4c329 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:13.989615 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-186e9d6a-3127-434f-a689-50b063843072 req-e5d22c73-f92a-4e86-a046-c143f2d4c329 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:13.990649 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-186e9d6a-3127-434f-a689-50b063843072 req-e5d22c73-f92a-4e86-a046-c143f2d4c329 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:14.004154 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-3dba43aa-1865-4d02-bcd1-9664477a9443 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:14.005225 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-3dba43aa-1865-4d02-bcd1-9664477a9443 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] [instance: c4b812d5-f2ff-41c7-b912-3d19d752340b] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:14.014733 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3dba43aa-1865-4d02-bcd1-9664477a9443 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:14.016465 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3dba43aa-1865-4d02-bcd1-9664477a9443 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:14.018960 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3dba43aa-1865-4d02-bcd1-9664477a9443 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:14.019938 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3dba43aa-1865-4d02-bcd1-9664477a9443 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:14.024575 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3dba43aa-1865-4d02-bcd1-9664477a9443 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:14.025753 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3dba43aa-1865-4d02-bcd1-9664477a9443 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:14.026897 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-186e9d6a-3127-434f-a689-50b063843072 req-e5d22c73-f92a-4e86-a046-c143f2d4c329 service nova] Creating event network-vif-plugged:67d0d477-8fa7-442f-a5da-9f7866a73c5b for instance c4b812d5-f2ff-41c7-b912-3d19d752340b on n-h1-851028-13 Oct 04 18:32:14.039222 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-186e9d6a-3127-434f-a689-50b063843072 req-e5d22c73-f92a-4e86-a046-c143f2d4c329 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115327 Oct 04 18:32:14.042997 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 159/302] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:32:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:32:14.384792 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-3dba43aa-1865-4d02-bcd1-9664477a9443 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7db99f361654711bea7f1b2c404d312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7adedcdb9c3485ea2738c00e25aa3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:14.394321 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-3dba43aa-1865-4d02-bcd1-9664477a9443 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] 10.222.0.43 "GET /compute/v2.1/servers/c4b812d5-f2ff-41c7-b912-3d19d752340b" status: 200 len: 1319 microversion: 2.1 time: 0.394250 Oct 04 18:32:14.395454 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 144/303] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:13 2022] GET /compute/v2.1/servers/c4b812d5-f2ff-41c7-b912-3d19d752340b => generated 1319 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:14.562436 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-c84c8972-6543-4a5d-b4ee-84c11370e3fc tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:14.563216 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-c84c8972-6543-4a5d-b4ee-84c11370e3fc tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] [instance: b249a7cd-d1ee-4a74-a93d-9991ba84785f] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:14.586061 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c84c8972-6543-4a5d-b4ee-84c11370e3fc tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:14.587243 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c84c8972-6543-4a5d-b4ee-84c11370e3fc tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:14.588064 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c84c8972-6543-4a5d-b4ee-84c11370e3fc tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:14.590803 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c84c8972-6543-4a5d-b4ee-84c11370e3fc tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:14.591530 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c84c8972-6543-4a5d-b4ee-84c11370e3fc tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:14.594171 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c84c8972-6543-4a5d-b4ee-84c11370e3fc tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:14.942754 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-c84c8972-6543-4a5d-b4ee-84c11370e3fc tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '459e65f14af049bba311453d6a86360b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1753b9ee9a644e409a1efd0c9e7c152c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:14.951494 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-c84c8972-6543-4a5d-b4ee-84c11370e3fc tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] 10.222.0.43 "GET /compute/v2.1/servers/b249a7cd-d1ee-4a74-a93d-9991ba84785f" status: 200 len: 1319 microversion: 2.1 time: 0.395078 Oct 04 18:32:14.952137 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 160/304] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:14 2022] GET /compute/v2.1/servers/b249a7cd-d1ee-4a74-a93d-9991ba84785f => generated 1319 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:15.418777 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-33db9ff8-5868-4613-8f2b-fd6e2550c9a3 tempest-FlavorsAccessTestJSON-1964749454 tempest-FlavorsAccessTestJSON-1964749454-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-795366727", "id": 1842884682, "os-flavor-access:is_public": "False"}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:15.419947 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-7a059812-a5eb-441e-a7ed-a2dbc65bfc63 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:15.420669 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-7a059812-a5eb-441e-a7ed-a2dbc65bfc63 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] [instance: c4b812d5-f2ff-41c7-b912-3d19d752340b] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:15.438233 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7a059812-a5eb-441e-a7ed-a2dbc65bfc63 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:15.438789 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7a059812-a5eb-441e-a7ed-a2dbc65bfc63 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:15.439245 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7a059812-a5eb-441e-a7ed-a2dbc65bfc63 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:15.439981 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7a059812-a5eb-441e-a7ed-a2dbc65bfc63 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:15.440442 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7a059812-a5eb-441e-a7ed-a2dbc65bfc63 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:15.440880 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7a059812-a5eb-441e-a7ed-a2dbc65bfc63 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:15.455457 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-33db9ff8-5868-4613-8f2b-fd6e2550c9a3 tempest-FlavorsAccessTestJSON-1964749454 tempest-FlavorsAccessTestJSON-1964749454-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.270639 Oct 04 18:32:15.455972 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 145/305] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 18:32:15 2022] POST /compute/v2.1/flavors => generated 430 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:32:15.480253 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-6b449de8-e831-41e5-b682-674f94196593 tempest-FlavorsAccessTestJSON-1964749454 tempest-FlavorsAccessTestJSON-1964749454-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "abe94db2c60844f894102bb8734eb4b1"}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:15.757276 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-7a059812-a5eb-441e-a7ed-a2dbc65bfc63 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7db99f361654711bea7f1b2c404d312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7adedcdb9c3485ea2738c00e25aa3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:15.780797 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-7a059812-a5eb-441e-a7ed-a2dbc65bfc63 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] 10.222.0.43 "GET /compute/v2.1/servers/c4b812d5-f2ff-41c7-b912-3d19d752340b" status: 200 len: 1319 microversion: 2.1 time: 0.365826 Oct 04 18:32:15.781738 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 161/306] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:15 2022] GET /compute/v2.1/servers/c4b812d5-f2ff-41c7-b912-3d19d752340b => generated 1319 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:15.977610 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-45d7ff0c-aa75-45df-87ce-17938d148bad tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:15.979031 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-45d7ff0c-aa75-45df-87ce-17938d148bad tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] [instance: b249a7cd-d1ee-4a74-a93d-9991ba84785f] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:15.992788 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-45d7ff0c-aa75-45df-87ce-17938d148bad tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:15.993643 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-45d7ff0c-aa75-45df-87ce-17938d148bad tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:15.994455 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-45d7ff0c-aa75-45df-87ce-17938d148bad tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:15.995544 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-45d7ff0c-aa75-45df-87ce-17938d148bad tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:15.996419 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-45d7ff0c-aa75-45df-87ce-17938d148bad tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:15.997056 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-45d7ff0c-aa75-45df-87ce-17938d148bad tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:16.213750 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-45d7ff0c-aa75-45df-87ce-17938d148bad tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '459e65f14af049bba311453d6a86360b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1753b9ee9a644e409a1efd0c9e7c152c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:16.223842 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-45d7ff0c-aa75-45df-87ce-17938d148bad tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] 10.222.0.43 "GET /compute/v2.1/servers/b249a7cd-d1ee-4a74-a93d-9991ba84785f" status: 200 len: 1319 microversion: 2.1 time: 0.251044 Oct 04 18:32:16.224802 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 162/307] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:15 2022] GET /compute/v2.1/servers/b249a7cd-d1ee-4a74-a93d-9991ba84785f => generated 1319 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:32:16.343363 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-6b449de8-e831-41e5-b682-674f94196593 tempest-FlavorsAccessTestJSON-1964749454 tempest-FlavorsAccessTestJSON-1964749454-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors/1842884682/action" status: 200 len: 97 microversion: 2.1 time: 0.868632 Oct 04 18:32:16.344545 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 146/308] 10.222.0.43 () {60 vars in 1200 bytes} [Tue Oct 4 18:32:15 2022] POST /compute/v2.1/flavors/1842884682/action => generated 97 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:32:16.349872 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-30c27f8d-3278-4bb2-af04-1893f6536c89 req-b9f9663e-db68-4712-841e-69696952fe06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b249a7cd-d1ee-4a74-a93d-9991ba84785f", "name": "network-vif-plugged", "status": "completed", "tag": "cf5a1845-85d4-4127-adb0-9778baba06db"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:16.366207 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-30c27f8d-3278-4bb2-af04-1893f6536c89 req-b9f9663e-db68-4712-841e-69696952fe06 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:16.366958 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-30c27f8d-3278-4bb2-af04-1893f6536c89 req-b9f9663e-db68-4712-841e-69696952fe06 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:16.367621 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-30c27f8d-3278-4bb2-af04-1893f6536c89 req-b9f9663e-db68-4712-841e-69696952fe06 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:16.381916 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-30c27f8d-3278-4bb2-af04-1893f6536c89 req-b9f9663e-db68-4712-841e-69696952fe06 service nova] Creating event network-vif-plugged:cf5a1845-85d4-4127-adb0-9778baba06db for instance b249a7cd-d1ee-4a74-a93d-9991ba84785f on n-h2-851028-13 Oct 04 18:32:16.389484 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-30c27f8d-3278-4bb2-af04-1893f6536c89 req-b9f9663e-db68-4712-841e-69696952fe06 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043145 Oct 04 18:32:16.390886 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 147/309] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:32:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:32:16.797676 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-825dfb9b-3d3b-4532-891b-d96df53b4bc1 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-1702725808", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452", "networks": [{"uuid": "0c823502-f774-43d6-893c-f93f073651ed"}]}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:16.876585 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.network.neutron [None req-825dfb9b-3d3b-4532-891b-d96df53b4bc1 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] validate_networks() for [('0c823502-f774-43d6-893c-f93f073651ed', None, None, None, None, None)] {{(pid=123596) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:32:16.906558 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-24b296e0-b878-4660-af3b-bc23705ebc01 tempest-FlavorsAccessTestJSON-320194953 tempest-FlavorsAccessTestJSON-320194953-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:16.941479 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-24b296e0-b878-4660-af3b-bc23705ebc01 tempest-FlavorsAccessTestJSON-320194953 tempest-FlavorsAccessTestJSON-320194953-project] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 6238 microversion: 2.1 time: 0.548465 Oct 04 18:32:16.958399 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 148/310] 10.222.0.43 () {58 vars in 1146 bytes} [Tue Oct 4 18:32:16 2022] GET /compute/v2.1/flavors/detail => generated 6238 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:16.967717 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-0d42b845-96db-4ab9-b386-0416b74ceebc tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:16.968897 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-0d42b845-96db-4ab9-b386-0416b74ceebc tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] [instance: c4b812d5-f2ff-41c7-b912-3d19d752340b] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:16.977176 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0d42b845-96db-4ab9-b386-0416b74ceebc tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:16.978521 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0d42b845-96db-4ab9-b386-0416b74ceebc tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:16.979308 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0d42b845-96db-4ab9-b386-0416b74ceebc tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:16.980216 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0d42b845-96db-4ab9-b386-0416b74ceebc tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:16.980855 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0d42b845-96db-4ab9-b386-0416b74ceebc tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:16.981472 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0d42b845-96db-4ab9-b386-0416b74ceebc tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:17.168458 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-0d42b845-96db-4ab9-b386-0416b74ceebc tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7db99f361654711bea7f1b2c404d312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7adedcdb9c3485ea2738c00e25aa3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:17.177739 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-0d42b845-96db-4ab9-b386-0416b74ceebc tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] 10.222.0.43 "GET /compute/v2.1/servers/c4b812d5-f2ff-41c7-b912-3d19d752340b" status: 200 len: 1469 microversion: 2.1 time: 0.217432 Oct 04 18:32:17.193856 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 149/311] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:16 2022] GET /compute/v2.1/servers/c4b812d5-f2ff-41c7-b912-3d19d752340b => generated 1469 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:17.202451 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-6c5dca0f-e678-4fe4-a966-77b2c500c0b8 tempest-FlavorsAccessTestJSON-1964749454 tempest-FlavorsAccessTestJSON-1964749454-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "abe94db2c60844f894102bb8734eb4b1"}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:17.460126 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-825dfb9b-3d3b-4532-891b-d96df53b4bc1 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Flavor limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:32:17.461864 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-825dfb9b-3d3b-4532-891b-d96df53b4bc1 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Image limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:32:17.462348 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-825dfb9b-3d3b-4532-891b-d96df53b4bc1 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Flavor pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:32:17.462812 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-825dfb9b-3d3b-4532-891b-d96df53b4bc1 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Image pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:32:17.463846 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-825dfb9b-3d3b-4532-891b-d96df53b4bc1 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:32:17.474520 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-825dfb9b-3d3b-4532-891b-d96df53b4bc1 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:17.475276 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-825dfb9b-3d3b-4532-891b-d96df53b4bc1 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:17.475916 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-825dfb9b-3d3b-4532-891b-d96df53b4bc1 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:17.476830 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-825dfb9b-3d3b-4532-891b-d96df53b4bc1 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:17.477517 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-825dfb9b-3d3b-4532-891b-d96df53b4bc1 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:17.478137 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-825dfb9b-3d3b-4532-891b-d96df53b4bc1 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:17.508430 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-825dfb9b-3d3b-4532-891b-d96df53b4bc1 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Getting quotas for project 38c636de1e6b42868f1f58e46fd4a3f0. Resources: {'ram', 'cores', 'instances'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:32:17.513912 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-825dfb9b-3d3b-4532-891b-d96df53b4bc1 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Getting quotas for user f207a188e3fa4987b9fe4dd773ad03b9 and project 38c636de1e6b42868f1f58e46fd4a3f0. Resources: {'ram', 'cores', 'instances'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:32:17.528157 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-825dfb9b-3d3b-4532-891b-d96df53b4bc1 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Going to run 1 instances... {{(pid=123596) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:32:17.531199 n-d-851028-13 devstack@n-api.service[123596]: WARNING nova.utils [None req-825dfb9b-3d3b-4532-891b-d96df53b4bc1 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Hostname tempest-FloatingIPsAssociationNegativeTestJSON-server-1702725808 is longer than 63, truncate it to tempest-FloatingIPsAssociationNegativeTestJSON-server-170272580 Oct 04 18:32:17.532274 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-825dfb9b-3d3b-4532-891b-d96df53b4bc1 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] [instance: 606aebcb-2b6a-469f-a578-91325770ab4b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e8943ec5-4038-4d4b-b9b9-2415a79f5243',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123596) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:32:17.587547 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-825dfb9b-3d3b-4532-891b-d96df53b4bc1 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.342868 Oct 04 18:32:17.588891 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 163/312] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 18:32:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 1349 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:32:17.606452 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-0fb5cba5-d9d5-4f30-95fd-07502506c9d2 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:17.606923 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-0fb5cba5-d9d5-4f30-95fd-07502506c9d2 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] [instance: 4311d976-991e-4ab1-9d5e-d654aa7d0b08] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:17.614315 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0fb5cba5-d9d5-4f30-95fd-07502506c9d2 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:17.614804 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0fb5cba5-d9d5-4f30-95fd-07502506c9d2 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:17.615237 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0fb5cba5-d9d5-4f30-95fd-07502506c9d2 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:17.615935 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0fb5cba5-d9d5-4f30-95fd-07502506c9d2 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:17.616383 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0fb5cba5-d9d5-4f30-95fd-07502506c9d2 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:17.616811 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0fb5cba5-d9d5-4f30-95fd-07502506c9d2 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:17.849073 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-0fb5cba5-d9d5-4f30-95fd-07502506c9d2 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7db99f361654711bea7f1b2c404d312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7adedcdb9c3485ea2738c00e25aa3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:17.859304 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-0fb5cba5-d9d5-4f30-95fd-07502506c9d2 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] 10.222.0.43 "GET /compute/v2.1/servers/4311d976-991e-4ab1-9d5e-d654aa7d0b08" status: 200 len: 1469 microversion: 2.1 time: 0.261344 Oct 04 18:32:17.860209 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 164/313] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:17 2022] GET /compute/v2.1/servers/4311d976-991e-4ab1-9d5e-d654aa7d0b08 => generated 1469 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:17.866071 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-17a2d104-149c-48f4-a3b0-727942e38497 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:17.866870 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-17a2d104-149c-48f4-a3b0-727942e38497 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] [instance: b249a7cd-d1ee-4a74-a93d-9991ba84785f] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:17.896762 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-17a2d104-149c-48f4-a3b0-727942e38497 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:17.902001 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-17a2d104-149c-48f4-a3b0-727942e38497 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:17.903856 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-17a2d104-149c-48f4-a3b0-727942e38497 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:17.906299 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-17a2d104-149c-48f4-a3b0-727942e38497 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:17.906774 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-17a2d104-149c-48f4-a3b0-727942e38497 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:17.907210 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-17a2d104-149c-48f4-a3b0-727942e38497 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:17.911935 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-6c5dca0f-e678-4fe4-a966-77b2c500c0b8 tempest-FlavorsAccessTestJSON-1964749454 tempest-FlavorsAccessTestJSON-1964749454-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors/1842884682/action" status: 200 len: 21 microversion: 2.1 time: 0.716518 Oct 04 18:32:17.914510 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 150/314] 10.222.0.43 () {60 vars in 1200 bytes} [Tue Oct 4 18:32:17 2022] POST /compute/v2.1/flavors/1842884682/action => generated 21 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:32:17.929588 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-15d62b03-2f6f-40c7-b43b-4b7aa521bc34 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:17.930424 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-15d62b03-2f6f-40c7-b43b-4b7aa521bc34 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] [instance: 606aebcb-2b6a-469f-a578-91325770ab4b] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:18.053476 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-15d62b03-2f6f-40c7-b43b-4b7aa521bc34 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f207a188e3fa4987b9fe4dd773ad03b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c636de1e6b42868f1f58e46fd4a3f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:18.071071 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-15d62b03-2f6f-40c7-b43b-4b7aa521bc34 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] 10.222.0.43 "GET /compute/v2.1/servers/606aebcb-2b6a-469f-a578-91325770ab4b" status: 200 len: 1232 microversion: 2.1 time: 0.155442 Oct 04 18:32:18.071664 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 151/315] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:17 2022] GET /compute/v2.1/servers/606aebcb-2b6a-469f-a578-91325770ab4b => generated 1232 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:18.183690 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-17a2d104-149c-48f4-a3b0-727942e38497 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '459e65f14af049bba311453d6a86360b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1753b9ee9a644e409a1efd0c9e7c152c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:18.194599 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-17a2d104-149c-48f4-a3b0-727942e38497 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] 10.222.0.43 "GET /compute/v2.1/servers/b249a7cd-d1ee-4a74-a93d-9991ba84785f" status: 200 len: 1319 microversion: 2.1 time: 0.332911 Oct 04 18:32:18.195185 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 165/316] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:17 2022] GET /compute/v2.1/servers/b249a7cd-d1ee-4a74-a93d-9991ba84785f => generated 1319 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:18.203498 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-a79df7fb-18b1-401b-a07b-688c8ed97fa0 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:18.232391 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-a79df7fb-18b1-401b-a07b-688c8ed97fa0 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a7db99f361654711bea7f1b2c404d312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7adedcdb9c3485ea2738c00e25aa3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:18.233339 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-a79df7fb-18b1-401b-a07b-688c8ed97fa0 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Searching by: {'reservation_id': 'r-uuchw9zp', 'deleted': False, 'project_id': 'e7adedcdb9c3485ea2738c00e25aa3fd'} {{(pid=123596) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:32:18.242957 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a79df7fb-18b1-401b-a07b-688c8ed97fa0 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:18.243415 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a79df7fb-18b1-401b-a07b-688c8ed97fa0 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:18.244461 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a79df7fb-18b1-401b-a07b-688c8ed97fa0 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:18.245894 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a79df7fb-18b1-401b-a07b-688c8ed97fa0 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:18.246389 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a79df7fb-18b1-401b-a07b-688c8ed97fa0 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:18.246960 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a79df7fb-18b1-401b-a07b-688c8ed97fa0 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:18.437622 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.multi_cell_list [None req-a79df7fb-18b1-401b-a07b-688c8ed97fa0 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=123596) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 18:32:18.497972 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=100 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:32:18.578267 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-a79df7fb-18b1-401b-a07b-688c8ed97fa0 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7db99f361654711bea7f1b2c404d312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7adedcdb9c3485ea2738c00e25aa3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:18.582840 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-3fc94019-396a-46a7-b870-d43c314ce5ce tempest-HypervisorAdminV228Test-1112405447 tempest-HypervisorAdminV228Test-1112405447-project-admin] Calling method '.version_select at 0x7fb22467adc0>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:18.585244 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3fc94019-396a-46a7-b870-d43c314ce5ce tempest-HypervisorAdminV228Test-1112405447 tempest-HypervisorAdminV228Test-1112405447-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:18.585833 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3fc94019-396a-46a7-b870-d43c314ce5ce tempest-HypervisorAdminV228Test-1112405447 tempest-HypervisorAdminV228Test-1112405447-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:18.586283 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3fc94019-396a-46a7-b870-d43c314ce5ce tempest-HypervisorAdminV228Test-1112405447 tempest-HypervisorAdminV228Test-1112405447-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:18.597751 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a79df7fb-18b1-401b-a07b-688c8ed97fa0 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:18.598242 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a79df7fb-18b1-401b-a07b-688c8ed97fa0 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:18.598687 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a79df7fb-18b1-401b-a07b-688c8ed97fa0 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:18.604713 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3fc94019-396a-46a7-b870-d43c314ce5ce tempest-HypervisorAdminV228Test-1112405447 tempest-HypervisorAdminV228Test-1112405447-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:18.606158 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3fc94019-396a-46a7-b870-d43c314ce5ce tempest-HypervisorAdminV228Test-1112405447 tempest-HypervisorAdminV228Test-1112405447-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:18.608017 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3fc94019-396a-46a7-b870-d43c314ce5ce tempest-HypervisorAdminV228Test-1112405447 tempest-HypervisorAdminV228Test-1112405447-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:18.627029 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3fc94019-396a-46a7-b870-d43c314ce5ce tempest-HypervisorAdminV228Test-1112405447 tempest-HypervisorAdminV228Test-1112405447-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:18.628379 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3fc94019-396a-46a7-b870-d43c314ce5ce tempest-HypervisorAdminV228Test-1112405447 tempest-HypervisorAdminV228Test-1112405447-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:18.629289 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3fc94019-396a-46a7-b870-d43c314ce5ce tempest-HypervisorAdminV228Test-1112405447 tempest-HypervisorAdminV228Test-1112405447-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:18.639121 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-3fc94019-396a-46a7-b870-d43c314ce5ce tempest-HypervisorAdminV228Test-1112405447 tempest-HypervisorAdminV228Test-1112405447-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.28 time: 0.564846 Oct 04 18:32:18.641045 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 152/317] 10.222.0.43 () {60 vars in 1187 bytes} [Tue Oct 4 18:32:18 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:32:18.648978 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-84c70a3e-5624-4f79-9f14-d1163d85acc8 tempest-FlavorsAccessTestJSON-320194953 tempest-FlavorsAccessTestJSON-320194953-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:18.686180 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-84c70a3e-5624-4f79-9f14-d1163d85acc8 tempest-FlavorsAccessTestJSON-320194953 tempest-FlavorsAccessTestJSON-320194953-project] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 5818 microversion: 2.1 time: 0.043282 Oct 04 18:32:18.688270 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 153/318] 10.222.0.43 () {58 vars in 1146 bytes} [Tue Oct 4 18:32:18 2022] GET /compute/v2.1/flavors/detail => generated 5818 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:18.695768 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-0e4edf9c-d323-40e7-893f-f3ae4cc39fd4 tempest-HypervisorAdminV228Test-1112405447 tempest-HypervisorAdminV228Test-1112405447-project-admin] Calling method '.version_select at 0x7fb224485430>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:18.700241 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0e4edf9c-d323-40e7-893f-f3ae4cc39fd4 tempest-HypervisorAdminV228Test-1112405447 tempest-HypervisorAdminV228Test-1112405447-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:18.700953 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0e4edf9c-d323-40e7-893f-f3ae4cc39fd4 tempest-HypervisorAdminV228Test-1112405447 tempest-HypervisorAdminV228Test-1112405447-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:18.701782 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0e4edf9c-d323-40e7-893f-f3ae4cc39fd4 tempest-HypervisorAdminV228Test-1112405447 tempest-HypervisorAdminV228Test-1112405447-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:18.736722 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0e4edf9c-d323-40e7-893f-f3ae4cc39fd4 tempest-HypervisorAdminV228Test-1112405447 tempest-HypervisorAdminV228Test-1112405447-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:18.737353 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0e4edf9c-d323-40e7-893f-f3ae4cc39fd4 tempest-HypervisorAdminV228Test-1112405447 tempest-HypervisorAdminV228Test-1112405447-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:18.738190 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0e4edf9c-d323-40e7-893f-f3ae4cc39fd4 tempest-HypervisorAdminV228Test-1112405447 tempest-HypervisorAdminV228Test-1112405447-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:18.746883 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-0e4edf9c-d323-40e7-893f-f3ae4cc39fd4 tempest-HypervisorAdminV228Test-1112405447 tempest-HypervisorAdminV228Test-1112405447-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 720 microversion: 2.28 time: 0.056170 Oct 04 18:32:18.748708 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 154/319] 10.222.0.43 () {60 vars in 1193 bytes} [Tue Oct 4 18:32:18 2022] GET /compute/v2.1/os-hypervisors/1 => generated 720 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:32:18.754462 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-234ad4bc-26ef-4b84-9589-c896802ba944 tempest-FlavorsAccessTestJSON-1964749454 tempest-FlavorsAccessTestJSON-1964749454-project-admin] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:18.787306 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-234ad4bc-26ef-4b84-9589-c896802ba944 tempest-FlavorsAccessTestJSON-1964749454 tempest-FlavorsAccessTestJSON-1964749454-project-admin] 10.222.0.43 "DELETE /compute/v2.1/flavors/1842884682" status: 202 len: 0 microversion: 2.1 time: 0.036141 Oct 04 18:32:18.790077 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 155/320] 10.222.0.43 () {58 vars in 1161 bytes} [Tue Oct 4 18:32:18 2022] DELETE /compute/v2.1/flavors/1842884682 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:32:18.799932 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-fbbf8e4f-a09e-4b7e-84ae-fc4159d0ced4 tempest-FlavorsAccessTestJSON-1964749454 tempest-FlavorsAccessTestJSON-1964749454-project-admin] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:18.823951 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-fbbf8e4f-a09e-4b7e-84ae-fc4159d0ced4 tempest-FlavorsAccessTestJSON-1964749454 tempest-FlavorsAccessTestJSON-1964749454-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 5818 microversion: 2.1 time: 0.027464 Oct 04 18:32:18.824980 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 156/321] 10.222.0.43 () {58 vars in 1146 bytes} [Tue Oct 4 18:32:18 2022] GET /compute/v2.1/flavors/detail => generated 5818 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:18.860968 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-a79df7fb-18b1-401b-a07b-688c8ed97fa0 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] 10.222.0.43 "GET /compute/v2.1/servers/detail?reservation_id=r-uuchw9zp" status: 200 len: 2931 microversion: 2.1 time: 0.664287 Oct 04 18:32:18.861613 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 166/322] 10.222.0.43 () {58 vars in 1197 bytes} [Tue Oct 4 18:32:18 2022] GET /compute/v2.1/servers/detail?reservation_id=r-uuchw9zp => generated 2931 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:18.870871 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-7e5a8182-21b7-424f-8852-2741c38b34cc tempest-FlavorsAccessTestJSON-1964749454 tempest-FlavorsAccessTestJSON-1964749454-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-443417698", "id": 587805597, "os-flavor-access:is_public": "False"}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:18.898617 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-7e5a8182-21b7-424f-8852-2741c38b34cc tempest-FlavorsAccessTestJSON-1964749454 tempest-FlavorsAccessTestJSON-1964749454-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 0.035821 Oct 04 18:32:18.908037 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 167/323] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 18:32:18 2022] POST /compute/v2.1/flavors => generated 427 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:32:18.913225 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-8494cc8c-8073-4dd5-b86a-af1ba330116e tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:18.943473 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.compute.server_groups [None req-8494cc8c-8073-4dd5-b86a-af1ba330116e tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Querying cell 66287c68-6a08-453f-953b-bd2446fe0d25(cell1) for 2 instances {{(pid=123596) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 04 18:32:18.945371 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8494cc8c-8073-4dd5-b86a-af1ba330116e tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:18.947563 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8494cc8c-8073-4dd5-b86a-af1ba330116e tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:18.948064 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8494cc8c-8073-4dd5-b86a-af1ba330116e tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:18.991815 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-8494cc8c-8073-4dd5-b86a-af1ba330116e tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] 10.222.0.43 "GET /compute/v2.1/os-server-groups/2e541515-72cb-4ea1-b049-ec95de4faec4" status: 200 len: 265 microversion: 2.1 time: 0.082102 Oct 04 18:32:18.992594 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 168/324] 10.222.0.43 () {58 vars in 1263 bytes} [Tue Oct 4 18:32:18 2022] GET /compute/v2.1/os-server-groups/2e541515-72cb-4ea1-b049-ec95de4faec4 => generated 265 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:32:19.000986 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-8293b22f-fb1a-40ae-b114-0b3be53f187d tempest-FlavorsAccessTestJSON-1964749454 tempest-FlavorsAccessTestJSON-1964749454-project-admin] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:19.045777 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-8293b22f-fb1a-40ae-b114-0b3be53f187d tempest-FlavorsAccessTestJSON-1964749454 tempest-FlavorsAccessTestJSON-1964749454-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/587805597/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.051740 Oct 04 18:32:19.053373 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 169/325] 10.222.0.43 () {58 vars in 1206 bytes} [Tue Oct 4 18:32:18 2022] GET /compute/v2.1/flavors/587805597/os-flavor-access => generated 21 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:32:19.068080 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-c9f97f23-fb1f-4b7b-865d-55cc13645762 tempest-ServersOnMultiNodesTest-1245420526 tempest-ServersOnMultiNodesTest-1245420526-project-admin] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:19.068884 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-c9f97f23-fb1f-4b7b-865d-55cc13645762 tempest-ServersOnMultiNodesTest-1245420526 tempest-ServersOnMultiNodesTest-1245420526-project-admin] [instance: c4b812d5-f2ff-41c7-b912-3d19d752340b] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:19.078406 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c9f97f23-fb1f-4b7b-865d-55cc13645762 tempest-ServersOnMultiNodesTest-1245420526 tempest-ServersOnMultiNodesTest-1245420526-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:19.079514 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c9f97f23-fb1f-4b7b-865d-55cc13645762 tempest-ServersOnMultiNodesTest-1245420526 tempest-ServersOnMultiNodesTest-1245420526-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:19.080404 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c9f97f23-fb1f-4b7b-865d-55cc13645762 tempest-ServersOnMultiNodesTest-1245420526 tempest-ServersOnMultiNodesTest-1245420526-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:19.081583 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c9f97f23-fb1f-4b7b-865d-55cc13645762 tempest-ServersOnMultiNodesTest-1245420526 tempest-ServersOnMultiNodesTest-1245420526-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:19.082252 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c9f97f23-fb1f-4b7b-865d-55cc13645762 tempest-ServersOnMultiNodesTest-1245420526 tempest-ServersOnMultiNodesTest-1245420526-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:19.083166 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c9f97f23-fb1f-4b7b-865d-55cc13645762 tempest-ServersOnMultiNodesTest-1245420526 tempest-ServersOnMultiNodesTest-1245420526-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:19.100984 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-4b13a77b-0c6f-428e-a61e-d7e1e1ac6d7e tempest-AggregatesAdminNegativeTestJSON-635194796 tempest-AggregatesAdminNegativeTestJSON-635194796-project-admin] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:19.110693 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4b13a77b-0c6f-428e-a61e-d7e1e1ac6d7e tempest-AggregatesAdminNegativeTestJSON-635194796 tempest-AggregatesAdminNegativeTestJSON-635194796-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:19.111177 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4b13a77b-0c6f-428e-a61e-d7e1e1ac6d7e tempest-AggregatesAdminNegativeTestJSON-635194796 tempest-AggregatesAdminNegativeTestJSON-635194796-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:19.111671 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4b13a77b-0c6f-428e-a61e-d7e1e1ac6d7e tempest-AggregatesAdminNegativeTestJSON-635194796 tempest-AggregatesAdminNegativeTestJSON-635194796-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:19.112355 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4b13a77b-0c6f-428e-a61e-d7e1e1ac6d7e tempest-AggregatesAdminNegativeTestJSON-635194796 tempest-AggregatesAdminNegativeTestJSON-635194796-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:19.112813 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4b13a77b-0c6f-428e-a61e-d7e1e1ac6d7e tempest-AggregatesAdminNegativeTestJSON-635194796 tempest-AggregatesAdminNegativeTestJSON-635194796-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:19.113267 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4b13a77b-0c6f-428e-a61e-d7e1e1ac6d7e tempest-AggregatesAdminNegativeTestJSON-635194796 tempest-AggregatesAdminNegativeTestJSON-635194796-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:19.160915 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-4b13a77b-0c6f-428e-a61e-d7e1e1ac6d7e tempest-AggregatesAdminNegativeTestJSON-635194796 tempest-AggregatesAdminNegativeTestJSON-635194796-project-admin] 10.222.0.43 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.324673 Oct 04 18:32:19.165588 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 157/326] 10.222.0.43 () {58 vars in 1176 bytes} [Tue Oct 4 18:32:18 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:32:19.174238 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-cd8923d4-194b-4c94-8039-57395b8e5951 tempest-FlavorsAccessTestJSON-1964749454 tempest-FlavorsAccessTestJSON-1964749454-project-admin] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:19.212348 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-cd8923d4-194b-4c94-8039-57395b8e5951 tempest-FlavorsAccessTestJSON-1964749454 tempest-FlavorsAccessTestJSON-1964749454-project-admin] 10.222.0.43 "DELETE /compute/v2.1/flavors/587805597" status: 202 len: 0 microversion: 2.1 time: 0.045213 Oct 04 18:32:19.212939 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 158/327] 10.222.0.43 () {58 vars in 1158 bytes} [Tue Oct 4 18:32:19 2022] DELETE /compute/v2.1/flavors/587805597 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:32:19.219593 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-5f9a2b5a-1e5a-4ac1-9181-84acf335d430 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:19.223026 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-5f9a2b5a-1e5a-4ac1-9181-84acf335d430 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] [instance: 606aebcb-2b6a-469f-a578-91325770ab4b] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:19.232984 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5f9a2b5a-1e5a-4ac1-9181-84acf335d430 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:19.233989 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5f9a2b5a-1e5a-4ac1-9181-84acf335d430 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:19.234687 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5f9a2b5a-1e5a-4ac1-9181-84acf335d430 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:19.235512 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5f9a2b5a-1e5a-4ac1-9181-84acf335d430 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:19.236041 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5f9a2b5a-1e5a-4ac1-9181-84acf335d430 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:19.236692 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5f9a2b5a-1e5a-4ac1-9181-84acf335d430 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:19.281899 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-c9f97f23-fb1f-4b7b-865d-55cc13645762 tempest-ServersOnMultiNodesTest-1245420526 tempest-ServersOnMultiNodesTest-1245420526-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/c4b812d5-f2ff-41c7-b912-3d19d752340b" status: 200 len: 1622 microversion: 2.1 time: 0.223260 Oct 04 18:32:19.283470 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 170/328] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:19 2022] GET /compute/v2.1/servers/c4b812d5-f2ff-41c7-b912-3d19d752340b => generated 1622 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:19.288565 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-95bbd147-aac3-4414-83de-8f0bbfac50fd tempest-AggregatesAdminNegativeTestJSON-635194796 tempest-AggregatesAdminNegativeTestJSON-635194796-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1652011141"}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:19.292476 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.objects.aggregate [None req-95bbd147-aac3-4414-83de-8f0bbfac50fd tempest-AggregatesAdminNegativeTestJSON-635194796 tempest-AggregatesAdminNegativeTestJSON-635194796-project-admin] Generated uuid 0e47cec9-9c38-41bc-a3ef-68dcf79cf3d9 for aggregate {{(pid=123596) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 18:32:19.322259 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-5f9a2b5a-1e5a-4ac1-9181-84acf335d430 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f207a188e3fa4987b9fe4dd773ad03b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c636de1e6b42868f1f58e46fd4a3f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:19.332064 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-95bbd147-aac3-4414-83de-8f0bbfac50fd tempest-AggregatesAdminNegativeTestJSON-635194796 tempest-AggregatesAdminNegativeTestJSON-635194796-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.043927 Oct 04 18:32:19.332742 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 171/329] 10.222.0.43 () {60 vars in 1164 bytes} [Tue Oct 4 18:32:19 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:32:19.346358 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-5f9a2b5a-1e5a-4ac1-9181-84acf335d430 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] 10.222.0.43 "GET /compute/v2.1/servers/606aebcb-2b6a-469f-a578-91325770ab4b" status: 200 len: 1284 microversion: 2.1 time: 0.129519 Oct 04 18:32:19.346983 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 159/330] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:19 2022] GET /compute/v2.1/servers/606aebcb-2b6a-469f-a578-91325770ab4b => generated 1284 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:19.353028 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-8843e8ad-b33b-4ef5-921b-a868d13a2119 tempest-FlavorsAccessTestJSON-1964749454 tempest-FlavorsAccessTestJSON-1964749454-project-admin] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:19.361202 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-598a253b-03ef-4a27-aee9-dbfce4e66f70 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:19.361822 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-598a253b-03ef-4a27-aee9-dbfce4e66f70 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] [instance: b249a7cd-d1ee-4a74-a93d-9991ba84785f] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:19.376786 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-598a253b-03ef-4a27-aee9-dbfce4e66f70 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:19.377793 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-598a253b-03ef-4a27-aee9-dbfce4e66f70 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:19.378386 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-598a253b-03ef-4a27-aee9-dbfce4e66f70 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:19.379481 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-598a253b-03ef-4a27-aee9-dbfce4e66f70 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:19.380148 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-598a253b-03ef-4a27-aee9-dbfce4e66f70 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:19.381169 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-598a253b-03ef-4a27-aee9-dbfce4e66f70 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:19.417946 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-8843e8ad-b33b-4ef5-921b-a868d13a2119 tempest-FlavorsAccessTestJSON-1964749454 tempest-FlavorsAccessTestJSON-1964749454-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 5818 microversion: 2.1 time: 0.072525 Oct 04 18:32:19.418590 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 172/331] 10.222.0.43 () {58 vars in 1146 bytes} [Tue Oct 4 18:32:19 2022] GET /compute/v2.1/flavors/detail => generated 5818 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:19.433126 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-d7c74f55-dc95-4087-885c-d6940f4c666d tempest-ServersOnMultiNodesTest-1245420526 tempest-ServersOnMultiNodesTest-1245420526-project-admin] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:19.434294 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-d7c74f55-dc95-4087-885c-d6940f4c666d tempest-ServersOnMultiNodesTest-1245420526 tempest-ServersOnMultiNodesTest-1245420526-project-admin] [instance: 4311d976-991e-4ab1-9d5e-d654aa7d0b08] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:19.442821 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d7c74f55-dc95-4087-885c-d6940f4c666d tempest-ServersOnMultiNodesTest-1245420526 tempest-ServersOnMultiNodesTest-1245420526-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:19.443629 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d7c74f55-dc95-4087-885c-d6940f4c666d tempest-ServersOnMultiNodesTest-1245420526 tempest-ServersOnMultiNodesTest-1245420526-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:19.444252 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d7c74f55-dc95-4087-885c-d6940f4c666d tempest-ServersOnMultiNodesTest-1245420526 tempest-ServersOnMultiNodesTest-1245420526-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:19.445358 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d7c74f55-dc95-4087-885c-d6940f4c666d tempest-ServersOnMultiNodesTest-1245420526 tempest-ServersOnMultiNodesTest-1245420526-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:19.446063 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d7c74f55-dc95-4087-885c-d6940f4c666d tempest-ServersOnMultiNodesTest-1245420526 tempest-ServersOnMultiNodesTest-1245420526-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:19.446725 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d7c74f55-dc95-4087-885c-d6940f4c666d tempest-ServersOnMultiNodesTest-1245420526 tempest-ServersOnMultiNodesTest-1245420526-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:19.646327 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-598a253b-03ef-4a27-aee9-dbfce4e66f70 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '459e65f14af049bba311453d6a86360b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1753b9ee9a644e409a1efd0c9e7c152c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:19.658412 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-598a253b-03ef-4a27-aee9-dbfce4e66f70 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] 10.222.0.43 "GET /compute/v2.1/servers/b249a7cd-d1ee-4a74-a93d-9991ba84785f" status: 200 len: 1468 microversion: 2.1 time: 0.307605 Oct 04 18:32:19.692308 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 160/332] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:19 2022] GET /compute/v2.1/servers/b249a7cd-d1ee-4a74-a93d-9991ba84785f => generated 1468 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:19.701094 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-70746a2f-ed66-4f3c-adc4-2a0b2a3bf07a tempest-AggregatesAdminNegativeTestJSON-635194796 tempest-AggregatesAdminNegativeTestJSON-635194796-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-851028-13"}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:19.741160 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-70746a2f-ed66-4f3c-adc4-2a0b2a3bf07a tempest-AggregatesAdminNegativeTestJSON-635194796 tempest-AggregatesAdminNegativeTestJSON-635194796-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:19.742012 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-70746a2f-ed66-4f3c-adc4-2a0b2a3bf07a tempest-AggregatesAdminNegativeTestJSON-635194796 tempest-AggregatesAdminNegativeTestJSON-635194796-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:19.742555 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-70746a2f-ed66-4f3c-adc4-2a0b2a3bf07a tempest-AggregatesAdminNegativeTestJSON-635194796 tempest-AggregatesAdminNegativeTestJSON-635194796-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:19.789268 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=88,nova_api:UPDATE=1,nova_api:DELETE=7 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:32:19.977416 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-d7c74f55-dc95-4087-885c-d6940f4c666d tempest-ServersOnMultiNodesTest-1245420526 tempest-ServersOnMultiNodesTest-1245420526-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/4311d976-991e-4ab1-9d5e-d654aa7d0b08" status: 200 len: 1622 microversion: 2.1 time: 0.555154 Oct 04 18:32:19.996118 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 173/333] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:19 2022] GET /compute/v2.1/servers/4311d976-991e-4ab1-9d5e-d654aa7d0b08 => generated 1622 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:20.016392 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-54ea998f-ec9d-4d95-99ea-4a8c747514e9 tempest-DeleteServersAdminTestJSON-1863575440 tempest-DeleteServersAdminTestJSON-1863575440-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:20.022261 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-54ea998f-ec9d-4d95-99ea-4a8c747514e9 tempest-DeleteServersAdminTestJSON-1863575440 tempest-DeleteServersAdminTestJSON-1863575440-project-admin] [instance: b249a7cd-d1ee-4a74-a93d-9991ba84785f] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:20.030001 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-70746a2f-ed66-4f3c-adc4-2a0b2a3bf07a tempest-AggregatesAdminNegativeTestJSON-635194796 tempest-AggregatesAdminNegativeTestJSON-635194796-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 244 microversion: 2.1 time: 0.334990 Oct 04 18:32:20.036923 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 161/334] 10.222.0.43 () {60 vars in 1194 bytes} [Tue Oct 4 18:32:19 2022] POST /compute/v2.1/os-aggregates/11/action => generated 244 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:32:20.040032 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-f514cbb9-6b35-413a-993d-e930a192dc81 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Action: 'create', calling method: .version_select at 0x7fb224539820>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-1786200476", "policies": ["anti-affinity"]}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:20.051608 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-54ea998f-ec9d-4d95-99ea-4a8c747514e9 tempest-DeleteServersAdminTestJSON-1863575440 tempest-DeleteServersAdminTestJSON-1863575440-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:20.053402 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-54ea998f-ec9d-4d95-99ea-4a8c747514e9 tempest-DeleteServersAdminTestJSON-1863575440 tempest-DeleteServersAdminTestJSON-1863575440-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:20.062410 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-54ea998f-ec9d-4d95-99ea-4a8c747514e9 tempest-DeleteServersAdminTestJSON-1863575440 tempest-DeleteServersAdminTestJSON-1863575440-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:20.064662 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-54ea998f-ec9d-4d95-99ea-4a8c747514e9 tempest-DeleteServersAdminTestJSON-1863575440 tempest-DeleteServersAdminTestJSON-1863575440-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:20.065586 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-54ea998f-ec9d-4d95-99ea-4a8c747514e9 tempest-DeleteServersAdminTestJSON-1863575440 tempest-DeleteServersAdminTestJSON-1863575440-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:20.066783 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-54ea998f-ec9d-4d95-99ea-4a8c747514e9 tempest-DeleteServersAdminTestJSON-1863575440 tempest-DeleteServersAdminTestJSON-1863575440-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:20.110598 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-f514cbb9-6b35-413a-993d-e930a192dc81 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Getting quotas for project e7adedcdb9c3485ea2738c00e25aa3fd. Resources: {'server_groups'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:32:20.129006 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-f514cbb9-6b35-413a-993d-e930a192dc81 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Getting quotas for user a7db99f361654711bea7f1b2c404d312 and project e7adedcdb9c3485ea2738c00e25aa3fd. Resources: {'server_groups'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:32:20.245181 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-f514cbb9-6b35-413a-993d-e930a192dc81 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Getting quotas for project e7adedcdb9c3485ea2738c00e25aa3fd. Resources: {'server_groups'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:32:20.257563 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-f514cbb9-6b35-413a-993d-e930a192dc81 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Getting quotas for user a7db99f361654711bea7f1b2c404d312 and project e7adedcdb9c3485ea2738c00e25aa3fd. Resources: {'server_groups'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:32:20.268814 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-54ea998f-ec9d-4d95-99ea-4a8c747514e9 tempest-DeleteServersAdminTestJSON-1863575440 tempest-DeleteServersAdminTestJSON-1863575440-project-admin] 10.222.0.43 "POST /compute/v2.1/servers/b249a7cd-d1ee-4a74-a93d-9991ba84785f/action" status: 202 len: 0 microversion: 2.1 time: 0.269495 Oct 04 18:32:20.272077 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 174/335] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 18:32:19 2022] POST /compute/v2.1/servers/b249a7cd-d1ee-4a74-a93d-9991ba84785f/action => generated 0 bytes in 275 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:32:20.285382 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-8d0dc68a-7268-4dd2-bf04-b77e442bc4d8 tempest-AggregatesAdminNegativeTestJSON-635194796 tempest-AggregatesAdminNegativeTestJSON-635194796-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-851028-13"}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:20.299918 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-f514cbb9-6b35-413a-993d-e930a192dc81 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] 10.222.0.43 "POST /compute/v2.1/os-server-groups" status: 200 len: 193 microversion: 2.1 time: 0.267891 Oct 04 18:32:20.301607 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 162/336] 10.222.0.43 () {60 vars in 1174 bytes} [Tue Oct 4 18:32:20 2022] POST /compute/v2.1/os-server-groups => generated 193 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:32:20.309239 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-585df961-0a53-41a9-a57b-dcf1f9f73e29 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:20.310142 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-585df961-0a53-41a9-a57b-dcf1f9f73e29 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] [instance: b249a7cd-d1ee-4a74-a93d-9991ba84785f] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:20.319287 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8d0dc68a-7268-4dd2-bf04-b77e442bc4d8 tempest-AggregatesAdminNegativeTestJSON-635194796 tempest-AggregatesAdminNegativeTestJSON-635194796-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:20.319813 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8d0dc68a-7268-4dd2-bf04-b77e442bc4d8 tempest-AggregatesAdminNegativeTestJSON-635194796 tempest-AggregatesAdminNegativeTestJSON-635194796-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:20.320303 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8d0dc68a-7268-4dd2-bf04-b77e442bc4d8 tempest-AggregatesAdminNegativeTestJSON-635194796 tempest-AggregatesAdminNegativeTestJSON-635194796-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:20.332304 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-585df961-0a53-41a9-a57b-dcf1f9f73e29 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:20.333332 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-585df961-0a53-41a9-a57b-dcf1f9f73e29 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:20.334277 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-585df961-0a53-41a9-a57b-dcf1f9f73e29 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:20.335332 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-585df961-0a53-41a9-a57b-dcf1f9f73e29 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:20.336211 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-585df961-0a53-41a9-a57b-dcf1f9f73e29 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:20.336822 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-585df961-0a53-41a9-a57b-dcf1f9f73e29 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:20.379382 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-8d0dc68a-7268-4dd2-bf04-b77e442bc4d8 tempest-AggregatesAdminNegativeTestJSON-635194796 tempest-AggregatesAdminNegativeTestJSON-635194796-project-admin] HTTP exception thrown: Aggregate 11 already has host n-h2-851028-13. Oct 04 18:32:20.412159 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-8d0dc68a-7268-4dd2-bf04-b77e442bc4d8 tempest-AggregatesAdminNegativeTestJSON-635194796 tempest-AggregatesAdminNegativeTestJSON-635194796-project-admin] Request method failure captured: Oct 04 18:32:20.412159 n-d-851028-13 devstack@n-api.service[123596]: request: POST /compute/v2.1/os-aggregates/11/action HTTP/1.1 Oct 04 18:32:20.412159 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:32:20.412159 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:32:20.412159 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:32:20.412159 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 40 Oct 04 18:32:20.412159 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:32:20.412159 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:32:20.412159 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:32:20.412159 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:32:20.412159 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPHwyghqUch5OFDRJqqz8nEa33TeaPKuolXJF37XvIGGrBUnil9VLtRpwr8tXHQYd2YuLtGPymX_aVheJCMCI_4tGi1FGxwVHH3MQL3S2iFZNTSl0_Ki7FTyAAgkh9v_i1p_BuHy4MxeG0E3GwhW0NOSWqt9BhtXq7d-PfJXr9XH-CkQ Oct 04 18:32:20.412159 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:32:20.412159 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:32:20.412159 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:32:20.412159 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:32:20.412159 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:32:20.412159 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:32:20.412159 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: bce7a697f1cb43c2b64ff85b7add03b4 Oct 04 18:32:20.412159 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-635194796 Oct 04 18:32:20.412159 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,admin,reader Oct 04 18:32:20.412159 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,admin,reader Oct 04 18:32:20.413920 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/bce7a697f1cb43c2b64ff85b7add03b4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_bce7a697f1cb43c2b64ff85b7add03b4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/bce7a697f1cb43c2b64ff85b7add03b4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/bce7a697f1cb43c2b64ff85b7add03b4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:32:20.413920 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-635194796 Oct 04 18:32:20.413920 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: bce7a697f1cb43c2b64ff85b7add03b4 Oct 04 18:32:20.413920 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-635194796 Oct 04 18:32:20.413920 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-AggregatesAdminNegativeTestJSON-635194796-project-admin Oct 04 18:32:20.413920 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:32:20.413920 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:32:20.413920 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: fb2baff63b274646ac21f934327e4294 Oct 04 18:32:20.413920 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-635194796-project-admin Oct 04 18:32:20.413920 n-d-851028-13 devstack@n-api.service[123596]: Oct 04 18:32:20.413920 n-d-851028-13 devstack@n-api.service[123596]: {"add_host": {"host": "n-h2-851028-13"}} Oct 04 18:32:20.413920 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 18:32:20.413920 n-d-851028-13 devstack@n-api.service[123596]: exception: Aggregate 11 already has host n-h2-851028-13. Oct 04 18:32:20.415037 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': '11', 'body': {'add_host': {'host': 'n-h2-851028-13'}}} Oct 04 18:32:20.415037 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:32:20.415037 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:20.415037 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 04 18:32:20.415037 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 04 18:32:20.415037 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 04 18:32:20.415037 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 04 18:32:20.415037 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 04 18:32:20.415037 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 04 18:32:20.415037 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 04 18:32:20.415037 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 04 18:32:20.415037 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 04 18:32:20.415037 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 04 18:32:20.415037 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 04 18:32:20.415037 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi result.read() Oct 04 18:32:20.415037 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 04 18:32:20.415037 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 04 18:32:20.415037 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 04 18:32:20.415037 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 04 18:32:20.416574 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 04 18:32:20.416574 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 04 18:32:20.416574 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 04 18:32:20.416574 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 04 18:32:20.416574 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'n-h2-851028-13-11' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Oct 04 18:32:20.416574 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:32:20.416574 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 04 18:32:20.416574 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:32:20.416574 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:20.416574 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 73, in _host_add_to_db Oct 04 18:32:20.416574 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi host_ref.save(context.session) Oct 04 18:32:20.416574 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 04 18:32:20.416574 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi session.flush() Oct 04 18:32:20.416574 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 04 18:32:20.416574 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 04 18:32:20.416574 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 04 18:32:20.416574 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 04 18:32:20.416574 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 04 18:32:20.416574 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 04 18:32:20.418088 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 04 18:32:20.418088 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception Oct 04 18:32:20.418088 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 04 18:32:20.418088 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 04 18:32:20.418088 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 04 18:32:20.418088 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 04 18:32:20.418088 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 04 18:32:20.418088 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 04 18:32:20.418088 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 04 18:32:20.418088 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 04 18:32:20.418088 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 04 18:32:20.418088 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 04 18:32:20.418088 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 04 18:32:20.418088 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 04 18:32:20.418088 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 04 18:32:20.418088 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 04 18:32:20.418088 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 04 18:32:20.418088 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 04 18:32:20.419358 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 04 18:32:20.419358 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 04 18:32:20.419358 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 04 18:32:20.419358 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 04 18:32:20.419358 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 04 18:32:20.419358 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception Oct 04 18:32:20.419358 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 04 18:32:20.419358 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 04 18:32:20.419358 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 04 18:32:20.419358 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 04 18:32:20.419358 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 04 18:32:20.419358 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 04 18:32:20.419358 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 04 18:32:20.419358 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 04 18:32:20.419358 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 04 18:32:20.419358 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 04 18:32:20.419358 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 04 18:32:20.419358 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi result.read() Oct 04 18:32:20.420905 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 04 18:32:20.420905 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 04 18:32:20.420905 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 04 18:32:20.420905 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 04 18:32:20.420905 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 04 18:32:20.420905 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 04 18:32:20.420905 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 04 18:32:20.420905 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 04 18:32:20.420905 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'n-h2-851028-13-11' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Oct 04 18:32:20.420905 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO aggregate_hosts (created_at, updated_at, host, aggregate_id) VALUES (%(created_at)s, %(updated_at)s, %(host)s, %(aggregate_id)s)] Oct 04 18:32:20.420905 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 4, 18, 32, 20, 363293), 'updated_at': None, 'host': 'n-h2-851028-13', 'aggregate_id': 11}] Oct 04 18:32:20.420905 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 04 18:32:20.420905 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:32:20.420905 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:20.420905 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:32:20.420905 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:20.420905 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Oct 04 18:32:20.422320 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Oct 04 18:32:20.422320 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 04 18:32:20.422320 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 04 18:32:20.422320 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:32:20.422320 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:32:20.422320 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:32:20.422320 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:32:20.422320 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 04 18:32:20.422320 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 04 18:32:20.422320 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6641, in add_host_to_aggregate Oct 04 18:32:20.422320 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi aggregate.add_host(host_name) Oct 04 18:32:20.422320 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 04 18:32:20.422320 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 04 18:32:20.422320 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 395, in add_host Oct 04 18:32:20.422320 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi _host_add_to_db(self._context, self.id, host) Oct 04 18:32:20.422320 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 76, in _host_add_to_db Oct 04 18:32:20.422320 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.AggregateHostExists(host=host, Oct 04 18:32:20.422320 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.AggregateHostExists: Aggregate 11 already has host n-h2-851028-13. Oct 04 18:32:20.422320 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:32:20.422320 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:20.427392 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:32:20.427392 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:20.427392 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:32:20.427392 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:32:20.427392 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:32:20.427392 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:32:20.427392 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:32:20.427392 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:32:20.427392 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:32:20.427392 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:32:20.427392 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 187, in _add_host Oct 04 18:32:20.427392 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Oct 04 18:32:20.427392 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate 11 already has host n-h2-851028-13. Oct 04 18:32:20.427392 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:32:20.427392 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:20.427392 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:32:20.427392 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:20.427392 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:32:20.427392 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:32:20.427392 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:32:20.427392 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:32:20.429982 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 11 already has host n-h2-851028-13. Oct 04 18:32:20.429982 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:32:20.431624 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-8d0dc68a-7268-4dd2-bf04-b77e442bc4d8 tempest-AggregatesAdminNegativeTestJSON-635194796 tempest-AggregatesAdminNegativeTestJSON-635194796-project-admin] Returning 409 to user: Aggregate 11 already has host n-h2-851028-13. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:32:20.433900 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-8d0dc68a-7268-4dd2-bf04-b77e442bc4d8 tempest-AggregatesAdminNegativeTestJSON-635194796 tempest-AggregatesAdminNegativeTestJSON-635194796-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates/11/action" status: 409 len: 97 microversion: 2.1 time: 0.160610 Oct 04 18:32:20.438882 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 175/337] 10.222.0.43 () {60 vars in 1194 bytes} [Tue Oct 4 18:32:20 2022] POST /compute/v2.1/os-aggregates/11/action => generated 97 bytes in 166 msecs (HTTP/1.1 409) 9 headers in 377 bytes (1 switches on core 0) Oct 04 18:32:20.448256 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-e5d33441-fdd4-468e-a5be-9dc5208045ed tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:20.449218 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-e5d33441-fdd4-468e-a5be-9dc5208045ed tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] [instance: 606aebcb-2b6a-469f-a578-91325770ab4b] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:20.455316 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-585df961-0a53-41a9-a57b-dcf1f9f73e29 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:20.461332 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-585df961-0a53-41a9-a57b-dcf1f9f73e29 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:20.462992 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-585df961-0a53-41a9-a57b-dcf1f9f73e29 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:20.464603 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.objects.instance [None req-585df961-0a53-41a9-a57b-dcf1f9f73e29 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lazy-loading 'fault' on Instance uuid b249a7cd-d1ee-4a74-a93d-9991ba84785f {{(pid=123595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:32:20.465579 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e5d33441-fdd4-468e-a5be-9dc5208045ed tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:20.466074 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e5d33441-fdd4-468e-a5be-9dc5208045ed tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:20.467833 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e5d33441-fdd4-468e-a5be-9dc5208045ed tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:20.468770 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e5d33441-fdd4-468e-a5be-9dc5208045ed tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:20.469286 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e5d33441-fdd4-468e-a5be-9dc5208045ed tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:20.471528 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e5d33441-fdd4-468e-a5be-9dc5208045ed tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:20.586130 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-e5d33441-fdd4-468e-a5be-9dc5208045ed tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f207a188e3fa4987b9fe4dd773ad03b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c636de1e6b42868f1f58e46fd4a3f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:20.596293 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-e5d33441-fdd4-468e-a5be-9dc5208045ed tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] 10.222.0.43 "GET /compute/v2.1/servers/606aebcb-2b6a-469f-a578-91325770ab4b" status: 200 len: 1290 microversion: 2.1 time: 0.155835 Oct 04 18:32:20.597135 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 176/338] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:20 2022] GET /compute/v2.1/servers/606aebcb-2b6a-469f-a578-91325770ab4b => generated 1290 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:20.602469 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-a4d2a335-6468-474c-83f1-adebf99ca32a tempest-AggregatesAdminNegativeTestJSON-635194796 tempest-AggregatesAdminNegativeTestJSON-635194796-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-851028-13"}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:20.616360 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a4d2a335-6468-474c-83f1-adebf99ca32a tempest-AggregatesAdminNegativeTestJSON-635194796 tempest-AggregatesAdminNegativeTestJSON-635194796-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:20.617297 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a4d2a335-6468-474c-83f1-adebf99ca32a tempest-AggregatesAdminNegativeTestJSON-635194796 tempest-AggregatesAdminNegativeTestJSON-635194796-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:20.617947 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a4d2a335-6468-474c-83f1-adebf99ca32a tempest-AggregatesAdminNegativeTestJSON-635194796 tempest-AggregatesAdminNegativeTestJSON-635194796-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:20.791788 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-585df961-0a53-41a9-a57b-dcf1f9f73e29 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '459e65f14af049bba311453d6a86360b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1753b9ee9a644e409a1efd0c9e7c152c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:20.800536 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-585df961-0a53-41a9-a57b-dcf1f9f73e29 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] 10.222.0.43 "GET /compute/v2.1/servers/b249a7cd-d1ee-4a74-a93d-9991ba84785f" status: 200 len: 1451 microversion: 2.1 time: 0.497740 Oct 04 18:32:20.802666 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 163/339] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:20 2022] GET /compute/v2.1/servers/b249a7cd-d1ee-4a74-a93d-9991ba84785f => generated 1451 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:20.808505 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-16e78bea-cdba-4d80-b098-b955f570569d tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1643783290", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "acf92c64-4619-49b4-9c95-f8a5a9086ea1"}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:20.847134 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-a4d2a335-6468-474c-83f1-adebf99ca32a tempest-AggregatesAdminNegativeTestJSON-635194796 tempest-AggregatesAdminNegativeTestJSON-635194796-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 228 microversion: 2.1 time: 0.248359 Oct 04 18:32:20.848665 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 177/340] 10.222.0.43 () {60 vars in 1194 bytes} [Tue Oct 4 18:32:20 2022] POST /compute/v2.1/os-aggregates/11/action => generated 228 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:32:20.893904 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.network.neutron [None req-16e78bea-cdba-4d80-b098-b955f570569d tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] validate_networks() for None {{(pid=123595) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:32:21.211407 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-16e78bea-cdba-4d80-b098-b955f570569d tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Flavor limits 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:32:21.212150 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-16e78bea-cdba-4d80-b098-b955f570569d tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Image limits 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:32:21.212281 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-16e78bea-cdba-4d80-b098-b955f570569d tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Flavor pref 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:32:21.212911 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-16e78bea-cdba-4d80-b098-b955f570569d tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Image pref 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:32:21.213611 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-16e78bea-cdba-4d80-b098-b955f570569d tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:32:21.231359 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-16e78bea-cdba-4d80-b098-b955f570569d tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:21.232252 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-16e78bea-cdba-4d80-b098-b955f570569d tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:21.232869 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-16e78bea-cdba-4d80-b098-b955f570569d tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:21.233822 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-16e78bea-cdba-4d80-b098-b955f570569d tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:21.234893 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-16e78bea-cdba-4d80-b098-b955f570569d tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:21.235515 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-16e78bea-cdba-4d80-b098-b955f570569d tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:21.261970 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-16e78bea-cdba-4d80-b098-b955f570569d tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Getting quotas for project e7adedcdb9c3485ea2738c00e25aa3fd. Resources: {'ram', 'cores', 'instances'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:32:21.268362 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-16e78bea-cdba-4d80-b098-b955f570569d tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Getting quotas for user a7db99f361654711bea7f1b2c404d312 and project e7adedcdb9c3485ea2738c00e25aa3fd. Resources: {'ram', 'cores', 'instances'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:32:21.274709 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-8b466887-15bc-45b2-909a-65b3ed14b060 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-562529276", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452"}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:21.283766 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-16e78bea-cdba-4d80-b098-b955f570569d tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Going to run 2 instances... {{(pid=123595) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:32:21.287491 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-16e78bea-cdba-4d80-b098-b955f570569d tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] [instance: 6251d93c-aab7-43cc-9be0-212545cf2b01] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e8943ec5-4038-4d4b-b9b9-2415a79f5243',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:32:21.360554 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.network.neutron [None req-8b466887-15bc-45b2-909a-65b3ed14b060 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] validate_networks() for None {{(pid=123596) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:32:21.363100 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-16e78bea-cdba-4d80-b098-b955f570569d tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Getting quotas for project e7adedcdb9c3485ea2738c00e25aa3fd. Resources: {'server_group_members'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:32:21.371945 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-16e78bea-cdba-4d80-b098-b955f570569d tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Getting quotas for user a7db99f361654711bea7f1b2c404d312 and project e7adedcdb9c3485ea2738c00e25aa3fd. Resources: {'server_group_members'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:32:21.428234 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-16e78bea-cdba-4d80-b098-b955f570569d tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Getting quotas for project e7adedcdb9c3485ea2738c00e25aa3fd. Resources: {'server_group_members'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:32:21.435744 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-16e78bea-cdba-4d80-b098-b955f570569d tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Getting quotas for user a7db99f361654711bea7f1b2c404d312 and project e7adedcdb9c3485ea2738c00e25aa3fd. Resources: {'server_group_members'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:32:21.479067 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-16e78bea-cdba-4d80-b098-b955f570569d tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] [instance: 640d917c-c9cb-4758-aa1d-216e34a55297] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e8943ec5-4038-4d4b-b9b9-2415a79f5243',instance=,instance_uuid=6251d93c-aab7-43cc-9be0-212545cf2b01,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:32:21.571539 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-16e78bea-cdba-4d80-b098-b955f570569d tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Getting quotas for project e7adedcdb9c3485ea2738c00e25aa3fd. Resources: {'server_group_members'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:32:21.578037 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-16e78bea-cdba-4d80-b098-b955f570569d tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Getting quotas for user a7db99f361654711bea7f1b2c404d312 and project e7adedcdb9c3485ea2738c00e25aa3fd. Resources: {'server_group_members'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:32:21.646221 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-16e78bea-cdba-4d80-b098-b955f570569d tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Getting quotas for project e7adedcdb9c3485ea2738c00e25aa3fd. Resources: {'server_group_members'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:32:21.658655 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-16e78bea-cdba-4d80-b098-b955f570569d tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Getting quotas for user a7db99f361654711bea7f1b2c404d312 and project e7adedcdb9c3485ea2738c00e25aa3fd. Resources: {'server_group_members'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:32:21.670829 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=11 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:32:21.719426 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-16e78bea-cdba-4d80-b098-b955f570569d tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 0.915287 Oct 04 18:32:21.721047 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 164/341] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 18:32:20 2022] POST /compute/v2.1/servers => generated 32 bytes in 917 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Oct 04 18:32:21.721234 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-8b466887-15bc-45b2-909a-65b3ed14b060 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Flavor limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:32:21.721840 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-8b466887-15bc-45b2-909a-65b3ed14b060 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Image limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:32:21.722329 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-8b466887-15bc-45b2-909a-65b3ed14b060 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Flavor pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:32:21.722740 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-8b466887-15bc-45b2-909a-65b3ed14b060 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Image pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:32:21.723153 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-8b466887-15bc-45b2-909a-65b3ed14b060 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:32:21.726245 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=8,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:32:21.735446 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-5fa56461-33fd-4059-8f70-982cde0c178b tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:21.736313 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-5fa56461-33fd-4059-8f70-982cde0c178b tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] [instance: b249a7cd-d1ee-4a74-a93d-9991ba84785f] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:21.756720 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8b466887-15bc-45b2-909a-65b3ed14b060 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:21.757429 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8b466887-15bc-45b2-909a-65b3ed14b060 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:21.757879 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8b466887-15bc-45b2-909a-65b3ed14b060 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:21.758639 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8b466887-15bc-45b2-909a-65b3ed14b060 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:21.760632 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5fa56461-33fd-4059-8f70-982cde0c178b tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:21.761404 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5fa56461-33fd-4059-8f70-982cde0c178b tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:21.762127 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8b466887-15bc-45b2-909a-65b3ed14b060 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:21.763046 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5fa56461-33fd-4059-8f70-982cde0c178b tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:21.764836 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8b466887-15bc-45b2-909a-65b3ed14b060 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:21.766380 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5fa56461-33fd-4059-8f70-982cde0c178b tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:21.769315 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5fa56461-33fd-4059-8f70-982cde0c178b tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:21.769801 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5fa56461-33fd-4059-8f70-982cde0c178b tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:21.800133 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-8b466887-15bc-45b2-909a-65b3ed14b060 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Getting quotas for project 94ae6e2cb75d410d8029aa49909c973b. Resources: {'ram', 'cores', 'instances'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:32:21.808058 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-8b466887-15bc-45b2-909a-65b3ed14b060 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Getting quotas for user cdb7b0ce49ec438f9a60b79bdb2ac164 and project 94ae6e2cb75d410d8029aa49909c973b. Resources: {'ram', 'cores', 'instances'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:32:21.821901 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-8b466887-15bc-45b2-909a-65b3ed14b060 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Going to run 1 instances... {{(pid=123596) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:32:21.824151 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-5fa56461-33fd-4059-8f70-982cde0c178b tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] [instance: b249a7cd-d1ee-4a74-a93d-9991ba84785f] Going to try to terminate instance {{(pid=123595) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:32:21.824899 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-8b466887-15bc-45b2-909a-65b3ed14b060 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] [instance: 918d6106-9c7c-4046-9cdd-319afe4cdb25] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e8943ec5-4038-4d4b-b9b9-2415a79f5243',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123596) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:32:21.923763 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-8b466887-15bc-45b2-909a-65b3ed14b060 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.073715 Oct 04 18:32:21.933323 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 178/342] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 18:32:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 1084 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:32:21.948333 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-e7063c05-53e6-414f-b0ab-fc157c37e6e2 tempest-AggregatesAdminNegativeTestJSON-635194796 tempest-AggregatesAdminNegativeTestJSON-635194796-project-admin] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:21.979952 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-e7063c05-53e6-414f-b0ab-fc157c37e6e2 tempest-AggregatesAdminNegativeTestJSON-635194796 tempest-AggregatesAdminNegativeTestJSON-635194796-project-admin] 10.222.0.43 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.044698 Oct 04 18:32:21.987376 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 179/343] 10.222.0.43 () {58 vars in 1155 bytes} [Tue Oct 4 18:32:21 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 18:32:21.995127 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-69c78818-5152-4fe4-a27c-e6c3f522356a tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:21.996172 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-69c78818-5152-4fe4-a27c-e6c3f522356a tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] [instance: 606aebcb-2b6a-469f-a578-91325770ab4b] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:21.999167 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-5fa56461-33fd-4059-8f70-982cde0c178b tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] 10.222.0.43 "DELETE /compute/v2.1/servers/b249a7cd-d1ee-4a74-a93d-9991ba84785f" status: 204 len: 0 microversion: 2.1 time: 0.274589 Oct 04 18:32:22.003816 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 165/344] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 18:32:21 2022] DELETE /compute/v2.1/servers/b249a7cd-d1ee-4a74-a93d-9991ba84785f => generated 0 bytes in 278 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:32:22.004587 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-69c78818-5152-4fe4-a27c-e6c3f522356a tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:22.005160 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-69c78818-5152-4fe4-a27c-e6c3f522356a tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:22.005776 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-69c78818-5152-4fe4-a27c-e6c3f522356a tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:22.006687 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-69c78818-5152-4fe4-a27c-e6c3f522356a tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:22.007505 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-69c78818-5152-4fe4-a27c-e6c3f522356a tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:22.008093 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-69c78818-5152-4fe4-a27c-e6c3f522356a tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:22.012792 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-09adaf87-4132-4d37-99f2-e956526defc2 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:22.018242 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-09adaf87-4132-4d37-99f2-e956526defc2 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a7db99f361654711bea7f1b2c404d312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7adedcdb9c3485ea2738c00e25aa3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:22.019063 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-09adaf87-4132-4d37-99f2-e956526defc2 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Searching by: {'deleted': False, 'project_id': 'e7adedcdb9c3485ea2738c00e25aa3fd'} {{(pid=123595) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:32:22.040274 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-09adaf87-4132-4d37-99f2-e956526defc2 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:22.040835 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-09adaf87-4132-4d37-99f2-e956526defc2 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:22.054164 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-09adaf87-4132-4d37-99f2-e956526defc2 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:22.054164 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-09adaf87-4132-4d37-99f2-e956526defc2 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:22.054164 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-09adaf87-4132-4d37-99f2-e956526defc2 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:22.054164 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-09adaf87-4132-4d37-99f2-e956526defc2 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:22.081960 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=30 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:32:22.106197 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:32:22.112362 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.multi_cell_list [None req-09adaf87-4132-4d37-99f2-e956526defc2 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=123595) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 18:32:22.170565 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-09adaf87-4132-4d37-99f2-e956526defc2 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] 10.222.0.43 "GET /compute/v2.1/servers" status: 200 len: 1666 microversion: 2.1 time: 0.162272 Oct 04 18:32:22.171787 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 166/345] 10.222.0.43 () {58 vars in 1125 bytes} [Tue Oct 4 18:32:22 2022] GET /compute/v2.1/servers => generated 1666 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:22.183872 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-88fb577d-6e96-4994-a27b-331e038e487d tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:22.187526 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-88fb577d-6e96-4994-a27b-331e038e487d tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] [instance: 918d6106-9c7c-4046-9cdd-319afe4cdb25] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:22.300350 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-69c78818-5152-4fe4-a27c-e6c3f522356a tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f207a188e3fa4987b9fe4dd773ad03b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c636de1e6b42868f1f58e46fd4a3f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:22.313967 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-69c78818-5152-4fe4-a27c-e6c3f522356a tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] 10.222.0.43 "GET /compute/v2.1/servers/606aebcb-2b6a-469f-a578-91325770ab4b" status: 200 len: 1332 microversion: 2.1 time: 0.325171 Oct 04 18:32:22.326151 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 180/346] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:21 2022] GET /compute/v2.1/servers/606aebcb-2b6a-469f-a578-91325770ab4b => generated 1332 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:22.326151 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-3e751954-8669-4737-866c-852df1c63d97 tempest-AggregatesAdminNegativeTestJSON-635194796 tempest-AggregatesAdminNegativeTestJSON-635194796-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1784730063"}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:22.326151 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.objects.aggregate [None req-3e751954-8669-4737-866c-852df1c63d97 tempest-AggregatesAdminNegativeTestJSON-635194796 tempest-AggregatesAdminNegativeTestJSON-635194796-project-admin] Generated uuid 9970df73-9044-4005-8923-c7b408f29959 for aggregate {{(pid=123596) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 18:32:22.358089 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-88fb577d-6e96-4994-a27b-331e038e487d tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb7b0ce49ec438f9a60b79bdb2ac164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94ae6e2cb75d410d8029aa49909c973b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:22.368150 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-88fb577d-6e96-4994-a27b-331e038e487d tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] 10.222.0.43 "GET /compute/v2.1/servers/918d6106-9c7c-4046-9cdd-319afe4cdb25" status: 200 len: 1221 microversion: 2.1 time: 0.194566 Oct 04 18:32:22.372620 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 167/347] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:22 2022] GET /compute/v2.1/servers/918d6106-9c7c-4046-9cdd-319afe4cdb25 => generated 1221 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:22.380404 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-10942fd7-0621-47e3-9281-0fd2254b7689 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:22.382493 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-10942fd7-0621-47e3-9281-0fd2254b7689 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] [instance: b249a7cd-d1ee-4a74-a93d-9991ba84785f] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:22.398617 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-10942fd7-0621-47e3-9281-0fd2254b7689 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:22.400002 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-10942fd7-0621-47e3-9281-0fd2254b7689 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:22.401213 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-10942fd7-0621-47e3-9281-0fd2254b7689 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:22.402600 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-10942fd7-0621-47e3-9281-0fd2254b7689 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:22.403310 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-10942fd7-0621-47e3-9281-0fd2254b7689 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:22.405018 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-3e751954-8669-4737-866c-852df1c63d97 tempest-AggregatesAdminNegativeTestJSON-635194796 tempest-AggregatesAdminNegativeTestJSON-635194796-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.089398 Oct 04 18:32:22.405676 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 181/348] 10.222.0.43 () {60 vars in 1164 bytes} [Tue Oct 4 18:32:22 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:32:22.406201 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-10942fd7-0621-47e3-9281-0fd2254b7689 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:22.419196 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-e5c3dca0-3f50-4b59-a40a-f2893e9a58f7 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:22.419871 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-e5c3dca0-3f50-4b59-a40a-f2893e9a58f7 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] [instance: 640d917c-c9cb-4758-aa1d-216e34a55297] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:22.466773 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-10942fd7-0621-47e3-9281-0fd2254b7689 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:22.469358 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-10942fd7-0621-47e3-9281-0fd2254b7689 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:22.470653 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-10942fd7-0621-47e3-9281-0fd2254b7689 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:22.475185 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.objects.instance [None req-10942fd7-0621-47e3-9281-0fd2254b7689 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lazy-loading 'fault' on Instance uuid b249a7cd-d1ee-4a74-a93d-9991ba84785f {{(pid=123595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:32:22.574202 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-e5c3dca0-3f50-4b59-a40a-f2893e9a58f7 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7db99f361654711bea7f1b2c404d312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7adedcdb9c3485ea2738c00e25aa3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:22.586268 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-e5c3dca0-3f50-4b59-a40a-f2893e9a58f7 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] 10.222.0.43 "GET /compute/v2.1/servers/640d917c-c9cb-4758-aa1d-216e34a55297" status: 200 len: 1219 microversion: 2.1 time: 0.178136 Oct 04 18:32:22.588685 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 182/349] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:22 2022] GET /compute/v2.1/servers/640d917c-c9cb-4758-aa1d-216e34a55297 => generated 1219 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:22.743198 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-10942fd7-0621-47e3-9281-0fd2254b7689 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '459e65f14af049bba311453d6a86360b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1753b9ee9a644e409a1efd0c9e7c152c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:22.757700 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-10942fd7-0621-47e3-9281-0fd2254b7689 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] 10.222.0.43 "GET /compute/v2.1/servers/b249a7cd-d1ee-4a74-a93d-9991ba84785f" status: 200 len: 1457 microversion: 2.1 time: 0.380978 Oct 04 18:32:22.773836 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 168/350] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:22 2022] GET /compute/v2.1/servers/b249a7cd-d1ee-4a74-a93d-9991ba84785f => generated 1457 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:22.784477 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-f23d9683-0fd8-4bc2-95be-4da5f5028d5d req-5a8ca32c-7289-43d8-a0f9-ce81705f93e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "606aebcb-2b6a-469f-a578-91325770ab4b", "tag": "101c6584-c112-496c-8a18-4440b7f3aec5"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:22.802084 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-f23d9683-0fd8-4bc2-95be-4da5f5028d5d req-5a8ca32c-7289-43d8-a0f9-ce81705f93e1 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:22.802569 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-f23d9683-0fd8-4bc2-95be-4da5f5028d5d req-5a8ca32c-7289-43d8-a0f9-ce81705f93e1 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:22.803146 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-f23d9683-0fd8-4bc2-95be-4da5f5028d5d req-5a8ca32c-7289-43d8-a0f9-ce81705f93e1 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:22.819092 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-f23d9683-0fd8-4bc2-95be-4da5f5028d5d req-5a8ca32c-7289-43d8-a0f9-ce81705f93e1 service nova] Creating event network-changed:101c6584-c112-496c-8a18-4440b7f3aec5 for instance 606aebcb-2b6a-469f-a578-91325770ab4b on n-h2-851028-13 Oct 04 18:32:22.824745 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-f23d9683-0fd8-4bc2-95be-4da5f5028d5d req-5a8ca32c-7289-43d8-a0f9-ce81705f93e1 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049030 Oct 04 18:32:22.825726 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 169/351] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:32:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:32:22.925704 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-b5897481-1d38-4ced-941a-d29c1a906df9 tempest-AggregatesAdminNegativeTestJSON-1288969004 tempest-AggregatesAdminNegativeTestJSON-1288969004-project] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-851028-13"}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:22.929908 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-b5897481-1d38-4ced-941a-d29c1a906df9 tempest-AggregatesAdminNegativeTestJSON-1288969004 tempest-AggregatesAdminNegativeTestJSON-1288969004-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': '62a3cb8bb32a4bdbb7c360370697d9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7694a80f5cd2481faf6ea92be8c51e4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:22.931862 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-b5897481-1d38-4ced-941a-d29c1a906df9 tempest-AggregatesAdminNegativeTestJSON-1288969004 tempest-AggregatesAdminNegativeTestJSON-1288969004-project] Request method failure captured: Oct 04 18:32:22.931862 n-d-851028-13 devstack@n-api.service[123596]: request: POST /compute/v2.1/os-aggregates/12/action HTTP/1.1 Oct 04 18:32:22.931862 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:32:22.931862 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:32:22.931862 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:32:22.931862 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 40 Oct 04 18:32:22.931862 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:32:22.931862 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:32:22.931862 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:32:22.931862 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:32:22.931862 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPHwwTyasFQdt0vSEiEifUlslxjrZQ5PpmAkaNDtIaW6JSJ_RVvCGQ8OdcOL24jbtv1AQnsjbKUNM_cuE3vPfnO5AYOEw2ZVD2lUG9KEQkiMiTQcZawMlO8cY6tzInnxY2jn7BFfJz4XVX85WNo3zdgQVI4Anp61lrKQ81_BJ0QNh_WA Oct 04 18:32:22.931862 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:32:22.931862 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:32:22.931862 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:32:22.931862 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:32:22.931862 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:32:22.931862 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:32:22.931862 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: 7694a80f5cd2481faf6ea92be8c51e4d Oct 04 18:32:22.931862 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1288969004 Oct 04 18:32:22.931862 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 18:32:22.931862 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 18:32:22.933311 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/7694a80f5cd2481faf6ea92be8c51e4d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_7694a80f5cd2481faf6ea92be8c51e4d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/7694a80f5cd2481faf6ea92be8c51e4d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/7694a80f5cd2481faf6ea92be8c51e4d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:32:22.933311 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1288969004 Oct 04 18:32:22.933311 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: 7694a80f5cd2481faf6ea92be8c51e4d Oct 04 18:32:22.933311 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1288969004 Oct 04 18:32:22.933311 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-AggregatesAdminNegativeTestJSON-1288969004-project Oct 04 18:32:22.933311 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:32:22.933311 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:32:22.933311 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 62a3cb8bb32a4bdbb7c360370697d9e0 Oct 04 18:32:22.933311 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1288969004-project Oct 04 18:32:22.933311 n-d-851028-13 devstack@n-api.service[123596]: Oct 04 18:32:22.933311 n-d-851028-13 devstack@n-api.service[123596]: {"add_host": {"host": "n-h2-851028-13"}} Oct 04 18:32:22.933311 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 18:32:22.933311 n-d-851028-13 devstack@n-api.service[123596]: exception: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 04 18:32:22.934196 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': '12', 'body': {'add_host': {'host': 'n-h2-851028-13'}}} Oct 04 18:32:22.934196 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:32:22.934196 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:22.934196 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:32:22.934196 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:32:22.934196 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:32:22.934196 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:32:22.934196 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:32:22.934196 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:32:22.934196 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:32:22.934196 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:32:22.934196 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 172, in _add_host Oct 04 18:32:22.934196 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'add_host', target={}) Oct 04 18:32:22.934196 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 18:32:22.934196 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 18:32:22.934196 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 18:32:22.934196 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 18:32:22.934196 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:32:22.934196 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:32:22.935420 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:32:22.935420 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:32:22.935420 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 18:32:22.935420 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 18:32:22.935420 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 18:32:22.935420 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 18:32:22.935420 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 18:32:22.935420 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 18:32:22.935420 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 04 18:32:22.935420 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:32:22.935420 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:22.935420 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:32:22.935420 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:22.935420 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:32:22.935420 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:32:22.935420 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 18:32:22.935420 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 18:32:22.935420 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 04 18:32:22.935420 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:32:22.937726 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-b5897481-1d38-4ced-941a-d29c1a906df9 tempest-AggregatesAdminNegativeTestJSON-1288969004 tempest-AggregatesAdminNegativeTestJSON-1288969004-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:32:22.939104 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-b5897481-1d38-4ced-941a-d29c1a906df9 tempest-AggregatesAdminNegativeTestJSON-1288969004 tempest-AggregatesAdminNegativeTestJSON-1288969004-project] 10.222.0.43 "POST /compute/v2.1/os-aggregates/12/action" status: 403 len: 118 microversion: 2.1 time: 0.349000 Oct 04 18:32:22.940186 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 183/352] 10.222.0.43 () {60 vars in 1194 bytes} [Tue Oct 4 18:32:22 2022] POST /compute/v2.1/os-aggregates/12/action => generated 118 bytes in 350 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:32:22.948576 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-f2c13ce3-4a2e-4fce-87c0-f1e3596e5575 tempest-AggregatesAdminNegativeTestJSON-635194796 tempest-AggregatesAdminNegativeTestJSON-635194796-project-admin] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:22.985414 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-f2c13ce3-4a2e-4fce-87c0-f1e3596e5575 tempest-AggregatesAdminNegativeTestJSON-635194796 tempest-AggregatesAdminNegativeTestJSON-635194796-project-admin] 10.222.0.43 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.040689 Oct 04 18:32:22.988497 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 170/353] 10.222.0.43 () {58 vars in 1155 bytes} [Tue Oct 4 18:32:22 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 18:32:23.000890 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-3fa81a08-4876-4557-b90b-39e8693ea55e tempest-AggregatesAdminNegativeTestJSON-635194796 tempest-AggregatesAdminNegativeTestJSON-635194796-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1002178630"}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:23.007759 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.objects.aggregate [None req-3fa81a08-4876-4557-b90b-39e8693ea55e tempest-AggregatesAdminNegativeTestJSON-635194796 tempest-AggregatesAdminNegativeTestJSON-635194796-project-admin] Generated uuid d7f6cf86-7528-4549-abf5-863e80aec07a for aggregate {{(pid=123596) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 18:32:23.040467 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-3fa81a08-4876-4557-b90b-39e8693ea55e tempest-AggregatesAdminNegativeTestJSON-635194796 tempest-AggregatesAdminNegativeTestJSON-635194796-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.045759 Oct 04 18:32:23.042843 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 184/354] 10.222.0.43 () {60 vars in 1164 bytes} [Tue Oct 4 18:32:22 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:32:23.063080 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-85995b4d-590d-4955-a350-f8e75ad11d05 tempest-AggregatesAdminNegativeTestJSON-635194796 tempest-AggregatesAdminNegativeTestJSON-635194796-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-806497240"}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:23.080549 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-85995b4d-590d-4955-a350-f8e75ad11d05 tempest-AggregatesAdminNegativeTestJSON-635194796 tempest-AggregatesAdminNegativeTestJSON-635194796-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:23.082007 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-85995b4d-590d-4955-a350-f8e75ad11d05 tempest-AggregatesAdminNegativeTestJSON-635194796 tempest-AggregatesAdminNegativeTestJSON-635194796-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:23.082749 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-85995b4d-590d-4955-a350-f8e75ad11d05 tempest-AggregatesAdminNegativeTestJSON-635194796 tempest-AggregatesAdminNegativeTestJSON-635194796-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:23.091756 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-85995b4d-590d-4955-a350-f8e75ad11d05 tempest-AggregatesAdminNegativeTestJSON-635194796 tempest-AggregatesAdminNegativeTestJSON-635194796-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:23.092519 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-85995b4d-590d-4955-a350-f8e75ad11d05 tempest-AggregatesAdminNegativeTestJSON-635194796 tempest-AggregatesAdminNegativeTestJSON-635194796-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:23.092982 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-85995b4d-590d-4955-a350-f8e75ad11d05 tempest-AggregatesAdminNegativeTestJSON-635194796 tempest-AggregatesAdminNegativeTestJSON-635194796-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:23.101218 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-85995b4d-590d-4955-a350-f8e75ad11d05 tempest-AggregatesAdminNegativeTestJSON-635194796 tempest-AggregatesAdminNegativeTestJSON-635194796-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-806497240 could not be found. Oct 04 18:32:23.104604 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-85995b4d-590d-4955-a350-f8e75ad11d05 tempest-AggregatesAdminNegativeTestJSON-635194796 tempest-AggregatesAdminNegativeTestJSON-635194796-project-admin] Request method failure captured: Oct 04 18:32:23.104604 n-d-851028-13 devstack@n-api.service[123595]: request: POST /compute/v2.1/os-aggregates/13/action HTTP/1.1 Oct 04 18:32:23.104604 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 18:32:23.104604 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 18:32:23.104604 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 18:32:23.104604 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 57 Oct 04 18:32:23.104604 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 18:32:23.104604 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 18:32:23.104604 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 18:32:23.104604 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 18:32:23.104604 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPHwyghqUch5OFDRJqqz8nEa33TeaPKuolXJF37XvIGGrBUnil9VLtRpwr8tXHQYd2YuLtGPymX_aVheJCMCI_4tGi1FGxwVHH3MQL3S2iFZNTSl0_Ki7FTyAAgkh9v_i1p_BuHy4MxeG0E3GwhW0NOSWqt9BhtXq7d-PfJXr9XH-CkQ Oct 04 18:32:23.104604 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 18:32:23.104604 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 18:32:23.104604 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 18:32:23.104604 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 18:32:23.104604 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 18:32:23.104604 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 18:32:23.104604 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: bce7a697f1cb43c2b64ff85b7add03b4 Oct 04 18:32:23.104604 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-635194796 Oct 04 18:32:23.104604 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,admin,reader Oct 04 18:32:23.104604 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,admin,reader Oct 04 18:32:23.106210 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/bce7a697f1cb43c2b64ff85b7add03b4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_bce7a697f1cb43c2b64ff85b7add03b4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/bce7a697f1cb43c2b64ff85b7add03b4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/bce7a697f1cb43c2b64ff85b7add03b4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:32:23.106210 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-635194796 Oct 04 18:32:23.106210 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: bce7a697f1cb43c2b64ff85b7add03b4 Oct 04 18:32:23.106210 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-635194796 Oct 04 18:32:23.106210 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-AggregatesAdminNegativeTestJSON-635194796-project-admin Oct 04 18:32:23.106210 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 18:32:23.106210 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 18:32:23.106210 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: fb2baff63b274646ac21f934327e4294 Oct 04 18:32:23.106210 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-635194796-project-admin Oct 04 18:32:23.106210 n-d-851028-13 devstack@n-api.service[123595]: Oct 04 18:32:23.106210 n-d-851028-13 devstack@n-api.service[123595]: {"add_host": {"host": "tempest-nonexist_host-806497240"}} Oct 04 18:32:23.106210 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 18:32:23.106210 n-d-851028-13 devstack@n-api.service[123595]: exception: Compute host tempest-nonexist_host-806497240 could not be found. Oct 04 18:32:23.110335 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': '13', 'body': {'add_host': {'host': 'tempest-nonexist_host-806497240'}}} Oct 04 18:32:23.110335 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:32:23.110335 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:23.110335 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5999, in _get_service_in_cell_by_host Oct 04 18:32:23.110335 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 04 18:32:23.110335 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 18:32:23.110335 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 18:32:23.110335 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 04 18:32:23.110335 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 04 18:32:23.110335 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 18:32:23.110335 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 18:32:23.110335 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 04 18:32:23.110335 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 04 18:32:23.110335 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'tempest-nonexist_host-806497240' is not mapped to any cell Oct 04 18:32:23.110335 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:32:23.110335 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:23.110335 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:32:23.110335 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:23.110335 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Oct 04 18:32:23.114938 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Oct 04 18:32:23.114938 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 04 18:32:23.114938 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 04 18:32:23.114938 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 04 18:32:23.114938 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:32:23.114938 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:23.114938 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:32:23.114938 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:23.114938 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Oct 04 18:32:23.114938 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Oct 04 18:32:23.114938 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 04 18:32:23.114938 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 04 18:32:23.114938 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:32:23.114938 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:32:23.114938 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:32:23.114938 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:32:23.114938 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 04 18:32:23.114938 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 04 18:32:23.114938 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6621, in add_host_to_aggregate Oct 04 18:32:23.114938 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi service = _get_service_in_cell_by_host(context, host_name) Oct 04 18:32:23.116459 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6007, in _get_service_in_cell_by_host Oct 04 18:32:23.116459 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Oct 04 18:32:23.116459 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-nonexist_host-806497240 could not be found. Oct 04 18:32:23.116459 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:32:23.116459 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:23.116459 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:32:23.116459 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:23.116459 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:32:23.116459 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:32:23.116459 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:32:23.116459 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:32:23.116459 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:32:23.116459 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:32:23.116459 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:32:23.116459 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:32:23.116459 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 184, in _add_host Oct 04 18:32:23.116459 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:32:23.116459 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Compute host tempest-nonexist_host-806497240 could not be found. Oct 04 18:32:23.116459 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:32:23.116459 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:23.116459 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:32:23.118011 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:23.118011 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:32:23.118011 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:32:23.118011 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:32:23.118011 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:32:23.118011 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-nonexist_host-806497240 could not be found. Oct 04 18:32:23.118011 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:32:23.118011 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-85995b4d-590d-4955-a350-f8e75ad11d05 tempest-AggregatesAdminNegativeTestJSON-635194796 tempest-AggregatesAdminNegativeTestJSON-635194796-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-806497240 could not be found. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:32:23.118011 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-85995b4d-590d-4955-a350-f8e75ad11d05 tempest-AggregatesAdminNegativeTestJSON-635194796 tempest-AggregatesAdminNegativeTestJSON-635194796-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates/13/action" status: 404 len: 110 microversion: 2.1 time: 0.054590 Oct 04 18:32:23.118011 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 171/355] 10.222.0.43 () {60 vars in 1194 bytes} [Tue Oct 4 18:32:23 2022] POST /compute/v2.1/os-aggregates/13/action => generated 110 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:32:23.122713 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-7d07e226-e1ca-4839-a625-a772eb854080 tempest-AggregatesAdminNegativeTestJSON-635194796 tempest-AggregatesAdminNegativeTestJSON-635194796-project-admin] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:23.162806 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-7d07e226-e1ca-4839-a625-a772eb854080 tempest-AggregatesAdminNegativeTestJSON-635194796 tempest-AggregatesAdminNegativeTestJSON-635194796-project-admin] 10.222.0.43 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.050225 Oct 04 18:32:23.164249 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 185/356] 10.222.0.43 () {58 vars in 1155 bytes} [Tue Oct 4 18:32:23 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 18:32:23.175381 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-1fe639e6-4961-44e0-8f97-896a7267b791 tempest-AggregatesAdminNegativeTestJSON-635194796 tempest-AggregatesAdminNegativeTestJSON-635194796-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:23.180944 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-1fe639e6-4961-44e0-8f97-896a7267b791 tempest-AggregatesAdminNegativeTestJSON-635194796 tempest-AggregatesAdminNegativeTestJSON-635194796-project-admin] Request method failure captured: Oct 04 18:32:23.180944 n-d-851028-13 devstack@n-api.service[123595]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 04 18:32:23.180944 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 18:32:23.180944 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 18:32:23.180944 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 18:32:23.180944 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 283 Oct 04 18:32:23.180944 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 18:32:23.180944 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 18:32:23.180944 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 18:32:23.180944 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 18:32:23.180944 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPHwyghqUch5OFDRJqqz8nEa33TeaPKuolXJF37XvIGGrBUnil9VLtRpwr8tXHQYd2YuLtGPymX_aVheJCMCI_4tGi1FGxwVHH3MQL3S2iFZNTSl0_Ki7FTyAAgkh9v_i1p_BuHy4MxeG0E3GwhW0NOSWqt9BhtXq7d-PfJXr9XH-CkQ Oct 04 18:32:23.180944 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 18:32:23.180944 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 18:32:23.180944 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 18:32:23.180944 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 18:32:23.180944 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 18:32:23.180944 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 18:32:23.180944 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: bce7a697f1cb43c2b64ff85b7add03b4 Oct 04 18:32:23.180944 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-635194796 Oct 04 18:32:23.180944 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,admin,reader Oct 04 18:32:23.180944 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,admin,reader Oct 04 18:32:23.182555 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/bce7a697f1cb43c2b64ff85b7add03b4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_bce7a697f1cb43c2b64ff85b7add03b4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/bce7a697f1cb43c2b64ff85b7add03b4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/bce7a697f1cb43c2b64ff85b7add03b4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:32:23.182555 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-635194796 Oct 04 18:32:23.182555 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: bce7a697f1cb43c2b64ff85b7add03b4 Oct 04 18:32:23.182555 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-635194796 Oct 04 18:32:23.182555 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-AggregatesAdminNegativeTestJSON-635194796-project-admin Oct 04 18:32:23.182555 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 18:32:23.182555 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 18:32:23.182555 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: fb2baff63b274646ac21f934327e4294 Oct 04 18:32:23.182555 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-635194796-project-admin Oct 04 18:32:23.182555 n-d-851028-13 devstack@n-api.service[123595]: Oct 04 18:32:23.183338 n-d-851028-13 devstack@n-api.service[123595]: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 04 18:32:23.183338 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 18:32:23.183338 n-d-851028-13 devstack@n-api.service[123595]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 04 18:32:23.183338 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'body': {'aggregate': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 04 18:32:23.183338 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:32:23.183338 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:23.183338 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:32:23.183338 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:32:23.183338 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:32:23.183338 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:32:23.183921 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 04 18:32:23.183921 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:32:23.183921 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['aggregate']['properties']['name']: Oct 04 18:32:23.183921 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 04 18:32:23.183921 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:32:23.183921 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Oct 04 18:32:23.183921 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 04 18:32:23.183921 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:32:23.183921 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:23.183921 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:32:23.183921 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:23.183921 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:32:23.183921 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:32:23.183921 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:32:23.183921 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:32:23.183921 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:32:23.183921 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:32:23.184846 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:32:23.184846 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:32:23.184846 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 18:32:23.184846 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 18:32:23.184846 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:32:23.184846 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:32:23.184846 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:32:23.184846 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:32:23.184846 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 04 18:32:23.184846 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:32:23.184846 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:23.184846 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:32:23.184846 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:23.184846 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:32:23.184846 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:32:23.185700 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:32:23.185700 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:32:23.185700 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 04 18:32:23.185700 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:32:23.185700 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-1fe639e6-4961-44e0-8f97-896a7267b791 tempest-AggregatesAdminNegativeTestJSON-635194796 tempest-AggregatesAdminNegativeTestJSON-635194796-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:32:23.186115 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-1fe639e6-4961-44e0-8f97-896a7267b791 tempest-AggregatesAdminNegativeTestJSON-635194796 tempest-AggregatesAdminNegativeTestJSON-635194796-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.011388 Oct 04 18:32:23.186115 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 172/357] 10.222.0.43 () {60 vars in 1165 bytes} [Tue Oct 4 18:32:23 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:32:23.194693 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-3b3f5afb-2430-46df-87d2-811770a3cd65 tempest-AggregatesAdminNegativeTestJSON-635194796 tempest-AggregatesAdminNegativeTestJSON-635194796-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:23.200515 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-3b3f5afb-2430-46df-87d2-811770a3cd65 tempest-AggregatesAdminNegativeTestJSON-635194796 tempest-AggregatesAdminNegativeTestJSON-635194796-project-admin] Request method failure captured: Oct 04 18:32:23.200515 n-d-851028-13 devstack@n-api.service[123596]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 04 18:32:23.200515 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:32:23.200515 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:32:23.200515 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:32:23.200515 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 27 Oct 04 18:32:23.200515 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:32:23.200515 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:32:23.200515 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:32:23.200515 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:32:23.200515 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPHwyghqUch5OFDRJqqz8nEa33TeaPKuolXJF37XvIGGrBUnil9VLtRpwr8tXHQYd2YuLtGPymX_aVheJCMCI_4tGi1FGxwVHH3MQL3S2iFZNTSl0_Ki7FTyAAgkh9v_i1p_BuHy4MxeG0E3GwhW0NOSWqt9BhtXq7d-PfJXr9XH-CkQ Oct 04 18:32:23.200515 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:32:23.200515 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:32:23.200515 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:32:23.200515 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:32:23.200515 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:32:23.200515 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:32:23.200515 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: bce7a697f1cb43c2b64ff85b7add03b4 Oct 04 18:32:23.200515 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-635194796 Oct 04 18:32:23.200515 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,admin,reader Oct 04 18:32:23.200515 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,admin,reader Oct 04 18:32:23.202213 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/bce7a697f1cb43c2b64ff85b7add03b4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_bce7a697f1cb43c2b64ff85b7add03b4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/bce7a697f1cb43c2b64ff85b7add03b4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/bce7a697f1cb43c2b64ff85b7add03b4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:32:23.202213 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-635194796 Oct 04 18:32:23.202213 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: bce7a697f1cb43c2b64ff85b7add03b4 Oct 04 18:32:23.202213 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-635194796 Oct 04 18:32:23.202213 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-AggregatesAdminNegativeTestJSON-635194796-project-admin Oct 04 18:32:23.202213 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:32:23.202213 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:32:23.202213 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: fb2baff63b274646ac21f934327e4294 Oct 04 18:32:23.202213 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-635194796-project-admin Oct 04 18:32:23.202213 n-d-851028-13 devstack@n-api.service[123596]: Oct 04 18:32:23.202213 n-d-851028-13 devstack@n-api.service[123596]: {"aggregate": {"name": ""}} Oct 04 18:32:23.202213 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 18:32:23.202213 n-d-851028-13 devstack@n-api.service[123596]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 04 18:32:23.203103 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'body': {'aggregate': {'name': ''}}} Oct 04 18:32:23.203103 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:32:23.203103 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:23.203103 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:32:23.203103 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:32:23.203103 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:32:23.203103 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:32:23.203103 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 04 18:32:23.203103 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:32:23.203103 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['aggregate']['properties']['name']: Oct 04 18:32:23.203103 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 04 18:32:23.203103 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:32:23.203103 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Oct 04 18:32:23.203103 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi '' Oct 04 18:32:23.203103 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:32:23.203103 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:23.203103 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:32:23.203103 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:23.203103 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:32:23.203103 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:32:23.203103 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:32:23.203103 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:32:23.203103 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:32:23.204693 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:32:23.204693 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:32:23.204693 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:32:23.204693 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 18:32:23.204693 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 18:32:23.204693 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:32:23.204693 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:32:23.204693 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:32:23.204693 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:32:23.204693 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 04 18:32:23.204693 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:32:23.204693 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:23.204693 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:32:23.204693 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:23.204693 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:32:23.204693 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:32:23.204693 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:32:23.204693 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:32:23.204693 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 04 18:32:23.204693 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:32:23.206474 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-3b3f5afb-2430-46df-87d2-811770a3cd65 tempest-AggregatesAdminNegativeTestJSON-635194796 tempest-AggregatesAdminNegativeTestJSON-635194796-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:32:23.208694 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-3b3f5afb-2430-46df-87d2-811770a3cd65 tempest-AggregatesAdminNegativeTestJSON-635194796 tempest-AggregatesAdminNegativeTestJSON-635194796-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.017955 Oct 04 18:32:23.213648 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 186/358] 10.222.0.43 () {60 vars in 1164 bytes} [Tue Oct 4 18:32:23 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:32:23.222160 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-3fff2600-24d3-4c29-9fd7-3f88273cff08 tempest-AggregatesAdminNegativeTestJSON-1288969004 tempest-AggregatesAdminNegativeTestJSON-1288969004-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1293681105"}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:23.225893 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-3fff2600-24d3-4c29-9fd7-3f88273cff08 tempest-AggregatesAdminNegativeTestJSON-1288969004 tempest-AggregatesAdminNegativeTestJSON-1288969004-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': '62a3cb8bb32a4bdbb7c360370697d9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7694a80f5cd2481faf6ea92be8c51e4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:23.227721 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-3fff2600-24d3-4c29-9fd7-3f88273cff08 tempest-AggregatesAdminNegativeTestJSON-1288969004 tempest-AggregatesAdminNegativeTestJSON-1288969004-project] Request method failure captured: Oct 04 18:32:23.227721 n-d-851028-13 devstack@n-api.service[123595]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 04 18:32:23.227721 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 18:32:23.227721 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 18:32:23.227721 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 18:32:23.227721 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 60 Oct 04 18:32:23.227721 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 18:32:23.227721 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 18:32:23.227721 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 18:32:23.227721 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 18:32:23.227721 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPHwwTyasFQdt0vSEiEifUlslxjrZQ5PpmAkaNDtIaW6JSJ_RVvCGQ8OdcOL24jbtv1AQnsjbKUNM_cuE3vPfnO5AYOEw2ZVD2lUG9KEQkiMiTQcZawMlO8cY6tzInnxY2jn7BFfJz4XVX85WNo3zdgQVI4Anp61lrKQ81_BJ0QNh_WA Oct 04 18:32:23.227721 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 18:32:23.227721 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 18:32:23.227721 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 18:32:23.227721 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 18:32:23.227721 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 18:32:23.227721 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 18:32:23.227721 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: 7694a80f5cd2481faf6ea92be8c51e4d Oct 04 18:32:23.227721 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1288969004 Oct 04 18:32:23.227721 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 18:32:23.227721 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 18:32:23.229547 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/7694a80f5cd2481faf6ea92be8c51e4d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_7694a80f5cd2481faf6ea92be8c51e4d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/7694a80f5cd2481faf6ea92be8c51e4d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/7694a80f5cd2481faf6ea92be8c51e4d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:32:23.229547 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1288969004 Oct 04 18:32:23.229547 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: 7694a80f5cd2481faf6ea92be8c51e4d Oct 04 18:32:23.229547 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1288969004 Oct 04 18:32:23.229547 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-AggregatesAdminNegativeTestJSON-1288969004-project Oct 04 18:32:23.229547 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 18:32:23.229547 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 18:32:23.229547 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: 62a3cb8bb32a4bdbb7c360370697d9e0 Oct 04 18:32:23.229547 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1288969004-project Oct 04 18:32:23.229547 n-d-851028-13 devstack@n-api.service[123595]: Oct 04 18:32:23.229547 n-d-851028-13 devstack@n-api.service[123595]: {"aggregate": {"name": "tempest-test_aggregate-1293681105"}} Oct 04 18:32:23.229547 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 18:32:23.229547 n-d-851028-13 devstack@n-api.service[123595]: exception: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 04 18:32:23.230260 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-1293681105'}}} Oct 04 18:32:23.230260 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:32:23.230260 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:23.230260 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:32:23.230260 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:32:23.230260 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:32:23.230260 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:32:23.230260 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:32:23.230260 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:32:23.230260 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:32:23.230260 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:32:23.230260 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:32:23.230260 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:32:23.230260 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 70, in create Oct 04 18:32:23.230260 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'create', target={}) Oct 04 18:32:23.230260 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 18:32:23.230260 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 18:32:23.230260 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 18:32:23.230260 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 18:32:23.231484 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:32:23.231484 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:32:23.231484 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:32:23.231484 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:32:23.231484 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 18:32:23.231484 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 18:32:23.231484 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 18:32:23.231484 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 18:32:23.231484 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 18:32:23.231484 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 18:32:23.231484 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 04 18:32:23.231484 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:32:23.231484 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:23.231484 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:32:23.231484 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:23.231484 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:32:23.231484 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:32:23.231484 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 18:32:23.231484 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 18:32:23.231484 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 04 18:32:23.232534 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:32:23.234887 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-3fff2600-24d3-4c29-9fd7-3f88273cff08 tempest-AggregatesAdminNegativeTestJSON-1288969004 tempest-AggregatesAdminNegativeTestJSON-1288969004-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:32:23.235744 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-3fff2600-24d3-4c29-9fd7-3f88273cff08 tempest-AggregatesAdminNegativeTestJSON-1288969004 tempest-AggregatesAdminNegativeTestJSON-1288969004-project] 10.222.0.43 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.020854 Oct 04 18:32:23.236301 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 173/359] 10.222.0.43 () {60 vars in 1164 bytes} [Tue Oct 4 18:32:23 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 22 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:32:23.248704 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-c81f2bf9-88a0-4339-b3df-15ab405eab65 tempest-AggregatesAdminNegativeTestJSON-635194796 tempest-AggregatesAdminNegativeTestJSON-635194796-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-408593317"}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:23.252855 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.objects.aggregate [None req-c81f2bf9-88a0-4339-b3df-15ab405eab65 tempest-AggregatesAdminNegativeTestJSON-635194796 tempest-AggregatesAdminNegativeTestJSON-635194796-project-admin] Generated uuid 1c9ab2c7-d774-40d4-aa10-a1455804ea37 for aggregate {{(pid=123596) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 18:32:23.280774 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-c81f2bf9-88a0-4339-b3df-15ab405eab65 tempest-AggregatesAdminNegativeTestJSON-635194796 tempest-AggregatesAdminNegativeTestJSON-635194796-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.038845 Oct 04 18:32:23.281560 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 187/360] 10.222.0.43 () {60 vars in 1164 bytes} [Tue Oct 4 18:32:23 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:32:23.306181 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-c95a8b81-1366-4027-9754-1a05caec8df3 tempest-AggregatesAdminNegativeTestJSON-635194796 tempest-AggregatesAdminNegativeTestJSON-635194796-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-408593317"}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:23.314508 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.objects.aggregate [None req-c95a8b81-1366-4027-9754-1a05caec8df3 tempest-AggregatesAdminNegativeTestJSON-635194796 tempest-AggregatesAdminNegativeTestJSON-635194796-project-admin] Generated uuid bfde5a0e-62f8-4785-95ea-a1522050cb65 for aggregate {{(pid=123595) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 18:32:23.330489 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-c95a8b81-1366-4027-9754-1a05caec8df3 tempest-AggregatesAdminNegativeTestJSON-635194796 tempest-AggregatesAdminNegativeTestJSON-635194796-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-408593317 already exists. Oct 04 18:32:23.333014 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-c95a8b81-1366-4027-9754-1a05caec8df3 tempest-AggregatesAdminNegativeTestJSON-635194796 tempest-AggregatesAdminNegativeTestJSON-635194796-project-admin] Request method failure captured: Oct 04 18:32:23.333014 n-d-851028-13 devstack@n-api.service[123595]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 04 18:32:23.333014 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 18:32:23.333014 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 18:32:23.333014 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 18:32:23.333014 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 59 Oct 04 18:32:23.333014 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 18:32:23.333014 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 18:32:23.333014 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 18:32:23.333014 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 18:32:23.333014 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPHwyghqUch5OFDRJqqz8nEa33TeaPKuolXJF37XvIGGrBUnil9VLtRpwr8tXHQYd2YuLtGPymX_aVheJCMCI_4tGi1FGxwVHH3MQL3S2iFZNTSl0_Ki7FTyAAgkh9v_i1p_BuHy4MxeG0E3GwhW0NOSWqt9BhtXq7d-PfJXr9XH-CkQ Oct 04 18:32:23.333014 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 18:32:23.333014 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 18:32:23.333014 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 18:32:23.333014 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 18:32:23.333014 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 18:32:23.333014 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 18:32:23.333014 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: bce7a697f1cb43c2b64ff85b7add03b4 Oct 04 18:32:23.333014 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-635194796 Oct 04 18:32:23.333014 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,admin,reader Oct 04 18:32:23.333014 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,admin,reader Oct 04 18:32:23.334287 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/bce7a697f1cb43c2b64ff85b7add03b4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_bce7a697f1cb43c2b64ff85b7add03b4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/bce7a697f1cb43c2b64ff85b7add03b4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/bce7a697f1cb43c2b64ff85b7add03b4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:32:23.334287 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-635194796 Oct 04 18:32:23.334287 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: bce7a697f1cb43c2b64ff85b7add03b4 Oct 04 18:32:23.334287 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-635194796 Oct 04 18:32:23.334287 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-AggregatesAdminNegativeTestJSON-635194796-project-admin Oct 04 18:32:23.334287 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 18:32:23.334287 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 18:32:23.334287 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: fb2baff63b274646ac21f934327e4294 Oct 04 18:32:23.334287 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-635194796-project-admin Oct 04 18:32:23.334287 n-d-851028-13 devstack@n-api.service[123595]: Oct 04 18:32:23.334287 n-d-851028-13 devstack@n-api.service[123595]: {"aggregate": {"name": "tempest-test_aggregate-408593317"}} Oct 04 18:32:23.334287 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 18:32:23.334287 n-d-851028-13 devstack@n-api.service[123595]: exception: Aggregate tempest-test_aggregate-408593317 already exists. Oct 04 18:32:23.335109 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-408593317'}}} Oct 04 18:32:23.335109 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:32:23.335109 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:23.335109 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 78, in create Oct 04 18:32:23.335109 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi aggregate = self.api.create_aggregate(context, name, avail_zone) Oct 04 18:32:23.335109 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 04 18:32:23.335109 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 04 18:32:23.335109 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:32:23.335109 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:32:23.335109 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:32:23.335109 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:32:23.335109 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 04 18:32:23.335109 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 04 18:32:23.335109 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6458, in create_aggregate Oct 04 18:32:23.335109 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi aggregate.create() Oct 04 18:32:23.335109 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 04 18:32:23.335109 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 04 18:32:23.335109 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 310, in create Oct 04 18:32:23.335109 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_create_in_db(self._context, updates, Oct 04 18:32:23.337324 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 18:32:23.337324 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 18:32:23.337324 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 175, in _aggregate_create_in_db Oct 04 18:32:23.337324 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.AggregateNameExists(aggregate_name=values['name']) Oct 04 18:32:23.337324 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNameExists: Aggregate tempest-test_aggregate-408593317 already exists. Oct 04 18:32:23.337324 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:32:23.337324 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:23.337324 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:32:23.337324 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:23.337324 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:32:23.337324 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:32:23.337324 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:32:23.337324 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:32:23.337324 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:32:23.337324 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:32:23.337324 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:32:23.337324 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:32:23.337324 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:32:23.337324 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:32:23.337324 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 80, in create Oct 04 18:32:23.338617 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Oct 04 18:32:23.338617 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate tempest-test_aggregate-408593317 already exists. Oct 04 18:32:23.338617 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:32:23.338617 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:23.338617 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:32:23.338617 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:23.338617 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:32:23.338617 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:32:23.338617 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:32:23.338617 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:32:23.338617 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate tempest-test_aggregate-408593317 already exists. Oct 04 18:32:23.338617 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:32:23.343533 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f5a09de7-55d4-48c8-9656-ac36f08f88b3 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:23.344115 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-f5a09de7-55d4-48c8-9656-ac36f08f88b3 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] [instance: 606aebcb-2b6a-469f-a578-91325770ab4b] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:23.348442 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-c95a8b81-1366-4027-9754-1a05caec8df3 tempest-AggregatesAdminNegativeTestJSON-635194796 tempest-AggregatesAdminNegativeTestJSON-635194796-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-408593317 already exists. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:32:23.359237 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-c95a8b81-1366-4027-9754-1a05caec8df3 tempest-AggregatesAdminNegativeTestJSON-635194796 tempest-AggregatesAdminNegativeTestJSON-635194796-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates" status: 409 len: 110 microversion: 2.1 time: 0.067723 Oct 04 18:32:23.363157 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 174/361] 10.222.0.43 () {60 vars in 1164 bytes} [Tue Oct 4 18:32:23 2022] POST /compute/v2.1/os-aggregates => generated 110 bytes in 73 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:32:23.364252 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f5a09de7-55d4-48c8-9656-ac36f08f88b3 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:23.364755 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f5a09de7-55d4-48c8-9656-ac36f08f88b3 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:23.365250 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f5a09de7-55d4-48c8-9656-ac36f08f88b3 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:23.368819 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f5a09de7-55d4-48c8-9656-ac36f08f88b3 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:23.372275 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f5a09de7-55d4-48c8-9656-ac36f08f88b3 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:23.373063 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f5a09de7-55d4-48c8-9656-ac36f08f88b3 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:23.376715 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-447f0349-5092-49a6-9513-552c38d40604 tempest-AggregatesAdminNegativeTestJSON-635194796 tempest-AggregatesAdminNegativeTestJSON-635194796-project-admin] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:23.441160 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-447f0349-5092-49a6-9513-552c38d40604 tempest-AggregatesAdminNegativeTestJSON-635194796 tempest-AggregatesAdminNegativeTestJSON-635194796-project-admin] 10.222.0.43 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.068483 Oct 04 18:32:23.448536 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 175/362] 10.222.0.43 () {58 vars in 1155 bytes} [Tue Oct 4 18:32:23 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 18:32:23.476512 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-f1c66c48-516c-45bb-a542-0a2429d2ef6c tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:23.477288 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-f1c66c48-516c-45bb-a542-0a2429d2ef6c tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] [instance: 918d6106-9c7c-4046-9cdd-319afe4cdb25] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:23.486855 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f1c66c48-516c-45bb-a542-0a2429d2ef6c tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:23.487630 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f1c66c48-516c-45bb-a542-0a2429d2ef6c tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:23.488564 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f1c66c48-516c-45bb-a542-0a2429d2ef6c tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:23.489861 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f1c66c48-516c-45bb-a542-0a2429d2ef6c tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:23.490478 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f1c66c48-516c-45bb-a542-0a2429d2ef6c tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:23.491083 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f1c66c48-516c-45bb-a542-0a2429d2ef6c tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:23.591238 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-f1c66c48-516c-45bb-a542-0a2429d2ef6c tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb7b0ce49ec438f9a60b79bdb2ac164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94ae6e2cb75d410d8029aa49909c973b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:23.606847 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-f1c66c48-516c-45bb-a542-0a2429d2ef6c tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] 10.222.0.43 "GET /compute/v2.1/servers/918d6106-9c7c-4046-9cdd-319afe4cdb25" status: 200 len: 1273 microversion: 2.1 time: 0.156312 Oct 04 18:32:23.607752 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 176/363] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:23 2022] GET /compute/v2.1/servers/918d6106-9c7c-4046-9cdd-319afe4cdb25 => generated 1273 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:23.616701 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-3d37d146-6417-4acf-bdf0-d2c464e78c6f tempest-AggregatesAdminNegativeTestJSON-635194796 tempest-AggregatesAdminNegativeTestJSON-635194796-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2034992580"}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:23.621186 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.objects.aggregate [None req-3d37d146-6417-4acf-bdf0-d2c464e78c6f tempest-AggregatesAdminNegativeTestJSON-635194796 tempest-AggregatesAdminNegativeTestJSON-635194796-project-admin] Generated uuid 843b1e27-50a6-4114-b97d-81744a9e1d52 for aggregate {{(pid=123595) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 18:32:23.685540 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-3d37d146-6417-4acf-bdf0-d2c464e78c6f tempest-AggregatesAdminNegativeTestJSON-635194796 tempest-AggregatesAdminNegativeTestJSON-635194796-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.074433 Oct 04 18:32:23.687812 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 177/364] 10.222.0.43 () {60 vars in 1164 bytes} [Tue Oct 4 18:32:23 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:32:23.699775 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-732af94f-971a-42a8-99b7-783b89811f7c tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:23.705966 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-732af94f-971a-42a8-99b7-783b89811f7c tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] [instance: 640d917c-c9cb-4758-aa1d-216e34a55297] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:23.716907 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-732af94f-971a-42a8-99b7-783b89811f7c tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:23.718413 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-732af94f-971a-42a8-99b7-783b89811f7c tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:23.719012 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-732af94f-971a-42a8-99b7-783b89811f7c tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:23.719923 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-732af94f-971a-42a8-99b7-783b89811f7c tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:23.720671 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-732af94f-971a-42a8-99b7-783b89811f7c tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:23.721330 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-732af94f-971a-42a8-99b7-783b89811f7c tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:23.854116 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-732af94f-971a-42a8-99b7-783b89811f7c tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7db99f361654711bea7f1b2c404d312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7adedcdb9c3485ea2738c00e25aa3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:23.864606 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-732af94f-971a-42a8-99b7-783b89811f7c tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] 10.222.0.43 "GET /compute/v2.1/servers/640d917c-c9cb-4758-aa1d-216e34a55297" status: 200 len: 1215 microversion: 2.1 time: 0.174905 Oct 04 18:32:23.865908 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 178/365] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:23 2022] GET /compute/v2.1/servers/640d917c-c9cb-4758-aa1d-216e34a55297 => generated 1215 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:23.887591 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-eefd31ae-63d3-43bd-8e8e-69cd48312959 tempest-AggregatesAdminNegativeTestJSON-1288969004 tempest-AggregatesAdminNegativeTestJSON-1288969004-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:23.889641 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-eefd31ae-63d3-43bd-8e8e-69cd48312959 tempest-AggregatesAdminNegativeTestJSON-1288969004 tempest-AggregatesAdminNegativeTestJSON-1288969004-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': '62a3cb8bb32a4bdbb7c360370697d9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7694a80f5cd2481faf6ea92be8c51e4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:23.891713 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-eefd31ae-63d3-43bd-8e8e-69cd48312959 tempest-AggregatesAdminNegativeTestJSON-1288969004 tempest-AggregatesAdminNegativeTestJSON-1288969004-project] Request method failure captured: Oct 04 18:32:23.891713 n-d-851028-13 devstack@n-api.service[123595]: request: DELETE /compute/v2.1/os-aggregates/15 HTTP/1.1 Oct 04 18:32:23.891713 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 18:32:23.891713 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 18:32:23.891713 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 18:32:23.891713 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 0 Oct 04 18:32:23.891713 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 18:32:23.891713 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 18:32:23.891713 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 18:32:23.891713 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 18:32:23.891713 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPHwwTyasFQdt0vSEiEifUlslxjrZQ5PpmAkaNDtIaW6JSJ_RVvCGQ8OdcOL24jbtv1AQnsjbKUNM_cuE3vPfnO5AYOEw2ZVD2lUG9KEQkiMiTQcZawMlO8cY6tzInnxY2jn7BFfJz4XVX85WNo3zdgQVI4Anp61lrKQ81_BJ0QNh_WA Oct 04 18:32:23.891713 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 18:32:23.891713 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 18:32:23.891713 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 18:32:23.891713 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 18:32:23.891713 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 18:32:23.891713 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 18:32:23.891713 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: 7694a80f5cd2481faf6ea92be8c51e4d Oct 04 18:32:23.891713 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1288969004 Oct 04 18:32:23.891713 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 18:32:23.891713 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 18:32:23.892938 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/7694a80f5cd2481faf6ea92be8c51e4d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_7694a80f5cd2481faf6ea92be8c51e4d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/7694a80f5cd2481faf6ea92be8c51e4d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/7694a80f5cd2481faf6ea92be8c51e4d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:32:23.892938 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1288969004 Oct 04 18:32:23.892938 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: 7694a80f5cd2481faf6ea92be8c51e4d Oct 04 18:32:23.892938 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1288969004 Oct 04 18:32:23.892938 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-AggregatesAdminNegativeTestJSON-1288969004-project Oct 04 18:32:23.892938 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 18:32:23.892938 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 18:32:23.892938 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: 62a3cb8bb32a4bdbb7c360370697d9e0 Oct 04 18:32:23.892938 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1288969004-project Oct 04 18:32:23.892938 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 18:32:23.892938 n-d-851028-13 devstack@n-api.service[123595]: exception: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 04 18:32:23.892938 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': '15'} Oct 04 18:32:23.893651 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:32:23.893651 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:23.893651 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:32:23.893651 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:32:23.893651 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:32:23.893651 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:32:23.893651 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:32:23.893651 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:32:23.893651 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 147, in delete Oct 04 18:32:23.893651 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'delete', target={}) Oct 04 18:32:23.893651 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 18:32:23.893651 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 18:32:23.893651 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 18:32:23.893651 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 18:32:23.893651 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:32:23.893651 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:32:23.893651 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:32:23.893651 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:32:23.893651 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 18:32:23.894726 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 18:32:23.894726 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 18:32:23.894726 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 18:32:23.894726 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 18:32:23.894726 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 18:32:23.894726 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 04 18:32:23.894726 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:32:23.894726 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:23.894726 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:32:23.894726 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:23.894726 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:32:23.894726 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:32:23.894726 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 18:32:23.894726 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 18:32:23.894726 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 04 18:32:23.894726 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:32:23.898442 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-eefd31ae-63d3-43bd-8e8e-69cd48312959 tempest-AggregatesAdminNegativeTestJSON-1288969004 tempest-AggregatesAdminNegativeTestJSON-1288969004-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:32:23.899572 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-eefd31ae-63d3-43bd-8e8e-69cd48312959 tempest-AggregatesAdminNegativeTestJSON-1288969004 tempest-AggregatesAdminNegativeTestJSON-1288969004-project] 10.222.0.43 "DELETE /compute/v2.1/os-aggregates/15" status: 403 len: 116 microversion: 2.1 time: 0.032079 Oct 04 18:32:23.900318 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 179/366] 10.222.0.43 () {58 vars in 1155 bytes} [Tue Oct 4 18:32:23 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 116 bytes in 34 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:32:23.908633 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-95fa4882-6e27-4cf7-878c-50ebba4266cd tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:23.909656 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-95fa4882-6e27-4cf7-878c-50ebba4266cd tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] [instance: b249a7cd-d1ee-4a74-a93d-9991ba84785f] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:23.920403 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-95fa4882-6e27-4cf7-878c-50ebba4266cd tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:23.920991 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-95fa4882-6e27-4cf7-878c-50ebba4266cd tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:23.921754 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-95fa4882-6e27-4cf7-878c-50ebba4266cd tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:23.922761 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-95fa4882-6e27-4cf7-878c-50ebba4266cd tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:23.923594 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-95fa4882-6e27-4cf7-878c-50ebba4266cd tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:23.924393 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-95fa4882-6e27-4cf7-878c-50ebba4266cd tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:23.968102 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-95fa4882-6e27-4cf7-878c-50ebba4266cd tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:23.968977 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-95fa4882-6e27-4cf7-878c-50ebba4266cd tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:23.969743 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-95fa4882-6e27-4cf7-878c-50ebba4266cd tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:23.970647 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.objects.instance [None req-95fa4882-6e27-4cf7-878c-50ebba4266cd tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lazy-loading 'fault' on Instance uuid b249a7cd-d1ee-4a74-a93d-9991ba84785f {{(pid=123595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:32:24.307551 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-f5a09de7-55d4-48c8-9656-ac36f08f88b3 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f207a188e3fa4987b9fe4dd773ad03b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c636de1e6b42868f1f58e46fd4a3f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:24.320498 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-f5a09de7-55d4-48c8-9656-ac36f08f88b3 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] 10.222.0.43 "GET /compute/v2.1/servers/606aebcb-2b6a-469f-a578-91325770ab4b" status: 200 len: 1332 microversion: 2.1 time: 0.980811 Oct 04 18:32:24.334988 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 188/367] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:23 2022] GET /compute/v2.1/servers/606aebcb-2b6a-469f-a578-91325770ab4b => generated 1332 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:24.351752 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-6f168c5c-fa8b-4109-8392-098645efe90f tempest-AggregatesAdminNegativeTestJSON-635194796 tempest-AggregatesAdminNegativeTestJSON-635194796-project-admin] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:24.421998 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-6f168c5c-fa8b-4109-8392-098645efe90f tempest-AggregatesAdminNegativeTestJSON-635194796 tempest-AggregatesAdminNegativeTestJSON-635194796-project-admin] 10.222.0.43 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.077566 Oct 04 18:32:24.431260 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 189/368] 10.222.0.43 () {58 vars in 1155 bytes} [Tue Oct 4 18:32:24 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 18:32:24.437813 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-9df02f94-6e30-41d5-9e2c-596b4421c0fe tempest-AggregatesAdminNegativeTestJSON-635194796 tempest-AggregatesAdminNegativeTestJSON-635194796-project-admin] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:24.453672 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-9df02f94-6e30-41d5-9e2c-596b4421c0fe tempest-AggregatesAdminNegativeTestJSON-635194796 tempest-AggregatesAdminNegativeTestJSON-635194796-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Oct 04 18:32:24.456200 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-9df02f94-6e30-41d5-9e2c-596b4421c0fe tempest-AggregatesAdminNegativeTestJSON-635194796 tempest-AggregatesAdminNegativeTestJSON-635194796-project-admin] Request method failure captured: Oct 04 18:32:24.456200 n-d-851028-13 devstack@n-api.service[123596]: request: DELETE /compute/v2.1/os-aggregates/-1 HTTP/1.1 Oct 04 18:32:24.456200 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:32:24.456200 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:32:24.456200 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:32:24.456200 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 18:32:24.456200 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:32:24.456200 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:32:24.456200 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:32:24.456200 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:32:24.456200 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPHwyghqUch5OFDRJqqz8nEa33TeaPKuolXJF37XvIGGrBUnil9VLtRpwr8tXHQYd2YuLtGPymX_aVheJCMCI_4tGi1FGxwVHH3MQL3S2iFZNTSl0_Ki7FTyAAgkh9v_i1p_BuHy4MxeG0E3GwhW0NOSWqt9BhtXq7d-PfJXr9XH-CkQ Oct 04 18:32:24.456200 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:32:24.456200 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:32:24.456200 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:32:24.456200 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:32:24.456200 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:32:24.456200 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:32:24.456200 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: bce7a697f1cb43c2b64ff85b7add03b4 Oct 04 18:32:24.456200 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-635194796 Oct 04 18:32:24.456200 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,admin,reader Oct 04 18:32:24.456200 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,admin,reader Oct 04 18:32:24.457543 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/bce7a697f1cb43c2b64ff85b7add03b4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_bce7a697f1cb43c2b64ff85b7add03b4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/bce7a697f1cb43c2b64ff85b7add03b4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/bce7a697f1cb43c2b64ff85b7add03b4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:32:24.457543 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-635194796 Oct 04 18:32:24.457543 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: bce7a697f1cb43c2b64ff85b7add03b4 Oct 04 18:32:24.457543 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-635194796 Oct 04 18:32:24.457543 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-AggregatesAdminNegativeTestJSON-635194796-project-admin Oct 04 18:32:24.457543 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:32:24.457543 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:32:24.457543 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: fb2baff63b274646ac21f934327e4294 Oct 04 18:32:24.457543 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-635194796-project-admin Oct 04 18:32:24.457543 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 18:32:24.457543 n-d-851028-13 devstack@n-api.service[123596]: exception: Aggregate -1 could not be found. Oct 04 18:32:24.457543 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': '-1'} Oct 04 18:32:24.458237 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:32:24.458237 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:24.458237 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 04 18:32:24.458237 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 04 18:32:24.458237 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 04 18:32:24.458237 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 04 18:32:24.458237 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:32:24.458237 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:32:24.458237 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:32:24.458237 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:32:24.458237 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 04 18:32:24.458237 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 04 18:32:24.458237 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Oct 04 18:32:24.458237 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 04 18:32:24.458237 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 18:32:24.458237 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 18:32:24.458237 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 04 18:32:24.458237 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 04 18:32:24.458237 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 18:32:24.464400 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 18:32:24.464400 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 04 18:32:24.464400 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 04 18:32:24.464400 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Oct 04 18:32:24.464400 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:32:24.464400 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:24.464400 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:32:24.464400 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:24.464400 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:32:24.464400 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:32:24.464400 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:32:24.464400 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:32:24.464400 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:32:24.464400 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:32:24.464400 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 04 18:32:24.464400 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:32:24.464400 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Oct 04 18:32:24.464400 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:32:24.464400 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:24.464400 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:32:24.464400 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:24.465876 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:32:24.465876 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:32:24.465876 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:32:24.465876 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:32:24.465876 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Oct 04 18:32:24.465876 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:32:24.465876 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-9df02f94-6e30-41d5-9e2c-596b4421c0fe tempest-AggregatesAdminNegativeTestJSON-635194796 tempest-AggregatesAdminNegativeTestJSON-635194796-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:32:24.465876 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-9df02f94-6e30-41d5-9e2c-596b4421c0fe tempest-AggregatesAdminNegativeTestJSON-635194796 tempest-AggregatesAdminNegativeTestJSON-635194796-project-admin] 10.222.0.43 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.025181 Oct 04 18:32:24.465876 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 190/369] 10.222.0.43 () {58 vars in 1155 bytes} [Tue Oct 4 18:32:24 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:32:24.469344 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-cd6a5917-51ab-49bd-9f1a-d4d662f92c65 tempest-AggregatesAdminNegativeTestJSON-635194796 tempest-AggregatesAdminNegativeTestJSON-635194796-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1060194261"}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:24.473475 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.objects.aggregate [None req-cd6a5917-51ab-49bd-9f1a-d4d662f92c65 tempest-AggregatesAdminNegativeTestJSON-635194796 tempest-AggregatesAdminNegativeTestJSON-635194796-project-admin] Generated uuid 60ded65e-14a7-4333-bf4c-b80d071c7e6f for aggregate {{(pid=123596) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 18:32:24.537270 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-cd6a5917-51ab-49bd-9f1a-d4d662f92c65 tempest-AggregatesAdminNegativeTestJSON-635194796 tempest-AggregatesAdminNegativeTestJSON-635194796-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.072438 Oct 04 18:32:24.538034 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 191/370] 10.222.0.43 () {60 vars in 1164 bytes} [Tue Oct 4 18:32:24 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:32:24.551060 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-a0fcc108-ad81-4257-90e6-9b54f212ada6 tempest-AggregatesAdminNegativeTestJSON-1288969004 tempest-AggregatesAdminNegativeTestJSON-1288969004-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:24.553208 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-a0fcc108-ad81-4257-90e6-9b54f212ada6 tempest-AggregatesAdminNegativeTestJSON-1288969004 tempest-AggregatesAdminNegativeTestJSON-1288969004-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': '62a3cb8bb32a4bdbb7c360370697d9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7694a80f5cd2481faf6ea92be8c51e4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:24.554756 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-a0fcc108-ad81-4257-90e6-9b54f212ada6 tempest-AggregatesAdminNegativeTestJSON-1288969004 tempest-AggregatesAdminNegativeTestJSON-1288969004-project] Request method failure captured: Oct 04 18:32:24.554756 n-d-851028-13 devstack@n-api.service[123596]: request: GET /compute/v2.1/os-aggregates/16 HTTP/1.1 Oct 04 18:32:24.554756 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:32:24.554756 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:32:24.554756 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:32:24.554756 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 18:32:24.554756 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:32:24.554756 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:32:24.554756 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:32:24.554756 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:32:24.554756 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPHwwTyasFQdt0vSEiEifUlslxjrZQ5PpmAkaNDtIaW6JSJ_RVvCGQ8OdcOL24jbtv1AQnsjbKUNM_cuE3vPfnO5AYOEw2ZVD2lUG9KEQkiMiTQcZawMlO8cY6tzInnxY2jn7BFfJz4XVX85WNo3zdgQVI4Anp61lrKQ81_BJ0QNh_WA Oct 04 18:32:24.554756 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:32:24.554756 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:32:24.554756 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:32:24.554756 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:32:24.554756 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:32:24.554756 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:32:24.554756 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: 7694a80f5cd2481faf6ea92be8c51e4d Oct 04 18:32:24.554756 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1288969004 Oct 04 18:32:24.554756 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 18:32:24.554756 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 18:32:24.556050 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/7694a80f5cd2481faf6ea92be8c51e4d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_7694a80f5cd2481faf6ea92be8c51e4d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/7694a80f5cd2481faf6ea92be8c51e4d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/7694a80f5cd2481faf6ea92be8c51e4d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:32:24.556050 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1288969004 Oct 04 18:32:24.556050 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: 7694a80f5cd2481faf6ea92be8c51e4d Oct 04 18:32:24.556050 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1288969004 Oct 04 18:32:24.556050 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-AggregatesAdminNegativeTestJSON-1288969004-project Oct 04 18:32:24.556050 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:32:24.556050 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:32:24.556050 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 62a3cb8bb32a4bdbb7c360370697d9e0 Oct 04 18:32:24.556050 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1288969004-project Oct 04 18:32:24.556050 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 18:32:24.556050 n-d-851028-13 devstack@n-api.service[123596]: exception: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 04 18:32:24.556050 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': '16'} Oct 04 18:32:24.556854 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:32:24.556854 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:24.556854 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:32:24.556854 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:32:24.556854 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:32:24.556854 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:32:24.556854 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:32:24.556854 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:32:24.556854 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 100, in show Oct 04 18:32:24.556854 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'show', target={}) Oct 04 18:32:24.556854 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 18:32:24.556854 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 18:32:24.556854 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 18:32:24.556854 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 18:32:24.556854 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:32:24.556854 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:32:24.556854 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:32:24.556854 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:32:24.556854 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 18:32:24.557944 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 18:32:24.557944 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 18:32:24.557944 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 18:32:24.557944 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 18:32:24.557944 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 18:32:24.557944 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 04 18:32:24.557944 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:32:24.557944 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:24.557944 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:32:24.557944 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:24.557944 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:32:24.557944 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:32:24.557944 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 18:32:24.557944 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 18:32:24.557944 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 04 18:32:24.557944 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:32:24.560389 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-a0fcc108-ad81-4257-90e6-9b54f212ada6 tempest-AggregatesAdminNegativeTestJSON-1288969004 tempest-AggregatesAdminNegativeTestJSON-1288969004-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:32:24.563173 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-a0fcc108-ad81-4257-90e6-9b54f212ada6 tempest-AggregatesAdminNegativeTestJSON-1288969004 tempest-AggregatesAdminNegativeTestJSON-1288969004-project] 10.222.0.43 "GET /compute/v2.1/os-aggregates/16" status: 403 len: 114 microversion: 2.1 time: 0.015990 Oct 04 18:32:24.569717 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 192/371] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Oct 4 18:32:24 2022] GET /compute/v2.1/os-aggregates/16 => generated 114 bytes in 23 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:32:24.576941 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-b5c533a0-5868-44a7-81ff-1f9cd41891d1 tempest-AggregatesAdminNegativeTestJSON-635194796 tempest-AggregatesAdminNegativeTestJSON-635194796-project-admin] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:24.609475 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-b5c533a0-5868-44a7-81ff-1f9cd41891d1 tempest-AggregatesAdminNegativeTestJSON-635194796 tempest-AggregatesAdminNegativeTestJSON-635194796-project-admin] 10.222.0.43 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.037624 Oct 04 18:32:24.617159 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 193/372] 10.222.0.43 () {58 vars in 1155 bytes} [Tue Oct 4 18:32:24 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 18:32:24.625694 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f7a21d87-40d1-4dfa-923c-0fa8f09d8ea8 tempest-AggregatesAdminNegativeTestJSON-635194796 tempest-AggregatesAdminNegativeTestJSON-635194796-project-admin] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:24.639773 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-95fa4882-6e27-4cf7-878c-50ebba4266cd tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '459e65f14af049bba311453d6a86360b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1753b9ee9a644e409a1efd0c9e7c152c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:24.650177 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-95fa4882-6e27-4cf7-878c-50ebba4266cd tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] 10.222.0.43 "GET /compute/v2.1/servers/b249a7cd-d1ee-4a74-a93d-9991ba84785f" status: 200 len: 1457 microversion: 2.1 time: 0.748430 Oct 04 18:32:24.654924 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-f7a21d87-40d1-4dfa-923c-0fa8f09d8ea8 tempest-AggregatesAdminNegativeTestJSON-635194796 tempest-AggregatesAdminNegativeTestJSON-635194796-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Oct 04 18:32:24.655353 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 180/373] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:23 2022] GET /compute/v2.1/servers/b249a7cd-d1ee-4a74-a93d-9991ba84785f => generated 1457 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:24.662512 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f7a21d87-40d1-4dfa-923c-0fa8f09d8ea8 tempest-AggregatesAdminNegativeTestJSON-635194796 tempest-AggregatesAdminNegativeTestJSON-635194796-project-admin] Request method failure captured: Oct 04 18:32:24.662512 n-d-851028-13 devstack@n-api.service[123596]: request: GET /compute/v2.1/os-aggregates/-1 HTTP/1.1 Oct 04 18:32:24.662512 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:32:24.662512 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:32:24.662512 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:32:24.662512 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 18:32:24.662512 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:32:24.662512 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:32:24.662512 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:32:24.662512 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:32:24.662512 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPHwyghqUch5OFDRJqqz8nEa33TeaPKuolXJF37XvIGGrBUnil9VLtRpwr8tXHQYd2YuLtGPymX_aVheJCMCI_4tGi1FGxwVHH3MQL3S2iFZNTSl0_Ki7FTyAAgkh9v_i1p_BuHy4MxeG0E3GwhW0NOSWqt9BhtXq7d-PfJXr9XH-CkQ Oct 04 18:32:24.662512 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:32:24.662512 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:32:24.662512 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:32:24.662512 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:32:24.662512 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:32:24.662512 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:32:24.662512 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: bce7a697f1cb43c2b64ff85b7add03b4 Oct 04 18:32:24.662512 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-635194796 Oct 04 18:32:24.662512 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,admin,reader Oct 04 18:32:24.662512 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,admin,reader Oct 04 18:32:24.663753 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/bce7a697f1cb43c2b64ff85b7add03b4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_bce7a697f1cb43c2b64ff85b7add03b4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/bce7a697f1cb43c2b64ff85b7add03b4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/bce7a697f1cb43c2b64ff85b7add03b4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:32:24.663753 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-635194796 Oct 04 18:32:24.663753 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: bce7a697f1cb43c2b64ff85b7add03b4 Oct 04 18:32:24.663753 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-635194796 Oct 04 18:32:24.663753 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-AggregatesAdminNegativeTestJSON-635194796-project-admin Oct 04 18:32:24.663753 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:32:24.663753 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:32:24.663753 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: fb2baff63b274646ac21f934327e4294 Oct 04 18:32:24.663753 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-635194796-project-admin Oct 04 18:32:24.663753 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 18:32:24.663753 n-d-851028-13 devstack@n-api.service[123596]: exception: Aggregate -1 could not be found. Oct 04 18:32:24.663753 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': '-1'} Oct 04 18:32:24.664408 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:32:24.664408 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:24.664408 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 04 18:32:24.664408 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 04 18:32:24.664408 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Oct 04 18:32:24.664408 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 04 18:32:24.664408 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 18:32:24.664408 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 18:32:24.664408 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 04 18:32:24.664408 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 04 18:32:24.664408 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 18:32:24.664408 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 18:32:24.664408 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 04 18:32:24.664408 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 04 18:32:24.664408 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Oct 04 18:32:24.664408 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:32:24.664408 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:24.664408 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:32:24.664408 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:24.664408 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:32:24.665598 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:32:24.665598 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:32:24.665598 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:32:24.665598 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:32:24.665598 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:32:24.665598 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 04 18:32:24.665598 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:32:24.665598 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Oct 04 18:32:24.665598 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:32:24.665598 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:24.665598 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:32:24.665598 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:24.665598 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:32:24.665598 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:32:24.665598 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:32:24.665598 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:32:24.665598 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Oct 04 18:32:24.665598 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:32:24.672069 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-3a0a05c3-948a-4724-ba0e-129e906c6912 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:24.672236 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f7a21d87-40d1-4dfa-923c-0fa8f09d8ea8 tempest-AggregatesAdminNegativeTestJSON-635194796 tempest-AggregatesAdminNegativeTestJSON-635194796-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:32:24.672236 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-f7a21d87-40d1-4dfa-923c-0fa8f09d8ea8 tempest-AggregatesAdminNegativeTestJSON-635194796 tempest-AggregatesAdminNegativeTestJSON-635194796-project-admin] 10.222.0.43 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.052083 Oct 04 18:32:24.681786 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-3a0a05c3-948a-4724-ba0e-129e906c6912 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] [instance: 918d6106-9c7c-4046-9cdd-319afe4cdb25] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:24.682416 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 194/374] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Oct 4 18:32:24 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:32:24.692014 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-53745074-d2eb-43c5-a504-465c9a833994 tempest-AggregatesAdminNegativeTestJSON-1288969004 tempest-AggregatesAdminNegativeTestJSON-1288969004-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:24.695198 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-53745074-d2eb-43c5-a504-465c9a833994 tempest-AggregatesAdminNegativeTestJSON-1288969004 tempest-AggregatesAdminNegativeTestJSON-1288969004-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': '62a3cb8bb32a4bdbb7c360370697d9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7694a80f5cd2481faf6ea92be8c51e4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:24.696752 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-53745074-d2eb-43c5-a504-465c9a833994 tempest-AggregatesAdminNegativeTestJSON-1288969004 tempest-AggregatesAdminNegativeTestJSON-1288969004-project] Request method failure captured: Oct 04 18:32:24.696752 n-d-851028-13 devstack@n-api.service[123596]: request: GET /compute/v2.1/os-aggregates HTTP/1.1 Oct 04 18:32:24.696752 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:32:24.696752 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:32:24.696752 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:32:24.696752 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 18:32:24.696752 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:32:24.696752 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:32:24.696752 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:32:24.696752 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:32:24.696752 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPHwwTyasFQdt0vSEiEifUlslxjrZQ5PpmAkaNDtIaW6JSJ_RVvCGQ8OdcOL24jbtv1AQnsjbKUNM_cuE3vPfnO5AYOEw2ZVD2lUG9KEQkiMiTQcZawMlO8cY6tzInnxY2jn7BFfJz4XVX85WNo3zdgQVI4Anp61lrKQ81_BJ0QNh_WA Oct 04 18:32:24.696752 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:32:24.696752 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:32:24.696752 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:32:24.696752 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:32:24.696752 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:32:24.696752 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:32:24.696752 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: 7694a80f5cd2481faf6ea92be8c51e4d Oct 04 18:32:24.696752 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1288969004 Oct 04 18:32:24.696752 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 18:32:24.696752 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 18:32:24.698573 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/7694a80f5cd2481faf6ea92be8c51e4d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_7694a80f5cd2481faf6ea92be8c51e4d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/7694a80f5cd2481faf6ea92be8c51e4d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/7694a80f5cd2481faf6ea92be8c51e4d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:32:24.698573 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1288969004 Oct 04 18:32:24.698573 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: 7694a80f5cd2481faf6ea92be8c51e4d Oct 04 18:32:24.698573 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1288969004 Oct 04 18:32:24.698573 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-AggregatesAdminNegativeTestJSON-1288969004-project Oct 04 18:32:24.698573 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:32:24.698573 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:32:24.698573 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 62a3cb8bb32a4bdbb7c360370697d9e0 Oct 04 18:32:24.698573 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1288969004-project Oct 04 18:32:24.698573 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 18:32:24.698573 n-d-851028-13 devstack@n-api.service[123596]: exception: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 04 18:32:24.698573 n-d-851028-13 devstack@n-api.service[123596]: action_args: {} Oct 04 18:32:24.699318 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:32:24.699318 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:24.699318 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:32:24.699318 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:32:24.699318 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:32:24.699318 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:32:24.699318 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:32:24.699318 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:32:24.699318 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 55, in index Oct 04 18:32:24.699318 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'index', target={}) Oct 04 18:32:24.699318 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 18:32:24.699318 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 18:32:24.699318 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 18:32:24.699318 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 18:32:24.699318 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:32:24.699318 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:32:24.699318 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:32:24.699318 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:32:24.699318 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 18:32:24.700362 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 18:32:24.700362 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 18:32:24.700362 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 18:32:24.700362 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 18:32:24.700362 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 18:32:24.700362 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 04 18:32:24.700362 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:32:24.700362 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:24.700362 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:32:24.700362 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:24.700362 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:32:24.700362 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:32:24.700362 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 18:32:24.700362 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 18:32:24.700362 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 04 18:32:24.700362 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:32:24.700362 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-53745074-d2eb-43c5-a504-465c9a833994 tempest-AggregatesAdminNegativeTestJSON-1288969004 tempest-AggregatesAdminNegativeTestJSON-1288969004-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:32:24.701341 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-53745074-d2eb-43c5-a504-465c9a833994 tempest-AggregatesAdminNegativeTestJSON-1288969004 tempest-AggregatesAdminNegativeTestJSON-1288969004-project] 10.222.0.43 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.015164 Oct 04 18:32:24.701341 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 195/375] 10.222.0.43 () {58 vars in 1143 bytes} [Tue Oct 4 18:32:24 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 16 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:32:24.713350 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3a0a05c3-948a-4724-ba0e-129e906c6912 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:24.714612 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3a0a05c3-948a-4724-ba0e-129e906c6912 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:24.715062 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3a0a05c3-948a-4724-ba0e-129e906c6912 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:24.715313 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-d16a314c-9cdd-4f55-b4ff-896d1483327e tempest-AggregatesAdminNegativeTestJSON-635194796 tempest-AggregatesAdminNegativeTestJSON-635194796-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-84088198"}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:24.717725 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3a0a05c3-948a-4724-ba0e-129e906c6912 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:24.720730 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.objects.aggregate [None req-d16a314c-9cdd-4f55-b4ff-896d1483327e tempest-AggregatesAdminNegativeTestJSON-635194796 tempest-AggregatesAdminNegativeTestJSON-635194796-project-admin] Generated uuid 7d9e669c-0605-4527-990f-546a0a2993cd for aggregate {{(pid=123596) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 18:32:24.724082 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3a0a05c3-948a-4724-ba0e-129e906c6912 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:24.724543 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3a0a05c3-948a-4724-ba0e-129e906c6912 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:24.762792 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-d16a314c-9cdd-4f55-b4ff-896d1483327e tempest-AggregatesAdminNegativeTestJSON-635194796 tempest-AggregatesAdminNegativeTestJSON-635194796-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.053091 Oct 04 18:32:24.771389 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 196/376] 10.222.0.43 () {60 vars in 1164 bytes} [Tue Oct 4 18:32:24 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:32:24.798063 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-1c3d0565-9390-4ebe-affe-1b5663d959c3 tempest-AggregatesAdminNegativeTestJSON-635194796 tempest-AggregatesAdminNegativeTestJSON-635194796-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-851028-13"}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:24.829041 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1c3d0565-9390-4ebe-affe-1b5663d959c3 tempest-AggregatesAdminNegativeTestJSON-635194796 tempest-AggregatesAdminNegativeTestJSON-635194796-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:24.829633 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1c3d0565-9390-4ebe-affe-1b5663d959c3 tempest-AggregatesAdminNegativeTestJSON-635194796 tempest-AggregatesAdminNegativeTestJSON-635194796-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:24.840613 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1c3d0565-9390-4ebe-affe-1b5663d959c3 tempest-AggregatesAdminNegativeTestJSON-635194796 tempest-AggregatesAdminNegativeTestJSON-635194796-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:24.892842 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-3a0a05c3-948a-4724-ba0e-129e906c6912 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb7b0ce49ec438f9a60b79bdb2ac164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94ae6e2cb75d410d8029aa49909c973b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:24.906994 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-3a0a05c3-948a-4724-ba0e-129e906c6912 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] 10.222.0.43 "GET /compute/v2.1/servers/918d6106-9c7c-4046-9cdd-319afe4cdb25" status: 200 len: 1279 microversion: 2.1 time: 0.249720 Oct 04 18:32:24.908552 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 181/377] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:24 2022] GET /compute/v2.1/servers/918d6106-9c7c-4046-9cdd-319afe4cdb25 => generated 1279 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:24.921771 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-e29a467a-9a00-49d2-8748-70181c8db860 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:24.922871 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-e29a467a-9a00-49d2-8748-70181c8db860 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] [instance: 640d917c-c9cb-4758-aa1d-216e34a55297] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:24.954652 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e29a467a-9a00-49d2-8748-70181c8db860 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:24.954652 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e29a467a-9a00-49d2-8748-70181c8db860 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:24.954652 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e29a467a-9a00-49d2-8748-70181c8db860 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:24.955076 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e29a467a-9a00-49d2-8748-70181c8db860 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:24.955201 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e29a467a-9a00-49d2-8748-70181c8db860 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:24.961560 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e29a467a-9a00-49d2-8748-70181c8db860 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:25.090768 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-1c3d0565-9390-4ebe-affe-1b5663d959c3 tempest-AggregatesAdminNegativeTestJSON-635194796 tempest-AggregatesAdminNegativeTestJSON-635194796-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 242 microversion: 2.1 time: 0.311798 Oct 04 18:32:25.091717 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 197/378] 10.222.0.43 () {60 vars in 1194 bytes} [Tue Oct 4 18:32:24 2022] POST /compute/v2.1/os-aggregates/17/action => generated 242 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:32:25.104137 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-9a99074e-42d4-4416-bdd5-5a6b2ce9d1e6 tempest-AggregatesAdminNegativeTestJSON-1288969004 tempest-AggregatesAdminNegativeTestJSON-1288969004-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-851028-13"}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:25.107942 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-9a99074e-42d4-4416-bdd5-5a6b2ce9d1e6 tempest-AggregatesAdminNegativeTestJSON-1288969004 tempest-AggregatesAdminNegativeTestJSON-1288969004-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': '62a3cb8bb32a4bdbb7c360370697d9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7694a80f5cd2481faf6ea92be8c51e4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:25.114840 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-9a99074e-42d4-4416-bdd5-5a6b2ce9d1e6 tempest-AggregatesAdminNegativeTestJSON-1288969004 tempest-AggregatesAdminNegativeTestJSON-1288969004-project] Request method failure captured: Oct 04 18:32:25.114840 n-d-851028-13 devstack@n-api.service[123596]: request: POST /compute/v2.1/os-aggregates/17/action HTTP/1.1 Oct 04 18:32:25.114840 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:32:25.114840 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:32:25.114840 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:32:25.114840 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 43 Oct 04 18:32:25.114840 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:32:25.114840 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:32:25.114840 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:32:25.114840 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:32:25.114840 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPHwwTyasFQdt0vSEiEifUlslxjrZQ5PpmAkaNDtIaW6JSJ_RVvCGQ8OdcOL24jbtv1AQnsjbKUNM_cuE3vPfnO5AYOEw2ZVD2lUG9KEQkiMiTQcZawMlO8cY6tzInnxY2jn7BFfJz4XVX85WNo3zdgQVI4Anp61lrKQ81_BJ0QNh_WA Oct 04 18:32:25.114840 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:32:25.114840 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:32:25.114840 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:32:25.114840 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:32:25.114840 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:32:25.114840 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:32:25.114840 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: 7694a80f5cd2481faf6ea92be8c51e4d Oct 04 18:32:25.114840 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1288969004 Oct 04 18:32:25.114840 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 18:32:25.114840 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 18:32:25.116423 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/7694a80f5cd2481faf6ea92be8c51e4d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_7694a80f5cd2481faf6ea92be8c51e4d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/7694a80f5cd2481faf6ea92be8c51e4d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/7694a80f5cd2481faf6ea92be8c51e4d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:32:25.116423 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1288969004 Oct 04 18:32:25.116423 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: 7694a80f5cd2481faf6ea92be8c51e4d Oct 04 18:32:25.116423 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1288969004 Oct 04 18:32:25.116423 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-AggregatesAdminNegativeTestJSON-1288969004-project Oct 04 18:32:25.116423 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:32:25.116423 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:32:25.116423 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 62a3cb8bb32a4bdbb7c360370697d9e0 Oct 04 18:32:25.116423 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1288969004-project Oct 04 18:32:25.116423 n-d-851028-13 devstack@n-api.service[123596]: Oct 04 18:32:25.116423 n-d-851028-13 devstack@n-api.service[123596]: {"remove_host": {"host": "n-h2-851028-13"}} Oct 04 18:32:25.116423 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 18:32:25.116423 n-d-851028-13 devstack@n-api.service[123596]: exception: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 04 18:32:25.117342 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': '17', 'body': {'remove_host': {'host': 'n-h2-851028-13'}}} Oct 04 18:32:25.117342 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:32:25.117342 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:25.117342 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:32:25.117342 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:32:25.117342 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:32:25.117342 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:32:25.117342 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:32:25.117342 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:32:25.117342 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:32:25.117342 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:32:25.117342 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 201, in _remove_host Oct 04 18:32:25.117342 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'remove_host', target={}) Oct 04 18:32:25.117342 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 18:32:25.117342 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 18:32:25.117342 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 18:32:25.117342 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 18:32:25.117342 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:32:25.117342 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:32:25.118757 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:32:25.118757 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:32:25.118757 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 18:32:25.118757 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 18:32:25.118757 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 18:32:25.118757 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 18:32:25.118757 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 18:32:25.118757 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 18:32:25.118757 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 04 18:32:25.118757 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:32:25.118757 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:25.118757 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:32:25.118757 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:25.118757 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:32:25.118757 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:32:25.118757 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 18:32:25.118757 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 18:32:25.118757 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 04 18:32:25.118757 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:32:25.121477 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-9a99074e-42d4-4416-bdd5-5a6b2ce9d1e6 tempest-AggregatesAdminNegativeTestJSON-1288969004 tempest-AggregatesAdminNegativeTestJSON-1288969004-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:32:25.122672 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-9a99074e-42d4-4416-bdd5-5a6b2ce9d1e6 tempest-AggregatesAdminNegativeTestJSON-1288969004 tempest-AggregatesAdminNegativeTestJSON-1288969004-project] 10.222.0.43 "POST /compute/v2.1/os-aggregates/17/action" status: 403 len: 121 microversion: 2.1 time: 0.023178 Oct 04 18:32:25.123737 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 198/379] 10.222.0.43 () {60 vars in 1194 bytes} [Tue Oct 4 18:32:25 2022] POST /compute/v2.1/os-aggregates/17/action => generated 121 bytes in 25 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:32:25.132682 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-990c19f9-b4db-407a-b57d-98a07f145b27 tempest-AggregatesAdminNegativeTestJSON-635194796 tempest-AggregatesAdminNegativeTestJSON-635194796-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-851028-13"}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:25.156972 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-990c19f9-b4db-407a-b57d-98a07f145b27 tempest-AggregatesAdminNegativeTestJSON-635194796 tempest-AggregatesAdminNegativeTestJSON-635194796-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:25.166222 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-990c19f9-b4db-407a-b57d-98a07f145b27 tempest-AggregatesAdminNegativeTestJSON-635194796 tempest-AggregatesAdminNegativeTestJSON-635194796-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:25.166995 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-990c19f9-b4db-407a-b57d-98a07f145b27 tempest-AggregatesAdminNegativeTestJSON-635194796 tempest-AggregatesAdminNegativeTestJSON-635194796-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:25.200736 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-e29a467a-9a00-49d2-8748-70181c8db860 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7db99f361654711bea7f1b2c404d312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7adedcdb9c3485ea2738c00e25aa3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:25.220523 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-e29a467a-9a00-49d2-8748-70181c8db860 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] 10.222.0.43 "GET /compute/v2.1/servers/640d917c-c9cb-4758-aa1d-216e34a55297" status: 200 len: 1289 microversion: 2.1 time: 0.305007 Oct 04 18:32:25.221431 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 182/380] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:24 2022] GET /compute/v2.1/servers/640d917c-c9cb-4758-aa1d-216e34a55297 => generated 1289 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:25.347809 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-d348a7cb-d5f3-42e1-9d64-cf1f98489a4e tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:25.350169 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-d348a7cb-d5f3-42e1-9d64-cf1f98489a4e tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] [instance: 606aebcb-2b6a-469f-a578-91325770ab4b] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:25.368233 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d348a7cb-d5f3-42e1-9d64-cf1f98489a4e tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:25.370400 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d348a7cb-d5f3-42e1-9d64-cf1f98489a4e tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:25.371603 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d348a7cb-d5f3-42e1-9d64-cf1f98489a4e tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:25.377500 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d348a7cb-d5f3-42e1-9d64-cf1f98489a4e tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:25.379920 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d348a7cb-d5f3-42e1-9d64-cf1f98489a4e tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:25.381459 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d348a7cb-d5f3-42e1-9d64-cf1f98489a4e tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:25.394732 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-990c19f9-b4db-407a-b57d-98a07f145b27 tempest-AggregatesAdminNegativeTestJSON-635194796 tempest-AggregatesAdminNegativeTestJSON-635194796-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 226 microversion: 2.1 time: 0.262721 Oct 04 18:32:25.397908 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 199/381] 10.222.0.43 () {60 vars in 1194 bytes} [Tue Oct 4 18:32:25 2022] POST /compute/v2.1/os-aggregates/17/action => generated 226 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:32:25.411881 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-b0306c09-4b43-4315-94c0-51e6fe6c89ba tempest-AggregatesAdminNegativeTestJSON-635194796 tempest-AggregatesAdminNegativeTestJSON-635194796-project-admin] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:25.471131 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-b0306c09-4b43-4315-94c0-51e6fe6c89ba tempest-AggregatesAdminNegativeTestJSON-635194796 tempest-AggregatesAdminNegativeTestJSON-635194796-project-admin] 10.222.0.43 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.064183 Oct 04 18:32:25.472175 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 200/382] 10.222.0.43 () {58 vars in 1155 bytes} [Tue Oct 4 18:32:25 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 18:32:25.486587 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-2dbd6c03-8ec2-449a-bbab-6e769bf8eb56 tempest-AggregatesAdminNegativeTestJSON-635194796 tempest-AggregatesAdminNegativeTestJSON-635194796-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1770451854"}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:25.494363 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.objects.aggregate [None req-2dbd6c03-8ec2-449a-bbab-6e769bf8eb56 tempest-AggregatesAdminNegativeTestJSON-635194796 tempest-AggregatesAdminNegativeTestJSON-635194796-project-admin] Generated uuid 0be4968d-1af0-4865-841b-48708bd96485 for aggregate {{(pid=123596) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 18:32:25.551548 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-2dbd6c03-8ec2-449a-bbab-6e769bf8eb56 tempest-AggregatesAdminNegativeTestJSON-635194796 tempest-AggregatesAdminNegativeTestJSON-635194796-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.072999 Oct 04 18:32:25.552829 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 201/383] 10.222.0.43 () {60 vars in 1164 bytes} [Tue Oct 4 18:32:25 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:32:25.572057 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-da7eaad2-c868-4c08-9f62-21bb8d2767b8 tempest-AggregatesAdminNegativeTestJSON-635194796 tempest-AggregatesAdminNegativeTestJSON-635194796-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:25.602255 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-da7eaad2-c868-4c08-9f62-21bb8d2767b8 tempest-AggregatesAdminNegativeTestJSON-635194796 tempest-AggregatesAdminNegativeTestJSON-635194796-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:25.602755 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-da7eaad2-c868-4c08-9f62-21bb8d2767b8 tempest-AggregatesAdminNegativeTestJSON-635194796 tempest-AggregatesAdminNegativeTestJSON-635194796-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:25.603199 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-da7eaad2-c868-4c08-9f62-21bb8d2767b8 tempest-AggregatesAdminNegativeTestJSON-635194796 tempest-AggregatesAdminNegativeTestJSON-635194796-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:25.622047 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-da7eaad2-c868-4c08-9f62-21bb8d2767b8 tempest-AggregatesAdminNegativeTestJSON-635194796 tempest-AggregatesAdminNegativeTestJSON-635194796-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:25.622468 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-da7eaad2-c868-4c08-9f62-21bb8d2767b8 tempest-AggregatesAdminNegativeTestJSON-635194796 tempest-AggregatesAdminNegativeTestJSON-635194796-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:25.622917 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-da7eaad2-c868-4c08-9f62-21bb8d2767b8 tempest-AggregatesAdminNegativeTestJSON-635194796 tempest-AggregatesAdminNegativeTestJSON-635194796-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:25.655980 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.compute.aggregates [None req-da7eaad2-c868-4c08-9f62-21bb8d2767b8 tempest-AggregatesAdminNegativeTestJSON-635194796 tempest-AggregatesAdminNegativeTestJSON-635194796-project-admin] Failed to remove host nonexist_host from aggregate 18. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Oct 04 18:32:25.655980 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-da7eaad2-c868-4c08-9f62-21bb8d2767b8 tempest-AggregatesAdminNegativeTestJSON-635194796 tempest-AggregatesAdminNegativeTestJSON-635194796-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 18 Oct 04 18:32:25.655980 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-da7eaad2-c868-4c08-9f62-21bb8d2767b8 tempest-AggregatesAdminNegativeTestJSON-635194796 tempest-AggregatesAdminNegativeTestJSON-635194796-project-admin] Request method failure captured: Oct 04 18:32:25.655980 n-d-851028-13 devstack@n-api.service[123596]: request: POST /compute/v2.1/os-aggregates/18/action HTTP/1.1 Oct 04 18:32:25.655980 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:32:25.655980 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:32:25.655980 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:32:25.655980 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 42 Oct 04 18:32:25.655980 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:32:25.655980 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:32:25.655980 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:32:25.655980 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:32:25.655980 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPHwyghqUch5OFDRJqqz8nEa33TeaPKuolXJF37XvIGGrBUnil9VLtRpwr8tXHQYd2YuLtGPymX_aVheJCMCI_4tGi1FGxwVHH3MQL3S2iFZNTSl0_Ki7FTyAAgkh9v_i1p_BuHy4MxeG0E3GwhW0NOSWqt9BhtXq7d-PfJXr9XH-CkQ Oct 04 18:32:25.655980 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:32:25.655980 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:32:25.655980 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:32:25.655980 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:32:25.655980 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:32:25.655980 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:32:25.655980 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: bce7a697f1cb43c2b64ff85b7add03b4 Oct 04 18:32:25.655980 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-635194796 Oct 04 18:32:25.655980 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,admin,reader Oct 04 18:32:25.655980 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,admin,reader Oct 04 18:32:25.658736 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/bce7a697f1cb43c2b64ff85b7add03b4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_bce7a697f1cb43c2b64ff85b7add03b4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/bce7a697f1cb43c2b64ff85b7add03b4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/bce7a697f1cb43c2b64ff85b7add03b4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:32:25.658736 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-635194796 Oct 04 18:32:25.658736 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: bce7a697f1cb43c2b64ff85b7add03b4 Oct 04 18:32:25.658736 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-635194796 Oct 04 18:32:25.658736 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-AggregatesAdminNegativeTestJSON-635194796-project-admin Oct 04 18:32:25.658736 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:32:25.658736 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:32:25.658736 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: fb2baff63b274646ac21f934327e4294 Oct 04 18:32:25.658736 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-635194796-project-admin Oct 04 18:32:25.658736 n-d-851028-13 devstack@n-api.service[123596]: Oct 04 18:32:25.658736 n-d-851028-13 devstack@n-api.service[123596]: {"remove_host": {"host": "nonexist_host"}} Oct 04 18:32:25.658736 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 18:32:25.658736 n-d-851028-13 devstack@n-api.service[123596]: exception: Cannot remove host nonexist_host in aggregate 18 Oct 04 18:32:25.659653 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': '18', 'body': {'remove_host': {'host': 'nonexist_host'}}} Oct 04 18:32:25.659653 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:32:25.659653 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:25.659653 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5999, in _get_service_in_cell_by_host Oct 04 18:32:25.659653 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 04 18:32:25.659653 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 18:32:25.659653 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 18:32:25.659653 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 04 18:32:25.659653 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 04 18:32:25.659653 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 18:32:25.659653 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 18:32:25.659653 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 04 18:32:25.659653 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 04 18:32:25.659653 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexist_host' is not mapped to any cell Oct 04 18:32:25.659653 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:32:25.659653 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:25.659653 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:32:25.659653 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:25.659653 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Oct 04 18:32:25.659653 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Oct 04 18:32:25.661512 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 04 18:32:25.661512 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 04 18:32:25.661512 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 04 18:32:25.661512 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:32:25.661512 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:25.661512 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:32:25.661512 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:25.661512 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 209, in _remove_host Oct 04 18:32:25.661512 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi aggregate = self.api.remove_host_from_aggregate(context, id, host) Oct 04 18:32:25.661512 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 04 18:32:25.661512 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 04 18:32:25.661512 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:32:25.661512 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:32:25.661512 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:32:25.661512 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:32:25.661512 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 04 18:32:25.661512 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 04 18:32:25.661512 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6683, in remove_host_from_aggregate Oct 04 18:32:25.661512 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi _get_service_in_cell_by_host(context, host_name) Oct 04 18:32:25.661512 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6007, in _get_service_in_cell_by_host Oct 04 18:32:25.663205 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Oct 04 18:32:25.663205 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Oct 04 18:32:25.663205 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:32:25.663205 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:25.663205 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:32:25.663205 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:25.663205 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:32:25.663205 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:32:25.663205 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:32:25.663205 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:32:25.663205 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:32:25.663205 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:32:25.663205 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:32:25.663205 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:32:25.663205 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 217, in _remove_host Oct 04 18:32:25.663205 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 04 18:32:25.663205 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Cannot remove host nonexist_host in aggregate 18 Oct 04 18:32:25.663205 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:32:25.663205 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:25.663205 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:32:25.663205 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:25.665256 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:32:25.665256 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:32:25.665256 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:32:25.665256 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:32:25.665256 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot remove host nonexist_host in aggregate 18 Oct 04 18:32:25.665256 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:32:25.665256 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-da7eaad2-c868-4c08-9f62-21bb8d2767b8 tempest-AggregatesAdminNegativeTestJSON-635194796 tempest-AggregatesAdminNegativeTestJSON-635194796-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 18 {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:32:25.665256 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-da7eaad2-c868-4c08-9f62-21bb8d2767b8 tempest-AggregatesAdminNegativeTestJSON-635194796 tempest-AggregatesAdminNegativeTestJSON-635194796-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates/18/action" status: 404 len: 94 microversion: 2.1 time: 0.092765 Oct 04 18:32:25.665256 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 202/384] 10.222.0.43 () {60 vars in 1194 bytes} [Tue Oct 4 18:32:25 2022] POST /compute/v2.1/os-aggregates/18/action => generated 94 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 04 18:32:25.665938 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-6bb34589-05d4-442b-a8f5-d73003c07adc tempest-AggregatesAdminNegativeTestJSON-635194796 tempest-AggregatesAdminNegativeTestJSON-635194796-project-admin] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:25.692617 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=10,nova_api:DELETE=13 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:32:25.704847 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-6bb34589-05d4-442b-a8f5-d73003c07adc tempest-AggregatesAdminNegativeTestJSON-635194796 tempest-AggregatesAdminNegativeTestJSON-635194796-project-admin] 10.222.0.43 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.1 time: 0.045128 Oct 04 18:32:25.708222 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 203/385] 10.222.0.43 () {58 vars in 1155 bytes} [Tue Oct 4 18:32:25 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Oct 04 18:32:25.715751 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-8e5adf67-90ad-4f39-a73e-54b2db3f6eac tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:25.716600 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-8e5adf67-90ad-4f39-a73e-54b2db3f6eac tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] [instance: b249a7cd-d1ee-4a74-a93d-9991ba84785f] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:25.723300 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8e5adf67-90ad-4f39-a73e-54b2db3f6eac tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:25.724025 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8e5adf67-90ad-4f39-a73e-54b2db3f6eac tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:25.724637 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8e5adf67-90ad-4f39-a73e-54b2db3f6eac tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:25.725588 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8e5adf67-90ad-4f39-a73e-54b2db3f6eac tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:25.726195 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8e5adf67-90ad-4f39-a73e-54b2db3f6eac tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:25.726772 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8e5adf67-90ad-4f39-a73e-54b2db3f6eac tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:25.762874 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8e5adf67-90ad-4f39-a73e-54b2db3f6eac tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:25.763551 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8e5adf67-90ad-4f39-a73e-54b2db3f6eac tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:25.764161 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8e5adf67-90ad-4f39-a73e-54b2db3f6eac tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:25.764802 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.objects.instance [None req-8e5adf67-90ad-4f39-a73e-54b2db3f6eac tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lazy-loading 'fault' on Instance uuid b249a7cd-d1ee-4a74-a93d-9991ba84785f {{(pid=123596) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:32:25.823705 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-8e5adf67-90ad-4f39-a73e-54b2db3f6eac tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '459e65f14af049bba311453d6a86360b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1753b9ee9a644e409a1efd0c9e7c152c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:25.834350 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-8e5adf67-90ad-4f39-a73e-54b2db3f6eac tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] 10.222.0.43 "GET /compute/v2.1/servers/b249a7cd-d1ee-4a74-a93d-9991ba84785f" status: 200 len: 1415 microversion: 2.1 time: 0.124065 Oct 04 18:32:25.835708 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 204/386] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:25 2022] GET /compute/v2.1/servers/b249a7cd-d1ee-4a74-a93d-9991ba84785f => generated 1415 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:25.859559 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-b57bd5c9-4365-4e9c-b116-acbbaa0533d9 req-d0b36b69-575e-435c-8538-7af00480bf0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b249a7cd-d1ee-4a74-a93d-9991ba84785f", "name": "network-vif-deleted", "tag": "cf5a1845-85d4-4127-adb0-9778baba06db"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:25.876012 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-b57bd5c9-4365-4e9c-b116-acbbaa0533d9 req-d0b36b69-575e-435c-8538-7af00480bf0c service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:25.876366 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-b57bd5c9-4365-4e9c-b116-acbbaa0533d9 req-d0b36b69-575e-435c-8538-7af00480bf0c service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:25.876804 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-b57bd5c9-4365-4e9c-b116-acbbaa0533d9 req-d0b36b69-575e-435c-8538-7af00480bf0c service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:25.889752 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-b57bd5c9-4365-4e9c-b116-acbbaa0533d9 req-d0b36b69-575e-435c-8538-7af00480bf0c service nova] Creating event network-vif-deleted:cf5a1845-85d4-4127-adb0-9778baba06db for instance b249a7cd-d1ee-4a74-a93d-9991ba84785f on n-h2-851028-13 Oct 04 18:32:25.895791 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-b57bd5c9-4365-4e9c-b116-acbbaa0533d9 req-d0b36b69-575e-435c-8538-7af00480bf0c service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058374 Oct 04 18:32:25.897554 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 205/387] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:32:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:32:25.936289 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-6389458b-8b56-409a-87fd-cf7621a0cf96 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:25.938005 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-6389458b-8b56-409a-87fd-cf7621a0cf96 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] [instance: 918d6106-9c7c-4046-9cdd-319afe4cdb25] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:25.946180 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6389458b-8b56-409a-87fd-cf7621a0cf96 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:25.947028 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6389458b-8b56-409a-87fd-cf7621a0cf96 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:25.948108 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6389458b-8b56-409a-87fd-cf7621a0cf96 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:25.949514 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6389458b-8b56-409a-87fd-cf7621a0cf96 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:25.950246 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6389458b-8b56-409a-87fd-cf7621a0cf96 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:25.950869 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6389458b-8b56-409a-87fd-cf7621a0cf96 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:26.023871 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-d348a7cb-d5f3-42e1-9d64-cf1f98489a4e tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f207a188e3fa4987b9fe4dd773ad03b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c636de1e6b42868f1f58e46fd4a3f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:26.030575 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-6389458b-8b56-409a-87fd-cf7621a0cf96 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb7b0ce49ec438f9a60b79bdb2ac164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94ae6e2cb75d410d8029aa49909c973b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:26.033333 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-d348a7cb-d5f3-42e1-9d64-cf1f98489a4e tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] 10.222.0.43 "GET /compute/v2.1/servers/606aebcb-2b6a-469f-a578-91325770ab4b" status: 200 len: 1332 microversion: 2.1 time: 0.690259 Oct 04 18:32:26.035570 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 183/388] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:25 2022] GET /compute/v2.1/servers/606aebcb-2b6a-469f-a578-91325770ab4b => generated 1332 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:32:26.050952 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-6389458b-8b56-409a-87fd-cf7621a0cf96 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] 10.222.0.43 "GET /compute/v2.1/servers/918d6106-9c7c-4046-9cdd-319afe4cdb25" status: 200 len: 1279 microversion: 2.1 time: 0.120807 Oct 04 18:32:26.051543 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 206/389] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:25 2022] GET /compute/v2.1/servers/918d6106-9c7c-4046-9cdd-319afe4cdb25 => generated 1279 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:26.248624 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-af2e95e3-7892-4f9e-abe9-8f29c19f7bc4 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:26.249794 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-af2e95e3-7892-4f9e-abe9-8f29c19f7bc4 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] [instance: 640d917c-c9cb-4758-aa1d-216e34a55297] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:26.261995 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-af2e95e3-7892-4f9e-abe9-8f29c19f7bc4 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:26.262876 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-af2e95e3-7892-4f9e-abe9-8f29c19f7bc4 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:26.263785 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-af2e95e3-7892-4f9e-abe9-8f29c19f7bc4 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:26.266982 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-af2e95e3-7892-4f9e-abe9-8f29c19f7bc4 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:26.267834 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-af2e95e3-7892-4f9e-abe9-8f29c19f7bc4 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:26.269147 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-af2e95e3-7892-4f9e-abe9-8f29c19f7bc4 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:26.361375 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-af2e95e3-7892-4f9e-abe9-8f29c19f7bc4 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7db99f361654711bea7f1b2c404d312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7adedcdb9c3485ea2738c00e25aa3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:26.378157 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-af2e95e3-7892-4f9e-abe9-8f29c19f7bc4 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] 10.222.0.43 "GET /compute/v2.1/servers/640d917c-c9cb-4758-aa1d-216e34a55297" status: 200 len: 1277 microversion: 2.1 time: 0.135704 Oct 04 18:32:26.380357 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 207/390] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:26 2022] GET /compute/v2.1/servers/640d917c-c9cb-4758-aa1d-216e34a55297 => generated 1277 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:32:26.612386 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-d777277f-cea0-4640-a4d0-1443fe7c2a9d tempest-InstanceUsageAuditLogTestJSON-61710832 tempest-InstanceUsageAuditLogTestJSON-61710832-project-admin] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:26.667223 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-d777277f-cea0-4640-a4d0-1443fe7c2a9d tempest-InstanceUsageAuditLogTestJSON-61710832 tempest-InstanceUsageAuditLogTestJSON-61710832-project-admin] 10.222.0.43 "GET /compute/v2.1/os-instance_usage_audit_log/2022-10-04 18:32:26" status: 200 len: 318 microversion: 2.1 time: 0.523404 Oct 04 18:32:26.668963 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 184/391] 10.222.0.43 () {58 vars in 1251 bytes} [Tue Oct 4 18:32:26 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-10-04%2018%3A32%3A26 => generated 318 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:32:26.687919 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-ca1b095d-08d9-4248-b93a-30fcc3911303 tempest-InstanceUsageAuditLogTestJSON-61710832 tempest-InstanceUsageAuditLogTestJSON-61710832-project-admin] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:26.740786 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-ca1b095d-08d9-4248-b93a-30fcc3911303 tempest-InstanceUsageAuditLogTestJSON-61710832 tempest-InstanceUsageAuditLogTestJSON-61710832-project-admin] 10.222.0.43 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.058306 Oct 04 18:32:26.744513 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 208/392] 10.222.0.43 () {58 vars in 1185 bytes} [Tue Oct 4 18:32:26 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:32:26.863255 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-4ee81928-9398-4cf8-bafa-fa22aa7c0f77 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:26.864239 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-4ee81928-9398-4cf8-bafa-fa22aa7c0f77 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] [instance: b249a7cd-d1ee-4a74-a93d-9991ba84785f] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:26.874536 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4ee81928-9398-4cf8-bafa-fa22aa7c0f77 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:26.875267 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-afd4bb0d-6690-4748-b369-164e4b8a9d90 tempest-HypervisorAdminV253TestBase-1748369341 tempest-HypervisorAdminV253TestBase-1748369341-project-admin] Calling method '.version_select at 0x7fb2244851f0>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:26.875654 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4ee81928-9398-4cf8-bafa-fa22aa7c0f77 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:26.876563 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4ee81928-9398-4cf8-bafa-fa22aa7c0f77 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:26.877535 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4ee81928-9398-4cf8-bafa-fa22aa7c0f77 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:26.878228 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4ee81928-9398-4cf8-bafa-fa22aa7c0f77 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:26.879230 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4ee81928-9398-4cf8-bafa-fa22aa7c0f77 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:26.880340 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-afd4bb0d-6690-4748-b369-164e4b8a9d90 tempest-HypervisorAdminV253TestBase-1748369341 tempest-HypervisorAdminV253TestBase-1748369341-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:26.881039 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-afd4bb0d-6690-4748-b369-164e4b8a9d90 tempest-HypervisorAdminV253TestBase-1748369341 tempest-HypervisorAdminV253TestBase-1748369341-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:26.881673 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-afd4bb0d-6690-4748-b369-164e4b8a9d90 tempest-HypervisorAdminV253TestBase-1748369341 tempest-HypervisorAdminV253TestBase-1748369341-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:26.907228 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-afd4bb0d-6690-4748-b369-164e4b8a9d90 tempest-HypervisorAdminV253TestBase-1748369341 tempest-HypervisorAdminV253TestBase-1748369341-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:26.908042 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-afd4bb0d-6690-4748-b369-164e4b8a9d90 tempest-HypervisorAdminV253TestBase-1748369341 tempest-HypervisorAdminV253TestBase-1748369341-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:26.908651 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-afd4bb0d-6690-4748-b369-164e4b8a9d90 tempest-HypervisorAdminV253TestBase-1748369341 tempest-HypervisorAdminV253TestBase-1748369341-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:26.930573 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4ee81928-9398-4cf8-bafa-fa22aa7c0f77 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:26.931212 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4ee81928-9398-4cf8-bafa-fa22aa7c0f77 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:26.932186 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4ee81928-9398-4cf8-bafa-fa22aa7c0f77 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:26.932970 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.objects.instance [None req-4ee81928-9398-4cf8-bafa-fa22aa7c0f77 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lazy-loading 'fault' on Instance uuid b249a7cd-d1ee-4a74-a93d-9991ba84785f {{(pid=123596) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:32:26.950436 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-afd4bb0d-6690-4748-b369-164e4b8a9d90 tempest-HypervisorAdminV253TestBase-1748369341 tempest-HypervisorAdminV253TestBase-1748369341-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:26.951442 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-afd4bb0d-6690-4748-b369-164e4b8a9d90 tempest-HypervisorAdminV253TestBase-1748369341 tempest-HypervisorAdminV253TestBase-1748369341-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:26.952055 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-afd4bb0d-6690-4748-b369-164e4b8a9d90 tempest-HypervisorAdminV253TestBase-1748369341 tempest-HypervisorAdminV253TestBase-1748369341-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:26.980895 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-afd4bb0d-6690-4748-b369-164e4b8a9d90 tempest-HypervisorAdminV253TestBase-1748369341 tempest-HypervisorAdminV253TestBase-1748369341-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:26.981854 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-afd4bb0d-6690-4748-b369-164e4b8a9d90 tempest-HypervisorAdminV253TestBase-1748369341 tempest-HypervisorAdminV253TestBase-1748369341-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:26.982483 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-afd4bb0d-6690-4748-b369-164e4b8a9d90 tempest-HypervisorAdminV253TestBase-1748369341 tempest-HypervisorAdminV253TestBase-1748369341-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:26.999227 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-4ee81928-9398-4cf8-bafa-fa22aa7c0f77 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '459e65f14af049bba311453d6a86360b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1753b9ee9a644e409a1efd0c9e7c152c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:27.006413 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:32:27.015566 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-4ee81928-9398-4cf8-bafa-fa22aa7c0f77 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] 10.222.0.43 "GET /compute/v2.1/servers/b249a7cd-d1ee-4a74-a93d-9991ba84785f" status: 200 len: 1309 microversion: 2.1 time: 0.157134 Oct 04 18:32:27.016782 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 209/393] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:26 2022] GET /compute/v2.1/servers/b249a7cd-d1ee-4a74-a93d-9991ba84785f => generated 1309 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:27.024528 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-afd4bb0d-6690-4748-b369-164e4b8a9d90 tempest-HypervisorAdminV253TestBase-1748369341 tempest-HypervisorAdminV253TestBase-1748369341-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:27.025076 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-afd4bb0d-6690-4748-b369-164e4b8a9d90 tempest-HypervisorAdminV253TestBase-1748369341 tempest-HypervisorAdminV253TestBase-1748369341-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:27.028716 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-afd4bb0d-6690-4748-b369-164e4b8a9d90 tempest-HypervisorAdminV253TestBase-1748369341 tempest-HypervisorAdminV253TestBase-1748369341-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:27.052565 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-afd4bb0d-6690-4748-b369-164e4b8a9d90 tempest-HypervisorAdminV253TestBase-1748369341 tempest-HypervisorAdminV253TestBase-1748369341-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 2314 microversion: 2.53 time: 0.274394 Oct 04 18:32:27.053544 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 185/394] 10.222.0.43 () {60 vars in 1243 bytes} [Tue Oct 4 18:32:26 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 2314 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:32:27.079127 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-b6211acf-ea66-4112-ad4f-4482890d5c5a tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:27.081014 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-b6211acf-ea66-4112-ad4f-4482890d5c5a tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] [instance: 606aebcb-2b6a-469f-a578-91325770ab4b] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:27.090621 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-95abc937-713c-4469-93d4-00b7ecbf1310 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:27.092008 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-95abc937-713c-4469-93d4-00b7ecbf1310 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] [instance: 918d6106-9c7c-4046-9cdd-319afe4cdb25] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:27.099965 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b6211acf-ea66-4112-ad4f-4482890d5c5a tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:27.101360 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b6211acf-ea66-4112-ad4f-4482890d5c5a tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:27.102493 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b6211acf-ea66-4112-ad4f-4482890d5c5a tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:27.104628 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b6211acf-ea66-4112-ad4f-4482890d5c5a tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:27.105795 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b6211acf-ea66-4112-ad4f-4482890d5c5a tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:27.107375 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b6211acf-ea66-4112-ad4f-4482890d5c5a tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:27.108546 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-95abc937-713c-4469-93d4-00b7ecbf1310 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:27.109404 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-95abc937-713c-4469-93d4-00b7ecbf1310 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:27.110163 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-95abc937-713c-4469-93d4-00b7ecbf1310 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:27.112499 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-95abc937-713c-4469-93d4-00b7ecbf1310 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:27.113922 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-95abc937-713c-4469-93d4-00b7ecbf1310 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:27.114873 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-95abc937-713c-4469-93d4-00b7ecbf1310 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:27.289351 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-95abc937-713c-4469-93d4-00b7ecbf1310 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb7b0ce49ec438f9a60b79bdb2ac164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94ae6e2cb75d410d8029aa49909c973b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:27.300747 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-95abc937-713c-4469-93d4-00b7ecbf1310 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] 10.222.0.43 "GET /compute/v2.1/servers/918d6106-9c7c-4046-9cdd-319afe4cdb25" status: 200 len: 1279 microversion: 2.1 time: 0.224976 Oct 04 18:32:27.315756 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-b6211acf-ea66-4112-ad4f-4482890d5c5a tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f207a188e3fa4987b9fe4dd773ad03b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c636de1e6b42868f1f58e46fd4a3f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:27.321658 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 186/395] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:27 2022] GET /compute/v2.1/servers/918d6106-9c7c-4046-9cdd-319afe4cdb25 => generated 1279 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:27.333528 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-b6211acf-ea66-4112-ad4f-4482890d5c5a tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] 10.222.0.43 "GET /compute/v2.1/servers/606aebcb-2b6a-469f-a578-91325770ab4b" status: 200 len: 1332 microversion: 2.1 time: 0.266321 Oct 04 18:32:27.334684 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 210/396] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:27 2022] GET /compute/v2.1/servers/606aebcb-2b6a-469f-a578-91325770ab4b => generated 1332 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:27.342508 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-bb16b651-8881-46f2-9ae3-a309f833433f tempest-HypervisorAdminV253TestBase-1748369341 tempest-HypervisorAdminV253TestBase-1748369341-project-admin] Calling method '.version_select at 0x7fb2244faee0>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:27.353271 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bb16b651-8881-46f2-9ae3-a309f833433f tempest-HypervisorAdminV253TestBase-1748369341 tempest-HypervisorAdminV253TestBase-1748369341-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:27.354155 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bb16b651-8881-46f2-9ae3-a309f833433f tempest-HypervisorAdminV253TestBase-1748369341 tempest-HypervisorAdminV253TestBase-1748369341-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:27.355058 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bb16b651-8881-46f2-9ae3-a309f833433f tempest-HypervisorAdminV253TestBase-1748369341 tempest-HypervisorAdminV253TestBase-1748369341-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:27.378264 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bb16b651-8881-46f2-9ae3-a309f833433f tempest-HypervisorAdminV253TestBase-1748369341 tempest-HypervisorAdminV253TestBase-1748369341-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:27.379024 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bb16b651-8881-46f2-9ae3-a309f833433f tempest-HypervisorAdminV253TestBase-1748369341 tempest-HypervisorAdminV253TestBase-1748369341-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:27.379669 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bb16b651-8881-46f2-9ae3-a309f833433f tempest-HypervisorAdminV253TestBase-1748369341 tempest-HypervisorAdminV253TestBase-1748369341-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:27.410974 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-75877578-713b-48ff-9123-b0e00362c780 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:27.411836 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-75877578-713b-48ff-9123-b0e00362c780 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] [instance: 640d917c-c9cb-4758-aa1d-216e34a55297] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:27.419029 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-75877578-713b-48ff-9123-b0e00362c780 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:27.420195 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-75877578-713b-48ff-9123-b0e00362c780 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:27.420815 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-75877578-713b-48ff-9123-b0e00362c780 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:27.421843 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-75877578-713b-48ff-9123-b0e00362c780 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:27.422462 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-75877578-713b-48ff-9123-b0e00362c780 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:27.423483 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-75877578-713b-48ff-9123-b0e00362c780 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:27.438727 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bb16b651-8881-46f2-9ae3-a309f833433f tempest-HypervisorAdminV253TestBase-1748369341 tempest-HypervisorAdminV253TestBase-1748369341-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:27.440227 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bb16b651-8881-46f2-9ae3-a309f833433f tempest-HypervisorAdminV253TestBase-1748369341 tempest-HypervisorAdminV253TestBase-1748369341-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:27.440893 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bb16b651-8881-46f2-9ae3-a309f833433f tempest-HypervisorAdminV253TestBase-1748369341 tempest-HypervisorAdminV253TestBase-1748369341-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:27.461413 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bb16b651-8881-46f2-9ae3-a309f833433f tempest-HypervisorAdminV253TestBase-1748369341 tempest-HypervisorAdminV253TestBase-1748369341-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:27.462149 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bb16b651-8881-46f2-9ae3-a309f833433f tempest-HypervisorAdminV253TestBase-1748369341 tempest-HypervisorAdminV253TestBase-1748369341-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:27.463362 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bb16b651-8881-46f2-9ae3-a309f833433f tempest-HypervisorAdminV253TestBase-1748369341 tempest-HypervisorAdminV253TestBase-1748369341-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:27.510508 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bb16b651-8881-46f2-9ae3-a309f833433f tempest-HypervisorAdminV253TestBase-1748369341 tempest-HypervisorAdminV253TestBase-1748369341-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:27.511052 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bb16b651-8881-46f2-9ae3-a309f833433f tempest-HypervisorAdminV253TestBase-1748369341 tempest-HypervisorAdminV253TestBase-1748369341-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:27.511472 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bb16b651-8881-46f2-9ae3-a309f833433f tempest-HypervisorAdminV253TestBase-1748369341 tempest-HypervisorAdminV253TestBase-1748369341-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:27.519842 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-bb16b651-8881-46f2-9ae3-a309f833433f tempest-HypervisorAdminV253TestBase-1748369341 tempest-HypervisorAdminV253TestBase-1748369341-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 1004 microversion: 2.53 time: 0.196450 Oct 04 18:32:27.520997 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 187/397] 10.222.0.43 () {60 vars in 1222 bytes} [Tue Oct 4 18:32:27 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 1004 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:32:27.534604 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-baf56c6b-c2ed-4a0f-9081-00f92b79ac99 tempest-HypervisorAdminV253TestBase-1748369341 tempest-HypervisorAdminV253TestBase-1748369341-project-admin] Calling method '.version_select at 0x7fb22448d820>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:27.540136 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-baf56c6b-c2ed-4a0f-9081-00f92b79ac99 tempest-HypervisorAdminV253TestBase-1748369341 tempest-HypervisorAdminV253TestBase-1748369341-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:27.540645 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-baf56c6b-c2ed-4a0f-9081-00f92b79ac99 tempest-HypervisorAdminV253TestBase-1748369341 tempest-HypervisorAdminV253TestBase-1748369341-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:27.541744 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-baf56c6b-c2ed-4a0f-9081-00f92b79ac99 tempest-HypervisorAdminV253TestBase-1748369341 tempest-HypervisorAdminV253TestBase-1748369341-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:27.580380 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-baf56c6b-c2ed-4a0f-9081-00f92b79ac99 tempest-HypervisorAdminV253TestBase-1748369341 tempest-HypervisorAdminV253TestBase-1748369341-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:27.580887 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-baf56c6b-c2ed-4a0f-9081-00f92b79ac99 tempest-HypervisorAdminV253TestBase-1748369341 tempest-HypervisorAdminV253TestBase-1748369341-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:27.581535 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-baf56c6b-c2ed-4a0f-9081-00f92b79ac99 tempest-HypervisorAdminV253TestBase-1748369341 tempest-HypervisorAdminV253TestBase-1748369341-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:27.588375 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-baf56c6b-c2ed-4a0f-9081-00f92b79ac99 tempest-HypervisorAdminV253TestBase-1748369341 tempest-HypervisorAdminV253TestBase-1748369341-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hypervisors/affa5ca8-bdd1-4268-8e96-bd7305ec50af" status: 200 len: 794 microversion: 2.53 time: 0.057900 Oct 04 18:32:27.589610 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 188/398] 10.222.0.43 () {60 vars in 1298 bytes} [Tue Oct 4 18:32:27 2022] GET /compute/v2.1/os-hypervisors/affa5ca8-bdd1-4268-8e96-bd7305ec50af => generated 794 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:32:27.623481 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-75877578-713b-48ff-9123-b0e00362c780 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7db99f361654711bea7f1b2c404d312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7adedcdb9c3485ea2738c00e25aa3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:27.638382 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-75877578-713b-48ff-9123-b0e00362c780 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] 10.222.0.43 "GET /compute/v2.1/servers/640d917c-c9cb-4758-aa1d-216e34a55297" status: 200 len: 1277 microversion: 2.1 time: 0.231079 Oct 04 18:32:27.646554 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 211/399] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:27 2022] GET /compute/v2.1/servers/640d917c-c9cb-4758-aa1d-216e34a55297 => generated 1277 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:32:28.039353 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-6d5d3cf8-7a7f-413a-90cf-e9e7b35ab5fd tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:28.040629 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-6d5d3cf8-7a7f-413a-90cf-e9e7b35ab5fd tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] [instance: b249a7cd-d1ee-4a74-a93d-9991ba84785f] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:28.066668 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6d5d3cf8-7a7f-413a-90cf-e9e7b35ab5fd tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:28.067515 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6d5d3cf8-7a7f-413a-90cf-e9e7b35ab5fd tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:28.068245 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6d5d3cf8-7a7f-413a-90cf-e9e7b35ab5fd tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:28.069328 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6d5d3cf8-7a7f-413a-90cf-e9e7b35ab5fd tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:28.069996 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6d5d3cf8-7a7f-413a-90cf-e9e7b35ab5fd tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:28.070587 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6d5d3cf8-7a7f-413a-90cf-e9e7b35ab5fd tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:28.090198 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-6d5d3cf8-7a7f-413a-90cf-e9e7b35ab5fd tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] HTTP exception thrown: Instance b249a7cd-d1ee-4a74-a93d-9991ba84785f could not be found. Oct 04 18:32:28.092080 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-6d5d3cf8-7a7f-413a-90cf-e9e7b35ab5fd tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Request method failure captured: Oct 04 18:32:28.092080 n-d-851028-13 devstack@n-api.service[123595]: request: GET /compute/v2.1/servers/b249a7cd-d1ee-4a74-a93d-9991ba84785f HTTP/1.1 Oct 04 18:32:28.092080 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 18:32:28.092080 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 18:32:28.092080 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 18:32:28.092080 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 0 Oct 04 18:32:28.092080 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 18:32:28.092080 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 18:32:28.092080 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 18:32:28.092080 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 18:32:28.092080 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPHvt3Y6rNVLSMdy9xAbvM1SwrzHCmiOroJJTfX2qOHmf77BMWdMfcNsjcH76qCiZQUjwzTPz2lfj1VfZRsPFlmxuLNjSVGxiKGgUEHY1S2tJ0UdIN5RuK_OrynSy71at-I0VBgCzGqOWM-CuMd25KoO0Uju4Ps6lF9ju13TEpSGJYdM Oct 04 18:32:28.092080 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 18:32:28.092080 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 18:32:28.092080 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 18:32:28.092080 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 18:32:28.092080 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 18:32:28.092080 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 18:32:28.092080 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: 1753b9ee9a644e409a1efd0c9e7c152c Oct 04 18:32:28.092080 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1925649271 Oct 04 18:32:28.092080 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 18:32:28.092080 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 18:32:28.093506 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/1753b9ee9a644e409a1efd0c9e7c152c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_1753b9ee9a644e409a1efd0c9e7c152c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1753b9ee9a644e409a1efd0c9e7c152c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1753b9ee9a644e409a1efd0c9e7c152c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:32:28.093506 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-DeleteServersAdminTestJSON-1925649271 Oct 04 18:32:28.093506 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: 1753b9ee9a644e409a1efd0c9e7c152c Oct 04 18:32:28.093506 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1925649271 Oct 04 18:32:28.093506 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-DeleteServersAdminTestJSON-1925649271-project Oct 04 18:32:28.093506 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 18:32:28.093506 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 18:32:28.093506 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: 459e65f14af049bba311453d6a86360b Oct 04 18:32:28.093506 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-DeleteServersAdminTestJSON-1925649271-project Oct 04 18:32:28.093506 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 18:32:28.093506 n-d-851028-13 devstack@n-api.service[123595]: exception: Instance b249a7cd-d1ee-4a74-a93d-9991ba84785f could not be found. Oct 04 18:32:28.093506 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': 'b249a7cd-d1ee-4a74-a93d-9991ba84785f'} Oct 04 18:32:28.094237 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:32:28.094237 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:28.094237 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:32:28.094237 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:32:28.094237 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:32:28.094237 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:32:28.094237 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:32:28.094237 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:32:28.094237 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:32:28.094237 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:32:28.094237 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b249a7cd-d1ee-4a74-a93d-9991ba84785f could not be found. Oct 04 18:32:28.094237 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:32:28.094237 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:28.094237 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:32:28.094237 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:28.094237 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:32:28.094237 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:32:28.094237 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:32:28.094237 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:32:28.094237 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:32:28.095338 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:32:28.095338 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:32:28.095338 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:32:28.095338 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:32:28.095338 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:32:28.095338 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:32:28.095338 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:32:28.095338 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b249a7cd-d1ee-4a74-a93d-9991ba84785f could not be found. Oct 04 18:32:28.095338 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:32:28.095338 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:28.095338 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:32:28.095338 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:28.095338 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:32:28.095338 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:32:28.095338 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:32:28.095338 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:32:28.095338 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b249a7cd-d1ee-4a74-a93d-9991ba84785f could not be found. Oct 04 18:32:28.095338 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:32:28.097624 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-6d5d3cf8-7a7f-413a-90cf-e9e7b35ab5fd tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Returning 404 to user: Instance b249a7cd-d1ee-4a74-a93d-9991ba84785f could not be found. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:32:28.099635 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-6d5d3cf8-7a7f-413a-90cf-e9e7b35ab5fd tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] 10.222.0.43 "GET /compute/v2.1/servers/b249a7cd-d1ee-4a74-a93d-9991ba84785f" status: 404 len: 111 microversion: 2.1 time: 0.064208 Oct 04 18:32:28.105723 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 189/400] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:28 2022] GET /compute/v2.1/servers/b249a7cd-d1ee-4a74-a93d-9991ba84785f => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:32:28.118088 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-ca688366-c6e2-467f-8122-3465f731cd96 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:28.119634 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-ca688366-c6e2-467f-8122-3465f731cd96 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] [instance: b249a7cd-d1ee-4a74-a93d-9991ba84785f] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:28.140110 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ca688366-c6e2-467f-8122-3465f731cd96 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:28.142271 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ca688366-c6e2-467f-8122-3465f731cd96 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:28.143019 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ca688366-c6e2-467f-8122-3465f731cd96 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:28.146221 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ca688366-c6e2-467f-8122-3465f731cd96 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:28.148020 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ca688366-c6e2-467f-8122-3465f731cd96 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:28.151191 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ca688366-c6e2-467f-8122-3465f731cd96 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:28.199317 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-ca688366-c6e2-467f-8122-3465f731cd96 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] HTTP exception thrown: Instance b249a7cd-d1ee-4a74-a93d-9991ba84785f could not be found. Oct 04 18:32:28.203402 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-ca688366-c6e2-467f-8122-3465f731cd96 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Request method failure captured: Oct 04 18:32:28.203402 n-d-851028-13 devstack@n-api.service[123596]: request: DELETE /compute/v2.1/servers/b249a7cd-d1ee-4a74-a93d-9991ba84785f HTTP/1.1 Oct 04 18:32:28.203402 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:32:28.203402 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:32:28.203402 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:32:28.203402 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 18:32:28.203402 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:32:28.203402 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:32:28.203402 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:32:28.203402 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:32:28.203402 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPHvt3Y6rNVLSMdy9xAbvM1SwrzHCmiOroJJTfX2qOHmf77BMWdMfcNsjcH76qCiZQUjwzTPz2lfj1VfZRsPFlmxuLNjSVGxiKGgUEHY1S2tJ0UdIN5RuK_OrynSy71at-I0VBgCzGqOWM-CuMd25KoO0Uju4Ps6lF9ju13TEpSGJYdM Oct 04 18:32:28.203402 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:32:28.203402 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:32:28.203402 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:32:28.203402 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:32:28.203402 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:32:28.203402 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:32:28.203402 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: 1753b9ee9a644e409a1efd0c9e7c152c Oct 04 18:32:28.203402 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1925649271 Oct 04 18:32:28.203402 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 18:32:28.203402 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 18:32:28.204892 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/1753b9ee9a644e409a1efd0c9e7c152c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_1753b9ee9a644e409a1efd0c9e7c152c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1753b9ee9a644e409a1efd0c9e7c152c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1753b9ee9a644e409a1efd0c9e7c152c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:32:28.204892 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-DeleteServersAdminTestJSON-1925649271 Oct 04 18:32:28.204892 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: 1753b9ee9a644e409a1efd0c9e7c152c Oct 04 18:32:28.204892 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1925649271 Oct 04 18:32:28.204892 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-DeleteServersAdminTestJSON-1925649271-project Oct 04 18:32:28.204892 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:32:28.204892 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:32:28.204892 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 459e65f14af049bba311453d6a86360b Oct 04 18:32:28.204892 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-DeleteServersAdminTestJSON-1925649271-project Oct 04 18:32:28.204892 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 18:32:28.204892 n-d-851028-13 devstack@n-api.service[123596]: exception: Instance b249a7cd-d1ee-4a74-a93d-9991ba84785f could not be found. Oct 04 18:32:28.204892 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': 'b249a7cd-d1ee-4a74-a93d-9991ba84785f'} Oct 04 18:32:28.205669 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:32:28.205669 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:28.205669 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:32:28.205669 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:32:28.205669 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:32:28.205669 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:32:28.205669 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:32:28.205669 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:32:28.205669 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:32:28.205669 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:32:28.205669 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b249a7cd-d1ee-4a74-a93d-9991ba84785f could not be found. Oct 04 18:32:28.205669 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:32:28.205669 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:28.205669 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:32:28.205669 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:28.205669 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:32:28.205669 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:32:28.205669 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:32:28.205669 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:32:28.205669 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:32:28.206776 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:32:28.206776 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:32:28.206776 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:32:28.206776 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:32:28.206776 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:32:28.206776 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:32:28.206776 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:32:28.206776 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:32:28.206776 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:32:28.206776 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b249a7cd-d1ee-4a74-a93d-9991ba84785f could not be found. Oct 04 18:32:28.206776 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:32:28.206776 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:28.206776 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:32:28.206776 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:28.206776 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:32:28.206776 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:32:28.206776 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:32:28.206776 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:32:28.206776 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b249a7cd-d1ee-4a74-a93d-9991ba84785f could not be found. Oct 04 18:32:28.206776 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:32:28.207875 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-ca688366-c6e2-467f-8122-3465f731cd96 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Returning 404 to user: Instance b249a7cd-d1ee-4a74-a93d-9991ba84785f could not be found. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:32:28.207875 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-ca688366-c6e2-467f-8122-3465f731cd96 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] 10.222.0.43 "DELETE /compute/v2.1/servers/b249a7cd-d1ee-4a74-a93d-9991ba84785f" status: 404 len: 111 microversion: 2.1 time: 0.097728 Oct 04 18:32:28.207875 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 212/401] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 18:32:28 2022] DELETE /compute/v2.1/servers/b249a7cd-d1ee-4a74-a93d-9991ba84785f => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:32:28.227867 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-b89abba9-321a-4eb0-8bbe-d15a9b81bfb2 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:28.228748 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-b89abba9-321a-4eb0-8bbe-d15a9b81bfb2 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] [instance: b249a7cd-d1ee-4a74-a93d-9991ba84785f] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:28.248047 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b89abba9-321a-4eb0-8bbe-d15a9b81bfb2 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:28.248841 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b89abba9-321a-4eb0-8bbe-d15a9b81bfb2 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:28.249581 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b89abba9-321a-4eb0-8bbe-d15a9b81bfb2 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:28.252601 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b89abba9-321a-4eb0-8bbe-d15a9b81bfb2 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:28.254494 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b89abba9-321a-4eb0-8bbe-d15a9b81bfb2 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:28.257563 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b89abba9-321a-4eb0-8bbe-d15a9b81bfb2 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:28.298650 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-b89abba9-321a-4eb0-8bbe-d15a9b81bfb2 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] HTTP exception thrown: Instance b249a7cd-d1ee-4a74-a93d-9991ba84785f could not be found. Oct 04 18:32:28.306199 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-b89abba9-321a-4eb0-8bbe-d15a9b81bfb2 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Request method failure captured: Oct 04 18:32:28.306199 n-d-851028-13 devstack@n-api.service[123595]: request: GET /compute/v2.1/servers/b249a7cd-d1ee-4a74-a93d-9991ba84785f HTTP/1.1 Oct 04 18:32:28.306199 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 18:32:28.306199 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 18:32:28.306199 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 18:32:28.306199 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 0 Oct 04 18:32:28.306199 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 18:32:28.306199 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 18:32:28.306199 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 18:32:28.306199 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 18:32:28.306199 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPHvt3Y6rNVLSMdy9xAbvM1SwrzHCmiOroJJTfX2qOHmf77BMWdMfcNsjcH76qCiZQUjwzTPz2lfj1VfZRsPFlmxuLNjSVGxiKGgUEHY1S2tJ0UdIN5RuK_OrynSy71at-I0VBgCzGqOWM-CuMd25KoO0Uju4Ps6lF9ju13TEpSGJYdM Oct 04 18:32:28.306199 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 18:32:28.306199 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 18:32:28.306199 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 18:32:28.306199 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 18:32:28.306199 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 18:32:28.306199 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 18:32:28.306199 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: 1753b9ee9a644e409a1efd0c9e7c152c Oct 04 18:32:28.306199 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1925649271 Oct 04 18:32:28.306199 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 18:32:28.306199 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 18:32:28.307946 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/1753b9ee9a644e409a1efd0c9e7c152c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_1753b9ee9a644e409a1efd0c9e7c152c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1753b9ee9a644e409a1efd0c9e7c152c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1753b9ee9a644e409a1efd0c9e7c152c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:32:28.307946 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-DeleteServersAdminTestJSON-1925649271 Oct 04 18:32:28.307946 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: 1753b9ee9a644e409a1efd0c9e7c152c Oct 04 18:32:28.307946 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1925649271 Oct 04 18:32:28.307946 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-DeleteServersAdminTestJSON-1925649271-project Oct 04 18:32:28.307946 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 18:32:28.307946 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 18:32:28.307946 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: 459e65f14af049bba311453d6a86360b Oct 04 18:32:28.307946 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-DeleteServersAdminTestJSON-1925649271-project Oct 04 18:32:28.307946 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 18:32:28.307946 n-d-851028-13 devstack@n-api.service[123595]: exception: Instance b249a7cd-d1ee-4a74-a93d-9991ba84785f could not be found. Oct 04 18:32:28.307946 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': 'b249a7cd-d1ee-4a74-a93d-9991ba84785f'} Oct 04 18:32:28.308779 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:32:28.308779 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:28.308779 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:32:28.308779 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:32:28.308779 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:32:28.308779 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:32:28.308779 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:32:28.308779 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:32:28.308779 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:32:28.308779 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:32:28.308779 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b249a7cd-d1ee-4a74-a93d-9991ba84785f could not be found. Oct 04 18:32:28.308779 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:32:28.308779 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:28.308779 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:32:28.308779 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:28.308779 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:32:28.308779 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:32:28.308779 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:32:28.308779 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:32:28.308779 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:32:28.310215 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:32:28.310215 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:32:28.310215 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:32:28.310215 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:32:28.310215 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:32:28.310215 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:32:28.310215 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:32:28.310215 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b249a7cd-d1ee-4a74-a93d-9991ba84785f could not be found. Oct 04 18:32:28.310215 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:32:28.310215 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:28.310215 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:32:28.310215 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:28.310215 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:32:28.310215 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:32:28.310215 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:32:28.310215 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:32:28.310215 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b249a7cd-d1ee-4a74-a93d-9991ba84785f could not be found. Oct 04 18:32:28.310215 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:32:28.331868 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-b89abba9-321a-4eb0-8bbe-d15a9b81bfb2 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Returning 404 to user: Instance b249a7cd-d1ee-4a74-a93d-9991ba84785f could not be found. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:32:28.332462 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-ae875b45-8971-4825-bfba-b95a0dc183b6 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:28.334369 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-ae875b45-8971-4825-bfba-b95a0dc183b6 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] [instance: 918d6106-9c7c-4046-9cdd-319afe4cdb25] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:28.336403 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-b89abba9-321a-4eb0-8bbe-d15a9b81bfb2 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] 10.222.0.43 "GET /compute/v2.1/servers/b249a7cd-d1ee-4a74-a93d-9991ba84785f" status: 404 len: 111 microversion: 2.1 time: 0.123266 Oct 04 18:32:28.345629 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 190/402] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:28 2022] GET /compute/v2.1/servers/b249a7cd-d1ee-4a74-a93d-9991ba84785f => generated 111 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:32:28.361626 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-fcd42107-706f-403e-a7e5-06366f557140 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:28.363965 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-fcd42107-706f-403e-a7e5-06366f557140 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] [instance: 968f1c40-0d51-403e-9609-8eb62b9060bb] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:28.365527 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ae875b45-8971-4825-bfba-b95a0dc183b6 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:28.368357 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ae875b45-8971-4825-bfba-b95a0dc183b6 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:28.370172 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ae875b45-8971-4825-bfba-b95a0dc183b6 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:28.371453 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ae875b45-8971-4825-bfba-b95a0dc183b6 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:28.379400 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ae875b45-8971-4825-bfba-b95a0dc183b6 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:28.379909 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fcd42107-706f-403e-a7e5-06366f557140 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:28.381609 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ae875b45-8971-4825-bfba-b95a0dc183b6 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:28.382707 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fcd42107-706f-403e-a7e5-06366f557140 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:28.383696 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fcd42107-706f-403e-a7e5-06366f557140 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:28.386105 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fcd42107-706f-403e-a7e5-06366f557140 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:28.387932 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fcd42107-706f-403e-a7e5-06366f557140 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:28.389359 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fcd42107-706f-403e-a7e5-06366f557140 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:28.430102 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-fcd42107-706f-403e-a7e5-06366f557140 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] HTTP exception thrown: Instance 968f1c40-0d51-403e-9609-8eb62b9060bb could not be found. Oct 04 18:32:28.436186 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-fcd42107-706f-403e-a7e5-06366f557140 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Request method failure captured: Oct 04 18:32:28.436186 n-d-851028-13 devstack@n-api.service[123595]: request: DELETE /compute/v2.1/servers/968f1c40-0d51-403e-9609-8eb62b9060bb HTTP/1.1 Oct 04 18:32:28.436186 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 18:32:28.436186 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 18:32:28.436186 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 18:32:28.436186 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 0 Oct 04 18:32:28.436186 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 18:32:28.436186 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 18:32:28.436186 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 18:32:28.436186 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 18:32:28.436186 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPHvt3Y6rNVLSMdy9xAbvM1SwrzHCmiOroJJTfX2qOHmf77BMWdMfcNsjcH76qCiZQUjwzTPz2lfj1VfZRsPFlmxuLNjSVGxiKGgUEHY1S2tJ0UdIN5RuK_OrynSy71at-I0VBgCzGqOWM-CuMd25KoO0Uju4Ps6lF9ju13TEpSGJYdM Oct 04 18:32:28.436186 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 18:32:28.436186 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 18:32:28.436186 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 18:32:28.436186 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 18:32:28.436186 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 18:32:28.436186 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 18:32:28.436186 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: 1753b9ee9a644e409a1efd0c9e7c152c Oct 04 18:32:28.436186 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1925649271 Oct 04 18:32:28.436186 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 18:32:28.436186 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 18:32:28.437485 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/1753b9ee9a644e409a1efd0c9e7c152c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_1753b9ee9a644e409a1efd0c9e7c152c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1753b9ee9a644e409a1efd0c9e7c152c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1753b9ee9a644e409a1efd0c9e7c152c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:32:28.437485 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-DeleteServersAdminTestJSON-1925649271 Oct 04 18:32:28.437485 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: 1753b9ee9a644e409a1efd0c9e7c152c Oct 04 18:32:28.437485 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1925649271 Oct 04 18:32:28.437485 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-DeleteServersAdminTestJSON-1925649271-project Oct 04 18:32:28.437485 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 18:32:28.437485 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 18:32:28.437485 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: 459e65f14af049bba311453d6a86360b Oct 04 18:32:28.437485 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-DeleteServersAdminTestJSON-1925649271-project Oct 04 18:32:28.437485 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 18:32:28.437485 n-d-851028-13 devstack@n-api.service[123595]: exception: Instance 968f1c40-0d51-403e-9609-8eb62b9060bb could not be found. Oct 04 18:32:28.437485 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': '968f1c40-0d51-403e-9609-8eb62b9060bb'} Oct 04 18:32:28.438148 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:32:28.438148 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:28.438148 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:32:28.438148 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:32:28.438148 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:32:28.438148 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:32:28.438148 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:32:28.438148 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:32:28.438148 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:32:28.438148 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:32:28.438148 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 968f1c40-0d51-403e-9609-8eb62b9060bb could not be found. Oct 04 18:32:28.438148 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:32:28.438148 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:28.438148 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:32:28.438148 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:28.438148 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:32:28.438148 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:32:28.438148 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:32:28.438148 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:32:28.438148 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:32:28.439319 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:32:28.439319 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:32:28.439319 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:32:28.439319 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:32:28.439319 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:32:28.439319 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:32:28.439319 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:32:28.439319 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:32:28.439319 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:32:28.439319 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 968f1c40-0d51-403e-9609-8eb62b9060bb could not be found. Oct 04 18:32:28.439319 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:32:28.439319 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:28.439319 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:32:28.439319 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:28.439319 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:32:28.439319 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:32:28.439319 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:32:28.439319 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:32:28.439319 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 968f1c40-0d51-403e-9609-8eb62b9060bb could not be found. Oct 04 18:32:28.439319 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:32:28.442958 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-fcd42107-706f-403e-a7e5-06366f557140 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Returning 404 to user: Instance 968f1c40-0d51-403e-9609-8eb62b9060bb could not be found. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:32:28.444676 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-fcd42107-706f-403e-a7e5-06366f557140 tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] 10.222.0.43 "DELETE /compute/v2.1/servers/968f1c40-0d51-403e-9609-8eb62b9060bb" status: 404 len: 111 microversion: 2.1 time: 0.096640 Oct 04 18:32:28.452692 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 191/403] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 18:32:28 2022] DELETE /compute/v2.1/servers/968f1c40-0d51-403e-9609-8eb62b9060bb => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:32:28.460007 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-c04c3793-2005-4e5b-a682-a21ae891ee4f tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:28.463563 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-c04c3793-2005-4e5b-a682-a21ae891ee4f tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] [instance: 606aebcb-2b6a-469f-a578-91325770ab4b] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:28.479240 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c04c3793-2005-4e5b-a682-a21ae891ee4f tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:28.481720 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c04c3793-2005-4e5b-a682-a21ae891ee4f tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:28.485767 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c04c3793-2005-4e5b-a682-a21ae891ee4f tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:28.486765 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c04c3793-2005-4e5b-a682-a21ae891ee4f tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:28.491797 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c04c3793-2005-4e5b-a682-a21ae891ee4f tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:28.492554 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c04c3793-2005-4e5b-a682-a21ae891ee4f tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:28.501337 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=100 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:32:28.737866 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-ae875b45-8971-4825-bfba-b95a0dc183b6 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb7b0ce49ec438f9a60b79bdb2ac164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94ae6e2cb75d410d8029aa49909c973b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:28.748972 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-ae875b45-8971-4825-bfba-b95a0dc183b6 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] 10.222.0.43 "GET /compute/v2.1/servers/918d6106-9c7c-4046-9cdd-319afe4cdb25" status: 200 len: 1321 microversion: 2.1 time: 0.422669 Oct 04 18:32:28.750271 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 213/404] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:28 2022] GET /compute/v2.1/servers/918d6106-9c7c-4046-9cdd-319afe4cdb25 => generated 1321 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:28.769267 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-26818f65-a9b7-4a2b-af3b-09b69ba8aa4d tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:28.770276 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-26818f65-a9b7-4a2b-af3b-09b69ba8aa4d tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] [instance: 968f1c40-0d51-403e-9609-8eb62b9060bb] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:28.779788 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-26818f65-a9b7-4a2b-af3b-09b69ba8aa4d tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:28.782250 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-26818f65-a9b7-4a2b-af3b-09b69ba8aa4d tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:28.784463 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-26818f65-a9b7-4a2b-af3b-09b69ba8aa4d tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:28.787289 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-26818f65-a9b7-4a2b-af3b-09b69ba8aa4d tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:28.788720 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-26818f65-a9b7-4a2b-af3b-09b69ba8aa4d tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:28.789485 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-26818f65-a9b7-4a2b-af3b-09b69ba8aa4d tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:28.813449 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-26818f65-a9b7-4a2b-af3b-09b69ba8aa4d tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] HTTP exception thrown: Instance 968f1c40-0d51-403e-9609-8eb62b9060bb could not be found. Oct 04 18:32:28.815269 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-26818f65-a9b7-4a2b-af3b-09b69ba8aa4d tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Request method failure captured: Oct 04 18:32:28.815269 n-d-851028-13 devstack@n-api.service[123596]: request: GET /compute/v2.1/servers/968f1c40-0d51-403e-9609-8eb62b9060bb HTTP/1.1 Oct 04 18:32:28.815269 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:32:28.815269 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:32:28.815269 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:32:28.815269 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 18:32:28.815269 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:32:28.815269 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:32:28.815269 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:32:28.815269 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:32:28.815269 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPHvt3Y6rNVLSMdy9xAbvM1SwrzHCmiOroJJTfX2qOHmf77BMWdMfcNsjcH76qCiZQUjwzTPz2lfj1VfZRsPFlmxuLNjSVGxiKGgUEHY1S2tJ0UdIN5RuK_OrynSy71at-I0VBgCzGqOWM-CuMd25KoO0Uju4Ps6lF9ju13TEpSGJYdM Oct 04 18:32:28.815269 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:32:28.815269 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:32:28.815269 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:32:28.815269 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:32:28.815269 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:32:28.815269 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:32:28.815269 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: 1753b9ee9a644e409a1efd0c9e7c152c Oct 04 18:32:28.815269 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1925649271 Oct 04 18:32:28.815269 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 18:32:28.815269 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 18:32:28.816791 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/1753b9ee9a644e409a1efd0c9e7c152c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_1753b9ee9a644e409a1efd0c9e7c152c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1753b9ee9a644e409a1efd0c9e7c152c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1753b9ee9a644e409a1efd0c9e7c152c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:32:28.816791 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-DeleteServersAdminTestJSON-1925649271 Oct 04 18:32:28.816791 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: 1753b9ee9a644e409a1efd0c9e7c152c Oct 04 18:32:28.816791 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1925649271 Oct 04 18:32:28.816791 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-DeleteServersAdminTestJSON-1925649271-project Oct 04 18:32:28.816791 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:32:28.816791 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:32:28.816791 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 459e65f14af049bba311453d6a86360b Oct 04 18:32:28.816791 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-DeleteServersAdminTestJSON-1925649271-project Oct 04 18:32:28.816791 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 18:32:28.816791 n-d-851028-13 devstack@n-api.service[123596]: exception: Instance 968f1c40-0d51-403e-9609-8eb62b9060bb could not be found. Oct 04 18:32:28.816791 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': '968f1c40-0d51-403e-9609-8eb62b9060bb'} Oct 04 18:32:28.817795 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:32:28.817795 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:28.817795 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:32:28.817795 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:32:28.817795 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:32:28.817795 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:32:28.817795 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:32:28.817795 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:32:28.817795 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:32:28.817795 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:32:28.817795 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 968f1c40-0d51-403e-9609-8eb62b9060bb could not be found. Oct 04 18:32:28.817795 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:32:28.817795 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:28.817795 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:32:28.817795 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:28.817795 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:32:28.817795 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:32:28.817795 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:32:28.817795 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:32:28.817795 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:32:28.819002 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:32:28.819002 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:32:28.819002 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:32:28.819002 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:32:28.819002 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:32:28.819002 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:32:28.819002 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:32:28.819002 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 968f1c40-0d51-403e-9609-8eb62b9060bb could not be found. Oct 04 18:32:28.819002 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:32:28.819002 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:28.819002 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:32:28.819002 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:28.819002 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:32:28.819002 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:32:28.819002 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:32:28.819002 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:32:28.819002 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 968f1c40-0d51-403e-9609-8eb62b9060bb could not be found. Oct 04 18:32:28.819002 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:32:28.823025 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-26818f65-a9b7-4a2b-af3b-09b69ba8aa4d tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] Returning 404 to user: Instance 968f1c40-0d51-403e-9609-8eb62b9060bb could not be found. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:32:28.824150 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-26818f65-a9b7-4a2b-af3b-09b69ba8aa4d tempest-DeleteServersAdminTestJSON-1925649271 tempest-DeleteServersAdminTestJSON-1925649271-project] 10.222.0.43 "GET /compute/v2.1/servers/968f1c40-0d51-403e-9609-8eb62b9060bb" status: 404 len: 111 microversion: 2.1 time: 0.072556 Oct 04 18:32:28.825264 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 214/405] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:28 2022] GET /compute/v2.1/servers/968f1c40-0d51-403e-9609-8eb62b9060bb => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:32:28.855579 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-9b6f2ba5-fb4b-479c-ad55-4053107cd326 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:28.858764 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-9b6f2ba5-fb4b-479c-ad55-4053107cd326 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] [instance: 640d917c-c9cb-4758-aa1d-216e34a55297] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:28.875384 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9b6f2ba5-fb4b-479c-ad55-4053107cd326 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:28.876199 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9b6f2ba5-fb4b-479c-ad55-4053107cd326 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:28.877199 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9b6f2ba5-fb4b-479c-ad55-4053107cd326 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:28.879659 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9b6f2ba5-fb4b-479c-ad55-4053107cd326 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:28.880545 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9b6f2ba5-fb4b-479c-ad55-4053107cd326 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:28.881544 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9b6f2ba5-fb4b-479c-ad55-4053107cd326 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:28.985277 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-9b6f2ba5-fb4b-479c-ad55-4053107cd326 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7db99f361654711bea7f1b2c404d312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7adedcdb9c3485ea2738c00e25aa3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:28.997808 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-9b6f2ba5-fb4b-479c-ad55-4053107cd326 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] 10.222.0.43 "GET /compute/v2.1/servers/640d917c-c9cb-4758-aa1d-216e34a55297" status: 200 len: 1277 microversion: 2.1 time: 0.170347 Oct 04 18:32:29.013474 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-c04c3793-2005-4e5b-a682-a21ae891ee4f tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f207a188e3fa4987b9fe4dd773ad03b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c636de1e6b42868f1f58e46fd4a3f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:29.016632 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 215/406] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:28 2022] GET /compute/v2.1/servers/640d917c-c9cb-4758-aa1d-216e34a55297 => generated 1277 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:29.022637 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-c04c3793-2005-4e5b-a682-a21ae891ee4f tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] 10.222.0.43 "GET /compute/v2.1/servers/606aebcb-2b6a-469f-a578-91325770ab4b" status: 200 len: 1332 microversion: 2.1 time: 0.568133 Oct 04 18:32:29.043277 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 192/407] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:28 2022] GET /compute/v2.1/servers/606aebcb-2b6a-469f-a578-91325770ab4b => generated 1332 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:29.771887 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-bf08b903-28da-4737-8405-2e51867d255c tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:29.772500 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-bf08b903-28da-4737-8405-2e51867d255c tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] [instance: 918d6106-9c7c-4046-9cdd-319afe4cdb25] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:29.781653 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bf08b903-28da-4737-8405-2e51867d255c tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:29.785900 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bf08b903-28da-4737-8405-2e51867d255c tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:29.790485 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bf08b903-28da-4737-8405-2e51867d255c tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:29.792026 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bf08b903-28da-4737-8405-2e51867d255c tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:29.792662 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bf08b903-28da-4737-8405-2e51867d255c tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:29.793284 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bf08b903-28da-4737-8405-2e51867d255c tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:30.024584 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-bb688142-010c-473a-a4c9-c23685b2bdea tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:30.025813 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-bb688142-010c-473a-a4c9-c23685b2bdea tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] [instance: 640d917c-c9cb-4758-aa1d-216e34a55297] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:30.036629 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bb688142-010c-473a-a4c9-c23685b2bdea tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:30.037502 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bb688142-010c-473a-a4c9-c23685b2bdea tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:30.038291 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bb688142-010c-473a-a4c9-c23685b2bdea tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:30.049080 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-bf08b903-28da-4737-8405-2e51867d255c tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb7b0ce49ec438f9a60b79bdb2ac164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94ae6e2cb75d410d8029aa49909c973b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:30.060093 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-bf08b903-28da-4737-8405-2e51867d255c tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] 10.222.0.43 "GET /compute/v2.1/servers/918d6106-9c7c-4046-9cdd-319afe4cdb25" status: 200 len: 1321 microversion: 2.1 time: 0.291973 Oct 04 18:32:30.060733 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 216/408] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:29 2022] GET /compute/v2.1/servers/918d6106-9c7c-4046-9cdd-319afe4cdb25 => generated 1321 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:32:30.062275 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bb688142-010c-473a-a4c9-c23685b2bdea tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:30.062806 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bb688142-010c-473a-a4c9-c23685b2bdea tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:30.066133 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bb688142-010c-473a-a4c9-c23685b2bdea tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:30.078493 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-d126f9f5-8b86-4f40-93d3-7ef9a3693c9e tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:30.090650 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-d126f9f5-8b86-4f40-93d3-7ef9a3693c9e tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] [instance: 606aebcb-2b6a-469f-a578-91325770ab4b] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:30.117201 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d126f9f5-8b86-4f40-93d3-7ef9a3693c9e tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:30.117929 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d126f9f5-8b86-4f40-93d3-7ef9a3693c9e tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:30.118563 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d126f9f5-8b86-4f40-93d3-7ef9a3693c9e tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:30.121479 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d126f9f5-8b86-4f40-93d3-7ef9a3693c9e tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:30.124636 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d126f9f5-8b86-4f40-93d3-7ef9a3693c9e tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:30.126020 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d126f9f5-8b86-4f40-93d3-7ef9a3693c9e tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:30.427115 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-d126f9f5-8b86-4f40-93d3-7ef9a3693c9e tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f207a188e3fa4987b9fe4dd773ad03b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c636de1e6b42868f1f58e46fd4a3f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:30.436953 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-d126f9f5-8b86-4f40-93d3-7ef9a3693c9e tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] 10.222.0.43 "GET /compute/v2.1/servers/606aebcb-2b6a-469f-a578-91325770ab4b" status: 200 len: 1332 microversion: 2.1 time: 0.364783 Oct 04 18:32:30.441632 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 217/409] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:30 2022] GET /compute/v2.1/servers/606aebcb-2b6a-469f-a578-91325770ab4b => generated 1332 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:31.033508 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-bb688142-010c-473a-a4c9-c23685b2bdea tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7db99f361654711bea7f1b2c404d312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7adedcdb9c3485ea2738c00e25aa3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:31.065894 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-bb688142-010c-473a-a4c9-c23685b2bdea tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] 10.222.0.43 "GET /compute/v2.1/servers/640d917c-c9cb-4758-aa1d-216e34a55297" status: 200 len: 1319 microversion: 2.1 time: 1.046112 Oct 04 18:32:31.085179 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 193/410] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:30 2022] GET /compute/v2.1/servers/640d917c-c9cb-4758-aa1d-216e34a55297 => generated 1319 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:31.092583 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-4091a0b5-a3f1-4975-bab5-de1136cf1d74 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:31.093443 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-4091a0b5-a3f1-4975-bab5-de1136cf1d74 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] [instance: 918d6106-9c7c-4046-9cdd-319afe4cdb25] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:31.107189 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4091a0b5-a3f1-4975-bab5-de1136cf1d74 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:31.107770 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4091a0b5-a3f1-4975-bab5-de1136cf1d74 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:31.108203 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4091a0b5-a3f1-4975-bab5-de1136cf1d74 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:31.109165 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4091a0b5-a3f1-4975-bab5-de1136cf1d74 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:31.109794 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4091a0b5-a3f1-4975-bab5-de1136cf1d74 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:31.110821 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4091a0b5-a3f1-4975-bab5-de1136cf1d74 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:31.323021 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-7773991c-e292-4ab1-b34f-6e73dffc9323 req-3fce2747-f94b-41e7-bd40-b26056529b1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "606aebcb-2b6a-469f-a578-91325770ab4b", "name": "network-vif-plugged", "status": "completed", "tag": "101c6584-c112-496c-8a18-4440b7f3aec5"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:31.354597 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-7773991c-e292-4ab1-b34f-6e73dffc9323 req-3fce2747-f94b-41e7-bd40-b26056529b1e service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:31.355069 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-7773991c-e292-4ab1-b34f-6e73dffc9323 req-3fce2747-f94b-41e7-bd40-b26056529b1e service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:31.355499 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-7773991c-e292-4ab1-b34f-6e73dffc9323 req-3fce2747-f94b-41e7-bd40-b26056529b1e service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:31.382494 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-7773991c-e292-4ab1-b34f-6e73dffc9323 req-3fce2747-f94b-41e7-bd40-b26056529b1e service nova] Creating event network-vif-plugged:101c6584-c112-496c-8a18-4440b7f3aec5 for instance 606aebcb-2b6a-469f-a578-91325770ab4b on n-h2-851028-13 Oct 04 18:32:31.393662 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-7773991c-e292-4ab1-b34f-6e73dffc9323 req-3fce2747-f94b-41e7-bd40-b26056529b1e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075439 Oct 04 18:32:31.398907 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 194/411] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:32:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:32:31.466396 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-a7969b51-89dc-4f05-a4c4-a427f5a09e21 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:31.467464 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-a7969b51-89dc-4f05-a4c4-a427f5a09e21 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] [instance: 606aebcb-2b6a-469f-a578-91325770ab4b] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:31.479160 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a7969b51-89dc-4f05-a4c4-a427f5a09e21 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:31.481965 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a7969b51-89dc-4f05-a4c4-a427f5a09e21 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:31.482774 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a7969b51-89dc-4f05-a4c4-a427f5a09e21 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:31.485608 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a7969b51-89dc-4f05-a4c4-a427f5a09e21 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:31.486435 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a7969b51-89dc-4f05-a4c4-a427f5a09e21 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:31.488683 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a7969b51-89dc-4f05-a4c4-a427f5a09e21 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:31.630519 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-4091a0b5-a3f1-4975-bab5-de1136cf1d74 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb7b0ce49ec438f9a60b79bdb2ac164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94ae6e2cb75d410d8029aa49909c973b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:31.639982 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-4091a0b5-a3f1-4975-bab5-de1136cf1d74 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] 10.222.0.43 "GET /compute/v2.1/servers/918d6106-9c7c-4046-9cdd-319afe4cdb25" status: 200 len: 1321 microversion: 2.1 time: 0.552062 Oct 04 18:32:31.644907 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 218/412] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:31 2022] GET /compute/v2.1/servers/918d6106-9c7c-4046-9cdd-319afe4cdb25 => generated 1321 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:32.013510 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-a7969b51-89dc-4f05-a4c4-a427f5a09e21 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f207a188e3fa4987b9fe4dd773ad03b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c636de1e6b42868f1f58e46fd4a3f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:32.031871 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-81361acc-cab5-49ac-a002-ab916f960067 req-331f9c76-102f-491f-ba78-4726dd4d24a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "918d6106-9c7c-4046-9cdd-319afe4cdb25", "tag": "bc88b509-77d8-4be9-9d0b-1aa4318894e1"}, {"name": "network-changed", "server_uuid": "6251d93c-aab7-43cc-9be0-212545cf2b01", "tag": "f0f8a0e7-af5c-4b16-b5ab-dac6dfca0427"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:32.041576 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-a7969b51-89dc-4f05-a4c4-a427f5a09e21 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] 10.222.0.43 "GET /compute/v2.1/servers/606aebcb-2b6a-469f-a578-91325770ab4b" status: 200 len: 1332 microversion: 2.1 time: 0.579087 Oct 04 18:32:32.044083 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 195/413] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:31 2022] GET /compute/v2.1/servers/606aebcb-2b6a-469f-a578-91325770ab4b => generated 1332 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:32.048435 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-81361acc-cab5-49ac-a002-ab916f960067 req-331f9c76-102f-491f-ba78-4726dd4d24a3 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:32.049267 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-81361acc-cab5-49ac-a002-ab916f960067 req-331f9c76-102f-491f-ba78-4726dd4d24a3 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:32.050190 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-81361acc-cab5-49ac-a002-ab916f960067 req-331f9c76-102f-491f-ba78-4726dd4d24a3 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:32.082486 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-81361acc-cab5-49ac-a002-ab916f960067 req-331f9c76-102f-491f-ba78-4726dd4d24a3 service nova] Creating event network-changed:bc88b509-77d8-4be9-9d0b-1aa4318894e1 for instance 918d6106-9c7c-4046-9cdd-319afe4cdb25 on n-h1-851028-13 Oct 04 18:32:32.083974 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-81361acc-cab5-49ac-a002-ab916f960067 req-331f9c76-102f-491f-ba78-4726dd4d24a3 service nova] Creating event network-changed:f0f8a0e7-af5c-4b16-b5ab-dac6dfca0427 for instance 6251d93c-aab7-43cc-9be0-212545cf2b01 on n-h1-851028-13 Oct 04 18:32:32.096769 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-82aaf51d-f956-47f0-bd01-e803b7b3e8d1 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:32.098353 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-82aaf51d-f956-47f0-bd01-e803b7b3e8d1 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] [instance: 640d917c-c9cb-4758-aa1d-216e34a55297] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:32.110827 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-82aaf51d-f956-47f0-bd01-e803b7b3e8d1 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:32.114614 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-81361acc-cab5-49ac-a002-ab916f960067 req-331f9c76-102f-491f-ba78-4726dd4d24a3 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.086491 Oct 04 18:32:32.116007 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-82aaf51d-f956-47f0-bd01-e803b7b3e8d1 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:32.117305 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-82aaf51d-f956-47f0-bd01-e803b7b3e8d1 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:32.119419 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-82aaf51d-f956-47f0-bd01-e803b7b3e8d1 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:32.119895 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 219/414] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:32:32 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:32:32.126143 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-82aaf51d-f956-47f0-bd01-e803b7b3e8d1 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:32.127065 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-82aaf51d-f956-47f0-bd01-e803b7b3e8d1 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:32.668962 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-2d59bc3d-5e52-43d6-851b-6bbfd4e1fa02 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:32.670070 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-2d59bc3d-5e52-43d6-851b-6bbfd4e1fa02 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] [instance: 918d6106-9c7c-4046-9cdd-319afe4cdb25] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:32.677026 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2d59bc3d-5e52-43d6-851b-6bbfd4e1fa02 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:32.677839 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2d59bc3d-5e52-43d6-851b-6bbfd4e1fa02 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:32.678597 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2d59bc3d-5e52-43d6-851b-6bbfd4e1fa02 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:32.679677 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2d59bc3d-5e52-43d6-851b-6bbfd4e1fa02 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:32.680391 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2d59bc3d-5e52-43d6-851b-6bbfd4e1fa02 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:32.681752 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2d59bc3d-5e52-43d6-851b-6bbfd4e1fa02 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:32.848863 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-82aaf51d-f956-47f0-bd01-e803b7b3e8d1 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7db99f361654711bea7f1b2c404d312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7adedcdb9c3485ea2738c00e25aa3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:32.863254 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-82aaf51d-f956-47f0-bd01-e803b7b3e8d1 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] 10.222.0.43 "GET /compute/v2.1/servers/640d917c-c9cb-4758-aa1d-216e34a55297" status: 200 len: 1319 microversion: 2.1 time: 0.772817 Oct 04 18:32:32.873141 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 196/415] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:32 2022] GET /compute/v2.1/servers/640d917c-c9cb-4758-aa1d-216e34a55297 => generated 1319 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:32:32.893727 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-2d59bc3d-5e52-43d6-851b-6bbfd4e1fa02 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb7b0ce49ec438f9a60b79bdb2ac164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94ae6e2cb75d410d8029aa49909c973b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:32.908695 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-2d59bc3d-5e52-43d6-851b-6bbfd4e1fa02 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] 10.222.0.43 "GET /compute/v2.1/servers/918d6106-9c7c-4046-9cdd-319afe4cdb25" status: 200 len: 1321 microversion: 2.1 time: 0.243994 Oct 04 18:32:32.909572 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 220/416] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:32 2022] GET /compute/v2.1/servers/918d6106-9c7c-4046-9cdd-319afe4cdb25 => generated 1321 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:32:33.070113 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-22232eab-44fd-4d96-b510-aa72c7f72363 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:33.071456 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-22232eab-44fd-4d96-b510-aa72c7f72363 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] [instance: 606aebcb-2b6a-469f-a578-91325770ab4b] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:33.079445 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-22232eab-44fd-4d96-b510-aa72c7f72363 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:33.079944 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-22232eab-44fd-4d96-b510-aa72c7f72363 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:33.080387 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-22232eab-44fd-4d96-b510-aa72c7f72363 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:33.081103 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-22232eab-44fd-4d96-b510-aa72c7f72363 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:33.081599 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-22232eab-44fd-4d96-b510-aa72c7f72363 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:33.082035 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-22232eab-44fd-4d96-b510-aa72c7f72363 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:33.089191 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=3 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:32:33.489915 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-22232eab-44fd-4d96-b510-aa72c7f72363 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f207a188e3fa4987b9fe4dd773ad03b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c636de1e6b42868f1f58e46fd4a3f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:33.502920 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-22232eab-44fd-4d96-b510-aa72c7f72363 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] 10.222.0.43 "GET /compute/v2.1/servers/606aebcb-2b6a-469f-a578-91325770ab4b" status: 200 len: 1332 microversion: 2.1 time: 0.436217 Oct 04 18:32:33.503657 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 197/417] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:33 2022] GET /compute/v2.1/servers/606aebcb-2b6a-469f-a578-91325770ab4b => generated 1332 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:33.889719 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-34a2a5a1-e146-4aec-9c48-8c6b7efb34bf tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:33.890979 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-34a2a5a1-e146-4aec-9c48-8c6b7efb34bf tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] [instance: 640d917c-c9cb-4758-aa1d-216e34a55297] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:33.898120 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-34a2a5a1-e146-4aec-9c48-8c6b7efb34bf tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:33.899062 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-34a2a5a1-e146-4aec-9c48-8c6b7efb34bf tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:33.899718 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-34a2a5a1-e146-4aec-9c48-8c6b7efb34bf tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:33.902153 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-34a2a5a1-e146-4aec-9c48-8c6b7efb34bf tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:33.902893 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-34a2a5a1-e146-4aec-9c48-8c6b7efb34bf tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:33.903544 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-34a2a5a1-e146-4aec-9c48-8c6b7efb34bf tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:33.937906 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-00582ecb-e3c9-497e-9583-0b415e3bd2e1 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:33.938695 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-00582ecb-e3c9-497e-9583-0b415e3bd2e1 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] [instance: 918d6106-9c7c-4046-9cdd-319afe4cdb25] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:33.953799 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-00582ecb-e3c9-497e-9583-0b415e3bd2e1 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:33.954616 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-00582ecb-e3c9-497e-9583-0b415e3bd2e1 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:33.955360 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-00582ecb-e3c9-497e-9583-0b415e3bd2e1 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:33.956954 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-00582ecb-e3c9-497e-9583-0b415e3bd2e1 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:33.957989 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-00582ecb-e3c9-497e-9583-0b415e3bd2e1 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:33.958941 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-00582ecb-e3c9-497e-9583-0b415e3bd2e1 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:34.229549 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-34a2a5a1-e146-4aec-9c48-8c6b7efb34bf tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7db99f361654711bea7f1b2c404d312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7adedcdb9c3485ea2738c00e25aa3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:34.244827 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-00582ecb-e3c9-497e-9583-0b415e3bd2e1 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb7b0ce49ec438f9a60b79bdb2ac164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94ae6e2cb75d410d8029aa49909c973b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:34.247061 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-34a2a5a1-e146-4aec-9c48-8c6b7efb34bf tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] 10.222.0.43 "GET /compute/v2.1/servers/640d917c-c9cb-4758-aa1d-216e34a55297" status: 200 len: 1319 microversion: 2.1 time: 0.361616 Oct 04 18:32:34.248160 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 221/418] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:33 2022] GET /compute/v2.1/servers/640d917c-c9cb-4758-aa1d-216e34a55297 => generated 1319 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:34.253539 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-fdc828c9-cfe2-4d0f-b091-ed464d333fb9 req-f5f99832-fcd6-46b3-b814-5ddcba73efd1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "640d917c-c9cb-4758-aa1d-216e34a55297", "tag": "5a0ea8df-3cc7-4b6a-9b2d-ac13a2c7f69e"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:34.258482 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-00582ecb-e3c9-497e-9583-0b415e3bd2e1 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] 10.222.0.43 "GET /compute/v2.1/servers/918d6106-9c7c-4046-9cdd-319afe4cdb25" status: 200 len: 1321 microversion: 2.1 time: 0.326664 Oct 04 18:32:34.267110 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 198/419] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:33 2022] GET /compute/v2.1/servers/918d6106-9c7c-4046-9cdd-319afe4cdb25 => generated 1321 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:34.273211 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-fdc828c9-cfe2-4d0f-b091-ed464d333fb9 req-f5f99832-fcd6-46b3-b814-5ddcba73efd1 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:34.273920 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-fdc828c9-cfe2-4d0f-b091-ed464d333fb9 req-f5f99832-fcd6-46b3-b814-5ddcba73efd1 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:34.274676 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-fdc828c9-cfe2-4d0f-b091-ed464d333fb9 req-f5f99832-fcd6-46b3-b814-5ddcba73efd1 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:34.299132 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-fdc828c9-cfe2-4d0f-b091-ed464d333fb9 req-f5f99832-fcd6-46b3-b814-5ddcba73efd1 service nova] Creating event network-changed:5a0ea8df-3cc7-4b6a-9b2d-ac13a2c7f69e for instance 640d917c-c9cb-4758-aa1d-216e34a55297 on n-h2-851028-13 Oct 04 18:32:34.319567 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-fdc828c9-cfe2-4d0f-b091-ed464d333fb9 req-f5f99832-fcd6-46b3-b814-5ddcba73efd1 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069903 Oct 04 18:32:34.321573 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 222/420] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:32:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:32:34.527267 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-09bfca65-d4b3-44f9-8354-30454b51d51a tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:34.528242 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-09bfca65-d4b3-44f9-8354-30454b51d51a tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] [instance: 606aebcb-2b6a-469f-a578-91325770ab4b] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:34.535597 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-09bfca65-d4b3-44f9-8354-30454b51d51a tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:34.539877 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-09bfca65-d4b3-44f9-8354-30454b51d51a tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:34.541321 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-09bfca65-d4b3-44f9-8354-30454b51d51a tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:34.542275 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-09bfca65-d4b3-44f9-8354-30454b51d51a tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:34.542952 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-09bfca65-d4b3-44f9-8354-30454b51d51a tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:34.543652 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-09bfca65-d4b3-44f9-8354-30454b51d51a tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:34.769222 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-09bfca65-d4b3-44f9-8354-30454b51d51a tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f207a188e3fa4987b9fe4dd773ad03b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c636de1e6b42868f1f58e46fd4a3f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:34.779872 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-09bfca65-d4b3-44f9-8354-30454b51d51a tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] 10.222.0.43 "GET /compute/v2.1/servers/606aebcb-2b6a-469f-a578-91325770ab4b" status: 200 len: 1536 microversion: 2.1 time: 0.256697 Oct 04 18:32:34.781772 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 199/421] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:34 2022] GET /compute/v2.1/servers/606aebcb-2b6a-469f-a578-91325770ab4b => generated 1536 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:34.806413 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-2e62dd1c-86af-4829-8e81-872c29f28d37 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Action: 'create', calling method: .version_select at 0x7fb224318dc0>, body: {"pool": "73f4d4fd-920f-4232-90c7-c4abfd77b225"} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:35.468812 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-f520af03-0020-48c6-bfea-b985f9e7df61 tempest-FlavorsAccessNegativeTestJSON-1942833929 tempest-FlavorsAccessNegativeTestJSON-1942833929-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1180237638", "id": 753758080, "os-flavor-access:is_public": "False"}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:35.478481 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:DELETE=4,nova_api:INSERT=2 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:32:35.497538 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-f520af03-0020-48c6-bfea-b985f9e7df61 tempest-FlavorsAccessNegativeTestJSON-1942833929 tempest-FlavorsAccessNegativeTestJSON-1942833929-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.553885 Oct 04 18:32:35.498813 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 200/422] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 18:32:34 2022] POST /compute/v2.1/flavors => generated 436 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:32:35.507180 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-3be40f77-d7ce-44df-9afc-baff538e15e0 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:35.508356 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-3be40f77-d7ce-44df-9afc-baff538e15e0 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] [instance: 640d917c-c9cb-4758-aa1d-216e34a55297] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:35.521396 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3be40f77-d7ce-44df-9afc-baff538e15e0 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:35.522523 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3be40f77-d7ce-44df-9afc-baff538e15e0 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:35.523514 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3be40f77-d7ce-44df-9afc-baff538e15e0 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:35.526554 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3be40f77-d7ce-44df-9afc-baff538e15e0 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:35.527845 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3be40f77-d7ce-44df-9afc-baff538e15e0 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:35.529703 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3be40f77-d7ce-44df-9afc-baff538e15e0 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:35.622434 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=9 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:32:35.804925 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-3be40f77-d7ce-44df-9afc-baff538e15e0 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7db99f361654711bea7f1b2c404d312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7adedcdb9c3485ea2738c00e25aa3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:35.817977 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-3be40f77-d7ce-44df-9afc-baff538e15e0 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] 10.222.0.43 "GET /compute/v2.1/servers/640d917c-c9cb-4758-aa1d-216e34a55297" status: 200 len: 1319 microversion: 2.1 time: 0.317350 Oct 04 18:32:35.833203 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 201/423] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:35 2022] GET /compute/v2.1/servers/640d917c-c9cb-4758-aa1d-216e34a55297 => generated 1319 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:35.833203 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-70ce0c18-3702-4aa9-8a9e-36b8e6a5c209 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:35.833203 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-70ce0c18-3702-4aa9-8a9e-36b8e6a5c209 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] [instance: 918d6106-9c7c-4046-9cdd-319afe4cdb25] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:35.838471 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-70ce0c18-3702-4aa9-8a9e-36b8e6a5c209 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:35.839005 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-70ce0c18-3702-4aa9-8a9e-36b8e6a5c209 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:35.839827 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-70ce0c18-3702-4aa9-8a9e-36b8e6a5c209 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:35.840362 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-70ce0c18-3702-4aa9-8a9e-36b8e6a5c209 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:35.840856 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-70ce0c18-3702-4aa9-8a9e-36b8e6a5c209 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:35.842247 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-70ce0c18-3702-4aa9-8a9e-36b8e6a5c209 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:36.130215 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-70ce0c18-3702-4aa9-8a9e-36b8e6a5c209 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb7b0ce49ec438f9a60b79bdb2ac164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94ae6e2cb75d410d8029aa49909c973b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:36.139062 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-70ce0c18-3702-4aa9-8a9e-36b8e6a5c209 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] 10.222.0.43 "GET /compute/v2.1/servers/918d6106-9c7c-4046-9cdd-319afe4cdb25" status: 200 len: 1321 microversion: 2.1 time: 0.317425 Oct 04 18:32:36.141461 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 202/424] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:35 2022] GET /compute/v2.1/servers/918d6106-9c7c-4046-9cdd-319afe4cdb25 => generated 1321 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:36.149392 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-cc3db479-32f9-4bf4-886e-e903c6a5d457 tempest-FlavorsAccessNegativeTestJSON-1942833929 tempest-FlavorsAccessNegativeTestJSON-1942833929-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "b02ea5c6a82c4215b269b905193e1066"}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:36.412530 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-cc3db479-32f9-4bf4-886e-e903c6a5d457 tempest-FlavorsAccessNegativeTestJSON-1942833929 tempest-FlavorsAccessNegativeTestJSON-1942833929-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors/753758080/action" status: 200 len: 96 microversion: 2.1 time: 0.269743 Oct 04 18:32:36.414100 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 203/425] 10.222.0.43 () {60 vars in 1197 bytes} [Tue Oct 4 18:32:36 2022] POST /compute/v2.1/flavors/753758080/action => generated 96 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:32:36.653348 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=59 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:32:36.669875 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-1a84ae80-9eca-4135-bbf7-9a2c5e574b47 tempest-FlavorsExtraSpecsTestJSON-1642702656 tempest-FlavorsExtraSpecsTestJSON-1642702656-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-572750279", "ram": 512, "vcpus": 1, "disk": 10, "id": 1195442128, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:36.710766 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-1a84ae80-9eca-4135-bbf7-9a2c5e574b47 tempest-FlavorsExtraSpecsTestJSON-1642702656 tempest-FlavorsExtraSpecsTestJSON-1642702656-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.294271 Oct 04 18:32:36.712180 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 204/426] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 18:32:36 2022] POST /compute/v2.1/flavors => generated 415 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:32:36.720573 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-a068fa2f-5ff7-4210-8799-cb8f821fc0a7 tempest-FlavorsAccessNegativeTestJSON-1942833929 tempest-FlavorsAccessNegativeTestJSON-1942833929-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "b02ea5c6a82c4215b269b905193e1066"}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:36.730503 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=29 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:32:37.065435 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-a068fa2f-5ff7-4210-8799-cb8f821fc0a7 tempest-FlavorsAccessNegativeTestJSON-1942833929 tempest-FlavorsAccessNegativeTestJSON-1942833929-project-admin] HTTP exception thrown: Flavor access already exists for flavor 32 and project b02ea5c6a82c4215b269b905193e1066 combination. Oct 04 18:32:37.079626 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-a068fa2f-5ff7-4210-8799-cb8f821fc0a7 tempest-FlavorsAccessNegativeTestJSON-1942833929 tempest-FlavorsAccessNegativeTestJSON-1942833929-project-admin] Request method failure captured: Oct 04 18:32:37.079626 n-d-851028-13 devstack@n-api.service[123595]: request: POST /compute/v2.1/flavors/753758080/action HTTP/1.1 Oct 04 18:32:37.079626 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 18:32:37.079626 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 18:32:37.079626 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 18:32:37.079626 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 67 Oct 04 18:32:37.079626 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 18:32:37.079626 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 18:32:37.079626 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 18:32:37.079626 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 18:32:37.079626 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPHxBPxrusxNWF2dLoPbOiJb8Eik1vthqBfatloeYfikMYwY6Ij8-jLs84RpgYaaGILPkZl5omYD7k5wiVllwI2TFJ_PCVk46fXECiljOi4gIBEqF9fy_9xqrS18ic6yukiGMoWxQQPwVq2jX6YZ_1zqe-d7-mZTrZdomHnoXEBBSxnM Oct 04 18:32:37.079626 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 18:32:37.079626 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 18:32:37.079626 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 18:32:37.079626 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 18:32:37.079626 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 18:32:37.079626 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 18:32:37.079626 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: 4149d2da2aee4e1ba5866aa326ceff74 Oct 04 18:32:37.079626 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1942833929 Oct 04 18:32:37.079626 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,admin,reader Oct 04 18:32:37.079626 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,admin,reader Oct 04 18:32:37.080977 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/4149d2da2aee4e1ba5866aa326ceff74"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_4149d2da2aee4e1ba5866aa326ceff74"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4149d2da2aee4e1ba5866aa326ceff74"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4149d2da2aee4e1ba5866aa326ceff74"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:32:37.080977 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1942833929 Oct 04 18:32:37.080977 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: 4149d2da2aee4e1ba5866aa326ceff74 Oct 04 18:32:37.080977 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1942833929 Oct 04 18:32:37.080977 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-FlavorsAccessNegativeTestJSON-1942833929-project-admin Oct 04 18:32:37.080977 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 18:32:37.080977 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 18:32:37.080977 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: 9369fdb0a8494b33802c6e8241b417be Oct 04 18:32:37.080977 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1942833929-project-admin Oct 04 18:32:37.080977 n-d-851028-13 devstack@n-api.service[123595]: Oct 04 18:32:37.080977 n-d-851028-13 devstack@n-api.service[123595]: {"addTenantAccess": {"tenant": "b02ea5c6a82c4215b269b905193e1066"}} Oct 04 18:32:37.080977 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 18:32:37.081967 n-d-851028-13 devstack@n-api.service[123595]: exception: Flavor access already exists for flavor 32 and project b02ea5c6a82c4215b269b905193e1066 combination. Oct 04 18:32:37.081967 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': '753758080', 'body': {'addTenantAccess': {'tenant': 'b02ea5c6a82c4215b269b905193e1066'}}} Oct 04 18:32:37.081967 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:32:37.081967 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:37.081967 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 04 18:32:37.081967 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 04 18:32:37.081967 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 04 18:32:37.081967 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 04 18:32:37.081967 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 04 18:32:37.081967 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 04 18:32:37.081967 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 04 18:32:37.081967 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 04 18:32:37.081967 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 04 18:32:37.081967 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 04 18:32:37.081967 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 04 18:32:37.081967 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi result.read() Oct 04 18:32:37.081967 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 04 18:32:37.081967 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 04 18:32:37.082960 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 04 18:32:37.082960 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 04 18:32:37.082960 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 04 18:32:37.082960 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 04 18:32:37.082960 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 04 18:32:37.082960 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 04 18:32:37.082960 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '32-b02ea5c6a82c4215b269b905193e1066' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Oct 04 18:32:37.082960 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:32:37.082960 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 04 18:32:37.082960 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:32:37.082960 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:37.082960 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 73, in _flavor_add_project Oct 04 18:32:37.082960 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi project.save(context.session) Oct 04 18:32:37.082960 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 04 18:32:37.082960 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi session.flush() Oct 04 18:32:37.082960 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 04 18:32:37.082960 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 04 18:32:37.082960 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 04 18:32:37.082960 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 04 18:32:37.086210 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 04 18:32:37.086210 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 04 18:32:37.086210 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 04 18:32:37.086210 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception Oct 04 18:32:37.086210 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 04 18:32:37.086210 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 04 18:32:37.086210 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 04 18:32:37.086210 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 04 18:32:37.086210 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 04 18:32:37.086210 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 04 18:32:37.086210 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 04 18:32:37.086210 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 04 18:32:37.086210 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 04 18:32:37.086210 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 04 18:32:37.086210 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 04 18:32:37.086210 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 04 18:32:37.086210 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 04 18:32:37.086210 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 04 18:32:37.088874 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 04 18:32:37.088874 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 04 18:32:37.088874 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 04 18:32:37.088874 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 04 18:32:37.088874 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 04 18:32:37.088874 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 04 18:32:37.088874 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 04 18:32:37.088874 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception Oct 04 18:32:37.088874 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 04 18:32:37.088874 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 04 18:32:37.088874 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 04 18:32:37.088874 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 04 18:32:37.088874 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 04 18:32:37.088874 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 04 18:32:37.088874 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 04 18:32:37.088874 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 04 18:32:37.088874 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 04 18:32:37.088874 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 04 18:32:37.090944 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 04 18:32:37.090944 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi result.read() Oct 04 18:32:37.090944 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 04 18:32:37.090944 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 04 18:32:37.090944 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 04 18:32:37.090944 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 04 18:32:37.090944 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 04 18:32:37.090944 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 04 18:32:37.090944 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 04 18:32:37.090944 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 04 18:32:37.090944 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '32-b02ea5c6a82c4215b269b905193e1066' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Oct 04 18:32:37.090944 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO flavor_projects (created_at, updated_at, flavor_id, project_id) VALUES (%(created_at)s, %(updated_at)s, %(flavor_id)s, %(project_id)s)] Oct 04 18:32:37.090944 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 4, 18, 32, 37, 52334), 'updated_at': None, 'flavor_id': 32, 'project_id': 'b02ea5c6a82c4215b269b905193e1066'}] Oct 04 18:32:37.090944 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 04 18:32:37.090944 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:32:37.090944 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:37.090944 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:32:37.094353 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:37.094353 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 79, in _add_tenant_access Oct 04 18:32:37.094353 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi flavor.add_access(tenant) Oct 04 18:32:37.094353 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 04 18:32:37.094353 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 04 18:32:37.094353 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 411, in add_access Oct 04 18:32:37.094353 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi self._add_access(project_id) Oct 04 18:32:37.094353 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 404, in _add_access Oct 04 18:32:37.094353 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi self._flavor_add_project(self._context, self.id, project_id) Oct 04 18:32:37.094353 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 397, in _flavor_add_project Oct 04 18:32:37.094353 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return _flavor_add_project(context, flavor_id, project_id) Oct 04 18:32:37.094353 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 18:32:37.094353 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 18:32:37.094353 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 75, in _flavor_add_project Oct 04 18:32:37.094353 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessExists(flavor_id=flavor_id, Oct 04 18:32:37.094353 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessExists: Flavor access already exists for flavor 32 and project b02ea5c6a82c4215b269b905193e1066 combination. Oct 04 18:32:37.094353 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:32:37.094353 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:37.094353 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:32:37.096538 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:37.096538 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:32:37.096538 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:32:37.096538 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:32:37.096538 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:32:37.096538 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:32:37.096538 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:32:37.096538 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:32:37.096538 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:32:37.096538 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 83, in _add_tenant_access Oct 04 18:32:37.096538 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=err.format_message()) Oct 04 18:32:37.096538 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Flavor access already exists for flavor 32 and project b02ea5c6a82c4215b269b905193e1066 combination. Oct 04 18:32:37.096538 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:32:37.096538 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:37.096538 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:32:37.096538 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:37.096538 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:32:37.096538 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:32:37.096538 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:32:37.096538 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:32:37.101774 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access already exists for flavor 32 and project b02ea5c6a82c4215b269b905193e1066 combination. Oct 04 18:32:37.101774 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:32:37.101774 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-a068fa2f-5ff7-4210-8799-cb8f821fc0a7 tempest-FlavorsAccessNegativeTestJSON-1942833929 tempest-FlavorsAccessNegativeTestJSON-1942833929-project-admin] Returning 409 to user: Flavor access already exists for flavor 32 and project b02ea5c6a82c4215b269b905193e1066 combination. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:32:37.101774 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-a068fa2f-5ff7-4210-8799-cb8f821fc0a7 tempest-FlavorsAccessNegativeTestJSON-1942833929 tempest-FlavorsAccessNegativeTestJSON-1942833929-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors/753758080/action" status: 409 len: 152 microversion: 2.1 time: 0.384652 Oct 04 18:32:37.103709 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 205/427] 10.222.0.43 () {60 vars in 1197 bytes} [Tue Oct 4 18:32:36 2022] POST /compute/v2.1/flavors/753758080/action => generated 152 bytes in 391 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:32:37.114466 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-42f4734c-64a7-478a-8432-0074623e5048 tempest-FlavorsExtraSpecsTestJSON-1642702656 tempest-FlavorsExtraSpecsTestJSON-1642702656-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:37.165340 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-42f4734c-64a7-478a-8432-0074623e5048 tempest-FlavorsExtraSpecsTestJSON-1642702656 tempest-FlavorsExtraSpecsTestJSON-1642702656-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors/1195442128/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.059235 Oct 04 18:32:37.170105 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 206/428] 10.222.0.43 () {60 vars in 1224 bytes} [Tue Oct 4 18:32:37 2022] POST /compute/v2.1/flavors/1195442128/os-extra_specs => generated 66 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:32:37.176216 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-58095729-ef54-474f-b6bd-3d12b45eaf4c tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:37.178444 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-58095729-ef54-474f-b6bd-3d12b45eaf4c tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] [instance: 640d917c-c9cb-4758-aa1d-216e34a55297] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:37.189760 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-58095729-ef54-474f-b6bd-3d12b45eaf4c tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:37.190545 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-58095729-ef54-474f-b6bd-3d12b45eaf4c tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:37.191137 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-58095729-ef54-474f-b6bd-3d12b45eaf4c tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:37.192573 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-58095729-ef54-474f-b6bd-3d12b45eaf4c tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:37.193233 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-58095729-ef54-474f-b6bd-3d12b45eaf4c tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:37.193815 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-58095729-ef54-474f-b6bd-3d12b45eaf4c tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:37.816265 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-58095729-ef54-474f-b6bd-3d12b45eaf4c tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7db99f361654711bea7f1b2c404d312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7adedcdb9c3485ea2738c00e25aa3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:37.826699 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-58095729-ef54-474f-b6bd-3d12b45eaf4c tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] 10.222.0.43 "GET /compute/v2.1/servers/640d917c-c9cb-4758-aa1d-216e34a55297" status: 200 len: 1319 microversion: 2.1 time: 0.655179 Oct 04 18:32:37.827380 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 207/429] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:37 2022] GET /compute/v2.1/servers/640d917c-c9cb-4758-aa1d-216e34a55297 => generated 1319 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:37.850654 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-27ed6c7a-4da7-4c54-a887-2d3cd470f48d tempest-FlavorsAccessNegativeTestJSON-1942833929 tempest-FlavorsAccessNegativeTestJSON-1942833929-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "b02ea5c6a82c4215b269b905193e1066"}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:38.125709 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-27ed6c7a-4da7-4c54-a887-2d3cd470f48d tempest-FlavorsAccessNegativeTestJSON-1942833929 tempest-FlavorsAccessNegativeTestJSON-1942833929-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors/753758080/action" status: 200 len: 21 microversion: 2.1 time: 0.283162 Oct 04 18:32:38.132078 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 208/430] 10.222.0.43 () {60 vars in 1197 bytes} [Tue Oct 4 18:32:37 2022] POST /compute/v2.1/flavors/753758080/action => generated 21 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:32:38.147036 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-529c7de4-75a4-43fb-8925-175b939eef5b tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:38.147921 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-529c7de4-75a4-43fb-8925-175b939eef5b tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] [instance: 918d6106-9c7c-4046-9cdd-319afe4cdb25] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:38.158765 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-529c7de4-75a4-43fb-8925-175b939eef5b tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:38.159266 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-529c7de4-75a4-43fb-8925-175b939eef5b tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:38.159709 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-529c7de4-75a4-43fb-8925-175b939eef5b tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:38.160423 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-529c7de4-75a4-43fb-8925-175b939eef5b tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:38.160992 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-529c7de4-75a4-43fb-8925-175b939eef5b tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:38.161617 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-529c7de4-75a4-43fb-8925-175b939eef5b tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:38.317660 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-2e62dd1c-86af-4829-8e81-872c29f28d37 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] 10.222.0.43 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.515673 Oct 04 18:32:38.319163 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 223/431] 10.222.0.43 () {60 vars in 1170 bytes} [Tue Oct 4 18:32:34 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3518 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:32:38.500337 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-529c7de4-75a4-43fb-8925-175b939eef5b tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb7b0ce49ec438f9a60b79bdb2ac164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94ae6e2cb75d410d8029aa49909c973b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:38.518874 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-529c7de4-75a4-43fb-8925-175b939eef5b tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] 10.222.0.43 "GET /compute/v2.1/servers/918d6106-9c7c-4046-9cdd-319afe4cdb25" status: 200 len: 1321 microversion: 2.1 time: 0.382890 Oct 04 18:32:38.521658 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 209/432] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:38 2022] GET /compute/v2.1/servers/918d6106-9c7c-4046-9cdd-319afe4cdb25 => generated 1321 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:38.527013 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-5af58bbf-be27-417c-9beb-b85dacd4e9b7 tempest-FlavorsAccessNegativeTestJSON-1942833929 tempest-FlavorsAccessNegativeTestJSON-1942833929-project-admin] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:38.578468 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-5af58bbf-be27-417c-9beb-b85dacd4e9b7 tempest-FlavorsAccessNegativeTestJSON-1942833929 tempest-FlavorsAccessNegativeTestJSON-1942833929-project-admin] 10.222.0.43 "DELETE /compute/v2.1/flavors/753758080" status: 202 len: 0 microversion: 2.1 time: 0.055475 Oct 04 18:32:38.579596 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 210/433] 10.222.0.43 () {58 vars in 1158 bytes} [Tue Oct 4 18:32:38 2022] DELETE /compute/v2.1/flavors/753758080 => generated 0 bytes in 57 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:32:38.586160 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-12e2b20c-a784-4bc4-91a7-10fc1ec3ab8a tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Action: 'action', calling method: .version_select at 0x7fb225843940>, body: {"addFloatingIp": {"address": "172.25.8.217"}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:38.612309 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-12e2b20c-a784-4bc4-91a7-10fc1ec3ab8a tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] [instance: 606aebcb-2b6a-469f-a578-91325770ab4b] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:38.638414 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-12e2b20c-a784-4bc4-91a7-10fc1ec3ab8a tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:38.643992 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-12e2b20c-a784-4bc4-91a7-10fc1ec3ab8a tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:38.645663 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-12e2b20c-a784-4bc4-91a7-10fc1ec3ab8a tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:38.647259 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-12e2b20c-a784-4bc4-91a7-10fc1ec3ab8a tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:38.647766 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-12e2b20c-a784-4bc4-91a7-10fc1ec3ab8a tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:38.648251 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-12e2b20c-a784-4bc4-91a7-10fc1ec3ab8a tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:38.812580 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-91b28ee0-7579-44a0-a952-882b7134c765 tempest-FlavorsExtraSpecsTestJSON-1568433342 tempest-FlavorsExtraSpecsTestJSON-1568433342-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:38.815385 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-12e2b20c-a784-4bc4-91a7-10fc1ec3ab8a tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Acquiring lock "refresh_cache-606aebcb-2b6a-469f-a578-91325770ab4b" {{(pid=123595) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 04 18:32:38.819465 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-12e2b20c-a784-4bc4-91a7-10fc1ec3ab8a tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Acquired lock "refresh_cache-606aebcb-2b6a-469f-a578-91325770ab4b" {{(pid=123595) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 04 18:32:38.844163 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-91b28ee0-7579-44a0-a952-882b7134c765 tempest-FlavorsExtraSpecsTestJSON-1568433342 tempest-FlavorsExtraSpecsTestJSON-1568433342-project] 10.222.0.43 "GET /compute/v2.1/flavors/1195442128/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.518395 Oct 04 18:32:38.860449 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 224/434] 10.222.0.43 () {58 vars in 1203 bytes} [Tue Oct 4 18:32:38 2022] GET /compute/v2.1/flavors/1195442128/os-extra_specs => generated 66 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:32:38.866887 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-3bc2a33a-2022-422b-9991-df850887f52a tempest-FlavorsAccessNegativeTestJSON-1942833929 tempest-FlavorsAccessNegativeTestJSON-1942833929-project-admin] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:38.906520 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-3bc2a33a-2022-422b-9991-df850887f52a tempest-FlavorsAccessNegativeTestJSON-1942833929 tempest-FlavorsAccessNegativeTestJSON-1942833929-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 6223 microversion: 2.1 time: 0.043525 Oct 04 18:32:38.907735 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 225/435] 10.222.0.43 () {58 vars in 1146 bytes} [Tue Oct 4 18:32:38 2022] GET /compute/v2.1/flavors/detail => generated 6223 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:38.915033 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-67674d9a-b0b5-47da-aa94-26751211709c tempest-FlavorsExtraSpecsTestJSON-1642702656 tempest-FlavorsExtraSpecsTestJSON-1642702656-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:38.957793 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-67674d9a-b0b5-47da-aa94-26751211709c tempest-FlavorsExtraSpecsTestJSON-1642702656 tempest-FlavorsExtraSpecsTestJSON-1642702656-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors/1195442128/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.048724 Oct 04 18:32:38.960574 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 226/436] 10.222.0.43 () {60 vars in 1224 bytes} [Tue Oct 4 18:32:38 2022] POST /compute/v2.1/flavors/1195442128/os-extra_specs => generated 66 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:32:38.971106 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-941d105e-58a5-4855-9ec9-31e995e928cf tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:38.974532 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-941d105e-58a5-4855-9ec9-31e995e928cf tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] [instance: 640d917c-c9cb-4758-aa1d-216e34a55297] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:38.989726 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-941d105e-58a5-4855-9ec9-31e995e928cf tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:38.990430 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-941d105e-58a5-4855-9ec9-31e995e928cf tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:38.991072 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-941d105e-58a5-4855-9ec9-31e995e928cf tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:38.991976 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-941d105e-58a5-4855-9ec9-31e995e928cf tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:38.992608 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-941d105e-58a5-4855-9ec9-31e995e928cf tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:38.993304 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-941d105e-58a5-4855-9ec9-31e995e928cf tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:39.229641 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-941d105e-58a5-4855-9ec9-31e995e928cf tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7db99f361654711bea7f1b2c404d312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7adedcdb9c3485ea2738c00e25aa3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:39.257363 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-941d105e-58a5-4855-9ec9-31e995e928cf tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] 10.222.0.43 "GET /compute/v2.1/servers/640d917c-c9cb-4758-aa1d-216e34a55297" status: 200 len: 1319 microversion: 2.1 time: 0.292841 Oct 04 18:32:39.275791 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 227/437] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:38 2022] GET /compute/v2.1/servers/640d917c-c9cb-4758-aa1d-216e34a55297 => generated 1319 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:39.283715 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-11904a74-8ef0-45d6-a3de-bd5ac5411a31 tempest-FlavorsAccessNegativeTestJSON-1942833929 tempest-FlavorsAccessNegativeTestJSON-1942833929-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-929467792", "id": 1693481855, "os-flavor-access:is_public": "True"}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:39.331498 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-11904a74-8ef0-45d6-a3de-bd5ac5411a31 tempest-FlavorsAccessNegativeTestJSON-1942833929 tempest-FlavorsAccessNegativeTestJSON-1942833929-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 437 microversion: 2.1 time: 0.053335 Oct 04 18:32:39.333552 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 228/438] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 18:32:39 2022] POST /compute/v2.1/flavors => generated 437 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:32:39.348139 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-25ae9e90-775d-401b-a8f5-d117363e0b79 tempest-FlavorsExtraSpecsTestJSON-1568433342 tempest-FlavorsExtraSpecsTestJSON-1568433342-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:39.387081 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-25ae9e90-775d-401b-a8f5-d117363e0b79 tempest-FlavorsExtraSpecsTestJSON-1568433342 tempest-FlavorsExtraSpecsTestJSON-1568433342-project] 10.222.0.43 "GET /compute/v2.1/flavors/1195442128/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.044682 Oct 04 18:32:39.404747 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 229/439] 10.222.0.43 () {58 vars in 1245 bytes} [Tue Oct 4 18:32:39 2022] GET /compute/v2.1/flavors/1195442128/os-extra_specs/hw:numa_nodes => generated 22 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:32:39.423268 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-eea85f86-ce34-4c15-880e-efaa5b1daeb7 tempest-FlavorsAccessNegativeTestJSON-1942833929 tempest-FlavorsAccessNegativeTestJSON-1942833929-project-admin] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:39.439743 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-eea85f86-ce34-4c15-880e-efaa5b1daeb7 tempest-FlavorsAccessNegativeTestJSON-1942833929 tempest-FlavorsAccessNegativeTestJSON-1942833929-project-admin] HTTP exception thrown: Access list not available for public flavors. Oct 04 18:32:39.442263 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-eea85f86-ce34-4c15-880e-efaa5b1daeb7 tempest-FlavorsAccessNegativeTestJSON-1942833929 tempest-FlavorsAccessNegativeTestJSON-1942833929-project-admin] Request method failure captured: Oct 04 18:32:39.442263 n-d-851028-13 devstack@n-api.service[123596]: request: GET /compute/v2.1/flavors/1693481855/os-flavor-access HTTP/1.1 Oct 04 18:32:39.442263 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:32:39.442263 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:32:39.442263 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:32:39.442263 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 18:32:39.442263 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:32:39.442263 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:32:39.442263 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:32:39.442263 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:32:39.442263 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPHxBPxrusxNWF2dLoPbOiJb8Eik1vthqBfatloeYfikMYwY6Ij8-jLs84RpgYaaGILPkZl5omYD7k5wiVllwI2TFJ_PCVk46fXECiljOi4gIBEqF9fy_9xqrS18ic6yukiGMoWxQQPwVq2jX6YZ_1zqe-d7-mZTrZdomHnoXEBBSxnM Oct 04 18:32:39.442263 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:32:39.442263 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:32:39.442263 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:32:39.442263 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:32:39.442263 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:32:39.442263 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:32:39.442263 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: 4149d2da2aee4e1ba5866aa326ceff74 Oct 04 18:32:39.442263 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1942833929 Oct 04 18:32:39.442263 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,admin,reader Oct 04 18:32:39.442263 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,admin,reader Oct 04 18:32:39.443995 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/4149d2da2aee4e1ba5866aa326ceff74"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_4149d2da2aee4e1ba5866aa326ceff74"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4149d2da2aee4e1ba5866aa326ceff74"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4149d2da2aee4e1ba5866aa326ceff74"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:32:39.443995 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1942833929 Oct 04 18:32:39.443995 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: 4149d2da2aee4e1ba5866aa326ceff74 Oct 04 18:32:39.443995 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1942833929 Oct 04 18:32:39.443995 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-FlavorsAccessNegativeTestJSON-1942833929-project-admin Oct 04 18:32:39.443995 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:32:39.443995 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:32:39.443995 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 9369fdb0a8494b33802c6e8241b417be Oct 04 18:32:39.443995 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1942833929-project-admin Oct 04 18:32:39.443995 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 18:32:39.443995 n-d-851028-13 devstack@n-api.service[123596]: exception: Access list not available for public flavors. Oct 04 18:32:39.443995 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'flavor_id': '1693481855'} Oct 04 18:32:39.445212 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:32:39.445212 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:39.445212 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:32:39.445212 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:32:39.445212 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:32:39.445212 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:32:39.445212 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:32:39.445212 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:32:39.445212 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 52, in index Oct 04 18:32:39.445212 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 18:32:39.445212 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Access list not available for public flavors. Oct 04 18:32:39.445212 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:32:39.445212 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:39.445212 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:32:39.445212 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:39.445212 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:32:39.445212 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:32:39.445212 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:32:39.445212 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:32:39.445212 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Access list not available for public flavors. Oct 04 18:32:39.445212 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:32:39.449295 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-eea85f86-ce34-4c15-880e-efaa5b1daeb7 tempest-FlavorsAccessNegativeTestJSON-1942833929 tempest-FlavorsAccessNegativeTestJSON-1942833929-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:32:39.450474 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-eea85f86-ce34-4c15-880e-efaa5b1daeb7 tempest-FlavorsAccessNegativeTestJSON-1942833929 tempest-FlavorsAccessNegativeTestJSON-1942833929-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/1693481855/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.042646 Oct 04 18:32:39.451508 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 230/440] 10.222.0.43 () {58 vars in 1209 bytes} [Tue Oct 4 18:32:39 2022] GET /compute/v2.1/flavors/1693481855/os-flavor-access => generated 91 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:32:39.457390 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-27335588-1e85-41f2-bf7b-1afd2289da26 tempest-FlavorsExtraSpecsTestJSON-1642702656 tempest-FlavorsExtraSpecsTestJSON-1642702656-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:39.501193 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-27335588-1e85-41f2-bf7b-1afd2289da26 tempest-FlavorsExtraSpecsTestJSON-1642702656 tempest-FlavorsExtraSpecsTestJSON-1642702656-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors/1195442128/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.046171 Oct 04 18:32:39.501647 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 231/441] 10.222.0.43 () {60 vars in 1224 bytes} [Tue Oct 4 18:32:39 2022] POST /compute/v2.1/flavors/1195442128/os-extra_specs => generated 66 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:32:39.523484 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-181834b7-92bf-49fb-b864-20f84bc63f72 tempest-FlavorsAccessNegativeTestJSON-1942833929 tempest-FlavorsAccessNegativeTestJSON-1942833929-project-admin] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:39.610041 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-181834b7-92bf-49fb-b864-20f84bc63f72 tempest-FlavorsAccessNegativeTestJSON-1942833929 tempest-FlavorsAccessNegativeTestJSON-1942833929-project-admin] 10.222.0.43 "DELETE /compute/v2.1/flavors/1693481855" status: 202 len: 0 microversion: 2.1 time: 0.092898 Oct 04 18:32:39.611759 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 232/442] 10.222.0.43 () {58 vars in 1161 bytes} [Tue Oct 4 18:32:39 2022] DELETE /compute/v2.1/flavors/1693481855 => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:32:39.641133 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-16feb829-e541-46e2-a8a7-539921540931 tempest-FlavorsExtraSpecsTestJSON-1642702656 tempest-FlavorsExtraSpecsTestJSON-1642702656-project-admin] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:39.662699 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-16feb829-e541-46e2-a8a7-539921540931 tempest-FlavorsExtraSpecsTestJSON-1642702656 tempest-FlavorsExtraSpecsTestJSON-1642702656-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/1195442128/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.041560 Oct 04 18:32:39.666410 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 233/443] 10.222.0.43 () {58 vars in 1203 bytes} [Tue Oct 4 18:32:39 2022] GET /compute/v2.1/flavors/1195442128/os-extra_specs => generated 66 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:32:39.680179 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-e94c532c-28c7-4865-a201-16c994d9267d tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:39.682212 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-e94c532c-28c7-4865-a201-16c994d9267d tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] [instance: 918d6106-9c7c-4046-9cdd-319afe4cdb25] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:39.705324 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e94c532c-28c7-4865-a201-16c994d9267d tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:39.705856 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e94c532c-28c7-4865-a201-16c994d9267d tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:39.707893 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e94c532c-28c7-4865-a201-16c994d9267d tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:39.708689 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e94c532c-28c7-4865-a201-16c994d9267d tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:39.709203 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e94c532c-28c7-4865-a201-16c994d9267d tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:39.709637 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e94c532c-28c7-4865-a201-16c994d9267d tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:40.043794 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-e94c532c-28c7-4865-a201-16c994d9267d tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb7b0ce49ec438f9a60b79bdb2ac164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94ae6e2cb75d410d8029aa49909c973b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:40.053793 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-e94c532c-28c7-4865-a201-16c994d9267d tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] 10.222.0.43 "GET /compute/v2.1/servers/918d6106-9c7c-4046-9cdd-319afe4cdb25" status: 200 len: 1321 microversion: 2.1 time: 0.386324 Oct 04 18:32:40.059557 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 234/444] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:39 2022] GET /compute/v2.1/servers/918d6106-9c7c-4046-9cdd-319afe4cdb25 => generated 1321 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:40.068153 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-b003ee5d-de89-4bba-a4e2-9a60a1974a34 tempest-FlavorsAccessNegativeTestJSON-1942833929 tempest-FlavorsAccessNegativeTestJSON-1942833929-project-admin] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:40.114918 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-b003ee5d-de89-4bba-a4e2-9a60a1974a34 tempest-FlavorsAccessNegativeTestJSON-1942833929 tempest-FlavorsAccessNegativeTestJSON-1942833929-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 6223 microversion: 2.1 time: 0.053246 Oct 04 18:32:40.115834 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 235/445] 10.222.0.43 () {58 vars in 1146 bytes} [Tue Oct 4 18:32:40 2022] GET /compute/v2.1/flavors/detail => generated 6223 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:40.142594 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-3c186654-899c-4f2c-8c47-5bb23bfeed0c tempest-FlavorsExtraSpecsTestJSON-1642702656 tempest-FlavorsExtraSpecsTestJSON-1642702656-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:40.250337 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-3c186654-899c-4f2c-8c47-5bb23bfeed0c tempest-FlavorsExtraSpecsTestJSON-1642702656 tempest-FlavorsExtraSpecsTestJSON-1642702656-project-admin] 10.222.0.43 "PUT /compute/v2.1/flavors/1195442128/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.119442 Oct 04 18:32:40.252611 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 236/446] 10.222.0.43 () {60 vars in 1265 bytes} [Tue Oct 4 18:32:40 2022] PUT /compute/v2.1/flavors/1195442128/os-extra_specs/hw:numa_nodes => generated 22 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:32:40.262907 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-fc3cff76-d1aa-4dc5-bac6-e967948b8884 req-256745fe-5a4f-43ed-95b6-45341f925e11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "640d917c-c9cb-4758-aa1d-216e34a55297", "name": "network-vif-plugged", "status": "completed", "tag": "5a0ea8df-3cc7-4b6a-9b2d-ac13a2c7f69e"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:40.280174 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_api:SELECT=83,nova_api:SAVEPOINT=6,nova_api:RELEASE=6,nova_api:INSERT=1,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:32:40.287062 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-fc3cff76-d1aa-4dc5-bac6-e967948b8884 req-256745fe-5a4f-43ed-95b6-45341f925e11 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:40.288082 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-fc3cff76-d1aa-4dc5-bac6-e967948b8884 req-256745fe-5a4f-43ed-95b6-45341f925e11 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:40.288674 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-fc3cff76-d1aa-4dc5-bac6-e967948b8884 req-256745fe-5a4f-43ed-95b6-45341f925e11 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:40.306885 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-fc3cff76-d1aa-4dc5-bac6-e967948b8884 req-256745fe-5a4f-43ed-95b6-45341f925e11 service nova] Creating event network-vif-plugged:5a0ea8df-3cc7-4b6a-9b2d-ac13a2c7f69e for instance 640d917c-c9cb-4758-aa1d-216e34a55297 on n-h2-851028-13 Oct 04 18:32:40.313806 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-fc3cff76-d1aa-4dc5-bac6-e967948b8884 req-256745fe-5a4f-43ed-95b6-45341f925e11 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054935 Oct 04 18:32:40.315695 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 237/447] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:32:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:32:40.323567 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f7f1ad9a-e7e3-473b-9eea-2446f85aa7ce tempest-FlavorsAccessNegativeTestJSON-1942833929 tempest-FlavorsAccessNegativeTestJSON-1942833929-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1576337399", "id": 408821228, "os-flavor-access:is_public": "False"}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:40.378725 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-f7f1ad9a-e7e3-473b-9eea-2446f85aa7ce tempest-FlavorsAccessNegativeTestJSON-1942833929 tempest-FlavorsAccessNegativeTestJSON-1942833929-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.060940 Oct 04 18:32:40.390602 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 238/448] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 18:32:40 2022] POST /compute/v2.1/flavors => generated 436 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:32:40.397280 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-ee81db3c-cbae-4035-9162-86733161c84b tempest-FlavorsExtraSpecsTestJSON-1642702656 tempest-FlavorsExtraSpecsTestJSON-1642702656-project-admin] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:40.408855 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-ee81db3c-cbae-4035-9162-86733161c84b tempest-FlavorsExtraSpecsTestJSON-1642702656 tempest-FlavorsExtraSpecsTestJSON-1642702656-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/1195442128/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.016767 Oct 04 18:32:40.410776 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 239/449] 10.222.0.43 () {58 vars in 1203 bytes} [Tue Oct 4 18:32:40 2022] GET /compute/v2.1/flavors/1195442128/os-extra_specs => generated 66 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:32:40.425531 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-2020eca8-acb6-4cf4-8b84-5b9fe0c305f9 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:40.431772 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-2020eca8-acb6-4cf4-8b84-5b9fe0c305f9 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] [instance: 640d917c-c9cb-4758-aa1d-216e34a55297] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:40.455403 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2020eca8-acb6-4cf4-8b84-5b9fe0c305f9 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:40.455916 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2020eca8-acb6-4cf4-8b84-5b9fe0c305f9 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:40.456375 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2020eca8-acb6-4cf4-8b84-5b9fe0c305f9 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:40.457137 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2020eca8-acb6-4cf4-8b84-5b9fe0c305f9 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:40.457596 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2020eca8-acb6-4cf4-8b84-5b9fe0c305f9 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:40.458082 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2020eca8-acb6-4cf4-8b84-5b9fe0c305f9 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:40.808684 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-2020eca8-acb6-4cf4-8b84-5b9fe0c305f9 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7db99f361654711bea7f1b2c404d312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7adedcdb9c3485ea2738c00e25aa3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:40.823353 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-2020eca8-acb6-4cf4-8b84-5b9fe0c305f9 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] 10.222.0.43 "GET /compute/v2.1/servers/640d917c-c9cb-4758-aa1d-216e34a55297" status: 200 len: 1319 microversion: 2.1 time: 0.410946 Oct 04 18:32:40.824948 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 240/450] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:40 2022] GET /compute/v2.1/servers/640d917c-c9cb-4758-aa1d-216e34a55297 => generated 1319 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:41.252011 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-c68b2d49-71bc-4ffe-9140-1f120f927572 tempest-FlavorsAccessNegativeTestJSON-1887157482 tempest-FlavorsAccessNegativeTestJSON-1887157482-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "b02ea5c6a82c4215b269b905193e1066"}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:41.267219 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-c68b2d49-71bc-4ffe-9140-1f120f927572 tempest-FlavorsAccessNegativeTestJSON-1887157482 tempest-FlavorsAccessNegativeTestJSON-1887157482-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': '5b6712f1e44849518ecee0cbe3e9b9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ea5c6a82c4215b269b905193e1066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:41.275076 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-c68b2d49-71bc-4ffe-9140-1f120f927572 tempest-FlavorsAccessNegativeTestJSON-1887157482 tempest-FlavorsAccessNegativeTestJSON-1887157482-project] Request method failure captured: Oct 04 18:32:41.275076 n-d-851028-13 devstack@n-api.service[123596]: request: POST /compute/v2.1/flavors/408821228/action HTTP/1.1 Oct 04 18:32:41.275076 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:32:41.275076 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:32:41.275076 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:32:41.275076 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 67 Oct 04 18:32:41.275076 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:32:41.275076 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:32:41.275076 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:32:41.275076 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:32:41.275076 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPHw_nFv3P4smfpM4wkJW1-FR6zIC-m511_BccP2eMK4rxGYyK0AKJsBOP3F14ZlVnxBDgOKWUSiVPb53dhsOv2RwOwf5wnc27cRzQ74_mxsgy5GTPfMq4AoKkKpAufjgqiRfIfp7TwwkFl-1iavh-t0_J4Qa1P7-7_tGIb8-m5S57BU Oct 04 18:32:41.275076 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:32:41.275076 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:32:41.275076 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:32:41.275076 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:32:41.275076 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:32:41.275076 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:32:41.275076 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: b02ea5c6a82c4215b269b905193e1066 Oct 04 18:32:41.275076 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1887157482 Oct 04 18:32:41.275076 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 18:32:41.275076 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 18:32:41.276669 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/b02ea5c6a82c4215b269b905193e1066"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_b02ea5c6a82c4215b269b905193e1066"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b02ea5c6a82c4215b269b905193e1066"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b02ea5c6a82c4215b269b905193e1066"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:32:41.276669 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1887157482 Oct 04 18:32:41.276669 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: b02ea5c6a82c4215b269b905193e1066 Oct 04 18:32:41.276669 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1887157482 Oct 04 18:32:41.276669 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-FlavorsAccessNegativeTestJSON-1887157482-project Oct 04 18:32:41.276669 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:32:41.276669 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:32:41.276669 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 5b6712f1e44849518ecee0cbe3e9b9a8 Oct 04 18:32:41.276669 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1887157482-project Oct 04 18:32:41.276669 n-d-851028-13 devstack@n-api.service[123596]: Oct 04 18:32:41.276669 n-d-851028-13 devstack@n-api.service[123596]: {"addTenantAccess": {"tenant": "b02ea5c6a82c4215b269b905193e1066"}} Oct 04 18:32:41.276669 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 18:32:41.277857 n-d-851028-13 devstack@n-api.service[123596]: exception: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 04 18:32:41.277857 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': '408821228', 'body': {'addTenantAccess': {'tenant': 'b02ea5c6a82c4215b269b905193e1066'}}} Oct 04 18:32:41.277857 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:32:41.277857 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:41.277857 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:32:41.277857 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:32:41.277857 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:32:41.277857 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:32:41.277857 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:32:41.277857 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:32:41.277857 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:32:41.277857 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:32:41.277857 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 66, in _add_tenant_access Oct 04 18:32:41.277857 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi context.can(fa_policies.POLICY_ROOT % "add_tenant_access", target={}) Oct 04 18:32:41.277857 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 18:32:41.277857 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 18:32:41.277857 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 18:32:41.277857 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 18:32:41.277857 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:32:41.280111 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:32:41.280111 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:32:41.280111 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:32:41.280111 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 18:32:41.280111 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 18:32:41.280111 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 18:32:41.280111 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 18:32:41.280111 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 18:32:41.280111 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 18:32:41.280111 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 04 18:32:41.280111 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:32:41.280111 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:41.280111 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:32:41.280111 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:41.280111 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:32:41.280111 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:32:41.280111 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 18:32:41.280111 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 18:32:41.280111 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 04 18:32:41.280111 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:32:41.282270 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-c68b2d49-71bc-4ffe-9140-1f120f927572 tempest-FlavorsAccessNegativeTestJSON-1887157482 tempest-FlavorsAccessNegativeTestJSON-1887157482-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:32:41.282270 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-c68b2d49-71bc-4ffe-9140-1f120f927572 tempest-FlavorsAccessNegativeTestJSON-1887157482 tempest-FlavorsAccessNegativeTestJSON-1887157482-project] 10.222.0.43 "POST /compute/v2.1/flavors/408821228/action" status: 403 len: 130 microversion: 2.1 time: 0.450485 Oct 04 18:32:41.286167 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 241/451] 10.222.0.43 () {60 vars in 1197 bytes} [Tue Oct 4 18:32:40 2022] POST /compute/v2.1/flavors/408821228/action => generated 130 bytes in 460 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:32:41.300857 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-929ddc4e-0314-4d21-8eea-d2d44ba4549f tempest-FlavorsExtraSpecsTestJSON-1642702656 tempest-FlavorsExtraSpecsTestJSON-1642702656-project-admin] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:41.381289 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-929ddc4e-0314-4d21-8eea-d2d44ba4549f tempest-FlavorsExtraSpecsTestJSON-1642702656 tempest-FlavorsExtraSpecsTestJSON-1642702656-project-admin] 10.222.0.43 "DELETE /compute/v2.1/flavors/1195442128/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.093746 Oct 04 18:32:41.387789 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 242/452] 10.222.0.43 () {58 vars in 1248 bytes} [Tue Oct 4 18:32:41 2022] DELETE /compute/v2.1/flavors/1195442128/os-extra_specs/hw:numa_nodes => generated 0 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 18:32:41.526296 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-7da4a34a-d1a2-4e68-8c44-498e624d21f4 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-UnshelveToHostMultiNodesTest-server-682934025", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452", "networks": "none"}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:41.621055 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-7da4a34a-d1a2-4e68-8c44-498e624d21f4 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Flavor limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:32:41.621580 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-7da4a34a-d1a2-4e68-8c44-498e624d21f4 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Image limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:32:41.622058 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-7da4a34a-d1a2-4e68-8c44-498e624d21f4 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Flavor pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:32:41.622470 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-7da4a34a-d1a2-4e68-8c44-498e624d21f4 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Image pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:32:41.622883 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-7da4a34a-d1a2-4e68-8c44-498e624d21f4 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:32:41.658402 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7da4a34a-d1a2-4e68-8c44-498e624d21f4 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:41.659183 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7da4a34a-d1a2-4e68-8c44-498e624d21f4 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:41.659864 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7da4a34a-d1a2-4e68-8c44-498e624d21f4 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:41.661012 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7da4a34a-d1a2-4e68-8c44-498e624d21f4 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:41.661806 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7da4a34a-d1a2-4e68-8c44-498e624d21f4 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:41.662490 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7da4a34a-d1a2-4e68-8c44-498e624d21f4 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:41.721486 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-7da4a34a-d1a2-4e68-8c44-498e624d21f4 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Getting quotas for project ef4df4f9d8384884b2d603c79bd26f2c. Resources: {'ram', 'cores', 'instances'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:32:41.734643 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-7da4a34a-d1a2-4e68-8c44-498e624d21f4 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Getting quotas for user 558386453e684a5abab558c526db7b2c and project ef4df4f9d8384884b2d603c79bd26f2c. Resources: {'ram', 'cores', 'instances'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:32:41.757384 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.network.neutron [None req-12e2b20c-a784-4bc4-91a7-10fc1ec3ab8a tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] [instance: 606aebcb-2b6a-469f-a578-91325770ab4b] Building network info cache for instance {{(pid=123595) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 04 18:32:41.762925 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-7da4a34a-d1a2-4e68-8c44-498e624d21f4 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Going to run 1 instances... {{(pid=123596) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:32:41.765364 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-7da4a34a-d1a2-4e68-8c44-498e624d21f4 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] [instance: 84e0414b-a39f-4bfe-bc9d-c170ceb34d15] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e8943ec5-4038-4d4b-b9b9-2415a79f5243',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123596) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:32:41.850794 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-7da4a34a-d1a2-4e68-8c44-498e624d21f4 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.91 time: 0.461731 Oct 04 18:32:41.853735 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 243/453] 10.222.0.43 () {62 vars in 1188 bytes} [Tue Oct 4 18:32:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 465 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 04 18:32:41.861912 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-ba2ff4cc-e209-4f88-9fed-2918c0c4759f tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:41.862523 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-ba2ff4cc-e209-4f88-9fed-2918c0c4759f tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] [instance: 918d6106-9c7c-4046-9cdd-319afe4cdb25] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:41.876076 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ba2ff4cc-e209-4f88-9fed-2918c0c4759f tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:41.876590 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ba2ff4cc-e209-4f88-9fed-2918c0c4759f tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:41.877041 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ba2ff4cc-e209-4f88-9fed-2918c0c4759f tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:41.877823 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ba2ff4cc-e209-4f88-9fed-2918c0c4759f tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:41.890242 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ba2ff4cc-e209-4f88-9fed-2918c0c4759f tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:41.891925 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ba2ff4cc-e209-4f88-9fed-2918c0c4759f tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:42.224581 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-ba2ff4cc-e209-4f88-9fed-2918c0c4759f tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb7b0ce49ec438f9a60b79bdb2ac164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94ae6e2cb75d410d8029aa49909c973b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:42.234965 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-ba2ff4cc-e209-4f88-9fed-2918c0c4759f tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] 10.222.0.43 "GET /compute/v2.1/servers/918d6106-9c7c-4046-9cdd-319afe4cdb25" status: 200 len: 1321 microversion: 2.1 time: 0.380084 Oct 04 18:32:42.238269 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 244/454] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:41 2022] GET /compute/v2.1/servers/918d6106-9c7c-4046-9cdd-319afe4cdb25 => generated 1321 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:42.248207 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-15041da3-3171-4683-a8d0-6ad651c80892 tempest-FlavorsAccessNegativeTestJSON-1942833929 tempest-FlavorsAccessNegativeTestJSON-1942833929-project-admin] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:42.289593 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-15041da3-3171-4683-a8d0-6ad651c80892 tempest-FlavorsAccessNegativeTestJSON-1942833929 tempest-FlavorsAccessNegativeTestJSON-1942833929-project-admin] 10.222.0.43 "DELETE /compute/v2.1/flavors/408821228" status: 202 len: 0 microversion: 2.1 time: 0.049897 Oct 04 18:32:42.290929 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 245/455] 10.222.0.43 () {58 vars in 1158 bytes} [Tue Oct 4 18:32:42 2022] DELETE /compute/v2.1/flavors/408821228 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:32:42.297147 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-c9ba632f-307d-4427-b8a4-d9fb0d81c9b3 tempest-FlavorsExtraSpecsTestJSON-1642702656 tempest-FlavorsExtraSpecsTestJSON-1642702656-project-admin] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:42.333194 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-c9ba632f-307d-4427-b8a4-d9fb0d81c9b3 tempest-FlavorsExtraSpecsTestJSON-1642702656 tempest-FlavorsExtraSpecsTestJSON-1642702656-project-admin] 10.222.0.43 "DELETE /compute/v2.1/flavors/1195442128/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.040660 Oct 04 18:32:42.334565 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 246/456] 10.222.0.43 () {58 vars in 1248 bytes} [Tue Oct 4 18:32:42 2022] DELETE /compute/v2.1/flavors/1195442128/os-extra_specs/hw:cpu_policy => generated 0 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 18:32:42.342857 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-f89dd7ad-6e13-49be-a409-b6e256f9792f req-579b5c14-cf3d-4e98-af89-eecf398a4240 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "606aebcb-2b6a-469f-a578-91325770ab4b", "tag": "101c6584-c112-496c-8a18-4440b7f3aec5"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:42.358054 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-f89dd7ad-6e13-49be-a409-b6e256f9792f req-579b5c14-cf3d-4e98-af89-eecf398a4240 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:42.359637 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-f89dd7ad-6e13-49be-a409-b6e256f9792f req-579b5c14-cf3d-4e98-af89-eecf398a4240 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:42.360353 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-f89dd7ad-6e13-49be-a409-b6e256f9792f req-579b5c14-cf3d-4e98-af89-eecf398a4240 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:42.377352 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-f89dd7ad-6e13-49be-a409-b6e256f9792f req-579b5c14-cf3d-4e98-af89-eecf398a4240 service nova] Creating event network-changed:101c6584-c112-496c-8a18-4440b7f3aec5 for instance 606aebcb-2b6a-469f-a578-91325770ab4b on n-h2-851028-13 Oct 04 18:32:42.385523 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-f89dd7ad-6e13-49be-a409-b6e256f9792f req-579b5c14-cf3d-4e98-af89-eecf398a4240 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049068 Oct 04 18:32:42.387006 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 247/457] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:32:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:32:42.394951 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-7ce99ce0-6443-4e23-9967-6d0f933f70fb tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:42.396868 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-7ce99ce0-6443-4e23-9967-6d0f933f70fb tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] [instance: 640d917c-c9cb-4758-aa1d-216e34a55297] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:42.404795 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7ce99ce0-6443-4e23-9967-6d0f933f70fb tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:42.406344 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7ce99ce0-6443-4e23-9967-6d0f933f70fb tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:42.407132 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7ce99ce0-6443-4e23-9967-6d0f933f70fb tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:42.408052 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7ce99ce0-6443-4e23-9967-6d0f933f70fb tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:42.408693 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7ce99ce0-6443-4e23-9967-6d0f933f70fb tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:42.409576 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7ce99ce0-6443-4e23-9967-6d0f933f70fb tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:42.729134 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-7ce99ce0-6443-4e23-9967-6d0f933f70fb tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7db99f361654711bea7f1b2c404d312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7adedcdb9c3485ea2738c00e25aa3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:42.739735 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-7ce99ce0-6443-4e23-9967-6d0f933f70fb tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] 10.222.0.43 "GET /compute/v2.1/servers/640d917c-c9cb-4758-aa1d-216e34a55297" status: 200 len: 1469 microversion: 2.1 time: 0.351280 Oct 04 18:32:42.761210 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 248/458] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:42 2022] GET /compute/v2.1/servers/640d917c-c9cb-4758-aa1d-216e34a55297 => generated 1469 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:42.773297 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-58f1bc71-4771-433a-9b3b-0d365828c405 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:42.776162 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-58f1bc71-4771-433a-9b3b-0d365828c405 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] [instance: 84e0414b-a39f-4bfe-bc9d-c170ceb34d15] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:42.782880 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-58f1bc71-4771-433a-9b3b-0d365828c405 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:42.783306 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-58f1bc71-4771-433a-9b3b-0d365828c405 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:42.783745 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-58f1bc71-4771-433a-9b3b-0d365828c405 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:42.784449 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-58f1bc71-4771-433a-9b3b-0d365828c405 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:42.784899 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-58f1bc71-4771-433a-9b3b-0d365828c405 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:42.785426 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-58f1bc71-4771-433a-9b3b-0d365828c405 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:42.912061 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=100 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:32:43.011598 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-58f1bc71-4771-433a-9b3b-0d365828c405 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:43.043890 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-58f1bc71-4771-433a-9b3b-0d365828c405 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:43.049220 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-58f1bc71-4771-433a-9b3b-0d365828c405 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:43.064414 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-58f1bc71-4771-433a-9b3b-0d365828c405 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] 10.222.0.43 "GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15" status: 200 len: 1448 microversion: 2.91 time: 0.301916 Oct 04 18:32:43.087751 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 249/459] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:32:42 2022] GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15 => generated 1448 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:32:43.094098 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-b0ec11e7-e1cb-4a54-9fc0-d703acab061e tempest-FlavorsAccessNegativeTestJSON-1942833929 tempest-FlavorsAccessNegativeTestJSON-1942833929-project-admin] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:43.140940 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-b0ec11e7-e1cb-4a54-9fc0-d703acab061e tempest-FlavorsAccessNegativeTestJSON-1942833929 tempest-FlavorsAccessNegativeTestJSON-1942833929-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 6223 microversion: 2.1 time: 0.050550 Oct 04 18:32:43.142569 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 250/460] 10.222.0.43 () {58 vars in 1146 bytes} [Tue Oct 4 18:32:43 2022] GET /compute/v2.1/flavors/detail => generated 6223 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:43.151047 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-828e551d-442c-4293-8454-9a2105e46591 tempest-FlavorsExtraSpecsTestJSON-1642702656 tempest-FlavorsExtraSpecsTestJSON-1642702656-project-admin] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:43.186572 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-828e551d-442c-4293-8454-9a2105e46591 tempest-FlavorsExtraSpecsTestJSON-1642702656 tempest-FlavorsExtraSpecsTestJSON-1642702656-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/1195442128/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.041551 Oct 04 18:32:43.187163 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 251/461] 10.222.0.43 () {58 vars in 1203 bytes} [Tue Oct 4 18:32:43 2022] GET /compute/v2.1/flavors/1195442128/os-extra_specs => generated 19 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:32:43.207419 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-381e66c8-e6a1-4fb4-afed-241d66e51829 req-96175e3a-0ad1-4860-b67b-47b82398aeee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6251d93c-aab7-43cc-9be0-212545cf2b01", "name": "network-vif-plugged", "status": "completed", "tag": "f0f8a0e7-af5c-4b16-b5ab-dac6dfca0427"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:43.241384 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-381e66c8-e6a1-4fb4-afed-241d66e51829 req-96175e3a-0ad1-4860-b67b-47b82398aeee service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:43.242569 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-381e66c8-e6a1-4fb4-afed-241d66e51829 req-96175e3a-0ad1-4860-b67b-47b82398aeee service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:43.243835 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-381e66c8-e6a1-4fb4-afed-241d66e51829 req-96175e3a-0ad1-4860-b67b-47b82398aeee service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:43.300560 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-381e66c8-e6a1-4fb4-afed-241d66e51829 req-96175e3a-0ad1-4860-b67b-47b82398aeee service nova] Creating event network-vif-plugged:f0f8a0e7-af5c-4b16-b5ab-dac6dfca0427 for instance 6251d93c-aab7-43cc-9be0-212545cf2b01 on n-h1-851028-13 Oct 04 18:32:43.321957 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-381e66c8-e6a1-4fb4-afed-241d66e51829 req-96175e3a-0ad1-4860-b67b-47b82398aeee service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130638 Oct 04 18:32:43.322859 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 252/462] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:32:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:32:43.366010 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-a9792ab5-d946-4e41-8f08-0a8480d8d015 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:43.373398 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.network.neutron [None req-12e2b20c-a784-4bc4-91a7-10fc1ec3ab8a tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] [instance: 606aebcb-2b6a-469f-a578-91325770ab4b] Updating instance_info_cache with network_info: [{"id": "101c6584-c112-496c-8a18-4440b7f3aec5", "address": "fa:16:3e:02:1e:9f", "network": {"id": "0c823502-f774-43d6-893c-f93f073651ed", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-1385900104-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.8.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "38c636de1e6b42868f1f58e46fd4a3f0", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap101c6584-c1", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=123595) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 04 18:32:43.374238 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-a9792ab5-d946-4e41-8f08-0a8480d8d015 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] [instance: 6251d93c-aab7-43cc-9be0-212545cf2b01] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:43.407275 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-12e2b20c-a784-4bc4-91a7-10fc1ec3ab8a tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Releasing lock "refresh_cache-606aebcb-2b6a-469f-a578-91325770ab4b" {{(pid=123595) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 04 18:32:43.408501 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-12e2b20c-a784-4bc4-91a7-10fc1ec3ab8a tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] 10.222.0.43 "POST /compute/v2.1/servers/606aebcb-2b6a-469f-a578-91325770ab4b/action" status: 202 len: 0 microversion: 2.1 time: 4.827694 Oct 04 18:32:43.416909 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a9792ab5-d946-4e41-8f08-0a8480d8d015 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:43.417732 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a9792ab5-d946-4e41-8f08-0a8480d8d015 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:43.417900 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a9792ab5-d946-4e41-8f08-0a8480d8d015 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:43.418195 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 211/463] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 18:32:38 2022] POST /compute/v2.1/servers/606aebcb-2b6a-469f-a578-91325770ab4b/action => generated 0 bytes in 4836 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 04 18:32:43.418623 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a9792ab5-d946-4e41-8f08-0a8480d8d015 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:43.438003 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-72c885a2-553b-46ca-8d95-12da8514e19b tempest-FlavorsAccessNegativeTestJSON-1942833929 tempest-FlavorsAccessNegativeTestJSON-1942833929-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1377894251", "id": 1225929511, "os-flavor-access:is_public": "False"}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:43.439359 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a9792ab5-d946-4e41-8f08-0a8480d8d015 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:43.441074 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a9792ab5-d946-4e41-8f08-0a8480d8d015 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:43.513447 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-72c885a2-553b-46ca-8d95-12da8514e19b tempest-FlavorsAccessNegativeTestJSON-1942833929 tempest-FlavorsAccessNegativeTestJSON-1942833929-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.081615 Oct 04 18:32:43.514672 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 212/464] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 18:32:43 2022] POST /compute/v2.1/flavors => generated 439 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:32:43.520316 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-2cadebbf-927d-4dc6-9236-6a7b08feb041 tempest-FlavorsExtraSpecsTestJSON-1642702656 tempest-FlavorsExtraSpecsTestJSON-1642702656-project-admin] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:43.595926 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-2cadebbf-927d-4dc6-9236-6a7b08feb041 tempest-FlavorsExtraSpecsTestJSON-1642702656 tempest-FlavorsExtraSpecsTestJSON-1642702656-project-admin] 10.222.0.43 "DELETE /compute/v2.1/flavors/1195442128" status: 202 len: 0 microversion: 2.1 time: 0.080045 Oct 04 18:32:43.597428 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 213/465] 10.222.0.43 () {58 vars in 1161 bytes} [Tue Oct 4 18:32:43 2022] DELETE /compute/v2.1/flavors/1195442128 => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:32:43.613961 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-29042bc9-898f-4767-b699-447dc2042bf7 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:43.614978 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-29042bc9-898f-4767-b699-447dc2042bf7 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] [instance: 918d6106-9c7c-4046-9cdd-319afe4cdb25] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:43.632769 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-29042bc9-898f-4767-b699-447dc2042bf7 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:43.637716 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-29042bc9-898f-4767-b699-447dc2042bf7 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:43.638471 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-29042bc9-898f-4767-b699-447dc2042bf7 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:43.646973 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-29042bc9-898f-4767-b699-447dc2042bf7 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:43.647794 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-29042bc9-898f-4767-b699-447dc2042bf7 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:43.648506 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-29042bc9-898f-4767-b699-447dc2042bf7 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:43.831734 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-a9792ab5-d946-4e41-8f08-0a8480d8d015 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7db99f361654711bea7f1b2c404d312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7adedcdb9c3485ea2738c00e25aa3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:43.840541 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-a9792ab5-d946-4e41-8f08-0a8480d8d015 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] 10.222.0.43 "GET /compute/v2.1/servers/6251d93c-aab7-43cc-9be0-212545cf2b01" status: 200 len: 1319 microversion: 2.1 time: 0.514847 Oct 04 18:32:43.844734 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 253/466] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:43 2022] GET /compute/v2.1/servers/6251d93c-aab7-43cc-9be0-212545cf2b01 => generated 1319 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:43.859315 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-6567de31-ad2e-487b-828a-f849a7da4722 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Action: 'create', calling method: .version_select at 0x7fb224318430>, body: {"pool": "73f4d4fd-920f-4232-90c7-c4abfd77b225"} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:43.876300 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-29042bc9-898f-4767-b699-447dc2042bf7 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb7b0ce49ec438f9a60b79bdb2ac164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94ae6e2cb75d410d8029aa49909c973b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:43.885633 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-29042bc9-898f-4767-b699-447dc2042bf7 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] 10.222.0.43 "GET /compute/v2.1/servers/918d6106-9c7c-4046-9cdd-319afe4cdb25" status: 200 len: 1321 microversion: 2.1 time: 0.286162 Oct 04 18:32:43.901139 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 214/467] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:43 2022] GET /compute/v2.1/servers/918d6106-9c7c-4046-9cdd-319afe4cdb25 => generated 1321 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:43.901139 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-cb5dfead-b79c-4f24-a649-3c8896868705 tempest-FlavorsAccessNegativeTestJSON-1942833929 tempest-FlavorsAccessNegativeTestJSON-1942833929-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "b02ea5c6a82c4215b269b905193e1066"}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:44.285202 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-cb5dfead-b79c-4f24-a649-3c8896868705 tempest-FlavorsAccessNegativeTestJSON-1942833929 tempest-FlavorsAccessNegativeTestJSON-1942833929-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors/1225929511/action" status: 200 len: 97 microversion: 2.1 time: 0.396813 Oct 04 18:32:44.293786 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 215/468] 10.222.0.43 () {60 vars in 1200 bytes} [Tue Oct 4 18:32:43 2022] POST /compute/v2.1/flavors/1225929511/action => generated 97 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:32:44.307247 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-f3f031ed-c717-4276-a70b-b698cefd3e7c tempest-FlavorsExtraSpecsTestJSON-1642702656 tempest-FlavorsExtraSpecsTestJSON-1642702656-project-admin] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:44.369200 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-f3f031ed-c717-4276-a70b-b698cefd3e7c tempest-FlavorsExtraSpecsTestJSON-1642702656 tempest-FlavorsExtraSpecsTestJSON-1642702656-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 5818 microversion: 2.1 time: 0.070802 Oct 04 18:32:44.384471 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 216/469] 10.222.0.43 () {58 vars in 1146 bytes} [Tue Oct 4 18:32:44 2022] GET /compute/v2.1/flavors/detail => generated 5818 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:44.397316 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-a09178d4-80f4-4200-962d-7a38b178e936 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:44.398912 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-a09178d4-80f4-4200-962d-7a38b178e936 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] [instance: 9b19b908-7870-477b-9be7-7d260d59b183] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:44.413505 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a09178d4-80f4-4200-962d-7a38b178e936 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:44.420679 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a09178d4-80f4-4200-962d-7a38b178e936 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:44.421657 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a09178d4-80f4-4200-962d-7a38b178e936 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:44.422664 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a09178d4-80f4-4200-962d-7a38b178e936 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:44.423350 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a09178d4-80f4-4200-962d-7a38b178e936 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:44.423997 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a09178d4-80f4-4200-962d-7a38b178e936 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:44.481327 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-a09178d4-80f4-4200-962d-7a38b178e936 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] [instance: 9b19b908-7870-477b-9be7-7d260d59b183] Going to try to terminate instance {{(pid=123595) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:32:44.663255 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=95,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=2,nova_cell1:RELEASE=1,nova_cell1:INSERT=1 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:32:44.784965 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-a09178d4-80f4-4200-962d-7a38b178e936 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] 10.222.0.43 "DELETE /compute/v2.1/servers/9b19b908-7870-477b-9be7-7d260d59b183" status: 204 len: 0 microversion: 2.1 time: 0.397357 Oct 04 18:32:44.797494 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 217/470] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 18:32:44 2022] DELETE /compute/v2.1/servers/9b19b908-7870-477b-9be7-7d260d59b183 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:32:44.802337 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-d8e0ec16-7de7-4f46-883d-7ee9272d0df4 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:44.803976 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-d8e0ec16-7de7-4f46-883d-7ee9272d0df4 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] [instance: 84e0414b-a39f-4bfe-bc9d-c170ceb34d15] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:44.819946 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d8e0ec16-7de7-4f46-883d-7ee9272d0df4 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:44.820445 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d8e0ec16-7de7-4f46-883d-7ee9272d0df4 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:44.820949 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d8e0ec16-7de7-4f46-883d-7ee9272d0df4 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:44.821702 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d8e0ec16-7de7-4f46-883d-7ee9272d0df4 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:44.829131 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d8e0ec16-7de7-4f46-883d-7ee9272d0df4 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:44.829802 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d8e0ec16-7de7-4f46-883d-7ee9272d0df4 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:45.164332 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-d8e0ec16-7de7-4f46-883d-7ee9272d0df4 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:45.174369 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-d8e0ec16-7de7-4f46-883d-7ee9272d0df4 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:45.176366 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-d8e0ec16-7de7-4f46-883d-7ee9272d0df4 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:45.205553 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-d8e0ec16-7de7-4f46-883d-7ee9272d0df4 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] 10.222.0.43 "GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15" status: 200 len: 1510 microversion: 2.91 time: 0.414368 Oct 04 18:32:45.209245 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 218/471] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:32:44 2022] GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15 => generated 1510 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:32:45.216658 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-d94f9e56-97fc-42a7-93fb-866e1ca10473 tempest-FlavorsAccessNegativeTestJSON-1887157482 tempest-FlavorsAccessNegativeTestJSON-1887157482-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "b02ea5c6a82c4215b269b905193e1066"}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:45.235690 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-d94f9e56-97fc-42a7-93fb-866e1ca10473 tempest-FlavorsAccessNegativeTestJSON-1887157482 tempest-FlavorsAccessNegativeTestJSON-1887157482-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': '5b6712f1e44849518ecee0cbe3e9b9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ea5c6a82c4215b269b905193e1066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:45.240662 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-d94f9e56-97fc-42a7-93fb-866e1ca10473 tempest-FlavorsAccessNegativeTestJSON-1887157482 tempest-FlavorsAccessNegativeTestJSON-1887157482-project] Request method failure captured: Oct 04 18:32:45.240662 n-d-851028-13 devstack@n-api.service[123595]: request: POST /compute/v2.1/flavors/1225929511/action HTTP/1.1 Oct 04 18:32:45.240662 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 18:32:45.240662 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 18:32:45.240662 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 18:32:45.240662 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 70 Oct 04 18:32:45.240662 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 18:32:45.240662 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 18:32:45.240662 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 18:32:45.240662 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 18:32:45.240662 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPHw_nFv3P4smfpM4wkJW1-FR6zIC-m511_BccP2eMK4rxGYyK0AKJsBOP3F14ZlVnxBDgOKWUSiVPb53dhsOv2RwOwf5wnc27cRzQ74_mxsgy5GTPfMq4AoKkKpAufjgqiRfIfp7TwwkFl-1iavh-t0_J4Qa1P7-7_tGIb8-m5S57BU Oct 04 18:32:45.240662 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 18:32:45.240662 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 18:32:45.240662 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 18:32:45.240662 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 18:32:45.240662 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 18:32:45.240662 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 18:32:45.240662 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: b02ea5c6a82c4215b269b905193e1066 Oct 04 18:32:45.240662 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1887157482 Oct 04 18:32:45.240662 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 18:32:45.240662 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 18:32:45.242233 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/b02ea5c6a82c4215b269b905193e1066"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_b02ea5c6a82c4215b269b905193e1066"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b02ea5c6a82c4215b269b905193e1066"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b02ea5c6a82c4215b269b905193e1066"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:32:45.242233 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1887157482 Oct 04 18:32:45.242233 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: b02ea5c6a82c4215b269b905193e1066 Oct 04 18:32:45.242233 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1887157482 Oct 04 18:32:45.242233 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-FlavorsAccessNegativeTestJSON-1887157482-project Oct 04 18:32:45.242233 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 18:32:45.242233 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 18:32:45.242233 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: 5b6712f1e44849518ecee0cbe3e9b9a8 Oct 04 18:32:45.242233 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1887157482-project Oct 04 18:32:45.242233 n-d-851028-13 devstack@n-api.service[123595]: Oct 04 18:32:45.242233 n-d-851028-13 devstack@n-api.service[123595]: {"removeTenantAccess": {"tenant": "b02ea5c6a82c4215b269b905193e1066"}} Oct 04 18:32:45.242233 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 18:32:45.243711 n-d-851028-13 devstack@n-api.service[123595]: exception: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 04 18:32:45.243711 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': '1225929511', 'body': {'removeTenantAccess': {'tenant': 'b02ea5c6a82c4215b269b905193e1066'}}} Oct 04 18:32:45.243711 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:32:45.243711 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:45.243711 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:32:45.243711 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:32:45.243711 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:32:45.243711 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:32:45.243711 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:32:45.243711 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:32:45.243711 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:32:45.243711 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:32:45.243711 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 91, in _remove_tenant_access Oct 04 18:32:45.243711 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi context.can( Oct 04 18:32:45.243711 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 18:32:45.243711 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 18:32:45.243711 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 18:32:45.243711 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 18:32:45.243711 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:32:45.243711 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:32:45.245096 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:32:45.245096 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:32:45.245096 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 18:32:45.245096 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 18:32:45.245096 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 18:32:45.245096 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 18:32:45.245096 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 18:32:45.245096 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 18:32:45.245096 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 04 18:32:45.245096 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:32:45.245096 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:45.245096 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:32:45.245096 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:45.245096 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:32:45.245096 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:32:45.245096 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 18:32:45.245096 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 18:32:45.245096 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 04 18:32:45.245096 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:32:45.247364 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-d94f9e56-97fc-42a7-93fb-866e1ca10473 tempest-FlavorsAccessNegativeTestJSON-1887157482 tempest-FlavorsAccessNegativeTestJSON-1887157482-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:32:45.249452 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-d94f9e56-97fc-42a7-93fb-866e1ca10473 tempest-FlavorsAccessNegativeTestJSON-1887157482 tempest-FlavorsAccessNegativeTestJSON-1887157482-project] 10.222.0.43 "POST /compute/v2.1/flavors/1225929511/action" status: 403 len: 133 microversion: 2.1 time: 0.038512 Oct 04 18:32:45.253239 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 219/472] 10.222.0.43 () {60 vars in 1200 bytes} [Tue Oct 4 18:32:45 2022] POST /compute/v2.1/flavors/1225929511/action => generated 133 bytes in 43 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:32:45.268234 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-904e8e06-d69c-4325-8316-dc752b07fcb2 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:45.274646 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-904e8e06-d69c-4325-8316-dc752b07fcb2 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] [instance: 6251d93c-aab7-43cc-9be0-212545cf2b01] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:45.304171 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-904e8e06-d69c-4325-8316-dc752b07fcb2 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:45.306805 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-904e8e06-d69c-4325-8316-dc752b07fcb2 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:45.307435 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-904e8e06-d69c-4325-8316-dc752b07fcb2 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:45.309490 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-904e8e06-d69c-4325-8316-dc752b07fcb2 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:45.314382 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-904e8e06-d69c-4325-8316-dc752b07fcb2 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:45.316059 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-904e8e06-d69c-4325-8316-dc752b07fcb2 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:45.878806 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-904e8e06-d69c-4325-8316-dc752b07fcb2 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7db99f361654711bea7f1b2c404d312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7adedcdb9c3485ea2738c00e25aa3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:45.891412 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-904e8e06-d69c-4325-8316-dc752b07fcb2 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] 10.222.0.43 "GET /compute/v2.1/servers/6251d93c-aab7-43cc-9be0-212545cf2b01" status: 200 len: 1319 microversion: 2.1 time: 0.635383 Oct 04 18:32:45.892726 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 220/473] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:45 2022] GET /compute/v2.1/servers/6251d93c-aab7-43cc-9be0-212545cf2b01 => generated 1319 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:45.909058 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-b1d5197e-8df4-43fc-af2f-0b2a8e8f6c28 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:45.922721 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-b1d5197e-8df4-43fc-af2f-0b2a8e8f6c28 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] [instance: 918d6106-9c7c-4046-9cdd-319afe4cdb25] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:45.930110 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b1d5197e-8df4-43fc-af2f-0b2a8e8f6c28 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:45.930896 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b1d5197e-8df4-43fc-af2f-0b2a8e8f6c28 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:45.931455 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b1d5197e-8df4-43fc-af2f-0b2a8e8f6c28 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:45.932320 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b1d5197e-8df4-43fc-af2f-0b2a8e8f6c28 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:45.933529 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b1d5197e-8df4-43fc-af2f-0b2a8e8f6c28 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:45.937000 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b1d5197e-8df4-43fc-af2f-0b2a8e8f6c28 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:46.230583 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-b1d5197e-8df4-43fc-af2f-0b2a8e8f6c28 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb7b0ce49ec438f9a60b79bdb2ac164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94ae6e2cb75d410d8029aa49909c973b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:46.244941 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-b1d5197e-8df4-43fc-af2f-0b2a8e8f6c28 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] 10.222.0.43 "GET /compute/v2.1/servers/918d6106-9c7c-4046-9cdd-319afe4cdb25" status: 200 len: 1321 microversion: 2.1 time: 0.350670 Oct 04 18:32:46.249337 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 221/474] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:45 2022] GET /compute/v2.1/servers/918d6106-9c7c-4046-9cdd-319afe4cdb25 => generated 1321 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:46.267141 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-61a716be-0ec2-4870-b48e-bc9c8c680895 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1099624345", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "1259901898", "adminPass": "***", "networks": [{"uuid": "82bb2889-3863-48eb-88d8-9122cbd1ee80"}], "security_groups": [{"name": "tempest-securitygroup--901927384"}], "key_name": "tempest-keypair-1885965875", "user_data": "}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:46.375834 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-6567de31-ad2e-487b-828a-f849a7da4722 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] 10.222.0.43 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 2.529207 Oct 04 18:32:46.376547 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 254/475] 10.222.0.43 () {60 vars in 1170 bytes} [Tue Oct 4 18:32:43 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 2531 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:32:46.381820 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-ca07f2aa-295a-4f19-9027-2600d4d7a3a8 tempest-FlavorsAccessNegativeTestJSON-1942833929 tempest-FlavorsAccessNegativeTestJSON-1942833929-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "b02ea5c6a82c4215b269b905193e1066"}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:46.546827 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.network.neutron [None req-61a716be-0ec2-4870-b48e-bc9c8c680895 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] validate_networks() for [('82bb2889-3863-48eb-88d8-9122cbd1ee80', None, None, None, None, None)] {{(pid=123595) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:32:46.925142 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-ca07f2aa-295a-4f19-9027-2600d4d7a3a8 tempest-FlavorsAccessNegativeTestJSON-1942833929 tempest-FlavorsAccessNegativeTestJSON-1942833929-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors/1225929511/action" status: 200 len: 21 microversion: 2.1 time: 0.547008 Oct 04 18:32:46.933538 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 255/476] 10.222.0.43 () {60 vars in 1200 bytes} [Tue Oct 4 18:32:46 2022] POST /compute/v2.1/flavors/1225929511/action => generated 21 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:32:46.942196 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-2b6684e2-9997-4307-9a6d-4e284a02ba4f req-9c2ce135-53c5-4557-9c0e-62514457eef2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "918d6106-9c7c-4046-9cdd-319afe4cdb25", "name": "network-vif-plugged", "status": "completed", "tag": "bc88b509-77d8-4be9-9d0b-1aa4318894e1"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:46.966124 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-2b6684e2-9997-4307-9a6d-4e284a02ba4f req-9c2ce135-53c5-4557-9c0e-62514457eef2 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:46.966905 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-2b6684e2-9997-4307-9a6d-4e284a02ba4f req-9c2ce135-53c5-4557-9c0e-62514457eef2 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:46.967365 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-2b6684e2-9997-4307-9a6d-4e284a02ba4f req-9c2ce135-53c5-4557-9c0e-62514457eef2 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:47.000883 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-2b6684e2-9997-4307-9a6d-4e284a02ba4f req-9c2ce135-53c5-4557-9c0e-62514457eef2 service nova] Creating event network-vif-plugged:bc88b509-77d8-4be9-9d0b-1aa4318894e1 for instance 918d6106-9c7c-4046-9cdd-319afe4cdb25 on n-h1-851028-13 Oct 04 18:32:47.013478 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-2b6684e2-9997-4307-9a6d-4e284a02ba4f req-9c2ce135-53c5-4557-9c0e-62514457eef2 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078037 Oct 04 18:32:47.016868 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 256/477] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:32:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:32:47.032364 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-ab044225-a3a6-46d9-9a3b-2e7b6b772af7 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:47.033280 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-ab044225-a3a6-46d9-9a3b-2e7b6b772af7 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] [instance: 84e0414b-a39f-4bfe-bc9d-c170ceb34d15] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:47.089250 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ab044225-a3a6-46d9-9a3b-2e7b6b772af7 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:47.089761 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ab044225-a3a6-46d9-9a3b-2e7b6b772af7 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:47.090208 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ab044225-a3a6-46d9-9a3b-2e7b6b772af7 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:47.090937 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ab044225-a3a6-46d9-9a3b-2e7b6b772af7 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:47.091400 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ab044225-a3a6-46d9-9a3b-2e7b6b772af7 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:47.095945 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ab044225-a3a6-46d9-9a3b-2e7b6b772af7 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:47.303546 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-ab044225-a3a6-46d9-9a3b-2e7b6b772af7 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:47.316511 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-ab044225-a3a6-46d9-9a3b-2e7b6b772af7 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:47.322660 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-ab044225-a3a6-46d9-9a3b-2e7b6b772af7 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:47.342284 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-ab044225-a3a6-46d9-9a3b-2e7b6b772af7 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] 10.222.0.43 "GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15" status: 200 len: 1510 microversion: 2.91 time: 0.323467 Oct 04 18:32:47.343474 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 257/478] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:32:47 2022] GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15 => generated 1510 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:32:47.358295 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-ec657d92-6c32-4045-af60-b5e6b13cbed9 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Action: 'action', calling method: .version_select at 0x7fb22583f940>, body: {"addFloatingIp": {"address": "172.25.8.50"}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:47.362587 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-ec657d92-6c32-4045-af60-b5e6b13cbed9 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] [instance: 606aebcb-2b6a-469f-a578-91325770ab4b] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:47.389696 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ec657d92-6c32-4045-af60-b5e6b13cbed9 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:47.400484 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ec657d92-6c32-4045-af60-b5e6b13cbed9 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:47.401984 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ec657d92-6c32-4045-af60-b5e6b13cbed9 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:47.403059 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ec657d92-6c32-4045-af60-b5e6b13cbed9 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:47.425468 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ec657d92-6c32-4045-af60-b5e6b13cbed9 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:47.426211 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ec657d92-6c32-4045-af60-b5e6b13cbed9 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:47.545245 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ec657d92-6c32-4045-af60-b5e6b13cbed9 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Acquiring lock "refresh_cache-606aebcb-2b6a-469f-a578-91325770ab4b" {{(pid=123596) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 04 18:32:47.545899 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ec657d92-6c32-4045-af60-b5e6b13cbed9 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Acquired lock "refresh_cache-606aebcb-2b6a-469f-a578-91325770ab4b" {{(pid=123596) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 04 18:32:48.089206 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-61a716be-0ec2-4870-b48e-bc9c8c680895 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Flavor limits 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:32:48.089602 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-61a716be-0ec2-4870-b48e-bc9c8c680895 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Image limits 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:32:48.089819 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-61a716be-0ec2-4870-b48e-bc9c8c680895 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Flavor pref 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:32:48.090534 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-61a716be-0ec2-4870-b48e-bc9c8c680895 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Image pref 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:32:48.091116 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-61a716be-0ec2-4870-b48e-bc9c8c680895 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:32:48.104716 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-61a716be-0ec2-4870-b48e-bc9c8c680895 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:48.105246 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-61a716be-0ec2-4870-b48e-bc9c8c680895 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:48.105695 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-61a716be-0ec2-4870-b48e-bc9c8c680895 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:48.106507 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-61a716be-0ec2-4870-b48e-bc9c8c680895 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:48.106918 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-61a716be-0ec2-4870-b48e-bc9c8c680895 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:48.107348 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-61a716be-0ec2-4870-b48e-bc9c8c680895 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:48.151108 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-61a716be-0ec2-4870-b48e-bc9c8c680895 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Getting quotas for project 82c615a05e8a4cd086f2e580529fb1d4. Resources: {'ram', 'cores', 'instances'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:32:48.166485 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-61a716be-0ec2-4870-b48e-bc9c8c680895 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Getting quotas for user f8ea2088d8124b149187a1c140d3be88 and project 82c615a05e8a4cd086f2e580529fb1d4. Resources: {'ram', 'cores', 'instances'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:32:48.172180 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=7,nova_api:SAVEPOINT=2,nova_api:RELEASE=2,nova_api:DELETE=7,nova_api:UPDATE=1 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:32:48.193507 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-61a716be-0ec2-4870-b48e-bc9c8c680895 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Going to run 1 instances... {{(pid=123595) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:32:48.197037 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-61a716be-0ec2-4870-b48e-bc9c8c680895 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] [instance: fbe51dae-877b-4377-9f23-9a129775c317] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e8943ec5-4038-4d4b-b9b9-2415a79f5243',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=123595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:32:48.316824 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-61a716be-0ec2-4870-b48e-bc9c8c680895 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.063646 Oct 04 18:32:48.318273 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 222/479] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 18:32:46 2022] POST /compute/v2.1/servers => generated 401 bytes in 2068 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:32:48.356930 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-03278b12-7419-46ac-902f-1ec47d79edde tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:48.362842 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-03278b12-7419-46ac-902f-1ec47d79edde tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] [instance: 6251d93c-aab7-43cc-9be0-212545cf2b01] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:48.382341 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-03278b12-7419-46ac-902f-1ec47d79edde tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:48.383067 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-03278b12-7419-46ac-902f-1ec47d79edde tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:48.385302 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-03278b12-7419-46ac-902f-1ec47d79edde tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:48.386433 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-03278b12-7419-46ac-902f-1ec47d79edde tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:48.387259 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-03278b12-7419-46ac-902f-1ec47d79edde tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:48.387856 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-03278b12-7419-46ac-902f-1ec47d79edde tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:48.521755 n-d-851028-13 devstack@n-api.service[123596]: DEBUG neutronclient.v2_0.client [None req-ec657d92-6c32-4045-af60-b5e6b13cbed9 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.25.8.50 (30dde387-8323-4545-8128-5ca9224fbadf) with port 101c6584-c112-496c-8a18-4440b7f3aec5 using fixed IP 172.20.0.8, as that fixed IP already has a floating IP on external network 73f4d4fd-920f-4232-90c7-c4abfd77b225.", "detail": ""}} {{(pid=123596) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 18:32:48.522790 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ec657d92-6c32-4045-af60-b5e6b13cbed9 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Releasing lock "refresh_cache-606aebcb-2b6a-469f-a578-91325770ab4b" {{(pid=123596) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 04 18:32:48.524386 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-ec657d92-6c32-4045-af60-b5e6b13cbed9 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] HTTP exception thrown: Cannot associate floating IP 172.25.8.50 (30dde387-8323-4545-8128-5ca9224fbadf) with port 101c6584-c112-496c-8a18-4440b7f3aec5 using fixed IP 172.20.0.8, as that fixed IP already has a floating IP on external network 73f4d4fd-920f-4232-90c7-c4abfd77b225. Oct 04 18:32:48.524386 n-d-851028-13 devstack@n-api.service[123596]: Neutron server returns request_ids: ['req-4c282933-ceb2-423f-95b2-366d4cd50e48'] Oct 04 18:32:48.542691 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-ec657d92-6c32-4045-af60-b5e6b13cbed9 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Request method failure captured: Oct 04 18:32:48.542691 n-d-851028-13 devstack@n-api.service[123596]: request: POST /compute/v2.1/servers/606aebcb-2b6a-469f-a578-91325770ab4b/action HTTP/1.1 Oct 04 18:32:48.542691 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:32:48.542691 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:32:48.542691 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:32:48.542691 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 45 Oct 04 18:32:48.542691 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:32:48.542691 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:32:48.542691 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:32:48.542691 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:32:48.542691 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPHwvbOQqnDjvNFqcoO2SDu0TzYjAt5AyP3sChpg5Gr0w9tnlVGL1WnZBZGfhAGi45qS58eKNHB7XSOB8h3QYe_LH6aBK6h8b1Urcm7MaId1M56GN2pIau77L_IM8sT6CwZNggL3X1Mdk4EFReH0aW3i0ckLhikk7zf0FRhKVnOekuio Oct 04 18:32:48.542691 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:32:48.542691 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:32:48.542691 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:32:48.542691 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:32:48.542691 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:32:48.542691 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:32:48.542691 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: 38c636de1e6b42868f1f58e46fd4a3f0 Oct 04 18:32:48.542691 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 Oct 04 18:32:48.542691 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 18:32:48.542691 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 18:32:48.545832 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/38c636de1e6b42868f1f58e46fd4a3f0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_38c636de1e6b42868f1f58e46fd4a3f0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/38c636de1e6b42868f1f58e46fd4a3f0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/38c636de1e6b42868f1f58e46fd4a3f0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:32:48.545832 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 Oct 04 18:32:48.545832 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: 38c636de1e6b42868f1f58e46fd4a3f0 Oct 04 18:32:48.545832 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 Oct 04 18:32:48.545832 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project Oct 04 18:32:48.545832 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:32:48.545832 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:32:48.545832 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: f207a188e3fa4987b9fe4dd773ad03b9 Oct 04 18:32:48.545832 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project Oct 04 18:32:48.545832 n-d-851028-13 devstack@n-api.service[123596]: Oct 04 18:32:48.545832 n-d-851028-13 devstack@n-api.service[123596]: {"addFloatingIp": {"address": "172.25.8.50"}} Oct 04 18:32:48.545832 n-d-851028-13 devstack@n-api.service[123596]: method: Oct 04 18:32:48.547280 n-d-851028-13 devstack@n-api.service[123596]: exception: Cannot associate floating IP 172.25.8.50 (30dde387-8323-4545-8128-5ca9224fbadf) with port 101c6584-c112-496c-8a18-4440b7f3aec5 using fixed IP 172.20.0.8, as that fixed IP already has a floating IP on external network 73f4d4fd-920f-4232-90c7-c4abfd77b225. Oct 04 18:32:48.547280 n-d-851028-13 devstack@n-api.service[123596]: Neutron server returns request_ids: ['req-4c282933-ceb2-423f-95b2-366d4cd50e48'] Oct 04 18:32:48.547280 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': '606aebcb-2b6a-469f-a578-91325770ab4b', 'body': {'addFloatingIp': {'address': '172.25.8.50'}}} Oct 04 18:32:48.547280 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:32:48.547280 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:48.547280 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2703, in associate_floating_ip Oct 04 18:32:48.547280 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi client.update_floatingip(fip['id'], {'floatingip': param}) Oct 04 18:32:48.547280 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:32:48.547280 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:32:48.547280 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1016, in update_floatingip Oct 04 18:32:48.547280 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return self._update_resource(self.floatingip_path % (floatingip), Oct 04 18:32:48.547280 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:32:48.547280 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:32:48.547280 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 2548, in _update_resource Oct 04 18:32:48.547280 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return self.put(path, **kwargs) Oct 04 18:32:48.547280 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:32:48.547280 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:32:48.549826 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 365, in put Oct 04 18:32:48.549826 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return self.retry_request("PUT", action, body=body, Oct 04 18:32:48.549826 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:32:48.549826 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:32:48.549826 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 18:32:48.549826 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 18:32:48.549826 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:32:48.549826 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:32:48.549826 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 18:32:48.549826 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 18:32:48.549826 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:32:48.549826 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:32:48.549826 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 18:32:48.549826 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 18:32:48.549826 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 18:32:48.549826 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 18:32:48.552374 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Cannot associate floating IP 172.25.8.50 (30dde387-8323-4545-8128-5ca9224fbadf) with port 101c6584-c112-496c-8a18-4440b7f3aec5 using fixed IP 172.20.0.8, as that fixed IP already has a floating IP on external network 73f4d4fd-920f-4232-90c7-c4abfd77b225. Oct 04 18:32:48.552374 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4c282933-ceb2-423f-95b2-366d4cd50e48'] Oct 04 18:32:48.552374 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:32:48.552374 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:48.552374 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:32:48.552374 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:48.552374 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Oct 04 18:32:48.552374 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Oct 04 18:32:48.552374 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Oct 04 18:32:48.552374 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Oct 04 18:32:48.552374 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2705, in associate_floating_ip Oct 04 18:32:48.552374 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpAssociateFailed(str(e)) Oct 04 18:32:48.552374 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpAssociateFailed: Cannot associate floating IP 172.25.8.50 (30dde387-8323-4545-8128-5ca9224fbadf) with port 101c6584-c112-496c-8a18-4440b7f3aec5 using fixed IP 172.20.0.8, as that fixed IP already has a floating IP on external network 73f4d4fd-920f-4232-90c7-c4abfd77b225. Oct 04 18:32:48.552374 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4c282933-ceb2-423f-95b2-366d4cd50e48'] Oct 04 18:32:48.552374 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:32:48.552374 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:48.556290 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:32:48.556290 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:48.556290 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:32:48.556290 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:32:48.556290 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:32:48.556290 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:32:48.556290 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:32:48.556290 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:32:48.556290 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:32:48.556290 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:32:48.556290 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:32:48.556290 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:32:48.556290 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 246, in _add_floating_ip Oct 04 18:32:48.556290 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=e.format_message()) Oct 04 18:32:48.556290 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Cannot associate floating IP 172.25.8.50 (30dde387-8323-4545-8128-5ca9224fbadf) with port 101c6584-c112-496c-8a18-4440b7f3aec5 using fixed IP 172.20.0.8, as that fixed IP already has a floating IP on external network 73f4d4fd-920f-4232-90c7-c4abfd77b225. Oct 04 18:32:48.556290 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4c282933-ceb2-423f-95b2-366d4cd50e48'] Oct 04 18:32:48.556290 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:32:48.556290 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:48.559153 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:32:48.559153 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:48.559153 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:32:48.559153 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:32:48.559153 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:32:48.559153 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:32:48.559153 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot associate floating IP 172.25.8.50 (30dde387-8323-4545-8128-5ca9224fbadf) with port 101c6584-c112-496c-8a18-4440b7f3aec5 using fixed IP 172.20.0.8, as that fixed IP already has a floating IP on external network 73f4d4fd-920f-4232-90c7-c4abfd77b225. Oct 04 18:32:48.559153 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4c282933-ceb2-423f-95b2-366d4cd50e48'] Oct 04 18:32:48.559153 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:32:48.559153 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-ec657d92-6c32-4045-af60-b5e6b13cbed9 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Returning 400 to user: Cannot associate floating IP 172.25.8.50 (30dde387-8323-4545-8128-5ca9224fbadf) with port 101c6584-c112-496c-8a18-4440b7f3aec5 using fixed IP 172.20.0.8, as that fixed IP already has a floating IP on external network 73f4d4fd-920f-4232-90c7-c4abfd77b225. Oct 04 18:32:48.559153 n-d-851028-13 devstack@n-api.service[123596]: Neutron server returns request_ids: ['req-4c282933-ceb2-423f-95b2-366d4cd50e48'] {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:32:48.559861 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-ec657d92-6c32-4045-af60-b5e6b13cbed9 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] 10.222.0.43 "POST /compute/v2.1/servers/606aebcb-2b6a-469f-a578-91325770ab4b/action" status: 400 len: 380 microversion: 2.1 time: 1.201725 Oct 04 18:32:48.559861 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 258/480] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 18:32:47 2022] POST /compute/v2.1/servers/606aebcb-2b6a-469f-a578-91325770ab4b/action => generated 380 bytes in 1205 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:32:48.559861 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-2c320c52-c527-46f5-81de-50965ce42d15 tempest-FlavorsAccessNegativeTestJSON-1942833929 tempest-FlavorsAccessNegativeTestJSON-1942833929-project-admin] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:48.613938 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-2c320c52-c527-46f5-81de-50965ce42d15 tempest-FlavorsAccessNegativeTestJSON-1942833929 tempest-FlavorsAccessNegativeTestJSON-1942833929-project-admin] 10.222.0.43 "DELETE /compute/v2.1/flavors/1225929511" status: 202 len: 0 microversion: 2.1 time: 0.063139 Oct 04 18:32:48.614839 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 259/481] 10.222.0.43 () {58 vars in 1161 bytes} [Tue Oct 4 18:32:48 2022] DELETE /compute/v2.1/flavors/1225929511 => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:32:48.629808 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-0d10bceb-d12a-43c6-a5c0-7f652ad03433 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:48.630625 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-0d10bceb-d12a-43c6-a5c0-7f652ad03433 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] [instance: 918d6106-9c7c-4046-9cdd-319afe4cdb25] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:48.653486 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0d10bceb-d12a-43c6-a5c0-7f652ad03433 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:48.655234 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0d10bceb-d12a-43c6-a5c0-7f652ad03433 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:48.659660 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0d10bceb-d12a-43c6-a5c0-7f652ad03433 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:48.660910 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0d10bceb-d12a-43c6-a5c0-7f652ad03433 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:48.662068 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0d10bceb-d12a-43c6-a5c0-7f652ad03433 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:48.662794 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0d10bceb-d12a-43c6-a5c0-7f652ad03433 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:49.026489 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-0d10bceb-d12a-43c6-a5c0-7f652ad03433 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb7b0ce49ec438f9a60b79bdb2ac164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94ae6e2cb75d410d8029aa49909c973b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:49.036684 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-0d10bceb-d12a-43c6-a5c0-7f652ad03433 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] 10.222.0.43 "GET /compute/v2.1/servers/918d6106-9c7c-4046-9cdd-319afe4cdb25" status: 200 len: 1321 microversion: 2.1 time: 0.420236 Oct 04 18:32:49.038047 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 260/482] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:48 2022] GET /compute/v2.1/servers/918d6106-9c7c-4046-9cdd-319afe4cdb25 => generated 1321 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:49.053806 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-6e684268-9cbb-4094-9d3b-4148da6e6104 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:49.054741 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-6e684268-9cbb-4094-9d3b-4148da6e6104 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] [instance: fbe51dae-877b-4377-9f23-9a129775c317] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:49.156781 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-6e684268-9cbb-4094-9d3b-4148da6e6104 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ea2088d8124b149187a1c140d3be88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82c615a05e8a4cd086f2e580529fb1d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:49.165723 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-6e684268-9cbb-4094-9d3b-4148da6e6104 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] 10.222.0.43 "GET /compute/v2.1/servers/fbe51dae-877b-4377-9f23-9a129775c317" status: 200 len: 1265 microversion: 2.1 time: 0.125774 Oct 04 18:32:49.166368 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 261/483] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:49 2022] GET /compute/v2.1/servers/fbe51dae-877b-4377-9f23-9a129775c317 => generated 1265 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:49.171849 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-27c514af-de90-4ab6-a5ed-69a72c445093 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:49.172823 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-27c514af-de90-4ab6-a5ed-69a72c445093 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] [instance: 84e0414b-a39f-4bfe-bc9d-c170ceb34d15] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:49.191289 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-27c514af-de90-4ab6-a5ed-69a72c445093 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:49.192144 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-27c514af-de90-4ab6-a5ed-69a72c445093 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:49.192753 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-27c514af-de90-4ab6-a5ed-69a72c445093 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:49.194042 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-03278b12-7419-46ac-902f-1ec47d79edde tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7db99f361654711bea7f1b2c404d312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7adedcdb9c3485ea2738c00e25aa3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:49.196233 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-27c514af-de90-4ab6-a5ed-69a72c445093 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:49.196892 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-27c514af-de90-4ab6-a5ed-69a72c445093 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:49.200391 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-27c514af-de90-4ab6-a5ed-69a72c445093 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:49.205790 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-03278b12-7419-46ac-902f-1ec47d79edde tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] 10.222.0.43 "GET /compute/v2.1/servers/6251d93c-aab7-43cc-9be0-212545cf2b01" status: 200 len: 1468 microversion: 2.1 time: 0.886112 Oct 04 18:32:49.215260 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 223/484] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:48 2022] GET /compute/v2.1/servers/6251d93c-aab7-43cc-9be0-212545cf2b01 => generated 1468 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:49.240358 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-03c249ac-9239-4ead-bec8-cafe4eb44538 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Calling method '.version_select at 0x7fb2240ee820>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:49.378920 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-27c514af-de90-4ab6-a5ed-69a72c445093 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:49.393496 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-27c514af-de90-4ab6-a5ed-69a72c445093 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:49.396810 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-27c514af-de90-4ab6-a5ed-69a72c445093 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:49.409164 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-27c514af-de90-4ab6-a5ed-69a72c445093 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] 10.222.0.43 "GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15" status: 200 len: 1531 microversion: 2.91 time: 0.241329 Oct 04 18:32:49.413189 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 262/485] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:32:49 2022] GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15 => generated 1531 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:32:49.422750 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-4dad6258-a14b-49b9-a1f6-78217f0d8672 tempest-FlavorsAccessNegativeTestJSON-1942833929 tempest-FlavorsAccessNegativeTestJSON-1942833929-project-admin] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:49.468079 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-4dad6258-a14b-49b9-a1f6-78217f0d8672 tempest-FlavorsAccessNegativeTestJSON-1942833929 tempest-FlavorsAccessNegativeTestJSON-1942833929-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 5818 microversion: 2.1 time: 0.049363 Oct 04 18:32:49.469275 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 263/486] 10.222.0.43 () {58 vars in 1146 bytes} [Tue Oct 4 18:32:49 2022] GET /compute/v2.1/flavors/detail => generated 5818 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:49.475409 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-b441eb4b-1637-4e00-98ef-050568cf51b6 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:49.481343 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-b441eb4b-1637-4e00-98ef-050568cf51b6 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a7db99f361654711bea7f1b2c404d312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7adedcdb9c3485ea2738c00e25aa3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:49.482650 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-b441eb4b-1637-4e00-98ef-050568cf51b6 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Searching by: {'reservation_id': 'r-wuby48wx', 'deleted': False, 'project_id': 'e7adedcdb9c3485ea2738c00e25aa3fd'} {{(pid=123596) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:32:49.488526 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=4,nova_api:SAVEPOINT=1,nova_api:RELEASE=1,nova_api:DELETE=9 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:32:49.501634 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b441eb4b-1637-4e00-98ef-050568cf51b6 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:49.502289 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b441eb4b-1637-4e00-98ef-050568cf51b6 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:49.502995 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b441eb4b-1637-4e00-98ef-050568cf51b6 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:49.504237 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b441eb4b-1637-4e00-98ef-050568cf51b6 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:49.505274 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b441eb4b-1637-4e00-98ef-050568cf51b6 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:49.505891 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b441eb4b-1637-4e00-98ef-050568cf51b6 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:49.703669 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.multi_cell_list [None req-b441eb4b-1637-4e00-98ef-050568cf51b6 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=123596) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 18:32:49.907551 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-b441eb4b-1637-4e00-98ef-050568cf51b6 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7db99f361654711bea7f1b2c404d312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7adedcdb9c3485ea2738c00e25aa3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:49.943300 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b441eb4b-1637-4e00-98ef-050568cf51b6 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:49.944233 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b441eb4b-1637-4e00-98ef-050568cf51b6 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:49.945074 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b441eb4b-1637-4e00-98ef-050568cf51b6 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:50.174096 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-b441eb4b-1637-4e00-98ef-050568cf51b6 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] 10.222.0.43 "GET /compute/v2.1/servers/detail?reservation_id=r-wuby48wx" status: 200 len: 2930 microversion: 2.1 time: 0.703302 Oct 04 18:32:50.174712 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 264/487] 10.222.0.43 () {58 vars in 1197 bytes} [Tue Oct 4 18:32:49 2022] GET /compute/v2.1/servers/detail?reservation_id=r-wuby48wx => generated 2930 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:50.743932 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-53fc0a3e-92e2-4f2d-89c9-4be5e6e23d0a tempest-UnshelveToHostMultiNodesTest-313056567 tempest-UnshelveToHostMultiNodesTest-313056567-project-admin] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:50.744612 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-53fc0a3e-92e2-4f2d-89c9-4be5e6e23d0a tempest-UnshelveToHostMultiNodesTest-313056567 tempest-UnshelveToHostMultiNodesTest-313056567-project-admin] [instance: 84e0414b-a39f-4bfe-bc9d-c170ceb34d15] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:50.755276 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-53fc0a3e-92e2-4f2d-89c9-4be5e6e23d0a tempest-UnshelveToHostMultiNodesTest-313056567 tempest-UnshelveToHostMultiNodesTest-313056567-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:50.755770 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-53fc0a3e-92e2-4f2d-89c9-4be5e6e23d0a tempest-UnshelveToHostMultiNodesTest-313056567 tempest-UnshelveToHostMultiNodesTest-313056567-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:50.756210 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-53fc0a3e-92e2-4f2d-89c9-4be5e6e23d0a tempest-UnshelveToHostMultiNodesTest-313056567 tempest-UnshelveToHostMultiNodesTest-313056567-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:50.757445 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-53fc0a3e-92e2-4f2d-89c9-4be5e6e23d0a tempest-UnshelveToHostMultiNodesTest-313056567 tempest-UnshelveToHostMultiNodesTest-313056567-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:50.757917 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-53fc0a3e-92e2-4f2d-89c9-4be5e6e23d0a tempest-UnshelveToHostMultiNodesTest-313056567 tempest-UnshelveToHostMultiNodesTest-313056567-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:50.758482 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-53fc0a3e-92e2-4f2d-89c9-4be5e6e23d0a tempest-UnshelveToHostMultiNodesTest-313056567 tempest-UnshelveToHostMultiNodesTest-313056567-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:50.895204 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.objects.instance [None req-53fc0a3e-92e2-4f2d-89c9-4be5e6e23d0a tempest-UnshelveToHostMultiNodesTest-313056567 tempest-UnshelveToHostMultiNodesTest-313056567-project-admin] Lazy-loading 'services' on Instance uuid 84e0414b-a39f-4bfe-bc9d-c170ceb34d15 {{(pid=123596) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:32:51.028367 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-53fc0a3e-92e2-4f2d-89c9-4be5e6e23d0a tempest-UnshelveToHostMultiNodesTest-313056567 tempest-UnshelveToHostMultiNodesTest-313056567-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15" status: 200 len: 1938 microversion: 2.91 time: 0.852503 Oct 04 18:32:51.049819 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 265/488] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:32:50 2022] GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15 => generated 1938 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:32:51.089601 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-b968b068-b63d-437c-94c7-3ef979713fa4 tempest-FlavorsAccessNegativeTestJSON-1942833929 tempest-FlavorsAccessNegativeTestJSON-1942833929-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-232914344", "id": 744725950, "os-flavor-access:is_public": "False"}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:51.136272 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-b968b068-b63d-437c-94c7-3ef979713fa4 tempest-FlavorsAccessNegativeTestJSON-1942833929 tempest-FlavorsAccessNegativeTestJSON-1942833929-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.085047 Oct 04 18:32:51.139513 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 266/489] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 18:32:51 2022] POST /compute/v2.1/flavors => generated 435 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:32:51.152448 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-2cbda9d2-8d09-4d9e-9025-e48e43f53037 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:51.153577 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-2cbda9d2-8d09-4d9e-9025-e48e43f53037 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] [instance: 918d6106-9c7c-4046-9cdd-319afe4cdb25] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:51.176621 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2cbda9d2-8d09-4d9e-9025-e48e43f53037 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:51.177494 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2cbda9d2-8d09-4d9e-9025-e48e43f53037 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:51.180649 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2cbda9d2-8d09-4d9e-9025-e48e43f53037 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:51.182878 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2cbda9d2-8d09-4d9e-9025-e48e43f53037 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:51.185042 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2cbda9d2-8d09-4d9e-9025-e48e43f53037 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:51.186653 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2cbda9d2-8d09-4d9e-9025-e48e43f53037 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:51.993978 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-2cbda9d2-8d09-4d9e-9025-e48e43f53037 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb7b0ce49ec438f9a60b79bdb2ac164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94ae6e2cb75d410d8029aa49909c973b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:52.009036 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-2cbda9d2-8d09-4d9e-9025-e48e43f53037 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] 10.222.0.43 "GET /compute/v2.1/servers/918d6106-9c7c-4046-9cdd-319afe4cdb25" status: 200 len: 1471 microversion: 2.1 time: 0.868108 Oct 04 18:32:52.012791 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 267/490] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:51 2022] GET /compute/v2.1/servers/918d6106-9c7c-4046-9cdd-319afe4cdb25 => generated 1471 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:52.021603 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-2e63d702-74df-4eb5-8c2a-4fd96b3760bc tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:52.028204 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-2e63d702-74df-4eb5-8c2a-4fd96b3760bc tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] [instance: fbe51dae-877b-4377-9f23-9a129775c317] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:52.043156 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2e63d702-74df-4eb5-8c2a-4fd96b3760bc tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:52.044840 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2e63d702-74df-4eb5-8c2a-4fd96b3760bc tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:52.045631 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2e63d702-74df-4eb5-8c2a-4fd96b3760bc tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:52.047058 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2e63d702-74df-4eb5-8c2a-4fd96b3760bc tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:52.047725 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2e63d702-74df-4eb5-8c2a-4fd96b3760bc tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:52.049906 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2e63d702-74df-4eb5-8c2a-4fd96b3760bc tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:52.174183 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-2e63d702-74df-4eb5-8c2a-4fd96b3760bc tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ea2088d8124b149187a1c140d3be88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82c615a05e8a4cd086f2e580529fb1d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:52.183693 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-2e63d702-74df-4eb5-8c2a-4fd96b3760bc tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] 10.222.0.43 "GET /compute/v2.1/servers/fbe51dae-877b-4377-9f23-9a129775c317" status: 200 len: 1323 microversion: 2.1 time: 0.169291 Oct 04 18:32:52.189344 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 268/491] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:52 2022] GET /compute/v2.1/servers/fbe51dae-877b-4377-9f23-9a129775c317 => generated 1323 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:52.194314 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-cb376c82-946f-4a6f-a194-9651b7e74265 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:52.246309 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.compute.server_groups [None req-cb376c82-946f-4a6f-a194-9651b7e74265 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Querying cell 66287c68-6a08-453f-953b-bd2446fe0d25(cell1) for 2 instances {{(pid=123596) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 04 18:32:52.252111 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cb376c82-946f-4a6f-a194-9651b7e74265 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:52.252992 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cb376c82-946f-4a6f-a194-9651b7e74265 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:52.253711 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cb376c82-946f-4a6f-a194-9651b7e74265 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:52.296133 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-03c249ac-9239-4ead-bec8-cafe4eb44538 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] 10.222.0.43 "DELETE /compute/v2.1/os-floating-ips/30dde387-8323-4545-8128-5ca9224fbadf" status: 202 len: 0 microversion: 2.1 time: 3.078422 Oct 04 18:32:52.297095 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 224/492] 10.222.0.43 () {58 vars in 1263 bytes} [Tue Oct 4 18:32:49 2022] DELETE /compute/v2.1/os-floating-ips/30dde387-8323-4545-8128-5ca9224fbadf => generated 0 bytes in 3081 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:32:52.304609 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-cb376c82-946f-4a6f-a194-9651b7e74265 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] 10.222.0.43 "GET /compute/v2.1/os-server-groups/acf92c64-4619-49b4-9c95-f8a5a9086ea1" status: 200 len: 271 microversion: 2.1 time: 0.111829 Oct 04 18:32:52.309210 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 269/493] 10.222.0.43 () {58 vars in 1263 bytes} [Tue Oct 4 18:32:52 2022] GET /compute/v2.1/os-server-groups/acf92c64-4619-49b4-9c95-f8a5a9086ea1 => generated 271 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:32:52.323882 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-27948be8-4b4c-44a5-b8c1-7584dd8b826a tempest-FlavorsAccessNegativeTestJSON-1942833929 tempest-FlavorsAccessNegativeTestJSON-1942833929-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "1a6ed20d687d4c91b667d81e8f19b5f8"}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:52.330029 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-1efdf863-9a6b-464e-8f75-da23e31575cc tempest-UnshelveToHostMultiNodesTest-313056567 tempest-UnshelveToHostMultiNodesTest-313056567-project-admin] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:52.331167 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-1efdf863-9a6b-464e-8f75-da23e31575cc tempest-UnshelveToHostMultiNodesTest-313056567 tempest-UnshelveToHostMultiNodesTest-313056567-project-admin] [instance: 84e0414b-a39f-4bfe-bc9d-c170ceb34d15] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:52.370461 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1efdf863-9a6b-464e-8f75-da23e31575cc tempest-UnshelveToHostMultiNodesTest-313056567 tempest-UnshelveToHostMultiNodesTest-313056567-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:52.373466 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1efdf863-9a6b-464e-8f75-da23e31575cc tempest-UnshelveToHostMultiNodesTest-313056567 tempest-UnshelveToHostMultiNodesTest-313056567-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:52.374287 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1efdf863-9a6b-464e-8f75-da23e31575cc tempest-UnshelveToHostMultiNodesTest-313056567 tempest-UnshelveToHostMultiNodesTest-313056567-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:52.383487 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1efdf863-9a6b-464e-8f75-da23e31575cc tempest-UnshelveToHostMultiNodesTest-313056567 tempest-UnshelveToHostMultiNodesTest-313056567-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:52.384330 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1efdf863-9a6b-464e-8f75-da23e31575cc tempest-UnshelveToHostMultiNodesTest-313056567 tempest-UnshelveToHostMultiNodesTest-313056567-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:52.392443 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1efdf863-9a6b-464e-8f75-da23e31575cc tempest-UnshelveToHostMultiNodesTest-313056567 tempest-UnshelveToHostMultiNodesTest-313056567-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:52.771989 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.objects.instance [None req-1efdf863-9a6b-464e-8f75-da23e31575cc tempest-UnshelveToHostMultiNodesTest-313056567 tempest-UnshelveToHostMultiNodesTest-313056567-project-admin] Lazy-loading 'services' on Instance uuid 84e0414b-a39f-4bfe-bc9d-c170ceb34d15 {{(pid=123595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:32:52.874975 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-27948be8-4b4c-44a5-b8c1-7584dd8b826a tempest-FlavorsAccessNegativeTestJSON-1942833929 tempest-FlavorsAccessNegativeTestJSON-1942833929-project-admin] HTTP exception thrown: Flavor access not found for 37 / 1a6ed20d687d4c91b667d81e8f19b5f8 combination. Oct 04 18:32:52.882180 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-27948be8-4b4c-44a5-b8c1-7584dd8b826a tempest-FlavorsAccessNegativeTestJSON-1942833929 tempest-FlavorsAccessNegativeTestJSON-1942833929-project-admin] Request method failure captured: Oct 04 18:32:52.882180 n-d-851028-13 devstack@n-api.service[123596]: request: POST /compute/v2.1/flavors/744725950/action HTTP/1.1 Oct 04 18:32:52.882180 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:32:52.882180 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:32:52.882180 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:32:52.882180 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 70 Oct 04 18:32:52.882180 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:32:52.882180 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:32:52.882180 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:32:52.882180 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:32:52.882180 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPHxBPxrusxNWF2dLoPbOiJb8Eik1vthqBfatloeYfikMYwY6Ij8-jLs84RpgYaaGILPkZl5omYD7k5wiVllwI2TFJ_PCVk46fXECiljOi4gIBEqF9fy_9xqrS18ic6yukiGMoWxQQPwVq2jX6YZ_1zqe-d7-mZTrZdomHnoXEBBSxnM Oct 04 18:32:52.882180 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:32:52.882180 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:32:52.882180 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:32:52.882180 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:32:52.882180 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:32:52.882180 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:32:52.882180 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: 4149d2da2aee4e1ba5866aa326ceff74 Oct 04 18:32:52.882180 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1942833929 Oct 04 18:32:52.882180 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,admin,reader Oct 04 18:32:52.882180 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,admin,reader Oct 04 18:32:52.883722 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/4149d2da2aee4e1ba5866aa326ceff74"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_4149d2da2aee4e1ba5866aa326ceff74"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4149d2da2aee4e1ba5866aa326ceff74"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4149d2da2aee4e1ba5866aa326ceff74"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:32:52.883722 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1942833929 Oct 04 18:32:52.883722 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: 4149d2da2aee4e1ba5866aa326ceff74 Oct 04 18:32:52.883722 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1942833929 Oct 04 18:32:52.883722 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-FlavorsAccessNegativeTestJSON-1942833929-project-admin Oct 04 18:32:52.883722 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:32:52.883722 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:32:52.883722 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 9369fdb0a8494b33802c6e8241b417be Oct 04 18:32:52.883722 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1942833929-project-admin Oct 04 18:32:52.883722 n-d-851028-13 devstack@n-api.service[123596]: Oct 04 18:32:52.883722 n-d-851028-13 devstack@n-api.service[123596]: {"removeTenantAccess": {"tenant": "1a6ed20d687d4c91b667d81e8f19b5f8"}} Oct 04 18:32:52.883722 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 18:32:52.884395 n-d-851028-13 devstack@n-api.service[123596]: exception: Flavor access not found for 37 / 1a6ed20d687d4c91b667d81e8f19b5f8 combination. Oct 04 18:32:52.884395 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': '744725950', 'body': {'removeTenantAccess': {'tenant': '1a6ed20d687d4c91b667d81e8f19b5f8'}}} Oct 04 18:32:52.884395 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:32:52.884395 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:52.884395 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 104, in _remove_tenant_access Oct 04 18:32:52.884395 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi flavor.remove_access(tenant) Oct 04 18:32:52.884395 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 04 18:32:52.884395 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 04 18:32:52.884395 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 423, in remove_access Oct 04 18:32:52.884395 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi self._remove_access(project_id) Oct 04 18:32:52.884395 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 416, in _remove_access Oct 04 18:32:52.884395 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi self._flavor_del_project(self._context, self.id, project_id) Oct 04 18:32:52.884395 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 401, in _flavor_del_project Oct 04 18:32:52.884395 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return _flavor_del_project(context, flavor_id, project_id) Oct 04 18:32:52.884395 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 18:32:52.884395 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 18:32:52.884395 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 86, in _flavor_del_project Oct 04 18:32:52.884395 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessNotFound(flavor_id=flavor_id, Oct 04 18:32:52.885441 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessNotFound: Flavor access not found for 37 / 1a6ed20d687d4c91b667d81e8f19b5f8 combination. Oct 04 18:32:52.885441 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:32:52.885441 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:52.885441 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:32:52.885441 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:52.885441 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:32:52.885441 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:32:52.885441 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:32:52.885441 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:32:52.885441 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:32:52.885441 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:32:52.885441 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:32:52.885441 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:32:52.885441 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 107, in _remove_tenant_access Oct 04 18:32:52.885441 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:32:52.885441 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor access not found for 37 / 1a6ed20d687d4c91b667d81e8f19b5f8 combination. Oct 04 18:32:52.885441 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:32:52.885441 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:52.885441 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:32:52.885441 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:52.888846 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:32:52.888846 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:32:52.888846 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:32:52.888846 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:32:52.888846 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access not found for 37 / 1a6ed20d687d4c91b667d81e8f19b5f8 combination. Oct 04 18:32:52.888846 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:32:52.892205 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-27948be8-4b4c-44a5-b8c1-7584dd8b826a tempest-FlavorsAccessNegativeTestJSON-1942833929 tempest-FlavorsAccessNegativeTestJSON-1942833929-project-admin] Returning 404 to user: Flavor access not found for 37 / 1a6ed20d687d4c91b667d81e8f19b5f8 combination. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:32:52.893353 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-27948be8-4b4c-44a5-b8c1-7584dd8b826a tempest-FlavorsAccessNegativeTestJSON-1942833929 tempest-FlavorsAccessNegativeTestJSON-1942833929-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors/744725950/action" status: 404 len: 124 microversion: 2.1 time: 0.582835 Oct 04 18:32:52.897340 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 270/494] 10.222.0.43 () {60 vars in 1197 bytes} [Tue Oct 4 18:32:52 2022] POST /compute/v2.1/flavors/744725950/action => generated 124 bytes in 587 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:32:52.946689 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-1efdf863-9a6b-464e-8f75-da23e31575cc tempest-UnshelveToHostMultiNodesTest-313056567 tempest-UnshelveToHostMultiNodesTest-313056567-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15" status: 200 len: 1938 microversion: 2.91 time: 0.647163 Oct 04 18:32:52.949673 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 225/495] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:32:52 2022] GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15 => generated 1938 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:32:53.010095 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-58a2fa9a-2d33-4cd4-9550-2f96954639e2 tempest-FlavorsV255TestJSON-51257839 tempest-FlavorsV255TestJSON-51257839-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-1666507485", "id": 1400097773, "os-flavor-access:is_public": "True"}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:53.050608 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-58a2fa9a-2d33-4cd4-9550-2f96954639e2 tempest-FlavorsV255TestJSON-51257839 tempest-FlavorsV255TestJSON-51257839-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 449 microversion: 2.55 time: 0.151787 Oct 04 18:32:53.051984 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 271/496] 10.222.0.43 () {62 vars in 1188 bytes} [Tue Oct 4 18:32:52 2022] POST /compute/v2.1/flavors => generated 449 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:32:53.068493 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-e6b4b617-13c5-4aca-842d-b8f9659c8aaf tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Action: 'action', calling method: .version_select at 0x7fb22583f9d0>, body: {"removeFloatingIp": {"address": "172.25.8.217"}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:53.278877 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-d10373d7-ef67-418a-b326-3c1be010c928 tempest-ServersAdminNegativeTestJSON-1726585348 tempest-ServersAdminNegativeTestJSON-1726585348-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:53.279600 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-d10373d7-ef67-418a-b326-3c1be010c928 tempest-ServersAdminNegativeTestJSON-1726585348 tempest-ServersAdminNegativeTestJSON-1726585348-project-admin] [instance: ba1f4da6-7617-4135-b65c-59c8575d2f7b] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:53.291387 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-d10373d7-ef67-418a-b326-3c1be010c928 tempest-ServersAdminNegativeTestJSON-1726585348 tempest-ServersAdminNegativeTestJSON-1726585348-project-admin] HTTP exception thrown: Instance ba1f4da6-7617-4135-b65c-59c8575d2f7b could not be found. Oct 04 18:32:53.302774 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-d10373d7-ef67-418a-b326-3c1be010c928 tempest-ServersAdminNegativeTestJSON-1726585348 tempest-ServersAdminNegativeTestJSON-1726585348-project-admin] Request method failure captured: Oct 04 18:32:53.302774 n-d-851028-13 devstack@n-api.service[123595]: request: POST /compute/v2.1/servers/ba1f4da6-7617-4135-b65c-59c8575d2f7b/action HTTP/1.1 Oct 04 18:32:53.302774 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 18:32:53.302774 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 18:32:53.302774 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 18:32:53.302774 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 15 Oct 04 18:32:53.302774 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 18:32:53.302774 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 18:32:53.302774 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 18:32:53.302774 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 18:32:53.302774 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPHw0ZJknVIKo8ZjoLNI6-7bbAu2N1mk1vzqefdcJIov3FmHJO1WI5_1bqvex4ZF_ID-riViOhscotE3s2N8-73s4t7FmWOzCM97KlGqkxpVmDBHWnfU449Y1h-FN5HhindrA8dI_RNHOB9NciOFV32yhsgQpDN8Nc9rl_CtX3dHw4IU Oct 04 18:32:53.302774 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 18:32:53.302774 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 18:32:53.302774 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 18:32:53.302774 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 18:32:53.302774 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 18:32:53.302774 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 18:32:53.302774 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: b22715dc1edb4f63bb646f6bb187a8f8 Oct 04 18:32:53.302774 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1726585348 Oct 04 18:32:53.302774 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,admin,reader Oct 04 18:32:53.302774 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,admin,reader Oct 04 18:32:53.305935 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/b22715dc1edb4f63bb646f6bb187a8f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_b22715dc1edb4f63bb646f6bb187a8f8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b22715dc1edb4f63bb646f6bb187a8f8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b22715dc1edb4f63bb646f6bb187a8f8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:32:53.305935 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1726585348 Oct 04 18:32:53.305935 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: b22715dc1edb4f63bb646f6bb187a8f8 Oct 04 18:32:53.305935 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1726585348 Oct 04 18:32:53.305935 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-ServersAdminNegativeTestJSON-1726585348-project-admin Oct 04 18:32:53.305935 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 18:32:53.305935 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 18:32:53.305935 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: 00ce12e8c6b649958005421bfe37ab11 Oct 04 18:32:53.305935 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1726585348-project-admin Oct 04 18:32:53.305935 n-d-851028-13 devstack@n-api.service[123595]: Oct 04 18:32:53.305935 n-d-851028-13 devstack@n-api.service[123595]: {"migrate": {}} Oct 04 18:32:53.305935 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 18:32:53.305935 n-d-851028-13 devstack@n-api.service[123595]: exception: Instance ba1f4da6-7617-4135-b65c-59c8575d2f7b could not be found. Oct 04 18:32:53.307319 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': 'ba1f4da6-7617-4135-b65c-59c8575d2f7b', 'body': {'migrate': {}}} Oct 04 18:32:53.307319 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:32:53.307319 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:53.307319 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:32:53.307319 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:32:53.307319 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:32:53.307319 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:32:53.307319 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 18:32:53.307319 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 18:32:53.307319 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba1f4da6-7617-4135-b65c-59c8575d2f7b could not be found. Oct 04 18:32:53.307319 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:32:53.307319 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:53.307319 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:32:53.307319 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:53.307319 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:32:53.307319 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:32:53.307319 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:32:53.307319 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:32:53.307319 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:32:53.307319 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:32:53.313601 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:32:53.313601 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:32:53.313601 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 47, in _migrate Oct 04 18:32:53.313601 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id, Oct 04 18:32:53.313601 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:32:53.313601 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:32:53.313601 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba1f4da6-7617-4135-b65c-59c8575d2f7b could not be found. Oct 04 18:32:53.313601 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:32:53.313601 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:53.313601 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:32:53.313601 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:53.313601 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:32:53.313601 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:32:53.313601 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:32:53.313601 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:32:53.313601 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba1f4da6-7617-4135-b65c-59c8575d2f7b could not be found. Oct 04 18:32:53.313601 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:32:53.324394 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-d10373d7-ef67-418a-b326-3c1be010c928 tempest-ServersAdminNegativeTestJSON-1726585348 tempest-ServersAdminNegativeTestJSON-1726585348-project-admin] Returning 404 to user: Instance ba1f4da6-7617-4135-b65c-59c8575d2f7b could not be found. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:32:53.329537 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-d10373d7-ef67-418a-b326-3c1be010c928 tempest-ServersAdminNegativeTestJSON-1726585348 tempest-ServersAdminNegativeTestJSON-1726585348-project-admin] 10.222.0.43 "POST /compute/v2.1/servers/ba1f4da6-7617-4135-b65c-59c8575d2f7b/action" status: 404 len: 111 microversion: 2.1 time: 0.377809 Oct 04 18:32:53.338288 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 226/497] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 18:32:52 2022] POST /compute/v2.1/servers/ba1f4da6-7617-4135-b65c-59c8575d2f7b/action => generated 111 bytes in 388 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:32:53.348177 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-7a8f137d-e7a2-46f9-b708-a7797f338e64 req-6edd54f9-1c1e-4890-947d-86a0c067097f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b19b908-7870-477b-9be7-7d260d59b183", "name": "network-vif-deleted", "tag": "1b942ddb-54b7-42fd-90da-3d92df57749c"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:53.409058 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-7a8f137d-e7a2-46f9-b708-a7797f338e64 req-6edd54f9-1c1e-4890-947d-86a0c067097f service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:53.409863 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-7a8f137d-e7a2-46f9-b708-a7797f338e64 req-6edd54f9-1c1e-4890-947d-86a0c067097f service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:53.410486 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-7a8f137d-e7a2-46f9-b708-a7797f338e64 req-6edd54f9-1c1e-4890-947d-86a0c067097f service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:53.451389 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-7a8f137d-e7a2-46f9-b708-a7797f338e64 req-6edd54f9-1c1e-4890-947d-86a0c067097f service nova] Creating event network-vif-deleted:1b942ddb-54b7-42fd-90da-3d92df57749c for instance 9b19b908-7870-477b-9be7-7d260d59b183 on n-h2-851028-13 Oct 04 18:32:53.466848 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-7a8f137d-e7a2-46f9-b708-a7797f338e64 req-6edd54f9-1c1e-4890-947d-86a0c067097f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123528 Oct 04 18:32:53.467607 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 227/498] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:32:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:32:53.484563 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-d6b977f8-5cd8-467d-8fdb-b701088cd131 tempest-ServersOnMultiNodesTest-1245420526 tempest-ServersOnMultiNodesTest-1245420526-project-admin] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:53.489010 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-d6b977f8-5cd8-467d-8fdb-b701088cd131 tempest-ServersOnMultiNodesTest-1245420526 tempest-ServersOnMultiNodesTest-1245420526-project-admin] [instance: 6251d93c-aab7-43cc-9be0-212545cf2b01] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:53.528146 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d6b977f8-5cd8-467d-8fdb-b701088cd131 tempest-ServersOnMultiNodesTest-1245420526 tempest-ServersOnMultiNodesTest-1245420526-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:53.529681 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d6b977f8-5cd8-467d-8fdb-b701088cd131 tempest-ServersOnMultiNodesTest-1245420526 tempest-ServersOnMultiNodesTest-1245420526-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:53.531200 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d6b977f8-5cd8-467d-8fdb-b701088cd131 tempest-ServersOnMultiNodesTest-1245420526 tempest-ServersOnMultiNodesTest-1245420526-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:53.533430 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d6b977f8-5cd8-467d-8fdb-b701088cd131 tempest-ServersOnMultiNodesTest-1245420526 tempest-ServersOnMultiNodesTest-1245420526-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:53.534945 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d6b977f8-5cd8-467d-8fdb-b701088cd131 tempest-ServersOnMultiNodesTest-1245420526 tempest-ServersOnMultiNodesTest-1245420526-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:53.535491 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d6b977f8-5cd8-467d-8fdb-b701088cd131 tempest-ServersOnMultiNodesTest-1245420526 tempest-ServersOnMultiNodesTest-1245420526-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:53.629558 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-e6b4b617-13c5-4aca-842d-b8f9659c8aaf tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] [instance: 606aebcb-2b6a-469f-a578-91325770ab4b] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:53.639966 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e6b4b617-13c5-4aca-842d-b8f9659c8aaf tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:53.640468 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e6b4b617-13c5-4aca-842d-b8f9659c8aaf tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:53.643933 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e6b4b617-13c5-4aca-842d-b8f9659c8aaf tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:53.654148 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e6b4b617-13c5-4aca-842d-b8f9659c8aaf tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:53.656642 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e6b4b617-13c5-4aca-842d-b8f9659c8aaf tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:53.658000 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e6b4b617-13c5-4aca-842d-b8f9659c8aaf tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:53.887164 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-d6b977f8-5cd8-467d-8fdb-b701088cd131 tempest-ServersOnMultiNodesTest-1245420526 tempest-ServersOnMultiNodesTest-1245420526-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/6251d93c-aab7-43cc-9be0-212545cf2b01" status: 200 len: 1621 microversion: 2.1 time: 0.417235 Oct 04 18:32:53.901589 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 228/499] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:53 2022] GET /compute/v2.1/servers/6251d93c-aab7-43cc-9be0-212545cf2b01 => generated 1621 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:53.901589 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-6b7a5788-1632-4744-9f6b-5733070e6134 tempest-FlavorsAccessNegativeTestJSON-1942833929 tempest-FlavorsAccessNegativeTestJSON-1942833929-project-admin] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:53.932683 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-6b7a5788-1632-4744-9f6b-5733070e6134 tempest-FlavorsAccessNegativeTestJSON-1942833929 tempest-FlavorsAccessNegativeTestJSON-1942833929-project-admin] 10.222.0.43 "DELETE /compute/v2.1/flavors/744725950" status: 202 len: 0 microversion: 2.1 time: 0.040236 Oct 04 18:32:53.936968 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 229/500] 10.222.0.43 () {58 vars in 1158 bytes} [Tue Oct 4 18:32:53 2022] DELETE /compute/v2.1/flavors/744725950 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:32:53.951434 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-e5152b01-ab6d-4271-b68f-016202e73c6b tempest-UnshelveToHostMultiNodesTest-313056567 tempest-UnshelveToHostMultiNodesTest-313056567-project-admin] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:53.955920 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e5152b01-ab6d-4271-b68f-016202e73c6b tempest-UnshelveToHostMultiNodesTest-313056567 tempest-UnshelveToHostMultiNodesTest-313056567-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:53.956417 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e5152b01-ab6d-4271-b68f-016202e73c6b tempest-UnshelveToHostMultiNodesTest-313056567 tempest-UnshelveToHostMultiNodesTest-313056567-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:53.957207 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e5152b01-ab6d-4271-b68f-016202e73c6b tempest-UnshelveToHostMultiNodesTest-313056567 tempest-UnshelveToHostMultiNodesTest-313056567-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:53.958215 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e5152b01-ab6d-4271-b68f-016202e73c6b tempest-UnshelveToHostMultiNodesTest-313056567 tempest-UnshelveToHostMultiNodesTest-313056567-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:53.958676 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e5152b01-ab6d-4271-b68f-016202e73c6b tempest-UnshelveToHostMultiNodesTest-313056567 tempest-UnshelveToHostMultiNodesTest-313056567-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:53.959112 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e5152b01-ab6d-4271-b68f-016202e73c6b tempest-UnshelveToHostMultiNodesTest-313056567 tempest-UnshelveToHostMultiNodesTest-313056567-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:54.013000 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-e5152b01-ab6d-4271-b68f-016202e73c6b tempest-UnshelveToHostMultiNodesTest-313056567 tempest-UnshelveToHostMultiNodesTest-313056567-project-admin] 10.222.0.43 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 500 microversion: 2.91 time: 0.075000 Oct 04 18:32:54.020795 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 230/501] 10.222.0.43 () {60 vars in 1217 bytes} [Tue Oct 4 18:32:53 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 500 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:32:54.243062 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-daf3520f-c6a2-4a2c-af2b-e6e120aa1bce tempest-FlavorsV255TestJSON-71166118 tempest-FlavorsV255TestJSON-71166118-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:54.256888 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-daf3520f-c6a2-4a2c-af2b-e6e120aa1bce tempest-FlavorsV255TestJSON-71166118 tempest-FlavorsV255TestJSON-71166118-project] 10.222.0.43 "GET /compute/v2.1/flavors/1400097773" status: 200 len: 449 microversion: 2.55 time: 0.239120 Oct 04 18:32:54.258165 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 231/502] 10.222.0.43 () {60 vars in 1199 bytes} [Tue Oct 4 18:32:54 2022] GET /compute/v2.1/flavors/1400097773 => generated 449 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:32:54.272339 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-768c9cd3-ffa9-4db3-a616-320721921483 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:54.273084 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-768c9cd3-ffa9-4db3-a616-320721921483 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] [instance: fbe51dae-877b-4377-9f23-9a129775c317] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:54.292347 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-768c9cd3-ffa9-4db3-a616-320721921483 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:54.296740 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-768c9cd3-ffa9-4db3-a616-320721921483 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:54.300909 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-768c9cd3-ffa9-4db3-a616-320721921483 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:54.302014 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-768c9cd3-ffa9-4db3-a616-320721921483 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:54.302730 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-768c9cd3-ffa9-4db3-a616-320721921483 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:54.305273 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-768c9cd3-ffa9-4db3-a616-320721921483 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:54.486341 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e6b4b617-13c5-4aca-842d-b8f9659c8aaf tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Acquiring lock "refresh_cache-606aebcb-2b6a-469f-a578-91325770ab4b" {{(pid=123596) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 04 18:32:54.487309 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e6b4b617-13c5-4aca-842d-b8f9659c8aaf tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Acquired lock "refresh_cache-606aebcb-2b6a-469f-a578-91325770ab4b" {{(pid=123596) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 04 18:32:54.630655 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-768c9cd3-ffa9-4db3-a616-320721921483 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ea2088d8124b149187a1c140d3be88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82c615a05e8a4cd086f2e580529fb1d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:54.651140 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-768c9cd3-ffa9-4db3-a616-320721921483 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] 10.222.0.43 "GET /compute/v2.1/servers/fbe51dae-877b-4377-9f23-9a129775c317" status: 200 len: 1390 microversion: 2.1 time: 0.391637 Oct 04 18:32:54.652298 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 232/503] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:54 2022] GET /compute/v2.1/servers/fbe51dae-877b-4377-9f23-9a129775c317 => generated 1390 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:54.662415 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-f15b3915-38d7-4a4d-b456-9f4fc4044ad7 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1279392979", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452"}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:54.754563 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.network.neutron [None req-f15b3915-38d7-4a4d-b456-9f4fc4044ad7 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] validate_networks() for None {{(pid=123595) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:32:55.275024 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-f15b3915-38d7-4a4d-b456-9f4fc4044ad7 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Flavor limits 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:32:55.275823 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-f15b3915-38d7-4a4d-b456-9f4fc4044ad7 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Image limits 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:32:55.276551 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-f15b3915-38d7-4a4d-b456-9f4fc4044ad7 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Flavor pref 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:32:55.277836 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-f15b3915-38d7-4a4d-b456-9f4fc4044ad7 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Image pref 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:32:55.278543 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-f15b3915-38d7-4a4d-b456-9f4fc4044ad7 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:32:55.300869 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f15b3915-38d7-4a4d-b456-9f4fc4044ad7 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:55.302101 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f15b3915-38d7-4a4d-b456-9f4fc4044ad7 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:55.302900 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f15b3915-38d7-4a4d-b456-9f4fc4044ad7 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:55.303910 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f15b3915-38d7-4a4d-b456-9f4fc4044ad7 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:55.304905 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f15b3915-38d7-4a4d-b456-9f4fc4044ad7 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:55.305615 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f15b3915-38d7-4a4d-b456-9f4fc4044ad7 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:55.337073 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-f15b3915-38d7-4a4d-b456-9f4fc4044ad7 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Getting quotas for project 94ae6e2cb75d410d8029aa49909c973b. Resources: {'ram', 'cores', 'instances'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:32:55.343551 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-f15b3915-38d7-4a4d-b456-9f4fc4044ad7 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Getting quotas for user cdb7b0ce49ec438f9a60b79bdb2ac164 and project 94ae6e2cb75d410d8029aa49909c973b. Resources: {'ram', 'cores', 'instances'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:32:55.380459 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-f15b3915-38d7-4a4d-b456-9f4fc4044ad7 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Going to run 1 instances... {{(pid=123595) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:32:55.384416 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-f15b3915-38d7-4a4d-b456-9f4fc4044ad7 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] [instance: e5e92f30-937a-4ec2-b11f-336030c3d5c9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e8943ec5-4038-4d4b-b9b9-2415a79f5243',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:32:55.456805 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-f15b3915-38d7-4a4d-b456-9f4fc4044ad7 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.803284 Oct 04 18:32:55.457766 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 233/504] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 18:32:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 805 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:32:55.464273 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-17f702dc-59aa-4a69-b9a7-1a5d9dfadfa0 tempest-ServersOnMultiNodesTest-1245420526 tempest-ServersOnMultiNodesTest-1245420526-project-admin] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:55.465397 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-17f702dc-59aa-4a69-b9a7-1a5d9dfadfa0 tempest-ServersOnMultiNodesTest-1245420526 tempest-ServersOnMultiNodesTest-1245420526-project-admin] [instance: 640d917c-c9cb-4758-aa1d-216e34a55297] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:55.471950 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-17f702dc-59aa-4a69-b9a7-1a5d9dfadfa0 tempest-ServersOnMultiNodesTest-1245420526 tempest-ServersOnMultiNodesTest-1245420526-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:55.472703 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-17f702dc-59aa-4a69-b9a7-1a5d9dfadfa0 tempest-ServersOnMultiNodesTest-1245420526 tempest-ServersOnMultiNodesTest-1245420526-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:55.473469 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-17f702dc-59aa-4a69-b9a7-1a5d9dfadfa0 tempest-ServersOnMultiNodesTest-1245420526 tempest-ServersOnMultiNodesTest-1245420526-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:55.474377 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-17f702dc-59aa-4a69-b9a7-1a5d9dfadfa0 tempest-ServersOnMultiNodesTest-1245420526 tempest-ServersOnMultiNodesTest-1245420526-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:55.475132 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-17f702dc-59aa-4a69-b9a7-1a5d9dfadfa0 tempest-ServersOnMultiNodesTest-1245420526 tempest-ServersOnMultiNodesTest-1245420526-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:55.475782 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-17f702dc-59aa-4a69-b9a7-1a5d9dfadfa0 tempest-ServersOnMultiNodesTest-1245420526 tempest-ServersOnMultiNodesTest-1245420526-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:55.739756 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-17f702dc-59aa-4a69-b9a7-1a5d9dfadfa0 tempest-ServersOnMultiNodesTest-1245420526 tempest-ServersOnMultiNodesTest-1245420526-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/640d917c-c9cb-4758-aa1d-216e34a55297" status: 200 len: 1622 microversion: 2.1 time: 0.280519 Oct 04 18:32:55.757935 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 234/505] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:55 2022] GET /compute/v2.1/servers/640d917c-c9cb-4758-aa1d-216e34a55297 => generated 1622 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:55.777480 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-8fee1537-2a2e-442d-ad6e-96c9bd64bdfe tempest-FlavorsAccessNegativeTestJSON-1942833929 tempest-FlavorsAccessNegativeTestJSON-1942833929-project-admin] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:55.840617 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-8fee1537-2a2e-442d-ad6e-96c9bd64bdfe tempest-FlavorsAccessNegativeTestJSON-1942833929 tempest-FlavorsAccessNegativeTestJSON-1942833929-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 6236 microversion: 2.1 time: 0.081010 Oct 04 18:32:55.849271 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 235/506] 10.222.0.43 () {58 vars in 1146 bytes} [Tue Oct 4 18:32:55 2022] GET /compute/v2.1/flavors/detail => generated 6236 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:55.862853 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-55073286-f98a-48b2-a416-287a42428525 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:55.864004 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-55073286-f98a-48b2-a416-287a42428525 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] [instance: 84e0414b-a39f-4bfe-bc9d-c170ceb34d15] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:55.881368 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-55073286-f98a-48b2-a416-287a42428525 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:55.886575 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-55073286-f98a-48b2-a416-287a42428525 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:55.889340 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-55073286-f98a-48b2-a416-287a42428525 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:55.890349 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-55073286-f98a-48b2-a416-287a42428525 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:55.892796 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-55073286-f98a-48b2-a416-287a42428525 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:55.895114 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-55073286-f98a-48b2-a416-287a42428525 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:55.977721 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.objects.instance [None req-55073286-f98a-48b2-a416-287a42428525 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lazy-loading 'flavor' on Instance uuid 84e0414b-a39f-4bfe-bc9d-c170ceb34d15 {{(pid=123595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:32:56.179960 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.network.neutron [None req-e6b4b617-13c5-4aca-842d-b8f9659c8aaf tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] [instance: 606aebcb-2b6a-469f-a578-91325770ab4b] Building network info cache for instance {{(pid=123596) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 04 18:32:56.439648 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-55073286-f98a-48b2-a416-287a42428525 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] 10.222.0.43 "POST /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15/action" status: 202 len: 0 microversion: 2.91 time: 0.588550 Oct 04 18:32:56.440326 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 236/507] 10.222.0.43 () {62 vars in 1319 bytes} [Tue Oct 4 18:32:55 2022] POST /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15/action => generated 0 bytes in 590 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:32:56.445747 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-9b77966b-df93-4cf9-8cac-8659e9676754 tempest-FlavorsV255TestJSON-51257839 tempest-FlavorsV255TestJSON-51257839-project-admin] Action: 'update', calling method: .version_select at 0x7fb225a04670>, body: {"flavor": {"description": "new"}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:56.508206 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-9b77966b-df93-4cf9-8cac-8659e9676754 tempest-FlavorsV255TestJSON-51257839 tempest-FlavorsV255TestJSON-51257839-project-admin] 10.222.0.43 "PUT /compute/v2.1/flavors/1400097773" status: 200 len: 450 microversion: 2.55 time: 0.066156 Oct 04 18:32:56.509289 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 237/508] 10.222.0.43 () {62 vars in 1219 bytes} [Tue Oct 4 18:32:56 2022] PUT /compute/v2.1/flavors/1400097773 => generated 450 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:32:56.514755 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-9b65662a-43f6-43f1-804f-5ac1e0dc4732 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:56.515481 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-9b65662a-43f6-43f1-804f-5ac1e0dc4732 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] [instance: e5e92f30-937a-4ec2-b11f-336030c3d5c9] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:56.525502 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9b65662a-43f6-43f1-804f-5ac1e0dc4732 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:56.526007 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9b65662a-43f6-43f1-804f-5ac1e0dc4732 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:56.527499 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9b65662a-43f6-43f1-804f-5ac1e0dc4732 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:56.528579 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9b65662a-43f6-43f1-804f-5ac1e0dc4732 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:56.530168 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9b65662a-43f6-43f1-804f-5ac1e0dc4732 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:56.530777 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9b65662a-43f6-43f1-804f-5ac1e0dc4732 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:56.694034 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-9b65662a-43f6-43f1-804f-5ac1e0dc4732 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb7b0ce49ec438f9a60b79bdb2ac164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94ae6e2cb75d410d8029aa49909c973b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:56.706538 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-9b65662a-43f6-43f1-804f-5ac1e0dc4732 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] 10.222.0.43 "GET /compute/v2.1/servers/e5e92f30-937a-4ec2-b11f-336030c3d5c9" status: 200 len: 1226 microversion: 2.1 time: 0.194215 Oct 04 18:32:56.709779 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 238/509] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:56 2022] GET /compute/v2.1/servers/e5e92f30-937a-4ec2-b11f-336030c3d5c9 => generated 1226 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:56.720471 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-7a316f85-e411-4b46-b77c-f1107079afeb req-b6e579b0-523c-43f8-8b79-d6d4f108acde service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fbe51dae-877b-4377-9f23-9a129775c317", "tag": "af27bbcc-4fc5-451e-89df-ae9d39d63786"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:56.749197 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-7a316f85-e411-4b46-b77c-f1107079afeb req-b6e579b0-523c-43f8-8b79-d6d4f108acde service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:56.751516 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-7a316f85-e411-4b46-b77c-f1107079afeb req-b6e579b0-523c-43f8-8b79-d6d4f108acde service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:56.752172 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-7a316f85-e411-4b46-b77c-f1107079afeb req-b6e579b0-523c-43f8-8b79-d6d4f108acde service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:56.779650 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-7a316f85-e411-4b46-b77c-f1107079afeb req-b6e579b0-523c-43f8-8b79-d6d4f108acde service nova] Creating event network-changed:af27bbcc-4fc5-451e-89df-ae9d39d63786 for instance fbe51dae-877b-4377-9f23-9a129775c317 on n-h2-851028-13 Oct 04 18:32:56.793299 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-7a316f85-e411-4b46-b77c-f1107079afeb req-b6e579b0-523c-43f8-8b79-d6d4f108acde service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081893 Oct 04 18:32:56.796126 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 239/510] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:32:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:32:56.964684 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.network.neutron [None req-e6b4b617-13c5-4aca-842d-b8f9659c8aaf tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] [instance: 606aebcb-2b6a-469f-a578-91325770ab4b] Updating instance_info_cache with network_info: [{"id": "101c6584-c112-496c-8a18-4440b7f3aec5", "address": "fa:16:3e:02:1e:9f", "network": {"id": "0c823502-f774-43d6-893c-f93f073651ed", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-1385900104-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "38c636de1e6b42868f1f58e46fd4a3f0", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap101c6584-c1", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=123596) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 04 18:32:56.980123 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e6b4b617-13c5-4aca-842d-b8f9659c8aaf tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Releasing lock "refresh_cache-606aebcb-2b6a-469f-a578-91325770ab4b" {{(pid=123596) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 04 18:32:56.981395 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-e6b4b617-13c5-4aca-842d-b8f9659c8aaf tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] 10.222.0.43 "POST /compute/v2.1/servers/606aebcb-2b6a-469f-a578-91325770ab4b/action" status: 202 len: 0 microversion: 2.1 time: 3.928127 Oct 04 18:32:56.982325 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 272/511] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 18:32:53 2022] POST /compute/v2.1/servers/606aebcb-2b6a-469f-a578-91325770ab4b/action => generated 0 bytes in 3930 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 04 18:32:56.988513 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-5f88c310-ef8b-489e-839a-fe1304b2a6ef tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:56.989653 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-5f88c310-ef8b-489e-839a-fe1304b2a6ef tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] [instance: fbe51dae-877b-4377-9f23-9a129775c317] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:56.998492 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5f88c310-ef8b-489e-839a-fe1304b2a6ef tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:56.999239 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5f88c310-ef8b-489e-839a-fe1304b2a6ef tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:56.999830 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5f88c310-ef8b-489e-839a-fe1304b2a6ef tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:57.000872 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5f88c310-ef8b-489e-839a-fe1304b2a6ef tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:57.001867 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5f88c310-ef8b-489e-839a-fe1304b2a6ef tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:57.002546 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5f88c310-ef8b-489e-839a-fe1304b2a6ef tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:57.185601 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-a6a18f26-8332-4b74-bbca-ffd4662328c7 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-582955391", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452", "networks": [{"uuid": "1fac60ec-a479-4aec-9ef2-ec5cc4fb1c50"}]}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:57.249571 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.network.neutron [None req-a6a18f26-8332-4b74-bbca-ffd4662328c7 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] validate_networks() for [('1fac60ec-a479-4aec-9ef2-ec5cc4fb1c50', None, None, None, None, None)] {{(pid=123595) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:32:57.262154 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-5f88c310-ef8b-489e-839a-fe1304b2a6ef tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ea2088d8124b149187a1c140d3be88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82c615a05e8a4cd086f2e580529fb1d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:57.280390 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-5f88c310-ef8b-489e-839a-fe1304b2a6ef tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] 10.222.0.43 "GET /compute/v2.1/servers/fbe51dae-877b-4377-9f23-9a129775c317" status: 200 len: 1390 microversion: 2.1 time: 0.296796 Oct 04 18:32:57.280981 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 273/512] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:56 2022] GET /compute/v2.1/servers/fbe51dae-877b-4377-9f23-9a129775c317 => generated 1390 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:57.287078 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-10048272-b5c9-4563-922d-2af9f1a5ba08 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-456968852", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "b36499e0-9405-4153-a581-13c1bd9d43eb"}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:57.389359 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.network.neutron [None req-10048272-b5c9-4563-922d-2af9f1a5ba08 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] validate_networks() for None {{(pid=123596) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:32:57.752617 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-10048272-b5c9-4563-922d-2af9f1a5ba08 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Flavor limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:32:57.753048 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-10048272-b5c9-4563-922d-2af9f1a5ba08 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Image limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:32:57.753633 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-10048272-b5c9-4563-922d-2af9f1a5ba08 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Flavor pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:32:57.754048 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-10048272-b5c9-4563-922d-2af9f1a5ba08 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Image pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:32:57.754461 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-10048272-b5c9-4563-922d-2af9f1a5ba08 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:32:57.766653 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-10048272-b5c9-4563-922d-2af9f1a5ba08 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:57.767140 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-10048272-b5c9-4563-922d-2af9f1a5ba08 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:57.767567 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-10048272-b5c9-4563-922d-2af9f1a5ba08 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:57.769442 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-10048272-b5c9-4563-922d-2af9f1a5ba08 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:57.782252 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-10048272-b5c9-4563-922d-2af9f1a5ba08 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:57.784669 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-10048272-b5c9-4563-922d-2af9f1a5ba08 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:57.823201 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-10048272-b5c9-4563-922d-2af9f1a5ba08 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Getting quotas for project e7adedcdb9c3485ea2738c00e25aa3fd. Resources: {'ram', 'cores', 'instances'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:32:57.828340 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-10048272-b5c9-4563-922d-2af9f1a5ba08 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Getting quotas for user a7db99f361654711bea7f1b2c404d312 and project e7adedcdb9c3485ea2738c00e25aa3fd. Resources: {'ram', 'cores', 'instances'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:32:57.852717 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-10048272-b5c9-4563-922d-2af9f1a5ba08 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Going to run 1 instances... {{(pid=123596) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:32:57.856095 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-10048272-b5c9-4563-922d-2af9f1a5ba08 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] [instance: fc077a8b-c0f8-4bb1-8a39-91874ac015e7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e8943ec5-4038-4d4b-b9b9-2415a79f5243',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123596) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:32:57.962738 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-a6a18f26-8332-4b74-bbca-ffd4662328c7 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Flavor limits 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:32:57.963493 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-a6a18f26-8332-4b74-bbca-ffd4662328c7 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Image limits 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:32:57.964602 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-a6a18f26-8332-4b74-bbca-ffd4662328c7 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Flavor pref 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:32:57.965749 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-a6a18f26-8332-4b74-bbca-ffd4662328c7 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Image pref 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:32:57.966449 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-a6a18f26-8332-4b74-bbca-ffd4662328c7 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:32:57.969225 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-10048272-b5c9-4563-922d-2af9f1a5ba08 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.685760 Oct 04 18:32:57.969904 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 274/513] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 18:32:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 687 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:32:57.980157 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a6a18f26-8332-4b74-bbca-ffd4662328c7 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:57.981188 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a6a18f26-8332-4b74-bbca-ffd4662328c7 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:57.981859 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a6a18f26-8332-4b74-bbca-ffd4662328c7 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:57.982954 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a6a18f26-8332-4b74-bbca-ffd4662328c7 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:57.983664 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a6a18f26-8332-4b74-bbca-ffd4662328c7 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:57.984321 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a6a18f26-8332-4b74-bbca-ffd4662328c7 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:57.987128 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-ef1962b0-8ad4-4ced-b17c-85f8df0c55c5 req-f02807ca-0035-46ab-8d96-0f47d25e71c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "606aebcb-2b6a-469f-a578-91325770ab4b", "tag": "101c6584-c112-496c-8a18-4440b7f3aec5"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:58.008241 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-ef1962b0-8ad4-4ced-b17c-85f8df0c55c5 req-f02807ca-0035-46ab-8d96-0f47d25e71c1 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:58.018492 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-ef1962b0-8ad4-4ced-b17c-85f8df0c55c5 req-f02807ca-0035-46ab-8d96-0f47d25e71c1 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:58.020003 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-ef1962b0-8ad4-4ced-b17c-85f8df0c55c5 req-f02807ca-0035-46ab-8d96-0f47d25e71c1 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:58.053807 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-ef1962b0-8ad4-4ced-b17c-85f8df0c55c5 req-f02807ca-0035-46ab-8d96-0f47d25e71c1 service nova] Creating event network-changed:101c6584-c112-496c-8a18-4440b7f3aec5 for instance 606aebcb-2b6a-469f-a578-91325770ab4b on n-h2-851028-13 Oct 04 18:32:58.069290 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-ef1962b0-8ad4-4ced-b17c-85f8df0c55c5 req-f02807ca-0035-46ab-8d96-0f47d25e71c1 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097440 Oct 04 18:32:58.071034 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-a6a18f26-8332-4b74-bbca-ffd4662328c7 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Getting quotas for project 34199e342c1b4158abf82384f2213b5f. Resources: {'ram', 'cores', 'instances'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:32:58.071394 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 275/514] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:32:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:32:58.077616 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-3c70e735-2cef-4501-a9c1-6b259afafa1c tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:58.080358 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-3c70e735-2cef-4501-a9c1-6b259afafa1c tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] [instance: 84e0414b-a39f-4bfe-bc9d-c170ceb34d15] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:58.091104 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-a6a18f26-8332-4b74-bbca-ffd4662328c7 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Getting quotas for user 807a4a88319946aead73a3ccfcda6aeb and project 34199e342c1b4158abf82384f2213b5f. Resources: {'ram', 'cores', 'instances'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:32:58.092874 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3c70e735-2cef-4501-a9c1-6b259afafa1c tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:58.095123 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3c70e735-2cef-4501-a9c1-6b259afafa1c tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:58.097387 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3c70e735-2cef-4501-a9c1-6b259afafa1c tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:58.098318 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3c70e735-2cef-4501-a9c1-6b259afafa1c tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:58.101977 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3c70e735-2cef-4501-a9c1-6b259afafa1c tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:58.104406 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3c70e735-2cef-4501-a9c1-6b259afafa1c tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:58.132264 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-a6a18f26-8332-4b74-bbca-ffd4662328c7 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Going to run 1 instances... {{(pid=123595) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:32:58.138936 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-a6a18f26-8332-4b74-bbca-ffd4662328c7 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] [instance: fd5fe360-8ecf-41d0-9376-9d5533fc6ba8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e8943ec5-4038-4d4b-b9b9-2415a79f5243',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:32:58.276231 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-a6a18f26-8332-4b74-bbca-ffd4662328c7 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.478808 Oct 04 18:32:58.283075 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 240/515] 10.222.0.43 () {62 vars in 1188 bytes} [Tue Oct 4 18:32:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 1486 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 04 18:32:58.291577 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-5127d7f4-880f-461d-a817-e87e123117e7 tempest-FlavorsV255TestJSON-71166118 tempest-FlavorsV255TestJSON-71166118-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:58.305053 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-3c70e735-2cef-4501-a9c1-6b259afafa1c tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:58.318201 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-3c70e735-2cef-4501-a9c1-6b259afafa1c tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:58.324081 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-3c70e735-2cef-4501-a9c1-6b259afafa1c tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:58.341787 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-3c70e735-2cef-4501-a9c1-6b259afafa1c tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] 10.222.0.43 "GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15" status: 200 len: 1537 microversion: 2.91 time: 0.266966 Oct 04 18:32:58.343311 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 276/516] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:32:58 2022] GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15 => generated 1537 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:32:58.352937 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-2d233cf4-06b9-49cc-8ced-e0be92c674d3 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Calling method '.version_select at 0x7fb21fd548b0>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:58.436080 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-5127d7f4-880f-461d-a817-e87e123117e7 tempest-FlavorsV255TestJSON-71166118 tempest-FlavorsV255TestJSON-71166118-project] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 6594 microversion: 2.55 time: 0.150128 Oct 04 18:32:58.440501 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 241/517] 10.222.0.43 () {60 vars in 1187 bytes} [Tue Oct 4 18:32:58 2022] GET /compute/v2.1/flavors/detail => generated 6594 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:32:58.461243 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-c744e6d4-9eab-4a74-ac37-912b64cc7358 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:58.463833 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-c744e6d4-9eab-4a74-ac37-912b64cc7358 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] [instance: e5e92f30-937a-4ec2-b11f-336030c3d5c9] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:58.496962 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c744e6d4-9eab-4a74-ac37-912b64cc7358 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:58.497752 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c744e6d4-9eab-4a74-ac37-912b64cc7358 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:58.498213 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c744e6d4-9eab-4a74-ac37-912b64cc7358 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:58.499025 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c744e6d4-9eab-4a74-ac37-912b64cc7358 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:58.499492 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c744e6d4-9eab-4a74-ac37-912b64cc7358 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:58.501388 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c744e6d4-9eab-4a74-ac37-912b64cc7358 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:58.795750 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-c744e6d4-9eab-4a74-ac37-912b64cc7358 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb7b0ce49ec438f9a60b79bdb2ac164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94ae6e2cb75d410d8029aa49909c973b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:58.808216 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-c744e6d4-9eab-4a74-ac37-912b64cc7358 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] 10.222.0.43 "GET /compute/v2.1/servers/e5e92f30-937a-4ec2-b11f-336030c3d5c9" status: 200 len: 1218 microversion: 2.1 time: 0.366307 Oct 04 18:32:58.811450 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 242/518] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:58 2022] GET /compute/v2.1/servers/e5e92f30-937a-4ec2-b11f-336030c3d5c9 => generated 1218 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:58.823025 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-6c35b65a-9f05-45f3-b885-fc35c31f3a29 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:58.825724 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-6c35b65a-9f05-45f3-b885-fc35c31f3a29 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] [instance: fc077a8b-c0f8-4bb1-8a39-91874ac015e7] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:59.087625 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-6c35b65a-9f05-45f3-b885-fc35c31f3a29 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7db99f361654711bea7f1b2c404d312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7adedcdb9c3485ea2738c00e25aa3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:59.102889 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-6c35b65a-9f05-45f3-b885-fc35c31f3a29 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] 10.222.0.43 "GET /compute/v2.1/servers/fc077a8b-c0f8-4bb1-8a39-91874ac015e7" status: 200 len: 1216 microversion: 2.1 time: 0.287721 Oct 04 18:32:59.103584 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 243/519] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:58 2022] GET /compute/v2.1/servers/fc077a8b-c0f8-4bb1-8a39-91874ac015e7 => generated 1216 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:59.123614 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-bef44066-5a59-474b-9613-ab93b7dd9cb6 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:59.130121 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-bef44066-5a59-474b-9613-ab93b7dd9cb6 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] [instance: fd5fe360-8ecf-41d0-9376-9d5533fc6ba8] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:59.261547 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-bef44066-5a59-474b-9613-ab93b7dd9cb6 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:59.310066 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-bef44066-5a59-474b-9613-ab93b7dd9cb6 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:59.313891 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-bef44066-5a59-474b-9613-ab93b7dd9cb6 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:59.315072 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-bef44066-5a59-474b-9613-ab93b7dd9cb6 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] 10.222.0.43 "GET /compute/v2.1/servers/fd5fe360-8ecf-41d0-9376-9d5533fc6ba8" status: 200 len: 1261 microversion: 2.25 time: 0.198769 Oct 04 18:32:59.319761 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 244/520] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:32:59 2022] GET /compute/v2.1/servers/fd5fe360-8ecf-41d0-9376-9d5533fc6ba8 => generated 1261 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:32:59.337760 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-21ce928d-0cd4-4c2c-bbaa-ad970af188cf tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:59.338383 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-21ce928d-0cd4-4c2c-bbaa-ad970af188cf tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] [instance: fbe51dae-877b-4377-9f23-9a129775c317] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:59.346794 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-21ce928d-0cd4-4c2c-bbaa-ad970af188cf tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:59.347320 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-21ce928d-0cd4-4c2c-bbaa-ad970af188cf tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:59.348085 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-21ce928d-0cd4-4c2c-bbaa-ad970af188cf tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:59.349001 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-21ce928d-0cd4-4c2c-bbaa-ad970af188cf tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:59.349711 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-21ce928d-0cd4-4c2c-bbaa-ad970af188cf tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:59.352434 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-21ce928d-0cd4-4c2c-bbaa-ad970af188cf tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:59.906325 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-21ce928d-0cd4-4c2c-bbaa-ad970af188cf tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ea2088d8124b149187a1c140d3be88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82c615a05e8a4cd086f2e580529fb1d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:59.919623 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-21ce928d-0cd4-4c2c-bbaa-ad970af188cf tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] 10.222.0.43 "GET /compute/v2.1/servers/fbe51dae-877b-4377-9f23-9a129775c317" status: 200 len: 1390 microversion: 2.1 time: 0.598040 Oct 04 18:32:59.935683 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 245/521] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:59 2022] GET /compute/v2.1/servers/fbe51dae-877b-4377-9f23-9a129775c317 => generated 1390 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:59.948541 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-f6fb9008-7017-4e85-9fa2-cec50bc4d9f8 tempest-FlavorsV255TestJSON-71166118 tempest-FlavorsV255TestJSON-71166118-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:00.005152 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-f6fb9008-7017-4e85-9fa2-cec50bc4d9f8 tempest-FlavorsV255TestJSON-71166118 tempest-FlavorsV255TestJSON-71166118-project] 10.222.0.43 "GET /compute/v2.1/flavors" status: 200 len: 3684 microversion: 2.55 time: 0.067793 Oct 04 18:33:00.006420 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 246/522] 10.222.0.43 () {60 vars in 1166 bytes} [Tue Oct 4 18:32:59 2022] GET /compute/v2.1/flavors => generated 3684 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:33:00.020513 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-8770ac00-ed91-48f3-ba1f-8f2025590fe2 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:00.025548 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-8770ac00-ed91-48f3-ba1f-8f2025590fe2 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] [instance: 84e0414b-a39f-4bfe-bc9d-c170ceb34d15] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:00.033878 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=9,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:33:00.044529 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8770ac00-ed91-48f3-ba1f-8f2025590fe2 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:00.045419 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8770ac00-ed91-48f3-ba1f-8f2025590fe2 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:00.046115 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8770ac00-ed91-48f3-ba1f-8f2025590fe2 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:00.047225 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8770ac00-ed91-48f3-ba1f-8f2025590fe2 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:00.047903 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8770ac00-ed91-48f3-ba1f-8f2025590fe2 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:00.048599 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8770ac00-ed91-48f3-ba1f-8f2025590fe2 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:00.092708 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:33:00.407150 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-8770ac00-ed91-48f3-ba1f-8f2025590fe2 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:00.420279 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-8770ac00-ed91-48f3-ba1f-8f2025590fe2 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:00.422061 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-8770ac00-ed91-48f3-ba1f-8f2025590fe2 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:00.456722 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-8770ac00-ed91-48f3-ba1f-8f2025590fe2 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] 10.222.0.43 "GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15" status: 200 len: 1537 microversion: 2.91 time: 0.448943 Oct 04 18:33:00.485304 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 247/523] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:33:00 2022] GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15 => generated 1537 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:33:00.491573 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-3b74d3a6-c9e1-44e4-82de-90682f617c88 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:00.496756 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-3b74d3a6-c9e1-44e4-82de-90682f617c88 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] [instance: e5e92f30-937a-4ec2-b11f-336030c3d5c9] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:00.511842 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3b74d3a6-c9e1-44e4-82de-90682f617c88 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:00.512506 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3b74d3a6-c9e1-44e4-82de-90682f617c88 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:00.513891 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3b74d3a6-c9e1-44e4-82de-90682f617c88 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:00.517748 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3b74d3a6-c9e1-44e4-82de-90682f617c88 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:00.517937 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3b74d3a6-c9e1-44e4-82de-90682f617c88 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:00.518637 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3b74d3a6-c9e1-44e4-82de-90682f617c88 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:00.694466 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-3b74d3a6-c9e1-44e4-82de-90682f617c88 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb7b0ce49ec438f9a60b79bdb2ac164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94ae6e2cb75d410d8029aa49909c973b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:00.706131 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-3b74d3a6-c9e1-44e4-82de-90682f617c88 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] 10.222.0.43 "GET /compute/v2.1/servers/e5e92f30-937a-4ec2-b11f-336030c3d5c9" status: 200 len: 1280 microversion: 2.1 time: 0.219023 Oct 04 18:33:00.718563 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 248/524] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:00 2022] GET /compute/v2.1/servers/e5e92f30-937a-4ec2-b11f-336030c3d5c9 => generated 1280 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:00.724707 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-695947c4-1156-4f18-b29b-c6117ed8faa3 tempest-FlavorsV255TestJSON-51257839 tempest-FlavorsV255TestJSON-51257839-project-admin] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:00.726854 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-2d233cf4-06b9-49cc-8ced-e0be92c674d3 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] 10.222.0.43 "DELETE /compute/v2.1/os-floating-ips/d2d76974-b88c-424c-9b60-1920fb32394f" status: 202 len: 0 microversion: 2.1 time: 2.380587 Oct 04 18:33:00.727654 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 277/525] 10.222.0.43 () {58 vars in 1263 bytes} [Tue Oct 4 18:32:58 2022] DELETE /compute/v2.1/os-floating-ips/d2d76974-b88c-424c-9b60-1920fb32394f => generated 0 bytes in 2383 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:33:00.740667 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-a82a4416-85bb-41a5-8fc2-873265e4cfdd tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:00.742751 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-a82a4416-85bb-41a5-8fc2-873265e4cfdd tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] [instance: fc077a8b-c0f8-4bb1-8a39-91874ac015e7] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:00.753352 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-695947c4-1156-4f18-b29b-c6117ed8faa3 tempest-FlavorsV255TestJSON-51257839 tempest-FlavorsV255TestJSON-51257839-project-admin] 10.222.0.43 "DELETE /compute/v2.1/flavors/1400097773" status: 202 len: 0 microversion: 2.55 time: 0.033210 Oct 04 18:33:00.753630 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a82a4416-85bb-41a5-8fc2-873265e4cfdd tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:00.754470 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a82a4416-85bb-41a5-8fc2-873265e4cfdd tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:00.755144 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a82a4416-85bb-41a5-8fc2-873265e4cfdd tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:00.756739 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a82a4416-85bb-41a5-8fc2-873265e4cfdd tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:00.758550 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a82a4416-85bb-41a5-8fc2-873265e4cfdd tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:00.759464 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a82a4416-85bb-41a5-8fc2-873265e4cfdd tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:00.759761 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 249/526] 10.222.0.43 () {60 vars in 1202 bytes} [Tue Oct 4 18:33:00 2022] DELETE /compute/v2.1/flavors/1400097773 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:33:00.765843 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-3191967c-c8ab-4b40-842b-e1fba6f3b787 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:00.767210 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-3191967c-c8ab-4b40-842b-e1fba6f3b787 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] [instance: fd5fe360-8ecf-41d0-9376-9d5533fc6ba8] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:00.778576 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3191967c-c8ab-4b40-842b-e1fba6f3b787 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:00.780091 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3191967c-c8ab-4b40-842b-e1fba6f3b787 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:00.780901 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3191967c-c8ab-4b40-842b-e1fba6f3b787 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:00.782668 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3191967c-c8ab-4b40-842b-e1fba6f3b787 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:00.783350 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3191967c-c8ab-4b40-842b-e1fba6f3b787 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:00.784587 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3191967c-c8ab-4b40-842b-e1fba6f3b787 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:00.825809 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:33:01.011029 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-3191967c-c8ab-4b40-842b-e1fba6f3b787 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:01.026601 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-3191967c-c8ab-4b40-842b-e1fba6f3b787 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:01.028067 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-3191967c-c8ab-4b40-842b-e1fba6f3b787 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:01.038800 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-3191967c-c8ab-4b40-842b-e1fba6f3b787 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] 10.222.0.43 "GET /compute/v2.1/servers/fd5fe360-8ecf-41d0-9376-9d5533fc6ba8" status: 200 len: 1313 microversion: 2.25 time: 0.268357 Oct 04 18:33:01.039898 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 250/527] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:33:00 2022] GET /compute/v2.1/servers/fd5fe360-8ecf-41d0-9376-9d5533fc6ba8 => generated 1313 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:33:01.050343 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-fff0f604-4b37-44a9-839f-455d368357fa tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": ""}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:33:01.061201 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-fff0f604-4b37-44a9-839f-455d368357fa tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Request method failure captured: Oct 04 18:33:01.061201 n-d-851028-13 devstack@n-api.service[123595]: request: POST /compute/v2.1/servers/606aebcb-2b6a-469f-a578-91325770ab4b/action HTTP/1.1 Oct 04 18:33:01.061201 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 18:33:01.061201 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 18:33:01.061201 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 18:33:01.061201 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 34 Oct 04 18:33:01.061201 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 18:33:01.061201 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 18:33:01.061201 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 18:33:01.061201 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 18:33:01.061201 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPHwvbOQqnDjvNFqcoO2SDu0TzYjAt5AyP3sChpg5Gr0w9tnlVGL1WnZBZGfhAGi45qS58eKNHB7XSOB8h3QYe_LH6aBK6h8b1Urcm7MaId1M56GN2pIau77L_IM8sT6CwZNggL3X1Mdk4EFReH0aW3i0ckLhikk7zf0FRhKVnOekuio Oct 04 18:33:01.061201 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 18:33:01.061201 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 18:33:01.061201 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 18:33:01.061201 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 18:33:01.061201 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 18:33:01.061201 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 18:33:01.061201 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: 38c636de1e6b42868f1f58e46fd4a3f0 Oct 04 18:33:01.061201 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 Oct 04 18:33:01.061201 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 18:33:01.061201 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 18:33:01.063086 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/38c636de1e6b42868f1f58e46fd4a3f0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_38c636de1e6b42868f1f58e46fd4a3f0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/38c636de1e6b42868f1f58e46fd4a3f0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/38c636de1e6b42868f1f58e46fd4a3f0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:33:01.063086 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 Oct 04 18:33:01.063086 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: 38c636de1e6b42868f1f58e46fd4a3f0 Oct 04 18:33:01.063086 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 Oct 04 18:33:01.063086 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project Oct 04 18:33:01.063086 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 18:33:01.063086 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 18:33:01.063086 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: f207a188e3fa4987b9fe4dd773ad03b9 Oct 04 18:33:01.063086 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project Oct 04 18:33:01.063086 n-d-851028-13 devstack@n-api.service[123595]: Oct 04 18:33:01.063086 n-d-851028-13 devstack@n-api.service[123595]: {"addFloatingIp": {"address": ""}} Oct 04 18:33:01.063086 n-d-851028-13 devstack@n-api.service[123595]: method: Oct 04 18:33:01.063086 n-d-851028-13 devstack@n-api.service[123595]: exception: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 04 18:33:01.064091 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': '606aebcb-2b6a-469f-a578-91325770ab4b', 'body': {'addFloatingIp': {'address': ''}}} Oct 04 18:33:01.064091 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:33:01.064091 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:33:01.064091 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:33:01.064091 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:33:01.064091 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:33:01.064091 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:33:01.064091 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is not valid under any of the given schemas Oct 04 18:33:01.064091 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:33:01.064091 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['addFloatingIp']['properties']['address']: Oct 04 18:33:01.064091 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'ipv4'}, {'format': 'ipv6'}], 'type': 'string'} Oct 04 18:33:01.064091 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:33:01.064091 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi On instance['addFloatingIp']: Oct 04 18:33:01.064091 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi '' Oct 04 18:33:01.064091 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:33:01.064091 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:33:01.064091 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:33:01.064091 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:33:01.064091 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:33:01.064091 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:33:01.064091 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:33:01.064091 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:33:01.065878 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:33:01.065878 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:33:01.065878 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:33:01.065878 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:33:01.065878 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 18:33:01.065878 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 18:33:01.065878 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:33:01.065878 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:33:01.065878 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:33:01.065878 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:33:01.065878 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 04 18:33:01.065878 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:33:01.065878 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:33:01.065878 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:33:01.065878 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:33:01.065878 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:33:01.065878 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:33:01.065878 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:33:01.065878 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:33:01.067286 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 04 18:33:01.067286 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:33:01.067579 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-a82a4416-85bb-41a5-8fc2-873265e4cfdd tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7db99f361654711bea7f1b2c404d312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7adedcdb9c3485ea2738c00e25aa3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:01.070931 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-fff0f604-4b37-44a9-839f-455d368357fa tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:33:01.072074 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-fff0f604-4b37-44a9-839f-455d368357fa tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] 10.222.0.43 "POST /compute/v2.1/servers/606aebcb-2b6a-469f-a578-91325770ab4b/action" status: 400 len: 142 microversion: 2.1 time: 0.031157 Oct 04 18:33:01.072837 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 251/528] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 18:33:01 2022] POST /compute/v2.1/servers/606aebcb-2b6a-469f-a578-91325770ab4b/action => generated 142 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:33:01.077360 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-a82a4416-85bb-41a5-8fc2-873265e4cfdd tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] 10.222.0.43 "GET /compute/v2.1/servers/fc077a8b-c0f8-4bb1-8a39-91874ac015e7" status: 200 len: 1268 microversion: 2.1 time: 0.348328 Oct 04 18:33:01.081260 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 278/529] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:00 2022] GET /compute/v2.1/servers/fc077a8b-c0f8-4bb1-8a39-91874ac015e7 => generated 1268 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:01.083668 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-02fefd9d-d55e-4d97-b5a3-ab527dcf6a4c tempest-FlavorsV255TestJSON-51257839 tempest-FlavorsV255TestJSON-51257839-project-admin] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:01.092898 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-efc29924-b0f5-45e0-a75f-73d56a2493c7 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:01.094914 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-efc29924-b0f5-45e0-a75f-73d56a2493c7 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] [instance: fbe51dae-877b-4377-9f23-9a129775c317] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:01.103039 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-efc29924-b0f5-45e0-a75f-73d56a2493c7 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:01.103995 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-efc29924-b0f5-45e0-a75f-73d56a2493c7 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:01.105027 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-efc29924-b0f5-45e0-a75f-73d56a2493c7 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:01.107215 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-efc29924-b0f5-45e0-a75f-73d56a2493c7 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:01.108362 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-efc29924-b0f5-45e0-a75f-73d56a2493c7 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:01.109565 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-efc29924-b0f5-45e0-a75f-73d56a2493c7 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:01.152305 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-02fefd9d-d55e-4d97-b5a3-ab527dcf6a4c tempest-FlavorsV255TestJSON-51257839 tempest-FlavorsV255TestJSON-51257839-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 6154 microversion: 2.55 time: 0.078159 Oct 04 18:33:01.172824 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 252/530] 10.222.0.43 () {60 vars in 1187 bytes} [Tue Oct 4 18:33:01 2022] GET /compute/v2.1/flavors/detail => generated 6154 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:33:01.188787 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-e2195057-25d0-4802-a6cd-9e2b3a627f32 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:33:01.191363 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-e2195057-25d0-4802-a6cd-9e2b3a627f32 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] [instance: 606aebcb-2b6a-469f-a578-91325770ab4b] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:01.211578 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e2195057-25d0-4802-a6cd-9e2b3a627f32 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:01.212085 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e2195057-25d0-4802-a6cd-9e2b3a627f32 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:01.212550 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e2195057-25d0-4802-a6cd-9e2b3a627f32 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:01.213442 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e2195057-25d0-4802-a6cd-9e2b3a627f32 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:01.213985 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e2195057-25d0-4802-a6cd-9e2b3a627f32 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:01.214424 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e2195057-25d0-4802-a6cd-9e2b3a627f32 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:01.300506 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e2195057-25d0-4802-a6cd-9e2b3a627f32 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Acquiring lock "refresh_cache-606aebcb-2b6a-469f-a578-91325770ab4b" {{(pid=123595) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 04 18:33:01.300901 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e2195057-25d0-4802-a6cd-9e2b3a627f32 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Acquired lock "refresh_cache-606aebcb-2b6a-469f-a578-91325770ab4b" {{(pid=123595) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 04 18:33:01.432233 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-efc29924-b0f5-45e0-a75f-73d56a2493c7 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ea2088d8124b149187a1c140d3be88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82c615a05e8a4cd086f2e580529fb1d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:01.444323 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-efc29924-b0f5-45e0-a75f-73d56a2493c7 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] 10.222.0.43 "GET /compute/v2.1/servers/fbe51dae-877b-4377-9f23-9a129775c317" status: 200 len: 1390 microversion: 2.1 time: 0.361944 Oct 04 18:33:01.448477 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 279/531] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:01 2022] GET /compute/v2.1/servers/fbe51dae-877b-4377-9f23-9a129775c317 => generated 1390 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:01.503486 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-d5acb031-62bb-4335-a4b8-77388c3d8b67 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:01.504116 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-d5acb031-62bb-4335-a4b8-77388c3d8b67 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] [instance: 84e0414b-a39f-4bfe-bc9d-c170ceb34d15] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:01.511487 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d5acb031-62bb-4335-a4b8-77388c3d8b67 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:01.512315 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d5acb031-62bb-4335-a4b8-77388c3d8b67 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:01.512985 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d5acb031-62bb-4335-a4b8-77388c3d8b67 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:01.514149 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d5acb031-62bb-4335-a4b8-77388c3d8b67 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:01.514795 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d5acb031-62bb-4335-a4b8-77388c3d8b67 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:01.515405 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d5acb031-62bb-4335-a4b8-77388c3d8b67 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:01.719166 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-d5acb031-62bb-4335-a4b8-77388c3d8b67 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:01.735328 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-d5acb031-62bb-4335-a4b8-77388c3d8b67 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:01.740729 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-d5acb031-62bb-4335-a4b8-77388c3d8b67 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:01.754864 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-d5acb031-62bb-4335-a4b8-77388c3d8b67 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] 10.222.0.43 "GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15" status: 200 len: 1537 microversion: 2.91 time: 0.264929 Oct 04 18:33:01.755586 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 280/532] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:33:01 2022] GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15 => generated 1537 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:33:01.769047 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-424c0409-1c3c-442a-8ddf-516a08aef44f tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:01.773851 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-424c0409-1c3c-442a-8ddf-516a08aef44f tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] [instance: e5e92f30-937a-4ec2-b11f-336030c3d5c9] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:01.795062 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-424c0409-1c3c-442a-8ddf-516a08aef44f tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:01.795821 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-424c0409-1c3c-442a-8ddf-516a08aef44f tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:01.796578 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-424c0409-1c3c-442a-8ddf-516a08aef44f tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:01.797572 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-424c0409-1c3c-442a-8ddf-516a08aef44f tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:01.800131 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-424c0409-1c3c-442a-8ddf-516a08aef44f tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:01.802191 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-424c0409-1c3c-442a-8ddf-516a08aef44f tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:02.310300 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-424c0409-1c3c-442a-8ddf-516a08aef44f tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb7b0ce49ec438f9a60b79bdb2ac164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94ae6e2cb75d410d8029aa49909c973b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:02.318577 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-424c0409-1c3c-442a-8ddf-516a08aef44f tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] 10.222.0.43 "GET /compute/v2.1/servers/e5e92f30-937a-4ec2-b11f-336030c3d5c9" status: 200 len: 1322 microversion: 2.1 time: 0.558825 Oct 04 18:33:02.319285 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 281/533] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:01 2022] GET /compute/v2.1/servers/e5e92f30-937a-4ec2-b11f-336030c3d5c9 => generated 1322 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:02.341148 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-e6053aa6-cc0c-4aff-8817-95bf9c93354e tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:02.342070 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-e6053aa6-cc0c-4aff-8817-95bf9c93354e tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] [instance: fd5fe360-8ecf-41d0-9376-9d5533fc6ba8] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:02.349578 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e6053aa6-cc0c-4aff-8817-95bf9c93354e tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:02.350302 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e6053aa6-cc0c-4aff-8817-95bf9c93354e tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:02.350932 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e6053aa6-cc0c-4aff-8817-95bf9c93354e tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:02.352621 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e6053aa6-cc0c-4aff-8817-95bf9c93354e tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:02.353452 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e6053aa6-cc0c-4aff-8817-95bf9c93354e tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:02.354082 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e6053aa6-cc0c-4aff-8817-95bf9c93354e tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:02.480803 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-e6053aa6-cc0c-4aff-8817-95bf9c93354e tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:02.504713 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-e6053aa6-cc0c-4aff-8817-95bf9c93354e tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:02.519187 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e2195057-25d0-4802-a6cd-9e2b3a627f32 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Releasing lock "refresh_cache-606aebcb-2b6a-469f-a578-91325770ab4b" {{(pid=123595) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 04 18:33:02.519760 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-e2195057-25d0-4802-a6cd-9e2b3a627f32 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] HTTP exception thrown: floating IP not found Oct 04 18:33:02.520306 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-e6053aa6-cc0c-4aff-8817-95bf9c93354e tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:02.524157 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-e2195057-25d0-4802-a6cd-9e2b3a627f32 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Request method failure captured: Oct 04 18:33:02.524157 n-d-851028-13 devstack@n-api.service[123595]: request: POST /compute/v2.1/servers/606aebcb-2b6a-469f-a578-91325770ab4b/action HTTP/1.1 Oct 04 18:33:02.524157 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 18:33:02.524157 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 18:33:02.524157 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 18:33:02.524157 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 41 Oct 04 18:33:02.524157 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 18:33:02.524157 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 18:33:02.524157 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 18:33:02.524157 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 18:33:02.524157 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPHwvbOQqnDjvNFqcoO2SDu0TzYjAt5AyP3sChpg5Gr0w9tnlVGL1WnZBZGfhAGi45qS58eKNHB7XSOB8h3QYe_LH6aBK6h8b1Urcm7MaId1M56GN2pIau77L_IM8sT6CwZNggL3X1Mdk4EFReH0aW3i0ckLhikk7zf0FRhKVnOekuio Oct 04 18:33:02.524157 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 18:33:02.524157 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 18:33:02.524157 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 18:33:02.524157 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 18:33:02.524157 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 18:33:02.524157 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 18:33:02.524157 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: 38c636de1e6b42868f1f58e46fd4a3f0 Oct 04 18:33:02.524157 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 Oct 04 18:33:02.524157 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 18:33:02.524157 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 18:33:02.525771 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/38c636de1e6b42868f1f58e46fd4a3f0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_38c636de1e6b42868f1f58e46fd4a3f0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/38c636de1e6b42868f1f58e46fd4a3f0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/38c636de1e6b42868f1f58e46fd4a3f0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:33:02.525771 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 Oct 04 18:33:02.525771 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: 38c636de1e6b42868f1f58e46fd4a3f0 Oct 04 18:33:02.525771 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 Oct 04 18:33:02.525771 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project Oct 04 18:33:02.525771 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 18:33:02.525771 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 18:33:02.525771 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: f207a188e3fa4987b9fe4dd773ad03b9 Oct 04 18:33:02.525771 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project Oct 04 18:33:02.525771 n-d-851028-13 devstack@n-api.service[123595]: Oct 04 18:33:02.525771 n-d-851028-13 devstack@n-api.service[123595]: {"addFloatingIp": {"address": "0.0.0.0"}} Oct 04 18:33:02.525771 n-d-851028-13 devstack@n-api.service[123595]: method: Oct 04 18:33:02.525771 n-d-851028-13 devstack@n-api.service[123595]: exception: floating IP not found Oct 04 18:33:02.541558 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': '606aebcb-2b6a-469f-a578-91325770ab4b', 'body': {'addFloatingIp': {'address': '0.0.0.0'}}} Oct 04 18:33:02.541558 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:33:02.541558 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:33:02.541558 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Oct 04 18:33:02.541558 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Oct 04 18:33:02.541558 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Oct 04 18:33:02.541558 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Oct 04 18:33:02.541558 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2699, in associate_floating_ip Oct 04 18:33:02.541558 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, floating_address) Oct 04 18:33:02.541558 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Oct 04 18:33:02.541558 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Oct 04 18:33:02.541558 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Oct 04 18:33:02.541558 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:33:02.541558 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:33:02.541558 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:33:02.541558 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:33:02.541558 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:33:02.541558 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:33:02.541558 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:33:02.543768 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:33:02.543768 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:33:02.543768 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:33:02.543768 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:33:02.543768 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:33:02.543768 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:33:02.543768 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:33:02.543768 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 252, in _add_floating_ip Oct 04 18:33:02.543768 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 04 18:33:02.543768 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: floating IP not found Oct 04 18:33:02.543768 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:33:02.543768 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:33:02.543768 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:33:02.543768 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:33:02.543768 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:33:02.543768 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:33:02.543768 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:33:02.543768 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:33:02.543768 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: floating IP not found Oct 04 18:33:02.543768 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:33:02.545311 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-e6053aa6-cc0c-4aff-8817-95bf9c93354e tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] 10.222.0.43 "GET /compute/v2.1/servers/fd5fe360-8ecf-41d0-9376-9d5533fc6ba8" status: 200 len: 1319 microversion: 2.25 time: 0.190608 Oct 04 18:33:02.545311 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 282/534] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:33:02 2022] GET /compute/v2.1/servers/fd5fe360-8ecf-41d0-9376-9d5533fc6ba8 => generated 1319 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:33:02.545311 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-055af4b8-8d24-456e-83da-d03d430bdb61 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:02.545311 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-055af4b8-8d24-456e-83da-d03d430bdb61 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] [instance: fc077a8b-c0f8-4bb1-8a39-91874ac015e7] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:02.548699 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-055af4b8-8d24-456e-83da-d03d430bdb61 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:02.548699 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-055af4b8-8d24-456e-83da-d03d430bdb61 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:02.548969 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-055af4b8-8d24-456e-83da-d03d430bdb61 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:02.550807 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-055af4b8-8d24-456e-83da-d03d430bdb61 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:02.551290 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-055af4b8-8d24-456e-83da-d03d430bdb61 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:02.551726 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-055af4b8-8d24-456e-83da-d03d430bdb61 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:02.559121 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-e2195057-25d0-4802-a6cd-9e2b3a627f32 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Returning 404 to user: floating IP not found {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:33:02.561961 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-e2195057-25d0-4802-a6cd-9e2b3a627f32 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] 10.222.0.43 "POST /compute/v2.1/servers/606aebcb-2b6a-469f-a578-91325770ab4b/action" status: 404 len: 67 microversion: 2.1 time: 1.387884 Oct 04 18:33:02.566483 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 253/535] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 18:33:01 2022] POST /compute/v2.1/servers/606aebcb-2b6a-469f-a578-91325770ab4b/action => generated 67 bytes in 1393 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:33:02.578578 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-296f7a79-24d3-4e65-ba47-bf51a5c1af17 req-af20bf99-98b0-4df4-ba34-a4b492ad3b06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbe51dae-877b-4377-9f23-9a129775c317", "name": "network-vif-plugged", "status": "completed", "tag": "af27bbcc-4fc5-451e-89df-ae9d39d63786"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:33:02.596651 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-296f7a79-24d3-4e65-ba47-bf51a5c1af17 req-af20bf99-98b0-4df4-ba34-a4b492ad3b06 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:02.597150 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-296f7a79-24d3-4e65-ba47-bf51a5c1af17 req-af20bf99-98b0-4df4-ba34-a4b492ad3b06 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:02.597582 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-296f7a79-24d3-4e65-ba47-bf51a5c1af17 req-af20bf99-98b0-4df4-ba34-a4b492ad3b06 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:02.615536 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-296f7a79-24d3-4e65-ba47-bf51a5c1af17 req-af20bf99-98b0-4df4-ba34-a4b492ad3b06 service nova] Creating event network-vif-plugged:af27bbcc-4fc5-451e-89df-ae9d39d63786 for instance fbe51dae-877b-4377-9f23-9a129775c317 on n-h2-851028-13 Oct 04 18:33:02.626934 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-296f7a79-24d3-4e65-ba47-bf51a5c1af17 req-af20bf99-98b0-4df4-ba34-a4b492ad3b06 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058855 Oct 04 18:33:02.634350 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 254/536] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:33:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:33:02.640836 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-f53b9896-c9f3-4c05-9923-7de17c2550a2 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:02.642126 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-f53b9896-c9f3-4c05-9923-7de17c2550a2 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] [instance: fbe51dae-877b-4377-9f23-9a129775c317] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:02.654190 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f53b9896-c9f3-4c05-9923-7de17c2550a2 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:02.673336 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f53b9896-c9f3-4c05-9923-7de17c2550a2 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:02.674179 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f53b9896-c9f3-4c05-9923-7de17c2550a2 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:02.676235 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f53b9896-c9f3-4c05-9923-7de17c2550a2 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:02.676922 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f53b9896-c9f3-4c05-9923-7de17c2550a2 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:02.679697 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f53b9896-c9f3-4c05-9923-7de17c2550a2 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:02.748879 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-055af4b8-8d24-456e-83da-d03d430bdb61 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7db99f361654711bea7f1b2c404d312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7adedcdb9c3485ea2738c00e25aa3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:02.763647 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-055af4b8-8d24-456e-83da-d03d430bdb61 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] 10.222.0.43 "GET /compute/v2.1/servers/fc077a8b-c0f8-4bb1-8a39-91874ac015e7" status: 200 len: 1274 microversion: 2.1 time: 0.235003 Oct 04 18:33:02.782624 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 283/537] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:02 2022] GET /compute/v2.1/servers/fc077a8b-c0f8-4bb1-8a39-91874ac015e7 => generated 1274 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:02.782624 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-8da4d6b6-7344-49c9-95b9-28b597c94259 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:33:02.871874 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-8da4d6b6-7344-49c9-95b9-28b597c94259 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. Oct 04 18:33:02.873620 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-8da4d6b6-7344-49c9-95b9-28b597c94259 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Request method failure captured: Oct 04 18:33:02.873620 n-d-851028-13 devstack@n-api.service[123596]: request: POST /compute/v2.1/servers/606aebcb-2b6a-469f-a578-91325770ab4b/action HTTP/1.1 Oct 04 18:33:02.873620 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:33:02.873620 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:33:02.873620 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:33:02.873620 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 44 Oct 04 18:33:02.873620 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:33:02.873620 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:33:02.873620 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:33:02.873620 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:33:02.873620 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPHwvbOQqnDjvNFqcoO2SDu0TzYjAt5AyP3sChpg5Gr0w9tnlVGL1WnZBZGfhAGi45qS58eKNHB7XSOB8h3QYe_LH6aBK6h8b1Urcm7MaId1M56GN2pIau77L_IM8sT6CwZNggL3X1Mdk4EFReH0aW3i0ckLhikk7zf0FRhKVnOekuio Oct 04 18:33:02.873620 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:33:02.873620 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:33:02.873620 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:33:02.873620 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:33:02.873620 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:33:02.873620 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:33:02.873620 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: 38c636de1e6b42868f1f58e46fd4a3f0 Oct 04 18:33:02.873620 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 Oct 04 18:33:02.873620 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 18:33:02.873620 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 18:33:02.874982 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/38c636de1e6b42868f1f58e46fd4a3f0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_38c636de1e6b42868f1f58e46fd4a3f0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/38c636de1e6b42868f1f58e46fd4a3f0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/38c636de1e6b42868f1f58e46fd4a3f0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:33:02.874982 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 Oct 04 18:33:02.874982 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: 38c636de1e6b42868f1f58e46fd4a3f0 Oct 04 18:33:02.874982 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 Oct 04 18:33:02.874982 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project Oct 04 18:33:02.874982 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:33:02.874982 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:33:02.874982 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: f207a188e3fa4987b9fe4dd773ad03b9 Oct 04 18:33:02.874982 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project Oct 04 18:33:02.874982 n-d-851028-13 devstack@n-api.service[123596]: Oct 04 18:33:02.874982 n-d-851028-13 devstack@n-api.service[123596]: {"removeFloatingIp": {"address": "0.0.0.0"}} Oct 04 18:33:02.874982 n-d-851028-13 devstack@n-api.service[123596]: method: Oct 04 18:33:02.874982 n-d-851028-13 devstack@n-api.service[123596]: exception: Floating IP not found for address 0.0.0.0. Oct 04 18:33:02.875788 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': '606aebcb-2b6a-469f-a578-91325770ab4b', 'body': {'removeFloatingIp': {'address': '0.0.0.0'}}} Oct 04 18:33:02.875788 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:33:02.875788 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:33:02.875788 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 58, in get_instance_by_floating_ip_addr Oct 04 18:33:02.875788 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi self.network_api.get_instance_id_by_floating_address( Oct 04 18:33:02.875788 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2927, in get_instance_id_by_floating_address Oct 04 18:33:02.875788 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, address) Oct 04 18:33:02.875788 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Oct 04 18:33:02.875788 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Oct 04 18:33:02.875788 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Oct 04 18:33:02.875788 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:33:02.875788 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:33:02.875788 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:33:02.875788 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:33:02.875788 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:33:02.875788 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:33:02.875788 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:33:02.875788 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:33:02.875788 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:33:02.876871 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:33:02.876871 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:33:02.876871 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:33:02.876871 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:33:02.876871 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:33:02.876871 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 277, in _remove_floating_ip Oct 04 18:33:02.876871 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = get_instance_by_floating_ip_addr(self, context, address) Oct 04 18:33:02.876871 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 61, in get_instance_by_floating_ip_addr Oct 04 18:33:02.876871 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=ex.format_message()) Oct 04 18:33:02.876871 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for address 0.0.0.0. Oct 04 18:33:02.876871 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:33:02.876871 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:33:02.876871 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:33:02.876871 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:33:02.876871 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:33:02.876871 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:33:02.876871 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:33:02.876871 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:33:02.876871 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for address 0.0.0.0. Oct 04 18:33:02.876871 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:33:02.878118 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-8da4d6b6-7344-49c9-95b9-28b597c94259 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:33:02.878118 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-8da4d6b6-7344-49c9-95b9-28b597c94259 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] 10.222.0.43 "POST /compute/v2.1/servers/606aebcb-2b6a-469f-a578-91325770ab4b/action" status: 404 len: 88 microversion: 2.1 time: 0.098232 Oct 04 18:33:02.878118 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 284/538] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 18:33:02 2022] POST /compute/v2.1/servers/606aebcb-2b6a-469f-a578-91325770ab4b/action => generated 88 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:33:02.881466 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-2901c061-e442-4bf3-b398-435f0ec01733 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:02.882084 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-2901c061-e442-4bf3-b398-435f0ec01733 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] [instance: 84e0414b-a39f-4bfe-bc9d-c170ceb34d15] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:02.901316 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2901c061-e442-4bf3-b398-435f0ec01733 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:02.901869 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2901c061-e442-4bf3-b398-435f0ec01733 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:02.902334 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2901c061-e442-4bf3-b398-435f0ec01733 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:02.903085 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2901c061-e442-4bf3-b398-435f0ec01733 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:02.903556 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2901c061-e442-4bf3-b398-435f0ec01733 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:02.904001 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2901c061-e442-4bf3-b398-435f0ec01733 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:03.043552 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-2901c061-e442-4bf3-b398-435f0ec01733 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:03.071369 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-2901c061-e442-4bf3-b398-435f0ec01733 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:03.073782 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-2901c061-e442-4bf3-b398-435f0ec01733 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:03.079523 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-2901c061-e442-4bf3-b398-435f0ec01733 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] 10.222.0.43 "GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15" status: 200 len: 1537 microversion: 2.91 time: 0.202359 Oct 04 18:33:03.080413 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 285/539] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:33:02 2022] GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15 => generated 1537 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:33:03.085054 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-c71ad81f-13e5-4076-9343-5c9be9147263 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:03.085668 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-c71ad81f-13e5-4076-9343-5c9be9147263 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] [instance: 606aebcb-2b6a-469f-a578-91325770ab4b] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:03.091727 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c71ad81f-13e5-4076-9343-5c9be9147263 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:03.092232 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c71ad81f-13e5-4076-9343-5c9be9147263 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:03.092884 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c71ad81f-13e5-4076-9343-5c9be9147263 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:03.094629 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c71ad81f-13e5-4076-9343-5c9be9147263 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:03.095094 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c71ad81f-13e5-4076-9343-5c9be9147263 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:03.095581 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c71ad81f-13e5-4076-9343-5c9be9147263 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:03.144812 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-c71ad81f-13e5-4076-9343-5c9be9147263 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] [instance: 606aebcb-2b6a-469f-a578-91325770ab4b] Going to try to terminate instance {{(pid=123596) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:33:03.345695 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-c71ad81f-13e5-4076-9343-5c9be9147263 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] 10.222.0.43 "DELETE /compute/v2.1/servers/606aebcb-2b6a-469f-a578-91325770ab4b" status: 204 len: 0 microversion: 2.1 time: 0.263538 Oct 04 18:33:03.347596 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 286/540] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 18:33:03 2022] DELETE /compute/v2.1/servers/606aebcb-2b6a-469f-a578-91325770ab4b => generated 0 bytes in 266 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:33:03.364563 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-62998919-0d01-4ca0-a1e0-2a109e44ddc4 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:03.365504 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-62998919-0d01-4ca0-a1e0-2a109e44ddc4 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] [instance: e5e92f30-937a-4ec2-b11f-336030c3d5c9] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:03.395484 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-62998919-0d01-4ca0-a1e0-2a109e44ddc4 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:03.396284 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-62998919-0d01-4ca0-a1e0-2a109e44ddc4 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:03.396730 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-62998919-0d01-4ca0-a1e0-2a109e44ddc4 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:03.397480 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-62998919-0d01-4ca0-a1e0-2a109e44ddc4 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:03.400765 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-62998919-0d01-4ca0-a1e0-2a109e44ddc4 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:03.403908 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-62998919-0d01-4ca0-a1e0-2a109e44ddc4 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:03.534479 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-f53b9896-c9f3-4c05-9923-7de17c2550a2 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ea2088d8124b149187a1c140d3be88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82c615a05e8a4cd086f2e580529fb1d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:03.556488 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-f53b9896-c9f3-4c05-9923-7de17c2550a2 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] 10.222.0.43 "GET /compute/v2.1/servers/fbe51dae-877b-4377-9f23-9a129775c317" status: 200 len: 1390 microversion: 2.1 time: 0.919822 Oct 04 18:33:03.587162 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 255/541] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:02 2022] GET /compute/v2.1/servers/fbe51dae-877b-4377-9f23-9a129775c317 => generated 1390 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:03.620664 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-512a21d3-005f-40b5-ba83-c13a1b4efcc5 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:03.621981 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-512a21d3-005f-40b5-ba83-c13a1b4efcc5 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] [instance: 606aebcb-2b6a-469f-a578-91325770ab4b] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:03.639684 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-512a21d3-005f-40b5-ba83-c13a1b4efcc5 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:03.645210 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-512a21d3-005f-40b5-ba83-c13a1b4efcc5 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:03.647060 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-512a21d3-005f-40b5-ba83-c13a1b4efcc5 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:03.650463 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-512a21d3-005f-40b5-ba83-c13a1b4efcc5 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:03.651291 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-512a21d3-005f-40b5-ba83-c13a1b4efcc5 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:03.652173 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-512a21d3-005f-40b5-ba83-c13a1b4efcc5 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:03.705014 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-62998919-0d01-4ca0-a1e0-2a109e44ddc4 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb7b0ce49ec438f9a60b79bdb2ac164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94ae6e2cb75d410d8029aa49909c973b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:03.713631 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-62998919-0d01-4ca0-a1e0-2a109e44ddc4 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] 10.222.0.43 "GET /compute/v2.1/servers/e5e92f30-937a-4ec2-b11f-336030c3d5c9" status: 200 len: 1322 microversion: 2.1 time: 0.363265 Oct 04 18:33:03.716077 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 287/542] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:03 2022] GET /compute/v2.1/servers/e5e92f30-937a-4ec2-b11f-336030c3d5c9 => generated 1322 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:03.724514 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-e4e9bda8-4191-43b5-9ad7-14b4148321ae tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:03.725147 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-e4e9bda8-4191-43b5-9ad7-14b4148321ae tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] [instance: fd5fe360-8ecf-41d0-9376-9d5533fc6ba8] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:03.745540 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e4e9bda8-4191-43b5-9ad7-14b4148321ae tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:03.746029 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e4e9bda8-4191-43b5-9ad7-14b4148321ae tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:03.746468 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e4e9bda8-4191-43b5-9ad7-14b4148321ae tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:03.747501 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e4e9bda8-4191-43b5-9ad7-14b4148321ae tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:03.747953 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e4e9bda8-4191-43b5-9ad7-14b4148321ae tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:03.748371 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e4e9bda8-4191-43b5-9ad7-14b4148321ae tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:03.832285 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-e4e9bda8-4191-43b5-9ad7-14b4148321ae tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:03.843702 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-e4e9bda8-4191-43b5-9ad7-14b4148321ae tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:03.845048 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-e4e9bda8-4191-43b5-9ad7-14b4148321ae tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:03.846644 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-e4e9bda8-4191-43b5-9ad7-14b4148321ae tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] 10.222.0.43 "GET /compute/v2.1/servers/fd5fe360-8ecf-41d0-9376-9d5533fc6ba8" status: 200 len: 1319 microversion: 2.25 time: 0.128329 Oct 04 18:33:03.848507 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 288/543] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:33:03 2022] GET /compute/v2.1/servers/fd5fe360-8ecf-41d0-9376-9d5533fc6ba8 => generated 1319 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:33:03.853865 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-5114884a-016d-46b9-97ce-4c411fe16db8 req-d2ea8dfb-1098-40a2-b17c-5b42b45947e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5e92f30-937a-4ec2-b11f-336030c3d5c9", "tag": "17ae84c1-48ca-4769-9d6d-c68a66614fb0"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:33:03.864222 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-5114884a-016d-46b9-97ce-4c411fe16db8 req-d2ea8dfb-1098-40a2-b17c-5b42b45947e1 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:03.864902 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-5114884a-016d-46b9-97ce-4c411fe16db8 req-d2ea8dfb-1098-40a2-b17c-5b42b45947e1 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:03.865596 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-5114884a-016d-46b9-97ce-4c411fe16db8 req-d2ea8dfb-1098-40a2-b17c-5b42b45947e1 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:03.877846 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-5114884a-016d-46b9-97ce-4c411fe16db8 req-d2ea8dfb-1098-40a2-b17c-5b42b45947e1 service nova] Creating event network-changed:17ae84c1-48ca-4769-9d6d-c68a66614fb0 for instance e5e92f30-937a-4ec2-b11f-336030c3d5c9 on n-h2-851028-13 Oct 04 18:33:03.884404 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-5114884a-016d-46b9-97ce-4c411fe16db8 req-d2ea8dfb-1098-40a2-b17c-5b42b45947e1 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034721 Oct 04 18:33:03.885011 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 289/544] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:33:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:33:04.136848 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-512a21d3-005f-40b5-ba83-c13a1b4efcc5 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f207a188e3fa4987b9fe4dd773ad03b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c636de1e6b42868f1f58e46fd4a3f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:04.145345 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-512a21d3-005f-40b5-ba83-c13a1b4efcc5 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] 10.222.0.43 "GET /compute/v2.1/servers/606aebcb-2b6a-469f-a578-91325770ab4b" status: 200 len: 1542 microversion: 2.1 time: 0.552057 Oct 04 18:33:04.145917 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 256/545] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:03 2022] GET /compute/v2.1/servers/606aebcb-2b6a-469f-a578-91325770ab4b => generated 1542 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:04.164210 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-84f4f43a-b78a-4616-be13-5b6d384c6c86 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:04.165291 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-84f4f43a-b78a-4616-be13-5b6d384c6c86 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] [instance: fc077a8b-c0f8-4bb1-8a39-91874ac015e7] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:04.173766 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-84f4f43a-b78a-4616-be13-5b6d384c6c86 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:04.174654 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-84f4f43a-b78a-4616-be13-5b6d384c6c86 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:04.175398 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-84f4f43a-b78a-4616-be13-5b6d384c6c86 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:04.176524 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-84f4f43a-b78a-4616-be13-5b6d384c6c86 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:04.177283 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-84f4f43a-b78a-4616-be13-5b6d384c6c86 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:04.177875 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-84f4f43a-b78a-4616-be13-5b6d384c6c86 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:04.252520 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-bd6cb0ed-3ce5-43c2-8098-37d791e94284 tempest-FlavorsV261TestJSON-33117265 tempest-FlavorsV261TestJSON-33117265-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-53500582", "id": 14683996, "os-flavor-access:is_public": "True"}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:33:04.280727 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-bd6cb0ed-3ce5-43c2-8098-37d791e94284 tempest-FlavorsV261TestJSON-33117265 tempest-FlavorsV261TestJSON-33117265-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 460 microversion: 2.61 time: 0.394065 Oct 04 18:33:04.282170 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 290/546] 10.222.0.43 () {62 vars in 1188 bytes} [Tue Oct 4 18:33:03 2022] POST /compute/v2.1/flavors => generated 460 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:33:04.290810 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-b85ffe65-ee0e-4514-8015-d1c6fd0caaae tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:04.298826 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-b85ffe65-ee0e-4514-8015-d1c6fd0caaae tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] [instance: 84e0414b-a39f-4bfe-bc9d-c170ceb34d15] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:04.315128 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b85ffe65-ee0e-4514-8015-d1c6fd0caaae tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:04.315725 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b85ffe65-ee0e-4514-8015-d1c6fd0caaae tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:04.316171 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b85ffe65-ee0e-4514-8015-d1c6fd0caaae tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:04.316896 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b85ffe65-ee0e-4514-8015-d1c6fd0caaae tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:04.317377 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b85ffe65-ee0e-4514-8015-d1c6fd0caaae tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:04.317805 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b85ffe65-ee0e-4514-8015-d1c6fd0caaae tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:04.320713 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-84f4f43a-b78a-4616-be13-5b6d384c6c86 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7db99f361654711bea7f1b2c404d312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7adedcdb9c3485ea2738c00e25aa3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:04.339754 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-84f4f43a-b78a-4616-be13-5b6d384c6c86 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] 10.222.0.43 "GET /compute/v2.1/servers/fc077a8b-c0f8-4bb1-8a39-91874ac015e7" status: 200 len: 1274 microversion: 2.1 time: 0.184287 Oct 04 18:33:04.343755 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 257/547] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:04 2022] GET /compute/v2.1/servers/fc077a8b-c0f8-4bb1-8a39-91874ac015e7 => generated 1274 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:04.449248 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-b85ffe65-ee0e-4514-8015-d1c6fd0caaae tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:04.453818 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-b85ffe65-ee0e-4514-8015-d1c6fd0caaae tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:04.456087 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-b85ffe65-ee0e-4514-8015-d1c6fd0caaae tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:04.470241 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-b85ffe65-ee0e-4514-8015-d1c6fd0caaae tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] 10.222.0.43 "GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15" status: 200 len: 1537 microversion: 2.91 time: 0.186583 Oct 04 18:33:04.476583 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 291/548] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:33:04 2022] GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15 => generated 1537 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:33:04.562854 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-1a6a60b4-b87d-4f6b-b1f4-e382fcf4a580 tempest-FlavorsV261TestJSON-1146803022 tempest-FlavorsV261TestJSON-1146803022-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:04.580165 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-1a6a60b4-b87d-4f6b-b1f4-e382fcf4a580 tempest-FlavorsV261TestJSON-1146803022 tempest-FlavorsV261TestJSON-1146803022-project] 10.222.0.43 "GET /compute/v2.1/flavors/14683996" status: 200 len: 460 microversion: 2.61 time: 0.226412 Oct 04 18:33:04.581322 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 258/549] 10.222.0.43 () {60 vars in 1193 bytes} [Tue Oct 4 18:33:04 2022] GET /compute/v2.1/flavors/14683996 => generated 460 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:33:04.599086 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-eabdc745-de2a-46a3-896f-bfb88abb8ef3 tempest-FlavorsV261TestJSON-33117265 tempest-FlavorsV261TestJSON-33117265-project-admin] Action: 'update', calling method: .version_select at 0x7fb225a00670>, body: {"flavor": {"description": "new"}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:33:04.613750 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-6327a3ef-6b84-4ebf-a604-e964df52b290 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:04.615943 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-6327a3ef-6b84-4ebf-a604-e964df52b290 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] [instance: fbe51dae-877b-4377-9f23-9a129775c317] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:04.634274 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6327a3ef-6b84-4ebf-a604-e964df52b290 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:04.638363 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6327a3ef-6b84-4ebf-a604-e964df52b290 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:04.638980 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6327a3ef-6b84-4ebf-a604-e964df52b290 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:04.639845 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6327a3ef-6b84-4ebf-a604-e964df52b290 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:04.642191 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6327a3ef-6b84-4ebf-a604-e964df52b290 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:04.643646 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6327a3ef-6b84-4ebf-a604-e964df52b290 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:04.717697 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-eabdc745-de2a-46a3-896f-bfb88abb8ef3 tempest-FlavorsV261TestJSON-33117265 tempest-FlavorsV261TestJSON-33117265-project-admin] 10.222.0.43 "PUT /compute/v2.1/flavors/14683996" status: 200 len: 461 microversion: 2.61 time: 0.124701 Oct 04 18:33:04.719094 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 292/550] 10.222.0.43 () {62 vars in 1213 bytes} [Tue Oct 4 18:33:04 2022] PUT /compute/v2.1/flavors/14683996 => generated 461 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:33:04.739706 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-75f5048b-af18-4479-a3a6-99a1dae03750 tempest-FlavorsV261TestJSON-1146803022 tempest-FlavorsV261TestJSON-1146803022-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:04.752630 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=6,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:33:04.815378 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-75f5048b-af18-4479-a3a6-99a1dae03750 tempest-FlavorsV261TestJSON-1146803022 tempest-FlavorsV261TestJSON-1146803022-project] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 7149 microversion: 2.61 time: 0.081527 Oct 04 18:33:04.816712 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 293/551] 10.222.0.43 () {60 vars in 1187 bytes} [Tue Oct 4 18:33:04 2022] GET /compute/v2.1/flavors/detail => generated 7149 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:33:04.824208 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-ab3da09f-ea71-467d-adec-ad918ac364c3 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:04.825385 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-ab3da09f-ea71-467d-adec-ad918ac364c3 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] [instance: e5e92f30-937a-4ec2-b11f-336030c3d5c9] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:04.836358 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ab3da09f-ea71-467d-adec-ad918ac364c3 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:04.837004 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ab3da09f-ea71-467d-adec-ad918ac364c3 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:04.837333 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ab3da09f-ea71-467d-adec-ad918ac364c3 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:04.838088 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ab3da09f-ea71-467d-adec-ad918ac364c3 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:04.845690 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ab3da09f-ea71-467d-adec-ad918ac364c3 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:04.846159 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ab3da09f-ea71-467d-adec-ad918ac364c3 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:05.064878 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-ab3da09f-ea71-467d-adec-ad918ac364c3 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb7b0ce49ec438f9a60b79bdb2ac164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94ae6e2cb75d410d8029aa49909c973b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:05.074545 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-ab3da09f-ea71-467d-adec-ad918ac364c3 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] 10.222.0.43 "GET /compute/v2.1/servers/e5e92f30-937a-4ec2-b11f-336030c3d5c9" status: 200 len: 1322 microversion: 2.1 time: 0.255278 Oct 04 18:33:05.079847 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 294/552] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:04 2022] GET /compute/v2.1/servers/e5e92f30-937a-4ec2-b11f-336030c3d5c9 => generated 1322 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:05.084748 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-d32ef5e9-dfe5-4bdf-9a03-da08149863f0 tempest-FlavorsV261TestJSON-1146803022 tempest-FlavorsV261TestJSON-1146803022-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:05.130086 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-d32ef5e9-dfe5-4bdf-9a03-da08149863f0 tempest-FlavorsV261TestJSON-1146803022 tempest-FlavorsV261TestJSON-1146803022-project] 10.222.0.43 "GET /compute/v2.1/flavors" status: 200 len: 3676 microversion: 2.61 time: 0.048999 Oct 04 18:33:05.131191 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 295/553] 10.222.0.43 () {60 vars in 1166 bytes} [Tue Oct 4 18:33:05 2022] GET /compute/v2.1/flavors => generated 3676 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:33:05.150303 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-fd713a16-c99e-4c13-84c1-68be023f0ff0 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:05.151326 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-fd713a16-c99e-4c13-84c1-68be023f0ff0 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] [instance: fd5fe360-8ecf-41d0-9376-9d5533fc6ba8] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:05.161413 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fd713a16-c99e-4c13-84c1-68be023f0ff0 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:05.162448 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fd713a16-c99e-4c13-84c1-68be023f0ff0 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:05.162907 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fd713a16-c99e-4c13-84c1-68be023f0ff0 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:05.163671 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fd713a16-c99e-4c13-84c1-68be023f0ff0 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:05.166768 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fd713a16-c99e-4c13-84c1-68be023f0ff0 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:05.166768 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fd713a16-c99e-4c13-84c1-68be023f0ff0 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:05.357458 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-fd713a16-c99e-4c13-84c1-68be023f0ff0 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:05.366909 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-fd713a16-c99e-4c13-84c1-68be023f0ff0 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:05.368460 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-fd713a16-c99e-4c13-84c1-68be023f0ff0 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:05.369623 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-fd713a16-c99e-4c13-84c1-68be023f0ff0 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] 10.222.0.43 "GET /compute/v2.1/servers/fd5fe360-8ecf-41d0-9376-9d5533fc6ba8" status: 200 len: 1361 microversion: 2.25 time: 0.237658 Oct 04 18:33:05.386608 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 296/554] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:33:05 2022] GET /compute/v2.1/servers/fd5fe360-8ecf-41d0-9376-9d5533fc6ba8 => generated 1361 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:33:05.397394 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-65d25bac-65e5-4f72-a912-986e7e984cb1 tempest-FlavorsV261TestJSON-33117265 tempest-FlavorsV261TestJSON-33117265-project-admin] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:05.420607 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-65d25bac-65e5-4f72-a912-986e7e984cb1 tempest-FlavorsV261TestJSON-33117265 tempest-FlavorsV261TestJSON-33117265-project-admin] 10.222.0.43 "DELETE /compute/v2.1/flavors/14683996" status: 202 len: 0 microversion: 2.61 time: 0.031673 Oct 04 18:33:05.426787 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 297/555] 10.222.0.43 () {60 vars in 1196 bytes} [Tue Oct 4 18:33:05 2022] DELETE /compute/v2.1/flavors/14683996 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:33:05.432782 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-81aa2183-2b21-4145-997c-acbd2be6b817 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:05.433686 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-81aa2183-2b21-4145-997c-acbd2be6b817 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] [instance: 606aebcb-2b6a-469f-a578-91325770ab4b] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:05.441036 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-81aa2183-2b21-4145-997c-acbd2be6b817 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:05.441565 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-81aa2183-2b21-4145-997c-acbd2be6b817 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:05.442099 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-81aa2183-2b21-4145-997c-acbd2be6b817 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:05.443295 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-81aa2183-2b21-4145-997c-acbd2be6b817 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:05.443998 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-81aa2183-2b21-4145-997c-acbd2be6b817 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:05.444691 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-81aa2183-2b21-4145-997c-acbd2be6b817 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:05.454407 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-6327a3ef-6b84-4ebf-a604-e964df52b290 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ea2088d8124b149187a1c140d3be88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82c615a05e8a4cd086f2e580529fb1d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:05.467953 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-6327a3ef-6b84-4ebf-a604-e964df52b290 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] 10.222.0.43 "GET /compute/v2.1/servers/fbe51dae-877b-4377-9f23-9a129775c317" status: 200 len: 1390 microversion: 2.1 time: 0.869358 Oct 04 18:33:05.468938 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 259/556] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:04 2022] GET /compute/v2.1/servers/fbe51dae-877b-4377-9f23-9a129775c317 => generated 1390 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:05.481907 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-42b70bf8-9420-41c1-a8dd-ec1ec7e3e247 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:05.483478 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-42b70bf8-9420-41c1-a8dd-ec1ec7e3e247 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] [instance: fc077a8b-c0f8-4bb1-8a39-91874ac015e7] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:05.500908 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-42b70bf8-9420-41c1-a8dd-ec1ec7e3e247 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:05.507952 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-42b70bf8-9420-41c1-a8dd-ec1ec7e3e247 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:05.508646 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-42b70bf8-9420-41c1-a8dd-ec1ec7e3e247 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:05.509684 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-42b70bf8-9420-41c1-a8dd-ec1ec7e3e247 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:05.510372 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-42b70bf8-9420-41c1-a8dd-ec1ec7e3e247 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:05.510873 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-42b70bf8-9420-41c1-a8dd-ec1ec7e3e247 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:06.123118 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-42b70bf8-9420-41c1-a8dd-ec1ec7e3e247 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7db99f361654711bea7f1b2c404d312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7adedcdb9c3485ea2738c00e25aa3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:06.132890 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-42b70bf8-9420-41c1-a8dd-ec1ec7e3e247 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] 10.222.0.43 "GET /compute/v2.1/servers/fc077a8b-c0f8-4bb1-8a39-91874ac015e7" status: 200 len: 1316 microversion: 2.1 time: 0.654426 Oct 04 18:33:06.146316 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 260/557] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:05 2022] GET /compute/v2.1/servers/fc077a8b-c0f8-4bb1-8a39-91874ac015e7 => generated 1316 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:06.155602 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-4ad2198a-0fd0-465c-9a29-8b81da1ed2b7 tempest-FlavorsV261TestJSON-33117265 tempest-FlavorsV261TestJSON-33117265-project-admin] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:06.181512 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-4ad2198a-0fd0-465c-9a29-8b81da1ed2b7 tempest-FlavorsV261TestJSON-33117265 tempest-FlavorsV261TestJSON-33117265-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 6698 microversion: 2.61 time: 0.033342 Oct 04 18:33:06.183213 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 261/558] 10.222.0.43 () {60 vars in 1187 bytes} [Tue Oct 4 18:33:06 2022] GET /compute/v2.1/flavors/detail => generated 6698 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:33:06.188941 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-b52f7d06-7ffd-4212-9181-4b0c565e443e tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:06.189867 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-b52f7d06-7ffd-4212-9181-4b0c565e443e tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] [instance: 84e0414b-a39f-4bfe-bc9d-c170ceb34d15] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:06.202371 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b52f7d06-7ffd-4212-9181-4b0c565e443e tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:06.203261 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b52f7d06-7ffd-4212-9181-4b0c565e443e tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:06.203972 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b52f7d06-7ffd-4212-9181-4b0c565e443e tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:06.205053 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b52f7d06-7ffd-4212-9181-4b0c565e443e tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:06.209653 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b52f7d06-7ffd-4212-9181-4b0c565e443e tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:06.210369 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b52f7d06-7ffd-4212-9181-4b0c565e443e tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:06.229310 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-81aa2183-2b21-4145-997c-acbd2be6b817 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f207a188e3fa4987b9fe4dd773ad03b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c636de1e6b42868f1f58e46fd4a3f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:06.248063 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-81aa2183-2b21-4145-997c-acbd2be6b817 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] 10.222.0.43 "GET /compute/v2.1/servers/606aebcb-2b6a-469f-a578-91325770ab4b" status: 200 len: 1542 microversion: 2.1 time: 0.811199 Oct 04 18:33:06.249096 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 298/559] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:05 2022] GET /compute/v2.1/servers/606aebcb-2b6a-469f-a578-91325770ab4b => generated 1542 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:06.258912 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-8834acb6-a21d-4328-8756-b257b5bf6010 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:06.259860 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-8834acb6-a21d-4328-8756-b257b5bf6010 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] [instance: e5e92f30-937a-4ec2-b11f-336030c3d5c9] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:06.282266 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8834acb6-a21d-4328-8756-b257b5bf6010 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:06.283213 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8834acb6-a21d-4328-8756-b257b5bf6010 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:06.283896 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8834acb6-a21d-4328-8756-b257b5bf6010 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:06.285414 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8834acb6-a21d-4328-8756-b257b5bf6010 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:06.288549 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8834acb6-a21d-4328-8756-b257b5bf6010 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:06.289396 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8834acb6-a21d-4328-8756-b257b5bf6010 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:06.443391 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-b52f7d06-7ffd-4212-9181-4b0c565e443e tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:06.455815 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-b52f7d06-7ffd-4212-9181-4b0c565e443e tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:06.459906 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-b52f7d06-7ffd-4212-9181-4b0c565e443e tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:06.487223 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-b52f7d06-7ffd-4212-9181-4b0c565e443e tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] 10.222.0.43 "GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15" status: 200 len: 1537 microversion: 2.91 time: 0.299509 Oct 04 18:33:06.490345 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 262/560] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:33:06 2022] GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15 => generated 1537 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:33:06.514955 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-cba684be-d91c-4b06-93cc-1d4e1db09e94 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:06.515952 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-cba684be-d91c-4b06-93cc-1d4e1db09e94 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] [instance: fd5fe360-8ecf-41d0-9376-9d5533fc6ba8] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:06.529163 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cba684be-d91c-4b06-93cc-1d4e1db09e94 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:06.531515 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cba684be-d91c-4b06-93cc-1d4e1db09e94 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:06.536579 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cba684be-d91c-4b06-93cc-1d4e1db09e94 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:06.539779 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cba684be-d91c-4b06-93cc-1d4e1db09e94 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:06.541955 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cba684be-d91c-4b06-93cc-1d4e1db09e94 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:06.543332 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-8834acb6-a21d-4328-8756-b257b5bf6010 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb7b0ce49ec438f9a60b79bdb2ac164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94ae6e2cb75d410d8029aa49909c973b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:06.543995 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cba684be-d91c-4b06-93cc-1d4e1db09e94 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:06.548091 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:33:06.561959 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-8834acb6-a21d-4328-8756-b257b5bf6010 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] 10.222.0.43 "GET /compute/v2.1/servers/e5e92f30-937a-4ec2-b11f-336030c3d5c9" status: 200 len: 1322 microversion: 2.1 time: 0.309795 Oct 04 18:33:06.565303 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 299/561] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:06 2022] GET /compute/v2.1/servers/e5e92f30-937a-4ec2-b11f-336030c3d5c9 => generated 1322 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:06.572505 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-e74bac4a-c5b2-4724-9009-07b7c20f643a tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:06.573484 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-e74bac4a-c5b2-4724-9009-07b7c20f643a tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] [instance: fbe51dae-877b-4377-9f23-9a129775c317] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:06.587513 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e74bac4a-c5b2-4724-9009-07b7c20f643a tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:06.588278 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e74bac4a-c5b2-4724-9009-07b7c20f643a tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:06.588935 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e74bac4a-c5b2-4724-9009-07b7c20f643a tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:06.589919 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e74bac4a-c5b2-4724-9009-07b7c20f643a tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:06.590574 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e74bac4a-c5b2-4724-9009-07b7c20f643a tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:06.591165 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e74bac4a-c5b2-4724-9009-07b7c20f643a tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:06.889874 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-e74bac4a-c5b2-4724-9009-07b7c20f643a tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ea2088d8124b149187a1c140d3be88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82c615a05e8a4cd086f2e580529fb1d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:06.926360 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-e74bac4a-c5b2-4724-9009-07b7c20f643a tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] 10.222.0.43 "GET /compute/v2.1/servers/fbe51dae-877b-4377-9f23-9a129775c317" status: 200 len: 1589 microversion: 2.1 time: 0.359749 Oct 04 18:33:06.932115 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 300/562] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:06 2022] GET /compute/v2.1/servers/fbe51dae-877b-4377-9f23-9a129775c317 => generated 1589 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:06.933592 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-e74bac4a-c5b2-4724-9009-07b7c20f643a tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:06.938305 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-e74bac4a-c5b2-4724-9009-07b7c20f643a tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] 10.222.0.43 "GET /compute//" status: 200 len: 377 microversion: - time: 0.004987 Oct 04 18:33:06.947663 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 301/563] 10.222.0.43 () {56 vars in 886 bytes} [Tue Oct 4 18:33:06 2022] GET /compute/ => generated 377 bytes in 14 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 04 18:33:06.952981 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-75b8cc74-618f-4d3f-ae3a-04f275bc8ce5 req-234e2638-8603-42f2-954d-a2b2699550f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "606aebcb-2b6a-469f-a578-91325770ab4b", "name": "network-vif-deleted", "tag": "101c6584-c112-496c-8a18-4440b7f3aec5"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:33:06.983203 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-75b8cc74-618f-4d3f-ae3a-04f275bc8ce5 req-234e2638-8603-42f2-954d-a2b2699550f7 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:06.984971 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-75b8cc74-618f-4d3f-ae3a-04f275bc8ce5 req-234e2638-8603-42f2-954d-a2b2699550f7 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:06.986017 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-75b8cc74-618f-4d3f-ae3a-04f275bc8ce5 req-234e2638-8603-42f2-954d-a2b2699550f7 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:07.012124 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-cba684be-d91c-4b06-93cc-1d4e1db09e94 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:07.017775 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-75b8cc74-618f-4d3f-ae3a-04f275bc8ce5 req-234e2638-8603-42f2-954d-a2b2699550f7 service nova] Creating event network-vif-deleted:101c6584-c112-496c-8a18-4440b7f3aec5 for instance 606aebcb-2b6a-469f-a578-91325770ab4b on n-h2-851028-13 Oct 04 18:33:07.026595 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-cba684be-d91c-4b06-93cc-1d4e1db09e94 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:07.028053 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-cba684be-d91c-4b06-93cc-1d4e1db09e94 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:07.029028 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-75b8cc74-618f-4d3f-ae3a-04f275bc8ce5 req-234e2638-8603-42f2-954d-a2b2699550f7 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079478 Oct 04 18:33:07.031827 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 302/564] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:33:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:33:07.034687 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-cba684be-d91c-4b06-93cc-1d4e1db09e94 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] 10.222.0.43 "GET /compute/v2.1/servers/fd5fe360-8ecf-41d0-9376-9d5533fc6ba8" status: 200 len: 1361 microversion: 2.25 time: 0.529956 Oct 04 18:33:07.049710 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 263/565] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:33:06 2022] GET /compute/v2.1/servers/fd5fe360-8ecf-41d0-9376-9d5533fc6ba8 => generated 1361 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:33:07.051766 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-20ec0208-9346-49a9-9569-525486de1759 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:07.066105 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-20ec0208-9346-49a9-9569-525486de1759 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] [instance: fbe51dae-877b-4377-9f23-9a129775c317] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:07.075485 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-20ec0208-9346-49a9-9569-525486de1759 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:07.076126 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-20ec0208-9346-49a9-9569-525486de1759 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:07.076647 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-20ec0208-9346-49a9-9569-525486de1759 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:07.078224 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-20ec0208-9346-49a9-9569-525486de1759 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:07.079090 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-20ec0208-9346-49a9-9569-525486de1759 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:07.079312 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-20ec0208-9346-49a9-9569-525486de1759 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:07.159453 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-f1235730-51a3-48e8-8d88-ffeaece8f6be tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:07.160166 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-f1235730-51a3-48e8-8d88-ffeaece8f6be tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] [instance: fc077a8b-c0f8-4bb1-8a39-91874ac015e7] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:07.171847 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f1235730-51a3-48e8-8d88-ffeaece8f6be tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:07.172880 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f1235730-51a3-48e8-8d88-ffeaece8f6be tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:07.173615 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f1235730-51a3-48e8-8d88-ffeaece8f6be tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:07.175928 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f1235730-51a3-48e8-8d88-ffeaece8f6be tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:07.177949 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f1235730-51a3-48e8-8d88-ffeaece8f6be tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:07.178659 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f1235730-51a3-48e8-8d88-ffeaece8f6be tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:07.275199 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-20ec0208-9346-49a9-9569-525486de1759 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] 10.222.0.43 "GET /compute/v2.1/servers/fbe51dae-877b-4377-9f23-9a129775c317/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.240463 Oct 04 18:33:07.275826 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 303/566] 10.222.0.43 () {58 vars in 1275 bytes} [Tue Oct 4 18:33:07 2022] GET /compute/v2.1/servers/fbe51dae-877b-4377-9f23-9a129775c317/os-interface => generated 284 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:33:07.291373 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-9fce109e-3c41-49e0-ab9b-122992878a95 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:07.292101 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-9fce109e-3c41-49e0-ab9b-122992878a95 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] [instance: 606aebcb-2b6a-469f-a578-91325770ab4b] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:07.303816 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9fce109e-3c41-49e0-ab9b-122992878a95 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:07.308550 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9fce109e-3c41-49e0-ab9b-122992878a95 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:07.310952 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9fce109e-3c41-49e0-ab9b-122992878a95 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:07.311952 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9fce109e-3c41-49e0-ab9b-122992878a95 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:07.314162 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9fce109e-3c41-49e0-ab9b-122992878a95 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:07.316690 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9fce109e-3c41-49e0-ab9b-122992878a95 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:07.372337 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9fce109e-3c41-49e0-ab9b-122992878a95 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:07.373054 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9fce109e-3c41-49e0-ab9b-122992878a95 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:07.373697 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9fce109e-3c41-49e0-ab9b-122992878a95 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:07.374317 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.objects.instance [None req-9fce109e-3c41-49e0-ab9b-122992878a95 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Lazy-loading 'fault' on Instance uuid 606aebcb-2b6a-469f-a578-91325770ab4b {{(pid=123596) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:33:07.544454 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-9fce109e-3c41-49e0-ab9b-122992878a95 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f207a188e3fa4987b9fe4dd773ad03b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c636de1e6b42868f1f58e46fd4a3f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:07.558617 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-9fce109e-3c41-49e0-ab9b-122992878a95 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] 10.222.0.43 "GET /compute/v2.1/servers/606aebcb-2b6a-469f-a578-91325770ab4b" status: 200 len: 1322 microversion: 2.1 time: 0.272977 Oct 04 18:33:07.559438 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 304/567] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:07 2022] GET /compute/v2.1/servers/606aebcb-2b6a-469f-a578-91325770ab4b => generated 1322 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:07.568561 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-ad3b783f-4cd7-45b6-9865-c9451c03b4ee req-257a6878-2353-45bf-8319-307601fd6f2e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd5fe360-8ecf-41d0-9376-9d5533fc6ba8", "tag": "c60c6944-7112-4929-bd6e-03bb7d4559d0"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:33:07.592507 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-ad3b783f-4cd7-45b6-9865-c9451c03b4ee req-257a6878-2353-45bf-8319-307601fd6f2e service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:07.593268 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-ad3b783f-4cd7-45b6-9865-c9451c03b4ee req-257a6878-2353-45bf-8319-307601fd6f2e service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:07.593541 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-ad3b783f-4cd7-45b6-9865-c9451c03b4ee req-257a6878-2353-45bf-8319-307601fd6f2e service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:07.619565 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-ad3b783f-4cd7-45b6-9865-c9451c03b4ee req-257a6878-2353-45bf-8319-307601fd6f2e service nova] Creating event network-changed:c60c6944-7112-4929-bd6e-03bb7d4559d0 for instance fd5fe360-8ecf-41d0-9376-9d5533fc6ba8 on n-h1-851028-13 Oct 04 18:33:07.637019 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-ad3b783f-4cd7-45b6-9865-c9451c03b4ee req-257a6878-2353-45bf-8319-307601fd6f2e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075177 Oct 04 18:33:07.637682 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 305/568] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:33:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:33:07.642819 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-844324b1-b67d-4e43-8574-cc3bf0601ec2 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:07.643515 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-844324b1-b67d-4e43-8574-cc3bf0601ec2 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] [instance: 84e0414b-a39f-4bfe-bc9d-c170ceb34d15] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:07.662110 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-844324b1-b67d-4e43-8574-cc3bf0601ec2 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:07.662940 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-844324b1-b67d-4e43-8574-cc3bf0601ec2 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:07.664434 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-844324b1-b67d-4e43-8574-cc3bf0601ec2 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:07.667330 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-844324b1-b67d-4e43-8574-cc3bf0601ec2 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:07.668041 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-844324b1-b67d-4e43-8574-cc3bf0601ec2 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:07.668838 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-844324b1-b67d-4e43-8574-cc3bf0601ec2 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:07.720793 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-f1235730-51a3-48e8-8d88-ffeaece8f6be tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7db99f361654711bea7f1b2c404d312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7adedcdb9c3485ea2738c00e25aa3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:07.729194 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-f1235730-51a3-48e8-8d88-ffeaece8f6be tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] 10.222.0.43 "GET /compute/v2.1/servers/fc077a8b-c0f8-4bb1-8a39-91874ac015e7" status: 200 len: 1316 microversion: 2.1 time: 0.573450 Oct 04 18:33:07.729791 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 264/569] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:07 2022] GET /compute/v2.1/servers/fc077a8b-c0f8-4bb1-8a39-91874ac015e7 => generated 1316 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:33:07.749209 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-b19e7231-df70-4f22-a516-e89d48786b6a tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:07.749851 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-b19e7231-df70-4f22-a516-e89d48786b6a tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] [instance: e5e92f30-937a-4ec2-b11f-336030c3d5c9] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:07.756377 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b19e7231-df70-4f22-a516-e89d48786b6a tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:07.757250 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b19e7231-df70-4f22-a516-e89d48786b6a tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:07.757898 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b19e7231-df70-4f22-a516-e89d48786b6a tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:07.758906 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b19e7231-df70-4f22-a516-e89d48786b6a tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:07.759575 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b19e7231-df70-4f22-a516-e89d48786b6a tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:07.760287 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b19e7231-df70-4f22-a516-e89d48786b6a tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:07.808917 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=6 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:33:07.820474 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-844324b1-b67d-4e43-8574-cc3bf0601ec2 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:07.842186 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-844324b1-b67d-4e43-8574-cc3bf0601ec2 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:07.845145 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-844324b1-b67d-4e43-8574-cc3bf0601ec2 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:07.848140 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=16 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:33:07.852981 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-844324b1-b67d-4e43-8574-cc3bf0601ec2 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] 10.222.0.43 "GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15" status: 200 len: 1537 microversion: 2.91 time: 0.213849 Oct 04 18:33:07.854400 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 306/570] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:33:07 2022] GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15 => generated 1537 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:33:08.000324 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=8 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:33:08.067223 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-2a287cb6-911b-4fc7-908e-f36c6003bf85 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:08.068070 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-2a287cb6-911b-4fc7-908e-f36c6003bf85 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] [instance: fd5fe360-8ecf-41d0-9376-9d5533fc6ba8] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:08.078003 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2a287cb6-911b-4fc7-908e-f36c6003bf85 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:08.079082 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2a287cb6-911b-4fc7-908e-f36c6003bf85 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:08.080040 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2a287cb6-911b-4fc7-908e-f36c6003bf85 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:08.081013 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2a287cb6-911b-4fc7-908e-f36c6003bf85 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:08.081827 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2a287cb6-911b-4fc7-908e-f36c6003bf85 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:08.082485 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2a287cb6-911b-4fc7-908e-f36c6003bf85 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:08.467176 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-b19e7231-df70-4f22-a516-e89d48786b6a tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb7b0ce49ec438f9a60b79bdb2ac164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94ae6e2cb75d410d8029aa49909c973b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:08.479051 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-b19e7231-df70-4f22-a516-e89d48786b6a tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] 10.222.0.43 "GET /compute/v2.1/servers/e5e92f30-937a-4ec2-b11f-336030c3d5c9" status: 200 len: 1322 microversion: 2.1 time: 0.733630 Oct 04 18:33:08.481457 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 265/571] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:07 2022] GET /compute/v2.1/servers/e5e92f30-937a-4ec2-b11f-336030c3d5c9 => generated 1322 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:08.578318 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-2a287cb6-911b-4fc7-908e-f36c6003bf85 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:08.590734 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-2a287cb6-911b-4fc7-908e-f36c6003bf85 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:08.592964 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-2a287cb6-911b-4fc7-908e-f36c6003bf85 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:08.594386 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-2a287cb6-911b-4fc7-908e-f36c6003bf85 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] 10.222.0.43 "GET /compute/v2.1/servers/fd5fe360-8ecf-41d0-9376-9d5533fc6ba8" status: 200 len: 1361 microversion: 2.25 time: 0.534062 Oct 04 18:33:08.595564 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 307/572] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:33:08 2022] GET /compute/v2.1/servers/fd5fe360-8ecf-41d0-9376-9d5533fc6ba8 => generated 1361 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:33:08.604116 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-344f82b6-f512-4e82-8dba-c42120cb11a9 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:08.605024 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-344f82b6-f512-4e82-8dba-c42120cb11a9 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] [instance: 606aebcb-2b6a-469f-a578-91325770ab4b] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:08.615250 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-344f82b6-f512-4e82-8dba-c42120cb11a9 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:08.615746 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-344f82b6-f512-4e82-8dba-c42120cb11a9 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:08.616723 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-344f82b6-f512-4e82-8dba-c42120cb11a9 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:08.617473 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-344f82b6-f512-4e82-8dba-c42120cb11a9 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:08.618211 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-344f82b6-f512-4e82-8dba-c42120cb11a9 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:08.618972 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-344f82b6-f512-4e82-8dba-c42120cb11a9 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:08.657967 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-344f82b6-f512-4e82-8dba-c42120cb11a9 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:08.659332 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-344f82b6-f512-4e82-8dba-c42120cb11a9 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:08.660049 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-344f82b6-f512-4e82-8dba-c42120cb11a9 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:08.660919 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.objects.instance [None req-344f82b6-f512-4e82-8dba-c42120cb11a9 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Lazy-loading 'fault' on Instance uuid 606aebcb-2b6a-469f-a578-91325770ab4b {{(pid=123595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:33:08.752705 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-597e7738-9263-4ca6-aeb3-577755eaa0ea tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:08.753737 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-597e7738-9263-4ca6-aeb3-577755eaa0ea tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] [instance: fc077a8b-c0f8-4bb1-8a39-91874ac015e7] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:08.761725 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-597e7738-9263-4ca6-aeb3-577755eaa0ea tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:08.762512 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-597e7738-9263-4ca6-aeb3-577755eaa0ea tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:08.763181 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-597e7738-9263-4ca6-aeb3-577755eaa0ea tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:08.764098 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-597e7738-9263-4ca6-aeb3-577755eaa0ea tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:08.764789 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-597e7738-9263-4ca6-aeb3-577755eaa0ea tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:08.765470 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-597e7738-9263-4ca6-aeb3-577755eaa0ea tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:08.770725 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-344f82b6-f512-4e82-8dba-c42120cb11a9 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f207a188e3fa4987b9fe4dd773ad03b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c636de1e6b42868f1f58e46fd4a3f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:08.780755 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-344f82b6-f512-4e82-8dba-c42120cb11a9 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] 10.222.0.43 "GET /compute/v2.1/servers/606aebcb-2b6a-469f-a578-91325770ab4b" status: 200 len: 1322 microversion: 2.1 time: 0.180812 Oct 04 18:33:08.787697 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 266/573] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:08 2022] GET /compute/v2.1/servers/606aebcb-2b6a-469f-a578-91325770ab4b => generated 1322 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:08.886240 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-377b869f-e961-4e68-8b5a-a31d76fd26c3 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:08.887587 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-377b869f-e961-4e68-8b5a-a31d76fd26c3 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] [instance: 84e0414b-a39f-4bfe-bc9d-c170ceb34d15] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:08.900068 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-377b869f-e961-4e68-8b5a-a31d76fd26c3 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:08.900565 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-377b869f-e961-4e68-8b5a-a31d76fd26c3 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:08.901037 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-377b869f-e961-4e68-8b5a-a31d76fd26c3 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:08.901784 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-377b869f-e961-4e68-8b5a-a31d76fd26c3 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:08.902238 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-377b869f-e961-4e68-8b5a-a31d76fd26c3 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:08.903609 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-377b869f-e961-4e68-8b5a-a31d76fd26c3 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:09.011847 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-377b869f-e961-4e68-8b5a-a31d76fd26c3 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:09.028658 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-377b869f-e961-4e68-8b5a-a31d76fd26c3 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:09.030167 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-377b869f-e961-4e68-8b5a-a31d76fd26c3 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:09.039334 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-377b869f-e961-4e68-8b5a-a31d76fd26c3 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] 10.222.0.43 "GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15" status: 200 len: 1537 microversion: 2.91 time: 0.159703 Oct 04 18:33:09.040151 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 267/574] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:33:08 2022] GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15 => generated 1537 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:33:09.064752 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-597e7738-9263-4ca6-aeb3-577755eaa0ea tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7db99f361654711bea7f1b2c404d312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7adedcdb9c3485ea2738c00e25aa3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:09.075100 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-597e7738-9263-4ca6-aeb3-577755eaa0ea tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] 10.222.0.43 "GET /compute/v2.1/servers/fc077a8b-c0f8-4bb1-8a39-91874ac015e7" status: 200 len: 1316 microversion: 2.1 time: 0.326993 Oct 04 18:33:09.091729 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 308/575] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:08 2022] GET /compute/v2.1/servers/fc077a8b-c0f8-4bb1-8a39-91874ac015e7 => generated 1316 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:09.304586 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-7c30137d-4112-4c87-a84c-a4f47875034c tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:09.305414 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-5c0bb3d2-cac0-41d1-ad63-02a678a4da62 req-a158604a-8874-4d5d-88b8-b01905f8d5c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fbe51dae-877b-4377-9f23-9a129775c317", "tag": "af27bbcc-4fc5-451e-89df-ae9d39d63786"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:33:09.305953 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-7c30137d-4112-4c87-a84c-a4f47875034c tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] [instance: fbe51dae-877b-4377-9f23-9a129775c317] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:09.321495 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=22 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:33:09.324488 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7c30137d-4112-4c87-a84c-a4f47875034c tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:09.325404 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7c30137d-4112-4c87-a84c-a4f47875034c tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:09.328099 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7c30137d-4112-4c87-a84c-a4f47875034c tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:09.328901 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7c30137d-4112-4c87-a84c-a4f47875034c tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:09.329605 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7c30137d-4112-4c87-a84c-a4f47875034c tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:09.331398 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7c30137d-4112-4c87-a84c-a4f47875034c tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:09.337079 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-5c0bb3d2-cac0-41d1-ad63-02a678a4da62 req-a158604a-8874-4d5d-88b8-b01905f8d5c9 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:09.337986 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-5c0bb3d2-cac0-41d1-ad63-02a678a4da62 req-a158604a-8874-4d5d-88b8-b01905f8d5c9 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:09.338613 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-5c0bb3d2-cac0-41d1-ad63-02a678a4da62 req-a158604a-8874-4d5d-88b8-b01905f8d5c9 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:09.399378 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-5c0bb3d2-cac0-41d1-ad63-02a678a4da62 req-a158604a-8874-4d5d-88b8-b01905f8d5c9 service nova] Creating event network-changed:af27bbcc-4fc5-451e-89df-ae9d39d63786 for instance fbe51dae-877b-4377-9f23-9a129775c317 on n-h2-851028-13 Oct 04 18:33:09.415638 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-5c0bb3d2-cac0-41d1-ad63-02a678a4da62 req-a158604a-8874-4d5d-88b8-b01905f8d5c9 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116652 Oct 04 18:33:09.418685 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 309/576] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:33:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:33:09.507500 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-bea937a1-c38e-4e5e-a930-46dbfece16c9 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:09.510395 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-bea937a1-c38e-4e5e-a930-46dbfece16c9 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] [instance: e5e92f30-937a-4ec2-b11f-336030c3d5c9] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:09.529774 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bea937a1-c38e-4e5e-a930-46dbfece16c9 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:09.530673 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bea937a1-c38e-4e5e-a930-46dbfece16c9 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:09.531333 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bea937a1-c38e-4e5e-a930-46dbfece16c9 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:09.539093 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bea937a1-c38e-4e5e-a930-46dbfece16c9 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:09.541646 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bea937a1-c38e-4e5e-a930-46dbfece16c9 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:09.542334 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bea937a1-c38e-4e5e-a930-46dbfece16c9 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:09.799793 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-7c30137d-4112-4c87-a84c-a4f47875034c tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ea2088d8124b149187a1c140d3be88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82c615a05e8a4cd086f2e580529fb1d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:09.810591 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-7c30137d-4112-4c87-a84c-a4f47875034c tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] 10.222.0.43 "GET /compute/v2.1/servers/fbe51dae-877b-4377-9f23-9a129775c317" status: 200 len: 1589 microversion: 2.1 time: 0.516717 Oct 04 18:33:09.811564 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 268/577] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:09 2022] GET /compute/v2.1/servers/fbe51dae-877b-4377-9f23-9a129775c317 => generated 1589 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:09.835050 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-301519ab-6242-44f1-b1fd-f8cdae7b28ac tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:09.836170 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-301519ab-6242-44f1-b1fd-f8cdae7b28ac tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] [instance: fd5fe360-8ecf-41d0-9376-9d5533fc6ba8] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:09.849648 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-301519ab-6242-44f1-b1fd-f8cdae7b28ac tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:09.852699 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-301519ab-6242-44f1-b1fd-f8cdae7b28ac tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:09.854163 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-301519ab-6242-44f1-b1fd-f8cdae7b28ac tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:09.856569 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-301519ab-6242-44f1-b1fd-f8cdae7b28ac tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:09.859746 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-301519ab-6242-44f1-b1fd-f8cdae7b28ac tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:09.860514 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-301519ab-6242-44f1-b1fd-f8cdae7b28ac tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:09.873248 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-bea937a1-c38e-4e5e-a930-46dbfece16c9 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb7b0ce49ec438f9a60b79bdb2ac164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94ae6e2cb75d410d8029aa49909c973b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:09.890498 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=100 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:33:09.898425 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-bea937a1-c38e-4e5e-a930-46dbfece16c9 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] 10.222.0.43 "GET /compute/v2.1/servers/e5e92f30-937a-4ec2-b11f-336030c3d5c9" status: 200 len: 1322 microversion: 2.1 time: 0.396929 Oct 04 18:33:09.900501 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 310/578] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:09 2022] GET /compute/v2.1/servers/e5e92f30-937a-4ec2-b11f-336030c3d5c9 => generated 1322 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:33:09.917690 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-339d6892-13a3-4bf7-be19-085401912b2a req-ba97c724-b6ef-46f8-8319-d15f8a5ec2bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc077a8b-c0f8-4bb1-8a39-91874ac015e7", "tag": "8aafc535-def4-4ec3-9e02-7b72095d1324"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:33:09.931643 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-339d6892-13a3-4bf7-be19-085401912b2a req-ba97c724-b6ef-46f8-8319-d15f8a5ec2bd service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:09.932529 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-339d6892-13a3-4bf7-be19-085401912b2a req-ba97c724-b6ef-46f8-8319-d15f8a5ec2bd service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:09.933300 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-339d6892-13a3-4bf7-be19-085401912b2a req-ba97c724-b6ef-46f8-8319-d15f8a5ec2bd service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:09.947685 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-339d6892-13a3-4bf7-be19-085401912b2a req-ba97c724-b6ef-46f8-8319-d15f8a5ec2bd service nova] Creating event network-changed:8aafc535-def4-4ec3-9e02-7b72095d1324 for instance fc077a8b-c0f8-4bb1-8a39-91874ac015e7 on n-h2-851028-13 Oct 04 18:33:09.952924 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-339d6892-13a3-4bf7-be19-085401912b2a req-ba97c724-b6ef-46f8-8319-d15f8a5ec2bd service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051000 Oct 04 18:33:09.954518 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 311/579] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:33:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:33:09.961828 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-7b5d67ba-9277-481a-b4c7-ddbbca3614eb tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:09.963415 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-7b5d67ba-9277-481a-b4c7-ddbbca3614eb tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] [instance: 606aebcb-2b6a-469f-a578-91325770ab4b] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:09.970522 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7b5d67ba-9277-481a-b4c7-ddbbca3614eb tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:09.971234 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7b5d67ba-9277-481a-b4c7-ddbbca3614eb tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:09.972207 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7b5d67ba-9277-481a-b4c7-ddbbca3614eb tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:09.974234 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7b5d67ba-9277-481a-b4c7-ddbbca3614eb tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:09.975104 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7b5d67ba-9277-481a-b4c7-ddbbca3614eb tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:09.976432 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7b5d67ba-9277-481a-b4c7-ddbbca3614eb tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:09.997476 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-7b5d67ba-9277-481a-b4c7-ddbbca3614eb tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] HTTP exception thrown: Instance 606aebcb-2b6a-469f-a578-91325770ab4b could not be found. Oct 04 18:33:09.998958 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-7b5d67ba-9277-481a-b4c7-ddbbca3614eb tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Request method failure captured: Oct 04 18:33:09.998958 n-d-851028-13 devstack@n-api.service[123596]: request: GET /compute/v2.1/servers/606aebcb-2b6a-469f-a578-91325770ab4b HTTP/1.1 Oct 04 18:33:09.998958 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:33:09.998958 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:33:09.998958 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:33:09.998958 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 18:33:09.998958 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:33:09.998958 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:33:09.998958 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:33:09.998958 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:33:09.998958 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPHwvbOQqnDjvNFqcoO2SDu0TzYjAt5AyP3sChpg5Gr0w9tnlVGL1WnZBZGfhAGi45qS58eKNHB7XSOB8h3QYe_LH6aBK6h8b1Urcm7MaId1M56GN2pIau77L_IM8sT6CwZNggL3X1Mdk4EFReH0aW3i0ckLhikk7zf0FRhKVnOekuio Oct 04 18:33:09.998958 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:33:09.998958 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:33:09.998958 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:33:09.998958 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:33:09.998958 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:33:09.998958 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:33:09.998958 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: 38c636de1e6b42868f1f58e46fd4a3f0 Oct 04 18:33:09.998958 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 Oct 04 18:33:09.998958 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 18:33:09.998958 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 18:33:10.000622 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/38c636de1e6b42868f1f58e46fd4a3f0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_38c636de1e6b42868f1f58e46fd4a3f0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/38c636de1e6b42868f1f58e46fd4a3f0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/38c636de1e6b42868f1f58e46fd4a3f0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:33:10.000622 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 Oct 04 18:33:10.000622 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: 38c636de1e6b42868f1f58e46fd4a3f0 Oct 04 18:33:10.000622 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 Oct 04 18:33:10.000622 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project Oct 04 18:33:10.000622 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:33:10.000622 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:33:10.000622 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: f207a188e3fa4987b9fe4dd773ad03b9 Oct 04 18:33:10.000622 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project Oct 04 18:33:10.000622 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 18:33:10.000622 n-d-851028-13 devstack@n-api.service[123596]: exception: Instance 606aebcb-2b6a-469f-a578-91325770ab4b could not be found. Oct 04 18:33:10.001738 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': '606aebcb-2b6a-469f-a578-91325770ab4b'} Oct 04 18:33:10.001738 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:33:10.001738 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:33:10.001738 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:33:10.001738 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:33:10.001738 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:33:10.001738 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:33:10.001738 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:33:10.001738 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:33:10.001738 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:33:10.001738 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:33:10.001738 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 606aebcb-2b6a-469f-a578-91325770ab4b could not be found. Oct 04 18:33:10.001738 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:33:10.001738 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:33:10.001738 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:33:10.001738 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:33:10.001738 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:33:10.001738 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:33:10.001738 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:33:10.001738 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:33:10.003411 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:33:10.003411 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:33:10.003411 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:33:10.003411 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:33:10.003411 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:33:10.003411 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:33:10.003411 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:33:10.003411 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:33:10.003411 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 606aebcb-2b6a-469f-a578-91325770ab4b could not be found. Oct 04 18:33:10.003411 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:33:10.003411 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:33:10.003411 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:33:10.003411 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:33:10.003411 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:33:10.003411 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:33:10.003411 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:33:10.003411 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:33:10.003411 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 606aebcb-2b6a-469f-a578-91325770ab4b could not be found. Oct 04 18:33:10.003411 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:33:10.005569 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-7b5d67ba-9277-481a-b4c7-ddbbca3614eb tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] Returning 404 to user: Instance 606aebcb-2b6a-469f-a578-91325770ab4b could not be found. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:33:10.007015 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-7b5d67ba-9277-481a-b4c7-ddbbca3614eb tempest-FloatingIPsAssociationNegativeTestJSON-1348035609 tempest-FloatingIPsAssociationNegativeTestJSON-1348035609-project] 10.222.0.43 "GET /compute/v2.1/servers/606aebcb-2b6a-469f-a578-91325770ab4b" status: 404 len: 111 microversion: 2.1 time: 0.050855 Oct 04 18:33:10.007990 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 312/580] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:09 2022] GET /compute/v2.1/servers/606aebcb-2b6a-469f-a578-91325770ab4b => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:33:10.069873 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-a4526a2a-3208-4664-853b-3c0defe4e3aa tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:10.070487 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-a4526a2a-3208-4664-853b-3c0defe4e3aa tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] [instance: 84e0414b-a39f-4bfe-bc9d-c170ceb34d15] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:10.079498 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a4526a2a-3208-4664-853b-3c0defe4e3aa tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:10.080011 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a4526a2a-3208-4664-853b-3c0defe4e3aa tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:10.080453 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a4526a2a-3208-4664-853b-3c0defe4e3aa tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:10.086288 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a4526a2a-3208-4664-853b-3c0defe4e3aa tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:10.086916 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a4526a2a-3208-4664-853b-3c0defe4e3aa tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:10.087465 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a4526a2a-3208-4664-853b-3c0defe4e3aa tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:10.213250 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-a4526a2a-3208-4664-853b-3c0defe4e3aa tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:10.227442 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-a4526a2a-3208-4664-853b-3c0defe4e3aa tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:10.231901 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-a4526a2a-3208-4664-853b-3c0defe4e3aa tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:10.241055 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-a4526a2a-3208-4664-853b-3c0defe4e3aa tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] 10.222.0.43 "GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15" status: 200 len: 1537 microversion: 2.91 time: 0.174201 Oct 04 18:33:10.245538 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 313/581] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:33:10 2022] GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15 => generated 1537 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:33:10.259392 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-aa498af1-1e71-4483-90c2-24ebb8e71606 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:10.263876 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-aa498af1-1e71-4483-90c2-24ebb8e71606 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] [instance: fc077a8b-c0f8-4bb1-8a39-91874ac015e7] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:10.283005 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-aa498af1-1e71-4483-90c2-24ebb8e71606 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:10.283956 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-aa498af1-1e71-4483-90c2-24ebb8e71606 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:10.284669 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-aa498af1-1e71-4483-90c2-24ebb8e71606 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:10.287656 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-aa498af1-1e71-4483-90c2-24ebb8e71606 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:10.289259 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-aa498af1-1e71-4483-90c2-24ebb8e71606 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:10.289910 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-aa498af1-1e71-4483-90c2-24ebb8e71606 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:10.557814 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-301519ab-6242-44f1-b1fd-f8cdae7b28ac tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:10.568392 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-301519ab-6242-44f1-b1fd-f8cdae7b28ac tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:10.571350 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-301519ab-6242-44f1-b1fd-f8cdae7b28ac tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:10.573349 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-301519ab-6242-44f1-b1fd-f8cdae7b28ac tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] 10.222.0.43 "GET /compute/v2.1/servers/fd5fe360-8ecf-41d0-9376-9d5533fc6ba8" status: 200 len: 1361 microversion: 2.25 time: 0.760298 Oct 04 18:33:10.574155 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 269/582] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:33:09 2022] GET /compute/v2.1/servers/fd5fe360-8ecf-41d0-9376-9d5533fc6ba8 => generated 1361 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:33:10.679960 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-aa498af1-1e71-4483-90c2-24ebb8e71606 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7db99f361654711bea7f1b2c404d312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7adedcdb9c3485ea2738c00e25aa3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:10.695220 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-aa498af1-1e71-4483-90c2-24ebb8e71606 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] 10.222.0.43 "GET /compute/v2.1/servers/fc077a8b-c0f8-4bb1-8a39-91874ac015e7" status: 200 len: 1316 microversion: 2.1 time: 0.442027 Oct 04 18:33:10.696402 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 314/583] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:10 2022] GET /compute/v2.1/servers/fc077a8b-c0f8-4bb1-8a39-91874ac015e7 => generated 1316 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:10.923647 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-dd68efe6-170c-4c1a-85cb-b2fb8ef1fcc0 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:10.924335 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-dd68efe6-170c-4c1a-85cb-b2fb8ef1fcc0 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] [instance: e5e92f30-937a-4ec2-b11f-336030c3d5c9] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:10.946197 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dd68efe6-170c-4c1a-85cb-b2fb8ef1fcc0 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:10.947682 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dd68efe6-170c-4c1a-85cb-b2fb8ef1fcc0 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:10.949756 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dd68efe6-170c-4c1a-85cb-b2fb8ef1fcc0 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:10.951409 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dd68efe6-170c-4c1a-85cb-b2fb8ef1fcc0 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:10.954079 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dd68efe6-170c-4c1a-85cb-b2fb8ef1fcc0 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:10.955805 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dd68efe6-170c-4c1a-85cb-b2fb8ef1fcc0 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:11.274232 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-4ab0d988-04da-435f-8439-0009c140208a tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:11.275072 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-4ab0d988-04da-435f-8439-0009c140208a tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] [instance: 84e0414b-a39f-4bfe-bc9d-c170ceb34d15] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:11.292500 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4ab0d988-04da-435f-8439-0009c140208a tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:11.294789 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4ab0d988-04da-435f-8439-0009c140208a tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:11.295563 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4ab0d988-04da-435f-8439-0009c140208a tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:11.296493 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4ab0d988-04da-435f-8439-0009c140208a tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:11.299384 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4ab0d988-04da-435f-8439-0009c140208a tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:11.300014 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4ab0d988-04da-435f-8439-0009c140208a tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:11.358200 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-dd68efe6-170c-4c1a-85cb-b2fb8ef1fcc0 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb7b0ce49ec438f9a60b79bdb2ac164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94ae6e2cb75d410d8029aa49909c973b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:11.371353 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-dd68efe6-170c-4c1a-85cb-b2fb8ef1fcc0 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] 10.222.0.43 "GET /compute/v2.1/servers/e5e92f30-937a-4ec2-b11f-336030c3d5c9" status: 200 len: 1322 microversion: 2.1 time: 0.451565 Oct 04 18:33:11.372543 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 270/584] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:10 2022] GET /compute/v2.1/servers/e5e92f30-937a-4ec2-b11f-336030c3d5c9 => generated 1322 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:11.563147 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-4ab0d988-04da-435f-8439-0009c140208a tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:11.579551 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-4ab0d988-04da-435f-8439-0009c140208a tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:11.582581 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-4ab0d988-04da-435f-8439-0009c140208a tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:11.600638 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-2ca1412a-d9b8-44cc-992f-60cae077549e tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:11.601616 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-2ca1412a-d9b8-44cc-992f-60cae077549e tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] [instance: fd5fe360-8ecf-41d0-9376-9d5533fc6ba8] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:11.606209 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-4ab0d988-04da-435f-8439-0009c140208a tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] 10.222.0.43 "GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15" status: 200 len: 1537 microversion: 2.91 time: 0.335794 Oct 04 18:33:11.610077 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2ca1412a-d9b8-44cc-992f-60cae077549e tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:11.610882 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2ca1412a-d9b8-44cc-992f-60cae077549e tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:11.611534 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2ca1412a-d9b8-44cc-992f-60cae077549e tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:11.612471 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2ca1412a-d9b8-44cc-992f-60cae077549e tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:11.613152 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2ca1412a-d9b8-44cc-992f-60cae077549e tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:11.620210 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2ca1412a-d9b8-44cc-992f-60cae077549e tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:11.627720 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 315/585] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:33:11 2022] GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15 => generated 1537 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:33:11.719218 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-205b438e-43c6-4d65-a8d1-3a4410490ec6 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:11.720260 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-205b438e-43c6-4d65-a8d1-3a4410490ec6 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] [instance: fc077a8b-c0f8-4bb1-8a39-91874ac015e7] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:11.737928 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-205b438e-43c6-4d65-a8d1-3a4410490ec6 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:11.738431 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-205b438e-43c6-4d65-a8d1-3a4410490ec6 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:11.738875 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-205b438e-43c6-4d65-a8d1-3a4410490ec6 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:11.739613 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-205b438e-43c6-4d65-a8d1-3a4410490ec6 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:11.743562 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-205b438e-43c6-4d65-a8d1-3a4410490ec6 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:11.744067 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-205b438e-43c6-4d65-a8d1-3a4410490ec6 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:12.034483 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-205b438e-43c6-4d65-a8d1-3a4410490ec6 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7db99f361654711bea7f1b2c404d312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7adedcdb9c3485ea2738c00e25aa3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:12.055545 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-205b438e-43c6-4d65-a8d1-3a4410490ec6 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] 10.222.0.43 "GET /compute/v2.1/servers/fc077a8b-c0f8-4bb1-8a39-91874ac015e7" status: 200 len: 1316 microversion: 2.1 time: 0.331315 Oct 04 18:33:12.056499 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 316/586] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:11 2022] GET /compute/v2.1/servers/fc077a8b-c0f8-4bb1-8a39-91874ac015e7 => generated 1316 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:12.349477 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-2ca1412a-d9b8-44cc-992f-60cae077549e tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:12.362901 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-2ca1412a-d9b8-44cc-992f-60cae077549e tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:12.364375 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-2ca1412a-d9b8-44cc-992f-60cae077549e tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:12.370104 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-2ca1412a-d9b8-44cc-992f-60cae077549e tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] 10.222.0.43 "GET /compute/v2.1/servers/fd5fe360-8ecf-41d0-9376-9d5533fc6ba8" status: 200 len: 1361 microversion: 2.25 time: 0.771838 Oct 04 18:33:12.370944 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 271/587] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:33:11 2022] GET /compute/v2.1/servers/fd5fe360-8ecf-41d0-9376-9d5533fc6ba8 => generated 1361 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:33:12.402423 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-0a0ac1a2-7eb5-4fca-a702-cb357299a4ee tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:12.403723 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-0a0ac1a2-7eb5-4fca-a702-cb357299a4ee tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] [instance: e5e92f30-937a-4ec2-b11f-336030c3d5c9] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:12.410823 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0a0ac1a2-7eb5-4fca-a702-cb357299a4ee tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:12.411686 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0a0ac1a2-7eb5-4fca-a702-cb357299a4ee tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:12.412744 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0a0ac1a2-7eb5-4fca-a702-cb357299a4ee tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:12.414529 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0a0ac1a2-7eb5-4fca-a702-cb357299a4ee tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:12.415457 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0a0ac1a2-7eb5-4fca-a702-cb357299a4ee tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:12.418273 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0a0ac1a2-7eb5-4fca-a702-cb357299a4ee tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:12.545494 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-996fa312-899c-4856-85ad-2def6af89f61 tempest-HostsAdminNegativeTestJSON-612486445 tempest-HostsAdminNegativeTestJSON-612486445-project-admin] Calling method '.version_select at 0x7fb21fe24310>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:12.550717 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-996fa312-899c-4856-85ad-2def6af89f61 tempest-HostsAdminNegativeTestJSON-612486445 tempest-HostsAdminNegativeTestJSON-612486445-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:12.551532 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-996fa312-899c-4856-85ad-2def6af89f61 tempest-HostsAdminNegativeTestJSON-612486445 tempest-HostsAdminNegativeTestJSON-612486445-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:12.552149 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-996fa312-899c-4856-85ad-2def6af89f61 tempest-HostsAdminNegativeTestJSON-612486445 tempest-HostsAdminNegativeTestJSON-612486445-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:12.554246 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-996fa312-899c-4856-85ad-2def6af89f61 tempest-HostsAdminNegativeTestJSON-612486445 tempest-HostsAdminNegativeTestJSON-612486445-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:12.555247 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-996fa312-899c-4856-85ad-2def6af89f61 tempest-HostsAdminNegativeTestJSON-612486445 tempest-HostsAdminNegativeTestJSON-612486445-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:12.555991 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-996fa312-899c-4856-85ad-2def6af89f61 tempest-HostsAdminNegativeTestJSON-612486445 tempest-HostsAdminNegativeTestJSON-612486445-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:12.590263 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-996fa312-899c-4856-85ad-2def6af89f61 tempest-HostsAdminNegativeTestJSON-612486445 tempest-HostsAdminNegativeTestJSON-612486445-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hosts" status: 200 len: 381 microversion: 2.1 time: 0.306188 Oct 04 18:33:12.592795 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 317/588] 10.222.0.43 () {58 vars in 1128 bytes} [Tue Oct 4 18:33:12 2022] GET /compute/v2.1/os-hosts => generated 381 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:33:12.818810 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-0a0ac1a2-7eb5-4fca-a702-cb357299a4ee tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb7b0ce49ec438f9a60b79bdb2ac164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94ae6e2cb75d410d8029aa49909c973b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:12.830265 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-0a0ac1a2-7eb5-4fca-a702-cb357299a4ee tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] 10.222.0.43 "GET /compute/v2.1/servers/e5e92f30-937a-4ec2-b11f-336030c3d5c9" status: 200 len: 1322 microversion: 2.1 time: 0.434098 Oct 04 18:33:12.835759 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 272/589] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:12 2022] GET /compute/v2.1/servers/e5e92f30-937a-4ec2-b11f-336030c3d5c9 => generated 1322 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:12.850795 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-491868d2-19b5-4bbe-ac64-32ef50531c91 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:12.851769 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-491868d2-19b5-4bbe-ac64-32ef50531c91 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] [instance: 84e0414b-a39f-4bfe-bc9d-c170ceb34d15] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:12.864264 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-c446a5ab-744c-47b6-9da7-95a856673c4b tempest-HostsAdminNegativeTestJSON-483826469 tempest-HostsAdminNegativeTestJSON-483826469-project] Calling method '.version_select at 0x7fb21fcbe5e0>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:12.871565 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-c446a5ab-744c-47b6-9da7-95a856673c4b tempest-HostsAdminNegativeTestJSON-483826469 tempest-HostsAdminNegativeTestJSON-483826469-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': '85c04284cd1341689f3a87a51e6e16fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85ce697712a4779868ad23acf997b64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:12.875589 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-c446a5ab-744c-47b6-9da7-95a856673c4b tempest-HostsAdminNegativeTestJSON-483826469 tempest-HostsAdminNegativeTestJSON-483826469-project] Request method failure captured: Oct 04 18:33:12.875589 n-d-851028-13 devstack@n-api.service[123596]: request: GET /compute/v2.1/os-hosts HTTP/1.1 Oct 04 18:33:12.875589 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:33:12.875589 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:33:12.875589 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:33:12.875589 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 18:33:12.875589 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:33:12.875589 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:33:12.875589 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:33:12.875589 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:33:12.875589 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPHxmBFu-fOVI0EFr4orsRflUwwS1z6hxWlWDd7JW3UWh1V59tmxAPr_3Kl-KnuNVvv9I6tUNJCb6Pk2agkQt7V0spOLhc_Wq7VdgS-tmBIyxE6R7b2ZbEk_-qeadW3HPWE5mZhfTtrMXoACjXgcRUj1BAfz3VUb0sNjw-1BKQ78mtKo Oct 04 18:33:12.875589 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:33:12.875589 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:33:12.875589 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:33:12.875589 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:33:12.875589 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:33:12.875589 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:33:12.875589 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: c85ce697712a4779868ad23acf997b64 Oct 04 18:33:12.875589 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-483826469 Oct 04 18:33:12.875589 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 18:33:12.875589 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 18:33:12.877335 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/c85ce697712a4779868ad23acf997b64"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_c85ce697712a4779868ad23acf997b64"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c85ce697712a4779868ad23acf997b64"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c85ce697712a4779868ad23acf997b64"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:33:12.877335 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-HostsAdminNegativeTestJSON-483826469 Oct 04 18:33:12.877335 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: c85ce697712a4779868ad23acf997b64 Oct 04 18:33:12.877335 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-483826469 Oct 04 18:33:12.877335 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-HostsAdminNegativeTestJSON-483826469-project Oct 04 18:33:12.877335 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:33:12.877335 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:33:12.877335 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 85c04284cd1341689f3a87a51e6e16fd Oct 04 18:33:12.877335 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-HostsAdminNegativeTestJSON-483826469-project Oct 04 18:33:12.877335 n-d-851028-13 devstack@n-api.service[123596]: method: Oct 04 18:33:12.877335 n-d-851028-13 devstack@n-api.service[123596]: exception: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 04 18:33:12.877335 n-d-851028-13 devstack@n-api.service[123596]: action_args: {} Oct 04 18:33:12.877335 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:33:12.878277 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:33:12.878277 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:33:12.878277 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:33:12.878277 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:33:12.878277 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:33:12.878277 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:33:12.878277 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:33:12.878277 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 18:33:12.878277 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:33:12.878277 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:33:12.878277 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:33:12.878277 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 74, in index Oct 04 18:33:12.878277 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'list', Oct 04 18:33:12.878277 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 18:33:12.878277 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 18:33:12.878277 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 18:33:12.878277 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 18:33:12.878277 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:33:12.878277 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:33:12.879730 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:33:12.879730 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:33:12.879730 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 18:33:12.879730 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 18:33:12.879730 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 18:33:12.879730 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 18:33:12.879730 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 18:33:12.879730 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 18:33:12.879730 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 04 18:33:12.879730 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:33:12.879730 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:33:12.879730 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:33:12.879730 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:33:12.879730 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:33:12.879730 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:33:12.879730 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 18:33:12.879730 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 18:33:12.879730 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 04 18:33:12.879730 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:33:12.881153 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-491868d2-19b5-4bbe-ac64-32ef50531c91 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:12.881153 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-491868d2-19b5-4bbe-ac64-32ef50531c91 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:12.881153 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-491868d2-19b5-4bbe-ac64-32ef50531c91 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:12.881430 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-c446a5ab-744c-47b6-9da7-95a856673c4b tempest-HostsAdminNegativeTestJSON-483826469 tempest-HostsAdminNegativeTestJSON-483826469-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:33:12.881430 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-c446a5ab-744c-47b6-9da7-95a856673c4b tempest-HostsAdminNegativeTestJSON-483826469 tempest-HostsAdminNegativeTestJSON-483826469-project] 10.222.0.43 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.280248 Oct 04 18:33:12.883101 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 318/590] 10.222.0.43 () {58 vars in 1128 bytes} [Tue Oct 4 18:33:12 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 283 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:33:12.883231 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-491868d2-19b5-4bbe-ac64-32ef50531c91 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:12.883919 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-491868d2-19b5-4bbe-ac64-32ef50531c91 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:12.884401 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-491868d2-19b5-4bbe-ac64-32ef50531c91 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:12.892213 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-2e6b0b08-6d04-437d-858d-173d49495e79 tempest-HostsAdminNegativeTestJSON-483826469 tempest-HostsAdminNegativeTestJSON-483826469-project] Calling method '.version_select at 0x7fb21fd04c10>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:12.904658 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-2e6b0b08-6d04-437d-858d-173d49495e79 tempest-HostsAdminNegativeTestJSON-483826469 tempest-HostsAdminNegativeTestJSON-483826469-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': '85c04284cd1341689f3a87a51e6e16fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85ce697712a4779868ad23acf997b64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:12.906455 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-2e6b0b08-6d04-437d-858d-173d49495e79 tempest-HostsAdminNegativeTestJSON-483826469 tempest-HostsAdminNegativeTestJSON-483826469-project] Request method failure captured: Oct 04 18:33:12.906455 n-d-851028-13 devstack@n-api.service[123596]: request: GET /compute/v2.1/os-hosts/n-d-851028-13/reboot HTTP/1.1 Oct 04 18:33:12.906455 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:33:12.906455 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:33:12.906455 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:33:12.906455 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 18:33:12.906455 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:33:12.906455 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:33:12.906455 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:33:12.906455 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:33:12.906455 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPHxmBFu-fOVI0EFr4orsRflUwwS1z6hxWlWDd7JW3UWh1V59tmxAPr_3Kl-KnuNVvv9I6tUNJCb6Pk2agkQt7V0spOLhc_Wq7VdgS-tmBIyxE6R7b2ZbEk_-qeadW3HPWE5mZhfTtrMXoACjXgcRUj1BAfz3VUb0sNjw-1BKQ78mtKo Oct 04 18:33:12.906455 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:33:12.906455 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:33:12.906455 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:33:12.906455 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:33:12.906455 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:33:12.906455 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:33:12.906455 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: c85ce697712a4779868ad23acf997b64 Oct 04 18:33:12.906455 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-483826469 Oct 04 18:33:12.906455 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 18:33:12.906455 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 18:33:12.907926 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/c85ce697712a4779868ad23acf997b64"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_c85ce697712a4779868ad23acf997b64"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c85ce697712a4779868ad23acf997b64"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c85ce697712a4779868ad23acf997b64"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:33:12.907926 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-HostsAdminNegativeTestJSON-483826469 Oct 04 18:33:12.907926 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: c85ce697712a4779868ad23acf997b64 Oct 04 18:33:12.907926 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-483826469 Oct 04 18:33:12.907926 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-HostsAdminNegativeTestJSON-483826469-project Oct 04 18:33:12.907926 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:33:12.907926 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:33:12.907926 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 85c04284cd1341689f3a87a51e6e16fd Oct 04 18:33:12.907926 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-HostsAdminNegativeTestJSON-483826469-project Oct 04 18:33:12.907926 n-d-851028-13 devstack@n-api.service[123596]: method: Oct 04 18:33:12.907926 n-d-851028-13 devstack@n-api.service[123596]: exception: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 04 18:33:12.907926 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': 'n-d-851028-13'} Oct 04 18:33:12.907926 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:33:12.908797 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:33:12.908797 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:33:12.908797 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:33:12.908797 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:33:12.908797 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:33:12.908797 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:33:12.908797 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:33:12.908797 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:33:12.908797 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:33:12.908797 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 203, in reboot Oct 04 18:33:12.908797 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'reboot', Oct 04 18:33:12.908797 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 18:33:12.908797 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 18:33:12.908797 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 18:33:12.908797 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 18:33:12.908797 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:33:12.908797 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:33:12.908797 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:33:12.908797 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:33:12.910004 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 18:33:12.910004 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 18:33:12.910004 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 18:33:12.910004 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 18:33:12.910004 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 18:33:12.910004 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 18:33:12.910004 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 04 18:33:12.910004 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:33:12.910004 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:33:12.910004 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:33:12.910004 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:33:12.910004 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:33:12.910004 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:33:12.910004 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 18:33:12.910004 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 18:33:12.910004 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 04 18:33:12.910004 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:33:12.910991 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-2e6b0b08-6d04-437d-858d-173d49495e79 tempest-HostsAdminNegativeTestJSON-483826469 tempest-HostsAdminNegativeTestJSON-483826469-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:33:12.910991 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-2e6b0b08-6d04-437d-858d-173d49495e79 tempest-HostsAdminNegativeTestJSON-483826469 tempest-HostsAdminNegativeTestJSON-483826469-project] 10.222.0.43 "GET /compute/v2.1/os-hosts/n-d-851028-13/reboot" status: 403 len: 111 microversion: 2.1 time: 0.019775 Oct 04 18:33:12.910991 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 319/591] 10.222.0.43 () {58 vars in 1191 bytes} [Tue Oct 4 18:33:12 2022] GET /compute/v2.1/os-hosts/n-d-851028-13/reboot => generated 111 bytes in 21 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:33:13.003271 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-491868d2-19b5-4bbe-ac64-32ef50531c91 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:13.015716 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-491868d2-19b5-4bbe-ac64-32ef50531c91 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:13.018512 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-491868d2-19b5-4bbe-ac64-32ef50531c91 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:13.028422 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-491868d2-19b5-4bbe-ac64-32ef50531c91 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] 10.222.0.43 "GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15" status: 200 len: 1537 microversion: 2.91 time: 0.189104 Oct 04 18:33:13.030162 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 273/592] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:33:12 2022] GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15 => generated 1537 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:33:13.134119 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-492301e5-2a29-42c1-bd90-edb346bc2c83 tempest-HostsAdminNegativeTestJSON-612486445 tempest-HostsAdminNegativeTestJSON-612486445-project-admin] Calling method '.version_select at 0x7fb224323040>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:13.143191 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-492301e5-2a29-42c1-bd90-edb346bc2c83 tempest-HostsAdminNegativeTestJSON-612486445 tempest-HostsAdminNegativeTestJSON-612486445-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 18:33:13.145678 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-492301e5-2a29-42c1-bd90-edb346bc2c83 tempest-HostsAdminNegativeTestJSON-612486445 tempest-HostsAdminNegativeTestJSON-612486445-project-admin] Request method failure captured: Oct 04 18:33:13.145678 n-d-851028-13 devstack@n-api.service[123596]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot HTTP/1.1 Oct 04 18:33:13.145678 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:33:13.145678 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:33:13.145678 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:33:13.145678 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 18:33:13.145678 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:33:13.145678 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:33:13.145678 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:33:13.145678 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:33:13.145678 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPHxoVfd4XfLNh9VwEdBBy-tlkn_9EeSvxOK5P5y0S-XAX1E9mXG1JHD3IxKgJeda3t3NyBWaVL3Crs-hmJyn1DW8tzdp-7P4ifisapq76izMNba9-RDSZ89lcUyJvDrQnBGFTzJaAVInr3NhFqUjs1vs1hlAspZlN6m8vmBX20a_lUc Oct 04 18:33:13.145678 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:33:13.145678 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:33:13.145678 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:33:13.145678 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:33:13.145678 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:33:13.145678 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:33:13.145678 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: 477cbc49bd8c41328ecfb74475c8ab95 Oct 04 18:33:13.145678 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-612486445 Oct 04 18:33:13.145678 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,admin,reader Oct 04 18:33:13.145678 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,admin,reader Oct 04 18:33:13.147857 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/477cbc49bd8c41328ecfb74475c8ab95"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_477cbc49bd8c41328ecfb74475c8ab95"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/477cbc49bd8c41328ecfb74475c8ab95"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/477cbc49bd8c41328ecfb74475c8ab95"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:33:13.147857 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-HostsAdminNegativeTestJSON-612486445 Oct 04 18:33:13.147857 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: 477cbc49bd8c41328ecfb74475c8ab95 Oct 04 18:33:13.147857 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-612486445 Oct 04 18:33:13.147857 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-HostsAdminNegativeTestJSON-612486445-project-admin Oct 04 18:33:13.147857 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:33:13.147857 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:33:13.147857 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: bf362a5265d640808ea804f5751ab89d Oct 04 18:33:13.147857 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-HostsAdminNegativeTestJSON-612486445-project-admin Oct 04 18:33:13.147857 n-d-851028-13 devstack@n-api.service[123596]: method: Oct 04 18:33:13.147857 n-d-851028-13 devstack@n-api.service[123596]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 18:33:13.147857 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': 'nonexistent_hostname'} Oct 04 18:33:13.147857 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:33:13.148826 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:33:13.148826 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 04 18:33:13.148826 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 04 18:33:13.148826 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 04 18:33:13.148826 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 04 18:33:13.148826 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:33:13.148826 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:33:13.148826 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:33:13.148826 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:33:13.148826 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 04 18:33:13.148826 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 04 18:33:13.148826 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 04 18:33:13.148826 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 04 18:33:13.148826 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 18:33:13.148826 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 18:33:13.148826 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 04 18:33:13.148826 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 04 18:33:13.148826 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 18:33:13.148826 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 18:33:13.150328 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 04 18:33:13.150328 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 04 18:33:13.150328 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 18:33:13.150328 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:33:13.150328 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:33:13.150328 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:33:13.150328 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:33:13.150328 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:33:13.150328 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:33:13.150328 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:33:13.150328 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:33:13.150328 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:33:13.150328 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:33:13.150328 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:33:13.150328 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:33:13.150328 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 205, in reboot Oct 04 18:33:13.150328 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="reboot") Oct 04 18:33:13.150328 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 04 18:33:13.150328 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:33:13.152264 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 18:33:13.152264 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:33:13.152264 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:33:13.152264 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:33:13.152264 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:33:13.152264 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:33:13.152264 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:33:13.152264 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:33:13.152264 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:33:13.152264 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 18:33:13.152264 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:33:13.152264 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-492301e5-2a29-42c1-bd90-edb346bc2c83 tempest-HostsAdminNegativeTestJSON-612486445 tempest-HostsAdminNegativeTestJSON-612486445-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:33:13.153548 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-492301e5-2a29-42c1-bd90-edb346bc2c83 tempest-HostsAdminNegativeTestJSON-612486445 tempest-HostsAdminNegativeTestJSON-612486445-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.238732 Oct 04 18:33:13.158305 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 320/593] 10.222.0.43 () {58 vars in 1212 bytes} [Tue Oct 4 18:33:12 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 241 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 04 18:33:13.163351 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-9db383a4-3d7b-40ed-a143-fc4453c1492e tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:13.164416 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-9db383a4-3d7b-40ed-a143-fc4453c1492e tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] [instance: fc077a8b-c0f8-4bb1-8a39-91874ac015e7] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:13.173339 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9db383a4-3d7b-40ed-a143-fc4453c1492e tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:13.173339 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9db383a4-3d7b-40ed-a143-fc4453c1492e tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:13.173339 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9db383a4-3d7b-40ed-a143-fc4453c1492e tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:13.173339 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9db383a4-3d7b-40ed-a143-fc4453c1492e tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:13.173788 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9db383a4-3d7b-40ed-a143-fc4453c1492e tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:13.174335 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9db383a4-3d7b-40ed-a143-fc4453c1492e tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:13.214126 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-042aa3a6-791b-41ce-ba3a-1d13b2b98841 tempest-InstanceUsageAuditLogNegativeTestJSON-945897107 tempest-InstanceUsageAuditLogNegativeTestJSON-945897107-project-admin] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:13.216251 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-042aa3a6-791b-41ce-ba3a-1d13b2b98841 tempest-InstanceUsageAuditLogNegativeTestJSON-945897107 tempest-InstanceUsageAuditLogNegativeTestJSON-945897107-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Oct 04 18:33:13.226839 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-042aa3a6-791b-41ce-ba3a-1d13b2b98841 tempest-InstanceUsageAuditLogNegativeTestJSON-945897107 tempest-InstanceUsageAuditLogNegativeTestJSON-945897107-project-admin] Request method failure captured: Oct 04 18:33:13.226839 n-d-851028-13 devstack@n-api.service[123595]: request: GET /compute/v2.1/os-instance_usage_audit_log/invalid_time HTTP/1.1 Oct 04 18:33:13.226839 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 18:33:13.226839 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 18:33:13.226839 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 18:33:13.226839 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 0 Oct 04 18:33:13.226839 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 18:33:13.226839 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 18:33:13.226839 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 18:33:13.226839 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 18:33:13.226839 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPHxogoPzUnSORzgbNpGMHb2AX8J3xHb_9ADnwXJ6kvP4BcfbLpkNbWj8Cb89ro4_fOiLhRZblBFEXV8vHSKV_6HdyKIYWFYZTJcEA2qAPgpVI5MS8Nz2jdPH8Nke9LWK_9MuK7t23zTZ8BrIGB-PqPK6RRKaFQ-U1OxaEU0yE4y2nhY Oct 04 18:33:13.226839 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 18:33:13.226839 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 18:33:13.226839 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 18:33:13.226839 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 18:33:13.226839 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 18:33:13.226839 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 18:33:13.226839 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: 70def775d521454ca5c991d33273b3a4 Oct 04 18:33:13.226839 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-945897107 Oct 04 18:33:13.226839 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,admin,reader Oct 04 18:33:13.226839 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,admin,reader Oct 04 18:33:13.228553 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/70def775d521454ca5c991d33273b3a4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_70def775d521454ca5c991d33273b3a4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/70def775d521454ca5c991d33273b3a4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/70def775d521454ca5c991d33273b3a4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:33:13.228553 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-945897107 Oct 04 18:33:13.228553 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: 70def775d521454ca5c991d33273b3a4 Oct 04 18:33:13.228553 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-945897107 Oct 04 18:33:13.228553 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-945897107-project-admin Oct 04 18:33:13.228553 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 18:33:13.228553 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 18:33:13.228553 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: e5e46a2c7b2f46b299d6c895a498df39 Oct 04 18:33:13.228553 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-945897107-project-admin Oct 04 18:33:13.228553 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 18:33:13.228553 n-d-851028-13 devstack@n-api.service[123595]: exception: Invalid timestamp for date invalid_time Oct 04 18:33:13.229485 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': 'invalid_time'} Oct 04 18:33:13.229485 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:33:13.229485 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:33:13.229485 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 51, in show Oct 04 18:33:13.229485 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi before_date = datetime.datetime.strptime(str(id), Oct 04 18:33:13.229485 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 568, in _strptime_datetime Oct 04 18:33:13.229485 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi tt, fraction, gmtoff_fraction = _strptime(data_string, format) Oct 04 18:33:13.229485 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 349, in _strptime Oct 04 18:33:13.229485 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise ValueError("time data %r does not match format %r" % Oct 04 18:33:13.229485 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi ValueError: time data 'invalid_time' does not match format '%Y-%m-%d %H:%M:%S' Oct 04 18:33:13.229485 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:33:13.229485 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:33:13.229485 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:33:13.229485 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:33:13.229485 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:33:13.229485 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:33:13.229485 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:33:13.229485 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:33:13.229485 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:33:13.229485 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:33:13.231027 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 55, in show Oct 04 18:33:13.231027 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=msg) Oct 04 18:33:13.231027 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid timestamp for date invalid_time Oct 04 18:33:13.231027 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:33:13.231027 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:33:13.231027 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:33:13.231027 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:33:13.231027 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:33:13.231027 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:33:13.231027 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:33:13.231027 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:33:13.231027 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid timestamp for date invalid_time Oct 04 18:33:13.231027 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:33:13.231027 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-042aa3a6-791b-41ce-ba3a-1d13b2b98841 tempest-InstanceUsageAuditLogNegativeTestJSON-945897107 tempest-InstanceUsageAuditLogNegativeTestJSON-945897107-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:33:13.232338 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-042aa3a6-791b-41ce-ba3a-1d13b2b98841 tempest-InstanceUsageAuditLogNegativeTestJSON-945897107 tempest-InstanceUsageAuditLogNegativeTestJSON-945897107-project-admin] 10.222.0.43 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.200186 Oct 04 18:33:13.234186 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 274/594] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Oct 4 18:33:13 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 202 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 04 18:33:13.238574 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-5eb18fd0-123d-46c1-a8e7-ff7e776bce1b tempest-HostsAdminNegativeTestJSON-483826469 tempest-HostsAdminNegativeTestJSON-483826469-project] Calling method '.version_select at 0x7fb21fe78ca0>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:13.240654 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-5eb18fd0-123d-46c1-a8e7-ff7e776bce1b tempest-HostsAdminNegativeTestJSON-483826469 tempest-HostsAdminNegativeTestJSON-483826469-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': '85c04284cd1341689f3a87a51e6e16fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85ce697712a4779868ad23acf997b64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:13.242997 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-5eb18fd0-123d-46c1-a8e7-ff7e776bce1b tempest-HostsAdminNegativeTestJSON-483826469 tempest-HostsAdminNegativeTestJSON-483826469-project] Request method failure captured: Oct 04 18:33:13.242997 n-d-851028-13 devstack@n-api.service[123595]: request: GET /compute/v2.1/os-hosts/n-d-851028-13 HTTP/1.1 Oct 04 18:33:13.242997 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 18:33:13.242997 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 18:33:13.242997 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 18:33:13.242997 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 0 Oct 04 18:33:13.242997 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 18:33:13.242997 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 18:33:13.242997 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 18:33:13.242997 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 18:33:13.242997 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPHxmBFu-fOVI0EFr4orsRflUwwS1z6hxWlWDd7JW3UWh1V59tmxAPr_3Kl-KnuNVvv9I6tUNJCb6Pk2agkQt7V0spOLhc_Wq7VdgS-tmBIyxE6R7b2ZbEk_-qeadW3HPWE5mZhfTtrMXoACjXgcRUj1BAfz3VUb0sNjw-1BKQ78mtKo Oct 04 18:33:13.242997 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 18:33:13.242997 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 18:33:13.242997 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 18:33:13.242997 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 18:33:13.242997 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 18:33:13.242997 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 18:33:13.242997 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: c85ce697712a4779868ad23acf997b64 Oct 04 18:33:13.242997 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-483826469 Oct 04 18:33:13.242997 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 18:33:13.242997 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 18:33:13.244486 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/c85ce697712a4779868ad23acf997b64"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_c85ce697712a4779868ad23acf997b64"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c85ce697712a4779868ad23acf997b64"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c85ce697712a4779868ad23acf997b64"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:33:13.244486 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-HostsAdminNegativeTestJSON-483826469 Oct 04 18:33:13.244486 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: c85ce697712a4779868ad23acf997b64 Oct 04 18:33:13.244486 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-483826469 Oct 04 18:33:13.244486 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-HostsAdminNegativeTestJSON-483826469-project Oct 04 18:33:13.244486 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 18:33:13.244486 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 18:33:13.244486 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: 85c04284cd1341689f3a87a51e6e16fd Oct 04 18:33:13.244486 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-HostsAdminNegativeTestJSON-483826469-project Oct 04 18:33:13.244486 n-d-851028-13 devstack@n-api.service[123595]: method: Oct 04 18:33:13.244486 n-d-851028-13 devstack@n-api.service[123595]: exception: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 04 18:33:13.244486 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': 'n-d-851028-13'} Oct 04 18:33:13.244486 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:33:13.245526 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:33:13.245526 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:33:13.245526 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:33:13.245526 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:33:13.245526 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:33:13.245526 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:33:13.245526 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:33:13.245526 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:33:13.245526 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:33:13.245526 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 270, in show Oct 04 18:33:13.245526 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'show', Oct 04 18:33:13.245526 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 18:33:13.245526 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 18:33:13.245526 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 18:33:13.245526 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 18:33:13.245526 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:33:13.245526 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:33:13.245526 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:33:13.245526 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:33:13.246713 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 18:33:13.246713 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 18:33:13.246713 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 18:33:13.246713 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 18:33:13.246713 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 18:33:13.246713 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 18:33:13.246713 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 04 18:33:13.246713 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:33:13.246713 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:33:13.246713 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:33:13.246713 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:33:13.246713 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:33:13.246713 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:33:13.246713 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 18:33:13.246713 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 18:33:13.246713 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 04 18:33:13.246713 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:33:13.249770 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-5eb18fd0-123d-46c1-a8e7-ff7e776bce1b tempest-HostsAdminNegativeTestJSON-483826469 tempest-HostsAdminNegativeTestJSON-483826469-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:33:13.249770 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-5eb18fd0-123d-46c1-a8e7-ff7e776bce1b tempest-HostsAdminNegativeTestJSON-483826469 tempest-HostsAdminNegativeTestJSON-483826469-project] 10.222.0.43 "GET /compute/v2.1/os-hosts/n-d-851028-13" status: 403 len: 109 microversion: 2.1 time: 0.010294 Oct 04 18:33:13.249770 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 275/595] 10.222.0.43 () {58 vars in 1170 bytes} [Tue Oct 4 18:33:13 2022] GET /compute/v2.1/os-hosts/n-d-851028-13 => generated 109 bytes in 11 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:33:13.455796 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-08606442-2076-4a8d-a956-f330ce58eca9 tempest-InstanceUsageAuditLogNegativeTestJSON-1298912456 tempest-InstanceUsageAuditLogNegativeTestJSON-1298912456-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:13.458614 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-08606442-2076-4a8d-a956-f330ce58eca9 tempest-InstanceUsageAuditLogNegativeTestJSON-1298912456 tempest-InstanceUsageAuditLogNegativeTestJSON-1298912456-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': '98b8390fe46643779c2d676f5f901757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced716192b694b5aa112c9b897caa83b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:13.462585 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-08606442-2076-4a8d-a956-f330ce58eca9 tempest-InstanceUsageAuditLogNegativeTestJSON-1298912456 tempest-InstanceUsageAuditLogNegativeTestJSON-1298912456-project] Request method failure captured: Oct 04 18:33:13.462585 n-d-851028-13 devstack@n-api.service[123595]: request: GET /compute/v2.1/os-instance_usage_audit_log HTTP/1.1 Oct 04 18:33:13.462585 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 18:33:13.462585 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 18:33:13.462585 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 18:33:13.462585 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 0 Oct 04 18:33:13.462585 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 18:33:13.462585 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 18:33:13.462585 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 18:33:13.462585 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 18:33:13.462585 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPHxnId4NyeviTZHkpAOeAaWZgVPd6imVRYALfuJ4Y7XfaFHAB-bLukPH-RqSo1jfA54KV6MZfl3FdS1-GAhDVf8xM7tZRjs4FcuP6_ognLz7qnqCLjTa9xcB9Fo-pE33lUWQ_ZCx_Reh0jwJADFxe2CbBYEvQ6vKt1Z52-QHGHqx9rs Oct 04 18:33:13.462585 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 18:33:13.462585 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 18:33:13.462585 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 18:33:13.462585 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 18:33:13.462585 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 18:33:13.462585 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 18:33:13.462585 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: ced716192b694b5aa112c9b897caa83b Oct 04 18:33:13.462585 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1298912456 Oct 04 18:33:13.462585 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 18:33:13.462585 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 18:33:13.464034 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/ced716192b694b5aa112c9b897caa83b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_ced716192b694b5aa112c9b897caa83b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ced716192b694b5aa112c9b897caa83b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ced716192b694b5aa112c9b897caa83b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:33:13.464034 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1298912456 Oct 04 18:33:13.464034 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: ced716192b694b5aa112c9b897caa83b Oct 04 18:33:13.464034 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1298912456 Oct 04 18:33:13.464034 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1298912456-project Oct 04 18:33:13.464034 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 18:33:13.464034 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 18:33:13.464034 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: 98b8390fe46643779c2d676f5f901757 Oct 04 18:33:13.464034 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1298912456-project Oct 04 18:33:13.464034 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 18:33:13.465226 n-d-851028-13 devstack@n-api.service[123595]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 04 18:33:13.465226 n-d-851028-13 devstack@n-api.service[123595]: action_args: {} Oct 04 18:33:13.465226 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:33:13.465226 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:33:13.465226 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:33:13.465226 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:33:13.465226 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:33:13.465226 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:33:13.465226 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:33:13.465226 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:33:13.465226 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 38, in index Oct 04 18:33:13.465226 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'list', target={}) Oct 04 18:33:13.465226 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 18:33:13.465226 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 18:33:13.465226 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 18:33:13.465226 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 18:33:13.465226 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:33:13.465226 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:33:13.465226 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:33:13.465226 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:33:13.470848 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 18:33:13.470848 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 18:33:13.470848 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 18:33:13.470848 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 18:33:13.470848 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 18:33:13.470848 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 18:33:13.470848 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 04 18:33:13.470848 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:33:13.470848 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:33:13.470848 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:33:13.470848 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:33:13.470848 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:33:13.470848 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:33:13.470848 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 18:33:13.470848 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 18:33:13.470848 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 04 18:33:13.470848 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:33:13.471884 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-08606442-2076-4a8d-a956-f330ce58eca9 tempest-InstanceUsageAuditLogNegativeTestJSON-1298912456 tempest-InstanceUsageAuditLogNegativeTestJSON-1298912456-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:33:13.471884 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-08606442-2076-4a8d-a956-f330ce58eca9 tempest-InstanceUsageAuditLogNegativeTestJSON-1298912456 tempest-InstanceUsageAuditLogNegativeTestJSON-1298912456-project] 10.222.0.43 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.217859 Oct 04 18:33:13.471884 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 276/596] 10.222.0.43 () {58 vars in 1185 bytes} [Tue Oct 4 18:33:13 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 220 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:33:13.471884 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-f47e6601-2642-4eb4-a5d2-9c3822a3ef67 tempest-HostsAdminNegativeTestJSON-612486445 tempest-HostsAdminNegativeTestJSON-612486445-project-admin] Calling method '.version_select at 0x7fb21fe65c10>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:13.483302 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-f47e6601-2642-4eb4-a5d2-9c3822a3ef67 tempest-HostsAdminNegativeTestJSON-612486445 tempest-HostsAdminNegativeTestJSON-612486445-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 18:33:13.484877 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-f47e6601-2642-4eb4-a5d2-9c3822a3ef67 tempest-HostsAdminNegativeTestJSON-612486445 tempest-HostsAdminNegativeTestJSON-612486445-project-admin] Request method failure captured: Oct 04 18:33:13.484877 n-d-851028-13 devstack@n-api.service[123595]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Oct 04 18:33:13.484877 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 18:33:13.484877 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 18:33:13.484877 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 18:33:13.484877 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 0 Oct 04 18:33:13.484877 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 18:33:13.484877 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 18:33:13.484877 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 18:33:13.484877 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 18:33:13.484877 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPHxoVfd4XfLNh9VwEdBBy-tlkn_9EeSvxOK5P5y0S-XAX1E9mXG1JHD3IxKgJeda3t3NyBWaVL3Crs-hmJyn1DW8tzdp-7P4ifisapq76izMNba9-RDSZ89lcUyJvDrQnBGFTzJaAVInr3NhFqUjs1vs1hlAspZlN6m8vmBX20a_lUc Oct 04 18:33:13.484877 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 18:33:13.484877 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 18:33:13.484877 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 18:33:13.484877 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 18:33:13.484877 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 18:33:13.484877 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 18:33:13.484877 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: 477cbc49bd8c41328ecfb74475c8ab95 Oct 04 18:33:13.484877 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-612486445 Oct 04 18:33:13.484877 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,admin,reader Oct 04 18:33:13.484877 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,admin,reader Oct 04 18:33:13.486324 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/477cbc49bd8c41328ecfb74475c8ab95"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_477cbc49bd8c41328ecfb74475c8ab95"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/477cbc49bd8c41328ecfb74475c8ab95"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/477cbc49bd8c41328ecfb74475c8ab95"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:33:13.486324 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-HostsAdminNegativeTestJSON-612486445 Oct 04 18:33:13.486324 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: 477cbc49bd8c41328ecfb74475c8ab95 Oct 04 18:33:13.486324 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-612486445 Oct 04 18:33:13.486324 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-HostsAdminNegativeTestJSON-612486445-project-admin Oct 04 18:33:13.486324 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 18:33:13.486324 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 18:33:13.486324 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: bf362a5265d640808ea804f5751ab89d Oct 04 18:33:13.486324 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-HostsAdminNegativeTestJSON-612486445-project-admin Oct 04 18:33:13.486324 n-d-851028-13 devstack@n-api.service[123595]: method: Oct 04 18:33:13.486324 n-d-851028-13 devstack@n-api.service[123595]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 18:33:13.486324 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': 'nonexistent_hostname'} Oct 04 18:33:13.486324 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:33:13.487089 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:33:13.487089 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 274, in show Oct 04 18:33:13.487089 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 04 18:33:13.487089 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 18:33:13.487089 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 18:33:13.487089 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 04 18:33:13.487089 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 04 18:33:13.487089 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 18:33:13.487089 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 18:33:13.487089 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 04 18:33:13.487089 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 04 18:33:13.487089 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 18:33:13.487089 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:33:13.487089 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:33:13.487089 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:33:13.487089 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:33:13.487089 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:33:13.487089 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:33:13.487089 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:33:13.488720 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:33:13.488720 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:33:13.488720 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:33:13.488720 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:33:13.488720 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:33:13.488720 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 282, in show Oct 04 18:33:13.488720 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:33:13.488720 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 18:33:13.488720 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:33:13.488720 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:33:13.488720 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:33:13.488720 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:33:13.488720 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:33:13.488720 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:33:13.488720 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:33:13.488720 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:33:13.488720 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 18:33:13.488720 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:33:13.489787 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-f47e6601-2642-4eb4-a5d2-9c3822a3ef67 tempest-HostsAdminNegativeTestJSON-612486445 tempest-HostsAdminNegativeTestJSON-612486445-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:33:13.489787 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-f47e6601-2642-4eb4-a5d2-9c3822a3ef67 tempest-HostsAdminNegativeTestJSON-612486445 tempest-HostsAdminNegativeTestJSON-612486445-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.019432 Oct 04 18:33:13.492353 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 277/597] 10.222.0.43 () {58 vars in 1191 bytes} [Tue Oct 4 18:33:13 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:33:13.498787 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-2286cb71-bccf-4465-849c-a80b568ed3f0 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:13.499154 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-2286cb71-bccf-4465-849c-a80b568ed3f0 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] [instance: fd5fe360-8ecf-41d0-9376-9d5533fc6ba8] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:13.509324 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2286cb71-bccf-4465-849c-a80b568ed3f0 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:13.509827 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2286cb71-bccf-4465-849c-a80b568ed3f0 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:13.510274 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2286cb71-bccf-4465-849c-a80b568ed3f0 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:13.511008 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2286cb71-bccf-4465-849c-a80b568ed3f0 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:13.511738 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2286cb71-bccf-4465-849c-a80b568ed3f0 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:13.513002 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2286cb71-bccf-4465-849c-a80b568ed3f0 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:13.523160 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-9db383a4-3d7b-40ed-a143-fc4453c1492e tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7db99f361654711bea7f1b2c404d312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7adedcdb9c3485ea2738c00e25aa3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:13.532549 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-9db383a4-3d7b-40ed-a143-fc4453c1492e tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] 10.222.0.43 "GET /compute/v2.1/servers/fc077a8b-c0f8-4bb1-8a39-91874ac015e7" status: 200 len: 1316 microversion: 2.1 time: 0.376750 Oct 04 18:33:13.537589 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 321/598] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:13 2022] GET /compute/v2.1/servers/fc077a8b-c0f8-4bb1-8a39-91874ac015e7 => generated 1316 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:13.550130 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-920d314e-df66-4328-b8f4-6ebe07012495 tempest-InstanceUsageAuditLogNegativeTestJSON-1298912456 tempest-InstanceUsageAuditLogNegativeTestJSON-1298912456-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:13.558942 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-920d314e-df66-4328-b8f4-6ebe07012495 tempest-InstanceUsageAuditLogNegativeTestJSON-1298912456 tempest-InstanceUsageAuditLogNegativeTestJSON-1298912456-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': '98b8390fe46643779c2d676f5f901757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced716192b694b5aa112c9b897caa83b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:13.561446 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-920d314e-df66-4328-b8f4-6ebe07012495 tempest-InstanceUsageAuditLogNegativeTestJSON-1298912456 tempest-InstanceUsageAuditLogNegativeTestJSON-1298912456-project] Request method failure captured: Oct 04 18:33:13.561446 n-d-851028-13 devstack@n-api.service[123596]: request: GET /compute/v2.1/os-instance_usage_audit_log/2022-10-04%2018:33:13 HTTP/1.1 Oct 04 18:33:13.561446 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:33:13.561446 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:33:13.561446 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:33:13.561446 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 18:33:13.561446 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:33:13.561446 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:33:13.561446 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:33:13.561446 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:33:13.561446 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPHxnId4NyeviTZHkpAOeAaWZgVPd6imVRYALfuJ4Y7XfaFHAB-bLukPH-RqSo1jfA54KV6MZfl3FdS1-GAhDVf8xM7tZRjs4FcuP6_ognLz7qnqCLjTa9xcB9Fo-pE33lUWQ_ZCx_Reh0jwJADFxe2CbBYEvQ6vKt1Z52-QHGHqx9rs Oct 04 18:33:13.561446 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:33:13.561446 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:33:13.561446 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:33:13.561446 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:33:13.561446 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:33:13.561446 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:33:13.561446 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: ced716192b694b5aa112c9b897caa83b Oct 04 18:33:13.561446 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1298912456 Oct 04 18:33:13.561446 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 18:33:13.561446 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 18:33:13.563111 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/ced716192b694b5aa112c9b897caa83b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_ced716192b694b5aa112c9b897caa83b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ced716192b694b5aa112c9b897caa83b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ced716192b694b5aa112c9b897caa83b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:33:13.563111 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1298912456 Oct 04 18:33:13.563111 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: ced716192b694b5aa112c9b897caa83b Oct 04 18:33:13.563111 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1298912456 Oct 04 18:33:13.563111 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1298912456-project Oct 04 18:33:13.563111 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:33:13.563111 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:33:13.563111 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 98b8390fe46643779c2d676f5f901757 Oct 04 18:33:13.563111 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1298912456-project Oct 04 18:33:13.563111 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 18:33:13.563972 n-d-851028-13 devstack@n-api.service[123596]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 04 18:33:13.563972 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': '2022-10-04 18:33:13'} Oct 04 18:33:13.563972 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:33:13.563972 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:33:13.563972 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:33:13.563972 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:33:13.563972 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:33:13.563972 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:33:13.563972 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:33:13.563972 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:33:13.563972 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 45, in show Oct 04 18:33:13.563972 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'show', target={}) Oct 04 18:33:13.563972 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 18:33:13.563972 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 18:33:13.563972 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 18:33:13.563972 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 18:33:13.563972 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:33:13.563972 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:33:13.563972 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:33:13.563972 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:33:13.565892 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 18:33:13.565892 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 18:33:13.565892 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 18:33:13.565892 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 18:33:13.565892 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 18:33:13.565892 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 18:33:13.565892 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 04 18:33:13.565892 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:33:13.565892 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:33:13.565892 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:33:13.565892 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:33:13.565892 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:33:13.565892 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:33:13.565892 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 18:33:13.565892 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 18:33:13.565892 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 04 18:33:13.565892 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:33:13.567305 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-920d314e-df66-4328-b8f4-6ebe07012495 tempest-InstanceUsageAuditLogNegativeTestJSON-1298912456 tempest-InstanceUsageAuditLogNegativeTestJSON-1298912456-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:33:13.571657 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-920d314e-df66-4328-b8f4-6ebe07012495 tempest-InstanceUsageAuditLogNegativeTestJSON-1298912456 tempest-InstanceUsageAuditLogNegativeTestJSON-1298912456-project] 10.222.0.43 "GET /compute/v2.1/os-instance_usage_audit_log/2022-10-04 18:33:13" status: 403 len: 128 microversion: 2.1 time: 0.030165 Oct 04 18:33:13.576686 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 322/599] 10.222.0.43 () {58 vars in 1251 bytes} [Tue Oct 4 18:33:13 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-10-04%2018%3A33%3A13 => generated 128 bytes in 34 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:33:13.582603 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-8a3d6366-a1de-4dd9-bd7d-aa62e8dfed20 tempest-HostsAdminNegativeTestJSON-483826469 tempest-HostsAdminNegativeTestJSON-483826469-project] Calling method '.version_select at 0x7fb21fd3a430>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:13.597004 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-8a3d6366-a1de-4dd9-bd7d-aa62e8dfed20 tempest-HostsAdminNegativeTestJSON-483826469 tempest-HostsAdminNegativeTestJSON-483826469-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': '85c04284cd1341689f3a87a51e6e16fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85ce697712a4779868ad23acf997b64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:13.608674 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-8a3d6366-a1de-4dd9-bd7d-aa62e8dfed20 tempest-HostsAdminNegativeTestJSON-483826469 tempest-HostsAdminNegativeTestJSON-483826469-project] Request method failure captured: Oct 04 18:33:13.608674 n-d-851028-13 devstack@n-api.service[123596]: request: GET /compute/v2.1/os-hosts/n-d-851028-13/shutdown HTTP/1.1 Oct 04 18:33:13.608674 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:33:13.608674 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:33:13.608674 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:33:13.608674 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 18:33:13.608674 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:33:13.608674 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:33:13.608674 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:33:13.608674 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:33:13.608674 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPHxmBFu-fOVI0EFr4orsRflUwwS1z6hxWlWDd7JW3UWh1V59tmxAPr_3Kl-KnuNVvv9I6tUNJCb6Pk2agkQt7V0spOLhc_Wq7VdgS-tmBIyxE6R7b2ZbEk_-qeadW3HPWE5mZhfTtrMXoACjXgcRUj1BAfz3VUb0sNjw-1BKQ78mtKo Oct 04 18:33:13.608674 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:33:13.608674 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:33:13.608674 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:33:13.608674 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:33:13.608674 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:33:13.608674 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:33:13.608674 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: c85ce697712a4779868ad23acf997b64 Oct 04 18:33:13.608674 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-483826469 Oct 04 18:33:13.608674 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 18:33:13.608674 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 18:33:13.610322 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/c85ce697712a4779868ad23acf997b64"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_c85ce697712a4779868ad23acf997b64"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c85ce697712a4779868ad23acf997b64"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c85ce697712a4779868ad23acf997b64"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:33:13.610322 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-HostsAdminNegativeTestJSON-483826469 Oct 04 18:33:13.610322 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: c85ce697712a4779868ad23acf997b64 Oct 04 18:33:13.610322 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-483826469 Oct 04 18:33:13.610322 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-HostsAdminNegativeTestJSON-483826469-project Oct 04 18:33:13.610322 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:33:13.610322 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:33:13.610322 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 85c04284cd1341689f3a87a51e6e16fd Oct 04 18:33:13.610322 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-HostsAdminNegativeTestJSON-483826469-project Oct 04 18:33:13.610322 n-d-851028-13 devstack@n-api.service[123596]: method: Oct 04 18:33:13.610322 n-d-851028-13 devstack@n-api.service[123596]: exception: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 04 18:33:13.610322 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': 'n-d-851028-13'} Oct 04 18:33:13.610322 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:33:13.611159 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:33:13.611159 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:33:13.611159 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:33:13.611159 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:33:13.611159 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:33:13.611159 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:33:13.611159 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:33:13.611159 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:33:13.611159 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:33:13.611159 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 195, in shutdown Oct 04 18:33:13.611159 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'shutdown', Oct 04 18:33:13.611159 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 18:33:13.611159 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 18:33:13.611159 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 18:33:13.611159 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 18:33:13.611159 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:33:13.611159 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:33:13.611159 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:33:13.611159 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:33:13.612426 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 18:33:13.612426 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 18:33:13.612426 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 18:33:13.612426 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 18:33:13.612426 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 18:33:13.612426 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 18:33:13.612426 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 04 18:33:13.612426 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:33:13.612426 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:33:13.612426 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:33:13.612426 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:33:13.612426 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:33:13.612426 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:33:13.612426 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 18:33:13.612426 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 18:33:13.612426 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 04 18:33:13.612426 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:33:13.615332 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-8a3d6366-a1de-4dd9-bd7d-aa62e8dfed20 tempest-HostsAdminNegativeTestJSON-483826469 tempest-HostsAdminNegativeTestJSON-483826469-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:33:13.619223 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-8a3d6366-a1de-4dd9-bd7d-aa62e8dfed20 tempest-HostsAdminNegativeTestJSON-483826469 tempest-HostsAdminNegativeTestJSON-483826469-project] 10.222.0.43 "GET /compute/v2.1/os-hosts/n-d-851028-13/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.043611 Oct 04 18:33:13.621963 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 323/600] 10.222.0.43 () {58 vars in 1197 bytes} [Tue Oct 4 18:33:13 2022] GET /compute/v2.1/os-hosts/n-d-851028-13/shutdown => generated 113 bytes in 48 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:33:13.635245 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-c60a2bb6-627c-4a49-9daa-05188e770ddf req-829bbd10-e656-458e-83a8-76ab3a814871 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd5fe360-8ecf-41d0-9376-9d5533fc6ba8", "name": "network-vif-plugged", "status": "completed", "tag": "c60c6944-7112-4929-bd6e-03bb7d4559d0"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:33:13.648599 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-c60a2bb6-627c-4a49-9daa-05188e770ddf req-829bbd10-e656-458e-83a8-76ab3a814871 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:13.649604 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-c60a2bb6-627c-4a49-9daa-05188e770ddf req-829bbd10-e656-458e-83a8-76ab3a814871 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:13.650308 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-c60a2bb6-627c-4a49-9daa-05188e770ddf req-829bbd10-e656-458e-83a8-76ab3a814871 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:13.668443 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-c60a2bb6-627c-4a49-9daa-05188e770ddf req-829bbd10-e656-458e-83a8-76ab3a814871 service nova] Creating event network-vif-plugged:c60c6944-7112-4929-bd6e-03bb7d4559d0 for instance fd5fe360-8ecf-41d0-9376-9d5533fc6ba8 on n-h1-851028-13 Oct 04 18:33:13.684753 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-c60a2bb6-627c-4a49-9daa-05188e770ddf req-829bbd10-e656-458e-83a8-76ab3a814871 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060820 Oct 04 18:33:13.685811 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 324/601] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:33:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:33:13.703565 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-37869818-ea3b-4a69-966b-cb42ba40af9e tempest-HostsAdminNegativeTestJSON-612486445 tempest-HostsAdminNegativeTestJSON-612486445-project-admin] Calling method '.version_select at 0x7fb21fd3ab80>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:13.727396 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-37869818-ea3b-4a69-966b-cb42ba40af9e tempest-HostsAdminNegativeTestJSON-612486445 tempest-HostsAdminNegativeTestJSON-612486445-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 18:33:13.732064 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-37869818-ea3b-4a69-966b-cb42ba40af9e tempest-HostsAdminNegativeTestJSON-612486445 tempest-HostsAdminNegativeTestJSON-612486445-project-admin] Request method failure captured: Oct 04 18:33:13.732064 n-d-851028-13 devstack@n-api.service[123596]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown HTTP/1.1 Oct 04 18:33:13.732064 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:33:13.732064 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:33:13.732064 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:33:13.732064 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 18:33:13.732064 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:33:13.732064 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:33:13.732064 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:33:13.732064 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:33:13.732064 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPHxoVfd4XfLNh9VwEdBBy-tlkn_9EeSvxOK5P5y0S-XAX1E9mXG1JHD3IxKgJeda3t3NyBWaVL3Crs-hmJyn1DW8tzdp-7P4ifisapq76izMNba9-RDSZ89lcUyJvDrQnBGFTzJaAVInr3NhFqUjs1vs1hlAspZlN6m8vmBX20a_lUc Oct 04 18:33:13.732064 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:33:13.732064 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:33:13.732064 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:33:13.732064 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:33:13.732064 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:33:13.732064 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:33:13.732064 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: 477cbc49bd8c41328ecfb74475c8ab95 Oct 04 18:33:13.732064 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-612486445 Oct 04 18:33:13.732064 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,admin,reader Oct 04 18:33:13.732064 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,admin,reader Oct 04 18:33:13.733647 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/477cbc49bd8c41328ecfb74475c8ab95"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_477cbc49bd8c41328ecfb74475c8ab95"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/477cbc49bd8c41328ecfb74475c8ab95"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/477cbc49bd8c41328ecfb74475c8ab95"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:33:13.733647 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-HostsAdminNegativeTestJSON-612486445 Oct 04 18:33:13.733647 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: 477cbc49bd8c41328ecfb74475c8ab95 Oct 04 18:33:13.733647 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-612486445 Oct 04 18:33:13.733647 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-HostsAdminNegativeTestJSON-612486445-project-admin Oct 04 18:33:13.733647 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:33:13.733647 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:33:13.733647 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: bf362a5265d640808ea804f5751ab89d Oct 04 18:33:13.733647 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-HostsAdminNegativeTestJSON-612486445-project-admin Oct 04 18:33:13.733647 n-d-851028-13 devstack@n-api.service[123596]: method: Oct 04 18:33:13.733647 n-d-851028-13 devstack@n-api.service[123596]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 18:33:13.733647 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': 'nonexistent_hostname'} Oct 04 18:33:13.733647 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:33:13.734596 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:33:13.734596 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 04 18:33:13.734596 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 04 18:33:13.734596 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 04 18:33:13.734596 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 04 18:33:13.734596 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:33:13.734596 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:33:13.734596 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:33:13.734596 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:33:13.734596 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 04 18:33:13.734596 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 04 18:33:13.734596 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 04 18:33:13.734596 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 04 18:33:13.734596 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 18:33:13.734596 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 18:33:13.734596 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 04 18:33:13.734596 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 04 18:33:13.734596 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 18:33:13.734596 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 18:33:13.736021 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 04 18:33:13.736021 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 04 18:33:13.736021 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 18:33:13.736021 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:33:13.736021 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:33:13.736021 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:33:13.736021 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:33:13.736021 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:33:13.736021 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:33:13.736021 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:33:13.736021 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:33:13.736021 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:33:13.736021 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:33:13.736021 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:33:13.736021 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:33:13.736021 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 197, in shutdown Oct 04 18:33:13.736021 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="shutdown") Oct 04 18:33:13.736021 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 04 18:33:13.736021 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:33:13.737793 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 18:33:13.737793 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:33:13.737793 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:33:13.737793 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:33:13.737793 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:33:13.737793 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:33:13.737793 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:33:13.737793 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:33:13.737793 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:33:13.737793 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 18:33:13.737793 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:33:13.742061 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-37869818-ea3b-4a69-966b-cb42ba40af9e tempest-HostsAdminNegativeTestJSON-612486445 tempest-HostsAdminNegativeTestJSON-612486445-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:33:13.743169 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-37869818-ea3b-4a69-966b-cb42ba40af9e tempest-HostsAdminNegativeTestJSON-612486445 tempest-HostsAdminNegativeTestJSON-612486445-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.056070 Oct 04 18:33:13.744273 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 325/602] 10.222.0.43 () {58 vars in 1218 bytes} [Tue Oct 4 18:33:13 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:33:13.762809 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-ca2efe3d-36f3-4ea7-8344-59bdf18d63a8 tempest-HostsAdminNegativeTestJSON-483826469 tempest-HostsAdminNegativeTestJSON-483826469-project] Calling method '.version_select at 0x7fb21fd54700>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:13.764732 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-ca2efe3d-36f3-4ea7-8344-59bdf18d63a8 tempest-HostsAdminNegativeTestJSON-483826469 tempest-HostsAdminNegativeTestJSON-483826469-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': '85c04284cd1341689f3a87a51e6e16fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85ce697712a4779868ad23acf997b64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:13.766325 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-ca2efe3d-36f3-4ea7-8344-59bdf18d63a8 tempest-HostsAdminNegativeTestJSON-483826469 tempest-HostsAdminNegativeTestJSON-483826469-project] Request method failure captured: Oct 04 18:33:13.766325 n-d-851028-13 devstack@n-api.service[123596]: request: GET /compute/v2.1/os-hosts/n-d-851028-13/startup HTTP/1.1 Oct 04 18:33:13.766325 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:33:13.766325 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:33:13.766325 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:33:13.766325 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 18:33:13.766325 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:33:13.766325 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:33:13.766325 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:33:13.766325 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:33:13.766325 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPHxmBFu-fOVI0EFr4orsRflUwwS1z6hxWlWDd7JW3UWh1V59tmxAPr_3Kl-KnuNVvv9I6tUNJCb6Pk2agkQt7V0spOLhc_Wq7VdgS-tmBIyxE6R7b2ZbEk_-qeadW3HPWE5mZhfTtrMXoACjXgcRUj1BAfz3VUb0sNjw-1BKQ78mtKo Oct 04 18:33:13.766325 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:33:13.766325 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:33:13.766325 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:33:13.766325 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:33:13.766325 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:33:13.766325 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:33:13.766325 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: c85ce697712a4779868ad23acf997b64 Oct 04 18:33:13.766325 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-483826469 Oct 04 18:33:13.766325 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 18:33:13.766325 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 18:33:13.767862 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/c85ce697712a4779868ad23acf997b64"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_c85ce697712a4779868ad23acf997b64"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c85ce697712a4779868ad23acf997b64"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c85ce697712a4779868ad23acf997b64"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:33:13.767862 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-HostsAdminNegativeTestJSON-483826469 Oct 04 18:33:13.767862 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: c85ce697712a4779868ad23acf997b64 Oct 04 18:33:13.767862 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-483826469 Oct 04 18:33:13.767862 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-HostsAdminNegativeTestJSON-483826469-project Oct 04 18:33:13.767862 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:33:13.767862 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:33:13.767862 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 85c04284cd1341689f3a87a51e6e16fd Oct 04 18:33:13.767862 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-HostsAdminNegativeTestJSON-483826469-project Oct 04 18:33:13.767862 n-d-851028-13 devstack@n-api.service[123596]: method: Oct 04 18:33:13.767862 n-d-851028-13 devstack@n-api.service[123596]: exception: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 04 18:33:13.767862 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': 'n-d-851028-13'} Oct 04 18:33:13.767862 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:33:13.768865 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:33:13.768865 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:33:13.768865 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:33:13.768865 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:33:13.768865 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:33:13.768865 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:33:13.768865 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:33:13.768865 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:33:13.768865 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:33:13.768865 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 187, in startup Oct 04 18:33:13.768865 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'start', Oct 04 18:33:13.768865 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 18:33:13.768865 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 18:33:13.768865 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 18:33:13.768865 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 18:33:13.768865 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:33:13.768865 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:33:13.768865 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:33:13.768865 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:33:13.770222 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 18:33:13.770222 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 18:33:13.770222 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 18:33:13.770222 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 18:33:13.770222 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 18:33:13.770222 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 18:33:13.770222 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 04 18:33:13.770222 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:33:13.770222 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:33:13.770222 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:33:13.770222 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:33:13.770222 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:33:13.770222 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:33:13.770222 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 18:33:13.770222 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 18:33:13.770222 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 04 18:33:13.770222 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:33:13.774676 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-ca2efe3d-36f3-4ea7-8344-59bdf18d63a8 tempest-HostsAdminNegativeTestJSON-483826469 tempest-HostsAdminNegativeTestJSON-483826469-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:33:13.775857 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-ca2efe3d-36f3-4ea7-8344-59bdf18d63a8 tempest-HostsAdminNegativeTestJSON-483826469 tempest-HostsAdminNegativeTestJSON-483826469-project] 10.222.0.43 "GET /compute/v2.1/os-hosts/n-d-851028-13/startup" status: 403 len: 110 microversion: 2.1 time: 0.026708 Oct 04 18:33:13.777787 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 326/603] 10.222.0.43 () {58 vars in 1194 bytes} [Tue Oct 4 18:33:13 2022] GET /compute/v2.1/os-hosts/n-d-851028-13/startup => generated 110 bytes in 29 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:33:13.792658 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f86fc33a-4d19-43b6-b35d-b4279f720554 tempest-HostsAdminNegativeTestJSON-612486445 tempest-HostsAdminNegativeTestJSON-612486445-project-admin] Calling method '.version_select at 0x7fb21fd54e50>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:13.816437 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-f86fc33a-4d19-43b6-b35d-b4279f720554 tempest-HostsAdminNegativeTestJSON-612486445 tempest-HostsAdminNegativeTestJSON-612486445-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 18:33:13.818491 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f86fc33a-4d19-43b6-b35d-b4279f720554 tempest-HostsAdminNegativeTestJSON-612486445 tempest-HostsAdminNegativeTestJSON-612486445-project-admin] Request method failure captured: Oct 04 18:33:13.818491 n-d-851028-13 devstack@n-api.service[123596]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/startup HTTP/1.1 Oct 04 18:33:13.818491 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:33:13.818491 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:33:13.818491 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:33:13.818491 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 18:33:13.818491 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:33:13.818491 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:33:13.818491 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:33:13.818491 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:33:13.818491 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPHxoVfd4XfLNh9VwEdBBy-tlkn_9EeSvxOK5P5y0S-XAX1E9mXG1JHD3IxKgJeda3t3NyBWaVL3Crs-hmJyn1DW8tzdp-7P4ifisapq76izMNba9-RDSZ89lcUyJvDrQnBGFTzJaAVInr3NhFqUjs1vs1hlAspZlN6m8vmBX20a_lUc Oct 04 18:33:13.818491 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:33:13.818491 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:33:13.818491 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:33:13.818491 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:33:13.818491 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:33:13.818491 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:33:13.818491 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: 477cbc49bd8c41328ecfb74475c8ab95 Oct 04 18:33:13.818491 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-612486445 Oct 04 18:33:13.818491 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,admin,reader Oct 04 18:33:13.818491 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,admin,reader Oct 04 18:33:13.820088 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/477cbc49bd8c41328ecfb74475c8ab95"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_477cbc49bd8c41328ecfb74475c8ab95"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/477cbc49bd8c41328ecfb74475c8ab95"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/477cbc49bd8c41328ecfb74475c8ab95"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:33:13.820088 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-HostsAdminNegativeTestJSON-612486445 Oct 04 18:33:13.820088 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: 477cbc49bd8c41328ecfb74475c8ab95 Oct 04 18:33:13.820088 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-612486445 Oct 04 18:33:13.820088 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-HostsAdminNegativeTestJSON-612486445-project-admin Oct 04 18:33:13.820088 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:33:13.820088 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:33:13.820088 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: bf362a5265d640808ea804f5751ab89d Oct 04 18:33:13.820088 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-HostsAdminNegativeTestJSON-612486445-project-admin Oct 04 18:33:13.820088 n-d-851028-13 devstack@n-api.service[123596]: method: Oct 04 18:33:13.820088 n-d-851028-13 devstack@n-api.service[123596]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 18:33:13.820088 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': 'nonexistent_hostname'} Oct 04 18:33:13.820088 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:33:13.820969 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:33:13.820969 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 04 18:33:13.820969 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 04 18:33:13.820969 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 04 18:33:13.820969 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 04 18:33:13.820969 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:33:13.820969 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:33:13.820969 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:33:13.820969 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:33:13.820969 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 04 18:33:13.820969 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 04 18:33:13.820969 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 04 18:33:13.820969 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 04 18:33:13.820969 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 18:33:13.820969 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 18:33:13.820969 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 04 18:33:13.820969 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 04 18:33:13.820969 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 18:33:13.820969 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 18:33:13.822159 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 04 18:33:13.822159 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 04 18:33:13.822159 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 18:33:13.822159 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:33:13.822159 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:33:13.822159 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:33:13.822159 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:33:13.822159 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:33:13.822159 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:33:13.822159 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:33:13.822159 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:33:13.822159 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:33:13.822159 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:33:13.822159 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:33:13.822159 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:33:13.822159 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 189, in startup Oct 04 18:33:13.822159 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="startup") Oct 04 18:33:13.822159 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 04 18:33:13.822159 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:33:13.823295 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 18:33:13.823295 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:33:13.823295 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:33:13.823295 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:33:13.823295 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:33:13.823295 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:33:13.823295 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:33:13.823295 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:33:13.823295 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:33:13.823295 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 18:33:13.823295 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:33:13.825573 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f86fc33a-4d19-43b6-b35d-b4279f720554 tempest-HostsAdminNegativeTestJSON-612486445 tempest-HostsAdminNegativeTestJSON-612486445-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:33:13.826593 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-f86fc33a-4d19-43b6-b35d-b4279f720554 tempest-HostsAdminNegativeTestJSON-612486445 tempest-HostsAdminNegativeTestJSON-612486445-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.042569 Oct 04 18:33:13.828296 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 327/604] 10.222.0.43 () {58 vars in 1215 bytes} [Tue Oct 4 18:33:13 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:33:13.839191 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-6dcbca81-07db-4329-a588-3c5d92d50b9f tempest-HostsAdminNegativeTestJSON-612486445 tempest-HostsAdminNegativeTestJSON-612486445-project-admin] Action: 'update', calling method: .version_select at 0x7fb21fd3a550>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:33:13.840755 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-2286cb71-bccf-4465-849c-a80b568ed3f0 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:13.844242 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-6dcbca81-07db-4329-a588-3c5d92d50b9f tempest-HostsAdminNegativeTestJSON-612486445 tempest-HostsAdminNegativeTestJSON-612486445-project-admin] Request method failure captured: Oct 04 18:33:13.844242 n-d-851028-13 devstack@n-api.service[123596]: request: PUT /compute/v2.1/os-hosts/n-d-851028-13 HTTP/1.1 Oct 04 18:33:13.844242 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:33:13.844242 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:33:13.844242 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:33:13.844242 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 51 Oct 04 18:33:13.844242 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:33:13.844242 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:33:13.844242 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:33:13.844242 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:33:13.844242 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPHxoVfd4XfLNh9VwEdBBy-tlkn_9EeSvxOK5P5y0S-XAX1E9mXG1JHD3IxKgJeda3t3NyBWaVL3Crs-hmJyn1DW8tzdp-7P4ifisapq76izMNba9-RDSZ89lcUyJvDrQnBGFTzJaAVInr3NhFqUjs1vs1hlAspZlN6m8vmBX20a_lUc Oct 04 18:33:13.844242 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:33:13.844242 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:33:13.844242 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:33:13.844242 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:33:13.844242 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:33:13.844242 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:33:13.844242 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: 477cbc49bd8c41328ecfb74475c8ab95 Oct 04 18:33:13.844242 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-612486445 Oct 04 18:33:13.844242 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,admin,reader Oct 04 18:33:13.844242 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,admin,reader Oct 04 18:33:13.845752 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/477cbc49bd8c41328ecfb74475c8ab95"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_477cbc49bd8c41328ecfb74475c8ab95"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/477cbc49bd8c41328ecfb74475c8ab95"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/477cbc49bd8c41328ecfb74475c8ab95"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:33:13.845752 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-HostsAdminNegativeTestJSON-612486445 Oct 04 18:33:13.845752 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: 477cbc49bd8c41328ecfb74475c8ab95 Oct 04 18:33:13.845752 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-612486445 Oct 04 18:33:13.845752 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-HostsAdminNegativeTestJSON-612486445-project-admin Oct 04 18:33:13.845752 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:33:13.845752 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:33:13.845752 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: bf362a5265d640808ea804f5751ab89d Oct 04 18:33:13.845752 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-HostsAdminNegativeTestJSON-612486445-project-admin Oct 04 18:33:13.845752 n-d-851028-13 devstack@n-api.service[123596]: Oct 04 18:33:13.845752 n-d-851028-13 devstack@n-api.service[123596]: {"status": "enable", "maintenance_mode": "invalid"} Oct 04 18:33:13.845752 n-d-851028-13 devstack@n-api.service[123596]: method: Oct 04 18:33:13.845752 n-d-851028-13 devstack@n-api.service[123596]: exception: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 04 18:33:13.846654 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': 'n-d-851028-13', 'body': {'status': 'enable', 'maintenance_mode': 'invalid'}} Oct 04 18:33:13.846654 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:33:13.846654 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:33:13.846654 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:33:13.846654 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:33:13.846654 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:33:13.846654 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:33:13.846654 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 04 18:33:13.846654 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:33:13.846654 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['maintenance_mode']: Oct 04 18:33:13.846654 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 04 18:33:13.846654 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi 'disable', Oct 04 18:33:13.846654 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi 'Enable', Oct 04 18:33:13.846654 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi 'Disable', Oct 04 18:33:13.846654 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 04 18:33:13.846654 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 04 18:33:13.846654 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 04 18:33:13.846654 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:33:13.846654 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi On instance: Oct 04 18:33:13.846654 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi 'invalid' Oct 04 18:33:13.846654 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:33:13.846654 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:33:13.846654 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:33:13.846654 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:33:13.846654 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:33:13.848730 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:33:13.848730 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:33:13.848730 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:33:13.848730 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:33:13.848730 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:33:13.848730 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:33:13.848730 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:33:13.848730 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 18:33:13.848730 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 18:33:13.848730 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:33:13.848730 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:33:13.848730 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:33:13.848730 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:33:13.848730 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 04 18:33:13.848730 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:33:13.848730 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:33:13.848730 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:33:13.848730 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:33:13.848730 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:33:13.850379 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:33:13.850379 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:33:13.850379 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:33:13.850379 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 04 18:33:13.850379 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:33:13.854601 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-2286cb71-bccf-4465-849c-a80b568ed3f0 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:13.854814 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-6dcbca81-07db-4329-a588-3c5d92d50b9f tempest-HostsAdminNegativeTestJSON-612486445 tempest-HostsAdminNegativeTestJSON-612486445-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:33:13.854814 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-6dcbca81-07db-4329-a588-3c5d92d50b9f tempest-HostsAdminNegativeTestJSON-612486445 tempest-HostsAdminNegativeTestJSON-612486445-project-admin] 10.222.0.43 "PUT /compute/v2.1/os-hosts/n-d-851028-13" status: 400 len: 199 microversion: 2.1 time: 0.020371 Oct 04 18:33:13.855471 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 328/605] 10.222.0.43 () {60 vars in 1190 bytes} [Tue Oct 4 18:33:13 2022] PUT /compute/v2.1/os-hosts/n-d-851028-13 => generated 199 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:33:13.856124 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-2286cb71-bccf-4465-849c-a80b568ed3f0 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:13.858179 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-2286cb71-bccf-4465-849c-a80b568ed3f0 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] 10.222.0.43 "GET /compute/v2.1/servers/fd5fe360-8ecf-41d0-9376-9d5533fc6ba8" status: 200 len: 1361 microversion: 2.25 time: 0.363694 Oct 04 18:33:13.858179 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 278/606] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:33:13 2022] GET /compute/v2.1/servers/fd5fe360-8ecf-41d0-9376-9d5533fc6ba8 => generated 1361 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:33:13.863887 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-b23efd4f-b61d-45fb-937a-f67f22c2545b tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:13.864836 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-b23efd4f-b61d-45fb-937a-f67f22c2545b tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] [instance: e5e92f30-937a-4ec2-b11f-336030c3d5c9] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:13.867089 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-0253aa49-e574-4bbe-a01b-8c81599f6ef3 tempest-HostsAdminNegativeTestJSON-612486445 tempest-HostsAdminNegativeTestJSON-612486445-project-admin] Action: 'update', calling method: .version_select at 0x7fb21fe65ee0>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:33:13.872795 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b23efd4f-b61d-45fb-937a-f67f22c2545b tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:13.873547 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b23efd4f-b61d-45fb-937a-f67f22c2545b tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:13.874317 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b23efd4f-b61d-45fb-937a-f67f22c2545b tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:13.875195 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b23efd4f-b61d-45fb-937a-f67f22c2545b tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:13.875305 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-0253aa49-e574-4bbe-a01b-8c81599f6ef3 tempest-HostsAdminNegativeTestJSON-612486445 tempest-HostsAdminNegativeTestJSON-612486445-project-admin] Request method failure captured: Oct 04 18:33:13.875305 n-d-851028-13 devstack@n-api.service[123595]: request: PUT /compute/v2.1/os-hosts/n-d-851028-13 HTTP/1.1 Oct 04 18:33:13.875305 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 18:33:13.875305 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 18:33:13.875305 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 18:33:13.875305 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 51 Oct 04 18:33:13.875305 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 18:33:13.875305 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 18:33:13.875305 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 18:33:13.875305 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 18:33:13.875305 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPHxoVfd4XfLNh9VwEdBBy-tlkn_9EeSvxOK5P5y0S-XAX1E9mXG1JHD3IxKgJeda3t3NyBWaVL3Crs-hmJyn1DW8tzdp-7P4ifisapq76izMNba9-RDSZ89lcUyJvDrQnBGFTzJaAVInr3NhFqUjs1vs1hlAspZlN6m8vmBX20a_lUc Oct 04 18:33:13.875305 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 18:33:13.875305 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 18:33:13.875305 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 18:33:13.875305 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 18:33:13.875305 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 18:33:13.875305 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 18:33:13.875305 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: 477cbc49bd8c41328ecfb74475c8ab95 Oct 04 18:33:13.875305 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-612486445 Oct 04 18:33:13.875305 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,admin,reader Oct 04 18:33:13.875305 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,admin,reader Oct 04 18:33:13.876780 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/477cbc49bd8c41328ecfb74475c8ab95"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_477cbc49bd8c41328ecfb74475c8ab95"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/477cbc49bd8c41328ecfb74475c8ab95"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/477cbc49bd8c41328ecfb74475c8ab95"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:33:13.876780 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-HostsAdminNegativeTestJSON-612486445 Oct 04 18:33:13.876780 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: 477cbc49bd8c41328ecfb74475c8ab95 Oct 04 18:33:13.876780 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-612486445 Oct 04 18:33:13.876780 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-HostsAdminNegativeTestJSON-612486445-project-admin Oct 04 18:33:13.876780 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 18:33:13.876780 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 18:33:13.876780 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: bf362a5265d640808ea804f5751ab89d Oct 04 18:33:13.876780 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-HostsAdminNegativeTestJSON-612486445-project-admin Oct 04 18:33:13.876780 n-d-851028-13 devstack@n-api.service[123595]: Oct 04 18:33:13.876780 n-d-851028-13 devstack@n-api.service[123595]: {"status": "invalid", "maintenance_mode": "enable"} Oct 04 18:33:13.876780 n-d-851028-13 devstack@n-api.service[123595]: method: Oct 04 18:33:13.876780 n-d-851028-13 devstack@n-api.service[123595]: exception: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 04 18:33:13.877726 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': 'n-d-851028-13', 'body': {'status': 'invalid', 'maintenance_mode': 'enable'}} Oct 04 18:33:13.877726 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:33:13.877726 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:33:13.877726 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:33:13.877726 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:33:13.877726 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:33:13.877726 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:33:13.877726 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 04 18:33:13.877726 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:33:13.877726 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['status']: Oct 04 18:33:13.877726 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 04 18:33:13.877726 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi 'disable', Oct 04 18:33:13.877726 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi 'Enable', Oct 04 18:33:13.877726 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi 'Disable', Oct 04 18:33:13.877726 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 04 18:33:13.877726 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 04 18:33:13.877726 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 04 18:33:13.877726 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:33:13.877726 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi On instance: Oct 04 18:33:13.877726 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi 'invalid' Oct 04 18:33:13.877726 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:33:13.877726 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:33:13.877726 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:33:13.877726 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:33:13.877726 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:33:13.879239 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:33:13.879239 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:33:13.879239 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:33:13.879239 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:33:13.879239 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:33:13.879239 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:33:13.879239 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:33:13.879239 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 18:33:13.879239 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 18:33:13.879239 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:33:13.879239 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:33:13.879239 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:33:13.879239 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:33:13.879239 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 04 18:33:13.879239 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:33:13.879239 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:33:13.879239 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:33:13.879239 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:33:13.879239 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:33:13.882488 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:33:13.882488 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:33:13.882488 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:33:13.882488 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 04 18:33:13.882488 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:33:13.882488 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-0253aa49-e574-4bbe-a01b-8c81599f6ef3 tempest-HostsAdminNegativeTestJSON-612486445 tempest-HostsAdminNegativeTestJSON-612486445-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:33:13.882488 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-0253aa49-e574-4bbe-a01b-8c81599f6ef3 tempest-HostsAdminNegativeTestJSON-612486445 tempest-HostsAdminNegativeTestJSON-612486445-project-admin] 10.222.0.43 "PUT /compute/v2.1/os-hosts/n-d-851028-13" status: 400 len: 189 microversion: 2.1 time: 0.016064 Oct 04 18:33:13.882488 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 279/607] 10.222.0.43 () {60 vars in 1190 bytes} [Tue Oct 4 18:33:13 2022] PUT /compute/v2.1/os-hosts/n-d-851028-13 => generated 189 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:33:13.883710 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b23efd4f-b61d-45fb-937a-f67f22c2545b tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:13.884314 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b23efd4f-b61d-45fb-937a-f67f22c2545b tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:13.908037 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-eb3f83bf-23a5-48d9-a88a-05a45cb4ab5f tempest-HostsAdminNegativeTestJSON-483826469 tempest-HostsAdminNegativeTestJSON-483826469-project] Action: 'update', calling method: .version_select at 0x7fb21fe78af0>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:33:13.911907 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-eb3f83bf-23a5-48d9-a88a-05a45cb4ab5f tempest-HostsAdminNegativeTestJSON-483826469 tempest-HostsAdminNegativeTestJSON-483826469-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': '85c04284cd1341689f3a87a51e6e16fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85ce697712a4779868ad23acf997b64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:13.920673 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-eb3f83bf-23a5-48d9-a88a-05a45cb4ab5f tempest-HostsAdminNegativeTestJSON-483826469 tempest-HostsAdminNegativeTestJSON-483826469-project] Request method failure captured: Oct 04 18:33:13.920673 n-d-851028-13 devstack@n-api.service[123595]: request: PUT /compute/v2.1/os-hosts/n-d-851028-13 HTTP/1.1 Oct 04 18:33:13.920673 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 18:33:13.920673 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 18:33:13.920673 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 18:33:13.920673 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 50 Oct 04 18:33:13.920673 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 18:33:13.920673 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 18:33:13.920673 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 18:33:13.920673 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 18:33:13.920673 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPHxmBFu-fOVI0EFr4orsRflUwwS1z6hxWlWDd7JW3UWh1V59tmxAPr_3Kl-KnuNVvv9I6tUNJCb6Pk2agkQt7V0spOLhc_Wq7VdgS-tmBIyxE6R7b2ZbEk_-qeadW3HPWE5mZhfTtrMXoACjXgcRUj1BAfz3VUb0sNjw-1BKQ78mtKo Oct 04 18:33:13.920673 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 18:33:13.920673 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 18:33:13.920673 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 18:33:13.920673 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 18:33:13.920673 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 18:33:13.920673 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 18:33:13.920673 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: c85ce697712a4779868ad23acf997b64 Oct 04 18:33:13.920673 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-483826469 Oct 04 18:33:13.920673 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 18:33:13.920673 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 18:33:13.922078 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/c85ce697712a4779868ad23acf997b64"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_c85ce697712a4779868ad23acf997b64"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c85ce697712a4779868ad23acf997b64"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c85ce697712a4779868ad23acf997b64"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:33:13.922078 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-HostsAdminNegativeTestJSON-483826469 Oct 04 18:33:13.922078 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: c85ce697712a4779868ad23acf997b64 Oct 04 18:33:13.922078 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-483826469 Oct 04 18:33:13.922078 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-HostsAdminNegativeTestJSON-483826469-project Oct 04 18:33:13.922078 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 18:33:13.922078 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 18:33:13.922078 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: 85c04284cd1341689f3a87a51e6e16fd Oct 04 18:33:13.922078 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-HostsAdminNegativeTestJSON-483826469-project Oct 04 18:33:13.922078 n-d-851028-13 devstack@n-api.service[123595]: Oct 04 18:33:13.922078 n-d-851028-13 devstack@n-api.service[123595]: {"status": "enable", "maintenance_mode": "enable"} Oct 04 18:33:13.922078 n-d-851028-13 devstack@n-api.service[123595]: method: Oct 04 18:33:13.922078 n-d-851028-13 devstack@n-api.service[123595]: exception: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 04 18:33:13.922078 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': 'n-d-851028-13', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Oct 04 18:33:13.923189 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:33:13.923189 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:33:13.923189 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:33:13.923189 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:33:13.923189 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:33:13.923189 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:33:13.923189 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:33:13.923189 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:33:13.923189 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:33:13.923189 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:33:13.923189 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:33:13.923189 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:33:13.923189 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 112, in update Oct 04 18:33:13.923189 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'update', Oct 04 18:33:13.923189 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 18:33:13.923189 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 18:33:13.923189 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 18:33:13.923189 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 18:33:13.923189 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:33:13.923189 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:33:13.924353 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:33:13.924353 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:33:13.924353 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 18:33:13.924353 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 18:33:13.924353 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 18:33:13.924353 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 18:33:13.924353 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 18:33:13.924353 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 18:33:13.924353 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 04 18:33:13.924353 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:33:13.924353 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:33:13.924353 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:33:13.924353 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:33:13.924353 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:33:13.924353 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:33:13.924353 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 18:33:13.924353 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 18:33:13.924353 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 04 18:33:13.924353 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:33:13.931838 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-eb3f83bf-23a5-48d9-a88a-05a45cb4ab5f tempest-HostsAdminNegativeTestJSON-483826469 tempest-HostsAdminNegativeTestJSON-483826469-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:33:13.932811 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-eb3f83bf-23a5-48d9-a88a-05a45cb4ab5f tempest-HostsAdminNegativeTestJSON-483826469 tempest-HostsAdminNegativeTestJSON-483826469-project] 10.222.0.43 "PUT /compute/v2.1/os-hosts/n-d-851028-13" status: 403 len: 111 microversion: 2.1 time: 0.041574 Oct 04 18:33:13.933419 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 280/608] 10.222.0.43 () {60 vars in 1190 bytes} [Tue Oct 4 18:33:13 2022] PUT /compute/v2.1/os-hosts/n-d-851028-13 => generated 111 bytes in 43 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:33:13.958547 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-00665fb7-845f-4d99-8950-46e0997b7d39 tempest-HostsAdminNegativeTestJSON-612486445 tempest-HostsAdminNegativeTestJSON-612486445-project-admin] Action: 'update', calling method: .version_select at 0x7fb21fe1ef70>, body: {"status": null, "maintenance_mode": null} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:33:13.968105 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-00665fb7-845f-4d99-8950-46e0997b7d39 tempest-HostsAdminNegativeTestJSON-612486445 tempest-HostsAdminNegativeTestJSON-612486445-project-admin] Request method failure captured: Oct 04 18:33:13.968105 n-d-851028-13 devstack@n-api.service[123595]: request: PUT /compute/v2.1/os-hosts/n-d-851028-13 HTTP/1.1 Oct 04 18:33:13.968105 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 18:33:13.968105 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 18:33:13.968105 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 18:33:13.968105 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 42 Oct 04 18:33:13.968105 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 18:33:13.968105 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 18:33:13.968105 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 18:33:13.968105 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 18:33:13.968105 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPHxoVfd4XfLNh9VwEdBBy-tlkn_9EeSvxOK5P5y0S-XAX1E9mXG1JHD3IxKgJeda3t3NyBWaVL3Crs-hmJyn1DW8tzdp-7P4ifisapq76izMNba9-RDSZ89lcUyJvDrQnBGFTzJaAVInr3NhFqUjs1vs1hlAspZlN6m8vmBX20a_lUc Oct 04 18:33:13.968105 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 18:33:13.968105 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 18:33:13.968105 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 18:33:13.968105 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 18:33:13.968105 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 18:33:13.968105 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 18:33:13.968105 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: 477cbc49bd8c41328ecfb74475c8ab95 Oct 04 18:33:13.968105 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-612486445 Oct 04 18:33:13.968105 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,admin,reader Oct 04 18:33:13.968105 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,admin,reader Oct 04 18:33:13.969526 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/477cbc49bd8c41328ecfb74475c8ab95"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_477cbc49bd8c41328ecfb74475c8ab95"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/477cbc49bd8c41328ecfb74475c8ab95"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/477cbc49bd8c41328ecfb74475c8ab95"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:33:13.969526 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-HostsAdminNegativeTestJSON-612486445 Oct 04 18:33:13.969526 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: 477cbc49bd8c41328ecfb74475c8ab95 Oct 04 18:33:13.969526 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-612486445 Oct 04 18:33:13.969526 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-HostsAdminNegativeTestJSON-612486445-project-admin Oct 04 18:33:13.969526 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 18:33:13.969526 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 18:33:13.969526 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: bf362a5265d640808ea804f5751ab89d Oct 04 18:33:13.969526 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-HostsAdminNegativeTestJSON-612486445-project-admin Oct 04 18:33:13.969526 n-d-851028-13 devstack@n-api.service[123595]: Oct 04 18:33:13.969526 n-d-851028-13 devstack@n-api.service[123595]: {"status": null, "maintenance_mode": null} Oct 04 18:33:13.969526 n-d-851028-13 devstack@n-api.service[123595]: method: Oct 04 18:33:13.969526 n-d-851028-13 devstack@n-api.service[123595]: exception: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 04 18:33:13.969526 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': 'n-d-851028-13', 'body': {'status': None, 'maintenance_mode': None}} Oct 04 18:33:13.970369 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:33:13.970369 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:33:13.970369 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:33:13.970369 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:33:13.970369 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:33:13.970369 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:33:13.970369 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: None is not of type 'string' Oct 04 18:33:13.970369 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:33:13.970369 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['status']: Oct 04 18:33:13.970369 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 04 18:33:13.970369 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi 'disable', Oct 04 18:33:13.970369 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi 'Enable', Oct 04 18:33:13.970369 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi 'Disable', Oct 04 18:33:13.970369 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 04 18:33:13.970369 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 04 18:33:13.970369 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 04 18:33:13.970369 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:33:13.970369 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi On instance: Oct 04 18:33:13.970369 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi None Oct 04 18:33:13.970369 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:33:13.970369 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:33:13.970369 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:33:13.970369 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:33:13.970369 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:33:13.970369 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:33:13.973790 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:33:13.973790 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:33:13.973790 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:33:13.973790 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:33:13.973790 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:33:13.973790 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:33:13.973790 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 18:33:13.973790 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 18:33:13.973790 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:33:13.973790 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:33:13.973790 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:33:13.973790 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:33:13.973790 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 04 18:33:13.973790 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:33:13.973790 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:33:13.973790 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:33:13.973790 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:33:13.973790 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:33:13.973790 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:33:13.974854 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:33:13.974854 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:33:13.974854 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 04 18:33:13.974854 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:33:13.974854 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-00665fb7-845f-4d99-8950-46e0997b7d39 tempest-HostsAdminNegativeTestJSON-612486445 tempest-HostsAdminNegativeTestJSON-612486445-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:33:13.974854 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-00665fb7-845f-4d99-8950-46e0997b7d39 tempest-HostsAdminNegativeTestJSON-612486445 tempest-HostsAdminNegativeTestJSON-612486445-project-admin] 10.222.0.43 "PUT /compute/v2.1/os-hosts/n-d-851028-13" status: 400 len: 127 microversion: 2.1 time: 0.026360 Oct 04 18:33:13.976159 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 281/609] 10.222.0.43 () {60 vars in 1190 bytes} [Tue Oct 4 18:33:13 2022] PUT /compute/v2.1/os-hosts/n-d-851028-13 => generated 127 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:33:13.984430 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-7af1145f-99d2-4ef0-b094-722d194b9726 tempest-HostsAdminNegativeTestJSON-612486445 tempest-HostsAdminNegativeTestJSON-612486445-project-admin] Action: 'update', calling method: .version_select at 0x7fb21fe65280>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:33:13.994269 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.hosts [None req-7af1145f-99d2-4ef0-b094-722d194b9726 tempest-HostsAdminNegativeTestJSON-612486445 tempest-HostsAdminNegativeTestJSON-612486445-project-admin] Enabling host nonexistent_hostname. Oct 04 18:33:14.005779 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-7af1145f-99d2-4ef0-b094-722d194b9726 tempest-HostsAdminNegativeTestJSON-612486445 tempest-HostsAdminNegativeTestJSON-612486445-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 18:33:14.008456 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-7af1145f-99d2-4ef0-b094-722d194b9726 tempest-HostsAdminNegativeTestJSON-612486445 tempest-HostsAdminNegativeTestJSON-612486445-project-admin] Request method failure captured: Oct 04 18:33:14.008456 n-d-851028-13 devstack@n-api.service[123595]: request: PUT /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Oct 04 18:33:14.008456 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 18:33:14.008456 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 18:33:14.008456 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 18:33:14.008456 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 50 Oct 04 18:33:14.008456 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 18:33:14.008456 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 18:33:14.008456 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 18:33:14.008456 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 18:33:14.008456 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPHxoVfd4XfLNh9VwEdBBy-tlkn_9EeSvxOK5P5y0S-XAX1E9mXG1JHD3IxKgJeda3t3NyBWaVL3Crs-hmJyn1DW8tzdp-7P4ifisapq76izMNba9-RDSZ89lcUyJvDrQnBGFTzJaAVInr3NhFqUjs1vs1hlAspZlN6m8vmBX20a_lUc Oct 04 18:33:14.008456 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 18:33:14.008456 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 18:33:14.008456 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 18:33:14.008456 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 18:33:14.008456 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 18:33:14.008456 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 18:33:14.008456 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: 477cbc49bd8c41328ecfb74475c8ab95 Oct 04 18:33:14.008456 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-612486445 Oct 04 18:33:14.008456 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,admin,reader Oct 04 18:33:14.008456 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,admin,reader Oct 04 18:33:14.010876 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/477cbc49bd8c41328ecfb74475c8ab95"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_477cbc49bd8c41328ecfb74475c8ab95"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/477cbc49bd8c41328ecfb74475c8ab95"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/477cbc49bd8c41328ecfb74475c8ab95"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:33:14.010876 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-HostsAdminNegativeTestJSON-612486445 Oct 04 18:33:14.010876 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: 477cbc49bd8c41328ecfb74475c8ab95 Oct 04 18:33:14.010876 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-612486445 Oct 04 18:33:14.010876 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-HostsAdminNegativeTestJSON-612486445-project-admin Oct 04 18:33:14.010876 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 18:33:14.010876 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 18:33:14.010876 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: bf362a5265d640808ea804f5751ab89d Oct 04 18:33:14.010876 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-HostsAdminNegativeTestJSON-612486445-project-admin Oct 04 18:33:14.010876 n-d-851028-13 devstack@n-api.service[123595]: Oct 04 18:33:14.010876 n-d-851028-13 devstack@n-api.service[123595]: {"status": "enable", "maintenance_mode": "enable"} Oct 04 18:33:14.010876 n-d-851028-13 devstack@n-api.service[123595]: method: Oct 04 18:33:14.010876 n-d-851028-13 devstack@n-api.service[123595]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 18:33:14.010876 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': 'nonexistent_hostname', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Oct 04 18:33:14.011683 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:33:14.011683 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:33:14.011683 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 159, in _set_enabled_status Oct 04 18:33:14.011683 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi result = self.api.set_host_enabled(context, host_name, enabled) Oct 04 18:33:14.011683 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 04 18:33:14.011683 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 04 18:33:14.011683 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:33:14.011683 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:33:14.011683 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:33:14.011683 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:33:14.011683 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 04 18:33:14.011683 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 04 18:33:14.011683 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 04 18:33:14.011683 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 04 18:33:14.011683 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 18:33:14.011683 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 18:33:14.011683 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 04 18:33:14.011683 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 04 18:33:14.012727 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 18:33:14.012727 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 18:33:14.012727 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 04 18:33:14.012727 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 04 18:33:14.012727 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 18:33:14.012727 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:33:14.012727 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:33:14.012727 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:33:14.012727 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:33:14.012727 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:33:14.012727 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:33:14.012727 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:33:14.012727 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:33:14.012727 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:33:14.012727 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:33:14.012727 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:33:14.012727 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:33:14.012727 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:33:14.012727 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:33:14.012727 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 124, in update Oct 04 18:33:14.015619 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi result['status'] = self._set_enabled_status(context, id, status) Oct 04 18:33:14.015619 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 163, in _set_enabled_status Oct 04 18:33:14.015619 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:33:14.015619 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 18:33:14.015619 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:33:14.015619 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:33:14.015619 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:33:14.015619 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:33:14.015619 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:33:14.015619 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:33:14.015619 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:33:14.015619 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:33:14.015619 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 18:33:14.015619 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:33:14.015619 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-7af1145f-99d2-4ef0-b094-722d194b9726 tempest-HostsAdminNegativeTestJSON-612486445 tempest-HostsAdminNegativeTestJSON-612486445-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:33:14.017792 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-7af1145f-99d2-4ef0-b094-722d194b9726 tempest-HostsAdminNegativeTestJSON-612486445 tempest-HostsAdminNegativeTestJSON-612486445-project-admin] 10.222.0.43 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.038588 Oct 04 18:33:14.017792 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 282/610] 10.222.0.43 () {60 vars in 1211 bytes} [Tue Oct 4 18:33:13 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 04 18:33:14.070392 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-69666928-b107-44ad-b313-d5081e89de0b tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:14.070555 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-69666928-b107-44ad-b313-d5081e89de0b tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] [instance: 84e0414b-a39f-4bfe-bc9d-c170ceb34d15] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:14.084217 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-69666928-b107-44ad-b313-d5081e89de0b tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:14.087215 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-69666928-b107-44ad-b313-d5081e89de0b tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:14.091151 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-69666928-b107-44ad-b313-d5081e89de0b tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:14.095308 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-69666928-b107-44ad-b313-d5081e89de0b tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:14.095308 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-69666928-b107-44ad-b313-d5081e89de0b tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:14.095308 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-69666928-b107-44ad-b313-d5081e89de0b tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:14.185924 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-b23efd4f-b61d-45fb-937a-f67f22c2545b tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb7b0ce49ec438f9a60b79bdb2ac164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94ae6e2cb75d410d8029aa49909c973b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:14.199483 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-b23efd4f-b61d-45fb-937a-f67f22c2545b tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] 10.222.0.43 "GET /compute/v2.1/servers/e5e92f30-937a-4ec2-b11f-336030c3d5c9" status: 200 len: 1322 microversion: 2.1 time: 0.342336 Oct 04 18:33:14.199902 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 329/611] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:13 2022] GET /compute/v2.1/servers/e5e92f30-937a-4ec2-b11f-336030c3d5c9 => generated 1322 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:14.279773 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-69666928-b107-44ad-b313-d5081e89de0b tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:14.294785 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-69666928-b107-44ad-b313-d5081e89de0b tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:14.297381 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-69666928-b107-44ad-b313-d5081e89de0b tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:14.304970 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-69666928-b107-44ad-b313-d5081e89de0b tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] 10.222.0.43 "GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15" status: 200 len: 1537 microversion: 2.91 time: 0.248643 Oct 04 18:33:14.305930 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 283/612] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:33:14 2022] GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15 => generated 1537 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:33:14.563795 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-25baa442-180f-4710-b733-d182dba46692 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:14.564823 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-25baa442-180f-4710-b733-d182dba46692 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] [instance: fc077a8b-c0f8-4bb1-8a39-91874ac015e7] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:14.576676 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-25baa442-180f-4710-b733-d182dba46692 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:14.579034 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-25baa442-180f-4710-b733-d182dba46692 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:14.579610 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-25baa442-180f-4710-b733-d182dba46692 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:14.580370 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-25baa442-180f-4710-b733-d182dba46692 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:14.580834 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-25baa442-180f-4710-b733-d182dba46692 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:14.581306 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-25baa442-180f-4710-b733-d182dba46692 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:14.904595 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-4766df22-e61f-42aa-845a-4e2bbac811b0 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:14.905465 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-4766df22-e61f-42aa-845a-4e2bbac811b0 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] [instance: fd5fe360-8ecf-41d0-9376-9d5533fc6ba8] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:14.919225 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4766df22-e61f-42aa-845a-4e2bbac811b0 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:14.919225 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4766df22-e61f-42aa-845a-4e2bbac811b0 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:14.919617 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4766df22-e61f-42aa-845a-4e2bbac811b0 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:14.920167 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4766df22-e61f-42aa-845a-4e2bbac811b0 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:14.920926 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4766df22-e61f-42aa-845a-4e2bbac811b0 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:14.921659 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4766df22-e61f-42aa-845a-4e2bbac811b0 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:15.164505 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-4766df22-e61f-42aa-845a-4e2bbac811b0 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:15.181089 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-4766df22-e61f-42aa-845a-4e2bbac811b0 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:15.182884 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-4766df22-e61f-42aa-845a-4e2bbac811b0 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:15.184087 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-4766df22-e61f-42aa-845a-4e2bbac811b0 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] 10.222.0.43 "GET /compute/v2.1/servers/fd5fe360-8ecf-41d0-9376-9d5533fc6ba8" status: 200 len: 1361 microversion: 2.25 time: 0.283566 Oct 04 18:33:15.184956 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 284/613] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:33:14 2022] GET /compute/v2.1/servers/fd5fe360-8ecf-41d0-9376-9d5533fc6ba8 => generated 1361 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:33:15.225969 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-c35586e6-d503-4f03-a941-436b67a60e77 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:15.228969 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-c35586e6-d503-4f03-a941-436b67a60e77 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] [instance: e5e92f30-937a-4ec2-b11f-336030c3d5c9] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:15.255327 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c35586e6-d503-4f03-a941-436b67a60e77 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:15.257858 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c35586e6-d503-4f03-a941-436b67a60e77 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:15.258639 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c35586e6-d503-4f03-a941-436b67a60e77 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:15.261302 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c35586e6-d503-4f03-a941-436b67a60e77 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:15.262540 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c35586e6-d503-4f03-a941-436b67a60e77 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:15.265651 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c35586e6-d503-4f03-a941-436b67a60e77 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:15.357081 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-25baa442-180f-4710-b733-d182dba46692 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7db99f361654711bea7f1b2c404d312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7adedcdb9c3485ea2738c00e25aa3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:15.370015 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-25baa442-180f-4710-b733-d182dba46692 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] 10.222.0.43 "GET /compute/v2.1/servers/fc077a8b-c0f8-4bb1-8a39-91874ac015e7" status: 200 len: 1316 microversion: 2.1 time: 0.808563 Oct 04 18:33:15.371045 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 330/614] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:14 2022] GET /compute/v2.1/servers/fc077a8b-c0f8-4bb1-8a39-91874ac015e7 => generated 1316 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:15.376357 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-7ab7d882-aa17-49d7-b421-85c980191678 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:15.377350 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-7ab7d882-aa17-49d7-b421-85c980191678 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] [instance: 84e0414b-a39f-4bfe-bc9d-c170ceb34d15] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:15.385845 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7ab7d882-aa17-49d7-b421-85c980191678 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:15.386679 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7ab7d882-aa17-49d7-b421-85c980191678 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:15.387461 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7ab7d882-aa17-49d7-b421-85c980191678 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:15.388378 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7ab7d882-aa17-49d7-b421-85c980191678 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:15.389013 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7ab7d882-aa17-49d7-b421-85c980191678 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:15.389845 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7ab7d882-aa17-49d7-b421-85c980191678 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:15.415618 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=100 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:33:15.452096 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-c35586e6-d503-4f03-a941-436b67a60e77 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb7b0ce49ec438f9a60b79bdb2ac164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94ae6e2cb75d410d8029aa49909c973b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:15.460875 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-c35586e6-d503-4f03-a941-436b67a60e77 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] 10.222.0.43 "GET /compute/v2.1/servers/e5e92f30-937a-4ec2-b11f-336030c3d5c9" status: 200 len: 1322 microversion: 2.1 time: 0.240463 Oct 04 18:33:15.466007 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 285/615] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:15 2022] GET /compute/v2.1/servers/e5e92f30-937a-4ec2-b11f-336030c3d5c9 => generated 1322 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:15.514240 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-7ab7d882-aa17-49d7-b421-85c980191678 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:15.524886 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-7ab7d882-aa17-49d7-b421-85c980191678 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:15.527194 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-7ab7d882-aa17-49d7-b421-85c980191678 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:15.535627 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-7ab7d882-aa17-49d7-b421-85c980191678 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] 10.222.0.43 "GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15" status: 200 len: 1537 microversion: 2.91 time: 0.162273 Oct 04 18:33:15.546605 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 331/616] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:33:15 2022] GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15 => generated 1537 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:33:15.834433 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-aa270b3d-75fd-4496-929c-b54911bad17f req-cce611a1-5912-4b38-8686-d7e414f2b63a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5e92f30-937a-4ec2-b11f-336030c3d5c9", "name": "network-vif-plugged", "status": "completed", "tag": "17ae84c1-48ca-4769-9d6d-c68a66614fb0"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:33:15.848166 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-aa270b3d-75fd-4496-929c-b54911bad17f req-cce611a1-5912-4b38-8686-d7e414f2b63a service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:15.848991 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-aa270b3d-75fd-4496-929c-b54911bad17f req-cce611a1-5912-4b38-8686-d7e414f2b63a service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:15.849799 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-aa270b3d-75fd-4496-929c-b54911bad17f req-cce611a1-5912-4b38-8686-d7e414f2b63a service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:15.875467 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-aa270b3d-75fd-4496-929c-b54911bad17f req-cce611a1-5912-4b38-8686-d7e414f2b63a service nova] Creating event network-vif-plugged:17ae84c1-48ca-4769-9d6d-c68a66614fb0 for instance e5e92f30-937a-4ec2-b11f-336030c3d5c9 on n-h2-851028-13 Oct 04 18:33:15.881702 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-aa270b3d-75fd-4496-929c-b54911bad17f req-cce611a1-5912-4b38-8686-d7e414f2b63a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054220 Oct 04 18:33:15.884426 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 286/617] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:33:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:33:16.213100 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-b9f5184f-b25c-446f-ad4c-d95e5ee3559d tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:16.213822 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-b9f5184f-b25c-446f-ad4c-d95e5ee3559d tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] [instance: fd5fe360-8ecf-41d0-9376-9d5533fc6ba8] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:16.226802 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b9f5184f-b25c-446f-ad4c-d95e5ee3559d tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:16.227640 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b9f5184f-b25c-446f-ad4c-d95e5ee3559d tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:16.228567 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b9f5184f-b25c-446f-ad4c-d95e5ee3559d tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:16.229534 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b9f5184f-b25c-446f-ad4c-d95e5ee3559d tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:16.230203 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b9f5184f-b25c-446f-ad4c-d95e5ee3559d tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:16.236018 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b9f5184f-b25c-446f-ad4c-d95e5ee3559d tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:16.396825 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-8b51e827-9d27-403f-8c7f-3d491fdba05e tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:16.398034 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-8b51e827-9d27-403f-8c7f-3d491fdba05e tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] [instance: fc077a8b-c0f8-4bb1-8a39-91874ac015e7] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:16.407926 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8b51e827-9d27-403f-8c7f-3d491fdba05e tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:16.409014 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8b51e827-9d27-403f-8c7f-3d491fdba05e tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:16.409790 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8b51e827-9d27-403f-8c7f-3d491fdba05e tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:16.411476 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8b51e827-9d27-403f-8c7f-3d491fdba05e tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:16.413054 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8b51e827-9d27-403f-8c7f-3d491fdba05e tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:16.413966 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8b51e827-9d27-403f-8c7f-3d491fdba05e tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:16.545469 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-b9f5184f-b25c-446f-ad4c-d95e5ee3559d tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:16.556536 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-b9f5184f-b25c-446f-ad4c-d95e5ee3559d tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:16.563266 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-b9f5184f-b25c-446f-ad4c-d95e5ee3559d tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:16.564574 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-b9f5184f-b25c-446f-ad4c-d95e5ee3559d tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] 10.222.0.43 "GET /compute/v2.1/servers/fd5fe360-8ecf-41d0-9376-9d5533fc6ba8" status: 200 len: 1558 microversion: 2.25 time: 0.356903 Oct 04 18:33:16.565168 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 332/618] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:33:16 2022] GET /compute/v2.1/servers/fd5fe360-8ecf-41d0-9376-9d5533fc6ba8 => generated 1558 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:33:16.573820 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-e015919e-2e96-40fc-8573-c7d163f41991 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:16.574438 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-e015919e-2e96-40fc-8573-c7d163f41991 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] [instance: e5e92f30-937a-4ec2-b11f-336030c3d5c9] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:16.593914 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e015919e-2e96-40fc-8573-c7d163f41991 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:16.594425 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e015919e-2e96-40fc-8573-c7d163f41991 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:16.595268 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e015919e-2e96-40fc-8573-c7d163f41991 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:16.597974 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e015919e-2e96-40fc-8573-c7d163f41991 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:16.598769 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e015919e-2e96-40fc-8573-c7d163f41991 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:16.599425 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e015919e-2e96-40fc-8573-c7d163f41991 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:16.683898 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-8b51e827-9d27-403f-8c7f-3d491fdba05e tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7db99f361654711bea7f1b2c404d312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7adedcdb9c3485ea2738c00e25aa3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:16.699289 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-8b51e827-9d27-403f-8c7f-3d491fdba05e tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] 10.222.0.43 "GET /compute/v2.1/servers/fc077a8b-c0f8-4bb1-8a39-91874ac015e7" status: 200 len: 1316 microversion: 2.1 time: 0.305348 Oct 04 18:33:16.702365 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 287/619] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:16 2022] GET /compute/v2.1/servers/fc077a8b-c0f8-4bb1-8a39-91874ac015e7 => generated 1316 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:16.743039 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-e9f49df2-9619-49ac-aa6c-6c1d9b36bb17 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:16.744286 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-e9f49df2-9619-49ac-aa6c-6c1d9b36bb17 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] [instance: 84e0414b-a39f-4bfe-bc9d-c170ceb34d15] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:16.752555 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e9f49df2-9619-49ac-aa6c-6c1d9b36bb17 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:16.753374 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e9f49df2-9619-49ac-aa6c-6c1d9b36bb17 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:16.754980 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e9f49df2-9619-49ac-aa6c-6c1d9b36bb17 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:16.755945 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e9f49df2-9619-49ac-aa6c-6c1d9b36bb17 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:16.756958 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e9f49df2-9619-49ac-aa6c-6c1d9b36bb17 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:16.757674 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e9f49df2-9619-49ac-aa6c-6c1d9b36bb17 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:16.871215 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-e9f49df2-9619-49ac-aa6c-6c1d9b36bb17 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:16.888376 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-e9f49df2-9619-49ac-aa6c-6c1d9b36bb17 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:16.889913 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-e9f49df2-9619-49ac-aa6c-6c1d9b36bb17 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:16.898952 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-e9f49df2-9619-49ac-aa6c-6c1d9b36bb17 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] 10.222.0.43 "GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15" status: 200 len: 1537 microversion: 2.91 time: 0.193409 Oct 04 18:33:16.899738 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 288/620] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:33:16 2022] GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15 => generated 1537 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:33:17.016815 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-e015919e-2e96-40fc-8573-c7d163f41991 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb7b0ce49ec438f9a60b79bdb2ac164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94ae6e2cb75d410d8029aa49909c973b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:17.025874 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-e015919e-2e96-40fc-8573-c7d163f41991 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] 10.222.0.43 "GET /compute/v2.1/servers/e5e92f30-937a-4ec2-b11f-336030c3d5c9" status: 200 len: 1322 microversion: 2.1 time: 0.459661 Oct 04 18:33:17.026550 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 333/621] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:16 2022] GET /compute/v2.1/servers/e5e92f30-937a-4ec2-b11f-336030c3d5c9 => generated 1322 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:17.234135 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-73983ae9-0e2e-4220-a7f2-f0e4fcac58a7 tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:17.235156 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-73983ae9-0e2e-4220-a7f2-f0e4fcac58a7 tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] [instance: fd5fe360-8ecf-41d0-9376-9d5533fc6ba8] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:17.244456 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-73983ae9-0e2e-4220-a7f2-f0e4fcac58a7 tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:17.245279 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-73983ae9-0e2e-4220-a7f2-f0e4fcac58a7 tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:17.246127 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-73983ae9-0e2e-4220-a7f2-f0e4fcac58a7 tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:17.247102 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-73983ae9-0e2e-4220-a7f2-f0e4fcac58a7 tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:17.247925 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-73983ae9-0e2e-4220-a7f2-f0e4fcac58a7 tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:17.248798 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-73983ae9-0e2e-4220-a7f2-f0e4fcac58a7 tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:17.424945 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.objects.instance [None req-73983ae9-0e2e-4220-a7f2-f0e4fcac58a7 tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] Lazy-loading 'services' on Instance uuid fd5fe360-8ecf-41d0-9376-9d5533fc6ba8 {{(pid=123595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:33:17.440116 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-73983ae9-0e2e-4220-a7f2-f0e4fcac58a7 tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/fd5fe360-8ecf-41d0-9376-9d5533fc6ba8" status: 200 len: 2052 microversion: 2.25 time: 0.539256 Oct 04 18:33:17.441357 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 289/622] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:33:16 2022] GET /compute/v2.1/servers/fd5fe360-8ecf-41d0-9376-9d5533fc6ba8 => generated 2052 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:33:17.466258 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-46af7bfe-eb17-4f1d-b2e0-ed37f22c8c2f tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:17.467880 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-46af7bfe-eb17-4f1d-b2e0-ed37f22c8c2f tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] [instance: fd5fe360-8ecf-41d0-9376-9d5533fc6ba8] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:17.476657 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-46af7bfe-eb17-4f1d-b2e0-ed37f22c8c2f tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:17.477777 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-46af7bfe-eb17-4f1d-b2e0-ed37f22c8c2f tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:17.478223 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-46af7bfe-eb17-4f1d-b2e0-ed37f22c8c2f tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:17.479260 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-46af7bfe-eb17-4f1d-b2e0-ed37f22c8c2f tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:17.480086 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-46af7bfe-eb17-4f1d-b2e0-ed37f22c8c2f tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:17.480756 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-46af7bfe-eb17-4f1d-b2e0-ed37f22c8c2f tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:17.653487 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.objects.instance [None req-46af7bfe-eb17-4f1d-b2e0-ed37f22c8c2f tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] Lazy-loading 'services' on Instance uuid fd5fe360-8ecf-41d0-9376-9d5533fc6ba8 {{(pid=123596) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:33:17.672581 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-46af7bfe-eb17-4f1d-b2e0-ed37f22c8c2f tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/fd5fe360-8ecf-41d0-9376-9d5533fc6ba8" status: 200 len: 2052 microversion: 2.25 time: 0.210372 Oct 04 18:33:17.673841 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 334/623] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:33:17 2022] GET /compute/v2.1/servers/fd5fe360-8ecf-41d0-9376-9d5533fc6ba8 => generated 2052 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:33:17.700103 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-b0b1e713-480e-4db5-8331-a9454ecbeb94 tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:17.708912 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b0b1e713-480e-4db5-8331-a9454ecbeb94 tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:17.711703 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b0b1e713-480e-4db5-8331-a9454ecbeb94 tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:17.712361 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b0b1e713-480e-4db5-8331-a9454ecbeb94 tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:17.713436 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b0b1e713-480e-4db5-8331-a9454ecbeb94 tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:17.714051 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b0b1e713-480e-4db5-8331-a9454ecbeb94 tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:17.714672 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b0b1e713-480e-4db5-8331-a9454ecbeb94 tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:17.723852 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-91589b8e-5063-4839-abd8-6a23f57225eb tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:17.725403 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-91589b8e-5063-4839-abd8-6a23f57225eb tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] [instance: fc077a8b-c0f8-4bb1-8a39-91874ac015e7] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:17.733761 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-91589b8e-5063-4839-abd8-6a23f57225eb tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:17.737949 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-91589b8e-5063-4839-abd8-6a23f57225eb tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:17.738626 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-91589b8e-5063-4839-abd8-6a23f57225eb tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:17.739512 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-91589b8e-5063-4839-abd8-6a23f57225eb tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:17.739957 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-91589b8e-5063-4839-abd8-6a23f57225eb tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:17.740381 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-91589b8e-5063-4839-abd8-6a23f57225eb tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:17.778420 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-b0b1e713-480e-4db5-8331-a9454ecbeb94 tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] 10.222.0.43 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.082251 Oct 04 18:33:17.779154 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 290/624] 10.222.0.43 () {60 vars in 1217 bytes} [Tue Oct 4 18:33:17 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:33:17.793050 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-e3a7ad98-4635-4d76-84fe-3b67e90479c5 tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-851028-13", "block_migration": "auto"}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:33:17.795959 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-e3a7ad98-4635-4d76-84fe-3b67e90479c5 tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] [instance: fd5fe360-8ecf-41d0-9376-9d5533fc6ba8] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:17.804863 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e3a7ad98-4635-4d76-84fe-3b67e90479c5 tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:17.805625 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e3a7ad98-4635-4d76-84fe-3b67e90479c5 tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:17.806527 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e3a7ad98-4635-4d76-84fe-3b67e90479c5 tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:17.807475 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e3a7ad98-4635-4d76-84fe-3b67e90479c5 tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:17.808146 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e3a7ad98-4635-4d76-84fe-3b67e90479c5 tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:17.809679 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e3a7ad98-4635-4d76-84fe-3b67e90479c5 tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:17.933906 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.objects.instance [None req-e3a7ad98-4635-4d76-84fe-3b67e90479c5 tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] Lazy-loading 'flavor' on Instance uuid fd5fe360-8ecf-41d0-9376-9d5533fc6ba8 {{(pid=123595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:33:18.004143 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-e3a7ad98-4635-4d76-84fe-3b67e90479c5 tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] [instance: fd5fe360-8ecf-41d0-9376-9d5533fc6ba8] Going to try to live migrate instance to n-h2-851028-13 {{(pid=123595) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 04 18:33:18.037248 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-91589b8e-5063-4839-abd8-6a23f57225eb tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7db99f361654711bea7f1b2c404d312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7adedcdb9c3485ea2738c00e25aa3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:18.049069 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-91589b8e-5063-4839-abd8-6a23f57225eb tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] 10.222.0.43 "GET /compute/v2.1/servers/fc077a8b-c0f8-4bb1-8a39-91874ac015e7" status: 200 len: 1316 microversion: 2.1 time: 0.328827 Oct 04 18:33:18.050975 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 335/625] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:17 2022] GET /compute/v2.1/servers/fc077a8b-c0f8-4bb1-8a39-91874ac015e7 => generated 1316 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:33:18.059135 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-4ae1f733-4384-4873-9aec-5e98ce49e32e tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:18.064658 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-4ae1f733-4384-4873-9aec-5e98ce49e32e tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] [instance: 84e0414b-a39f-4bfe-bc9d-c170ceb34d15] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:18.073082 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4ae1f733-4384-4873-9aec-5e98ce49e32e tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:18.074207 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4ae1f733-4384-4873-9aec-5e98ce49e32e tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:18.081880 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4ae1f733-4384-4873-9aec-5e98ce49e32e tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:18.081880 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4ae1f733-4384-4873-9aec-5e98ce49e32e tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:18.081880 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4ae1f733-4384-4873-9aec-5e98ce49e32e tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:18.081880 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4ae1f733-4384-4873-9aec-5e98ce49e32e tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:18.187247 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-4ae1f733-4384-4873-9aec-5e98ce49e32e tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:18.201123 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-4ae1f733-4384-4873-9aec-5e98ce49e32e tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:18.203344 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-4ae1f733-4384-4873-9aec-5e98ce49e32e tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:18.209144 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-4ae1f733-4384-4873-9aec-5e98ce49e32e tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] 10.222.0.43 "GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15" status: 200 len: 1537 microversion: 2.91 time: 0.156301 Oct 04 18:33:18.221521 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 336/626] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:33:18 2022] GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15 => generated 1537 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:33:18.221521 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-ecaeefde-f8a6-4d5e-aaf7-545b2f63bc05 req-d1110172-10ab-4fda-aa88-d53c5cc63d89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc077a8b-c0f8-4bb1-8a39-91874ac015e7", "name": "network-vif-plugged", "status": "completed", "tag": "8aafc535-def4-4ec3-9e02-7b72095d1324"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:33:18.229355 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-ecaeefde-f8a6-4d5e-aaf7-545b2f63bc05 req-d1110172-10ab-4fda-aa88-d53c5cc63d89 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:18.229994 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-ecaeefde-f8a6-4d5e-aaf7-545b2f63bc05 req-d1110172-10ab-4fda-aa88-d53c5cc63d89 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:18.230445 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-ecaeefde-f8a6-4d5e-aaf7-545b2f63bc05 req-d1110172-10ab-4fda-aa88-d53c5cc63d89 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:18.244686 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-ecaeefde-f8a6-4d5e-aaf7-545b2f63bc05 req-d1110172-10ab-4fda-aa88-d53c5cc63d89 service nova] Creating event network-vif-plugged:8aafc535-def4-4ec3-9e02-7b72095d1324 for instance fc077a8b-c0f8-4bb1-8a39-91874ac015e7 on n-h2-851028-13 Oct 04 18:33:18.250429 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-ecaeefde-f8a6-4d5e-aaf7-545b2f63bc05 req-d1110172-10ab-4fda-aa88-d53c5cc63d89 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038812 Oct 04 18:33:18.251353 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 337/627] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:33:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:33:18.257574 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-924cdd9c-2edd-49b1-8003-58be0173201e tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:18.258291 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-924cdd9c-2edd-49b1-8003-58be0173201e tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] [instance: e5e92f30-937a-4ec2-b11f-336030c3d5c9] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:18.269176 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-924cdd9c-2edd-49b1-8003-58be0173201e tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:18.269692 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-924cdd9c-2edd-49b1-8003-58be0173201e tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:18.270142 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-924cdd9c-2edd-49b1-8003-58be0173201e tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:18.270872 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-924cdd9c-2edd-49b1-8003-58be0173201e tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:18.271327 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-924cdd9c-2edd-49b1-8003-58be0173201e tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:18.271791 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-924cdd9c-2edd-49b1-8003-58be0173201e tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:18.453592 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-924cdd9c-2edd-49b1-8003-58be0173201e tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb7b0ce49ec438f9a60b79bdb2ac164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94ae6e2cb75d410d8029aa49909c973b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:18.467117 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-924cdd9c-2edd-49b1-8003-58be0173201e tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] 10.222.0.43 "GET /compute/v2.1/servers/e5e92f30-937a-4ec2-b11f-336030c3d5c9" status: 200 len: 1471 microversion: 2.1 time: 0.214263 Oct 04 18:33:18.468883 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 338/628] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:18 2022] GET /compute/v2.1/servers/e5e92f30-937a-4ec2-b11f-336030c3d5c9 => generated 1471 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:18.503249 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-6b415d82-70df-4691-81e5-ab1324c68152 tempest-ServersAdminNegativeTestJSON-1726585348 tempest-ServersAdminNegativeTestJSON-1726585348-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:33:18.504562 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-6b415d82-70df-4691-81e5-ab1324c68152 tempest-ServersAdminNegativeTestJSON-1726585348 tempest-ServersAdminNegativeTestJSON-1726585348-project-admin] [instance: e5e92f30-937a-4ec2-b11f-336030c3d5c9] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:18.515773 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6b415d82-70df-4691-81e5-ab1324c68152 tempest-ServersAdminNegativeTestJSON-1726585348 tempest-ServersAdminNegativeTestJSON-1726585348-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:18.516517 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6b415d82-70df-4691-81e5-ab1324c68152 tempest-ServersAdminNegativeTestJSON-1726585348 tempest-ServersAdminNegativeTestJSON-1726585348-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:18.517296 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6b415d82-70df-4691-81e5-ab1324c68152 tempest-ServersAdminNegativeTestJSON-1726585348 tempest-ServersAdminNegativeTestJSON-1726585348-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:18.518724 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6b415d82-70df-4691-81e5-ab1324c68152 tempest-ServersAdminNegativeTestJSON-1726585348 tempest-ServersAdminNegativeTestJSON-1726585348-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:18.519717 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6b415d82-70df-4691-81e5-ab1324c68152 tempest-ServersAdminNegativeTestJSON-1726585348 tempest-ServersAdminNegativeTestJSON-1726585348-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:18.520464 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6b415d82-70df-4691-81e5-ab1324c68152 tempest-ServersAdminNegativeTestJSON-1726585348 tempest-ServersAdminNegativeTestJSON-1726585348-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:18.564832 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.objects.instance [None req-6b415d82-70df-4691-81e5-ab1324c68152 tempest-ServersAdminNegativeTestJSON-1726585348 tempest-ServersAdminNegativeTestJSON-1726585348-project-admin] Lazy-loading 'flavor' on Instance uuid e5e92f30-937a-4ec2-b11f-336030c3d5c9 {{(pid=123596) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:33:18.699727 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-6b415d82-70df-4691-81e5-ab1324c68152 tempest-ServersAdminNegativeTestJSON-1726585348 tempest-ServersAdminNegativeTestJSON-1726585348-project-admin] 10.222.0.43 "POST /compute/v2.1/servers/e5e92f30-937a-4ec2-b11f-336030c3d5c9/action" status: 202 len: 0 microversion: 2.1 time: 0.203047 Oct 04 18:33:18.701342 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 339/629] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 18:33:18 2022] POST /compute/v2.1/servers/e5e92f30-937a-4ec2-b11f-336030c3d5c9/action => generated 0 bytes in 212 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 18:33:18.719890 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-0cb46b5b-b2f0-4cbf-8564-0278aba0a06c tempest-ServersAdminNegativeTestJSON-1726585348 tempest-ServersAdminNegativeTestJSON-1726585348-project-admin] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:18.721081 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-0cb46b5b-b2f0-4cbf-8564-0278aba0a06c tempest-ServersAdminNegativeTestJSON-1726585348 tempest-ServersAdminNegativeTestJSON-1726585348-project-admin] [instance: e5e92f30-937a-4ec2-b11f-336030c3d5c9] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:18.729177 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=3 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:33:18.731341 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0cb46b5b-b2f0-4cbf-8564-0278aba0a06c tempest-ServersAdminNegativeTestJSON-1726585348 tempest-ServersAdminNegativeTestJSON-1726585348-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:18.732657 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0cb46b5b-b2f0-4cbf-8564-0278aba0a06c tempest-ServersAdminNegativeTestJSON-1726585348 tempest-ServersAdminNegativeTestJSON-1726585348-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:18.733508 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0cb46b5b-b2f0-4cbf-8564-0278aba0a06c tempest-ServersAdminNegativeTestJSON-1726585348 tempest-ServersAdminNegativeTestJSON-1726585348-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:18.734496 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0cb46b5b-b2f0-4cbf-8564-0278aba0a06c tempest-ServersAdminNegativeTestJSON-1726585348 tempest-ServersAdminNegativeTestJSON-1726585348-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:18.735696 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0cb46b5b-b2f0-4cbf-8564-0278aba0a06c tempest-ServersAdminNegativeTestJSON-1726585348 tempest-ServersAdminNegativeTestJSON-1726585348-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:18.736300 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0cb46b5b-b2f0-4cbf-8564-0278aba0a06c tempest-ServersAdminNegativeTestJSON-1726585348 tempest-ServersAdminNegativeTestJSON-1726585348-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:19.063743 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-0cb46b5b-b2f0-4cbf-8564-0278aba0a06c tempest-ServersAdminNegativeTestJSON-1726585348 tempest-ServersAdminNegativeTestJSON-1726585348-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/e5e92f30-937a-4ec2-b11f-336030c3d5c9" status: 200 len: 1632 microversion: 2.1 time: 0.348464 Oct 04 18:33:19.064344 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 340/630] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:18 2022] GET /compute/v2.1/servers/e5e92f30-937a-4ec2-b11f-336030c3d5c9 => generated 1632 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:19.089564 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-227d7953-2616-4899-a459-2d97b3ac2e83 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:19.091294 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-227d7953-2616-4899-a459-2d97b3ac2e83 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] [instance: fc077a8b-c0f8-4bb1-8a39-91874ac015e7] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:19.102239 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-227d7953-2616-4899-a459-2d97b3ac2e83 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:19.103173 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-227d7953-2616-4899-a459-2d97b3ac2e83 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:19.105016 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-227d7953-2616-4899-a459-2d97b3ac2e83 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:19.106904 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-227d7953-2616-4899-a459-2d97b3ac2e83 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:19.107716 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-227d7953-2616-4899-a459-2d97b3ac2e83 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:19.108224 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-227d7953-2616-4899-a459-2d97b3ac2e83 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:19.288001 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-227d7953-2616-4899-a459-2d97b3ac2e83 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7db99f361654711bea7f1b2c404d312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7adedcdb9c3485ea2738c00e25aa3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:19.289573 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-227d7953-2616-4899-a459-2d97b3ac2e83 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] 10.222.0.43 "GET /compute/v2.1/servers/fc077a8b-c0f8-4bb1-8a39-91874ac015e7" status: 200 len: 1316 microversion: 2.1 time: 0.211553 Oct 04 18:33:19.293744 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 341/631] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:19 2022] GET /compute/v2.1/servers/fc077a8b-c0f8-4bb1-8a39-91874ac015e7 => generated 1316 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:19.652622 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-4286e307-781f-4923-98de-1523fe6d1f14 tempest-KeyPairsV210TestJSON-1709615696 tempest-KeyPairsV210TestJSON-1709615696-project-admin] Action: 'create', calling method: .version_select at 0x7fb21ff35160>, body: {"keypair": {"name": "tempest-keypair-162563808", "type": "ssh", "user_id": "5f3877c47938413e8965bcfd5e6bf714", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMSerbOSbl9OaiMg1cNE66Y3YuHgI5v1+cTi+qyb82fFFEPI7Q8iFDBhmKduhz+JhbYbhC/xHFS+nKI8be/EKmKjELvuEpjoSnTcjscQB/d+NkfTMnDc6dfD+GQ1mALh7A=="}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:33:19.688494 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-4286e307-781f-4923-98de-1523fe6d1f14 tempest-KeyPairsV210TestJSON-1709615696 tempest-KeyPairsV210TestJSON-1709615696-project-admin] Getting quotas for project 9ee09c3e0e4342cf95fc7841aa5f64c9. Resources: {'key_pairs'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:33:19.696810 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-4286e307-781f-4923-98de-1523fe6d1f14 tempest-KeyPairsV210TestJSON-1709615696 tempest-KeyPairsV210TestJSON-1709615696-project-admin] Getting quotas for user 0f0a9c7d9ff24c59bce319aaf294315e and project 9ee09c3e0e4342cf95fc7841aa5f64c9. Resources: {'key_pairs'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:33:19.733591 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-4286e307-781f-4923-98de-1523fe6d1f14 tempest-KeyPairsV210TestJSON-1709615696 tempest-KeyPairsV210TestJSON-1709615696-project-admin] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.10 time: 0.436360 Oct 04 18:33:19.735870 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 342/632] 10.222.0.43 () {62 vars in 1200 bytes} [Tue Oct 4 18:33:19 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 442 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 04 18:33:19.741437 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-4842501b-25a4-4dbb-8b87-daa18bf7e7a4 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:19.742202 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-4842501b-25a4-4dbb-8b87-daa18bf7e7a4 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] [instance: 84e0414b-a39f-4bfe-bc9d-c170ceb34d15] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:19.761419 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4842501b-25a4-4dbb-8b87-daa18bf7e7a4 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:19.761922 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4842501b-25a4-4dbb-8b87-daa18bf7e7a4 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:19.762507 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4842501b-25a4-4dbb-8b87-daa18bf7e7a4 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:19.763230 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4842501b-25a4-4dbb-8b87-daa18bf7e7a4 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:19.763826 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4842501b-25a4-4dbb-8b87-daa18bf7e7a4 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:19.764261 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4842501b-25a4-4dbb-8b87-daa18bf7e7a4 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:19.849283 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-4842501b-25a4-4dbb-8b87-daa18bf7e7a4 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:19.858981 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-4842501b-25a4-4dbb-8b87-daa18bf7e7a4 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:19.860594 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-4842501b-25a4-4dbb-8b87-daa18bf7e7a4 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:19.866708 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-4842501b-25a4-4dbb-8b87-daa18bf7e7a4 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] 10.222.0.43 "GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15" status: 200 len: 1537 microversion: 2.91 time: 0.129269 Oct 04 18:33:19.867745 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 343/633] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:33:19 2022] GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15 => generated 1537 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:33:19.872797 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-76bedf94-e1b8-4681-a135-f96e08e64643 tempest-KeyPairsV210TestJSON-1709615696 tempest-KeyPairsV210TestJSON-1709615696-project-admin] Action: 'create', calling method: .version_select at 0x7fb22410b9d0>, body: {"keypair": {"name": "tempest-keypair-718913067", "type": "ssh", "user_id": "5f3877c47938413e8965bcfd5e6bf714", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHGPSDIuXFjb20A/AQXNIqhX9FWDoUfRZqGOP2jQXfzJ7N1wOigPWDkVqSD5/je4TGDztLaaJ0oM0y2xVUNaN8K0V1/+vIOKrG+9SCEWM5g9upby618r3AO+UBW2PCEXqQ=="}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:33:19.893382 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-76bedf94-e1b8-4681-a135-f96e08e64643 tempest-KeyPairsV210TestJSON-1709615696 tempest-KeyPairsV210TestJSON-1709615696-project-admin] Getting quotas for project 9ee09c3e0e4342cf95fc7841aa5f64c9. Resources: {'key_pairs'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:33:19.901690 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-76bedf94-e1b8-4681-a135-f96e08e64643 tempest-KeyPairsV210TestJSON-1709615696 tempest-KeyPairsV210TestJSON-1709615696-project-admin] Getting quotas for user 0f0a9c7d9ff24c59bce319aaf294315e and project 9ee09c3e0e4342cf95fc7841aa5f64c9. Resources: {'key_pairs'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:33:19.933146 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-76bedf94-e1b8-4681-a135-f96e08e64643 tempest-KeyPairsV210TestJSON-1709615696 tempest-KeyPairsV210TestJSON-1709615696-project-admin] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.10 time: 0.060994 Oct 04 18:33:19.933826 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 344/634] 10.222.0.43 () {62 vars in 1200 bytes} [Tue Oct 4 18:33:19 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 65 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 04 18:33:19.951323 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-d2c19df1-f15d-429b-8aaa-db193f2d58c0 tempest-KeyPairsV210TestJSON-1709615696 tempest-KeyPairsV210TestJSON-1709615696-project-admin] Calling method '.version_select at 0x7fb21fd54280>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:19.965924 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-d2c19df1-f15d-429b-8aaa-db193f2d58c0 tempest-KeyPairsV210TestJSON-1709615696 tempest-KeyPairsV210TestJSON-1709615696-project-admin] 10.222.0.43 "GET /compute/v2.1/os-keypairs/tempest-keypair-162563808?user_id=5f3877c47938413e8965bcfd5e6bf714" status: 200 len: 511 microversion: 2.10 time: 0.024772 Oct 04 18:33:19.968422 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 345/635] 10.222.0.43 () {60 vars in 1337 bytes} [Tue Oct 4 18:33:19 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-162563808?user_id=5f3877c47938413e8965bcfd5e6bf714 => generated 511 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 18:33:19.988931 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-3b4aa806-521a-49f3-a48c-cf98e59f278a tempest-KeyPairsV210TestJSON-1709615696 tempest-KeyPairsV210TestJSON-1709615696-project-admin] Action: 'create', calling method: .version_select at 0x7fb2240fbb80>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-1347830619", "type": "ssh", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBBKAKmtxQnuPRkoDaDkH0U0YDN2c44Iyxr6BIK9i9fauJvW26tw4J4pfspjPi+FLTZms4s53x4ZKOhhEnrWgUeaMLlnQhyCR0LMjZ87vmx147XImkmVgv0xRE24R9/TCw=="}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:33:20.007308 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-3b4aa806-521a-49f3-a48c-cf98e59f278a tempest-KeyPairsV210TestJSON-1709615696 tempest-KeyPairsV210TestJSON-1709615696-project-admin] Getting quotas for project 9ee09c3e0e4342cf95fc7841aa5f64c9. Resources: {'key_pairs'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:33:20.011704 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-3b4aa806-521a-49f3-a48c-cf98e59f278a tempest-KeyPairsV210TestJSON-1709615696 tempest-KeyPairsV210TestJSON-1709615696-project-admin] Getting quotas for user 0f0a9c7d9ff24c59bce319aaf294315e and project 9ee09c3e0e4342cf95fc7841aa5f64c9. Resources: {'key_pairs'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:33:20.058373 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-3b4aa806-521a-49f3-a48c-cf98e59f278a tempest-KeyPairsV210TestJSON-1709615696 tempest-KeyPairsV210TestJSON-1709615696-project-admin] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 201 len: 422 microversion: 2.10 time: 0.078635 Oct 04 18:33:20.059420 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 346/636] 10.222.0.43 () {62 vars in 1200 bytes} [Tue Oct 4 18:33:19 2022] POST /compute/v2.1/os-keypairs => generated 422 bytes in 81 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Oct 04 18:33:20.075225 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-82b89678-20e0-44ef-af13-e0b7411ba539 tempest-KeyPairsV210TestJSON-1709615696 tempest-KeyPairsV210TestJSON-1709615696-project-admin] Calling method '.version_select at 0x7fb22413e9d0>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:20.081095 n-d-851028-13 devstack@n-api.service[123596]: WARNING oslo_db.sqlalchemy.utils [None req-82b89678-20e0-44ef-af13-e0b7411ba539 tempest-KeyPairsV210TestJSON-1709615696 tempest-KeyPairsV210TestJSON-1709615696-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Oct 04 18:33:20.092392 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-82b89678-20e0-44ef-af13-e0b7411ba539 tempest-KeyPairsV210TestJSON-1709615696 tempest-KeyPairsV210TestJSON-1709615696-project-admin] 10.222.0.43 "GET /compute/v2.1/os-keypairs?user_id=5f3877c47938413e8965bcfd5e6bf714" status: 200 len: 724 microversion: 2.10 time: 0.025383 Oct 04 18:33:20.100461 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 347/637] 10.222.0.43 () {60 vars in 1259 bytes} [Tue Oct 4 18:33:20 2022] GET /compute/v2.1/os-keypairs?user_id=5f3877c47938413e8965bcfd5e6bf714 => generated 724 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:33:20.105385 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-0c284972-6537-4a6f-8291-3a5f88c33aa9 tempest-ServersAdminNegativeTestJSON-1726585348 tempest-ServersAdminNegativeTestJSON-1726585348-project-admin] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:20.106011 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-0c284972-6537-4a6f-8291-3a5f88c33aa9 tempest-ServersAdminNegativeTestJSON-1726585348 tempest-ServersAdminNegativeTestJSON-1726585348-project-admin] [instance: e5e92f30-937a-4ec2-b11f-336030c3d5c9] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:20.112147 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0c284972-6537-4a6f-8291-3a5f88c33aa9 tempest-ServersAdminNegativeTestJSON-1726585348 tempest-ServersAdminNegativeTestJSON-1726585348-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:20.112636 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0c284972-6537-4a6f-8291-3a5f88c33aa9 tempest-ServersAdminNegativeTestJSON-1726585348 tempest-ServersAdminNegativeTestJSON-1726585348-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:20.113078 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0c284972-6537-4a6f-8291-3a5f88c33aa9 tempest-ServersAdminNegativeTestJSON-1726585348 tempest-ServersAdminNegativeTestJSON-1726585348-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:20.113800 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0c284972-6537-4a6f-8291-3a5f88c33aa9 tempest-ServersAdminNegativeTestJSON-1726585348 tempest-ServersAdminNegativeTestJSON-1726585348-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:20.114250 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0c284972-6537-4a6f-8291-3a5f88c33aa9 tempest-ServersAdminNegativeTestJSON-1726585348 tempest-ServersAdminNegativeTestJSON-1726585348-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:20.114675 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0c284972-6537-4a6f-8291-3a5f88c33aa9 tempest-ServersAdminNegativeTestJSON-1726585348 tempest-ServersAdminNegativeTestJSON-1726585348-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:20.386512 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-0c284972-6537-4a6f-8291-3a5f88c33aa9 tempest-ServersAdminNegativeTestJSON-1726585348 tempest-ServersAdminNegativeTestJSON-1726585348-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/e5e92f30-937a-4ec2-b11f-336030c3d5c9" status: 200 len: 1615 microversion: 2.1 time: 0.284731 Oct 04 18:33:20.396150 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 348/638] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:20 2022] GET /compute/v2.1/servers/e5e92f30-937a-4ec2-b11f-336030c3d5c9 => generated 1615 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:20.423690 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-4007221e-968f-4366-b099-20b4e86a8e3d tempest-KeyPairsV210TestJSON-1709615696 tempest-KeyPairsV210TestJSON-1709615696-project-admin] Calling method '.version_select at 0x7fb21fe24e50>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:20.476502 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-4007221e-968f-4366-b099-20b4e86a8e3d tempest-KeyPairsV210TestJSON-1709615696 tempest-KeyPairsV210TestJSON-1709615696-project-admin] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1347830619" status: 204 len: 0 microversion: 2.10 time: 0.065715 Oct 04 18:33:20.479130 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 349/639] 10.222.0.43 () {60 vars in 1325 bytes} [Tue Oct 4 18:33:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1347830619 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 18:33:20.491665 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-1d50aa1d-9372-4064-9372-405ac6696899 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:20.493062 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-1d50aa1d-9372-4064-9372-405ac6696899 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] [instance: fc077a8b-c0f8-4bb1-8a39-91874ac015e7] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:20.503785 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1d50aa1d-9372-4064-9372-405ac6696899 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:20.505746 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1d50aa1d-9372-4064-9372-405ac6696899 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:20.506496 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1d50aa1d-9372-4064-9372-405ac6696899 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:20.508377 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1d50aa1d-9372-4064-9372-405ac6696899 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:20.509343 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1d50aa1d-9372-4064-9372-405ac6696899 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:20.510224 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1d50aa1d-9372-4064-9372-405ac6696899 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:20.715474 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-1d50aa1d-9372-4064-9372-405ac6696899 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7db99f361654711bea7f1b2c404d312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7adedcdb9c3485ea2738c00e25aa3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:20.726397 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-1d50aa1d-9372-4064-9372-405ac6696899 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] 10.222.0.43 "GET /compute/v2.1/servers/fc077a8b-c0f8-4bb1-8a39-91874ac015e7" status: 200 len: 1466 microversion: 2.1 time: 0.245198 Oct 04 18:33:20.726974 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 350/640] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:20 2022] GET /compute/v2.1/servers/fc077a8b-c0f8-4bb1-8a39-91874ac015e7 => generated 1466 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:20.820956 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-a9dc231c-c256-48ab-8c48-fe5bafb89bdf tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-1016402072", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452"}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:33:20.888057 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.network.neutron [None req-a9dc231c-c256-48ab-8c48-fe5bafb89bdf tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] validate_networks() for None {{(pid=123596) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:33:21.463676 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-a9dc231c-c256-48ab-8c48-fe5bafb89bdf tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Flavor limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:33:21.463676 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-a9dc231c-c256-48ab-8c48-fe5bafb89bdf tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Image limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:33:21.463676 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-a9dc231c-c256-48ab-8c48-fe5bafb89bdf tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Flavor pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:33:21.463676 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-a9dc231c-c256-48ab-8c48-fe5bafb89bdf tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Image pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:33:21.463676 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-a9dc231c-c256-48ab-8c48-fe5bafb89bdf tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:33:21.477803 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a9dc231c-c256-48ab-8c48-fe5bafb89bdf tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:21.478126 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a9dc231c-c256-48ab-8c48-fe5bafb89bdf tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:21.479225 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a9dc231c-c256-48ab-8c48-fe5bafb89bdf tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:21.479606 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a9dc231c-c256-48ab-8c48-fe5bafb89bdf tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:21.480328 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a9dc231c-c256-48ab-8c48-fe5bafb89bdf tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:21.480987 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a9dc231c-c256-48ab-8c48-fe5bafb89bdf tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:21.503022 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-a9dc231c-c256-48ab-8c48-fe5bafb89bdf tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Getting quotas for project 829069b2787a423f922fcc5b5702f167. Resources: {'ram', 'cores', 'instances'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:33:21.517431 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-a9dc231c-c256-48ab-8c48-fe5bafb89bdf tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Getting quotas for user c4aec5af742842f5bb2048c8b7d60687 and project 829069b2787a423f922fcc5b5702f167. Resources: {'ram', 'cores', 'instances'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:33:21.532602 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-a9dc231c-c256-48ab-8c48-fe5bafb89bdf tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Going to run 1 instances... {{(pid=123596) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:33:21.535969 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-a9dc231c-c256-48ab-8c48-fe5bafb89bdf tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] [instance: 101edf03-d928-461d-98cf-12753ae7f7d7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e8943ec5-4038-4d4b-b9b9-2415a79f5243',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123596) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:33:21.594766 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-a9dc231c-c256-48ab-8c48-fe5bafb89bdf tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.866470 Oct 04 18:33:21.596799 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 351/641] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 18:33:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 869 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:33:21.608652 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-7d78153b-60ab-4c97-86d4-75a6fddafdb6 tempest-ServersAdminNegativeTestJSON-1726585348 tempest-ServersAdminNegativeTestJSON-1726585348-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:33:21.609397 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-7d78153b-60ab-4c97-86d4-75a6fddafdb6 tempest-ServersAdminNegativeTestJSON-1726585348 tempest-ServersAdminNegativeTestJSON-1726585348-project-admin] [instance: e5e92f30-937a-4ec2-b11f-336030c3d5c9] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:21.620147 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7d78153b-60ab-4c97-86d4-75a6fddafdb6 tempest-ServersAdminNegativeTestJSON-1726585348 tempest-ServersAdminNegativeTestJSON-1726585348-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:21.620846 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7d78153b-60ab-4c97-86d4-75a6fddafdb6 tempest-ServersAdminNegativeTestJSON-1726585348 tempest-ServersAdminNegativeTestJSON-1726585348-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:21.621360 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7d78153b-60ab-4c97-86d4-75a6fddafdb6 tempest-ServersAdminNegativeTestJSON-1726585348 tempest-ServersAdminNegativeTestJSON-1726585348-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:21.622409 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7d78153b-60ab-4c97-86d4-75a6fddafdb6 tempest-ServersAdminNegativeTestJSON-1726585348 tempest-ServersAdminNegativeTestJSON-1726585348-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:21.623035 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7d78153b-60ab-4c97-86d4-75a6fddafdb6 tempest-ServersAdminNegativeTestJSON-1726585348 tempest-ServersAdminNegativeTestJSON-1726585348-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:21.623783 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7d78153b-60ab-4c97-86d4-75a6fddafdb6 tempest-ServersAdminNegativeTestJSON-1726585348 tempest-ServersAdminNegativeTestJSON-1726585348-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:21.762506 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-7d78153b-60ab-4c97-86d4-75a6fddafdb6 tempest-ServersAdminNegativeTestJSON-1726585348 tempest-ServersAdminNegativeTestJSON-1726585348-project-admin] HTTP exception thrown: Cannot 'migrate' instance e5e92f30-937a-4ec2-b11f-336030c3d5c9 while it is in vm_state suspended Oct 04 18:33:21.766075 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-7d78153b-60ab-4c97-86d4-75a6fddafdb6 tempest-ServersAdminNegativeTestJSON-1726585348 tempest-ServersAdminNegativeTestJSON-1726585348-project-admin] Request method failure captured: Oct 04 18:33:21.766075 n-d-851028-13 devstack@n-api.service[123596]: request: POST /compute/v2.1/servers/e5e92f30-937a-4ec2-b11f-336030c3d5c9/action HTTP/1.1 Oct 04 18:33:21.766075 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:33:21.766075 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:33:21.766075 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:33:21.766075 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 15 Oct 04 18:33:21.766075 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:33:21.766075 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:33:21.766075 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:33:21.766075 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:33:21.766075 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPHw0ZJknVIKo8ZjoLNI6-7bbAu2N1mk1vzqefdcJIov3FmHJO1WI5_1bqvex4ZF_ID-riViOhscotE3s2N8-73s4t7FmWOzCM97KlGqkxpVmDBHWnfU449Y1h-FN5HhindrA8dI_RNHOB9NciOFV32yhsgQpDN8Nc9rl_CtX3dHw4IU Oct 04 18:33:21.766075 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:33:21.766075 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:33:21.766075 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:33:21.766075 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:33:21.766075 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:33:21.766075 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:33:21.766075 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: b22715dc1edb4f63bb646f6bb187a8f8 Oct 04 18:33:21.766075 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1726585348 Oct 04 18:33:21.766075 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,admin,reader Oct 04 18:33:21.766075 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,admin,reader Oct 04 18:33:21.767904 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/b22715dc1edb4f63bb646f6bb187a8f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_b22715dc1edb4f63bb646f6bb187a8f8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b22715dc1edb4f63bb646f6bb187a8f8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b22715dc1edb4f63bb646f6bb187a8f8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:33:21.767904 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1726585348 Oct 04 18:33:21.767904 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: b22715dc1edb4f63bb646f6bb187a8f8 Oct 04 18:33:21.767904 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1726585348 Oct 04 18:33:21.767904 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-ServersAdminNegativeTestJSON-1726585348-project-admin Oct 04 18:33:21.767904 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:33:21.767904 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:33:21.767904 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 00ce12e8c6b649958005421bfe37ab11 Oct 04 18:33:21.767904 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1726585348-project-admin Oct 04 18:33:21.767904 n-d-851028-13 devstack@n-api.service[123596]: Oct 04 18:33:21.767904 n-d-851028-13 devstack@n-api.service[123596]: {"migrate": {}} Oct 04 18:33:21.767904 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 18:33:21.767904 n-d-851028-13 devstack@n-api.service[123596]: exception: Cannot 'migrate' instance e5e92f30-937a-4ec2-b11f-336030c3d5c9 while it is in vm_state suspended Oct 04 18:33:21.768974 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': 'e5e92f30-937a-4ec2-b11f-336030c3d5c9', 'body': {'migrate': {}}} Oct 04 18:33:21.768974 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:33:21.768974 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:33:21.768974 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Oct 04 18:33:21.768974 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Oct 04 18:33:21.768974 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 04 18:33:21.768974 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 18:33:21.768974 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 04 18:33:21.768974 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 04 18:33:21.768974 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 04 18:33:21.768974 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 04 18:33:21.768974 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 18:33:21.768974 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 18:33:21.768974 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 04 18:33:21.768974 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 04 18:33:21.768974 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance e5e92f30-937a-4ec2-b11f-336030c3d5c9 in vm_state suspended. Cannot resize while the instance is in this state. Oct 04 18:33:21.768974 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:33:21.768974 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:33:21.768974 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:33:21.768974 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:33:21.771743 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:33:21.771743 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:33:21.771743 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:33:21.771743 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:33:21.771743 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:33:21.771743 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:33:21.771743 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:33:21.771743 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:33:21.771743 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 69, in _migrate Oct 04 18:33:21.771743 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 04 18:33:21.771743 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 04 18:33:21.771743 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 04 18:33:21.771743 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'migrate' instance e5e92f30-937a-4ec2-b11f-336030c3d5c9 while it is in vm_state suspended Oct 04 18:33:21.771743 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:33:21.771743 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:33:21.771743 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:33:21.771743 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:33:21.771743 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:33:21.771743 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:33:21.774284 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:33:21.774284 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:33:21.774284 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'migrate' instance e5e92f30-937a-4ec2-b11f-336030c3d5c9 while it is in vm_state suspended Oct 04 18:33:21.774284 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:33:21.774284 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-7d78153b-60ab-4c97-86d4-75a6fddafdb6 tempest-ServersAdminNegativeTestJSON-1726585348 tempest-ServersAdminNegativeTestJSON-1726585348-project-admin] Returning 409 to user: Cannot 'migrate' instance e5e92f30-937a-4ec2-b11f-336030c3d5c9 while it is in vm_state suspended {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:33:21.774284 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-7d78153b-60ab-4c97-86d4-75a6fddafdb6 tempest-ServersAdminNegativeTestJSON-1726585348 tempest-ServersAdminNegativeTestJSON-1726585348-project-admin] 10.222.0.43 "POST /compute/v2.1/servers/e5e92f30-937a-4ec2-b11f-336030c3d5c9/action" status: 409 len: 148 microversion: 2.1 time: 0.166310 Oct 04 18:33:21.777562 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 352/642] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 18:33:21 2022] POST /compute/v2.1/servers/e5e92f30-937a-4ec2-b11f-336030c3d5c9/action => generated 148 bytes in 169 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:33:21.785184 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-9c3a90cd-bf7b-4a4f-a7ba-4a23d0ced4ba tempest-KeyPairsV210TestJSON-1709615696 tempest-KeyPairsV210TestJSON-1709615696-project-admin] Calling method '.version_select at 0x7fb21fd54430>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:21.810133 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-9c3a90cd-bf7b-4a4f-a7ba-4a23d0ced4ba tempest-KeyPairsV210TestJSON-1709615696 tempest-KeyPairsV210TestJSON-1709615696-project-admin] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-718913067?user_id=5f3877c47938413e8965bcfd5e6bf714" status: 204 len: 0 microversion: 2.10 time: 0.030980 Oct 04 18:33:21.811212 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 353/643] 10.222.0.43 () {60 vars in 1340 bytes} [Tue Oct 4 18:33:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-718913067?user_id=5f3877c47938413e8965bcfd5e6bf714 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 18:33:21.820112 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-2825bbfc-4dec-413c-90cc-236ae19d37f0 tempest-ServersOnMultiNodesTest-1245420526 tempest-ServersOnMultiNodesTest-1245420526-project-admin] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:21.820769 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-2825bbfc-4dec-413c-90cc-236ae19d37f0 tempest-ServersOnMultiNodesTest-1245420526 tempest-ServersOnMultiNodesTest-1245420526-project-admin] [instance: fc077a8b-c0f8-4bb1-8a39-91874ac015e7] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:21.829862 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2825bbfc-4dec-413c-90cc-236ae19d37f0 tempest-ServersOnMultiNodesTest-1245420526 tempest-ServersOnMultiNodesTest-1245420526-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:21.830754 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2825bbfc-4dec-413c-90cc-236ae19d37f0 tempest-ServersOnMultiNodesTest-1245420526 tempest-ServersOnMultiNodesTest-1245420526-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:21.831555 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2825bbfc-4dec-413c-90cc-236ae19d37f0 tempest-ServersOnMultiNodesTest-1245420526 tempest-ServersOnMultiNodesTest-1245420526-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:21.832768 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2825bbfc-4dec-413c-90cc-236ae19d37f0 tempest-ServersOnMultiNodesTest-1245420526 tempest-ServersOnMultiNodesTest-1245420526-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:21.833674 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2825bbfc-4dec-413c-90cc-236ae19d37f0 tempest-ServersOnMultiNodesTest-1245420526 tempest-ServersOnMultiNodesTest-1245420526-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:21.834320 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2825bbfc-4dec-413c-90cc-236ae19d37f0 tempest-ServersOnMultiNodesTest-1245420526 tempest-ServersOnMultiNodesTest-1245420526-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:21.863171 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:33:21.969220 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-e3a7ad98-4635-4d76-84fe-3b67e90479c5 tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] 10.222.0.43 "POST /compute/v2.1/servers/fd5fe360-8ecf-41d0-9376-9d5533fc6ba8/action" status: 202 len: 0 microversion: 2.25 time: 4.180053 Oct 04 18:33:21.969708 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 291/644] 10.222.0.43 () {62 vars in 1319 bytes} [Tue Oct 4 18:33:17 2022] POST /compute/v2.1/servers/fd5fe360-8ecf-41d0-9376-9d5533fc6ba8/action => generated 0 bytes in 4182 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 04 18:33:21.979834 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-7ce9ac98-2147-4037-bd15-b25cf4c55c56 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:21.980467 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-7ce9ac98-2147-4037-bd15-b25cf4c55c56 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] [instance: 84e0414b-a39f-4bfe-bc9d-c170ceb34d15] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:21.993060 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7ce9ac98-2147-4037-bd15-b25cf4c55c56 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:21.993867 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7ce9ac98-2147-4037-bd15-b25cf4c55c56 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:21.994485 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7ce9ac98-2147-4037-bd15-b25cf4c55c56 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:21.995562 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7ce9ac98-2147-4037-bd15-b25cf4c55c56 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:21.996025 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7ce9ac98-2147-4037-bd15-b25cf4c55c56 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:21.996457 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7ce9ac98-2147-4037-bd15-b25cf4c55c56 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:22.088775 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-7ce9ac98-2147-4037-bd15-b25cf4c55c56 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:22.106330 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-7ce9ac98-2147-4037-bd15-b25cf4c55c56 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:22.110209 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-7ce9ac98-2147-4037-bd15-b25cf4c55c56 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:22.121158 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=3 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:33:22.136055 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-7ce9ac98-2147-4037-bd15-b25cf4c55c56 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] 10.222.0.43 "GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15" status: 200 len: 1537 microversion: 2.91 time: 0.160786 Oct 04 18:33:22.153879 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 292/645] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:33:21 2022] GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15 => generated 1537 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:33:22.164410 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-2825bbfc-4dec-413c-90cc-236ae19d37f0 tempest-ServersOnMultiNodesTest-1245420526 tempest-ServersOnMultiNodesTest-1245420526-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/fc077a8b-c0f8-4bb1-8a39-91874ac015e7" status: 200 len: 1619 microversion: 2.1 time: 0.351349 Oct 04 18:33:22.175524 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 354/646] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:21 2022] GET /compute/v2.1/servers/fc077a8b-c0f8-4bb1-8a39-91874ac015e7 => generated 1619 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:22.177618 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-19d9e266-d4a4-4a95-9276-7f3fd814af61 tempest-ServersAdminNegativeTestJSON-1726585348 tempest-ServersAdminNegativeTestJSON-1726585348-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:33:22.181629 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-19d9e266-d4a4-4a95-9276-7f3fd814af61 tempest-ServersAdminNegativeTestJSON-1726585348 tempest-ServersAdminNegativeTestJSON-1726585348-project-admin] Request method failure captured: Oct 04 18:33:22.181629 n-d-851028-13 devstack@n-api.service[123596]: request: POST /compute/v2.1/servers/918d6106-9c7c-4046-9cdd-319afe4cdb25/action HTTP/1.1 Oct 04 18:33:22.181629 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:33:22.181629 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:33:22.181629 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:33:22.181629 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 39 Oct 04 18:33:22.181629 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:33:22.181629 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:33:22.181629 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:33:22.181629 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:33:22.181629 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPHw0ZJknVIKo8ZjoLNI6-7bbAu2N1mk1vzqefdcJIov3FmHJO1WI5_1bqvex4ZF_ID-riViOhscotE3s2N8-73s4t7FmWOzCM97KlGqkxpVmDBHWnfU449Y1h-FN5HhindrA8dI_RNHOB9NciOFV32yhsgQpDN8Nc9rl_CtX3dHw4IU Oct 04 18:33:22.181629 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:33:22.181629 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:33:22.181629 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:33:22.181629 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:33:22.181629 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:33:22.181629 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:33:22.181629 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: b22715dc1edb4f63bb646f6bb187a8f8 Oct 04 18:33:22.181629 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1726585348 Oct 04 18:33:22.181629 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,admin,reader Oct 04 18:33:22.181629 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,admin,reader Oct 04 18:33:22.184361 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/b22715dc1edb4f63bb646f6bb187a8f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_b22715dc1edb4f63bb646f6bb187a8f8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b22715dc1edb4f63bb646f6bb187a8f8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b22715dc1edb4f63bb646f6bb187a8f8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:33:22.184361 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1726585348 Oct 04 18:33:22.184361 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: b22715dc1edb4f63bb646f6bb187a8f8 Oct 04 18:33:22.184361 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1726585348 Oct 04 18:33:22.184361 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-ServersAdminNegativeTestJSON-1726585348-project-admin Oct 04 18:33:22.184361 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:33:22.184361 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:33:22.184361 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 00ce12e8c6b649958005421bfe37ab11 Oct 04 18:33:22.184361 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1726585348-project-admin Oct 04 18:33:22.184361 n-d-851028-13 devstack@n-api.service[123596]: Oct 04 18:33:22.184361 n-d-851028-13 devstack@n-api.service[123596]: {"os-resetState": {"state": "invalid"}} Oct 04 18:33:22.184361 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 18:33:22.185835 n-d-851028-13 devstack@n-api.service[123596]: exception: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 04 18:33:22.185835 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': '918d6106-9c7c-4046-9cdd-319afe4cdb25', 'body': {'os-resetState': {'state': 'invalid'}}} Oct 04 18:33:22.185835 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:33:22.185835 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:33:22.185835 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:33:22.185835 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:33:22.185835 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:33:22.185835 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:33:22.185835 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['active', 'error'] Oct 04 18:33:22.185835 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:33:22.185835 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['os-resetState']['properties']['state']: Oct 04 18:33:22.185835 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Oct 04 18:33:22.185835 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:33:22.185835 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Oct 04 18:33:22.185835 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi 'invalid' Oct 04 18:33:22.185835 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:33:22.185835 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:33:22.185835 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:33:22.185835 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:33:22.185835 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:33:22.185835 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:33:22.185835 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:33:22.188447 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:33:22.188447 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:33:22.188447 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:33:22.188447 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 18:33:22.188447 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 18:33:22.188447 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:33:22.188447 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:33:22.188447 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:33:22.188447 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:33:22.188447 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 04 18:33:22.188447 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:33:22.188447 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:33:22.188447 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:33:22.188447 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:33:22.188447 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:33:22.188447 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:33:22.188447 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:33:22.188447 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:33:22.188447 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 04 18:33:22.195422 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:33:22.195422 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-19d9e266-d4a4-4a95-9276-7f3fd814af61 tempest-ServersAdminNegativeTestJSON-1726585348 tempest-ServersAdminNegativeTestJSON-1726585348-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:33:22.195422 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-19d9e266-d4a4-4a95-9276-7f3fd814af61 tempest-ServersAdminNegativeTestJSON-1726585348 tempest-ServersAdminNegativeTestJSON-1726585348-project-admin] 10.222.0.43 "POST /compute/v2.1/servers/918d6106-9c7c-4046-9cdd-319afe4cdb25/action" status: 400 len: 144 microversion: 2.1 time: 0.021474 Oct 04 18:33:22.196201 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-3b3ab53f-4535-4a26-9b3f-bb1461590f5c tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:22.196201 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-3b3ab53f-4535-4a26-9b3f-bb1461590f5c tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] [instance: 101edf03-d928-461d-98cf-12753ae7f7d7] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:22.198157 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 355/647] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 18:33:22 2022] POST /compute/v2.1/servers/918d6106-9c7c-4046-9cdd-319afe4cdb25/action => generated 144 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:33:22.202396 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-c85c7cb4-48f9-46bb-b6cf-64ae675c9526 tempest-KeyPairsV210TestJSON-1709615696 tempest-KeyPairsV210TestJSON-1709615696-project-admin] Calling method '.version_select at 0x7fb21fdbc310>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:22.225783 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-c85c7cb4-48f9-46bb-b6cf-64ae675c9526 tempest-KeyPairsV210TestJSON-1709615696 tempest-KeyPairsV210TestJSON-1709615696-project-admin] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-162563808?user_id=5f3877c47938413e8965bcfd5e6bf714" status: 204 len: 0 microversion: 2.10 time: 0.027314 Oct 04 18:33:22.232436 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 356/648] 10.222.0.43 () {60 vars in 1340 bytes} [Tue Oct 4 18:33:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-162563808?user_id=5f3877c47938413e8965bcfd5e6bf714 => generated 0 bytes in 29 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 18:33:22.239632 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-567c2b74-b428-44cc-aa5f-ce7c912f548a tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:22.240114 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-567c2b74-b428-44cc-aa5f-ce7c912f548a tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] [instance: fd5fe360-8ecf-41d0-9376-9d5533fc6ba8] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:22.248571 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-567c2b74-b428-44cc-aa5f-ce7c912f548a tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:22.249352 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-567c2b74-b428-44cc-aa5f-ce7c912f548a tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:22.249809 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-567c2b74-b428-44cc-aa5f-ce7c912f548a tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:22.250625 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-567c2b74-b428-44cc-aa5f-ce7c912f548a tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:22.252154 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-567c2b74-b428-44cc-aa5f-ce7c912f548a tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:22.252924 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-567c2b74-b428-44cc-aa5f-ce7c912f548a tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:22.335707 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-3b3ab53f-4535-4a26-9b3f-bb1461590f5c tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4aec5af742842f5bb2048c8b7d60687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829069b2787a423f922fcc5b5702f167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:22.352606 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-3b3ab53f-4535-4a26-9b3f-bb1461590f5c tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] 10.222.0.43 "GET /compute/v2.1/servers/101edf03-d928-461d-98cf-12753ae7f7d7" status: 200 len: 1219 microversion: 2.1 time: 0.197311 Oct 04 18:33:22.357496 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 293/649] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:22 2022] GET /compute/v2.1/servers/101edf03-d928-461d-98cf-12753ae7f7d7 => generated 1219 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:22.377499 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-37c9caab-1998-46dc-990b-9d9880389a7c tempest-ServersAdminNegativeTestJSON-1726585348 tempest-ServersAdminNegativeTestJSON-1726585348-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:33:22.391007 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-37c9caab-1998-46dc-990b-9d9880389a7c tempest-ServersAdminNegativeTestJSON-1726585348 tempest-ServersAdminNegativeTestJSON-1726585348-project-admin] Request method failure captured: Oct 04 18:33:22.391007 n-d-851028-13 devstack@n-api.service[123595]: request: POST /compute/v2.1/servers/918d6106-9c7c-4046-9cdd-319afe4cdb25/action HTTP/1.1 Oct 04 18:33:22.391007 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 18:33:22.391007 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 18:33:22.391007 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 18:33:22.391007 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 31 Oct 04 18:33:22.391007 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 18:33:22.391007 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 18:33:22.391007 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 18:33:22.391007 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 18:33:22.391007 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPHw0ZJknVIKo8ZjoLNI6-7bbAu2N1mk1vzqefdcJIov3FmHJO1WI5_1bqvex4ZF_ID-riViOhscotE3s2N8-73s4t7FmWOzCM97KlGqkxpVmDBHWnfU449Y1h-FN5HhindrA8dI_RNHOB9NciOFV32yhsgQpDN8Nc9rl_CtX3dHw4IU Oct 04 18:33:22.391007 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 18:33:22.391007 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 18:33:22.391007 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 18:33:22.391007 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 18:33:22.391007 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 18:33:22.391007 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 18:33:22.391007 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: b22715dc1edb4f63bb646f6bb187a8f8 Oct 04 18:33:22.391007 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1726585348 Oct 04 18:33:22.391007 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,admin,reader Oct 04 18:33:22.391007 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,admin,reader Oct 04 18:33:22.392727 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/b22715dc1edb4f63bb646f6bb187a8f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_b22715dc1edb4f63bb646f6bb187a8f8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b22715dc1edb4f63bb646f6bb187a8f8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b22715dc1edb4f63bb646f6bb187a8f8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:33:22.392727 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1726585348 Oct 04 18:33:22.392727 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: b22715dc1edb4f63bb646f6bb187a8f8 Oct 04 18:33:22.392727 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1726585348 Oct 04 18:33:22.392727 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-ServersAdminNegativeTestJSON-1726585348-project-admin Oct 04 18:33:22.392727 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 18:33:22.392727 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 18:33:22.392727 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: 00ce12e8c6b649958005421bfe37ab11 Oct 04 18:33:22.392727 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1726585348-project-admin Oct 04 18:33:22.392727 n-d-851028-13 devstack@n-api.service[123595]: Oct 04 18:33:22.392727 n-d-851028-13 devstack@n-api.service[123595]: {"os-resetState": {"state": 1}} Oct 04 18:33:22.392727 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 18:33:22.392727 n-d-851028-13 devstack@n-api.service[123595]: exception: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 04 18:33:22.393733 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': '918d6106-9c7c-4046-9cdd-319afe4cdb25', 'body': {'os-resetState': {'state': 1}}} Oct 04 18:33:22.393733 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:33:22.393733 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:33:22.393733 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:33:22.393733 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:33:22.393733 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:33:22.393733 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:33:22.393733 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 1 is not of type 'string' Oct 04 18:33:22.393733 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:33:22.393733 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['os-resetState']['properties']['state']: Oct 04 18:33:22.393733 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Oct 04 18:33:22.393733 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:33:22.393733 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Oct 04 18:33:22.393733 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi 1 Oct 04 18:33:22.393733 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:33:22.393733 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:33:22.393733 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:33:22.393733 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:33:22.393733 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:33:22.393733 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:33:22.393733 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:33:22.393733 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:33:22.395850 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:33:22.395850 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:33:22.395850 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 18:33:22.395850 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 18:33:22.395850 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:33:22.395850 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:33:22.395850 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:33:22.395850 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:33:22.395850 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 04 18:33:22.395850 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:33:22.395850 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:33:22.395850 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:33:22.395850 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:33:22.395850 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:33:22.395850 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:33:22.395850 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:33:22.395850 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:33:22.395850 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 04 18:33:22.395850 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:33:22.397967 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-37c9caab-1998-46dc-990b-9d9880389a7c tempest-ServersAdminNegativeTestJSON-1726585348 tempest-ServersAdminNegativeTestJSON-1726585348-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:33:22.397967 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-37c9caab-1998-46dc-990b-9d9880389a7c tempest-ServersAdminNegativeTestJSON-1726585348 tempest-ServersAdminNegativeTestJSON-1726585348-project-admin] 10.222.0.43 "POST /compute/v2.1/servers/918d6106-9c7c-4046-9cdd-319afe4cdb25/action" status: 400 len: 120 microversion: 2.1 time: 0.037285 Oct 04 18:33:22.406782 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 294/650] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 18:33:22 2022] POST /compute/v2.1/servers/918d6106-9c7c-4046-9cdd-319afe4cdb25/action => generated 120 bytes in 48 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:33:22.418599 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-0e12ea2c-d0d4-4707-b6d1-9ba998086786 tempest-ServersAdminNegativeTestJSON-1726585348 tempest-ServersAdminNegativeTestJSON-1726585348-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:33:22.423588 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-0e12ea2c-d0d4-4707-b6d1-9ba998086786 tempest-ServersAdminNegativeTestJSON-1726585348 tempest-ServersAdminNegativeTestJSON-1726585348-project-admin] Failed to fetch instance by id 999 {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 04 18:33:22.424418 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-0e12ea2c-d0d4-4707-b6d1-9ba998086786 tempest-ServersAdminNegativeTestJSON-1726585348 tempest-ServersAdminNegativeTestJSON-1726585348-project-admin] HTTP exception thrown: Instance 999 could not be found. Oct 04 18:33:22.427136 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-0e12ea2c-d0d4-4707-b6d1-9ba998086786 tempest-ServersAdminNegativeTestJSON-1726585348 tempest-ServersAdminNegativeTestJSON-1726585348-project-admin] Request method failure captured: Oct 04 18:33:22.427136 n-d-851028-13 devstack@n-api.service[123595]: request: POST /compute/v2.1/servers/999/action HTTP/1.1 Oct 04 18:33:22.427136 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 18:33:22.427136 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 18:33:22.427136 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 18:33:22.427136 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 37 Oct 04 18:33:22.427136 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 18:33:22.427136 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 18:33:22.427136 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 18:33:22.427136 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 18:33:22.427136 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPHw0ZJknVIKo8ZjoLNI6-7bbAu2N1mk1vzqefdcJIov3FmHJO1WI5_1bqvex4ZF_ID-riViOhscotE3s2N8-73s4t7FmWOzCM97KlGqkxpVmDBHWnfU449Y1h-FN5HhindrA8dI_RNHOB9NciOFV32yhsgQpDN8Nc9rl_CtX3dHw4IU Oct 04 18:33:22.427136 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 18:33:22.427136 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 18:33:22.427136 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 18:33:22.427136 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 18:33:22.427136 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 18:33:22.427136 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 18:33:22.427136 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: b22715dc1edb4f63bb646f6bb187a8f8 Oct 04 18:33:22.427136 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1726585348 Oct 04 18:33:22.427136 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,admin,reader Oct 04 18:33:22.427136 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,admin,reader Oct 04 18:33:22.429527 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/b22715dc1edb4f63bb646f6bb187a8f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_b22715dc1edb4f63bb646f6bb187a8f8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b22715dc1edb4f63bb646f6bb187a8f8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b22715dc1edb4f63bb646f6bb187a8f8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:33:22.429527 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1726585348 Oct 04 18:33:22.429527 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: b22715dc1edb4f63bb646f6bb187a8f8 Oct 04 18:33:22.429527 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1726585348 Oct 04 18:33:22.429527 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-ServersAdminNegativeTestJSON-1726585348-project-admin Oct 04 18:33:22.429527 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 18:33:22.429527 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 18:33:22.429527 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: 00ce12e8c6b649958005421bfe37ab11 Oct 04 18:33:22.429527 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1726585348-project-admin Oct 04 18:33:22.429527 n-d-851028-13 devstack@n-api.service[123595]: Oct 04 18:33:22.429527 n-d-851028-13 devstack@n-api.service[123595]: {"os-resetState": {"state": "error"}} Oct 04 18:33:22.429527 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 18:33:22.429527 n-d-851028-13 devstack@n-api.service[123595]: exception: Instance 999 could not be found. Oct 04 18:33:22.430507 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': '999', 'body': {'os-resetState': {'state': 'error'}}} Oct 04 18:33:22.430507 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:33:22.430507 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:33:22.430507 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:33:22.430507 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:33:22.430507 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 04 18:33:22.430507 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 04 18:33:22.430507 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Oct 04 18:33:22.430507 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:33:22.430507 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:33:22.430507 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:33:22.430507 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:33:22.430507 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:33:22.430507 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:33:22.430507 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:33:22.430507 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:33:22.430507 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:33:22.430507 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:33:22.430507 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:33:22.430507 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:33:22.430507 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/admin_actions.py", line 66, in _reset_state Oct 04 18:33:22.432087 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 04 18:33:22.432087 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:33:22.432087 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:33:22.432087 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Oct 04 18:33:22.432087 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:33:22.432087 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:33:22.432087 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:33:22.432087 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:33:22.432087 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:33:22.432087 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:33:22.432087 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:33:22.432087 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:33:22.432087 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Oct 04 18:33:22.432087 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:33:22.436097 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-0e12ea2c-d0d4-4707-b6d1-9ba998086786 tempest-ServersAdminNegativeTestJSON-1726585348 tempest-ServersAdminNegativeTestJSON-1726585348-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:33:22.437372 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-0e12ea2c-d0d4-4707-b6d1-9ba998086786 tempest-ServersAdminNegativeTestJSON-1726585348 tempest-ServersAdminNegativeTestJSON-1726585348-project-admin] 10.222.0.43 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.029354 Oct 04 18:33:22.439494 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 295/651] 10.222.0.43 () {60 vars in 1179 bytes} [Tue Oct 4 18:33:22 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:33:22.458736 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-8b7ead92-6972-486b-b003-016491e38308 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:22.460071 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-8b7ead92-6972-486b-b003-016491e38308 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] [instance: e5e92f30-937a-4ec2-b11f-336030c3d5c9] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:22.471904 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8b7ead92-6972-486b-b003-016491e38308 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:22.474943 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8b7ead92-6972-486b-b003-016491e38308 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:22.475399 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8b7ead92-6972-486b-b003-016491e38308 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:22.476126 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8b7ead92-6972-486b-b003-016491e38308 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:22.476668 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8b7ead92-6972-486b-b003-016491e38308 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:22.477010 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8b7ead92-6972-486b-b003-016491e38308 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:22.484104 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:33:22.538957 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-8b7ead92-6972-486b-b003-016491e38308 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] [instance: e5e92f30-937a-4ec2-b11f-336030c3d5c9] Going to try to terminate instance {{(pid=123595) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:33:22.689765 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-8b7ead92-6972-486b-b003-016491e38308 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] 10.222.0.43 "DELETE /compute/v2.1/servers/e5e92f30-937a-4ec2-b11f-336030c3d5c9" status: 204 len: 0 microversion: 2.1 time: 0.241082 Oct 04 18:33:22.697052 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 296/652] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 18:33:22 2022] DELETE /compute/v2.1/servers/e5e92f30-937a-4ec2-b11f-336030c3d5c9 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:33:22.712873 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-91a925b1-5889-4a72-bf64-787285639eff tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1880281833", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["b36499e0-9405-4153-a581-13c1bd9d43eb"]}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:33:22.767664 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-567c2b74-b428-44cc-aa5f-ce7c912f548a tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:22.810921 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-567c2b74-b428-44cc-aa5f-ce7c912f548a tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:22.816225 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-567c2b74-b428-44cc-aa5f-ce7c912f548a tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:22.832844 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-567c2b74-b428-44cc-aa5f-ce7c912f548a tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] 10.222.0.43 "GET /compute/v2.1/servers/fd5fe360-8ecf-41d0-9376-9d5533fc6ba8" status: 200 len: 1568 microversion: 2.25 time: 0.595642 Oct 04 18:33:22.837648 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 357/653] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:33:22 2022] GET /compute/v2.1/servers/fd5fe360-8ecf-41d0-9376-9d5533fc6ba8 => generated 1568 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:33:22.838664 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.network.neutron [None req-91a925b1-5889-4a72-bf64-787285639eff tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] validate_networks() for None {{(pid=123595) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:33:22.867994 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-d1c86569-6cf6-4904-b949-df2799aa9f93 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:22.870037 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-d1c86569-6cf6-4904-b949-df2799aa9f93 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] [instance: e5e92f30-937a-4ec2-b11f-336030c3d5c9] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:22.880137 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d1c86569-6cf6-4904-b949-df2799aa9f93 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:22.882339 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d1c86569-6cf6-4904-b949-df2799aa9f93 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:22.883041 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d1c86569-6cf6-4904-b949-df2799aa9f93 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:22.884010 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d1c86569-6cf6-4904-b949-df2799aa9f93 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:22.884705 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d1c86569-6cf6-4904-b949-df2799aa9f93 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:22.885418 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d1c86569-6cf6-4904-b949-df2799aa9f93 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:23.419089 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-91a925b1-5889-4a72-bf64-787285639eff tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Flavor limits 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:33:23.420168 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-91a925b1-5889-4a72-bf64-787285639eff tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Image limits 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:33:23.420843 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-91a925b1-5889-4a72-bf64-787285639eff tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Flavor pref 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:33:23.421450 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-91a925b1-5889-4a72-bf64-787285639eff tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Image pref 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:33:23.422390 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-91a925b1-5889-4a72-bf64-787285639eff tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:33:23.443134 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-91a925b1-5889-4a72-bf64-787285639eff tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:23.444161 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-91a925b1-5889-4a72-bf64-787285639eff tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:23.444683 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-91a925b1-5889-4a72-bf64-787285639eff tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:23.445374 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-91a925b1-5889-4a72-bf64-787285639eff tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:23.448228 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-91a925b1-5889-4a72-bf64-787285639eff tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:23.448906 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-91a925b1-5889-4a72-bf64-787285639eff tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:23.514146 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-91a925b1-5889-4a72-bf64-787285639eff tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Getting quotas for project e7adedcdb9c3485ea2738c00e25aa3fd. Resources: {'ram', 'cores', 'instances'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:33:23.522897 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-91a925b1-5889-4a72-bf64-787285639eff tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Getting quotas for user a7db99f361654711bea7f1b2c404d312 and project e7adedcdb9c3485ea2738c00e25aa3fd. Resources: {'ram', 'cores', 'instances'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:33:23.547695 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-91a925b1-5889-4a72-bf64-787285639eff tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Going to run 1 instances... {{(pid=123595) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:33:23.553160 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-91a925b1-5889-4a72-bf64-787285639eff tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] [instance: 8408d8e1-41b0-4185-8806-9808f082a016] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e8943ec5-4038-4d4b-b9b9-2415a79f5243',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:33:23.642721 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-91a925b1-5889-4a72-bf64-787285639eff tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.943098 Oct 04 18:33:23.643947 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 297/654] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 18:33:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 946 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:33:23.650432 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-f327beb7-f126-45c1-a250-9958a7fed3cd tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:23.651907 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-f327beb7-f126-45c1-a250-9958a7fed3cd tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] [instance: 84e0414b-a39f-4bfe-bc9d-c170ceb34d15] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:23.666805 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f327beb7-f126-45c1-a250-9958a7fed3cd tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:23.667300 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f327beb7-f126-45c1-a250-9958a7fed3cd tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:23.669765 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f327beb7-f126-45c1-a250-9958a7fed3cd tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:23.672332 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f327beb7-f126-45c1-a250-9958a7fed3cd tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:23.675523 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f327beb7-f126-45c1-a250-9958a7fed3cd tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:23.675989 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f327beb7-f126-45c1-a250-9958a7fed3cd tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:23.749370 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-d1c86569-6cf6-4904-b949-df2799aa9f93 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb7b0ce49ec438f9a60b79bdb2ac164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94ae6e2cb75d410d8029aa49909c973b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:23.771134 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-d1c86569-6cf6-4904-b949-df2799aa9f93 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] 10.222.0.43 "GET /compute/v2.1/servers/e5e92f30-937a-4ec2-b11f-336030c3d5c9" status: 200 len: 1468 microversion: 2.1 time: 0.929162 Oct 04 18:33:23.772764 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 358/655] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:22 2022] GET /compute/v2.1/servers/e5e92f30-937a-4ec2-b11f-336030c3d5c9 => generated 1468 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:23.791153 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-23876300-8bc1-4a48-b2b1-c846090bb37b tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:23.791878 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-23876300-8bc1-4a48-b2b1-c846090bb37b tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] [instance: 101edf03-d928-461d-98cf-12753ae7f7d7] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:23.800093 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-23876300-8bc1-4a48-b2b1-c846090bb37b tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:23.800850 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-23876300-8bc1-4a48-b2b1-c846090bb37b tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:23.801854 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-23876300-8bc1-4a48-b2b1-c846090bb37b tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:23.804396 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-23876300-8bc1-4a48-b2b1-c846090bb37b tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:23.805361 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-23876300-8bc1-4a48-b2b1-c846090bb37b tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:23.806153 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-23876300-8bc1-4a48-b2b1-c846090bb37b tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:23.883839 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-f327beb7-f126-45c1-a250-9958a7fed3cd tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:23.895785 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-f327beb7-f126-45c1-a250-9958a7fed3cd tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:23.899778 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-f327beb7-f126-45c1-a250-9958a7fed3cd tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:23.913314 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-f327beb7-f126-45c1-a250-9958a7fed3cd tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] 10.222.0.43 "GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15" status: 200 len: 1537 microversion: 2.91 time: 0.267769 Oct 04 18:33:23.916344 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 298/656] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:33:23 2022] GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15 => generated 1537 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:33:23.924140 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-7e73e285-45cc-4a7a-9de7-c375a6b14a44 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:23.925172 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-7e73e285-45cc-4a7a-9de7-c375a6b14a44 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] [instance: 8408d8e1-41b0-4185-8806-9808f082a016] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:23.950284 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-23876300-8bc1-4a48-b2b1-c846090bb37b tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4aec5af742842f5bb2048c8b7d60687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829069b2787a423f922fcc5b5702f167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:23.973298 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-23876300-8bc1-4a48-b2b1-c846090bb37b tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] 10.222.0.43 "GET /compute/v2.1/servers/101edf03-d928-461d-98cf-12753ae7f7d7" status: 200 len: 1271 microversion: 2.1 time: 0.198540 Oct 04 18:33:23.990609 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 359/657] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:23 2022] GET /compute/v2.1/servers/101edf03-d928-461d-98cf-12753ae7f7d7 => generated 1271 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:23.990609 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-5dcc89b1-0615-490f-922a-dd18d4ef6010 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:23.990609 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-5dcc89b1-0615-490f-922a-dd18d4ef6010 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] [instance: fd5fe360-8ecf-41d0-9376-9d5533fc6ba8] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:24.000312 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5dcc89b1-0615-490f-922a-dd18d4ef6010 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:24.001404 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5dcc89b1-0615-490f-922a-dd18d4ef6010 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:24.002074 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5dcc89b1-0615-490f-922a-dd18d4ef6010 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:24.003044 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5dcc89b1-0615-490f-922a-dd18d4ef6010 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:24.003711 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5dcc89b1-0615-490f-922a-dd18d4ef6010 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:24.004350 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5dcc89b1-0615-490f-922a-dd18d4ef6010 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:24.164982 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-7e73e285-45cc-4a7a-9de7-c375a6b14a44 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7db99f361654711bea7f1b2c404d312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7adedcdb9c3485ea2738c00e25aa3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:24.198941 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-7e73e285-45cc-4a7a-9de7-c375a6b14a44 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] 10.222.0.43 "GET /compute/v2.1/servers/8408d8e1-41b0-4185-8806-9808f082a016" status: 200 len: 1217 microversion: 2.1 time: 0.264216 Oct 04 18:33:24.201842 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 299/658] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:23 2022] GET /compute/v2.1/servers/8408d8e1-41b0-4185-8806-9808f082a016 => generated 1217 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:24.454677 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-5dcc89b1-0615-490f-922a-dd18d4ef6010 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:24.466563 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-5dcc89b1-0615-490f-922a-dd18d4ef6010 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:24.468651 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-5dcc89b1-0615-490f-922a-dd18d4ef6010 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:24.470820 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-5dcc89b1-0615-490f-922a-dd18d4ef6010 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] 10.222.0.43 "GET /compute/v2.1/servers/fd5fe360-8ecf-41d0-9376-9d5533fc6ba8" status: 200 len: 1568 microversion: 2.25 time: 0.489112 Oct 04 18:33:24.482597 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 360/659] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:33:23 2022] GET /compute/v2.1/servers/fd5fe360-8ecf-41d0-9376-9d5533fc6ba8 => generated 1568 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:33:24.800926 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-595c3995-aba0-47b1-a49d-c1fa15438645 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:24.803057 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-595c3995-aba0-47b1-a49d-c1fa15438645 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] [instance: e5e92f30-937a-4ec2-b11f-336030c3d5c9] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:24.817972 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-595c3995-aba0-47b1-a49d-c1fa15438645 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:24.819788 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-595c3995-aba0-47b1-a49d-c1fa15438645 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:24.820320 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-595c3995-aba0-47b1-a49d-c1fa15438645 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:24.821327 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-595c3995-aba0-47b1-a49d-c1fa15438645 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:24.822024 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-595c3995-aba0-47b1-a49d-c1fa15438645 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:24.822572 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-595c3995-aba0-47b1-a49d-c1fa15438645 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:24.947817 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-3bf03819-6160-4931-87ff-adf77d55f1db tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:24.949356 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-3bf03819-6160-4931-87ff-adf77d55f1db tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] [instance: 84e0414b-a39f-4bfe-bc9d-c170ceb34d15] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:24.972869 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3bf03819-6160-4931-87ff-adf77d55f1db tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:24.973620 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3bf03819-6160-4931-87ff-adf77d55f1db tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:24.974253 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3bf03819-6160-4931-87ff-adf77d55f1db tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:24.975657 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3bf03819-6160-4931-87ff-adf77d55f1db tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:24.976573 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3bf03819-6160-4931-87ff-adf77d55f1db tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:24.977220 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3bf03819-6160-4931-87ff-adf77d55f1db tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:25.179539 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-3bf03819-6160-4931-87ff-adf77d55f1db tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:25.196759 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-3bf03819-6160-4931-87ff-adf77d55f1db tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:25.199737 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-3bf03819-6160-4931-87ff-adf77d55f1db tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:25.209355 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-3bf03819-6160-4931-87ff-adf77d55f1db tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] 10.222.0.43 "GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15" status: 200 len: 1537 microversion: 2.91 time: 0.265262 Oct 04 18:33:25.210238 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 361/660] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:33:24 2022] GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15 => generated 1537 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:33:25.217046 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-5514388d-29db-48e0-aa94-442b1448aaee tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:25.219174 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-5514388d-29db-48e0-aa94-442b1448aaee tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] [instance: 101edf03-d928-461d-98cf-12753ae7f7d7] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:25.228058 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5514388d-29db-48e0-aa94-442b1448aaee tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:25.228769 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5514388d-29db-48e0-aa94-442b1448aaee tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:25.229463 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5514388d-29db-48e0-aa94-442b1448aaee tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:25.230336 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5514388d-29db-48e0-aa94-442b1448aaee tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:25.230965 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5514388d-29db-48e0-aa94-442b1448aaee tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:25.231518 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5514388d-29db-48e0-aa94-442b1448aaee tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:25.394591 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-5514388d-29db-48e0-aa94-442b1448aaee tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4aec5af742842f5bb2048c8b7d60687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829069b2787a423f922fcc5b5702f167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:25.408523 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-5514388d-29db-48e0-aa94-442b1448aaee tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] 10.222.0.43 "GET /compute/v2.1/servers/101edf03-d928-461d-98cf-12753ae7f7d7" status: 200 len: 1277 microversion: 2.1 time: 0.196282 Oct 04 18:33:25.412804 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 362/661] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:25 2022] GET /compute/v2.1/servers/101edf03-d928-461d-98cf-12753ae7f7d7 => generated 1277 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:25.432188 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-595c3995-aba0-47b1-a49d-c1fa15438645 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb7b0ce49ec438f9a60b79bdb2ac164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94ae6e2cb75d410d8029aa49909c973b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:25.440734 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-a5de7e8e-02a8-4919-8507-73d5630b2636 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:25.442471 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-a5de7e8e-02a8-4919-8507-73d5630b2636 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] [instance: 8408d8e1-41b0-4185-8806-9808f082a016] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:25.442850 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-595c3995-aba0-47b1-a49d-c1fa15438645 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] 10.222.0.43 "GET /compute/v2.1/servers/e5e92f30-937a-4ec2-b11f-336030c3d5c9" status: 200 len: 1468 microversion: 2.1 time: 0.650872 Oct 04 18:33:25.445484 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 300/662] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:24 2022] GET /compute/v2.1/servers/e5e92f30-937a-4ec2-b11f-336030c3d5c9 => generated 1468 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:25.465924 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a5de7e8e-02a8-4919-8507-73d5630b2636 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:25.466744 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a5de7e8e-02a8-4919-8507-73d5630b2636 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:25.473424 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a5de7e8e-02a8-4919-8507-73d5630b2636 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:25.474661 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a5de7e8e-02a8-4919-8507-73d5630b2636 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:25.475650 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a5de7e8e-02a8-4919-8507-73d5630b2636 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:25.476281 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a5de7e8e-02a8-4919-8507-73d5630b2636 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:25.500950 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-e7427f5a-9f54-4074-9e17-b503bc3dcd75 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:25.501931 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-e7427f5a-9f54-4074-9e17-b503bc3dcd75 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] [instance: fd5fe360-8ecf-41d0-9376-9d5533fc6ba8] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:25.510594 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e7427f5a-9f54-4074-9e17-b503bc3dcd75 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:25.513691 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e7427f5a-9f54-4074-9e17-b503bc3dcd75 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:25.514386 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e7427f5a-9f54-4074-9e17-b503bc3dcd75 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:25.517029 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e7427f5a-9f54-4074-9e17-b503bc3dcd75 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:25.517728 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e7427f5a-9f54-4074-9e17-b503bc3dcd75 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:25.520385 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e7427f5a-9f54-4074-9e17-b503bc3dcd75 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:25.652798 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-a5de7e8e-02a8-4919-8507-73d5630b2636 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7db99f361654711bea7f1b2c404d312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7adedcdb9c3485ea2738c00e25aa3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:25.662622 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-a5de7e8e-02a8-4919-8507-73d5630b2636 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] 10.222.0.43 "GET /compute/v2.1/servers/8408d8e1-41b0-4185-8806-9808f082a016" status: 200 len: 1269 microversion: 2.1 time: 0.246851 Oct 04 18:33:25.678973 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 363/663] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:25 2022] GET /compute/v2.1/servers/8408d8e1-41b0-4185-8806-9808f082a016 => generated 1269 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:26.261423 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-5a99a247-8009-4d7e-b08f-a2835aa4e984 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:26.264244 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-5a99a247-8009-4d7e-b08f-a2835aa4e984 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] [instance: 84e0414b-a39f-4bfe-bc9d-c170ceb34d15] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:26.270197 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=6,nova_api:DELETE=3 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:33:26.309795 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5a99a247-8009-4d7e-b08f-a2835aa4e984 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:26.311234 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5a99a247-8009-4d7e-b08f-a2835aa4e984 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:26.312239 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5a99a247-8009-4d7e-b08f-a2835aa4e984 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:26.317939 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5a99a247-8009-4d7e-b08f-a2835aa4e984 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:26.320584 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5a99a247-8009-4d7e-b08f-a2835aa4e984 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:26.322901 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5a99a247-8009-4d7e-b08f-a2835aa4e984 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:26.437336 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-5a99a247-8009-4d7e-b08f-a2835aa4e984 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:26.460539 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-5a99a247-8009-4d7e-b08f-a2835aa4e984 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:26.465851 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-5a99a247-8009-4d7e-b08f-a2835aa4e984 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:26.479910 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-5a99a247-8009-4d7e-b08f-a2835aa4e984 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] 10.222.0.43 "GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15" status: 200 len: 1537 microversion: 2.91 time: 0.237850 Oct 04 18:33:26.484506 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 364/664] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:33:26 2022] GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15 => generated 1537 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:33:26.492592 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f7fc10d9-87bd-475f-9c74-d4fd5eaaf6d5 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:26.497530 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-f7fc10d9-87bd-475f-9c74-d4fd5eaaf6d5 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] [instance: 101edf03-d928-461d-98cf-12753ae7f7d7] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:26.509957 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f7fc10d9-87bd-475f-9c74-d4fd5eaaf6d5 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:26.510377 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f7fc10d9-87bd-475f-9c74-d4fd5eaaf6d5 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:26.510824 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f7fc10d9-87bd-475f-9c74-d4fd5eaaf6d5 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:26.511533 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f7fc10d9-87bd-475f-9c74-d4fd5eaaf6d5 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:26.511993 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f7fc10d9-87bd-475f-9c74-d4fd5eaaf6d5 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:26.512421 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f7fc10d9-87bd-475f-9c74-d4fd5eaaf6d5 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:26.565213 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-e7427f5a-9f54-4074-9e17-b503bc3dcd75 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:26.581810 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-e7427f5a-9f54-4074-9e17-b503bc3dcd75 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:26.584599 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-e7427f5a-9f54-4074-9e17-b503bc3dcd75 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:26.589615 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-e7427f5a-9f54-4074-9e17-b503bc3dcd75 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] 10.222.0.43 "GET /compute/v2.1/servers/fd5fe360-8ecf-41d0-9376-9d5533fc6ba8" status: 200 len: 1568 microversion: 2.25 time: 1.089926 Oct 04 18:33:26.591249 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 301/665] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:33:25 2022] GET /compute/v2.1/servers/fd5fe360-8ecf-41d0-9376-9d5533fc6ba8 => generated 1568 bytes in 1096 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:33:26.602435 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-77832c88-2f65-469c-9a20-d4e86e5559d3 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:26.604097 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-77832c88-2f65-469c-9a20-d4e86e5559d3 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] [instance: e5e92f30-937a-4ec2-b11f-336030c3d5c9] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:26.616633 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-77832c88-2f65-469c-9a20-d4e86e5559d3 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:26.617277 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-77832c88-2f65-469c-9a20-d4e86e5559d3 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:26.617946 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-77832c88-2f65-469c-9a20-d4e86e5559d3 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:26.619090 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-77832c88-2f65-469c-9a20-d4e86e5559d3 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:26.620245 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-77832c88-2f65-469c-9a20-d4e86e5559d3 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:26.620902 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-77832c88-2f65-469c-9a20-d4e86e5559d3 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:26.637536 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-f7fc10d9-87bd-475f-9c74-d4fd5eaaf6d5 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4aec5af742842f5bb2048c8b7d60687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829069b2787a423f922fcc5b5702f167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:26.651179 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-f7fc10d9-87bd-475f-9c74-d4fd5eaaf6d5 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] 10.222.0.43 "GET /compute/v2.1/servers/101edf03-d928-461d-98cf-12753ae7f7d7" status: 200 len: 1277 microversion: 2.1 time: 0.165053 Oct 04 18:33:26.651789 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 365/666] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:26 2022] GET /compute/v2.1/servers/101edf03-d928-461d-98cf-12753ae7f7d7 => generated 1277 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:26.689250 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-5ac6ebd0-38e3-4905-82e6-f617ab08cb36 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:26.689910 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-5ac6ebd0-38e3-4905-82e6-f617ab08cb36 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] [instance: 8408d8e1-41b0-4185-8806-9808f082a016] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:26.700306 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5ac6ebd0-38e3-4905-82e6-f617ab08cb36 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:26.700646 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5ac6ebd0-38e3-4905-82e6-f617ab08cb36 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:26.705850 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5ac6ebd0-38e3-4905-82e6-f617ab08cb36 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:26.706872 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5ac6ebd0-38e3-4905-82e6-f617ab08cb36 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:26.707521 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5ac6ebd0-38e3-4905-82e6-f617ab08cb36 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:26.708121 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5ac6ebd0-38e3-4905-82e6-f617ab08cb36 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:26.793417 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-77832c88-2f65-469c-9a20-d4e86e5559d3 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb7b0ce49ec438f9a60b79bdb2ac164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94ae6e2cb75d410d8029aa49909c973b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:26.807894 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-77832c88-2f65-469c-9a20-d4e86e5559d3 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] 10.222.0.43 "GET /compute/v2.1/servers/e5e92f30-937a-4ec2-b11f-336030c3d5c9" status: 200 len: 1426 microversion: 2.1 time: 0.209981 Oct 04 18:33:26.809923 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 302/667] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:26 2022] GET /compute/v2.1/servers/e5e92f30-937a-4ec2-b11f-336030c3d5c9 => generated 1426 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:26.947726 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-5ac6ebd0-38e3-4905-82e6-f617ab08cb36 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7db99f361654711bea7f1b2c404d312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7adedcdb9c3485ea2738c00e25aa3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:26.960876 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-5ac6ebd0-38e3-4905-82e6-f617ab08cb36 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] 10.222.0.43 "GET /compute/v2.1/servers/8408d8e1-41b0-4185-8806-9808f082a016" status: 200 len: 1275 microversion: 2.1 time: 0.276055 Oct 04 18:33:26.961717 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 366/668] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:26 2022] GET /compute/v2.1/servers/8408d8e1-41b0-4185-8806-9808f082a016 => generated 1275 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:33:27.006457 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-fd909133-3d6b-4d63-b758-18c194cc9875 req-393dc0d5-b8f2-46ef-93ba-8a9aaddc4b34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5e92f30-937a-4ec2-b11f-336030c3d5c9", "name": "network-vif-deleted", "tag": "17ae84c1-48ca-4769-9d6d-c68a66614fb0"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:33:27.027404 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-fd909133-3d6b-4d63-b758-18c194cc9875 req-393dc0d5-b8f2-46ef-93ba-8a9aaddc4b34 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:27.039401 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-fd909133-3d6b-4d63-b758-18c194cc9875 req-393dc0d5-b8f2-46ef-93ba-8a9aaddc4b34 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:27.050302 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-fd909133-3d6b-4d63-b758-18c194cc9875 req-393dc0d5-b8f2-46ef-93ba-8a9aaddc4b34 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:27.100140 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-fd909133-3d6b-4d63-b758-18c194cc9875 req-393dc0d5-b8f2-46ef-93ba-8a9aaddc4b34 service nova] Creating event network-vif-deleted:17ae84c1-48ca-4769-9d6d-c68a66614fb0 for instance e5e92f30-937a-4ec2-b11f-336030c3d5c9 on n-h2-851028-13 Oct 04 18:33:27.121403 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-fd909133-3d6b-4d63-b758-18c194cc9875 req-393dc0d5-b8f2-46ef-93ba-8a9aaddc4b34 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111980 Oct 04 18:33:27.122870 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 303/669] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:33:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:33:27.530560 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-a6f5136e-de2e-4939-8380-789054d1729c tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:27.531088 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-a6f5136e-de2e-4939-8380-789054d1729c tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] [instance: 84e0414b-a39f-4bfe-bc9d-c170ceb34d15] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:27.547766 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a6f5136e-de2e-4939-8380-789054d1729c tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:27.548247 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a6f5136e-de2e-4939-8380-789054d1729c tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:27.548692 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a6f5136e-de2e-4939-8380-789054d1729c tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:27.549442 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a6f5136e-de2e-4939-8380-789054d1729c tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:27.549899 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a6f5136e-de2e-4939-8380-789054d1729c tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:27.551317 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a6f5136e-de2e-4939-8380-789054d1729c tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:27.618638 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-5f5050e3-3d10-4bdd-a00b-cce752a2965e tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:27.619957 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-5f5050e3-3d10-4bdd-a00b-cce752a2965e tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] [instance: fd5fe360-8ecf-41d0-9376-9d5533fc6ba8] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:27.631643 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5f5050e3-3d10-4bdd-a00b-cce752a2965e tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:27.632141 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5f5050e3-3d10-4bdd-a00b-cce752a2965e tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:27.632576 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5f5050e3-3d10-4bdd-a00b-cce752a2965e tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:27.644189 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5f5050e3-3d10-4bdd-a00b-cce752a2965e tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:27.644951 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5f5050e3-3d10-4bdd-a00b-cce752a2965e tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:27.645442 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5f5050e3-3d10-4bdd-a00b-cce752a2965e tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:27.752165 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-a6f5136e-de2e-4939-8380-789054d1729c tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:27.764895 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-a6f5136e-de2e-4939-8380-789054d1729c tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:27.766847 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-a6f5136e-de2e-4939-8380-789054d1729c tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:27.781255 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-a6f5136e-de2e-4939-8380-789054d1729c tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] 10.222.0.43 "GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15" status: 200 len: 1537 microversion: 2.91 time: 0.254437 Oct 04 18:33:27.783723 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 367/670] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:33:27 2022] GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15 => generated 1537 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:33:27.789485 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-62da8293-3458-488f-b744-7ce63e65ab0d tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:27.790314 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-62da8293-3458-488f-b744-7ce63e65ab0d tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] [instance: 101edf03-d928-461d-98cf-12753ae7f7d7] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:27.798079 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-62da8293-3458-488f-b744-7ce63e65ab0d tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:27.803293 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-62da8293-3458-488f-b744-7ce63e65ab0d tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:27.803965 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-62da8293-3458-488f-b744-7ce63e65ab0d tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:27.805046 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-62da8293-3458-488f-b744-7ce63e65ab0d tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:27.805934 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-62da8293-3458-488f-b744-7ce63e65ab0d tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:27.806523 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-62da8293-3458-488f-b744-7ce63e65ab0d tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:28.088488 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-5f5050e3-3d10-4bdd-a00b-cce752a2965e tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:28.106437 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-5f5050e3-3d10-4bdd-a00b-cce752a2965e tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:28.108211 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-5f5050e3-3d10-4bdd-a00b-cce752a2965e tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:28.109658 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-5f5050e3-3d10-4bdd-a00b-cce752a2965e tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] 10.222.0.43 "GET /compute/v2.1/servers/fd5fe360-8ecf-41d0-9376-9d5533fc6ba8" status: 200 len: 1568 microversion: 2.25 time: 0.497226 Oct 04 18:33:28.110975 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 304/671] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:33:27 2022] GET /compute/v2.1/servers/fd5fe360-8ecf-41d0-9376-9d5533fc6ba8 => generated 1568 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:33:28.115929 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-2bb3a35f-03b1-450e-a525-1759de489b46 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:28.122032 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-2bb3a35f-03b1-450e-a525-1759de489b46 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] [instance: e5e92f30-937a-4ec2-b11f-336030c3d5c9] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:28.134852 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2bb3a35f-03b1-450e-a525-1759de489b46 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:28.135683 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2bb3a35f-03b1-450e-a525-1759de489b46 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:28.143259 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2bb3a35f-03b1-450e-a525-1759de489b46 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:28.143259 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2bb3a35f-03b1-450e-a525-1759de489b46 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:28.143810 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2bb3a35f-03b1-450e-a525-1759de489b46 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:28.144202 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2bb3a35f-03b1-450e-a525-1759de489b46 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:28.206648 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2bb3a35f-03b1-450e-a525-1759de489b46 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:28.207146 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2bb3a35f-03b1-450e-a525-1759de489b46 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:28.207588 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2bb3a35f-03b1-450e-a525-1759de489b46 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:28.208050 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.objects.instance [None req-2bb3a35f-03b1-450e-a525-1759de489b46 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Lazy-loading 'fault' on Instance uuid e5e92f30-937a-4ec2-b11f-336030c3d5c9 {{(pid=123595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:33:28.363051 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-2bb3a35f-03b1-450e-a525-1759de489b46 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb7b0ce49ec438f9a60b79bdb2ac164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94ae6e2cb75d410d8029aa49909c973b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:28.372917 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-2bb3a35f-03b1-450e-a525-1759de489b46 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] 10.222.0.43 "GET /compute/v2.1/servers/e5e92f30-937a-4ec2-b11f-336030c3d5c9" status: 200 len: 1312 microversion: 2.1 time: 0.260633 Oct 04 18:33:28.382635 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 305/672] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:28 2022] GET /compute/v2.1/servers/e5e92f30-937a-4ec2-b11f-336030c3d5c9 => generated 1312 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:28.398527 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-c779a287-711c-4272-8efd-d28b6a0be63d tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:28.399811 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-c779a287-711c-4272-8efd-d28b6a0be63d tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] [instance: 8408d8e1-41b0-4185-8806-9808f082a016] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:28.417597 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c779a287-711c-4272-8efd-d28b6a0be63d tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:28.419976 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c779a287-711c-4272-8efd-d28b6a0be63d tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:28.420439 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c779a287-711c-4272-8efd-d28b6a0be63d tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:28.422683 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c779a287-711c-4272-8efd-d28b6a0be63d tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:28.424760 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c779a287-711c-4272-8efd-d28b6a0be63d tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:28.426471 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c779a287-711c-4272-8efd-d28b6a0be63d tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:28.530170 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-c779a287-711c-4272-8efd-d28b6a0be63d tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7db99f361654711bea7f1b2c404d312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7adedcdb9c3485ea2738c00e25aa3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:28.539585 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-c779a287-711c-4272-8efd-d28b6a0be63d tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] 10.222.0.43 "GET /compute/v2.1/servers/8408d8e1-41b0-4185-8806-9808f082a016" status: 200 len: 1275 microversion: 2.1 time: 0.154853 Oct 04 18:33:28.540334 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 306/673] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:28 2022] GET /compute/v2.1/servers/8408d8e1-41b0-4185-8806-9808f082a016 => generated 1275 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:28.727960 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-6347208f-fce9-4d14-bd23-5aed8f7a82c8 tempest-ServicesAdminNegativeTestJSON-114663365 tempest-ServicesAdminNegativeTestJSON-114663365-project-admin] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:28.734450 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6347208f-fce9-4d14-bd23-5aed8f7a82c8 tempest-ServicesAdminNegativeTestJSON-114663365 tempest-ServicesAdminNegativeTestJSON-114663365-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:28.735136 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6347208f-fce9-4d14-bd23-5aed8f7a82c8 tempest-ServicesAdminNegativeTestJSON-114663365 tempest-ServicesAdminNegativeTestJSON-114663365-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:28.735930 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6347208f-fce9-4d14-bd23-5aed8f7a82c8 tempest-ServicesAdminNegativeTestJSON-114663365 tempest-ServicesAdminNegativeTestJSON-114663365-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:28.737745 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6347208f-fce9-4d14-bd23-5aed8f7a82c8 tempest-ServicesAdminNegativeTestJSON-114663365 tempest-ServicesAdminNegativeTestJSON-114663365-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:28.738430 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6347208f-fce9-4d14-bd23-5aed8f7a82c8 tempest-ServicesAdminNegativeTestJSON-114663365 tempest-ServicesAdminNegativeTestJSON-114663365-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:28.738870 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6347208f-fce9-4d14-bd23-5aed8f7a82c8 tempest-ServicesAdminNegativeTestJSON-114663365 tempest-ServicesAdminNegativeTestJSON-114663365-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:28.775851 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-62da8293-3458-488f-b744-7ce63e65ab0d tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4aec5af742842f5bb2048c8b7d60687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829069b2787a423f922fcc5b5702f167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:28.779401 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-6347208f-fce9-4d14-bd23-5aed8f7a82c8 tempest-ServicesAdminNegativeTestJSON-114663365 tempest-ServicesAdminNegativeTestJSON-114663365-project-admin] 10.222.0.43 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.237487 Oct 04 18:33:28.789380 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 307/674] 10.222.0.43 () {58 vars in 1137 bytes} [Tue Oct 4 18:33:28 2022] GET /compute/v2.1/os-services => generated 949 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:33:28.792871 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-62da8293-3458-488f-b744-7ce63e65ab0d tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] 10.222.0.43 "GET /compute/v2.1/servers/101edf03-d928-461d-98cf-12753ae7f7d7" status: 200 len: 1319 microversion: 2.1 time: 1.006140 Oct 04 18:33:28.794338 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 368/675] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:27 2022] GET /compute/v2.1/servers/101edf03-d928-461d-98cf-12753ae7f7d7 => generated 1319 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:28.799104 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-460bef4f-2408-4109-9c88-9fb664f7d3ef tempest-ServicesAdminNegativeTestJSON-114663365 tempest-ServicesAdminNegativeTestJSON-114663365-project-admin] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:28.803101 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-460bef4f-2408-4109-9c88-9fb664f7d3ef tempest-ServicesAdminNegativeTestJSON-114663365 tempest-ServicesAdminNegativeTestJSON-114663365-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:28.803781 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-460bef4f-2408-4109-9c88-9fb664f7d3ef tempest-ServicesAdminNegativeTestJSON-114663365 tempest-ServicesAdminNegativeTestJSON-114663365-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:28.804395 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-460bef4f-2408-4109-9c88-9fb664f7d3ef tempest-ServicesAdminNegativeTestJSON-114663365 tempest-ServicesAdminNegativeTestJSON-114663365-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:28.805323 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-460bef4f-2408-4109-9c88-9fb664f7d3ef tempest-ServicesAdminNegativeTestJSON-114663365 tempest-ServicesAdminNegativeTestJSON-114663365-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:28.805937 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-460bef4f-2408-4109-9c88-9fb664f7d3ef tempest-ServicesAdminNegativeTestJSON-114663365 tempest-ServicesAdminNegativeTestJSON-114663365-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:28.806606 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-460bef4f-2408-4109-9c88-9fb664f7d3ef tempest-ServicesAdminNegativeTestJSON-114663365 tempest-ServicesAdminNegativeTestJSON-114663365-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:28.814875 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-6dffe52f-8c6b-4b00-b095-bc1cf7fbd471 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:28.815515 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-6dffe52f-8c6b-4b00-b095-bc1cf7fbd471 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] [instance: 84e0414b-a39f-4bfe-bc9d-c170ceb34d15] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:28.822328 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6dffe52f-8c6b-4b00-b095-bc1cf7fbd471 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:28.823121 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6dffe52f-8c6b-4b00-b095-bc1cf7fbd471 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:28.823742 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6dffe52f-8c6b-4b00-b095-bc1cf7fbd471 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:28.824647 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6dffe52f-8c6b-4b00-b095-bc1cf7fbd471 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:28.825332 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6dffe52f-8c6b-4b00-b095-bc1cf7fbd471 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:28.827728 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6dffe52f-8c6b-4b00-b095-bc1cf7fbd471 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:28.836229 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-460bef4f-2408-4109-9c88-9fb664f7d3ef tempest-ServicesAdminNegativeTestJSON-114663365 tempest-ServicesAdminNegativeTestJSON-114663365-project-admin] 10.222.0.43 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.040664 Oct 04 18:33:28.837266 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 308/676] 10.222.0.43 () {58 vars in 1170 bytes} [Tue Oct 4 18:33:28 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 949 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:33:28.853173 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-097effc1-a03f-4748-84a5-bb45d216ccf4 tempest-ServicesAdminNegativeTestJSON-114663365 tempest-ServicesAdminNegativeTestJSON-114663365-project-admin] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:28.857952 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-097effc1-a03f-4748-84a5-bb45d216ccf4 tempest-ServicesAdminNegativeTestJSON-114663365 tempest-ServicesAdminNegativeTestJSON-114663365-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:28.858449 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-097effc1-a03f-4748-84a5-bb45d216ccf4 tempest-ServicesAdminNegativeTestJSON-114663365 tempest-ServicesAdminNegativeTestJSON-114663365-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:28.858930 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-097effc1-a03f-4748-84a5-bb45d216ccf4 tempest-ServicesAdminNegativeTestJSON-114663365 tempest-ServicesAdminNegativeTestJSON-114663365-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:28.859684 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-097effc1-a03f-4748-84a5-bb45d216ccf4 tempest-ServicesAdminNegativeTestJSON-114663365 tempest-ServicesAdminNegativeTestJSON-114663365-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:28.860202 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-097effc1-a03f-4748-84a5-bb45d216ccf4 tempest-ServicesAdminNegativeTestJSON-114663365 tempest-ServicesAdminNegativeTestJSON-114663365-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:28.860638 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-097effc1-a03f-4748-84a5-bb45d216ccf4 tempest-ServicesAdminNegativeTestJSON-114663365 tempest-ServicesAdminNegativeTestJSON-114663365-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:28.897557 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-097effc1-a03f-4748-84a5-bb45d216ccf4 tempest-ServicesAdminNegativeTestJSON-114663365 tempest-ServicesAdminNegativeTestJSON-114663365-project-admin] 10.222.0.43 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.050432 Oct 04 18:33:28.898178 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 309/677] 10.222.0.43 () {58 vars in 1137 bytes} [Tue Oct 4 18:33:28 2022] GET /compute/v2.1/os-services => generated 949 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:33:28.914120 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-900d8283-f5fc-40ac-9e3a-35dbe1657765 tempest-ServicesAdminNegativeTestJSON-114663365 tempest-ServicesAdminNegativeTestJSON-114663365-project-admin] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:28.920451 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-900d8283-f5fc-40ac-9e3a-35dbe1657765 tempest-ServicesAdminNegativeTestJSON-114663365 tempest-ServicesAdminNegativeTestJSON-114663365-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:28.920952 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-900d8283-f5fc-40ac-9e3a-35dbe1657765 tempest-ServicesAdminNegativeTestJSON-114663365 tempest-ServicesAdminNegativeTestJSON-114663365-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:28.921503 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-900d8283-f5fc-40ac-9e3a-35dbe1657765 tempest-ServicesAdminNegativeTestJSON-114663365 tempest-ServicesAdminNegativeTestJSON-114663365-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:28.922301 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-900d8283-f5fc-40ac-9e3a-35dbe1657765 tempest-ServicesAdminNegativeTestJSON-114663365 tempest-ServicesAdminNegativeTestJSON-114663365-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:28.923010 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-900d8283-f5fc-40ac-9e3a-35dbe1657765 tempest-ServicesAdminNegativeTestJSON-114663365 tempest-ServicesAdminNegativeTestJSON-114663365-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:28.923459 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-900d8283-f5fc-40ac-9e3a-35dbe1657765 tempest-ServicesAdminNegativeTestJSON-114663365 tempest-ServicesAdminNegativeTestJSON-114663365-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:28.962155 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-900d8283-f5fc-40ac-9e3a-35dbe1657765 tempest-ServicesAdminNegativeTestJSON-114663365 tempest-ServicesAdminNegativeTestJSON-114663365-project-admin] 10.222.0.43 "GET /compute/v2.1/os-services?host=n-d-851028-13&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.054073 Oct 04 18:33:28.963064 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 310/678] 10.222.0.43 () {58 vars in 1196 bytes} [Tue Oct 4 18:33:28 2022] GET /compute/v2.1/os-services?host=n-d-851028-13&binary=xxx => generated 16 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:33:28.977287 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-88e626a6-719e-4917-8520-26691f5dbb94 tempest-ServicesAdminNegativeTestJSON-114663365 tempest-ServicesAdminNegativeTestJSON-114663365-project-admin] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:28.981747 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-88e626a6-719e-4917-8520-26691f5dbb94 tempest-ServicesAdminNegativeTestJSON-114663365 tempest-ServicesAdminNegativeTestJSON-114663365-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:28.982239 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-88e626a6-719e-4917-8520-26691f5dbb94 tempest-ServicesAdminNegativeTestJSON-114663365 tempest-ServicesAdminNegativeTestJSON-114663365-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:28.982686 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-88e626a6-719e-4917-8520-26691f5dbb94 tempest-ServicesAdminNegativeTestJSON-114663365 tempest-ServicesAdminNegativeTestJSON-114663365-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:28.983597 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-88e626a6-719e-4917-8520-26691f5dbb94 tempest-ServicesAdminNegativeTestJSON-114663365 tempest-ServicesAdminNegativeTestJSON-114663365-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:28.984254 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-88e626a6-719e-4917-8520-26691f5dbb94 tempest-ServicesAdminNegativeTestJSON-114663365 tempest-ServicesAdminNegativeTestJSON-114663365-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:28.984687 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-88e626a6-719e-4917-8520-26691f5dbb94 tempest-ServicesAdminNegativeTestJSON-114663365 tempest-ServicesAdminNegativeTestJSON-114663365-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:29.016114 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-88e626a6-719e-4917-8520-26691f5dbb94 tempest-ServicesAdminNegativeTestJSON-114663365 tempest-ServicesAdminNegativeTestJSON-114663365-project-admin] 10.222.0.43 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.043474 Oct 04 18:33:29.017151 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 311/679] 10.222.0.43 () {58 vars in 1137 bytes} [Tue Oct 4 18:33:28 2022] GET /compute/v2.1/os-services => generated 949 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:33:29.034471 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-5c066d78-32f4-4524-a136-ca99f9a827be tempest-ServicesAdminNegativeTestJSON-114663365 tempest-ServicesAdminNegativeTestJSON-114663365-project-admin] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:29.039330 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5c066d78-32f4-4524-a136-ca99f9a827be tempest-ServicesAdminNegativeTestJSON-114663365 tempest-ServicesAdminNegativeTestJSON-114663365-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:29.040748 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5c066d78-32f4-4524-a136-ca99f9a827be tempest-ServicesAdminNegativeTestJSON-114663365 tempest-ServicesAdminNegativeTestJSON-114663365-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:29.041422 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5c066d78-32f4-4524-a136-ca99f9a827be tempest-ServicesAdminNegativeTestJSON-114663365 tempest-ServicesAdminNegativeTestJSON-114663365-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:29.042920 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5c066d78-32f4-4524-a136-ca99f9a827be tempest-ServicesAdminNegativeTestJSON-114663365 tempest-ServicesAdminNegativeTestJSON-114663365-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:29.043589 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5c066d78-32f4-4524-a136-ca99f9a827be tempest-ServicesAdminNegativeTestJSON-114663365 tempest-ServicesAdminNegativeTestJSON-114663365-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:29.044199 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5c066d78-32f4-4524-a136-ca99f9a827be tempest-ServicesAdminNegativeTestJSON-114663365 tempest-ServicesAdminNegativeTestJSON-114663365-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:29.060975 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-6dffe52f-8c6b-4b00-b095-bc1cf7fbd471 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:29.090655 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-5c066d78-32f4-4524-a136-ca99f9a827be tempest-ServicesAdminNegativeTestJSON-114663365 tempest-ServicesAdminNegativeTestJSON-114663365-project-admin] 10.222.0.43 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.1 time: 0.064070 Oct 04 18:33:29.092135 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 312/680] 10.222.0.43 () {58 vars in 1198 bytes} [Tue Oct 4 18:33:29 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:33:29.100156 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-6dffe52f-8c6b-4b00-b095-bc1cf7fbd471 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:29.105301 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-6dffe52f-8c6b-4b00-b095-bc1cf7fbd471 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:29.131448 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-6dffe52f-8c6b-4b00-b095-bc1cf7fbd471 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] 10.222.0.43 "GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15" status: 200 len: 1537 microversion: 2.91 time: 0.318658 Oct 04 18:33:29.137234 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 369/681] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:33:28 2022] GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15 => generated 1537 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:33:29.154848 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-6e588502-a6f2-4edb-926f-db70c27003fd tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:29.155933 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-6e588502-a6f2-4edb-926f-db70c27003fd tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] [instance: fd5fe360-8ecf-41d0-9376-9d5533fc6ba8] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:29.199491 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6e588502-a6f2-4edb-926f-db70c27003fd tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:29.200305 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6e588502-a6f2-4edb-926f-db70c27003fd tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:29.201049 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6e588502-a6f2-4edb-926f-db70c27003fd tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:29.210298 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6e588502-a6f2-4edb-926f-db70c27003fd tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:29.211920 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6e588502-a6f2-4edb-926f-db70c27003fd tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:29.213534 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6e588502-a6f2-4edb-926f-db70c27003fd tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:29.313419 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-c6ce373f-a61c-4f54-83d2-12581a7a5ede tempest-ServicesAdminNegativeTestJSON-480122069 tempest-ServicesAdminNegativeTestJSON-480122069-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:29.318634 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-c6ce373f-a61c-4f54-83d2-12581a7a5ede tempest-ServicesAdminNegativeTestJSON-480122069 tempest-ServicesAdminNegativeTestJSON-480122069-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '2f20ec21ba684c05adc02fc9c75334ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c59a2a3a08484321be375f914c82d66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:29.328919 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-c6ce373f-a61c-4f54-83d2-12581a7a5ede tempest-ServicesAdminNegativeTestJSON-480122069 tempest-ServicesAdminNegativeTestJSON-480122069-project] Request method failure captured: Oct 04 18:33:29.328919 n-d-851028-13 devstack@n-api.service[123595]: request: GET /compute/v2.1/os-services HTTP/1.1 Oct 04 18:33:29.328919 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 18:33:29.328919 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 18:33:29.328919 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 18:33:29.328919 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 0 Oct 04 18:33:29.328919 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 18:33:29.328919 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 18:33:29.328919 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 18:33:29.328919 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 18:33:29.328919 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPHx3rlbjU0KjvxGnGpqA_SSOSvDKEGe6QbJ_1vGZ1K0fJq0eiVAcBUB3UuPlPJFJ36QITpV7bj555FrHKMG0qEkrKpwv3Avw7F6hPwPaq5g69vnJQQ2r8YIXdEuWv-d4l9Tia0qnjdhLxuY6ZohT-vrni1LjyW2pujKzeQus0cCiZUU Oct 04 18:33:29.328919 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 18:33:29.328919 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 18:33:29.328919 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 18:33:29.328919 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 18:33:29.328919 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 18:33:29.328919 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 18:33:29.328919 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: c59a2a3a08484321be375f914c82d66a Oct 04 18:33:29.328919 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-ServicesAdminNegativeTestJSON-480122069 Oct 04 18:33:29.328919 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 18:33:29.328919 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 18:33:29.330551 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/c59a2a3a08484321be375f914c82d66a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_c59a2a3a08484321be375f914c82d66a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c59a2a3a08484321be375f914c82d66a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c59a2a3a08484321be375f914c82d66a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:33:29.330551 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-ServicesAdminNegativeTestJSON-480122069 Oct 04 18:33:29.330551 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: c59a2a3a08484321be375f914c82d66a Oct 04 18:33:29.330551 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-ServicesAdminNegativeTestJSON-480122069 Oct 04 18:33:29.330551 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-ServicesAdminNegativeTestJSON-480122069-project Oct 04 18:33:29.330551 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 18:33:29.330551 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 18:33:29.330551 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: 2f20ec21ba684c05adc02fc9c75334ce Oct 04 18:33:29.330551 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-ServicesAdminNegativeTestJSON-480122069-project Oct 04 18:33:29.330551 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 18:33:29.330551 n-d-851028-13 devstack@n-api.service[123595]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 04 18:33:29.330551 n-d-851028-13 devstack@n-api.service[123595]: action_args: {} Oct 04 18:33:29.331392 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:33:29.331392 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:33:29.331392 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:33:29.331392 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:33:29.331392 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:33:29.331392 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:33:29.331392 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 18:33:29.331392 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:33:29.331392 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 18:33:29.331392 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:33:29.331392 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:33:29.331392 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:33:29.331392 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Oct 04 18:33:29.331392 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Oct 04 18:33:29.331392 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 18:33:29.331392 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 18:33:29.331392 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 18:33:29.331392 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 18:33:29.331392 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:33:29.332536 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:33:29.332536 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:33:29.332536 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:33:29.332536 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 18:33:29.332536 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 18:33:29.332536 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 18:33:29.332536 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 18:33:29.332536 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 18:33:29.332536 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 18:33:29.332536 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 04 18:33:29.332536 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:33:29.332536 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:33:29.332536 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:33:29.332536 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:33:29.332536 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:33:29.332536 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:33:29.332536 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 18:33:29.332536 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 18:33:29.332536 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 04 18:33:29.332536 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:33:29.335867 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-c6ce373f-a61c-4f54-83d2-12581a7a5ede tempest-ServicesAdminNegativeTestJSON-480122069 tempest-ServicesAdminNegativeTestJSON-480122069-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:33:29.335867 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-c6ce373f-a61c-4f54-83d2-12581a7a5ede tempest-ServicesAdminNegativeTestJSON-480122069 tempest-ServicesAdminNegativeTestJSON-480122069-project] 10.222.0.43 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.222296 Oct 04 18:33:29.335867 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 313/682] 10.222.0.43 () {58 vars in 1137 bytes} [Tue Oct 4 18:33:29 2022] GET /compute/v2.1/os-services => generated 112 bytes in 223 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:33:29.343599 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-45e43ec8-2a91-4429-aa36-858d3f6c802d req-983a4aa3-5f44-4e56-a7c7-037561f31500 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd5fe360-8ecf-41d0-9376-9d5533fc6ba8", "name": "network-vif-unplugged", "status": "completed", "tag": "c60c6944-7112-4929-bd6e-03bb7d4559d0"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:33:29.370763 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-45e43ec8-2a91-4429-aa36-858d3f6c802d req-983a4aa3-5f44-4e56-a7c7-037561f31500 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:29.371743 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-45e43ec8-2a91-4429-aa36-858d3f6c802d req-983a4aa3-5f44-4e56-a7c7-037561f31500 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:29.372391 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-45e43ec8-2a91-4429-aa36-858d3f6c802d req-983a4aa3-5f44-4e56-a7c7-037561f31500 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:29.387322 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-45e43ec8-2a91-4429-aa36-858d3f6c802d req-983a4aa3-5f44-4e56-a7c7-037561f31500 service nova] Creating event network-vif-unplugged:c60c6944-7112-4929-bd6e-03bb7d4559d0 for instance fd5fe360-8ecf-41d0-9376-9d5533fc6ba8 on n-h1-851028-13 Oct 04 18:33:29.399721 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-45e43ec8-2a91-4429-aa36-858d3f6c802d req-983a4aa3-5f44-4e56-a7c7-037561f31500 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.073923 Oct 04 18:33:29.413456 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 314/683] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:33:29 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:33:29.430525 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-dede6ecf-4601-4ff7-b94c-f2e5140a9a61 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:29.430742 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-dede6ecf-4601-4ff7-b94c-f2e5140a9a61 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] [instance: e5e92f30-937a-4ec2-b11f-336030c3d5c9] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:29.443922 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dede6ecf-4601-4ff7-b94c-f2e5140a9a61 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:29.444421 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dede6ecf-4601-4ff7-b94c-f2e5140a9a61 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:29.444859 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dede6ecf-4601-4ff7-b94c-f2e5140a9a61 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:29.455889 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dede6ecf-4601-4ff7-b94c-f2e5140a9a61 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:29.456446 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dede6ecf-4601-4ff7-b94c-f2e5140a9a61 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:29.456896 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dede6ecf-4601-4ff7-b94c-f2e5140a9a61 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:29.491492 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-dede6ecf-4601-4ff7-b94c-f2e5140a9a61 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] HTTP exception thrown: Instance e5e92f30-937a-4ec2-b11f-336030c3d5c9 could not be found. Oct 04 18:33:29.493227 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-dede6ecf-4601-4ff7-b94c-f2e5140a9a61 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Request method failure captured: Oct 04 18:33:29.493227 n-d-851028-13 devstack@n-api.service[123595]: request: GET /compute/v2.1/servers/e5e92f30-937a-4ec2-b11f-336030c3d5c9 HTTP/1.1 Oct 04 18:33:29.493227 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 18:33:29.493227 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 18:33:29.493227 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 18:33:29.493227 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 0 Oct 04 18:33:29.493227 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 18:33:29.493227 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 18:33:29.493227 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 18:33:29.493227 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 18:33:29.493227 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPHwzsk-n6ULMV06SW99ekV8Tnkog9uAF1R2CgcGZzE9X_MnxBvFTdLdSSiSlIOBRrd3oO-f02e6pq95uD6P7i0lT3OXUwYU8YnXIcvVeIl-wgrgXS9W10xRV_R9MJwI5TCCZ4LWMWED4LCFVPxmfc2ukRQQ75CNglnwfWenkLyFWcno Oct 04 18:33:29.493227 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 18:33:29.493227 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 18:33:29.493227 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 18:33:29.493227 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 18:33:29.493227 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 18:33:29.493227 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 18:33:29.493227 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: 94ae6e2cb75d410d8029aa49909c973b Oct 04 18:33:29.493227 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-679418353 Oct 04 18:33:29.493227 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 18:33:29.493227 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 18:33:29.494531 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/94ae6e2cb75d410d8029aa49909c973b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_94ae6e2cb75d410d8029aa49909c973b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/94ae6e2cb75d410d8029aa49909c973b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/94ae6e2cb75d410d8029aa49909c973b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:33:29.494531 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-ServersAdminNegativeTestJSON-679418353 Oct 04 18:33:29.494531 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: 94ae6e2cb75d410d8029aa49909c973b Oct 04 18:33:29.494531 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-679418353 Oct 04 18:33:29.494531 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-ServersAdminNegativeTestJSON-679418353-project Oct 04 18:33:29.494531 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 18:33:29.494531 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 18:33:29.494531 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: cdb7b0ce49ec438f9a60b79bdb2ac164 Oct 04 18:33:29.494531 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-ServersAdminNegativeTestJSON-679418353-project Oct 04 18:33:29.494531 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 18:33:29.494531 n-d-851028-13 devstack@n-api.service[123595]: exception: Instance e5e92f30-937a-4ec2-b11f-336030c3d5c9 could not be found. Oct 04 18:33:29.494531 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': 'e5e92f30-937a-4ec2-b11f-336030c3d5c9'} Oct 04 18:33:29.495394 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:33:29.495394 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:33:29.495394 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:33:29.495394 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:33:29.495394 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:33:29.495394 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:33:29.495394 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:33:29.495394 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:33:29.495394 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:33:29.495394 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:33:29.495394 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5e92f30-937a-4ec2-b11f-336030c3d5c9 could not be found. Oct 04 18:33:29.495394 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:33:29.495394 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:33:29.495394 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:33:29.495394 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:33:29.495394 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:33:29.495394 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:33:29.495394 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:33:29.495394 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:33:29.495394 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:33:29.496564 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:33:29.496564 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:33:29.496564 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:33:29.496564 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:33:29.496564 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:33:29.496564 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:33:29.496564 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:33:29.496564 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5e92f30-937a-4ec2-b11f-336030c3d5c9 could not be found. Oct 04 18:33:29.496564 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:33:29.496564 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:33:29.496564 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:33:29.496564 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:33:29.496564 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:33:29.496564 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:33:29.496564 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:33:29.496564 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:33:29.496564 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5e92f30-937a-4ec2-b11f-336030c3d5c9 could not be found. Oct 04 18:33:29.496564 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:33:29.497805 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-dede6ecf-4601-4ff7-b94c-f2e5140a9a61 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Returning 404 to user: Instance e5e92f30-937a-4ec2-b11f-336030c3d5c9 could not be found. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:33:29.497805 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-dede6ecf-4601-4ff7-b94c-f2e5140a9a61 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] 10.222.0.43 "GET /compute/v2.1/servers/e5e92f30-937a-4ec2-b11f-336030c3d5c9" status: 404 len: 111 microversion: 2.1 time: 0.079700 Oct 04 18:33:29.497805 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 315/684] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:29 2022] GET /compute/v2.1/servers/e5e92f30-937a-4ec2-b11f-336030c3d5c9 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:33:29.512793 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-8e76c14d-18f6-4c39-b386-69551416f552 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:29.513336 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-8e76c14d-18f6-4c39-b386-69551416f552 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] [instance: 918d6106-9c7c-4046-9cdd-319afe4cdb25] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:29.526163 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8e76c14d-18f6-4c39-b386-69551416f552 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:29.526671 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8e76c14d-18f6-4c39-b386-69551416f552 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:29.527483 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8e76c14d-18f6-4c39-b386-69551416f552 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:29.527826 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8e76c14d-18f6-4c39-b386-69551416f552 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:29.537527 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8e76c14d-18f6-4c39-b386-69551416f552 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:29.538931 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8e76c14d-18f6-4c39-b386-69551416f552 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:29.581948 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-8e76c14d-18f6-4c39-b386-69551416f552 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] [instance: 918d6106-9c7c-4046-9cdd-319afe4cdb25] Going to try to terminate instance {{(pid=123595) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:33:29.718096 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-8e76c14d-18f6-4c39-b386-69551416f552 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] 10.222.0.43 "DELETE /compute/v2.1/servers/918d6106-9c7c-4046-9cdd-319afe4cdb25" status: 204 len: 0 microversion: 2.1 time: 0.216170 Oct 04 18:33:29.718548 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 316/685] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 18:33:29 2022] DELETE /compute/v2.1/servers/918d6106-9c7c-4046-9cdd-319afe4cdb25 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:33:29.728511 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-b89caba0-ee2c-4f70-bb2d-f769f339f35a tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:29.730459 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-b89caba0-ee2c-4f70-bb2d-f769f339f35a tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] [instance: 8408d8e1-41b0-4185-8806-9808f082a016] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:29.738066 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b89caba0-ee2c-4f70-bb2d-f769f339f35a tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:29.738804 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b89caba0-ee2c-4f70-bb2d-f769f339f35a tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:29.740243 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b89caba0-ee2c-4f70-bb2d-f769f339f35a tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:29.741332 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b89caba0-ee2c-4f70-bb2d-f769f339f35a tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:29.742244 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b89caba0-ee2c-4f70-bb2d-f769f339f35a tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:29.743183 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b89caba0-ee2c-4f70-bb2d-f769f339f35a tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:29.811938 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-6e588502-a6f2-4edb-926f-db70c27003fd tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:29.830761 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-6e588502-a6f2-4edb-926f-db70c27003fd tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:29.837998 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-6e588502-a6f2-4edb-926f-db70c27003fd tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:29.839883 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-6e588502-a6f2-4edb-926f-db70c27003fd tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] 10.222.0.43 "GET /compute/v2.1/servers/fd5fe360-8ecf-41d0-9376-9d5533fc6ba8" status: 200 len: 1568 microversion: 2.25 time: 0.700924 Oct 04 18:33:29.842997 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 370/686] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:33:29 2022] GET /compute/v2.1/servers/fd5fe360-8ecf-41d0-9376-9d5533fc6ba8 => generated 1568 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:33:29.848854 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-195be57d-0c4e-4651-83a4-849717437ee7 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:29.849569 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-195be57d-0c4e-4651-83a4-849717437ee7 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] [instance: 918d6106-9c7c-4046-9cdd-319afe4cdb25] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:29.869414 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-195be57d-0c4e-4651-83a4-849717437ee7 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:29.870660 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-195be57d-0c4e-4651-83a4-849717437ee7 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:29.871847 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-195be57d-0c4e-4651-83a4-849717437ee7 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:29.873508 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-195be57d-0c4e-4651-83a4-849717437ee7 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:29.873943 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-195be57d-0c4e-4651-83a4-849717437ee7 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:29.888723 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-195be57d-0c4e-4651-83a4-849717437ee7 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:30.094394 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-b89caba0-ee2c-4f70-bb2d-f769f339f35a tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7db99f361654711bea7f1b2c404d312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7adedcdb9c3485ea2738c00e25aa3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:30.098751 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:33:30.110029 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-b89caba0-ee2c-4f70-bb2d-f769f339f35a tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] 10.222.0.43 "GET /compute/v2.1/servers/8408d8e1-41b0-4185-8806-9808f082a016" status: 200 len: 1317 microversion: 2.1 time: 0.388621 Oct 04 18:33:30.110818 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 317/687] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:29 2022] GET /compute/v2.1/servers/8408d8e1-41b0-4185-8806-9808f082a016 => generated 1317 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:30.120505 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-f6421b5b-3785-4836-9581-8ed8ea86fa03 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:30.135520 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-f6421b5b-3785-4836-9581-8ed8ea86fa03 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] [instance: 101edf03-d928-461d-98cf-12753ae7f7d7] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:30.156938 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f6421b5b-3785-4836-9581-8ed8ea86fa03 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:30.159972 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f6421b5b-3785-4836-9581-8ed8ea86fa03 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:30.160425 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f6421b5b-3785-4836-9581-8ed8ea86fa03 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:30.161195 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f6421b5b-3785-4836-9581-8ed8ea86fa03 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:30.162178 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f6421b5b-3785-4836-9581-8ed8ea86fa03 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:30.162606 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f6421b5b-3785-4836-9581-8ed8ea86fa03 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:30.487366 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-195be57d-0c4e-4651-83a4-849717437ee7 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb7b0ce49ec438f9a60b79bdb2ac164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94ae6e2cb75d410d8029aa49909c973b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:30.501541 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-195be57d-0c4e-4651-83a4-849717437ee7 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] 10.222.0.43 "GET /compute/v2.1/servers/918d6106-9c7c-4046-9cdd-319afe4cdb25" status: 200 len: 1477 microversion: 2.1 time: 0.656810 Oct 04 18:33:30.503065 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 371/688] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:29 2022] GET /compute/v2.1/servers/918d6106-9c7c-4046-9cdd-319afe4cdb25 => generated 1477 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:30.508435 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-11c187e5-bed4-4b70-8e85-21f37b9eff87 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:30.509791 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-11c187e5-bed4-4b70-8e85-21f37b9eff87 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] [instance: 84e0414b-a39f-4bfe-bc9d-c170ceb34d15] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:30.517989 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-11c187e5-bed4-4b70-8e85-21f37b9eff87 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:30.518967 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-11c187e5-bed4-4b70-8e85-21f37b9eff87 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:30.519770 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-11c187e5-bed4-4b70-8e85-21f37b9eff87 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:30.521576 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-11c187e5-bed4-4b70-8e85-21f37b9eff87 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:30.522470 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-11c187e5-bed4-4b70-8e85-21f37b9eff87 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:30.523263 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-11c187e5-bed4-4b70-8e85-21f37b9eff87 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:30.621195 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-f6421b5b-3785-4836-9581-8ed8ea86fa03 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4aec5af742842f5bb2048c8b7d60687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829069b2787a423f922fcc5b5702f167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:30.630590 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-f6421b5b-3785-4836-9581-8ed8ea86fa03 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] 10.222.0.43 "GET /compute/v2.1/servers/101edf03-d928-461d-98cf-12753ae7f7d7" status: 200 len: 1319 microversion: 2.1 time: 0.518430 Oct 04 18:33:30.631558 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 318/689] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:30 2022] GET /compute/v2.1/servers/101edf03-d928-461d-98cf-12753ae7f7d7 => generated 1319 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:30.665379 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-11c187e5-bed4-4b70-8e85-21f37b9eff87 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:30.678180 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-11c187e5-bed4-4b70-8e85-21f37b9eff87 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:30.679796 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-11c187e5-bed4-4b70-8e85-21f37b9eff87 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:30.686982 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-11c187e5-bed4-4b70-8e85-21f37b9eff87 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] 10.222.0.43 "GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15" status: 200 len: 1558 microversion: 2.91 time: 0.182519 Oct 04 18:33:30.688232 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 372/690] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:33:30 2022] GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15 => generated 1558 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:33:30.870627 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-f4d1a824-baad-42a5-af4f-0ec8d01051ff tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:30.871529 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-f4d1a824-baad-42a5-af4f-0ec8d01051ff tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] [instance: fd5fe360-8ecf-41d0-9376-9d5533fc6ba8] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:30.887707 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f4d1a824-baad-42a5-af4f-0ec8d01051ff tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:30.890246 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f4d1a824-baad-42a5-af4f-0ec8d01051ff tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:30.890785 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f4d1a824-baad-42a5-af4f-0ec8d01051ff tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:30.892986 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f4d1a824-baad-42a5-af4f-0ec8d01051ff tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:30.893497 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f4d1a824-baad-42a5-af4f-0ec8d01051ff tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:30.893944 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f4d1a824-baad-42a5-af4f-0ec8d01051ff tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:31.140969 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-ca01b862-45aa-40fc-b556-2aa61588f825 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:31.142042 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-ca01b862-45aa-40fc-b556-2aa61588f825 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] [instance: 8408d8e1-41b0-4185-8806-9808f082a016] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:31.156893 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ca01b862-45aa-40fc-b556-2aa61588f825 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:31.158361 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ca01b862-45aa-40fc-b556-2aa61588f825 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:31.162801 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ca01b862-45aa-40fc-b556-2aa61588f825 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:31.164955 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ca01b862-45aa-40fc-b556-2aa61588f825 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:31.171975 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ca01b862-45aa-40fc-b556-2aa61588f825 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:31.172833 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ca01b862-45aa-40fc-b556-2aa61588f825 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:31.179177 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=100 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:33:31.208834 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-f4d1a824-baad-42a5-af4f-0ec8d01051ff tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:31.224820 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-f4d1a824-baad-42a5-af4f-0ec8d01051ff tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:31.227037 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-f4d1a824-baad-42a5-af4f-0ec8d01051ff tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:31.230693 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-f4d1a824-baad-42a5-af4f-0ec8d01051ff tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] 10.222.0.43 "GET /compute/v2.1/servers/fd5fe360-8ecf-41d0-9376-9d5533fc6ba8" status: 200 len: 1568 microversion: 2.25 time: 0.365527 Oct 04 18:33:31.232900 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 319/691] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:33:30 2022] GET /compute/v2.1/servers/fd5fe360-8ecf-41d0-9376-9d5533fc6ba8 => generated 1568 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:33:31.488985 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=4 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:33:31.528507 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=18 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:33:31.617026 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-ca01b862-45aa-40fc-b556-2aa61588f825 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7db99f361654711bea7f1b2c404d312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7adedcdb9c3485ea2738c00e25aa3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:31.634615 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-ca01b862-45aa-40fc-b556-2aa61588f825 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] 10.222.0.43 "GET /compute/v2.1/servers/8408d8e1-41b0-4185-8806-9808f082a016" status: 200 len: 1317 microversion: 2.1 time: 0.498638 Oct 04 18:33:31.635677 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 373/692] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:31 2022] GET /compute/v2.1/servers/8408d8e1-41b0-4185-8806-9808f082a016 => generated 1317 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:31.649409 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-f8164e98-4ede-4ceb-8800-f9873d6d92e8 req-8cc2d12f-a34e-4fb8-a402-e4e3da1eb736 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8408d8e1-41b0-4185-8806-9808f082a016", "tag": "a599834b-b75e-4efd-912d-97b463dc6035"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:33:31.691953 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-f8164e98-4ede-4ceb-8800-f9873d6d92e8 req-8cc2d12f-a34e-4fb8-a402-e4e3da1eb736 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:31.693856 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-f8164e98-4ede-4ceb-8800-f9873d6d92e8 req-8cc2d12f-a34e-4fb8-a402-e4e3da1eb736 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:31.694841 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-f8164e98-4ede-4ceb-8800-f9873d6d92e8 req-8cc2d12f-a34e-4fb8-a402-e4e3da1eb736 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:31.731318 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-f8164e98-4ede-4ceb-8800-f9873d6d92e8 req-8cc2d12f-a34e-4fb8-a402-e4e3da1eb736 service nova] Creating event network-changed:a599834b-b75e-4efd-912d-97b463dc6035 for instance 8408d8e1-41b0-4185-8806-9808f082a016 on n-h2-851028-13 Oct 04 18:33:31.744042 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-f8164e98-4ede-4ceb-8800-f9873d6d92e8 req-8cc2d12f-a34e-4fb8-a402-e4e3da1eb736 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106874 Oct 04 18:33:31.745257 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 374/693] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:33:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:33:31.759645 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-219bb6d3-3296-469d-a7c9-4c576fd371d1 req-641b003f-5a61-46a3-ac35-b7abe782d55e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd5fe360-8ecf-41d0-9376-9d5533fc6ba8", "tag": "c60c6944-7112-4929-bd6e-03bb7d4559d0"}, {"name": "network-changed", "server_uuid": "101edf03-d928-461d-98cf-12753ae7f7d7", "tag": "c3985dab-2758-4c15-b5b3-6093e8e8ce76"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:33:31.788207 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-219bb6d3-3296-469d-a7c9-4c576fd371d1 req-641b003f-5a61-46a3-ac35-b7abe782d55e service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:31.788999 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-219bb6d3-3296-469d-a7c9-4c576fd371d1 req-641b003f-5a61-46a3-ac35-b7abe782d55e service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:31.789711 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-219bb6d3-3296-469d-a7c9-4c576fd371d1 req-641b003f-5a61-46a3-ac35-b7abe782d55e service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:31.819343 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-219bb6d3-3296-469d-a7c9-4c576fd371d1 req-641b003f-5a61-46a3-ac35-b7abe782d55e service nova] Creating event network-changed:c60c6944-7112-4929-bd6e-03bb7d4559d0 for instance fd5fe360-8ecf-41d0-9376-9d5533fc6ba8 on n-h1-851028-13 Oct 04 18:33:31.819872 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-219bb6d3-3296-469d-a7c9-4c576fd371d1 req-641b003f-5a61-46a3-ac35-b7abe782d55e service nova] Creating event network-changed:c3985dab-2758-4c15-b5b3-6093e8e8ce76 for instance 101edf03-d928-461d-98cf-12753ae7f7d7 on n-h1-851028-13 Oct 04 18:33:31.838378 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-2a4f8329-7d05-480b-af8e-cc88f78eb259 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1107955627", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452", "networks": [{"uuid": "8427bdfe-80f6-4509-a949-365d3d4b4e33"}]}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:33:31.849004 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-219bb6d3-3296-469d-a7c9-4c576fd371d1 req-641b003f-5a61-46a3-ac35-b7abe782d55e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.102141 Oct 04 18:33:31.856266 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 375/694] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:33:31 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:33:31.865100 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-88fb204b-2858-445e-806f-87e53b4f58cb tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:31.875958 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-88fb204b-2858-445e-806f-87e53b4f58cb tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] [instance: 918d6106-9c7c-4046-9cdd-319afe4cdb25] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:31.899330 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-88fb204b-2858-445e-806f-87e53b4f58cb tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:31.900107 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-88fb204b-2858-445e-806f-87e53b4f58cb tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:31.900909 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-88fb204b-2858-445e-806f-87e53b4f58cb tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:31.901765 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-88fb204b-2858-445e-806f-87e53b4f58cb tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:31.902234 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-88fb204b-2858-445e-806f-87e53b4f58cb tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:31.902675 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-88fb204b-2858-445e-806f-87e53b4f58cb tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:31.960595 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.network.neutron [None req-2a4f8329-7d05-480b-af8e-cc88f78eb259 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] validate_networks() for [('8427bdfe-80f6-4509-a949-365d3d4b4e33', None, None, None, None, None)] {{(pid=123595) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:33:32.244398 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-88fb204b-2858-445e-806f-87e53b4f58cb tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb7b0ce49ec438f9a60b79bdb2ac164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94ae6e2cb75d410d8029aa49909c973b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:32.254130 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-88fb204b-2858-445e-806f-87e53b4f58cb tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] 10.222.0.43 "GET /compute/v2.1/servers/918d6106-9c7c-4046-9cdd-319afe4cdb25" status: 200 len: 1477 microversion: 2.1 time: 0.396122 Oct 04 18:33:32.256140 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 376/695] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:31 2022] GET /compute/v2.1/servers/918d6106-9c7c-4046-9cdd-319afe4cdb25 => generated 1477 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:32.262245 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-d55a5d4d-e2c9-4488-a0e7-282123bdcc64 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:32.264462 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-d55a5d4d-e2c9-4488-a0e7-282123bdcc64 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] [instance: 101edf03-d928-461d-98cf-12753ae7f7d7] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:32.275569 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d55a5d4d-e2c9-4488-a0e7-282123bdcc64 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:32.276425 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d55a5d4d-e2c9-4488-a0e7-282123bdcc64 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:32.277558 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d55a5d4d-e2c9-4488-a0e7-282123bdcc64 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:32.279150 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d55a5d4d-e2c9-4488-a0e7-282123bdcc64 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:32.280159 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d55a5d4d-e2c9-4488-a0e7-282123bdcc64 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:32.280924 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d55a5d4d-e2c9-4488-a0e7-282123bdcc64 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:32.600842 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-d55a5d4d-e2c9-4488-a0e7-282123bdcc64 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4aec5af742842f5bb2048c8b7d60687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829069b2787a423f922fcc5b5702f167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:32.627745 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-d55a5d4d-e2c9-4488-a0e7-282123bdcc64 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] 10.222.0.43 "GET /compute/v2.1/servers/101edf03-d928-461d-98cf-12753ae7f7d7" status: 200 len: 1319 microversion: 2.1 time: 0.370074 Oct 04 18:33:32.629439 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 377/696] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:32 2022] GET /compute/v2.1/servers/101edf03-d928-461d-98cf-12753ae7f7d7 => generated 1319 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:32.637752 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-0c80797b-ea65-43ee-99a3-dd3d8616b560 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:32.638943 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-0c80797b-ea65-43ee-99a3-dd3d8616b560 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] [instance: 84e0414b-a39f-4bfe-bc9d-c170ceb34d15] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:32.650334 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0c80797b-ea65-43ee-99a3-dd3d8616b560 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:32.651544 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0c80797b-ea65-43ee-99a3-dd3d8616b560 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:32.652985 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0c80797b-ea65-43ee-99a3-dd3d8616b560 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:32.654421 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0c80797b-ea65-43ee-99a3-dd3d8616b560 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:32.655483 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0c80797b-ea65-43ee-99a3-dd3d8616b560 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:32.656458 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0c80797b-ea65-43ee-99a3-dd3d8616b560 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:32.778757 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-0c80797b-ea65-43ee-99a3-dd3d8616b560 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:32.789975 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-0c80797b-ea65-43ee-99a3-dd3d8616b560 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:32.791747 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-0c80797b-ea65-43ee-99a3-dd3d8616b560 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:32.800641 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-0c80797b-ea65-43ee-99a3-dd3d8616b560 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] 10.222.0.43 "GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15" status: 200 len: 1553 microversion: 2.91 time: 0.168714 Oct 04 18:33:32.802751 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 378/697] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:33:32 2022] GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15 => generated 1553 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:33:32.817180 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-7c82a0e7-46c2-451d-9e5f-a48379ed9b9f tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:32.818164 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-7c82a0e7-46c2-451d-9e5f-a48379ed9b9f tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] [instance: fd5fe360-8ecf-41d0-9376-9d5533fc6ba8] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:32.839869 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7c82a0e7-46c2-451d-9e5f-a48379ed9b9f tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:32.840774 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7c82a0e7-46c2-451d-9e5f-a48379ed9b9f tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:32.841665 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7c82a0e7-46c2-451d-9e5f-a48379ed9b9f tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:32.842700 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7c82a0e7-46c2-451d-9e5f-a48379ed9b9f tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:32.843766 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7c82a0e7-46c2-451d-9e5f-a48379ed9b9f tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:32.844450 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7c82a0e7-46c2-451d-9e5f-a48379ed9b9f tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:33.257840 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-7c82a0e7-46c2-451d-9e5f-a48379ed9b9f tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:33.273281 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-7c82a0e7-46c2-451d-9e5f-a48379ed9b9f tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:33.275208 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-7c82a0e7-46c2-451d-9e5f-a48379ed9b9f tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:33.284261 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-7c82a0e7-46c2-451d-9e5f-a48379ed9b9f tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] 10.222.0.43 "GET /compute/v2.1/servers/fd5fe360-8ecf-41d0-9376-9d5533fc6ba8" status: 200 len: 1568 microversion: 2.25 time: 0.477792 Oct 04 18:33:33.285187 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 379/698] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:33:32 2022] GET /compute/v2.1/servers/fd5fe360-8ecf-41d0-9376-9d5533fc6ba8 => generated 1568 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:33:33.319559 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-44696012-9ff7-46dc-a666-e8b060285553 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:33.320301 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-44696012-9ff7-46dc-a666-e8b060285553 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] [instance: 8408d8e1-41b0-4185-8806-9808f082a016] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:33.347049 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-44696012-9ff7-46dc-a666-e8b060285553 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:33.348338 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-44696012-9ff7-46dc-a666-e8b060285553 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:33.348614 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-44696012-9ff7-46dc-a666-e8b060285553 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:33.349694 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-44696012-9ff7-46dc-a666-e8b060285553 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:33.350391 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-44696012-9ff7-46dc-a666-e8b060285553 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:33.350931 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-44696012-9ff7-46dc-a666-e8b060285553 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:33.615508 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-44696012-9ff7-46dc-a666-e8b060285553 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7db99f361654711bea7f1b2c404d312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7adedcdb9c3485ea2738c00e25aa3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:33.627095 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-44696012-9ff7-46dc-a666-e8b060285553 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] 10.222.0.43 "GET /compute/v2.1/servers/8408d8e1-41b0-4185-8806-9808f082a016" status: 200 len: 1317 microversion: 2.1 time: 0.339271 Oct 04 18:33:33.627684 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 380/699] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:33 2022] GET /compute/v2.1/servers/8408d8e1-41b0-4185-8806-9808f082a016 => generated 1317 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:33.646257 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-8575d686-9230-4b87-9f13-ddde153bbb77 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:33.649327 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-8575d686-9230-4b87-9f13-ddde153bbb77 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] [instance: 918d6106-9c7c-4046-9cdd-319afe4cdb25] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:33.666390 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8575d686-9230-4b87-9f13-ddde153bbb77 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:33.666901 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8575d686-9230-4b87-9f13-ddde153bbb77 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:33.667560 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8575d686-9230-4b87-9f13-ddde153bbb77 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:33.670148 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8575d686-9230-4b87-9f13-ddde153bbb77 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:33.670634 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8575d686-9230-4b87-9f13-ddde153bbb77 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:33.671171 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8575d686-9230-4b87-9f13-ddde153bbb77 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:34.038676 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-8575d686-9230-4b87-9f13-ddde153bbb77 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb7b0ce49ec438f9a60b79bdb2ac164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94ae6e2cb75d410d8029aa49909c973b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:34.060620 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-8575d686-9230-4b87-9f13-ddde153bbb77 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] 10.222.0.43 "GET /compute/v2.1/servers/918d6106-9c7c-4046-9cdd-319afe4cdb25" status: 200 len: 1477 microversion: 2.1 time: 0.429137 Oct 04 18:33:34.061209 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 381/700] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:33 2022] GET /compute/v2.1/servers/918d6106-9c7c-4046-9cdd-319afe4cdb25 => generated 1477 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:34.082778 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-82b5996d-6a04-44a0-82c6-341fd53c6cc2 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:34.083415 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-82b5996d-6a04-44a0-82c6-341fd53c6cc2 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] [instance: 101edf03-d928-461d-98cf-12753ae7f7d7] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:34.103489 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-82b5996d-6a04-44a0-82c6-341fd53c6cc2 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:34.114404 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-82b5996d-6a04-44a0-82c6-341fd53c6cc2 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:34.116305 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-82b5996d-6a04-44a0-82c6-341fd53c6cc2 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:34.120095 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-82b5996d-6a04-44a0-82c6-341fd53c6cc2 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:34.123209 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-82b5996d-6a04-44a0-82c6-341fd53c6cc2 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:34.123666 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-82b5996d-6a04-44a0-82c6-341fd53c6cc2 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:34.180908 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=10 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:33:34.616930 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-82b5996d-6a04-44a0-82c6-341fd53c6cc2 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4aec5af742842f5bb2048c8b7d60687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829069b2787a423f922fcc5b5702f167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:34.631867 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-82b5996d-6a04-44a0-82c6-341fd53c6cc2 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] 10.222.0.43 "GET /compute/v2.1/servers/101edf03-d928-461d-98cf-12753ae7f7d7" status: 200 len: 1319 microversion: 2.1 time: 0.568888 Oct 04 18:33:34.636628 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 382/701] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:34 2022] GET /compute/v2.1/servers/101edf03-d928-461d-98cf-12753ae7f7d7 => generated 1319 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:34.656872 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-a6df1676-cb94-4307-bd97-222ade09ebea tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:34.658112 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-a6df1676-cb94-4307-bd97-222ade09ebea tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] [instance: 84e0414b-a39f-4bfe-bc9d-c170ceb34d15] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:34.675014 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a6df1676-cb94-4307-bd97-222ade09ebea tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:34.676076 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a6df1676-cb94-4307-bd97-222ade09ebea tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:34.677748 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a6df1676-cb94-4307-bd97-222ade09ebea tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:34.679108 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a6df1676-cb94-4307-bd97-222ade09ebea tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:34.680575 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a6df1676-cb94-4307-bd97-222ade09ebea tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:34.681388 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a6df1676-cb94-4307-bd97-222ade09ebea tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:34.787123 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-2a4f8329-7d05-480b-af8e-cc88f78eb259 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Flavor limits 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:33:34.787840 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-2a4f8329-7d05-480b-af8e-cc88f78eb259 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Image limits 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:33:34.788682 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-2a4f8329-7d05-480b-af8e-cc88f78eb259 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Flavor pref 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:33:34.789446 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-2a4f8329-7d05-480b-af8e-cc88f78eb259 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Image pref 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:33:34.790324 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-2a4f8329-7d05-480b-af8e-cc88f78eb259 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:33:34.835411 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2a4f8329-7d05-480b-af8e-cc88f78eb259 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:34.836131 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2a4f8329-7d05-480b-af8e-cc88f78eb259 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:34.836796 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2a4f8329-7d05-480b-af8e-cc88f78eb259 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:34.837989 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2a4f8329-7d05-480b-af8e-cc88f78eb259 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:34.857372 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2a4f8329-7d05-480b-af8e-cc88f78eb259 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:34.859010 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2a4f8329-7d05-480b-af8e-cc88f78eb259 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:34.929765 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:33:34.969064 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-2a4f8329-7d05-480b-af8e-cc88f78eb259 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Getting quotas for project 4fa31ed92017490a82497c7b8910aef0. Resources: {'ram', 'cores', 'instances'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:33:34.983782 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-2a4f8329-7d05-480b-af8e-cc88f78eb259 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Getting quotas for user 5a41ab6fb78a42ceaca621c5a38ffc6d and project 4fa31ed92017490a82497c7b8910aef0. Resources: {'ram', 'cores', 'instances'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:33:34.988002 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-a6df1676-cb94-4307-bd97-222ade09ebea tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:35.000773 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-a6df1676-cb94-4307-bd97-222ade09ebea tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:35.006949 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-a6df1676-cb94-4307-bd97-222ade09ebea tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:35.010605 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-2a4f8329-7d05-480b-af8e-cc88f78eb259 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Going to run 1 instances... {{(pid=123595) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:33:35.014328 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-2a4f8329-7d05-480b-af8e-cc88f78eb259 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] [instance: 533db4f5-5f62-47ab-9d4c-5e5a95c0b756] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e8943ec5-4038-4d4b-b9b9-2415a79f5243',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:33:35.027500 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-a6df1676-cb94-4307-bd97-222ade09ebea tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] 10.222.0.43 "GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15" status: 200 len: 1553 microversion: 2.91 time: 0.388899 Oct 04 18:33:35.036712 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 383/702] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:33:34 2022] GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15 => generated 1553 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:33:35.052945 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-9d95df92-d8b1-4351-95ed-9b1e53363108 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:35.061647 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-9d95df92-d8b1-4351-95ed-9b1e53363108 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] [instance: fd5fe360-8ecf-41d0-9376-9d5533fc6ba8] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:35.089848 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9d95df92-d8b1-4351-95ed-9b1e53363108 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:35.091805 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9d95df92-d8b1-4351-95ed-9b1e53363108 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:35.092525 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9d95df92-d8b1-4351-95ed-9b1e53363108 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:35.094240 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9d95df92-d8b1-4351-95ed-9b1e53363108 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:35.095838 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9d95df92-d8b1-4351-95ed-9b1e53363108 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:35.097146 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9d95df92-d8b1-4351-95ed-9b1e53363108 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:35.184457 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-2a4f8329-7d05-480b-af8e-cc88f78eb259 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.948424 Oct 04 18:33:35.195084 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 320/703] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 18:33:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 3961 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:33:35.205543 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-4d3d103e-4a18-4608-a1df-5be5d2a7b8cd tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:35.206946 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-4d3d103e-4a18-4608-a1df-5be5d2a7b8cd tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] [instance: 8408d8e1-41b0-4185-8806-9808f082a016] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:35.227336 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4d3d103e-4a18-4608-a1df-5be5d2a7b8cd tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:35.227986 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4d3d103e-4a18-4608-a1df-5be5d2a7b8cd tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:35.229459 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4d3d103e-4a18-4608-a1df-5be5d2a7b8cd tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:35.231637 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4d3d103e-4a18-4608-a1df-5be5d2a7b8cd tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:35.234760 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4d3d103e-4a18-4608-a1df-5be5d2a7b8cd tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:35.236352 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4d3d103e-4a18-4608-a1df-5be5d2a7b8cd tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:35.539301 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-9d95df92-d8b1-4351-95ed-9b1e53363108 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:35.564984 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-9d95df92-d8b1-4351-95ed-9b1e53363108 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:35.566620 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-9d95df92-d8b1-4351-95ed-9b1e53363108 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:35.568652 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-9d95df92-d8b1-4351-95ed-9b1e53363108 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] 10.222.0.43 "GET /compute/v2.1/servers/fd5fe360-8ecf-41d0-9376-9d5533fc6ba8" status: 200 len: 1568 microversion: 2.25 time: 0.529175 Oct 04 18:33:35.574507 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 384/704] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:33:35 2022] GET /compute/v2.1/servers/fd5fe360-8ecf-41d0-9376-9d5533fc6ba8 => generated 1568 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:33:35.599807 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-33540668-7e61-4d18-889e-52ed07b8c088 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:35.600428 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-33540668-7e61-4d18-889e-52ed07b8c088 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] [instance: 918d6106-9c7c-4046-9cdd-319afe4cdb25] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:35.631208 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-33540668-7e61-4d18-889e-52ed07b8c088 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:35.631766 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-33540668-7e61-4d18-889e-52ed07b8c088 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:35.632159 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-33540668-7e61-4d18-889e-52ed07b8c088 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:35.641553 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-4d3d103e-4a18-4608-a1df-5be5d2a7b8cd tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7db99f361654711bea7f1b2c404d312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7adedcdb9c3485ea2738c00e25aa3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:35.647584 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-33540668-7e61-4d18-889e-52ed07b8c088 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:35.648142 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-33540668-7e61-4d18-889e-52ed07b8c088 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:35.648600 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-33540668-7e61-4d18-889e-52ed07b8c088 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:35.652877 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-4d3d103e-4a18-4608-a1df-5be5d2a7b8cd tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] 10.222.0.43 "GET /compute/v2.1/servers/8408d8e1-41b0-4185-8806-9808f082a016" status: 200 len: 1317 microversion: 2.1 time: 0.455769 Oct 04 18:33:35.653524 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 321/705] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:35 2022] GET /compute/v2.1/servers/8408d8e1-41b0-4185-8806-9808f082a016 => generated 1317 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:35.674677 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-e3fac808-2b6b-4505-bbd0-2a157dde35a4 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:35.675556 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-e3fac808-2b6b-4505-bbd0-2a157dde35a4 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] [instance: 533db4f5-5f62-47ab-9d4c-5e5a95c0b756] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:35.820918 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-e3fac808-2b6b-4505-bbd0-2a157dde35a4 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a41ab6fb78a42ceaca621c5a38ffc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa31ed92017490a82497c7b8910aef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:35.839609 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-e3fac808-2b6b-4505-bbd0-2a157dde35a4 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] 10.222.0.43 "GET /compute/v2.1/servers/533db4f5-5f62-47ab-9d4c-5e5a95c0b756" status: 200 len: 1208 microversion: 2.1 time: 0.174423 Oct 04 18:33:35.840659 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 322/706] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:35 2022] GET /compute/v2.1/servers/533db4f5-5f62-47ab-9d4c-5e5a95c0b756 => generated 1208 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:35.890906 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-d25e1c74-58fa-412a-bbc4-5072ffd90b87 req-5e5dc3a6-1c3c-4c5f-96ba-f52c98161bdd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "918d6106-9c7c-4046-9cdd-319afe4cdb25", "name": "network-vif-deleted", "tag": "bc88b509-77d8-4be9-9d0b-1aa4318894e1"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:33:35.910194 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-d25e1c74-58fa-412a-bbc4-5072ffd90b87 req-5e5dc3a6-1c3c-4c5f-96ba-f52c98161bdd service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:35.911855 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-d25e1c74-58fa-412a-bbc4-5072ffd90b87 req-5e5dc3a6-1c3c-4c5f-96ba-f52c98161bdd service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:35.912538 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-d25e1c74-58fa-412a-bbc4-5072ffd90b87 req-5e5dc3a6-1c3c-4c5f-96ba-f52c98161bdd service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:35.939041 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-d25e1c74-58fa-412a-bbc4-5072ffd90b87 req-5e5dc3a6-1c3c-4c5f-96ba-f52c98161bdd service nova] Creating event network-vif-deleted:bc88b509-77d8-4be9-9d0b-1aa4318894e1 for instance 918d6106-9c7c-4046-9cdd-319afe4cdb25 on n-h1-851028-13 Oct 04 18:33:35.947953 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-d25e1c74-58fa-412a-bbc4-5072ffd90b87 req-5e5dc3a6-1c3c-4c5f-96ba-f52c98161bdd service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070575 Oct 04 18:33:35.949495 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 323/707] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:33:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:33:35.957284 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-71eb82c1-93a5-4d0d-9ce6-31e17fef72ad tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:35.959526 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-71eb82c1-93a5-4d0d-9ce6-31e17fef72ad tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] [instance: 101edf03-d928-461d-98cf-12753ae7f7d7] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:35.962744 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-33540668-7e61-4d18-889e-52ed07b8c088 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb7b0ce49ec438f9a60b79bdb2ac164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94ae6e2cb75d410d8029aa49909c973b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:35.968812 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-71eb82c1-93a5-4d0d-9ce6-31e17fef72ad tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:35.969829 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-71eb82c1-93a5-4d0d-9ce6-31e17fef72ad tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:35.970961 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-71eb82c1-93a5-4d0d-9ce6-31e17fef72ad tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:35.972400 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-71eb82c1-93a5-4d0d-9ce6-31e17fef72ad tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:35.973273 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-71eb82c1-93a5-4d0d-9ce6-31e17fef72ad tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:35.974084 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-71eb82c1-93a5-4d0d-9ce6-31e17fef72ad tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:35.982971 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-33540668-7e61-4d18-889e-52ed07b8c088 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] 10.222.0.43 "GET /compute/v2.1/servers/918d6106-9c7c-4046-9cdd-319afe4cdb25" status: 200 len: 1435 microversion: 2.1 time: 0.401261 Oct 04 18:33:35.983640 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 385/708] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:35 2022] GET /compute/v2.1/servers/918d6106-9c7c-4046-9cdd-319afe4cdb25 => generated 1435 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:36.069771 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-6afe320f-1e82-4b94-b206-43b00fe0bcd0 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:36.070086 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-6afe320f-1e82-4b94-b206-43b00fe0bcd0 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] [instance: 84e0414b-a39f-4bfe-bc9d-c170ceb34d15] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:36.082556 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6afe320f-1e82-4b94-b206-43b00fe0bcd0 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:36.084073 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6afe320f-1e82-4b94-b206-43b00fe0bcd0 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:36.086175 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6afe320f-1e82-4b94-b206-43b00fe0bcd0 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:36.088317 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6afe320f-1e82-4b94-b206-43b00fe0bcd0 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:36.089688 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6afe320f-1e82-4b94-b206-43b00fe0bcd0 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:36.093938 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6afe320f-1e82-4b94-b206-43b00fe0bcd0 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:36.261845 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-6afe320f-1e82-4b94-b206-43b00fe0bcd0 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:36.283351 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-6afe320f-1e82-4b94-b206-43b00fe0bcd0 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:36.285130 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-6afe320f-1e82-4b94-b206-43b00fe0bcd0 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:36.299879 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-6afe320f-1e82-4b94-b206-43b00fe0bcd0 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] 10.222.0.43 "GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15" status: 200 len: 1553 microversion: 2.91 time: 0.234765 Oct 04 18:33:36.300492 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 386/709] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:33:36 2022] GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15 => generated 1553 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:33:36.604152 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-4f0dd053-de48-4d0f-8ce1-e61df98b62a3 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:36.605335 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-4f0dd053-de48-4d0f-8ce1-e61df98b62a3 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] [instance: fd5fe360-8ecf-41d0-9376-9d5533fc6ba8] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:36.622353 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4f0dd053-de48-4d0f-8ce1-e61df98b62a3 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:36.624396 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4f0dd053-de48-4d0f-8ce1-e61df98b62a3 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:36.627005 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4f0dd053-de48-4d0f-8ce1-e61df98b62a3 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:36.628832 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4f0dd053-de48-4d0f-8ce1-e61df98b62a3 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:36.629507 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4f0dd053-de48-4d0f-8ce1-e61df98b62a3 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:36.631456 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4f0dd053-de48-4d0f-8ce1-e61df98b62a3 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:36.693428 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-71eb82c1-93a5-4d0d-9ce6-31e17fef72ad tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4aec5af742842f5bb2048c8b7d60687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829069b2787a423f922fcc5b5702f167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:36.702731 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-71eb82c1-93a5-4d0d-9ce6-31e17fef72ad tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] 10.222.0.43 "GET /compute/v2.1/servers/101edf03-d928-461d-98cf-12753ae7f7d7" status: 200 len: 1319 microversion: 2.1 time: 0.750474 Oct 04 18:33:36.714306 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 324/710] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:35 2022] GET /compute/v2.1/servers/101edf03-d928-461d-98cf-12753ae7f7d7 => generated 1319 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:36.720791 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-17174ada-e9c7-4267-a956-701e50b08712 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:36.721434 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-17174ada-e9c7-4267-a956-701e50b08712 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] [instance: 8408d8e1-41b0-4185-8806-9808f082a016] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:36.740758 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-17174ada-e9c7-4267-a956-701e50b08712 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:36.745921 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-17174ada-e9c7-4267-a956-701e50b08712 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:36.746593 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-17174ada-e9c7-4267-a956-701e50b08712 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:36.747485 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-17174ada-e9c7-4267-a956-701e50b08712 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:36.748384 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-17174ada-e9c7-4267-a956-701e50b08712 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:36.749656 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-17174ada-e9c7-4267-a956-701e50b08712 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:36.949137 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-4f0dd053-de48-4d0f-8ce1-e61df98b62a3 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:36.962305 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-4f0dd053-de48-4d0f-8ce1-e61df98b62a3 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:36.964064 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-4f0dd053-de48-4d0f-8ce1-e61df98b62a3 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:36.965486 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-4f0dd053-de48-4d0f-8ce1-e61df98b62a3 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] 10.222.0.43 "GET /compute/v2.1/servers/fd5fe360-8ecf-41d0-9376-9d5533fc6ba8" status: 200 len: 1568 microversion: 2.25 time: 0.368459 Oct 04 18:33:36.966597 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 387/711] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:33:36 2022] GET /compute/v2.1/servers/fd5fe360-8ecf-41d0-9376-9d5533fc6ba8 => generated 1568 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:33:36.971454 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-883ce653-d05e-496d-9734-c5c87f82de36 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:36.978213 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-883ce653-d05e-496d-9734-c5c87f82de36 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] [instance: 533db4f5-5f62-47ab-9d4c-5e5a95c0b756] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:36.993896 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-883ce653-d05e-496d-9734-c5c87f82de36 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:36.994418 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-883ce653-d05e-496d-9734-c5c87f82de36 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:36.994873 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-883ce653-d05e-496d-9734-c5c87f82de36 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:36.995606 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-883ce653-d05e-496d-9734-c5c87f82de36 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:36.996055 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-883ce653-d05e-496d-9734-c5c87f82de36 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:36.996476 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-883ce653-d05e-496d-9734-c5c87f82de36 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:37.111280 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-883ce653-d05e-496d-9734-c5c87f82de36 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a41ab6fb78a42ceaca621c5a38ffc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa31ed92017490a82497c7b8910aef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:37.131301 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-883ce653-d05e-496d-9734-c5c87f82de36 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] 10.222.0.43 "GET /compute/v2.1/servers/533db4f5-5f62-47ab-9d4c-5e5a95c0b756" status: 200 len: 1260 microversion: 2.1 time: 0.163314 Oct 04 18:33:37.147323 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 388/712] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:36 2022] GET /compute/v2.1/servers/533db4f5-5f62-47ab-9d4c-5e5a95c0b756 => generated 1260 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:37.169586 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-49865de3-30f1-4313-b993-5285bfcb1df6 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:37.171377 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-49865de3-30f1-4313-b993-5285bfcb1df6 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] [instance: 918d6106-9c7c-4046-9cdd-319afe4cdb25] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:37.184251 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-49865de3-30f1-4313-b993-5285bfcb1df6 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:37.184929 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-49865de3-30f1-4313-b993-5285bfcb1df6 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:37.189065 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-49865de3-30f1-4313-b993-5285bfcb1df6 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:37.190224 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-49865de3-30f1-4313-b993-5285bfcb1df6 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:37.190754 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-49865de3-30f1-4313-b993-5285bfcb1df6 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:37.191294 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-49865de3-30f1-4313-b993-5285bfcb1df6 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:37.234500 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-49865de3-30f1-4313-b993-5285bfcb1df6 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:37.236081 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-49865de3-30f1-4313-b993-5285bfcb1df6 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:37.236703 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-49865de3-30f1-4313-b993-5285bfcb1df6 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:37.237195 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.objects.instance [None req-49865de3-30f1-4313-b993-5285bfcb1df6 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Lazy-loading 'fault' on Instance uuid 918d6106-9c7c-4046-9cdd-319afe4cdb25 {{(pid=123596) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:33:37.400837 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-17174ada-e9c7-4267-a956-701e50b08712 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7db99f361654711bea7f1b2c404d312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7adedcdb9c3485ea2738c00e25aa3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:37.409968 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-17174ada-e9c7-4267-a956-701e50b08712 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] 10.222.0.43 "GET /compute/v2.1/servers/8408d8e1-41b0-4185-8806-9808f082a016" status: 200 len: 1317 microversion: 2.1 time: 0.694458 Oct 04 18:33:37.415394 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 325/713] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:36 2022] GET /compute/v2.1/servers/8408d8e1-41b0-4185-8806-9808f082a016 => generated 1317 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:37.421229 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-bad60763-adca-4304-bf9b-c70a2ec12ac8 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:37.429251 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-bad60763-adca-4304-bf9b-c70a2ec12ac8 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] [instance: 84e0414b-a39f-4bfe-bc9d-c170ceb34d15] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:37.436743 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bad60763-adca-4304-bf9b-c70a2ec12ac8 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:37.441855 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bad60763-adca-4304-bf9b-c70a2ec12ac8 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:37.443205 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bad60763-adca-4304-bf9b-c70a2ec12ac8 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:37.444145 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bad60763-adca-4304-bf9b-c70a2ec12ac8 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:37.445312 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bad60763-adca-4304-bf9b-c70a2ec12ac8 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:37.447624 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bad60763-adca-4304-bf9b-c70a2ec12ac8 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:37.575721 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-bad60763-adca-4304-bf9b-c70a2ec12ac8 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:37.586131 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-bad60763-adca-4304-bf9b-c70a2ec12ac8 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:37.591699 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-bad60763-adca-4304-bf9b-c70a2ec12ac8 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:37.606574 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-bad60763-adca-4304-bf9b-c70a2ec12ac8 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] 10.222.0.43 "GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15" status: 200 len: 1553 microversion: 2.91 time: 0.189501 Oct 04 18:33:37.610463 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 326/714] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:33:37 2022] GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15 => generated 1553 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:33:37.749981 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-88617733-605c-48ed-b0a4-f21ad96a822c tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:37.750648 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-88617733-605c-48ed-b0a4-f21ad96a822c tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] [instance: 101edf03-d928-461d-98cf-12753ae7f7d7] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:37.763296 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-88617733-605c-48ed-b0a4-f21ad96a822c tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:37.763977 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-88617733-605c-48ed-b0a4-f21ad96a822c tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:37.764542 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-88617733-605c-48ed-b0a4-f21ad96a822c tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:37.765405 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-88617733-605c-48ed-b0a4-f21ad96a822c tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:37.771058 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-88617733-605c-48ed-b0a4-f21ad96a822c tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:37.771677 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-88617733-605c-48ed-b0a4-f21ad96a822c tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:37.973024 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-49865de3-30f1-4313-b993-5285bfcb1df6 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb7b0ce49ec438f9a60b79bdb2ac164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94ae6e2cb75d410d8029aa49909c973b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:37.993786 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-49865de3-30f1-4313-b993-5285bfcb1df6 tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] 10.222.0.43 "GET /compute/v2.1/servers/918d6106-9c7c-4046-9cdd-319afe4cdb25" status: 200 len: 1311 microversion: 2.1 time: 0.840531 Oct 04 18:33:38.011613 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 389/715] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:37 2022] GET /compute/v2.1/servers/918d6106-9c7c-4046-9cdd-319afe4cdb25 => generated 1311 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:38.034753 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-7213d655-ced3-41d2-aed9-a425d05cbfe8 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:38.035681 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-7213d655-ced3-41d2-aed9-a425d05cbfe8 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] [instance: fd5fe360-8ecf-41d0-9376-9d5533fc6ba8] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:38.055895 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7213d655-ced3-41d2-aed9-a425d05cbfe8 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:38.058988 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7213d655-ced3-41d2-aed9-a425d05cbfe8 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:38.060179 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7213d655-ced3-41d2-aed9-a425d05cbfe8 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:38.061475 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7213d655-ced3-41d2-aed9-a425d05cbfe8 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:38.067716 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7213d655-ced3-41d2-aed9-a425d05cbfe8 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:38.073478 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7213d655-ced3-41d2-aed9-a425d05cbfe8 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:38.366218 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-7213d655-ced3-41d2-aed9-a425d05cbfe8 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:38.370019 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=100 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:33:38.383095 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-7213d655-ced3-41d2-aed9-a425d05cbfe8 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:38.384716 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-7213d655-ced3-41d2-aed9-a425d05cbfe8 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:38.385976 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-7213d655-ced3-41d2-aed9-a425d05cbfe8 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] 10.222.0.43 "GET /compute/v2.1/servers/fd5fe360-8ecf-41d0-9376-9d5533fc6ba8" status: 200 len: 1568 microversion: 2.25 time: 0.372112 Oct 04 18:33:38.401147 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 390/716] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:33:38 2022] GET /compute/v2.1/servers/fd5fe360-8ecf-41d0-9376-9d5533fc6ba8 => generated 1568 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:33:38.401147 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-997e6d45-caba-41d5-9aac-738a2f39bf7d tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:38.401147 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-997e6d45-caba-41d5-9aac-738a2f39bf7d tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] [instance: 533db4f5-5f62-47ab-9d4c-5e5a95c0b756] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:38.420354 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-997e6d45-caba-41d5-9aac-738a2f39bf7d tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:38.420857 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-997e6d45-caba-41d5-9aac-738a2f39bf7d tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:38.421334 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-997e6d45-caba-41d5-9aac-738a2f39bf7d tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:38.437811 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-997e6d45-caba-41d5-9aac-738a2f39bf7d tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:38.440339 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-997e6d45-caba-41d5-9aac-738a2f39bf7d tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:38.440973 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-997e6d45-caba-41d5-9aac-738a2f39bf7d tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:38.518680 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-88617733-605c-48ed-b0a4-f21ad96a822c tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4aec5af742842f5bb2048c8b7d60687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829069b2787a423f922fcc5b5702f167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:38.534533 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-88617733-605c-48ed-b0a4-f21ad96a822c tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] 10.222.0.43 "GET /compute/v2.1/servers/101edf03-d928-461d-98cf-12753ae7f7d7" status: 200 len: 1319 microversion: 2.1 time: 0.783053 Oct 04 18:33:38.539839 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 327/717] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:37 2022] GET /compute/v2.1/servers/101edf03-d928-461d-98cf-12753ae7f7d7 => generated 1319 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:38.571599 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-930c4b6c-bed0-4854-9885-2a55acfe4059 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:38.572267 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-930c4b6c-bed0-4854-9885-2a55acfe4059 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] [instance: 8408d8e1-41b0-4185-8806-9808f082a016] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:38.622387 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-930c4b6c-bed0-4854-9885-2a55acfe4059 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:38.623243 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-930c4b6c-bed0-4854-9885-2a55acfe4059 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:38.623762 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-930c4b6c-bed0-4854-9885-2a55acfe4059 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:38.624620 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-930c4b6c-bed0-4854-9885-2a55acfe4059 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:38.625094 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-930c4b6c-bed0-4854-9885-2a55acfe4059 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:38.625615 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-930c4b6c-bed0-4854-9885-2a55acfe4059 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:38.698634 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-997e6d45-caba-41d5-9aac-738a2f39bf7d tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a41ab6fb78a42ceaca621c5a38ffc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa31ed92017490a82497c7b8910aef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:38.714804 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-997e6d45-caba-41d5-9aac-738a2f39bf7d tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] 10.222.0.43 "GET /compute/v2.1/servers/533db4f5-5f62-47ab-9d4c-5e5a95c0b756" status: 200 len: 1266 microversion: 2.1 time: 0.325663 Oct 04 18:33:38.718115 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 391/718] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:38 2022] GET /compute/v2.1/servers/533db4f5-5f62-47ab-9d4c-5e5a95c0b756 => generated 1266 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:38.750211 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-0e784369-4405-4ec5-bd8b-f5b5a727390f tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:38.757292 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-0e784369-4405-4ec5-bd8b-f5b5a727390f tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] [instance: 84e0414b-a39f-4bfe-bc9d-c170ceb34d15] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:38.779306 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0e784369-4405-4ec5-bd8b-f5b5a727390f tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:38.779824 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0e784369-4405-4ec5-bd8b-f5b5a727390f tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:38.781987 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0e784369-4405-4ec5-bd8b-f5b5a727390f tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:38.784084 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0e784369-4405-4ec5-bd8b-f5b5a727390f tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:38.787378 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0e784369-4405-4ec5-bd8b-f5b5a727390f tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:38.787861 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0e784369-4405-4ec5-bd8b-f5b5a727390f tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:39.086008 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-930c4b6c-bed0-4854-9885-2a55acfe4059 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7db99f361654711bea7f1b2c404d312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7adedcdb9c3485ea2738c00e25aa3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:39.096881 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-930c4b6c-bed0-4854-9885-2a55acfe4059 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] 10.222.0.43 "GET /compute/v2.1/servers/8408d8e1-41b0-4185-8806-9808f082a016" status: 200 len: 1317 microversion: 2.1 time: 0.553330 Oct 04 18:33:39.120760 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 328/719] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:38 2022] GET /compute/v2.1/servers/8408d8e1-41b0-4185-8806-9808f082a016 => generated 1317 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:39.132863 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-a2820437-d56f-4a68-a3fd-a7853395942c tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:39.133722 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-a2820437-d56f-4a68-a3fd-a7853395942c tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] [instance: 918d6106-9c7c-4046-9cdd-319afe4cdb25] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:39.147440 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a2820437-d56f-4a68-a3fd-a7853395942c tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:39.147948 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a2820437-d56f-4a68-a3fd-a7853395942c tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:39.148394 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a2820437-d56f-4a68-a3fd-a7853395942c tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:39.149135 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a2820437-d56f-4a68-a3fd-a7853395942c tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:39.163623 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a2820437-d56f-4a68-a3fd-a7853395942c tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:39.164205 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a2820437-d56f-4a68-a3fd-a7853395942c tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:39.166015 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-0e784369-4405-4ec5-bd8b-f5b5a727390f tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:39.176372 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-0e784369-4405-4ec5-bd8b-f5b5a727390f tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:39.184335 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-0e784369-4405-4ec5-bd8b-f5b5a727390f tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:39.191816 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-a2820437-d56f-4a68-a3fd-a7853395942c tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] HTTP exception thrown: Instance 918d6106-9c7c-4046-9cdd-319afe4cdb25 could not be found. Oct 04 18:33:39.198364 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-0e784369-4405-4ec5-bd8b-f5b5a727390f tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] 10.222.0.43 "GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15" status: 200 len: 1553 microversion: 2.91 time: 0.475540 Oct 04 18:33:39.198903 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-a2820437-d56f-4a68-a3fd-a7853395942c tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Request method failure captured: Oct 04 18:33:39.198903 n-d-851028-13 devstack@n-api.service[123595]: request: GET /compute/v2.1/servers/918d6106-9c7c-4046-9cdd-319afe4cdb25 HTTP/1.1 Oct 04 18:33:39.198903 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 18:33:39.198903 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 18:33:39.198903 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 18:33:39.198903 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 0 Oct 04 18:33:39.198903 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 18:33:39.198903 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 18:33:39.198903 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 18:33:39.198903 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 18:33:39.198903 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPHwzsk-n6ULMV06SW99ekV8Tnkog9uAF1R2CgcGZzE9X_MnxBvFTdLdSSiSlIOBRrd3oO-f02e6pq95uD6P7i0lT3OXUwYU8YnXIcvVeIl-wgrgXS9W10xRV_R9MJwI5TCCZ4LWMWED4LCFVPxmfc2ukRQQ75CNglnwfWenkLyFWcno Oct 04 18:33:39.198903 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 18:33:39.198903 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 18:33:39.198903 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 18:33:39.198903 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 18:33:39.198903 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 18:33:39.198903 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 18:33:39.198903 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: 94ae6e2cb75d410d8029aa49909c973b Oct 04 18:33:39.198903 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-679418353 Oct 04 18:33:39.198903 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 18:33:39.198903 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 18:33:39.200516 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/94ae6e2cb75d410d8029aa49909c973b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_94ae6e2cb75d410d8029aa49909c973b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/94ae6e2cb75d410d8029aa49909c973b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/94ae6e2cb75d410d8029aa49909c973b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:33:39.200516 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-ServersAdminNegativeTestJSON-679418353 Oct 04 18:33:39.200516 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: 94ae6e2cb75d410d8029aa49909c973b Oct 04 18:33:39.200516 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-679418353 Oct 04 18:33:39.200516 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-ServersAdminNegativeTestJSON-679418353-project Oct 04 18:33:39.200516 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 18:33:39.200516 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 18:33:39.200516 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: cdb7b0ce49ec438f9a60b79bdb2ac164 Oct 04 18:33:39.200516 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-ServersAdminNegativeTestJSON-679418353-project Oct 04 18:33:39.200516 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 18:33:39.200516 n-d-851028-13 devstack@n-api.service[123595]: exception: Instance 918d6106-9c7c-4046-9cdd-319afe4cdb25 could not be found. Oct 04 18:33:39.200516 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': '918d6106-9c7c-4046-9cdd-319afe4cdb25'} Oct 04 18:33:39.201459 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:33:39.201459 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:33:39.201459 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:33:39.201459 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:33:39.201459 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:33:39.201459 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:33:39.201459 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:33:39.201459 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:33:39.201459 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:33:39.201459 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:33:39.201459 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 918d6106-9c7c-4046-9cdd-319afe4cdb25 could not be found. Oct 04 18:33:39.201459 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:33:39.201459 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:33:39.201459 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:33:39.201459 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:33:39.201459 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:33:39.201459 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:33:39.201459 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:33:39.201459 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:33:39.201459 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:33:39.202979 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:33:39.202979 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:33:39.202979 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:33:39.202979 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:33:39.202979 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:33:39.202979 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:33:39.202979 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:33:39.202979 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 918d6106-9c7c-4046-9cdd-319afe4cdb25 could not be found. Oct 04 18:33:39.202979 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:33:39.202979 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:33:39.202979 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:33:39.202979 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:33:39.202979 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:33:39.202979 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:33:39.202979 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:33:39.202979 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:33:39.202979 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 918d6106-9c7c-4046-9cdd-319afe4cdb25 could not be found. Oct 04 18:33:39.202979 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:33:39.204290 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-a2820437-d56f-4a68-a3fd-a7853395942c tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] Returning 404 to user: Instance 918d6106-9c7c-4046-9cdd-319afe4cdb25 could not be found. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:33:39.204290 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-a2820437-d56f-4a68-a3fd-a7853395942c tempest-ServersAdminNegativeTestJSON-679418353 tempest-ServersAdminNegativeTestJSON-679418353-project] 10.222.0.43 "GET /compute/v2.1/servers/918d6106-9c7c-4046-9cdd-319afe4cdb25" status: 404 len: 111 microversion: 2.1 time: 0.078324 Oct 04 18:33:39.207447 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 392/721] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:33:38 2022] GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15 => generated 1553 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:33:39.207583 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 329/721] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:39 2022] GET /compute/v2.1/servers/918d6106-9c7c-4046-9cdd-319afe4cdb25 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:33:39.416347 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-4058331d-9c31-49ec-8139-f114ef80c202 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:39.416988 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-4058331d-9c31-49ec-8139-f114ef80c202 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] [instance: fd5fe360-8ecf-41d0-9376-9d5533fc6ba8] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:39.424898 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4058331d-9c31-49ec-8139-f114ef80c202 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:39.425448 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4058331d-9c31-49ec-8139-f114ef80c202 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:39.431064 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4058331d-9c31-49ec-8139-f114ef80c202 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:39.438278 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4058331d-9c31-49ec-8139-f114ef80c202 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:39.438977 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4058331d-9c31-49ec-8139-f114ef80c202 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:39.439878 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4058331d-9c31-49ec-8139-f114ef80c202 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:39.566416 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-178b6b58-3b38-44fb-9787-a8cc2f6ab4d8 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:39.567281 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-178b6b58-3b38-44fb-9787-a8cc2f6ab4d8 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] [instance: 101edf03-d928-461d-98cf-12753ae7f7d7] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:39.584469 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-178b6b58-3b38-44fb-9787-a8cc2f6ab4d8 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:39.584988 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-178b6b58-3b38-44fb-9787-a8cc2f6ab4d8 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:39.585498 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-178b6b58-3b38-44fb-9787-a8cc2f6ab4d8 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:39.586214 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-178b6b58-3b38-44fb-9787-a8cc2f6ab4d8 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:39.586672 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-178b6b58-3b38-44fb-9787-a8cc2f6ab4d8 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:39.587991 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-178b6b58-3b38-44fb-9787-a8cc2f6ab4d8 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:40.063904 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-4058331d-9c31-49ec-8139-f114ef80c202 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:40.074125 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-4058331d-9c31-49ec-8139-f114ef80c202 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:40.081883 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-4058331d-9c31-49ec-8139-f114ef80c202 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:40.083484 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-4058331d-9c31-49ec-8139-f114ef80c202 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] 10.222.0.43 "GET /compute/v2.1/servers/fd5fe360-8ecf-41d0-9376-9d5533fc6ba8" status: 200 len: 1568 microversion: 2.25 time: 0.671164 Oct 04 18:33:40.094466 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 330/722] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:33:39 2022] GET /compute/v2.1/servers/fd5fe360-8ecf-41d0-9376-9d5533fc6ba8 => generated 1568 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:33:40.100764 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-4d42c1c6-de75-4a94-ac01-097834004683 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:40.101703 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-4d42c1c6-de75-4a94-ac01-097834004683 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] [instance: 533db4f5-5f62-47ab-9d4c-5e5a95c0b756] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:40.116056 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4d42c1c6-de75-4a94-ac01-097834004683 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:40.123484 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4d42c1c6-de75-4a94-ac01-097834004683 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:40.124280 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4d42c1c6-de75-4a94-ac01-097834004683 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:40.125315 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4d42c1c6-de75-4a94-ac01-097834004683 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:40.126012 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4d42c1c6-de75-4a94-ac01-097834004683 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:40.126699 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4d42c1c6-de75-4a94-ac01-097834004683 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:40.279819 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-178b6b58-3b38-44fb-9787-a8cc2f6ab4d8 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4aec5af742842f5bb2048c8b7d60687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829069b2787a423f922fcc5b5702f167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:40.289024 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-4d42c1c6-de75-4a94-ac01-097834004683 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a41ab6fb78a42ceaca621c5a38ffc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa31ed92017490a82497c7b8910aef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:40.292109 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-178b6b58-3b38-44fb-9787-a8cc2f6ab4d8 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] 10.222.0.43 "GET /compute/v2.1/servers/101edf03-d928-461d-98cf-12753ae7f7d7" status: 200 len: 1319 microversion: 2.1 time: 0.731377 Oct 04 18:33:40.295917 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 393/723] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:39 2022] GET /compute/v2.1/servers/101edf03-d928-461d-98cf-12753ae7f7d7 => generated 1319 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:40.305904 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-28e0b3e2-fbb5-48c5-907b-fa0ee4e9153b req-a173ec3b-9b36-45ba-840e-befa3aac6a0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8408d8e1-41b0-4185-8806-9808f082a016", "name": "network-vif-plugged", "status": "completed", "tag": "a599834b-b75e-4efd-912d-97b463dc6035"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:33:40.315546 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-4d42c1c6-de75-4a94-ac01-097834004683 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] 10.222.0.43 "GET /compute/v2.1/servers/533db4f5-5f62-47ab-9d4c-5e5a95c0b756" status: 200 len: 1266 microversion: 2.1 time: 0.219053 Oct 04 18:33:40.316727 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 331/724] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:40 2022] GET /compute/v2.1/servers/533db4f5-5f62-47ab-9d4c-5e5a95c0b756 => generated 1266 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:40.327791 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-8c5679a2-8f1e-45f5-85b0-7f301e0b963b tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:40.328819 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-8c5679a2-8f1e-45f5-85b0-7f301e0b963b tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] [instance: 8408d8e1-41b0-4185-8806-9808f082a016] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:40.333827 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-28e0b3e2-fbb5-48c5-907b-fa0ee4e9153b req-a173ec3b-9b36-45ba-840e-befa3aac6a0b service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:40.333827 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-28e0b3e2-fbb5-48c5-907b-fa0ee4e9153b req-a173ec3b-9b36-45ba-840e-befa3aac6a0b service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:40.334234 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-28e0b3e2-fbb5-48c5-907b-fa0ee4e9153b req-a173ec3b-9b36-45ba-840e-befa3aac6a0b service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:40.349516 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8c5679a2-8f1e-45f5-85b0-7f301e0b963b tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:40.352476 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8c5679a2-8f1e-45f5-85b0-7f301e0b963b tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:40.353227 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8c5679a2-8f1e-45f5-85b0-7f301e0b963b tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:40.354200 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8c5679a2-8f1e-45f5-85b0-7f301e0b963b tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:40.354941 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8c5679a2-8f1e-45f5-85b0-7f301e0b963b tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:40.359812 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8c5679a2-8f1e-45f5-85b0-7f301e0b963b tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:40.375649 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-28e0b3e2-fbb5-48c5-907b-fa0ee4e9153b req-a173ec3b-9b36-45ba-840e-befa3aac6a0b service nova] Creating event network-vif-plugged:a599834b-b75e-4efd-912d-97b463dc6035 for instance 8408d8e1-41b0-4185-8806-9808f082a016 on n-h2-851028-13 Oct 04 18:33:40.401322 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-28e0b3e2-fbb5-48c5-907b-fa0ee4e9153b req-a173ec3b-9b36-45ba-840e-befa3aac6a0b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101249 Oct 04 18:33:40.404338 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 394/725] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:33:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:33:40.430279 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-c23a95a4-e195-4432-8bc4-6952715ec24d tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:40.442027 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-c23a95a4-e195-4432-8bc4-6952715ec24d tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] [instance: 84e0414b-a39f-4bfe-bc9d-c170ceb34d15] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:40.467259 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c23a95a4-e195-4432-8bc4-6952715ec24d tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:40.467834 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c23a95a4-e195-4432-8bc4-6952715ec24d tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:40.468385 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c23a95a4-e195-4432-8bc4-6952715ec24d tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:40.471097 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c23a95a4-e195-4432-8bc4-6952715ec24d tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:40.471663 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c23a95a4-e195-4432-8bc4-6952715ec24d tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:40.472116 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c23a95a4-e195-4432-8bc4-6952715ec24d tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:40.688888 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-8c5679a2-8f1e-45f5-85b0-7f301e0b963b tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7db99f361654711bea7f1b2c404d312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7adedcdb9c3485ea2738c00e25aa3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:40.699478 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-8c5679a2-8f1e-45f5-85b0-7f301e0b963b tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] 10.222.0.43 "GET /compute/v2.1/servers/8408d8e1-41b0-4185-8806-9808f082a016" status: 200 len: 1317 microversion: 2.1 time: 0.381355 Oct 04 18:33:40.721891 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 332/726] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:40 2022] GET /compute/v2.1/servers/8408d8e1-41b0-4185-8806-9808f082a016 => generated 1317 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:40.753080 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-c23a95a4-e195-4432-8bc4-6952715ec24d tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:40.778201 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-c23a95a4-e195-4432-8bc4-6952715ec24d tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:40.783836 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-c23a95a4-e195-4432-8bc4-6952715ec24d tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:40.799827 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-c23a95a4-e195-4432-8bc4-6952715ec24d tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] 10.222.0.43 "GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15" status: 200 len: 1553 microversion: 2.91 time: 0.394184 Oct 04 18:33:40.802070 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 395/727] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:33:40 2022] GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15 => generated 1553 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:33:41.112190 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-5e1c9e3f-ce0c-419b-8061-b747b9e3fe83 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:41.112821 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-5e1c9e3f-ce0c-419b-8061-b747b9e3fe83 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] [instance: fd5fe360-8ecf-41d0-9376-9d5533fc6ba8] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:41.137380 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5e1c9e3f-ce0c-419b-8061-b747b9e3fe83 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:41.138329 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5e1c9e3f-ce0c-419b-8061-b747b9e3fe83 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:41.139001 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5e1c9e3f-ce0c-419b-8061-b747b9e3fe83 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:41.141817 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5e1c9e3f-ce0c-419b-8061-b747b9e3fe83 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:41.142534 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5e1c9e3f-ce0c-419b-8061-b747b9e3fe83 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:41.146905 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5e1c9e3f-ce0c-419b-8061-b747b9e3fe83 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:41.337982 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f00a8f27-a4ce-4989-abb2-26ba926814e8 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:41.339899 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-f00a8f27-a4ce-4989-abb2-26ba926814e8 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] [instance: 101edf03-d928-461d-98cf-12753ae7f7d7] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:41.350635 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f00a8f27-a4ce-4989-abb2-26ba926814e8 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:41.351524 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f00a8f27-a4ce-4989-abb2-26ba926814e8 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:41.352179 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f00a8f27-a4ce-4989-abb2-26ba926814e8 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:41.353161 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f00a8f27-a4ce-4989-abb2-26ba926814e8 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:41.353840 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f00a8f27-a4ce-4989-abb2-26ba926814e8 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:41.355150 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f00a8f27-a4ce-4989-abb2-26ba926814e8 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:41.429897 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-5e1c9e3f-ce0c-419b-8061-b747b9e3fe83 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:41.453387 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-5e1c9e3f-ce0c-419b-8061-b747b9e3fe83 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:41.465975 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-5e1c9e3f-ce0c-419b-8061-b747b9e3fe83 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:41.467991 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-5e1c9e3f-ce0c-419b-8061-b747b9e3fe83 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] 10.222.0.43 "GET /compute/v2.1/servers/fd5fe360-8ecf-41d0-9376-9d5533fc6ba8" status: 200 len: 1558 microversion: 2.25 time: 0.360139 Oct 04 18:33:41.468905 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 333/728] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:33:41 2022] GET /compute/v2.1/servers/fd5fe360-8ecf-41d0-9376-9d5533fc6ba8 => generated 1558 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:33:41.474042 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-759ed494-f83e-4d09-a742-f5e530d745a8 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:41.498227 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-759ed494-f83e-4d09-a742-f5e530d745a8 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] [instance: 533db4f5-5f62-47ab-9d4c-5e5a95c0b756] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:41.530590 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-759ed494-f83e-4d09-a742-f5e530d745a8 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:41.531091 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-759ed494-f83e-4d09-a742-f5e530d745a8 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:41.531537 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-759ed494-f83e-4d09-a742-f5e530d745a8 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:41.532382 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-759ed494-f83e-4d09-a742-f5e530d745a8 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:41.532847 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-759ed494-f83e-4d09-a742-f5e530d745a8 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:41.543528 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-759ed494-f83e-4d09-a742-f5e530d745a8 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:41.940452 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-759ed494-f83e-4d09-a742-f5e530d745a8 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a41ab6fb78a42ceaca621c5a38ffc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa31ed92017490a82497c7b8910aef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:41.953221 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-759ed494-f83e-4d09-a742-f5e530d745a8 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] 10.222.0.43 "GET /compute/v2.1/servers/533db4f5-5f62-47ab-9d4c-5e5a95c0b756" status: 200 len: 1308 microversion: 2.1 time: 0.479944 Oct 04 18:33:41.970212 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 334/729] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:41 2022] GET /compute/v2.1/servers/533db4f5-5f62-47ab-9d4c-5e5a95c0b756 => generated 1308 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:41.978999 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-f8249555-4e09-4758-b23b-5b19cfe85d64 tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] Calling method '.version_select at 0x7fb21fe37dc0>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:41.987276 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f8249555-4e09-4758-b23b-5b19cfe85d64 tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:41.988044 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f8249555-4e09-4758-b23b-5b19cfe85d64 tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:41.988658 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f8249555-4e09-4758-b23b-5b19cfe85d64 tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:42.011242 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-f8249555-4e09-4758-b23b-5b19cfe85d64 tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] 10.222.0.43 "GET /compute/v2.1/os-migrations" status: 200 len: 684 microversion: 2.25 time: 0.039545 Oct 04 18:33:42.012506 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 335/730] 10.222.0.43 () {60 vars in 1184 bytes} [Tue Oct 4 18:33:41 2022] GET /compute/v2.1/os-migrations => generated 684 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:33:42.017968 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-48c6ef77-0182-4c39-b001-f53290046e51 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:42.018912 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-48c6ef77-0182-4c39-b001-f53290046e51 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] [instance: 8408d8e1-41b0-4185-8806-9808f082a016] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:42.032266 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-48c6ef77-0182-4c39-b001-f53290046e51 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:42.035690 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-48c6ef77-0182-4c39-b001-f53290046e51 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:42.036485 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-48c6ef77-0182-4c39-b001-f53290046e51 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:42.039573 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-48c6ef77-0182-4c39-b001-f53290046e51 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:42.040153 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-48c6ef77-0182-4c39-b001-f53290046e51 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:42.040602 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-48c6ef77-0182-4c39-b001-f53290046e51 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:42.186052 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-f00a8f27-a4ce-4989-abb2-26ba926814e8 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4aec5af742842f5bb2048c8b7d60687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829069b2787a423f922fcc5b5702f167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:42.202667 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-f00a8f27-a4ce-4989-abb2-26ba926814e8 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] 10.222.0.43 "GET /compute/v2.1/servers/101edf03-d928-461d-98cf-12753ae7f7d7" status: 200 len: 1319 microversion: 2.1 time: 0.883055 Oct 04 18:33:42.209067 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 396/731] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:41 2022] GET /compute/v2.1/servers/101edf03-d928-461d-98cf-12753ae7f7d7 => generated 1319 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:42.219231 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-6cb80ff9-6367-4bed-96e4-449e9b7d562b tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:42.222552 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-6cb80ff9-6367-4bed-96e4-449e9b7d562b tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] [instance: 84e0414b-a39f-4bfe-bc9d-c170ceb34d15] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:42.242541 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6cb80ff9-6367-4bed-96e4-449e9b7d562b tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:42.244215 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6cb80ff9-6367-4bed-96e4-449e9b7d562b tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:42.253292 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6cb80ff9-6367-4bed-96e4-449e9b7d562b tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:42.254382 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6cb80ff9-6367-4bed-96e4-449e9b7d562b tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:42.256312 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6cb80ff9-6367-4bed-96e4-449e9b7d562b tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:42.260249 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6cb80ff9-6367-4bed-96e4-449e9b7d562b tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:42.442685 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-48c6ef77-0182-4c39-b001-f53290046e51 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7db99f361654711bea7f1b2c404d312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7adedcdb9c3485ea2738c00e25aa3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:42.455625 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-48c6ef77-0182-4c39-b001-f53290046e51 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] 10.222.0.43 "GET /compute/v2.1/servers/8408d8e1-41b0-4185-8806-9808f082a016" status: 200 len: 1317 microversion: 2.1 time: 0.440950 Oct 04 18:33:42.456839 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 336/732] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:42 2022] GET /compute/v2.1/servers/8408d8e1-41b0-4185-8806-9808f082a016 => generated 1317 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:42.469748 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-9bf70084-0ee6-4f54-afbf-77c0d8626880 tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:42.473943 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-9bf70084-0ee6-4f54-afbf-77c0d8626880 tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] [instance: fd5fe360-8ecf-41d0-9376-9d5533fc6ba8] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:42.486636 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9bf70084-0ee6-4f54-afbf-77c0d8626880 tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:42.487426 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9bf70084-0ee6-4f54-afbf-77c0d8626880 tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:42.488315 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9bf70084-0ee6-4f54-afbf-77c0d8626880 tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:42.489552 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9bf70084-0ee6-4f54-afbf-77c0d8626880 tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:42.490273 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9bf70084-0ee6-4f54-afbf-77c0d8626880 tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:42.490874 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9bf70084-0ee6-4f54-afbf-77c0d8626880 tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:42.756028 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.objects.instance [None req-9bf70084-0ee6-4f54-afbf-77c0d8626880 tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] Lazy-loading 'services' on Instance uuid fd5fe360-8ecf-41d0-9376-9d5533fc6ba8 {{(pid=123595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:33:42.771551 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=100 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:33:42.816180 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-9bf70084-0ee6-4f54-afbf-77c0d8626880 tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/fd5fe360-8ecf-41d0-9376-9d5533fc6ba8" status: 200 len: 2052 microversion: 2.25 time: 0.353686 Oct 04 18:33:42.819486 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 337/733] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:33:42 2022] GET /compute/v2.1/servers/fd5fe360-8ecf-41d0-9376-9d5533fc6ba8 => generated 2052 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:33:42.967382 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-cb5fd9e2-12c3-415e-b502-39482ffb4dbc req-670ee4c9-c978-44be-aabb-20910ba90626 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "101edf03-d928-461d-98cf-12753ae7f7d7", "name": "network-vif-plugged", "status": "completed", "tag": "c3985dab-2758-4c15-b5b3-6093e8e8ce76"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:33:42.992275 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-cb5fd9e2-12c3-415e-b502-39482ffb4dbc req-670ee4c9-c978-44be-aabb-20910ba90626 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:43.002069 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-cb5fd9e2-12c3-415e-b502-39482ffb4dbc req-670ee4c9-c978-44be-aabb-20910ba90626 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:43.005839 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-cb5fd9e2-12c3-415e-b502-39482ffb4dbc req-670ee4c9-c978-44be-aabb-20910ba90626 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:43.033672 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-cb5fd9e2-12c3-415e-b502-39482ffb4dbc req-670ee4c9-c978-44be-aabb-20910ba90626 service nova] Creating event network-vif-plugged:c3985dab-2758-4c15-b5b3-6093e8e8ce76 for instance 101edf03-d928-461d-98cf-12753ae7f7d7 on n-h1-851028-13 Oct 04 18:33:43.047985 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-cb5fd9e2-12c3-415e-b502-39482ffb4dbc req-670ee4c9-c978-44be-aabb-20910ba90626 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085269 Oct 04 18:33:43.049218 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 338/734] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:33:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:33:43.057616 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-2db754c0-f7b3-4378-a28f-39387917172b tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:43.058896 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-2db754c0-f7b3-4378-a28f-39387917172b tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] [instance: 533db4f5-5f62-47ab-9d4c-5e5a95c0b756] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:43.070991 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2db754c0-f7b3-4378-a28f-39387917172b tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:43.071902 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2db754c0-f7b3-4378-a28f-39387917172b tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:43.072609 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2db754c0-f7b3-4378-a28f-39387917172b tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:43.073610 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2db754c0-f7b3-4378-a28f-39387917172b tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:43.076286 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2db754c0-f7b3-4378-a28f-39387917172b tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:43.077216 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2db754c0-f7b3-4378-a28f-39387917172b tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:43.113375 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-6cb80ff9-6367-4bed-96e4-449e9b7d562b tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:43.124998 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-6cb80ff9-6367-4bed-96e4-449e9b7d562b tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:43.131298 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-6cb80ff9-6367-4bed-96e4-449e9b7d562b tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:43.145688 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-6cb80ff9-6367-4bed-96e4-449e9b7d562b tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] 10.222.0.43 "GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15" status: 200 len: 1553 microversion: 2.91 time: 0.932648 Oct 04 18:33:43.146823 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 397/735] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:33:42 2022] GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15 => generated 1553 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:33:43.157778 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-0d216b92-5744-4ca1-94ce-1c3b36ee4200 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-27368141", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452", "networks": [{"uuid": "1fac60ec-a479-4aec-9ef2-ec5cc4fb1c50"}]}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:33:43.336740 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.network.neutron [None req-0d216b92-5744-4ca1-94ce-1c3b36ee4200 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] validate_networks() for [('1fac60ec-a479-4aec-9ef2-ec5cc4fb1c50', None, None, None, None, None)] {{(pid=123596) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:33:43.532369 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-2db754c0-f7b3-4378-a28f-39387917172b tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a41ab6fb78a42ceaca621c5a38ffc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa31ed92017490a82497c7b8910aef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:43.550401 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-2db754c0-f7b3-4378-a28f-39387917172b tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] 10.222.0.43 "GET /compute/v2.1/servers/533db4f5-5f62-47ab-9d4c-5e5a95c0b756" status: 200 len: 1308 microversion: 2.1 time: 0.493955 Oct 04 18:33:43.555911 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 339/736] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:43 2022] GET /compute/v2.1/servers/533db4f5-5f62-47ab-9d4c-5e5a95c0b756 => generated 1308 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:43.561612 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-8df8aa18-fe27-4fb1-8681-72c6f43abffb tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:43.562510 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-8df8aa18-fe27-4fb1-8681-72c6f43abffb tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] [instance: 101edf03-d928-461d-98cf-12753ae7f7d7] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:43.575501 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8df8aa18-fe27-4fb1-8681-72c6f43abffb tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:43.576407 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8df8aa18-fe27-4fb1-8681-72c6f43abffb tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:43.577076 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8df8aa18-fe27-4fb1-8681-72c6f43abffb tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:43.578238 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8df8aa18-fe27-4fb1-8681-72c6f43abffb tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:43.580748 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8df8aa18-fe27-4fb1-8681-72c6f43abffb tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:43.581498 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8df8aa18-fe27-4fb1-8681-72c6f43abffb tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:43.798686 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-8df8aa18-fe27-4fb1-8681-72c6f43abffb tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4aec5af742842f5bb2048c8b7d60687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829069b2787a423f922fcc5b5702f167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:43.812858 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-8df8aa18-fe27-4fb1-8681-72c6f43abffb tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] 10.222.0.43 "GET /compute/v2.1/servers/101edf03-d928-461d-98cf-12753ae7f7d7" status: 200 len: 1319 microversion: 2.1 time: 0.255468 Oct 04 18:33:43.814917 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 340/737] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:43 2022] GET /compute/v2.1/servers/101edf03-d928-461d-98cf-12753ae7f7d7 => generated 1319 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:43.830178 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-251ca9fd-9393-46ca-800c-93bf2d240746 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:43.831240 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-251ca9fd-9393-46ca-800c-93bf2d240746 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] [instance: 8408d8e1-41b0-4185-8806-9808f082a016] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:43.840840 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-251ca9fd-9393-46ca-800c-93bf2d240746 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:43.842407 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-251ca9fd-9393-46ca-800c-93bf2d240746 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:43.843344 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-251ca9fd-9393-46ca-800c-93bf2d240746 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:43.844179 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-251ca9fd-9393-46ca-800c-93bf2d240746 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:43.844750 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-251ca9fd-9393-46ca-800c-93bf2d240746 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:43.845888 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-251ca9fd-9393-46ca-800c-93bf2d240746 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:44.453626 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-251ca9fd-9393-46ca-800c-93bf2d240746 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7db99f361654711bea7f1b2c404d312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7adedcdb9c3485ea2738c00e25aa3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:44.463609 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-251ca9fd-9393-46ca-800c-93bf2d240746 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] 10.222.0.43 "GET /compute/v2.1/servers/8408d8e1-41b0-4185-8806-9808f082a016" status: 200 len: 1466 microversion: 2.1 time: 0.647293 Oct 04 18:33:44.469716 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 341/738] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:43 2022] GET /compute/v2.1/servers/8408d8e1-41b0-4185-8806-9808f082a016 => generated 1466 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:44.491899 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-87473bdc-b786-4012-be75-f999b6bcf245 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:44.492396 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-87473bdc-b786-4012-be75-f999b6bcf245 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] [instance: 84e0414b-a39f-4bfe-bc9d-c170ceb34d15] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:44.515075 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-87473bdc-b786-4012-be75-f999b6bcf245 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:44.515573 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-87473bdc-b786-4012-be75-f999b6bcf245 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:44.516014 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-87473bdc-b786-4012-be75-f999b6bcf245 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:44.516753 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-87473bdc-b786-4012-be75-f999b6bcf245 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:44.517268 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-87473bdc-b786-4012-be75-f999b6bcf245 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:44.517770 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-87473bdc-b786-4012-be75-f999b6bcf245 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:44.542975 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-0d216b92-5744-4ca1-94ce-1c3b36ee4200 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Flavor limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:33:44.543606 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-0d216b92-5744-4ca1-94ce-1c3b36ee4200 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Image limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:33:44.544033 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-0d216b92-5744-4ca1-94ce-1c3b36ee4200 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Flavor pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:33:44.544678 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-0d216b92-5744-4ca1-94ce-1c3b36ee4200 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Image pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:33:44.545392 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-0d216b92-5744-4ca1-94ce-1c3b36ee4200 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:33:44.561092 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0d216b92-5744-4ca1-94ce-1c3b36ee4200 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:44.565728 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0d216b92-5744-4ca1-94ce-1c3b36ee4200 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:44.570640 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0d216b92-5744-4ca1-94ce-1c3b36ee4200 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:44.574397 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0d216b92-5744-4ca1-94ce-1c3b36ee4200 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:44.575255 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0d216b92-5744-4ca1-94ce-1c3b36ee4200 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:44.575924 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0d216b92-5744-4ca1-94ce-1c3b36ee4200 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:44.626608 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-0d216b92-5744-4ca1-94ce-1c3b36ee4200 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Getting quotas for project 34199e342c1b4158abf82384f2213b5f. Resources: {'ram', 'cores', 'instances'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:33:44.631903 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-0d216b92-5744-4ca1-94ce-1c3b36ee4200 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Getting quotas for user 807a4a88319946aead73a3ccfcda6aeb and project 34199e342c1b4158abf82384f2213b5f. Resources: {'ram', 'cores', 'instances'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:33:44.651216 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_api:SELECT=100 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:33:44.653025 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-0d216b92-5744-4ca1-94ce-1c3b36ee4200 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Going to run 1 instances... {{(pid=123596) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:33:44.655813 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-0d216b92-5744-4ca1-94ce-1c3b36ee4200 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] [instance: 9895c2ec-35ea-419e-9565-0c0f2fc5bbbc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e8943ec5-4038-4d4b-b9b9-2415a79f5243',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123596) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:33:44.728287 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-0d216b92-5744-4ca1-94ce-1c3b36ee4200 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.574752 Oct 04 18:33:44.731351 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 398/739] 10.222.0.43 () {62 vars in 1188 bytes} [Tue Oct 4 18:33:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 1584 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 04 18:33:44.753516 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f9bf98da-17e4-4b80-b19a-f1364a57f03e tempest-ServersOnMultiNodesTest-1245420526 tempest-ServersOnMultiNodesTest-1245420526-project-admin] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:44.759750 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-f9bf98da-17e4-4b80-b19a-f1364a57f03e tempest-ServersOnMultiNodesTest-1245420526 tempest-ServersOnMultiNodesTest-1245420526-project-admin] [instance: 8408d8e1-41b0-4185-8806-9808f082a016] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:44.760077 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-87473bdc-b786-4012-be75-f999b6bcf245 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:44.769337 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-87473bdc-b786-4012-be75-f999b6bcf245 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:44.773618 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f9bf98da-17e4-4b80-b19a-f1364a57f03e tempest-ServersOnMultiNodesTest-1245420526 tempest-ServersOnMultiNodesTest-1245420526-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:44.775188 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f9bf98da-17e4-4b80-b19a-f1364a57f03e tempest-ServersOnMultiNodesTest-1245420526 tempest-ServersOnMultiNodesTest-1245420526-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:44.775857 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f9bf98da-17e4-4b80-b19a-f1364a57f03e tempest-ServersOnMultiNodesTest-1245420526 tempest-ServersOnMultiNodesTest-1245420526-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:44.776913 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f9bf98da-17e4-4b80-b19a-f1364a57f03e tempest-ServersOnMultiNodesTest-1245420526 tempest-ServersOnMultiNodesTest-1245420526-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:44.777908 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f9bf98da-17e4-4b80-b19a-f1364a57f03e tempest-ServersOnMultiNodesTest-1245420526 tempest-ServersOnMultiNodesTest-1245420526-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:44.780017 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-87473bdc-b786-4012-be75-f999b6bcf245 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:44.782642 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f9bf98da-17e4-4b80-b19a-f1364a57f03e tempest-ServersOnMultiNodesTest-1245420526 tempest-ServersOnMultiNodesTest-1245420526-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:44.798480 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-87473bdc-b786-4012-be75-f999b6bcf245 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] 10.222.0.43 "GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15" status: 200 len: 1553 microversion: 2.91 time: 0.327476 Oct 04 18:33:44.809162 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 342/740] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:33:44 2022] GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15 => generated 1553 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:33:44.813909 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-a16da548-25bb-4d4f-aeb5-eb8f1bda1954 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:44.814770 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-a16da548-25bb-4d4f-aeb5-eb8f1bda1954 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] [instance: 533db4f5-5f62-47ab-9d4c-5e5a95c0b756] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:44.843535 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a16da548-25bb-4d4f-aeb5-eb8f1bda1954 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:44.848478 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a16da548-25bb-4d4f-aeb5-eb8f1bda1954 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:44.849823 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a16da548-25bb-4d4f-aeb5-eb8f1bda1954 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:44.852337 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a16da548-25bb-4d4f-aeb5-eb8f1bda1954 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:44.862049 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a16da548-25bb-4d4f-aeb5-eb8f1bda1954 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:44.864828 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a16da548-25bb-4d4f-aeb5-eb8f1bda1954 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:44.934562 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=18 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:33:45.503221 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-f9bf98da-17e4-4b80-b19a-f1364a57f03e tempest-ServersOnMultiNodesTest-1245420526 tempest-ServersOnMultiNodesTest-1245420526-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/8408d8e1-41b0-4185-8806-9808f082a016" status: 200 len: 1619 microversion: 2.1 time: 0.766020 Oct 04 18:33:45.513279 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 399/741] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:44 2022] GET /compute/v2.1/servers/8408d8e1-41b0-4185-8806-9808f082a016 => generated 1619 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:45.518369 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-8c9672ed-dd50-45b5-bc2a-615261160689 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:45.530311 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-8c9672ed-dd50-45b5-bc2a-615261160689 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] [instance: 9895c2ec-35ea-419e-9565-0c0f2fc5bbbc] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:45.720171 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-8c9672ed-dd50-45b5-bc2a-615261160689 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:45.731934 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-8c9672ed-dd50-45b5-bc2a-615261160689 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:45.735932 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-8c9672ed-dd50-45b5-bc2a-615261160689 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:45.737102 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-8c9672ed-dd50-45b5-bc2a-615261160689 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] 10.222.0.43 "GET /compute/v2.1/servers/9895c2ec-35ea-419e-9565-0c0f2fc5bbbc" status: 200 len: 1260 microversion: 2.25 time: 0.222558 Oct 04 18:33:45.743146 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 400/742] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:33:45 2022] GET /compute/v2.1/servers/9895c2ec-35ea-419e-9565-0c0f2fc5bbbc => generated 1260 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:33:45.756287 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-a16da548-25bb-4d4f-aeb5-eb8f1bda1954 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a41ab6fb78a42ceaca621c5a38ffc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa31ed92017490a82497c7b8910aef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:45.757608 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-9c8e740f-79a5-4876-86dd-c2e0e500877c tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:45.761230 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-9c8e740f-79a5-4876-86dd-c2e0e500877c tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] [instance: 101edf03-d928-461d-98cf-12753ae7f7d7] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:45.780505 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-a16da548-25bb-4d4f-aeb5-eb8f1bda1954 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] 10.222.0.43 "GET /compute/v2.1/servers/533db4f5-5f62-47ab-9d4c-5e5a95c0b756" status: 200 len: 1308 microversion: 2.1 time: 0.974283 Oct 04 18:33:45.788028 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 343/743] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:44 2022] GET /compute/v2.1/servers/533db4f5-5f62-47ab-9d4c-5e5a95c0b756 => generated 1308 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:45.792635 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9c8e740f-79a5-4876-86dd-c2e0e500877c tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:45.796206 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9c8e740f-79a5-4876-86dd-c2e0e500877c tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:45.798251 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9c8e740f-79a5-4876-86dd-c2e0e500877c tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:45.802372 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9c8e740f-79a5-4876-86dd-c2e0e500877c tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:45.803515 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9c8e740f-79a5-4876-86dd-c2e0e500877c tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:45.805705 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9c8e740f-79a5-4876-86dd-c2e0e500877c tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:45.806465 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-90ca9421-920d-4084-b470-581a06c248dd req-08634e8f-2d90-4759-842d-f5d090a6d28e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "533db4f5-5f62-47ab-9d4c-5e5a95c0b756", "tag": "9dc10a12-f514-49cb-8d56-3dda7855de52"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:33:45.849759 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=8 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:33:45.908272 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-90ca9421-920d-4084-b470-581a06c248dd req-08634e8f-2d90-4759-842d-f5d090a6d28e service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:45.909847 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-90ca9421-920d-4084-b470-581a06c248dd req-08634e8f-2d90-4759-842d-f5d090a6d28e service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:45.914423 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-90ca9421-920d-4084-b470-581a06c248dd req-08634e8f-2d90-4759-842d-f5d090a6d28e service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:45.950723 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-90ca9421-920d-4084-b470-581a06c248dd req-08634e8f-2d90-4759-842d-f5d090a6d28e service nova] Creating event network-changed:9dc10a12-f514-49cb-8d56-3dda7855de52 for instance 533db4f5-5f62-47ab-9d4c-5e5a95c0b756 on n-h2-851028-13 Oct 04 18:33:45.966184 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-90ca9421-920d-4084-b470-581a06c248dd req-08634e8f-2d90-4759-842d-f5d090a6d28e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.171102 Oct 04 18:33:45.970706 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 344/744] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:33:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:33:45.979154 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-38e42420-3a9d-4901-96d3-78025fb6df4f tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:45.980592 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-38e42420-3a9d-4901-96d3-78025fb6df4f tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] [instance: 84e0414b-a39f-4bfe-bc9d-c170ceb34d15] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:45.996149 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-38e42420-3a9d-4901-96d3-78025fb6df4f tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:45.996928 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-38e42420-3a9d-4901-96d3-78025fb6df4f tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:45.997627 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-38e42420-3a9d-4901-96d3-78025fb6df4f tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:46.012950 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-38e42420-3a9d-4901-96d3-78025fb6df4f tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:46.013967 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-38e42420-3a9d-4901-96d3-78025fb6df4f tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:46.014768 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-38e42420-3a9d-4901-96d3-78025fb6df4f tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:46.248363 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-38e42420-3a9d-4901-96d3-78025fb6df4f tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:46.251654 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-9c8e740f-79a5-4876-86dd-c2e0e500877c tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4aec5af742842f5bb2048c8b7d60687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829069b2787a423f922fcc5b5702f167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:46.264378 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-9c8e740f-79a5-4876-86dd-c2e0e500877c tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] 10.222.0.43 "GET /compute/v2.1/servers/101edf03-d928-461d-98cf-12753ae7f7d7" status: 200 len: 1469 microversion: 2.1 time: 0.519871 Oct 04 18:33:46.266389 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 401/745] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:45 2022] GET /compute/v2.1/servers/101edf03-d928-461d-98cf-12753ae7f7d7 => generated 1469 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:46.270429 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-38e42420-3a9d-4901-96d3-78025fb6df4f tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:46.272251 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-38e42420-3a9d-4901-96d3-78025fb6df4f tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:46.278052 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-5d069513-94fe-47d2-956d-48f4c71aa498 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1582308494", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "b36499e0-9405-4153-a581-13c1bd9d43eb"}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:33:46.290375 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-38e42420-3a9d-4901-96d3-78025fb6df4f tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] 10.222.0.43 "GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15" status: 200 len: 1553 microversion: 2.91 time: 0.318112 Oct 04 18:33:46.292063 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 345/746] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:33:45 2022] GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15 => generated 1553 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:33:46.387380 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.network.neutron [None req-5d069513-94fe-47d2-956d-48f4c71aa498 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] validate_networks() for None {{(pid=123596) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:33:46.720690 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-ebf8d477-edeb-4b69-a321-79b7759392c0 tempest-LiveMigrationNegativeTest-828398147 tempest-LiveMigrationNegativeTest-828398147-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-647157818", "block_migration": true, "disk_over_commit": false}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:33:46.723701 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-ebf8d477-edeb-4b69-a321-79b7759392c0 tempest-LiveMigrationNegativeTest-828398147 tempest-LiveMigrationNegativeTest-828398147-project-admin] [instance: 101edf03-d928-461d-98cf-12753ae7f7d7] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:46.741620 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ebf8d477-edeb-4b69-a321-79b7759392c0 tempest-LiveMigrationNegativeTest-828398147 tempest-LiveMigrationNegativeTest-828398147-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:46.744013 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ebf8d477-edeb-4b69-a321-79b7759392c0 tempest-LiveMigrationNegativeTest-828398147 tempest-LiveMigrationNegativeTest-828398147-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:46.744590 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ebf8d477-edeb-4b69-a321-79b7759392c0 tempest-LiveMigrationNegativeTest-828398147 tempest-LiveMigrationNegativeTest-828398147-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:46.747576 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ebf8d477-edeb-4b69-a321-79b7759392c0 tempest-LiveMigrationNegativeTest-828398147 tempest-LiveMigrationNegativeTest-828398147-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:46.759796 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ebf8d477-edeb-4b69-a321-79b7759392c0 tempest-LiveMigrationNegativeTest-828398147 tempest-LiveMigrationNegativeTest-828398147-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:46.759974 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ebf8d477-edeb-4b69-a321-79b7759392c0 tempest-LiveMigrationNegativeTest-828398147 tempest-LiveMigrationNegativeTest-828398147-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:46.821375 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.objects.instance [None req-ebf8d477-edeb-4b69-a321-79b7759392c0 tempest-LiveMigrationNegativeTest-828398147 tempest-LiveMigrationNegativeTest-828398147-project-admin] Lazy-loading 'flavor' on Instance uuid 101edf03-d928-461d-98cf-12753ae7f7d7 {{(pid=123595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:33:46.861345 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-ebf8d477-edeb-4b69-a321-79b7759392c0 tempest-LiveMigrationNegativeTest-828398147 tempest-LiveMigrationNegativeTest-828398147-project-admin] [instance: 101edf03-d928-461d-98cf-12753ae7f7d7] Going to try to live migrate instance to tempest-host-647157818 {{(pid=123595) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 04 18:33:46.887329 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-ebf8d477-edeb-4b69-a321-79b7759392c0 tempest-LiveMigrationNegativeTest-828398147 tempest-LiveMigrationNegativeTest-828398147-project-admin] HTTP exception thrown: Compute host tempest-host-647157818 could not be found. Oct 04 18:33:46.893218 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-ebf8d477-edeb-4b69-a321-79b7759392c0 tempest-LiveMigrationNegativeTest-828398147 tempest-LiveMigrationNegativeTest-828398147-project-admin] Request method failure captured: Oct 04 18:33:46.893218 n-d-851028-13 devstack@n-api.service[123595]: request: POST /compute/v2.1/servers/101edf03-d928-461d-98cf-12753ae7f7d7/action HTTP/1.1 Oct 04 18:33:46.893218 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 18:33:46.893218 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 18:33:46.893218 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 18:33:46.893218 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 106 Oct 04 18:33:46.893218 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 18:33:46.893218 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 18:33:46.893218 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 18:33:46.893218 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 18:33:46.893218 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPHxwQdt6BHzRTURP22Mb2Lm3DiMu2FmI_M0tlFgdLiWmiAHPuB_B-ou8hwlWCYvlSOxaLOeRpaKPiCCktkHmNES_CPq_ymZL6OtJEg-GTzJqEEXVr4ELxoLShokfHAiDbs4zsp79SfSOOA9-2AzCQH3k4T6FXBA8lG7wjsd3C3tsnbM Oct 04 18:33:46.893218 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 18:33:46.893218 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 18:33:46.893218 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 18:33:46.893218 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 18:33:46.893218 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 18:33:46.893218 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 18:33:46.893218 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: b113b5940fcc4224a2d606722e4856e1 Oct 04 18:33:46.893218 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-LiveMigrationNegativeTest-828398147 Oct 04 18:33:46.893218 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,admin,reader Oct 04 18:33:46.893218 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,admin,reader Oct 04 18:33:46.894986 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/b113b5940fcc4224a2d606722e4856e1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_b113b5940fcc4224a2d606722e4856e1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b113b5940fcc4224a2d606722e4856e1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b113b5940fcc4224a2d606722e4856e1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:33:46.894986 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-LiveMigrationNegativeTest-828398147 Oct 04 18:33:46.894986 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: b113b5940fcc4224a2d606722e4856e1 Oct 04 18:33:46.894986 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-828398147 Oct 04 18:33:46.894986 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-LiveMigrationNegativeTest-828398147-project-admin Oct 04 18:33:46.894986 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 18:33:46.894986 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 18:33:46.894986 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: c1f16ac97d204377a471448fde3f2310 Oct 04 18:33:46.894986 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-LiveMigrationNegativeTest-828398147-project-admin Oct 04 18:33:46.894986 n-d-851028-13 devstack@n-api.service[123595]: Oct 04 18:33:46.894986 n-d-851028-13 devstack@n-api.service[123595]: {"os-migrateLive": {"host": "tempest-host-647157818", "block_migration": true, "disk_over_commit": false}} Oct 04 18:33:46.894986 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 18:33:46.895848 n-d-851028-13 devstack@n-api.service[123595]: exception: Compute host tempest-host-647157818 could not be found. Oct 04 18:33:46.895848 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': '101edf03-d928-461d-98cf-12753ae7f7d7', 'body': {'os-migrateLive': {'host': 'tempest-host-647157818', 'block_migration': True, 'disk_over_commit': False}}} Oct 04 18:33:46.895848 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:33:46.895848 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:33:46.895848 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Oct 04 18:33:46.895848 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Oct 04 18:33:46.895848 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 04 18:33:46.895848 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 18:33:46.895848 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 04 18:33:46.895848 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 04 18:33:46.895848 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 04 18:33:46.895848 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 18:33:46.895848 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 04 18:33:46.895848 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 04 18:33:46.895848 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 04 18:33:46.895848 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 18:33:46.895848 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 04 18:33:46.895848 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 18:33:46.895848 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 18:33:46.897680 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 18:33:46.897680 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 04 18:33:46.897680 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 18:33:46.897680 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5488, in live_migrate Oct 04 18:33:46.897680 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nodes = objects.ComputeNodeList.get_all_by_host(context, host_name) Oct 04 18:33:46.897680 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 18:33:46.897680 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 18:33:46.897680 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 476, in get_all_by_host Oct 04 18:33:46.897680 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi db_computes = cls._db_compute_node_get_all_by_host(context, host, Oct 04 18:33:46.897680 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 179, in wrapper Oct 04 18:33:46.897680 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:33:46.897680 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 472, in _db_compute_node_get_all_by_host Oct 04 18:33:46.897680 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return db.compute_node_get_all_by_host(context, host) Oct 04 18:33:46.897680 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 241, in wrapper Oct 04 18:33:46.897680 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(context, *args, **kwargs) Oct 04 18:33:46.897680 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 740, in compute_node_get_all_by_host Oct 04 18:33:46.897680 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host) Oct 04 18:33:46.897680 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-host-647157818 could not be found. Oct 04 18:33:46.897680 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:33:46.899598 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:33:46.899598 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:33:46.899598 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:33:46.899598 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:33:46.899598 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:33:46.899598 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:33:46.899598 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:33:46.899598 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:33:46.899598 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:33:46.899598 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:33:46.899598 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:33:46.899598 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:33:46.899598 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:33:46.899598 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:33:46.899598 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:33:46.899598 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 04 18:33:46.899598 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 150, in _migrate_live Oct 04 18:33:46.899598 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 04 18:33:46.899598 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Compute host tempest-host-647157818 could not be found. Oct 04 18:33:46.899598 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:33:46.901614 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:33:46.901614 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:33:46.901614 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:33:46.901614 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:33:46.901614 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:33:46.901614 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:33:46.901614 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:33:46.901614 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-host-647157818 could not be found. Oct 04 18:33:46.901614 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:33:46.908574 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-ebf8d477-edeb-4b69-a321-79b7759392c0 tempest-LiveMigrationNegativeTest-828398147 tempest-LiveMigrationNegativeTest-828398147-project-admin] Returning 400 to user: Compute host tempest-host-647157818 could not be found. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:33:46.909696 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-ebf8d477-edeb-4b69-a321-79b7759392c0 tempest-LiveMigrationNegativeTest-828398147 tempest-LiveMigrationNegativeTest-828398147-project-admin] 10.222.0.43 "POST /compute/v2.1/servers/101edf03-d928-461d-98cf-12753ae7f7d7/action" status: 400 len: 99 microversion: 2.1 time: 0.616470 Oct 04 18:33:46.911047 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 346/747] 10.222.0.43 () {60 vars in 1279 bytes} [Tue Oct 4 18:33:46 2022] POST /compute/v2.1/servers/101edf03-d928-461d-98cf-12753ae7f7d7/action => generated 99 bytes in 618 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 04 18:33:46.920772 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-5d069513-94fe-47d2-956d-48f4c71aa498 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Flavor limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:33:46.921588 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-5d069513-94fe-47d2-956d-48f4c71aa498 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Image limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:33:46.922713 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-5d069513-94fe-47d2-956d-48f4c71aa498 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Flavor pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:33:46.923251 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-5d069513-94fe-47d2-956d-48f4c71aa498 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Image pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:33:46.923778 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-5d069513-94fe-47d2-956d-48f4c71aa498 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:33:46.924306 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-d18902f7-1575-41f7-8e1f-c46135dcf379 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:46.924950 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-d18902f7-1575-41f7-8e1f-c46135dcf379 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] [instance: 9895c2ec-35ea-419e-9565-0c0f2fc5bbbc] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:46.936592 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5d069513-94fe-47d2-956d-48f4c71aa498 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:46.937271 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5d069513-94fe-47d2-956d-48f4c71aa498 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:46.937815 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5d069513-94fe-47d2-956d-48f4c71aa498 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:46.938653 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5d069513-94fe-47d2-956d-48f4c71aa498 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:46.939216 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5d069513-94fe-47d2-956d-48f4c71aa498 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:46.939749 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5d069513-94fe-47d2-956d-48f4c71aa498 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:46.942301 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d18902f7-1575-41f7-8e1f-c46135dcf379 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:46.943049 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d18902f7-1575-41f7-8e1f-c46135dcf379 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:46.943883 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d18902f7-1575-41f7-8e1f-c46135dcf379 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:46.944624 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d18902f7-1575-41f7-8e1f-c46135dcf379 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:46.945087 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d18902f7-1575-41f7-8e1f-c46135dcf379 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:46.945550 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d18902f7-1575-41f7-8e1f-c46135dcf379 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:46.986225 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-5d069513-94fe-47d2-956d-48f4c71aa498 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Getting quotas for project e7adedcdb9c3485ea2738c00e25aa3fd. Resources: {'ram', 'cores', 'instances'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:33:46.997882 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-5d069513-94fe-47d2-956d-48f4c71aa498 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Getting quotas for user a7db99f361654711bea7f1b2c404d312 and project e7adedcdb9c3485ea2738c00e25aa3fd. Resources: {'ram', 'cores', 'instances'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:33:47.025513 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-5d069513-94fe-47d2-956d-48f4c71aa498 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Going to run 1 instances... {{(pid=123596) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:33:47.027718 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-5d069513-94fe-47d2-956d-48f4c71aa498 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] [instance: b2c8854b-ed0b-4727-b89b-f0633f75d9de] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e8943ec5-4038-4d4b-b9b9-2415a79f5243',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123596) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:33:47.106193 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-d18902f7-1575-41f7-8e1f-c46135dcf379 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:47.130949 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-d18902f7-1575-41f7-8e1f-c46135dcf379 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:47.143799 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-d18902f7-1575-41f7-8e1f-c46135dcf379 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:47.152592 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-d18902f7-1575-41f7-8e1f-c46135dcf379 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] 10.222.0.43 "GET /compute/v2.1/servers/9895c2ec-35ea-419e-9565-0c0f2fc5bbbc" status: 200 len: 1312 microversion: 2.25 time: 0.237659 Oct 04 18:33:47.154780 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-5d069513-94fe-47d2-956d-48f4c71aa498 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.887087 Oct 04 18:33:47.155637 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 402/748] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 18:33:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 889 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:33:47.156134 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 347/749] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:33:46 2022] GET /compute/v2.1/servers/9895c2ec-35ea-419e-9565-0c0f2fc5bbbc => generated 1312 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:33:47.173366 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-b920a998-11b2-4be2-adc5-214d99ee02ab tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:47.173832 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-1d98f477-2035-4d11-b7e1-10aabca49057 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:47.180253 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-b920a998-11b2-4be2-adc5-214d99ee02ab tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] [instance: 101edf03-d928-461d-98cf-12753ae7f7d7] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:47.181031 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-1d98f477-2035-4d11-b7e1-10aabca49057 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] [instance: 533db4f5-5f62-47ab-9d4c-5e5a95c0b756] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:47.216734 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b920a998-11b2-4be2-adc5-214d99ee02ab tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:47.221511 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b920a998-11b2-4be2-adc5-214d99ee02ab tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:47.223717 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1d98f477-2035-4d11-b7e1-10aabca49057 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:47.224552 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b920a998-11b2-4be2-adc5-214d99ee02ab tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:47.225487 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b920a998-11b2-4be2-adc5-214d99ee02ab tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:47.226139 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1d98f477-2035-4d11-b7e1-10aabca49057 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:47.226878 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b920a998-11b2-4be2-adc5-214d99ee02ab tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:47.227910 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1d98f477-2035-4d11-b7e1-10aabca49057 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:47.228830 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b920a998-11b2-4be2-adc5-214d99ee02ab tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:47.237997 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1d98f477-2035-4d11-b7e1-10aabca49057 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:47.239436 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1d98f477-2035-4d11-b7e1-10aabca49057 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:47.240118 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1d98f477-2035-4d11-b7e1-10aabca49057 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:47.572496 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-b920a998-11b2-4be2-adc5-214d99ee02ab tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4aec5af742842f5bb2048c8b7d60687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829069b2787a423f922fcc5b5702f167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:47.581395 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-b920a998-11b2-4be2-adc5-214d99ee02ab tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] 10.222.0.43 "GET /compute/v2.1/servers/101edf03-d928-461d-98cf-12753ae7f7d7" status: 200 len: 1469 microversion: 2.1 time: 0.418831 Oct 04 18:33:47.586459 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 403/750] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:47 2022] GET /compute/v2.1/servers/101edf03-d928-461d-98cf-12753ae7f7d7 => generated 1469 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:47.599040 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-3499a803-55ff-44ef-b7da-8625ebec7a8b tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:47.601538 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-3499a803-55ff-44ef-b7da-8625ebec7a8b tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] [instance: b2c8854b-ed0b-4727-b89b-f0633f75d9de] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:47.752543 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-3499a803-55ff-44ef-b7da-8625ebec7a8b tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7db99f361654711bea7f1b2c404d312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7adedcdb9c3485ea2738c00e25aa3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:47.767808 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-3499a803-55ff-44ef-b7da-8625ebec7a8b tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] 10.222.0.43 "GET /compute/v2.1/servers/b2c8854b-ed0b-4727-b89b-f0633f75d9de" status: 200 len: 1217 microversion: 2.1 time: 0.176899 Oct 04 18:33:47.770012 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 404/751] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:47 2022] GET /compute/v2.1/servers/b2c8854b-ed0b-4727-b89b-f0633f75d9de => generated 1217 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:47.781540 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-3fdfa925-4a4c-40b5-a44d-2d59a1dfe777 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:47.797073 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-3fdfa925-4a4c-40b5-a44d-2d59a1dfe777 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] [instance: 84e0414b-a39f-4bfe-bc9d-c170ceb34d15] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:47.827616 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3fdfa925-4a4c-40b5-a44d-2d59a1dfe777 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:47.833838 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3fdfa925-4a4c-40b5-a44d-2d59a1dfe777 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:47.834296 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3fdfa925-4a4c-40b5-a44d-2d59a1dfe777 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:47.835055 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3fdfa925-4a4c-40b5-a44d-2d59a1dfe777 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:47.837152 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3fdfa925-4a4c-40b5-a44d-2d59a1dfe777 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:47.837636 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3fdfa925-4a4c-40b5-a44d-2d59a1dfe777 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:47.965369 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-3fdfa925-4a4c-40b5-a44d-2d59a1dfe777 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:47.978972 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-3fdfa925-4a4c-40b5-a44d-2d59a1dfe777 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:47.982676 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-3fdfa925-4a4c-40b5-a44d-2d59a1dfe777 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:48.000867 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-3fdfa925-4a4c-40b5-a44d-2d59a1dfe777 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] 10.222.0.43 "GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15" status: 200 len: 1553 microversion: 2.91 time: 0.227925 Oct 04 18:33:48.003260 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 405/752] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:33:47 2022] GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15 => generated 1553 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:33:48.027074 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-54ab3a48-42fb-4b94-b39e-08df2ba9ef4a tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-1227748779", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452"}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:33:48.194008 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.network.neutron [None req-54ab3a48-42fb-4b94-b39e-08df2ba9ef4a tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] validate_networks() for None {{(pid=123596) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:33:48.679735 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-1d98f477-2035-4d11-b7e1-10aabca49057 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a41ab6fb78a42ceaca621c5a38ffc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa31ed92017490a82497c7b8910aef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:48.700740 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-1d98f477-2035-4d11-b7e1-10aabca49057 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] 10.222.0.43 "GET /compute/v2.1/servers/533db4f5-5f62-47ab-9d4c-5e5a95c0b756" status: 200 len: 1308 microversion: 2.1 time: 1.543278 Oct 04 18:33:48.706497 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 348/753] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:47 2022] GET /compute/v2.1/servers/533db4f5-5f62-47ab-9d4c-5e5a95c0b756 => generated 1308 bytes in 1550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:48.735865 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-5aa12503-3871-4519-9595-7ae54c823a64 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:48.741634 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-5aa12503-3871-4519-9595-7ae54c823a64 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] [instance: 9895c2ec-35ea-419e-9565-0c0f2fc5bbbc] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:48.771942 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5aa12503-3871-4519-9595-7ae54c823a64 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:48.776076 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5aa12503-3871-4519-9595-7ae54c823a64 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:48.779984 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5aa12503-3871-4519-9595-7ae54c823a64 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:48.781149 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5aa12503-3871-4519-9595-7ae54c823a64 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:48.784907 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5aa12503-3871-4519-9595-7ae54c823a64 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:48.787370 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5aa12503-3871-4519-9595-7ae54c823a64 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:48.855194 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-54ab3a48-42fb-4b94-b39e-08df2ba9ef4a tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Flavor limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:33:48.855786 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-54ab3a48-42fb-4b94-b39e-08df2ba9ef4a tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Image limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:33:48.856385 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-54ab3a48-42fb-4b94-b39e-08df2ba9ef4a tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Flavor pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:33:48.856925 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-54ab3a48-42fb-4b94-b39e-08df2ba9ef4a tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Image pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:33:48.857487 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-54ab3a48-42fb-4b94-b39e-08df2ba9ef4a tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:33:48.883986 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-54ab3a48-42fb-4b94-b39e-08df2ba9ef4a tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:48.886658 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-54ab3a48-42fb-4b94-b39e-08df2ba9ef4a tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:48.889645 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-54ab3a48-42fb-4b94-b39e-08df2ba9ef4a tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:48.890895 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-54ab3a48-42fb-4b94-b39e-08df2ba9ef4a tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:48.891607 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-54ab3a48-42fb-4b94-b39e-08df2ba9ef4a tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:48.892275 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-54ab3a48-42fb-4b94-b39e-08df2ba9ef4a tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:48.929913 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-54ab3a48-42fb-4b94-b39e-08df2ba9ef4a tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Getting quotas for project 829069b2787a423f922fcc5b5702f167. Resources: {'ram', 'cores', 'instances'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:33:48.957388 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-54ab3a48-42fb-4b94-b39e-08df2ba9ef4a tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Getting quotas for user c4aec5af742842f5bb2048c8b7d60687 and project 829069b2787a423f922fcc5b5702f167. Resources: {'ram', 'cores', 'instances'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:33:48.984821 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-54ab3a48-42fb-4b94-b39e-08df2ba9ef4a tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Going to run 1 instances... {{(pid=123596) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:33:48.988631 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-54ab3a48-42fb-4b94-b39e-08df2ba9ef4a tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] [instance: bcc13e2d-03e7-464d-abac-f5ffb7cbb509] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e8943ec5-4038-4d4b-b9b9-2415a79f5243',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123596) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:33:49.062976 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-54ab3a48-42fb-4b94-b39e-08df2ba9ef4a tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.056748 Oct 04 18:33:49.065856 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 406/754] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 18:33:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 1060 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:33:49.078298 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-2439822b-0f9d-4bd3-8b2b-6e7bd71f4d52 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:49.078935 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-2439822b-0f9d-4bd3-8b2b-6e7bd71f4d52 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] [instance: b2c8854b-ed0b-4727-b89b-f0633f75d9de] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:49.122129 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2439822b-0f9d-4bd3-8b2b-6e7bd71f4d52 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:49.123782 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2439822b-0f9d-4bd3-8b2b-6e7bd71f4d52 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:49.124944 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2439822b-0f9d-4bd3-8b2b-6e7bd71f4d52 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:49.126390 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2439822b-0f9d-4bd3-8b2b-6e7bd71f4d52 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:49.127167 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2439822b-0f9d-4bd3-8b2b-6e7bd71f4d52 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:49.128114 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2439822b-0f9d-4bd3-8b2b-6e7bd71f4d52 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:49.181047 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-5aa12503-3871-4519-9595-7ae54c823a64 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:49.198346 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-5aa12503-3871-4519-9595-7ae54c823a64 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:49.207517 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-5aa12503-3871-4519-9595-7ae54c823a64 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:49.214377 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-5aa12503-3871-4519-9595-7ae54c823a64 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] 10.222.0.43 "GET /compute/v2.1/servers/9895c2ec-35ea-419e-9565-0c0f2fc5bbbc" status: 200 len: 1318 microversion: 2.25 time: 0.503217 Oct 04 18:33:49.218112 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 349/755] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:33:48 2022] GET /compute/v2.1/servers/9895c2ec-35ea-419e-9565-0c0f2fc5bbbc => generated 1318 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:33:49.228898 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-5b283dec-76dd-4faf-9701-71149f79a762 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:49.233098 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-5b283dec-76dd-4faf-9701-71149f79a762 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] [instance: 84e0414b-a39f-4bfe-bc9d-c170ceb34d15] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:49.247651 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5b283dec-76dd-4faf-9701-71149f79a762 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:49.248448 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5b283dec-76dd-4faf-9701-71149f79a762 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:49.249189 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5b283dec-76dd-4faf-9701-71149f79a762 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:49.253314 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5b283dec-76dd-4faf-9701-71149f79a762 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:49.254676 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5b283dec-76dd-4faf-9701-71149f79a762 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:49.255383 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5b283dec-76dd-4faf-9701-71149f79a762 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:49.378431 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-2439822b-0f9d-4bd3-8b2b-6e7bd71f4d52 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7db99f361654711bea7f1b2c404d312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7adedcdb9c3485ea2738c00e25aa3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:49.394561 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-2439822b-0f9d-4bd3-8b2b-6e7bd71f4d52 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] 10.222.0.43 "GET /compute/v2.1/servers/b2c8854b-ed0b-4727-b89b-f0633f75d9de" status: 200 len: 1269 microversion: 2.1 time: 0.324803 Oct 04 18:33:49.397521 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 407/756] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:49 2022] GET /compute/v2.1/servers/b2c8854b-ed0b-4727-b89b-f0633f75d9de => generated 1269 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:49.412321 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-4e54823f-85c8-40c1-a23b-87b744b9ebbb tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:49.412952 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-4e54823f-85c8-40c1-a23b-87b744b9ebbb tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] [instance: bcc13e2d-03e7-464d-abac-f5ffb7cbb509] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:49.491635 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-5b283dec-76dd-4faf-9701-71149f79a762 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:49.510135 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-5b283dec-76dd-4faf-9701-71149f79a762 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:49.511947 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-5b283dec-76dd-4faf-9701-71149f79a762 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:49.528322 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-5b283dec-76dd-4faf-9701-71149f79a762 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] 10.222.0.43 "GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15" status: 200 len: 1553 microversion: 2.91 time: 0.308912 Oct 04 18:33:49.532319 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 350/757] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:33:49 2022] GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15 => generated 1553 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:33:49.608668 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-4e54823f-85c8-40c1-a23b-87b744b9ebbb tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4aec5af742842f5bb2048c8b7d60687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829069b2787a423f922fcc5b5702f167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:49.619158 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-4e54823f-85c8-40c1-a23b-87b744b9ebbb tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] 10.222.0.43 "GET /compute/v2.1/servers/bcc13e2d-03e7-464d-abac-f5ffb7cbb509" status: 200 len: 1219 microversion: 2.1 time: 0.219890 Oct 04 18:33:49.629648 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 408/758] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:49 2022] GET /compute/v2.1/servers/bcc13e2d-03e7-464d-abac-f5ffb7cbb509 => generated 1219 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:49.730308 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-79915c93-1f77-4b54-b15d-1cb8d9292caf tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:49.731711 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-79915c93-1f77-4b54-b15d-1cb8d9292caf tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] [instance: 533db4f5-5f62-47ab-9d4c-5e5a95c0b756] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:49.740600 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-79915c93-1f77-4b54-b15d-1cb8d9292caf tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:49.745869 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-79915c93-1f77-4b54-b15d-1cb8d9292caf tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:49.746678 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-79915c93-1f77-4b54-b15d-1cb8d9292caf tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:49.747708 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-79915c93-1f77-4b54-b15d-1cb8d9292caf tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:49.748411 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-79915c93-1f77-4b54-b15d-1cb8d9292caf tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:49.749690 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-79915c93-1f77-4b54-b15d-1cb8d9292caf tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:50.246288 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-dc721c13-3c5c-46c8-b983-936b75d88669 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:50.247762 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-dc721c13-3c5c-46c8-b983-936b75d88669 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] [instance: 9895c2ec-35ea-419e-9565-0c0f2fc5bbbc] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:50.260432 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dc721c13-3c5c-46c8-b983-936b75d88669 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:50.262965 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dc721c13-3c5c-46c8-b983-936b75d88669 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:50.263675 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dc721c13-3c5c-46c8-b983-936b75d88669 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:50.267761 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dc721c13-3c5c-46c8-b983-936b75d88669 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:50.268556 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dc721c13-3c5c-46c8-b983-936b75d88669 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:50.269268 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dc721c13-3c5c-46c8-b983-936b75d88669 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:50.408412 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-dc721c13-3c5c-46c8-b983-936b75d88669 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:50.423498 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-dc721c13-3c5c-46c8-b983-936b75d88669 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:50.427629 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-dc721c13-3c5c-46c8-b983-936b75d88669 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:50.429433 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-dc721c13-3c5c-46c8-b983-936b75d88669 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] 10.222.0.43 "GET /compute/v2.1/servers/9895c2ec-35ea-419e-9565-0c0f2fc5bbbc" status: 200 len: 1318 microversion: 2.25 time: 0.187265 Oct 04 18:33:50.432861 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 409/759] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:33:50 2022] GET /compute/v2.1/servers/9895c2ec-35ea-419e-9565-0c0f2fc5bbbc => generated 1318 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:33:50.440160 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-ed1437f4-6e02-46f2-b8b4-56608a07ee6e tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:50.441385 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-ed1437f4-6e02-46f2-b8b4-56608a07ee6e tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] [instance: b2c8854b-ed0b-4727-b89b-f0633f75d9de] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:50.449884 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ed1437f4-6e02-46f2-b8b4-56608a07ee6e tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:50.451043 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ed1437f4-6e02-46f2-b8b4-56608a07ee6e tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:50.452363 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ed1437f4-6e02-46f2-b8b4-56608a07ee6e tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:50.453576 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ed1437f4-6e02-46f2-b8b4-56608a07ee6e tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:50.454211 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ed1437f4-6e02-46f2-b8b4-56608a07ee6e tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:50.455200 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ed1437f4-6e02-46f2-b8b4-56608a07ee6e tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:50.551497 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-ed1437f4-6e02-46f2-b8b4-56608a07ee6e tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7db99f361654711bea7f1b2c404d312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7adedcdb9c3485ea2738c00e25aa3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:50.568416 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-ed1437f4-6e02-46f2-b8b4-56608a07ee6e tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] 10.222.0.43 "GET /compute/v2.1/servers/b2c8854b-ed0b-4727-b89b-f0633f75d9de" status: 200 len: 1275 microversion: 2.1 time: 0.133786 Oct 04 18:33:50.569424 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 410/760] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:50 2022] GET /compute/v2.1/servers/b2c8854b-ed0b-4727-b89b-f0633f75d9de => generated 1275 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:50.576035 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-81cf2310-946c-4fd3-9bbf-1009cd87679e tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:50.576937 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-81cf2310-946c-4fd3-9bbf-1009cd87679e tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] [instance: 84e0414b-a39f-4bfe-bc9d-c170ceb34d15] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:50.586389 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-81cf2310-946c-4fd3-9bbf-1009cd87679e tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:50.587777 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-81cf2310-946c-4fd3-9bbf-1009cd87679e tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:50.588405 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-81cf2310-946c-4fd3-9bbf-1009cd87679e tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:50.589377 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-81cf2310-946c-4fd3-9bbf-1009cd87679e tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:50.590073 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-81cf2310-946c-4fd3-9bbf-1009cd87679e tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:50.591279 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-81cf2310-946c-4fd3-9bbf-1009cd87679e tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:50.757558 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-81cf2310-946c-4fd3-9bbf-1009cd87679e tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:50.773459 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-81cf2310-946c-4fd3-9bbf-1009cd87679e tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:50.776586 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-81cf2310-946c-4fd3-9bbf-1009cd87679e tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:50.795891 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-81cf2310-946c-4fd3-9bbf-1009cd87679e tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] 10.222.0.43 "GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15" status: 200 len: 1553 microversion: 2.91 time: 0.224303 Oct 04 18:33:50.808513 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 411/761] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:33:50 2022] GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15 => generated 1553 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:33:50.823687 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f0e02b8d-d57b-4b42-9993-37db8e3c5180 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:50.823687 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-f0e02b8d-d57b-4b42-9993-37db8e3c5180 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] [instance: bcc13e2d-03e7-464d-abac-f5ffb7cbb509] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:50.836974 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f0e02b8d-d57b-4b42-9993-37db8e3c5180 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:50.838130 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f0e02b8d-d57b-4b42-9993-37db8e3c5180 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:50.840068 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f0e02b8d-d57b-4b42-9993-37db8e3c5180 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:50.841683 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f0e02b8d-d57b-4b42-9993-37db8e3c5180 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:50.843064 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f0e02b8d-d57b-4b42-9993-37db8e3c5180 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:50.843064 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f0e02b8d-d57b-4b42-9993-37db8e3c5180 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:50.973658 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-79915c93-1f77-4b54-b15d-1cb8d9292caf tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a41ab6fb78a42ceaca621c5a38ffc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa31ed92017490a82497c7b8910aef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:50.993554 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-79915c93-1f77-4b54-b15d-1cb8d9292caf tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] 10.222.0.43 "GET /compute/v2.1/servers/533db4f5-5f62-47ab-9d4c-5e5a95c0b756" status: 200 len: 1308 microversion: 2.1 time: 1.267405 Oct 04 18:33:50.994212 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 351/762] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:49 2022] GET /compute/v2.1/servers/533db4f5-5f62-47ab-9d4c-5e5a95c0b756 => generated 1308 bytes in 1269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:51.067559 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-f0e02b8d-d57b-4b42-9993-37db8e3c5180 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4aec5af742842f5bb2048c8b7d60687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829069b2787a423f922fcc5b5702f167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:51.076586 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-f0e02b8d-d57b-4b42-9993-37db8e3c5180 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] 10.222.0.43 "GET /compute/v2.1/servers/bcc13e2d-03e7-464d-abac-f5ffb7cbb509" status: 200 len: 1271 microversion: 2.1 time: 0.274136 Oct 04 18:33:51.085320 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 412/763] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:50 2022] GET /compute/v2.1/servers/bcc13e2d-03e7-464d-abac-f5ffb7cbb509 => generated 1271 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:51.459343 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-6bb4c26d-5a30-4892-9955-487af62dc374 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:51.460003 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-6bb4c26d-5a30-4892-9955-487af62dc374 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] [instance: 9895c2ec-35ea-419e-9565-0c0f2fc5bbbc] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:51.469568 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6bb4c26d-5a30-4892-9955-487af62dc374 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:51.472375 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6bb4c26d-5a30-4892-9955-487af62dc374 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:51.473572 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6bb4c26d-5a30-4892-9955-487af62dc374 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:51.474500 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6bb4c26d-5a30-4892-9955-487af62dc374 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:51.475126 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6bb4c26d-5a30-4892-9955-487af62dc374 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:51.475742 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6bb4c26d-5a30-4892-9955-487af62dc374 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:51.597296 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-e3bdbe03-74bf-4566-bd11-ae12ba85e865 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:51.598097 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-e3bdbe03-74bf-4566-bd11-ae12ba85e865 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] [instance: b2c8854b-ed0b-4727-b89b-f0633f75d9de] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:51.624972 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e3bdbe03-74bf-4566-bd11-ae12ba85e865 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:51.626515 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e3bdbe03-74bf-4566-bd11-ae12ba85e865 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:51.627291 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e3bdbe03-74bf-4566-bd11-ae12ba85e865 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:51.628225 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e3bdbe03-74bf-4566-bd11-ae12ba85e865 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:51.628893 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e3bdbe03-74bf-4566-bd11-ae12ba85e865 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:51.630365 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e3bdbe03-74bf-4566-bd11-ae12ba85e865 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:51.700940 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=100 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:33:51.811948 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-e3bdbe03-74bf-4566-bd11-ae12ba85e865 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7db99f361654711bea7f1b2c404d312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7adedcdb9c3485ea2738c00e25aa3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:51.833641 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-e3bdbe03-74bf-4566-bd11-ae12ba85e865 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] 10.222.0.43 "GET /compute/v2.1/servers/b2c8854b-ed0b-4727-b89b-f0633f75d9de" status: 200 len: 1275 microversion: 2.1 time: 0.238149 Oct 04 18:33:51.835889 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 413/764] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:51 2022] GET /compute/v2.1/servers/b2c8854b-ed0b-4727-b89b-f0633f75d9de => generated 1275 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:51.853506 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-787c1819-4776-435f-88b4-47959752c830 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:51.854355 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-787c1819-4776-435f-88b4-47959752c830 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] [instance: 84e0414b-a39f-4bfe-bc9d-c170ceb34d15] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:51.866064 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-787c1819-4776-435f-88b4-47959752c830 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:51.870375 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-787c1819-4776-435f-88b4-47959752c830 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:51.872184 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-787c1819-4776-435f-88b4-47959752c830 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:51.874150 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-787c1819-4776-435f-88b4-47959752c830 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:51.876295 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-787c1819-4776-435f-88b4-47959752c830 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:51.876858 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-787c1819-4776-435f-88b4-47959752c830 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:52.024889 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-787c1819-4776-435f-88b4-47959752c830 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:52.048060 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-787c1819-4776-435f-88b4-47959752c830 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:52.050918 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-787c1819-4776-435f-88b4-47959752c830 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:52.068455 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-787c1819-4776-435f-88b4-47959752c830 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] 10.222.0.43 "GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15" status: 200 len: 1553 microversion: 2.91 time: 0.230991 Oct 04 18:33:52.093210 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 414/765] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:33:51 2022] GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15 => generated 1553 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:33:52.093210 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-d8c56e63-1a68-4822-82eb-78b0e9aec0ff tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:52.093210 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-d8c56e63-1a68-4822-82eb-78b0e9aec0ff tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] [instance: 533db4f5-5f62-47ab-9d4c-5e5a95c0b756] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:52.094616 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d8c56e63-1a68-4822-82eb-78b0e9aec0ff tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:52.095180 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d8c56e63-1a68-4822-82eb-78b0e9aec0ff tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:52.095628 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d8c56e63-1a68-4822-82eb-78b0e9aec0ff tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:52.096504 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d8c56e63-1a68-4822-82eb-78b0e9aec0ff tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:52.096967 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d8c56e63-1a68-4822-82eb-78b0e9aec0ff tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:52.097803 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d8c56e63-1a68-4822-82eb-78b0e9aec0ff tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:52.521236 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-d8c56e63-1a68-4822-82eb-78b0e9aec0ff tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a41ab6fb78a42ceaca621c5a38ffc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa31ed92017490a82497c7b8910aef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:52.533554 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-d8c56e63-1a68-4822-82eb-78b0e9aec0ff tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] 10.222.0.43 "GET /compute/v2.1/servers/533db4f5-5f62-47ab-9d4c-5e5a95c0b756" status: 200 len: 1308 microversion: 2.1 time: 0.450685 Oct 04 18:33:52.534782 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 415/766] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:52 2022] GET /compute/v2.1/servers/533db4f5-5f62-47ab-9d4c-5e5a95c0b756 => generated 1308 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:52.540900 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-c17f7d8e-9683-46ea-89dc-2e6fcbce4709 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:52.546522 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-c17f7d8e-9683-46ea-89dc-2e6fcbce4709 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] [instance: bcc13e2d-03e7-464d-abac-f5ffb7cbb509] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:52.567736 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c17f7d8e-9683-46ea-89dc-2e6fcbce4709 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:52.569571 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c17f7d8e-9683-46ea-89dc-2e6fcbce4709 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:52.570046 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c17f7d8e-9683-46ea-89dc-2e6fcbce4709 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:52.572876 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c17f7d8e-9683-46ea-89dc-2e6fcbce4709 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:52.574351 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c17f7d8e-9683-46ea-89dc-2e6fcbce4709 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:52.575091 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c17f7d8e-9683-46ea-89dc-2e6fcbce4709 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:52.715698 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-c17f7d8e-9683-46ea-89dc-2e6fcbce4709 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4aec5af742842f5bb2048c8b7d60687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829069b2787a423f922fcc5b5702f167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:52.725076 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-c17f7d8e-9683-46ea-89dc-2e6fcbce4709 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] 10.222.0.43 "GET /compute/v2.1/servers/bcc13e2d-03e7-464d-abac-f5ffb7cbb509" status: 200 len: 1277 microversion: 2.1 time: 0.188845 Oct 04 18:33:52.737577 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 416/767] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:52 2022] GET /compute/v2.1/servers/bcc13e2d-03e7-464d-abac-f5ffb7cbb509 => generated 1277 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:52.862439 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-428b0794-2941-4e40-983a-1e6561e7dd8d tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:52.864008 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-428b0794-2941-4e40-983a-1e6561e7dd8d tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] [instance: b2c8854b-ed0b-4727-b89b-f0633f75d9de] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:52.878137 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-428b0794-2941-4e40-983a-1e6561e7dd8d tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:52.881409 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-428b0794-2941-4e40-983a-1e6561e7dd8d tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:52.881409 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-428b0794-2941-4e40-983a-1e6561e7dd8d tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:52.881409 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-428b0794-2941-4e40-983a-1e6561e7dd8d tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:52.881816 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-428b0794-2941-4e40-983a-1e6561e7dd8d tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:52.882234 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-428b0794-2941-4e40-983a-1e6561e7dd8d tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:52.992343 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-428b0794-2941-4e40-983a-1e6561e7dd8d tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7db99f361654711bea7f1b2c404d312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7adedcdb9c3485ea2738c00e25aa3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:53.002389 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-6bb4c26d-5a30-4892-9955-487af62dc374 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:53.033374 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-428b0794-2941-4e40-983a-1e6561e7dd8d tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] 10.222.0.43 "GET /compute/v2.1/servers/b2c8854b-ed0b-4727-b89b-f0633f75d9de" status: 200 len: 1275 microversion: 2.1 time: 0.176208 Oct 04 18:33:53.038900 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 417/768] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:52 2022] GET /compute/v2.1/servers/b2c8854b-ed0b-4727-b89b-f0633f75d9de => generated 1275 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:53.039690 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-6bb4c26d-5a30-4892-9955-487af62dc374 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:53.069003 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-6bb4c26d-5a30-4892-9955-487af62dc374 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:53.077223 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-6bb4c26d-5a30-4892-9955-487af62dc374 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] 10.222.0.43 "GET /compute/v2.1/servers/9895c2ec-35ea-419e-9565-0c0f2fc5bbbc" status: 200 len: 1360 microversion: 2.25 time: 1.622461 Oct 04 18:33:53.108607 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-4dd61fd9-579e-46f4-baa0-a6ed26d3f123 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:53.109693 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-4dd61fd9-579e-46f4-baa0-a6ed26d3f123 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] [instance: 84e0414b-a39f-4bfe-bc9d-c170ceb34d15] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:53.124554 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4dd61fd9-579e-46f4-baa0-a6ed26d3f123 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:53.125458 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4dd61fd9-579e-46f4-baa0-a6ed26d3f123 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:53.126094 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4dd61fd9-579e-46f4-baa0-a6ed26d3f123 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:53.128235 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4dd61fd9-579e-46f4-baa0-a6ed26d3f123 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:53.129815 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4dd61fd9-579e-46f4-baa0-a6ed26d3f123 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:53.131685 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4dd61fd9-579e-46f4-baa0-a6ed26d3f123 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:53.154661 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 352/769] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:33:51 2022] GET /compute/v2.1/servers/9895c2ec-35ea-419e-9565-0c0f2fc5bbbc => generated 1360 bytes in 1688 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:33:53.335235 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-4dd61fd9-579e-46f4-baa0-a6ed26d3f123 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:53.347662 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-4dd61fd9-579e-46f4-baa0-a6ed26d3f123 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:53.352263 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-4dd61fd9-579e-46f4-baa0-a6ed26d3f123 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:53.364422 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-4dd61fd9-579e-46f4-baa0-a6ed26d3f123 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] 10.222.0.43 "GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15" status: 200 len: 1553 microversion: 2.91 time: 0.260346 Oct 04 18:33:53.380944 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 418/770] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:33:53 2022] GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15 => generated 1553 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:33:53.499591 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-e1e60e09-c025-464f-9cdc-0d9316e2b2b0 req-e2728090-ffaa-4294-aba7-4b13428fac97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "533db4f5-5f62-47ab-9d4c-5e5a95c0b756", "name": "network-vif-plugged", "status": "completed", "tag": "9dc10a12-f514-49cb-8d56-3dda7855de52"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:33:53.525718 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-e1e60e09-c025-464f-9cdc-0d9316e2b2b0 req-e2728090-ffaa-4294-aba7-4b13428fac97 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:53.527000 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-e1e60e09-c025-464f-9cdc-0d9316e2b2b0 req-e2728090-ffaa-4294-aba7-4b13428fac97 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:53.528785 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-e1e60e09-c025-464f-9cdc-0d9316e2b2b0 req-e2728090-ffaa-4294-aba7-4b13428fac97 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:53.557589 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-e84604c8-6474-4e2e-939b-c5430af827fc tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:53.558510 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-e84604c8-6474-4e2e-939b-c5430af827fc tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] [instance: 533db4f5-5f62-47ab-9d4c-5e5a95c0b756] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:53.577397 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e84604c8-6474-4e2e-939b-c5430af827fc tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:53.577985 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e84604c8-6474-4e2e-939b-c5430af827fc tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:53.578856 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e84604c8-6474-4e2e-939b-c5430af827fc tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:53.582567 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-e1e60e09-c025-464f-9cdc-0d9316e2b2b0 req-e2728090-ffaa-4294-aba7-4b13428fac97 service nova] Creating event network-vif-plugged:9dc10a12-f514-49cb-8d56-3dda7855de52 for instance 533db4f5-5f62-47ab-9d4c-5e5a95c0b756 on n-h2-851028-13 Oct 04 18:33:53.584226 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e84604c8-6474-4e2e-939b-c5430af827fc tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:53.584729 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e84604c8-6474-4e2e-939b-c5430af827fc tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:53.585190 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e84604c8-6474-4e2e-939b-c5430af827fc tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:53.605256 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-e1e60e09-c025-464f-9cdc-0d9316e2b2b0 req-e2728090-ffaa-4294-aba7-4b13428fac97 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102374 Oct 04 18:33:53.611037 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 353/771] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:33:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:33:53.753282 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-7ed7cb6a-fa77-4f71-b9f4-49ae8782dcff tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:53.754970 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-7ed7cb6a-fa77-4f71-b9f4-49ae8782dcff tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] [instance: bcc13e2d-03e7-464d-abac-f5ffb7cbb509] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:53.766436 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7ed7cb6a-fa77-4f71-b9f4-49ae8782dcff tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:53.774078 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7ed7cb6a-fa77-4f71-b9f4-49ae8782dcff tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:53.775526 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7ed7cb6a-fa77-4f71-b9f4-49ae8782dcff tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:53.780705 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7ed7cb6a-fa77-4f71-b9f4-49ae8782dcff tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:53.785263 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7ed7cb6a-fa77-4f71-b9f4-49ae8782dcff tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:53.787492 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7ed7cb6a-fa77-4f71-b9f4-49ae8782dcff tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:53.972954 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-e84604c8-6474-4e2e-939b-c5430af827fc tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a41ab6fb78a42ceaca621c5a38ffc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa31ed92017490a82497c7b8910aef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:53.981098 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-e84604c8-6474-4e2e-939b-c5430af827fc tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] 10.222.0.43 "GET /compute/v2.1/servers/533db4f5-5f62-47ab-9d4c-5e5a95c0b756" status: 200 len: 1308 microversion: 2.1 time: 0.427887 Oct 04 18:33:53.981705 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 419/772] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:53 2022] GET /compute/v2.1/servers/533db4f5-5f62-47ab-9d4c-5e5a95c0b756 => generated 1308 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:54.068288 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-9f6229b6-ea1b-4ef3-8f0f-5aa487dde3ce tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:54.069185 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-9f6229b6-ea1b-4ef3-8f0f-5aa487dde3ce tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] [instance: b2c8854b-ed0b-4727-b89b-f0633f75d9de] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:54.078349 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9f6229b6-ea1b-4ef3-8f0f-5aa487dde3ce tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:54.079441 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9f6229b6-ea1b-4ef3-8f0f-5aa487dde3ce tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:54.081704 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9f6229b6-ea1b-4ef3-8f0f-5aa487dde3ce tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:54.083995 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9f6229b6-ea1b-4ef3-8f0f-5aa487dde3ce tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:54.084864 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9f6229b6-ea1b-4ef3-8f0f-5aa487dde3ce tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:54.087278 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9f6229b6-ea1b-4ef3-8f0f-5aa487dde3ce tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:54.206524 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-9f6229b6-ea1b-4ef3-8f0f-5aa487dde3ce tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7db99f361654711bea7f1b2c404d312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7adedcdb9c3485ea2738c00e25aa3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:54.222290 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-9f6229b6-ea1b-4ef3-8f0f-5aa487dde3ce tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] 10.222.0.43 "GET /compute/v2.1/servers/b2c8854b-ed0b-4727-b89b-f0633f75d9de" status: 200 len: 1275 microversion: 2.1 time: 0.158041 Oct 04 18:33:54.225606 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 420/773] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:54 2022] GET /compute/v2.1/servers/b2c8854b-ed0b-4727-b89b-f0633f75d9de => generated 1275 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:54.237675 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-855f88c9-4983-46fc-a572-0b185ac8c92e tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:54.239872 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-855f88c9-4983-46fc-a572-0b185ac8c92e tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] [instance: 9895c2ec-35ea-419e-9565-0c0f2fc5bbbc] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:54.250907 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-855f88c9-4983-46fc-a572-0b185ac8c92e tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:54.252255 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-855f88c9-4983-46fc-a572-0b185ac8c92e tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:54.253151 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-855f88c9-4983-46fc-a572-0b185ac8c92e tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:54.255703 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-855f88c9-4983-46fc-a572-0b185ac8c92e tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:54.264256 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-855f88c9-4983-46fc-a572-0b185ac8c92e tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:54.264961 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-855f88c9-4983-46fc-a572-0b185ac8c92e tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:54.277153 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-7ed7cb6a-fa77-4f71-b9f4-49ae8782dcff tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4aec5af742842f5bb2048c8b7d60687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829069b2787a423f922fcc5b5702f167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:54.290876 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-7ed7cb6a-fa77-4f71-b9f4-49ae8782dcff tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] 10.222.0.43 "GET /compute/v2.1/servers/bcc13e2d-03e7-464d-abac-f5ffb7cbb509" status: 200 len: 1277 microversion: 2.1 time: 0.542775 Oct 04 18:33:54.291752 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 354/774] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:53 2022] GET /compute/v2.1/servers/bcc13e2d-03e7-464d-abac-f5ffb7cbb509 => generated 1277 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:33:54.397926 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-42b271d6-1498-4cce-af1c-32784d8d64b6 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:54.398652 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-42b271d6-1498-4cce-af1c-32784d8d64b6 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] [instance: 84e0414b-a39f-4bfe-bc9d-c170ceb34d15] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:54.408039 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-42b271d6-1498-4cce-af1c-32784d8d64b6 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:54.413166 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-42b271d6-1498-4cce-af1c-32784d8d64b6 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:54.417545 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-42b271d6-1498-4cce-af1c-32784d8d64b6 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:54.418550 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-42b271d6-1498-4cce-af1c-32784d8d64b6 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:54.419227 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-42b271d6-1498-4cce-af1c-32784d8d64b6 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:54.419843 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-42b271d6-1498-4cce-af1c-32784d8d64b6 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:54.555602 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-855f88c9-4983-46fc-a572-0b185ac8c92e tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:54.572257 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-855f88c9-4983-46fc-a572-0b185ac8c92e tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:54.575398 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-855f88c9-4983-46fc-a572-0b185ac8c92e tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:54.576599 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-855f88c9-4983-46fc-a572-0b185ac8c92e tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] 10.222.0.43 "GET /compute/v2.1/servers/9895c2ec-35ea-419e-9565-0c0f2fc5bbbc" status: 200 len: 1360 microversion: 2.25 time: 0.348264 Oct 04 18:33:54.583199 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 421/775] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:33:54 2022] GET /compute/v2.1/servers/9895c2ec-35ea-419e-9565-0c0f2fc5bbbc => generated 1360 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:33:54.886882 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-42b271d6-1498-4cce-af1c-32784d8d64b6 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:54.897924 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-42b271d6-1498-4cce-af1c-32784d8d64b6 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:54.899927 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-42b271d6-1498-4cce-af1c-32784d8d64b6 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:54.908070 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-42b271d6-1498-4cce-af1c-32784d8d64b6 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] 10.222.0.43 "GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15" status: 200 len: 1553 microversion: 2.91 time: 0.513902 Oct 04 18:33:54.909536 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 355/776] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:33:54 2022] GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15 => generated 1553 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:33:55.006978 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-4cf0e947-87f4-477a-9995-c2ec10b618fe tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:55.007873 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-4cf0e947-87f4-477a-9995-c2ec10b618fe tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] [instance: 533db4f5-5f62-47ab-9d4c-5e5a95c0b756] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:55.051426 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4cf0e947-87f4-477a-9995-c2ec10b618fe tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:55.054348 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4cf0e947-87f4-477a-9995-c2ec10b618fe tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:55.055343 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4cf0e947-87f4-477a-9995-c2ec10b618fe tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:55.058555 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4cf0e947-87f4-477a-9995-c2ec10b618fe tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:55.061036 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4cf0e947-87f4-477a-9995-c2ec10b618fe tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:55.063848 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4cf0e947-87f4-477a-9995-c2ec10b618fe tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:55.251657 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-8da06633-4767-493b-a392-73b0938d6a45 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:55.252288 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-8da06633-4767-493b-a392-73b0938d6a45 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] [instance: b2c8854b-ed0b-4727-b89b-f0633f75d9de] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:55.273918 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8da06633-4767-493b-a392-73b0938d6a45 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:55.274435 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8da06633-4767-493b-a392-73b0938d6a45 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:55.274909 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8da06633-4767-493b-a392-73b0938d6a45 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:55.280290 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8da06633-4767-493b-a392-73b0938d6a45 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:55.281326 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8da06633-4767-493b-a392-73b0938d6a45 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:55.290123 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8da06633-4767-493b-a392-73b0938d6a45 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:55.348397 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=100 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:33:55.508057 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-8da06633-4767-493b-a392-73b0938d6a45 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7db99f361654711bea7f1b2c404d312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7adedcdb9c3485ea2738c00e25aa3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:55.520487 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-8da06633-4767-493b-a392-73b0938d6a45 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] 10.222.0.43 "GET /compute/v2.1/servers/b2c8854b-ed0b-4727-b89b-f0633f75d9de" status: 200 len: 1275 microversion: 2.1 time: 0.271296 Oct 04 18:33:55.537144 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 356/777] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:55 2022] GET /compute/v2.1/servers/b2c8854b-ed0b-4727-b89b-f0633f75d9de => generated 1275 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:33:55.537916 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-86b1b97c-29ae-430b-8f07-ac5b3c82d82e tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:55.538557 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-86b1b97c-29ae-430b-8f07-ac5b3c82d82e tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] [instance: bcc13e2d-03e7-464d-abac-f5ffb7cbb509] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:55.554619 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-86b1b97c-29ae-430b-8f07-ac5b3c82d82e tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:55.558709 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-86b1b97c-29ae-430b-8f07-ac5b3c82d82e tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:55.559340 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-86b1b97c-29ae-430b-8f07-ac5b3c82d82e tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:55.560098 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-86b1b97c-29ae-430b-8f07-ac5b3c82d82e tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:55.560745 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-86b1b97c-29ae-430b-8f07-ac5b3c82d82e tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:55.561211 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-86b1b97c-29ae-430b-8f07-ac5b3c82d82e tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:55.676900 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-4cf0e947-87f4-477a-9995-c2ec10b618fe tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a41ab6fb78a42ceaca621c5a38ffc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa31ed92017490a82497c7b8910aef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:55.687773 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-4cf0e947-87f4-477a-9995-c2ec10b618fe tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] 10.222.0.43 "GET /compute/v2.1/servers/533db4f5-5f62-47ab-9d4c-5e5a95c0b756" status: 200 len: 1308 microversion: 2.1 time: 0.683821 Oct 04 18:33:55.687773 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 422/778] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:55 2022] GET /compute/v2.1/servers/533db4f5-5f62-47ab-9d4c-5e5a95c0b756 => generated 1308 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:33:55.718148 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-ad380961-4f82-452b-9f8d-5cba3f2328aa tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:55.725971 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-ad380961-4f82-452b-9f8d-5cba3f2328aa tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] [instance: 9895c2ec-35ea-419e-9565-0c0f2fc5bbbc] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:55.732920 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ad380961-4f82-452b-9f8d-5cba3f2328aa tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:55.734617 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ad380961-4f82-452b-9f8d-5cba3f2328aa tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:55.738736 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ad380961-4f82-452b-9f8d-5cba3f2328aa tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:55.739684 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ad380961-4f82-452b-9f8d-5cba3f2328aa tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:55.740282 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ad380961-4f82-452b-9f8d-5cba3f2328aa tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:55.740830 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ad380961-4f82-452b-9f8d-5cba3f2328aa tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:55.748161 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-86b1b97c-29ae-430b-8f07-ac5b3c82d82e tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4aec5af742842f5bb2048c8b7d60687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829069b2787a423f922fcc5b5702f167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:55.757582 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-86b1b97c-29ae-430b-8f07-ac5b3c82d82e tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] 10.222.0.43 "GET /compute/v2.1/servers/bcc13e2d-03e7-464d-abac-f5ffb7cbb509" status: 200 len: 1277 microversion: 2.1 time: 0.232547 Oct 04 18:33:55.774533 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 357/779] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:55 2022] GET /compute/v2.1/servers/bcc13e2d-03e7-464d-abac-f5ffb7cbb509 => generated 1277 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:55.850455 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-e7c003e1-cbd9-49cb-a15a-d434e7bf7fc7 req-fc939eea-f3ed-4ee9-9a9c-1b00d401a7fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9895c2ec-35ea-419e-9565-0c0f2fc5bbbc", "tag": "d1c13a57-f549-4198-9a2d-173f2932d012"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:33:55.869241 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-e7c003e1-cbd9-49cb-a15a-d434e7bf7fc7 req-fc939eea-f3ed-4ee9-9a9c-1b00d401a7fe service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:55.873654 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-e7c003e1-cbd9-49cb-a15a-d434e7bf7fc7 req-fc939eea-f3ed-4ee9-9a9c-1b00d401a7fe service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:55.874626 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-e7c003e1-cbd9-49cb-a15a-d434e7bf7fc7 req-fc939eea-f3ed-4ee9-9a9c-1b00d401a7fe service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:55.898518 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-e7c003e1-cbd9-49cb-a15a-d434e7bf7fc7 req-fc939eea-f3ed-4ee9-9a9c-1b00d401a7fe service nova] Creating event network-changed:d1c13a57-f549-4198-9a2d-173f2932d012 for instance 9895c2ec-35ea-419e-9565-0c0f2fc5bbbc on n-h1-851028-13 Oct 04 18:33:55.916125 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-e7c003e1-cbd9-49cb-a15a-d434e7bf7fc7 req-fc939eea-f3ed-4ee9-9a9c-1b00d401a7fe service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068628 Oct 04 18:33:55.924825 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 358/780] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:33:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:33:55.957836 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-9a8d9b95-e9fb-4e12-b966-97bd818ccda5 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:55.960275 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-9a8d9b95-e9fb-4e12-b966-97bd818ccda5 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] [instance: 84e0414b-a39f-4bfe-bc9d-c170ceb34d15] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:55.977316 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9a8d9b95-e9fb-4e12-b966-97bd818ccda5 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:55.978945 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9a8d9b95-e9fb-4e12-b966-97bd818ccda5 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:55.983389 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9a8d9b95-e9fb-4e12-b966-97bd818ccda5 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:55.984674 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9a8d9b95-e9fb-4e12-b966-97bd818ccda5 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:55.985429 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9a8d9b95-e9fb-4e12-b966-97bd818ccda5 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:55.986128 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9a8d9b95-e9fb-4e12-b966-97bd818ccda5 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:56.325205 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-9a8d9b95-e9fb-4e12-b966-97bd818ccda5 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:56.343712 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-9a8d9b95-e9fb-4e12-b966-97bd818ccda5 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:56.348458 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-9a8d9b95-e9fb-4e12-b966-97bd818ccda5 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:56.364348 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:33:56.370115 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-9a8d9b95-e9fb-4e12-b966-97bd818ccda5 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] 10.222.0.43 "GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15" status: 200 len: 1553 microversion: 2.91 time: 0.421689 Oct 04 18:33:56.376009 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-ad380961-4f82-452b-9f8d-5cba3f2328aa tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:56.407411 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 359/781] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:33:55 2022] GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15 => generated 1553 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:33:56.412563 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-ad380961-4f82-452b-9f8d-5cba3f2328aa tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:56.418276 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-ad380961-4f82-452b-9f8d-5cba3f2328aa tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:56.419863 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-ad380961-4f82-452b-9f8d-5cba3f2328aa tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] 10.222.0.43 "GET /compute/v2.1/servers/9895c2ec-35ea-419e-9565-0c0f2fc5bbbc" status: 200 len: 1360 microversion: 2.25 time: 0.711260 Oct 04 18:33:56.422602 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 423/782] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:33:55 2022] GET /compute/v2.1/servers/9895c2ec-35ea-419e-9565-0c0f2fc5bbbc => generated 1360 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:33:56.551492 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-954885c5-d362-4ed3-a8b5-4fa77ea036dd tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:56.552113 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-954885c5-d362-4ed3-a8b5-4fa77ea036dd tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] [instance: b2c8854b-ed0b-4727-b89b-f0633f75d9de] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:56.576630 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-954885c5-d362-4ed3-a8b5-4fa77ea036dd tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:56.577197 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-954885c5-d362-4ed3-a8b5-4fa77ea036dd tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:56.577602 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-954885c5-d362-4ed3-a8b5-4fa77ea036dd tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:56.578329 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-954885c5-d362-4ed3-a8b5-4fa77ea036dd tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:56.578788 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-954885c5-d362-4ed3-a8b5-4fa77ea036dd tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:56.579217 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-954885c5-d362-4ed3-a8b5-4fa77ea036dd tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:56.716653 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-59dc2539-c3e8-4f98-8dc6-2ee8fadaf4f7 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:56.717379 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-59dc2539-c3e8-4f98-8dc6-2ee8fadaf4f7 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] [instance: 533db4f5-5f62-47ab-9d4c-5e5a95c0b756] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:56.730151 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-59dc2539-c3e8-4f98-8dc6-2ee8fadaf4f7 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:56.731980 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-59dc2539-c3e8-4f98-8dc6-2ee8fadaf4f7 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:56.733040 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-59dc2539-c3e8-4f98-8dc6-2ee8fadaf4f7 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:56.735255 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-59dc2539-c3e8-4f98-8dc6-2ee8fadaf4f7 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:56.736551 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-59dc2539-c3e8-4f98-8dc6-2ee8fadaf4f7 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:56.737018 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-59dc2539-c3e8-4f98-8dc6-2ee8fadaf4f7 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:57.266650 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-954885c5-d362-4ed3-a8b5-4fa77ea036dd tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7db99f361654711bea7f1b2c404d312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7adedcdb9c3485ea2738c00e25aa3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:57.277882 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-954885c5-d362-4ed3-a8b5-4fa77ea036dd tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] 10.222.0.43 "GET /compute/v2.1/servers/b2c8854b-ed0b-4727-b89b-f0633f75d9de" status: 200 len: 1317 microversion: 2.1 time: 0.730817 Oct 04 18:33:57.281616 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 360/783] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:56 2022] GET /compute/v2.1/servers/b2c8854b-ed0b-4727-b89b-f0633f75d9de => generated 1317 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:33:57.294572 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-59dc2539-c3e8-4f98-8dc6-2ee8fadaf4f7 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a41ab6fb78a42ceaca621c5a38ffc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa31ed92017490a82497c7b8910aef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:57.297666 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-928ad9e5-9f00-4e94-b63e-9860dffb4f35 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:57.298521 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-928ad9e5-9f00-4e94-b63e-9860dffb4f35 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] [instance: bcc13e2d-03e7-464d-abac-f5ffb7cbb509] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:57.305327 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-928ad9e5-9f00-4e94-b63e-9860dffb4f35 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:57.309252 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-928ad9e5-9f00-4e94-b63e-9860dffb4f35 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:57.309981 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-928ad9e5-9f00-4e94-b63e-9860dffb4f35 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:57.310923 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-928ad9e5-9f00-4e94-b63e-9860dffb4f35 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:57.314802 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-928ad9e5-9f00-4e94-b63e-9860dffb4f35 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:57.315625 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-928ad9e5-9f00-4e94-b63e-9860dffb4f35 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:57.317331 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-59dc2539-c3e8-4f98-8dc6-2ee8fadaf4f7 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] 10.222.0.43 "GET /compute/v2.1/servers/533db4f5-5f62-47ab-9d4c-5e5a95c0b756" status: 200 len: 1308 microversion: 2.1 time: 0.593433 Oct 04 18:33:57.321121 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 424/784] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:56 2022] GET /compute/v2.1/servers/533db4f5-5f62-47ab-9d4c-5e5a95c0b756 => generated 1308 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:33:57.416146 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-ddb0c1d4-0b12-4f7d-b3b2-ab98579bb245 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:57.416886 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-ddb0c1d4-0b12-4f7d-b3b2-ab98579bb245 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] [instance: 84e0414b-a39f-4bfe-bc9d-c170ceb34d15] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:57.436526 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:33:57.438193 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ddb0c1d4-0b12-4f7d-b3b2-ab98579bb245 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:57.442120 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ddb0c1d4-0b12-4f7d-b3b2-ab98579bb245 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:57.444284 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ddb0c1d4-0b12-4f7d-b3b2-ab98579bb245 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:57.448502 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ddb0c1d4-0b12-4f7d-b3b2-ab98579bb245 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:57.449245 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ddb0c1d4-0b12-4f7d-b3b2-ab98579bb245 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:57.450479 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ddb0c1d4-0b12-4f7d-b3b2-ab98579bb245 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:57.741637 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-ddb0c1d4-0b12-4f7d-b3b2-ab98579bb245 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:57.773935 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-ddb0c1d4-0b12-4f7d-b3b2-ab98579bb245 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:57.783753 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-ddb0c1d4-0b12-4f7d-b3b2-ab98579bb245 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:57.805709 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-ddb0c1d4-0b12-4f7d-b3b2-ab98579bb245 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] 10.222.0.43 "GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15" status: 200 len: 1553 microversion: 2.91 time: 0.395280 Oct 04 18:33:57.806313 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 425/785] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:33:57 2022] GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15 => generated 1553 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:33:57.812212 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-c66c0269-c368-4d35-b6ea-57b4c4dfcbfb tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:57.813092 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-c66c0269-c368-4d35-b6ea-57b4c4dfcbfb tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] [instance: 9895c2ec-35ea-419e-9565-0c0f2fc5bbbc] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:57.834092 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c66c0269-c368-4d35-b6ea-57b4c4dfcbfb tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:57.834692 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c66c0269-c368-4d35-b6ea-57b4c4dfcbfb tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:57.835199 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c66c0269-c368-4d35-b6ea-57b4c4dfcbfb tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:57.836199 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c66c0269-c368-4d35-b6ea-57b4c4dfcbfb tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:57.836868 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c66c0269-c368-4d35-b6ea-57b4c4dfcbfb tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:57.837534 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c66c0269-c368-4d35-b6ea-57b4c4dfcbfb tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:57.997670 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-928ad9e5-9f00-4e94-b63e-9860dffb4f35 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4aec5af742842f5bb2048c8b7d60687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829069b2787a423f922fcc5b5702f167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:58.013612 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-928ad9e5-9f00-4e94-b63e-9860dffb4f35 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] 10.222.0.43 "GET /compute/v2.1/servers/bcc13e2d-03e7-464d-abac-f5ffb7cbb509" status: 200 len: 1319 microversion: 2.1 time: 0.729567 Oct 04 18:33:58.018262 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 361/786] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:57 2022] GET /compute/v2.1/servers/bcc13e2d-03e7-464d-abac-f5ffb7cbb509 => generated 1319 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:58.309919 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-eb38b81e-8a8b-4be7-85db-629408941a8d tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:58.310837 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-eb38b81e-8a8b-4be7-85db-629408941a8d tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] [instance: b2c8854b-ed0b-4727-b89b-f0633f75d9de] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:58.320391 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-eb38b81e-8a8b-4be7-85db-629408941a8d tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:58.321203 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-eb38b81e-8a8b-4be7-85db-629408941a8d tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:58.323481 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-eb38b81e-8a8b-4be7-85db-629408941a8d tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:58.324414 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-eb38b81e-8a8b-4be7-85db-629408941a8d tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:58.325909 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-eb38b81e-8a8b-4be7-85db-629408941a8d tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:58.330095 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-eb38b81e-8a8b-4be7-85db-629408941a8d tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:58.733014 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-eb38b81e-8a8b-4be7-85db-629408941a8d tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7db99f361654711bea7f1b2c404d312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7adedcdb9c3485ea2738c00e25aa3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:58.754013 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-eb38b81e-8a8b-4be7-85db-629408941a8d tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] 10.222.0.43 "GET /compute/v2.1/servers/b2c8854b-ed0b-4727-b89b-f0633f75d9de" status: 200 len: 1317 microversion: 2.1 time: 0.446228 Oct 04 18:33:58.756687 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 362/787] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:58 2022] GET /compute/v2.1/servers/b2c8854b-ed0b-4727-b89b-f0633f75d9de => generated 1317 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:33:58.778176 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-ec3d38e8-b476-4905-bea8-7941316c6436 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:58.779072 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-ec3d38e8-b476-4905-bea8-7941316c6436 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] [instance: 533db4f5-5f62-47ab-9d4c-5e5a95c0b756] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:58.796421 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ec3d38e8-b476-4905-bea8-7941316c6436 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:58.797339 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ec3d38e8-b476-4905-bea8-7941316c6436 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:58.798237 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ec3d38e8-b476-4905-bea8-7941316c6436 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:58.805148 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ec3d38e8-b476-4905-bea8-7941316c6436 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:58.807257 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ec3d38e8-b476-4905-bea8-7941316c6436 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:58.808509 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ec3d38e8-b476-4905-bea8-7941316c6436 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:58.903097 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=6 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:33:59.105232 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-c66c0269-c368-4d35-b6ea-57b4c4dfcbfb tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:59.122639 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-c66c0269-c368-4d35-b6ea-57b4c4dfcbfb tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:59.124410 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-c66c0269-c368-4d35-b6ea-57b4c4dfcbfb tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:59.125773 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-c66c0269-c368-4d35-b6ea-57b4c4dfcbfb tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] 10.222.0.43 "GET /compute/v2.1/servers/9895c2ec-35ea-419e-9565-0c0f2fc5bbbc" status: 200 len: 1360 microversion: 2.25 time: 1.318242 Oct 04 18:33:59.141768 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 426/788] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:33:57 2022] GET /compute/v2.1/servers/9895c2ec-35ea-419e-9565-0c0f2fc5bbbc => generated 1360 bytes in 1335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:33:59.150139 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-e9c6d07a-cd9a-4cd0-8ca1-81d42a18e5a9 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:59.151814 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-e9c6d07a-cd9a-4cd0-8ca1-81d42a18e5a9 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] [instance: 84e0414b-a39f-4bfe-bc9d-c170ceb34d15] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:59.159039 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e9c6d07a-cd9a-4cd0-8ca1-81d42a18e5a9 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:59.159801 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e9c6d07a-cd9a-4cd0-8ca1-81d42a18e5a9 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:59.160400 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e9c6d07a-cd9a-4cd0-8ca1-81d42a18e5a9 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:59.161337 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e9c6d07a-cd9a-4cd0-8ca1-81d42a18e5a9 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:59.161960 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e9c6d07a-cd9a-4cd0-8ca1-81d42a18e5a9 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:59.162663 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e9c6d07a-cd9a-4cd0-8ca1-81d42a18e5a9 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:59.288036 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-e9c6d07a-cd9a-4cd0-8ca1-81d42a18e5a9 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:59.316436 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-e9c6d07a-cd9a-4cd0-8ca1-81d42a18e5a9 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:59.321578 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-ec3d38e8-b476-4905-bea8-7941316c6436 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a41ab6fb78a42ceaca621c5a38ffc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa31ed92017490a82497c7b8910aef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:59.333851 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-e9c6d07a-cd9a-4cd0-8ca1-81d42a18e5a9 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:59.338495 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-ec3d38e8-b476-4905-bea8-7941316c6436 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] 10.222.0.43 "GET /compute/v2.1/servers/533db4f5-5f62-47ab-9d4c-5e5a95c0b756" status: 200 len: 1488 microversion: 2.1 time: 0.580099 Oct 04 18:33:59.339358 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-e9c6d07a-cd9a-4cd0-8ca1-81d42a18e5a9 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] 10.222.0.43 "GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15" status: 200 len: 1553 microversion: 2.91 time: 0.196230 Oct 04 18:33:59.354018 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 427/789] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:33:59 2022] GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15 => generated 1553 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:33:59.354018 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-2e3be171-5ec0-4db7-a624-c77e3514a9ef tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:59.354018 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-2e3be171-5ec0-4db7-a624-c77e3514a9ef tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] [instance: bcc13e2d-03e7-464d-abac-f5ffb7cbb509] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:59.362249 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 363/790] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:58 2022] GET /compute/v2.1/servers/533db4f5-5f62-47ab-9d4c-5e5a95c0b756 => generated 1488 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:59.374684 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-54d6fadf-59f5-4676-8136-ca9010b5576c tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:33:59.375372 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-54d6fadf-59f5-4676-8136-ca9010b5576c tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] [instance: 533db4f5-5f62-47ab-9d4c-5e5a95c0b756] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:59.377435 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2e3be171-5ec0-4db7-a624-c77e3514a9ef tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:59.378164 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2e3be171-5ec0-4db7-a624-c77e3514a9ef tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:59.380031 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2e3be171-5ec0-4db7-a624-c77e3514a9ef tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:59.383420 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2e3be171-5ec0-4db7-a624-c77e3514a9ef tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:59.388223 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2e3be171-5ec0-4db7-a624-c77e3514a9ef tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:59.390925 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2e3be171-5ec0-4db7-a624-c77e3514a9ef tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:59.392796 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-54d6fadf-59f5-4676-8136-ca9010b5576c tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:59.397088 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-54d6fadf-59f5-4676-8136-ca9010b5576c tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:59.397733 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-54d6fadf-59f5-4676-8136-ca9010b5576c tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:59.398570 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-54d6fadf-59f5-4676-8136-ca9010b5576c tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:59.399137 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-54d6fadf-59f5-4676-8136-ca9010b5576c tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:59.399673 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-54d6fadf-59f5-4676-8136-ca9010b5576c tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:59.529263 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-54d6fadf-59f5-4676-8136-ca9010b5576c tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] 10.222.0.43 "POST /compute/v2.1/servers/533db4f5-5f62-47ab-9d4c-5e5a95c0b756/action" status: 202 len: 0 microversion: 2.1 time: 0.158334 Oct 04 18:33:59.530641 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 364/791] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 18:33:59 2022] POST /compute/v2.1/servers/533db4f5-5f62-47ab-9d4c-5e5a95c0b756/action => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:33:59.544757 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-d4d63b2f-7dae-4bef-9df3-fa21e813f914 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:59.545430 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-d4d63b2f-7dae-4bef-9df3-fa21e813f914 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] [instance: 533db4f5-5f62-47ab-9d4c-5e5a95c0b756] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:59.556820 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d4d63b2f-7dae-4bef-9df3-fa21e813f914 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:59.557630 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d4d63b2f-7dae-4bef-9df3-fa21e813f914 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:59.558622 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d4d63b2f-7dae-4bef-9df3-fa21e813f914 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:59.559534 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d4d63b2f-7dae-4bef-9df3-fa21e813f914 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:59.568258 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d4d63b2f-7dae-4bef-9df3-fa21e813f914 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:59.568896 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d4d63b2f-7dae-4bef-9df3-fa21e813f914 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:59.616335 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=24 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:33:59.886262 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-d4d63b2f-7dae-4bef-9df3-fa21e813f914 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a41ab6fb78a42ceaca621c5a38ffc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa31ed92017490a82497c7b8910aef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:59.913176 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-d4d63b2f-7dae-4bef-9df3-fa21e813f914 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] 10.222.0.43 "GET /compute/v2.1/servers/533db4f5-5f62-47ab-9d4c-5e5a95c0b756" status: 200 len: 1493 microversion: 2.1 time: 0.371805 Oct 04 18:33:59.913788 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-2e3be171-5ec0-4db7-a624-c77e3514a9ef tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4aec5af742842f5bb2048c8b7d60687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829069b2787a423f922fcc5b5702f167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:59.926057 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-2e3be171-5ec0-4db7-a624-c77e3514a9ef tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] 10.222.0.43 "GET /compute/v2.1/servers/bcc13e2d-03e7-464d-abac-f5ffb7cbb509" status: 200 len: 1319 microversion: 2.1 time: 0.584523 Oct 04 18:33:59.929048 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 428/792] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:59 2022] GET /compute/v2.1/servers/bcc13e2d-03e7-464d-abac-f5ffb7cbb509 => generated 1319 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:59.935517 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 365/793] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:59 2022] GET /compute/v2.1/servers/533db4f5-5f62-47ab-9d4c-5e5a95c0b756 => generated 1493 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:59.942365 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-4a56205a-62be-48ac-ba1d-f96dda6110b1 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:59.944272 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-4a56205a-62be-48ac-ba1d-f96dda6110b1 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] [instance: b2c8854b-ed0b-4727-b89b-f0633f75d9de] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:59.960029 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4a56205a-62be-48ac-ba1d-f96dda6110b1 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:59.961647 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4a56205a-62be-48ac-ba1d-f96dda6110b1 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:59.966767 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4a56205a-62be-48ac-ba1d-f96dda6110b1 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:59.978716 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4a56205a-62be-48ac-ba1d-f96dda6110b1 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:59.980437 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4a56205a-62be-48ac-ba1d-f96dda6110b1 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:59.982052 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4a56205a-62be-48ac-ba1d-f96dda6110b1 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:59.983483 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-c733477c-a061-44e3-be04-250e5b528055 req-5d07aaab-a8ac-4bf2-980a-48241dd8f8a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2c8854b-ed0b-4727-b89b-f0633f75d9de", "tag": "218fd35c-7248-49e8-9f4b-8c869e0161e1"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:34:00.000886 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-c733477c-a061-44e3-be04-250e5b528055 req-5d07aaab-a8ac-4bf2-980a-48241dd8f8a6 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:00.004423 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-c733477c-a061-44e3-be04-250e5b528055 req-5d07aaab-a8ac-4bf2-980a-48241dd8f8a6 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:00.005539 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-c733477c-a061-44e3-be04-250e5b528055 req-5d07aaab-a8ac-4bf2-980a-48241dd8f8a6 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:00.043846 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-c733477c-a061-44e3-be04-250e5b528055 req-5d07aaab-a8ac-4bf2-980a-48241dd8f8a6 service nova] Creating event network-changed:218fd35c-7248-49e8-9f4b-8c869e0161e1 for instance b2c8854b-ed0b-4727-b89b-f0633f75d9de on n-h1-851028-13 Oct 04 18:34:00.057452 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-c733477c-a061-44e3-be04-250e5b528055 req-5d07aaab-a8ac-4bf2-980a-48241dd8f8a6 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077916 Oct 04 18:34:00.066574 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 366/794] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:33:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:34:00.158966 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-fda107b2-c3f7-4d8b-a94e-7e704ce07ddd tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:00.160599 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-fda107b2-c3f7-4d8b-a94e-7e704ce07ddd tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] [instance: 9895c2ec-35ea-419e-9565-0c0f2fc5bbbc] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:00.170192 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fda107b2-c3f7-4d8b-a94e-7e704ce07ddd tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:00.171537 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fda107b2-c3f7-4d8b-a94e-7e704ce07ddd tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:00.172390 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fda107b2-c3f7-4d8b-a94e-7e704ce07ddd tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:00.173353 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fda107b2-c3f7-4d8b-a94e-7e704ce07ddd tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:00.174054 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fda107b2-c3f7-4d8b-a94e-7e704ce07ddd tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:00.174657 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fda107b2-c3f7-4d8b-a94e-7e704ce07ddd tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:00.282666 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-4a56205a-62be-48ac-ba1d-f96dda6110b1 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7db99f361654711bea7f1b2c404d312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7adedcdb9c3485ea2738c00e25aa3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:00.288374 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=100 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:34:00.294799 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-4a56205a-62be-48ac-ba1d-f96dda6110b1 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] 10.222.0.43 "GET /compute/v2.1/servers/b2c8854b-ed0b-4727-b89b-f0633f75d9de" status: 200 len: 1317 microversion: 2.1 time: 0.364335 Oct 04 18:34:00.305759 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 429/795] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:59 2022] GET /compute/v2.1/servers/b2c8854b-ed0b-4727-b89b-f0633f75d9de => generated 1317 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:00.386760 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-9aaca5b5-aa9e-4ad4-a80c-5076de535118 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:00.387740 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-9aaca5b5-aa9e-4ad4-a80c-5076de535118 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] [instance: 84e0414b-a39f-4bfe-bc9d-c170ceb34d15] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:00.394858 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9aaca5b5-aa9e-4ad4-a80c-5076de535118 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:00.395732 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9aaca5b5-aa9e-4ad4-a80c-5076de535118 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:00.396410 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9aaca5b5-aa9e-4ad4-a80c-5076de535118 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:00.397537 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9aaca5b5-aa9e-4ad4-a80c-5076de535118 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:00.398247 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9aaca5b5-aa9e-4ad4-a80c-5076de535118 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:00.399009 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9aaca5b5-aa9e-4ad4-a80c-5076de535118 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:00.509425 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-9aaca5b5-aa9e-4ad4-a80c-5076de535118 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:00.526366 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-9aaca5b5-aa9e-4ad4-a80c-5076de535118 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:00.528240 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-9aaca5b5-aa9e-4ad4-a80c-5076de535118 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:00.534263 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-9aaca5b5-aa9e-4ad4-a80c-5076de535118 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] 10.222.0.43 "GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15" status: 200 len: 1535 microversion: 2.91 time: 0.152504 Oct 04 18:34:00.542410 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 430/796] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:34:00 2022] GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15 => generated 1535 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:34:00.632322 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-4b88f080-cf51-4791-b927-9d7c70d7bd6d req-f3c5b0b3-5db1-47cd-9415-4e5813308330 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bcc13e2d-03e7-464d-abac-f5ffb7cbb509", "tag": "245a7e0d-101b-4e22-8ab0-1570a93277ef"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:34:00.647707 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-fda107b2-c3f7-4d8b-a94e-7e704ce07ddd tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:00.651171 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-4b88f080-cf51-4791-b927-9d7c70d7bd6d req-f3c5b0b3-5db1-47cd-9415-4e5813308330 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:00.651721 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-4b88f080-cf51-4791-b927-9d7c70d7bd6d req-f3c5b0b3-5db1-47cd-9415-4e5813308330 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:00.652172 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-4b88f080-cf51-4791-b927-9d7c70d7bd6d req-f3c5b0b3-5db1-47cd-9415-4e5813308330 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:00.686459 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-4b88f080-cf51-4791-b927-9d7c70d7bd6d req-f3c5b0b3-5db1-47cd-9415-4e5813308330 service nova] Creating event network-changed:245a7e0d-101b-4e22-8ab0-1570a93277ef for instance bcc13e2d-03e7-464d-abac-f5ffb7cbb509 on n-h2-851028-13 Oct 04 18:34:00.690361 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-fda107b2-c3f7-4d8b-a94e-7e704ce07ddd tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:00.694743 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-fda107b2-c3f7-4d8b-a94e-7e704ce07ddd tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:00.696083 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-4b88f080-cf51-4791-b927-9d7c70d7bd6d req-f3c5b0b3-5db1-47cd-9415-4e5813308330 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065255 Oct 04 18:34:00.696975 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 431/797] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:34:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:34:00.697932 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-fda107b2-c3f7-4d8b-a94e-7e704ce07ddd tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] 10.222.0.43 "GET /compute/v2.1/servers/9895c2ec-35ea-419e-9565-0c0f2fc5bbbc" status: 200 len: 1360 microversion: 2.25 time: 0.544298 Oct 04 18:34:00.719286 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 367/798] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:34:00 2022] GET /compute/v2.1/servers/9895c2ec-35ea-419e-9565-0c0f2fc5bbbc => generated 1360 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:34:00.944061 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-34eb3173-5deb-4065-81cf-0007b1d68a37 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:00.946254 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-34eb3173-5deb-4065-81cf-0007b1d68a37 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] [instance: 533db4f5-5f62-47ab-9d4c-5e5a95c0b756] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:00.956195 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-1a8aa6a4-96a9-4aba-a160-6e035014dd77 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:00.956927 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-1a8aa6a4-96a9-4aba-a160-6e035014dd77 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] [instance: bcc13e2d-03e7-464d-abac-f5ffb7cbb509] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:00.959223 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-34eb3173-5deb-4065-81cf-0007b1d68a37 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:00.959728 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-34eb3173-5deb-4065-81cf-0007b1d68a37 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:00.960178 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-34eb3173-5deb-4065-81cf-0007b1d68a37 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:00.964251 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-34eb3173-5deb-4065-81cf-0007b1d68a37 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:00.965323 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-34eb3173-5deb-4065-81cf-0007b1d68a37 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:00.966197 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1a8aa6a4-96a9-4aba-a160-6e035014dd77 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:00.966934 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1a8aa6a4-96a9-4aba-a160-6e035014dd77 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:00.967469 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-34eb3173-5deb-4065-81cf-0007b1d68a37 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:00.969428 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1a8aa6a4-96a9-4aba-a160-6e035014dd77 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:00.970237 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1a8aa6a4-96a9-4aba-a160-6e035014dd77 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:00.972894 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1a8aa6a4-96a9-4aba-a160-6e035014dd77 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:00.973326 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1a8aa6a4-96a9-4aba-a160-6e035014dd77 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:01.249437 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-34eb3173-5deb-4065-81cf-0007b1d68a37 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a41ab6fb78a42ceaca621c5a38ffc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa31ed92017490a82497c7b8910aef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:01.258941 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-34eb3173-5deb-4065-81cf-0007b1d68a37 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] 10.222.0.43 "GET /compute/v2.1/servers/533db4f5-5f62-47ab-9d4c-5e5a95c0b756" status: 200 len: 1473 microversion: 2.1 time: 0.320797 Oct 04 18:34:01.262658 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 432/799] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:00 2022] GET /compute/v2.1/servers/533db4f5-5f62-47ab-9d4c-5e5a95c0b756 => generated 1473 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:01.288560 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-6a94e319-2119-4f18-8d70-993650d38db9 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1243202467"}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:34:01.291680 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-6a94e319-2119-4f18-8d70-993650d38db9 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] [instance: 533db4f5-5f62-47ab-9d4c-5e5a95c0b756] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:01.299744 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6a94e319-2119-4f18-8d70-993650d38db9 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:01.300789 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6a94e319-2119-4f18-8d70-993650d38db9 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:01.301617 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6a94e319-2119-4f18-8d70-993650d38db9 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:01.303114 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6a94e319-2119-4f18-8d70-993650d38db9 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:01.303849 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6a94e319-2119-4f18-8d70-993650d38db9 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:01.304565 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6a94e319-2119-4f18-8d70-993650d38db9 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:01.696100 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-6a94e319-2119-4f18-8d70-993650d38db9 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] 10.222.0.43 "POST /compute/v2.1/servers/533db4f5-5f62-47ab-9d4c-5e5a95c0b756/action" status: 202 len: 0 microversion: 2.1 time: 0.412694 Oct 04 18:34:01.701942 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 433/800] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 18:34:01 2022] POST /compute/v2.1/servers/533db4f5-5f62-47ab-9d4c-5e5a95c0b756/action => generated 0 bytes in 419 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 04 18:34:01.710520 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-65ab5cad-d946-42a9-9eef-b7e299f5f935 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:01.716551 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-65ab5cad-d946-42a9-9eef-b7e299f5f935 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] [instance: b2c8854b-ed0b-4727-b89b-f0633f75d9de] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:01.731257 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-65ab5cad-d946-42a9-9eef-b7e299f5f935 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:01.742334 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-65ab5cad-d946-42a9-9eef-b7e299f5f935 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:01.742942 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-65ab5cad-d946-42a9-9eef-b7e299f5f935 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:01.743670 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-65ab5cad-d946-42a9-9eef-b7e299f5f935 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:01.744143 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-65ab5cad-d946-42a9-9eef-b7e299f5f935 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:01.744574 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-65ab5cad-d946-42a9-9eef-b7e299f5f935 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:01.870095 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-1a8aa6a4-96a9-4aba-a160-6e035014dd77 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4aec5af742842f5bb2048c8b7d60687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829069b2787a423f922fcc5b5702f167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:01.881080 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-1a8aa6a4-96a9-4aba-a160-6e035014dd77 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] 10.222.0.43 "GET /compute/v2.1/servers/bcc13e2d-03e7-464d-abac-f5ffb7cbb509" status: 200 len: 1319 microversion: 2.1 time: 0.929362 Oct 04 18:34:01.886335 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 368/801] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:00 2022] GET /compute/v2.1/servers/bcc13e2d-03e7-464d-abac-f5ffb7cbb509 => generated 1319 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:01.896538 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-ff7d2423-da3d-4518-9b15-4d8fd4017b8a tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:01.901732 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-ff7d2423-da3d-4518-9b15-4d8fd4017b8a tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] [instance: 84e0414b-a39f-4bfe-bc9d-c170ceb34d15] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:01.913588 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ff7d2423-da3d-4518-9b15-4d8fd4017b8a tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:01.914263 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ff7d2423-da3d-4518-9b15-4d8fd4017b8a tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:01.914880 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ff7d2423-da3d-4518-9b15-4d8fd4017b8a tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:01.917329 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ff7d2423-da3d-4518-9b15-4d8fd4017b8a tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:01.917976 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ff7d2423-da3d-4518-9b15-4d8fd4017b8a tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:01.919946 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ff7d2423-da3d-4518-9b15-4d8fd4017b8a tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:02.118756 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-ff7d2423-da3d-4518-9b15-4d8fd4017b8a tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:02.147542 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-ff7d2423-da3d-4518-9b15-4d8fd4017b8a tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:02.152765 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-ff7d2423-da3d-4518-9b15-4d8fd4017b8a tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:02.155668 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-65ab5cad-d946-42a9-9eef-b7e299f5f935 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7db99f361654711bea7f1b2c404d312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7adedcdb9c3485ea2738c00e25aa3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:02.167345 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-ff7d2423-da3d-4518-9b15-4d8fd4017b8a tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] 10.222.0.43 "GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15" status: 200 len: 1535 microversion: 2.91 time: 0.279582 Oct 04 18:34:02.167705 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-65ab5cad-d946-42a9-9eef-b7e299f5f935 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] 10.222.0.43 "GET /compute/v2.1/servers/b2c8854b-ed0b-4727-b89b-f0633f75d9de" status: 200 len: 1317 microversion: 2.1 time: 0.464185 Oct 04 18:34:02.168478 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 434/802] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:01 2022] GET /compute/v2.1/servers/b2c8854b-ed0b-4727-b89b-f0633f75d9de => generated 1317 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:02.172865 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 369/803] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:34:01 2022] GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15 => generated 1535 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:34:02.176018 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-1ab615f2-b933-403c-8fb9-5c0f75665259 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Calling method '.version_select at 0x7fb21fb90280>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:02.201229 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-2be3d94c-1d41-46c0-9b7f-73ba5a102a1c tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:02.202080 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-2be3d94c-1d41-46c0-9b7f-73ba5a102a1c tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] [instance: 9895c2ec-35ea-419e-9565-0c0f2fc5bbbc] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:02.218789 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2be3d94c-1d41-46c0-9b7f-73ba5a102a1c tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:02.223923 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2be3d94c-1d41-46c0-9b7f-73ba5a102a1c tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:02.224474 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2be3d94c-1d41-46c0-9b7f-73ba5a102a1c tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:02.226393 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2be3d94c-1d41-46c0-9b7f-73ba5a102a1c tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:02.228292 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2be3d94c-1d41-46c0-9b7f-73ba5a102a1c tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:02.229201 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2be3d94c-1d41-46c0-9b7f-73ba5a102a1c tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:02.240310 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-1ab615f2-b933-403c-8fb9-5c0f75665259 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] 10.222.0.43 "GET /compute/v2.1/images/431ce5a8-e1dc-4eb2-a165-ad8ed0489d0b" status: 200 len: 1412 microversion: 2.1 time: 0.070520 Oct 04 18:34:02.266485 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 435/804] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 18:34:02 2022] GET /compute/v2.1/images/431ce5a8-e1dc-4eb2-a165-ad8ed0489d0b => generated 1412 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:02.907971 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-1bc282aa-6888-4988-9894-4e726712aa7e tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:02.908741 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-1bc282aa-6888-4988-9894-4e726712aa7e tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] [instance: bcc13e2d-03e7-464d-abac-f5ffb7cbb509] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:02.922563 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1bc282aa-6888-4988-9894-4e726712aa7e tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:02.923880 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1bc282aa-6888-4988-9894-4e726712aa7e tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:02.924545 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1bc282aa-6888-4988-9894-4e726712aa7e tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:02.927283 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1bc282aa-6888-4988-9894-4e726712aa7e tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:02.928035 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1bc282aa-6888-4988-9894-4e726712aa7e tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:02.930351 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1bc282aa-6888-4988-9894-4e726712aa7e tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:03.421777 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-2be3d94c-1d41-46c0-9b7f-73ba5a102a1c tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:03.431986 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-2be3d94c-1d41-46c0-9b7f-73ba5a102a1c tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:03.439137 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-2be3d94c-1d41-46c0-9b7f-73ba5a102a1c tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:03.441090 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-2be3d94c-1d41-46c0-9b7f-73ba5a102a1c tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] 10.222.0.43 "GET /compute/v2.1/servers/9895c2ec-35ea-419e-9565-0c0f2fc5bbbc" status: 200 len: 1360 microversion: 2.25 time: 1.257236 Oct 04 18:34:03.441862 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 370/805] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:34:02 2022] GET /compute/v2.1/servers/9895c2ec-35ea-419e-9565-0c0f2fc5bbbc => generated 1360 bytes in 1268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:34:03.480004 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-14557bbb-1e40-4377-8c30-f8f7a1d36ab4 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:03.481073 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-14557bbb-1e40-4377-8c30-f8f7a1d36ab4 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] [instance: b2c8854b-ed0b-4727-b89b-f0633f75d9de] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:03.496494 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-14557bbb-1e40-4377-8c30-f8f7a1d36ab4 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:03.497029 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-14557bbb-1e40-4377-8c30-f8f7a1d36ab4 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:03.497524 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-14557bbb-1e40-4377-8c30-f8f7a1d36ab4 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:03.501019 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-14557bbb-1e40-4377-8c30-f8f7a1d36ab4 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:03.502764 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-14557bbb-1e40-4377-8c30-f8f7a1d36ab4 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:03.506120 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-14557bbb-1e40-4377-8c30-f8f7a1d36ab4 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:03.974669 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-1bc282aa-6888-4988-9894-4e726712aa7e tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4aec5af742842f5bb2048c8b7d60687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829069b2787a423f922fcc5b5702f167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:03.986971 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-1bc282aa-6888-4988-9894-4e726712aa7e tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] 10.222.0.43 "GET /compute/v2.1/servers/bcc13e2d-03e7-464d-abac-f5ffb7cbb509" status: 200 len: 1319 microversion: 2.1 time: 1.082688 Oct 04 18:34:03.991250 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 436/806] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:02 2022] GET /compute/v2.1/servers/bcc13e2d-03e7-464d-abac-f5ffb7cbb509 => generated 1319 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:34:03.999042 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-00ec5980-913e-411c-852a-970691373ae0 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:03.999819 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-00ec5980-913e-411c-852a-970691373ae0 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] [instance: 84e0414b-a39f-4bfe-bc9d-c170ceb34d15] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:04.007273 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-00ec5980-913e-411c-852a-970691373ae0 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:04.007915 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-00ec5980-913e-411c-852a-970691373ae0 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:04.009999 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-00ec5980-913e-411c-852a-970691373ae0 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:04.010988 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-00ec5980-913e-411c-852a-970691373ae0 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:04.011689 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-00ec5980-913e-411c-852a-970691373ae0 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:04.016458 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-00ec5980-913e-411c-852a-970691373ae0 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:04.312235 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-00ec5980-913e-411c-852a-970691373ae0 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:04.334780 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-00ec5980-913e-411c-852a-970691373ae0 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:04.337055 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-00ec5980-913e-411c-852a-970691373ae0 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:04.372241 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-00ec5980-913e-411c-852a-970691373ae0 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] 10.222.0.43 "GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15" status: 200 len: 1538 microversion: 2.91 time: 0.379202 Oct 04 18:34:04.377648 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 437/807] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:34:03 2022] GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15 => generated 1538 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:34:04.393338 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-5cbb7c2a-7081-4143-bb28-c09e0a543de5 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Calling method '.version_select at 0x7fb21fd11790>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:04.463058 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-5cbb7c2a-7081-4143-bb28-c09e0a543de5 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] 10.222.0.43 "GET /compute/v2.1/images/431ce5a8-e1dc-4eb2-a165-ad8ed0489d0b" status: 200 len: 1412 microversion: 2.1 time: 0.083861 Oct 04 18:34:04.470865 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 438/808] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 18:34:04 2022] GET /compute/v2.1/images/431ce5a8-e1dc-4eb2-a165-ad8ed0489d0b => generated 1412 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:04.470865 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-05d82729-506d-40b9-be3f-9e969cb7285f tempest-UnshelveToHostMultiNodesTest-313056567 tempest-UnshelveToHostMultiNodesTest-313056567-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "n-h2-851028-13"}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:34:04.472293 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-05d82729-506d-40b9-be3f-9e969cb7285f tempest-UnshelveToHostMultiNodesTest-313056567 tempest-UnshelveToHostMultiNodesTest-313056567-project-admin] [instance: 84e0414b-a39f-4bfe-bc9d-c170ceb34d15] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:04.478508 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-05d82729-506d-40b9-be3f-9e969cb7285f tempest-UnshelveToHostMultiNodesTest-313056567 tempest-UnshelveToHostMultiNodesTest-313056567-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:04.479005 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-05d82729-506d-40b9-be3f-9e969cb7285f tempest-UnshelveToHostMultiNodesTest-313056567 tempest-UnshelveToHostMultiNodesTest-313056567-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:04.479453 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-05d82729-506d-40b9-be3f-9e969cb7285f tempest-UnshelveToHostMultiNodesTest-313056567 tempest-UnshelveToHostMultiNodesTest-313056567-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:04.480177 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-05d82729-506d-40b9-be3f-9e969cb7285f tempest-UnshelveToHostMultiNodesTest-313056567 tempest-UnshelveToHostMultiNodesTest-313056567-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:04.480637 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-05d82729-506d-40b9-be3f-9e969cb7285f tempest-UnshelveToHostMultiNodesTest-313056567 tempest-UnshelveToHostMultiNodesTest-313056567-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:04.481073 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-05d82729-506d-40b9-be3f-9e969cb7285f tempest-UnshelveToHostMultiNodesTest-313056567 tempest-UnshelveToHostMultiNodesTest-313056567-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:04.624139 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-05d82729-506d-40b9-be3f-9e969cb7285f tempest-UnshelveToHostMultiNodesTest-313056567 tempest-UnshelveToHostMultiNodesTest-313056567-project-admin] [instance: 84e0414b-a39f-4bfe-bc9d-c170ceb34d15] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "n-h2-851028-13". {{(pid=123596) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 04 18:34:04.760460 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-05d82729-506d-40b9-be3f-9e969cb7285f tempest-UnshelveToHostMultiNodesTest-313056567 tempest-UnshelveToHostMultiNodesTest-313056567-project-admin] 10.222.0.43 "POST /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15/action" status: 202 len: 0 microversion: 2.91 time: 0.291048 Oct 04 18:34:04.764023 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 439/809] 10.222.0.43 () {62 vars in 1319 bytes} [Tue Oct 4 18:34:04 2022] POST /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15/action => generated 0 bytes in 297 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:34:04.774526 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-e3501fbb-da68-4eef-a7b7-58a95dcb4b81 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:04.775150 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-e3501fbb-da68-4eef-a7b7-58a95dcb4b81 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] [instance: 9895c2ec-35ea-419e-9565-0c0f2fc5bbbc] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:04.786778 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e3501fbb-da68-4eef-a7b7-58a95dcb4b81 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:04.787290 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e3501fbb-da68-4eef-a7b7-58a95dcb4b81 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:04.787735 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e3501fbb-da68-4eef-a7b7-58a95dcb4b81 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:04.788454 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e3501fbb-da68-4eef-a7b7-58a95dcb4b81 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:04.788915 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e3501fbb-da68-4eef-a7b7-58a95dcb4b81 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:04.789380 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e3501fbb-da68-4eef-a7b7-58a95dcb4b81 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:04.985511 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-14557bbb-1e40-4377-8c30-f8f7a1d36ab4 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7db99f361654711bea7f1b2c404d312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7adedcdb9c3485ea2738c00e25aa3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:04.994606 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-14557bbb-1e40-4377-8c30-f8f7a1d36ab4 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] 10.222.0.43 "GET /compute/v2.1/servers/b2c8854b-ed0b-4727-b89b-f0633f75d9de" status: 200 len: 1317 microversion: 2.1 time: 1.530206 Oct 04 18:34:05.002183 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 371/810] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:03 2022] GET /compute/v2.1/servers/b2c8854b-ed0b-4727-b89b-f0633f75d9de => generated 1317 bytes in 1538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:05.021444 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-3d082f03-eefe-45cd-853c-e00a89d3c077 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:05.025661 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-3d082f03-eefe-45cd-853c-e00a89d3c077 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] [instance: 84e0414b-a39f-4bfe-bc9d-c170ceb34d15] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:05.032490 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3d082f03-eefe-45cd-853c-e00a89d3c077 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:05.037387 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3d082f03-eefe-45cd-853c-e00a89d3c077 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:05.038039 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3d082f03-eefe-45cd-853c-e00a89d3c077 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:05.039227 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3d082f03-eefe-45cd-853c-e00a89d3c077 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:05.039850 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3d082f03-eefe-45cd-853c-e00a89d3c077 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:05.040581 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3d082f03-eefe-45cd-853c-e00a89d3c077 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:05.230846 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-e3501fbb-da68-4eef-a7b7-58a95dcb4b81 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:05.245262 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-e3501fbb-da68-4eef-a7b7-58a95dcb4b81 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:05.254910 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-e3501fbb-da68-4eef-a7b7-58a95dcb4b81 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:05.256242 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-e3501fbb-da68-4eef-a7b7-58a95dcb4b81 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] 10.222.0.43 "GET /compute/v2.1/servers/9895c2ec-35ea-419e-9565-0c0f2fc5bbbc" status: 200 len: 1360 microversion: 2.25 time: 0.492903 Oct 04 18:34:05.257702 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 440/811] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:34:04 2022] GET /compute/v2.1/servers/9895c2ec-35ea-419e-9565-0c0f2fc5bbbc => generated 1360 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:34:05.264378 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-8d40e72e-8b65-4373-8111-002a7158a75f tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:05.270060 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-8d40e72e-8b65-4373-8111-002a7158a75f tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] [instance: bcc13e2d-03e7-464d-abac-f5ffb7cbb509] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:05.283176 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8d40e72e-8b65-4373-8111-002a7158a75f tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:05.283535 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8d40e72e-8b65-4373-8111-002a7158a75f tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:05.284165 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8d40e72e-8b65-4373-8111-002a7158a75f tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:05.285648 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8d40e72e-8b65-4373-8111-002a7158a75f tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:05.286483 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8d40e72e-8b65-4373-8111-002a7158a75f tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:05.290314 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8d40e72e-8b65-4373-8111-002a7158a75f tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:05.301216 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-3d082f03-eefe-45cd-853c-e00a89d3c077 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:05.311995 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-3d082f03-eefe-45cd-853c-e00a89d3c077 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:05.319133 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-3d082f03-eefe-45cd-853c-e00a89d3c077 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:05.331809 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-3d082f03-eefe-45cd-853c-e00a89d3c077 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] 10.222.0.43 "GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15" status: 200 len: 1486 microversion: 2.91 time: 0.327133 Oct 04 18:34:05.351625 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 372/812] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:34:05 2022] GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15 => generated 1486 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:34:05.479131 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-c883df2d-aa5f-449a-8df8-af15f10cea15 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Calling method '.version_select at 0x7fb21fc609d0>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:05.540878 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-c883df2d-aa5f-449a-8df8-af15f10cea15 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] 10.222.0.43 "GET /compute/v2.1/images/431ce5a8-e1dc-4eb2-a165-ad8ed0489d0b" status: 200 len: 1412 microversion: 2.1 time: 0.065348 Oct 04 18:34:05.543677 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 373/813] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 18:34:05 2022] GET /compute/v2.1/images/431ce5a8-e1dc-4eb2-a165-ad8ed0489d0b => generated 1412 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:05.675406 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-8d40e72e-8b65-4373-8111-002a7158a75f tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4aec5af742842f5bb2048c8b7d60687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829069b2787a423f922fcc5b5702f167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:05.686210 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-8d40e72e-8b65-4373-8111-002a7158a75f tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] 10.222.0.43 "GET /compute/v2.1/servers/bcc13e2d-03e7-464d-abac-f5ffb7cbb509" status: 200 len: 1319 microversion: 2.1 time: 0.427207 Oct 04 18:34:05.693267 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 441/814] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:05 2022] GET /compute/v2.1/servers/bcc13e2d-03e7-464d-abac-f5ffb7cbb509 => generated 1319 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:06.024813 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-a371f8b6-e451-499d-9287-d90f54184b35 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:06.025843 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-a371f8b6-e451-499d-9287-d90f54184b35 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] [instance: b2c8854b-ed0b-4727-b89b-f0633f75d9de] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:06.064960 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a371f8b6-e451-499d-9287-d90f54184b35 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:06.074737 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a371f8b6-e451-499d-9287-d90f54184b35 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:06.075512 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a371f8b6-e451-499d-9287-d90f54184b35 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:06.076429 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a371f8b6-e451-499d-9287-d90f54184b35 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:06.077927 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a371f8b6-e451-499d-9287-d90f54184b35 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:06.082446 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a371f8b6-e451-499d-9287-d90f54184b35 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:06.137243 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-f90eb645-5b29-4513-b59d-30881c21d1f3 tempest-FloatingIPsNegativeTestJSON-553706323 tempest-FloatingIPsNegativeTestJSON-553706323-project] Calling method '.version_select at 0x7fb21fd10160>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:06.304057 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-f90eb645-5b29-4513-b59d-30881c21d1f3 tempest-FloatingIPsNegativeTestJSON-553706323 tempest-FloatingIPsNegativeTestJSON-553706323-project] 10.222.0.43 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 0.308075 Oct 04 18:34:06.312499 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 374/815] 10.222.0.43 () {58 vars in 1149 bytes} [Tue Oct 4 18:34:05 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:34:06.319271 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-e7c20493-111f-49a3-a1e6-ea6fccf42dd6 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:06.319773 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-e7c20493-111f-49a3-a1e6-ea6fccf42dd6 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] [instance: fbe51dae-877b-4377-9f23-9a129775c317] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:06.338746 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e7c20493-111f-49a3-a1e6-ea6fccf42dd6 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:06.339516 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e7c20493-111f-49a3-a1e6-ea6fccf42dd6 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:06.340153 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e7c20493-111f-49a3-a1e6-ea6fccf42dd6 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:06.342984 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e7c20493-111f-49a3-a1e6-ea6fccf42dd6 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:06.343644 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e7c20493-111f-49a3-a1e6-ea6fccf42dd6 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:06.344253 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e7c20493-111f-49a3-a1e6-ea6fccf42dd6 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:06.355319 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:34:06.419564 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-e7c20493-111f-49a3-a1e6-ea6fccf42dd6 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] [instance: fbe51dae-877b-4377-9f23-9a129775c317] Going to try to terminate instance {{(pid=123595) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:34:06.507948 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-a371f8b6-e451-499d-9287-d90f54184b35 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7db99f361654711bea7f1b2c404d312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7adedcdb9c3485ea2738c00e25aa3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:06.522183 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-a371f8b6-e451-499d-9287-d90f54184b35 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] 10.222.0.43 "GET /compute/v2.1/servers/b2c8854b-ed0b-4727-b89b-f0633f75d9de" status: 200 len: 1317 microversion: 2.1 time: 0.501498 Oct 04 18:34:06.523070 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 442/816] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:06 2022] GET /compute/v2.1/servers/b2c8854b-ed0b-4727-b89b-f0633f75d9de => generated 1317 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:34:06.528238 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-900125a2-dc3e-4698-b816-0e13887eb8bb tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:06.536539 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-900125a2-dc3e-4698-b816-0e13887eb8bb tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] [instance: 9895c2ec-35ea-419e-9565-0c0f2fc5bbbc] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:06.565915 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-e7c20493-111f-49a3-a1e6-ea6fccf42dd6 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] 10.222.0.43 "DELETE /compute/v2.1/servers/fbe51dae-877b-4377-9f23-9a129775c317" status: 204 len: 0 microversion: 2.1 time: 0.251462 Oct 04 18:34:06.567475 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 375/817] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 18:34:06 2022] DELETE /compute/v2.1/servers/fbe51dae-877b-4377-9f23-9a129775c317 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:34:06.575209 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-bc4694f1-448b-4f17-8de8-5bae22a3864b tempest-FloatingIPsNegativeTestJSON-553706323 tempest-FloatingIPsNegativeTestJSON-553706323-project] Action: 'create', calling method: .version_select at 0x7fb21fc54160>, body: {"pool": "non_exist_pool"} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:34:06.579385 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-900125a2-dc3e-4698-b816-0e13887eb8bb tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:06.579903 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-900125a2-dc3e-4698-b816-0e13887eb8bb tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:06.580352 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-900125a2-dc3e-4698-b816-0e13887eb8bb tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:06.584872 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-900125a2-dc3e-4698-b816-0e13887eb8bb tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:06.585461 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-900125a2-dc3e-4698-b816-0e13887eb8bb tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:06.585915 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-900125a2-dc3e-4698-b816-0e13887eb8bb tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:06.631987 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-bc4694f1-448b-4f17-8de8-5bae22a3864b tempest-FloatingIPsNegativeTestJSON-553706323 tempest-FloatingIPsNegativeTestJSON-553706323-project] HTTP exception thrown: Floating IP pool not found. Oct 04 18:34:06.634090 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-bc4694f1-448b-4f17-8de8-5bae22a3864b tempest-FloatingIPsNegativeTestJSON-553706323 tempest-FloatingIPsNegativeTestJSON-553706323-project] Request method failure captured: Oct 04 18:34:06.634090 n-d-851028-13 devstack@n-api.service[123595]: request: POST /compute/v2.1/os-floating-ips HTTP/1.1 Oct 04 18:34:06.634090 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 18:34:06.634090 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 18:34:06.634090 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 18:34:06.634090 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 26 Oct 04 18:34:06.634090 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 18:34:06.634090 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 18:34:06.634090 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 18:34:06.634090 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 18:34:06.634090 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPHydYQJUddktKTC5sS0nZ4nu249QNyV-xP3zz1Zs5lM5LzT70RNs1acGL17WKwCLDUxjCLnw1ZKSQ31FsWI-l3wPw_cP1wlWLr82QTjevflWluPkGg1JChbduCVLhS8WYNQyGATddFnRl2XkH0rrvCOEXj25vcGHjyHfL4g5MiRmdoA Oct 04 18:34:06.634090 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 18:34:06.634090 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 18:34:06.634090 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 18:34:06.634090 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 18:34:06.634090 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 18:34:06.634090 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 18:34:06.634090 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: f266b358d3c74a3b90208c7a52ab7fe3 Oct 04 18:34:06.634090 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-553706323 Oct 04 18:34:06.634090 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 18:34:06.634090 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 18:34:06.635754 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/f266b358d3c74a3b90208c7a52ab7fe3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_f266b358d3c74a3b90208c7a52ab7fe3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f266b358d3c74a3b90208c7a52ab7fe3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f266b358d3c74a3b90208c7a52ab7fe3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:34:06.635754 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-553706323 Oct 04 18:34:06.635754 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: f266b358d3c74a3b90208c7a52ab7fe3 Oct 04 18:34:06.635754 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-553706323 Oct 04 18:34:06.635754 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-FloatingIPsNegativeTestJSON-553706323-project Oct 04 18:34:06.635754 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 18:34:06.635754 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 18:34:06.635754 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: 609dba539cd94772b2413f3804bc06fd Oct 04 18:34:06.635754 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-553706323-project Oct 04 18:34:06.635754 n-d-851028-13 devstack@n-api.service[123595]: Oct 04 18:34:06.635754 n-d-851028-13 devstack@n-api.service[123595]: {"pool": "non_exist_pool"} Oct 04 18:34:06.635754 n-d-851028-13 devstack@n-api.service[123595]: method: Oct 04 18:34:06.635754 n-d-851028-13 devstack@n-api.service[123595]: exception: Floating IP pool not found. Oct 04 18:34:06.635754 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'body': {'pool': 'non_exist_pool'}} Oct 04 18:34:06.635754 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:34:06.636943 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:34:06.636943 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 127, in create Oct 04 18:34:06.636943 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi address = self.network_api.allocate_floating_ip(context, pool) Oct 04 18:34:06.636943 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2972, in allocate_floating_ip Oct 04 18:34:06.636943 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi pool_id = self._get_floating_ip_pool_id_by_name_or_id(client, pool) Oct 04 18:34:06.636943 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2962, in _get_floating_ip_pool_id_by_name_or_id Oct 04 18:34:06.636943 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpPoolNotFound() Oct 04 18:34:06.636943 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpPoolNotFound: Floating IP pool not found. Oct 04 18:34:06.636943 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:34:06.636943 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:34:06.636943 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:34:06.636943 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:34:06.636943 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:34:06.636943 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:34:06.636943 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:34:06.636943 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:34:06.636943 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:34:06.636943 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:34:06.636943 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:34:06.636943 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:34:06.638512 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 142, in create Oct 04 18:34:06.638512 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:34:06.638512 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP pool not found. Oct 04 18:34:06.638512 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:34:06.638512 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:34:06.638512 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:34:06.638512 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:34:06.638512 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:34:06.638512 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:34:06.638512 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:34:06.638512 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:34:06.638512 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP pool not found. Oct 04 18:34:06.638512 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:34:06.638512 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-bc4694f1-448b-4f17-8de8-5bae22a3864b tempest-FloatingIPsNegativeTestJSON-553706323 tempest-FloatingIPsNegativeTestJSON-553706323-project] Returning 404 to user: Floating IP pool not found. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:34:06.638512 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-bc4694f1-448b-4f17-8de8-5bae22a3864b tempest-FloatingIPsNegativeTestJSON-553706323 tempest-FloatingIPsNegativeTestJSON-553706323-project] 10.222.0.43 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.066687 Oct 04 18:34:06.639628 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 376/818] 10.222.0.43 () {60 vars in 1170 bytes} [Tue Oct 4 18:34:06 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:34:06.649784 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-7c73e4df-df09-423c-a152-1a00b3d97bb8 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:06.655160 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-7c73e4df-df09-423c-a152-1a00b3d97bb8 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] [instance: 84e0414b-a39f-4bfe-bc9d-c170ceb34d15] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:06.671991 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7c73e4df-df09-423c-a152-1a00b3d97bb8 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:06.672500 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7c73e4df-df09-423c-a152-1a00b3d97bb8 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:06.672992 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7c73e4df-df09-423c-a152-1a00b3d97bb8 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:06.673839 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7c73e4df-df09-423c-a152-1a00b3d97bb8 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:06.674303 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7c73e4df-df09-423c-a152-1a00b3d97bb8 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:06.675622 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7c73e4df-df09-423c-a152-1a00b3d97bb8 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:06.932349 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-900125a2-dc3e-4698-b816-0e13887eb8bb tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:06.947419 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-900125a2-dc3e-4698-b816-0e13887eb8bb tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:06.958292 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-900125a2-dc3e-4698-b816-0e13887eb8bb tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:06.960718 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-900125a2-dc3e-4698-b816-0e13887eb8bb tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] 10.222.0.43 "GET /compute/v2.1/servers/9895c2ec-35ea-419e-9565-0c0f2fc5bbbc" status: 200 len: 1360 microversion: 2.25 time: 0.436308 Oct 04 18:34:06.965231 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 443/819] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:34:06 2022] GET /compute/v2.1/servers/9895c2ec-35ea-419e-9565-0c0f2fc5bbbc => generated 1360 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:34:06.972202 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-c6e722ec-7a72-492b-bdc2-1488d10e01b7 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Calling method '.version_select at 0x7fb21fd11d30>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:07.079143 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-c6e722ec-7a72-492b-bdc2-1488d10e01b7 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] 10.222.0.43 "GET /compute/v2.1/images/431ce5a8-e1dc-4eb2-a165-ad8ed0489d0b" status: 200 len: 1412 microversion: 2.1 time: 0.111259 Oct 04 18:34:07.082030 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 444/820] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 18:34:06 2022] GET /compute/v2.1/images/431ce5a8-e1dc-4eb2-a165-ad8ed0489d0b => generated 1412 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:07.097526 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-ea475e0b-b0e8-4b65-9b0e-2632dab2fc0d tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:07.098837 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-ea475e0b-b0e8-4b65-9b0e-2632dab2fc0d tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] [instance: fbe51dae-877b-4377-9f23-9a129775c317] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:07.109021 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ea475e0b-b0e8-4b65-9b0e-2632dab2fc0d tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:07.110188 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ea475e0b-b0e8-4b65-9b0e-2632dab2fc0d tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:07.116784 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ea475e0b-b0e8-4b65-9b0e-2632dab2fc0d tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:07.118172 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ea475e0b-b0e8-4b65-9b0e-2632dab2fc0d tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:07.119078 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ea475e0b-b0e8-4b65-9b0e-2632dab2fc0d tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:07.120286 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ea475e0b-b0e8-4b65-9b0e-2632dab2fc0d tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:07.186561 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-7c73e4df-df09-423c-a152-1a00b3d97bb8 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:07.214478 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-7c73e4df-df09-423c-a152-1a00b3d97bb8 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:07.217631 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-7c73e4df-df09-423c-a152-1a00b3d97bb8 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:07.228672 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-7c73e4df-df09-423c-a152-1a00b3d97bb8 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] 10.222.0.43 "GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15" status: 200 len: 1486 microversion: 2.91 time: 0.590718 Oct 04 18:34:07.233413 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 377/821] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:34:06 2022] GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15 => generated 1486 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:34:07.279342 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-1fb99b1a-12cf-428a-a935-5096ce57391f tempest-FloatingIPsNegativeTestJSON-553706323 tempest-FloatingIPsNegativeTestJSON-553706323-project] Calling method '.version_select at 0x7fb21fe1eaf0>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:07.388170 n-d-851028-13 devstack@n-api.service[123595]: DEBUG neutronclient.v2_0.client [None req-1fb99b1a-12cf-428a-a935-5096ce57391f tempest-FloatingIPsNegativeTestJSON-553706323 tempest-FloatingIPsNegativeTestJSON-553706323-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 1683df21-942e-4e64-bed1-ddec969b2657 could not be found", "detail": ""}} {{(pid=123595) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 18:34:07.389331 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-1fb99b1a-12cf-428a-a935-5096ce57391f tempest-FloatingIPsNegativeTestJSON-553706323 tempest-FloatingIPsNegativeTestJSON-553706323-project] HTTP exception thrown: Floating IP not found for ID 1683df21-942e-4e64-bed1-ddec969b2657 Oct 04 18:34:07.392555 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-1fb99b1a-12cf-428a-a935-5096ce57391f tempest-FloatingIPsNegativeTestJSON-553706323 tempest-FloatingIPsNegativeTestJSON-553706323-project] Request method failure captured: Oct 04 18:34:07.392555 n-d-851028-13 devstack@n-api.service[123595]: request: DELETE /compute/v2.1/os-floating-ips/1683df21-942e-4e64-bed1-ddec969b2657 HTTP/1.1 Oct 04 18:34:07.392555 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 18:34:07.392555 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 18:34:07.392555 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 18:34:07.392555 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 0 Oct 04 18:34:07.392555 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 18:34:07.392555 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 18:34:07.392555 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 18:34:07.392555 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 18:34:07.392555 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPHydYQJUddktKTC5sS0nZ4nu249QNyV-xP3zz1Zs5lM5LzT70RNs1acGL17WKwCLDUxjCLnw1ZKSQ31FsWI-l3wPw_cP1wlWLr82QTjevflWluPkGg1JChbduCVLhS8WYNQyGATddFnRl2XkH0rrvCOEXj25vcGHjyHfL4g5MiRmdoA Oct 04 18:34:07.392555 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 18:34:07.392555 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 18:34:07.392555 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 18:34:07.392555 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 18:34:07.392555 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 18:34:07.392555 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 18:34:07.392555 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: f266b358d3c74a3b90208c7a52ab7fe3 Oct 04 18:34:07.392555 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-553706323 Oct 04 18:34:07.392555 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 18:34:07.392555 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 18:34:07.394221 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/f266b358d3c74a3b90208c7a52ab7fe3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_f266b358d3c74a3b90208c7a52ab7fe3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f266b358d3c74a3b90208c7a52ab7fe3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f266b358d3c74a3b90208c7a52ab7fe3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:34:07.394221 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-553706323 Oct 04 18:34:07.394221 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: f266b358d3c74a3b90208c7a52ab7fe3 Oct 04 18:34:07.394221 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-553706323 Oct 04 18:34:07.394221 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-FloatingIPsNegativeTestJSON-553706323-project Oct 04 18:34:07.394221 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 18:34:07.394221 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 18:34:07.394221 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: 609dba539cd94772b2413f3804bc06fd Oct 04 18:34:07.394221 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-553706323-project Oct 04 18:34:07.394221 n-d-851028-13 devstack@n-api.service[123595]: method: Oct 04 18:34:07.394221 n-d-851028-13 devstack@n-api.service[123595]: exception: Floating IP not found for ID 1683df21-942e-4e64-bed1-ddec969b2657 Oct 04 18:34:07.394221 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': '1683df21-942e-4e64-bed1-ddec969b2657'} Oct 04 18:34:07.394221 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:34:07.395180 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:34:07.395180 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 04 18:34:07.395180 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 04 18:34:07.395180 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:34:07.395180 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:34:07.395180 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 04 18:34:07.395180 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 04 18:34:07.395180 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:34:07.395180 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:34:07.395180 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 18:34:07.395180 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 18:34:07.395180 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:34:07.395180 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:34:07.395180 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 18:34:07.395180 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 18:34:07.395180 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:34:07.395180 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:34:07.395180 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 18:34:07.395180 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 18:34:07.396638 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:34:07.396638 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:34:07.396638 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 18:34:07.396638 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 18:34:07.396638 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 18:34:07.396638 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 18:34:07.396638 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 1683df21-942e-4e64-bed1-ddec969b2657 could not be found Oct 04 18:34:07.396638 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9b54014a-e566-4f45-a94e-2d350dee096b'] Oct 04 18:34:07.396638 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:34:07.396638 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:34:07.396638 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:34:07.396638 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:34:07.396638 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Oct 04 18:34:07.396638 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 04 18:34:07.396638 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 04 18:34:07.396638 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 04 18:34:07.396638 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 1683df21-942e-4e64-bed1-ddec969b2657. Oct 04 18:34:07.396638 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:34:07.396638 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:34:07.396638 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:34:07.399500 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:34:07.399500 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:34:07.399500 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:34:07.399500 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:34:07.399500 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:34:07.399500 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:34:07.399500 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:34:07.399500 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:34:07.399500 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:34:07.399500 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Oct 04 18:34:07.399500 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 04 18:34:07.399500 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 1683df21-942e-4e64-bed1-ddec969b2657 Oct 04 18:34:07.399500 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:34:07.399500 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:34:07.399500 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:34:07.399500 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:34:07.399500 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:34:07.399500 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:34:07.399500 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:34:07.399500 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:34:07.401089 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 1683df21-942e-4e64-bed1-ddec969b2657 Oct 04 18:34:07.401089 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:34:07.401089 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-1fb99b1a-12cf-428a-a935-5096ce57391f tempest-FloatingIPsNegativeTestJSON-553706323 tempest-FloatingIPsNegativeTestJSON-553706323-project] Returning 404 to user: Floating IP not found for ID 1683df21-942e-4e64-bed1-ddec969b2657 {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:34:07.401089 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-1fb99b1a-12cf-428a-a935-5096ce57391f tempest-FloatingIPsNegativeTestJSON-553706323 tempest-FloatingIPsNegativeTestJSON-553706323-project] 10.222.0.43 "DELETE /compute/v2.1/os-floating-ips/1683df21-942e-4e64-bed1-ddec969b2657" status: 404 len: 111 microversion: 2.1 time: 0.145639 Oct 04 18:34:07.401089 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 378/822] 10.222.0.43 () {58 vars in 1263 bytes} [Tue Oct 4 18:34:07 2022] DELETE /compute/v2.1/os-floating-ips/1683df21-942e-4e64-bed1-ddec969b2657 => generated 111 bytes in 147 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:34:07.412276 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-4b5e8f34-4444-4f96-bdb0-944625f43fae tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:07.413138 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-4b5e8f34-4444-4f96-bdb0-944625f43fae tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] [instance: bcc13e2d-03e7-464d-abac-f5ffb7cbb509] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:07.421084 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4b5e8f34-4444-4f96-bdb0-944625f43fae tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:07.421836 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4b5e8f34-4444-4f96-bdb0-944625f43fae tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:07.422455 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4b5e8f34-4444-4f96-bdb0-944625f43fae tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:07.423696 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4b5e8f34-4444-4f96-bdb0-944625f43fae tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:07.428325 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4b5e8f34-4444-4f96-bdb0-944625f43fae tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:07.428916 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4b5e8f34-4444-4f96-bdb0-944625f43fae tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:07.620614 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-ea475e0b-b0e8-4b65-9b0e-2632dab2fc0d tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ea2088d8124b149187a1c140d3be88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82c615a05e8a4cd086f2e580529fb1d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:07.637815 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-ea475e0b-b0e8-4b65-9b0e-2632dab2fc0d tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] 10.222.0.43 "GET /compute/v2.1/servers/fbe51dae-877b-4377-9f23-9a129775c317" status: 200 len: 1714 microversion: 2.1 time: 0.554339 Oct 04 18:34:07.643945 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 445/823] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:07 2022] GET /compute/v2.1/servers/fbe51dae-877b-4377-9f23-9a129775c317 => generated 1714 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:07.650693 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-bd08b2d6-15e4-4b95-bb3b-f034408cda10 req-260d6bb5-3662-4d2f-bf21-a77233853e92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9895c2ec-35ea-419e-9565-0c0f2fc5bbbc", "name": "network-vif-plugged", "status": "completed", "tag": "d1c13a57-f549-4198-9a2d-173f2932d012"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:34:07.689497 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-bd08b2d6-15e4-4b95-bb3b-f034408cda10 req-260d6bb5-3662-4d2f-bf21-a77233853e92 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:07.691455 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-bd08b2d6-15e4-4b95-bb3b-f034408cda10 req-260d6bb5-3662-4d2f-bf21-a77233853e92 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:07.693147 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-bd08b2d6-15e4-4b95-bb3b-f034408cda10 req-260d6bb5-3662-4d2f-bf21-a77233853e92 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:07.738632 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-bd08b2d6-15e4-4b95-bb3b-f034408cda10 req-260d6bb5-3662-4d2f-bf21-a77233853e92 service nova] Creating event network-vif-plugged:d1c13a57-f549-4198-9a2d-173f2932d012 for instance 9895c2ec-35ea-419e-9565-0c0f2fc5bbbc on n-h1-851028-13 Oct 04 18:34:07.750568 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-bd08b2d6-15e4-4b95-bb3b-f034408cda10 req-260d6bb5-3662-4d2f-bf21-a77233853e92 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105193 Oct 04 18:34:07.751866 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 446/824] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:34:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:34:07.756361 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-4b5e8f34-4444-4f96-bdb0-944625f43fae tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4aec5af742842f5bb2048c8b7d60687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829069b2787a423f922fcc5b5702f167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:07.763776 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-33eae86b-eaf3-4786-86c2-5406c2652b25 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:07.768389 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-4b5e8f34-4444-4f96-bdb0-944625f43fae tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] 10.222.0.43 "GET /compute/v2.1/servers/bcc13e2d-03e7-464d-abac-f5ffb7cbb509" status: 200 len: 1319 microversion: 2.1 time: 0.371819 Oct 04 18:34:07.770337 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 379/825] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:07 2022] GET /compute/v2.1/servers/bcc13e2d-03e7-464d-abac-f5ffb7cbb509 => generated 1319 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:07.778617 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-33eae86b-eaf3-4786-86c2-5406c2652b25 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] [instance: b2c8854b-ed0b-4727-b89b-f0633f75d9de] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:07.801515 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-33eae86b-eaf3-4786-86c2-5406c2652b25 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:07.803640 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-33eae86b-eaf3-4786-86c2-5406c2652b25 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:07.804292 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-33eae86b-eaf3-4786-86c2-5406c2652b25 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:07.807161 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-33eae86b-eaf3-4786-86c2-5406c2652b25 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:07.808140 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-33eae86b-eaf3-4786-86c2-5406c2652b25 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:07.811742 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-33eae86b-eaf3-4786-86c2-5406c2652b25 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:08.080767 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-33eae86b-eaf3-4786-86c2-5406c2652b25 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7db99f361654711bea7f1b2c404d312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7adedcdb9c3485ea2738c00e25aa3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:08.096373 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-33eae86b-eaf3-4786-86c2-5406c2652b25 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] 10.222.0.43 "GET /compute/v2.1/servers/b2c8854b-ed0b-4727-b89b-f0633f75d9de" status: 200 len: 1317 microversion: 2.1 time: 0.340182 Oct 04 18:34:08.115287 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 447/826] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:07 2022] GET /compute/v2.1/servers/b2c8854b-ed0b-4727-b89b-f0633f75d9de => generated 1317 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:08.121060 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-6236066d-a07f-40f7-9edd-1ccb7505a46e tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:08.122008 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-6236066d-a07f-40f7-9edd-1ccb7505a46e tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] [instance: 9895c2ec-35ea-419e-9565-0c0f2fc5bbbc] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:08.131253 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6236066d-a07f-40f7-9edd-1ccb7505a46e tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:08.132015 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6236066d-a07f-40f7-9edd-1ccb7505a46e tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:08.132720 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6236066d-a07f-40f7-9edd-1ccb7505a46e tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:08.134430 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6236066d-a07f-40f7-9edd-1ccb7505a46e tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:08.135609 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6236066d-a07f-40f7-9edd-1ccb7505a46e tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:08.136213 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6236066d-a07f-40f7-9edd-1ccb7505a46e tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:08.142063 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:34:08.232805 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-2b18255d-d1cf-4da0-8916-8c198431743d tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Action: 'create', calling method: .version_select at 0x7fb21fc60f70>, body: {"keypair": {"name": "tempest-keypair-1832452513", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKhslQZCjfztKqR5Skx6i1HK/EhNHX2HeiI7oLwriF9eOkiVNHOhu9HuADsKv1zwJ/fMVxtr/uvtXYk7LwfriNe8ny6RVTimnHEYglV4wV8mdnM2mRb+cXch48rh7Baa9Q=="}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:34:08.253098 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-2b18255d-d1cf-4da0-8916-8c198431743d tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Getting quotas for project a1d6187bfad04cb7bc17155862ee0cdc. Resources: {'key_pairs'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:34:08.258594 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-2b18255d-d1cf-4da0-8916-8c198431743d tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Getting quotas for user 64887fff0bc7417094c4fee2f7e9aa5a and project a1d6187bfad04cb7bc17155862ee0cdc. Resources: {'key_pairs'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:34:08.309202 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-2b18255d-d1cf-4da0-8916-8c198431743d tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.317850 Oct 04 18:34:08.310166 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 380/827] 10.222.0.43 () {60 vars in 1159 bytes} [Tue Oct 4 18:34:07 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:34:08.324345 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-5cb09482-c703-48b0-99ca-a2e3d85044f1 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Calling method '.version_select at 0x7fb21fc6ab80>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:08.393436 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-6236066d-a07f-40f7-9edd-1ccb7505a46e tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:08.401139 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-5cb09482-c703-48b0-99ca-a2e3d85044f1 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] 10.222.0.43 "GET /compute/v2.1/images/431ce5a8-e1dc-4eb2-a165-ad8ed0489d0b" status: 200 len: 1412 microversion: 2.1 time: 0.089465 Oct 04 18:34:08.406475 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 381/828] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 18:34:08 2022] GET /compute/v2.1/images/431ce5a8-e1dc-4eb2-a165-ad8ed0489d0b => generated 1412 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:08.415019 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-1c7ce5e3-9ab2-4218-9118-98a16f90e683 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:08.415928 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-6236066d-a07f-40f7-9edd-1ccb7505a46e tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:08.416553 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-1c7ce5e3-9ab2-4218-9118-98a16f90e683 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] [instance: 84e0414b-a39f-4bfe-bc9d-c170ceb34d15] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:08.418810 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-6236066d-a07f-40f7-9edd-1ccb7505a46e tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:08.421657 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-6236066d-a07f-40f7-9edd-1ccb7505a46e tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] 10.222.0.43 "GET /compute/v2.1/servers/9895c2ec-35ea-419e-9565-0c0f2fc5bbbc" status: 200 len: 1360 microversion: 2.25 time: 0.304906 Oct 04 18:34:08.422865 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 448/829] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:34:08 2022] GET /compute/v2.1/servers/9895c2ec-35ea-419e-9565-0c0f2fc5bbbc => generated 1360 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:34:08.460932 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1c7ce5e3-9ab2-4218-9118-98a16f90e683 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:08.461465 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1c7ce5e3-9ab2-4218-9118-98a16f90e683 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:08.461913 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1c7ce5e3-9ab2-4218-9118-98a16f90e683 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:08.466332 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1c7ce5e3-9ab2-4218-9118-98a16f90e683 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:08.467227 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1c7ce5e3-9ab2-4218-9118-98a16f90e683 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:08.468479 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1c7ce5e3-9ab2-4218-9118-98a16f90e683 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:08.676821 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-d0e77626-d0a6-45ff-9001-c6fc28ad174b tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:08.677499 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-d0e77626-d0a6-45ff-9001-c6fc28ad174b tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] [instance: fbe51dae-877b-4377-9f23-9a129775c317] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:08.688868 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d0e77626-d0a6-45ff-9001-c6fc28ad174b tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:08.689595 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d0e77626-d0a6-45ff-9001-c6fc28ad174b tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:08.690220 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d0e77626-d0a6-45ff-9001-c6fc28ad174b tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:08.693516 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d0e77626-d0a6-45ff-9001-c6fc28ad174b tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:08.693984 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d0e77626-d0a6-45ff-9001-c6fc28ad174b tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:08.694667 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d0e77626-d0a6-45ff-9001-c6fc28ad174b tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:08.724409 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-1c7ce5e3-9ab2-4218-9118-98a16f90e683 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:08.740936 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-1c7ce5e3-9ab2-4218-9118-98a16f90e683 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:08.745216 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-1c7ce5e3-9ab2-4218-9118-98a16f90e683 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:08.765704 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-1c7ce5e3-9ab2-4218-9118-98a16f90e683 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] 10.222.0.43 "GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15" status: 200 len: 1486 microversion: 2.91 time: 0.358008 Oct 04 18:34:08.784642 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 382/830] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:34:08 2022] GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15 => generated 1486 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:34:08.798433 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-20b9633e-8242-4ec9-825a-c21196309ed5 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:08.799732 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-20b9633e-8242-4ec9-825a-c21196309ed5 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] [instance: bcc13e2d-03e7-464d-abac-f5ffb7cbb509] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:08.811132 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-20b9633e-8242-4ec9-825a-c21196309ed5 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:08.811725 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-20b9633e-8242-4ec9-825a-c21196309ed5 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:08.813725 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-20b9633e-8242-4ec9-825a-c21196309ed5 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:08.814748 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-20b9633e-8242-4ec9-825a-c21196309ed5 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:08.816132 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-20b9633e-8242-4ec9-825a-c21196309ed5 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:08.816713 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-20b9633e-8242-4ec9-825a-c21196309ed5 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:09.060842 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-d0e77626-d0a6-45ff-9001-c6fc28ad174b tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ea2088d8124b149187a1c140d3be88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82c615a05e8a4cd086f2e580529fb1d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:09.073187 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-d0e77626-d0a6-45ff-9001-c6fc28ad174b tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] 10.222.0.43 "GET /compute/v2.1/servers/fbe51dae-877b-4377-9f23-9a129775c317" status: 200 len: 1714 microversion: 2.1 time: 0.401346 Oct 04 18:34:09.075142 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 449/831] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:08 2022] GET /compute/v2.1/servers/fbe51dae-877b-4377-9f23-9a129775c317 => generated 1714 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:34:09.120471 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-0d4f3217-503e-4461-a7c7-24dfc3acb5b0 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:09.121324 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-0d4f3217-503e-4461-a7c7-24dfc3acb5b0 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] [instance: b2c8854b-ed0b-4727-b89b-f0633f75d9de] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:09.134686 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0d4f3217-503e-4461-a7c7-24dfc3acb5b0 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:09.135926 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0d4f3217-503e-4461-a7c7-24dfc3acb5b0 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:09.138254 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0d4f3217-503e-4461-a7c7-24dfc3acb5b0 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:09.139184 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0d4f3217-503e-4461-a7c7-24dfc3acb5b0 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:09.141503 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0d4f3217-503e-4461-a7c7-24dfc3acb5b0 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:09.142262 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0d4f3217-503e-4461-a7c7-24dfc3acb5b0 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:09.158033 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-20b9633e-8242-4ec9-825a-c21196309ed5 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4aec5af742842f5bb2048c8b7d60687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829069b2787a423f922fcc5b5702f167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:09.166745 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-20b9633e-8242-4ec9-825a-c21196309ed5 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] 10.222.0.43 "GET /compute/v2.1/servers/bcc13e2d-03e7-464d-abac-f5ffb7cbb509" status: 200 len: 1319 microversion: 2.1 time: 0.375851 Oct 04 18:34:09.177489 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 383/832] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:08 2022] GET /compute/v2.1/servers/bcc13e2d-03e7-464d-abac-f5ffb7cbb509 => generated 1319 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:09.419862 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-b6b90000-f2fb-49c5-a3e6-64508e69282f tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Calling method '.version_select at 0x7fb21fc4f040>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:09.522289 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-0d4f3217-503e-4461-a7c7-24dfc3acb5b0 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7db99f361654711bea7f1b2c404d312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7adedcdb9c3485ea2738c00e25aa3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:09.524730 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-b6b90000-f2fb-49c5-a3e6-64508e69282f tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] 10.222.0.43 "GET /compute/v2.1/images/431ce5a8-e1dc-4eb2-a165-ad8ed0489d0b" status: 200 len: 1412 microversion: 2.1 time: 0.112405 Oct 04 18:34:09.526365 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 384/833] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 18:34:09 2022] GET /compute/v2.1/images/431ce5a8-e1dc-4eb2-a165-ad8ed0489d0b => generated 1412 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:09.532357 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-fd025f2d-2958-4036-b161-4e634048aee5 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:09.533432 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-fd025f2d-2958-4036-b161-4e634048aee5 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] [instance: 9895c2ec-35ea-419e-9565-0c0f2fc5bbbc] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:09.535836 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-0d4f3217-503e-4461-a7c7-24dfc3acb5b0 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] 10.222.0.43 "GET /compute/v2.1/servers/b2c8854b-ed0b-4727-b89b-f0633f75d9de" status: 200 len: 1317 microversion: 2.1 time: 0.414596 Oct 04 18:34:09.536543 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 450/834] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:09 2022] GET /compute/v2.1/servers/b2c8854b-ed0b-4727-b89b-f0633f75d9de => generated 1317 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:34:09.542503 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fd025f2d-2958-4036-b161-4e634048aee5 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:09.544171 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fd025f2d-2958-4036-b161-4e634048aee5 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:09.544901 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fd025f2d-2958-4036-b161-4e634048aee5 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:09.545911 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fd025f2d-2958-4036-b161-4e634048aee5 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:09.546613 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fd025f2d-2958-4036-b161-4e634048aee5 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:09.548184 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fd025f2d-2958-4036-b161-4e634048aee5 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:09.803338 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-4efd4d5c-6886-4dac-876f-b1e83fb73fe4 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:09.803974 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-4efd4d5c-6886-4dac-876f-b1e83fb73fe4 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] [instance: 84e0414b-a39f-4bfe-bc9d-c170ceb34d15] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:09.819779 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4efd4d5c-6886-4dac-876f-b1e83fb73fe4 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:09.822585 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4efd4d5c-6886-4dac-876f-b1e83fb73fe4 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:09.823601 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4efd4d5c-6886-4dac-876f-b1e83fb73fe4 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:09.825143 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4efd4d5c-6886-4dac-876f-b1e83fb73fe4 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:09.828267 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4efd4d5c-6886-4dac-876f-b1e83fb73fe4 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:09.828875 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4efd4d5c-6886-4dac-876f-b1e83fb73fe4 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:09.873815 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-fd025f2d-2958-4036-b161-4e634048aee5 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:09.887029 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-fd025f2d-2958-4036-b161-4e634048aee5 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:09.888511 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-fd025f2d-2958-4036-b161-4e634048aee5 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:09.889707 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-fd025f2d-2958-4036-b161-4e634048aee5 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] 10.222.0.43 "GET /compute/v2.1/servers/9895c2ec-35ea-419e-9565-0c0f2fc5bbbc" status: 200 len: 1360 microversion: 2.25 time: 0.362051 Oct 04 18:34:09.890363 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 385/835] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:34:09 2022] GET /compute/v2.1/servers/9895c2ec-35ea-419e-9565-0c0f2fc5bbbc => generated 1360 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:34:09.923403 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-66119c1e-3619-46bd-8043-73c51be2cea7 req-12659835-10db-42f2-94e8-296d2bbc81d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "533db4f5-5f62-47ab-9d4c-5e5a95c0b756", "name": "network-vif-plugged", "status": "completed", "tag": "9dc10a12-f514-49cb-8d56-3dda7855de52"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:34:09.950431 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-66119c1e-3619-46bd-8043-73c51be2cea7 req-12659835-10db-42f2-94e8-296d2bbc81d4 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:09.951544 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-66119c1e-3619-46bd-8043-73c51be2cea7 req-12659835-10db-42f2-94e8-296d2bbc81d4 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:09.952000 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-66119c1e-3619-46bd-8043-73c51be2cea7 req-12659835-10db-42f2-94e8-296d2bbc81d4 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:09.979590 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-66119c1e-3619-46bd-8043-73c51be2cea7 req-12659835-10db-42f2-94e8-296d2bbc81d4 service nova] Creating event network-vif-plugged:9dc10a12-f514-49cb-8d56-3dda7855de52 for instance 533db4f5-5f62-47ab-9d4c-5e5a95c0b756 on n-h2-851028-13 Oct 04 18:34:09.993835 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-66119c1e-3619-46bd-8043-73c51be2cea7 req-12659835-10db-42f2-94e8-296d2bbc81d4 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079543 Oct 04 18:34:09.994793 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 386/836] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:34:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:34:10.012367 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-4efd4d5c-6886-4dac-876f-b1e83fb73fe4 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:10.027696 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-4efd4d5c-6886-4dac-876f-b1e83fb73fe4 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:10.033034 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-4efd4d5c-6886-4dac-876f-b1e83fb73fe4 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:10.061582 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-4efd4d5c-6886-4dac-876f-b1e83fb73fe4 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] 10.222.0.43 "GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15" status: 200 len: 1488 microversion: 2.91 time: 0.267396 Oct 04 18:34:10.064573 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 451/837] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:34:09 2022] GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15 => generated 1488 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:34:10.103094 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-b4de6159-af32-4f5e-ae80-99179475c859 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:10.105141 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-b4de6159-af32-4f5e-ae80-99179475c859 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] [instance: fbe51dae-877b-4377-9f23-9a129775c317] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:10.118623 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b4de6159-af32-4f5e-ae80-99179475c859 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:10.119125 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b4de6159-af32-4f5e-ae80-99179475c859 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:10.119556 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b4de6159-af32-4f5e-ae80-99179475c859 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:10.120284 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b4de6159-af32-4f5e-ae80-99179475c859 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:10.134798 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b4de6159-af32-4f5e-ae80-99179475c859 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:10.137240 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b4de6159-af32-4f5e-ae80-99179475c859 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:10.198761 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-b3f472a9-b2e9-4cdd-a151-a64f377af81a tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:10.201512 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-b3f472a9-b2e9-4cdd-a151-a64f377af81a tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] [instance: bcc13e2d-03e7-464d-abac-f5ffb7cbb509] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:10.229727 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b3f472a9-b2e9-4cdd-a151-a64f377af81a tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:10.236964 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b3f472a9-b2e9-4cdd-a151-a64f377af81a tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:10.237960 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b3f472a9-b2e9-4cdd-a151-a64f377af81a tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:10.239620 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b3f472a9-b2e9-4cdd-a151-a64f377af81a tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:10.244284 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b3f472a9-b2e9-4cdd-a151-a64f377af81a tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:10.251229 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b3f472a9-b2e9-4cdd-a151-a64f377af81a tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:10.713581 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-b3f472a9-b2e9-4cdd-a151-a64f377af81a tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4aec5af742842f5bb2048c8b7d60687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829069b2787a423f922fcc5b5702f167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:10.735021 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-b3f472a9-b2e9-4cdd-a151-a64f377af81a tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] 10.222.0.43 "GET /compute/v2.1/servers/bcc13e2d-03e7-464d-abac-f5ffb7cbb509" status: 200 len: 1319 microversion: 2.1 time: 0.542375 Oct 04 18:34:10.737609 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 452/838] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:10 2022] GET /compute/v2.1/servers/bcc13e2d-03e7-464d-abac-f5ffb7cbb509 => generated 1319 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:10.750548 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-cec7ca51-61b0-4f68-85bf-88c9d0c16da1 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Calling method '.version_select at 0x7fb2246bc790>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:10.891704 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-cec7ca51-61b0-4f68-85bf-88c9d0c16da1 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] 10.222.0.43 "GET /compute/v2.1/images/431ce5a8-e1dc-4eb2-a165-ad8ed0489d0b" status: 200 len: 1412 microversion: 2.1 time: 0.152298 Oct 04 18:34:10.892484 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 453/839] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 18:34:10 2022] GET /compute/v2.1/images/431ce5a8-e1dc-4eb2-a165-ad8ed0489d0b => generated 1412 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:10.923235 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-7e1472bf-2125-4f07-b73e-a5ef69c59001 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:10.923919 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-7e1472bf-2125-4f07-b73e-a5ef69c59001 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] [instance: b2c8854b-ed0b-4727-b89b-f0633f75d9de] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:10.945202 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7e1472bf-2125-4f07-b73e-a5ef69c59001 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:10.945825 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7e1472bf-2125-4f07-b73e-a5ef69c59001 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:10.946291 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7e1472bf-2125-4f07-b73e-a5ef69c59001 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:10.947046 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7e1472bf-2125-4f07-b73e-a5ef69c59001 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:10.953755 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7e1472bf-2125-4f07-b73e-a5ef69c59001 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:10.957821 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7e1472bf-2125-4f07-b73e-a5ef69c59001 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:11.416220 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-7e1472bf-2125-4f07-b73e-a5ef69c59001 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7db99f361654711bea7f1b2c404d312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7adedcdb9c3485ea2738c00e25aa3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:11.438087 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-7e1472bf-2125-4f07-b73e-a5ef69c59001 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] 10.222.0.43 "GET /compute/v2.1/servers/b2c8854b-ed0b-4727-b89b-f0633f75d9de" status: 200 len: 1317 microversion: 2.1 time: 0.535872 Oct 04 18:34:11.439416 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 454/840] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:10 2022] GET /compute/v2.1/servers/b2c8854b-ed0b-4727-b89b-f0633f75d9de => generated 1317 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:11.444814 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-22838482-0fd9-46ae-a00f-c57c0ce4e105 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:11.447876 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-22838482-0fd9-46ae-a00f-c57c0ce4e105 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] [instance: 9895c2ec-35ea-419e-9565-0c0f2fc5bbbc] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:11.464629 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-22838482-0fd9-46ae-a00f-c57c0ce4e105 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:11.465342 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-22838482-0fd9-46ae-a00f-c57c0ce4e105 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:11.465980 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-22838482-0fd9-46ae-a00f-c57c0ce4e105 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:11.466879 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-22838482-0fd9-46ae-a00f-c57c0ce4e105 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:11.467699 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-22838482-0fd9-46ae-a00f-c57c0ce4e105 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:11.468368 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-22838482-0fd9-46ae-a00f-c57c0ce4e105 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:11.801288 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-22838482-0fd9-46ae-a00f-c57c0ce4e105 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:11.809426 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-b4de6159-af32-4f5e-ae80-99179475c859 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ea2088d8124b149187a1c140d3be88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82c615a05e8a4cd086f2e580529fb1d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:11.827123 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-b4de6159-af32-4f5e-ae80-99179475c859 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] 10.222.0.43 "GET /compute/v2.1/servers/fbe51dae-877b-4377-9f23-9a129775c317" status: 200 len: 1714 microversion: 2.1 time: 1.727026 Oct 04 18:34:11.828209 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 387/841] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:10 2022] GET /compute/v2.1/servers/fbe51dae-877b-4377-9f23-9a129775c317 => generated 1714 bytes in 1733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:11.834858 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-9c5fa606-a646-4fd7-afe2-c7b94b7ce0eb tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:11.836322 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-9c5fa606-a646-4fd7-afe2-c7b94b7ce0eb tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] [instance: 84e0414b-a39f-4bfe-bc9d-c170ceb34d15] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:11.838436 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-22838482-0fd9-46ae-a00f-c57c0ce4e105 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:11.842251 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-22838482-0fd9-46ae-a00f-c57c0ce4e105 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:11.849445 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-22838482-0fd9-46ae-a00f-c57c0ce4e105 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] 10.222.0.43 "GET /compute/v2.1/servers/9895c2ec-35ea-419e-9565-0c0f2fc5bbbc" status: 200 len: 1556 microversion: 2.25 time: 0.407479 Oct 04 18:34:11.852400 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9c5fa606-a646-4fd7-afe2-c7b94b7ce0eb tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:11.852870 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 455/842] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:34:11 2022] GET /compute/v2.1/servers/9895c2ec-35ea-419e-9565-0c0f2fc5bbbc => generated 1556 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:34:11.854789 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9c5fa606-a646-4fd7-afe2-c7b94b7ce0eb tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:11.855320 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9c5fa606-a646-4fd7-afe2-c7b94b7ce0eb tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:11.858280 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9c5fa606-a646-4fd7-afe2-c7b94b7ce0eb tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:11.860589 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9c5fa606-a646-4fd7-afe2-c7b94b7ce0eb tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:11.861150 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9c5fa606-a646-4fd7-afe2-c7b94b7ce0eb tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:11.871661 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-c9ea81fd-d8a9-4ff6-8036-ded7b1a8ed94 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-21139801", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452", "networks": [{"uuid": "080c1339-0c4e-4f34-9f61-6d5bffd07a16"}], "security_groups": [{"name": "tempest-securitygroup--867099082"}], "key_name": "tempest-keypair-1832452513", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:34:12.031390 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-9c5fa606-a646-4fd7-afe2-c7b94b7ce0eb tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:12.053720 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-9c5fa606-a646-4fd7-afe2-c7b94b7ce0eb tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:12.061939 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-9c5fa606-a646-4fd7-afe2-c7b94b7ce0eb tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:12.076873 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-9c5fa606-a646-4fd7-afe2-c7b94b7ce0eb tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] 10.222.0.43 "GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15" status: 200 len: 1544 microversion: 2.91 time: 0.247342 Oct 04 18:34:12.077715 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 388/843] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:34:11 2022] GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15 => generated 1544 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:34:12.086676 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-c0faf912-b4e3-47bf-97cf-deae185b93bf tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:12.089777 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-c0faf912-b4e3-47bf-97cf-deae185b93bf tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] [instance: bcc13e2d-03e7-464d-abac-f5ffb7cbb509] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:12.108172 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c0faf912-b4e3-47bf-97cf-deae185b93bf tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:12.109393 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c0faf912-b4e3-47bf-97cf-deae185b93bf tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:12.109943 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c0faf912-b4e3-47bf-97cf-deae185b93bf tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:12.110774 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c0faf912-b4e3-47bf-97cf-deae185b93bf tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:12.111338 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c0faf912-b4e3-47bf-97cf-deae185b93bf tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:12.112428 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c0faf912-b4e3-47bf-97cf-deae185b93bf tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:12.114483 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.network.neutron [None req-c9ea81fd-d8a9-4ff6-8036-ded7b1a8ed94 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] validate_networks() for [('080c1339-0c4e-4f34-9f61-6d5bffd07a16', None, None, None, None, None)] {{(pid=123596) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:34:12.672474 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-c0faf912-b4e3-47bf-97cf-deae185b93bf tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4aec5af742842f5bb2048c8b7d60687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829069b2787a423f922fcc5b5702f167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:12.695803 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-c0faf912-b4e3-47bf-97cf-deae185b93bf tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] 10.222.0.43 "GET /compute/v2.1/servers/bcc13e2d-03e7-464d-abac-f5ffb7cbb509" status: 200 len: 1319 microversion: 2.1 time: 0.616101 Oct 04 18:34:12.718367 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 389/844] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:12 2022] GET /compute/v2.1/servers/bcc13e2d-03e7-464d-abac-f5ffb7cbb509 => generated 1319 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:12.727528 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-0d3d4429-1347-4fcc-adf3-50107f7c0a14 tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:12.731665 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-0d3d4429-1347-4fcc-adf3-50107f7c0a14 tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] [instance: 9895c2ec-35ea-419e-9565-0c0f2fc5bbbc] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:12.746471 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0d3d4429-1347-4fcc-adf3-50107f7c0a14 tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:12.748321 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0d3d4429-1347-4fcc-adf3-50107f7c0a14 tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:12.749055 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0d3d4429-1347-4fcc-adf3-50107f7c0a14 tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:12.750611 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0d3d4429-1347-4fcc-adf3-50107f7c0a14 tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:12.753377 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0d3d4429-1347-4fcc-adf3-50107f7c0a14 tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:12.764562 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0d3d4429-1347-4fcc-adf3-50107f7c0a14 tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:13.011028 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-c9ea81fd-d8a9-4ff6-8036-ded7b1a8ed94 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Flavor limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:34:13.011791 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-c9ea81fd-d8a9-4ff6-8036-ded7b1a8ed94 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Image limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:34:13.012456 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-c9ea81fd-d8a9-4ff6-8036-ded7b1a8ed94 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Flavor pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:34:13.013056 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-c9ea81fd-d8a9-4ff6-8036-ded7b1a8ed94 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Image pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:34:13.013716 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-c9ea81fd-d8a9-4ff6-8036-ded7b1a8ed94 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:34:13.026323 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c9ea81fd-d8a9-4ff6-8036-ded7b1a8ed94 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:13.030480 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c9ea81fd-d8a9-4ff6-8036-ded7b1a8ed94 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:13.034331 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c9ea81fd-d8a9-4ff6-8036-ded7b1a8ed94 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:13.038189 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c9ea81fd-d8a9-4ff6-8036-ded7b1a8ed94 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:13.038965 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c9ea81fd-d8a9-4ff6-8036-ded7b1a8ed94 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:13.039598 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c9ea81fd-d8a9-4ff6-8036-ded7b1a8ed94 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:13.080421 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-c9ea81fd-d8a9-4ff6-8036-ded7b1a8ed94 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Getting quotas for project a1d6187bfad04cb7bc17155862ee0cdc. Resources: {'ram', 'cores', 'instances'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:34:13.086376 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-c9ea81fd-d8a9-4ff6-8036-ded7b1a8ed94 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Getting quotas for user 64887fff0bc7417094c4fee2f7e9aa5a and project a1d6187bfad04cb7bc17155862ee0cdc. Resources: {'ram', 'cores', 'instances'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:34:13.100009 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-c9ea81fd-d8a9-4ff6-8036-ded7b1a8ed94 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Going to run 1 instances... {{(pid=123596) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:34:13.103444 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-c9ea81fd-d8a9-4ff6-8036-ded7b1a8ed94 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] [instance: eb05639b-cd53-4c27-9505-20e668a16acc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e8943ec5-4038-4d4b-b9b9-2415a79f5243',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123596) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:34:13.204521 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-c9ea81fd-d8a9-4ff6-8036-ded7b1a8ed94 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.348995 Oct 04 18:34:13.207206 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 456/845] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 18:34:11 2022] POST /compute/v2.1/servers => generated 405 bytes in 1353 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:34:13.219344 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-e4298e63-d79e-4537-b03f-ccd5c7224d25 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Calling method '.version_select at 0x7fb21fb92d30>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:13.628161 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.objects.instance [None req-0d3d4429-1347-4fcc-adf3-50107f7c0a14 tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] Lazy-loading 'services' on Instance uuid 9895c2ec-35ea-419e-9565-0c0f2fc5bbbc {{(pid=123595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:34:13.742546 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-0d3d4429-1347-4fcc-adf3-50107f7c0a14 tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/9895c2ec-35ea-419e-9565-0c0f2fc5bbbc" status: 200 len: 2049 microversion: 2.25 time: 1.022790 Oct 04 18:34:13.743388 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 390/846] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:34:12 2022] GET /compute/v2.1/servers/9895c2ec-35ea-419e-9565-0c0f2fc5bbbc => generated 2049 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:34:13.748210 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-c05da0ec-e7a5-455d-990a-f06a38e98e70 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:13.748767 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-c05da0ec-e7a5-455d-990a-f06a38e98e70 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] [instance: b2c8854b-ed0b-4727-b89b-f0633f75d9de] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:13.764775 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c05da0ec-e7a5-455d-990a-f06a38e98e70 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:13.765615 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c05da0ec-e7a5-455d-990a-f06a38e98e70 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:13.770169 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c05da0ec-e7a5-455d-990a-f06a38e98e70 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:13.771180 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c05da0ec-e7a5-455d-990a-f06a38e98e70 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:13.771821 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c05da0ec-e7a5-455d-990a-f06a38e98e70 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:13.772422 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c05da0ec-e7a5-455d-990a-f06a38e98e70 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:14.440972 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-c05da0ec-e7a5-455d-990a-f06a38e98e70 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7db99f361654711bea7f1b2c404d312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7adedcdb9c3485ea2738c00e25aa3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:14.451679 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-c05da0ec-e7a5-455d-990a-f06a38e98e70 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] 10.222.0.43 "GET /compute/v2.1/servers/b2c8854b-ed0b-4727-b89b-f0633f75d9de" status: 200 len: 1317 microversion: 2.1 time: 0.707162 Oct 04 18:34:14.455186 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 391/847] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:13 2022] GET /compute/v2.1/servers/b2c8854b-ed0b-4727-b89b-f0633f75d9de => generated 1317 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:14.472422 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-af159890-238d-4dd7-bf32-13cce32ae29b tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:14.479211 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-af159890-238d-4dd7-bf32-13cce32ae29b tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] [instance: fbe51dae-877b-4377-9f23-9a129775c317] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:14.500436 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-af159890-238d-4dd7-bf32-13cce32ae29b tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:14.500949 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-af159890-238d-4dd7-bf32-13cce32ae29b tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:14.503312 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-af159890-238d-4dd7-bf32-13cce32ae29b tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:14.504517 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-af159890-238d-4dd7-bf32-13cce32ae29b tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:14.510427 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-af159890-238d-4dd7-bf32-13cce32ae29b tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:14.510858 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-af159890-238d-4dd7-bf32-13cce32ae29b tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:14.740324 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-af159890-238d-4dd7-bf32-13cce32ae29b tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ea2088d8124b149187a1c140d3be88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82c615a05e8a4cd086f2e580529fb1d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:14.791814 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-af159890-238d-4dd7-bf32-13cce32ae29b tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] 10.222.0.43 "GET /compute/v2.1/servers/fbe51dae-877b-4377-9f23-9a129775c317" status: 200 len: 1647 microversion: 2.1 time: 0.333768 Oct 04 18:34:14.792447 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 392/848] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:14 2022] GET /compute/v2.1/servers/fbe51dae-877b-4377-9f23-9a129775c317 => generated 1647 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:14.833884 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-02c16c87-626c-4d88-b8fe-6965d5c61cd9 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:14.838818 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-02c16c87-626c-4d88-b8fe-6965d5c61cd9 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] [instance: 84e0414b-a39f-4bfe-bc9d-c170ceb34d15] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:14.871857 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-02c16c87-626c-4d88-b8fe-6965d5c61cd9 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:14.887233 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-02c16c87-626c-4d88-b8fe-6965d5c61cd9 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:14.888059 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-02c16c87-626c-4d88-b8fe-6965d5c61cd9 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:14.889069 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-02c16c87-626c-4d88-b8fe-6965d5c61cd9 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:14.901743 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-02c16c87-626c-4d88-b8fe-6965d5c61cd9 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:14.902497 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-02c16c87-626c-4d88-b8fe-6965d5c61cd9 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:15.236556 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-02c16c87-626c-4d88-b8fe-6965d5c61cd9 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:15.265347 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-02c16c87-626c-4d88-b8fe-6965d5c61cd9 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:15.276276 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-02c16c87-626c-4d88-b8fe-6965d5c61cd9 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:15.298491 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-02c16c87-626c-4d88-b8fe-6965d5c61cd9 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] 10.222.0.43 "GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15" status: 200 len: 1544 microversion: 2.91 time: 0.499129 Oct 04 18:34:15.299966 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 393/849] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:34:14 2022] GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15 => generated 1544 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:34:15.334492 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-8c6df491-ed6d-4b57-a787-e92151de42d0 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:15.335236 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-8c6df491-ed6d-4b57-a787-e92151de42d0 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] [instance: eb05639b-cd53-4c27-9505-20e668a16acc] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:15.352623 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8c6df491-ed6d-4b57-a787-e92151de42d0 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:15.355531 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8c6df491-ed6d-4b57-a787-e92151de42d0 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:15.358275 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8c6df491-ed6d-4b57-a787-e92151de42d0 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:15.359071 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8c6df491-ed6d-4b57-a787-e92151de42d0 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:15.360793 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8c6df491-ed6d-4b57-a787-e92151de42d0 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:15.361271 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8c6df491-ed6d-4b57-a787-e92151de42d0 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:15.554239 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-8c6df491-ed6d-4b57-a787-e92151de42d0 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64887fff0bc7417094c4fee2f7e9aa5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6187bfad04cb7bc17155862ee0cdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:15.568513 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-8c6df491-ed6d-4b57-a787-e92151de42d0 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] 10.222.0.43 "GET /compute/v2.1/servers/eb05639b-cd53-4c27-9505-20e668a16acc" status: 200 len: 1292 microversion: 2.1 time: 0.263697 Oct 04 18:34:15.569234 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 394/850] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:15 2022] GET /compute/v2.1/servers/eb05639b-cd53-4c27-9505-20e668a16acc => generated 1292 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:15.604314 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-0c2a4740-f099-47a9-b76a-f3f63d7f605e tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:15.604995 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-0c2a4740-f099-47a9-b76a-f3f63d7f605e tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] [instance: bcc13e2d-03e7-464d-abac-f5ffb7cbb509] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:15.630412 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0c2a4740-f099-47a9-b76a-f3f63d7f605e tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:15.631166 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0c2a4740-f099-47a9-b76a-f3f63d7f605e tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:15.631653 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0c2a4740-f099-47a9-b76a-f3f63d7f605e tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:15.632419 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0c2a4740-f099-47a9-b76a-f3f63d7f605e tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:15.633061 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0c2a4740-f099-47a9-b76a-f3f63d7f605e tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:15.633698 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0c2a4740-f099-47a9-b76a-f3f63d7f605e tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:15.683300 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:34:16.204146 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-0c2a4740-f099-47a9-b76a-f3f63d7f605e tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4aec5af742842f5bb2048c8b7d60687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829069b2787a423f922fcc5b5702f167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:16.243938 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-0c2a4740-f099-47a9-b76a-f3f63d7f605e tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] 10.222.0.43 "GET /compute/v2.1/servers/bcc13e2d-03e7-464d-abac-f5ffb7cbb509" status: 200 len: 1319 microversion: 2.1 time: 0.646633 Oct 04 18:34:16.247001 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 395/851] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:15 2022] GET /compute/v2.1/servers/bcc13e2d-03e7-464d-abac-f5ffb7cbb509 => generated 1319 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:16.298202 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-f874f7bf-a717-4a1f-8ca5-7608e155f9c9 tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:16.303019 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-f874f7bf-a717-4a1f-8ca5-7608e155f9c9 tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] [instance: 9895c2ec-35ea-419e-9565-0c0f2fc5bbbc] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:16.319072 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f874f7bf-a717-4a1f-8ca5-7608e155f9c9 tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:16.321062 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f874f7bf-a717-4a1f-8ca5-7608e155f9c9 tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:16.323093 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f874f7bf-a717-4a1f-8ca5-7608e155f9c9 tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:16.328155 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f874f7bf-a717-4a1f-8ca5-7608e155f9c9 tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:16.330863 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f874f7bf-a717-4a1f-8ca5-7608e155f9c9 tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:16.331382 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f874f7bf-a717-4a1f-8ca5-7608e155f9c9 tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:16.773543 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.objects.instance [None req-f874f7bf-a717-4a1f-8ca5-7608e155f9c9 tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] Lazy-loading 'services' on Instance uuid 9895c2ec-35ea-419e-9565-0c0f2fc5bbbc {{(pid=123595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:34:16.806181 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-f874f7bf-a717-4a1f-8ca5-7608e155f9c9 tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/9895c2ec-35ea-419e-9565-0c0f2fc5bbbc" status: 200 len: 2049 microversion: 2.25 time: 0.535047 Oct 04 18:34:16.836100 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 396/852] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:34:16 2022] GET /compute/v2.1/servers/9895c2ec-35ea-419e-9565-0c0f2fc5bbbc => generated 2049 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:34:16.841081 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-78819bbf-97a5-4db2-b230-6743a71b9d3b req-bafaac69-fcd2-4b53-bb2e-66db33425d03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2c8854b-ed0b-4727-b89b-f0633f75d9de", "name": "network-vif-plugged", "status": "completed", "tag": "218fd35c-7248-49e8-9f4b-8c869e0161e1"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:34:16.876441 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-78819bbf-97a5-4db2-b230-6743a71b9d3b req-bafaac69-fcd2-4b53-bb2e-66db33425d03 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:16.876933 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-78819bbf-97a5-4db2-b230-6743a71b9d3b req-bafaac69-fcd2-4b53-bb2e-66db33425d03 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:16.878105 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-78819bbf-97a5-4db2-b230-6743a71b9d3b req-bafaac69-fcd2-4b53-bb2e-66db33425d03 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:16.904759 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-78819bbf-97a5-4db2-b230-6743a71b9d3b req-bafaac69-fcd2-4b53-bb2e-66db33425d03 service nova] Creating event network-vif-plugged:218fd35c-7248-49e8-9f4b-8c869e0161e1 for instance b2c8854b-ed0b-4727-b89b-f0633f75d9de on n-h1-851028-13 Oct 04 18:34:16.917790 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-78819bbf-97a5-4db2-b230-6743a71b9d3b req-bafaac69-fcd2-4b53-bb2e-66db33425d03 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080195 Oct 04 18:34:16.919015 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 397/853] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:34:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:34:16.924361 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-97daad0b-fc61-49b6-9016-8bbe82ba4f2b req-65bb04b7-b4ad-407a-99cf-7e7a442bb9aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbe51dae-877b-4377-9f23-9a129775c317", "name": "network-vif-deleted", "tag": "af27bbcc-4fc5-451e-89df-ae9d39d63786"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:34:16.951328 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-97daad0b-fc61-49b6-9016-8bbe82ba4f2b req-65bb04b7-b4ad-407a-99cf-7e7a442bb9aa service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:16.958329 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-97daad0b-fc61-49b6-9016-8bbe82ba4f2b req-65bb04b7-b4ad-407a-99cf-7e7a442bb9aa service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:16.959110 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-97daad0b-fc61-49b6-9016-8bbe82ba4f2b req-65bb04b7-b4ad-407a-99cf-7e7a442bb9aa service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:16.997191 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-97daad0b-fc61-49b6-9016-8bbe82ba4f2b req-65bb04b7-b4ad-407a-99cf-7e7a442bb9aa service nova] Creating event network-vif-deleted:af27bbcc-4fc5-451e-89df-ae9d39d63786 for instance fbe51dae-877b-4377-9f23-9a129775c317 on n-h2-851028-13 Oct 04 18:34:17.009463 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-97daad0b-fc61-49b6-9016-8bbe82ba4f2b req-65bb04b7-b4ad-407a-99cf-7e7a442bb9aa service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087752 Oct 04 18:34:17.012582 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 398/854] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:34:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:34:17.025390 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-7c49bc76-0786-4597-9850-01fe831801e1 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:17.026818 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-7c49bc76-0786-4597-9850-01fe831801e1 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] [instance: b2c8854b-ed0b-4727-b89b-f0633f75d9de] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:17.038757 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7c49bc76-0786-4597-9850-01fe831801e1 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:17.039899 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7c49bc76-0786-4597-9850-01fe831801e1 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:17.040609 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7c49bc76-0786-4597-9850-01fe831801e1 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:17.041726 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7c49bc76-0786-4597-9850-01fe831801e1 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:17.042406 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7c49bc76-0786-4597-9850-01fe831801e1 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:17.043031 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7c49bc76-0786-4597-9850-01fe831801e1 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:17.608004 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-7c49bc76-0786-4597-9850-01fe831801e1 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7db99f361654711bea7f1b2c404d312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7adedcdb9c3485ea2738c00e25aa3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:17.622888 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-7c49bc76-0786-4597-9850-01fe831801e1 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] 10.222.0.43 "GET /compute/v2.1/servers/b2c8854b-ed0b-4727-b89b-f0633f75d9de" status: 200 len: 1317 microversion: 2.1 time: 0.608400 Oct 04 18:34:17.624059 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 399/855] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:17 2022] GET /compute/v2.1/servers/b2c8854b-ed0b-4727-b89b-f0633f75d9de => generated 1317 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:17.630242 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-66f2ec9c-5ad3-451e-9946-5a7a2abf9c8a tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:17.630871 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-66f2ec9c-5ad3-451e-9946-5a7a2abf9c8a tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] [instance: fbe51dae-877b-4377-9f23-9a129775c317] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:17.639107 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-66f2ec9c-5ad3-451e-9946-5a7a2abf9c8a tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:17.639683 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-66f2ec9c-5ad3-451e-9946-5a7a2abf9c8a tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:17.640131 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-66f2ec9c-5ad3-451e-9946-5a7a2abf9c8a tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:17.640928 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-66f2ec9c-5ad3-451e-9946-5a7a2abf9c8a tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:17.641627 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-66f2ec9c-5ad3-451e-9946-5a7a2abf9c8a tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:17.642338 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-66f2ec9c-5ad3-451e-9946-5a7a2abf9c8a tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:17.701203 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:34:17.704525 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-66f2ec9c-5ad3-451e-9946-5a7a2abf9c8a tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:17.705723 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-66f2ec9c-5ad3-451e-9946-5a7a2abf9c8a tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:17.706557 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-66f2ec9c-5ad3-451e-9946-5a7a2abf9c8a tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:17.707389 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.objects.instance [None req-66f2ec9c-5ad3-451e-9946-5a7a2abf9c8a tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Lazy-loading 'fault' on Instance uuid fbe51dae-877b-4377-9f23-9a129775c317 {{(pid=123595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:34:17.896844 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-66f2ec9c-5ad3-451e-9946-5a7a2abf9c8a tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ea2088d8124b149187a1c140d3be88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82c615a05e8a4cd086f2e580529fb1d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:17.937692 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-66f2ec9c-5ad3-451e-9946-5a7a2abf9c8a tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] 10.222.0.43 "GET /compute/v2.1/servers/fbe51dae-877b-4377-9f23-9a129775c317" status: 200 len: 1355 microversion: 2.1 time: 0.311963 Oct 04 18:34:17.941729 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 400/856] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:17 2022] GET /compute/v2.1/servers/fbe51dae-877b-4377-9f23-9a129775c317 => generated 1355 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:17.951073 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-ff858a76-bacb-47f1-aba5-82b0e06c5f0c tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:17.951705 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-ff858a76-bacb-47f1-aba5-82b0e06c5f0c tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] [instance: 84e0414b-a39f-4bfe-bc9d-c170ceb34d15] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:17.973649 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ff858a76-bacb-47f1-aba5-82b0e06c5f0c tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:17.974445 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ff858a76-bacb-47f1-aba5-82b0e06c5f0c tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:17.975055 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ff858a76-bacb-47f1-aba5-82b0e06c5f0c tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:17.975944 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ff858a76-bacb-47f1-aba5-82b0e06c5f0c tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:17.976579 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ff858a76-bacb-47f1-aba5-82b0e06c5f0c tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:17.977310 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ff858a76-bacb-47f1-aba5-82b0e06c5f0c tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:18.227397 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-ff858a76-bacb-47f1-aba5-82b0e06c5f0c tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:18.240376 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-ff858a76-bacb-47f1-aba5-82b0e06c5f0c tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:18.241930 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-ff858a76-bacb-47f1-aba5-82b0e06c5f0c tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:18.261572 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-ff858a76-bacb-47f1-aba5-82b0e06c5f0c tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] 10.222.0.43 "GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15" status: 200 len: 1544 microversion: 2.91 time: 0.316533 Oct 04 18:34:18.293544 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 401/857] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:34:17 2022] GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15 => generated 1544 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:34:18.298599 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-5238bc20-ebd5-4396-9c30-a2052f2dca55 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:18.310434 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-5238bc20-ebd5-4396-9c30-a2052f2dca55 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] [instance: eb05639b-cd53-4c27-9505-20e668a16acc] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:18.332458 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=4 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:34:18.334147 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5238bc20-ebd5-4396-9c30-a2052f2dca55 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:18.334649 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5238bc20-ebd5-4396-9c30-a2052f2dca55 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:18.335096 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5238bc20-ebd5-4396-9c30-a2052f2dca55 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:18.335819 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5238bc20-ebd5-4396-9c30-a2052f2dca55 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:18.336276 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5238bc20-ebd5-4396-9c30-a2052f2dca55 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:18.336706 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5238bc20-ebd5-4396-9c30-a2052f2dca55 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:18.553036 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-5238bc20-ebd5-4396-9c30-a2052f2dca55 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64887fff0bc7417094c4fee2f7e9aa5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6187bfad04cb7bc17155862ee0cdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:18.572769 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-5238bc20-ebd5-4396-9c30-a2052f2dca55 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] 10.222.0.43 "GET /compute/v2.1/servers/eb05639b-cd53-4c27-9505-20e668a16acc" status: 200 len: 1298 microversion: 2.1 time: 0.277925 Oct 04 18:34:18.582682 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 402/858] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:18 2022] GET /compute/v2.1/servers/eb05639b-cd53-4c27-9505-20e668a16acc => generated 1298 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:18.627487 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-c117f582-2adb-46f2-8d0b-8dc073fda922 tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:18.644557 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c117f582-2adb-46f2-8d0b-8dc073fda922 tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:18.646777 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c117f582-2adb-46f2-8d0b-8dc073fda922 tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:18.651306 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c117f582-2adb-46f2-8d0b-8dc073fda922 tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:18.652450 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c117f582-2adb-46f2-8d0b-8dc073fda922 tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:18.655175 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c117f582-2adb-46f2-8d0b-8dc073fda922 tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:18.657422 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c117f582-2adb-46f2-8d0b-8dc073fda922 tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:18.731367 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-c117f582-2adb-46f2-8d0b-8dc073fda922 tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] 10.222.0.43 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.093401 Oct 04 18:34:18.732347 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 403/859] 10.222.0.43 () {60 vars in 1217 bytes} [Tue Oct 4 18:34:18 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:34:18.767063 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-8162e7a9-7e77-4811-b260-57fea4d26799 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:18.770645 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-8162e7a9-7e77-4811-b260-57fea4d26799 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] [instance: bcc13e2d-03e7-464d-abac-f5ffb7cbb509] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:18.788842 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8162e7a9-7e77-4811-b260-57fea4d26799 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:18.793405 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8162e7a9-7e77-4811-b260-57fea4d26799 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:18.794055 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8162e7a9-7e77-4811-b260-57fea4d26799 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:18.794962 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8162e7a9-7e77-4811-b260-57fea4d26799 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:18.795879 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8162e7a9-7e77-4811-b260-57fea4d26799 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:18.798119 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8162e7a9-7e77-4811-b260-57fea4d26799 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:19.506818 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-8162e7a9-7e77-4811-b260-57fea4d26799 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4aec5af742842f5bb2048c8b7d60687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829069b2787a423f922fcc5b5702f167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:19.520843 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-8162e7a9-7e77-4811-b260-57fea4d26799 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] 10.222.0.43 "GET /compute/v2.1/servers/bcc13e2d-03e7-464d-abac-f5ffb7cbb509" status: 200 len: 1319 microversion: 2.1 time: 0.785187 Oct 04 18:34:19.521947 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 404/860] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:18 2022] GET /compute/v2.1/servers/bcc13e2d-03e7-464d-abac-f5ffb7cbb509 => generated 1319 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:19.542612 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-2217e1ea-efd9-4bc5-85ab-0ac4ef329fb2 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:19.543309 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-2217e1ea-efd9-4bc5-85ab-0ac4ef329fb2 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] [instance: b2c8854b-ed0b-4727-b89b-f0633f75d9de] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:19.559120 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2217e1ea-efd9-4bc5-85ab-0ac4ef329fb2 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:19.559626 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2217e1ea-efd9-4bc5-85ab-0ac4ef329fb2 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:19.560071 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2217e1ea-efd9-4bc5-85ab-0ac4ef329fb2 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:19.560796 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2217e1ea-efd9-4bc5-85ab-0ac4ef329fb2 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:19.561283 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2217e1ea-efd9-4bc5-85ab-0ac4ef329fb2 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:19.561718 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2217e1ea-efd9-4bc5-85ab-0ac4ef329fb2 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:19.846253 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-2217e1ea-efd9-4bc5-85ab-0ac4ef329fb2 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7db99f361654711bea7f1b2c404d312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7adedcdb9c3485ea2738c00e25aa3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:19.859960 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-2217e1ea-efd9-4bc5-85ab-0ac4ef329fb2 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] 10.222.0.43 "GET /compute/v2.1/servers/b2c8854b-ed0b-4727-b89b-f0633f75d9de" status: 200 len: 1467 microversion: 2.1 time: 0.336872 Oct 04 18:34:19.878238 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 405/861] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:19 2022] GET /compute/v2.1/servers/b2c8854b-ed0b-4727-b89b-f0633f75d9de => generated 1467 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:19.904676 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-8646669c-27c3-48cb-8bee-7a415cbba0ca tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:34:19.905760 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-8646669c-27c3-48cb-8bee-7a415cbba0ca tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] [instance: 9895c2ec-35ea-419e-9565-0c0f2fc5bbbc] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:19.960059 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8646669c-27c3-48cb-8bee-7a415cbba0ca tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:19.964152 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8646669c-27c3-48cb-8bee-7a415cbba0ca tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:19.967775 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8646669c-27c3-48cb-8bee-7a415cbba0ca tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:19.985644 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8646669c-27c3-48cb-8bee-7a415cbba0ca tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:19.986340 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8646669c-27c3-48cb-8bee-7a415cbba0ca tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:19.987109 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8646669c-27c3-48cb-8bee-7a415cbba0ca tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:20.105676 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-8646669c-27c3-48cb-8bee-7a415cbba0ca tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] 10.222.0.43 "POST /compute/v2.1/servers/9895c2ec-35ea-419e-9565-0c0f2fc5bbbc/action" status: 202 len: 0 microversion: 2.25 time: 0.225845 Oct 04 18:34:20.110522 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 406/862] 10.222.0.43 () {62 vars in 1319 bytes} [Tue Oct 4 18:34:19 2022] POST /compute/v2.1/servers/9895c2ec-35ea-419e-9565-0c0f2fc5bbbc/action => generated 0 bytes in 231 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:34:20.125253 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-45ae3165-34ec-4277-9f5d-e528059bdca6 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:20.126164 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-45ae3165-34ec-4277-9f5d-e528059bdca6 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] [instance: fbe51dae-877b-4377-9f23-9a129775c317] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:20.139453 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-45ae3165-34ec-4277-9f5d-e528059bdca6 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:20.139960 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-45ae3165-34ec-4277-9f5d-e528059bdca6 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:20.140407 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-45ae3165-34ec-4277-9f5d-e528059bdca6 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:20.146055 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-45ae3165-34ec-4277-9f5d-e528059bdca6 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:20.146577 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-45ae3165-34ec-4277-9f5d-e528059bdca6 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:20.146999 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-45ae3165-34ec-4277-9f5d-e528059bdca6 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:20.235441 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-45ae3165-34ec-4277-9f5d-e528059bdca6 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:20.237152 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-45ae3165-34ec-4277-9f5d-e528059bdca6 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:20.237618 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-45ae3165-34ec-4277-9f5d-e528059bdca6 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:20.238109 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.objects.instance [None req-45ae3165-34ec-4277-9f5d-e528059bdca6 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Lazy-loading 'fault' on Instance uuid fbe51dae-877b-4377-9f23-9a129775c317 {{(pid=123595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:34:20.438619 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-45ae3165-34ec-4277-9f5d-e528059bdca6 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ea2088d8124b149187a1c140d3be88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82c615a05e8a4cd086f2e580529fb1d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:20.447100 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-45ae3165-34ec-4277-9f5d-e528059bdca6 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] 10.222.0.43 "GET /compute/v2.1/servers/fbe51dae-877b-4377-9f23-9a129775c317" status: 200 len: 1355 microversion: 2.1 time: 0.332718 Oct 04 18:34:20.458759 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 407/863] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:20 2022] GET /compute/v2.1/servers/fbe51dae-877b-4377-9f23-9a129775c317 => generated 1355 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:20.468779 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-61446714-fbfb-45ed-a1fc-331e88ba2134 req-d9c35fd1-1c56-4392-b962-680b7bb50065 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bcc13e2d-03e7-464d-abac-f5ffb7cbb509", "name": "network-vif-plugged", "status": "completed", "tag": "245a7e0d-101b-4e22-8ab0-1570a93277ef"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:34:20.479367 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-61446714-fbfb-45ed-a1fc-331e88ba2134 req-d9c35fd1-1c56-4392-b962-680b7bb50065 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:20.480260 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-61446714-fbfb-45ed-a1fc-331e88ba2134 req-d9c35fd1-1c56-4392-b962-680b7bb50065 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:20.480927 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-61446714-fbfb-45ed-a1fc-331e88ba2134 req-d9c35fd1-1c56-4392-b962-680b7bb50065 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:20.508964 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-61446714-fbfb-45ed-a1fc-331e88ba2134 req-d9c35fd1-1c56-4392-b962-680b7bb50065 service nova] Creating event network-vif-plugged:245a7e0d-101b-4e22-8ab0-1570a93277ef for instance bcc13e2d-03e7-464d-abac-f5ffb7cbb509 on n-h2-851028-13 Oct 04 18:34:20.528189 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-61446714-fbfb-45ed-a1fc-331e88ba2134 req-d9c35fd1-1c56-4392-b962-680b7bb50065 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067691 Oct 04 18:34:20.530551 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 408/864] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:34:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:34:20.546313 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-e978ba77-1c23-4976-8659-56cddd315829 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:20.555731 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-e978ba77-1c23-4976-8659-56cddd315829 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] [instance: 84e0414b-a39f-4bfe-bc9d-c170ceb34d15] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:20.562947 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e978ba77-1c23-4976-8659-56cddd315829 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:20.564838 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e978ba77-1c23-4976-8659-56cddd315829 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:20.565718 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e978ba77-1c23-4976-8659-56cddd315829 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:20.567822 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e978ba77-1c23-4976-8659-56cddd315829 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:20.569564 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e978ba77-1c23-4976-8659-56cddd315829 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:20.571559 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e978ba77-1c23-4976-8659-56cddd315829 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:20.691616 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-e978ba77-1c23-4976-8659-56cddd315829 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:20.712510 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-e978ba77-1c23-4976-8659-56cddd315829 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:20.741028 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-e978ba77-1c23-4976-8659-56cddd315829 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:20.750019 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-e978ba77-1c23-4976-8659-56cddd315829 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] 10.222.0.43 "GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15" status: 200 len: 1544 microversion: 2.91 time: 0.217776 Oct 04 18:34:20.759284 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 409/865] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:34:20 2022] GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15 => generated 1544 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:34:20.767160 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-5c780407-ecda-45f0-a06f-6fc6f2dbbbcf tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:20.768276 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-5c780407-ecda-45f0-a06f-6fc6f2dbbbcf tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] [instance: eb05639b-cd53-4c27-9505-20e668a16acc] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:20.804698 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5c780407-ecda-45f0-a06f-6fc6f2dbbbcf tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:20.807211 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5c780407-ecda-45f0-a06f-6fc6f2dbbbcf tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:20.810194 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5c780407-ecda-45f0-a06f-6fc6f2dbbbcf tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:20.811365 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5c780407-ecda-45f0-a06f-6fc6f2dbbbcf tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:20.813772 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5c780407-ecda-45f0-a06f-6fc6f2dbbbcf tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:20.814435 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5c780407-ecda-45f0-a06f-6fc6f2dbbbcf tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:21.475727 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-5c780407-ecda-45f0-a06f-6fc6f2dbbbcf tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64887fff0bc7417094c4fee2f7e9aa5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6187bfad04cb7bc17155862ee0cdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:21.491976 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-5c780407-ecda-45f0-a06f-6fc6f2dbbbcf tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] 10.222.0.43 "GET /compute/v2.1/servers/eb05639b-cd53-4c27-9505-20e668a16acc" status: 200 len: 1298 microversion: 2.1 time: 0.728869 Oct 04 18:34:21.510550 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 410/866] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:20 2022] GET /compute/v2.1/servers/eb05639b-cd53-4c27-9505-20e668a16acc => generated 1298 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:21.523061 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-fde612a6-7a2d-4407-8e87-016fb2214cc8 tempest-ServersOnMultiNodesTest-1245420526 tempest-ServersOnMultiNodesTest-1245420526-project-admin] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:21.523703 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-fde612a6-7a2d-4407-8e87-016fb2214cc8 tempest-ServersOnMultiNodesTest-1245420526 tempest-ServersOnMultiNodesTest-1245420526-project-admin] [instance: b2c8854b-ed0b-4727-b89b-f0633f75d9de] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:21.535375 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fde612a6-7a2d-4407-8e87-016fb2214cc8 tempest-ServersOnMultiNodesTest-1245420526 tempest-ServersOnMultiNodesTest-1245420526-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:21.544812 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fde612a6-7a2d-4407-8e87-016fb2214cc8 tempest-ServersOnMultiNodesTest-1245420526 tempest-ServersOnMultiNodesTest-1245420526-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:21.544812 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fde612a6-7a2d-4407-8e87-016fb2214cc8 tempest-ServersOnMultiNodesTest-1245420526 tempest-ServersOnMultiNodesTest-1245420526-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:21.544812 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fde612a6-7a2d-4407-8e87-016fb2214cc8 tempest-ServersOnMultiNodesTest-1245420526 tempest-ServersOnMultiNodesTest-1245420526-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:21.544812 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fde612a6-7a2d-4407-8e87-016fb2214cc8 tempest-ServersOnMultiNodesTest-1245420526 tempest-ServersOnMultiNodesTest-1245420526-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:21.545514 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fde612a6-7a2d-4407-8e87-016fb2214cc8 tempest-ServersOnMultiNodesTest-1245420526 tempest-ServersOnMultiNodesTest-1245420526-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:21.853089 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-fde612a6-7a2d-4407-8e87-016fb2214cc8 tempest-ServersOnMultiNodesTest-1245420526 tempest-ServersOnMultiNodesTest-1245420526-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/b2c8854b-ed0b-4727-b89b-f0633f75d9de" status: 200 len: 1620 microversion: 2.1 time: 0.340468 Oct 04 18:34:21.869140 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 411/867] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:21 2022] GET /compute/v2.1/servers/b2c8854b-ed0b-4727-b89b-f0633f75d9de => generated 1620 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:21.871445 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-76b42207-e4ab-46c7-a640-aad94f3f2772 tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:21.872333 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-76b42207-e4ab-46c7-a640-aad94f3f2772 tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] [instance: 9895c2ec-35ea-419e-9565-0c0f2fc5bbbc] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:21.890398 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-76b42207-e4ab-46c7-a640-aad94f3f2772 tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:21.891014 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-76b42207-e4ab-46c7-a640-aad94f3f2772 tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:21.891462 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-76b42207-e4ab-46c7-a640-aad94f3f2772 tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:21.892261 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-76b42207-e4ab-46c7-a640-aad94f3f2772 tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:21.893381 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-76b42207-e4ab-46c7-a640-aad94f3f2772 tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:21.893819 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-76b42207-e4ab-46c7-a640-aad94f3f2772 tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:22.243647 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:34:22.248626 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.objects.instance [None req-76b42207-e4ab-46c7-a640-aad94f3f2772 tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] Lazy-loading 'services' on Instance uuid 9895c2ec-35ea-419e-9565-0c0f2fc5bbbc {{(pid=123595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:34:22.281439 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-76b42207-e4ab-46c7-a640-aad94f3f2772 tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/9895c2ec-35ea-419e-9565-0c0f2fc5bbbc" status: 200 len: 2034 microversion: 2.25 time: 0.423809 Oct 04 18:34:22.297946 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 412/868] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:34:21 2022] GET /compute/v2.1/servers/9895c2ec-35ea-419e-9565-0c0f2fc5bbbc => generated 2034 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:34:22.308440 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-82e2b2ae-2e33-4780-a578-da603f963f82 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:22.308997 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-82e2b2ae-2e33-4780-a578-da603f963f82 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] [instance: bcc13e2d-03e7-464d-abac-f5ffb7cbb509] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:22.318525 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-82e2b2ae-2e33-4780-a578-da603f963f82 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:22.319079 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-82e2b2ae-2e33-4780-a578-da603f963f82 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:22.319202 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-82e2b2ae-2e33-4780-a578-da603f963f82 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:22.319941 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-82e2b2ae-2e33-4780-a578-da603f963f82 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:22.320451 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-82e2b2ae-2e33-4780-a578-da603f963f82 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:22.320776 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-82e2b2ae-2e33-4780-a578-da603f963f82 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:22.547151 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-82e2b2ae-2e33-4780-a578-da603f963f82 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4aec5af742842f5bb2048c8b7d60687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829069b2787a423f922fcc5b5702f167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:22.555385 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-82e2b2ae-2e33-4780-a578-da603f963f82 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] 10.222.0.43 "GET /compute/v2.1/servers/bcc13e2d-03e7-464d-abac-f5ffb7cbb509" status: 200 len: 1319 microversion: 2.1 time: 0.255504 Oct 04 18:34:22.556205 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 413/869] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:22 2022] GET /compute/v2.1/servers/bcc13e2d-03e7-464d-abac-f5ffb7cbb509 => generated 1319 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:22.573183 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-1050a810-9e88-4aad-9b03-0b7a5ad54387 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:22.581900 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-1050a810-9e88-4aad-9b03-0b7a5ad54387 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] [instance: fbe51dae-877b-4377-9f23-9a129775c317] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:22.588366 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1050a810-9e88-4aad-9b03-0b7a5ad54387 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:22.588938 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1050a810-9e88-4aad-9b03-0b7a5ad54387 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:22.589493 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1050a810-9e88-4aad-9b03-0b7a5ad54387 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:22.590286 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1050a810-9e88-4aad-9b03-0b7a5ad54387 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:22.590821 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1050a810-9e88-4aad-9b03-0b7a5ad54387 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:22.591328 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1050a810-9e88-4aad-9b03-0b7a5ad54387 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:22.606788 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-1050a810-9e88-4aad-9b03-0b7a5ad54387 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] HTTP exception thrown: Instance fbe51dae-877b-4377-9f23-9a129775c317 could not be found. Oct 04 18:34:22.608719 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-1050a810-9e88-4aad-9b03-0b7a5ad54387 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Request method failure captured: Oct 04 18:34:22.608719 n-d-851028-13 devstack@n-api.service[123595]: request: GET /compute/v2.1/servers/fbe51dae-877b-4377-9f23-9a129775c317 HTTP/1.1 Oct 04 18:34:22.608719 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 18:34:22.608719 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 18:34:22.608719 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 18:34:22.608719 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 0 Oct 04 18:34:22.608719 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 18:34:22.608719 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 18:34:22.608719 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 18:34:22.608719 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 18:34:22.608719 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPHv2QQ3jzxK9bNushSTjp6y8Xo_it4ckq6ryRr5sK1e_bJBDmtF5jD03bM5zBSKI8NSKKQpHL-7xQlPXmN7q0fPNd57nBsnZXwjWsBIHh2WvlKt97iHPsqXESK9N4v7QO3iJ_YD2Lzbp5kqM8RoMW4mG2F8iwe8qrJahQt83Rp6TVCw Oct 04 18:34:22.608719 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 18:34:22.608719 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 18:34:22.608719 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 18:34:22.608719 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 18:34:22.608719 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 18:34:22.608719 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 18:34:22.608719 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: 82c615a05e8a4cd086f2e580529fb1d4 Oct 04 18:34:22.608719 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-956674611 Oct 04 18:34:22.608719 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 18:34:22.608719 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 18:34:22.610598 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/82c615a05e8a4cd086f2e580529fb1d4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_82c615a05e8a4cd086f2e580529fb1d4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/82c615a05e8a4cd086f2e580529fb1d4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/82c615a05e8a4cd086f2e580529fb1d4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:34:22.610598 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-956674611 Oct 04 18:34:22.610598 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: 82c615a05e8a4cd086f2e580529fb1d4 Oct 04 18:34:22.610598 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-956674611 Oct 04 18:34:22.610598 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-ServersWithSpecificFlavorTestJSON-956674611-project Oct 04 18:34:22.610598 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 18:34:22.610598 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 18:34:22.610598 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: f8ea2088d8124b149187a1c140d3be88 Oct 04 18:34:22.610598 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-956674611-project Oct 04 18:34:22.610598 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 18:34:22.610598 n-d-851028-13 devstack@n-api.service[123595]: exception: Instance fbe51dae-877b-4377-9f23-9a129775c317 could not be found. Oct 04 18:34:22.610598 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': 'fbe51dae-877b-4377-9f23-9a129775c317'} Oct 04 18:34:22.611573 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:34:22.611573 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:34:22.611573 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:34:22.611573 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:34:22.611573 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:34:22.611573 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:34:22.611573 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:34:22.611573 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:34:22.611573 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:34:22.611573 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:34:22.611573 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fbe51dae-877b-4377-9f23-9a129775c317 could not be found. Oct 04 18:34:22.611573 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:34:22.611573 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:34:22.611573 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:34:22.611573 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:34:22.611573 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:34:22.611573 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:34:22.611573 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:34:22.611573 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:34:22.611573 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:34:22.613679 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:34:22.613679 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:34:22.613679 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:34:22.613679 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:34:22.613679 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:34:22.613679 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:34:22.613679 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:34:22.613679 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fbe51dae-877b-4377-9f23-9a129775c317 could not be found. Oct 04 18:34:22.613679 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:34:22.613679 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:34:22.613679 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:34:22.613679 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:34:22.613679 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:34:22.613679 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:34:22.613679 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:34:22.613679 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:34:22.613679 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fbe51dae-877b-4377-9f23-9a129775c317 could not be found. Oct 04 18:34:22.613679 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:34:22.614947 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-1050a810-9e88-4aad-9b03-0b7a5ad54387 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Returning 404 to user: Instance fbe51dae-877b-4377-9f23-9a129775c317 could not be found. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:34:22.614947 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-1050a810-9e88-4aad-9b03-0b7a5ad54387 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] 10.222.0.43 "GET /compute/v2.1/servers/fbe51dae-877b-4377-9f23-9a129775c317" status: 404 len: 111 microversion: 2.1 time: 0.054501 Oct 04 18:34:22.614947 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 414/870] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:22 2022] GET /compute/v2.1/servers/fbe51dae-877b-4377-9f23-9a129775c317 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:34:22.618733 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-5c45f191-53e0-4171-b029-1d70ef6c8d81 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:22.619358 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-5c45f191-53e0-4171-b029-1d70ef6c8d81 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] [instance: 84e0414b-a39f-4bfe-bc9d-c170ceb34d15] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:22.628915 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5c45f191-53e0-4171-b029-1d70ef6c8d81 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:22.628915 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5c45f191-53e0-4171-b029-1d70ef6c8d81 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:22.628915 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5c45f191-53e0-4171-b029-1d70ef6c8d81 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:22.628915 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5c45f191-53e0-4171-b029-1d70ef6c8d81 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:22.629517 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5c45f191-53e0-4171-b029-1d70ef6c8d81 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:22.629517 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5c45f191-53e0-4171-b029-1d70ef6c8d81 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:22.732976 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-5c45f191-53e0-4171-b029-1d70ef6c8d81 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:22.742034 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-5c45f191-53e0-4171-b029-1d70ef6c8d81 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:22.743486 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-5c45f191-53e0-4171-b029-1d70ef6c8d81 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:22.758801 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-5c45f191-53e0-4171-b029-1d70ef6c8d81 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] 10.222.0.43 "GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15" status: 200 len: 1544 microversion: 2.91 time: 0.144009 Oct 04 18:34:22.776475 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 415/871] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:34:22 2022] GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15 => generated 1544 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:34:22.964724 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-0d03f2dc-0597-451b-95ce-372e33f004bc tempest-AbsoluteLimitsNegativeTestJSON-10007641 tempest-AbsoluteLimitsNegativeTestJSON-10007641-project] Calling method '.version_select at 0x7fb21fc6ce50>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:22.981132 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0d03f2dc-0597-451b-95ce-372e33f004bc tempest-AbsoluteLimitsNegativeTestJSON-10007641 tempest-AbsoluteLimitsNegativeTestJSON-10007641-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:22.982093 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0d03f2dc-0597-451b-95ce-372e33f004bc tempest-AbsoluteLimitsNegativeTestJSON-10007641 tempest-AbsoluteLimitsNegativeTestJSON-10007641-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:22.982758 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0d03f2dc-0597-451b-95ce-372e33f004bc tempest-AbsoluteLimitsNegativeTestJSON-10007641 tempest-AbsoluteLimitsNegativeTestJSON-10007641-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:22.984089 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0d03f2dc-0597-451b-95ce-372e33f004bc tempest-AbsoluteLimitsNegativeTestJSON-10007641 tempest-AbsoluteLimitsNegativeTestJSON-10007641-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:22.984641 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0d03f2dc-0597-451b-95ce-372e33f004bc tempest-AbsoluteLimitsNegativeTestJSON-10007641 tempest-AbsoluteLimitsNegativeTestJSON-10007641-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:22.985171 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0d03f2dc-0597-451b-95ce-372e33f004bc tempest-AbsoluteLimitsNegativeTestJSON-10007641 tempest-AbsoluteLimitsNegativeTestJSON-10007641-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:23.010378 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-0d03f2dc-0597-451b-95ce-372e33f004bc tempest-AbsoluteLimitsNegativeTestJSON-10007641 tempest-AbsoluteLimitsNegativeTestJSON-10007641-project] 10.222.0.43 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.228880 Oct 04 18:34:23.012307 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 416/872] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Oct 4 18:34:22 2022] GET /compute/v2.1/limits => generated 511 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:34:23.021162 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-840f524a-0968-487d-95f5-430b3c966e0c tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:23.022236 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-840f524a-0968-487d-95f5-430b3c966e0c tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] [instance: b2c8854b-ed0b-4727-b89b-f0633f75d9de] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:23.030119 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-840f524a-0968-487d-95f5-430b3c966e0c tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:23.030842 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-840f524a-0968-487d-95f5-430b3c966e0c tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:23.031438 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-840f524a-0968-487d-95f5-430b3c966e0c tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:23.032419 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-840f524a-0968-487d-95f5-430b3c966e0c tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:23.033637 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-840f524a-0968-487d-95f5-430b3c966e0c tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:23.033637 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-840f524a-0968-487d-95f5-430b3c966e0c tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:23.061159 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=2 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:34:23.062906 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=42 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:34:23.078787 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-840f524a-0968-487d-95f5-430b3c966e0c tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] [instance: b2c8854b-ed0b-4727-b89b-f0633f75d9de] Going to try to terminate instance {{(pid=123595) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:34:23.096248 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=6 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:34:23.146764 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:34:23.210576 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-840f524a-0968-487d-95f5-430b3c966e0c tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] 10.222.0.43 "DELETE /compute/v2.1/servers/b2c8854b-ed0b-4727-b89b-f0633f75d9de" status: 204 len: 0 microversion: 2.1 time: 0.195904 Oct 04 18:34:23.212007 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 417/873] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 18:34:23 2022] DELETE /compute/v2.1/servers/b2c8854b-ed0b-4727-b89b-f0633f75d9de => generated 0 bytes in 199 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:34:23.221140 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-4b784b8f-e39f-49a0-8e4c-b892c9584a3c tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-851028-13", "block_migration": "auto"}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:34:23.224485 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-4b784b8f-e39f-49a0-8e4c-b892c9584a3c tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] [instance: 9895c2ec-35ea-419e-9565-0c0f2fc5bbbc] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:23.231924 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4b784b8f-e39f-49a0-8e4c-b892c9584a3c tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:23.235071 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4b784b8f-e39f-49a0-8e4c-b892c9584a3c tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:23.235776 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4b784b8f-e39f-49a0-8e4c-b892c9584a3c tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:23.237650 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4b784b8f-e39f-49a0-8e4c-b892c9584a3c tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:23.238358 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4b784b8f-e39f-49a0-8e4c-b892c9584a3c tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:23.238989 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4b784b8f-e39f-49a0-8e4c-b892c9584a3c tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:23.274848 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.objects.instance [None req-4b784b8f-e39f-49a0-8e4c-b892c9584a3c tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] Lazy-loading 'flavor' on Instance uuid 9895c2ec-35ea-419e-9565-0c0f2fc5bbbc {{(pid=123595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:34:23.294833 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-4b784b8f-e39f-49a0-8e4c-b892c9584a3c tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] [instance: 9895c2ec-35ea-419e-9565-0c0f2fc5bbbc] Going to try to live migrate instance to n-h2-851028-13 {{(pid=123595) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 04 18:34:27.219505 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-e4298e63-d79e-4537-b03f-ccd5c7224d25 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] 10.222.0.43 "GET /compute/v2.1/images/431ce5a8-e1dc-4eb2-a165-ad8ed0489d0b" status: 200 len: 1421 microversion: 2.1 time: 14.011142 Oct 04 18:34:27.220145 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 457/874] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 18:34:13 2022] GET /compute/v2.1/images/431ce5a8-e1dc-4eb2-a165-ad8ed0489d0b => generated 1421 bytes in 14012 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:27.226189 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-deb41678-f71a-4621-8ca2-f80b2a45e885 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:27.226899 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-deb41678-f71a-4621-8ca2-f80b2a45e885 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] [instance: eb05639b-cd53-4c27-9505-20e668a16acc] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:27.233411 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-deb41678-f71a-4621-8ca2-f80b2a45e885 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:27.233992 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-deb41678-f71a-4621-8ca2-f80b2a45e885 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:27.234438 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-deb41678-f71a-4621-8ca2-f80b2a45e885 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:27.235205 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-deb41678-f71a-4621-8ca2-f80b2a45e885 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:27.235684 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-deb41678-f71a-4621-8ca2-f80b2a45e885 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:27.236161 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-deb41678-f71a-4621-8ca2-f80b2a45e885 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:27.370615 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-deb41678-f71a-4621-8ca2-f80b2a45e885 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64887fff0bc7417094c4fee2f7e9aa5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6187bfad04cb7bc17155862ee0cdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:27.379433 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-deb41678-f71a-4621-8ca2-f80b2a45e885 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] 10.222.0.43 "GET /compute/v2.1/servers/eb05639b-cd53-4c27-9505-20e668a16acc" status: 200 len: 1365 microversion: 2.1 time: 0.157308 Oct 04 18:34:27.380028 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 458/875] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:27 2022] GET /compute/v2.1/servers/eb05639b-cd53-4c27-9505-20e668a16acc => generated 1365 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:27.388034 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-3ee04bf0-9da7-4c28-be39-31bb09b7e632 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:27.388895 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-3ee04bf0-9da7-4c28-be39-31bb09b7e632 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] [instance: 9b19b908-7870-477b-9be7-7d260d59b183] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:27.399820 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3ee04bf0-9da7-4c28-be39-31bb09b7e632 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:27.400536 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3ee04bf0-9da7-4c28-be39-31bb09b7e632 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:27.401086 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3ee04bf0-9da7-4c28-be39-31bb09b7e632 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:27.402155 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3ee04bf0-9da7-4c28-be39-31bb09b7e632 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:27.402759 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3ee04bf0-9da7-4c28-be39-31bb09b7e632 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:27.403294 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3ee04bf0-9da7-4c28-be39-31bb09b7e632 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:27.419207 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-3ee04bf0-9da7-4c28-be39-31bb09b7e632 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] HTTP exception thrown: Instance 9b19b908-7870-477b-9be7-7d260d59b183 could not be found. Oct 04 18:34:27.421848 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-3ee04bf0-9da7-4c28-be39-31bb09b7e632 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Request method failure captured: Oct 04 18:34:27.421848 n-d-851028-13 devstack@n-api.service[123596]: request: DELETE /compute/v2.1/servers/9b19b908-7870-477b-9be7-7d260d59b183 HTTP/1.1 Oct 04 18:34:27.421848 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:34:27.421848 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:34:27.421848 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:34:27.421848 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 18:34:27.421848 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:34:27.421848 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:34:27.421848 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:34:27.421848 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:34:27.421848 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPHv2QQ3jzxK9bNushSTjp6y8Xo_it4ckq6ryRr5sK1e_bJBDmtF5jD03bM5zBSKI8NSKKQpHL-7xQlPXmN7q0fPNd57nBsnZXwjWsBIHh2WvlKt97iHPsqXESK9N4v7QO3iJ_YD2Lzbp5kqM8RoMW4mG2F8iwe8qrJahQt83Rp6TVCw Oct 04 18:34:27.421848 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:34:27.421848 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:34:27.421848 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:34:27.421848 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:34:27.421848 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:34:27.421848 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:34:27.421848 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: 82c615a05e8a4cd086f2e580529fb1d4 Oct 04 18:34:27.421848 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-956674611 Oct 04 18:34:27.421848 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 18:34:27.421848 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 18:34:27.423667 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/82c615a05e8a4cd086f2e580529fb1d4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_82c615a05e8a4cd086f2e580529fb1d4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/82c615a05e8a4cd086f2e580529fb1d4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/82c615a05e8a4cd086f2e580529fb1d4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:34:27.423667 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-956674611 Oct 04 18:34:27.423667 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: 82c615a05e8a4cd086f2e580529fb1d4 Oct 04 18:34:27.423667 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-956674611 Oct 04 18:34:27.423667 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-ServersWithSpecificFlavorTestJSON-956674611-project Oct 04 18:34:27.423667 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:34:27.423667 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:34:27.423667 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: f8ea2088d8124b149187a1c140d3be88 Oct 04 18:34:27.423667 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-956674611-project Oct 04 18:34:27.423667 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 18:34:27.423667 n-d-851028-13 devstack@n-api.service[123596]: exception: Instance 9b19b908-7870-477b-9be7-7d260d59b183 could not be found. Oct 04 18:34:27.423667 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': '9b19b908-7870-477b-9be7-7d260d59b183'} Oct 04 18:34:27.424508 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:34:27.424508 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:34:27.424508 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:34:27.424508 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:34:27.424508 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:34:27.424508 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:34:27.424508 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:34:27.424508 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:34:27.424508 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:34:27.424508 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:34:27.424508 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b19b908-7870-477b-9be7-7d260d59b183 could not be found. Oct 04 18:34:27.424508 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:34:27.424508 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:34:27.424508 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:34:27.424508 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:34:27.424508 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:34:27.424508 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:34:27.424508 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:34:27.424508 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:34:27.424508 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:34:27.425999 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:34:27.425999 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:34:27.425999 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:34:27.425999 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:34:27.425999 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:34:27.425999 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:34:27.425999 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:34:27.425999 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:34:27.425999 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:34:27.425999 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b19b908-7870-477b-9be7-7d260d59b183 could not be found. Oct 04 18:34:27.425999 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:34:27.425999 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:34:27.425999 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:34:27.425999 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:34:27.425999 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:34:27.425999 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:34:27.425999 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:34:27.425999 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:34:27.425999 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b19b908-7870-477b-9be7-7d260d59b183 could not be found. Oct 04 18:34:27.425999 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:34:27.427881 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-3ee04bf0-9da7-4c28-be39-31bb09b7e632 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Returning 404 to user: Instance 9b19b908-7870-477b-9be7-7d260d59b183 could not be found. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:34:27.427881 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-3ee04bf0-9da7-4c28-be39-31bb09b7e632 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] 10.222.0.43 "DELETE /compute/v2.1/servers/9b19b908-7870-477b-9be7-7d260d59b183" status: 404 len: 111 microversion: 2.1 time: 0.042256 Oct 04 18:34:27.427881 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 459/876] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 18:34:27 2022] DELETE /compute/v2.1/servers/9b19b908-7870-477b-9be7-7d260d59b183 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:34:27.428412 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-4d635311-a3df-4e17-9c6d-0c114001b2c9 tempest-AbsoluteLimitsNegativeTestJSON-10007641 tempest-AbsoluteLimitsNegativeTestJSON-10007641-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-87099678", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:34:27.485529 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.network.neutron [None req-4d635311-a3df-4e17-9c6d-0c114001b2c9 tempest-AbsoluteLimitsNegativeTestJSON-10007641 tempest-AbsoluteLimitsNegativeTestJSON-10007641-project] validate_networks() for None {{(pid=123596) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:34:27.695113 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-4d635311-a3df-4e17-9c6d-0c114001b2c9 tempest-AbsoluteLimitsNegativeTestJSON-10007641 tempest-AbsoluteLimitsNegativeTestJSON-10007641-project] Getting quotas for project 55d30c4c9c27456196ac9f88e40de835. Resources: dict_keys(['metadata_items']) {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:34:27.698937 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-4d635311-a3df-4e17-9c6d-0c114001b2c9 tempest-AbsoluteLimitsNegativeTestJSON-10007641 tempest-AbsoluteLimitsNegativeTestJSON-10007641-project] Getting quotas for user 7deb748efba3429fa78abee4bbcb94d8 and project 55d30c4c9c27456196ac9f88e40de835. Resources: dict_keys(['metadata_items']) {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:34:27.709791 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-4d635311-a3df-4e17-9c6d-0c114001b2c9 tempest-AbsoluteLimitsNegativeTestJSON-10007641 tempest-AbsoluteLimitsNegativeTestJSON-10007641-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Oct 04 18:34:27.712050 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-4d635311-a3df-4e17-9c6d-0c114001b2c9 tempest-AbsoluteLimitsNegativeTestJSON-10007641 tempest-AbsoluteLimitsNegativeTestJSON-10007641-project] Request method failure captured: Oct 04 18:34:27.712050 n-d-851028-13 devstack@n-api.service[123596]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 18:34:27.712050 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:34:27.712050 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:34:27.712050 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:34:27.712050 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 1750 Oct 04 18:34:27.712050 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:34:27.712050 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:34:27.712050 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:34:27.712050 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:34:27.712050 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPHytnRH2o91p9X7Mn68aFay76V8cz5phW5qLNngFlOO_tvXIxSAvxyruytpfVeHO6pL-kp4y3VrFs6toD4vVenKOy7W8hnIBRaBGJWogL_8dj9tB3Krsd5Py7DW_bpb8MPHMEpJPfOW9B_wLvTMh9txm4x9E8edGHMkD8QWoRUSuVw0 Oct 04 18:34:27.712050 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:34:27.712050 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:34:27.712050 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:34:27.712050 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:34:27.712050 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:34:27.712050 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:34:27.712050 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: 55d30c4c9c27456196ac9f88e40de835 Oct 04 18:34:27.712050 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-AbsoluteLimitsNegativeTestJSON-10007641 Oct 04 18:34:27.712050 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 18:34:27.712050 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 18:34:27.712050 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/55d30c4c9c27456196ac9f88e40de835"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_55d30c4c9c27456196ac9f88e40de835"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/55d30c4c9c27456196ac9f88e40de835"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/55d30c4c9c27456196ac9f88e40de835"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:34:27.712050 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-AbsoluteLimitsNegativeTestJSON-10007641 Oct 04 18:34:27.712050 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: 55d30c4c9c27456196ac9f88e40de835 Oct 04 18:34:27.712050 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-AbsoluteLimitsNegativeTestJSON-10007641 Oct 04 18:34:27.712050 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-AbsoluteLimitsNegativeTestJSON-10007641-project Oct 04 18:34:27.712050 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:34:27.712050 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:34:27.712050 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 7deb748efba3429fa78abee4bbcb94d8 Oct 04 18:34:27.712050 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-AbsoluteLimitsNegativeTestJSON-10007641-project Oct 04 18:34:27.712050 n-d-851028-13 devstack@n-api.service[123596]: Oct 04 18:34:27.712050 n-d-851028-13 devstack@n-api.service[123596]: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-87099678", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} Oct 04 18:34:27.712050 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 18:34:27.712050 n-d-851028-13 devstack@n-api.service[123596]: exception: Maximum number of metadata items exceeds 128 Oct 04 18:34:27.714403 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'body': {'server': {'name': 'tempest-AbsoluteLimitsNegativeTestJSON-server-87099678', 'imageRef': 'e8943ec5-4038-4d4b-b9b9-2415a79f5243', 'flavorRef': '452', 'metadata': {'0': '0', '1': '1', '2': '2', '3': '3', '4': '4', '5': '5', '6': '6', '7': '7', '8': '8', '9': '9', '10': '10', '11': '11', '12': '12', '13': '13', '14': '14', '15': '15', '16': '16', '17': '17', '18': '18', '19': '19', '20': '20', '21': '21', '22': '22', '23': '23', '24': '24', '25': '25', '26': '26', '27': '27', '28': '28', '29': '29', '30': '30', '31': '31', '32': '32', '33': '33', '34': '34', '35': '35', '36': '36', '37': '37', '38': '38', '39': '39', '40': '40', '41': '41', '42': '42', '43': '43', '44': '44', '45': '45', '46': '46', '47': '47', '48': '48', '49': '49', '50': '50', '51': '51', '52': '52', '53': '53', '54': '54', '55': '55', '56': '56', '57': '57', '58': '58', '59': '59', '60': '60', '61': '61', '62': '62', '63': '63', '64': '64', '65': '65', '66': '66', '67': '67', '68': '68', '69': '69', '70': '70', '71': '71', '72': '72', '73': '73', '74': '74', '75': '75', '76': '76', '77': '77', '78': '78', '79': '79', '80': '80', '81': '81', '82': '82', '83': '83', '84': '84', '85': '85', '86': '86', '87': '87', '88': '88', '89': '89', '90': '90', '91': '91', '92': '92', '93': '93', '94': '94', '95': '95', '96': '96', '97': '97', '98': '98', '99': '99', '100': '100', '101': '101', '102': '102', '103': '103', '104': '104', '105': '105', '106': '106', '107': '107', '108': '108', '109': '109', '110': '110', '111': '111', '112': '112', '113': '113', '114': '114', '115': '115', '116': '116', '117': '117', '118': '118', '119': '119', '120': '120', '121': '121', '122': '122', '123': '123', '124': '124', '125': '125', '126': '126', '127': '127', '128': '128'}}}} Oct 04 18:34:27.714403 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:34:27.714403 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:34:27.714403 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 476, in _check_metadata_properties_quota Oct 04 18:34:27.714403 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi objects.Quotas.limit_check(context, metadata_items=num_metadata) Oct 04 18:34:27.714403 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 18:34:27.714403 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 18:34:27.714403 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 290, in limit_check Oct 04 18:34:27.714403 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check( Oct 04 18:34:27.714403 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1118, in limit_check Oct 04 18:34:27.714403 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return self._driver.limit_check(context, self._resources, values, Oct 04 18:34:27.714403 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 468, in limit_check Oct 04 18:34:27.714403 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), quotas=quotas, Oct 04 18:34:27.714403 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['metadata_items'] Oct 04 18:34:27.714403 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:34:27.714403 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:34:27.714403 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:34:27.714403 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:34:27.714403 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 18:34:27.714403 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 18:34:27.714403 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 18:34:27.714403 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 18:34:27.714403 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Oct 04 18:34:27.714403 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Oct 04 18:34:27.714403 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1016, in _checks_for_create_and_rebuild Oct 04 18:34:27.714403 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi self._check_metadata_properties_quota(context, metadata) Oct 04 18:34:27.714403 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 483, in _check_metadata_properties_quota Oct 04 18:34:27.714403 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.MetadataLimitExceeded(allowed=quota_metadata) Oct 04 18:34:27.714403 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.MetadataLimitExceeded: Maximum number of metadata items exceeds 128 Oct 04 18:34:27.714403 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:34:27.714403 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:34:27.714403 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:34:27.714403 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:34:27.714403 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:34:27.714403 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:34:27.714403 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:34:27.714403 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:34:27.714403 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:34:27.714403 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:34:27.714403 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:34:27.714403 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:34:27.714403 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:34:27.714403 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:34:27.714403 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:34:27.717290 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:34:27.717290 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 18:34:27.717290 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 04 18:34:27.717290 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 04 18:34:27.717290 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Maximum number of metadata items exceeds 128 Oct 04 18:34:27.717290 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:34:27.717290 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:34:27.717290 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:34:27.717290 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:34:27.717290 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:34:27.717290 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:34:27.717290 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:34:27.717290 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:34:27.717290 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Maximum number of metadata items exceeds 128 Oct 04 18:34:27.717290 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:34:27.717290 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-4d635311-a3df-4e17-9c6d-0c114001b2c9 tempest-AbsoluteLimitsNegativeTestJSON-10007641 tempest-AbsoluteLimitsNegativeTestJSON-10007641-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:34:27.717290 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-4d635311-a3df-4e17-9c6d-0c114001b2c9 tempest-AbsoluteLimitsNegativeTestJSON-10007641 tempest-AbsoluteLimitsNegativeTestJSON-10007641-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 0.288730 Oct 04 18:34:27.717290 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 460/877] 10.222.0.43 () {60 vars in 1148 bytes} [Tue Oct 4 18:34:27 2022] POST /compute/v2.1/servers => generated 87 bytes in 290 msecs (HTTP/1.1 403) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:34:27.718883 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-dffd8c63-cf0b-456f-b4b7-a0d5dca9af1d tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:27.719551 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-dffd8c63-cf0b-456f-b4b7-a0d5dca9af1d tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] [instance: b2c8854b-ed0b-4727-b89b-f0633f75d9de] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:27.725722 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dffd8c63-cf0b-456f-b4b7-a0d5dca9af1d tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:27.726211 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dffd8c63-cf0b-456f-b4b7-a0d5dca9af1d tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:27.726648 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dffd8c63-cf0b-456f-b4b7-a0d5dca9af1d tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:27.727351 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dffd8c63-cf0b-456f-b4b7-a0d5dca9af1d tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:27.727808 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dffd8c63-cf0b-456f-b4b7-a0d5dca9af1d tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:27.728235 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dffd8c63-cf0b-456f-b4b7-a0d5dca9af1d tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:27.744669 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-dffd8c63-cf0b-456f-b4b7-a0d5dca9af1d tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] HTTP exception thrown: Instance b2c8854b-ed0b-4727-b89b-f0633f75d9de could not be found. Oct 04 18:34:27.746502 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-dffd8c63-cf0b-456f-b4b7-a0d5dca9af1d tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Request method failure captured: Oct 04 18:34:27.746502 n-d-851028-13 devstack@n-api.service[123596]: request: GET /compute/v2.1/servers/b2c8854b-ed0b-4727-b89b-f0633f75d9de HTTP/1.1 Oct 04 18:34:27.746502 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:34:27.746502 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:34:27.746502 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:34:27.746502 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 18:34:27.746502 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:34:27.746502 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:34:27.746502 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:34:27.746502 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:34:27.746502 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPHvuItqv5xcxbp_bqbjUggZhpUG53TiGDPrqjFiNZGHAMY6QdeICs1jR4QxEtGJ9kJciv8ws3outzNBgAd1ZiItYEkQ7c76M1xzjstLBOG0OAwb8aGthDLSqRW7T7V0wj50TxoUUgeNpSMbG6VscuaiI7GHr0fqlhRjDqzMaKz-IIxQ Oct 04 18:34:27.746502 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:34:27.746502 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:34:27.746502 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:34:27.746502 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:34:27.746502 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:34:27.746502 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:34:27.746502 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: e7adedcdb9c3485ea2738c00e25aa3fd Oct 04 18:34:27.746502 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-ServersOnMultiNodesTest-1469796738 Oct 04 18:34:27.746502 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 18:34:27.746502 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 18:34:27.746502 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/e7adedcdb9c3485ea2738c00e25aa3fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_e7adedcdb9c3485ea2738c00e25aa3fd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/e7adedcdb9c3485ea2738c00e25aa3fd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/e7adedcdb9c3485ea2738c00e25aa3fd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:34:27.746502 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-ServersOnMultiNodesTest-1469796738 Oct 04 18:34:27.746502 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: e7adedcdb9c3485ea2738c00e25aa3fd Oct 04 18:34:27.746502 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1469796738 Oct 04 18:34:27.746502 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-ServersOnMultiNodesTest-1469796738-project Oct 04 18:34:27.746502 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:34:27.746502 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:34:27.746502 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: a7db99f361654711bea7f1b2c404d312 Oct 04 18:34:27.746502 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-ServersOnMultiNodesTest-1469796738-project Oct 04 18:34:27.746502 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 18:34:27.746502 n-d-851028-13 devstack@n-api.service[123596]: exception: Instance b2c8854b-ed0b-4727-b89b-f0633f75d9de could not be found. Oct 04 18:34:27.746502 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': 'b2c8854b-ed0b-4727-b89b-f0633f75d9de'} Oct 04 18:34:27.746502 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:34:27.746502 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:34:27.746502 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:34:27.746502 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:34:27.746502 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:34:27.746502 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:34:27.746502 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:34:27.746502 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:34:27.746502 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:34:27.746502 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:34:27.746502 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2c8854b-ed0b-4727-b89b-f0633f75d9de could not be found. Oct 04 18:34:27.746502 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:34:27.746502 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:34:27.746502 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:34:27.746502 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:34:27.746502 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:34:27.746502 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:34:27.746502 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:34:27.746502 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:34:27.746502 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:34:27.746502 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:34:27.746502 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:34:27.746502 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:34:27.746502 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:34:27.746502 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:34:27.746502 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:34:27.746502 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:34:27.746502 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2c8854b-ed0b-4727-b89b-f0633f75d9de could not be found. Oct 04 18:34:27.746502 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:34:27.746502 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:34:27.746502 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:34:27.752173 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:34:27.752173 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:34:27.752173 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:34:27.752173 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:34:27.752173 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:34:27.752173 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2c8854b-ed0b-4727-b89b-f0633f75d9de could not be found. Oct 04 18:34:27.752173 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:34:27.752173 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-dffd8c63-cf0b-456f-b4b7-a0d5dca9af1d tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Returning 404 to user: Instance b2c8854b-ed0b-4727-b89b-f0633f75d9de could not be found. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:34:27.752173 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-dffd8c63-cf0b-456f-b4b7-a0d5dca9af1d tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] 10.222.0.43 "GET /compute/v2.1/servers/b2c8854b-ed0b-4727-b89b-f0633f75d9de" status: 404 len: 111 microversion: 2.1 time: 0.032855 Oct 04 18:34:27.752173 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 461/878] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:27 2022] GET /compute/v2.1/servers/b2c8854b-ed0b-4727-b89b-f0633f75d9de => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:34:27.754361 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f278102e-97d8-45d5-8bf0-5f715d40d4ab tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:27.754570 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-f278102e-97d8-45d5-8bf0-5f715d40d4ab tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] [instance: bcc13e2d-03e7-464d-abac-f5ffb7cbb509] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:27.760551 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f278102e-97d8-45d5-8bf0-5f715d40d4ab tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:27.761035 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f278102e-97d8-45d5-8bf0-5f715d40d4ab tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:27.761512 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f278102e-97d8-45d5-8bf0-5f715d40d4ab tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:27.762214 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f278102e-97d8-45d5-8bf0-5f715d40d4ab tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:27.762670 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f278102e-97d8-45d5-8bf0-5f715d40d4ab tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:27.763100 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f278102e-97d8-45d5-8bf0-5f715d40d4ab tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:27.900443 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-f278102e-97d8-45d5-8bf0-5f715d40d4ab tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4aec5af742842f5bb2048c8b7d60687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829069b2787a423f922fcc5b5702f167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:27.908811 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-f278102e-97d8-45d5-8bf0-5f715d40d4ab tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] 10.222.0.43 "GET /compute/v2.1/servers/bcc13e2d-03e7-464d-abac-f5ffb7cbb509" status: 200 len: 1319 microversion: 2.1 time: 0.159304 Oct 04 18:34:27.909439 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 462/879] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:27 2022] GET /compute/v2.1/servers/bcc13e2d-03e7-464d-abac-f5ffb7cbb509 => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:27.914314 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-8298efe8-2694-4f38-9d0f-e6d2a9e12a73 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:27.915176 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-8298efe8-2694-4f38-9d0f-e6d2a9e12a73 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] [instance: 84e0414b-a39f-4bfe-bc9d-c170ceb34d15] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:27.921399 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8298efe8-2694-4f38-9d0f-e6d2a9e12a73 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:27.921891 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8298efe8-2694-4f38-9d0f-e6d2a9e12a73 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:27.922396 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8298efe8-2694-4f38-9d0f-e6d2a9e12a73 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:27.923004 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8298efe8-2694-4f38-9d0f-e6d2a9e12a73 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:27.924013 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8298efe8-2694-4f38-9d0f-e6d2a9e12a73 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:27.924506 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8298efe8-2694-4f38-9d0f-e6d2a9e12a73 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:28.024154 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-8298efe8-2694-4f38-9d0f-e6d2a9e12a73 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:28.038268 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-8298efe8-2694-4f38-9d0f-e6d2a9e12a73 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:28.040246 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-8298efe8-2694-4f38-9d0f-e6d2a9e12a73 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:28.066543 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-8298efe8-2694-4f38-9d0f-e6d2a9e12a73 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] 10.222.0.43 "GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15" status: 200 len: 1544 microversion: 2.91 time: 0.155411 Oct 04 18:34:28.068943 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 463/880] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:34:27 2022] GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15 => generated 1544 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:34:28.074034 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-be709e1c-e0e4-4bf4-b7ae-302f7c548907 req-fa631f83-75c2-4c4c-a893-8fe09c280704 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2c8854b-ed0b-4727-b89b-f0633f75d9de", "name": "network-vif-deleted", "tag": "218fd35c-7248-49e8-9f4b-8c869e0161e1"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:34:28.095941 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-be709e1c-e0e4-4bf4-b7ae-302f7c548907 req-fa631f83-75c2-4c4c-a893-8fe09c280704 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:28.096422 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-be709e1c-e0e4-4bf4-b7ae-302f7c548907 req-fa631f83-75c2-4c4c-a893-8fe09c280704 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:28.096925 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-be709e1c-e0e4-4bf4-b7ae-302f7c548907 req-fa631f83-75c2-4c4c-a893-8fe09c280704 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:28.108967 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-be709e1c-e0e4-4bf4-b7ae-302f7c548907 req-fa631f83-75c2-4c4c-a893-8fe09c280704 service nova] Creating event network-vif-deleted:218fd35c-7248-49e8-9f4b-8c869e0161e1 for instance b2c8854b-ed0b-4727-b89b-f0633f75d9de on n-h1-851028-13 Oct 04 18:34:28.114329 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-be709e1c-e0e4-4bf4-b7ae-302f7c548907 req-fa631f83-75c2-4c4c-a893-8fe09c280704 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045208 Oct 04 18:34:28.115427 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 464/881] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:34:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:34:28.121058 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-fbc6bfec-077e-4994-a352-a83b79d5ce29 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Calling method '.version_select at 0x7fb21fd11790>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:28.176970 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-fbc6bfec-077e-4994-a352-a83b79d5ce29 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] 10.222.0.43 "GET /compute/v2.1/images/431ce5a8-e1dc-4eb2-a165-ad8ed0489d0b" status: 200 len: 1421 microversion: 2.1 time: 0.060064 Oct 04 18:34:28.177775 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 465/882] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 18:34:28 2022] GET /compute/v2.1/images/431ce5a8-e1dc-4eb2-a165-ad8ed0489d0b => generated 1421 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:28.182667 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-2e292719-26a7-41fc-8169-7b955432ec76 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:28.183401 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-2e292719-26a7-41fc-8169-7b955432ec76 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] [instance: 9b19b908-7870-477b-9be7-7d260d59b183] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:28.190380 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2e292719-26a7-41fc-8169-7b955432ec76 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:28.190875 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2e292719-26a7-41fc-8169-7b955432ec76 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:28.191316 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2e292719-26a7-41fc-8169-7b955432ec76 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:28.192816 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2e292719-26a7-41fc-8169-7b955432ec76 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:28.193367 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2e292719-26a7-41fc-8169-7b955432ec76 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:28.193846 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2e292719-26a7-41fc-8169-7b955432ec76 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:28.208712 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-2e292719-26a7-41fc-8169-7b955432ec76 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] HTTP exception thrown: Instance 9b19b908-7870-477b-9be7-7d260d59b183 could not be found. Oct 04 18:34:28.210408 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-2e292719-26a7-41fc-8169-7b955432ec76 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Request method failure captured: Oct 04 18:34:28.210408 n-d-851028-13 devstack@n-api.service[123596]: request: GET /compute/v2.1/servers/9b19b908-7870-477b-9be7-7d260d59b183 HTTP/1.1 Oct 04 18:34:28.210408 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:34:28.210408 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:34:28.210408 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:34:28.210408 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 18:34:28.210408 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:34:28.210408 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:34:28.210408 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:34:28.210408 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:34:28.210408 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPHv2QQ3jzxK9bNushSTjp6y8Xo_it4ckq6ryRr5sK1e_bJBDmtF5jD03bM5zBSKI8NSKKQpHL-7xQlPXmN7q0fPNd57nBsnZXwjWsBIHh2WvlKt97iHPsqXESK9N4v7QO3iJ_YD2Lzbp5kqM8RoMW4mG2F8iwe8qrJahQt83Rp6TVCw Oct 04 18:34:28.210408 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:34:28.210408 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:34:28.210408 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:34:28.210408 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:34:28.210408 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:34:28.210408 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:34:28.210408 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: 82c615a05e8a4cd086f2e580529fb1d4 Oct 04 18:34:28.210408 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-956674611 Oct 04 18:34:28.210408 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 18:34:28.210408 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 18:34:28.210408 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/82c615a05e8a4cd086f2e580529fb1d4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_82c615a05e8a4cd086f2e580529fb1d4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/82c615a05e8a4cd086f2e580529fb1d4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/82c615a05e8a4cd086f2e580529fb1d4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:34:28.210408 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-956674611 Oct 04 18:34:28.210408 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: 82c615a05e8a4cd086f2e580529fb1d4 Oct 04 18:34:28.210408 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-956674611 Oct 04 18:34:28.210408 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-ServersWithSpecificFlavorTestJSON-956674611-project Oct 04 18:34:28.210408 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:34:28.210408 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:34:28.210408 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: f8ea2088d8124b149187a1c140d3be88 Oct 04 18:34:28.210408 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-956674611-project Oct 04 18:34:28.210408 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 18:34:28.210408 n-d-851028-13 devstack@n-api.service[123596]: exception: Instance 9b19b908-7870-477b-9be7-7d260d59b183 could not be found. Oct 04 18:34:28.210408 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': '9b19b908-7870-477b-9be7-7d260d59b183'} Oct 04 18:34:28.210408 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:34:28.210408 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:34:28.210408 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:34:28.210408 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:34:28.210408 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:34:28.210408 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:34:28.210408 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:34:28.210408 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:34:28.210408 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:34:28.210408 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:34:28.210408 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b19b908-7870-477b-9be7-7d260d59b183 could not be found. Oct 04 18:34:28.210408 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:34:28.210408 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:34:28.210408 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:34:28.210408 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:34:28.210408 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:34:28.210408 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:34:28.210408 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:34:28.210408 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:34:28.210408 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:34:28.210408 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:34:28.210408 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:34:28.210408 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:34:28.210408 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:34:28.210408 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:34:28.210408 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:34:28.210408 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:34:28.210408 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b19b908-7870-477b-9be7-7d260d59b183 could not be found. Oct 04 18:34:28.210408 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:34:28.210408 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:34:28.215209 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:34:28.215209 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:34:28.215209 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:34:28.215209 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:34:28.215209 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:34:28.215209 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:34:28.215209 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b19b908-7870-477b-9be7-7d260d59b183 could not be found. Oct 04 18:34:28.215209 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:34:28.215209 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-2e292719-26a7-41fc-8169-7b955432ec76 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Returning 404 to user: Instance 9b19b908-7870-477b-9be7-7d260d59b183 could not be found. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:34:28.215209 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-2e292719-26a7-41fc-8169-7b955432ec76 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] 10.222.0.43 "GET /compute/v2.1/servers/9b19b908-7870-477b-9be7-7d260d59b183" status: 404 len: 111 microversion: 2.1 time: 0.033299 Oct 04 18:34:28.215209 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 466/883] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:28 2022] GET /compute/v2.1/servers/9b19b908-7870-477b-9be7-7d260d59b183 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:34:28.217728 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-70bc9825-56e9-45bd-9b66-fc51df2461a9 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:28.218518 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-70bc9825-56e9-45bd-9b66-fc51df2461a9 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] [instance: 8408d8e1-41b0-4185-8806-9808f082a016] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:28.226325 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-70bc9825-56e9-45bd-9b66-fc51df2461a9 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:28.227963 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-70bc9825-56e9-45bd-9b66-fc51df2461a9 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:28.228650 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-70bc9825-56e9-45bd-9b66-fc51df2461a9 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:28.229654 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-70bc9825-56e9-45bd-9b66-fc51df2461a9 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:28.230441 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-70bc9825-56e9-45bd-9b66-fc51df2461a9 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:28.231152 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-70bc9825-56e9-45bd-9b66-fc51df2461a9 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:28.261623 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-70bc9825-56e9-45bd-9b66-fc51df2461a9 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] [instance: 8408d8e1-41b0-4185-8806-9808f082a016] Going to try to terminate instance {{(pid=123596) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:34:28.370436 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-70bc9825-56e9-45bd-9b66-fc51df2461a9 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] 10.222.0.43 "DELETE /compute/v2.1/servers/8408d8e1-41b0-4185-8806-9808f082a016" status: 204 len: 0 microversion: 2.1 time: 0.156067 Oct 04 18:34:28.374411 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 467/884] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 18:34:28 2022] DELETE /compute/v2.1/servers/8408d8e1-41b0-4185-8806-9808f082a016 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:34:28.389488 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-29a3e3ff-3a15-43bf-af24-bfea6dd3f4ad tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Calling method '.version_select at 0x7fb21fccbd30>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:29.220796 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-29a3e3ff-3a15-43bf-af24-bfea6dd3f4ad tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] 10.222.0.43 "DELETE /compute/v2.1/images/431ce5a8-e1dc-4eb2-a165-ad8ed0489d0b" status: 204 len: 0 microversion: 2.1 time: 0.836195 Oct 04 18:34:29.221504 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 468/885] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:28 2022] DELETE /compute/v2.1/images/431ce5a8-e1dc-4eb2-a165-ad8ed0489d0b => generated 0 bytes in 850 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:34:29.226410 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-bfddfe38-b40b-41b3-b4a9-f6e047b75811 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Calling method '.version_select at 0x7fb21fb53a60>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:29.247679 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-bfddfe38-b40b-41b3-b4a9-f6e047b75811 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1885965875" status: 202 len: 0 microversion: 2.1 time: 0.024753 Oct 04 18:34:29.248075 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 469/886] 10.222.0.43 () {58 vars in 1221 bytes} [Tue Oct 4 18:34:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1885965875 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:34:29.254001 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-6f78754c-8d98-4a4c-ba2c-fdd6e7ce734d tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:29.255156 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-6f78754c-8d98-4a4c-ba2c-fdd6e7ce734d tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] [instance: 8408d8e1-41b0-4185-8806-9808f082a016] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:29.261550 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6f78754c-8d98-4a4c-ba2c-fdd6e7ce734d tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:29.262337 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6f78754c-8d98-4a4c-ba2c-fdd6e7ce734d tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:29.262899 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6f78754c-8d98-4a4c-ba2c-fdd6e7ce734d tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:29.263716 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6f78754c-8d98-4a4c-ba2c-fdd6e7ce734d tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:29.264266 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6f78754c-8d98-4a4c-ba2c-fdd6e7ce734d tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:29.264821 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6f78754c-8d98-4a4c-ba2c-fdd6e7ce734d tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:29.424715 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-6f78754c-8d98-4a4c-ba2c-fdd6e7ce734d tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7db99f361654711bea7f1b2c404d312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7adedcdb9c3485ea2738c00e25aa3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:29.436820 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-6f78754c-8d98-4a4c-ba2c-fdd6e7ce734d tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] 10.222.0.43 "GET /compute/v2.1/servers/8408d8e1-41b0-4185-8806-9808f082a016" status: 200 len: 1472 microversion: 2.1 time: 0.185410 Oct 04 18:34:29.436820 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 470/887] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:29 2022] GET /compute/v2.1/servers/8408d8e1-41b0-4185-8806-9808f082a016 => generated 1472 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:29.447761 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-b7a11e05-5c9a-42cd-aef4-7a4627cbdd4e tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:29.448383 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-b7a11e05-5c9a-42cd-aef4-7a4627cbdd4e tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] [instance: eb05639b-cd53-4c27-9505-20e668a16acc] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:29.456832 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b7a11e05-5c9a-42cd-aef4-7a4627cbdd4e tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:29.457251 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b7a11e05-5c9a-42cd-aef4-7a4627cbdd4e tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:29.458104 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b7a11e05-5c9a-42cd-aef4-7a4627cbdd4e tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:29.458352 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b7a11e05-5c9a-42cd-aef4-7a4627cbdd4e tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:29.458809 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b7a11e05-5c9a-42cd-aef4-7a4627cbdd4e tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:29.459235 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b7a11e05-5c9a-42cd-aef4-7a4627cbdd4e tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:29.607615 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-b7a11e05-5c9a-42cd-aef4-7a4627cbdd4e tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64887fff0bc7417094c4fee2f7e9aa5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6187bfad04cb7bc17155862ee0cdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:29.616887 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-b7a11e05-5c9a-42cd-aef4-7a4627cbdd4e tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] 10.222.0.43 "GET /compute/v2.1/servers/eb05639b-cd53-4c27-9505-20e668a16acc" status: 200 len: 1365 microversion: 2.1 time: 0.173585 Oct 04 18:34:29.617661 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 471/888] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:29 2022] GET /compute/v2.1/servers/eb05639b-cd53-4c27-9505-20e668a16acc => generated 1365 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:29.622386 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-84e16404-4f05-491e-9074-6275d848543c tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:29.623147 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-84e16404-4f05-491e-9074-6275d848543c tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] [instance: bcc13e2d-03e7-464d-abac-f5ffb7cbb509] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:29.630048 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-84e16404-4f05-491e-9074-6275d848543c tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:29.630657 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-84e16404-4f05-491e-9074-6275d848543c tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:29.631199 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-84e16404-4f05-491e-9074-6275d848543c tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:29.632134 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-84e16404-4f05-491e-9074-6275d848543c tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:29.632717 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-84e16404-4f05-491e-9074-6275d848543c tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:29.633266 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-84e16404-4f05-491e-9074-6275d848543c tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:29.777767 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-84e16404-4f05-491e-9074-6275d848543c tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4aec5af742842f5bb2048c8b7d60687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829069b2787a423f922fcc5b5702f167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:29.786640 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-84e16404-4f05-491e-9074-6275d848543c tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] 10.222.0.43 "GET /compute/v2.1/servers/bcc13e2d-03e7-464d-abac-f5ffb7cbb509" status: 200 len: 1468 microversion: 2.1 time: 0.167853 Oct 04 18:34:29.787234 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 472/889] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:29 2022] GET /compute/v2.1/servers/bcc13e2d-03e7-464d-abac-f5ffb7cbb509 => generated 1468 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:29.792100 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-b891a65d-c93e-47e4-bc2c-49e9cbb07f2b tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:29.792703 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-b891a65d-c93e-47e4-bc2c-49e9cbb07f2b tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] [instance: 84e0414b-a39f-4bfe-bc9d-c170ceb34d15] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:29.807526 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b891a65d-c93e-47e4-bc2c-49e9cbb07f2b tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:29.807944 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b891a65d-c93e-47e4-bc2c-49e9cbb07f2b tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:29.808396 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b891a65d-c93e-47e4-bc2c-49e9cbb07f2b tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:29.809134 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b891a65d-c93e-47e4-bc2c-49e9cbb07f2b tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:29.809825 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b891a65d-c93e-47e4-bc2c-49e9cbb07f2b tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:29.810259 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b891a65d-c93e-47e4-bc2c-49e9cbb07f2b tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:29.901288 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-b891a65d-c93e-47e4-bc2c-49e9cbb07f2b tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:29.912174 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-b891a65d-c93e-47e4-bc2c-49e9cbb07f2b tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:29.914206 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-b891a65d-c93e-47e4-bc2c-49e9cbb07f2b tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:29.919923 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-b891a65d-c93e-47e4-bc2c-49e9cbb07f2b tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] 10.222.0.43 "GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15" status: 200 len: 1544 microversion: 2.91 time: 0.131479 Oct 04 18:34:29.920557 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 473/890] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:34:29 2022] GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15 => generated 1544 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:34:29.941811 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-ae8b1d1b-58ff-4989-ae1c-717b23ccbde4 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:29.942318 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-ae8b1d1b-58ff-4989-ae1c-717b23ccbde4 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] [instance: 533db4f5-5f62-47ab-9d4c-5e5a95c0b756] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:29.948643 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ae8b1d1b-58ff-4989-ae1c-717b23ccbde4 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:29.949072 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ae8b1d1b-58ff-4989-ae1c-717b23ccbde4 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:29.949543 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ae8b1d1b-58ff-4989-ae1c-717b23ccbde4 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:29.950244 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ae8b1d1b-58ff-4989-ae1c-717b23ccbde4 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:29.950729 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ae8b1d1b-58ff-4989-ae1c-717b23ccbde4 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:29.951153 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ae8b1d1b-58ff-4989-ae1c-717b23ccbde4 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:29.980828 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-ae8b1d1b-58ff-4989-ae1c-717b23ccbde4 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] [instance: 533db4f5-5f62-47ab-9d4c-5e5a95c0b756] Going to try to terminate instance {{(pid=123596) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:34:30.070450 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-ae8b1d1b-58ff-4989-ae1c-717b23ccbde4 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] 10.222.0.43 "DELETE /compute/v2.1/servers/533db4f5-5f62-47ab-9d4c-5e5a95c0b756" status: 204 len: 0 microversion: 2.1 time: 0.148293 Oct 04 18:34:30.071173 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 474/891] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 18:34:29 2022] DELETE /compute/v2.1/servers/533db4f5-5f62-47ab-9d4c-5e5a95c0b756 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:34:30.077147 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-10ffb0b9-2e2b-44dd-b3e1-cc2ffa44ed12 tempest-LiveMigrationNegativeTest-828398147 tempest-LiveMigrationNegativeTest-828398147-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:34:30.078235 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-10ffb0b9-2e2b-44dd-b3e1-cc2ffa44ed12 tempest-LiveMigrationNegativeTest-828398147 tempest-LiveMigrationNegativeTest-828398147-project-admin] [instance: bcc13e2d-03e7-464d-abac-f5ffb7cbb509] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:30.087075 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-10ffb0b9-2e2b-44dd-b3e1-cc2ffa44ed12 tempest-LiveMigrationNegativeTest-828398147 tempest-LiveMigrationNegativeTest-828398147-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:30.087175 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-10ffb0b9-2e2b-44dd-b3e1-cc2ffa44ed12 tempest-LiveMigrationNegativeTest-828398147 tempest-LiveMigrationNegativeTest-828398147-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:30.087634 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-10ffb0b9-2e2b-44dd-b3e1-cc2ffa44ed12 tempest-LiveMigrationNegativeTest-828398147 tempest-LiveMigrationNegativeTest-828398147-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:30.088466 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-10ffb0b9-2e2b-44dd-b3e1-cc2ffa44ed12 tempest-LiveMigrationNegativeTest-828398147 tempest-LiveMigrationNegativeTest-828398147-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:30.105308 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-10ffb0b9-2e2b-44dd-b3e1-cc2ffa44ed12 tempest-LiveMigrationNegativeTest-828398147 tempest-LiveMigrationNegativeTest-828398147-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:30.109078 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-10ffb0b9-2e2b-44dd-b3e1-cc2ffa44ed12 tempest-LiveMigrationNegativeTest-828398147 tempest-LiveMigrationNegativeTest-828398147-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:30.183728 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.objects.instance [None req-10ffb0b9-2e2b-44dd-b3e1-cc2ffa44ed12 tempest-LiveMigrationNegativeTest-828398147 tempest-LiveMigrationNegativeTest-828398147-project-admin] Lazy-loading 'flavor' on Instance uuid bcc13e2d-03e7-464d-abac-f5ffb7cbb509 {{(pid=123596) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:34:30.269711 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-10ffb0b9-2e2b-44dd-b3e1-cc2ffa44ed12 tempest-LiveMigrationNegativeTest-828398147 tempest-LiveMigrationNegativeTest-828398147-project-admin] 10.222.0.43 "POST /compute/v2.1/servers/bcc13e2d-03e7-464d-abac-f5ffb7cbb509/action" status: 202 len: 0 microversion: 2.1 time: 0.196845 Oct 04 18:34:30.270410 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 475/892] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 18:34:30 2022] POST /compute/v2.1/servers/bcc13e2d-03e7-464d-abac-f5ffb7cbb509/action => generated 0 bytes in 198 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:34:30.275622 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-3363edf9-4daa-4efb-b657-0b730316f50b req-cfbff507-c6de-41a1-98f0-b282088a1337 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb05639b-cd53-4c27-9505-20e668a16acc", "tag": "1ffe1dcb-316b-4423-ae6b-6882dba87be0"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:34:30.286270 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-3363edf9-4daa-4efb-b657-0b730316f50b req-cfbff507-c6de-41a1-98f0-b282088a1337 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:30.286834 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-3363edf9-4daa-4efb-b657-0b730316f50b req-cfbff507-c6de-41a1-98f0-b282088a1337 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:30.287341 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-3363edf9-4daa-4efb-b657-0b730316f50b req-cfbff507-c6de-41a1-98f0-b282088a1337 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:30.297073 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:34:30.300187 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-3363edf9-4daa-4efb-b657-0b730316f50b req-cfbff507-c6de-41a1-98f0-b282088a1337 service nova] Creating event network-changed:1ffe1dcb-316b-4423-ae6b-6882dba87be0 for instance eb05639b-cd53-4c27-9505-20e668a16acc on n-h2-851028-13 Oct 04 18:34:30.305067 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-3363edf9-4daa-4efb-b657-0b730316f50b req-cfbff507-c6de-41a1-98f0-b282088a1337 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033175 Oct 04 18:34:30.305952 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 476/893] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:34:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:34:30.311832 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-d2a03f2d-d949-47bf-90bd-8bb3f4caad07 tempest-ServersWithSpecificFlavorTestJSON-952303503 tempest-ServersWithSpecificFlavorTestJSON-952303503-project-admin] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:30.330684 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-d2a03f2d-d949-47bf-90bd-8bb3f4caad07 tempest-ServersWithSpecificFlavorTestJSON-952303503 tempest-ServersWithSpecificFlavorTestJSON-952303503-project-admin] 10.222.0.43 "DELETE /compute/v2.1/flavors/312702730" status: 202 len: 0 microversion: 2.1 time: 0.023628 Oct 04 18:34:30.331264 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 477/894] 10.222.0.43 () {58 vars in 1158 bytes} [Tue Oct 4 18:34:30 2022] DELETE /compute/v2.1/flavors/312702730 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:34:30.336726 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-3e97b5f1-9563-42b5-8096-1ffa03942ca7 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1648497441", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452", "networks": [{"uuid": "8427bdfe-80f6-4509-a949-365d3d4b4e33"}]}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:34:30.393950 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.network.neutron [None req-3e97b5f1-9563-42b5-8096-1ffa03942ca7 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] validate_networks() for [('8427bdfe-80f6-4509-a949-365d3d4b4e33', None, None, None, None, None)] {{(pid=123596) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:34:30.855570 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-3e97b5f1-9563-42b5-8096-1ffa03942ca7 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Flavor limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:34:30.857516 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-3e97b5f1-9563-42b5-8096-1ffa03942ca7 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Image limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:34:30.858249 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-3e97b5f1-9563-42b5-8096-1ffa03942ca7 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Flavor pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:34:30.858859 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-3e97b5f1-9563-42b5-8096-1ffa03942ca7 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Image pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:34:30.859801 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-3e97b5f1-9563-42b5-8096-1ffa03942ca7 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:34:30.870985 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3e97b5f1-9563-42b5-8096-1ffa03942ca7 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:30.871755 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3e97b5f1-9563-42b5-8096-1ffa03942ca7 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:30.872394 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3e97b5f1-9563-42b5-8096-1ffa03942ca7 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:30.873433 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3e97b5f1-9563-42b5-8096-1ffa03942ca7 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:30.874065 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3e97b5f1-9563-42b5-8096-1ffa03942ca7 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:30.874669 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3e97b5f1-9563-42b5-8096-1ffa03942ca7 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:30.900573 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-3e97b5f1-9563-42b5-8096-1ffa03942ca7 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Getting quotas for project 4fa31ed92017490a82497c7b8910aef0. Resources: {'ram', 'cores', 'instances'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:34:30.905791 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-3e97b5f1-9563-42b5-8096-1ffa03942ca7 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Getting quotas for user 5a41ab6fb78a42ceaca621c5a38ffc6d and project 4fa31ed92017490a82497c7b8910aef0. Resources: {'ram', 'cores', 'instances'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:34:30.920234 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-3e97b5f1-9563-42b5-8096-1ffa03942ca7 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Going to run 1 instances... {{(pid=123596) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:34:30.923028 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-3e97b5f1-9563-42b5-8096-1ffa03942ca7 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] [instance: 93798a9a-d90d-4a4e-8e30-d6575486ff56] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e8943ec5-4038-4d4b-b9b9-2415a79f5243',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123596) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:34:30.974604 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-3e97b5f1-9563-42b5-8096-1ffa03942ca7 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.642263 Oct 04 18:34:30.975642 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 478/895] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 18:34:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 644 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:34:30.982038 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-8eca4d29-1a29-4eeb-a920-b84081d3a3e8 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:30.982796 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-8eca4d29-1a29-4eeb-a920-b84081d3a3e8 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] [instance: bcc13e2d-03e7-464d-abac-f5ffb7cbb509] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:30.989444 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8eca4d29-1a29-4eeb-a920-b84081d3a3e8 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:30.990084 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8eca4d29-1a29-4eeb-a920-b84081d3a3e8 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:30.990656 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8eca4d29-1a29-4eeb-a920-b84081d3a3e8 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:30.991452 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8eca4d29-1a29-4eeb-a920-b84081d3a3e8 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:30.992111 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8eca4d29-1a29-4eeb-a920-b84081d3a3e8 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:30.992723 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8eca4d29-1a29-4eeb-a920-b84081d3a3e8 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:31.208222 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-8eca4d29-1a29-4eeb-a920-b84081d3a3e8 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4aec5af742842f5bb2048c8b7d60687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829069b2787a423f922fcc5b5702f167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:31.220387 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-8eca4d29-1a29-4eeb-a920-b84081d3a3e8 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] 10.222.0.43 "GET /compute/v2.1/servers/bcc13e2d-03e7-464d-abac-f5ffb7cbb509" status: 200 len: 1476 microversion: 2.1 time: 0.243601 Oct 04 18:34:31.221537 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 479/896] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:30 2022] GET /compute/v2.1/servers/bcc13e2d-03e7-464d-abac-f5ffb7cbb509 => generated 1476 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:31.226184 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-ee5f4870-29f6-4eca-a766-ba5b554f34fc tempest-ServersWithSpecificFlavorTestJSON-952303503 tempest-ServersWithSpecificFlavorTestJSON-952303503-project-admin] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:31.261571 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-ee5f4870-29f6-4eca-a766-ba5b554f34fc tempest-ServersWithSpecificFlavorTestJSON-952303503 tempest-ServersWithSpecificFlavorTestJSON-952303503-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 5406 microversion: 2.1 time: 0.038478 Oct 04 18:34:31.276938 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 480/897] 10.222.0.43 () {58 vars in 1146 bytes} [Tue Oct 4 18:34:31 2022] GET /compute/v2.1/flavors/detail => generated 5406 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:31.282968 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-04d449e2-c89b-4a08-bdce-1d741f6d27ec tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:31.283634 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-04d449e2-c89b-4a08-bdce-1d741f6d27ec tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] [instance: 8408d8e1-41b0-4185-8806-9808f082a016] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:31.290756 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-04d449e2-c89b-4a08-bdce-1d741f6d27ec tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:31.291256 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-04d449e2-c89b-4a08-bdce-1d741f6d27ec tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:31.292513 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-04d449e2-c89b-4a08-bdce-1d741f6d27ec tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:31.294079 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-04d449e2-c89b-4a08-bdce-1d741f6d27ec tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:31.294637 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-04d449e2-c89b-4a08-bdce-1d741f6d27ec tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:31.295342 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-04d449e2-c89b-4a08-bdce-1d741f6d27ec tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:31.507542 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-04d449e2-c89b-4a08-bdce-1d741f6d27ec tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7db99f361654711bea7f1b2c404d312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7adedcdb9c3485ea2738c00e25aa3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:31.525583 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-04d449e2-c89b-4a08-bdce-1d741f6d27ec tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] 10.222.0.43 "GET /compute/v2.1/servers/8408d8e1-41b0-4185-8806-9808f082a016" status: 200 len: 1472 microversion: 2.1 time: 0.260256 Oct 04 18:34:31.526350 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 481/898] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:31 2022] GET /compute/v2.1/servers/8408d8e1-41b0-4185-8806-9808f082a016 => generated 1472 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:31.538774 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-da28e452-03c3-45da-932e-e24ef6aa9a3d tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:31.541632 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-da28e452-03c3-45da-932e-e24ef6aa9a3d tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] [instance: eb05639b-cd53-4c27-9505-20e668a16acc] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:31.555701 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-da28e452-03c3-45da-932e-e24ef6aa9a3d tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:31.558070 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-da28e452-03c3-45da-932e-e24ef6aa9a3d tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:31.559012 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-da28e452-03c3-45da-932e-e24ef6aa9a3d tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:31.560740 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-da28e452-03c3-45da-932e-e24ef6aa9a3d tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:31.564867 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-da28e452-03c3-45da-932e-e24ef6aa9a3d tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:31.568064 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-da28e452-03c3-45da-932e-e24ef6aa9a3d tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:31.788750 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-da28e452-03c3-45da-932e-e24ef6aa9a3d tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64887fff0bc7417094c4fee2f7e9aa5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6187bfad04cb7bc17155862ee0cdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:31.800646 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-da28e452-03c3-45da-932e-e24ef6aa9a3d tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] 10.222.0.43 "GET /compute/v2.1/servers/eb05639b-cd53-4c27-9505-20e668a16acc" status: 200 len: 1365 microversion: 2.1 time: 0.273124 Oct 04 18:34:31.801259 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 482/899] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:31 2022] GET /compute/v2.1/servers/eb05639b-cd53-4c27-9505-20e668a16acc => generated 1365 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:31.807045 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-60b47b5e-2d91-4467-8ca8-3becf0f15af2 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:31.807829 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-60b47b5e-2d91-4467-8ca8-3becf0f15af2 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] [instance: 84e0414b-a39f-4bfe-bc9d-c170ceb34d15] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:31.814335 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-60b47b5e-2d91-4467-8ca8-3becf0f15af2 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:31.815609 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-60b47b5e-2d91-4467-8ca8-3becf0f15af2 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:31.816312 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-60b47b5e-2d91-4467-8ca8-3becf0f15af2 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:31.817921 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-60b47b5e-2d91-4467-8ca8-3becf0f15af2 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:31.818556 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-60b47b5e-2d91-4467-8ca8-3becf0f15af2 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:31.819138 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-60b47b5e-2d91-4467-8ca8-3becf0f15af2 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:31.914337 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-60b47b5e-2d91-4467-8ca8-3becf0f15af2 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:31.923876 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-60b47b5e-2d91-4467-8ca8-3becf0f15af2 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:31.925727 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-60b47b5e-2d91-4467-8ca8-3becf0f15af2 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:31.932088 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-60b47b5e-2d91-4467-8ca8-3becf0f15af2 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] 10.222.0.43 "GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15" status: 200 len: 1544 microversion: 2.91 time: 0.129246 Oct 04 18:34:31.943531 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 483/900] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:34:31 2022] GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15 => generated 1544 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:34:31.951635 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-35555736-fff1-4c7c-9d6e-2e1decdc71c6 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:31.952268 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-35555736-fff1-4c7c-9d6e-2e1decdc71c6 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] [instance: 93798a9a-d90d-4a4e-8e30-d6575486ff56] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:31.971253 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-35555736-fff1-4c7c-9d6e-2e1decdc71c6 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:31.971751 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-35555736-fff1-4c7c-9d6e-2e1decdc71c6 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:31.974359 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-35555736-fff1-4c7c-9d6e-2e1decdc71c6 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:31.975681 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-35555736-fff1-4c7c-9d6e-2e1decdc71c6 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:31.978641 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-35555736-fff1-4c7c-9d6e-2e1decdc71c6 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:31.979473 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-35555736-fff1-4c7c-9d6e-2e1decdc71c6 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:32.071295 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-35555736-fff1-4c7c-9d6e-2e1decdc71c6 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a41ab6fb78a42ceaca621c5a38ffc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa31ed92017490a82497c7b8910aef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:32.080171 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-35555736-fff1-4c7c-9d6e-2e1decdc71c6 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] 10.222.0.43 "GET /compute/v2.1/servers/93798a9a-d90d-4a4e-8e30-d6575486ff56" status: 200 len: 1204 microversion: 2.1 time: 0.135267 Oct 04 18:34:32.080749 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 484/901] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:31 2022] GET /compute/v2.1/servers/93798a9a-d90d-4a4e-8e30-d6575486ff56 => generated 1204 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:32.096057 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-e2bc357d-46b8-4c12-ae86-0247330c0e8d tempest-ServersWithSpecificFlavorTestJSON-952303503 tempest-ServersWithSpecificFlavorTestJSON-952303503-project-admin] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:32.102560 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=2,nova_api:DELETE=5,nova_api:INSERT=3 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:34:32.116766 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-e2bc357d-46b8-4c12-ae86-0247330c0e8d tempest-ServersWithSpecificFlavorTestJSON-952303503 tempest-ServersWithSpecificFlavorTestJSON-952303503-project-admin] 10.222.0.43 "DELETE /compute/v2.1/flavors/1259901898" status: 202 len: 0 microversion: 2.1 time: 0.034461 Oct 04 18:34:32.117419 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 485/902] 10.222.0.43 () {58 vars in 1161 bytes} [Tue Oct 4 18:34:32 2022] DELETE /compute/v2.1/flavors/1259901898 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:34:32.123035 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-1c9e150a-ab44-4a89-8f33-f7c1300ef587 req-c2bb4d14-40b1-441e-9bc9-8bd1e12073e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "533db4f5-5f62-47ab-9d4c-5e5a95c0b756", "name": "network-vif-unplugged", "status": "completed", "tag": "9dc10a12-f514-49cb-8d56-3dda7855de52"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:34:32.142487 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-1c9e150a-ab44-4a89-8f33-f7c1300ef587 req-c2bb4d14-40b1-441e-9bc9-8bd1e12073e4 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:32.142968 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-1c9e150a-ab44-4a89-8f33-f7c1300ef587 req-c2bb4d14-40b1-441e-9bc9-8bd1e12073e4 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:32.143562 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-1c9e150a-ab44-4a89-8f33-f7c1300ef587 req-c2bb4d14-40b1-441e-9bc9-8bd1e12073e4 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:32.157084 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-1c9e150a-ab44-4a89-8f33-f7c1300ef587 req-c2bb4d14-40b1-441e-9bc9-8bd1e12073e4 service nova] Creating event network-vif-unplugged:9dc10a12-f514-49cb-8d56-3dda7855de52 for instance 533db4f5-5f62-47ab-9d4c-5e5a95c0b756 on n-h2-851028-13 Oct 04 18:34:32.162352 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-1c9e150a-ab44-4a89-8f33-f7c1300ef587 req-c2bb4d14-40b1-441e-9bc9-8bd1e12073e4 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043521 Oct 04 18:34:32.163073 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 486/903] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:34:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:34:32.168563 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-c57a90f4-ec8f-41c1-b700-04dd8b0f4a54 tempest-ServersWithSpecificFlavorTestJSON-952303503 tempest-ServersWithSpecificFlavorTestJSON-952303503-project-admin] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:32.193407 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-c57a90f4-ec8f-41c1-b700-04dd8b0f4a54 tempest-ServersWithSpecificFlavorTestJSON-952303503 tempest-ServersWithSpecificFlavorTestJSON-952303503-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.028792 Oct 04 18:34:32.194661 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 487/904] 10.222.0.43 () {58 vars in 1146 bytes} [Tue Oct 4 18:34:32 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:32.223166 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-abc41e7b-4de9-47f6-a4de-dc483ff17e1d tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:32.223874 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-abc41e7b-4de9-47f6-a4de-dc483ff17e1d tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] [instance: fbe51dae-877b-4377-9f23-9a129775c317] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:32.230389 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-abc41e7b-4de9-47f6-a4de-dc483ff17e1d tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:32.231129 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-abc41e7b-4de9-47f6-a4de-dc483ff17e1d tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:32.231812 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-abc41e7b-4de9-47f6-a4de-dc483ff17e1d tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:32.232724 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-abc41e7b-4de9-47f6-a4de-dc483ff17e1d tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:32.233396 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-abc41e7b-4de9-47f6-a4de-dc483ff17e1d tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:32.234026 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-abc41e7b-4de9-47f6-a4de-dc483ff17e1d tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:32.251274 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-abc41e7b-4de9-47f6-a4de-dc483ff17e1d tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] HTTP exception thrown: Instance fbe51dae-877b-4377-9f23-9a129775c317 could not be found. Oct 04 18:34:32.253812 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-abc41e7b-4de9-47f6-a4de-dc483ff17e1d tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Request method failure captured: Oct 04 18:34:32.253812 n-d-851028-13 devstack@n-api.service[123596]: request: DELETE /compute/v2.1/servers/fbe51dae-877b-4377-9f23-9a129775c317 HTTP/1.1 Oct 04 18:34:32.253812 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:34:32.253812 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:34:32.253812 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:34:32.253812 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 18:34:32.253812 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:34:32.253812 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:34:32.253812 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:34:32.253812 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:34:32.253812 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPHv2QQ3jzxK9bNushSTjp6y8Xo_it4ckq6ryRr5sK1e_bJBDmtF5jD03bM5zBSKI8NSKKQpHL-7xQlPXmN7q0fPNd57nBsnZXwjWsBIHh2WvlKt97iHPsqXESK9N4v7QO3iJ_YD2Lzbp5kqM8RoMW4mG2F8iwe8qrJahQt83Rp6TVCw Oct 04 18:34:32.253812 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:34:32.253812 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:34:32.253812 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:34:32.253812 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:34:32.253812 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:34:32.253812 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:34:32.253812 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: 82c615a05e8a4cd086f2e580529fb1d4 Oct 04 18:34:32.253812 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-956674611 Oct 04 18:34:32.253812 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 18:34:32.253812 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 18:34:32.253812 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/82c615a05e8a4cd086f2e580529fb1d4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_82c615a05e8a4cd086f2e580529fb1d4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/82c615a05e8a4cd086f2e580529fb1d4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/82c615a05e8a4cd086f2e580529fb1d4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:34:32.253812 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-956674611 Oct 04 18:34:32.253812 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: 82c615a05e8a4cd086f2e580529fb1d4 Oct 04 18:34:32.253812 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-956674611 Oct 04 18:34:32.253812 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-ServersWithSpecificFlavorTestJSON-956674611-project Oct 04 18:34:32.253812 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:34:32.253812 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:34:32.253812 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: f8ea2088d8124b149187a1c140d3be88 Oct 04 18:34:32.253812 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-956674611-project Oct 04 18:34:32.253812 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 18:34:32.253812 n-d-851028-13 devstack@n-api.service[123596]: exception: Instance fbe51dae-877b-4377-9f23-9a129775c317 could not be found. Oct 04 18:34:32.253812 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': 'fbe51dae-877b-4377-9f23-9a129775c317'} Oct 04 18:34:32.253812 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:34:32.253812 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:34:32.253812 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:34:32.253812 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:34:32.253812 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:34:32.253812 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:34:32.253812 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:34:32.253812 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:34:32.253812 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:34:32.253812 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:34:32.253812 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fbe51dae-877b-4377-9f23-9a129775c317 could not be found. Oct 04 18:34:32.253812 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:34:32.253812 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:34:32.253812 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:34:32.253812 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:34:32.253812 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:34:32.253812 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:34:32.253812 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:34:32.253812 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:34:32.253812 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:34:32.253812 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:34:32.253812 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:34:32.253812 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:34:32.253812 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:34:32.253812 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:34:32.253812 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:34:32.253812 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:34:32.253812 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:34:32.253812 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:34:32.257606 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fbe51dae-877b-4377-9f23-9a129775c317 could not be found. Oct 04 18:34:32.257606 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:34:32.257606 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:34:32.257606 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:34:32.257606 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:34:32.257606 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:34:32.257606 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:34:32.257606 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:34:32.257606 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:34:32.257606 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fbe51dae-877b-4377-9f23-9a129775c317 could not be found. Oct 04 18:34:32.257606 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:34:32.257606 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-abc41e7b-4de9-47f6-a4de-dc483ff17e1d tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Returning 404 to user: Instance fbe51dae-877b-4377-9f23-9a129775c317 could not be found. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:34:32.257606 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-abc41e7b-4de9-47f6-a4de-dc483ff17e1d tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] 10.222.0.43 "DELETE /compute/v2.1/servers/fbe51dae-877b-4377-9f23-9a129775c317" status: 404 len: 111 microversion: 2.1 time: 0.036081 Oct 04 18:34:32.257606 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 488/905] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 18:34:32 2022] DELETE /compute/v2.1/servers/fbe51dae-877b-4377-9f23-9a129775c317 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:34:32.260231 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-a9b4a8be-a62e-462c-b4a8-0788cdb2a064 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:32.260846 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-a9b4a8be-a62e-462c-b4a8-0788cdb2a064 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] [instance: bcc13e2d-03e7-464d-abac-f5ffb7cbb509] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:32.266965 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a9b4a8be-a62e-462c-b4a8-0788cdb2a064 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:32.267429 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a9b4a8be-a62e-462c-b4a8-0788cdb2a064 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:32.267869 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a9b4a8be-a62e-462c-b4a8-0788cdb2a064 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:32.268575 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a9b4a8be-a62e-462c-b4a8-0788cdb2a064 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:32.269034 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a9b4a8be-a62e-462c-b4a8-0788cdb2a064 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:32.269488 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a9b4a8be-a62e-462c-b4a8-0788cdb2a064 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:32.423580 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-a9b4a8be-a62e-462c-b4a8-0788cdb2a064 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4aec5af742842f5bb2048c8b7d60687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829069b2787a423f922fcc5b5702f167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:32.432444 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-a9b4a8be-a62e-462c-b4a8-0788cdb2a064 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] 10.222.0.43 "GET /compute/v2.1/servers/bcc13e2d-03e7-464d-abac-f5ffb7cbb509" status: 200 len: 1476 microversion: 2.1 time: 0.175665 Oct 04 18:34:32.433028 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 489/906] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:32 2022] GET /compute/v2.1/servers/bcc13e2d-03e7-464d-abac-f5ffb7cbb509 => generated 1476 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:32.438473 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-dbbec2b3-9698-4896-b99a-c20680536bb7 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:32.439749 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-dbbec2b3-9698-4896-b99a-c20680536bb7 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] [instance: fbe51dae-877b-4377-9f23-9a129775c317] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:32.448241 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dbbec2b3-9698-4896-b99a-c20680536bb7 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:32.448931 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dbbec2b3-9698-4896-b99a-c20680536bb7 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:32.450392 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dbbec2b3-9698-4896-b99a-c20680536bb7 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:32.451183 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dbbec2b3-9698-4896-b99a-c20680536bb7 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:32.452208 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dbbec2b3-9698-4896-b99a-c20680536bb7 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:32.452662 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dbbec2b3-9698-4896-b99a-c20680536bb7 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:32.468420 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-dbbec2b3-9698-4896-b99a-c20680536bb7 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] HTTP exception thrown: Instance fbe51dae-877b-4377-9f23-9a129775c317 could not be found. Oct 04 18:34:32.470254 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-dbbec2b3-9698-4896-b99a-c20680536bb7 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Request method failure captured: Oct 04 18:34:32.470254 n-d-851028-13 devstack@n-api.service[123596]: request: GET /compute/v2.1/servers/fbe51dae-877b-4377-9f23-9a129775c317 HTTP/1.1 Oct 04 18:34:32.470254 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:34:32.470254 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:34:32.470254 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:34:32.470254 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 18:34:32.470254 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:34:32.470254 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:34:32.470254 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:34:32.470254 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:34:32.470254 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPHv2QQ3jzxK9bNushSTjp6y8Xo_it4ckq6ryRr5sK1e_bJBDmtF5jD03bM5zBSKI8NSKKQpHL-7xQlPXmN7q0fPNd57nBsnZXwjWsBIHh2WvlKt97iHPsqXESK9N4v7QO3iJ_YD2Lzbp5kqM8RoMW4mG2F8iwe8qrJahQt83Rp6TVCw Oct 04 18:34:32.470254 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:34:32.470254 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:34:32.470254 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:34:32.470254 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:34:32.470254 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:34:32.470254 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:34:32.470254 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: 82c615a05e8a4cd086f2e580529fb1d4 Oct 04 18:34:32.470254 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-956674611 Oct 04 18:34:32.470254 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 18:34:32.470254 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 18:34:32.470254 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/82c615a05e8a4cd086f2e580529fb1d4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_82c615a05e8a4cd086f2e580529fb1d4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/82c615a05e8a4cd086f2e580529fb1d4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/82c615a05e8a4cd086f2e580529fb1d4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:34:32.470254 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-956674611 Oct 04 18:34:32.470254 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: 82c615a05e8a4cd086f2e580529fb1d4 Oct 04 18:34:32.470254 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-956674611 Oct 04 18:34:32.470254 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-ServersWithSpecificFlavorTestJSON-956674611-project Oct 04 18:34:32.470254 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:34:32.470254 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:34:32.470254 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: f8ea2088d8124b149187a1c140d3be88 Oct 04 18:34:32.470254 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-956674611-project Oct 04 18:34:32.470254 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 18:34:32.470254 n-d-851028-13 devstack@n-api.service[123596]: exception: Instance fbe51dae-877b-4377-9f23-9a129775c317 could not be found. Oct 04 18:34:32.470254 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': 'fbe51dae-877b-4377-9f23-9a129775c317'} Oct 04 18:34:32.470254 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:34:32.470254 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:34:32.470254 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:34:32.470254 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:34:32.470254 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:34:32.470254 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:34:32.470254 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:34:32.470254 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:34:32.470254 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:34:32.470254 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:34:32.470254 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fbe51dae-877b-4377-9f23-9a129775c317 could not be found. Oct 04 18:34:32.470254 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:34:32.470254 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:34:32.470254 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:34:32.470254 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:34:32.470254 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:34:32.470254 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:34:32.470254 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:34:32.470254 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:34:32.470254 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:34:32.470254 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:34:32.470254 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:34:32.470254 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:34:32.470254 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:34:32.470254 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:34:32.470254 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:34:32.470254 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:34:32.470254 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fbe51dae-877b-4377-9f23-9a129775c317 could not be found. Oct 04 18:34:32.470254 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:34:32.470254 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:34:32.474912 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:34:32.474912 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:34:32.474912 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:34:32.474912 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:34:32.474912 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:34:32.474912 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:34:32.474912 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fbe51dae-877b-4377-9f23-9a129775c317 could not be found. Oct 04 18:34:32.474912 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:34:32.476774 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-dbbec2b3-9698-4896-b99a-c20680536bb7 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Returning 404 to user: Instance fbe51dae-877b-4377-9f23-9a129775c317 could not be found. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:34:32.479588 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-dbbec2b3-9698-4896-b99a-c20680536bb7 tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] 10.222.0.43 "GET /compute/v2.1/servers/fbe51dae-877b-4377-9f23-9a129775c317" status: 404 len: 111 microversion: 2.1 time: 0.043892 Oct 04 18:34:32.480540 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 490/907] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:32 2022] GET /compute/v2.1/servers/fbe51dae-877b-4377-9f23-9a129775c317 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:34:32.488494 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-1dc1bf1a-11f1-4d86-9d1d-fb3dd1289bed tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:32.489010 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-1dc1bf1a-11f1-4d86-9d1d-fb3dd1289bed tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] [instance: 9b19b908-7870-477b-9be7-7d260d59b183] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:32.496569 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1dc1bf1a-11f1-4d86-9d1d-fb3dd1289bed tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:32.497102 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1dc1bf1a-11f1-4d86-9d1d-fb3dd1289bed tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:32.497587 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1dc1bf1a-11f1-4d86-9d1d-fb3dd1289bed tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:32.498319 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1dc1bf1a-11f1-4d86-9d1d-fb3dd1289bed tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:32.498773 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1dc1bf1a-11f1-4d86-9d1d-fb3dd1289bed tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:32.499355 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1dc1bf1a-11f1-4d86-9d1d-fb3dd1289bed tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:32.515759 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-1dc1bf1a-11f1-4d86-9d1d-fb3dd1289bed tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] HTTP exception thrown: Instance 9b19b908-7870-477b-9be7-7d260d59b183 could not be found. Oct 04 18:34:32.517926 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-1dc1bf1a-11f1-4d86-9d1d-fb3dd1289bed tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Request method failure captured: Oct 04 18:34:32.517926 n-d-851028-13 devstack@n-api.service[123596]: request: DELETE /compute/v2.1/servers/9b19b908-7870-477b-9be7-7d260d59b183 HTTP/1.1 Oct 04 18:34:32.517926 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:34:32.517926 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:34:32.517926 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:34:32.517926 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 18:34:32.517926 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:34:32.517926 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:34:32.517926 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:34:32.517926 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:34:32.517926 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPHv2QQ3jzxK9bNushSTjp6y8Xo_it4ckq6ryRr5sK1e_bJBDmtF5jD03bM5zBSKI8NSKKQpHL-7xQlPXmN7q0fPNd57nBsnZXwjWsBIHh2WvlKt97iHPsqXESK9N4v7QO3iJ_YD2Lzbp5kqM8RoMW4mG2F8iwe8qrJahQt83Rp6TVCw Oct 04 18:34:32.517926 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:34:32.517926 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:34:32.517926 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:34:32.517926 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:34:32.517926 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:34:32.517926 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:34:32.517926 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: 82c615a05e8a4cd086f2e580529fb1d4 Oct 04 18:34:32.517926 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-956674611 Oct 04 18:34:32.517926 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 18:34:32.517926 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 18:34:32.517926 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/82c615a05e8a4cd086f2e580529fb1d4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_82c615a05e8a4cd086f2e580529fb1d4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/82c615a05e8a4cd086f2e580529fb1d4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/82c615a05e8a4cd086f2e580529fb1d4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:34:32.517926 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-956674611 Oct 04 18:34:32.517926 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: 82c615a05e8a4cd086f2e580529fb1d4 Oct 04 18:34:32.517926 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-956674611 Oct 04 18:34:32.517926 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-ServersWithSpecificFlavorTestJSON-956674611-project Oct 04 18:34:32.517926 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:34:32.517926 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:34:32.517926 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: f8ea2088d8124b149187a1c140d3be88 Oct 04 18:34:32.517926 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-956674611-project Oct 04 18:34:32.517926 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 18:34:32.517926 n-d-851028-13 devstack@n-api.service[123596]: exception: Instance 9b19b908-7870-477b-9be7-7d260d59b183 could not be found. Oct 04 18:34:32.517926 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': '9b19b908-7870-477b-9be7-7d260d59b183'} Oct 04 18:34:32.517926 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:34:32.517926 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:34:32.517926 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:34:32.517926 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:34:32.517926 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:34:32.517926 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:34:32.517926 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:34:32.517926 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:34:32.517926 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:34:32.517926 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:34:32.517926 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b19b908-7870-477b-9be7-7d260d59b183 could not be found. Oct 04 18:34:32.517926 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:34:32.517926 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:34:32.517926 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:34:32.517926 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:34:32.517926 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:34:32.517926 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:34:32.517926 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:34:32.517926 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:34:32.517926 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:34:32.517926 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:34:32.517926 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:34:32.517926 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:34:32.517926 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:34:32.517926 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:34:32.517926 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:34:32.517926 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:34:32.517926 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:34:32.517926 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:34:32.523400 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b19b908-7870-477b-9be7-7d260d59b183 could not be found. Oct 04 18:34:32.523400 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:34:32.523400 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:34:32.523400 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:34:32.523400 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:34:32.523400 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:34:32.523400 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:34:32.523400 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:34:32.523400 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:34:32.523400 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b19b908-7870-477b-9be7-7d260d59b183 could not be found. Oct 04 18:34:32.523400 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:34:32.523400 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-1dc1bf1a-11f1-4d86-9d1d-fb3dd1289bed tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Returning 404 to user: Instance 9b19b908-7870-477b-9be7-7d260d59b183 could not be found. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:34:32.523400 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-1dc1bf1a-11f1-4d86-9d1d-fb3dd1289bed tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] 10.222.0.43 "DELETE /compute/v2.1/servers/9b19b908-7870-477b-9be7-7d260d59b183" status: 404 len: 111 microversion: 2.1 time: 0.034797 Oct 04 18:34:32.523400 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 491/908] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 18:34:32 2022] DELETE /compute/v2.1/servers/9b19b908-7870-477b-9be7-7d260d59b183 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:34:32.528590 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-b905f745-4272-450a-a4c5-c5f0275734df tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:32.529253 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-b905f745-4272-450a-a4c5-c5f0275734df tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] [instance: 9b19b908-7870-477b-9be7-7d260d59b183] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:32.536318 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b905f745-4272-450a-a4c5-c5f0275734df tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:32.538015 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b905f745-4272-450a-a4c5-c5f0275734df tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:32.538471 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b905f745-4272-450a-a4c5-c5f0275734df tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:32.539199 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b905f745-4272-450a-a4c5-c5f0275734df tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:32.539660 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b905f745-4272-450a-a4c5-c5f0275734df tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:32.540089 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b905f745-4272-450a-a4c5-c5f0275734df tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:32.557232 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-b905f745-4272-450a-a4c5-c5f0275734df tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] HTTP exception thrown: Instance 9b19b908-7870-477b-9be7-7d260d59b183 could not be found. Oct 04 18:34:32.558742 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-b905f745-4272-450a-a4c5-c5f0275734df tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Request method failure captured: Oct 04 18:34:32.558742 n-d-851028-13 devstack@n-api.service[123596]: request: GET /compute/v2.1/servers/9b19b908-7870-477b-9be7-7d260d59b183 HTTP/1.1 Oct 04 18:34:32.558742 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:34:32.558742 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:34:32.558742 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:34:32.558742 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 18:34:32.558742 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:34:32.558742 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:34:32.558742 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:34:32.558742 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:34:32.558742 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPHv2QQ3jzxK9bNushSTjp6y8Xo_it4ckq6ryRr5sK1e_bJBDmtF5jD03bM5zBSKI8NSKKQpHL-7xQlPXmN7q0fPNd57nBsnZXwjWsBIHh2WvlKt97iHPsqXESK9N4v7QO3iJ_YD2Lzbp5kqM8RoMW4mG2F8iwe8qrJahQt83Rp6TVCw Oct 04 18:34:32.558742 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:34:32.558742 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:34:32.558742 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:34:32.558742 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:34:32.558742 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:34:32.558742 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:34:32.558742 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: 82c615a05e8a4cd086f2e580529fb1d4 Oct 04 18:34:32.558742 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-956674611 Oct 04 18:34:32.558742 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 18:34:32.558742 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 18:34:32.558742 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/82c615a05e8a4cd086f2e580529fb1d4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_82c615a05e8a4cd086f2e580529fb1d4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/82c615a05e8a4cd086f2e580529fb1d4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/82c615a05e8a4cd086f2e580529fb1d4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:34:32.558742 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-956674611 Oct 04 18:34:32.558742 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: 82c615a05e8a4cd086f2e580529fb1d4 Oct 04 18:34:32.558742 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-956674611 Oct 04 18:34:32.558742 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-ServersWithSpecificFlavorTestJSON-956674611-project Oct 04 18:34:32.558742 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:34:32.558742 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:34:32.558742 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: f8ea2088d8124b149187a1c140d3be88 Oct 04 18:34:32.558742 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-956674611-project Oct 04 18:34:32.558742 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 18:34:32.558742 n-d-851028-13 devstack@n-api.service[123596]: exception: Instance 9b19b908-7870-477b-9be7-7d260d59b183 could not be found. Oct 04 18:34:32.558742 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': '9b19b908-7870-477b-9be7-7d260d59b183'} Oct 04 18:34:32.558742 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:34:32.558742 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:34:32.558742 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:34:32.558742 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:34:32.558742 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:34:32.558742 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:34:32.558742 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:34:32.558742 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:34:32.558742 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:34:32.558742 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:34:32.558742 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b19b908-7870-477b-9be7-7d260d59b183 could not be found. Oct 04 18:34:32.558742 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:34:32.558742 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:34:32.558742 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:34:32.558742 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:34:32.558742 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:34:32.558742 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:34:32.558742 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:34:32.558742 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:34:32.558742 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:34:32.558742 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:34:32.558742 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:34:32.558742 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:34:32.558742 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:34:32.558742 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:34:32.558742 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:34:32.558742 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:34:32.558742 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b19b908-7870-477b-9be7-7d260d59b183 could not be found. Oct 04 18:34:32.558742 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:34:32.558742 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:34:32.563581 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:34:32.563581 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:34:32.563581 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:34:32.563581 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:34:32.563581 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:34:32.563581 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:34:32.563581 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b19b908-7870-477b-9be7-7d260d59b183 could not be found. Oct 04 18:34:32.563581 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:34:32.563581 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-b905f745-4272-450a-a4c5-c5f0275734df tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] Returning 404 to user: Instance 9b19b908-7870-477b-9be7-7d260d59b183 could not be found. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:34:32.563581 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-b905f745-4272-450a-a4c5-c5f0275734df tempest-ServersWithSpecificFlavorTestJSON-956674611 tempest-ServersWithSpecificFlavorTestJSON-956674611-project] 10.222.0.43 "GET /compute/v2.1/servers/9b19b908-7870-477b-9be7-7d260d59b183" status: 404 len: 111 microversion: 2.1 time: 0.035987 Oct 04 18:34:32.569300 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 492/909] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:32 2022] GET /compute/v2.1/servers/9b19b908-7870-477b-9be7-7d260d59b183 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:34:32.581451 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-fee56a7a-c375-4601-b3ce-86cead4c78cd tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:32.584523 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-fee56a7a-c375-4601-b3ce-86cead4c78cd tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] [instance: 8408d8e1-41b0-4185-8806-9808f082a016] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:32.591917 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fee56a7a-c375-4601-b3ce-86cead4c78cd tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:32.592720 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fee56a7a-c375-4601-b3ce-86cead4c78cd tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:32.593368 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fee56a7a-c375-4601-b3ce-86cead4c78cd tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:32.594306 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fee56a7a-c375-4601-b3ce-86cead4c78cd tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:32.594972 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fee56a7a-c375-4601-b3ce-86cead4c78cd tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:32.595565 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fee56a7a-c375-4601-b3ce-86cead4c78cd tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:32.980955 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=2 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:34:32.994376 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-fee56a7a-c375-4601-b3ce-86cead4c78cd tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7db99f361654711bea7f1b2c404d312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7adedcdb9c3485ea2738c00e25aa3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:32.997772 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=4 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:34:33.008283 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-fee56a7a-c375-4601-b3ce-86cead4c78cd tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] 10.222.0.43 "GET /compute/v2.1/servers/8408d8e1-41b0-4185-8806-9808f082a016" status: 200 len: 1472 microversion: 2.1 time: 0.431707 Oct 04 18:34:33.010541 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 493/910] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:32 2022] GET /compute/v2.1/servers/8408d8e1-41b0-4185-8806-9808f082a016 => generated 1472 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:33.015652 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-cf8f8d06-8a9d-4937-a942-37389564e7df tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:33.016269 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-cf8f8d06-8a9d-4937-a942-37389564e7df tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] [instance: eb05639b-cd53-4c27-9505-20e668a16acc] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:33.023215 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cf8f8d06-8a9d-4937-a942-37389564e7df tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:33.023878 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cf8f8d06-8a9d-4937-a942-37389564e7df tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:33.024324 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cf8f8d06-8a9d-4937-a942-37389564e7df tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:33.042175 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cf8f8d06-8a9d-4937-a942-37389564e7df tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:33.042786 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cf8f8d06-8a9d-4937-a942-37389564e7df tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:33.043244 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cf8f8d06-8a9d-4937-a942-37389564e7df tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:33.308568 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=1 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:34:33.353092 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-cf8f8d06-8a9d-4937-a942-37389564e7df tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64887fff0bc7417094c4fee2f7e9aa5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6187bfad04cb7bc17155862ee0cdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:33.374122 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-cf8f8d06-8a9d-4937-a942-37389564e7df tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] 10.222.0.43 "GET /compute/v2.1/servers/eb05639b-cd53-4c27-9505-20e668a16acc" status: 200 len: 1365 microversion: 2.1 time: 0.362226 Oct 04 18:34:33.383389 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:34:33.387817 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 494/911] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:33 2022] GET /compute/v2.1/servers/eb05639b-cd53-4c27-9505-20e668a16acc => generated 1365 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:33.400454 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-15d7b1f5-d1bb-42b5-babb-231f9532d850 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:33.401413 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-15d7b1f5-d1bb-42b5-babb-231f9532d850 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] [instance: 84e0414b-a39f-4bfe-bc9d-c170ceb34d15] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:33.409364 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-15d7b1f5-d1bb-42b5-babb-231f9532d850 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:33.411864 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-15d7b1f5-d1bb-42b5-babb-231f9532d850 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:33.412865 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-15d7b1f5-d1bb-42b5-babb-231f9532d850 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:33.413888 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-15d7b1f5-d1bb-42b5-babb-231f9532d850 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:33.414543 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-15d7b1f5-d1bb-42b5-babb-231f9532d850 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:33.415167 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-15d7b1f5-d1bb-42b5-babb-231f9532d850 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:33.523769 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-15d7b1f5-d1bb-42b5-babb-231f9532d850 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:33.543623 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-15d7b1f5-d1bb-42b5-babb-231f9532d850 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:33.545908 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-15d7b1f5-d1bb-42b5-babb-231f9532d850 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:33.552619 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-15d7b1f5-d1bb-42b5-babb-231f9532d850 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] 10.222.0.43 "GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15" status: 200 len: 1544 microversion: 2.91 time: 0.162431 Oct 04 18:34:33.553914 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 495/912] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:34:33 2022] GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15 => generated 1544 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:34:33.560395 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f5cfeed3-7bf1-4e01-aaed-256c729246d8 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:33.561738 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-f5cfeed3-7bf1-4e01-aaed-256c729246d8 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] [instance: 93798a9a-d90d-4a4e-8e30-d6575486ff56] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:33.568889 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f5cfeed3-7bf1-4e01-aaed-256c729246d8 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:33.569749 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f5cfeed3-7bf1-4e01-aaed-256c729246d8 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:33.570408 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f5cfeed3-7bf1-4e01-aaed-256c729246d8 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:33.572086 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f5cfeed3-7bf1-4e01-aaed-256c729246d8 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:33.572788 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f5cfeed3-7bf1-4e01-aaed-256c729246d8 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:33.573599 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f5cfeed3-7bf1-4e01-aaed-256c729246d8 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:33.788874 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-f5cfeed3-7bf1-4e01-aaed-256c729246d8 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a41ab6fb78a42ceaca621c5a38ffc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa31ed92017490a82497c7b8910aef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:33.801221 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-f5cfeed3-7bf1-4e01-aaed-256c729246d8 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] 10.222.0.43 "GET /compute/v2.1/servers/93798a9a-d90d-4a4e-8e30-d6575486ff56" status: 200 len: 1266 microversion: 2.1 time: 0.245119 Oct 04 18:34:33.801667 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 496/913] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:33 2022] GET /compute/v2.1/servers/93798a9a-d90d-4a4e-8e30-d6575486ff56 => generated 1266 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:33.823903 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-bcdff706-85e3-4f14-8fb3-5632c44011d3 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:33.824823 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-bcdff706-85e3-4f14-8fb3-5632c44011d3 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] [instance: bcc13e2d-03e7-464d-abac-f5ffb7cbb509] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:33.832183 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bcdff706-85e3-4f14-8fb3-5632c44011d3 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:33.832991 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bcdff706-85e3-4f14-8fb3-5632c44011d3 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:33.833601 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bcdff706-85e3-4f14-8fb3-5632c44011d3 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:33.834552 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bcdff706-85e3-4f14-8fb3-5632c44011d3 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:33.835237 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bcdff706-85e3-4f14-8fb3-5632c44011d3 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:33.835886 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bcdff706-85e3-4f14-8fb3-5632c44011d3 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:34.199734 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-bcdff706-85e3-4f14-8fb3-5632c44011d3 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4aec5af742842f5bb2048c8b7d60687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829069b2787a423f922fcc5b5702f167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:34.209298 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-bcdff706-85e3-4f14-8fb3-5632c44011d3 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] 10.222.0.43 "GET /compute/v2.1/servers/bcc13e2d-03e7-464d-abac-f5ffb7cbb509" status: 200 len: 1476 microversion: 2.1 time: 0.390735 Oct 04 18:34:34.225591 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 497/914] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:33 2022] GET /compute/v2.1/servers/bcc13e2d-03e7-464d-abac-f5ffb7cbb509 => generated 1476 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:34.230435 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-57c460ab-353d-4ccc-a48a-8c4c9eeb8a2f tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:34.231592 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-57c460ab-353d-4ccc-a48a-8c4c9eeb8a2f tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] [instance: 8408d8e1-41b0-4185-8806-9808f082a016] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:34.247157 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-57c460ab-353d-4ccc-a48a-8c4c9eeb8a2f tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:34.248180 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-57c460ab-353d-4ccc-a48a-8c4c9eeb8a2f tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:34.249054 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-57c460ab-353d-4ccc-a48a-8c4c9eeb8a2f tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:34.250370 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-57c460ab-353d-4ccc-a48a-8c4c9eeb8a2f tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:34.251090 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-57c460ab-353d-4ccc-a48a-8c4c9eeb8a2f tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:34.251684 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-57c460ab-353d-4ccc-a48a-8c4c9eeb8a2f tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:34.541863 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-57c460ab-353d-4ccc-a48a-8c4c9eeb8a2f tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7db99f361654711bea7f1b2c404d312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7adedcdb9c3485ea2738c00e25aa3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:34.553416 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-57c460ab-353d-4ccc-a48a-8c4c9eeb8a2f tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] 10.222.0.43 "GET /compute/v2.1/servers/8408d8e1-41b0-4185-8806-9808f082a016" status: 200 len: 1472 microversion: 2.1 time: 0.325390 Oct 04 18:34:34.572143 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 498/915] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:34 2022] GET /compute/v2.1/servers/8408d8e1-41b0-4185-8806-9808f082a016 => generated 1472 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:34.578334 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-0b634a00-ca76-49d0-a719-e59088ef551b tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:34.581215 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-0b634a00-ca76-49d0-a719-e59088ef551b tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] [instance: eb05639b-cd53-4c27-9505-20e668a16acc] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:34.589846 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0b634a00-ca76-49d0-a719-e59088ef551b tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:34.591368 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0b634a00-ca76-49d0-a719-e59088ef551b tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:34.591368 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0b634a00-ca76-49d0-a719-e59088ef551b tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:34.591672 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0b634a00-ca76-49d0-a719-e59088ef551b tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:34.592153 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0b634a00-ca76-49d0-a719-e59088ef551b tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:34.592633 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0b634a00-ca76-49d0-a719-e59088ef551b tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:34.862962 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-0b634a00-ca76-49d0-a719-e59088ef551b tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64887fff0bc7417094c4fee2f7e9aa5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6187bfad04cb7bc17155862ee0cdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:34.874259 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-0b634a00-ca76-49d0-a719-e59088ef551b tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] 10.222.0.43 "GET /compute/v2.1/servers/eb05639b-cd53-4c27-9505-20e668a16acc" status: 200 len: 1365 microversion: 2.1 time: 0.300847 Oct 04 18:34:34.875029 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 499/916] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:34 2022] GET /compute/v2.1/servers/eb05639b-cd53-4c27-9505-20e668a16acc => generated 1365 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:34.897094 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-081b124c-3264-4ff9-9b11-a74783194ba7 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:34.897825 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-081b124c-3264-4ff9-9b11-a74783194ba7 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] [instance: 84e0414b-a39f-4bfe-bc9d-c170ceb34d15] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:34.915761 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-081b124c-3264-4ff9-9b11-a74783194ba7 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:34.916279 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-081b124c-3264-4ff9-9b11-a74783194ba7 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:34.916724 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-081b124c-3264-4ff9-9b11-a74783194ba7 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:34.917831 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-081b124c-3264-4ff9-9b11-a74783194ba7 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:34.921469 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-081b124c-3264-4ff9-9b11-a74783194ba7 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:34.921968 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-081b124c-3264-4ff9-9b11-a74783194ba7 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:35.074864 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-081b124c-3264-4ff9-9b11-a74783194ba7 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:35.085483 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-081b124c-3264-4ff9-9b11-a74783194ba7 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:35.087120 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-081b124c-3264-4ff9-9b11-a74783194ba7 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:35.095508 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-081b124c-3264-4ff9-9b11-a74783194ba7 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] 10.222.0.43 "GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15" status: 200 len: 1544 microversion: 2.91 time: 0.204881 Oct 04 18:34:35.096133 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 500/917] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:34:34 2022] GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15 => generated 1544 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:34:35.102864 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-7ffeb2fd-420f-4371-a4c4-a593b44e9eb0 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:35.103965 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-7ffeb2fd-420f-4371-a4c4-a593b44e9eb0 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] [instance: 93798a9a-d90d-4a4e-8e30-d6575486ff56] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:35.110894 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7ffeb2fd-420f-4371-a4c4-a593b44e9eb0 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:35.111386 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7ffeb2fd-420f-4371-a4c4-a593b44e9eb0 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:35.111827 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7ffeb2fd-420f-4371-a4c4-a593b44e9eb0 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:35.112527 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7ffeb2fd-420f-4371-a4c4-a593b44e9eb0 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:35.112979 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7ffeb2fd-420f-4371-a4c4-a593b44e9eb0 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:35.113431 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7ffeb2fd-420f-4371-a4c4-a593b44e9eb0 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:35.133684 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=100 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:34:35.194405 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-7ffeb2fd-420f-4371-a4c4-a593b44e9eb0 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a41ab6fb78a42ceaca621c5a38ffc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa31ed92017490a82497c7b8910aef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:35.201680 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-7ffeb2fd-420f-4371-a4c4-a593b44e9eb0 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] 10.222.0.43 "GET /compute/v2.1/servers/93798a9a-d90d-4a4e-8e30-d6575486ff56" status: 200 len: 1266 microversion: 2.1 time: 0.104387 Oct 04 18:34:35.217744 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 501/918] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:35 2022] GET /compute/v2.1/servers/93798a9a-d90d-4a4e-8e30-d6575486ff56 => generated 1266 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:35.236374 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-d2f3cb92-152e-48df-a689-a1a7b2f1cd37 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:35.238076 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-d2f3cb92-152e-48df-a689-a1a7b2f1cd37 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] [instance: bcc13e2d-03e7-464d-abac-f5ffb7cbb509] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:35.246935 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d2f3cb92-152e-48df-a689-a1a7b2f1cd37 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:35.248053 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d2f3cb92-152e-48df-a689-a1a7b2f1cd37 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:35.248694 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d2f3cb92-152e-48df-a689-a1a7b2f1cd37 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:35.250034 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d2f3cb92-152e-48df-a689-a1a7b2f1cd37 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:35.250600 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d2f3cb92-152e-48df-a689-a1a7b2f1cd37 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:35.251189 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d2f3cb92-152e-48df-a689-a1a7b2f1cd37 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:35.772576 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-d2f3cb92-152e-48df-a689-a1a7b2f1cd37 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4aec5af742842f5bb2048c8b7d60687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829069b2787a423f922fcc5b5702f167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:35.784080 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-d2f3cb92-152e-48df-a689-a1a7b2f1cd37 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] 10.222.0.43 "GET /compute/v2.1/servers/bcc13e2d-03e7-464d-abac-f5ffb7cbb509" status: 200 len: 1459 microversion: 2.1 time: 0.552092 Oct 04 18:34:35.784692 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 502/919] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:35 2022] GET /compute/v2.1/servers/bcc13e2d-03e7-464d-abac-f5ffb7cbb509 => generated 1459 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:34:35.802182 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-75a088f1-c16c-47a7-89d9-84f33b81ab68 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:35.802715 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-75a088f1-c16c-47a7-89d9-84f33b81ab68 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] [instance: 8408d8e1-41b0-4185-8806-9808f082a016] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:35.810651 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-75a088f1-c16c-47a7-89d9-84f33b81ab68 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:35.811682 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-75a088f1-c16c-47a7-89d9-84f33b81ab68 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:35.811682 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-75a088f1-c16c-47a7-89d9-84f33b81ab68 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:35.812452 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-75a088f1-c16c-47a7-89d9-84f33b81ab68 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:35.812917 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-75a088f1-c16c-47a7-89d9-84f33b81ab68 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:35.813509 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-75a088f1-c16c-47a7-89d9-84f33b81ab68 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:36.074366 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-75a088f1-c16c-47a7-89d9-84f33b81ab68 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7db99f361654711bea7f1b2c404d312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7adedcdb9c3485ea2738c00e25aa3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:36.092235 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-75a088f1-c16c-47a7-89d9-84f33b81ab68 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] 10.222.0.43 "GET /compute/v2.1/servers/8408d8e1-41b0-4185-8806-9808f082a016" status: 200 len: 1472 microversion: 2.1 time: 0.301532 Oct 04 18:34:36.093091 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 503/920] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:35 2022] GET /compute/v2.1/servers/8408d8e1-41b0-4185-8806-9808f082a016 => generated 1472 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:36.105817 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f5dc63c2-7d56-49db-b9f3-2218a156fdab tempest-LiveMigrationNegativeTest-828398147 tempest-LiveMigrationNegativeTest-828398147-project-admin] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:36.106703 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-f5dc63c2-7d56-49db-b9f3-2218a156fdab tempest-LiveMigrationNegativeTest-828398147 tempest-LiveMigrationNegativeTest-828398147-project-admin] [instance: bcc13e2d-03e7-464d-abac-f5ffb7cbb509] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:36.120881 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f5dc63c2-7d56-49db-b9f3-2218a156fdab tempest-LiveMigrationNegativeTest-828398147 tempest-LiveMigrationNegativeTest-828398147-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:36.121579 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f5dc63c2-7d56-49db-b9f3-2218a156fdab tempest-LiveMigrationNegativeTest-828398147 tempest-LiveMigrationNegativeTest-828398147-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:36.122018 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f5dc63c2-7d56-49db-b9f3-2218a156fdab tempest-LiveMigrationNegativeTest-828398147 tempest-LiveMigrationNegativeTest-828398147-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:36.123004 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f5dc63c2-7d56-49db-b9f3-2218a156fdab tempest-LiveMigrationNegativeTest-828398147 tempest-LiveMigrationNegativeTest-828398147-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:36.123176 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f5dc63c2-7d56-49db-b9f3-2218a156fdab tempest-LiveMigrationNegativeTest-828398147 tempest-LiveMigrationNegativeTest-828398147-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:36.123600 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f5dc63c2-7d56-49db-b9f3-2218a156fdab tempest-LiveMigrationNegativeTest-828398147 tempest-LiveMigrationNegativeTest-828398147-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:36.420101 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-f5dc63c2-7d56-49db-b9f3-2218a156fdab tempest-LiveMigrationNegativeTest-828398147 tempest-LiveMigrationNegativeTest-828398147-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/bcc13e2d-03e7-464d-abac-f5ffb7cbb509" status: 200 len: 1612 microversion: 2.1 time: 0.318318 Oct 04 18:34:36.421485 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 504/921] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:36 2022] GET /compute/v2.1/servers/bcc13e2d-03e7-464d-abac-f5ffb7cbb509 => generated 1612 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:36.428958 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-4eb5ba7a-5e51-4224-b758-84f5177d7428 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:36.429724 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-4eb5ba7a-5e51-4224-b758-84f5177d7428 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] [instance: eb05639b-cd53-4c27-9505-20e668a16acc] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:36.440591 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4eb5ba7a-5e51-4224-b758-84f5177d7428 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:36.440591 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4eb5ba7a-5e51-4224-b758-84f5177d7428 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:36.440882 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4eb5ba7a-5e51-4224-b758-84f5177d7428 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:36.441584 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4eb5ba7a-5e51-4224-b758-84f5177d7428 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:36.442042 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4eb5ba7a-5e51-4224-b758-84f5177d7428 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:36.442482 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4eb5ba7a-5e51-4224-b758-84f5177d7428 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:36.588169 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-4b784b8f-e39f-49a0-8e4c-b892c9584a3c tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] 10.222.0.43 "POST /compute/v2.1/servers/9895c2ec-35ea-419e-9565-0c0f2fc5bbbc/action" status: 202 len: 0 microversion: 2.25 time: 13.374247 Oct 04 18:34:36.591772 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 418/922] 10.222.0.43 () {62 vars in 1319 bytes} [Tue Oct 4 18:34:23 2022] POST /compute/v2.1/servers/9895c2ec-35ea-419e-9565-0c0f2fc5bbbc/action => generated 0 bytes in 13377 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:34:36.595886 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-042acab9-eacc-46c9-8bbe-5dbe34e7b5f3 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:36.596519 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-042acab9-eacc-46c9-8bbe-5dbe34e7b5f3 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] [instance: 84e0414b-a39f-4bfe-bc9d-c170ceb34d15] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:36.611748 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-042acab9-eacc-46c9-8bbe-5dbe34e7b5f3 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:36.612464 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-042acab9-eacc-46c9-8bbe-5dbe34e7b5f3 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:36.613079 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-042acab9-eacc-46c9-8bbe-5dbe34e7b5f3 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:36.615474 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-042acab9-eacc-46c9-8bbe-5dbe34e7b5f3 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:36.616138 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-042acab9-eacc-46c9-8bbe-5dbe34e7b5f3 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:36.617662 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-042acab9-eacc-46c9-8bbe-5dbe34e7b5f3 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:36.747388 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-4eb5ba7a-5e51-4224-b758-84f5177d7428 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64887fff0bc7417094c4fee2f7e9aa5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6187bfad04cb7bc17155862ee0cdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:36.759947 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-4eb5ba7a-5e51-4224-b758-84f5177d7428 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] 10.222.0.43 "GET /compute/v2.1/servers/eb05639b-cd53-4c27-9505-20e668a16acc" status: 200 len: 1365 microversion: 2.1 time: 0.334923 Oct 04 18:34:36.760925 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 505/923] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:36 2022] GET /compute/v2.1/servers/eb05639b-cd53-4c27-9505-20e668a16acc => generated 1365 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:37.053389 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-042acab9-eacc-46c9-8bbe-5dbe34e7b5f3 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:37.057668 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-6aea11ac-eb9b-473c-848b-beb1136e73e8 tempest-SecurityGroupRulesNegativeTestJSON-1902147119 tempest-SecurityGroupRulesNegativeTestJSON-1902147119-project] Action: 'create', calling method: .version_select at 0x7fb21fd110d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-618236663", "description": "tempest-description-866088940"}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:34:37.069625 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-042acab9-eacc-46c9-8bbe-5dbe34e7b5f3 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:37.071132 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-042acab9-eacc-46c9-8bbe-5dbe34e7b5f3 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:37.077428 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-042acab9-eacc-46c9-8bbe-5dbe34e7b5f3 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] 10.222.0.43 "GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15" status: 200 len: 1544 microversion: 2.91 time: 0.485995 Oct 04 18:34:37.089371 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 419/924] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:34:36 2022] GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15 => generated 1544 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:34:37.109422 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-e9ec8e8f-ffa6-4085-96e6-1d458fb5e662 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:37.110585 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-e9ec8e8f-ffa6-4085-96e6-1d458fb5e662 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] [instance: 93798a9a-d90d-4a4e-8e30-d6575486ff56] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:37.128439 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e9ec8e8f-ffa6-4085-96e6-1d458fb5e662 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:37.134293 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e9ec8e8f-ffa6-4085-96e6-1d458fb5e662 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:37.135281 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e9ec8e8f-ffa6-4085-96e6-1d458fb5e662 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:37.137923 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e9ec8e8f-ffa6-4085-96e6-1d458fb5e662 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:37.139781 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e9ec8e8f-ffa6-4085-96e6-1d458fb5e662 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:37.143716 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e9ec8e8f-ffa6-4085-96e6-1d458fb5e662 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:37.407883 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-6aea11ac-eb9b-473c-848b-beb1136e73e8 tempest-SecurityGroupRulesNegativeTestJSON-1902147119 tempest-SecurityGroupRulesNegativeTestJSON-1902147119-project] 10.222.0.43 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 0.645695 Oct 04 18:34:37.408674 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 506/925] 10.222.0.43 () {60 vars in 1180 bytes} [Tue Oct 4 18:34:36 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:34:37.413805 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-dd87d814-d373-4c06-b160-af5b53a2469b tempest-LiveMigrationNegativeTest-828398147 tempest-LiveMigrationNegativeTest-828398147-project-admin] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:37.421178 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dd87d814-d373-4c06-b160-af5b53a2469b tempest-LiveMigrationNegativeTest-828398147 tempest-LiveMigrationNegativeTest-828398147-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:37.426126 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dd87d814-d373-4c06-b160-af5b53a2469b tempest-LiveMigrationNegativeTest-828398147 tempest-LiveMigrationNegativeTest-828398147-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:37.426598 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dd87d814-d373-4c06-b160-af5b53a2469b tempest-LiveMigrationNegativeTest-828398147 tempest-LiveMigrationNegativeTest-828398147-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:37.427412 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dd87d814-d373-4c06-b160-af5b53a2469b tempest-LiveMigrationNegativeTest-828398147 tempest-LiveMigrationNegativeTest-828398147-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:37.429009 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dd87d814-d373-4c06-b160-af5b53a2469b tempest-LiveMigrationNegativeTest-828398147 tempest-LiveMigrationNegativeTest-828398147-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:37.430077 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dd87d814-d373-4c06-b160-af5b53a2469b tempest-LiveMigrationNegativeTest-828398147 tempest-LiveMigrationNegativeTest-828398147-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:37.466832 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-dd87d814-d373-4c06-b160-af5b53a2469b tempest-LiveMigrationNegativeTest-828398147 tempest-LiveMigrationNegativeTest-828398147-project-admin] 10.222.0.43 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.057146 Oct 04 18:34:37.467830 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 507/926] 10.222.0.43 () {58 vars in 1176 bytes} [Tue Oct 4 18:34:37 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:34:37.472893 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-82cae203-92e5-4c88-b9cd-4482a70af859 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:37.473541 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-82cae203-92e5-4c88-b9cd-4482a70af859 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] [instance: 9895c2ec-35ea-419e-9565-0c0f2fc5bbbc] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:37.481072 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-82cae203-92e5-4c88-b9cd-4482a70af859 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:37.481903 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-82cae203-92e5-4c88-b9cd-4482a70af859 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:37.482516 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-82cae203-92e5-4c88-b9cd-4482a70af859 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:37.483431 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-82cae203-92e5-4c88-b9cd-4482a70af859 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:37.484052 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-82cae203-92e5-4c88-b9cd-4482a70af859 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:37.484643 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-82cae203-92e5-4c88-b9cd-4482a70af859 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:37.671873 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-82cae203-92e5-4c88-b9cd-4482a70af859 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:37.682742 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-82cae203-92e5-4c88-b9cd-4482a70af859 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:37.685870 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-82cae203-92e5-4c88-b9cd-4482a70af859 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:37.689212 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-82cae203-92e5-4c88-b9cd-4482a70af859 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] 10.222.0.43 "GET /compute/v2.1/servers/9895c2ec-35ea-419e-9565-0c0f2fc5bbbc" status: 200 len: 1566 microversion: 2.25 time: 0.219470 Oct 04 18:34:37.691272 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 508/927] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:34:37 2022] GET /compute/v2.1/servers/9895c2ec-35ea-419e-9565-0c0f2fc5bbbc => generated 1566 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:34:37.696927 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-2d89a520-fc8e-4c36-9c92-e6211dbe7404 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:37.698038 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-2d89a520-fc8e-4c36-9c92-e6211dbe7404 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] [instance: 8408d8e1-41b0-4185-8806-9808f082a016] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:37.708464 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2d89a520-fc8e-4c36-9c92-e6211dbe7404 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:37.709641 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2d89a520-fc8e-4c36-9c92-e6211dbe7404 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:37.710456 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2d89a520-fc8e-4c36-9c92-e6211dbe7404 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:37.711914 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2d89a520-fc8e-4c36-9c92-e6211dbe7404 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:37.713458 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2d89a520-fc8e-4c36-9c92-e6211dbe7404 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:37.714225 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2d89a520-fc8e-4c36-9c92-e6211dbe7404 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:37.775469 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2d89a520-fc8e-4c36-9c92-e6211dbe7404 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:37.777555 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2d89a520-fc8e-4c36-9c92-e6211dbe7404 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:37.779289 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2d89a520-fc8e-4c36-9c92-e6211dbe7404 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:37.780559 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.objects.instance [None req-2d89a520-fc8e-4c36-9c92-e6211dbe7404 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lazy-loading 'fault' on Instance uuid 8408d8e1-41b0-4185-8806-9808f082a016 {{(pid=123596) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:34:37.816606 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-e9ec8e8f-ffa6-4085-96e6-1d458fb5e662 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a41ab6fb78a42ceaca621c5a38ffc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa31ed92017490a82497c7b8910aef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:37.828735 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-e9ec8e8f-ffa6-4085-96e6-1d458fb5e662 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] 10.222.0.43 "GET /compute/v2.1/servers/93798a9a-d90d-4a4e-8e30-d6575486ff56" status: 200 len: 1308 microversion: 2.1 time: 0.737439 Oct 04 18:34:37.831493 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 420/928] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:37 2022] GET /compute/v2.1/servers/93798a9a-d90d-4a4e-8e30-d6575486ff56 => generated 1308 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:37.834530 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-2d89a520-fc8e-4c36-9c92-e6211dbe7404 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7db99f361654711bea7f1b2c404d312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7adedcdb9c3485ea2738c00e25aa3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:37.837392 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-a069a02b-1b37-44d6-91a0-1a6d6bd80d3d req-117d36ae-77aa-4906-bc58-8ed005fbd0af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8408d8e1-41b0-4185-8806-9808f082a016", "name": "network-vif-deleted", "tag": "a599834b-b75e-4efd-912d-97b463dc6035"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:34:37.843486 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-2d89a520-fc8e-4c36-9c92-e6211dbe7404 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] 10.222.0.43 "GET /compute/v2.1/servers/8408d8e1-41b0-4185-8806-9808f082a016" status: 200 len: 1307 microversion: 2.1 time: 0.150799 Oct 04 18:34:37.853175 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 509/929] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:37 2022] GET /compute/v2.1/servers/8408d8e1-41b0-4185-8806-9808f082a016 => generated 1307 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:37.861989 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-4831628c-79e0-4607-b12c-36bf14706bf6 tempest-SecurityGroupRulesNegativeTestJSON-1902147119 tempest-SecurityGroupRulesNegativeTestJSON-1902147119-project] Action: 'create', calling method: .version_select at 0x7fb21fb698b0>, body: {"security_group_rule": {"parent_group_id": "db5d0dac-1fc4-4ae3-a268-4040060bcd72", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:34:37.862475 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-a069a02b-1b37-44d6-91a0-1a6d6bd80d3d req-117d36ae-77aa-4906-bc58-8ed005fbd0af service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:37.863201 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-a069a02b-1b37-44d6-91a0-1a6d6bd80d3d req-117d36ae-77aa-4906-bc58-8ed005fbd0af service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:37.863869 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-a069a02b-1b37-44d6-91a0-1a6d6bd80d3d req-117d36ae-77aa-4906-bc58-8ed005fbd0af service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:37.882410 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-a069a02b-1b37-44d6-91a0-1a6d6bd80d3d req-117d36ae-77aa-4906-bc58-8ed005fbd0af service nova] Creating event network-vif-deleted:a599834b-b75e-4efd-912d-97b463dc6035 for instance 8408d8e1-41b0-4185-8806-9808f082a016 on n-h2-851028-13 Oct 04 18:34:37.889093 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-a069a02b-1b37-44d6-91a0-1a6d6bd80d3d req-117d36ae-77aa-4906-bc58-8ed005fbd0af service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056154 Oct 04 18:34:37.890367 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 421/930] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:34:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:34:37.900836 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-0f0dfc0f-ef27-4865-97d5-b74cc2967e98 tempest-LiveMigrationNegativeTest-828398147 tempest-LiveMigrationNegativeTest-828398147-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-851028-13", "block_migration": true, "disk_over_commit": false}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:34:37.905415 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-0f0dfc0f-ef27-4865-97d5-b74cc2967e98 tempest-LiveMigrationNegativeTest-828398147 tempest-LiveMigrationNegativeTest-828398147-project-admin] [instance: bcc13e2d-03e7-464d-abac-f5ffb7cbb509] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:37.916052 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0f0dfc0f-ef27-4865-97d5-b74cc2967e98 tempest-LiveMigrationNegativeTest-828398147 tempest-LiveMigrationNegativeTest-828398147-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:37.916724 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0f0dfc0f-ef27-4865-97d5-b74cc2967e98 tempest-LiveMigrationNegativeTest-828398147 tempest-LiveMigrationNegativeTest-828398147-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:37.917310 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0f0dfc0f-ef27-4865-97d5-b74cc2967e98 tempest-LiveMigrationNegativeTest-828398147 tempest-LiveMigrationNegativeTest-828398147-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:37.918140 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0f0dfc0f-ef27-4865-97d5-b74cc2967e98 tempest-LiveMigrationNegativeTest-828398147 tempest-LiveMigrationNegativeTest-828398147-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:37.918698 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0f0dfc0f-ef27-4865-97d5-b74cc2967e98 tempest-LiveMigrationNegativeTest-828398147 tempest-LiveMigrationNegativeTest-828398147-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:37.919322 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0f0dfc0f-ef27-4865-97d5-b74cc2967e98 tempest-LiveMigrationNegativeTest-828398147 tempest-LiveMigrationNegativeTest-828398147-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:37.969124 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.objects.instance [None req-0f0dfc0f-ef27-4865-97d5-b74cc2967e98 tempest-LiveMigrationNegativeTest-828398147 tempest-LiveMigrationNegativeTest-828398147-project-admin] Lazy-loading 'flavor' on Instance uuid bcc13e2d-03e7-464d-abac-f5ffb7cbb509 {{(pid=123595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:34:37.986762 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-0f0dfc0f-ef27-4865-97d5-b74cc2967e98 tempest-LiveMigrationNegativeTest-828398147 tempest-LiveMigrationNegativeTest-828398147-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance bcc13e2d-03e7-464d-abac-f5ffb7cbb509 while it is in vm_state suspended Oct 04 18:34:37.989484 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-0f0dfc0f-ef27-4865-97d5-b74cc2967e98 tempest-LiveMigrationNegativeTest-828398147 tempest-LiveMigrationNegativeTest-828398147-project-admin] Request method failure captured: Oct 04 18:34:37.989484 n-d-851028-13 devstack@n-api.service[123595]: request: POST /compute/v2.1/servers/bcc13e2d-03e7-464d-abac-f5ffb7cbb509/action HTTP/1.1 Oct 04 18:34:37.989484 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 18:34:37.989484 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 18:34:37.989484 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 18:34:37.989484 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 98 Oct 04 18:34:37.989484 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 18:34:37.989484 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 18:34:37.989484 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 18:34:37.989484 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 18:34:37.989484 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPHxwQdt6BHzRTURP22Mb2Lm3DiMu2FmI_M0tlFgdLiWmiAHPuB_B-ou8hwlWCYvlSOxaLOeRpaKPiCCktkHmNES_CPq_ymZL6OtJEg-GTzJqEEXVr4ELxoLShokfHAiDbs4zsp79SfSOOA9-2AzCQH3k4T6FXBA8lG7wjsd3C3tsnbM Oct 04 18:34:37.989484 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 18:34:37.989484 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 18:34:37.989484 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 18:34:37.989484 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 18:34:37.989484 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 18:34:37.989484 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 18:34:37.989484 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: b113b5940fcc4224a2d606722e4856e1 Oct 04 18:34:37.989484 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-LiveMigrationNegativeTest-828398147 Oct 04 18:34:37.989484 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,admin,reader Oct 04 18:34:37.989484 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,admin,reader Oct 04 18:34:37.989484 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/b113b5940fcc4224a2d606722e4856e1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_b113b5940fcc4224a2d606722e4856e1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b113b5940fcc4224a2d606722e4856e1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b113b5940fcc4224a2d606722e4856e1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:34:37.989484 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-LiveMigrationNegativeTest-828398147 Oct 04 18:34:37.989484 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: b113b5940fcc4224a2d606722e4856e1 Oct 04 18:34:37.989484 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-828398147 Oct 04 18:34:37.989484 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-LiveMigrationNegativeTest-828398147-project-admin Oct 04 18:34:37.989484 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 18:34:37.989484 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 18:34:37.989484 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: c1f16ac97d204377a471448fde3f2310 Oct 04 18:34:37.989484 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-LiveMigrationNegativeTest-828398147-project-admin Oct 04 18:34:37.989484 n-d-851028-13 devstack@n-api.service[123595]: Oct 04 18:34:37.989484 n-d-851028-13 devstack@n-api.service[123595]: {"os-migrateLive": {"host": "n-h1-851028-13", "block_migration": true, "disk_over_commit": false}} Oct 04 18:34:37.989484 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 18:34:37.989484 n-d-851028-13 devstack@n-api.service[123595]: exception: Cannot 'os-migrateLive' instance bcc13e2d-03e7-464d-abac-f5ffb7cbb509 while it is in vm_state suspended Oct 04 18:34:37.989484 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': 'bcc13e2d-03e7-464d-abac-f5ffb7cbb509', 'body': {'os-migrateLive': {'host': 'n-h1-851028-13', 'block_migration': True, 'disk_over_commit': False}}} Oct 04 18:34:37.989484 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:34:37.989484 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:34:37.989484 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Oct 04 18:34:37.989484 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Oct 04 18:34:37.989484 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 04 18:34:37.989484 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 18:34:37.989484 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 04 18:34:37.989484 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 04 18:34:37.989484 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 04 18:34:37.989484 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 18:34:37.989484 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 04 18:34:37.989484 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 04 18:34:37.989484 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 04 18:34:37.989484 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 18:34:37.989484 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 04 18:34:37.989484 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 18:34:37.989484 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 18:34:37.989484 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 18:34:37.989484 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 04 18:34:37.989484 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 04 18:34:37.989484 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance bcc13e2d-03e7-464d-abac-f5ffb7cbb509 in vm_state suspended. Cannot live_migrate while the instance is in this state. Oct 04 18:34:37.989484 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:34:37.989484 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:34:37.989484 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:34:37.989484 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:34:37.989484 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:34:37.993964 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:34:37.993964 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:34:37.993964 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:34:37.993964 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:34:37.993964 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:34:37.993964 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:34:37.993964 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:34:37.993964 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:34:37.993964 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:34:37.993964 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:34:37.993964 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:34:37.993964 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 04 18:34:37.993964 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 152, in _migrate_live Oct 04 18:34:37.993964 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 04 18:34:37.993964 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 04 18:34:37.993964 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 04 18:34:37.993964 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'os-migrateLive' instance bcc13e2d-03e7-464d-abac-f5ffb7cbb509 while it is in vm_state suspended Oct 04 18:34:37.993964 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:34:37.993964 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:34:37.993964 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:34:37.993964 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:34:37.993964 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:34:37.993964 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:34:37.993964 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:34:37.993964 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:34:37.993964 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'os-migrateLive' instance bcc13e2d-03e7-464d-abac-f5ffb7cbb509 while it is in vm_state suspended Oct 04 18:34:37.993964 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:34:37.998443 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-0f0dfc0f-ef27-4865-97d5-b74cc2967e98 tempest-LiveMigrationNegativeTest-828398147 tempest-LiveMigrationNegativeTest-828398147-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance bcc13e2d-03e7-464d-abac-f5ffb7cbb509 while it is in vm_state suspended {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:34:38.000254 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-0f0dfc0f-ef27-4865-97d5-b74cc2967e98 tempest-LiveMigrationNegativeTest-828398147 tempest-LiveMigrationNegativeTest-828398147-project-admin] 10.222.0.43 "POST /compute/v2.1/servers/bcc13e2d-03e7-464d-abac-f5ffb7cbb509/action" status: 409 len: 155 microversion: 2.1 time: 0.106124 Oct 04 18:34:38.009970 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 422/931] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 18:34:37 2022] POST /compute/v2.1/servers/bcc13e2d-03e7-464d-abac-f5ffb7cbb509/action => generated 155 bytes in 116 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:34:38.017006 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-197a18e9-d1a4-4367-bb89-15056f6792ad tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:38.018060 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-197a18e9-d1a4-4367-bb89-15056f6792ad tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] [instance: eb05639b-cd53-4c27-9505-20e668a16acc] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:38.026481 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-197a18e9-d1a4-4367-bb89-15056f6792ad tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:38.027352 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-197a18e9-d1a4-4367-bb89-15056f6792ad tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:38.028038 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-197a18e9-d1a4-4367-bb89-15056f6792ad tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:38.029807 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-197a18e9-d1a4-4367-bb89-15056f6792ad tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:38.030828 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-197a18e9-d1a4-4367-bb89-15056f6792ad tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:38.032270 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-197a18e9-d1a4-4367-bb89-15056f6792ad tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:38.133986 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-4831628c-79e0-4607-b12c-36bf14706bf6 tempest-SecurityGroupRulesNegativeTestJSON-1902147119 tempest-SecurityGroupRulesNegativeTestJSON-1902147119-project] 10.222.0.43 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.280591 Oct 04 18:34:38.134642 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 510/932] 10.222.0.43 () {60 vars in 1195 bytes} [Tue Oct 4 18:34:37 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:34:38.147249 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-d2755c26-262a-4a80-879a-825fbc04c92c tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:38.147755 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-d2755c26-262a-4a80-879a-825fbc04c92c tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] [instance: bcc13e2d-03e7-464d-abac-f5ffb7cbb509] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:38.154149 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d2755c26-262a-4a80-879a-825fbc04c92c tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:38.154980 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d2755c26-262a-4a80-879a-825fbc04c92c tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:38.155652 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d2755c26-262a-4a80-879a-825fbc04c92c tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:38.156549 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d2755c26-262a-4a80-879a-825fbc04c92c tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:38.157287 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d2755c26-262a-4a80-879a-825fbc04c92c tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:38.158017 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d2755c26-262a-4a80-879a-825fbc04c92c tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:38.188910 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-d2755c26-262a-4a80-879a-825fbc04c92c tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] [instance: bcc13e2d-03e7-464d-abac-f5ffb7cbb509] Going to try to terminate instance {{(pid=123596) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:34:38.289278 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-d2755c26-262a-4a80-879a-825fbc04c92c tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] 10.222.0.43 "DELETE /compute/v2.1/servers/bcc13e2d-03e7-464d-abac-f5ffb7cbb509" status: 204 len: 0 microversion: 2.1 time: 0.145379 Oct 04 18:34:38.293189 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 511/933] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 18:34:38 2022] DELETE /compute/v2.1/servers/bcc13e2d-03e7-464d-abac-f5ffb7cbb509 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:34:38.300501 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-726ea45a-3cd8-46cb-90f0-2a71168ab19a tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:38.301812 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-726ea45a-3cd8-46cb-90f0-2a71168ab19a tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] [instance: 84e0414b-a39f-4bfe-bc9d-c170ceb34d15] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:38.308961 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-726ea45a-3cd8-46cb-90f0-2a71168ab19a tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:38.309783 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-726ea45a-3cd8-46cb-90f0-2a71168ab19a tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:38.310390 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-726ea45a-3cd8-46cb-90f0-2a71168ab19a tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:38.311308 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-726ea45a-3cd8-46cb-90f0-2a71168ab19a tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:38.312203 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-726ea45a-3cd8-46cb-90f0-2a71168ab19a tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:38.312797 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-726ea45a-3cd8-46cb-90f0-2a71168ab19a tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:38.397650 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-726ea45a-3cd8-46cb-90f0-2a71168ab19a tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:38.411037 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-726ea45a-3cd8-46cb-90f0-2a71168ab19a tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:38.412734 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-726ea45a-3cd8-46cb-90f0-2a71168ab19a tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:38.419487 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-726ea45a-3cd8-46cb-90f0-2a71168ab19a tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] 10.222.0.43 "GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15" status: 200 len: 1531 microversion: 2.91 time: 0.124058 Oct 04 18:34:38.427487 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 512/934] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:34:38 2022] GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15 => generated 1531 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:34:38.439395 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-21c277e1-6772-4626-bb78-115c0c50f601 tempest-SecurityGroupRulesNegativeTestJSON-1902147119 tempest-SecurityGroupRulesNegativeTestJSON-1902147119-project] Action: 'create', calling method: .version_select at 0x7fb21fb58d30>, body: {"security_group_rule": {"parent_group_id": "db5d0dac-1fc4-4ae3-a268-4040060bcd72", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:34:38.459766 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-197a18e9-d1a4-4367-bb89-15056f6792ad tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64887fff0bc7417094c4fee2f7e9aa5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6187bfad04cb7bc17155862ee0cdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:38.473916 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-197a18e9-d1a4-4367-bb89-15056f6792ad tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] 10.222.0.43 "GET /compute/v2.1/servers/eb05639b-cd53-4c27-9505-20e668a16acc" status: 200 len: 1365 microversion: 2.1 time: 0.462211 Oct 04 18:34:38.493742 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 423/935] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:38 2022] GET /compute/v2.1/servers/eb05639b-cd53-4c27-9505-20e668a16acc => generated 1365 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:38.506047 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-a0ff7d8d-df5d-4860-a857-f4206e8fa3f9 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:38.507872 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-a0ff7d8d-df5d-4860-a857-f4206e8fa3f9 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] [instance: bcc13e2d-03e7-464d-abac-f5ffb7cbb509] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:38.512359 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-21c277e1-6772-4626-bb78-115c0c50f601 tempest-SecurityGroupRulesNegativeTestJSON-1902147119 tempest-SecurityGroupRulesNegativeTestJSON-1902147119-project] HTTP exception thrown: This rule already exists in group db5d0dac-1fc4-4ae3-a268-4040060bcd72 Oct 04 18:34:38.515238 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-21c277e1-6772-4626-bb78-115c0c50f601 tempest-SecurityGroupRulesNegativeTestJSON-1902147119 tempest-SecurityGroupRulesNegativeTestJSON-1902147119-project] Request method failure captured: Oct 04 18:34:38.515238 n-d-851028-13 devstack@n-api.service[123596]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 04 18:34:38.515238 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:34:38.515238 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:34:38.515238 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:34:38.515238 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 138 Oct 04 18:34:38.515238 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:34:38.515238 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:34:38.515238 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:34:38.515238 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:34:38.515238 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPHy8Wk37Kt-KEPYTw4ckPdWUqFxLgD2-K-78O18tkuJzgNpD7Tq8-0rrlYeqBFFk_KJuKAPrn-_DZEID1KQqBk5OQVTbaNjnTgvt70fy9R-59105DigD-QRLAsSvlfrSDFMi2XWbac2MgKNSOZSKOHGMT_kk9iQrNtiTfOjBiv7e1nM Oct 04 18:34:38.515238 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:34:38.515238 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:34:38.515238 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:34:38.515238 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:34:38.515238 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:34:38.515238 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:34:38.515238 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: 4a28e1fc23834fd2b065d34598efec10 Oct 04 18:34:38.515238 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1902147119 Oct 04 18:34:38.515238 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 18:34:38.515238 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 18:34:38.515238 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/4a28e1fc23834fd2b065d34598efec10"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_4a28e1fc23834fd2b065d34598efec10"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4a28e1fc23834fd2b065d34598efec10"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4a28e1fc23834fd2b065d34598efec10"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:34:38.515238 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1902147119 Oct 04 18:34:38.515238 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: 4a28e1fc23834fd2b065d34598efec10 Oct 04 18:34:38.515238 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1902147119 Oct 04 18:34:38.515238 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1902147119-project Oct 04 18:34:38.515238 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:34:38.515238 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:34:38.515238 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 5b93da9a8ec74ae3b1a206311bd01a8d Oct 04 18:34:38.515238 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1902147119-project Oct 04 18:34:38.515238 n-d-851028-13 devstack@n-api.service[123596]: Oct 04 18:34:38.515238 n-d-851028-13 devstack@n-api.service[123596]: {"security_group_rule": {"parent_group_id": "db5d0dac-1fc4-4ae3-a268-4040060bcd72", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 04 18:34:38.515238 n-d-851028-13 devstack@n-api.service[123596]: method: Oct 04 18:34:38.515238 n-d-851028-13 devstack@n-api.service[123596]: exception: This rule already exists in group db5d0dac-1fc4-4ae3-a268-4040060bcd72 Oct 04 18:34:38.515238 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'db5d0dac-1fc4-4ae3-a268-4040060bcd72', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 04 18:34:38.515238 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:34:38.515238 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:34:38.515238 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 324, in create Oct 04 18:34:38.515238 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi security_group_api.create_security_group_rule( Oct 04 18:34:38.515238 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 186, in create_security_group_rule Oct 04 18:34:38.515238 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Oct 04 18:34:38.515238 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: This rule already exists in group db5d0dac-1fc4-4ae3-a268-4040060bcd72 Oct 04 18:34:38.515238 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:34:38.515238 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:34:38.515238 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:34:38.515238 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:34:38.515238 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:34:38.515238 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:34:38.515238 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:34:38.515238 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:34:38.515238 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:34:38.515238 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:34:38.515238 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:34:38.515238 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:34:38.515238 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 327, in create Oct 04 18:34:38.515238 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 04 18:34:38.515238 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: This rule already exists in group db5d0dac-1fc4-4ae3-a268-4040060bcd72 Oct 04 18:34:38.515238 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:34:38.515238 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:34:38.515238 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:34:38.515238 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:34:38.515238 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:34:38.515238 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:34:38.522114 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:34:38.522114 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:34:38.522114 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: This rule already exists in group db5d0dac-1fc4-4ae3-a268-4040060bcd72 Oct 04 18:34:38.522114 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:34:38.522114 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-21c277e1-6772-4626-bb78-115c0c50f601 tempest-SecurityGroupRulesNegativeTestJSON-1902147119 tempest-SecurityGroupRulesNegativeTestJSON-1902147119-project] Returning 400 to user: This rule already exists in group db5d0dac-1fc4-4ae3-a268-4040060bcd72 {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:34:38.522114 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-21c277e1-6772-4626-bb78-115c0c50f601 tempest-SecurityGroupRulesNegativeTestJSON-1902147119 tempest-SecurityGroupRulesNegativeTestJSON-1902147119-project] 10.222.0.43 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.089001 Oct 04 18:34:38.522114 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 513/936] 10.222.0.43 () {60 vars in 1195 bytes} [Tue Oct 4 18:34:38 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 91 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:34:38.523192 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a0ff7d8d-df5d-4860-a857-f4206e8fa3f9 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:38.523192 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a0ff7d8d-df5d-4860-a857-f4206e8fa3f9 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:38.523491 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a0ff7d8d-df5d-4860-a857-f4206e8fa3f9 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:38.524038 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a0ff7d8d-df5d-4860-a857-f4206e8fa3f9 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:38.524224 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-ff27e242-5889-4498-97cd-bd111c2237b6 tempest-UnshelveToHostMultiNodesTest-313056567 tempest-UnshelveToHostMultiNodesTest-313056567-project-admin] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:38.524712 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-ff27e242-5889-4498-97cd-bd111c2237b6 tempest-UnshelveToHostMultiNodesTest-313056567 tempest-UnshelveToHostMultiNodesTest-313056567-project-admin] [instance: 84e0414b-a39f-4bfe-bc9d-c170ceb34d15] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:38.525317 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a0ff7d8d-df5d-4860-a857-f4206e8fa3f9 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:38.526187 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a0ff7d8d-df5d-4860-a857-f4206e8fa3f9 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:38.538975 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ff27e242-5889-4498-97cd-bd111c2237b6 tempest-UnshelveToHostMultiNodesTest-313056567 tempest-UnshelveToHostMultiNodesTest-313056567-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:38.539827 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ff27e242-5889-4498-97cd-bd111c2237b6 tempest-UnshelveToHostMultiNodesTest-313056567 tempest-UnshelveToHostMultiNodesTest-313056567-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:38.540521 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ff27e242-5889-4498-97cd-bd111c2237b6 tempest-UnshelveToHostMultiNodesTest-313056567 tempest-UnshelveToHostMultiNodesTest-313056567-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:38.541555 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ff27e242-5889-4498-97cd-bd111c2237b6 tempest-UnshelveToHostMultiNodesTest-313056567 tempest-UnshelveToHostMultiNodesTest-313056567-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:38.542099 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ff27e242-5889-4498-97cd-bd111c2237b6 tempest-UnshelveToHostMultiNodesTest-313056567 tempest-UnshelveToHostMultiNodesTest-313056567-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:38.542607 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ff27e242-5889-4498-97cd-bd111c2237b6 tempest-UnshelveToHostMultiNodesTest-313056567 tempest-UnshelveToHostMultiNodesTest-313056567-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:38.662570 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.objects.instance [None req-ff27e242-5889-4498-97cd-bd111c2237b6 tempest-UnshelveToHostMultiNodesTest-313056567 tempest-UnshelveToHostMultiNodesTest-313056567-project-admin] Lazy-loading 'services' on Instance uuid 84e0414b-a39f-4bfe-bc9d-c170ceb34d15 {{(pid=123596) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:34:38.708245 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-ff27e242-5889-4498-97cd-bd111c2237b6 tempest-UnshelveToHostMultiNodesTest-313056567 tempest-UnshelveToHostMultiNodesTest-313056567-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15" status: 200 len: 1938 microversion: 2.91 time: 0.187472 Oct 04 18:34:38.712265 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 514/937] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:34:38 2022] GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15 => generated 1938 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:34:38.740724 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-707784d2-4257-479e-a0f8-844beb3ffd45 tempest-SecurityGroupRulesNegativeTestJSON-1902147119 tempest-SecurityGroupRulesNegativeTestJSON-1902147119-project] Calling method '.version_select at 0x7fb21fb7ac10>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:38.949660 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-707784d2-4257-479e-a0f8-844beb3ffd45 tempest-SecurityGroupRulesNegativeTestJSON-1902147119 tempest-SecurityGroupRulesNegativeTestJSON-1902147119-project] 10.222.0.43 "DELETE /compute/v2.1/os-security-group-rules/381840aa-5114-4ab2-8f83-8b741b9878eb" status: 202 len: 0 microversion: 2.1 time: 0.234281 Oct 04 18:34:38.956124 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 515/938] 10.222.0.43 () {58 vars in 1287 bytes} [Tue Oct 4 18:34:38 2022] DELETE /compute/v2.1/os-security-group-rules/381840aa-5114-4ab2-8f83-8b741b9878eb => generated 0 bytes in 241 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:34:38.967587 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-3e831588-b911-4639-8c79-55ee83697bc5 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:38.969961 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-3e831588-b911-4639-8c79-55ee83697bc5 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] [instance: 9895c2ec-35ea-419e-9565-0c0f2fc5bbbc] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:38.978648 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3e831588-b911-4639-8c79-55ee83697bc5 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:38.979603 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3e831588-b911-4639-8c79-55ee83697bc5 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:38.980398 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3e831588-b911-4639-8c79-55ee83697bc5 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:38.981598 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3e831588-b911-4639-8c79-55ee83697bc5 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:38.982268 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3e831588-b911-4639-8c79-55ee83697bc5 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:38.982936 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3e831588-b911-4639-8c79-55ee83697bc5 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:39.156578 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-3e831588-b911-4639-8c79-55ee83697bc5 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:39.167216 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-3e831588-b911-4639-8c79-55ee83697bc5 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:39.169412 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-3e831588-b911-4639-8c79-55ee83697bc5 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:39.170870 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-3e831588-b911-4639-8c79-55ee83697bc5 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] 10.222.0.43 "GET /compute/v2.1/servers/9895c2ec-35ea-419e-9565-0c0f2fc5bbbc" status: 200 len: 1566 microversion: 2.25 time: 0.213125 Oct 04 18:34:39.172010 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 516/939] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:34:38 2022] GET /compute/v2.1/servers/9895c2ec-35ea-419e-9565-0c0f2fc5bbbc => generated 1566 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:34:39.175019 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-a0ff7d8d-df5d-4860-a857-f4206e8fa3f9 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4aec5af742842f5bb2048c8b7d60687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829069b2787a423f922fcc5b5702f167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:39.178598 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-606f7796-2f5d-4512-b12f-ad5169305139 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:34:39.179130 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-606f7796-2f5d-4512-b12f-ad5169305139 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] [instance: 84e0414b-a39f-4bfe-bc9d-c170ceb34d15] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:39.186323 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-606f7796-2f5d-4512-b12f-ad5169305139 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:39.186866 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-606f7796-2f5d-4512-b12f-ad5169305139 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:39.187248 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-606f7796-2f5d-4512-b12f-ad5169305139 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:39.188005 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-606f7796-2f5d-4512-b12f-ad5169305139 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:39.189247 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-606f7796-2f5d-4512-b12f-ad5169305139 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:39.189677 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-606f7796-2f5d-4512-b12f-ad5169305139 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:39.203234 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-a0ff7d8d-df5d-4860-a857-f4206e8fa3f9 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] 10.222.0.43 "GET /compute/v2.1/servers/bcc13e2d-03e7-464d-abac-f5ffb7cbb509" status: 200 len: 1465 microversion: 2.1 time: 0.707043 Oct 04 18:34:39.208815 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 424/940] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:38 2022] GET /compute/v2.1/servers/bcc13e2d-03e7-464d-abac-f5ffb7cbb509 => generated 1465 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:39.218135 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-289f7370-d655-4028-9a5f-fcf5babe9c90 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:39.218392 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-289f7370-d655-4028-9a5f-fcf5babe9c90 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] [instance: 93798a9a-d90d-4a4e-8e30-d6575486ff56] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:39.225815 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-289f7370-d655-4028-9a5f-fcf5babe9c90 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:39.226001 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.objects.instance [None req-606f7796-2f5d-4512-b12f-ad5169305139 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lazy-loading 'flavor' on Instance uuid 84e0414b-a39f-4bfe-bc9d-c170ceb34d15 {{(pid=123596) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:34:39.237924 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-289f7370-d655-4028-9a5f-fcf5babe9c90 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:39.238393 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-289f7370-d655-4028-9a5f-fcf5babe9c90 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:39.239156 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-289f7370-d655-4028-9a5f-fcf5babe9c90 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:39.239625 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-289f7370-d655-4028-9a5f-fcf5babe9c90 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:39.240071 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-289f7370-d655-4028-9a5f-fcf5babe9c90 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:39.539665 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-289f7370-d655-4028-9a5f-fcf5babe9c90 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a41ab6fb78a42ceaca621c5a38ffc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa31ed92017490a82497c7b8910aef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:39.553780 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-289f7370-d655-4028-9a5f-fcf5babe9c90 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] 10.222.0.43 "GET /compute/v2.1/servers/93798a9a-d90d-4a4e-8e30-d6575486ff56" status: 200 len: 1308 microversion: 2.1 time: 0.342929 Oct 04 18:34:39.555409 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 425/941] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:39 2022] GET /compute/v2.1/servers/93798a9a-d90d-4a4e-8e30-d6575486ff56 => generated 1308 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:39.560567 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-1792763b-8f52-4833-afe4-16f7804ebee5 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:39.561290 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-1792763b-8f52-4833-afe4-16f7804ebee5 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] [instance: 8408d8e1-41b0-4185-8806-9808f082a016] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:39.568155 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1792763b-8f52-4833-afe4-16f7804ebee5 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:39.568658 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1792763b-8f52-4833-afe4-16f7804ebee5 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:39.569238 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1792763b-8f52-4833-afe4-16f7804ebee5 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:39.569989 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1792763b-8f52-4833-afe4-16f7804ebee5 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:39.570454 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1792763b-8f52-4833-afe4-16f7804ebee5 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:39.570891 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1792763b-8f52-4833-afe4-16f7804ebee5 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:39.577349 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-606f7796-2f5d-4512-b12f-ad5169305139 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] 10.222.0.43 "POST /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15/action" status: 202 len: 0 microversion: 2.91 time: 0.403842 Oct 04 18:34:39.578128 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 517/942] 10.222.0.43 () {62 vars in 1319 bytes} [Tue Oct 4 18:34:39 2022] POST /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15/action => generated 0 bytes in 405 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:34:39.586396 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-4527b0fb-e7f4-436d-ab49-7c958fc3ef3e tempest-SecurityGroupRulesNegativeTestJSON-1902147119 tempest-SecurityGroupRulesNegativeTestJSON-1902147119-project] Action: 'create', calling method: .version_select at 0x7fb21fd11b80>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-364693783", "description": "tempest-description-1379152073"}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:34:39.621884 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1792763b-8f52-4833-afe4-16f7804ebee5 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:39.622716 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1792763b-8f52-4833-afe4-16f7804ebee5 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:39.623759 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1792763b-8f52-4833-afe4-16f7804ebee5 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:39.624390 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.objects.instance [None req-1792763b-8f52-4833-afe4-16f7804ebee5 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lazy-loading 'fault' on Instance uuid 8408d8e1-41b0-4185-8806-9808f082a016 {{(pid=123595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:34:39.694094 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-1792763b-8f52-4833-afe4-16f7804ebee5 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7db99f361654711bea7f1b2c404d312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7adedcdb9c3485ea2738c00e25aa3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:39.704305 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-1792763b-8f52-4833-afe4-16f7804ebee5 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] 10.222.0.43 "GET /compute/v2.1/servers/8408d8e1-41b0-4185-8806-9808f082a016" status: 200 len: 1307 microversion: 2.1 time: 0.146583 Oct 04 18:34:39.707190 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 426/943] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:39 2022] GET /compute/v2.1/servers/8408d8e1-41b0-4185-8806-9808f082a016 => generated 1307 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:39.715130 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-559a3301-edf8-4c92-a013-5bff1dc8e49a tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:39.716439 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-559a3301-edf8-4c92-a013-5bff1dc8e49a tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] [instance: eb05639b-cd53-4c27-9505-20e668a16acc] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:39.725074 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-559a3301-edf8-4c92-a013-5bff1dc8e49a tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:39.726217 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-559a3301-edf8-4c92-a013-5bff1dc8e49a tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:39.727376 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-559a3301-edf8-4c92-a013-5bff1dc8e49a tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:39.728667 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-559a3301-edf8-4c92-a013-5bff1dc8e49a tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:39.729249 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-559a3301-edf8-4c92-a013-5bff1dc8e49a tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:39.729910 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-559a3301-edf8-4c92-a013-5bff1dc8e49a tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:39.979948 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-559a3301-edf8-4c92-a013-5bff1dc8e49a tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64887fff0bc7417094c4fee2f7e9aa5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6187bfad04cb7bc17155862ee0cdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:39.995629 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-559a3301-edf8-4c92-a013-5bff1dc8e49a tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] 10.222.0.43 "GET /compute/v2.1/servers/eb05639b-cd53-4c27-9505-20e668a16acc" status: 200 len: 1365 microversion: 2.1 time: 0.286164 Oct 04 18:34:39.996587 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-4527b0fb-e7f4-436d-ab49-7c958fc3ef3e tempest-SecurityGroupRulesNegativeTestJSON-1902147119 tempest-SecurityGroupRulesNegativeTestJSON-1902147119-project] 10.222.0.43 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.417430 Oct 04 18:34:39.997505 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 518/944] 10.222.0.43 () {60 vars in 1180 bytes} [Tue Oct 4 18:34:39 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:34:40.005903 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 427/945] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:39 2022] GET /compute/v2.1/servers/eb05639b-cd53-4c27-9505-20e668a16acc => generated 1365 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:40.009895 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-5749515c-c68c-4b8d-bd1f-e7241c434cdf tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:40.010800 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-5749515c-c68c-4b8d-bd1f-e7241c434cdf tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] [instance: 84e0414b-a39f-4bfe-bc9d-c170ceb34d15] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:40.020698 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-c1dc530e-040d-46fd-b026-2e73399a3322 req-2a6b590c-f108-415f-a06e-b9cb45e1175a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "533db4f5-5f62-47ab-9d4c-5e5a95c0b756", "name": "network-vif-deleted", "tag": "9dc10a12-f514-49cb-8d56-3dda7855de52"}, {"name": "network-changed", "server_uuid": "93798a9a-d90d-4a4e-8e30-d6575486ff56", "tag": "7b3aff25-35c6-4d42-9b23-577e2f738102"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:34:40.023708 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5749515c-c68c-4b8d-bd1f-e7241c434cdf tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:40.024283 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5749515c-c68c-4b8d-bd1f-e7241c434cdf tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:40.024808 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5749515c-c68c-4b8d-bd1f-e7241c434cdf tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:40.025722 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5749515c-c68c-4b8d-bd1f-e7241c434cdf tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:40.026251 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5749515c-c68c-4b8d-bd1f-e7241c434cdf tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:40.026753 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5749515c-c68c-4b8d-bd1f-e7241c434cdf tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:40.056802 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-c1dc530e-040d-46fd-b026-2e73399a3322 req-2a6b590c-f108-415f-a06e-b9cb45e1175a service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:40.057566 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-c1dc530e-040d-46fd-b026-2e73399a3322 req-2a6b590c-f108-415f-a06e-b9cb45e1175a service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:40.058201 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-c1dc530e-040d-46fd-b026-2e73399a3322 req-2a6b590c-f108-415f-a06e-b9cb45e1175a service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:40.076263 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-c1dc530e-040d-46fd-b026-2e73399a3322 req-2a6b590c-f108-415f-a06e-b9cb45e1175a service nova] Creating event network-vif-deleted:9dc10a12-f514-49cb-8d56-3dda7855de52 for instance 533db4f5-5f62-47ab-9d4c-5e5a95c0b756 on n-h2-851028-13 Oct 04 18:34:40.076783 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-c1dc530e-040d-46fd-b026-2e73399a3322 req-2a6b590c-f108-415f-a06e-b9cb45e1175a service nova] Creating event network-changed:7b3aff25-35c6-4d42-9b23-577e2f738102 for instance 93798a9a-d90d-4a4e-8e30-d6575486ff56 on n-h1-851028-13 Oct 04 18:34:40.087487 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-c1dc530e-040d-46fd-b026-2e73399a3322 req-2a6b590c-f108-415f-a06e-b9cb45e1175a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.080078 Oct 04 18:34:40.091489 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 519/946] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:34:40 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:34:40.135177 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-6f05d92f-f4a9-45b4-be1f-c91f5d3cdefb tempest-SecurityGroupRulesNegativeTestJSON-1902147119 tempest-SecurityGroupRulesNegativeTestJSON-1902147119-project] Action: 'create', calling method: .version_select at 0x7fb21fb69af0>, body: {"security_group_rule": {"parent_group_id": "1fc1e2cf-7a86-41b9-a6b8-b04994e8f300", "ip_protocol": "tcp", "from_port": 1641653771, "to_port": 22}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:34:40.227422 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-5749515c-c68c-4b8d-bd1f-e7241c434cdf tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:40.252512 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-5749515c-c68c-4b8d-bd1f-e7241c434cdf tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:40.259412 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-5749515c-c68c-4b8d-bd1f-e7241c434cdf tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:40.295706 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-5749515c-c68c-4b8d-bd1f-e7241c434cdf tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] 10.222.0.43 "GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15" status: 200 len: 1537 microversion: 2.91 time: 0.292851 Oct 04 18:34:40.296322 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 428/947] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:34:40 2022] GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15 => generated 1537 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:34:40.314340 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-a8c7fee9-e82e-4b6d-a46d-eabec921abe9 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:40.315329 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-a8c7fee9-e82e-4b6d-a46d-eabec921abe9 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] [instance: 9895c2ec-35ea-419e-9565-0c0f2fc5bbbc] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:40.331946 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a8c7fee9-e82e-4b6d-a46d-eabec921abe9 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:40.332850 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a8c7fee9-e82e-4b6d-a46d-eabec921abe9 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:40.334336 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a8c7fee9-e82e-4b6d-a46d-eabec921abe9 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:40.335264 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a8c7fee9-e82e-4b6d-a46d-eabec921abe9 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:40.339071 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a8c7fee9-e82e-4b6d-a46d-eabec921abe9 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:40.339754 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a8c7fee9-e82e-4b6d-a46d-eabec921abe9 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:40.459440 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-6f05d92f-f4a9-45b4-be1f-c91f5d3cdefb tempest-SecurityGroupRulesNegativeTestJSON-1902147119 tempest-SecurityGroupRulesNegativeTestJSON-1902147119-project] HTTP exception thrown: Invalid port range 1641653771:22. Former value cannot be greater than the later Oct 04 18:34:40.466984 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-6f05d92f-f4a9-45b4-be1f-c91f5d3cdefb tempest-SecurityGroupRulesNegativeTestJSON-1902147119 tempest-SecurityGroupRulesNegativeTestJSON-1902147119-project] Request method failure captured: Oct 04 18:34:40.466984 n-d-851028-13 devstack@n-api.service[123596]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 04 18:34:40.466984 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:34:40.466984 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:34:40.466984 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:34:40.466984 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 146 Oct 04 18:34:40.466984 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:34:40.466984 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:34:40.466984 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:34:40.466984 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:34:40.466984 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPHy8Wk37Kt-KEPYTw4ckPdWUqFxLgD2-K-78O18tkuJzgNpD7Tq8-0rrlYeqBFFk_KJuKAPrn-_DZEID1KQqBk5OQVTbaNjnTgvt70fy9R-59105DigD-QRLAsSvlfrSDFMi2XWbac2MgKNSOZSKOHGMT_kk9iQrNtiTfOjBiv7e1nM Oct 04 18:34:40.466984 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:34:40.466984 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:34:40.466984 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:34:40.466984 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:34:40.466984 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:34:40.466984 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:34:40.466984 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: 4a28e1fc23834fd2b065d34598efec10 Oct 04 18:34:40.466984 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1902147119 Oct 04 18:34:40.466984 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 18:34:40.466984 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 18:34:40.466984 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/4a28e1fc23834fd2b065d34598efec10"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_4a28e1fc23834fd2b065d34598efec10"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4a28e1fc23834fd2b065d34598efec10"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4a28e1fc23834fd2b065d34598efec10"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:34:40.466984 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1902147119 Oct 04 18:34:40.466984 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: 4a28e1fc23834fd2b065d34598efec10 Oct 04 18:34:40.466984 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1902147119 Oct 04 18:34:40.466984 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1902147119-project Oct 04 18:34:40.466984 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:34:40.466984 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:34:40.466984 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 5b93da9a8ec74ae3b1a206311bd01a8d Oct 04 18:34:40.466984 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1902147119-project Oct 04 18:34:40.466984 n-d-851028-13 devstack@n-api.service[123596]: Oct 04 18:34:40.466984 n-d-851028-13 devstack@n-api.service[123596]: {"security_group_rule": {"parent_group_id": "1fc1e2cf-7a86-41b9-a6b8-b04994e8f300", "ip_protocol": "tcp", "from_port": 1641653771, "to_port": 22}} Oct 04 18:34:40.466984 n-d-851028-13 devstack@n-api.service[123596]: method: Oct 04 18:34:40.466984 n-d-851028-13 devstack@n-api.service[123596]: exception: Invalid port range 1641653771:22. Former value cannot be greater than the later Oct 04 18:34:40.466984 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'body': {'security_group_rule': {'parent_group_id': '1fc1e2cf-7a86-41b9-a6b8-b04994e8f300', 'ip_protocol': 'tcp', 'from_port': 1641653771, 'to_port': 22}}} Oct 04 18:34:40.466984 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:34:40.466984 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:34:40.466984 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 04 18:34:40.466984 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 04 18:34:40.466984 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 04 18:34:40.466984 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 04 18:34:40.466984 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 04 18:34:40.466984 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 04 18:34:40.466984 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Oct 04 18:34:40.466984 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 04 18:34:40.466984 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 1641653771:22. Former value cannot be greater than the later Oct 04 18:34:40.466984 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:34:40.466984 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:34:40.466984 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:34:40.466984 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:34:40.466984 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:34:40.466984 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:34:40.466984 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:34:40.466984 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:34:40.466984 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:34:40.466984 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:34:40.466984 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:34:40.466984 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:34:40.466984 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 04 18:34:40.466984 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 04 18:34:40.466984 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 1641653771:22. Former value cannot be greater than the later Oct 04 18:34:40.466984 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:34:40.471545 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:34:40.471545 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:34:40.471545 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:34:40.471545 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:34:40.471545 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:34:40.471545 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:34:40.471545 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:34:40.471545 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 1641653771:22. Former value cannot be greater than the later Oct 04 18:34:40.471545 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:34:40.471545 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-6f05d92f-f4a9-45b4-be1f-c91f5d3cdefb tempest-SecurityGroupRulesNegativeTestJSON-1902147119 tempest-SecurityGroupRulesNegativeTestJSON-1902147119-project] Returning 400 to user: Invalid port range 1641653771:22. Former value cannot be greater than the later {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:34:40.471545 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-6f05d92f-f4a9-45b4-be1f-c91f5d3cdefb tempest-SecurityGroupRulesNegativeTestJSON-1902147119 tempest-SecurityGroupRulesNegativeTestJSON-1902147119-project] 10.222.0.43 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 123 microversion: 2.1 time: 0.375732 Oct 04 18:34:40.471545 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 520/948] 10.222.0.43 () {60 vars in 1195 bytes} [Tue Oct 4 18:34:40 2022] POST /compute/v2.1/os-security-group-rules => generated 123 bytes in 377 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:34:40.478837 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-8a77ef66-49aa-4452-a38e-1dcfe36233e3 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:40.479922 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-8a77ef66-49aa-4452-a38e-1dcfe36233e3 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] [instance: bcc13e2d-03e7-464d-abac-f5ffb7cbb509] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:40.490843 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8a77ef66-49aa-4452-a38e-1dcfe36233e3 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:40.491359 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8a77ef66-49aa-4452-a38e-1dcfe36233e3 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:40.491820 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8a77ef66-49aa-4452-a38e-1dcfe36233e3 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:40.492533 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8a77ef66-49aa-4452-a38e-1dcfe36233e3 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:40.493686 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8a77ef66-49aa-4452-a38e-1dcfe36233e3 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:40.494129 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8a77ef66-49aa-4452-a38e-1dcfe36233e3 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:40.516174 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:34:40.878425 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-a8c7fee9-e82e-4b6d-a46d-eabec921abe9 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:40.893586 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-a8c7fee9-e82e-4b6d-a46d-eabec921abe9 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:40.893799 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-8a77ef66-49aa-4452-a38e-1dcfe36233e3 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4aec5af742842f5bb2048c8b7d60687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829069b2787a423f922fcc5b5702f167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:40.895069 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-a8c7fee9-e82e-4b6d-a46d-eabec921abe9 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:40.900892 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-a8c7fee9-e82e-4b6d-a46d-eabec921abe9 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] 10.222.0.43 "GET /compute/v2.1/servers/9895c2ec-35ea-419e-9565-0c0f2fc5bbbc" status: 200 len: 1566 microversion: 2.25 time: 0.600262 Oct 04 18:34:40.904545 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-8a77ef66-49aa-4452-a38e-1dcfe36233e3 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] 10.222.0.43 "GET /compute/v2.1/servers/bcc13e2d-03e7-464d-abac-f5ffb7cbb509" status: 200 len: 1465 microversion: 2.1 time: 0.433769 Oct 04 18:34:40.913448 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 429/949] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:34:40 2022] GET /compute/v2.1/servers/9895c2ec-35ea-419e-9565-0c0f2fc5bbbc => generated 1566 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:34:40.919771 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-905e516a-83a3-4361-90da-5210b4f00aee tempest-SecurityGroupRulesNegativeTestJSON-1902147119 tempest-SecurityGroupRulesNegativeTestJSON-1902147119-project] Action: 'create', calling method: .version_select at 0x7fb21fc60820>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1191366657", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:34:40.921781 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-905e516a-83a3-4361-90da-5210b4f00aee tempest-SecurityGroupRulesNegativeTestJSON-1902147119 tempest-SecurityGroupRulesNegativeTestJSON-1902147119-project] HTTP exception thrown: Security group id should be uuid Oct 04 18:34:40.923882 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-905e516a-83a3-4361-90da-5210b4f00aee tempest-SecurityGroupRulesNegativeTestJSON-1902147119 tempest-SecurityGroupRulesNegativeTestJSON-1902147119-project] Request method failure captured: Oct 04 18:34:40.923882 n-d-851028-13 devstack@n-api.service[123595]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 04 18:34:40.923882 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 18:34:40.923882 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 18:34:40.923882 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 18:34:40.923882 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 131 Oct 04 18:34:40.923882 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 18:34:40.923882 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 18:34:40.923882 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 18:34:40.923882 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 18:34:40.923882 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPHy8Wk37Kt-KEPYTw4ckPdWUqFxLgD2-K-78O18tkuJzgNpD7Tq8-0rrlYeqBFFk_KJuKAPrn-_DZEID1KQqBk5OQVTbaNjnTgvt70fy9R-59105DigD-QRLAsSvlfrSDFMi2XWbac2MgKNSOZSKOHGMT_kk9iQrNtiTfOjBiv7e1nM Oct 04 18:34:40.923882 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 18:34:40.923882 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 18:34:40.923882 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 18:34:40.923882 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 18:34:40.923882 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 18:34:40.923882 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 18:34:40.923882 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: 4a28e1fc23834fd2b065d34598efec10 Oct 04 18:34:40.923882 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1902147119 Oct 04 18:34:40.923882 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 18:34:40.923882 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 18:34:40.923882 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/4a28e1fc23834fd2b065d34598efec10"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_4a28e1fc23834fd2b065d34598efec10"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4a28e1fc23834fd2b065d34598efec10"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4a28e1fc23834fd2b065d34598efec10"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:34:40.923882 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1902147119 Oct 04 18:34:40.923882 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: 4a28e1fc23834fd2b065d34598efec10 Oct 04 18:34:40.923882 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1902147119 Oct 04 18:34:40.923882 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1902147119-project Oct 04 18:34:40.923882 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 18:34:40.923882 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 18:34:40.923882 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: 5b93da9a8ec74ae3b1a206311bd01a8d Oct 04 18:34:40.923882 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1902147119-project Oct 04 18:34:40.923882 n-d-851028-13 devstack@n-api.service[123595]: Oct 04 18:34:40.923882 n-d-851028-13 devstack@n-api.service[123595]: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1191366657", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 04 18:34:40.923882 n-d-851028-13 devstack@n-api.service[123595]: method: Oct 04 18:34:40.923882 n-d-851028-13 devstack@n-api.service[123595]: exception: Security group id should be uuid Oct 04 18:34:40.923882 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'tempest-non_int_id-1191366657', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 04 18:34:40.923882 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:34:40.923882 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:34:40.923882 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 285, in create Oct 04 18:34:40.923882 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi parent_group_id = security_group_api.validate_id( Oct 04 18:34:40.923882 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 51, in validate_id Oct 04 18:34:40.923882 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Oct 04 18:34:40.923882 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security group id should be uuid Oct 04 18:34:40.923882 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:34:40.923882 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:34:40.923882 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:34:40.923882 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:34:40.923882 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:34:40.923882 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:34:40.923882 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:34:40.923882 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:34:40.923882 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:34:40.923882 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:34:40.923882 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:34:40.923882 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:34:40.923882 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 04 18:34:40.923882 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 04 18:34:40.923882 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security group id should be uuid Oct 04 18:34:40.923882 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:34:40.923882 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:34:40.923882 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:34:40.923882 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:34:40.923882 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:34:40.923882 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:34:40.923882 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:34:40.923882 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:34:40.927974 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group id should be uuid Oct 04 18:34:40.927974 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:34:40.927974 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-905e516a-83a3-4361-90da-5210b4f00aee tempest-SecurityGroupRulesNegativeTestJSON-1902147119 tempest-SecurityGroupRulesNegativeTestJSON-1902147119-project] Returning 400 to user: Security group id should be uuid {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:34:40.927974 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-905e516a-83a3-4361-90da-5210b4f00aee tempest-SecurityGroupRulesNegativeTestJSON-1902147119 tempest-SecurityGroupRulesNegativeTestJSON-1902147119-project] 10.222.0.43 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.010761 Oct 04 18:34:40.928246 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 521/950] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:40 2022] GET /compute/v2.1/servers/bcc13e2d-03e7-464d-abac-f5ffb7cbb509 => generated 1465 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:40.931061 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-7a84ecf8-3f96-4d55-851d-4b2d8d21883c tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:40.931600 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-7a84ecf8-3f96-4d55-851d-4b2d8d21883c tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] [instance: 93798a9a-d90d-4a4e-8e30-d6575486ff56] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:40.931974 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 430/951] 10.222.0.43 () {60 vars in 1195 bytes} [Tue Oct 4 18:34:40 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 04 18:34:40.944832 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-2a9cfbd3-1b5b-49a8-8cc4-1ba3749562c3 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:40.945479 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-2a9cfbd3-1b5b-49a8-8cc4-1ba3749562c3 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] [instance: 8408d8e1-41b0-4185-8806-9808f082a016] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:40.949805 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=10 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:34:40.951738 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7a84ecf8-3f96-4d55-851d-4b2d8d21883c tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:40.953870 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7a84ecf8-3f96-4d55-851d-4b2d8d21883c tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:40.955286 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7a84ecf8-3f96-4d55-851d-4b2d8d21883c tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:40.957516 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7a84ecf8-3f96-4d55-851d-4b2d8d21883c tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:40.958392 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7a84ecf8-3f96-4d55-851d-4b2d8d21883c tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:40.959263 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7a84ecf8-3f96-4d55-851d-4b2d8d21883c tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:40.967265 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2a9cfbd3-1b5b-49a8-8cc4-1ba3749562c3 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:40.967778 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2a9cfbd3-1b5b-49a8-8cc4-1ba3749562c3 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:40.968430 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2a9cfbd3-1b5b-49a8-8cc4-1ba3749562c3 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:40.969383 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2a9cfbd3-1b5b-49a8-8cc4-1ba3749562c3 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:40.970009 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2a9cfbd3-1b5b-49a8-8cc4-1ba3749562c3 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:40.970506 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2a9cfbd3-1b5b-49a8-8cc4-1ba3749562c3 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:41.054112 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2a9cfbd3-1b5b-49a8-8cc4-1ba3749562c3 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:41.063253 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2a9cfbd3-1b5b-49a8-8cc4-1ba3749562c3 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:41.063943 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2a9cfbd3-1b5b-49a8-8cc4-1ba3749562c3 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:41.064425 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.objects.instance [None req-2a9cfbd3-1b5b-49a8-8cc4-1ba3749562c3 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lazy-loading 'fault' on Instance uuid 8408d8e1-41b0-4185-8806-9808f082a016 {{(pid=123595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:34:41.164212 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-2a9cfbd3-1b5b-49a8-8cc4-1ba3749562c3 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7db99f361654711bea7f1b2c404d312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7adedcdb9c3485ea2738c00e25aa3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:41.174440 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-2a9cfbd3-1b5b-49a8-8cc4-1ba3749562c3 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] 10.222.0.43 "GET /compute/v2.1/servers/8408d8e1-41b0-4185-8806-9808f082a016" status: 200 len: 1307 microversion: 2.1 time: 0.241342 Oct 04 18:34:41.186364 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 431/952] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:40 2022] GET /compute/v2.1/servers/8408d8e1-41b0-4185-8806-9808f082a016 => generated 1307 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:41.192341 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-7abfe1d6-ca53-4418-9393-f841132eef97 tempest-SecurityGroupRulesNegativeTestJSON-1902147119 tempest-SecurityGroupRulesNegativeTestJSON-1902147119-project] Action: 'create', calling method: .version_select at 0x7fb21fe78430>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-523666593", "description": "tempest-description-1405709232"}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:34:41.254441 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-7a84ecf8-3f96-4d55-851d-4b2d8d21883c tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a41ab6fb78a42ceaca621c5a38ffc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa31ed92017490a82497c7b8910aef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:41.280396 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-7a84ecf8-3f96-4d55-851d-4b2d8d21883c tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] 10.222.0.43 "GET /compute/v2.1/servers/93798a9a-d90d-4a4e-8e30-d6575486ff56" status: 200 len: 1308 microversion: 2.1 time: 0.351302 Oct 04 18:34:41.282165 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 522/953] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:40 2022] GET /compute/v2.1/servers/93798a9a-d90d-4a4e-8e30-d6575486ff56 => generated 1308 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:41.307845 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-76f91fb6-da96-4ec2-a7cd-87efb4d45fe0 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:41.308866 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-76f91fb6-da96-4ec2-a7cd-87efb4d45fe0 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] [instance: eb05639b-cd53-4c27-9505-20e668a16acc] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:41.318109 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-76f91fb6-da96-4ec2-a7cd-87efb4d45fe0 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:41.319103 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-76f91fb6-da96-4ec2-a7cd-87efb4d45fe0 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:41.319856 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-76f91fb6-da96-4ec2-a7cd-87efb4d45fe0 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:41.321638 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-76f91fb6-da96-4ec2-a7cd-87efb4d45fe0 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:41.322247 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-76f91fb6-da96-4ec2-a7cd-87efb4d45fe0 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:41.322832 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-76f91fb6-da96-4ec2-a7cd-87efb4d45fe0 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:41.943354 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-76f91fb6-da96-4ec2-a7cd-87efb4d45fe0 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64887fff0bc7417094c4fee2f7e9aa5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6187bfad04cb7bc17155862ee0cdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:41.951863 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-76f91fb6-da96-4ec2-a7cd-87efb4d45fe0 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] 10.222.0.43 "GET /compute/v2.1/servers/eb05639b-cd53-4c27-9505-20e668a16acc" status: 200 len: 1365 microversion: 2.1 time: 0.650369 Oct 04 18:34:41.952818 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 523/954] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:41 2022] GET /compute/v2.1/servers/eb05639b-cd53-4c27-9505-20e668a16acc => generated 1365 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:41.958983 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-7b8d44e5-7b03-45fa-a50c-5d5f727135db tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:41.959824 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-7b8d44e5-7b03-45fa-a50c-5d5f727135db tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] [instance: 84e0414b-a39f-4bfe-bc9d-c170ceb34d15] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:41.970851 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7b8d44e5-7b03-45fa-a50c-5d5f727135db tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:41.971500 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7b8d44e5-7b03-45fa-a50c-5d5f727135db tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:41.972065 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7b8d44e5-7b03-45fa-a50c-5d5f727135db tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:41.973062 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7b8d44e5-7b03-45fa-a50c-5d5f727135db tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:41.974500 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7b8d44e5-7b03-45fa-a50c-5d5f727135db tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:41.975195 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7b8d44e5-7b03-45fa-a50c-5d5f727135db tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:42.199688 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-7b8d44e5-7b03-45fa-a50c-5d5f727135db tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:42.218407 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-7b8d44e5-7b03-45fa-a50c-5d5f727135db tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:42.220394 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-7b8d44e5-7b03-45fa-a50c-5d5f727135db tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:42.229355 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-7b8d44e5-7b03-45fa-a50c-5d5f727135db tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] 10.222.0.43 "GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15" status: 200 len: 1537 microversion: 2.91 time: 0.275382 Oct 04 18:34:42.229956 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 524/955] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:34:41 2022] GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15 => generated 1537 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:34:42.246286 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-199b96b7-8dcf-44c5-a411-9f72ccf71d87 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:42.247835 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-199b96b7-8dcf-44c5-a411-9f72ccf71d87 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] [instance: 9895c2ec-35ea-419e-9565-0c0f2fc5bbbc] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:42.270852 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-199b96b7-8dcf-44c5-a411-9f72ccf71d87 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:42.271723 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-199b96b7-8dcf-44c5-a411-9f72ccf71d87 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:42.272375 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-199b96b7-8dcf-44c5-a411-9f72ccf71d87 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:42.273385 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-199b96b7-8dcf-44c5-a411-9f72ccf71d87 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:42.274298 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-199b96b7-8dcf-44c5-a411-9f72ccf71d87 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:42.275115 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-199b96b7-8dcf-44c5-a411-9f72ccf71d87 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:42.415702 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-7abfe1d6-ca53-4418-9393-f841132eef97 tempest-SecurityGroupRulesNegativeTestJSON-1902147119 tempest-SecurityGroupRulesNegativeTestJSON-1902147119-project] 10.222.0.43 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 1.227840 Oct 04 18:34:42.416441 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 432/956] 10.222.0.43 () {60 vars in 1180 bytes} [Tue Oct 4 18:34:41 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 1229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:34:42.421466 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-894fa2f4-d515-4772-8e18-fe411d8492fb tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:42.422950 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-894fa2f4-d515-4772-8e18-fe411d8492fb tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] [instance: bcc13e2d-03e7-464d-abac-f5ffb7cbb509] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:42.444281 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-894fa2f4-d515-4772-8e18-fe411d8492fb tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:42.444384 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-894fa2f4-d515-4772-8e18-fe411d8492fb tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:42.444778 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-894fa2f4-d515-4772-8e18-fe411d8492fb tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:42.445575 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-894fa2f4-d515-4772-8e18-fe411d8492fb tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:42.446039 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-894fa2f4-d515-4772-8e18-fe411d8492fb tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:42.446472 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-894fa2f4-d515-4772-8e18-fe411d8492fb tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:42.514592 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-894fa2f4-d515-4772-8e18-fe411d8492fb tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:42.515839 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-894fa2f4-d515-4772-8e18-fe411d8492fb tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:42.516431 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-894fa2f4-d515-4772-8e18-fe411d8492fb tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:42.517359 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.objects.instance [None req-894fa2f4-d515-4772-8e18-fe411d8492fb tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lazy-loading 'fault' on Instance uuid bcc13e2d-03e7-464d-abac-f5ffb7cbb509 {{(pid=123595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:34:42.605333 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-894fa2f4-d515-4772-8e18-fe411d8492fb tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4aec5af742842f5bb2048c8b7d60687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829069b2787a423f922fcc5b5702f167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:42.613846 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-894fa2f4-d515-4772-8e18-fe411d8492fb tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] 10.222.0.43 "GET /compute/v2.1/servers/bcc13e2d-03e7-464d-abac-f5ffb7cbb509" status: 200 len: 1309 microversion: 2.1 time: 0.195966 Oct 04 18:34:42.614943 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 433/957] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:42 2022] GET /compute/v2.1/servers/bcc13e2d-03e7-464d-abac-f5ffb7cbb509 => generated 1309 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:42.620358 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-e35ee01f-a4d0-4b5b-93f0-79bb82ea3843 req-14376b85-26f8-4a86-9773-5b2237f6ff81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bcc13e2d-03e7-464d-abac-f5ffb7cbb509", "name": "network-vif-deleted", "tag": "245a7e0d-101b-4e22-8ab0-1570a93277ef"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:34:42.630059 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-e35ee01f-a4d0-4b5b-93f0-79bb82ea3843 req-14376b85-26f8-4a86-9773-5b2237f6ff81 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:42.630713 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-e35ee01f-a4d0-4b5b-93f0-79bb82ea3843 req-14376b85-26f8-4a86-9773-5b2237f6ff81 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:42.631485 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-e35ee01f-a4d0-4b5b-93f0-79bb82ea3843 req-14376b85-26f8-4a86-9773-5b2237f6ff81 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:42.645252 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-e35ee01f-a4d0-4b5b-93f0-79bb82ea3843 req-14376b85-26f8-4a86-9773-5b2237f6ff81 service nova] Creating event network-vif-deleted:245a7e0d-101b-4e22-8ab0-1570a93277ef for instance bcc13e2d-03e7-464d-abac-f5ffb7cbb509 on n-h2-851028-13 Oct 04 18:34:42.650239 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-e35ee01f-a4d0-4b5b-93f0-79bb82ea3843 req-14376b85-26f8-4a86-9773-5b2237f6ff81 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033972 Oct 04 18:34:42.651376 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 434/958] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:34:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:34:42.657606 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-62e774df-4620-4a8b-bbb3-ec1623701201 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:42.658378 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-62e774df-4620-4a8b-bbb3-ec1623701201 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] [instance: 8408d8e1-41b0-4185-8806-9808f082a016] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:42.665591 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-62e774df-4620-4a8b-bbb3-ec1623701201 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:42.665591 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-62e774df-4620-4a8b-bbb3-ec1623701201 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:42.665845 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-62e774df-4620-4a8b-bbb3-ec1623701201 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:42.666879 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-62e774df-4620-4a8b-bbb3-ec1623701201 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:42.667501 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-62e774df-4620-4a8b-bbb3-ec1623701201 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:42.667927 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-62e774df-4620-4a8b-bbb3-ec1623701201 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:42.682465 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-62e774df-4620-4a8b-bbb3-ec1623701201 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] HTTP exception thrown: Instance 8408d8e1-41b0-4185-8806-9808f082a016 could not be found. Oct 04 18:34:42.684123 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-62e774df-4620-4a8b-bbb3-ec1623701201 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Request method failure captured: Oct 04 18:34:42.684123 n-d-851028-13 devstack@n-api.service[123595]: request: GET /compute/v2.1/servers/8408d8e1-41b0-4185-8806-9808f082a016 HTTP/1.1 Oct 04 18:34:42.684123 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 18:34:42.684123 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 18:34:42.684123 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 18:34:42.684123 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 0 Oct 04 18:34:42.684123 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 18:34:42.684123 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 18:34:42.684123 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 18:34:42.684123 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 18:34:42.684123 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPHvuItqv5xcxbp_bqbjUggZhpUG53TiGDPrqjFiNZGHAMY6QdeICs1jR4QxEtGJ9kJciv8ws3outzNBgAd1ZiItYEkQ7c76M1xzjstLBOG0OAwb8aGthDLSqRW7T7V0wj50TxoUUgeNpSMbG6VscuaiI7GHr0fqlhRjDqzMaKz-IIxQ Oct 04 18:34:42.684123 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 18:34:42.684123 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 18:34:42.684123 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 18:34:42.684123 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 18:34:42.684123 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 18:34:42.684123 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 18:34:42.684123 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: e7adedcdb9c3485ea2738c00e25aa3fd Oct 04 18:34:42.684123 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-ServersOnMultiNodesTest-1469796738 Oct 04 18:34:42.684123 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 18:34:42.684123 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 18:34:42.684123 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/e7adedcdb9c3485ea2738c00e25aa3fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_e7adedcdb9c3485ea2738c00e25aa3fd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/e7adedcdb9c3485ea2738c00e25aa3fd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/e7adedcdb9c3485ea2738c00e25aa3fd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:34:42.684123 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-ServersOnMultiNodesTest-1469796738 Oct 04 18:34:42.684123 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: e7adedcdb9c3485ea2738c00e25aa3fd Oct 04 18:34:42.684123 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1469796738 Oct 04 18:34:42.684123 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-ServersOnMultiNodesTest-1469796738-project Oct 04 18:34:42.684123 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 18:34:42.684123 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 18:34:42.684123 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: a7db99f361654711bea7f1b2c404d312 Oct 04 18:34:42.684123 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-ServersOnMultiNodesTest-1469796738-project Oct 04 18:34:42.684123 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 18:34:42.684123 n-d-851028-13 devstack@n-api.service[123595]: exception: Instance 8408d8e1-41b0-4185-8806-9808f082a016 could not be found. Oct 04 18:34:42.684123 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': '8408d8e1-41b0-4185-8806-9808f082a016'} Oct 04 18:34:42.684123 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:34:42.684123 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:34:42.684123 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:34:42.684123 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:34:42.684123 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:34:42.684123 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:34:42.684123 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:34:42.684123 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:34:42.684123 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:34:42.684123 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:34:42.684123 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8408d8e1-41b0-4185-8806-9808f082a016 could not be found. Oct 04 18:34:42.684123 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:34:42.684123 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:34:42.684123 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:34:42.684123 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:34:42.684123 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:34:42.684123 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:34:42.684123 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:34:42.684123 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:34:42.684123 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:34:42.684123 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:34:42.684123 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:34:42.684123 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:34:42.684123 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:34:42.684123 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:34:42.684123 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:34:42.684123 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:34:42.684123 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8408d8e1-41b0-4185-8806-9808f082a016 could not be found. Oct 04 18:34:42.684123 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:34:42.684123 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:34:42.684123 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:34:42.688562 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:34:42.688562 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:34:42.688562 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:34:42.688562 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:34:42.688562 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:34:42.688562 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8408d8e1-41b0-4185-8806-9808f082a016 could not be found. Oct 04 18:34:42.688562 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:34:42.688562 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-62e774df-4620-4a8b-bbb3-ec1623701201 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Returning 404 to user: Instance 8408d8e1-41b0-4185-8806-9808f082a016 could not be found. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:34:42.688562 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-62e774df-4620-4a8b-bbb3-ec1623701201 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] 10.222.0.43 "GET /compute/v2.1/servers/8408d8e1-41b0-4185-8806-9808f082a016" status: 404 len: 111 microversion: 2.1 time: 0.032929 Oct 04 18:34:42.688562 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 435/959] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:42 2022] GET /compute/v2.1/servers/8408d8e1-41b0-4185-8806-9808f082a016 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:34:42.691093 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-f77c0ffa-f7ab-4f85-92c1-8d559b4e38d6 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:42.691763 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-f77c0ffa-f7ab-4f85-92c1-8d559b4e38d6 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] [instance: 93798a9a-d90d-4a4e-8e30-d6575486ff56] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:42.697832 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f77c0ffa-f7ab-4f85-92c1-8d559b4e38d6 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:42.698313 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f77c0ffa-f7ab-4f85-92c1-8d559b4e38d6 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:42.698915 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f77c0ffa-f7ab-4f85-92c1-8d559b4e38d6 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:42.699750 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f77c0ffa-f7ab-4f85-92c1-8d559b4e38d6 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:42.700363 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f77c0ffa-f7ab-4f85-92c1-8d559b4e38d6 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:42.700793 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f77c0ffa-f7ab-4f85-92c1-8d559b4e38d6 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:42.737633 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-199b96b7-8dcf-44c5-a411-9f72ccf71d87 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:42.746777 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-199b96b7-8dcf-44c5-a411-9f72ccf71d87 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:42.748187 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-199b96b7-8dcf-44c5-a411-9f72ccf71d87 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:42.749409 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-199b96b7-8dcf-44c5-a411-9f72ccf71d87 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] 10.222.0.43 "GET /compute/v2.1/servers/9895c2ec-35ea-419e-9565-0c0f2fc5bbbc" status: 200 len: 1566 microversion: 2.25 time: 0.514645 Oct 04 18:34:42.770379 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 525/960] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:34:42 2022] GET /compute/v2.1/servers/9895c2ec-35ea-419e-9565-0c0f2fc5bbbc => generated 1566 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:34:42.775952 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-02f2c422-016a-4000-a5f6-dc42b8af9405 req-9732367d-0bef-4396-8e89-616b1a4c982f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb05639b-cd53-4c27-9505-20e668a16acc", "name": "network-vif-plugged", "status": "completed", "tag": "1ffe1dcb-316b-4423-ae6b-6882dba87be0"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:34:42.786731 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-02f2c422-016a-4000-a5f6-dc42b8af9405 req-9732367d-0bef-4396-8e89-616b1a4c982f service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:42.787217 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-02f2c422-016a-4000-a5f6-dc42b8af9405 req-9732367d-0bef-4396-8e89-616b1a4c982f service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:42.787658 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-02f2c422-016a-4000-a5f6-dc42b8af9405 req-9732367d-0bef-4396-8e89-616b1a4c982f service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:42.801885 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-02f2c422-016a-4000-a5f6-dc42b8af9405 req-9732367d-0bef-4396-8e89-616b1a4c982f service nova] Creating event network-vif-plugged:1ffe1dcb-316b-4423-ae6b-6882dba87be0 for instance eb05639b-cd53-4c27-9505-20e668a16acc on n-h2-851028-13 Oct 04 18:34:42.808390 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-02f2c422-016a-4000-a5f6-dc42b8af9405 req-9732367d-0bef-4396-8e89-616b1a4c982f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036648 Oct 04 18:34:42.809534 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 526/961] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:34:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:34:42.817748 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-bad54adb-89f8-4a60-8320-b898261d5a87 tempest-SecurityGroupRulesNegativeTestJSON-1902147119 tempest-SecurityGroupRulesNegativeTestJSON-1902147119-project] Action: 'create', calling method: .version_select at 0x7fb21fb6eb80>, body: {"security_group_rule": {"parent_group_id": "204e5115-7a8e-4058-947b-eec368e3a2e0", "ip_protocol": "tempest-999-2032253488", "from_port": 22, "to_port": 22}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:34:42.947264 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-f77c0ffa-f7ab-4f85-92c1-8d559b4e38d6 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a41ab6fb78a42ceaca621c5a38ffc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa31ed92017490a82497c7b8910aef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:42.956885 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-f77c0ffa-f7ab-4f85-92c1-8d559b4e38d6 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] 10.222.0.43 "GET /compute/v2.1/servers/93798a9a-d90d-4a4e-8e30-d6575486ff56" status: 200 len: 1308 microversion: 2.1 time: 0.269320 Oct 04 18:34:42.972872 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 436/962] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:42 2022] GET /compute/v2.1/servers/93798a9a-d90d-4a4e-8e30-d6575486ff56 => generated 1308 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:42.980614 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-c484b69a-1903-4e6f-80c0-b10da56d78ae tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:42.981507 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-c484b69a-1903-4e6f-80c0-b10da56d78ae tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] [instance: fc077a8b-c0f8-4bb1-8a39-91874ac015e7] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:42.989548 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c484b69a-1903-4e6f-80c0-b10da56d78ae tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:42.990369 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c484b69a-1903-4e6f-80c0-b10da56d78ae tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:42.991267 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c484b69a-1903-4e6f-80c0-b10da56d78ae tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:42.992746 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c484b69a-1903-4e6f-80c0-b10da56d78ae tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:42.993325 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c484b69a-1903-4e6f-80c0-b10da56d78ae tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:42.993967 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c484b69a-1903-4e6f-80c0-b10da56d78ae tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:43.002398 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-bad54adb-89f8-4a60-8320-b898261d5a87 tempest-SecurityGroupRulesNegativeTestJSON-1902147119 tempest-SecurityGroupRulesNegativeTestJSON-1902147119-project] HTTP exception thrown: Invalid IP protocol tempest-999-2032253488. Oct 04 18:34:43.004822 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-bad54adb-89f8-4a60-8320-b898261d5a87 tempest-SecurityGroupRulesNegativeTestJSON-1902147119 tempest-SecurityGroupRulesNegativeTestJSON-1902147119-project] Request method failure captured: Oct 04 18:34:43.004822 n-d-851028-13 devstack@n-api.service[123596]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 04 18:34:43.004822 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:34:43.004822 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:34:43.004822 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:34:43.004822 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 157 Oct 04 18:34:43.004822 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:34:43.004822 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:34:43.004822 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:34:43.004822 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:34:43.004822 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPHy8Wk37Kt-KEPYTw4ckPdWUqFxLgD2-K-78O18tkuJzgNpD7Tq8-0rrlYeqBFFk_KJuKAPrn-_DZEID1KQqBk5OQVTbaNjnTgvt70fy9R-59105DigD-QRLAsSvlfrSDFMi2XWbac2MgKNSOZSKOHGMT_kk9iQrNtiTfOjBiv7e1nM Oct 04 18:34:43.004822 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:34:43.004822 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:34:43.004822 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:34:43.004822 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:34:43.004822 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:34:43.004822 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:34:43.004822 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: 4a28e1fc23834fd2b065d34598efec10 Oct 04 18:34:43.004822 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1902147119 Oct 04 18:34:43.004822 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 18:34:43.004822 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 18:34:43.004822 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/4a28e1fc23834fd2b065d34598efec10"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_4a28e1fc23834fd2b065d34598efec10"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4a28e1fc23834fd2b065d34598efec10"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4a28e1fc23834fd2b065d34598efec10"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:34:43.004822 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1902147119 Oct 04 18:34:43.004822 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: 4a28e1fc23834fd2b065d34598efec10 Oct 04 18:34:43.004822 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1902147119 Oct 04 18:34:43.004822 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1902147119-project Oct 04 18:34:43.004822 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:34:43.004822 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:34:43.004822 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 5b93da9a8ec74ae3b1a206311bd01a8d Oct 04 18:34:43.004822 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1902147119-project Oct 04 18:34:43.004822 n-d-851028-13 devstack@n-api.service[123596]: Oct 04 18:34:43.004822 n-d-851028-13 devstack@n-api.service[123596]: {"security_group_rule": {"parent_group_id": "204e5115-7a8e-4058-947b-eec368e3a2e0", "ip_protocol": "tempest-999-2032253488", "from_port": 22, "to_port": 22}} Oct 04 18:34:43.004822 n-d-851028-13 devstack@n-api.service[123596]: method: Oct 04 18:34:43.004822 n-d-851028-13 devstack@n-api.service[123596]: exception: Invalid IP protocol tempest-999-2032253488. Oct 04 18:34:43.004822 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'body': {'security_group_rule': {'parent_group_id': '204e5115-7a8e-4058-947b-eec368e3a2e0', 'ip_protocol': 'tempest-999-2032253488', 'from_port': 22, 'to_port': 22}}} Oct 04 18:34:43.004822 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:34:43.004822 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:34:43.004822 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 04 18:34:43.004822 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 04 18:34:43.004822 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 04 18:34:43.004822 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 04 18:34:43.004822 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 04 18:34:43.004822 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 04 18:34:43.004822 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 144, in _new_ingress_rule Oct 04 18:34:43.004822 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.InvalidIpProtocol(protocol=ip_protocol) Oct 04 18:34:43.004822 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.InvalidIpProtocol: Invalid IP protocol tempest-999-2032253488. Oct 04 18:34:43.004822 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:34:43.004822 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:34:43.004822 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:34:43.004822 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:34:43.004822 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:34:43.004822 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:34:43.004822 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:34:43.004822 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:34:43.004822 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:34:43.004822 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:34:43.004822 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:34:43.004822 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:34:43.004822 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 04 18:34:43.004822 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 04 18:34:43.004822 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid IP protocol tempest-999-2032253488. Oct 04 18:34:43.004822 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:34:43.004822 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:34:43.009190 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:34:43.009190 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:34:43.009190 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:34:43.009190 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:34:43.009190 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:34:43.009190 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:34:43.009190 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid IP protocol tempest-999-2032253488. Oct 04 18:34:43.009190 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:34:43.009190 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-bad54adb-89f8-4a60-8320-b898261d5a87 tempest-SecurityGroupRulesNegativeTestJSON-1902147119 tempest-SecurityGroupRulesNegativeTestJSON-1902147119-project] Returning 400 to user: Invalid IP protocol tempest-999-2032253488. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:34:43.009190 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-bad54adb-89f8-4a60-8320-b898261d5a87 tempest-SecurityGroupRulesNegativeTestJSON-1902147119 tempest-SecurityGroupRulesNegativeTestJSON-1902147119-project] 10.222.0.43 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 87 microversion: 2.1 time: 0.195440 Oct 04 18:34:43.009190 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 527/963] 10.222.0.43 () {60 vars in 1195 bytes} [Tue Oct 4 18:34:42 2022] POST /compute/v2.1/os-security-group-rules => generated 87 bytes in 197 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 04 18:34:43.031167 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-99ec3f86-b682-4e58-8aa2-8bc237547663 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:43.032520 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-99ec3f86-b682-4e58-8aa2-8bc237547663 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] [instance: eb05639b-cd53-4c27-9505-20e668a16acc] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:43.045286 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-c484b69a-1903-4e6f-80c0-b10da56d78ae tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] [instance: fc077a8b-c0f8-4bb1-8a39-91874ac015e7] Going to try to terminate instance {{(pid=123595) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:34:43.083589 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-99ec3f86-b682-4e58-8aa2-8bc237547663 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:43.085915 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-99ec3f86-b682-4e58-8aa2-8bc237547663 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:43.088703 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-99ec3f86-b682-4e58-8aa2-8bc237547663 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:43.091061 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-99ec3f86-b682-4e58-8aa2-8bc237547663 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:43.093012 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-99ec3f86-b682-4e58-8aa2-8bc237547663 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:43.096882 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-99ec3f86-b682-4e58-8aa2-8bc237547663 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:43.119000 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=100 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:34:43.250222 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-c484b69a-1903-4e6f-80c0-b10da56d78ae tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] 10.222.0.43 "DELETE /compute/v2.1/servers/fc077a8b-c0f8-4bb1-8a39-91874ac015e7" status: 204 len: 0 microversion: 2.1 time: 0.275799 Oct 04 18:34:43.251617 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 437/964] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 18:34:42 2022] DELETE /compute/v2.1/servers/fc077a8b-c0f8-4bb1-8a39-91874ac015e7 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:34:43.263310 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-53184f20-0520-48b5-bbcb-c89e3531bed9 tempest-SecurityGroupRulesNegativeTestJSON-1902147119 tempest-SecurityGroupRulesNegativeTestJSON-1902147119-project] Action: 'create', calling method: .version_select at 0x7fb21fc60940>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1506844974", "description": "tempest-description-2005307745"}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:34:43.480912 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-99ec3f86-b682-4e58-8aa2-8bc237547663 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64887fff0bc7417094c4fee2f7e9aa5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6187bfad04cb7bc17155862ee0cdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:43.493769 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-99ec3f86-b682-4e58-8aa2-8bc237547663 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] 10.222.0.43 "GET /compute/v2.1/servers/eb05639b-cd53-4c27-9505-20e668a16acc" status: 200 len: 1365 microversion: 2.1 time: 0.481562 Oct 04 18:34:43.496662 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 528/965] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:43 2022] GET /compute/v2.1/servers/eb05639b-cd53-4c27-9505-20e668a16acc => generated 1365 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:43.509659 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-c39f627d-f566-4941-9a4b-63120009a3ad req-ebc7426e-ee6a-4937-a6fe-a6f55d37c80a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9895c2ec-35ea-419e-9565-0c0f2fc5bbbc", "name": "network-vif-unplugged", "status": "completed", "tag": "d1c13a57-f549-4198-9a2d-173f2932d012"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:34:43.530384 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-c39f627d-f566-4941-9a4b-63120009a3ad req-ebc7426e-ee6a-4937-a6fe-a6f55d37c80a service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:43.530713 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-c39f627d-f566-4941-9a4b-63120009a3ad req-ebc7426e-ee6a-4937-a6fe-a6f55d37c80a service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:43.531205 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-c39f627d-f566-4941-9a4b-63120009a3ad req-ebc7426e-ee6a-4937-a6fe-a6f55d37c80a service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:43.563281 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-c39f627d-f566-4941-9a4b-63120009a3ad req-ebc7426e-ee6a-4937-a6fe-a6f55d37c80a service nova] Creating event network-vif-unplugged:d1c13a57-f549-4198-9a2d-173f2932d012 for instance 9895c2ec-35ea-419e-9565-0c0f2fc5bbbc on n-h1-851028-13 Oct 04 18:34:43.570658 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-c39f627d-f566-4941-9a4b-63120009a3ad req-ebc7426e-ee6a-4937-a6fe-a6f55d37c80a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.072550 Oct 04 18:34:43.573581 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 529/966] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:34:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:34:43.587634 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-4432443a-8df6-4f5d-890d-ad428a3d84d7 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:43.589501 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-4432443a-8df6-4f5d-890d-ad428a3d84d7 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] [instance: 84e0414b-a39f-4bfe-bc9d-c170ceb34d15] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:43.597184 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_api:DELETE=2,nova_api:SELECT=97,nova_api:UPDATE=1 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:34:43.601175 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4432443a-8df6-4f5d-890d-ad428a3d84d7 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:43.603579 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4432443a-8df6-4f5d-890d-ad428a3d84d7 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:43.603761 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4432443a-8df6-4f5d-890d-ad428a3d84d7 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:43.609704 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4432443a-8df6-4f5d-890d-ad428a3d84d7 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:43.613898 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4432443a-8df6-4f5d-890d-ad428a3d84d7 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:43.614849 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4432443a-8df6-4f5d-890d-ad428a3d84d7 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:43.650077 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-53184f20-0520-48b5-bbcb-c89e3531bed9 tempest-SecurityGroupRulesNegativeTestJSON-1902147119 tempest-SecurityGroupRulesNegativeTestJSON-1902147119-project] 10.222.0.43 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.393505 Oct 04 18:34:43.650746 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 438/967] 10.222.0.43 () {60 vars in 1180 bytes} [Tue Oct 4 18:34:43 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:34:43.655675 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-c71409fc-6d79-4be4-bb44-aeb100776379 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:43.656407 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-c71409fc-6d79-4be4-bb44-aeb100776379 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] [instance: fc077a8b-c0f8-4bb1-8a39-91874ac015e7] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:43.669530 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c71409fc-6d79-4be4-bb44-aeb100776379 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:43.670057 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c71409fc-6d79-4be4-bb44-aeb100776379 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:43.670500 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c71409fc-6d79-4be4-bb44-aeb100776379 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:43.673507 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c71409fc-6d79-4be4-bb44-aeb100776379 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:43.673990 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c71409fc-6d79-4be4-bb44-aeb100776379 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:43.674529 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c71409fc-6d79-4be4-bb44-aeb100776379 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:43.798761 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-4432443a-8df6-4f5d-890d-ad428a3d84d7 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:43.821301 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-4432443a-8df6-4f5d-890d-ad428a3d84d7 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:43.825175 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-4432443a-8df6-4f5d-890d-ad428a3d84d7 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:43.839954 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-4432443a-8df6-4f5d-890d-ad428a3d84d7 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] 10.222.0.43 "GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15" status: 200 len: 1537 microversion: 2.91 time: 0.265081 Oct 04 18:34:43.852372 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 530/968] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:34:43 2022] GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15 => generated 1537 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:34:43.866457 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-a25de855-dbb4-4cd2-98c2-0a34b7016df9 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:43.867354 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-a25de855-dbb4-4cd2-98c2-0a34b7016df9 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] [instance: bcc13e2d-03e7-464d-abac-f5ffb7cbb509] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:43.877484 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a25de855-dbb4-4cd2-98c2-0a34b7016df9 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:43.877989 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a25de855-dbb4-4cd2-98c2-0a34b7016df9 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:43.878432 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a25de855-dbb4-4cd2-98c2-0a34b7016df9 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:43.879926 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a25de855-dbb4-4cd2-98c2-0a34b7016df9 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:43.880439 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a25de855-dbb4-4cd2-98c2-0a34b7016df9 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:43.880945 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a25de855-dbb4-4cd2-98c2-0a34b7016df9 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:43.898550 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-a25de855-dbb4-4cd2-98c2-0a34b7016df9 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] HTTP exception thrown: Instance bcc13e2d-03e7-464d-abac-f5ffb7cbb509 could not be found. Oct 04 18:34:43.900375 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-a25de855-dbb4-4cd2-98c2-0a34b7016df9 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Request method failure captured: Oct 04 18:34:43.900375 n-d-851028-13 devstack@n-api.service[123596]: request: GET /compute/v2.1/servers/bcc13e2d-03e7-464d-abac-f5ffb7cbb509 HTTP/1.1 Oct 04 18:34:43.900375 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:34:43.900375 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:34:43.900375 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:34:43.900375 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 18:34:43.900375 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:34:43.900375 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:34:43.900375 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:34:43.900375 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:34:43.900375 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPHxvGpn_Rmwb4_qp9sFfGvgN7iAAV2xSCWfRC9n0GexWg9-roiWoSufHMVwAQTbSjS8E-I_crn1vdoZeeJb4yK13_4-CfmlbLu2Wg1RgBTFkFTTUO8JismVpURO1heY4t66WZGJDnhJVfX0V2lSC4alpE7HkcsZl_0iOLpOl_Nfxbps Oct 04 18:34:43.900375 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:34:43.900375 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:34:43.900375 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:34:43.900375 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:34:43.900375 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:34:43.900375 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:34:43.900375 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: 829069b2787a423f922fcc5b5702f167 Oct 04 18:34:43.900375 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-LiveMigrationNegativeTest-1833877563 Oct 04 18:34:43.900375 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 18:34:43.900375 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 18:34:43.900375 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/829069b2787a423f922fcc5b5702f167"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_829069b2787a423f922fcc5b5702f167"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/829069b2787a423f922fcc5b5702f167"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/829069b2787a423f922fcc5b5702f167"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:34:43.900375 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-LiveMigrationNegativeTest-1833877563 Oct 04 18:34:43.900375 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: 829069b2787a423f922fcc5b5702f167 Oct 04 18:34:43.900375 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1833877563 Oct 04 18:34:43.900375 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-LiveMigrationNegativeTest-1833877563-project Oct 04 18:34:43.900375 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:34:43.900375 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:34:43.900375 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: c4aec5af742842f5bb2048c8b7d60687 Oct 04 18:34:43.900375 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-LiveMigrationNegativeTest-1833877563-project Oct 04 18:34:43.900375 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 18:34:43.900375 n-d-851028-13 devstack@n-api.service[123596]: exception: Instance bcc13e2d-03e7-464d-abac-f5ffb7cbb509 could not be found. Oct 04 18:34:43.900375 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': 'bcc13e2d-03e7-464d-abac-f5ffb7cbb509'} Oct 04 18:34:43.900375 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:34:43.900375 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:34:43.900375 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:34:43.900375 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:34:43.900375 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:34:43.900375 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:34:43.900375 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:34:43.900375 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:34:43.900375 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:34:43.900375 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:34:43.900375 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bcc13e2d-03e7-464d-abac-f5ffb7cbb509 could not be found. Oct 04 18:34:43.900375 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:34:43.900375 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:34:43.900375 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:34:43.900375 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:34:43.900375 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:34:43.900375 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:34:43.900375 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:34:43.900375 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:34:43.900375 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:34:43.900375 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:34:43.900375 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:34:43.900375 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:34:43.900375 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:34:43.900375 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:34:43.900375 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:34:43.900375 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:34:43.900375 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bcc13e2d-03e7-464d-abac-f5ffb7cbb509 could not be found. Oct 04 18:34:43.900375 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:34:43.900375 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:34:43.900375 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:34:43.905019 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:34:43.905019 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:34:43.905019 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:34:43.905019 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:34:43.905019 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:34:43.905019 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bcc13e2d-03e7-464d-abac-f5ffb7cbb509 could not be found. Oct 04 18:34:43.905019 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:34:43.905019 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-a25de855-dbb4-4cd2-98c2-0a34b7016df9 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Returning 404 to user: Instance bcc13e2d-03e7-464d-abac-f5ffb7cbb509 could not be found. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:34:43.908341 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-c71409fc-6d79-4be4-bb44-aeb100776379 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7db99f361654711bea7f1b2c404d312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7adedcdb9c3485ea2738c00e25aa3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:43.908536 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-a25de855-dbb4-4cd2-98c2-0a34b7016df9 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] 10.222.0.43 "GET /compute/v2.1/servers/bcc13e2d-03e7-464d-abac-f5ffb7cbb509" status: 404 len: 111 microversion: 2.1 time: 0.047977 Oct 04 18:34:43.908536 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 531/969] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:43 2022] GET /compute/v2.1/servers/bcc13e2d-03e7-464d-abac-f5ffb7cbb509 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:34:43.908536 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-9428ec18-e999-4602-bf06-9bba025a9484 tempest-SecurityGroupRulesNegativeTestJSON-1902147119 tempest-SecurityGroupRulesNegativeTestJSON-1902147119-project] Action: 'create', calling method: .version_select at 0x7fb21fb035e0>, body: {"security_group_rule": {"parent_group_id": "8620a6f4-fb10-4b4e-8689-cf57adce7927", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:34:43.913564 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-c71409fc-6d79-4be4-bb44-aeb100776379 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] 10.222.0.43 "GET /compute/v2.1/servers/fc077a8b-c0f8-4bb1-8a39-91874ac015e7" status: 200 len: 1472 microversion: 2.1 time: 0.261560 Oct 04 18:34:43.925573 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 439/970] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:43 2022] GET /compute/v2.1/servers/fc077a8b-c0f8-4bb1-8a39-91874ac015e7 => generated 1472 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:43.935066 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-8fea8e6a-9f30-4416-bf46-a321511aa5a5 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:43.935830 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-8fea8e6a-9f30-4416-bf46-a321511aa5a5 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] [instance: 9895c2ec-35ea-419e-9565-0c0f2fc5bbbc] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:43.943005 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8fea8e6a-9f30-4416-bf46-a321511aa5a5 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:43.943598 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8fea8e6a-9f30-4416-bf46-a321511aa5a5 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:43.944106 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8fea8e6a-9f30-4416-bf46-a321511aa5a5 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:43.945550 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8fea8e6a-9f30-4416-bf46-a321511aa5a5 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:43.946082 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8fea8e6a-9f30-4416-bf46-a321511aa5a5 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:43.947191 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8fea8e6a-9f30-4416-bf46-a321511aa5a5 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:43.962954 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-9428ec18-e999-4602-bf06-9bba025a9484 tempest-SecurityGroupRulesNegativeTestJSON-1902147119 tempest-SecurityGroupRulesNegativeTestJSON-1902147119-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Oct 04 18:34:43.964690 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-9428ec18-e999-4602-bf06-9bba025a9484 tempest-SecurityGroupRulesNegativeTestJSON-1902147119 tempest-SecurityGroupRulesNegativeTestJSON-1902147119-project] Request method failure captured: Oct 04 18:34:43.964690 n-d-851028-13 devstack@n-api.service[123596]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 04 18:34:43.964690 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:34:43.964690 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:34:43.964690 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:34:43.964690 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 138 Oct 04 18:34:43.964690 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:34:43.964690 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:34:43.964690 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:34:43.964690 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:34:43.964690 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPHy8Wk37Kt-KEPYTw4ckPdWUqFxLgD2-K-78O18tkuJzgNpD7Tq8-0rrlYeqBFFk_KJuKAPrn-_DZEID1KQqBk5OQVTbaNjnTgvt70fy9R-59105DigD-QRLAsSvlfrSDFMi2XWbac2MgKNSOZSKOHGMT_kk9iQrNtiTfOjBiv7e1nM Oct 04 18:34:43.964690 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:34:43.964690 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:34:43.964690 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:34:43.964690 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:34:43.964690 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:34:43.964690 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:34:43.964690 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: 4a28e1fc23834fd2b065d34598efec10 Oct 04 18:34:43.964690 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1902147119 Oct 04 18:34:43.964690 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 18:34:43.964690 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 18:34:43.964690 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/4a28e1fc23834fd2b065d34598efec10"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_4a28e1fc23834fd2b065d34598efec10"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4a28e1fc23834fd2b065d34598efec10"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4a28e1fc23834fd2b065d34598efec10"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:34:43.964690 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1902147119 Oct 04 18:34:43.964690 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: 4a28e1fc23834fd2b065d34598efec10 Oct 04 18:34:43.964690 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1902147119 Oct 04 18:34:43.964690 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1902147119-project Oct 04 18:34:43.964690 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:34:43.964690 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:34:43.964690 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 5b93da9a8ec74ae3b1a206311bd01a8d Oct 04 18:34:43.964690 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1902147119-project Oct 04 18:34:43.964690 n-d-851028-13 devstack@n-api.service[123596]: Oct 04 18:34:43.964690 n-d-851028-13 devstack@n-api.service[123596]: {"security_group_rule": {"parent_group_id": "8620a6f4-fb10-4b4e-8689-cf57adce7927", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} Oct 04 18:34:43.964690 n-d-851028-13 devstack@n-api.service[123596]: method: Oct 04 18:34:43.964690 n-d-851028-13 devstack@n-api.service[123596]: exception: Invalid port range 22:21. Former value cannot be greater than the later Oct 04 18:34:43.964690 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'body': {'security_group_rule': {'parent_group_id': '8620a6f4-fb10-4b4e-8689-cf57adce7927', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 21}}} Oct 04 18:34:43.964690 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:34:43.964690 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:34:43.964690 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 04 18:34:43.964690 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 04 18:34:43.964690 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 04 18:34:43.964690 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 04 18:34:43.964690 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 04 18:34:43.964690 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 04 18:34:43.964690 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Oct 04 18:34:43.964690 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 04 18:34:43.964690 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:21. Former value cannot be greater than the later Oct 04 18:34:43.964690 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:34:43.964690 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:34:43.964690 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:34:43.964690 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:34:43.964690 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:34:43.964690 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:34:43.964690 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:34:43.964690 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:34:43.964690 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:34:43.964690 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:34:43.964690 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:34:43.964690 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:34:43.964690 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 04 18:34:43.964690 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 04 18:34:43.964690 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:21. Former value cannot be greater than the later Oct 04 18:34:43.964690 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:34:43.970115 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:34:43.970115 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:34:43.970115 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:34:43.970115 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:34:43.970115 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:34:43.970115 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:34:43.970115 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:34:43.970115 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:21. Former value cannot be greater than the later Oct 04 18:34:43.970115 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:34:43.982292 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-9428ec18-e999-4602-bf06-9bba025a9484 tempest-SecurityGroupRulesNegativeTestJSON-1902147119 tempest-SecurityGroupRulesNegativeTestJSON-1902147119-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:34:43.985093 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-9428ec18-e999-4602-bf06-9bba025a9484 tempest-SecurityGroupRulesNegativeTestJSON-1902147119 tempest-SecurityGroupRulesNegativeTestJSON-1902147119-project] 10.222.0.43 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.079721 Oct 04 18:34:43.985742 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 532/971] 10.222.0.43 () {60 vars in 1195 bytes} [Tue Oct 4 18:34:43 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 83 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:34:44.001262 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-4352d2eb-fe54-4a8f-8b3e-2063227015ed tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:44.001952 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-4352d2eb-fe54-4a8f-8b3e-2063227015ed tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] [instance: 101edf03-d928-461d-98cf-12753ae7f7d7] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:44.014496 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4352d2eb-fe54-4a8f-8b3e-2063227015ed tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:44.015160 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4352d2eb-fe54-4a8f-8b3e-2063227015ed tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:44.015422 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4352d2eb-fe54-4a8f-8b3e-2063227015ed tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:44.016383 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4352d2eb-fe54-4a8f-8b3e-2063227015ed tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:44.017023 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4352d2eb-fe54-4a8f-8b3e-2063227015ed tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:44.017743 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4352d2eb-fe54-4a8f-8b3e-2063227015ed tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:44.062032 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-4352d2eb-fe54-4a8f-8b3e-2063227015ed tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] [instance: 101edf03-d928-461d-98cf-12753ae7f7d7] Going to try to terminate instance {{(pid=123596) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:34:44.224604 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-4352d2eb-fe54-4a8f-8b3e-2063227015ed tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] 10.222.0.43 "DELETE /compute/v2.1/servers/101edf03-d928-461d-98cf-12753ae7f7d7" status: 204 len: 0 microversion: 2.1 time: 0.237116 Oct 04 18:34:44.226417 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-8fea8e6a-9f30-4416-bf46-a321511aa5a5 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:44.229122 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 533/972] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 18:34:43 2022] DELETE /compute/v2.1/servers/101edf03-d928-461d-98cf-12753ae7f7d7 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:34:44.237944 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-c7b91e8b-cd34-481a-bdbf-a0ad4dcf6110 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:44.239533 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-c7b91e8b-cd34-481a-bdbf-a0ad4dcf6110 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] [instance: 93798a9a-d90d-4a4e-8e30-d6575486ff56] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:44.240301 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-8fea8e6a-9f30-4416-bf46-a321511aa5a5 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:44.241997 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-8fea8e6a-9f30-4416-bf46-a321511aa5a5 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:44.243459 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-8fea8e6a-9f30-4416-bf46-a321511aa5a5 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] 10.222.0.43 "GET /compute/v2.1/servers/9895c2ec-35ea-419e-9565-0c0f2fc5bbbc" status: 200 len: 1566 microversion: 2.25 time: 0.316699 Oct 04 18:34:44.244550 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 440/973] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:34:43 2022] GET /compute/v2.1/servers/9895c2ec-35ea-419e-9565-0c0f2fc5bbbc => generated 1566 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:34:44.250257 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-c9eb6a93-80f2-4f46-a299-d581bd9e22aa tempest-SecurityGroupRulesNegativeTestJSON-1902147119 tempest-SecurityGroupRulesNegativeTestJSON-1902147119-project] Action: 'create', calling method: .version_select at 0x7fb21fbee430>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-767853788", "description": "tempest-description-491231106"}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:34:44.264528 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c7b91e8b-cd34-481a-bdbf-a0ad4dcf6110 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:44.265155 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c7b91e8b-cd34-481a-bdbf-a0ad4dcf6110 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:44.268822 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c7b91e8b-cd34-481a-bdbf-a0ad4dcf6110 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:44.269864 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c7b91e8b-cd34-481a-bdbf-a0ad4dcf6110 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:44.270527 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c7b91e8b-cd34-481a-bdbf-a0ad4dcf6110 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:44.271180 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c7b91e8b-cd34-481a-bdbf-a0ad4dcf6110 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:44.482949 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-c9eb6a93-80f2-4f46-a299-d581bd9e22aa tempest-SecurityGroupRulesNegativeTestJSON-1902147119 tempest-SecurityGroupRulesNegativeTestJSON-1902147119-project] 10.222.0.43 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 0.236490 Oct 04 18:34:44.484200 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 441/974] 10.222.0.43 () {60 vars in 1180 bytes} [Tue Oct 4 18:34:44 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:34:44.489569 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-d4b4df8d-608c-4c1a-b36c-2c2d65d783c4 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:44.490587 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-d4b4df8d-608c-4c1a-b36c-2c2d65d783c4 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] [instance: 101edf03-d928-461d-98cf-12753ae7f7d7] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:44.504637 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d4b4df8d-608c-4c1a-b36c-2c2d65d783c4 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:44.505586 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d4b4df8d-608c-4c1a-b36c-2c2d65d783c4 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:44.506213 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d4b4df8d-608c-4c1a-b36c-2c2d65d783c4 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:44.507834 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d4b4df8d-608c-4c1a-b36c-2c2d65d783c4 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:44.508498 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d4b4df8d-608c-4c1a-b36c-2c2d65d783c4 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:44.509090 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d4b4df8d-608c-4c1a-b36c-2c2d65d783c4 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:44.683857 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-d4b4df8d-608c-4c1a-b36c-2c2d65d783c4 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4aec5af742842f5bb2048c8b7d60687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829069b2787a423f922fcc5b5702f167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:44.699268 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-d4b4df8d-608c-4c1a-b36c-2c2d65d783c4 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] 10.222.0.43 "GET /compute/v2.1/servers/101edf03-d928-461d-98cf-12753ae7f7d7" status: 200 len: 1475 microversion: 2.1 time: 0.213219 Oct 04 18:34:44.713061 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 442/975] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:44 2022] GET /compute/v2.1/servers/101edf03-d928-461d-98cf-12753ae7f7d7 => generated 1475 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:44.713061 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-4b2a9b03-9621-457f-9eac-605709774581 tempest-SecurityGroupRulesNegativeTestJSON-1902147119 tempest-SecurityGroupRulesNegativeTestJSON-1902147119-project] Action: 'create', calling method: .version_select at 0x7fb21fc60790>, body: {"security_group_rule": {"parent_group_id": "3be6b06a-481b-4b0b-a429-052206aca682", "ip_protocol": "tcp", "from_port": 22, "to_port": 199383440}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:34:44.766537 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-4b2a9b03-9621-457f-9eac-605709774581 tempest-SecurityGroupRulesNegativeTestJSON-1902147119 tempest-SecurityGroupRulesNegativeTestJSON-1902147119-project] HTTP exception thrown: Invalid port range 22:199383440. Valid TCP ports should be between 1-65535 Oct 04 18:34:44.769907 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-4b2a9b03-9621-457f-9eac-605709774581 tempest-SecurityGroupRulesNegativeTestJSON-1902147119 tempest-SecurityGroupRulesNegativeTestJSON-1902147119-project] Request method failure captured: Oct 04 18:34:44.769907 n-d-851028-13 devstack@n-api.service[123595]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 04 18:34:44.769907 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 18:34:44.769907 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 18:34:44.769907 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 18:34:44.769907 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 145 Oct 04 18:34:44.769907 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 18:34:44.769907 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 18:34:44.769907 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 18:34:44.769907 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 18:34:44.769907 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPHy8Wk37Kt-KEPYTw4ckPdWUqFxLgD2-K-78O18tkuJzgNpD7Tq8-0rrlYeqBFFk_KJuKAPrn-_DZEID1KQqBk5OQVTbaNjnTgvt70fy9R-59105DigD-QRLAsSvlfrSDFMi2XWbac2MgKNSOZSKOHGMT_kk9iQrNtiTfOjBiv7e1nM Oct 04 18:34:44.769907 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 18:34:44.769907 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 18:34:44.769907 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 18:34:44.769907 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 18:34:44.769907 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 18:34:44.769907 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 18:34:44.769907 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: 4a28e1fc23834fd2b065d34598efec10 Oct 04 18:34:44.769907 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1902147119 Oct 04 18:34:44.769907 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 18:34:44.769907 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 18:34:44.769907 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/4a28e1fc23834fd2b065d34598efec10"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_4a28e1fc23834fd2b065d34598efec10"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4a28e1fc23834fd2b065d34598efec10"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4a28e1fc23834fd2b065d34598efec10"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:34:44.769907 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1902147119 Oct 04 18:34:44.769907 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: 4a28e1fc23834fd2b065d34598efec10 Oct 04 18:34:44.769907 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1902147119 Oct 04 18:34:44.769907 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1902147119-project Oct 04 18:34:44.769907 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 18:34:44.769907 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 18:34:44.769907 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: 5b93da9a8ec74ae3b1a206311bd01a8d Oct 04 18:34:44.769907 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1902147119-project Oct 04 18:34:44.769907 n-d-851028-13 devstack@n-api.service[123595]: Oct 04 18:34:44.769907 n-d-851028-13 devstack@n-api.service[123595]: {"security_group_rule": {"parent_group_id": "3be6b06a-481b-4b0b-a429-052206aca682", "ip_protocol": "tcp", "from_port": 22, "to_port": 199383440}} Oct 04 18:34:44.769907 n-d-851028-13 devstack@n-api.service[123595]: method: Oct 04 18:34:44.769907 n-d-851028-13 devstack@n-api.service[123595]: exception: Invalid port range 22:199383440. Valid TCP ports should be between 1-65535 Oct 04 18:34:44.769907 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'body': {'security_group_rule': {'parent_group_id': '3be6b06a-481b-4b0b-a429-052206aca682', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 199383440}}} Oct 04 18:34:44.769907 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:34:44.769907 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:34:44.769907 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 04 18:34:44.769907 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 04 18:34:44.769907 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 04 18:34:44.769907 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 04 18:34:44.769907 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 04 18:34:44.769907 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 04 18:34:44.769907 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 157, in _new_ingress_rule Oct 04 18:34:44.769907 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 04 18:34:44.769907 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:199383440. Valid TCP ports should be between 1-65535 Oct 04 18:34:44.769907 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:34:44.769907 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:34:44.769907 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:34:44.769907 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:34:44.769907 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:34:44.769907 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:34:44.769907 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:34:44.769907 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:34:44.769907 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:34:44.769907 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:34:44.769907 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:34:44.769907 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:34:44.769907 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 04 18:34:44.769907 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 04 18:34:44.769907 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:199383440. Valid TCP ports should be between 1-65535 Oct 04 18:34:44.769907 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:34:44.773782 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:34:44.773782 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:34:44.773782 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:34:44.773782 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:34:44.773782 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:34:44.773782 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:34:44.773782 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:34:44.773782 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:199383440. Valid TCP ports should be between 1-65535 Oct 04 18:34:44.773782 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:34:44.776369 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-4b2a9b03-9621-457f-9eac-605709774581 tempest-SecurityGroupRulesNegativeTestJSON-1902147119 tempest-SecurityGroupRulesNegativeTestJSON-1902147119-project] Returning 400 to user: Invalid port range 22:199383440. Valid TCP ports should be between 1-65535 {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:34:44.777618 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-4b2a9b03-9621-457f-9eac-605709774581 tempest-SecurityGroupRulesNegativeTestJSON-1902147119 tempest-SecurityGroupRulesNegativeTestJSON-1902147119-project] 10.222.0.43 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 118 microversion: 2.1 time: 0.075928 Oct 04 18:34:44.778384 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 443/976] 10.222.0.43 () {60 vars in 1195 bytes} [Tue Oct 4 18:34:44 2022] POST /compute/v2.1/os-security-group-rules => generated 118 bytes in 78 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:34:44.786188 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-68717607-1e3d-4b78-b4ba-23bfe57f3abf tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:44.787015 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-68717607-1e3d-4b78-b4ba-23bfe57f3abf tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] [instance: eb05639b-cd53-4c27-9505-20e668a16acc] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:44.794591 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-68717607-1e3d-4b78-b4ba-23bfe57f3abf tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:44.795087 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-68717607-1e3d-4b78-b4ba-23bfe57f3abf tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:44.795530 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-68717607-1e3d-4b78-b4ba-23bfe57f3abf tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:44.796322 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-68717607-1e3d-4b78-b4ba-23bfe57f3abf tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:44.796779 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-68717607-1e3d-4b78-b4ba-23bfe57f3abf tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:44.797778 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-68717607-1e3d-4b78-b4ba-23bfe57f3abf tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:44.855060 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-c7b91e8b-cd34-481a-bdbf-a0ad4dcf6110 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a41ab6fb78a42ceaca621c5a38ffc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa31ed92017490a82497c7b8910aef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:44.865337 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-c7b91e8b-cd34-481a-bdbf-a0ad4dcf6110 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] 10.222.0.43 "GET /compute/v2.1/servers/93798a9a-d90d-4a4e-8e30-d6575486ff56" status: 200 len: 1308 microversion: 2.1 time: 0.634394 Oct 04 18:34:44.866046 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 534/977] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:44 2022] GET /compute/v2.1/servers/93798a9a-d90d-4a4e-8e30-d6575486ff56 => generated 1308 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:44.874560 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-8ab5d010-0192-4e05-bff2-e8e56e957ec6 tempest-SecurityGroupRulesNegativeTestJSON-1902147119 tempest-SecurityGroupRulesNegativeTestJSON-1902147119-project] Action: 'create', calling method: .version_select at 0x7fb21fb58430>, body: {"security_group_rule": {"parent_group_id": "63849fc2-0a22-4d61-82cc-9fecbfdf7ef0", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:34:44.921079 n-d-851028-13 devstack@n-api.service[123596]: DEBUG neutronclient.v2_0.client [None req-8ab5d010-0192-4e05-bff2-e8e56e957ec6 tempest-SecurityGroupRulesNegativeTestJSON-1902147119 tempest-SecurityGroupRulesNegativeTestJSON-1902147119-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 63849fc2-0a22-4d61-82cc-9fecbfdf7ef0 does not exist", "detail": ""}} {{(pid=123596) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 18:34:44.922865 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.network.security_group_api [None req-8ab5d010-0192-4e05-bff2-e8e56e957ec6 tempest-SecurityGroupRulesNegativeTestJSON-1902147119 tempest-SecurityGroupRulesNegativeTestJSON-1902147119-project] Neutron security group 63849fc2-0a22-4d61-82cc-9fecbfdf7ef0 not found {{(pid=123596) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 04 18:34:44.923731 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-8ab5d010-0192-4e05-bff2-e8e56e957ec6 tempest-SecurityGroupRulesNegativeTestJSON-1902147119 tempest-SecurityGroupRulesNegativeTestJSON-1902147119-project] HTTP exception thrown: Security group 63849fc2-0a22-4d61-82cc-9fecbfdf7ef0 does not exist Oct 04 18:34:44.923731 n-d-851028-13 devstack@n-api.service[123596]: Neutron server returns request_ids: ['req-ec26f036-576c-4711-a705-abecabe080d7'] Oct 04 18:34:44.926105 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-8ab5d010-0192-4e05-bff2-e8e56e957ec6 tempest-SecurityGroupRulesNegativeTestJSON-1902147119 tempest-SecurityGroupRulesNegativeTestJSON-1902147119-project] Request method failure captured: Oct 04 18:34:44.926105 n-d-851028-13 devstack@n-api.service[123596]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 04 18:34:44.926105 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:34:44.926105 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:34:44.926105 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:34:44.926105 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 138 Oct 04 18:34:44.926105 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:34:44.926105 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:34:44.926105 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:34:44.926105 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:34:44.926105 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPHy8Wk37Kt-KEPYTw4ckPdWUqFxLgD2-K-78O18tkuJzgNpD7Tq8-0rrlYeqBFFk_KJuKAPrn-_DZEID1KQqBk5OQVTbaNjnTgvt70fy9R-59105DigD-QRLAsSvlfrSDFMi2XWbac2MgKNSOZSKOHGMT_kk9iQrNtiTfOjBiv7e1nM Oct 04 18:34:44.926105 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:34:44.926105 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:34:44.926105 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:34:44.926105 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:34:44.926105 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:34:44.926105 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:34:44.926105 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: 4a28e1fc23834fd2b065d34598efec10 Oct 04 18:34:44.926105 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1902147119 Oct 04 18:34:44.926105 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 18:34:44.926105 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 18:34:44.926105 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/4a28e1fc23834fd2b065d34598efec10"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_4a28e1fc23834fd2b065d34598efec10"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4a28e1fc23834fd2b065d34598efec10"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4a28e1fc23834fd2b065d34598efec10"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:34:44.926105 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1902147119 Oct 04 18:34:44.926105 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: 4a28e1fc23834fd2b065d34598efec10 Oct 04 18:34:44.926105 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1902147119 Oct 04 18:34:44.926105 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1902147119-project Oct 04 18:34:44.926105 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:34:44.926105 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:34:44.926105 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 5b93da9a8ec74ae3b1a206311bd01a8d Oct 04 18:34:44.926105 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1902147119-project Oct 04 18:34:44.926105 n-d-851028-13 devstack@n-api.service[123596]: Oct 04 18:34:44.926105 n-d-851028-13 devstack@n-api.service[123596]: {"security_group_rule": {"parent_group_id": "63849fc2-0a22-4d61-82cc-9fecbfdf7ef0", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 04 18:34:44.926105 n-d-851028-13 devstack@n-api.service[123596]: method: Oct 04 18:34:44.926105 n-d-851028-13 devstack@n-api.service[123596]: exception: Security group 63849fc2-0a22-4d61-82cc-9fecbfdf7ef0 does not exist Oct 04 18:34:44.926105 n-d-851028-13 devstack@n-api.service[123596]: Neutron server returns request_ids: ['req-ec26f036-576c-4711-a705-abecabe080d7'] Oct 04 18:34:44.926105 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'body': {'security_group_rule': {'parent_group_id': '63849fc2-0a22-4d61-82cc-9fecbfdf7ef0', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 04 18:34:44.926105 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:34:44.926105 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:34:44.926105 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 04 18:34:44.926105 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 04 18:34:44.926105 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:34:44.926105 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:34:44.926105 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 04 18:34:44.926105 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 04 18:34:44.926105 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:34:44.926105 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:34:44.926105 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 18:34:44.926105 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 18:34:44.926105 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:34:44.926105 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:34:44.926105 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 18:34:44.926105 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 18:34:44.926105 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:34:44.926105 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:34:44.926105 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 18:34:44.926105 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 18:34:44.926105 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:34:44.926105 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:34:44.926105 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 18:34:44.926105 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 18:34:44.926105 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 18:34:44.932236 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 18:34:44.932236 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 63849fc2-0a22-4d61-82cc-9fecbfdf7ef0 does not exist Oct 04 18:34:44.932236 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ec26f036-576c-4711-a705-abecabe080d7'] Oct 04 18:34:44.932236 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:34:44.932236 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:34:44.932236 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:34:44.932236 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:34:44.932236 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 287, in create Oct 04 18:34:44.932236 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get( Oct 04 18:34:44.932236 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 04 18:34:44.932236 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 18:34:44.932236 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 63849fc2-0a22-4d61-82cc-9fecbfdf7ef0 does not exist Oct 04 18:34:44.932236 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ec26f036-576c-4711-a705-abecabe080d7'] Oct 04 18:34:44.932236 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:34:44.932236 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:34:44.932236 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:34:44.932236 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:34:44.932236 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:34:44.932236 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:34:44.932236 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:34:44.932236 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:34:44.932236 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:34:44.932236 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:34:44.932236 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:34:44.932236 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:34:44.932236 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 303, in create Oct 04 18:34:44.932236 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 04 18:34:44.932236 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 63849fc2-0a22-4d61-82cc-9fecbfdf7ef0 does not exist Oct 04 18:34:44.932236 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ec26f036-576c-4711-a705-abecabe080d7'] Oct 04 18:34:44.932236 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:34:44.932236 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:34:44.932236 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:34:44.932236 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:34:44.932236 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:34:44.932236 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:34:44.932236 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:34:44.932236 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:34:44.932236 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 63849fc2-0a22-4d61-82cc-9fecbfdf7ef0 does not exist Oct 04 18:34:44.932236 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ec26f036-576c-4711-a705-abecabe080d7'] Oct 04 18:34:44.932236 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:34:44.932236 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-8ab5d010-0192-4e05-bff2-e8e56e957ec6 tempest-SecurityGroupRulesNegativeTestJSON-1902147119 tempest-SecurityGroupRulesNegativeTestJSON-1902147119-project] Returning 404 to user: Security group 63849fc2-0a22-4d61-82cc-9fecbfdf7ef0 does not exist Oct 04 18:34:44.932236 n-d-851028-13 devstack@n-api.service[123596]: Neutron server returns request_ids: ['req-ec26f036-576c-4711-a705-abecabe080d7'] {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:34:44.932236 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-8ab5d010-0192-4e05-bff2-e8e56e957ec6 tempest-SecurityGroupRulesNegativeTestJSON-1902147119 tempest-SecurityGroupRulesNegativeTestJSON-1902147119-project] 10.222.0.43 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.060569 Oct 04 18:34:44.932236 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 535/978] 10.222.0.43 () {60 vars in 1195 bytes} [Tue Oct 4 18:34:44 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:34:44.937180 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-1e0d23c7-0b6d-4542-b004-a4be1715996c tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:44.937180 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-1e0d23c7-0b6d-4542-b004-a4be1715996c tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] [instance: 84e0414b-a39f-4bfe-bc9d-c170ceb34d15] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:44.942475 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1e0d23c7-0b6d-4542-b004-a4be1715996c tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:44.943230 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1e0d23c7-0b6d-4542-b004-a4be1715996c tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:44.943676 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1e0d23c7-0b6d-4542-b004-a4be1715996c tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:44.944399 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1e0d23c7-0b6d-4542-b004-a4be1715996c tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:44.944861 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1e0d23c7-0b6d-4542-b004-a4be1715996c tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:44.945334 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1e0d23c7-0b6d-4542-b004-a4be1715996c tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:45.061967 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-1e0d23c7-0b6d-4542-b004-a4be1715996c tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:45.078912 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-1e0d23c7-0b6d-4542-b004-a4be1715996c tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:45.082371 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-1e0d23c7-0b6d-4542-b004-a4be1715996c tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:45.091509 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-1e0d23c7-0b6d-4542-b004-a4be1715996c tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] 10.222.0.43 "GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15" status: 200 len: 1537 microversion: 2.91 time: 0.161130 Oct 04 18:34:45.105133 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 536/979] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:34:44 2022] GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15 => generated 1537 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:34:45.105133 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-366b9c3a-46d5-489f-ad89-00b4911a1ddf tempest-SecurityGroupRulesNegativeTestJSON-1902147119 tempest-SecurityGroupRulesNegativeTestJSON-1902147119-project] Calling method '.version_select at 0x7fb21fb03790>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:45.140806 n-d-851028-13 devstack@n-api.service[123596]: DEBUG neutronclient.v2_0.client [None req-366b9c3a-46d5-489f-ad89-00b4911a1ddf tempest-SecurityGroupRulesNegativeTestJSON-1902147119 tempest-SecurityGroupRulesNegativeTestJSON-1902147119-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule 51ac8d4b-1341-4c41-8a0c-949665b3961a does not exist", "detail": ""}} {{(pid=123596) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 18:34:45.141470 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.network.security_group_api [None req-366b9c3a-46d5-489f-ad89-00b4911a1ddf tempest-SecurityGroupRulesNegativeTestJSON-1902147119 tempest-SecurityGroupRulesNegativeTestJSON-1902147119-project] Neutron security group rule 51ac8d4b-1341-4c41-8a0c-949665b3961a not found {{(pid=123596) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Oct 04 18:34:45.142069 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-366b9c3a-46d5-489f-ad89-00b4911a1ddf tempest-SecurityGroupRulesNegativeTestJSON-1902147119 tempest-SecurityGroupRulesNegativeTestJSON-1902147119-project] HTTP exception thrown: Security group rule 51ac8d4b-1341-4c41-8a0c-949665b3961a does not exist Oct 04 18:34:45.142069 n-d-851028-13 devstack@n-api.service[123596]: Neutron server returns request_ids: ['req-d2ebbe3b-2d40-4773-aa47-45813ed8e346'] Oct 04 18:34:45.143908 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-366b9c3a-46d5-489f-ad89-00b4911a1ddf tempest-SecurityGroupRulesNegativeTestJSON-1902147119 tempest-SecurityGroupRulesNegativeTestJSON-1902147119-project] Request method failure captured: Oct 04 18:34:45.143908 n-d-851028-13 devstack@n-api.service[123596]: request: DELETE /compute/v2.1/os-security-group-rules/51ac8d4b-1341-4c41-8a0c-949665b3961a HTTP/1.1 Oct 04 18:34:45.143908 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:34:45.143908 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:34:45.143908 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:34:45.143908 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 18:34:45.143908 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:34:45.143908 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:34:45.143908 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:34:45.143908 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:34:45.143908 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPHy8Wk37Kt-KEPYTw4ckPdWUqFxLgD2-K-78O18tkuJzgNpD7Tq8-0rrlYeqBFFk_KJuKAPrn-_DZEID1KQqBk5OQVTbaNjnTgvt70fy9R-59105DigD-QRLAsSvlfrSDFMi2XWbac2MgKNSOZSKOHGMT_kk9iQrNtiTfOjBiv7e1nM Oct 04 18:34:45.143908 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:34:45.143908 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:34:45.143908 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:34:45.143908 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:34:45.143908 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:34:45.143908 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:34:45.143908 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: 4a28e1fc23834fd2b065d34598efec10 Oct 04 18:34:45.143908 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1902147119 Oct 04 18:34:45.143908 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 18:34:45.143908 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 18:34:45.143908 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/4a28e1fc23834fd2b065d34598efec10"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_4a28e1fc23834fd2b065d34598efec10"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4a28e1fc23834fd2b065d34598efec10"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4a28e1fc23834fd2b065d34598efec10"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:34:45.143908 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1902147119 Oct 04 18:34:45.143908 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: 4a28e1fc23834fd2b065d34598efec10 Oct 04 18:34:45.143908 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1902147119 Oct 04 18:34:45.143908 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1902147119-project Oct 04 18:34:45.143908 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:34:45.143908 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:34:45.143908 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 5b93da9a8ec74ae3b1a206311bd01a8d Oct 04 18:34:45.143908 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1902147119-project Oct 04 18:34:45.143908 n-d-851028-13 devstack@n-api.service[123596]: method: Oct 04 18:34:45.143908 n-d-851028-13 devstack@n-api.service[123596]: exception: Security group rule 51ac8d4b-1341-4c41-8a0c-949665b3961a does not exist Oct 04 18:34:45.143908 n-d-851028-13 devstack@n-api.service[123596]: Neutron server returns request_ids: ['req-d2ebbe3b-2d40-4773-aa47-45813ed8e346'] Oct 04 18:34:45.143908 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': '51ac8d4b-1341-4c41-8a0c-949665b3961a'} Oct 04 18:34:45.143908 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:34:45.143908 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:34:45.143908 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 459, in get_rule Oct 04 18:34:45.143908 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi rule = neutron.show_security_group_rule( Oct 04 18:34:45.143908 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:34:45.143908 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:34:45.143908 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1092, in show_security_group_rule Oct 04 18:34:45.143908 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_rule_path % (security_group_rule), Oct 04 18:34:45.143908 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:34:45.143908 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:34:45.143908 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 18:34:45.143908 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 18:34:45.143908 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:34:45.143908 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:34:45.143908 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 18:34:45.143908 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 18:34:45.143908 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:34:45.143908 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:34:45.143908 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 18:34:45.143908 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 18:34:45.143908 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:34:45.143908 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:34:45.143908 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 18:34:45.143908 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 18:34:45.143908 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 18:34:45.143908 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 18:34:45.148041 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group rule 51ac8d4b-1341-4c41-8a0c-949665b3961a does not exist Oct 04 18:34:45.148041 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d2ebbe3b-2d40-4773-aa47-45813ed8e346'] Oct 04 18:34:45.148041 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:34:45.148041 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:34:45.148041 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:34:45.148041 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:34:45.148041 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 359, in delete Oct 04 18:34:45.148041 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi rule = security_group_api.get_rule(context, id) Oct 04 18:34:45.148041 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 464, in get_rule Oct 04 18:34:45.148041 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 18:34:45.148041 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group rule 51ac8d4b-1341-4c41-8a0c-949665b3961a does not exist Oct 04 18:34:45.148041 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d2ebbe3b-2d40-4773-aa47-45813ed8e346'] Oct 04 18:34:45.148041 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:34:45.148041 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:34:45.148041 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:34:45.148041 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:34:45.148041 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:34:45.148041 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:34:45.148041 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:34:45.148041 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:34:45.148041 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:34:45.148041 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:34:45.148041 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:34:45.148041 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:34:45.148041 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 365, in delete Oct 04 18:34:45.148041 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 04 18:34:45.148041 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group rule 51ac8d4b-1341-4c41-8a0c-949665b3961a does not exist Oct 04 18:34:45.148041 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d2ebbe3b-2d40-4773-aa47-45813ed8e346'] Oct 04 18:34:45.148041 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:34:45.148041 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:34:45.148041 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:34:45.148041 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:34:45.148041 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:34:45.148041 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:34:45.148041 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:34:45.148041 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:34:45.148041 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group rule 51ac8d4b-1341-4c41-8a0c-949665b3961a does not exist Oct 04 18:34:45.148041 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d2ebbe3b-2d40-4773-aa47-45813ed8e346'] Oct 04 18:34:45.148041 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:34:45.148041 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-366b9c3a-46d5-489f-ad89-00b4911a1ddf tempest-SecurityGroupRulesNegativeTestJSON-1902147119 tempest-SecurityGroupRulesNegativeTestJSON-1902147119-project] Returning 404 to user: Security group rule 51ac8d4b-1341-4c41-8a0c-949665b3961a does not exist Oct 04 18:34:45.148041 n-d-851028-13 devstack@n-api.service[123596]: Neutron server returns request_ids: ['req-d2ebbe3b-2d40-4773-aa47-45813ed8e346'] {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:34:45.148041 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-366b9c3a-46d5-489f-ad89-00b4911a1ddf tempest-SecurityGroupRulesNegativeTestJSON-1902147119 tempest-SecurityGroupRulesNegativeTestJSON-1902147119-project] 10.222.0.43 "DELETE /compute/v2.1/os-security-group-rules/51ac8d4b-1341-4c41-8a0c-949665b3961a" status: 404 len: 199 microversion: 2.1 time: 0.047606 Oct 04 18:34:45.148041 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 537/980] 10.222.0.43 () {58 vars in 1287 bytes} [Tue Oct 4 18:34:45 2022] DELETE /compute/v2.1/os-security-group-rules/51ac8d4b-1341-4c41-8a0c-949665b3961a => generated 199 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:34:45.151580 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-4463d748-b9b4-4178-8677-f321b2dbdbcf tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:45.151580 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-4463d748-b9b4-4178-8677-f321b2dbdbcf tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] [instance: fc077a8b-c0f8-4bb1-8a39-91874ac015e7] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:45.168580 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4463d748-b9b4-4178-8677-f321b2dbdbcf tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:45.169085 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4463d748-b9b4-4178-8677-f321b2dbdbcf tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:45.169562 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4463d748-b9b4-4178-8677-f321b2dbdbcf tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:45.170297 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4463d748-b9b4-4178-8677-f321b2dbdbcf tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:45.170761 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4463d748-b9b4-4178-8677-f321b2dbdbcf tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:45.171191 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4463d748-b9b4-4178-8677-f321b2dbdbcf tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:45.278357 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-68717607-1e3d-4b78-b4ba-23bfe57f3abf tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64887fff0bc7417094c4fee2f7e9aa5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6187bfad04cb7bc17155862ee0cdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:45.286071 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-68717607-1e3d-4b78-b4ba-23bfe57f3abf tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] 10.222.0.43 "GET /compute/v2.1/servers/eb05639b-cd53-4c27-9505-20e668a16acc" status: 200 len: 1365 microversion: 2.1 time: 0.506559 Oct 04 18:34:45.286637 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 444/981] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:44 2022] GET /compute/v2.1/servers/eb05639b-cd53-4c27-9505-20e668a16acc => generated 1365 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:45.291180 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-851e2f9d-6095-4b91-b1be-a2f93cc514e3 tempest-SecurityGroupRulesNegativeTestJSON-1902147119 tempest-SecurityGroupRulesNegativeTestJSON-1902147119-project] Calling method '.version_select at 0x7fb21fc60670>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:45.400293 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-4463d748-b9b4-4178-8677-f321b2dbdbcf tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7db99f361654711bea7f1b2c404d312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7adedcdb9c3485ea2738c00e25aa3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:45.409221 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-4463d748-b9b4-4178-8677-f321b2dbdbcf tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] 10.222.0.43 "GET /compute/v2.1/servers/fc077a8b-c0f8-4bb1-8a39-91874ac015e7" status: 200 len: 1472 microversion: 2.1 time: 0.261790 Oct 04 18:34:45.409803 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 538/982] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:45 2022] GET /compute/v2.1/servers/fc077a8b-c0f8-4bb1-8a39-91874ac015e7 => generated 1472 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:45.415038 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-31907ce0-8e54-475d-910f-974c0496474c tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:45.415891 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-31907ce0-8e54-475d-910f-974c0496474c tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] [instance: 9895c2ec-35ea-419e-9565-0c0f2fc5bbbc] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:45.423079 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-31907ce0-8e54-475d-910f-974c0496474c tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:45.423808 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-31907ce0-8e54-475d-910f-974c0496474c tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:45.424508 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-31907ce0-8e54-475d-910f-974c0496474c tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:45.425436 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-31907ce0-8e54-475d-910f-974c0496474c tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:45.425898 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-31907ce0-8e54-475d-910f-974c0496474c tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:45.426332 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-31907ce0-8e54-475d-910f-974c0496474c tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:45.501433 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-851e2f9d-6095-4b91-b1be-a2f93cc514e3 tempest-SecurityGroupRulesNegativeTestJSON-1902147119 tempest-SecurityGroupRulesNegativeTestJSON-1902147119-project] 10.222.0.43 "DELETE /compute/v2.1/os-security-groups/3be6b06a-481b-4b0b-a429-052206aca682" status: 202 len: 0 microversion: 2.1 time: 0.212188 Oct 04 18:34:45.503150 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 445/983] 10.222.0.43 () {58 vars in 1272 bytes} [Tue Oct 4 18:34:45 2022] DELETE /compute/v2.1/os-security-groups/3be6b06a-481b-4b0b-a429-052206aca682 => generated 0 bytes in 216 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:34:45.511973 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-43f00e00-62fa-4ab4-9ded-1781001274b4 tempest-SecurityGroupRulesNegativeTestJSON-1902147119 tempest-SecurityGroupRulesNegativeTestJSON-1902147119-project] Calling method '.version_select at 0x7fb21fd105e0>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:45.650200 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-31907ce0-8e54-475d-910f-974c0496474c tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:45.660305 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-31907ce0-8e54-475d-910f-974c0496474c tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:45.661884 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-31907ce0-8e54-475d-910f-974c0496474c tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:45.663069 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-31907ce0-8e54-475d-910f-974c0496474c tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] 10.222.0.43 "GET /compute/v2.1/servers/9895c2ec-35ea-419e-9565-0c0f2fc5bbbc" status: 200 len: 1566 microversion: 2.25 time: 0.252072 Oct 04 18:34:45.664458 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 539/984] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:34:45 2022] GET /compute/v2.1/servers/9895c2ec-35ea-419e-9565-0c0f2fc5bbbc => generated 1566 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:34:45.700126 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-aac486f5-a33d-4709-bfa5-89b1f7a44951 req-da39e986-6710-4a86-8011-3f569158484e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9895c2ec-35ea-419e-9565-0c0f2fc5bbbc", "tag": "d1c13a57-f549-4198-9a2d-173f2932d012"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:34:45.712878 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-aac486f5-a33d-4709-bfa5-89b1f7a44951 req-da39e986-6710-4a86-8011-3f569158484e service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:45.713417 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-aac486f5-a33d-4709-bfa5-89b1f7a44951 req-da39e986-6710-4a86-8011-3f569158484e service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:45.713874 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-aac486f5-a33d-4709-bfa5-89b1f7a44951 req-da39e986-6710-4a86-8011-3f569158484e service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:45.728088 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-aac486f5-a33d-4709-bfa5-89b1f7a44951 req-da39e986-6710-4a86-8011-3f569158484e service nova] Creating event network-changed:d1c13a57-f549-4198-9a2d-173f2932d012 for instance 9895c2ec-35ea-419e-9565-0c0f2fc5bbbc on n-h1-851028-13 Oct 04 18:34:45.735472 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-aac486f5-a33d-4709-bfa5-89b1f7a44951 req-da39e986-6710-4a86-8011-3f569158484e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040297 Oct 04 18:34:45.736823 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 540/985] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:34:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:34:45.744293 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-54f3740b-0f3d-40b6-9a32-e51f3d381d67 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:45.753672 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-54f3740b-0f3d-40b6-9a32-e51f3d381d67 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] [instance: 101edf03-d928-461d-98cf-12753ae7f7d7] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:45.766376 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-54f3740b-0f3d-40b6-9a32-e51f3d381d67 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:45.767213 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-54f3740b-0f3d-40b6-9a32-e51f3d381d67 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:45.767658 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-54f3740b-0f3d-40b6-9a32-e51f3d381d67 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:45.768765 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-54f3740b-0f3d-40b6-9a32-e51f3d381d67 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:45.769987 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-54f3740b-0f3d-40b6-9a32-e51f3d381d67 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:45.770463 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-54f3740b-0f3d-40b6-9a32-e51f3d381d67 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:45.958361 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-43f00e00-62fa-4ab4-9ded-1781001274b4 tempest-SecurityGroupRulesNegativeTestJSON-1902147119 tempest-SecurityGroupRulesNegativeTestJSON-1902147119-project] 10.222.0.43 "DELETE /compute/v2.1/os-security-groups/8620a6f4-fb10-4b4e-8689-cf57adce7927" status: 202 len: 0 microversion: 2.1 time: 0.450289 Oct 04 18:34:45.959877 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 446/986] 10.222.0.43 () {58 vars in 1272 bytes} [Tue Oct 4 18:34:45 2022] DELETE /compute/v2.1/os-security-groups/8620a6f4-fb10-4b4e-8689-cf57adce7927 => generated 0 bytes in 453 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:34:45.970794 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-9261efe0-f0ac-4fcb-b339-0d3fead9751a tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:45.972142 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-9261efe0-f0ac-4fcb-b339-0d3fead9751a tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] [instance: 93798a9a-d90d-4a4e-8e30-d6575486ff56] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:45.986272 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9261efe0-f0ac-4fcb-b339-0d3fead9751a tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:45.987344 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9261efe0-f0ac-4fcb-b339-0d3fead9751a tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:45.988415 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9261efe0-f0ac-4fcb-b339-0d3fead9751a tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:45.989524 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9261efe0-f0ac-4fcb-b339-0d3fead9751a tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:45.990446 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9261efe0-f0ac-4fcb-b339-0d3fead9751a tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:45.991318 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9261efe0-f0ac-4fcb-b339-0d3fead9751a tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:46.012043 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-54f3740b-0f3d-40b6-9a32-e51f3d381d67 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4aec5af742842f5bb2048c8b7d60687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829069b2787a423f922fcc5b5702f167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:46.026183 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-54f3740b-0f3d-40b6-9a32-e51f3d381d67 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] 10.222.0.43 "GET /compute/v2.1/servers/101edf03-d928-461d-98cf-12753ae7f7d7" status: 200 len: 1475 microversion: 2.1 time: 0.287969 Oct 04 18:34:46.027397 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 541/987] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:45 2022] GET /compute/v2.1/servers/101edf03-d928-461d-98cf-12753ae7f7d7 => generated 1475 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:46.036229 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-c1220384-44f9-44f0-bbc5-a7fa950fa68d tempest-SecurityGroupRulesNegativeTestJSON-1902147119 tempest-SecurityGroupRulesNegativeTestJSON-1902147119-project] Calling method '.version_select at 0x7fb224110310>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:46.350269 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-9261efe0-f0ac-4fcb-b339-0d3fead9751a tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a41ab6fb78a42ceaca621c5a38ffc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa31ed92017490a82497c7b8910aef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:46.363626 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-9261efe0-f0ac-4fcb-b339-0d3fead9751a tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] 10.222.0.43 "GET /compute/v2.1/servers/93798a9a-d90d-4a4e-8e30-d6575486ff56" status: 200 len: 1308 microversion: 2.1 time: 0.401825 Oct 04 18:34:46.364667 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 447/988] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:45 2022] GET /compute/v2.1/servers/93798a9a-d90d-4a4e-8e30-d6575486ff56 => generated 1308 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:46.371653 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-b29ef3e1-af36-4c4b-81c5-509e3b871b37 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:46.372525 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-b29ef3e1-af36-4c4b-81c5-509e3b871b37 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] [instance: 84e0414b-a39f-4bfe-bc9d-c170ceb34d15] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:46.379584 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b29ef3e1-af36-4c4b-81c5-509e3b871b37 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:46.380557 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b29ef3e1-af36-4c4b-81c5-509e3b871b37 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:46.381374 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b29ef3e1-af36-4c4b-81c5-509e3b871b37 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:46.383071 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b29ef3e1-af36-4c4b-81c5-509e3b871b37 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:46.383846 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b29ef3e1-af36-4c4b-81c5-509e3b871b37 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:46.384491 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b29ef3e1-af36-4c4b-81c5-509e3b871b37 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:46.547013 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-b29ef3e1-af36-4c4b-81c5-509e3b871b37 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:46.568606 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-b29ef3e1-af36-4c4b-81c5-509e3b871b37 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:46.570478 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-b29ef3e1-af36-4c4b-81c5-509e3b871b37 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:46.590595 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-b29ef3e1-af36-4c4b-81c5-509e3b871b37 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] 10.222.0.43 "GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15" status: 200 len: 1537 microversion: 2.91 time: 0.211763 Oct 04 18:34:46.591969 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 448/989] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:34:46 2022] GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15 => generated 1537 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:34:46.597006 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-d0003de5-0e0b-4cbc-b52c-b403bbaf9302 req-933a795f-3dc7-4740-94df-b3dc4397cc43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc077a8b-c0f8-4bb1-8a39-91874ac015e7", "name": "network-vif-deleted", "tag": "8aafc535-def4-4ec3-9e02-7b72095d1324"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:34:46.607981 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-c1220384-44f9-44f0-bbc5-a7fa950fa68d tempest-SecurityGroupRulesNegativeTestJSON-1902147119 tempest-SecurityGroupRulesNegativeTestJSON-1902147119-project] 10.222.0.43 "DELETE /compute/v2.1/os-security-groups/204e5115-7a8e-4058-947b-eec368e3a2e0" status: 202 len: 0 microversion: 2.1 time: 0.579355 Oct 04 18:34:46.608756 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-d0003de5-0e0b-4cbc-b52c-b403bbaf9302 req-933a795f-3dc7-4740-94df-b3dc4397cc43 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:46.610062 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-d0003de5-0e0b-4cbc-b52c-b403bbaf9302 req-933a795f-3dc7-4740-94df-b3dc4397cc43 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:46.610668 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-d0003de5-0e0b-4cbc-b52c-b403bbaf9302 req-933a795f-3dc7-4740-94df-b3dc4397cc43 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:46.612289 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 542/990] 10.222.0.43 () {58 vars in 1272 bytes} [Tue Oct 4 18:34:46 2022] DELETE /compute/v2.1/os-security-groups/204e5115-7a8e-4058-947b-eec368e3a2e0 => generated 0 bytes in 584 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:34:46.619135 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-5ea63b53-4ec8-42f1-b4ef-89b76e1e7bc4 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:46.620059 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-5ea63b53-4ec8-42f1-b4ef-89b76e1e7bc4 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] [instance: eb05639b-cd53-4c27-9505-20e668a16acc] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:46.632996 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5ea63b53-4ec8-42f1-b4ef-89b76e1e7bc4 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:46.635488 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5ea63b53-4ec8-42f1-b4ef-89b76e1e7bc4 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:46.635954 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5ea63b53-4ec8-42f1-b4ef-89b76e1e7bc4 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:46.636699 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5ea63b53-4ec8-42f1-b4ef-89b76e1e7bc4 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:46.637193 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5ea63b53-4ec8-42f1-b4ef-89b76e1e7bc4 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:46.639991 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5ea63b53-4ec8-42f1-b4ef-89b76e1e7bc4 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:46.659356 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-d0003de5-0e0b-4cbc-b52c-b403bbaf9302 req-933a795f-3dc7-4740-94df-b3dc4397cc43 service nova] Creating event network-vif-deleted:8aafc535-def4-4ec3-9e02-7b72095d1324 for instance fc077a8b-c0f8-4bb1-8a39-91874ac015e7 on n-h2-851028-13 Oct 04 18:34:46.673920 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-d0003de5-0e0b-4cbc-b52c-b403bbaf9302 req-933a795f-3dc7-4740-94df-b3dc4397cc43 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080397 Oct 04 18:34:46.675051 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 449/991] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:34:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:34:46.680350 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-a363f483-c711-4238-ad9f-f787be44f175 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:46.692606 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-a363f483-c711-4238-ad9f-f787be44f175 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] [instance: fc077a8b-c0f8-4bb1-8a39-91874ac015e7] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:46.705336 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a363f483-c711-4238-ad9f-f787be44f175 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:46.706016 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a363f483-c711-4238-ad9f-f787be44f175 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:46.706621 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a363f483-c711-4238-ad9f-f787be44f175 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:46.707530 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a363f483-c711-4238-ad9f-f787be44f175 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:46.708175 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a363f483-c711-4238-ad9f-f787be44f175 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:46.711768 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a363f483-c711-4238-ad9f-f787be44f175 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:46.798493 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a363f483-c711-4238-ad9f-f787be44f175 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:46.799184 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a363f483-c711-4238-ad9f-f787be44f175 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:46.799818 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a363f483-c711-4238-ad9f-f787be44f175 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:46.800654 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.objects.instance [None req-a363f483-c711-4238-ad9f-f787be44f175 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lazy-loading 'fault' on Instance uuid fc077a8b-c0f8-4bb1-8a39-91874ac015e7 {{(pid=123595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:34:46.931625 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-5ea63b53-4ec8-42f1-b4ef-89b76e1e7bc4 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64887fff0bc7417094c4fee2f7e9aa5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6187bfad04cb7bc17155862ee0cdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:46.937836 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:34:46.945597 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-5ea63b53-4ec8-42f1-b4ef-89b76e1e7bc4 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] 10.222.0.43 "GET /compute/v2.1/servers/eb05639b-cd53-4c27-9505-20e668a16acc" status: 200 len: 1555 microversion: 2.1 time: 0.331856 Oct 04 18:34:46.949702 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 543/992] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:46 2022] GET /compute/v2.1/servers/eb05639b-cd53-4c27-9505-20e668a16acc => generated 1555 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:46.957705 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-dbf1d204-a3d1-499e-bfb3-ba710fbd1fb4 tempest-SecurityGroupRulesNegativeTestJSON-1902147119 tempest-SecurityGroupRulesNegativeTestJSON-1902147119-project] Calling method '.version_select at 0x7fb21fb581f0>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:46.986574 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-a363f483-c711-4238-ad9f-f787be44f175 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7db99f361654711bea7f1b2c404d312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7adedcdb9c3485ea2738c00e25aa3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:46.995112 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-a363f483-c711-4238-ad9f-f787be44f175 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] 10.222.0.43 "GET /compute/v2.1/servers/fc077a8b-c0f8-4bb1-8a39-91874ac015e7" status: 200 len: 1306 microversion: 2.1 time: 0.318695 Oct 04 18:34:46.995699 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 450/993] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:46 2022] GET /compute/v2.1/servers/fc077a8b-c0f8-4bb1-8a39-91874ac015e7 => generated 1306 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:47.010157 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-874b26b4-de8d-4c9e-a336-35b8e4cfcd4a tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:47.011018 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-874b26b4-de8d-4c9e-a336-35b8e4cfcd4a tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] [instance: 9895c2ec-35ea-419e-9565-0c0f2fc5bbbc] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:47.019574 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-874b26b4-de8d-4c9e-a336-35b8e4cfcd4a tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:47.020312 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-874b26b4-de8d-4c9e-a336-35b8e4cfcd4a tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:47.020911 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-874b26b4-de8d-4c9e-a336-35b8e4cfcd4a tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:47.021823 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-874b26b4-de8d-4c9e-a336-35b8e4cfcd4a tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:47.022451 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-874b26b4-de8d-4c9e-a336-35b8e4cfcd4a tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:47.023035 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-874b26b4-de8d-4c9e-a336-35b8e4cfcd4a tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:47.383703 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-874b26b4-de8d-4c9e-a336-35b8e4cfcd4a tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:47.396523 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-874b26b4-de8d-4c9e-a336-35b8e4cfcd4a tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:47.398713 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-874b26b4-de8d-4c9e-a336-35b8e4cfcd4a tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:47.400238 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-874b26b4-de8d-4c9e-a336-35b8e4cfcd4a tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] 10.222.0.43 "GET /compute/v2.1/servers/9895c2ec-35ea-419e-9565-0c0f2fc5bbbc" status: 200 len: 1566 microversion: 2.25 time: 0.393928 Oct 04 18:34:47.401381 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 451/994] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:34:47 2022] GET /compute/v2.1/servers/9895c2ec-35ea-419e-9565-0c0f2fc5bbbc => generated 1566 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:34:47.407396 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-a3f41615-d271-402b-9065-35a08406b589 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:47.408163 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-a3f41615-d271-402b-9065-35a08406b589 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] [instance: eb05639b-cd53-4c27-9505-20e668a16acc] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:47.414680 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a3f41615-d271-402b-9065-35a08406b589 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:47.415357 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a3f41615-d271-402b-9065-35a08406b589 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:47.415990 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a3f41615-d271-402b-9065-35a08406b589 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:47.416876 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a3f41615-d271-402b-9065-35a08406b589 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:47.417526 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a3f41615-d271-402b-9065-35a08406b589 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:47.418114 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a3f41615-d271-402b-9065-35a08406b589 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:47.443478 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=4 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:34:47.499317 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-dbf1d204-a3d1-499e-bfb3-ba710fbd1fb4 tempest-SecurityGroupRulesNegativeTestJSON-1902147119 tempest-SecurityGroupRulesNegativeTestJSON-1902147119-project] 10.222.0.43 "DELETE /compute/v2.1/os-security-groups/1fc1e2cf-7a86-41b9-a6b8-b04994e8f300" status: 202 len: 0 microversion: 2.1 time: 0.547936 Oct 04 18:34:47.503824 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 544/995] 10.222.0.43 () {58 vars in 1272 bytes} [Tue Oct 4 18:34:46 2022] DELETE /compute/v2.1/os-security-groups/1fc1e2cf-7a86-41b9-a6b8-b04994e8f300 => generated 0 bytes in 553 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:34:47.509929 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-d0ff9db8-4fc3-4988-8d32-3f5475e64508 req-7a928d02-6e88-48f3-974f-0e5104b9b0c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93798a9a-d90d-4a4e-8e30-d6575486ff56", "name": "network-vif-plugged", "status": "completed", "tag": "7b3aff25-35c6-4d42-9b23-577e2f738102"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:34:47.529043 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-d0ff9db8-4fc3-4988-8d32-3f5475e64508 req-7a928d02-6e88-48f3-974f-0e5104b9b0c8 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:47.529891 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-d0ff9db8-4fc3-4988-8d32-3f5475e64508 req-7a928d02-6e88-48f3-974f-0e5104b9b0c8 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:47.530538 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-d0ff9db8-4fc3-4988-8d32-3f5475e64508 req-7a928d02-6e88-48f3-974f-0e5104b9b0c8 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:47.548988 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-d0ff9db8-4fc3-4988-8d32-3f5475e64508 req-7a928d02-6e88-48f3-974f-0e5104b9b0c8 service nova] Creating event network-vif-plugged:7b3aff25-35c6-4d42-9b23-577e2f738102 for instance 93798a9a-d90d-4a4e-8e30-d6575486ff56 on n-h1-851028-13 Oct 04 18:34:47.557582 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-d0ff9db8-4fc3-4988-8d32-3f5475e64508 req-7a928d02-6e88-48f3-974f-0e5104b9b0c8 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052205 Oct 04 18:34:47.559016 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 545/996] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:34:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:34:47.565066 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-aa358622-16a7-4db1-abfd-bf7633e5f371 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:47.566504 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-aa358622-16a7-4db1-abfd-bf7633e5f371 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] [instance: 101edf03-d928-461d-98cf-12753ae7f7d7] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:47.571811 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-a3f41615-d271-402b-9065-35a08406b589 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] 10.222.0.43 "GET /compute/v2.1/servers/eb05639b-cd53-4c27-9505-20e668a16acc/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.169032 Oct 04 18:34:47.572923 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 452/997] 10.222.0.43 () {58 vars in 1275 bytes} [Tue Oct 4 18:34:47 2022] GET /compute/v2.1/servers/eb05639b-cd53-4c27-9505-20e668a16acc/os-interface => generated 285 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:34:47.577856 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-4b59e6c8-135e-46a3-8042-4fb9975daac2 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:47.579546 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-4b59e6c8-135e-46a3-8042-4fb9975daac2 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] [instance: 93798a9a-d90d-4a4e-8e30-d6575486ff56] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:47.606134 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-aa358622-16a7-4db1-abfd-bf7633e5f371 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:47.607090 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-aa358622-16a7-4db1-abfd-bf7633e5f371 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:47.607704 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-aa358622-16a7-4db1-abfd-bf7633e5f371 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:47.608859 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-aa358622-16a7-4db1-abfd-bf7633e5f371 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:47.610877 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-aa358622-16a7-4db1-abfd-bf7633e5f371 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:47.611235 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4b59e6c8-135e-46a3-8042-4fb9975daac2 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:47.612030 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-aa358622-16a7-4db1-abfd-bf7633e5f371 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:47.622301 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4b59e6c8-135e-46a3-8042-4fb9975daac2 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:47.623527 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4b59e6c8-135e-46a3-8042-4fb9975daac2 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:47.624458 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4b59e6c8-135e-46a3-8042-4fb9975daac2 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:47.625936 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4b59e6c8-135e-46a3-8042-4fb9975daac2 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:47.626565 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4b59e6c8-135e-46a3-8042-4fb9975daac2 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:47.748439 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-aa358622-16a7-4db1-abfd-bf7633e5f371 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4aec5af742842f5bb2048c8b7d60687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829069b2787a423f922fcc5b5702f167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:47.780674 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-aa358622-16a7-4db1-abfd-bf7633e5f371 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] 10.222.0.43 "GET /compute/v2.1/servers/101edf03-d928-461d-98cf-12753ae7f7d7" status: 200 len: 1433 microversion: 2.1 time: 0.219889 Oct 04 18:34:47.784809 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 546/998] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:47 2022] GET /compute/v2.1/servers/101edf03-d928-461d-98cf-12753ae7f7d7 => generated 1433 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:47.791775 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-1974f3d9-eab6-4978-ae6a-a9a96ef41496 tempest-SecurityGroupRulesNegativeTestJSON-1902147119 tempest-SecurityGroupRulesNegativeTestJSON-1902147119-project] Calling method '.version_select at 0x7fb21fb58940>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:47.944411 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-4b59e6c8-135e-46a3-8042-4fb9975daac2 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a41ab6fb78a42ceaca621c5a38ffc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa31ed92017490a82497c7b8910aef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:47.953040 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-4b59e6c8-135e-46a3-8042-4fb9975daac2 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] 10.222.0.43 "GET /compute/v2.1/servers/93798a9a-d90d-4a4e-8e30-d6575486ff56" status: 200 len: 1308 microversion: 2.1 time: 0.378849 Oct 04 18:34:47.965742 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 453/999] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:47 2022] GET /compute/v2.1/servers/93798a9a-d90d-4a4e-8e30-d6575486ff56 => generated 1308 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:47.974869 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-5aff0980-a795-4c6b-8111-9b5258c7aef9 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:47.976225 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-5aff0980-a795-4c6b-8111-9b5258c7aef9 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] [instance: 84e0414b-a39f-4bfe-bc9d-c170ceb34d15] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:47.982533 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5aff0980-a795-4c6b-8111-9b5258c7aef9 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:47.983280 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5aff0980-a795-4c6b-8111-9b5258c7aef9 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:47.983886 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5aff0980-a795-4c6b-8111-9b5258c7aef9 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:47.985369 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5aff0980-a795-4c6b-8111-9b5258c7aef9 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:47.985989 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5aff0980-a795-4c6b-8111-9b5258c7aef9 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:47.986564 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5aff0980-a795-4c6b-8111-9b5258c7aef9 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:48.075154 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-5aff0980-a795-4c6b-8111-9b5258c7aef9 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:48.084546 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-5aff0980-a795-4c6b-8111-9b5258c7aef9 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:48.086299 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-5aff0980-a795-4c6b-8111-9b5258c7aef9 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:48.091857 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-5aff0980-a795-4c6b-8111-9b5258c7aef9 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] 10.222.0.43 "GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15" status: 200 len: 1537 microversion: 2.91 time: 0.124884 Oct 04 18:34:48.092668 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 454/1000] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:34:47 2022] GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15 => generated 1537 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:34:48.099331 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-f8097870-0405-49ce-88de-f0bf43ccf70e tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:48.100290 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-f8097870-0405-49ce-88de-f0bf43ccf70e tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] [instance: fc077a8b-c0f8-4bb1-8a39-91874ac015e7] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:48.108436 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f8097870-0405-49ce-88de-f0bf43ccf70e tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:48.109312 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f8097870-0405-49ce-88de-f0bf43ccf70e tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:48.110971 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f8097870-0405-49ce-88de-f0bf43ccf70e tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:48.112349 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f8097870-0405-49ce-88de-f0bf43ccf70e tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:48.113091 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f8097870-0405-49ce-88de-f0bf43ccf70e tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:48.113826 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f8097870-0405-49ce-88de-f0bf43ccf70e tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:48.136417 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-f8097870-0405-49ce-88de-f0bf43ccf70e tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] HTTP exception thrown: Instance fc077a8b-c0f8-4bb1-8a39-91874ac015e7 could not be found. Oct 04 18:34:48.138211 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-f8097870-0405-49ce-88de-f0bf43ccf70e tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Request method failure captured: Oct 04 18:34:48.138211 n-d-851028-13 devstack@n-api.service[123595]: request: GET /compute/v2.1/servers/fc077a8b-c0f8-4bb1-8a39-91874ac015e7 HTTP/1.1 Oct 04 18:34:48.138211 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 18:34:48.138211 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 18:34:48.138211 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 18:34:48.138211 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 0 Oct 04 18:34:48.138211 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 18:34:48.138211 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 18:34:48.138211 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 18:34:48.138211 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 18:34:48.138211 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPHvuItqv5xcxbp_bqbjUggZhpUG53TiGDPrqjFiNZGHAMY6QdeICs1jR4QxEtGJ9kJciv8ws3outzNBgAd1ZiItYEkQ7c76M1xzjstLBOG0OAwb8aGthDLSqRW7T7V0wj50TxoUUgeNpSMbG6VscuaiI7GHr0fqlhRjDqzMaKz-IIxQ Oct 04 18:34:48.138211 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 18:34:48.138211 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 18:34:48.138211 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 18:34:48.138211 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 18:34:48.138211 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 18:34:48.138211 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 18:34:48.138211 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: e7adedcdb9c3485ea2738c00e25aa3fd Oct 04 18:34:48.138211 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-ServersOnMultiNodesTest-1469796738 Oct 04 18:34:48.138211 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 18:34:48.138211 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 18:34:48.138211 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/e7adedcdb9c3485ea2738c00e25aa3fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_e7adedcdb9c3485ea2738c00e25aa3fd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/e7adedcdb9c3485ea2738c00e25aa3fd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/e7adedcdb9c3485ea2738c00e25aa3fd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:34:48.138211 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-ServersOnMultiNodesTest-1469796738 Oct 04 18:34:48.138211 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: e7adedcdb9c3485ea2738c00e25aa3fd Oct 04 18:34:48.138211 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1469796738 Oct 04 18:34:48.138211 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-ServersOnMultiNodesTest-1469796738-project Oct 04 18:34:48.138211 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 18:34:48.138211 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 18:34:48.138211 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: a7db99f361654711bea7f1b2c404d312 Oct 04 18:34:48.138211 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-ServersOnMultiNodesTest-1469796738-project Oct 04 18:34:48.138211 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 18:34:48.138211 n-d-851028-13 devstack@n-api.service[123595]: exception: Instance fc077a8b-c0f8-4bb1-8a39-91874ac015e7 could not be found. Oct 04 18:34:48.138211 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': 'fc077a8b-c0f8-4bb1-8a39-91874ac015e7'} Oct 04 18:34:48.138211 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:34:48.138211 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:34:48.138211 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:34:48.138211 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:34:48.138211 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:34:48.138211 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:34:48.138211 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:34:48.138211 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:34:48.138211 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:34:48.138211 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:34:48.138211 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fc077a8b-c0f8-4bb1-8a39-91874ac015e7 could not be found. Oct 04 18:34:48.138211 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:34:48.138211 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:34:48.138211 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:34:48.138211 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:34:48.138211 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:34:48.138211 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:34:48.138211 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:34:48.138211 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:34:48.138211 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:34:48.138211 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:34:48.138211 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:34:48.138211 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:34:48.138211 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:34:48.138211 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:34:48.138211 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:34:48.138211 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:34:48.138211 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fc077a8b-c0f8-4bb1-8a39-91874ac015e7 could not be found. Oct 04 18:34:48.138211 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:34:48.138211 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:34:48.138211 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:34:48.142990 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:34:48.142990 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:34:48.142990 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:34:48.142990 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:34:48.142990 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:34:48.142990 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fc077a8b-c0f8-4bb1-8a39-91874ac015e7 could not be found. Oct 04 18:34:48.142990 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:34:48.142990 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-f8097870-0405-49ce-88de-f0bf43ccf70e tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Returning 404 to user: Instance fc077a8b-c0f8-4bb1-8a39-91874ac015e7 could not be found. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:34:48.144530 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-f8097870-0405-49ce-88de-f0bf43ccf70e tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] 10.222.0.43 "GET /compute/v2.1/servers/fc077a8b-c0f8-4bb1-8a39-91874ac015e7" status: 404 len: 111 microversion: 2.1 time: 0.050142 Oct 04 18:34:48.145585 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 455/1001] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:48 2022] GET /compute/v2.1/servers/fc077a8b-c0f8-4bb1-8a39-91874ac015e7 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:34:48.154155 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-38517371-11d7-4a11-ac97-792d34616b00 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:48.155077 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-38517371-11d7-4a11-ac97-792d34616b00 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] [instance: 6251d93c-aab7-43cc-9be0-212545cf2b01] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:48.163299 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-38517371-11d7-4a11-ac97-792d34616b00 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:48.164184 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-38517371-11d7-4a11-ac97-792d34616b00 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:48.166479 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-38517371-11d7-4a11-ac97-792d34616b00 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:48.167446 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-38517371-11d7-4a11-ac97-792d34616b00 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:48.168454 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-38517371-11d7-4a11-ac97-792d34616b00 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:48.169251 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-38517371-11d7-4a11-ac97-792d34616b00 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:48.217734 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-38517371-11d7-4a11-ac97-792d34616b00 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] [instance: 6251d93c-aab7-43cc-9be0-212545cf2b01] Going to try to terminate instance {{(pid=123595) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:34:48.336704 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-38517371-11d7-4a11-ac97-792d34616b00 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] 10.222.0.43 "DELETE /compute/v2.1/servers/6251d93c-aab7-43cc-9be0-212545cf2b01" status: 204 len: 0 microversion: 2.1 time: 0.187064 Oct 04 18:34:48.339379 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 456/1002] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 18:34:48 2022] DELETE /compute/v2.1/servers/6251d93c-aab7-43cc-9be0-212545cf2b01 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 18:34:48.352460 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-8cc2f1c9-c2af-4bac-8076-ff8c673bd780 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:48.353283 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-8cc2f1c9-c2af-4bac-8076-ff8c673bd780 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] [instance: 640d917c-c9cb-4758-aa1d-216e34a55297] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:48.362966 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8cc2f1c9-c2af-4bac-8076-ff8c673bd780 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:48.363581 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8cc2f1c9-c2af-4bac-8076-ff8c673bd780 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:48.364455 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8cc2f1c9-c2af-4bac-8076-ff8c673bd780 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:48.365790 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8cc2f1c9-c2af-4bac-8076-ff8c673bd780 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:48.366474 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8cc2f1c9-c2af-4bac-8076-ff8c673bd780 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:48.367531 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8cc2f1c9-c2af-4bac-8076-ff8c673bd780 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:48.405628 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-8cc2f1c9-c2af-4bac-8076-ff8c673bd780 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] [instance: 640d917c-c9cb-4758-aa1d-216e34a55297] Going to try to terminate instance {{(pid=123595) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:34:48.422255 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=96,nova_cell1:INSERT=2 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:34:48.507814 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-8cc2f1c9-c2af-4bac-8076-ff8c673bd780 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] 10.222.0.43 "DELETE /compute/v2.1/servers/640d917c-c9cb-4758-aa1d-216e34a55297" status: 204 len: 0 microversion: 2.1 time: 0.162696 Oct 04 18:34:48.511829 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 457/1003] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 18:34:48 2022] DELETE /compute/v2.1/servers/640d917c-c9cb-4758-aa1d-216e34a55297 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 18:34:48.515557 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-806e8b4d-b0dd-4915-930c-16ad792063e3 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:48.518146 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-806e8b4d-b0dd-4915-930c-16ad792063e3 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] [instance: 9895c2ec-35ea-419e-9565-0c0f2fc5bbbc] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:48.521909 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:34:48.526391 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-806e8b4d-b0dd-4915-930c-16ad792063e3 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:48.526975 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-806e8b4d-b0dd-4915-930c-16ad792063e3 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:48.527497 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-806e8b4d-b0dd-4915-930c-16ad792063e3 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:48.528296 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-806e8b4d-b0dd-4915-930c-16ad792063e3 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:48.528828 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-806e8b4d-b0dd-4915-930c-16ad792063e3 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:48.529368 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-806e8b4d-b0dd-4915-930c-16ad792063e3 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:48.692602 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-806e8b4d-b0dd-4915-930c-16ad792063e3 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:48.700945 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-806e8b4d-b0dd-4915-930c-16ad792063e3 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:48.702531 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-806e8b4d-b0dd-4915-930c-16ad792063e3 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:48.704375 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-806e8b4d-b0dd-4915-930c-16ad792063e3 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] 10.222.0.43 "GET /compute/v2.1/servers/9895c2ec-35ea-419e-9565-0c0f2fc5bbbc" status: 200 len: 1566 microversion: 2.25 time: 0.194030 Oct 04 18:34:48.705018 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 458/1004] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:34:48 2022] GET /compute/v2.1/servers/9895c2ec-35ea-419e-9565-0c0f2fc5bbbc => generated 1566 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:34:48.720964 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-77694bee-fc0a-4e59-8cd3-8d4feb8ac677 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:48.721678 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-77694bee-fc0a-4e59-8cd3-8d4feb8ac677 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] [instance: 6251d93c-aab7-43cc-9be0-212545cf2b01] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:48.728352 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-77694bee-fc0a-4e59-8cd3-8d4feb8ac677 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:48.728856 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-77694bee-fc0a-4e59-8cd3-8d4feb8ac677 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:48.729343 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-77694bee-fc0a-4e59-8cd3-8d4feb8ac677 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:48.730069 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-77694bee-fc0a-4e59-8cd3-8d4feb8ac677 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:48.730526 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-77694bee-fc0a-4e59-8cd3-8d4feb8ac677 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:48.730962 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-77694bee-fc0a-4e59-8cd3-8d4feb8ac677 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:48.865916 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-1974f3d9-eab6-4978-ae6a-a9a96ef41496 tempest-SecurityGroupRulesNegativeTestJSON-1902147119 tempest-SecurityGroupRulesNegativeTestJSON-1902147119-project] 10.222.0.43 "DELETE /compute/v2.1/os-security-groups/db5d0dac-1fc4-4ae3-a268-4040060bcd72" status: 202 len: 0 microversion: 2.1 time: 1.078981 Oct 04 18:34:48.866671 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 547/1005] 10.222.0.43 () {58 vars in 1272 bytes} [Tue Oct 4 18:34:47 2022] DELETE /compute/v2.1/os-security-groups/db5d0dac-1fc4-4ae3-a268-4040060bcd72 => generated 0 bytes in 1081 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:34:48.873513 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-fc86c1ef-9495-462c-8d0c-51797372ebac req-43ec6a2c-1c61-4e82-b11f-98957565cfcd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "101edf03-d928-461d-98cf-12753ae7f7d7", "name": "network-vif-deleted", "tag": "c3985dab-2758-4c15-b5b3-6093e8e8ce76"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:34:48.882778 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-77694bee-fc0a-4e59-8cd3-8d4feb8ac677 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7db99f361654711bea7f1b2c404d312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7adedcdb9c3485ea2738c00e25aa3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:48.894044 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-fc86c1ef-9495-462c-8d0c-51797372ebac req-43ec6a2c-1c61-4e82-b11f-98957565cfcd service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:48.894521 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-fc86c1ef-9495-462c-8d0c-51797372ebac req-43ec6a2c-1c61-4e82-b11f-98957565cfcd service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:48.894949 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-fc86c1ef-9495-462c-8d0c-51797372ebac req-43ec6a2c-1c61-4e82-b11f-98957565cfcd service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:48.899800 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-77694bee-fc0a-4e59-8cd3-8d4feb8ac677 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] 10.222.0.43 "GET /compute/v2.1/servers/6251d93c-aab7-43cc-9be0-212545cf2b01" status: 200 len: 1474 microversion: 2.1 time: 0.185343 Oct 04 18:34:48.918050 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 459/1006] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:48 2022] GET /compute/v2.1/servers/6251d93c-aab7-43cc-9be0-212545cf2b01 => generated 1474 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:48.930131 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-a903a215-4f52-477c-8a29-7e26729eb69c tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:48.930748 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-a903a215-4f52-477c-8a29-7e26729eb69c tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] [instance: 101edf03-d928-461d-98cf-12753ae7f7d7] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:48.937401 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-fc86c1ef-9495-462c-8d0c-51797372ebac req-43ec6a2c-1c61-4e82-b11f-98957565cfcd service nova] Creating event network-vif-deleted:c3985dab-2758-4c15-b5b3-6093e8e8ce76 for instance 101edf03-d928-461d-98cf-12753ae7f7d7 on n-h1-851028-13 Oct 04 18:34:48.941686 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a903a215-4f52-477c-8a29-7e26729eb69c tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:48.945651 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a903a215-4f52-477c-8a29-7e26729eb69c tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:48.947360 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-fc86c1ef-9495-462c-8d0c-51797372ebac req-43ec6a2c-1c61-4e82-b11f-98957565cfcd service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079007 Oct 04 18:34:48.948031 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a903a215-4f52-477c-8a29-7e26729eb69c tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:48.949072 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a903a215-4f52-477c-8a29-7e26729eb69c tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:48.950390 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a903a215-4f52-477c-8a29-7e26729eb69c tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:48.950825 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 548/1007] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:34:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:34:48.951420 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a903a215-4f52-477c-8a29-7e26729eb69c tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:48.983865 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-af27493c-f2ba-40b7-ad24-832bab7ccc12 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:48.984309 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-af27493c-f2ba-40b7-ad24-832bab7ccc12 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] [instance: 93798a9a-d90d-4a4e-8e30-d6575486ff56] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:48.992784 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-af27493c-f2ba-40b7-ad24-832bab7ccc12 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:48.996095 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-af27493c-f2ba-40b7-ad24-832bab7ccc12 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:48.998368 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-af27493c-f2ba-40b7-ad24-832bab7ccc12 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:48.999422 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-af27493c-f2ba-40b7-ad24-832bab7ccc12 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:49.010012 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-af27493c-f2ba-40b7-ad24-832bab7ccc12 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:49.010781 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-af27493c-f2ba-40b7-ad24-832bab7ccc12 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:49.017633 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a903a215-4f52-477c-8a29-7e26729eb69c tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:49.019672 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a903a215-4f52-477c-8a29-7e26729eb69c tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:49.021029 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a903a215-4f52-477c-8a29-7e26729eb69c tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:49.021911 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.objects.instance [None req-a903a215-4f52-477c-8a29-7e26729eb69c tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lazy-loading 'fault' on Instance uuid 101edf03-d928-461d-98cf-12753ae7f7d7 {{(pid=123595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:34:49.100147 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-a903a215-4f52-477c-8a29-7e26729eb69c tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4aec5af742842f5bb2048c8b7d60687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829069b2787a423f922fcc5b5702f167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:49.115525 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-a903a215-4f52-477c-8a29-7e26729eb69c tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] 10.222.0.43 "GET /compute/v2.1/servers/101edf03-d928-461d-98cf-12753ae7f7d7" status: 200 len: 1309 microversion: 2.1 time: 0.196638 Oct 04 18:34:49.116625 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 460/1008] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:48 2022] GET /compute/v2.1/servers/101edf03-d928-461d-98cf-12753ae7f7d7 => generated 1309 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:49.133644 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-4431ec90-bc57-4d16-a28e-78c23189dfb8 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:49.134328 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-4431ec90-bc57-4d16-a28e-78c23189dfb8 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] [instance: 84e0414b-a39f-4bfe-bc9d-c170ceb34d15] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:49.146555 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4431ec90-bc57-4d16-a28e-78c23189dfb8 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:49.147217 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4431ec90-bc57-4d16-a28e-78c23189dfb8 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:49.147765 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4431ec90-bc57-4d16-a28e-78c23189dfb8 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:49.148745 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4431ec90-bc57-4d16-a28e-78c23189dfb8 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:49.149484 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4431ec90-bc57-4d16-a28e-78c23189dfb8 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:49.149977 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4431ec90-bc57-4d16-a28e-78c23189dfb8 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:49.235772 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-4431ec90-bc57-4d16-a28e-78c23189dfb8 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:49.244668 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-4431ec90-bc57-4d16-a28e-78c23189dfb8 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:49.246142 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-4431ec90-bc57-4d16-a28e-78c23189dfb8 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:49.252196 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-4431ec90-bc57-4d16-a28e-78c23189dfb8 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] 10.222.0.43 "GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15" status: 200 len: 1537 microversion: 2.91 time: 0.122554 Oct 04 18:34:49.252963 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 461/1009] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:34:49 2022] GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15 => generated 1537 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:34:49.458031 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-af27493c-f2ba-40b7-ad24-832bab7ccc12 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a41ab6fb78a42ceaca621c5a38ffc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa31ed92017490a82497c7b8910aef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:49.470637 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-af27493c-f2ba-40b7-ad24-832bab7ccc12 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] 10.222.0.43 "GET /compute/v2.1/servers/93798a9a-d90d-4a4e-8e30-d6575486ff56" status: 200 len: 1308 microversion: 2.1 time: 0.491071 Oct 04 18:34:49.471967 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 549/1010] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:48 2022] GET /compute/v2.1/servers/93798a9a-d90d-4a4e-8e30-d6575486ff56 => generated 1308 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:49.730222 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-b684096b-5d17-4132-8bb2-4fc25c6cf9fc tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:49.731115 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-b684096b-5d17-4132-8bb2-4fc25c6cf9fc tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] [instance: 9895c2ec-35ea-419e-9565-0c0f2fc5bbbc] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:49.737625 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b684096b-5d17-4132-8bb2-4fc25c6cf9fc tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:49.738360 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b684096b-5d17-4132-8bb2-4fc25c6cf9fc tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:49.738961 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b684096b-5d17-4132-8bb2-4fc25c6cf9fc tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:49.739835 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b684096b-5d17-4132-8bb2-4fc25c6cf9fc tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:49.740301 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b684096b-5d17-4132-8bb2-4fc25c6cf9fc tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:49.740709 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b684096b-5d17-4132-8bb2-4fc25c6cf9fc tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:49.934486 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-87e704fc-0d20-4a13-b8cd-bf791201a094 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:49.935989 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-87e704fc-0d20-4a13-b8cd-bf791201a094 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] [instance: 6251d93c-aab7-43cc-9be0-212545cf2b01] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:49.940659 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-b684096b-5d17-4132-8bb2-4fc25c6cf9fc tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:49.951042 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-87e704fc-0d20-4a13-b8cd-bf791201a094 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:49.952318 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-87e704fc-0d20-4a13-b8cd-bf791201a094 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:49.953391 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-87e704fc-0d20-4a13-b8cd-bf791201a094 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:49.956612 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-87e704fc-0d20-4a13-b8cd-bf791201a094 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:49.959885 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-87e704fc-0d20-4a13-b8cd-bf791201a094 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:49.961271 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-87e704fc-0d20-4a13-b8cd-bf791201a094 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:49.963583 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-b684096b-5d17-4132-8bb2-4fc25c6cf9fc tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:49.967718 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-b684096b-5d17-4132-8bb2-4fc25c6cf9fc tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:49.972938 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-b684096b-5d17-4132-8bb2-4fc25c6cf9fc tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] 10.222.0.43 "GET /compute/v2.1/servers/9895c2ec-35ea-419e-9565-0c0f2fc5bbbc" status: 200 len: 1566 microversion: 2.25 time: 0.246124 Oct 04 18:34:49.975799 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 462/1011] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:34:49 2022] GET /compute/v2.1/servers/9895c2ec-35ea-419e-9565-0c0f2fc5bbbc => generated 1566 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:34:49.982826 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-46e0afcc-42dc-407d-b3b1-7dbbe7e1997d req-55ab9e44-dc2b-49d2-899e-1edb04016b8e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb05639b-cd53-4c27-9505-20e668a16acc", "tag": "1ffe1dcb-316b-4423-ae6b-6882dba87be0"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:34:49.997065 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-46e0afcc-42dc-407d-b3b1-7dbbe7e1997d req-55ab9e44-dc2b-49d2-899e-1edb04016b8e service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:49.997837 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-46e0afcc-42dc-407d-b3b1-7dbbe7e1997d req-55ab9e44-dc2b-49d2-899e-1edb04016b8e service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:49.999379 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-46e0afcc-42dc-407d-b3b1-7dbbe7e1997d req-55ab9e44-dc2b-49d2-899e-1edb04016b8e service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:50.016886 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-46e0afcc-42dc-407d-b3b1-7dbbe7e1997d req-55ab9e44-dc2b-49d2-899e-1edb04016b8e service nova] Creating event network-changed:1ffe1dcb-316b-4423-ae6b-6882dba87be0 for instance eb05639b-cd53-4c27-9505-20e668a16acc on n-h2-851028-13 Oct 04 18:34:50.023641 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-46e0afcc-42dc-407d-b3b1-7dbbe7e1997d req-55ab9e44-dc2b-49d2-899e-1edb04016b8e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046432 Oct 04 18:34:50.026604 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 463/1012] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:34:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:34:50.143212 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-5d8de523-33af-4158-9604-d8a9bffdcc5c tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:50.144760 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-5d8de523-33af-4158-9604-d8a9bffdcc5c tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] [instance: 101edf03-d928-461d-98cf-12753ae7f7d7] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:50.157819 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5d8de523-33af-4158-9604-d8a9bffdcc5c tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:50.158319 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5d8de523-33af-4158-9604-d8a9bffdcc5c tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:50.158758 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5d8de523-33af-4158-9604-d8a9bffdcc5c tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:50.159473 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5d8de523-33af-4158-9604-d8a9bffdcc5c tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:50.159928 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5d8de523-33af-4158-9604-d8a9bffdcc5c tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:50.164843 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5d8de523-33af-4158-9604-d8a9bffdcc5c tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:50.240588 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5d8de523-33af-4158-9604-d8a9bffdcc5c tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:50.241138 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5d8de523-33af-4158-9604-d8a9bffdcc5c tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:50.241719 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5d8de523-33af-4158-9604-d8a9bffdcc5c tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:50.242169 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.objects.instance [None req-5d8de523-33af-4158-9604-d8a9bffdcc5c tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lazy-loading 'fault' on Instance uuid 101edf03-d928-461d-98cf-12753ae7f7d7 {{(pid=123595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:34:50.322666 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-5d8de523-33af-4158-9604-d8a9bffdcc5c tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4aec5af742842f5bb2048c8b7d60687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829069b2787a423f922fcc5b5702f167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:50.335361 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-5d8de523-33af-4158-9604-d8a9bffdcc5c tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] 10.222.0.43 "GET /compute/v2.1/servers/101edf03-d928-461d-98cf-12753ae7f7d7" status: 200 len: 1309 microversion: 2.1 time: 0.195396 Oct 04 18:34:50.337820 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 464/1013] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:50 2022] GET /compute/v2.1/servers/101edf03-d928-461d-98cf-12753ae7f7d7 => generated 1309 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:50.346033 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-199e7ed5-ddb3-4043-be15-24d13366bf42 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:50.349762 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-199e7ed5-ddb3-4043-be15-24d13366bf42 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] [instance: 84e0414b-a39f-4bfe-bc9d-c170ceb34d15] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:50.369692 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-199e7ed5-ddb3-4043-be15-24d13366bf42 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:50.370455 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-199e7ed5-ddb3-4043-be15-24d13366bf42 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:50.371177 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-199e7ed5-ddb3-4043-be15-24d13366bf42 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:50.372099 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-199e7ed5-ddb3-4043-be15-24d13366bf42 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:50.374251 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-199e7ed5-ddb3-4043-be15-24d13366bf42 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:50.374895 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-199e7ed5-ddb3-4043-be15-24d13366bf42 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:50.431692 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-87e704fc-0d20-4a13-b8cd-bf791201a094 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7db99f361654711bea7f1b2c404d312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7adedcdb9c3485ea2738c00e25aa3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:50.447143 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-87e704fc-0d20-4a13-b8cd-bf791201a094 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] 10.222.0.43 "GET /compute/v2.1/servers/6251d93c-aab7-43cc-9be0-212545cf2b01" status: 200 len: 1474 microversion: 2.1 time: 0.519878 Oct 04 18:34:50.447742 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 550/1014] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:49 2022] GET /compute/v2.1/servers/6251d93c-aab7-43cc-9be0-212545cf2b01 => generated 1474 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:34:50.494956 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-91567b88-b621-4d16-8df8-87712eb0cc18 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:50.495587 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-91567b88-b621-4d16-8df8-87712eb0cc18 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] [instance: 93798a9a-d90d-4a4e-8e30-d6575486ff56] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:50.510701 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-91567b88-b621-4d16-8df8-87712eb0cc18 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:50.517001 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-91567b88-b621-4d16-8df8-87712eb0cc18 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:50.518036 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-91567b88-b621-4d16-8df8-87712eb0cc18 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:50.518939 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-91567b88-b621-4d16-8df8-87712eb0cc18 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:50.519550 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-91567b88-b621-4d16-8df8-87712eb0cc18 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:50.520159 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-91567b88-b621-4d16-8df8-87712eb0cc18 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:50.543817 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-199e7ed5-ddb3-4043-be15-24d13366bf42 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:50.558601 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-199e7ed5-ddb3-4043-be15-24d13366bf42 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:50.561933 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-199e7ed5-ddb3-4043-be15-24d13366bf42 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:50.576992 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-199e7ed5-ddb3-4043-be15-24d13366bf42 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] 10.222.0.43 "GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15" status: 200 len: 1537 microversion: 2.91 time: 0.237854 Oct 04 18:34:50.580118 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 465/1015] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:34:50 2022] GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15 => generated 1537 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:34:50.895933 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-91567b88-b621-4d16-8df8-87712eb0cc18 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a41ab6fb78a42ceaca621c5a38ffc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa31ed92017490a82497c7b8910aef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:50.904292 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-91567b88-b621-4d16-8df8-87712eb0cc18 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] 10.222.0.43 "GET /compute/v2.1/servers/93798a9a-d90d-4a4e-8e30-d6575486ff56" status: 200 len: 1308 microversion: 2.1 time: 0.412997 Oct 04 18:34:50.917725 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 551/1016] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:50 2022] GET /compute/v2.1/servers/93798a9a-d90d-4a4e-8e30-d6575486ff56 => generated 1308 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:51.003229 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-4dc09b86-a5ab-485d-920d-a6d841df8c93 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:51.004396 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-4dc09b86-a5ab-485d-920d-a6d841df8c93 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] [instance: 9895c2ec-35ea-419e-9565-0c0f2fc5bbbc] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:51.012443 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4dc09b86-a5ab-485d-920d-a6d841df8c93 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:51.013323 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4dc09b86-a5ab-485d-920d-a6d841df8c93 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:51.014008 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4dc09b86-a5ab-485d-920d-a6d841df8c93 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:51.015011 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4dc09b86-a5ab-485d-920d-a6d841df8c93 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:51.015739 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4dc09b86-a5ab-485d-920d-a6d841df8c93 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:51.016528 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4dc09b86-a5ab-485d-920d-a6d841df8c93 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:51.364643 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-c357ab80-7df9-425d-b8a5-168c1ab50072 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:51.366763 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-c357ab80-7df9-425d-b8a5-168c1ab50072 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] [instance: 101edf03-d928-461d-98cf-12753ae7f7d7] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:51.380885 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c357ab80-7df9-425d-b8a5-168c1ab50072 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:51.381418 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c357ab80-7df9-425d-b8a5-168c1ab50072 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:51.381854 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c357ab80-7df9-425d-b8a5-168c1ab50072 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:51.384891 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c357ab80-7df9-425d-b8a5-168c1ab50072 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:51.388961 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c357ab80-7df9-425d-b8a5-168c1ab50072 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:51.389598 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c357ab80-7df9-425d-b8a5-168c1ab50072 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:51.446972 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c357ab80-7df9-425d-b8a5-168c1ab50072 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:51.447520 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c357ab80-7df9-425d-b8a5-168c1ab50072 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:51.448165 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c357ab80-7df9-425d-b8a5-168c1ab50072 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:51.449821 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.objects.instance [None req-c357ab80-7df9-425d-b8a5-168c1ab50072 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lazy-loading 'fault' on Instance uuid 101edf03-d928-461d-98cf-12753ae7f7d7 {{(pid=123596) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:34:51.535635 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-c357ab80-7df9-425d-b8a5-168c1ab50072 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4aec5af742842f5bb2048c8b7d60687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829069b2787a423f922fcc5b5702f167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:51.543214 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-c357ab80-7df9-425d-b8a5-168c1ab50072 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] 10.222.0.43 "GET /compute/v2.1/servers/101edf03-d928-461d-98cf-12753ae7f7d7" status: 200 len: 1309 microversion: 2.1 time: 0.183615 Oct 04 18:34:51.554405 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 552/1017] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:51 2022] GET /compute/v2.1/servers/101edf03-d928-461d-98cf-12753ae7f7d7 => generated 1309 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:51.554405 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-80f05fb9-96e6-479f-acd3-bdee35113e06 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:51.554405 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-80f05fb9-96e6-479f-acd3-bdee35113e06 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] [instance: 6251d93c-aab7-43cc-9be0-212545cf2b01] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:51.556544 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-80f05fb9-96e6-479f-acd3-bdee35113e06 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:51.557283 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-80f05fb9-96e6-479f-acd3-bdee35113e06 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:51.557907 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-80f05fb9-96e6-479f-acd3-bdee35113e06 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:51.558822 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-80f05fb9-96e6-479f-acd3-bdee35113e06 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:51.559460 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-80f05fb9-96e6-479f-acd3-bdee35113e06 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:51.560067 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-80f05fb9-96e6-479f-acd3-bdee35113e06 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:51.580015 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-4dc09b86-a5ab-485d-920d-a6d841df8c93 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:51.592496 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-4dc09b86-a5ab-485d-920d-a6d841df8c93 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:51.594225 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-4dc09b86-a5ab-485d-920d-a6d841df8c93 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:51.595444 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-4dc09b86-a5ab-485d-920d-a6d841df8c93 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] 10.222.0.43 "GET /compute/v2.1/servers/9895c2ec-35ea-419e-9565-0c0f2fc5bbbc" status: 200 len: 1566 microversion: 2.25 time: 0.597109 Oct 04 18:34:51.596220 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 466/1018] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:34:50 2022] GET /compute/v2.1/servers/9895c2ec-35ea-419e-9565-0c0f2fc5bbbc => generated 1566 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:34:51.614265 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-9a8ed074-1cb4-4067-8713-9015a987ba96 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:51.614889 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-9a8ed074-1cb4-4067-8713-9015a987ba96 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] [instance: 84e0414b-a39f-4bfe-bc9d-c170ceb34d15] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:51.639932 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9a8ed074-1cb4-4067-8713-9015a987ba96 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:51.640999 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9a8ed074-1cb4-4067-8713-9015a987ba96 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:51.641573 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9a8ed074-1cb4-4067-8713-9015a987ba96 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:51.642337 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9a8ed074-1cb4-4067-8713-9015a987ba96 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:51.642807 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9a8ed074-1cb4-4067-8713-9015a987ba96 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:51.643265 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9a8ed074-1cb4-4067-8713-9015a987ba96 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:51.801734 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-9a8ed074-1cb4-4067-8713-9015a987ba96 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:51.825936 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-9a8ed074-1cb4-4067-8713-9015a987ba96 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:51.828419 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-9a8ed074-1cb4-4067-8713-9015a987ba96 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:51.856703 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-9a8ed074-1cb4-4067-8713-9015a987ba96 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] 10.222.0.43 "GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15" status: 200 len: 1537 microversion: 2.91 time: 0.247622 Oct 04 18:34:51.877211 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 467/1019] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:34:51 2022] GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15 => generated 1537 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:34:51.931121 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-a34919f2-9b87-4dea-8d20-f3a94bb7382c tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:51.931340 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-a34919f2-9b87-4dea-8d20-f3a94bb7382c tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] [instance: 93798a9a-d90d-4a4e-8e30-d6575486ff56] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:51.940339 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a34919f2-9b87-4dea-8d20-f3a94bb7382c tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:51.941700 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a34919f2-9b87-4dea-8d20-f3a94bb7382c tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:51.942460 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a34919f2-9b87-4dea-8d20-f3a94bb7382c tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:51.944186 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a34919f2-9b87-4dea-8d20-f3a94bb7382c tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:51.944810 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a34919f2-9b87-4dea-8d20-f3a94bb7382c tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:51.945343 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a34919f2-9b87-4dea-8d20-f3a94bb7382c tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:51.975401 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-80f05fb9-96e6-479f-acd3-bdee35113e06 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7db99f361654711bea7f1b2c404d312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7adedcdb9c3485ea2738c00e25aa3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:51.985642 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-80f05fb9-96e6-479f-acd3-bdee35113e06 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] 10.222.0.43 "GET /compute/v2.1/servers/6251d93c-aab7-43cc-9be0-212545cf2b01" status: 200 len: 1474 microversion: 2.1 time: 0.440430 Oct 04 18:34:51.990032 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 553/1020] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:51 2022] GET /compute/v2.1/servers/6251d93c-aab7-43cc-9be0-212545cf2b01 => generated 1474 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:52.070710 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-5926b979-0ff5-4354-b8c2-b54119b9fb5a req-6633960d-0bbc-4d5e-a5ba-c1b62e8b37ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "640d917c-c9cb-4758-aa1d-216e34a55297", "name": "network-vif-deleted", "tag": "5a0ea8df-3cc7-4b6a-9b2d-ac13a2c7f69e"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:34:52.081369 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-5926b979-0ff5-4354-b8c2-b54119b9fb5a req-6633960d-0bbc-4d5e-a5ba-c1b62e8b37ec service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:52.082335 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-5926b979-0ff5-4354-b8c2-b54119b9fb5a req-6633960d-0bbc-4d5e-a5ba-c1b62e8b37ec service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:52.082939 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-5926b979-0ff5-4354-b8c2-b54119b9fb5a req-6633960d-0bbc-4d5e-a5ba-c1b62e8b37ec service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:52.096583 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-5926b979-0ff5-4354-b8c2-b54119b9fb5a req-6633960d-0bbc-4d5e-a5ba-c1b62e8b37ec service nova] Creating event network-vif-deleted:5a0ea8df-3cc7-4b6a-9b2d-ac13a2c7f69e for instance 640d917c-c9cb-4758-aa1d-216e34a55297 on n-h2-851028-13 Oct 04 18:34:52.104063 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-5926b979-0ff5-4354-b8c2-b54119b9fb5a req-6633960d-0bbc-4d5e-a5ba-c1b62e8b37ec service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037269 Oct 04 18:34:52.105479 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 554/1021] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:34:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:34:52.532650 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-13f828ba-0a21-45ac-aa10-aaee2dde7405 req-a5f05947-c4a1-4dca-9e20-dbf7580ea66d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6251d93c-aab7-43cc-9be0-212545cf2b01", "name": "network-vif-unplugged", "status": "completed", "tag": "f0f8a0e7-af5c-4b16-b5ab-dac6dfca0427"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:34:52.542628 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-13f828ba-0a21-45ac-aa10-aaee2dde7405 req-a5f05947-c4a1-4dca-9e20-dbf7580ea66d service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:52.543322 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-13f828ba-0a21-45ac-aa10-aaee2dde7405 req-a5f05947-c4a1-4dca-9e20-dbf7580ea66d service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:52.543941 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-13f828ba-0a21-45ac-aa10-aaee2dde7405 req-a5f05947-c4a1-4dca-9e20-dbf7580ea66d service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:52.557772 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-13f828ba-0a21-45ac-aa10-aaee2dde7405 req-a5f05947-c4a1-4dca-9e20-dbf7580ea66d service nova] Creating event network-vif-unplugged:f0f8a0e7-af5c-4b16-b5ab-dac6dfca0427 for instance 6251d93c-aab7-43cc-9be0-212545cf2b01 on n-h1-851028-13 Oct 04 18:34:52.563610 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-13f828ba-0a21-45ac-aa10-aaee2dde7405 req-a5f05947-c4a1-4dca-9e20-dbf7580ea66d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035781 Oct 04 18:34:52.564530 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 555/1022] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:34:52 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:34:52.573842 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-b4a97a72-0e70-448b-a72a-73f6080a6132 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:52.578607 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-b4a97a72-0e70-448b-a72a-73f6080a6132 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] [instance: 101edf03-d928-461d-98cf-12753ae7f7d7] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:52.599459 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b4a97a72-0e70-448b-a72a-73f6080a6132 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:52.600410 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b4a97a72-0e70-448b-a72a-73f6080a6132 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:52.601069 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b4a97a72-0e70-448b-a72a-73f6080a6132 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:52.601992 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b4a97a72-0e70-448b-a72a-73f6080a6132 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:52.602732 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b4a97a72-0e70-448b-a72a-73f6080a6132 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:52.603370 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b4a97a72-0e70-448b-a72a-73f6080a6132 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:52.642756 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-b4a97a72-0e70-448b-a72a-73f6080a6132 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] HTTP exception thrown: Instance 101edf03-d928-461d-98cf-12753ae7f7d7 could not be found. Oct 04 18:34:52.644465 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-b4a97a72-0e70-448b-a72a-73f6080a6132 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Request method failure captured: Oct 04 18:34:52.644465 n-d-851028-13 devstack@n-api.service[123596]: request: GET /compute/v2.1/servers/101edf03-d928-461d-98cf-12753ae7f7d7 HTTP/1.1 Oct 04 18:34:52.644465 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:34:52.644465 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:34:52.644465 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:34:52.644465 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 18:34:52.644465 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:34:52.644465 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:34:52.644465 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:34:52.644465 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:34:52.644465 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPHxvGpn_Rmwb4_qp9sFfGvgN7iAAV2xSCWfRC9n0GexWg9-roiWoSufHMVwAQTbSjS8E-I_crn1vdoZeeJb4yK13_4-CfmlbLu2Wg1RgBTFkFTTUO8JismVpURO1heY4t66WZGJDnhJVfX0V2lSC4alpE7HkcsZl_0iOLpOl_Nfxbps Oct 04 18:34:52.644465 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:34:52.644465 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:34:52.644465 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:34:52.644465 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:34:52.644465 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:34:52.644465 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:34:52.644465 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: 829069b2787a423f922fcc5b5702f167 Oct 04 18:34:52.644465 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-LiveMigrationNegativeTest-1833877563 Oct 04 18:34:52.644465 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 18:34:52.644465 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 18:34:52.644465 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/829069b2787a423f922fcc5b5702f167"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_829069b2787a423f922fcc5b5702f167"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/829069b2787a423f922fcc5b5702f167"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/829069b2787a423f922fcc5b5702f167"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:34:52.644465 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-LiveMigrationNegativeTest-1833877563 Oct 04 18:34:52.644465 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: 829069b2787a423f922fcc5b5702f167 Oct 04 18:34:52.644465 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1833877563 Oct 04 18:34:52.644465 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-LiveMigrationNegativeTest-1833877563-project Oct 04 18:34:52.644465 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:34:52.644465 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:34:52.644465 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: c4aec5af742842f5bb2048c8b7d60687 Oct 04 18:34:52.644465 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-LiveMigrationNegativeTest-1833877563-project Oct 04 18:34:52.644465 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 18:34:52.644465 n-d-851028-13 devstack@n-api.service[123596]: exception: Instance 101edf03-d928-461d-98cf-12753ae7f7d7 could not be found. Oct 04 18:34:52.644465 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': '101edf03-d928-461d-98cf-12753ae7f7d7'} Oct 04 18:34:52.644465 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:34:52.644465 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:34:52.644465 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:34:52.644465 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:34:52.644465 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:34:52.644465 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:34:52.644465 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:34:52.644465 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:34:52.644465 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:34:52.644465 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:34:52.644465 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 101edf03-d928-461d-98cf-12753ae7f7d7 could not be found. Oct 04 18:34:52.644465 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:34:52.644465 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:34:52.644465 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:34:52.644465 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:34:52.644465 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:34:52.644465 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:34:52.644465 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:34:52.644465 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:34:52.644465 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:34:52.644465 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:34:52.644465 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:34:52.644465 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:34:52.644465 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:34:52.644465 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:34:52.644465 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:34:52.644465 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:34:52.644465 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 101edf03-d928-461d-98cf-12753ae7f7d7 could not be found. Oct 04 18:34:52.644465 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:34:52.644465 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:34:52.644465 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:34:52.649537 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:34:52.649537 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:34:52.649537 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:34:52.649537 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:34:52.649537 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:34:52.649537 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 101edf03-d928-461d-98cf-12753ae7f7d7 could not be found. Oct 04 18:34:52.649537 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:34:52.649537 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-b4a97a72-0e70-448b-a72a-73f6080a6132 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] Returning 404 to user: Instance 101edf03-d928-461d-98cf-12753ae7f7d7 could not be found. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:34:52.649537 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-b4a97a72-0e70-448b-a72a-73f6080a6132 tempest-LiveMigrationNegativeTest-1833877563 tempest-LiveMigrationNegativeTest-1833877563-project] 10.222.0.43 "GET /compute/v2.1/servers/101edf03-d928-461d-98cf-12753ae7f7d7" status: 404 len: 111 microversion: 2.1 time: 0.079886 Oct 04 18:34:52.653940 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 556/1023] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:52 2022] GET /compute/v2.1/servers/101edf03-d928-461d-98cf-12753ae7f7d7 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:34:52.664415 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-01e3cbe0-45a1-4def-904a-330b1e4163ab tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:52.665519 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-01e3cbe0-45a1-4def-904a-330b1e4163ab tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] [instance: 9895c2ec-35ea-419e-9565-0c0f2fc5bbbc] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:52.689448 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-01e3cbe0-45a1-4def-904a-330b1e4163ab tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:52.690249 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-01e3cbe0-45a1-4def-904a-330b1e4163ab tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:52.690859 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-01e3cbe0-45a1-4def-904a-330b1e4163ab tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:52.693831 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-01e3cbe0-45a1-4def-904a-330b1e4163ab tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:52.695657 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-01e3cbe0-45a1-4def-904a-330b1e4163ab tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:52.700098 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-01e3cbe0-45a1-4def-904a-330b1e4163ab tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:52.731871 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-a34919f2-9b87-4dea-8d20-f3a94bb7382c tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a41ab6fb78a42ceaca621c5a38ffc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa31ed92017490a82497c7b8910aef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:52.743263 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-a34919f2-9b87-4dea-8d20-f3a94bb7382c tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] 10.222.0.43 "GET /compute/v2.1/servers/93798a9a-d90d-4a4e-8e30-d6575486ff56" status: 200 len: 1487 microversion: 2.1 time: 0.818886 Oct 04 18:34:52.750368 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 468/1024] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:51 2022] GET /compute/v2.1/servers/93798a9a-d90d-4a4e-8e30-d6575486ff56 => generated 1487 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:34:52.776814 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-f21ccf85-b5d3-4dc9-9ad2-603ccef5fa78 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:34:52.799493 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f21ccf85-b5d3-4dc9-9ad2-603ccef5fa78 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:52.800433 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f21ccf85-b5d3-4dc9-9ad2-603ccef5fa78 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:52.801441 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f21ccf85-b5d3-4dc9-9ad2-603ccef5fa78 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:52.939394 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-f21ccf85-b5d3-4dc9-9ad2-603ccef5fa78 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] [instance: 93798a9a-d90d-4a4e-8e30-d6575486ff56] Going to try to stop instance {{(pid=123595) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 04 18:34:53.030848 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-f21ccf85-b5d3-4dc9-9ad2-603ccef5fa78 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] 10.222.0.43 "POST /compute/v2.1/servers/93798a9a-d90d-4a4e-8e30-d6575486ff56/action" status: 202 len: 0 microversion: 2.1 time: 0.258616 Oct 04 18:34:53.032811 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 469/1025] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 18:34:52 2022] POST /compute/v2.1/servers/93798a9a-d90d-4a4e-8e30-d6575486ff56/action => generated 0 bytes in 261 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:34:53.044197 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-72aff6ae-4fde-4ca4-8a8a-922745068b0f tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:53.046331 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-72aff6ae-4fde-4ca4-8a8a-922745068b0f tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] [instance: 84e0414b-a39f-4bfe-bc9d-c170ceb34d15] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:53.067520 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-72aff6ae-4fde-4ca4-8a8a-922745068b0f tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:53.070395 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-72aff6ae-4fde-4ca4-8a8a-922745068b0f tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:53.071974 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-72aff6ae-4fde-4ca4-8a8a-922745068b0f tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:53.073030 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-72aff6ae-4fde-4ca4-8a8a-922745068b0f tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:53.075299 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-72aff6ae-4fde-4ca4-8a8a-922745068b0f tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:53.076052 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-72aff6ae-4fde-4ca4-8a8a-922745068b0f tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:53.314258 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-72aff6ae-4fde-4ca4-8a8a-922745068b0f tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:53.338704 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-72aff6ae-4fde-4ca4-8a8a-922745068b0f tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:53.340172 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-72aff6ae-4fde-4ca4-8a8a-922745068b0f tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:53.342925 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-01e3cbe0-45a1-4def-904a-330b1e4163ab tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:53.346135 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-72aff6ae-4fde-4ca4-8a8a-922745068b0f tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] 10.222.0.43 "GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15" status: 200 len: 1537 microversion: 2.91 time: 0.311808 Oct 04 18:34:53.347160 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 470/1026] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:34:53 2022] GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15 => generated 1537 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:34:53.361485 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-01e3cbe0-45a1-4def-904a-330b1e4163ab tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:53.361485 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-01e3cbe0-45a1-4def-904a-330b1e4163ab tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:53.361485 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-01e3cbe0-45a1-4def-904a-330b1e4163ab tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] 10.222.0.43 "GET /compute/v2.1/servers/9895c2ec-35ea-419e-9565-0c0f2fc5bbbc" status: 200 len: 1566 microversion: 2.25 time: 0.700990 Oct 04 18:34:53.361485 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 557/1027] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:34:52 2022] GET /compute/v2.1/servers/9895c2ec-35ea-419e-9565-0c0f2fc5bbbc => generated 1566 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:34:53.362439 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-ffca036f-39b3-4b5b-b531-12b3f53abe8a tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:53.363761 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-ffca036f-39b3-4b5b-b531-12b3f53abe8a tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] [instance: 6251d93c-aab7-43cc-9be0-212545cf2b01] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:53.371049 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ffca036f-39b3-4b5b-b531-12b3f53abe8a tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:53.371859 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ffca036f-39b3-4b5b-b531-12b3f53abe8a tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:53.372505 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ffca036f-39b3-4b5b-b531-12b3f53abe8a tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:53.373439 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ffca036f-39b3-4b5b-b531-12b3f53abe8a tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:53.374100 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ffca036f-39b3-4b5b-b531-12b3f53abe8a tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:53.375061 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-d8ac7c30-c54e-47c9-8cfb-52fa8fb387b8 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:53.375476 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ffca036f-39b3-4b5b-b531-12b3f53abe8a tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:53.375688 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-d8ac7c30-c54e-47c9-8cfb-52fa8fb387b8 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] [instance: 93798a9a-d90d-4a4e-8e30-d6575486ff56] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:53.386436 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d8ac7c30-c54e-47c9-8cfb-52fa8fb387b8 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:53.387185 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d8ac7c30-c54e-47c9-8cfb-52fa8fb387b8 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:53.387813 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d8ac7c30-c54e-47c9-8cfb-52fa8fb387b8 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:53.388684 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d8ac7c30-c54e-47c9-8cfb-52fa8fb387b8 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:53.389338 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d8ac7c30-c54e-47c9-8cfb-52fa8fb387b8 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:53.389924 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d8ac7c30-c54e-47c9-8cfb-52fa8fb387b8 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:53.854590 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-d8ac7c30-c54e-47c9-8cfb-52fa8fb387b8 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a41ab6fb78a42ceaca621c5a38ffc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa31ed92017490a82497c7b8910aef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:53.860494 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-ffca036f-39b3-4b5b-b531-12b3f53abe8a tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7db99f361654711bea7f1b2c404d312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7adedcdb9c3485ea2738c00e25aa3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:53.884269 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-ffca036f-39b3-4b5b-b531-12b3f53abe8a tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] 10.222.0.43 "GET /compute/v2.1/servers/6251d93c-aab7-43cc-9be0-212545cf2b01" status: 200 len: 1432 microversion: 2.1 time: 0.526608 Oct 04 18:34:53.905949 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 558/1028] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:53 2022] GET /compute/v2.1/servers/6251d93c-aab7-43cc-9be0-212545cf2b01 => generated 1432 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:53.907786 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-d8ac7c30-c54e-47c9-8cfb-52fa8fb387b8 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] 10.222.0.43 "GET /compute/v2.1/servers/93798a9a-d90d-4a4e-8e30-d6575486ff56" status: 200 len: 1497 microversion: 2.1 time: 0.537107 Oct 04 18:34:53.912019 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 471/1029] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:53 2022] GET /compute/v2.1/servers/93798a9a-d90d-4a4e-8e30-d6575486ff56 => generated 1497 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:53.926091 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-5fc1af3c-2ca2-4d8f-8937-eb5f574185a5 req-de2b195e-af64-47a3-b086-01244205182e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6251d93c-aab7-43cc-9be0-212545cf2b01", "name": "network-vif-deleted", "tag": "f0f8a0e7-af5c-4b16-b5ab-dac6dfca0427"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:34:53.940870 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-5fc1af3c-2ca2-4d8f-8937-eb5f574185a5 req-de2b195e-af64-47a3-b086-01244205182e service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:53.942277 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-5fc1af3c-2ca2-4d8f-8937-eb5f574185a5 req-de2b195e-af64-47a3-b086-01244205182e service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:53.942941 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-5fc1af3c-2ca2-4d8f-8937-eb5f574185a5 req-de2b195e-af64-47a3-b086-01244205182e service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:53.974688 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-5fc1af3c-2ca2-4d8f-8937-eb5f574185a5 req-de2b195e-af64-47a3-b086-01244205182e service nova] Creating event network-vif-deleted:f0f8a0e7-af5c-4b16-b5ab-dac6dfca0427 for instance 6251d93c-aab7-43cc-9be0-212545cf2b01 on n-h1-851028-13 Oct 04 18:34:53.996431 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-5fc1af3c-2ca2-4d8f-8937-eb5f574185a5 req-de2b195e-af64-47a3-b086-01244205182e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080030 Oct 04 18:34:53.997683 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 559/1030] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:34:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:34:54.380137 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-6c07011b-23de-4e15-ac55-cfcb01db57cc tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:54.381367 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-6c07011b-23de-4e15-ac55-cfcb01db57cc tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] [instance: 84e0414b-a39f-4bfe-bc9d-c170ceb34d15] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:54.388354 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-1bb21d11-059f-490c-afef-27cb6b1c2992 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:54.389266 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-1bb21d11-059f-490c-afef-27cb6b1c2992 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] [instance: 9895c2ec-35ea-419e-9565-0c0f2fc5bbbc] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:54.389510 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6c07011b-23de-4e15-ac55-cfcb01db57cc tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:54.390450 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6c07011b-23de-4e15-ac55-cfcb01db57cc tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:54.391663 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6c07011b-23de-4e15-ac55-cfcb01db57cc tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:54.392628 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6c07011b-23de-4e15-ac55-cfcb01db57cc tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:54.393359 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6c07011b-23de-4e15-ac55-cfcb01db57cc tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:54.394030 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6c07011b-23de-4e15-ac55-cfcb01db57cc tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:54.399350 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:34:54.405930 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1bb21d11-059f-490c-afef-27cb6b1c2992 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:54.410296 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1bb21d11-059f-490c-afef-27cb6b1c2992 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:54.412810 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1bb21d11-059f-490c-afef-27cb6b1c2992 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:54.414573 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1bb21d11-059f-490c-afef-27cb6b1c2992 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:54.415590 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1bb21d11-059f-490c-afef-27cb6b1c2992 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:54.416783 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1bb21d11-059f-490c-afef-27cb6b1c2992 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:54.539137 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-6c07011b-23de-4e15-ac55-cfcb01db57cc tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:54.561496 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-6c07011b-23de-4e15-ac55-cfcb01db57cc tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:54.564067 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-6c07011b-23de-4e15-ac55-cfcb01db57cc tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:54.573774 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-6c07011b-23de-4e15-ac55-cfcb01db57cc tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] 10.222.0.43 "GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15" status: 200 len: 1537 microversion: 2.91 time: 0.197796 Oct 04 18:34:54.581035 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 472/1031] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:34:54 2022] GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15 => generated 1537 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:34:54.740049 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-1bb21d11-059f-490c-afef-27cb6b1c2992 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:54.754887 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-1bb21d11-059f-490c-afef-27cb6b1c2992 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:54.758751 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-1bb21d11-059f-490c-afef-27cb6b1c2992 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:54.762211 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-1bb21d11-059f-490c-afef-27cb6b1c2992 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] 10.222.0.43 "GET /compute/v2.1/servers/9895c2ec-35ea-419e-9565-0c0f2fc5bbbc" status: 200 len: 1566 microversion: 2.25 time: 0.379159 Oct 04 18:34:54.791897 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 560/1032] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:34:54 2022] GET /compute/v2.1/servers/9895c2ec-35ea-419e-9565-0c0f2fc5bbbc => generated 1566 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:34:54.916288 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-739e0c41-f945-46f3-970f-4337bacc6ad3 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:54.918008 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-739e0c41-f945-46f3-970f-4337bacc6ad3 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] [instance: 6251d93c-aab7-43cc-9be0-212545cf2b01] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:54.942833 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-b01da63c-5dbd-44b0-ba41-231fdecd7805 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:54.945186 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-b01da63c-5dbd-44b0-ba41-231fdecd7805 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] [instance: 93798a9a-d90d-4a4e-8e30-d6575486ff56] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:54.945506 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-739e0c41-f945-46f3-970f-4337bacc6ad3 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:54.946224 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-739e0c41-f945-46f3-970f-4337bacc6ad3 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:54.946800 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-739e0c41-f945-46f3-970f-4337bacc6ad3 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:54.948033 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-739e0c41-f945-46f3-970f-4337bacc6ad3 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:54.949740 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-739e0c41-f945-46f3-970f-4337bacc6ad3 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:54.952019 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-739e0c41-f945-46f3-970f-4337bacc6ad3 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:54.970535 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b01da63c-5dbd-44b0-ba41-231fdecd7805 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:54.974182 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b01da63c-5dbd-44b0-ba41-231fdecd7805 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:54.977030 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b01da63c-5dbd-44b0-ba41-231fdecd7805 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:54.978015 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b01da63c-5dbd-44b0-ba41-231fdecd7805 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:54.980710 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b01da63c-5dbd-44b0-ba41-231fdecd7805 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:54.982757 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b01da63c-5dbd-44b0-ba41-231fdecd7805 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:54.987094 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-739e0c41-f945-46f3-970f-4337bacc6ad3 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] HTTP exception thrown: Instance 6251d93c-aab7-43cc-9be0-212545cf2b01 could not be found. Oct 04 18:34:54.989038 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-739e0c41-f945-46f3-970f-4337bacc6ad3 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Request method failure captured: Oct 04 18:34:54.989038 n-d-851028-13 devstack@n-api.service[123595]: request: GET /compute/v2.1/servers/6251d93c-aab7-43cc-9be0-212545cf2b01 HTTP/1.1 Oct 04 18:34:54.989038 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 18:34:54.989038 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 18:34:54.989038 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 18:34:54.989038 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 0 Oct 04 18:34:54.989038 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 18:34:54.989038 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 18:34:54.989038 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 18:34:54.989038 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 18:34:54.989038 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPHvuItqv5xcxbp_bqbjUggZhpUG53TiGDPrqjFiNZGHAMY6QdeICs1jR4QxEtGJ9kJciv8ws3outzNBgAd1ZiItYEkQ7c76M1xzjstLBOG0OAwb8aGthDLSqRW7T7V0wj50TxoUUgeNpSMbG6VscuaiI7GHr0fqlhRjDqzMaKz-IIxQ Oct 04 18:34:54.989038 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 18:34:54.989038 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 18:34:54.989038 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 18:34:54.989038 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 18:34:54.989038 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 18:34:54.989038 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 18:34:54.989038 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: e7adedcdb9c3485ea2738c00e25aa3fd Oct 04 18:34:54.989038 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-ServersOnMultiNodesTest-1469796738 Oct 04 18:34:54.989038 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 18:34:54.989038 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 18:34:54.989038 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/e7adedcdb9c3485ea2738c00e25aa3fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_e7adedcdb9c3485ea2738c00e25aa3fd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/e7adedcdb9c3485ea2738c00e25aa3fd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/e7adedcdb9c3485ea2738c00e25aa3fd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:34:54.989038 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-ServersOnMultiNodesTest-1469796738 Oct 04 18:34:54.989038 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: e7adedcdb9c3485ea2738c00e25aa3fd Oct 04 18:34:54.989038 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1469796738 Oct 04 18:34:54.989038 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-ServersOnMultiNodesTest-1469796738-project Oct 04 18:34:54.989038 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 18:34:54.989038 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 18:34:54.989038 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: a7db99f361654711bea7f1b2c404d312 Oct 04 18:34:54.989038 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-ServersOnMultiNodesTest-1469796738-project Oct 04 18:34:54.989038 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 18:34:54.989038 n-d-851028-13 devstack@n-api.service[123595]: exception: Instance 6251d93c-aab7-43cc-9be0-212545cf2b01 could not be found. Oct 04 18:34:54.989038 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': '6251d93c-aab7-43cc-9be0-212545cf2b01'} Oct 04 18:34:54.989038 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:34:54.989038 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:34:54.989038 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:34:54.989038 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:34:54.989038 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:34:54.989038 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:34:54.989038 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:34:54.989038 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:34:54.989038 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:34:54.989038 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:34:54.989038 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6251d93c-aab7-43cc-9be0-212545cf2b01 could not be found. Oct 04 18:34:54.989038 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:34:54.989038 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:34:54.989038 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:34:54.989038 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:34:54.989038 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:34:54.989038 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:34:54.989038 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:34:54.989038 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:34:54.989038 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:34:54.989038 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:34:54.989038 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:34:54.989038 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:34:54.989038 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:34:54.989038 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:34:54.989038 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:34:54.989038 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:34:54.989038 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6251d93c-aab7-43cc-9be0-212545cf2b01 could not be found. Oct 04 18:34:54.989038 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:34:54.989038 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:34:54.989038 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:34:54.993838 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:34:54.993838 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:34:54.993838 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:34:54.993838 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:34:54.993838 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:34:54.993838 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6251d93c-aab7-43cc-9be0-212545cf2b01 could not be found. Oct 04 18:34:54.993838 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:34:54.996548 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-739e0c41-f945-46f3-970f-4337bacc6ad3 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Returning 404 to user: Instance 6251d93c-aab7-43cc-9be0-212545cf2b01 could not be found. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:34:54.998838 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-739e0c41-f945-46f3-970f-4337bacc6ad3 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] 10.222.0.43 "GET /compute/v2.1/servers/6251d93c-aab7-43cc-9be0-212545cf2b01" status: 404 len: 111 microversion: 2.1 time: 0.087774 Oct 04 18:34:55.005458 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 473/1033] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:54 2022] GET /compute/v2.1/servers/6251d93c-aab7-43cc-9be0-212545cf2b01 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:34:55.012148 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-586285f8-968f-40b9-874d-c4f0666d4a57 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:55.012779 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-586285f8-968f-40b9-874d-c4f0666d4a57 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] [instance: 640d917c-c9cb-4758-aa1d-216e34a55297] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:55.026744 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-586285f8-968f-40b9-874d-c4f0666d4a57 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:55.028154 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-586285f8-968f-40b9-874d-c4f0666d4a57 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:55.028984 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-586285f8-968f-40b9-874d-c4f0666d4a57 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:55.030769 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-586285f8-968f-40b9-874d-c4f0666d4a57 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:55.033341 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-586285f8-968f-40b9-874d-c4f0666d4a57 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:55.034491 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-586285f8-968f-40b9-874d-c4f0666d4a57 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:55.072108 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-586285f8-968f-40b9-874d-c4f0666d4a57 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] HTTP exception thrown: Instance 640d917c-c9cb-4758-aa1d-216e34a55297 could not be found. Oct 04 18:34:55.076107 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-586285f8-968f-40b9-874d-c4f0666d4a57 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Request method failure captured: Oct 04 18:34:55.076107 n-d-851028-13 devstack@n-api.service[123595]: request: GET /compute/v2.1/servers/640d917c-c9cb-4758-aa1d-216e34a55297 HTTP/1.1 Oct 04 18:34:55.076107 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 18:34:55.076107 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 18:34:55.076107 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 18:34:55.076107 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 0 Oct 04 18:34:55.076107 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 18:34:55.076107 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 18:34:55.076107 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 18:34:55.076107 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 18:34:55.076107 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPHvuItqv5xcxbp_bqbjUggZhpUG53TiGDPrqjFiNZGHAMY6QdeICs1jR4QxEtGJ9kJciv8ws3outzNBgAd1ZiItYEkQ7c76M1xzjstLBOG0OAwb8aGthDLSqRW7T7V0wj50TxoUUgeNpSMbG6VscuaiI7GHr0fqlhRjDqzMaKz-IIxQ Oct 04 18:34:55.076107 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 18:34:55.076107 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 18:34:55.076107 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 18:34:55.076107 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 18:34:55.076107 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 18:34:55.076107 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 18:34:55.076107 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: e7adedcdb9c3485ea2738c00e25aa3fd Oct 04 18:34:55.076107 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-ServersOnMultiNodesTest-1469796738 Oct 04 18:34:55.076107 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 18:34:55.076107 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 18:34:55.076107 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/e7adedcdb9c3485ea2738c00e25aa3fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_e7adedcdb9c3485ea2738c00e25aa3fd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/e7adedcdb9c3485ea2738c00e25aa3fd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/e7adedcdb9c3485ea2738c00e25aa3fd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:34:55.076107 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-ServersOnMultiNodesTest-1469796738 Oct 04 18:34:55.076107 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: e7adedcdb9c3485ea2738c00e25aa3fd Oct 04 18:34:55.076107 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1469796738 Oct 04 18:34:55.076107 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-ServersOnMultiNodesTest-1469796738-project Oct 04 18:34:55.076107 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 18:34:55.076107 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 18:34:55.076107 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: a7db99f361654711bea7f1b2c404d312 Oct 04 18:34:55.076107 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-ServersOnMultiNodesTest-1469796738-project Oct 04 18:34:55.076107 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 18:34:55.076107 n-d-851028-13 devstack@n-api.service[123595]: exception: Instance 640d917c-c9cb-4758-aa1d-216e34a55297 could not be found. Oct 04 18:34:55.076107 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': '640d917c-c9cb-4758-aa1d-216e34a55297'} Oct 04 18:34:55.076107 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:34:55.076107 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:34:55.076107 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:34:55.076107 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:34:55.076107 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:34:55.076107 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:34:55.076107 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:34:55.076107 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:34:55.076107 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:34:55.076107 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:34:55.076107 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 640d917c-c9cb-4758-aa1d-216e34a55297 could not be found. Oct 04 18:34:55.076107 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:34:55.076107 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:34:55.076107 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:34:55.076107 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:34:55.076107 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:34:55.076107 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:34:55.076107 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:34:55.076107 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:34:55.076107 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:34:55.076107 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:34:55.076107 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:34:55.076107 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:34:55.076107 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:34:55.076107 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:34:55.076107 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:34:55.076107 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:34:55.076107 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 640d917c-c9cb-4758-aa1d-216e34a55297 could not be found. Oct 04 18:34:55.076107 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:34:55.076107 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:34:55.076107 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:34:55.081061 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:34:55.081061 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:34:55.081061 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:34:55.081061 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:34:55.081061 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:34:55.081061 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 640d917c-c9cb-4758-aa1d-216e34a55297 could not be found. Oct 04 18:34:55.081061 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:34:55.088321 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-586285f8-968f-40b9-874d-c4f0666d4a57 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Returning 404 to user: Instance 640d917c-c9cb-4758-aa1d-216e34a55297 could not be found. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:34:55.089935 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-586285f8-968f-40b9-874d-c4f0666d4a57 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] 10.222.0.43 "GET /compute/v2.1/servers/640d917c-c9cb-4758-aa1d-216e34a55297" status: 404 len: 111 microversion: 2.1 time: 0.082757 Oct 04 18:34:55.092660 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 474/1034] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:55 2022] GET /compute/v2.1/servers/640d917c-c9cb-4758-aa1d-216e34a55297 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:34:55.124253 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-41a06650-fc1b-47e8-8704-3e0c0ee3f3d4 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:55.241294 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-41a06650-fc1b-47e8-8704-3e0c0ee3f3d4 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] 10.222.0.43 "DELETE /compute/v2.1/os-server-groups/acf92c64-4619-49b4-9c95-f8a5a9086ea1" status: 204 len: 0 microversion: 2.1 time: 0.142229 Oct 04 18:34:55.243929 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 475/1035] 10.222.0.43 () {58 vars in 1266 bytes} [Tue Oct 4 18:34:55 2022] DELETE /compute/v2.1/os-server-groups/acf92c64-4619-49b4-9c95-f8a5a9086ea1 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 18:34:55.260769 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-b92c03ad-72de-47da-9c68-737444b26ece tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:55.261011 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-b92c03ad-72de-47da-9c68-737444b26ece tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] [instance: 4311d976-991e-4ab1-9d5e-d654aa7d0b08] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:55.278417 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b92c03ad-72de-47da-9c68-737444b26ece tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:55.280390 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b92c03ad-72de-47da-9c68-737444b26ece tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:55.280777 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b92c03ad-72de-47da-9c68-737444b26ece tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:55.282187 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b92c03ad-72de-47da-9c68-737444b26ece tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:55.282667 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b92c03ad-72de-47da-9c68-737444b26ece tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:55.283109 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b92c03ad-72de-47da-9c68-737444b26ece tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:55.327424 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-b01da63c-5dbd-44b0-ba41-231fdecd7805 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a41ab6fb78a42ceaca621c5a38ffc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa31ed92017490a82497c7b8910aef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:55.335762 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-b92c03ad-72de-47da-9c68-737444b26ece tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] [instance: 4311d976-991e-4ab1-9d5e-d654aa7d0b08] Going to try to terminate instance {{(pid=123595) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:34:55.336320 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-b01da63c-5dbd-44b0-ba41-231fdecd7805 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] 10.222.0.43 "GET /compute/v2.1/servers/93798a9a-d90d-4a4e-8e30-d6575486ff56" status: 200 len: 1497 microversion: 2.1 time: 0.403811 Oct 04 18:34:55.336915 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 561/1036] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:54 2022] GET /compute/v2.1/servers/93798a9a-d90d-4a4e-8e30-d6575486ff56 => generated 1497 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:34:55.497542 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-b92c03ad-72de-47da-9c68-737444b26ece tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] 10.222.0.43 "DELETE /compute/v2.1/servers/4311d976-991e-4ab1-9d5e-d654aa7d0b08" status: 204 len: 0 microversion: 2.1 time: 0.248288 Oct 04 18:34:55.500526 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 476/1037] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 18:34:55 2022] DELETE /compute/v2.1/servers/4311d976-991e-4ab1-9d5e-d654aa7d0b08 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:34:55.509465 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-fc82a352-8b21-44b8-b7de-545328585a3f tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:55.509971 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-fc82a352-8b21-44b8-b7de-545328585a3f tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] [instance: c4b812d5-f2ff-41c7-b912-3d19d752340b] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:55.525219 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fc82a352-8b21-44b8-b7de-545328585a3f tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:55.525825 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fc82a352-8b21-44b8-b7de-545328585a3f tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:55.528866 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fc82a352-8b21-44b8-b7de-545328585a3f tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:55.529861 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fc82a352-8b21-44b8-b7de-545328585a3f tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:55.532251 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fc82a352-8b21-44b8-b7de-545328585a3f tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:55.533530 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fc82a352-8b21-44b8-b7de-545328585a3f tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:55.607937 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-216283d4-e8e4-4c9e-8f85-49c2bc759764 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:55.608763 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-216283d4-e8e4-4c9e-8f85-49c2bc759764 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] [instance: 84e0414b-a39f-4bfe-bc9d-c170ceb34d15] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:55.612772 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-fc82a352-8b21-44b8-b7de-545328585a3f tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] [instance: c4b812d5-f2ff-41c7-b912-3d19d752340b] Going to try to terminate instance {{(pid=123596) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:34:55.621166 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-216283d4-e8e4-4c9e-8f85-49c2bc759764 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:55.621677 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-216283d4-e8e4-4c9e-8f85-49c2bc759764 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:55.622124 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-216283d4-e8e4-4c9e-8f85-49c2bc759764 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:55.622845 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-216283d4-e8e4-4c9e-8f85-49c2bc759764 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:55.623299 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-216283d4-e8e4-4c9e-8f85-49c2bc759764 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:55.623726 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-216283d4-e8e4-4c9e-8f85-49c2bc759764 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:55.753478 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-fc82a352-8b21-44b8-b7de-545328585a3f tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] 10.222.0.43 "DELETE /compute/v2.1/servers/c4b812d5-f2ff-41c7-b912-3d19d752340b" status: 204 len: 0 microversion: 2.1 time: 0.248274 Oct 04 18:34:55.754388 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 562/1038] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 18:34:55 2022] DELETE /compute/v2.1/servers/c4b812d5-f2ff-41c7-b912-3d19d752340b => generated 0 bytes in 251 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:34:55.765417 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-587d7eb8-4e33-46c8-8e09-58b9a869f984 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:55.768506 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-587d7eb8-4e33-46c8-8e09-58b9a869f984 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] [instance: 4311d976-991e-4ab1-9d5e-d654aa7d0b08] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:55.778112 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-587d7eb8-4e33-46c8-8e09-58b9a869f984 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:55.779893 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-587d7eb8-4e33-46c8-8e09-58b9a869f984 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:55.781581 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-587d7eb8-4e33-46c8-8e09-58b9a869f984 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:55.782566 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-587d7eb8-4e33-46c8-8e09-58b9a869f984 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:55.783539 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-587d7eb8-4e33-46c8-8e09-58b9a869f984 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:55.784224 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-587d7eb8-4e33-46c8-8e09-58b9a869f984 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:55.889485 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-216283d4-e8e4-4c9e-8f85-49c2bc759764 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:55.898284 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-216283d4-e8e4-4c9e-8f85-49c2bc759764 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:55.899741 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-216283d4-e8e4-4c9e-8f85-49c2bc759764 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:55.905728 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-216283d4-e8e4-4c9e-8f85-49c2bc759764 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] 10.222.0.43 "GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15" status: 200 len: 1537 microversion: 2.91 time: 0.302544 Oct 04 18:34:55.917910 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 477/1039] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:34:55 2022] GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15 => generated 1537 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:34:55.943985 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-85f11e26-befe-4399-b236-9f7d823e2c56 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:55.944348 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-85f11e26-befe-4399-b236-9f7d823e2c56 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] [instance: 9895c2ec-35ea-419e-9565-0c0f2fc5bbbc] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:55.951038 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-85f11e26-befe-4399-b236-9f7d823e2c56 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:55.952078 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-85f11e26-befe-4399-b236-9f7d823e2c56 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:55.952530 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-85f11e26-befe-4399-b236-9f7d823e2c56 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:55.953554 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-85f11e26-befe-4399-b236-9f7d823e2c56 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:55.954166 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-85f11e26-befe-4399-b236-9f7d823e2c56 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:55.954755 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-85f11e26-befe-4399-b236-9f7d823e2c56 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:56.013671 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-587d7eb8-4e33-46c8-8e09-58b9a869f984 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7db99f361654711bea7f1b2c404d312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7adedcdb9c3485ea2738c00e25aa3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:56.023594 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-587d7eb8-4e33-46c8-8e09-58b9a869f984 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] 10.222.0.43 "GET /compute/v2.1/servers/4311d976-991e-4ab1-9d5e-d654aa7d0b08" status: 200 len: 1475 microversion: 2.1 time: 0.264354 Oct 04 18:34:56.024548 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 563/1040] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:55 2022] GET /compute/v2.1/servers/4311d976-991e-4ab1-9d5e-d654aa7d0b08 => generated 1475 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:56.280055 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-85f11e26-befe-4399-b236-9f7d823e2c56 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:56.290678 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-85f11e26-befe-4399-b236-9f7d823e2c56 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:56.293662 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-85f11e26-befe-4399-b236-9f7d823e2c56 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:56.294871 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-85f11e26-befe-4399-b236-9f7d823e2c56 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] 10.222.0.43 "GET /compute/v2.1/servers/9895c2ec-35ea-419e-9565-0c0f2fc5bbbc" status: 200 len: 1541 microversion: 2.25 time: 0.375291 Oct 04 18:34:56.302298 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 478/1041] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:34:55 2022] GET /compute/v2.1/servers/9895c2ec-35ea-419e-9565-0c0f2fc5bbbc => generated 1541 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:34:56.323772 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-2fc19ff2-10c7-4908-a16f-e4e0bcd1b3d0 tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] Calling method '.version_select at 0x7fb21fb7a0d0>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:56.324875 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2fc19ff2-10c7-4908-a16f-e4e0bcd1b3d0 tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:56.325400 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2fc19ff2-10c7-4908-a16f-e4e0bcd1b3d0 tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:56.325857 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2fc19ff2-10c7-4908-a16f-e4e0bcd1b3d0 tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:56.342979 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-2fc19ff2-10c7-4908-a16f-e4e0bcd1b3d0 tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] 10.222.0.43 "GET /compute/v2.1/os-migrations" status: 200 len: 1108 microversion: 2.25 time: 0.025998 Oct 04 18:34:56.344302 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 564/1042] 10.222.0.43 () {60 vars in 1184 bytes} [Tue Oct 4 18:34:56 2022] GET /compute/v2.1/os-migrations => generated 1108 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:34:56.361353 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-db90ab9a-3073-427b-8ac3-c34385130e17 tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:56.362288 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-db90ab9a-3073-427b-8ac3-c34385130e17 tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] [instance: 9895c2ec-35ea-419e-9565-0c0f2fc5bbbc] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:56.376892 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-db90ab9a-3073-427b-8ac3-c34385130e17 tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:56.377423 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-db90ab9a-3073-427b-8ac3-c34385130e17 tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:56.377864 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-db90ab9a-3073-427b-8ac3-c34385130e17 tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:56.378688 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-db90ab9a-3073-427b-8ac3-c34385130e17 tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:56.381026 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-392e0d78-9512-4660-9df4-4dc8649b5c03 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:56.381697 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-392e0d78-9512-4660-9df4-4dc8649b5c03 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] [instance: 93798a9a-d90d-4a4e-8e30-d6575486ff56] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:56.385604 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-db90ab9a-3073-427b-8ac3-c34385130e17 tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:56.385784 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-db90ab9a-3073-427b-8ac3-c34385130e17 tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:56.399980 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-392e0d78-9512-4660-9df4-4dc8649b5c03 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:56.400559 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-392e0d78-9512-4660-9df4-4dc8649b5c03 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:56.401204 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-392e0d78-9512-4660-9df4-4dc8649b5c03 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:56.402381 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-392e0d78-9512-4660-9df4-4dc8649b5c03 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:56.403011 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-392e0d78-9512-4660-9df4-4dc8649b5c03 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:56.403601 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-392e0d78-9512-4660-9df4-4dc8649b5c03 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:56.442535 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:34:56.575798 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.objects.instance [None req-db90ab9a-3073-427b-8ac3-c34385130e17 tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] Lazy-loading 'services' on Instance uuid 9895c2ec-35ea-419e-9565-0c0f2fc5bbbc {{(pid=123595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:34:56.601907 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-db90ab9a-3073-427b-8ac3-c34385130e17 tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/9895c2ec-35ea-419e-9565-0c0f2fc5bbbc" status: 200 len: 2034 microversion: 2.25 time: 0.247657 Oct 04 18:34:56.616997 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 479/1043] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:34:56 2022] GET /compute/v2.1/servers/9895c2ec-35ea-419e-9565-0c0f2fc5bbbc => generated 2034 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:34:56.625426 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-392e0d78-9512-4660-9df4-4dc8649b5c03 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a41ab6fb78a42ceaca621c5a38ffc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa31ed92017490a82497c7b8910aef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:56.644689 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-392e0d78-9512-4660-9df4-4dc8649b5c03 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] 10.222.0.43 "GET /compute/v2.1/servers/93798a9a-d90d-4a4e-8e30-d6575486ff56" status: 200 len: 1497 microversion: 2.1 time: 0.274794 Oct 04 18:34:56.658147 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 565/1044] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:56 2022] GET /compute/v2.1/servers/93798a9a-d90d-4a4e-8e30-d6575486ff56 => generated 1497 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:56.667838 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-8bfff4ea-8230-44ac-8fa5-4c94f9096b27 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Action: 'create', calling method: .version_select at 0x7fb21fbc0d30>, body: {"keypair": {"name": "tempest-keypair-1549185586", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEtHzPTzzv3w0m3K9x8FqYEYMvEteiQuFPc0Oh1Hy95F/OwmtB+4ijS4PNXv8BxaCqQFWmVXkSNGgADJNfx16fb1TSHvtan3aIUrzRxbZ3rn8Ez2zSNjcYlqmn+DGTEc8w=="}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:34:56.696003 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-8bfff4ea-8230-44ac-8fa5-4c94f9096b27 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Getting quotas for project 34199e342c1b4158abf82384f2213b5f. Resources: {'key_pairs'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:34:56.700287 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-8bfff4ea-8230-44ac-8fa5-4c94f9096b27 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Getting quotas for user 807a4a88319946aead73a3ccfcda6aeb and project 34199e342c1b4158abf82384f2213b5f. Resources: {'key_pairs'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:34:56.740459 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-8bfff4ea-8230-44ac-8fa5-4c94f9096b27 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.25 time: 0.097625 Oct 04 18:34:56.744762 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 480/1045] 10.222.0.43 () {62 vars in 1200 bytes} [Tue Oct 4 18:34:56 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 103 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 04 18:34:56.941229 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f6f1339a-12c9-44b6-8f65-8375cb1acd8e tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:56.941947 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-f6f1339a-12c9-44b6-8f65-8375cb1acd8e tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] [instance: 84e0414b-a39f-4bfe-bc9d-c170ceb34d15] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:56.966013 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f6f1339a-12c9-44b6-8f65-8375cb1acd8e tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:56.966690 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f6f1339a-12c9-44b6-8f65-8375cb1acd8e tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:56.967280 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f6f1339a-12c9-44b6-8f65-8375cb1acd8e tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:56.968947 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f6f1339a-12c9-44b6-8f65-8375cb1acd8e tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:56.970947 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f6f1339a-12c9-44b6-8f65-8375cb1acd8e tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:56.971489 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f6f1339a-12c9-44b6-8f65-8375cb1acd8e tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:57.053777 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-0fb893ea-d0c5-420d-921e-10ddfddb4a8e tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:57.054538 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-0fb893ea-d0c5-420d-921e-10ddfddb4a8e tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] [instance: 4311d976-991e-4ab1-9d5e-d654aa7d0b08] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:57.071501 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0fb893ea-d0c5-420d-921e-10ddfddb4a8e tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:57.072132 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0fb893ea-d0c5-420d-921e-10ddfddb4a8e tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:57.073772 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0fb893ea-d0c5-420d-921e-10ddfddb4a8e tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:57.075362 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0fb893ea-d0c5-420d-921e-10ddfddb4a8e tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:57.076487 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0fb893ea-d0c5-420d-921e-10ddfddb4a8e tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:57.077588 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0fb893ea-d0c5-420d-921e-10ddfddb4a8e tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:57.123885 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-f6f1339a-12c9-44b6-8f65-8375cb1acd8e tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:57.139309 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-f6f1339a-12c9-44b6-8f65-8375cb1acd8e tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:57.141759 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-f6f1339a-12c9-44b6-8f65-8375cb1acd8e tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:57.149277 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-f6f1339a-12c9-44b6-8f65-8375cb1acd8e tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] 10.222.0.43 "GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15" status: 200 len: 1537 microversion: 2.91 time: 0.213361 Oct 04 18:34:57.150774 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 566/1046] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:34:56 2022] GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15 => generated 1537 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:34:57.328375 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-0fb893ea-d0c5-420d-921e-10ddfddb4a8e tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7db99f361654711bea7f1b2c404d312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7adedcdb9c3485ea2738c00e25aa3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:57.337591 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-0fb893ea-d0c5-420d-921e-10ddfddb4a8e tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] 10.222.0.43 "GET /compute/v2.1/servers/4311d976-991e-4ab1-9d5e-d654aa7d0b08" status: 200 len: 1475 microversion: 2.1 time: 0.288596 Oct 04 18:34:57.339037 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 481/1047] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:57 2022] GET /compute/v2.1/servers/4311d976-991e-4ab1-9d5e-d654aa7d0b08 => generated 1475 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:34:57.589143 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-b9eb2b65-27aa-4181-b94d-e0090ef534f5 tempest-HypervisorAdminNegativeTestJSON-151052672 tempest-HypervisorAdminNegativeTestJSON-151052672-project] Calling method '.version_select at 0x7fb227ed8280>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:57.592607 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-b9eb2b65-27aa-4181-b94d-e0090ef534f5 tempest-HypervisorAdminNegativeTestJSON-151052672 tempest-HypervisorAdminNegativeTestJSON-151052672-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': '38a500daf9194c5b835245283f66313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4d1bad8a11b407ab83f3c21c91d01d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:57.595631 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-b9eb2b65-27aa-4181-b94d-e0090ef534f5 tempest-HypervisorAdminNegativeTestJSON-151052672 tempest-HypervisorAdminNegativeTestJSON-151052672-project] Request method failure captured: Oct 04 18:34:57.595631 n-d-851028-13 devstack@n-api.service[123596]: request: GET /compute/v2.1/os-hypervisors/detail HTTP/1.1 Oct 04 18:34:57.595631 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:34:57.595631 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:34:57.595631 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:34:57.595631 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 18:34:57.595631 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:34:57.595631 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:34:57.595631 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:34:57.595631 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:34:57.595631 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPHzQzyQemD7ayiCQgYQGNWLMEJRyn6dMXXouBzOOirrnYf1ryqgZPSrZcFWBQehCGnrMl3kXH0XDd7pv-RYN8noOhtkDguq8sRnL8NqmCusbRltTfoF4udn-pwmvYPcnzIGoMdqpoGW4hd3iP2llA2PYH3VcPKFVHbEQ6uQIK9c5i6g Oct 04 18:34:57.595631 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:34:57.595631 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:34:57.595631 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:34:57.595631 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:34:57.595631 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:34:57.595631 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:34:57.595631 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: d4d1bad8a11b407ab83f3c21c91d01d3 Oct 04 18:34:57.595631 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-151052672 Oct 04 18:34:57.595631 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 18:34:57.595631 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 18:34:57.595631 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/d4d1bad8a11b407ab83f3c21c91d01d3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_d4d1bad8a11b407ab83f3c21c91d01d3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d4d1bad8a11b407ab83f3c21c91d01d3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d4d1bad8a11b407ab83f3c21c91d01d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:34:57.595631 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-151052672 Oct 04 18:34:57.595631 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: d4d1bad8a11b407ab83f3c21c91d01d3 Oct 04 18:34:57.595631 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-151052672 Oct 04 18:34:57.595631 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-HypervisorAdminNegativeTestJSON-151052672-project Oct 04 18:34:57.595631 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:34:57.595631 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:34:57.595631 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 38a500daf9194c5b835245283f66313d Oct 04 18:34:57.595631 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-151052672-project Oct 04 18:34:57.595631 n-d-851028-13 devstack@n-api.service[123596]: method: Oct 04 18:34:57.595631 n-d-851028-13 devstack@n-api.service[123596]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 04 18:34:57.595631 n-d-851028-13 devstack@n-api.service[123596]: action_args: {} Oct 04 18:34:57.595631 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:34:57.595631 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:34:57.595631 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:34:57.595631 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:34:57.595631 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:34:57.595631 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:34:57.595631 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:34:57.595631 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:34:57.595631 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:34:57.595631 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:34:57.595631 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 285, in detail Oct 04 18:34:57.595631 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return self._detail(req) Oct 04 18:34:57.595631 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 289, in _detail Oct 04 18:34:57.595631 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list-detail', target={}) Oct 04 18:34:57.595631 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 18:34:57.595631 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 18:34:57.595631 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 18:34:57.595631 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 18:34:57.595631 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:34:57.595631 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:34:57.595631 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:34:57.595631 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:34:57.595631 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 18:34:57.595631 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 18:34:57.595631 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 18:34:57.595631 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 18:34:57.595631 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 18:34:57.595631 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 18:34:57.595631 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 04 18:34:57.595631 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:34:57.600594 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:34:57.600594 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:34:57.600594 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:34:57.600594 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:34:57.600594 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:34:57.600594 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 18:34:57.600594 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 18:34:57.600594 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 04 18:34:57.600594 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:34:57.603336 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-b9eb2b65-27aa-4181-b94d-e0090ef534f5 tempest-HypervisorAdminNegativeTestJSON-151052672 tempest-HypervisorAdminNegativeTestJSON-151052672-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:34:57.605487 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-b9eb2b65-27aa-4181-b94d-e0090ef534f5 tempest-HypervisorAdminNegativeTestJSON-151052672 tempest-HypervisorAdminNegativeTestJSON-151052672-project] 10.222.0.43 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.244442 Oct 04 18:34:57.606345 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 567/1048] 10.222.0.43 () {58 vars in 1167 bytes} [Tue Oct 4 18:34:57 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 246 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:34:57.618484 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-2817b2f9-2452-4340-b23f-993c33b8ca7c tempest-HypervisorAdminNegativeTestJSON-151052672 tempest-HypervisorAdminNegativeTestJSON-151052672-project] Calling method '.version_select at 0x7fb21fbfe310>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:57.621746 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-2817b2f9-2452-4340-b23f-993c33b8ca7c tempest-HypervisorAdminNegativeTestJSON-151052672 tempest-HypervisorAdminNegativeTestJSON-151052672-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': '38a500daf9194c5b835245283f66313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4d1bad8a11b407ab83f3c21c91d01d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:57.623771 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-2817b2f9-2452-4340-b23f-993c33b8ca7c tempest-HypervisorAdminNegativeTestJSON-151052672 tempest-HypervisorAdminNegativeTestJSON-151052672-project] Request method failure captured: Oct 04 18:34:57.623771 n-d-851028-13 devstack@n-api.service[123595]: request: GET /compute/v2.1/os-hypervisors HTTP/1.1 Oct 04 18:34:57.623771 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 18:34:57.623771 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 18:34:57.623771 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 18:34:57.623771 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 0 Oct 04 18:34:57.623771 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 18:34:57.623771 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 18:34:57.623771 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 18:34:57.623771 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 18:34:57.623771 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPHzQzyQemD7ayiCQgYQGNWLMEJRyn6dMXXouBzOOirrnYf1ryqgZPSrZcFWBQehCGnrMl3kXH0XDd7pv-RYN8noOhtkDguq8sRnL8NqmCusbRltTfoF4udn-pwmvYPcnzIGoMdqpoGW4hd3iP2llA2PYH3VcPKFVHbEQ6uQIK9c5i6g Oct 04 18:34:57.623771 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 18:34:57.623771 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 18:34:57.623771 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 18:34:57.623771 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 18:34:57.623771 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 18:34:57.623771 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 18:34:57.623771 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: d4d1bad8a11b407ab83f3c21c91d01d3 Oct 04 18:34:57.623771 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-151052672 Oct 04 18:34:57.623771 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 18:34:57.623771 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 18:34:57.623771 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/d4d1bad8a11b407ab83f3c21c91d01d3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_d4d1bad8a11b407ab83f3c21c91d01d3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d4d1bad8a11b407ab83f3c21c91d01d3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d4d1bad8a11b407ab83f3c21c91d01d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:34:57.623771 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-151052672 Oct 04 18:34:57.623771 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: d4d1bad8a11b407ab83f3c21c91d01d3 Oct 04 18:34:57.623771 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-151052672 Oct 04 18:34:57.623771 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-HypervisorAdminNegativeTestJSON-151052672-project Oct 04 18:34:57.623771 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 18:34:57.623771 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 18:34:57.623771 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: 38a500daf9194c5b835245283f66313d Oct 04 18:34:57.623771 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-151052672-project Oct 04 18:34:57.623771 n-d-851028-13 devstack@n-api.service[123595]: method: Oct 04 18:34:57.623771 n-d-851028-13 devstack@n-api.service[123595]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 04 18:34:57.623771 n-d-851028-13 devstack@n-api.service[123595]: action_args: {} Oct 04 18:34:57.623771 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:34:57.623771 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:34:57.623771 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:34:57.623771 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:34:57.623771 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:34:57.623771 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:34:57.623771 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:34:57.623771 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:34:57.623771 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:34:57.623771 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:34:57.623771 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 253, in index Oct 04 18:34:57.623771 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return self._index(req) Oct 04 18:34:57.623771 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 257, in _index Oct 04 18:34:57.623771 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list', target={}) Oct 04 18:34:57.623771 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 18:34:57.623771 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 18:34:57.623771 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 18:34:57.623771 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 18:34:57.623771 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:34:57.623771 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:34:57.623771 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:34:57.623771 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:34:57.623771 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 18:34:57.623771 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 18:34:57.623771 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 18:34:57.623771 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 18:34:57.623771 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 18:34:57.623771 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 18:34:57.623771 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 04 18:34:57.623771 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:34:57.628502 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:34:57.628502 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:34:57.628502 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:34:57.628502 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:34:57.628502 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:34:57.628502 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 18:34:57.628502 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 18:34:57.628502 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 04 18:34:57.628502 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:34:57.628502 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-2817b2f9-2452-4340-b23f-993c33b8ca7c tempest-HypervisorAdminNegativeTestJSON-151052672 tempest-HypervisorAdminNegativeTestJSON-151052672-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:34:57.628502 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-2817b2f9-2452-4340-b23f-993c33b8ca7c tempest-HypervisorAdminNegativeTestJSON-151052672 tempest-HypervisorAdminNegativeTestJSON-151052672-project] 10.222.0.43 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.012641 Oct 04 18:34:57.628502 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 482/1049] 10.222.0.43 () {58 vars in 1146 bytes} [Tue Oct 4 18:34:57 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 14 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:34:57.635548 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-8da62273-05b5-403a-bf32-700c3b28b397 tempest-HypervisorAdminNegativeTestJSON-151052672 tempest-HypervisorAdminNegativeTestJSON-151052672-project] Calling method '.version_select at 0x7fb21fb6e790>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:57.638667 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-8da62273-05b5-403a-bf32-700c3b28b397 tempest-HypervisorAdminNegativeTestJSON-151052672 tempest-HypervisorAdminNegativeTestJSON-151052672-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': '38a500daf9194c5b835245283f66313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4d1bad8a11b407ab83f3c21c91d01d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:57.641359 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-8da62273-05b5-403a-bf32-700c3b28b397 tempest-HypervisorAdminNegativeTestJSON-151052672 tempest-HypervisorAdminNegativeTestJSON-151052672-project] Request method failure captured: Oct 04 18:34:57.641359 n-d-851028-13 devstack@n-api.service[123596]: request: GET /compute/v2.1/os-hypervisors/statistics HTTP/1.1 Oct 04 18:34:57.641359 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:34:57.641359 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:34:57.641359 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:34:57.641359 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 18:34:57.641359 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:34:57.641359 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:34:57.641359 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:34:57.641359 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:34:57.641359 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPHzQzyQemD7ayiCQgYQGNWLMEJRyn6dMXXouBzOOirrnYf1ryqgZPSrZcFWBQehCGnrMl3kXH0XDd7pv-RYN8noOhtkDguq8sRnL8NqmCusbRltTfoF4udn-pwmvYPcnzIGoMdqpoGW4hd3iP2llA2PYH3VcPKFVHbEQ6uQIK9c5i6g Oct 04 18:34:57.641359 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:34:57.641359 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:34:57.641359 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:34:57.641359 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:34:57.641359 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:34:57.641359 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:34:57.641359 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: d4d1bad8a11b407ab83f3c21c91d01d3 Oct 04 18:34:57.641359 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-151052672 Oct 04 18:34:57.641359 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 18:34:57.641359 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 18:34:57.641359 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/d4d1bad8a11b407ab83f3c21c91d01d3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_d4d1bad8a11b407ab83f3c21c91d01d3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d4d1bad8a11b407ab83f3c21c91d01d3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d4d1bad8a11b407ab83f3c21c91d01d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:34:57.641359 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-151052672 Oct 04 18:34:57.641359 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: d4d1bad8a11b407ab83f3c21c91d01d3 Oct 04 18:34:57.641359 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-151052672 Oct 04 18:34:57.641359 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-HypervisorAdminNegativeTestJSON-151052672-project Oct 04 18:34:57.641359 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:34:57.641359 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:34:57.641359 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 38a500daf9194c5b835245283f66313d Oct 04 18:34:57.641359 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-151052672-project Oct 04 18:34:57.641359 n-d-851028-13 devstack@n-api.service[123596]: method: Oct 04 18:34:57.641359 n-d-851028-13 devstack@n-api.service[123596]: exception: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 04 18:34:57.641359 n-d-851028-13 devstack@n-api.service[123596]: action_args: {} Oct 04 18:34:57.641359 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:34:57.641359 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:34:57.641359 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:34:57.641359 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:34:57.641359 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:34:57.641359 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:34:57.641359 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:34:57.641359 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:34:57.641359 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:34:57.641359 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:34:57.641359 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 521, in statistics Oct 04 18:34:57.641359 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'statistics', target={}) Oct 04 18:34:57.641359 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 18:34:57.641359 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 18:34:57.641359 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 18:34:57.641359 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 18:34:57.641359 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:34:57.641359 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:34:57.641359 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:34:57.641359 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:34:57.641359 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 18:34:57.641359 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 18:34:57.641359 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 18:34:57.641359 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 18:34:57.641359 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 18:34:57.641359 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 18:34:57.641359 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 04 18:34:57.641359 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:34:57.641359 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:34:57.641359 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:34:57.641359 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:34:57.648437 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:34:57.648437 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:34:57.648437 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 18:34:57.648437 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 18:34:57.648437 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 04 18:34:57.648437 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:34:57.648437 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-8da62273-05b5-403a-bf32-700c3b28b397 tempest-HypervisorAdminNegativeTestJSON-151052672 tempest-HypervisorAdminNegativeTestJSON-151052672-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:34:57.648437 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-8da62273-05b5-403a-bf32-700c3b28b397 tempest-HypervisorAdminNegativeTestJSON-151052672 tempest-HypervisorAdminNegativeTestJSON-151052672-project] 10.222.0.43 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.013240 Oct 04 18:34:57.648437 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 568/1050] 10.222.0.43 () {58 vars in 1179 bytes} [Tue Oct 4 18:34:57 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 14 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:34:57.672596 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-30bbdf4d-08ae-49df-899f-2a30216d9ec4 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:57.673794 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-30bbdf4d-08ae-49df-899f-2a30216d9ec4 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] [instance: 93798a9a-d90d-4a4e-8e30-d6575486ff56] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:57.681176 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-30bbdf4d-08ae-49df-899f-2a30216d9ec4 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:57.681899 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-30bbdf4d-08ae-49df-899f-2a30216d9ec4 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:57.682326 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-30bbdf4d-08ae-49df-899f-2a30216d9ec4 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:57.683344 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-30bbdf4d-08ae-49df-899f-2a30216d9ec4 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:57.683964 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-30bbdf4d-08ae-49df-899f-2a30216d9ec4 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:57.684647 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-30bbdf4d-08ae-49df-899f-2a30216d9ec4 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:57.908305 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-30bbdf4d-08ae-49df-899f-2a30216d9ec4 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a41ab6fb78a42ceaca621c5a38ffc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa31ed92017490a82497c7b8910aef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:57.918918 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-30bbdf4d-08ae-49df-899f-2a30216d9ec4 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] 10.222.0.43 "GET /compute/v2.1/servers/93798a9a-d90d-4a4e-8e30-d6575486ff56" status: 200 len: 1497 microversion: 2.1 time: 0.253103 Oct 04 18:34:57.920171 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 569/1051] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:57 2022] GET /compute/v2.1/servers/93798a9a-d90d-4a4e-8e30-d6575486ff56 => generated 1497 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:34:57.946785 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-d601830a-7fbe-4a77-9535-a898afb42bf1 tempest-HypervisorAdminNegativeTestJSON-607144227 tempest-HypervisorAdminNegativeTestJSON-607144227-project-admin] Calling method '.version_select at 0x7fb21fc31af0>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:57.951141 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d601830a-7fbe-4a77-9535-a898afb42bf1 tempest-HypervisorAdminNegativeTestJSON-607144227 tempest-HypervisorAdminNegativeTestJSON-607144227-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:57.951141 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d601830a-7fbe-4a77-9535-a898afb42bf1 tempest-HypervisorAdminNegativeTestJSON-607144227 tempest-HypervisorAdminNegativeTestJSON-607144227-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:57.951141 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d601830a-7fbe-4a77-9535-a898afb42bf1 tempest-HypervisorAdminNegativeTestJSON-607144227 tempest-HypervisorAdminNegativeTestJSON-607144227-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:57.966901 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d601830a-7fbe-4a77-9535-a898afb42bf1 tempest-HypervisorAdminNegativeTestJSON-607144227 tempest-HypervisorAdminNegativeTestJSON-607144227-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:57.967397 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d601830a-7fbe-4a77-9535-a898afb42bf1 tempest-HypervisorAdminNegativeTestJSON-607144227 tempest-HypervisorAdminNegativeTestJSON-607144227-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:57.967962 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d601830a-7fbe-4a77-9535-a898afb42bf1 tempest-HypervisorAdminNegativeTestJSON-607144227 tempest-HypervisorAdminNegativeTestJSON-607144227-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:57.980043 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d601830a-7fbe-4a77-9535-a898afb42bf1 tempest-HypervisorAdminNegativeTestJSON-607144227 tempest-HypervisorAdminNegativeTestJSON-607144227-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:57.980867 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d601830a-7fbe-4a77-9535-a898afb42bf1 tempest-HypervisorAdminNegativeTestJSON-607144227 tempest-HypervisorAdminNegativeTestJSON-607144227-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:57.981577 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d601830a-7fbe-4a77-9535-a898afb42bf1 tempest-HypervisorAdminNegativeTestJSON-607144227 tempest-HypervisorAdminNegativeTestJSON-607144227-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:57.988074 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-d601830a-7fbe-4a77-9535-a898afb42bf1 tempest-HypervisorAdminNegativeTestJSON-607144227 tempest-HypervisorAdminNegativeTestJSON-607144227-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.337481 Oct 04 18:34:58.000656 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-22baec93-3a36-4728-b467-123585cab4a9 tempest-HypervisorAdminNegativeTestJSON-151052672 tempest-HypervisorAdminNegativeTestJSON-151052672-project] Calling method '.version_select at 0x7fb227ed8f70>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:58.002550 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-22baec93-3a36-4728-b467-123585cab4a9 tempest-HypervisorAdminNegativeTestJSON-151052672 tempest-HypervisorAdminNegativeTestJSON-151052672-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': '38a500daf9194c5b835245283f66313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4d1bad8a11b407ab83f3c21c91d01d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:58.005409 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-22baec93-3a36-4728-b467-123585cab4a9 tempest-HypervisorAdminNegativeTestJSON-151052672 tempest-HypervisorAdminNegativeTestJSON-151052672-project] Request method failure captured: Oct 04 18:34:58.005409 n-d-851028-13 devstack@n-api.service[123596]: request: GET /compute/v2.1/os-hypervisors/1/uptime HTTP/1.1 Oct 04 18:34:58.005409 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:34:58.005409 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:34:58.005409 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:34:58.005409 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 18:34:58.005409 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:34:58.005409 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:34:58.005409 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:34:58.005409 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:34:58.005409 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPHzQzyQemD7ayiCQgYQGNWLMEJRyn6dMXXouBzOOirrnYf1ryqgZPSrZcFWBQehCGnrMl3kXH0XDd7pv-RYN8noOhtkDguq8sRnL8NqmCusbRltTfoF4udn-pwmvYPcnzIGoMdqpoGW4hd3iP2llA2PYH3VcPKFVHbEQ6uQIK9c5i6g Oct 04 18:34:58.005409 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:34:58.005409 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:34:58.005409 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:34:58.005409 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:34:58.005409 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:34:58.005409 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:34:58.005409 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: d4d1bad8a11b407ab83f3c21c91d01d3 Oct 04 18:34:58.005409 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-151052672 Oct 04 18:34:58.005409 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 18:34:58.005409 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 18:34:58.005409 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/d4d1bad8a11b407ab83f3c21c91d01d3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_d4d1bad8a11b407ab83f3c21c91d01d3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d4d1bad8a11b407ab83f3c21c91d01d3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d4d1bad8a11b407ab83f3c21c91d01d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:34:58.005409 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-151052672 Oct 04 18:34:58.005409 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: d4d1bad8a11b407ab83f3c21c91d01d3 Oct 04 18:34:58.005409 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-151052672 Oct 04 18:34:58.005409 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-HypervisorAdminNegativeTestJSON-151052672-project Oct 04 18:34:58.005409 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:34:58.005409 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:34:58.005409 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 38a500daf9194c5b835245283f66313d Oct 04 18:34:58.005409 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-151052672-project Oct 04 18:34:58.005409 n-d-851028-13 devstack@n-api.service[123596]: method: Oct 04 18:34:58.005409 n-d-851028-13 devstack@n-api.service[123596]: exception: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 04 18:34:58.005409 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': '1'} Oct 04 18:34:58.005409 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:34:58.005409 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:34:58.005409 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:34:58.005409 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:34:58.005409 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:34:58.005409 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:34:58.005409 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:34:58.005409 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:34:58.005409 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:34:58.005409 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:34:58.005409 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 387, in uptime Oct 04 18:34:58.005409 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'uptime', target={}) Oct 04 18:34:58.005409 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 18:34:58.005409 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 18:34:58.005409 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 18:34:58.005409 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 18:34:58.005409 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:34:58.005409 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:34:58.005409 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:34:58.005409 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:34:58.005409 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 18:34:58.005409 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 18:34:58.005409 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 18:34:58.005409 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 18:34:58.005409 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 18:34:58.005409 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 18:34:58.005409 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 04 18:34:58.005409 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:34:58.005409 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:34:58.005409 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:34:58.005409 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:34:58.012118 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:34:58.012118 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:34:58.012118 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 18:34:58.012118 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 18:34:58.012118 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 04 18:34:58.012118 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:34:58.013190 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 483/1052] 10.222.0.43 () {58 vars in 1146 bytes} [Tue Oct 4 18:34:57 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:34:58.014263 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-22baec93-3a36-4728-b467-123585cab4a9 tempest-HypervisorAdminNegativeTestJSON-151052672 tempest-HypervisorAdminNegativeTestJSON-151052672-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:34:58.016203 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-22baec93-3a36-4728-b467-123585cab4a9 tempest-HypervisorAdminNegativeTestJSON-151052672 tempest-HypervisorAdminNegativeTestJSON-151052672-project] 10.222.0.43 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.019925 Oct 04 18:34:58.017429 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 570/1053] 10.222.0.43 () {58 vars in 1173 bytes} [Tue Oct 4 18:34:57 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 22 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:34:58.028545 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-f517228f-eb77-47df-a2df-dadf7d374b46 tempest-HypervisorAdminNegativeTestJSON-607144227 tempest-HypervisorAdminNegativeTestJSON-607144227-project-admin] Calling method '.version_select at 0x7fb21fbeef70>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:58.031253 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-f517228f-eb77-47df-a2df-dadf7d374b46 tempest-HypervisorAdminNegativeTestJSON-607144227 tempest-HypervisorAdminNegativeTestJSON-607144227-project-admin] HTTP exception thrown: Hypervisor with ID 'bfa9ff0a-9356-44ae-a40f-1f154c735d3a' could not be found. Oct 04 18:34:58.050170 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-f517228f-eb77-47df-a2df-dadf7d374b46 tempest-HypervisorAdminNegativeTestJSON-607144227 tempest-HypervisorAdminNegativeTestJSON-607144227-project-admin] Request method failure captured: Oct 04 18:34:58.050170 n-d-851028-13 devstack@n-api.service[123595]: request: GET /compute/v2.1/os-hypervisors/bfa9ff0a-9356-44ae-a40f-1f154c735d3a/uptime HTTP/1.1 Oct 04 18:34:58.050170 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 18:34:58.050170 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 18:34:58.050170 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 18:34:58.050170 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 0 Oct 04 18:34:58.050170 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 18:34:58.050170 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 18:34:58.050170 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 18:34:58.050170 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 18:34:58.050170 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPHzRnt-Y5exi8RmnSMwWNcSVun9egZUIsfqVUlDSl11aFeKOjhYJisfKtPwp4E80CfkqU0QHPCB9e1uelFBtQWlzsInzu9IytrJ3Z69CSMD5T9C1duHypLAYZr7f9k3VhAFNzDfyxQWpFyzJOxwdkNvicP_B09bbup-Yiw0A-yjcAOM Oct 04 18:34:58.050170 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 18:34:58.050170 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 18:34:58.050170 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 18:34:58.050170 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 18:34:58.050170 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 18:34:58.050170 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 18:34:58.050170 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: 3582f9a98c4e4cf39b9ff6917edd08da Oct 04 18:34:58.050170 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-607144227 Oct 04 18:34:58.050170 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,admin,reader Oct 04 18:34:58.050170 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,admin,reader Oct 04 18:34:58.050170 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/3582f9a98c4e4cf39b9ff6917edd08da"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_3582f9a98c4e4cf39b9ff6917edd08da"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/3582f9a98c4e4cf39b9ff6917edd08da"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/3582f9a98c4e4cf39b9ff6917edd08da"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:34:58.050170 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-607144227 Oct 04 18:34:58.050170 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: 3582f9a98c4e4cf39b9ff6917edd08da Oct 04 18:34:58.050170 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-607144227 Oct 04 18:34:58.050170 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-HypervisorAdminNegativeTestJSON-607144227-project-admin Oct 04 18:34:58.050170 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 18:34:58.050170 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 18:34:58.050170 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: 0311e73434604829b0340f1d668d4f50 Oct 04 18:34:58.050170 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-607144227-project-admin Oct 04 18:34:58.050170 n-d-851028-13 devstack@n-api.service[123595]: method: Oct 04 18:34:58.050170 n-d-851028-13 devstack@n-api.service[123595]: exception: Hypervisor with ID 'bfa9ff0a-9356-44ae-a40f-1f154c735d3a' could not be found. Oct 04 18:34:58.050170 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': 'bfa9ff0a-9356-44ae-a40f-1f154c735d3a'} Oct 04 18:34:58.050170 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:34:58.050170 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:34:58.050170 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Oct 04 18:34:58.050170 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi value = int(str(value)) Oct 04 18:34:58.050170 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: 'bfa9ff0a-9356-44ae-a40f-1f154c735d3a' Oct 04 18:34:58.050170 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:34:58.050170 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:34:58.050170 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:34:58.050170 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:34:58.050170 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Oct 04 18:34:58.050170 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Oct 04 18:34:58.050170 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Oct 04 18:34:58.050170 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Oct 04 18:34:58.050170 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Oct 04 18:34:58.050170 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:34:58.050170 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:34:58.050170 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:34:58.050170 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:34:58.050170 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Oct 04 18:34:58.050170 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Oct 04 18:34:58.050170 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Oct 04 18:34:58.050170 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Oct 04 18:34:58.050170 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Oct 04 18:34:58.050170 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:34:58.050170 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:34:58.050170 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:34:58.050170 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:34:58.050170 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:34:58.050170 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:34:58.050170 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:34:58.050170 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:34:58.050170 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:34:58.056571 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:34:58.056571 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:34:58.056571 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:34:58.056571 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 389, in uptime Oct 04 18:34:58.056571 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Oct 04 18:34:58.056571 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Oct 04 18:34:58.056571 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 04 18:34:58.056571 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID 'bfa9ff0a-9356-44ae-a40f-1f154c735d3a' could not be found. Oct 04 18:34:58.056571 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:34:58.056571 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:34:58.056571 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:34:58.056571 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:34:58.056571 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:34:58.056571 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:34:58.056571 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:34:58.056571 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:34:58.056571 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID 'bfa9ff0a-9356-44ae-a40f-1f154c735d3a' could not be found. Oct 04 18:34:58.056571 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:34:58.060211 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-f517228f-eb77-47df-a2df-dadf7d374b46 tempest-HypervisorAdminNegativeTestJSON-607144227 tempest-HypervisorAdminNegativeTestJSON-607144227-project-admin] Returning 404 to user: Hypervisor with ID 'bfa9ff0a-9356-44ae-a40f-1f154c735d3a' could not be found. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:34:58.061489 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-f517228f-eb77-47df-a2df-dadf7d374b46 tempest-HypervisorAdminNegativeTestJSON-607144227 tempest-HypervisorAdminNegativeTestJSON-607144227-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hypervisors/bfa9ff0a-9356-44ae-a40f-1f154c735d3a/uptime" status: 404 len: 123 microversion: 2.1 time: 0.038777 Oct 04 18:34:58.063179 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 484/1054] 10.222.0.43 () {58 vars in 1278 bytes} [Tue Oct 4 18:34:58 2022] GET /compute/v2.1/os-hypervisors/bfa9ff0a-9356-44ae-a40f-1f154c735d3a/uptime => generated 123 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:34:58.071931 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-a9100412-dbde-4244-aeff-59c98e0eba29 tempest-HypervisorAdminNegativeTestJSON-607144227 tempest-HypervisorAdminNegativeTestJSON-607144227-project-admin] Calling method '.version_select at 0x7fb227f558b0>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:58.075566 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a9100412-dbde-4244-aeff-59c98e0eba29 tempest-HypervisorAdminNegativeTestJSON-607144227 tempest-HypervisorAdminNegativeTestJSON-607144227-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:58.076075 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a9100412-dbde-4244-aeff-59c98e0eba29 tempest-HypervisorAdminNegativeTestJSON-607144227 tempest-HypervisorAdminNegativeTestJSON-607144227-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:58.076687 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a9100412-dbde-4244-aeff-59c98e0eba29 tempest-HypervisorAdminNegativeTestJSON-607144227 tempest-HypervisorAdminNegativeTestJSON-607144227-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:58.095722 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a9100412-dbde-4244-aeff-59c98e0eba29 tempest-HypervisorAdminNegativeTestJSON-607144227 tempest-HypervisorAdminNegativeTestJSON-607144227-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:58.096493 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a9100412-dbde-4244-aeff-59c98e0eba29 tempest-HypervisorAdminNegativeTestJSON-607144227 tempest-HypervisorAdminNegativeTestJSON-607144227-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:58.097886 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a9100412-dbde-4244-aeff-59c98e0eba29 tempest-HypervisorAdminNegativeTestJSON-607144227 tempest-HypervisorAdminNegativeTestJSON-607144227-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:58.113517 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a9100412-dbde-4244-aeff-59c98e0eba29 tempest-HypervisorAdminNegativeTestJSON-607144227 tempest-HypervisorAdminNegativeTestJSON-607144227-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:58.114190 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a9100412-dbde-4244-aeff-59c98e0eba29 tempest-HypervisorAdminNegativeTestJSON-607144227 tempest-HypervisorAdminNegativeTestJSON-607144227-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:58.114845 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a9100412-dbde-4244-aeff-59c98e0eba29 tempest-HypervisorAdminNegativeTestJSON-607144227 tempest-HypervisorAdminNegativeTestJSON-607144227-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:58.121968 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-a9100412-dbde-4244-aeff-59c98e0eba29 tempest-HypervisorAdminNegativeTestJSON-607144227 tempest-HypervisorAdminNegativeTestJSON-607144227-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.053877 Oct 04 18:34:58.123223 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 571/1055] 10.222.0.43 () {58 vars in 1146 bytes} [Tue Oct 4 18:34:58 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:34:58.134618 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-474d2b3b-c781-4b5b-bc16-5c5623546c78 tempest-HypervisorAdminNegativeTestJSON-151052672 tempest-HypervisorAdminNegativeTestJSON-151052672-project] Calling method '.version_select at 0x7fb21fbfe3a0>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:58.136737 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-474d2b3b-c781-4b5b-bc16-5c5623546c78 tempest-HypervisorAdminNegativeTestJSON-151052672 tempest-HypervisorAdminNegativeTestJSON-151052672-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': '38a500daf9194c5b835245283f66313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4d1bad8a11b407ab83f3c21c91d01d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:58.138931 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-474d2b3b-c781-4b5b-bc16-5c5623546c78 tempest-HypervisorAdminNegativeTestJSON-151052672 tempest-HypervisorAdminNegativeTestJSON-151052672-project] Request method failure captured: Oct 04 18:34:58.138931 n-d-851028-13 devstack@n-api.service[123595]: request: GET /compute/v2.1/os-hypervisors/1 HTTP/1.1 Oct 04 18:34:58.138931 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 18:34:58.138931 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 18:34:58.138931 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 18:34:58.138931 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 0 Oct 04 18:34:58.138931 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 18:34:58.138931 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 18:34:58.138931 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 18:34:58.138931 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 18:34:58.138931 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPHzQzyQemD7ayiCQgYQGNWLMEJRyn6dMXXouBzOOirrnYf1ryqgZPSrZcFWBQehCGnrMl3kXH0XDd7pv-RYN8noOhtkDguq8sRnL8NqmCusbRltTfoF4udn-pwmvYPcnzIGoMdqpoGW4hd3iP2llA2PYH3VcPKFVHbEQ6uQIK9c5i6g Oct 04 18:34:58.138931 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 18:34:58.138931 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 18:34:58.138931 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 18:34:58.138931 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 18:34:58.138931 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 18:34:58.138931 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 18:34:58.138931 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: d4d1bad8a11b407ab83f3c21c91d01d3 Oct 04 18:34:58.138931 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-151052672 Oct 04 18:34:58.138931 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 18:34:58.138931 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 18:34:58.138931 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/d4d1bad8a11b407ab83f3c21c91d01d3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_d4d1bad8a11b407ab83f3c21c91d01d3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d4d1bad8a11b407ab83f3c21c91d01d3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d4d1bad8a11b407ab83f3c21c91d01d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:34:58.138931 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-151052672 Oct 04 18:34:58.138931 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: d4d1bad8a11b407ab83f3c21c91d01d3 Oct 04 18:34:58.138931 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-151052672 Oct 04 18:34:58.138931 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-HypervisorAdminNegativeTestJSON-151052672-project Oct 04 18:34:58.138931 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 18:34:58.138931 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 18:34:58.138931 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: 38a500daf9194c5b835245283f66313d Oct 04 18:34:58.138931 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-151052672-project Oct 04 18:34:58.138931 n-d-851028-13 devstack@n-api.service[123595]: method: Oct 04 18:34:58.138931 n-d-851028-13 devstack@n-api.service[123595]: exception: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 04 18:34:58.138931 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': '1'} Oct 04 18:34:58.138931 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:34:58.138931 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:34:58.138931 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:34:58.138931 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:34:58.138931 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:34:58.138931 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:34:58.138931 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:34:58.138931 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:34:58.138931 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:34:58.138931 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:34:58.138931 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Oct 04 18:34:58.138931 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 04 18:34:58.138931 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 341, in _show Oct 04 18:34:58.138931 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'show', target={}) Oct 04 18:34:58.138931 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 18:34:58.138931 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 18:34:58.138931 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 18:34:58.138931 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 18:34:58.138931 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:34:58.138931 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:34:58.138931 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:34:58.138931 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:34:58.138931 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 18:34:58.138931 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 18:34:58.138931 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 18:34:58.138931 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 18:34:58.138931 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 18:34:58.138931 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 18:34:58.138931 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 04 18:34:58.138931 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:34:58.144161 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:34:58.144161 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:34:58.144161 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:34:58.144161 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:34:58.144161 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:34:58.144161 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 18:34:58.144161 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 18:34:58.144161 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 04 18:34:58.144161 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:34:58.144161 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-474d2b3b-c781-4b5b-bc16-5c5623546c78 tempest-HypervisorAdminNegativeTestJSON-151052672 tempest-HypervisorAdminNegativeTestJSON-151052672-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:34:58.144161 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-474d2b3b-c781-4b5b-bc16-5c5623546c78 tempest-HypervisorAdminNegativeTestJSON-151052672 tempest-HypervisorAdminNegativeTestJSON-151052672-project] 10.222.0.43 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.010425 Oct 04 18:34:58.144161 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 485/1056] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Oct 4 18:34:58 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 13 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:34:58.151527 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-c1c0d109-37ea-4c2f-8e8e-a19d3a20b07b tempest-HypervisorAdminNegativeTestJSON-607144227 tempest-HypervisorAdminNegativeTestJSON-607144227-project-admin] Calling method '.version_select at 0x7fb227ed8a60>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:58.153176 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-c1c0d109-37ea-4c2f-8e8e-a19d3a20b07b tempest-HypervisorAdminNegativeTestJSON-607144227 tempest-HypervisorAdminNegativeTestJSON-607144227-project-admin] HTTP exception thrown: Hypervisor with ID '7336316e-5de9-49cb-9c8c-e843241ba919' could not be found. Oct 04 18:34:58.158294 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-c1c0d109-37ea-4c2f-8e8e-a19d3a20b07b tempest-HypervisorAdminNegativeTestJSON-607144227 tempest-HypervisorAdminNegativeTestJSON-607144227-project-admin] Request method failure captured: Oct 04 18:34:58.158294 n-d-851028-13 devstack@n-api.service[123596]: request: GET /compute/v2.1/os-hypervisors/7336316e-5de9-49cb-9c8c-e843241ba919 HTTP/1.1 Oct 04 18:34:58.158294 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:34:58.158294 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:34:58.158294 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:34:58.158294 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 18:34:58.158294 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:34:58.158294 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:34:58.158294 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:34:58.158294 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:34:58.158294 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPHzRnt-Y5exi8RmnSMwWNcSVun9egZUIsfqVUlDSl11aFeKOjhYJisfKtPwp4E80CfkqU0QHPCB9e1uelFBtQWlzsInzu9IytrJ3Z69CSMD5T9C1duHypLAYZr7f9k3VhAFNzDfyxQWpFyzJOxwdkNvicP_B09bbup-Yiw0A-yjcAOM Oct 04 18:34:58.158294 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:34:58.158294 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:34:58.158294 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:34:58.158294 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:34:58.158294 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:34:58.158294 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:34:58.158294 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: 3582f9a98c4e4cf39b9ff6917edd08da Oct 04 18:34:58.158294 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-607144227 Oct 04 18:34:58.158294 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,admin,reader Oct 04 18:34:58.158294 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,admin,reader Oct 04 18:34:58.158294 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/3582f9a98c4e4cf39b9ff6917edd08da"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_3582f9a98c4e4cf39b9ff6917edd08da"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/3582f9a98c4e4cf39b9ff6917edd08da"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/3582f9a98c4e4cf39b9ff6917edd08da"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:34:58.158294 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-607144227 Oct 04 18:34:58.158294 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: 3582f9a98c4e4cf39b9ff6917edd08da Oct 04 18:34:58.158294 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-607144227 Oct 04 18:34:58.158294 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-HypervisorAdminNegativeTestJSON-607144227-project-admin Oct 04 18:34:58.158294 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:34:58.158294 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:34:58.158294 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 0311e73434604829b0340f1d668d4f50 Oct 04 18:34:58.158294 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-607144227-project-admin Oct 04 18:34:58.158294 n-d-851028-13 devstack@n-api.service[123596]: method: Oct 04 18:34:58.158294 n-d-851028-13 devstack@n-api.service[123596]: exception: Hypervisor with ID '7336316e-5de9-49cb-9c8c-e843241ba919' could not be found. Oct 04 18:34:58.158294 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': '7336316e-5de9-49cb-9c8c-e843241ba919'} Oct 04 18:34:58.158294 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:34:58.158294 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:34:58.158294 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Oct 04 18:34:58.158294 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi value = int(str(value)) Oct 04 18:34:58.158294 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '7336316e-5de9-49cb-9c8c-e843241ba919' Oct 04 18:34:58.158294 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:34:58.158294 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:34:58.158294 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:34:58.158294 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:34:58.158294 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Oct 04 18:34:58.158294 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Oct 04 18:34:58.158294 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Oct 04 18:34:58.158294 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Oct 04 18:34:58.158294 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Oct 04 18:34:58.158294 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:34:58.158294 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:34:58.158294 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:34:58.158294 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:34:58.158294 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Oct 04 18:34:58.158294 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Oct 04 18:34:58.158294 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Oct 04 18:34:58.158294 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Oct 04 18:34:58.158294 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Oct 04 18:34:58.158294 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:34:58.158294 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:34:58.158294 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:34:58.158294 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:34:58.158294 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:34:58.158294 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:34:58.158294 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:34:58.158294 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:34:58.158294 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:34:58.158294 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:34:58.162637 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:34:58.162637 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:34:58.162637 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Oct 04 18:34:58.162637 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 04 18:34:58.162637 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 343, in _show Oct 04 18:34:58.162637 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Oct 04 18:34:58.162637 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Oct 04 18:34:58.162637 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 04 18:34:58.162637 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '7336316e-5de9-49cb-9c8c-e843241ba919' could not be found. Oct 04 18:34:58.162637 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:34:58.162637 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:34:58.162637 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:34:58.162637 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:34:58.162637 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:34:58.162637 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:34:58.162637 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:34:58.162637 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:34:58.162637 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '7336316e-5de9-49cb-9c8c-e843241ba919' could not be found. Oct 04 18:34:58.162637 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:34:58.162637 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-c1c0d109-37ea-4c2f-8e8e-a19d3a20b07b tempest-HypervisorAdminNegativeTestJSON-607144227 tempest-HypervisorAdminNegativeTestJSON-607144227-project-admin] Returning 404 to user: Hypervisor with ID '7336316e-5de9-49cb-9c8c-e843241ba919' could not be found. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:34:58.162637 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-c1c0d109-37ea-4c2f-8e8e-a19d3a20b07b tempest-HypervisorAdminNegativeTestJSON-607144227 tempest-HypervisorAdminNegativeTestJSON-607144227-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hypervisors/7336316e-5de9-49cb-9c8c-e843241ba919" status: 404 len: 123 microversion: 2.1 time: 0.012794 Oct 04 18:34:58.164044 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 572/1057] 10.222.0.43 () {58 vars in 1257 bytes} [Tue Oct 4 18:34:58 2022] GET /compute/v2.1/os-hypervisors/7336316e-5de9-49cb-9c8c-e843241ba919 => generated 123 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:34:58.179743 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-c161db6d-8f1e-4451-a814-4c3643cb6699 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:58.180469 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-c161db6d-8f1e-4451-a814-4c3643cb6699 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] [instance: 84e0414b-a39f-4bfe-bc9d-c170ceb34d15] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:58.188077 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c161db6d-8f1e-4451-a814-4c3643cb6699 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:58.188574 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c161db6d-8f1e-4451-a814-4c3643cb6699 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:58.190593 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c161db6d-8f1e-4451-a814-4c3643cb6699 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:58.191368 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c161db6d-8f1e-4451-a814-4c3643cb6699 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:58.191855 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c161db6d-8f1e-4451-a814-4c3643cb6699 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:58.192307 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c161db6d-8f1e-4451-a814-4c3643cb6699 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:58.281909 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-c161db6d-8f1e-4451-a814-4c3643cb6699 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:58.291310 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-c161db6d-8f1e-4451-a814-4c3643cb6699 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:58.293189 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-c161db6d-8f1e-4451-a814-4c3643cb6699 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:58.304674 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-c161db6d-8f1e-4451-a814-4c3643cb6699 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] 10.222.0.43 "GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15" status: 200 len: 1537 microversion: 2.91 time: 0.129926 Oct 04 18:34:58.306639 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 486/1058] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:34:58 2022] GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15 => generated 1537 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:34:58.365451 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-9e4539be-693d-4c30-8156-31e4f186e0c1 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:58.366078 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-9e4539be-693d-4c30-8156-31e4f186e0c1 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] [instance: 4311d976-991e-4ab1-9d5e-d654aa7d0b08] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:58.382534 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9e4539be-693d-4c30-8156-31e4f186e0c1 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:58.384143 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9e4539be-693d-4c30-8156-31e4f186e0c1 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:58.384696 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9e4539be-693d-4c30-8156-31e4f186e0c1 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:58.385938 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9e4539be-693d-4c30-8156-31e4f186e0c1 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:58.386419 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9e4539be-693d-4c30-8156-31e4f186e0c1 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:58.387120 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9e4539be-693d-4c30-8156-31e4f186e0c1 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:58.642554 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-9e4539be-693d-4c30-8156-31e4f186e0c1 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7db99f361654711bea7f1b2c404d312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7adedcdb9c3485ea2738c00e25aa3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:58.680249 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-9e4539be-693d-4c30-8156-31e4f186e0c1 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] 10.222.0.43 "GET /compute/v2.1/servers/4311d976-991e-4ab1-9d5e-d654aa7d0b08" status: 200 len: 1475 microversion: 2.1 time: 0.317297 Oct 04 18:34:58.692918 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 573/1059] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:58 2022] GET /compute/v2.1/servers/4311d976-991e-4ab1-9d5e-d654aa7d0b08 => generated 1475 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:58.851188 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-6aea427c-c0e6-467c-af5a-41da06df9063 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-514568867", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452", "networks": [{"uuid": "1fac60ec-a479-4aec-9ef2-ec5cc4fb1c50"}], "security_groups": [{"name": "tempest-securitygroup--2146164198"}], "key_name": "tempest-keypair-1549185586", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:34:58.945054 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-24822dd6-0a80-4ea0-8f11-44c22806161e tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:58.945988 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-24822dd6-0a80-4ea0-8f11-44c22806161e tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] [instance: 93798a9a-d90d-4a4e-8e30-d6575486ff56] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:58.956240 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-24822dd6-0a80-4ea0-8f11-44c22806161e tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:58.956682 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-24822dd6-0a80-4ea0-8f11-44c22806161e tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:58.957418 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-24822dd6-0a80-4ea0-8f11-44c22806161e tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:58.958418 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-24822dd6-0a80-4ea0-8f11-44c22806161e tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:58.959150 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-24822dd6-0a80-4ea0-8f11-44c22806161e tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:58.959675 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-24822dd6-0a80-4ea0-8f11-44c22806161e tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:59.253430 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-24822dd6-0a80-4ea0-8f11-44c22806161e tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a41ab6fb78a42ceaca621c5a38ffc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa31ed92017490a82497c7b8910aef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:59.264286 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-24822dd6-0a80-4ea0-8f11-44c22806161e tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] 10.222.0.43 "GET /compute/v2.1/servers/93798a9a-d90d-4a4e-8e30-d6575486ff56" status: 200 len: 1497 microversion: 2.1 time: 0.323318 Oct 04 18:34:59.266667 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 574/1060] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:58 2022] GET /compute/v2.1/servers/93798a9a-d90d-4a4e-8e30-d6575486ff56 => generated 1497 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:59.275925 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.network.neutron [None req-6aea427c-c0e6-467c-af5a-41da06df9063 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] validate_networks() for [('1fac60ec-a479-4aec-9ef2-ec5cc4fb1c50', None, None, None, None, None)] {{(pid=123595) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:34:59.495666 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-5f9cfbd1-3528-4d3e-87f4-88c0c444674b tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-186431938", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452", "networks": "none"}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:34:59.580428 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-5f9cfbd1-3528-4d3e-87f4-88c0c444674b tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Flavor limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:34:59.582751 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-5f9cfbd1-3528-4d3e-87f4-88c0c444674b tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Image limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:34:59.585853 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-5f9cfbd1-3528-4d3e-87f4-88c0c444674b tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Flavor pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:34:59.586557 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-5f9cfbd1-3528-4d3e-87f4-88c0c444674b tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Image pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:34:59.588610 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-5f9cfbd1-3528-4d3e-87f4-88c0c444674b tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:34:59.608527 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5f9cfbd1-3528-4d3e-87f4-88c0c444674b tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:59.610353 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5f9cfbd1-3528-4d3e-87f4-88c0c444674b tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:59.610810 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5f9cfbd1-3528-4d3e-87f4-88c0c444674b tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:59.611936 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5f9cfbd1-3528-4d3e-87f4-88c0c444674b tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:59.612766 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5f9cfbd1-3528-4d3e-87f4-88c0c444674b tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:59.613166 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5f9cfbd1-3528-4d3e-87f4-88c0c444674b tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:59.633969 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-5f9cfbd1-3528-4d3e-87f4-88c0c444674b tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Getting quotas for project f2c849c5d04f44f7951908d740ec1689. Resources: {'ram', 'cores', 'instances'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:34:59.639332 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-5f9cfbd1-3528-4d3e-87f4-88c0c444674b tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Getting quotas for user 0d8b5e18327f4713a1e465acb9e863f1 and project f2c849c5d04f44f7951908d740ec1689. Resources: {'ram', 'cores', 'instances'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:34:59.654477 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:34:59.657007 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-5f9cfbd1-3528-4d3e-87f4-88c0c444674b tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Going to run 1 instances... {{(pid=123596) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:34:59.659739 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-5f9cfbd1-3528-4d3e-87f4-88c0c444674b tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] [instance: 67e13bce-be81-4775-be5f-737add9f1694] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e8943ec5-4038-4d4b-b9b9-2415a79f5243',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123596) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:34:59.723268 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-5f9cfbd1-3528-4d3e-87f4-88c0c444674b tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.75 time: 0.451753 Oct 04 18:34:59.724567 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 575/1061] 10.222.0.43 () {62 vars in 1188 bytes} [Tue Oct 4 18:34:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 457 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 04 18:34:59.732328 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-dcd40079-49df-480f-9331-5789c714dfa7 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:59.733510 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-dcd40079-49df-480f-9331-5789c714dfa7 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] [instance: 84e0414b-a39f-4bfe-bc9d-c170ceb34d15] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:59.742916 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dcd40079-49df-480f-9331-5789c714dfa7 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:59.744020 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dcd40079-49df-480f-9331-5789c714dfa7 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:59.745097 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dcd40079-49df-480f-9331-5789c714dfa7 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:59.746599 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dcd40079-49df-480f-9331-5789c714dfa7 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:59.747627 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dcd40079-49df-480f-9331-5789c714dfa7 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:59.748241 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dcd40079-49df-480f-9331-5789c714dfa7 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:59.971573 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-dcd40079-49df-480f-9331-5789c714dfa7 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:59.982642 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-dcd40079-49df-480f-9331-5789c714dfa7 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:59.984646 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-dcd40079-49df-480f-9331-5789c714dfa7 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:59.993630 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-dcd40079-49df-480f-9331-5789c714dfa7 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] 10.222.0.43 "GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15" status: 200 len: 1537 microversion: 2.91 time: 0.267648 Oct 04 18:34:59.998167 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 576/1062] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:34:59 2022] GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15 => generated 1537 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:35:00.003502 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-eeecf047-fbe2-4c99-a55b-8531f1d1c46c tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:00.004115 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-eeecf047-fbe2-4c99-a55b-8531f1d1c46c tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] [instance: 4311d976-991e-4ab1-9d5e-d654aa7d0b08] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:00.027172 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-eeecf047-fbe2-4c99-a55b-8531f1d1c46c tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:00.027638 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-eeecf047-fbe2-4c99-a55b-8531f1d1c46c tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:00.028078 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-eeecf047-fbe2-4c99-a55b-8531f1d1c46c tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:00.028790 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-eeecf047-fbe2-4c99-a55b-8531f1d1c46c tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:00.029273 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-eeecf047-fbe2-4c99-a55b-8531f1d1c46c tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:00.038677 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-eeecf047-fbe2-4c99-a55b-8531f1d1c46c tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:00.336944 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-eeecf047-fbe2-4c99-a55b-8531f1d1c46c tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7db99f361654711bea7f1b2c404d312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7adedcdb9c3485ea2738c00e25aa3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:00.348621 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-eeecf047-fbe2-4c99-a55b-8531f1d1c46c tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] 10.222.0.43 "GET /compute/v2.1/servers/4311d976-991e-4ab1-9d5e-d654aa7d0b08" status: 200 len: 1475 microversion: 2.1 time: 0.349307 Oct 04 18:35:00.351769 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 577/1063] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:59 2022] GET /compute/v2.1/servers/4311d976-991e-4ab1-9d5e-d654aa7d0b08 => generated 1475 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:00.364544 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-6b81de22-84e6-46cc-beae-695675567379 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:35:00.377451 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-6b81de22-84e6-46cc-beae-695675567379 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] [instance: 67e13bce-be81-4775-be5f-737add9f1694] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:00.568525 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-6b81de22-84e6-46cc-beae-695675567379 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8b5e18327f4713a1e465acb9e863f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c849c5d04f44f7951908d740ec1689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:00.580271 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-6b81de22-84e6-46cc-beae-695675567379 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d8b5e18327f4713a1e465acb9e863f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c849c5d04f44f7951908d740ec1689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:00.584733 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-6b81de22-84e6-46cc-beae-695675567379 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d8b5e18327f4713a1e465acb9e863f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c849c5d04f44f7951908d740ec1689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:00.600568 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-6b81de22-84e6-46cc-beae-695675567379 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] 10.222.0.43 "PUT /compute/v2.1/servers/67e13bce-be81-4775-be5f-737add9f1694" status: 200 len: 1358 microversion: 2.75 time: 0.246689 Oct 04 18:35:00.622792 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 578/1064] 10.222.0.43 () {62 vars in 1297 bytes} [Tue Oct 4 18:35:00 2022] PUT /compute/v2.1/servers/67e13bce-be81-4775-be5f-737add9f1694 => generated 1358 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:35:00.641172 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-ff590e6c-765b-4f52-9677-d7e3a6d14ff6 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:00.642952 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-ff590e6c-765b-4f52-9677-d7e3a6d14ff6 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] [instance: 93798a9a-d90d-4a4e-8e30-d6575486ff56] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:00.659541 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ff590e6c-765b-4f52-9677-d7e3a6d14ff6 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:00.661728 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ff590e6c-765b-4f52-9677-d7e3a6d14ff6 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:00.662437 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ff590e6c-765b-4f52-9677-d7e3a6d14ff6 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:00.665493 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ff590e6c-765b-4f52-9677-d7e3a6d14ff6 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:00.666237 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ff590e6c-765b-4f52-9677-d7e3a6d14ff6 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:00.666923 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ff590e6c-765b-4f52-9677-d7e3a6d14ff6 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:00.799898 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-6aea427c-c0e6-467c-af5a-41da06df9063 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Flavor limits 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:35:00.800404 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-6aea427c-c0e6-467c-af5a-41da06df9063 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Image limits 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:35:00.800801 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-6aea427c-c0e6-467c-af5a-41da06df9063 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Flavor pref 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:35:00.801290 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-6aea427c-c0e6-467c-af5a-41da06df9063 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Image pref 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:35:00.801756 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-6aea427c-c0e6-467c-af5a-41da06df9063 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:35:00.826873 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6aea427c-c0e6-467c-af5a-41da06df9063 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:00.828106 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6aea427c-c0e6-467c-af5a-41da06df9063 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:00.828945 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6aea427c-c0e6-467c-af5a-41da06df9063 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:00.832132 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6aea427c-c0e6-467c-af5a-41da06df9063 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:00.832806 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6aea427c-c0e6-467c-af5a-41da06df9063 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:00.833532 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6aea427c-c0e6-467c-af5a-41da06df9063 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:00.861079 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=3,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:35:00.873530 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-6aea427c-c0e6-467c-af5a-41da06df9063 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Getting quotas for project 34199e342c1b4158abf82384f2213b5f. Resources: {'ram', 'cores', 'instances'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:35:00.881738 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-6aea427c-c0e6-467c-af5a-41da06df9063 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Getting quotas for user 807a4a88319946aead73a3ccfcda6aeb and project 34199e342c1b4158abf82384f2213b5f. Resources: {'ram', 'cores', 'instances'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:35:00.906268 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-6aea427c-c0e6-467c-af5a-41da06df9063 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Going to run 1 instances... {{(pid=123595) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:35:00.909586 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-6aea427c-c0e6-467c-af5a-41da06df9063 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] [instance: 7222a4ce-d2a2-4b09-afc6-55bca52414d4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e8943ec5-4038-4d4b-b9b9-2415a79f5243',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:35:00.965629 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-6aea427c-c0e6-467c-af5a-41da06df9063 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.25 time: 2.122035 Oct 04 18:35:00.966276 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 487/1065] 10.222.0.43 () {62 vars in 1188 bytes} [Tue Oct 4 18:34:58 2022] POST /compute/v2.1/servers => generated 406 bytes in 2124 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 04 18:35:00.971769 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-2e507b4c-3ad7-4884-8487-650d0ff4c168 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:00.972622 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-2e507b4c-3ad7-4884-8487-650d0ff4c168 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] [instance: 67e13bce-be81-4775-be5f-737add9f1694] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:00.981667 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2e507b4c-3ad7-4884-8487-650d0ff4c168 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:00.982623 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2e507b4c-3ad7-4884-8487-650d0ff4c168 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:00.983233 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2e507b4c-3ad7-4884-8487-650d0ff4c168 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:00.984187 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2e507b4c-3ad7-4884-8487-650d0ff4c168 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:00.984845 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2e507b4c-3ad7-4884-8487-650d0ff4c168 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:00.985467 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2e507b4c-3ad7-4884-8487-650d0ff4c168 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:01.154584 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-2e507b4c-3ad7-4884-8487-650d0ff4c168 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8b5e18327f4713a1e465acb9e863f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c849c5d04f44f7951908d740ec1689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:01.158313 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-ff590e6c-765b-4f52-9677-d7e3a6d14ff6 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a41ab6fb78a42ceaca621c5a38ffc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa31ed92017490a82497c7b8910aef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:01.168040 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-ff590e6c-765b-4f52-9677-d7e3a6d14ff6 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] 10.222.0.43 "GET /compute/v2.1/servers/93798a9a-d90d-4a4e-8e30-d6575486ff56" status: 200 len: 1497 microversion: 2.1 time: 0.537625 Oct 04 18:35:01.176480 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-2e507b4c-3ad7-4884-8487-650d0ff4c168 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d8b5e18327f4713a1e465acb9e863f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c849c5d04f44f7951908d740ec1689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:01.176778 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 579/1066] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:00 2022] GET /compute/v2.1/servers/93798a9a-d90d-4a4e-8e30-d6575486ff56 => generated 1497 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:01.182778 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-2e507b4c-3ad7-4884-8487-650d0ff4c168 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d8b5e18327f4713a1e465acb9e863f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c849c5d04f44f7951908d740ec1689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:01.187368 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-72809f31-5927-489c-9f2f-98505cc86534 req-b25e5f85-880f-48bd-b900-0ddc9b8bf8bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4b812d5-f2ff-41c7-b912-3d19d752340b", "name": "network-vif-deleted", "tag": "67d0d477-8fa7-442f-a5da-9f7866a73c5b"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:35:01.200331 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-2e507b4c-3ad7-4884-8487-650d0ff4c168 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] 10.222.0.43 "GET /compute/v2.1/servers/67e13bce-be81-4775-be5f-737add9f1694" status: 200 len: 1354 microversion: 2.75 time: 0.231935 Oct 04 18:35:01.202496 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 488/1067] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:35:00 2022] GET /compute/v2.1/servers/67e13bce-be81-4775-be5f-737add9f1694 => generated 1354 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:35:01.228201 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-72809f31-5927-489c-9f2f-98505cc86534 req-b25e5f85-880f-48bd-b900-0ddc9b8bf8bd service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:01.228862 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-72809f31-5927-489c-9f2f-98505cc86534 req-b25e5f85-880f-48bd-b900-0ddc9b8bf8bd service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:01.229198 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-72809f31-5927-489c-9f2f-98505cc86534 req-b25e5f85-880f-48bd-b900-0ddc9b8bf8bd service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:01.234710 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-bbd9b6e1-5dcb-43bb-a0cd-702d909ac354 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:01.235795 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-bbd9b6e1-5dcb-43bb-a0cd-702d909ac354 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] [instance: 7222a4ce-d2a2-4b09-afc6-55bca52414d4] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:01.288938 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-72809f31-5927-489c-9f2f-98505cc86534 req-b25e5f85-880f-48bd-b900-0ddc9b8bf8bd service nova] Creating event network-vif-deleted:67d0d477-8fa7-442f-a5da-9f7866a73c5b for instance c4b812d5-f2ff-41c7-b912-3d19d752340b on n-h1-851028-13 Oct 04 18:35:01.303396 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-72809f31-5927-489c-9f2f-98505cc86534 req-b25e5f85-880f-48bd-b900-0ddc9b8bf8bd service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120156 Oct 04 18:35:01.305393 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 580/1068] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:35:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:35:01.320227 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f347671b-46c0-4b83-916b-ca0163d694d2 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:01.321570 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-f347671b-46c0-4b83-916b-ca0163d694d2 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] [instance: 84e0414b-a39f-4bfe-bc9d-c170ceb34d15] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:01.335758 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f347671b-46c0-4b83-916b-ca0163d694d2 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:01.337395 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f347671b-46c0-4b83-916b-ca0163d694d2 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:01.338705 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f347671b-46c0-4b83-916b-ca0163d694d2 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:01.339742 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f347671b-46c0-4b83-916b-ca0163d694d2 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:01.340538 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f347671b-46c0-4b83-916b-ca0163d694d2 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:01.341572 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f347671b-46c0-4b83-916b-ca0163d694d2 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:01.366445 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-bbd9b6e1-5dcb-43bb-a0cd-702d909ac354 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:01.375023 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-bbd9b6e1-5dcb-43bb-a0cd-702d909ac354 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:01.376494 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-bbd9b6e1-5dcb-43bb-a0cd-702d909ac354 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:01.384272 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-bbd9b6e1-5dcb-43bb-a0cd-702d909ac354 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] 10.222.0.43 "GET /compute/v2.1/servers/7222a4ce-d2a2-4b09-afc6-55bca52414d4" status: 200 len: 1285 microversion: 2.25 time: 0.156347 Oct 04 18:35:01.385647 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 489/1069] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:35:01 2022] GET /compute/v2.1/servers/7222a4ce-d2a2-4b09-afc6-55bca52414d4 => generated 1285 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:35:01.411844 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-46f8b29f-87ac-46a0-b0ae-10e311a21ad8 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:01.412970 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-46f8b29f-87ac-46a0-b0ae-10e311a21ad8 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] [instance: 4311d976-991e-4ab1-9d5e-d654aa7d0b08] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:01.422484 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-46f8b29f-87ac-46a0-b0ae-10e311a21ad8 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:01.423480 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-46f8b29f-87ac-46a0-b0ae-10e311a21ad8 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:01.424325 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-46f8b29f-87ac-46a0-b0ae-10e311a21ad8 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:01.425315 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-46f8b29f-87ac-46a0-b0ae-10e311a21ad8 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:01.426344 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-46f8b29f-87ac-46a0-b0ae-10e311a21ad8 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:01.428672 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-46f8b29f-87ac-46a0-b0ae-10e311a21ad8 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:01.475585 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-46f8b29f-87ac-46a0-b0ae-10e311a21ad8 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:01.476354 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-46f8b29f-87ac-46a0-b0ae-10e311a21ad8 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:01.477185 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-46f8b29f-87ac-46a0-b0ae-10e311a21ad8 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:01.477924 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.objects.instance [None req-46f8b29f-87ac-46a0-b0ae-10e311a21ad8 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lazy-loading 'fault' on Instance uuid 4311d976-991e-4ab1-9d5e-d654aa7d0b08 {{(pid=123595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:35:01.541828 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-46f8b29f-87ac-46a0-b0ae-10e311a21ad8 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7db99f361654711bea7f1b2c404d312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7adedcdb9c3485ea2738c00e25aa3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:01.561092 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-46f8b29f-87ac-46a0-b0ae-10e311a21ad8 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] 10.222.0.43 "GET /compute/v2.1/servers/4311d976-991e-4ab1-9d5e-d654aa7d0b08" status: 200 len: 1309 microversion: 2.1 time: 0.172658 Oct 04 18:35:01.563647 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 490/1070] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:01 2022] GET /compute/v2.1/servers/4311d976-991e-4ab1-9d5e-d654aa7d0b08 => generated 1309 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:01.596346 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-f347671b-46c0-4b83-916b-ca0163d694d2 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:01.607244 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-f347671b-46c0-4b83-916b-ca0163d694d2 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:01.608203 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-f347671b-46c0-4b83-916b-ca0163d694d2 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:01.621595 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-f347671b-46c0-4b83-916b-ca0163d694d2 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] 10.222.0.43 "GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15" status: 200 len: 1537 microversion: 2.91 time: 0.314267 Oct 04 18:35:01.624831 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 581/1071] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:35:01 2022] GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15 => generated 1537 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:35:02.198066 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-a82c2896-f8ee-4c7e-8ee3-d0b7622ec125 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:02.198066 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-a82c2896-f8ee-4c7e-8ee3-d0b7622ec125 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] [instance: 93798a9a-d90d-4a4e-8e30-d6575486ff56] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:02.216155 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a82c2896-f8ee-4c7e-8ee3-d0b7622ec125 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:02.218233 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a82c2896-f8ee-4c7e-8ee3-d0b7622ec125 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:02.218957 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a82c2896-f8ee-4c7e-8ee3-d0b7622ec125 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:02.234465 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-391ce18a-2027-4d1a-9a04-b21ef55cf1d4 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:02.235085 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-391ce18a-2027-4d1a-9a04-b21ef55cf1d4 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] [instance: 67e13bce-be81-4775-be5f-737add9f1694] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:02.243803 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a82c2896-f8ee-4c7e-8ee3-d0b7622ec125 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:02.246372 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a82c2896-f8ee-4c7e-8ee3-d0b7622ec125 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:02.247087 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-391ce18a-2027-4d1a-9a04-b21ef55cf1d4 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:02.247571 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-391ce18a-2027-4d1a-9a04-b21ef55cf1d4 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:02.248018 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-391ce18a-2027-4d1a-9a04-b21ef55cf1d4 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:02.253642 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a82c2896-f8ee-4c7e-8ee3-d0b7622ec125 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:02.257034 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-391ce18a-2027-4d1a-9a04-b21ef55cf1d4 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:02.257744 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-391ce18a-2027-4d1a-9a04-b21ef55cf1d4 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:02.264300 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-391ce18a-2027-4d1a-9a04-b21ef55cf1d4 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:02.622719 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-a82c2896-f8ee-4c7e-8ee3-d0b7622ec125 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a41ab6fb78a42ceaca621c5a38ffc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa31ed92017490a82497c7b8910aef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:02.634562 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-a82c2896-f8ee-4c7e-8ee3-d0b7622ec125 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] 10.222.0.43 "GET /compute/v2.1/servers/93798a9a-d90d-4a4e-8e30-d6575486ff56" status: 200 len: 1497 microversion: 2.1 time: 0.447083 Oct 04 18:35:02.636240 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 491/1072] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:02 2022] GET /compute/v2.1/servers/93798a9a-d90d-4a4e-8e30-d6575486ff56 => generated 1497 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:02.645402 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-eba1318c-bcaa-4895-a8f0-89ebfe8fe442 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:02.647705 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-eba1318c-bcaa-4895-a8f0-89ebfe8fe442 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] [instance: 7222a4ce-d2a2-4b09-afc6-55bca52414d4] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:02.666043 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-eba1318c-bcaa-4895-a8f0-89ebfe8fe442 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:02.666787 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-eba1318c-bcaa-4895-a8f0-89ebfe8fe442 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:02.667461 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-eba1318c-bcaa-4895-a8f0-89ebfe8fe442 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:02.668392 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-eba1318c-bcaa-4895-a8f0-89ebfe8fe442 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:02.669297 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-eba1318c-bcaa-4895-a8f0-89ebfe8fe442 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:02.670170 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-eba1318c-bcaa-4895-a8f0-89ebfe8fe442 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:02.685839 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-391ce18a-2027-4d1a-9a04-b21ef55cf1d4 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8b5e18327f4713a1e465acb9e863f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c849c5d04f44f7951908d740ec1689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:02.706962 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-391ce18a-2027-4d1a-9a04-b21ef55cf1d4 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d8b5e18327f4713a1e465acb9e863f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c849c5d04f44f7951908d740ec1689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:02.720690 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-391ce18a-2027-4d1a-9a04-b21ef55cf1d4 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d8b5e18327f4713a1e465acb9e863f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c849c5d04f44f7951908d740ec1689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:02.729835 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-391ce18a-2027-4d1a-9a04-b21ef55cf1d4 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] 10.222.0.43 "GET /compute/v2.1/servers/67e13bce-be81-4775-be5f-737add9f1694" status: 200 len: 1418 microversion: 2.75 time: 0.499642 Oct 04 18:35:02.733645 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 582/1073] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:35:02 2022] GET /compute/v2.1/servers/67e13bce-be81-4775-be5f-737add9f1694 => generated 1418 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:35:02.751472 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-563c2c62-a8c6-43d6-9e58-4b74a5f9b001 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:02.752100 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-563c2c62-a8c6-43d6-9e58-4b74a5f9b001 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] [instance: 4311d976-991e-4ab1-9d5e-d654aa7d0b08] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:02.761808 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-563c2c62-a8c6-43d6-9e58-4b74a5f9b001 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:02.762570 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-563c2c62-a8c6-43d6-9e58-4b74a5f9b001 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:02.763200 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-563c2c62-a8c6-43d6-9e58-4b74a5f9b001 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:02.764122 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-563c2c62-a8c6-43d6-9e58-4b74a5f9b001 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:02.764987 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-563c2c62-a8c6-43d6-9e58-4b74a5f9b001 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:02.765788 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-563c2c62-a8c6-43d6-9e58-4b74a5f9b001 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:02.797582 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-eba1318c-bcaa-4895-a8f0-89ebfe8fe442 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:02.818049 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-eba1318c-bcaa-4895-a8f0-89ebfe8fe442 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:02.821000 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-eba1318c-bcaa-4895-a8f0-89ebfe8fe442 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:02.822816 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-eba1318c-bcaa-4895-a8f0-89ebfe8fe442 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] 10.222.0.43 "GET /compute/v2.1/servers/7222a4ce-d2a2-4b09-afc6-55bca52414d4" status: 200 len: 1281 microversion: 2.25 time: 0.185386 Oct 04 18:35:02.824055 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 492/1074] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:35:02 2022] GET /compute/v2.1/servers/7222a4ce-d2a2-4b09-afc6-55bca52414d4 => generated 1281 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:35:02.830064 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-5a84b1c3-5cee-40d0-8f10-816ca320d69c tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:02.830974 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-5a84b1c3-5cee-40d0-8f10-816ca320d69c tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] [instance: 84e0414b-a39f-4bfe-bc9d-c170ceb34d15] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:02.841464 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5a84b1c3-5cee-40d0-8f10-816ca320d69c tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:02.842191 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5a84b1c3-5cee-40d0-8f10-816ca320d69c tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:02.843075 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5a84b1c3-5cee-40d0-8f10-816ca320d69c tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:02.844337 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5a84b1c3-5cee-40d0-8f10-816ca320d69c tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:02.845129 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5a84b1c3-5cee-40d0-8f10-816ca320d69c tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:02.845760 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5a84b1c3-5cee-40d0-8f10-816ca320d69c tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:02.856292 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-563c2c62-a8c6-43d6-9e58-4b74a5f9b001 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:02.861781 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-563c2c62-a8c6-43d6-9e58-4b74a5f9b001 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:02.862662 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-563c2c62-a8c6-43d6-9e58-4b74a5f9b001 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:02.863282 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.objects.instance [None req-563c2c62-a8c6-43d6-9e58-4b74a5f9b001 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lazy-loading 'fault' on Instance uuid 4311d976-991e-4ab1-9d5e-d654aa7d0b08 {{(pid=123596) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:35:02.926726 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-5a84b1c3-5cee-40d0-8f10-816ca320d69c tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:02.936188 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-5a84b1c3-5cee-40d0-8f10-816ca320d69c tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:02.937929 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-5a84b1c3-5cee-40d0-8f10-816ca320d69c tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:02.944034 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-5a84b1c3-5cee-40d0-8f10-816ca320d69c tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] 10.222.0.43 "GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15" status: 200 len: 1537 microversion: 2.91 time: 0.118662 Oct 04 18:35:02.945174 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 493/1075] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:35:02 2022] GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15 => generated 1537 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:35:03.212465 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-563c2c62-a8c6-43d6-9e58-4b74a5f9b001 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7db99f361654711bea7f1b2c404d312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7adedcdb9c3485ea2738c00e25aa3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:03.224113 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-563c2c62-a8c6-43d6-9e58-4b74a5f9b001 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] 10.222.0.43 "GET /compute/v2.1/servers/4311d976-991e-4ab1-9d5e-d654aa7d0b08" status: 200 len: 1309 microversion: 2.1 time: 0.488916 Oct 04 18:35:03.225005 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 583/1076] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:02 2022] GET /compute/v2.1/servers/4311d976-991e-4ab1-9d5e-d654aa7d0b08 => generated 1309 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:03.335048 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-2f96a1df-ae4b-4748-81c9-0cab9abe1f9c req-956ca81f-205e-4578-817f-710d0da58c06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4311d976-991e-4ab1-9d5e-d654aa7d0b08", "name": "network-vif-deleted", "tag": "b89d6e48-3869-4b43-a6d0-a6c0d069cdd9"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:35:03.361280 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-2f96a1df-ae4b-4748-81c9-0cab9abe1f9c req-956ca81f-205e-4578-817f-710d0da58c06 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:03.363022 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-2f96a1df-ae4b-4748-81c9-0cab9abe1f9c req-956ca81f-205e-4578-817f-710d0da58c06 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:03.364539 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-2f96a1df-ae4b-4748-81c9-0cab9abe1f9c req-956ca81f-205e-4578-817f-710d0da58c06 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:03.400630 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-2f96a1df-ae4b-4748-81c9-0cab9abe1f9c req-956ca81f-205e-4578-817f-710d0da58c06 service nova] Creating event network-vif-deleted:b89d6e48-3869-4b43-a6d0-a6c0d069cdd9 for instance 4311d976-991e-4ab1-9d5e-d654aa7d0b08 on n-h1-851028-13 Oct 04 18:35:03.410950 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-2f96a1df-ae4b-4748-81c9-0cab9abe1f9c req-956ca81f-205e-4578-817f-710d0da58c06 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083395 Oct 04 18:35:03.412533 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 494/1077] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:35:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:35:03.660290 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f2fd5fdc-1ef1-4ce7-8733-709470b05248 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:03.660910 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-f2fd5fdc-1ef1-4ce7-8733-709470b05248 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] [instance: 93798a9a-d90d-4a4e-8e30-d6575486ff56] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:03.667542 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f2fd5fdc-1ef1-4ce7-8733-709470b05248 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:03.668289 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f2fd5fdc-1ef1-4ce7-8733-709470b05248 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:03.668892 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f2fd5fdc-1ef1-4ce7-8733-709470b05248 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:03.669773 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f2fd5fdc-1ef1-4ce7-8733-709470b05248 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:03.670380 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f2fd5fdc-1ef1-4ce7-8733-709470b05248 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:03.671022 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f2fd5fdc-1ef1-4ce7-8733-709470b05248 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:03.766188 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-524ba204-739b-46d6-8cfd-25864615ec24 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:03.767219 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-524ba204-739b-46d6-8cfd-25864615ec24 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] [instance: 67e13bce-be81-4775-be5f-737add9f1694] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:03.777404 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-524ba204-739b-46d6-8cfd-25864615ec24 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:03.778757 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-524ba204-739b-46d6-8cfd-25864615ec24 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:03.779974 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-524ba204-739b-46d6-8cfd-25864615ec24 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:03.781951 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-524ba204-739b-46d6-8cfd-25864615ec24 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:03.782930 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-524ba204-739b-46d6-8cfd-25864615ec24 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:03.783893 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-524ba204-739b-46d6-8cfd-25864615ec24 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:03.793960 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:35:03.894197 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-524ba204-739b-46d6-8cfd-25864615ec24 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8b5e18327f4713a1e465acb9e863f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c849c5d04f44f7951908d740ec1689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:03.910067 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-524ba204-739b-46d6-8cfd-25864615ec24 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d8b5e18327f4713a1e465acb9e863f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c849c5d04f44f7951908d740ec1689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:03.911825 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-524ba204-739b-46d6-8cfd-25864615ec24 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d8b5e18327f4713a1e465acb9e863f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c849c5d04f44f7951908d740ec1689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:03.918384 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-524ba204-739b-46d6-8cfd-25864615ec24 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] 10.222.0.43 "GET /compute/v2.1/servers/67e13bce-be81-4775-be5f-737add9f1694" status: 200 len: 1416 microversion: 2.75 time: 0.156911 Oct 04 18:35:03.919639 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 495/1078] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:35:03 2022] GET /compute/v2.1/servers/67e13bce-be81-4775-be5f-737add9f1694 => generated 1416 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:35:03.933430 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-e7e66b21-f5ae-4b72-873b-424df5b939ff tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:03.934428 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-e7e66b21-f5ae-4b72-873b-424df5b939ff tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] [instance: 7222a4ce-d2a2-4b09-afc6-55bca52414d4] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:03.942580 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e7e66b21-f5ae-4b72-873b-424df5b939ff tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:03.943582 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e7e66b21-f5ae-4b72-873b-424df5b939ff tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:03.944132 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e7e66b21-f5ae-4b72-873b-424df5b939ff tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:03.945102 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e7e66b21-f5ae-4b72-873b-424df5b939ff tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:03.945778 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e7e66b21-f5ae-4b72-873b-424df5b939ff tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:03.946489 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e7e66b21-f5ae-4b72-873b-424df5b939ff tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:04.028165 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-f2fd5fdc-1ef1-4ce7-8733-709470b05248 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a41ab6fb78a42ceaca621c5a38ffc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa31ed92017490a82497c7b8910aef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:04.040537 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-f2fd5fdc-1ef1-4ce7-8733-709470b05248 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] 10.222.0.43 "GET /compute/v2.1/servers/93798a9a-d90d-4a4e-8e30-d6575486ff56" status: 200 len: 1497 microversion: 2.1 time: 0.383946 Oct 04 18:35:04.042899 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 584/1079] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:03 2022] GET /compute/v2.1/servers/93798a9a-d90d-4a4e-8e30-d6575486ff56 => generated 1497 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:04.049100 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-162c99dd-75f0-48fc-adc9-9601d6429840 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:04.050130 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-162c99dd-75f0-48fc-adc9-9601d6429840 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] [instance: 84e0414b-a39f-4bfe-bc9d-c170ceb34d15] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:04.080674 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-162c99dd-75f0-48fc-adc9-9601d6429840 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:04.081388 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-162c99dd-75f0-48fc-adc9-9601d6429840 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:04.081931 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-162c99dd-75f0-48fc-adc9-9601d6429840 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:04.082938 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-162c99dd-75f0-48fc-adc9-9601d6429840 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:04.084395 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-162c99dd-75f0-48fc-adc9-9601d6429840 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:04.085097 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-162c99dd-75f0-48fc-adc9-9601d6429840 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:04.303554 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-162c99dd-75f0-48fc-adc9-9601d6429840 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:04.314216 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-162c99dd-75f0-48fc-adc9-9601d6429840 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:04.319365 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-162c99dd-75f0-48fc-adc9-9601d6429840 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:04.335215 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-162c99dd-75f0-48fc-adc9-9601d6429840 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] 10.222.0.43 "GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15" status: 200 len: 1537 microversion: 2.91 time: 0.289622 Oct 04 18:35:04.335852 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 585/1080] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:35:04 2022] GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15 => generated 1537 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:35:04.348391 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-93d29f1c-09b9-445a-a220-5ed170adc3c1 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:04.350563 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-93d29f1c-09b9-445a-a220-5ed170adc3c1 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] [instance: 4311d976-991e-4ab1-9d5e-d654aa7d0b08] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:04.367057 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-93d29f1c-09b9-445a-a220-5ed170adc3c1 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:04.368441 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-93d29f1c-09b9-445a-a220-5ed170adc3c1 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:04.368880 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-93d29f1c-09b9-445a-a220-5ed170adc3c1 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:04.370990 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-93d29f1c-09b9-445a-a220-5ed170adc3c1 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:04.373829 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-93d29f1c-09b9-445a-a220-5ed170adc3c1 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:04.373829 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-93d29f1c-09b9-445a-a220-5ed170adc3c1 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:04.400535 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-93d29f1c-09b9-445a-a220-5ed170adc3c1 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] HTTP exception thrown: Instance 4311d976-991e-4ab1-9d5e-d654aa7d0b08 could not be found. Oct 04 18:35:04.402658 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-93d29f1c-09b9-445a-a220-5ed170adc3c1 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Request method failure captured: Oct 04 18:35:04.402658 n-d-851028-13 devstack@n-api.service[123596]: request: GET /compute/v2.1/servers/4311d976-991e-4ab1-9d5e-d654aa7d0b08 HTTP/1.1 Oct 04 18:35:04.402658 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:35:04.402658 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:35:04.402658 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:35:04.402658 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 18:35:04.402658 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:35:04.402658 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:35:04.402658 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:35:04.402658 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:35:04.402658 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPHvuItqv5xcxbp_bqbjUggZhpUG53TiGDPrqjFiNZGHAMY6QdeICs1jR4QxEtGJ9kJciv8ws3outzNBgAd1ZiItYEkQ7c76M1xzjstLBOG0OAwb8aGthDLSqRW7T7V0wj50TxoUUgeNpSMbG6VscuaiI7GHr0fqlhRjDqzMaKz-IIxQ Oct 04 18:35:04.402658 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:35:04.402658 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:35:04.402658 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:35:04.402658 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:35:04.402658 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:35:04.402658 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:35:04.402658 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: e7adedcdb9c3485ea2738c00e25aa3fd Oct 04 18:35:04.402658 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-ServersOnMultiNodesTest-1469796738 Oct 04 18:35:04.402658 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 18:35:04.402658 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 18:35:04.402658 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/e7adedcdb9c3485ea2738c00e25aa3fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_e7adedcdb9c3485ea2738c00e25aa3fd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/e7adedcdb9c3485ea2738c00e25aa3fd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/e7adedcdb9c3485ea2738c00e25aa3fd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:35:04.402658 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-ServersOnMultiNodesTest-1469796738 Oct 04 18:35:04.402658 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: e7adedcdb9c3485ea2738c00e25aa3fd Oct 04 18:35:04.402658 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1469796738 Oct 04 18:35:04.402658 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-ServersOnMultiNodesTest-1469796738-project Oct 04 18:35:04.402658 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:35:04.402658 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:35:04.402658 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: a7db99f361654711bea7f1b2c404d312 Oct 04 18:35:04.402658 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-ServersOnMultiNodesTest-1469796738-project Oct 04 18:35:04.402658 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 18:35:04.402658 n-d-851028-13 devstack@n-api.service[123596]: exception: Instance 4311d976-991e-4ab1-9d5e-d654aa7d0b08 could not be found. Oct 04 18:35:04.402658 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': '4311d976-991e-4ab1-9d5e-d654aa7d0b08'} Oct 04 18:35:04.402658 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:35:04.402658 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:35:04.402658 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:35:04.402658 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:35:04.402658 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:35:04.402658 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:35:04.402658 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:35:04.402658 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:35:04.402658 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:35:04.402658 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:35:04.402658 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4311d976-991e-4ab1-9d5e-d654aa7d0b08 could not be found. Oct 04 18:35:04.402658 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:35:04.402658 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:35:04.402658 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:35:04.402658 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:35:04.402658 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:35:04.402658 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:35:04.402658 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:35:04.402658 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:35:04.402658 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:35:04.402658 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:35:04.402658 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:35:04.402658 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:35:04.402658 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:35:04.402658 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:35:04.402658 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:35:04.402658 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:35:04.402658 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4311d976-991e-4ab1-9d5e-d654aa7d0b08 could not be found. Oct 04 18:35:04.402658 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:35:04.402658 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:35:04.402658 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:35:04.407359 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:35:04.407359 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:35:04.407359 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:35:04.407359 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:35:04.407359 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:35:04.407359 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4311d976-991e-4ab1-9d5e-d654aa7d0b08 could not be found. Oct 04 18:35:04.407359 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:35:04.409818 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-93d29f1c-09b9-445a-a220-5ed170adc3c1 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Returning 404 to user: Instance 4311d976-991e-4ab1-9d5e-d654aa7d0b08 could not be found. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:35:04.412358 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-93d29f1c-09b9-445a-a220-5ed170adc3c1 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] 10.222.0.43 "GET /compute/v2.1/servers/4311d976-991e-4ab1-9d5e-d654aa7d0b08" status: 404 len: 111 microversion: 2.1 time: 0.074338 Oct 04 18:35:04.416221 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 586/1081] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:04 2022] GET /compute/v2.1/servers/4311d976-991e-4ab1-9d5e-d654aa7d0b08 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:35:04.422728 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f99186cb-7b43-4211-814e-99c8cdaac33f tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:04.423640 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-f99186cb-7b43-4211-814e-99c8cdaac33f tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] [instance: c4b812d5-f2ff-41c7-b912-3d19d752340b] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:04.430618 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f99186cb-7b43-4211-814e-99c8cdaac33f tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:04.431742 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f99186cb-7b43-4211-814e-99c8cdaac33f tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:04.432610 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f99186cb-7b43-4211-814e-99c8cdaac33f tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:04.433638 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f99186cb-7b43-4211-814e-99c8cdaac33f tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:04.434331 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f99186cb-7b43-4211-814e-99c8cdaac33f tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:04.435436 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f99186cb-7b43-4211-814e-99c8cdaac33f tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:04.476831 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f99186cb-7b43-4211-814e-99c8cdaac33f tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:04.477753 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f99186cb-7b43-4211-814e-99c8cdaac33f tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:04.478425 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f99186cb-7b43-4211-814e-99c8cdaac33f tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:04.479093 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.objects.instance [None req-f99186cb-7b43-4211-814e-99c8cdaac33f tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lazy-loading 'fault' on Instance uuid c4b812d5-f2ff-41c7-b912-3d19d752340b {{(pid=123596) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:35:04.567497 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-f99186cb-7b43-4211-814e-99c8cdaac33f tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7db99f361654711bea7f1b2c404d312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7adedcdb9c3485ea2738c00e25aa3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:04.582594 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-f99186cb-7b43-4211-814e-99c8cdaac33f tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] 10.222.0.43 "GET /compute/v2.1/servers/c4b812d5-f2ff-41c7-b912-3d19d752340b" status: 200 len: 1309 microversion: 2.1 time: 0.163736 Oct 04 18:35:04.586969 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 587/1082] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:04 2022] GET /compute/v2.1/servers/c4b812d5-f2ff-41c7-b912-3d19d752340b => generated 1309 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:04.670358 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-e7e66b21-f5ae-4b72-873b-424df5b939ff tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:04.685280 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-e7e66b21-f5ae-4b72-873b-424df5b939ff tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:04.687159 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-e7e66b21-f5ae-4b72-873b-424df5b939ff tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:04.697295 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-e7e66b21-f5ae-4b72-873b-424df5b939ff tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] 10.222.0.43 "GET /compute/v2.1/servers/7222a4ce-d2a2-4b09-afc6-55bca52414d4" status: 200 len: 1281 microversion: 2.25 time: 0.776207 Oct 04 18:35:04.698247 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 496/1083] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:35:03 2022] GET /compute/v2.1/servers/7222a4ce-d2a2-4b09-afc6-55bca52414d4 => generated 1281 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:35:04.957841 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-5b1102e6-d316-4500-80f6-0b0a37641f73 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:04.960928 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-5b1102e6-d316-4500-80f6-0b0a37641f73 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] [instance: 67e13bce-be81-4775-be5f-737add9f1694] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:04.976416 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5b1102e6-d316-4500-80f6-0b0a37641f73 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:04.981921 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5b1102e6-d316-4500-80f6-0b0a37641f73 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:04.984734 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5b1102e6-d316-4500-80f6-0b0a37641f73 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:04.986108 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5b1102e6-d316-4500-80f6-0b0a37641f73 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:04.988665 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5b1102e6-d316-4500-80f6-0b0a37641f73 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:04.990472 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5b1102e6-d316-4500-80f6-0b0a37641f73 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:05.023743 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=100 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:35:05.070903 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-56e3cec9-1da7-4c6a-9402-8d4caea98430 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:05.071595 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-56e3cec9-1da7-4c6a-9402-8d4caea98430 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] [instance: 93798a9a-d90d-4a4e-8e30-d6575486ff56] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:05.078121 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-56e3cec9-1da7-4c6a-9402-8d4caea98430 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:05.078601 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-56e3cec9-1da7-4c6a-9402-8d4caea98430 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:05.079036 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-56e3cec9-1da7-4c6a-9402-8d4caea98430 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:05.079740 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-56e3cec9-1da7-4c6a-9402-8d4caea98430 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:05.080229 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-56e3cec9-1da7-4c6a-9402-8d4caea98430 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:05.080671 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-56e3cec9-1da7-4c6a-9402-8d4caea98430 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:05.375330 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-5b1102e6-d316-4500-80f6-0b0a37641f73 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8b5e18327f4713a1e465acb9e863f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c849c5d04f44f7951908d740ec1689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:05.392181 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-56e3cec9-1da7-4c6a-9402-8d4caea98430 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a41ab6fb78a42ceaca621c5a38ffc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa31ed92017490a82497c7b8910aef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:05.395240 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-5b1102e6-d316-4500-80f6-0b0a37641f73 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d8b5e18327f4713a1e465acb9e863f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c849c5d04f44f7951908d740ec1689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:05.397126 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-5b1102e6-d316-4500-80f6-0b0a37641f73 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d8b5e18327f4713a1e465acb9e863f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c849c5d04f44f7951908d740ec1689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:05.407370 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-5b1102e6-d316-4500-80f6-0b0a37641f73 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] 10.222.0.43 "GET /compute/v2.1/servers/67e13bce-be81-4775-be5f-737add9f1694" status: 200 len: 1416 microversion: 2.75 time: 0.459655 Oct 04 18:35:05.409255 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 588/1084] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:35:04 2022] GET /compute/v2.1/servers/67e13bce-be81-4775-be5f-737add9f1694 => generated 1416 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:35:05.414858 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-56e3cec9-1da7-4c6a-9402-8d4caea98430 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] 10.222.0.43 "GET /compute/v2.1/servers/93798a9a-d90d-4a4e-8e30-d6575486ff56" status: 200 len: 1497 microversion: 2.1 time: 0.347747 Oct 04 18:35:05.415494 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-fc2a735f-41bd-4ee2-9f4d-4d4630dc4537 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:05.415921 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 497/1085] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:05 2022] GET /compute/v2.1/servers/93798a9a-d90d-4a4e-8e30-d6575486ff56 => generated 1497 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:05.416685 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-fc2a735f-41bd-4ee2-9f4d-4d4630dc4537 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] [instance: 84e0414b-a39f-4bfe-bc9d-c170ceb34d15] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:05.424492 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fc2a735f-41bd-4ee2-9f4d-4d4630dc4537 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:05.425386 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fc2a735f-41bd-4ee2-9f4d-4d4630dc4537 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:05.426134 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fc2a735f-41bd-4ee2-9f4d-4d4630dc4537 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:05.427049 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fc2a735f-41bd-4ee2-9f4d-4d4630dc4537 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:05.428484 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fc2a735f-41bd-4ee2-9f4d-4d4630dc4537 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:05.429170 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fc2a735f-41bd-4ee2-9f4d-4d4630dc4537 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:05.618560 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-bb94f421-a6a4-483b-a600-6af4c1bd7d04 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:05.619546 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-bb94f421-a6a4-483b-a600-6af4c1bd7d04 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] [instance: c4b812d5-f2ff-41c7-b912-3d19d752340b] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:05.633290 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bb94f421-a6a4-483b-a600-6af4c1bd7d04 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:05.634517 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bb94f421-a6a4-483b-a600-6af4c1bd7d04 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:05.636001 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bb94f421-a6a4-483b-a600-6af4c1bd7d04 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:05.637775 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bb94f421-a6a4-483b-a600-6af4c1bd7d04 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:05.638834 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bb94f421-a6a4-483b-a600-6af4c1bd7d04 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:05.639977 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bb94f421-a6a4-483b-a600-6af4c1bd7d04 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:05.690169 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-bb94f421-a6a4-483b-a600-6af4c1bd7d04 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] HTTP exception thrown: Instance c4b812d5-f2ff-41c7-b912-3d19d752340b could not be found. Oct 04 18:35:05.697448 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-bb94f421-a6a4-483b-a600-6af4c1bd7d04 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Request method failure captured: Oct 04 18:35:05.697448 n-d-851028-13 devstack@n-api.service[123595]: request: GET /compute/v2.1/servers/c4b812d5-f2ff-41c7-b912-3d19d752340b HTTP/1.1 Oct 04 18:35:05.697448 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 18:35:05.697448 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 18:35:05.697448 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 18:35:05.697448 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 0 Oct 04 18:35:05.697448 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 18:35:05.697448 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 18:35:05.697448 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 18:35:05.697448 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 18:35:05.697448 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPHvuItqv5xcxbp_bqbjUggZhpUG53TiGDPrqjFiNZGHAMY6QdeICs1jR4QxEtGJ9kJciv8ws3outzNBgAd1ZiItYEkQ7c76M1xzjstLBOG0OAwb8aGthDLSqRW7T7V0wj50TxoUUgeNpSMbG6VscuaiI7GHr0fqlhRjDqzMaKz-IIxQ Oct 04 18:35:05.697448 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 18:35:05.697448 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 18:35:05.697448 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 18:35:05.697448 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 18:35:05.697448 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 18:35:05.697448 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 18:35:05.697448 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: e7adedcdb9c3485ea2738c00e25aa3fd Oct 04 18:35:05.697448 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-ServersOnMultiNodesTest-1469796738 Oct 04 18:35:05.697448 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 18:35:05.697448 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 18:35:05.697448 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/e7adedcdb9c3485ea2738c00e25aa3fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_e7adedcdb9c3485ea2738c00e25aa3fd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/e7adedcdb9c3485ea2738c00e25aa3fd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/e7adedcdb9c3485ea2738c00e25aa3fd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:35:05.697448 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-ServersOnMultiNodesTest-1469796738 Oct 04 18:35:05.697448 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: e7adedcdb9c3485ea2738c00e25aa3fd Oct 04 18:35:05.697448 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1469796738 Oct 04 18:35:05.697448 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-ServersOnMultiNodesTest-1469796738-project Oct 04 18:35:05.697448 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 18:35:05.697448 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 18:35:05.697448 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: a7db99f361654711bea7f1b2c404d312 Oct 04 18:35:05.697448 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-ServersOnMultiNodesTest-1469796738-project Oct 04 18:35:05.697448 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 18:35:05.697448 n-d-851028-13 devstack@n-api.service[123595]: exception: Instance c4b812d5-f2ff-41c7-b912-3d19d752340b could not be found. Oct 04 18:35:05.697448 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': 'c4b812d5-f2ff-41c7-b912-3d19d752340b'} Oct 04 18:35:05.697448 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:35:05.697448 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:35:05.697448 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:35:05.697448 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:35:05.697448 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:35:05.697448 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:35:05.697448 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:35:05.697448 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:35:05.697448 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:35:05.697448 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:35:05.697448 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c4b812d5-f2ff-41c7-b912-3d19d752340b could not be found. Oct 04 18:35:05.697448 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:35:05.697448 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:35:05.697448 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:35:05.697448 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:35:05.697448 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:35:05.697448 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:35:05.697448 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:35:05.697448 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:35:05.697448 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:35:05.697448 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:35:05.697448 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:35:05.697448 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:35:05.697448 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:35:05.697448 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:35:05.697448 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:35:05.697448 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:35:05.697448 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4b812d5-f2ff-41c7-b912-3d19d752340b could not be found. Oct 04 18:35:05.697448 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:35:05.697448 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:35:05.697448 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:35:05.707816 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:35:05.707816 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:35:05.707816 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:35:05.707816 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:35:05.707816 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:35:05.707816 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4b812d5-f2ff-41c7-b912-3d19d752340b could not be found. Oct 04 18:35:05.707816 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:35:05.709710 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-fc2a735f-41bd-4ee2-9f4d-4d4630dc4537 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:05.710641 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-bb94f421-a6a4-483b-a600-6af4c1bd7d04 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Returning 404 to user: Instance c4b812d5-f2ff-41c7-b912-3d19d752340b could not be found. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:35:05.712556 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-bb94f421-a6a4-483b-a600-6af4c1bd7d04 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] 10.222.0.43 "GET /compute/v2.1/servers/c4b812d5-f2ff-41c7-b912-3d19d752340b" status: 404 len: 111 microversion: 2.1 time: 0.101991 Oct 04 18:35:05.714369 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 498/1086] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:05 2022] GET /compute/v2.1/servers/c4b812d5-f2ff-41c7-b912-3d19d752340b => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:35:05.723594 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-fc2a735f-41bd-4ee2-9f4d-4d4630dc4537 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:05.726602 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-7c26f1ad-e104-490d-81f5-a9d33cd1b63d tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:05.729336 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-fc2a735f-41bd-4ee2-9f4d-4d4630dc4537 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:05.756251 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-fc2a735f-41bd-4ee2-9f4d-4d4630dc4537 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] 10.222.0.43 "GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15" status: 200 len: 1537 microversion: 2.91 time: 0.342605 Oct 04 18:35:05.760408 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 589/1087] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:35:05 2022] GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15 => generated 1537 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:35:05.765596 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-7c26f1ad-e104-490d-81f5-a9d33cd1b63d tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] 10.222.0.43 "DELETE /compute/v2.1/os-server-groups/2e541515-72cb-4ea1-b049-ec95de4faec4" status: 204 len: 0 microversion: 2.1 time: 0.043754 Oct 04 18:35:05.766690 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 499/1088] 10.222.0.43 () {58 vars in 1266 bytes} [Tue Oct 4 18:35:05 2022] DELETE /compute/v2.1/os-server-groups/2e541515-72cb-4ea1-b049-ec95de4faec4 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:35:05.783238 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-a73999f3-5098-4288-b6ca-f71ae2939980 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:05.784029 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-a73999f3-5098-4288-b6ca-f71ae2939980 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] [instance: b36499e0-9405-4153-a581-13c1bd9d43eb] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:05.789416 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-32a9767d-7126-45f2-bd79-c82dfdb6efb0 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:05.790036 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-32a9767d-7126-45f2-bd79-c82dfdb6efb0 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] [instance: 7222a4ce-d2a2-4b09-afc6-55bca52414d4] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:05.792764 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a73999f3-5098-4288-b6ca-f71ae2939980 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:05.794104 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a73999f3-5098-4288-b6ca-f71ae2939980 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:05.794754 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a73999f3-5098-4288-b6ca-f71ae2939980 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:05.795662 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a73999f3-5098-4288-b6ca-f71ae2939980 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:05.796319 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a73999f3-5098-4288-b6ca-f71ae2939980 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:05.796930 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a73999f3-5098-4288-b6ca-f71ae2939980 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:05.818605 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-32a9767d-7126-45f2-bd79-c82dfdb6efb0 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:05.819019 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-32a9767d-7126-45f2-bd79-c82dfdb6efb0 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:05.820757 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-32a9767d-7126-45f2-bd79-c82dfdb6efb0 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:05.822969 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-32a9767d-7126-45f2-bd79-c82dfdb6efb0 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:05.825207 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-32a9767d-7126-45f2-bd79-c82dfdb6efb0 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:05.825673 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-32a9767d-7126-45f2-bd79-c82dfdb6efb0 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:05.833390 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-a73999f3-5098-4288-b6ca-f71ae2939980 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] [instance: b36499e0-9405-4153-a581-13c1bd9d43eb] Going to try to terminate instance {{(pid=123595) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:35:06.030227 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-a73999f3-5098-4288-b6ca-f71ae2939980 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] 10.222.0.43 "DELETE /compute/v2.1/servers/b36499e0-9405-4153-a581-13c1bd9d43eb" status: 204 len: 0 microversion: 2.1 time: 0.258296 Oct 04 18:35:06.034190 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 500/1089] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 18:35:05 2022] DELETE /compute/v2.1/servers/b36499e0-9405-4153-a581-13c1bd9d43eb => generated 0 bytes in 261 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:35:06.037639 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-32a9767d-7126-45f2-bd79-c82dfdb6efb0 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:06.059317 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-32a9767d-7126-45f2-bd79-c82dfdb6efb0 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:06.061299 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-b336b411-734c-4aeb-8485-2db946e76d3d tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:06.061953 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-32a9767d-7126-45f2-bd79-c82dfdb6efb0 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:06.063407 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-b336b411-734c-4aeb-8485-2db946e76d3d tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] [instance: b36499e0-9405-4153-a581-13c1bd9d43eb] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:06.064360 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-32a9767d-7126-45f2-bd79-c82dfdb6efb0 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] 10.222.0.43 "GET /compute/v2.1/servers/7222a4ce-d2a2-4b09-afc6-55bca52414d4" status: 200 len: 1337 microversion: 2.25 time: 0.302668 Oct 04 18:35:06.065529 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 590/1090] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:35:05 2022] GET /compute/v2.1/servers/7222a4ce-d2a2-4b09-afc6-55bca52414d4 => generated 1337 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:35:06.073838 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b336b411-734c-4aeb-8485-2db946e76d3d tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:06.074664 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b336b411-734c-4aeb-8485-2db946e76d3d tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:06.085700 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b336b411-734c-4aeb-8485-2db946e76d3d tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:06.086686 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b336b411-734c-4aeb-8485-2db946e76d3d tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:06.087263 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b336b411-734c-4aeb-8485-2db946e76d3d tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:06.087854 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b336b411-734c-4aeb-8485-2db946e76d3d tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:06.308920 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-b336b411-734c-4aeb-8485-2db946e76d3d tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7db99f361654711bea7f1b2c404d312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7adedcdb9c3485ea2738c00e25aa3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:06.318938 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-b336b411-734c-4aeb-8485-2db946e76d3d tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] 10.222.0.43 "GET /compute/v2.1/servers/b36499e0-9405-4153-a581-13c1bd9d43eb" status: 200 len: 1473 microversion: 2.1 time: 0.270144 Oct 04 18:35:06.320780 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 501/1091] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:06 2022] GET /compute/v2.1/servers/b36499e0-9405-4153-a581-13c1bd9d43eb => generated 1473 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:06.446221 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-c21b29d9-803b-4fc8-b923-44fa4437e892 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:06.447205 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-c21b29d9-803b-4fc8-b923-44fa4437e892 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] [instance: 93798a9a-d90d-4a4e-8e30-d6575486ff56] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:06.458193 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c21b29d9-803b-4fc8-b923-44fa4437e892 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:06.458915 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c21b29d9-803b-4fc8-b923-44fa4437e892 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:06.459474 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c21b29d9-803b-4fc8-b923-44fa4437e892 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:06.463151 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c21b29d9-803b-4fc8-b923-44fa4437e892 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:06.465977 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c21b29d9-803b-4fc8-b923-44fa4437e892 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:06.466729 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c21b29d9-803b-4fc8-b923-44fa4437e892 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:06.469381 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-3e39e9e0-38d1-4bcb-85d9-4b72a51ff71d tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:06.470214 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-3e39e9e0-38d1-4bcb-85d9-4b72a51ff71d tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] [instance: 67e13bce-be81-4775-be5f-737add9f1694] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:06.490860 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3e39e9e0-38d1-4bcb-85d9-4b72a51ff71d tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:06.491368 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3e39e9e0-38d1-4bcb-85d9-4b72a51ff71d tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:06.491821 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3e39e9e0-38d1-4bcb-85d9-4b72a51ff71d tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:06.492557 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3e39e9e0-38d1-4bcb-85d9-4b72a51ff71d tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:06.493022 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3e39e9e0-38d1-4bcb-85d9-4b72a51ff71d tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:06.493489 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3e39e9e0-38d1-4bcb-85d9-4b72a51ff71d tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:06.670399 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-3e39e9e0-38d1-4bcb-85d9-4b72a51ff71d tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8b5e18327f4713a1e465acb9e863f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c849c5d04f44f7951908d740ec1689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:06.684975 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-3e39e9e0-38d1-4bcb-85d9-4b72a51ff71d tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d8b5e18327f4713a1e465acb9e863f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c849c5d04f44f7951908d740ec1689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:06.695670 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-3e39e9e0-38d1-4bcb-85d9-4b72a51ff71d tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d8b5e18327f4713a1e465acb9e863f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c849c5d04f44f7951908d740ec1689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:06.709206 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-3e39e9e0-38d1-4bcb-85d9-4b72a51ff71d tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] 10.222.0.43 "GET /compute/v2.1/servers/67e13bce-be81-4775-be5f-737add9f1694" status: 200 len: 1437 microversion: 2.75 time: 0.242886 Oct 04 18:35:06.709830 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 502/1092] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:35:06 2022] GET /compute/v2.1/servers/67e13bce-be81-4775-be5f-737add9f1694 => generated 1437 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:35:06.737934 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-c21b29d9-803b-4fc8-b923-44fa4437e892 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a41ab6fb78a42ceaca621c5a38ffc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa31ed92017490a82497c7b8910aef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:06.744161 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-1b5495c0-fb4b-4b18-8337-2dfd63168d01 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243"}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:35:06.747026 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-1b5495c0-fb4b-4b18-8337-2dfd63168d01 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] [instance: 67e13bce-be81-4775-be5f-737add9f1694] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:06.766871 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-c21b29d9-803b-4fc8-b923-44fa4437e892 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] 10.222.0.43 "GET /compute/v2.1/servers/93798a9a-d90d-4a4e-8e30-d6575486ff56" status: 200 len: 1497 microversion: 2.1 time: 0.320564 Oct 04 18:35:06.770839 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 591/1093] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:06 2022] GET /compute/v2.1/servers/93798a9a-d90d-4a4e-8e30-d6575486ff56 => generated 1497 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:06.772884 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1b5495c0-fb4b-4b18-8337-2dfd63168d01 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:06.773594 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1b5495c0-fb4b-4b18-8337-2dfd63168d01 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:06.774198 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1b5495c0-fb4b-4b18-8337-2dfd63168d01 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:06.775127 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1b5495c0-fb4b-4b18-8337-2dfd63168d01 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:06.775864 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1b5495c0-fb4b-4b18-8337-2dfd63168d01 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:06.776459 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1b5495c0-fb4b-4b18-8337-2dfd63168d01 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:06.794170 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-10ffdfe6-3bb8-4236-b9f3-395b770865f9 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:06.796838 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-10ffdfe6-3bb8-4236-b9f3-395b770865f9 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] [instance: 84e0414b-a39f-4bfe-bc9d-c170ceb34d15] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:06.804801 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-10ffdfe6-3bb8-4236-b9f3-395b770865f9 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:06.805813 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-10ffdfe6-3bb8-4236-b9f3-395b770865f9 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:06.806476 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-10ffdfe6-3bb8-4236-b9f3-395b770865f9 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:06.807386 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-10ffdfe6-3bb8-4236-b9f3-395b770865f9 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:06.808135 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-10ffdfe6-3bb8-4236-b9f3-395b770865f9 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:06.808859 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-10ffdfe6-3bb8-4236-b9f3-395b770865f9 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:06.908396 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-1b5495c0-fb4b-4b18-8337-2dfd63168d01 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Flavor limits 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:35:06.908816 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-1b5495c0-fb4b-4b18-8337-2dfd63168d01 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Image limits 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:35:06.909491 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-1b5495c0-fb4b-4b18-8337-2dfd63168d01 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Flavor pref 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:35:06.910050 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-1b5495c0-fb4b-4b18-8337-2dfd63168d01 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Image pref 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:35:06.910627 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-1b5495c0-fb4b-4b18-8337-2dfd63168d01 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:35:06.940660 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-10ffdfe6-3bb8-4236-b9f3-395b770865f9 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:06.956898 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-10ffdfe6-3bb8-4236-b9f3-395b770865f9 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:06.962331 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-10ffdfe6-3bb8-4236-b9f3-395b770865f9 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:06.976072 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-10ffdfe6-3bb8-4236-b9f3-395b770865f9 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] 10.222.0.43 "GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15" status: 200 len: 1558 microversion: 2.91 time: 0.187280 Oct 04 18:35:07.001796 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 592/1094] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:35:06 2022] GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15 => generated 1558 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:35:07.051537 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-1b5495c0-fb4b-4b18-8337-2dfd63168d01 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] [instance: 67e13bce-be81-4775-be5f-737add9f1694] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:07.063542 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1b5495c0-fb4b-4b18-8337-2dfd63168d01 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:07.068749 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1b5495c0-fb4b-4b18-8337-2dfd63168d01 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:07.071326 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1b5495c0-fb4b-4b18-8337-2dfd63168d01 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:07.073342 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1b5495c0-fb4b-4b18-8337-2dfd63168d01 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:07.075288 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1b5495c0-fb4b-4b18-8337-2dfd63168d01 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:07.075915 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1b5495c0-fb4b-4b18-8337-2dfd63168d01 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:07.096468 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-b229ad10-1dc0-446d-9d47-532157f627e3 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:07.097397 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-b229ad10-1dc0-446d-9d47-532157f627e3 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] [instance: 7222a4ce-d2a2-4b09-afc6-55bca52414d4] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:07.110210 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b229ad10-1dc0-446d-9d47-532157f627e3 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:07.113359 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b229ad10-1dc0-446d-9d47-532157f627e3 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:07.114065 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b229ad10-1dc0-446d-9d47-532157f627e3 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:07.117027 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b229ad10-1dc0-446d-9d47-532157f627e3 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:07.118738 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b229ad10-1dc0-446d-9d47-532157f627e3 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:07.121019 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b229ad10-1dc0-446d-9d47-532157f627e3 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:07.239266 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-1b5495c0-fb4b-4b18-8337-2dfd63168d01 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8b5e18327f4713a1e465acb9e863f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c849c5d04f44f7951908d740ec1689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:07.274947 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-1b5495c0-fb4b-4b18-8337-2dfd63168d01 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d8b5e18327f4713a1e465acb9e863f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c849c5d04f44f7951908d740ec1689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:07.279533 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-1b5495c0-fb4b-4b18-8337-2dfd63168d01 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d8b5e18327f4713a1e465acb9e863f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c849c5d04f44f7951908d740ec1689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:07.293324 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-1b5495c0-fb4b-4b18-8337-2dfd63168d01 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] 10.222.0.43 "POST /compute/v2.1/servers/67e13bce-be81-4775-be5f-737add9f1694/action" status: 202 len: 1494 microversion: 2.75 time: 0.553809 Oct 04 18:35:07.294408 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 503/1095] 10.222.0.43 () {62 vars in 1319 bytes} [Tue Oct 4 18:35:06 2022] POST /compute/v2.1/servers/67e13bce-be81-4775-be5f-737add9f1694/action => generated 1494 bytes in 555 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 04 18:35:07.308955 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-b229ad10-1dc0-446d-9d47-532157f627e3 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:07.336919 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-b229ad10-1dc0-446d-9d47-532157f627e3 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:07.338753 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-6db7496b-7389-441f-97b7-fe3187319bbc tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:07.338970 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-b229ad10-1dc0-446d-9d47-532157f627e3 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:07.339785 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-6db7496b-7389-441f-97b7-fe3187319bbc tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] [instance: 67e13bce-be81-4775-be5f-737add9f1694] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:07.340288 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-b229ad10-1dc0-446d-9d47-532157f627e3 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] 10.222.0.43 "GET /compute/v2.1/servers/7222a4ce-d2a2-4b09-afc6-55bca52414d4" status: 200 len: 1337 microversion: 2.25 time: 0.249433 Oct 04 18:35:07.345369 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 593/1096] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:35:07 2022] GET /compute/v2.1/servers/7222a4ce-d2a2-4b09-afc6-55bca52414d4 => generated 1337 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:35:07.358431 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-dca5def6-7951-40c3-b0c4-c7c2969585b0 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:07.359370 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-dca5def6-7951-40c3-b0c4-c7c2969585b0 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] [instance: b36499e0-9405-4153-a581-13c1bd9d43eb] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:07.367003 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6db7496b-7389-441f-97b7-fe3187319bbc tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:07.367370 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dca5def6-7951-40c3-b0c4-c7c2969585b0 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:07.367879 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dca5def6-7951-40c3-b0c4-c7c2969585b0 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:07.368287 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6db7496b-7389-441f-97b7-fe3187319bbc tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:07.368402 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dca5def6-7951-40c3-b0c4-c7c2969585b0 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:07.369024 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dca5def6-7951-40c3-b0c4-c7c2969585b0 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:07.369267 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6db7496b-7389-441f-97b7-fe3187319bbc tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:07.370188 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6db7496b-7389-441f-97b7-fe3187319bbc tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:07.370846 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6db7496b-7389-441f-97b7-fe3187319bbc tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:07.371495 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6db7496b-7389-441f-97b7-fe3187319bbc tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:07.378533 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dca5def6-7951-40c3-b0c4-c7c2969585b0 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:07.379017 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dca5def6-7951-40c3-b0c4-c7c2969585b0 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:07.486823 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-6db7496b-7389-441f-97b7-fe3187319bbc tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8b5e18327f4713a1e465acb9e863f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c849c5d04f44f7951908d740ec1689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:07.498665 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-6db7496b-7389-441f-97b7-fe3187319bbc tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d8b5e18327f4713a1e465acb9e863f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c849c5d04f44f7951908d740ec1689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:07.503053 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-6db7496b-7389-441f-97b7-fe3187319bbc tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d8b5e18327f4713a1e465acb9e863f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c849c5d04f44f7951908d740ec1689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:07.521289 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-6db7496b-7389-441f-97b7-fe3187319bbc tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] 10.222.0.43 "GET /compute/v2.1/servers/67e13bce-be81-4775-be5f-737add9f1694" status: 200 len: 1446 microversion: 2.75 time: 0.187681 Oct 04 18:35:07.522182 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 504/1097] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:35:07 2022] GET /compute/v2.1/servers/67e13bce-be81-4775-be5f-737add9f1694 => generated 1446 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:35:07.752197 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-dca5def6-7951-40c3-b0c4-c7c2969585b0 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7db99f361654711bea7f1b2c404d312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7adedcdb9c3485ea2738c00e25aa3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:07.766513 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-dca5def6-7951-40c3-b0c4-c7c2969585b0 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] 10.222.0.43 "GET /compute/v2.1/servers/b36499e0-9405-4153-a581-13c1bd9d43eb" status: 200 len: 1473 microversion: 2.1 time: 0.413752 Oct 04 18:35:07.767539 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 594/1098] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:07 2022] GET /compute/v2.1/servers/b36499e0-9405-4153-a581-13c1bd9d43eb => generated 1473 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:07.808915 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-4cbdcada-5154-43ef-aa6d-fa8e311e57a0 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:07.810007 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-4cbdcada-5154-43ef-aa6d-fa8e311e57a0 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] [instance: 93798a9a-d90d-4a4e-8e30-d6575486ff56] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:07.841487 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4cbdcada-5154-43ef-aa6d-fa8e311e57a0 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:07.842377 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4cbdcada-5154-43ef-aa6d-fa8e311e57a0 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:07.843482 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4cbdcada-5154-43ef-aa6d-fa8e311e57a0 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:07.844347 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4cbdcada-5154-43ef-aa6d-fa8e311e57a0 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:07.844916 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4cbdcada-5154-43ef-aa6d-fa8e311e57a0 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:07.845491 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4cbdcada-5154-43ef-aa6d-fa8e311e57a0 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:08.015906 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f4b0aade-235f-4bfa-b5e0-a40ac4b59331 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:08.016848 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-f4b0aade-235f-4bfa-b5e0-a40ac4b59331 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] [instance: 84e0414b-a39f-4bfe-bc9d-c170ceb34d15] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:08.043093 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f4b0aade-235f-4bfa-b5e0-a40ac4b59331 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:08.043648 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f4b0aade-235f-4bfa-b5e0-a40ac4b59331 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:08.044101 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f4b0aade-235f-4bfa-b5e0-a40ac4b59331 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:08.044844 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f4b0aade-235f-4bfa-b5e0-a40ac4b59331 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:08.045370 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f4b0aade-235f-4bfa-b5e0-a40ac4b59331 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:08.046035 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f4b0aade-235f-4bfa-b5e0-a40ac4b59331 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:08.230404 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-4cbdcada-5154-43ef-aa6d-fa8e311e57a0 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a41ab6fb78a42ceaca621c5a38ffc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa31ed92017490a82497c7b8910aef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:08.240510 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-4cbdcada-5154-43ef-aa6d-fa8e311e57a0 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] 10.222.0.43 "GET /compute/v2.1/servers/93798a9a-d90d-4a4e-8e30-d6575486ff56" status: 200 len: 1497 microversion: 2.1 time: 0.451051 Oct 04 18:35:08.255546 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 505/1099] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:07 2022] GET /compute/v2.1/servers/93798a9a-d90d-4a4e-8e30-d6575486ff56 => generated 1497 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:08.320081 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-f4b0aade-235f-4bfa-b5e0-a40ac4b59331 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:08.333079 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-f4b0aade-235f-4bfa-b5e0-a40ac4b59331 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:08.335193 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-f4b0aade-235f-4bfa-b5e0-a40ac4b59331 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:08.344193 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-f4b0aade-235f-4bfa-b5e0-a40ac4b59331 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] 10.222.0.43 "GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15" status: 200 len: 1553 microversion: 2.91 time: 0.333426 Oct 04 18:35:08.346332 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 595/1100] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:35:08 2022] GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15 => generated 1553 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:35:08.372735 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-502b4795-164e-40c0-a9f9-130fa9eaf136 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:08.373427 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-502b4795-164e-40c0-a9f9-130fa9eaf136 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] [instance: 7222a4ce-d2a2-4b09-afc6-55bca52414d4] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:08.386839 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-502b4795-164e-40c0-a9f9-130fa9eaf136 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:08.387722 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-502b4795-164e-40c0-a9f9-130fa9eaf136 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:08.388395 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-502b4795-164e-40c0-a9f9-130fa9eaf136 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:08.391109 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-502b4795-164e-40c0-a9f9-130fa9eaf136 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:08.392511 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-502b4795-164e-40c0-a9f9-130fa9eaf136 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:08.393251 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-502b4795-164e-40c0-a9f9-130fa9eaf136 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:08.715168 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-502b4795-164e-40c0-a9f9-130fa9eaf136 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:08.743450 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-502b4795-164e-40c0-a9f9-130fa9eaf136 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:08.760062 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-502b4795-164e-40c0-a9f9-130fa9eaf136 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:08.768077 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-502b4795-164e-40c0-a9f9-130fa9eaf136 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] 10.222.0.43 "GET /compute/v2.1/servers/7222a4ce-d2a2-4b09-afc6-55bca52414d4" status: 200 len: 1337 microversion: 2.25 time: 0.396553 Oct 04 18:35:08.771520 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 506/1101] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:35:08 2022] GET /compute/v2.1/servers/7222a4ce-d2a2-4b09-afc6-55bca52414d4 => generated 1337 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:35:08.776600 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-f63bc5ee-6b4f-4ae0-acd1-c411872db441 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:08.799521 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-ab45bb8b-2977-4baf-bfad-187b843a8293 tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] Action: 'create', calling method: .version_select at 0x7fb227e7eaf0>, body: {"keypair": {"name": "tempest-keypair-1930838380", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBHi/CyFG/+z8XLfr9ec0vcyLYHOuYpuWlEwuSm4pyDK5G1lImQtiYihoGeh0dSWTf7atGLHP0i5qIMPCH4SMw6r2dZ+h8/60hknz0KUGoMyKHny40ovWKPKA04fQDQRhw=="}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:35:08.802102 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-f63bc5ee-6b4f-4ae0-acd1-c411872db441 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] [instance: 67e13bce-be81-4775-be5f-737add9f1694] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:08.827642 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f63bc5ee-6b4f-4ae0-acd1-c411872db441 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:08.828295 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f63bc5ee-6b4f-4ae0-acd1-c411872db441 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:08.835809 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f63bc5ee-6b4f-4ae0-acd1-c411872db441 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:08.838087 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f63bc5ee-6b4f-4ae0-acd1-c411872db441 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:08.844615 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f63bc5ee-6b4f-4ae0-acd1-c411872db441 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:08.846381 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f63bc5ee-6b4f-4ae0-acd1-c411872db441 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:08.847653 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-ab45bb8b-2977-4baf-bfad-187b843a8293 tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] Getting quotas for project bdc10a840253410ab9404ff4906eebc8. Resources: {'key_pairs'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:35:08.865252 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-ab45bb8b-2977-4baf-bfad-187b843a8293 tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] Getting quotas for user cf77a83227f0404da7792695463b6714 and project bdc10a840253410ab9404ff4906eebc8. Resources: {'key_pairs'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:35:08.931206 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-ab45bb8b-2977-4baf-bfad-187b843a8293 tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.451837 Oct 04 18:35:08.939112 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 596/1102] 10.222.0.43 () {60 vars in 1159 bytes} [Tue Oct 4 18:35:08 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:35:08.946541 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-d140304c-09ba-4f28-b25d-4c133bb8834c tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:08.950249 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-d140304c-09ba-4f28-b25d-4c133bb8834c tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] [instance: b36499e0-9405-4153-a581-13c1bd9d43eb] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:08.966026 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d140304c-09ba-4f28-b25d-4c133bb8834c tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:08.966807 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d140304c-09ba-4f28-b25d-4c133bb8834c tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:08.967595 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d140304c-09ba-4f28-b25d-4c133bb8834c tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:08.970300 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d140304c-09ba-4f28-b25d-4c133bb8834c tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:08.971080 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d140304c-09ba-4f28-b25d-4c133bb8834c tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:08.972575 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d140304c-09ba-4f28-b25d-4c133bb8834c tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:09.116267 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-f63bc5ee-6b4f-4ae0-acd1-c411872db441 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8b5e18327f4713a1e465acb9e863f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c849c5d04f44f7951908d740ec1689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:09.130317 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-f63bc5ee-6b4f-4ae0-acd1-c411872db441 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d8b5e18327f4713a1e465acb9e863f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c849c5d04f44f7951908d740ec1689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:09.131898 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-f63bc5ee-6b4f-4ae0-acd1-c411872db441 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d8b5e18327f4713a1e465acb9e863f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c849c5d04f44f7951908d740ec1689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:09.145565 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-f63bc5ee-6b4f-4ae0-acd1-c411872db441 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] 10.222.0.43 "GET /compute/v2.1/servers/67e13bce-be81-4775-be5f-737add9f1694" status: 200 len: 1446 microversion: 2.75 time: 0.372555 Oct 04 18:35:09.146549 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 507/1103] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:35:08 2022] GET /compute/v2.1/servers/67e13bce-be81-4775-be5f-737add9f1694 => generated 1446 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:35:09.266896 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-05f757f6-ba24-449f-a17d-5f8af526606c tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:09.267722 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-05f757f6-ba24-449f-a17d-5f8af526606c tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] [instance: 93798a9a-d90d-4a4e-8e30-d6575486ff56] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:09.277314 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-05f757f6-ba24-449f-a17d-5f8af526606c tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:09.277816 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-05f757f6-ba24-449f-a17d-5f8af526606c tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:09.287392 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-05f757f6-ba24-449f-a17d-5f8af526606c tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:09.289062 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-05f757f6-ba24-449f-a17d-5f8af526606c tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:09.290182 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-05f757f6-ba24-449f-a17d-5f8af526606c tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:09.291001 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-05f757f6-ba24-449f-a17d-5f8af526606c tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:09.624047 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=2 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:35:10.111919 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-d140304c-09ba-4f28-b25d-4c133bb8834c tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7db99f361654711bea7f1b2c404d312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7adedcdb9c3485ea2738c00e25aa3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:10.139501 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-d140304c-09ba-4f28-b25d-4c133bb8834c tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] 10.222.0.43 "GET /compute/v2.1/servers/b36499e0-9405-4153-a581-13c1bd9d43eb" status: 200 len: 1473 microversion: 2.1 time: 1.198456 Oct 04 18:35:10.140776 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 597/1104] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:08 2022] GET /compute/v2.1/servers/b36499e0-9405-4153-a581-13c1bd9d43eb => generated 1473 bytes in 1201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:10.159938 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-403ac411-387a-4621-af4a-b35424439985 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:10.160809 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-403ac411-387a-4621-af4a-b35424439985 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] [instance: 84e0414b-a39f-4bfe-bc9d-c170ceb34d15] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:10.205262 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-403ac411-387a-4621-af4a-b35424439985 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:10.215728 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-403ac411-387a-4621-af4a-b35424439985 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:10.218220 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-403ac411-387a-4621-af4a-b35424439985 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:10.219183 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-403ac411-387a-4621-af4a-b35424439985 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:10.219821 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-403ac411-387a-4621-af4a-b35424439985 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:10.220483 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-403ac411-387a-4621-af4a-b35424439985 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:10.490687 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-05f757f6-ba24-449f-a17d-5f8af526606c tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a41ab6fb78a42ceaca621c5a38ffc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa31ed92017490a82497c7b8910aef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:10.509556 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-05f757f6-ba24-449f-a17d-5f8af526606c tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] 10.222.0.43 "GET /compute/v2.1/servers/93798a9a-d90d-4a4e-8e30-d6575486ff56" status: 200 len: 1497 microversion: 2.1 time: 1.245580 Oct 04 18:35:10.512369 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 508/1105] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:09 2022] GET /compute/v2.1/servers/93798a9a-d90d-4a4e-8e30-d6575486ff56 => generated 1497 bytes in 1251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:35:10.518874 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-ed0bfb0d-d8af-43ef-b67a-c41a09f7d434 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:10.519836 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-ed0bfb0d-d8af-43ef-b67a-c41a09f7d434 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] [instance: 7222a4ce-d2a2-4b09-afc6-55bca52414d4] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:10.526768 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-403ac411-387a-4621-af4a-b35424439985 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:10.529894 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ed0bfb0d-d8af-43ef-b67a-c41a09f7d434 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:10.533694 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ed0bfb0d-d8af-43ef-b67a-c41a09f7d434 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:10.535658 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ed0bfb0d-d8af-43ef-b67a-c41a09f7d434 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:10.538295 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ed0bfb0d-d8af-43ef-b67a-c41a09f7d434 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:10.540443 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ed0bfb0d-d8af-43ef-b67a-c41a09f7d434 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:10.542074 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ed0bfb0d-d8af-43ef-b67a-c41a09f7d434 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:10.542769 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-403ac411-387a-4621-af4a-b35424439985 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:10.544237 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-403ac411-387a-4621-af4a-b35424439985 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:10.580040 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:35:10.593316 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-403ac411-387a-4621-af4a-b35424439985 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] 10.222.0.43 "GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15" status: 200 len: 1553 microversion: 2.91 time: 0.448332 Oct 04 18:35:10.593316 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 598/1106] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:35:10 2022] GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15 => generated 1553 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:35:10.609539 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-3af3bfc5-d872-4873-95c2-f42bc56ecf94 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:10.610157 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-3af3bfc5-d872-4873-95c2-f42bc56ecf94 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] [instance: 67e13bce-be81-4775-be5f-737add9f1694] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:10.633682 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3af3bfc5-d872-4873-95c2-f42bc56ecf94 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:10.634193 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3af3bfc5-d872-4873-95c2-f42bc56ecf94 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:10.634642 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3af3bfc5-d872-4873-95c2-f42bc56ecf94 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:10.635361 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3af3bfc5-d872-4873-95c2-f42bc56ecf94 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:10.635814 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3af3bfc5-d872-4873-95c2-f42bc56ecf94 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:10.636244 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3af3bfc5-d872-4873-95c2-f42bc56ecf94 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:10.851824 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=2 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:35:11.047169 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-3af3bfc5-d872-4873-95c2-f42bc56ecf94 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8b5e18327f4713a1e465acb9e863f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c849c5d04f44f7951908d740ec1689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:11.060299 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-3af3bfc5-d872-4873-95c2-f42bc56ecf94 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d8b5e18327f4713a1e465acb9e863f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c849c5d04f44f7951908d740ec1689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:11.066933 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-3af3bfc5-d872-4873-95c2-f42bc56ecf94 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d8b5e18327f4713a1e465acb9e863f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c849c5d04f44f7951908d740ec1689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:11.070189 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-ed0bfb0d-d8af-43ef-b67a-c41a09f7d434 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:11.081796 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-3af3bfc5-d872-4873-95c2-f42bc56ecf94 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] 10.222.0.43 "GET /compute/v2.1/servers/67e13bce-be81-4775-be5f-737add9f1694" status: 200 len: 1446 microversion: 2.75 time: 0.488115 Oct 04 18:35:11.097366 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-ed0bfb0d-d8af-43ef-b67a-c41a09f7d434 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:11.097579 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 599/1107] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:35:10 2022] GET /compute/v2.1/servers/67e13bce-be81-4775-be5f-737add9f1694 => generated 1446 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:35:11.097669 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-ed0bfb0d-d8af-43ef-b67a-c41a09f7d434 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:11.097669 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-ed0bfb0d-d8af-43ef-b67a-c41a09f7d434 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] 10.222.0.43 "GET /compute/v2.1/servers/7222a4ce-d2a2-4b09-afc6-55bca52414d4" status: 200 len: 1343 microversion: 2.25 time: 0.573327 Oct 04 18:35:11.097669 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 509/1108] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:35:10 2022] GET /compute/v2.1/servers/7222a4ce-d2a2-4b09-afc6-55bca52414d4 => generated 1343 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:35:11.146420 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-9455e3b7-3262-4016-bbe1-c966fa6e6969 req-6f98ceda-0494-4e51-8cf4-64c6f7b67a1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b36499e0-9405-4153-a581-13c1bd9d43eb", "name": "network-vif-deleted", "tag": "7e660be0-d7f2-4b01-9122-66b33a304293"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:35:11.168397 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-99e306d7-27dd-4bbf-8fbe-41467bec6ebb tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:11.169063 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-99e306d7-27dd-4bbf-8fbe-41467bec6ebb tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] [instance: b36499e0-9405-4153-a581-13c1bd9d43eb] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:11.188397 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-99e306d7-27dd-4bbf-8fbe-41467bec6ebb tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:11.188931 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-99e306d7-27dd-4bbf-8fbe-41467bec6ebb tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:11.189390 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-99e306d7-27dd-4bbf-8fbe-41467bec6ebb tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:11.190201 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-9455e3b7-3262-4016-bbe1-c966fa6e6969 req-6f98ceda-0494-4e51-8cf4-64c6f7b67a1e service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:11.190684 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-9455e3b7-3262-4016-bbe1-c966fa6e6969 req-6f98ceda-0494-4e51-8cf4-64c6f7b67a1e service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:11.191111 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-9455e3b7-3262-4016-bbe1-c966fa6e6969 req-6f98ceda-0494-4e51-8cf4-64c6f7b67a1e service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:11.195997 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-99e306d7-27dd-4bbf-8fbe-41467bec6ebb tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:11.197775 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-99e306d7-27dd-4bbf-8fbe-41467bec6ebb tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:11.198231 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-99e306d7-27dd-4bbf-8fbe-41467bec6ebb tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:11.242959 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-9455e3b7-3262-4016-bbe1-c966fa6e6969 req-6f98ceda-0494-4e51-8cf4-64c6f7b67a1e service nova] Creating event network-vif-deleted:7e660be0-d7f2-4b01-9122-66b33a304293 for instance b36499e0-9405-4153-a581-13c1bd9d43eb on n-h1-851028-13 Oct 04 18:35:11.259192 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-9455e3b7-3262-4016-bbe1-c966fa6e6969 req-6f98ceda-0494-4e51-8cf4-64c6f7b67a1e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117131 Oct 04 18:35:11.268800 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 600/1109] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:35:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:35:11.374783 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=12 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:35:11.438603 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-99e306d7-27dd-4bbf-8fbe-41467bec6ebb tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7db99f361654711bea7f1b2c404d312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7adedcdb9c3485ea2738c00e25aa3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:11.449725 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-99e306d7-27dd-4bbf-8fbe-41467bec6ebb tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] 10.222.0.43 "GET /compute/v2.1/servers/b36499e0-9405-4153-a581-13c1bd9d43eb" status: 200 len: 1302 microversion: 2.1 time: 0.285521 Oct 04 18:35:11.477438 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 510/1110] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:11 2022] GET /compute/v2.1/servers/b36499e0-9405-4153-a581-13c1bd9d43eb => generated 1302 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:35:11.540680 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-3ca5cf34-8347-44bf-9246-c4e7f26b1054 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:11.549326 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-3ca5cf34-8347-44bf-9246-c4e7f26b1054 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] [instance: 93798a9a-d90d-4a4e-8e30-d6575486ff56] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:11.566281 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3ca5cf34-8347-44bf-9246-c4e7f26b1054 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:11.567161 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3ca5cf34-8347-44bf-9246-c4e7f26b1054 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:11.567828 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3ca5cf34-8347-44bf-9246-c4e7f26b1054 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:11.575765 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3ca5cf34-8347-44bf-9246-c4e7f26b1054 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:11.584810 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3ca5cf34-8347-44bf-9246-c4e7f26b1054 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:11.585913 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3ca5cf34-8347-44bf-9246-c4e7f26b1054 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:11.623094 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-166ac31b-f0eb-4baf-8cd1-d5c078c976cb tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:11.623739 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-166ac31b-f0eb-4baf-8cd1-d5c078c976cb tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] [instance: 84e0414b-a39f-4bfe-bc9d-c170ceb34d15] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:11.650791 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-166ac31b-f0eb-4baf-8cd1-d5c078c976cb tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:11.654568 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-166ac31b-f0eb-4baf-8cd1-d5c078c976cb tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:11.657277 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-166ac31b-f0eb-4baf-8cd1-d5c078c976cb tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:11.662092 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-166ac31b-f0eb-4baf-8cd1-d5c078c976cb tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:11.662985 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-166ac31b-f0eb-4baf-8cd1-d5c078c976cb tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:11.664537 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-166ac31b-f0eb-4baf-8cd1-d5c078c976cb tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:11.901945 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-166ac31b-f0eb-4baf-8cd1-d5c078c976cb tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:11.921949 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-166ac31b-f0eb-4baf-8cd1-d5c078c976cb tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:11.924562 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-166ac31b-f0eb-4baf-8cd1-d5c078c976cb tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:11.935050 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-166ac31b-f0eb-4baf-8cd1-d5c078c976cb tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] 10.222.0.43 "GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15" status: 200 len: 1553 microversion: 2.91 time: 0.314369 Oct 04 18:35:11.953171 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 511/1111] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:35:11 2022] GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15 => generated 1553 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:35:12.114535 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-8d8a7d60-2fc5-42fc-8253-87f824da340c tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:12.115155 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-8d8a7d60-2fc5-42fc-8253-87f824da340c tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] [instance: 67e13bce-be81-4775-be5f-737add9f1694] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:12.127438 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8d8a7d60-2fc5-42fc-8253-87f824da340c tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:12.129445 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8d8a7d60-2fc5-42fc-8253-87f824da340c tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:12.130921 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8d8a7d60-2fc5-42fc-8253-87f824da340c tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:12.132395 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8d8a7d60-2fc5-42fc-8253-87f824da340c tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:12.133838 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8d8a7d60-2fc5-42fc-8253-87f824da340c tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:12.135980 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8d8a7d60-2fc5-42fc-8253-87f824da340c tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:12.211307 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-3ca5cf34-8347-44bf-9246-c4e7f26b1054 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a41ab6fb78a42ceaca621c5a38ffc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa31ed92017490a82497c7b8910aef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:12.236243 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-3ca5cf34-8347-44bf-9246-c4e7f26b1054 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] 10.222.0.43 "GET /compute/v2.1/servers/93798a9a-d90d-4a4e-8e30-d6575486ff56" status: 200 len: 1497 microversion: 2.1 time: 0.704324 Oct 04 18:35:12.263271 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 601/1112] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:11 2022] GET /compute/v2.1/servers/93798a9a-d90d-4a4e-8e30-d6575486ff56 => generated 1497 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:12.277939 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-7937b99d-fe50-48f6-aba6-5c6ae27f35ef tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:12.279270 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-7937b99d-fe50-48f6-aba6-5c6ae27f35ef tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] [instance: 7222a4ce-d2a2-4b09-afc6-55bca52414d4] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:12.300051 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:35:12.303695 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7937b99d-fe50-48f6-aba6-5c6ae27f35ef tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:12.304405 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7937b99d-fe50-48f6-aba6-5c6ae27f35ef tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:12.305473 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7937b99d-fe50-48f6-aba6-5c6ae27f35ef tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:12.310445 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7937b99d-fe50-48f6-aba6-5c6ae27f35ef tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:12.312265 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7937b99d-fe50-48f6-aba6-5c6ae27f35ef tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:12.313013 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7937b99d-fe50-48f6-aba6-5c6ae27f35ef tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:12.462670 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-7937b99d-fe50-48f6-aba6-5c6ae27f35ef tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:12.487141 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-7937b99d-fe50-48f6-aba6-5c6ae27f35ef tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:12.497497 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-7937b99d-fe50-48f6-aba6-5c6ae27f35ef tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:12.502151 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-7937b99d-fe50-48f6-aba6-5c6ae27f35ef tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] 10.222.0.43 "GET /compute/v2.1/servers/7222a4ce-d2a2-4b09-afc6-55bca52414d4" status: 200 len: 1343 microversion: 2.25 time: 0.237008 Oct 04 18:35:12.504471 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 602/1113] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:35:12 2022] GET /compute/v2.1/servers/7222a4ce-d2a2-4b09-afc6-55bca52414d4 => generated 1343 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:35:12.510676 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-6f451019-afd8-4557-8fa1-777c8ccb4da7 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:12.519587 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-6f451019-afd8-4557-8fa1-777c8ccb4da7 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] [instance: b36499e0-9405-4153-a581-13c1bd9d43eb] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:12.534875 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6f451019-afd8-4557-8fa1-777c8ccb4da7 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:12.535717 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6f451019-afd8-4557-8fa1-777c8ccb4da7 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:12.536371 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6f451019-afd8-4557-8fa1-777c8ccb4da7 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:12.537433 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6f451019-afd8-4557-8fa1-777c8ccb4da7 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:12.538057 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6f451019-afd8-4557-8fa1-777c8ccb4da7 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:12.538973 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6f451019-afd8-4557-8fa1-777c8ccb4da7 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:12.567795 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-6f451019-afd8-4557-8fa1-777c8ccb4da7 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] HTTP exception thrown: Instance b36499e0-9405-4153-a581-13c1bd9d43eb could not be found. Oct 04 18:35:12.570336 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-6f451019-afd8-4557-8fa1-777c8ccb4da7 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Request method failure captured: Oct 04 18:35:12.570336 n-d-851028-13 devstack@n-api.service[123596]: request: GET /compute/v2.1/servers/b36499e0-9405-4153-a581-13c1bd9d43eb HTTP/1.1 Oct 04 18:35:12.570336 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:35:12.570336 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:35:12.570336 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:35:12.570336 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 18:35:12.570336 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:35:12.570336 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:35:12.570336 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:35:12.570336 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:35:12.570336 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPHvuItqv5xcxbp_bqbjUggZhpUG53TiGDPrqjFiNZGHAMY6QdeICs1jR4QxEtGJ9kJciv8ws3outzNBgAd1ZiItYEkQ7c76M1xzjstLBOG0OAwb8aGthDLSqRW7T7V0wj50TxoUUgeNpSMbG6VscuaiI7GHr0fqlhRjDqzMaKz-IIxQ Oct 04 18:35:12.570336 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:35:12.570336 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:35:12.570336 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:35:12.570336 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:35:12.570336 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:35:12.570336 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:35:12.570336 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: e7adedcdb9c3485ea2738c00e25aa3fd Oct 04 18:35:12.570336 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-ServersOnMultiNodesTest-1469796738 Oct 04 18:35:12.570336 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 18:35:12.570336 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 18:35:12.570336 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/e7adedcdb9c3485ea2738c00e25aa3fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_e7adedcdb9c3485ea2738c00e25aa3fd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/e7adedcdb9c3485ea2738c00e25aa3fd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/e7adedcdb9c3485ea2738c00e25aa3fd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:35:12.570336 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-ServersOnMultiNodesTest-1469796738 Oct 04 18:35:12.570336 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: e7adedcdb9c3485ea2738c00e25aa3fd Oct 04 18:35:12.570336 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1469796738 Oct 04 18:35:12.570336 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-ServersOnMultiNodesTest-1469796738-project Oct 04 18:35:12.570336 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:35:12.570336 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:35:12.570336 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: a7db99f361654711bea7f1b2c404d312 Oct 04 18:35:12.570336 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-ServersOnMultiNodesTest-1469796738-project Oct 04 18:35:12.570336 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 18:35:12.570336 n-d-851028-13 devstack@n-api.service[123596]: exception: Instance b36499e0-9405-4153-a581-13c1bd9d43eb could not be found. Oct 04 18:35:12.570336 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': 'b36499e0-9405-4153-a581-13c1bd9d43eb'} Oct 04 18:35:12.570336 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:35:12.570336 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:35:12.570336 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:35:12.570336 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:35:12.570336 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:35:12.570336 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:35:12.570336 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:35:12.570336 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:35:12.570336 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:35:12.570336 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:35:12.570336 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b36499e0-9405-4153-a581-13c1bd9d43eb could not be found. Oct 04 18:35:12.570336 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:35:12.570336 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:35:12.570336 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:35:12.570336 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:35:12.570336 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:35:12.570336 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:35:12.570336 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:35:12.570336 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:35:12.570336 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:35:12.570336 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:35:12.570336 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:35:12.570336 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:35:12.570336 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:35:12.570336 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:35:12.570336 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:35:12.570336 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:35:12.570336 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b36499e0-9405-4153-a581-13c1bd9d43eb could not be found. Oct 04 18:35:12.570336 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:35:12.570336 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:35:12.570336 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:35:12.575292 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:35:12.575292 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:35:12.575292 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:35:12.575292 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:35:12.575292 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:35:12.575292 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b36499e0-9405-4153-a581-13c1bd9d43eb could not be found. Oct 04 18:35:12.575292 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:35:12.578553 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-6f451019-afd8-4557-8fa1-777c8ccb4da7 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] Returning 404 to user: Instance b36499e0-9405-4153-a581-13c1bd9d43eb could not be found. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:35:12.579603 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-6f451019-afd8-4557-8fa1-777c8ccb4da7 tempest-ServersOnMultiNodesTest-1469796738 tempest-ServersOnMultiNodesTest-1469796738-project] 10.222.0.43 "GET /compute/v2.1/servers/b36499e0-9405-4153-a581-13c1bd9d43eb" status: 404 len: 111 microversion: 2.1 time: 0.072743 Oct 04 18:35:12.580737 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 603/1114] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:12 2022] GET /compute/v2.1/servers/b36499e0-9405-4153-a581-13c1bd9d43eb => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:35:12.589679 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-8d8a7d60-2fc5-42fc-8253-87f824da340c tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8b5e18327f4713a1e465acb9e863f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c849c5d04f44f7951908d740ec1689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:12.604482 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-8d8a7d60-2fc5-42fc-8253-87f824da340c tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d8b5e18327f4713a1e465acb9e863f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c849c5d04f44f7951908d740ec1689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:12.609456 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-8d8a7d60-2fc5-42fc-8253-87f824da340c tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d8b5e18327f4713a1e465acb9e863f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c849c5d04f44f7951908d740ec1689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:12.617297 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-8d8a7d60-2fc5-42fc-8253-87f824da340c tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] 10.222.0.43 "GET /compute/v2.1/servers/67e13bce-be81-4775-be5f-737add9f1694" status: 200 len: 1446 microversion: 2.75 time: 0.506156 Oct 04 18:35:12.630051 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 512/1115] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:35:12 2022] GET /compute/v2.1/servers/67e13bce-be81-4775-be5f-737add9f1694 => generated 1446 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:35:12.970513 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-1fd9d0a0-6cf4-48d3-a12e-564a4af296be tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:12.971132 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-1fd9d0a0-6cf4-48d3-a12e-564a4af296be tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] [instance: 84e0414b-a39f-4bfe-bc9d-c170ceb34d15] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:12.986992 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1fd9d0a0-6cf4-48d3-a12e-564a4af296be tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:12.987494 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1fd9d0a0-6cf4-48d3-a12e-564a4af296be tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:12.993474 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1fd9d0a0-6cf4-48d3-a12e-564a4af296be tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:12.999017 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1fd9d0a0-6cf4-48d3-a12e-564a4af296be tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:13.002599 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1fd9d0a0-6cf4-48d3-a12e-564a4af296be tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:13.005707 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1fd9d0a0-6cf4-48d3-a12e-564a4af296be tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:13.268670 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-9d6b8b8f-758c-4cf3-9389-d1fbc527e2ae tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:13.269376 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-9d6b8b8f-758c-4cf3-9389-d1fbc527e2ae tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] [instance: 93798a9a-d90d-4a4e-8e30-d6575486ff56] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:13.278486 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=3,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:35:13.292441 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9d6b8b8f-758c-4cf3-9389-d1fbc527e2ae tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:13.295953 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9d6b8b8f-758c-4cf3-9389-d1fbc527e2ae tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:13.307220 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9d6b8b8f-758c-4cf3-9389-d1fbc527e2ae tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:13.311586 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9d6b8b8f-758c-4cf3-9389-d1fbc527e2ae tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:13.312134 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9d6b8b8f-758c-4cf3-9389-d1fbc527e2ae tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:13.316412 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9d6b8b8f-758c-4cf3-9389-d1fbc527e2ae tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:13.357340 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-1fd9d0a0-6cf4-48d3-a12e-564a4af296be tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:13.397655 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-1fd9d0a0-6cf4-48d3-a12e-564a4af296be tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:13.404578 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-1fd9d0a0-6cf4-48d3-a12e-564a4af296be tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:13.437673 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-1fd9d0a0-6cf4-48d3-a12e-564a4af296be tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] 10.222.0.43 "GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15" status: 200 len: 1553 microversion: 2.91 time: 0.470336 Oct 04 18:35:13.439203 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 604/1116] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:35:12 2022] GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15 => generated 1553 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:35:13.538276 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-25158a86-e77e-4ff3-b303-da29155a3f16 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:13.539109 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-25158a86-e77e-4ff3-b303-da29155a3f16 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] [instance: 7222a4ce-d2a2-4b09-afc6-55bca52414d4] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:13.557171 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-25158a86-e77e-4ff3-b303-da29155a3f16 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:13.559594 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-25158a86-e77e-4ff3-b303-da29155a3f16 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:13.560135 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-25158a86-e77e-4ff3-b303-da29155a3f16 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:13.562108 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-25158a86-e77e-4ff3-b303-da29155a3f16 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:13.562587 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-25158a86-e77e-4ff3-b303-da29155a3f16 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:13.563994 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-25158a86-e77e-4ff3-b303-da29155a3f16 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:14.075010 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-25158a86-e77e-4ff3-b303-da29155a3f16 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:14.092850 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-25158a86-e77e-4ff3-b303-da29155a3f16 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:14.096925 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-25158a86-e77e-4ff3-b303-da29155a3f16 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:14.100970 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-25158a86-e77e-4ff3-b303-da29155a3f16 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] 10.222.0.43 "GET /compute/v2.1/servers/7222a4ce-d2a2-4b09-afc6-55bca52414d4" status: 200 len: 1411 microversion: 2.25 time: 0.568186 Oct 04 18:35:14.104550 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 605/1117] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:35:13 2022] GET /compute/v2.1/servers/7222a4ce-d2a2-4b09-afc6-55bca52414d4 => generated 1411 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:35:14.117264 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-8df3c65d-da58-4ca4-b558-a15146bd0827 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:14.118738 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-8df3c65d-da58-4ca4-b558-a15146bd0827 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] [instance: 67e13bce-be81-4775-be5f-737add9f1694] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:14.138656 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8df3c65d-da58-4ca4-b558-a15146bd0827 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:14.141526 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8df3c65d-da58-4ca4-b558-a15146bd0827 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:14.142684 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8df3c65d-da58-4ca4-b558-a15146bd0827 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:14.145701 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8df3c65d-da58-4ca4-b558-a15146bd0827 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:14.148757 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8df3c65d-da58-4ca4-b558-a15146bd0827 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:14.149259 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8df3c65d-da58-4ca4-b558-a15146bd0827 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:14.384298 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-9d6b8b8f-758c-4cf3-9389-d1fbc527e2ae tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a41ab6fb78a42ceaca621c5a38ffc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa31ed92017490a82497c7b8910aef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:14.392490 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-8df3c65d-da58-4ca4-b558-a15146bd0827 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8b5e18327f4713a1e465acb9e863f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c849c5d04f44f7951908d740ec1689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:14.407712 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-8df3c65d-da58-4ca4-b558-a15146bd0827 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d8b5e18327f4713a1e465acb9e863f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c849c5d04f44f7951908d740ec1689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:14.413458 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-8df3c65d-da58-4ca4-b558-a15146bd0827 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d8b5e18327f4713a1e465acb9e863f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c849c5d04f44f7951908d740ec1689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:14.421723 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-9d6b8b8f-758c-4cf3-9389-d1fbc527e2ae tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] 10.222.0.43 "GET /compute/v2.1/servers/93798a9a-d90d-4a4e-8e30-d6575486ff56" status: 200 len: 1497 microversion: 2.1 time: 1.151402 Oct 04 18:35:14.426208 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 513/1118] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:13 2022] GET /compute/v2.1/servers/93798a9a-d90d-4a4e-8e30-d6575486ff56 => generated 1497 bytes in 1162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:14.431526 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-8df3c65d-da58-4ca4-b558-a15146bd0827 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] 10.222.0.43 "GET /compute/v2.1/servers/67e13bce-be81-4775-be5f-737add9f1694" status: 200 len: 1446 microversion: 2.75 time: 0.325155 Oct 04 18:35:14.432048 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 606/1119] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:35:14 2022] GET /compute/v2.1/servers/67e13bce-be81-4775-be5f-737add9f1694 => generated 1446 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:35:14.476536 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-c800bfdf-1501-4d6f-a5b5-f05ad1892357 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:14.477885 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-c800bfdf-1501-4d6f-a5b5-f05ad1892357 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] [instance: 84e0414b-a39f-4bfe-bc9d-c170ceb34d15] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:14.487900 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c800bfdf-1501-4d6f-a5b5-f05ad1892357 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:14.488739 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c800bfdf-1501-4d6f-a5b5-f05ad1892357 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:14.489379 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c800bfdf-1501-4d6f-a5b5-f05ad1892357 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:14.490301 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c800bfdf-1501-4d6f-a5b5-f05ad1892357 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:14.490921 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c800bfdf-1501-4d6f-a5b5-f05ad1892357 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:14.491595 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c800bfdf-1501-4d6f-a5b5-f05ad1892357 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:14.622483 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-c800bfdf-1501-4d6f-a5b5-f05ad1892357 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:14.636537 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-c800bfdf-1501-4d6f-a5b5-f05ad1892357 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:14.652209 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-c800bfdf-1501-4d6f-a5b5-f05ad1892357 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:14.670927 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-c800bfdf-1501-4d6f-a5b5-f05ad1892357 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] 10.222.0.43 "GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15" status: 200 len: 1553 microversion: 2.91 time: 0.198668 Oct 04 18:35:14.691856 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 514/1120] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:35:14 2022] GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15 => generated 1553 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:35:15.142226 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-1a90a56f-232f-4013-85de-7938e8319b21 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:15.143345 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-1a90a56f-232f-4013-85de-7938e8319b21 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] [instance: 7222a4ce-d2a2-4b09-afc6-55bca52414d4] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:15.156007 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1a90a56f-232f-4013-85de-7938e8319b21 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:15.157817 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1a90a56f-232f-4013-85de-7938e8319b21 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:15.159940 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1a90a56f-232f-4013-85de-7938e8319b21 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:15.161018 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1a90a56f-232f-4013-85de-7938e8319b21 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:15.163082 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1a90a56f-232f-4013-85de-7938e8319b21 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:15.167573 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1a90a56f-232f-4013-85de-7938e8319b21 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:15.179872 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=100 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:35:15.372598 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-bc065e8d-8c56-4ea4-b326-51663427dea3 tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-176115205", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "2f18419f-15dd-47a8-a597-510d88110364"}], "security_groups": [{"name": "tempest-securitygroup--1268982409"}], "key_name": "tempest-keypair-1930838380", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:35:15.558675 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-1a90a56f-232f-4013-85de-7938e8319b21 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:15.575377 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-1a90a56f-232f-4013-85de-7938e8319b21 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:15.578869 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-1a90a56f-232f-4013-85de-7938e8319b21 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:15.598340 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-1a90a56f-232f-4013-85de-7938e8319b21 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] 10.222.0.43 "GET /compute/v2.1/servers/7222a4ce-d2a2-4b09-afc6-55bca52414d4" status: 200 len: 1411 microversion: 2.25 time: 0.464479 Oct 04 18:35:15.601209 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 607/1121] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:35:15 2022] GET /compute/v2.1/servers/7222a4ce-d2a2-4b09-afc6-55bca52414d4 => generated 1411 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:35:15.607220 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-04c43398-ec30-455c-8f20-ed80cc171421 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:15.608374 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-04c43398-ec30-455c-8f20-ed80cc171421 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] [instance: 93798a9a-d90d-4a4e-8e30-d6575486ff56] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:15.616025 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-04c43398-ec30-455c-8f20-ed80cc171421 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:15.616709 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-04c43398-ec30-455c-8f20-ed80cc171421 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:15.632504 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-04c43398-ec30-455c-8f20-ed80cc171421 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:15.635217 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-04c43398-ec30-455c-8f20-ed80cc171421 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:15.641450 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-04c43398-ec30-455c-8f20-ed80cc171421 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:15.644529 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-04c43398-ec30-455c-8f20-ed80cc171421 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:15.861437 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.network.neutron [None req-bc065e8d-8c56-4ea4-b326-51663427dea3 tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] validate_networks() for [('2f18419f-15dd-47a8-a597-510d88110364', None, None, None, None, None)] {{(pid=123595) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:35:16.109774 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-04c43398-ec30-455c-8f20-ed80cc171421 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a41ab6fb78a42ceaca621c5a38ffc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa31ed92017490a82497c7b8910aef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:16.119762 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-04c43398-ec30-455c-8f20-ed80cc171421 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] 10.222.0.43 "GET /compute/v2.1/servers/93798a9a-d90d-4a4e-8e30-d6575486ff56" status: 200 len: 1497 microversion: 2.1 time: 0.517213 Oct 04 18:35:16.130057 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 608/1122] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:15 2022] GET /compute/v2.1/servers/93798a9a-d90d-4a4e-8e30-d6575486ff56 => generated 1497 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:16.147408 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-db78a254-cf71-41cd-8dd1-3c32e5e2bba4 req-f9b1f52a-f94e-4c1b-ac7f-c1c747dad044 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7222a4ce-d2a2-4b09-afc6-55bca52414d4", "tag": "dc9d53f5-3f85-42de-8651-845234788630"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:35:16.183752 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-db78a254-cf71-41cd-8dd1-3c32e5e2bba4 req-f9b1f52a-f94e-4c1b-ac7f-c1c747dad044 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:16.185192 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-db78a254-cf71-41cd-8dd1-3c32e5e2bba4 req-f9b1f52a-f94e-4c1b-ac7f-c1c747dad044 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:16.186784 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-db78a254-cf71-41cd-8dd1-3c32e5e2bba4 req-f9b1f52a-f94e-4c1b-ac7f-c1c747dad044 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:16.228714 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-db78a254-cf71-41cd-8dd1-3c32e5e2bba4 req-f9b1f52a-f94e-4c1b-ac7f-c1c747dad044 service nova] Creating event network-changed:dc9d53f5-3f85-42de-8651-845234788630 for instance 7222a4ce-d2a2-4b09-afc6-55bca52414d4 on n-h1-851028-13 Oct 04 18:35:16.245537 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-db78a254-cf71-41cd-8dd1-3c32e5e2bba4 req-f9b1f52a-f94e-4c1b-ac7f-c1c747dad044 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112626 Oct 04 18:35:16.250586 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 609/1123] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:35:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:35:16.265544 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-a0ca5eff-8a01-446f-8521-46ad3d509533 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:16.280425 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-a0ca5eff-8a01-446f-8521-46ad3d509533 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] [instance: 67e13bce-be81-4775-be5f-737add9f1694] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:16.298519 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a0ca5eff-8a01-446f-8521-46ad3d509533 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:16.311495 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a0ca5eff-8a01-446f-8521-46ad3d509533 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:16.312462 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a0ca5eff-8a01-446f-8521-46ad3d509533 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:16.313757 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a0ca5eff-8a01-446f-8521-46ad3d509533 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:16.314480 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a0ca5eff-8a01-446f-8521-46ad3d509533 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:16.315180 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a0ca5eff-8a01-446f-8521-46ad3d509533 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:16.584045 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-a0ca5eff-8a01-446f-8521-46ad3d509533 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8b5e18327f4713a1e465acb9e863f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c849c5d04f44f7951908d740ec1689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:16.594690 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-a0ca5eff-8a01-446f-8521-46ad3d509533 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d8b5e18327f4713a1e465acb9e863f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c849c5d04f44f7951908d740ec1689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:16.621240 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-a0ca5eff-8a01-446f-8521-46ad3d509533 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d8b5e18327f4713a1e465acb9e863f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c849c5d04f44f7951908d740ec1689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:16.638920 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-a0ca5eff-8a01-446f-8521-46ad3d509533 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] 10.222.0.43 "GET /compute/v2.1/servers/67e13bce-be81-4775-be5f-737add9f1694" status: 200 len: 1446 microversion: 2.75 time: 0.378949 Oct 04 18:35:16.652087 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 610/1124] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:35:16 2022] GET /compute/v2.1/servers/67e13bce-be81-4775-be5f-737add9f1694 => generated 1446 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:35:16.670073 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-913d764e-44c5-4525-8d31-07b5ffa0ba24 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:16.682278 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-913d764e-44c5-4525-8d31-07b5ffa0ba24 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] [instance: 84e0414b-a39f-4bfe-bc9d-c170ceb34d15] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:16.706699 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-913d764e-44c5-4525-8d31-07b5ffa0ba24 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:16.710722 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-913d764e-44c5-4525-8d31-07b5ffa0ba24 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:16.713721 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-913d764e-44c5-4525-8d31-07b5ffa0ba24 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:16.717836 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-913d764e-44c5-4525-8d31-07b5ffa0ba24 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:16.722943 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-913d764e-44c5-4525-8d31-07b5ffa0ba24 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:16.735127 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-913d764e-44c5-4525-8d31-07b5ffa0ba24 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:17.172962 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-913d764e-44c5-4525-8d31-07b5ffa0ba24 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:17.190819 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-913d764e-44c5-4525-8d31-07b5ffa0ba24 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:17.193033 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-913d764e-44c5-4525-8d31-07b5ffa0ba24 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:17.212221 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-913d764e-44c5-4525-8d31-07b5ffa0ba24 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] 10.222.0.43 "GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15" status: 200 len: 1553 microversion: 2.91 time: 0.555589 Oct 04 18:35:17.216725 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 611/1125] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:35:16 2022] GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15 => generated 1553 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:35:17.223678 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-7efd2fa3-fef4-4d46-bfbd-a5e728edb7c8 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:17.225447 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-7efd2fa3-fef4-4d46-bfbd-a5e728edb7c8 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] [instance: 7222a4ce-d2a2-4b09-afc6-55bca52414d4] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:17.242127 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7efd2fa3-fef4-4d46-bfbd-a5e728edb7c8 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:17.248701 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7efd2fa3-fef4-4d46-bfbd-a5e728edb7c8 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:17.249642 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7efd2fa3-fef4-4d46-bfbd-a5e728edb7c8 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:17.250639 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7efd2fa3-fef4-4d46-bfbd-a5e728edb7c8 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:17.251670 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7efd2fa3-fef4-4d46-bfbd-a5e728edb7c8 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:17.253686 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7efd2fa3-fef4-4d46-bfbd-a5e728edb7c8 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:17.672022 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-bc065e8d-8c56-4ea4-b326-51663427dea3 tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] Getting quotas for project bdc10a840253410ab9404ff4906eebc8. Resources: dict_keys(['metadata_items']) {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:35:17.686561 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-bc065e8d-8c56-4ea4-b326-51663427dea3 tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] Getting quotas for user cf77a83227f0404da7792695463b6714 and project bdc10a840253410ab9404ff4906eebc8. Resources: dict_keys(['metadata_items']) {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:35:17.724330 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-bc065e8d-8c56-4ea4-b326-51663427dea3 tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] Flavor limits 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:35:17.724764 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-bc065e8d-8c56-4ea4-b326-51663427dea3 tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] Image limits 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:35:17.725334 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-bc065e8d-8c56-4ea4-b326-51663427dea3 tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] Flavor pref 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:35:17.725822 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-bc065e8d-8c56-4ea4-b326-51663427dea3 tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] Image pref 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:35:17.729651 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-bc065e8d-8c56-4ea4-b326-51663427dea3 tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:35:17.752048 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bc065e8d-8c56-4ea4-b326-51663427dea3 tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:17.752563 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bc065e8d-8c56-4ea4-b326-51663427dea3 tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:17.753000 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bc065e8d-8c56-4ea4-b326-51663427dea3 tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:17.754048 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bc065e8d-8c56-4ea4-b326-51663427dea3 tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:17.758438 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bc065e8d-8c56-4ea4-b326-51663427dea3 tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:17.759283 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bc065e8d-8c56-4ea4-b326-51663427dea3 tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:17.811388 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-bc065e8d-8c56-4ea4-b326-51663427dea3 tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] Getting quotas for project bdc10a840253410ab9404ff4906eebc8. Resources: {'ram', 'cores', 'instances'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:35:17.822918 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-bc065e8d-8c56-4ea4-b326-51663427dea3 tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] Getting quotas for user cf77a83227f0404da7792695463b6714 and project bdc10a840253410ab9404ff4906eebc8. Resources: {'ram', 'cores', 'instances'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:35:17.858309 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-bc065e8d-8c56-4ea4-b326-51663427dea3 tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] Going to run 1 instances... {{(pid=123595) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:35:17.871874 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-bc065e8d-8c56-4ea4-b326-51663427dea3 tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] [instance: 37823428-1dab-4b0a-9ea1-7232766fc9b7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e8943ec5-4038-4d4b-b9b9-2415a79f5243',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:35:17.982365 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-bc065e8d-8c56-4ea4-b326-51663427dea3 tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 2.614935 Oct 04 18:35:17.983726 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 515/1126] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 18:35:15 2022] POST /compute/v2.1/servers => generated 409 bytes in 2618 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 18:35:17.988886 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-ea1f8ef9-f7fd-4a7b-abf5-1b9721208b40 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:17.990458 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-ea1f8ef9-f7fd-4a7b-abf5-1b9721208b40 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] [instance: 93798a9a-d90d-4a4e-8e30-d6575486ff56] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:18.001295 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ea1f8ef9-f7fd-4a7b-abf5-1b9721208b40 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:18.001805 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ea1f8ef9-f7fd-4a7b-abf5-1b9721208b40 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:18.002376 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ea1f8ef9-f7fd-4a7b-abf5-1b9721208b40 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:18.003172 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ea1f8ef9-f7fd-4a7b-abf5-1b9721208b40 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:18.003971 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ea1f8ef9-f7fd-4a7b-abf5-1b9721208b40 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:18.004415 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ea1f8ef9-f7fd-4a7b-abf5-1b9721208b40 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:18.386708 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-ea1f8ef9-f7fd-4a7b-abf5-1b9721208b40 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a41ab6fb78a42ceaca621c5a38ffc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa31ed92017490a82497c7b8910aef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:18.416640 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-ea1f8ef9-f7fd-4a7b-abf5-1b9721208b40 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] 10.222.0.43 "GET /compute/v2.1/servers/93798a9a-d90d-4a4e-8e30-d6575486ff56" status: 200 len: 1497 microversion: 2.1 time: 0.431692 Oct 04 18:35:18.421507 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 516/1127] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:17 2022] GET /compute/v2.1/servers/93798a9a-d90d-4a4e-8e30-d6575486ff56 => generated 1497 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:18.429598 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-1213fcdb-ccb7-4da6-93cc-9431bf481ae2 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:18.445783 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-1213fcdb-ccb7-4da6-93cc-9431bf481ae2 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] [instance: 67e13bce-be81-4775-be5f-737add9f1694] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:18.447396 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-7efd2fa3-fef4-4d46-bfbd-a5e728edb7c8 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:18.466026 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-7efd2fa3-fef4-4d46-bfbd-a5e728edb7c8 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:18.476965 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1213fcdb-ccb7-4da6-93cc-9431bf481ae2 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:18.478907 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1213fcdb-ccb7-4da6-93cc-9431bf481ae2 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:18.480305 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-7efd2fa3-fef4-4d46-bfbd-a5e728edb7c8 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:18.480499 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1213fcdb-ccb7-4da6-93cc-9431bf481ae2 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:18.483247 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1213fcdb-ccb7-4da6-93cc-9431bf481ae2 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:18.489923 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1213fcdb-ccb7-4da6-93cc-9431bf481ae2 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:18.490382 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1213fcdb-ccb7-4da6-93cc-9431bf481ae2 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:18.497407 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-7efd2fa3-fef4-4d46-bfbd-a5e728edb7c8 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] 10.222.0.43 "GET /compute/v2.1/servers/7222a4ce-d2a2-4b09-afc6-55bca52414d4" status: 200 len: 1411 microversion: 2.25 time: 1.277102 Oct 04 18:35:18.518138 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 612/1128] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:35:17 2022] GET /compute/v2.1/servers/7222a4ce-d2a2-4b09-afc6-55bca52414d4 => generated 1411 bytes in 1300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:35:18.526719 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-5de72ae5-e9cf-4ec2-8d47-4c7603f10d03 tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:18.528825 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-5de72ae5-e9cf-4ec2-8d47-4c7603f10d03 tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] [instance: 37823428-1dab-4b0a-9ea1-7232766fc9b7] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:18.691743 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-5de72ae5-e9cf-4ec2-8d47-4c7603f10d03 tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf77a83227f0404da7792695463b6714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc10a840253410ab9404ff4906eebc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:18.711770 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-5de72ae5-e9cf-4ec2-8d47-4c7603f10d03 tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] 10.222.0.43 "GET /compute/v2.1/servers/37823428-1dab-4b0a-9ea1-7232766fc9b7" status: 200 len: 1277 microversion: 2.1 time: 0.183138 Oct 04 18:35:18.731053 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 613/1129] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:18 2022] GET /compute/v2.1/servers/37823428-1dab-4b0a-9ea1-7232766fc9b7 => generated 1277 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:18.735365 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-452d60c8-b3d7-457f-b985-c4105a8b8d69 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:18.737367 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-452d60c8-b3d7-457f-b985-c4105a8b8d69 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] [instance: 84e0414b-a39f-4bfe-bc9d-c170ceb34d15] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:18.768914 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-452d60c8-b3d7-457f-b985-c4105a8b8d69 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:18.772363 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-452d60c8-b3d7-457f-b985-c4105a8b8d69 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:18.776161 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-452d60c8-b3d7-457f-b985-c4105a8b8d69 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:18.780572 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-452d60c8-b3d7-457f-b985-c4105a8b8d69 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:18.781057 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-452d60c8-b3d7-457f-b985-c4105a8b8d69 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:18.781522 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-452d60c8-b3d7-457f-b985-c4105a8b8d69 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:18.788094 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-1213fcdb-ccb7-4da6-93cc-9431bf481ae2 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8b5e18327f4713a1e465acb9e863f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c849c5d04f44f7951908d740ec1689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:18.797631 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-1213fcdb-ccb7-4da6-93cc-9431bf481ae2 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d8b5e18327f4713a1e465acb9e863f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c849c5d04f44f7951908d740ec1689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:18.812409 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-1213fcdb-ccb7-4da6-93cc-9431bf481ae2 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d8b5e18327f4713a1e465acb9e863f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c849c5d04f44f7951908d740ec1689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:18.849948 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-1213fcdb-ccb7-4da6-93cc-9431bf481ae2 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] 10.222.0.43 "GET /compute/v2.1/servers/67e13bce-be81-4775-be5f-737add9f1694" status: 200 len: 1446 microversion: 2.75 time: 0.421848 Oct 04 18:35:18.850812 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 517/1130] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:35:18 2022] GET /compute/v2.1/servers/67e13bce-be81-4775-be5f-737add9f1694 => generated 1446 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:35:18.984481 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-452d60c8-b3d7-457f-b985-c4105a8b8d69 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:19.000601 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-452d60c8-b3d7-457f-b985-c4105a8b8d69 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:19.008996 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-452d60c8-b3d7-457f-b985-c4105a8b8d69 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:19.042571 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-452d60c8-b3d7-457f-b985-c4105a8b8d69 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] 10.222.0.43 "GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15" status: 200 len: 1553 microversion: 2.91 time: 0.322701 Oct 04 18:35:19.062052 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 614/1131] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:35:18 2022] GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15 => generated 1553 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:35:19.459507 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-c5b677ff-9e8f-4038-809f-5011805a6ee6 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:19.460114 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-c5b677ff-9e8f-4038-809f-5011805a6ee6 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] [instance: 93798a9a-d90d-4a4e-8e30-d6575486ff56] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:19.475922 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c5b677ff-9e8f-4038-809f-5011805a6ee6 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:19.486371 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c5b677ff-9e8f-4038-809f-5011805a6ee6 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:19.487065 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c5b677ff-9e8f-4038-809f-5011805a6ee6 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:19.488049 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c5b677ff-9e8f-4038-809f-5011805a6ee6 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:19.494706 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c5b677ff-9e8f-4038-809f-5011805a6ee6 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:19.495429 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c5b677ff-9e8f-4038-809f-5011805a6ee6 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:19.530975 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-97c1abee-4dcd-41cd-b5f9-e5c94b5e9959 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:19.531597 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-97c1abee-4dcd-41cd-b5f9-e5c94b5e9959 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] [instance: 7222a4ce-d2a2-4b09-afc6-55bca52414d4] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:19.570083 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-97c1abee-4dcd-41cd-b5f9-e5c94b5e9959 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:19.570957 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-97c1abee-4dcd-41cd-b5f9-e5c94b5e9959 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:19.571430 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-97c1abee-4dcd-41cd-b5f9-e5c94b5e9959 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:19.582329 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-97c1abee-4dcd-41cd-b5f9-e5c94b5e9959 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:19.582847 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-97c1abee-4dcd-41cd-b5f9-e5c94b5e9959 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:19.583419 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-97c1abee-4dcd-41cd-b5f9-e5c94b5e9959 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:20.191175 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-c5b677ff-9e8f-4038-809f-5011805a6ee6 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a41ab6fb78a42ceaca621c5a38ffc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa31ed92017490a82497c7b8910aef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:20.220884 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-c5b677ff-9e8f-4038-809f-5011805a6ee6 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] 10.222.0.43 "GET /compute/v2.1/servers/93798a9a-d90d-4a4e-8e30-d6575486ff56" status: 200 len: 1497 microversion: 2.1 time: 0.763900 Oct 04 18:35:20.223707 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 518/1132] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:19 2022] GET /compute/v2.1/servers/93798a9a-d90d-4a4e-8e30-d6575486ff56 => generated 1497 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:20.241370 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-d7d621cf-664d-4fa9-a8eb-e3a797cba0ef tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:20.244252 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-d7d621cf-664d-4fa9-a8eb-e3a797cba0ef tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] [instance: 37823428-1dab-4b0a-9ea1-7232766fc9b7] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:20.275770 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d7d621cf-664d-4fa9-a8eb-e3a797cba0ef tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:20.282202 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d7d621cf-664d-4fa9-a8eb-e3a797cba0ef tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:20.283080 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d7d621cf-664d-4fa9-a8eb-e3a797cba0ef tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:20.302660 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d7d621cf-664d-4fa9-a8eb-e3a797cba0ef tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:20.303158 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d7d621cf-664d-4fa9-a8eb-e3a797cba0ef tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:20.303613 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d7d621cf-664d-4fa9-a8eb-e3a797cba0ef tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:20.564422 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-d7d621cf-664d-4fa9-a8eb-e3a797cba0ef tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf77a83227f0404da7792695463b6714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc10a840253410ab9404ff4906eebc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:20.576278 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-d7d621cf-664d-4fa9-a8eb-e3a797cba0ef tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] 10.222.0.43 "GET /compute/v2.1/servers/37823428-1dab-4b0a-9ea1-7232766fc9b7" status: 200 len: 1329 microversion: 2.1 time: 0.351149 Oct 04 18:35:20.580174 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 519/1133] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:20 2022] GET /compute/v2.1/servers/37823428-1dab-4b0a-9ea1-7232766fc9b7 => generated 1329 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:20.594973 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-331489ba-c754-4f06-bf67-e86f41cd5249 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:20.604933 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-331489ba-c754-4f06-bf67-e86f41cd5249 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] [instance: 67e13bce-be81-4775-be5f-737add9f1694] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:20.614468 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-331489ba-c754-4f06-bf67-e86f41cd5249 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:20.615335 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-331489ba-c754-4f06-bf67-e86f41cd5249 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:20.616129 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-331489ba-c754-4f06-bf67-e86f41cd5249 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:20.617264 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-331489ba-c754-4f06-bf67-e86f41cd5249 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:20.618289 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-331489ba-c754-4f06-bf67-e86f41cd5249 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:20.618979 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-331489ba-c754-4f06-bf67-e86f41cd5249 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:20.808478 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-331489ba-c754-4f06-bf67-e86f41cd5249 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8b5e18327f4713a1e465acb9e863f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c849c5d04f44f7951908d740ec1689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:20.819438 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-331489ba-c754-4f06-bf67-e86f41cd5249 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d8b5e18327f4713a1e465acb9e863f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c849c5d04f44f7951908d740ec1689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:20.823799 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-331489ba-c754-4f06-bf67-e86f41cd5249 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d8b5e18327f4713a1e465acb9e863f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c849c5d04f44f7951908d740ec1689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:20.838026 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-331489ba-c754-4f06-bf67-e86f41cd5249 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] 10.222.0.43 "GET /compute/v2.1/servers/67e13bce-be81-4775-be5f-737add9f1694" status: 200 len: 1446 microversion: 2.75 time: 0.249959 Oct 04 18:35:20.860783 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 520/1134] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:35:20 2022] GET /compute/v2.1/servers/67e13bce-be81-4775-be5f-737add9f1694 => generated 1446 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:35:20.871547 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-e7c3f4fb-c702-4b7d-a667-12c4f9dc25e8 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:20.876021 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-e7c3f4fb-c702-4b7d-a667-12c4f9dc25e8 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] [instance: 84e0414b-a39f-4bfe-bc9d-c170ceb34d15] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:20.899214 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e7c3f4fb-c702-4b7d-a667-12c4f9dc25e8 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:20.899733 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e7c3f4fb-c702-4b7d-a667-12c4f9dc25e8 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:20.902075 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e7c3f4fb-c702-4b7d-a667-12c4f9dc25e8 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:20.904466 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e7c3f4fb-c702-4b7d-a667-12c4f9dc25e8 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:20.904940 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e7c3f4fb-c702-4b7d-a667-12c4f9dc25e8 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:20.913658 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e7c3f4fb-c702-4b7d-a667-12c4f9dc25e8 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:21.125311 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-97c1abee-4dcd-41cd-b5f9-e5c94b5e9959 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:21.143715 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-97c1abee-4dcd-41cd-b5f9-e5c94b5e9959 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:21.147372 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-97c1abee-4dcd-41cd-b5f9-e5c94b5e9959 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:21.153408 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-97c1abee-4dcd-41cd-b5f9-e5c94b5e9959 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] 10.222.0.43 "GET /compute/v2.1/servers/7222a4ce-d2a2-4b09-afc6-55bca52414d4" status: 200 len: 1411 microversion: 2.25 time: 1.625297 Oct 04 18:35:21.155605 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 615/1135] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:35:19 2022] GET /compute/v2.1/servers/7222a4ce-d2a2-4b09-afc6-55bca52414d4 => generated 1411 bytes in 1629 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:35:21.286059 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-e7c3f4fb-c702-4b7d-a667-12c4f9dc25e8 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:21.306243 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-e7c3f4fb-c702-4b7d-a667-12c4f9dc25e8 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:21.308186 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-e7c3f4fb-c702-4b7d-a667-12c4f9dc25e8 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:21.331366 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-e7c3f4fb-c702-4b7d-a667-12c4f9dc25e8 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] 10.222.0.43 "GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15" status: 200 len: 1553 microversion: 2.91 time: 0.468002 Oct 04 18:35:21.357391 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 521/1136] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:35:20 2022] GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15 => generated 1553 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:35:21.377094 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-eb676252-d141-4098-beae-addef02a277a tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:21.383730 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-eb676252-d141-4098-beae-addef02a277a tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] [instance: 93798a9a-d90d-4a4e-8e30-d6575486ff56] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:21.397884 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-eb676252-d141-4098-beae-addef02a277a tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:21.401515 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-eb676252-d141-4098-beae-addef02a277a tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:21.401974 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-eb676252-d141-4098-beae-addef02a277a tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:21.405503 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-eb676252-d141-4098-beae-addef02a277a tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:21.407463 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-eb676252-d141-4098-beae-addef02a277a tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:21.408110 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-eb676252-d141-4098-beae-addef02a277a tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:21.420365 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-bcc5579c-42ab-4579-b5bc-1d6e0dbe94f5 tempest-ServicesAdminTestJSON-158590367 tempest-ServicesAdminTestJSON-158590367-project-admin] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:21.424700 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bcc5579c-42ab-4579-b5bc-1d6e0dbe94f5 tempest-ServicesAdminTestJSON-158590367 tempest-ServicesAdminTestJSON-158590367-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:21.425256 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bcc5579c-42ab-4579-b5bc-1d6e0dbe94f5 tempest-ServicesAdminTestJSON-158590367 tempest-ServicesAdminTestJSON-158590367-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:21.430589 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bcc5579c-42ab-4579-b5bc-1d6e0dbe94f5 tempest-ServicesAdminTestJSON-158590367 tempest-ServicesAdminTestJSON-158590367-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:21.431498 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bcc5579c-42ab-4579-b5bc-1d6e0dbe94f5 tempest-ServicesAdminTestJSON-158590367 tempest-ServicesAdminTestJSON-158590367-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:21.432894 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bcc5579c-42ab-4579-b5bc-1d6e0dbe94f5 tempest-ServicesAdminTestJSON-158590367 tempest-ServicesAdminTestJSON-158590367-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:21.433580 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bcc5579c-42ab-4579-b5bc-1d6e0dbe94f5 tempest-ServicesAdminTestJSON-158590367 tempest-ServicesAdminTestJSON-158590367-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:21.463595 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-bcc5579c-42ab-4579-b5bc-1d6e0dbe94f5 tempest-ServicesAdminTestJSON-158590367 tempest-ServicesAdminTestJSON-158590367-project-admin] 10.222.0.43 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.306630 Oct 04 18:35:21.475119 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 616/1137] 10.222.0.43 () {58 vars in 1137 bytes} [Tue Oct 4 18:35:21 2022] GET /compute/v2.1/os-services => generated 949 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:35:21.480262 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-e16d1fcb-d881-4899-b895-04adf4a353d0 tempest-ServicesAdminTestJSON-158590367 tempest-ServicesAdminTestJSON-158590367-project-admin] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:21.488286 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e16d1fcb-d881-4899-b895-04adf4a353d0 tempest-ServicesAdminTestJSON-158590367 tempest-ServicesAdminTestJSON-158590367-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:21.492384 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e16d1fcb-d881-4899-b895-04adf4a353d0 tempest-ServicesAdminTestJSON-158590367 tempest-ServicesAdminTestJSON-158590367-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:21.493045 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e16d1fcb-d881-4899-b895-04adf4a353d0 tempest-ServicesAdminTestJSON-158590367 tempest-ServicesAdminTestJSON-158590367-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:21.494086 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e16d1fcb-d881-4899-b895-04adf4a353d0 tempest-ServicesAdminTestJSON-158590367 tempest-ServicesAdminTestJSON-158590367-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:21.496781 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e16d1fcb-d881-4899-b895-04adf4a353d0 tempest-ServicesAdminTestJSON-158590367 tempest-ServicesAdminTestJSON-158590367-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:21.499199 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e16d1fcb-d881-4899-b895-04adf4a353d0 tempest-ServicesAdminTestJSON-158590367 tempest-ServicesAdminTestJSON-158590367-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:21.563205 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-e16d1fcb-d881-4899-b895-04adf4a353d0 tempest-ServicesAdminTestJSON-158590367 tempest-ServicesAdminTestJSON-158590367-project-admin] 10.222.0.43 "GET /compute/v2.1/os-services?host=n-d-851028-13" status: 200 len: 581 microversion: 2.1 time: 0.086568 Oct 04 18:35:21.587612 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 617/1138] 10.222.0.43 () {58 vars in 1174 bytes} [Tue Oct 4 18:35:21 2022] GET /compute/v2.1/os-services?host=n-d-851028-13 => generated 581 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:35:21.601472 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f543b506-3ab0-4ab1-97c9-e599b0dcc0d5 tempest-ServicesAdminTestJSON-158590367 tempest-ServicesAdminTestJSON-158590367-project-admin] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:21.629190 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f543b506-3ab0-4ab1-97c9-e599b0dcc0d5 tempest-ServicesAdminTestJSON-158590367 tempest-ServicesAdminTestJSON-158590367-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:21.629695 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f543b506-3ab0-4ab1-97c9-e599b0dcc0d5 tempest-ServicesAdminTestJSON-158590367 tempest-ServicesAdminTestJSON-158590367-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:21.635058 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f543b506-3ab0-4ab1-97c9-e599b0dcc0d5 tempest-ServicesAdminTestJSON-158590367 tempest-ServicesAdminTestJSON-158590367-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:21.636128 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f543b506-3ab0-4ab1-97c9-e599b0dcc0d5 tempest-ServicesAdminTestJSON-158590367 tempest-ServicesAdminTestJSON-158590367-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:21.636614 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f543b506-3ab0-4ab1-97c9-e599b0dcc0d5 tempest-ServicesAdminTestJSON-158590367 tempest-ServicesAdminTestJSON-158590367-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:21.637290 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f543b506-3ab0-4ab1-97c9-e599b0dcc0d5 tempest-ServicesAdminTestJSON-158590367 tempest-ServicesAdminTestJSON-158590367-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:21.680146 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-f543b506-3ab0-4ab1-97c9-e599b0dcc0d5 tempest-ServicesAdminTestJSON-158590367 tempest-ServicesAdminTestJSON-158590367-project-admin] 10.222.0.43 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.090236 Oct 04 18:35:21.685485 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 618/1139] 10.222.0.43 () {58 vars in 1176 bytes} [Tue Oct 4 18:35:21 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:35:21.694129 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-791b2eb3-500b-4fb6-808a-c6301d28e258 tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:21.702971 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-791b2eb3-500b-4fb6-808a-c6301d28e258 tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] [instance: 37823428-1dab-4b0a-9ea1-7232766fc9b7] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:21.719201 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-791b2eb3-500b-4fb6-808a-c6301d28e258 tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:21.720270 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-791b2eb3-500b-4fb6-808a-c6301d28e258 tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:21.723310 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-791b2eb3-500b-4fb6-808a-c6301d28e258 tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:21.729026 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-791b2eb3-500b-4fb6-808a-c6301d28e258 tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:21.729882 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-791b2eb3-500b-4fb6-808a-c6301d28e258 tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:21.730407 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-791b2eb3-500b-4fb6-808a-c6301d28e258 tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:21.808496 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-eb676252-d141-4098-beae-addef02a277a tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a41ab6fb78a42ceaca621c5a38ffc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa31ed92017490a82497c7b8910aef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:21.817100 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-eb676252-d141-4098-beae-addef02a277a tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] 10.222.0.43 "GET /compute/v2.1/servers/93798a9a-d90d-4a4e-8e30-d6575486ff56" status: 200 len: 1497 microversion: 2.1 time: 0.457446 Oct 04 18:35:21.829136 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 522/1140] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:21 2022] GET /compute/v2.1/servers/93798a9a-d90d-4a4e-8e30-d6575486ff56 => generated 1497 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:21.833255 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-f41e7603-711e-47f3-b52d-6caffc850c7b tempest-ServicesAdminTestJSON-158590367 tempest-ServicesAdminTestJSON-158590367-project-admin] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:21.845013 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f41e7603-711e-47f3-b52d-6caffc850c7b tempest-ServicesAdminTestJSON-158590367 tempest-ServicesAdminTestJSON-158590367-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:21.860316 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f41e7603-711e-47f3-b52d-6caffc850c7b tempest-ServicesAdminTestJSON-158590367 tempest-ServicesAdminTestJSON-158590367-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:21.861044 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f41e7603-711e-47f3-b52d-6caffc850c7b tempest-ServicesAdminTestJSON-158590367 tempest-ServicesAdminTestJSON-158590367-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:21.865565 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f41e7603-711e-47f3-b52d-6caffc850c7b tempest-ServicesAdminTestJSON-158590367 tempest-ServicesAdminTestJSON-158590367-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:21.866052 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f41e7603-711e-47f3-b52d-6caffc850c7b tempest-ServicesAdminTestJSON-158590367 tempest-ServicesAdminTestJSON-158590367-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:21.866862 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f41e7603-711e-47f3-b52d-6caffc850c7b tempest-ServicesAdminTestJSON-158590367 tempest-ServicesAdminTestJSON-158590367-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:21.921249 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-f41e7603-711e-47f3-b52d-6caffc850c7b tempest-ServicesAdminTestJSON-158590367 tempest-ServicesAdminTestJSON-158590367-project-admin] 10.222.0.43 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.102007 Oct 04 18:35:21.930407 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 523/1141] 10.222.0.43 () {58 vars in 1137 bytes} [Tue Oct 4 18:35:21 2022] GET /compute/v2.1/os-services => generated 949 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:35:21.949071 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-6d4051e7-29fa-461c-8040-97deb5f13cb3 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:21.953324 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-6d4051e7-29fa-461c-8040-97deb5f13cb3 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] [instance: 67e13bce-be81-4775-be5f-737add9f1694] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:21.959255 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-791b2eb3-500b-4fb6-808a-c6301d28e258 tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf77a83227f0404da7792695463b6714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc10a840253410ab9404ff4906eebc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:21.977619 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-791b2eb3-500b-4fb6-808a-c6301d28e258 tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] 10.222.0.43 "GET /compute/v2.1/servers/37823428-1dab-4b0a-9ea1-7232766fc9b7" status: 200 len: 1335 microversion: 2.1 time: 0.284885 Oct 04 18:35:21.978390 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 619/1142] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:21 2022] GET /compute/v2.1/servers/37823428-1dab-4b0a-9ea1-7232766fc9b7 => generated 1335 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:21.981493 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6d4051e7-29fa-461c-8040-97deb5f13cb3 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:21.982629 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6d4051e7-29fa-461c-8040-97deb5f13cb3 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:21.983503 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6d4051e7-29fa-461c-8040-97deb5f13cb3 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:21.987476 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6d4051e7-29fa-461c-8040-97deb5f13cb3 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:21.988128 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6d4051e7-29fa-461c-8040-97deb5f13cb3 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:21.988723 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6d4051e7-29fa-461c-8040-97deb5f13cb3 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:22.156028 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-6d4051e7-29fa-461c-8040-97deb5f13cb3 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8b5e18327f4713a1e465acb9e863f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c849c5d04f44f7951908d740ec1689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:22.184292 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-6d4051e7-29fa-461c-8040-97deb5f13cb3 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d8b5e18327f4713a1e465acb9e863f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c849c5d04f44f7951908d740ec1689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:22.186754 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-6d4051e7-29fa-461c-8040-97deb5f13cb3 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d8b5e18327f4713a1e465acb9e863f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c849c5d04f44f7951908d740ec1689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:22.187369 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-6679f308-4e47-4f81-8822-770a69a1e866 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:22.188181 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-6679f308-4e47-4f81-8822-770a69a1e866 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] [instance: 7222a4ce-d2a2-4b09-afc6-55bca52414d4] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:22.200749 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-6d4051e7-29fa-461c-8040-97deb5f13cb3 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] 10.222.0.43 "GET /compute/v2.1/servers/67e13bce-be81-4775-be5f-737add9f1694" status: 200 len: 1446 microversion: 2.75 time: 0.268630 Oct 04 18:35:22.204909 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 524/1143] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:35:21 2022] GET /compute/v2.1/servers/67e13bce-be81-4775-be5f-737add9f1694 => generated 1446 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:35:22.209454 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6679f308-4e47-4f81-8822-770a69a1e866 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:22.212985 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6679f308-4e47-4f81-8822-770a69a1e866 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:22.213514 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6679f308-4e47-4f81-8822-770a69a1e866 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:22.214279 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6679f308-4e47-4f81-8822-770a69a1e866 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:22.216689 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6679f308-4e47-4f81-8822-770a69a1e866 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:22.218154 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6679f308-4e47-4f81-8822-770a69a1e866 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:22.366392 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-e1947cae-6afb-48cf-acb6-4dca6ac8d27b tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:22.370270 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-e1947cae-6afb-48cf-acb6-4dca6ac8d27b tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] [instance: 84e0414b-a39f-4bfe-bc9d-c170ceb34d15] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:22.391944 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e1947cae-6afb-48cf-acb6-4dca6ac8d27b tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:22.393032 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e1947cae-6afb-48cf-acb6-4dca6ac8d27b tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:22.394751 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e1947cae-6afb-48cf-acb6-4dca6ac8d27b tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:22.395659 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e1947cae-6afb-48cf-acb6-4dca6ac8d27b tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:22.397456 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e1947cae-6afb-48cf-acb6-4dca6ac8d27b tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:22.398940 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e1947cae-6afb-48cf-acb6-4dca6ac8d27b tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:22.622679 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-6679f308-4e47-4f81-8822-770a69a1e866 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:22.631295 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-6679f308-4e47-4f81-8822-770a69a1e866 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:22.642069 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-e1947cae-6afb-48cf-acb6-4dca6ac8d27b tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:22.653746 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-6679f308-4e47-4f81-8822-770a69a1e866 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:22.656680 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-6679f308-4e47-4f81-8822-770a69a1e866 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] 10.222.0.43 "GET /compute/v2.1/servers/7222a4ce-d2a2-4b09-afc6-55bca52414d4" status: 200 len: 1411 microversion: 2.25 time: 0.474457 Oct 04 18:35:22.657257 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-e1947cae-6afb-48cf-acb6-4dca6ac8d27b tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:22.660341 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 620/1144] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:35:22 2022] GET /compute/v2.1/servers/7222a4ce-d2a2-4b09-afc6-55bca52414d4 => generated 1411 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:35:22.663722 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-e1947cae-6afb-48cf-acb6-4dca6ac8d27b tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:22.690147 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-e1947cae-6afb-48cf-acb6-4dca6ac8d27b tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] 10.222.0.43 "GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15" status: 200 len: 1553 microversion: 2.91 time: 0.328182 Oct 04 18:35:22.690813 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 525/1145] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:35:22 2022] GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15 => generated 1553 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:35:22.845430 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-aa958a18-8aee-47f1-a589-ec2f70d5e85a tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:22.846422 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-aa958a18-8aee-47f1-a589-ec2f70d5e85a tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] [instance: 93798a9a-d90d-4a4e-8e30-d6575486ff56] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:22.855380 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-aa958a18-8aee-47f1-a589-ec2f70d5e85a tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:22.856345 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-aa958a18-8aee-47f1-a589-ec2f70d5e85a tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:22.857799 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-aa958a18-8aee-47f1-a589-ec2f70d5e85a tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:22.859094 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-aa958a18-8aee-47f1-a589-ec2f70d5e85a tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:22.860235 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-aa958a18-8aee-47f1-a589-ec2f70d5e85a tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:22.860908 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-aa958a18-8aee-47f1-a589-ec2f70d5e85a tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:23.014582 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-f81ea76f-c34a-41de-af27-07924aab1646 tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:23.015555 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-f81ea76f-c34a-41de-af27-07924aab1646 tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] [instance: 37823428-1dab-4b0a-9ea1-7232766fc9b7] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:23.035979 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f81ea76f-c34a-41de-af27-07924aab1646 tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:23.038510 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f81ea76f-c34a-41de-af27-07924aab1646 tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:23.040777 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f81ea76f-c34a-41de-af27-07924aab1646 tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:23.043806 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f81ea76f-c34a-41de-af27-07924aab1646 tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:23.045103 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f81ea76f-c34a-41de-af27-07924aab1646 tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:23.047967 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f81ea76f-c34a-41de-af27-07924aab1646 tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:23.306456 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-aa958a18-8aee-47f1-a589-ec2f70d5e85a tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a41ab6fb78a42ceaca621c5a38ffc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa31ed92017490a82497c7b8910aef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:23.320975 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-aa958a18-8aee-47f1-a589-ec2f70d5e85a tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] 10.222.0.43 "GET /compute/v2.1/servers/93798a9a-d90d-4a4e-8e30-d6575486ff56" status: 200 len: 1497 microversion: 2.1 time: 0.481838 Oct 04 18:35:23.323785 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 621/1146] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:22 2022] GET /compute/v2.1/servers/93798a9a-d90d-4a4e-8e30-d6575486ff56 => generated 1497 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:23.348007 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-1614b6fd-f3d2-4694-9bd0-6ca3ec1839a5 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:23.348656 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-1614b6fd-f3d2-4694-9bd0-6ca3ec1839a5 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] [instance: 67e13bce-be81-4775-be5f-737add9f1694] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:23.364919 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1614b6fd-f3d2-4694-9bd0-6ca3ec1839a5 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:23.365537 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1614b6fd-f3d2-4694-9bd0-6ca3ec1839a5 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:23.366004 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1614b6fd-f3d2-4694-9bd0-6ca3ec1839a5 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:23.370054 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1614b6fd-f3d2-4694-9bd0-6ca3ec1839a5 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:23.371859 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1614b6fd-f3d2-4694-9bd0-6ca3ec1839a5 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:23.372327 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1614b6fd-f3d2-4694-9bd0-6ca3ec1839a5 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:23.421692 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-f81ea76f-c34a-41de-af27-07924aab1646 tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf77a83227f0404da7792695463b6714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc10a840253410ab9404ff4906eebc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:23.433387 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-f81ea76f-c34a-41de-af27-07924aab1646 tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] 10.222.0.43 "GET /compute/v2.1/servers/37823428-1dab-4b0a-9ea1-7232766fc9b7" status: 200 len: 1403 microversion: 2.1 time: 0.432444 Oct 04 18:35:23.438900 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 526/1147] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:22 2022] GET /compute/v2.1/servers/37823428-1dab-4b0a-9ea1-7232766fc9b7 => generated 1403 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:23.616163 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-1614b6fd-f3d2-4694-9bd0-6ca3ec1839a5 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8b5e18327f4713a1e465acb9e863f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c849c5d04f44f7951908d740ec1689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:23.632528 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-1614b6fd-f3d2-4694-9bd0-6ca3ec1839a5 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d8b5e18327f4713a1e465acb9e863f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c849c5d04f44f7951908d740ec1689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:23.636740 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-1614b6fd-f3d2-4694-9bd0-6ca3ec1839a5 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d8b5e18327f4713a1e465acb9e863f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c849c5d04f44f7951908d740ec1689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:23.647856 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-1614b6fd-f3d2-4694-9bd0-6ca3ec1839a5 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] 10.222.0.43 "GET /compute/v2.1/servers/67e13bce-be81-4775-be5f-737add9f1694" status: 200 len: 1446 microversion: 2.75 time: 0.322218 Oct 04 18:35:23.649429 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 622/1148] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:35:23 2022] GET /compute/v2.1/servers/67e13bce-be81-4775-be5f-737add9f1694 => generated 1446 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:35:23.693010 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-bdc9718e-d3d4-4e01-994e-9a02db026263 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:23.693669 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-bdc9718e-d3d4-4e01-994e-9a02db026263 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] [instance: 7222a4ce-d2a2-4b09-afc6-55bca52414d4] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:23.700153 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bdc9718e-d3d4-4e01-994e-9a02db026263 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:23.700644 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bdc9718e-d3d4-4e01-994e-9a02db026263 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:23.706590 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bdc9718e-d3d4-4e01-994e-9a02db026263 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:23.707420 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bdc9718e-d3d4-4e01-994e-9a02db026263 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:23.707909 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bdc9718e-d3d4-4e01-994e-9a02db026263 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:23.708355 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bdc9718e-d3d4-4e01-994e-9a02db026263 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:23.727692 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-2d822c98-c504-44e5-a237-db259bc40819 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:23.728314 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-2d822c98-c504-44e5-a237-db259bc40819 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] [instance: 84e0414b-a39f-4bfe-bc9d-c170ceb34d15] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:23.757625 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2d822c98-c504-44e5-a237-db259bc40819 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:23.759553 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2d822c98-c504-44e5-a237-db259bc40819 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:23.760482 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2d822c98-c504-44e5-a237-db259bc40819 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:23.760780 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2d822c98-c504-44e5-a237-db259bc40819 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:23.761269 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2d822c98-c504-44e5-a237-db259bc40819 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:23.761708 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2d822c98-c504-44e5-a237-db259bc40819 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:23.807678 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=100 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:35:24.014779 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-2d822c98-c504-44e5-a237-db259bc40819 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:24.030873 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-2d822c98-c504-44e5-a237-db259bc40819 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:24.036723 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-2d822c98-c504-44e5-a237-db259bc40819 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:24.048328 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-2d822c98-c504-44e5-a237-db259bc40819 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] 10.222.0.43 "GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15" status: 200 len: 1553 microversion: 2.91 time: 0.323366 Oct 04 18:35:24.061807 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 623/1149] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:35:23 2022] GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15 => generated 1553 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:35:24.349378 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-16ecdda8-5a4f-4b19-8409-7ea5bc84c4ff tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:24.350627 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-16ecdda8-5a4f-4b19-8409-7ea5bc84c4ff tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] [instance: 93798a9a-d90d-4a4e-8e30-d6575486ff56] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:24.362694 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-16ecdda8-5a4f-4b19-8409-7ea5bc84c4ff tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:24.363381 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-16ecdda8-5a4f-4b19-8409-7ea5bc84c4ff tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:24.364006 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-16ecdda8-5a4f-4b19-8409-7ea5bc84c4ff tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:24.364884 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-16ecdda8-5a4f-4b19-8409-7ea5bc84c4ff tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:24.367768 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-16ecdda8-5a4f-4b19-8409-7ea5bc84c4ff tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:24.368511 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-16ecdda8-5a4f-4b19-8409-7ea5bc84c4ff tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:24.578096 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-bdc9718e-d3d4-4e01-994e-9a02db026263 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:24.597389 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-bdc9718e-d3d4-4e01-994e-9a02db026263 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:24.615537 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-bdc9718e-d3d4-4e01-994e-9a02db026263 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:24.617957 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-bdc9718e-d3d4-4e01-994e-9a02db026263 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] 10.222.0.43 "GET /compute/v2.1/servers/7222a4ce-d2a2-4b09-afc6-55bca52414d4" status: 200 len: 1411 microversion: 2.25 time: 0.929168 Oct 04 18:35:24.624153 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 527/1150] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:35:23 2022] GET /compute/v2.1/servers/7222a4ce-d2a2-4b09-afc6-55bca52414d4 => generated 1411 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:35:24.639207 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-883a7630-dd01-4fa3-af08-da59dad508c1 tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:24.649624 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-883a7630-dd01-4fa3-af08-da59dad508c1 tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] [instance: 37823428-1dab-4b0a-9ea1-7232766fc9b7] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:24.682719 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-883a7630-dd01-4fa3-af08-da59dad508c1 tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:24.684689 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-883a7630-dd01-4fa3-af08-da59dad508c1 tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:24.686325 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-883a7630-dd01-4fa3-af08-da59dad508c1 tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:24.688742 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-883a7630-dd01-4fa3-af08-da59dad508c1 tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:24.692556 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-883a7630-dd01-4fa3-af08-da59dad508c1 tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:24.694430 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-883a7630-dd01-4fa3-af08-da59dad508c1 tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:24.744133 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-16ecdda8-5a4f-4b19-8409-7ea5bc84c4ff tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a41ab6fb78a42ceaca621c5a38ffc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa31ed92017490a82497c7b8910aef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:24.761573 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-16ecdda8-5a4f-4b19-8409-7ea5bc84c4ff tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] 10.222.0.43 "GET /compute/v2.1/servers/93798a9a-d90d-4a4e-8e30-d6575486ff56" status: 200 len: 1474 microversion: 2.1 time: 0.414907 Oct 04 18:35:24.763016 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 624/1151] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:24 2022] GET /compute/v2.1/servers/93798a9a-d90d-4a4e-8e30-d6575486ff56 => generated 1474 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:35:24.776875 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-ee08f97f-6712-41e5-b556-49c358820bf5 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:24.780249 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-ee08f97f-6712-41e5-b556-49c358820bf5 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] [instance: 67e13bce-be81-4775-be5f-737add9f1694] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:24.796615 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ee08f97f-6712-41e5-b556-49c358820bf5 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:24.797423 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ee08f97f-6712-41e5-b556-49c358820bf5 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:24.798033 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ee08f97f-6712-41e5-b556-49c358820bf5 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:24.799602 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ee08f97f-6712-41e5-b556-49c358820bf5 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:24.803868 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ee08f97f-6712-41e5-b556-49c358820bf5 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:24.804549 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ee08f97f-6712-41e5-b556-49c358820bf5 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:24.996234 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-ee08f97f-6712-41e5-b556-49c358820bf5 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8b5e18327f4713a1e465acb9e863f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c849c5d04f44f7951908d740ec1689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:25.035713 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-ee08f97f-6712-41e5-b556-49c358820bf5 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d8b5e18327f4713a1e465acb9e863f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c849c5d04f44f7951908d740ec1689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:25.042520 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-ee08f97f-6712-41e5-b556-49c358820bf5 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d8b5e18327f4713a1e465acb9e863f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c849c5d04f44f7951908d740ec1689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:25.064249 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-ee08f97f-6712-41e5-b556-49c358820bf5 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] 10.222.0.43 "GET /compute/v2.1/servers/67e13bce-be81-4775-be5f-737add9f1694" status: 200 len: 1446 microversion: 2.75 time: 0.298546 Oct 04 18:35:25.069778 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 625/1152] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:35:24 2022] GET /compute/v2.1/servers/67e13bce-be81-4775-be5f-737add9f1694 => generated 1446 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:35:25.085535 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-7cf35e62-f9f9-4dbe-9ea1-1f65c343ec87 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1971113948"}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:35:25.094313 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-7cf35e62-f9f9-4dbe-9ea1-1f65c343ec87 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] [instance: 93798a9a-d90d-4a4e-8e30-d6575486ff56] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:25.119718 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7cf35e62-f9f9-4dbe-9ea1-1f65c343ec87 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:25.123884 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7cf35e62-f9f9-4dbe-9ea1-1f65c343ec87 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:25.124535 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7cf35e62-f9f9-4dbe-9ea1-1f65c343ec87 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:25.126074 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7cf35e62-f9f9-4dbe-9ea1-1f65c343ec87 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:25.131633 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7cf35e62-f9f9-4dbe-9ea1-1f65c343ec87 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:25.132372 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7cf35e62-f9f9-4dbe-9ea1-1f65c343ec87 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:25.495272 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=100 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:35:25.610513 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-7cf35e62-f9f9-4dbe-9ea1-1f65c343ec87 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] 10.222.0.43 "POST /compute/v2.1/servers/93798a9a-d90d-4a4e-8e30-d6575486ff56/action" status: 202 len: 0 microversion: 2.1 time: 0.539108 Oct 04 18:35:25.621281 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 626/1153] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 18:35:25 2022] POST /compute/v2.1/servers/93798a9a-d90d-4a4e-8e30-d6575486ff56/action => generated 0 bytes in 545 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 04 18:35:25.634584 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-8a11d279-0d01-4603-8635-26d39b8b3d12 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:25.637668 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-8a11d279-0d01-4603-8635-26d39b8b3d12 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] [instance: 84e0414b-a39f-4bfe-bc9d-c170ceb34d15] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:25.690137 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8a11d279-0d01-4603-8635-26d39b8b3d12 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:25.691082 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8a11d279-0d01-4603-8635-26d39b8b3d12 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:25.691836 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8a11d279-0d01-4603-8635-26d39b8b3d12 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:25.692833 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8a11d279-0d01-4603-8635-26d39b8b3d12 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:25.693436 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8a11d279-0d01-4603-8635-26d39b8b3d12 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:25.706742 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8a11d279-0d01-4603-8635-26d39b8b3d12 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:25.984421 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-883a7630-dd01-4fa3-af08-da59dad508c1 tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf77a83227f0404da7792695463b6714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc10a840253410ab9404ff4906eebc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:25.990328 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-8a11d279-0d01-4603-8635-26d39b8b3d12 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:26.007421 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-8a11d279-0d01-4603-8635-26d39b8b3d12 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:26.007950 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-883a7630-dd01-4fa3-af08-da59dad508c1 tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] 10.222.0.43 "GET /compute/v2.1/servers/37823428-1dab-4b0a-9ea1-7232766fc9b7" status: 200 len: 1403 microversion: 2.1 time: 1.381036 Oct 04 18:35:26.008666 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 528/1154] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:24 2022] GET /compute/v2.1/servers/37823428-1dab-4b0a-9ea1-7232766fc9b7 => generated 1403 bytes in 1384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:26.010541 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-8a11d279-0d01-4603-8635-26d39b8b3d12 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:26.032653 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-8a11d279-0d01-4603-8635-26d39b8b3d12 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] 10.222.0.43 "GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15" status: 200 len: 1553 microversion: 2.91 time: 0.414285 Oct 04 18:35:26.037637 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-a1193773-708c-457e-bc4e-9e1b9d0c353f req-d1b14150-c16f-4479-931e-9af42acf6994 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37823428-1dab-4b0a-9ea1-7232766fc9b7", "tag": "f96938f2-b281-4c53-8ec7-b2b1a3999f07"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:35:26.061040 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 627/1155] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:35:25 2022] GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15 => generated 1553 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:35:26.073437 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-2cb61861-b266-46e3-bdd9-9e6956607fc5 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Calling method '.version_select at 0x7fb227e02280>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:26.128099 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-a1193773-708c-457e-bc4e-9e1b9d0c353f req-d1b14150-c16f-4479-931e-9af42acf6994 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:26.128859 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-a1193773-708c-457e-bc4e-9e1b9d0c353f req-d1b14150-c16f-4479-931e-9af42acf6994 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:26.129621 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-a1193773-708c-457e-bc4e-9e1b9d0c353f req-d1b14150-c16f-4479-931e-9af42acf6994 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:26.142347 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-2cb61861-b266-46e3-bdd9-9e6956607fc5 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] 10.222.0.43 "GET /compute/v2.1/images/37400fa2-9016-4a4d-831a-321e28ef058c" status: 200 len: 1412 microversion: 2.1 time: 0.079916 Oct 04 18:35:26.144214 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 628/1156] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 18:35:26 2022] GET /compute/v2.1/images/37400fa2-9016-4a4d-831a-321e28ef058c => generated 1412 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:26.150480 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-be6c68d0-b15c-43b6-8f87-daead347c0e5 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:26.151543 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-be6c68d0-b15c-43b6-8f87-daead347c0e5 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] [instance: 7222a4ce-d2a2-4b09-afc6-55bca52414d4] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:26.162555 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-be6c68d0-b15c-43b6-8f87-daead347c0e5 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:26.163491 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-be6c68d0-b15c-43b6-8f87-daead347c0e5 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:26.165472 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-be6c68d0-b15c-43b6-8f87-daead347c0e5 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:26.168432 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-be6c68d0-b15c-43b6-8f87-daead347c0e5 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:26.170377 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-be6c68d0-b15c-43b6-8f87-daead347c0e5 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:26.171448 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-be6c68d0-b15c-43b6-8f87-daead347c0e5 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:26.174804 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-a1193773-708c-457e-bc4e-9e1b9d0c353f req-d1b14150-c16f-4479-931e-9af42acf6994 service nova] Creating event network-changed:f96938f2-b281-4c53-8ec7-b2b1a3999f07 for instance 37823428-1dab-4b0a-9ea1-7232766fc9b7 on n-h2-851028-13 Oct 04 18:35:26.190365 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-a1193773-708c-457e-bc4e-9e1b9d0c353f req-d1b14150-c16f-4479-931e-9af42acf6994 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.175047 Oct 04 18:35:26.204218 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 529/1157] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:35:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:35:26.231459 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-323ad7f7-8fa8-4e39-b937-1cbe3221a00d tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:26.237255 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-323ad7f7-8fa8-4e39-b937-1cbe3221a00d tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] [instance: 67e13bce-be81-4775-be5f-737add9f1694] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:26.257146 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-323ad7f7-8fa8-4e39-b937-1cbe3221a00d tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:26.259268 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-323ad7f7-8fa8-4e39-b937-1cbe3221a00d tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:26.262789 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-323ad7f7-8fa8-4e39-b937-1cbe3221a00d tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:26.268176 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-323ad7f7-8fa8-4e39-b937-1cbe3221a00d tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:26.271468 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-323ad7f7-8fa8-4e39-b937-1cbe3221a00d tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:26.272270 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-323ad7f7-8fa8-4e39-b937-1cbe3221a00d tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:26.492975 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-323ad7f7-8fa8-4e39-b937-1cbe3221a00d tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8b5e18327f4713a1e465acb9e863f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c849c5d04f44f7951908d740ec1689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:26.508851 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-323ad7f7-8fa8-4e39-b937-1cbe3221a00d tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d8b5e18327f4713a1e465acb9e863f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c849c5d04f44f7951908d740ec1689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:26.511315 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-323ad7f7-8fa8-4e39-b937-1cbe3221a00d tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d8b5e18327f4713a1e465acb9e863f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c849c5d04f44f7951908d740ec1689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:26.518232 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-323ad7f7-8fa8-4e39-b937-1cbe3221a00d tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] 10.222.0.43 "GET /compute/v2.1/servers/67e13bce-be81-4775-be5f-737add9f1694" status: 200 len: 1446 microversion: 2.75 time: 0.312285 Oct 04 18:35:26.519461 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 530/1158] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:35:26 2022] GET /compute/v2.1/servers/67e13bce-be81-4775-be5f-737add9f1694 => generated 1446 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:35:26.525535 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-be6c68d0-b15c-43b6-8f87-daead347c0e5 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:26.540871 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-be6c68d0-b15c-43b6-8f87-daead347c0e5 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:26.544178 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-be6c68d0-b15c-43b6-8f87-daead347c0e5 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:26.546171 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-be6c68d0-b15c-43b6-8f87-daead347c0e5 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] 10.222.0.43 "GET /compute/v2.1/servers/7222a4ce-d2a2-4b09-afc6-55bca52414d4" status: 200 len: 1411 microversion: 2.25 time: 0.400766 Oct 04 18:35:26.557956 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 629/1159] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:35:26 2022] GET /compute/v2.1/servers/7222a4ce-d2a2-4b09-afc6-55bca52414d4 => generated 1411 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:35:26.568228 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-613ff8ad-e768-4db5-9f8d-18fb65c6128f req-9568fe51-b66d-451f-bc57-639e9136f486 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7222a4ce-d2a2-4b09-afc6-55bca52414d4", "name": "network-vif-plugged", "status": "completed", "tag": "dc9d53f5-3f85-42de-8651-845234788630"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:35:26.587644 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-613ff8ad-e768-4db5-9f8d-18fb65c6128f req-9568fe51-b66d-451f-bc57-639e9136f486 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:26.587644 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-613ff8ad-e768-4db5-9f8d-18fb65c6128f req-9568fe51-b66d-451f-bc57-639e9136f486 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:26.590208 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-613ff8ad-e768-4db5-9f8d-18fb65c6128f req-9568fe51-b66d-451f-bc57-639e9136f486 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:26.631105 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-613ff8ad-e768-4db5-9f8d-18fb65c6128f req-9568fe51-b66d-451f-bc57-639e9136f486 service nova] Creating event network-vif-plugged:dc9d53f5-3f85-42de-8651-845234788630 for instance 7222a4ce-d2a2-4b09-afc6-55bca52414d4 on n-h1-851028-13 Oct 04 18:35:26.656616 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-613ff8ad-e768-4db5-9f8d-18fb65c6128f req-9568fe51-b66d-451f-bc57-639e9136f486 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091626 Oct 04 18:35:26.657617 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 531/1160] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:35:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:35:27.046994 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f6433945-cbba-431e-aa45-b74a0a82da46 tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:27.048831 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-f6433945-cbba-431e-aa45-b74a0a82da46 tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] [instance: 37823428-1dab-4b0a-9ea1-7232766fc9b7] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:27.060110 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f6433945-cbba-431e-aa45-b74a0a82da46 tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:27.061886 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f6433945-cbba-431e-aa45-b74a0a82da46 tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:27.065002 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f6433945-cbba-431e-aa45-b74a0a82da46 tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:27.067809 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f6433945-cbba-431e-aa45-b74a0a82da46 tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:27.068534 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f6433945-cbba-431e-aa45-b74a0a82da46 tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:27.070785 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f6433945-cbba-431e-aa45-b74a0a82da46 tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:27.099952 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-18cc8e9d-fefd-47d9-9a39-5e9fc59a3a37 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:27.102256 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-18cc8e9d-fefd-47d9-9a39-5e9fc59a3a37 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] [instance: 84e0414b-a39f-4bfe-bc9d-c170ceb34d15] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:27.141845 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-18cc8e9d-fefd-47d9-9a39-5e9fc59a3a37 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:27.143107 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-18cc8e9d-fefd-47d9-9a39-5e9fc59a3a37 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:27.143875 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-18cc8e9d-fefd-47d9-9a39-5e9fc59a3a37 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:27.149984 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-18cc8e9d-fefd-47d9-9a39-5e9fc59a3a37 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:27.151062 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-18cc8e9d-fefd-47d9-9a39-5e9fc59a3a37 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:27.152289 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-18cc8e9d-fefd-47d9-9a39-5e9fc59a3a37 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:27.381593 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-18cc8e9d-fefd-47d9-9a39-5e9fc59a3a37 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:27.392706 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-18cc8e9d-fefd-47d9-9a39-5e9fc59a3a37 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:27.417782 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-18cc8e9d-fefd-47d9-9a39-5e9fc59a3a37 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:27.429456 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-18cc8e9d-fefd-47d9-9a39-5e9fc59a3a37 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] 10.222.0.43 "GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15" status: 200 len: 1553 microversion: 2.91 time: 0.352094 Oct 04 18:35:27.436024 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 532/1161] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:35:27 2022] GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15 => generated 1553 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:35:27.444088 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-5d867982-ad68-4fe1-aece-fd509d920b32 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Calling method '.version_select at 0x7fb21fb25820>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:27.490683 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-f6433945-cbba-431e-aa45-b74a0a82da46 tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf77a83227f0404da7792695463b6714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc10a840253410ab9404ff4906eebc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:27.509505 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-f6433945-cbba-431e-aa45-b74a0a82da46 tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] 10.222.0.43 "GET /compute/v2.1/servers/37823428-1dab-4b0a-9ea1-7232766fc9b7" status: 200 len: 1403 microversion: 2.1 time: 0.473348 Oct 04 18:35:27.510160 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 630/1162] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:27 2022] GET /compute/v2.1/servers/37823428-1dab-4b0a-9ea1-7232766fc9b7 => generated 1403 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:27.552360 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-5d867982-ad68-4fe1-aece-fd509d920b32 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] 10.222.0.43 "GET /compute/v2.1/images/37400fa2-9016-4a4d-831a-321e28ef058c" status: 200 len: 1412 microversion: 2.1 time: 0.114307 Oct 04 18:35:27.555735 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 533/1163] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 18:35:27 2022] GET /compute/v2.1/images/37400fa2-9016-4a4d-831a-321e28ef058c => generated 1412 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:27.566152 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-974b26b2-e5e3-4ac6-9ccf-1c74cb84bd1b tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:27.566152 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-974b26b2-e5e3-4ac6-9ccf-1c74cb84bd1b tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] [instance: 67e13bce-be81-4775-be5f-737add9f1694] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:27.588673 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-974b26b2-e5e3-4ac6-9ccf-1c74cb84bd1b tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:27.589462 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-974b26b2-e5e3-4ac6-9ccf-1c74cb84bd1b tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:27.590166 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-974b26b2-e5e3-4ac6-9ccf-1c74cb84bd1b tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:27.591132 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-974b26b2-e5e3-4ac6-9ccf-1c74cb84bd1b tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:27.592895 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-974b26b2-e5e3-4ac6-9ccf-1c74cb84bd1b tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:27.593481 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-974b26b2-e5e3-4ac6-9ccf-1c74cb84bd1b tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:27.595238 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-9d1afc95-2528-40e0-9640-c69107143467 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:27.598028 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-9d1afc95-2528-40e0-9640-c69107143467 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] [instance: 7222a4ce-d2a2-4b09-afc6-55bca52414d4] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:27.618041 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9d1afc95-2528-40e0-9640-c69107143467 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:27.619468 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9d1afc95-2528-40e0-9640-c69107143467 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:27.619944 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9d1afc95-2528-40e0-9640-c69107143467 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:27.620753 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9d1afc95-2528-40e0-9640-c69107143467 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:27.621237 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9d1afc95-2528-40e0-9640-c69107143467 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:27.621662 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9d1afc95-2528-40e0-9640-c69107143467 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:27.840422 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=10 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:35:27.859996 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-974b26b2-e5e3-4ac6-9ccf-1c74cb84bd1b tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8b5e18327f4713a1e465acb9e863f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c849c5d04f44f7951908d740ec1689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:27.875374 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-974b26b2-e5e3-4ac6-9ccf-1c74cb84bd1b tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d8b5e18327f4713a1e465acb9e863f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c849c5d04f44f7951908d740ec1689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:27.878747 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-974b26b2-e5e3-4ac6-9ccf-1c74cb84bd1b tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d8b5e18327f4713a1e465acb9e863f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c849c5d04f44f7951908d740ec1689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:27.892348 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-974b26b2-e5e3-4ac6-9ccf-1c74cb84bd1b tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] 10.222.0.43 "GET /compute/v2.1/servers/67e13bce-be81-4775-be5f-737add9f1694" status: 200 len: 1446 microversion: 2.75 time: 0.336069 Oct 04 18:35:27.905148 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 631/1164] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:35:27 2022] GET /compute/v2.1/servers/67e13bce-be81-4775-be5f-737add9f1694 => generated 1446 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:35:28.487174 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-803fe28c-da8a-4ffa-b5bb-2bdf5fcf62ab tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:28.487807 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-803fe28c-da8a-4ffa-b5bb-2bdf5fcf62ab tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] [instance: 84e0414b-a39f-4bfe-bc9d-c170ceb34d15] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:28.503079 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-803fe28c-da8a-4ffa-b5bb-2bdf5fcf62ab tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:28.504397 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-803fe28c-da8a-4ffa-b5bb-2bdf5fcf62ab tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:28.504847 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-803fe28c-da8a-4ffa-b5bb-2bdf5fcf62ab tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:28.506483 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-803fe28c-da8a-4ffa-b5bb-2bdf5fcf62ab tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:28.506951 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-803fe28c-da8a-4ffa-b5bb-2bdf5fcf62ab tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:28.507389 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-803fe28c-da8a-4ffa-b5bb-2bdf5fcf62ab tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:28.691846 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-803fe28c-da8a-4ffa-b5bb-2bdf5fcf62ab tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:28.698378 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-9d1afc95-2528-40e0-9640-c69107143467 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:28.703837 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=14 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:35:28.720177 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-803fe28c-da8a-4ffa-b5bb-2bdf5fcf62ab tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:28.728267 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-803fe28c-da8a-4ffa-b5bb-2bdf5fcf62ab tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:28.729017 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-9d1afc95-2528-40e0-9640-c69107143467 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:28.732536 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-9d1afc95-2528-40e0-9640-c69107143467 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:28.734822 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-9d1afc95-2528-40e0-9640-c69107143467 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] 10.222.0.43 "GET /compute/v2.1/servers/7222a4ce-d2a2-4b09-afc6-55bca52414d4" status: 200 len: 1411 microversion: 2.25 time: 1.163708 Oct 04 18:35:28.745591 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 534/1165] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:35:27 2022] GET /compute/v2.1/servers/7222a4ce-d2a2-4b09-afc6-55bca52414d4 => generated 1411 bytes in 1175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:35:28.759107 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-803fe28c-da8a-4ffa-b5bb-2bdf5fcf62ab tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] 10.222.0.43 "GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15" status: 200 len: 1553 microversion: 2.91 time: 0.299337 Oct 04 18:35:28.764046 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-741bd297-1eda-4949-848d-669a6ba29a6f tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:28.773336 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-741bd297-1eda-4949-848d-669a6ba29a6f tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] [instance: 37823428-1dab-4b0a-9ea1-7232766fc9b7] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:28.799528 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-741bd297-1eda-4949-848d-669a6ba29a6f tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:28.800434 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-741bd297-1eda-4949-848d-669a6ba29a6f tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:28.802474 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 632/1166] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:35:28 2022] GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15 => generated 1553 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:35:28.809377 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-741bd297-1eda-4949-848d-669a6ba29a6f tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:28.811489 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-741bd297-1eda-4949-848d-669a6ba29a6f tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:28.812343 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-741bd297-1eda-4949-848d-669a6ba29a6f tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:28.820497 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-741bd297-1eda-4949-848d-669a6ba29a6f tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:28.821736 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-b5be2843-a036-48a9-b2e0-5923ecdd4ca5 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Calling method '.version_select at 0x7fb227e5d1f0>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:28.909543 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-b5be2843-a036-48a9-b2e0-5923ecdd4ca5 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] 10.222.0.43 "GET /compute/v2.1/images/37400fa2-9016-4a4d-831a-321e28ef058c" status: 200 len: 1412 microversion: 2.1 time: 0.105801 Oct 04 18:35:28.940746 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 633/1167] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 18:35:28 2022] GET /compute/v2.1/images/37400fa2-9016-4a4d-831a-321e28ef058c => generated 1412 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:28.961818 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f13f2260-a16d-45b8-bffb-b31838f7dbb6 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:28.980707 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-f13f2260-a16d-45b8-bffb-b31838f7dbb6 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] [instance: 67e13bce-be81-4775-be5f-737add9f1694] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:29.019656 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f13f2260-a16d-45b8-bffb-b31838f7dbb6 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:29.022361 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f13f2260-a16d-45b8-bffb-b31838f7dbb6 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:29.024212 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f13f2260-a16d-45b8-bffb-b31838f7dbb6 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:29.027375 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f13f2260-a16d-45b8-bffb-b31838f7dbb6 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:29.030247 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f13f2260-a16d-45b8-bffb-b31838f7dbb6 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:29.035852 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f13f2260-a16d-45b8-bffb-b31838f7dbb6 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:29.254283 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-f13f2260-a16d-45b8-bffb-b31838f7dbb6 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8b5e18327f4713a1e465acb9e863f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c849c5d04f44f7951908d740ec1689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:29.276635 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-f13f2260-a16d-45b8-bffb-b31838f7dbb6 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d8b5e18327f4713a1e465acb9e863f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c849c5d04f44f7951908d740ec1689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:29.285606 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-f13f2260-a16d-45b8-bffb-b31838f7dbb6 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d8b5e18327f4713a1e465acb9e863f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c849c5d04f44f7951908d740ec1689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:29.313567 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-f13f2260-a16d-45b8-bffb-b31838f7dbb6 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] 10.222.0.43 "GET /compute/v2.1/servers/67e13bce-be81-4775-be5f-737add9f1694" status: 200 len: 1446 microversion: 2.75 time: 0.368775 Oct 04 18:35:29.337634 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 634/1168] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:35:28 2022] GET /compute/v2.1/servers/67e13bce-be81-4775-be5f-737add9f1694 => generated 1446 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:35:29.769628 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-819d7179-c3ca-4f77-a215-270d7d12d87c tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:29.771301 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-819d7179-c3ca-4f77-a215-270d7d12d87c tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] [instance: 7222a4ce-d2a2-4b09-afc6-55bca52414d4] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:29.794971 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-819d7179-c3ca-4f77-a215-270d7d12d87c tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:29.795652 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-819d7179-c3ca-4f77-a215-270d7d12d87c tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:29.796103 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-819d7179-c3ca-4f77-a215-270d7d12d87c tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:29.796841 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-819d7179-c3ca-4f77-a215-270d7d12d87c tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:29.800564 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-819d7179-c3ca-4f77-a215-270d7d12d87c tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:29.800564 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-819d7179-c3ca-4f77-a215-270d7d12d87c tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:30.218872 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-819d7179-c3ca-4f77-a215-270d7d12d87c tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:30.237405 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-819d7179-c3ca-4f77-a215-270d7d12d87c tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:30.239523 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-819d7179-c3ca-4f77-a215-270d7d12d87c tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:30.268589 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-819d7179-c3ca-4f77-a215-270d7d12d87c tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] 10.222.0.43 "GET /compute/v2.1/servers/7222a4ce-d2a2-4b09-afc6-55bca52414d4" status: 200 len: 1608 microversion: 2.25 time: 0.506385 Oct 04 18:35:30.272951 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 635/1169] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:35:29 2022] GET /compute/v2.1/servers/7222a4ce-d2a2-4b09-afc6-55bca52414d4 => generated 1608 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:35:30.290413 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-0f80fb69-cd3f-4db6-b58b-6185f05177b8 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:30.292236 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-0f80fb69-cd3f-4db6-b58b-6185f05177b8 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] [instance: 84e0414b-a39f-4bfe-bc9d-c170ceb34d15] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:30.307592 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0f80fb69-cd3f-4db6-b58b-6185f05177b8 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:30.309532 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0f80fb69-cd3f-4db6-b58b-6185f05177b8 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:30.311619 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0f80fb69-cd3f-4db6-b58b-6185f05177b8 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:30.314185 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0f80fb69-cd3f-4db6-b58b-6185f05177b8 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:30.316577 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0f80fb69-cd3f-4db6-b58b-6185f05177b8 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:30.317275 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0f80fb69-cd3f-4db6-b58b-6185f05177b8 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:30.456354 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-741bd297-1eda-4949-848d-669a6ba29a6f tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf77a83227f0404da7792695463b6714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc10a840253410ab9404ff4906eebc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:30.476126 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-741bd297-1eda-4949-848d-669a6ba29a6f tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] 10.222.0.43 "GET /compute/v2.1/servers/37823428-1dab-4b0a-9ea1-7232766fc9b7" status: 200 len: 1403 microversion: 2.1 time: 1.725420 Oct 04 18:35:30.476836 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 535/1170] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:28 2022] GET /compute/v2.1/servers/37823428-1dab-4b0a-9ea1-7232766fc9b7 => generated 1403 bytes in 1730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:30.488621 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-0f80fb69-cd3f-4db6-b58b-6185f05177b8 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:30.502787 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-d97110fb-f4bc-47e4-a2fe-9912121b91fa tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Calling method '.version_select at 0x7fb21fc315e0>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:30.505069 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-0f80fb69-cd3f-4db6-b58b-6185f05177b8 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:30.518875 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-0f80fb69-cd3f-4db6-b58b-6185f05177b8 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:30.534207 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-0f80fb69-cd3f-4db6-b58b-6185f05177b8 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] 10.222.0.43 "GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15" status: 200 len: 1553 microversion: 2.91 time: 0.256888 Oct 04 18:35:30.538407 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 636/1171] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:35:30 2022] GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15 => generated 1553 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:35:30.558507 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-45cdaad3-865e-49f2-8ed5-512327742766 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:30.560850 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-45cdaad3-865e-49f2-8ed5-512327742766 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] [instance: 7222a4ce-d2a2-4b09-afc6-55bca52414d4] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:30.572388 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_api:SELECT=100 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:35:30.588697 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-45cdaad3-865e-49f2-8ed5-512327742766 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:30.594054 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-45cdaad3-865e-49f2-8ed5-512327742766 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:30.602712 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-45cdaad3-865e-49f2-8ed5-512327742766 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:30.603747 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-45cdaad3-865e-49f2-8ed5-512327742766 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:30.605563 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-45cdaad3-865e-49f2-8ed5-512327742766 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:30.608157 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-45cdaad3-865e-49f2-8ed5-512327742766 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:30.820254 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-45cdaad3-865e-49f2-8ed5-512327742766 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] 10.222.0.43 "GET /compute/v2.1/servers/7222a4ce-d2a2-4b09-afc6-55bca52414d4/os-interface" status: 200 len: 285 microversion: 2.25 time: 0.278970 Oct 04 18:35:30.821960 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 637/1172] 10.222.0.43 () {60 vars in 1316 bytes} [Tue Oct 4 18:35:30 2022] GET /compute/v2.1/servers/7222a4ce-d2a2-4b09-afc6-55bca52414d4/os-interface => generated 285 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:35:30.833309 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-67d77130-e41e-4603-b4b0-8e5dffa5ff67 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:30.833943 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-67d77130-e41e-4603-b4b0-8e5dffa5ff67 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] [instance: 67e13bce-be81-4775-be5f-737add9f1694] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:30.857852 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-67d77130-e41e-4603-b4b0-8e5dffa5ff67 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:30.858576 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-67d77130-e41e-4603-b4b0-8e5dffa5ff67 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:30.859042 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-67d77130-e41e-4603-b4b0-8e5dffa5ff67 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:30.859796 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-67d77130-e41e-4603-b4b0-8e5dffa5ff67 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:30.860304 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-67d77130-e41e-4603-b4b0-8e5dffa5ff67 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:30.860690 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-67d77130-e41e-4603-b4b0-8e5dffa5ff67 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:31.364934 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-67d77130-e41e-4603-b4b0-8e5dffa5ff67 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8b5e18327f4713a1e465acb9e863f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c849c5d04f44f7951908d740ec1689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:31.385441 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-67d77130-e41e-4603-b4b0-8e5dffa5ff67 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d8b5e18327f4713a1e465acb9e863f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c849c5d04f44f7951908d740ec1689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:31.398312 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-67d77130-e41e-4603-b4b0-8e5dffa5ff67 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d8b5e18327f4713a1e465acb9e863f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c849c5d04f44f7951908d740ec1689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:31.422973 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-67d77130-e41e-4603-b4b0-8e5dffa5ff67 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] 10.222.0.43 "GET /compute/v2.1/servers/67e13bce-be81-4775-be5f-737add9f1694" status: 200 len: 1446 microversion: 2.75 time: 0.598389 Oct 04 18:35:31.430111 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 638/1173] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:35:30 2022] GET /compute/v2.1/servers/67e13bce-be81-4775-be5f-737add9f1694 => generated 1446 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:35:31.453061 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-78c4f931-f964-4935-959c-f1197b80a21a req-43b7ebd3-b0cc-4ee4-b9f0-32dd7c1de75a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93798a9a-d90d-4a4e-8e30-d6575486ff56", "name": "network-vif-plugged", "status": "completed", "tag": "7b3aff25-35c6-4d42-9b23-577e2f738102"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:35:31.507332 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-78c4f931-f964-4935-959c-f1197b80a21a req-43b7ebd3-b0cc-4ee4-b9f0-32dd7c1de75a service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:31.508037 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-78c4f931-f964-4935-959c-f1197b80a21a req-43b7ebd3-b0cc-4ee4-b9f0-32dd7c1de75a service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:31.508580 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-78c4f931-f964-4935-959c-f1197b80a21a req-43b7ebd3-b0cc-4ee4-b9f0-32dd7c1de75a service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:31.563484 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-78c4f931-f964-4935-959c-f1197b80a21a req-43b7ebd3-b0cc-4ee4-b9f0-32dd7c1de75a service nova] Creating event network-vif-plugged:7b3aff25-35c6-4d42-9b23-577e2f738102 for instance 93798a9a-d90d-4a4e-8e30-d6575486ff56 on n-h1-851028-13 Oct 04 18:35:31.596689 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-78c4f931-f964-4935-959c-f1197b80a21a req-43b7ebd3-b0cc-4ee4-b9f0-32dd7c1de75a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.163405 Oct 04 18:35:31.602043 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 639/1174] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:35:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:35:31.620349 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-90c7a79c-cc32-4934-a456-49e455891b41 tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:31.638787 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-90c7a79c-cc32-4934-a456-49e455891b41 tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] [instance: 37823428-1dab-4b0a-9ea1-7232766fc9b7] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:31.662387 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=6 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:35:31.672230 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-90c7a79c-cc32-4934-a456-49e455891b41 tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:31.674375 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-90c7a79c-cc32-4934-a456-49e455891b41 tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:31.677866 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-90c7a79c-cc32-4934-a456-49e455891b41 tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:31.680538 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-90c7a79c-cc32-4934-a456-49e455891b41 tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:31.687255 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-90c7a79c-cc32-4934-a456-49e455891b41 tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:31.694903 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-90c7a79c-cc32-4934-a456-49e455891b41 tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:31.881562 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=4 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:35:32.125762 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-90c7a79c-cc32-4934-a456-49e455891b41 tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf77a83227f0404da7792695463b6714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc10a840253410ab9404ff4906eebc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:32.153872 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-90c7a79c-cc32-4934-a456-49e455891b41 tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] 10.222.0.43 "GET /compute/v2.1/servers/37823428-1dab-4b0a-9ea1-7232766fc9b7" status: 200 len: 1403 microversion: 2.1 time: 0.526236 Oct 04 18:35:32.161467 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 640/1175] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:31 2022] GET /compute/v2.1/servers/37823428-1dab-4b0a-9ea1-7232766fc9b7 => generated 1403 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:32.166901 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f9d5e55c-bcc8-4cf6-9083-61457a151ad7 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:32.167760 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-f9d5e55c-bcc8-4cf6-9083-61457a151ad7 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] [instance: 84e0414b-a39f-4bfe-bc9d-c170ceb34d15] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:32.194783 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f9d5e55c-bcc8-4cf6-9083-61457a151ad7 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:32.195303 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f9d5e55c-bcc8-4cf6-9083-61457a151ad7 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:32.195758 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f9d5e55c-bcc8-4cf6-9083-61457a151ad7 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:32.198681 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f9d5e55c-bcc8-4cf6-9083-61457a151ad7 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:32.199227 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f9d5e55c-bcc8-4cf6-9083-61457a151ad7 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:32.201922 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f9d5e55c-bcc8-4cf6-9083-61457a151ad7 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:33.106022 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-f9d5e55c-bcc8-4cf6-9083-61457a151ad7 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:33.122120 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-f9d5e55c-bcc8-4cf6-9083-61457a151ad7 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:33.128079 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-f9d5e55c-bcc8-4cf6-9083-61457a151ad7 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:33.141092 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-f9d5e55c-bcc8-4cf6-9083-61457a151ad7 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] 10.222.0.43 "GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15" status: 200 len: 1553 microversion: 2.91 time: 0.978226 Oct 04 18:35:33.142952 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 641/1176] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:35:32 2022] GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15 => generated 1553 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:35:33.163144 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-39776858-58b4-4aca-bbe7-179e49407b80 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "046cae51-6b65-41f0-81e1-45da3fb3e511"}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:35:33.178233 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-39776858-58b4-4aca-bbe7-179e49407b80 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] [instance: eb05639b-cd53-4c27-9505-20e668a16acc] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:33.187721 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-39776858-58b4-4aca-bbe7-179e49407b80 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:33.188508 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-39776858-58b4-4aca-bbe7-179e49407b80 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:33.189137 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-39776858-58b4-4aca-bbe7-179e49407b80 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:33.190443 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-39776858-58b4-4aca-bbe7-179e49407b80 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:33.191101 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-39776858-58b4-4aca-bbe7-179e49407b80 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:33.192008 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-39776858-58b4-4aca-bbe7-179e49407b80 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:34.000643 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-39776858-58b4-4aca-bbe7-179e49407b80 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] 10.222.0.43 "POST /compute/v2.1/servers/eb05639b-cd53-4c27-9505-20e668a16acc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.850160 Oct 04 18:35:34.005151 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 642/1177] 10.222.0.43 () {60 vars in 1323 bytes} [Tue Oct 4 18:35:33 2022] POST /compute/v2.1/servers/eb05639b-cd53-4c27-9505-20e668a16acc/os-volume_attachments => generated 194 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:35:34.031255 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-70e04f18-43bb-48cd-b86c-c96245c00345 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:34.035343 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-70e04f18-43bb-48cd-b86c-c96245c00345 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] [instance: 67e13bce-be81-4775-be5f-737add9f1694] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:34.095364 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-70e04f18-43bb-48cd-b86c-c96245c00345 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:34.095847 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-70e04f18-43bb-48cd-b86c-c96245c00345 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:34.096299 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-70e04f18-43bb-48cd-b86c-c96245c00345 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:34.114426 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-70e04f18-43bb-48cd-b86c-c96245c00345 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:34.122108 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-70e04f18-43bb-48cd-b86c-c96245c00345 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:34.122734 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-70e04f18-43bb-48cd-b86c-c96245c00345 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:34.594107 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-70e04f18-43bb-48cd-b86c-c96245c00345 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8b5e18327f4713a1e465acb9e863f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c849c5d04f44f7951908d740ec1689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:34.616839 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-70e04f18-43bb-48cd-b86c-c96245c00345 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d8b5e18327f4713a1e465acb9e863f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c849c5d04f44f7951908d740ec1689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:34.620642 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-70e04f18-43bb-48cd-b86c-c96245c00345 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d8b5e18327f4713a1e465acb9e863f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c849c5d04f44f7951908d740ec1689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:34.640487 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-70e04f18-43bb-48cd-b86c-c96245c00345 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] 10.222.0.43 "GET /compute/v2.1/servers/67e13bce-be81-4775-be5f-737add9f1694" status: 200 len: 1446 microversion: 2.75 time: 0.633918 Oct 04 18:35:34.674991 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 643/1178] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:35:34 2022] GET /compute/v2.1/servers/67e13bce-be81-4775-be5f-737add9f1694 => generated 1446 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:35:34.707362 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-fb49c888-116b-4a31-bcfd-0b82ad41cd4e tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:34.708268 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-fb49c888-116b-4a31-bcfd-0b82ad41cd4e tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] [instance: 37823428-1dab-4b0a-9ea1-7232766fc9b7] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:34.728371 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fb49c888-116b-4a31-bcfd-0b82ad41cd4e tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:34.737664 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fb49c888-116b-4a31-bcfd-0b82ad41cd4e tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:34.740110 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fb49c888-116b-4a31-bcfd-0b82ad41cd4e tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:34.741568 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fb49c888-116b-4a31-bcfd-0b82ad41cd4e tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:34.744318 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fb49c888-116b-4a31-bcfd-0b82ad41cd4e tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:34.744984 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fb49c888-116b-4a31-bcfd-0b82ad41cd4e tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:34.810724 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:UPDATE=3,nova_cell1:SELECT=95,nova_cell1:INSERT=2 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:35:35.318628 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-fb49c888-116b-4a31-bcfd-0b82ad41cd4e tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf77a83227f0404da7792695463b6714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc10a840253410ab9404ff4906eebc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:35.361415 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-fb49c888-116b-4a31-bcfd-0b82ad41cd4e tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] 10.222.0.43 "GET /compute/v2.1/servers/37823428-1dab-4b0a-9ea1-7232766fc9b7" status: 200 len: 1403 microversion: 2.1 time: 0.678365 Oct 04 18:35:35.369874 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 644/1179] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:34 2022] GET /compute/v2.1/servers/37823428-1dab-4b0a-9ea1-7232766fc9b7 => generated 1403 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:35.392135 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-2eed6746-87d5-44db-a440-285d98c465d4 req-b61361d1-b68d-444c-a469-24ce75474ce2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37823428-1dab-4b0a-9ea1-7232766fc9b7", "name": "network-vif-plugged", "status": "completed", "tag": "f96938f2-b281-4c53-8ec7-b2b1a3999f07"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:35:35.428857 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-2eed6746-87d5-44db-a440-285d98c465d4 req-b61361d1-b68d-444c-a469-24ce75474ce2 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:35.430460 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-2eed6746-87d5-44db-a440-285d98c465d4 req-b61361d1-b68d-444c-a469-24ce75474ce2 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:35.432248 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-2eed6746-87d5-44db-a440-285d98c465d4 req-b61361d1-b68d-444c-a469-24ce75474ce2 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:35.470623 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-2eed6746-87d5-44db-a440-285d98c465d4 req-b61361d1-b68d-444c-a469-24ce75474ce2 service nova] Creating event network-vif-plugged:f96938f2-b281-4c53-8ec7-b2b1a3999f07 for instance 37823428-1dab-4b0a-9ea1-7232766fc9b7 on n-h2-851028-13 Oct 04 18:35:35.478754 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-2eed6746-87d5-44db-a440-285d98c465d4 req-b61361d1-b68d-444c-a469-24ce75474ce2 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107505 Oct 04 18:35:35.481549 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 645/1180] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:35:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:35:35.495530 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-b074c851-b1b9-4252-80fd-ff392a7e9fa4 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:35.496803 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-b074c851-b1b9-4252-80fd-ff392a7e9fa4 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] [instance: 84e0414b-a39f-4bfe-bc9d-c170ceb34d15] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:35.557286 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b074c851-b1b9-4252-80fd-ff392a7e9fa4 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:35.566084 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b074c851-b1b9-4252-80fd-ff392a7e9fa4 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:35.569079 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b074c851-b1b9-4252-80fd-ff392a7e9fa4 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:35.582372 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b074c851-b1b9-4252-80fd-ff392a7e9fa4 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:35.583195 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b074c851-b1b9-4252-80fd-ff392a7e9fa4 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:35.583539 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b074c851-b1b9-4252-80fd-ff392a7e9fa4 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:35.939198 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-b074c851-b1b9-4252-80fd-ff392a7e9fa4 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:35.951306 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-b074c851-b1b9-4252-80fd-ff392a7e9fa4 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:35.961333 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-b074c851-b1b9-4252-80fd-ff392a7e9fa4 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:36.001727 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-b074c851-b1b9-4252-80fd-ff392a7e9fa4 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] 10.222.0.43 "GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15" status: 200 len: 1553 microversion: 2.91 time: 0.516915 Oct 04 18:35:36.012010 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 646/1181] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:35:35 2022] GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15 => generated 1553 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:35:36.021181 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-7575f75d-b80b-4003-bcd2-b17de54957ab tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:36.022111 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-7575f75d-b80b-4003-bcd2-b17de54957ab tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] [instance: 67e13bce-be81-4775-be5f-737add9f1694] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:36.065771 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7575f75d-b80b-4003-bcd2-b17de54957ab tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:36.066293 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7575f75d-b80b-4003-bcd2-b17de54957ab tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:36.079946 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7575f75d-b80b-4003-bcd2-b17de54957ab tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:36.080777 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7575f75d-b80b-4003-bcd2-b17de54957ab tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:36.082986 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7575f75d-b80b-4003-bcd2-b17de54957ab tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:36.083474 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7575f75d-b80b-4003-bcd2-b17de54957ab tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:36.339285 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-7575f75d-b80b-4003-bcd2-b17de54957ab tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8b5e18327f4713a1e465acb9e863f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c849c5d04f44f7951908d740ec1689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:36.357693 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-7575f75d-b80b-4003-bcd2-b17de54957ab tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d8b5e18327f4713a1e465acb9e863f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c849c5d04f44f7951908d740ec1689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:36.359768 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-7575f75d-b80b-4003-bcd2-b17de54957ab tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d8b5e18327f4713a1e465acb9e863f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c849c5d04f44f7951908d740ec1689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:36.398012 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-7575f75d-b80b-4003-bcd2-b17de54957ab tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] 10.222.0.43 "GET /compute/v2.1/servers/67e13bce-be81-4775-be5f-737add9f1694" status: 200 len: 1446 microversion: 2.75 time: 0.371620 Oct 04 18:35:36.398626 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 647/1182] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:35:36 2022] GET /compute/v2.1/servers/67e13bce-be81-4775-be5f-737add9f1694 => generated 1446 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:35:36.414789 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-f732c0ab-00e5-4aff-a890-ef939b5aac36 req-afb3a1ab-c4d6-4fb3-8d84-e1a6c4481ead service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7222a4ce-d2a2-4b09-afc6-55bca52414d4", "tag": "dc9d53f5-3f85-42de-8651-845234788630"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:35:36.458629 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-f732c0ab-00e5-4aff-a890-ef939b5aac36 req-afb3a1ab-c4d6-4fb3-8d84-e1a6c4481ead service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:36.459121 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-f732c0ab-00e5-4aff-a890-ef939b5aac36 req-afb3a1ab-c4d6-4fb3-8d84-e1a6c4481ead service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:36.459714 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-f732c0ab-00e5-4aff-a890-ef939b5aac36 req-afb3a1ab-c4d6-4fb3-8d84-e1a6c4481ead service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:36.503769 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-f732c0ab-00e5-4aff-a890-ef939b5aac36 req-afb3a1ab-c4d6-4fb3-8d84-e1a6c4481ead service nova] Creating event network-changed:dc9d53f5-3f85-42de-8651-845234788630 for instance 7222a4ce-d2a2-4b09-afc6-55bca52414d4 on n-h1-851028-13 Oct 04 18:35:36.514398 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-f732c0ab-00e5-4aff-a890-ef939b5aac36 req-afb3a1ab-c4d6-4fb3-8d84-e1a6c4481ead service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113051 Oct 04 18:35:36.522949 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 648/1183] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:35:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:35:36.532897 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-87a07b4d-78fa-4e9c-a6b8-2c02e1bba27d tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:36.537387 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-87a07b4d-78fa-4e9c-a6b8-2c02e1bba27d tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] [instance: 37823428-1dab-4b0a-9ea1-7232766fc9b7] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:36.552691 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-87a07b4d-78fa-4e9c-a6b8-2c02e1bba27d tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:36.555733 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-87a07b4d-78fa-4e9c-a6b8-2c02e1bba27d tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:36.556563 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-87a07b4d-78fa-4e9c-a6b8-2c02e1bba27d tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:36.559818 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-87a07b4d-78fa-4e9c-a6b8-2c02e1bba27d tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:36.567260 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-87a07b4d-78fa-4e9c-a6b8-2c02e1bba27d tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:36.568010 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-87a07b4d-78fa-4e9c-a6b8-2c02e1bba27d tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:37.011490 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-87a07b4d-78fa-4e9c-a6b8-2c02e1bba27d tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf77a83227f0404da7792695463b6714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc10a840253410ab9404ff4906eebc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:37.020905 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-87a07b4d-78fa-4e9c-a6b8-2c02e1bba27d tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] 10.222.0.43 "GET /compute/v2.1/servers/37823428-1dab-4b0a-9ea1-7232766fc9b7" status: 200 len: 1403 microversion: 2.1 time: 0.496359 Oct 04 18:35:37.039226 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 649/1184] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:36 2022] GET /compute/v2.1/servers/37823428-1dab-4b0a-9ea1-7232766fc9b7 => generated 1403 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:37.063098 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-393b48ca-2c21-46b7-996c-26529ad22bf3 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:37.068647 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-393b48ca-2c21-46b7-996c-26529ad22bf3 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] [instance: 84e0414b-a39f-4bfe-bc9d-c170ceb34d15] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:37.117302 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-393b48ca-2c21-46b7-996c-26529ad22bf3 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:37.123158 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-393b48ca-2c21-46b7-996c-26529ad22bf3 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:37.127437 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-393b48ca-2c21-46b7-996c-26529ad22bf3 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:37.129237 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-393b48ca-2c21-46b7-996c-26529ad22bf3 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:37.134289 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-393b48ca-2c21-46b7-996c-26529ad22bf3 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:37.137361 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-393b48ca-2c21-46b7-996c-26529ad22bf3 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:37.360618 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-393b48ca-2c21-46b7-996c-26529ad22bf3 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:37.372317 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-393b48ca-2c21-46b7-996c-26529ad22bf3 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:37.376788 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-393b48ca-2c21-46b7-996c-26529ad22bf3 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:37.390700 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-393b48ca-2c21-46b7-996c-26529ad22bf3 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] 10.222.0.43 "GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15" status: 200 len: 1553 microversion: 2.91 time: 0.351433 Oct 04 18:35:37.409259 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 650/1185] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:35:37 2022] GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15 => generated 1553 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:35:37.441255 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-35e62962-61c1-4994-b78a-ff6db8a98c81 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:37.442230 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-35e62962-61c1-4994-b78a-ff6db8a98c81 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] [instance: 67e13bce-be81-4775-be5f-737add9f1694] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:37.451477 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-35e62962-61c1-4994-b78a-ff6db8a98c81 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:37.452359 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-35e62962-61c1-4994-b78a-ff6db8a98c81 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:37.453059 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-35e62962-61c1-4994-b78a-ff6db8a98c81 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:37.454120 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-35e62962-61c1-4994-b78a-ff6db8a98c81 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:37.454809 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-35e62962-61c1-4994-b78a-ff6db8a98c81 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:37.455485 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-35e62962-61c1-4994-b78a-ff6db8a98c81 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:37.583526 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-35e62962-61c1-4994-b78a-ff6db8a98c81 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8b5e18327f4713a1e465acb9e863f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c849c5d04f44f7951908d740ec1689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:37.599016 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-35e62962-61c1-4994-b78a-ff6db8a98c81 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d8b5e18327f4713a1e465acb9e863f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c849c5d04f44f7951908d740ec1689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:37.600897 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-35e62962-61c1-4994-b78a-ff6db8a98c81 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d8b5e18327f4713a1e465acb9e863f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c849c5d04f44f7951908d740ec1689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:37.608394 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-35e62962-61c1-4994-b78a-ff6db8a98c81 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] 10.222.0.43 "GET /compute/v2.1/servers/67e13bce-be81-4775-be5f-737add9f1694" status: 200 len: 1446 microversion: 2.75 time: 0.175603 Oct 04 18:35:37.609803 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 651/1186] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:35:37 2022] GET /compute/v2.1/servers/67e13bce-be81-4775-be5f-737add9f1694 => generated 1446 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:35:38.055736 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-72088349-be69-4276-a9c4-c8242da8efe2 tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:38.057224 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-72088349-be69-4276-a9c4-c8242da8efe2 tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] [instance: 37823428-1dab-4b0a-9ea1-7232766fc9b7] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:38.067831 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-72088349-be69-4276-a9c4-c8242da8efe2 tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:38.069560 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-72088349-be69-4276-a9c4-c8242da8efe2 tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:38.071715 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-72088349-be69-4276-a9c4-c8242da8efe2 tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:38.075339 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-72088349-be69-4276-a9c4-c8242da8efe2 tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:38.076287 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-72088349-be69-4276-a9c4-c8242da8efe2 tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:38.076982 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-72088349-be69-4276-a9c4-c8242da8efe2 tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:38.442146 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-72088349-be69-4276-a9c4-c8242da8efe2 tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf77a83227f0404da7792695463b6714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc10a840253410ab9404ff4906eebc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:38.451938 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-72088349-be69-4276-a9c4-c8242da8efe2 tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] 10.222.0.43 "GET /compute/v2.1/servers/37823428-1dab-4b0a-9ea1-7232766fc9b7" status: 200 len: 1591 microversion: 2.1 time: 0.402310 Oct 04 18:35:38.453566 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 652/1187] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:38 2022] GET /compute/v2.1/servers/37823428-1dab-4b0a-9ea1-7232766fc9b7 => generated 1591 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:35:38.473254 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-3789b6a0-7c59-47a9-b615-32e6cff2a1b4 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:38.474134 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-3789b6a0-7c59-47a9-b615-32e6cff2a1b4 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] [instance: 84e0414b-a39f-4bfe-bc9d-c170ceb34d15] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:38.481005 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3789b6a0-7c59-47a9-b615-32e6cff2a1b4 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:38.481870 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3789b6a0-7c59-47a9-b615-32e6cff2a1b4 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:38.482479 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3789b6a0-7c59-47a9-b615-32e6cff2a1b4 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:38.483387 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3789b6a0-7c59-47a9-b615-32e6cff2a1b4 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:38.484006 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3789b6a0-7c59-47a9-b615-32e6cff2a1b4 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:38.484599 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3789b6a0-7c59-47a9-b615-32e6cff2a1b4 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:38.631477 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-3789b6a0-7c59-47a9-b615-32e6cff2a1b4 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:38.643681 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-3789b6a0-7c59-47a9-b615-32e6cff2a1b4 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:38.665618 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-3789b6a0-7c59-47a9-b615-32e6cff2a1b4 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:38.672908 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-3789b6a0-7c59-47a9-b615-32e6cff2a1b4 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] 10.222.0.43 "GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15" status: 200 len: 1553 microversion: 2.91 time: 0.214569 Oct 04 18:35:38.681961 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 653/1188] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:35:38 2022] GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15 => generated 1553 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:35:38.701656 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-314541b5-2d7f-4d65-9486-42d3761c7df2 tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:38.702431 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-314541b5-2d7f-4d65-9486-42d3761c7df2 tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] [instance: 37823428-1dab-4b0a-9ea1-7232766fc9b7] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:38.721296 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-314541b5-2d7f-4d65-9486-42d3761c7df2 tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:38.722237 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-314541b5-2d7f-4d65-9486-42d3761c7df2 tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:38.725034 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-314541b5-2d7f-4d65-9486-42d3761c7df2 tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:38.726080 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-314541b5-2d7f-4d65-9486-42d3761c7df2 tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:38.737288 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-314541b5-2d7f-4d65-9486-42d3761c7df2 tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:38.739156 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-314541b5-2d7f-4d65-9486-42d3761c7df2 tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:38.799279 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=3 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:35:38.881617 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-314541b5-2d7f-4d65-9486-42d3761c7df2 tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] 10.222.0.43 "GET /compute/v2.1/servers/37823428-1dab-4b0a-9ea1-7232766fc9b7/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.197520 Oct 04 18:35:38.883499 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 654/1189] 10.222.0.43 () {58 vars in 1275 bytes} [Tue Oct 4 18:35:38 2022] GET /compute/v2.1/servers/37823428-1dab-4b0a-9ea1-7232766fc9b7/os-interface => generated 285 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:35:38.890622 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-7a3450d4-15e3-4c0b-a060-d5b957eb424d tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:38.892329 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-7a3450d4-15e3-4c0b-a060-d5b957eb424d tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] [instance: 67e13bce-be81-4775-be5f-737add9f1694] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:38.906516 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7a3450d4-15e3-4c0b-a060-d5b957eb424d tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:38.911164 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7a3450d4-15e3-4c0b-a060-d5b957eb424d tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:38.911892 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7a3450d4-15e3-4c0b-a060-d5b957eb424d tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:38.912821 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7a3450d4-15e3-4c0b-a060-d5b957eb424d tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:38.913550 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7a3450d4-15e3-4c0b-a060-d5b957eb424d tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:38.916709 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7a3450d4-15e3-4c0b-a060-d5b957eb424d tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:39.088971 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-7a3450d4-15e3-4c0b-a060-d5b957eb424d tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8b5e18327f4713a1e465acb9e863f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c849c5d04f44f7951908d740ec1689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:39.099424 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-7a3450d4-15e3-4c0b-a060-d5b957eb424d tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d8b5e18327f4713a1e465acb9e863f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c849c5d04f44f7951908d740ec1689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:39.109623 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-7a3450d4-15e3-4c0b-a060-d5b957eb424d tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d8b5e18327f4713a1e465acb9e863f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c849c5d04f44f7951908d740ec1689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:39.121127 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-7a3450d4-15e3-4c0b-a060-d5b957eb424d tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] 10.222.0.43 "GET /compute/v2.1/servers/67e13bce-be81-4775-be5f-737add9f1694" status: 200 len: 1446 microversion: 2.75 time: 0.236243 Oct 04 18:35:39.123235 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 655/1190] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:35:38 2022] GET /compute/v2.1/servers/67e13bce-be81-4775-be5f-737add9f1694 => generated 1446 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:35:39.714506 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-7dbcdf03-528e-4aa8-9a60-f465217aec27 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:39.715297 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-7dbcdf03-528e-4aa8-9a60-f465217aec27 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] [instance: 84e0414b-a39f-4bfe-bc9d-c170ceb34d15] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:39.727961 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7dbcdf03-528e-4aa8-9a60-f465217aec27 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:39.728902 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7dbcdf03-528e-4aa8-9a60-f465217aec27 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:39.730901 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7dbcdf03-528e-4aa8-9a60-f465217aec27 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:39.732636 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7dbcdf03-528e-4aa8-9a60-f465217aec27 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:39.735621 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7dbcdf03-528e-4aa8-9a60-f465217aec27 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:39.738348 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7dbcdf03-528e-4aa8-9a60-f465217aec27 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:39.849320 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-d97110fb-f4bc-47e4-a2fe-9912121b91fa tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] 10.222.0.43 "GET /compute/v2.1/images/37400fa2-9016-4a4d-831a-321e28ef058c" status: 200 len: 1412 microversion: 2.1 time: 9.368366 Oct 04 18:35:39.850863 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 536/1191] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 18:35:30 2022] GET /compute/v2.1/images/37400fa2-9016-4a4d-831a-321e28ef058c => generated 1412 bytes in 9370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:39.926242 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-7dbcdf03-528e-4aa8-9a60-f465217aec27 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:39.937986 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-7dbcdf03-528e-4aa8-9a60-f465217aec27 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:39.940394 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-7dbcdf03-528e-4aa8-9a60-f465217aec27 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:39.948306 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-7dbcdf03-528e-4aa8-9a60-f465217aec27 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] 10.222.0.43 "GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15" status: 200 len: 1553 microversion: 2.91 time: 0.238427 Oct 04 18:35:39.968086 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 656/1192] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:35:39 2022] GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15 => generated 1553 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:35:40.155281 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-37ff81a7-ff0d-4827-b25d-ddb98ff76880 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:40.156154 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-37ff81a7-ff0d-4827-b25d-ddb98ff76880 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] [instance: 67e13bce-be81-4775-be5f-737add9f1694] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:40.174291 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-37ff81a7-ff0d-4827-b25d-ddb98ff76880 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:40.176962 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-37ff81a7-ff0d-4827-b25d-ddb98ff76880 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:40.177641 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-37ff81a7-ff0d-4827-b25d-ddb98ff76880 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:40.178584 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-37ff81a7-ff0d-4827-b25d-ddb98ff76880 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:40.179764 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-37ff81a7-ff0d-4827-b25d-ddb98ff76880 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:40.180401 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-37ff81a7-ff0d-4827-b25d-ddb98ff76880 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:40.499195 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-37ff81a7-ff0d-4827-b25d-ddb98ff76880 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8b5e18327f4713a1e465acb9e863f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c849c5d04f44f7951908d740ec1689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:40.509774 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-37ff81a7-ff0d-4827-b25d-ddb98ff76880 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d8b5e18327f4713a1e465acb9e863f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c849c5d04f44f7951908d740ec1689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:40.511292 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-37ff81a7-ff0d-4827-b25d-ddb98ff76880 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d8b5e18327f4713a1e465acb9e863f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c849c5d04f44f7951908d740ec1689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:40.542998 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-37ff81a7-ff0d-4827-b25d-ddb98ff76880 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] 10.222.0.43 "GET /compute/v2.1/servers/67e13bce-be81-4775-be5f-737add9f1694" status: 200 len: 1446 microversion: 2.75 time: 0.391927 Oct 04 18:35:40.569224 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 537/1193] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:35:40 2022] GET /compute/v2.1/servers/67e13bce-be81-4775-be5f-737add9f1694 => generated 1446 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:35:40.865561 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-819ede45-51a4-4de0-99d5-dc14d7fba484 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Calling method '.version_select at 0x7fb227d6d040>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:40.959201 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-819ede45-51a4-4de0-99d5-dc14d7fba484 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] 10.222.0.43 "GET /compute/v2.1/images/37400fa2-9016-4a4d-831a-321e28ef058c" status: 200 len: 1412 microversion: 2.1 time: 0.097967 Oct 04 18:35:40.969896 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 657/1194] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 18:35:40 2022] GET /compute/v2.1/images/37400fa2-9016-4a4d-831a-321e28ef058c => generated 1412 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:40.982946 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-2c811019-456f-478b-b038-ba3525ca3dd1 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:40.989333 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-2c811019-456f-478b-b038-ba3525ca3dd1 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] [instance: 84e0414b-a39f-4bfe-bc9d-c170ceb34d15] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:41.001486 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2c811019-456f-478b-b038-ba3525ca3dd1 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:41.002994 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2c811019-456f-478b-b038-ba3525ca3dd1 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:41.004224 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2c811019-456f-478b-b038-ba3525ca3dd1 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:41.005258 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2c811019-456f-478b-b038-ba3525ca3dd1 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:41.005937 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2c811019-456f-478b-b038-ba3525ca3dd1 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:41.006605 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2c811019-456f-478b-b038-ba3525ca3dd1 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:41.191965 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-2c811019-456f-478b-b038-ba3525ca3dd1 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:41.211468 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-2c811019-456f-478b-b038-ba3525ca3dd1 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:41.213008 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-2c811019-456f-478b-b038-ba3525ca3dd1 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:41.240544 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-2c811019-456f-478b-b038-ba3525ca3dd1 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] 10.222.0.43 "GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15" status: 200 len: 1535 microversion: 2.91 time: 0.258109 Oct 04 18:35:41.267582 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 538/1195] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:35:40 2022] GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15 => generated 1535 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:35:41.470651 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-c306b316-fd3b-45ef-a85f-ba5d42e4539d tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:41.470651 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-c306b316-fd3b-45ef-a85f-ba5d42e4539d tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] [instance: 37823428-1dab-4b0a-9ea1-7232766fc9b7] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:41.472472 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-4c27396a-ec59-46fa-a86c-c5bc998d97e4 req-b539ef24-d6eb-47ee-89d6-2ea75bde41a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37823428-1dab-4b0a-9ea1-7232766fc9b7", "tag": "f96938f2-b281-4c53-8ec7-b2b1a3999f07"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:35:41.486771 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c306b316-fd3b-45ef-a85f-ba5d42e4539d tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:41.487177 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c306b316-fd3b-45ef-a85f-ba5d42e4539d tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:41.487910 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c306b316-fd3b-45ef-a85f-ba5d42e4539d tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:41.488458 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c306b316-fd3b-45ef-a85f-ba5d42e4539d tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:41.488925 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c306b316-fd3b-45ef-a85f-ba5d42e4539d tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:41.489493 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c306b316-fd3b-45ef-a85f-ba5d42e4539d tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:41.503567 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-4c27396a-ec59-46fa-a86c-c5bc998d97e4 req-b539ef24-d6eb-47ee-89d6-2ea75bde41a4 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:41.504132 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-4c27396a-ec59-46fa-a86c-c5bc998d97e4 req-b539ef24-d6eb-47ee-89d6-2ea75bde41a4 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:41.504580 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-4c27396a-ec59-46fa-a86c-c5bc998d97e4 req-b539ef24-d6eb-47ee-89d6-2ea75bde41a4 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:41.556159 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-4c27396a-ec59-46fa-a86c-c5bc998d97e4 req-b539ef24-d6eb-47ee-89d6-2ea75bde41a4 service nova] Creating event network-changed:f96938f2-b281-4c53-8ec7-b2b1a3999f07 for instance 37823428-1dab-4b0a-9ea1-7232766fc9b7 on n-h2-851028-13 Oct 04 18:35:41.577026 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-4c27396a-ec59-46fa-a86c-c5bc998d97e4 req-b539ef24-d6eb-47ee-89d6-2ea75bde41a4 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103921 Oct 04 18:35:41.578392 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 539/1196] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:35:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:35:41.593963 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-0d64fc6b-7b35-448a-a56c-877fbdc004b0 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:41.594685 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-0d64fc6b-7b35-448a-a56c-877fbdc004b0 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] [instance: 67e13bce-be81-4775-be5f-737add9f1694] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:41.615142 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0d64fc6b-7b35-448a-a56c-877fbdc004b0 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:41.615641 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0d64fc6b-7b35-448a-a56c-877fbdc004b0 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:41.619433 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0d64fc6b-7b35-448a-a56c-877fbdc004b0 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:41.621101 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0d64fc6b-7b35-448a-a56c-877fbdc004b0 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:41.628293 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0d64fc6b-7b35-448a-a56c-877fbdc004b0 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:41.628760 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0d64fc6b-7b35-448a-a56c-877fbdc004b0 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:41.886914 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-0d64fc6b-7b35-448a-a56c-877fbdc004b0 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8b5e18327f4713a1e465acb9e863f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c849c5d04f44f7951908d740ec1689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:41.911557 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-0d64fc6b-7b35-448a-a56c-877fbdc004b0 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d8b5e18327f4713a1e465acb9e863f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c849c5d04f44f7951908d740ec1689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:41.917157 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-0d64fc6b-7b35-448a-a56c-877fbdc004b0 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d8b5e18327f4713a1e465acb9e863f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c849c5d04f44f7951908d740ec1689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:41.939805 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-0d64fc6b-7b35-448a-a56c-877fbdc004b0 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] 10.222.0.43 "GET /compute/v2.1/servers/67e13bce-be81-4775-be5f-737add9f1694" status: 200 len: 1446 microversion: 2.75 time: 0.358937 Oct 04 18:35:41.941664 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 540/1197] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:35:41 2022] GET /compute/v2.1/servers/67e13bce-be81-4775-be5f-737add9f1694 => generated 1446 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:35:41.975851 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-0ca80cf3-4ae3-4779-8272-34e5f010f2a7 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Calling method '.version_select at 0x7fb21fb25dc0>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:42.062600 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-0ca80cf3-4ae3-4779-8272-34e5f010f2a7 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] 10.222.0.43 "GET /compute/v2.1/images/37400fa2-9016-4a4d-831a-321e28ef058c" status: 200 len: 1412 microversion: 2.1 time: 0.090452 Oct 04 18:35:42.063883 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 541/1198] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 18:35:41 2022] GET /compute/v2.1/images/37400fa2-9016-4a4d-831a-321e28ef058c => generated 1412 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:35:42.170731 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-c306b316-fd3b-45ef-a85f-ba5d42e4539d tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf77a83227f0404da7792695463b6714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc10a840253410ab9404ff4906eebc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:42.191356 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-c306b316-fd3b-45ef-a85f-ba5d42e4539d tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] 10.222.0.43 "GET /compute/v2.1/servers/37823428-1dab-4b0a-9ea1-7232766fc9b7" status: 200 len: 1591 microversion: 2.1 time: 0.721840 Oct 04 18:35:42.193487 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 658/1199] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:41 2022] GET /compute/v2.1/servers/37823428-1dab-4b0a-9ea1-7232766fc9b7 => generated 1591 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:42.274291 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-8c25a256-4a77-4cc7-bfe8-a7b347207766 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:42.274916 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-8c25a256-4a77-4cc7-bfe8-a7b347207766 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] [instance: 84e0414b-a39f-4bfe-bc9d-c170ceb34d15] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:42.288403 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8c25a256-4a77-4cc7-bfe8-a7b347207766 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:42.293138 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8c25a256-4a77-4cc7-bfe8-a7b347207766 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:42.294784 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8c25a256-4a77-4cc7-bfe8-a7b347207766 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:42.296976 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8c25a256-4a77-4cc7-bfe8-a7b347207766 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:42.301801 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8c25a256-4a77-4cc7-bfe8-a7b347207766 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:42.302458 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8c25a256-4a77-4cc7-bfe8-a7b347207766 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:42.731296 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-8c25a256-4a77-4cc7-bfe8-a7b347207766 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:42.745464 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-8c25a256-4a77-4cc7-bfe8-a7b347207766 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:42.747731 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-8c25a256-4a77-4cc7-bfe8-a7b347207766 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:42.761370 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-8c25a256-4a77-4cc7-bfe8-a7b347207766 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] 10.222.0.43 "GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15" status: 200 len: 1535 microversion: 2.91 time: 0.491278 Oct 04 18:35:42.763810 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 542/1200] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:35:42 2022] GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15 => generated 1535 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:35:42.979901 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-623e0209-a041-43ac-abbf-8196401dab50 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:42.980528 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-623e0209-a041-43ac-abbf-8196401dab50 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] [instance: 67e13bce-be81-4775-be5f-737add9f1694] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:43.003884 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-623e0209-a041-43ac-abbf-8196401dab50 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:43.004408 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-623e0209-a041-43ac-abbf-8196401dab50 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:43.004873 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-623e0209-a041-43ac-abbf-8196401dab50 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:43.005663 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-623e0209-a041-43ac-abbf-8196401dab50 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:43.006126 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-623e0209-a041-43ac-abbf-8196401dab50 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:43.006664 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-623e0209-a041-43ac-abbf-8196401dab50 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:43.080406 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-f3010aa2-8063-417d-8a75-3c4b8592ad7b tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Calling method '.version_select at 0x7fb21fb3aaf0>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:43.189537 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-f3010aa2-8063-417d-8a75-3c4b8592ad7b tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] 10.222.0.43 "GET /compute/v2.1/images/37400fa2-9016-4a4d-831a-321e28ef058c" status: 200 len: 1412 microversion: 2.1 time: 0.113496 Oct 04 18:35:43.190479 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 543/1201] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 18:35:43 2022] GET /compute/v2.1/images/37400fa2-9016-4a4d-831a-321e28ef058c => generated 1412 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:35:43.218389 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-623e0209-a041-43ac-abbf-8196401dab50 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8b5e18327f4713a1e465acb9e863f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c849c5d04f44f7951908d740ec1689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:43.228960 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-623e0209-a041-43ac-abbf-8196401dab50 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d8b5e18327f4713a1e465acb9e863f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c849c5d04f44f7951908d740ec1689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:43.231807 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-623e0209-a041-43ac-abbf-8196401dab50 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d8b5e18327f4713a1e465acb9e863f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c849c5d04f44f7951908d740ec1689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:43.237860 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-623e0209-a041-43ac-abbf-8196401dab50 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] 10.222.0.43 "GET /compute/v2.1/servers/67e13bce-be81-4775-be5f-737add9f1694" status: 200 len: 1446 microversion: 2.75 time: 0.261938 Oct 04 18:35:43.238715 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 659/1202] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:35:42 2022] GET /compute/v2.1/servers/67e13bce-be81-4775-be5f-737add9f1694 => generated 1446 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:35:43.804467 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-dd702353-af51-4c5b-94f2-c7c060cdc553 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:43.805458 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-dd702353-af51-4c5b-94f2-c7c060cdc553 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] [instance: 84e0414b-a39f-4bfe-bc9d-c170ceb34d15] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:43.831877 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dd702353-af51-4c5b-94f2-c7c060cdc553 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:43.832665 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dd702353-af51-4c5b-94f2-c7c060cdc553 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:43.834126 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dd702353-af51-4c5b-94f2-c7c060cdc553 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:43.836873 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dd702353-af51-4c5b-94f2-c7c060cdc553 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:43.839901 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dd702353-af51-4c5b-94f2-c7c060cdc553 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:43.840961 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dd702353-af51-4c5b-94f2-c7c060cdc553 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:44.136797 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-dd702353-af51-4c5b-94f2-c7c060cdc553 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:44.158040 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-dd702353-af51-4c5b-94f2-c7c060cdc553 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:44.164190 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-dd702353-af51-4c5b-94f2-c7c060cdc553 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:44.184013 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-dd702353-af51-4c5b-94f2-c7c060cdc553 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] 10.222.0.43 "GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15" status: 200 len: 1478 microversion: 2.91 time: 0.390634 Oct 04 18:35:44.185510 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 544/1203] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:35:43 2022] GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15 => generated 1478 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:35:44.208911 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-64684f73-c147-4ff6-814f-d225c601b151 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Calling method '.version_select at 0x7fb227d86790>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:44.222518 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-3646270d-8967-446d-9b54-f92a0ff05ebe tempest-UnshelveToHostMultiNodesTest-313056567 tempest-UnshelveToHostMultiNodesTest-313056567-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "n-h1-851028-13"}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:35:44.229929 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-3646270d-8967-446d-9b54-f92a0ff05ebe tempest-UnshelveToHostMultiNodesTest-313056567 tempest-UnshelveToHostMultiNodesTest-313056567-project-admin] [instance: 84e0414b-a39f-4bfe-bc9d-c170ceb34d15] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:44.256645 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3646270d-8967-446d-9b54-f92a0ff05ebe tempest-UnshelveToHostMultiNodesTest-313056567 tempest-UnshelveToHostMultiNodesTest-313056567-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:44.263910 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3646270d-8967-446d-9b54-f92a0ff05ebe tempest-UnshelveToHostMultiNodesTest-313056567 tempest-UnshelveToHostMultiNodesTest-313056567-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:44.265352 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3646270d-8967-446d-9b54-f92a0ff05ebe tempest-UnshelveToHostMultiNodesTest-313056567 tempest-UnshelveToHostMultiNodesTest-313056567-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:44.266138 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3646270d-8967-446d-9b54-f92a0ff05ebe tempest-UnshelveToHostMultiNodesTest-313056567 tempest-UnshelveToHostMultiNodesTest-313056567-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:44.272439 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3646270d-8967-446d-9b54-f92a0ff05ebe tempest-UnshelveToHostMultiNodesTest-313056567 tempest-UnshelveToHostMultiNodesTest-313056567-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:44.273051 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3646270d-8967-446d-9b54-f92a0ff05ebe tempest-UnshelveToHostMultiNodesTest-313056567 tempest-UnshelveToHostMultiNodesTest-313056567-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:44.359900 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-64684f73-c147-4ff6-814f-d225c601b151 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] 10.222.0.43 "GET /compute/v2.1/images/37400fa2-9016-4a4d-831a-321e28ef058c" status: 200 len: 1412 microversion: 2.1 time: 0.156774 Oct 04 18:35:44.360467 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 660/1204] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 18:35:44 2022] GET /compute/v2.1/images/37400fa2-9016-4a4d-831a-321e28ef058c => generated 1412 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:44.380775 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-bd182bb2-f86a-442e-bb80-98df6f7ee0b7 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:44.387841 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-bd182bb2-f86a-442e-bb80-98df6f7ee0b7 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] [instance: 67e13bce-be81-4775-be5f-737add9f1694] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:44.406643 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bd182bb2-f86a-442e-bb80-98df6f7ee0b7 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:44.407491 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bd182bb2-f86a-442e-bb80-98df6f7ee0b7 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:44.408380 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bd182bb2-f86a-442e-bb80-98df6f7ee0b7 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:44.416060 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bd182bb2-f86a-442e-bb80-98df6f7ee0b7 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:44.434861 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bd182bb2-f86a-442e-bb80-98df6f7ee0b7 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:44.435787 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bd182bb2-f86a-442e-bb80-98df6f7ee0b7 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:44.642821 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-bd182bb2-f86a-442e-bb80-98df6f7ee0b7 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8b5e18327f4713a1e465acb9e863f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c849c5d04f44f7951908d740ec1689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:44.672477 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-bd182bb2-f86a-442e-bb80-98df6f7ee0b7 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d8b5e18327f4713a1e465acb9e863f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c849c5d04f44f7951908d740ec1689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:44.677505 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-bd182bb2-f86a-442e-bb80-98df6f7ee0b7 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d8b5e18327f4713a1e465acb9e863f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c849c5d04f44f7951908d740ec1689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:44.691965 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-3646270d-8967-446d-9b54-f92a0ff05ebe tempest-UnshelveToHostMultiNodesTest-313056567 tempest-UnshelveToHostMultiNodesTest-313056567-project-admin] [instance: 84e0414b-a39f-4bfe-bc9d-c170ceb34d15] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "n-h1-851028-13". {{(pid=123595) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 04 18:35:44.697715 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-bd182bb2-f86a-442e-bb80-98df6f7ee0b7 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] 10.222.0.43 "GET /compute/v2.1/servers/67e13bce-be81-4775-be5f-737add9f1694" status: 200 len: 1446 microversion: 2.75 time: 0.334992 Oct 04 18:35:44.700508 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 661/1205] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:35:44 2022] GET /compute/v2.1/servers/67e13bce-be81-4775-be5f-737add9f1694 => generated 1446 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:35:44.864525 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-3646270d-8967-446d-9b54-f92a0ff05ebe tempest-UnshelveToHostMultiNodesTest-313056567 tempest-UnshelveToHostMultiNodesTest-313056567-project-admin] 10.222.0.43 "POST /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15/action" status: 202 len: 0 microversion: 2.91 time: 0.649689 Oct 04 18:35:44.873821 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 545/1206] 10.222.0.43 () {62 vars in 1319 bytes} [Tue Oct 4 18:35:44 2022] POST /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15/action => generated 0 bytes in 660 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 04 18:35:44.880305 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-983583d2-3403-4b88-b535-86ab854d4bc1 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:44.881222 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-983583d2-3403-4b88-b535-86ab854d4bc1 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] [instance: 84e0414b-a39f-4bfe-bc9d-c170ceb34d15] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:44.919002 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-983583d2-3403-4b88-b535-86ab854d4bc1 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:44.919470 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-983583d2-3403-4b88-b535-86ab854d4bc1 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:44.931974 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-983583d2-3403-4b88-b535-86ab854d4bc1 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:44.937384 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-983583d2-3403-4b88-b535-86ab854d4bc1 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:44.939979 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-983583d2-3403-4b88-b535-86ab854d4bc1 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:44.940863 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-983583d2-3403-4b88-b535-86ab854d4bc1 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:45.170529 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-983583d2-3403-4b88-b535-86ab854d4bc1 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:45.186878 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-983583d2-3403-4b88-b535-86ab854d4bc1 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:45.192099 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-983583d2-3403-4b88-b535-86ab854d4bc1 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:45.203967 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-983583d2-3403-4b88-b535-86ab854d4bc1 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] 10.222.0.43 "GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15" status: 200 len: 1486 microversion: 2.91 time: 0.328750 Oct 04 18:35:45.205457 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 662/1207] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:35:44 2022] GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15 => generated 1486 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:35:45.376198 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-e8d4866d-85b4-4ac4-8bd0-a061f21b2042 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Calling method '.version_select at 0x7fb21fb48a60>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:45.480811 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-e8d4866d-85b4-4ac4-8bd0-a061f21b2042 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] 10.222.0.43 "GET /compute/v2.1/images/37400fa2-9016-4a4d-831a-321e28ef058c" status: 200 len: 1412 microversion: 2.1 time: 0.108337 Oct 04 18:35:45.481445 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 546/1208] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 18:35:45 2022] GET /compute/v2.1/images/37400fa2-9016-4a4d-831a-321e28ef058c => generated 1412 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:45.728534 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-15db1f52-89dc-4a90-85c6-6b3c19fa7b9c tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:45.729348 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-15db1f52-89dc-4a90-85c6-6b3c19fa7b9c tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] [instance: 67e13bce-be81-4775-be5f-737add9f1694] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:45.753254 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-15db1f52-89dc-4a90-85c6-6b3c19fa7b9c tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:45.753769 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-15db1f52-89dc-4a90-85c6-6b3c19fa7b9c tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:45.754307 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-15db1f52-89dc-4a90-85c6-6b3c19fa7b9c tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:45.755106 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-15db1f52-89dc-4a90-85c6-6b3c19fa7b9c tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:45.755619 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-15db1f52-89dc-4a90-85c6-6b3c19fa7b9c tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:45.756620 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-15db1f52-89dc-4a90-85c6-6b3c19fa7b9c tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:45.912326 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-15db1f52-89dc-4a90-85c6-6b3c19fa7b9c tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8b5e18327f4713a1e465acb9e863f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c849c5d04f44f7951908d740ec1689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:45.921421 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-15db1f52-89dc-4a90-85c6-6b3c19fa7b9c tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d8b5e18327f4713a1e465acb9e863f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c849c5d04f44f7951908d740ec1689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:45.922901 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-15db1f52-89dc-4a90-85c6-6b3c19fa7b9c tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d8b5e18327f4713a1e465acb9e863f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c849c5d04f44f7951908d740ec1689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:45.945679 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-15db1f52-89dc-4a90-85c6-6b3c19fa7b9c tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] 10.222.0.43 "GET /compute/v2.1/servers/67e13bce-be81-4775-be5f-737add9f1694" status: 200 len: 1446 microversion: 2.75 time: 0.222392 Oct 04 18:35:45.953505 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 663/1209] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:35:45 2022] GET /compute/v2.1/servers/67e13bce-be81-4775-be5f-737add9f1694 => generated 1446 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:35:46.244490 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-81a7c201-8b82-490c-8b4e-6b76eeb677c7 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:46.245026 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-81a7c201-8b82-490c-8b4e-6b76eeb677c7 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] [instance: 84e0414b-a39f-4bfe-bc9d-c170ceb34d15] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:46.273679 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-81a7c201-8b82-490c-8b4e-6b76eeb677c7 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:46.279385 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-81a7c201-8b82-490c-8b4e-6b76eeb677c7 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:46.281142 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-81a7c201-8b82-490c-8b4e-6b76eeb677c7 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:46.285693 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-81a7c201-8b82-490c-8b4e-6b76eeb677c7 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:46.288788 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-81a7c201-8b82-490c-8b4e-6b76eeb677c7 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:46.291281 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-81a7c201-8b82-490c-8b4e-6b76eeb677c7 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:46.495646 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-0a95a88f-cae7-4024-89aa-ff14c143c8b9 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Calling method '.version_select at 0x7fb227d96b80>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:46.567028 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-0a95a88f-cae7-4024-89aa-ff14c143c8b9 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] 10.222.0.43 "GET /compute/v2.1/images/37400fa2-9016-4a4d-831a-321e28ef058c" status: 200 len: 1412 microversion: 2.1 time: 0.075028 Oct 04 18:35:46.575853 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 664/1210] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 18:35:46 2022] GET /compute/v2.1/images/37400fa2-9016-4a4d-831a-321e28ef058c => generated 1412 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:46.583679 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-81a7c201-8b82-490c-8b4e-6b76eeb677c7 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:46.596751 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-81a7c201-8b82-490c-8b4e-6b76eeb677c7 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:46.611385 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-81a7c201-8b82-490c-8b4e-6b76eeb677c7 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:46.643186 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-81a7c201-8b82-490c-8b4e-6b76eeb677c7 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] 10.222.0.43 "GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15" status: 200 len: 1488 microversion: 2.91 time: 0.403107 Oct 04 18:35:46.649636 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 547/1211] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:35:46 2022] GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15 => generated 1488 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:35:46.976519 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-998decaf-2f88-451c-97f5-d2143b92c587 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:46.977187 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-998decaf-2f88-451c-97f5-d2143b92c587 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] [instance: 67e13bce-be81-4775-be5f-737add9f1694] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:46.991695 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-998decaf-2f88-451c-97f5-d2143b92c587 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:46.994942 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-998decaf-2f88-451c-97f5-d2143b92c587 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:46.995585 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-998decaf-2f88-451c-97f5-d2143b92c587 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:46.998970 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-998decaf-2f88-451c-97f5-d2143b92c587 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:46.999652 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-998decaf-2f88-451c-97f5-d2143b92c587 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:47.002073 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-998decaf-2f88-451c-97f5-d2143b92c587 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:47.172093 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-998decaf-2f88-451c-97f5-d2143b92c587 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8b5e18327f4713a1e465acb9e863f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c849c5d04f44f7951908d740ec1689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:47.184941 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=100 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:35:47.199117 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-998decaf-2f88-451c-97f5-d2143b92c587 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d8b5e18327f4713a1e465acb9e863f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c849c5d04f44f7951908d740ec1689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:47.202932 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-998decaf-2f88-451c-97f5-d2143b92c587 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d8b5e18327f4713a1e465acb9e863f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c849c5d04f44f7951908d740ec1689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:47.217569 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-998decaf-2f88-451c-97f5-d2143b92c587 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] 10.222.0.43 "GET /compute/v2.1/servers/67e13bce-be81-4775-be5f-737add9f1694" status: 200 len: 1446 microversion: 2.75 time: 0.245426 Oct 04 18:35:47.218985 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 665/1212] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:35:46 2022] GET /compute/v2.1/servers/67e13bce-be81-4775-be5f-737add9f1694 => generated 1446 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:35:47.583299 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-15471018-6c4a-4a5d-963d-52dfc10620e9 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Calling method '.version_select at 0x7fb21fbfe310>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:47.686307 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-15471018-6c4a-4a5d-963d-52dfc10620e9 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] 10.222.0.43 "GET /compute/v2.1/images/37400fa2-9016-4a4d-831a-321e28ef058c" status: 200 len: 1412 microversion: 2.1 time: 0.107035 Oct 04 18:35:47.687774 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 548/1213] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 18:35:47 2022] GET /compute/v2.1/images/37400fa2-9016-4a4d-831a-321e28ef058c => generated 1412 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:47.689967 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-204b6128-40a7-489a-80c9-3b869f829a82 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:47.691486 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-204b6128-40a7-489a-80c9-3b869f829a82 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] [instance: 84e0414b-a39f-4bfe-bc9d-c170ceb34d15] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:47.713169 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-204b6128-40a7-489a-80c9-3b869f829a82 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:47.724500 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-204b6128-40a7-489a-80c9-3b869f829a82 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:47.728896 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-204b6128-40a7-489a-80c9-3b869f829a82 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:47.731902 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-204b6128-40a7-489a-80c9-3b869f829a82 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:47.733934 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-204b6128-40a7-489a-80c9-3b869f829a82 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:47.735084 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-204b6128-40a7-489a-80c9-3b869f829a82 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:47.899595 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-204b6128-40a7-489a-80c9-3b869f829a82 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:47.909317 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-204b6128-40a7-489a-80c9-3b869f829a82 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:47.912619 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-204b6128-40a7-489a-80c9-3b869f829a82 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:47.922221 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-204b6128-40a7-489a-80c9-3b869f829a82 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] 10.222.0.43 "GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15" status: 200 len: 1544 microversion: 2.91 time: 0.250891 Oct 04 18:35:47.923480 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 666/1214] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:35:47 2022] GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15 => generated 1544 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:35:48.246294 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-0d89266b-d7f4-4c78-b161-84ecc833bbd1 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:48.246919 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-0d89266b-d7f4-4c78-b161-84ecc833bbd1 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] [instance: 67e13bce-be81-4775-be5f-737add9f1694] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:48.255177 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0d89266b-d7f4-4c78-b161-84ecc833bbd1 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:48.255904 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0d89266b-d7f4-4c78-b161-84ecc833bbd1 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:48.256651 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0d89266b-d7f4-4c78-b161-84ecc833bbd1 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:48.257727 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0d89266b-d7f4-4c78-b161-84ecc833bbd1 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:48.258406 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0d89266b-d7f4-4c78-b161-84ecc833bbd1 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:48.259055 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0d89266b-d7f4-4c78-b161-84ecc833bbd1 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:48.429163 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-0d89266b-d7f4-4c78-b161-84ecc833bbd1 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8b5e18327f4713a1e465acb9e863f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c849c5d04f44f7951908d740ec1689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:48.449573 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-0d89266b-d7f4-4c78-b161-84ecc833bbd1 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d8b5e18327f4713a1e465acb9e863f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c849c5d04f44f7951908d740ec1689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:48.453622 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-0d89266b-d7f4-4c78-b161-84ecc833bbd1 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d8b5e18327f4713a1e465acb9e863f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c849c5d04f44f7951908d740ec1689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:48.466472 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-0d89266b-d7f4-4c78-b161-84ecc833bbd1 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] 10.222.0.43 "GET /compute/v2.1/servers/67e13bce-be81-4775-be5f-737add9f1694" status: 200 len: 1446 microversion: 2.75 time: 0.224129 Oct 04 18:35:48.497102 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 549/1215] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:35:48 2022] GET /compute/v2.1/servers/67e13bce-be81-4775-be5f-737add9f1694 => generated 1446 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:35:48.703773 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-b051734d-77b9-49ce-9279-f4a2ad048df1 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Calling method '.version_select at 0x7fb21fb25820>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:48.903607 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-c9c5edb7-f2f8-484e-8e43-8c8b43206179 tempest-FloatingIPsTestJSON-496844738 tempest-FloatingIPsTestJSON-496844738-project] Action: 'create', calling method: .version_select at 0x7fb227de2d30>, body: {"pool": null} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:35:52.817887 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-c9c5edb7-f2f8-484e-8e43-8c8b43206179 tempest-FloatingIPsTestJSON-496844738 tempest-FloatingIPsTestJSON-496844738-project] 10.222.0.43 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 4.185931 Oct 04 18:35:52.820966 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 667/1216] 10.222.0.43 () {60 vars in 1170 bytes} [Tue Oct 4 18:35:48 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 4189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:35:52.834105 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-a4bc8596-e65a-4da2-9bb6-116465ce6d74 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:52.835491 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-a4bc8596-e65a-4da2-9bb6-116465ce6d74 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] [instance: 84e0414b-a39f-4bfe-bc9d-c170ceb34d15] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:52.844641 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a4bc8596-e65a-4da2-9bb6-116465ce6d74 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:52.846833 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a4bc8596-e65a-4da2-9bb6-116465ce6d74 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:52.847554 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a4bc8596-e65a-4da2-9bb6-116465ce6d74 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:52.848608 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a4bc8596-e65a-4da2-9bb6-116465ce6d74 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:52.849348 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a4bc8596-e65a-4da2-9bb6-116465ce6d74 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:52.850139 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a4bc8596-e65a-4da2-9bb6-116465ce6d74 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:52.972612 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-a4bc8596-e65a-4da2-9bb6-116465ce6d74 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:52.996817 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-a4bc8596-e65a-4da2-9bb6-116465ce6d74 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:52.998376 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-a4bc8596-e65a-4da2-9bb6-116465ce6d74 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:53.011930 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-a4bc8596-e65a-4da2-9bb6-116465ce6d74 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] 10.222.0.43 "GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15" status: 200 len: 1544 microversion: 2.91 time: 0.188970 Oct 04 18:35:53.015503 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 668/1217] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:35:52 2022] GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15 => generated 1544 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:35:53.020613 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-aa2500c1-cf6f-47fd-a90f-2f8f5b5a28d4 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:53.025886 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-aa2500c1-cf6f-47fd-a90f-2f8f5b5a28d4 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] [instance: 67e13bce-be81-4775-be5f-737add9f1694] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:53.036241 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-aa2500c1-cf6f-47fd-a90f-2f8f5b5a28d4 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:53.037001 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-aa2500c1-cf6f-47fd-a90f-2f8f5b5a28d4 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:53.037642 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-aa2500c1-cf6f-47fd-a90f-2f8f5b5a28d4 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:53.038515 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-aa2500c1-cf6f-47fd-a90f-2f8f5b5a28d4 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:53.039132 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-aa2500c1-cf6f-47fd-a90f-2f8f5b5a28d4 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:53.039736 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-aa2500c1-cf6f-47fd-a90f-2f8f5b5a28d4 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:53.216487 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-aa2500c1-cf6f-47fd-a90f-2f8f5b5a28d4 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8b5e18327f4713a1e465acb9e863f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c849c5d04f44f7951908d740ec1689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:53.233841 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-aa2500c1-cf6f-47fd-a90f-2f8f5b5a28d4 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d8b5e18327f4713a1e465acb9e863f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c849c5d04f44f7951908d740ec1689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:53.238992 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-aa2500c1-cf6f-47fd-a90f-2f8f5b5a28d4 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d8b5e18327f4713a1e465acb9e863f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c849c5d04f44f7951908d740ec1689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:53.252823 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-aa2500c1-cf6f-47fd-a90f-2f8f5b5a28d4 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] 10.222.0.43 "GET /compute/v2.1/servers/67e13bce-be81-4775-be5f-737add9f1694" status: 200 len: 1446 microversion: 2.75 time: 0.235842 Oct 04 18:35:53.256164 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 669/1218] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:35:53 2022] GET /compute/v2.1/servers/67e13bce-be81-4775-be5f-737add9f1694 => generated 1446 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:35:53.261143 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-872a10bc-c14f-4662-9000-edae6b903efa tempest-FloatingIPsTestJSON-496844738 tempest-FloatingIPsTestJSON-496844738-project] Calling method '.version_select at 0x7fb227d96430>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:53.525225 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-872a10bc-c14f-4662-9000-edae6b903efa tempest-FloatingIPsTestJSON-496844738 tempest-FloatingIPsTestJSON-496844738-project] 10.222.0.43 "GET /compute/v2.1/os-floating-ips/71c3dfaa-1e85-492b-8c8f-cb6523636eaf" status: 200 len: 141 microversion: 2.1 time: 0.267512 Oct 04 18:35:53.525834 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 670/1219] 10.222.0.43 () {58 vars in 1260 bytes} [Tue Oct 4 18:35:53 2022] GET /compute/v2.1/os-floating-ips/71c3dfaa-1e85-492b-8c8f-cb6523636eaf => generated 141 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:35:53.541862 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-ed4cc2ff-a5fc-4415-832c-28e527886772 tempest-FloatingIPsTestJSON-496844738 tempest-FloatingIPsTestJSON-496844738-project] Calling method '.version_select at 0x7fb227de2ca0>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:53.781879 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-ed4cc2ff-a5fc-4415-832c-28e527886772 tempest-FloatingIPsTestJSON-496844738 tempest-FloatingIPsTestJSON-496844738-project] 10.222.0.43 "GET /compute/v2.1/os-floating-ips" status: 200 len: 144 microversion: 2.1 time: 0.247441 Oct 04 18:35:53.782468 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 671/1220] 10.222.0.43 () {58 vars in 1149 bytes} [Tue Oct 4 18:35:53 2022] GET /compute/v2.1/os-floating-ips => generated 144 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:35:53.800580 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-72147585-6188-4286-a5de-e1f1738f22da tempest-FloatingIPsTestJSON-496844738 tempest-FloatingIPsTestJSON-496844738-project] Calling method '.version_select at 0x7fb227dd9430>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:54.753256 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-b051734d-77b9-49ce-9279-f4a2ad048df1 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] 10.222.0.43 "GET /compute/v2.1/images/37400fa2-9016-4a4d-831a-321e28ef058c" status: 200 len: 1421 microversion: 2.1 time: 6.049659 Oct 04 18:35:54.772077 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 550/1221] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 18:35:48 2022] GET /compute/v2.1/images/37400fa2-9016-4a4d-831a-321e28ef058c => generated 1421 bytes in 6073 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:54.793964 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-b1f2c170-1995-487d-b84a-ba971af6adb0 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:54.794583 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-b1f2c170-1995-487d-b84a-ba971af6adb0 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] [instance: 84e0414b-a39f-4bfe-bc9d-c170ceb34d15] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:54.826285 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b1f2c170-1995-487d-b84a-ba971af6adb0 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:54.826944 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b1f2c170-1995-487d-b84a-ba971af6adb0 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:54.831282 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b1f2c170-1995-487d-b84a-ba971af6adb0 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:54.831282 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b1f2c170-1995-487d-b84a-ba971af6adb0 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:54.831282 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b1f2c170-1995-487d-b84a-ba971af6adb0 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:54.834110 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b1f2c170-1995-487d-b84a-ba971af6adb0 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:54.839781 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:35:55.053791 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-b1f2c170-1995-487d-b84a-ba971af6adb0 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:55.072482 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-b1f2c170-1995-487d-b84a-ba971af6adb0 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:55.074729 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-b1f2c170-1995-487d-b84a-ba971af6adb0 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:55.081056 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-b1f2c170-1995-487d-b84a-ba971af6adb0 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] 10.222.0.43 "GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15" status: 200 len: 1544 microversion: 2.91 time: 0.307094 Oct 04 18:35:55.103953 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 551/1222] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:35:54 2022] GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15 => generated 1544 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:35:55.112616 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-4342be03-c973-430a-87b1-b84aa4f041c8 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:55.114284 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-4342be03-c973-430a-87b1-b84aa4f041c8 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] [instance: 67e13bce-be81-4775-be5f-737add9f1694] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:55.121245 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4342be03-c973-430a-87b1-b84aa4f041c8 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:55.121984 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4342be03-c973-430a-87b1-b84aa4f041c8 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:55.122589 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4342be03-c973-430a-87b1-b84aa4f041c8 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:55.125161 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4342be03-c973-430a-87b1-b84aa4f041c8 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:55.125813 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4342be03-c973-430a-87b1-b84aa4f041c8 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:55.126403 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4342be03-c973-430a-87b1-b84aa4f041c8 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:55.268317 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-4342be03-c973-430a-87b1-b84aa4f041c8 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8b5e18327f4713a1e465acb9e863f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c849c5d04f44f7951908d740ec1689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:55.282729 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-4342be03-c973-430a-87b1-b84aa4f041c8 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d8b5e18327f4713a1e465acb9e863f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c849c5d04f44f7951908d740ec1689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:55.284307 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-4342be03-c973-430a-87b1-b84aa4f041c8 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d8b5e18327f4713a1e465acb9e863f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c849c5d04f44f7951908d740ec1689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:55.313857 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-4342be03-c973-430a-87b1-b84aa4f041c8 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] 10.222.0.43 "GET /compute/v2.1/servers/67e13bce-be81-4775-be5f-737add9f1694" status: 200 len: 1446 microversion: 2.75 time: 0.204064 Oct 04 18:35:55.314763 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 552/1223] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:35:55 2022] GET /compute/v2.1/servers/67e13bce-be81-4775-be5f-737add9f1694 => generated 1446 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:35:55.326801 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-a32222cc-0010-4455-8295-7753f392b0df tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Calling method '.version_select at 0x7fb21fb25e50>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:55.425915 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-a32222cc-0010-4455-8295-7753f392b0df tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] 10.222.0.43 "GET /compute/v2.1/images/37400fa2-9016-4a4d-831a-321e28ef058c" status: 200 len: 1421 microversion: 2.1 time: 0.108784 Oct 04 18:35:55.440779 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 553/1224] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 18:35:55 2022] GET /compute/v2.1/images/37400fa2-9016-4a4d-831a-321e28ef058c => generated 1421 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:55.445441 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-dfcbc6d2-c2d2-4d74-b52a-4037536efd21 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Calling method '.version_select at 0x7fb21fae1790>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:55.677055 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-72147585-6188-4286-a5de-e1f1738f22da tempest-FloatingIPsTestJSON-496844738 tempest-FloatingIPsTestJSON-496844738-project] 10.222.0.43 "DELETE /compute/v2.1/os-floating-ips/71c3dfaa-1e85-492b-8c8f-cb6523636eaf" status: 202 len: 0 microversion: 2.1 time: 1.884001 Oct 04 18:35:55.679178 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 672/1225] 10.222.0.43 () {58 vars in 1263 bytes} [Tue Oct 4 18:35:53 2022] DELETE /compute/v2.1/os-floating-ips/71c3dfaa-1e85-492b-8c8f-cb6523636eaf => generated 0 bytes in 1887 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:35:55.689811 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-3a466c59-67c2-48b5-b998-7a0ead9d58b7 tempest-FloatingIPsTestJSON-496844738 tempest-FloatingIPsTestJSON-496844738-project] Action: 'create', calling method: .version_select at 0x7fb227d86820>, body: {"pool": null} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:35:56.978789 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-dfcbc6d2-c2d2-4d74-b52a-4037536efd21 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] 10.222.0.43 "DELETE /compute/v2.1/images/37400fa2-9016-4a4d-831a-321e28ef058c" status: 204 len: 0 microversion: 2.1 time: 1.537093 Oct 04 18:35:56.980580 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 554/1226] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:55 2022] DELETE /compute/v2.1/images/37400fa2-9016-4a4d-831a-321e28ef058c => generated 0 bytes in 1540 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:35:56.985699 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-fe395e07-b77a-43a7-b7b7-4a76ec6bf999 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:56.989767 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-fe395e07-b77a-43a7-b7b7-4a76ec6bf999 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] [instance: 84e0414b-a39f-4bfe-bc9d-c170ceb34d15] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:57.012008 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fe395e07-b77a-43a7-b7b7-4a76ec6bf999 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:57.014338 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fe395e07-b77a-43a7-b7b7-4a76ec6bf999 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:57.015295 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fe395e07-b77a-43a7-b7b7-4a76ec6bf999 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:57.019065 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fe395e07-b77a-43a7-b7b7-4a76ec6bf999 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:57.019791 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fe395e07-b77a-43a7-b7b7-4a76ec6bf999 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:57.020438 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fe395e07-b77a-43a7-b7b7-4a76ec6bf999 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:57.157172 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-fe395e07-b77a-43a7-b7b7-4a76ec6bf999 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:57.179174 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-fe395e07-b77a-43a7-b7b7-4a76ec6bf999 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:57.180810 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-fe395e07-b77a-43a7-b7b7-4a76ec6bf999 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:57.195130 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-fe395e07-b77a-43a7-b7b7-4a76ec6bf999 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] 10.222.0.43 "GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15" status: 200 len: 1544 microversion: 2.91 time: 0.213099 Oct 04 18:35:57.195780 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 555/1227] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:35:56 2022] GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15 => generated 1544 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:35:57.213542 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-9a0841ed-9a54-4b87-b42b-ed79c4c0c9a3 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:57.215713 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-9a0841ed-9a54-4b87-b42b-ed79c4c0c9a3 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] [instance: 67e13bce-be81-4775-be5f-737add9f1694] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:57.222764 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9a0841ed-9a54-4b87-b42b-ed79c4c0c9a3 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:57.224483 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9a0841ed-9a54-4b87-b42b-ed79c4c0c9a3 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:57.225425 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9a0841ed-9a54-4b87-b42b-ed79c4c0c9a3 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:57.226827 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9a0841ed-9a54-4b87-b42b-ed79c4c0c9a3 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:57.227727 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9a0841ed-9a54-4b87-b42b-ed79c4c0c9a3 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:57.232743 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9a0841ed-9a54-4b87-b42b-ed79c4c0c9a3 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:57.330881 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-9a0841ed-9a54-4b87-b42b-ed79c4c0c9a3 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8b5e18327f4713a1e465acb9e863f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c849c5d04f44f7951908d740ec1689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:57.343418 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-9a0841ed-9a54-4b87-b42b-ed79c4c0c9a3 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d8b5e18327f4713a1e465acb9e863f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c849c5d04f44f7951908d740ec1689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:57.349011 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-9a0841ed-9a54-4b87-b42b-ed79c4c0c9a3 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d8b5e18327f4713a1e465acb9e863f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c849c5d04f44f7951908d740ec1689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:57.356632 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-9a0841ed-9a54-4b87-b42b-ed79c4c0c9a3 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] 10.222.0.43 "GET /compute/v2.1/servers/67e13bce-be81-4775-be5f-737add9f1694" status: 200 len: 1452 microversion: 2.75 time: 0.157925 Oct 04 18:35:57.369775 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 556/1228] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:35:57 2022] GET /compute/v2.1/servers/67e13bce-be81-4775-be5f-737add9f1694 => generated 1452 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:35:57.790114 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-74bb5c43-5dbe-4d6c-884b-dd17efe4dbac tempest-VolumesAdminNegativeTest-1009225662 tempest-VolumesAdminNegativeTest-1009225662-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "92f1148b-9d16-4def-94d0-9785b2204918"}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:35:57.794236 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-74bb5c43-5dbe-4d6c-884b-dd17efe4dbac tempest-VolumesAdminNegativeTest-1009225662 tempest-VolumesAdminNegativeTest-1009225662-project-admin] [instance: eb05639b-cd53-4c27-9505-20e668a16acc] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:57.805794 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-74bb5c43-5dbe-4d6c-884b-dd17efe4dbac tempest-VolumesAdminNegativeTest-1009225662 tempest-VolumesAdminNegativeTest-1009225662-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:57.806594 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-74bb5c43-5dbe-4d6c-884b-dd17efe4dbac tempest-VolumesAdminNegativeTest-1009225662 tempest-VolumesAdminNegativeTest-1009225662-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:57.807113 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-74bb5c43-5dbe-4d6c-884b-dd17efe4dbac tempest-VolumesAdminNegativeTest-1009225662 tempest-VolumesAdminNegativeTest-1009225662-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:57.807937 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-74bb5c43-5dbe-4d6c-884b-dd17efe4dbac tempest-VolumesAdminNegativeTest-1009225662 tempest-VolumesAdminNegativeTest-1009225662-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:57.808564 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-74bb5c43-5dbe-4d6c-884b-dd17efe4dbac tempest-VolumesAdminNegativeTest-1009225662 tempest-VolumesAdminNegativeTest-1009225662-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:57.809094 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-74bb5c43-5dbe-4d6c-884b-dd17efe4dbac tempest-VolumesAdminNegativeTest-1009225662 tempest-VolumesAdminNegativeTest-1009225662-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:57.959308 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-3a466c59-67c2-48b5-b998-7a0ead9d58b7 tempest-FloatingIPsTestJSON-496844738 tempest-FloatingIPsTestJSON-496844738-project] 10.222.0.43 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 2.274458 Oct 04 18:35:57.960447 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 673/1229] 10.222.0.43 () {60 vars in 1170 bytes} [Tue Oct 4 18:35:55 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 2276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:35:57.972756 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-3fabde86-053d-4531-bb89-dcb4598020b6 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:57.976659 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-3fabde86-053d-4531-bb89-dcb4598020b6 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] [instance: 93798a9a-d90d-4a4e-8e30-d6575486ff56] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:57.988630 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3fabde86-053d-4531-bb89-dcb4598020b6 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:57.989151 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3fabde86-053d-4531-bb89-dcb4598020b6 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:57.989583 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3fabde86-053d-4531-bb89-dcb4598020b6 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:57.990399 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3fabde86-053d-4531-bb89-dcb4598020b6 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:57.994324 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3fabde86-053d-4531-bb89-dcb4598020b6 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:57.994963 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3fabde86-053d-4531-bb89-dcb4598020b6 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:58.045348 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-3fabde86-053d-4531-bb89-dcb4598020b6 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] [instance: 93798a9a-d90d-4a4e-8e30-d6575486ff56] Going to try to terminate instance {{(pid=123596) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:35:58.092917 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-74bb5c43-5dbe-4d6c-884b-dd17efe4dbac tempest-VolumesAdminNegativeTest-1009225662 tempest-VolumesAdminNegativeTest-1009225662-project-admin] HTTP exception thrown: Volume 92f1148b-9d16-4def-94d0-9785b2204918 could not be found. Oct 04 18:35:58.111632 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-74bb5c43-5dbe-4d6c-884b-dd17efe4dbac tempest-VolumesAdminNegativeTest-1009225662 tempest-VolumesAdminNegativeTest-1009225662-project-admin] Request method failure captured: Oct 04 18:35:58.111632 n-d-851028-13 devstack@n-api.service[123595]: request: PUT /compute/v2.1/servers/eb05639b-cd53-4c27-9505-20e668a16acc/os-volume_attachments/046cae51-6b65-41f0-81e1-45da3fb3e511 HTTP/1.1 Oct 04 18:35:58.111632 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 18:35:58.111632 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 18:35:58.111632 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 18:35:58.111632 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 74 Oct 04 18:35:58.111632 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 18:35:58.111632 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 18:35:58.111632 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 18:35:58.111632 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 18:35:58.111632 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPHyfPbuDF9LIAjbzyfEhAMuPE0cbL6FyLTwkF5q-vvHk2E4hM3ofpANJUlMAEEz4hkTMIE9u9hat7JfSLcVi_piqJrrLvGAHGhAMw4zXqKKGrTjv-BfZRGdXAIFvlfWPY3dTjo3hHRjMaZKnqNRbClpTkf-E8Bg61jMdszvxkcg-NkM Oct 04 18:35:58.111632 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 18:35:58.111632 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 18:35:58.111632 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 18:35:58.111632 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 18:35:58.111632 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 18:35:58.111632 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 18:35:58.111632 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: 7bc988ff61624763a15c6e9f2d471e9b Oct 04 18:35:58.111632 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-VolumesAdminNegativeTest-1009225662 Oct 04 18:35:58.111632 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,admin,reader Oct 04 18:35:58.111632 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,admin,reader Oct 04 18:35:58.111632 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/7bc988ff61624763a15c6e9f2d471e9b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_7bc988ff61624763a15c6e9f2d471e9b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/7bc988ff61624763a15c6e9f2d471e9b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/7bc988ff61624763a15c6e9f2d471e9b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:35:58.111632 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-VolumesAdminNegativeTest-1009225662 Oct 04 18:35:58.111632 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: 7bc988ff61624763a15c6e9f2d471e9b Oct 04 18:35:58.111632 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1009225662 Oct 04 18:35:58.111632 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-VolumesAdminNegativeTest-1009225662-project-admin Oct 04 18:35:58.111632 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 18:35:58.111632 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 18:35:58.111632 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: f97c6c93fca44dfc8d889f5eb3a632c7 Oct 04 18:35:58.111632 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-VolumesAdminNegativeTest-1009225662-project-admin Oct 04 18:35:58.111632 n-d-851028-13 devstack@n-api.service[123595]: Oct 04 18:35:58.111632 n-d-851028-13 devstack@n-api.service[123595]: {"volumeAttachment": {"volumeId": "92f1148b-9d16-4def-94d0-9785b2204918"}} Oct 04 18:35:58.111632 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 18:35:58.111632 n-d-851028-13 devstack@n-api.service[123595]: exception: Volume 92f1148b-9d16-4def-94d0-9785b2204918 could not be found. Oct 04 18:35:58.111632 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'server_id': 'eb05639b-cd53-4c27-9505-20e668a16acc', 'id': '046cae51-6b65-41f0-81e1-45da3fb3e511', 'body': {'volumeAttachment': {'volumeId': '92f1148b-9d16-4def-94d0-9785b2204918'}}} Oct 04 18:35:58.111632 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:35:58.111632 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:35:58.111632 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 18:35:58.111632 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 18:35:58.111632 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 18:35:58.111632 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 18:35:58.111632 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 18:35:58.111632 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 18:35:58.111632 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 18:35:58.111632 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 18:35:58.111632 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 18:35:58.111632 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 18:35:58.111632 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 18:35:58.111632 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 18:35:58.111632 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 18:35:58.111632 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 18:35:58.111632 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 92f1148b-9d16-4def-94d0-9785b2204918 could not be found. (HTTP 404) (Request-ID: req-c1480b7d-5b44-4c5e-8305-ae8c9a22dae8) Oct 04 18:35:58.111632 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:35:58.111632 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:35:58.111632 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:35:58.111632 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:35:58.111632 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Oct 04 18:35:58.111632 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Oct 04 18:35:58.111632 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 04 18:35:58.111632 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 04 18:35:58.111632 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 04 18:35:58.116029 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 04 18:35:58.116029 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 04 18:35:58.116029 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 04 18:35:58.116029 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 18:35:58.116029 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 18:35:58.116029 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 18:35:58.116029 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 18:35:58.116029 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 18:35:58.116029 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 18:35:58.116029 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 18:35:58.116029 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 18:35:58.116029 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 18:35:58.116029 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 18:35:58.116029 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 18:35:58.116029 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 18:35:58.116029 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 18:35:58.116029 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 18:35:58.116029 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 92f1148b-9d16-4def-94d0-9785b2204918 could not be found. Oct 04 18:35:58.116029 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:35:58.116029 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:35:58.116029 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:35:58.116029 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:35:58.116029 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:35:58.116029 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:35:58.116029 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:35:58.116029 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:35:58.116029 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:35:58.116029 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:35:58.116029 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:35:58.116029 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:35:58.116029 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:35:58.116029 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:35:58.116029 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Oct 04 18:35:58.116029 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Oct 04 18:35:58.116029 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Oct 04 18:35:58.116029 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 04 18:35:58.116029 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume 92f1148b-9d16-4def-94d0-9785b2204918 could not be found. Oct 04 18:35:58.116029 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:35:58.116029 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:35:58.116029 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:35:58.116029 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:35:58.116029 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:35:58.116029 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:35:58.116029 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:35:58.116029 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:35:58.116029 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 92f1148b-9d16-4def-94d0-9785b2204918 could not be found. Oct 04 18:35:58.116029 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:35:58.120187 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-74bb5c43-5dbe-4d6c-884b-dd17efe4dbac tempest-VolumesAdminNegativeTest-1009225662 tempest-VolumesAdminNegativeTest-1009225662-project-admin] Returning 400 to user: Volume 92f1148b-9d16-4def-94d0-9785b2204918 could not be found. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:35:58.128399 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-74bb5c43-5dbe-4d6c-884b-dd17efe4dbac tempest-VolumesAdminNegativeTest-1009225662 tempest-VolumesAdminNegativeTest-1009225662-project-admin] 10.222.0.43 "PUT /compute/v2.1/servers/eb05639b-cd53-4c27-9505-20e668a16acc/os-volume_attachments/046cae51-6b65-41f0-81e1-45da3fb3e511" status: 400 len: 107 microversion: 2.1 time: 0.756280 Oct 04 18:35:58.129530 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 557/1230] 10.222.0.43 () {60 vars in 1433 bytes} [Tue Oct 4 18:35:57 2022] PUT /compute/v2.1/servers/eb05639b-cd53-4c27-9505-20e668a16acc/os-volume_attachments/046cae51-6b65-41f0-81e1-45da3fb3e511 => generated 107 bytes in 759 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:35:58.140431 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-e8532c9c-679f-4322-b225-311970b49ddd tempest-FloatingIPsTestJSON-496844738 tempest-FloatingIPsTestJSON-496844738-project] Calling method '.version_select at 0x7fb21fa1cd30>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:58.183801 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:35:58.204046 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-3fabde86-053d-4531-bb89-dcb4598020b6 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] 10.222.0.43 "DELETE /compute/v2.1/servers/93798a9a-d90d-4a4e-8e30-d6575486ff56" status: 204 len: 0 microversion: 2.1 time: 0.234769 Oct 04 18:35:58.211786 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 674/1231] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 18:35:57 2022] DELETE /compute/v2.1/servers/93798a9a-d90d-4a4e-8e30-d6575486ff56 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:35:58.238588 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-625cfc10-c5e7-48cf-86f9-b63a4f54e303 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:58.239356 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-625cfc10-c5e7-48cf-86f9-b63a4f54e303 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] [instance: 84e0414b-a39f-4bfe-bc9d-c170ceb34d15] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:58.257420 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-625cfc10-c5e7-48cf-86f9-b63a4f54e303 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:58.258150 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-625cfc10-c5e7-48cf-86f9-b63a4f54e303 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:58.258886 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-625cfc10-c5e7-48cf-86f9-b63a4f54e303 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:58.259805 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-625cfc10-c5e7-48cf-86f9-b63a4f54e303 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:58.260474 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-625cfc10-c5e7-48cf-86f9-b63a4f54e303 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:58.261364 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-625cfc10-c5e7-48cf-86f9-b63a4f54e303 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:58.358998 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-625cfc10-c5e7-48cf-86f9-b63a4f54e303 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:58.375706 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-625cfc10-c5e7-48cf-86f9-b63a4f54e303 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:58.377608 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-625cfc10-c5e7-48cf-86f9-b63a4f54e303 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:58.387360 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-625cfc10-c5e7-48cf-86f9-b63a4f54e303 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] 10.222.0.43 "GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15" status: 200 len: 1544 microversion: 2.91 time: 0.166181 Oct 04 18:35:58.410425 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 675/1232] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:35:58 2022] GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15 => generated 1544 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:35:58.418414 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-32755237-4dda-471a-9d07-348612090265 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:58.419420 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-32755237-4dda-471a-9d07-348612090265 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] [instance: eb05639b-cd53-4c27-9505-20e668a16acc] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:58.431418 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-32755237-4dda-471a-9d07-348612090265 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:58.433564 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-32755237-4dda-471a-9d07-348612090265 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:58.434241 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-32755237-4dda-471a-9d07-348612090265 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:58.435154 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-32755237-4dda-471a-9d07-348612090265 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:58.435782 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-32755237-4dda-471a-9d07-348612090265 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:58.436568 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-32755237-4dda-471a-9d07-348612090265 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:58.683408 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.objects.instance [None req-32755237-4dda-471a-9d07-348612090265 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lazy-loading 'services' on Instance uuid eb05639b-cd53-4c27-9505-20e668a16acc {{(pid=123596) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:35:58.840737 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-32755237-4dda-471a-9d07-348612090265 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] 10.222.0.43 "DELETE /compute/v2.1/servers/eb05639b-cd53-4c27-9505-20e668a16acc/os-volume_attachments/046cae51-6b65-41f0-81e1-45da3fb3e511" status: 202 len: 0 microversion: 2.1 time: 0.428375 Oct 04 18:35:58.841370 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 676/1233] 10.222.0.43 () {58 vars in 1416 bytes} [Tue Oct 4 18:35:58 2022] DELETE /compute/v2.1/servers/eb05639b-cd53-4c27-9505-20e668a16acc/os-volume_attachments/046cae51-6b65-41f0-81e1-45da3fb3e511 => generated 0 bytes in 430 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:35:58.846685 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-bf342f03-1cab-4c94-8d02-0b4a3205f9e7 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:58.847398 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-bf342f03-1cab-4c94-8d02-0b4a3205f9e7 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] [instance: 67e13bce-be81-4775-be5f-737add9f1694] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:58.894806 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bf342f03-1cab-4c94-8d02-0b4a3205f9e7 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:58.896049 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bf342f03-1cab-4c94-8d02-0b4a3205f9e7 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:58.897317 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bf342f03-1cab-4c94-8d02-0b4a3205f9e7 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:58.898488 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bf342f03-1cab-4c94-8d02-0b4a3205f9e7 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:58.900127 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bf342f03-1cab-4c94-8d02-0b4a3205f9e7 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:58.901218 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bf342f03-1cab-4c94-8d02-0b4a3205f9e7 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:59.476871 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-bf342f03-1cab-4c94-8d02-0b4a3205f9e7 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8b5e18327f4713a1e465acb9e863f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c849c5d04f44f7951908d740ec1689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:59.494070 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-bf342f03-1cab-4c94-8d02-0b4a3205f9e7 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d8b5e18327f4713a1e465acb9e863f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c849c5d04f44f7951908d740ec1689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:59.495451 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-bf342f03-1cab-4c94-8d02-0b4a3205f9e7 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d8b5e18327f4713a1e465acb9e863f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c849c5d04f44f7951908d740ec1689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:59.503828 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-bf342f03-1cab-4c94-8d02-0b4a3205f9e7 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] 10.222.0.43 "GET /compute/v2.1/servers/67e13bce-be81-4775-be5f-737add9f1694" status: 200 len: 1452 microversion: 2.75 time: 0.661014 Oct 04 18:35:59.504884 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 677/1234] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:35:58 2022] GET /compute/v2.1/servers/67e13bce-be81-4775-be5f-737add9f1694 => generated 1452 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:35:59.509819 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-fe908a2a-4bc4-4a81-bd86-35aa909a4233 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-726296632", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452", "networks": [{"uuid": "8427bdfe-80f6-4509-a949-365d3d4b4e33"}]}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:35:59.586713 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.network.neutron [None req-fe908a2a-4bc4-4a81-bd86-35aa909a4233 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] validate_networks() for [('8427bdfe-80f6-4509-a949-365d3d4b4e33', None, None, None, None, None)] {{(pid=123596) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:35:59.885207 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-e8532c9c-679f-4322-b225-311970b49ddd tempest-FloatingIPsTestJSON-496844738 tempest-FloatingIPsTestJSON-496844738-project] 10.222.0.43 "DELETE /compute/v2.1/os-floating-ips/7f3be8ce-5033-4ec4-b075-64b04aa165ee" status: 202 len: 0 microversion: 2.1 time: 1.751166 Oct 04 18:35:59.886965 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 558/1235] 10.222.0.43 () {58 vars in 1263 bytes} [Tue Oct 4 18:35:58 2022] DELETE /compute/v2.1/os-floating-ips/7f3be8ce-5033-4ec4-b075-64b04aa165ee => generated 0 bytes in 1757 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:35:59.895605 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-b0997d11-31dc-4302-ae55-0e63fa08079c tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:59.908282 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-b0997d11-31dc-4302-ae55-0e63fa08079c tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] [instance: eb05639b-cd53-4c27-9505-20e668a16acc] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:59.916014 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b0997d11-31dc-4302-ae55-0e63fa08079c tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:59.916936 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b0997d11-31dc-4302-ae55-0e63fa08079c tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:59.919016 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b0997d11-31dc-4302-ae55-0e63fa08079c tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:59.920012 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b0997d11-31dc-4302-ae55-0e63fa08079c tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:59.920772 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b0997d11-31dc-4302-ae55-0e63fa08079c tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:59.921499 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b0997d11-31dc-4302-ae55-0e63fa08079c tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:59.970200 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-b0997d11-31dc-4302-ae55-0e63fa08079c tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] 10.222.0.43 "GET /compute/v2.1/servers/eb05639b-cd53-4c27-9505-20e668a16acc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078272 Oct 04 18:35:59.976656 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 559/1236] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Oct 4 18:35:59 2022] GET /compute/v2.1/servers/eb05639b-cd53-4c27-9505-20e668a16acc/os-volume_attachments => generated 197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:35:59.985920 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-c7a00171-324b-42a9-92e9-666d50af76c1 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:59.987299 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-c7a00171-324b-42a9-92e9-666d50af76c1 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] [instance: 84e0414b-a39f-4bfe-bc9d-c170ceb34d15] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:00.014634 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c7a00171-324b-42a9-92e9-666d50af76c1 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:00.015727 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c7a00171-324b-42a9-92e9-666d50af76c1 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:00.016538 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c7a00171-324b-42a9-92e9-666d50af76c1 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:00.017788 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c7a00171-324b-42a9-92e9-666d50af76c1 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:00.018559 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c7a00171-324b-42a9-92e9-666d50af76c1 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:00.019378 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c7a00171-324b-42a9-92e9-666d50af76c1 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:00.106690 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-fe908a2a-4bc4-4a81-bd86-35aa909a4233 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Flavor limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:36:00.107330 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-fe908a2a-4bc4-4a81-bd86-35aa909a4233 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Image limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:36:00.107975 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-fe908a2a-4bc4-4a81-bd86-35aa909a4233 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Flavor pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:36:00.108548 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-fe908a2a-4bc4-4a81-bd86-35aa909a4233 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Image pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:36:00.109251 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-fe908a2a-4bc4-4a81-bd86-35aa909a4233 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:36:00.122205 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-c7a00171-324b-42a9-92e9-666d50af76c1 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:00.124365 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fe908a2a-4bc4-4a81-bd86-35aa909a4233 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:00.127429 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fe908a2a-4bc4-4a81-bd86-35aa909a4233 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:00.128939 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fe908a2a-4bc4-4a81-bd86-35aa909a4233 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:00.130591 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fe908a2a-4bc4-4a81-bd86-35aa909a4233 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:00.132540 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fe908a2a-4bc4-4a81-bd86-35aa909a4233 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:00.133801 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fe908a2a-4bc4-4a81-bd86-35aa909a4233 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:00.134674 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-c7a00171-324b-42a9-92e9-666d50af76c1 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:00.139170 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-c7a00171-324b-42a9-92e9-666d50af76c1 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:00.145333 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-c7a00171-324b-42a9-92e9-666d50af76c1 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] 10.222.0.43 "GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15" status: 200 len: 1544 microversion: 2.91 time: 0.166755 Oct 04 18:36:00.146358 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 560/1237] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:35:59 2022] GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15 => generated 1544 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:36:00.185958 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-fe908a2a-4bc4-4a81-bd86-35aa909a4233 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Getting quotas for project 4fa31ed92017490a82497c7b8910aef0. Resources: {'ram', 'cores', 'instances'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:36:00.202543 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-fe908a2a-4bc4-4a81-bd86-35aa909a4233 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Getting quotas for user 5a41ab6fb78a42ceaca621c5a38ffc6d and project 4fa31ed92017490a82497c7b8910aef0. Resources: {'ram', 'cores', 'instances'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:36:00.233626 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-fe908a2a-4bc4-4a81-bd86-35aa909a4233 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Going to run 1 instances... {{(pid=123596) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:36:00.236895 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-fe908a2a-4bc4-4a81-bd86-35aa909a4233 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] [instance: 9ee1bd28-0921-4444-afe3-c09cbfa0680a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e8943ec5-4038-4d4b-b9b9-2415a79f5243',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123596) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:36:00.346482 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-fe908a2a-4bc4-4a81-bd86-35aa909a4233 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.840463 Oct 04 18:36:00.346980 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-e22c6008-0e7f-4c45-80d0-d689e6ef8f44 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1986976737", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452"}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:36:00.347474 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 678/1238] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 18:35:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 842 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:36:00.352420 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-a5560864-327b-4d9e-bdf7-65f4e18fcb38 tempest-FloatingIPsTestJSON-496844738 tempest-FloatingIPsTestJSON-496844738-project] Calling method '.version_select at 0x7fb227d59ee0>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:00.415790 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.network.neutron [None req-e22c6008-0e7f-4c45-80d0-d689e6ef8f44 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] validate_networks() for None {{(pid=123595) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:36:00.453580 n-d-851028-13 devstack@n-api.service[123596]: DEBUG neutronclient.v2_0.client [None req-a5560864-327b-4d9e-bdf7-65f4e18fcb38 tempest-FloatingIPsTestJSON-496844738 tempest-FloatingIPsTestJSON-496844738-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 7f3be8ce-5033-4ec4-b075-64b04aa165ee could not be found", "detail": ""}} {{(pid=123596) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 18:36:00.454288 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-a5560864-327b-4d9e-bdf7-65f4e18fcb38 tempest-FloatingIPsTestJSON-496844738 tempest-FloatingIPsTestJSON-496844738-project] HTTP exception thrown: Floating IP not found for ID 7f3be8ce-5033-4ec4-b075-64b04aa165ee Oct 04 18:36:00.456227 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-a5560864-327b-4d9e-bdf7-65f4e18fcb38 tempest-FloatingIPsTestJSON-496844738 tempest-FloatingIPsTestJSON-496844738-project] Request method failure captured: Oct 04 18:36:00.456227 n-d-851028-13 devstack@n-api.service[123596]: request: GET /compute/v2.1/os-floating-ips/7f3be8ce-5033-4ec4-b075-64b04aa165ee HTTP/1.1 Oct 04 18:36:00.456227 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:36:00.456227 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:36:00.456227 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:36:00.456227 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 18:36:00.456227 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:36:00.456227 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:36:00.456227 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:36:00.456227 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:36:00.456227 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPH0EfB-d15Fzv7sC_njSi2Q6JiEE1DYL03ZjbxP3AN9Q8DkDV3E_aItFOA-FxX5o6oD9FOOAjg_kv4Ldrp0EbCSdef3p8DU8bJZn-ag6pBrVM43gOfQofJNZBxfckRhnqLqU9Jy5Gf0kDwcLIEMEpORBOclLHXstuxliXkbsaV_WYIM Oct 04 18:36:00.456227 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:36:00.456227 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:36:00.456227 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:36:00.456227 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:36:00.456227 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:36:00.456227 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:36:00.456227 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: d7c6b3df6ed34f3d86fb3671e7e138dc Oct 04 18:36:00.456227 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-FloatingIPsTestJSON-496844738 Oct 04 18:36:00.456227 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 18:36:00.456227 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 18:36:00.456227 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/d7c6b3df6ed34f3d86fb3671e7e138dc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_d7c6b3df6ed34f3d86fb3671e7e138dc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d7c6b3df6ed34f3d86fb3671e7e138dc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d7c6b3df6ed34f3d86fb3671e7e138dc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:36:00.456227 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-FloatingIPsTestJSON-496844738 Oct 04 18:36:00.456227 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: d7c6b3df6ed34f3d86fb3671e7e138dc Oct 04 18:36:00.456227 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-FloatingIPsTestJSON-496844738 Oct 04 18:36:00.456227 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-FloatingIPsTestJSON-496844738-project Oct 04 18:36:00.456227 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:36:00.456227 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:36:00.456227 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 343062c7a30848c89001f45c25cf6624 Oct 04 18:36:00.456227 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-FloatingIPsTestJSON-496844738-project Oct 04 18:36:00.456227 n-d-851028-13 devstack@n-api.service[123596]: method: Oct 04 18:36:00.456227 n-d-851028-13 devstack@n-api.service[123596]: exception: Floating IP not found for ID 7f3be8ce-5033-4ec4-b075-64b04aa165ee Oct 04 18:36:00.456227 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': '7f3be8ce-5033-4ec4-b075-64b04aa165ee'} Oct 04 18:36:00.456227 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:36:00.456227 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:36:00.456227 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 04 18:36:00.456227 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 04 18:36:00.456227 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:36:00.456227 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:36:00.456227 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 04 18:36:00.456227 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 04 18:36:00.456227 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:36:00.456227 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:36:00.456227 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 18:36:00.456227 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 18:36:00.456227 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:36:00.456227 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:36:00.456227 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 18:36:00.456227 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 18:36:00.456227 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:36:00.456227 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:36:00.456227 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 18:36:00.456227 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 18:36:00.456227 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:36:00.456227 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:36:00.456227 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 18:36:00.456227 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 18:36:00.456227 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 18:36:00.456227 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 18:36:00.456227 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 7f3be8ce-5033-4ec4-b075-64b04aa165ee could not be found Oct 04 18:36:00.456227 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-28fefd7a-c929-48e4-a575-244bea0ffee9'] Oct 04 18:36:00.456227 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:36:00.461552 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:36:00.461552 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:36:00.461552 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:36:00.461552 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Oct 04 18:36:00.461552 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 04 18:36:00.461552 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 04 18:36:00.461552 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 04 18:36:00.461552 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 7f3be8ce-5033-4ec4-b075-64b04aa165ee. Oct 04 18:36:00.461552 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:36:00.461552 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:36:00.461552 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:36:00.461552 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:36:00.461552 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:36:00.461552 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:36:00.461552 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:36:00.461552 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:36:00.461552 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:36:00.461552 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:36:00.461552 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:36:00.461552 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:36:00.461552 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Oct 04 18:36:00.461552 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 04 18:36:00.461552 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 7f3be8ce-5033-4ec4-b075-64b04aa165ee Oct 04 18:36:00.461552 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:36:00.461552 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:36:00.461552 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:36:00.461552 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:36:00.461552 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:36:00.461552 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:36:00.461552 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:36:00.461552 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:36:00.461552 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 7f3be8ce-5033-4ec4-b075-64b04aa165ee Oct 04 18:36:00.461552 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:36:00.461552 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-a5560864-327b-4d9e-bdf7-65f4e18fcb38 tempest-FloatingIPsTestJSON-496844738 tempest-FloatingIPsTestJSON-496844738-project] Returning 404 to user: Floating IP not found for ID 7f3be8ce-5033-4ec4-b075-64b04aa165ee {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:36:00.461552 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-a5560864-327b-4d9e-bdf7-65f4e18fcb38 tempest-FloatingIPsTestJSON-496844738 tempest-FloatingIPsTestJSON-496844738-project] 10.222.0.43 "GET /compute/v2.1/os-floating-ips/7f3be8ce-5033-4ec4-b075-64b04aa165ee" status: 404 len: 111 microversion: 2.1 time: 0.109145 Oct 04 18:36:00.461552 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 679/1239] 10.222.0.43 () {58 vars in 1260 bytes} [Tue Oct 4 18:36:00 2022] GET /compute/v2.1/os-floating-ips/7f3be8ce-5033-4ec4-b075-64b04aa165ee => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:36:00.468499 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-68feaad1-2a0f-4cbc-a98a-7c43d020cd2f tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:00.468499 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-68feaad1-2a0f-4cbc-a98a-7c43d020cd2f tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] [instance: 9ee1bd28-0921-4444-afe3-c09cbfa0680a] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:00.526236 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-68feaad1-2a0f-4cbc-a98a-7c43d020cd2f tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a41ab6fb78a42ceaca621c5a38ffc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa31ed92017490a82497c7b8910aef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:00.534186 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-68feaad1-2a0f-4cbc-a98a-7c43d020cd2f tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] 10.222.0.43 "GET /compute/v2.1/servers/9ee1bd28-0921-4444-afe3-c09cbfa0680a" status: 200 len: 1207 microversion: 2.1 time: 0.074086 Oct 04 18:36:00.535051 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 680/1240] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:00 2022] GET /compute/v2.1/servers/9ee1bd28-0921-4444-afe3-c09cbfa0680a => generated 1207 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:00.541714 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-1e89f4e2-14c1-4bca-92dd-cb76f09ee948 tempest-FloatingIPsTestJSON-496844738 tempest-FloatingIPsTestJSON-496844738-project] Calling method '.version_select at 0x7fb227d59f70>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:00.607211 n-d-851028-13 devstack@n-api.service[123596]: DEBUG neutronclient.v2_0.client [None req-1e89f4e2-14c1-4bca-92dd-cb76f09ee948 tempest-FloatingIPsTestJSON-496844738 tempest-FloatingIPsTestJSON-496844738-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 7f3be8ce-5033-4ec4-b075-64b04aa165ee could not be found", "detail": ""}} {{(pid=123596) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 18:36:00.608110 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-1e89f4e2-14c1-4bca-92dd-cb76f09ee948 tempest-FloatingIPsTestJSON-496844738 tempest-FloatingIPsTestJSON-496844738-project] HTTP exception thrown: Floating IP not found for ID 7f3be8ce-5033-4ec4-b075-64b04aa165ee Oct 04 18:36:00.610158 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-1e89f4e2-14c1-4bca-92dd-cb76f09ee948 tempest-FloatingIPsTestJSON-496844738 tempest-FloatingIPsTestJSON-496844738-project] Request method failure captured: Oct 04 18:36:00.610158 n-d-851028-13 devstack@n-api.service[123596]: request: DELETE /compute/v2.1/os-floating-ips/7f3be8ce-5033-4ec4-b075-64b04aa165ee HTTP/1.1 Oct 04 18:36:00.610158 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:36:00.610158 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:36:00.610158 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:36:00.610158 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 18:36:00.610158 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:36:00.610158 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:36:00.610158 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:36:00.610158 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:36:00.610158 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPH0EfB-d15Fzv7sC_njSi2Q6JiEE1DYL03ZjbxP3AN9Q8DkDV3E_aItFOA-FxX5o6oD9FOOAjg_kv4Ldrp0EbCSdef3p8DU8bJZn-ag6pBrVM43gOfQofJNZBxfckRhnqLqU9Jy5Gf0kDwcLIEMEpORBOclLHXstuxliXkbsaV_WYIM Oct 04 18:36:00.610158 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:36:00.610158 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:36:00.610158 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:36:00.610158 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:36:00.610158 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:36:00.610158 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:36:00.610158 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: d7c6b3df6ed34f3d86fb3671e7e138dc Oct 04 18:36:00.610158 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-FloatingIPsTestJSON-496844738 Oct 04 18:36:00.610158 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 18:36:00.610158 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 18:36:00.610158 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/d7c6b3df6ed34f3d86fb3671e7e138dc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_d7c6b3df6ed34f3d86fb3671e7e138dc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d7c6b3df6ed34f3d86fb3671e7e138dc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d7c6b3df6ed34f3d86fb3671e7e138dc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:36:00.610158 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-FloatingIPsTestJSON-496844738 Oct 04 18:36:00.610158 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: d7c6b3df6ed34f3d86fb3671e7e138dc Oct 04 18:36:00.610158 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-FloatingIPsTestJSON-496844738 Oct 04 18:36:00.610158 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-FloatingIPsTestJSON-496844738-project Oct 04 18:36:00.610158 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:36:00.610158 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:36:00.610158 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 343062c7a30848c89001f45c25cf6624 Oct 04 18:36:00.610158 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-FloatingIPsTestJSON-496844738-project Oct 04 18:36:00.610158 n-d-851028-13 devstack@n-api.service[123596]: method: Oct 04 18:36:00.610158 n-d-851028-13 devstack@n-api.service[123596]: exception: Floating IP not found for ID 7f3be8ce-5033-4ec4-b075-64b04aa165ee Oct 04 18:36:00.610158 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': '7f3be8ce-5033-4ec4-b075-64b04aa165ee'} Oct 04 18:36:00.610158 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:36:00.610158 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:36:00.610158 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 04 18:36:00.610158 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 04 18:36:00.610158 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:36:00.610158 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:36:00.610158 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 04 18:36:00.610158 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 04 18:36:00.610158 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:36:00.610158 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:36:00.610158 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 18:36:00.610158 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 18:36:00.610158 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:36:00.610158 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:36:00.610158 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 18:36:00.610158 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 18:36:00.610158 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:36:00.610158 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:36:00.610158 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 18:36:00.610158 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 18:36:00.610158 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:36:00.610158 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:36:00.610158 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 18:36:00.610158 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 18:36:00.610158 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 18:36:00.610158 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 18:36:00.610158 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 7f3be8ce-5033-4ec4-b075-64b04aa165ee could not be found Oct 04 18:36:00.610158 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5591f0f4-ccea-4ad9-b182-b14434416461'] Oct 04 18:36:00.610158 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:36:00.614899 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:36:00.614899 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:36:00.614899 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:36:00.614899 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Oct 04 18:36:00.614899 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 04 18:36:00.614899 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 04 18:36:00.614899 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 04 18:36:00.614899 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 7f3be8ce-5033-4ec4-b075-64b04aa165ee. Oct 04 18:36:00.614899 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:36:00.614899 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:36:00.614899 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:36:00.614899 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:36:00.614899 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:36:00.614899 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:36:00.614899 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:36:00.614899 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:36:00.614899 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:36:00.614899 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:36:00.614899 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:36:00.614899 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:36:00.614899 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Oct 04 18:36:00.614899 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 04 18:36:00.614899 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 7f3be8ce-5033-4ec4-b075-64b04aa165ee Oct 04 18:36:00.614899 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:36:00.614899 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:36:00.614899 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:36:00.614899 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:36:00.614899 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:36:00.614899 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:36:00.614899 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:36:00.614899 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:36:00.614899 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 7f3be8ce-5033-4ec4-b075-64b04aa165ee Oct 04 18:36:00.614899 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:36:00.618307 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-1e89f4e2-14c1-4bca-92dd-cb76f09ee948 tempest-FloatingIPsTestJSON-496844738 tempest-FloatingIPsTestJSON-496844738-project] Returning 404 to user: Floating IP not found for ID 7f3be8ce-5033-4ec4-b075-64b04aa165ee {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:36:00.619348 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-1e89f4e2-14c1-4bca-92dd-cb76f09ee948 tempest-FloatingIPsTestJSON-496844738 tempest-FloatingIPsTestJSON-496844738-project] 10.222.0.43 "DELETE /compute/v2.1/os-floating-ips/7f3be8ce-5033-4ec4-b075-64b04aa165ee" status: 404 len: 111 microversion: 2.1 time: 0.083022 Oct 04 18:36:00.620073 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 681/1241] 10.222.0.43 () {58 vars in 1263 bytes} [Tue Oct 4 18:36:00 2022] DELETE /compute/v2.1/os-floating-ips/7f3be8ce-5033-4ec4-b075-64b04aa165ee => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:36:00.646523 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-0c9bedee-4d9c-4e32-ba79-4b4ef6256c0b tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:00.649537 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-0c9bedee-4d9c-4e32-ba79-4b4ef6256c0b tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] [instance: 67e13bce-be81-4775-be5f-737add9f1694] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:00.675473 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0c9bedee-4d9c-4e32-ba79-4b4ef6256c0b tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:00.676783 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0c9bedee-4d9c-4e32-ba79-4b4ef6256c0b tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:00.690413 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0c9bedee-4d9c-4e32-ba79-4b4ef6256c0b tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:00.692323 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0c9bedee-4d9c-4e32-ba79-4b4ef6256c0b tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:00.693610 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0c9bedee-4d9c-4e32-ba79-4b4ef6256c0b tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:00.695822 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0c9bedee-4d9c-4e32-ba79-4b4ef6256c0b tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:00.820883 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-0c9bedee-4d9c-4e32-ba79-4b4ef6256c0b tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8b5e18327f4713a1e465acb9e863f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c849c5d04f44f7951908d740ec1689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:00.833684 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-0c9bedee-4d9c-4e32-ba79-4b4ef6256c0b tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d8b5e18327f4713a1e465acb9e863f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c849c5d04f44f7951908d740ec1689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:00.835447 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-0c9bedee-4d9c-4e32-ba79-4b4ef6256c0b tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d8b5e18327f4713a1e465acb9e863f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c849c5d04f44f7951908d740ec1689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:00.849858 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-0c9bedee-4d9c-4e32-ba79-4b4ef6256c0b tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] 10.222.0.43 "GET /compute/v2.1/servers/67e13bce-be81-4775-be5f-737add9f1694" status: 200 len: 1452 microversion: 2.75 time: 0.228020 Oct 04 18:36:00.866180 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 682/1242] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:36:00 2022] GET /compute/v2.1/servers/67e13bce-be81-4775-be5f-737add9f1694 => generated 1452 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:36:00.918768 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-e22c6008-0e7f-4c45-80d0-d689e6ef8f44 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Flavor limits 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:36:00.919340 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-e22c6008-0e7f-4c45-80d0-d689e6ef8f44 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Image limits 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:36:00.919791 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-e22c6008-0e7f-4c45-80d0-d689e6ef8f44 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Flavor pref 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:36:00.920228 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-e22c6008-0e7f-4c45-80d0-d689e6ef8f44 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Image pref 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:36:00.920688 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-e22c6008-0e7f-4c45-80d0-d689e6ef8f44 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:36:00.956739 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e22c6008-0e7f-4c45-80d0-d689e6ef8f44 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:00.957199 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e22c6008-0e7f-4c45-80d0-d689e6ef8f44 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:00.957653 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e22c6008-0e7f-4c45-80d0-d689e6ef8f44 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:00.958409 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e22c6008-0e7f-4c45-80d0-d689e6ef8f44 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:00.958875 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e22c6008-0e7f-4c45-80d0-d689e6ef8f44 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:00.959314 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e22c6008-0e7f-4c45-80d0-d689e6ef8f44 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:00.986151 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-bd19236b-8e25-4bc9-bb37-2ae156910747 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:00.988881 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-bd19236b-8e25-4bc9-bb37-2ae156910747 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] [instance: eb05639b-cd53-4c27-9505-20e668a16acc] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:01.001353 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bd19236b-8e25-4bc9-bb37-2ae156910747 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:01.014253 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bd19236b-8e25-4bc9-bb37-2ae156910747 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:01.016704 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bd19236b-8e25-4bc9-bb37-2ae156910747 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:01.017636 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bd19236b-8e25-4bc9-bb37-2ae156910747 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:01.020542 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bd19236b-8e25-4bc9-bb37-2ae156910747 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:01.021385 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bd19236b-8e25-4bc9-bb37-2ae156910747 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:01.025311 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-e22c6008-0e7f-4c45-80d0-d689e6ef8f44 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Getting quotas for project 50a6a1a86a59403dad27f6e3c628853c. Resources: {'ram', 'cores', 'instances'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:36:01.041496 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-e22c6008-0e7f-4c45-80d0-d689e6ef8f44 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Getting quotas for user 581885ffa737444eafa3179cceb6ee1d and project 50a6a1a86a59403dad27f6e3c628853c. Resources: {'ram', 'cores', 'instances'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:36:01.101404 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-e22c6008-0e7f-4c45-80d0-d689e6ef8f44 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Going to run 1 instances... {{(pid=123595) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:36:01.104090 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-e22c6008-0e7f-4c45-80d0-d689e6ef8f44 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: ce0d629a-068c-4a62-8a03-fc43fc0be9b3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e8943ec5-4038-4d4b-b9b9-2415a79f5243',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:36:01.123540 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-bd19236b-8e25-4bc9-bb37-2ae156910747 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] 10.222.0.43 "GET /compute/v2.1/servers/eb05639b-cd53-4c27-9505-20e668a16acc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.141291 Oct 04 18:36:01.126161 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 683/1243] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Oct 4 18:36:00 2022] GET /compute/v2.1/servers/eb05639b-cd53-4c27-9505-20e668a16acc/os-volume_attachments => generated 197 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:36:01.180984 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-df43ea3c-1a72-4ee8-99ca-53b296c55588 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:01.185182 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-df43ea3c-1a72-4ee8-99ca-53b296c55588 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] [instance: 84e0414b-a39f-4bfe-bc9d-c170ceb34d15] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:01.206923 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-df43ea3c-1a72-4ee8-99ca-53b296c55588 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:01.207614 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-df43ea3c-1a72-4ee8-99ca-53b296c55588 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:01.211009 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-df43ea3c-1a72-4ee8-99ca-53b296c55588 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:01.212788 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-df43ea3c-1a72-4ee8-99ca-53b296c55588 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:01.215368 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-df43ea3c-1a72-4ee8-99ca-53b296c55588 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:01.215938 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-df43ea3c-1a72-4ee8-99ca-53b296c55588 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:01.226197 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-e22c6008-0e7f-4c45-80d0-d689e6ef8f44 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.077179 Oct 04 18:36:01.227021 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 561/1244] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 18:36:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 1080 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:36:01.249058 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-3c03d8b1-d56a-4991-9be1-993751d08295 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:01.254495 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-3c03d8b1-d56a-4991-9be1-993751d08295 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: ce0d629a-068c-4a62-8a03-fc43fc0be9b3] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:01.372963 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-3c03d8b1-d56a-4991-9be1-993751d08295 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:01.380188 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-3c03d8b1-d56a-4991-9be1-993751d08295 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/ce0d629a-068c-4a62-8a03-fc43fc0be9b3" status: 200 len: 1213 microversion: 2.1 time: 0.140171 Oct 04 18:36:01.381943 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 562/1245] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:01 2022] GET /compute/v2.1/servers/ce0d629a-068c-4a62-8a03-fc43fc0be9b3 => generated 1213 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:01.423791 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-df43ea3c-1a72-4ee8-99ca-53b296c55588 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:01.436765 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-df43ea3c-1a72-4ee8-99ca-53b296c55588 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:01.438338 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-df43ea3c-1a72-4ee8-99ca-53b296c55588 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:01.445714 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-df43ea3c-1a72-4ee8-99ca-53b296c55588 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] 10.222.0.43 "GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15" status: 200 len: 1544 microversion: 2.91 time: 0.270570 Oct 04 18:36:01.458835 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 684/1246] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:36:01 2022] GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15 => generated 1544 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:36:01.564287 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-9998c175-61bd-4d30-b264-b76fff0ae063 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:01.565311 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-9998c175-61bd-4d30-b264-b76fff0ae063 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] [instance: 9ee1bd28-0921-4444-afe3-c09cbfa0680a] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:01.572491 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9998c175-61bd-4d30-b264-b76fff0ae063 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:01.573864 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9998c175-61bd-4d30-b264-b76fff0ae063 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:01.574467 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9998c175-61bd-4d30-b264-b76fff0ae063 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:01.575334 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9998c175-61bd-4d30-b264-b76fff0ae063 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:01.575948 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9998c175-61bd-4d30-b264-b76fff0ae063 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:01.576695 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9998c175-61bd-4d30-b264-b76fff0ae063 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:01.689104 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-9998c175-61bd-4d30-b264-b76fff0ae063 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a41ab6fb78a42ceaca621c5a38ffc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa31ed92017490a82497c7b8910aef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:01.710711 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-9998c175-61bd-4d30-b264-b76fff0ae063 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] 10.222.0.43 "GET /compute/v2.1/servers/9ee1bd28-0921-4444-afe3-c09cbfa0680a" status: 200 len: 1203 microversion: 2.1 time: 0.151843 Oct 04 18:36:01.712299 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 563/1247] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:01 2022] GET /compute/v2.1/servers/9ee1bd28-0921-4444-afe3-c09cbfa0680a => generated 1203 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:01.897629 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-78e377ec-1dff-47ec-8efd-df4ed61927bd tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:01.898236 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-78e377ec-1dff-47ec-8efd-df4ed61927bd tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] [instance: 67e13bce-be81-4775-be5f-737add9f1694] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:01.906083 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-78e377ec-1dff-47ec-8efd-df4ed61927bd tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:01.906786 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-78e377ec-1dff-47ec-8efd-df4ed61927bd tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:01.907416 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-78e377ec-1dff-47ec-8efd-df4ed61927bd tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:01.908478 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-78e377ec-1dff-47ec-8efd-df4ed61927bd tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:01.909295 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-78e377ec-1dff-47ec-8efd-df4ed61927bd tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:01.909907 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-78e377ec-1dff-47ec-8efd-df4ed61927bd tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:02.005276 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-78e377ec-1dff-47ec-8efd-df4ed61927bd tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8b5e18327f4713a1e465acb9e863f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c849c5d04f44f7951908d740ec1689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:02.029081 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-78e377ec-1dff-47ec-8efd-df4ed61927bd tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d8b5e18327f4713a1e465acb9e863f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c849c5d04f44f7951908d740ec1689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:02.037287 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-78e377ec-1dff-47ec-8efd-df4ed61927bd tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d8b5e18327f4713a1e465acb9e863f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c849c5d04f44f7951908d740ec1689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:02.067182 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-78e377ec-1dff-47ec-8efd-df4ed61927bd tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] 10.222.0.43 "GET /compute/v2.1/servers/67e13bce-be81-4775-be5f-737add9f1694" status: 200 len: 1452 microversion: 2.75 time: 0.173390 Oct 04 18:36:02.067781 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 685/1248] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:36:01 2022] GET /compute/v2.1/servers/67e13bce-be81-4775-be5f-737add9f1694 => generated 1452 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:36:02.138298 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-3cd9fcee-b357-43b7-9dc3-58ad3ea131ab tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:02.141234 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-3cd9fcee-b357-43b7-9dc3-58ad3ea131ab tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] [instance: eb05639b-cd53-4c27-9505-20e668a16acc] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:02.147604 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3cd9fcee-b357-43b7-9dc3-58ad3ea131ab tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:02.148303 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3cd9fcee-b357-43b7-9dc3-58ad3ea131ab tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:02.149043 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3cd9fcee-b357-43b7-9dc3-58ad3ea131ab tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:02.149966 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3cd9fcee-b357-43b7-9dc3-58ad3ea131ab tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:02.150509 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3cd9fcee-b357-43b7-9dc3-58ad3ea131ab tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:02.151011 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3cd9fcee-b357-43b7-9dc3-58ad3ea131ab tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:02.184456 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-3cd9fcee-b357-43b7-9dc3-58ad3ea131ab tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] 10.222.0.43 "GET /compute/v2.1/servers/eb05639b-cd53-4c27-9505-20e668a16acc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050934 Oct 04 18:36:02.185041 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 564/1249] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Oct 4 18:36:02 2022] GET /compute/v2.1/servers/eb05639b-cd53-4c27-9505-20e668a16acc/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:36:02.410201 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-26f27206-1e22-494c-a48d-9540848fc819 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:02.410989 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-26f27206-1e22-494c-a48d-9540848fc819 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: ce0d629a-068c-4a62-8a03-fc43fc0be9b3] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:02.422249 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-26f27206-1e22-494c-a48d-9540848fc819 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:02.424036 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-26f27206-1e22-494c-a48d-9540848fc819 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:02.424492 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-26f27206-1e22-494c-a48d-9540848fc819 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:02.426404 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-26f27206-1e22-494c-a48d-9540848fc819 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:02.429207 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-26f27206-1e22-494c-a48d-9540848fc819 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:02.437376 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-26f27206-1e22-494c-a48d-9540848fc819 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:02.494157 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-2caa340e-ab82-4f62-bcb1-25c96e5c81e1 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:02.495201 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-2caa340e-ab82-4f62-bcb1-25c96e5c81e1 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] [instance: 84e0414b-a39f-4bfe-bc9d-c170ceb34d15] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:02.509158 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2caa340e-ab82-4f62-bcb1-25c96e5c81e1 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:02.511355 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2caa340e-ab82-4f62-bcb1-25c96e5c81e1 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:02.513183 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2caa340e-ab82-4f62-bcb1-25c96e5c81e1 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:02.514596 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2caa340e-ab82-4f62-bcb1-25c96e5c81e1 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:02.522088 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2caa340e-ab82-4f62-bcb1-25c96e5c81e1 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:02.525982 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2caa340e-ab82-4f62-bcb1-25c96e5c81e1 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:02.689257 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-2caa340e-ab82-4f62-bcb1-25c96e5c81e1 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:02.691405 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-26f27206-1e22-494c-a48d-9540848fc819 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:02.708915 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-26f27206-1e22-494c-a48d-9540848fc819 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/ce0d629a-068c-4a62-8a03-fc43fc0be9b3" status: 200 len: 1209 microversion: 2.1 time: 0.304683 Oct 04 18:36:02.711482 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-2caa340e-ab82-4f62-bcb1-25c96e5c81e1 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:02.715548 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 686/1250] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:02 2022] GET /compute/v2.1/servers/ce0d629a-068c-4a62-8a03-fc43fc0be9b3 => generated 1209 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:02.717146 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-2caa340e-ab82-4f62-bcb1-25c96e5c81e1 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:02.735835 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-2caa340e-ab82-4f62-bcb1-25c96e5c81e1 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] 10.222.0.43 "GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15" status: 200 len: 1544 microversion: 2.91 time: 0.252464 Oct 04 18:36:02.736724 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 565/1251] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:36:02 2022] GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15 => generated 1544 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:36:02.737451 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-2d635616-d919-40e0-b181-b0180d0da4f6 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:02.738498 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-2d635616-d919-40e0-b181-b0180d0da4f6 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] [instance: 9ee1bd28-0921-4444-afe3-c09cbfa0680a] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:02.748402 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2d635616-d919-40e0-b181-b0180d0da4f6 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:02.749321 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2d635616-d919-40e0-b181-b0180d0da4f6 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:02.749943 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2d635616-d919-40e0-b181-b0180d0da4f6 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:02.750867 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2d635616-d919-40e0-b181-b0180d0da4f6 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:02.753007 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2d635616-d919-40e0-b181-b0180d0da4f6 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:02.753673 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2d635616-d919-40e0-b181-b0180d0da4f6 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:02.846014 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-2d635616-d919-40e0-b181-b0180d0da4f6 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a41ab6fb78a42ceaca621c5a38ffc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa31ed92017490a82497c7b8910aef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:02.855985 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-2d635616-d919-40e0-b181-b0180d0da4f6 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] 10.222.0.43 "GET /compute/v2.1/servers/9ee1bd28-0921-4444-afe3-c09cbfa0680a" status: 200 len: 1277 microversion: 2.1 time: 0.122998 Oct 04 18:36:02.870768 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 687/1252] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:02 2022] GET /compute/v2.1/servers/9ee1bd28-0921-4444-afe3-c09cbfa0680a => generated 1277 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:36:03.094736 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-533f72c5-0520-43c3-846e-7aa5e0d9d892 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:03.095346 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-533f72c5-0520-43c3-846e-7aa5e0d9d892 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] [instance: 67e13bce-be81-4775-be5f-737add9f1694] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:03.101281 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-533f72c5-0520-43c3-846e-7aa5e0d9d892 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:03.102020 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-533f72c5-0520-43c3-846e-7aa5e0d9d892 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:03.102458 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-533f72c5-0520-43c3-846e-7aa5e0d9d892 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:03.103169 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-533f72c5-0520-43c3-846e-7aa5e0d9d892 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:03.103623 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-533f72c5-0520-43c3-846e-7aa5e0d9d892 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:03.104047 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-533f72c5-0520-43c3-846e-7aa5e0d9d892 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:03.196783 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-1634cc7b-6445-4f23-a33f-0c8aaa89eb6a tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:03.210978 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-1634cc7b-6445-4f23-a33f-0c8aaa89eb6a tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] [instance: eb05639b-cd53-4c27-9505-20e668a16acc] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:03.224450 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-533f72c5-0520-43c3-846e-7aa5e0d9d892 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8b5e18327f4713a1e465acb9e863f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c849c5d04f44f7951908d740ec1689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:03.233989 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1634cc7b-6445-4f23-a33f-0c8aaa89eb6a tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:03.235713 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1634cc7b-6445-4f23-a33f-0c8aaa89eb6a tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:03.235841 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-533f72c5-0520-43c3-846e-7aa5e0d9d892 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d8b5e18327f4713a1e465acb9e863f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c849c5d04f44f7951908d740ec1689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:03.236594 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1634cc7b-6445-4f23-a33f-0c8aaa89eb6a tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:03.237303 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-533f72c5-0520-43c3-846e-7aa5e0d9d892 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d8b5e18327f4713a1e465acb9e863f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c849c5d04f44f7951908d740ec1689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:03.252278 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-533f72c5-0520-43c3-846e-7aa5e0d9d892 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] 10.222.0.43 "GET /compute/v2.1/servers/67e13bce-be81-4775-be5f-737add9f1694" status: 200 len: 1452 microversion: 2.75 time: 0.161298 Oct 04 18:36:03.252876 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 566/1253] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:36:03 2022] GET /compute/v2.1/servers/67e13bce-be81-4775-be5f-737add9f1694 => generated 1452 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:36:03.253046 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1634cc7b-6445-4f23-a33f-0c8aaa89eb6a tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:03.266478 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1634cc7b-6445-4f23-a33f-0c8aaa89eb6a tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.028s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:03.267090 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1634cc7b-6445-4f23-a33f-0c8aaa89eb6a tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:03.315467 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:36:03.335380 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-1634cc7b-6445-4f23-a33f-0c8aaa89eb6a tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] 10.222.0.43 "GET /compute/v2.1/servers/eb05639b-cd53-4c27-9505-20e668a16acc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.142865 Oct 04 18:36:03.337831 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 688/1254] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Oct 4 18:36:03 2022] GET /compute/v2.1/servers/eb05639b-cd53-4c27-9505-20e668a16acc/os-volume_attachments => generated 197 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:36:03.740233 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-5c9e6ce9-7964-4f49-a9ca-62fda9cb3010 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:03.741059 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-5c9e6ce9-7964-4f49-a9ca-62fda9cb3010 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: ce0d629a-068c-4a62-8a03-fc43fc0be9b3] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:03.751158 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5c9e6ce9-7964-4f49-a9ca-62fda9cb3010 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:03.760417 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5c9e6ce9-7964-4f49-a9ca-62fda9cb3010 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:03.761468 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5c9e6ce9-7964-4f49-a9ca-62fda9cb3010 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:03.762325 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5c9e6ce9-7964-4f49-a9ca-62fda9cb3010 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:03.768507 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-4f7acc80-6ed0-403a-a1cf-a028e4c44ba7 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:03.769308 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-4f7acc80-6ed0-403a-a1cf-a028e4c44ba7 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] [instance: 84e0414b-a39f-4bfe-bc9d-c170ceb34d15] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:03.776791 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5c9e6ce9-7964-4f49-a9ca-62fda9cb3010 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:03.777468 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5c9e6ce9-7964-4f49-a9ca-62fda9cb3010 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:03.781852 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4f7acc80-6ed0-403a-a1cf-a028e4c44ba7 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:03.788755 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4f7acc80-6ed0-403a-a1cf-a028e4c44ba7 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:03.789364 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4f7acc80-6ed0-403a-a1cf-a028e4c44ba7 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:03.790232 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4f7acc80-6ed0-403a-a1cf-a028e4c44ba7 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:03.791138 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4f7acc80-6ed0-403a-a1cf-a028e4c44ba7 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:03.797748 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4f7acc80-6ed0-403a-a1cf-a028e4c44ba7 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:03.919442 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-5c9e6ce9-7964-4f49-a9ca-62fda9cb3010 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:03.931623 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-5c9e6ce9-7964-4f49-a9ca-62fda9cb3010 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/ce0d629a-068c-4a62-8a03-fc43fc0be9b3" status: 200 len: 1271 microversion: 2.1 time: 0.195637 Oct 04 18:36:03.933400 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 567/1255] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:03 2022] GET /compute/v2.1/servers/ce0d629a-068c-4a62-8a03-fc43fc0be9b3 => generated 1271 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:03.946993 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-cde68244-46a5-4b98-9e2e-5e544b5ce181 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:03.947909 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-cde68244-46a5-4b98-9e2e-5e544b5ce181 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] [instance: 9ee1bd28-0921-4444-afe3-c09cbfa0680a] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:03.966178 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cde68244-46a5-4b98-9e2e-5e544b5ce181 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:03.967027 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cde68244-46a5-4b98-9e2e-5e544b5ce181 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:03.967841 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cde68244-46a5-4b98-9e2e-5e544b5ce181 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:03.968758 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cde68244-46a5-4b98-9e2e-5e544b5ce181 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:03.969431 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cde68244-46a5-4b98-9e2e-5e544b5ce181 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:03.970091 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cde68244-46a5-4b98-9e2e-5e544b5ce181 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:04.130612 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-cde68244-46a5-4b98-9e2e-5e544b5ce181 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a41ab6fb78a42ceaca621c5a38ffc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa31ed92017490a82497c7b8910aef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:04.140287 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-cde68244-46a5-4b98-9e2e-5e544b5ce181 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] 10.222.0.43 "GET /compute/v2.1/servers/9ee1bd28-0921-4444-afe3-c09cbfa0680a" status: 200 len: 1265 microversion: 2.1 time: 0.205543 Oct 04 18:36:04.145744 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 568/1256] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:03 2022] GET /compute/v2.1/servers/9ee1bd28-0921-4444-afe3-c09cbfa0680a => generated 1265 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:04.203500 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-4f7acc80-6ed0-403a-a1cf-a028e4c44ba7 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:04.222804 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-4f7acc80-6ed0-403a-a1cf-a028e4c44ba7 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:04.230324 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-4f7acc80-6ed0-403a-a1cf-a028e4c44ba7 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:04.253201 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-4f7acc80-6ed0-403a-a1cf-a028e4c44ba7 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] 10.222.0.43 "GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15" status: 200 len: 1544 microversion: 2.91 time: 0.489072 Oct 04 18:36:04.254264 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 689/1257] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:36:03 2022] GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15 => generated 1544 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:36:04.297335 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-92da06f4-cba6-4a88-baa2-d1eb612ab303 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:04.298549 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-92da06f4-cba6-4a88-baa2-d1eb612ab303 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] [instance: 67e13bce-be81-4775-be5f-737add9f1694] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:04.319392 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-92da06f4-cba6-4a88-baa2-d1eb612ab303 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:04.321273 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-92da06f4-cba6-4a88-baa2-d1eb612ab303 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:04.321997 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-92da06f4-cba6-4a88-baa2-d1eb612ab303 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:04.322929 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-92da06f4-cba6-4a88-baa2-d1eb612ab303 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:04.324066 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-92da06f4-cba6-4a88-baa2-d1eb612ab303 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:04.324663 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-92da06f4-cba6-4a88-baa2-d1eb612ab303 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:04.348204 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-4d62835c-76df-40c8-98c3-8d58dfb151bb tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:04.351043 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-4d62835c-76df-40c8-98c3-8d58dfb151bb tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] [instance: eb05639b-cd53-4c27-9505-20e668a16acc] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:04.361460 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4d62835c-76df-40c8-98c3-8d58dfb151bb tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:04.371413 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4d62835c-76df-40c8-98c3-8d58dfb151bb tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:04.372276 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4d62835c-76df-40c8-98c3-8d58dfb151bb tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:04.373348 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4d62835c-76df-40c8-98c3-8d58dfb151bb tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:04.374103 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4d62835c-76df-40c8-98c3-8d58dfb151bb tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:04.374796 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4d62835c-76df-40c8-98c3-8d58dfb151bb tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:04.437364 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-4d62835c-76df-40c8-98c3-8d58dfb151bb tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] 10.222.0.43 "GET /compute/v2.1/servers/eb05639b-cd53-4c27-9505-20e668a16acc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.092752 Oct 04 18:36:04.438345 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 690/1258] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Oct 4 18:36:04 2022] GET /compute/v2.1/servers/eb05639b-cd53-4c27-9505-20e668a16acc/os-volume_attachments => generated 197 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:36:04.458115 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-92da06f4-cba6-4a88-baa2-d1eb612ab303 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8b5e18327f4713a1e465acb9e863f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c849c5d04f44f7951908d740ec1689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:04.470971 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-92da06f4-cba6-4a88-baa2-d1eb612ab303 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d8b5e18327f4713a1e465acb9e863f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c849c5d04f44f7951908d740ec1689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:04.472435 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-92da06f4-cba6-4a88-baa2-d1eb612ab303 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d8b5e18327f4713a1e465acb9e863f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c849c5d04f44f7951908d740ec1689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:04.476802 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-579933ad-4cfe-4f42-bff5-e6bb57667cc9 req-3d0af565-a352-4014-833b-1bf28ccdaddf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93798a9a-d90d-4a4e-8e30-d6575486ff56", "name": "network-vif-unplugged", "status": "completed", "tag": "7b3aff25-35c6-4d42-9b23-577e2f738102"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:36:04.485639 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:36:04.491244 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-92da06f4-cba6-4a88-baa2-d1eb612ab303 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] 10.222.0.43 "GET /compute/v2.1/servers/67e13bce-be81-4775-be5f-737add9f1694" status: 200 len: 1452 microversion: 2.75 time: 0.198197 Oct 04 18:36:04.505553 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-579933ad-4cfe-4f42-bff5-e6bb57667cc9 req-3d0af565-a352-4014-833b-1bf28ccdaddf service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:04.505553 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-579933ad-4cfe-4f42-bff5-e6bb57667cc9 req-3d0af565-a352-4014-833b-1bf28ccdaddf service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:04.505553 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-579933ad-4cfe-4f42-bff5-e6bb57667cc9 req-3d0af565-a352-4014-833b-1bf28ccdaddf service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:04.506281 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 569/1259] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:36:04 2022] GET /compute/v2.1/servers/67e13bce-be81-4775-be5f-737add9f1694 => generated 1452 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:36:04.513513 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-579933ad-4cfe-4f42-bff5-e6bb57667cc9 req-3d0af565-a352-4014-833b-1bf28ccdaddf service nova] Creating event network-vif-unplugged:7b3aff25-35c6-4d42-9b23-577e2f738102 for instance 93798a9a-d90d-4a4e-8e30-d6575486ff56 on n-h1-851028-13 Oct 04 18:36:04.520315 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-579933ad-4cfe-4f42-bff5-e6bb57667cc9 req-3d0af565-a352-4014-833b-1bf28ccdaddf service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048954 Oct 04 18:36:04.521892 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 691/1260] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:36:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:36:04.957660 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-a9624743-a687-4fff-a0ee-c9fe2a0e7e15 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:04.958757 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-a9624743-a687-4fff-a0ee-c9fe2a0e7e15 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: ce0d629a-068c-4a62-8a03-fc43fc0be9b3] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:04.971881 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a9624743-a687-4fff-a0ee-c9fe2a0e7e15 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:04.972386 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a9624743-a687-4fff-a0ee-c9fe2a0e7e15 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:04.972828 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a9624743-a687-4fff-a0ee-c9fe2a0e7e15 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:04.973583 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a9624743-a687-4fff-a0ee-c9fe2a0e7e15 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:04.974038 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a9624743-a687-4fff-a0ee-c9fe2a0e7e15 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:04.974473 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a9624743-a687-4fff-a0ee-c9fe2a0e7e15 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:05.115346 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-a9624743-a687-4fff-a0ee-c9fe2a0e7e15 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:05.127850 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-a9624743-a687-4fff-a0ee-c9fe2a0e7e15 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/ce0d629a-068c-4a62-8a03-fc43fc0be9b3" status: 200 len: 1271 microversion: 2.1 time: 0.174630 Oct 04 18:36:05.133503 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 570/1261] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:04 2022] GET /compute/v2.1/servers/ce0d629a-068c-4a62-8a03-fc43fc0be9b3 => generated 1271 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:05.171295 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-8e16db2e-daa8-411b-8afe-60b20786b846 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:05.172019 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-8e16db2e-daa8-411b-8afe-60b20786b846 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] [instance: 9ee1bd28-0921-4444-afe3-c09cbfa0680a] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:05.185683 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8e16db2e-daa8-411b-8afe-60b20786b846 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:05.186186 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8e16db2e-daa8-411b-8afe-60b20786b846 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:05.186636 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8e16db2e-daa8-411b-8afe-60b20786b846 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:05.187357 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8e16db2e-daa8-411b-8afe-60b20786b846 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:05.189464 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8e16db2e-daa8-411b-8afe-60b20786b846 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:05.189960 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8e16db2e-daa8-411b-8afe-60b20786b846 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:05.281799 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-1eae2915-5a96-41ff-8552-5d451816daed tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:05.283716 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-1eae2915-5a96-41ff-8552-5d451816daed tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] [instance: 84e0414b-a39f-4bfe-bc9d-c170ceb34d15] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:05.296458 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1eae2915-5a96-41ff-8552-5d451816daed tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:05.297255 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1eae2915-5a96-41ff-8552-5d451816daed tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:05.300275 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1eae2915-5a96-41ff-8552-5d451816daed tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:05.305087 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1eae2915-5a96-41ff-8552-5d451816daed tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:05.305762 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1eae2915-5a96-41ff-8552-5d451816daed tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:05.306410 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1eae2915-5a96-41ff-8552-5d451816daed tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:05.423613 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-1eae2915-5a96-41ff-8552-5d451816daed tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:05.434951 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-1eae2915-5a96-41ff-8552-5d451816daed tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:05.436424 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-1eae2915-5a96-41ff-8552-5d451816daed tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:05.449196 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-1eae2915-5a96-41ff-8552-5d451816daed tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] 10.222.0.43 "GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15" status: 200 len: 1544 microversion: 2.91 time: 0.169359 Oct 04 18:36:05.462248 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 571/1262] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:36:05 2022] GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15 => generated 1544 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:36:05.464808 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-505280f6-9014-4172-9974-6ed4517a6242 req-e0a6587d-b2d5-4df1-bce9-b3b46030baf2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93798a9a-d90d-4a4e-8e30-d6575486ff56", "name": "network-vif-deleted", "tag": "7b3aff25-35c6-4d42-9b23-577e2f738102"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:36:05.490984 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-505280f6-9014-4172-9974-6ed4517a6242 req-e0a6587d-b2d5-4df1-bce9-b3b46030baf2 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:05.491610 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-505280f6-9014-4172-9974-6ed4517a6242 req-e0a6587d-b2d5-4df1-bce9-b3b46030baf2 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:05.492056 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-505280f6-9014-4172-9974-6ed4517a6242 req-e0a6587d-b2d5-4df1-bce9-b3b46030baf2 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:05.520074 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-505280f6-9014-4172-9974-6ed4517a6242 req-e0a6587d-b2d5-4df1-bce9-b3b46030baf2 service nova] Creating event network-vif-deleted:7b3aff25-35c6-4d42-9b23-577e2f738102 for instance 93798a9a-d90d-4a4e-8e30-d6575486ff56 on n-h1-851028-13 Oct 04 18:36:05.533631 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-505280f6-9014-4172-9974-6ed4517a6242 req-e0a6587d-b2d5-4df1-bce9-b3b46030baf2 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077282 Oct 04 18:36:05.535930 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 572/1263] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:36:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:36:05.546534 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-4988184b-adea-466b-90f8-a4c565dc07d3 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:05.549326 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-4988184b-adea-466b-90f8-a4c565dc07d3 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] [instance: eb05639b-cd53-4c27-9505-20e668a16acc] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:05.561831 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4988184b-adea-466b-90f8-a4c565dc07d3 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:05.565219 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4988184b-adea-466b-90f8-a4c565dc07d3 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:05.565769 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4988184b-adea-466b-90f8-a4c565dc07d3 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:05.571177 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4988184b-adea-466b-90f8-a4c565dc07d3 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:05.571702 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4988184b-adea-466b-90f8-a4c565dc07d3 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:05.572157 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4988184b-adea-466b-90f8-a4c565dc07d3 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:05.626252 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=100 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:36:05.656369 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-4988184b-adea-466b-90f8-a4c565dc07d3 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] 10.222.0.43 "GET /compute/v2.1/servers/eb05639b-cd53-4c27-9505-20e668a16acc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.115009 Oct 04 18:36:05.657473 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 573/1264] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Oct 4 18:36:05 2022] GET /compute/v2.1/servers/eb05639b-cd53-4c27-9505-20e668a16acc/os-volume_attachments => generated 197 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:36:05.662334 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-e2e946ba-6280-46c8-bcbd-e550493ac18a tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:05.671036 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-e2e946ba-6280-46c8-bcbd-e550493ac18a tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] [instance: 67e13bce-be81-4775-be5f-737add9f1694] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:05.687719 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e2e946ba-6280-46c8-bcbd-e550493ac18a tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:05.688445 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e2e946ba-6280-46c8-bcbd-e550493ac18a tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:05.689090 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e2e946ba-6280-46c8-bcbd-e550493ac18a tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:05.689945 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e2e946ba-6280-46c8-bcbd-e550493ac18a tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:05.690413 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e2e946ba-6280-46c8-bcbd-e550493ac18a tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:05.690856 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e2e946ba-6280-46c8-bcbd-e550493ac18a tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:05.697153 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-8e16db2e-daa8-411b-8afe-60b20786b846 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a41ab6fb78a42ceaca621c5a38ffc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa31ed92017490a82497c7b8910aef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:05.712320 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-8e16db2e-daa8-411b-8afe-60b20786b846 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] 10.222.0.43 "GET /compute/v2.1/servers/9ee1bd28-0921-4444-afe3-c09cbfa0680a" status: 200 len: 1307 microversion: 2.1 time: 0.544254 Oct 04 18:36:05.732815 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 692/1265] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:05 2022] GET /compute/v2.1/servers/9ee1bd28-0921-4444-afe3-c09cbfa0680a => generated 1307 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:05.848686 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-e2e946ba-6280-46c8-bcbd-e550493ac18a tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8b5e18327f4713a1e465acb9e863f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c849c5d04f44f7951908d740ec1689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:05.864220 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-e2e946ba-6280-46c8-bcbd-e550493ac18a tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d8b5e18327f4713a1e465acb9e863f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c849c5d04f44f7951908d740ec1689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:05.869709 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-e2e946ba-6280-46c8-bcbd-e550493ac18a tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d8b5e18327f4713a1e465acb9e863f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c849c5d04f44f7951908d740ec1689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:05.881235 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-e2e946ba-6280-46c8-bcbd-e550493ac18a tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] 10.222.0.43 "GET /compute/v2.1/servers/67e13bce-be81-4775-be5f-737add9f1694" status: 200 len: 1452 microversion: 2.75 time: 0.222419 Oct 04 18:36:05.882624 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 574/1266] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:36:05 2022] GET /compute/v2.1/servers/67e13bce-be81-4775-be5f-737add9f1694 => generated 1452 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:36:06.159081 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-75b66596-774c-45a5-87b9-53b81cfd19d2 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:06.159697 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-75b66596-774c-45a5-87b9-53b81cfd19d2 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: ce0d629a-068c-4a62-8a03-fc43fc0be9b3] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:06.194960 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-75b66596-774c-45a5-87b9-53b81cfd19d2 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:06.195498 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-75b66596-774c-45a5-87b9-53b81cfd19d2 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:06.195937 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-75b66596-774c-45a5-87b9-53b81cfd19d2 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:06.196665 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-75b66596-774c-45a5-87b9-53b81cfd19d2 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:06.197153 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-75b66596-774c-45a5-87b9-53b81cfd19d2 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:06.197580 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-75b66596-774c-45a5-87b9-53b81cfd19d2 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:06.480073 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-bd798387-1c23-454a-b5b4-1ae71a5ca344 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:06.480953 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-bd798387-1c23-454a-b5b4-1ae71a5ca344 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] [instance: 84e0414b-a39f-4bfe-bc9d-c170ceb34d15] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:06.501912 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bd798387-1c23-454a-b5b4-1ae71a5ca344 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:06.502653 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bd798387-1c23-454a-b5b4-1ae71a5ca344 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:06.503826 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bd798387-1c23-454a-b5b4-1ae71a5ca344 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:06.504890 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bd798387-1c23-454a-b5b4-1ae71a5ca344 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:06.505748 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bd798387-1c23-454a-b5b4-1ae71a5ca344 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:06.506957 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bd798387-1c23-454a-b5b4-1ae71a5ca344 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:06.636363 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-bd798387-1c23-454a-b5b4-1ae71a5ca344 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:06.647910 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-bd798387-1c23-454a-b5b4-1ae71a5ca344 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:06.652581 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-bd798387-1c23-454a-b5b4-1ae71a5ca344 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:06.659750 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-bd798387-1c23-454a-b5b4-1ae71a5ca344 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] 10.222.0.43 "GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15" status: 200 len: 1544 microversion: 2.91 time: 0.184138 Oct 04 18:36:06.660910 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 575/1267] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:36:06 2022] GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15 => generated 1544 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:36:06.670490 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-c19f4666-5ccf-468d-aea6-b5b496bea079 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:06.673277 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-c19f4666-5ccf-468d-aea6-b5b496bea079 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] [instance: eb05639b-cd53-4c27-9505-20e668a16acc] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:06.680986 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c19f4666-5ccf-468d-aea6-b5b496bea079 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:06.681872 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c19f4666-5ccf-468d-aea6-b5b496bea079 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:06.683120 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c19f4666-5ccf-468d-aea6-b5b496bea079 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:06.684225 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c19f4666-5ccf-468d-aea6-b5b496bea079 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:06.684908 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c19f4666-5ccf-468d-aea6-b5b496bea079 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:06.685572 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c19f4666-5ccf-468d-aea6-b5b496bea079 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:06.722251 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-c19f4666-5ccf-468d-aea6-b5b496bea079 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] 10.222.0.43 "GET /compute/v2.1/servers/eb05639b-cd53-4c27-9505-20e668a16acc/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.056614 Oct 04 18:36:06.723357 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 576/1268] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Oct 4 18:36:06 2022] GET /compute/v2.1/servers/eb05639b-cd53-4c27-9505-20e668a16acc/os-volume_attachments => generated 25 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:36:06.741969 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-6f96f240-5a97-4f54-9236-787630b907ac tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:06.742748 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-6f96f240-5a97-4f54-9236-787630b907ac tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] [instance: 9ee1bd28-0921-4444-afe3-c09cbfa0680a] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:06.755964 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6f96f240-5a97-4f54-9236-787630b907ac tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:06.756711 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6f96f240-5a97-4f54-9236-787630b907ac tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:06.757077 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6f96f240-5a97-4f54-9236-787630b907ac tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:06.758053 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6f96f240-5a97-4f54-9236-787630b907ac tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:06.758967 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6f96f240-5a97-4f54-9236-787630b907ac tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:06.762492 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-75b66596-774c-45a5-87b9-53b81cfd19d2 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:06.772218 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6f96f240-5a97-4f54-9236-787630b907ac tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:06.776865 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-75b66596-774c-45a5-87b9-53b81cfd19d2 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/ce0d629a-068c-4a62-8a03-fc43fc0be9b3" status: 200 len: 1313 microversion: 2.1 time: 0.622455 Oct 04 18:36:06.781248 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 693/1269] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:06 2022] GET /compute/v2.1/servers/ce0d629a-068c-4a62-8a03-fc43fc0be9b3 => generated 1313 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:06.910854 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-127d36d3-1cba-4dd6-810c-2a9d0a446295 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:06.911970 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-127d36d3-1cba-4dd6-810c-2a9d0a446295 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] [instance: 67e13bce-be81-4775-be5f-737add9f1694] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:06.924669 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-127d36d3-1cba-4dd6-810c-2a9d0a446295 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:06.925653 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-127d36d3-1cba-4dd6-810c-2a9d0a446295 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:06.926296 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-127d36d3-1cba-4dd6-810c-2a9d0a446295 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:06.927827 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-127d36d3-1cba-4dd6-810c-2a9d0a446295 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:06.928832 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-127d36d3-1cba-4dd6-810c-2a9d0a446295 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:06.929457 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-127d36d3-1cba-4dd6-810c-2a9d0a446295 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:07.051604 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-127d36d3-1cba-4dd6-810c-2a9d0a446295 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8b5e18327f4713a1e465acb9e863f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c849c5d04f44f7951908d740ec1689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:07.078520 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-127d36d3-1cba-4dd6-810c-2a9d0a446295 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d8b5e18327f4713a1e465acb9e863f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c849c5d04f44f7951908d740ec1689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:07.080019 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-127d36d3-1cba-4dd6-810c-2a9d0a446295 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d8b5e18327f4713a1e465acb9e863f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c849c5d04f44f7951908d740ec1689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:07.091396 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-127d36d3-1cba-4dd6-810c-2a9d0a446295 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] 10.222.0.43 "GET /compute/v2.1/servers/67e13bce-be81-4775-be5f-737add9f1694" status: 200 len: 1452 microversion: 2.75 time: 0.184651 Oct 04 18:36:07.092925 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 694/1270] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:36:06 2022] GET /compute/v2.1/servers/67e13bce-be81-4775-be5f-737add9f1694 => generated 1452 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:36:07.099582 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-0b5b7aa2-a7fb-4375-b28e-b153514e541d tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-640719709", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452", "networks": [{"uuid": "080c1339-0c4e-4f34-9f61-6d5bffd07a16"}]}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:36:07.164586 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-6f96f240-5a97-4f54-9236-787630b907ac tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a41ab6fb78a42ceaca621c5a38ffc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa31ed92017490a82497c7b8910aef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:07.218045 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-6f96f240-5a97-4f54-9236-787630b907ac tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] 10.222.0.43 "GET /compute/v2.1/servers/9ee1bd28-0921-4444-afe3-c09cbfa0680a" status: 200 len: 1307 microversion: 2.1 time: 0.473318 Oct 04 18:36:07.223403 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.network.neutron [None req-0b5b7aa2-a7fb-4375-b28e-b153514e541d tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] validate_networks() for [('080c1339-0c4e-4f34-9f61-6d5bffd07a16', None, None, None, None, None)] {{(pid=123596) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:36:07.238471 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 577/1271] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:06 2022] GET /compute/v2.1/servers/9ee1bd28-0921-4444-afe3-c09cbfa0680a => generated 1307 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:36:07.243515 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-40e14f03-c1fa-4144-a387-230d7d33bc5a req-26dfe6a0-02ca-47d0-8e7d-66ca6531a268 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ee1bd28-0921-4444-afe3-c09cbfa0680a", "tag": "9b0949c2-7109-4d21-a62e-7d24d18a41c0"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:36:07.262854 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-40e14f03-c1fa-4144-a387-230d7d33bc5a req-26dfe6a0-02ca-47d0-8e7d-66ca6531a268 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:07.263341 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-40e14f03-c1fa-4144-a387-230d7d33bc5a req-26dfe6a0-02ca-47d0-8e7d-66ca6531a268 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:07.264200 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-40e14f03-c1fa-4144-a387-230d7d33bc5a req-26dfe6a0-02ca-47d0-8e7d-66ca6531a268 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:07.275721 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-40e14f03-c1fa-4144-a387-230d7d33bc5a req-26dfe6a0-02ca-47d0-8e7d-66ca6531a268 service nova] Creating event network-changed:9b0949c2-7109-4d21-a62e-7d24d18a41c0 for instance 9ee1bd28-0921-4444-afe3-c09cbfa0680a on n-h2-851028-13 Oct 04 18:36:07.282140 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-40e14f03-c1fa-4144-a387-230d7d33bc5a req-26dfe6a0-02ca-47d0-8e7d-66ca6531a268 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041877 Oct 04 18:36:07.283257 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 578/1272] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:36:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:36:07.555161 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-a52bea1c-ab30-42db-a736-ef9827a2d8ed req-fb119a19-bf58-4f5d-a4ef-6cb5766ca02d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce0d629a-068c-4a62-8a03-fc43fc0be9b3", "tag": "5b0b787d-0181-4910-a488-5e61d24675ce"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:36:07.567673 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-a52bea1c-ab30-42db-a736-ef9827a2d8ed req-fb119a19-bf58-4f5d-a4ef-6cb5766ca02d service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:07.568484 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-a52bea1c-ab30-42db-a736-ef9827a2d8ed req-fb119a19-bf58-4f5d-a4ef-6cb5766ca02d service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:07.569185 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-a52bea1c-ab30-42db-a736-ef9827a2d8ed req-fb119a19-bf58-4f5d-a4ef-6cb5766ca02d service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:07.581381 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-a52bea1c-ab30-42db-a736-ef9827a2d8ed req-fb119a19-bf58-4f5d-a4ef-6cb5766ca02d service nova] Creating event network-changed:5b0b787d-0181-4910-a488-5e61d24675ce for instance ce0d629a-068c-4a62-8a03-fc43fc0be9b3 on n-h2-851028-13 Oct 04 18:36:07.586938 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-a52bea1c-ab30-42db-a736-ef9827a2d8ed req-fb119a19-bf58-4f5d-a4ef-6cb5766ca02d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036940 Oct 04 18:36:07.587935 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 579/1273] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:36:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:36:07.692921 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-19ecc537-5f77-434d-a218-7155df0bdabb tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:07.693587 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-19ecc537-5f77-434d-a218-7155df0bdabb tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] [instance: 84e0414b-a39f-4bfe-bc9d-c170ceb34d15] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:07.700996 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-19ecc537-5f77-434d-a218-7155df0bdabb tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:07.701797 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-19ecc537-5f77-434d-a218-7155df0bdabb tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:07.702242 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-19ecc537-5f77-434d-a218-7155df0bdabb tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:07.702952 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-19ecc537-5f77-434d-a218-7155df0bdabb tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:07.703411 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-19ecc537-5f77-434d-a218-7155df0bdabb tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:07.703837 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-19ecc537-5f77-434d-a218-7155df0bdabb tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:07.779944 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-19ecc537-5f77-434d-a218-7155df0bdabb tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:07.790205 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-19ecc537-5f77-434d-a218-7155df0bdabb tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:07.792630 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-19ecc537-5f77-434d-a218-7155df0bdabb tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:07.799685 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-19ecc537-5f77-434d-a218-7155df0bdabb tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] 10.222.0.43 "GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15" status: 200 len: 1544 microversion: 2.91 time: 0.111145 Oct 04 18:36:07.800361 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 580/1274] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:36:07 2022] GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15 => generated 1544 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:36:07.808796 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-de4a4f2e-5043-48ce-b2dd-24e2ff8db904 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:07.812252 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-de4a4f2e-5043-48ce-b2dd-24e2ff8db904 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: ce0d629a-068c-4a62-8a03-fc43fc0be9b3] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:07.823839 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-de4a4f2e-5043-48ce-b2dd-24e2ff8db904 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:07.825000 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-de4a4f2e-5043-48ce-b2dd-24e2ff8db904 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:07.825831 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-de4a4f2e-5043-48ce-b2dd-24e2ff8db904 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:07.826762 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-de4a4f2e-5043-48ce-b2dd-24e2ff8db904 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:07.827376 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-de4a4f2e-5043-48ce-b2dd-24e2ff8db904 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:07.827985 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-de4a4f2e-5043-48ce-b2dd-24e2ff8db904 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:07.988435 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-de4a4f2e-5043-48ce-b2dd-24e2ff8db904 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:07.998885 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-de4a4f2e-5043-48ce-b2dd-24e2ff8db904 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/ce0d629a-068c-4a62-8a03-fc43fc0be9b3" status: 200 len: 1313 microversion: 2.1 time: 0.197100 Oct 04 18:36:07.999479 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 581/1275] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:07 2022] GET /compute/v2.1/servers/ce0d629a-068c-4a62-8a03-fc43fc0be9b3 => generated 1313 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:08.038800 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-0b5b7aa2-a7fb-4375-b28e-b153514e541d tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Flavor limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:36:08.039518 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-0b5b7aa2-a7fb-4375-b28e-b153514e541d tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Image limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:36:08.039708 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-0b5b7aa2-a7fb-4375-b28e-b153514e541d tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Flavor pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:36:08.040254 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-0b5b7aa2-a7fb-4375-b28e-b153514e541d tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Image pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:36:08.040670 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-0b5b7aa2-a7fb-4375-b28e-b153514e541d tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:36:08.056906 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0b5b7aa2-a7fb-4375-b28e-b153514e541d tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:08.058165 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0b5b7aa2-a7fb-4375-b28e-b153514e541d tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:08.058651 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0b5b7aa2-a7fb-4375-b28e-b153514e541d tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:08.059517 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0b5b7aa2-a7fb-4375-b28e-b153514e541d tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:08.060132 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0b5b7aa2-a7fb-4375-b28e-b153514e541d tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:08.060734 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0b5b7aa2-a7fb-4375-b28e-b153514e541d tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:08.085728 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-0b5b7aa2-a7fb-4375-b28e-b153514e541d tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Getting quotas for project a1d6187bfad04cb7bc17155862ee0cdc. Resources: {'ram', 'cores', 'instances'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:36:08.092161 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-0b5b7aa2-a7fb-4375-b28e-b153514e541d tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Getting quotas for user 64887fff0bc7417094c4fee2f7e9aa5a and project a1d6187bfad04cb7bc17155862ee0cdc. Resources: {'ram', 'cores', 'instances'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:36:08.104743 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-0b5b7aa2-a7fb-4375-b28e-b153514e541d tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Going to run 1 instances... {{(pid=123596) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:36:08.107259 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-0b5b7aa2-a7fb-4375-b28e-b153514e541d tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] [instance: 63543ce9-528e-4064-a6cd-6dd249104468] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e8943ec5-4038-4d4b-b9b9-2415a79f5243',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123596) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:36:08.120984 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-0cc4b5cf-0cfa-4846-b78d-79152200c489 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:08.122237 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-0cc4b5cf-0cfa-4846-b78d-79152200c489 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] [instance: 67e13bce-be81-4775-be5f-737add9f1694] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:08.132190 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0cc4b5cf-0cfa-4846-b78d-79152200c489 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:08.132699 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0cc4b5cf-0cfa-4846-b78d-79152200c489 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:08.133171 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0cc4b5cf-0cfa-4846-b78d-79152200c489 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:08.133902 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0cc4b5cf-0cfa-4846-b78d-79152200c489 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:08.134362 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0cc4b5cf-0cfa-4846-b78d-79152200c489 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:08.134792 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0cc4b5cf-0cfa-4846-b78d-79152200c489 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:08.154952 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-0b5b7aa2-a7fb-4375-b28e-b153514e541d tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.060154 Oct 04 18:36:08.156024 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 695/1276] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 18:36:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 1062 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:36:08.168144 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-e0fd22b6-1797-4504-af90-d6d46307ebd0 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:08.169154 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-e0fd22b6-1797-4504-af90-d6d46307ebd0 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] [instance: 63543ce9-528e-4064-a6cd-6dd249104468] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:08.221101 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-0cc4b5cf-0cfa-4846-b78d-79152200c489 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8b5e18327f4713a1e465acb9e863f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c849c5d04f44f7951908d740ec1689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:08.231797 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-e0fd22b6-1797-4504-af90-d6d46307ebd0 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64887fff0bc7417094c4fee2f7e9aa5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6187bfad04cb7bc17155862ee0cdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:08.237779 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-0cc4b5cf-0cfa-4846-b78d-79152200c489 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d8b5e18327f4713a1e465acb9e863f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c849c5d04f44f7951908d740ec1689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:08.240032 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-e0fd22b6-1797-4504-af90-d6d46307ebd0 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] 10.222.0.43 "GET /compute/v2.1/servers/63543ce9-528e-4064-a6cd-6dd249104468" status: 200 len: 1217 microversion: 2.1 time: 0.076945 Oct 04 18:36:08.240623 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-0cc4b5cf-0cfa-4846-b78d-79152200c489 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d8b5e18327f4713a1e465acb9e863f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c849c5d04f44f7951908d740ec1689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:08.241361 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 696/1277] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:08 2022] GET /compute/v2.1/servers/63543ce9-528e-4064-a6cd-6dd249104468 => generated 1217 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:08.246857 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-2f5c6699-bfa9-4abc-a437-42a91247473e tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:08.247466 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-2f5c6699-bfa9-4abc-a437-42a91247473e tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] [instance: 9ee1bd28-0921-4444-afe3-c09cbfa0680a] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:08.255181 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2f5c6699-bfa9-4abc-a437-42a91247473e tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:08.256028 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2f5c6699-bfa9-4abc-a437-42a91247473e tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:08.256676 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2f5c6699-bfa9-4abc-a437-42a91247473e tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:08.257674 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2f5c6699-bfa9-4abc-a437-42a91247473e tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:08.258886 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2f5c6699-bfa9-4abc-a437-42a91247473e tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:08.259559 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2f5c6699-bfa9-4abc-a437-42a91247473e tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:08.261038 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-0cc4b5cf-0cfa-4846-b78d-79152200c489 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] 10.222.0.43 "GET /compute/v2.1/servers/67e13bce-be81-4775-be5f-737add9f1694" status: 200 len: 1452 microversion: 2.75 time: 0.144460 Oct 04 18:36:08.261633 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 582/1278] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:36:08 2022] GET /compute/v2.1/servers/67e13bce-be81-4775-be5f-737add9f1694 => generated 1452 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:36:08.456764 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-2f5c6699-bfa9-4abc-a437-42a91247473e tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a41ab6fb78a42ceaca621c5a38ffc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa31ed92017490a82497c7b8910aef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:08.466734 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-2f5c6699-bfa9-4abc-a437-42a91247473e tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] 10.222.0.43 "GET /compute/v2.1/servers/9ee1bd28-0921-4444-afe3-c09cbfa0680a" status: 200 len: 1307 microversion: 2.1 time: 0.223973 Oct 04 18:36:08.467337 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 697/1279] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:08 2022] GET /compute/v2.1/servers/9ee1bd28-0921-4444-afe3-c09cbfa0680a => generated 1307 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:08.832047 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-abb95d97-b1b9-4551-96b7-dc737624d6d7 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:08.832933 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-abb95d97-b1b9-4551-96b7-dc737624d6d7 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] [instance: 84e0414b-a39f-4bfe-bc9d-c170ceb34d15] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:08.839939 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-abb95d97-b1b9-4551-96b7-dc737624d6d7 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:08.840437 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-abb95d97-b1b9-4551-96b7-dc737624d6d7 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:08.840912 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-abb95d97-b1b9-4551-96b7-dc737624d6d7 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:08.841703 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-abb95d97-b1b9-4551-96b7-dc737624d6d7 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:08.842166 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-abb95d97-b1b9-4551-96b7-dc737624d6d7 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:08.842597 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-abb95d97-b1b9-4551-96b7-dc737624d6d7 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:08.914723 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-abb95d97-b1b9-4551-96b7-dc737624d6d7 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:08.926486 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-abb95d97-b1b9-4551-96b7-dc737624d6d7 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:08.930209 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-abb95d97-b1b9-4551-96b7-dc737624d6d7 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:08.936211 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-abb95d97-b1b9-4551-96b7-dc737624d6d7 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] 10.222.0.43 "GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15" status: 200 len: 1544 microversion: 2.91 time: 0.108036 Oct 04 18:36:08.936953 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 583/1280] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:36:08 2022] GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15 => generated 1544 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:36:09.022216 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-18725a14-969f-4eca-9c8e-c911406f381f tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:09.023218 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-18725a14-969f-4eca-9c8e-c911406f381f tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: ce0d629a-068c-4a62-8a03-fc43fc0be9b3] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:09.030115 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-18725a14-969f-4eca-9c8e-c911406f381f tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:09.030727 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-18725a14-969f-4eca-9c8e-c911406f381f tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:09.031407 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-18725a14-969f-4eca-9c8e-c911406f381f tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:09.032185 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-18725a14-969f-4eca-9c8e-c911406f381f tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:09.032998 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-18725a14-969f-4eca-9c8e-c911406f381f tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:09.033676 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-18725a14-969f-4eca-9c8e-c911406f381f tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:09.264642 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-f3a12364-d0ee-4fba-816f-ad536b32ab22 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:09.265328 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-f3a12364-d0ee-4fba-816f-ad536b32ab22 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] [instance: 63543ce9-528e-4064-a6cd-6dd249104468] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:09.273947 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f3a12364-d0ee-4fba-816f-ad536b32ab22 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:09.274466 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f3a12364-d0ee-4fba-816f-ad536b32ab22 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:09.274903 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f3a12364-d0ee-4fba-816f-ad536b32ab22 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:09.275630 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f3a12364-d0ee-4fba-816f-ad536b32ab22 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:09.276620 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f3a12364-d0ee-4fba-816f-ad536b32ab22 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:09.277076 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f3a12364-d0ee-4fba-816f-ad536b32ab22 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:09.303262 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-18725a14-969f-4eca-9c8e-c911406f381f tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:09.314837 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-18725a14-969f-4eca-9c8e-c911406f381f tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/ce0d629a-068c-4a62-8a03-fc43fc0be9b3" status: 200 len: 1313 microversion: 2.1 time: 0.297537 Oct 04 18:36:09.324291 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 698/1281] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:09 2022] GET /compute/v2.1/servers/ce0d629a-068c-4a62-8a03-fc43fc0be9b3 => generated 1313 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:09.339291 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-6a42ba8e-f16b-4526-b55c-9832628ef128 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:09.340300 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-6a42ba8e-f16b-4526-b55c-9832628ef128 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] [instance: 67e13bce-be81-4775-be5f-737add9f1694] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:09.349052 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6a42ba8e-f16b-4526-b55c-9832628ef128 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:09.350115 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6a42ba8e-f16b-4526-b55c-9832628ef128 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:09.351790 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6a42ba8e-f16b-4526-b55c-9832628ef128 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:09.353028 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6a42ba8e-f16b-4526-b55c-9832628ef128 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:09.353745 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6a42ba8e-f16b-4526-b55c-9832628ef128 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:09.354553 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6a42ba8e-f16b-4526-b55c-9832628ef128 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:09.455335 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-6a42ba8e-f16b-4526-b55c-9832628ef128 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8b5e18327f4713a1e465acb9e863f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c849c5d04f44f7951908d740ec1689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:09.467727 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-6a42ba8e-f16b-4526-b55c-9832628ef128 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d8b5e18327f4713a1e465acb9e863f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c849c5d04f44f7951908d740ec1689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:09.469430 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-6a42ba8e-f16b-4526-b55c-9832628ef128 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d8b5e18327f4713a1e465acb9e863f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c849c5d04f44f7951908d740ec1689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:09.475235 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-6a42ba8e-f16b-4526-b55c-9832628ef128 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] 10.222.0.43 "GET /compute/v2.1/servers/67e13bce-be81-4775-be5f-737add9f1694" status: 200 len: 1437 microversion: 2.75 time: 0.148352 Oct 04 18:36:09.476847 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 699/1282] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:36:09 2022] GET /compute/v2.1/servers/67e13bce-be81-4775-be5f-737add9f1694 => generated 1437 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:36:09.510521 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-37dcdcf0-3049-44ce-9914-de4c60a199c6 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:09.511067 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-37dcdcf0-3049-44ce-9914-de4c60a199c6 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] [instance: 9ee1bd28-0921-4444-afe3-c09cbfa0680a] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:09.521599 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-37dcdcf0-3049-44ce-9914-de4c60a199c6 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:09.522111 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-37dcdcf0-3049-44ce-9914-de4c60a199c6 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:09.522563 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-37dcdcf0-3049-44ce-9914-de4c60a199c6 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:09.523283 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-37dcdcf0-3049-44ce-9914-de4c60a199c6 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:09.523744 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-37dcdcf0-3049-44ce-9914-de4c60a199c6 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:09.524179 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-37dcdcf0-3049-44ce-9914-de4c60a199c6 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:09.527453 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-f3a12364-d0ee-4fba-816f-ad536b32ab22 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64887fff0bc7417094c4fee2f7e9aa5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6187bfad04cb7bc17155862ee0cdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:09.539753 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-f3a12364-d0ee-4fba-816f-ad536b32ab22 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] 10.222.0.43 "GET /compute/v2.1/servers/63543ce9-528e-4064-a6cd-6dd249104468" status: 200 len: 1221 microversion: 2.1 time: 0.279590 Oct 04 18:36:09.540157 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 584/1283] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:09 2022] GET /compute/v2.1/servers/63543ce9-528e-4064-a6cd-6dd249104468 => generated 1221 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:09.878483 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-37dcdcf0-3049-44ce-9914-de4c60a199c6 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a41ab6fb78a42ceaca621c5a38ffc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa31ed92017490a82497c7b8910aef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:09.890496 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-37dcdcf0-3049-44ce-9914-de4c60a199c6 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] 10.222.0.43 "GET /compute/v2.1/servers/9ee1bd28-0921-4444-afe3-c09cbfa0680a" status: 200 len: 1307 microversion: 2.1 time: 0.398136 Oct 04 18:36:09.897401 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 700/1284] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:09 2022] GET /compute/v2.1/servers/9ee1bd28-0921-4444-afe3-c09cbfa0680a => generated 1307 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:09.967209 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-a71b98a6-0ea9-4a71-b2b0-e6caf32d6a41 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243"}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:36:09.967795 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-33a707cd-6393-49c6-9d43-6422ced1165a tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:09.968302 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-33a707cd-6393-49c6-9d43-6422ced1165a tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] [instance: 84e0414b-a39f-4bfe-bc9d-c170ceb34d15] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:09.971647 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-a71b98a6-0ea9-4a71-b2b0-e6caf32d6a41 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] [instance: 67e13bce-be81-4775-be5f-737add9f1694] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:09.976902 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-33a707cd-6393-49c6-9d43-6422ced1165a tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:09.977599 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-33a707cd-6393-49c6-9d43-6422ced1165a tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:09.978355 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-33a707cd-6393-49c6-9d43-6422ced1165a tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:09.980430 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-33a707cd-6393-49c6-9d43-6422ced1165a tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:09.981533 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-33a707cd-6393-49c6-9d43-6422ced1165a tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:09.982162 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-33a707cd-6393-49c6-9d43-6422ced1165a tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:09.987907 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a71b98a6-0ea9-4a71-b2b0-e6caf32d6a41 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:09.988413 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a71b98a6-0ea9-4a71-b2b0-e6caf32d6a41 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:09.988975 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a71b98a6-0ea9-4a71-b2b0-e6caf32d6a41 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:09.989770 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a71b98a6-0ea9-4a71-b2b0-e6caf32d6a41 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:09.990465 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a71b98a6-0ea9-4a71-b2b0-e6caf32d6a41 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:09.990966 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a71b98a6-0ea9-4a71-b2b0-e6caf32d6a41 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:10.086649 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-33a707cd-6393-49c6-9d43-6422ced1165a tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:10.099201 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-33a707cd-6393-49c6-9d43-6422ced1165a tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:10.100862 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-33a707cd-6393-49c6-9d43-6422ced1165a tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:10.105126 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:36:10.108834 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-33a707cd-6393-49c6-9d43-6422ced1165a tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] 10.222.0.43 "GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15" status: 200 len: 1544 microversion: 2.91 time: 0.148360 Oct 04 18:36:10.109469 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 701/1285] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:36:09 2022] GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15 => generated 1544 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:36:10.166087 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-1e208fec-5a7e-4215-83bf-95cc3d071929 tempest-ImagesMetadataTestJSON-898211660 tempest-ImagesMetadataTestJSON-898211660-project] Calling method '.version_select at 0x7fb227d59e50>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:10.211403 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-1e208fec-5a7e-4215-83bf-95cc3d071929 tempest-ImagesMetadataTestJSON-898211660 tempest-ImagesMetadataTestJSON-898211660-project] 10.222.0.43 "GET /compute/v2.1/images/b7d4304d-eeee-4cc8-86ac-e9e7232b5a30" status: 200 len: 636 microversion: 2.1 time: 0.050636 Oct 04 18:36:10.212168 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 702/1286] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 18:36:10 2022] GET /compute/v2.1/images/b7d4304d-eeee-4cc8-86ac-e9e7232b5a30 => generated 636 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:36:10.216906 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-a71b98a6-0ea9-4a71-b2b0-e6caf32d6a41 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Flavor limits 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:36:10.217477 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-a71b98a6-0ea9-4a71-b2b0-e6caf32d6a41 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Image limits 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:36:10.218006 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-a71b98a6-0ea9-4a71-b2b0-e6caf32d6a41 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Flavor pref 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:36:10.218463 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-a71b98a6-0ea9-4a71-b2b0-e6caf32d6a41 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Image pref 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:36:10.218911 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-a71b98a6-0ea9-4a71-b2b0-e6caf32d6a41 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:36:10.226189 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-c8b3aa81-4d65-46e8-99fb-dbb49f183d0f tempest-ImagesMetadataTestJSON-898211660 tempest-ImagesMetadataTestJSON-898211660-project] Action: 'update_all', calling method: .version_select at 0x7fb227d86700>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:36:10.278247 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-c8b3aa81-4d65-46e8-99fb-dbb49f183d0f tempest-ImagesMetadataTestJSON-898211660 tempest-ImagesMetadataTestJSON-898211660-project] Getting quotas for project 16dea78980d645b5adc76f3f9d2a0d43. Resources: dict_keys(['metadata_items']) {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:36:10.283479 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-c8b3aa81-4d65-46e8-99fb-dbb49f183d0f tempest-ImagesMetadataTestJSON-898211660 tempest-ImagesMetadataTestJSON-898211660-project] Getting quotas for user 8b50c14ffaa84b59a4a0068b169dd35b and project 16dea78980d645b5adc76f3f9d2a0d43. Resources: dict_keys(['metadata_items']) {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:36:10.284070 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-a71b98a6-0ea9-4a71-b2b0-e6caf32d6a41 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] [instance: 67e13bce-be81-4775-be5f-737add9f1694] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:10.290042 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a71b98a6-0ea9-4a71-b2b0-e6caf32d6a41 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:10.290533 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a71b98a6-0ea9-4a71-b2b0-e6caf32d6a41 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:10.290983 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a71b98a6-0ea9-4a71-b2b0-e6caf32d6a41 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:10.292191 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a71b98a6-0ea9-4a71-b2b0-e6caf32d6a41 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:10.292657 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a71b98a6-0ea9-4a71-b2b0-e6caf32d6a41 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:10.293090 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a71b98a6-0ea9-4a71-b2b0-e6caf32d6a41 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:10.372379 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.objects.instance [None req-a71b98a6-0ea9-4a71-b2b0-e6caf32d6a41 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Lazy-loading 'services' on Instance uuid 67e13bce-be81-4775-be5f-737add9f1694 {{(pid=123595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:36:10.393965 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-a71b98a6-0ea9-4a71-b2b0-e6caf32d6a41 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] 10.222.0.43 "POST /compute/v2.1/servers/67e13bce-be81-4775-be5f-737add9f1694/action" status: 202 len: 1942 microversion: 2.75 time: 0.844252 Oct 04 18:36:10.394614 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 585/1287] 10.222.0.43 () {62 vars in 1319 bytes} [Tue Oct 4 18:36:09 2022] POST /compute/v2.1/servers/67e13bce-be81-4775-be5f-737add9f1694/action => generated 1942 bytes in 854 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 04 18:36:10.402065 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-15a0a213-649d-4616-948c-9c0e3e05f573 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:10.402669 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-15a0a213-649d-4616-948c-9c0e3e05f573 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: ce0d629a-068c-4a62-8a03-fc43fc0be9b3] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:10.409305 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-15a0a213-649d-4616-948c-9c0e3e05f573 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:10.409949 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-15a0a213-649d-4616-948c-9c0e3e05f573 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:10.410396 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-15a0a213-649d-4616-948c-9c0e3e05f573 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:10.411104 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-15a0a213-649d-4616-948c-9c0e3e05f573 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:10.411554 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-15a0a213-649d-4616-948c-9c0e3e05f573 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:10.411985 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-15a0a213-649d-4616-948c-9c0e3e05f573 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:10.580959 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-15a0a213-649d-4616-948c-9c0e3e05f573 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:10.598051 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-15a0a213-649d-4616-948c-9c0e3e05f573 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/ce0d629a-068c-4a62-8a03-fc43fc0be9b3" status: 200 len: 1313 microversion: 2.1 time: 0.198568 Oct 04 18:36:10.598748 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 586/1288] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:10 2022] GET /compute/v2.1/servers/ce0d629a-068c-4a62-8a03-fc43fc0be9b3 => generated 1313 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:10.606126 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-6068e922-71cf-4c9d-a487-b4d695605bcc tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:10.607226 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-6068e922-71cf-4c9d-a487-b4d695605bcc tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] [instance: 67e13bce-be81-4775-be5f-737add9f1694] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:10.622296 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6068e922-71cf-4c9d-a487-b4d695605bcc tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:10.623060 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6068e922-71cf-4c9d-a487-b4d695605bcc tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:10.623559 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6068e922-71cf-4c9d-a487-b4d695605bcc tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:10.624336 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6068e922-71cf-4c9d-a487-b4d695605bcc tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:10.624846 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6068e922-71cf-4c9d-a487-b4d695605bcc tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:10.626018 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6068e922-71cf-4c9d-a487-b4d695605bcc tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:10.643437 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-c8b3aa81-4d65-46e8-99fb-dbb49f183d0f tempest-ImagesMetadataTestJSON-898211660 tempest-ImagesMetadataTestJSON-898211660-project] 10.222.0.43 "PUT /compute/v2.1/images/b7d4304d-eeee-4cc8-86ac-e9e7232b5a30/metadata" status: 200 len: 61 microversion: 2.1 time: 0.420968 Oct 04 18:36:10.644580 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 703/1289] 10.222.0.43 () {60 vars in 1280 bytes} [Tue Oct 4 18:36:10 2022] PUT /compute/v2.1/images/b7d4304d-eeee-4cc8-86ac-e9e7232b5a30/metadata => generated 61 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 04 18:36:10.650216 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-bda1dc10-f77b-41ef-b8ec-df20938deef3 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:10.651468 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-bda1dc10-f77b-41ef-b8ec-df20938deef3 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] [instance: 63543ce9-528e-4064-a6cd-6dd249104468] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:10.658600 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bda1dc10-f77b-41ef-b8ec-df20938deef3 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:10.659183 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bda1dc10-f77b-41ef-b8ec-df20938deef3 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:10.659696 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bda1dc10-f77b-41ef-b8ec-df20938deef3 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:10.660471 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bda1dc10-f77b-41ef-b8ec-df20938deef3 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:10.660997 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bda1dc10-f77b-41ef-b8ec-df20938deef3 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:10.661518 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bda1dc10-f77b-41ef-b8ec-df20938deef3 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:10.727561 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-bda1dc10-f77b-41ef-b8ec-df20938deef3 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64887fff0bc7417094c4fee2f7e9aa5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6187bfad04cb7bc17155862ee0cdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:10.737523 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-bda1dc10-f77b-41ef-b8ec-df20938deef3 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] 10.222.0.43 "GET /compute/v2.1/servers/63543ce9-528e-4064-a6cd-6dd249104468" status: 200 len: 1277 microversion: 2.1 time: 0.091556 Oct 04 18:36:10.738944 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 704/1290] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:10 2022] GET /compute/v2.1/servers/63543ce9-528e-4064-a6cd-6dd249104468 => generated 1277 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:10.746099 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-09af3c05-f01b-47df-8de4-1b89bcd9309e tempest-ImagesMetadataTestJSON-898211660 tempest-ImagesMetadataTestJSON-898211660-project] Calling method '.version_select at 0x7fb227de9280>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:10.783183 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.objects.instance [None req-6068e922-71cf-4c9d-a487-b4d695605bcc tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Lazy-loading 'services' on Instance uuid 67e13bce-be81-4775-be5f-737add9f1694 {{(pid=123595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:36:10.852541 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-6068e922-71cf-4c9d-a487-b4d695605bcc tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/67e13bce-be81-4775-be5f-737add9f1694" status: 200 len: 1929 microversion: 2.75 time: 0.251877 Oct 04 18:36:10.856519 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 587/1291] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:36:10 2022] GET /compute/v2.1/servers/67e13bce-be81-4775-be5f-737add9f1694 => generated 1929 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:36:10.915583 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-f8e0d312-0886-4c7a-a593-2622b9464320 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:10.916267 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-f8e0d312-0886-4c7a-a593-2622b9464320 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] [instance: 9ee1bd28-0921-4444-afe3-c09cbfa0680a] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:10.923025 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f8e0d312-0886-4c7a-a593-2622b9464320 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:10.923519 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f8e0d312-0886-4c7a-a593-2622b9464320 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:10.923960 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f8e0d312-0886-4c7a-a593-2622b9464320 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:10.924872 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f8e0d312-0886-4c7a-a593-2622b9464320 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:10.925539 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f8e0d312-0886-4c7a-a593-2622b9464320 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:10.925876 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f8e0d312-0886-4c7a-a593-2622b9464320 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:10.942270 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:36:10.983041 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=2 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:36:11.095897 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-09af3c05-f01b-47df-8de4-1b89bcd9309e tempest-ImagesMetadataTestJSON-898211660 tempest-ImagesMetadataTestJSON-898211660-project] 10.222.0.43 "DELETE /compute/v2.1/images/b7d4304d-eeee-4cc8-86ac-e9e7232b5a30/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.355338 Oct 04 18:36:11.099706 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 705/1292] 10.222.0.43 () {58 vars in 1296 bytes} [Tue Oct 4 18:36:10 2022] DELETE /compute/v2.1/images/b7d4304d-eeee-4cc8-86ac-e9e7232b5a30/metadata/os_version => generated 0 bytes in 357 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:36:11.104778 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-38913e85-b64c-4128-9b1f-32326c3b0906 tempest-ImagesMetadataTestJSON-898211660 tempest-ImagesMetadataTestJSON-898211660-project] Calling method '.version_select at 0x7fb227e5d550>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:11.157540 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-38913e85-b64c-4128-9b1f-32326c3b0906 tempest-ImagesMetadataTestJSON-898211660 tempest-ImagesMetadataTestJSON-898211660-project] 10.222.0.43 "GET /compute/v2.1/images/b7d4304d-eeee-4cc8-86ac-e9e7232b5a30/metadata" status: 200 len: 37 microversion: 2.1 time: 0.056486 Oct 04 18:36:11.163598 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 706/1293] 10.222.0.43 () {58 vars in 1260 bytes} [Tue Oct 4 18:36:11 2022] GET /compute/v2.1/images/b7d4304d-eeee-4cc8-86ac-e9e7232b5a30/metadata => generated 37 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:36:11.164821 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-c41dd428-cc7b-4ca0-8cb7-05e787bb78e4 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:11.165685 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-c41dd428-cc7b-4ca0-8cb7-05e787bb78e4 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] [instance: 84e0414b-a39f-4bfe-bc9d-c170ceb34d15] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:11.172243 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c41dd428-cc7b-4ca0-8cb7-05e787bb78e4 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:11.172952 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c41dd428-cc7b-4ca0-8cb7-05e787bb78e4 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:11.173626 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c41dd428-cc7b-4ca0-8cb7-05e787bb78e4 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:11.174500 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c41dd428-cc7b-4ca0-8cb7-05e787bb78e4 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:11.175153 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c41dd428-cc7b-4ca0-8cb7-05e787bb78e4 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:11.175762 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c41dd428-cc7b-4ca0-8cb7-05e787bb78e4 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:11.263061 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-c41dd428-cc7b-4ca0-8cb7-05e787bb78e4 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:11.263460 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-f8e0d312-0886-4c7a-a593-2622b9464320 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a41ab6fb78a42ceaca621c5a38ffc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa31ed92017490a82497c7b8910aef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:11.279364 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-c41dd428-cc7b-4ca0-8cb7-05e787bb78e4 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:11.280007 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-f8e0d312-0886-4c7a-a593-2622b9464320 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] 10.222.0.43 "GET /compute/v2.1/servers/9ee1bd28-0921-4444-afe3-c09cbfa0680a" status: 200 len: 1307 microversion: 2.1 time: 0.368237 Oct 04 18:36:11.280607 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 588/1294] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:10 2022] GET /compute/v2.1/servers/9ee1bd28-0921-4444-afe3-c09cbfa0680a => generated 1307 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:36:11.282415 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-c41dd428-cc7b-4ca0-8cb7-05e787bb78e4 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:11.290903 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-c41dd428-cc7b-4ca0-8cb7-05e787bb78e4 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] 10.222.0.43 "GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15" status: 200 len: 1531 microversion: 2.91 time: 0.131008 Oct 04 18:36:11.292075 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-a83d55e7-72e1-4c21-95ca-2c008f12851a tempest-ImagesMetadataTestJSON-898211660 tempest-ImagesMetadataTestJSON-898211660-project] Action: 'update_all', calling method: .version_select at 0x7fb21f980dc0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:36:11.292851 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 707/1295] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:36:11 2022] GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15 => generated 1531 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:36:11.324724 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-34453471-53a3-4829-8c43-c7ad949d5b17 tempest-UnshelveToHostMultiNodesTest-313056567 tempest-UnshelveToHostMultiNodesTest-313056567-project-admin] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:11.325283 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-34453471-53a3-4829-8c43-c7ad949d5b17 tempest-UnshelveToHostMultiNodesTest-313056567 tempest-UnshelveToHostMultiNodesTest-313056567-project-admin] [instance: 84e0414b-a39f-4bfe-bc9d-c170ceb34d15] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:11.340121 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-34453471-53a3-4829-8c43-c7ad949d5b17 tempest-UnshelveToHostMultiNodesTest-313056567 tempest-UnshelveToHostMultiNodesTest-313056567-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:11.340886 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-34453471-53a3-4829-8c43-c7ad949d5b17 tempest-UnshelveToHostMultiNodesTest-313056567 tempest-UnshelveToHostMultiNodesTest-313056567-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:11.342941 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-34453471-53a3-4829-8c43-c7ad949d5b17 tempest-UnshelveToHostMultiNodesTest-313056567 tempest-UnshelveToHostMultiNodesTest-313056567-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:11.343660 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-34453471-53a3-4829-8c43-c7ad949d5b17 tempest-UnshelveToHostMultiNodesTest-313056567 tempest-UnshelveToHostMultiNodesTest-313056567-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:11.344125 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-34453471-53a3-4829-8c43-c7ad949d5b17 tempest-UnshelveToHostMultiNodesTest-313056567 tempest-UnshelveToHostMultiNodesTest-313056567-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:11.344555 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-34453471-53a3-4829-8c43-c7ad949d5b17 tempest-UnshelveToHostMultiNodesTest-313056567 tempest-UnshelveToHostMultiNodesTest-313056567-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:11.379652 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=8 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:36:11.390341 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-a83d55e7-72e1-4c21-95ca-2c008f12851a tempest-ImagesMetadataTestJSON-898211660 tempest-ImagesMetadataTestJSON-898211660-project] Getting quotas for project 16dea78980d645b5adc76f3f9d2a0d43. Resources: dict_keys(['metadata_items']) {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:36:11.395961 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-a83d55e7-72e1-4c21-95ca-2c008f12851a tempest-ImagesMetadataTestJSON-898211660 tempest-ImagesMetadataTestJSON-898211660-project] Getting quotas for user 8b50c14ffaa84b59a4a0068b169dd35b and project 16dea78980d645b5adc76f3f9d2a0d43. Resources: dict_keys(['metadata_items']) {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:36:11.456510 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.objects.instance [None req-34453471-53a3-4829-8c43-c7ad949d5b17 tempest-UnshelveToHostMultiNodesTest-313056567 tempest-UnshelveToHostMultiNodesTest-313056567-project-admin] Lazy-loading 'services' on Instance uuid 84e0414b-a39f-4bfe-bc9d-c170ceb34d15 {{(pid=123596) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:36:11.484246 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-34453471-53a3-4829-8c43-c7ad949d5b17 tempest-UnshelveToHostMultiNodesTest-313056567 tempest-UnshelveToHostMultiNodesTest-313056567-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15" status: 200 len: 1938 microversion: 2.91 time: 0.163896 Oct 04 18:36:11.485285 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 708/1296] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:36:11 2022] GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15 => generated 1938 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:36:11.541968 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-0687981d-9f35-4f94-bcac-41ca0f2c5fa1 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:11.542614 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-0687981d-9f35-4f94-bcac-41ca0f2c5fa1 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] [instance: 84e0414b-a39f-4bfe-bc9d-c170ceb34d15] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:11.551254 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0687981d-9f35-4f94-bcac-41ca0f2c5fa1 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:11.552194 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0687981d-9f35-4f94-bcac-41ca0f2c5fa1 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:11.553324 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0687981d-9f35-4f94-bcac-41ca0f2c5fa1 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:11.554422 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0687981d-9f35-4f94-bcac-41ca0f2c5fa1 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:11.555114 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0687981d-9f35-4f94-bcac-41ca0f2c5fa1 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:11.556074 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0687981d-9f35-4f94-bcac-41ca0f2c5fa1 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:11.586736 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-0687981d-9f35-4f94-bcac-41ca0f2c5fa1 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] [instance: 84e0414b-a39f-4bfe-bc9d-c170ceb34d15] Going to try to terminate instance {{(pid=123596) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:36:11.664864 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:36:11.716060 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-0687981d-9f35-4f94-bcac-41ca0f2c5fa1 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] 10.222.0.43 "DELETE /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15" status: 204 len: 0 microversion: 2.91 time: 0.179858 Oct 04 18:36:11.716895 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 709/1297] 10.222.0.43 () {60 vars in 1280 bytes} [Tue Oct 4 18:36:11 2022] DELETE /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 18:36:11.728353 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-238fee94-d324-4e46-8a95-48e155e46812 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:11.729179 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-238fee94-d324-4e46-8a95-48e155e46812 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: ce0d629a-068c-4a62-8a03-fc43fc0be9b3] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:11.741867 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-238fee94-d324-4e46-8a95-48e155e46812 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:11.742683 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-238fee94-d324-4e46-8a95-48e155e46812 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:11.743444 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-238fee94-d324-4e46-8a95-48e155e46812 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:11.746136 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-238fee94-d324-4e46-8a95-48e155e46812 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:11.746985 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-238fee94-d324-4e46-8a95-48e155e46812 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:11.747583 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-238fee94-d324-4e46-8a95-48e155e46812 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:11.751954 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-a83d55e7-72e1-4c21-95ca-2c008f12851a tempest-ImagesMetadataTestJSON-898211660 tempest-ImagesMetadataTestJSON-898211660-project] 10.222.0.43 "PUT /compute/v2.1/images/b7d4304d-eeee-4cc8-86ac-e9e7232b5a30/metadata" status: 200 len: 61 microversion: 2.1 time: 0.470228 Oct 04 18:36:11.753064 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 589/1298] 10.222.0.43 () {60 vars in 1280 bytes} [Tue Oct 4 18:36:11 2022] PUT /compute/v2.1/images/b7d4304d-eeee-4cc8-86ac-e9e7232b5a30/metadata => generated 61 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:36:11.761330 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-614daa95-e437-4032-bf7e-20dd34406144 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:11.762328 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-614daa95-e437-4032-bf7e-20dd34406144 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] [instance: 84e0414b-a39f-4bfe-bc9d-c170ceb34d15] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:11.774046 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-614daa95-e437-4032-bf7e-20dd34406144 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:11.775128 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-614daa95-e437-4032-bf7e-20dd34406144 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:11.775945 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-614daa95-e437-4032-bf7e-20dd34406144 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:11.776987 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-614daa95-e437-4032-bf7e-20dd34406144 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:11.777703 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-614daa95-e437-4032-bf7e-20dd34406144 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:11.778341 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-614daa95-e437-4032-bf7e-20dd34406144 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:11.901491 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-614daa95-e437-4032-bf7e-20dd34406144 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:11.910814 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-614daa95-e437-4032-bf7e-20dd34406144 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:11.912421 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-614daa95-e437-4032-bf7e-20dd34406144 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:11.918834 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-614daa95-e437-4032-bf7e-20dd34406144 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] 10.222.0.43 "GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15" status: 200 len: 1537 microversion: 2.91 time: 0.164310 Oct 04 18:36:11.919618 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 590/1299] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:36:11 2022] GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15 => generated 1537 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:36:11.924720 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-7cfeffa2-be78-4b33-b5c6-43860072f78e tempest-ImagesMetadataTestJSON-898211660 tempest-ImagesMetadataTestJSON-898211660-project] Calling method '.version_select at 0x7fb21fa3a310>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:11.954536 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-238fee94-d324-4e46-8a95-48e155e46812 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:11.966190 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-238fee94-d324-4e46-8a95-48e155e46812 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/ce0d629a-068c-4a62-8a03-fc43fc0be9b3" status: 200 len: 1313 microversion: 2.1 time: 0.242644 Oct 04 18:36:11.967509 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 710/1300] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:11 2022] GET /compute/v2.1/servers/ce0d629a-068c-4a62-8a03-fc43fc0be9b3 => generated 1313 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:11.969878 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-7cfeffa2-be78-4b33-b5c6-43860072f78e tempest-ImagesMetadataTestJSON-898211660 tempest-ImagesMetadataTestJSON-898211660-project] 10.222.0.43 "GET /compute/v2.1/images/b7d4304d-eeee-4cc8-86ac-e9e7232b5a30/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.048920 Oct 04 18:36:11.977612 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 591/1301] 10.222.0.43 () {58 vars in 1290 bytes} [Tue Oct 4 18:36:11 2022] GET /compute/v2.1/images/b7d4304d-eeee-4cc8-86ac-e9e7232b5a30/metadata/os_distro => generated 33 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:36:11.977874 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-e051b3fb-dcd4-4b7b-88d5-9a22b86082f4 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:11.977874 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-e051b3fb-dcd4-4b7b-88d5-9a22b86082f4 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] [instance: 63543ce9-528e-4064-a6cd-6dd249104468] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:11.985496 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e051b3fb-dcd4-4b7b-88d5-9a22b86082f4 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:11.986358 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e051b3fb-dcd4-4b7b-88d5-9a22b86082f4 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:11.987233 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e051b3fb-dcd4-4b7b-88d5-9a22b86082f4 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:11.987506 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e051b3fb-dcd4-4b7b-88d5-9a22b86082f4 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:11.987997 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e051b3fb-dcd4-4b7b-88d5-9a22b86082f4 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:11.988588 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e051b3fb-dcd4-4b7b-88d5-9a22b86082f4 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:11.988703 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-fbf4ae24-0261-4c71-9511-32946b0dce36 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:11.989241 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-fbf4ae24-0261-4c71-9511-32946b0dce36 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] [instance: 67e13bce-be81-4775-be5f-737add9f1694] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:11.996391 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fbf4ae24-0261-4c71-9511-32946b0dce36 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:11.996881 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fbf4ae24-0261-4c71-9511-32946b0dce36 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:11.997350 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fbf4ae24-0261-4c71-9511-32946b0dce36 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:11.998055 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fbf4ae24-0261-4c71-9511-32946b0dce36 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:11.998508 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fbf4ae24-0261-4c71-9511-32946b0dce36 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:11.998934 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fbf4ae24-0261-4c71-9511-32946b0dce36 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:12.128973 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-e051b3fb-dcd4-4b7b-88d5-9a22b86082f4 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64887fff0bc7417094c4fee2f7e9aa5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6187bfad04cb7bc17155862ee0cdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:12.137254 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-e051b3fb-dcd4-4b7b-88d5-9a22b86082f4 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] 10.222.0.43 "GET /compute/v2.1/servers/63543ce9-528e-4064-a6cd-6dd249104468" status: 200 len: 1317 microversion: 2.1 time: 0.168679 Oct 04 18:36:12.137850 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 711/1302] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:11 2022] GET /compute/v2.1/servers/63543ce9-528e-4064-a6cd-6dd249104468 => generated 1317 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:12.149273 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-46adb47b-ae2b-46fa-b9d8-e3cc4d238507 tempest-ImagesMetadataTestJSON-898211660 tempest-ImagesMetadataTestJSON-898211660-project] Action: 'update_all', calling method: .version_select at 0x7fb227e82e50>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:36:12.192985 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-46adb47b-ae2b-46fa-b9d8-e3cc4d238507 tempest-ImagesMetadataTestJSON-898211660 tempest-ImagesMetadataTestJSON-898211660-project] Getting quotas for project 16dea78980d645b5adc76f3f9d2a0d43. Resources: dict_keys(['metadata_items']) {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:36:12.197325 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-46adb47b-ae2b-46fa-b9d8-e3cc4d238507 tempest-ImagesMetadataTestJSON-898211660 tempest-ImagesMetadataTestJSON-898211660-project] Getting quotas for user 8b50c14ffaa84b59a4a0068b169dd35b and project 16dea78980d645b5adc76f3f9d2a0d43. Resources: dict_keys(['metadata_items']) {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:36:12.354108 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-46adb47b-ae2b-46fa-b9d8-e3cc4d238507 tempest-ImagesMetadataTestJSON-898211660 tempest-ImagesMetadataTestJSON-898211660-project] 10.222.0.43 "PUT /compute/v2.1/images/b7d4304d-eeee-4cc8-86ac-e9e7232b5a30/metadata" status: 200 len: 61 microversion: 2.1 time: 0.215066 Oct 04 18:36:12.354706 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 712/1303] 10.222.0.43 () {60 vars in 1280 bytes} [Tue Oct 4 18:36:12 2022] PUT /compute/v2.1/images/b7d4304d-eeee-4cc8-86ac-e9e7232b5a30/metadata => generated 61 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:36:12.359231 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-b42dcdf0-0675-45a0-8fdf-4458e6984b02 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:12.359839 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-b42dcdf0-0675-45a0-8fdf-4458e6984b02 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] [instance: 9ee1bd28-0921-4444-afe3-c09cbfa0680a] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:12.366107 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b42dcdf0-0675-45a0-8fdf-4458e6984b02 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:12.366603 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b42dcdf0-0675-45a0-8fdf-4458e6984b02 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:12.367044 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b42dcdf0-0675-45a0-8fdf-4458e6984b02 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:12.368018 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b42dcdf0-0675-45a0-8fdf-4458e6984b02 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:12.368194 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b42dcdf0-0675-45a0-8fdf-4458e6984b02 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:12.368622 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b42dcdf0-0675-45a0-8fdf-4458e6984b02 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:12.378854 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.objects.instance [None req-fbf4ae24-0261-4c71-9511-32946b0dce36 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Lazy-loading 'services' on Instance uuid 67e13bce-be81-4775-be5f-737add9f1694 {{(pid=123595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:36:12.400025 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-fbf4ae24-0261-4c71-9511-32946b0dce36 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/67e13bce-be81-4775-be5f-737add9f1694" status: 200 len: 1929 microversion: 2.75 time: 0.428008 Oct 04 18:36:12.413407 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 592/1304] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:36:11 2022] GET /compute/v2.1/servers/67e13bce-be81-4775-be5f-737add9f1694 => generated 1929 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:36:12.413407 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-ccebfb45-0ffa-4c30-b440-d3293093e391 tempest-ImagesMetadataTestJSON-898211660 tempest-ImagesMetadataTestJSON-898211660-project] Calling method '.version_select at 0x7fb21fbfe700>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:12.471433 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-ccebfb45-0ffa-4c30-b440-d3293093e391 tempest-ImagesMetadataTestJSON-898211660 tempest-ImagesMetadataTestJSON-898211660-project] 10.222.0.43 "GET /compute/v2.1/images/b7d4304d-eeee-4cc8-86ac-e9e7232b5a30/metadata" status: 200 len: 61 microversion: 2.1 time: 0.069621 Oct 04 18:36:12.471998 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 593/1305] 10.222.0.43 () {58 vars in 1260 bytes} [Tue Oct 4 18:36:12 2022] GET /compute/v2.1/images/b7d4304d-eeee-4cc8-86ac-e9e7232b5a30/metadata => generated 61 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:36:12.487908 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-38fa5781-006a-48c2-b477-581c2d973efc tempest-ImagesMetadataTestJSON-898211660 tempest-ImagesMetadataTestJSON-898211660-project] Action: 'update_all', calling method: .version_select at 0x7fb21fa3a1f0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:36:12.553679 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-b42dcdf0-0675-45a0-8fdf-4458e6984b02 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a41ab6fb78a42ceaca621c5a38ffc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa31ed92017490a82497c7b8910aef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:12.562838 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-b42dcdf0-0675-45a0-8fdf-4458e6984b02 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] 10.222.0.43 "GET /compute/v2.1/servers/9ee1bd28-0921-4444-afe3-c09cbfa0680a" status: 200 len: 1307 microversion: 2.1 time: 0.206904 Oct 04 18:36:12.563696 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 713/1306] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:12 2022] GET /compute/v2.1/servers/9ee1bd28-0921-4444-afe3-c09cbfa0680a => generated 1307 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:12.579190 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-38fa5781-006a-48c2-b477-581c2d973efc tempest-ImagesMetadataTestJSON-898211660 tempest-ImagesMetadataTestJSON-898211660-project] Getting quotas for project 16dea78980d645b5adc76f3f9d2a0d43. Resources: dict_keys(['metadata_items']) {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:36:12.585827 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-38fa5781-006a-48c2-b477-581c2d973efc tempest-ImagesMetadataTestJSON-898211660 tempest-ImagesMetadataTestJSON-898211660-project] Getting quotas for user 8b50c14ffaa84b59a4a0068b169dd35b and project 16dea78980d645b5adc76f3f9d2a0d43. Resources: dict_keys(['metadata_items']) {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:36:12.756199 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-38fa5781-006a-48c2-b477-581c2d973efc tempest-ImagesMetadataTestJSON-898211660 tempest-ImagesMetadataTestJSON-898211660-project] 10.222.0.43 "PUT /compute/v2.1/images/b7d4304d-eeee-4cc8-86ac-e9e7232b5a30/metadata" status: 200 len: 61 microversion: 2.1 time: 0.277271 Oct 04 18:36:12.756796 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 594/1307] 10.222.0.43 () {60 vars in 1280 bytes} [Tue Oct 4 18:36:12 2022] PUT /compute/v2.1/images/b7d4304d-eeee-4cc8-86ac-e9e7232b5a30/metadata => generated 61 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 04 18:36:12.766843 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-2da9b25e-6970-4b74-a30b-2a8f0e9ff669 tempest-ImagesMetadataTestJSON-898211660 tempest-ImagesMetadataTestJSON-898211660-project] Action: 'update_all', calling method: .version_select at 0x7fb227de9b80>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:36:12.817634 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-2da9b25e-6970-4b74-a30b-2a8f0e9ff669 tempest-ImagesMetadataTestJSON-898211660 tempest-ImagesMetadataTestJSON-898211660-project] Getting quotas for project 16dea78980d645b5adc76f3f9d2a0d43. Resources: dict_keys(['metadata_items']) {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:36:12.821585 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-2da9b25e-6970-4b74-a30b-2a8f0e9ff669 tempest-ImagesMetadataTestJSON-898211660 tempest-ImagesMetadataTestJSON-898211660-project] Getting quotas for user 8b50c14ffaa84b59a4a0068b169dd35b and project 16dea78980d645b5adc76f3f9d2a0d43. Resources: dict_keys(['metadata_items']) {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:36:12.951914 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-74bf8548-3bea-4b7f-8af3-fd80347ecfd9 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:12.952609 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-74bf8548-3bea-4b7f-8af3-fd80347ecfd9 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] [instance: 84e0414b-a39f-4bfe-bc9d-c170ceb34d15] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:12.959245 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-74bf8548-3bea-4b7f-8af3-fd80347ecfd9 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:12.959801 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-74bf8548-3bea-4b7f-8af3-fd80347ecfd9 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:12.960307 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-74bf8548-3bea-4b7f-8af3-fd80347ecfd9 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:12.961073 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-74bf8548-3bea-4b7f-8af3-fd80347ecfd9 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:12.962114 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-74bf8548-3bea-4b7f-8af3-fd80347ecfd9 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:12.962600 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-74bf8548-3bea-4b7f-8af3-fd80347ecfd9 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:13.031659 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-74bf8548-3bea-4b7f-8af3-fd80347ecfd9 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:13.045079 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-74bf8548-3bea-4b7f-8af3-fd80347ecfd9 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:13.046642 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-74bf8548-3bea-4b7f-8af3-fd80347ecfd9 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:13.052209 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-74bf8548-3bea-4b7f-8af3-fd80347ecfd9 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] 10.222.0.43 "GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15" status: 200 len: 1537 microversion: 2.91 time: 0.104743 Oct 04 18:36:13.053332 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 595/1308] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:36:12 2022] GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15 => generated 1537 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:36:13.058106 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-21293925-4cbf-4229-9f2a-4eeb0347cb55 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:13.058713 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-21293925-4cbf-4229-9f2a-4eeb0347cb55 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: ce0d629a-068c-4a62-8a03-fc43fc0be9b3] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:13.064505 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-21293925-4cbf-4229-9f2a-4eeb0347cb55 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:13.064984 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-21293925-4cbf-4229-9f2a-4eeb0347cb55 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:13.065532 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-21293925-4cbf-4229-9f2a-4eeb0347cb55 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:13.066296 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-21293925-4cbf-4229-9f2a-4eeb0347cb55 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:13.066756 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-21293925-4cbf-4229-9f2a-4eeb0347cb55 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:13.067180 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-21293925-4cbf-4229-9f2a-4eeb0347cb55 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:13.162490 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-2da9b25e-6970-4b74-a30b-2a8f0e9ff669 tempest-ImagesMetadataTestJSON-898211660 tempest-ImagesMetadataTestJSON-898211660-project] 10.222.0.43 "PUT /compute/v2.1/images/b7d4304d-eeee-4cc8-86ac-e9e7232b5a30/metadata" status: 200 len: 64 microversion: 2.1 time: 0.399550 Oct 04 18:36:13.163089 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 714/1309] 10.222.0.43 () {60 vars in 1280 bytes} [Tue Oct 4 18:36:12 2022] PUT /compute/v2.1/images/b7d4304d-eeee-4cc8-86ac-e9e7232b5a30/metadata => generated 64 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:36:13.168461 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-81359560-c373-4dbf-8564-9dd2550783dd req-c6d587a7-32e0-43bd-9bf4-7a384ed8c697 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce0d629a-068c-4a62-8a03-fc43fc0be9b3", "name": "network-vif-plugged", "status": "completed", "tag": "5b0b787d-0181-4910-a488-5e61d24675ce"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:36:13.178645 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-81359560-c373-4dbf-8564-9dd2550783dd req-c6d587a7-32e0-43bd-9bf4-7a384ed8c697 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:13.179163 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-81359560-c373-4dbf-8564-9dd2550783dd req-c6d587a7-32e0-43bd-9bf4-7a384ed8c697 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:13.179620 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-81359560-c373-4dbf-8564-9dd2550783dd req-c6d587a7-32e0-43bd-9bf4-7a384ed8c697 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:13.192847 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-81359560-c373-4dbf-8564-9dd2550783dd req-c6d587a7-32e0-43bd-9bf4-7a384ed8c697 service nova] Creating event network-vif-plugged:5b0b787d-0181-4910-a488-5e61d24675ce for instance ce0d629a-068c-4a62-8a03-fc43fc0be9b3 on n-h2-851028-13 Oct 04 18:36:13.198173 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-81359560-c373-4dbf-8564-9dd2550783dd req-c6d587a7-32e0-43bd-9bf4-7a384ed8c697 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033716 Oct 04 18:36:13.198785 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 715/1310] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:36:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:36:13.204313 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-5a942de1-4548-4809-bc00-411b68cbaaca tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:13.205080 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-5a942de1-4548-4809-bc00-411b68cbaaca tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] [instance: 63543ce9-528e-4064-a6cd-6dd249104468] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:13.211868 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5a942de1-4548-4809-bc00-411b68cbaaca tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:13.212439 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5a942de1-4548-4809-bc00-411b68cbaaca tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:13.213778 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5a942de1-4548-4809-bc00-411b68cbaaca tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:13.214803 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5a942de1-4548-4809-bc00-411b68cbaaca tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:13.215342 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5a942de1-4548-4809-bc00-411b68cbaaca tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:13.215771 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5a942de1-4548-4809-bc00-411b68cbaaca tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:13.223716 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-21293925-4cbf-4229-9f2a-4eeb0347cb55 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:13.232566 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-21293925-4cbf-4229-9f2a-4eeb0347cb55 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/ce0d629a-068c-4a62-8a03-fc43fc0be9b3" status: 200 len: 1313 microversion: 2.1 time: 0.178040 Oct 04 18:36:13.233195 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 596/1311] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:13 2022] GET /compute/v2.1/servers/ce0d629a-068c-4a62-8a03-fc43fc0be9b3 => generated 1313 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:13.241949 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-d2c7fcb8-1762-4e2b-bc43-6b4b8c76d09c tempest-ImagesMetadataTestJSON-898211660 tempest-ImagesMetadataTestJSON-898211660-project] Calling method '.version_select at 0x7fb21f9d5310>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:13.285159 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-d2c7fcb8-1762-4e2b-bc43-6b4b8c76d09c tempest-ImagesMetadataTestJSON-898211660 tempest-ImagesMetadataTestJSON-898211660-project] 10.222.0.43 "GET /compute/v2.1/images/b7d4304d-eeee-4cc8-86ac-e9e7232b5a30/metadata" status: 200 len: 64 microversion: 2.1 time: 0.050861 Oct 04 18:36:13.285767 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 597/1312] 10.222.0.43 () {58 vars in 1260 bytes} [Tue Oct 4 18:36:13 2022] GET /compute/v2.1/images/b7d4304d-eeee-4cc8-86ac-e9e7232b5a30/metadata => generated 64 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:36:13.295899 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-1ba8fb2f-ffd7-4eba-8e12-e635bb96d20f tempest-ImagesMetadataTestJSON-898211660 tempest-ImagesMetadataTestJSON-898211660-project] Action: 'update_all', calling method: .version_select at 0x7fb21f980670>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:36:13.348297 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-1ba8fb2f-ffd7-4eba-8e12-e635bb96d20f tempest-ImagesMetadataTestJSON-898211660 tempest-ImagesMetadataTestJSON-898211660-project] Getting quotas for project 16dea78980d645b5adc76f3f9d2a0d43. Resources: dict_keys(['metadata_items']) {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:36:13.352134 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-1ba8fb2f-ffd7-4eba-8e12-e635bb96d20f tempest-ImagesMetadataTestJSON-898211660 tempest-ImagesMetadataTestJSON-898211660-project] Getting quotas for user 8b50c14ffaa84b59a4a0068b169dd35b and project 16dea78980d645b5adc76f3f9d2a0d43. Resources: dict_keys(['metadata_items']) {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:36:13.404636 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-5a942de1-4548-4809-bc00-411b68cbaaca tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64887fff0bc7417094c4fee2f7e9aa5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6187bfad04cb7bc17155862ee0cdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:13.412955 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-5a942de1-4548-4809-bc00-411b68cbaaca tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] 10.222.0.43 "GET /compute/v2.1/servers/63543ce9-528e-4064-a6cd-6dd249104468" status: 200 len: 1317 microversion: 2.1 time: 0.212998 Oct 04 18:36:13.413579 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 716/1313] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:13 2022] GET /compute/v2.1/servers/63543ce9-528e-4064-a6cd-6dd249104468 => generated 1317 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:13.433807 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-e5ac6f49-b519-46ea-8ada-897e734bfec6 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:13.435933 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-e5ac6f49-b519-46ea-8ada-897e734bfec6 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] [instance: 67e13bce-be81-4775-be5f-737add9f1694] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:13.446218 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e5ac6f49-b519-46ea-8ada-897e734bfec6 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:13.447300 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e5ac6f49-b519-46ea-8ada-897e734bfec6 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:13.447959 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e5ac6f49-b519-46ea-8ada-897e734bfec6 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:13.448975 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e5ac6f49-b519-46ea-8ada-897e734bfec6 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:13.449560 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e5ac6f49-b519-46ea-8ada-897e734bfec6 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:13.450001 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e5ac6f49-b519-46ea-8ada-897e734bfec6 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:13.526900 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.objects.instance [None req-e5ac6f49-b519-46ea-8ada-897e734bfec6 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Lazy-loading 'services' on Instance uuid 67e13bce-be81-4775-be5f-737add9f1694 {{(pid=123596) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:36:13.545681 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-e5ac6f49-b519-46ea-8ada-897e734bfec6 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/67e13bce-be81-4775-be5f-737add9f1694" status: 200 len: 1929 microversion: 2.75 time: 0.119575 Oct 04 18:36:13.546270 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 717/1314] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:36:13 2022] GET /compute/v2.1/servers/67e13bce-be81-4775-be5f-737add9f1694 => generated 1929 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:36:13.586483 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-29f32502-7f92-420d-b000-7aad43fa70ad tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:13.587110 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-29f32502-7f92-420d-b000-7aad43fa70ad tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] [instance: 9ee1bd28-0921-4444-afe3-c09cbfa0680a] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:13.593828 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-29f32502-7f92-420d-b000-7aad43fa70ad tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:13.594318 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-29f32502-7f92-420d-b000-7aad43fa70ad tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:13.594764 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-29f32502-7f92-420d-b000-7aad43fa70ad tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:13.595467 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-29f32502-7f92-420d-b000-7aad43fa70ad tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:13.595926 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-29f32502-7f92-420d-b000-7aad43fa70ad tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:13.596353 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-29f32502-7f92-420d-b000-7aad43fa70ad tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:13.660938 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-1ba8fb2f-ffd7-4eba-8e12-e635bb96d20f tempest-ImagesMetadataTestJSON-898211660 tempest-ImagesMetadataTestJSON-898211660-project] 10.222.0.43 "PUT /compute/v2.1/images/b7d4304d-eeee-4cc8-86ac-e9e7232b5a30/metadata" status: 200 len: 61 microversion: 2.1 time: 0.368744 Oct 04 18:36:13.661577 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 598/1315] 10.222.0.43 () {60 vars in 1280 bytes} [Tue Oct 4 18:36:13 2022] PUT /compute/v2.1/images/b7d4304d-eeee-4cc8-86ac-e9e7232b5a30/metadata => generated 61 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 04 18:36:13.670922 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-81962780-5828-4f3f-94a6-7a1b7f10bfd4 tempest-ImagesMetadataTestJSON-898211660 tempest-ImagesMetadataTestJSON-898211660-project] Action: 'update', calling method: .version_select at 0x7fb21fb25dc0>, body: {"meta": {"os_version": "alt"}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:36:13.720681 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-81962780-5828-4f3f-94a6-7a1b7f10bfd4 tempest-ImagesMetadataTestJSON-898211660 tempest-ImagesMetadataTestJSON-898211660-project] Getting quotas for project 16dea78980d645b5adc76f3f9d2a0d43. Resources: dict_keys(['metadata_items']) {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:36:13.722986 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_api:SELECT=100 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:36:13.725710 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-81962780-5828-4f3f-94a6-7a1b7f10bfd4 tempest-ImagesMetadataTestJSON-898211660 tempest-ImagesMetadataTestJSON-898211660-project] Getting quotas for user 8b50c14ffaa84b59a4a0068b169dd35b and project 16dea78980d645b5adc76f3f9d2a0d43. Resources: dict_keys(['metadata_items']) {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:36:13.734119 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-29f32502-7f92-420d-b000-7aad43fa70ad tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a41ab6fb78a42ceaca621c5a38ffc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa31ed92017490a82497c7b8910aef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:13.741961 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-29f32502-7f92-420d-b000-7aad43fa70ad tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] 10.222.0.43 "GET /compute/v2.1/servers/9ee1bd28-0921-4444-afe3-c09cbfa0680a" status: 200 len: 1307 microversion: 2.1 time: 0.159354 Oct 04 18:36:13.745912 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 718/1316] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:13 2022] GET /compute/v2.1/servers/9ee1bd28-0921-4444-afe3-c09cbfa0680a => generated 1307 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:36:13.992398 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-81962780-5828-4f3f-94a6-7a1b7f10bfd4 tempest-ImagesMetadataTestJSON-898211660 tempest-ImagesMetadataTestJSON-898211660-project] 10.222.0.43 "PUT /compute/v2.1/images/b7d4304d-eeee-4cc8-86ac-e9e7232b5a30/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 0.325157 Oct 04 18:36:13.992990 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 599/1317] 10.222.0.43 () {60 vars in 1313 bytes} [Tue Oct 4 18:36:13 2022] PUT /compute/v2.1/images/b7d4304d-eeee-4cc8-86ac-e9e7232b5a30/metadata/os_version => generated 31 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:36:14.002340 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-d7a4b52d-98a3-4fb2-af38-01aa8e2eb856 tempest-ImagesMetadataTestJSON-898211660 tempest-ImagesMetadataTestJSON-898211660-project] Calling method '.version_select at 0x7fb227e7ee50>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:14.045546 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-d7a4b52d-98a3-4fb2-af38-01aa8e2eb856 tempest-ImagesMetadataTestJSON-898211660 tempest-ImagesMetadataTestJSON-898211660-project] 10.222.0.43 "GET /compute/v2.1/images/b7d4304d-eeee-4cc8-86ac-e9e7232b5a30/metadata" status: 200 len: 58 microversion: 2.1 time: 0.046892 Oct 04 18:36:14.046270 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 719/1318] 10.222.0.43 () {58 vars in 1260 bytes} [Tue Oct 4 18:36:13 2022] GET /compute/v2.1/images/b7d4304d-eeee-4cc8-86ac-e9e7232b5a30/metadata => generated 58 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:36:14.056854 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-4734c994-350c-431e-8501-709605a93aa8 tempest-ImagesMetadataTestJSON-898211660 tempest-ImagesMetadataTestJSON-898211660-project] Action: 'update_all', calling method: .version_select at 0x7fb21fbfe700>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:36:14.089238 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-bdb33e59-07ee-401c-bd32-d5969242015a tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:14.090133 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-bdb33e59-07ee-401c-bd32-d5969242015a tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] [instance: 84e0414b-a39f-4bfe-bc9d-c170ceb34d15] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:14.096846 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bdb33e59-07ee-401c-bd32-d5969242015a tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:14.097851 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bdb33e59-07ee-401c-bd32-d5969242015a tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:14.098369 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bdb33e59-07ee-401c-bd32-d5969242015a tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:14.099165 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bdb33e59-07ee-401c-bd32-d5969242015a tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:14.099710 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bdb33e59-07ee-401c-bd32-d5969242015a tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:14.100229 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bdb33e59-07ee-401c-bd32-d5969242015a tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:14.108436 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-4734c994-350c-431e-8501-709605a93aa8 tempest-ImagesMetadataTestJSON-898211660 tempest-ImagesMetadataTestJSON-898211660-project] Getting quotas for project 16dea78980d645b5adc76f3f9d2a0d43. Resources: dict_keys(['metadata_items']) {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:36:14.112301 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-4734c994-350c-431e-8501-709605a93aa8 tempest-ImagesMetadataTestJSON-898211660 tempest-ImagesMetadataTestJSON-898211660-project] Getting quotas for user 8b50c14ffaa84b59a4a0068b169dd35b and project 16dea78980d645b5adc76f3f9d2a0d43. Resources: dict_keys(['metadata_items']) {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:36:14.179462 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-bdb33e59-07ee-401c-bd32-d5969242015a tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:14.190324 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-bdb33e59-07ee-401c-bd32-d5969242015a tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:14.191952 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-bdb33e59-07ee-401c-bd32-d5969242015a tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '558386453e684a5abab558c526db7b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4df4f9d8384884b2d603c79bd26f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:14.197648 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-bdb33e59-07ee-401c-bd32-d5969242015a tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] 10.222.0.43 "GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15" status: 200 len: 1537 microversion: 2.91 time: 0.118488 Oct 04 18:36:14.198676 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 720/1319] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:36:14 2022] GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15 => generated 1537 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:36:14.255652 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-2995100f-3dd4-4162-b826-dabb814e0ab3 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:14.256615 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-2995100f-3dd4-4162-b826-dabb814e0ab3 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: ce0d629a-068c-4a62-8a03-fc43fc0be9b3] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:14.265377 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2995100f-3dd4-4162-b826-dabb814e0ab3 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:14.265945 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2995100f-3dd4-4162-b826-dabb814e0ab3 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:14.266469 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2995100f-3dd4-4162-b826-dabb814e0ab3 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:14.267274 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2995100f-3dd4-4162-b826-dabb814e0ab3 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:14.267794 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2995100f-3dd4-4162-b826-dabb814e0ab3 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:14.268284 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2995100f-3dd4-4162-b826-dabb814e0ab3 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:14.411465 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-4734c994-350c-431e-8501-709605a93aa8 tempest-ImagesMetadataTestJSON-898211660 tempest-ImagesMetadataTestJSON-898211660-project] 10.222.0.43 "PUT /compute/v2.1/images/b7d4304d-eeee-4cc8-86ac-e9e7232b5a30/metadata" status: 200 len: 61 microversion: 2.1 time: 0.358809 Oct 04 18:36:14.416340 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 600/1320] 10.222.0.43 () {60 vars in 1280 bytes} [Tue Oct 4 18:36:14 2022] PUT /compute/v2.1/images/b7d4304d-eeee-4cc8-86ac-e9e7232b5a30/metadata => generated 61 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:36:14.422051 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-e8e5ed16-a6fc-4246-94f6-15b105cbfab9 tempest-ImagesMetadataTestJSON-898211660 tempest-ImagesMetadataTestJSON-898211660-project] Action: 'create', calling method: .version_select at 0x7fb21f9d5d30>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:36:14.463582 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-2995100f-3dd4-4162-b826-dabb814e0ab3 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:14.481234 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-2995100f-3dd4-4162-b826-dabb814e0ab3 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/ce0d629a-068c-4a62-8a03-fc43fc0be9b3" status: 200 len: 1313 microversion: 2.1 time: 0.226104 Oct 04 18:36:14.481980 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 721/1321] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:14 2022] GET /compute/v2.1/servers/ce0d629a-068c-4a62-8a03-fc43fc0be9b3 => generated 1313 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:14.489950 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-b029632c-aba3-46e6-aafc-b6b13e473f46 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:14.491091 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-b029632c-aba3-46e6-aafc-b6b13e473f46 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] [instance: 63543ce9-528e-4064-a6cd-6dd249104468] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:14.494679 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-e8e5ed16-a6fc-4246-94f6-15b105cbfab9 tempest-ImagesMetadataTestJSON-898211660 tempest-ImagesMetadataTestJSON-898211660-project] Getting quotas for project 16dea78980d645b5adc76f3f9d2a0d43. Resources: dict_keys(['metadata_items']) {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:36:14.500726 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-e8e5ed16-a6fc-4246-94f6-15b105cbfab9 tempest-ImagesMetadataTestJSON-898211660 tempest-ImagesMetadataTestJSON-898211660-project] Getting quotas for user 8b50c14ffaa84b59a4a0068b169dd35b and project 16dea78980d645b5adc76f3f9d2a0d43. Resources: dict_keys(['metadata_items']) {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:36:14.500901 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b029632c-aba3-46e6-aafc-b6b13e473f46 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:14.501451 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b029632c-aba3-46e6-aafc-b6b13e473f46 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:14.501893 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b029632c-aba3-46e6-aafc-b6b13e473f46 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:14.502784 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b029632c-aba3-46e6-aafc-b6b13e473f46 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:14.505729 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b029632c-aba3-46e6-aafc-b6b13e473f46 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:14.506455 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b029632c-aba3-46e6-aafc-b6b13e473f46 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:14.696536 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-b029632c-aba3-46e6-aafc-b6b13e473f46 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64887fff0bc7417094c4fee2f7e9aa5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6187bfad04cb7bc17155862ee0cdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:14.707229 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-b029632c-aba3-46e6-aafc-b6b13e473f46 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] 10.222.0.43 "GET /compute/v2.1/servers/63543ce9-528e-4064-a6cd-6dd249104468" status: 200 len: 1317 microversion: 2.1 time: 0.223877 Oct 04 18:36:14.708399 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 722/1322] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:14 2022] GET /compute/v2.1/servers/63543ce9-528e-4064-a6cd-6dd249104468 => generated 1317 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:14.714200 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-58a09ba2-2f91-43df-854d-94b38f579a50 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:14.715013 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-58a09ba2-2f91-43df-854d-94b38f579a50 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] [instance: 67e13bce-be81-4775-be5f-737add9f1694] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:14.722447 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-58a09ba2-2f91-43df-854d-94b38f579a50 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:14.724751 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-58a09ba2-2f91-43df-854d-94b38f579a50 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:14.725530 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-58a09ba2-2f91-43df-854d-94b38f579a50 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:14.726477 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-58a09ba2-2f91-43df-854d-94b38f579a50 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:14.727214 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-58a09ba2-2f91-43df-854d-94b38f579a50 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:14.727912 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-58a09ba2-2f91-43df-854d-94b38f579a50 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:14.840090 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.objects.instance [None req-58a09ba2-2f91-43df-854d-94b38f579a50 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Lazy-loading 'services' on Instance uuid 67e13bce-be81-4775-be5f-737add9f1694 {{(pid=123596) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:36:14.868686 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-58a09ba2-2f91-43df-854d-94b38f579a50 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/67e13bce-be81-4775-be5f-737add9f1694" status: 200 len: 1929 microversion: 2.75 time: 0.158882 Oct 04 18:36:14.869896 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 723/1323] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:36:14 2022] GET /compute/v2.1/servers/67e13bce-be81-4775-be5f-737add9f1694 => generated 1929 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:36:14.889349 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-f01bac14-bdc2-4f13-be98-635cab123c34 req-79d2dc79-0e49-4019-b295-ee59874fe6fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63543ce9-528e-4064-a6cd-6dd249104468", "tag": "3cf62e8e-aadc-4bbd-97a3-8471a4356442"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:36:14.899866 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-f01bac14-bdc2-4f13-be98-635cab123c34 req-79d2dc79-0e49-4019-b295-ee59874fe6fa service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:14.900433 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-f01bac14-bdc2-4f13-be98-635cab123c34 req-79d2dc79-0e49-4019-b295-ee59874fe6fa service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:14.901146 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-f01bac14-bdc2-4f13-be98-635cab123c34 req-79d2dc79-0e49-4019-b295-ee59874fe6fa service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:14.915325 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-f01bac14-bdc2-4f13-be98-635cab123c34 req-79d2dc79-0e49-4019-b295-ee59874fe6fa service nova] Creating event network-changed:3cf62e8e-aadc-4bbd-97a3-8471a4356442 for instance 63543ce9-528e-4064-a6cd-6dd249104468 on n-h1-851028-13 Oct 04 18:36:14.921449 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-e8e5ed16-a6fc-4246-94f6-15b105cbfab9 tempest-ImagesMetadataTestJSON-898211660 tempest-ImagesMetadataTestJSON-898211660-project] 10.222.0.43 "POST /compute/v2.1/images/b7d4304d-eeee-4cc8-86ac-e9e7232b5a30/metadata" status: 200 len: 85 microversion: 2.1 time: 0.503644 Oct 04 18:36:14.922170 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 601/1324] 10.222.0.43 () {60 vars in 1281 bytes} [Tue Oct 4 18:36:14 2022] POST /compute/v2.1/images/b7d4304d-eeee-4cc8-86ac-e9e7232b5a30/metadata => generated 85 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 04 18:36:14.926668 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-f01bac14-bdc2-4f13-be98-635cab123c34 req-79d2dc79-0e49-4019-b295-ee59874fe6fa service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039464 Oct 04 18:36:14.927645 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 724/1325] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:36:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:36:14.928221 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-a12cebdc-e815-4016-8857-e788af1864ae tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:14.928962 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-a12cebdc-e815-4016-8857-e788af1864ae tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] [instance: 9ee1bd28-0921-4444-afe3-c09cbfa0680a] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:14.934905 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-c6f2bfcb-0b62-4caa-889f-dbb8f48f91c6 tempest-ImagesMetadataTestJSON-898211660 tempest-ImagesMetadataTestJSON-898211660-project] Calling method '.version_select at 0x7fb227e025e0>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:14.936431 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a12cebdc-e815-4016-8857-e788af1864ae tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:14.937316 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a12cebdc-e815-4016-8857-e788af1864ae tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:14.937942 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a12cebdc-e815-4016-8857-e788af1864ae tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:14.938760 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a12cebdc-e815-4016-8857-e788af1864ae tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:14.939324 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a12cebdc-e815-4016-8857-e788af1864ae tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:14.939859 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a12cebdc-e815-4016-8857-e788af1864ae tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:14.989497 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-c6f2bfcb-0b62-4caa-889f-dbb8f48f91c6 tempest-ImagesMetadataTestJSON-898211660 tempest-ImagesMetadataTestJSON-898211660-project] 10.222.0.43 "GET /compute/v2.1/images/b7d4304d-eeee-4cc8-86ac-e9e7232b5a30/metadata" status: 200 len: 85 microversion: 2.1 time: 0.058762 Oct 04 18:36:14.990840 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 725/1326] 10.222.0.43 () {58 vars in 1260 bytes} [Tue Oct 4 18:36:14 2022] GET /compute/v2.1/images/b7d4304d-eeee-4cc8-86ac-e9e7232b5a30/metadata => generated 85 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:36:15.215234 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-a12cebdc-e815-4016-8857-e788af1864ae tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a41ab6fb78a42ceaca621c5a38ffc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa31ed92017490a82497c7b8910aef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:15.217949 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-2d44aa8e-ddf3-406b-8f1a-8bd9504d82d8 req-60d4d7e3-67d4-40df-9f2f-dd1508036e71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ee1bd28-0921-4444-afe3-c09cbfa0680a", "name": "network-vif-plugged", "status": "completed", "tag": "9b0949c2-7109-4d21-a62e-7d24d18a41c0"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:36:15.233160 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-a12cebdc-e815-4016-8857-e788af1864ae tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] 10.222.0.43 "GET /compute/v2.1/servers/9ee1bd28-0921-4444-afe3-c09cbfa0680a" status: 200 len: 1307 microversion: 2.1 time: 0.309917 Oct 04 18:36:15.237250 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-2d44aa8e-ddf3-406b-8f1a-8bd9504d82d8 req-60d4d7e3-67d4-40df-9f2f-dd1508036e71 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:15.238042 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 602/1327] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:14 2022] GET /compute/v2.1/servers/9ee1bd28-0921-4444-afe3-c09cbfa0680a => generated 1307 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:15.242856 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-0d3f8dd5-2223-42a4-ab2d-94274d54a021 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:15.243462 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-0d3f8dd5-2223-42a4-ab2d-94274d54a021 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] [instance: 84e0414b-a39f-4bfe-bc9d-c170ceb34d15] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:15.246810 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-2d44aa8e-ddf3-406b-8f1a-8bd9504d82d8 req-60d4d7e3-67d4-40df-9f2f-dd1508036e71 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:15.247258 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-2d44aa8e-ddf3-406b-8f1a-8bd9504d82d8 req-60d4d7e3-67d4-40df-9f2f-dd1508036e71 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:15.260147 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0d3f8dd5-2223-42a4-ab2d-94274d54a021 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:15.260769 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0d3f8dd5-2223-42a4-ab2d-94274d54a021 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:15.260900 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-2d44aa8e-ddf3-406b-8f1a-8bd9504d82d8 req-60d4d7e3-67d4-40df-9f2f-dd1508036e71 service nova] Creating event network-vif-plugged:9b0949c2-7109-4d21-a62e-7d24d18a41c0 for instance 9ee1bd28-0921-4444-afe3-c09cbfa0680a on n-h2-851028-13 Oct 04 18:36:15.261273 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0d3f8dd5-2223-42a4-ab2d-94274d54a021 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:15.261997 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0d3f8dd5-2223-42a4-ab2d-94274d54a021 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:15.262457 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0d3f8dd5-2223-42a4-ab2d-94274d54a021 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:15.262981 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0d3f8dd5-2223-42a4-ab2d-94274d54a021 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:15.266404 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-2d44aa8e-ddf3-406b-8f1a-8bd9504d82d8 req-60d4d7e3-67d4-40df-9f2f-dd1508036e71 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054849 Oct 04 18:36:15.267412 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 726/1328] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:36:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:36:15.282762 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-0d3f8dd5-2223-42a4-ab2d-94274d54a021 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] HTTP exception thrown: Instance 84e0414b-a39f-4bfe-bc9d-c170ceb34d15 could not be found. Oct 04 18:36:15.284677 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-0d3f8dd5-2223-42a4-ab2d-94274d54a021 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Request method failure captured: Oct 04 18:36:15.284677 n-d-851028-13 devstack@n-api.service[123595]: request: GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15 HTTP/1.1 Oct 04 18:36:15.284677 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 18:36:15.284677 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 18:36:15.284677 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 18:36:15.284677 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 0 Oct 04 18:36:15.284677 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 18:36:15.284677 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 18:36:15.284677 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 18:36:15.284677 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 18:36:15.284677 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPHxHuuQN0g9u5xCSxfHCS96KmzgWXWS9_yz7Uirk6HVghcDkDfvraFR4TW7DI65ZRp25I0AGnFj1ghj9eDv5LiK_sGRRD-plP-lc6oEw1VOu7WcYnklmjrSTOtmPAV_RdS29lucd1F-8VppEYxilcLJoIBRD6pSN_culAEZdAb4R1Ko Oct 04 18:36:15.284677 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 18:36:15.284677 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 18:36:15.284677 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 18:36:15.284677 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 18:36:15.284677 n-d-851028-13 devstack@n-api.service[123595]: X-Openstack-Nova-Api-Version: 2.91 Oct 04 18:36:15.284677 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 18:36:15.284677 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 18:36:15.284677 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: ef4df4f9d8384884b2d603c79bd26f2c Oct 04 18:36:15.284677 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-UnshelveToHostMultiNodesTest-507493074 Oct 04 18:36:15.284677 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 18:36:15.284677 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 18:36:15.284677 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/ef4df4f9d8384884b2d603c79bd26f2c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_ef4df4f9d8384884b2d603c79bd26f2c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ef4df4f9d8384884b2d603c79bd26f2c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ef4df4f9d8384884b2d603c79bd26f2c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:36:15.284677 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-UnshelveToHostMultiNodesTest-507493074 Oct 04 18:36:15.284677 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: ef4df4f9d8384884b2d603c79bd26f2c Oct 04 18:36:15.284677 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-UnshelveToHostMultiNodesTest-507493074 Oct 04 18:36:15.284677 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-UnshelveToHostMultiNodesTest-507493074-project Oct 04 18:36:15.284677 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 18:36:15.284677 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 18:36:15.284677 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: 558386453e684a5abab558c526db7b2c Oct 04 18:36:15.284677 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-UnshelveToHostMultiNodesTest-507493074-project Oct 04 18:36:15.284677 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 18:36:15.284677 n-d-851028-13 devstack@n-api.service[123595]: exception: Instance 84e0414b-a39f-4bfe-bc9d-c170ceb34d15 could not be found. Oct 04 18:36:15.284677 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': '84e0414b-a39f-4bfe-bc9d-c170ceb34d15'} Oct 04 18:36:15.284677 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:36:15.284677 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:36:15.284677 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:36:15.284677 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:36:15.284677 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:36:15.284677 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:36:15.284677 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:36:15.284677 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:36:15.284677 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:36:15.284677 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:36:15.284677 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84e0414b-a39f-4bfe-bc9d-c170ceb34d15 could not be found. Oct 04 18:36:15.284677 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:36:15.284677 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:36:15.284677 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:36:15.284677 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:36:15.284677 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:36:15.284677 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:36:15.284677 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:36:15.284677 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:36:15.284677 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:36:15.284677 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:36:15.284677 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:36:15.284677 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:36:15.284677 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:36:15.284677 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:36:15.284677 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:36:15.284677 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:36:15.284677 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84e0414b-a39f-4bfe-bc9d-c170ceb34d15 could not be found. Oct 04 18:36:15.284677 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:36:15.284677 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:36:15.291944 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:36:15.291944 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:36:15.291944 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:36:15.291944 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:36:15.291944 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:36:15.291944 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:36:15.291944 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84e0414b-a39f-4bfe-bc9d-c170ceb34d15 could not be found. Oct 04 18:36:15.291944 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:36:15.291944 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-0d3f8dd5-2223-42a4-ab2d-94274d54a021 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] Returning 404 to user: Instance 84e0414b-a39f-4bfe-bc9d-c170ceb34d15 could not be found. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:36:15.291944 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-0d3f8dd5-2223-42a4-ab2d-94274d54a021 tempest-UnshelveToHostMultiNodesTest-507493074 tempest-UnshelveToHostMultiNodesTest-507493074-project] 10.222.0.43 "GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15" status: 404 len: 111 microversion: 2.91 time: 0.047092 Oct 04 18:36:15.291944 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 603/1329] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:36:15 2022] GET /compute/v2.1/servers/84e0414b-a39f-4bfe-bc9d-c170ceb34d15 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:36:15.505858 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-90ae3ceb-88e4-4d46-9663-c95e7aeb38f9 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:15.506570 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-90ae3ceb-88e4-4d46-9663-c95e7aeb38f9 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: ce0d629a-068c-4a62-8a03-fc43fc0be9b3] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:15.514384 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-90ae3ceb-88e4-4d46-9663-c95e7aeb38f9 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:15.514879 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-90ae3ceb-88e4-4d46-9663-c95e7aeb38f9 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:15.515313 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-90ae3ceb-88e4-4d46-9663-c95e7aeb38f9 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:15.516191 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-90ae3ceb-88e4-4d46-9663-c95e7aeb38f9 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:15.516646 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-90ae3ceb-88e4-4d46-9663-c95e7aeb38f9 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:15.517265 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-90ae3ceb-88e4-4d46-9663-c95e7aeb38f9 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:15.730853 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-ba3bb59f-9f1f-4663-a8c6-b0a2f477e5ec tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:15.731828 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-ba3bb59f-9f1f-4663-a8c6-b0a2f477e5ec tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] [instance: 63543ce9-528e-4064-a6cd-6dd249104468] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:15.739924 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ba3bb59f-9f1f-4663-a8c6-b0a2f477e5ec tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:15.740361 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ba3bb59f-9f1f-4663-a8c6-b0a2f477e5ec tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:15.741039 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ba3bb59f-9f1f-4663-a8c6-b0a2f477e5ec tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:15.741704 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ba3bb59f-9f1f-4663-a8c6-b0a2f477e5ec tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:15.742261 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ba3bb59f-9f1f-4663-a8c6-b0a2f477e5ec tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:15.742965 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ba3bb59f-9f1f-4663-a8c6-b0a2f477e5ec tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:15.945591 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-ba3bb59f-9f1f-4663-a8c6-b0a2f477e5ec tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64887fff0bc7417094c4fee2f7e9aa5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6187bfad04cb7bc17155862ee0cdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:15.953965 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-ba3bb59f-9f1f-4663-a8c6-b0a2f477e5ec tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] 10.222.0.43 "GET /compute/v2.1/servers/63543ce9-528e-4064-a6cd-6dd249104468" status: 200 len: 1317 microversion: 2.1 time: 0.227009 Oct 04 18:36:15.955034 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 604/1330] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:15 2022] GET /compute/v2.1/servers/63543ce9-528e-4064-a6cd-6dd249104468 => generated 1317 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:36:15.960422 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-446c19fb-b728-4155-ae21-01878f14e192 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:15.961034 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-446c19fb-b728-4155-ae21-01878f14e192 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] [instance: 67e13bce-be81-4775-be5f-737add9f1694] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:15.968127 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-446c19fb-b728-4155-ae21-01878f14e192 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:15.968862 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-446c19fb-b728-4155-ae21-01878f14e192 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:15.969488 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-446c19fb-b728-4155-ae21-01878f14e192 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:15.970202 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-446c19fb-b728-4155-ae21-01878f14e192 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:15.970652 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-446c19fb-b728-4155-ae21-01878f14e192 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:15.971091 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-446c19fb-b728-4155-ae21-01878f14e192 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:15.994728 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-90ae3ceb-88e4-4d46-9663-c95e7aeb38f9 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:16.019282 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-90ae3ceb-88e4-4d46-9663-c95e7aeb38f9 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/ce0d629a-068c-4a62-8a03-fc43fc0be9b3" status: 200 len: 1463 microversion: 2.1 time: 0.517004 Oct 04 18:36:16.020003 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 727/1331] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:15 2022] GET /compute/v2.1/servers/ce0d629a-068c-4a62-8a03-fc43fc0be9b3 => generated 1463 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:16.063790 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.objects.instance [None req-446c19fb-b728-4155-ae21-01878f14e192 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Lazy-loading 'services' on Instance uuid 67e13bce-be81-4775-be5f-737add9f1694 {{(pid=123595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:36:16.082639 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-446c19fb-b728-4155-ae21-01878f14e192 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/67e13bce-be81-4775-be5f-737add9f1694" status: 200 len: 1929 microversion: 2.75 time: 0.125998 Oct 04 18:36:16.083246 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 605/1332] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:36:15 2022] GET /compute/v2.1/servers/67e13bce-be81-4775-be5f-737add9f1694 => generated 1929 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:36:16.232073 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-b0c2ad30-b1c9-4a49-bf0d-47e3d57ecd9f tempest-MigrationsAdminTest-1571334602 tempest-MigrationsAdminTest-1571334602-project-admin] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:16.233334 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-b0c2ad30-b1c9-4a49-bf0d-47e3d57ecd9f tempest-MigrationsAdminTest-1571334602 tempest-MigrationsAdminTest-1571334602-project-admin] [instance: ce0d629a-068c-4a62-8a03-fc43fc0be9b3] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:16.240193 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b0c2ad30-b1c9-4a49-bf0d-47e3d57ecd9f tempest-MigrationsAdminTest-1571334602 tempest-MigrationsAdminTest-1571334602-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:16.240751 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b0c2ad30-b1c9-4a49-bf0d-47e3d57ecd9f tempest-MigrationsAdminTest-1571334602 tempest-MigrationsAdminTest-1571334602-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:16.241165 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b0c2ad30-b1c9-4a49-bf0d-47e3d57ecd9f tempest-MigrationsAdminTest-1571334602 tempest-MigrationsAdminTest-1571334602-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:16.241879 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b0c2ad30-b1c9-4a49-bf0d-47e3d57ecd9f tempest-MigrationsAdminTest-1571334602 tempest-MigrationsAdminTest-1571334602-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:16.242329 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b0c2ad30-b1c9-4a49-bf0d-47e3d57ecd9f tempest-MigrationsAdminTest-1571334602 tempest-MigrationsAdminTest-1571334602-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:16.242770 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b0c2ad30-b1c9-4a49-bf0d-47e3d57ecd9f tempest-MigrationsAdminTest-1571334602 tempest-MigrationsAdminTest-1571334602-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:16.269993 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-f91edbef-ad3b-41f9-818c-fd0305c1a0a1 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:16.270650 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-f91edbef-ad3b-41f9-818c-fd0305c1a0a1 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] [instance: 9ee1bd28-0921-4444-afe3-c09cbfa0680a] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:16.281530 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f91edbef-ad3b-41f9-818c-fd0305c1a0a1 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:16.282035 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f91edbef-ad3b-41f9-818c-fd0305c1a0a1 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:16.282482 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f91edbef-ad3b-41f9-818c-fd0305c1a0a1 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:16.283197 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f91edbef-ad3b-41f9-818c-fd0305c1a0a1 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:16.283657 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f91edbef-ad3b-41f9-818c-fd0305c1a0a1 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:16.284105 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f91edbef-ad3b-41f9-818c-fd0305c1a0a1 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:16.455446 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-f91edbef-ad3b-41f9-818c-fd0305c1a0a1 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a41ab6fb78a42ceaca621c5a38ffc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa31ed92017490a82497c7b8910aef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:16.466414 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-f91edbef-ad3b-41f9-818c-fd0305c1a0a1 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] 10.222.0.43 "GET /compute/v2.1/servers/9ee1bd28-0921-4444-afe3-c09cbfa0680a" status: 200 len: 1307 microversion: 2.1 time: 0.207874 Oct 04 18:36:16.473207 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 606/1333] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:16 2022] GET /compute/v2.1/servers/9ee1bd28-0921-4444-afe3-c09cbfa0680a => generated 1307 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:16.578729 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-b0c2ad30-b1c9-4a49-bf0d-47e3d57ecd9f tempest-MigrationsAdminTest-1571334602 tempest-MigrationsAdminTest-1571334602-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/ce0d629a-068c-4a62-8a03-fc43fc0be9b3" status: 200 len: 1616 microversion: 2.1 time: 0.539800 Oct 04 18:36:16.580514 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 728/1334] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:16 2022] GET /compute/v2.1/servers/ce0d629a-068c-4a62-8a03-fc43fc0be9b3 => generated 1616 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:36:16.605889 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-68c720b7-bb57-4ae9-b57a-ab5733ee9561 tempest-MigrationsAdminTest-1571334602 tempest-MigrationsAdminTest-1571334602-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:36:16.606984 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-68c720b7-bb57-4ae9-b57a-ab5733ee9561 tempest-MigrationsAdminTest-1571334602 tempest-MigrationsAdminTest-1571334602-project-admin] [instance: ce0d629a-068c-4a62-8a03-fc43fc0be9b3] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:16.613845 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-68c720b7-bb57-4ae9-b57a-ab5733ee9561 tempest-MigrationsAdminTest-1571334602 tempest-MigrationsAdminTest-1571334602-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:16.614382 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-68c720b7-bb57-4ae9-b57a-ab5733ee9561 tempest-MigrationsAdminTest-1571334602 tempest-MigrationsAdminTest-1571334602-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:16.615079 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-68c720b7-bb57-4ae9-b57a-ab5733ee9561 tempest-MigrationsAdminTest-1571334602 tempest-MigrationsAdminTest-1571334602-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:16.615813 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-68c720b7-bb57-4ae9-b57a-ab5733ee9561 tempest-MigrationsAdminTest-1571334602 tempest-MigrationsAdminTest-1571334602-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:16.616278 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-68c720b7-bb57-4ae9-b57a-ab5733ee9561 tempest-MigrationsAdminTest-1571334602 tempest-MigrationsAdminTest-1571334602-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:16.616712 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-68c720b7-bb57-4ae9-b57a-ab5733ee9561 tempest-MigrationsAdminTest-1571334602 tempest-MigrationsAdminTest-1571334602-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:16.716043 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-68c720b7-bb57-4ae9-b57a-ab5733ee9561 tempest-MigrationsAdminTest-1571334602 tempest-MigrationsAdminTest-1571334602-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '1a7436d44aba4786b9faeaedd5763591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8fea69caf14ba4875edc783cd7025b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:16.716674 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-68c720b7-bb57-4ae9-b57a-ab5733ee9561 tempest-MigrationsAdminTest-1571334602 tempest-MigrationsAdminTest-1571334602-project-admin] [instance: ce0d629a-068c-4a62-8a03-fc43fc0be9b3] flavor_id is None. Assuming migration. {{(pid=123595) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 04 18:36:16.717324 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-68c720b7-bb57-4ae9-b57a-ab5733ee9561 tempest-MigrationsAdminTest-1571334602 tempest-MigrationsAdminTest-1571334602-project-admin] [instance: ce0d629a-068c-4a62-8a03-fc43fc0be9b3] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=123595) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 04 18:36:16.979983 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-73b94a79-6022-4d91-ac89-1c6871c92626 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:16.980616 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-73b94a79-6022-4d91-ac89-1c6871c92626 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] [instance: 63543ce9-528e-4064-a6cd-6dd249104468] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:16.987546 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-73b94a79-6022-4d91-ac89-1c6871c92626 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:16.988047 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-73b94a79-6022-4d91-ac89-1c6871c92626 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:16.988489 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-73b94a79-6022-4d91-ac89-1c6871c92626 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:16.989230 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-73b94a79-6022-4d91-ac89-1c6871c92626 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:16.990429 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-73b94a79-6022-4d91-ac89-1c6871c92626 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:16.991037 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-73b94a79-6022-4d91-ac89-1c6871c92626 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:17.000999 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-68c720b7-bb57-4ae9-b57a-ab5733ee9561 tempest-MigrationsAdminTest-1571334602 tempest-MigrationsAdminTest-1571334602-project-admin] 10.222.0.43 "POST /compute/v2.1/servers/ce0d629a-068c-4a62-8a03-fc43fc0be9b3/action" status: 202 len: 0 microversion: 2.1 time: 0.401683 Oct 04 18:36:17.004048 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 607/1335] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 18:36:16 2022] POST /compute/v2.1/servers/ce0d629a-068c-4a62-8a03-fc43fc0be9b3/action => generated 0 bytes in 406 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:36:17.017390 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-efc665ab-98fc-4673-a44a-5e8e6ea9b2a5 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:17.018018 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-efc665ab-98fc-4673-a44a-5e8e6ea9b2a5 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: ce0d629a-068c-4a62-8a03-fc43fc0be9b3] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:17.047075 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-efc665ab-98fc-4673-a44a-5e8e6ea9b2a5 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:17.051509 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-efc665ab-98fc-4673-a44a-5e8e6ea9b2a5 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:17.053665 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-efc665ab-98fc-4673-a44a-5e8e6ea9b2a5 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:17.055562 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-efc665ab-98fc-4673-a44a-5e8e6ea9b2a5 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:17.060943 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-efc665ab-98fc-4673-a44a-5e8e6ea9b2a5 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:17.061805 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-efc665ab-98fc-4673-a44a-5e8e6ea9b2a5 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:17.344916 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-efc665ab-98fc-4673-a44a-5e8e6ea9b2a5 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:17.356663 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-efc665ab-98fc-4673-a44a-5e8e6ea9b2a5 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/ce0d629a-068c-4a62-8a03-fc43fc0be9b3" status: 200 len: 1472 microversion: 2.1 time: 0.348261 Oct 04 18:36:17.357855 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 608/1336] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:17 2022] GET /compute/v2.1/servers/ce0d629a-068c-4a62-8a03-fc43fc0be9b3 => generated 1472 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:17.362971 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-90670444-3c22-4bc5-98d2-49db4de7b776 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:17.363850 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-90670444-3c22-4bc5-98d2-49db4de7b776 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] [instance: 67e13bce-be81-4775-be5f-737add9f1694] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:17.370222 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-90670444-3c22-4bc5-98d2-49db4de7b776 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:17.370944 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-90670444-3c22-4bc5-98d2-49db4de7b776 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:17.371539 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-90670444-3c22-4bc5-98d2-49db4de7b776 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:17.372444 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-90670444-3c22-4bc5-98d2-49db4de7b776 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:17.373051 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-90670444-3c22-4bc5-98d2-49db4de7b776 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:17.373654 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-90670444-3c22-4bc5-98d2-49db4de7b776 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:17.458421 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.objects.instance [None req-90670444-3c22-4bc5-98d2-49db4de7b776 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Lazy-loading 'services' on Instance uuid 67e13bce-be81-4775-be5f-737add9f1694 {{(pid=123595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:36:17.477273 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-90670444-3c22-4bc5-98d2-49db4de7b776 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/67e13bce-be81-4775-be5f-737add9f1694" status: 200 len: 1929 microversion: 2.75 time: 0.118119 Oct 04 18:36:17.478043 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 609/1337] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:36:17 2022] GET /compute/v2.1/servers/67e13bce-be81-4775-be5f-737add9f1694 => generated 1929 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:36:17.614574 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-73b94a79-6022-4d91-ac89-1c6871c92626 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64887fff0bc7417094c4fee2f7e9aa5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6187bfad04cb7bc17155862ee0cdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:17.618545 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-6474a365-9def-4b8e-81d0-a0f4e0c2719a tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-2056620755", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452"}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:36:17.623759 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-73b94a79-6022-4d91-ac89-1c6871c92626 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] 10.222.0.43 "GET /compute/v2.1/servers/63543ce9-528e-4064-a6cd-6dd249104468" status: 200 len: 1317 microversion: 2.1 time: 0.648239 Oct 04 18:36:17.628308 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 729/1338] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:16 2022] GET /compute/v2.1/servers/63543ce9-528e-4064-a6cd-6dd249104468 => generated 1317 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:36:17.638301 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-2538a4de-0d80-4ba1-87d6-d9bfa7df2eb3 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:17.638975 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-2538a4de-0d80-4ba1-87d6-d9bfa7df2eb3 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] [instance: 9ee1bd28-0921-4444-afe3-c09cbfa0680a] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:17.651354 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2538a4de-0d80-4ba1-87d6-d9bfa7df2eb3 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:17.652193 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2538a4de-0d80-4ba1-87d6-d9bfa7df2eb3 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:17.653242 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2538a4de-0d80-4ba1-87d6-d9bfa7df2eb3 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:17.655845 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2538a4de-0d80-4ba1-87d6-d9bfa7df2eb3 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:17.656408 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2538a4de-0d80-4ba1-87d6-d9bfa7df2eb3 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:17.657227 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2538a4de-0d80-4ba1-87d6-d9bfa7df2eb3 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:17.698775 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.network.neutron [None req-6474a365-9def-4b8e-81d0-a0f4e0c2719a tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] validate_networks() for None {{(pid=123595) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:36:17.852880 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-2538a4de-0d80-4ba1-87d6-d9bfa7df2eb3 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a41ab6fb78a42ceaca621c5a38ffc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa31ed92017490a82497c7b8910aef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:17.865214 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-2538a4de-0d80-4ba1-87d6-d9bfa7df2eb3 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] 10.222.0.43 "GET /compute/v2.1/servers/9ee1bd28-0921-4444-afe3-c09cbfa0680a" status: 200 len: 1487 microversion: 2.1 time: 0.235738 Oct 04 18:36:17.876858 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 730/1339] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:17 2022] GET /compute/v2.1/servers/9ee1bd28-0921-4444-afe3-c09cbfa0680a => generated 1487 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:17.891088 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f7a0d324-7772-49cf-bb1f-3682947c1630 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:36:17.892101 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-f7a0d324-7772-49cf-bb1f-3682947c1630 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] [instance: 9ee1bd28-0921-4444-afe3-c09cbfa0680a] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:17.906144 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f7a0d324-7772-49cf-bb1f-3682947c1630 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:17.906658 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f7a0d324-7772-49cf-bb1f-3682947c1630 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:17.907106 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f7a0d324-7772-49cf-bb1f-3682947c1630 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:17.907816 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f7a0d324-7772-49cf-bb1f-3682947c1630 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:17.908277 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f7a0d324-7772-49cf-bb1f-3682947c1630 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:17.908712 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f7a0d324-7772-49cf-bb1f-3682947c1630 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:17.940003 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.objects.instance [None req-f7a0d324-7772-49cf-bb1f-3682947c1630 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lazy-loading 'flavor' on Instance uuid 9ee1bd28-0921-4444-afe3-c09cbfa0680a {{(pid=123596) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:36:17.944354 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=100 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:36:17.968660 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-6474a365-9def-4b8e-81d0-a0f4e0c2719a tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Flavor limits 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:36:17.969093 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-6474a365-9def-4b8e-81d0-a0f4e0c2719a tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Image limits 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:36:17.969595 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-6474a365-9def-4b8e-81d0-a0f4e0c2719a tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Flavor pref 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:36:17.970015 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-6474a365-9def-4b8e-81d0-a0f4e0c2719a tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Image pref 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:36:17.970647 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-6474a365-9def-4b8e-81d0-a0f4e0c2719a tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:36:17.982354 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6474a365-9def-4b8e-81d0-a0f4e0c2719a tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:17.983982 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6474a365-9def-4b8e-81d0-a0f4e0c2719a tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:17.985955 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6474a365-9def-4b8e-81d0-a0f4e0c2719a tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:17.986906 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6474a365-9def-4b8e-81d0-a0f4e0c2719a tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:17.987828 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6474a365-9def-4b8e-81d0-a0f4e0c2719a tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:17.988571 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6474a365-9def-4b8e-81d0-a0f4e0c2719a tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:18.013543 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-6474a365-9def-4b8e-81d0-a0f4e0c2719a tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Getting quotas for project 3b194743a4124bdba97895542273859a. Resources: {'ram', 'cores', 'instances'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:36:18.018307 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-6474a365-9def-4b8e-81d0-a0f4e0c2719a tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Getting quotas for user 1e8046c7965b473e9f7d31be9d6f6937 and project 3b194743a4124bdba97895542273859a. Resources: {'ram', 'cores', 'instances'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:36:18.033548 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-6474a365-9def-4b8e-81d0-a0f4e0c2719a tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Going to run 1 instances... {{(pid=123595) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:36:18.037078 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-6474a365-9def-4b8e-81d0-a0f4e0c2719a tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] [instance: 4231fdff-39dd-49a6-bea2-5edea44c3582] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e8943ec5-4038-4d4b-b9b9-2415a79f5243',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:36:18.038085 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-f7a0d324-7772-49cf-bb1f-3682947c1630 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] 10.222.0.43 "POST /compute/v2.1/servers/9ee1bd28-0921-4444-afe3-c09cbfa0680a/action" status: 202 len: 0 microversion: 2.1 time: 0.152097 Oct 04 18:36:18.039269 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 731/1340] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 18:36:17 2022] POST /compute/v2.1/servers/9ee1bd28-0921-4444-afe3-c09cbfa0680a/action => generated 0 bytes in 155 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 18:36:18.060029 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-3c86824a-3b14-4a55-9bd3-0c43a48825d4 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:18.061006 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-3c86824a-3b14-4a55-9bd3-0c43a48825d4 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] [instance: 9ee1bd28-0921-4444-afe3-c09cbfa0680a] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:18.077734 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=4 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:36:18.080198 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3c86824a-3b14-4a55-9bd3-0c43a48825d4 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:18.080795 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3c86824a-3b14-4a55-9bd3-0c43a48825d4 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:18.081338 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3c86824a-3b14-4a55-9bd3-0c43a48825d4 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:18.082188 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3c86824a-3b14-4a55-9bd3-0c43a48825d4 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:18.082711 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3c86824a-3b14-4a55-9bd3-0c43a48825d4 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:18.083342 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3c86824a-3b14-4a55-9bd3-0c43a48825d4 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:18.102936 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-6474a365-9def-4b8e-81d0-a0f4e0c2719a tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.622764 Oct 04 18:36:18.104239 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 610/1341] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 18:36:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 625 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:36:18.119139 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-e6cbf9f4-8695-481e-bdbd-fe3efda741d8 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:18.122093 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-e6cbf9f4-8695-481e-bdbd-fe3efda741d8 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] [instance: 4231fdff-39dd-49a6-bea2-5edea44c3582] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:18.194409 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-e6cbf9f4-8695-481e-bdbd-fe3efda741d8 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8046c7965b473e9f7d31be9d6f6937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b194743a4124bdba97895542273859a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:18.207638 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-e6cbf9f4-8695-481e-bdbd-fe3efda741d8 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] 10.222.0.43 "GET /compute/v2.1/servers/4231fdff-39dd-49a6-bea2-5edea44c3582" status: 200 len: 1217 microversion: 2.1 time: 0.094672 Oct 04 18:36:18.208409 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 611/1342] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:18 2022] GET /compute/v2.1/servers/4231fdff-39dd-49a6-bea2-5edea44c3582 => generated 1217 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:18.285891 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-3c86824a-3b14-4a55-9bd3-0c43a48825d4 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a41ab6fb78a42ceaca621c5a38ffc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa31ed92017490a82497c7b8910aef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:18.294104 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-3c86824a-3b14-4a55-9bd3-0c43a48825d4 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] 10.222.0.43 "GET /compute/v2.1/servers/9ee1bd28-0921-4444-afe3-c09cbfa0680a" status: 200 len: 1495 microversion: 2.1 time: 0.241688 Oct 04 18:36:18.310955 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 732/1343] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:18 2022] GET /compute/v2.1/servers/9ee1bd28-0921-4444-afe3-c09cbfa0680a => generated 1495 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:18.382637 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-d2cd6d2b-5fea-4053-ada8-e3890f34e842 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:18.383487 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-d2cd6d2b-5fea-4053-ada8-e3890f34e842 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: ce0d629a-068c-4a62-8a03-fc43fc0be9b3] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:18.391728 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d2cd6d2b-5fea-4053-ada8-e3890f34e842 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:18.392530 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d2cd6d2b-5fea-4053-ada8-e3890f34e842 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:18.393182 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d2cd6d2b-5fea-4053-ada8-e3890f34e842 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:18.394175 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d2cd6d2b-5fea-4053-ada8-e3890f34e842 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:18.395087 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d2cd6d2b-5fea-4053-ada8-e3890f34e842 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:18.395690 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d2cd6d2b-5fea-4053-ada8-e3890f34e842 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:18.508241 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-0d9419de-bbe1-45ae-896c-eb7fc455ca2d tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:18.508945 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-0d9419de-bbe1-45ae-896c-eb7fc455ca2d tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] [instance: 67e13bce-be81-4775-be5f-737add9f1694] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:18.526804 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0d9419de-bbe1-45ae-896c-eb7fc455ca2d tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:18.527363 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0d9419de-bbe1-45ae-896c-eb7fc455ca2d tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:18.537558 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0d9419de-bbe1-45ae-896c-eb7fc455ca2d tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:18.538464 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0d9419de-bbe1-45ae-896c-eb7fc455ca2d tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:18.538896 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0d9419de-bbe1-45ae-896c-eb7fc455ca2d tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:18.539338 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0d9419de-bbe1-45ae-896c-eb7fc455ca2d tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:18.597722 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-d2cd6d2b-5fea-4053-ada8-e3890f34e842 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:18.610355 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-d2cd6d2b-5fea-4053-ada8-e3890f34e842 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/ce0d629a-068c-4a62-8a03-fc43fc0be9b3" status: 200 len: 1472 microversion: 2.1 time: 0.233600 Oct 04 18:36:18.628183 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 612/1344] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:18 2022] GET /compute/v2.1/servers/ce0d629a-068c-4a62-8a03-fc43fc0be9b3 => generated 1472 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:18.653066 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-13da4015-7a1d-4d71-ad04-91644668ae8b tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:18.653636 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-13da4015-7a1d-4d71-ad04-91644668ae8b tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] [instance: 63543ce9-528e-4064-a6cd-6dd249104468] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:18.669979 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-13da4015-7a1d-4d71-ad04-91644668ae8b tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:18.670479 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-13da4015-7a1d-4d71-ad04-91644668ae8b tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:18.670918 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-13da4015-7a1d-4d71-ad04-91644668ae8b tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:18.671625 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-13da4015-7a1d-4d71-ad04-91644668ae8b tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:18.672091 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-13da4015-7a1d-4d71-ad04-91644668ae8b tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:18.672502 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-13da4015-7a1d-4d71-ad04-91644668ae8b tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:18.679419 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.objects.instance [None req-0d9419de-bbe1-45ae-896c-eb7fc455ca2d tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Lazy-loading 'services' on Instance uuid 67e13bce-be81-4775-be5f-737add9f1694 {{(pid=123596) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:36:18.698480 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-0d9419de-bbe1-45ae-896c-eb7fc455ca2d tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/67e13bce-be81-4775-be5f-737add9f1694" status: 200 len: 1929 microversion: 2.75 time: 0.196274 Oct 04 18:36:18.699068 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 733/1345] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:36:18 2022] GET /compute/v2.1/servers/67e13bce-be81-4775-be5f-737add9f1694 => generated 1929 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:36:18.945217 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-13da4015-7a1d-4d71-ad04-91644668ae8b tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64887fff0bc7417094c4fee2f7e9aa5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6187bfad04cb7bc17155862ee0cdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:18.949004 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:36:18.959413 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-13da4015-7a1d-4d71-ad04-91644668ae8b tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] 10.222.0.43 "GET /compute/v2.1/servers/63543ce9-528e-4064-a6cd-6dd249104468" status: 200 len: 1317 microversion: 2.1 time: 0.310810 Oct 04 18:36:18.960926 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 613/1346] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:18 2022] GET /compute/v2.1/servers/63543ce9-528e-4064-a6cd-6dd249104468 => generated 1317 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:36:19.231668 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-0ecb92a4-5a13-4bef-a923-634d561ddc3d tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:19.233101 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-0ecb92a4-5a13-4bef-a923-634d561ddc3d tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] [instance: 4231fdff-39dd-49a6-bea2-5edea44c3582] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:19.240298 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0ecb92a4-5a13-4bef-a923-634d561ddc3d tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:19.240869 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0ecb92a4-5a13-4bef-a923-634d561ddc3d tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:19.241459 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0ecb92a4-5a13-4bef-a923-634d561ddc3d tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:19.242488 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0ecb92a4-5a13-4bef-a923-634d561ddc3d tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:19.243501 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0ecb92a4-5a13-4bef-a923-634d561ddc3d tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:19.244184 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0ecb92a4-5a13-4bef-a923-634d561ddc3d tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:19.319006 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-4846b31e-6f21-4ddd-bf93-ac629f9e2a7e tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:19.319583 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-4846b31e-6f21-4ddd-bf93-ac629f9e2a7e tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] [instance: 9ee1bd28-0921-4444-afe3-c09cbfa0680a] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:19.324166 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-0ecb92a4-5a13-4bef-a923-634d561ddc3d tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8046c7965b473e9f7d31be9d6f6937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b194743a4124bdba97895542273859a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:19.339197 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-0ecb92a4-5a13-4bef-a923-634d561ddc3d tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] 10.222.0.43 "GET /compute/v2.1/servers/4231fdff-39dd-49a6-bea2-5edea44c3582" status: 200 len: 1221 microversion: 2.1 time: 0.112226 Oct 04 18:36:19.342229 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 734/1347] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:19 2022] GET /compute/v2.1/servers/4231fdff-39dd-49a6-bea2-5edea44c3582 => generated 1221 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:19.342498 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4846b31e-6f21-4ddd-bf93-ac629f9e2a7e tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:19.342498 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4846b31e-6f21-4ddd-bf93-ac629f9e2a7e tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:19.342734 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4846b31e-6f21-4ddd-bf93-ac629f9e2a7e tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:19.344284 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4846b31e-6f21-4ddd-bf93-ac629f9e2a7e tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:19.345352 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4846b31e-6f21-4ddd-bf93-ac629f9e2a7e tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:19.346321 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4846b31e-6f21-4ddd-bf93-ac629f9e2a7e tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:19.488673 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-4846b31e-6f21-4ddd-bf93-ac629f9e2a7e tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a41ab6fb78a42ceaca621c5a38ffc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa31ed92017490a82497c7b8910aef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:19.496538 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-4846b31e-6f21-4ddd-bf93-ac629f9e2a7e tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] 10.222.0.43 "GET /compute/v2.1/servers/9ee1bd28-0921-4444-afe3-c09cbfa0680a" status: 200 len: 1478 microversion: 2.1 time: 0.182629 Oct 04 18:36:19.497125 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 614/1348] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:19 2022] GET /compute/v2.1/servers/9ee1bd28-0921-4444-afe3-c09cbfa0680a => generated 1478 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:36:19.522518 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-18a62f9a-4880-44f0-90e3-7ae9ca935fe4 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-291768013"}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:36:19.525993 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-18a62f9a-4880-44f0-90e3-7ae9ca935fe4 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] [instance: 9ee1bd28-0921-4444-afe3-c09cbfa0680a] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:19.531984 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-18a62f9a-4880-44f0-90e3-7ae9ca935fe4 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:19.532458 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-18a62f9a-4880-44f0-90e3-7ae9ca935fe4 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:19.532894 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-18a62f9a-4880-44f0-90e3-7ae9ca935fe4 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:19.533616 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-18a62f9a-4880-44f0-90e3-7ae9ca935fe4 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:19.534063 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-18a62f9a-4880-44f0-90e3-7ae9ca935fe4 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:19.534489 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-18a62f9a-4880-44f0-90e3-7ae9ca935fe4 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:19.640547 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-b862d0f1-4c8d-4667-bcb2-08275caad2dc tempest-ServicesAdminNegativeV253TestJSON-323945417 tempest-ServicesAdminNegativeV253TestJSON-323945417-project-admin] Action: 'update', calling method: .version_select at 0x7fb227ed8af0>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:36:19.644222 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b862d0f1-4c8d-4667-bcb2-08275caad2dc tempest-ServicesAdminNegativeV253TestJSON-323945417 tempest-ServicesAdminNegativeV253TestJSON-323945417-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:19.644716 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b862d0f1-4c8d-4667-bcb2-08275caad2dc tempest-ServicesAdminNegativeV253TestJSON-323945417 tempest-ServicesAdminNegativeV253TestJSON-323945417-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:19.645187 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b862d0f1-4c8d-4667-bcb2-08275caad2dc tempest-ServicesAdminNegativeV253TestJSON-323945417 tempest-ServicesAdminNegativeV253TestJSON-323945417-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:19.654352 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b862d0f1-4c8d-4667-bcb2-08275caad2dc tempest-ServicesAdminNegativeV253TestJSON-323945417 tempest-ServicesAdminNegativeV253TestJSON-323945417-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:19.655262 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b862d0f1-4c8d-4667-bcb2-08275caad2dc tempest-ServicesAdminNegativeV253TestJSON-323945417 tempest-ServicesAdminNegativeV253TestJSON-323945417-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:19.656003 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b862d0f1-4c8d-4667-bcb2-08275caad2dc tempest-ServicesAdminNegativeV253TestJSON-323945417 tempest-ServicesAdminNegativeV253TestJSON-323945417-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:19.664271 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-b862d0f1-4c8d-4667-bcb2-08275caad2dc tempest-ServicesAdminNegativeV253TestJSON-323945417 tempest-ServicesAdminNegativeV253TestJSON-323945417-project-admin] HTTP exception thrown: Service dc226075-0b9b-43eb-8e21-7095ca850701 could not be found. Oct 04 18:36:19.667058 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-b862d0f1-4c8d-4667-bcb2-08275caad2dc tempest-ServicesAdminNegativeV253TestJSON-323945417 tempest-ServicesAdminNegativeV253TestJSON-323945417-project-admin] Request method failure captured: Oct 04 18:36:19.667058 n-d-851028-13 devstack@n-api.service[123596]: request: PUT /compute/v2.1/os-services/dc226075-0b9b-43eb-8e21-7095ca850701 HTTP/1.1 Oct 04 18:36:19.667058 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:36:19.667058 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:36:19.667058 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:36:19.667058 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 56 Oct 04 18:36:19.667058 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:36:19.667058 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:36:19.667058 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:36:19.667058 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:36:19.667058 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPH0jrBXu-yN_-qNyCL9-VlayQvdLacQLR580PpQj89bruDTJodUQLkF33i7I8cVsZEPBVbpZoE7sjVdhIWlFkPDz-Z5erlKf_aScH5klHMwqC-Alt-azTx1EbfTxI-YvN7Nj0UZirXRFmcs927qo2jmz2ZkfhTqG8hgBjzJdj1iA8Co Oct 04 18:36:19.667058 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:36:19.667058 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:36:19.667058 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:36:19.667058 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:36:19.667058 n-d-851028-13 devstack@n-api.service[123596]: X-Openstack-Nova-Api-Version: 2.53 Oct 04 18:36:19.667058 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:36:19.667058 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:36:19.667058 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: 4d1358d2ce1841d2a1704789993301dd Oct 04 18:36:19.667058 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-323945417 Oct 04 18:36:19.667058 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,admin,reader Oct 04 18:36:19.667058 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,admin,reader Oct 04 18:36:19.667058 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/4d1358d2ce1841d2a1704789993301dd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_4d1358d2ce1841d2a1704789993301dd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4d1358d2ce1841d2a1704789993301dd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4d1358d2ce1841d2a1704789993301dd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:36:19.667058 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-323945417 Oct 04 18:36:19.667058 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: 4d1358d2ce1841d2a1704789993301dd Oct 04 18:36:19.667058 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-323945417 Oct 04 18:36:19.667058 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-ServicesAdminNegativeV253TestJSON-323945417-project-admin Oct 04 18:36:19.667058 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:36:19.667058 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:36:19.667058 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 905c483951874f8cae046a3e0f8ef614 Oct 04 18:36:19.667058 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-323945417-project-admin Oct 04 18:36:19.667058 n-d-851028-13 devstack@n-api.service[123596]: Oct 04 18:36:19.667058 n-d-851028-13 devstack@n-api.service[123596]: {"status": "disabled", "disabled_reason": "maintenance"} Oct 04 18:36:19.667058 n-d-851028-13 devstack@n-api.service[123596]: method: Oct 04 18:36:19.667058 n-d-851028-13 devstack@n-api.service[123596]: exception: Service dc226075-0b9b-43eb-8e21-7095ca850701 could not be found. Oct 04 18:36:19.667058 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': 'dc226075-0b9b-43eb-8e21-7095ca850701', 'body': {'status': 'disabled', 'disabled_reason': 'maintenance'}} Oct 04 18:36:19.667058 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:36:19.667058 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:36:19.667058 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Oct 04 18:36:19.667058 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 04 18:36:19.667058 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 04 18:36:19.667058 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 04 18:36:19.667058 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 04 18:36:19.667058 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:36:19.667058 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:36:19.667058 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:36:19.667058 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:36:19.667058 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 04 18:36:19.667058 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 04 18:36:19.667058 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Oct 04 18:36:19.667058 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 04 18:36:19.667058 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service dc226075-0b9b-43eb-8e21-7095ca850701 could not be found. Oct 04 18:36:19.667058 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:36:19.667058 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:36:19.667058 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:36:19.667058 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:36:19.667058 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:36:19.667058 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:36:19.667058 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:36:19.667058 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:36:19.667058 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:36:19.667058 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:36:19.667058 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:36:19.667058 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:36:19.667058 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:36:19.667058 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:36:19.672893 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 04 18:36:19.672893 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:36:19.672893 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service dc226075-0b9b-43eb-8e21-7095ca850701 could not be found. Oct 04 18:36:19.672893 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:36:19.672893 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:36:19.672893 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:36:19.672893 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:36:19.672893 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:36:19.672893 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:36:19.672893 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:36:19.672893 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:36:19.672893 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service dc226075-0b9b-43eb-8e21-7095ca850701 could not be found. Oct 04 18:36:19.672893 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:36:19.672893 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-b862d0f1-4c8d-4667-bcb2-08275caad2dc tempest-ServicesAdminNegativeV253TestJSON-323945417 tempest-ServicesAdminNegativeV253TestJSON-323945417-project-admin] Returning 404 to user: Service dc226075-0b9b-43eb-8e21-7095ca850701 could not be found. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:36:19.672893 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-b862d0f1-4c8d-4667-bcb2-08275caad2dc tempest-ServicesAdminNegativeV253TestJSON-323945417 tempest-ServicesAdminNegativeV253TestJSON-323945417-project-admin] 10.222.0.43 "PUT /compute/v2.1/os-services/dc226075-0b9b-43eb-8e21-7095ca850701" status: 404 len: 110 microversion: 2.53 time: 0.156075 Oct 04 18:36:19.674860 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 735/1349] 10.222.0.43 () {62 vars in 1309 bytes} [Tue Oct 4 18:36:19 2022] PUT /compute/v2.1/os-services/dc226075-0b9b-43eb-8e21-7095ca850701 => generated 110 bytes in 163 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:36:19.680311 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-01fa6432-900c-4546-ab25-b81644f4a13e tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:19.680936 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-01fa6432-900c-4546-ab25-b81644f4a13e tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: ce0d629a-068c-4a62-8a03-fc43fc0be9b3] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:19.687357 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-01fa6432-900c-4546-ab25-b81644f4a13e tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:19.687854 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-01fa6432-900c-4546-ab25-b81644f4a13e tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:19.688296 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-01fa6432-900c-4546-ab25-b81644f4a13e tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:19.688999 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-01fa6432-900c-4546-ab25-b81644f4a13e tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:19.689513 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-01fa6432-900c-4546-ab25-b81644f4a13e tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:19.689941 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-01fa6432-900c-4546-ab25-b81644f4a13e tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:19.742643 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-18a62f9a-4880-44f0-90e3-7ae9ca935fe4 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] 10.222.0.43 "POST /compute/v2.1/servers/9ee1bd28-0921-4444-afe3-c09cbfa0680a/action" status: 202 len: 0 microversion: 2.1 time: 0.224604 Oct 04 18:36:19.743494 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 615/1350] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 18:36:19 2022] POST /compute/v2.1/servers/9ee1bd28-0921-4444-afe3-c09cbfa0680a/action => generated 0 bytes in 226 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 04 18:36:19.749369 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-bc3da526-be21-47f1-8b91-ee0b37a45038 tempest-ServicesAdminNegativeV253TestJSON-323945417 tempest-ServicesAdminNegativeV253TestJSON-323945417-project-admin] Action: 'update', calling method: .version_select at 0x7fb21f8d3e50>, body: {"status": "disabled"} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:36:19.752656 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bc3da526-be21-47f1-8b91-ee0b37a45038 tempest-ServicesAdminNegativeV253TestJSON-323945417 tempest-ServicesAdminNegativeV253TestJSON-323945417-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:19.753146 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bc3da526-be21-47f1-8b91-ee0b37a45038 tempest-ServicesAdminNegativeV253TestJSON-323945417 tempest-ServicesAdminNegativeV253TestJSON-323945417-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:19.753587 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bc3da526-be21-47f1-8b91-ee0b37a45038 tempest-ServicesAdminNegativeV253TestJSON-323945417 tempest-ServicesAdminNegativeV253TestJSON-323945417-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:19.761294 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bc3da526-be21-47f1-8b91-ee0b37a45038 tempest-ServicesAdminNegativeV253TestJSON-323945417 tempest-ServicesAdminNegativeV253TestJSON-323945417-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:19.761775 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bc3da526-be21-47f1-8b91-ee0b37a45038 tempest-ServicesAdminNegativeV253TestJSON-323945417 tempest-ServicesAdminNegativeV253TestJSON-323945417-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:19.762264 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bc3da526-be21-47f1-8b91-ee0b37a45038 tempest-ServicesAdminNegativeV253TestJSON-323945417 tempest-ServicesAdminNegativeV253TestJSON-323945417-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:19.769934 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-bc3da526-be21-47f1-8b91-ee0b37a45038 tempest-ServicesAdminNegativeV253TestJSON-323945417 tempest-ServicesAdminNegativeV253TestJSON-323945417-project-admin] HTTP exception thrown: Service dc226075-0b9b-43eb-8e21-7095ca850701 could not be found. Oct 04 18:36:19.771726 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-bc3da526-be21-47f1-8b91-ee0b37a45038 tempest-ServicesAdminNegativeV253TestJSON-323945417 tempest-ServicesAdminNegativeV253TestJSON-323945417-project-admin] Request method failure captured: Oct 04 18:36:19.771726 n-d-851028-13 devstack@n-api.service[123595]: request: PUT /compute/v2.1/os-services/dc226075-0b9b-43eb-8e21-7095ca850701 HTTP/1.1 Oct 04 18:36:19.771726 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 18:36:19.771726 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 18:36:19.771726 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 18:36:19.771726 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 22 Oct 04 18:36:19.771726 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 18:36:19.771726 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 18:36:19.771726 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 18:36:19.771726 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 18:36:19.771726 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPH0jrBXu-yN_-qNyCL9-VlayQvdLacQLR580PpQj89bruDTJodUQLkF33i7I8cVsZEPBVbpZoE7sjVdhIWlFkPDz-Z5erlKf_aScH5klHMwqC-Alt-azTx1EbfTxI-YvN7Nj0UZirXRFmcs927qo2jmz2ZkfhTqG8hgBjzJdj1iA8Co Oct 04 18:36:19.771726 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 18:36:19.771726 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 18:36:19.771726 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 18:36:19.771726 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 18:36:19.771726 n-d-851028-13 devstack@n-api.service[123595]: X-Openstack-Nova-Api-Version: 2.53 Oct 04 18:36:19.771726 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 18:36:19.771726 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 18:36:19.771726 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: 4d1358d2ce1841d2a1704789993301dd Oct 04 18:36:19.771726 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-323945417 Oct 04 18:36:19.771726 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,admin,reader Oct 04 18:36:19.771726 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,admin,reader Oct 04 18:36:19.771726 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/4d1358d2ce1841d2a1704789993301dd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_4d1358d2ce1841d2a1704789993301dd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4d1358d2ce1841d2a1704789993301dd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4d1358d2ce1841d2a1704789993301dd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:36:19.771726 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-323945417 Oct 04 18:36:19.771726 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: 4d1358d2ce1841d2a1704789993301dd Oct 04 18:36:19.771726 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-323945417 Oct 04 18:36:19.771726 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-ServicesAdminNegativeV253TestJSON-323945417-project-admin Oct 04 18:36:19.771726 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 18:36:19.771726 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 18:36:19.771726 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: 905c483951874f8cae046a3e0f8ef614 Oct 04 18:36:19.771726 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-323945417-project-admin Oct 04 18:36:19.771726 n-d-851028-13 devstack@n-api.service[123595]: Oct 04 18:36:19.771726 n-d-851028-13 devstack@n-api.service[123595]: {"status": "disabled"} Oct 04 18:36:19.771726 n-d-851028-13 devstack@n-api.service[123595]: method: Oct 04 18:36:19.771726 n-d-851028-13 devstack@n-api.service[123595]: exception: Service dc226075-0b9b-43eb-8e21-7095ca850701 could not be found. Oct 04 18:36:19.771726 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': 'dc226075-0b9b-43eb-8e21-7095ca850701', 'body': {'status': 'disabled'}} Oct 04 18:36:19.771726 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:36:19.771726 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:36:19.771726 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Oct 04 18:36:19.771726 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 04 18:36:19.771726 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 04 18:36:19.771726 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 04 18:36:19.771726 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 04 18:36:19.771726 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:36:19.771726 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:36:19.771726 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:36:19.771726 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:36:19.771726 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 04 18:36:19.771726 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 04 18:36:19.771726 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Oct 04 18:36:19.771726 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 04 18:36:19.771726 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service dc226075-0b9b-43eb-8e21-7095ca850701 could not be found. Oct 04 18:36:19.771726 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:36:19.771726 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:36:19.771726 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:36:19.771726 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:36:19.771726 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:36:19.771726 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:36:19.771726 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:36:19.771726 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:36:19.771726 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:36:19.771726 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:36:19.771726 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:36:19.771726 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:36:19.771726 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:36:19.771726 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:36:19.777687 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 04 18:36:19.777687 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:36:19.777687 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service dc226075-0b9b-43eb-8e21-7095ca850701 could not be found. Oct 04 18:36:19.777687 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:36:19.777687 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:36:19.777687 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:36:19.777687 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:36:19.777687 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:36:19.777687 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:36:19.777687 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:36:19.777687 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:36:19.777687 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service dc226075-0b9b-43eb-8e21-7095ca850701 could not be found. Oct 04 18:36:19.777687 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:36:19.777687 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-bc3da526-be21-47f1-8b91-ee0b37a45038 tempest-ServicesAdminNegativeV253TestJSON-323945417 tempest-ServicesAdminNegativeV253TestJSON-323945417-project-admin] Returning 404 to user: Service dc226075-0b9b-43eb-8e21-7095ca850701 could not be found. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:36:19.777687 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-bc3da526-be21-47f1-8b91-ee0b37a45038 tempest-ServicesAdminNegativeV253TestJSON-323945417 tempest-ServicesAdminNegativeV253TestJSON-323945417-project-admin] 10.222.0.43 "PUT /compute/v2.1/os-services/dc226075-0b9b-43eb-8e21-7095ca850701" status: 404 len: 110 microversion: 2.53 time: 0.027963 Oct 04 18:36:19.777687 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 616/1351] 10.222.0.43 () {62 vars in 1309 bytes} [Tue Oct 4 18:36:19 2022] PUT /compute/v2.1/os-services/dc226075-0b9b-43eb-8e21-7095ca850701 => generated 110 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:36:19.789606 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-931f0fe3-e8a8-40be-8479-8f3e1d64a835 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:19.791052 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-931f0fe3-e8a8-40be-8479-8f3e1d64a835 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] [instance: 67e13bce-be81-4775-be5f-737add9f1694] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:19.797450 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-931f0fe3-e8a8-40be-8479-8f3e1d64a835 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:19.798231 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-931f0fe3-e8a8-40be-8479-8f3e1d64a835 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:19.798709 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-931f0fe3-e8a8-40be-8479-8f3e1d64a835 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:19.799502 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-931f0fe3-e8a8-40be-8479-8f3e1d64a835 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:19.800009 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-931f0fe3-e8a8-40be-8479-8f3e1d64a835 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:19.800480 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-931f0fe3-e8a8-40be-8479-8f3e1d64a835 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:19.834666 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-01fa6432-900c-4546-ab25-b81644f4a13e tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:19.843676 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-01fa6432-900c-4546-ab25-b81644f4a13e tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/ce0d629a-068c-4a62-8a03-fc43fc0be9b3" status: 200 len: 1472 microversion: 2.1 time: 0.167566 Oct 04 18:36:19.844348 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 736/1352] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:19 2022] GET /compute/v2.1/servers/ce0d629a-068c-4a62-8a03-fc43fc0be9b3 => generated 1472 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:19.851443 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-db301b8b-3b86-421d-9f34-ae7ed252d53b tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Calling method '.version_select at 0x7fb227eb1280>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:19.882493 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.objects.instance [None req-931f0fe3-e8a8-40be-8479-8f3e1d64a835 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Lazy-loading 'services' on Instance uuid 67e13bce-be81-4775-be5f-737add9f1694 {{(pid=123595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:36:19.896394 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-db301b8b-3b86-421d-9f34-ae7ed252d53b tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] 10.222.0.43 "GET /compute/v2.1/images/c7776971-442e-4bf2-8d58-f38b00ff4b4a" status: 200 len: 1437 microversion: 2.1 time: 0.050797 Oct 04 18:36:19.897037 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 737/1353] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 18:36:19 2022] GET /compute/v2.1/images/c7776971-442e-4bf2-8d58-f38b00ff4b4a => generated 1437 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:19.903683 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-1d09ae1f-82c4-4934-b58e-e128ed6d345c tempest-ServicesAdminNegativeV253TestJSON-323945417 tempest-ServicesAdminNegativeV253TestJSON-323945417-project-admin] Action: 'update', calling method: .version_select at 0x7fb227e7ef70>, body: {"status": "enabled"} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:36:19.905736 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1d09ae1f-82c4-4934-b58e-e128ed6d345c tempest-ServicesAdminNegativeV253TestJSON-323945417 tempest-ServicesAdminNegativeV253TestJSON-323945417-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:19.906234 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1d09ae1f-82c4-4934-b58e-e128ed6d345c tempest-ServicesAdminNegativeV253TestJSON-323945417 tempest-ServicesAdminNegativeV253TestJSON-323945417-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:19.906683 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1d09ae1f-82c4-4934-b58e-e128ed6d345c tempest-ServicesAdminNegativeV253TestJSON-323945417 tempest-ServicesAdminNegativeV253TestJSON-323945417-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:19.907936 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-931f0fe3-e8a8-40be-8479-8f3e1d64a835 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/67e13bce-be81-4775-be5f-737add9f1694" status: 200 len: 1929 microversion: 2.75 time: 0.122245 Oct 04 18:36:19.915059 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 617/1354] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:36:19 2022] GET /compute/v2.1/servers/67e13bce-be81-4775-be5f-737add9f1694 => generated 1929 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:36:19.918960 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1d09ae1f-82c4-4934-b58e-e128ed6d345c tempest-ServicesAdminNegativeV253TestJSON-323945417 tempest-ServicesAdminNegativeV253TestJSON-323945417-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:19.919622 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1d09ae1f-82c4-4934-b58e-e128ed6d345c tempest-ServicesAdminNegativeV253TestJSON-323945417 tempest-ServicesAdminNegativeV253TestJSON-323945417-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:19.920243 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1d09ae1f-82c4-4934-b58e-e128ed6d345c tempest-ServicesAdminNegativeV253TestJSON-323945417 tempest-ServicesAdminNegativeV253TestJSON-323945417-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:19.926430 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-1d09ae1f-82c4-4934-b58e-e128ed6d345c tempest-ServicesAdminNegativeV253TestJSON-323945417 tempest-ServicesAdminNegativeV253TestJSON-323945417-project-admin] HTTP exception thrown: Service dc226075-0b9b-43eb-8e21-7095ca850701 could not be found. Oct 04 18:36:19.928443 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-1d09ae1f-82c4-4934-b58e-e128ed6d345c tempest-ServicesAdminNegativeV253TestJSON-323945417 tempest-ServicesAdminNegativeV253TestJSON-323945417-project-admin] Request method failure captured: Oct 04 18:36:19.928443 n-d-851028-13 devstack@n-api.service[123596]: request: PUT /compute/v2.1/os-services/dc226075-0b9b-43eb-8e21-7095ca850701 HTTP/1.1 Oct 04 18:36:19.928443 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:36:19.928443 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:36:19.928443 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:36:19.928443 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 21 Oct 04 18:36:19.928443 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:36:19.928443 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:36:19.928443 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:36:19.928443 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:36:19.928443 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPH0jrBXu-yN_-qNyCL9-VlayQvdLacQLR580PpQj89bruDTJodUQLkF33i7I8cVsZEPBVbpZoE7sjVdhIWlFkPDz-Z5erlKf_aScH5klHMwqC-Alt-azTx1EbfTxI-YvN7Nj0UZirXRFmcs927qo2jmz2ZkfhTqG8hgBjzJdj1iA8Co Oct 04 18:36:19.928443 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:36:19.928443 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:36:19.928443 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:36:19.928443 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:36:19.928443 n-d-851028-13 devstack@n-api.service[123596]: X-Openstack-Nova-Api-Version: 2.53 Oct 04 18:36:19.928443 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:36:19.928443 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:36:19.928443 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: 4d1358d2ce1841d2a1704789993301dd Oct 04 18:36:19.928443 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-323945417 Oct 04 18:36:19.928443 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,admin,reader Oct 04 18:36:19.928443 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,admin,reader Oct 04 18:36:19.928443 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/4d1358d2ce1841d2a1704789993301dd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_4d1358d2ce1841d2a1704789993301dd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4d1358d2ce1841d2a1704789993301dd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4d1358d2ce1841d2a1704789993301dd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:36:19.928443 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-323945417 Oct 04 18:36:19.928443 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: 4d1358d2ce1841d2a1704789993301dd Oct 04 18:36:19.928443 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-323945417 Oct 04 18:36:19.928443 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-ServicesAdminNegativeV253TestJSON-323945417-project-admin Oct 04 18:36:19.928443 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:36:19.928443 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:36:19.928443 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 905c483951874f8cae046a3e0f8ef614 Oct 04 18:36:19.928443 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-323945417-project-admin Oct 04 18:36:19.928443 n-d-851028-13 devstack@n-api.service[123596]: Oct 04 18:36:19.928443 n-d-851028-13 devstack@n-api.service[123596]: {"status": "enabled"} Oct 04 18:36:19.928443 n-d-851028-13 devstack@n-api.service[123596]: method: Oct 04 18:36:19.928443 n-d-851028-13 devstack@n-api.service[123596]: exception: Service dc226075-0b9b-43eb-8e21-7095ca850701 could not be found. Oct 04 18:36:19.928443 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': 'dc226075-0b9b-43eb-8e21-7095ca850701', 'body': {'status': 'enabled'}} Oct 04 18:36:19.928443 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:36:19.928443 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:36:19.928443 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Oct 04 18:36:19.928443 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 04 18:36:19.928443 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 04 18:36:19.928443 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 04 18:36:19.928443 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 04 18:36:19.928443 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:36:19.928443 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:36:19.928443 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:36:19.928443 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:36:19.928443 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 04 18:36:19.928443 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 04 18:36:19.928443 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Oct 04 18:36:19.928443 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 04 18:36:19.928443 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service dc226075-0b9b-43eb-8e21-7095ca850701 could not be found. Oct 04 18:36:19.928443 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:36:19.928443 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:36:19.928443 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:36:19.928443 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:36:19.928443 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:36:19.928443 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:36:19.928443 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:36:19.928443 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:36:19.928443 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:36:19.928443 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:36:19.928443 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:36:19.928443 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:36:19.928443 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:36:19.928443 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:36:19.935307 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 04 18:36:19.935307 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:36:19.935307 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service dc226075-0b9b-43eb-8e21-7095ca850701 could not be found. Oct 04 18:36:19.935307 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:36:19.935307 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:36:19.935307 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:36:19.935307 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:36:19.935307 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:36:19.935307 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:36:19.935307 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:36:19.935307 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:36:19.935307 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service dc226075-0b9b-43eb-8e21-7095ca850701 could not be found. Oct 04 18:36:19.935307 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:36:19.935307 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-1d09ae1f-82c4-4934-b58e-e128ed6d345c tempest-ServicesAdminNegativeV253TestJSON-323945417 tempest-ServicesAdminNegativeV253TestJSON-323945417-project-admin] Returning 404 to user: Service dc226075-0b9b-43eb-8e21-7095ca850701 could not be found. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:36:19.935307 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-1d09ae1f-82c4-4934-b58e-e128ed6d345c tempest-ServicesAdminNegativeV253TestJSON-323945417 tempest-ServicesAdminNegativeV253TestJSON-323945417-project-admin] 10.222.0.43 "PUT /compute/v2.1/os-services/dc226075-0b9b-43eb-8e21-7095ca850701" status: 404 len: 110 microversion: 2.53 time: 0.033116 Oct 04 18:36:19.935307 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 738/1355] 10.222.0.43 () {62 vars in 1309 bytes} [Tue Oct 4 18:36:19 2022] PUT /compute/v2.1/os-services/dc226075-0b9b-43eb-8e21-7095ca850701 => generated 110 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:36:19.942400 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-b01e14ba-672c-4480-88fd-c71368620d3a tempest-ServicesAdminNegativeV253TestJSON-323945417 tempest-ServicesAdminNegativeV253TestJSON-323945417-project-admin] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:19.945883 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b01e14ba-672c-4480-88fd-c71368620d3a tempest-ServicesAdminNegativeV253TestJSON-323945417 tempest-ServicesAdminNegativeV253TestJSON-323945417-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:19.946373 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b01e14ba-672c-4480-88fd-c71368620d3a tempest-ServicesAdminNegativeV253TestJSON-323945417 tempest-ServicesAdminNegativeV253TestJSON-323945417-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:19.946829 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b01e14ba-672c-4480-88fd-c71368620d3a tempest-ServicesAdminNegativeV253TestJSON-323945417 tempest-ServicesAdminNegativeV253TestJSON-323945417-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:19.947713 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b01e14ba-672c-4480-88fd-c71368620d3a tempest-ServicesAdminNegativeV253TestJSON-323945417 tempest-ServicesAdminNegativeV253TestJSON-323945417-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:19.948174 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b01e14ba-672c-4480-88fd-c71368620d3a tempest-ServicesAdminNegativeV253TestJSON-323945417 tempest-ServicesAdminNegativeV253TestJSON-323945417-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:19.948635 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b01e14ba-672c-4480-88fd-c71368620d3a tempest-ServicesAdminNegativeV253TestJSON-323945417 tempest-ServicesAdminNegativeV253TestJSON-323945417-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:19.974083 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-b01e14ba-672c-4480-88fd-c71368620d3a tempest-ServicesAdminNegativeV253TestJSON-323945417 tempest-ServicesAdminNegativeV253TestJSON-323945417-project-admin] 10.222.0.43 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.035754 Oct 04 18:36:19.974685 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 618/1356] 10.222.0.43 () {60 vars in 1178 bytes} [Tue Oct 4 18:36:19 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:36:19.984147 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-91d394cb-40e4-4890-921e-4daaae8a697e tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:19.985519 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-91d394cb-40e4-4890-921e-4daaae8a697e tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] [instance: 63543ce9-528e-4064-a6cd-6dd249104468] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:19.987557 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-37fc4416-9c33-43d4-b4cb-99a981be1429 tempest-ServicesAdminNegativeV253TestJSON-323945417 tempest-ServicesAdminNegativeV253TestJSON-323945417-project-admin] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:19.991400 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-37fc4416-9c33-43d4-b4cb-99a981be1429 tempest-ServicesAdminNegativeV253TestJSON-323945417 tempest-ServicesAdminNegativeV253TestJSON-323945417-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:19.991847 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-91d394cb-40e4-4890-921e-4daaae8a697e tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:19.991961 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-37fc4416-9c33-43d4-b4cb-99a981be1429 tempest-ServicesAdminNegativeV253TestJSON-323945417 tempest-ServicesAdminNegativeV253TestJSON-323945417-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:19.992343 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-91d394cb-40e4-4890-921e-4daaae8a697e tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:19.992462 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-37fc4416-9c33-43d4-b4cb-99a981be1429 tempest-ServicesAdminNegativeV253TestJSON-323945417 tempest-ServicesAdminNegativeV253TestJSON-323945417-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:19.992817 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-91d394cb-40e4-4890-921e-4daaae8a697e tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:19.993227 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-37fc4416-9c33-43d4-b4cb-99a981be1429 tempest-ServicesAdminNegativeV253TestJSON-323945417 tempest-ServicesAdminNegativeV253TestJSON-323945417-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:19.993570 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-91d394cb-40e4-4890-921e-4daaae8a697e tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:19.993688 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-37fc4416-9c33-43d4-b4cb-99a981be1429 tempest-ServicesAdminNegativeV253TestJSON-323945417 tempest-ServicesAdminNegativeV253TestJSON-323945417-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:19.994061 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-91d394cb-40e4-4890-921e-4daaae8a697e tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:19.994186 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-37fc4416-9c33-43d4-b4cb-99a981be1429 tempest-ServicesAdminNegativeV253TestJSON-323945417 tempest-ServicesAdminNegativeV253TestJSON-323945417-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:19.994498 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-91d394cb-40e4-4890-921e-4daaae8a697e tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:20.019794 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-37fc4416-9c33-43d4-b4cb-99a981be1429 tempest-ServicesAdminNegativeV253TestJSON-323945417 tempest-ServicesAdminNegativeV253TestJSON-323945417-project-admin] 10.222.0.43 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.035874 Oct 04 18:36:20.020565 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 619/1357] 10.222.0.43 () {60 vars in 1211 bytes} [Tue Oct 4 18:36:19 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1244 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:36:20.034951 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-b7950cd1-f4fd-46fc-8b39-a041757fe070 tempest-ServicesAdminNegativeV253TestJSON-323945417 tempest-ServicesAdminNegativeV253TestJSON-323945417-project-admin] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:20.038573 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b7950cd1-f4fd-46fc-8b39-a041757fe070 tempest-ServicesAdminNegativeV253TestJSON-323945417 tempest-ServicesAdminNegativeV253TestJSON-323945417-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:20.039152 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b7950cd1-f4fd-46fc-8b39-a041757fe070 tempest-ServicesAdminNegativeV253TestJSON-323945417 tempest-ServicesAdminNegativeV253TestJSON-323945417-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:20.039747 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b7950cd1-f4fd-46fc-8b39-a041757fe070 tempest-ServicesAdminNegativeV253TestJSON-323945417 tempest-ServicesAdminNegativeV253TestJSON-323945417-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:20.040578 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b7950cd1-f4fd-46fc-8b39-a041757fe070 tempest-ServicesAdminNegativeV253TestJSON-323945417 tempest-ServicesAdminNegativeV253TestJSON-323945417-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:20.041210 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b7950cd1-f4fd-46fc-8b39-a041757fe070 tempest-ServicesAdminNegativeV253TestJSON-323945417 tempest-ServicesAdminNegativeV253TestJSON-323945417-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:20.041679 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b7950cd1-f4fd-46fc-8b39-a041757fe070 tempest-ServicesAdminNegativeV253TestJSON-323945417 tempest-ServicesAdminNegativeV253TestJSON-323945417-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:20.073202 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-b7950cd1-f4fd-46fc-8b39-a041757fe070 tempest-ServicesAdminNegativeV253TestJSON-323945417 tempest-ServicesAdminNegativeV253TestJSON-323945417-project-admin] 10.222.0.43 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.041919 Oct 04 18:36:20.073821 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 620/1358] 10.222.0.43 () {60 vars in 1178 bytes} [Tue Oct 4 18:36:20 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:36:20.086465 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-f5462b32-3b3f-406d-9cd4-33d8d6c733e6 tempest-ServicesAdminNegativeV253TestJSON-323945417 tempest-ServicesAdminNegativeV253TestJSON-323945417-project-admin] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:20.091031 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f5462b32-3b3f-406d-9cd4-33d8d6c733e6 tempest-ServicesAdminNegativeV253TestJSON-323945417 tempest-ServicesAdminNegativeV253TestJSON-323945417-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:20.091525 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f5462b32-3b3f-406d-9cd4-33d8d6c733e6 tempest-ServicesAdminNegativeV253TestJSON-323945417 tempest-ServicesAdminNegativeV253TestJSON-323945417-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:20.091978 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f5462b32-3b3f-406d-9cd4-33d8d6c733e6 tempest-ServicesAdminNegativeV253TestJSON-323945417 tempest-ServicesAdminNegativeV253TestJSON-323945417-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:20.092711 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f5462b32-3b3f-406d-9cd4-33d8d6c733e6 tempest-ServicesAdminNegativeV253TestJSON-323945417 tempest-ServicesAdminNegativeV253TestJSON-323945417-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:20.093220 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f5462b32-3b3f-406d-9cd4-33d8d6c733e6 tempest-ServicesAdminNegativeV253TestJSON-323945417 tempest-ServicesAdminNegativeV253TestJSON-323945417-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:20.093648 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f5462b32-3b3f-406d-9cd4-33d8d6c733e6 tempest-ServicesAdminNegativeV253TestJSON-323945417 tempest-ServicesAdminNegativeV253TestJSON-323945417-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:20.122519 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-f5462b32-3b3f-406d-9cd4-33d8d6c733e6 tempest-ServicesAdminNegativeV253TestJSON-323945417 tempest-ServicesAdminNegativeV253TestJSON-323945417-project-admin] 10.222.0.43 "GET /compute/v2.1/os-services?host=n-d-851028-13&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.039924 Oct 04 18:36:20.123316 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 621/1359] 10.222.0.43 () {60 vars in 1237 bytes} [Tue Oct 4 18:36:20 2022] GET /compute/v2.1/os-services?host=n-d-851028-13&binary=xxx => generated 16 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:20.137327 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-d80910d5-8360-4288-a456-e2691d38e753 tempest-ServicesAdminNegativeV253TestJSON-323945417 tempest-ServicesAdminNegativeV253TestJSON-323945417-project-admin] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:20.141252 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d80910d5-8360-4288-a456-e2691d38e753 tempest-ServicesAdminNegativeV253TestJSON-323945417 tempest-ServicesAdminNegativeV253TestJSON-323945417-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:20.141983 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d80910d5-8360-4288-a456-e2691d38e753 tempest-ServicesAdminNegativeV253TestJSON-323945417 tempest-ServicesAdminNegativeV253TestJSON-323945417-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:20.142454 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d80910d5-8360-4288-a456-e2691d38e753 tempest-ServicesAdminNegativeV253TestJSON-323945417 tempest-ServicesAdminNegativeV253TestJSON-323945417-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:20.143203 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d80910d5-8360-4288-a456-e2691d38e753 tempest-ServicesAdminNegativeV253TestJSON-323945417 tempest-ServicesAdminNegativeV253TestJSON-323945417-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:20.143665 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d80910d5-8360-4288-a456-e2691d38e753 tempest-ServicesAdminNegativeV253TestJSON-323945417 tempest-ServicesAdminNegativeV253TestJSON-323945417-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:20.144092 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d80910d5-8360-4288-a456-e2691d38e753 tempest-ServicesAdminNegativeV253TestJSON-323945417 tempest-ServicesAdminNegativeV253TestJSON-323945417-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:20.169809 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-d80910d5-8360-4288-a456-e2691d38e753 tempest-ServicesAdminNegativeV253TestJSON-323945417 tempest-ServicesAdminNegativeV253TestJSON-323945417-project-admin] 10.222.0.43 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.037207 Oct 04 18:36:20.170360 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 622/1360] 10.222.0.43 () {60 vars in 1178 bytes} [Tue Oct 4 18:36:20 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:36:20.185788 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-8b8cbacf-a160-4384-85f6-009da3d9fbc0 tempest-ServicesAdminNegativeV253TestJSON-323945417 tempest-ServicesAdminNegativeV253TestJSON-323945417-project-admin] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:20.189475 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8b8cbacf-a160-4384-85f6-009da3d9fbc0 tempest-ServicesAdminNegativeV253TestJSON-323945417 tempest-ServicesAdminNegativeV253TestJSON-323945417-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:20.189968 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8b8cbacf-a160-4384-85f6-009da3d9fbc0 tempest-ServicesAdminNegativeV253TestJSON-323945417 tempest-ServicesAdminNegativeV253TestJSON-323945417-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:20.190538 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8b8cbacf-a160-4384-85f6-009da3d9fbc0 tempest-ServicesAdminNegativeV253TestJSON-323945417 tempest-ServicesAdminNegativeV253TestJSON-323945417-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:20.191255 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8b8cbacf-a160-4384-85f6-009da3d9fbc0 tempest-ServicesAdminNegativeV253TestJSON-323945417 tempest-ServicesAdminNegativeV253TestJSON-323945417-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:20.191811 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8b8cbacf-a160-4384-85f6-009da3d9fbc0 tempest-ServicesAdminNegativeV253TestJSON-323945417 tempest-ServicesAdminNegativeV253TestJSON-323945417-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:20.192299 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8b8cbacf-a160-4384-85f6-009da3d9fbc0 tempest-ServicesAdminNegativeV253TestJSON-323945417 tempest-ServicesAdminNegativeV253TestJSON-323945417-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:20.194912 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-91d394cb-40e4-4890-921e-4daaae8a697e tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64887fff0bc7417094c4fee2f7e9aa5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6187bfad04cb7bc17155862ee0cdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:20.205527 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-91d394cb-40e4-4890-921e-4daaae8a697e tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] 10.222.0.43 "GET /compute/v2.1/servers/63543ce9-528e-4064-a6cd-6dd249104468" status: 200 len: 1317 microversion: 2.1 time: 0.224181 Oct 04 18:36:20.207145 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 739/1361] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:19 2022] GET /compute/v2.1/servers/63543ce9-528e-4064-a6cd-6dd249104468 => generated 1317 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:20.219319 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-8b8cbacf-a160-4384-85f6-009da3d9fbc0 tempest-ServicesAdminNegativeV253TestJSON-323945417 tempest-ServicesAdminNegativeV253TestJSON-323945417-project-admin] 10.222.0.43 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.53 time: 0.039232 Oct 04 18:36:20.219937 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 623/1362] 10.222.0.43 () {60 vars in 1239 bytes} [Tue Oct 4 18:36:20 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:36:20.368660 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-3faf0c8e-7127-463c-9b1e-03ceb8da24ac tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:20.369207 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-3faf0c8e-7127-463c-9b1e-03ceb8da24ac tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] [instance: 4231fdff-39dd-49a6-bea2-5edea44c3582] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:20.382814 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-ab4999c1-14fb-4521-bdd8-57f33495e560 tempest-ServicesAdminNegativeV253TestJSON-1184577247 tempest-ServicesAdminNegativeV253TestJSON-1184577247-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:20.383499 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:36:20.387317 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3faf0c8e-7127-463c-9b1e-03ceb8da24ac tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:20.387617 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-ab4999c1-14fb-4521-bdd8-57f33495e560 tempest-ServicesAdminNegativeV253TestJSON-1184577247 tempest-ServicesAdminNegativeV253TestJSON-1184577247-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': 'b5af6748604a4343a303ee6beec7ff5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cc5fb6e34594e398d5b959e074a408f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:20.388755 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3faf0c8e-7127-463c-9b1e-03ceb8da24ac tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:20.389297 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-ab4999c1-14fb-4521-bdd8-57f33495e560 tempest-ServicesAdminNegativeV253TestJSON-1184577247 tempest-ServicesAdminNegativeV253TestJSON-1184577247-project] Request method failure captured: Oct 04 18:36:20.389297 n-d-851028-13 devstack@n-api.service[123596]: request: GET /compute/v2.1/os-services HTTP/1.1 Oct 04 18:36:20.389297 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:36:20.389297 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:36:20.389297 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:36:20.389297 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 18:36:20.389297 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:36:20.389297 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:36:20.389297 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:36:20.389297 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:36:20.389297 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPH0ixXbXwN8pWX8b_zq8PBw_jdziCLVYlkEipaJizYCmBkBjFezlACTtRP0DCUhwySje6pepNuetI8TJUsjTjHJ4_XJMTHXlozzXvgJJu15FGv3IVD_NZyhm-UGbN2PEdyqydn_3J82GYEtbR0TrS86q1KGTmMIErP3oUc2nUyREbzs Oct 04 18:36:20.389297 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:36:20.389297 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:36:20.389297 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:36:20.389297 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:36:20.389297 n-d-851028-13 devstack@n-api.service[123596]: X-Openstack-Nova-Api-Version: 2.53 Oct 04 18:36:20.389297 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:36:20.389297 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:36:20.389297 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: 8cc5fb6e34594e398d5b959e074a408f Oct 04 18:36:20.389297 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1184577247 Oct 04 18:36:20.389297 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 18:36:20.389297 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 18:36:20.389297 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/8cc5fb6e34594e398d5b959e074a408f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_8cc5fb6e34594e398d5b959e074a408f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8cc5fb6e34594e398d5b959e074a408f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8cc5fb6e34594e398d5b959e074a408f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:36:20.389297 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1184577247 Oct 04 18:36:20.389297 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: 8cc5fb6e34594e398d5b959e074a408f Oct 04 18:36:20.389297 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1184577247 Oct 04 18:36:20.389297 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1184577247-project Oct 04 18:36:20.389297 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:36:20.389297 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:36:20.389297 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: b5af6748604a4343a303ee6beec7ff5a Oct 04 18:36:20.389297 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1184577247-project Oct 04 18:36:20.389297 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 18:36:20.389297 n-d-851028-13 devstack@n-api.service[123596]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 04 18:36:20.389297 n-d-851028-13 devstack@n-api.service[123596]: action_args: {} Oct 04 18:36:20.389297 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:36:20.389297 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:36:20.389297 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:36:20.389297 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:36:20.389297 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:36:20.389297 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:36:20.389297 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 18:36:20.389297 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:36:20.389297 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 18:36:20.389297 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:36:20.389297 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:36:20.389297 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:36:20.389297 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Oct 04 18:36:20.389297 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Oct 04 18:36:20.389297 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 18:36:20.389297 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 18:36:20.389297 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 18:36:20.389297 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 18:36:20.389297 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:36:20.389297 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:36:20.389297 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:36:20.389297 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:36:20.389297 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 18:36:20.389297 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 18:36:20.389297 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 18:36:20.389297 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 18:36:20.389297 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 18:36:20.389297 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 18:36:20.389297 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 04 18:36:20.393592 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:36:20.393592 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:36:20.393592 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:36:20.393592 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:36:20.393592 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:36:20.393592 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:36:20.393592 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 18:36:20.393592 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 18:36:20.393592 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 04 18:36:20.393592 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:36:20.393592 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-ab4999c1-14fb-4521-bdd8-57f33495e560 tempest-ServicesAdminNegativeV253TestJSON-1184577247 tempest-ServicesAdminNegativeV253TestJSON-1184577247-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:36:20.393592 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-ab4999c1-14fb-4521-bdd8-57f33495e560 tempest-ServicesAdminNegativeV253TestJSON-1184577247 tempest-ServicesAdminNegativeV253TestJSON-1184577247-project] 10.222.0.43 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.156321 Oct 04 18:36:20.395694 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3faf0c8e-7127-463c-9b1e-03ceb8da24ac tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:20.396687 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3faf0c8e-7127-463c-9b1e-03ceb8da24ac tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:20.398628 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3faf0c8e-7127-463c-9b1e-03ceb8da24ac tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:20.399404 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3faf0c8e-7127-463c-9b1e-03ceb8da24ac tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:20.403125 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 740/1363] 10.222.0.43 () {60 vars in 1178 bytes} [Tue Oct 4 18:36:20 2022] GET /compute/v2.1/os-services => generated 112 bytes in 170 msecs (HTTP/1.1 403) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:36:20.480622 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-e4c3a6fb-9882-4320-a02e-3c1af9d87d37 req-c42c8127-fe90-4fe0-a8de-940f91745e8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63543ce9-528e-4064-a6cd-6dd249104468", "name": "network-vif-plugged", "status": "completed", "tag": "3cf62e8e-aadc-4bbd-97a3-8471a4356442"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:36:20.482261 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-3faf0c8e-7127-463c-9b1e-03ceb8da24ac tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8046c7965b473e9f7d31be9d6f6937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b194743a4124bdba97895542273859a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:20.493098 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-3faf0c8e-7127-463c-9b1e-03ceb8da24ac tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] 10.222.0.43 "GET /compute/v2.1/servers/4231fdff-39dd-49a6-bea2-5edea44c3582" status: 200 len: 1269 microversion: 2.1 time: 0.128794 Oct 04 18:36:20.494702 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 624/1364] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:20 2022] GET /compute/v2.1/servers/4231fdff-39dd-49a6-bea2-5edea44c3582 => generated 1269 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:20.497974 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-e4c3a6fb-9882-4320-a02e-3c1af9d87d37 req-c42c8127-fe90-4fe0-a8de-940f91745e8b service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:20.498469 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-e4c3a6fb-9882-4320-a02e-3c1af9d87d37 req-c42c8127-fe90-4fe0-a8de-940f91745e8b service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:20.499003 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-e4c3a6fb-9882-4320-a02e-3c1af9d87d37 req-c42c8127-fe90-4fe0-a8de-940f91745e8b service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:20.513272 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-e4c3a6fb-9882-4320-a02e-3c1af9d87d37 req-c42c8127-fe90-4fe0-a8de-940f91745e8b service nova] Creating event network-vif-plugged:3cf62e8e-aadc-4bbd-97a3-8471a4356442 for instance 63543ce9-528e-4064-a6cd-6dd249104468 on n-h1-851028-13 Oct 04 18:36:20.518588 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-e4c3a6fb-9882-4320-a02e-3c1af9d87d37 req-c42c8127-fe90-4fe0-a8de-940f91745e8b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044728 Oct 04 18:36:20.519405 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 741/1365] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:36:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:36:20.643621 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-811af449-37a9-43e7-9521-7e61303ef3c2 tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:20.644595 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-811af449-37a9-43e7-9521-7e61303ef3c2 tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] [instance: 7222a4ce-d2a2-4b09-afc6-55bca52414d4] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:20.652016 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-811af449-37a9-43e7-9521-7e61303ef3c2 tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:20.652707 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-811af449-37a9-43e7-9521-7e61303ef3c2 tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:20.653367 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-811af449-37a9-43e7-9521-7e61303ef3c2 tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:20.654267 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-811af449-37a9-43e7-9521-7e61303ef3c2 tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:20.654723 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-811af449-37a9-43e7-9521-7e61303ef3c2 tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:20.655447 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-811af449-37a9-43e7-9521-7e61303ef3c2 tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:20.803702 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.objects.instance [None req-811af449-37a9-43e7-9521-7e61303ef3c2 tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] Lazy-loading 'services' on Instance uuid 7222a4ce-d2a2-4b09-afc6-55bca52414d4 {{(pid=123595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:36:20.819237 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-811af449-37a9-43e7-9521-7e61303ef3c2 tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/7222a4ce-d2a2-4b09-afc6-55bca52414d4" status: 200 len: 2347 microversion: 2.25 time: 0.180029 Oct 04 18:36:20.820677 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 625/1366] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:36:20 2022] GET /compute/v2.1/servers/7222a4ce-d2a2-4b09-afc6-55bca52414d4 => generated 2347 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:36:20.860495 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-8d3f7e19-d8dd-4dc4-adbd-e0b525461ed2 tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:20.866090 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8d3f7e19-d8dd-4dc4-adbd-e0b525461ed2 tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:20.866927 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8d3f7e19-d8dd-4dc4-adbd-e0b525461ed2 tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:20.867548 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8d3f7e19-d8dd-4dc4-adbd-e0b525461ed2 tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:20.868524 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8d3f7e19-d8dd-4dc4-adbd-e0b525461ed2 tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:20.869795 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8d3f7e19-d8dd-4dc4-adbd-e0b525461ed2 tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:20.870493 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8d3f7e19-d8dd-4dc4-adbd-e0b525461ed2 tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:20.871761 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-c49ca7d2-3d20-4196-919b-ad860fb6ff0a tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:20.872432 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-c49ca7d2-3d20-4196-919b-ad860fb6ff0a tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: ce0d629a-068c-4a62-8a03-fc43fc0be9b3] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:20.878830 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c49ca7d2-3d20-4196-919b-ad860fb6ff0a tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:20.879600 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c49ca7d2-3d20-4196-919b-ad860fb6ff0a tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:20.880193 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c49ca7d2-3d20-4196-919b-ad860fb6ff0a tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:20.881356 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c49ca7d2-3d20-4196-919b-ad860fb6ff0a tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:20.882639 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c49ca7d2-3d20-4196-919b-ad860fb6ff0a tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:20.883260 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c49ca7d2-3d20-4196-919b-ad860fb6ff0a tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:20.908093 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:36:20.929653 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-8d3f7e19-d8dd-4dc4-adbd-e0b525461ed2 tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] 10.222.0.43 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.074445 Oct 04 18:36:20.931044 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 742/1367] 10.222.0.43 () {60 vars in 1217 bytes} [Tue Oct 4 18:36:20 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:36:20.944446 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-78af6521-eeac-4523-ac15-904396d8a147 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Calling method '.version_select at 0x7fb227eb1e50>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:21.020226 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-78af6521-eeac-4523-ac15-904396d8a147 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] 10.222.0.43 "GET /compute/v2.1/images/c7776971-442e-4bf2-8d58-f38b00ff4b4a" status: 200 len: 1437 microversion: 2.1 time: 0.086629 Oct 04 18:36:21.033213 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 743/1368] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 18:36:20 2022] GET /compute/v2.1/images/c7776971-442e-4bf2-8d58-f38b00ff4b4a => generated 1437 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:21.039991 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-6938711e-8a8f-4822-a289-81daabc443af tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:21.042110 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-6938711e-8a8f-4822-a289-81daabc443af tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] [instance: 67e13bce-be81-4775-be5f-737add9f1694] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:21.051026 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6938711e-8a8f-4822-a289-81daabc443af tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:21.052426 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6938711e-8a8f-4822-a289-81daabc443af tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:21.053180 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6938711e-8a8f-4822-a289-81daabc443af tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:21.054003 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6938711e-8a8f-4822-a289-81daabc443af tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:21.054755 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6938711e-8a8f-4822-a289-81daabc443af tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:21.055841 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6938711e-8a8f-4822-a289-81daabc443af tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:21.199653 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.objects.instance [None req-6938711e-8a8f-4822-a289-81daabc443af tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Lazy-loading 'services' on Instance uuid 67e13bce-be81-4775-be5f-737add9f1694 {{(pid=123596) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:36:21.222660 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-6938711e-8a8f-4822-a289-81daabc443af tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/67e13bce-be81-4775-be5f-737add9f1694" status: 200 len: 1929 microversion: 2.75 time: 0.188203 Oct 04 18:36:21.223528 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 744/1369] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:36:21 2022] GET /compute/v2.1/servers/67e13bce-be81-4775-be5f-737add9f1694 => generated 1929 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:36:21.248220 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-bd949634-fa44-42ed-9e07-493ed684acba tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:21.250135 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-bd949634-fa44-42ed-9e07-493ed684acba tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] [instance: 63543ce9-528e-4064-a6cd-6dd249104468] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:21.257641 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bd949634-fa44-42ed-9e07-493ed684acba tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:21.258361 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bd949634-fa44-42ed-9e07-493ed684acba tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:21.258990 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bd949634-fa44-42ed-9e07-493ed684acba tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:21.259878 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bd949634-fa44-42ed-9e07-493ed684acba tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:21.260506 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bd949634-fa44-42ed-9e07-493ed684acba tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:21.260945 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bd949634-fa44-42ed-9e07-493ed684acba tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:21.289860 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-c49ca7d2-3d20-4196-919b-ad860fb6ff0a tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:21.298377 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-c49ca7d2-3d20-4196-919b-ad860fb6ff0a tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/ce0d629a-068c-4a62-8a03-fc43fc0be9b3" status: 200 len: 1472 microversion: 2.1 time: 0.434418 Oct 04 18:36:21.299719 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 626/1370] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:20 2022] GET /compute/v2.1/servers/ce0d629a-068c-4a62-8a03-fc43fc0be9b3 => generated 1472 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:36:21.450523 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-bd949634-fa44-42ed-9e07-493ed684acba tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64887fff0bc7417094c4fee2f7e9aa5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6187bfad04cb7bc17155862ee0cdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:21.463599 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-bd949634-fa44-42ed-9e07-493ed684acba tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] 10.222.0.43 "GET /compute/v2.1/servers/63543ce9-528e-4064-a6cd-6dd249104468" status: 200 len: 1317 microversion: 2.1 time: 0.235092 Oct 04 18:36:21.465027 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 745/1371] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:21 2022] GET /compute/v2.1/servers/63543ce9-528e-4064-a6cd-6dd249104468 => generated 1317 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:21.520975 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-27dc313e-6bd6-44ca-9c1b-cf1ba600524b tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:21.521695 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-27dc313e-6bd6-44ca-9c1b-cf1ba600524b tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] [instance: 4231fdff-39dd-49a6-bea2-5edea44c3582] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:21.534421 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-27dc313e-6bd6-44ca-9c1b-cf1ba600524b tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:21.534941 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-27dc313e-6bd6-44ca-9c1b-cf1ba600524b tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:21.535540 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-27dc313e-6bd6-44ca-9c1b-cf1ba600524b tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:21.536401 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-27dc313e-6bd6-44ca-9c1b-cf1ba600524b tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:21.536708 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-27dc313e-6bd6-44ca-9c1b-cf1ba600524b tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:21.537373 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-27dc313e-6bd6-44ca-9c1b-cf1ba600524b tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:21.654209 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-27dc313e-6bd6-44ca-9c1b-cf1ba600524b tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8046c7965b473e9f7d31be9d6f6937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b194743a4124bdba97895542273859a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:21.677052 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-27dc313e-6bd6-44ca-9c1b-cf1ba600524b tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] 10.222.0.43 "GET /compute/v2.1/servers/4231fdff-39dd-49a6-bea2-5edea44c3582" status: 200 len: 1275 microversion: 2.1 time: 0.148937 Oct 04 18:36:21.679530 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 627/1372] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:21 2022] GET /compute/v2.1/servers/4231fdff-39dd-49a6-bea2-5edea44c3582 => generated 1275 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:22.037068 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-c8529343-bc8e-4e3d-b9c7-414896c04e1f tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Calling method '.version_select at 0x7fb227ed8d30>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:22.109008 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-c8529343-bc8e-4e3d-b9c7-414896c04e1f tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] 10.222.0.43 "GET /compute/v2.1/images/c7776971-442e-4bf2-8d58-f38b00ff4b4a" status: 200 len: 1437 microversion: 2.1 time: 0.075691 Oct 04 18:36:22.109829 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 746/1373] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 18:36:22 2022] GET /compute/v2.1/images/c7776971-442e-4bf2-8d58-f38b00ff4b4a => generated 1437 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:22.257359 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-dad88c05-7fd8-48b9-b908-a8e6ada37b23 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:22.258354 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-dad88c05-7fd8-48b9-b908-a8e6ada37b23 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] [instance: 67e13bce-be81-4775-be5f-737add9f1694] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:22.267491 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dad88c05-7fd8-48b9-b908-a8e6ada37b23 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:22.270341 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dad88c05-7fd8-48b9-b908-a8e6ada37b23 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:22.271121 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dad88c05-7fd8-48b9-b908-a8e6ada37b23 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:22.272071 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dad88c05-7fd8-48b9-b908-a8e6ada37b23 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:22.272716 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dad88c05-7fd8-48b9-b908-a8e6ada37b23 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:22.273168 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dad88c05-7fd8-48b9-b908-a8e6ada37b23 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:22.324899 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-1ce42ea8-db69-4068-97d4-10d2490955df tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:22.325844 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-1ce42ea8-db69-4068-97d4-10d2490955df tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: ce0d629a-068c-4a62-8a03-fc43fc0be9b3] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:22.357665 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1ce42ea8-db69-4068-97d4-10d2490955df tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:22.358762 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1ce42ea8-db69-4068-97d4-10d2490955df tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:22.363222 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1ce42ea8-db69-4068-97d4-10d2490955df tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:22.365295 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1ce42ea8-db69-4068-97d4-10d2490955df tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:22.370312 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1ce42ea8-db69-4068-97d4-10d2490955df tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:22.372414 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1ce42ea8-db69-4068-97d4-10d2490955df tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:22.412222 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.objects.instance [None req-dad88c05-7fd8-48b9-b908-a8e6ada37b23 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Lazy-loading 'services' on Instance uuid 67e13bce-be81-4775-be5f-737add9f1694 {{(pid=123595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:36:22.464701 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-dad88c05-7fd8-48b9-b908-a8e6ada37b23 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/67e13bce-be81-4775-be5f-737add9f1694" status: 200 len: 1929 microversion: 2.75 time: 0.212649 Oct 04 18:36:22.466344 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 628/1374] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:36:22 2022] GET /compute/v2.1/servers/67e13bce-be81-4775-be5f-737add9f1694 => generated 1929 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:36:22.487759 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-043710b7-452e-4e85-9052-6176656b09b7 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:22.489162 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-043710b7-452e-4e85-9052-6176656b09b7 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] [instance: 63543ce9-528e-4064-a6cd-6dd249104468] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:22.500970 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-043710b7-452e-4e85-9052-6176656b09b7 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:22.501844 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-043710b7-452e-4e85-9052-6176656b09b7 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:22.502290 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-043710b7-452e-4e85-9052-6176656b09b7 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:22.503035 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-043710b7-452e-4e85-9052-6176656b09b7 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:22.503441 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-043710b7-452e-4e85-9052-6176656b09b7 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:22.503952 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-043710b7-452e-4e85-9052-6176656b09b7 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:22.702589 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-1ce42ea8-db69-4068-97d4-10d2490955df tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:22.717438 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-1ce42ea8-db69-4068-97d4-10d2490955df tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/ce0d629a-068c-4a62-8a03-fc43fc0be9b3" status: 200 len: 1477 microversion: 2.1 time: 0.396054 Oct 04 18:36:22.718966 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 747/1375] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:22 2022] GET /compute/v2.1/servers/ce0d629a-068c-4a62-8a03-fc43fc0be9b3 => generated 1477 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:22.756990 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-c4eec171-fda4-446f-be36-c456d7de4997 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "36fe8524-c75a-41e5-8c52-89819bcd9c83", "device": "/dev/xvdb"}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:36:22.760465 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-c4eec171-fda4-446f-be36-c456d7de4997 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] [instance: 7222a4ce-d2a2-4b09-afc6-55bca52414d4] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:22.779270 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c4eec171-fda4-446f-be36-c456d7de4997 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:22.782917 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c4eec171-fda4-446f-be36-c456d7de4997 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:22.783695 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c4eec171-fda4-446f-be36-c456d7de4997 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:22.785520 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c4eec171-fda4-446f-be36-c456d7de4997 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:22.787949 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c4eec171-fda4-446f-be36-c456d7de4997 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:22.788295 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c4eec171-fda4-446f-be36-c456d7de4997 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:22.829758 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=28 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:36:22.855723 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-043710b7-452e-4e85-9052-6176656b09b7 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64887fff0bc7417094c4fee2f7e9aa5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6187bfad04cb7bc17155862ee0cdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:22.875381 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-043710b7-452e-4e85-9052-6176656b09b7 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] 10.222.0.43 "GET /compute/v2.1/servers/63543ce9-528e-4064-a6cd-6dd249104468" status: 200 len: 1317 microversion: 2.1 time: 0.391124 Oct 04 18:36:22.879957 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 629/1376] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:22 2022] GET /compute/v2.1/servers/63543ce9-528e-4064-a6cd-6dd249104468 => generated 1317 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:36:22.894718 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-fa860628-d568-4c07-87ad-015030032ec9 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:22.898537 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-fa860628-d568-4c07-87ad-015030032ec9 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] [instance: 4231fdff-39dd-49a6-bea2-5edea44c3582] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:22.914707 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fa860628-d568-4c07-87ad-015030032ec9 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:22.915474 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fa860628-d568-4c07-87ad-015030032ec9 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:22.916713 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fa860628-d568-4c07-87ad-015030032ec9 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:22.917708 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fa860628-d568-4c07-87ad-015030032ec9 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:22.918459 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fa860628-d568-4c07-87ad-015030032ec9 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:22.919167 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fa860628-d568-4c07-87ad-015030032ec9 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:23.294291 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-fa860628-d568-4c07-87ad-015030032ec9 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8046c7965b473e9f7d31be9d6f6937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b194743a4124bdba97895542273859a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:23.306340 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-fa860628-d568-4c07-87ad-015030032ec9 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] 10.222.0.43 "GET /compute/v2.1/servers/4231fdff-39dd-49a6-bea2-5edea44c3582" status: 200 len: 1317 microversion: 2.1 time: 0.424609 Oct 04 18:36:23.308459 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 630/1377] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:22 2022] GET /compute/v2.1/servers/4231fdff-39dd-49a6-bea2-5edea44c3582 => generated 1317 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:23.335580 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-e3cec6f7-d277-4600-986a-9928575d8f34 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Calling method '.version_select at 0x7fb21f8d3160>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:23.346511 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-c4eec171-fda4-446f-be36-c456d7de4997 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] 10.222.0.43 "POST /compute/v2.1/servers/7222a4ce-d2a2-4b09-afc6-55bca52414d4/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 0.609690 Oct 04 18:36:23.346895 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 748/1378] 10.222.0.43 () {62 vars in 1364 bytes} [Tue Oct 4 18:36:22 2022] POST /compute/v2.1/servers/7222a4ce-d2a2-4b09-afc6-55bca52414d4/os-volume_attachments => generated 194 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:36:23.412734 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-e3cec6f7-d277-4600-986a-9928575d8f34 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] 10.222.0.43 "GET /compute/v2.1/images/c7776971-442e-4bf2-8d58-f38b00ff4b4a" status: 200 len: 1437 microversion: 2.1 time: 0.102684 Oct 04 18:36:23.416638 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 631/1379] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 18:36:23 2022] GET /compute/v2.1/images/c7776971-442e-4bf2-8d58-f38b00ff4b4a => generated 1437 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:23.501539 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-9ce2a6f1-d71a-42b2-a622-251e9ab558c7 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:23.504539 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-9ce2a6f1-d71a-42b2-a622-251e9ab558c7 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] [instance: 67e13bce-be81-4775-be5f-737add9f1694] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:23.518254 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9ce2a6f1-d71a-42b2-a622-251e9ab558c7 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:23.520298 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9ce2a6f1-d71a-42b2-a622-251e9ab558c7 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:23.520988 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9ce2a6f1-d71a-42b2-a622-251e9ab558c7 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:23.522320 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9ce2a6f1-d71a-42b2-a622-251e9ab558c7 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:23.523562 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9ce2a6f1-d71a-42b2-a622-251e9ab558c7 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:23.525851 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9ce2a6f1-d71a-42b2-a622-251e9ab558c7 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:23.632438 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.objects.instance [None req-9ce2a6f1-d71a-42b2-a622-251e9ab558c7 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Lazy-loading 'services' on Instance uuid 67e13bce-be81-4775-be5f-737add9f1694 {{(pid=123596) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:36:23.653369 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-9ce2a6f1-d71a-42b2-a622-251e9ab558c7 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/67e13bce-be81-4775-be5f-737add9f1694" status: 200 len: 1929 microversion: 2.75 time: 0.161055 Oct 04 18:36:23.669778 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 749/1380] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:36:23 2022] GET /compute/v2.1/servers/67e13bce-be81-4775-be5f-737add9f1694 => generated 1929 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:36:23.753349 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-5ee20702-ee08-4011-ab5f-bc273fb7c15f tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:23.754049 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-5ee20702-ee08-4011-ab5f-bc273fb7c15f tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: ce0d629a-068c-4a62-8a03-fc43fc0be9b3] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:23.768964 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5ee20702-ee08-4011-ab5f-bc273fb7c15f tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:23.770312 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5ee20702-ee08-4011-ab5f-bc273fb7c15f tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:23.770817 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5ee20702-ee08-4011-ab5f-bc273fb7c15f tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:23.771740 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5ee20702-ee08-4011-ab5f-bc273fb7c15f tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:23.772368 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5ee20702-ee08-4011-ab5f-bc273fb7c15f tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:23.772967 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5ee20702-ee08-4011-ab5f-bc273fb7c15f tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:23.856152 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-c2e949b3-fc5d-4234-81b6-1687a89b1df3 req-2f4b478d-b47f-453b-8768-f16b976139af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4231fdff-39dd-49a6-bea2-5edea44c3582", "tag": "ee13bc47-8284-46ee-acc8-f29243243bf5"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:36:23.887366 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-c2e949b3-fc5d-4234-81b6-1687a89b1df3 req-2f4b478d-b47f-453b-8768-f16b976139af service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:23.887901 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-c2e949b3-fc5d-4234-81b6-1687a89b1df3 req-2f4b478d-b47f-453b-8768-f16b976139af service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:23.888353 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-c2e949b3-fc5d-4234-81b6-1687a89b1df3 req-2f4b478d-b47f-453b-8768-f16b976139af service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:23.907814 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-c2e949b3-fc5d-4234-81b6-1687a89b1df3 req-2f4b478d-b47f-453b-8768-f16b976139af service nova] Creating event network-changed:ee13bc47-8284-46ee-acc8-f29243243bf5 for instance 4231fdff-39dd-49a6-bea2-5edea44c3582 on n-h1-851028-13 Oct 04 18:36:23.916413 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-c2e949b3-fc5d-4234-81b6-1687a89b1df3 req-2f4b478d-b47f-453b-8768-f16b976139af service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072102 Oct 04 18:36:23.918480 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 750/1381] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:36:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:36:23.927450 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-9ad33b94-b66e-452d-a69a-100664254505 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:23.928785 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-9ad33b94-b66e-452d-a69a-100664254505 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] [instance: 63543ce9-528e-4064-a6cd-6dd249104468] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:23.937087 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9ad33b94-b66e-452d-a69a-100664254505 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:23.938070 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9ad33b94-b66e-452d-a69a-100664254505 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:23.938756 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9ad33b94-b66e-452d-a69a-100664254505 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:23.940034 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9ad33b94-b66e-452d-a69a-100664254505 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:23.940747 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9ad33b94-b66e-452d-a69a-100664254505 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:23.941446 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9ad33b94-b66e-452d-a69a-100664254505 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:24.252397 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-5ee20702-ee08-4011-ab5f-bc273fb7c15f tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:24.277750 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-5ee20702-ee08-4011-ab5f-bc273fb7c15f tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/ce0d629a-068c-4a62-8a03-fc43fc0be9b3" status: 200 len: 1477 microversion: 2.1 time: 0.524310 Oct 04 18:36:24.280884 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 632/1382] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:23 2022] GET /compute/v2.1/servers/ce0d629a-068c-4a62-8a03-fc43fc0be9b3 => generated 1477 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:24.300478 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-9ad33b94-b66e-452d-a69a-100664254505 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64887fff0bc7417094c4fee2f7e9aa5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6187bfad04cb7bc17155862ee0cdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:24.304978 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:36:24.310918 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-9ad33b94-b66e-452d-a69a-100664254505 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] 10.222.0.43 "GET /compute/v2.1/servers/63543ce9-528e-4064-a6cd-6dd249104468" status: 200 len: 1507 microversion: 2.1 time: 0.390986 Oct 04 18:36:24.311496 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 751/1383] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:23 2022] GET /compute/v2.1/servers/63543ce9-528e-4064-a6cd-6dd249104468 => generated 1507 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:24.340400 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-d2d84605-a604-4f15-8493-c4ecad7e6de9 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:24.341031 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-d2d84605-a604-4f15-8493-c4ecad7e6de9 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] [instance: 4231fdff-39dd-49a6-bea2-5edea44c3582] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:24.356763 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d2d84605-a604-4f15-8493-c4ecad7e6de9 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:24.357297 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d2d84605-a604-4f15-8493-c4ecad7e6de9 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:24.357747 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d2d84605-a604-4f15-8493-c4ecad7e6de9 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:24.361690 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d2d84605-a604-4f15-8493-c4ecad7e6de9 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:24.362160 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d2d84605-a604-4f15-8493-c4ecad7e6de9 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:24.362613 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d2d84605-a604-4f15-8493-c4ecad7e6de9 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:24.429664 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-71f8cb88-ed38-437d-b7db-74c6e2f5f487 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Calling method '.version_select at 0x7fb227e02790>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:24.510304 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-71f8cb88-ed38-437d-b7db-74c6e2f5f487 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] 10.222.0.43 "GET /compute/v2.1/images/c7776971-442e-4bf2-8d58-f38b00ff4b4a" status: 200 len: 1437 microversion: 2.1 time: 0.084248 Oct 04 18:36:24.510881 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 752/1384] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 18:36:24 2022] GET /compute/v2.1/images/c7776971-442e-4bf2-8d58-f38b00ff4b4a => generated 1437 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:36:24.687763 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-c5cb8f03-dc6d-4111-ae1a-b44088ae1438 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:24.688471 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-c5cb8f03-dc6d-4111-ae1a-b44088ae1438 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] [instance: 67e13bce-be81-4775-be5f-737add9f1694] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:24.700144 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c5cb8f03-dc6d-4111-ae1a-b44088ae1438 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:24.700654 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c5cb8f03-dc6d-4111-ae1a-b44088ae1438 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:24.701103 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c5cb8f03-dc6d-4111-ae1a-b44088ae1438 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:24.706054 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c5cb8f03-dc6d-4111-ae1a-b44088ae1438 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:24.716534 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c5cb8f03-dc6d-4111-ae1a-b44088ae1438 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:24.717969 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c5cb8f03-dc6d-4111-ae1a-b44088ae1438 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:24.813826 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-d2d84605-a604-4f15-8493-c4ecad7e6de9 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8046c7965b473e9f7d31be9d6f6937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b194743a4124bdba97895542273859a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:24.817222 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:36:24.836892 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-d2d84605-a604-4f15-8493-c4ecad7e6de9 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] 10.222.0.43 "GET /compute/v2.1/servers/4231fdff-39dd-49a6-bea2-5edea44c3582" status: 200 len: 1317 microversion: 2.1 time: 0.499573 Oct 04 18:36:24.847036 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 633/1385] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:24 2022] GET /compute/v2.1/servers/4231fdff-39dd-49a6-bea2-5edea44c3582 => generated 1317 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:24.966527 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.objects.instance [None req-c5cb8f03-dc6d-4111-ae1a-b44088ae1438 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Lazy-loading 'services' on Instance uuid 67e13bce-be81-4775-be5f-737add9f1694 {{(pid=123596) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:36:25.016793 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-c5cb8f03-dc6d-4111-ae1a-b44088ae1438 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/67e13bce-be81-4775-be5f-737add9f1694" status: 200 len: 1929 microversion: 2.75 time: 0.337124 Oct 04 18:36:25.018295 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 753/1386] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:36:24 2022] GET /compute/v2.1/servers/67e13bce-be81-4775-be5f-737add9f1694 => generated 1929 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:36:25.057538 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-8cd813e1-094a-4b32-be28-eac0c9f3bf8b req-8e6fe543-e56e-4345-88ac-f1960dadb3a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ee1bd28-0921-4444-afe3-c09cbfa0680a", "name": "network-vif-plugged", "status": "completed", "tag": "9b0949c2-7109-4d21-a62e-7d24d18a41c0"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:36:25.108070 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-8cd813e1-094a-4b32-be28-eac0c9f3bf8b req-8e6fe543-e56e-4345-88ac-f1960dadb3a0 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:25.110813 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-8cd813e1-094a-4b32-be28-eac0c9f3bf8b req-8e6fe543-e56e-4345-88ac-f1960dadb3a0 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:25.114993 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-8cd813e1-094a-4b32-be28-eac0c9f3bf8b req-8e6fe543-e56e-4345-88ac-f1960dadb3a0 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:25.155416 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-8cd813e1-094a-4b32-be28-eac0c9f3bf8b req-8e6fe543-e56e-4345-88ac-f1960dadb3a0 service nova] Creating event network-vif-plugged:9b0949c2-7109-4d21-a62e-7d24d18a41c0 for instance 9ee1bd28-0921-4444-afe3-c09cbfa0680a on n-h2-851028-13 Oct 04 18:36:25.185752 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-8cd813e1-094a-4b32-be28-eac0c9f3bf8b req-8e6fe543-e56e-4345-88ac-f1960dadb3a0 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.143483 Oct 04 18:36:25.186402 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 634/1387] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:36:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:36:25.305923 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-73996b21-fec7-4886-b28e-a44a931c86ac tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:25.306714 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-73996b21-fec7-4886-b28e-a44a931c86ac tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: ce0d629a-068c-4a62-8a03-fc43fc0be9b3] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:25.316290 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-73996b21-fec7-4886-b28e-a44a931c86ac tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:25.317289 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-73996b21-fec7-4886-b28e-a44a931c86ac tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:25.318081 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-73996b21-fec7-4886-b28e-a44a931c86ac tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:25.319063 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-73996b21-fec7-4886-b28e-a44a931c86ac tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:25.319746 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-73996b21-fec7-4886-b28e-a44a931c86ac tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:25.320436 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-73996b21-fec7-4886-b28e-a44a931c86ac tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:25.346543 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-8df82409-e99e-46c4-88a8-eee1784fe277 tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:25.351956 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-8df82409-e99e-46c4-88a8-eee1784fe277 tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cf77a83227f0404da7792695463b6714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc10a840253410ab9404ff4906eebc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:25.356636 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-8df82409-e99e-46c4-88a8-eee1784fe277 tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] Searching by: {'deleted': False, 'project_id': 'bdc10a840253410ab9404ff4906eebc8'} {{(pid=123595) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:36:25.371805 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8df82409-e99e-46c4-88a8-eee1784fe277 tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:25.372439 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8df82409-e99e-46c4-88a8-eee1784fe277 tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:25.373155 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8df82409-e99e-46c4-88a8-eee1784fe277 tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:25.374641 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8df82409-e99e-46c4-88a8-eee1784fe277 tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:25.377488 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8df82409-e99e-46c4-88a8-eee1784fe277 tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:25.378183 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8df82409-e99e-46c4-88a8-eee1784fe277 tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:25.439866 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.multi_cell_list [None req-8df82409-e99e-46c4-88a8-eee1784fe277 tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=123595) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 18:36:25.496906 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-8df82409-e99e-46c4-88a8-eee1784fe277 tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] 10.222.0.43 "GET /compute/v2.1/servers" status: 200 len: 339 microversion: 2.1 time: 0.166424 Oct 04 18:36:25.497749 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 635/1388] 10.222.0.43 () {58 vars in 1125 bytes} [Tue Oct 4 18:36:25 2022] GET /compute/v2.1/servers => generated 339 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:36:25.521997 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-28a75bbc-38b6-4277-8721-555cc56c0f58 tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:25.530143 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-28a75bbc-38b6-4277-8721-555cc56c0f58 tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cf77a83227f0404da7792695463b6714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc10a840253410ab9404ff4906eebc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:25.530949 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-28a75bbc-38b6-4277-8721-555cc56c0f58 tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] Searching by: {'deleted': False, 'project_id': 'bdc10a840253410ab9404ff4906eebc8'} {{(pid=123595) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:36:25.546187 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-28a75bbc-38b6-4277-8721-555cc56c0f58 tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:25.547509 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-28a75bbc-38b6-4277-8721-555cc56c0f58 tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:25.547657 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-28a75bbc-38b6-4277-8721-555cc56c0f58 tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:25.548346 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-28a75bbc-38b6-4277-8721-555cc56c0f58 tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:25.548804 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-28a75bbc-38b6-4277-8721-555cc56c0f58 tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:25.549277 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-28a75bbc-38b6-4277-8721-555cc56c0f58 tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:25.602490 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-73996b21-fec7-4886-b28e-a44a931c86ac tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:25.622406 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-73996b21-fec7-4886-b28e-a44a931c86ac tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/ce0d629a-068c-4a62-8a03-fc43fc0be9b3" status: 200 len: 1477 microversion: 2.1 time: 0.312173 Oct 04 18:36:25.624075 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 754/1389] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:25 2022] GET /compute/v2.1/servers/ce0d629a-068c-4a62-8a03-fc43fc0be9b3 => generated 1477 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:36:25.629491 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-d77cf075-abb3-4dd2-8567-063359f6f8ab tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Calling method '.version_select at 0x7fb227cf34c0>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:25.713599 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-d77cf075-abb3-4dd2-8567-063359f6f8ab tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] 10.222.0.43 "GET /compute/v2.1/images/c7776971-442e-4bf2-8d58-f38b00ff4b4a" status: 200 len: 1437 microversion: 2.1 time: 0.080516 Oct 04 18:36:25.714351 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.multi_cell_list [None req-28a75bbc-38b6-4277-8721-555cc56c0f58 tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=123595) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 18:36:25.715228 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 755/1390] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 18:36:25 2022] GET /compute/v2.1/images/c7776971-442e-4bf2-8d58-f38b00ff4b4a => generated 1437 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:25.875408 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-28a75bbc-38b6-4277-8721-555cc56c0f58 tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf77a83227f0404da7792695463b6714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc10a840253410ab9404ff4906eebc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:25.887770 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-28a75bbc-38b6-4277-8721-555cc56c0f58 tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:25.888517 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-28a75bbc-38b6-4277-8721-555cc56c0f58 tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:25.889316 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-28a75bbc-38b6-4277-8721-555cc56c0f58 tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:25.965865 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-ba7c9e8d-4243-4652-9a7f-c7f2388bab74 tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-2014768779", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452"}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:36:26.047654 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.network.neutron [None req-ba7c9e8d-4243-4652-9a7f-c7f2388bab74 tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] validate_networks() for None {{(pid=123596) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:36:26.125022 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-28a75bbc-38b6-4277-8721-555cc56c0f58 tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] 10.222.0.43 "GET /compute/v2.1/servers/detail" status: 200 len: 1713 microversion: 2.1 time: 0.613991 Oct 04 18:36:26.126267 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 636/1391] 10.222.0.43 () {58 vars in 1146 bytes} [Tue Oct 4 18:36:25 2022] GET /compute/v2.1/servers/detail => generated 1713 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:26.146214 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-742facc4-fd72-431e-8de5-b74df3288761 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:26.147133 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-742facc4-fd72-431e-8de5-b74df3288761 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] [instance: 4231fdff-39dd-49a6-bea2-5edea44c3582] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:26.159776 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-742facc4-fd72-431e-8de5-b74df3288761 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:26.160420 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-742facc4-fd72-431e-8de5-b74df3288761 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:26.160982 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-742facc4-fd72-431e-8de5-b74df3288761 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:26.161810 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-742facc4-fd72-431e-8de5-b74df3288761 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:26.162365 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-742facc4-fd72-431e-8de5-b74df3288761 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:26.162895 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-742facc4-fd72-431e-8de5-b74df3288761 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:26.419517 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-ba7c9e8d-4243-4652-9a7f-c7f2388bab74 tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] Flavor limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:36:26.420233 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-ba7c9e8d-4243-4652-9a7f-c7f2388bab74 tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] Image limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:36:26.421187 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-ba7c9e8d-4243-4652-9a7f-c7f2388bab74 tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] Flavor pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:36:26.422717 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-ba7c9e8d-4243-4652-9a7f-c7f2388bab74 tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] Image pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:36:26.423329 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-ba7c9e8d-4243-4652-9a7f-c7f2388bab74 tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:36:26.456326 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ba7c9e8d-4243-4652-9a7f-c7f2388bab74 tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:26.462148 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ba7c9e8d-4243-4652-9a7f-c7f2388bab74 tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:26.463841 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ba7c9e8d-4243-4652-9a7f-c7f2388bab74 tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:26.464691 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ba7c9e8d-4243-4652-9a7f-c7f2388bab74 tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:26.465183 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ba7c9e8d-4243-4652-9a7f-c7f2388bab74 tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:26.465632 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ba7c9e8d-4243-4652-9a7f-c7f2388bab74 tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:26.514902 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-ba7c9e8d-4243-4652-9a7f-c7f2388bab74 tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] Getting quotas for project 4a71c255d30a42e785c18fc1ce2208bf. Resources: {'ram', 'cores', 'instances'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:36:26.520478 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-ba7c9e8d-4243-4652-9a7f-c7f2388bab74 tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] Getting quotas for user 013cb5ed545e4aa29e25e8a6af35db7f and project 4a71c255d30a42e785c18fc1ce2208bf. Resources: {'ram', 'cores', 'instances'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:36:26.541726 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-ba7c9e8d-4243-4652-9a7f-c7f2388bab74 tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] Going to run 1 instances... {{(pid=123596) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:36:26.544957 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-ba7c9e8d-4243-4652-9a7f-c7f2388bab74 tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] [instance: 1f956517-1701-4171-9227-03726c7e8fca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e8943ec5-4038-4d4b-b9b9-2415a79f5243',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123596) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:36:26.623336 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-ba7c9e8d-4243-4652-9a7f-c7f2388bab74 tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.906792 Oct 04 18:36:26.624516 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 756/1392] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 18:36:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 908 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:36:26.631936 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-7b6689ad-77f9-4c6a-a51b-7f78443a8734 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:26.632571 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-7b6689ad-77f9-4c6a-a51b-7f78443a8734 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] [instance: 67e13bce-be81-4775-be5f-737add9f1694] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:26.669140 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7b6689ad-77f9-4c6a-a51b-7f78443a8734 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:26.669140 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7b6689ad-77f9-4c6a-a51b-7f78443a8734 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:26.669140 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7b6689ad-77f9-4c6a-a51b-7f78443a8734 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:26.673727 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7b6689ad-77f9-4c6a-a51b-7f78443a8734 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:26.673961 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7b6689ad-77f9-4c6a-a51b-7f78443a8734 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:26.674459 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7b6689ad-77f9-4c6a-a51b-7f78443a8734 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:26.723357 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-742facc4-fd72-431e-8de5-b74df3288761 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8046c7965b473e9f7d31be9d6f6937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b194743a4124bdba97895542273859a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:26.737524 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-742facc4-fd72-431e-8de5-b74df3288761 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] 10.222.0.43 "GET /compute/v2.1/servers/4231fdff-39dd-49a6-bea2-5edea44c3582" status: 200 len: 1317 microversion: 2.1 time: 0.610051 Oct 04 18:36:26.738172 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 637/1393] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:26 2022] GET /compute/v2.1/servers/4231fdff-39dd-49a6-bea2-5edea44c3582 => generated 1317 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:26.763776 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-a607d924-ac35-4e89-9d4e-acffb989557e tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:26.775878 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.objects.instance [None req-7b6689ad-77f9-4c6a-a51b-7f78443a8734 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Lazy-loading 'services' on Instance uuid 67e13bce-be81-4775-be5f-737add9f1694 {{(pid=123596) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:36:26.782260 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-a607d924-ac35-4e89-9d4e-acffb989557e tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] 10.222.0.43 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.043005 Oct 04 18:36:26.784986 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 638/1394] 10.222.0.43 () {58 vars in 1137 bytes} [Tue Oct 4 18:36:26 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:36:26.797895 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-1b4283a2-2299-44a1-93a9-6ee64f7e7c9b tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:26.798528 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-1b4283a2-2299-44a1-93a9-6ee64f7e7c9b tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] [instance: 1f956517-1701-4171-9227-03726c7e8fca] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:26.800559 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-7b6689ad-77f9-4c6a-a51b-7f78443a8734 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/67e13bce-be81-4775-be5f-737add9f1694" status: 200 len: 1929 microversion: 2.75 time: 0.174792 Oct 04 18:36:26.812926 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 757/1395] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:36:26 2022] GET /compute/v2.1/servers/67e13bce-be81-4775-be5f-737add9f1694 => generated 1929 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:36:26.830765 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-2addbdc8-8583-4d38-a9e4-19c3714952e6 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:26.831546 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-2addbdc8-8583-4d38-a9e4-19c3714952e6 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: ce0d629a-068c-4a62-8a03-fc43fc0be9b3] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:26.838368 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2addbdc8-8583-4d38-a9e4-19c3714952e6 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:26.841713 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2addbdc8-8583-4d38-a9e4-19c3714952e6 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:26.842324 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2addbdc8-8583-4d38-a9e4-19c3714952e6 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:26.843166 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2addbdc8-8583-4d38-a9e4-19c3714952e6 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:26.843904 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2addbdc8-8583-4d38-a9e4-19c3714952e6 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:26.844473 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2addbdc8-8583-4d38-a9e4-19c3714952e6 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:26.966493 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-1b4283a2-2299-44a1-93a9-6ee64f7e7c9b tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013cb5ed545e4aa29e25e8a6af35db7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a71c255d30a42e785c18fc1ce2208bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:26.973908 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-1b4283a2-2299-44a1-93a9-6ee64f7e7c9b tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] 10.222.0.43 "GET /compute/v2.1/servers/1f956517-1701-4171-9227-03726c7e8fca" status: 200 len: 1214 microversion: 2.1 time: 0.186404 Oct 04 18:36:26.983145 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 639/1396] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:26 2022] GET /compute/v2.1/servers/1f956517-1701-4171-9227-03726c7e8fca => generated 1214 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:26.987843 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-b9aefa03-0cdc-48cc-87fd-891f4f3f6c46 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Calling method '.version_select at 0x7fb21f99d3a0>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:27.078377 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-b9aefa03-0cdc-48cc-87fd-891f4f3f6c46 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] 10.222.0.43 "GET /compute/v2.1/images/c7776971-442e-4bf2-8d58-f38b00ff4b4a" status: 200 len: 1437 microversion: 2.1 time: 0.094035 Oct 04 18:36:27.079230 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 640/1397] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 18:36:26 2022] GET /compute/v2.1/images/c7776971-442e-4bf2-8d58-f38b00ff4b4a => generated 1437 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:27.093523 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-2addbdc8-8583-4d38-a9e4-19c3714952e6 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:27.111574 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-66c0894c-9b0a-4b67-b15a-967df6c26c5c tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:27.112509 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-66c0894c-9b0a-4b67-b15a-967df6c26c5c tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] [instance: 37823428-1dab-4b0a-9ea1-7232766fc9b7] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:27.122726 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-66c0894c-9b0a-4b67-b15a-967df6c26c5c tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:27.125744 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-66c0894c-9b0a-4b67-b15a-967df6c26c5c tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:27.126363 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-66c0894c-9b0a-4b67-b15a-967df6c26c5c tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:27.127280 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-66c0894c-9b0a-4b67-b15a-967df6c26c5c tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:27.129726 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-66c0894c-9b0a-4b67-b15a-967df6c26c5c tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:27.130371 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-66c0894c-9b0a-4b67-b15a-967df6c26c5c tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:27.141563 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-2addbdc8-8583-4d38-a9e4-19c3714952e6 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/ce0d629a-068c-4a62-8a03-fc43fc0be9b3" status: 200 len: 1477 microversion: 2.1 time: 0.321698 Oct 04 18:36:27.142227 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 758/1398] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:26 2022] GET /compute/v2.1/servers/ce0d629a-068c-4a62-8a03-fc43fc0be9b3 => generated 1477 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:27.203805 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-66c0894c-9b0a-4b67-b15a-967df6c26c5c tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] [instance: 37823428-1dab-4b0a-9ea1-7232766fc9b7] Going to try to terminate instance {{(pid=123595) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:36:27.398050 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-66c0894c-9b0a-4b67-b15a-967df6c26c5c tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] 10.222.0.43 "DELETE /compute/v2.1/servers/37823428-1dab-4b0a-9ea1-7232766fc9b7" status: 204 len: 0 microversion: 2.1 time: 0.291353 Oct 04 18:36:27.403494 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 641/1399] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 18:36:27 2022] DELETE /compute/v2.1/servers/37823428-1dab-4b0a-9ea1-7232766fc9b7 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 18:36:27.411561 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-0344d5a8-1c9f-400f-9786-ae8bf8d070cc tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:27.412155 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-0344d5a8-1c9f-400f-9786-ae8bf8d070cc tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] [instance: 37823428-1dab-4b0a-9ea1-7232766fc9b7] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:27.442833 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0344d5a8-1c9f-400f-9786-ae8bf8d070cc tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:27.444613 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0344d5a8-1c9f-400f-9786-ae8bf8d070cc tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:27.446135 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0344d5a8-1c9f-400f-9786-ae8bf8d070cc tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:27.448657 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0344d5a8-1c9f-400f-9786-ae8bf8d070cc tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:27.450340 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0344d5a8-1c9f-400f-9786-ae8bf8d070cc tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:27.452391 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0344d5a8-1c9f-400f-9786-ae8bf8d070cc tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:27.536536 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-03f8953c-e5f7-4e04-8088-92727783296b tempest-VolumesAdminNegativeTest-1009225662 tempest-VolumesAdminNegativeTest-1009225662-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "0687046f-2514-4138-afdd-e8d6f73d607b"}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:36:27.543109 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-03f8953c-e5f7-4e04-8088-92727783296b tempest-VolumesAdminNegativeTest-1009225662 tempest-VolumesAdminNegativeTest-1009225662-project-admin] [instance: 63543ce9-528e-4064-a6cd-6dd249104468] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:27.562811 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-03f8953c-e5f7-4e04-8088-92727783296b tempest-VolumesAdminNegativeTest-1009225662 tempest-VolumesAdminNegativeTest-1009225662-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:27.563587 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-03f8953c-e5f7-4e04-8088-92727783296b tempest-VolumesAdminNegativeTest-1009225662 tempest-VolumesAdminNegativeTest-1009225662-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:27.564362 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-03f8953c-e5f7-4e04-8088-92727783296b tempest-VolumesAdminNegativeTest-1009225662 tempest-VolumesAdminNegativeTest-1009225662-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:27.565281 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-03f8953c-e5f7-4e04-8088-92727783296b tempest-VolumesAdminNegativeTest-1009225662 tempest-VolumesAdminNegativeTest-1009225662-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:27.565898 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-03f8953c-e5f7-4e04-8088-92727783296b tempest-VolumesAdminNegativeTest-1009225662 tempest-VolumesAdminNegativeTest-1009225662-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:27.566735 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-03f8953c-e5f7-4e04-8088-92727783296b tempest-VolumesAdminNegativeTest-1009225662 tempest-VolumesAdminNegativeTest-1009225662-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:27.687043 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-03f8953c-e5f7-4e04-8088-92727783296b tempest-VolumesAdminNegativeTest-1009225662 tempest-VolumesAdminNegativeTest-1009225662-project-admin] HTTP exception thrown: Volume 5b67ff5a-598d-4b06-b185-ed1ac8d54b60 could not be found. Oct 04 18:36:27.689494 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-03f8953c-e5f7-4e04-8088-92727783296b tempest-VolumesAdminNegativeTest-1009225662 tempest-VolumesAdminNegativeTest-1009225662-project-admin] Request method failure captured: Oct 04 18:36:27.689494 n-d-851028-13 devstack@n-api.service[123595]: request: PUT /compute/v2.1/servers/63543ce9-528e-4064-a6cd-6dd249104468/os-volume_attachments/5b67ff5a-598d-4b06-b185-ed1ac8d54b60 HTTP/1.1 Oct 04 18:36:27.689494 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 18:36:27.689494 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 18:36:27.689494 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 18:36:27.689494 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 74 Oct 04 18:36:27.689494 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 18:36:27.689494 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 18:36:27.689494 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 18:36:27.689494 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 18:36:27.689494 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPHyfPbuDF9LIAjbzyfEhAMuPE0cbL6FyLTwkF5q-vvHk2E4hM3ofpANJUlMAEEz4hkTMIE9u9hat7JfSLcVi_piqJrrLvGAHGhAMw4zXqKKGrTjv-BfZRGdXAIFvlfWPY3dTjo3hHRjMaZKnqNRbClpTkf-E8Bg61jMdszvxkcg-NkM Oct 04 18:36:27.689494 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 18:36:27.689494 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 18:36:27.689494 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 18:36:27.689494 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 18:36:27.689494 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 18:36:27.689494 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 18:36:27.689494 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: 7bc988ff61624763a15c6e9f2d471e9b Oct 04 18:36:27.689494 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-VolumesAdminNegativeTest-1009225662 Oct 04 18:36:27.689494 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,admin,reader Oct 04 18:36:27.689494 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,admin,reader Oct 04 18:36:27.689494 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/7bc988ff61624763a15c6e9f2d471e9b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_7bc988ff61624763a15c6e9f2d471e9b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/7bc988ff61624763a15c6e9f2d471e9b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/7bc988ff61624763a15c6e9f2d471e9b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:36:27.689494 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-VolumesAdminNegativeTest-1009225662 Oct 04 18:36:27.689494 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: 7bc988ff61624763a15c6e9f2d471e9b Oct 04 18:36:27.689494 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1009225662 Oct 04 18:36:27.689494 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-VolumesAdminNegativeTest-1009225662-project-admin Oct 04 18:36:27.689494 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 18:36:27.689494 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 18:36:27.689494 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: f97c6c93fca44dfc8d889f5eb3a632c7 Oct 04 18:36:27.689494 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-VolumesAdminNegativeTest-1009225662-project-admin Oct 04 18:36:27.689494 n-d-851028-13 devstack@n-api.service[123595]: Oct 04 18:36:27.689494 n-d-851028-13 devstack@n-api.service[123595]: {"volumeAttachment": {"volumeId": "0687046f-2514-4138-afdd-e8d6f73d607b"}} Oct 04 18:36:27.689494 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 18:36:27.689494 n-d-851028-13 devstack@n-api.service[123595]: exception: Volume 5b67ff5a-598d-4b06-b185-ed1ac8d54b60 could not be found. Oct 04 18:36:27.689494 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'server_id': '63543ce9-528e-4064-a6cd-6dd249104468', 'id': '5b67ff5a-598d-4b06-b185-ed1ac8d54b60', 'body': {'volumeAttachment': {'volumeId': '0687046f-2514-4138-afdd-e8d6f73d607b'}}} Oct 04 18:36:27.689494 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:36:27.689494 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:36:27.689494 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 18:36:27.689494 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 18:36:27.689494 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 18:36:27.689494 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 18:36:27.689494 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 18:36:27.689494 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 18:36:27.689494 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 18:36:27.689494 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 18:36:27.689494 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 18:36:27.689494 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 18:36:27.689494 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 18:36:27.689494 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 18:36:27.689494 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 18:36:27.689494 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 18:36:27.689494 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5b67ff5a-598d-4b06-b185-ed1ac8d54b60 could not be found. (HTTP 404) (Request-ID: req-c81c50de-940e-4bd7-82f5-b3e99ddec8e4) Oct 04 18:36:27.689494 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:36:27.689494 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:36:27.689494 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:36:27.689494 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:36:27.689494 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Oct 04 18:36:27.689494 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Oct 04 18:36:27.689494 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 04 18:36:27.689494 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 04 18:36:27.689494 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 04 18:36:27.694426 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 04 18:36:27.694426 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 04 18:36:27.694426 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 04 18:36:27.694426 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 18:36:27.694426 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 18:36:27.694426 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 18:36:27.694426 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 18:36:27.694426 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 18:36:27.694426 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 18:36:27.694426 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 18:36:27.694426 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 18:36:27.694426 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 18:36:27.694426 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 18:36:27.694426 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 18:36:27.694426 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 18:36:27.694426 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 18:36:27.694426 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 18:36:27.694426 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5b67ff5a-598d-4b06-b185-ed1ac8d54b60 could not be found. Oct 04 18:36:27.694426 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:36:27.694426 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:36:27.694426 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:36:27.694426 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:36:27.694426 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:36:27.694426 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:36:27.694426 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:36:27.694426 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:36:27.694426 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:36:27.694426 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:36:27.694426 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:36:27.694426 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:36:27.694426 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:36:27.694426 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:36:27.694426 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Oct 04 18:36:27.694426 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Oct 04 18:36:27.694426 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Oct 04 18:36:27.694426 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:36:27.694426 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5b67ff5a-598d-4b06-b185-ed1ac8d54b60 could not be found. Oct 04 18:36:27.694426 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:36:27.694426 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:36:27.694426 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:36:27.694426 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:36:27.694426 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:36:27.694426 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:36:27.694426 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:36:27.694426 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:36:27.694426 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5b67ff5a-598d-4b06-b185-ed1ac8d54b60 could not be found. Oct 04 18:36:27.694426 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:36:27.694426 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-03f8953c-e5f7-4e04-8088-92727783296b tempest-VolumesAdminNegativeTest-1009225662 tempest-VolumesAdminNegativeTest-1009225662-project-admin] Returning 404 to user: Volume 5b67ff5a-598d-4b06-b185-ed1ac8d54b60 could not be found. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:36:27.694426 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-03f8953c-e5f7-4e04-8088-92727783296b tempest-VolumesAdminNegativeTest-1009225662 tempest-VolumesAdminNegativeTest-1009225662-project-admin] 10.222.0.43 "PUT /compute/v2.1/servers/63543ce9-528e-4064-a6cd-6dd249104468/os-volume_attachments/5b67ff5a-598d-4b06-b185-ed1ac8d54b60" status: 404 len: 109 microversion: 2.1 time: 0.160149 Oct 04 18:36:27.698182 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 642/1400] 10.222.0.43 () {60 vars in 1433 bytes} [Tue Oct 4 18:36:27 2022] PUT /compute/v2.1/servers/63543ce9-528e-4064-a6cd-6dd249104468/os-volume_attachments/5b67ff5a-598d-4b06-b185-ed1ac8d54b60 => generated 109 bytes in 167 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:36:27.710081 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-0344d5a8-1c9f-400f-9786-ae8bf8d070cc tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf77a83227f0404da7792695463b6714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc10a840253410ab9404ff4906eebc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:27.719443 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-0344d5a8-1c9f-400f-9786-ae8bf8d070cc tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] 10.222.0.43 "GET /compute/v2.1/servers/37823428-1dab-4b0a-9ea1-7232766fc9b7" status: 200 len: 1716 microversion: 2.1 time: 0.313944 Oct 04 18:36:27.733141 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 759/1401] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:27 2022] GET /compute/v2.1/servers/37823428-1dab-4b0a-9ea1-7232766fc9b7 => generated 1716 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:36:27.763298 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-b7de0283-4634-4bb3-977f-cf6a9474bc36 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:27.767261 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-b7de0283-4634-4bb3-977f-cf6a9474bc36 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] [instance: 4231fdff-39dd-49a6-bea2-5edea44c3582] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:27.776256 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b7de0283-4634-4bb3-977f-cf6a9474bc36 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:27.776756 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b7de0283-4634-4bb3-977f-cf6a9474bc36 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:27.777235 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b7de0283-4634-4bb3-977f-cf6a9474bc36 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:27.777953 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b7de0283-4634-4bb3-977f-cf6a9474bc36 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:27.778466 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b7de0283-4634-4bb3-977f-cf6a9474bc36 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:27.778910 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b7de0283-4634-4bb3-977f-cf6a9474bc36 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:27.836746 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-2d15ac95-d35a-48e3-ab1e-3b17aba5671e tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:27.838526 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-2d15ac95-d35a-48e3-ab1e-3b17aba5671e tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] [instance: 67e13bce-be81-4775-be5f-737add9f1694] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:27.863642 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2d15ac95-d35a-48e3-ab1e-3b17aba5671e tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:27.864347 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2d15ac95-d35a-48e3-ab1e-3b17aba5671e tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:27.864988 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2d15ac95-d35a-48e3-ab1e-3b17aba5671e tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:27.865929 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2d15ac95-d35a-48e3-ab1e-3b17aba5671e tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:27.867489 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2d15ac95-d35a-48e3-ab1e-3b17aba5671e tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:27.870836 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2d15ac95-d35a-48e3-ab1e-3b17aba5671e tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:28.066556 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.objects.instance [None req-2d15ac95-d35a-48e3-ab1e-3b17aba5671e tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Lazy-loading 'services' on Instance uuid 67e13bce-be81-4775-be5f-737add9f1694 {{(pid=123596) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:36:28.090357 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-b7de0283-4634-4bb3-977f-cf6a9474bc36 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8046c7965b473e9f7d31be9d6f6937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b194743a4124bdba97895542273859a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:28.091747 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-2d15ac95-d35a-48e3-ab1e-3b17aba5671e tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/67e13bce-be81-4775-be5f-737add9f1694" status: 200 len: 1929 microversion: 2.75 time: 0.259261 Oct 04 18:36:28.092984 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 760/1402] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:36:27 2022] GET /compute/v2.1/servers/67e13bce-be81-4775-be5f-737add9f1694 => generated 1929 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:36:28.099588 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-b7de0283-4634-4bb3-977f-cf6a9474bc36 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] 10.222.0.43 "GET /compute/v2.1/servers/4231fdff-39dd-49a6-bea2-5edea44c3582" status: 200 len: 1317 microversion: 2.1 time: 0.340765 Oct 04 18:36:28.100164 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 643/1403] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:27 2022] GET /compute/v2.1/servers/4231fdff-39dd-49a6-bea2-5edea44c3582 => generated 1317 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:28.107060 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-7d73c705-39fb-4446-af35-f8810d1ca81c tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Calling method '.version_select at 0x7fb21f8345e0>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:28.122230 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-9d8593ce-a202-42d0-a81f-0ec14aaa091f tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:28.122885 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-9d8593ce-a202-42d0-a81f-0ec14aaa091f tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] [instance: 1f956517-1701-4171-9227-03726c7e8fca] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:28.134431 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9d8593ce-a202-42d0-a81f-0ec14aaa091f tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:28.134931 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9d8593ce-a202-42d0-a81f-0ec14aaa091f tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:28.135375 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9d8593ce-a202-42d0-a81f-0ec14aaa091f tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:28.136091 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9d8593ce-a202-42d0-a81f-0ec14aaa091f tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:28.136550 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9d8593ce-a202-42d0-a81f-0ec14aaa091f tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:28.137148 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9d8593ce-a202-42d0-a81f-0ec14aaa091f tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:28.196726 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-7d73c705-39fb-4446-af35-f8810d1ca81c tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] 10.222.0.43 "GET /compute/v2.1/images/c7776971-442e-4bf2-8d58-f38b00ff4b4a" status: 200 len: 1437 microversion: 2.1 time: 0.093048 Oct 04 18:36:28.197367 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 644/1404] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 18:36:28 2022] GET /compute/v2.1/images/c7776971-442e-4bf2-8d58-f38b00ff4b4a => generated 1437 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:28.211367 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-8bef80d7-6afb-4301-ad90-d9efdbb37a66 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:28.213058 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-8bef80d7-6afb-4301-ad90-d9efdbb37a66 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: ce0d629a-068c-4a62-8a03-fc43fc0be9b3] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:28.221328 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8bef80d7-6afb-4301-ad90-d9efdbb37a66 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:28.221739 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8bef80d7-6afb-4301-ad90-d9efdbb37a66 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:28.222193 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8bef80d7-6afb-4301-ad90-d9efdbb37a66 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:28.222906 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8bef80d7-6afb-4301-ad90-d9efdbb37a66 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:28.223360 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8bef80d7-6afb-4301-ad90-d9efdbb37a66 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:28.223788 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8bef80d7-6afb-4301-ad90-d9efdbb37a66 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:28.293315 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-9d8593ce-a202-42d0-a81f-0ec14aaa091f tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013cb5ed545e4aa29e25e8a6af35db7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a71c255d30a42e785c18fc1ce2208bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:28.336792 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-9d8593ce-a202-42d0-a81f-0ec14aaa091f tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] 10.222.0.43 "GET /compute/v2.1/servers/1f956517-1701-4171-9227-03726c7e8fca" status: 200 len: 1266 microversion: 2.1 time: 0.241545 Oct 04 18:36:28.339445 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 761/1405] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:28 2022] GET /compute/v2.1/servers/1f956517-1701-4171-9227-03726c7e8fca => generated 1266 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:28.518349 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-8bef80d7-6afb-4301-ad90-d9efdbb37a66 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:28.528445 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-8bef80d7-6afb-4301-ad90-d9efdbb37a66 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/ce0d629a-068c-4a62-8a03-fc43fc0be9b3" status: 200 len: 1477 microversion: 2.1 time: 0.329978 Oct 04 18:36:28.533389 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 645/1406] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:28 2022] GET /compute/v2.1/servers/ce0d629a-068c-4a62-8a03-fc43fc0be9b3 => generated 1477 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:28.744397 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-6527a418-2b90-4566-bd91-8ff172030dc2 tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:28.745629 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-6527a418-2b90-4566-bd91-8ff172030dc2 tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] [instance: 37823428-1dab-4b0a-9ea1-7232766fc9b7] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:28.752565 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6527a418-2b90-4566-bd91-8ff172030dc2 tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:28.753296 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6527a418-2b90-4566-bd91-8ff172030dc2 tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:28.753943 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6527a418-2b90-4566-bd91-8ff172030dc2 tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:28.755524 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6527a418-2b90-4566-bd91-8ff172030dc2 tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:28.756154 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6527a418-2b90-4566-bd91-8ff172030dc2 tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:28.756757 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6527a418-2b90-4566-bd91-8ff172030dc2 tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:28.982779 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-6527a418-2b90-4566-bd91-8ff172030dc2 tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf77a83227f0404da7792695463b6714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc10a840253410ab9404ff4906eebc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:28.995766 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-6527a418-2b90-4566-bd91-8ff172030dc2 tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] 10.222.0.43 "GET /compute/v2.1/servers/37823428-1dab-4b0a-9ea1-7232766fc9b7" status: 200 len: 1716 microversion: 2.1 time: 0.255636 Oct 04 18:36:29.009147 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 762/1407] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:28 2022] GET /compute/v2.1/servers/37823428-1dab-4b0a-9ea1-7232766fc9b7 => generated 1716 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:29.130473 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-530e17b3-43ba-4881-8e88-79b2dfe544d3 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:29.131635 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-9c1f3852-c2c7-4b86-8e78-2cae5a3b5c98 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:29.132360 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-9c1f3852-c2c7-4b86-8e78-2cae5a3b5c98 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] [instance: 4231fdff-39dd-49a6-bea2-5edea44c3582] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:29.132715 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-530e17b3-43ba-4881-8e88-79b2dfe544d3 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] [instance: 67e13bce-be81-4775-be5f-737add9f1694] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:29.151372 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9c1f3852-c2c7-4b86-8e78-2cae5a3b5c98 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:29.152632 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-530e17b3-43ba-4881-8e88-79b2dfe544d3 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:29.154639 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9c1f3852-c2c7-4b86-8e78-2cae5a3b5c98 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:29.155270 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-530e17b3-43ba-4881-8e88-79b2dfe544d3 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:29.155823 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9c1f3852-c2c7-4b86-8e78-2cae5a3b5c98 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:29.156767 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-530e17b3-43ba-4881-8e88-79b2dfe544d3 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:29.157643 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9c1f3852-c2c7-4b86-8e78-2cae5a3b5c98 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:29.158465 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-530e17b3-43ba-4881-8e88-79b2dfe544d3 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:29.160818 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9c1f3852-c2c7-4b86-8e78-2cae5a3b5c98 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:29.161508 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-530e17b3-43ba-4881-8e88-79b2dfe544d3 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:29.162066 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-530e17b3-43ba-4881-8e88-79b2dfe544d3 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:29.162604 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9c1f3852-c2c7-4b86-8e78-2cae5a3b5c98 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:29.373739 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.objects.instance [None req-530e17b3-43ba-4881-8e88-79b2dfe544d3 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Lazy-loading 'services' on Instance uuid 67e13bce-be81-4775-be5f-737add9f1694 {{(pid=123595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:36:29.420941 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-530e17b3-43ba-4881-8e88-79b2dfe544d3 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/67e13bce-be81-4775-be5f-737add9f1694" status: 200 len: 1929 microversion: 2.75 time: 0.300224 Oct 04 18:36:29.422102 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 646/1408] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:36:29 2022] GET /compute/v2.1/servers/67e13bce-be81-4775-be5f-737add9f1694 => generated 1929 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:36:29.430499 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-8963de92-aefc-4df7-9cb4-a5550d34bf56 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Calling method '.version_select at 0x7fb21f9a29d0>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:29.528768 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-8963de92-aefc-4df7-9cb4-a5550d34bf56 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] 10.222.0.43 "GET /compute/v2.1/images/c7776971-442e-4bf2-8d58-f38b00ff4b4a" status: 200 len: 1437 microversion: 2.1 time: 0.104640 Oct 04 18:36:29.533197 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 647/1409] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 18:36:29 2022] GET /compute/v2.1/images/c7776971-442e-4bf2-8d58-f38b00ff4b4a => generated 1437 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:29.556446 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-0a1b415f-f9e1-424e-8437-9c24f48621cd tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:29.562555 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-0a1b415f-f9e1-424e-8437-9c24f48621cd tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] [instance: 1f956517-1701-4171-9227-03726c7e8fca] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:29.579101 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0a1b415f-f9e1-424e-8437-9c24f48621cd tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:29.579608 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0a1b415f-f9e1-424e-8437-9c24f48621cd tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:29.580055 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0a1b415f-f9e1-424e-8437-9c24f48621cd tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:29.580779 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0a1b415f-f9e1-424e-8437-9c24f48621cd tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:29.581272 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0a1b415f-f9e1-424e-8437-9c24f48621cd tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:29.581706 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0a1b415f-f9e1-424e-8437-9c24f48621cd tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:29.657632 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-9c1f3852-c2c7-4b86-8e78-2cae5a3b5c98 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8046c7965b473e9f7d31be9d6f6937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b194743a4124bdba97895542273859a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:29.671424 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-9c1f3852-c2c7-4b86-8e78-2cae5a3b5c98 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] 10.222.0.43 "GET /compute/v2.1/servers/4231fdff-39dd-49a6-bea2-5edea44c3582" status: 200 len: 1317 microversion: 2.1 time: 0.544509 Oct 04 18:36:29.672093 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 763/1410] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:29 2022] GET /compute/v2.1/servers/4231fdff-39dd-49a6-bea2-5edea44c3582 => generated 1317 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:29.687755 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-687926e2-9c65-4a28-bd97-096e30dba8da tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:29.689403 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-687926e2-9c65-4a28-bd97-096e30dba8da tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: ce0d629a-068c-4a62-8a03-fc43fc0be9b3] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:29.706782 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-687926e2-9c65-4a28-bd97-096e30dba8da tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:29.707299 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-687926e2-9c65-4a28-bd97-096e30dba8da tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:29.709512 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-687926e2-9c65-4a28-bd97-096e30dba8da tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:29.711024 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-687926e2-9c65-4a28-bd97-096e30dba8da tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:29.712961 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-687926e2-9c65-4a28-bd97-096e30dba8da tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:29.713656 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-687926e2-9c65-4a28-bd97-096e30dba8da tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:30.009947 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-687926e2-9c65-4a28-bd97-096e30dba8da tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:30.026577 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-687926e2-9c65-4a28-bd97-096e30dba8da tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/ce0d629a-068c-4a62-8a03-fc43fc0be9b3" status: 200 len: 1477 microversion: 2.1 time: 0.352240 Oct 04 18:36:30.029099 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 764/1411] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:29 2022] GET /compute/v2.1/servers/ce0d629a-068c-4a62-8a03-fc43fc0be9b3 => generated 1477 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:30.054789 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-31a099b5-b773-49a0-8443-92434b76a112 tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:30.055629 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-31a099b5-b773-49a0-8443-92434b76a112 tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] [instance: 37823428-1dab-4b0a-9ea1-7232766fc9b7] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:30.066213 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-31a099b5-b773-49a0-8443-92434b76a112 tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:30.068181 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-31a099b5-b773-49a0-8443-92434b76a112 tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:30.068652 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-31a099b5-b773-49a0-8443-92434b76a112 tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:30.071102 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-31a099b5-b773-49a0-8443-92434b76a112 tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:30.071641 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-31a099b5-b773-49a0-8443-92434b76a112 tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:30.073729 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-31a099b5-b773-49a0-8443-92434b76a112 tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:30.401374 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-0a1b415f-f9e1-424e-8437-9c24f48621cd tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013cb5ed545e4aa29e25e8a6af35db7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a71c255d30a42e785c18fc1ce2208bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:30.415764 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-0a1b415f-f9e1-424e-8437-9c24f48621cd tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] 10.222.0.43 "GET /compute/v2.1/servers/1f956517-1701-4171-9227-03726c7e8fca" status: 200 len: 1272 microversion: 2.1 time: 0.879518 Oct 04 18:36:30.416386 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 648/1412] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:29 2022] GET /compute/v2.1/servers/1f956517-1701-4171-9227-03726c7e8fca => generated 1272 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:30.465673 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-322766fc-11cd-4358-857a-22786cc95f49 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:30.467986 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-322766fc-11cd-4358-857a-22786cc95f49 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] [instance: 67e13bce-be81-4775-be5f-737add9f1694] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:30.489854 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-322766fc-11cd-4358-857a-22786cc95f49 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:30.490842 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-322766fc-11cd-4358-857a-22786cc95f49 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:30.492383 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-322766fc-11cd-4358-857a-22786cc95f49 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:30.493709 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-322766fc-11cd-4358-857a-22786cc95f49 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:30.498340 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-322766fc-11cd-4358-857a-22786cc95f49 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:30.498798 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-322766fc-11cd-4358-857a-22786cc95f49 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:30.725208 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.objects.instance [None req-322766fc-11cd-4358-857a-22786cc95f49 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Lazy-loading 'services' on Instance uuid 67e13bce-be81-4775-be5f-737add9f1694 {{(pid=123595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:36:30.777436 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-322766fc-11cd-4358-857a-22786cc95f49 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/67e13bce-be81-4775-be5f-737add9f1694" status: 200 len: 1929 microversion: 2.75 time: 0.323368 Oct 04 18:36:30.795278 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 649/1413] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:36:30 2022] GET /compute/v2.1/servers/67e13bce-be81-4775-be5f-737add9f1694 => generated 1929 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:36:30.821145 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-ff5f94b2-aade-442c-8e65-81f6c6a9c7e3 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Calling method '.version_select at 0x7fb21f8d31f0>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:30.917998 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-ff5f94b2-aade-442c-8e65-81f6c6a9c7e3 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] 10.222.0.43 "GET /compute/v2.1/images/c7776971-442e-4bf2-8d58-f38b00ff4b4a" status: 200 len: 1437 microversion: 2.1 time: 0.119698 Oct 04 18:36:30.918788 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 650/1414] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 18:36:30 2022] GET /compute/v2.1/images/c7776971-442e-4bf2-8d58-f38b00ff4b4a => generated 1437 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:30.936343 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-be1d025d-032e-4661-a989-76562c08fece req-258f0e63-0f5a-4e1a-b81b-3dbc41d87b3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4231fdff-39dd-49a6-bea2-5edea44c3582", "name": "network-vif-plugged", "status": "completed", "tag": "ee13bc47-8284-46ee-acc8-f29243243bf5"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:36:30.960867 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-be1d025d-032e-4661-a989-76562c08fece req-258f0e63-0f5a-4e1a-b81b-3dbc41d87b3c service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:30.962655 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-be1d025d-032e-4661-a989-76562c08fece req-258f0e63-0f5a-4e1a-b81b-3dbc41d87b3c service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:30.963363 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-be1d025d-032e-4661-a989-76562c08fece req-258f0e63-0f5a-4e1a-b81b-3dbc41d87b3c service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:31.009825 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-be1d025d-032e-4661-a989-76562c08fece req-258f0e63-0f5a-4e1a-b81b-3dbc41d87b3c service nova] Creating event network-vif-plugged:ee13bc47-8284-46ee-acc8-f29243243bf5 for instance 4231fdff-39dd-49a6-bea2-5edea44c3582 on n-h1-851028-13 Oct 04 18:36:31.009825 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-be1d025d-032e-4661-a989-76562c08fece req-258f0e63-0f5a-4e1a-b81b-3dbc41d87b3c service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065653 Oct 04 18:36:31.009825 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 651/1415] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:36:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:36:31.009825 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-0ea0e522-5e86-4631-a6ca-800c6b2ed8f8 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:31.009825 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-0ea0e522-5e86-4631-a6ca-800c6b2ed8f8 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] [instance: 4231fdff-39dd-49a6-bea2-5edea44c3582] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:31.015081 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0ea0e522-5e86-4631-a6ca-800c6b2ed8f8 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:31.015081 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0ea0e522-5e86-4631-a6ca-800c6b2ed8f8 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:31.015081 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0ea0e522-5e86-4631-a6ca-800c6b2ed8f8 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:31.015081 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0ea0e522-5e86-4631-a6ca-800c6b2ed8f8 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:31.015081 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0ea0e522-5e86-4631-a6ca-800c6b2ed8f8 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:31.034071 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0ea0e522-5e86-4631-a6ca-800c6b2ed8f8 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:31.160170 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-31a099b5-b773-49a0-8443-92434b76a112 tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf77a83227f0404da7792695463b6714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc10a840253410ab9404ff4906eebc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:31.172435 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-31a099b5-b773-49a0-8443-92434b76a112 tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] 10.222.0.43 "GET /compute/v2.1/servers/37823428-1dab-4b0a-9ea1-7232766fc9b7" status: 200 len: 1716 microversion: 2.1 time: 1.140574 Oct 04 18:36:31.173350 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 765/1416] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:30 2022] GET /compute/v2.1/servers/37823428-1dab-4b0a-9ea1-7232766fc9b7 => generated 1716 bytes in 1144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:31.180585 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-3f71b35c-eae8-4e4b-82f6-e02d4e32df4f tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:31.182043 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-3f71b35c-eae8-4e4b-82f6-e02d4e32df4f tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: ce0d629a-068c-4a62-8a03-fc43fc0be9b3] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:31.188290 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3f71b35c-eae8-4e4b-82f6-e02d4e32df4f tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:31.192780 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3f71b35c-eae8-4e4b-82f6-e02d4e32df4f tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:31.193741 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3f71b35c-eae8-4e4b-82f6-e02d4e32df4f tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:31.194672 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3f71b35c-eae8-4e4b-82f6-e02d4e32df4f tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:31.201719 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3f71b35c-eae8-4e4b-82f6-e02d4e32df4f tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:31.202280 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3f71b35c-eae8-4e4b-82f6-e02d4e32df4f tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:31.388661 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-0ea0e522-5e86-4631-a6ca-800c6b2ed8f8 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8046c7965b473e9f7d31be9d6f6937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b194743a4124bdba97895542273859a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:31.402669 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-0ea0e522-5e86-4631-a6ca-800c6b2ed8f8 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] 10.222.0.43 "GET /compute/v2.1/servers/4231fdff-39dd-49a6-bea2-5edea44c3582" status: 200 len: 1317 microversion: 2.1 time: 0.405986 Oct 04 18:36:31.403312 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 652/1417] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:30 2022] GET /compute/v2.1/servers/4231fdff-39dd-49a6-bea2-5edea44c3582 => generated 1317 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:31.451786 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-ba808f3e-0da9-419c-ba5a-40d679405c2d tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:31.452416 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-ba808f3e-0da9-419c-ba5a-40d679405c2d tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] [instance: 1f956517-1701-4171-9227-03726c7e8fca] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:31.477024 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ba808f3e-0da9-419c-ba5a-40d679405c2d tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:31.485401 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ba808f3e-0da9-419c-ba5a-40d679405c2d tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:31.485934 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ba808f3e-0da9-419c-ba5a-40d679405c2d tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:31.486680 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ba808f3e-0da9-419c-ba5a-40d679405c2d tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:31.487339 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ba808f3e-0da9-419c-ba5a-40d679405c2d tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:31.487570 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ba808f3e-0da9-419c-ba5a-40d679405c2d tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:31.735848 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-ba808f3e-0da9-419c-ba5a-40d679405c2d tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013cb5ed545e4aa29e25e8a6af35db7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a71c255d30a42e785c18fc1ce2208bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:31.747299 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-ba808f3e-0da9-419c-ba5a-40d679405c2d tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] 10.222.0.43 "GET /compute/v2.1/servers/1f956517-1701-4171-9227-03726c7e8fca" status: 200 len: 1272 microversion: 2.1 time: 0.310634 Oct 04 18:36:31.753221 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 653/1418] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:31 2022] GET /compute/v2.1/servers/1f956517-1701-4171-9227-03726c7e8fca => generated 1272 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:36:31.810445 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-5cddc95b-ad05-425a-aac4-427774d98a35 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:31.811070 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-5cddc95b-ad05-425a-aac4-427774d98a35 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] [instance: 67e13bce-be81-4775-be5f-737add9f1694] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:31.825534 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5cddc95b-ad05-425a-aac4-427774d98a35 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:31.834590 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5cddc95b-ad05-425a-aac4-427774d98a35 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:31.835169 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5cddc95b-ad05-425a-aac4-427774d98a35 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:31.841490 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5cddc95b-ad05-425a-aac4-427774d98a35 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:31.842256 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5cddc95b-ad05-425a-aac4-427774d98a35 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:31.843378 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5cddc95b-ad05-425a-aac4-427774d98a35 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:31.939514 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-3f71b35c-eae8-4e4b-82f6-e02d4e32df4f tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:31.952270 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-3f71b35c-eae8-4e4b-82f6-e02d4e32df4f tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/ce0d629a-068c-4a62-8a03-fc43fc0be9b3" status: 200 len: 1477 microversion: 2.1 time: 0.777143 Oct 04 18:36:31.953490 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 766/1419] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:31 2022] GET /compute/v2.1/servers/ce0d629a-068c-4a62-8a03-fc43fc0be9b3 => generated 1477 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:31.966897 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-08b8d15f-ab7c-4b93-8af2-899e38eaa575 req-ce785f91-345b-461e-89dc-4df85cbdd31b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37823428-1dab-4b0a-9ea1-7232766fc9b7", "name": "network-vif-deleted", "tag": "f96938f2-b281-4c53-8ec7-b2b1a3999f07"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:36:31.997214 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-08b8d15f-ab7c-4b93-8af2-899e38eaa575 req-ce785f91-345b-461e-89dc-4df85cbdd31b service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:31.998215 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-08b8d15f-ab7c-4b93-8af2-899e38eaa575 req-ce785f91-345b-461e-89dc-4df85cbdd31b service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:31.999117 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-08b8d15f-ab7c-4b93-8af2-899e38eaa575 req-ce785f91-345b-461e-89dc-4df85cbdd31b service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:32.032843 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-08b8d15f-ab7c-4b93-8af2-899e38eaa575 req-ce785f91-345b-461e-89dc-4df85cbdd31b service nova] Creating event network-vif-deleted:f96938f2-b281-4c53-8ec7-b2b1a3999f07 for instance 37823428-1dab-4b0a-9ea1-7232766fc9b7 on n-h2-851028-13 Oct 04 18:36:32.053556 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:36:32.063283 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-08b8d15f-ab7c-4b93-8af2-899e38eaa575 req-ce785f91-345b-461e-89dc-4df85cbdd31b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102327 Oct 04 18:36:32.068712 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 767/1420] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:36:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:36:32.072460 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.objects.instance [None req-5cddc95b-ad05-425a-aac4-427774d98a35 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Lazy-loading 'services' on Instance uuid 67e13bce-be81-4775-be5f-737add9f1694 {{(pid=123595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:36:32.075154 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-14b706f9-fb3d-45f7-8364-912ce21c1e2b tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Calling method '.version_select at 0x7fb227ed8280>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:32.136583 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-14b706f9-fb3d-45f7-8364-912ce21c1e2b tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] 10.222.0.43 "GET /compute/v2.1/images/c7776971-442e-4bf2-8d58-f38b00ff4b4a" status: 200 len: 1437 microversion: 2.1 time: 0.066296 Oct 04 18:36:32.173294 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 768/1421] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 18:36:32 2022] GET /compute/v2.1/images/c7776971-442e-4bf2-8d58-f38b00ff4b4a => generated 1437 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:32.175718 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-5cddc95b-ad05-425a-aac4-427774d98a35 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/67e13bce-be81-4775-be5f-737add9f1694" status: 200 len: 1929 microversion: 2.75 time: 0.371885 Oct 04 18:36:32.176493 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 654/1422] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:36:31 2022] GET /compute/v2.1/servers/67e13bce-be81-4775-be5f-737add9f1694 => generated 1929 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:36:32.201458 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f474b675-84a3-4ad6-a6b4-9e05def366df tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:32.202200 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-f474b675-84a3-4ad6-a6b4-9e05def366df tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] [instance: 37823428-1dab-4b0a-9ea1-7232766fc9b7] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:32.220565 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f474b675-84a3-4ad6-a6b4-9e05def366df tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:32.225852 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f474b675-84a3-4ad6-a6b4-9e05def366df tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:32.229682 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f474b675-84a3-4ad6-a6b4-9e05def366df tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:32.232913 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f474b675-84a3-4ad6-a6b4-9e05def366df tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:32.233989 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f474b675-84a3-4ad6-a6b4-9e05def366df tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:32.235026 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f474b675-84a3-4ad6-a6b4-9e05def366df tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:32.360342 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f474b675-84a3-4ad6-a6b4-9e05def366df tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:32.361417 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f474b675-84a3-4ad6-a6b4-9e05def366df tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:32.362432 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f474b675-84a3-4ad6-a6b4-9e05def366df tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:32.363514 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.objects.instance [None req-f474b675-84a3-4ad6-a6b4-9e05def366df tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] Lazy-loading 'fault' on Instance uuid 37823428-1dab-4b0a-9ea1-7232766fc9b7 {{(pid=123596) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:36:32.436976 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-0a2ba5fa-d6f1-499f-9c32-cde6a6eb53c2 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:32.437746 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-0a2ba5fa-d6f1-499f-9c32-cde6a6eb53c2 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] [instance: 4231fdff-39dd-49a6-bea2-5edea44c3582] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:32.469248 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-f474b675-84a3-4ad6-a6b4-9e05def366df tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf77a83227f0404da7792695463b6714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc10a840253410ab9404ff4906eebc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:32.485358 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-f474b675-84a3-4ad6-a6b4-9e05def366df tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] 10.222.0.43 "GET /compute/v2.1/servers/37823428-1dab-4b0a-9ea1-7232766fc9b7" status: 200 len: 1367 microversion: 2.1 time: 0.287586 Oct 04 18:36:32.488291 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 769/1423] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:32 2022] GET /compute/v2.1/servers/37823428-1dab-4b0a-9ea1-7232766fc9b7 => generated 1367 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:32.497953 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0a2ba5fa-d6f1-499f-9c32-cde6a6eb53c2 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:32.498479 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0a2ba5fa-d6f1-499f-9c32-cde6a6eb53c2 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:32.498937 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0a2ba5fa-d6f1-499f-9c32-cde6a6eb53c2 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:32.499683 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0a2ba5fa-d6f1-499f-9c32-cde6a6eb53c2 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:32.500148 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0a2ba5fa-d6f1-499f-9c32-cde6a6eb53c2 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:32.500583 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0a2ba5fa-d6f1-499f-9c32-cde6a6eb53c2 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:32.557009 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-1e61e06f-aedb-499a-8404-bb21ad4d7ea9 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:32.557889 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-1e61e06f-aedb-499a-8404-bb21ad4d7ea9 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] [instance: 63543ce9-528e-4064-a6cd-6dd249104468] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:32.586378 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1e61e06f-aedb-499a-8404-bb21ad4d7ea9 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:32.591211 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1e61e06f-aedb-499a-8404-bb21ad4d7ea9 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:32.591934 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1e61e06f-aedb-499a-8404-bb21ad4d7ea9 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:32.593052 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1e61e06f-aedb-499a-8404-bb21ad4d7ea9 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:32.595834 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1e61e06f-aedb-499a-8404-bb21ad4d7ea9 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:32.598123 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1e61e06f-aedb-499a-8404-bb21ad4d7ea9 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:32.662724 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-1e61e06f-aedb-499a-8404-bb21ad4d7ea9 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] [instance: 63543ce9-528e-4064-a6cd-6dd249104468] Going to try to terminate instance {{(pid=123596) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:36:32.729417 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=100 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:36:32.792896 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-0a2ba5fa-d6f1-499f-9c32-cde6a6eb53c2 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8046c7965b473e9f7d31be9d6f6937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b194743a4124bdba97895542273859a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:32.808851 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-0a2ba5fa-d6f1-499f-9c32-cde6a6eb53c2 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] 10.222.0.43 "GET /compute/v2.1/servers/4231fdff-39dd-49a6-bea2-5edea44c3582" status: 200 len: 1317 microversion: 2.1 time: 0.373409 Oct 04 18:36:32.809760 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 655/1424] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:32 2022] GET /compute/v2.1/servers/4231fdff-39dd-49a6-bea2-5edea44c3582 => generated 1317 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:32.818916 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-b68b1e1b-f35b-4bb5-9c40-ecafc0ec8330 tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:32.819808 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-b68b1e1b-f35b-4bb5-9c40-ecafc0ec8330 tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] [instance: 1f956517-1701-4171-9227-03726c7e8fca] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:32.827786 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b68b1e1b-f35b-4bb5-9c40-ecafc0ec8330 tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:32.828701 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b68b1e1b-f35b-4bb5-9c40-ecafc0ec8330 tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:32.829464 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b68b1e1b-f35b-4bb5-9c40-ecafc0ec8330 tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:32.830373 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b68b1e1b-f35b-4bb5-9c40-ecafc0ec8330 tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:32.831025 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b68b1e1b-f35b-4bb5-9c40-ecafc0ec8330 tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:32.832299 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b68b1e1b-f35b-4bb5-9c40-ecafc0ec8330 tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:32.869846 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-1e61e06f-aedb-499a-8404-bb21ad4d7ea9 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] 10.222.0.43 "DELETE /compute/v2.1/servers/63543ce9-528e-4064-a6cd-6dd249104468" status: 204 len: 0 microversion: 2.1 time: 0.314468 Oct 04 18:36:32.873853 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 770/1425] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 18:36:32 2022] DELETE /compute/v2.1/servers/63543ce9-528e-4064-a6cd-6dd249104468 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 18:36:32.892298 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-ed3aca5f-3af8-4180-aeaf-137a5b9d8677 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:32.893030 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-ed3aca5f-3af8-4180-aeaf-137a5b9d8677 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] [instance: 63543ce9-528e-4064-a6cd-6dd249104468] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:32.944887 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ed3aca5f-3af8-4180-aeaf-137a5b9d8677 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:32.945426 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ed3aca5f-3af8-4180-aeaf-137a5b9d8677 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:32.949658 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ed3aca5f-3af8-4180-aeaf-137a5b9d8677 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:32.956589 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ed3aca5f-3af8-4180-aeaf-137a5b9d8677 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:32.960216 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ed3aca5f-3af8-4180-aeaf-137a5b9d8677 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:32.961663 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ed3aca5f-3af8-4180-aeaf-137a5b9d8677 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:33.381332 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-ed3aca5f-3af8-4180-aeaf-137a5b9d8677 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64887fff0bc7417094c4fee2f7e9aa5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6187bfad04cb7bc17155862ee0cdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:33.384703 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-b68b1e1b-f35b-4bb5-9c40-ecafc0ec8330 tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013cb5ed545e4aa29e25e8a6af35db7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a71c255d30a42e785c18fc1ce2208bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:33.395803 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-b68b1e1b-f35b-4bb5-9c40-ecafc0ec8330 tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] 10.222.0.43 "GET /compute/v2.1/servers/1f956517-1701-4171-9227-03726c7e8fca" status: 200 len: 1314 microversion: 2.1 time: 0.583671 Oct 04 18:36:33.401049 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-ed3aca5f-3af8-4180-aeaf-137a5b9d8677 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] 10.222.0.43 "GET /compute/v2.1/servers/63543ce9-528e-4064-a6cd-6dd249104468" status: 200 len: 1513 microversion: 2.1 time: 0.522238 Oct 04 18:36:33.419457 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 771/1426] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:32 2022] GET /compute/v2.1/servers/63543ce9-528e-4064-a6cd-6dd249104468 => generated 1513 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:33.419967 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 656/1427] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:32 2022] GET /compute/v2.1/servers/1f956517-1701-4171-9227-03726c7e8fca => generated 1314 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:33.433690 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f79eb628-f2fa-4b26-8dc4-b50420fa771d tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:33.434937 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-f79eb628-f2fa-4b26-8dc4-b50420fa771d tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: ce0d629a-068c-4a62-8a03-fc43fc0be9b3] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:33.435067 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-8edc3fd4-5bb3-48e3-b188-44f8baeb8b8f tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Calling method '.version_select at 0x7fb21f7e91f0>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:33.449368 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f79eb628-f2fa-4b26-8dc4-b50420fa771d tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:33.450028 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f79eb628-f2fa-4b26-8dc4-b50420fa771d tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:33.450543 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f79eb628-f2fa-4b26-8dc4-b50420fa771d tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:33.468220 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f79eb628-f2fa-4b26-8dc4-b50420fa771d tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:33.471612 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f79eb628-f2fa-4b26-8dc4-b50420fa771d tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:33.472263 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f79eb628-f2fa-4b26-8dc4-b50420fa771d tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:33.553710 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-8edc3fd4-5bb3-48e3-b188-44f8baeb8b8f tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] 10.222.0.43 "GET /compute/v2.1/images/c7776971-442e-4bf2-8d58-f38b00ff4b4a" status: 200 len: 1437 microversion: 2.1 time: 0.132472 Oct 04 18:36:33.555206 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 657/1428] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 18:36:33 2022] GET /compute/v2.1/images/c7776971-442e-4bf2-8d58-f38b00ff4b4a => generated 1437 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:33.565264 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-f39cc0e2-1284-45de-89fe-8f762eeb1f7e tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:33.568137 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-f39cc0e2-1284-45de-89fe-8f762eeb1f7e tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] [instance: 67e13bce-be81-4775-be5f-737add9f1694] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:33.591123 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f39cc0e2-1284-45de-89fe-8f762eeb1f7e tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:33.593625 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f39cc0e2-1284-45de-89fe-8f762eeb1f7e tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:33.594286 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f39cc0e2-1284-45de-89fe-8f762eeb1f7e tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:33.596078 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f39cc0e2-1284-45de-89fe-8f762eeb1f7e tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:33.598580 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f39cc0e2-1284-45de-89fe-8f762eeb1f7e tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:33.600423 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f39cc0e2-1284-45de-89fe-8f762eeb1f7e tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:33.879660 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-f79eb628-f2fa-4b26-8dc4-b50420fa771d tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:33.894091 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-f79eb628-f2fa-4b26-8dc4-b50420fa771d tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/ce0d629a-068c-4a62-8a03-fc43fc0be9b3" status: 200 len: 1477 microversion: 2.1 time: 0.472973 Oct 04 18:36:33.895388 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 772/1429] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:33 2022] GET /compute/v2.1/servers/ce0d629a-068c-4a62-8a03-fc43fc0be9b3 => generated 1477 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:33.900606 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-ab0e8e7d-f489-4537-9eea-85d2f190cd95 tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:33.901541 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-ab0e8e7d-f489-4537-9eea-85d2f190cd95 tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] [instance: 37823428-1dab-4b0a-9ea1-7232766fc9b7] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:33.908090 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ab0e8e7d-f489-4537-9eea-85d2f190cd95 tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:33.908852 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ab0e8e7d-f489-4537-9eea-85d2f190cd95 tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:33.909562 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ab0e8e7d-f489-4537-9eea-85d2f190cd95 tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:33.910626 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ab0e8e7d-f489-4537-9eea-85d2f190cd95 tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:33.911314 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ab0e8e7d-f489-4537-9eea-85d2f190cd95 tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:33.911955 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ab0e8e7d-f489-4537-9eea-85d2f190cd95 tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:33.913485 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.objects.instance [None req-f39cc0e2-1284-45de-89fe-8f762eeb1f7e tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Lazy-loading 'services' on Instance uuid 67e13bce-be81-4775-be5f-737add9f1694 {{(pid=123595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:36:33.959527 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-f39cc0e2-1284-45de-89fe-8f762eeb1f7e tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/67e13bce-be81-4775-be5f-737add9f1694" status: 200 len: 1929 microversion: 2.75 time: 0.402463 Oct 04 18:36:33.960136 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 658/1430] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:36:33 2022] GET /compute/v2.1/servers/67e13bce-be81-4775-be5f-737add9f1694 => generated 1929 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:36:33.964891 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-dcdcf5f8-ba2d-4921-9c33-7ba686f0b4e5 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:33.965545 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-dcdcf5f8-ba2d-4921-9c33-7ba686f0b4e5 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] [instance: 4231fdff-39dd-49a6-bea2-5edea44c3582] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:33.976560 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-ab0e8e7d-f489-4537-9eea-85d2f190cd95 tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] HTTP exception thrown: Instance 37823428-1dab-4b0a-9ea1-7232766fc9b7 could not be found. Oct 04 18:36:33.979154 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dcdcf5f8-ba2d-4921-9c33-7ba686f0b4e5 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:33.979669 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dcdcf5f8-ba2d-4921-9c33-7ba686f0b4e5 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:33.980113 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dcdcf5f8-ba2d-4921-9c33-7ba686f0b4e5 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:33.980839 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dcdcf5f8-ba2d-4921-9c33-7ba686f0b4e5 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:33.981333 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dcdcf5f8-ba2d-4921-9c33-7ba686f0b4e5 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:33.981770 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dcdcf5f8-ba2d-4921-9c33-7ba686f0b4e5 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:33.988206 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-ab0e8e7d-f489-4537-9eea-85d2f190cd95 tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] Request method failure captured: Oct 04 18:36:33.988206 n-d-851028-13 devstack@n-api.service[123596]: request: GET /compute/v2.1/servers/37823428-1dab-4b0a-9ea1-7232766fc9b7 HTTP/1.1 Oct 04 18:36:33.988206 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:36:33.988206 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:36:33.988206 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:36:33.988206 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 18:36:33.988206 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:36:33.988206 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:36:33.988206 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:36:33.988206 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:36:33.988206 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPHzclaK1blUTnjbgLcJE-QCvFEEjdNV8W0PNJBL58Ro9GfAn8YQQ7saux87tobeMOIwyx3qAm4qPT4HD-hMyTIEk-khz30QpjSRKhQfTf4bXz6LHnocKxpyXHjKj9huQXGHEwJMdQ3AEjOYbuQZIAfNHyf9vwYIZuTQxEKkW_jUYvnI Oct 04 18:36:33.988206 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:36:33.988206 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:36:33.988206 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:36:33.988206 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:36:33.988206 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:36:33.988206 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:36:33.988206 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: bdc10a840253410ab9404ff4906eebc8 Oct 04 18:36:33.988206 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-ServersTestManualDisk-905588507 Oct 04 18:36:33.988206 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 18:36:33.988206 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 18:36:33.988206 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/bdc10a840253410ab9404ff4906eebc8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_bdc10a840253410ab9404ff4906eebc8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/bdc10a840253410ab9404ff4906eebc8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/bdc10a840253410ab9404ff4906eebc8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:36:33.988206 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-ServersTestManualDisk-905588507 Oct 04 18:36:33.988206 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: bdc10a840253410ab9404ff4906eebc8 Oct 04 18:36:33.988206 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-ServersTestManualDisk-905588507 Oct 04 18:36:33.988206 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-ServersTestManualDisk-905588507-project Oct 04 18:36:33.988206 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:36:33.988206 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:36:33.988206 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: cf77a83227f0404da7792695463b6714 Oct 04 18:36:33.988206 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-ServersTestManualDisk-905588507-project Oct 04 18:36:33.988206 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 18:36:33.988206 n-d-851028-13 devstack@n-api.service[123596]: exception: Instance 37823428-1dab-4b0a-9ea1-7232766fc9b7 could not be found. Oct 04 18:36:33.988206 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': '37823428-1dab-4b0a-9ea1-7232766fc9b7'} Oct 04 18:36:33.988206 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:36:33.988206 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:36:33.988206 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:36:33.988206 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:36:33.988206 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:36:33.988206 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:36:33.988206 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:36:33.988206 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:36:33.988206 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:36:33.988206 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:36:33.988206 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37823428-1dab-4b0a-9ea1-7232766fc9b7 could not be found. Oct 04 18:36:33.988206 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:36:33.988206 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:36:33.988206 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:36:33.988206 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:36:33.988206 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:36:33.988206 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:36:33.988206 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:36:33.988206 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:36:33.988206 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:36:33.988206 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:36:33.988206 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:36:33.988206 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:36:33.988206 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:36:33.988206 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:36:33.988206 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:36:33.988206 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:36:33.988206 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37823428-1dab-4b0a-9ea1-7232766fc9b7 could not be found. Oct 04 18:36:33.988206 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:36:33.988206 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:36:33.988206 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:36:33.993747 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:36:33.993747 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:36:33.993747 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:36:33.993747 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:36:33.993747 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:36:33.993747 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37823428-1dab-4b0a-9ea1-7232766fc9b7 could not be found. Oct 04 18:36:33.993747 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:36:33.993747 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-ab0e8e7d-f489-4537-9eea-85d2f190cd95 tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] Returning 404 to user: Instance 37823428-1dab-4b0a-9ea1-7232766fc9b7 could not be found. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:36:33.993747 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-ab0e8e7d-f489-4537-9eea-85d2f190cd95 tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] 10.222.0.43 "GET /compute/v2.1/servers/37823428-1dab-4b0a-9ea1-7232766fc9b7" status: 404 len: 111 microversion: 2.1 time: 0.093147 Oct 04 18:36:33.996373 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 773/1431] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:33 2022] GET /compute/v2.1/servers/37823428-1dab-4b0a-9ea1-7232766fc9b7 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:36:34.007475 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-cd4a8b3e-1cb1-404c-b536-ac6c7be1ba3d tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] Calling method '.version_select at 0x7fb227e02550>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:34.071750 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-cd4a8b3e-1cb1-404c-b536-ac6c7be1ba3d tempest-ServersTestManualDisk-905588507 tempest-ServersTestManualDisk-905588507-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1930838380" status: 202 len: 0 microversion: 2.1 time: 0.074001 Oct 04 18:36:34.074204 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 774/1432] 10.222.0.43 () {58 vars in 1221 bytes} [Tue Oct 4 18:36:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1930838380 => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:36:34.421653 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-dd28c783-da55-4a7b-b4e5-e375d51e00c1 tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:34.422408 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-dd28c783-da55-4a7b-b4e5-e375d51e00c1 tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] [instance: 1f956517-1701-4171-9227-03726c7e8fca] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:34.451374 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dd28c783-da55-4a7b-b4e5-e375d51e00c1 tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:34.454971 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dd28c783-da55-4a7b-b4e5-e375d51e00c1 tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:34.455834 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dd28c783-da55-4a7b-b4e5-e375d51e00c1 tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:34.456917 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dd28c783-da55-4a7b-b4e5-e375d51e00c1 tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:34.457664 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dd28c783-da55-4a7b-b4e5-e375d51e00c1 tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:34.466028 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dd28c783-da55-4a7b-b4e5-e375d51e00c1 tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:34.471565 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-dcdcf5f8-ba2d-4921-9c33-7ba686f0b4e5 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8046c7965b473e9f7d31be9d6f6937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b194743a4124bdba97895542273859a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:34.510809 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-dcdcf5f8-ba2d-4921-9c33-7ba686f0b4e5 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] 10.222.0.43 "GET /compute/v2.1/servers/4231fdff-39dd-49a6-bea2-5edea44c3582" status: 200 len: 1317 microversion: 2.1 time: 0.549487 Oct 04 18:36:34.521275 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 659/1433] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:33 2022] GET /compute/v2.1/servers/4231fdff-39dd-49a6-bea2-5edea44c3582 => generated 1317 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:34.530697 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-c474ff45-7e9d-49ae-b0b7-ea65d67947be tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:34.538219 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-c474ff45-7e9d-49ae-b0b7-ea65d67947be tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] [instance: 63543ce9-528e-4064-a6cd-6dd249104468] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:34.555783 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c474ff45-7e9d-49ae-b0b7-ea65d67947be tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:34.557384 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c474ff45-7e9d-49ae-b0b7-ea65d67947be tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:34.558160 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c474ff45-7e9d-49ae-b0b7-ea65d67947be tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:34.559171 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c474ff45-7e9d-49ae-b0b7-ea65d67947be tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:34.560043 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c474ff45-7e9d-49ae-b0b7-ea65d67947be tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:34.560711 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c474ff45-7e9d-49ae-b0b7-ea65d67947be tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:34.886387 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-c474ff45-7e9d-49ae-b0b7-ea65d67947be tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64887fff0bc7417094c4fee2f7e9aa5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6187bfad04cb7bc17155862ee0cdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:34.902904 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-c474ff45-7e9d-49ae-b0b7-ea65d67947be tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] 10.222.0.43 "GET /compute/v2.1/servers/63543ce9-528e-4064-a6cd-6dd249104468" status: 200 len: 1513 microversion: 2.1 time: 0.380228 Oct 04 18:36:34.903547 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 660/1434] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:34 2022] GET /compute/v2.1/servers/63543ce9-528e-4064-a6cd-6dd249104468 => generated 1513 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:34.916760 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-1042bcc7-dcc5-441a-840c-7594b8ab7ad5 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Calling method '.version_select at 0x7fb21f834430>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:34.996174 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-1042bcc7-dcc5-441a-840c-7594b8ab7ad5 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] 10.222.0.43 "GET /compute/v2.1/images/c7776971-442e-4bf2-8d58-f38b00ff4b4a" status: 200 len: 1437 microversion: 2.1 time: 0.087762 Oct 04 18:36:34.997788 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 661/1435] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 18:36:34 2022] GET /compute/v2.1/images/c7776971-442e-4bf2-8d58-f38b00ff4b4a => generated 1437 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:35.017686 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-2363b836-b11b-4f7b-8bac-dfbe184004ba req-0c27ab6e-1821-4574-8635-e7bef44de844 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f956517-1701-4171-9227-03726c7e8fca", "tag": "514cb875-d7dc-421d-b51a-0a154956df58"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:36:35.034769 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-2363b836-b11b-4f7b-8bac-dfbe184004ba req-0c27ab6e-1821-4574-8635-e7bef44de844 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:35.035937 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-2363b836-b11b-4f7b-8bac-dfbe184004ba req-0c27ab6e-1821-4574-8635-e7bef44de844 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:35.036696 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-2363b836-b11b-4f7b-8bac-dfbe184004ba req-0c27ab6e-1821-4574-8635-e7bef44de844 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:35.068693 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-2363b836-b11b-4f7b-8bac-dfbe184004ba req-0c27ab6e-1821-4574-8635-e7bef44de844 service nova] Creating event network-changed:514cb875-d7dc-421d-b51a-0a154956df58 for instance 1f956517-1701-4171-9227-03726c7e8fca on n-h1-851028-13 Oct 04 18:36:35.075535 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-2363b836-b11b-4f7b-8bac-dfbe184004ba req-0c27ab6e-1821-4574-8635-e7bef44de844 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075028 Oct 04 18:36:35.076535 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 662/1436] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:36:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:36:35.083138 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-a3165e67-b25d-4488-9b86-76d4537dd943 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:35.084212 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-a3165e67-b25d-4488-9b86-76d4537dd943 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: ce0d629a-068c-4a62-8a03-fc43fc0be9b3] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:35.091724 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a3165e67-b25d-4488-9b86-76d4537dd943 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:35.092627 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a3165e67-b25d-4488-9b86-76d4537dd943 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:35.093490 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a3165e67-b25d-4488-9b86-76d4537dd943 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:35.094682 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a3165e67-b25d-4488-9b86-76d4537dd943 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:35.095415 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a3165e67-b25d-4488-9b86-76d4537dd943 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:35.096140 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a3165e67-b25d-4488-9b86-76d4537dd943 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:35.243445 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-dd28c783-da55-4a7b-b4e5-e375d51e00c1 tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013cb5ed545e4aa29e25e8a6af35db7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a71c255d30a42e785c18fc1ce2208bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:35.260352 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-dd28c783-da55-4a7b-b4e5-e375d51e00c1 tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] 10.222.0.43 "GET /compute/v2.1/servers/1f956517-1701-4171-9227-03726c7e8fca" status: 200 len: 1314 microversion: 2.1 time: 0.844861 Oct 04 18:36:35.261618 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 775/1437] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:34 2022] GET /compute/v2.1/servers/1f956517-1701-4171-9227-03726c7e8fca => generated 1314 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:36:35.294716 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-2a4b2be4-97bd-42c4-9532-82fc79f67a13 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:35.295609 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-2a4b2be4-97bd-42c4-9532-82fc79f67a13 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] [instance: 67e13bce-be81-4775-be5f-737add9f1694] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:35.302406 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2a4b2be4-97bd-42c4-9532-82fc79f67a13 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:35.303234 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2a4b2be4-97bd-42c4-9532-82fc79f67a13 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:35.303905 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2a4b2be4-97bd-42c4-9532-82fc79f67a13 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:35.304862 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2a4b2be4-97bd-42c4-9532-82fc79f67a13 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:35.305645 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2a4b2be4-97bd-42c4-9532-82fc79f67a13 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:35.306474 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2a4b2be4-97bd-42c4-9532-82fc79f67a13 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:35.476852 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.objects.instance [None req-2a4b2be4-97bd-42c4-9532-82fc79f67a13 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Lazy-loading 'services' on Instance uuid 67e13bce-be81-4775-be5f-737add9f1694 {{(pid=123596) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:36:35.520057 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-2a4b2be4-97bd-42c4-9532-82fc79f67a13 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/67e13bce-be81-4775-be5f-737add9f1694" status: 200 len: 1929 microversion: 2.75 time: 0.238528 Oct 04 18:36:35.521733 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-a3165e67-b25d-4488-9b86-76d4537dd943 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:35.522403 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 776/1438] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:36:35 2022] GET /compute/v2.1/servers/67e13bce-be81-4775-be5f-737add9f1694 => generated 1929 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:36:35.531994 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-a3165e67-b25d-4488-9b86-76d4537dd943 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/ce0d629a-068c-4a62-8a03-fc43fc0be9b3" status: 200 len: 1477 microversion: 2.1 time: 0.453883 Oct 04 18:36:35.532586 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 663/1439] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:35 2022] GET /compute/v2.1/servers/ce0d629a-068c-4a62-8a03-fc43fc0be9b3 => generated 1477 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:35.556505 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-9592e826-8cf6-4345-97f6-49bc45f48768 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:35.557626 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-9592e826-8cf6-4345-97f6-49bc45f48768 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] [instance: 4231fdff-39dd-49a6-bea2-5edea44c3582] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:35.578957 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9592e826-8cf6-4345-97f6-49bc45f48768 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:35.579468 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9592e826-8cf6-4345-97f6-49bc45f48768 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:35.579922 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9592e826-8cf6-4345-97f6-49bc45f48768 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:35.580652 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9592e826-8cf6-4345-97f6-49bc45f48768 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:35.581298 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9592e826-8cf6-4345-97f6-49bc45f48768 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:35.581730 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9592e826-8cf6-4345-97f6-49bc45f48768 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:35.865542 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-9592e826-8cf6-4345-97f6-49bc45f48768 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8046c7965b473e9f7d31be9d6f6937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b194743a4124bdba97895542273859a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:35.881077 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-9592e826-8cf6-4345-97f6-49bc45f48768 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] 10.222.0.43 "GET /compute/v2.1/servers/4231fdff-39dd-49a6-bea2-5edea44c3582" status: 200 len: 1467 microversion: 2.1 time: 0.329571 Oct 04 18:36:35.882455 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 777/1440] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:35 2022] GET /compute/v2.1/servers/4231fdff-39dd-49a6-bea2-5edea44c3582 => generated 1467 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:35.906030 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-d72c66ca-cdc8-4e45-9a13-8d813c5767eb tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-2108518760", "metadata": {"image_type": "test"}}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:36:35.909625 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-d72c66ca-cdc8-4e45-9a13-8d813c5767eb tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] [instance: 4231fdff-39dd-49a6-bea2-5edea44c3582] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:35.916043 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=20 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:36:35.918359 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d72c66ca-cdc8-4e45-9a13-8d813c5767eb tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:35.919207 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d72c66ca-cdc8-4e45-9a13-8d813c5767eb tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:35.919842 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d72c66ca-cdc8-4e45-9a13-8d813c5767eb tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:35.920788 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d72c66ca-cdc8-4e45-9a13-8d813c5767eb tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:35.921596 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d72c66ca-cdc8-4e45-9a13-8d813c5767eb tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:35.922480 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d72c66ca-cdc8-4e45-9a13-8d813c5767eb tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:35.933570 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-8fb5e276-673c-4068-aa11-7aae7b2f19e6 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:35.934539 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-8fb5e276-673c-4068-aa11-7aae7b2f19e6 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] [instance: 63543ce9-528e-4064-a6cd-6dd249104468] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:35.941066 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:36:35.947559 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8fb5e276-673c-4068-aa11-7aae7b2f19e6 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:35.948491 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8fb5e276-673c-4068-aa11-7aae7b2f19e6 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:35.949146 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8fb5e276-673c-4068-aa11-7aae7b2f19e6 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:35.950896 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8fb5e276-673c-4068-aa11-7aae7b2f19e6 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:35.956458 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8fb5e276-673c-4068-aa11-7aae7b2f19e6 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:35.959173 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8fb5e276-673c-4068-aa11-7aae7b2f19e6 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:36.022341 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-d72c66ca-cdc8-4e45-9a13-8d813c5767eb tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Getting quotas for project 3b194743a4124bdba97895542273859a. Resources: dict_keys(['metadata_items']) {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:36:36.037154 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-d72c66ca-cdc8-4e45-9a13-8d813c5767eb tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Getting quotas for user 1e8046c7965b473e9f7d31be9d6f6937 and project 3b194743a4124bdba97895542273859a. Resources: dict_keys(['metadata_items']) {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:36:36.298774 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-8fb5e276-673c-4068-aa11-7aae7b2f19e6 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64887fff0bc7417094c4fee2f7e9aa5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6187bfad04cb7bc17155862ee0cdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:36.330816 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-8fb5e276-673c-4068-aa11-7aae7b2f19e6 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] 10.222.0.43 "GET /compute/v2.1/servers/63543ce9-528e-4064-a6cd-6dd249104468" status: 200 len: 1471 microversion: 2.1 time: 0.401234 Oct 04 18:36:36.338679 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 778/1441] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:35 2022] GET /compute/v2.1/servers/63543ce9-528e-4064-a6cd-6dd249104468 => generated 1471 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:36.347590 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-b177a714-43c7-4a47-88ab-00ddfde00d99 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Calling method '.version_select at 0x7fb21fb030d0>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:36.425534 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-d72c66ca-cdc8-4e45-9a13-8d813c5767eb tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] 10.222.0.43 "POST /compute/v2.1/servers/4231fdff-39dd-49a6-bea2-5edea44c3582/action" status: 202 len: 0 microversion: 2.1 time: 0.523172 Oct 04 18:36:36.426576 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 664/1442] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 18:36:35 2022] POST /compute/v2.1/servers/4231fdff-39dd-49a6-bea2-5edea44c3582/action => generated 0 bytes in 525 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 04 18:36:36.437733 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-c01c7045-412d-4b61-a383-cff903c348bc tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:36.438548 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-c01c7045-412d-4b61-a383-cff903c348bc tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] [instance: 1f956517-1701-4171-9227-03726c7e8fca] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:36.446020 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c01c7045-412d-4b61-a383-cff903c348bc tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:36.447309 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c01c7045-412d-4b61-a383-cff903c348bc tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:36.447854 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c01c7045-412d-4b61-a383-cff903c348bc tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:36.448765 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c01c7045-412d-4b61-a383-cff903c348bc tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:36.449354 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c01c7045-412d-4b61-a383-cff903c348bc tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:36.449886 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c01c7045-412d-4b61-a383-cff903c348bc tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:36.463024 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-b177a714-43c7-4a47-88ab-00ddfde00d99 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] 10.222.0.43 "GET /compute/v2.1/images/c7776971-442e-4bf2-8d58-f38b00ff4b4a" status: 200 len: 1437 microversion: 2.1 time: 0.122990 Oct 04 18:36:36.464716 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 779/1443] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 18:36:36 2022] GET /compute/v2.1/images/c7776971-442e-4bf2-8d58-f38b00ff4b4a => generated 1437 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:36.470912 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-b0a35f1f-302d-4559-acd6-b23304c1c037 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Calling method '.version_select at 0x7fb227e021f0>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:36.492222 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=8 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:36:36.538615 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-b0a35f1f-302d-4559-acd6-b23304c1c037 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] 10.222.0.43 "GET /compute/v2.1/images/3adaa529-06f7-4c7d-8ad1-d56ec671ea9a" status: 200 len: 1424 microversion: 2.1 time: 0.072468 Oct 04 18:36:36.540281 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 780/1444] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 18:36:36 2022] GET /compute/v2.1/images/3adaa529-06f7-4c7d-8ad1-d56ec671ea9a => generated 1424 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:36.563371 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-cb7b1272-55b9-406a-b668-c64e45525d2c tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:36.564258 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-cb7b1272-55b9-406a-b668-c64e45525d2c tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] [instance: 67e13bce-be81-4775-be5f-737add9f1694] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:36.567408 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=6 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:36:36.582040 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cb7b1272-55b9-406a-b668-c64e45525d2c tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:36.583119 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cb7b1272-55b9-406a-b668-c64e45525d2c tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:36.583897 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cb7b1272-55b9-406a-b668-c64e45525d2c tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:36.584884 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cb7b1272-55b9-406a-b668-c64e45525d2c tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:36.585612 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cb7b1272-55b9-406a-b668-c64e45525d2c tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:36.586300 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cb7b1272-55b9-406a-b668-c64e45525d2c tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:36.697672 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-c01c7045-412d-4b61-a383-cff903c348bc tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013cb5ed545e4aa29e25e8a6af35db7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a71c255d30a42e785c18fc1ce2208bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:36.706076 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-c01c7045-412d-4b61-a383-cff903c348bc tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] 10.222.0.43 "GET /compute/v2.1/servers/1f956517-1701-4171-9227-03726c7e8fca" status: 200 len: 1314 microversion: 2.1 time: 0.277710 Oct 04 18:36:36.707049 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 665/1445] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:36 2022] GET /compute/v2.1/servers/1f956517-1701-4171-9227-03726c7e8fca => generated 1314 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:36.712269 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-a348b37f-cfbc-4cfd-8175-5592d08b1c57 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:36.713400 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-a348b37f-cfbc-4cfd-8175-5592d08b1c57 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: ce0d629a-068c-4a62-8a03-fc43fc0be9b3] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:36.719612 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a348b37f-cfbc-4cfd-8175-5592d08b1c57 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:36.720376 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a348b37f-cfbc-4cfd-8175-5592d08b1c57 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:36.721044 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a348b37f-cfbc-4cfd-8175-5592d08b1c57 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:36.721198 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.objects.instance [None req-cb7b1272-55b9-406a-b668-c64e45525d2c tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Lazy-loading 'services' on Instance uuid 67e13bce-be81-4775-be5f-737add9f1694 {{(pid=123596) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:36:36.722431 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a348b37f-cfbc-4cfd-8175-5592d08b1c57 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:36.723125 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a348b37f-cfbc-4cfd-8175-5592d08b1c57 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:36.724057 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a348b37f-cfbc-4cfd-8175-5592d08b1c57 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:36.752147 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-cb7b1272-55b9-406a-b668-c64e45525d2c tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/67e13bce-be81-4775-be5f-737add9f1694" status: 200 len: 1929 microversion: 2.75 time: 0.193399 Oct 04 18:36:36.753333 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 781/1446] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:36:36 2022] GET /compute/v2.1/servers/67e13bce-be81-4775-be5f-737add9f1694 => generated 1929 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:36:36.916426 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-a348b37f-cfbc-4cfd-8175-5592d08b1c57 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:36.926921 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-a348b37f-cfbc-4cfd-8175-5592d08b1c57 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/ce0d629a-068c-4a62-8a03-fc43fc0be9b3" status: 200 len: 1477 microversion: 2.1 time: 0.218566 Oct 04 18:36:36.927762 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 666/1447] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:36 2022] GET /compute/v2.1/servers/ce0d629a-068c-4a62-8a03-fc43fc0be9b3 => generated 1477 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:37.124415 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-f7a6f556-0b90-422e-b479-a62691cab927 req-fb02f6c8-6d8a-47de-ad50-c9cf68fc3792 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63543ce9-528e-4064-a6cd-6dd249104468", "name": "network-vif-deleted", "tag": "3cf62e8e-aadc-4bbd-97a3-8471a4356442"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:36:37.140951 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-f7a6f556-0b90-422e-b479-a62691cab927 req-fb02f6c8-6d8a-47de-ad50-c9cf68fc3792 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:37.141857 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-f7a6f556-0b90-422e-b479-a62691cab927 req-fb02f6c8-6d8a-47de-ad50-c9cf68fc3792 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:37.142561 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-f7a6f556-0b90-422e-b479-a62691cab927 req-fb02f6c8-6d8a-47de-ad50-c9cf68fc3792 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:37.157601 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-f7a6f556-0b90-422e-b479-a62691cab927 req-fb02f6c8-6d8a-47de-ad50-c9cf68fc3792 service nova] Creating event network-vif-deleted:3cf62e8e-aadc-4bbd-97a3-8471a4356442 for instance 63543ce9-528e-4064-a6cd-6dd249104468 on n-h1-851028-13 Oct 04 18:36:37.163389 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-f7a6f556-0b90-422e-b479-a62691cab927 req-fb02f6c8-6d8a-47de-ad50-c9cf68fc3792 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043020 Oct 04 18:36:37.164203 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 782/1448] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:36:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:36:37.361068 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-d1e98845-0c4b-48b4-89f4-1f1089db1c78 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:37.361744 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-d1e98845-0c4b-48b4-89f4-1f1089db1c78 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] [instance: 63543ce9-528e-4064-a6cd-6dd249104468] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:37.367849 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=36 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:36:37.369321 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:36:37.372057 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d1e98845-0c4b-48b4-89f4-1f1089db1c78 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:37.372933 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d1e98845-0c4b-48b4-89f4-1f1089db1c78 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:37.373556 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d1e98845-0c4b-48b4-89f4-1f1089db1c78 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:37.374579 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d1e98845-0c4b-48b4-89f4-1f1089db1c78 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:37.374934 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d1e98845-0c4b-48b4-89f4-1f1089db1c78 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:37.375592 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d1e98845-0c4b-48b4-89f4-1f1089db1c78 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:37.470378 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-d1e98845-0c4b-48b4-89f4-1f1089db1c78 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64887fff0bc7417094c4fee2f7e9aa5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6187bfad04cb7bc17155862ee0cdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:37.480800 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-bf644b1f-235b-4c70-9e61-99d8733b1359 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Calling method '.version_select at 0x7fb21fb7aee0>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:37.481191 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-d1e98845-0c4b-48b4-89f4-1f1089db1c78 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] 10.222.0.43 "GET /compute/v2.1/servers/63543ce9-528e-4064-a6cd-6dd249104468" status: 200 len: 1471 microversion: 2.1 time: 0.124542 Oct 04 18:36:37.501949 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 667/1449] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:37 2022] GET /compute/v2.1/servers/63543ce9-528e-4064-a6cd-6dd249104468 => generated 1471 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:37.568062 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-64b30036-46cf-4ffd-9bd0-444ccf06d1d0 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Calling method '.version_select at 0x7fb21f7853a0>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:37.592191 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-bf644b1f-235b-4c70-9e61-99d8733b1359 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] 10.222.0.43 "GET /compute/v2.1/images/c7776971-442e-4bf2-8d58-f38b00ff4b4a" status: 200 len: 1437 microversion: 2.1 time: 0.116385 Oct 04 18:36:37.603002 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 783/1450] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 18:36:37 2022] GET /compute/v2.1/images/c7776971-442e-4bf2-8d58-f38b00ff4b4a => generated 1437 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:36:37.671293 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-64b30036-46cf-4ffd-9bd0-444ccf06d1d0 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] 10.222.0.43 "GET /compute/v2.1/images/3adaa529-06f7-4c7d-8ad1-d56ec671ea9a" status: 200 len: 1424 microversion: 2.1 time: 0.111583 Oct 04 18:36:37.671890 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 668/1451] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 18:36:37 2022] GET /compute/v2.1/images/3adaa529-06f7-4c7d-8ad1-d56ec671ea9a => generated 1424 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:37.732150 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-dc652154-aa1b-4c9d-b24d-f0caed5649e7 tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:37.733100 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-dc652154-aa1b-4c9d-b24d-f0caed5649e7 tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] [instance: 1f956517-1701-4171-9227-03726c7e8fca] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:37.743304 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dc652154-aa1b-4c9d-b24d-f0caed5649e7 tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:37.744095 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dc652154-aa1b-4c9d-b24d-f0caed5649e7 tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:37.744800 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dc652154-aa1b-4c9d-b24d-f0caed5649e7 tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:37.745699 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dc652154-aa1b-4c9d-b24d-f0caed5649e7 tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:37.746237 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dc652154-aa1b-4c9d-b24d-f0caed5649e7 tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:37.746678 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dc652154-aa1b-4c9d-b24d-f0caed5649e7 tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:37.783898 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-97826db5-f9db-4b21-8b57-c0b34c5d6ec1 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:37.784716 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-97826db5-f9db-4b21-8b57-c0b34c5d6ec1 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] [instance: 67e13bce-be81-4775-be5f-737add9f1694] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:37.796573 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-97826db5-f9db-4b21-8b57-c0b34c5d6ec1 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:37.797269 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-97826db5-f9db-4b21-8b57-c0b34c5d6ec1 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:37.798020 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-97826db5-f9db-4b21-8b57-c0b34c5d6ec1 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:37.798987 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-97826db5-f9db-4b21-8b57-c0b34c5d6ec1 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:37.799732 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-97826db5-f9db-4b21-8b57-c0b34c5d6ec1 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:37.800501 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-97826db5-f9db-4b21-8b57-c0b34c5d6ec1 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:37.881849 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.objects.instance [None req-97826db5-f9db-4b21-8b57-c0b34c5d6ec1 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Lazy-loading 'services' on Instance uuid 67e13bce-be81-4775-be5f-737add9f1694 {{(pid=123595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:36:37.901644 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-97826db5-f9db-4b21-8b57-c0b34c5d6ec1 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/67e13bce-be81-4775-be5f-737add9f1694" status: 200 len: 1929 microversion: 2.75 time: 0.121547 Oct 04 18:36:37.912286 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 669/1452] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:36:37 2022] GET /compute/v2.1/servers/67e13bce-be81-4775-be5f-737add9f1694 => generated 1929 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:36:37.955207 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-7c1f9276-e1ef-4bb5-804a-96481d737174 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:37.956355 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-7c1f9276-e1ef-4bb5-804a-96481d737174 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: ce0d629a-068c-4a62-8a03-fc43fc0be9b3] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:37.964340 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7c1f9276-e1ef-4bb5-804a-96481d737174 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:37.964857 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7c1f9276-e1ef-4bb5-804a-96481d737174 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:37.965360 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7c1f9276-e1ef-4bb5-804a-96481d737174 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:37.966109 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7c1f9276-e1ef-4bb5-804a-96481d737174 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:37.966656 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7c1f9276-e1ef-4bb5-804a-96481d737174 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:37.967094 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7c1f9276-e1ef-4bb5-804a-96481d737174 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:38.031554 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-dc652154-aa1b-4c9d-b24d-f0caed5649e7 tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013cb5ed545e4aa29e25e8a6af35db7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a71c255d30a42e785c18fc1ce2208bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:38.040810 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-dc652154-aa1b-4c9d-b24d-f0caed5649e7 tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] 10.222.0.43 "GET /compute/v2.1/servers/1f956517-1701-4171-9227-03726c7e8fca" status: 200 len: 1314 microversion: 2.1 time: 0.313198 Oct 04 18:36:38.054350 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 784/1453] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:37 2022] GET /compute/v2.1/servers/1f956517-1701-4171-9227-03726c7e8fca => generated 1314 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:38.273770 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-7c1f9276-e1ef-4bb5-804a-96481d737174 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:38.285573 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-7c1f9276-e1ef-4bb5-804a-96481d737174 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/ce0d629a-068c-4a62-8a03-fc43fc0be9b3" status: 200 len: 1477 microversion: 2.1 time: 0.334563 Oct 04 18:36:38.303815 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 670/1454] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:37 2022] GET /compute/v2.1/servers/ce0d629a-068c-4a62-8a03-fc43fc0be9b3 => generated 1477 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:36:38.520240 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-08f7790d-d94b-4034-85c6-b42edc1eabbd tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:38.521195 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-08f7790d-d94b-4034-85c6-b42edc1eabbd tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] [instance: 63543ce9-528e-4064-a6cd-6dd249104468] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:38.536307 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-08f7790d-d94b-4034-85c6-b42edc1eabbd tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:38.538274 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-08f7790d-d94b-4034-85c6-b42edc1eabbd tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:38.538831 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-08f7790d-d94b-4034-85c6-b42edc1eabbd tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:38.540473 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-08f7790d-d94b-4034-85c6-b42edc1eabbd tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:38.541049 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-08f7790d-d94b-4034-85c6-b42edc1eabbd tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:38.542167 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-08f7790d-d94b-4034-85c6-b42edc1eabbd tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:38.608698 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-919f0602-66aa-49a8-a6ac-3c9e563911ee tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Calling method '.version_select at 0x7fb21f892550>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:38.689056 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-08f7790d-d94b-4034-85c6-b42edc1eabbd tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64887fff0bc7417094c4fee2f7e9aa5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6187bfad04cb7bc17155862ee0cdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:38.692470 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-919f0602-66aa-49a8-a6ac-3c9e563911ee tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] 10.222.0.43 "GET /compute/v2.1/images/c7776971-442e-4bf2-8d58-f38b00ff4b4a" status: 200 len: 1437 microversion: 2.1 time: 0.087556 Oct 04 18:36:38.698649 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-08f7790d-d94b-4034-85c6-b42edc1eabbd tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] 10.222.0.43 "GET /compute/v2.1/servers/63543ce9-528e-4064-a6cd-6dd249104468" status: 200 len: 1302 microversion: 2.1 time: 0.182750 Oct 04 18:36:38.699641 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 785/1455] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:38 2022] GET /compute/v2.1/servers/63543ce9-528e-4064-a6cd-6dd249104468 => generated 1302 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:38.701443 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 671/1456] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 18:36:38 2022] GET /compute/v2.1/images/c7776971-442e-4bf2-8d58-f38b00ff4b4a => generated 1437 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:38.704983 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-c5f3d20b-624f-420d-a213-4c3a4b85bec4 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Calling method '.version_select at 0x7fb21fb033a0>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:38.798108 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-c5f3d20b-624f-420d-a213-4c3a4b85bec4 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] 10.222.0.43 "GET /compute/v2.1/images/3adaa529-06f7-4c7d-8ad1-d56ec671ea9a" status: 200 len: 1424 microversion: 2.1 time: 0.097295 Oct 04 18:36:38.799490 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 786/1457] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 18:36:38 2022] GET /compute/v2.1/images/3adaa529-06f7-4c7d-8ad1-d56ec671ea9a => generated 1424 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:38.932324 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-1159c1b5-0a94-44ca-af98-8dde47f9f625 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:38.933610 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-1159c1b5-0a94-44ca-af98-8dde47f9f625 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] [instance: 67e13bce-be81-4775-be5f-737add9f1694] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:38.941833 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1159c1b5-0a94-44ca-af98-8dde47f9f625 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:38.942658 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1159c1b5-0a94-44ca-af98-8dde47f9f625 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:38.943328 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1159c1b5-0a94-44ca-af98-8dde47f9f625 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:38.944284 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1159c1b5-0a94-44ca-af98-8dde47f9f625 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:38.944952 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1159c1b5-0a94-44ca-af98-8dde47f9f625 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:38.945618 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1159c1b5-0a94-44ca-af98-8dde47f9f625 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:39.070441 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-73fc775e-455d-4b47-84b2-48507d27b675 tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:39.070441 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-73fc775e-455d-4b47-84b2-48507d27b675 tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] [instance: 1f956517-1701-4171-9227-03726c7e8fca] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:39.089097 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-73fc775e-455d-4b47-84b2-48507d27b675 tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:39.089647 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-73fc775e-455d-4b47-84b2-48507d27b675 tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:39.090058 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-73fc775e-455d-4b47-84b2-48507d27b675 tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:39.090964 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-73fc775e-455d-4b47-84b2-48507d27b675 tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:39.097905 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-73fc775e-455d-4b47-84b2-48507d27b675 tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:39.098647 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-73fc775e-455d-4b47-84b2-48507d27b675 tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:39.321196 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-73fc775e-455d-4b47-84b2-48507d27b675 tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013cb5ed545e4aa29e25e8a6af35db7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a71c255d30a42e785c18fc1ce2208bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:39.334348 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-73fc775e-455d-4b47-84b2-48507d27b675 tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] 10.222.0.43 "GET /compute/v2.1/servers/1f956517-1701-4171-9227-03726c7e8fca" status: 200 len: 1314 microversion: 2.1 time: 0.263608 Oct 04 18:36:39.351797 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 787/1458] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:39 2022] GET /compute/v2.1/servers/1f956517-1701-4171-9227-03726c7e8fca => generated 1314 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:39.363703 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-c80a0924-512a-4fdc-906e-7c9b666461af tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:39.368459 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-c80a0924-512a-4fdc-906e-7c9b666461af tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: ce0d629a-068c-4a62-8a03-fc43fc0be9b3] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:39.376645 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c80a0924-512a-4fdc-906e-7c9b666461af tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:39.377585 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c80a0924-512a-4fdc-906e-7c9b666461af tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:39.378274 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c80a0924-512a-4fdc-906e-7c9b666461af tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:39.379160 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c80a0924-512a-4fdc-906e-7c9b666461af tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:39.379614 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c80a0924-512a-4fdc-906e-7c9b666461af tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:39.380246 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c80a0924-512a-4fdc-906e-7c9b666461af tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:39.420569 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.objects.instance [None req-1159c1b5-0a94-44ca-af98-8dde47f9f625 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Lazy-loading 'services' on Instance uuid 67e13bce-be81-4775-be5f-737add9f1694 {{(pid=123595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:36:39.440194 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:36:39.479421 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-1159c1b5-0a94-44ca-af98-8dde47f9f625 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/67e13bce-be81-4775-be5f-737add9f1694" status: 200 len: 1947 microversion: 2.75 time: 0.550772 Oct 04 18:36:39.480862 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 672/1459] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:36:38 2022] GET /compute/v2.1/servers/67e13bce-be81-4775-be5f-737add9f1694 => generated 1947 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:36:39.607205 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-c80a0924-512a-4fdc-906e-7c9b666461af tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:39.615613 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-c80a0924-512a-4fdc-906e-7c9b666461af tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/ce0d629a-068c-4a62-8a03-fc43fc0be9b3" status: 200 len: 1477 microversion: 2.1 time: 0.261723 Oct 04 18:36:39.616745 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 788/1460] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:39 2022] GET /compute/v2.1/servers/ce0d629a-068c-4a62-8a03-fc43fc0be9b3 => generated 1477 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:39.707812 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-fc596283-7b7e-43ce-98fd-2707cb7afb77 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Calling method '.version_select at 0x7fb21f7c0e50>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:39.723714 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-3bcfdb54-432a-4bce-b4e5-ca4e2485ce62 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:39.724429 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-3bcfdb54-432a-4bce-b4e5-ca4e2485ce62 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] [instance: 63543ce9-528e-4064-a6cd-6dd249104468] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:39.735714 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3bcfdb54-432a-4bce-b4e5-ca4e2485ce62 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:39.738595 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3bcfdb54-432a-4bce-b4e5-ca4e2485ce62 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:39.746814 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3bcfdb54-432a-4bce-b4e5-ca4e2485ce62 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:39.747581 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3bcfdb54-432a-4bce-b4e5-ca4e2485ce62 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:39.748320 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3bcfdb54-432a-4bce-b4e5-ca4e2485ce62 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:39.748757 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3bcfdb54-432a-4bce-b4e5-ca4e2485ce62 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:39.781461 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-fc596283-7b7e-43ce-98fd-2707cb7afb77 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] 10.222.0.43 "GET /compute/v2.1/images/c7776971-442e-4bf2-8d58-f38b00ff4b4a" status: 200 len: 1437 microversion: 2.1 time: 0.077447 Oct 04 18:36:39.782564 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 673/1461] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 18:36:39 2022] GET /compute/v2.1/images/c7776971-442e-4bf2-8d58-f38b00ff4b4a => generated 1437 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:39.800271 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3bcfdb54-432a-4bce-b4e5-ca4e2485ce62 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:39.800754 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3bcfdb54-432a-4bce-b4e5-ca4e2485ce62 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:39.801226 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3bcfdb54-432a-4bce-b4e5-ca4e2485ce62 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:39.801682 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.objects.instance [None req-3bcfdb54-432a-4bce-b4e5-ca4e2485ce62 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lazy-loading 'fault' on Instance uuid 63543ce9-528e-4064-a6cd-6dd249104468 {{(pid=123596) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:36:39.814818 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-4e48ba41-25aa-4a27-9390-f5382cd70ae0 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Calling method '.version_select at 0x7fb21f7e9040>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:39.900869 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-3bcfdb54-432a-4bce-b4e5-ca4e2485ce62 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64887fff0bc7417094c4fee2f7e9aa5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6187bfad04cb7bc17155862ee0cdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:39.902542 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-4e48ba41-25aa-4a27-9390-f5382cd70ae0 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] 10.222.0.43 "GET /compute/v2.1/images/3adaa529-06f7-4c7d-8ad1-d56ec671ea9a" status: 200 len: 1424 microversion: 2.1 time: 0.091979 Oct 04 18:36:39.907982 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 674/1462] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 18:36:39 2022] GET /compute/v2.1/images/3adaa529-06f7-4c7d-8ad1-d56ec671ea9a => generated 1424 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:36:39.919975 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-3bcfdb54-432a-4bce-b4e5-ca4e2485ce62 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] 10.222.0.43 "GET /compute/v2.1/servers/63543ce9-528e-4064-a6cd-6dd249104468" status: 200 len: 1307 microversion: 2.1 time: 0.200039 Oct 04 18:36:39.921154 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 789/1463] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:39 2022] GET /compute/v2.1/servers/63543ce9-528e-4064-a6cd-6dd249104468 => generated 1307 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:40.364130 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-4bb0561b-fc13-4db9-9b4f-f9b2fd528f5b tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:40.364905 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-4bb0561b-fc13-4db9-9b4f-f9b2fd528f5b tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] [instance: 1f956517-1701-4171-9227-03726c7e8fca] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:40.385843 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4bb0561b-fc13-4db9-9b4f-f9b2fd528f5b tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:40.387164 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4bb0561b-fc13-4db9-9b4f-f9b2fd528f5b tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:40.388548 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4bb0561b-fc13-4db9-9b4f-f9b2fd528f5b tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:40.392692 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4bb0561b-fc13-4db9-9b4f-f9b2fd528f5b tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:40.393575 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4bb0561b-fc13-4db9-9b4f-f9b2fd528f5b tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:40.396784 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4bb0561b-fc13-4db9-9b4f-f9b2fd528f5b tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:40.510828 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-3bb5fd12-3cd6-4021-8356-e69b339ca194 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:40.512116 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-3bb5fd12-3cd6-4021-8356-e69b339ca194 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] [instance: 67e13bce-be81-4775-be5f-737add9f1694] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:40.522246 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3bb5fd12-3cd6-4021-8356-e69b339ca194 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:40.523004 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3bb5fd12-3cd6-4021-8356-e69b339ca194 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:40.523652 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3bb5fd12-3cd6-4021-8356-e69b339ca194 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:40.524744 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3bb5fd12-3cd6-4021-8356-e69b339ca194 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:40.525411 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3bb5fd12-3cd6-4021-8356-e69b339ca194 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:40.526193 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3bb5fd12-3cd6-4021-8356-e69b339ca194 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:40.682548 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.objects.instance [None req-3bb5fd12-3cd6-4021-8356-e69b339ca194 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Lazy-loading 'services' on Instance uuid 67e13bce-be81-4775-be5f-737add9f1694 {{(pid=123596) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:36:40.717787 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-4bb0561b-fc13-4db9-9b4f-f9b2fd528f5b tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013cb5ed545e4aa29e25e8a6af35db7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a71c255d30a42e785c18fc1ce2208bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:40.730009 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-3bb5fd12-3cd6-4021-8356-e69b339ca194 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/67e13bce-be81-4775-be5f-737add9f1694" status: 200 len: 1935 microversion: 2.75 time: 0.221920 Oct 04 18:36:40.730500 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-4bb0561b-fc13-4db9-9b4f-f9b2fd528f5b tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] 10.222.0.43 "GET /compute/v2.1/servers/1f956517-1701-4171-9227-03726c7e8fca" status: 200 len: 1314 microversion: 2.1 time: 0.370063 Oct 04 18:36:40.730999 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 675/1464] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:40 2022] GET /compute/v2.1/servers/1f956517-1701-4171-9227-03726c7e8fca => generated 1314 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:40.735895 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 790/1465] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:36:40 2022] GET /compute/v2.1/servers/67e13bce-be81-4775-be5f-737add9f1694 => generated 1935 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:36:40.760558 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-052a95bc-72be-4b89-b4e7-0bdd79d685b5 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:40.761984 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-052a95bc-72be-4b89-b4e7-0bdd79d685b5 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: ce0d629a-068c-4a62-8a03-fc43fc0be9b3] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:40.770726 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-052a95bc-72be-4b89-b4e7-0bdd79d685b5 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:40.771670 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-052a95bc-72be-4b89-b4e7-0bdd79d685b5 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:40.772291 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-052a95bc-72be-4b89-b4e7-0bdd79d685b5 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:40.773242 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-052a95bc-72be-4b89-b4e7-0bdd79d685b5 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:40.775017 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-052a95bc-72be-4b89-b4e7-0bdd79d685b5 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:40.776104 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-052a95bc-72be-4b89-b4e7-0bdd79d685b5 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:40.800915 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-22d10672-7e41-4bd1-927d-84a65b9fff0d tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Calling method '.version_select at 0x7fb21fb030d0>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:40.881559 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-22d10672-7e41-4bd1-927d-84a65b9fff0d tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] 10.222.0.43 "GET /compute/v2.1/images/c7776971-442e-4bf2-8d58-f38b00ff4b4a" status: 200 len: 1437 microversion: 2.1 time: 0.086748 Oct 04 18:36:40.882230 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 791/1466] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 18:36:40 2022] GET /compute/v2.1/images/c7776971-442e-4bf2-8d58-f38b00ff4b4a => generated 1437 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:36:40.919185 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-3b32381c-8733-4a24-83f5-b54bccad67e0 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Calling method '.version_select at 0x7fb21fb6eca0>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:40.989197 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-052a95bc-72be-4b89-b4e7-0bdd79d685b5 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:41.018383 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-3b32381c-8733-4a24-83f5-b54bccad67e0 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] 10.222.0.43 "GET /compute/v2.1/images/3adaa529-06f7-4c7d-8ad1-d56ec671ea9a" status: 200 len: 1424 microversion: 2.1 time: 0.101195 Oct 04 18:36:41.023964 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 792/1467] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 18:36:40 2022] GET /compute/v2.1/images/3adaa529-06f7-4c7d-8ad1-d56ec671ea9a => generated 1424 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:36:41.026600 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-052a95bc-72be-4b89-b4e7-0bdd79d685b5 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/ce0d629a-068c-4a62-8a03-fc43fc0be9b3" status: 200 len: 1477 microversion: 2.1 time: 0.266659 Oct 04 18:36:41.030704 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 676/1468] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:40 2022] GET /compute/v2.1/servers/ce0d629a-068c-4a62-8a03-fc43fc0be9b3 => generated 1477 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:41.034397 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-47054b98-eb2f-488c-b93e-83e8f2a9a1ed tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:41.036123 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-47054b98-eb2f-488c-b93e-83e8f2a9a1ed tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] [instance: 63543ce9-528e-4064-a6cd-6dd249104468] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:41.044318 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-47054b98-eb2f-488c-b93e-83e8f2a9a1ed tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:41.045167 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-47054b98-eb2f-488c-b93e-83e8f2a9a1ed tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:41.045824 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-47054b98-eb2f-488c-b93e-83e8f2a9a1ed tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:41.046889 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-47054b98-eb2f-488c-b93e-83e8f2a9a1ed tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:41.047497 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-47054b98-eb2f-488c-b93e-83e8f2a9a1ed tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:41.048074 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-47054b98-eb2f-488c-b93e-83e8f2a9a1ed tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:41.079922 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:36:41.129336 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-47054b98-eb2f-488c-b93e-83e8f2a9a1ed tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:41.130411 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-47054b98-eb2f-488c-b93e-83e8f2a9a1ed tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:41.135351 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-47054b98-eb2f-488c-b93e-83e8f2a9a1ed tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:41.137371 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.objects.instance [None req-47054b98-eb2f-488c-b93e-83e8f2a9a1ed tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lazy-loading 'fault' on Instance uuid 63543ce9-528e-4064-a6cd-6dd249104468 {{(pid=123596) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:36:41.223723 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-47054b98-eb2f-488c-b93e-83e8f2a9a1ed tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64887fff0bc7417094c4fee2f7e9aa5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6187bfad04cb7bc17155862ee0cdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:41.239650 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-47054b98-eb2f-488c-b93e-83e8f2a9a1ed tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] 10.222.0.43 "GET /compute/v2.1/servers/63543ce9-528e-4064-a6cd-6dd249104468" status: 200 len: 1307 microversion: 2.1 time: 0.213340 Oct 04 18:36:41.242088 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 793/1469] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:41 2022] GET /compute/v2.1/servers/63543ce9-528e-4064-a6cd-6dd249104468 => generated 1307 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:41.761591 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-4a2426ce-ea2c-48e9-a8c6-4f49254fc81d tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:41.762338 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-4a2426ce-ea2c-48e9-a8c6-4f49254fc81d tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] [instance: 1f956517-1701-4171-9227-03726c7e8fca] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:41.764960 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-a199c108-b27f-492e-b622-a9a05b55e571 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:41.766825 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-a199c108-b27f-492e-b622-a9a05b55e571 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] [instance: 67e13bce-be81-4775-be5f-737add9f1694] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:41.771979 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4a2426ce-ea2c-48e9-a8c6-4f49254fc81d tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:41.772734 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4a2426ce-ea2c-48e9-a8c6-4f49254fc81d tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:41.774775 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4a2426ce-ea2c-48e9-a8c6-4f49254fc81d tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:41.775981 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4a2426ce-ea2c-48e9-a8c6-4f49254fc81d tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:41.776660 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4a2426ce-ea2c-48e9-a8c6-4f49254fc81d tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:41.777337 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4a2426ce-ea2c-48e9-a8c6-4f49254fc81d tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:41.789212 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a199c108-b27f-492e-b622-a9a05b55e571 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:41.789808 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a199c108-b27f-492e-b622-a9a05b55e571 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:41.790260 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a199c108-b27f-492e-b622-a9a05b55e571 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:41.791010 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a199c108-b27f-492e-b622-a9a05b55e571 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:41.791476 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a199c108-b27f-492e-b622-a9a05b55e571 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:41.791909 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a199c108-b27f-492e-b622-a9a05b55e571 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:41.913165 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.objects.instance [None req-a199c108-b27f-492e-b622-a9a05b55e571 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Lazy-loading 'services' on Instance uuid 67e13bce-be81-4775-be5f-737add9f1694 {{(pid=123596) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:36:41.995072 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-4a2426ce-ea2c-48e9-a8c6-4f49254fc81d tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013cb5ed545e4aa29e25e8a6af35db7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a71c255d30a42e785c18fc1ce2208bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:42.004500 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-4a2426ce-ea2c-48e9-a8c6-4f49254fc81d tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] 10.222.0.43 "GET /compute/v2.1/servers/1f956517-1701-4171-9227-03726c7e8fca" status: 200 len: 1314 microversion: 2.1 time: 0.251739 Oct 04 18:36:42.008790 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 677/1470] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:41 2022] GET /compute/v2.1/servers/1f956517-1701-4171-9227-03726c7e8fca => generated 1314 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:42.009374 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-a199c108-b27f-492e-b622-a9a05b55e571 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/67e13bce-be81-4775-be5f-737add9f1694" status: 200 len: 1935 microversion: 2.75 time: 0.248678 Oct 04 18:36:42.009967 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 794/1471] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:36:41 2022] GET /compute/v2.1/servers/67e13bce-be81-4775-be5f-737add9f1694 => generated 1935 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:36:42.013484 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-e7b92798-8556-4001-b1a0-9d4712791ac1 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Calling method '.version_select at 0x7fb21f7b0790>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:42.047861 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-680cd396-fa8f-4fb9-9736-6aa4db969f43 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Calling method '.version_select at 0x7fb227d591f0>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:42.132453 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-e7b92798-8556-4001-b1a0-9d4712791ac1 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] 10.222.0.43 "GET /compute/v2.1/images/c7776971-442e-4bf2-8d58-f38b00ff4b4a" status: 200 len: 1437 microversion: 2.1 time: 0.122464 Oct 04 18:36:42.135484 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 678/1472] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 18:36:42 2022] GET /compute/v2.1/images/c7776971-442e-4bf2-8d58-f38b00ff4b4a => generated 1437 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:42.141043 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-680cd396-fa8f-4fb9-9736-6aa4db969f43 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] 10.222.0.43 "GET /compute/v2.1/images/3adaa529-06f7-4c7d-8ad1-d56ec671ea9a" status: 200 len: 1424 microversion: 2.1 time: 0.100874 Oct 04 18:36:42.141744 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 795/1473] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 18:36:42 2022] GET /compute/v2.1/images/3adaa529-06f7-4c7d-8ad1-d56ec671ea9a => generated 1424 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:42.143378 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-2c864ff0-4083-4552-a361-0a241ed808a2 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:42.143975 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-2c864ff0-4083-4552-a361-0a241ed808a2 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: ce0d629a-068c-4a62-8a03-fc43fc0be9b3] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:42.152114 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2c864ff0-4083-4552-a361-0a241ed808a2 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:42.152665 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2c864ff0-4083-4552-a361-0a241ed808a2 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:42.153140 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2c864ff0-4083-4552-a361-0a241ed808a2 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:42.153827 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2c864ff0-4083-4552-a361-0a241ed808a2 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:42.154319 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2c864ff0-4083-4552-a361-0a241ed808a2 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:42.155003 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2c864ff0-4083-4552-a361-0a241ed808a2 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:42.265950 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-8ea3a186-e838-44b3-8347-1f188480737e tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:42.267637 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-8ea3a186-e838-44b3-8347-1f188480737e tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] [instance: 63543ce9-528e-4064-a6cd-6dd249104468] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:42.283277 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8ea3a186-e838-44b3-8347-1f188480737e tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:42.284117 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8ea3a186-e838-44b3-8347-1f188480737e tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:42.285048 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8ea3a186-e838-44b3-8347-1f188480737e tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:42.286345 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8ea3a186-e838-44b3-8347-1f188480737e tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:42.287271 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8ea3a186-e838-44b3-8347-1f188480737e tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:42.287932 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8ea3a186-e838-44b3-8347-1f188480737e tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:42.330381 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8ea3a186-e838-44b3-8347-1f188480737e tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:42.331248 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8ea3a186-e838-44b3-8347-1f188480737e tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:42.331845 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8ea3a186-e838-44b3-8347-1f188480737e tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:42.332452 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.objects.instance [None req-8ea3a186-e838-44b3-8347-1f188480737e tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lazy-loading 'fault' on Instance uuid 63543ce9-528e-4064-a6cd-6dd249104468 {{(pid=123596) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:36:42.368195 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-2c864ff0-4083-4552-a361-0a241ed808a2 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:42.376670 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-2c864ff0-4083-4552-a361-0a241ed808a2 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/ce0d629a-068c-4a62-8a03-fc43fc0be9b3" status: 200 len: 1477 microversion: 2.1 time: 0.239676 Oct 04 18:36:42.377692 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 679/1474] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:42 2022] GET /compute/v2.1/servers/ce0d629a-068c-4a62-8a03-fc43fc0be9b3 => generated 1477 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:42.392695 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-8ea3a186-e838-44b3-8347-1f188480737e tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64887fff0bc7417094c4fee2f7e9aa5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6187bfad04cb7bc17155862ee0cdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:42.404646 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-8ea3a186-e838-44b3-8347-1f188480737e tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] 10.222.0.43 "GET /compute/v2.1/servers/63543ce9-528e-4064-a6cd-6dd249104468" status: 200 len: 1307 microversion: 2.1 time: 0.144275 Oct 04 18:36:42.406438 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 796/1475] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:42 2022] GET /compute/v2.1/servers/63543ce9-528e-4064-a6cd-6dd249104468 => generated 1307 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:42.813029 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-b2ca5c2e-6919-40e4-9145-4942e44d20fb req-b72182c8-448d-4dfc-a6ff-a6c297102e88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f956517-1701-4171-9227-03726c7e8fca", "name": "network-vif-plugged", "status": "completed", "tag": "514cb875-d7dc-421d-b51a-0a154956df58"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:36:42.823339 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-b2ca5c2e-6919-40e4-9145-4942e44d20fb req-b72182c8-448d-4dfc-a6ff-a6c297102e88 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:42.824157 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-b2ca5c2e-6919-40e4-9145-4942e44d20fb req-b72182c8-448d-4dfc-a6ff-a6c297102e88 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:42.824888 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-b2ca5c2e-6919-40e4-9145-4942e44d20fb req-b72182c8-448d-4dfc-a6ff-a6c297102e88 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:42.837819 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-b2ca5c2e-6919-40e4-9145-4942e44d20fb req-b72182c8-448d-4dfc-a6ff-a6c297102e88 service nova] Creating event network-vif-plugged:514cb875-d7dc-421d-b51a-0a154956df58 for instance 1f956517-1701-4171-9227-03726c7e8fca on n-h1-851028-13 Oct 04 18:36:42.843188 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-b2ca5c2e-6919-40e4-9145-4942e44d20fb req-b72182c8-448d-4dfc-a6ff-a6c297102e88 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033703 Oct 04 18:36:42.843886 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 680/1476] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:36:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:36:43.030762 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-14c2cca1-75c4-43a9-b265-56bcd33f5a28 tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:43.031378 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-14c2cca1-75c4-43a9-b265-56bcd33f5a28 tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] [instance: 1f956517-1701-4171-9227-03726c7e8fca] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:43.039969 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-14c2cca1-75c4-43a9-b265-56bcd33f5a28 tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:43.040754 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-14c2cca1-75c4-43a9-b265-56bcd33f5a28 tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:43.062678 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-2dd19c63-2b9e-4a96-9e68-546440f107eb tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:43.063926 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-2dd19c63-2b9e-4a96-9e68-546440f107eb tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] [instance: 67e13bce-be81-4775-be5f-737add9f1694] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:43.067499 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-14c2cca1-75c4-43a9-b265-56bcd33f5a28 tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:43.068492 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-14c2cca1-75c4-43a9-b265-56bcd33f5a28 tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:43.071094 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-14c2cca1-75c4-43a9-b265-56bcd33f5a28 tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:43.071812 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-14c2cca1-75c4-43a9-b265-56bcd33f5a28 tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:43.078211 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2dd19c63-2b9e-4a96-9e68-546440f107eb tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:43.078826 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2dd19c63-2b9e-4a96-9e68-546440f107eb tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:43.079327 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2dd19c63-2b9e-4a96-9e68-546440f107eb tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:43.080445 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2dd19c63-2b9e-4a96-9e68-546440f107eb tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:43.080882 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2dd19c63-2b9e-4a96-9e68-546440f107eb tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:43.081393 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2dd19c63-2b9e-4a96-9e68-546440f107eb tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:43.191557 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.objects.instance [None req-2dd19c63-2b9e-4a96-9e68-546440f107eb tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Lazy-loading 'services' on Instance uuid 67e13bce-be81-4775-be5f-737add9f1694 {{(pid=123595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:36:43.231126 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-2dd19c63-2b9e-4a96-9e68-546440f107eb tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/67e13bce-be81-4775-be5f-737add9f1694" status: 200 len: 1935 microversion: 2.75 time: 0.181595 Oct 04 18:36:43.252368 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 681/1477] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:36:43 2022] GET /compute/v2.1/servers/67e13bce-be81-4775-be5f-737add9f1694 => generated 1935 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:36:43.265446 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-0b39247d-e2cc-4269-966c-b47ffbf037b7 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Calling method '.version_select at 0x7fb21f7b0b80>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:43.348884 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-0b39247d-e2cc-4269-966c-b47ffbf037b7 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] 10.222.0.43 "GET /compute/v2.1/images/c7776971-442e-4bf2-8d58-f38b00ff4b4a" status: 200 len: 1446 microversion: 2.1 time: 0.093847 Oct 04 18:36:43.356267 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-14c2cca1-75c4-43a9-b265-56bcd33f5a28 tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013cb5ed545e4aa29e25e8a6af35db7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a71c255d30a42e785c18fc1ce2208bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:43.365100 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-14c2cca1-75c4-43a9-b265-56bcd33f5a28 tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] 10.222.0.43 "GET /compute/v2.1/servers/1f956517-1701-4171-9227-03726c7e8fca" status: 200 len: 1314 microversion: 2.1 time: 0.337946 Oct 04 18:36:43.365100 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 797/1478] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:43 2022] GET /compute/v2.1/servers/1f956517-1701-4171-9227-03726c7e8fca => generated 1314 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:43.371066 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-b46648d5-0dac-4347-916a-420441423d4f tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Calling method '.version_select at 0x7fb227e021f0>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:43.378357 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 682/1479] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 18:36:43 2022] GET /compute/v2.1/images/c7776971-442e-4bf2-8d58-f38b00ff4b4a => generated 1446 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:43.396518 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-95667b03-e7c3-443b-ac4d-f5fdc2d27899 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Calling method '.version_select at 0x7fb21f7e9ee0>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:43.456428 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-b46648d5-0dac-4347-916a-420441423d4f tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] 10.222.0.43 "GET /compute/v2.1/images/3adaa529-06f7-4c7d-8ad1-d56ec671ea9a" status: 200 len: 1424 microversion: 2.1 time: 0.089653 Oct 04 18:36:43.457016 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 798/1480] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 18:36:43 2022] GET /compute/v2.1/images/3adaa529-06f7-4c7d-8ad1-d56ec671ea9a => generated 1424 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:43.468713 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-8ca43f61-5e0b-4c06-b890-b6238e620765 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:43.468930 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-95667b03-e7c3-443b-ac4d-f5fdc2d27899 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] 10.222.0.43 "GET /compute/v2.1/images/c7776971-442e-4bf2-8d58-f38b00ff4b4a" status: 200 len: 1446 microversion: 2.1 time: 0.088275 Oct 04 18:36:43.469747 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-8ca43f61-5e0b-4c06-b890-b6238e620765 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: ce0d629a-068c-4a62-8a03-fc43fc0be9b3] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:43.470149 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 683/1481] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 18:36:43 2022] GET /compute/v2.1/images/c7776971-442e-4bf2-8d58-f38b00ff4b4a => generated 1446 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:43.475393 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-6f8046b7-6a02-4158-9d33-c7d479bd5df4 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:43.476259 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-6f8046b7-6a02-4158-9d33-c7d479bd5df4 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] [instance: 63543ce9-528e-4064-a6cd-6dd249104468] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:43.483664 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8ca43f61-5e0b-4c06-b890-b6238e620765 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:43.484160 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8ca43f61-5e0b-4c06-b890-b6238e620765 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:43.484600 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8ca43f61-5e0b-4c06-b890-b6238e620765 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:43.486213 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6f8046b7-6a02-4158-9d33-c7d479bd5df4 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:43.486882 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6f8046b7-6a02-4158-9d33-c7d479bd5df4 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:43.487490 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6f8046b7-6a02-4158-9d33-c7d479bd5df4 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:43.488375 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8ca43f61-5e0b-4c06-b890-b6238e620765 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:43.488607 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6f8046b7-6a02-4158-9d33-c7d479bd5df4 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:43.488893 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8ca43f61-5e0b-4c06-b890-b6238e620765 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:43.489379 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8ca43f61-5e0b-4c06-b890-b6238e620765 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:43.489622 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6f8046b7-6a02-4158-9d33-c7d479bd5df4 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:43.490211 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6f8046b7-6a02-4158-9d33-c7d479bd5df4 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:43.542021 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6f8046b7-6a02-4158-9d33-c7d479bd5df4 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:43.543028 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6f8046b7-6a02-4158-9d33-c7d479bd5df4 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:43.543714 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6f8046b7-6a02-4158-9d33-c7d479bd5df4 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:43.544553 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.objects.instance [None req-6f8046b7-6a02-4158-9d33-c7d479bd5df4 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lazy-loading 'fault' on Instance uuid 63543ce9-528e-4064-a6cd-6dd249104468 {{(pid=123595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:36:43.709960 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-8ca43f61-5e0b-4c06-b890-b6238e620765 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:43.718791 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-8ca43f61-5e0b-4c06-b890-b6238e620765 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/ce0d629a-068c-4a62-8a03-fc43fc0be9b3" status: 200 len: 1477 microversion: 2.1 time: 0.259888 Oct 04 18:36:43.733677 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 799/1482] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:43 2022] GET /compute/v2.1/servers/ce0d629a-068c-4a62-8a03-fc43fc0be9b3 => generated 1477 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:43.742264 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-8577167b-47bb-46d3-85c6-3a2fb0d20d3e tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Calling method '.version_select at 0x7fb227f554c0>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:43.784819 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-6f8046b7-6a02-4158-9d33-c7d479bd5df4 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64887fff0bc7417094c4fee2f7e9aa5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6187bfad04cb7bc17155862ee0cdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:43.795929 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-6f8046b7-6a02-4158-9d33-c7d479bd5df4 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] 10.222.0.43 "GET /compute/v2.1/servers/63543ce9-528e-4064-a6cd-6dd249104468" status: 200 len: 1307 microversion: 2.1 time: 0.322519 Oct 04 18:36:43.797426 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 684/1483] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:43 2022] GET /compute/v2.1/servers/63543ce9-528e-4064-a6cd-6dd249104468 => generated 1307 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:44.272647 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-914f3c30-e75e-4ecf-9ff3-862d39687190 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:44.273362 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-914f3c30-e75e-4ecf-9ff3-862d39687190 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] [instance: 67e13bce-be81-4775-be5f-737add9f1694] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:44.286380 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-914f3c30-e75e-4ecf-9ff3-862d39687190 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:44.287134 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-914f3c30-e75e-4ecf-9ff3-862d39687190 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:44.287725 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-914f3c30-e75e-4ecf-9ff3-862d39687190 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:44.288946 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-914f3c30-e75e-4ecf-9ff3-862d39687190 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:44.290560 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-914f3c30-e75e-4ecf-9ff3-862d39687190 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:44.291152 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-914f3c30-e75e-4ecf-9ff3-862d39687190 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:44.476354 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.objects.instance [None req-914f3c30-e75e-4ecf-9ff3-862d39687190 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Lazy-loading 'services' on Instance uuid 67e13bce-be81-4775-be5f-737add9f1694 {{(pid=123595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:36:44.509349 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-914f3c30-e75e-4ecf-9ff3-862d39687190 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/67e13bce-be81-4775-be5f-737add9f1694" status: 200 len: 1935 microversion: 2.75 time: 0.242480 Oct 04 18:36:44.525165 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 685/1484] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:36:44 2022] GET /compute/v2.1/servers/67e13bce-be81-4775-be5f-737add9f1694 => generated 1935 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:36:44.528007 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-80284f70-20d1-4743-902a-4b0908c77326 tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:44.530216 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-80284f70-20d1-4743-902a-4b0908c77326 tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] [instance: 1f956517-1701-4171-9227-03726c7e8fca] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:44.539574 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-80284f70-20d1-4743-902a-4b0908c77326 tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:44.540157 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-80284f70-20d1-4743-902a-4b0908c77326 tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:44.540790 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-80284f70-20d1-4743-902a-4b0908c77326 tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:44.541874 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-80284f70-20d1-4743-902a-4b0908c77326 tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:44.542930 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-80284f70-20d1-4743-902a-4b0908c77326 tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:44.543484 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-80284f70-20d1-4743-902a-4b0908c77326 tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:44.570857 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-8577167b-47bb-46d3-85c6-3a2fb0d20d3e tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] 10.222.0.43 "DELETE /compute/v2.1/images/c7776971-442e-4bf2-8d58-f38b00ff4b4a" status: 204 len: 0 microversion: 2.1 time: 0.835451 Oct 04 18:36:44.572278 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 800/1485] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:43 2022] DELETE /compute/v2.1/images/c7776971-442e-4bf2-8d58-f38b00ff4b4a => generated 0 bytes in 838 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:36:44.577667 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-1066fc3f-a2ab-4906-84e8-c7b10193d307 tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:44.578549 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-1066fc3f-a2ab-4906-84e8-c7b10193d307 tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] [instance: 7222a4ce-d2a2-4b09-afc6-55bca52414d4] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:44.585068 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1066fc3f-a2ab-4906-84e8-c7b10193d307 tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:44.585827 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1066fc3f-a2ab-4906-84e8-c7b10193d307 tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:44.587153 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1066fc3f-a2ab-4906-84e8-c7b10193d307 tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:44.588147 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1066fc3f-a2ab-4906-84e8-c7b10193d307 tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:44.588812 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1066fc3f-a2ab-4906-84e8-c7b10193d307 tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:44.589502 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1066fc3f-a2ab-4906-84e8-c7b10193d307 tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:44.753286 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-80284f70-20d1-4743-902a-4b0908c77326 tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013cb5ed545e4aa29e25e8a6af35db7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a71c255d30a42e785c18fc1ce2208bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:44.763345 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-80284f70-20d1-4743-902a-4b0908c77326 tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] 10.222.0.43 "GET /compute/v2.1/servers/1f956517-1701-4171-9227-03726c7e8fca" status: 200 len: 1314 microversion: 2.1 time: 0.247136 Oct 04 18:36:44.763942 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 686/1486] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:44 2022] GET /compute/v2.1/servers/1f956517-1701-4171-9227-03726c7e8fca => generated 1314 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:44.769192 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-3cd72d80-e2db-48f7-9dda-67518f2a86e5 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Calling method '.version_select at 0x7fb21f785310>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:44.834727 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-3cd72d80-e2db-48f7-9dda-67518f2a86e5 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] 10.222.0.43 "GET /compute/v2.1/images/3adaa529-06f7-4c7d-8ad1-d56ec671ea9a" status: 200 len: 1424 microversion: 2.1 time: 0.069143 Oct 04 18:36:44.835578 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 687/1487] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 18:36:44 2022] GET /compute/v2.1/images/3adaa529-06f7-4c7d-8ad1-d56ec671ea9a => generated 1424 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:44.840062 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-3dd353ef-24a1-4ee0-8ea5-87bc33d232b4 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:44.840796 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-3dd353ef-24a1-4ee0-8ea5-87bc33d232b4 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] [instance: 9ee1bd28-0921-4444-afe3-c09cbfa0680a] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:44.847465 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3dd353ef-24a1-4ee0-8ea5-87bc33d232b4 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:44.848132 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3dd353ef-24a1-4ee0-8ea5-87bc33d232b4 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:44.848636 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3dd353ef-24a1-4ee0-8ea5-87bc33d232b4 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:44.849447 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3dd353ef-24a1-4ee0-8ea5-87bc33d232b4 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:44.849987 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3dd353ef-24a1-4ee0-8ea5-87bc33d232b4 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:44.850484 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3dd353ef-24a1-4ee0-8ea5-87bc33d232b4 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:44.879050 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-3dd353ef-24a1-4ee0-8ea5-87bc33d232b4 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] [instance: 9ee1bd28-0921-4444-afe3-c09cbfa0680a] Going to try to terminate instance {{(pid=123595) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:36:44.920451 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.objects.instance [None req-1066fc3f-a2ab-4906-84e8-c7b10193d307 tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] Lazy-loading 'services' on Instance uuid 7222a4ce-d2a2-4b09-afc6-55bca52414d4 {{(pid=123596) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:36:44.944585 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-1066fc3f-a2ab-4906-84e8-c7b10193d307 tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/7222a4ce-d2a2-4b09-afc6-55bca52414d4" status: 200 len: 2425 microversion: 2.25 time: 0.370849 Oct 04 18:36:44.954506 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 801/1488] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:36:44 2022] GET /compute/v2.1/servers/7222a4ce-d2a2-4b09-afc6-55bca52414d4 => generated 2425 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:36:44.967098 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-01611948-24e1-4c62-bfa8-cbe1dbcfeba0 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:44.968565 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-01611948-24e1-4c62-bfa8-cbe1dbcfeba0 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: ce0d629a-068c-4a62-8a03-fc43fc0be9b3] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:44.993773 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-01611948-24e1-4c62-bfa8-cbe1dbcfeba0 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:44.994595 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-01611948-24e1-4c62-bfa8-cbe1dbcfeba0 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:44.995382 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-01611948-24e1-4c62-bfa8-cbe1dbcfeba0 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:44.996438 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-01611948-24e1-4c62-bfa8-cbe1dbcfeba0 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:44.997200 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-01611948-24e1-4c62-bfa8-cbe1dbcfeba0 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:44.997872 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-01611948-24e1-4c62-bfa8-cbe1dbcfeba0 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:45.041431 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-3dd353ef-24a1-4ee0-8ea5-87bc33d232b4 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] 10.222.0.43 "DELETE /compute/v2.1/servers/9ee1bd28-0921-4444-afe3-c09cbfa0680a" status: 204 len: 0 microversion: 2.1 time: 0.202958 Oct 04 18:36:45.042426 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 688/1489] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 18:36:44 2022] DELETE /compute/v2.1/servers/9ee1bd28-0921-4444-afe3-c09cbfa0680a => generated 0 bytes in 206 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:36:45.081442 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-a8b96518-38e8-4161-96a6-cef0f05e194c tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:45.083289 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-a8b96518-38e8-4161-96a6-cef0f05e194c tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] [instance: 63543ce9-528e-4064-a6cd-6dd249104468] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:45.102190 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a8b96518-38e8-4161-96a6-cef0f05e194c tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:45.103678 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a8b96518-38e8-4161-96a6-cef0f05e194c tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:45.104352 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a8b96518-38e8-4161-96a6-cef0f05e194c tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:45.105161 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a8b96518-38e8-4161-96a6-cef0f05e194c tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:45.105608 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a8b96518-38e8-4161-96a6-cef0f05e194c tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:45.108548 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a8b96518-38e8-4161-96a6-cef0f05e194c tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:45.134288 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-a8b96518-38e8-4161-96a6-cef0f05e194c tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] HTTP exception thrown: Instance 63543ce9-528e-4064-a6cd-6dd249104468 could not be found. Oct 04 18:36:45.137935 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-a8b96518-38e8-4161-96a6-cef0f05e194c tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Request method failure captured: Oct 04 18:36:45.137935 n-d-851028-13 devstack@n-api.service[123595]: request: GET /compute/v2.1/servers/63543ce9-528e-4064-a6cd-6dd249104468 HTTP/1.1 Oct 04 18:36:45.137935 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 18:36:45.137935 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 18:36:45.137935 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 18:36:45.137935 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 0 Oct 04 18:36:45.137935 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 18:36:45.137935 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 18:36:45.137935 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 18:36:45.137935 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 18:36:45.137935 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPHyRpx9Vi7hlUpPB369niRBxdu4Tbz1_IwmyOHt6h_OXXj-uJmvUoFTRUHlWXGc_-uDdGrSQsoBiSoOmzZLa0L_oIG-VrHpSBN7BeRmoSgDp0TpnTIRFhm6vKPEsF1Gk1W6YNQk-mB5F7I7nx-pqqvHFj2gju6lXDpM_KJpEkUufITw Oct 04 18:36:45.137935 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 18:36:45.137935 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 18:36:45.137935 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 18:36:45.137935 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 18:36:45.137935 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 18:36:45.137935 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 18:36:45.137935 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: a1d6187bfad04cb7bc17155862ee0cdc Oct 04 18:36:45.137935 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-VolumesAdminNegativeTest-600132423 Oct 04 18:36:45.137935 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 18:36:45.137935 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 18:36:45.137935 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/a1d6187bfad04cb7bc17155862ee0cdc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_a1d6187bfad04cb7bc17155862ee0cdc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a1d6187bfad04cb7bc17155862ee0cdc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a1d6187bfad04cb7bc17155862ee0cdc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:36:45.137935 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-VolumesAdminNegativeTest-600132423 Oct 04 18:36:45.137935 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: a1d6187bfad04cb7bc17155862ee0cdc Oct 04 18:36:45.137935 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-600132423 Oct 04 18:36:45.137935 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-VolumesAdminNegativeTest-600132423-project Oct 04 18:36:45.137935 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 18:36:45.137935 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 18:36:45.137935 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: 64887fff0bc7417094c4fee2f7e9aa5a Oct 04 18:36:45.137935 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-VolumesAdminNegativeTest-600132423-project Oct 04 18:36:45.137935 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 18:36:45.137935 n-d-851028-13 devstack@n-api.service[123595]: exception: Instance 63543ce9-528e-4064-a6cd-6dd249104468 could not be found. Oct 04 18:36:45.137935 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': '63543ce9-528e-4064-a6cd-6dd249104468'} Oct 04 18:36:45.137935 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:36:45.137935 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:36:45.137935 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:36:45.137935 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:36:45.137935 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:36:45.137935 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:36:45.137935 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:36:45.137935 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:36:45.137935 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:36:45.137935 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:36:45.137935 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 63543ce9-528e-4064-a6cd-6dd249104468 could not be found. Oct 04 18:36:45.137935 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:36:45.137935 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:36:45.137935 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:36:45.137935 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:36:45.137935 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:36:45.137935 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:36:45.137935 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:36:45.137935 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:36:45.137935 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:36:45.137935 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:36:45.137935 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:36:45.137935 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:36:45.137935 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:36:45.137935 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:36:45.137935 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:36:45.137935 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:36:45.137935 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 63543ce9-528e-4064-a6cd-6dd249104468 could not be found. Oct 04 18:36:45.137935 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:36:45.137935 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:36:45.137935 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:36:45.142597 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:36:45.142597 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:36:45.142597 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:36:45.142597 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:36:45.142597 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:36:45.142597 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 63543ce9-528e-4064-a6cd-6dd249104468 could not be found. Oct 04 18:36:45.142597 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:36:45.146122 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-a8b96518-38e8-4161-96a6-cef0f05e194c tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Returning 404 to user: Instance 63543ce9-528e-4064-a6cd-6dd249104468 could not be found. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:36:45.147408 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-a8b96518-38e8-4161-96a6-cef0f05e194c tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] 10.222.0.43 "GET /compute/v2.1/servers/63543ce9-528e-4064-a6cd-6dd249104468" status: 404 len: 111 microversion: 2.1 time: 0.100674 Oct 04 18:36:45.149009 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 689/1490] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:45 2022] GET /compute/v2.1/servers/63543ce9-528e-4064-a6cd-6dd249104468 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:36:45.156640 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-482ea797-b10b-45f8-9c5e-8a15b4f09947 tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-851028-13", "block_migration": "auto"}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:36:45.160293 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-482ea797-b10b-45f8-9c5e-8a15b4f09947 tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] [instance: 7222a4ce-d2a2-4b09-afc6-55bca52414d4] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:45.170189 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-482ea797-b10b-45f8-9c5e-8a15b4f09947 tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:45.170808 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-482ea797-b10b-45f8-9c5e-8a15b4f09947 tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:45.171346 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-482ea797-b10b-45f8-9c5e-8a15b4f09947 tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:45.172639 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-482ea797-b10b-45f8-9c5e-8a15b4f09947 tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:45.172639 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-482ea797-b10b-45f8-9c5e-8a15b4f09947 tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:45.173327 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-482ea797-b10b-45f8-9c5e-8a15b4f09947 tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:45.227494 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.objects.instance [None req-482ea797-b10b-45f8-9c5e-8a15b4f09947 tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] Lazy-loading 'flavor' on Instance uuid 7222a4ce-d2a2-4b09-afc6-55bca52414d4 {{(pid=123595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:36:45.255987 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-482ea797-b10b-45f8-9c5e-8a15b4f09947 tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] [instance: 7222a4ce-d2a2-4b09-afc6-55bca52414d4] Going to try to live migrate instance to n-h2-851028-13 {{(pid=123595) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 04 18:36:45.521714 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-01611948-24e1-4c62-bfa8-cbe1dbcfeba0 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:45.534327 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-01611948-24e1-4c62-bfa8-cbe1dbcfeba0 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/ce0d629a-068c-4a62-8a03-fc43fc0be9b3" status: 200 len: 1477 microversion: 2.1 time: 0.576613 Oct 04 18:36:45.544325 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 802/1491] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:44 2022] GET /compute/v2.1/servers/ce0d629a-068c-4a62-8a03-fc43fc0be9b3 => generated 1477 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:45.550511 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-e4a02bd3-affb-457b-a573-578784b86924 req-3ae08df9-de31-454d-a9ea-026ac41f4868 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4231fdff-39dd-49a6-bea2-5edea44c3582", "name": "network-vif-plugged", "status": "completed", "tag": "ee13bc47-8284-46ee-acc8-f29243243bf5"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:36:45.579360 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-e4a02bd3-affb-457b-a573-578784b86924 req-3ae08df9-de31-454d-a9ea-026ac41f4868 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:45.580150 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-e4a02bd3-affb-457b-a573-578784b86924 req-3ae08df9-de31-454d-a9ea-026ac41f4868 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:45.580591 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-e4a02bd3-affb-457b-a573-578784b86924 req-3ae08df9-de31-454d-a9ea-026ac41f4868 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:45.597303 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-e4a02bd3-affb-457b-a573-578784b86924 req-3ae08df9-de31-454d-a9ea-026ac41f4868 service nova] Creating event network-vif-plugged:ee13bc47-8284-46ee-acc8-f29243243bf5 for instance 4231fdff-39dd-49a6-bea2-5edea44c3582 on n-h1-851028-13 Oct 04 18:36:45.621525 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-e4a02bd3-affb-457b-a573-578784b86924 req-3ae08df9-de31-454d-a9ea-026ac41f4868 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075297 Oct 04 18:36:45.629989 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 803/1492] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:36:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:36:45.654381 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-4fe50c81-5811-48cf-8404-1180839d6ec8 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1109084443", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452", "networks": [{"uuid": "8427bdfe-80f6-4509-a949-365d3d4b4e33"}]}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:36:45.745239 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.network.neutron [None req-4fe50c81-5811-48cf-8404-1180839d6ec8 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] validate_networks() for [('8427bdfe-80f6-4509-a949-365d3d4b4e33', None, None, None, None, None)] {{(pid=123596) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:36:47.038033 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-4fe50c81-5811-48cf-8404-1180839d6ec8 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Flavor limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:36:47.040197 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-4fe50c81-5811-48cf-8404-1180839d6ec8 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Image limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:36:47.041036 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-4fe50c81-5811-48cf-8404-1180839d6ec8 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Flavor pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:36:47.041725 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-4fe50c81-5811-48cf-8404-1180839d6ec8 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Image pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:36:47.042386 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-4fe50c81-5811-48cf-8404-1180839d6ec8 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:36:47.056686 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4fe50c81-5811-48cf-8404-1180839d6ec8 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:47.057642 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4fe50c81-5811-48cf-8404-1180839d6ec8 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:47.058328 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4fe50c81-5811-48cf-8404-1180839d6ec8 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:47.059468 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4fe50c81-5811-48cf-8404-1180839d6ec8 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:47.060163 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4fe50c81-5811-48cf-8404-1180839d6ec8 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:47.060834 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4fe50c81-5811-48cf-8404-1180839d6ec8 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:47.086601 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-4fe50c81-5811-48cf-8404-1180839d6ec8 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Getting quotas for project 4fa31ed92017490a82497c7b8910aef0. Resources: {'ram', 'cores', 'instances'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:36:47.091912 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-4fe50c81-5811-48cf-8404-1180839d6ec8 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Getting quotas for user 5a41ab6fb78a42ceaca621c5a38ffc6d and project 4fa31ed92017490a82497c7b8910aef0. Resources: {'ram', 'cores', 'instances'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:36:47.106799 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-4fe50c81-5811-48cf-8404-1180839d6ec8 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Going to run 1 instances... {{(pid=123596) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:36:47.109743 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-4fe50c81-5811-48cf-8404-1180839d6ec8 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] [instance: 64228016-ae20-4fcb-87da-c3d4d585e241] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e8943ec5-4038-4d4b-b9b9-2415a79f5243',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123596) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:36:47.185374 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-4fe50c81-5811-48cf-8404-1180839d6ec8 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.548991 Oct 04 18:36:47.189354 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 804/1493] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 18:36:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 1559 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:36:47.215589 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-529c5ee4-47ff-489a-89c8-c7f6a6078952 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:47.219145 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-529c5ee4-47ff-489a-89c8-c7f6a6078952 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] [instance: 67e13bce-be81-4775-be5f-737add9f1694] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:47.235696 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-529c5ee4-47ff-489a-89c8-c7f6a6078952 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:47.239239 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-529c5ee4-47ff-489a-89c8-c7f6a6078952 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:47.240334 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-529c5ee4-47ff-489a-89c8-c7f6a6078952 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:47.241465 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-529c5ee4-47ff-489a-89c8-c7f6a6078952 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:47.242322 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-529c5ee4-47ff-489a-89c8-c7f6a6078952 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:47.243287 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-529c5ee4-47ff-489a-89c8-c7f6a6078952 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:47.688306 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.objects.instance [None req-529c5ee4-47ff-489a-89c8-c7f6a6078952 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] Lazy-loading 'services' on Instance uuid 67e13bce-be81-4775-be5f-737add9f1694 {{(pid=123596) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:36:47.760501 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-529c5ee4-47ff-489a-89c8-c7f6a6078952 tempest-ServersAdmin275Test-1404286905 tempest-ServersAdmin275Test-1404286905-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/67e13bce-be81-4775-be5f-737add9f1694" status: 200 len: 1920 microversion: 2.75 time: 0.569798 Oct 04 18:36:47.767498 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 805/1494] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:36:47 2022] GET /compute/v2.1/servers/67e13bce-be81-4775-be5f-737add9f1694 => generated 1920 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:36:47.778604 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-7c4c6b51-8f85-40f2-b63a-a0046ed412b8 tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:47.780734 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-7c4c6b51-8f85-40f2-b63a-a0046ed412b8 tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] [instance: 1f956517-1701-4171-9227-03726c7e8fca] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:47.816485 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7c4c6b51-8f85-40f2-b63a-a0046ed412b8 tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:47.817552 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7c4c6b51-8f85-40f2-b63a-a0046ed412b8 tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:47.818207 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7c4c6b51-8f85-40f2-b63a-a0046ed412b8 tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:47.819268 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7c4c6b51-8f85-40f2-b63a-a0046ed412b8 tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:47.820073 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7c4c6b51-8f85-40f2-b63a-a0046ed412b8 tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:47.822926 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7c4c6b51-8f85-40f2-b63a-a0046ed412b8 tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:48.586942 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-7c4c6b51-8f85-40f2-b63a-a0046ed412b8 tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013cb5ed545e4aa29e25e8a6af35db7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a71c255d30a42e785c18fc1ce2208bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:48.606204 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-7c4c6b51-8f85-40f2-b63a-a0046ed412b8 tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] 10.222.0.43 "GET /compute/v2.1/servers/1f956517-1701-4171-9227-03726c7e8fca" status: 200 len: 1464 microversion: 2.1 time: 0.837375 Oct 04 18:36:48.621561 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 806/1495] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:47 2022] GET /compute/v2.1/servers/1f956517-1701-4171-9227-03726c7e8fca => generated 1464 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:48.630947 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-6cdfba87-bd94-43e5-a8f0-072d0f226625 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Calling method '.version_select at 0x7fb21fb53ee0>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:48.756544 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-6cdfba87-bd94-43e5-a8f0-072d0f226625 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] 10.222.0.43 "GET /compute/v2.1/images/3adaa529-06f7-4c7d-8ad1-d56ec671ea9a" status: 200 len: 1424 microversion: 2.1 time: 0.133526 Oct 04 18:36:48.763259 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 807/1496] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 18:36:48 2022] GET /compute/v2.1/images/3adaa529-06f7-4c7d-8ad1-d56ec671ea9a => generated 1424 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:48.777590 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-482ea797-b10b-45f8-9c5e-8a15b4f09947 tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] 10.222.0.43 "POST /compute/v2.1/servers/7222a4ce-d2a2-4b09-afc6-55bca52414d4/action" status: 202 len: 0 microversion: 2.25 time: 3.625974 Oct 04 18:36:48.780788 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 690/1497] 10.222.0.43 () {62 vars in 1319 bytes} [Tue Oct 4 18:36:45 2022] POST /compute/v2.1/servers/7222a4ce-d2a2-4b09-afc6-55bca52414d4/action => generated 0 bytes in 3631 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:36:48.793406 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-7016a6e8-1ae9-4dfb-9fc4-f0a6136d17ff tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:48.794419 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-7016a6e8-1ae9-4dfb-9fc4-f0a6136d17ff tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] [instance: 64228016-ae20-4fcb-87da-c3d4d585e241] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:48.797801 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f596a814-c1fb-40a5-ad6e-3d117cbddc42 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:48.809590 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-f596a814-c1fb-40a5-ad6e-3d117cbddc42 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: ce0d629a-068c-4a62-8a03-fc43fc0be9b3] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:48.840264 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7016a6e8-1ae9-4dfb-9fc4-f0a6136d17ff tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:48.844425 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f596a814-c1fb-40a5-ad6e-3d117cbddc42 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:48.846587 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7016a6e8-1ae9-4dfb-9fc4-f0a6136d17ff tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:48.847581 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f596a814-c1fb-40a5-ad6e-3d117cbddc42 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:48.848316 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7016a6e8-1ae9-4dfb-9fc4-f0a6136d17ff tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:48.849006 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f596a814-c1fb-40a5-ad6e-3d117cbddc42 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:48.850197 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7016a6e8-1ae9-4dfb-9fc4-f0a6136d17ff tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:48.852326 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7016a6e8-1ae9-4dfb-9fc4-f0a6136d17ff tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:48.852752 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f596a814-c1fb-40a5-ad6e-3d117cbddc42 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:48.853729 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f596a814-c1fb-40a5-ad6e-3d117cbddc42 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:48.854334 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f596a814-c1fb-40a5-ad6e-3d117cbddc42 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:48.855084 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7016a6e8-1ae9-4dfb-9fc4-f0a6136d17ff tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:49.041841 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-7016a6e8-1ae9-4dfb-9fc4-f0a6136d17ff tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a41ab6fb78a42ceaca621c5a38ffc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa31ed92017490a82497c7b8910aef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:49.059405 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-7016a6e8-1ae9-4dfb-9fc4-f0a6136d17ff tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] 10.222.0.43 "GET /compute/v2.1/servers/64228016-ae20-4fcb-87da-c3d4d585e241" status: 200 len: 1204 microversion: 2.1 time: 0.277268 Oct 04 18:36:49.065938 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 691/1498] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:48 2022] GET /compute/v2.1/servers/64228016-ae20-4fcb-87da-c3d4d585e241 => generated 1204 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:49.528830 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-bb70a69c-37d6-4318-b004-cd43fa5bcb50 req-f51f0f38-f42d-4890-b270-638474fa5888 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ee1bd28-0921-4444-afe3-c09cbfa0680a", "name": "network-vif-unplugged", "status": "completed", "tag": "9b0949c2-7109-4d21-a62e-7d24d18a41c0"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:36:49.560754 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-bb70a69c-37d6-4318-b004-cd43fa5bcb50 req-f51f0f38-f42d-4890-b270-638474fa5888 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:49.565192 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-bb70a69c-37d6-4318-b004-cd43fa5bcb50 req-f51f0f38-f42d-4890-b270-638474fa5888 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:49.566100 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-bb70a69c-37d6-4318-b004-cd43fa5bcb50 req-f51f0f38-f42d-4890-b270-638474fa5888 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:49.574954 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:36:49.597158 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-bb70a69c-37d6-4318-b004-cd43fa5bcb50 req-f51f0f38-f42d-4890-b270-638474fa5888 service nova] Creating event network-vif-unplugged:9b0949c2-7109-4d21-a62e-7d24d18a41c0 for instance 9ee1bd28-0921-4444-afe3-c09cbfa0680a on n-h2-851028-13 Oct 04 18:36:49.617153 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-bb70a69c-37d6-4318-b004-cd43fa5bcb50 req-f51f0f38-f42d-4890-b270-638474fa5888 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.549258 Oct 04 18:36:49.620670 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 692/1499] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:36:49 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:36:49.629085 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-8a3fe92b-4b70-44db-aac1-66deb6b460f5 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:49.639485 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-8a3fe92b-4b70-44db-aac1-66deb6b460f5 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] [instance: 67e13bce-be81-4775-be5f-737add9f1694] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:49.685329 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8a3fe92b-4b70-44db-aac1-66deb6b460f5 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:49.689866 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8a3fe92b-4b70-44db-aac1-66deb6b460f5 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:49.690928 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8a3fe92b-4b70-44db-aac1-66deb6b460f5 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:49.693151 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8a3fe92b-4b70-44db-aac1-66deb6b460f5 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:49.696283 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8a3fe92b-4b70-44db-aac1-66deb6b460f5 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:49.699807 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8a3fe92b-4b70-44db-aac1-66deb6b460f5 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:49.823044 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-8a3fe92b-4b70-44db-aac1-66deb6b460f5 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] [instance: 67e13bce-be81-4775-be5f-737add9f1694] Going to try to terminate instance {{(pid=123595) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:36:50.034571 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-f596a814-c1fb-40a5-ad6e-3d117cbddc42 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:50.048451 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-f596a814-c1fb-40a5-ad6e-3d117cbddc42 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/ce0d629a-068c-4a62-8a03-fc43fc0be9b3" status: 200 len: 1477 microversion: 2.1 time: 1.282063 Oct 04 18:36:50.070631 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 808/1500] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:48 2022] GET /compute/v2.1/servers/ce0d629a-068c-4a62-8a03-fc43fc0be9b3 => generated 1477 bytes in 1306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:50.369438 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-8a3fe92b-4b70-44db-aac1-66deb6b460f5 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] 10.222.0.43 "DELETE /compute/v2.1/servers/67e13bce-be81-4775-be5f-737add9f1694" status: 204 len: 0 microversion: 2.75 time: 0.744220 Oct 04 18:36:50.372215 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 693/1501] 10.222.0.43 () {60 vars in 1280 bytes} [Tue Oct 4 18:36:49 2022] DELETE /compute/v2.1/servers/67e13bce-be81-4775-be5f-737add9f1694 => generated 0 bytes in 751 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 18:36:50.386408 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-d4d6e21d-3d6b-4ae5-91d4-d67c74b21af1 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:50.406918 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-d4d6e21d-3d6b-4ae5-91d4-d67c74b21af1 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] [instance: 7222a4ce-d2a2-4b09-afc6-55bca52414d4] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:50.430552 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d4d6e21d-3d6b-4ae5-91d4-d67c74b21af1 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:50.431140 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d4d6e21d-3d6b-4ae5-91d4-d67c74b21af1 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:50.431782 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d4d6e21d-3d6b-4ae5-91d4-d67c74b21af1 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:50.432648 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d4d6e21d-3d6b-4ae5-91d4-d67c74b21af1 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:50.453773 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d4d6e21d-3d6b-4ae5-91d4-d67c74b21af1 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:50.457076 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d4d6e21d-3d6b-4ae5-91d4-d67c74b21af1 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:50.565129 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-63a93b29-9012-4e1c-96d9-043639c68ea8 tempest-TenantUsagesTestJSON-2147123429 tempest-TenantUsagesTestJSON-2147123429-project-admin] Calling method '.version_select at 0x7fb21fb03ee0>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:50.583455 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-63a93b29-9012-4e1c-96d9-043639c68ea8 tempest-TenantUsagesTestJSON-2147123429 tempest-TenantUsagesTestJSON-2147123429-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:50.584204 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-63a93b29-9012-4e1c-96d9-043639c68ea8 tempest-TenantUsagesTestJSON-2147123429 tempest-TenantUsagesTestJSON-2147123429-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:50.584811 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-63a93b29-9012-4e1c-96d9-043639c68ea8 tempest-TenantUsagesTestJSON-2147123429 tempest-TenantUsagesTestJSON-2147123429-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:50.635817 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-63a93b29-9012-4e1c-96d9-043639c68ea8 tempest-TenantUsagesTestJSON-2147123429 tempest-TenantUsagesTestJSON-2147123429-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:50.643127 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-63a93b29-9012-4e1c-96d9-043639c68ea8 tempest-TenantUsagesTestJSON-2147123429 tempest-TenantUsagesTestJSON-2147123429-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:50.643839 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-63a93b29-9012-4e1c-96d9-043639c68ea8 tempest-TenantUsagesTestJSON-2147123429 tempest-TenantUsagesTestJSON-2147123429-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:50.675253 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-63a93b29-9012-4e1c-96d9-043639c68ea8 tempest-TenantUsagesTestJSON-2147123429 tempest-TenantUsagesTestJSON-2147123429-project-admin] 10.222.0.43 "GET /compute/v2.1/os-simple-tenant-usage/4a71c255d30a42e785c18fc1ce2208bf?start=2022-10-03T18%3A36%3A48.626706&end=2022-10-05T18%3A36%3A48.626706" status: 200 len: 694 microversion: 2.1 time: 0.603424 Oct 04 18:36:50.697923 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 809/1502] 10.222.0.43 () {58 vars in 1412 bytes} [Tue Oct 4 18:36:50 2022] GET /compute/v2.1/os-simple-tenant-usage/4a71c255d30a42e785c18fc1ce2208bf?start=2022-10-03T18%3A36%3A48.626706&end=2022-10-05T18%3A36%3A48.626706 => generated 694 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:36:50.721978 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-fa476404-0f23-44c3-8efa-2a99b4840864 req-89fedb00-6a6d-4cc9-bd66-b566ca24c38a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ee1bd28-0921-4444-afe3-c09cbfa0680a", "name": "network-vif-deleted", "tag": "9b0949c2-7109-4d21-a62e-7d24d18a41c0"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:36:50.743956 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-fa476404-0f23-44c3-8efa-2a99b4840864 req-89fedb00-6a6d-4cc9-bd66-b566ca24c38a service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:50.744856 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-fa476404-0f23-44c3-8efa-2a99b4840864 req-89fedb00-6a6d-4cc9-bd66-b566ca24c38a service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:50.745535 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-fa476404-0f23-44c3-8efa-2a99b4840864 req-89fedb00-6a6d-4cc9-bd66-b566ca24c38a service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:50.771915 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-fa476404-0f23-44c3-8efa-2a99b4840864 req-89fedb00-6a6d-4cc9-bd66-b566ca24c38a service nova] Creating event network-vif-deleted:9b0949c2-7109-4d21-a62e-7d24d18a41c0 for instance 9ee1bd28-0921-4444-afe3-c09cbfa0680a on n-h2-851028-13 Oct 04 18:36:50.787866 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-fa476404-0f23-44c3-8efa-2a99b4840864 req-89fedb00-6a6d-4cc9-bd66-b566ca24c38a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087692 Oct 04 18:36:50.789527 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 810/1503] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:36:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:36:50.808138 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-d542fb0a-b6ad-4584-a322-0e7763c68999 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Calling method '.version_select at 0x7fb21fb031f0>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:50.914414 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-d542fb0a-b6ad-4584-a322-0e7763c68999 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] 10.222.0.43 "GET /compute/v2.1/images/3adaa529-06f7-4c7d-8ad1-d56ec671ea9a" status: 200 len: 1424 microversion: 2.1 time: 0.122638 Oct 04 18:36:50.921016 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 811/1504] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 18:36:50 2022] GET /compute/v2.1/images/3adaa529-06f7-4c7d-8ad1-d56ec671ea9a => generated 1424 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:50.926468 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-3892d872-411e-4b35-8190-9ff7edbf2851 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:50.930490 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-3892d872-411e-4b35-8190-9ff7edbf2851 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] [instance: 64228016-ae20-4fcb-87da-c3d4d585e241] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:50.944593 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3892d872-411e-4b35-8190-9ff7edbf2851 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:50.948433 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3892d872-411e-4b35-8190-9ff7edbf2851 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:50.948979 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3892d872-411e-4b35-8190-9ff7edbf2851 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:50.949821 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3892d872-411e-4b35-8190-9ff7edbf2851 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:50.952634 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3892d872-411e-4b35-8190-9ff7edbf2851 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:50.953465 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3892d872-411e-4b35-8190-9ff7edbf2851 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:51.199057 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-3892d872-411e-4b35-8190-9ff7edbf2851 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a41ab6fb78a42ceaca621c5a38ffc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa31ed92017490a82497c7b8910aef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:51.209755 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-3892d872-411e-4b35-8190-9ff7edbf2851 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] 10.222.0.43 "GET /compute/v2.1/servers/64228016-ae20-4fcb-87da-c3d4d585e241" status: 200 len: 1266 microversion: 2.1 time: 0.287217 Oct 04 18:36:51.216992 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 812/1505] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:50 2022] GET /compute/v2.1/servers/64228016-ae20-4fcb-87da-c3d4d585e241 => generated 1266 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:51.231533 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-28a412f6-d360-48c5-9394-5c5aacdac489 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:51.236333 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-28a412f6-d360-48c5-9394-5c5aacdac489 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] [instance: 67e13bce-be81-4775-be5f-737add9f1694] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:51.255523 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-28a412f6-d360-48c5-9394-5c5aacdac489 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:51.256552 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-28a412f6-d360-48c5-9394-5c5aacdac489 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:51.257301 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-28a412f6-d360-48c5-9394-5c5aacdac489 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:51.265427 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-28a412f6-d360-48c5-9394-5c5aacdac489 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:51.266360 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-28a412f6-d360-48c5-9394-5c5aacdac489 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:51.267059 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-28a412f6-d360-48c5-9394-5c5aacdac489 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:51.407181 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-28a412f6-d360-48c5-9394-5c5aacdac489 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8b5e18327f4713a1e465acb9e863f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c849c5d04f44f7951908d740ec1689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:51.416416 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-d4d6e21d-3d6b-4ae5-91d4-d67c74b21af1 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:51.423662 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-28a412f6-d360-48c5-9394-5c5aacdac489 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d8b5e18327f4713a1e465acb9e863f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c849c5d04f44f7951908d740ec1689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:51.425394 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-28a412f6-d360-48c5-9394-5c5aacdac489 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d8b5e18327f4713a1e465acb9e863f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c849c5d04f44f7951908d740ec1689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:51.434030 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-d4d6e21d-3d6b-4ae5-91d4-d67c74b21af1 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:51.435799 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-d4d6e21d-3d6b-4ae5-91d4-d67c74b21af1 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:51.438830 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-28a412f6-d360-48c5-9394-5c5aacdac489 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] 10.222.0.43 "GET /compute/v2.1/servers/67e13bce-be81-4775-be5f-737add9f1694" status: 200 len: 1443 microversion: 2.75 time: 0.220344 Oct 04 18:36:51.442516 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 813/1506] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:36:51 2022] GET /compute/v2.1/servers/67e13bce-be81-4775-be5f-737add9f1694 => generated 1443 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:36:51.455303 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-d4d6e21d-3d6b-4ae5-91d4-d67c74b21af1 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] 10.222.0.43 "GET /compute/v2.1/servers/7222a4ce-d2a2-4b09-afc6-55bca52414d4" status: 200 len: 1815 microversion: 2.25 time: 1.062564 Oct 04 18:36:51.456564 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 694/1507] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:36:50 2022] GET /compute/v2.1/servers/7222a4ce-d2a2-4b09-afc6-55bca52414d4 => generated 1815 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:36:51.462611 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-2fd03676-7992-4627-a374-eb637fd8871b tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] Calling method '.version_select at 0x7fb21fb6e670>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:51.467795 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-39ce8250-44f6-4658-8f6a-2ae4b4323b05 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:51.468508 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-39ce8250-44f6-4658-8f6a-2ae4b4323b05 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] [instance: eb05639b-cd53-4c27-9505-20e668a16acc] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:51.487452 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-39ce8250-44f6-4658-8f6a-2ae4b4323b05 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:51.488226 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-39ce8250-44f6-4658-8f6a-2ae4b4323b05 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:51.488885 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-39ce8250-44f6-4658-8f6a-2ae4b4323b05 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:51.489507 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2fd03676-7992-4627-a374-eb637fd8871b tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:51.489646 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-39ce8250-44f6-4658-8f6a-2ae4b4323b05 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:51.490091 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-39ce8250-44f6-4658-8f6a-2ae4b4323b05 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:51.490524 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-39ce8250-44f6-4658-8f6a-2ae4b4323b05 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:51.491327 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2fd03676-7992-4627-a374-eb637fd8871b tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:51.496121 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2fd03676-7992-4627-a374-eb637fd8871b tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:51.512842 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2fd03676-7992-4627-a374-eb637fd8871b tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:51.515931 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2fd03676-7992-4627-a374-eb637fd8871b tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:51.516490 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2fd03676-7992-4627-a374-eb637fd8871b tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:51.532632 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-2fd03676-7992-4627-a374-eb637fd8871b tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] 10.222.0.43 "GET /compute/v2.1/os-simple-tenant-usage/4a71c255d30a42e785c18fc1ce2208bf?start=2022-10-03T18%3A36%3A48.626706&end=2022-10-05T18%3A36%3A48.626706" status: 200 len: 694 microversion: 2.1 time: 0.088667 Oct 04 18:36:51.545879 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 814/1508] 10.222.0.43 () {58 vars in 1412 bytes} [Tue Oct 4 18:36:51 2022] GET /compute/v2.1/os-simple-tenant-usage/4a71c255d30a42e785c18fc1ce2208bf?start=2022-10-03T18%3A36%3A48.626706&end=2022-10-05T18%3A36%3A48.626706 => generated 694 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:36:51.569605 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-a92627ce-1c12-4458-8568-832e7125fb36 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:51.570988 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-a92627ce-1c12-4458-8568-832e7125fb36 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: ce0d629a-068c-4a62-8a03-fc43fc0be9b3] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:51.585773 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-39ce8250-44f6-4658-8f6a-2ae4b4323b05 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] [instance: eb05639b-cd53-4c27-9505-20e668a16acc] Going to try to terminate instance {{(pid=123595) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:36:51.587361 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a92627ce-1c12-4458-8568-832e7125fb36 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:51.587972 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a92627ce-1c12-4458-8568-832e7125fb36 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:51.588524 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a92627ce-1c12-4458-8568-832e7125fb36 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:51.589896 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a92627ce-1c12-4458-8568-832e7125fb36 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:51.590476 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a92627ce-1c12-4458-8568-832e7125fb36 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:51.591065 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a92627ce-1c12-4458-8568-832e7125fb36 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:51.867161 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-39ce8250-44f6-4658-8f6a-2ae4b4323b05 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] 10.222.0.43 "DELETE /compute/v2.1/servers/eb05639b-cd53-4c27-9505-20e668a16acc" status: 204 len: 0 microversion: 2.1 time: 0.403008 Oct 04 18:36:51.868553 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 695/1509] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 18:36:51 2022] DELETE /compute/v2.1/servers/eb05639b-cd53-4c27-9505-20e668a16acc => generated 0 bytes in 411 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:36:51.877495 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-ad88ec2d-7fa4-4b83-89c5-7e0c9562ceff tempest-TenantUsagesTestJSON-2147123429 tempest-TenantUsagesTestJSON-2147123429-project-admin] Calling method '.version_select at 0x7fb21f834280>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:51.899993 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ad88ec2d-7fa4-4b83-89c5-7e0c9562ceff tempest-TenantUsagesTestJSON-2147123429 tempest-TenantUsagesTestJSON-2147123429-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:51.902249 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ad88ec2d-7fa4-4b83-89c5-7e0c9562ceff tempest-TenantUsagesTestJSON-2147123429 tempest-TenantUsagesTestJSON-2147123429-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:51.902944 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ad88ec2d-7fa4-4b83-89c5-7e0c9562ceff tempest-TenantUsagesTestJSON-2147123429 tempest-TenantUsagesTestJSON-2147123429-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:51.928058 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ad88ec2d-7fa4-4b83-89c5-7e0c9562ceff tempest-TenantUsagesTestJSON-2147123429 tempest-TenantUsagesTestJSON-2147123429-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:51.928671 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ad88ec2d-7fa4-4b83-89c5-7e0c9562ceff tempest-TenantUsagesTestJSON-2147123429 tempest-TenantUsagesTestJSON-2147123429-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:51.929213 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ad88ec2d-7fa4-4b83-89c5-7e0c9562ceff tempest-TenantUsagesTestJSON-2147123429 tempest-TenantUsagesTestJSON-2147123429-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:52.056630 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-ad88ec2d-7fa4-4b83-89c5-7e0c9562ceff tempest-TenantUsagesTestJSON-2147123429 tempest-TenantUsagesTestJSON-2147123429-project-admin] 10.222.0.43 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-03T18%3A36%3A48.626706&end=2022-10-05T18%3A36%3A48.626706&detailed=1" status: 200 len: 17246 microversion: 2.1 time: 0.186447 Oct 04 18:36:52.064523 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 696/1510] 10.222.0.43 () {58 vars in 1335 bytes} [Tue Oct 4 18:36:51 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-03T18%3A36%3A48.626706&end=2022-10-05T18%3A36%3A48.626706&detailed=1 => generated 17246 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:36:52.072238 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-a4754cdf-3023-463f-9fae-94f715bd8b83 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:52.073095 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-a4754cdf-3023-463f-9fae-94f715bd8b83 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] [instance: eb05639b-cd53-4c27-9505-20e668a16acc] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:52.079767 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a4754cdf-3023-463f-9fae-94f715bd8b83 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:52.080288 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a4754cdf-3023-463f-9fae-94f715bd8b83 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:52.080713 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a4754cdf-3023-463f-9fae-94f715bd8b83 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:52.081478 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a4754cdf-3023-463f-9fae-94f715bd8b83 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:52.083238 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a4754cdf-3023-463f-9fae-94f715bd8b83 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:52.083793 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a4754cdf-3023-463f-9fae-94f715bd8b83 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:52.444618 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-a92627ce-1c12-4458-8568-832e7125fb36 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:52.458807 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-a92627ce-1c12-4458-8568-832e7125fb36 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/ce0d629a-068c-4a62-8a03-fc43fc0be9b3" status: 200 len: 1477 microversion: 2.1 time: 0.897245 Oct 04 18:36:52.459924 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 815/1511] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:51 2022] GET /compute/v2.1/servers/ce0d629a-068c-4a62-8a03-fc43fc0be9b3 => generated 1477 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:52.472042 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-e3c71172-2eb8-4059-bd0d-c6f58bc77469 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Calling method '.version_select at 0x7fb21fb6e0d0>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:52.494442 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-a4754cdf-3023-463f-9fae-94f715bd8b83 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64887fff0bc7417094c4fee2f7e9aa5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6187bfad04cb7bc17155862ee0cdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:52.512940 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-a4754cdf-3023-463f-9fae-94f715bd8b83 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] 10.222.0.43 "GET /compute/v2.1/servers/eb05639b-cd53-4c27-9505-20e668a16acc" status: 200 len: 1680 microversion: 2.1 time: 0.446973 Oct 04 18:36:52.526249 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 697/1512] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:52 2022] GET /compute/v2.1/servers/eb05639b-cd53-4c27-9505-20e668a16acc => generated 1680 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:52.570476 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-bfa3bbbf-8fa6-4605-982b-62b6e4cf1f2c tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:52.571156 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-bfa3bbbf-8fa6-4605-982b-62b6e4cf1f2c tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] [instance: 1f956517-1701-4171-9227-03726c7e8fca] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:52.597232 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bfa3bbbf-8fa6-4605-982b-62b6e4cf1f2c tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:52.598046 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bfa3bbbf-8fa6-4605-982b-62b6e4cf1f2c tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:52.598749 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bfa3bbbf-8fa6-4605-982b-62b6e4cf1f2c tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:52.599712 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bfa3bbbf-8fa6-4605-982b-62b6e4cf1f2c tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:52.602517 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bfa3bbbf-8fa6-4605-982b-62b6e4cf1f2c tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:52.604647 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bfa3bbbf-8fa6-4605-982b-62b6e4cf1f2c tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:52.611200 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-e3c71172-2eb8-4059-bd0d-c6f58bc77469 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] 10.222.0.43 "GET /compute/v2.1/images/3adaa529-06f7-4c7d-8ad1-d56ec671ea9a" status: 200 len: 1424 microversion: 2.1 time: 0.148510 Oct 04 18:36:52.612219 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 816/1513] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 18:36:52 2022] GET /compute/v2.1/images/3adaa529-06f7-4c7d-8ad1-d56ec671ea9a => generated 1424 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:52.622839 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f8ba3b9a-2338-4924-9427-05d667b07b18 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:52.626255 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-f8ba3b9a-2338-4924-9427-05d667b07b18 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] [instance: 64228016-ae20-4fcb-87da-c3d4d585e241] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:52.652536 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f8ba3b9a-2338-4924-9427-05d667b07b18 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:52.653501 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f8ba3b9a-2338-4924-9427-05d667b07b18 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:52.654216 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f8ba3b9a-2338-4924-9427-05d667b07b18 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:52.655226 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f8ba3b9a-2338-4924-9427-05d667b07b18 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:52.656705 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f8ba3b9a-2338-4924-9427-05d667b07b18 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:52.657463 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f8ba3b9a-2338-4924-9427-05d667b07b18 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:52.688828 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-bfa3bbbf-8fa6-4605-982b-62b6e4cf1f2c tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] [instance: 1f956517-1701-4171-9227-03726c7e8fca] Going to try to terminate instance {{(pid=123595) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:36:52.896604 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-f8ba3b9a-2338-4924-9427-05d667b07b18 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a41ab6fb78a42ceaca621c5a38ffc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa31ed92017490a82497c7b8910aef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:52.902172 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=100 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:36:52.914998 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-f8ba3b9a-2338-4924-9427-05d667b07b18 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] 10.222.0.43 "GET /compute/v2.1/servers/64228016-ae20-4fcb-87da-c3d4d585e241" status: 200 len: 1266 microversion: 2.1 time: 0.301278 Oct 04 18:36:52.941543 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 817/1514] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:52 2022] GET /compute/v2.1/servers/64228016-ae20-4fcb-87da-c3d4d585e241 => generated 1266 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:52.968489 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-fff21cbc-8268-4ee3-933f-ebb5149a2045 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:52.971719 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-fff21cbc-8268-4ee3-933f-ebb5149a2045 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] [instance: 67e13bce-be81-4775-be5f-737add9f1694] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:52.979589 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-bfa3bbbf-8fa6-4605-982b-62b6e4cf1f2c tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] 10.222.0.43 "DELETE /compute/v2.1/servers/1f956517-1701-4171-9227-03726c7e8fca" status: 204 len: 0 microversion: 2.1 time: 0.451899 Oct 04 18:36:52.980418 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 698/1515] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 18:36:52 2022] DELETE /compute/v2.1/servers/1f956517-1701-4171-9227-03726c7e8fca => generated 0 bytes in 453 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:36:52.985669 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-14d496c8-2440-4d6d-af40-f7f6c7a41761 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:53.006361 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fff21cbc-8268-4ee3-933f-ebb5149a2045 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:53.008442 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fff21cbc-8268-4ee3-933f-ebb5149a2045 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:53.010417 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-14d496c8-2440-4d6d-af40-f7f6c7a41761 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] [instance: 7222a4ce-d2a2-4b09-afc6-55bca52414d4] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:53.012624 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fff21cbc-8268-4ee3-933f-ebb5149a2045 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:53.017143 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fff21cbc-8268-4ee3-933f-ebb5149a2045 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:53.018450 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fff21cbc-8268-4ee3-933f-ebb5149a2045 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:53.021931 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fff21cbc-8268-4ee3-933f-ebb5149a2045 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:53.043150 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-14d496c8-2440-4d6d-af40-f7f6c7a41761 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:53.048110 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-14d496c8-2440-4d6d-af40-f7f6c7a41761 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:53.049029 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-14d496c8-2440-4d6d-af40-f7f6c7a41761 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:53.055675 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-14d496c8-2440-4d6d-af40-f7f6c7a41761 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:53.058104 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-14d496c8-2440-4d6d-af40-f7f6c7a41761 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:53.058807 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-14d496c8-2440-4d6d-af40-f7f6c7a41761 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:53.433393 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-fff21cbc-8268-4ee3-933f-ebb5149a2045 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8b5e18327f4713a1e465acb9e863f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c849c5d04f44f7951908d740ec1689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:53.445787 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-fff21cbc-8268-4ee3-933f-ebb5149a2045 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d8b5e18327f4713a1e465acb9e863f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c849c5d04f44f7951908d740ec1689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:53.447135 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-fff21cbc-8268-4ee3-933f-ebb5149a2045 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d8b5e18327f4713a1e465acb9e863f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c849c5d04f44f7951908d740ec1689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:53.493361 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-fff21cbc-8268-4ee3-933f-ebb5149a2045 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] 10.222.0.43 "GET /compute/v2.1/servers/67e13bce-be81-4775-be5f-737add9f1694" status: 200 len: 1443 microversion: 2.75 time: 0.544336 Oct 04 18:36:53.497735 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 818/1516] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:36:52 2022] GET /compute/v2.1/servers/67e13bce-be81-4775-be5f-737add9f1694 => generated 1443 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:36:53.509938 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-8be87642-8bb8-474d-b39b-8732bcb345fb tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:53.510561 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-8be87642-8bb8-474d-b39b-8732bcb345fb tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] [instance: 1f956517-1701-4171-9227-03726c7e8fca] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:53.539984 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8be87642-8bb8-474d-b39b-8732bcb345fb tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:53.540499 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8be87642-8bb8-474d-b39b-8732bcb345fb tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:53.540949 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8be87642-8bb8-474d-b39b-8732bcb345fb tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:53.541710 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8be87642-8bb8-474d-b39b-8732bcb345fb tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:53.542172 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8be87642-8bb8-474d-b39b-8732bcb345fb tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:53.542605 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8be87642-8bb8-474d-b39b-8732bcb345fb tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:53.566763 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-14d496c8-2440-4d6d-af40-f7f6c7a41761 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:53.580262 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-14d496c8-2440-4d6d-af40-f7f6c7a41761 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:53.586352 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-14d496c8-2440-4d6d-af40-f7f6c7a41761 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:53.588407 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-14d496c8-2440-4d6d-af40-f7f6c7a41761 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] 10.222.0.43 "GET /compute/v2.1/servers/7222a4ce-d2a2-4b09-afc6-55bca52414d4" status: 200 len: 1815 microversion: 2.25 time: 0.606793 Oct 04 18:36:53.589926 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 699/1517] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:36:52 2022] GET /compute/v2.1/servers/7222a4ce-d2a2-4b09-afc6-55bca52414d4 => generated 1815 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:36:53.596336 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-8bec9bb9-430e-4336-ad37-89a489b4d94a tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:53.600258 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-8bec9bb9-430e-4336-ad37-89a489b4d94a tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: ce0d629a-068c-4a62-8a03-fc43fc0be9b3] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:53.628680 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8bec9bb9-430e-4336-ad37-89a489b4d94a tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:53.630065 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8bec9bb9-430e-4336-ad37-89a489b4d94a tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:53.630793 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8bec9bb9-430e-4336-ad37-89a489b4d94a tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:53.644915 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8bec9bb9-430e-4336-ad37-89a489b4d94a tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:53.645842 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8bec9bb9-430e-4336-ad37-89a489b4d94a tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:53.646519 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8bec9bb9-430e-4336-ad37-89a489b4d94a tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:53.875704 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-8be87642-8bb8-474d-b39b-8732bcb345fb tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013cb5ed545e4aa29e25e8a6af35db7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a71c255d30a42e785c18fc1ce2208bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:53.890398 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-8be87642-8bb8-474d-b39b-8732bcb345fb tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] 10.222.0.43 "GET /compute/v2.1/servers/1f956517-1701-4171-9227-03726c7e8fca" status: 200 len: 1470 microversion: 2.1 time: 0.391525 Oct 04 18:36:53.906285 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 819/1518] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:53 2022] GET /compute/v2.1/servers/1f956517-1701-4171-9227-03726c7e8fca => generated 1470 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:53.917761 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-8bec9bb9-430e-4336-ad37-89a489b4d94a tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:53.923675 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f9c1b81f-6e73-4e52-b60f-8fa006cf82ba tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:53.924778 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-f9c1b81f-6e73-4e52-b60f-8fa006cf82ba tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] [instance: eb05639b-cd53-4c27-9505-20e668a16acc] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:53.931908 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-8bec9bb9-430e-4336-ad37-89a489b4d94a tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/ce0d629a-068c-4a62-8a03-fc43fc0be9b3" status: 200 len: 1477 microversion: 2.1 time: 0.340593 Oct 04 18:36:53.932838 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 700/1519] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:53 2022] GET /compute/v2.1/servers/ce0d629a-068c-4a62-8a03-fc43fc0be9b3 => generated 1477 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:53.939313 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-e9a0ea14-844c-4b4b-8f9d-51cbe9fd55f9 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Calling method '.version_select at 0x7fb21fa3f550>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:53.965912 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f9c1b81f-6e73-4e52-b60f-8fa006cf82ba tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:53.966353 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f9c1b81f-6e73-4e52-b60f-8fa006cf82ba tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:53.966805 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f9c1b81f-6e73-4e52-b60f-8fa006cf82ba tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:53.967533 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f9c1b81f-6e73-4e52-b60f-8fa006cf82ba tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:53.968045 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f9c1b81f-6e73-4e52-b60f-8fa006cf82ba tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:53.968495 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f9c1b81f-6e73-4e52-b60f-8fa006cf82ba tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:54.001799 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-e9a0ea14-844c-4b4b-8f9d-51cbe9fd55f9 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] 10.222.0.43 "GET /compute/v2.1/images/3adaa529-06f7-4c7d-8ad1-d56ec671ea9a" status: 200 len: 1424 microversion: 2.1 time: 0.067442 Oct 04 18:36:54.002601 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 701/1520] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 18:36:53 2022] GET /compute/v2.1/images/3adaa529-06f7-4c7d-8ad1-d56ec671ea9a => generated 1424 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:54.089246 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-486733cf-8b95-4534-9851-a02f7e0f3f27 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-960440567", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "50296dcd-13c2-4968-9506-186cf62eed87"}]}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:36:54.164592 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.network.neutron [None req-486733cf-8b95-4534-9851-a02f7e0f3f27 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] validate_networks() for [('50296dcd-13c2-4968-9506-186cf62eed87', None, None, None, None, None)] {{(pid=123595) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:36:54.196117 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-f9c1b81f-6e73-4e52-b60f-8fa006cf82ba tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64887fff0bc7417094c4fee2f7e9aa5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6187bfad04cb7bc17155862ee0cdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:54.208391 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-f9c1b81f-6e73-4e52-b60f-8fa006cf82ba tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] 10.222.0.43 "GET /compute/v2.1/servers/eb05639b-cd53-4c27-9505-20e668a16acc" status: 200 len: 1680 microversion: 2.1 time: 0.299576 Oct 04 18:36:54.209489 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 820/1521] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:53 2022] GET /compute/v2.1/servers/eb05639b-cd53-4c27-9505-20e668a16acc => generated 1680 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:54.214828 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-ded8c678-47a9-43a0-a87c-7affbd8040af tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:54.215654 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-ded8c678-47a9-43a0-a87c-7affbd8040af tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] [instance: 64228016-ae20-4fcb-87da-c3d4d585e241] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:54.223230 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ded8c678-47a9-43a0-a87c-7affbd8040af tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:54.223852 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ded8c678-47a9-43a0-a87c-7affbd8040af tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:54.224463 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ded8c678-47a9-43a0-a87c-7affbd8040af tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:54.225504 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ded8c678-47a9-43a0-a87c-7affbd8040af tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:54.226505 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ded8c678-47a9-43a0-a87c-7affbd8040af tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:54.227681 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ded8c678-47a9-43a0-a87c-7affbd8040af tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:54.394119 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-ded8c678-47a9-43a0-a87c-7affbd8040af tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a41ab6fb78a42ceaca621c5a38ffc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa31ed92017490a82497c7b8910aef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:54.407786 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-ded8c678-47a9-43a0-a87c-7affbd8040af tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] 10.222.0.43 "GET /compute/v2.1/servers/64228016-ae20-4fcb-87da-c3d4d585e241" status: 200 len: 1308 microversion: 2.1 time: 0.196901 Oct 04 18:36:54.416729 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 821/1522] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:54 2022] GET /compute/v2.1/servers/64228016-ae20-4fcb-87da-c3d4d585e241 => generated 1308 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:54.528216 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-6f9ca87a-515b-47fa-8675-9a40a7d46253 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:54.528844 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-6f9ca87a-515b-47fa-8675-9a40a7d46253 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] [instance: 67e13bce-be81-4775-be5f-737add9f1694] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:54.539504 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6f9ca87a-515b-47fa-8675-9a40a7d46253 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:54.540580 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6f9ca87a-515b-47fa-8675-9a40a7d46253 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:54.542638 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6f9ca87a-515b-47fa-8675-9a40a7d46253 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:54.543481 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6f9ca87a-515b-47fa-8675-9a40a7d46253 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:54.546038 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6f9ca87a-515b-47fa-8675-9a40a7d46253 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:54.546701 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6f9ca87a-515b-47fa-8675-9a40a7d46253 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:54.691548 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-6f9ca87a-515b-47fa-8675-9a40a7d46253 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8b5e18327f4713a1e465acb9e863f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c849c5d04f44f7951908d740ec1689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:54.705266 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-6f9ca87a-515b-47fa-8675-9a40a7d46253 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d8b5e18327f4713a1e465acb9e863f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c849c5d04f44f7951908d740ec1689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:54.707178 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-6f9ca87a-515b-47fa-8675-9a40a7d46253 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d8b5e18327f4713a1e465acb9e863f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c849c5d04f44f7951908d740ec1689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:54.717844 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-6f9ca87a-515b-47fa-8675-9a40a7d46253 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] 10.222.0.43 "GET /compute/v2.1/servers/67e13bce-be81-4775-be5f-737add9f1694" status: 200 len: 1443 microversion: 2.75 time: 0.193604 Oct 04 18:36:54.733867 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 822/1523] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:36:54 2022] GET /compute/v2.1/servers/67e13bce-be81-4775-be5f-737add9f1694 => generated 1443 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:36:54.761560 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-d5f0ecdf-532c-4cd1-98a1-490df7f82a80 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:54.762488 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-d5f0ecdf-532c-4cd1-98a1-490df7f82a80 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] [instance: 7222a4ce-d2a2-4b09-afc6-55bca52414d4] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:54.776409 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:36:54.781062 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d5f0ecdf-532c-4cd1-98a1-490df7f82a80 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:54.785041 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d5f0ecdf-532c-4cd1-98a1-490df7f82a80 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:54.787088 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d5f0ecdf-532c-4cd1-98a1-490df7f82a80 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:54.788041 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d5f0ecdf-532c-4cd1-98a1-490df7f82a80 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:54.790201 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d5f0ecdf-532c-4cd1-98a1-490df7f82a80 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:54.791539 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d5f0ecdf-532c-4cd1-98a1-490df7f82a80 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:55.075360 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-d5f0ecdf-532c-4cd1-98a1-490df7f82a80 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:55.098774 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-d5f0ecdf-532c-4cd1-98a1-490df7f82a80 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:55.100945 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-d5f0ecdf-532c-4cd1-98a1-490df7f82a80 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:55.102684 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-d5f0ecdf-532c-4cd1-98a1-490df7f82a80 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] 10.222.0.43 "GET /compute/v2.1/servers/7222a4ce-d2a2-4b09-afc6-55bca52414d4" status: 200 len: 1815 microversion: 2.25 time: 0.367625 Oct 04 18:36:55.139896 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 823/1524] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:36:54 2022] GET /compute/v2.1/servers/7222a4ce-d2a2-4b09-afc6-55bca52414d4 => generated 1815 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:36:55.159259 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-748c10e3-1a69-4c80-890b-4ee6f249b3aa tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:55.160726 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-748c10e3-1a69-4c80-890b-4ee6f249b3aa tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] [instance: 1f956517-1701-4171-9227-03726c7e8fca] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:55.182736 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-748c10e3-1a69-4c80-890b-4ee6f249b3aa tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:55.184554 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-748c10e3-1a69-4c80-890b-4ee6f249b3aa tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:55.186497 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-748c10e3-1a69-4c80-890b-4ee6f249b3aa tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:55.187493 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-748c10e3-1a69-4c80-890b-4ee6f249b3aa tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:55.190642 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-748c10e3-1a69-4c80-890b-4ee6f249b3aa tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:55.191516 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-748c10e3-1a69-4c80-890b-4ee6f249b3aa tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:55.596349 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-748c10e3-1a69-4c80-890b-4ee6f249b3aa tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013cb5ed545e4aa29e25e8a6af35db7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a71c255d30a42e785c18fc1ce2208bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:55.605693 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-748c10e3-1a69-4c80-890b-4ee6f249b3aa tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] 10.222.0.43 "GET /compute/v2.1/servers/1f956517-1701-4171-9227-03726c7e8fca" status: 200 len: 1470 microversion: 2.1 time: 0.461278 Oct 04 18:36:55.610214 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 824/1525] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:55 2022] GET /compute/v2.1/servers/1f956517-1701-4171-9227-03726c7e8fca => generated 1470 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:55.615417 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-4193a9b5-58dc-4fd0-9b0e-589347d04323 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:55.621011 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-4193a9b5-58dc-4fd0-9b0e-589347d04323 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: ce0d629a-068c-4a62-8a03-fc43fc0be9b3] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:55.629594 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4193a9b5-58dc-4fd0-9b0e-589347d04323 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:55.639121 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4193a9b5-58dc-4fd0-9b0e-589347d04323 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:55.640023 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4193a9b5-58dc-4fd0-9b0e-589347d04323 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:55.641027 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4193a9b5-58dc-4fd0-9b0e-589347d04323 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:55.641745 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4193a9b5-58dc-4fd0-9b0e-589347d04323 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:55.642410 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4193a9b5-58dc-4fd0-9b0e-589347d04323 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:55.907399 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-4193a9b5-58dc-4fd0-9b0e-589347d04323 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:55.916607 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-4193a9b5-58dc-4fd0-9b0e-589347d04323 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/ce0d629a-068c-4a62-8a03-fc43fc0be9b3" status: 200 len: 1476 microversion: 2.1 time: 0.304920 Oct 04 18:36:55.922925 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 825/1526] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:55 2022] GET /compute/v2.1/servers/ce0d629a-068c-4a62-8a03-fc43fc0be9b3 => generated 1476 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:55.929037 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-80b1682f-b6e8-4bef-81b4-ff050188357d tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Calling method '.version_select at 0x7fb21fb53940>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:55.935778 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-486733cf-8b95-4534-9851-a02f7e0f3f27 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Flavor limits 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:36:55.936344 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-486733cf-8b95-4534-9851-a02f7e0f3f27 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Image limits 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:36:55.936686 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-486733cf-8b95-4534-9851-a02f7e0f3f27 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Flavor pref 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:36:55.937527 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-486733cf-8b95-4534-9851-a02f7e0f3f27 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Image pref 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:36:55.937952 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-486733cf-8b95-4534-9851-a02f7e0f3f27 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:36:55.974144 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-486733cf-8b95-4534-9851-a02f7e0f3f27 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:55.980521 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-486733cf-8b95-4534-9851-a02f7e0f3f27 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:55.981094 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-486733cf-8b95-4534-9851-a02f7e0f3f27 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:55.989712 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-486733cf-8b95-4534-9851-a02f7e0f3f27 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:55.990216 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-486733cf-8b95-4534-9851-a02f7e0f3f27 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:55.994733 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-486733cf-8b95-4534-9851-a02f7e0f3f27 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:56.015518 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-80b1682f-b6e8-4bef-81b4-ff050188357d tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] 10.222.0.43 "GET /compute/v2.1/images/3adaa529-06f7-4c7d-8ad1-d56ec671ea9a" status: 200 len: 1424 microversion: 2.1 time: 0.090993 Oct 04 18:36:56.016623 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 826/1527] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 18:36:55 2022] GET /compute/v2.1/images/3adaa529-06f7-4c7d-8ad1-d56ec671ea9a => generated 1424 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:56.024894 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-97866cfb-ab64-4e65-a62f-7eb26f877fc9 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:56.033769 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-97866cfb-ab64-4e65-a62f-7eb26f877fc9 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] [instance: eb05639b-cd53-4c27-9505-20e668a16acc] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:56.060404 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-486733cf-8b95-4534-9851-a02f7e0f3f27 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Getting quotas for project a06b8feba3404490a448aa2d4fb106b2. Resources: {'ram', 'cores', 'instances'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:36:56.060716 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-97866cfb-ab64-4e65-a62f-7eb26f877fc9 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:56.061989 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-97866cfb-ab64-4e65-a62f-7eb26f877fc9 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:56.067112 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-97866cfb-ab64-4e65-a62f-7eb26f877fc9 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:56.070605 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-97866cfb-ab64-4e65-a62f-7eb26f877fc9 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:56.077557 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-486733cf-8b95-4534-9851-a02f7e0f3f27 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Getting quotas for user 9fa193aff0474ae3ba5d1aa7b0d0e8c4 and project a06b8feba3404490a448aa2d4fb106b2. Resources: {'ram', 'cores', 'instances'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:36:56.081446 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-97866cfb-ab64-4e65-a62f-7eb26f877fc9 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:56.082613 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-97866cfb-ab64-4e65-a62f-7eb26f877fc9 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:56.115332 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-486733cf-8b95-4534-9851-a02f7e0f3f27 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Going to run 3 instances... {{(pid=123595) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:36:56.119600 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-486733cf-8b95-4534-9851-a02f7e0f3f27 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] [instance: 744f6597-f965-405c-ad7b-66a8a0f1397b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e8943ec5-4038-4d4b-b9b9-2415a79f5243',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:36:56.155578 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=4,nova_api:INSERT=1 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:36:56.214320 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-486733cf-8b95-4534-9851-a02f7e0f3f27 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] [instance: 132f39b7-bf1b-49a8-87a3-38cd95a041de] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e8943ec5-4038-4d4b-b9b9-2415a79f5243',instance=,instance_uuid=744f6597-f965-405c-ad7b-66a8a0f1397b,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:36:56.319172 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-486733cf-8b95-4534-9851-a02f7e0f3f27 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] [instance: 86743a21-e24e-4001-b3da-48615f6e281e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e8943ec5-4038-4d4b-b9b9-2415a79f5243',instance=,instance_uuid=132f39b7-bf1b-49a8-87a3-38cd95a041de,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:36:56.503097 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-486733cf-8b95-4534-9851-a02f7e0f3f27 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.498717 Oct 04 18:36:56.505506 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 702/1528] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 18:36:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 2502 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:36:56.517373 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-ac7f57ff-6ae0-4886-a82d-a15284a1934f tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:56.518118 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-ac7f57ff-6ae0-4886-a82d-a15284a1934f tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] [instance: 64228016-ae20-4fcb-87da-c3d4d585e241] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:56.535188 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ac7f57ff-6ae0-4886-a82d-a15284a1934f tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:56.536747 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ac7f57ff-6ae0-4886-a82d-a15284a1934f tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:56.540895 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ac7f57ff-6ae0-4886-a82d-a15284a1934f tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:56.541928 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ac7f57ff-6ae0-4886-a82d-a15284a1934f tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:56.542928 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ac7f57ff-6ae0-4886-a82d-a15284a1934f tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:56.542928 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ac7f57ff-6ae0-4886-a82d-a15284a1934f tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:56.717622 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-97866cfb-ab64-4e65-a62f-7eb26f877fc9 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64887fff0bc7417094c4fee2f7e9aa5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6187bfad04cb7bc17155862ee0cdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:56.732682 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-97866cfb-ab64-4e65-a62f-7eb26f877fc9 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] 10.222.0.43 "GET /compute/v2.1/servers/eb05639b-cd53-4c27-9505-20e668a16acc" status: 200 len: 1680 microversion: 2.1 time: 0.714500 Oct 04 18:36:56.754179 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 827/1529] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:56 2022] GET /compute/v2.1/servers/eb05639b-cd53-4c27-9505-20e668a16acc => generated 1680 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:56.759657 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-bacad417-0318-4212-87e6-6520c5ad3cc7 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:56.772526 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-bacad417-0318-4212-87e6-6520c5ad3cc7 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] [instance: 67e13bce-be81-4775-be5f-737add9f1694] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:56.801013 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bacad417-0318-4212-87e6-6520c5ad3cc7 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:56.804727 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bacad417-0318-4212-87e6-6520c5ad3cc7 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:56.805400 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bacad417-0318-4212-87e6-6520c5ad3cc7 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:56.806307 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bacad417-0318-4212-87e6-6520c5ad3cc7 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:56.811403 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bacad417-0318-4212-87e6-6520c5ad3cc7 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:56.812096 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bacad417-0318-4212-87e6-6520c5ad3cc7 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:56.950283 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bacad417-0318-4212-87e6-6520c5ad3cc7 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:56.951673 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bacad417-0318-4212-87e6-6520c5ad3cc7 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:56.953009 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bacad417-0318-4212-87e6-6520c5ad3cc7 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:56.954395 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.objects.instance [None req-bacad417-0318-4212-87e6-6520c5ad3cc7 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lazy-loading 'fault' on Instance uuid 67e13bce-be81-4775-be5f-737add9f1694 {{(pid=123596) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:36:57.102217 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-bacad417-0318-4212-87e6-6520c5ad3cc7 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8b5e18327f4713a1e465acb9e863f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c849c5d04f44f7951908d740ec1689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:57.104869 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=6 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:36:57.113970 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-bacad417-0318-4212-87e6-6520c5ad3cc7 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d8b5e18327f4713a1e465acb9e863f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c849c5d04f44f7951908d740ec1689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:57.122175 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-bacad417-0318-4212-87e6-6520c5ad3cc7 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d8b5e18327f4713a1e465acb9e863f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c849c5d04f44f7951908d740ec1689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:57.152193 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-bacad417-0318-4212-87e6-6520c5ad3cc7 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] 10.222.0.43 "GET /compute/v2.1/servers/67e13bce-be81-4775-be5f-737add9f1694" status: 200 len: 1448 microversion: 2.75 time: 0.396523 Oct 04 18:36:57.153520 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 828/1530] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:36:56 2022] GET /compute/v2.1/servers/67e13bce-be81-4775-be5f-737add9f1694 => generated 1448 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:36:57.158639 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-a4103ce4-eff5-46f3-8b55-2193999b1f6d tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:57.172983 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-a4103ce4-eff5-46f3-8b55-2193999b1f6d tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] [instance: 7222a4ce-d2a2-4b09-afc6-55bca52414d4] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:57.187183 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a4103ce4-eff5-46f3-8b55-2193999b1f6d tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:57.192552 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a4103ce4-eff5-46f3-8b55-2193999b1f6d tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:57.195061 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a4103ce4-eff5-46f3-8b55-2193999b1f6d tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:57.195994 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a4103ce4-eff5-46f3-8b55-2193999b1f6d tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:57.206162 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a4103ce4-eff5-46f3-8b55-2193999b1f6d tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:57.206926 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a4103ce4-eff5-46f3-8b55-2193999b1f6d tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:57.668919 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-ac7f57ff-6ae0-4886-a82d-a15284a1934f tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a41ab6fb78a42ceaca621c5a38ffc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa31ed92017490a82497c7b8910aef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:57.681457 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-ac7f57ff-6ae0-4886-a82d-a15284a1934f tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] 10.222.0.43 "GET /compute/v2.1/servers/64228016-ae20-4fcb-87da-c3d4d585e241" status: 200 len: 1308 microversion: 2.1 time: 1.173986 Oct 04 18:36:57.684402 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 703/1531] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:56 2022] GET /compute/v2.1/servers/64228016-ae20-4fcb-87da-c3d4d585e241 => generated 1308 bytes in 1178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:57.705402 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-810c72ec-cf19-4bb5-b3ab-a7d90d497882 req-ecfd7d8c-ff4f-475f-b1c2-b84d091a2d69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce0d629a-068c-4a62-8a03-fc43fc0be9b3", "name": "network-vif-unplugged", "status": "completed", "tag": "5b0b787d-0181-4910-a488-5e61d24675ce"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:36:57.724956 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-a4103ce4-eff5-46f3-8b55-2193999b1f6d tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:57.739764 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-a4103ce4-eff5-46f3-8b55-2193999b1f6d tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:57.743084 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-810c72ec-cf19-4bb5-b3ab-a7d90d497882 req-ecfd7d8c-ff4f-475f-b1c2-b84d091a2d69 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:57.743604 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-810c72ec-cf19-4bb5-b3ab-a7d90d497882 req-ecfd7d8c-ff4f-475f-b1c2-b84d091a2d69 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:57.752825 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-810c72ec-cf19-4bb5-b3ab-a7d90d497882 req-ecfd7d8c-ff4f-475f-b1c2-b84d091a2d69 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:57.753772 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-a4103ce4-eff5-46f3-8b55-2193999b1f6d tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:57.757538 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-a4103ce4-eff5-46f3-8b55-2193999b1f6d tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] 10.222.0.43 "GET /compute/v2.1/servers/7222a4ce-d2a2-4b09-afc6-55bca52414d4" status: 200 len: 1815 microversion: 2.25 time: 0.600595 Oct 04 18:36:57.758463 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 829/1532] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:36:57 2022] GET /compute/v2.1/servers/7222a4ce-d2a2-4b09-afc6-55bca52414d4 => generated 1815 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:36:57.763584 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-ff093989-977a-41c0-8b5c-027ea2a61aa5 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:57.783175 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-ff093989-977a-41c0-8b5c-027ea2a61aa5 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9fa193aff0474ae3ba5d1aa7b0d0e8c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a06b8feba3404490a448aa2d4fb106b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:57.783861 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-ff093989-977a-41c0-8b5c-027ea2a61aa5 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Searching by: {'deleted': False, 'project_id': 'a06b8feba3404490a448aa2d4fb106b2'} {{(pid=123596) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:36:57.809812 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-810c72ec-cf19-4bb5-b3ab-a7d90d497882 req-ecfd7d8c-ff4f-475f-b1c2-b84d091a2d69 service nova] Creating event network-vif-unplugged:5b0b787d-0181-4910-a488-5e61d24675ce for instance ce0d629a-068c-4a62-8a03-fc43fc0be9b3 on n-h1-851028-13 Oct 04 18:36:57.841697 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ff093989-977a-41c0-8b5c-027ea2a61aa5 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:57.842529 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [req-810c72ec-cf19-4bb5-b3ab-a7d90d497882 req-ecfd7d8c-ff4f-475f-b1c2-b84d091a2d69 service nova] Instance ce0d629a-068c-4a62-8a03-fc43fc0be9b3 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851028-13', 'n-h2-851028-13'} {{(pid=123595) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 18:36:57.842775 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ff093989-977a-41c0-8b5c-027ea2a61aa5 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:57.844014 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ff093989-977a-41c0-8b5c-027ea2a61aa5 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:57.845169 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ff093989-977a-41c0-8b5c-027ea2a61aa5 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:57.845948 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ff093989-977a-41c0-8b5c-027ea2a61aa5 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:57.846761 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ff093989-977a-41c0-8b5c-027ea2a61aa5 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:57.897020 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-810c72ec-cf19-4bb5-b3ab-a7d90d497882 req-ecfd7d8c-ff4f-475f-b1c2-b84d091a2d69 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.207806 Oct 04 18:36:57.901665 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 704/1533] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:36:57 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:36:57.919140 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-917314c9-47bf-4a01-9668-08686d43f2d8 tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:57.920137 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-917314c9-47bf-4a01-9668-08686d43f2d8 tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] [instance: 1f956517-1701-4171-9227-03726c7e8fca] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:57.944783 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-917314c9-47bf-4a01-9668-08686d43f2d8 tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:57.945199 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-917314c9-47bf-4a01-9668-08686d43f2d8 tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:57.945622 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-917314c9-47bf-4a01-9668-08686d43f2d8 tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:57.954044 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-917314c9-47bf-4a01-9668-08686d43f2d8 tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:57.955663 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-917314c9-47bf-4a01-9668-08686d43f2d8 tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:57.959096 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-917314c9-47bf-4a01-9668-08686d43f2d8 tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:58.067585 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.multi_cell_list [None req-ff093989-977a-41c0-8b5c-027ea2a61aa5 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Listed batch of 1 results from cell out of 997 limit. Returned 1 total so far. {{(pid=123596) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 18:36:58.286865 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-ff093989-977a-41c0-8b5c-027ea2a61aa5 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] 10.222.0.43 "GET /compute/v2.1/servers" status: 200 len: 1015 microversion: 2.1 time: 0.527018 Oct 04 18:36:58.294335 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 830/1534] 10.222.0.43 () {58 vars in 1125 bytes} [Tue Oct 4 18:36:57 2022] GET /compute/v2.1/servers => generated 1015 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:58.296619 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-6f882f6d-9334-4106-90b2-728b75b26bb2 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:58.297277 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-6f882f6d-9334-4106-90b2-728b75b26bb2 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: ce0d629a-068c-4a62-8a03-fc43fc0be9b3] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:58.328795 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6f882f6d-9334-4106-90b2-728b75b26bb2 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:58.329337 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6f882f6d-9334-4106-90b2-728b75b26bb2 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:58.329805 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6f882f6d-9334-4106-90b2-728b75b26bb2 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:58.330532 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6f882f6d-9334-4106-90b2-728b75b26bb2 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:58.331000 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6f882f6d-9334-4106-90b2-728b75b26bb2 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:58.331431 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6f882f6d-9334-4106-90b2-728b75b26bb2 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:58.758343 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-6f882f6d-9334-4106-90b2-728b75b26bb2 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:58.781136 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-6f882f6d-9334-4106-90b2-728b75b26bb2 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/ce0d629a-068c-4a62-8a03-fc43fc0be9b3" status: 200 len: 1476 microversion: 2.1 time: 0.492541 Oct 04 18:36:58.797803 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 831/1535] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:58 2022] GET /compute/v2.1/servers/ce0d629a-068c-4a62-8a03-fc43fc0be9b3 => generated 1476 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:58.805221 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-87dbf37e-8204-4467-9731-dfa95550a71a tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Calling method '.version_select at 0x7fb2246bc4c0>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:58.941820 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-87dbf37e-8204-4467-9731-dfa95550a71a tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] 10.222.0.43 "GET /compute/v2.1/images/3adaa529-06f7-4c7d-8ad1-d56ec671ea9a" status: 200 len: 1424 microversion: 2.1 time: 0.143436 Oct 04 18:36:58.951074 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 832/1536] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 18:36:58 2022] GET /compute/v2.1/images/3adaa529-06f7-4c7d-8ad1-d56ec671ea9a => generated 1424 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:58.974896 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-95a1d2ea-7a07-47ce-8ad9-3ca6d9273047 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:58.988161 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-95a1d2ea-7a07-47ce-8ad9-3ca6d9273047 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] [instance: eb05639b-cd53-4c27-9505-20e668a16acc] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:59.023219 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-95a1d2ea-7a07-47ce-8ad9-3ca6d9273047 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:59.027124 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-95a1d2ea-7a07-47ce-8ad9-3ca6d9273047 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:59.030979 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-95a1d2ea-7a07-47ce-8ad9-3ca6d9273047 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:59.034750 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-95a1d2ea-7a07-47ce-8ad9-3ca6d9273047 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:59.035264 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-95a1d2ea-7a07-47ce-8ad9-3ca6d9273047 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:59.035714 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-95a1d2ea-7a07-47ce-8ad9-3ca6d9273047 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:59.336768 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-917314c9-47bf-4a01-9668-08686d43f2d8 tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013cb5ed545e4aa29e25e8a6af35db7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a71c255d30a42e785c18fc1ce2208bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:59.346334 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-917314c9-47bf-4a01-9668-08686d43f2d8 tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] 10.222.0.43 "GET /compute/v2.1/servers/1f956517-1701-4171-9227-03726c7e8fca" status: 200 len: 1470 microversion: 2.1 time: 1.443421 Oct 04 18:36:59.365852 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 705/1537] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:57 2022] GET /compute/v2.1/servers/1f956517-1701-4171-9227-03726c7e8fca => generated 1470 bytes in 1464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:59.372910 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-e9f5302f-629c-43af-adc1-d8636b36b922 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:59.387627 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-e9f5302f-629c-43af-adc1-d8636b36b922 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] [instance: 67e13bce-be81-4775-be5f-737add9f1694] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:59.414375 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e9f5302f-629c-43af-adc1-d8636b36b922 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:59.415155 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e9f5302f-629c-43af-adc1-d8636b36b922 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:59.415885 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e9f5302f-629c-43af-adc1-d8636b36b922 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:59.416851 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e9f5302f-629c-43af-adc1-d8636b36b922 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:59.419195 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e9f5302f-629c-43af-adc1-d8636b36b922 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:59.427629 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e9f5302f-629c-43af-adc1-d8636b36b922 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:59.482886 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-e9f5302f-629c-43af-adc1-d8636b36b922 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] HTTP exception thrown: Instance 67e13bce-be81-4775-be5f-737add9f1694 could not be found. Oct 04 18:36:59.495428 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-e9f5302f-629c-43af-adc1-d8636b36b922 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Request method failure captured: Oct 04 18:36:59.495428 n-d-851028-13 devstack@n-api.service[123595]: request: GET /compute/v2.1/servers/67e13bce-be81-4775-be5f-737add9f1694 HTTP/1.1 Oct 04 18:36:59.495428 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 18:36:59.495428 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 18:36:59.495428 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 18:36:59.495428 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 0 Oct 04 18:36:59.495428 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 18:36:59.495428 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 18:36:59.495428 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 18:36:59.495428 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 18:36:59.495428 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPHzRWDp2hVFL0JAtKlVE8G-uulih7OSOnplpv9t3QonFD0lIqEO83RvLXzbmW5OmpojwG-ZUsozgMrnbVUkSYyDIfYn9xNztIBIK8mlGo-5SivrTUtLx7PYx4rOigHV-900fy3Gs4Ah4dgQwQoQl5-vvgDKYIdvoAk0cQuZOK7Q7BXE Oct 04 18:36:59.495428 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 18:36:59.495428 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 18:36:59.495428 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 18:36:59.495428 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 18:36:59.495428 n-d-851028-13 devstack@n-api.service[123595]: X-Openstack-Nova-Api-Version: 2.75 Oct 04 18:36:59.495428 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 18:36:59.495428 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 18:36:59.495428 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: f2c849c5d04f44f7951908d740ec1689 Oct 04 18:36:59.495428 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-ServersAdmin275Test-1829972118 Oct 04 18:36:59.495428 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 18:36:59.495428 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 18:36:59.495428 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/f2c849c5d04f44f7951908d740ec1689"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_f2c849c5d04f44f7951908d740ec1689"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f2c849c5d04f44f7951908d740ec1689"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f2c849c5d04f44f7951908d740ec1689"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:36:59.495428 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-ServersAdmin275Test-1829972118 Oct 04 18:36:59.495428 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: f2c849c5d04f44f7951908d740ec1689 Oct 04 18:36:59.495428 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-ServersAdmin275Test-1829972118 Oct 04 18:36:59.495428 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-ServersAdmin275Test-1829972118-project Oct 04 18:36:59.495428 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 18:36:59.495428 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 18:36:59.495428 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: 0d8b5e18327f4713a1e465acb9e863f1 Oct 04 18:36:59.495428 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-ServersAdmin275Test-1829972118-project Oct 04 18:36:59.495428 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 18:36:59.495428 n-d-851028-13 devstack@n-api.service[123595]: exception: Instance 67e13bce-be81-4775-be5f-737add9f1694 could not be found. Oct 04 18:36:59.495428 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': '67e13bce-be81-4775-be5f-737add9f1694'} Oct 04 18:36:59.495428 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:36:59.495428 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:36:59.495428 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:36:59.495428 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:36:59.495428 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:36:59.495428 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:36:59.495428 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:36:59.495428 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:36:59.495428 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:36:59.495428 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:36:59.495428 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 67e13bce-be81-4775-be5f-737add9f1694 could not be found. Oct 04 18:36:59.495428 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:36:59.495428 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:36:59.495428 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:36:59.495428 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:36:59.495428 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:36:59.495428 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:36:59.495428 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:36:59.495428 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:36:59.495428 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:36:59.495428 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:36:59.495428 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:36:59.495428 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:36:59.495428 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:36:59.495428 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:36:59.495428 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:36:59.495428 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:36:59.495428 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 67e13bce-be81-4775-be5f-737add9f1694 could not be found. Oct 04 18:36:59.495428 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:36:59.495428 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:36:59.495428 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:36:59.506064 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:36:59.506064 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:36:59.506064 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:36:59.506064 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:36:59.506064 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:36:59.506064 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 67e13bce-be81-4775-be5f-737add9f1694 could not be found. Oct 04 18:36:59.506064 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:36:59.506064 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-e9f5302f-629c-43af-adc1-d8636b36b922 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] Returning 404 to user: Instance 67e13bce-be81-4775-be5f-737add9f1694 could not be found. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:36:59.506064 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-e9f5302f-629c-43af-adc1-d8636b36b922 tempest-ServersAdmin275Test-1829972118 tempest-ServersAdmin275Test-1829972118-project] 10.222.0.43 "GET /compute/v2.1/servers/67e13bce-be81-4775-be5f-737add9f1694" status: 404 len: 111 microversion: 2.75 time: 0.128324 Oct 04 18:36:59.506064 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 706/1538] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:36:59 2022] GET /compute/v2.1/servers/67e13bce-be81-4775-be5f-737add9f1694 => generated 111 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:36:59.525866 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-1fc9cced-a911-4c58-a336-836e23041a82 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:59.526536 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-1fc9cced-a911-4c58-a336-836e23041a82 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] [instance: 86743a21-e24e-4001-b3da-48615f6e281e] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:59.558293 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1fc9cced-a911-4c58-a336-836e23041a82 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:59.558835 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1fc9cced-a911-4c58-a336-836e23041a82 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:59.565395 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1fc9cced-a911-4c58-a336-836e23041a82 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:59.573254 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1fc9cced-a911-4c58-a336-836e23041a82 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:59.575313 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1fc9cced-a911-4c58-a336-836e23041a82 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:59.575732 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1fc9cced-a911-4c58-a336-836e23041a82 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:59.621400 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-95a1d2ea-7a07-47ce-8ad9-3ca6d9273047 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64887fff0bc7417094c4fee2f7e9aa5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6187bfad04cb7bc17155862ee0cdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:59.636224 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-95a1d2ea-7a07-47ce-8ad9-3ca6d9273047 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] 10.222.0.43 "GET /compute/v2.1/servers/eb05639b-cd53-4c27-9505-20e668a16acc" status: 200 len: 1680 microversion: 2.1 time: 0.679731 Oct 04 18:36:59.661159 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 833/1539] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:58 2022] GET /compute/v2.1/servers/eb05639b-cd53-4c27-9505-20e668a16acc => generated 1680 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:59.698267 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-322e41fe-ecc2-432b-8a45-d22b8d68773c tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:59.702379 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-322e41fe-ecc2-432b-8a45-d22b8d68773c tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] [instance: 64228016-ae20-4fcb-87da-c3d4d585e241] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:59.727363 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-322e41fe-ecc2-432b-8a45-d22b8d68773c tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:59.736385 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-322e41fe-ecc2-432b-8a45-d22b8d68773c tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:59.737314 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-322e41fe-ecc2-432b-8a45-d22b8d68773c tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:59.740518 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-322e41fe-ecc2-432b-8a45-d22b8d68773c tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:59.742374 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-322e41fe-ecc2-432b-8a45-d22b8d68773c tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:59.743088 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-322e41fe-ecc2-432b-8a45-d22b8d68773c tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:59.954251 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-1fc9cced-a911-4c58-a336-836e23041a82 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa193aff0474ae3ba5d1aa7b0d0e8c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a06b8feba3404490a448aa2d4fb106b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:59.966301 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:36:59.972610 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-1fc9cced-a911-4c58-a336-836e23041a82 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] 10.222.0.43 "GET /compute/v2.1/servers/86743a21-e24e-4001-b3da-48615f6e281e" status: 200 len: 1274 microversion: 2.1 time: 0.467096 Oct 04 18:36:59.977807 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 707/1540] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:59 2022] GET /compute/v2.1/servers/86743a21-e24e-4001-b3da-48615f6e281e => generated 1274 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:59.986889 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-317aa044-c1ea-4ed5-b682-adb11b1bf398 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:59.992188 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-317aa044-c1ea-4ed5-b682-adb11b1bf398 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] [instance: 7222a4ce-d2a2-4b09-afc6-55bca52414d4] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:00.027502 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-317aa044-c1ea-4ed5-b682-adb11b1bf398 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:00.028173 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-317aa044-c1ea-4ed5-b682-adb11b1bf398 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:00.028625 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-317aa044-c1ea-4ed5-b682-adb11b1bf398 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:00.030821 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-317aa044-c1ea-4ed5-b682-adb11b1bf398 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:00.033795 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-317aa044-c1ea-4ed5-b682-adb11b1bf398 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:00.035882 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-317aa044-c1ea-4ed5-b682-adb11b1bf398 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:00.165966 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-322e41fe-ecc2-432b-8a45-d22b8d68773c tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a41ab6fb78a42ceaca621c5a38ffc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa31ed92017490a82497c7b8910aef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:00.175831 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-322e41fe-ecc2-432b-8a45-d22b8d68773c tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] 10.222.0.43 "GET /compute/v2.1/servers/64228016-ae20-4fcb-87da-c3d4d585e241" status: 200 len: 1308 microversion: 2.1 time: 0.513294 Oct 04 18:37:00.184644 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 834/1541] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:59 2022] GET /compute/v2.1/servers/64228016-ae20-4fcb-87da-c3d4d585e241 => generated 1308 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:00.735950 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-348ba2b7-75cf-4f34-9e80-4aa7e671098e req-f71b7ebe-b35b-488c-aae6-62e86314bb34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f956517-1701-4171-9227-03726c7e8fca", "name": "network-vif-deleted", "tag": "514cb875-d7dc-421d-b51a-0a154956df58"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:37:00.765663 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-348ba2b7-75cf-4f34-9e80-4aa7e671098e req-f71b7ebe-b35b-488c-aae6-62e86314bb34 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:00.778657 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-348ba2b7-75cf-4f34-9e80-4aa7e671098e req-f71b7ebe-b35b-488c-aae6-62e86314bb34 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:00.779209 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-348ba2b7-75cf-4f34-9e80-4aa7e671098e req-f71b7ebe-b35b-488c-aae6-62e86314bb34 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:00.804769 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-348ba2b7-75cf-4f34-9e80-4aa7e671098e req-f71b7ebe-b35b-488c-aae6-62e86314bb34 service nova] Creating event network-vif-deleted:514cb875-d7dc-421d-b51a-0a154956df58 for instance 1f956517-1701-4171-9227-03726c7e8fca on n-h1-851028-13 Oct 04 18:37:00.822318 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-348ba2b7-75cf-4f34-9e80-4aa7e671098e req-f71b7ebe-b35b-488c-aae6-62e86314bb34 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.633572 Oct 04 18:37:00.825479 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 835/1542] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:37:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:37:00.840712 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-abd9cbcc-8674-430e-a911-778013ce71f8 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:00.841770 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-abd9cbcc-8674-430e-a911-778013ce71f8 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: ce0d629a-068c-4a62-8a03-fc43fc0be9b3] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:00.853856 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-abd9cbcc-8674-430e-a911-778013ce71f8 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:00.854365 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-abd9cbcc-8674-430e-a911-778013ce71f8 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:00.858023 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-abd9cbcc-8674-430e-a911-778013ce71f8 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:00.860308 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-abd9cbcc-8674-430e-a911-778013ce71f8 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:00.861066 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-abd9cbcc-8674-430e-a911-778013ce71f8 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:00.862652 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-abd9cbcc-8674-430e-a911-778013ce71f8 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:00.945821 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=100 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:37:01.020180 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-317aa044-c1ea-4ed5-b682-adb11b1bf398 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:01.053731 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-317aa044-c1ea-4ed5-b682-adb11b1bf398 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:01.056150 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-317aa044-c1ea-4ed5-b682-adb11b1bf398 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:01.057707 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-317aa044-c1ea-4ed5-b682-adb11b1bf398 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] 10.222.0.43 "GET /compute/v2.1/servers/7222a4ce-d2a2-4b09-afc6-55bca52414d4" status: 200 len: 1815 microversion: 2.25 time: 1.076475 Oct 04 18:37:01.058490 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 708/1543] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:36:59 2022] GET /compute/v2.1/servers/7222a4ce-d2a2-4b09-afc6-55bca52414d4 => generated 1815 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:37:01.082340 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-b2b06e6c-bf7c-4111-92f5-e1bfac4bc871 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Calling method '.version_select at 0x7fb21f74c820>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:01.192320 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-b2b06e6c-bf7c-4111-92f5-e1bfac4bc871 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] 10.222.0.43 "GET /compute/v2.1/images/3adaa529-06f7-4c7d-8ad1-d56ec671ea9a" status: 200 len: 1424 microversion: 2.1 time: 0.113471 Oct 04 18:37:01.202428 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 709/1544] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 18:37:01 2022] GET /compute/v2.1/images/3adaa529-06f7-4c7d-8ad1-d56ec671ea9a => generated 1424 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:01.379676 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-fbe383db-98c0-4f91-8ca6-2c19eb0255d4 req-b9308625-1d6d-45c6-93bf-ded4613a227d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce0d629a-068c-4a62-8a03-fc43fc0be9b3", "tag": "5b0b787d-0181-4910-a488-5e61d24675ce"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:37:01.396764 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-fbe383db-98c0-4f91-8ca6-2c19eb0255d4 req-b9308625-1d6d-45c6-93bf-ded4613a227d service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:01.397637 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-fbe383db-98c0-4f91-8ca6-2c19eb0255d4 req-b9308625-1d6d-45c6-93bf-ded4613a227d service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:01.399094 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-fbe383db-98c0-4f91-8ca6-2c19eb0255d4 req-b9308625-1d6d-45c6-93bf-ded4613a227d service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:01.425521 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-fbe383db-98c0-4f91-8ca6-2c19eb0255d4 req-b9308625-1d6d-45c6-93bf-ded4613a227d service nova] Creating event network-changed:5b0b787d-0181-4910-a488-5e61d24675ce for instance ce0d629a-068c-4a62-8a03-fc43fc0be9b3 on n-h1-851028-13 Oct 04 18:37:01.435072 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [req-fbe383db-98c0-4f91-8ca6-2c19eb0255d4 req-b9308625-1d6d-45c6-93bf-ded4613a227d service nova] Instance ce0d629a-068c-4a62-8a03-fc43fc0be9b3 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851028-13', 'n-h2-851028-13'} {{(pid=123595) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 18:37:01.451053 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-fbe383db-98c0-4f91-8ca6-2c19eb0255d4 req-b9308625-1d6d-45c6-93bf-ded4613a227d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.245954 Oct 04 18:37:01.452835 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 710/1545] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:37:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:37:01.458905 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-79ab8569-f87c-4b72-9abc-acf30f86b147 tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:01.460331 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-79ab8569-f87c-4b72-9abc-acf30f86b147 tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] [instance: 1f956517-1701-4171-9227-03726c7e8fca] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:01.482789 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-79ab8569-f87c-4b72-9abc-acf30f86b147 tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:01.483671 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-79ab8569-f87c-4b72-9abc-acf30f86b147 tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:01.484373 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-79ab8569-f87c-4b72-9abc-acf30f86b147 tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:01.485426 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-79ab8569-f87c-4b72-9abc-acf30f86b147 tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:01.486580 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-79ab8569-f87c-4b72-9abc-acf30f86b147 tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:01.487435 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-79ab8569-f87c-4b72-9abc-acf30f86b147 tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:01.544134 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-79ab8569-f87c-4b72-9abc-acf30f86b147 tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:01.545447 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-79ab8569-f87c-4b72-9abc-acf30f86b147 tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:01.546004 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-79ab8569-f87c-4b72-9abc-acf30f86b147 tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:01.547322 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.objects.instance [None req-79ab8569-f87c-4b72-9abc-acf30f86b147 tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] Lazy-loading 'fault' on Instance uuid 1f956517-1701-4171-9227-03726c7e8fca {{(pid=123595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:37:01.643585 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-79ab8569-f87c-4b72-9abc-acf30f86b147 tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013cb5ed545e4aa29e25e8a6af35db7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a71c255d30a42e785c18fc1ce2208bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:01.692702 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-79ab8569-f87c-4b72-9abc-acf30f86b147 tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] 10.222.0.43 "GET /compute/v2.1/servers/1f956517-1701-4171-9227-03726c7e8fca" status: 200 len: 1304 microversion: 2.1 time: 0.238277 Oct 04 18:37:01.702872 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 711/1546] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:01 2022] GET /compute/v2.1/servers/1f956517-1701-4171-9227-03726c7e8fca => generated 1304 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:01.711932 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-e9623497-79da-4009-9705-04e6a8cbf584 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:01.714107 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-e9623497-79da-4009-9705-04e6a8cbf584 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] [instance: eb05639b-cd53-4c27-9505-20e668a16acc] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:01.745152 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e9623497-79da-4009-9705-04e6a8cbf584 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:01.751314 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e9623497-79da-4009-9705-04e6a8cbf584 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:01.753756 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e9623497-79da-4009-9705-04e6a8cbf584 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:01.760727 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e9623497-79da-4009-9705-04e6a8cbf584 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:01.761532 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e9623497-79da-4009-9705-04e6a8cbf584 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:01.771798 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e9623497-79da-4009-9705-04e6a8cbf584 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:01.975864 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-e9623497-79da-4009-9705-04e6a8cbf584 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64887fff0bc7417094c4fee2f7e9aa5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6187bfad04cb7bc17155862ee0cdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:01.985662 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-e9623497-79da-4009-9705-04e6a8cbf584 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] 10.222.0.43 "GET /compute/v2.1/servers/eb05639b-cd53-4c27-9505-20e668a16acc" status: 200 len: 1613 microversion: 2.1 time: 0.281363 Oct 04 18:37:01.989890 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 712/1547] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:01 2022] GET /compute/v2.1/servers/eb05639b-cd53-4c27-9505-20e668a16acc => generated 1613 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:01.995672 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-fc029545-7082-4484-b8d9-5537a48868be tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:02.002031 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-fc029545-7082-4484-b8d9-5537a48868be tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] [instance: 86743a21-e24e-4001-b3da-48615f6e281e] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:02.019018 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fc029545-7082-4484-b8d9-5537a48868be tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:02.019785 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fc029545-7082-4484-b8d9-5537a48868be tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:02.020419 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fc029545-7082-4484-b8d9-5537a48868be tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:02.021833 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fc029545-7082-4484-b8d9-5537a48868be tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:02.022519 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fc029545-7082-4484-b8d9-5537a48868be tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:02.023143 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fc029545-7082-4484-b8d9-5537a48868be tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:02.203487 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-abd9cbcc-8674-430e-a911-778013ce71f8 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:02.219996 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-abd9cbcc-8674-430e-a911-778013ce71f8 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/ce0d629a-068c-4a62-8a03-fc43fc0be9b3" status: 200 len: 1474 microversion: 2.1 time: 1.392944 Oct 04 18:37:02.229426 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 836/1548] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:00 2022] GET /compute/v2.1/servers/ce0d629a-068c-4a62-8a03-fc43fc0be9b3 => generated 1474 bytes in 1403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:02.244044 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-3c0aa6a2-605a-4d70-8654-17ead8f2504b tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:02.251596 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-3c0aa6a2-605a-4d70-8654-17ead8f2504b tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] [instance: 64228016-ae20-4fcb-87da-c3d4d585e241] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:02.271023 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3c0aa6a2-605a-4d70-8654-17ead8f2504b tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:02.274016 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3c0aa6a2-605a-4d70-8654-17ead8f2504b tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:02.274604 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3c0aa6a2-605a-4d70-8654-17ead8f2504b tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:02.275620 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3c0aa6a2-605a-4d70-8654-17ead8f2504b tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:02.277882 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3c0aa6a2-605a-4d70-8654-17ead8f2504b tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:02.278581 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3c0aa6a2-605a-4d70-8654-17ead8f2504b tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:02.304634 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-fc029545-7082-4484-b8d9-5537a48868be tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa193aff0474ae3ba5d1aa7b0d0e8c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a06b8feba3404490a448aa2d4fb106b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:02.324024 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-fc029545-7082-4484-b8d9-5537a48868be tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] 10.222.0.43 "GET /compute/v2.1/servers/86743a21-e24e-4001-b3da-48615f6e281e" status: 200 len: 1282 microversion: 2.1 time: 0.326307 Oct 04 18:37:02.324756 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 713/1549] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:01 2022] GET /compute/v2.1/servers/86743a21-e24e-4001-b3da-48615f6e281e => generated 1282 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:02.347811 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-24a3041b-e5d1-49f7-a979-fb175d616a9c tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:02.349042 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-24a3041b-e5d1-49f7-a979-fb175d616a9c tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] [instance: 7222a4ce-d2a2-4b09-afc6-55bca52414d4] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:02.370262 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-24a3041b-e5d1-49f7-a979-fb175d616a9c tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:02.373737 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-24a3041b-e5d1-49f7-a979-fb175d616a9c tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:02.374192 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-24a3041b-e5d1-49f7-a979-fb175d616a9c tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:02.374923 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-24a3041b-e5d1-49f7-a979-fb175d616a9c tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:02.375546 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-24a3041b-e5d1-49f7-a979-fb175d616a9c tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:02.378984 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-24a3041b-e5d1-49f7-a979-fb175d616a9c tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:03.283235 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-3c0aa6a2-605a-4d70-8654-17ead8f2504b tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a41ab6fb78a42ceaca621c5a38ffc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa31ed92017490a82497c7b8910aef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:03.311819 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-3c0aa6a2-605a-4d70-8654-17ead8f2504b tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] 10.222.0.43 "GET /compute/v2.1/servers/64228016-ae20-4fcb-87da-c3d4d585e241" status: 200 len: 1308 microversion: 2.1 time: 1.067437 Oct 04 18:37:03.312873 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 837/1550] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:02 2022] GET /compute/v2.1/servers/64228016-ae20-4fcb-87da-c3d4d585e241 => generated 1308 bytes in 1083 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:03.330671 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-c421160b-fefb-462e-ba9b-2e2ac0e58e77 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Calling method '.version_select at 0x7fb227ed8d30>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:03.418839 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-c421160b-fefb-462e-ba9b-2e2ac0e58e77 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] 10.222.0.43 "GET /compute/v2.1/images/3adaa529-06f7-4c7d-8ad1-d56ec671ea9a" status: 200 len: 1424 microversion: 2.1 time: 0.104495 Oct 04 18:37:03.427991 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 838/1551] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 18:37:03 2022] GET /compute/v2.1/images/3adaa529-06f7-4c7d-8ad1-d56ec671ea9a => generated 1424 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:03.433916 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-8a1008f4-0c0a-4873-b833-7cd74e308210 tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:03.446151 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-8a1008f4-0c0a-4873-b833-7cd74e308210 tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] [instance: 1f956517-1701-4171-9227-03726c7e8fca] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:03.454721 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8a1008f4-0c0a-4873-b833-7cd74e308210 tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:03.461047 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8a1008f4-0c0a-4873-b833-7cd74e308210 tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:03.461906 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8a1008f4-0c0a-4873-b833-7cd74e308210 tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:03.462830 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8a1008f4-0c0a-4873-b833-7cd74e308210 tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:03.463473 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8a1008f4-0c0a-4873-b833-7cd74e308210 tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:03.464074 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8a1008f4-0c0a-4873-b833-7cd74e308210 tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:03.553102 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8a1008f4-0c0a-4873-b833-7cd74e308210 tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:03.554964 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8a1008f4-0c0a-4873-b833-7cd74e308210 tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:03.556913 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8a1008f4-0c0a-4873-b833-7cd74e308210 tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:03.557979 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.objects.instance [None req-8a1008f4-0c0a-4873-b833-7cd74e308210 tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] Lazy-loading 'fault' on Instance uuid 1f956517-1701-4171-9227-03726c7e8fca {{(pid=123596) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:37:03.806462 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-8a1008f4-0c0a-4873-b833-7cd74e308210 tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013cb5ed545e4aa29e25e8a6af35db7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a71c255d30a42e785c18fc1ce2208bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:03.818963 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-8a1008f4-0c0a-4873-b833-7cd74e308210 tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] 10.222.0.43 "GET /compute/v2.1/servers/1f956517-1701-4171-9227-03726c7e8fca" status: 200 len: 1304 microversion: 2.1 time: 0.388867 Oct 04 18:37:03.822093 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 839/1552] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:03 2022] GET /compute/v2.1/servers/1f956517-1701-4171-9227-03726c7e8fca => generated 1304 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:03.829123 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-9daae011-39b7-4194-a9f5-c736c95b7dd8 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:03.846121 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-9daae011-39b7-4194-a9f5-c736c95b7dd8 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] [instance: eb05639b-cd53-4c27-9505-20e668a16acc] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:03.854149 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9daae011-39b7-4194-a9f5-c736c95b7dd8 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:03.861045 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9daae011-39b7-4194-a9f5-c736c95b7dd8 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:03.862102 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9daae011-39b7-4194-a9f5-c736c95b7dd8 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:03.863102 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9daae011-39b7-4194-a9f5-c736c95b7dd8 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:03.863748 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9daae011-39b7-4194-a9f5-c736c95b7dd8 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:03.864372 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9daae011-39b7-4194-a9f5-c736c95b7dd8 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:03.890353 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-9daae011-39b7-4194-a9f5-c736c95b7dd8 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] HTTP exception thrown: Instance eb05639b-cd53-4c27-9505-20e668a16acc could not be found. Oct 04 18:37:03.903162 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-9daae011-39b7-4194-a9f5-c736c95b7dd8 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Request method failure captured: Oct 04 18:37:03.903162 n-d-851028-13 devstack@n-api.service[123596]: request: GET /compute/v2.1/servers/eb05639b-cd53-4c27-9505-20e668a16acc HTTP/1.1 Oct 04 18:37:03.903162 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:37:03.903162 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:37:03.903162 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:37:03.903162 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 18:37:03.903162 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:37:03.903162 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:37:03.903162 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:37:03.903162 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:37:03.903162 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPHyRpx9Vi7hlUpPB369niRBxdu4Tbz1_IwmyOHt6h_OXXj-uJmvUoFTRUHlWXGc_-uDdGrSQsoBiSoOmzZLa0L_oIG-VrHpSBN7BeRmoSgDp0TpnTIRFhm6vKPEsF1Gk1W6YNQk-mB5F7I7nx-pqqvHFj2gju6lXDpM_KJpEkUufITw Oct 04 18:37:03.903162 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:37:03.903162 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:37:03.903162 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:37:03.903162 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:37:03.903162 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:37:03.903162 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:37:03.903162 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: a1d6187bfad04cb7bc17155862ee0cdc Oct 04 18:37:03.903162 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-VolumesAdminNegativeTest-600132423 Oct 04 18:37:03.903162 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 18:37:03.903162 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 18:37:03.903162 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/a1d6187bfad04cb7bc17155862ee0cdc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_a1d6187bfad04cb7bc17155862ee0cdc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a1d6187bfad04cb7bc17155862ee0cdc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a1d6187bfad04cb7bc17155862ee0cdc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:37:03.903162 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-VolumesAdminNegativeTest-600132423 Oct 04 18:37:03.903162 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: a1d6187bfad04cb7bc17155862ee0cdc Oct 04 18:37:03.903162 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-600132423 Oct 04 18:37:03.903162 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-VolumesAdminNegativeTest-600132423-project Oct 04 18:37:03.903162 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:37:03.903162 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:37:03.903162 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 64887fff0bc7417094c4fee2f7e9aa5a Oct 04 18:37:03.903162 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-VolumesAdminNegativeTest-600132423-project Oct 04 18:37:03.903162 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 18:37:03.903162 n-d-851028-13 devstack@n-api.service[123596]: exception: Instance eb05639b-cd53-4c27-9505-20e668a16acc could not be found. Oct 04 18:37:03.903162 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': 'eb05639b-cd53-4c27-9505-20e668a16acc'} Oct 04 18:37:03.903162 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:37:03.903162 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:03.903162 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:37:03.903162 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:37:03.903162 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:37:03.903162 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:37:03.903162 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:37:03.903162 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:37:03.903162 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:37:03.903162 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:37:03.903162 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb05639b-cd53-4c27-9505-20e668a16acc could not be found. Oct 04 18:37:03.903162 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:37:03.903162 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:37:03.903162 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:37:03.903162 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:03.903162 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:37:03.903162 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:37:03.903162 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:37:03.903162 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:37:03.903162 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:37:03.903162 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:37:03.903162 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:37:03.903162 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:37:03.903162 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:37:03.903162 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:37:03.903162 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:37:03.903162 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:37:03.903162 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb05639b-cd53-4c27-9505-20e668a16acc could not be found. Oct 04 18:37:03.903162 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:37:03.903162 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:37:03.903162 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:37:03.908608 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:03.908608 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:37:03.908608 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:37:03.908608 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:37:03.908608 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:37:03.908608 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb05639b-cd53-4c27-9505-20e668a16acc could not be found. Oct 04 18:37:03.908608 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:37:03.910035 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-9daae011-39b7-4194-a9f5-c736c95b7dd8 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Returning 404 to user: Instance eb05639b-cd53-4c27-9505-20e668a16acc could not be found. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:37:03.911087 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-9daae011-39b7-4194-a9f5-c736c95b7dd8 tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] 10.222.0.43 "GET /compute/v2.1/servers/eb05639b-cd53-4c27-9505-20e668a16acc" status: 404 len: 111 microversion: 2.1 time: 0.085809 Oct 04 18:37:03.915727 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 840/1553] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:03 2022] GET /compute/v2.1/servers/eb05639b-cd53-4c27-9505-20e668a16acc => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:37:03.921709 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-1180bbcd-d4e0-4358-bc68-944ea4aaeb70 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:03.929268 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-1180bbcd-d4e0-4358-bc68-944ea4aaeb70 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: ce0d629a-068c-4a62-8a03-fc43fc0be9b3] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:03.946045 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1180bbcd-d4e0-4358-bc68-944ea4aaeb70 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:03.947019 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1180bbcd-d4e0-4358-bc68-944ea4aaeb70 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:03.947663 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1180bbcd-d4e0-4358-bc68-944ea4aaeb70 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:03.948590 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1180bbcd-d4e0-4358-bc68-944ea4aaeb70 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:03.950166 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1180bbcd-d4e0-4358-bc68-944ea4aaeb70 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:03.950820 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1180bbcd-d4e0-4358-bc68-944ea4aaeb70 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:04.467406 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-1180bbcd-d4e0-4358-bc68-944ea4aaeb70 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:04.481845 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-1180bbcd-d4e0-4358-bc68-944ea4aaeb70 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/ce0d629a-068c-4a62-8a03-fc43fc0be9b3" status: 200 len: 1471 microversion: 2.1 time: 0.564747 Oct 04 18:37:04.489063 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 841/1554] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:03 2022] GET /compute/v2.1/servers/ce0d629a-068c-4a62-8a03-fc43fc0be9b3 => generated 1471 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:04.500160 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-78aae1ca-f912-4431-ac7b-63d8e8dacca1 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:04.510562 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-78aae1ca-f912-4431-ac7b-63d8e8dacca1 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] [instance: 86743a21-e24e-4001-b3da-48615f6e281e] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:04.532620 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-78aae1ca-f912-4431-ac7b-63d8e8dacca1 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:04.538432 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-78aae1ca-f912-4431-ac7b-63d8e8dacca1 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:04.542483 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-78aae1ca-f912-4431-ac7b-63d8e8dacca1 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:04.543577 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-78aae1ca-f912-4431-ac7b-63d8e8dacca1 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:04.546241 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-78aae1ca-f912-4431-ac7b-63d8e8dacca1 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:04.546973 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-78aae1ca-f912-4431-ac7b-63d8e8dacca1 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:04.781338 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-78aae1ca-f912-4431-ac7b-63d8e8dacca1 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa193aff0474ae3ba5d1aa7b0d0e8c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a06b8feba3404490a448aa2d4fb106b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:04.794308 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-78aae1ca-f912-4431-ac7b-63d8e8dacca1 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] 10.222.0.43 "GET /compute/v2.1/servers/86743a21-e24e-4001-b3da-48615f6e281e" status: 200 len: 1280 microversion: 2.1 time: 0.303983 Oct 04 18:37:04.799753 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 842/1555] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:04 2022] GET /compute/v2.1/servers/86743a21-e24e-4001-b3da-48615f6e281e => generated 1280 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:04.821680 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-8e3783e1-8aa4-4f35-8afd-a7eaee11a3a0 req-0214d6aa-15a4-4fc8-9883-d30bf38b3ca8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64228016-ae20-4fcb-87da-c3d4d585e241", "tag": "544eb6fd-0a18-483e-aad4-45ebdf392b69"}, {"server_uuid": "eb05639b-cd53-4c27-9505-20e668a16acc", "name": "network-vif-deleted", "tag": "1ffe1dcb-316b-4423-ae6b-6882dba87be0"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:37:04.855850 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-24a3041b-e5d1-49f7-a979-fb175d616a9c tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:04.874536 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-24a3041b-e5d1-49f7-a979-fb175d616a9c tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:04.878247 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-24a3041b-e5d1-49f7-a979-fb175d616a9c tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:04.881154 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-8e3783e1-8aa4-4f35-8afd-a7eaee11a3a0 req-0214d6aa-15a4-4fc8-9883-d30bf38b3ca8 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:04.882861 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-8e3783e1-8aa4-4f35-8afd-a7eaee11a3a0 req-0214d6aa-15a4-4fc8-9883-d30bf38b3ca8 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:04.883574 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-24a3041b-e5d1-49f7-a979-fb175d616a9c tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] 10.222.0.43 "GET /compute/v2.1/servers/7222a4ce-d2a2-4b09-afc6-55bca52414d4" status: 200 len: 1815 microversion: 2.25 time: 2.551758 Oct 04 18:37:04.885879 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 714/1556] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:37:02 2022] GET /compute/v2.1/servers/7222a4ce-d2a2-4b09-afc6-55bca52414d4 => generated 1815 bytes in 2556 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:37:04.886589 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-8e3783e1-8aa4-4f35-8afd-a7eaee11a3a0 req-0214d6aa-15a4-4fc8-9883-d30bf38b3ca8 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:04.902622 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-d153664e-283b-417b-bd45-4a80ccd2033c tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] Calling method '.version_select at 0x7fb21fa3f940>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:04.909964 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-8e3783e1-8aa4-4f35-8afd-a7eaee11a3a0 req-0214d6aa-15a4-4fc8-9883-d30bf38b3ca8 service nova] Creating event network-changed:544eb6fd-0a18-483e-aad4-45ebdf392b69 for instance 64228016-ae20-4fcb-87da-c3d4d585e241 on n-h1-851028-13 Oct 04 18:37:04.910490 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-8e3783e1-8aa4-4f35-8afd-a7eaee11a3a0 req-0214d6aa-15a4-4fc8-9883-d30bf38b3ca8 service nova] Creating event network-vif-deleted:1ffe1dcb-316b-4423-ae6b-6882dba87be0 for instance eb05639b-cd53-4c27-9505-20e668a16acc on n-h2-851028-13 Oct 04 18:37:04.943822 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-8e3783e1-8aa4-4f35-8afd-a7eaee11a3a0 req-0214d6aa-15a4-4fc8-9883-d30bf38b3ca8 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.146000 Oct 04 18:37:04.944818 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 843/1557] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:37:04 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:37:04.950289 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-d153664e-283b-417b-bd45-4a80ccd2033c tempest-VolumesAdminNegativeTest-600132423 tempest-VolumesAdminNegativeTest-600132423-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1832452513" status: 202 len: 0 microversion: 2.1 time: 0.060888 Oct 04 18:37:04.950517 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-2d0a87b6-db59-4491-8c83-5ef2d06b7b70 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:04.951165 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-2d0a87b6-db59-4491-8c83-5ef2d06b7b70 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] [instance: 64228016-ae20-4fcb-87da-c3d4d585e241] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:04.952055 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 715/1558] 10.222.0.43 () {58 vars in 1221 bytes} [Tue Oct 4 18:37:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1832452513 => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:37:04.964119 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-79fa25b3-4623-4d53-a1da-dc2e13f35877 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Calling method '.version_select at 0x7fb21fa3a4c0>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:04.970449 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2d0a87b6-db59-4491-8c83-5ef2d06b7b70 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:04.970960 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2d0a87b6-db59-4491-8c83-5ef2d06b7b70 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:04.971449 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2d0a87b6-db59-4491-8c83-5ef2d06b7b70 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:04.972172 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2d0a87b6-db59-4491-8c83-5ef2d06b7b70 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:04.973142 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2d0a87b6-db59-4491-8c83-5ef2d06b7b70 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:04.973142 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2d0a87b6-db59-4491-8c83-5ef2d06b7b70 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:05.122031 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-79fa25b3-4623-4d53-a1da-dc2e13f35877 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] 10.222.0.43 "GET /compute/v2.1/images/3adaa529-06f7-4c7d-8ad1-d56ec671ea9a" status: 200 len: 1424 microversion: 2.1 time: 0.168437 Oct 04 18:37:05.125155 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 716/1559] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 18:37:04 2022] GET /compute/v2.1/images/3adaa529-06f7-4c7d-8ad1-d56ec671ea9a => generated 1424 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:05.140056 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-163a1bd5-bc43-47b4-9c2b-ab159f4e02b4 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:37:05.142768 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-163a1bd5-bc43-47b4-9c2b-ab159f4e02b4 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: ce0d629a-068c-4a62-8a03-fc43fc0be9b3] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:05.160118 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-163a1bd5-bc43-47b4-9c2b-ab159f4e02b4 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:05.161294 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-163a1bd5-bc43-47b4-9c2b-ab159f4e02b4 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:05.164954 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-163a1bd5-bc43-47b4-9c2b-ab159f4e02b4 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:05.168704 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-163a1bd5-bc43-47b4-9c2b-ab159f4e02b4 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:05.170022 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-163a1bd5-bc43-47b4-9c2b-ab159f4e02b4 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:05.170666 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-163a1bd5-bc43-47b4-9c2b-ab159f4e02b4 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:05.364441 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-163a1bd5-bc43-47b4-9c2b-ab159f4e02b4 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "POST /compute/v2.1/servers/ce0d629a-068c-4a62-8a03-fc43fc0be9b3/action" status: 204 len: 0 microversion: 2.1 time: 0.236955 Oct 04 18:37:05.368073 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 717/1560] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 18:37:05 2022] POST /compute/v2.1/servers/ce0d629a-068c-4a62-8a03-fc43fc0be9b3/action => generated 0 bytes in 242 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:37:05.385453 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-099033a1-6b98-441c-98e9-c5abbdbb37c3 tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:05.387386 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-099033a1-6b98-441c-98e9-c5abbdbb37c3 tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] [instance: 1f956517-1701-4171-9227-03726c7e8fca] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:05.428644 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-099033a1-6b98-441c-98e9-c5abbdbb37c3 tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:05.431281 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-099033a1-6b98-441c-98e9-c5abbdbb37c3 tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:05.431985 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-099033a1-6b98-441c-98e9-c5abbdbb37c3 tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:05.435297 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-099033a1-6b98-441c-98e9-c5abbdbb37c3 tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:05.436434 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-099033a1-6b98-441c-98e9-c5abbdbb37c3 tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:05.437183 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-099033a1-6b98-441c-98e9-c5abbdbb37c3 tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:05.488751 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-099033a1-6b98-441c-98e9-c5abbdbb37c3 tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] HTTP exception thrown: Instance 1f956517-1701-4171-9227-03726c7e8fca could not be found. Oct 04 18:37:05.495852 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-099033a1-6b98-441c-98e9-c5abbdbb37c3 tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] Request method failure captured: Oct 04 18:37:05.495852 n-d-851028-13 devstack@n-api.service[123595]: request: GET /compute/v2.1/servers/1f956517-1701-4171-9227-03726c7e8fca HTTP/1.1 Oct 04 18:37:05.495852 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 18:37:05.495852 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 18:37:05.495852 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 18:37:05.495852 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 0 Oct 04 18:37:05.495852 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 18:37:05.495852 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 18:37:05.495852 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 18:37:05.495852 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 18:37:05.495852 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPH0oItoFuylEXTySyz60njnhjzo_wJVYImFToi6Joaax4qvIl-mD6SU8_E2C065D8IqpHNZl4TxBhf3I_f6f9MT7UN1M5bIQNeDNPZ6Op8rNWZ7O-BXupFKlmv9WMoRzJJFS6HkITWNiHGVrLK9jkyRfc5JULiVzz_eXsurVr44tB4k Oct 04 18:37:05.495852 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 18:37:05.495852 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 18:37:05.495852 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 18:37:05.495852 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 18:37:05.495852 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 18:37:05.495852 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 18:37:05.495852 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: 4a71c255d30a42e785c18fc1ce2208bf Oct 04 18:37:05.495852 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-TenantUsagesTestJSON-48080970 Oct 04 18:37:05.495852 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 18:37:05.495852 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 18:37:05.495852 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/4a71c255d30a42e785c18fc1ce2208bf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_4a71c255d30a42e785c18fc1ce2208bf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4a71c255d30a42e785c18fc1ce2208bf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4a71c255d30a42e785c18fc1ce2208bf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:37:05.495852 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-TenantUsagesTestJSON-48080970 Oct 04 18:37:05.495852 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: 4a71c255d30a42e785c18fc1ce2208bf Oct 04 18:37:05.495852 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-TenantUsagesTestJSON-48080970 Oct 04 18:37:05.495852 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-TenantUsagesTestJSON-48080970-project Oct 04 18:37:05.495852 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 18:37:05.495852 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 18:37:05.495852 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: 013cb5ed545e4aa29e25e8a6af35db7f Oct 04 18:37:05.495852 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-TenantUsagesTestJSON-48080970-project Oct 04 18:37:05.495852 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 18:37:05.495852 n-d-851028-13 devstack@n-api.service[123595]: exception: Instance 1f956517-1701-4171-9227-03726c7e8fca could not be found. Oct 04 18:37:05.495852 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': '1f956517-1701-4171-9227-03726c7e8fca'} Oct 04 18:37:05.495852 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:37:05.495852 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:05.495852 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:37:05.495852 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:37:05.495852 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:37:05.495852 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:37:05.495852 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:37:05.495852 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:37:05.495852 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:37:05.495852 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:37:05.495852 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f956517-1701-4171-9227-03726c7e8fca could not be found. Oct 04 18:37:05.495852 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:37:05.495852 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:37:05.495852 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:37:05.495852 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:05.495852 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:37:05.495852 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:37:05.495852 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:37:05.495852 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:37:05.495852 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:37:05.495852 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:37:05.495852 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:37:05.495852 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:37:05.495852 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:37:05.495852 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:37:05.495852 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:37:05.495852 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:37:05.495852 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f956517-1701-4171-9227-03726c7e8fca could not be found. Oct 04 18:37:05.495852 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:37:05.495852 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:37:05.495852 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:37:05.500378 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:05.500378 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:37:05.500378 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:37:05.500378 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:37:05.500378 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:37:05.500378 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f956517-1701-4171-9227-03726c7e8fca could not be found. Oct 04 18:37:05.500378 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:37:05.504788 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-099033a1-6b98-441c-98e9-c5abbdbb37c3 tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] Returning 404 to user: Instance 1f956517-1701-4171-9227-03726c7e8fca could not be found. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:37:05.506874 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-099033a1-6b98-441c-98e9-c5abbdbb37c3 tempest-TenantUsagesTestJSON-48080970 tempest-TenantUsagesTestJSON-48080970-project] 10.222.0.43 "GET /compute/v2.1/servers/1f956517-1701-4171-9227-03726c7e8fca" status: 404 len: 111 microversion: 2.1 time: 0.136804 Oct 04 18:37:05.510361 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 718/1561] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:05 2022] GET /compute/v2.1/servers/1f956517-1701-4171-9227-03726c7e8fca => generated 111 bytes in 141 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:37:05.533608 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-e5dc173e-3438-4384-ab47-d119549d5747 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:05.534236 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-e5dc173e-3438-4384-ab47-d119549d5747 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: ce0d629a-068c-4a62-8a03-fc43fc0be9b3] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:05.555244 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e5dc173e-3438-4384-ab47-d119549d5747 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:05.557766 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e5dc173e-3438-4384-ab47-d119549d5747 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:05.558579 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e5dc173e-3438-4384-ab47-d119549d5747 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:05.559516 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e5dc173e-3438-4384-ab47-d119549d5747 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:05.560661 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e5dc173e-3438-4384-ab47-d119549d5747 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:05.567716 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e5dc173e-3438-4384-ab47-d119549d5747 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:05.946847 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-2d0a87b6-db59-4491-8c83-5ef2d06b7b70 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a41ab6fb78a42ceaca621c5a38ffc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa31ed92017490a82497c7b8910aef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:05.968468 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-2d0a87b6-db59-4491-8c83-5ef2d06b7b70 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] 10.222.0.43 "GET /compute/v2.1/servers/64228016-ae20-4fcb-87da-c3d4d585e241" status: 200 len: 1308 microversion: 2.1 time: 1.018419 Oct 04 18:37:05.969471 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 844/1562] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:04 2022] GET /compute/v2.1/servers/64228016-ae20-4fcb-87da-c3d4d585e241 => generated 1308 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:05.987879 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-b4d7bec0-2463-41e7-b234-d8656320e740 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:05.989561 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-b4d7bec0-2463-41e7-b234-d8656320e740 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] [instance: 86743a21-e24e-4001-b3da-48615f6e281e] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:06.039391 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=4 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:37:06.042878 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b4d7bec0-2463-41e7-b234-d8656320e740 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:06.043538 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b4d7bec0-2463-41e7-b234-d8656320e740 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:06.043996 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b4d7bec0-2463-41e7-b234-d8656320e740 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:06.057025 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b4d7bec0-2463-41e7-b234-d8656320e740 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:06.057664 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b4d7bec0-2463-41e7-b234-d8656320e740 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:06.058122 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b4d7bec0-2463-41e7-b234-d8656320e740 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:06.101357 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=6 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:37:06.352092 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-b4d7bec0-2463-41e7-b234-d8656320e740 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa193aff0474ae3ba5d1aa7b0d0e8c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a06b8feba3404490a448aa2d4fb106b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:06.379009 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-b4d7bec0-2463-41e7-b234-d8656320e740 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] 10.222.0.43 "GET /compute/v2.1/servers/86743a21-e24e-4001-b3da-48615f6e281e" status: 200 len: 1280 microversion: 2.1 time: 0.401237 Oct 04 18:37:06.380321 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 845/1563] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:05 2022] GET /compute/v2.1/servers/86743a21-e24e-4001-b3da-48615f6e281e => generated 1280 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:06.411666 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-62792a28-1938-45e4-961a-bbeabf1b8a0c tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:06.412299 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-62792a28-1938-45e4-961a-bbeabf1b8a0c tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] [instance: 7222a4ce-d2a2-4b09-afc6-55bca52414d4] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:06.439171 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-62792a28-1938-45e4-961a-bbeabf1b8a0c tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:06.439682 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-62792a28-1938-45e4-961a-bbeabf1b8a0c tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:06.440127 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-62792a28-1938-45e4-961a-bbeabf1b8a0c tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:06.450113 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-62792a28-1938-45e4-961a-bbeabf1b8a0c tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:06.457187 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-62792a28-1938-45e4-961a-bbeabf1b8a0c tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:06.458175 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-62792a28-1938-45e4-961a-bbeabf1b8a0c tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:06.884024 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-62792a28-1938-45e4-961a-bbeabf1b8a0c tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:06.894377 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-62792a28-1938-45e4-961a-bbeabf1b8a0c tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:06.895845 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-62792a28-1938-45e4-961a-bbeabf1b8a0c tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:06.897175 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-62792a28-1938-45e4-961a-bbeabf1b8a0c tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] 10.222.0.43 "GET /compute/v2.1/servers/7222a4ce-d2a2-4b09-afc6-55bca52414d4" status: 200 len: 1815 microversion: 2.25 time: 0.512460 Oct 04 18:37:06.901377 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 846/1564] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:37:06 2022] GET /compute/v2.1/servers/7222a4ce-d2a2-4b09-afc6-55bca52414d4 => generated 1815 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:37:06.920343 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-225515e6-e47c-413b-a524-1cbd7eb0e373 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Calling method '.version_select at 0x7fb227f5b5e0>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:06.994593 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-225515e6-e47c-413b-a524-1cbd7eb0e373 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] 10.222.0.43 "GET /compute/v2.1/images/3adaa529-06f7-4c7d-8ad1-d56ec671ea9a" status: 200 len: 1424 microversion: 2.1 time: 0.091330 Oct 04 18:37:06.996268 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 847/1565] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 18:37:06 2022] GET /compute/v2.1/images/3adaa529-06f7-4c7d-8ad1-d56ec671ea9a => generated 1424 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:07.018519 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-53f857fa-adf8-4604-b205-01c41dc4c50e tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:07.019149 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-53f857fa-adf8-4604-b205-01c41dc4c50e tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] [instance: 64228016-ae20-4fcb-87da-c3d4d585e241] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:07.028073 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-53f857fa-adf8-4604-b205-01c41dc4c50e tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:07.028577 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-53f857fa-adf8-4604-b205-01c41dc4c50e tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:07.029021 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-53f857fa-adf8-4604-b205-01c41dc4c50e tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:07.030987 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-53f857fa-adf8-4604-b205-01c41dc4c50e tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:07.031969 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-53f857fa-adf8-4604-b205-01c41dc4c50e tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:07.032427 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-53f857fa-adf8-4604-b205-01c41dc4c50e tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:07.234096 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-53f857fa-adf8-4604-b205-01c41dc4c50e tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a41ab6fb78a42ceaca621c5a38ffc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa31ed92017490a82497c7b8910aef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:07.248831 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-53f857fa-adf8-4604-b205-01c41dc4c50e tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] 10.222.0.43 "GET /compute/v2.1/servers/64228016-ae20-4fcb-87da-c3d4d585e241" status: 200 len: 1308 microversion: 2.1 time: 0.250253 Oct 04 18:37:07.250161 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 848/1566] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:06 2022] GET /compute/v2.1/servers/64228016-ae20-4fcb-87da-c3d4d585e241 => generated 1308 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:07.425684 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-c27d0e76-cbdf-47ef-931a-666e1596ce66 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:07.426717 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-c27d0e76-cbdf-47ef-931a-666e1596ce66 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] [instance: 86743a21-e24e-4001-b3da-48615f6e281e] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:07.437923 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c27d0e76-cbdf-47ef-931a-666e1596ce66 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:07.438436 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c27d0e76-cbdf-47ef-931a-666e1596ce66 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:07.438887 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c27d0e76-cbdf-47ef-931a-666e1596ce66 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:07.439649 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c27d0e76-cbdf-47ef-931a-666e1596ce66 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:07.440108 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c27d0e76-cbdf-47ef-931a-666e1596ce66 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:07.440541 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c27d0e76-cbdf-47ef-931a-666e1596ce66 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:07.516359 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-e5dc173e-3438-4384-ab47-d119549d5747 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:07.531017 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-e5dc173e-3438-4384-ab47-d119549d5747 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/ce0d629a-068c-4a62-8a03-fc43fc0be9b3" status: 200 len: 1471 microversion: 2.1 time: 2.017469 Oct 04 18:37:07.533623 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 719/1567] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:05 2022] GET /compute/v2.1/servers/ce0d629a-068c-4a62-8a03-fc43fc0be9b3 => generated 1471 bytes in 2021 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:07.559281 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-c27d0e76-cbdf-47ef-931a-666e1596ce66 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa193aff0474ae3ba5d1aa7b0d0e8c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a06b8feba3404490a448aa2d4fb106b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:07.577805 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-c27d0e76-cbdf-47ef-931a-666e1596ce66 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] 10.222.0.43 "GET /compute/v2.1/servers/86743a21-e24e-4001-b3da-48615f6e281e" status: 200 len: 1280 microversion: 2.1 time: 0.157485 Oct 04 18:37:07.593132 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 849/1568] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:07 2022] GET /compute/v2.1/servers/86743a21-e24e-4001-b3da-48615f6e281e => generated 1280 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:07.614679 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-70fc1ef5-827d-476b-9572-da37444fbaec req-e4d52b29-bc81-467e-816f-136adf1023f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce0d629a-068c-4a62-8a03-fc43fc0be9b3", "name": "network-vif-plugged", "status": "completed", "tag": "5b0b787d-0181-4910-a488-5e61d24675ce"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:37:07.634789 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-70fc1ef5-827d-476b-9572-da37444fbaec req-e4d52b29-bc81-467e-816f-136adf1023f4 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:07.636311 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-70fc1ef5-827d-476b-9572-da37444fbaec req-e4d52b29-bc81-467e-816f-136adf1023f4 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:07.637062 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-70fc1ef5-827d-476b-9572-da37444fbaec req-e4d52b29-bc81-467e-816f-136adf1023f4 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:07.656348 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-70fc1ef5-827d-476b-9572-da37444fbaec req-e4d52b29-bc81-467e-816f-136adf1023f4 service nova] Creating event network-vif-plugged:5b0b787d-0181-4910-a488-5e61d24675ce for instance ce0d629a-068c-4a62-8a03-fc43fc0be9b3 on n-h1-851028-13 Oct 04 18:37:07.667025 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [req-70fc1ef5-827d-476b-9572-da37444fbaec req-e4d52b29-bc81-467e-816f-136adf1023f4 service nova] Instance ce0d629a-068c-4a62-8a03-fc43fc0be9b3 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851028-13', 'n-h2-851028-13'} {{(pid=123595) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 18:37:07.696492 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-70fc1ef5-827d-476b-9572-da37444fbaec req-e4d52b29-bc81-467e-816f-136adf1023f4 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086414 Oct 04 18:37:07.700342 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 720/1569] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:37:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:37:07.928687 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-0956b9dd-722b-4286-8e49-54273fa3020d tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:07.930255 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-0956b9dd-722b-4286-8e49-54273fa3020d tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] [instance: 7222a4ce-d2a2-4b09-afc6-55bca52414d4] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:07.937501 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=8 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:37:07.965030 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0956b9dd-722b-4286-8e49-54273fa3020d tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:07.983891 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0956b9dd-722b-4286-8e49-54273fa3020d tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:07.984519 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0956b9dd-722b-4286-8e49-54273fa3020d tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:07.986875 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0956b9dd-722b-4286-8e49-54273fa3020d tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:07.991294 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0956b9dd-722b-4286-8e49-54273fa3020d tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:07.992361 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0956b9dd-722b-4286-8e49-54273fa3020d tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:08.016254 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-fc221060-61d5-4926-8eb2-9559dbc39783 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Calling method '.version_select at 0x7fb21f7f89d0>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:08.154917 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-fc221060-61d5-4926-8eb2-9559dbc39783 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] 10.222.0.43 "GET /compute/v2.1/images/3adaa529-06f7-4c7d-8ad1-d56ec671ea9a" status: 200 len: 1424 microversion: 2.1 time: 0.146807 Oct 04 18:37:08.155521 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 721/1570] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 18:37:08 2022] GET /compute/v2.1/images/3adaa529-06f7-4c7d-8ad1-d56ec671ea9a => generated 1424 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:08.276481 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-8571fbcc-2ead-4f28-a359-ee27e9f98397 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:08.277519 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-8571fbcc-2ead-4f28-a359-ee27e9f98397 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] [instance: 64228016-ae20-4fcb-87da-c3d4d585e241] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:08.294681 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8571fbcc-2ead-4f28-a359-ee27e9f98397 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:08.295487 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8571fbcc-2ead-4f28-a359-ee27e9f98397 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:08.296093 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8571fbcc-2ead-4f28-a359-ee27e9f98397 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:08.296988 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8571fbcc-2ead-4f28-a359-ee27e9f98397 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:08.297634 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8571fbcc-2ead-4f28-a359-ee27e9f98397 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:08.298588 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8571fbcc-2ead-4f28-a359-ee27e9f98397 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:08.394303 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-0956b9dd-722b-4286-8e49-54273fa3020d tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:08.406105 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-0956b9dd-722b-4286-8e49-54273fa3020d tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:08.415575 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-0956b9dd-722b-4286-8e49-54273fa3020d tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:08.419521 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-0956b9dd-722b-4286-8e49-54273fa3020d tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] 10.222.0.43 "GET /compute/v2.1/servers/7222a4ce-d2a2-4b09-afc6-55bca52414d4" status: 200 len: 1815 microversion: 2.25 time: 0.496160 Oct 04 18:37:08.422482 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 850/1571] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:37:07 2022] GET /compute/v2.1/servers/7222a4ce-d2a2-4b09-afc6-55bca52414d4 => generated 1815 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:37:08.555660 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-51eced7a-694a-46bc-96e7-ec3c8c8cc5dd tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:08.556217 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-51eced7a-694a-46bc-96e7-ec3c8c8cc5dd tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: ce0d629a-068c-4a62-8a03-fc43fc0be9b3] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:08.572635 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-51eced7a-694a-46bc-96e7-ec3c8c8cc5dd tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:08.578721 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-51eced7a-694a-46bc-96e7-ec3c8c8cc5dd tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:08.580442 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-51eced7a-694a-46bc-96e7-ec3c8c8cc5dd tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:08.582964 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-51eced7a-694a-46bc-96e7-ec3c8c8cc5dd tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:08.583738 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-51eced7a-694a-46bc-96e7-ec3c8c8cc5dd tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:08.585880 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-51eced7a-694a-46bc-96e7-ec3c8c8cc5dd tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:09.034951 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-51eced7a-694a-46bc-96e7-ec3c8c8cc5dd tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:09.038769 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-8571fbcc-2ead-4f28-a359-ee27e9f98397 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a41ab6fb78a42ceaca621c5a38ffc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa31ed92017490a82497c7b8910aef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:09.052868 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-51eced7a-694a-46bc-96e7-ec3c8c8cc5dd tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/ce0d629a-068c-4a62-8a03-fc43fc0be9b3" status: 200 len: 1471 microversion: 2.1 time: 0.502275 Oct 04 18:37:09.053781 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 851/1572] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:08 2022] GET /compute/v2.1/servers/ce0d629a-068c-4a62-8a03-fc43fc0be9b3 => generated 1471 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:37:09.062559 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-8571fbcc-2ead-4f28-a359-ee27e9f98397 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] 10.222.0.43 "GET /compute/v2.1/servers/64228016-ae20-4fcb-87da-c3d4d585e241" status: 200 len: 1308 microversion: 2.1 time: 0.790561 Oct 04 18:37:09.063171 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 722/1573] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:08 2022] GET /compute/v2.1/servers/64228016-ae20-4fcb-87da-c3d4d585e241 => generated 1308 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:37:09.069356 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-366c99f1-50a2-46d9-9755-b969cab82d73 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:09.069989 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-366c99f1-50a2-46d9-9755-b969cab82d73 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] [instance: 86743a21-e24e-4001-b3da-48615f6e281e] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:09.086389 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-366c99f1-50a2-46d9-9755-b969cab82d73 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:09.086902 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-366c99f1-50a2-46d9-9755-b969cab82d73 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:09.087355 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-366c99f1-50a2-46d9-9755-b969cab82d73 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:09.088770 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-366c99f1-50a2-46d9-9755-b969cab82d73 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:09.094634 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-366c99f1-50a2-46d9-9755-b969cab82d73 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:09.096780 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-366c99f1-50a2-46d9-9755-b969cab82d73 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:09.170916 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-f8b7ad4d-d7c0-4c9b-93f9-78f4ea9b72ce tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Calling method '.version_select at 0x7fb21fa3a820>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:09.239481 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-366c99f1-50a2-46d9-9755-b969cab82d73 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa193aff0474ae3ba5d1aa7b0d0e8c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a06b8feba3404490a448aa2d4fb106b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:09.256696 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-366c99f1-50a2-46d9-9755-b969cab82d73 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] 10.222.0.43 "GET /compute/v2.1/servers/86743a21-e24e-4001-b3da-48615f6e281e" status: 200 len: 1280 microversion: 2.1 time: 0.201246 Oct 04 18:37:09.257645 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 852/1574] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:09 2022] GET /compute/v2.1/servers/86743a21-e24e-4001-b3da-48615f6e281e => generated 1280 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:09.294023 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-f8b7ad4d-d7c0-4c9b-93f9-78f4ea9b72ce tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] 10.222.0.43 "GET /compute/v2.1/images/3adaa529-06f7-4c7d-8ad1-d56ec671ea9a" status: 200 len: 1424 microversion: 2.1 time: 0.126865 Oct 04 18:37:09.302574 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 723/1575] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 18:37:09 2022] GET /compute/v2.1/images/3adaa529-06f7-4c7d-8ad1-d56ec671ea9a => generated 1424 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:09.453956 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-201d580d-9ae9-45c5-94d6-069f50b4af79 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:09.455247 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-201d580d-9ae9-45c5-94d6-069f50b4af79 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] [instance: 7222a4ce-d2a2-4b09-afc6-55bca52414d4] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:09.463626 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-201d580d-9ae9-45c5-94d6-069f50b4af79 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:09.464713 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-201d580d-9ae9-45c5-94d6-069f50b4af79 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:09.466037 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-201d580d-9ae9-45c5-94d6-069f50b4af79 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:09.466994 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-201d580d-9ae9-45c5-94d6-069f50b4af79 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:09.467678 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-201d580d-9ae9-45c5-94d6-069f50b4af79 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:09.468328 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-201d580d-9ae9-45c5-94d6-069f50b4af79 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:09.899102 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-201d580d-9ae9-45c5-94d6-069f50b4af79 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:09.910527 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-201d580d-9ae9-45c5-94d6-069f50b4af79 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:09.915449 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-201d580d-9ae9-45c5-94d6-069f50b4af79 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:09.921811 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-201d580d-9ae9-45c5-94d6-069f50b4af79 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] 10.222.0.43 "GET /compute/v2.1/servers/7222a4ce-d2a2-4b09-afc6-55bca52414d4" status: 200 len: 1815 microversion: 2.25 time: 0.468042 Oct 04 18:37:09.923005 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 853/1576] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:37:09 2022] GET /compute/v2.1/servers/7222a4ce-d2a2-4b09-afc6-55bca52414d4 => generated 1815 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:37:10.090140 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-912bacef-af3c-4263-9a92-213299eb5094 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:10.091417 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-0b6581d2-4f57-4b42-a2e1-851a676ee89a tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:10.093649 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-0b6581d2-4f57-4b42-a2e1-851a676ee89a tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] [instance: 64228016-ae20-4fcb-87da-c3d4d585e241] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:10.094870 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-912bacef-af3c-4263-9a92-213299eb5094 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: ce0d629a-068c-4a62-8a03-fc43fc0be9b3] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:10.117056 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0b6581d2-4f57-4b42-a2e1-851a676ee89a tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:10.120768 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0b6581d2-4f57-4b42-a2e1-851a676ee89a tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:10.121285 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-912bacef-af3c-4263-9a92-213299eb5094 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:10.124412 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-912bacef-af3c-4263-9a92-213299eb5094 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:10.125317 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0b6581d2-4f57-4b42-a2e1-851a676ee89a tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:10.126252 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0b6581d2-4f57-4b42-a2e1-851a676ee89a tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:10.126908 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-912bacef-af3c-4263-9a92-213299eb5094 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:10.129285 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0b6581d2-4f57-4b42-a2e1-851a676ee89a tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:10.131249 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-912bacef-af3c-4263-9a92-213299eb5094 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:10.131924 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0b6581d2-4f57-4b42-a2e1-851a676ee89a tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:10.134361 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-912bacef-af3c-4263-9a92-213299eb5094 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:10.137700 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-912bacef-af3c-4263-9a92-213299eb5094 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:10.497786 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-0b6581d2-4f57-4b42-a2e1-851a676ee89a tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a41ab6fb78a42ceaca621c5a38ffc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa31ed92017490a82497c7b8910aef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:10.519296 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-0b6581d2-4f57-4b42-a2e1-851a676ee89a tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] 10.222.0.43 "GET /compute/v2.1/servers/64228016-ae20-4fcb-87da-c3d4d585e241" status: 200 len: 1308 microversion: 2.1 time: 0.434595 Oct 04 18:37:10.519920 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 854/1577] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:10 2022] GET /compute/v2.1/servers/64228016-ae20-4fcb-87da-c3d4d585e241 => generated 1308 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:37:10.542153 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-8445bc46-9203-447d-8b55-e14192242842 req-c84d2ff4-4c23-48e1-b5cd-a8412b3e353f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "744f6597-f965-405c-ad7b-66a8a0f1397b", "tag": "e8aa70a4-f808-4675-a8cb-ceaa0108ff63"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:37:10.579405 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-8445bc46-9203-447d-8b55-e14192242842 req-c84d2ff4-4c23-48e1-b5cd-a8412b3e353f service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:10.581421 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-8445bc46-9203-447d-8b55-e14192242842 req-c84d2ff4-4c23-48e1-b5cd-a8412b3e353f service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:10.582442 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-8445bc46-9203-447d-8b55-e14192242842 req-c84d2ff4-4c23-48e1-b5cd-a8412b3e353f service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:10.598061 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-8445bc46-9203-447d-8b55-e14192242842 req-c84d2ff4-4c23-48e1-b5cd-a8412b3e353f service nova] Creating event network-changed:e8aa70a4-f808-4675-a8cb-ceaa0108ff63 for instance 744f6597-f965-405c-ad7b-66a8a0f1397b on n-h2-851028-13 Oct 04 18:37:10.604635 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-8445bc46-9203-447d-8b55-e14192242842 req-c84d2ff4-4c23-48e1-b5cd-a8412b3e353f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077590 Oct 04 18:37:10.608450 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 855/1578] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:37:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:37:10.619636 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-7dbdfd58-a3d8-4982-8de9-921891aebb7d tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:10.620880 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-7dbdfd58-a3d8-4982-8de9-921891aebb7d tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] [instance: 86743a21-e24e-4001-b3da-48615f6e281e] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:10.629586 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7dbdfd58-a3d8-4982-8de9-921891aebb7d tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:10.630679 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7dbdfd58-a3d8-4982-8de9-921891aebb7d tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:10.631843 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7dbdfd58-a3d8-4982-8de9-921891aebb7d tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:10.632850 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7dbdfd58-a3d8-4982-8de9-921891aebb7d tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:10.633667 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7dbdfd58-a3d8-4982-8de9-921891aebb7d tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:10.634728 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7dbdfd58-a3d8-4982-8de9-921891aebb7d tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:10.773996 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-7dbdfd58-a3d8-4982-8de9-921891aebb7d tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa193aff0474ae3ba5d1aa7b0d0e8c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a06b8feba3404490a448aa2d4fb106b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:10.778686 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=100 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:37:10.787813 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-7dbdfd58-a3d8-4982-8de9-921891aebb7d tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] 10.222.0.43 "GET /compute/v2.1/servers/86743a21-e24e-4001-b3da-48615f6e281e" status: 200 len: 1280 microversion: 2.1 time: 0.177613 Oct 04 18:37:10.794231 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 856/1579] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:10 2022] GET /compute/v2.1/servers/86743a21-e24e-4001-b3da-48615f6e281e => generated 1280 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:10.824240 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-382bacb0-23bd-4b19-8b96-a2d720440cea tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Calling method '.version_select at 0x7fb224680940>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:10.930326 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-382bacb0-23bd-4b19-8b96-a2d720440cea tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] 10.222.0.43 "GET /compute/v2.1/images/3adaa529-06f7-4c7d-8ad1-d56ec671ea9a" status: 200 len: 1424 microversion: 2.1 time: 0.137634 Oct 04 18:37:10.931578 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 857/1580] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 18:37:10 2022] GET /compute/v2.1/images/3adaa529-06f7-4c7d-8ad1-d56ec671ea9a => generated 1424 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:10.948004 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-3b2cab7b-9c93-4100-8c0b-d9f133207d18 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:10.948954 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-3b2cab7b-9c93-4100-8c0b-d9f133207d18 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] [instance: 7222a4ce-d2a2-4b09-afc6-55bca52414d4] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:10.957097 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3b2cab7b-9c93-4100-8c0b-d9f133207d18 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:10.957916 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3b2cab7b-9c93-4100-8c0b-d9f133207d18 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:10.958597 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3b2cab7b-9c93-4100-8c0b-d9f133207d18 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:10.960203 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3b2cab7b-9c93-4100-8c0b-d9f133207d18 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:10.960880 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3b2cab7b-9c93-4100-8c0b-d9f133207d18 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:10.961579 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3b2cab7b-9c93-4100-8c0b-d9f133207d18 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:11.296048 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-3b2cab7b-9c93-4100-8c0b-d9f133207d18 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:11.313059 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-3b2cab7b-9c93-4100-8c0b-d9f133207d18 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:11.321522 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-3b2cab7b-9c93-4100-8c0b-d9f133207d18 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:11.324665 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-3b2cab7b-9c93-4100-8c0b-d9f133207d18 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] 10.222.0.43 "GET /compute/v2.1/servers/7222a4ce-d2a2-4b09-afc6-55bca52414d4" status: 200 len: 1815 microversion: 2.25 time: 0.380503 Oct 04 18:37:11.343638 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 858/1581] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:37:10 2022] GET /compute/v2.1/servers/7222a4ce-d2a2-4b09-afc6-55bca52414d4 => generated 1815 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:37:11.543328 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-4077d4d0-52af-4472-a667-ea23fb42130a tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:11.544035 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-4077d4d0-52af-4472-a667-ea23fb42130a tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] [instance: 64228016-ae20-4fcb-87da-c3d4d585e241] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:11.554534 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4077d4d0-52af-4472-a667-ea23fb42130a tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:11.555024 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4077d4d0-52af-4472-a667-ea23fb42130a tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:11.555468 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4077d4d0-52af-4472-a667-ea23fb42130a tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:11.556183 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4077d4d0-52af-4472-a667-ea23fb42130a tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:11.556632 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4077d4d0-52af-4472-a667-ea23fb42130a tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:11.562871 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4077d4d0-52af-4472-a667-ea23fb42130a tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:11.699596 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-912bacef-af3c-4263-9a92-213299eb5094 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:11.724185 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-912bacef-af3c-4263-9a92-213299eb5094 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/ce0d629a-068c-4a62-8a03-fc43fc0be9b3" status: 200 len: 1471 microversion: 2.1 time: 1.652242 Oct 04 18:37:11.745932 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 724/1582] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:10 2022] GET /compute/v2.1/servers/ce0d629a-068c-4a62-8a03-fc43fc0be9b3 => generated 1471 bytes in 1674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:11.824149 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-5451bfb5-7736-485b-b346-ab8bd6960fc0 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:11.824781 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-5451bfb5-7736-485b-b346-ab8bd6960fc0 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] [instance: 86743a21-e24e-4001-b3da-48615f6e281e] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:11.843063 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5451bfb5-7736-485b-b346-ab8bd6960fc0 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:11.843578 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5451bfb5-7736-485b-b346-ab8bd6960fc0 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:11.844031 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5451bfb5-7736-485b-b346-ab8bd6960fc0 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:11.850989 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5451bfb5-7736-485b-b346-ab8bd6960fc0 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:11.851714 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5451bfb5-7736-485b-b346-ab8bd6960fc0 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:11.852327 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5451bfb5-7736-485b-b346-ab8bd6960fc0 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:11.853313 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-4077d4d0-52af-4472-a667-ea23fb42130a tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a41ab6fb78a42ceaca621c5a38ffc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa31ed92017490a82497c7b8910aef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:11.862973 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-4077d4d0-52af-4472-a667-ea23fb42130a tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] 10.222.0.43 "GET /compute/v2.1/servers/64228016-ae20-4fcb-87da-c3d4d585e241" status: 200 len: 1308 microversion: 2.1 time: 0.321965 Oct 04 18:37:11.864307 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 859/1583] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:11 2022] GET /compute/v2.1/servers/64228016-ae20-4fcb-87da-c3d4d585e241 => generated 1308 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:11.950042 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-5274e87a-5466-4e24-bd16-3ee19ce95582 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Calling method '.version_select at 0x7fb21fd11040>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:12.073615 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-5274e87a-5466-4e24-bd16-3ee19ce95582 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] 10.222.0.43 "GET /compute/v2.1/images/3adaa529-06f7-4c7d-8ad1-d56ec671ea9a" status: 200 len: 1424 microversion: 2.1 time: 0.128356 Oct 04 18:37:12.074592 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 860/1584] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 18:37:11 2022] GET /compute/v2.1/images/3adaa529-06f7-4c7d-8ad1-d56ec671ea9a => generated 1424 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:37:12.354540 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-4c42d150-7982-4ce7-ab7c-cee0a19cae3b tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:12.355139 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-4c42d150-7982-4ce7-ab7c-cee0a19cae3b tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] [instance: 7222a4ce-d2a2-4b09-afc6-55bca52414d4] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:12.369366 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4c42d150-7982-4ce7-ab7c-cee0a19cae3b tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:12.369882 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4c42d150-7982-4ce7-ab7c-cee0a19cae3b tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:12.370558 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4c42d150-7982-4ce7-ab7c-cee0a19cae3b tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:12.371037 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4c42d150-7982-4ce7-ab7c-cee0a19cae3b tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:12.371495 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4c42d150-7982-4ce7-ab7c-cee0a19cae3b tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:12.371923 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4c42d150-7982-4ce7-ab7c-cee0a19cae3b tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:12.840726 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-4c42d150-7982-4ce7-ab7c-cee0a19cae3b tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:12.858182 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-4c42d150-7982-4ce7-ab7c-cee0a19cae3b tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:12.860051 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-4c42d150-7982-4ce7-ab7c-cee0a19cae3b tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:12.862606 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-4c42d150-7982-4ce7-ab7c-cee0a19cae3b tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] 10.222.0.43 "GET /compute/v2.1/servers/7222a4ce-d2a2-4b09-afc6-55bca52414d4" status: 200 len: 1815 microversion: 2.25 time: 0.513584 Oct 04 18:37:12.866674 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 861/1585] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:37:12 2022] GET /compute/v2.1/servers/7222a4ce-d2a2-4b09-afc6-55bca52414d4 => generated 1815 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:37:12.880116 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-2649174b-8ccf-411e-8643-a546f26fdc4e tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:12.882917 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-2649174b-8ccf-411e-8643-a546f26fdc4e tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: ce0d629a-068c-4a62-8a03-fc43fc0be9b3] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:12.898879 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2649174b-8ccf-411e-8643-a546f26fdc4e tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:12.899748 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2649174b-8ccf-411e-8643-a546f26fdc4e tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:12.902515 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2649174b-8ccf-411e-8643-a546f26fdc4e tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:12.903581 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2649174b-8ccf-411e-8643-a546f26fdc4e tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:12.904988 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2649174b-8ccf-411e-8643-a546f26fdc4e tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:12.907939 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2649174b-8ccf-411e-8643-a546f26fdc4e tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:13.223963 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-2649174b-8ccf-411e-8643-a546f26fdc4e tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:13.235552 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-2649174b-8ccf-411e-8643-a546f26fdc4e tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/ce0d629a-068c-4a62-8a03-fc43fc0be9b3" status: 200 len: 1471 microversion: 2.1 time: 0.367455 Oct 04 18:37:13.253138 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 862/1586] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:12 2022] GET /compute/v2.1/servers/ce0d629a-068c-4a62-8a03-fc43fc0be9b3 => generated 1471 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:13.546714 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-e3ae08a2-2254-4784-92ec-7d764a0fca1d tempest-TenantUsagesNegativeTestJSON-884674647 tempest-TenantUsagesNegativeTestJSON-884674647-project-admin] 10.222.0.43 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-10-03T18%3A37%3A12.829418&end=2022-10-05T18%3A37%3A12.829418" status: 404 len: 112 microversion: - time: 0.302422 Oct 04 18:37:13.547353 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 863/1587] 10.222.0.43 () {58 vars in 1316 bytes} [Tue Oct 4 18:37:13 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-10-03T18%3A37%3A12.829418&end=2022-10-05T18%3A37%3A12.829418 => generated 112 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 04 18:37:13.572213 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-d1e2c797-b3c9-4994-ada9-7a149d7ed2d8 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:13.572952 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-d1e2c797-b3c9-4994-ada9-7a149d7ed2d8 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] [instance: 64228016-ae20-4fcb-87da-c3d4d585e241] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:13.606278 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d1e2c797-b3c9-4994-ada9-7a149d7ed2d8 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:13.606720 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d1e2c797-b3c9-4994-ada9-7a149d7ed2d8 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:13.607172 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d1e2c797-b3c9-4994-ada9-7a149d7ed2d8 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:13.607898 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d1e2c797-b3c9-4994-ada9-7a149d7ed2d8 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:13.608471 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d1e2c797-b3c9-4994-ada9-7a149d7ed2d8 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:13.608769 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d1e2c797-b3c9-4994-ada9-7a149d7ed2d8 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:13.714636 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-5451bfb5-7736-485b-b346-ab8bd6960fc0 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa193aff0474ae3ba5d1aa7b0d0e8c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a06b8feba3404490a448aa2d4fb106b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:13.723246 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-5451bfb5-7736-485b-b346-ab8bd6960fc0 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] 10.222.0.43 "GET /compute/v2.1/servers/86743a21-e24e-4001-b3da-48615f6e281e" status: 200 len: 1322 microversion: 2.1 time: 1.906987 Oct 04 18:37:13.737755 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 725/1588] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:11 2022] GET /compute/v2.1/servers/86743a21-e24e-4001-b3da-48615f6e281e => generated 1322 bytes in 1922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:13.745256 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-3e1ea215-cb7d-498f-bb2b-685d3cc652c1 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Calling method '.version_select at 0x7fb21fa1c9d0>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:13.798545 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-3e1ea215-cb7d-498f-bb2b-685d3cc652c1 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] 10.222.0.43 "GET /compute/v2.1/images/3adaa529-06f7-4c7d-8ad1-d56ec671ea9a" status: 200 len: 1433 microversion: 2.1 time: 0.059289 Oct 04 18:37:13.799734 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 726/1589] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 18:37:13 2022] GET /compute/v2.1/images/3adaa529-06f7-4c7d-8ad1-d56ec671ea9a => generated 1433 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:13.805766 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-7dacfec2-67fe-497f-86e1-e017883ead08 tempest-TenantUsagesNegativeTestJSON-884674647 tempest-TenantUsagesNegativeTestJSON-884674647-project-admin] Calling method '.version_select at 0x7fb21fb48c10>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:13.810844 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-7dacfec2-67fe-497f-86e1-e017883ead08 tempest-TenantUsagesNegativeTestJSON-884674647 tempest-TenantUsagesNegativeTestJSON-884674647-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Oct 04 18:37:13.820077 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-7dacfec2-67fe-497f-86e1-e017883ead08 tempest-TenantUsagesNegativeTestJSON-884674647 tempest-TenantUsagesNegativeTestJSON-884674647-project-admin] Request method failure captured: Oct 04 18:37:13.820077 n-d-851028-13 devstack@n-api.service[123595]: request: GET /compute/v2.1/os-simple-tenant-usage/068f194206f8473db6016fb474563068?start=2022-10-05T18%3A37%3A12.829418&end=2022-10-03T18%3A37%3A12.829418 HTTP/1.1 Oct 04 18:37:13.820077 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 18:37:13.820077 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 18:37:13.820077 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 18:37:13.820077 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 0 Oct 04 18:37:13.820077 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 18:37:13.820077 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 18:37:13.820077 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 18:37:13.820077 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 18:37:13.820077 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPH1YMf5fMBQgfr0i-30bazoYJJPdTn-ey1ZzqZ664XBmUqxE-inDpUzyw3WH-xe8KLCGBo5CRqReevrfpUW5myH431rE0jUTV0bKGahIAZC3CIn6RCNz3h7V4hMyG8sFRUp2UBs18VapgTq3X5SCqbolj-g5oLDRobbjvVGZNbGsukI Oct 04 18:37:13.820077 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 18:37:13.820077 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 18:37:13.820077 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 18:37:13.820077 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 18:37:13.820077 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 18:37:13.820077 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 18:37:13.820077 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: 7d08bd11ab0d45928b24b4d450d8d2fb Oct 04 18:37:13.820077 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-884674647 Oct 04 18:37:13.820077 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,admin,reader Oct 04 18:37:13.820077 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,admin,reader Oct 04 18:37:13.820077 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/7d08bd11ab0d45928b24b4d450d8d2fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_7d08bd11ab0d45928b24b4d450d8d2fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/7d08bd11ab0d45928b24b4d450d8d2fb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/7d08bd11ab0d45928b24b4d450d8d2fb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:37:13.820077 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-884674647 Oct 04 18:37:13.820077 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: 7d08bd11ab0d45928b24b4d450d8d2fb Oct 04 18:37:13.820077 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-884674647 Oct 04 18:37:13.820077 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-TenantUsagesNegativeTestJSON-884674647-project-admin Oct 04 18:37:13.820077 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 18:37:13.820077 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 18:37:13.820077 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: e2b80fb1445e491d817f9f9142ed621a Oct 04 18:37:13.820077 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-884674647-project-admin Oct 04 18:37:13.820077 n-d-851028-13 devstack@n-api.service[123595]: method: Oct 04 18:37:13.820077 n-d-851028-13 devstack@n-api.service[123595]: exception: Invalid start time. The start time cannot occur after the end time. Oct 04 18:37:13.820077 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': '068f194206f8473db6016fb474563068'} Oct 04 18:37:13.820077 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:37:13.820077 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:13.820077 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:37:13.820077 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:37:13.820077 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:37:13.820077 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:37:13.820077 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:37:13.820077 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:37:13.820077 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 18:37:13.820077 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:37:13.820077 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:37:13.820077 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:37:13.820077 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 292, in show Oct 04 18:37:13.820077 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 04 18:37:13.820077 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 338, in _show Oct 04 18:37:13.820077 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi (period_start, period_stop, ignore) = self._get_datetime_range( Oct 04 18:37:13.820077 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 259, in _get_datetime_range Oct 04 18:37:13.820077 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 04 18:37:13.820077 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid start time. The start time cannot occur after the end time. Oct 04 18:37:13.820077 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:37:13.820077 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:37:13.820077 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:37:13.820077 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:13.820077 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:37:13.820077 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:37:13.820077 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:37:13.820077 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:37:13.820077 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid start time. The start time cannot occur after the end time. Oct 04 18:37:13.820077 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:37:13.827808 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-7dacfec2-67fe-497f-86e1-e017883ead08 tempest-TenantUsagesNegativeTestJSON-884674647 tempest-TenantUsagesNegativeTestJSON-884674647-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:37:13.829410 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-7dacfec2-67fe-497f-86e1-e017883ead08 tempest-TenantUsagesNegativeTestJSON-884674647 tempest-TenantUsagesNegativeTestJSON-884674647-project-admin] 10.222.0.43 "GET /compute/v2.1/os-simple-tenant-usage/068f194206f8473db6016fb474563068?start=2022-10-05T18%3A37%3A12.829418&end=2022-10-03T18%3A37%3A12.829418" status: 400 len: 111 microversion: 2.1 time: 0.027647 Oct 04 18:37:13.830708 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 727/1590] 10.222.0.43 () {58 vars in 1412 bytes} [Tue Oct 4 18:37:13 2022] GET /compute/v2.1/os-simple-tenant-usage/068f194206f8473db6016fb474563068?start=2022-10-05T18%3A37%3A12.829418&end=2022-10-03T18%3A37%3A12.829418 => generated 111 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:37:13.838031 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-b88f53b3-9e90-475a-a7f2-00d75c11888c tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Calling method '.version_select at 0x7fb21f7b8670>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:13.904623 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-b88f53b3-9e90-475a-a7f2-00d75c11888c tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] 10.222.0.43 "GET /compute/v2.1/images/3adaa529-06f7-4c7d-8ad1-d56ec671ea9a" status: 200 len: 1433 microversion: 2.1 time: 0.072130 Oct 04 18:37:13.905487 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 728/1591] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 18:37:13 2022] GET /compute/v2.1/images/3adaa529-06f7-4c7d-8ad1-d56ec671ea9a => generated 1433 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:13.910561 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-df69faf7-a297-4577-87a1-6fb59d0c806e req-432009a2-8cb4-4e7e-bd39-845c3a3f894a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64228016-ae20-4fcb-87da-c3d4d585e241", "name": "network-vif-plugged", "status": "completed", "tag": "544eb6fd-0a18-483e-aad4-45ebdf392b69"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:37:13.922273 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-df69faf7-a297-4577-87a1-6fb59d0c806e req-432009a2-8cb4-4e7e-bd39-845c3a3f894a service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:13.923158 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-df69faf7-a297-4577-87a1-6fb59d0c806e req-432009a2-8cb4-4e7e-bd39-845c3a3f894a service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:13.923868 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-df69faf7-a297-4577-87a1-6fb59d0c806e req-432009a2-8cb4-4e7e-bd39-845c3a3f894a service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:13.939787 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-df69faf7-a297-4577-87a1-6fb59d0c806e req-432009a2-8cb4-4e7e-bd39-845c3a3f894a service nova] Creating event network-vif-plugged:544eb6fd-0a18-483e-aad4-45ebdf392b69 for instance 64228016-ae20-4fcb-87da-c3d4d585e241 on n-h1-851028-13 Oct 04 18:37:13.947149 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-df69faf7-a297-4577-87a1-6fb59d0c806e req-432009a2-8cb4-4e7e-bd39-845c3a3f894a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040243 Oct 04 18:37:13.948450 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 729/1592] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:37:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:37:14.185980 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-22ceda87-fbc5-4a05-b288-3ae3530604b2 tempest-TenantUsagesNegativeTestJSON-1890720125 tempest-TenantUsagesNegativeTestJSON-1890720125-project] Calling method '.version_select at 0x7fb21fae19d0>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:14.193919 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-22ceda87-fbc5-4a05-b288-3ae3530604b2 tempest-TenantUsagesNegativeTestJSON-1890720125 tempest-TenantUsagesNegativeTestJSON-1890720125-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': '862c0460833f4b0b9e990499c171dce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '068f194206f8473db6016fb474563068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:14.196700 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-22ceda87-fbc5-4a05-b288-3ae3530604b2 tempest-TenantUsagesNegativeTestJSON-1890720125 tempest-TenantUsagesNegativeTestJSON-1890720125-project] Request method failure captured: Oct 04 18:37:14.196700 n-d-851028-13 devstack@n-api.service[123595]: request: GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-03T18%3A37%3A12.829418&end=2022-10-05T18%3A37%3A12.829418&detailed=1 HTTP/1.1 Oct 04 18:37:14.196700 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 18:37:14.196700 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 18:37:14.196700 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 18:37:14.196700 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 0 Oct 04 18:37:14.196700 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 18:37:14.196700 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 18:37:14.196700 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 18:37:14.196700 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 18:37:14.196700 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPH1XjnGYtjhtb3QCtUTasIn-S95gAM82y-pjC0XpJMNU81LPyEQbikKT7h0pT4S6IhiwUcTvauFrz2J9C2PlK50ECNWB3zLJd77_tqPtibTWWWSohkzQ7F-0p6pDkKVS6TVUasGO49kuYGiqtyQEmDbC8lx7rpSpy7PJ_OJiK-ZRrp4 Oct 04 18:37:14.196700 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 18:37:14.196700 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 18:37:14.196700 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 18:37:14.196700 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 18:37:14.196700 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 18:37:14.196700 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 18:37:14.196700 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: 068f194206f8473db6016fb474563068 Oct 04 18:37:14.196700 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-1890720125 Oct 04 18:37:14.196700 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 18:37:14.196700 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 18:37:14.196700 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/068f194206f8473db6016fb474563068"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_068f194206f8473db6016fb474563068"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/068f194206f8473db6016fb474563068"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/068f194206f8473db6016fb474563068"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:37:14.196700 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-1890720125 Oct 04 18:37:14.196700 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: 068f194206f8473db6016fb474563068 Oct 04 18:37:14.196700 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-1890720125 Oct 04 18:37:14.196700 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-TenantUsagesNegativeTestJSON-1890720125-project Oct 04 18:37:14.196700 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 18:37:14.196700 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 18:37:14.196700 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: 862c0460833f4b0b9e990499c171dce2 Oct 04 18:37:14.196700 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-1890720125-project Oct 04 18:37:14.196700 n-d-851028-13 devstack@n-api.service[123595]: method: Oct 04 18:37:14.196700 n-d-851028-13 devstack@n-api.service[123595]: exception: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 04 18:37:14.196700 n-d-851028-13 devstack@n-api.service[123595]: action_args: {} Oct 04 18:37:14.196700 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:37:14.196700 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:14.196700 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:37:14.196700 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:37:14.196700 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:37:14.196700 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:37:14.196700 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:37:14.196700 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:37:14.196700 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 18:37:14.196700 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:37:14.196700 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:37:14.196700 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:37:14.196700 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 277, in index Oct 04 18:37:14.196700 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return self._index(req) Oct 04 18:37:14.196700 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 297, in _index Oct 04 18:37:14.196700 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi context.can(stu_policies.POLICY_ROOT % 'list') Oct 04 18:37:14.196700 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 18:37:14.196700 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 18:37:14.196700 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 18:37:14.196700 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 18:37:14.196700 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:37:14.196700 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:37:14.196700 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:37:14.196700 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:37:14.196700 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 18:37:14.196700 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 18:37:14.196700 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 18:37:14.196700 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 18:37:14.196700 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 18:37:14.201162 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 18:37:14.201162 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 04 18:37:14.201162 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:37:14.201162 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:37:14.201162 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:37:14.201162 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:14.201162 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:37:14.201162 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:37:14.201162 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 18:37:14.201162 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 18:37:14.201162 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 04 18:37:14.201162 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:37:14.207498 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-22ceda87-fbc5-4a05-b288-3ae3530604b2 tempest-TenantUsagesNegativeTestJSON-1890720125 tempest-TenantUsagesNegativeTestJSON-1890720125-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:37:14.208536 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-22ceda87-fbc5-4a05-b288-3ae3530604b2 tempest-TenantUsagesNegativeTestJSON-1890720125 tempest-TenantUsagesNegativeTestJSON-1890720125-project] 10.222.0.43 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-03T18%3A37%3A12.829418&end=2022-10-05T18%3A37%3A12.829418&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.258492 Oct 04 18:37:14.209353 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 730/1593] 10.222.0.43 () {58 vars in 1335 bytes} [Tue Oct 4 18:37:13 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-03T18%3A37%3A12.829418&end=2022-10-05T18%3A37%3A12.829418&detailed=1 => generated 123 bytes in 260 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:37:14.215758 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-dc653ffd-1908-4520-a96a-766d611b459c tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:14.217094 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-dc653ffd-1908-4520-a96a-766d611b459c tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] [instance: 7222a4ce-d2a2-4b09-afc6-55bca52414d4] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:14.227271 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dc653ffd-1908-4520-a96a-766d611b459c tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:14.228016 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dc653ffd-1908-4520-a96a-766d611b459c tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:14.228534 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dc653ffd-1908-4520-a96a-766d611b459c tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:14.229656 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dc653ffd-1908-4520-a96a-766d611b459c tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:14.230333 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dc653ffd-1908-4520-a96a-766d611b459c tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:14.231007 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dc653ffd-1908-4520-a96a-766d611b459c tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:14.465125 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-d1e2c797-b3c9-4994-ada9-7a149d7ed2d8 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a41ab6fb78a42ceaca621c5a38ffc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa31ed92017490a82497c7b8910aef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:14.479816 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-d1e2c797-b3c9-4994-ada9-7a149d7ed2d8 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] 10.222.0.43 "GET /compute/v2.1/servers/64228016-ae20-4fcb-87da-c3d4d585e241" status: 200 len: 1308 microversion: 2.1 time: 0.921238 Oct 04 18:37:14.483102 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 864/1594] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:13 2022] GET /compute/v2.1/servers/64228016-ae20-4fcb-87da-c3d4d585e241 => generated 1308 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:14.491846 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-dffeeff2-9c72-47b9-90c1-06a264412dae tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:14.495146 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-dffeeff2-9c72-47b9-90c1-06a264412dae tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] [instance: 4231fdff-39dd-49a6-bea2-5edea44c3582] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:14.514762 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dffeeff2-9c72-47b9-90c1-06a264412dae tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:14.515531 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dffeeff2-9c72-47b9-90c1-06a264412dae tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:14.516152 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dffeeff2-9c72-47b9-90c1-06a264412dae tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:14.517147 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dffeeff2-9c72-47b9-90c1-06a264412dae tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:14.518660 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dffeeff2-9c72-47b9-90c1-06a264412dae tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:14.520000 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dffeeff2-9c72-47b9-90c1-06a264412dae tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:14.901945 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-dffeeff2-9c72-47b9-90c1-06a264412dae tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8046c7965b473e9f7d31be9d6f6937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b194743a4124bdba97895542273859a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:14.911875 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-dffeeff2-9c72-47b9-90c1-06a264412dae tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] 10.222.0.43 "GET /compute/v2.1/servers/4231fdff-39dd-49a6-bea2-5edea44c3582" status: 200 len: 1467 microversion: 2.1 time: 0.427361 Oct 04 18:37:14.928134 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 865/1595] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:14 2022] GET /compute/v2.1/servers/4231fdff-39dd-49a6-bea2-5edea44c3582 => generated 1467 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:14.928134 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-59baf5a3-005d-436e-bd87-2808a946d4b1 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:14.928134 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-59baf5a3-005d-436e-bd87-2808a946d4b1 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: ce0d629a-068c-4a62-8a03-fc43fc0be9b3] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:14.928422 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-dc653ffd-1908-4520-a96a-766d611b459c tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:14.941889 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-dc653ffd-1908-4520-a96a-766d611b459c tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:14.942984 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-59baf5a3-005d-436e-bd87-2808a946d4b1 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:14.943904 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-dc653ffd-1908-4520-a96a-766d611b459c tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:14.945216 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-dc653ffd-1908-4520-a96a-766d611b459c tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] 10.222.0.43 "GET /compute/v2.1/servers/7222a4ce-d2a2-4b09-afc6-55bca52414d4" status: 200 len: 1815 microversion: 2.25 time: 0.734699 Oct 04 18:37:14.955449 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 731/1596] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:37:14 2022] GET /compute/v2.1/servers/7222a4ce-d2a2-4b09-afc6-55bca52414d4 => generated 1815 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:37:14.956138 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-59baf5a3-005d-436e-bd87-2808a946d4b1 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:14.956138 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-59baf5a3-005d-436e-bd87-2808a946d4b1 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:14.956848 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-59baf5a3-005d-436e-bd87-2808a946d4b1 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:14.958836 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-59baf5a3-005d-436e-bd87-2808a946d4b1 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:14.961179 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-1f8f3868-c2e2-4a4f-9168-aa25fe23030b tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:14.961350 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-59baf5a3-005d-436e-bd87-2808a946d4b1 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:14.962111 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-1f8f3868-c2e2-4a4f-9168-aa25fe23030b tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] [instance: 86743a21-e24e-4001-b3da-48615f6e281e] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:14.972066 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1f8f3868-c2e2-4a4f-9168-aa25fe23030b tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:14.972755 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1f8f3868-c2e2-4a4f-9168-aa25fe23030b tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:14.973293 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1f8f3868-c2e2-4a4f-9168-aa25fe23030b tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:14.974030 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1f8f3868-c2e2-4a4f-9168-aa25fe23030b tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:14.974496 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1f8f3868-c2e2-4a4f-9168-aa25fe23030b tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:14.975459 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1f8f3868-c2e2-4a4f-9168-aa25fe23030b tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:15.460180 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-59baf5a3-005d-436e-bd87-2808a946d4b1 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:15.470711 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-59baf5a3-005d-436e-bd87-2808a946d4b1 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/ce0d629a-068c-4a62-8a03-fc43fc0be9b3" status: 200 len: 1463 microversion: 2.1 time: 0.554395 Oct 04 18:37:15.472351 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 866/1597] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:14 2022] GET /compute/v2.1/servers/ce0d629a-068c-4a62-8a03-fc43fc0be9b3 => generated 1463 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:15.488635 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-1d1ceb72-83a0-423f-9d5d-3280f2803e61 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Calling method '.version_select at 0x7fb2249f94c0>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:15.545501 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-1d1ceb72-83a0-423f-9d5d-3280f2803e61 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] 10.222.0.43 "GET /compute/v2.1/images/e8943ec5-4038-4d4b-b9b9-2415a79f5243" status: 200 len: 784 microversion: 2.1 time: 0.062749 Oct 04 18:37:15.546414 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 867/1598] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 18:37:15 2022] GET /compute/v2.1/images/e8943ec5-4038-4d4b-b9b9-2415a79f5243 => generated 784 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:37:15.557856 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-f08b724a-d469-446f-820f-d07632a21289 req-33a10cc3-1848-4f9b-b3ed-8d99ecc6bc48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7222a4ce-d2a2-4b09-afc6-55bca52414d4", "name": "network-vif-unplugged", "status": "completed", "tag": "dc9d53f5-3f85-42de-8651-845234788630"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:37:15.582048 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-f08b724a-d469-446f-820f-d07632a21289 req-33a10cc3-1848-4f9b-b3ed-8d99ecc6bc48 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:15.583512 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-f08b724a-d469-446f-820f-d07632a21289 req-33a10cc3-1848-4f9b-b3ed-8d99ecc6bc48 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:15.584725 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-f08b724a-d469-446f-820f-d07632a21289 req-33a10cc3-1848-4f9b-b3ed-8d99ecc6bc48 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:15.598239 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-f08b724a-d469-446f-820f-d07632a21289 req-33a10cc3-1848-4f9b-b3ed-8d99ecc6bc48 service nova] Creating event network-vif-unplugged:dc9d53f5-3f85-42de-8651-845234788630 for instance 7222a4ce-d2a2-4b09-afc6-55bca52414d4 on n-h1-851028-13 Oct 04 18:37:15.604108 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-f08b724a-d469-446f-820f-d07632a21289 req-33a10cc3-1848-4f9b-b3ed-8d99ecc6bc48 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.056142 Oct 04 18:37:15.605374 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 868/1599] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:37:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:37:15.611454 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-56e0a061-16ca-4ae6-97e5-5528e9d4382c req-29553c74-dbc5-4b23-af2b-cb4ce36e9080 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "132f39b7-bf1b-49a8-87a3-38cd95a041de", "tag": "556f1b80-4726-4da7-bd27-966c4476c538"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:37:15.622954 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-56e0a061-16ca-4ae6-97e5-5528e9d4382c req-29553c74-dbc5-4b23-af2b-cb4ce36e9080 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:15.623441 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-56e0a061-16ca-4ae6-97e5-5528e9d4382c req-29553c74-dbc5-4b23-af2b-cb4ce36e9080 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:15.623882 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-56e0a061-16ca-4ae6-97e5-5528e9d4382c req-29553c74-dbc5-4b23-af2b-cb4ce36e9080 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:15.636517 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-56e0a061-16ca-4ae6-97e5-5528e9d4382c req-29553c74-dbc5-4b23-af2b-cb4ce36e9080 service nova] Creating event network-changed:556f1b80-4726-4da7-bd27-966c4476c538 for instance 132f39b7-bf1b-49a8-87a3-38cd95a041de on n-h2-851028-13 Oct 04 18:37:15.641699 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-56e0a061-16ca-4ae6-97e5-5528e9d4382c req-29553c74-dbc5-4b23-af2b-cb4ce36e9080 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034684 Oct 04 18:37:15.642492 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 869/1600] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:37:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:37:15.648233 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-db483f16-b2ca-4afe-935e-f182e727a6b0 tempest-MigrationsAdminTest-1571334602 tempest-MigrationsAdminTest-1571334602-project-admin] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:15.649004 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-db483f16-b2ca-4afe-935e-f182e727a6b0 tempest-MigrationsAdminTest-1571334602 tempest-MigrationsAdminTest-1571334602-project-admin] [instance: ce0d629a-068c-4a62-8a03-fc43fc0be9b3] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:15.656179 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-db483f16-b2ca-4afe-935e-f182e727a6b0 tempest-MigrationsAdminTest-1571334602 tempest-MigrationsAdminTest-1571334602-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:15.656957 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-db483f16-b2ca-4afe-935e-f182e727a6b0 tempest-MigrationsAdminTest-1571334602 tempest-MigrationsAdminTest-1571334602-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:15.657633 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-db483f16-b2ca-4afe-935e-f182e727a6b0 tempest-MigrationsAdminTest-1571334602 tempest-MigrationsAdminTest-1571334602-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:15.658374 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-db483f16-b2ca-4afe-935e-f182e727a6b0 tempest-MigrationsAdminTest-1571334602 tempest-MigrationsAdminTest-1571334602-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:15.658821 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-db483f16-b2ca-4afe-935e-f182e727a6b0 tempest-MigrationsAdminTest-1571334602 tempest-MigrationsAdminTest-1571334602-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:15.659526 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-db483f16-b2ca-4afe-935e-f182e727a6b0 tempest-MigrationsAdminTest-1571334602 tempest-MigrationsAdminTest-1571334602-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:16.004439 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-1f8f3868-c2e2-4a4f-9168-aa25fe23030b tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa193aff0474ae3ba5d1aa7b0d0e8c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a06b8feba3404490a448aa2d4fb106b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:16.013871 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-1f8f3868-c2e2-4a4f-9168-aa25fe23030b tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] 10.222.0.43 "GET /compute/v2.1/servers/86743a21-e24e-4001-b3da-48615f6e281e" status: 200 len: 1322 microversion: 2.1 time: 1.066563 Oct 04 18:37:16.032841 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 732/1601] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:14 2022] GET /compute/v2.1/servers/86743a21-e24e-4001-b3da-48615f6e281e => generated 1322 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:16.039195 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-c6d33fc9-fa07-45ae-9597-3ad6aea14e6e tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:16.040022 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-c6d33fc9-fa07-45ae-9597-3ad6aea14e6e tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] [instance: 64228016-ae20-4fcb-87da-c3d4d585e241] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:16.047641 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c6d33fc9-fa07-45ae-9597-3ad6aea14e6e tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:16.048424 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c6d33fc9-fa07-45ae-9597-3ad6aea14e6e tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:16.049032 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c6d33fc9-fa07-45ae-9597-3ad6aea14e6e tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:16.050091 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c6d33fc9-fa07-45ae-9597-3ad6aea14e6e tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:16.050224 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-db483f16-b2ca-4afe-935e-f182e727a6b0 tempest-MigrationsAdminTest-1571334602 tempest-MigrationsAdminTest-1571334602-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/ce0d629a-068c-4a62-8a03-fc43fc0be9b3" status: 200 len: 1616 microversion: 2.1 time: 0.406125 Oct 04 18:37:16.051776 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c6d33fc9-fa07-45ae-9597-3ad6aea14e6e tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:16.052361 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c6d33fc9-fa07-45ae-9597-3ad6aea14e6e tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:16.053961 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 870/1602] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:15 2022] GET /compute/v2.1/servers/ce0d629a-068c-4a62-8a03-fc43fc0be9b3 => generated 1616 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:16.067392 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-50697e7f-e8f9-4257-b6ce-8ac1716073b0 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:16.092487 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-50697e7f-e8f9-4257-b6ce-8ac1716073b0 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] 10.222.0.43 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.029516 Oct 04 18:37:16.094320 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 871/1603] 10.222.0.43 () {58 vars in 1137 bytes} [Tue Oct 4 18:37:16 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:37:16.099791 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-c2b08e4a-6a1f-4806-a8b2-f5cbf406c326 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:16.100701 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-c2b08e4a-6a1f-4806-a8b2-f5cbf406c326 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] [instance: 7222a4ce-d2a2-4b09-afc6-55bca52414d4] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:16.110567 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c2b08e4a-6a1f-4806-a8b2-f5cbf406c326 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:16.111908 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c2b08e4a-6a1f-4806-a8b2-f5cbf406c326 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:16.113195 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c2b08e4a-6a1f-4806-a8b2-f5cbf406c326 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:16.114312 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c2b08e4a-6a1f-4806-a8b2-f5cbf406c326 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:16.116249 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c2b08e4a-6a1f-4806-a8b2-f5cbf406c326 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:16.117024 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c2b08e4a-6a1f-4806-a8b2-f5cbf406c326 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:16.705001 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-c2b08e4a-6a1f-4806-a8b2-f5cbf406c326 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:16.730641 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-c2b08e4a-6a1f-4806-a8b2-f5cbf406c326 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:16.734066 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-c2b08e4a-6a1f-4806-a8b2-f5cbf406c326 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:16.741096 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-c2b08e4a-6a1f-4806-a8b2-f5cbf406c326 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] 10.222.0.43 "GET /compute/v2.1/servers/7222a4ce-d2a2-4b09-afc6-55bca52414d4" status: 200 len: 1815 microversion: 2.25 time: 0.639786 Oct 04 18:37:16.747907 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 872/1604] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:37:16 2022] GET /compute/v2.1/servers/7222a4ce-d2a2-4b09-afc6-55bca52414d4 => generated 1815 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:37:16.774932 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-e4055e80-2858-4080-bee5-957fa7641d99 req-3e29f6bc-8ede-4973-a02d-e4a2b981b028 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "744f6597-f965-405c-ad7b-66a8a0f1397b", "name": "network-vif-plugged", "status": "completed", "tag": "e8aa70a4-f808-4675-a8cb-ceaa0108ff63"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:37:16.804630 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-e4055e80-2858-4080-bee5-957fa7641d99 req-3e29f6bc-8ede-4973-a02d-e4a2b981b028 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:16.809692 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-e4055e80-2858-4080-bee5-957fa7641d99 req-3e29f6bc-8ede-4973-a02d-e4a2b981b028 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:16.810245 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-e4055e80-2858-4080-bee5-957fa7641d99 req-3e29f6bc-8ede-4973-a02d-e4a2b981b028 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:16.836402 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-e4055e80-2858-4080-bee5-957fa7641d99 req-3e29f6bc-8ede-4973-a02d-e4a2b981b028 service nova] Creating event network-vif-plugged:e8aa70a4-f808-4675-a8cb-ceaa0108ff63 for instance 744f6597-f965-405c-ad7b-66a8a0f1397b on n-h2-851028-13 Oct 04 18:37:16.852172 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-e4055e80-2858-4080-bee5-957fa7641d99 req-3e29f6bc-8ede-4973-a02d-e4a2b981b028 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100857 Oct 04 18:37:16.855356 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 873/1605] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:37:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:37:16.878196 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-3c5677c9-b1ec-4699-b5fe-9fed6b1a5abf tempest-MigrationsAdminTest-1571334602 tempest-MigrationsAdminTest-1571334602-project-admin] Calling method '.version_select at 0x7fb227ed80d0>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:16.891949 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3c5677c9-b1ec-4699-b5fe-9fed6b1a5abf tempest-MigrationsAdminTest-1571334602 tempest-MigrationsAdminTest-1571334602-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:16.892669 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3c5677c9-b1ec-4699-b5fe-9fed6b1a5abf tempest-MigrationsAdminTest-1571334602 tempest-MigrationsAdminTest-1571334602-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:16.894757 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3c5677c9-b1ec-4699-b5fe-9fed6b1a5abf tempest-MigrationsAdminTest-1571334602 tempest-MigrationsAdminTest-1571334602-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:16.934908 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-c6d33fc9-fa07-45ae-9597-3ad6aea14e6e tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a41ab6fb78a42ceaca621c5a38ffc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa31ed92017490a82497c7b8910aef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:16.948530 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-3c5677c9-b1ec-4699-b5fe-9fed6b1a5abf tempest-MigrationsAdminTest-1571334602 tempest-MigrationsAdminTest-1571334602-project-admin] 10.222.0.43 "GET /compute/v2.1/os-migrations" status: 200 len: 1577 microversion: 2.1 time: 0.083041 Oct 04 18:37:16.953272 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 874/1606] 10.222.0.43 () {58 vars in 1143 bytes} [Tue Oct 4 18:37:16 2022] GET /compute/v2.1/os-migrations => generated 1577 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:16.954514 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:37:16.969468 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-8356f33d-3188-4804-9574-08f569c8c53c tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Calling method '.version_select at 0x7fb21fb6eaf0>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:16.969689 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-c6d33fc9-fa07-45ae-9597-3ad6aea14e6e tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] 10.222.0.43 "GET /compute/v2.1/servers/64228016-ae20-4fcb-87da-c3d4d585e241" status: 200 len: 1308 microversion: 2.1 time: 0.935133 Oct 04 18:37:16.974350 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 733/1607] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:16 2022] GET /compute/v2.1/servers/64228016-ae20-4fcb-87da-c3d4d585e241 => generated 1308 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:17.042913 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-7691e237-cb02-4ff6-8744-7a0f11975f99 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:17.045054 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-7691e237-cb02-4ff6-8744-7a0f11975f99 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] [instance: 86743a21-e24e-4001-b3da-48615f6e281e] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:17.056093 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7691e237-cb02-4ff6-8744-7a0f11975f99 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:17.057029 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7691e237-cb02-4ff6-8744-7a0f11975f99 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:17.058231 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7691e237-cb02-4ff6-8744-7a0f11975f99 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:17.059511 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7691e237-cb02-4ff6-8744-7a0f11975f99 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:17.061810 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7691e237-cb02-4ff6-8744-7a0f11975f99 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:17.062529 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7691e237-cb02-4ff6-8744-7a0f11975f99 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:17.888066 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-7691e237-cb02-4ff6-8744-7a0f11975f99 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa193aff0474ae3ba5d1aa7b0d0e8c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a06b8feba3404490a448aa2d4fb106b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:17.901348 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-7691e237-cb02-4ff6-8744-7a0f11975f99 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] 10.222.0.43 "GET /compute/v2.1/servers/86743a21-e24e-4001-b3da-48615f6e281e" status: 200 len: 1322 microversion: 2.1 time: 0.863049 Oct 04 18:37:17.902129 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 734/1608] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:17 2022] GET /compute/v2.1/servers/86743a21-e24e-4001-b3da-48615f6e281e => generated 1322 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:17.919021 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-38db517e-a7b2-4a86-acf6-d9b2ed3620ba tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-768411506", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452"}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:37:18.003695 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.network.neutron [None req-38db517e-a7b2-4a86-acf6-d9b2ed3620ba tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] validate_networks() for None {{(pid=123595) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:37:18.083665 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-8356f33d-3188-4804-9574-08f569c8c53c tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] 10.222.0.43 "DELETE /compute/v2.1/images/3adaa529-06f7-4c7d-8ad1-d56ec671ea9a" status: 204 len: 0 microversion: 2.1 time: 1.129035 Oct 04 18:37:18.084294 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 875/1609] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:16 2022] DELETE /compute/v2.1/images/3adaa529-06f7-4c7d-8ad1-d56ec671ea9a => generated 0 bytes in 1130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:37:18.089339 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-8fd3ac28-e4f0-4295-87d6-3fa61189ed3c req-afd44bf9-6537-44ba-aebe-e398c25b33b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7222a4ce-d2a2-4b09-afc6-55bca52414d4", "tag": "dc9d53f5-3f85-42de-8651-845234788630"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:37:18.101718 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-8fd3ac28-e4f0-4295-87d6-3fa61189ed3c req-afd44bf9-6537-44ba-aebe-e398c25b33b2 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:18.102516 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-8fd3ac28-e4f0-4295-87d6-3fa61189ed3c req-afd44bf9-6537-44ba-aebe-e398c25b33b2 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:18.103195 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-8fd3ac28-e4f0-4295-87d6-3fa61189ed3c req-afd44bf9-6537-44ba-aebe-e398c25b33b2 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:18.115963 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-8fd3ac28-e4f0-4295-87d6-3fa61189ed3c req-afd44bf9-6537-44ba-aebe-e398c25b33b2 service nova] Creating event network-changed:dc9d53f5-3f85-42de-8651-845234788630 for instance 7222a4ce-d2a2-4b09-afc6-55bca52414d4 on n-h1-851028-13 Oct 04 18:37:18.122346 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-8fd3ac28-e4f0-4295-87d6-3fa61189ed3c req-afd44bf9-6537-44ba-aebe-e398c25b33b2 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036826 Oct 04 18:37:18.123258 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 876/1610] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:37:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:37:18.129630 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-772bee50-15fe-4dd2-91e4-1b58e781eff6 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:18.130855 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-772bee50-15fe-4dd2-91e4-1b58e781eff6 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] [instance: 7222a4ce-d2a2-4b09-afc6-55bca52414d4] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:18.137553 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-772bee50-15fe-4dd2-91e4-1b58e781eff6 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:18.138513 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-772bee50-15fe-4dd2-91e4-1b58e781eff6 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:18.139244 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-772bee50-15fe-4dd2-91e4-1b58e781eff6 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:18.140196 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-772bee50-15fe-4dd2-91e4-1b58e781eff6 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:18.141001 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-772bee50-15fe-4dd2-91e4-1b58e781eff6 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:18.141633 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-772bee50-15fe-4dd2-91e4-1b58e781eff6 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:18.565335 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-772bee50-15fe-4dd2-91e4-1b58e781eff6 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:18.576330 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-772bee50-15fe-4dd2-91e4-1b58e781eff6 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:18.578992 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-772bee50-15fe-4dd2-91e4-1b58e781eff6 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:18.586348 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-772bee50-15fe-4dd2-91e4-1b58e781eff6 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] 10.222.0.43 "GET /compute/v2.1/servers/7222a4ce-d2a2-4b09-afc6-55bca52414d4" status: 200 len: 1815 microversion: 2.25 time: 0.456944 Oct 04 18:37:18.588179 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 877/1611] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:37:18 2022] GET /compute/v2.1/servers/7222a4ce-d2a2-4b09-afc6-55bca52414d4 => generated 1815 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:37:18.603455 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-0d10546d-4271-495b-8853-3559b8f88e58 req-3d5ba152-81d3-4a10-b40f-89642aad8a2f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86743a21-e24e-4001-b3da-48615f6e281e", "tag": "36be2d21-a2ff-4ccd-8c37-dfd2f4b90d0c"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:37:18.635898 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-0d10546d-4271-495b-8853-3559b8f88e58 req-3d5ba152-81d3-4a10-b40f-89642aad8a2f service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:18.636390 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-0d10546d-4271-495b-8853-3559b8f88e58 req-3d5ba152-81d3-4a10-b40f-89642aad8a2f service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:18.636826 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-0d10546d-4271-495b-8853-3559b8f88e58 req-3d5ba152-81d3-4a10-b40f-89642aad8a2f service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:18.637750 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-38db517e-a7b2-4a86-acf6-d9b2ed3620ba tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Flavor limits 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:37:18.638294 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-38db517e-a7b2-4a86-acf6-d9b2ed3620ba tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Image limits 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:37:18.639022 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-38db517e-a7b2-4a86-acf6-d9b2ed3620ba tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Flavor pref 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:37:18.639962 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-38db517e-a7b2-4a86-acf6-d9b2ed3620ba tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Image pref 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:37:18.658509 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-38db517e-a7b2-4a86-acf6-d9b2ed3620ba tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:37:18.671744 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-0d10546d-4271-495b-8853-3559b8f88e58 req-3d5ba152-81d3-4a10-b40f-89642aad8a2f service nova] Creating event network-changed:36be2d21-a2ff-4ccd-8c37-dfd2f4b90d0c for instance 86743a21-e24e-4001-b3da-48615f6e281e on n-h1-851028-13 Oct 04 18:37:18.689483 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-0d10546d-4271-495b-8853-3559b8f88e58 req-3d5ba152-81d3-4a10-b40f-89642aad8a2f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097633 Oct 04 18:37:18.690523 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 878/1612] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:37:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:37:18.693623 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-38db517e-a7b2-4a86-acf6-d9b2ed3620ba tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:18.694412 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-38db517e-a7b2-4a86-acf6-d9b2ed3620ba tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:18.696812 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-38db517e-a7b2-4a86-acf6-d9b2ed3620ba tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:18.701227 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-38db517e-a7b2-4a86-acf6-d9b2ed3620ba tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:18.701938 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-246b825b-1087-40f3-bbb7-90a91ff5a73d tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:18.702568 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-38db517e-a7b2-4a86-acf6-d9b2ed3620ba tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:18.703209 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-246b825b-1087-40f3-bbb7-90a91ff5a73d tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] [instance: 64228016-ae20-4fcb-87da-c3d4d585e241] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:18.703797 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-38db517e-a7b2-4a86-acf6-d9b2ed3620ba tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:18.710679 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-246b825b-1087-40f3-bbb7-90a91ff5a73d tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:18.711480 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-246b825b-1087-40f3-bbb7-90a91ff5a73d tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:18.712075 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-246b825b-1087-40f3-bbb7-90a91ff5a73d tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:18.713526 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-246b825b-1087-40f3-bbb7-90a91ff5a73d tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:18.714129 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-246b825b-1087-40f3-bbb7-90a91ff5a73d tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:18.714717 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-246b825b-1087-40f3-bbb7-90a91ff5a73d tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:18.777741 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-38db517e-a7b2-4a86-acf6-d9b2ed3620ba tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Getting quotas for project 50a6a1a86a59403dad27f6e3c628853c. Resources: {'ram', 'cores', 'instances'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:37:18.801670 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-38db517e-a7b2-4a86-acf6-d9b2ed3620ba tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Getting quotas for user 581885ffa737444eafa3179cceb6ee1d and project 50a6a1a86a59403dad27f6e3c628853c. Resources: {'ram', 'cores', 'instances'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:37:18.826192 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-38db517e-a7b2-4a86-acf6-d9b2ed3620ba tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Going to run 1 instances... {{(pid=123595) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:37:18.828574 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-38db517e-a7b2-4a86-acf6-d9b2ed3620ba tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: d85af512-1b1f-42a4-9bb1-963cc956c9ae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e8943ec5-4038-4d4b-b9b9-2415a79f5243',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:37:18.949803 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-38db517e-a7b2-4a86-acf6-d9b2ed3620ba tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.035310 Oct 04 18:37:18.962383 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 735/1613] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 18:37:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 1059 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:37:18.983513 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-86821f3f-9210-4e80-8e5b-3fb2d1b41a52 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Calling method '.version_select at 0x7fb21f834ca0>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:19.013799 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-86821f3f-9210-4e80-8e5b-3fb2d1b41a52 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] HTTP exception thrown: Image not found. Oct 04 18:37:19.036396 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-86821f3f-9210-4e80-8e5b-3fb2d1b41a52 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Request method failure captured: Oct 04 18:37:19.036396 n-d-851028-13 devstack@n-api.service[123595]: request: GET /compute/v2.1/images/3adaa529-06f7-4c7d-8ad1-d56ec671ea9a HTTP/1.1 Oct 04 18:37:19.036396 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 18:37:19.036396 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 18:37:19.036396 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 18:37:19.036396 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 0 Oct 04 18:37:19.036396 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 18:37:19.036396 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 18:37:19.036396 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 18:37:19.036396 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 18:37:19.036396 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPH0hO_Ym2aLHAuk9rkBKg3C9YkagtqYC-rp7fMGd1weqaGssGyw08BqfU3pT_Y_hZLBo9ZzyE6BELs39RFtTAFUidzm6wwU42rAJzEyj8cCVUCsmjPcm1Fgx9u-MawhbeNr7VvrF2c4V4-Rrr5VP9VBPa6pSXjPPC4YiU4wUEOO-Voc Oct 04 18:37:19.036396 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 18:37:19.036396 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 18:37:19.036396 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 18:37:19.036396 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 18:37:19.036396 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 18:37:19.036396 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 18:37:19.036396 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: 3b194743a4124bdba97895542273859a Oct 04 18:37:19.036396 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-ImagesOneServerTestJSON-2102952989 Oct 04 18:37:19.036396 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 18:37:19.036396 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 18:37:19.036396 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/3b194743a4124bdba97895542273859a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_3b194743a4124bdba97895542273859a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/3b194743a4124bdba97895542273859a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/3b194743a4124bdba97895542273859a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:37:19.036396 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-ImagesOneServerTestJSON-2102952989 Oct 04 18:37:19.036396 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: 3b194743a4124bdba97895542273859a Oct 04 18:37:19.036396 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-2102952989 Oct 04 18:37:19.036396 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-ImagesOneServerTestJSON-2102952989-project Oct 04 18:37:19.036396 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 18:37:19.036396 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 18:37:19.036396 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: 1e8046c7965b473e9f7d31be9d6f6937 Oct 04 18:37:19.036396 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-ImagesOneServerTestJSON-2102952989-project Oct 04 18:37:19.036396 n-d-851028-13 devstack@n-api.service[123595]: method: Oct 04 18:37:19.036396 n-d-851028-13 devstack@n-api.service[123595]: exception: Image not found. Oct 04 18:37:19.036396 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': '3adaa529-06f7-4c7d-8ad1-d56ec671ea9a'} Oct 04 18:37:19.036396 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:37:19.036396 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:19.036396 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 18:37:19.036396 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 18:37:19.036396 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 18:37:19.036396 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 18:37:19.036396 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 18:37:19.036396 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 18:37:19.036396 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 18:37:19.036396 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 18:37:19.036396 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 18:37:19.036396 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 18:37:19.036396 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 18:37:19.036396 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 18:37:19.036396 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 18:37:19.036396 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 18:37:19.036396 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 18:37:19.036396 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 18:37:19.036396 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 3adaa529-06f7-4c7d-8ad1-d56ec671ea9a Oct 04 18:37:19.036396 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:37:19.036396 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:37:19.036396 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:37:19.036396 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:19.036396 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 04 18:37:19.036396 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 04 18:37:19.036396 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 04 18:37:19.036396 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 04 18:37:19.036396 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 04 18:37:19.036396 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 04 18:37:19.036396 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 04 18:37:19.041375 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 04 18:37:19.041375 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 18:37:19.041375 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 18:37:19.041375 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 18:37:19.041375 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 18:37:19.041375 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 18:37:19.041375 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 18:37:19.041375 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 18:37:19.041375 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 18:37:19.041375 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 18:37:19.041375 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 18:37:19.041375 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 18:37:19.041375 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 18:37:19.041375 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 18:37:19.041375 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 18:37:19.041375 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 18:37:19.041375 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 18:37:19.041375 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 3adaa529-06f7-4c7d-8ad1-d56ec671ea9a could not be found. Oct 04 18:37:19.041375 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:37:19.041375 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:37:19.041375 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:37:19.041375 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:19.041375 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:37:19.041375 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:37:19.041375 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:37:19.041375 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:37:19.041375 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:37:19.041375 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:37:19.041375 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:37:19.041375 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:37:19.041375 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 04 18:37:19.041375 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 18:37:19.041375 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 18:37:19.041375 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:37:19.041375 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:37:19.041375 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:37:19.041375 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:19.041375 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:37:19.041375 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:37:19.041375 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:37:19.041375 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:37:19.041375 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 18:37:19.041375 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:37:19.041375 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-86821f3f-9210-4e80-8e5b-3fb2d1b41a52 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Returning 404 to user: Image not found. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:37:19.041375 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-86821f3f-9210-4e80-8e5b-3fb2d1b41a52 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] 10.222.0.43 "GET /compute/v2.1/images/3adaa529-06f7-4c7d-8ad1-d56ec671ea9a" status: 404 len: 62 microversion: 2.1 time: 0.074367 Oct 04 18:37:19.060142 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 736/1614] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 18:37:18 2022] GET /compute/v2.1/images/3adaa529-06f7-4c7d-8ad1-d56ec671ea9a => generated 62 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:37:19.063681 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-cb646c5c-818b-4a41-aaba-44e1ec0a82ad req-f2d558a4-2c9f-497a-a37e-aed86cf898a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4231fdff-39dd-49a6-bea2-5edea44c3582", "name": "network-vif-unplugged", "status": "completed", "tag": "ee13bc47-8284-46ee-acc8-f29243243bf5"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:37:19.085330 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-cb646c5c-818b-4a41-aaba-44e1ec0a82ad req-f2d558a4-2c9f-497a-a37e-aed86cf898a5 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:19.086105 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-cb646c5c-818b-4a41-aaba-44e1ec0a82ad req-f2d558a4-2c9f-497a-a37e-aed86cf898a5 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:19.086770 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-cb646c5c-818b-4a41-aaba-44e1ec0a82ad req-f2d558a4-2c9f-497a-a37e-aed86cf898a5 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:19.099430 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-cb646c5c-818b-4a41-aaba-44e1ec0a82ad req-f2d558a4-2c9f-497a-a37e-aed86cf898a5 service nova] Creating event network-vif-unplugged:ee13bc47-8284-46ee-acc8-f29243243bf5 for instance 4231fdff-39dd-49a6-bea2-5edea44c3582 on n-h1-851028-13 Oct 04 18:37:19.105509 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-cb646c5c-818b-4a41-aaba-44e1ec0a82ad req-f2d558a4-2c9f-497a-a37e-aed86cf898a5 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.061027 Oct 04 18:37:19.106767 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 737/1615] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:37:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:37:19.113956 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-b1ae1375-928b-4ef4-99e4-2f3d4a8a46ac tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:19.115010 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-b1ae1375-928b-4ef4-99e4-2f3d4a8a46ac tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] [instance: 86743a21-e24e-4001-b3da-48615f6e281e] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:19.126345 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b1ae1375-928b-4ef4-99e4-2f3d4a8a46ac tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:19.127273 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b1ae1375-928b-4ef4-99e4-2f3d4a8a46ac tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:19.127942 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b1ae1375-928b-4ef4-99e4-2f3d4a8a46ac tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:19.128884 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b1ae1375-928b-4ef4-99e4-2f3d4a8a46ac tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:19.129589 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b1ae1375-928b-4ef4-99e4-2f3d4a8a46ac tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:19.130864 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b1ae1375-928b-4ef4-99e4-2f3d4a8a46ac tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:19.261014 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-246b825b-1087-40f3-bbb7-90a91ff5a73d tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a41ab6fb78a42ceaca621c5a38ffc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa31ed92017490a82497c7b8910aef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:19.274996 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-246b825b-1087-40f3-bbb7-90a91ff5a73d tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] 10.222.0.43 "GET /compute/v2.1/servers/64228016-ae20-4fcb-87da-c3d4d585e241" status: 200 len: 1488 microversion: 2.1 time: 0.581108 Oct 04 18:37:19.287308 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 879/1616] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:18 2022] GET /compute/v2.1/servers/64228016-ae20-4fcb-87da-c3d4d585e241 => generated 1488 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:19.310307 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-5e213ef5-0321-45f7-9f23-eaf5c624ff24 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:19.313173 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-5e213ef5-0321-45f7-9f23-eaf5c624ff24 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: d85af512-1b1f-42a4-9bb1-963cc956c9ae] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:19.325324 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_api:SELECT=100 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:37:19.488751 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-5e213ef5-0321-45f7-9f23-eaf5c624ff24 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:19.501407 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-5e213ef5-0321-45f7-9f23-eaf5c624ff24 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/d85af512-1b1f-42a4-9bb1-963cc956c9ae" status: 200 len: 1212 microversion: 2.1 time: 0.211637 Oct 04 18:37:19.503722 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 880/1617] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:19 2022] GET /compute/v2.1/servers/d85af512-1b1f-42a4-9bb1-963cc956c9ae => generated 1212 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:19.523350 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-a1f350a4-21a0-41dd-9645-13e9d47812df tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-724156726"}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:37:19.529939 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-a1f350a4-21a0-41dd-9645-13e9d47812df tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] [instance: 4231fdff-39dd-49a6-bea2-5edea44c3582] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:19.556413 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a1f350a4-21a0-41dd-9645-13e9d47812df tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:19.556924 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a1f350a4-21a0-41dd-9645-13e9d47812df tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:19.557397 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a1f350a4-21a0-41dd-9645-13e9d47812df tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:19.558127 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a1f350a4-21a0-41dd-9645-13e9d47812df tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:19.565569 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a1f350a4-21a0-41dd-9645-13e9d47812df tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:19.566353 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a1f350a4-21a0-41dd-9645-13e9d47812df tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:20.182214 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-a1f350a4-21a0-41dd-9645-13e9d47812df tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] 10.222.0.43 "POST /compute/v2.1/servers/4231fdff-39dd-49a6-bea2-5edea44c3582/action" status: 202 len: 0 microversion: 2.1 time: 0.670090 Oct 04 18:37:20.183494 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 881/1618] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 18:37:19 2022] POST /compute/v2.1/servers/4231fdff-39dd-49a6-bea2-5edea44c3582/action => generated 0 bytes in 679 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 04 18:37:20.213967 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-67ed3274-b731-4306-a441-52ac512c9606 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-816705493"}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:37:20.221851 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-67ed3274-b731-4306-a441-52ac512c9606 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] [instance: 64228016-ae20-4fcb-87da-c3d4d585e241] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:20.238789 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-67ed3274-b731-4306-a441-52ac512c9606 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:20.240239 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-67ed3274-b731-4306-a441-52ac512c9606 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:20.242160 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-67ed3274-b731-4306-a441-52ac512c9606 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:20.243513 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-67ed3274-b731-4306-a441-52ac512c9606 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:20.246330 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-67ed3274-b731-4306-a441-52ac512c9606 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:20.246330 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-67ed3274-b731-4306-a441-52ac512c9606 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:20.613572 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:37:20.706202 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-67ed3274-b731-4306-a441-52ac512c9606 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] 10.222.0.43 "POST /compute/v2.1/servers/64228016-ae20-4fcb-87da-c3d4d585e241/action" status: 202 len: 0 microversion: 2.1 time: 0.520980 Oct 04 18:37:20.713425 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 882/1619] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 18:37:20 2022] POST /compute/v2.1/servers/64228016-ae20-4fcb-87da-c3d4d585e241/action => generated 0 bytes in 529 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 04 18:37:20.720747 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-6f56065f-592b-453c-8f65-720f446f6470 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:20.721818 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-6f56065f-592b-453c-8f65-720f446f6470 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] [instance: 7222a4ce-d2a2-4b09-afc6-55bca52414d4] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:20.733622 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6f56065f-592b-453c-8f65-720f446f6470 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:20.734636 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6f56065f-592b-453c-8f65-720f446f6470 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:20.735338 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6f56065f-592b-453c-8f65-720f446f6470 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:20.736601 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6f56065f-592b-453c-8f65-720f446f6470 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:20.737391 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6f56065f-592b-453c-8f65-720f446f6470 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:20.738058 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6f56065f-592b-453c-8f65-720f446f6470 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:20.878121 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-b1ae1375-928b-4ef4-99e4-2f3d4a8a46ac tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa193aff0474ae3ba5d1aa7b0d0e8c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a06b8feba3404490a448aa2d4fb106b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:20.895842 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-b1ae1375-928b-4ef4-99e4-2f3d4a8a46ac tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] 10.222.0.43 "GET /compute/v2.1/servers/86743a21-e24e-4001-b3da-48615f6e281e" status: 200 len: 1322 microversion: 2.1 time: 1.787359 Oct 04 18:37:20.907536 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 738/1620] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:19 2022] GET /compute/v2.1/servers/86743a21-e24e-4001-b3da-48615f6e281e => generated 1322 bytes in 1800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:21.019370 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-6f56065f-592b-453c-8f65-720f446f6470 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:21.055297 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-6f56065f-592b-453c-8f65-720f446f6470 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:21.070805 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-6f56065f-592b-453c-8f65-720f446f6470 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:21.072203 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-6f56065f-592b-453c-8f65-720f446f6470 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] 10.222.0.43 "GET /compute/v2.1/servers/7222a4ce-d2a2-4b09-afc6-55bca52414d4" status: 200 len: 1815 microversion: 2.25 time: 0.356679 Oct 04 18:37:21.073184 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 883/1621] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:37:20 2022] GET /compute/v2.1/servers/7222a4ce-d2a2-4b09-afc6-55bca52414d4 => generated 1815 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:37:21.092636 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-d1c18f5a-3bd1-46ed-b18f-ac69e2ed4ae5 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Calling method '.version_select at 0x7fb225e558b0>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:21.186175 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-d1c18f5a-3bd1-46ed-b18f-ac69e2ed4ae5 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] 10.222.0.43 "GET /compute/v2.1/images/d7825145-299c-45b6-9fe8-780722b2d243" status: 200 len: 1428 microversion: 2.1 time: 0.111876 Oct 04 18:37:21.194585 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 884/1622] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 18:37:21 2022] GET /compute/v2.1/images/d7825145-299c-45b6-9fe8-780722b2d243 => generated 1428 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:21.199814 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-258208c4-6a91-4c12-b539-37a8a14831a1 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:21.200437 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-258208c4-6a91-4c12-b539-37a8a14831a1 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: d85af512-1b1f-42a4-9bb1-963cc956c9ae] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:21.220840 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-26d63b26-3dd9-4142-97b8-8ce4c8b639b7 tempest-FlavorsV2NegativeTest-3327453 tempest-FlavorsV2NegativeTest-3327453-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:21.229459 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-258208c4-6a91-4c12-b539-37a8a14831a1 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:21.233835 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-258208c4-6a91-4c12-b539-37a8a14831a1 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:21.234323 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-258208c4-6a91-4c12-b539-37a8a14831a1 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:21.237695 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-258208c4-6a91-4c12-b539-37a8a14831a1 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:21.238262 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-258208c4-6a91-4c12-b539-37a8a14831a1 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:21.238718 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-258208c4-6a91-4c12-b539-37a8a14831a1 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:21.295751 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-26d63b26-3dd9-4142-97b8-8ce4c8b639b7 tempest-FlavorsV2NegativeTest-3327453 tempest-FlavorsV2NegativeTest-3327453-project] 10.222.0.43 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.384481 Oct 04 18:37:21.321489 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 739/1623] 10.222.0.43 () {58 vars in 1137 bytes} [Tue Oct 4 18:37:20 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:37:21.348069 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-a2f1bbd2-0775-4322-9a24-471d12b36da1 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Calling method '.version_select at 0x7fb21f74cd30>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:21.449874 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-a2f1bbd2-0775-4322-9a24-471d12b36da1 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] 10.222.0.43 "GET /compute/v2.1/images/55efa976-ae7c-4644-8cf0-09c64d94a4c9" status: 200 len: 1411 microversion: 2.1 time: 0.109864 Oct 04 18:37:21.453097 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 740/1624] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 18:37:21 2022] GET /compute/v2.1/images/55efa976-ae7c-4644-8cf0-09c64d94a4c9 => generated 1411 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:21.467641 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-c7a1a1a2-e0ac-4981-a343-513d6cc12efe tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Calling method '.version_select at 0x7fb21fc31af0>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:21.586388 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-c7a1a1a2-e0ac-4981-a343-513d6cc12efe tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] 10.222.0.43 "GET /compute/v2.1/images/55efa976-ae7c-4644-8cf0-09c64d94a4c9" status: 200 len: 1411 microversion: 2.1 time: 0.124729 Oct 04 18:37:21.587403 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 741/1625] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 18:37:21 2022] GET /compute/v2.1/images/55efa976-ae7c-4644-8cf0-09c64d94a4c9 => generated 1411 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:37:21.613585 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-656a87d0-b9bd-4667-8bf4-594e1bf20d4e tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Calling method '.version_select at 0x7fb21fb2a280>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:21.747822 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-258208c4-6a91-4c12-b539-37a8a14831a1 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:21.764247 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-258208c4-6a91-4c12-b539-37a8a14831a1 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/d85af512-1b1f-42a4-9bb1-963cc956c9ae" status: 200 len: 1272 microversion: 2.1 time: 0.565389 Oct 04 18:37:21.773369 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 885/1626] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:21 2022] GET /compute/v2.1/servers/d85af512-1b1f-42a4-9bb1-963cc956c9ae => generated 1272 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:21.924342 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-498bf18e-aefc-4a9a-8b28-dc5c75ca8502 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:21.925924 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-498bf18e-aefc-4a9a-8b28-dc5c75ca8502 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] [instance: 86743a21-e24e-4001-b3da-48615f6e281e] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:21.941826 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-498bf18e-aefc-4a9a-8b28-dc5c75ca8502 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:21.942783 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-498bf18e-aefc-4a9a-8b28-dc5c75ca8502 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:21.944916 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-498bf18e-aefc-4a9a-8b28-dc5c75ca8502 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:21.946309 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-498bf18e-aefc-4a9a-8b28-dc5c75ca8502 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:21.947319 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-498bf18e-aefc-4a9a-8b28-dc5c75ca8502 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:21.948402 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-498bf18e-aefc-4a9a-8b28-dc5c75ca8502 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:21.978957 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-656a87d0-b9bd-4667-8bf4-594e1bf20d4e tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] 10.222.0.43 "DELETE /compute/v2.1/images/55efa976-ae7c-4644-8cf0-09c64d94a4c9" status: 204 len: 0 microversion: 2.1 time: 0.369431 Oct 04 18:37:21.983544 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 742/1627] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:21 2022] DELETE /compute/v2.1/images/55efa976-ae7c-4644-8cf0-09c64d94a4c9 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:37:21.989635 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-93bb6628-d704-4b4b-8ca5-a9244248b4c1 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Calling method '.version_select at 0x7fb21fb2a820>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:22.053659 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-93bb6628-d704-4b4b-8ca5-a9244248b4c1 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] HTTP exception thrown: Image not found. Oct 04 18:37:22.057671 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-93bb6628-d704-4b4b-8ca5-a9244248b4c1 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Request method failure captured: Oct 04 18:37:22.057671 n-d-851028-13 devstack@n-api.service[123595]: request: GET /compute/v2.1/images/55efa976-ae7c-4644-8cf0-09c64d94a4c9 HTTP/1.1 Oct 04 18:37:22.057671 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 18:37:22.057671 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 18:37:22.057671 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 18:37:22.057671 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 0 Oct 04 18:37:22.057671 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 18:37:22.057671 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 18:37:22.057671 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 18:37:22.057671 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 18:37:22.057671 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPHx6gAhOQR9SzxsaQbdLvvDvFzwkrsL-eso5wPcIMTe7QTGQ8GNpGTh82q09olF7Uzd5vnfi_owSOym5Q6Nw1rEFuVgt0OVgeRF4PHNfL8zRO2fxXQeqtj7eemFhMAlgrZ0t6cEXPXGxP4C7AYLZO84Rlcv3L9rcqzDiRnnfGTw4VIc Oct 04 18:37:22.057671 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 18:37:22.057671 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 18:37:22.057671 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 18:37:22.057671 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 18:37:22.057671 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 18:37:22.057671 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 18:37:22.057671 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: 4fa31ed92017490a82497c7b8910aef0 Oct 04 18:37:22.057671 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-ImagesTestJSON-306433374 Oct 04 18:37:22.057671 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 18:37:22.057671 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 18:37:22.057671 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/4fa31ed92017490a82497c7b8910aef0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_4fa31ed92017490a82497c7b8910aef0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4fa31ed92017490a82497c7b8910aef0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4fa31ed92017490a82497c7b8910aef0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:37:22.057671 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-ImagesTestJSON-306433374 Oct 04 18:37:22.057671 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: 4fa31ed92017490a82497c7b8910aef0 Oct 04 18:37:22.057671 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-ImagesTestJSON-306433374 Oct 04 18:37:22.057671 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-ImagesTestJSON-306433374-project Oct 04 18:37:22.057671 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 18:37:22.057671 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 18:37:22.057671 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: 5a41ab6fb78a42ceaca621c5a38ffc6d Oct 04 18:37:22.057671 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-ImagesTestJSON-306433374-project Oct 04 18:37:22.057671 n-d-851028-13 devstack@n-api.service[123595]: method: Oct 04 18:37:22.057671 n-d-851028-13 devstack@n-api.service[123595]: exception: Image not found. Oct 04 18:37:22.057671 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': '55efa976-ae7c-4644-8cf0-09c64d94a4c9'} Oct 04 18:37:22.057671 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:37:22.057671 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:22.057671 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 18:37:22.057671 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 18:37:22.057671 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 18:37:22.057671 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 18:37:22.057671 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 18:37:22.057671 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 18:37:22.057671 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 18:37:22.057671 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 18:37:22.057671 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 18:37:22.057671 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 18:37:22.057671 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 18:37:22.057671 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 18:37:22.057671 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 18:37:22.057671 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 18:37:22.057671 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 18:37:22.057671 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 18:37:22.057671 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 55efa976-ae7c-4644-8cf0-09c64d94a4c9 Oct 04 18:37:22.057671 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:37:22.057671 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:37:22.057671 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:37:22.057671 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:22.057671 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 04 18:37:22.057671 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 04 18:37:22.057671 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 04 18:37:22.057671 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 04 18:37:22.057671 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 04 18:37:22.057671 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 04 18:37:22.057671 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 04 18:37:22.057671 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 04 18:37:22.062411 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 18:37:22.062411 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 18:37:22.062411 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 18:37:22.062411 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 18:37:22.062411 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 18:37:22.062411 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 18:37:22.062411 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 18:37:22.062411 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 18:37:22.062411 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 18:37:22.062411 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 18:37:22.062411 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 18:37:22.062411 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 18:37:22.062411 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 18:37:22.062411 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 18:37:22.062411 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 18:37:22.062411 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 18:37:22.062411 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 55efa976-ae7c-4644-8cf0-09c64d94a4c9 could not be found. Oct 04 18:37:22.062411 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:37:22.062411 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:37:22.062411 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:37:22.062411 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:22.062411 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:37:22.062411 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:37:22.062411 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:37:22.062411 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:37:22.062411 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:37:22.062411 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:37:22.062411 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:37:22.062411 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:37:22.062411 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 04 18:37:22.062411 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 18:37:22.062411 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 18:37:22.062411 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:37:22.062411 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:37:22.062411 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:37:22.062411 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:22.062411 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:37:22.062411 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:37:22.062411 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:37:22.062411 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:37:22.062411 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 18:37:22.062411 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:37:22.068615 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-93bb6628-d704-4b4b-8ca5-a9244248b4c1 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Returning 404 to user: Image not found. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:37:22.070297 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-93bb6628-d704-4b4b-8ca5-a9244248b4c1 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] 10.222.0.43 "GET /compute/v2.1/images/55efa976-ae7c-4644-8cf0-09c64d94a4c9" status: 404 len: 62 microversion: 2.1 time: 0.085135 Oct 04 18:37:22.075166 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 743/1628] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 18:37:21 2022] GET /compute/v2.1/images/55efa976-ae7c-4644-8cf0-09c64d94a4c9 => generated 62 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:37:22.094024 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-2a1a5d9b-5c45-42ca-a6d6-feea404e7564 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:22.095657 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-2a1a5d9b-5c45-42ca-a6d6-feea404e7564 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] [instance: 64228016-ae20-4fcb-87da-c3d4d585e241] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:22.112602 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2a1a5d9b-5c45-42ca-a6d6-feea404e7564 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:22.113128 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2a1a5d9b-5c45-42ca-a6d6-feea404e7564 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:22.117927 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2a1a5d9b-5c45-42ca-a6d6-feea404e7564 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:22.118690 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2a1a5d9b-5c45-42ca-a6d6-feea404e7564 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:22.126028 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2a1a5d9b-5c45-42ca-a6d6-feea404e7564 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:22.126663 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2a1a5d9b-5c45-42ca-a6d6-feea404e7564 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:22.422381 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-498bf18e-aefc-4a9a-8b28-dc5c75ca8502 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa193aff0474ae3ba5d1aa7b0d0e8c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a06b8feba3404490a448aa2d4fb106b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:22.439885 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-498bf18e-aefc-4a9a-8b28-dc5c75ca8502 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] 10.222.0.43 "GET /compute/v2.1/servers/86743a21-e24e-4001-b3da-48615f6e281e" status: 200 len: 1322 microversion: 2.1 time: 0.519267 Oct 04 18:37:22.442566 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 886/1629] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:21 2022] GET /compute/v2.1/servers/86743a21-e24e-4001-b3da-48615f6e281e => generated 1322 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:22.455511 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-99a4d476-3185-40c9-9a99-cc962dd9e1b8 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:22.457885 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-99a4d476-3185-40c9-9a99-cc962dd9e1b8 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] [instance: 7222a4ce-d2a2-4b09-afc6-55bca52414d4] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:22.473931 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-99a4d476-3185-40c9-9a99-cc962dd9e1b8 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:22.477520 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-99a4d476-3185-40c9-9a99-cc962dd9e1b8 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:22.478285 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-99a4d476-3185-40c9-9a99-cc962dd9e1b8 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:22.492447 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-99a4d476-3185-40c9-9a99-cc962dd9e1b8 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:22.493463 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-99a4d476-3185-40c9-9a99-cc962dd9e1b8 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:22.494394 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-99a4d476-3185-40c9-9a99-cc962dd9e1b8 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:22.900327 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-99a4d476-3185-40c9-9a99-cc962dd9e1b8 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:22.929659 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-99a4d476-3185-40c9-9a99-cc962dd9e1b8 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:22.931590 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-99a4d476-3185-40c9-9a99-cc962dd9e1b8 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:22.938264 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-99a4d476-3185-40c9-9a99-cc962dd9e1b8 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] 10.222.0.43 "GET /compute/v2.1/servers/7222a4ce-d2a2-4b09-afc6-55bca52414d4" status: 200 len: 1815 microversion: 2.25 time: 0.491675 Oct 04 18:37:22.942153 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 887/1630] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:37:22 2022] GET /compute/v2.1/servers/7222a4ce-d2a2-4b09-afc6-55bca52414d4 => generated 1815 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:37:22.963542 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-d793068c-05c2-4b21-9dfa-61acb32e2924 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Calling method '.version_select at 0x7fb21fb53160>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:23.007533 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-2a1a5d9b-5c45-42ca-a6d6-feea404e7564 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a41ab6fb78a42ceaca621c5a38ffc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa31ed92017490a82497c7b8910aef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:23.022493 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-2a1a5d9b-5c45-42ca-a6d6-feea404e7564 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] 10.222.0.43 "GET /compute/v2.1/servers/64228016-ae20-4fcb-87da-c3d4d585e241" status: 200 len: 1500 microversion: 2.1 time: 0.945939 Oct 04 18:37:23.026015 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 744/1631] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:22 2022] GET /compute/v2.1/servers/64228016-ae20-4fcb-87da-c3d4d585e241 => generated 1500 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:23.050902 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-2d6b3983-de50-4c37-b98e-d99f582cfa71 tempest-FlavorsV2NegativeTest-3327453 tempest-FlavorsV2NegativeTest-3327453-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-678177953", "imageRef": "d74dc23b-3795-4aef-8f2c-c25e1f4bf9db", "flavorRef": "452"}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:37:23.072857 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-d793068c-05c2-4b21-9dfa-61acb32e2924 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] 10.222.0.43 "GET /compute/v2.1/images/d7825145-299c-45b6-9fe8-780722b2d243" status: 200 len: 1428 microversion: 2.1 time: 0.128788 Oct 04 18:37:23.074462 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 888/1632] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 18:37:22 2022] GET /compute/v2.1/images/d7825145-299c-45b6-9fe8-780722b2d243 => generated 1428 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:23.079572 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-e791e084-e549-41cb-9105-f4803f82fe02 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:23.080421 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-e791e084-e549-41cb-9105-f4803f82fe02 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: d85af512-1b1f-42a4-9bb1-963cc956c9ae] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:23.124906 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e791e084-e549-41cb-9105-f4803f82fe02 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:23.128105 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e791e084-e549-41cb-9105-f4803f82fe02 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:23.128593 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e791e084-e549-41cb-9105-f4803f82fe02 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:23.129386 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e791e084-e549-41cb-9105-f4803f82fe02 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:23.129883 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e791e084-e549-41cb-9105-f4803f82fe02 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:23.136972 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e791e084-e549-41cb-9105-f4803f82fe02 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:23.163019 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.network.neutron [None req-2d6b3983-de50-4c37-b98e-d99f582cfa71 tempest-FlavorsV2NegativeTest-3327453 tempest-FlavorsV2NegativeTest-3327453-project] validate_networks() for None {{(pid=123595) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:37:23.355641 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-e791e084-e549-41cb-9105-f4803f82fe02 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:23.373302 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-e791e084-e549-41cb-9105-f4803f82fe02 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/d85af512-1b1f-42a4-9bb1-963cc956c9ae" status: 200 len: 1270 microversion: 2.1 time: 0.296228 Oct 04 18:37:23.374256 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 889/1633] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:23 2022] GET /compute/v2.1/servers/d85af512-1b1f-42a4-9bb1-963cc956c9ae => generated 1270 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:23.470743 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-ac55c6f3-4675-45de-9f03-510d9bb8456a tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:23.472180 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-ac55c6f3-4675-45de-9f03-510d9bb8456a tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] [instance: 86743a21-e24e-4001-b3da-48615f6e281e] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:23.484914 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ac55c6f3-4675-45de-9f03-510d9bb8456a tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:23.485849 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ac55c6f3-4675-45de-9f03-510d9bb8456a tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:23.486318 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ac55c6f3-4675-45de-9f03-510d9bb8456a tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:23.487440 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ac55c6f3-4675-45de-9f03-510d9bb8456a tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:23.488095 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ac55c6f3-4675-45de-9f03-510d9bb8456a tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:23.488703 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ac55c6f3-4675-45de-9f03-510d9bb8456a tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:23.712288 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-ac55c6f3-4675-45de-9f03-510d9bb8456a tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa193aff0474ae3ba5d1aa7b0d0e8c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a06b8feba3404490a448aa2d4fb106b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:23.722726 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-ac55c6f3-4675-45de-9f03-510d9bb8456a tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] 10.222.0.43 "GET /compute/v2.1/servers/86743a21-e24e-4001-b3da-48615f6e281e" status: 200 len: 1322 microversion: 2.1 time: 0.259449 Oct 04 18:37:23.723667 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 890/1634] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:23 2022] GET /compute/v2.1/servers/86743a21-e24e-4001-b3da-48615f6e281e => generated 1322 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:37:23.791580 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-bc5db785-2ace-483c-8444-b35671d8a611 tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-1051010067", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452", "networks": [{"uuid": "075ab615-1724-4748-809f-3c0c6d2c7fb1"}]}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:37:23.847185 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.network.neutron [None req-bc5db785-2ace-483c-8444-b35671d8a611 tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] validate_networks() for [('075ab615-1724-4748-809f-3c0c6d2c7fb1', None, None, None, None, None)] {{(pid=123596) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:37:24.152008 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-2d6b3983-de50-4c37-b98e-d99f582cfa71 tempest-FlavorsV2NegativeTest-3327453 tempest-FlavorsV2NegativeTest-3327453-project] HTTP exception thrown: Flavor's memory is too small for requested image. Oct 04 18:37:24.155225 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-2d6b3983-de50-4c37-b98e-d99f582cfa71 tempest-FlavorsV2NegativeTest-3327453 tempest-FlavorsV2NegativeTest-3327453-project] Request method failure captured: Oct 04 18:37:24.155225 n-d-851028-13 devstack@n-api.service[123595]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 18:37:24.155225 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 18:37:24.155225 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 18:37:24.155225 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 18:37:24.155225 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 142 Oct 04 18:37:24.155225 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 18:37:24.155225 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 18:37:24.155225 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 18:37:24.155225 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 18:37:24.155225 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPH1fp37fNiqBTQAdd0ThjF0qYszuCHcI4R3nlkHFQblyDaRpjDPXLC86wGET6muvcP4kolGcUDbghp72fyT3e1a9FxFKtpQEOyg0miezZ20dJSFcXVvL0dme5B9_YdR-dKRx9I8nArz2OkFozTgdc0kno3vZJqY0s9mU6_AKsWiG0V0 Oct 04 18:37:24.155225 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 18:37:24.155225 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 18:37:24.155225 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 18:37:24.155225 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 18:37:24.155225 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 18:37:24.155225 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 18:37:24.155225 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: a3b57804bcca4c07955f7a8ea34c3c13 Oct 04 18:37:24.155225 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-FlavorsV2NegativeTest-3327453 Oct 04 18:37:24.155225 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 18:37:24.155225 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 18:37:24.155225 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/a3b57804bcca4c07955f7a8ea34c3c13"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_a3b57804bcca4c07955f7a8ea34c3c13"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a3b57804bcca4c07955f7a8ea34c3c13"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a3b57804bcca4c07955f7a8ea34c3c13"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:37:24.155225 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-FlavorsV2NegativeTest-3327453 Oct 04 18:37:24.155225 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: a3b57804bcca4c07955f7a8ea34c3c13 Oct 04 18:37:24.155225 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-FlavorsV2NegativeTest-3327453 Oct 04 18:37:24.155225 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-FlavorsV2NegativeTest-3327453-project Oct 04 18:37:24.155225 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 18:37:24.155225 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 18:37:24.155225 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: b1503bc18edc44bcab58e07594cd81b9 Oct 04 18:37:24.155225 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-FlavorsV2NegativeTest-3327453-project Oct 04 18:37:24.155225 n-d-851028-13 devstack@n-api.service[123595]: Oct 04 18:37:24.155225 n-d-851028-13 devstack@n-api.service[123595]: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-678177953", "imageRef": "d74dc23b-3795-4aef-8f2c-c25e1f4bf9db", "flavorRef": "452"}} Oct 04 18:37:24.155225 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 18:37:24.155225 n-d-851028-13 devstack@n-api.service[123595]: exception: Flavor's memory is too small for requested image. Oct 04 18:37:24.155225 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'body': {'server': {'name': 'tempest-FlavorsV2NegativeTest-server-678177953', 'imageRef': 'd74dc23b-3795-4aef-8f2c-c25e1f4bf9db', 'flavorRef': '452'}}} Oct 04 18:37:24.155225 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:37:24.155225 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:24.155225 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 18:37:24.155225 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 18:37:24.155225 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 18:37:24.155225 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 18:37:24.155225 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Oct 04 18:37:24.155225 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Oct 04 18:37:24.155225 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1019, in _checks_for_create_and_rebuild Oct 04 18:37:24.155225 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi self._validate_flavor_image(context, image_id, image, Oct 04 18:37:24.155225 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 683, in _validate_flavor_image Oct 04 18:37:24.155225 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi self._validate_flavor_image_nostatus( Oct 04 18:37:24.155225 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 751, in _validate_flavor_image_nostatus Oct 04 18:37:24.155225 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.FlavorMemoryTooSmall() Oct 04 18:37:24.155225 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.FlavorMemoryTooSmall: Flavor's memory is too small for requested image. Oct 04 18:37:24.155225 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:37:24.155225 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:37:24.155225 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:37:24.155225 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:24.155225 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:37:24.155225 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:37:24.155225 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:37:24.155225 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:37:24.155225 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:37:24.155225 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:37:24.155225 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:37:24.155225 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:37:24.155225 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:37:24.155225 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:37:24.160263 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:37:24.160263 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:37:24.160263 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 18:37:24.160263 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create Oct 04 18:37:24.160263 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 04 18:37:24.160263 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor's memory is too small for requested image. Oct 04 18:37:24.160263 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:37:24.160263 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:37:24.160263 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:37:24.160263 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:24.160263 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:37:24.160263 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:37:24.160263 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:37:24.160263 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:37:24.160263 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor's memory is too small for requested image. Oct 04 18:37:24.160263 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:37:24.165027 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-2d6b3983-de50-4c37-b98e-d99f582cfa71 tempest-FlavorsV2NegativeTest-3327453 tempest-FlavorsV2NegativeTest-3327453-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:37:24.166385 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-2d6b3983-de50-4c37-b98e-d99f582cfa71 tempest-FlavorsV2NegativeTest-3327453 tempest-FlavorsV2NegativeTest-3327453-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 1.139122 Oct 04 18:37:24.167227 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 745/1635] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 18:37:23 2022] POST /compute/v2.1/servers => generated 93 bytes in 1140 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 04 18:37:24.173672 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-9466ed8b-9339-4ec0-81b2-5b9f181c67b2 req-5df8eef6-feae-4aeb-92c3-8cb425a14896 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "132f39b7-bf1b-49a8-87a3-38cd95a041de", "name": "network-vif-plugged", "status": "completed", "tag": "556f1b80-4726-4da7-bd27-966c4476c538"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:37:24.185285 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-9466ed8b-9339-4ec0-81b2-5b9f181c67b2 req-5df8eef6-feae-4aeb-92c3-8cb425a14896 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:24.185944 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-9466ed8b-9339-4ec0-81b2-5b9f181c67b2 req-5df8eef6-feae-4aeb-92c3-8cb425a14896 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:24.186483 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-9466ed8b-9339-4ec0-81b2-5b9f181c67b2 req-5df8eef6-feae-4aeb-92c3-8cb425a14896 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:24.200829 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-9466ed8b-9339-4ec0-81b2-5b9f181c67b2 req-5df8eef6-feae-4aeb-92c3-8cb425a14896 service nova] Creating event network-vif-plugged:556f1b80-4726-4da7-bd27-966c4476c538 for instance 132f39b7-bf1b-49a8-87a3-38cd95a041de on n-h2-851028-13 Oct 04 18:37:24.207295 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-9466ed8b-9339-4ec0-81b2-5b9f181c67b2 req-5df8eef6-feae-4aeb-92c3-8cb425a14896 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038363 Oct 04 18:37:24.208193 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 746/1636] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:37:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:37:24.215232 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-b32ecc94-34e0-4da6-89d3-95fe059ccedc tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:24.216229 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-b32ecc94-34e0-4da6-89d3-95fe059ccedc tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] [instance: 7222a4ce-d2a2-4b09-afc6-55bca52414d4] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:24.223339 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b32ecc94-34e0-4da6-89d3-95fe059ccedc tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:24.223823 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b32ecc94-34e0-4da6-89d3-95fe059ccedc tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:24.224580 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b32ecc94-34e0-4da6-89d3-95fe059ccedc tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:24.225965 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b32ecc94-34e0-4da6-89d3-95fe059ccedc tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:24.226605 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b32ecc94-34e0-4da6-89d3-95fe059ccedc tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:24.227260 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b32ecc94-34e0-4da6-89d3-95fe059ccedc tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:24.640222 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-bc5db785-2ace-483c-8444-b35671d8a611 tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Flavor limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:37:24.640746 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-bc5db785-2ace-483c-8444-b35671d8a611 tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Image limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:37:24.641381 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-bc5db785-2ace-483c-8444-b35671d8a611 tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Flavor pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:37:24.641907 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-bc5db785-2ace-483c-8444-b35671d8a611 tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Image pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:37:24.642426 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-bc5db785-2ace-483c-8444-b35671d8a611 tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:37:24.654013 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bc5db785-2ace-483c-8444-b35671d8a611 tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:24.654995 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bc5db785-2ace-483c-8444-b35671d8a611 tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:24.655669 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bc5db785-2ace-483c-8444-b35671d8a611 tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:24.656652 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bc5db785-2ace-483c-8444-b35671d8a611 tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:24.657953 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bc5db785-2ace-483c-8444-b35671d8a611 tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:24.658609 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bc5db785-2ace-483c-8444-b35671d8a611 tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:24.683477 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-bc5db785-2ace-483c-8444-b35671d8a611 tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Getting quotas for project 9b9d3dec7f864f42adcd6e9c20043832. Resources: {'ram', 'cores', 'instances'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:37:24.693510 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-bc5db785-2ace-483c-8444-b35671d8a611 tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Getting quotas for user de84075cb5a44e83a41516b687f07e95 and project 9b9d3dec7f864f42adcd6e9c20043832. Resources: {'ram', 'cores', 'instances'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:37:24.710746 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-bc5db785-2ace-483c-8444-b35671d8a611 tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Going to run 1 instances... {{(pid=123596) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:37:24.713889 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-bc5db785-2ace-483c-8444-b35671d8a611 tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] [instance: bea29c43-a5ab-42b3-9d5d-3b0f4f0f30f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e8943ec5-4038-4d4b-b9b9-2415a79f5243',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123596) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:37:24.807933 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-bc5db785-2ace-483c-8444-b35671d8a611 tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.082084 Oct 04 18:37:24.809131 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 891/1637] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 18:37:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 1084 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:37:24.823635 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-aa45597d-a50e-49e5-a763-51d06bb288d3 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:24.824734 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-aa45597d-a50e-49e5-a763-51d06bb288d3 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] [instance: 64228016-ae20-4fcb-87da-c3d4d585e241] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:24.835227 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-aa45597d-a50e-49e5-a763-51d06bb288d3 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:24.836061 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-aa45597d-a50e-49e5-a763-51d06bb288d3 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:24.836745 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-aa45597d-a50e-49e5-a763-51d06bb288d3 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:24.838277 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-aa45597d-a50e-49e5-a763-51d06bb288d3 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:24.839320 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-aa45597d-a50e-49e5-a763-51d06bb288d3 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:24.839977 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-aa45597d-a50e-49e5-a763-51d06bb288d3 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:24.869162 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-b32ecc94-34e0-4da6-89d3-95fe059ccedc tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:24.894754 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-b32ecc94-34e0-4da6-89d3-95fe059ccedc tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:24.899410 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-b32ecc94-34e0-4da6-89d3-95fe059ccedc tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:24.905489 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-b32ecc94-34e0-4da6-89d3-95fe059ccedc tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] 10.222.0.43 "GET /compute/v2.1/servers/7222a4ce-d2a2-4b09-afc6-55bca52414d4" status: 200 len: 1815 microversion: 2.25 time: 0.692870 Oct 04 18:37:24.906756 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 747/1638] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:37:24 2022] GET /compute/v2.1/servers/7222a4ce-d2a2-4b09-afc6-55bca52414d4 => generated 1815 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:37:24.918064 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-f131a6df-c79c-4733-89fa-9d54dadbf992 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Calling method '.version_select at 0x7fb21f7b8ca0>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:25.012166 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-f131a6df-c79c-4733-89fa-9d54dadbf992 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] 10.222.0.43 "GET /compute/v2.1/images/d7825145-299c-45b6-9fe8-780722b2d243" status: 200 len: 1428 microversion: 2.1 time: 0.101991 Oct 04 18:37:25.023753 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 748/1639] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 18:37:24 2022] GET /compute/v2.1/images/d7825145-299c-45b6-9fe8-780722b2d243 => generated 1428 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:25.031462 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-2ab25bc0-5c53-4419-89ac-db180494f9c9 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:25.034569 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-2ab25bc0-5c53-4419-89ac-db180494f9c9 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: d85af512-1b1f-42a4-9bb1-963cc956c9ae] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:25.076190 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2ab25bc0-5c53-4419-89ac-db180494f9c9 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:25.076707 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2ab25bc0-5c53-4419-89ac-db180494f9c9 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:25.077196 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2ab25bc0-5c53-4419-89ac-db180494f9c9 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:25.078046 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2ab25bc0-5c53-4419-89ac-db180494f9c9 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:25.078705 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2ab25bc0-5c53-4419-89ac-db180494f9c9 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:25.079336 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2ab25bc0-5c53-4419-89ac-db180494f9c9 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:25.487354 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-aa45597d-a50e-49e5-a763-51d06bb288d3 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a41ab6fb78a42ceaca621c5a38ffc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa31ed92017490a82497c7b8910aef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:25.512377 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-aa45597d-a50e-49e5-a763-51d06bb288d3 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] 10.222.0.43 "GET /compute/v2.1/servers/64228016-ae20-4fcb-87da-c3d4d585e241" status: 200 len: 1506 microversion: 2.1 time: 0.701456 Oct 04 18:37:25.514114 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 892/1640] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:24 2022] GET /compute/v2.1/servers/64228016-ae20-4fcb-87da-c3d4d585e241 => generated 1506 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:25.521982 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-cd774a59-eb8e-40d3-8294-077772775381 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:25.522998 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-cd774a59-eb8e-40d3-8294-077772775381 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] [instance: 86743a21-e24e-4001-b3da-48615f6e281e] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:25.540344 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cd774a59-eb8e-40d3-8294-077772775381 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:25.541511 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cd774a59-eb8e-40d3-8294-077772775381 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:25.543882 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cd774a59-eb8e-40d3-8294-077772775381 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:25.545620 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cd774a59-eb8e-40d3-8294-077772775381 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:25.547132 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cd774a59-eb8e-40d3-8294-077772775381 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:25.548182 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cd774a59-eb8e-40d3-8294-077772775381 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:25.570824 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-2ab25bc0-5c53-4419-89ac-db180494f9c9 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:25.581100 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-2ab25bc0-5c53-4419-89ac-db180494f9c9 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/d85af512-1b1f-42a4-9bb1-963cc956c9ae" status: 200 len: 1312 microversion: 2.1 time: 0.555946 Oct 04 18:37:25.585606 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 749/1641] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:25 2022] GET /compute/v2.1/servers/d85af512-1b1f-42a4-9bb1-963cc956c9ae => generated 1312 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:25.591203 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-c0d09bba-7f54-4aad-95ed-7696a279cd1b tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:25.591999 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-c0d09bba-7f54-4aad-95ed-7696a279cd1b tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] [instance: bea29c43-a5ab-42b3-9d5d-3b0f4f0f30f3] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:25.860832 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-cd774a59-eb8e-40d3-8294-077772775381 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa193aff0474ae3ba5d1aa7b0d0e8c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a06b8feba3404490a448aa2d4fb106b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:25.875403 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-cd774a59-eb8e-40d3-8294-077772775381 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] 10.222.0.43 "GET /compute/v2.1/servers/86743a21-e24e-4001-b3da-48615f6e281e" status: 200 len: 1322 microversion: 2.1 time: 0.357746 Oct 04 18:37:25.876652 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 893/1642] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:25 2022] GET /compute/v2.1/servers/86743a21-e24e-4001-b3da-48615f6e281e => generated 1322 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:25.892959 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-c0d09bba-7f54-4aad-95ed-7696a279cd1b tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de84075cb5a44e83a41516b687f07e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9d3dec7f864f42adcd6e9c20043832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:25.908066 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-c0d09bba-7f54-4aad-95ed-7696a279cd1b tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] 10.222.0.43 "GET /compute/v2.1/servers/bea29c43-a5ab-42b3-9d5d-3b0f4f0f30f3" status: 200 len: 1216 microversion: 2.1 time: 0.321217 Oct 04 18:37:25.918846 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 750/1643] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:25 2022] GET /compute/v2.1/servers/bea29c43-a5ab-42b3-9d5d-3b0f4f0f30f3 => generated 1216 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:25.938824 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-6b274d1b-68ea-4840-a9b3-c7749bbab36c tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:25.940138 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-6b274d1b-68ea-4840-a9b3-c7749bbab36c tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] [instance: 7222a4ce-d2a2-4b09-afc6-55bca52414d4] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:25.950143 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6b274d1b-68ea-4840-a9b3-c7749bbab36c tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:25.951266 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6b274d1b-68ea-4840-a9b3-c7749bbab36c tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:25.952114 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6b274d1b-68ea-4840-a9b3-c7749bbab36c tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:25.954259 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6b274d1b-68ea-4840-a9b3-c7749bbab36c tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:25.955053 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6b274d1b-68ea-4840-a9b3-c7749bbab36c tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:25.955755 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6b274d1b-68ea-4840-a9b3-c7749bbab36c tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:26.035484 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-33f35bd4-e35c-40f0-82d9-307339a08e55 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Calling method '.version_select at 0x7fb21f7f83a0>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:26.133055 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-33f35bd4-e35c-40f0-82d9-307339a08e55 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] 10.222.0.43 "GET /compute/v2.1/images/d7825145-299c-45b6-9fe8-780722b2d243" status: 200 len: 1428 microversion: 2.1 time: 0.102778 Oct 04 18:37:26.136402 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 751/1644] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 18:37:26 2022] GET /compute/v2.1/images/d7825145-299c-45b6-9fe8-780722b2d243 => generated 1428 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:37:26.377553 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-6b274d1b-68ea-4840-a9b3-c7749bbab36c tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:26.388900 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-6b274d1b-68ea-4840-a9b3-c7749bbab36c tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:26.394022 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-6b274d1b-68ea-4840-a9b3-c7749bbab36c tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:26.399904 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-6b274d1b-68ea-4840-a9b3-c7749bbab36c tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] 10.222.0.43 "GET /compute/v2.1/servers/7222a4ce-d2a2-4b09-afc6-55bca52414d4" status: 200 len: 1815 microversion: 2.25 time: 0.466737 Oct 04 18:37:26.403333 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 894/1645] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:37:25 2022] GET /compute/v2.1/servers/7222a4ce-d2a2-4b09-afc6-55bca52414d4 => generated 1815 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:37:26.544552 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-846a7ef3-9eb0-4a6d-985a-6d28abdc54b7 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:26.545757 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-846a7ef3-9eb0-4a6d-985a-6d28abdc54b7 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] [instance: 64228016-ae20-4fcb-87da-c3d4d585e241] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:26.557387 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_api:INSERT=11,nova_api:SELECT=87,nova_api:DELETE=1 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:37:26.561397 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-846a7ef3-9eb0-4a6d-985a-6d28abdc54b7 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:26.565916 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-846a7ef3-9eb0-4a6d-985a-6d28abdc54b7 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:26.566721 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-846a7ef3-9eb0-4a6d-985a-6d28abdc54b7 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:26.567993 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-846a7ef3-9eb0-4a6d-985a-6d28abdc54b7 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:26.570757 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-846a7ef3-9eb0-4a6d-985a-6d28abdc54b7 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:26.571328 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-846a7ef3-9eb0-4a6d-985a-6d28abdc54b7 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:26.612419 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-1ff56938-fe1e-4ccb-98bb-80f14ae5b022 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:26.613635 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-1ff56938-fe1e-4ccb-98bb-80f14ae5b022 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: d85af512-1b1f-42a4-9bb1-963cc956c9ae] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:26.631010 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1ff56938-fe1e-4ccb-98bb-80f14ae5b022 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:26.631514 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1ff56938-fe1e-4ccb-98bb-80f14ae5b022 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:26.639435 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1ff56938-fe1e-4ccb-98bb-80f14ae5b022 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:26.640575 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1ff56938-fe1e-4ccb-98bb-80f14ae5b022 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:26.643345 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1ff56938-fe1e-4ccb-98bb-80f14ae5b022 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:26.643987 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1ff56938-fe1e-4ccb-98bb-80f14ae5b022 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:27.248779 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-846a7ef3-9eb0-4a6d-985a-6d28abdc54b7 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a41ab6fb78a42ceaca621c5a38ffc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa31ed92017490a82497c7b8910aef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:27.261037 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-846a7ef3-9eb0-4a6d-985a-6d28abdc54b7 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] 10.222.0.43 "GET /compute/v2.1/servers/64228016-ae20-4fcb-87da-c3d4d585e241" status: 200 len: 1488 microversion: 2.1 time: 0.721915 Oct 04 18:37:27.262401 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 752/1646] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:26 2022] GET /compute/v2.1/servers/64228016-ae20-4fcb-87da-c3d4d585e241 => generated 1488 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:27.277384 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-7d1e04ac-ac8f-4bf1-ac02-85f89ee9dfac req-1a9c9b52-15ab-403d-b8d1-40615ffc3a39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86743a21-e24e-4001-b3da-48615f6e281e", "name": "network-vif-plugged", "status": "completed", "tag": "36be2d21-a2ff-4ccd-8c37-dfd2f4b90d0c"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:37:27.321076 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-7d1e04ac-ac8f-4bf1-ac02-85f89ee9dfac req-1a9c9b52-15ab-403d-b8d1-40615ffc3a39 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:27.321783 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-7d1e04ac-ac8f-4bf1-ac02-85f89ee9dfac req-1a9c9b52-15ab-403d-b8d1-40615ffc3a39 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:27.322240 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-7d1e04ac-ac8f-4bf1-ac02-85f89ee9dfac req-1a9c9b52-15ab-403d-b8d1-40615ffc3a39 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:27.365088 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-7d1e04ac-ac8f-4bf1-ac02-85f89ee9dfac req-1a9c9b52-15ab-403d-b8d1-40615ffc3a39 service nova] Creating event network-vif-plugged:36be2d21-a2ff-4ccd-8c37-dfd2f4b90d0c for instance 86743a21-e24e-4001-b3da-48615f6e281e on n-h1-851028-13 Oct 04 18:37:27.384452 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-7d1e04ac-ac8f-4bf1-ac02-85f89ee9dfac req-1a9c9b52-15ab-403d-b8d1-40615ffc3a39 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120368 Oct 04 18:37:27.388251 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 753/1647] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:37:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:37:27.395137 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-1ff56938-fe1e-4ccb-98bb-80f14ae5b022 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:27.403801 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-a33e40ea-88af-40f6-9bf0-8c852f8f1ad0 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:27.405962 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-a33e40ea-88af-40f6-9bf0-8c852f8f1ad0 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] [instance: 86743a21-e24e-4001-b3da-48615f6e281e] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:27.411537 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-1ff56938-fe1e-4ccb-98bb-80f14ae5b022 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/d85af512-1b1f-42a4-9bb1-963cc956c9ae" status: 200 len: 1312 microversion: 2.1 time: 0.805635 Oct 04 18:37:27.415376 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 895/1648] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:26 2022] GET /compute/v2.1/servers/d85af512-1b1f-42a4-9bb1-963cc956c9ae => generated 1312 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:37:27.430142 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a33e40ea-88af-40f6-9bf0-8c852f8f1ad0 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:27.431749 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-8e448108-b342-4b1c-bfc0-e8b2ebe69564 tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:27.433353 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a33e40ea-88af-40f6-9bf0-8c852f8f1ad0 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:27.434117 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a33e40ea-88af-40f6-9bf0-8c852f8f1ad0 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:27.435686 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a33e40ea-88af-40f6-9bf0-8c852f8f1ad0 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:27.436345 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a33e40ea-88af-40f6-9bf0-8c852f8f1ad0 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:27.437731 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a33e40ea-88af-40f6-9bf0-8c852f8f1ad0 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:27.440055 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-8e448108-b342-4b1c-bfc0-e8b2ebe69564 tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] [instance: bea29c43-a5ab-42b3-9d5d-3b0f4f0f30f3] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:27.467184 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8e448108-b342-4b1c-bfc0-e8b2ebe69564 tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:27.468967 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8e448108-b342-4b1c-bfc0-e8b2ebe69564 tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:27.471788 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8e448108-b342-4b1c-bfc0-e8b2ebe69564 tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:27.483611 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8e448108-b342-4b1c-bfc0-e8b2ebe69564 tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:27.484563 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8e448108-b342-4b1c-bfc0-e8b2ebe69564 tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:27.485342 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8e448108-b342-4b1c-bfc0-e8b2ebe69564 tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:28.125247 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-a33e40ea-88af-40f6-9bf0-8c852f8f1ad0 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa193aff0474ae3ba5d1aa7b0d0e8c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a06b8feba3404490a448aa2d4fb106b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:28.140174 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-a33e40ea-88af-40f6-9bf0-8c852f8f1ad0 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] 10.222.0.43 "GET /compute/v2.1/servers/86743a21-e24e-4001-b3da-48615f6e281e" status: 200 len: 1322 microversion: 2.1 time: 0.750529 Oct 04 18:37:28.140720 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 754/1649] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:27 2022] GET /compute/v2.1/servers/86743a21-e24e-4001-b3da-48615f6e281e => generated 1322 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:28.156061 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-0806a5b3-9117-4162-a369-3b9995a2e5b1 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Calling method '.version_select at 0x7fb21faa68b0>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:28.273769 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-0806a5b3-9117-4162-a369-3b9995a2e5b1 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] 10.222.0.43 "GET /compute/v2.1/images/d7825145-299c-45b6-9fe8-780722b2d243" status: 200 len: 1428 microversion: 2.1 time: 0.129245 Oct 04 18:37:28.284453 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 755/1650] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 18:37:28 2022] GET /compute/v2.1/images/d7825145-299c-45b6-9fe8-780722b2d243 => generated 1428 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:28.298217 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-39571ce7-e9d5-4c3f-a9b8-9f131c1ba72b tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:28.300409 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-39571ce7-e9d5-4c3f-a9b8-9f131c1ba72b tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] [instance: 64228016-ae20-4fcb-87da-c3d4d585e241] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:28.323245 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-39571ce7-e9d5-4c3f-a9b8-9f131c1ba72b tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:28.323800 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-39571ce7-e9d5-4c3f-a9b8-9f131c1ba72b tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:28.327058 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-39571ce7-e9d5-4c3f-a9b8-9f131c1ba72b tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:28.332317 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-39571ce7-e9d5-4c3f-a9b8-9f131c1ba72b tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:28.333698 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-39571ce7-e9d5-4c3f-a9b8-9f131c1ba72b tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:28.334336 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-39571ce7-e9d5-4c3f-a9b8-9f131c1ba72b tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:28.406386 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-39571ce7-e9d5-4c3f-a9b8-9f131c1ba72b tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] [instance: 64228016-ae20-4fcb-87da-c3d4d585e241] Going to try to terminate instance {{(pid=123595) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:37:28.628269 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-39571ce7-e9d5-4c3f-a9b8-9f131c1ba72b tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] 10.222.0.43 "DELETE /compute/v2.1/servers/64228016-ae20-4fcb-87da-c3d4d585e241" status: 204 len: 0 microversion: 2.1 time: 0.342209 Oct 04 18:37:28.636597 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 756/1651] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 18:37:28 2022] DELETE /compute/v2.1/servers/64228016-ae20-4fcb-87da-c3d4d585e241 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:37:28.658112 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-c9ec1d70-381f-4437-a0a0-1ea18e7e397a tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:28.660312 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-c9ec1d70-381f-4437-a0a0-1ea18e7e397a tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] [instance: 7222a4ce-d2a2-4b09-afc6-55bca52414d4] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:28.679130 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c9ec1d70-381f-4437-a0a0-1ea18e7e397a tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:28.682997 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c9ec1d70-381f-4437-a0a0-1ea18e7e397a tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:28.685570 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c9ec1d70-381f-4437-a0a0-1ea18e7e397a tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:28.688044 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c9ec1d70-381f-4437-a0a0-1ea18e7e397a tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:28.689379 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c9ec1d70-381f-4437-a0a0-1ea18e7e397a tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:28.691571 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c9ec1d70-381f-4437-a0a0-1ea18e7e397a tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:28.710171 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-8e448108-b342-4b1c-bfc0-e8b2ebe69564 tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de84075cb5a44e83a41516b687f07e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9d3dec7f864f42adcd6e9c20043832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:28.728689 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-8e448108-b342-4b1c-bfc0-e8b2ebe69564 tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] 10.222.0.43 "GET /compute/v2.1/servers/bea29c43-a5ab-42b3-9d5d-3b0f4f0f30f3" status: 200 len: 1276 microversion: 2.1 time: 1.309153 Oct 04 18:37:28.731960 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 896/1652] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:27 2022] GET /compute/v2.1/servers/bea29c43-a5ab-42b3-9d5d-3b0f4f0f30f3 => generated 1276 bytes in 1316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:28.766675 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-53f1f72e-f8a8-43cc-a62b-a4f7bdf2431d req-88b703d3-4e99-41d6-b105-848bd7662c44 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d85af512-1b1f-42a4-9bb1-963cc956c9ae", "tag": "002dee45-b64c-4706-ab5c-1e8e34d83258"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:37:28.809210 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=2 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:37:28.825846 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-53f1f72e-f8a8-43cc-a62b-a4f7bdf2431d req-88b703d3-4e99-41d6-b105-848bd7662c44 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:28.827579 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-53f1f72e-f8a8-43cc-a62b-a4f7bdf2431d req-88b703d3-4e99-41d6-b105-848bd7662c44 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:28.828948 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-53f1f72e-f8a8-43cc-a62b-a4f7bdf2431d req-88b703d3-4e99-41d6-b105-848bd7662c44 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:28.868221 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-53f1f72e-f8a8-43cc-a62b-a4f7bdf2431d req-88b703d3-4e99-41d6-b105-848bd7662c44 service nova] Creating event network-changed:002dee45-b64c-4706-ab5c-1e8e34d83258 for instance d85af512-1b1f-42a4-9bb1-963cc956c9ae on n-h2-851028-13 Oct 04 18:37:28.884865 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-53f1f72e-f8a8-43cc-a62b-a4f7bdf2431d req-88b703d3-4e99-41d6-b105-848bd7662c44 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.148955 Oct 04 18:37:28.885831 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 897/1653] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:37:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:37:28.893690 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-80a650aa-0cff-45a5-b3a3-eb835e3171a2 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:28.899375 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-80a650aa-0cff-45a5-b3a3-eb835e3171a2 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: d85af512-1b1f-42a4-9bb1-963cc956c9ae] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:28.914777 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-80a650aa-0cff-45a5-b3a3-eb835e3171a2 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:28.919942 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-80a650aa-0cff-45a5-b3a3-eb835e3171a2 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:28.920417 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-80a650aa-0cff-45a5-b3a3-eb835e3171a2 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:28.921206 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-80a650aa-0cff-45a5-b3a3-eb835e3171a2 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:28.921686 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-80a650aa-0cff-45a5-b3a3-eb835e3171a2 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:28.922138 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-80a650aa-0cff-45a5-b3a3-eb835e3171a2 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:29.199165 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-80a650aa-0cff-45a5-b3a3-eb835e3171a2 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:29.208151 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-80a650aa-0cff-45a5-b3a3-eb835e3171a2 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/d85af512-1b1f-42a4-9bb1-963cc956c9ae" status: 200 len: 1312 microversion: 2.1 time: 0.318978 Oct 04 18:37:29.212585 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 898/1654] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:28 2022] GET /compute/v2.1/servers/d85af512-1b1f-42a4-9bb1-963cc956c9ae => generated 1312 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:29.391653 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-c9ec1d70-381f-4437-a0a0-1ea18e7e397a tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:29.407339 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-c9ec1d70-381f-4437-a0a0-1ea18e7e397a tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:29.414819 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-c9ec1d70-381f-4437-a0a0-1ea18e7e397a tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:29.424977 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-c9ec1d70-381f-4437-a0a0-1ea18e7e397a tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] 10.222.0.43 "GET /compute/v2.1/servers/7222a4ce-d2a2-4b09-afc6-55bca52414d4" status: 200 len: 1815 microversion: 2.25 time: 0.781550 Oct 04 18:37:29.429315 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 757/1655] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:37:28 2022] GET /compute/v2.1/servers/7222a4ce-d2a2-4b09-afc6-55bca52414d4 => generated 1815 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:37:29.438187 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-ed3ad3ca-f3fb-430d-a6a8-0b3c7693a71e tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Calling method '.version_select at 0x7fb21fbeef70>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:29.462824 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-6774e898-5c68-45a1-a970-037a3c318745 tempest-ListImagesTestJSON-514053004 tempest-ListImagesTestJSON-514053004-project] Calling method '.version_select at 0x7fb224556040>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:29.542397 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-ed3ad3ca-f3fb-430d-a6a8-0b3c7693a71e tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] HTTP exception thrown: Image not found. Oct 04 18:37:29.545631 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-ed3ad3ca-f3fb-430d-a6a8-0b3c7693a71e tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Request method failure captured: Oct 04 18:37:29.545631 n-d-851028-13 devstack@n-api.service[123595]: request: DELETE /compute/v2.1/images/55efa976-ae7c-4644-8cf0-09c64d94a4c9 HTTP/1.1 Oct 04 18:37:29.545631 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 18:37:29.545631 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 18:37:29.545631 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 18:37:29.545631 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 0 Oct 04 18:37:29.545631 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 18:37:29.545631 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 18:37:29.545631 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 18:37:29.545631 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 18:37:29.545631 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPHx6gAhOQR9SzxsaQbdLvvDvFzwkrsL-eso5wPcIMTe7QTGQ8GNpGTh82q09olF7Uzd5vnfi_owSOym5Q6Nw1rEFuVgt0OVgeRF4PHNfL8zRO2fxXQeqtj7eemFhMAlgrZ0t6cEXPXGxP4C7AYLZO84Rlcv3L9rcqzDiRnnfGTw4VIc Oct 04 18:37:29.545631 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 18:37:29.545631 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 18:37:29.545631 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 18:37:29.545631 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 18:37:29.545631 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 18:37:29.545631 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 18:37:29.545631 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: 4fa31ed92017490a82497c7b8910aef0 Oct 04 18:37:29.545631 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-ImagesTestJSON-306433374 Oct 04 18:37:29.545631 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 18:37:29.545631 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 18:37:29.545631 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/4fa31ed92017490a82497c7b8910aef0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_4fa31ed92017490a82497c7b8910aef0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4fa31ed92017490a82497c7b8910aef0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4fa31ed92017490a82497c7b8910aef0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:37:29.545631 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-ImagesTestJSON-306433374 Oct 04 18:37:29.545631 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: 4fa31ed92017490a82497c7b8910aef0 Oct 04 18:37:29.545631 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-ImagesTestJSON-306433374 Oct 04 18:37:29.545631 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-ImagesTestJSON-306433374-project Oct 04 18:37:29.545631 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 18:37:29.545631 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 18:37:29.545631 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: 5a41ab6fb78a42ceaca621c5a38ffc6d Oct 04 18:37:29.545631 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-ImagesTestJSON-306433374-project Oct 04 18:37:29.545631 n-d-851028-13 devstack@n-api.service[123595]: method: Oct 04 18:37:29.545631 n-d-851028-13 devstack@n-api.service[123595]: exception: Image not found. Oct 04 18:37:29.545631 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': '55efa976-ae7c-4644-8cf0-09c64d94a4c9'} Oct 04 18:37:29.545631 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:37:29.545631 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:29.545631 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 04 18:37:29.545631 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 04 18:37:29.545631 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 18:37:29.545631 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 18:37:29.545631 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 18:37:29.545631 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 18:37:29.545631 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 04 18:37:29.545631 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 04 18:37:29.545631 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 04 18:37:29.545631 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 04 18:37:29.545631 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 18:37:29.545631 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 18:37:29.545631 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 18:37:29.545631 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 18:37:29.545631 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 55efa976-ae7c-4644-8cf0-09c64d94a4c9 to delete Oct 04 18:37:29.545631 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:37:29.545631 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:37:29.545631 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:37:29.545631 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:29.545631 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 04 18:37:29.545631 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 04 18:37:29.545631 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 04 18:37:29.545631 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 04 18:37:29.545631 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 04 18:37:29.545631 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 04 18:37:29.545631 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 55efa976-ae7c-4644-8cf0-09c64d94a4c9 could not be found. Oct 04 18:37:29.545631 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:37:29.545631 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:37:29.545631 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:37:29.545631 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:29.562760 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:37:29.562760 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:37:29.562760 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:37:29.562760 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:37:29.562760 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:37:29.562760 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:37:29.562760 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:37:29.562760 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:37:29.562760 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 04 18:37:29.562760 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 18:37:29.562760 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 18:37:29.562760 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:37:29.562760 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:37:29.562760 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:37:29.562760 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:29.562760 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:37:29.562760 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:37:29.562760 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:37:29.562760 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:37:29.562760 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 18:37:29.562760 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:37:29.562760 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-ed3ad3ca-f3fb-430d-a6a8-0b3c7693a71e tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Returning 404 to user: Image not found. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:37:29.562760 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-ed3ad3ca-f3fb-430d-a6a8-0b3c7693a71e tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] 10.222.0.43 "DELETE /compute/v2.1/images/55efa976-ae7c-4644-8cf0-09c64d94a4c9" status: 404 len: 62 microversion: 2.1 time: 0.117227 Oct 04 18:37:29.562760 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 758/1656] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:29 2022] DELETE /compute/v2.1/images/55efa976-ae7c-4644-8cf0-09c64d94a4c9 => generated 62 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:37:29.567000 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-b564851f-05e1-4309-be54-24f16f8c5cb9 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:29.567000 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-b564851f-05e1-4309-be54-24f16f8c5cb9 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] [instance: 86743a21-e24e-4001-b3da-48615f6e281e] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:29.583110 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b564851f-05e1-4309-be54-24f16f8c5cb9 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:29.583852 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b564851f-05e1-4309-be54-24f16f8c5cb9 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:29.584371 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b564851f-05e1-4309-be54-24f16f8c5cb9 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:29.588501 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b564851f-05e1-4309-be54-24f16f8c5cb9 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:29.591334 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b564851f-05e1-4309-be54-24f16f8c5cb9 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:29.591789 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b564851f-05e1-4309-be54-24f16f8c5cb9 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:29.667880 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-6774e898-5c68-45a1-a970-037a3c318745 tempest-ListImagesTestJSON-514053004 tempest-ListImagesTestJSON-514053004-project] 10.222.0.43 "GET /compute/v2.1/images/e8943ec5-4038-4d4b-b9b9-2415a79f5243" status: 200 len: 784 microversion: 2.1 time: 0.453276 Oct 04 18:37:29.668816 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 899/1657] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 18:37:29 2022] GET /compute/v2.1/images/e8943ec5-4038-4d4b-b9b9-2415a79f5243 => generated 784 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:37:29.691723 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-385452c7-81a9-4c5d-bb27-76a4924df893 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Calling method '.version_select at 0x7fb225e55d30>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:29.812683 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-385452c7-81a9-4c5d-bb27-76a4924df893 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] 10.222.0.43 "GET /compute/v2.1/images/d7825145-299c-45b6-9fe8-780722b2d243" status: 200 len: 1428 microversion: 2.1 time: 0.142700 Oct 04 18:37:29.822271 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 900/1658] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 18:37:29 2022] GET /compute/v2.1/images/d7825145-299c-45b6-9fe8-780722b2d243 => generated 1428 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:29.829412 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-477a3a89-4d86-40e1-a508-3ff3e70069d8 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:29.830238 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-477a3a89-4d86-40e1-a508-3ff3e70069d8 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] [instance: 64228016-ae20-4fcb-87da-c3d4d585e241] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:29.837792 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-477a3a89-4d86-40e1-a508-3ff3e70069d8 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:29.838649 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-477a3a89-4d86-40e1-a508-3ff3e70069d8 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:29.839905 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-477a3a89-4d86-40e1-a508-3ff3e70069d8 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:29.840826 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-477a3a89-4d86-40e1-a508-3ff3e70069d8 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:29.841559 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-477a3a89-4d86-40e1-a508-3ff3e70069d8 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:29.842341 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-477a3a89-4d86-40e1-a508-3ff3e70069d8 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:29.879238 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-477a3a89-4d86-40e1-a508-3ff3e70069d8 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] [instance: 64228016-ae20-4fcb-87da-c3d4d585e241] Going to try to terminate instance {{(pid=123596) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:37:29.974068 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.compute.api [None req-477a3a89-4d86-40e1-a508-3ff3e70069d8 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] [instance: 64228016-ae20-4fcb-87da-c3d4d585e241] Instance is already in deleting state, ignoring this request Oct 04 18:37:29.975658 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-477a3a89-4d86-40e1-a508-3ff3e70069d8 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] 10.222.0.43 "DELETE /compute/v2.1/servers/64228016-ae20-4fcb-87da-c3d4d585e241" status: 204 len: 0 microversion: 2.1 time: 0.152043 Oct 04 18:37:29.981042 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 901/1659] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 18:37:29 2022] DELETE /compute/v2.1/servers/64228016-ae20-4fcb-87da-c3d4d585e241 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:37:29.988779 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-bacf21dc-d0ee-40b0-b67b-ae2970978d5b tempest-ListImagesTestJSON-514053004 tempest-ListImagesTestJSON-514053004-project] Calling method '.version_select at 0x7fb224556700>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:30.002426 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-b564851f-05e1-4309-be54-24f16f8c5cb9 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa193aff0474ae3ba5d1aa7b0d0e8c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a06b8feba3404490a448aa2d4fb106b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:30.019305 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-b564851f-05e1-4309-be54-24f16f8c5cb9 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] 10.222.0.43 "GET /compute/v2.1/servers/86743a21-e24e-4001-b3da-48615f6e281e" status: 200 len: 1322 microversion: 2.1 time: 0.464727 Oct 04 18:37:30.024112 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 759/1660] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:29 2022] GET /compute/v2.1/servers/86743a21-e24e-4001-b3da-48615f6e281e => generated 1322 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:30.038902 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-8db5c1be-0c5f-4755-a0ce-ac62295bdf9d tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:30.039541 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-8db5c1be-0c5f-4755-a0ce-ac62295bdf9d tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] [instance: bea29c43-a5ab-42b3-9d5d-3b0f4f0f30f3] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:30.075043 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8db5c1be-0c5f-4755-a0ce-ac62295bdf9d tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:30.076673 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8db5c1be-0c5f-4755-a0ce-ac62295bdf9d tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:30.079241 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8db5c1be-0c5f-4755-a0ce-ac62295bdf9d tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:30.081942 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8db5c1be-0c5f-4755-a0ce-ac62295bdf9d tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:30.085101 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8db5c1be-0c5f-4755-a0ce-ac62295bdf9d tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:30.086962 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8db5c1be-0c5f-4755-a0ce-ac62295bdf9d tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:30.154562 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-bacf21dc-d0ee-40b0-b67b-ae2970978d5b tempest-ListImagesTestJSON-514053004 tempest-ListImagesTestJSON-514053004-project] 10.222.0.43 "GET /compute/v2.1/images" status: 200 len: 445 microversion: 2.1 time: 0.171595 Oct 04 18:37:30.160337 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 902/1661] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Oct 4 18:37:29 2022] GET /compute/v2.1/images => generated 445 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:37:30.193543 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-950651d6-e008-4d53-aeaa-071b19155f17 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:30.194183 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-950651d6-e008-4d53-aeaa-071b19155f17 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] [instance: 64228016-ae20-4fcb-87da-c3d4d585e241] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:30.217796 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-950651d6-e008-4d53-aeaa-071b19155f17 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:30.218296 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-950651d6-e008-4d53-aeaa-071b19155f17 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:30.218738 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-950651d6-e008-4d53-aeaa-071b19155f17 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:30.219454 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-950651d6-e008-4d53-aeaa-071b19155f17 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:30.219912 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-950651d6-e008-4d53-aeaa-071b19155f17 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:30.220340 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-950651d6-e008-4d53-aeaa-071b19155f17 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:30.264415 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:37:30.786824 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-950651d6-e008-4d53-aeaa-071b19155f17 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a41ab6fb78a42ceaca621c5a38ffc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa31ed92017490a82497c7b8910aef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:30.804157 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-950651d6-e008-4d53-aeaa-071b19155f17 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] 10.222.0.43 "GET /compute/v2.1/servers/64228016-ae20-4fcb-87da-c3d4d585e241" status: 200 len: 1494 microversion: 2.1 time: 0.641196 Oct 04 18:37:30.808766 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 903/1662] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:30 2022] GET /compute/v2.1/servers/64228016-ae20-4fcb-87da-c3d4d585e241 => generated 1494 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:30.819765 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-e8f4cb62-19ec-4791-8cfc-b3681ddc8de4 tempest-ListImagesTestJSON-514053004 tempest-ListImagesTestJSON-514053004-project] Calling method '.version_select at 0x7fb2246803a0>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:30.925492 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-e8f4cb62-19ec-4791-8cfc-b3681ddc8de4 tempest-ListImagesTestJSON-514053004 tempest-ListImagesTestJSON-514053004-project] 10.222.0.43 "GET /compute/v2.1/images/detail" status: 200 len: 787 microversion: 2.1 time: 0.114373 Oct 04 18:37:30.926338 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 904/1663] 10.222.0.43 () {58 vars in 1143 bytes} [Tue Oct 4 18:37:30 2022] GET /compute/v2.1/images/detail => generated 787 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:37:30.944486 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-d4d558ab-7f05-4c78-8a72-8abb2736c9bd tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:30.945591 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-d4d558ab-7f05-4c78-8a72-8abb2736c9bd tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: d85af512-1b1f-42a4-9bb1-963cc956c9ae] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:30.959666 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d4d558ab-7f05-4c78-8a72-8abb2736c9bd tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:30.963663 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d4d558ab-7f05-4c78-8a72-8abb2736c9bd tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:30.964356 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d4d558ab-7f05-4c78-8a72-8abb2736c9bd tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:30.967606 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d4d558ab-7f05-4c78-8a72-8abb2736c9bd tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:30.968273 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d4d558ab-7f05-4c78-8a72-8abb2736c9bd tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:30.968847 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d4d558ab-7f05-4c78-8a72-8abb2736c9bd tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:31.656929 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-8db5c1be-0c5f-4755-a0ce-ac62295bdf9d tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de84075cb5a44e83a41516b687f07e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9d3dec7f864f42adcd6e9c20043832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:31.671148 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-8db5c1be-0c5f-4755-a0ce-ac62295bdf9d tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] 10.222.0.43 "GET /compute/v2.1/servers/bea29c43-a5ab-42b3-9d5d-3b0f4f0f30f3" status: 200 len: 1316 microversion: 2.1 time: 1.645864 Oct 04 18:37:31.672490 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 760/1664] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:30 2022] GET /compute/v2.1/servers/bea29c43-a5ab-42b3-9d5d-3b0f4f0f30f3 => generated 1316 bytes in 1648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:31.680785 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-f512f04f-533d-454b-896b-e54ffd214f7f tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:31.681699 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-f512f04f-533d-454b-896b-e54ffd214f7f tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] [instance: 7222a4ce-d2a2-4b09-afc6-55bca52414d4] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:31.690240 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f512f04f-533d-454b-896b-e54ffd214f7f tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:31.691073 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f512f04f-533d-454b-896b-e54ffd214f7f tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:31.693666 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f512f04f-533d-454b-896b-e54ffd214f7f tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:31.695080 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f512f04f-533d-454b-896b-e54ffd214f7f tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:31.696599 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f512f04f-533d-454b-896b-e54ffd214f7f tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:31.697565 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f512f04f-533d-454b-896b-e54ffd214f7f tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:31.711986 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-d4d558ab-7f05-4c78-8a72-8abb2736c9bd tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:31.726339 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-d4d558ab-7f05-4c78-8a72-8abb2736c9bd tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/d85af512-1b1f-42a4-9bb1-963cc956c9ae" status: 200 len: 1312 microversion: 2.1 time: 0.793979 Oct 04 18:37:31.730233 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 905/1665] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:30 2022] GET /compute/v2.1/servers/d85af512-1b1f-42a4-9bb1-963cc956c9ae => generated 1312 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:31.749763 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-fe5bccf4-58bd-4ceb-82ff-6679fd955855 req-2755f0b2-9a2a-4894-b875-82dfdee5ef30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4231fdff-39dd-49a6-bea2-5edea44c3582", "name": "network-vif-plugged", "status": "completed", "tag": "ee13bc47-8284-46ee-acc8-f29243243bf5"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:37:31.805085 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-fe5bccf4-58bd-4ceb-82ff-6679fd955855 req-2755f0b2-9a2a-4894-b875-82dfdee5ef30 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:31.807874 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-fe5bccf4-58bd-4ceb-82ff-6679fd955855 req-2755f0b2-9a2a-4894-b875-82dfdee5ef30 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:31.810796 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-fe5bccf4-58bd-4ceb-82ff-6679fd955855 req-2755f0b2-9a2a-4894-b875-82dfdee5ef30 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:31.881507 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-fe5bccf4-58bd-4ceb-82ff-6679fd955855 req-2755f0b2-9a2a-4894-b875-82dfdee5ef30 service nova] Creating event network-vif-plugged:ee13bc47-8284-46ee-acc8-f29243243bf5 for instance 4231fdff-39dd-49a6-bea2-5edea44c3582 on n-h1-851028-13 Oct 04 18:37:31.909204 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-fe5bccf4-58bd-4ceb-82ff-6679fd955855 req-2755f0b2-9a2a-4894-b875-82dfdee5ef30 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.177405 Oct 04 18:37:31.910494 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 906/1666] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:37:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:37:31.920170 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-8c7088af-b5e1-4c95-9c01-d6710dad526a tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Calling method '.version_select at 0x7fb21fb6e5e0>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:31.991544 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-8c7088af-b5e1-4c95-9c01-d6710dad526a tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] 10.222.0.43 "GET /compute/v2.1/images/d7825145-299c-45b6-9fe8-780722b2d243" status: 200 len: 1428 microversion: 2.1 time: 0.079308 Oct 04 18:37:31.993489 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 907/1667] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 18:37:31 2022] GET /compute/v2.1/images/d7825145-299c-45b6-9fe8-780722b2d243 => generated 1428 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:32.007222 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-8f998528-a6ac-495f-bc0a-6d785d0dd84b tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:32.008267 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-8f998528-a6ac-495f-bc0a-6d785d0dd84b tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] [instance: 86743a21-e24e-4001-b3da-48615f6e281e] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:32.023534 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8f998528-a6ac-495f-bc0a-6d785d0dd84b tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:32.028449 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8f998528-a6ac-495f-bc0a-6d785d0dd84b tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:32.029245 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8f998528-a6ac-495f-bc0a-6d785d0dd84b tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:32.030188 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8f998528-a6ac-495f-bc0a-6d785d0dd84b tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:32.032475 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8f998528-a6ac-495f-bc0a-6d785d0dd84b tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:32.033837 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8f998528-a6ac-495f-bc0a-6d785d0dd84b tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:32.395709 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-8f998528-a6ac-495f-bc0a-6d785d0dd84b tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa193aff0474ae3ba5d1aa7b0d0e8c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a06b8feba3404490a448aa2d4fb106b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:32.410075 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-8f998528-a6ac-495f-bc0a-6d785d0dd84b tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] 10.222.0.43 "GET /compute/v2.1/servers/86743a21-e24e-4001-b3da-48615f6e281e" status: 200 len: 1322 microversion: 2.1 time: 0.415207 Oct 04 18:37:32.413063 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 908/1668] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:31 2022] GET /compute/v2.1/servers/86743a21-e24e-4001-b3da-48615f6e281e => generated 1322 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:32.441877 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-5d5d756e-6875-4371-b4a4-556bad8c0dfb tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:32.443750 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-5d5d756e-6875-4371-b4a4-556bad8c0dfb tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] [instance: 64228016-ae20-4fcb-87da-c3d4d585e241] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:32.469165 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5d5d756e-6875-4371-b4a4-556bad8c0dfb tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:32.476107 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5d5d756e-6875-4371-b4a4-556bad8c0dfb tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:32.476703 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5d5d756e-6875-4371-b4a4-556bad8c0dfb tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:32.477614 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5d5d756e-6875-4371-b4a4-556bad8c0dfb tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:32.478741 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5d5d756e-6875-4371-b4a4-556bad8c0dfb tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:32.481043 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5d5d756e-6875-4371-b4a4-556bad8c0dfb tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:32.850273 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-5d5d756e-6875-4371-b4a4-556bad8c0dfb tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a41ab6fb78a42ceaca621c5a38ffc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa31ed92017490a82497c7b8910aef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:32.867705 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-5d5d756e-6875-4371-b4a4-556bad8c0dfb tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] 10.222.0.43 "GET /compute/v2.1/servers/64228016-ae20-4fcb-87da-c3d4d585e241" status: 200 len: 1494 microversion: 2.1 time: 0.451855 Oct 04 18:37:32.868979 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 909/1669] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:32 2022] GET /compute/v2.1/servers/64228016-ae20-4fcb-87da-c3d4d585e241 => generated 1494 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:32.874670 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-9b59cba2-c60c-4b72-8022-51edb7905ca0 tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:32.875568 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-9b59cba2-c60c-4b72-8022-51edb7905ca0 tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] [instance: bea29c43-a5ab-42b3-9d5d-3b0f4f0f30f3] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:32.883643 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9b59cba2-c60c-4b72-8022-51edb7905ca0 tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:32.884898 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9b59cba2-c60c-4b72-8022-51edb7905ca0 tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:32.885642 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9b59cba2-c60c-4b72-8022-51edb7905ca0 tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:32.886700 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9b59cba2-c60c-4b72-8022-51edb7905ca0 tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:32.888126 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9b59cba2-c60c-4b72-8022-51edb7905ca0 tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:32.889333 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9b59cba2-c60c-4b72-8022-51edb7905ca0 tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:32.977509 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-f512f04f-533d-454b-896b-e54ffd214f7f tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:32.988247 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-f512f04f-533d-454b-896b-e54ffd214f7f tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:32.998159 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-f512f04f-533d-454b-896b-e54ffd214f7f tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:33.000348 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-f512f04f-533d-454b-896b-e54ffd214f7f tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] 10.222.0.43 "GET /compute/v2.1/servers/7222a4ce-d2a2-4b09-afc6-55bca52414d4" status: 200 len: 1815 microversion: 2.25 time: 1.326550 Oct 04 18:37:33.000861 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 761/1670] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:37:31 2022] GET /compute/v2.1/servers/7222a4ce-d2a2-4b09-afc6-55bca52414d4 => generated 1815 bytes in 1328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:37:33.014305 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-3bf93487-ed12-4f1e-94d9-45cf2d901e94 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:33.015303 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-3bf93487-ed12-4f1e-94d9-45cf2d901e94 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: d85af512-1b1f-42a4-9bb1-963cc956c9ae] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:33.032917 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3bf93487-ed12-4f1e-94d9-45cf2d901e94 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:33.034967 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3bf93487-ed12-4f1e-94d9-45cf2d901e94 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:33.037974 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3bf93487-ed12-4f1e-94d9-45cf2d901e94 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:33.040736 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3bf93487-ed12-4f1e-94d9-45cf2d901e94 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:33.041843 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3bf93487-ed12-4f1e-94d9-45cf2d901e94 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:33.042495 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3bf93487-ed12-4f1e-94d9-45cf2d901e94 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:33.308754 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-9b59cba2-c60c-4b72-8022-51edb7905ca0 tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de84075cb5a44e83a41516b687f07e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9d3dec7f864f42adcd6e9c20043832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:33.318346 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-9b59cba2-c60c-4b72-8022-51edb7905ca0 tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] 10.222.0.43 "GET /compute/v2.1/servers/bea29c43-a5ab-42b3-9d5d-3b0f4f0f30f3" status: 200 len: 1316 microversion: 2.1 time: 0.448063 Oct 04 18:37:33.333678 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 910/1671] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:32 2022] GET /compute/v2.1/servers/bea29c43-a5ab-42b3-9d5d-3b0f4f0f30f3 => generated 1316 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:33.338205 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-57b27f92-4664-44ee-8ea4-54844be54eae tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Calling method '.version_select at 0x7fb22446e310>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:33.432789 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-57b27f92-4664-44ee-8ea4-54844be54eae tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] 10.222.0.43 "GET /compute/v2.1/images/d7825145-299c-45b6-9fe8-780722b2d243" status: 200 len: 1428 microversion: 2.1 time: 0.105633 Oct 04 18:37:33.433758 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 911/1672] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 18:37:33 2022] GET /compute/v2.1/images/d7825145-299c-45b6-9fe8-780722b2d243 => generated 1428 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:33.438697 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-a5204f63-de49-46ec-821b-499592bf1c9d tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:33.449963 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-a5204f63-de49-46ec-821b-499592bf1c9d tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] [instance: 86743a21-e24e-4001-b3da-48615f6e281e] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:33.456672 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a5204f63-de49-46ec-821b-499592bf1c9d tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:33.459514 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a5204f63-de49-46ec-821b-499592bf1c9d tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:33.460156 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a5204f63-de49-46ec-821b-499592bf1c9d tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:33.466101 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a5204f63-de49-46ec-821b-499592bf1c9d tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:33.466816 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a5204f63-de49-46ec-821b-499592bf1c9d tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:33.467424 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a5204f63-de49-46ec-821b-499592bf1c9d tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:33.768840 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-a5204f63-de49-46ec-821b-499592bf1c9d tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa193aff0474ae3ba5d1aa7b0d0e8c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a06b8feba3404490a448aa2d4fb106b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:33.795091 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-a5204f63-de49-46ec-821b-499592bf1c9d tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] 10.222.0.43 "GET /compute/v2.1/servers/86743a21-e24e-4001-b3da-48615f6e281e" status: 200 len: 1514 microversion: 2.1 time: 0.359937 Oct 04 18:37:33.797365 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 912/1673] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:33 2022] GET /compute/v2.1/servers/86743a21-e24e-4001-b3da-48615f6e281e => generated 1514 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:33.821686 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-9a913a39-448b-437d-a8d2-6b532ea63bb2 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:33.822626 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-9a913a39-448b-437d-a8d2-6b532ea63bb2 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] [instance: 132f39b7-bf1b-49a8-87a3-38cd95a041de] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:33.829742 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9a913a39-448b-437d-a8d2-6b532ea63bb2 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:33.830458 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9a913a39-448b-437d-a8d2-6b532ea63bb2 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:33.831075 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9a913a39-448b-437d-a8d2-6b532ea63bb2 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:33.831976 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9a913a39-448b-437d-a8d2-6b532ea63bb2 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:33.832599 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9a913a39-448b-437d-a8d2-6b532ea63bb2 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:33.833286 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9a913a39-448b-437d-a8d2-6b532ea63bb2 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:33.901487 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-3bf93487-ed12-4f1e-94d9-45cf2d901e94 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:33.915083 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-3bf93487-ed12-4f1e-94d9-45cf2d901e94 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/d85af512-1b1f-42a4-9bb1-963cc956c9ae" status: 200 len: 1312 microversion: 2.1 time: 0.910037 Oct 04 18:37:33.922245 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 762/1674] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:33 2022] GET /compute/v2.1/servers/d85af512-1b1f-42a4-9bb1-963cc956c9ae => generated 1312 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:33.938326 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-bee7fa7a-46f5-4123-8de3-07b963210d86 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:33.938943 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-bee7fa7a-46f5-4123-8de3-07b963210d86 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] [instance: 64228016-ae20-4fcb-87da-c3d4d585e241] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:33.954977 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bee7fa7a-46f5-4123-8de3-07b963210d86 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:33.955504 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bee7fa7a-46f5-4123-8de3-07b963210d86 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:33.955943 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bee7fa7a-46f5-4123-8de3-07b963210d86 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:33.956666 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bee7fa7a-46f5-4123-8de3-07b963210d86 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:33.957144 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bee7fa7a-46f5-4123-8de3-07b963210d86 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:33.957602 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bee7fa7a-46f5-4123-8de3-07b963210d86 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:34.009009 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:37:34.295588 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-9a913a39-448b-437d-a8d2-6b532ea63bb2 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa193aff0474ae3ba5d1aa7b0d0e8c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a06b8feba3404490a448aa2d4fb106b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:34.310315 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-9a913a39-448b-437d-a8d2-6b532ea63bb2 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] 10.222.0.43 "GET /compute/v2.1/servers/132f39b7-bf1b-49a8-87a3-38cd95a041de" status: 200 len: 1515 microversion: 2.1 time: 0.494259 Oct 04 18:37:34.326545 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 913/1675] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:33 2022] GET /compute/v2.1/servers/132f39b7-bf1b-49a8-87a3-38cd95a041de => generated 1515 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:37:34.326545 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-e450d58b-4b57-4462-8c98-8ed4b6a125e0 req-bca3e8a6-bb23-48dd-826a-cb62f5c05639 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64228016-ae20-4fcb-87da-c3d4d585e241", "name": "network-vif-plugged", "status": "completed", "tag": "544eb6fd-0a18-483e-aad4-45ebdf392b69"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:37:34.360435 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-e450d58b-4b57-4462-8c98-8ed4b6a125e0 req-bca3e8a6-bb23-48dd-826a-cb62f5c05639 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:34.363829 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-e450d58b-4b57-4462-8c98-8ed4b6a125e0 req-bca3e8a6-bb23-48dd-826a-cb62f5c05639 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:34.367837 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-e450d58b-4b57-4462-8c98-8ed4b6a125e0 req-bca3e8a6-bb23-48dd-826a-cb62f5c05639 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:34.471924 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-e450d58b-4b57-4462-8c98-8ed4b6a125e0 req-bca3e8a6-bb23-48dd-826a-cb62f5c05639 service nova] Creating event network-vif-plugged:544eb6fd-0a18-483e-aad4-45ebdf392b69 for instance 64228016-ae20-4fcb-87da-c3d4d585e241 on n-h1-851028-13 Oct 04 18:37:34.478034 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-e450d58b-4b57-4462-8c98-8ed4b6a125e0 req-bca3e8a6-bb23-48dd-826a-cb62f5c05639 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.155151 Oct 04 18:37:34.479210 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 914/1676] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:37:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:37:34.485743 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-6021f47a-1c60-4991-956a-cad627477826 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:34.486811 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-6021f47a-1c60-4991-956a-cad627477826 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] [instance: 7222a4ce-d2a2-4b09-afc6-55bca52414d4] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:34.496064 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6021f47a-1c60-4991-956a-cad627477826 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:34.496896 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6021f47a-1c60-4991-956a-cad627477826 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:34.497748 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6021f47a-1c60-4991-956a-cad627477826 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:34.498712 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6021f47a-1c60-4991-956a-cad627477826 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:34.499402 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6021f47a-1c60-4991-956a-cad627477826 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:34.500081 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6021f47a-1c60-4991-956a-cad627477826 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:34.573797 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-bee7fa7a-46f5-4123-8de3-07b963210d86 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a41ab6fb78a42ceaca621c5a38ffc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa31ed92017490a82497c7b8910aef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:34.585751 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-bee7fa7a-46f5-4123-8de3-07b963210d86 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] 10.222.0.43 "GET /compute/v2.1/servers/64228016-ae20-4fcb-87da-c3d4d585e241" status: 200 len: 1494 microversion: 2.1 time: 0.662349 Oct 04 18:37:34.587429 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 763/1677] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:33 2022] GET /compute/v2.1/servers/64228016-ae20-4fcb-87da-c3d4d585e241 => generated 1494 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:34.593379 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-64305798-62b5-45f2-84e5-498341becd91 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:34.594470 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-64305798-62b5-45f2-84e5-498341becd91 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] [instance: 744f6597-f965-405c-ad7b-66a8a0f1397b] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:34.605975 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-64305798-62b5-45f2-84e5-498341becd91 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:34.606791 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-64305798-62b5-45f2-84e5-498341becd91 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:34.608141 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-64305798-62b5-45f2-84e5-498341becd91 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:34.616232 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-64305798-62b5-45f2-84e5-498341becd91 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:34.616748 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-64305798-62b5-45f2-84e5-498341becd91 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:34.617226 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-64305798-62b5-45f2-84e5-498341becd91 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:34.672721 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=2 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:37:34.705864 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=8 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:37:34.885040 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-6021f47a-1c60-4991-956a-cad627477826 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:34.900497 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-6021f47a-1c60-4991-956a-cad627477826 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:34.903384 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-6021f47a-1c60-4991-956a-cad627477826 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:34.913843 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-6021f47a-1c60-4991-956a-cad627477826 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] 10.222.0.43 "GET /compute/v2.1/servers/7222a4ce-d2a2-4b09-afc6-55bca52414d4" status: 200 len: 1815 microversion: 2.25 time: 0.424350 Oct 04 18:37:34.914914 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 915/1678] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:37:34 2022] GET /compute/v2.1/servers/7222a4ce-d2a2-4b09-afc6-55bca52414d4 => generated 1815 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:37:34.928234 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-1d8910aa-98ec-4171-a75d-9ae53884d041 tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:34.929475 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-1d8910aa-98ec-4171-a75d-9ae53884d041 tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] [instance: bea29c43-a5ab-42b3-9d5d-3b0f4f0f30f3] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:34.950880 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1d8910aa-98ec-4171-a75d-9ae53884d041 tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:34.951877 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1d8910aa-98ec-4171-a75d-9ae53884d041 tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:34.953041 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1d8910aa-98ec-4171-a75d-9ae53884d041 tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:34.954181 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1d8910aa-98ec-4171-a75d-9ae53884d041 tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:34.955110 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1d8910aa-98ec-4171-a75d-9ae53884d041 tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:34.955799 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1d8910aa-98ec-4171-a75d-9ae53884d041 tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:35.256967 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-1d8910aa-98ec-4171-a75d-9ae53884d041 tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de84075cb5a44e83a41516b687f07e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9d3dec7f864f42adcd6e9c20043832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:35.272244 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-1d8910aa-98ec-4171-a75d-9ae53884d041 tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] 10.222.0.43 "GET /compute/v2.1/servers/bea29c43-a5ab-42b3-9d5d-3b0f4f0f30f3" status: 200 len: 1316 microversion: 2.1 time: 0.355732 Oct 04 18:37:35.273468 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 916/1679] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:34 2022] GET /compute/v2.1/servers/bea29c43-a5ab-42b3-9d5d-3b0f4f0f30f3 => generated 1316 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:35.280465 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-971b1f64-5a41-4261-8ac6-9a9fbbbfa39e tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Calling method '.version_select at 0x7fb2240fb670>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:35.349619 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-971b1f64-5a41-4261-8ac6-9a9fbbbfa39e tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] 10.222.0.43 "GET /compute/v2.1/images/d7825145-299c-45b6-9fe8-780722b2d243" status: 200 len: 1428 microversion: 2.1 time: 0.073142 Oct 04 18:37:35.359495 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 917/1680] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 18:37:35 2022] GET /compute/v2.1/images/d7825145-299c-45b6-9fe8-780722b2d243 => generated 1428 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:35.370833 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-55766445-8fbf-40a1-a0a3-31bfdf7bc83a tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:35.372523 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-55766445-8fbf-40a1-a0a3-31bfdf7bc83a tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: d85af512-1b1f-42a4-9bb1-963cc956c9ae] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:35.385045 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-55766445-8fbf-40a1-a0a3-31bfdf7bc83a tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:35.385852 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-55766445-8fbf-40a1-a0a3-31bfdf7bc83a tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:35.386586 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-55766445-8fbf-40a1-a0a3-31bfdf7bc83a tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:35.387532 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-55766445-8fbf-40a1-a0a3-31bfdf7bc83a tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:35.388218 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-55766445-8fbf-40a1-a0a3-31bfdf7bc83a tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:35.389219 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-55766445-8fbf-40a1-a0a3-31bfdf7bc83a tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:35.614155 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-55766445-8fbf-40a1-a0a3-31bfdf7bc83a tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:35.626039 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-55766445-8fbf-40a1-a0a3-31bfdf7bc83a tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/d85af512-1b1f-42a4-9bb1-963cc956c9ae" status: 200 len: 1312 microversion: 2.1 time: 0.264867 Oct 04 18:37:35.627012 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 918/1681] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:35 2022] GET /compute/v2.1/servers/d85af512-1b1f-42a4-9bb1-963cc956c9ae => generated 1312 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:35.660637 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-8c349dbf-7d12-402d-805c-2ea79590c770 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:35.662485 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-8c349dbf-7d12-402d-805c-2ea79590c770 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] [instance: 64228016-ae20-4fcb-87da-c3d4d585e241] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:35.683484 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8c349dbf-7d12-402d-805c-2ea79590c770 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:35.684052 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8c349dbf-7d12-402d-805c-2ea79590c770 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:35.685437 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8c349dbf-7d12-402d-805c-2ea79590c770 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:35.686966 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8c349dbf-7d12-402d-805c-2ea79590c770 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:35.687459 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8c349dbf-7d12-402d-805c-2ea79590c770 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:35.687967 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8c349dbf-7d12-402d-805c-2ea79590c770 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:35.899279 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=8 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:37:35.907023 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-8c349dbf-7d12-402d-805c-2ea79590c770 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a41ab6fb78a42ceaca621c5a38ffc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa31ed92017490a82497c7b8910aef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:35.929015 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-8c349dbf-7d12-402d-805c-2ea79590c770 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] 10.222.0.43 "GET /compute/v2.1/servers/64228016-ae20-4fcb-87da-c3d4d585e241" status: 200 len: 1494 microversion: 2.1 time: 0.284237 Oct 04 18:37:35.933476 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 919/1682] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:35 2022] GET /compute/v2.1/servers/64228016-ae20-4fcb-87da-c3d4d585e241 => generated 1494 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:35.954354 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-87177a6a-b3cc-4320-b0f9-02c5701e7a2c tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:35.954354 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-87177a6a-b3cc-4320-b0f9-02c5701e7a2c tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] [instance: 7222a4ce-d2a2-4b09-afc6-55bca52414d4] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:35.966174 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-87177a6a-b3cc-4320-b0f9-02c5701e7a2c tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:35.968274 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-87177a6a-b3cc-4320-b0f9-02c5701e7a2c tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:35.969092 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-87177a6a-b3cc-4320-b0f9-02c5701e7a2c tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:35.970852 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-87177a6a-b3cc-4320-b0f9-02c5701e7a2c tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:35.974693 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-87177a6a-b3cc-4320-b0f9-02c5701e7a2c tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:35.975445 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-87177a6a-b3cc-4320-b0f9-02c5701e7a2c tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:36.069540 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-64305798-62b5-45f2-84e5-498341becd91 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa193aff0474ae3ba5d1aa7b0d0e8c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a06b8feba3404490a448aa2d4fb106b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:36.087732 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-64305798-62b5-45f2-84e5-498341becd91 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] 10.222.0.43 "GET /compute/v2.1/servers/744f6597-f965-405c-ad7b-66a8a0f1397b" status: 200 len: 1514 microversion: 2.1 time: 1.498652 Oct 04 18:37:36.088745 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 764/1683] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:34 2022] GET /compute/v2.1/servers/744f6597-f965-405c-ad7b-66a8a0f1397b => generated 1514 bytes in 1500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:36.111548 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-6b2027b1-34c3-45bd-9266-09049946fb08 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:36.112258 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-6b2027b1-34c3-45bd-9266-09049946fb08 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] [instance: 744f6597-f965-405c-ad7b-66a8a0f1397b] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:36.127278 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6b2027b1-34c3-45bd-9266-09049946fb08 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:36.128119 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6b2027b1-34c3-45bd-9266-09049946fb08 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:36.129847 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6b2027b1-34c3-45bd-9266-09049946fb08 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:36.130757 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6b2027b1-34c3-45bd-9266-09049946fb08 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:36.131387 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6b2027b1-34c3-45bd-9266-09049946fb08 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:36.132752 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6b2027b1-34c3-45bd-9266-09049946fb08 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:36.203350 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-6b2027b1-34c3-45bd-9266-09049946fb08 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] [instance: 744f6597-f965-405c-ad7b-66a8a0f1397b] Going to try to terminate instance {{(pid=123595) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:37:36.297601 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-87177a6a-b3cc-4320-b0f9-02c5701e7a2c tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:36.312664 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-87177a6a-b3cc-4320-b0f9-02c5701e7a2c tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:36.315107 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-87177a6a-b3cc-4320-b0f9-02c5701e7a2c tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:36.316841 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-87177a6a-b3cc-4320-b0f9-02c5701e7a2c tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] 10.222.0.43 "GET /compute/v2.1/servers/7222a4ce-d2a2-4b09-afc6-55bca52414d4" status: 200 len: 1815 microversion: 2.25 time: 0.376791 Oct 04 18:37:36.330247 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 920/1684] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:37:35 2022] GET /compute/v2.1/servers/7222a4ce-d2a2-4b09-afc6-55bca52414d4 => generated 1815 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:37:36.413644 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-6b2027b1-34c3-45bd-9266-09049946fb08 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] 10.222.0.43 "DELETE /compute/v2.1/servers/744f6597-f965-405c-ad7b-66a8a0f1397b" status: 204 len: 0 microversion: 2.1 time: 0.306207 Oct 04 18:37:36.414827 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 765/1685] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 18:37:36 2022] DELETE /compute/v2.1/servers/744f6597-f965-405c-ad7b-66a8a0f1397b => generated 0 bytes in 308 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 18:37:36.423295 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-7e3a0878-dc91-42af-9ea5-8c509d3f081a tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:36.429643 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-7e3a0878-dc91-42af-9ea5-8c509d3f081a tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] [instance: bea29c43-a5ab-42b3-9d5d-3b0f4f0f30f3] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:36.443486 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7e3a0878-dc91-42af-9ea5-8c509d3f081a tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:36.446909 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7e3a0878-dc91-42af-9ea5-8c509d3f081a tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:36.447648 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7e3a0878-dc91-42af-9ea5-8c509d3f081a tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:36.448602 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7e3a0878-dc91-42af-9ea5-8c509d3f081a tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:36.451933 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7e3a0878-dc91-42af-9ea5-8c509d3f081a tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:36.452590 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7e3a0878-dc91-42af-9ea5-8c509d3f081a tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:36.612339 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-d9784abf-3c18-4412-af17-d2fdd5ff4633 tempest-KeyPairsV22TestJSON-611266393 tempest-KeyPairsV22TestJSON-611266393-project] Action: 'create', calling method: .version_select at 0x7fb22410b8b0>, body: {"keypair": {"name": "tempest-keypair-314270231", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGYewyzZOUCN9sMLgc4r+GiSpNH2FvS9PJIuCTBJmKMmCOwbZ/0RGc0QLVFoFNLKALA7gfgtRmekWbBciKUwb8gvjdnrkyhhxbe7jFb+ZDNKYq46i5/r8gupgyBuCVqfQw=="}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:37:36.634319 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-d9784abf-3c18-4412-af17-d2fdd5ff4633 tempest-KeyPairsV22TestJSON-611266393 tempest-KeyPairsV22TestJSON-611266393-project] Getting quotas for project 036a5961e2e746beb81e36c9eaabcce2. Resources: {'key_pairs'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:37:36.641275 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-d9784abf-3c18-4412-af17-d2fdd5ff4633 tempest-KeyPairsV22TestJSON-611266393 tempest-KeyPairsV22TestJSON-611266393-project] Getting quotas for user 554a6837c8de42e6803b0823f3a65d05 and project 036a5961e2e746beb81e36c9eaabcce2. Resources: {'key_pairs'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:37:36.681312 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-d9784abf-3c18-4412-af17-d2fdd5ff4633 tempest-KeyPairsV22TestJSON-611266393 tempest-KeyPairsV22TestJSON-611266393-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.349069 Oct 04 18:37:36.690156 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 921/1686] 10.222.0.43 () {62 vars in 1199 bytes} [Tue Oct 4 18:37:36 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 351 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 04 18:37:36.690426 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-e05e2e72-47e8-4f82-9de5-0466d6d12554 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Calling method '.version_select at 0x7fb21fb6e0d0>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:36.773676 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-e05e2e72-47e8-4f82-9de5-0466d6d12554 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] 10.222.0.43 "GET /compute/v2.1/images/d7825145-299c-45b6-9fe8-780722b2d243" status: 200 len: 1428 microversion: 2.1 time: 0.090265 Oct 04 18:37:36.775100 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 922/1687] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 18:37:36 2022] GET /compute/v2.1/images/d7825145-299c-45b6-9fe8-780722b2d243 => generated 1428 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:36.781595 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-1e1d1cd9-311c-4727-981f-504bf71d42cf tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:36.783226 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-1e1d1cd9-311c-4727-981f-504bf71d42cf tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] [instance: 744f6597-f965-405c-ad7b-66a8a0f1397b] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:36.793253 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1e1d1cd9-311c-4727-981f-504bf71d42cf tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:36.794219 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1e1d1cd9-311c-4727-981f-504bf71d42cf tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:36.794970 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1e1d1cd9-311c-4727-981f-504bf71d42cf tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:36.796233 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1e1d1cd9-311c-4727-981f-504bf71d42cf tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:36.797637 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1e1d1cd9-311c-4727-981f-504bf71d42cf tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:36.798847 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1e1d1cd9-311c-4727-981f-504bf71d42cf tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:37.095046 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-1e1d1cd9-311c-4727-981f-504bf71d42cf tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa193aff0474ae3ba5d1aa7b0d0e8c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a06b8feba3404490a448aa2d4fb106b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:37.114309 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-1e1d1cd9-311c-4727-981f-504bf71d42cf tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] 10.222.0.43 "GET /compute/v2.1/servers/744f6597-f965-405c-ad7b-66a8a0f1397b" status: 200 len: 1520 microversion: 2.1 time: 0.337673 Oct 04 18:37:37.116730 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 923/1688] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:36 2022] GET /compute/v2.1/servers/744f6597-f965-405c-ad7b-66a8a0f1397b => generated 1520 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:37.127709 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-439aa129-68dd-430a-98e1-1bd765caae5f req-5da95274-ea09-4f3d-9bf9-64209756f563 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d85af512-1b1f-42a4-9bb1-963cc956c9ae", "name": "network-vif-plugged", "status": "completed", "tag": "002dee45-b64c-4706-ab5c-1e8e34d83258"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:37:37.143046 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-7e3a0878-dc91-42af-9ea5-8c509d3f081a tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de84075cb5a44e83a41516b687f07e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9d3dec7f864f42adcd6e9c20043832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:37.144655 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-439aa129-68dd-430a-98e1-1bd765caae5f req-5da95274-ea09-4f3d-9bf9-64209756f563 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:37.146384 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-439aa129-68dd-430a-98e1-1bd765caae5f req-5da95274-ea09-4f3d-9bf9-64209756f563 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:37.146919 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-439aa129-68dd-430a-98e1-1bd765caae5f req-5da95274-ea09-4f3d-9bf9-64209756f563 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:37.157160 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-7e3a0878-dc91-42af-9ea5-8c509d3f081a tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] 10.222.0.43 "GET /compute/v2.1/servers/bea29c43-a5ab-42b3-9d5d-3b0f4f0f30f3" status: 200 len: 1316 microversion: 2.1 time: 0.737173 Oct 04 18:37:37.161922 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-439aa129-68dd-430a-98e1-1bd765caae5f req-5da95274-ea09-4f3d-9bf9-64209756f563 service nova] Creating event network-vif-plugged:002dee45-b64c-4706-ab5c-1e8e34d83258 for instance d85af512-1b1f-42a4-9bb1-963cc956c9ae on n-h2-851028-13 Oct 04 18:37:37.163456 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 766/1689] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:36 2022] GET /compute/v2.1/servers/bea29c43-a5ab-42b3-9d5d-3b0f4f0f30f3 => generated 1316 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:37.179023 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-790e39cb-387b-4342-81ae-01f28f758015 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:37.180874 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-790e39cb-387b-4342-81ae-01f28f758015 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: d85af512-1b1f-42a4-9bb1-963cc956c9ae] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:37.183130 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-439aa129-68dd-430a-98e1-1bd765caae5f req-5da95274-ea09-4f3d-9bf9-64209756f563 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061302 Oct 04 18:37:37.185333 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 924/1690] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:37:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:37:37.190764 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-790e39cb-387b-4342-81ae-01f28f758015 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:37.191377 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-790e39cb-387b-4342-81ae-01f28f758015 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:37.192017 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-790e39cb-387b-4342-81ae-01f28f758015 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:37.192862 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-790e39cb-387b-4342-81ae-01f28f758015 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:37.193540 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-790e39cb-387b-4342-81ae-01f28f758015 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:37.194156 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-790e39cb-387b-4342-81ae-01f28f758015 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:37.212636 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-54124361-a7c5-4e9f-8464-410ad3ce874a tempest-KeyPairsV22TestJSON-611266393 tempest-KeyPairsV22TestJSON-611266393-project] Calling method '.version_select at 0x7fb22401baf0>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:37.245151 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-54124361-a7c5-4e9f-8464-410ad3ce874a tempest-KeyPairsV22TestJSON-611266393 tempest-KeyPairsV22TestJSON-611266393-project] 10.222.0.43 "GET /compute/v2.1/os-keypairs/tempest-keypair-314270231" status: 200 len: 511 microversion: 2.2 time: 0.058197 Oct 04 18:37:37.252555 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 925/1691] 10.222.0.43 () {60 vars in 1255 bytes} [Tue Oct 4 18:37:37 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-314270231 => generated 511 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:37:37.258226 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-6bfae9a8-18bb-40d8-9142-5d3264c3c45c req-178dea7d-6d84-4b57-964b-5a904f0bff14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64228016-ae20-4fcb-87da-c3d4d585e241", "name": "network-vif-deleted", "tag": "544eb6fd-0a18-483e-aad4-45ebdf392b69"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:37:37.268085 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-6bfae9a8-18bb-40d8-9142-5d3264c3c45c req-178dea7d-6d84-4b57-964b-5a904f0bff14 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:37.268613 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-6bfae9a8-18bb-40d8-9142-5d3264c3c45c req-178dea7d-6d84-4b57-964b-5a904f0bff14 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:37.269048 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-6bfae9a8-18bb-40d8-9142-5d3264c3c45c req-178dea7d-6d84-4b57-964b-5a904f0bff14 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:37.281315 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-6bfae9a8-18bb-40d8-9142-5d3264c3c45c req-178dea7d-6d84-4b57-964b-5a904f0bff14 service nova] Creating event network-vif-deleted:544eb6fd-0a18-483e-aad4-45ebdf392b69 for instance 64228016-ae20-4fcb-87da-c3d4d585e241 on n-h1-851028-13 Oct 04 18:37:37.289624 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-6bfae9a8-18bb-40d8-9142-5d3264c3c45c req-178dea7d-6d84-4b57-964b-5a904f0bff14 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035703 Oct 04 18:37:37.290533 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 926/1692] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:37:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:37:37.298348 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-925232df-d799-4dc7-bf11-0db0ea2799ff tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:37.299147 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-925232df-d799-4dc7-bf11-0db0ea2799ff tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] [instance: 64228016-ae20-4fcb-87da-c3d4d585e241] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:37.302517 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:37:37.306510 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-925232df-d799-4dc7-bf11-0db0ea2799ff tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:37.307000 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-925232df-d799-4dc7-bf11-0db0ea2799ff tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:37.307441 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-925232df-d799-4dc7-bf11-0db0ea2799ff tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:37.308150 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-925232df-d799-4dc7-bf11-0db0ea2799ff tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:37.308604 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-925232df-d799-4dc7-bf11-0db0ea2799ff tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:37.309033 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-925232df-d799-4dc7-bf11-0db0ea2799ff tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:37.349747 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-925232df-d799-4dc7-bf11-0db0ea2799ff tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:37.350228 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-925232df-d799-4dc7-bf11-0db0ea2799ff tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:37.354287 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-925232df-d799-4dc7-bf11-0db0ea2799ff tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:37.355162 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.objects.instance [None req-925232df-d799-4dc7-bf11-0db0ea2799ff tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lazy-loading 'fault' on Instance uuid 64228016-ae20-4fcb-87da-c3d4d585e241 {{(pid=123596) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:37:37.421234 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-925232df-d799-4dc7-bf11-0db0ea2799ff tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a41ab6fb78a42ceaca621c5a38ffc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa31ed92017490a82497c7b8910aef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:37.441254 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-925232df-d799-4dc7-bf11-0db0ea2799ff tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] 10.222.0.43 "GET /compute/v2.1/servers/64228016-ae20-4fcb-87da-c3d4d585e241" status: 200 len: 1298 microversion: 2.1 time: 0.147470 Oct 04 18:37:37.445665 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 927/1693] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:37 2022] GET /compute/v2.1/servers/64228016-ae20-4fcb-87da-c3d4d585e241 => generated 1298 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:37.456929 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-66288704-d5de-4083-9d31-6f78ce8b5354 tempest-KeyPairsV22TestJSON-611266393 tempest-KeyPairsV22TestJSON-611266393-project] Calling method '.version_select at 0x7fb22401b670>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:37.484580 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-66288704-d5de-4083-9d31-6f78ce8b5354 tempest-KeyPairsV22TestJSON-611266393 tempest-KeyPairsV22TestJSON-611266393-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-314270231" status: 204 len: 0 microversion: 2.2 time: 0.036748 Oct 04 18:37:37.485742 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 928/1694] 10.222.0.43 () {60 vars in 1258 bytes} [Tue Oct 4 18:37:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-314270231 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:37:37.491540 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-1fd3d630-6ba6-401c-8085-33b424a3d8a5 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:37.492727 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-1fd3d630-6ba6-401c-8085-33b424a3d8a5 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] [instance: 7222a4ce-d2a2-4b09-afc6-55bca52414d4] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:37.512029 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-790e39cb-387b-4342-81ae-01f28f758015 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:37.530884 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1fd3d630-6ba6-401c-8085-33b424a3d8a5 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:37.531601 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1fd3d630-6ba6-401c-8085-33b424a3d8a5 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:37.532057 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1fd3d630-6ba6-401c-8085-33b424a3d8a5 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:37.533084 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1fd3d630-6ba6-401c-8085-33b424a3d8a5 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:37.533567 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1fd3d630-6ba6-401c-8085-33b424a3d8a5 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:37.533958 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-790e39cb-387b-4342-81ae-01f28f758015 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/d85af512-1b1f-42a4-9bb1-963cc956c9ae" status: 200 len: 1312 microversion: 2.1 time: 0.368443 Oct 04 18:37:37.534110 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1fd3d630-6ba6-401c-8085-33b424a3d8a5 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:37.538646 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 767/1695] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:37 2022] GET /compute/v2.1/servers/d85af512-1b1f-42a4-9bb1-963cc956c9ae => generated 1312 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:37.544513 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-3e6f9529-8338-464b-bc59-d02b5005c01b tempest-KeyPairsV22TestJSON-611266393 tempest-KeyPairsV22TestJSON-611266393-project] Action: 'create', calling method: .version_select at 0x7fb21fc3c790>, body: {"keypair": {"name": "tempest-keypair-1023051399", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP2YM7pBoksx6Z3r1A7z9Bw7RexKj2ObJcC3kACi+MYwOYRhL0KejUBU6vE8FXuNRoD3BvXQ4xdBbFecI4ZVAKwSg4KkuauKlrVNpJ64u0SY8XS3z8tKoP7Q7iMqt1sA7g=="}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:37:37.563999 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-3e6f9529-8338-464b-bc59-d02b5005c01b tempest-KeyPairsV22TestJSON-611266393 tempest-KeyPairsV22TestJSON-611266393-project] Getting quotas for project 036a5961e2e746beb81e36c9eaabcce2. Resources: {'key_pairs'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:37:37.568609 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-3e6f9529-8338-464b-bc59-d02b5005c01b tempest-KeyPairsV22TestJSON-611266393 tempest-KeyPairsV22TestJSON-611266393-project] Getting quotas for user 554a6837c8de42e6803b0823f3a65d05 and project 036a5961e2e746beb81e36c9eaabcce2. Resources: {'key_pairs'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:37:37.637556 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-3e6f9529-8338-464b-bc59-d02b5005c01b tempest-KeyPairsV22TestJSON-611266393 tempest-KeyPairsV22TestJSON-611266393-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.097358 Oct 04 18:37:37.640963 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 768/1696] 10.222.0.43 () {62 vars in 1199 bytes} [Tue Oct 4 18:37:37 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 101 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 04 18:37:37.650832 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-7e852e67-870d-4e22-853d-2b1b68943753 tempest-KeyPairsV22TestJSON-611266393 tempest-KeyPairsV22TestJSON-611266393-project] Calling method '.version_select at 0x7fb21fc60f70>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:37.693808 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-7e852e67-870d-4e22-853d-2b1b68943753 tempest-KeyPairsV22TestJSON-611266393 tempest-KeyPairsV22TestJSON-611266393-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1023051399" status: 204 len: 0 microversion: 2.2 time: 0.048173 Oct 04 18:37:37.698175 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 769/1697] 10.222.0.43 () {60 vars in 1261 bytes} [Tue Oct 4 18:37:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1023051399 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:37:37.714275 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-f0c9b2e6-fb51-4f99-8651-31a6ef6ebaed tempest-KeyPairsV22TestJSON-611266393 tempest-KeyPairsV22TestJSON-611266393-project] Action: 'create', calling method: .version_select at 0x7fb21fe651f0>, body: {"keypair": {"name": "tempest-keypair-87716134", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:37:37.791691 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-f0c9b2e6-fb51-4f99-8651-31a6ef6ebaed tempest-KeyPairsV22TestJSON-611266393 tempest-KeyPairsV22TestJSON-611266393-project] Getting quotas for project 036a5961e2e746beb81e36c9eaabcce2. Resources: {'key_pairs'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:37:37.822581 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-f0c9b2e6-fb51-4f99-8651-31a6ef6ebaed tempest-KeyPairsV22TestJSON-611266393 tempest-KeyPairsV22TestJSON-611266393-project] Getting quotas for user 554a6837c8de42e6803b0823f3a65d05 and project 036a5961e2e746beb81e36c9eaabcce2. Resources: {'key_pairs'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:37:37.892239 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-f0c9b2e6-fb51-4f99-8651-31a6ef6ebaed tempest-KeyPairsV22TestJSON-611266393 tempest-KeyPairsV22TestJSON-611266393-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 201 len: 587 microversion: 2.2 time: 0.185430 Oct 04 18:37:37.894313 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 770/1698] 10.222.0.43 () {62 vars in 1199 bytes} [Tue Oct 4 18:37:37 2022] POST /compute/v2.1/os-keypairs => generated 587 bytes in 188 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 04 18:37:37.908905 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-eec54027-d59d-4b4d-86f1-173854df3a0d tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Calling method '.version_select at 0x7fb21fb2a310>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:37.974426 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-1fd3d630-6ba6-401c-8085-33b424a3d8a5 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:37.996192 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-1fd3d630-6ba6-401c-8085-33b424a3d8a5 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:37.998175 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-1fd3d630-6ba6-401c-8085-33b424a3d8a5 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:38.011368 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-eec54027-d59d-4b4d-86f1-173854df3a0d tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] 10.222.0.43 "GET /compute/v2.1/images/d7825145-299c-45b6-9fe8-780722b2d243" status: 200 len: 1428 microversion: 2.1 time: 0.110367 Oct 04 18:37:38.011959 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 771/1699] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 18:37:37 2022] GET /compute/v2.1/images/d7825145-299c-45b6-9fe8-780722b2d243 => generated 1428 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:38.019527 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-1fd3d630-6ba6-401c-8085-33b424a3d8a5 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] 10.222.0.43 "GET /compute/v2.1/servers/7222a4ce-d2a2-4b09-afc6-55bca52414d4" status: 200 len: 1815 microversion: 2.25 time: 0.532061 Oct 04 18:37:38.020031 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 929/1700] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:37:37 2022] GET /compute/v2.1/servers/7222a4ce-d2a2-4b09-afc6-55bca52414d4 => generated 1815 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:37:38.025390 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-7fed6711-9033-4d2e-a9cb-239fbf8a860b tempest-KeyPairsV22TestJSON-611266393 tempest-KeyPairsV22TestJSON-611266393-project] Calling method '.version_select at 0x7fb227ed89d0>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:38.076541 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-7fed6711-9033-4d2e-a9cb-239fbf8a860b tempest-KeyPairsV22TestJSON-611266393 tempest-KeyPairsV22TestJSON-611266393-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-87716134" status: 204 len: 0 microversion: 2.2 time: 0.055346 Oct 04 18:37:38.077162 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 930/1701] 10.222.0.43 () {60 vars in 1255 bytes} [Tue Oct 4 18:37:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-87716134 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:37:38.093192 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-f2a7a022-4102-497d-bc9f-ca8106121ce9 tempest-KeyPairsV22TestJSON-611266393 tempest-KeyPairsV22TestJSON-611266393-project] Action: 'create', calling method: .version_select at 0x7fb21fc60550>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-2005767851", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDeuvgFRFnvS9BgUNwn46GwvMsjWs3xA/waCk9czy231VVFFaXjayIA51lxah6blkXSbv8p4DPrIU+QFKltfQVypRissyJi7qLt10Vx8cFXEaSAvRViXCNkywph1vBiZ+g=="}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:37:38.136156 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-f2a7a022-4102-497d-bc9f-ca8106121ce9 tempest-KeyPairsV22TestJSON-611266393 tempest-KeyPairsV22TestJSON-611266393-project] Getting quotas for project 036a5961e2e746beb81e36c9eaabcce2. Resources: {'key_pairs'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:37:38.142312 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-2beb42e4-2984-4071-b90f-2f3da5fda2be tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:38.142572 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-f2a7a022-4102-497d-bc9f-ca8106121ce9 tempest-KeyPairsV22TestJSON-611266393 tempest-KeyPairsV22TestJSON-611266393-project] Getting quotas for user 554a6837c8de42e6803b0823f3a65d05 and project 036a5961e2e746beb81e36c9eaabcce2. Resources: {'key_pairs'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:37:38.143580 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-2beb42e4-2984-4071-b90f-2f3da5fda2be tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] [instance: 744f6597-f965-405c-ad7b-66a8a0f1397b] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:38.153070 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2beb42e4-2984-4071-b90f-2f3da5fda2be tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:38.159892 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2beb42e4-2984-4071-b90f-2f3da5fda2be tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:38.161904 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2beb42e4-2984-4071-b90f-2f3da5fda2be tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:38.162939 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2beb42e4-2984-4071-b90f-2f3da5fda2be tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:38.163637 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2beb42e4-2984-4071-b90f-2f3da5fda2be tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:38.168183 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2beb42e4-2984-4071-b90f-2f3da5fda2be tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:38.185664 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-f2a7a022-4102-497d-bc9f-ca8106121ce9 tempest-KeyPairsV22TestJSON-611266393 tempest-KeyPairsV22TestJSON-611266393-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.092562 Oct 04 18:37:38.198998 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 772/1702] 10.222.0.43 () {62 vars in 1199 bytes} [Tue Oct 4 18:37:38 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 101 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 04 18:37:38.206958 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-43be58d6-c228-4acc-b708-d9093440fea6 tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:38.210120 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-43be58d6-c228-4acc-b708-d9093440fea6 tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] [instance: bea29c43-a5ab-42b3-9d5d-3b0f4f0f30f3] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:38.214663 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=100 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:37:38.219681 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-43be58d6-c228-4acc-b708-d9093440fea6 tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:38.220408 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-43be58d6-c228-4acc-b708-d9093440fea6 tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:38.222429 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-43be58d6-c228-4acc-b708-d9093440fea6 tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:38.224107 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-43be58d6-c228-4acc-b708-d9093440fea6 tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:38.224970 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-43be58d6-c228-4acc-b708-d9093440fea6 tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:38.225698 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-43be58d6-c228-4acc-b708-d9093440fea6 tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:38.548729 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-2beb42e4-2984-4071-b90f-2f3da5fda2be tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa193aff0474ae3ba5d1aa7b0d0e8c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a06b8feba3404490a448aa2d4fb106b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:38.561408 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-2beb42e4-2984-4071-b90f-2f3da5fda2be tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] 10.222.0.43 "GET /compute/v2.1/servers/744f6597-f965-405c-ad7b-66a8a0f1397b" status: 200 len: 1520 microversion: 2.1 time: 0.423987 Oct 04 18:37:38.567847 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 931/1703] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:38 2022] GET /compute/v2.1/servers/744f6597-f965-405c-ad7b-66a8a0f1397b => generated 1520 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:37:38.573204 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-62100d74-f7c3-4971-9e26-c5073096e2b8 tempest-KeyPairsV22TestJSON-611266393 tempest-KeyPairsV22TestJSON-611266393-project] Action: 'create', calling method: .version_select at 0x7fb227d86790>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-307367725", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP6OZcChMi5P3fn4O2tEPSPTjrUHtDWsEsixE0p7G51JZ8+s27mSD4Aqc8ieol8Zk/av4DgFu80gvc736EBLwY7HOJijA1EdZpssvwpVTu3stHdpMBCv8GLNA7y7oDnNzQ=="}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:37:38.612221 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-62100d74-f7c3-4971-9e26-c5073096e2b8 tempest-KeyPairsV22TestJSON-611266393 tempest-KeyPairsV22TestJSON-611266393-project] Getting quotas for project 036a5961e2e746beb81e36c9eaabcce2. Resources: {'key_pairs'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:37:38.617604 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-62100d74-f7c3-4971-9e26-c5073096e2b8 tempest-KeyPairsV22TestJSON-611266393 tempest-KeyPairsV22TestJSON-611266393-project] Getting quotas for user 554a6837c8de42e6803b0823f3a65d05 and project 036a5961e2e746beb81e36c9eaabcce2. Resources: {'key_pairs'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:37:38.657103 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-62100d74-f7c3-4971-9e26-c5073096e2b8 tempest-KeyPairsV22TestJSON-611266393 tempest-KeyPairsV22TestJSON-611266393-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.087686 Oct 04 18:37:38.668488 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 932/1704] 10.222.0.43 () {62 vars in 1199 bytes} [Tue Oct 4 18:37:38 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 100 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 04 18:37:38.675391 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-22f6954b-1938-4f41-bd32-909092cfb365 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:38.676190 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-22f6954b-1938-4f41-bd32-909092cfb365 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] [instance: 64228016-ae20-4fcb-87da-c3d4d585e241] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:38.683856 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-22f6954b-1938-4f41-bd32-909092cfb365 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:38.684466 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-22f6954b-1938-4f41-bd32-909092cfb365 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:38.685048 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-22f6954b-1938-4f41-bd32-909092cfb365 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:38.686116 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-22f6954b-1938-4f41-bd32-909092cfb365 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:38.687454 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-22f6954b-1938-4f41-bd32-909092cfb365 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:38.688134 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-22f6954b-1938-4f41-bd32-909092cfb365 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:38.716156 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-22f6954b-1938-4f41-bd32-909092cfb365 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] HTTP exception thrown: Instance 64228016-ae20-4fcb-87da-c3d4d585e241 could not be found. Oct 04 18:37:38.718365 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-22f6954b-1938-4f41-bd32-909092cfb365 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Request method failure captured: Oct 04 18:37:38.718365 n-d-851028-13 devstack@n-api.service[123596]: request: GET /compute/v2.1/servers/64228016-ae20-4fcb-87da-c3d4d585e241 HTTP/1.1 Oct 04 18:37:38.718365 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:37:38.718365 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:37:38.718365 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:37:38.718365 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 18:37:38.718365 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:37:38.718365 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:37:38.718365 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:37:38.718365 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:37:38.718365 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPHx6gAhOQR9SzxsaQbdLvvDvFzwkrsL-eso5wPcIMTe7QTGQ8GNpGTh82q09olF7Uzd5vnfi_owSOym5Q6Nw1rEFuVgt0OVgeRF4PHNfL8zRO2fxXQeqtj7eemFhMAlgrZ0t6cEXPXGxP4C7AYLZO84Rlcv3L9rcqzDiRnnfGTw4VIc Oct 04 18:37:38.718365 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:37:38.718365 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:37:38.718365 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:37:38.718365 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:37:38.718365 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:37:38.718365 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:37:38.718365 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: 4fa31ed92017490a82497c7b8910aef0 Oct 04 18:37:38.718365 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-ImagesTestJSON-306433374 Oct 04 18:37:38.718365 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 18:37:38.718365 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 18:37:38.718365 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/4fa31ed92017490a82497c7b8910aef0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_4fa31ed92017490a82497c7b8910aef0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4fa31ed92017490a82497c7b8910aef0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4fa31ed92017490a82497c7b8910aef0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:37:38.718365 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-ImagesTestJSON-306433374 Oct 04 18:37:38.718365 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: 4fa31ed92017490a82497c7b8910aef0 Oct 04 18:37:38.718365 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-ImagesTestJSON-306433374 Oct 04 18:37:38.718365 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-ImagesTestJSON-306433374-project Oct 04 18:37:38.718365 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:37:38.718365 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:37:38.718365 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 5a41ab6fb78a42ceaca621c5a38ffc6d Oct 04 18:37:38.718365 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-ImagesTestJSON-306433374-project Oct 04 18:37:38.718365 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 18:37:38.718365 n-d-851028-13 devstack@n-api.service[123596]: exception: Instance 64228016-ae20-4fcb-87da-c3d4d585e241 could not be found. Oct 04 18:37:38.718365 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': '64228016-ae20-4fcb-87da-c3d4d585e241'} Oct 04 18:37:38.718365 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:37:38.718365 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:38.718365 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:37:38.718365 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:37:38.718365 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:37:38.718365 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:37:38.718365 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:37:38.718365 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:37:38.718365 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:37:38.718365 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:37:38.718365 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64228016-ae20-4fcb-87da-c3d4d585e241 could not be found. Oct 04 18:37:38.718365 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:37:38.718365 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:37:38.718365 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:37:38.718365 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:38.718365 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:37:38.718365 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:37:38.718365 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:37:38.718365 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:37:38.718365 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:37:38.718365 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:37:38.718365 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:37:38.718365 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:37:38.718365 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:37:38.718365 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:37:38.718365 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:37:38.718365 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:37:38.718365 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64228016-ae20-4fcb-87da-c3d4d585e241 could not be found. Oct 04 18:37:38.718365 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:37:38.718365 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:37:38.718365 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:37:38.718365 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:38.723401 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:37:38.723401 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:37:38.723401 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:37:38.723401 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:37:38.723401 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64228016-ae20-4fcb-87da-c3d4d585e241 could not be found. Oct 04 18:37:38.723401 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:37:38.725906 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-22f6954b-1938-4f41-bd32-909092cfb365 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Returning 404 to user: Instance 64228016-ae20-4fcb-87da-c3d4d585e241 could not be found. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:37:38.726794 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-22f6954b-1938-4f41-bd32-909092cfb365 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] 10.222.0.43 "GET /compute/v2.1/servers/64228016-ae20-4fcb-87da-c3d4d585e241" status: 404 len: 111 microversion: 2.1 time: 0.056384 Oct 04 18:37:38.727371 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 933/1705] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:38 2022] GET /compute/v2.1/servers/64228016-ae20-4fcb-87da-c3d4d585e241 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:37:38.741954 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-d7195008-0eb5-41df-824c-f2239caa120a tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:38.742986 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-d7195008-0eb5-41df-824c-f2239caa120a tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: d85af512-1b1f-42a4-9bb1-963cc956c9ae] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:38.745499 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-43be58d6-c228-4acc-b708-d9093440fea6 tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de84075cb5a44e83a41516b687f07e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9d3dec7f864f42adcd6e9c20043832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:38.750907 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d7195008-0eb5-41df-824c-f2239caa120a tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:38.752033 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d7195008-0eb5-41df-824c-f2239caa120a tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:38.752731 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d7195008-0eb5-41df-824c-f2239caa120a tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:38.753810 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d7195008-0eb5-41df-824c-f2239caa120a tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:38.755920 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d7195008-0eb5-41df-824c-f2239caa120a tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:38.756614 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d7195008-0eb5-41df-824c-f2239caa120a tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:38.759855 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-43be58d6-c228-4acc-b708-d9093440fea6 tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] 10.222.0.43 "GET /compute/v2.1/servers/bea29c43-a5ab-42b3-9d5d-3b0f4f0f30f3" status: 200 len: 1316 microversion: 2.1 time: 0.559496 Oct 04 18:37:38.760460 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 773/1706] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:38 2022] GET /compute/v2.1/servers/bea29c43-a5ab-42b3-9d5d-3b0f4f0f30f3 => generated 1316 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:38.785076 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-3cb12786-d034-4284-aa8b-3142df656b40 tempest-KeyPairsV22TestJSON-611266393 tempest-KeyPairsV22TestJSON-611266393-project] Action: 'create', calling method: .version_select at 0x7fb21fc3c8b0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1092103002", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJDZoHsSIZy9Aw94hKctgplncpAbfmwzmPu4ztuclvLPH/XtmQ/vCXt3zl+Q1/e9jPSunW/NozECsPRuv4wQsWgPS+6LWxrjSkGV1Gdm/zuIvK6KCUWsDJrB94tgOXfhUA=="}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:37:38.829368 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-3cb12786-d034-4284-aa8b-3142df656b40 tempest-KeyPairsV22TestJSON-611266393 tempest-KeyPairsV22TestJSON-611266393-project] Getting quotas for project 036a5961e2e746beb81e36c9eaabcce2. Resources: {'key_pairs'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:37:38.839014 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-3cb12786-d034-4284-aa8b-3142df656b40 tempest-KeyPairsV22TestJSON-611266393 tempest-KeyPairsV22TestJSON-611266393-project] Getting quotas for user 554a6837c8de42e6803b0823f3a65d05 and project 036a5961e2e746beb81e36c9eaabcce2. Resources: {'key_pairs'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:37:38.892245 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-3cb12786-d034-4284-aa8b-3142df656b40 tempest-KeyPairsV22TestJSON-611266393 tempest-KeyPairsV22TestJSON-611266393-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.126698 Oct 04 18:37:38.892844 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 774/1707] 10.222.0.43 () {62 vars in 1199 bytes} [Tue Oct 4 18:37:38 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 128 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 04 18:37:38.908519 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-1678769e-2c77-48e6-adcd-c6c69b920ba2 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Calling method '.version_select at 0x7fb21f834670>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:38.938720 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-1678769e-2c77-48e6-adcd-c6c69b920ba2 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] HTTP exception thrown: Image not found. Oct 04 18:37:38.943203 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-1678769e-2c77-48e6-adcd-c6c69b920ba2 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Request method failure captured: Oct 04 18:37:38.943203 n-d-851028-13 devstack@n-api.service[123595]: request: DELETE /compute/v2.1/images/c7776971-442e-4bf2-8d58-f38b00ff4b4a HTTP/1.1 Oct 04 18:37:38.943203 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 18:37:38.943203 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 18:37:38.943203 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 18:37:38.943203 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 0 Oct 04 18:37:38.943203 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 18:37:38.943203 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 18:37:38.943203 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 18:37:38.943203 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 18:37:38.943203 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPHx6gAhOQR9SzxsaQbdLvvDvFzwkrsL-eso5wPcIMTe7QTGQ8GNpGTh82q09olF7Uzd5vnfi_owSOym5Q6Nw1rEFuVgt0OVgeRF4PHNfL8zRO2fxXQeqtj7eemFhMAlgrZ0t6cEXPXGxP4C7AYLZO84Rlcv3L9rcqzDiRnnfGTw4VIc Oct 04 18:37:38.943203 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 18:37:38.943203 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 18:37:38.943203 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 18:37:38.943203 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 18:37:38.943203 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 18:37:38.943203 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 18:37:38.943203 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: 4fa31ed92017490a82497c7b8910aef0 Oct 04 18:37:38.943203 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-ImagesTestJSON-306433374 Oct 04 18:37:38.943203 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 18:37:38.943203 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 18:37:38.943203 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/4fa31ed92017490a82497c7b8910aef0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_4fa31ed92017490a82497c7b8910aef0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4fa31ed92017490a82497c7b8910aef0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4fa31ed92017490a82497c7b8910aef0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:37:38.943203 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-ImagesTestJSON-306433374 Oct 04 18:37:38.943203 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: 4fa31ed92017490a82497c7b8910aef0 Oct 04 18:37:38.943203 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-ImagesTestJSON-306433374 Oct 04 18:37:38.943203 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-ImagesTestJSON-306433374-project Oct 04 18:37:38.943203 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 18:37:38.943203 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 18:37:38.943203 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: 5a41ab6fb78a42ceaca621c5a38ffc6d Oct 04 18:37:38.943203 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-ImagesTestJSON-306433374-project Oct 04 18:37:38.943203 n-d-851028-13 devstack@n-api.service[123595]: method: Oct 04 18:37:38.943203 n-d-851028-13 devstack@n-api.service[123595]: exception: Image not found. Oct 04 18:37:38.943203 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': 'c7776971-442e-4bf2-8d58-f38b00ff4b4a'} Oct 04 18:37:38.943203 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:37:38.943203 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:38.943203 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 04 18:37:38.943203 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 04 18:37:38.943203 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 18:37:38.943203 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 18:37:38.943203 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 18:37:38.943203 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 18:37:38.943203 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 04 18:37:38.943203 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 04 18:37:38.943203 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 04 18:37:38.943203 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 04 18:37:38.943203 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 18:37:38.943203 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 18:37:38.943203 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 18:37:38.943203 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 18:37:38.943203 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image c7776971-442e-4bf2-8d58-f38b00ff4b4a to delete Oct 04 18:37:38.943203 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:37:38.943203 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:37:38.943203 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:37:38.943203 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:38.943203 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 04 18:37:38.943203 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 04 18:37:38.943203 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 04 18:37:38.943203 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 04 18:37:38.943203 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 04 18:37:38.943203 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 04 18:37:38.943203 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image c7776971-442e-4bf2-8d58-f38b00ff4b4a could not be found. Oct 04 18:37:38.943203 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:37:38.943203 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:37:38.943203 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:37:38.943203 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:38.947851 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:37:38.947851 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:37:38.947851 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:37:38.947851 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:37:38.947851 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:37:38.947851 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:37:38.947851 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:37:38.947851 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:37:38.947851 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 04 18:37:38.947851 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 18:37:38.947851 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 18:37:38.947851 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:37:38.947851 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:37:38.947851 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:37:38.947851 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:38.947851 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:37:38.947851 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:37:38.947851 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:37:38.947851 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:37:38.947851 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 18:37:38.947851 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:37:38.953465 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-1678769e-2c77-48e6-adcd-c6c69b920ba2 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Returning 404 to user: Image not found. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:37:38.955853 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-1678769e-2c77-48e6-adcd-c6c69b920ba2 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] 10.222.0.43 "DELETE /compute/v2.1/images/c7776971-442e-4bf2-8d58-f38b00ff4b4a" status: 404 len: 62 microversion: 2.1 time: 0.053617 Oct 04 18:37:38.964415 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 775/1708] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:38 2022] DELETE /compute/v2.1/images/c7776971-442e-4bf2-8d58-f38b00ff4b4a => generated 62 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:37:38.992071 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-6a6598ec-ef74-4d89-8699-0b22bd42518c tempest-KeyPairsV22TestJSON-611266393 tempest-KeyPairsV22TestJSON-611266393-project] Calling method '.version_select at 0x7fb21f834ee0>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:39.011233 n-d-851028-13 devstack@n-api.service[123595]: WARNING oslo_db.sqlalchemy.utils [None req-6a6598ec-ef74-4d89-8699-0b22bd42518c tempest-KeyPairsV22TestJSON-611266393 tempest-KeyPairsV22TestJSON-611266393-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 04 18:37:39.025400 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-6a6598ec-ef74-4d89-8699-0b22bd42518c tempest-KeyPairsV22TestJSON-611266393 tempest-KeyPairsV22TestJSON-611266393-project] 10.222.0.43 "GET /compute/v2.1/os-keypairs" status: 200 len: 1141 microversion: 2.2 time: 0.059763 Oct 04 18:37:39.029895 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 776/1709] 10.222.0.43 () {60 vars in 1177 bytes} [Tue Oct 4 18:37:38 2022] GET /compute/v2.1/os-keypairs => generated 1141 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:39.050077 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-77f93257-d97b-4acb-b81c-87f1c5b52af9 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:39.051249 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-77f93257-d97b-4acb-b81c-87f1c5b52af9 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] [instance: 9ee1bd28-0921-4444-afe3-c09cbfa0680a] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:39.067500 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-77f93257-d97b-4acb-b81c-87f1c5b52af9 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:39.068372 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-77f93257-d97b-4acb-b81c-87f1c5b52af9 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:39.069027 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-77f93257-d97b-4acb-b81c-87f1c5b52af9 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:39.070024 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-77f93257-d97b-4acb-b81c-87f1c5b52af9 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:39.070690 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-77f93257-d97b-4acb-b81c-87f1c5b52af9 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:39.073609 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-77f93257-d97b-4acb-b81c-87f1c5b52af9 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:39.098750 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-77f93257-d97b-4acb-b81c-87f1c5b52af9 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] HTTP exception thrown: Instance 9ee1bd28-0921-4444-afe3-c09cbfa0680a could not be found. Oct 04 18:37:39.102785 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-77f93257-d97b-4acb-b81c-87f1c5b52af9 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Request method failure captured: Oct 04 18:37:39.102785 n-d-851028-13 devstack@n-api.service[123595]: request: DELETE /compute/v2.1/servers/9ee1bd28-0921-4444-afe3-c09cbfa0680a HTTP/1.1 Oct 04 18:37:39.102785 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 18:37:39.102785 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 18:37:39.102785 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 18:37:39.102785 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 0 Oct 04 18:37:39.102785 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 18:37:39.102785 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 18:37:39.102785 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 18:37:39.102785 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 18:37:39.102785 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPHx6gAhOQR9SzxsaQbdLvvDvFzwkrsL-eso5wPcIMTe7QTGQ8GNpGTh82q09olF7Uzd5vnfi_owSOym5Q6Nw1rEFuVgt0OVgeRF4PHNfL8zRO2fxXQeqtj7eemFhMAlgrZ0t6cEXPXGxP4C7AYLZO84Rlcv3L9rcqzDiRnnfGTw4VIc Oct 04 18:37:39.102785 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 18:37:39.102785 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 18:37:39.102785 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 18:37:39.102785 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 18:37:39.102785 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 18:37:39.102785 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 18:37:39.102785 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: 4fa31ed92017490a82497c7b8910aef0 Oct 04 18:37:39.102785 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-ImagesTestJSON-306433374 Oct 04 18:37:39.102785 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 18:37:39.102785 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 18:37:39.102785 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/4fa31ed92017490a82497c7b8910aef0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_4fa31ed92017490a82497c7b8910aef0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4fa31ed92017490a82497c7b8910aef0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4fa31ed92017490a82497c7b8910aef0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:37:39.102785 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-ImagesTestJSON-306433374 Oct 04 18:37:39.102785 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: 4fa31ed92017490a82497c7b8910aef0 Oct 04 18:37:39.102785 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-ImagesTestJSON-306433374 Oct 04 18:37:39.102785 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-ImagesTestJSON-306433374-project Oct 04 18:37:39.102785 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 18:37:39.102785 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 18:37:39.102785 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: 5a41ab6fb78a42ceaca621c5a38ffc6d Oct 04 18:37:39.102785 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-ImagesTestJSON-306433374-project Oct 04 18:37:39.102785 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 18:37:39.102785 n-d-851028-13 devstack@n-api.service[123595]: exception: Instance 9ee1bd28-0921-4444-afe3-c09cbfa0680a could not be found. Oct 04 18:37:39.102785 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': '9ee1bd28-0921-4444-afe3-c09cbfa0680a'} Oct 04 18:37:39.102785 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:37:39.102785 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:39.102785 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:37:39.102785 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:37:39.102785 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:37:39.102785 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:37:39.102785 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:37:39.102785 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:37:39.102785 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:37:39.102785 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:37:39.102785 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ee1bd28-0921-4444-afe3-c09cbfa0680a could not be found. Oct 04 18:37:39.102785 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:37:39.102785 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:37:39.102785 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:37:39.102785 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:39.102785 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:37:39.102785 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:37:39.102785 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:37:39.102785 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:37:39.102785 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:37:39.102785 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:37:39.102785 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:37:39.102785 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:37:39.102785 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:37:39.102785 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:37:39.102785 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:37:39.102785 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:37:39.102785 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:37:39.102785 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:37:39.102785 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ee1bd28-0921-4444-afe3-c09cbfa0680a could not be found. Oct 04 18:37:39.108598 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:37:39.108598 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:37:39.108598 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:37:39.108598 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:39.108598 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:37:39.108598 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:37:39.108598 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:37:39.108598 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:37:39.108598 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ee1bd28-0921-4444-afe3-c09cbfa0680a could not be found. Oct 04 18:37:39.108598 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:37:39.114423 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-77f93257-d97b-4acb-b81c-87f1c5b52af9 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Returning 404 to user: Instance 9ee1bd28-0921-4444-afe3-c09cbfa0680a could not be found. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:37:39.117986 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-77f93257-d97b-4acb-b81c-87f1c5b52af9 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] 10.222.0.43 "DELETE /compute/v2.1/servers/9ee1bd28-0921-4444-afe3-c09cbfa0680a" status: 404 len: 111 microversion: 2.1 time: 0.084352 Oct 04 18:37:39.122694 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 777/1710] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 18:37:39 2022] DELETE /compute/v2.1/servers/9ee1bd28-0921-4444-afe3-c09cbfa0680a => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:37:39.131122 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-6a016d36-8e52-4586-8d8e-1bd4da6e07b4 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Calling method '.version_select at 0x7fb21fa3a040>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:39.216253 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-6a016d36-8e52-4586-8d8e-1bd4da6e07b4 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] 10.222.0.43 "GET /compute/v2.1/images/d7825145-299c-45b6-9fe8-780722b2d243" status: 200 len: 1428 microversion: 2.1 time: 0.092065 Oct 04 18:37:39.217685 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 778/1711] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 18:37:39 2022] GET /compute/v2.1/images/d7825145-299c-45b6-9fe8-780722b2d243 => generated 1428 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:39.226142 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-d7195008-0eb5-41df-824c-f2239caa120a tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:39.229523 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-d7195008-0eb5-41df-824c-f2239caa120a tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/d85af512-1b1f-42a4-9bb1-963cc956c9ae" status: 200 len: 1312 microversion: 2.1 time: 0.500701 Oct 04 18:37:39.244755 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 934/1712] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:38 2022] GET /compute/v2.1/servers/d85af512-1b1f-42a4-9bb1-963cc956c9ae => generated 1312 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:39.244755 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-73cd8483-f6e8-4e07-bf9a-36e3e12d5bd2 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:39.247506 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-73cd8483-f6e8-4e07-bf9a-36e3e12d5bd2 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] [instance: 7222a4ce-d2a2-4b09-afc6-55bca52414d4] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:39.248895 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-717dee90-e2c1-4a21-b035-b6c14a2ea4cf tempest-KeyPairsV22TestJSON-611266393 tempest-KeyPairsV22TestJSON-611266393-project] Calling method '.version_select at 0x7fb21fb41b80>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:39.264822 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-73cd8483-f6e8-4e07-bf9a-36e3e12d5bd2 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:39.267849 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-73cd8483-f6e8-4e07-bf9a-36e3e12d5bd2 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:39.269356 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-73cd8483-f6e8-4e07-bf9a-36e3e12d5bd2 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:39.271065 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=2,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:37:39.272879 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-73cd8483-f6e8-4e07-bf9a-36e3e12d5bd2 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:39.273792 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-73cd8483-f6e8-4e07-bf9a-36e3e12d5bd2 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:39.274815 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-73cd8483-f6e8-4e07-bf9a-36e3e12d5bd2 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:39.284380 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-717dee90-e2c1-4a21-b035-b6c14a2ea4cf tempest-KeyPairsV22TestJSON-611266393 tempest-KeyPairsV22TestJSON-611266393-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1092103002" status: 204 len: 0 microversion: 2.2 time: 0.053755 Oct 04 18:37:39.285341 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 779/1713] 10.222.0.43 () {60 vars in 1321 bytes} [Tue Oct 4 18:37:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1092103002 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:37:39.297043 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-e185500c-dc88-4be3-9562-1a12e64d46be tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:39.301883 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-e185500c-dc88-4be3-9562-1a12e64d46be tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] [instance: 9ee1bd28-0921-4444-afe3-c09cbfa0680a] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:39.323605 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e185500c-dc88-4be3-9562-1a12e64d46be tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:39.324104 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e185500c-dc88-4be3-9562-1a12e64d46be tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:39.325768 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e185500c-dc88-4be3-9562-1a12e64d46be tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:39.329984 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e185500c-dc88-4be3-9562-1a12e64d46be tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:39.331585 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e185500c-dc88-4be3-9562-1a12e64d46be tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:39.332906 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e185500c-dc88-4be3-9562-1a12e64d46be tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:39.366330 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-e185500c-dc88-4be3-9562-1a12e64d46be tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] HTTP exception thrown: Instance 9ee1bd28-0921-4444-afe3-c09cbfa0680a could not be found. Oct 04 18:37:39.374935 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-e185500c-dc88-4be3-9562-1a12e64d46be tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Request method failure captured: Oct 04 18:37:39.374935 n-d-851028-13 devstack@n-api.service[123595]: request: GET /compute/v2.1/servers/9ee1bd28-0921-4444-afe3-c09cbfa0680a HTTP/1.1 Oct 04 18:37:39.374935 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 18:37:39.374935 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 18:37:39.374935 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 18:37:39.374935 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 0 Oct 04 18:37:39.374935 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 18:37:39.374935 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 18:37:39.374935 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 18:37:39.374935 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 18:37:39.374935 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPHx6gAhOQR9SzxsaQbdLvvDvFzwkrsL-eso5wPcIMTe7QTGQ8GNpGTh82q09olF7Uzd5vnfi_owSOym5Q6Nw1rEFuVgt0OVgeRF4PHNfL8zRO2fxXQeqtj7eemFhMAlgrZ0t6cEXPXGxP4C7AYLZO84Rlcv3L9rcqzDiRnnfGTw4VIc Oct 04 18:37:39.374935 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 18:37:39.374935 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 18:37:39.374935 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 18:37:39.374935 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 18:37:39.374935 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 18:37:39.374935 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 18:37:39.374935 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: 4fa31ed92017490a82497c7b8910aef0 Oct 04 18:37:39.374935 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-ImagesTestJSON-306433374 Oct 04 18:37:39.374935 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 18:37:39.374935 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 18:37:39.374935 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/4fa31ed92017490a82497c7b8910aef0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_4fa31ed92017490a82497c7b8910aef0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4fa31ed92017490a82497c7b8910aef0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4fa31ed92017490a82497c7b8910aef0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:37:39.374935 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-ImagesTestJSON-306433374 Oct 04 18:37:39.374935 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: 4fa31ed92017490a82497c7b8910aef0 Oct 04 18:37:39.374935 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-ImagesTestJSON-306433374 Oct 04 18:37:39.374935 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-ImagesTestJSON-306433374-project Oct 04 18:37:39.374935 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 18:37:39.374935 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 18:37:39.374935 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: 5a41ab6fb78a42ceaca621c5a38ffc6d Oct 04 18:37:39.374935 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-ImagesTestJSON-306433374-project Oct 04 18:37:39.374935 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 18:37:39.374935 n-d-851028-13 devstack@n-api.service[123595]: exception: Instance 9ee1bd28-0921-4444-afe3-c09cbfa0680a could not be found. Oct 04 18:37:39.374935 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': '9ee1bd28-0921-4444-afe3-c09cbfa0680a'} Oct 04 18:37:39.374935 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:37:39.374935 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:39.374935 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:37:39.374935 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:37:39.374935 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:37:39.374935 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:37:39.374935 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:37:39.374935 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:37:39.374935 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:37:39.374935 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:37:39.374935 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ee1bd28-0921-4444-afe3-c09cbfa0680a could not be found. Oct 04 18:37:39.374935 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:37:39.374935 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:37:39.374935 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:37:39.374935 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:39.374935 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:37:39.374935 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:37:39.374935 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:37:39.374935 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:37:39.374935 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:37:39.374935 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:37:39.374935 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:37:39.374935 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:37:39.374935 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:37:39.374935 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:37:39.374935 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:37:39.374935 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:37:39.374935 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ee1bd28-0921-4444-afe3-c09cbfa0680a could not be found. Oct 04 18:37:39.374935 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:37:39.374935 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:37:39.374935 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:37:39.374935 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:39.381462 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:37:39.381462 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:37:39.381462 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:37:39.381462 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:37:39.381462 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ee1bd28-0921-4444-afe3-c09cbfa0680a could not be found. Oct 04 18:37:39.381462 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:37:39.381462 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-e185500c-dc88-4be3-9562-1a12e64d46be tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Returning 404 to user: Instance 9ee1bd28-0921-4444-afe3-c09cbfa0680a could not be found. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:37:39.381462 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-e185500c-dc88-4be3-9562-1a12e64d46be tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] 10.222.0.43 "GET /compute/v2.1/servers/9ee1bd28-0921-4444-afe3-c09cbfa0680a" status: 404 len: 111 microversion: 2.1 time: 0.088338 Oct 04 18:37:39.381462 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 780/1714] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:39 2022] GET /compute/v2.1/servers/9ee1bd28-0921-4444-afe3-c09cbfa0680a => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:37:39.390961 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-ce5eb0e6-94e5-405c-9717-36fbd74d658e req-f66b3821-690a-498e-969f-aa660fb1c3f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "744f6597-f965-405c-ad7b-66a8a0f1397b", "name": "network-vif-deleted", "tag": "e8aa70a4-f808-4675-a8cb-ceaa0108ff63"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:37:39.442819 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-ce5eb0e6-94e5-405c-9717-36fbd74d658e req-f66b3821-690a-498e-969f-aa660fb1c3f6 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:39.445690 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-ce5eb0e6-94e5-405c-9717-36fbd74d658e req-f66b3821-690a-498e-969f-aa660fb1c3f6 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:39.446753 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-ce5eb0e6-94e5-405c-9717-36fbd74d658e req-f66b3821-690a-498e-969f-aa660fb1c3f6 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:39.484439 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-ce5eb0e6-94e5-405c-9717-36fbd74d658e req-f66b3821-690a-498e-969f-aa660fb1c3f6 service nova] Creating event network-vif-deleted:e8aa70a4-f808-4675-a8cb-ceaa0108ff63 for instance 744f6597-f965-405c-ad7b-66a8a0f1397b on n-h2-851028-13 Oct 04 18:37:39.502069 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-ce5eb0e6-94e5-405c-9717-36fbd74d658e req-f66b3821-690a-498e-969f-aa660fb1c3f6 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121311 Oct 04 18:37:39.506673 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 781/1715] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:37:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:37:39.523503 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-131e0081-3dde-47b0-a63b-baca2ae3fbbe tempest-KeyPairsV22TestJSON-611266393 tempest-KeyPairsV22TestJSON-611266393-project] Calling method '.version_select at 0x7fb21fbfe0d0>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:39.577881 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-131e0081-3dde-47b0-a63b-baca2ae3fbbe tempest-KeyPairsV22TestJSON-611266393 tempest-KeyPairsV22TestJSON-611266393-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-307367725" status: 204 len: 0 microversion: 2.2 time: 0.069379 Oct 04 18:37:39.579394 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 782/1716] 10.222.0.43 () {60 vars in 1318 bytes} [Tue Oct 4 18:37:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-307367725 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:37:39.584717 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-73cd8483-f6e8-4e07-bf9a-36e3e12d5bd2 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:39.599795 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-73cd8483-f6e8-4e07-bf9a-36e3e12d5bd2 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:39.603112 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-cb164cde-0826-425c-a3c5-dc3ce7354e2c req-b95aaaf4-d7dd-4dd8-a1a9-75f2ae2d1abe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bea29c43-a5ab-42b3-9d5d-3b0f4f0f30f3", "tag": "b42ba2ea-c6ef-4e9b-937f-48b377bf9659"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:37:39.603742 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-73cd8483-f6e8-4e07-bf9a-36e3e12d5bd2 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:39.607246 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-73cd8483-f6e8-4e07-bf9a-36e3e12d5bd2 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] 10.222.0.43 "GET /compute/v2.1/servers/7222a4ce-d2a2-4b09-afc6-55bca52414d4" status: 200 len: 1815 microversion: 2.25 time: 0.373041 Oct 04 18:37:39.611897 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 935/1717] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:37:39 2022] GET /compute/v2.1/servers/7222a4ce-d2a2-4b09-afc6-55bca52414d4 => generated 1815 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:37:39.623180 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-200611d3-0be6-4387-bfa7-7507bd9c7ae6 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Calling method '.version_select at 0x7fb224545670>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:39.638116 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-cb164cde-0826-425c-a3c5-dc3ce7354e2c req-b95aaaf4-d7dd-4dd8-a1a9-75f2ae2d1abe service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:39.642503 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-cb164cde-0826-425c-a3c5-dc3ce7354e2c req-b95aaaf4-d7dd-4dd8-a1a9-75f2ae2d1abe service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:39.643406 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-cb164cde-0826-425c-a3c5-dc3ce7354e2c req-b95aaaf4-d7dd-4dd8-a1a9-75f2ae2d1abe service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:39.665237 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-cb164cde-0826-425c-a3c5-dc3ce7354e2c req-b95aaaf4-d7dd-4dd8-a1a9-75f2ae2d1abe service nova] Creating event network-changed:b42ba2ea-c6ef-4e9b-937f-48b377bf9659 for instance bea29c43-a5ab-42b3-9d5d-3b0f4f0f30f3 on n-h1-851028-13 Oct 04 18:37:39.668084 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-200611d3-0be6-4387-bfa7-7507bd9c7ae6 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] HTTP exception thrown: Image not found. Oct 04 18:37:39.674496 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-200611d3-0be6-4387-bfa7-7507bd9c7ae6 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Request method failure captured: Oct 04 18:37:39.674496 n-d-851028-13 devstack@n-api.service[123596]: request: DELETE /compute/v2.1/images/37400fa2-9016-4a4d-831a-321e28ef058c HTTP/1.1 Oct 04 18:37:39.674496 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:37:39.674496 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:37:39.674496 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:37:39.674496 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 18:37:39.674496 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:37:39.674496 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:37:39.674496 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:37:39.674496 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:37:39.674496 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPHx6gAhOQR9SzxsaQbdLvvDvFzwkrsL-eso5wPcIMTe7QTGQ8GNpGTh82q09olF7Uzd5vnfi_owSOym5Q6Nw1rEFuVgt0OVgeRF4PHNfL8zRO2fxXQeqtj7eemFhMAlgrZ0t6cEXPXGxP4C7AYLZO84Rlcv3L9rcqzDiRnnfGTw4VIc Oct 04 18:37:39.674496 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:37:39.674496 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:37:39.674496 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:37:39.674496 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:37:39.674496 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:37:39.674496 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:37:39.674496 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: 4fa31ed92017490a82497c7b8910aef0 Oct 04 18:37:39.674496 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-ImagesTestJSON-306433374 Oct 04 18:37:39.674496 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 18:37:39.674496 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 18:37:39.674496 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/4fa31ed92017490a82497c7b8910aef0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_4fa31ed92017490a82497c7b8910aef0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4fa31ed92017490a82497c7b8910aef0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4fa31ed92017490a82497c7b8910aef0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:37:39.674496 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-ImagesTestJSON-306433374 Oct 04 18:37:39.674496 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: 4fa31ed92017490a82497c7b8910aef0 Oct 04 18:37:39.674496 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-ImagesTestJSON-306433374 Oct 04 18:37:39.674496 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-ImagesTestJSON-306433374-project Oct 04 18:37:39.674496 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:37:39.674496 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:37:39.674496 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 5a41ab6fb78a42ceaca621c5a38ffc6d Oct 04 18:37:39.674496 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-ImagesTestJSON-306433374-project Oct 04 18:37:39.674496 n-d-851028-13 devstack@n-api.service[123596]: method: Oct 04 18:37:39.674496 n-d-851028-13 devstack@n-api.service[123596]: exception: Image not found. Oct 04 18:37:39.674496 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': '37400fa2-9016-4a4d-831a-321e28ef058c'} Oct 04 18:37:39.674496 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:37:39.674496 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:39.674496 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 04 18:37:39.674496 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 04 18:37:39.674496 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 18:37:39.674496 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 18:37:39.674496 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 18:37:39.674496 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 18:37:39.674496 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 04 18:37:39.674496 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 04 18:37:39.674496 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 04 18:37:39.674496 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 04 18:37:39.674496 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 18:37:39.674496 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 18:37:39.674496 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 18:37:39.674496 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 18:37:39.674496 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 37400fa2-9016-4a4d-831a-321e28ef058c to delete Oct 04 18:37:39.674496 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:37:39.674496 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:37:39.674496 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:37:39.674496 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:39.674496 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 04 18:37:39.674496 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 04 18:37:39.674496 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 04 18:37:39.674496 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 04 18:37:39.674496 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 04 18:37:39.674496 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 04 18:37:39.674496 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 37400fa2-9016-4a4d-831a-321e28ef058c could not be found. Oct 04 18:37:39.674496 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:37:39.674496 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:37:39.674496 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:37:39.674496 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:39.679620 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:37:39.679620 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:37:39.679620 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:37:39.679620 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:37:39.679620 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:37:39.679620 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:37:39.679620 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:37:39.679620 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:37:39.679620 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 04 18:37:39.679620 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 18:37:39.679620 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 18:37:39.679620 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:37:39.679620 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:37:39.679620 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:37:39.679620 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:39.679620 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:37:39.679620 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:37:39.679620 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:37:39.679620 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:37:39.679620 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 18:37:39.679620 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:37:39.679620 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-200611d3-0be6-4387-bfa7-7507bd9c7ae6 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Returning 404 to user: Image not found. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:37:39.679620 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-200611d3-0be6-4387-bfa7-7507bd9c7ae6 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] 10.222.0.43 "DELETE /compute/v2.1/images/37400fa2-9016-4a4d-831a-321e28ef058c" status: 404 len: 62 microversion: 2.1 time: 0.063239 Oct 04 18:37:39.679620 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 936/1718] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:39 2022] DELETE /compute/v2.1/images/37400fa2-9016-4a4d-831a-321e28ef058c => generated 62 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:37:39.682368 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-39c0cc69-5b65-49f3-b4c3-b8a246473de8 tempest-KeyPairsV22TestJSON-611266393 tempest-KeyPairsV22TestJSON-611266393-project] Calling method '.version_select at 0x7fb2246684c0>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:39.685969 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-cb164cde-0826-425c-a3c5-dc3ce7354e2c req-b95aaaf4-d7dd-4dd8-a1a9-75f2ae2d1abe service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088464 Oct 04 18:37:39.688264 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 783/1719] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:37:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:37:39.707133 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-2aa2fb54-52cf-4de4-95d5-cc4c78000b21 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:39.708306 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-2aa2fb54-52cf-4de4-95d5-cc4c78000b21 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] [instance: 744f6597-f965-405c-ad7b-66a8a0f1397b] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:39.725098 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2aa2fb54-52cf-4de4-95d5-cc4c78000b21 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:39.725754 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2aa2fb54-52cf-4de4-95d5-cc4c78000b21 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:39.726409 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2aa2fb54-52cf-4de4-95d5-cc4c78000b21 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:39.727356 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2aa2fb54-52cf-4de4-95d5-cc4c78000b21 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:39.728208 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2aa2fb54-52cf-4de4-95d5-cc4c78000b21 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:39.731257 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2aa2fb54-52cf-4de4-95d5-cc4c78000b21 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:39.732792 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-39c0cc69-5b65-49f3-b4c3-b8a246473de8 tempest-KeyPairsV22TestJSON-611266393 tempest-KeyPairsV22TestJSON-611266393-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-2005767851" status: 204 len: 0 microversion: 2.2 time: 0.054742 Oct 04 18:37:39.733523 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 937/1720] 10.222.0.43 () {60 vars in 1321 bytes} [Tue Oct 4 18:37:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-2005767851 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:37:39.745662 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-48d9e222-5a18-4bef-96c9-6f6bdc17cc5f tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:39.747394 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-48d9e222-5a18-4bef-96c9-6f6bdc17cc5f tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] [instance: 93798a9a-d90d-4a4e-8e30-d6575486ff56] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:39.768927 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-48d9e222-5a18-4bef-96c9-6f6bdc17cc5f tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:39.770730 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-48d9e222-5a18-4bef-96c9-6f6bdc17cc5f tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:39.771760 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-48d9e222-5a18-4bef-96c9-6f6bdc17cc5f tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:39.774468 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-48d9e222-5a18-4bef-96c9-6f6bdc17cc5f tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:39.775186 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-48d9e222-5a18-4bef-96c9-6f6bdc17cc5f tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:39.775893 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-48d9e222-5a18-4bef-96c9-6f6bdc17cc5f tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:39.803231 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-48d9e222-5a18-4bef-96c9-6f6bdc17cc5f tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] HTTP exception thrown: Instance 93798a9a-d90d-4a4e-8e30-d6575486ff56 could not be found. Oct 04 18:37:39.805313 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-48d9e222-5a18-4bef-96c9-6f6bdc17cc5f tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Request method failure captured: Oct 04 18:37:39.805313 n-d-851028-13 devstack@n-api.service[123596]: request: DELETE /compute/v2.1/servers/93798a9a-d90d-4a4e-8e30-d6575486ff56 HTTP/1.1 Oct 04 18:37:39.805313 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:37:39.805313 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:37:39.805313 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:37:39.805313 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 18:37:39.805313 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:37:39.805313 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:37:39.805313 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:37:39.805313 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:37:39.805313 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPHx6gAhOQR9SzxsaQbdLvvDvFzwkrsL-eso5wPcIMTe7QTGQ8GNpGTh82q09olF7Uzd5vnfi_owSOym5Q6Nw1rEFuVgt0OVgeRF4PHNfL8zRO2fxXQeqtj7eemFhMAlgrZ0t6cEXPXGxP4C7AYLZO84Rlcv3L9rcqzDiRnnfGTw4VIc Oct 04 18:37:39.805313 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:37:39.805313 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:37:39.805313 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:37:39.805313 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:37:39.805313 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:37:39.805313 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:37:39.805313 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: 4fa31ed92017490a82497c7b8910aef0 Oct 04 18:37:39.805313 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-ImagesTestJSON-306433374 Oct 04 18:37:39.805313 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 18:37:39.805313 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 18:37:39.805313 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/4fa31ed92017490a82497c7b8910aef0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_4fa31ed92017490a82497c7b8910aef0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4fa31ed92017490a82497c7b8910aef0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4fa31ed92017490a82497c7b8910aef0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:37:39.805313 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-ImagesTestJSON-306433374 Oct 04 18:37:39.805313 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: 4fa31ed92017490a82497c7b8910aef0 Oct 04 18:37:39.805313 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-ImagesTestJSON-306433374 Oct 04 18:37:39.805313 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-ImagesTestJSON-306433374-project Oct 04 18:37:39.805313 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:37:39.805313 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:37:39.805313 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 5a41ab6fb78a42ceaca621c5a38ffc6d Oct 04 18:37:39.805313 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-ImagesTestJSON-306433374-project Oct 04 18:37:39.805313 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 18:37:39.805313 n-d-851028-13 devstack@n-api.service[123596]: exception: Instance 93798a9a-d90d-4a4e-8e30-d6575486ff56 could not be found. Oct 04 18:37:39.805313 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': '93798a9a-d90d-4a4e-8e30-d6575486ff56'} Oct 04 18:37:39.805313 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:37:39.805313 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:39.805313 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:37:39.805313 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:37:39.805313 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:37:39.805313 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:37:39.805313 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:37:39.805313 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:37:39.805313 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:37:39.805313 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:37:39.805313 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 93798a9a-d90d-4a4e-8e30-d6575486ff56 could not be found. Oct 04 18:37:39.805313 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:37:39.805313 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:37:39.805313 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:37:39.805313 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:39.805313 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:37:39.805313 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:37:39.805313 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:37:39.805313 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:37:39.805313 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:37:39.805313 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:37:39.805313 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:37:39.805313 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:37:39.805313 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:37:39.805313 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:37:39.805313 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:37:39.805313 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:37:39.805313 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:37:39.805313 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:37:39.805313 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93798a9a-d90d-4a4e-8e30-d6575486ff56 could not be found. Oct 04 18:37:39.814167 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:37:39.814167 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:37:39.814167 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:37:39.814167 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:39.814167 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:37:39.814167 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:37:39.814167 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:37:39.814167 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:37:39.814167 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93798a9a-d90d-4a4e-8e30-d6575486ff56 could not be found. Oct 04 18:37:39.814167 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:37:39.818341 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-48d9e222-5a18-4bef-96c9-6f6bdc17cc5f tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Returning 404 to user: Instance 93798a9a-d90d-4a4e-8e30-d6575486ff56 could not be found. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:37:39.819595 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-48d9e222-5a18-4bef-96c9-6f6bdc17cc5f tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] 10.222.0.43 "DELETE /compute/v2.1/servers/93798a9a-d90d-4a4e-8e30-d6575486ff56" status: 404 len: 111 microversion: 2.1 time: 0.084849 Oct 04 18:37:39.823966 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 938/1721] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 18:37:39 2022] DELETE /compute/v2.1/servers/93798a9a-d90d-4a4e-8e30-d6575486ff56 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:37:39.837300 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-425643c1-c658-4eaf-8851-e86849914d98 tempest-KeyPairsV22TestJSON-611266393 tempest-KeyPairsV22TestJSON-611266393-project] Action: 'create', calling method: .version_select at 0x7fb22410be50>, body: {"keypair": {"name": "tempest-keypair-1583089994", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNR8cXSy30+gf6GsGe49OYFrWob4t1+LaXwAGxK/zxE7VWxuCKq9LNs/lvsz711pg8btH7m//haIHZB7EHD9mUc0eis316fttMJOMukNlwp9seAHfE5AY9t8hJONslpeng=="}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:37:39.866417 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-425643c1-c658-4eaf-8851-e86849914d98 tempest-KeyPairsV22TestJSON-611266393 tempest-KeyPairsV22TestJSON-611266393-project] Getting quotas for project 036a5961e2e746beb81e36c9eaabcce2. Resources: {'key_pairs'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:37:39.870556 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-425643c1-c658-4eaf-8851-e86849914d98 tempest-KeyPairsV22TestJSON-611266393 tempest-KeyPairsV22TestJSON-611266393-project] Getting quotas for user 554a6837c8de42e6803b0823f3a65d05 and project 036a5961e2e746beb81e36c9eaabcce2. Resources: {'key_pairs'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:37:39.871988 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-2aa2fb54-52cf-4de4-95d5-cc4c78000b21 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa193aff0474ae3ba5d1aa7b0d0e8c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a06b8feba3404490a448aa2d4fb106b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:39.882014 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-2aa2fb54-52cf-4de4-95d5-cc4c78000b21 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] 10.222.0.43 "GET /compute/v2.1/servers/744f6597-f965-405c-ad7b-66a8a0f1397b" status: 200 len: 1307 microversion: 2.1 time: 0.188289 Oct 04 18:37:39.883634 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 784/1722] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:39 2022] GET /compute/v2.1/servers/744f6597-f965-405c-ad7b-66a8a0f1397b => generated 1307 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:39.916952 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-ee3680db-4c80-48bd-99da-aecf1dc6aea7 tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:39.917532 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-ee3680db-4c80-48bd-99da-aecf1dc6aea7 tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] [instance: bea29c43-a5ab-42b3-9d5d-3b0f4f0f30f3] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:39.928342 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ee3680db-4c80-48bd-99da-aecf1dc6aea7 tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:39.928887 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-425643c1-c658-4eaf-8851-e86849914d98 tempest-KeyPairsV22TestJSON-611266393 tempest-KeyPairsV22TestJSON-611266393-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.102784 Oct 04 18:37:39.929706 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ee3680db-4c80-48bd-99da-aecf1dc6aea7 tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:39.930527 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 939/1723] 10.222.0.43 () {62 vars in 1199 bytes} [Tue Oct 4 18:37:39 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 106 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 04 18:37:39.931295 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ee3680db-4c80-48bd-99da-aecf1dc6aea7 tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:39.934778 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ee3680db-4c80-48bd-99da-aecf1dc6aea7 tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:39.935466 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ee3680db-4c80-48bd-99da-aecf1dc6aea7 tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:39.936131 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ee3680db-4c80-48bd-99da-aecf1dc6aea7 tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:39.939770 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-4b37f237-eda1-407b-b6bc-91f0d1a47470 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:39.943089 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-4b37f237-eda1-407b-b6bc-91f0d1a47470 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] [instance: 93798a9a-d90d-4a4e-8e30-d6575486ff56] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:39.958809 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4b37f237-eda1-407b-b6bc-91f0d1a47470 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:39.959301 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4b37f237-eda1-407b-b6bc-91f0d1a47470 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:39.962562 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4b37f237-eda1-407b-b6bc-91f0d1a47470 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:39.963327 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4b37f237-eda1-407b-b6bc-91f0d1a47470 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:39.963851 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4b37f237-eda1-407b-b6bc-91f0d1a47470 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:39.964206 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4b37f237-eda1-407b-b6bc-91f0d1a47470 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:39.985956 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-4b37f237-eda1-407b-b6bc-91f0d1a47470 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] HTTP exception thrown: Instance 93798a9a-d90d-4a4e-8e30-d6575486ff56 could not be found. Oct 04 18:37:39.987837 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-4b37f237-eda1-407b-b6bc-91f0d1a47470 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Request method failure captured: Oct 04 18:37:39.987837 n-d-851028-13 devstack@n-api.service[123596]: request: GET /compute/v2.1/servers/93798a9a-d90d-4a4e-8e30-d6575486ff56 HTTP/1.1 Oct 04 18:37:39.987837 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:37:39.987837 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:37:39.987837 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:37:39.987837 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 18:37:39.987837 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:37:39.987837 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:37:39.987837 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:37:39.987837 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:37:39.987837 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPHx6gAhOQR9SzxsaQbdLvvDvFzwkrsL-eso5wPcIMTe7QTGQ8GNpGTh82q09olF7Uzd5vnfi_owSOym5Q6Nw1rEFuVgt0OVgeRF4PHNfL8zRO2fxXQeqtj7eemFhMAlgrZ0t6cEXPXGxP4C7AYLZO84Rlcv3L9rcqzDiRnnfGTw4VIc Oct 04 18:37:39.987837 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:37:39.987837 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:37:39.987837 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:37:39.987837 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:37:39.987837 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:37:39.987837 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:37:39.987837 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: 4fa31ed92017490a82497c7b8910aef0 Oct 04 18:37:39.987837 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-ImagesTestJSON-306433374 Oct 04 18:37:39.987837 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 18:37:39.987837 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 18:37:39.987837 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/4fa31ed92017490a82497c7b8910aef0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_4fa31ed92017490a82497c7b8910aef0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4fa31ed92017490a82497c7b8910aef0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4fa31ed92017490a82497c7b8910aef0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:37:39.987837 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-ImagesTestJSON-306433374 Oct 04 18:37:39.987837 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: 4fa31ed92017490a82497c7b8910aef0 Oct 04 18:37:39.987837 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-ImagesTestJSON-306433374 Oct 04 18:37:39.987837 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-ImagesTestJSON-306433374-project Oct 04 18:37:39.987837 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:37:39.987837 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:37:39.987837 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 5a41ab6fb78a42ceaca621c5a38ffc6d Oct 04 18:37:39.987837 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-ImagesTestJSON-306433374-project Oct 04 18:37:39.987837 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 18:37:39.987837 n-d-851028-13 devstack@n-api.service[123596]: exception: Instance 93798a9a-d90d-4a4e-8e30-d6575486ff56 could not be found. Oct 04 18:37:39.987837 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': '93798a9a-d90d-4a4e-8e30-d6575486ff56'} Oct 04 18:37:39.987837 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:37:39.987837 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:39.987837 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:37:39.987837 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:37:39.987837 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:37:39.987837 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:37:39.987837 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:37:39.987837 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:37:39.987837 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:37:39.987837 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:37:39.987837 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 93798a9a-d90d-4a4e-8e30-d6575486ff56 could not be found. Oct 04 18:37:39.987837 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:37:39.987837 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:37:39.987837 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:37:39.987837 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:39.987837 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:37:39.987837 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:37:39.987837 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:37:39.987837 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:37:39.987837 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:37:39.987837 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:37:39.987837 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:37:39.987837 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:37:39.987837 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:37:39.987837 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:37:39.987837 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:37:39.987837 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:37:39.987837 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93798a9a-d90d-4a4e-8e30-d6575486ff56 could not be found. Oct 04 18:37:39.987837 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:37:39.987837 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:37:39.987837 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:37:39.987837 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:39.992605 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:37:39.992605 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:37:39.992605 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:37:39.992605 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:37:39.992605 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93798a9a-d90d-4a4e-8e30-d6575486ff56 could not be found. Oct 04 18:37:39.992605 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:37:39.995602 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-4b37f237-eda1-407b-b6bc-91f0d1a47470 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Returning 404 to user: Instance 93798a9a-d90d-4a4e-8e30-d6575486ff56 could not be found. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:37:39.996740 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-4b37f237-eda1-407b-b6bc-91f0d1a47470 tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] 10.222.0.43 "GET /compute/v2.1/servers/93798a9a-d90d-4a4e-8e30-d6575486ff56" status: 404 len: 111 microversion: 2.1 time: 0.064247 Oct 04 18:37:39.997596 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 940/1724] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:39 2022] GET /compute/v2.1/servers/93798a9a-d90d-4a4e-8e30-d6575486ff56 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:37:40.006325 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-ac6f4472-25df-4f78-92b3-91e6dada9e55 tempest-KeyPairsV22TestJSON-611266393 tempest-KeyPairsV22TestJSON-611266393-project] Calling method '.version_select at 0x7fb22445f310>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:40.022858 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-ac6f4472-25df-4f78-92b3-91e6dada9e55 tempest-KeyPairsV22TestJSON-611266393 tempest-KeyPairsV22TestJSON-611266393-project] 10.222.0.43 "GET /compute/v2.1/os-keypairs/tempest-keypair-1583089994" status: 200 len: 513 microversion: 2.2 time: 0.023745 Oct 04 18:37:40.024183 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 941/1725] 10.222.0.43 () {60 vars in 1258 bytes} [Tue Oct 4 18:37:39 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1583089994 => generated 513 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:37:40.029404 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-a783fee6-785b-426b-8b2f-ddd0d1911ebc tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Calling method '.version_select at 0x7fb21fd048b0>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:40.066709 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-a783fee6-785b-426b-8b2f-ddd0d1911ebc tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] HTTP exception thrown: Image not found. Oct 04 18:37:40.068825 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-a783fee6-785b-426b-8b2f-ddd0d1911ebc tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Request method failure captured: Oct 04 18:37:40.068825 n-d-851028-13 devstack@n-api.service[123596]: request: DELETE /compute/v2.1/images/431ce5a8-e1dc-4eb2-a165-ad8ed0489d0b HTTP/1.1 Oct 04 18:37:40.068825 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:37:40.068825 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:37:40.068825 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:37:40.068825 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 18:37:40.068825 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:37:40.068825 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:37:40.068825 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:37:40.068825 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:37:40.068825 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPHx6gAhOQR9SzxsaQbdLvvDvFzwkrsL-eso5wPcIMTe7QTGQ8GNpGTh82q09olF7Uzd5vnfi_owSOym5Q6Nw1rEFuVgt0OVgeRF4PHNfL8zRO2fxXQeqtj7eemFhMAlgrZ0t6cEXPXGxP4C7AYLZO84Rlcv3L9rcqzDiRnnfGTw4VIc Oct 04 18:37:40.068825 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:37:40.068825 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:37:40.068825 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:37:40.068825 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:37:40.068825 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:37:40.068825 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:37:40.068825 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: 4fa31ed92017490a82497c7b8910aef0 Oct 04 18:37:40.068825 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-ImagesTestJSON-306433374 Oct 04 18:37:40.068825 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 18:37:40.068825 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 18:37:40.068825 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/4fa31ed92017490a82497c7b8910aef0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_4fa31ed92017490a82497c7b8910aef0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4fa31ed92017490a82497c7b8910aef0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4fa31ed92017490a82497c7b8910aef0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:37:40.068825 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-ImagesTestJSON-306433374 Oct 04 18:37:40.068825 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: 4fa31ed92017490a82497c7b8910aef0 Oct 04 18:37:40.068825 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-ImagesTestJSON-306433374 Oct 04 18:37:40.068825 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-ImagesTestJSON-306433374-project Oct 04 18:37:40.068825 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:37:40.068825 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:37:40.068825 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 5a41ab6fb78a42ceaca621c5a38ffc6d Oct 04 18:37:40.068825 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-ImagesTestJSON-306433374-project Oct 04 18:37:40.068825 n-d-851028-13 devstack@n-api.service[123596]: method: Oct 04 18:37:40.068825 n-d-851028-13 devstack@n-api.service[123596]: exception: Image not found. Oct 04 18:37:40.068825 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': '431ce5a8-e1dc-4eb2-a165-ad8ed0489d0b'} Oct 04 18:37:40.068825 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:37:40.068825 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:40.068825 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 04 18:37:40.068825 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 04 18:37:40.068825 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 18:37:40.068825 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 18:37:40.068825 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 18:37:40.068825 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 18:37:40.068825 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 04 18:37:40.068825 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 04 18:37:40.068825 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 04 18:37:40.068825 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 04 18:37:40.068825 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 18:37:40.068825 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 18:37:40.068825 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 18:37:40.068825 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 18:37:40.068825 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 431ce5a8-e1dc-4eb2-a165-ad8ed0489d0b to delete Oct 04 18:37:40.068825 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:37:40.068825 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:37:40.068825 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:37:40.068825 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:40.068825 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 04 18:37:40.068825 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 04 18:37:40.068825 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 04 18:37:40.068825 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 04 18:37:40.068825 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 04 18:37:40.068825 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 04 18:37:40.068825 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 431ce5a8-e1dc-4eb2-a165-ad8ed0489d0b could not be found. Oct 04 18:37:40.068825 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:37:40.068825 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:37:40.068825 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:37:40.068825 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:40.075372 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:37:40.075372 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:37:40.075372 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:37:40.075372 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:37:40.075372 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:37:40.075372 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:37:40.075372 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:37:40.075372 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:37:40.075372 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 04 18:37:40.075372 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 18:37:40.075372 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 18:37:40.075372 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:37:40.075372 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:37:40.075372 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:37:40.075372 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:40.075372 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:37:40.075372 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:37:40.075372 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:37:40.075372 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:37:40.075372 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 18:37:40.075372 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:37:40.082161 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-a783fee6-785b-426b-8b2f-ddd0d1911ebc tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Returning 404 to user: Image not found. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:37:40.084018 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-a783fee6-785b-426b-8b2f-ddd0d1911ebc tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] 10.222.0.43 "DELETE /compute/v2.1/images/431ce5a8-e1dc-4eb2-a165-ad8ed0489d0b" status: 404 len: 62 microversion: 2.1 time: 0.058497 Oct 04 18:37:40.084773 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 942/1726] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:40 2022] DELETE /compute/v2.1/images/431ce5a8-e1dc-4eb2-a165-ad8ed0489d0b => generated 62 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:37:40.097137 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-7031a2cd-4ad5-4c89-9712-db48c64b3171 tempest-KeyPairsV22TestJSON-611266393 tempest-KeyPairsV22TestJSON-611266393-project] Calling method '.version_select at 0x7fb227f5b820>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:40.112906 n-d-851028-13 devstack@n-api.service[123596]: WARNING oslo_db.sqlalchemy.utils [None req-7031a2cd-4ad5-4c89-9712-db48c64b3171 tempest-KeyPairsV22TestJSON-611266393 tempest-KeyPairsV22TestJSON-611266393-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 04 18:37:40.126435 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-7031a2cd-4ad5-4c89-9712-db48c64b3171 tempest-KeyPairsV22TestJSON-611266393 tempest-KeyPairsV22TestJSON-611266393-project] 10.222.0.43 "GET /compute/v2.1/os-keypairs" status: 200 len: 370 microversion: 2.2 time: 0.039422 Oct 04 18:37:40.127458 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 943/1727] 10.222.0.43 () {60 vars in 1177 bytes} [Tue Oct 4 18:37:40 2022] GET /compute/v2.1/os-keypairs => generated 370 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:37:40.139317 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-0c938aa6-207a-4eae-87a0-a193a5b7bb0b tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:40.139952 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-0c938aa6-207a-4eae-87a0-a193a5b7bb0b tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] [instance: 533db4f5-5f62-47ab-9d4c-5e5a95c0b756] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:40.154657 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0c938aa6-207a-4eae-87a0-a193a5b7bb0b tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:40.157328 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0c938aa6-207a-4eae-87a0-a193a5b7bb0b tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:40.158054 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0c938aa6-207a-4eae-87a0-a193a5b7bb0b tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:40.158625 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0c938aa6-207a-4eae-87a0-a193a5b7bb0b tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:40.159010 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0c938aa6-207a-4eae-87a0-a193a5b7bb0b tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:40.159442 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0c938aa6-207a-4eae-87a0-a193a5b7bb0b tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:40.209332 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-0c938aa6-207a-4eae-87a0-a193a5b7bb0b tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] HTTP exception thrown: Instance 533db4f5-5f62-47ab-9d4c-5e5a95c0b756 could not be found. Oct 04 18:37:40.210919 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-0c938aa6-207a-4eae-87a0-a193a5b7bb0b tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Request method failure captured: Oct 04 18:37:40.210919 n-d-851028-13 devstack@n-api.service[123596]: request: DELETE /compute/v2.1/servers/533db4f5-5f62-47ab-9d4c-5e5a95c0b756 HTTP/1.1 Oct 04 18:37:40.210919 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:37:40.210919 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:37:40.210919 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:37:40.210919 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 18:37:40.210919 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:37:40.210919 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:37:40.210919 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:37:40.210919 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:37:40.210919 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPHx6gAhOQR9SzxsaQbdLvvDvFzwkrsL-eso5wPcIMTe7QTGQ8GNpGTh82q09olF7Uzd5vnfi_owSOym5Q6Nw1rEFuVgt0OVgeRF4PHNfL8zRO2fxXQeqtj7eemFhMAlgrZ0t6cEXPXGxP4C7AYLZO84Rlcv3L9rcqzDiRnnfGTw4VIc Oct 04 18:37:40.210919 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:37:40.210919 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:37:40.210919 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:37:40.210919 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:37:40.210919 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:37:40.210919 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:37:40.210919 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: 4fa31ed92017490a82497c7b8910aef0 Oct 04 18:37:40.210919 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-ImagesTestJSON-306433374 Oct 04 18:37:40.210919 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 18:37:40.210919 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 18:37:40.210919 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/4fa31ed92017490a82497c7b8910aef0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_4fa31ed92017490a82497c7b8910aef0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4fa31ed92017490a82497c7b8910aef0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4fa31ed92017490a82497c7b8910aef0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:37:40.210919 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-ImagesTestJSON-306433374 Oct 04 18:37:40.210919 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: 4fa31ed92017490a82497c7b8910aef0 Oct 04 18:37:40.210919 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-ImagesTestJSON-306433374 Oct 04 18:37:40.210919 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-ImagesTestJSON-306433374-project Oct 04 18:37:40.210919 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:37:40.210919 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:37:40.210919 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 5a41ab6fb78a42ceaca621c5a38ffc6d Oct 04 18:37:40.210919 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-ImagesTestJSON-306433374-project Oct 04 18:37:40.210919 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 18:37:40.210919 n-d-851028-13 devstack@n-api.service[123596]: exception: Instance 533db4f5-5f62-47ab-9d4c-5e5a95c0b756 could not be found. Oct 04 18:37:40.210919 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': '533db4f5-5f62-47ab-9d4c-5e5a95c0b756'} Oct 04 18:37:40.210919 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:37:40.210919 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:40.210919 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:37:40.210919 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:37:40.210919 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:37:40.210919 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:37:40.210919 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:37:40.210919 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:37:40.210919 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:37:40.210919 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:37:40.210919 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 533db4f5-5f62-47ab-9d4c-5e5a95c0b756 could not be found. Oct 04 18:37:40.210919 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:37:40.210919 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:37:40.210919 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:37:40.210919 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:40.210919 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:37:40.210919 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:37:40.210919 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:37:40.210919 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:37:40.210919 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:37:40.210919 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:37:40.210919 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:37:40.210919 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:37:40.210919 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:37:40.210919 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:37:40.210919 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:37:40.210919 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:37:40.210919 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:37:40.210919 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:37:40.210919 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 533db4f5-5f62-47ab-9d4c-5e5a95c0b756 could not be found. Oct 04 18:37:40.217615 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:37:40.217615 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:37:40.217615 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:37:40.217615 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:40.217615 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:37:40.217615 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:37:40.217615 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:37:40.217615 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:37:40.217615 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 533db4f5-5f62-47ab-9d4c-5e5a95c0b756 could not be found. Oct 04 18:37:40.217615 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:37:40.217615 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-0c938aa6-207a-4eae-87a0-a193a5b7bb0b tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Returning 404 to user: Instance 533db4f5-5f62-47ab-9d4c-5e5a95c0b756 could not be found. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:37:40.217615 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-0c938aa6-207a-4eae-87a0-a193a5b7bb0b tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] 10.222.0.43 "DELETE /compute/v2.1/servers/533db4f5-5f62-47ab-9d4c-5e5a95c0b756" status: 404 len: 111 microversion: 2.1 time: 0.083794 Oct 04 18:37:40.219463 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 944/1728] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 18:37:40 2022] DELETE /compute/v2.1/servers/533db4f5-5f62-47ab-9d4c-5e5a95c0b756 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:37:40.234524 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-92d295e5-3a5a-4df4-a9e2-909f510b93cb tempest-KeyPairsV22TestJSON-611266393 tempest-KeyPairsV22TestJSON-611266393-project] Calling method '.version_select at 0x7fb21fd11550>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:40.281628 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-92d295e5-3a5a-4df4-a9e2-909f510b93cb tempest-KeyPairsV22TestJSON-611266393 tempest-KeyPairsV22TestJSON-611266393-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1583089994" status: 204 len: 0 microversion: 2.2 time: 0.059721 Oct 04 18:37:40.283245 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 945/1729] 10.222.0.43 () {60 vars in 1261 bytes} [Tue Oct 4 18:37:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1583089994 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:37:40.294518 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-cac95bf7-1bfd-497a-9ac7-897e4daca92f tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:40.295330 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-cac95bf7-1bfd-497a-9ac7-897e4daca92f tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] [instance: 533db4f5-5f62-47ab-9d4c-5e5a95c0b756] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:40.305879 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cac95bf7-1bfd-497a-9ac7-897e4daca92f tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:40.307404 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cac95bf7-1bfd-497a-9ac7-897e4daca92f tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:40.308186 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cac95bf7-1bfd-497a-9ac7-897e4daca92f tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:40.309374 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cac95bf7-1bfd-497a-9ac7-897e4daca92f tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:40.310129 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cac95bf7-1bfd-497a-9ac7-897e4daca92f tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:40.311036 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cac95bf7-1bfd-497a-9ac7-897e4daca92f tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:40.334213 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-cac95bf7-1bfd-497a-9ac7-897e4daca92f tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] HTTP exception thrown: Instance 533db4f5-5f62-47ab-9d4c-5e5a95c0b756 could not be found. Oct 04 18:37:40.337420 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-cac95bf7-1bfd-497a-9ac7-897e4daca92f tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Request method failure captured: Oct 04 18:37:40.337420 n-d-851028-13 devstack@n-api.service[123596]: request: GET /compute/v2.1/servers/533db4f5-5f62-47ab-9d4c-5e5a95c0b756 HTTP/1.1 Oct 04 18:37:40.337420 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:37:40.337420 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:37:40.337420 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:37:40.337420 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 18:37:40.337420 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:37:40.337420 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:37:40.337420 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:37:40.337420 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:37:40.337420 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPHx6gAhOQR9SzxsaQbdLvvDvFzwkrsL-eso5wPcIMTe7QTGQ8GNpGTh82q09olF7Uzd5vnfi_owSOym5Q6Nw1rEFuVgt0OVgeRF4PHNfL8zRO2fxXQeqtj7eemFhMAlgrZ0t6cEXPXGxP4C7AYLZO84Rlcv3L9rcqzDiRnnfGTw4VIc Oct 04 18:37:40.337420 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:37:40.337420 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:37:40.337420 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:37:40.337420 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:37:40.337420 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:37:40.337420 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:37:40.337420 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: 4fa31ed92017490a82497c7b8910aef0 Oct 04 18:37:40.337420 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-ImagesTestJSON-306433374 Oct 04 18:37:40.337420 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 18:37:40.337420 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 18:37:40.337420 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/4fa31ed92017490a82497c7b8910aef0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_4fa31ed92017490a82497c7b8910aef0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4fa31ed92017490a82497c7b8910aef0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4fa31ed92017490a82497c7b8910aef0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:37:40.337420 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-ImagesTestJSON-306433374 Oct 04 18:37:40.337420 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: 4fa31ed92017490a82497c7b8910aef0 Oct 04 18:37:40.337420 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-ImagesTestJSON-306433374 Oct 04 18:37:40.337420 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-ImagesTestJSON-306433374-project Oct 04 18:37:40.337420 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:37:40.337420 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:37:40.337420 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 5a41ab6fb78a42ceaca621c5a38ffc6d Oct 04 18:37:40.337420 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-ImagesTestJSON-306433374-project Oct 04 18:37:40.337420 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 18:37:40.337420 n-d-851028-13 devstack@n-api.service[123596]: exception: Instance 533db4f5-5f62-47ab-9d4c-5e5a95c0b756 could not be found. Oct 04 18:37:40.337420 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': '533db4f5-5f62-47ab-9d4c-5e5a95c0b756'} Oct 04 18:37:40.337420 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:37:40.337420 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:40.337420 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:37:40.337420 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:37:40.337420 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:37:40.337420 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:37:40.337420 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:37:40.337420 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:37:40.337420 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:37:40.337420 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:37:40.337420 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 533db4f5-5f62-47ab-9d4c-5e5a95c0b756 could not be found. Oct 04 18:37:40.337420 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:37:40.337420 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:37:40.337420 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:37:40.337420 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:40.337420 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:37:40.337420 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:37:40.337420 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:37:40.337420 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:37:40.337420 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:37:40.337420 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:37:40.337420 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:37:40.337420 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:37:40.337420 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:37:40.337420 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:37:40.337420 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:37:40.337420 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:37:40.337420 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 533db4f5-5f62-47ab-9d4c-5e5a95c0b756 could not be found. Oct 04 18:37:40.337420 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:37:40.337420 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:37:40.337420 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:37:40.337420 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:40.342204 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:37:40.342204 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:37:40.342204 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:37:40.342204 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:37:40.342204 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 533db4f5-5f62-47ab-9d4c-5e5a95c0b756 could not be found. Oct 04 18:37:40.342204 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:37:40.344317 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-cac95bf7-1bfd-497a-9ac7-897e4daca92f tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] Returning 404 to user: Instance 533db4f5-5f62-47ab-9d4c-5e5a95c0b756 could not be found. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:37:40.345472 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-cac95bf7-1bfd-497a-9ac7-897e4daca92f tempest-ImagesTestJSON-306433374 tempest-ImagesTestJSON-306433374-project] 10.222.0.43 "GET /compute/v2.1/servers/533db4f5-5f62-47ab-9d4c-5e5a95c0b756" status: 404 len: 111 microversion: 2.1 time: 0.060995 Oct 04 18:37:40.345597 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-ee3680db-4c80-48bd-99da-aecf1dc6aea7 tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de84075cb5a44e83a41516b687f07e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9d3dec7f864f42adcd6e9c20043832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:40.347214 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 946/1730] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:40 2022] GET /compute/v2.1/servers/533db4f5-5f62-47ab-9d4c-5e5a95c0b756 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:37:40.357735 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-ee3680db-4c80-48bd-99da-aecf1dc6aea7 tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] 10.222.0.43 "GET /compute/v2.1/servers/bea29c43-a5ab-42b3-9d5d-3b0f4f0f30f3" status: 200 len: 1316 microversion: 2.1 time: 0.472850 Oct 04 18:37:40.358330 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 785/1731] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:39 2022] GET /compute/v2.1/servers/bea29c43-a5ab-42b3-9d5d-3b0f4f0f30f3 => generated 1316 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:40.366145 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-0bbd4ced-699f-4f33-8148-2ee86bf07a34 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:40.366987 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-0bbd4ced-699f-4f33-8148-2ee86bf07a34 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: d85af512-1b1f-42a4-9bb1-963cc956c9ae] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:40.378831 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0bbd4ced-699f-4f33-8148-2ee86bf07a34 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:40.379914 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0bbd4ced-699f-4f33-8148-2ee86bf07a34 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:40.380367 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0bbd4ced-699f-4f33-8148-2ee86bf07a34 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:40.388468 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-1e6986a1-4908-46ec-95ba-f969c48f3cae tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Calling method '.version_select at 0x7fb224545280>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:40.394004 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0bbd4ced-699f-4f33-8148-2ee86bf07a34 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:40.394918 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0bbd4ced-699f-4f33-8148-2ee86bf07a34 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:40.395351 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0bbd4ced-699f-4f33-8148-2ee86bf07a34 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:40.467591 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-1e6986a1-4908-46ec-95ba-f969c48f3cae tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] 10.222.0.43 "GET /compute/v2.1/images/d7825145-299c-45b6-9fe8-780722b2d243" status: 200 len: 1428 microversion: 2.1 time: 0.117391 Oct 04 18:37:40.468191 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 947/1732] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 18:37:40 2022] GET /compute/v2.1/images/d7825145-299c-45b6-9fe8-780722b2d243 => generated 1428 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:40.490776 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-1904b68e-3b20-40c9-ab86-03dda509efb5 tempest-KeyPairsV22TestJSON-611266393 tempest-KeyPairsV22TestJSON-611266393-project] Action: 'create', calling method: .version_select at 0x7fb227d86790>, body: {"keypair": {"name": "tempest-keypair-2074407172", "type": "x509"}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:37:40.540438 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-1904b68e-3b20-40c9-ab86-03dda509efb5 tempest-KeyPairsV22TestJSON-611266393 tempest-KeyPairsV22TestJSON-611266393-project] Getting quotas for project 036a5961e2e746beb81e36c9eaabcce2. Resources: {'key_pairs'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:37:40.544988 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-1904b68e-3b20-40c9-ab86-03dda509efb5 tempest-KeyPairsV22TestJSON-611266393 tempest-KeyPairsV22TestJSON-611266393-project] Getting quotas for user 554a6837c8de42e6803b0823f3a65d05 and project 036a5961e2e746beb81e36c9eaabcce2. Resources: {'key_pairs'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:37:40.573368 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.processutils [None req-1904b68e-3b20-40c9-ab86-03dda509efb5 tempest-KeyPairsV22TestJSON-611266393 tempest-KeyPairsV22TestJSON-611266393-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmp8mmi6aui/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmp8mmi6aui/temp.key -subj /CN=554a6837c8de42e6803b0823f3a65d05 -extensions v3_req_client {{(pid=123596) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 04 18:37:40.809874 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-0bbd4ced-699f-4f33-8148-2ee86bf07a34 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:40.819250 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-0bbd4ced-699f-4f33-8148-2ee86bf07a34 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/d85af512-1b1f-42a4-9bb1-963cc956c9ae" status: 200 len: 1462 microversion: 2.1 time: 0.459876 Oct 04 18:37:40.831085 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 786/1733] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:40 2022] GET /compute/v2.1/servers/d85af512-1b1f-42a4-9bb1-963cc956c9ae => generated 1462 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:40.860504 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.processutils [None req-1904b68e-3b20-40c9-ab86-03dda509efb5 tempest-KeyPairsV22TestJSON-611266393 tempest-KeyPairsV22TestJSON-611266393-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmp8mmi6aui/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmp8mmi6aui/temp.key -subj /CN=554a6837c8de42e6803b0823f3a65d05 -extensions v3_req_client" returned: 0 in 0.287s {{(pid=123596) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 04 18:37:40.862715 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.processutils [None req-1904b68e-3b20-40c9-ab86-03dda509efb5 tempest-KeyPairsV22TestJSON-611266393 tempest-KeyPairsV22TestJSON-611266393-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmp8mmi6aui/temp.key -password pass: {{(pid=123596) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 04 18:37:40.871405 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-8a9a9b47-f40e-4ed8-b701-52c03c227625 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:40.874328 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-8a9a9b47-f40e-4ed8-b701-52c03c227625 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] [instance: 7222a4ce-d2a2-4b09-afc6-55bca52414d4] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:40.893501 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8a9a9b47-f40e-4ed8-b701-52c03c227625 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:40.897866 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8a9a9b47-f40e-4ed8-b701-52c03c227625 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:40.901474 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8a9a9b47-f40e-4ed8-b701-52c03c227625 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:40.904194 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.processutils [None req-1904b68e-3b20-40c9-ab86-03dda509efb5 tempest-KeyPairsV22TestJSON-611266393 tempest-KeyPairsV22TestJSON-611266393-project] CMD "openssl pkcs12 -export -inkey /tmp/tmp8mmi6aui/temp.key -password pass:" returned: 0 in 0.041s {{(pid=123596) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 04 18:37:40.905927 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8a9a9b47-f40e-4ed8-b701-52c03c227625 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:40.907411 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8a9a9b47-f40e-4ed8-b701-52c03c227625 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:40.909371 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8a9a9b47-f40e-4ed8-b701-52c03c227625 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:40.986589 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-1904b68e-3b20-40c9-ab86-03dda509efb5 tempest-KeyPairsV22TestJSON-611266393 tempest-KeyPairsV22TestJSON-611266393-project] Getting quotas for project 036a5961e2e746beb81e36c9eaabcce2. Resources: {'key_pairs'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:37:40.998364 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-1904b68e-3b20-40c9-ab86-03dda509efb5 tempest-KeyPairsV22TestJSON-611266393 tempest-KeyPairsV22TestJSON-611266393-project] Getting quotas for user 554a6837c8de42e6803b0823f3a65d05 and project 036a5961e2e746beb81e36c9eaabcce2. Resources: {'key_pairs'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:37:41.040479 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-1904b68e-3b20-40c9-ab86-03dda509efb5 tempest-KeyPairsV22TestJSON-611266393 tempest-KeyPairsV22TestJSON-611266393-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 201 len: 4693 microversion: 2.2 time: 0.569700 Oct 04 18:37:41.048813 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 948/1734] 10.222.0.43 () {62 vars in 1198 bytes} [Tue Oct 4 18:37:40 2022] POST /compute/v2.1/os-keypairs => generated 4693 bytes in 579 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:37:41.064221 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-b4d69306-54d1-4767-9d9f-c0f93c7c463d tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:37:41.069324 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-b4d69306-54d1-4767-9d9f-c0f93c7c463d tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: d85af512-1b1f-42a4-9bb1-963cc956c9ae] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:41.078522 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b4d69306-54d1-4767-9d9f-c0f93c7c463d tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:41.079371 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b4d69306-54d1-4767-9d9f-c0f93c7c463d tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:41.080020 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b4d69306-54d1-4767-9d9f-c0f93c7c463d tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:41.081042 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b4d69306-54d1-4767-9d9f-c0f93c7c463d tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:41.081704 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b4d69306-54d1-4767-9d9f-c0f93c7c463d tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:41.083722 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b4d69306-54d1-4767-9d9f-c0f93c7c463d tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:41.133245 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-8a9a9b47-f40e-4ed8-b701-52c03c227625 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:41.151780 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-8a9a9b47-f40e-4ed8-b701-52c03c227625 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:41.153879 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-8a9a9b47-f40e-4ed8-b701-52c03c227625 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:41.161962 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-8a9a9b47-f40e-4ed8-b701-52c03c227625 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] 10.222.0.43 "GET /compute/v2.1/servers/7222a4ce-d2a2-4b09-afc6-55bca52414d4" status: 200 len: 1805 microversion: 2.25 time: 0.323552 Oct 04 18:37:41.177180 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 787/1735] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:37:40 2022] GET /compute/v2.1/servers/7222a4ce-d2a2-4b09-afc6-55bca52414d4 => generated 1805 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:37:41.177180 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-e5e95a1a-6303-45ed-b62b-506c7cd97125 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:41.177180 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-e5e95a1a-6303-45ed-b62b-506c7cd97125 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] [instance: 744f6597-f965-405c-ad7b-66a8a0f1397b] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:41.199057 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e5e95a1a-6303-45ed-b62b-506c7cd97125 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:41.199476 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e5e95a1a-6303-45ed-b62b-506c7cd97125 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:41.199929 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e5e95a1a-6303-45ed-b62b-506c7cd97125 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:41.200735 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e5e95a1a-6303-45ed-b62b-506c7cd97125 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:41.201225 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e5e95a1a-6303-45ed-b62b-506c7cd97125 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:41.201670 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e5e95a1a-6303-45ed-b62b-506c7cd97125 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:41.228240 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-e5e95a1a-6303-45ed-b62b-506c7cd97125 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] HTTP exception thrown: Instance 744f6597-f965-405c-ad7b-66a8a0f1397b could not be found. Oct 04 18:37:41.229964 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-e5e95a1a-6303-45ed-b62b-506c7cd97125 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Request method failure captured: Oct 04 18:37:41.229964 n-d-851028-13 devstack@n-api.service[123595]: request: GET /compute/v2.1/servers/744f6597-f965-405c-ad7b-66a8a0f1397b HTTP/1.1 Oct 04 18:37:41.229964 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 18:37:41.229964 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 18:37:41.229964 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 18:37:41.229964 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 0 Oct 04 18:37:41.229964 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 18:37:41.229964 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 18:37:41.229964 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 18:37:41.229964 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 18:37:41.229964 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPH1FjpQDMTo-WQnaBct-hi793OA6nOXWID8VHZlHnLSe3utlSiytXhTaUmuOya5lNTsM3Kz-PejMBCBkmkHad0pn_NGG8jv8p4frIsdGg2r7IPRVyg-E3jXO7lLZ5_-qacE0T35EUj99w63mMEdMiYs1AsT4VphKCmkX_i1iKTkj4JU Oct 04 18:37:41.229964 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 18:37:41.229964 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 18:37:41.229964 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 18:37:41.229964 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 18:37:41.229964 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 18:37:41.229964 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 18:37:41.229964 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: a06b8feba3404490a448aa2d4fb106b2 Oct 04 18:37:41.229964 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-ListServersNegativeTestJSON-402277524 Oct 04 18:37:41.229964 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 18:37:41.229964 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 18:37:41.229964 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/a06b8feba3404490a448aa2d4fb106b2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_a06b8feba3404490a448aa2d4fb106b2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a06b8feba3404490a448aa2d4fb106b2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a06b8feba3404490a448aa2d4fb106b2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:37:41.229964 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-ListServersNegativeTestJSON-402277524 Oct 04 18:37:41.229964 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: a06b8feba3404490a448aa2d4fb106b2 Oct 04 18:37:41.229964 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-402277524 Oct 04 18:37:41.229964 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-ListServersNegativeTestJSON-402277524-project Oct 04 18:37:41.229964 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 18:37:41.229964 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 18:37:41.229964 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: 9fa193aff0474ae3ba5d1aa7b0d0e8c4 Oct 04 18:37:41.229964 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-ListServersNegativeTestJSON-402277524-project Oct 04 18:37:41.229964 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 18:37:41.229964 n-d-851028-13 devstack@n-api.service[123595]: exception: Instance 744f6597-f965-405c-ad7b-66a8a0f1397b could not be found. Oct 04 18:37:41.229964 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': '744f6597-f965-405c-ad7b-66a8a0f1397b'} Oct 04 18:37:41.229964 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:37:41.229964 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:41.229964 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:37:41.229964 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:37:41.229964 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:37:41.229964 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:37:41.229964 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:37:41.229964 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:37:41.229964 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:37:41.229964 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:37:41.229964 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 744f6597-f965-405c-ad7b-66a8a0f1397b could not be found. Oct 04 18:37:41.229964 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:37:41.229964 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:37:41.229964 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:37:41.229964 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:41.229964 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:37:41.229964 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:37:41.229964 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:37:41.229964 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:37:41.229964 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:37:41.229964 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:37:41.229964 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:37:41.229964 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:37:41.229964 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:37:41.229964 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:37:41.229964 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:37:41.229964 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:37:41.229964 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 744f6597-f965-405c-ad7b-66a8a0f1397b could not be found. Oct 04 18:37:41.229964 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:37:41.229964 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:37:41.235129 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:37:41.235129 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:41.235129 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:37:41.235129 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:37:41.235129 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:37:41.235129 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:37:41.235129 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 744f6597-f965-405c-ad7b-66a8a0f1397b could not be found. Oct 04 18:37:41.235129 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:37:41.235129 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-e5e95a1a-6303-45ed-b62b-506c7cd97125 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Returning 404 to user: Instance 744f6597-f965-405c-ad7b-66a8a0f1397b could not be found. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:37:41.235129 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-e5e95a1a-6303-45ed-b62b-506c7cd97125 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] 10.222.0.43 "GET /compute/v2.1/servers/744f6597-f965-405c-ad7b-66a8a0f1397b" status: 404 len: 111 microversion: 2.1 time: 0.065529 Oct 04 18:37:41.237167 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 788/1736] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:41 2022] GET /compute/v2.1/servers/744f6597-f965-405c-ad7b-66a8a0f1397b => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:37:41.289823 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-b4d69306-54d1-4767-9d9f-c0f93c7c463d tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:41.324035 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-b4d69306-54d1-4767-9d9f-c0f93c7c463d tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: d85af512-1b1f-42a4-9bb1-963cc956c9ae] Old instance type m1.heat2, new instance type m1.heat {{(pid=123596) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 04 18:37:41.337509 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-b4d69306-54d1-4767-9d9f-c0f93c7c463d tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Flavor limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:37:41.338254 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-b4d69306-54d1-4767-9d9f-c0f93c7c463d tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Image limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:37:41.339191 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-b4d69306-54d1-4767-9d9f-c0f93c7c463d tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Flavor pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:37:41.342777 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-b4d69306-54d1-4767-9d9f-c0f93c7c463d tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Image pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:37:41.350186 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-b4d69306-54d1-4767-9d9f-c0f93c7c463d tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:37:41.535395 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-d53e73d0-989e-43d7-b80c-f0c9455df5c1 tempest-FlavorsV2TestJSON-1387369016 tempest-FlavorsV2TestJSON-1387369016-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:41.553414 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-d53e73d0-989e-43d7-b80c-f0c9455df5c1 tempest-FlavorsV2TestJSON-1387369016 tempest-FlavorsV2TestJSON-1387369016-project] 10.222.0.43 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.309074 Oct 04 18:37:41.562895 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 789/1737] 10.222.0.43 () {58 vars in 1137 bytes} [Tue Oct 4 18:37:41 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:37:41.575023 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-1059b06e-3db8-46b9-b1a9-e2d6002eedf2 tempest-KeyPairsV22TestJSON-611266393 tempest-KeyPairsV22TestJSON-611266393-project] Calling method '.version_select at 0x7fb21fa3f550>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:41.596500 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-1059b06e-3db8-46b9-b1a9-e2d6002eedf2 tempest-KeyPairsV22TestJSON-611266393 tempest-KeyPairsV22TestJSON-611266393-project] 10.222.0.43 "GET /compute/v2.1/os-keypairs/tempest-keypair-2074407172" status: 200 len: 1534 microversion: 2.2 time: 0.032298 Oct 04 18:37:41.607910 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 790/1738] 10.222.0.43 () {60 vars in 1258 bytes} [Tue Oct 4 18:37:41 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-2074407172 => generated 1534 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:41.627746 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-b0c46708-840c-4c8d-8d15-15b41aecfce3 tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] Calling method '.version_select at 0x7fb21fbfe8b0>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:41.647815 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b0c46708-840c-4c8d-8d15-15b41aecfce3 tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:41.649813 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b0c46708-840c-4c8d-8d15-15b41aecfce3 tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:41.650456 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b0c46708-840c-4c8d-8d15-15b41aecfce3 tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:41.650921 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-b4d69306-54d1-4767-9d9f-c0f93c7c463d tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "POST /compute/v2.1/servers/d85af512-1b1f-42a4-9bb1-963cc956c9ae/action" status: 202 len: 0 microversion: 2.1 time: 0.592531 Oct 04 18:37:41.653720 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 949/1739] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 18:37:41 2022] POST /compute/v2.1/servers/d85af512-1b1f-42a4-9bb1-963cc956c9ae/action => generated 0 bytes in 597 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:37:41.659332 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-68a3e796-59c9-443e-b716-8588011d4b86 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:41.675339 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-b0c46708-840c-4c8d-8d15-15b41aecfce3 tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] 10.222.0.43 "GET /compute/v2.1/os-migrations" status: 200 len: 1960 microversion: 2.25 time: 0.064734 Oct 04 18:37:41.677693 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-68a3e796-59c9-443e-b716-8588011d4b86 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9fa193aff0474ae3ba5d1aa7b0d0e8c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a06b8feba3404490a448aa2d4fb106b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:41.678591 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 791/1740] 10.222.0.43 () {60 vars in 1184 bytes} [Tue Oct 4 18:37:41 2022] GET /compute/v2.1/os-migrations => generated 1960 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:37:41.681325 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-68a3e796-59c9-443e-b716-8588011d4b86 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': 'a06b8feba3404490a448aa2d4fb106b2'} {{(pid=123596) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:37:41.690385 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-0c4fc643-4dba-4887-b04a-c4892240863e tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:41.691236 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-0c4fc643-4dba-4887-b04a-c4892240863e tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] [instance: bea29c43-a5ab-42b3-9d5d-3b0f4f0f30f3] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:41.693520 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-68a3e796-59c9-443e-b716-8588011d4b86 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:41.696900 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-68a3e796-59c9-443e-b716-8588011d4b86 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:41.697392 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-68a3e796-59c9-443e-b716-8588011d4b86 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:41.699029 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-68a3e796-59c9-443e-b716-8588011d4b86 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:41.700013 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-68a3e796-59c9-443e-b716-8588011d4b86 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:41.704012 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-68a3e796-59c9-443e-b716-8588011d4b86 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:41.708777 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0c4fc643-4dba-4887-b04a-c4892240863e tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:41.717360 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0c4fc643-4dba-4887-b04a-c4892240863e tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:41.718592 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0c4fc643-4dba-4887-b04a-c4892240863e tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:41.720756 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0c4fc643-4dba-4887-b04a-c4892240863e tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:41.721497 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0c4fc643-4dba-4887-b04a-c4892240863e tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:41.722117 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0c4fc643-4dba-4887-b04a-c4892240863e tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:41.857472 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-68a3e796-59c9-443e-b716-8588011d4b86 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] 10.222.0.43 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 0.202346 Oct 04 18:37:41.858318 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 950/1741] 10.222.0.43 () {58 vars in 1230 bytes} [Tue Oct 4 18:37:41 2022] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:37:41.869961 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f113e947-0698-45d2-ba78-0be958db1611 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Calling method '.version_select at 0x7fb21fb7ae50>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:41.938132 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-f113e947-0698-45d2-ba78-0be958db1611 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] 10.222.0.43 "GET /compute/v2.1/images/d7825145-299c-45b6-9fe8-780722b2d243" status: 200 len: 1428 microversion: 2.1 time: 0.078361 Oct 04 18:37:41.939328 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 951/1742] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 18:37:41 2022] GET /compute/v2.1/images/d7825145-299c-45b6-9fe8-780722b2d243 => generated 1428 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:41.945223 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-0e32a9b6-2923-4dfe-a76a-173c31d5e6a3 tempest-FlavorsV2TestJSON-1387369016 tempest-FlavorsV2TestJSON-1387369016-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:41.959925 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-0c4fc643-4dba-4887-b04a-c4892240863e tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de84075cb5a44e83a41516b687f07e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9d3dec7f864f42adcd6e9c20043832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:41.968716 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-0c4fc643-4dba-4887-b04a-c4892240863e tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] 10.222.0.43 "GET /compute/v2.1/servers/bea29c43-a5ab-42b3-9d5d-3b0f4f0f30f3" status: 200 len: 1316 microversion: 2.1 time: 0.288777 Oct 04 18:37:41.969647 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 792/1743] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:41 2022] GET /compute/v2.1/servers/bea29c43-a5ab-42b3-9d5d-3b0f4f0f30f3 => generated 1316 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:41.975554 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-b25b371c-98df-4923-9f39-3fee1aebf660 tempest-KeyPairsV22TestJSON-611266393 tempest-KeyPairsV22TestJSON-611266393-project] Calling method '.version_select at 0x7fb21f980e50>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:41.978896 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-0e32a9b6-2923-4dfe-a76a-173c31d5e6a3 tempest-FlavorsV2TestJSON-1387369016 tempest-FlavorsV2TestJSON-1387369016-project] 10.222.0.43 "GET /compute/v2.1/flavors" status: 200 len: 2594 microversion: 2.1 time: 0.038252 Oct 04 18:37:41.980382 n-d-851028-13 devstack@n-api.service[123595]: WARNING oslo_db.sqlalchemy.utils [None req-b25b371c-98df-4923-9f39-3fee1aebf660 tempest-KeyPairsV22TestJSON-611266393 tempest-KeyPairsV22TestJSON-611266393-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 04 18:37:41.986312 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-b25b371c-98df-4923-9f39-3fee1aebf660 tempest-KeyPairsV22TestJSON-611266393 tempest-KeyPairsV22TestJSON-611266393-project] 10.222.0.43 "GET /compute/v2.1/os-keypairs" status: 200 len: 1391 microversion: 2.2 time: 0.015264 Oct 04 18:37:41.987191 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 793/1744] 10.222.0.43 () {60 vars in 1177 bytes} [Tue Oct 4 18:37:41 2022] GET /compute/v2.1/os-keypairs => generated 1391 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:41.995050 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-b87bcca2-820e-4182-949f-cc0c0c6f0bdb tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:41.996067 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-b87bcca2-820e-4182-949f-cc0c0c6f0bdb tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: d85af512-1b1f-42a4-9bb1-963cc956c9ae] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:41.997242 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 952/1745] 10.222.0.43 () {58 vars in 1125 bytes} [Tue Oct 4 18:37:41 2022] GET /compute/v2.1/flavors => generated 2594 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:42.004725 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-0c4fc1d0-1f5d-423f-bf58-07b4dc31d286 tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:42.005498 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-0c4fc1d0-1f5d-423f-bf58-07b4dc31d286 tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] [instance: 7222a4ce-d2a2-4b09-afc6-55bca52414d4] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:42.014387 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0c4fc1d0-1f5d-423f-bf58-07b4dc31d286 tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:42.014935 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0c4fc1d0-1f5d-423f-bf58-07b4dc31d286 tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:42.015485 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0c4fc1d0-1f5d-423f-bf58-07b4dc31d286 tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:42.016212 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0c4fc1d0-1f5d-423f-bf58-07b4dc31d286 tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:42.016667 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0c4fc1d0-1f5d-423f-bf58-07b4dc31d286 tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:42.017551 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0c4fc1d0-1f5d-423f-bf58-07b4dc31d286 tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:42.018511 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b87bcca2-820e-4182-949f-cc0c0c6f0bdb tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:42.019090 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b87bcca2-820e-4182-949f-cc0c0c6f0bdb tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:42.019547 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b87bcca2-820e-4182-949f-cc0c0c6f0bdb tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:42.022590 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b87bcca2-820e-4182-949f-cc0c0c6f0bdb tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:42.025585 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b87bcca2-820e-4182-949f-cc0c0c6f0bdb tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:42.026038 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b87bcca2-820e-4182-949f-cc0c0c6f0bdb tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:42.269188 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.objects.instance [None req-0c4fc1d0-1f5d-423f-bf58-07b4dc31d286 tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] Lazy-loading 'services' on Instance uuid 7222a4ce-d2a2-4b09-afc6-55bca52414d4 {{(pid=123596) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:37:42.299433 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-0c4fc1d0-1f5d-423f-bf58-07b4dc31d286 tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/7222a4ce-d2a2-4b09-afc6-55bca52414d4" status: 200 len: 2425 microversion: 2.25 time: 0.301022 Oct 04 18:37:42.300384 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 953/1746] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:37:41 2022] GET /compute/v2.1/servers/7222a4ce-d2a2-4b09-afc6-55bca52414d4 => generated 2425 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:37:42.323902 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-b87bcca2-820e-4182-949f-cc0c0c6f0bdb tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:42.330023 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-18322fdb-f39c-47bc-9b94-31d3a384a289 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:42.334004 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-b87bcca2-820e-4182-949f-cc0c0c6f0bdb tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/d85af512-1b1f-42a4-9bb1-963cc956c9ae" status: 200 len: 1471 microversion: 2.1 time: 0.345543 Oct 04 18:37:42.337144 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-18322fdb-f39c-47bc-9b94-31d3a384a289 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Request method failure captured: Oct 04 18:37:42.337144 n-d-851028-13 devstack@n-api.service[123596]: request: GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 HTTP/1.1 Oct 04 18:37:42.337144 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:37:42.337144 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:37:42.337144 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:37:42.337144 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 18:37:42.337144 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:37:42.337144 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:37:42.337144 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:37:42.337144 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:37:42.337144 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPH1FjpQDMTo-WQnaBct-hi793OA6nOXWID8VHZlHnLSe3utlSiytXhTaUmuOya5lNTsM3Kz-PejMBCBkmkHad0pn_NGG8jv8p4frIsdGg2r7IPRVyg-E3jXO7lLZ5_-qacE0T35EUj99w63mMEdMiYs1AsT4VphKCmkX_i1iKTkj4JU Oct 04 18:37:42.337144 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:37:42.337144 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:37:42.337144 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:37:42.337144 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:37:42.337144 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:37:42.337144 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:37:42.337144 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: a06b8feba3404490a448aa2d4fb106b2 Oct 04 18:37:42.337144 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-ListServersNegativeTestJSON-402277524 Oct 04 18:37:42.337144 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 18:37:42.337144 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 18:37:42.337144 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/a06b8feba3404490a448aa2d4fb106b2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_a06b8feba3404490a448aa2d4fb106b2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a06b8feba3404490a448aa2d4fb106b2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a06b8feba3404490a448aa2d4fb106b2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:37:42.337144 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-ListServersNegativeTestJSON-402277524 Oct 04 18:37:42.337144 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: a06b8feba3404490a448aa2d4fb106b2 Oct 04 18:37:42.337144 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-402277524 Oct 04 18:37:42.337144 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-ListServersNegativeTestJSON-402277524-project Oct 04 18:37:42.337144 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:37:42.337144 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:37:42.337144 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 9fa193aff0474ae3ba5d1aa7b0d0e8c4 Oct 04 18:37:42.337144 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-ListServersNegativeTestJSON-402277524-project Oct 04 18:37:42.337144 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 18:37:42.337144 n-d-851028-13 devstack@n-api.service[123596]: exception: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 04 18:37:42.337144 n-d-851028-13 devstack@n-api.service[123596]: action_args: {} Oct 04 18:37:42.337144 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:37:42.337144 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:42.337144 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:37:42.337144 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:37:42.337144 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:37:42.337144 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:37:42.337144 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '2011/01/01' is not a 'date-time' Oct 04 18:37:42.337144 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:37:42.337144 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['changes-since']['items']: Oct 04 18:37:42.337144 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi {'format': 'date-time', 'type': 'string'} Oct 04 18:37:42.337144 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:37:42.337144 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 04 18:37:42.337144 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi '2011/01/01' Oct 04 18:37:42.337144 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:37:42.337144 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:37:42.337144 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:37:42.337144 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:42.337144 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:37:42.337144 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:37:42.337144 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:37:42.337144 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:37:42.337144 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:37:42.337144 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:37:42.337144 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 18:37:42.337144 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:37:42.337144 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 18:37:42.337144 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:37:42.337144 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 18:37:42.337144 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:37:42.337144 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 04 18:37:42.337144 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 04 18:37:42.337144 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 04 18:37:42.337144 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:37:42.342562 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:37:42.342562 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:37:42.342562 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:37:42.342562 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 04 18:37:42.342562 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:37:42.342562 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:37:42.342562 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:37:42.342562 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:42.342562 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:37:42.342562 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:37:42.342562 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:37:42.342562 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:37:42.342562 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 04 18:37:42.342562 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:37:42.342562 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-18322fdb-f39c-47bc-9b94-31d3a384a289 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:37:42.342562 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-18322fdb-f39c-47bc-9b94-31d3a384a289 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] 10.222.0.43 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.020160 Oct 04 18:37:42.345564 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 954/1747] 10.222.0.43 () {58 vars in 1182 bytes} [Tue Oct 4 18:37:42 2022] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 45 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:37:42.352260 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 794/1748] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:41 2022] GET /compute/v2.1/servers/d85af512-1b1f-42a4-9bb1-963cc956c9ae => generated 1471 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:42.366843 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-98d33037-277f-4f1f-b0e5-86440cb04e6d tempest-FlavorsV2TestJSON-1387369016 tempest-FlavorsV2TestJSON-1387369016-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:42.367316 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-41899d07-108c-4567-8855-4ce5bbc85787 tempest-KeyPairsV22TestJSON-611266393 tempest-KeyPairsV22TestJSON-611266393-project] Calling method '.version_select at 0x7fb21fd3adc0>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:42.383081 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=4,nova_api:INSERT=3 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:37:42.385663 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-98d33037-277f-4f1f-b0e5-86440cb04e6d tempest-FlavorsV2TestJSON-1387369016 tempest-FlavorsV2TestJSON-1387369016-project] 10.222.0.43 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.031930 Oct 04 18:37:42.388116 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 795/1749] 10.222.0.43 () {58 vars in 1137 bytes} [Tue Oct 4 18:37:42 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:37:42.406037 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-244df90e-501c-48b1-8b95-c49b5be5837b tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:42.414521 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-244df90e-501c-48b1-8b95-c49b5be5837b tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] [instance: 7222a4ce-d2a2-4b09-afc6-55bca52414d4] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:42.433198 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-244df90e-501c-48b1-8b95-c49b5be5837b tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:42.433198 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-244df90e-501c-48b1-8b95-c49b5be5837b tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:42.433198 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-244df90e-501c-48b1-8b95-c49b5be5837b tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:42.439202 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-244df90e-501c-48b1-8b95-c49b5be5837b tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:42.445791 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-244df90e-501c-48b1-8b95-c49b5be5837b tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:42.446642 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-244df90e-501c-48b1-8b95-c49b5be5837b tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:42.458011 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-41899d07-108c-4567-8855-4ce5bbc85787 tempest-KeyPairsV22TestJSON-611266393 tempest-KeyPairsV22TestJSON-611266393-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2074407172" status: 204 len: 0 microversion: 2.2 time: 0.110207 Oct 04 18:37:42.458911 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 955/1750] 10.222.0.43 () {60 vars in 1261 bytes} [Tue Oct 4 18:37:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2074407172 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:37:42.468984 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-65e2e343-5228-4be9-9c8d-d283dcf2d17a tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:42.479687 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-65e2e343-5228-4be9-9c8d-d283dcf2d17a tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9fa193aff0474ae3ba5d1aa7b0d0e8c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a06b8feba3404490a448aa2d4fb106b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:42.480867 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-65e2e343-5228-4be9-9c8d-d283dcf2d17a tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Searching by: {'deleted': False, 'project_id': 'a06b8feba3404490a448aa2d4fb106b2'} {{(pid=123596) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:37:42.492346 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-65e2e343-5228-4be9-9c8d-d283dcf2d17a tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:42.492830 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-65e2e343-5228-4be9-9c8d-d283dcf2d17a tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:42.493361 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-65e2e343-5228-4be9-9c8d-d283dcf2d17a tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:42.500409 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-65e2e343-5228-4be9-9c8d-d283dcf2d17a tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:42.500905 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-65e2e343-5228-4be9-9c8d-d283dcf2d17a tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:42.501429 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-65e2e343-5228-4be9-9c8d-d283dcf2d17a tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:42.576393 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.multi_cell_list [None req-65e2e343-5228-4be9-9c8d-d283dcf2d17a tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=123596) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 18:37:42.632727 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-65e2e343-5228-4be9-9c8d-d283dcf2d17a tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] 10.222.0.43 "GET /compute/v2.1/servers" status: 200 len: 681 microversion: 2.1 time: 0.172639 Oct 04 18:37:42.634857 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 956/1751] 10.222.0.43 () {58 vars in 1125 bytes} [Tue Oct 4 18:37:42 2022] GET /compute/v2.1/servers => generated 681 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:37:42.641307 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-b2e5342b-48f5-4ab5-b2b4-583a943fb30b tempest-FlavorsV2TestJSON-1387369016 tempest-FlavorsV2TestJSON-1387369016-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:42.662203 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-b2e5342b-48f5-4ab5-b2b4-583a943fb30b tempest-FlavorsV2TestJSON-1387369016 tempest-FlavorsV2TestJSON-1387369016-project] 10.222.0.43 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.025132 Oct 04 18:37:42.663412 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 957/1752] 10.222.0.43 () {58 vars in 1137 bytes} [Tue Oct 4 18:37:42 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:37:42.685685 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-92e0440a-831d-4c7d-bc9a-d7f5710f4d7a tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:42.703603 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-92e0440a-831d-4c7d-bc9a-d7f5710f4d7a tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9fa193aff0474ae3ba5d1aa7b0d0e8c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a06b8feba3404490a448aa2d4fb106b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:42.708671 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.compute.servers [None req-92e0440a-831d-4c7d-bc9a-d7f5710f4d7a tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Removing options 'limit' from query {{(pid=123596) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 04 18:37:42.709886 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-92e0440a-831d-4c7d-bc9a-d7f5710f4d7a tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Searching by: {'deleted': False, 'project_id': 'a06b8feba3404490a448aa2d4fb106b2'} {{(pid=123596) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:37:42.720918 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-92e0440a-831d-4c7d-bc9a-d7f5710f4d7a tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:42.722136 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-92e0440a-831d-4c7d-bc9a-d7f5710f4d7a tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:42.722853 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-92e0440a-831d-4c7d-bc9a-d7f5710f4d7a tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:42.724072 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-92e0440a-831d-4c7d-bc9a-d7f5710f4d7a tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:42.724978 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-92e0440a-831d-4c7d-bc9a-d7f5710f4d7a tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:42.725643 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-92e0440a-831d-4c7d-bc9a-d7f5710f4d7a tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:42.786314 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.multi_cell_list [None req-92e0440a-831d-4c7d-bc9a-d7f5710f4d7a tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=123596) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 18:37:42.795990 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.objects.instance [None req-244df90e-501c-48b1-8b95-c49b5be5837b tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] Lazy-loading 'services' on Instance uuid 7222a4ce-d2a2-4b09-afc6-55bca52414d4 {{(pid=123595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:37:42.845345 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-244df90e-501c-48b1-8b95-c49b5be5837b tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/7222a4ce-d2a2-4b09-afc6-55bca52414d4" status: 200 len: 2425 microversion: 2.25 time: 0.446738 Oct 04 18:37:42.851038 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 796/1753] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:37:42 2022] GET /compute/v2.1/servers/7222a4ce-d2a2-4b09-afc6-55bca52414d4 => generated 2425 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:37:42.859729 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-16cc2389-88ba-4ab7-a0b5-8cbc93795889 tempest-FlavorsV2TestJSON-1387369016 tempest-FlavorsV2TestJSON-1387369016-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:42.885279 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-92e0440a-831d-4c7d-bc9a-d7f5710f4d7a tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] 10.222.0.43 "GET /compute/v2.1/servers?limit=102" status: 200 len: 681 microversion: 2.1 time: 0.220456 Oct 04 18:37:42.892793 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 958/1754] 10.222.0.43 () {58 vars in 1144 bytes} [Tue Oct 4 18:37:42 2022] GET /compute/v2.1/servers?limit=102 => generated 681 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:37:42.931399 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-55433e12-5b39-40cc-b363-b49d7736bc9e tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:42.949687 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-55433e12-5b39-40cc-b363-b49d7736bc9e tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Request method failure captured: Oct 04 18:37:42.949687 n-d-851028-13 devstack@n-api.service[123596]: request: GET /compute/v2.1/servers?limit=-1 HTTP/1.1 Oct 04 18:37:42.949687 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:37:42.949687 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:37:42.949687 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:37:42.949687 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 18:37:42.949687 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:37:42.949687 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:37:42.949687 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:37:42.949687 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:37:42.949687 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPH1FjpQDMTo-WQnaBct-hi793OA6nOXWID8VHZlHnLSe3utlSiytXhTaUmuOya5lNTsM3Kz-PejMBCBkmkHad0pn_NGG8jv8p4frIsdGg2r7IPRVyg-E3jXO7lLZ5_-qacE0T35EUj99w63mMEdMiYs1AsT4VphKCmkX_i1iKTkj4JU Oct 04 18:37:42.949687 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:37:42.949687 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:37:42.949687 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:37:42.949687 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:37:42.949687 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:37:42.949687 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:37:42.949687 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: a06b8feba3404490a448aa2d4fb106b2 Oct 04 18:37:42.949687 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-ListServersNegativeTestJSON-402277524 Oct 04 18:37:42.949687 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 18:37:42.949687 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 18:37:42.949687 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/a06b8feba3404490a448aa2d4fb106b2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_a06b8feba3404490a448aa2d4fb106b2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a06b8feba3404490a448aa2d4fb106b2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a06b8feba3404490a448aa2d4fb106b2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:37:42.949687 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-ListServersNegativeTestJSON-402277524 Oct 04 18:37:42.949687 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: a06b8feba3404490a448aa2d4fb106b2 Oct 04 18:37:42.949687 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-402277524 Oct 04 18:37:42.949687 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-ListServersNegativeTestJSON-402277524-project Oct 04 18:37:42.949687 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:37:42.949687 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:37:42.949687 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 9fa193aff0474ae3ba5d1aa7b0d0e8c4 Oct 04 18:37:42.949687 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-ListServersNegativeTestJSON-402277524-project Oct 04 18:37:42.949687 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 18:37:42.949687 n-d-851028-13 devstack@n-api.service[123596]: exception: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 04 18:37:42.949687 n-d-851028-13 devstack@n-api.service[123596]: action_args: {} Oct 04 18:37:42.949687 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:37:42.949687 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:42.949687 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:37:42.949687 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:37:42.949687 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:37:42.949687 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:37:42.949687 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '-1' does not match '^[0-9]*$' Oct 04 18:37:42.949687 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:37:42.949687 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Oct 04 18:37:42.949687 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 04 18:37:42.949687 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi 'minimum': 0, Oct 04 18:37:42.949687 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 04 18:37:42.949687 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 04 18:37:42.949687 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:37:42.949687 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 04 18:37:42.949687 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi '-1' Oct 04 18:37:42.949687 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:37:42.949687 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:37:42.949687 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:37:42.949687 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:42.949687 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:37:42.949687 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:37:42.949687 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:37:42.949687 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:37:42.949687 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:37:42.949687 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:37:42.949687 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 18:37:42.949687 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:37:42.949687 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 18:37:42.949687 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:37:42.949687 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 18:37:42.949687 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:37:42.949687 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 04 18:37:42.949687 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 04 18:37:42.949687 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 04 18:37:42.956451 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:37:42.956451 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:37:42.956451 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:37:42.956451 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:37:42.956451 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 04 18:37:42.956451 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:37:42.956451 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:37:42.956451 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:37:42.956451 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:42.956451 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:37:42.956451 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:37:42.956451 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:37:42.956451 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:37:42.956451 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 04 18:37:42.956451 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:37:42.959588 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-55433e12-5b39-40cc-b363-b49d7736bc9e tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:37:42.961396 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-55433e12-5b39-40cc-b363-b49d7736bc9e tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] 10.222.0.43 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.056904 Oct 04 18:37:42.966142 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 959/1755] 10.222.0.43 () {58 vars in 1142 bytes} [Tue Oct 4 18:37:42 2022] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 63 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:37:42.991181 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-28702ca9-a91f-4b5e-93be-2c2d462f220f tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Calling method '.version_select at 0x7fb21fd3aaf0>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:42.993189 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-16cc2389-88ba-4ab7-a0b5-8cbc93795889 tempest-FlavorsV2TestJSON-1387369016 tempest-FlavorsV2TestJSON-1387369016-project] 10.222.0.43 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.140862 Oct 04 18:37:43.009621 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 797/1756] 10.222.0.43 () {58 vars in 1165 bytes} [Tue Oct 4 18:37:42 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:43.032332 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-38caa81b-029e-4184-b520-8efc4835cce3 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:43.038248 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-38caa81b-029e-4184-b520-8efc4835cce3 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Request method failure captured: Oct 04 18:37:43.038248 n-d-851028-13 devstack@n-api.service[123595]: request: GET /compute/v2.1/servers?limit=testing HTTP/1.1 Oct 04 18:37:43.038248 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 18:37:43.038248 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 18:37:43.038248 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 18:37:43.038248 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 0 Oct 04 18:37:43.038248 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 18:37:43.038248 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 18:37:43.038248 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 18:37:43.038248 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 18:37:43.038248 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPH1FjpQDMTo-WQnaBct-hi793OA6nOXWID8VHZlHnLSe3utlSiytXhTaUmuOya5lNTsM3Kz-PejMBCBkmkHad0pn_NGG8jv8p4frIsdGg2r7IPRVyg-E3jXO7lLZ5_-qacE0T35EUj99w63mMEdMiYs1AsT4VphKCmkX_i1iKTkj4JU Oct 04 18:37:43.038248 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 18:37:43.038248 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 18:37:43.038248 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 18:37:43.038248 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 18:37:43.038248 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 18:37:43.038248 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 18:37:43.038248 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: a06b8feba3404490a448aa2d4fb106b2 Oct 04 18:37:43.038248 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-ListServersNegativeTestJSON-402277524 Oct 04 18:37:43.038248 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 18:37:43.038248 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 18:37:43.038248 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/a06b8feba3404490a448aa2d4fb106b2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_a06b8feba3404490a448aa2d4fb106b2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a06b8feba3404490a448aa2d4fb106b2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a06b8feba3404490a448aa2d4fb106b2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:37:43.038248 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-ListServersNegativeTestJSON-402277524 Oct 04 18:37:43.038248 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: a06b8feba3404490a448aa2d4fb106b2 Oct 04 18:37:43.038248 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-402277524 Oct 04 18:37:43.038248 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-ListServersNegativeTestJSON-402277524-project Oct 04 18:37:43.038248 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 18:37:43.038248 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 18:37:43.038248 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: 9fa193aff0474ae3ba5d1aa7b0d0e8c4 Oct 04 18:37:43.038248 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-ListServersNegativeTestJSON-402277524-project Oct 04 18:37:43.038248 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 18:37:43.038248 n-d-851028-13 devstack@n-api.service[123595]: exception: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 04 18:37:43.038248 n-d-851028-13 devstack@n-api.service[123595]: action_args: {} Oct 04 18:37:43.038248 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:37:43.038248 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:43.038248 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:37:43.038248 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:37:43.038248 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:37:43.038248 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:37:43.038248 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'testing' does not match '^[0-9]*$' Oct 04 18:37:43.038248 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:37:43.038248 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Oct 04 18:37:43.038248 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 04 18:37:43.038248 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi 'minimum': 0, Oct 04 18:37:43.038248 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 04 18:37:43.038248 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 04 18:37:43.038248 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:37:43.038248 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 04 18:37:43.038248 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi 'testing' Oct 04 18:37:43.038248 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:37:43.038248 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:37:43.038248 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:37:43.038248 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:43.038248 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:37:43.038248 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:37:43.038248 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:37:43.038248 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:37:43.038248 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:37:43.038248 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:37:43.038248 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 18:37:43.038248 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:37:43.038248 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 18:37:43.038248 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:37:43.038248 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 18:37:43.038248 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:37:43.038248 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 04 18:37:43.038248 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 04 18:37:43.038248 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 04 18:37:43.051472 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:37:43.051472 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:37:43.051472 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:37:43.051472 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:37:43.051472 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 04 18:37:43.051472 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:37:43.051472 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:37:43.051472 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:37:43.051472 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:43.051472 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:37:43.051472 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:37:43.051472 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:37:43.051472 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:37:43.051472 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 04 18:37:43.051472 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:37:43.054768 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-38caa81b-029e-4184-b520-8efc4835cce3 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:37:43.062446 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-38caa81b-029e-4184-b520-8efc4835cce3 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] 10.222.0.43 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.051463 Oct 04 18:37:43.064141 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 798/1757] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Oct 4 18:37:43 2022] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 54 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:37:43.072814 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-ef9cedda-ae10-4dc4-9501-4652393e2dd6 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:43.074700 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-ef9cedda-ae10-4dc4-9501-4652393e2dd6 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] [instance: 7222a4ce-d2a2-4b09-afc6-55bca52414d4] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:43.084515 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ef9cedda-ae10-4dc4-9501-4652393e2dd6 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:43.085710 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ef9cedda-ae10-4dc4-9501-4652393e2dd6 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:43.086344 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ef9cedda-ae10-4dc4-9501-4652393e2dd6 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:43.087258 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ef9cedda-ae10-4dc4-9501-4652393e2dd6 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:43.088490 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ef9cedda-ae10-4dc4-9501-4652393e2dd6 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:43.089245 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ef9cedda-ae10-4dc4-9501-4652393e2dd6 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:43.120086 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-28702ca9-a91f-4b5e-93be-2c2d462f220f tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] 10.222.0.43 "GET /compute/v2.1/images/d7825145-299c-45b6-9fe8-780722b2d243" status: 200 len: 1428 microversion: 2.1 time: 0.152481 Oct 04 18:37:43.120775 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 960/1758] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 18:37:42 2022] GET /compute/v2.1/images/d7825145-299c-45b6-9fe8-780722b2d243 => generated 1428 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:43.125784 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-916ae1dd-25e7-465e-ab4b-86b2a2a12129 tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:43.137885 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-916ae1dd-25e7-465e-ab4b-86b2a2a12129 tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] [instance: bea29c43-a5ab-42b3-9d5d-3b0f4f0f30f3] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:43.155873 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-916ae1dd-25e7-465e-ab4b-86b2a2a12129 tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:43.167469 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-916ae1dd-25e7-465e-ab4b-86b2a2a12129 tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:43.170956 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-916ae1dd-25e7-465e-ab4b-86b2a2a12129 tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:43.174599 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-916ae1dd-25e7-465e-ab4b-86b2a2a12129 tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:43.178302 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-916ae1dd-25e7-465e-ab4b-86b2a2a12129 tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:43.187130 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-916ae1dd-25e7-465e-ab4b-86b2a2a12129 tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:43.267943 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:37:43.399851 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.objects.instance [None req-ef9cedda-ae10-4dc4-9501-4652393e2dd6 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lazy-loading 'services' on Instance uuid 7222a4ce-d2a2-4b09-afc6-55bca52414d4 {{(pid=123595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:37:43.622748 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-ef9cedda-ae10-4dc4-9501-4652393e2dd6 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] 10.222.0.43 "DELETE /compute/v2.1/servers/7222a4ce-d2a2-4b09-afc6-55bca52414d4/os-volume_attachments/36fe8524-c75a-41e5-8c52-89819bcd9c83" status: 202 len: 0 microversion: 2.25 time: 0.556998 Oct 04 18:37:43.623741 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 799/1759] 10.222.0.43 () {60 vars in 1457 bytes} [Tue Oct 4 18:37:43 2022] DELETE /compute/v2.1/servers/7222a4ce-d2a2-4b09-afc6-55bca52414d4/os-volume_attachments/36fe8524-c75a-41e5-8c52-89819bcd9c83 => generated 0 bytes in 559 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:37:43.635082 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-b32703f2-b413-4be5-a82c-c7577935f53f tempest-FlavorsV2TestJSON-1387369016 tempest-FlavorsV2TestJSON-1387369016-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:43.653076 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-b32703f2-b413-4be5-a82c-c7577935f53f tempest-FlavorsV2TestJSON-1387369016 tempest-FlavorsV2TestJSON-1387369016-project] 10.222.0.43 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.026234 Oct 04 18:37:43.657363 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 800/1760] 10.222.0.43 () {58 vars in 1137 bytes} [Tue Oct 4 18:37:43 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:37:43.671120 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-b22bd4b1-5c09-4d74-8f53-ce17b3837a0d tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:43.679001 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-b22bd4b1-5c09-4d74-8f53-ce17b3837a0d tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9fa193aff0474ae3ba5d1aa7b0d0e8c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a06b8feba3404490a448aa2d4fb106b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:43.680137 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-b22bd4b1-5c09-4d74-8f53-ce17b3837a0d tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': 'a06b8feba3404490a448aa2d4fb106b2'} {{(pid=123595) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:37:43.698615 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.compute.servers [None req-b22bd4b1-5c09-4d74-8f53-ce17b3837a0d tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Flavor 'non_existing_flavor' could not be found {{(pid=123595) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:336}} Oct 04 18:37:43.698804 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-916ae1dd-25e7-465e-ab4b-86b2a2a12129 tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de84075cb5a44e83a41516b687f07e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9d3dec7f864f42adcd6e9c20043832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:43.700428 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-b22bd4b1-5c09-4d74-8f53-ce17b3837a0d tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] 10.222.0.43 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.041719 Oct 04 18:37:43.701842 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 801/1761] 10.222.0.43 () {58 vars in 1178 bytes} [Tue Oct 4 18:37:43 2022] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:37:43.707999 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-10c54f09-f3bd-4277-b8a8-f35cc59e4bf9 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:43.708991 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-10c54f09-f3bd-4277-b8a8-f35cc59e4bf9 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: d85af512-1b1f-42a4-9bb1-963cc956c9ae] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:43.717077 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-916ae1dd-25e7-465e-ab4b-86b2a2a12129 tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] 10.222.0.43 "GET /compute/v2.1/servers/bea29c43-a5ab-42b3-9d5d-3b0f4f0f30f3" status: 200 len: 1316 microversion: 2.1 time: 0.594941 Oct 04 18:37:43.729324 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 961/1762] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:43 2022] GET /compute/v2.1/servers/bea29c43-a5ab-42b3-9d5d-3b0f4f0f30f3 => generated 1316 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:43.730469 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-10c54f09-f3bd-4277-b8a8-f35cc59e4bf9 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:43.734085 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-0d06ac73-5b2f-4a02-86c5-01236ca2a961 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:43.734915 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-10c54f09-f3bd-4277-b8a8-f35cc59e4bf9 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:43.735553 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-10c54f09-f3bd-4277-b8a8-f35cc59e4bf9 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:43.736403 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-0d06ac73-5b2f-4a02-86c5-01236ca2a961 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] [instance: 7222a4ce-d2a2-4b09-afc6-55bca52414d4] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:43.736820 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-10c54f09-f3bd-4277-b8a8-f35cc59e4bf9 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:43.740245 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-10c54f09-f3bd-4277-b8a8-f35cc59e4bf9 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:43.740708 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-10c54f09-f3bd-4277-b8a8-f35cc59e4bf9 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:43.758037 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0d06ac73-5b2f-4a02-86c5-01236ca2a961 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:43.758537 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0d06ac73-5b2f-4a02-86c5-01236ca2a961 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:43.760545 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0d06ac73-5b2f-4a02-86c5-01236ca2a961 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:43.765304 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0d06ac73-5b2f-4a02-86c5-01236ca2a961 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:43.766673 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0d06ac73-5b2f-4a02-86c5-01236ca2a961 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:43.767306 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0d06ac73-5b2f-4a02-86c5-01236ca2a961 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:43.844672 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-0d06ac73-5b2f-4a02-86c5-01236ca2a961 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] 10.222.0.43 "GET /compute/v2.1/servers/7222a4ce-d2a2-4b09-afc6-55bca52414d4/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.122088 Oct 04 18:37:43.845292 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 962/1763] 10.222.0.43 () {60 vars in 1343 bytes} [Tue Oct 4 18:37:43 2022] GET /compute/v2.1/servers/7222a4ce-d2a2-4b09-afc6-55bca52414d4/os-volume_attachments => generated 197 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:37:43.859568 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-e299953c-1a56-4bd6-a16d-8ec8813f0746 tempest-FlavorsV2TestJSON-1387369016 tempest-FlavorsV2TestJSON-1387369016-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:43.917392 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-e299953c-1a56-4bd6-a16d-8ec8813f0746 tempest-FlavorsV2TestJSON-1387369016 tempest-FlavorsV2TestJSON-1387369016-project] 10.222.0.43 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.053290 Oct 04 18:37:43.918363 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 963/1764] 10.222.0.43 () {58 vars in 1169 bytes} [Tue Oct 4 18:37:43 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:43.923158 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-7934fc99-c040-4b2e-9c5c-3df411804a29 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:43.941518 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-7934fc99-c040-4b2e-9c5c-3df411804a29 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9fa193aff0474ae3ba5d1aa7b0d0e8c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a06b8feba3404490a448aa2d4fb106b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:43.945248 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-7934fc99-c040-4b2e-9c5c-3df411804a29 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': 'a06b8feba3404490a448aa2d4fb106b2'} {{(pid=123596) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:37:43.958110 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7934fc99-c040-4b2e-9c5c-3df411804a29 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:43.959016 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7934fc99-c040-4b2e-9c5c-3df411804a29 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:43.964578 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7934fc99-c040-4b2e-9c5c-3df411804a29 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:43.972441 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7934fc99-c040-4b2e-9c5c-3df411804a29 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:43.973148 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7934fc99-c040-4b2e-9c5c-3df411804a29 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:43.973745 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7934fc99-c040-4b2e-9c5c-3df411804a29 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:44.065057 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-10c54f09-f3bd-4277-b8a8-f35cc59e4bf9 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:44.083776 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-10c54f09-f3bd-4277-b8a8-f35cc59e4bf9 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/d85af512-1b1f-42a4-9bb1-963cc956c9ae" status: 200 len: 1471 microversion: 2.1 time: 0.380214 Oct 04 18:37:44.084376 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 802/1765] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:43 2022] GET /compute/v2.1/servers/d85af512-1b1f-42a4-9bb1-963cc956c9ae => generated 1471 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:44.110336 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-147007e5-7ec3-4499-801a-81e05b23d727 tempest-FlavorsV2TestJSON-1387369016 tempest-FlavorsV2TestJSON-1387369016-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:44.153227 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-147007e5-7ec3-4499-801a-81e05b23d727 tempest-FlavorsV2TestJSON-1387369016 tempest-FlavorsV2TestJSON-1387369016-project] 10.222.0.43 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.056779 Oct 04 18:37:44.156135 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 803/1766] 10.222.0.43 () {58 vars in 1161 bytes} [Tue Oct 4 18:37:44 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:37:44.174928 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-57250d38-f9fb-4e33-90ad-0cd077bb4394 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Calling method '.version_select at 0x7fb21fc3c310>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:44.295795 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-57250d38-f9fb-4e33-90ad-0cd077bb4394 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] 10.222.0.43 "GET /compute/v2.1/images/d7825145-299c-45b6-9fe8-780722b2d243" status: 200 len: 1428 microversion: 2.1 time: 0.137593 Oct 04 18:37:44.297560 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 804/1767] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 18:37:44 2022] GET /compute/v2.1/images/d7825145-299c-45b6-9fe8-780722b2d243 => generated 1428 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:44.308361 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-7934fc99-c040-4b2e-9c5c-3df411804a29 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] 10.222.0.43 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 0.388884 Oct 04 18:37:44.309249 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 964/1768] 10.222.0.43 () {58 vars in 1174 bytes} [Tue Oct 4 18:37:43 2022] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:37:44.323736 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-b23d1c1e-dce6-4187-9c12-e0e8ec92250f tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:44.329342 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-99317688-49ac-4c74-883d-097683538888 tempest-FlavorsV2TestJSON-1387369016 tempest-FlavorsV2TestJSON-1387369016-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:44.331424 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-b23d1c1e-dce6-4187-9c12-e0e8ec92250f tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9fa193aff0474ae3ba5d1aa7b0d0e8c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a06b8feba3404490a448aa2d4fb106b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:44.332377 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-b23d1c1e-dce6-4187-9c12-e0e8ec92250f tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': 'a06b8feba3404490a448aa2d4fb106b2'} {{(pid=123596) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:37:44.338772 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b23d1c1e-dce6-4187-9c12-e0e8ec92250f tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:44.339908 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b23d1c1e-dce6-4187-9c12-e0e8ec92250f tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:44.343213 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b23d1c1e-dce6-4187-9c12-e0e8ec92250f tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:44.351074 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b23d1c1e-dce6-4187-9c12-e0e8ec92250f tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:44.352577 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b23d1c1e-dce6-4187-9c12-e0e8ec92250f tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:44.353265 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b23d1c1e-dce6-4187-9c12-e0e8ec92250f tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:44.354135 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-99317688-49ac-4c74-883d-097683538888 tempest-FlavorsV2TestJSON-1387369016 tempest-FlavorsV2TestJSON-1387369016-project] 10.222.0.43 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.045905 Oct 04 18:37:44.365145 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 805/1769] 10.222.0.43 () {58 vars in 1137 bytes} [Tue Oct 4 18:37:44 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:37:44.371151 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-8f334e8f-7b26-4897-b26e-03a0bcd73507 tempest-FlavorsV2TestJSON-1387369016 tempest-FlavorsV2TestJSON-1387369016-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:44.463004 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-8f334e8f-7b26-4897-b26e-03a0bcd73507 tempest-FlavorsV2TestJSON-1387369016 tempest-FlavorsV2TestJSON-1387369016-project] 10.222.0.43 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2500 microversion: 2.1 time: 0.096612 Oct 04 18:37:44.465142 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 806/1770] 10.222.0.43 () {58 vars in 1167 bytes} [Tue Oct 4 18:37:44 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2500 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:44.492025 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-33a4b6b4-b399-438e-9cb1-fe80b935e829 tempest-FlavorsV2TestJSON-1387369016 tempest-FlavorsV2TestJSON-1387369016-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:44.515807 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-b23d1c1e-dce6-4187-9c12-e0e8ec92250f tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] 10.222.0.43 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.194565 Oct 04 18:37:44.518763 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 965/1771] 10.222.0.43 () {58 vars in 1184 bytes} [Tue Oct 4 18:37:44 2022] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:37:44.526511 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-33a4b6b4-b399-438e-9cb1-fe80b935e829 tempest-FlavorsV2TestJSON-1387369016 tempest-FlavorsV2TestJSON-1387369016-project] 10.222.0.43 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.044795 Oct 04 18:37:44.533481 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 807/1772] 10.222.0.43 () {58 vars in 1137 bytes} [Tue Oct 4 18:37:44 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:37:44.539836 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-456e9acf-0444-4bad-91db-df4b49fbf3d9 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:44.553002 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-09bcb2ae-d76b-4c7b-8d59-e867afa983ab tempest-FlavorsV2TestJSON-1387369016 tempest-FlavorsV2TestJSON-1387369016-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:44.556662 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-456e9acf-0444-4bad-91db-df4b49fbf3d9 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9fa193aff0474ae3ba5d1aa7b0d0e8c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a06b8feba3404490a448aa2d4fb106b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:44.558566 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-456e9acf-0444-4bad-91db-df4b49fbf3d9 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Searching by: {'deleted': False, 'project_id': 'a06b8feba3404490a448aa2d4fb106b2'} {{(pid=123596) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:37:44.579819 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-456e9acf-0444-4bad-91db-df4b49fbf3d9 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:44.586488 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-456e9acf-0444-4bad-91db-df4b49fbf3d9 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:44.588182 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-456e9acf-0444-4bad-91db-df4b49fbf3d9 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:44.589243 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-456e9acf-0444-4bad-91db-df4b49fbf3d9 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:44.590797 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-456e9acf-0444-4bad-91db-df4b49fbf3d9 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:44.592305 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-456e9acf-0444-4bad-91db-df4b49fbf3d9 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:44.632832 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-09bcb2ae-d76b-4c7b-8d59-e867afa983ab tempest-FlavorsV2TestJSON-1387369016 tempest-FlavorsV2TestJSON-1387369016-project] 10.222.0.43 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.093397 Oct 04 18:37:44.647945 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 808/1773] 10.222.0.43 () {58 vars in 1144 bytes} [Tue Oct 4 18:37:44 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:44.667996 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-e2345ca4-ebd9-4be2-9a75-12f74420c9d7 req-c36310db-6146-4490-adf8-6f6b07eff6bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bea29c43-a5ab-42b3-9d5d-3b0f4f0f30f3", "name": "network-vif-plugged", "status": "completed", "tag": "b42ba2ea-c6ef-4e9b-937f-48b377bf9659"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:37:44.701176 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-e2345ca4-ebd9-4be2-9a75-12f74420c9d7 req-c36310db-6146-4490-adf8-6f6b07eff6bb service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:44.706460 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-e2345ca4-ebd9-4be2-9a75-12f74420c9d7 req-c36310db-6146-4490-adf8-6f6b07eff6bb service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:44.707864 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-e2345ca4-ebd9-4be2-9a75-12f74420c9d7 req-c36310db-6146-4490-adf8-6f6b07eff6bb service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:44.763953 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-e2345ca4-ebd9-4be2-9a75-12f74420c9d7 req-c36310db-6146-4490-adf8-6f6b07eff6bb service nova] Creating event network-vif-plugged:b42ba2ea-c6ef-4e9b-937f-48b377bf9659 for instance bea29c43-a5ab-42b3-9d5d-3b0f4f0f30f3 on n-h1-851028-13 Oct 04 18:37:44.777212 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.multi_cell_list [None req-456e9acf-0444-4bad-91db-df4b49fbf3d9 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=123596) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 18:37:44.779005 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-e2345ca4-ebd9-4be2-9a75-12f74420c9d7 req-c36310db-6146-4490-adf8-6f6b07eff6bb service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127912 Oct 04 18:37:44.789167 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 809/1774] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:37:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:37:44.799027 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-a173cb4f-aaed-41b1-a18a-33af47627879 tempest-FlavorsV2TestJSON-1387369016 tempest-FlavorsV2TestJSON-1387369016-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:44.820722 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-a173cb4f-aaed-41b1-a18a-33af47627879 tempest-FlavorsV2TestJSON-1387369016 tempest-FlavorsV2TestJSON-1387369016-project] 10.222.0.43 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.029905 Oct 04 18:37:44.821355 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 810/1775] 10.222.0.43 () {58 vars in 1137 bytes} [Tue Oct 4 18:37:44 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:37:44.848298 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-46739e90-cb44-42cd-b542-974e986d686f tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:44.850486 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-46739e90-cb44-42cd-b542-974e986d686f tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] [instance: bea29c43-a5ab-42b3-9d5d-3b0f4f0f30f3] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:44.868734 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-46739e90-cb44-42cd-b542-974e986d686f tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:44.871499 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-46739e90-cb44-42cd-b542-974e986d686f tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:44.872946 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-46739e90-cb44-42cd-b542-974e986d686f tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:44.879651 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-46739e90-cb44-42cd-b542-974e986d686f tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:44.880341 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-46739e90-cb44-42cd-b542-974e986d686f tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:44.881271 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-46739e90-cb44-42cd-b542-974e986d686f tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:45.068595 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-456e9acf-0444-4bad-91db-df4b49fbf3d9 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa193aff0474ae3ba5d1aa7b0d0e8c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a06b8feba3404490a448aa2d4fb106b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:45.084306 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-456e9acf-0444-4bad-91db-df4b49fbf3d9 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:45.085163 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-456e9acf-0444-4bad-91db-df4b49fbf3d9 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:45.085822 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-456e9acf-0444-4bad-91db-df4b49fbf3d9 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:45.488282 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-46739e90-cb44-42cd-b542-974e986d686f tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de84075cb5a44e83a41516b687f07e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9d3dec7f864f42adcd6e9c20043832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:45.496680 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-46739e90-cb44-42cd-b542-974e986d686f tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] 10.222.0.43 "GET /compute/v2.1/servers/bea29c43-a5ab-42b3-9d5d-3b0f4f0f30f3" status: 200 len: 1316 microversion: 2.1 time: 0.662688 Oct 04 18:37:45.500658 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 811/1776] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:44 2022] GET /compute/v2.1/servers/bea29c43-a5ab-42b3-9d5d-3b0f4f0f30f3 => generated 1316 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:45.511006 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-15c24598-c741-4b7d-922f-5b723d25bdc9 tempest-FlavorsV2TestJSON-1387369016 tempest-FlavorsV2TestJSON-1387369016-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:45.530775 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-456e9acf-0444-4bad-91db-df4b49fbf3d9 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] 10.222.0.43 "GET /compute/v2.1/servers/detail" status: 200 len: 3022 microversion: 2.1 time: 1.002493 Oct 04 18:37:45.531388 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 966/1777] 10.222.0.43 () {58 vars in 1146 bytes} [Tue Oct 4 18:37:44 2022] GET /compute/v2.1/servers/detail => generated 3022 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:45.540684 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-9f8e17cb-ac75-43e1-b412-86d63304b944 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:45.547887 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-9f8e17cb-ac75-43e1-b412-86d63304b944 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] [instance: 7222a4ce-d2a2-4b09-afc6-55bca52414d4] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:45.567547 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9f8e17cb-ac75-43e1-b412-86d63304b944 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:45.568066 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9f8e17cb-ac75-43e1-b412-86d63304b944 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:45.568527 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9f8e17cb-ac75-43e1-b412-86d63304b944 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:45.570918 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9f8e17cb-ac75-43e1-b412-86d63304b944 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:45.571424 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9f8e17cb-ac75-43e1-b412-86d63304b944 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:45.574485 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9f8e17cb-ac75-43e1-b412-86d63304b944 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:45.578420 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-15c24598-c741-4b7d-922f-5b723d25bdc9 tempest-FlavorsV2TestJSON-1387369016 tempest-FlavorsV2TestJSON-1387369016-project] 10.222.0.43 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.075174 Oct 04 18:37:45.580800 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 812/1778] 10.222.0.43 () {58 vars in 1148 bytes} [Tue Oct 4 18:37:45 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:45.586328 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-df07a8fd-b5fc-4275-b257-7df23662762a tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:45.587256 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-df07a8fd-b5fc-4275-b257-7df23662762a tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: d85af512-1b1f-42a4-9bb1-963cc956c9ae] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:45.605753 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-df07a8fd-b5fc-4275-b257-7df23662762a tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:45.608421 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-df07a8fd-b5fc-4275-b257-7df23662762a tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:45.609302 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-df07a8fd-b5fc-4275-b257-7df23662762a tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:45.610464 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-df07a8fd-b5fc-4275-b257-7df23662762a tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:45.611174 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-df07a8fd-b5fc-4275-b257-7df23662762a tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:45.611857 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-df07a8fd-b5fc-4275-b257-7df23662762a tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:45.714895 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-9f8e17cb-ac75-43e1-b412-86d63304b944 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] 10.222.0.43 "GET /compute/v2.1/servers/7222a4ce-d2a2-4b09-afc6-55bca52414d4/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.182413 Oct 04 18:37:45.722141 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 967/1779] 10.222.0.43 () {60 vars in 1343 bytes} [Tue Oct 4 18:37:45 2022] GET /compute/v2.1/servers/7222a4ce-d2a2-4b09-afc6-55bca52414d4/os-volume_attachments => generated 197 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:37:45.731736 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-458a797d-7f29-4491-8a35-c33116908d07 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Calling method '.version_select at 0x7fb21f222dc0>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:45.851649 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-458a797d-7f29-4491-8a35-c33116908d07 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] 10.222.0.43 "GET /compute/v2.1/images/d7825145-299c-45b6-9fe8-780722b2d243" status: 200 len: 1428 microversion: 2.1 time: 0.123565 Oct 04 18:37:45.859965 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 968/1780] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 18:37:45 2022] GET /compute/v2.1/images/d7825145-299c-45b6-9fe8-780722b2d243 => generated 1428 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:45.884906 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-c7699cab-f7bc-474b-a650-5b088d59eb5d tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:45.913444 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-c7699cab-f7bc-474b-a650-5b088d59eb5d tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9fa193aff0474ae3ba5d1aa7b0d0e8c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a06b8feba3404490a448aa2d4fb106b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:45.914620 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-c7699cab-f7bc-474b-a650-5b088d59eb5d tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] 10.222.0.43 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.053588 Oct 04 18:37:45.915210 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 969/1781] 10.222.0.43 () {58 vars in 1178 bytes} [Tue Oct 4 18:37:45 2022] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:37:45.946474 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-ac981fba-67d9-453f-a6dd-24abc016bbad tempest-FlavorsV2TestJSON-1387369016 tempest-FlavorsV2TestJSON-1387369016-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:46.016083 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-ac981fba-67d9-453f-a6dd-24abc016bbad tempest-FlavorsV2TestJSON-1387369016 tempest-FlavorsV2TestJSON-1387369016-project] 10.222.0.43 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.094366 Oct 04 18:37:46.016697 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 970/1782] 10.222.0.43 () {58 vars in 1140 bytes} [Tue Oct 4 18:37:45 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:37:46.048853 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-7908d512-167d-4127-b4d2-9c49f4fac1bd tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:46.068299 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-7908d512-167d-4127-b4d2-9c49f4fac1bd tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9fa193aff0474ae3ba5d1aa7b0d0e8c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a06b8feba3404490a448aa2d4fb106b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:46.068977 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-7908d512-167d-4127-b4d2-9c49f4fac1bd tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Searching by: {'deleted': False, 'project_id': 'a06b8feba3404490a448aa2d4fb106b2'} {{(pid=123596) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:37:46.092292 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7908d512-167d-4127-b4d2-9c49f4fac1bd tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:46.096483 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7908d512-167d-4127-b4d2-9c49f4fac1bd tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:46.097198 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7908d512-167d-4127-b4d2-9c49f4fac1bd tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:46.099226 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7908d512-167d-4127-b4d2-9c49f4fac1bd tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:46.110183 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7908d512-167d-4127-b4d2-9c49f4fac1bd tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:46.111926 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7908d512-167d-4127-b4d2-9c49f4fac1bd tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:46.117867 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-df07a8fd-b5fc-4275-b257-7df23662762a tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:46.133362 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-df07a8fd-b5fc-4275-b257-7df23662762a tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/d85af512-1b1f-42a4-9bb1-963cc956c9ae" status: 200 len: 1471 microversion: 2.1 time: 0.546880 Oct 04 18:37:46.137594 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 813/1783] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:45 2022] GET /compute/v2.1/servers/d85af512-1b1f-42a4-9bb1-963cc956c9ae => generated 1471 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:46.148664 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-a155b3c7-aba6-4d87-a742-5c5ff71b251e tempest-FlavorsV2TestJSON-1387369016 tempest-FlavorsV2TestJSON-1387369016-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:46.183679 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-a155b3c7-aba6-4d87-a742-5c5ff71b251e tempest-FlavorsV2TestJSON-1387369016 tempest-FlavorsV2TestJSON-1387369016-project] 10.222.0.43 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.044649 Oct 04 18:37:46.199569 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.multi_cell_list [None req-7908d512-167d-4127-b4d2-9c49f4fac1bd tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=123596) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 18:37:46.200421 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 814/1784] 10.222.0.43 () {58 vars in 1137 bytes} [Tue Oct 4 18:37:46 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:37:46.218123 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-3c90a04d-f8a3-4d19-a1b2-2a301b23edda tempest-FlavorsV2TestJSON-1387369016 tempest-FlavorsV2TestJSON-1387369016-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:46.225448 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:37:46.308454 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-3c90a04d-f8a3-4d19-a1b2-2a301b23edda tempest-FlavorsV2TestJSON-1387369016 tempest-FlavorsV2TestJSON-1387369016-project] 10.222.0.43 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1300 microversion: 2.1 time: 0.097121 Oct 04 18:37:46.309717 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 815/1785] 10.222.0.43 () {58 vars in 1146 bytes} [Tue Oct 4 18:37:46 2022] GET /compute/v2.1/flavors?marker=452 => generated 1300 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:37:46.323580 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-7908d512-167d-4127-b4d2-9c49f4fac1bd tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] 10.222.0.43 "GET /compute/v2.1/servers" status: 200 len: 681 microversion: 2.1 time: 0.297849 Oct 04 18:37:46.324500 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-0cb01cef-f4f5-4489-9988-55de0a4866e7 tempest-FlavorsV2TestJSON-1387369016 tempest-FlavorsV2TestJSON-1387369016-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:46.328167 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 971/1786] 10.222.0.43 () {58 vars in 1125 bytes} [Tue Oct 4 18:37:46 2022] GET /compute/v2.1/servers => generated 681 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:37:46.343474 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-18daf6ca-a2b9-4b4f-a62e-ad62d4509123 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:46.344665 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-18daf6ca-a2b9-4b4f-a62e-ad62d4509123 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] [instance: 744f6597-f965-405c-ad7b-66a8a0f1397b] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:46.356324 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-18daf6ca-a2b9-4b4f-a62e-ad62d4509123 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:46.359003 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-18daf6ca-a2b9-4b4f-a62e-ad62d4509123 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:46.359571 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-18daf6ca-a2b9-4b4f-a62e-ad62d4509123 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:46.360891 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-18daf6ca-a2b9-4b4f-a62e-ad62d4509123 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:46.362018 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-18daf6ca-a2b9-4b4f-a62e-ad62d4509123 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:46.364686 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-18daf6ca-a2b9-4b4f-a62e-ad62d4509123 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:46.402766 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-0cb01cef-f4f5-4489-9988-55de0a4866e7 tempest-FlavorsV2TestJSON-1387369016 tempest-FlavorsV2TestJSON-1387369016-project] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.076774 Oct 04 18:37:46.403679 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 816/1787] 10.222.0.43 () {58 vars in 1146 bytes} [Tue Oct 4 18:37:46 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:46.419244 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-18daf6ca-a2b9-4b4f-a62e-ad62d4509123 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] HTTP exception thrown: Instance 744f6597-f965-405c-ad7b-66a8a0f1397b could not be found. Oct 04 18:37:46.421380 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-18daf6ca-a2b9-4b4f-a62e-ad62d4509123 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Request method failure captured: Oct 04 18:37:46.421380 n-d-851028-13 devstack@n-api.service[123596]: request: DELETE /compute/v2.1/servers/744f6597-f965-405c-ad7b-66a8a0f1397b HTTP/1.1 Oct 04 18:37:46.421380 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:37:46.421380 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:37:46.421380 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:37:46.421380 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 18:37:46.421380 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:37:46.421380 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:37:46.421380 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:37:46.421380 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:37:46.421380 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPH1FjpQDMTo-WQnaBct-hi793OA6nOXWID8VHZlHnLSe3utlSiytXhTaUmuOya5lNTsM3Kz-PejMBCBkmkHad0pn_NGG8jv8p4frIsdGg2r7IPRVyg-E3jXO7lLZ5_-qacE0T35EUj99w63mMEdMiYs1AsT4VphKCmkX_i1iKTkj4JU Oct 04 18:37:46.421380 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:37:46.421380 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:37:46.421380 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:37:46.421380 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:37:46.421380 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:37:46.421380 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:37:46.421380 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: a06b8feba3404490a448aa2d4fb106b2 Oct 04 18:37:46.421380 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-ListServersNegativeTestJSON-402277524 Oct 04 18:37:46.421380 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 18:37:46.421380 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 18:37:46.421380 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/a06b8feba3404490a448aa2d4fb106b2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_a06b8feba3404490a448aa2d4fb106b2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a06b8feba3404490a448aa2d4fb106b2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a06b8feba3404490a448aa2d4fb106b2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:37:46.421380 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-ListServersNegativeTestJSON-402277524 Oct 04 18:37:46.421380 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: a06b8feba3404490a448aa2d4fb106b2 Oct 04 18:37:46.421380 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-402277524 Oct 04 18:37:46.421380 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-ListServersNegativeTestJSON-402277524-project Oct 04 18:37:46.421380 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:37:46.421380 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:37:46.421380 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 9fa193aff0474ae3ba5d1aa7b0d0e8c4 Oct 04 18:37:46.421380 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-ListServersNegativeTestJSON-402277524-project Oct 04 18:37:46.421380 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 18:37:46.421380 n-d-851028-13 devstack@n-api.service[123596]: exception: Instance 744f6597-f965-405c-ad7b-66a8a0f1397b could not be found. Oct 04 18:37:46.421380 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': '744f6597-f965-405c-ad7b-66a8a0f1397b'} Oct 04 18:37:46.421380 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:37:46.421380 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:46.421380 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:37:46.421380 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:37:46.421380 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:37:46.421380 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:37:46.421380 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:37:46.421380 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:37:46.421380 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:37:46.421380 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:37:46.421380 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 744f6597-f965-405c-ad7b-66a8a0f1397b could not be found. Oct 04 18:37:46.421380 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:37:46.421380 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:37:46.421380 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:37:46.421380 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:46.421380 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:37:46.421380 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:37:46.421380 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:37:46.421380 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:37:46.421380 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:37:46.421380 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:37:46.421380 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:37:46.421380 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:37:46.421380 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:37:46.421380 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:37:46.421380 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:37:46.421380 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:37:46.421380 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:37:46.421380 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:37:46.427271 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 744f6597-f965-405c-ad7b-66a8a0f1397b could not be found. Oct 04 18:37:46.427271 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:37:46.427271 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:37:46.427271 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:37:46.427271 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:46.427271 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:37:46.427271 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:37:46.427271 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:37:46.427271 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:37:46.427271 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 744f6597-f965-405c-ad7b-66a8a0f1397b could not be found. Oct 04 18:37:46.427271 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:37:46.427271 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-18daf6ca-a2b9-4b4f-a62e-ad62d4509123 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Returning 404 to user: Instance 744f6597-f965-405c-ad7b-66a8a0f1397b could not be found. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:37:46.428358 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-18daf6ca-a2b9-4b4f-a62e-ad62d4509123 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] 10.222.0.43 "DELETE /compute/v2.1/servers/744f6597-f965-405c-ad7b-66a8a0f1397b" status: 404 len: 111 microversion: 2.1 time: 0.088306 Oct 04 18:37:46.433738 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 972/1788] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 18:37:46 2022] DELETE /compute/v2.1/servers/744f6597-f965-405c-ad7b-66a8a0f1397b => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:37:46.439728 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-65e4bc1f-7da5-4b6c-92e2-46df8a20d13f tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:46.440329 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-c281595a-3d2f-40c5-8477-102e2dadfe12 tempest-FlavorsV2TestJSON-1387369016 tempest-FlavorsV2TestJSON-1387369016-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:46.445204 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-65e4bc1f-7da5-4b6c-92e2-46df8a20d13f tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] [instance: 132f39b7-bf1b-49a8-87a3-38cd95a041de] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:46.456782 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-65e4bc1f-7da5-4b6c-92e2-46df8a20d13f tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:46.457702 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-65e4bc1f-7da5-4b6c-92e2-46df8a20d13f tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:46.458154 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-65e4bc1f-7da5-4b6c-92e2-46df8a20d13f tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:46.461229 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-65e4bc1f-7da5-4b6c-92e2-46df8a20d13f tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:46.462993 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-c281595a-3d2f-40c5-8477-102e2dadfe12 tempest-FlavorsV2TestJSON-1387369016 tempest-FlavorsV2TestJSON-1387369016-project] 10.222.0.43 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.041289 Oct 04 18:37:46.471882 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-65e4bc1f-7da5-4b6c-92e2-46df8a20d13f tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:46.471882 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-65e4bc1f-7da5-4b6c-92e2-46df8a20d13f tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:46.472202 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 817/1789] 10.222.0.43 () {58 vars in 1137 bytes} [Tue Oct 4 18:37:46 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:37:46.526296 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-d0e1e3e6-f4e3-4fdd-9020-3dbf98f5f1e0 tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:46.528138 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-d0e1e3e6-f4e3-4fdd-9020-3dbf98f5f1e0 tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] [instance: bea29c43-a5ab-42b3-9d5d-3b0f4f0f30f3] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:46.540796 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d0e1e3e6-f4e3-4fdd-9020-3dbf98f5f1e0 tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:46.541837 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d0e1e3e6-f4e3-4fdd-9020-3dbf98f5f1e0 tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:46.542461 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d0e1e3e6-f4e3-4fdd-9020-3dbf98f5f1e0 tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:46.544395 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d0e1e3e6-f4e3-4fdd-9020-3dbf98f5f1e0 tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:46.563281 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d0e1e3e6-f4e3-4fdd-9020-3dbf98f5f1e0 tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:46.565445 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d0e1e3e6-f4e3-4fdd-9020-3dbf98f5f1e0 tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:46.584449 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-65e4bc1f-7da5-4b6c-92e2-46df8a20d13f tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] [instance: 132f39b7-bf1b-49a8-87a3-38cd95a041de] Going to try to terminate instance {{(pid=123596) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:37:46.799194 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-65e4bc1f-7da5-4b6c-92e2-46df8a20d13f tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] 10.222.0.43 "DELETE /compute/v2.1/servers/132f39b7-bf1b-49a8-87a3-38cd95a041de" status: 204 len: 0 microversion: 2.1 time: 0.363345 Oct 04 18:37:46.803968 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 973/1790] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 18:37:46 2022] DELETE /compute/v2.1/servers/132f39b7-bf1b-49a8-87a3-38cd95a041de => generated 0 bytes in 365 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:37:46.807354 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-8d554de3-ac47-478f-b3ab-c4217cb4c2e8 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:46.818063 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-8d554de3-ac47-478f-b3ab-c4217cb4c2e8 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] [instance: 7222a4ce-d2a2-4b09-afc6-55bca52414d4] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:46.836828 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8d554de3-ac47-478f-b3ab-c4217cb4c2e8 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:46.837580 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8d554de3-ac47-478f-b3ab-c4217cb4c2e8 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:46.838889 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8d554de3-ac47-478f-b3ab-c4217cb4c2e8 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:46.843481 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8d554de3-ac47-478f-b3ab-c4217cb4c2e8 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:46.844258 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8d554de3-ac47-478f-b3ab-c4217cb4c2e8 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:46.844901 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8d554de3-ac47-478f-b3ab-c4217cb4c2e8 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:46.936446 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-8d554de3-ac47-478f-b3ab-c4217cb4c2e8 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] 10.222.0.43 "GET /compute/v2.1/servers/7222a4ce-d2a2-4b09-afc6-55bca52414d4/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.133886 Oct 04 18:37:46.942761 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 974/1791] 10.222.0.43 () {60 vars in 1343 bytes} [Tue Oct 4 18:37:46 2022] GET /compute/v2.1/servers/7222a4ce-d2a2-4b09-afc6-55bca52414d4/os-volume_attachments => generated 197 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:37:46.948083 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-e2da3068-9453-4de8-9716-566224c04e3d tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:46.948576 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-e2da3068-9453-4de8-9716-566224c04e3d tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] [instance: 86743a21-e24e-4001-b3da-48615f6e281e] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:46.956611 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e2da3068-9453-4de8-9716-566224c04e3d tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:46.957940 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e2da3068-9453-4de8-9716-566224c04e3d tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:46.958565 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e2da3068-9453-4de8-9716-566224c04e3d tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:46.959662 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e2da3068-9453-4de8-9716-566224c04e3d tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:46.961145 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e2da3068-9453-4de8-9716-566224c04e3d tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:46.962722 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e2da3068-9453-4de8-9716-566224c04e3d tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:47.008576 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-e2da3068-9453-4de8-9716-566224c04e3d tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] [instance: 86743a21-e24e-4001-b3da-48615f6e281e] Going to try to terminate instance {{(pid=123596) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:37:47.202067 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-d0e1e3e6-f4e3-4fdd-9020-3dbf98f5f1e0 tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de84075cb5a44e83a41516b687f07e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9d3dec7f864f42adcd6e9c20043832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:47.212908 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-e2da3068-9453-4de8-9716-566224c04e3d tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] 10.222.0.43 "DELETE /compute/v2.1/servers/86743a21-e24e-4001-b3da-48615f6e281e" status: 204 len: 0 microversion: 2.1 time: 0.268704 Oct 04 18:37:47.217227 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 975/1792] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 18:37:46 2022] DELETE /compute/v2.1/servers/86743a21-e24e-4001-b3da-48615f6e281e => generated 0 bytes in 271 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:37:47.225760 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-d0e1e3e6-f4e3-4fdd-9020-3dbf98f5f1e0 tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] 10.222.0.43 "GET /compute/v2.1/servers/bea29c43-a5ab-42b3-9d5d-3b0f4f0f30f3" status: 200 len: 1316 microversion: 2.1 time: 0.702533 Oct 04 18:37:47.231364 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-67c7e20a-5ec7-4d90-9a98-63703119426e tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Calling method '.version_select at 0x7fb21f1f53a0>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:47.232128 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 818/1793] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:46 2022] GET /compute/v2.1/servers/bea29c43-a5ab-42b3-9d5d-3b0f4f0f30f3 => generated 1316 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:37:47.253610 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-0ed38565-e0ce-4bc0-b90a-62f8e77cfb34 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:47.257653 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-0ed38565-e0ce-4bc0-b90a-62f8e77cfb34 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: d85af512-1b1f-42a4-9bb1-963cc956c9ae] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:47.281759 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0ed38565-e0ce-4bc0-b90a-62f8e77cfb34 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:47.287423 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0ed38565-e0ce-4bc0-b90a-62f8e77cfb34 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:47.291074 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0ed38565-e0ce-4bc0-b90a-62f8e77cfb34 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:47.294174 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0ed38565-e0ce-4bc0-b90a-62f8e77cfb34 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:47.302197 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0ed38565-e0ce-4bc0-b90a-62f8e77cfb34 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:47.304041 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0ed38565-e0ce-4bc0-b90a-62f8e77cfb34 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:47.362992 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-67c7e20a-5ec7-4d90-9a98-63703119426e tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] 10.222.0.43 "GET /compute/v2.1/images/d7825145-299c-45b6-9fe8-780722b2d243" status: 200 len: 1428 microversion: 2.1 time: 0.147462 Oct 04 18:37:47.371356 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 976/1794] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 18:37:47 2022] GET /compute/v2.1/images/d7825145-299c-45b6-9fe8-780722b2d243 => generated 1428 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:47.387335 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-e1999599-1b06-4521-9109-ff33b65a9e7e tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:47.392189 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-e1999599-1b06-4521-9109-ff33b65a9e7e tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] [instance: 744f6597-f965-405c-ad7b-66a8a0f1397b] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:47.427391 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e1999599-1b06-4521-9109-ff33b65a9e7e tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:47.428508 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e1999599-1b06-4521-9109-ff33b65a9e7e tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:47.428978 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e1999599-1b06-4521-9109-ff33b65a9e7e tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:47.429776 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e1999599-1b06-4521-9109-ff33b65a9e7e tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:47.430281 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e1999599-1b06-4521-9109-ff33b65a9e7e tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:47.437998 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e1999599-1b06-4521-9109-ff33b65a9e7e tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:47.499607 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-e1999599-1b06-4521-9109-ff33b65a9e7e tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] HTTP exception thrown: Instance 744f6597-f965-405c-ad7b-66a8a0f1397b could not be found. Oct 04 18:37:47.511693 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-e1999599-1b06-4521-9109-ff33b65a9e7e tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Request method failure captured: Oct 04 18:37:47.511693 n-d-851028-13 devstack@n-api.service[123596]: request: GET /compute/v2.1/servers/744f6597-f965-405c-ad7b-66a8a0f1397b HTTP/1.1 Oct 04 18:37:47.511693 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:37:47.511693 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:37:47.511693 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:37:47.511693 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 18:37:47.511693 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:37:47.511693 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:37:47.511693 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:37:47.511693 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:37:47.511693 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPH1FjpQDMTo-WQnaBct-hi793OA6nOXWID8VHZlHnLSe3utlSiytXhTaUmuOya5lNTsM3Kz-PejMBCBkmkHad0pn_NGG8jv8p4frIsdGg2r7IPRVyg-E3jXO7lLZ5_-qacE0T35EUj99w63mMEdMiYs1AsT4VphKCmkX_i1iKTkj4JU Oct 04 18:37:47.511693 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:37:47.511693 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:37:47.511693 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:37:47.511693 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:37:47.511693 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:37:47.511693 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:37:47.511693 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: a06b8feba3404490a448aa2d4fb106b2 Oct 04 18:37:47.511693 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-ListServersNegativeTestJSON-402277524 Oct 04 18:37:47.511693 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 18:37:47.511693 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 18:37:47.511693 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/a06b8feba3404490a448aa2d4fb106b2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_a06b8feba3404490a448aa2d4fb106b2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a06b8feba3404490a448aa2d4fb106b2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a06b8feba3404490a448aa2d4fb106b2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:37:47.511693 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-ListServersNegativeTestJSON-402277524 Oct 04 18:37:47.511693 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: a06b8feba3404490a448aa2d4fb106b2 Oct 04 18:37:47.511693 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-402277524 Oct 04 18:37:47.511693 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-ListServersNegativeTestJSON-402277524-project Oct 04 18:37:47.511693 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:37:47.511693 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:37:47.511693 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 9fa193aff0474ae3ba5d1aa7b0d0e8c4 Oct 04 18:37:47.511693 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-ListServersNegativeTestJSON-402277524-project Oct 04 18:37:47.511693 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 18:37:47.511693 n-d-851028-13 devstack@n-api.service[123596]: exception: Instance 744f6597-f965-405c-ad7b-66a8a0f1397b could not be found. Oct 04 18:37:47.511693 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': '744f6597-f965-405c-ad7b-66a8a0f1397b'} Oct 04 18:37:47.511693 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:37:47.511693 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:47.511693 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:37:47.511693 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:37:47.511693 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:37:47.511693 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:37:47.511693 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:37:47.511693 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:37:47.511693 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:37:47.511693 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:37:47.511693 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 744f6597-f965-405c-ad7b-66a8a0f1397b could not be found. Oct 04 18:37:47.511693 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:37:47.511693 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:37:47.511693 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:37:47.511693 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:47.511693 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:37:47.511693 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:37:47.511693 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:37:47.511693 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:37:47.511693 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:37:47.511693 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:37:47.511693 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:37:47.511693 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:37:47.511693 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:37:47.511693 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:37:47.511693 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:37:47.511693 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:37:47.511693 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 744f6597-f965-405c-ad7b-66a8a0f1397b could not be found. Oct 04 18:37:47.511693 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:37:47.511693 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:37:47.522202 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:37:47.522202 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:47.522202 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:37:47.522202 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:37:47.522202 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:37:47.522202 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:37:47.522202 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 744f6597-f965-405c-ad7b-66a8a0f1397b could not be found. Oct 04 18:37:47.522202 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:37:47.522202 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-e1999599-1b06-4521-9109-ff33b65a9e7e tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Returning 404 to user: Instance 744f6597-f965-405c-ad7b-66a8a0f1397b could not be found. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:37:47.522202 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-e1999599-1b06-4521-9109-ff33b65a9e7e tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] 10.222.0.43 "GET /compute/v2.1/servers/744f6597-f965-405c-ad7b-66a8a0f1397b" status: 404 len: 111 microversion: 2.1 time: 0.147804 Oct 04 18:37:47.522202 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 977/1795] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:47 2022] GET /compute/v2.1/servers/744f6597-f965-405c-ad7b-66a8a0f1397b => generated 111 bytes in 155 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:37:47.540516 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-d34093f4-ae8d-4f51-b5f3-e7267d25a3f4 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:47.545002 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-d34093f4-ae8d-4f51-b5f3-e7267d25a3f4 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] [instance: 132f39b7-bf1b-49a8-87a3-38cd95a041de] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:47.570466 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d34093f4-ae8d-4f51-b5f3-e7267d25a3f4 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:47.571084 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d34093f4-ae8d-4f51-b5f3-e7267d25a3f4 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:47.578303 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d34093f4-ae8d-4f51-b5f3-e7267d25a3f4 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:47.579206 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d34093f4-ae8d-4f51-b5f3-e7267d25a3f4 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:47.579697 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d34093f4-ae8d-4f51-b5f3-e7267d25a3f4 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:47.580174 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d34093f4-ae8d-4f51-b5f3-e7267d25a3f4 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:47.756948 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-0ed38565-e0ce-4bc0-b90a-62f8e77cfb34 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:47.767786 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-0ed38565-e0ce-4bc0-b90a-62f8e77cfb34 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/d85af512-1b1f-42a4-9bb1-963cc956c9ae" status: 200 len: 1471 microversion: 2.1 time: 0.532335 Oct 04 18:37:47.788824 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 819/1796] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:47 2022] GET /compute/v2.1/servers/d85af512-1b1f-42a4-9bb1-963cc956c9ae => generated 1471 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:47.949449 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-ba13eac4-abcf-461d-bd79-c9d5e6093629 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:47.952798 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-ba13eac4-abcf-461d-bd79-c9d5e6093629 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] [instance: 7222a4ce-d2a2-4b09-afc6-55bca52414d4] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:47.964025 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-d34093f4-ae8d-4f51-b5f3-e7267d25a3f4 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa193aff0474ae3ba5d1aa7b0d0e8c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a06b8feba3404490a448aa2d4fb106b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:47.974781 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-d34093f4-ae8d-4f51-b5f3-e7267d25a3f4 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] 10.222.0.43 "GET /compute/v2.1/servers/132f39b7-bf1b-49a8-87a3-38cd95a041de" status: 200 len: 1521 microversion: 2.1 time: 0.451228 Oct 04 18:37:47.980371 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ba13eac4-abcf-461d-bd79-c9d5e6093629 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:47.980925 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 978/1797] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:47 2022] GET /compute/v2.1/servers/132f39b7-bf1b-49a8-87a3-38cd95a041de => generated 1521 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:47.981702 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ba13eac4-abcf-461d-bd79-c9d5e6093629 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:47.982418 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ba13eac4-abcf-461d-bd79-c9d5e6093629 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:47.983377 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ba13eac4-abcf-461d-bd79-c9d5e6093629 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:47.984858 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ba13eac4-abcf-461d-bd79-c9d5e6093629 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:47.987242 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ba13eac4-abcf-461d-bd79-c9d5e6093629 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:48.072926 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-ba13eac4-abcf-461d-bd79-c9d5e6093629 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] 10.222.0.43 "GET /compute/v2.1/servers/7222a4ce-d2a2-4b09-afc6-55bca52414d4/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.127392 Oct 04 18:37:48.074316 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 820/1798] 10.222.0.43 () {60 vars in 1343 bytes} [Tue Oct 4 18:37:47 2022] GET /compute/v2.1/servers/7222a4ce-d2a2-4b09-afc6-55bca52414d4/os-volume_attachments => generated 197 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 18:37:48.257650 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-90da0bcd-cc1d-4b29-8095-be101d266427 tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:48.258279 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-90da0bcd-cc1d-4b29-8095-be101d266427 tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] [instance: bea29c43-a5ab-42b3-9d5d-3b0f4f0f30f3] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:48.279666 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-90da0bcd-cc1d-4b29-8095-be101d266427 tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:48.280276 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-90da0bcd-cc1d-4b29-8095-be101d266427 tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:48.280739 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-90da0bcd-cc1d-4b29-8095-be101d266427 tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:48.281516 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-90da0bcd-cc1d-4b29-8095-be101d266427 tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:48.285452 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-90da0bcd-cc1d-4b29-8095-be101d266427 tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:48.285986 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-90da0bcd-cc1d-4b29-8095-be101d266427 tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:48.389241 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-77170f56-992e-453b-88b3-933985d65355 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Calling method '.version_select at 0x7fb21fb41790>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:48.468439 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-77170f56-992e-453b-88b3-933985d65355 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] 10.222.0.43 "GET /compute/v2.1/images/d7825145-299c-45b6-9fe8-780722b2d243" status: 200 len: 1428 microversion: 2.1 time: 0.093180 Oct 04 18:37:48.469385 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 821/1799] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 18:37:48 2022] GET /compute/v2.1/images/d7825145-299c-45b6-9fe8-780722b2d243 => generated 1428 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:48.639978 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-90da0bcd-cc1d-4b29-8095-be101d266427 tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de84075cb5a44e83a41516b687f07e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9d3dec7f864f42adcd6e9c20043832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:48.650709 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-90da0bcd-cc1d-4b29-8095-be101d266427 tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] 10.222.0.43 "GET /compute/v2.1/servers/bea29c43-a5ab-42b3-9d5d-3b0f4f0f30f3" status: 200 len: 1504 microversion: 2.1 time: 0.397991 Oct 04 18:37:48.653254 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 979/1800] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:48 2022] GET /compute/v2.1/servers/bea29c43-a5ab-42b3-9d5d-3b0f4f0f30f3 => generated 1504 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:48.678101 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-3ce20ba1-bb63-422b-a06c-70f3cc5dcedc tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:48.678888 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-3ce20ba1-bb63-422b-a06c-70f3cc5dcedc tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] [instance: bea29c43-a5ab-42b3-9d5d-3b0f4f0f30f3] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:48.694154 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3ce20ba1-bb63-422b-a06c-70f3cc5dcedc tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:48.703524 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3ce20ba1-bb63-422b-a06c-70f3cc5dcedc tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:48.704267 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3ce20ba1-bb63-422b-a06c-70f3cc5dcedc tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:48.713935 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3ce20ba1-bb63-422b-a06c-70f3cc5dcedc tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:48.714688 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3ce20ba1-bb63-422b-a06c-70f3cc5dcedc tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:48.715304 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3ce20ba1-bb63-422b-a06c-70f3cc5dcedc tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:48.785994 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-3ce20ba1-bb63-422b-a06c-70f3cc5dcedc tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] [instance: bea29c43-a5ab-42b3-9d5d-3b0f4f0f30f3] Going to try to terminate instance {{(pid=123595) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:37:48.796164 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-4a83d001-9572-4b1e-8872-d83b162201f1 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:48.796541 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-4a83d001-9572-4b1e-8872-d83b162201f1 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: d85af512-1b1f-42a4-9bb1-963cc956c9ae] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:48.809344 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4a83d001-9572-4b1e-8872-d83b162201f1 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:48.809854 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4a83d001-9572-4b1e-8872-d83b162201f1 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:48.810296 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4a83d001-9572-4b1e-8872-d83b162201f1 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:48.811021 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4a83d001-9572-4b1e-8872-d83b162201f1 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:48.811478 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4a83d001-9572-4b1e-8872-d83b162201f1 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:48.812004 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4a83d001-9572-4b1e-8872-d83b162201f1 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:48.869983 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=16 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:37:48.964114 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-3ce20ba1-bb63-422b-a06c-70f3cc5dcedc tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] 10.222.0.43 "DELETE /compute/v2.1/servers/bea29c43-a5ab-42b3-9d5d-3b0f4f0f30f3" status: 204 len: 0 microversion: 2.1 time: 0.289951 Oct 04 18:37:48.965583 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 822/1801] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 18:37:48 2022] DELETE /compute/v2.1/servers/bea29c43-a5ab-42b3-9d5d-3b0f4f0f30f3 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:37:48.976660 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-327e8fee-72ec-429e-bcc6-293c405a2422 tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:48.978092 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-327e8fee-72ec-429e-bcc6-293c405a2422 tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] [instance: bea29c43-a5ab-42b3-9d5d-3b0f4f0f30f3] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:48.994432 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-327e8fee-72ec-429e-bcc6-293c405a2422 tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:48.998875 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-327e8fee-72ec-429e-bcc6-293c405a2422 tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:48.999431 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-327e8fee-72ec-429e-bcc6-293c405a2422 tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:49.000200 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-327e8fee-72ec-429e-bcc6-293c405a2422 tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:49.007905 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-327e8fee-72ec-429e-bcc6-293c405a2422 tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:49.007905 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-327e8fee-72ec-429e-bcc6-293c405a2422 tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:49.356145 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-4a83d001-9572-4b1e-8872-d83b162201f1 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:49.365754 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-4a83d001-9572-4b1e-8872-d83b162201f1 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/d85af512-1b1f-42a4-9bb1-963cc956c9ae" status: 200 len: 1471 microversion: 2.1 time: 0.573814 Oct 04 18:37:49.371845 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 980/1802] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:48 2022] GET /compute/v2.1/servers/d85af512-1b1f-42a4-9bb1-963cc956c9ae => generated 1471 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:37:49.379599 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-88cf34e4-df43-4237-a2d5-ccaa6cfa7f18 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:49.386076 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-88cf34e4-df43-4237-a2d5-ccaa6cfa7f18 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] [instance: 132f39b7-bf1b-49a8-87a3-38cd95a041de] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:49.395820 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-88cf34e4-df43-4237-a2d5-ccaa6cfa7f18 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:49.396458 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-88cf34e4-df43-4237-a2d5-ccaa6cfa7f18 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:49.397012 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-88cf34e4-df43-4237-a2d5-ccaa6cfa7f18 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:49.397874 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-88cf34e4-df43-4237-a2d5-ccaa6cfa7f18 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:49.402555 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-88cf34e4-df43-4237-a2d5-ccaa6cfa7f18 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:49.403267 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-88cf34e4-df43-4237-a2d5-ccaa6cfa7f18 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:49.768831 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-88cf34e4-df43-4237-a2d5-ccaa6cfa7f18 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa193aff0474ae3ba5d1aa7b0d0e8c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a06b8feba3404490a448aa2d4fb106b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:49.782535 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-88cf34e4-df43-4237-a2d5-ccaa6cfa7f18 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] 10.222.0.43 "GET /compute/v2.1/servers/132f39b7-bf1b-49a8-87a3-38cd95a041de" status: 200 len: 1521 microversion: 2.1 time: 0.408051 Oct 04 18:37:49.785490 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 981/1803] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:49 2022] GET /compute/v2.1/servers/132f39b7-bf1b-49a8-87a3-38cd95a041de => generated 1521 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:49.788741 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-327e8fee-72ec-429e-bcc6-293c405a2422 tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de84075cb5a44e83a41516b687f07e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9d3dec7f864f42adcd6e9c20043832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:49.796304 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-831c73ca-1e94-47e0-9a62-a6c66038e5d2 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:49.804404 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-831c73ca-1e94-47e0-9a62-a6c66038e5d2 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] [instance: 7222a4ce-d2a2-4b09-afc6-55bca52414d4] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:49.806216 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-327e8fee-72ec-429e-bcc6-293c405a2422 tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] 10.222.0.43 "GET /compute/v2.1/servers/bea29c43-a5ab-42b3-9d5d-3b0f4f0f30f3" status: 200 len: 1510 microversion: 2.1 time: 0.835911 Oct 04 18:37:49.807329 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 823/1804] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:48 2022] GET /compute/v2.1/servers/bea29c43-a5ab-42b3-9d5d-3b0f4f0f30f3 => generated 1510 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:37:49.818103 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-8cdbe911-d794-4878-80a7-8645f988f9db tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Calling method '.version_select at 0x7fb21fb2aaf0>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:49.819192 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-831c73ca-1e94-47e0-9a62-a6c66038e5d2 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:49.821789 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-831c73ca-1e94-47e0-9a62-a6c66038e5d2 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:49.822675 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-831c73ca-1e94-47e0-9a62-a6c66038e5d2 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:49.825150 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-831c73ca-1e94-47e0-9a62-a6c66038e5d2 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:49.830114 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-831c73ca-1e94-47e0-9a62-a6c66038e5d2 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:49.830900 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-831c73ca-1e94-47e0-9a62-a6c66038e5d2 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:49.914352 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-8cdbe911-d794-4878-80a7-8645f988f9db tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] 10.222.0.43 "GET /compute/v2.1/images/d7825145-299c-45b6-9fe8-780722b2d243" status: 200 len: 1428 microversion: 2.1 time: 0.105792 Oct 04 18:37:49.916490 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 824/1805] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 18:37:49 2022] GET /compute/v2.1/images/d7825145-299c-45b6-9fe8-780722b2d243 => generated 1428 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:49.930224 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-831c73ca-1e94-47e0-9a62-a6c66038e5d2 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] 10.222.0.43 "GET /compute/v2.1/servers/7222a4ce-d2a2-4b09-afc6-55bca52414d4/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.142200 Oct 04 18:37:49.936451 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 982/1806] 10.222.0.43 () {60 vars in 1343 bytes} [Tue Oct 4 18:37:49 2022] GET /compute/v2.1/servers/7222a4ce-d2a2-4b09-afc6-55bca52414d4/os-volume_attachments => generated 197 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:37:50.399228 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-ea022ca0-66d5-4453-bf0d-67e0c0c9a520 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:50.399874 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-ea022ca0-66d5-4453-bf0d-67e0c0c9a520 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: d85af512-1b1f-42a4-9bb1-963cc956c9ae] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:50.422356 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ea022ca0-66d5-4453-bf0d-67e0c0c9a520 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:50.423164 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ea022ca0-66d5-4453-bf0d-67e0c0c9a520 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:50.424821 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ea022ca0-66d5-4453-bf0d-67e0c0c9a520 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:50.426926 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ea022ca0-66d5-4453-bf0d-67e0c0c9a520 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:50.429736 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ea022ca0-66d5-4453-bf0d-67e0c0c9a520 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:50.430812 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ea022ca0-66d5-4453-bf0d-67e0c0c9a520 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:50.812149 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-c6b6c14f-4fde-4b43-913d-f66be1847d41 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:50.813722 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-c6b6c14f-4fde-4b43-913d-f66be1847d41 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] [instance: 132f39b7-bf1b-49a8-87a3-38cd95a041de] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:50.822147 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-ea022ca0-66d5-4453-bf0d-67e0c0c9a520 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:50.839095 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c6b6c14f-4fde-4b43-913d-f66be1847d41 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:50.843824 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c6b6c14f-4fde-4b43-913d-f66be1847d41 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:50.846686 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c6b6c14f-4fde-4b43-913d-f66be1847d41 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:50.851770 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c6b6c14f-4fde-4b43-913d-f66be1847d41 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:50.852541 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c6b6c14f-4fde-4b43-913d-f66be1847d41 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:50.852671 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-ea022ca0-66d5-4453-bf0d-67e0c0c9a520 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/d85af512-1b1f-42a4-9bb1-963cc956c9ae" status: 200 len: 1476 microversion: 2.1 time: 0.451664 Oct 04 18:37:50.853361 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c6b6c14f-4fde-4b43-913d-f66be1847d41 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:50.870403 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 825/1807] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:50 2022] GET /compute/v2.1/servers/d85af512-1b1f-42a4-9bb1-963cc956c9ae => generated 1476 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:50.897951 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-6568891d-bf6e-4c6f-8f9d-0914a222df25 tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:50.899002 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-6568891d-bf6e-4c6f-8f9d-0914a222df25 tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] [instance: bea29c43-a5ab-42b3-9d5d-3b0f4f0f30f3] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:50.926980 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6568891d-bf6e-4c6f-8f9d-0914a222df25 tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:50.931316 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6568891d-bf6e-4c6f-8f9d-0914a222df25 tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:50.932162 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6568891d-bf6e-4c6f-8f9d-0914a222df25 tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:50.933697 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6568891d-bf6e-4c6f-8f9d-0914a222df25 tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:50.934367 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6568891d-bf6e-4c6f-8f9d-0914a222df25 tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:50.935506 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6568891d-bf6e-4c6f-8f9d-0914a222df25 tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:51.545930 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-6568891d-bf6e-4c6f-8f9d-0914a222df25 tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de84075cb5a44e83a41516b687f07e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9d3dec7f864f42adcd6e9c20043832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:51.567630 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-6568891d-bf6e-4c6f-8f9d-0914a222df25 tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] 10.222.0.43 "GET /compute/v2.1/servers/bea29c43-a5ab-42b3-9d5d-3b0f4f0f30f3" status: 200 len: 1510 microversion: 2.1 time: 0.684170 Oct 04 18:37:51.571461 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 826/1808] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:50 2022] GET /compute/v2.1/servers/bea29c43-a5ab-42b3-9d5d-3b0f4f0f30f3 => generated 1510 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:51.594239 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-26400c4c-6ab4-4d89-87ba-7c4d559c5779 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Calling method '.version_select at 0x7fb21fc3cf70>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:51.690649 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-c6b6c14f-4fde-4b43-913d-f66be1847d41 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa193aff0474ae3ba5d1aa7b0d0e8c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a06b8feba3404490a448aa2d4fb106b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:51.708367 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-c6b6c14f-4fde-4b43-913d-f66be1847d41 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] 10.222.0.43 "GET /compute/v2.1/servers/132f39b7-bf1b-49a8-87a3-38cd95a041de" status: 200 len: 1479 microversion: 2.1 time: 0.901471 Oct 04 18:37:51.714168 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 983/1809] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:50 2022] GET /compute/v2.1/servers/132f39b7-bf1b-49a8-87a3-38cd95a041de => generated 1479 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:51.725377 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-a9530497-1890-4dd3-b99a-c07f6aa62f96 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:51.756616 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-26400c4c-6ab4-4d89-87ba-7c4d559c5779 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] 10.222.0.43 "GET /compute/v2.1/images/d7825145-299c-45b6-9fe8-780722b2d243" status: 200 len: 1428 microversion: 2.1 time: 0.174298 Oct 04 18:37:51.764034 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-a9530497-1890-4dd3-b99a-c07f6aa62f96 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] [instance: 7222a4ce-d2a2-4b09-afc6-55bca52414d4] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:51.766315 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 827/1810] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 18:37:51 2022] GET /compute/v2.1/images/d7825145-299c-45b6-9fe8-780722b2d243 => generated 1428 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:51.775945 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-2175b294-91a8-4161-a367-5aef5f59944d req-80e8f824-1d0c-41a5-bf1a-37025ab434f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "132f39b7-bf1b-49a8-87a3-38cd95a041de", "name": "network-vif-deleted", "tag": "556f1b80-4726-4da7-bd27-966c4476c538"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:37:51.796029 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a9530497-1890-4dd3-b99a-c07f6aa62f96 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:51.797933 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a9530497-1890-4dd3-b99a-c07f6aa62f96 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:51.798661 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a9530497-1890-4dd3-b99a-c07f6aa62f96 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:51.804445 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a9530497-1890-4dd3-b99a-c07f6aa62f96 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:51.805955 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a9530497-1890-4dd3-b99a-c07f6aa62f96 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:51.806620 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a9530497-1890-4dd3-b99a-c07f6aa62f96 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:51.836105 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-2175b294-91a8-4161-a367-5aef5f59944d req-80e8f824-1d0c-41a5-bf1a-37025ab434f5 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:51.843084 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-2175b294-91a8-4161-a367-5aef5f59944d req-80e8f824-1d0c-41a5-bf1a-37025ab434f5 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:51.843836 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-2175b294-91a8-4161-a367-5aef5f59944d req-80e8f824-1d0c-41a5-bf1a-37025ab434f5 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:51.896601 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-2175b294-91a8-4161-a367-5aef5f59944d req-80e8f824-1d0c-41a5-bf1a-37025ab434f5 service nova] Creating event network-vif-deleted:556f1b80-4726-4da7-bd27-966c4476c538 for instance 132f39b7-bf1b-49a8-87a3-38cd95a041de on n-h2-851028-13 Oct 04 18:37:51.911115 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-2175b294-91a8-4161-a367-5aef5f59944d req-80e8f824-1d0c-41a5-bf1a-37025ab434f5 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.143136 Oct 04 18:37:51.920056 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 828/1811] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:37:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:37:51.942422 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-361220a6-6b85-4ae2-ac2a-4a68ce244637 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:51.948200 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-361220a6-6b85-4ae2-ac2a-4a68ce244637 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: d85af512-1b1f-42a4-9bb1-963cc956c9ae] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:51.951141 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-a9530497-1890-4dd3-b99a-c07f6aa62f96 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] 10.222.0.43 "GET /compute/v2.1/servers/7222a4ce-d2a2-4b09-afc6-55bca52414d4/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.235050 Oct 04 18:37:51.962051 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 984/1812] 10.222.0.43 () {60 vars in 1343 bytes} [Tue Oct 4 18:37:51 2022] GET /compute/v2.1/servers/7222a4ce-d2a2-4b09-afc6-55bca52414d4/os-volume_attachments => generated 197 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:37:51.975933 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-361220a6-6b85-4ae2-ac2a-4a68ce244637 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:51.983734 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-361220a6-6b85-4ae2-ac2a-4a68ce244637 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:51.984565 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-361220a6-6b85-4ae2-ac2a-4a68ce244637 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:51.985579 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-361220a6-6b85-4ae2-ac2a-4a68ce244637 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:51.988634 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-361220a6-6b85-4ae2-ac2a-4a68ce244637 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:51.989365 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-361220a6-6b85-4ae2-ac2a-4a68ce244637 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:52.603389 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f7de1f5b-ed02-498d-9b45-98807abcf6d3 tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:52.604560 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-f7de1f5b-ed02-498d-9b45-98807abcf6d3 tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] [instance: bea29c43-a5ab-42b3-9d5d-3b0f4f0f30f3] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:52.619584 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f7de1f5b-ed02-498d-9b45-98807abcf6d3 tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:52.620785 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f7de1f5b-ed02-498d-9b45-98807abcf6d3 tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:52.624688 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f7de1f5b-ed02-498d-9b45-98807abcf6d3 tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:52.626485 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f7de1f5b-ed02-498d-9b45-98807abcf6d3 tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:52.627449 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f7de1f5b-ed02-498d-9b45-98807abcf6d3 tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:52.629197 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f7de1f5b-ed02-498d-9b45-98807abcf6d3 tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:52.818481 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-361220a6-6b85-4ae2-ac2a-4a68ce244637 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:52.826900 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-361220a6-6b85-4ae2-ac2a-4a68ce244637 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/d85af512-1b1f-42a4-9bb1-963cc956c9ae" status: 200 len: 1476 microversion: 2.1 time: 0.903576 Oct 04 18:37:52.833888 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 829/1813] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:51 2022] GET /compute/v2.1/servers/d85af512-1b1f-42a4-9bb1-963cc956c9ae => generated 1476 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:52.852603 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-3123f2ce-24d0-4bb6-a28c-60b0333e266b tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:52.865603 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-3123f2ce-24d0-4bb6-a28c-60b0333e266b tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] [instance: 132f39b7-bf1b-49a8-87a3-38cd95a041de] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:52.877227 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_api:DELETE=2,nova_api:SELECT=97,nova_api:UPDATE=1 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:37:52.915624 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3123f2ce-24d0-4bb6-a28c-60b0333e266b tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:52.916129 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3123f2ce-24d0-4bb6-a28c-60b0333e266b tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:52.916586 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3123f2ce-24d0-4bb6-a28c-60b0333e266b tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:52.917562 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3123f2ce-24d0-4bb6-a28c-60b0333e266b tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:52.918187 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3123f2ce-24d0-4bb6-a28c-60b0333e266b tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:52.921452 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3123f2ce-24d0-4bb6-a28c-60b0333e266b tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:52.957062 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-3123f2ce-24d0-4bb6-a28c-60b0333e266b tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] HTTP exception thrown: Instance 132f39b7-bf1b-49a8-87a3-38cd95a041de could not be found. Oct 04 18:37:52.959311 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-3123f2ce-24d0-4bb6-a28c-60b0333e266b tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Request method failure captured: Oct 04 18:37:52.959311 n-d-851028-13 devstack@n-api.service[123595]: request: GET /compute/v2.1/servers/132f39b7-bf1b-49a8-87a3-38cd95a041de HTTP/1.1 Oct 04 18:37:52.959311 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 18:37:52.959311 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 18:37:52.959311 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 18:37:52.959311 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 0 Oct 04 18:37:52.959311 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 18:37:52.959311 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 18:37:52.959311 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 18:37:52.959311 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 18:37:52.959311 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPH1FjpQDMTo-WQnaBct-hi793OA6nOXWID8VHZlHnLSe3utlSiytXhTaUmuOya5lNTsM3Kz-PejMBCBkmkHad0pn_NGG8jv8p4frIsdGg2r7IPRVyg-E3jXO7lLZ5_-qacE0T35EUj99w63mMEdMiYs1AsT4VphKCmkX_i1iKTkj4JU Oct 04 18:37:52.959311 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 18:37:52.959311 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 18:37:52.959311 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 18:37:52.959311 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 18:37:52.959311 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 18:37:52.959311 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 18:37:52.959311 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: a06b8feba3404490a448aa2d4fb106b2 Oct 04 18:37:52.959311 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-ListServersNegativeTestJSON-402277524 Oct 04 18:37:52.959311 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 18:37:52.959311 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 18:37:52.959311 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/a06b8feba3404490a448aa2d4fb106b2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_a06b8feba3404490a448aa2d4fb106b2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a06b8feba3404490a448aa2d4fb106b2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a06b8feba3404490a448aa2d4fb106b2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:37:52.959311 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-ListServersNegativeTestJSON-402277524 Oct 04 18:37:52.959311 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: a06b8feba3404490a448aa2d4fb106b2 Oct 04 18:37:52.959311 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-402277524 Oct 04 18:37:52.959311 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-ListServersNegativeTestJSON-402277524-project Oct 04 18:37:52.959311 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 18:37:52.959311 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 18:37:52.959311 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: 9fa193aff0474ae3ba5d1aa7b0d0e8c4 Oct 04 18:37:52.959311 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-ListServersNegativeTestJSON-402277524-project Oct 04 18:37:52.959311 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 18:37:52.959311 n-d-851028-13 devstack@n-api.service[123595]: exception: Instance 132f39b7-bf1b-49a8-87a3-38cd95a041de could not be found. Oct 04 18:37:52.959311 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': '132f39b7-bf1b-49a8-87a3-38cd95a041de'} Oct 04 18:37:52.959311 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:37:52.959311 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:52.959311 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:37:52.959311 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:37:52.959311 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:37:52.959311 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:37:52.959311 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:37:52.959311 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:37:52.959311 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:37:52.959311 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:37:52.959311 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 132f39b7-bf1b-49a8-87a3-38cd95a041de could not be found. Oct 04 18:37:52.959311 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:37:52.959311 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:37:52.959311 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:37:52.959311 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:52.959311 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:37:52.959311 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:37:52.959311 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:37:52.959311 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:37:52.959311 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:37:52.959311 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:37:52.959311 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:37:52.959311 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:37:52.959311 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:37:52.959311 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:37:52.959311 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:37:52.959311 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:37:52.959311 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 132f39b7-bf1b-49a8-87a3-38cd95a041de could not be found. Oct 04 18:37:52.959311 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:37:52.959311 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:37:52.965263 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:37:52.965263 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:52.965263 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:37:52.965263 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:37:52.965263 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:37:52.965263 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:37:52.965263 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 132f39b7-bf1b-49a8-87a3-38cd95a041de could not be found. Oct 04 18:37:52.965263 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:37:52.965263 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-3123f2ce-24d0-4bb6-a28c-60b0333e266b tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Returning 404 to user: Instance 132f39b7-bf1b-49a8-87a3-38cd95a041de could not be found. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:37:52.965263 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-3123f2ce-24d0-4bb6-a28c-60b0333e266b tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] 10.222.0.43 "GET /compute/v2.1/servers/132f39b7-bf1b-49a8-87a3-38cd95a041de" status: 404 len: 111 microversion: 2.1 time: 0.129507 Oct 04 18:37:52.968522 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 830/1814] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:52 2022] GET /compute/v2.1/servers/132f39b7-bf1b-49a8-87a3-38cd95a041de => generated 111 bytes in 136 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:37:52.995175 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-dc2fdfa8-c6b6-4fb1-b9f1-b970e736de3a tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Calling method '.version_select at 0x7fb21fc6a160>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:53.135577 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-f7de1f5b-ed02-498d-9b45-98807abcf6d3 tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de84075cb5a44e83a41516b687f07e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9d3dec7f864f42adcd6e9c20043832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:53.147165 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-dc2fdfa8-c6b6-4fb1-b9f1-b970e736de3a tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] 10.222.0.43 "GET /compute/v2.1/images/d7825145-299c-45b6-9fe8-780722b2d243" status: 200 len: 1428 microversion: 2.1 time: 0.177258 Oct 04 18:37:53.148992 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 831/1815] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 18:37:52 2022] GET /compute/v2.1/images/d7825145-299c-45b6-9fe8-780722b2d243 => generated 1428 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:53.157997 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-b139974f-626d-475d-8f65-247f487f4c77 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:53.158817 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-b139974f-626d-475d-8f65-247f487f4c77 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] [instance: 86743a21-e24e-4001-b3da-48615f6e281e] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:53.162553 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-f7de1f5b-ed02-498d-9b45-98807abcf6d3 tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] 10.222.0.43 "GET /compute/v2.1/servers/bea29c43-a5ab-42b3-9d5d-3b0f4f0f30f3" status: 200 len: 1510 microversion: 2.1 time: 0.564227 Oct 04 18:37:53.173926 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b139974f-626d-475d-8f65-247f487f4c77 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:53.176826 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b139974f-626d-475d-8f65-247f487f4c77 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:53.178736 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b139974f-626d-475d-8f65-247f487f4c77 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:53.181689 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b139974f-626d-475d-8f65-247f487f4c77 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:53.182583 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b139974f-626d-475d-8f65-247f487f4c77 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:53.184298 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b139974f-626d-475d-8f65-247f487f4c77 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:53.185696 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 985/1816] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:52 2022] GET /compute/v2.1/servers/bea29c43-a5ab-42b3-9d5d-3b0f4f0f30f3 => generated 1510 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:53.194933 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-b83f23bd-2782-4fc0-86c1-7efdac6b3efd tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:53.197826 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-b83f23bd-2782-4fc0-86c1-7efdac6b3efd tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] [instance: 7222a4ce-d2a2-4b09-afc6-55bca52414d4] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:53.210009 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b83f23bd-2782-4fc0-86c1-7efdac6b3efd tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:53.210772 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b83f23bd-2782-4fc0-86c1-7efdac6b3efd tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:53.211393 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b83f23bd-2782-4fc0-86c1-7efdac6b3efd tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:53.212323 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b83f23bd-2782-4fc0-86c1-7efdac6b3efd tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:53.213227 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b83f23bd-2782-4fc0-86c1-7efdac6b3efd tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:53.213834 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b83f23bd-2782-4fc0-86c1-7efdac6b3efd tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:53.267261 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:37:53.283136 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-b83f23bd-2782-4fc0-86c1-7efdac6b3efd tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] 10.222.0.43 "GET /compute/v2.1/servers/7222a4ce-d2a2-4b09-afc6-55bca52414d4/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.093726 Oct 04 18:37:53.284516 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 986/1817] 10.222.0.43 () {60 vars in 1343 bytes} [Tue Oct 4 18:37:53 2022] GET /compute/v2.1/servers/7222a4ce-d2a2-4b09-afc6-55bca52414d4/os-volume_attachments => generated 197 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:37:53.852832 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f500b983-0716-4da0-9a24-482907e4b86c tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:53.855367 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-f500b983-0716-4da0-9a24-482907e4b86c tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: d85af512-1b1f-42a4-9bb1-963cc956c9ae] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:53.868127 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f500b983-0716-4da0-9a24-482907e4b86c tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:53.869002 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f500b983-0716-4da0-9a24-482907e4b86c tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:53.877870 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f500b983-0716-4da0-9a24-482907e4b86c tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:53.879047 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f500b983-0716-4da0-9a24-482907e4b86c tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:53.879726 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f500b983-0716-4da0-9a24-482907e4b86c tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:53.880363 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f500b983-0716-4da0-9a24-482907e4b86c tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:54.381274 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-b139974f-626d-475d-8f65-247f487f4c77 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa193aff0474ae3ba5d1aa7b0d0e8c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a06b8feba3404490a448aa2d4fb106b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:54.408101 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-b139974f-626d-475d-8f65-247f487f4c77 tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] 10.222.0.43 "GET /compute/v2.1/servers/86743a21-e24e-4001-b3da-48615f6e281e" status: 200 len: 1520 microversion: 2.1 time: 1.239980 Oct 04 18:37:54.409576 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 832/1818] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:53 2022] GET /compute/v2.1/servers/86743a21-e24e-4001-b3da-48615f6e281e => generated 1520 bytes in 1260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:54.435302 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-bc91c653-86ab-4ee1-b568-c3130b9cf0c0 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Calling method '.version_select at 0x7fb21fa3f0d0>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:54.533727 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-bc91c653-86ab-4ee1-b568-c3130b9cf0c0 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] 10.222.0.43 "GET /compute/v2.1/images/d7825145-299c-45b6-9fe8-780722b2d243" status: 200 len: 1428 microversion: 2.1 time: 0.110638 Oct 04 18:37:54.537089 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 833/1819] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 18:37:54 2022] GET /compute/v2.1/images/d7825145-299c-45b6-9fe8-780722b2d243 => generated 1428 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:54.555334 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-d39f142b-d5eb-4d9d-b0c2-db6cebcd4dbb tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:54.563481 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-f500b983-0716-4da0-9a24-482907e4b86c tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:54.566743 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-d39f142b-d5eb-4d9d-b0c2-db6cebcd4dbb tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] [instance: bea29c43-a5ab-42b3-9d5d-3b0f4f0f30f3] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:54.575065 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-f500b983-0716-4da0-9a24-482907e4b86c tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/d85af512-1b1f-42a4-9bb1-963cc956c9ae" status: 200 len: 1476 microversion: 2.1 time: 0.726570 Oct 04 18:37:54.595976 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 987/1820] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:53 2022] GET /compute/v2.1/servers/d85af512-1b1f-42a4-9bb1-963cc956c9ae => generated 1476 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:54.595976 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-115731a7-b05d-4402-8b8d-86b234bc160e tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:54.595976 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-115731a7-b05d-4402-8b8d-86b234bc160e tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] [instance: 7222a4ce-d2a2-4b09-afc6-55bca52414d4] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:54.598077 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d39f142b-d5eb-4d9d-b0c2-db6cebcd4dbb tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:54.598585 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d39f142b-d5eb-4d9d-b0c2-db6cebcd4dbb tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:54.599292 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d39f142b-d5eb-4d9d-b0c2-db6cebcd4dbb tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:54.601969 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d39f142b-d5eb-4d9d-b0c2-db6cebcd4dbb tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:54.604549 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d39f142b-d5eb-4d9d-b0c2-db6cebcd4dbb tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:54.609439 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d39f142b-d5eb-4d9d-b0c2-db6cebcd4dbb tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:54.624896 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-115731a7-b05d-4402-8b8d-86b234bc160e tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:54.625453 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-115731a7-b05d-4402-8b8d-86b234bc160e tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:54.625880 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-115731a7-b05d-4402-8b8d-86b234bc160e tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:54.626592 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-115731a7-b05d-4402-8b8d-86b234bc160e tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:54.627048 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-115731a7-b05d-4402-8b8d-86b234bc160e tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:54.627476 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-115731a7-b05d-4402-8b8d-86b234bc160e tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:54.694959 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:37:54.736739 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-115731a7-b05d-4402-8b8d-86b234bc160e tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] 10.222.0.43 "GET /compute/v2.1/servers/7222a4ce-d2a2-4b09-afc6-55bca52414d4/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.151654 Oct 04 18:37:54.750820 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 988/1821] 10.222.0.43 () {60 vars in 1343 bytes} [Tue Oct 4 18:37:54 2022] GET /compute/v2.1/servers/7222a4ce-d2a2-4b09-afc6-55bca52414d4/os-volume_attachments => generated 197 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:37:54.768615 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-f1c9c6c6-9a8a-44f7-9f64-4b778abc7af8 req-304849c1-153a-4ced-a358-6ae33dfd9128 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bea29c43-a5ab-42b3-9d5d-3b0f4f0f30f3", "name": "network-vif-deleted", "tag": "b42ba2ea-c6ef-4e9b-937f-48b377bf9659"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:37:54.783223 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d39f142b-d5eb-4d9d-b0c2-db6cebcd4dbb tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:54.788289 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d39f142b-d5eb-4d9d-b0c2-db6cebcd4dbb tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:54.790590 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d39f142b-d5eb-4d9d-b0c2-db6cebcd4dbb tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:54.796116 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.objects.instance [None req-d39f142b-d5eb-4d9d-b0c2-db6cebcd4dbb tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Lazy-loading 'fault' on Instance uuid bea29c43-a5ab-42b3-9d5d-3b0f4f0f30f3 {{(pid=123595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:37:54.810053 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-f1c9c6c6-9a8a-44f7-9f64-4b778abc7af8 req-304849c1-153a-4ced-a358-6ae33dfd9128 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:54.810561 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-f1c9c6c6-9a8a-44f7-9f64-4b778abc7af8 req-304849c1-153a-4ced-a358-6ae33dfd9128 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:54.811027 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-f1c9c6c6-9a8a-44f7-9f64-4b778abc7af8 req-304849c1-153a-4ced-a358-6ae33dfd9128 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:54.878793 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-f1c9c6c6-9a8a-44f7-9f64-4b778abc7af8 req-304849c1-153a-4ced-a358-6ae33dfd9128 service nova] Creating event network-vif-deleted:b42ba2ea-c6ef-4e9b-937f-48b377bf9659 for instance bea29c43-a5ab-42b3-9d5d-3b0f4f0f30f3 on n-h1-851028-13 Oct 04 18:37:54.899869 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-f1c9c6c6-9a8a-44f7-9f64-4b778abc7af8 req-304849c1-153a-4ced-a358-6ae33dfd9128 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.147027 Oct 04 18:37:54.906765 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 989/1822] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:37:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:37:55.106891 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-d39f142b-d5eb-4d9d-b0c2-db6cebcd4dbb tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de84075cb5a44e83a41516b687f07e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9d3dec7f864f42adcd6e9c20043832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:55.117445 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-d39f142b-d5eb-4d9d-b0c2-db6cebcd4dbb tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] 10.222.0.43 "GET /compute/v2.1/servers/bea29c43-a5ab-42b3-9d5d-3b0f4f0f30f3" status: 200 len: 1306 microversion: 2.1 time: 0.578853 Oct 04 18:37:55.123227 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 834/1823] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:54 2022] GET /compute/v2.1/servers/bea29c43-a5ab-42b3-9d5d-3b0f4f0f30f3 => generated 1306 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:55.435022 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=22 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:37:55.443244 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-d29ed83f-1a36-4e50-9876-ad6e868703de tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:55.444937 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-d29ed83f-1a36-4e50-9876-ad6e868703de tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] [instance: 86743a21-e24e-4001-b3da-48615f6e281e] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:55.454447 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d29ed83f-1a36-4e50-9876-ad6e868703de tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:55.455458 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d29ed83f-1a36-4e50-9876-ad6e868703de tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:55.456098 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d29ed83f-1a36-4e50-9876-ad6e868703de tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:55.457210 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d29ed83f-1a36-4e50-9876-ad6e868703de tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:55.458168 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d29ed83f-1a36-4e50-9876-ad6e868703de tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:55.458782 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d29ed83f-1a36-4e50-9876-ad6e868703de tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:55.494994 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-47e2679d-d361-424f-8ab2-9f348e383e8f tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Calling method '.version_select at 0x7fb21fc6a280>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:55.540113 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-47e2679d-d361-424f-8ab2-9f348e383e8f tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] 10.222.0.43 "GET /compute/v2.1/images/d9a9dd34-fad4-41fd-9adf-f9f1a890d9a6" status: 200 len: 661 microversion: 2.1 time: 0.049650 Oct 04 18:37:55.540687 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 835/1824] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 18:37:55 2022] GET /compute/v2.1/images/d9a9dd34-fad4-41fd-9adf-f9f1a890d9a6 => generated 661 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:37:55.551294 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-09aa1616-080a-45b0-ae47-be1bdedc0d1b tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Calling method '.version_select at 0x7fb21fc3ce50>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:55.591668 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-d29ed83f-1a36-4e50-9876-ad6e868703de tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa193aff0474ae3ba5d1aa7b0d0e8c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a06b8feba3404490a448aa2d4fb106b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:55.601061 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-09aa1616-080a-45b0-ae47-be1bdedc0d1b tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] 10.222.0.43 "GET /compute/v2.1/images/d7825145-299c-45b6-9fe8-780722b2d243" status: 200 len: 1437 microversion: 2.1 time: 0.054091 Oct 04 18:37:55.610296 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 836/1825] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 18:37:55 2022] GET /compute/v2.1/images/d7825145-299c-45b6-9fe8-780722b2d243 => generated 1437 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:37:55.610296 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-e6021bd4-a19c-49ce-9e6e-016fcb773899 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Calling method '.version_select at 0x7fb21f7b8430>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:55.619291 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-d29ed83f-1a36-4e50-9876-ad6e868703de tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] 10.222.0.43 "GET /compute/v2.1/servers/86743a21-e24e-4001-b3da-48615f6e281e" status: 200 len: 1307 microversion: 2.1 time: 0.185023 Oct 04 18:37:55.636967 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 990/1826] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:55 2022] GET /compute/v2.1/servers/86743a21-e24e-4001-b3da-48615f6e281e => generated 1307 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:55.663083 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f50a6c92-7f73-4437-82fd-64d8322ae08a tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:55.663742 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-f50a6c92-7f73-4437-82fd-64d8322ae08a tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: d85af512-1b1f-42a4-9bb1-963cc956c9ae] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:55.670341 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f50a6c92-7f73-4437-82fd-64d8322ae08a tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:55.670856 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f50a6c92-7f73-4437-82fd-64d8322ae08a tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:55.671346 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f50a6c92-7f73-4437-82fd-64d8322ae08a tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:55.671964 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f50a6c92-7f73-4437-82fd-64d8322ae08a tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:55.673166 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f50a6c92-7f73-4437-82fd-64d8322ae08a tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:55.673964 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f50a6c92-7f73-4437-82fd-64d8322ae08a tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:55.697262 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-e6021bd4-a19c-49ce-9e6e-016fcb773899 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] 10.222.0.43 "GET /compute/v2.1/images/d9a9dd34-fad4-41fd-9adf-f9f1a890d9a6" status: 200 len: 661 microversion: 2.1 time: 0.093833 Oct 04 18:37:55.706851 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 837/1827] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 18:37:55 2022] GET /compute/v2.1/images/d9a9dd34-fad4-41fd-9adf-f9f1a890d9a6 => generated 661 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:37:55.740024 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-4b51b91e-3666-4b39-a4a7-81aadba31fae tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Calling method '.version_select at 0x7fb21fc3c820>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:55.803214 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-4b51b91e-3666-4b39-a4a7-81aadba31fae tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] 10.222.0.43 "GET /compute/v2.1/images/d7825145-299c-45b6-9fe8-780722b2d243" status: 200 len: 1437 microversion: 2.1 time: 0.094478 Oct 04 18:37:55.803871 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 838/1828] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 18:37:55 2022] GET /compute/v2.1/images/d7825145-299c-45b6-9fe8-780722b2d243 => generated 1437 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:55.971759 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-f50a6c92-7f73-4437-82fd-64d8322ae08a tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:55.991779 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-f50a6c92-7f73-4437-82fd-64d8322ae08a tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/d85af512-1b1f-42a4-9bb1-963cc956c9ae" status: 200 len: 1476 microversion: 2.1 time: 0.350771 Oct 04 18:37:56.005574 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 991/1829] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:55 2022] GET /compute/v2.1/servers/d85af512-1b1f-42a4-9bb1-963cc956c9ae => generated 1476 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:56.012950 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-56ef734f-c18e-4274-8c3a-4075b6c4cdcd tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:56.013892 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-56ef734f-c18e-4274-8c3a-4075b6c4cdcd tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] [instance: 4231fdff-39dd-49a6-bea2-5edea44c3582] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:56.028594 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-56ef734f-c18e-4274-8c3a-4075b6c4cdcd tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:56.029463 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-56ef734f-c18e-4274-8c3a-4075b6c4cdcd tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:56.030128 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-56ef734f-c18e-4274-8c3a-4075b6c4cdcd tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:56.031037 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-56ef734f-c18e-4274-8c3a-4075b6c4cdcd tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:56.041027 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-56ef734f-c18e-4274-8c3a-4075b6c4cdcd tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:56.041782 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-56ef734f-c18e-4274-8c3a-4075b6c4cdcd tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:56.139223 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=14 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:37:56.156349 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-03aaf89a-11b6-48cf-b984-38b88ae4eea0 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:56.158894 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-03aaf89a-11b6-48cf-b984-38b88ae4eea0 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] [instance: 7222a4ce-d2a2-4b09-afc6-55bca52414d4] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:56.173276 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-03aaf89a-11b6-48cf-b984-38b88ae4eea0 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:56.180927 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-03aaf89a-11b6-48cf-b984-38b88ae4eea0 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:56.181420 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-03aaf89a-11b6-48cf-b984-38b88ae4eea0 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:56.182177 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-03aaf89a-11b6-48cf-b984-38b88ae4eea0 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:56.182643 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-03aaf89a-11b6-48cf-b984-38b88ae4eea0 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:56.183084 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-03aaf89a-11b6-48cf-b984-38b88ae4eea0 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:56.276335 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-03aaf89a-11b6-48cf-b984-38b88ae4eea0 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] 10.222.0.43 "GET /compute/v2.1/servers/7222a4ce-d2a2-4b09-afc6-55bca52414d4/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.454537 Oct 04 18:37:56.277580 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 839/1830] 10.222.0.43 () {60 vars in 1343 bytes} [Tue Oct 4 18:37:55 2022] GET /compute/v2.1/servers/7222a4ce-d2a2-4b09-afc6-55bca52414d4/os-volume_attachments => generated 25 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:56.282647 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-6cf8bba8-5b62-4ffb-93f8-bbd5424a2520 tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:56.291005 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-6cf8bba8-5b62-4ffb-93f8-bbd5424a2520 tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] [instance: bea29c43-a5ab-42b3-9d5d-3b0f4f0f30f3] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:56.297516 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6cf8bba8-5b62-4ffb-93f8-bbd5424a2520 tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:56.298044 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6cf8bba8-5b62-4ffb-93f8-bbd5424a2520 tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:56.298490 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6cf8bba8-5b62-4ffb-93f8-bbd5424a2520 tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:56.299474 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6cf8bba8-5b62-4ffb-93f8-bbd5424a2520 tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:56.300056 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6cf8bba8-5b62-4ffb-93f8-bbd5424a2520 tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:56.300507 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6cf8bba8-5b62-4ffb-93f8-bbd5424a2520 tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:56.362570 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-6cf8bba8-5b62-4ffb-93f8-bbd5424a2520 tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] HTTP exception thrown: Instance bea29c43-a5ab-42b3-9d5d-3b0f4f0f30f3 could not be found. Oct 04 18:37:56.364420 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-6cf8bba8-5b62-4ffb-93f8-bbd5424a2520 tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Request method failure captured: Oct 04 18:37:56.364420 n-d-851028-13 devstack@n-api.service[123595]: request: GET /compute/v2.1/servers/bea29c43-a5ab-42b3-9d5d-3b0f4f0f30f3 HTTP/1.1 Oct 04 18:37:56.364420 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 18:37:56.364420 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 18:37:56.364420 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 18:37:56.364420 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 0 Oct 04 18:37:56.364420 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 18:37:56.364420 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 18:37:56.364420 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 18:37:56.364420 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 18:37:56.364420 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPH1j6ru-Lvs2wrjdCy9lxsxeqFR_0I69vaAEkGUkfOrTRHFL8podBIY09adymYaKc-fLH_NkEdBByYxe0mMJsKABTMuQ_o2bR1hS7KA3fBrPfxeTZtvPCU_ky0OzwOErFV4VC6vEg6HU5uNST8syClppkHeno1EsgK5NCYStWfnc39k Oct 04 18:37:56.364420 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 18:37:56.364420 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 18:37:56.364420 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 18:37:56.364420 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 18:37:56.364420 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 18:37:56.364420 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 18:37:56.364420 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: 9b9d3dec7f864f42adcd6e9c20043832 Oct 04 18:37:56.364420 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-ImagesNegativeTestJSON-1746998003 Oct 04 18:37:56.364420 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 18:37:56.364420 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 18:37:56.364420 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/9b9d3dec7f864f42adcd6e9c20043832"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_9b9d3dec7f864f42adcd6e9c20043832"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/9b9d3dec7f864f42adcd6e9c20043832"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/9b9d3dec7f864f42adcd6e9c20043832"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:37:56.364420 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-ImagesNegativeTestJSON-1746998003 Oct 04 18:37:56.364420 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: 9b9d3dec7f864f42adcd6e9c20043832 Oct 04 18:37:56.364420 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1746998003 Oct 04 18:37:56.364420 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-ImagesNegativeTestJSON-1746998003-project Oct 04 18:37:56.364420 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 18:37:56.364420 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 18:37:56.364420 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: de84075cb5a44e83a41516b687f07e95 Oct 04 18:37:56.364420 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-ImagesNegativeTestJSON-1746998003-project Oct 04 18:37:56.364420 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 18:37:56.364420 n-d-851028-13 devstack@n-api.service[123595]: exception: Instance bea29c43-a5ab-42b3-9d5d-3b0f4f0f30f3 could not be found. Oct 04 18:37:56.364420 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': 'bea29c43-a5ab-42b3-9d5d-3b0f4f0f30f3'} Oct 04 18:37:56.364420 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:37:56.364420 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:56.364420 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:37:56.364420 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:37:56.364420 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:37:56.364420 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:37:56.364420 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:37:56.364420 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:37:56.364420 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:37:56.364420 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:37:56.364420 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bea29c43-a5ab-42b3-9d5d-3b0f4f0f30f3 could not be found. Oct 04 18:37:56.364420 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:37:56.364420 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:37:56.364420 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:37:56.364420 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:56.364420 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:37:56.364420 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:37:56.364420 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:37:56.364420 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:37:56.364420 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:37:56.364420 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:37:56.364420 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:37:56.364420 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:37:56.364420 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:37:56.364420 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:37:56.364420 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:37:56.364420 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:37:56.364420 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bea29c43-a5ab-42b3-9d5d-3b0f4f0f30f3 could not be found. Oct 04 18:37:56.364420 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:37:56.364420 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:37:56.364420 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:37:56.370091 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:56.370091 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:37:56.370091 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:37:56.370091 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:37:56.370091 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:37:56.370091 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bea29c43-a5ab-42b3-9d5d-3b0f4f0f30f3 could not be found. Oct 04 18:37:56.370091 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:37:56.371393 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-6cf8bba8-5b62-4ffb-93f8-bbd5424a2520 tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Returning 404 to user: Instance bea29c43-a5ab-42b3-9d5d-3b0f4f0f30f3 could not be found. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:37:56.375425 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-6cf8bba8-5b62-4ffb-93f8-bbd5424a2520 tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] 10.222.0.43 "GET /compute/v2.1/servers/bea29c43-a5ab-42b3-9d5d-3b0f4f0f30f3" status: 404 len: 111 microversion: 2.1 time: 0.096563 Oct 04 18:37:56.376166 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 840/1831] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:56 2022] GET /compute/v2.1/servers/bea29c43-a5ab-42b3-9d5d-3b0f4f0f30f3 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:37:56.405196 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-4ccc0a59-d081-49fa-b5ea-3a6b49a8e997 tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1519474858", "metadata": {"image_type": "test"}}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:37:56.412638 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-4ccc0a59-d081-49fa-b5ea-3a6b49a8e997 tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] [instance: bea29c43-a5ab-42b3-9d5d-3b0f4f0f30f3] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:56.426026 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4ccc0a59-d081-49fa-b5ea-3a6b49a8e997 tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:56.426721 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4ccc0a59-d081-49fa-b5ea-3a6b49a8e997 tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:56.427359 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4ccc0a59-d081-49fa-b5ea-3a6b49a8e997 tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:56.438179 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4ccc0a59-d081-49fa-b5ea-3a6b49a8e997 tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:56.438964 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4ccc0a59-d081-49fa-b5ea-3a6b49a8e997 tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:56.439595 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4ccc0a59-d081-49fa-b5ea-3a6b49a8e997 tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:56.466512 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-4ccc0a59-d081-49fa-b5ea-3a6b49a8e997 tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] HTTP exception thrown: Instance bea29c43-a5ab-42b3-9d5d-3b0f4f0f30f3 could not be found. Oct 04 18:37:56.468912 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-4ccc0a59-d081-49fa-b5ea-3a6b49a8e997 tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Request method failure captured: Oct 04 18:37:56.468912 n-d-851028-13 devstack@n-api.service[123595]: request: POST /compute/v2.1/servers/bea29c43-a5ab-42b3-9d5d-3b0f4f0f30f3/action HTTP/1.1 Oct 04 18:37:56.468912 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 18:37:56.468912 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 18:37:56.468912 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 18:37:56.468912 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 112 Oct 04 18:37:56.468912 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 18:37:56.468912 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 18:37:56.468912 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 18:37:56.468912 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 18:37:56.468912 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPH1j6ru-Lvs2wrjdCy9lxsxeqFR_0I69vaAEkGUkfOrTRHFL8podBIY09adymYaKc-fLH_NkEdBByYxe0mMJsKABTMuQ_o2bR1hS7KA3fBrPfxeTZtvPCU_ky0OzwOErFV4VC6vEg6HU5uNST8syClppkHeno1EsgK5NCYStWfnc39k Oct 04 18:37:56.468912 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 18:37:56.468912 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 18:37:56.468912 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 18:37:56.468912 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 18:37:56.468912 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 18:37:56.468912 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 18:37:56.468912 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: 9b9d3dec7f864f42adcd6e9c20043832 Oct 04 18:37:56.468912 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-ImagesNegativeTestJSON-1746998003 Oct 04 18:37:56.468912 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 18:37:56.468912 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 18:37:56.468912 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/9b9d3dec7f864f42adcd6e9c20043832"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_9b9d3dec7f864f42adcd6e9c20043832"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/9b9d3dec7f864f42adcd6e9c20043832"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/9b9d3dec7f864f42adcd6e9c20043832"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:37:56.468912 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-ImagesNegativeTestJSON-1746998003 Oct 04 18:37:56.468912 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: 9b9d3dec7f864f42adcd6e9c20043832 Oct 04 18:37:56.468912 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1746998003 Oct 04 18:37:56.468912 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-ImagesNegativeTestJSON-1746998003-project Oct 04 18:37:56.468912 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 18:37:56.468912 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 18:37:56.468912 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: de84075cb5a44e83a41516b687f07e95 Oct 04 18:37:56.468912 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-ImagesNegativeTestJSON-1746998003-project Oct 04 18:37:56.468912 n-d-851028-13 devstack@n-api.service[123595]: Oct 04 18:37:56.468912 n-d-851028-13 devstack@n-api.service[123595]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1519474858", "metadata": {"image_type": "test"}}} Oct 04 18:37:56.468912 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 18:37:56.468912 n-d-851028-13 devstack@n-api.service[123595]: exception: Instance bea29c43-a5ab-42b3-9d5d-3b0f4f0f30f3 could not be found. Oct 04 18:37:56.468912 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': 'bea29c43-a5ab-42b3-9d5d-3b0f4f0f30f3', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-1519474858', 'metadata': {'image_type': 'test'}}}} Oct 04 18:37:56.468912 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:37:56.468912 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:56.468912 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:37:56.468912 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:37:56.468912 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:37:56.468912 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:37:56.468912 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:37:56.468912 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:37:56.468912 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:37:56.468912 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:37:56.468912 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bea29c43-a5ab-42b3-9d5d-3b0f4f0f30f3 could not be found. Oct 04 18:37:56.468912 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:37:56.468912 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:37:56.468912 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:37:56.468912 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:56.468912 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:37:56.468912 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:37:56.468912 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:37:56.468912 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:37:56.468912 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:37:56.468912 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:37:56.468912 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:37:56.468912 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:37:56.468912 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:37:56.468912 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:37:56.468912 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 04 18:37:56.468912 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 04 18:37:56.474138 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:37:56.474138 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:37:56.474138 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:37:56.474138 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:37:56.474138 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bea29c43-a5ab-42b3-9d5d-3b0f4f0f30f3 could not be found. Oct 04 18:37:56.474138 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:37:56.474138 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:37:56.474138 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:37:56.474138 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:56.474138 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:37:56.474138 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:37:56.474138 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:37:56.474138 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:37:56.474138 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bea29c43-a5ab-42b3-9d5d-3b0f4f0f30f3 could not be found. Oct 04 18:37:56.474138 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:37:56.476281 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-4ccc0a59-d081-49fa-b5ea-3a6b49a8e997 tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Returning 404 to user: Instance bea29c43-a5ab-42b3-9d5d-3b0f4f0f30f3 could not be found. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:37:56.477362 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-4ccc0a59-d081-49fa-b5ea-3a6b49a8e997 tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] 10.222.0.43 "POST /compute/v2.1/servers/bea29c43-a5ab-42b3-9d5d-3b0f4f0f30f3/action" status: 404 len: 111 microversion: 2.1 time: 0.095984 Oct 04 18:37:56.478451 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 841/1832] 10.222.0.43 () {60 vars in 1279 bytes} [Tue Oct 4 18:37:56 2022] POST /compute/v2.1/servers/bea29c43-a5ab-42b3-9d5d-3b0f4f0f30f3/action => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:37:56.501430 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-2d5180bb-fdef-4e65-b6cf-0fd6667fbff3 tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1100765424", "metadata": {"image_type": "test"}}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:37:56.516578 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-2d5180bb-fdef-4e65-b6cf-0fd6667fbff3 tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Failed to fetch instance by id tempest-invalid-1126401076 {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 04 18:37:56.521765 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-2d5180bb-fdef-4e65-b6cf-0fd6667fbff3 tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] HTTP exception thrown: Instance tempest-invalid-1126401076 could not be found. Oct 04 18:37:56.523599 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-2d5180bb-fdef-4e65-b6cf-0fd6667fbff3 tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Request method failure captured: Oct 04 18:37:56.523599 n-d-851028-13 devstack@n-api.service[123595]: request: POST /compute/v2.1/servers/tempest-invalid-1126401076/action HTTP/1.1 Oct 04 18:37:56.523599 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 18:37:56.523599 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 18:37:56.523599 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 18:37:56.523599 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 112 Oct 04 18:37:56.523599 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 18:37:56.523599 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 18:37:56.523599 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 18:37:56.523599 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 18:37:56.523599 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPH1j6ru-Lvs2wrjdCy9lxsxeqFR_0I69vaAEkGUkfOrTRHFL8podBIY09adymYaKc-fLH_NkEdBByYxe0mMJsKABTMuQ_o2bR1hS7KA3fBrPfxeTZtvPCU_ky0OzwOErFV4VC6vEg6HU5uNST8syClppkHeno1EsgK5NCYStWfnc39k Oct 04 18:37:56.523599 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 18:37:56.523599 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 18:37:56.523599 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 18:37:56.523599 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 18:37:56.523599 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 18:37:56.523599 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 18:37:56.523599 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: 9b9d3dec7f864f42adcd6e9c20043832 Oct 04 18:37:56.523599 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-ImagesNegativeTestJSON-1746998003 Oct 04 18:37:56.523599 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 18:37:56.523599 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 18:37:56.523599 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/9b9d3dec7f864f42adcd6e9c20043832"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_9b9d3dec7f864f42adcd6e9c20043832"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/9b9d3dec7f864f42adcd6e9c20043832"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/9b9d3dec7f864f42adcd6e9c20043832"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:37:56.523599 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-ImagesNegativeTestJSON-1746998003 Oct 04 18:37:56.523599 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: 9b9d3dec7f864f42adcd6e9c20043832 Oct 04 18:37:56.523599 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1746998003 Oct 04 18:37:56.523599 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-ImagesNegativeTestJSON-1746998003-project Oct 04 18:37:56.523599 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 18:37:56.523599 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 18:37:56.523599 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: de84075cb5a44e83a41516b687f07e95 Oct 04 18:37:56.523599 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-ImagesNegativeTestJSON-1746998003-project Oct 04 18:37:56.523599 n-d-851028-13 devstack@n-api.service[123595]: Oct 04 18:37:56.523599 n-d-851028-13 devstack@n-api.service[123595]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1100765424", "metadata": {"image_type": "test"}}} Oct 04 18:37:56.523599 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 18:37:56.523599 n-d-851028-13 devstack@n-api.service[123595]: exception: Instance tempest-invalid-1126401076 could not be found. Oct 04 18:37:56.523599 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': 'tempest-invalid-1126401076', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-1100765424', 'metadata': {'image_type': 'test'}}}} Oct 04 18:37:56.523599 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:37:56.523599 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:56.523599 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:37:56.523599 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:37:56.523599 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 04 18:37:56.523599 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 04 18:37:56.523599 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance tempest-invalid-1126401076 could not be found. Oct 04 18:37:56.523599 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:37:56.523599 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:37:56.523599 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:37:56.523599 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:56.523599 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:37:56.523599 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:37:56.523599 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:37:56.523599 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:37:56.523599 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:37:56.523599 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:37:56.523599 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:37:56.523599 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:37:56.523599 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:37:56.523599 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:37:56.523599 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 04 18:37:56.523599 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 04 18:37:56.523599 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:37:56.523599 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:37:56.523599 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:37:56.523599 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:37:56.523599 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance tempest-invalid-1126401076 could not be found. Oct 04 18:37:56.528988 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:37:56.528988 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:37:56.528988 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:37:56.528988 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:56.528988 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:37:56.528988 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:37:56.528988 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:37:56.528988 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:37:56.528988 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance tempest-invalid-1126401076 could not be found. Oct 04 18:37:56.528988 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:37:56.534574 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-2d5180bb-fdef-4e65-b6cf-0fd6667fbff3 tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Returning 404 to user: Instance tempest-invalid-1126401076 could not be found. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:37:56.535662 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-2d5180bb-fdef-4e65-b6cf-0fd6667fbff3 tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] 10.222.0.43 "POST /compute/v2.1/servers/tempest-invalid-1126401076/action" status: 404 len: 101 microversion: 2.1 time: 0.049145 Oct 04 18:37:56.558947 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 842/1833] 10.222.0.43 () {60 vars in 1249 bytes} [Tue Oct 4 18:37:56 2022] POST /compute/v2.1/servers/tempest-invalid-1126401076/action => generated 101 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:37:56.578141 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-c49d7451-6f01-4606-b5e6-42cf8e66c9f0 tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1348494370"}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:37:56.592716 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-c49d7451-6f01-4606-b5e6-42cf8e66c9f0 tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 04 18:37:56.605147 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-c49d7451-6f01-4606-b5e6-42cf8e66c9f0 tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 04 18:37:56.607026 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-c49d7451-6f01-4606-b5e6-42cf8e66c9f0 tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Request method failure captured: Oct 04 18:37:56.607026 n-d-851028-13 devstack@n-api.service[123595]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Oct 04 18:37:56.607026 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 18:37:56.607026 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 18:37:56.607026 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 18:37:56.607026 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 57 Oct 04 18:37:56.607026 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 18:37:56.607026 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 18:37:56.607026 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 18:37:56.607026 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 18:37:56.607026 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPH1j6ru-Lvs2wrjdCy9lxsxeqFR_0I69vaAEkGUkfOrTRHFL8podBIY09adymYaKc-fLH_NkEdBByYxe0mMJsKABTMuQ_o2bR1hS7KA3fBrPfxeTZtvPCU_ky0OzwOErFV4VC6vEg6HU5uNST8syClppkHeno1EsgK5NCYStWfnc39k Oct 04 18:37:56.607026 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 18:37:56.607026 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 18:37:56.607026 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 18:37:56.607026 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 18:37:56.607026 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 18:37:56.607026 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 18:37:56.607026 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: 9b9d3dec7f864f42adcd6e9c20043832 Oct 04 18:37:56.607026 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-ImagesNegativeTestJSON-1746998003 Oct 04 18:37:56.607026 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 18:37:56.607026 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 18:37:56.607026 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/9b9d3dec7f864f42adcd6e9c20043832"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_9b9d3dec7f864f42adcd6e9c20043832"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/9b9d3dec7f864f42adcd6e9c20043832"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/9b9d3dec7f864f42adcd6e9c20043832"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:37:56.607026 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-ImagesNegativeTestJSON-1746998003 Oct 04 18:37:56.607026 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: 9b9d3dec7f864f42adcd6e9c20043832 Oct 04 18:37:56.607026 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1746998003 Oct 04 18:37:56.607026 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-ImagesNegativeTestJSON-1746998003-project Oct 04 18:37:56.607026 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 18:37:56.607026 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 18:37:56.607026 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: de84075cb5a44e83a41516b687f07e95 Oct 04 18:37:56.607026 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-ImagesNegativeTestJSON-1746998003-project Oct 04 18:37:56.607026 n-d-851028-13 devstack@n-api.service[123595]: Oct 04 18:37:56.607026 n-d-851028-13 devstack@n-api.service[123595]: {"createImage": {"name": "tempest-test-snap-1348494370"}} Oct 04 18:37:56.607026 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 18:37:56.607026 n-d-851028-13 devstack@n-api.service[123595]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 04 18:37:56.607026 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-1348494370'}}} Oct 04 18:37:56.607026 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:37:56.607026 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:56.607026 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:37:56.607026 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:37:56.607026 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 04 18:37:56.607026 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 04 18:37:56.607026 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 04 18:37:56.607026 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:37:56.607026 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:37:56.607026 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:37:56.607026 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:56.607026 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:37:56.607026 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:37:56.607026 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:37:56.607026 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:37:56.607026 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:37:56.607026 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:37:56.607026 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:37:56.607026 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:37:56.607026 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:37:56.607026 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:37:56.607026 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 04 18:37:56.607026 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 04 18:37:56.607026 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:37:56.607026 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:37:56.607026 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:37:56.607026 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:37:56.607026 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 04 18:37:56.607026 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:37:56.613211 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:37:56.613211 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:37:56.613211 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:56.613211 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:37:56.613211 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:37:56.613211 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:37:56.613211 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:37:56.613211 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 04 18:37:56.613211 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:37:56.616011 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-c49d7451-6f01-4606-b5e6-42cf8e66c9f0 tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:37:56.628427 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-c49d7451-6f01-4606-b5e6-42cf8e66c9f0 tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] 10.222.0.43 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.062347 Oct 04 18:37:56.629278 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 843/1834] 10.222.0.43 () {60 vars in 1275 bytes} [Tue Oct 4 18:37:56 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:37:56.642518 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-b9d59c12-4c3c-4570-a085-6289713a2397 tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1344485545"}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:37:56.664771 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-b9d59c12-4c3c-4570-a085-6289713a2397 tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 04 18:37:56.666883 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-b9d59c12-4c3c-4570-a085-6289713a2397 tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 04 18:37:56.672132 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-b9d59c12-4c3c-4570-a085-6289713a2397 tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Request method failure captured: Oct 04 18:37:56.672132 n-d-851028-13 devstack@n-api.service[123595]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Oct 04 18:37:56.672132 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 18:37:56.672132 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 18:37:56.672132 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 18:37:56.672132 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 57 Oct 04 18:37:56.672132 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 18:37:56.672132 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 18:37:56.672132 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 18:37:56.672132 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 18:37:56.672132 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPH1j6ru-Lvs2wrjdCy9lxsxeqFR_0I69vaAEkGUkfOrTRHFL8podBIY09adymYaKc-fLH_NkEdBByYxe0mMJsKABTMuQ_o2bR1hS7KA3fBrPfxeTZtvPCU_ky0OzwOErFV4VC6vEg6HU5uNST8syClppkHeno1EsgK5NCYStWfnc39k Oct 04 18:37:56.672132 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 18:37:56.672132 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 18:37:56.672132 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 18:37:56.672132 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 18:37:56.672132 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 18:37:56.672132 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 18:37:56.672132 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: 9b9d3dec7f864f42adcd6e9c20043832 Oct 04 18:37:56.672132 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-ImagesNegativeTestJSON-1746998003 Oct 04 18:37:56.672132 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 18:37:56.672132 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 18:37:56.672132 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/9b9d3dec7f864f42adcd6e9c20043832"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_9b9d3dec7f864f42adcd6e9c20043832"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/9b9d3dec7f864f42adcd6e9c20043832"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/9b9d3dec7f864f42adcd6e9c20043832"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:37:56.672132 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-ImagesNegativeTestJSON-1746998003 Oct 04 18:37:56.672132 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: 9b9d3dec7f864f42adcd6e9c20043832 Oct 04 18:37:56.672132 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1746998003 Oct 04 18:37:56.672132 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-ImagesNegativeTestJSON-1746998003-project Oct 04 18:37:56.672132 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 18:37:56.672132 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 18:37:56.672132 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: de84075cb5a44e83a41516b687f07e95 Oct 04 18:37:56.672132 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-ImagesNegativeTestJSON-1746998003-project Oct 04 18:37:56.672132 n-d-851028-13 devstack@n-api.service[123595]: Oct 04 18:37:56.672132 n-d-851028-13 devstack@n-api.service[123595]: {"createImage": {"name": "tempest-test-snap-1344485545"}} Oct 04 18:37:56.672132 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 18:37:56.672132 n-d-851028-13 devstack@n-api.service[123595]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 04 18:37:56.672132 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-1344485545'}}} Oct 04 18:37:56.672132 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:37:56.672132 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:56.672132 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:37:56.672132 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:37:56.672132 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 04 18:37:56.672132 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 04 18:37:56.672132 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 04 18:37:56.672132 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:37:56.672132 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:37:56.672132 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:37:56.672132 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:56.672132 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:37:56.672132 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:37:56.672132 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:37:56.672132 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:37:56.672132 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:37:56.672132 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:37:56.672132 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:37:56.672132 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:37:56.672132 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:37:56.672132 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:37:56.672132 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 04 18:37:56.672132 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 04 18:37:56.672132 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:37:56.672132 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:37:56.672132 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:37:56.672132 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:37:56.672132 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 04 18:37:56.672132 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:37:56.680678 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:37:56.680678 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:37:56.680678 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:56.680678 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:37:56.680678 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:37:56.680678 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:37:56.680678 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:37:56.680678 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 04 18:37:56.680678 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:37:56.684927 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-b9d59c12-4c3c-4570-a085-6289713a2397 tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:37:56.687043 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-b9d59c12-4c3c-4570-a085-6289713a2397 tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] 10.222.0.43 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.048548 Oct 04 18:37:56.688309 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 844/1835] 10.222.0.43 () {60 vars in 1281 bytes} [Tue Oct 4 18:37:56 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:37:56.729915 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-f1234099-a783-4ac9-9a19-799cd385c74a tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:56.730811 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-f1234099-a783-4ac9-9a19-799cd385c74a tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] [instance: 86743a21-e24e-4001-b3da-48615f6e281e] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:56.732731 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-56ef734f-c18e-4274-8c3a-4075b6c4cdcd tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8046c7965b473e9f7d31be9d6f6937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b194743a4124bdba97895542273859a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:56.745298 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-56ef734f-c18e-4274-8c3a-4075b6c4cdcd tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] 10.222.0.43 "GET /compute/v2.1/servers/4231fdff-39dd-49a6-bea2-5edea44c3582" status: 200 len: 1467 microversion: 2.1 time: 0.738230 Oct 04 18:37:56.747644 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f1234099-a783-4ac9-9a19-799cd385c74a tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:56.748610 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f1234099-a783-4ac9-9a19-799cd385c74a tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:56.749809 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 992/1836] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:56 2022] GET /compute/v2.1/servers/4231fdff-39dd-49a6-bea2-5edea44c3582 => generated 1467 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:56.765421 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f1234099-a783-4ac9-9a19-799cd385c74a tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:56.765421 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f1234099-a783-4ac9-9a19-799cd385c74a tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:56.765421 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f1234099-a783-4ac9-9a19-799cd385c74a tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:56.765421 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f1234099-a783-4ac9-9a19-799cd385c74a tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:56.789132 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-f1234099-a783-4ac9-9a19-799cd385c74a tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] HTTP exception thrown: Instance 86743a21-e24e-4001-b3da-48615f6e281e could not be found. Oct 04 18:37:56.795022 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-f1234099-a783-4ac9-9a19-799cd385c74a tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Request method failure captured: Oct 04 18:37:56.795022 n-d-851028-13 devstack@n-api.service[123595]: request: GET /compute/v2.1/servers/86743a21-e24e-4001-b3da-48615f6e281e HTTP/1.1 Oct 04 18:37:56.795022 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 18:37:56.795022 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 18:37:56.795022 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 18:37:56.795022 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 0 Oct 04 18:37:56.795022 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 18:37:56.795022 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 18:37:56.795022 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 18:37:56.795022 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 18:37:56.795022 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPH1FjpQDMTo-WQnaBct-hi793OA6nOXWID8VHZlHnLSe3utlSiytXhTaUmuOya5lNTsM3Kz-PejMBCBkmkHad0pn_NGG8jv8p4frIsdGg2r7IPRVyg-E3jXO7lLZ5_-qacE0T35EUj99w63mMEdMiYs1AsT4VphKCmkX_i1iKTkj4JU Oct 04 18:37:56.795022 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 18:37:56.795022 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 18:37:56.795022 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 18:37:56.795022 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 18:37:56.795022 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 18:37:56.795022 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 18:37:56.795022 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: a06b8feba3404490a448aa2d4fb106b2 Oct 04 18:37:56.795022 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-ListServersNegativeTestJSON-402277524 Oct 04 18:37:56.795022 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 18:37:56.795022 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 18:37:56.795022 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/a06b8feba3404490a448aa2d4fb106b2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_a06b8feba3404490a448aa2d4fb106b2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a06b8feba3404490a448aa2d4fb106b2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a06b8feba3404490a448aa2d4fb106b2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:37:56.795022 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-ListServersNegativeTestJSON-402277524 Oct 04 18:37:56.795022 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: a06b8feba3404490a448aa2d4fb106b2 Oct 04 18:37:56.795022 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-402277524 Oct 04 18:37:56.795022 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-ListServersNegativeTestJSON-402277524-project Oct 04 18:37:56.795022 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 18:37:56.795022 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 18:37:56.795022 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: 9fa193aff0474ae3ba5d1aa7b0d0e8c4 Oct 04 18:37:56.795022 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-ListServersNegativeTestJSON-402277524-project Oct 04 18:37:56.795022 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 18:37:56.795022 n-d-851028-13 devstack@n-api.service[123595]: exception: Instance 86743a21-e24e-4001-b3da-48615f6e281e could not be found. Oct 04 18:37:56.795022 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': '86743a21-e24e-4001-b3da-48615f6e281e'} Oct 04 18:37:56.795022 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:37:56.795022 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:56.795022 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:37:56.795022 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:37:56.795022 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:37:56.795022 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:37:56.795022 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:37:56.795022 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:37:56.795022 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:37:56.795022 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:37:56.795022 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86743a21-e24e-4001-b3da-48615f6e281e could not be found. Oct 04 18:37:56.795022 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:37:56.795022 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:37:56.795022 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:37:56.795022 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:56.795022 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:37:56.795022 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:37:56.795022 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:37:56.795022 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:37:56.795022 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:37:56.795022 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:37:56.795022 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:37:56.795022 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:37:56.795022 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:37:56.795022 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:37:56.795022 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:37:56.795022 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:37:56.795022 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86743a21-e24e-4001-b3da-48615f6e281e could not be found. Oct 04 18:37:56.795022 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:37:56.795022 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:37:56.799998 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:37:56.799998 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:56.799998 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:37:56.799998 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:37:56.799998 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:37:56.799998 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:37:56.799998 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86743a21-e24e-4001-b3da-48615f6e281e could not be found. Oct 04 18:37:56.799998 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:37:56.805137 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-d899aafd-c786-4814-84a3-b1762456d45c tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:56.805137 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-d899aafd-c786-4814-84a3-b1762456d45c tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] [instance: bea29c43-a5ab-42b3-9d5d-3b0f4f0f30f3] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:56.823408 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d899aafd-c786-4814-84a3-b1762456d45c tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:56.823908 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d899aafd-c786-4814-84a3-b1762456d45c tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:56.828740 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-f1234099-a783-4ac9-9a19-799cd385c74a tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] Returning 404 to user: Instance 86743a21-e24e-4001-b3da-48615f6e281e could not be found. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:37:56.830128 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-f1234099-a783-4ac9-9a19-799cd385c74a tempest-ListServersNegativeTestJSON-402277524 tempest-ListServersNegativeTestJSON-402277524-project] 10.222.0.43 "GET /compute/v2.1/servers/86743a21-e24e-4001-b3da-48615f6e281e" status: 404 len: 111 microversion: 2.1 time: 0.117756 Oct 04 18:37:56.833562 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d899aafd-c786-4814-84a3-b1762456d45c tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:56.837034 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d899aafd-c786-4814-84a3-b1762456d45c tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:56.837034 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d899aafd-c786-4814-84a3-b1762456d45c tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:56.837034 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d899aafd-c786-4814-84a3-b1762456d45c tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:56.839665 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 845/1837] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:56 2022] GET /compute/v2.1/servers/86743a21-e24e-4001-b3da-48615f6e281e => generated 111 bytes in 142 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:37:56.854246 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-531934aa-34b5-40ab-ba85-6edfe720df39 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Calling method '.version_select at 0x7fb21fe785e0>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:56.922974 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-d899aafd-c786-4814-84a3-b1762456d45c tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] HTTP exception thrown: Instance bea29c43-a5ab-42b3-9d5d-3b0f4f0f30f3 could not be found. Oct 04 18:37:56.933346 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-d899aafd-c786-4814-84a3-b1762456d45c tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Request method failure captured: Oct 04 18:37:56.933346 n-d-851028-13 devstack@n-api.service[123596]: request: DELETE /compute/v2.1/servers/bea29c43-a5ab-42b3-9d5d-3b0f4f0f30f3 HTTP/1.1 Oct 04 18:37:56.933346 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:37:56.933346 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:37:56.933346 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:37:56.933346 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 18:37:56.933346 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:37:56.933346 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:37:56.933346 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:37:56.933346 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:37:56.933346 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPH1j6ru-Lvs2wrjdCy9lxsxeqFR_0I69vaAEkGUkfOrTRHFL8podBIY09adymYaKc-fLH_NkEdBByYxe0mMJsKABTMuQ_o2bR1hS7KA3fBrPfxeTZtvPCU_ky0OzwOErFV4VC6vEg6HU5uNST8syClppkHeno1EsgK5NCYStWfnc39k Oct 04 18:37:56.933346 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:37:56.933346 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:37:56.933346 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:37:56.933346 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:37:56.933346 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:37:56.933346 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:37:56.933346 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: 9b9d3dec7f864f42adcd6e9c20043832 Oct 04 18:37:56.933346 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-ImagesNegativeTestJSON-1746998003 Oct 04 18:37:56.933346 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 18:37:56.933346 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 18:37:56.933346 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/9b9d3dec7f864f42adcd6e9c20043832"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_9b9d3dec7f864f42adcd6e9c20043832"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/9b9d3dec7f864f42adcd6e9c20043832"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/9b9d3dec7f864f42adcd6e9c20043832"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:37:56.933346 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-ImagesNegativeTestJSON-1746998003 Oct 04 18:37:56.933346 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: 9b9d3dec7f864f42adcd6e9c20043832 Oct 04 18:37:56.933346 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1746998003 Oct 04 18:37:56.933346 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-ImagesNegativeTestJSON-1746998003-project Oct 04 18:37:56.933346 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:37:56.933346 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:37:56.933346 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: de84075cb5a44e83a41516b687f07e95 Oct 04 18:37:56.933346 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-ImagesNegativeTestJSON-1746998003-project Oct 04 18:37:56.933346 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 18:37:56.933346 n-d-851028-13 devstack@n-api.service[123596]: exception: Instance bea29c43-a5ab-42b3-9d5d-3b0f4f0f30f3 could not be found. Oct 04 18:37:56.933346 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': 'bea29c43-a5ab-42b3-9d5d-3b0f4f0f30f3'} Oct 04 18:37:56.933346 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:37:56.933346 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:56.933346 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:37:56.933346 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:37:56.933346 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:37:56.933346 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:37:56.933346 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:37:56.933346 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:37:56.933346 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:37:56.933346 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:37:56.933346 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bea29c43-a5ab-42b3-9d5d-3b0f4f0f30f3 could not be found. Oct 04 18:37:56.933346 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:37:56.933346 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:37:56.933346 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:37:56.933346 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:56.933346 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:37:56.933346 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:37:56.933346 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:37:56.933346 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:37:56.933346 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:37:56.933346 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:37:56.933346 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:37:56.933346 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:37:56.933346 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:37:56.933346 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:37:56.933346 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:37:56.933346 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:37:56.933346 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:37:56.933346 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:37:56.938989 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bea29c43-a5ab-42b3-9d5d-3b0f4f0f30f3 could not be found. Oct 04 18:37:56.938989 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:37:56.938989 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:37:56.938989 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:37:56.938989 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:56.938989 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:37:56.938989 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:37:56.938989 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:37:56.938989 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:37:56.938989 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bea29c43-a5ab-42b3-9d5d-3b0f4f0f30f3 could not be found. Oct 04 18:37:56.938989 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:37:56.938989 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-d899aafd-c786-4814-84a3-b1762456d45c tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Returning 404 to user: Instance bea29c43-a5ab-42b3-9d5d-3b0f4f0f30f3 could not be found. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:37:56.938989 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-d899aafd-c786-4814-84a3-b1762456d45c tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] 10.222.0.43 "DELETE /compute/v2.1/servers/bea29c43-a5ab-42b3-9d5d-3b0f4f0f30f3" status: 404 len: 111 microversion: 2.1 time: 0.158302 Oct 04 18:37:56.940172 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 993/1838] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 18:37:56 2022] DELETE /compute/v2.1/servers/bea29c43-a5ab-42b3-9d5d-3b0f4f0f30f3 => generated 111 bytes in 170 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:37:56.965868 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-abfbf7cf-d75a-4936-a324-60f51da2558b tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:56.967604 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-abfbf7cf-d75a-4936-a324-60f51da2558b tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] [instance: bea29c43-a5ab-42b3-9d5d-3b0f4f0f30f3] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:56.980255 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-abfbf7cf-d75a-4936-a324-60f51da2558b tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:56.984647 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-abfbf7cf-d75a-4936-a324-60f51da2558b tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:56.985785 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-abfbf7cf-d75a-4936-a324-60f51da2558b tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:56.989137 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-abfbf7cf-d75a-4936-a324-60f51da2558b tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:56.992026 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-abfbf7cf-d75a-4936-a324-60f51da2558b tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:56.992687 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-abfbf7cf-d75a-4936-a324-60f51da2558b tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:57.063154 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-abfbf7cf-d75a-4936-a324-60f51da2558b tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] HTTP exception thrown: Instance bea29c43-a5ab-42b3-9d5d-3b0f4f0f30f3 could not be found. Oct 04 18:37:57.070826 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-abfbf7cf-d75a-4936-a324-60f51da2558b tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Request method failure captured: Oct 04 18:37:57.070826 n-d-851028-13 devstack@n-api.service[123596]: request: GET /compute/v2.1/servers/bea29c43-a5ab-42b3-9d5d-3b0f4f0f30f3 HTTP/1.1 Oct 04 18:37:57.070826 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:37:57.070826 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:37:57.070826 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:37:57.070826 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 18:37:57.070826 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:37:57.070826 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:37:57.070826 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:37:57.070826 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:37:57.070826 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPH1j6ru-Lvs2wrjdCy9lxsxeqFR_0I69vaAEkGUkfOrTRHFL8podBIY09adymYaKc-fLH_NkEdBByYxe0mMJsKABTMuQ_o2bR1hS7KA3fBrPfxeTZtvPCU_ky0OzwOErFV4VC6vEg6HU5uNST8syClppkHeno1EsgK5NCYStWfnc39k Oct 04 18:37:57.070826 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:37:57.070826 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:37:57.070826 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:37:57.070826 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:37:57.070826 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:37:57.070826 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:37:57.070826 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: 9b9d3dec7f864f42adcd6e9c20043832 Oct 04 18:37:57.070826 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-ImagesNegativeTestJSON-1746998003 Oct 04 18:37:57.070826 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 18:37:57.070826 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 18:37:57.070826 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/9b9d3dec7f864f42adcd6e9c20043832"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_9b9d3dec7f864f42adcd6e9c20043832"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/9b9d3dec7f864f42adcd6e9c20043832"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/9b9d3dec7f864f42adcd6e9c20043832"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:37:57.070826 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-ImagesNegativeTestJSON-1746998003 Oct 04 18:37:57.070826 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: 9b9d3dec7f864f42adcd6e9c20043832 Oct 04 18:37:57.070826 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1746998003 Oct 04 18:37:57.070826 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-ImagesNegativeTestJSON-1746998003-project Oct 04 18:37:57.070826 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:37:57.070826 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:37:57.070826 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: de84075cb5a44e83a41516b687f07e95 Oct 04 18:37:57.070826 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-ImagesNegativeTestJSON-1746998003-project Oct 04 18:37:57.070826 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 18:37:57.070826 n-d-851028-13 devstack@n-api.service[123596]: exception: Instance bea29c43-a5ab-42b3-9d5d-3b0f4f0f30f3 could not be found. Oct 04 18:37:57.070826 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': 'bea29c43-a5ab-42b3-9d5d-3b0f4f0f30f3'} Oct 04 18:37:57.070826 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:37:57.070826 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:57.070826 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:37:57.070826 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:37:57.070826 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:37:57.070826 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:37:57.070826 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:37:57.070826 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:37:57.070826 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:37:57.070826 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:37:57.070826 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bea29c43-a5ab-42b3-9d5d-3b0f4f0f30f3 could not be found. Oct 04 18:37:57.070826 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:37:57.070826 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:37:57.070826 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:37:57.070826 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:57.070826 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:37:57.070826 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:37:57.070826 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:37:57.070826 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:37:57.070826 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:37:57.070826 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:37:57.070826 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:37:57.070826 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:37:57.070826 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:37:57.070826 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:37:57.070826 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:37:57.070826 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:37:57.070826 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bea29c43-a5ab-42b3-9d5d-3b0f4f0f30f3 could not be found. Oct 04 18:37:57.070826 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:37:57.070826 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:37:57.070826 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:37:57.075874 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:57.075874 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:37:57.075874 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:37:57.075874 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:37:57.075874 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:37:57.075874 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bea29c43-a5ab-42b3-9d5d-3b0f4f0f30f3 could not be found. Oct 04 18:37:57.075874 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:37:57.075874 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-abfbf7cf-d75a-4936-a324-60f51da2558b tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] Returning 404 to user: Instance bea29c43-a5ab-42b3-9d5d-3b0f4f0f30f3 could not be found. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:37:57.075874 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-abfbf7cf-d75a-4936-a324-60f51da2558b tempest-ImagesNegativeTestJSON-1746998003 tempest-ImagesNegativeTestJSON-1746998003-project] 10.222.0.43 "GET /compute/v2.1/servers/bea29c43-a5ab-42b3-9d5d-3b0f4f0f30f3" status: 404 len: 111 microversion: 2.1 time: 0.135360 Oct 04 18:37:57.081425 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 994/1839] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:56 2022] GET /compute/v2.1/servers/bea29c43-a5ab-42b3-9d5d-3b0f4f0f30f3 => generated 111 bytes in 141 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:37:57.098388 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-25acace7-8dab-4d9e-aeb1-ee994ef8c638 req-024f1be7-a021-448d-ad64-24916e81b090 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86743a21-e24e-4001-b3da-48615f6e281e", "name": "network-vif-deleted", "tag": "36be2d21-a2ff-4ccd-8c37-dfd2f4b90d0c"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:37:57.121961 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-25acace7-8dab-4d9e-aeb1-ee994ef8c638 req-024f1be7-a021-448d-ad64-24916e81b090 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:57.124099 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-25acace7-8dab-4d9e-aeb1-ee994ef8c638 req-024f1be7-a021-448d-ad64-24916e81b090 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:57.128441 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-25acace7-8dab-4d9e-aeb1-ee994ef8c638 req-024f1be7-a021-448d-ad64-24916e81b090 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:57.160855 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-25acace7-8dab-4d9e-aeb1-ee994ef8c638 req-024f1be7-a021-448d-ad64-24916e81b090 service nova] Creating event network-vif-deleted:36be2d21-a2ff-4ccd-8c37-dfd2f4b90d0c for instance 86743a21-e24e-4001-b3da-48615f6e281e on n-h1-851028-13 Oct 04 18:37:57.179798 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-25acace7-8dab-4d9e-aeb1-ee994ef8c638 req-024f1be7-a021-448d-ad64-24916e81b090 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096607 Oct 04 18:37:57.181905 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 995/1840] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:37:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:37:57.213696 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-44507431-b8c4-4ab6-9703-9708b10163de tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:57.218655 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-44507431-b8c4-4ab6-9703-9708b10163de tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: d85af512-1b1f-42a4-9bb1-963cc956c9ae] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:57.244686 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-44507431-b8c4-4ab6-9703-9708b10163de tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:57.246419 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-44507431-b8c4-4ab6-9703-9708b10163de tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:57.249056 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-44507431-b8c4-4ab6-9703-9708b10163de tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:57.252239 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-44507431-b8c4-4ab6-9703-9708b10163de tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:57.253731 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-44507431-b8c4-4ab6-9703-9708b10163de tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:57.255582 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-44507431-b8c4-4ab6-9703-9708b10163de tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:57.829580 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-44507431-b8c4-4ab6-9703-9708b10163de tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:57.842377 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-531934aa-34b5-40ab-ba85-6edfe720df39 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] 10.222.0.43 "DELETE /compute/v2.1/images/d7825145-299c-45b6-9fe8-780722b2d243" status: 204 len: 0 microversion: 2.1 time: 1.000853 Oct 04 18:37:57.846524 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 846/1841] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:56 2022] DELETE /compute/v2.1/images/d7825145-299c-45b6-9fe8-780722b2d243 => generated 0 bytes in 1003 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:37:57.848590 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-3ff67566-9b12-4c75-a50e-501075940504 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Calling method '.version_select at 0x7fb21fb3a430>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:57.849825 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-44507431-b8c4-4ab6-9703-9708b10163de tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/d85af512-1b1f-42a4-9bb1-963cc956c9ae" status: 200 len: 1476 microversion: 2.1 time: 0.666147 Oct 04 18:37:57.850430 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 996/1842] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:57 2022] GET /compute/v2.1/servers/d85af512-1b1f-42a4-9bb1-963cc956c9ae => generated 1476 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:57.870807 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-92f8949f-f60c-4ccd-bc0d-f959bf578cf8 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Calling method '.version_select at 0x7fb21f146e50>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:57.912043 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-3ff67566-9b12-4c75-a50e-501075940504 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] 10.222.0.43 "GET /compute/v2.1/images/52610c6d-facb-4b22-af71-212112120503" status: 200 len: 662 microversion: 2.1 time: 0.067657 Oct 04 18:37:57.913527 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 847/1843] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 18:37:57 2022] GET /compute/v2.1/images/52610c6d-facb-4b22-af71-212112120503 => generated 662 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:37:57.927906 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-2acfc7c9-cd89-4831-afc4-d57039dd6ec0 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Calling method '.version_select at 0x7fb21fc6a280>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:57.957982 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-92f8949f-f60c-4ccd-bc0d-f959bf578cf8 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] HTTP exception thrown: Image not found. Oct 04 18:37:57.960148 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-92f8949f-f60c-4ccd-bc0d-f959bf578cf8 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Request method failure captured: Oct 04 18:37:57.960148 n-d-851028-13 devstack@n-api.service[123596]: request: DELETE /compute/v2.1/images/3adaa529-06f7-4c7d-8ad1-d56ec671ea9a HTTP/1.1 Oct 04 18:37:57.960148 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:37:57.960148 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:37:57.960148 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:37:57.960148 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 18:37:57.960148 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:37:57.960148 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:37:57.960148 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:37:57.960148 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:37:57.960148 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPH0hO_Ym2aLHAuk9rkBKg3C9YkagtqYC-rp7fMGd1weqaGssGyw08BqfU3pT_Y_hZLBo9ZzyE6BELs39RFtTAFUidzm6wwU42rAJzEyj8cCVUCsmjPcm1Fgx9u-MawhbeNr7VvrF2c4V4-Rrr5VP9VBPa6pSXjPPC4YiU4wUEOO-Voc Oct 04 18:37:57.960148 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:37:57.960148 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:37:57.960148 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:37:57.960148 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:37:57.960148 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:37:57.960148 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:37:57.960148 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: 3b194743a4124bdba97895542273859a Oct 04 18:37:57.960148 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-ImagesOneServerTestJSON-2102952989 Oct 04 18:37:57.960148 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 18:37:57.960148 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 18:37:57.960148 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/3b194743a4124bdba97895542273859a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_3b194743a4124bdba97895542273859a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/3b194743a4124bdba97895542273859a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/3b194743a4124bdba97895542273859a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:37:57.960148 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-ImagesOneServerTestJSON-2102952989 Oct 04 18:37:57.960148 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: 3b194743a4124bdba97895542273859a Oct 04 18:37:57.960148 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-2102952989 Oct 04 18:37:57.960148 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-ImagesOneServerTestJSON-2102952989-project Oct 04 18:37:57.960148 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:37:57.960148 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:37:57.960148 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 1e8046c7965b473e9f7d31be9d6f6937 Oct 04 18:37:57.960148 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-ImagesOneServerTestJSON-2102952989-project Oct 04 18:37:57.960148 n-d-851028-13 devstack@n-api.service[123596]: method: Oct 04 18:37:57.960148 n-d-851028-13 devstack@n-api.service[123596]: exception: Image not found. Oct 04 18:37:57.960148 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': '3adaa529-06f7-4c7d-8ad1-d56ec671ea9a'} Oct 04 18:37:57.960148 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:37:57.960148 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:57.960148 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 04 18:37:57.960148 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 04 18:37:57.960148 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 18:37:57.960148 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 18:37:57.960148 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 18:37:57.960148 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 18:37:57.960148 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 04 18:37:57.960148 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 04 18:37:57.960148 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 04 18:37:57.960148 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 04 18:37:57.960148 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 18:37:57.960148 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 18:37:57.960148 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 18:37:57.960148 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 18:37:57.960148 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 3adaa529-06f7-4c7d-8ad1-d56ec671ea9a to delete Oct 04 18:37:57.960148 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:37:57.960148 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:37:57.960148 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:37:57.960148 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:57.960148 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 04 18:37:57.960148 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 04 18:37:57.960148 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 04 18:37:57.960148 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 04 18:37:57.960148 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 04 18:37:57.960148 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 04 18:37:57.960148 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 3adaa529-06f7-4c7d-8ad1-d56ec671ea9a could not be found. Oct 04 18:37:57.960148 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:37:57.960148 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:37:57.960148 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:37:57.960148 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:57.965268 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:37:57.965268 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:37:57.965268 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:37:57.965268 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:37:57.965268 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:37:57.965268 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:37:57.965268 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:37:57.965268 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:37:57.965268 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 04 18:37:57.965268 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 18:37:57.965268 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 18:37:57.965268 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:37:57.965268 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:37:57.965268 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:37:57.965268 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:57.965268 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:37:57.965268 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:37:57.965268 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:37:57.965268 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:37:57.965268 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 18:37:57.965268 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:37:57.968577 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-92f8949f-f60c-4ccd-bc0d-f959bf578cf8 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Returning 404 to user: Image not found. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:37:57.969713 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-92f8949f-f60c-4ccd-bc0d-f959bf578cf8 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] 10.222.0.43 "DELETE /compute/v2.1/images/3adaa529-06f7-4c7d-8ad1-d56ec671ea9a" status: 404 len: 62 microversion: 2.1 time: 0.102759 Oct 04 18:37:57.970773 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 997/1844] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:57 2022] DELETE /compute/v2.1/images/3adaa529-06f7-4c7d-8ad1-d56ec671ea9a => generated 62 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:37:57.982484 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-b560f233-6672-4557-bffc-39860e162efd tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:57.986191 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-b560f233-6672-4557-bffc-39860e162efd tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] [instance: 4231fdff-39dd-49a6-bea2-5edea44c3582] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:58.004555 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-2acfc7c9-cd89-4831-afc4-d57039dd6ec0 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] 10.222.0.43 "GET /compute/v2.1/images/52610c6d-facb-4b22-af71-212112120503" status: 200 len: 662 microversion: 2.1 time: 0.080810 Oct 04 18:37:58.004799 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 848/1845] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 18:37:57 2022] GET /compute/v2.1/images/52610c6d-facb-4b22-af71-212112120503 => generated 662 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:37:58.021664 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b560f233-6672-4557-bffc-39860e162efd tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:58.022140 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b560f233-6672-4557-bffc-39860e162efd tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:58.022673 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b560f233-6672-4557-bffc-39860e162efd tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:58.023412 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b560f233-6672-4557-bffc-39860e162efd tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:58.027933 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b560f233-6672-4557-bffc-39860e162efd tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:58.028384 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b560f233-6672-4557-bffc-39860e162efd tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:58.076461 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-b560f233-6672-4557-bffc-39860e162efd tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] [instance: 4231fdff-39dd-49a6-bea2-5edea44c3582] Going to try to terminate instance {{(pid=123596) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:37:58.251668 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-b560f233-6672-4557-bffc-39860e162efd tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] 10.222.0.43 "DELETE /compute/v2.1/servers/4231fdff-39dd-49a6-bea2-5edea44c3582" status: 204 len: 0 microversion: 2.1 time: 0.272455 Oct 04 18:37:58.258473 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 998/1846] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 18:37:57 2022] DELETE /compute/v2.1/servers/4231fdff-39dd-49a6-bea2-5edea44c3582 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 18:37:58.264814 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-b3071e9e-3028-4407-8b76-06aa0eae9284 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:58.265695 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-b3071e9e-3028-4407-8b76-06aa0eae9284 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] [instance: 4231fdff-39dd-49a6-bea2-5edea44c3582] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:58.275504 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b3071e9e-3028-4407-8b76-06aa0eae9284 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:58.277736 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b3071e9e-3028-4407-8b76-06aa0eae9284 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:58.280276 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b3071e9e-3028-4407-8b76-06aa0eae9284 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:58.282300 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b3071e9e-3028-4407-8b76-06aa0eae9284 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:58.283214 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b3071e9e-3028-4407-8b76-06aa0eae9284 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:58.286179 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b3071e9e-3028-4407-8b76-06aa0eae9284 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:58.874826 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-952f12f5-b958-4189-84d3-b371b539d838 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:58.877073 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-952f12f5-b958-4189-84d3-b371b539d838 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: d85af512-1b1f-42a4-9bb1-963cc956c9ae] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:58.892902 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-952f12f5-b958-4189-84d3-b371b539d838 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:58.897370 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-952f12f5-b958-4189-84d3-b371b539d838 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:58.897901 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-952f12f5-b958-4189-84d3-b371b539d838 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:58.898671 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-952f12f5-b958-4189-84d3-b371b539d838 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:58.901854 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-952f12f5-b958-4189-84d3-b371b539d838 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:58.902871 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-952f12f5-b958-4189-84d3-b371b539d838 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:59.419240 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-952f12f5-b958-4189-84d3-b371b539d838 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:59.436056 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-952f12f5-b958-4189-84d3-b371b539d838 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/d85af512-1b1f-42a4-9bb1-963cc956c9ae" status: 200 len: 1476 microversion: 2.1 time: 0.565646 Oct 04 18:37:59.437479 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 999/1847] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:58 2022] GET /compute/v2.1/servers/d85af512-1b1f-42a4-9bb1-963cc956c9ae => generated 1476 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:37:59.782406 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-e681b0e1-a5af-4405-9cab-d7e3181397de tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Calling method '.version_select at 0x7fb21f146ee0>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:59.844029 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-b3071e9e-3028-4407-8b76-06aa0eae9284 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8046c7965b473e9f7d31be9d6f6937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b194743a4124bdba97895542273859a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:59.868485 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-b3071e9e-3028-4407-8b76-06aa0eae9284 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] 10.222.0.43 "GET /compute/v2.1/servers/4231fdff-39dd-49a6-bea2-5edea44c3582" status: 200 len: 1473 microversion: 2.1 time: 1.609823 Oct 04 18:37:59.873491 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 849/1848] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:58 2022] GET /compute/v2.1/servers/4231fdff-39dd-49a6-bea2-5edea44c3582 => generated 1473 bytes in 1616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:59.929454 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-e681b0e1-a5af-4405-9cab-d7e3181397de tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] 10.222.0.43 "GET /compute/v2.1/images/4922dc1e-3377-471c-b125-be6842ef59ec" status: 200 len: 661 microversion: 2.1 time: 0.156655 Oct 04 18:37:59.930024 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1000/1849] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 18:37:59 2022] GET /compute/v2.1/images/4922dc1e-3377-471c-b125-be6842ef59ec => generated 661 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:37:59.946473 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-da988472-1a7d-4dd7-a902-e3a7f2dae7e1 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Calling method '.version_select at 0x7fb21f7b81f0>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:00.038239 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-da988472-1a7d-4dd7-a902-e3a7f2dae7e1 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] 10.222.0.43 "GET /compute/v2.1/images/4922dc1e-3377-471c-b125-be6842ef59ec" status: 200 len: 661 microversion: 2.1 time: 0.096332 Oct 04 18:38:00.040528 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 850/1850] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 18:37:59 2022] GET /compute/v2.1/images/4922dc1e-3377-471c-b125-be6842ef59ec => generated 661 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:38:00.123783 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-5006ca1c-efc8-45e8-be45-aeda09f64e29 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-520735362", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452"}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:38:00.162953 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=1,nova_api:UPDATE=3 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:38:00.268324 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.network.neutron [None req-5006ca1c-efc8-45e8-be45-aeda09f64e29 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] validate_networks() for None {{(pid=123596) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:38:00.341851 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-acc71cac-6b2d-48f0-b5a8-94bdff97644c req-24184c9f-3023-4e77-a512-f5553c95bf50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4231fdff-39dd-49a6-bea2-5edea44c3582", "name": "network-vif-unplugged", "status": "completed", "tag": "ee13bc47-8284-46ee-acc8-f29243243bf5"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:38:00.375116 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-acc71cac-6b2d-48f0-b5a8-94bdff97644c req-24184c9f-3023-4e77-a512-f5553c95bf50 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:00.381487 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-acc71cac-6b2d-48f0-b5a8-94bdff97644c req-24184c9f-3023-4e77-a512-f5553c95bf50 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:00.381994 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-acc71cac-6b2d-48f0-b5a8-94bdff97644c req-24184c9f-3023-4e77-a512-f5553c95bf50 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:00.432836 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-acc71cac-6b2d-48f0-b5a8-94bdff97644c req-24184c9f-3023-4e77-a512-f5553c95bf50 service nova] Creating event network-vif-unplugged:ee13bc47-8284-46ee-acc8-f29243243bf5 for instance 4231fdff-39dd-49a6-bea2-5edea44c3582 on n-h1-851028-13 Oct 04 18:38:00.450353 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-acc71cac-6b2d-48f0-b5a8-94bdff97644c req-24184c9f-3023-4e77-a512-f5553c95bf50 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.115183 Oct 04 18:38:00.453600 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 851/1851] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:38:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:38:00.465687 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-f835a8cd-9aaa-48a7-ad74-3c47a8c9049b tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:00.467405 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-f835a8cd-9aaa-48a7-ad74-3c47a8c9049b tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: d85af512-1b1f-42a4-9bb1-963cc956c9ae] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:00.477410 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f835a8cd-9aaa-48a7-ad74-3c47a8c9049b tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:00.478262 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f835a8cd-9aaa-48a7-ad74-3c47a8c9049b tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:00.479140 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f835a8cd-9aaa-48a7-ad74-3c47a8c9049b tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:00.480089 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f835a8cd-9aaa-48a7-ad74-3c47a8c9049b tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:00.480959 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f835a8cd-9aaa-48a7-ad74-3c47a8c9049b tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:00.481751 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f835a8cd-9aaa-48a7-ad74-3c47a8c9049b tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:00.987961 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-5006ca1c-efc8-45e8-be45-aeda09f64e29 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Flavor limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:38:00.989153 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-5006ca1c-efc8-45e8-be45-aeda09f64e29 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Image limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:38:00.990095 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-5006ca1c-efc8-45e8-be45-aeda09f64e29 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Flavor pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:38:00.990826 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-5006ca1c-efc8-45e8-be45-aeda09f64e29 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Image pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:38:00.991630 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-5006ca1c-efc8-45e8-be45-aeda09f64e29 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:38:01.009648 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5006ca1c-efc8-45e8-be45-aeda09f64e29 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:01.010559 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5006ca1c-efc8-45e8-be45-aeda09f64e29 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:01.011617 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5006ca1c-efc8-45e8-be45-aeda09f64e29 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:01.012832 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5006ca1c-efc8-45e8-be45-aeda09f64e29 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:01.013825 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5006ca1c-efc8-45e8-be45-aeda09f64e29 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:01.014561 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5006ca1c-efc8-45e8-be45-aeda09f64e29 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:01.093575 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-5006ca1c-efc8-45e8-be45-aeda09f64e29 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Getting quotas for project 59c54096058d4c9a8ea436329e25ecbf. Resources: {'ram', 'cores', 'instances'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:38:01.098916 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-5006ca1c-efc8-45e8-be45-aeda09f64e29 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Getting quotas for user e30c6d7042ca444a86e2260692ea048e and project 59c54096058d4c9a8ea436329e25ecbf. Resources: {'ram', 'cores', 'instances'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:38:01.127819 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-5006ca1c-efc8-45e8-be45-aeda09f64e29 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Going to run 1 instances... {{(pid=123596) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:38:01.130321 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-5006ca1c-efc8-45e8-be45-aeda09f64e29 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] [instance: 0b7f1ede-48b3-48d8-933e-287c338b1e6a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e8943ec5-4038-4d4b-b9b9-2415a79f5243',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123596) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:38:01.260061 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-5006ca1c-efc8-45e8-be45-aeda09f64e29 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.143416 Oct 04 18:38:01.265875 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1001/1852] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 18:38:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 1150 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:38:01.280770 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-f835a8cd-9aaa-48a7-ad74-3c47a8c9049b tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:01.318174 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-f835a8cd-9aaa-48a7-ad74-3c47a8c9049b tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/d85af512-1b1f-42a4-9bb1-963cc956c9ae" status: 200 len: 1476 microversion: 2.1 time: 0.839809 Oct 04 18:38:01.319089 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-6006364e-bcba-4f95-aec4-bce4714846b0 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:01.319967 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 852/1853] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:00 2022] GET /compute/v2.1/servers/d85af512-1b1f-42a4-9bb1-963cc956c9ae => generated 1476 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:01.323020 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-6006364e-bcba-4f95-aec4-bce4714846b0 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] [instance: 4231fdff-39dd-49a6-bea2-5edea44c3582] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:01.360297 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6006364e-bcba-4f95-aec4-bce4714846b0 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:01.360770 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6006364e-bcba-4f95-aec4-bce4714846b0 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:01.361261 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6006364e-bcba-4f95-aec4-bce4714846b0 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:01.362016 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6006364e-bcba-4f95-aec4-bce4714846b0 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:01.362629 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6006364e-bcba-4f95-aec4-bce4714846b0 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:01.363077 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6006364e-bcba-4f95-aec4-bce4714846b0 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:01.407830 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-9b5c5339-700a-44ac-8f3b-d9d18ba3c24c tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-1704475652", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452"}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:38:01.517213 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.network.neutron [None req-9b5c5339-700a-44ac-8f3b-d9d18ba3c24c tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] validate_networks() for None {{(pid=123595) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:38:02.025786 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-6006364e-bcba-4f95-aec4-bce4714846b0 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8046c7965b473e9f7d31be9d6f6937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b194743a4124bdba97895542273859a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:02.062848 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-6006364e-bcba-4f95-aec4-bce4714846b0 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] 10.222.0.43 "GET /compute/v2.1/servers/4231fdff-39dd-49a6-bea2-5edea44c3582" status: 200 len: 1473 microversion: 2.1 time: 0.764076 Oct 04 18:38:02.074113 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1002/1854] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:01 2022] GET /compute/v2.1/servers/4231fdff-39dd-49a6-bea2-5edea44c3582 => generated 1473 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:02.238345 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-b06b5571-446c-491b-8f31-cb1b234c1add tempest-SecurityGroupRulesTestJSON-1076849469 tempest-SecurityGroupRulesTestJSON-1076849469-project] Action: 'create', calling method: .version_select at 0x7fb21f1a1ca0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-804311618", "description": "tempest-description-1208631178"}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:38:02.306556 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-9b5c5339-700a-44ac-8f3b-d9d18ba3c24c tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Flavor limits 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:38:02.308017 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-9b5c5339-700a-44ac-8f3b-d9d18ba3c24c tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Image limits 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:38:02.308744 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-9b5c5339-700a-44ac-8f3b-d9d18ba3c24c tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Flavor pref 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:38:02.309460 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-9b5c5339-700a-44ac-8f3b-d9d18ba3c24c tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Image pref 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:38:02.310646 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-9b5c5339-700a-44ac-8f3b-d9d18ba3c24c tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:38:02.330630 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9b5c5339-700a-44ac-8f3b-d9d18ba3c24c tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:02.331496 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9b5c5339-700a-44ac-8f3b-d9d18ba3c24c tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:02.333563 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9b5c5339-700a-44ac-8f3b-d9d18ba3c24c tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:02.336064 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9b5c5339-700a-44ac-8f3b-d9d18ba3c24c tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:02.336829 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9b5c5339-700a-44ac-8f3b-d9d18ba3c24c tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:02.337916 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9b5c5339-700a-44ac-8f3b-d9d18ba3c24c tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:02.425915 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-9b5c5339-700a-44ac-8f3b-d9d18ba3c24c tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Getting quotas for project 59c54096058d4c9a8ea436329e25ecbf. Resources: {'ram', 'cores', 'instances'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:38:02.446517 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-9b5c5339-700a-44ac-8f3b-d9d18ba3c24c tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Getting quotas for user e30c6d7042ca444a86e2260692ea048e and project 59c54096058d4c9a8ea436329e25ecbf. Resources: {'ram', 'cores', 'instances'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:38:02.472907 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-9b5c5339-700a-44ac-8f3b-d9d18ba3c24c tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Going to run 1 instances... {{(pid=123595) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:38:02.481251 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-9b5c5339-700a-44ac-8f3b-d9d18ba3c24c tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] [instance: 6eb9c803-dd97-4af5-b0d0-aa6fc18f8a89] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e8943ec5-4038-4d4b-b9b9-2415a79f5243',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:38:02.596119 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-9b5c5339-700a-44ac-8f3b-d9d18ba3c24c tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.193392 Oct 04 18:38:02.599757 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 853/1855] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 18:38:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 1198 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 18:38:02.619866 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-8abc052b-a37f-4b33-8218-123257b381ac tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:02.622096 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-8abc052b-a37f-4b33-8218-123257b381ac tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: d85af512-1b1f-42a4-9bb1-963cc956c9ae] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:02.662822 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8abc052b-a37f-4b33-8218-123257b381ac tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:02.663344 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8abc052b-a37f-4b33-8218-123257b381ac tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:02.663830 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8abc052b-a37f-4b33-8218-123257b381ac tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:02.664935 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8abc052b-a37f-4b33-8218-123257b381ac tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:02.665440 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8abc052b-a37f-4b33-8218-123257b381ac tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:02.669189 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8abc052b-a37f-4b33-8218-123257b381ac tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:03.234681 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-b06b5571-446c-491b-8f31-cb1b234c1add tempest-SecurityGroupRulesTestJSON-1076849469 tempest-SecurityGroupRulesTestJSON-1076849469-project] 10.222.0.43 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 1.159329 Oct 04 18:38:03.240016 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1003/1856] 10.222.0.43 () {60 vars in 1180 bytes} [Tue Oct 4 18:38:02 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 1165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:38:03.246983 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f1911c78-21f6-4898-aa5b-b52d2190ed7f tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:03.249274 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-f1911c78-21f6-4898-aa5b-b52d2190ed7f tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] [instance: 6eb9c803-dd97-4af5-b0d0-aa6fc18f8a89] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:03.457555 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-f1911c78-21f6-4898-aa5b-b52d2190ed7f tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e30c6d7042ca444a86e2260692ea048e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c54096058d4c9a8ea436329e25ecbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:03.479306 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-f1911c78-21f6-4898-aa5b-b52d2190ed7f tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] 10.222.0.43 "GET /compute/v2.1/servers/6eb9c803-dd97-4af5-b0d0-aa6fc18f8a89" status: 200 len: 1218 microversion: 2.1 time: 0.236758 Oct 04 18:38:03.479934 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1004/1857] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:03 2022] GET /compute/v2.1/servers/6eb9c803-dd97-4af5-b0d0-aa6fc18f8a89 => generated 1218 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:03.489596 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-ee7d1cd3-1af9-4ce4-9b5f-e842a2d098d2 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:03.489596 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-ee7d1cd3-1af9-4ce4-9b5f-e842a2d098d2 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] [instance: 4231fdff-39dd-49a6-bea2-5edea44c3582] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:03.524493 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ee7d1cd3-1af9-4ce4-9b5f-e842a2d098d2 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:03.530732 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ee7d1cd3-1af9-4ce4-9b5f-e842a2d098d2 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:03.531585 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ee7d1cd3-1af9-4ce4-9b5f-e842a2d098d2 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:03.535564 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ee7d1cd3-1af9-4ce4-9b5f-e842a2d098d2 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:03.536496 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ee7d1cd3-1af9-4ce4-9b5f-e842a2d098d2 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:03.538873 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ee7d1cd3-1af9-4ce4-9b5f-e842a2d098d2 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:04.449818 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-ee7d1cd3-1af9-4ce4-9b5f-e842a2d098d2 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8046c7965b473e9f7d31be9d6f6937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b194743a4124bdba97895542273859a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:04.458681 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-ee7d1cd3-1af9-4ce4-9b5f-e842a2d098d2 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] 10.222.0.43 "GET /compute/v2.1/servers/4231fdff-39dd-49a6-bea2-5edea44c3582" status: 200 len: 1431 microversion: 2.1 time: 0.975698 Oct 04 18:38:04.482185 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1005/1858] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:03 2022] GET /compute/v2.1/servers/4231fdff-39dd-49a6-bea2-5edea44c3582 => generated 1431 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:04.497204 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-17e8f18f-2e79-450e-876f-20897d95f40e tempest-SecurityGroupRulesTestJSON-1076849469 tempest-SecurityGroupRulesTestJSON-1076849469-project] Action: 'create', calling method: .version_select at 0x7fb227d96670>, body: {"security_group_rule": {"parent_group_id": "bbcb983e-f139-40f5-b5ec-148471faa6ad", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:38:04.543725 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-8abc052b-a37f-4b33-8218-123257b381ac tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:04.573409 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-8abc052b-a37f-4b33-8218-123257b381ac tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/d85af512-1b1f-42a4-9bb1-963cc956c9ae" status: 200 len: 1476 microversion: 2.1 time: 1.952053 Oct 04 18:38:04.574551 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 854/1859] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:02 2022] GET /compute/v2.1/servers/d85af512-1b1f-42a4-9bb1-963cc956c9ae => generated 1476 bytes in 1974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:04.580029 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-9b016256-ca8c-4150-9f0e-ae9ac6d747d7 req-4152121f-2724-48ef-a227-5d3385c30560 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4231fdff-39dd-49a6-bea2-5edea44c3582", "name": "network-vif-deleted", "tag": "ee13bc47-8284-46ee-acc8-f29243243bf5"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:38:04.628319 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-9b016256-ca8c-4150-9f0e-ae9ac6d747d7 req-4152121f-2724-48ef-a227-5d3385c30560 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:04.634352 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-9b016256-ca8c-4150-9f0e-ae9ac6d747d7 req-4152121f-2724-48ef-a227-5d3385c30560 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:04.635531 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-9b016256-ca8c-4150-9f0e-ae9ac6d747d7 req-4152121f-2724-48ef-a227-5d3385c30560 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:04.680451 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-9b016256-ca8c-4150-9f0e-ae9ac6d747d7 req-4152121f-2724-48ef-a227-5d3385c30560 service nova] Creating event network-vif-deleted:ee13bc47-8284-46ee-acc8-f29243243bf5 for instance 4231fdff-39dd-49a6-bea2-5edea44c3582 on n-h1-851028-13 Oct 04 18:38:04.691553 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-9b016256-ca8c-4150-9f0e-ae9ac6d747d7 req-4152121f-2724-48ef-a227-5d3385c30560 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115137 Oct 04 18:38:04.694118 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 855/1860] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:38:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:38:04.706439 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-c2fd2fc0-2afa-464d-843f-5e15653a3ac0 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:04.710133 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-c2fd2fc0-2afa-464d-843f-5e15653a3ac0 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] [instance: 6eb9c803-dd97-4af5-b0d0-aa6fc18f8a89] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:04.725071 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c2fd2fc0-2afa-464d-843f-5e15653a3ac0 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:04.725910 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c2fd2fc0-2afa-464d-843f-5e15653a3ac0 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:04.731853 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c2fd2fc0-2afa-464d-843f-5e15653a3ac0 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:04.732864 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c2fd2fc0-2afa-464d-843f-5e15653a3ac0 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:04.733587 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c2fd2fc0-2afa-464d-843f-5e15653a3ac0 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:04.734189 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c2fd2fc0-2afa-464d-843f-5e15653a3ac0 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:05.063950 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-c2fd2fc0-2afa-464d-843f-5e15653a3ac0 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e30c6d7042ca444a86e2260692ea048e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c54096058d4c9a8ea436329e25ecbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:05.075557 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-c2fd2fc0-2afa-464d-843f-5e15653a3ac0 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] 10.222.0.43 "GET /compute/v2.1/servers/6eb9c803-dd97-4af5-b0d0-aa6fc18f8a89" status: 200 len: 1270 microversion: 2.1 time: 0.379900 Oct 04 18:38:05.079086 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 856/1861] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:04 2022] GET /compute/v2.1/servers/6eb9c803-dd97-4af5-b0d0-aa6fc18f8a89 => generated 1270 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:05.478679 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-17e8f18f-2e79-450e-876f-20897d95f40e tempest-SecurityGroupRulesTestJSON-1076849469 tempest-SecurityGroupRulesTestJSON-1076849469-project] 10.222.0.43 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.995210 Oct 04 18:38:05.479325 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1006/1862] 10.222.0.43 () {60 vars in 1195 bytes} [Tue Oct 4 18:38:04 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:38:05.492498 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-bac37e33-531f-4403-81e2-537eaf2e0fc2 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:05.498044 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-7f32f96d-b885-474a-81dc-3f1126829748 tempest-SecurityGroupRulesTestJSON-1076849469 tempest-SecurityGroupRulesTestJSON-1076849469-project] Action: 'create', calling method: .version_select at 0x7fb21f176ca0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-856853352", "description": "tempest-description-1637886380"}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:38:05.500679 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-bac37e33-531f-4403-81e2-537eaf2e0fc2 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] [instance: 4231fdff-39dd-49a6-bea2-5edea44c3582] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:05.527730 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bac37e33-531f-4403-81e2-537eaf2e0fc2 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:05.528239 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bac37e33-531f-4403-81e2-537eaf2e0fc2 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:05.529187 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bac37e33-531f-4403-81e2-537eaf2e0fc2 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:05.529455 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bac37e33-531f-4403-81e2-537eaf2e0fc2 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:05.529921 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bac37e33-531f-4403-81e2-537eaf2e0fc2 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:05.544778 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bac37e33-531f-4403-81e2-537eaf2e0fc2 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:05.591580 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-bac37e33-531f-4403-81e2-537eaf2e0fc2 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] HTTP exception thrown: Instance 4231fdff-39dd-49a6-bea2-5edea44c3582 could not be found. Oct 04 18:38:05.597836 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-bac37e33-531f-4403-81e2-537eaf2e0fc2 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Request method failure captured: Oct 04 18:38:05.597836 n-d-851028-13 devstack@n-api.service[123595]: request: GET /compute/v2.1/servers/4231fdff-39dd-49a6-bea2-5edea44c3582 HTTP/1.1 Oct 04 18:38:05.597836 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 18:38:05.597836 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 18:38:05.597836 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 18:38:05.597836 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 0 Oct 04 18:38:05.597836 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 18:38:05.597836 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 18:38:05.597836 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 18:38:05.597836 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 18:38:05.597836 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPH0hO_Ym2aLHAuk9rkBKg3C9YkagtqYC-rp7fMGd1weqaGssGyw08BqfU3pT_Y_hZLBo9ZzyE6BELs39RFtTAFUidzm6wwU42rAJzEyj8cCVUCsmjPcm1Fgx9u-MawhbeNr7VvrF2c4V4-Rrr5VP9VBPa6pSXjPPC4YiU4wUEOO-Voc Oct 04 18:38:05.597836 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 18:38:05.597836 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 18:38:05.597836 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 18:38:05.597836 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 18:38:05.597836 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 18:38:05.597836 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 18:38:05.597836 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: 3b194743a4124bdba97895542273859a Oct 04 18:38:05.597836 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-ImagesOneServerTestJSON-2102952989 Oct 04 18:38:05.597836 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 18:38:05.597836 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 18:38:05.597836 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/3b194743a4124bdba97895542273859a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_3b194743a4124bdba97895542273859a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/3b194743a4124bdba97895542273859a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/3b194743a4124bdba97895542273859a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:38:05.597836 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-ImagesOneServerTestJSON-2102952989 Oct 04 18:38:05.597836 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: 3b194743a4124bdba97895542273859a Oct 04 18:38:05.597836 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-2102952989 Oct 04 18:38:05.597836 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-ImagesOneServerTestJSON-2102952989-project Oct 04 18:38:05.597836 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 18:38:05.597836 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 18:38:05.597836 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: 1e8046c7965b473e9f7d31be9d6f6937 Oct 04 18:38:05.597836 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-ImagesOneServerTestJSON-2102952989-project Oct 04 18:38:05.597836 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 18:38:05.597836 n-d-851028-13 devstack@n-api.service[123595]: exception: Instance 4231fdff-39dd-49a6-bea2-5edea44c3582 could not be found. Oct 04 18:38:05.597836 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': '4231fdff-39dd-49a6-bea2-5edea44c3582'} Oct 04 18:38:05.597836 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:38:05.597836 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:38:05.597836 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:38:05.597836 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:38:05.597836 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:38:05.597836 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:38:05.597836 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:38:05.597836 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:38:05.597836 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:38:05.597836 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:38:05.597836 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4231fdff-39dd-49a6-bea2-5edea44c3582 could not be found. Oct 04 18:38:05.597836 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:38:05.597836 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:38:05.597836 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:38:05.597836 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:38:05.597836 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:38:05.597836 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:38:05.597836 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:38:05.597836 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:38:05.597836 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:38:05.597836 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:38:05.597836 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:38:05.597836 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:38:05.597836 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:38:05.597836 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:38:05.597836 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:38:05.597836 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:38:05.597836 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4231fdff-39dd-49a6-bea2-5edea44c3582 could not be found. Oct 04 18:38:05.597836 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:38:05.597836 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:38:05.597836 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:38:05.603788 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:38:05.603788 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:38:05.603788 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:38:05.603788 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:38:05.603788 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:38:05.603788 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4231fdff-39dd-49a6-bea2-5edea44c3582 could not be found. Oct 04 18:38:05.603788 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:38:05.603788 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-bac37e33-531f-4403-81e2-537eaf2e0fc2 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] Returning 404 to user: Instance 4231fdff-39dd-49a6-bea2-5edea44c3582 could not be found. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:38:05.603788 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-bac37e33-531f-4403-81e2-537eaf2e0fc2 tempest-ImagesOneServerTestJSON-2102952989 tempest-ImagesOneServerTestJSON-2102952989-project] 10.222.0.43 "GET /compute/v2.1/servers/4231fdff-39dd-49a6-bea2-5edea44c3582" status: 404 len: 111 microversion: 2.1 time: 0.110898 Oct 04 18:38:05.631203 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 857/1863] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:05 2022] GET /compute/v2.1/servers/4231fdff-39dd-49a6-bea2-5edea44c3582 => generated 111 bytes in 143 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:38:05.670132 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-1a515a21-fbb5-436d-8051-e469fe463fae tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:05.677617 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-1a515a21-fbb5-436d-8051-e469fe463fae tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: d85af512-1b1f-42a4-9bb1-963cc956c9ae] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:05.722667 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1a515a21-fbb5-436d-8051-e469fe463fae tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:05.723380 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1a515a21-fbb5-436d-8051-e469fe463fae tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:05.725222 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1a515a21-fbb5-436d-8051-e469fe463fae tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:05.728421 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1a515a21-fbb5-436d-8051-e469fe463fae tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:05.735704 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1a515a21-fbb5-436d-8051-e469fe463fae tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:05.739932 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1a515a21-fbb5-436d-8051-e469fe463fae tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:06.256502 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-1a515a21-fbb5-436d-8051-e469fe463fae tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:06.295707 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-1a515a21-fbb5-436d-8051-e469fe463fae tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/d85af512-1b1f-42a4-9bb1-963cc956c9ae" status: 200 len: 1476 microversion: 2.1 time: 0.646215 Oct 04 18:38:06.299219 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 858/1864] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:05 2022] GET /compute/v2.1/servers/d85af512-1b1f-42a4-9bb1-963cc956c9ae => generated 1476 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:06.345544 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-8f6a4e3c-15ad-4e9c-88a3-9161b1b14c5d tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:06.349103 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-8f6a4e3c-15ad-4e9c-88a3-9161b1b14c5d tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] [instance: 6eb9c803-dd97-4af5-b0d0-aa6fc18f8a89] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:06.366016 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8f6a4e3c-15ad-4e9c-88a3-9161b1b14c5d tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:06.367135 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8f6a4e3c-15ad-4e9c-88a3-9161b1b14c5d tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:06.368508 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8f6a4e3c-15ad-4e9c-88a3-9161b1b14c5d tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:06.370307 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8f6a4e3c-15ad-4e9c-88a3-9161b1b14c5d tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:06.375419 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8f6a4e3c-15ad-4e9c-88a3-9161b1b14c5d tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:06.376335 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8f6a4e3c-15ad-4e9c-88a3-9161b1b14c5d tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:06.413201 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-7f32f96d-b885-474a-81dc-3f1126829748 tempest-SecurityGroupRulesTestJSON-1076849469 tempest-SecurityGroupRulesTestJSON-1076849469-project] 10.222.0.43 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.917302 Oct 04 18:38:06.414315 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1007/1865] 10.222.0.43 () {60 vars in 1180 bytes} [Tue Oct 4 18:38:05 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:38:06.453742 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-ebaff14e-0fd8-4d12-9afe-e0b4fec562f6 tempest-SecurityGroupRulesTestJSON-1076849469 tempest-SecurityGroupRulesTestJSON-1076849469-project] Action: 'create', calling method: .version_select at 0x7fb21f100040>, body: {"security_group_rule": {"parent_group_id": "a35be54b-b345-49e1-a5a9-a53f2a9bde2f", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:38:06.746563 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-8f6a4e3c-15ad-4e9c-88a3-9161b1b14c5d tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e30c6d7042ca444a86e2260692ea048e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c54096058d4c9a8ea436329e25ecbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:06.761279 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-8f6a4e3c-15ad-4e9c-88a3-9161b1b14c5d tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] 10.222.0.43 "GET /compute/v2.1/servers/6eb9c803-dd97-4af5-b0d0-aa6fc18f8a89" status: 200 len: 1276 microversion: 2.1 time: 0.456515 Oct 04 18:38:06.762095 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 859/1866] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:06 2022] GET /compute/v2.1/servers/6eb9c803-dd97-4af5-b0d0-aa6fc18f8a89 => generated 1276 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:07.327905 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-28be460d-293b-47c4-93db-ac45a63ad8a9 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:07.328539 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-28be460d-293b-47c4-93db-ac45a63ad8a9 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: d85af512-1b1f-42a4-9bb1-963cc956c9ae] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:07.337324 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-28be460d-293b-47c4-93db-ac45a63ad8a9 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:07.337829 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-28be460d-293b-47c4-93db-ac45a63ad8a9 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:07.338276 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-28be460d-293b-47c4-93db-ac45a63ad8a9 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:07.338996 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-28be460d-293b-47c4-93db-ac45a63ad8a9 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:07.339456 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-28be460d-293b-47c4-93db-ac45a63ad8a9 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:07.339888 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-28be460d-293b-47c4-93db-ac45a63ad8a9 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:08.230882 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-ebaff14e-0fd8-4d12-9afe-e0b4fec562f6 tempest-SecurityGroupRulesTestJSON-1076849469 tempest-SecurityGroupRulesTestJSON-1076849469-project] 10.222.0.43 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 1.806587 Oct 04 18:38:08.233263 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1008/1867] 10.222.0.43 () {60 vars in 1195 bytes} [Tue Oct 4 18:38:06 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 1810 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:38:08.244194 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-32c21282-5d6b-44dc-b3c2-611e2f9cef18 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:08.245898 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-32c21282-5d6b-44dc-b3c2-611e2f9cef18 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] [instance: 6eb9c803-dd97-4af5-b0d0-aa6fc18f8a89] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:08.258086 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-32c21282-5d6b-44dc-b3c2-611e2f9cef18 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:08.258747 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-32c21282-5d6b-44dc-b3c2-611e2f9cef18 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:08.259545 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-32c21282-5d6b-44dc-b3c2-611e2f9cef18 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:08.266716 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-32c21282-5d6b-44dc-b3c2-611e2f9cef18 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:08.268067 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-32c21282-5d6b-44dc-b3c2-611e2f9cef18 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:08.268758 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-32c21282-5d6b-44dc-b3c2-611e2f9cef18 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:08.500386 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-32c21282-5d6b-44dc-b3c2-611e2f9cef18 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e30c6d7042ca444a86e2260692ea048e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c54096058d4c9a8ea436329e25ecbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:08.532923 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-32c21282-5d6b-44dc-b3c2-611e2f9cef18 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] 10.222.0.43 "GET /compute/v2.1/servers/6eb9c803-dd97-4af5-b0d0-aa6fc18f8a89" status: 200 len: 1276 microversion: 2.1 time: 0.296680 Oct 04 18:38:08.535975 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1009/1868] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:08 2022] GET /compute/v2.1/servers/6eb9c803-dd97-4af5-b0d0-aa6fc18f8a89 => generated 1276 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:08.585967 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-5ba8eb40-ff39-4178-b5a9-fccdf269c587 tempest-SecurityGroupRulesTestJSON-1076849469 tempest-SecurityGroupRulesTestJSON-1076849469-project] Action: 'create', calling method: .version_select at 0x7fb21f1004c0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-714011549", "description": "tempest-description-986507819"}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:38:09.082392 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-28be460d-293b-47c4-93db-ac45a63ad8a9 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:09.099654 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-28be460d-293b-47c4-93db-ac45a63ad8a9 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/d85af512-1b1f-42a4-9bb1-963cc956c9ae" status: 200 len: 1476 microversion: 2.1 time: 1.775548 Oct 04 18:38:09.102076 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 860/1869] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:07 2022] GET /compute/v2.1/servers/d85af512-1b1f-42a4-9bb1-963cc956c9ae => generated 1476 bytes in 1778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:38:09.578645 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-46a5ab01-5692-40c4-8c9f-dc1925728c72 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:09.579282 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-46a5ab01-5692-40c4-8c9f-dc1925728c72 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] [instance: 6eb9c803-dd97-4af5-b0d0-aa6fc18f8a89] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:09.615341 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-46a5ab01-5692-40c4-8c9f-dc1925728c72 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:09.616314 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-46a5ab01-5692-40c4-8c9f-dc1925728c72 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:09.630096 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-46a5ab01-5692-40c4-8c9f-dc1925728c72 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:09.631722 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-46a5ab01-5692-40c4-8c9f-dc1925728c72 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:09.633871 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-46a5ab01-5692-40c4-8c9f-dc1925728c72 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:09.636829 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-46a5ab01-5692-40c4-8c9f-dc1925728c72 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:09.988783 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-5ba8eb40-ff39-4178-b5a9-fccdf269c587 tempest-SecurityGroupRulesTestJSON-1076849469 tempest-SecurityGroupRulesTestJSON-1076849469-project] 10.222.0.43 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 1.450284 Oct 04 18:38:09.989712 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1010/1870] 10.222.0.43 () {60 vars in 1180 bytes} [Tue Oct 4 18:38:08 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 1453 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:38:10.488212 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-beb59e05-550d-4601-a36f-7eec5ec13a98 tempest-KeyPairsNegativeTestJSON-2110627829 tempest-KeyPairsNegativeTestJSON-2110627829-project] Action: 'create', calling method: .version_select at 0x7fb21f176040>, body: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBExNCnYyxPSLTJeI/lrZR7Aow+oAY8NvKXk2DNCAzed2VmgOFD1h4avGD/bETT+DeZtODv+3XfQyx+b/mH4WI+DDTokr8/2U5cfT05aPLXbUUA0llYv+7SVP9c7GejLfCg=="}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:38:10.492896 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-beb59e05-550d-4601-a36f-7eec5ec13a98 tempest-KeyPairsNegativeTestJSON-2110627829 tempest-KeyPairsNegativeTestJSON-2110627829-project] Request method failure captured: Oct 04 18:38:10.492896 n-d-851028-13 devstack@n-api.service[123596]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 04 18:38:10.492896 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:38:10.492896 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:38:10.492896 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:38:10.492896 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 257 Oct 04 18:38:10.492896 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:38:10.492896 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:38:10.492896 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:38:10.492896 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:38:10.492896 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPH2R4Ueuv7zhRrsdhvA_ge9R5YEym6G-6Fr-DspQUgms7wIOP7PdrZGYNQ0-Pd05_dgJlyiu99McSfb9-QCz0dJn7rjMfkGQ-Z1tOLLNK6KyHmHp8sM7xFM2EkWMLsmw0L03eEe6c8yCVgFTjqJWH2oZ1h_xso5od6P1r8b-WL4r920 Oct 04 18:38:10.492896 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:38:10.492896 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:38:10.492896 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:38:10.492896 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:38:10.492896 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:38:10.492896 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:38:10.492896 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: b673afb7448a42c7bd116b8947e511b7 Oct 04 18:38:10.492896 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-2110627829 Oct 04 18:38:10.492896 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 18:38:10.492896 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 18:38:10.492896 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/b673afb7448a42c7bd116b8947e511b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_b673afb7448a42c7bd116b8947e511b7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b673afb7448a42c7bd116b8947e511b7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b673afb7448a42c7bd116b8947e511b7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:38:10.492896 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-KeyPairsNegativeTestJSON-2110627829 Oct 04 18:38:10.492896 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: b673afb7448a42c7bd116b8947e511b7 Oct 04 18:38:10.492896 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-2110627829 Oct 04 18:38:10.492896 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-KeyPairsNegativeTestJSON-2110627829-project Oct 04 18:38:10.492896 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:38:10.492896 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:38:10.492896 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 4984a677b0044c01a44e6656eea65dc8 Oct 04 18:38:10.492896 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-KeyPairsNegativeTestJSON-2110627829-project Oct 04 18:38:10.492896 n-d-851028-13 devstack@n-api.service[123596]: Oct 04 18:38:10.492896 n-d-851028-13 devstack@n-api.service[123596]: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBExNCnYyxPSLTJeI/lrZR7Aow+oAY8NvKXk2DNCAzed2VmgOFD1h4avGD/bETT+DeZtODv+3XfQyx+b/mH4WI+DDTokr8/2U5cfT05aPLXbUUA0llYv+7SVP9c7GejLfCg=="}} Oct 04 18:38:10.492896 n-d-851028-13 devstack@n-api.service[123596]: method: Oct 04 18:38:10.492896 n-d-851028-13 devstack@n-api.service[123596]: exception: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 04 18:38:10.492896 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'body': {'keypair': {'name': 'key_/.\\@:', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBExNCnYyxPSLTJeI/lrZR7Aow+oAY8NvKXk2DNCAzed2VmgOFD1h4avGD/bETT+DeZtODv+3XfQyx+b/mH4WI+DDTokr8/2U5cfT05aPLXbUUA0llYv+7SVP9c7GejLfCg=='}}} Oct 04 18:38:10.492896 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:38:10.492896 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:38:10.492896 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 04 18:38:10.492896 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 04 18:38:10.492896 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 161, in _validate_keypair_name_20 Oct 04 18:38:10.492896 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return _validate_keypair_name(keypair_name, safe_chars) Oct 04 18:38:10.492896 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 175, in _validate_keypair_name Oct 04 18:38:10.492896 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.InvalidName(reason=reason) Oct 04 18:38:10.492896 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.InvalidName: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 04 18:38:10.492896 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:38:10.492896 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 04 18:38:10.492896 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:38:10.492896 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:38:10.492896 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:38:10.492896 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:38:10.492896 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:38:10.492896 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:38:10.492896 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'key_/.\\@:' is not a 'keypair_name_20' Oct 04 18:38:10.492896 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:38:10.492896 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['keypair']['properties']['name']['allOf'][1]: Oct 04 18:38:10.492896 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi {'format': 'keypair_name_20', Oct 04 18:38:10.492896 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi 'maxLength': 255, Oct 04 18:38:10.492896 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi 'minLength': 1, Oct 04 18:38:10.492896 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 04 18:38:10.492896 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:38:10.492896 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi On instance['keypair']['name']: Oct 04 18:38:10.492896 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi 'key_/.\\@:' Oct 04 18:38:10.492896 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:38:10.498453 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:38:10.498453 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:38:10.498453 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:38:10.498453 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:38:10.498453 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:38:10.498453 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:38:10.498453 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:38:10.498453 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:38:10.498453 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:38:10.498453 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:38:10.498453 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:38:10.498453 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:38:10.498453 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:38:10.498453 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 18:38:10.498453 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 18:38:10.498453 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:38:10.498453 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:38:10.498453 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:38:10.498453 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:38:10.498453 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 04 18:38:10.498453 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:38:10.498453 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:38:10.498453 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:38:10.498453 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:38:10.498453 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:38:10.498453 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:38:10.498453 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:38:10.498453 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:38:10.498453 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 04 18:38:10.498453 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:38:10.501516 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-beb59e05-550d-4601-a36f-7eec5ec13a98 tempest-KeyPairsNegativeTestJSON-2110627829 tempest-KeyPairsNegativeTestJSON-2110627829-project] Returning 400 to user: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:38:10.501516 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-beb59e05-550d-4601-a36f-7eec5ec13a98 tempest-KeyPairsNegativeTestJSON-2110627829 tempest-KeyPairsNegativeTestJSON-2110627829-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 400 len: 193 microversion: 2.1 time: 0.509886 Oct 04 18:38:10.501516 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1011/1871] 10.222.0.43 () {60 vars in 1159 bytes} [Tue Oct 4 18:38:09 2022] POST /compute/v2.1/os-keypairs => generated 193 bytes in 511 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:38:10.819553 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-46a5ab01-5692-40c4-8c9f-dc1925728c72 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e30c6d7042ca444a86e2260692ea048e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c54096058d4c9a8ea436329e25ecbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:10.829151 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-46a5ab01-5692-40c4-8c9f-dc1925728c72 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] 10.222.0.43 "GET /compute/v2.1/servers/6eb9c803-dd97-4af5-b0d0-aa6fc18f8a89" status: 200 len: 1276 microversion: 2.1 time: 1.268092 Oct 04 18:38:10.832252 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 861/1872] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:09 2022] GET /compute/v2.1/servers/6eb9c803-dd97-4af5-b0d0-aa6fc18f8a89 => generated 1276 bytes in 1275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:10.850211 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-2c02aa8e-fdc8-447f-a2a2-7fa8ef5011bd tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:10.857025 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-2c02aa8e-fdc8-447f-a2a2-7fa8ef5011bd tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: d85af512-1b1f-42a4-9bb1-963cc956c9ae] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:10.873851 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2c02aa8e-fdc8-447f-a2a2-7fa8ef5011bd tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:10.874467 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2c02aa8e-fdc8-447f-a2a2-7fa8ef5011bd tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:10.874995 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2c02aa8e-fdc8-447f-a2a2-7fa8ef5011bd tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:10.875821 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2c02aa8e-fdc8-447f-a2a2-7fa8ef5011bd tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:10.877845 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2c02aa8e-fdc8-447f-a2a2-7fa8ef5011bd tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:10.879351 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2c02aa8e-fdc8-447f-a2a2-7fa8ef5011bd tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:10.930625 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-60822ef1-c1a3-4f4f-b152-ecdade65f2f3 tempest-SecurityGroupRulesTestJSON-1076849469 tempest-SecurityGroupRulesTestJSON-1076849469-project] Action: 'create', calling method: .version_select at 0x7fb224690e50>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-283581406", "description": "tempest-description-2023951258"}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:38:11.036087 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=2 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:38:11.394336 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-2c02aa8e-fdc8-447f-a2a2-7fa8ef5011bd tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:11.413876 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-2c02aa8e-fdc8-447f-a2a2-7fa8ef5011bd tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/d85af512-1b1f-42a4-9bb1-963cc956c9ae" status: 200 len: 1476 microversion: 2.1 time: 0.575221 Oct 04 18:38:11.416736 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 862/1873] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:10 2022] GET /compute/v2.1/servers/d85af512-1b1f-42a4-9bb1-963cc956c9ae => generated 1476 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:11.433288 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-9c9f2971-edf6-4e89-876d-db2da97c291f tempest-KeyPairsNegativeTestJSON-2110627829 tempest-KeyPairsNegativeTestJSON-2110627829-project] Action: 'create', calling method: .version_select at 0x7fb21fa3f550>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1975142615", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:38:11.477480 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-9c9f2971-edf6-4e89-876d-db2da97c291f tempest-KeyPairsNegativeTestJSON-2110627829 tempest-KeyPairsNegativeTestJSON-2110627829-project] Getting quotas for project b673afb7448a42c7bd116b8947e511b7. Resources: {'key_pairs'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:38:11.498192 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-9c9f2971-edf6-4e89-876d-db2da97c291f tempest-KeyPairsNegativeTestJSON-2110627829 tempest-KeyPairsNegativeTestJSON-2110627829-project] Getting quotas for user 4984a677b0044c01a44e6656eea65dc8 and project b673afb7448a42c7bd116b8947e511b7. Resources: {'key_pairs'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:38:11.532778 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-9c9f2971-edf6-4e89-876d-db2da97c291f tempest-KeyPairsNegativeTestJSON-2110627829 tempest-KeyPairsNegativeTestJSON-2110627829-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 04 18:38:11.560060 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-9c9f2971-edf6-4e89-876d-db2da97c291f tempest-KeyPairsNegativeTestJSON-2110627829 tempest-KeyPairsNegativeTestJSON-2110627829-project] Request method failure captured: Oct 04 18:38:11.560060 n-d-851028-13 devstack@n-api.service[123595]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 04 18:38:11.560060 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 18:38:11.560060 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 18:38:11.560060 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 18:38:11.560060 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 2167 Oct 04 18:38:11.560060 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 18:38:11.560060 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 18:38:11.560060 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 18:38:11.560060 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 18:38:11.560060 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPH2R4Ueuv7zhRrsdhvA_ge9R5YEym6G-6Fr-DspQUgms7wIOP7PdrZGYNQ0-Pd05_dgJlyiu99McSfb9-QCz0dJn7rjMfkGQ-Z1tOLLNK6KyHmHp8sM7xFM2EkWMLsmw0L03eEe6c8yCVgFTjqJWH2oZ1h_xso5od6P1r8b-WL4r920 Oct 04 18:38:11.560060 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 18:38:11.560060 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 18:38:11.560060 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 18:38:11.560060 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 18:38:11.560060 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 18:38:11.560060 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 18:38:11.560060 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: b673afb7448a42c7bd116b8947e511b7 Oct 04 18:38:11.560060 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-2110627829 Oct 04 18:38:11.560060 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 18:38:11.560060 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 18:38:11.560060 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/b673afb7448a42c7bd116b8947e511b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_b673afb7448a42c7bd116b8947e511b7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b673afb7448a42c7bd116b8947e511b7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b673afb7448a42c7bd116b8947e511b7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:38:11.560060 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-KeyPairsNegativeTestJSON-2110627829 Oct 04 18:38:11.560060 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: b673afb7448a42c7bd116b8947e511b7 Oct 04 18:38:11.560060 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-2110627829 Oct 04 18:38:11.560060 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-KeyPairsNegativeTestJSON-2110627829-project Oct 04 18:38:11.560060 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 18:38:11.560060 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 18:38:11.560060 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: 4984a677b0044c01a44e6656eea65dc8 Oct 04 18:38:11.560060 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-KeyPairsNegativeTestJSON-2110627829-project Oct 04 18:38:11.560060 n-d-851028-13 devstack@n-api.service[123595]: Oct 04 18:38:11.560060 n-d-851028-13 devstack@n-api.service[123595]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1975142615", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} Oct 04 18:38:11.560060 n-d-851028-13 devstack@n-api.service[123595]: method: Oct 04 18:38:11.560060 n-d-851028-13 devstack@n-api.service[123595]: exception: Keypair data is invalid: failed to generate fingerprint Oct 04 18:38:11.562950 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1975142615', 'public_key': 'ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu'}}} Oct 04 18:38:11.562950 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:38:11.562950 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:38:11.562950 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 04 18:38:11.562950 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 04 18:38:11.562950 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 666, in load_ssh_public_key Oct 04 18:38:11.562950 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid key format") Oct 04 18:38:11.562950 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi ValueError: Invalid key format Oct 04 18:38:11.562950 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:38:11.562950 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:38:11.562950 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:38:11.562950 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:38:11.562950 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 04 18:38:11.562950 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 04 18:38:11.562950 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 04 18:38:11.562950 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 04 18:38:11.562950 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:38:11.562950 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:38:11.562950 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:38:11.562950 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:38:11.562950 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 04 18:38:11.562950 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 04 18:38:11.562950 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Oct 04 18:38:11.562950 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 04 18:38:11.562950 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Oct 04 18:38:11.562950 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 04 18:38:11.562950 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 04 18:38:11.562950 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 04 18:38:11.562950 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 04 18:38:11.562950 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:38:11.562950 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:38:11.562950 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:38:11.562950 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:38:11.562950 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:38:11.562950 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:38:11.562950 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:38:11.562950 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:38:11.562950 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:38:11.562950 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:38:11.562950 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:38:11.562950 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:38:11.566183 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:38:11.566183 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:38:11.566183 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:38:11.566183 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:38:11.566183 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 04 18:38:11.566183 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 04 18:38:11.566183 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 04 18:38:11.566183 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 04 18:38:11.566183 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 04 18:38:11.566183 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:38:11.566183 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:38:11.566183 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:38:11.566183 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:38:11.566183 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:38:11.566183 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:38:11.566183 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:38:11.566183 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:38:11.566183 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 04 18:38:11.566183 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:38:11.566183 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-9c9f2971-edf6-4e89-876d-db2da97c291f tempest-KeyPairsNegativeTestJSON-2110627829 tempest-KeyPairsNegativeTestJSON-2110627829-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:38:11.566183 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-9c9f2971-edf6-4e89-876d-db2da97c291f tempest-KeyPairsNegativeTestJSON-2110627829 tempest-KeyPairsNegativeTestJSON-2110627829-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.144301 Oct 04 18:38:11.566183 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 863/1874] 10.222.0.43 () {60 vars in 1160 bytes} [Tue Oct 4 18:38:11 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 146 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 04 18:38:11.578888 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-a34d37f7-c00b-4baf-99fa-96073b09b076 tempest-KeyPairsNegativeTestJSON-2110627829 tempest-KeyPairsNegativeTestJSON-2110627829-project] Action: 'create', calling method: .version_select at 0x7fb21fd1faf0>, body: {"keypair": {"name": "tempest-keypair-599458889", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLhtA/74cBiI1mDGjeVPCEL8cQFq4cQtl6iCjwMTHT1J9NWVRN/ZIDJ4A/PhXnVKhvHI4rfd9g3GyfKZIXOJUHO+e8XX7Yj/etac+zi/o3qavPwNW0qME5X0tmXBWhK1Yg=="}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:38:11.615383 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-a34d37f7-c00b-4baf-99fa-96073b09b076 tempest-KeyPairsNegativeTestJSON-2110627829 tempest-KeyPairsNegativeTestJSON-2110627829-project] Getting quotas for project b673afb7448a42c7bd116b8947e511b7. Resources: {'key_pairs'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:38:11.619420 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-a34d37f7-c00b-4baf-99fa-96073b09b076 tempest-KeyPairsNegativeTestJSON-2110627829 tempest-KeyPairsNegativeTestJSON-2110627829-project] Getting quotas for user 4984a677b0044c01a44e6656eea65dc8 and project b673afb7448a42c7bd116b8947e511b7. Resources: {'key_pairs'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:38:11.661273 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-a34d37f7-c00b-4baf-99fa-96073b09b076 tempest-KeyPairsNegativeTestJSON-2110627829 tempest-KeyPairsNegativeTestJSON-2110627829-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.088420 Oct 04 18:38:11.662485 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 864/1875] 10.222.0.43 () {60 vars in 1159 bytes} [Tue Oct 4 18:38:11 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:38:11.679963 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-54c25984-a574-46b5-8d4d-1abbb9234e11 tempest-KeyPairsNegativeTestJSON-2110627829 tempest-KeyPairsNegativeTestJSON-2110627829-project] Action: 'create', calling method: .version_select at 0x7fb21fc6ad30>, body: {"keypair": {"name": "tempest-keypair-599458889", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH6IXkXG/o5ROP/ClQANTpYbDfZmM58uqFtEh/6bQQtct6l8AUyHJc7lOL+9gyU2FiZAvpwSjuS/gje2EXpwb/R5+cZNgy7fZYsTOV6vPSr56JQDiia12gweQ7tJ7jX0/A=="}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:38:11.700205 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-54c25984-a574-46b5-8d4d-1abbb9234e11 tempest-KeyPairsNegativeTestJSON-2110627829 tempest-KeyPairsNegativeTestJSON-2110627829-project] Getting quotas for project b673afb7448a42c7bd116b8947e511b7. Resources: {'key_pairs'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:38:11.707134 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-54c25984-a574-46b5-8d4d-1abbb9234e11 tempest-KeyPairsNegativeTestJSON-2110627829 tempest-KeyPairsNegativeTestJSON-2110627829-project] Getting quotas for user 4984a677b0044c01a44e6656eea65dc8 and project b673afb7448a42c7bd116b8947e511b7. Resources: {'key_pairs'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:38:11.753760 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-54c25984-a574-46b5-8d4d-1abbb9234e11 tempest-KeyPairsNegativeTestJSON-2110627829 tempest-KeyPairsNegativeTestJSON-2110627829-project] HTTP exception thrown: Key pair 'tempest-keypair-599458889' already exists. Oct 04 18:38:11.767570 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-54c25984-a574-46b5-8d4d-1abbb9234e11 tempest-KeyPairsNegativeTestJSON-2110627829 tempest-KeyPairsNegativeTestJSON-2110627829-project] Request method failure captured: Oct 04 18:38:11.767570 n-d-851028-13 devstack@n-api.service[123595]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 04 18:38:11.767570 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 18:38:11.767570 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 18:38:11.767570 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 18:38:11.767570 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 272 Oct 04 18:38:11.767570 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 18:38:11.767570 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 18:38:11.767570 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 18:38:11.767570 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 18:38:11.767570 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPH2R4Ueuv7zhRrsdhvA_ge9R5YEym6G-6Fr-DspQUgms7wIOP7PdrZGYNQ0-Pd05_dgJlyiu99McSfb9-QCz0dJn7rjMfkGQ-Z1tOLLNK6KyHmHp8sM7xFM2EkWMLsmw0L03eEe6c8yCVgFTjqJWH2oZ1h_xso5od6P1r8b-WL4r920 Oct 04 18:38:11.767570 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 18:38:11.767570 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 18:38:11.767570 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 18:38:11.767570 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 18:38:11.767570 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 18:38:11.767570 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 18:38:11.767570 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: b673afb7448a42c7bd116b8947e511b7 Oct 04 18:38:11.767570 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-2110627829 Oct 04 18:38:11.767570 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 18:38:11.767570 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 18:38:11.767570 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/b673afb7448a42c7bd116b8947e511b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_b673afb7448a42c7bd116b8947e511b7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b673afb7448a42c7bd116b8947e511b7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b673afb7448a42c7bd116b8947e511b7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:38:11.767570 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-KeyPairsNegativeTestJSON-2110627829 Oct 04 18:38:11.767570 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: b673afb7448a42c7bd116b8947e511b7 Oct 04 18:38:11.767570 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-2110627829 Oct 04 18:38:11.767570 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-KeyPairsNegativeTestJSON-2110627829-project Oct 04 18:38:11.767570 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 18:38:11.767570 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 18:38:11.767570 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: 4984a677b0044c01a44e6656eea65dc8 Oct 04 18:38:11.767570 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-KeyPairsNegativeTestJSON-2110627829-project Oct 04 18:38:11.767570 n-d-851028-13 devstack@n-api.service[123595]: Oct 04 18:38:11.767570 n-d-851028-13 devstack@n-api.service[123595]: {"keypair": {"name": "tempest-keypair-599458889", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH6IXkXG/o5ROP/ClQANTpYbDfZmM58uqFtEh/6bQQtct6l8AUyHJc7lOL+9gyU2FiZAvpwSjuS/gje2EXpwb/R5+cZNgy7fZYsTOV6vPSr56JQDiia12gweQ7tJ7jX0/A=="}} Oct 04 18:38:11.767570 n-d-851028-13 devstack@n-api.service[123595]: method: Oct 04 18:38:11.767570 n-d-851028-13 devstack@n-api.service[123595]: exception: Key pair 'tempest-keypair-599458889' already exists. Oct 04 18:38:11.767570 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'body': {'keypair': {'name': 'tempest-keypair-599458889', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH6IXkXG/o5ROP/ClQANTpYbDfZmM58uqFtEh/6bQQtct6l8AUyHJc7lOL+9gyU2FiZAvpwSjuS/gje2EXpwb/R5+cZNgy7fZYsTOV6vPSr56JQDiia12gweQ7tJ7jX0/A=='}}} Oct 04 18:38:11.767570 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:38:11.767570 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:38:11.767570 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 04 18:38:11.767570 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 04 18:38:11.767570 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 04 18:38:11.767570 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 04 18:38:11.767570 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 04 18:38:11.767570 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 04 18:38:11.767570 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 04 18:38:11.767570 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 04 18:38:11.767570 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 04 18:38:11.767570 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 04 18:38:11.767570 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 04 18:38:11.767570 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi result.read() Oct 04 18:38:11.767570 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 04 18:38:11.767570 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 04 18:38:11.767570 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 04 18:38:11.767570 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 04 18:38:11.767570 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 04 18:38:11.767570 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 04 18:38:11.767570 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 04 18:38:11.767570 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 04 18:38:11.767570 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '4984a677b0044c01a44e6656eea65dc8-tempest-keypair-599458889' for key 'key_pairs.uniq_key_pairs0user_id0name'") Oct 04 18:38:11.767570 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:38:11.772364 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 04 18:38:11.772364 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:38:11.772364 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:38:11.772364 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 69, in _create_in_db Oct 04 18:38:11.772364 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi kp.save(context.session) Oct 04 18:38:11.772364 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 04 18:38:11.772364 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi session.flush() Oct 04 18:38:11.772364 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 04 18:38:11.772364 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 04 18:38:11.772364 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 04 18:38:11.772364 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 04 18:38:11.772364 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 04 18:38:11.772364 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 04 18:38:11.772364 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 04 18:38:11.772364 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception Oct 04 18:38:11.772364 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 04 18:38:11.772364 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 04 18:38:11.772364 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 04 18:38:11.772364 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 04 18:38:11.772364 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 04 18:38:11.772364 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 04 18:38:11.772364 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 04 18:38:11.772364 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 04 18:38:11.772364 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 04 18:38:11.772364 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 04 18:38:11.772364 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 04 18:38:11.772364 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 04 18:38:11.772364 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 04 18:38:11.772364 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 04 18:38:11.772364 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 04 18:38:11.772364 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 04 18:38:11.772364 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 04 18:38:11.772364 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 04 18:38:11.772364 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 04 18:38:11.772364 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 04 18:38:11.772364 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 04 18:38:11.772364 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception Oct 04 18:38:11.772364 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 04 18:38:11.772364 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 04 18:38:11.772364 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 04 18:38:11.772364 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 04 18:38:11.772364 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 04 18:38:11.772364 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 04 18:38:11.772364 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 04 18:38:11.772364 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 04 18:38:11.772364 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 04 18:38:11.772364 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 04 18:38:11.772364 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 04 18:38:11.772364 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi result.read() Oct 04 18:38:11.772364 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 04 18:38:11.772364 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 04 18:38:11.772364 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 04 18:38:11.772364 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 04 18:38:11.772364 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 04 18:38:11.772364 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 04 18:38:11.772364 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 04 18:38:11.784260 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 04 18:38:11.784260 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '4984a677b0044c01a44e6656eea65dc8-tempest-keypair-599458889' for key 'key_pairs.uniq_key_pairs0user_id0name'") Oct 04 18:38:11.784260 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO key_pairs (created_at, updated_at, name, user_id, fingerprint, public_key, type) VALUES (%(created_at)s, %(updated_at)s, %(name)s, %(user_id)s, %(fingerprint)s, %(public_key)s, %(type)s)] Oct 04 18:38:11.784260 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 4, 18, 38, 11, 731676), 'updated_at': None, 'name': 'tempest-keypair-599458889', 'user_id': '4984a677b0044c01a44e6656eea65dc8', 'fingerprint': '6a:5f:69:f1:c2:1c:ba:2c:52:0f:ee:6b:c0:10:37:44', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH6IXkXG/o5ROP/ClQANTpYbDfZmM58uqFtEh/6bQQtct6l8AUyHJc7lOL+9gyU2FiZAvpwSjuS/gje2EXpwb/R5+cZNgy7fZYsTOV6vPSr56JQDiia12gweQ7tJ7jX0/A==', 'type': 'ssh'}] Oct 04 18:38:11.784260 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 04 18:38:11.784260 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:38:11.784260 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:38:11.784260 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:38:11.784260 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:38:11.784260 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 04 18:38:11.784260 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 04 18:38:11.784260 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 04 18:38:11.784260 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 04 18:38:11.784260 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:38:11.784260 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:38:11.784260 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:38:11.784260 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:38:11.784260 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 04 18:38:11.784260 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 04 18:38:11.784260 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6777, in import_key_pair Oct 04 18:38:11.784260 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi keypair.create() Oct 04 18:38:11.784260 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 04 18:38:11.784260 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 04 18:38:11.784260 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 158, in create Oct 04 18:38:11.784260 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi self._create() Oct 04 18:38:11.784260 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 162, in _create Oct 04 18:38:11.784260 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi db_keypair = self._create_in_db(self._context, updates) Oct 04 18:38:11.784260 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 134, in _create_in_db Oct 04 18:38:11.784260 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return _create_in_db(context, values) Oct 04 18:38:11.784260 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 18:38:11.784260 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 18:38:11.784260 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 71, in _create_in_db Oct 04 18:38:11.784260 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.KeyPairExists(key_name=values['name']) Oct 04 18:38:11.784260 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.KeyPairExists: Key pair 'tempest-keypair-599458889' already exists. Oct 04 18:38:11.784260 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:38:11.784260 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:38:11.784260 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:38:11.784260 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:38:11.784260 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:38:11.784260 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:38:11.784260 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:38:11.784260 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:38:11.784260 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:38:11.784260 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:38:11.784260 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:38:11.784260 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:38:11.784260 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:38:11.784260 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:38:11.784260 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:38:11.784260 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:38:11.784260 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 04 18:38:11.784260 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 04 18:38:11.784260 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 132, in _create Oct 04 18:38:11.784260 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=exc.format_message()) Oct 04 18:38:11.784260 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Key pair 'tempest-keypair-599458889' already exists. Oct 04 18:38:11.788467 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:38:11.788467 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:38:11.788467 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:38:11.788467 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:38:11.788467 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:38:11.788467 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:38:11.788467 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:38:11.788467 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:38:11.788467 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Key pair 'tempest-keypair-599458889' already exists. Oct 04 18:38:11.788467 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:38:11.788467 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-54c25984-a574-46b5-8d4d-1abbb9234e11 tempest-KeyPairsNegativeTestJSON-2110627829 tempest-KeyPairsNegativeTestJSON-2110627829-project] Returning 409 to user: Key pair 'tempest-keypair-599458889' already exists. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:38:11.788467 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-54c25984-a574-46b5-8d4d-1abbb9234e11 tempest-KeyPairsNegativeTestJSON-2110627829 tempest-KeyPairsNegativeTestJSON-2110627829-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 409 len: 104 microversion: 2.1 time: 0.099734 Oct 04 18:38:11.788467 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 865/1876] 10.222.0.43 () {60 vars in 1159 bytes} [Tue Oct 4 18:38:11 2022] POST /compute/v2.1/os-keypairs => generated 104 bytes in 101 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:38:11.788467 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-da3e1e04-fcca-4cd5-81a3-9f34bc6d3d54 tempest-KeyPairsNegativeTestJSON-2110627829 tempest-KeyPairsNegativeTestJSON-2110627829-project] Calling method '.version_select at 0x7fb21fc4f310>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:11.830682 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-da3e1e04-fcca-4cd5-81a3-9f34bc6d3d54 tempest-KeyPairsNegativeTestJSON-2110627829 tempest-KeyPairsNegativeTestJSON-2110627829-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-599458889" status: 202 len: 0 microversion: 2.1 time: 0.052462 Oct 04 18:38:11.841748 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 866/1877] 10.222.0.43 () {58 vars in 1218 bytes} [Tue Oct 4 18:38:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-599458889 => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:38:11.848766 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-d96528f0-cb36-446e-ad63-e88b736f49a1 tempest-KeyPairsNegativeTestJSON-2110627829 tempest-KeyPairsNegativeTestJSON-2110627829-project] Action: 'create', calling method: .version_select at 0x7fb21fc6ad30>, body: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCWCxWarcH/im8Zipb2LMw226evix1HvNWNIlqa2G77w0w9xXnqVOh4g8bshzYDPzWpblBbN2R8nPTKZikUhEJoPNHG/9E055kphJIvbl8nRKRqo62EkuxJGJFOt37xwtQ=="}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:38:11.855307 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-d96528f0-cb36-446e-ad63-e88b736f49a1 tempest-KeyPairsNegativeTestJSON-2110627829 tempest-KeyPairsNegativeTestJSON-2110627829-project] Request method failure captured: Oct 04 18:38:11.855307 n-d-851028-13 devstack@n-api.service[123595]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 04 18:38:11.855307 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 18:38:11.855307 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 18:38:11.855307 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 18:38:11.855307 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 247 Oct 04 18:38:11.855307 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 18:38:11.855307 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 18:38:11.855307 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 18:38:11.855307 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 18:38:11.855307 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPH2R4Ueuv7zhRrsdhvA_ge9R5YEym6G-6Fr-DspQUgms7wIOP7PdrZGYNQ0-Pd05_dgJlyiu99McSfb9-QCz0dJn7rjMfkGQ-Z1tOLLNK6KyHmHp8sM7xFM2EkWMLsmw0L03eEe6c8yCVgFTjqJWH2oZ1h_xso5od6P1r8b-WL4r920 Oct 04 18:38:11.855307 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 18:38:11.855307 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 18:38:11.855307 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 18:38:11.855307 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 18:38:11.855307 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 18:38:11.855307 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 18:38:11.855307 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: b673afb7448a42c7bd116b8947e511b7 Oct 04 18:38:11.855307 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-2110627829 Oct 04 18:38:11.855307 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 18:38:11.855307 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 18:38:11.855307 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/b673afb7448a42c7bd116b8947e511b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_b673afb7448a42c7bd116b8947e511b7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b673afb7448a42c7bd116b8947e511b7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b673afb7448a42c7bd116b8947e511b7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:38:11.855307 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-KeyPairsNegativeTestJSON-2110627829 Oct 04 18:38:11.855307 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: b673afb7448a42c7bd116b8947e511b7 Oct 04 18:38:11.855307 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-2110627829 Oct 04 18:38:11.855307 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-KeyPairsNegativeTestJSON-2110627829-project Oct 04 18:38:11.855307 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 18:38:11.855307 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 18:38:11.855307 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: 4984a677b0044c01a44e6656eea65dc8 Oct 04 18:38:11.855307 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-KeyPairsNegativeTestJSON-2110627829-project Oct 04 18:38:11.855307 n-d-851028-13 devstack@n-api.service[123595]: Oct 04 18:38:11.855307 n-d-851028-13 devstack@n-api.service[123595]: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCWCxWarcH/im8Zipb2LMw226evix1HvNWNIlqa2G77w0w9xXnqVOh4g8bshzYDPzWpblBbN2R8nPTKZikUhEJoPNHG/9E055kphJIvbl8nRKRqo62EkuxJGJFOt37xwtQ=="}} Oct 04 18:38:11.855307 n-d-851028-13 devstack@n-api.service[123595]: method: Oct 04 18:38:11.855307 n-d-851028-13 devstack@n-api.service[123595]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 04 18:38:11.855307 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'body': {'keypair': {'name': '', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCWCxWarcH/im8Zipb2LMw226evix1HvNWNIlqa2G77w0w9xXnqVOh4g8bshzYDPzWpblBbN2R8nPTKZikUhEJoPNHG/9E055kphJIvbl8nRKRqo62EkuxJGJFOt37xwtQ=='}}} Oct 04 18:38:11.855307 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:38:11.855307 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:38:11.855307 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:38:11.855307 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:38:11.855307 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:38:11.855307 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:38:11.855307 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 04 18:38:11.855307 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:38:11.855307 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Oct 04 18:38:11.855307 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 04 18:38:11.855307 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:38:11.855307 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi On instance['keypair']: Oct 04 18:38:11.855307 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi '' Oct 04 18:38:11.855307 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:38:11.855307 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:38:11.855307 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:38:11.855307 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:38:11.855307 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:38:11.855307 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:38:11.855307 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:38:11.855307 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:38:11.855307 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:38:11.855307 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:38:11.855307 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:38:11.855307 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:38:11.855307 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:38:11.855307 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:38:11.855307 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 18:38:11.855307 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 18:38:11.860563 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:38:11.860563 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:38:11.860563 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:38:11.860563 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:38:11.860563 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 04 18:38:11.860563 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:38:11.860563 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:38:11.860563 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:38:11.860563 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:38:11.860563 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:38:11.860563 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:38:11.860563 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:38:11.860563 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:38:11.860563 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 04 18:38:11.860563 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:38:11.865527 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-d96528f0-cb36-446e-ad63-e88b736f49a1 tempest-KeyPairsNegativeTestJSON-2110627829 tempest-KeyPairsNegativeTestJSON-2110627829-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:38:11.867308 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-d96528f0-cb36-446e-ad63-e88b736f49a1 tempest-KeyPairsNegativeTestJSON-2110627829 tempest-KeyPairsNegativeTestJSON-2110627829-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.023612 Oct 04 18:38:11.873314 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 867/1878] 10.222.0.43 () {60 vars in 1159 bytes} [Tue Oct 4 18:38:11 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:38:11.886608 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-36bda7e5-66c7-435a-83b3-52d880495137 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:11.887496 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-36bda7e5-66c7-435a-83b3-52d880495137 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] [instance: 6eb9c803-dd97-4af5-b0d0-aa6fc18f8a89] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:11.899653 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-36bda7e5-66c7-435a-83b3-52d880495137 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:11.899894 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-36bda7e5-66c7-435a-83b3-52d880495137 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:11.900363 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-36bda7e5-66c7-435a-83b3-52d880495137 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:11.901404 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-36bda7e5-66c7-435a-83b3-52d880495137 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:11.901869 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-36bda7e5-66c7-435a-83b3-52d880495137 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:11.902508 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-36bda7e5-66c7-435a-83b3-52d880495137 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:11.982408 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-60822ef1-c1a3-4f4f-b152-ecdade65f2f3 tempest-SecurityGroupRulesTestJSON-1076849469 tempest-SecurityGroupRulesTestJSON-1076849469-project] 10.222.0.43 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 1.478502 Oct 04 18:38:11.993199 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1012/1879] 10.222.0.43 () {60 vars in 1180 bytes} [Tue Oct 4 18:38:10 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 1491 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:38:11.999824 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-449fae16-ee05-407f-8147-b6741ed035e3 tempest-KeyPairsNegativeTestJSON-2110627829 tempest-KeyPairsNegativeTestJSON-2110627829-project] Action: 'create', calling method: .version_select at 0x7fb21f100a60>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-314758447", "public_key": " "}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:38:12.042532 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-36bda7e5-66c7-435a-83b3-52d880495137 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e30c6d7042ca444a86e2260692ea048e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c54096058d4c9a8ea436329e25ecbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:12.066991 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-36bda7e5-66c7-435a-83b3-52d880495137 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] 10.222.0.43 "GET /compute/v2.1/servers/6eb9c803-dd97-4af5-b0d0-aa6fc18f8a89" status: 200 len: 1276 microversion: 2.1 time: 0.186133 Oct 04 18:38:12.070626 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-449fae16-ee05-407f-8147-b6741ed035e3 tempest-KeyPairsNegativeTestJSON-2110627829 tempest-KeyPairsNegativeTestJSON-2110627829-project] Getting quotas for project b673afb7448a42c7bd116b8947e511b7. Resources: {'key_pairs'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:38:12.079792 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-449fae16-ee05-407f-8147-b6741ed035e3 tempest-KeyPairsNegativeTestJSON-2110627829 tempest-KeyPairsNegativeTestJSON-2110627829-project] Getting quotas for user 4984a677b0044c01a44e6656eea65dc8 and project b673afb7448a42c7bd116b8947e511b7. Resources: {'key_pairs'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:38:12.087555 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 868/1880] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:11 2022] GET /compute/v2.1/servers/6eb9c803-dd97-4af5-b0d0-aa6fc18f8a89 => generated 1276 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:12.105802 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-9bc5e800-510f-4973-9cab-064903812979 tempest-SecurityGroupRulesTestJSON-1076849469 tempest-SecurityGroupRulesTestJSON-1076849469-project] Action: 'create', calling method: .version_select at 0x7fb224485d30>, body: {"security_group_rule": {"parent_group_id": "c260fcd4-8a0b-4426-8637-b6bb824111be", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "0c2e26b9-0ccf-406d-90c8-a635688a0166"}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:38:12.138486 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-449fae16-ee05-407f-8147-b6741ed035e3 tempest-KeyPairsNegativeTestJSON-2110627829 tempest-KeyPairsNegativeTestJSON-2110627829-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 04 18:38:12.144647 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-449fae16-ee05-407f-8147-b6741ed035e3 tempest-KeyPairsNegativeTestJSON-2110627829 tempest-KeyPairsNegativeTestJSON-2110627829-project] Request method failure captured: Oct 04 18:38:12.144647 n-d-851028-13 devstack@n-api.service[123596]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 04 18:38:12.144647 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:38:12.144647 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:38:12.144647 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:38:12.144647 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 94 Oct 04 18:38:12.144647 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:38:12.144647 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:38:12.144647 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:38:12.144647 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:38:12.144647 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPH2R4Ueuv7zhRrsdhvA_ge9R5YEym6G-6Fr-DspQUgms7wIOP7PdrZGYNQ0-Pd05_dgJlyiu99McSfb9-QCz0dJn7rjMfkGQ-Z1tOLLNK6KyHmHp8sM7xFM2EkWMLsmw0L03eEe6c8yCVgFTjqJWH2oZ1h_xso5od6P1r8b-WL4r920 Oct 04 18:38:12.144647 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:38:12.144647 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:38:12.144647 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:38:12.144647 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:38:12.144647 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:38:12.144647 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:38:12.144647 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: b673afb7448a42c7bd116b8947e511b7 Oct 04 18:38:12.144647 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-2110627829 Oct 04 18:38:12.144647 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 18:38:12.144647 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 18:38:12.144647 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/b673afb7448a42c7bd116b8947e511b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_b673afb7448a42c7bd116b8947e511b7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b673afb7448a42c7bd116b8947e511b7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b673afb7448a42c7bd116b8947e511b7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:38:12.144647 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-KeyPairsNegativeTestJSON-2110627829 Oct 04 18:38:12.144647 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: b673afb7448a42c7bd116b8947e511b7 Oct 04 18:38:12.144647 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-2110627829 Oct 04 18:38:12.144647 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-KeyPairsNegativeTestJSON-2110627829-project Oct 04 18:38:12.144647 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:38:12.144647 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:38:12.144647 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 4984a677b0044c01a44e6656eea65dc8 Oct 04 18:38:12.144647 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-KeyPairsNegativeTestJSON-2110627829-project Oct 04 18:38:12.144647 n-d-851028-13 devstack@n-api.service[123596]: Oct 04 18:38:12.144647 n-d-851028-13 devstack@n-api.service[123596]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-314758447", "public_key": " "}} Oct 04 18:38:12.144647 n-d-851028-13 devstack@n-api.service[123596]: method: Oct 04 18:38:12.144647 n-d-851028-13 devstack@n-api.service[123596]: exception: Keypair data is invalid: failed to generate fingerprint Oct 04 18:38:12.144647 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-314758447', 'public_key': ' '}}} Oct 04 18:38:12.144647 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:38:12.144647 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:38:12.144647 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 04 18:38:12.144647 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 04 18:38:12.144647 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 650, in load_ssh_public_key Oct 04 18:38:12.144647 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid line format") Oct 04 18:38:12.144647 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi ValueError: Invalid line format Oct 04 18:38:12.144647 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:38:12.144647 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:38:12.144647 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:38:12.144647 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:38:12.144647 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 04 18:38:12.144647 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 04 18:38:12.144647 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 04 18:38:12.144647 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 04 18:38:12.144647 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:38:12.144647 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:38:12.144647 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:38:12.144647 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:38:12.144647 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 04 18:38:12.144647 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 04 18:38:12.144647 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Oct 04 18:38:12.144647 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 04 18:38:12.144647 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Oct 04 18:38:12.144647 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 04 18:38:12.144647 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 04 18:38:12.144647 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 04 18:38:12.144647 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 04 18:38:12.144647 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:38:12.144647 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:38:12.144647 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:38:12.150439 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:38:12.150439 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:38:12.150439 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:38:12.150439 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:38:12.150439 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:38:12.150439 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:38:12.150439 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:38:12.150439 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:38:12.150439 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:38:12.150439 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:38:12.150439 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:38:12.150439 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:38:12.150439 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:38:12.150439 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 04 18:38:12.150439 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 04 18:38:12.150439 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 04 18:38:12.150439 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 04 18:38:12.150439 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 04 18:38:12.150439 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:38:12.150439 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:38:12.150439 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:38:12.150439 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:38:12.150439 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:38:12.150439 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:38:12.150439 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:38:12.150439 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:38:12.150439 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 04 18:38:12.150439 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:38:12.158272 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-449fae16-ee05-407f-8147-b6741ed035e3 tempest-KeyPairsNegativeTestJSON-2110627829 tempest-KeyPairsNegativeTestJSON-2110627829-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:38:12.161924 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-449fae16-ee05-407f-8147-b6741ed035e3 tempest-KeyPairsNegativeTestJSON-2110627829 tempest-KeyPairsNegativeTestJSON-2110627829-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.166765 Oct 04 18:38:12.163596 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1013/1881] 10.222.0.43 () {60 vars in 1158 bytes} [Tue Oct 4 18:38:11 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 169 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 04 18:38:12.180396 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-7562a1eb-c55d-4702-a30b-41eb7ccece3a tempest-KeyPairsNegativeTestJSON-2110627829 tempest-KeyPairsNegativeTestJSON-2110627829-project] Action: 'create', calling method: .version_select at 0x7fb21f100160>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBjEL6FaKHsp8PlDoIf19598uKho04BOHl8TllfMcoiYv+Z9+qSoea5bvurrn2n6EeWhC9bjpdX3vL2PxVEUdCYm7TwXWf1/mtOoJfcNZSrUpP4fdQkZTCqZPwx9tjVzVA=="}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:38:12.195976 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-7562a1eb-c55d-4702-a30b-41eb7ccece3a tempest-KeyPairsNegativeTestJSON-2110627829 tempest-KeyPairsNegativeTestJSON-2110627829-project] Request method failure captured: Oct 04 18:38:12.195976 n-d-851028-13 devstack@n-api.service[123596]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 04 18:38:12.195976 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:38:12.195976 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:38:12.195976 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:38:12.195976 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 507 Oct 04 18:38:12.195976 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:38:12.195976 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:38:12.195976 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:38:12.195976 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:38:12.195976 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPH2R4Ueuv7zhRrsdhvA_ge9R5YEym6G-6Fr-DspQUgms7wIOP7PdrZGYNQ0-Pd05_dgJlyiu99McSfb9-QCz0dJn7rjMfkGQ-Z1tOLLNK6KyHmHp8sM7xFM2EkWMLsmw0L03eEe6c8yCVgFTjqJWH2oZ1h_xso5od6P1r8b-WL4r920 Oct 04 18:38:12.195976 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:38:12.195976 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:38:12.195976 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:38:12.195976 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:38:12.195976 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:38:12.195976 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:38:12.195976 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: b673afb7448a42c7bd116b8947e511b7 Oct 04 18:38:12.195976 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-2110627829 Oct 04 18:38:12.195976 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 18:38:12.195976 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 18:38:12.195976 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/b673afb7448a42c7bd116b8947e511b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_b673afb7448a42c7bd116b8947e511b7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b673afb7448a42c7bd116b8947e511b7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b673afb7448a42c7bd116b8947e511b7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:38:12.195976 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-KeyPairsNegativeTestJSON-2110627829 Oct 04 18:38:12.195976 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: b673afb7448a42c7bd116b8947e511b7 Oct 04 18:38:12.195976 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-2110627829 Oct 04 18:38:12.195976 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-KeyPairsNegativeTestJSON-2110627829-project Oct 04 18:38:12.195976 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:38:12.195976 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:38:12.195976 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 4984a677b0044c01a44e6656eea65dc8 Oct 04 18:38:12.195976 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-KeyPairsNegativeTestJSON-2110627829-project Oct 04 18:38:12.195976 n-d-851028-13 devstack@n-api.service[123596]: Oct 04 18:38:12.195976 n-d-851028-13 devstack@n-api.service[123596]: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBjEL6FaKHsp8PlDoIf19598uKho04BOHl8TllfMcoiYv+Z9+qSoea5bvurrn2n6EeWhC9bjpdX3vL2PxVEUdCYm7TwXWf1/mtOoJfcNZSrUpP4fdQkZTCqZPwx9tjVzVA=="}} Oct 04 18:38:12.195976 n-d-851028-13 devstack@n-api.service[123596]: method: Oct 04 18:38:12.195976 n-d-851028-13 devstack@n-api.service[123596]: exception: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 04 18:38:12.195976 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'body': {'keypair': {'name': 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBjEL6FaKHsp8PlDoIf19598uKho04BOHl8TllfMcoiYv+Z9+qSoea5bvurrn2n6EeWhC9bjpdX3vL2PxVEUdCYm7TwXWf1/mtOoJfcNZSrUpP4fdQkZTCqZPwx9tjVzVA=='}}} Oct 04 18:38:12.195976 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:38:12.195976 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:38:12.195976 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:38:12.195976 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:38:12.195976 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:38:12.195976 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:38:12.195976 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 04 18:38:12.195976 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:38:12.195976 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Oct 04 18:38:12.195976 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 04 18:38:12.195976 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:38:12.195976 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi On instance['keypair']: Oct 04 18:38:12.195976 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' Oct 04 18:38:12.200235 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:38:12.200235 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:38:12.200235 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:38:12.200235 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:38:12.200235 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:38:12.200235 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:38:12.200235 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:38:12.200235 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:38:12.200235 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:38:12.200235 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:38:12.200235 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:38:12.200235 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:38:12.200235 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:38:12.200235 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:38:12.200235 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 18:38:12.200235 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 18:38:12.200235 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:38:12.200235 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:38:12.200235 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:38:12.200235 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:38:12.200235 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 04 18:38:12.200235 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:38:12.200235 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:38:12.200235 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:38:12.200235 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:38:12.200235 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:38:12.200235 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:38:12.200235 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:38:12.200235 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:38:12.200235 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 04 18:38:12.200235 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:38:12.200235 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-7562a1eb-c55d-4702-a30b-41eb7ccece3a tempest-KeyPairsNegativeTestJSON-2110627829 tempest-KeyPairsNegativeTestJSON-2110627829-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:38:12.204430 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-7562a1eb-c55d-4702-a30b-41eb7ccece3a tempest-KeyPairsNegativeTestJSON-2110627829 tempest-KeyPairsNegativeTestJSON-2110627829-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.031202 Oct 04 18:38:12.204430 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1014/1882] 10.222.0.43 () {60 vars in 1159 bytes} [Tue Oct 4 18:38:12 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 04 18:38:12.215341 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-60b75428-6dc9-492e-b2ee-7f40d28451c2 tempest-KeyPairsNegativeTestJSON-2110627829 tempest-KeyPairsNegativeTestJSON-2110627829-project] Action: 'create', calling method: .version_select at 0x7fb21fe24b80>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-580756340", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:38:12.251727 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-60b75428-6dc9-492e-b2ee-7f40d28451c2 tempest-KeyPairsNegativeTestJSON-2110627829 tempest-KeyPairsNegativeTestJSON-2110627829-project] Getting quotas for project b673afb7448a42c7bd116b8947e511b7. Resources: {'key_pairs'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:38:12.266640 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-60b75428-6dc9-492e-b2ee-7f40d28451c2 tempest-KeyPairsNegativeTestJSON-2110627829 tempest-KeyPairsNegativeTestJSON-2110627829-project] Getting quotas for user 4984a677b0044c01a44e6656eea65dc8 and project b673afb7448a42c7bd116b8947e511b7. Resources: {'key_pairs'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:38:12.300987 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-60b75428-6dc9-492e-b2ee-7f40d28451c2 tempest-KeyPairsNegativeTestJSON-2110627829 tempest-KeyPairsNegativeTestJSON-2110627829-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 04 18:38:12.303049 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-60b75428-6dc9-492e-b2ee-7f40d28451c2 tempest-KeyPairsNegativeTestJSON-2110627829 tempest-KeyPairsNegativeTestJSON-2110627829-project] Request method failure captured: Oct 04 18:38:12.303049 n-d-851028-13 devstack@n-api.service[123596]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 04 18:38:12.303049 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:38:12.303049 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:38:12.303049 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:38:12.303049 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 117 Oct 04 18:38:12.303049 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:38:12.303049 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:38:12.303049 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:38:12.303049 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:38:12.303049 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPH2R4Ueuv7zhRrsdhvA_ge9R5YEym6G-6Fr-DspQUgms7wIOP7PdrZGYNQ0-Pd05_dgJlyiu99McSfb9-QCz0dJn7rjMfkGQ-Z1tOLLNK6KyHmHp8sM7xFM2EkWMLsmw0L03eEe6c8yCVgFTjqJWH2oZ1h_xso5od6P1r8b-WL4r920 Oct 04 18:38:12.303049 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:38:12.303049 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:38:12.303049 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:38:12.303049 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:38:12.303049 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:38:12.303049 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:38:12.303049 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: b673afb7448a42c7bd116b8947e511b7 Oct 04 18:38:12.303049 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-2110627829 Oct 04 18:38:12.303049 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 18:38:12.303049 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 18:38:12.303049 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/b673afb7448a42c7bd116b8947e511b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_b673afb7448a42c7bd116b8947e511b7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b673afb7448a42c7bd116b8947e511b7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b673afb7448a42c7bd116b8947e511b7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:38:12.303049 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-KeyPairsNegativeTestJSON-2110627829 Oct 04 18:38:12.303049 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: b673afb7448a42c7bd116b8947e511b7 Oct 04 18:38:12.303049 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-2110627829 Oct 04 18:38:12.303049 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-KeyPairsNegativeTestJSON-2110627829-project Oct 04 18:38:12.303049 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:38:12.303049 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:38:12.303049 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 4984a677b0044c01a44e6656eea65dc8 Oct 04 18:38:12.303049 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-KeyPairsNegativeTestJSON-2110627829-project Oct 04 18:38:12.303049 n-d-851028-13 devstack@n-api.service[123596]: Oct 04 18:38:12.303049 n-d-851028-13 devstack@n-api.service[123596]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-580756340", "public_key": "ssh-rsa JUNK nova@ubuntu"}} Oct 04 18:38:12.303049 n-d-851028-13 devstack@n-api.service[123596]: method: Oct 04 18:38:12.303049 n-d-851028-13 devstack@n-api.service[123596]: exception: Keypair data is invalid: failed to generate fingerprint Oct 04 18:38:12.303049 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-580756340', 'public_key': 'ssh-rsa JUNK nova@ubuntu'}}} Oct 04 18:38:12.303049 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:38:12.303049 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:38:12.303049 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 04 18:38:12.303049 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 04 18:38:12.303049 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 664, in load_ssh_public_key Oct 04 18:38:12.303049 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi inner_key_type, data = _get_sshstr(data) Oct 04 18:38:12.303049 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 134, in _get_sshstr Oct 04 18:38:12.303049 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi n, data = _get_u32(data) Oct 04 18:38:12.303049 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 121, in _get_u32 Oct 04 18:38:12.303049 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid data") Oct 04 18:38:12.303049 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi ValueError: Invalid data Oct 04 18:38:12.303049 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:38:12.303049 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:38:12.303049 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:38:12.303049 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:38:12.303049 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 04 18:38:12.303049 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 04 18:38:12.303049 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 04 18:38:12.303049 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 04 18:38:12.303049 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:38:12.303049 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:38:12.303049 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:38:12.303049 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:38:12.303049 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 04 18:38:12.303049 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 04 18:38:12.303049 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Oct 04 18:38:12.303049 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 04 18:38:12.303049 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Oct 04 18:38:12.303049 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 04 18:38:12.308559 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 04 18:38:12.308559 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 04 18:38:12.308559 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 04 18:38:12.308559 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:38:12.308559 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:38:12.308559 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:38:12.308559 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:38:12.308559 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:38:12.308559 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:38:12.308559 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:38:12.308559 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:38:12.308559 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:38:12.308559 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:38:12.308559 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:38:12.308559 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:38:12.308559 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:38:12.308559 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:38:12.308559 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:38:12.308559 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:38:12.308559 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 04 18:38:12.308559 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 04 18:38:12.308559 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 04 18:38:12.308559 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 04 18:38:12.308559 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 04 18:38:12.308559 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:38:12.308559 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:38:12.308559 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:38:12.308559 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:38:12.308559 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:38:12.308559 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:38:12.308559 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:38:12.308559 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:38:12.308559 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 04 18:38:12.308559 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:38:12.308559 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-60b75428-6dc9-492e-b2ee-7f40d28451c2 tempest-KeyPairsNegativeTestJSON-2110627829 tempest-KeyPairsNegativeTestJSON-2110627829-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:38:12.313527 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-60b75428-6dc9-492e-b2ee-7f40d28451c2 tempest-KeyPairsNegativeTestJSON-2110627829 tempest-KeyPairsNegativeTestJSON-2110627829-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.100181 Oct 04 18:38:12.317326 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1015/1883] 10.222.0.43 () {60 vars in 1159 bytes} [Tue Oct 4 18:38:12 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 108 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Oct 04 18:38:12.334689 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f8f19a59-4efc-43b0-b380-d0b25bb528e3 tempest-KeyPairsNegativeTestJSON-2110627829 tempest-KeyPairsNegativeTestJSON-2110627829-project] Calling method '.version_select at 0x7fb21fd048b0>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:12.350463 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-f8f19a59-4efc-43b0-b380-d0b25bb528e3 tempest-KeyPairsNegativeTestJSON-2110627829 tempest-KeyPairsNegativeTestJSON-2110627829-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-133241423 not found for user 4984a677b0044c01a44e6656eea65dc8 Oct 04 18:38:12.352559 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f8f19a59-4efc-43b0-b380-d0b25bb528e3 tempest-KeyPairsNegativeTestJSON-2110627829 tempest-KeyPairsNegativeTestJSON-2110627829-project] Request method failure captured: Oct 04 18:38:12.352559 n-d-851028-13 devstack@n-api.service[123596]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-133241423 HTTP/1.1 Oct 04 18:38:12.352559 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:38:12.352559 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:38:12.352559 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:38:12.352559 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 18:38:12.352559 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:38:12.352559 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:38:12.352559 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:38:12.352559 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:38:12.352559 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPH2R4Ueuv7zhRrsdhvA_ge9R5YEym6G-6Fr-DspQUgms7wIOP7PdrZGYNQ0-Pd05_dgJlyiu99McSfb9-QCz0dJn7rjMfkGQ-Z1tOLLNK6KyHmHp8sM7xFM2EkWMLsmw0L03eEe6c8yCVgFTjqJWH2oZ1h_xso5od6P1r8b-WL4r920 Oct 04 18:38:12.352559 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:38:12.352559 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:38:12.352559 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:38:12.352559 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:38:12.352559 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:38:12.352559 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:38:12.352559 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: b673afb7448a42c7bd116b8947e511b7 Oct 04 18:38:12.352559 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-2110627829 Oct 04 18:38:12.352559 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 18:38:12.352559 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 18:38:12.352559 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/b673afb7448a42c7bd116b8947e511b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_b673afb7448a42c7bd116b8947e511b7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b673afb7448a42c7bd116b8947e511b7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b673afb7448a42c7bd116b8947e511b7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:38:12.352559 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-KeyPairsNegativeTestJSON-2110627829 Oct 04 18:38:12.352559 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: b673afb7448a42c7bd116b8947e511b7 Oct 04 18:38:12.352559 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-2110627829 Oct 04 18:38:12.352559 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-KeyPairsNegativeTestJSON-2110627829-project Oct 04 18:38:12.352559 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:38:12.352559 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:38:12.352559 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 4984a677b0044c01a44e6656eea65dc8 Oct 04 18:38:12.352559 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-KeyPairsNegativeTestJSON-2110627829-project Oct 04 18:38:12.352559 n-d-851028-13 devstack@n-api.service[123596]: method: Oct 04 18:38:12.352559 n-d-851028-13 devstack@n-api.service[123596]: exception: Keypair tempest-keypair-non-existent-133241423 not found for user 4984a677b0044c01a44e6656eea65dc8 Oct 04 18:38:12.352559 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': 'tempest-keypair-non-existent-133241423'} Oct 04 18:38:12.352559 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:38:12.352559 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:38:12.352559 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 170, in _delete Oct 04 18:38:12.352559 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Oct 04 18:38:12.352559 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 04 18:38:12.352559 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 04 18:38:12.352559 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:38:12.352559 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:38:12.352559 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:38:12.352559 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:38:12.352559 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 04 18:38:12.352559 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 04 18:38:12.352559 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6861, in delete_key_pair Oct 04 18:38:12.352559 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Oct 04 18:38:12.352559 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6882, in get_key_pair Oct 04 18:38:12.352559 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Oct 04 18:38:12.352559 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 18:38:12.352559 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 18:38:12.352559 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Oct 04 18:38:12.352559 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Oct 04 18:38:12.352559 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Oct 04 18:38:12.352559 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Oct 04 18:38:12.352559 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 18:38:12.352559 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 18:38:12.352559 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Oct 04 18:38:12.352559 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Oct 04 18:38:12.352559 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-non-existent-133241423 not found for user 4984a677b0044c01a44e6656eea65dc8 Oct 04 18:38:12.352559 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:38:12.352559 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:38:12.358887 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:38:12.358887 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:38:12.358887 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:38:12.358887 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:38:12.358887 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:38:12.358887 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:38:12.358887 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:38:12.358887 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:38:12.358887 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 18:38:12.358887 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:38:12.358887 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:38:12.358887 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:38:12.358887 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 143, in delete Oct 04 18:38:12.358887 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi self._delete(req, id) Oct 04 18:38:12.358887 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 172, in _delete Oct 04 18:38:12.358887 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Oct 04 18:38:12.358887 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-non-existent-133241423 not found for user 4984a677b0044c01a44e6656eea65dc8 Oct 04 18:38:12.358887 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:38:12.358887 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:38:12.358887 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:38:12.358887 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:38:12.358887 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:38:12.358887 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:38:12.358887 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:38:12.358887 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:38:12.358887 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-non-existent-133241423 not found for user 4984a677b0044c01a44e6656eea65dc8 Oct 04 18:38:12.358887 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:38:12.358887 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f8f19a59-4efc-43b0-b380-d0b25bb528e3 tempest-KeyPairsNegativeTestJSON-2110627829 tempest-KeyPairsNegativeTestJSON-2110627829-project] Returning 404 to user: Keypair tempest-keypair-non-existent-133241423 not found for user 4984a677b0044c01a44e6656eea65dc8 {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:38:12.358887 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-f8f19a59-4efc-43b0-b380-d0b25bb528e3 tempest-KeyPairsNegativeTestJSON-2110627829 tempest-KeyPairsNegativeTestJSON-2110627829-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-133241423" status: 404 len: 144 microversion: 2.1 time: 0.023773 Oct 04 18:38:12.358887 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1016/1884] 10.222.0.43 () {58 vars in 1257 bytes} [Tue Oct 4 18:38:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-133241423 => generated 144 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:38:12.383525 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=2 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:38:12.444481 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-4cd5bca2-624b-4ce6-be91-3e6091f553b0 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:12.446454 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-4cd5bca2-624b-4ce6-be91-3e6091f553b0 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: d85af512-1b1f-42a4-9bb1-963cc956c9ae] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:12.455180 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4cd5bca2-624b-4ce6-be91-3e6091f553b0 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:12.456839 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4cd5bca2-624b-4ce6-be91-3e6091f553b0 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:12.457810 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4cd5bca2-624b-4ce6-be91-3e6091f553b0 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:12.462283 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4cd5bca2-624b-4ce6-be91-3e6091f553b0 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:12.463518 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4cd5bca2-624b-4ce6-be91-3e6091f553b0 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:12.464210 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4cd5bca2-624b-4ce6-be91-3e6091f553b0 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:12.935221 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-4cd5bca2-624b-4ce6-be91-3e6091f553b0 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:12.946618 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-4cd5bca2-624b-4ce6-be91-3e6091f553b0 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/d85af512-1b1f-42a4-9bb1-963cc956c9ae" status: 200 len: 1476 microversion: 2.1 time: 0.506487 Oct 04 18:38:12.965988 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1017/1885] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:12 2022] GET /compute/v2.1/servers/d85af512-1b1f-42a4-9bb1-963cc956c9ae => generated 1476 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:13.100734 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-d91759a1-c95c-456a-9740-1b342b02f0ec tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:13.103649 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-d91759a1-c95c-456a-9740-1b342b02f0ec tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] [instance: 6eb9c803-dd97-4af5-b0d0-aa6fc18f8a89] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:13.128505 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d91759a1-c95c-456a-9740-1b342b02f0ec tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:13.130198 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d91759a1-c95c-456a-9740-1b342b02f0ec tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:13.132406 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d91759a1-c95c-456a-9740-1b342b02f0ec tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:13.136270 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d91759a1-c95c-456a-9740-1b342b02f0ec tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:13.138701 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d91759a1-c95c-456a-9740-1b342b02f0ec tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:13.140626 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d91759a1-c95c-456a-9740-1b342b02f0ec tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:13.608243 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-d91759a1-c95c-456a-9740-1b342b02f0ec tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e30c6d7042ca444a86e2260692ea048e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c54096058d4c9a8ea436329e25ecbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:13.644893 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-d91759a1-c95c-456a-9740-1b342b02f0ec tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] 10.222.0.43 "GET /compute/v2.1/servers/6eb9c803-dd97-4af5-b0d0-aa6fc18f8a89" status: 200 len: 1318 microversion: 2.1 time: 0.552425 Oct 04 18:38:13.668121 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1018/1886] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:13 2022] GET /compute/v2.1/servers/6eb9c803-dd97-4af5-b0d0-aa6fc18f8a89 => generated 1318 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:13.974838 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-47805a67-bd87-4062-8220-7a0b6bdab911 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:13.976794 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-47805a67-bd87-4062-8220-7a0b6bdab911 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: d85af512-1b1f-42a4-9bb1-963cc956c9ae] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:13.987962 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-47805a67-bd87-4062-8220-7a0b6bdab911 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:13.989415 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-47805a67-bd87-4062-8220-7a0b6bdab911 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:13.990120 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-47805a67-bd87-4062-8220-7a0b6bdab911 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:13.992788 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-47805a67-bd87-4062-8220-7a0b6bdab911 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:13.994335 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-47805a67-bd87-4062-8220-7a0b6bdab911 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:13.995777 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-47805a67-bd87-4062-8220-7a0b6bdab911 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:14.004822 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:38:14.271198 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-47805a67-bd87-4062-8220-7a0b6bdab911 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:14.281928 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-47805a67-bd87-4062-8220-7a0b6bdab911 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/d85af512-1b1f-42a4-9bb1-963cc956c9ae" status: 200 len: 1475 microversion: 2.1 time: 0.313718 Oct 04 18:38:14.283863 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1019/1887] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:13 2022] GET /compute/v2.1/servers/d85af512-1b1f-42a4-9bb1-963cc956c9ae => generated 1475 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:14.375092 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-9bc5e800-510f-4973-9cab-064903812979 tempest-SecurityGroupRulesTestJSON-1076849469 tempest-SecurityGroupRulesTestJSON-1076849469-project] 10.222.0.43 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 330 microversion: 2.1 time: 2.285440 Oct 04 18:38:14.378027 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 869/1888] 10.222.0.43 () {60 vars in 1195 bytes} [Tue Oct 4 18:38:12 2022] POST /compute/v2.1/os-security-group-rules => generated 330 bytes in 2287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:38:14.411924 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-cb0feaf8-4bed-47ce-8f9f-1932fe5a79a5 tempest-SecurityGroupRulesTestJSON-1076849469 tempest-SecurityGroupRulesTestJSON-1076849469-project] Action: 'create', calling method: .version_select at 0x7fb22445f280>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1547090434", "description": "tempest-description-1509311183"}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:38:14.670780 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-a5b00fdb-fc11-4098-ad38-03d795fcf0f8 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:14.671616 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-a5b00fdb-fc11-4098-ad38-03d795fcf0f8 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] [instance: 6eb9c803-dd97-4af5-b0d0-aa6fc18f8a89] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:14.682515 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a5b00fdb-fc11-4098-ad38-03d795fcf0f8 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:14.683029 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a5b00fdb-fc11-4098-ad38-03d795fcf0f8 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:14.683501 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a5b00fdb-fc11-4098-ad38-03d795fcf0f8 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:14.684202 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a5b00fdb-fc11-4098-ad38-03d795fcf0f8 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:14.684660 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a5b00fdb-fc11-4098-ad38-03d795fcf0f8 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:14.685173 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a5b00fdb-fc11-4098-ad38-03d795fcf0f8 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:14.999528 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-cb0feaf8-4bed-47ce-8f9f-1932fe5a79a5 tempest-SecurityGroupRulesTestJSON-1076849469 tempest-SecurityGroupRulesTestJSON-1076849469-project] 10.222.0.43 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.613437 Oct 04 18:38:15.001222 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1020/1889] 10.222.0.43 () {60 vars in 1180 bytes} [Tue Oct 4 18:38:14 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:38:15.008170 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-1d7e0467-6b89-4c9f-ad02-4a010a220ec1 req-71b6da92-573f-4563-b33a-ef16b07c3d0d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b7f1ede-48b3-48d8-933e-287c338b1e6a", "tag": "462f1dea-cb2e-42da-a165-e6bc91610838"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:38:15.032237 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-1d7e0467-6b89-4c9f-ad02-4a010a220ec1 req-71b6da92-573f-4563-b33a-ef16b07c3d0d service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:15.036910 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-1d7e0467-6b89-4c9f-ad02-4a010a220ec1 req-71b6da92-573f-4563-b33a-ef16b07c3d0d service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:15.038210 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-1d7e0467-6b89-4c9f-ad02-4a010a220ec1 req-71b6da92-573f-4563-b33a-ef16b07c3d0d service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:15.095343 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-1d7e0467-6b89-4c9f-ad02-4a010a220ec1 req-71b6da92-573f-4563-b33a-ef16b07c3d0d service nova] Creating event network-changed:462f1dea-cb2e-42da-a165-e6bc91610838 for instance 0b7f1ede-48b3-48d8-933e-287c338b1e6a on n-h1-851028-13 Oct 04 18:38:15.109377 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-1d7e0467-6b89-4c9f-ad02-4a010a220ec1 req-71b6da92-573f-4563-b33a-ef16b07c3d0d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104335 Oct 04 18:38:15.112752 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1021/1890] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:38:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:38:15.130017 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-74b660aa-ff62-4358-bca1-644508ab360d tempest-SecurityGroupRulesTestJSON-1076849469 tempest-SecurityGroupRulesTestJSON-1076849469-project] Action: 'create', calling method: .version_select at 0x7fb21fccb9d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-197636527", "description": "tempest-description-557766700"}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:38:15.558958 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-74b660aa-ff62-4358-bca1-644508ab360d tempest-SecurityGroupRulesTestJSON-1076849469 tempest-SecurityGroupRulesTestJSON-1076849469-project] 10.222.0.43 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.444417 Oct 04 18:38:15.559869 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1022/1891] 10.222.0.43 () {60 vars in 1180 bytes} [Tue Oct 4 18:38:15 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:38:15.633160 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-a5b00fdb-fc11-4098-ad38-03d795fcf0f8 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e30c6d7042ca444a86e2260692ea048e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c54096058d4c9a8ea436329e25ecbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:15.647321 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-a5b00fdb-fc11-4098-ad38-03d795fcf0f8 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] 10.222.0.43 "GET /compute/v2.1/servers/6eb9c803-dd97-4af5-b0d0-aa6fc18f8a89" status: 200 len: 1318 microversion: 2.1 time: 0.980254 Oct 04 18:38:15.662653 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 870/1892] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:14 2022] GET /compute/v2.1/servers/6eb9c803-dd97-4af5-b0d0-aa6fc18f8a89 => generated 1318 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:38:15.678470 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-0e90f11a-3b47-40fd-9215-be10f9c2075e tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:15.680313 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-0e90f11a-3b47-40fd-9215-be10f9c2075e tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: d85af512-1b1f-42a4-9bb1-963cc956c9ae] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:15.691068 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0e90f11a-3b47-40fd-9215-be10f9c2075e tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:15.695078 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0e90f11a-3b47-40fd-9215-be10f9c2075e tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:15.698139 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0e90f11a-3b47-40fd-9215-be10f9c2075e tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:15.699201 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0e90f11a-3b47-40fd-9215-be10f9c2075e tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:15.700184 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0e90f11a-3b47-40fd-9215-be10f9c2075e tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:15.702218 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0e90f11a-3b47-40fd-9215-be10f9c2075e tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:16.255630 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-c5e7168e-2505-4d4f-a05c-e6cbef3bfeb0 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-575175574", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452", "networks": [{"uuid": "8c78b501-c0dc-4b4a-aea6-b08dc5b06498"}]}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:38:16.365930 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.network.neutron [None req-c5e7168e-2505-4d4f-a05c-e6cbef3bfeb0 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] validate_networks() for [('8c78b501-c0dc-4b4a-aea6-b08dc5b06498', None, None, None, None, None)] {{(pid=123596) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:38:16.407376 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-0e90f11a-3b47-40fd-9215-be10f9c2075e tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:16.424622 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-0e90f11a-3b47-40fd-9215-be10f9c2075e tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/d85af512-1b1f-42a4-9bb1-963cc956c9ae" status: 200 len: 1475 microversion: 2.1 time: 0.758657 Oct 04 18:38:16.428148 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 871/1893] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:15 2022] GET /compute/v2.1/servers/d85af512-1b1f-42a4-9bb1-963cc956c9ae => generated 1475 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:16.437652 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-2f8a11de-302f-40df-87aa-0836fd077a57 tempest-SecurityGroupRulesTestJSON-1076849469 tempest-SecurityGroupRulesTestJSON-1076849469-project] Action: 'create', calling method: .version_select at 0x7fb21fd1faf0>, body: {"security_group_rule": {"parent_group_id": "e4f1bedc-d19e-41a0-a104-5436e68dfdec", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "21c3fa35-70d2-493d-8c18-fc1383c44395"}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:38:17.324678 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-c5e7168e-2505-4d4f-a05c-e6cbef3bfeb0 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Flavor limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:38:17.325300 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-c5e7168e-2505-4d4f-a05c-e6cbef3bfeb0 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Image limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:38:17.325770 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-c5e7168e-2505-4d4f-a05c-e6cbef3bfeb0 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Flavor pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:38:17.328059 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-c5e7168e-2505-4d4f-a05c-e6cbef3bfeb0 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Image pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:38:17.328059 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-c5e7168e-2505-4d4f-a05c-e6cbef3bfeb0 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:38:17.348195 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c5e7168e-2505-4d4f-a05c-e6cbef3bfeb0 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:17.348656 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c5e7168e-2505-4d4f-a05c-e6cbef3bfeb0 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:17.349053 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c5e7168e-2505-4d4f-a05c-e6cbef3bfeb0 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:17.359052 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c5e7168e-2505-4d4f-a05c-e6cbef3bfeb0 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:17.359555 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c5e7168e-2505-4d4f-a05c-e6cbef3bfeb0 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:17.363186 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c5e7168e-2505-4d4f-a05c-e6cbef3bfeb0 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:17.417951 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-c5e7168e-2505-4d4f-a05c-e6cbef3bfeb0 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Getting quotas for project 87f4f9b0233b4fb29963b77248a236f7. Resources: {'ram', 'cores', 'instances'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:38:17.436413 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-c5e7168e-2505-4d4f-a05c-e6cbef3bfeb0 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Getting quotas for user eadce040fcf3427abab9ef8b0ca19400 and project 87f4f9b0233b4fb29963b77248a236f7. Resources: {'ram', 'cores', 'instances'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:38:17.481344 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-c5e7168e-2505-4d4f-a05c-e6cbef3bfeb0 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Going to run 1 instances... {{(pid=123596) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:38:17.489664 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-c5e7168e-2505-4d4f-a05c-e6cbef3bfeb0 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] [instance: 36d7eb4f-22bc-4047-bc75-6f69142daee5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e8943ec5-4038-4d4b-b9b9-2415a79f5243',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123596) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:38:17.585335 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-c5e7168e-2505-4d4f-a05c-e6cbef3bfeb0 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.023937 Oct 04 18:38:17.592002 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1023/1894] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 18:38:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 2026 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:38:17.595784 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-aed4e8f4-dc0c-40a1-99a3-c23b28eb116f tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:17.596418 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-aed4e8f4-dc0c-40a1-99a3-c23b28eb116f tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] [instance: 6eb9c803-dd97-4af5-b0d0-aa6fc18f8a89] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:17.623655 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-aed4e8f4-dc0c-40a1-99a3-c23b28eb116f tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:17.625151 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-aed4e8f4-dc0c-40a1-99a3-c23b28eb116f tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:17.627559 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-aed4e8f4-dc0c-40a1-99a3-c23b28eb116f tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:17.628909 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-aed4e8f4-dc0c-40a1-99a3-c23b28eb116f tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:17.631642 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-aed4e8f4-dc0c-40a1-99a3-c23b28eb116f tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:17.633543 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-aed4e8f4-dc0c-40a1-99a3-c23b28eb116f tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:17.928047 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-aed4e8f4-dc0c-40a1-99a3-c23b28eb116f tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e30c6d7042ca444a86e2260692ea048e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c54096058d4c9a8ea436329e25ecbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:17.954039 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-aed4e8f4-dc0c-40a1-99a3-c23b28eb116f tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] 10.222.0.43 "GET /compute/v2.1/servers/6eb9c803-dd97-4af5-b0d0-aa6fc18f8a89" status: 200 len: 1318 microversion: 2.1 time: 0.366506 Oct 04 18:38:17.958461 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1024/1895] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:17 2022] GET /compute/v2.1/servers/6eb9c803-dd97-4af5-b0d0-aa6fc18f8a89 => generated 1318 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:17.978084 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-e64bdba5-fc32-4109-9b46-229ad66045d7 req-42eebd1c-c5f5-4580-bba3-880567fa05bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d85af512-1b1f-42a4-9bb1-963cc956c9ae", "name": "network-vif-unplugged", "status": "completed", "tag": "002dee45-b64c-4706-ab5c-1e8e34d83258"}, {"name": "network-changed", "server_uuid": "6eb9c803-dd97-4af5-b0d0-aa6fc18f8a89", "tag": "32bec9cb-4066-4472-bb00-a407392e684f"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:38:17.997102 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-e64bdba5-fc32-4109-9b46-229ad66045d7 req-42eebd1c-c5f5-4580-bba3-880567fa05bc service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:17.998786 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-e64bdba5-fc32-4109-9b46-229ad66045d7 req-42eebd1c-c5f5-4580-bba3-880567fa05bc service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:17.999621 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-e64bdba5-fc32-4109-9b46-229ad66045d7 req-42eebd1c-c5f5-4580-bba3-880567fa05bc service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:18.023510 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-e64bdba5-fc32-4109-9b46-229ad66045d7 req-42eebd1c-c5f5-4580-bba3-880567fa05bc service nova] Creating event network-vif-unplugged:002dee45-b64c-4706-ab5c-1e8e34d83258 for instance d85af512-1b1f-42a4-9bb1-963cc956c9ae on n-h1-851028-13 Oct 04 18:38:18.024404 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-e64bdba5-fc32-4109-9b46-229ad66045d7 req-42eebd1c-c5f5-4580-bba3-880567fa05bc service nova] Creating event network-changed:32bec9cb-4066-4472-bb00-a407392e684f for instance 6eb9c803-dd97-4af5-b0d0-aa6fc18f8a89 on n-h1-851028-13 Oct 04 18:38:18.048703 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [req-e64bdba5-fc32-4109-9b46-229ad66045d7 req-42eebd1c-c5f5-4580-bba3-880567fa05bc service nova] Instance d85af512-1b1f-42a4-9bb1-963cc956c9ae is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851028-13', 'n-h2-851028-13'} {{(pid=123596) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 18:38:18.073829 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-e64bdba5-fc32-4109-9b46-229ad66045d7 req-42eebd1c-c5f5-4580-bba3-880567fa05bc service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.112946 Oct 04 18:38:18.076113 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1025/1896] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:38:17 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:38:18.083152 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-1672fe2c-b597-48a3-adac-031441283737 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:18.084682 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-1672fe2c-b597-48a3-adac-031441283737 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: d85af512-1b1f-42a4-9bb1-963cc956c9ae] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:18.094503 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1672fe2c-b597-48a3-adac-031441283737 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:18.096616 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1672fe2c-b597-48a3-adac-031441283737 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:18.097419 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1672fe2c-b597-48a3-adac-031441283737 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:18.098603 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1672fe2c-b597-48a3-adac-031441283737 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:18.099395 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1672fe2c-b597-48a3-adac-031441283737 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:18.100069 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1672fe2c-b597-48a3-adac-031441283737 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:18.407375 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-1672fe2c-b597-48a3-adac-031441283737 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:18.444899 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-1672fe2c-b597-48a3-adac-031441283737 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/d85af512-1b1f-42a4-9bb1-963cc956c9ae" status: 200 len: 1475 microversion: 2.1 time: 0.365869 Oct 04 18:38:18.467220 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1026/1897] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:18 2022] GET /compute/v2.1/servers/d85af512-1b1f-42a4-9bb1-963cc956c9ae => generated 1475 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:18.795932 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-b332a380-e3dd-4f12-85d5-65c81ae506cc tempest-ServersAaction247Test-39568591 tempest-ServersAaction247Test-39568591-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAaction247Test-server-1629098170", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452", "networks": "none"}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:38:18.900041 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-b332a380-e3dd-4f12-85d5-65c81ae506cc tempest-ServersAaction247Test-39568591 tempest-ServersAaction247Test-39568591-project] Flavor limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:38:18.900473 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-b332a380-e3dd-4f12-85d5-65c81ae506cc tempest-ServersAaction247Test-39568591 tempest-ServersAaction247Test-39568591-project] Image limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:38:18.901036 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-b332a380-e3dd-4f12-85d5-65c81ae506cc tempest-ServersAaction247Test-39568591 tempest-ServersAaction247Test-39568591-project] Flavor pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:38:18.902286 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-b332a380-e3dd-4f12-85d5-65c81ae506cc tempest-ServersAaction247Test-39568591 tempest-ServersAaction247Test-39568591-project] Image pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:38:18.902698 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-b332a380-e3dd-4f12-85d5-65c81ae506cc tempest-ServersAaction247Test-39568591 tempest-ServersAaction247Test-39568591-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:38:18.932488 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b332a380-e3dd-4f12-85d5-65c81ae506cc tempest-ServersAaction247Test-39568591 tempest-ServersAaction247Test-39568591-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:18.938257 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b332a380-e3dd-4f12-85d5-65c81ae506cc tempest-ServersAaction247Test-39568591 tempest-ServersAaction247Test-39568591-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:18.939343 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b332a380-e3dd-4f12-85d5-65c81ae506cc tempest-ServersAaction247Test-39568591 tempest-ServersAaction247Test-39568591-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:18.941133 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b332a380-e3dd-4f12-85d5-65c81ae506cc tempest-ServersAaction247Test-39568591 tempest-ServersAaction247Test-39568591-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:18.941769 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b332a380-e3dd-4f12-85d5-65c81ae506cc tempest-ServersAaction247Test-39568591 tempest-ServersAaction247Test-39568591-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:18.943749 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b332a380-e3dd-4f12-85d5-65c81ae506cc tempest-ServersAaction247Test-39568591 tempest-ServersAaction247Test-39568591-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:19.017888 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-b332a380-e3dd-4f12-85d5-65c81ae506cc tempest-ServersAaction247Test-39568591 tempest-ServersAaction247Test-39568591-project] Getting quotas for project c93660b078ab46a89423cafbb0c192df. Resources: {'ram', 'cores', 'instances'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:38:19.030605 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-b332a380-e3dd-4f12-85d5-65c81ae506cc tempest-ServersAaction247Test-39568591 tempest-ServersAaction247Test-39568591-project] Getting quotas for user 1a11a96dc16d456493deb5d6d844dc8b and project c93660b078ab46a89423cafbb0c192df. Resources: {'ram', 'cores', 'instances'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:38:19.059173 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-b332a380-e3dd-4f12-85d5-65c81ae506cc tempest-ServersAaction247Test-39568591 tempest-ServersAaction247Test-39568591-project] Going to run 1 instances... {{(pid=123596) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:38:19.063480 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-b332a380-e3dd-4f12-85d5-65c81ae506cc tempest-ServersAaction247Test-39568591 tempest-ServersAaction247Test-39568591-project] [instance: 212e4404-4e73-4fc5-aacc-e6967180a85f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e8943ec5-4038-4d4b-b9b9-2415a79f5243',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123596) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:38:19.138340 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-2f8a11de-302f-40df-87aa-0836fd077a57 tempest-SecurityGroupRulesTestJSON-1076849469 tempest-SecurityGroupRulesTestJSON-1076849469-project] 10.222.0.43 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 330 microversion: 2.1 time: 2.708805 Oct 04 18:38:19.138925 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 872/1898] 10.222.0.43 () {60 vars in 1195 bytes} [Tue Oct 4 18:38:16 2022] POST /compute/v2.1/os-security-group-rules => generated 330 bytes in 2710 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:38:19.149990 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-d2abc3c6-d4dd-4480-975a-dfb07f3271f7 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:19.150687 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-d2abc3c6-d4dd-4480-975a-dfb07f3271f7 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] [instance: 36d7eb4f-22bc-4047-bc75-6f69142daee5] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:19.153074 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=5,nova_api:DELETE=1 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:38:19.182834 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d2abc3c6-d4dd-4480-975a-dfb07f3271f7 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:19.182834 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d2abc3c6-d4dd-4480-975a-dfb07f3271f7 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:19.182834 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d2abc3c6-d4dd-4480-975a-dfb07f3271f7 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:19.189740 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d2abc3c6-d4dd-4480-975a-dfb07f3271f7 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:19.190302 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d2abc3c6-d4dd-4480-975a-dfb07f3271f7 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:19.192241 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d2abc3c6-d4dd-4480-975a-dfb07f3271f7 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:19.268634 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=100 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:38:19.344924 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-b332a380-e3dd-4f12-85d5-65c81ae506cc tempest-ServersAaction247Test-39568591 tempest-ServersAaction247Test-39568591-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.863992 Oct 04 18:38:19.362419 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1027/1899] 10.222.0.43 () {62 vars in 1188 bytes} [Tue Oct 4 18:38:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 894 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 04 18:38:19.397743 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-c43bf500-e1b8-46b7-9628-3e87f6e31d1d tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:19.400329 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-c43bf500-e1b8-46b7-9628-3e87f6e31d1d tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] [instance: 6eb9c803-dd97-4af5-b0d0-aa6fc18f8a89] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:19.433552 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c43bf500-e1b8-46b7-9628-3e87f6e31d1d tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:19.436652 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c43bf500-e1b8-46b7-9628-3e87f6e31d1d tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:19.438234 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c43bf500-e1b8-46b7-9628-3e87f6e31d1d tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:19.439909 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c43bf500-e1b8-46b7-9628-3e87f6e31d1d tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:19.442449 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c43bf500-e1b8-46b7-9628-3e87f6e31d1d tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:19.443779 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c43bf500-e1b8-46b7-9628-3e87f6e31d1d tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:19.724360 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-d2abc3c6-d4dd-4480-975a-dfb07f3271f7 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eadce040fcf3427abab9ef8b0ca19400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f4f9b0233b4fb29963b77248a236f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:19.743067 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-d2abc3c6-d4dd-4480-975a-dfb07f3271f7 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] 10.222.0.43 "GET /compute/v2.1/servers/36d7eb4f-22bc-4047-bc75-6f69142daee5" status: 200 len: 1275 microversion: 2.1 time: 0.599418 Oct 04 18:38:19.747412 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 873/1900] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:19 2022] GET /compute/v2.1/servers/36d7eb4f-22bc-4047-bc75-6f69142daee5 => generated 1275 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:19.766043 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-fc36e5c4-ef5a-4f87-9aa4-757a17c1daae tempest-SecurityGroupRulesTestJSON-1076849469 tempest-SecurityGroupRulesTestJSON-1076849469-project] Calling method '.version_select at 0x7fb21fe37d30>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:20.568442 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-c43bf500-e1b8-46b7-9628-3e87f6e31d1d tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e30c6d7042ca444a86e2260692ea048e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c54096058d4c9a8ea436329e25ecbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:20.579007 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-fc36e5c4-ef5a-4f87-9aa4-757a17c1daae tempest-SecurityGroupRulesTestJSON-1076849469 tempest-SecurityGroupRulesTestJSON-1076849469-project] 10.222.0.43 "DELETE /compute/v2.1/os-security-groups/21c3fa35-70d2-493d-8c18-fc1383c44395" status: 202 len: 0 microversion: 2.1 time: 0.830050 Oct 04 18:38:20.580301 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 874/1901] 10.222.0.43 () {58 vars in 1272 bytes} [Tue Oct 4 18:38:19 2022] DELETE /compute/v2.1/os-security-groups/21c3fa35-70d2-493d-8c18-fc1383c44395 => generated 0 bytes in 832 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:38:20.586043 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-a85dde42-b266-484f-a314-3715bd2ee017 tempest-ServersAaction247Test-39568591 tempest-ServersAaction247Test-39568591-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:20.586894 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-a85dde42-b266-484f-a314-3715bd2ee017 tempest-ServersAaction247Test-39568591 tempest-ServersAaction247Test-39568591-project] [instance: 212e4404-4e73-4fc5-aacc-e6967180a85f] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:20.589010 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-c43bf500-e1b8-46b7-9628-3e87f6e31d1d tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] 10.222.0.43 "GET /compute/v2.1/servers/6eb9c803-dd97-4af5-b0d0-aa6fc18f8a89" status: 200 len: 1318 microversion: 2.1 time: 1.214725 Oct 04 18:38:20.601205 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1028/1902] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:19 2022] GET /compute/v2.1/servers/6eb9c803-dd97-4af5-b0d0-aa6fc18f8a89 => generated 1318 bytes in 1226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:20.601992 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-87af0910-c471-4235-ac2c-1d3109b3d9c5 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:20.603224 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-87af0910-c471-4235-ac2c-1d3109b3d9c5 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: d85af512-1b1f-42a4-9bb1-963cc956c9ae] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:20.620513 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-87af0910-c471-4235-ac2c-1d3109b3d9c5 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:20.621462 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-87af0910-c471-4235-ac2c-1d3109b3d9c5 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:20.622555 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-87af0910-c471-4235-ac2c-1d3109b3d9c5 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:20.623890 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-87af0910-c471-4235-ac2c-1d3109b3d9c5 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:20.624691 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a85dde42-b266-484f-a314-3715bd2ee017 tempest-ServersAaction247Test-39568591 tempest-ServersAaction247Test-39568591-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:20.625236 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a85dde42-b266-484f-a314-3715bd2ee017 tempest-ServersAaction247Test-39568591 tempest-ServersAaction247Test-39568591-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:20.625688 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a85dde42-b266-484f-a314-3715bd2ee017 tempest-ServersAaction247Test-39568591 tempest-ServersAaction247Test-39568591-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:20.626159 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-87af0910-c471-4235-ac2c-1d3109b3d9c5 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:20.626434 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a85dde42-b266-484f-a314-3715bd2ee017 tempest-ServersAaction247Test-39568591 tempest-ServersAaction247Test-39568591-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:20.626906 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a85dde42-b266-484f-a314-3715bd2ee017 tempest-ServersAaction247Test-39568591 tempest-ServersAaction247Test-39568591-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:20.627343 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a85dde42-b266-484f-a314-3715bd2ee017 tempest-ServersAaction247Test-39568591 tempest-ServersAaction247Test-39568591-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:20.628984 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-87af0910-c471-4235-ac2c-1d3109b3d9c5 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:20.842885 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-a85dde42-b266-484f-a314-3715bd2ee017 tempest-ServersAaction247Test-39568591 tempest-ServersAaction247Test-39568591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a11a96dc16d456493deb5d6d844dc8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c93660b078ab46a89423cafbb0c192df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:20.855953 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-a85dde42-b266-484f-a314-3715bd2ee017 tempest-ServersAaction247Test-39568591 tempest-ServersAaction247Test-39568591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a11a96dc16d456493deb5d6d844dc8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c93660b078ab46a89423cafbb0c192df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:20.859744 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-a85dde42-b266-484f-a314-3715bd2ee017 tempest-ServersAaction247Test-39568591 tempest-ServersAaction247Test-39568591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a11a96dc16d456493deb5d6d844dc8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c93660b078ab46a89423cafbb0c192df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:20.864128 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-a85dde42-b266-484f-a314-3715bd2ee017 tempest-ServersAaction247Test-39568591 tempest-ServersAaction247Test-39568591-project] 10.222.0.43 "GET /compute/v2.1/servers/212e4404-4e73-4fc5-aacc-e6967180a85f" status: 200 len: 1285 microversion: 2.47 time: 0.282096 Oct 04 18:38:20.864727 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 875/1903] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:38:20 2022] GET /compute/v2.1/servers/212e4404-4e73-4fc5-aacc-e6967180a85f => generated 1285 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:38:20.876592 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-4b0ff24b-577c-418d-afe2-fbc066e5c97d req-170e79e3-555d-476e-9825-801db770a538 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d85af512-1b1f-42a4-9bb1-963cc956c9ae", "tag": "002dee45-b64c-4706-ab5c-1e8e34d83258"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:38:20.894897 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-4b0ff24b-577c-418d-afe2-fbc066e5c97d req-170e79e3-555d-476e-9825-801db770a538 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:20.896153 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-4b0ff24b-577c-418d-afe2-fbc066e5c97d req-170e79e3-555d-476e-9825-801db770a538 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:20.896595 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-4b0ff24b-577c-418d-afe2-fbc066e5c97d req-170e79e3-555d-476e-9825-801db770a538 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:20.913565 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-4b0ff24b-577c-418d-afe2-fbc066e5c97d req-170e79e3-555d-476e-9825-801db770a538 service nova] Creating event network-changed:002dee45-b64c-4706-ab5c-1e8e34d83258 for instance d85af512-1b1f-42a4-9bb1-963cc956c9ae on n-h1-851028-13 Oct 04 18:38:20.921909 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [req-4b0ff24b-577c-418d-afe2-fbc066e5c97d req-170e79e3-555d-476e-9825-801db770a538 service nova] Instance d85af512-1b1f-42a4-9bb1-963cc956c9ae is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851028-13', 'n-h2-851028-13'} {{(pid=123595) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 18:38:20.936976 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-4b0ff24b-577c-418d-afe2-fbc066e5c97d req-170e79e3-555d-476e-9825-801db770a538 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069530 Oct 04 18:38:20.938444 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 876/1904] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:38:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:38:20.950216 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-9e6b9fff-8838-4a77-b9c0-0ef1cb2c93f7 tempest-SecurityGroupRulesTestJSON-1076849469 tempest-SecurityGroupRulesTestJSON-1076849469-project] Calling method '.version_select at 0x7fb224539940>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:20.982107 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-87af0910-c471-4235-ac2c-1d3109b3d9c5 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:20.999762 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-87af0910-c471-4235-ac2c-1d3109b3d9c5 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/d85af512-1b1f-42a4-9bb1-963cc956c9ae" status: 200 len: 1475 microversion: 2.1 time: 0.401078 Oct 04 18:38:21.016398 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1029/1905] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:20 2022] GET /compute/v2.1/servers/d85af512-1b1f-42a4-9bb1-963cc956c9ae => generated 1475 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:21.024973 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-9e6b9fff-8838-4a77-b9c0-0ef1cb2c93f7 tempest-SecurityGroupRulesTestJSON-1076849469 tempest-SecurityGroupRulesTestJSON-1076849469-project] 10.222.0.43 "GET /compute/v2.1/os-security-groups/e4f1bedc-d19e-41a0-a104-5436e68dfdec" status: 200 len: 248 microversion: 2.1 time: 0.082108 Oct 04 18:38:21.024973 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 877/1906] 10.222.0.43 () {58 vars in 1269 bytes} [Tue Oct 4 18:38:20 2022] GET /compute/v2.1/os-security-groups/e4f1bedc-d19e-41a0-a104-5436e68dfdec => generated 248 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:38:21.037696 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-4fc09834-c43b-4f6d-ac9d-bf234c5a9e33 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:21.038742 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-4fc09834-c43b-4f6d-ac9d-bf234c5a9e33 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] [instance: 36d7eb4f-22bc-4047-bc75-6f69142daee5] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:21.045253 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-c02dd269-835c-4e30-a3a3-303747705f82 tempest-SecurityGroupRulesTestJSON-1076849469 tempest-SecurityGroupRulesTestJSON-1076849469-project] Action: 'create', calling method: .version_select at 0x7fb21fc3cb80>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1086283087", "description": "tempest-description-210103390"}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:38:21.046274 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4fc09834-c43b-4f6d-ac9d-bf234c5a9e33 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:21.047728 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4fc09834-c43b-4f6d-ac9d-bf234c5a9e33 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:21.049437 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4fc09834-c43b-4f6d-ac9d-bf234c5a9e33 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:21.050464 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4fc09834-c43b-4f6d-ac9d-bf234c5a9e33 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:21.051171 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4fc09834-c43b-4f6d-ac9d-bf234c5a9e33 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:21.052445 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4fc09834-c43b-4f6d-ac9d-bf234c5a9e33 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:21.561348 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-4fc09834-c43b-4f6d-ac9d-bf234c5a9e33 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eadce040fcf3427abab9ef8b0ca19400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f4f9b0233b4fb29963b77248a236f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:21.576961 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-4fc09834-c43b-4f6d-ac9d-bf234c5a9e33 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] 10.222.0.43 "GET /compute/v2.1/servers/36d7eb4f-22bc-4047-bc75-6f69142daee5" status: 200 len: 1281 microversion: 2.1 time: 0.545906 Oct 04 18:38:21.578273 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1030/1907] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:21 2022] GET /compute/v2.1/servers/36d7eb4f-22bc-4047-bc75-6f69142daee5 => generated 1281 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:21.617229 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-d277fcdd-4c6a-42e4-b2d5-bc9df5dcaed2 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:21.617870 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-d277fcdd-4c6a-42e4-b2d5-bc9df5dcaed2 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] [instance: 6eb9c803-dd97-4af5-b0d0-aa6fc18f8a89] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:21.623965 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:38:21.625844 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d277fcdd-4c6a-42e4-b2d5-bc9df5dcaed2 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:21.627286 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d277fcdd-4c6a-42e4-b2d5-bc9df5dcaed2 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:21.628089 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d277fcdd-4c6a-42e4-b2d5-bc9df5dcaed2 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:21.629578 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d277fcdd-4c6a-42e4-b2d5-bc9df5dcaed2 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:21.631159 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d277fcdd-4c6a-42e4-b2d5-bc9df5dcaed2 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:21.631812 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d277fcdd-4c6a-42e4-b2d5-bc9df5dcaed2 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:21.720324 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=18 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:38:22.619583 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-d277fcdd-4c6a-42e4-b2d5-bc9df5dcaed2 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e30c6d7042ca444a86e2260692ea048e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c54096058d4c9a8ea436329e25ecbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:22.628474 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-d277fcdd-4c6a-42e4-b2d5-bc9df5dcaed2 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] 10.222.0.43 "GET /compute/v2.1/servers/6eb9c803-dd97-4af5-b0d0-aa6fc18f8a89" status: 200 len: 1318 microversion: 2.1 time: 1.016037 Oct 04 18:38:22.632518 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1031/1908] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:21 2022] GET /compute/v2.1/servers/6eb9c803-dd97-4af5-b0d0-aa6fc18f8a89 => generated 1318 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:38:22.652736 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-47d0e629-29dc-4976-8996-43072cf69576 tempest-ServersAaction247Test-39568591 tempest-ServersAaction247Test-39568591-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:22.653770 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-47d0e629-29dc-4976-8996-43072cf69576 tempest-ServersAaction247Test-39568591 tempest-ServersAaction247Test-39568591-project] [instance: 212e4404-4e73-4fc5-aacc-e6967180a85f] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:22.682035 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-47d0e629-29dc-4976-8996-43072cf69576 tempest-ServersAaction247Test-39568591 tempest-ServersAaction247Test-39568591-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:22.682559 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-47d0e629-29dc-4976-8996-43072cf69576 tempest-ServersAaction247Test-39568591 tempest-ServersAaction247Test-39568591-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:22.683013 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-47d0e629-29dc-4976-8996-43072cf69576 tempest-ServersAaction247Test-39568591 tempest-ServersAaction247Test-39568591-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:22.683748 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-47d0e629-29dc-4976-8996-43072cf69576 tempest-ServersAaction247Test-39568591 tempest-ServersAaction247Test-39568591-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:22.684423 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-47d0e629-29dc-4976-8996-43072cf69576 tempest-ServersAaction247Test-39568591 tempest-ServersAaction247Test-39568591-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:22.685125 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-47d0e629-29dc-4976-8996-43072cf69576 tempest-ServersAaction247Test-39568591 tempest-ServersAaction247Test-39568591-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:22.915618 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-47d0e629-29dc-4976-8996-43072cf69576 tempest-ServersAaction247Test-39568591 tempest-ServersAaction247Test-39568591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a11a96dc16d456493deb5d6d844dc8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c93660b078ab46a89423cafbb0c192df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:22.932634 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-47d0e629-29dc-4976-8996-43072cf69576 tempest-ServersAaction247Test-39568591 tempest-ServersAaction247Test-39568591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a11a96dc16d456493deb5d6d844dc8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c93660b078ab46a89423cafbb0c192df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:22.938391 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-47d0e629-29dc-4976-8996-43072cf69576 tempest-ServersAaction247Test-39568591 tempest-ServersAaction247Test-39568591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a11a96dc16d456493deb5d6d844dc8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c93660b078ab46a89423cafbb0c192df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:22.941168 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-47d0e629-29dc-4976-8996-43072cf69576 tempest-ServersAaction247Test-39568591 tempest-ServersAaction247Test-39568591-project] 10.222.0.43 "GET /compute/v2.1/servers/212e4404-4e73-4fc5-aacc-e6967180a85f" status: 200 len: 1339 microversion: 2.47 time: 0.303179 Oct 04 18:38:22.959298 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1032/1909] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:38:22 2022] GET /compute/v2.1/servers/212e4404-4e73-4fc5-aacc-e6967180a85f => generated 1339 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:38:22.998617 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-cae2d565-0b7a-4434-aeee-ef9ac94792bc tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:22.999993 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-cae2d565-0b7a-4434-aeee-ef9ac94792bc tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: d85af512-1b1f-42a4-9bb1-963cc956c9ae] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:23.014950 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cae2d565-0b7a-4434-aeee-ef9ac94792bc tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:23.015712 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cae2d565-0b7a-4434-aeee-ef9ac94792bc tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:23.016366 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cae2d565-0b7a-4434-aeee-ef9ac94792bc tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:23.017376 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cae2d565-0b7a-4434-aeee-ef9ac94792bc tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:23.018400 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cae2d565-0b7a-4434-aeee-ef9ac94792bc tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:23.019023 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cae2d565-0b7a-4434-aeee-ef9ac94792bc tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:23.170690 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-c02dd269-835c-4e30-a3a3-303747705f82 tempest-SecurityGroupRulesTestJSON-1076849469 tempest-SecurityGroupRulesTestJSON-1076849469-project] 10.222.0.43 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 2.135992 Oct 04 18:38:23.171450 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 878/1910] 10.222.0.43 () {60 vars in 1180 bytes} [Tue Oct 4 18:38:21 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 2137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:38:23.177690 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-4fea66fe-7757-48e3-a0a6-e6062fcd07f4 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:23.178600 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-4fea66fe-7757-48e3-a0a6-e6062fcd07f4 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] [instance: 36d7eb4f-22bc-4047-bc75-6f69142daee5] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:23.196088 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4fea66fe-7757-48e3-a0a6-e6062fcd07f4 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:23.196781 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4fea66fe-7757-48e3-a0a6-e6062fcd07f4 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:23.202875 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4fea66fe-7757-48e3-a0a6-e6062fcd07f4 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:23.203796 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4fea66fe-7757-48e3-a0a6-e6062fcd07f4 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:23.204472 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4fea66fe-7757-48e3-a0a6-e6062fcd07f4 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:23.205312 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4fea66fe-7757-48e3-a0a6-e6062fcd07f4 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:23.835160 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-4fea66fe-7757-48e3-a0a6-e6062fcd07f4 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eadce040fcf3427abab9ef8b0ca19400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f4f9b0233b4fb29963b77248a236f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:23.869805 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-4fea66fe-7757-48e3-a0a6-e6062fcd07f4 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] 10.222.0.43 "GET /compute/v2.1/servers/36d7eb4f-22bc-4047-bc75-6f69142daee5" status: 200 len: 1323 microversion: 2.1 time: 0.689076 Oct 04 18:38:23.893187 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 879/1911] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:23 2022] GET /compute/v2.1/servers/36d7eb4f-22bc-4047-bc75-6f69142daee5 => generated 1323 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:23.909986 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-6535a863-be6a-4f34-b112-d179606517f8 tempest-SecurityGroupRulesTestJSON-1076849469 tempest-SecurityGroupRulesTestJSON-1076849469-project] Action: 'create', calling method: .version_select at 0x7fb21fe1eca0>, body: {"security_group_rule": {"parent_group_id": "c27f7588-da25-48e3-8efc-005fb1eb49d8", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:38:23.975964 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-cae2d565-0b7a-4434-aeee-ef9ac94792bc tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:24.010899 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-cae2d565-0b7a-4434-aeee-ef9ac94792bc tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/d85af512-1b1f-42a4-9bb1-963cc956c9ae" status: 200 len: 1473 microversion: 2.1 time: 1.048283 Oct 04 18:38:24.026779 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1033/1912] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:22 2022] GET /compute/v2.1/servers/d85af512-1b1f-42a4-9bb1-963cc956c9ae => generated 1473 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:24.034900 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-4b2d5aef-8028-403e-a46e-226ec48a83a1 req-3b701214-1047-4ce9-a1a4-1309c68b7390 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b7f1ede-48b3-48d8-933e-287c338b1e6a", "name": "network-vif-plugged", "status": "completed", "tag": "462f1dea-cb2e-42da-a165-e6bc91610838"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:38:24.049544 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-4b2d5aef-8028-403e-a46e-226ec48a83a1 req-3b701214-1047-4ce9-a1a4-1309c68b7390 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:24.050459 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-4b2d5aef-8028-403e-a46e-226ec48a83a1 req-3b701214-1047-4ce9-a1a4-1309c68b7390 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:24.051197 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-4b2d5aef-8028-403e-a46e-226ec48a83a1 req-3b701214-1047-4ce9-a1a4-1309c68b7390 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:24.081277 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-4b2d5aef-8028-403e-a46e-226ec48a83a1 req-3b701214-1047-4ce9-a1a4-1309c68b7390 service nova] Creating event network-vif-plugged:462f1dea-cb2e-42da-a165-e6bc91610838 for instance 0b7f1ede-48b3-48d8-933e-287c338b1e6a on n-h1-851028-13 Oct 04 18:38:24.094495 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-4b2d5aef-8028-403e-a46e-226ec48a83a1 req-3b701214-1047-4ce9-a1a4-1309c68b7390 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065777 Oct 04 18:38:24.107301 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1034/1913] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:38:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:38:24.122305 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-884fe2d5-078a-4624-b464-c4e10aa56688 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:24.123524 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-884fe2d5-078a-4624-b464-c4e10aa56688 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] [instance: 6eb9c803-dd97-4af5-b0d0-aa6fc18f8a89] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:24.143987 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-884fe2d5-078a-4624-b464-c4e10aa56688 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:24.144911 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-884fe2d5-078a-4624-b464-c4e10aa56688 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:24.145690 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-884fe2d5-078a-4624-b464-c4e10aa56688 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:24.146668 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-884fe2d5-078a-4624-b464-c4e10aa56688 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:24.147376 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-884fe2d5-078a-4624-b464-c4e10aa56688 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:24.149588 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-884fe2d5-078a-4624-b464-c4e10aa56688 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:24.548453 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-6535a863-be6a-4f34-b112-d179606517f8 tempest-SecurityGroupRulesTestJSON-1076849469 tempest-SecurityGroupRulesTestJSON-1076849469-project] 10.222.0.43 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.652888 Oct 04 18:38:24.550154 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 880/1914] 10.222.0.43 () {60 vars in 1195 bytes} [Tue Oct 4 18:38:23 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:38:24.567066 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-9c66f698-c3b5-4b99-9ce5-5685a4efea0d tempest-ServersAaction247Test-39568591 tempest-ServersAaction247Test-39568591-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:24.568495 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-9c66f698-c3b5-4b99-9ce5-5685a4efea0d tempest-ServersAaction247Test-39568591 tempest-ServersAaction247Test-39568591-project] [instance: 212e4404-4e73-4fc5-aacc-e6967180a85f] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:24.580393 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9c66f698-c3b5-4b99-9ce5-5685a4efea0d tempest-ServersAaction247Test-39568591 tempest-ServersAaction247Test-39568591-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:24.581663 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9c66f698-c3b5-4b99-9ce5-5685a4efea0d tempest-ServersAaction247Test-39568591 tempest-ServersAaction247Test-39568591-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:24.583094 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9c66f698-c3b5-4b99-9ce5-5685a4efea0d tempest-ServersAaction247Test-39568591 tempest-ServersAaction247Test-39568591-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:24.583922 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9c66f698-c3b5-4b99-9ce5-5685a4efea0d tempest-ServersAaction247Test-39568591 tempest-ServersAaction247Test-39568591-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:24.584647 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9c66f698-c3b5-4b99-9ce5-5685a4efea0d tempest-ServersAaction247Test-39568591 tempest-ServersAaction247Test-39568591-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:24.585975 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9c66f698-c3b5-4b99-9ce5-5685a4efea0d tempest-ServersAaction247Test-39568591 tempest-ServersAaction247Test-39568591-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:24.759255 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-9c66f698-c3b5-4b99-9ce5-5685a4efea0d tempest-ServersAaction247Test-39568591 tempest-ServersAaction247Test-39568591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a11a96dc16d456493deb5d6d844dc8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c93660b078ab46a89423cafbb0c192df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:24.785791 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-9c66f698-c3b5-4b99-9ce5-5685a4efea0d tempest-ServersAaction247Test-39568591 tempest-ServersAaction247Test-39568591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a11a96dc16d456493deb5d6d844dc8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c93660b078ab46a89423cafbb0c192df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:24.802834 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-9c66f698-c3b5-4b99-9ce5-5685a4efea0d tempest-ServersAaction247Test-39568591 tempest-ServersAaction247Test-39568591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a11a96dc16d456493deb5d6d844dc8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c93660b078ab46a89423cafbb0c192df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:24.805732 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-9c66f698-c3b5-4b99-9ce5-5685a4efea0d tempest-ServersAaction247Test-39568591 tempest-ServersAaction247Test-39568591-project] 10.222.0.43 "GET /compute/v2.1/servers/212e4404-4e73-4fc5-aacc-e6967180a85f" status: 200 len: 1339 microversion: 2.47 time: 0.254012 Oct 04 18:38:24.807638 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 881/1915] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:38:24 2022] GET /compute/v2.1/servers/212e4404-4e73-4fc5-aacc-e6967180a85f => generated 1339 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:38:24.817903 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-b1f457da-fd80-48a3-b839-c6d5f83eb9d5 tempest-SecurityGroupRulesTestJSON-1076849469 tempest-SecurityGroupRulesTestJSON-1076849469-project] Action: 'create', calling method: .version_select at 0x7fb21fe1e4c0>, body: {"security_group_rule": {"parent_group_id": "c27f7588-da25-48e3-8efc-005fb1eb49d8", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:38:24.893631 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-884fe2d5-078a-4624-b464-c4e10aa56688 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e30c6d7042ca444a86e2260692ea048e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c54096058d4c9a8ea436329e25ecbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:24.910518 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-884fe2d5-078a-4624-b464-c4e10aa56688 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] 10.222.0.43 "GET /compute/v2.1/servers/6eb9c803-dd97-4af5-b0d0-aa6fc18f8a89" status: 200 len: 1318 microversion: 2.1 time: 0.801440 Oct 04 18:38:24.911131 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1035/1916] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:24 2022] GET /compute/v2.1/servers/6eb9c803-dd97-4af5-b0d0-aa6fc18f8a89 => generated 1318 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:24.931332 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-6926f8e2-e9a0-48a4-9c05-5116eba24821 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:24.939178 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-6926f8e2-e9a0-48a4-9c05-5116eba24821 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] [instance: 36d7eb4f-22bc-4047-bc75-6f69142daee5] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:24.953707 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6926f8e2-e9a0-48a4-9c05-5116eba24821 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:24.954916 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6926f8e2-e9a0-48a4-9c05-5116eba24821 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:24.955473 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6926f8e2-e9a0-48a4-9c05-5116eba24821 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:24.956608 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6926f8e2-e9a0-48a4-9c05-5116eba24821 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:24.957342 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6926f8e2-e9a0-48a4-9c05-5116eba24821 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:24.958236 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6926f8e2-e9a0-48a4-9c05-5116eba24821 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:26.039008 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-b1f457da-fd80-48a3-b839-c6d5f83eb9d5 tempest-SecurityGroupRulesTestJSON-1076849469 tempest-SecurityGroupRulesTestJSON-1076849469-project] 10.222.0.43 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 1.229697 Oct 04 18:38:26.040894 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 882/1917] 10.222.0.43 () {60 vars in 1195 bytes} [Tue Oct 4 18:38:24 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 1233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:38:26.058610 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-efa77117-8a7f-4567-a3f8-07dd17a3f974 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:26.062279 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-efa77117-8a7f-4567-a3f8-07dd17a3f974 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: d85af512-1b1f-42a4-9bb1-963cc956c9ae] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:26.087644 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-efa77117-8a7f-4567-a3f8-07dd17a3f974 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:26.093042 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-efa77117-8a7f-4567-a3f8-07dd17a3f974 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:26.093919 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-efa77117-8a7f-4567-a3f8-07dd17a3f974 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:26.095536 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-efa77117-8a7f-4567-a3f8-07dd17a3f974 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:26.096277 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-efa77117-8a7f-4567-a3f8-07dd17a3f974 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:26.096960 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-efa77117-8a7f-4567-a3f8-07dd17a3f974 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:26.154408 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-6926f8e2-e9a0-48a4-9c05-5116eba24821 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eadce040fcf3427abab9ef8b0ca19400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f4f9b0233b4fb29963b77248a236f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:26.181453 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-6926f8e2-e9a0-48a4-9c05-5116eba24821 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] 10.222.0.43 "GET /compute/v2.1/servers/36d7eb4f-22bc-4047-bc75-6f69142daee5" status: 200 len: 1323 microversion: 2.1 time: 1.268673 Oct 04 18:38:26.190314 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1036/1918] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:24 2022] GET /compute/v2.1/servers/36d7eb4f-22bc-4047-bc75-6f69142daee5 => generated 1323 bytes in 1278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:26.221836 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-1ec0f2e4-5cb0-4ea9-83d9-cf022420f4f0 req-6c79ee1b-5d00-42ce-b5a2-df13a2ce37d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36d7eb4f-22bc-4047-bc75-6f69142daee5", "tag": "e3d142e8-c4f2-49f8-af0d-f2e13e22b36f"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:38:26.255611 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-1ec0f2e4-5cb0-4ea9-83d9-cf022420f4f0 req-6c79ee1b-5d00-42ce-b5a2-df13a2ce37d0 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:26.256021 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-1ec0f2e4-5cb0-4ea9-83d9-cf022420f4f0 req-6c79ee1b-5d00-42ce-b5a2-df13a2ce37d0 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:26.256466 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-1ec0f2e4-5cb0-4ea9-83d9-cf022420f4f0 req-6c79ee1b-5d00-42ce-b5a2-df13a2ce37d0 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:26.291804 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-1ec0f2e4-5cb0-4ea9-83d9-cf022420f4f0 req-6c79ee1b-5d00-42ce-b5a2-df13a2ce37d0 service nova] Creating event network-changed:e3d142e8-c4f2-49f8-af0d-f2e13e22b36f for instance 36d7eb4f-22bc-4047-bc75-6f69142daee5 on n-h2-851028-13 Oct 04 18:38:26.304294 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-1ec0f2e4-5cb0-4ea9-83d9-cf022420f4f0 req-6c79ee1b-5d00-42ce-b5a2-df13a2ce37d0 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111672 Oct 04 18:38:26.304932 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1037/1919] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:38:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:38:26.323504 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-029e8122-3936-4320-b58d-0029c345b59a tempest-ServersAaction247Test-39568591 tempest-ServersAaction247Test-39568591-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:26.326459 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-029e8122-3936-4320-b58d-0029c345b59a tempest-ServersAaction247Test-39568591 tempest-ServersAaction247Test-39568591-project] [instance: 212e4404-4e73-4fc5-aacc-e6967180a85f] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:26.350208 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-029e8122-3936-4320-b58d-0029c345b59a tempest-ServersAaction247Test-39568591 tempest-ServersAaction247Test-39568591-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:26.353796 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-029e8122-3936-4320-b58d-0029c345b59a tempest-ServersAaction247Test-39568591 tempest-ServersAaction247Test-39568591-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:26.361301 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-029e8122-3936-4320-b58d-0029c345b59a tempest-ServersAaction247Test-39568591 tempest-ServersAaction247Test-39568591-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:26.362514 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-029e8122-3936-4320-b58d-0029c345b59a tempest-ServersAaction247Test-39568591 tempest-ServersAaction247Test-39568591-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:26.363639 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-029e8122-3936-4320-b58d-0029c345b59a tempest-ServersAaction247Test-39568591 tempest-ServersAaction247Test-39568591-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:26.364600 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-029e8122-3936-4320-b58d-0029c345b59a tempest-ServersAaction247Test-39568591 tempest-ServersAaction247Test-39568591-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:27.210148 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-029e8122-3936-4320-b58d-0029c345b59a tempest-ServersAaction247Test-39568591 tempest-ServersAaction247Test-39568591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a11a96dc16d456493deb5d6d844dc8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c93660b078ab46a89423cafbb0c192df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:27.226991 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-029e8122-3936-4320-b58d-0029c345b59a tempest-ServersAaction247Test-39568591 tempest-ServersAaction247Test-39568591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a11a96dc16d456493deb5d6d844dc8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c93660b078ab46a89423cafbb0c192df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:27.228815 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-029e8122-3936-4320-b58d-0029c345b59a tempest-ServersAaction247Test-39568591 tempest-ServersAaction247Test-39568591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a11a96dc16d456493deb5d6d844dc8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c93660b078ab46a89423cafbb0c192df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:27.232822 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-029e8122-3936-4320-b58d-0029c345b59a tempest-ServersAaction247Test-39568591 tempest-ServersAaction247Test-39568591-project] 10.222.0.43 "GET /compute/v2.1/servers/212e4404-4e73-4fc5-aacc-e6967180a85f" status: 200 len: 1339 microversion: 2.47 time: 0.924938 Oct 04 18:38:27.246843 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1038/1920] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:38:26 2022] GET /compute/v2.1/servers/212e4404-4e73-4fc5-aacc-e6967180a85f => generated 1339 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:38:27.265093 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-1ae169a1-f183-446b-a9c6-376e572514bf tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:27.267379 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-1ae169a1-f183-446b-a9c6-376e572514bf tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] [instance: 6eb9c803-dd97-4af5-b0d0-aa6fc18f8a89] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:27.286069 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1ae169a1-f183-446b-a9c6-376e572514bf tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:27.287240 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1ae169a1-f183-446b-a9c6-376e572514bf tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:27.287891 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1ae169a1-f183-446b-a9c6-376e572514bf tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:27.288860 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1ae169a1-f183-446b-a9c6-376e572514bf tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:27.289534 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1ae169a1-f183-446b-a9c6-376e572514bf tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:27.290147 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1ae169a1-f183-446b-a9c6-376e572514bf tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:27.537136 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-efa77117-8a7f-4567-a3f8-07dd17a3f974 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:27.552673 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-efa77117-8a7f-4567-a3f8-07dd17a3f974 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/d85af512-1b1f-42a4-9bb1-963cc956c9ae" status: 200 len: 1470 microversion: 2.1 time: 1.509360 Oct 04 18:38:27.555642 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 883/1921] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:26 2022] GET /compute/v2.1/servers/d85af512-1b1f-42a4-9bb1-963cc956c9ae => generated 1470 bytes in 1513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:27.565067 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-6aee298a-0829-4797-8564-3232667e3f8a tempest-SecurityGroupRulesTestJSON-1076849469 tempest-SecurityGroupRulesTestJSON-1076849469-project] Calling method '.version_select at 0x7fb21fc4fa60>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:27.725867 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-1ae169a1-f183-446b-a9c6-376e572514bf tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e30c6d7042ca444a86e2260692ea048e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c54096058d4c9a8ea436329e25ecbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:27.728655 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-6aee298a-0829-4797-8564-3232667e3f8a tempest-SecurityGroupRulesTestJSON-1076849469 tempest-SecurityGroupRulesTestJSON-1076849469-project] 10.222.0.43 "GET /compute/v2.1/os-security-groups/c27f7588-da25-48e3-8efc-005fb1eb49d8" status: 200 len: 664 microversion: 2.1 time: 0.171842 Oct 04 18:38:27.729710 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 884/1922] 10.222.0.43 () {58 vars in 1269 bytes} [Tue Oct 4 18:38:27 2022] GET /compute/v2.1/os-security-groups/c27f7588-da25-48e3-8efc-005fb1eb49d8 => generated 664 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:38:27.736919 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-6175a1f5-bfb0-42f6-b9ee-240e76e6b5a6 req-68537f11-66f0-4234-8fca-93ce7042d6bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6eb9c803-dd97-4af5-b0d0-aa6fc18f8a89", "name": "network-vif-plugged", "status": "completed", "tag": "32bec9cb-4066-4472-bb00-a407392e684f"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:38:27.748478 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-1ae169a1-f183-446b-a9c6-376e572514bf tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] 10.222.0.43 "GET /compute/v2.1/servers/6eb9c803-dd97-4af5-b0d0-aa6fc18f8a89" status: 200 len: 1318 microversion: 2.1 time: 0.499754 Oct 04 18:38:27.774084 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1039/1923] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:27 2022] GET /compute/v2.1/servers/6eb9c803-dd97-4af5-b0d0-aa6fc18f8a89 => generated 1318 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:27.798385 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-6175a1f5-bfb0-42f6-b9ee-240e76e6b5a6 req-68537f11-66f0-4234-8fca-93ce7042d6bc service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:27.799664 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-6175a1f5-bfb0-42f6-b9ee-240e76e6b5a6 req-68537f11-66f0-4234-8fca-93ce7042d6bc service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:27.801378 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-39475c83-d61a-49b5-9ae2-db30293a7bf6 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:27.802371 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-6175a1f5-bfb0-42f6-b9ee-240e76e6b5a6 req-68537f11-66f0-4234-8fca-93ce7042d6bc service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:27.805081 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-39475c83-d61a-49b5-9ae2-db30293a7bf6 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] [instance: 36d7eb4f-22bc-4047-bc75-6f69142daee5] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:27.825037 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-39475c83-d61a-49b5-9ae2-db30293a7bf6 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:27.826043 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-39475c83-d61a-49b5-9ae2-db30293a7bf6 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:27.826898 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-39475c83-d61a-49b5-9ae2-db30293a7bf6 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:27.827915 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-39475c83-d61a-49b5-9ae2-db30293a7bf6 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:27.828634 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-39475c83-d61a-49b5-9ae2-db30293a7bf6 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:27.830189 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-39475c83-d61a-49b5-9ae2-db30293a7bf6 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:27.836806 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-6175a1f5-bfb0-42f6-b9ee-240e76e6b5a6 req-68537f11-66f0-4234-8fca-93ce7042d6bc service nova] Creating event network-vif-plugged:32bec9cb-4066-4472-bb00-a407392e684f for instance 6eb9c803-dd97-4af5-b0d0-aa6fc18f8a89 on n-h1-851028-13 Oct 04 18:38:27.846681 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-6175a1f5-bfb0-42f6-b9ee-240e76e6b5a6 req-68537f11-66f0-4234-8fca-93ce7042d6bc service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115918 Oct 04 18:38:27.851470 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 885/1924] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:38:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:38:27.860033 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-c7c4490b-70b3-44b2-906d-e93bca033b86 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:38:27.869381 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-c7c4490b-70b3-44b2-906d-e93bca033b86 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: d85af512-1b1f-42a4-9bb1-963cc956c9ae] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:27.899213 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c7c4490b-70b3-44b2-906d-e93bca033b86 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:27.900019 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c7c4490b-70b3-44b2-906d-e93bca033b86 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:27.900686 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c7c4490b-70b3-44b2-906d-e93bca033b86 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:27.902258 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c7c4490b-70b3-44b2-906d-e93bca033b86 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:27.903226 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c7c4490b-70b3-44b2-906d-e93bca033b86 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:27.906356 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c7c4490b-70b3-44b2-906d-e93bca033b86 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:28.038979 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-c7c4490b-70b3-44b2-906d-e93bca033b86 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "POST /compute/v2.1/servers/d85af512-1b1f-42a4-9bb1-963cc956c9ae/action" status: 204 len: 0 microversion: 2.1 time: 0.184841 Oct 04 18:38:28.041773 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 886/1925] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 18:38:27 2022] POST /compute/v2.1/servers/d85af512-1b1f-42a4-9bb1-963cc956c9ae/action => generated 0 bytes in 190 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:38:28.055840 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-0add1e95-d96f-4783-8110-3be322ab50e4 tempest-SecurityGroupRulesTestJSON-1076849469 tempest-SecurityGroupRulesTestJSON-1076849469-project] Calling method '.version_select at 0x7fb21ff62280>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:28.118176 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-39475c83-d61a-49b5-9ae2-db30293a7bf6 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eadce040fcf3427abab9ef8b0ca19400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f4f9b0233b4fb29963b77248a236f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:28.127215 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-39475c83-d61a-49b5-9ae2-db30293a7bf6 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] 10.222.0.43 "GET /compute/v2.1/servers/36d7eb4f-22bc-4047-bc75-6f69142daee5" status: 200 len: 1323 microversion: 2.1 time: 0.351264 Oct 04 18:38:28.129030 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1040/1926] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:27 2022] GET /compute/v2.1/servers/36d7eb4f-22bc-4047-bc75-6f69142daee5 => generated 1323 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:28.135278 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-fb00d63e-ce99-4836-ae7d-8adc658919f7 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:28.151158 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-fb00d63e-ce99-4836-ae7d-8adc658919f7 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: d85af512-1b1f-42a4-9bb1-963cc956c9ae] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:28.168524 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fb00d63e-ce99-4836-ae7d-8adc658919f7 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:28.174398 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fb00d63e-ce99-4836-ae7d-8adc658919f7 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:28.175325 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fb00d63e-ce99-4836-ae7d-8adc658919f7 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:28.176279 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fb00d63e-ce99-4836-ae7d-8adc658919f7 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:28.177136 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fb00d63e-ce99-4836-ae7d-8adc658919f7 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:28.177762 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fb00d63e-ce99-4836-ae7d-8adc658919f7 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:28.256952 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=100 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:38:28.595796 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-0add1e95-d96f-4783-8110-3be322ab50e4 tempest-SecurityGroupRulesTestJSON-1076849469 tempest-SecurityGroupRulesTestJSON-1076849469-project] 10.222.0.43 "DELETE /compute/v2.1/os-security-group-rules/258dd35f-bf36-4f01-ba3a-a58774cf6456" status: 202 len: 0 microversion: 2.1 time: 0.551663 Oct 04 18:38:28.596374 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 887/1927] 10.222.0.43 () {58 vars in 1287 bytes} [Tue Oct 4 18:38:28 2022] DELETE /compute/v2.1/os-security-group-rules/258dd35f-bf36-4f01-ba3a-a58774cf6456 => generated 0 bytes in 554 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:38:28.604212 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-b701f0a9-e996-4519-b7d7-8cf85257a8fe tempest-ServersAaction247Test-39568591 tempest-ServersAaction247Test-39568591-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:28.605164 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-b701f0a9-e996-4519-b7d7-8cf85257a8fe tempest-ServersAaction247Test-39568591 tempest-ServersAaction247Test-39568591-project] [instance: 212e4404-4e73-4fc5-aacc-e6967180a85f] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:28.620208 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b701f0a9-e996-4519-b7d7-8cf85257a8fe tempest-ServersAaction247Test-39568591 tempest-ServersAaction247Test-39568591-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:28.623842 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b701f0a9-e996-4519-b7d7-8cf85257a8fe tempest-ServersAaction247Test-39568591 tempest-ServersAaction247Test-39568591-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:28.625083 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b701f0a9-e996-4519-b7d7-8cf85257a8fe tempest-ServersAaction247Test-39568591 tempest-ServersAaction247Test-39568591-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:28.626124 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b701f0a9-e996-4519-b7d7-8cf85257a8fe tempest-ServersAaction247Test-39568591 tempest-ServersAaction247Test-39568591-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:28.626755 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b701f0a9-e996-4519-b7d7-8cf85257a8fe tempest-ServersAaction247Test-39568591 tempest-ServersAaction247Test-39568591-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:28.629401 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b701f0a9-e996-4519-b7d7-8cf85257a8fe tempest-ServersAaction247Test-39568591 tempest-ServersAaction247Test-39568591-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:28.804609 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-fb00d63e-ce99-4836-ae7d-8adc658919f7 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:28.819173 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-fb00d63e-ce99-4836-ae7d-8adc658919f7 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/d85af512-1b1f-42a4-9bb1-963cc956c9ae" status: 200 len: 1470 microversion: 2.1 time: 0.688852 Oct 04 18:38:28.819770 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1041/1928] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:28 2022] GET /compute/v2.1/servers/d85af512-1b1f-42a4-9bb1-963cc956c9ae => generated 1470 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:28.839214 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-c19d89f5-3337-471d-93de-89f914c7d969 tempest-SecurityGroupRulesTestJSON-1076849469 tempest-SecurityGroupRulesTestJSON-1076849469-project] Calling method '.version_select at 0x7fb2246bcaf0>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:28.874506 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-b701f0a9-e996-4519-b7d7-8cf85257a8fe tempest-ServersAaction247Test-39568591 tempest-ServersAaction247Test-39568591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a11a96dc16d456493deb5d6d844dc8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c93660b078ab46a89423cafbb0c192df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:28.897295 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-b701f0a9-e996-4519-b7d7-8cf85257a8fe tempest-ServersAaction247Test-39568591 tempest-ServersAaction247Test-39568591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a11a96dc16d456493deb5d6d844dc8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c93660b078ab46a89423cafbb0c192df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:28.915051 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-b701f0a9-e996-4519-b7d7-8cf85257a8fe tempest-ServersAaction247Test-39568591 tempest-ServersAaction247Test-39568591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a11a96dc16d456493deb5d6d844dc8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c93660b078ab46a89423cafbb0c192df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:28.922501 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-b701f0a9-e996-4519-b7d7-8cf85257a8fe tempest-ServersAaction247Test-39568591 tempest-ServersAaction247Test-39568591-project] 10.222.0.43 "GET /compute/v2.1/servers/212e4404-4e73-4fc5-aacc-e6967180a85f" status: 200 len: 1360 microversion: 2.47 time: 0.320147 Oct 04 18:38:28.924799 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 888/1929] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:38:28 2022] GET /compute/v2.1/servers/212e4404-4e73-4fc5-aacc-e6967180a85f => generated 1360 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:38:28.936086 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-348bc002-549a-43af-8b56-5a0d9ef46574 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:28.942323 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-348bc002-549a-43af-8b56-5a0d9ef46574 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] [instance: 6eb9c803-dd97-4af5-b0d0-aa6fc18f8a89] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:28.969211 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=4 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:38:28.978778 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-348bc002-549a-43af-8b56-5a0d9ef46574 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:28.979283 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-348bc002-549a-43af-8b56-5a0d9ef46574 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:28.988077 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-348bc002-549a-43af-8b56-5a0d9ef46574 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:28.992746 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-348bc002-549a-43af-8b56-5a0d9ef46574 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:28.993274 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-348bc002-549a-43af-8b56-5a0d9ef46574 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:28.993772 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-348bc002-549a-43af-8b56-5a0d9ef46574 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:29.046822 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=28 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:38:29.670004 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-348bc002-549a-43af-8b56-5a0d9ef46574 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e30c6d7042ca444a86e2260692ea048e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c54096058d4c9a8ea436329e25ecbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:29.688821 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-348bc002-549a-43af-8b56-5a0d9ef46574 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] 10.222.0.43 "GET /compute/v2.1/servers/6eb9c803-dd97-4af5-b0d0-aa6fc18f8a89" status: 200 len: 1318 microversion: 2.1 time: 0.761538 Oct 04 18:38:29.689826 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 889/1930] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:28 2022] GET /compute/v2.1/servers/6eb9c803-dd97-4af5-b0d0-aa6fc18f8a89 => generated 1318 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:29.695051 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-1fde6f70-38b1-41ab-8c45-d3dc566753a0 tempest-ServersAaction247Test-39568591 tempest-ServersAaction247Test-39568591-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-1667955416"}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:38:29.700269 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-1fde6f70-38b1-41ab-8c45-d3dc566753a0 tempest-ServersAaction247Test-39568591 tempest-ServersAaction247Test-39568591-project] [instance: 212e4404-4e73-4fc5-aacc-e6967180a85f] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:29.735677 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1fde6f70-38b1-41ab-8c45-d3dc566753a0 tempest-ServersAaction247Test-39568591 tempest-ServersAaction247Test-39568591-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:29.740505 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1fde6f70-38b1-41ab-8c45-d3dc566753a0 tempest-ServersAaction247Test-39568591 tempest-ServersAaction247Test-39568591-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:29.743641 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1fde6f70-38b1-41ab-8c45-d3dc566753a0 tempest-ServersAaction247Test-39568591 tempest-ServersAaction247Test-39568591-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:29.762121 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1fde6f70-38b1-41ab-8c45-d3dc566753a0 tempest-ServersAaction247Test-39568591 tempest-ServersAaction247Test-39568591-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:29.763771 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1fde6f70-38b1-41ab-8c45-d3dc566753a0 tempest-ServersAaction247Test-39568591 tempest-ServersAaction247Test-39568591-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:29.764491 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1fde6f70-38b1-41ab-8c45-d3dc566753a0 tempest-ServersAaction247Test-39568591 tempest-ServersAaction247Test-39568591-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:30.187206 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-c19d89f5-3337-471d-93de-89f914c7d969 tempest-SecurityGroupRulesTestJSON-1076849469 tempest-SecurityGroupRulesTestJSON-1076849469-project] 10.222.0.43 "DELETE /compute/v2.1/os-security-groups/c27f7588-da25-48e3-8efc-005fb1eb49d8" status: 202 len: 0 microversion: 2.1 time: 1.362775 Oct 04 18:38:30.192969 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1042/1931] 10.222.0.43 () {58 vars in 1272 bytes} [Tue Oct 4 18:38:28 2022] DELETE /compute/v2.1/os-security-groups/c27f7588-da25-48e3-8efc-005fb1eb49d8 => generated 0 bytes in 1369 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:38:30.198876 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-1a08c8dc-9a91-429f-b92a-4adcbfbc13a6 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:30.200247 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-1a08c8dc-9a91-429f-b92a-4adcbfbc13a6 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] [instance: 36d7eb4f-22bc-4047-bc75-6f69142daee5] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:30.228853 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1a08c8dc-9a91-429f-b92a-4adcbfbc13a6 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:30.229710 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1a08c8dc-9a91-429f-b92a-4adcbfbc13a6 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:30.230663 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1a08c8dc-9a91-429f-b92a-4adcbfbc13a6 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:30.238297 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1a08c8dc-9a91-429f-b92a-4adcbfbc13a6 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:30.239182 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1a08c8dc-9a91-429f-b92a-4adcbfbc13a6 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:30.240336 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1a08c8dc-9a91-429f-b92a-4adcbfbc13a6 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:30.251439 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-1fde6f70-38b1-41ab-8c45-d3dc566753a0 tempest-ServersAaction247Test-39568591 tempest-ServersAaction247Test-39568591-project] 10.222.0.43 "POST /compute/v2.1/servers/212e4404-4e73-4fc5-aacc-e6967180a85f/action" status: 202 len: 52 microversion: 2.47 time: 0.559468 Oct 04 18:38:30.262773 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 890/1932] 10.222.0.43 () {62 vars in 1319 bytes} [Tue Oct 4 18:38:29 2022] POST /compute/v2.1/servers/212e4404-4e73-4fc5-aacc-e6967180a85f/action => generated 52 bytes in 572 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Oct 04 18:38:30.303891 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-93fb2f21-5f75-46d6-aa61-a9561b5fb01f tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:30.310073 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-93fb2f21-5f75-46d6-aa61-a9561b5fb01f tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: d85af512-1b1f-42a4-9bb1-963cc956c9ae] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:30.348229 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-93fb2f21-5f75-46d6-aa61-a9561b5fb01f tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:30.351469 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-93fb2f21-5f75-46d6-aa61-a9561b5fb01f tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:30.352757 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-93fb2f21-5f75-46d6-aa61-a9561b5fb01f tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:30.357576 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-93fb2f21-5f75-46d6-aa61-a9561b5fb01f tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:30.362614 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-93fb2f21-5f75-46d6-aa61-a9561b5fb01f tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:30.364744 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-93fb2f21-5f75-46d6-aa61-a9561b5fb01f tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:31.004234 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-93fb2f21-5f75-46d6-aa61-a9561b5fb01f tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:31.024552 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-93fb2f21-5f75-46d6-aa61-a9561b5fb01f tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/d85af512-1b1f-42a4-9bb1-963cc956c9ae" status: 200 len: 1470 microversion: 2.1 time: 0.757967 Oct 04 18:38:31.033071 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 891/1933] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:30 2022] GET /compute/v2.1/servers/d85af512-1b1f-42a4-9bb1-963cc956c9ae => generated 1470 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:31.053959 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-ffaf8a20-9120-4ffc-a7c4-47ed83e8dcf1 req-ebb33f2b-a1f2-4dd5-8781-c9dd321635b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d85af512-1b1f-42a4-9bb1-963cc956c9ae", "name": "network-vif-plugged", "status": "completed", "tag": "002dee45-b64c-4706-ab5c-1e8e34d83258"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:38:31.059269 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-1a08c8dc-9a91-429f-b92a-4adcbfbc13a6 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eadce040fcf3427abab9ef8b0ca19400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f4f9b0233b4fb29963b77248a236f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:31.071722 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-1a08c8dc-9a91-429f-b92a-4adcbfbc13a6 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] 10.222.0.43 "GET /compute/v2.1/servers/36d7eb4f-22bc-4047-bc75-6f69142daee5" status: 200 len: 1323 microversion: 2.1 time: 0.877525 Oct 04 18:38:31.080077 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-ffaf8a20-9120-4ffc-a7c4-47ed83e8dcf1 req-ebb33f2b-a1f2-4dd5-8781-c9dd321635b7 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:31.081022 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1043/1934] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:30 2022] GET /compute/v2.1/servers/36d7eb4f-22bc-4047-bc75-6f69142daee5 => generated 1323 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:31.081413 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-ffaf8a20-9120-4ffc-a7c4-47ed83e8dcf1 req-ebb33f2b-a1f2-4dd5-8781-c9dd321635b7 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:31.082090 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-ffaf8a20-9120-4ffc-a7c4-47ed83e8dcf1 req-ebb33f2b-a1f2-4dd5-8781-c9dd321635b7 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:31.099514 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-ffaf8a20-9120-4ffc-a7c4-47ed83e8dcf1 req-ebb33f2b-a1f2-4dd5-8781-c9dd321635b7 service nova] Creating event network-vif-plugged:002dee45-b64c-4706-ab5c-1e8e34d83258 for instance d85af512-1b1f-42a4-9bb1-963cc956c9ae on n-h1-851028-13 Oct 04 18:38:31.113097 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [req-ffaf8a20-9120-4ffc-a7c4-47ed83e8dcf1 req-ebb33f2b-a1f2-4dd5-8781-c9dd321635b7 service nova] Instance d85af512-1b1f-42a4-9bb1-963cc956c9ae is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851028-13', 'n-h2-851028-13'} {{(pid=123595) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 18:38:31.118640 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-4ce7d757-5977-4cff-9372-506977a93285 tempest-SecurityGroupRulesTestJSON-1076849469 tempest-SecurityGroupRulesTestJSON-1076849469-project] Calling method '.version_select at 0x7fb22445f310>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:31.156137 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-ffaf8a20-9120-4ffc-a7c4-47ed83e8dcf1 req-ebb33f2b-a1f2-4dd5-8781-c9dd321635b7 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118905 Oct 04 18:38:31.157486 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 892/1935] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:38:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:38:31.164832 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-0d61d390-bb6d-42db-80cb-951c25a403e6 tempest-ServersAaction247Test-39568591 tempest-ServersAaction247Test-39568591-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:31.175514 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-0d61d390-bb6d-42db-80cb-951c25a403e6 tempest-ServersAaction247Test-39568591 tempest-ServersAaction247Test-39568591-project] [instance: 212e4404-4e73-4fc5-aacc-e6967180a85f] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:31.190259 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0d61d390-bb6d-42db-80cb-951c25a403e6 tempest-ServersAaction247Test-39568591 tempest-ServersAaction247Test-39568591-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:31.192776 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0d61d390-bb6d-42db-80cb-951c25a403e6 tempest-ServersAaction247Test-39568591 tempest-ServersAaction247Test-39568591-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:31.193594 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0d61d390-bb6d-42db-80cb-951c25a403e6 tempest-ServersAaction247Test-39568591 tempest-ServersAaction247Test-39568591-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:31.195793 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0d61d390-bb6d-42db-80cb-951c25a403e6 tempest-ServersAaction247Test-39568591 tempest-ServersAaction247Test-39568591-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:31.198446 n-d-851028-13 devstack@n-api.service[123596]: DEBUG neutronclient.v2_0.client [None req-4ce7d757-5977-4cff-9372-506977a93285 tempest-SecurityGroupRulesTestJSON-1076849469 tempest-SecurityGroupRulesTestJSON-1076849469-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 21c3fa35-70d2-493d-8c18-fc1383c44395 does not exist", "detail": ""}} {{(pid=123596) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 18:38:31.199445 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0d61d390-bb6d-42db-80cb-951c25a403e6 tempest-ServersAaction247Test-39568591 tempest-ServersAaction247Test-39568591-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:31.199779 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.network.security_group_api [None req-4ce7d757-5977-4cff-9372-506977a93285 tempest-SecurityGroupRulesTestJSON-1076849469 tempest-SecurityGroupRulesTestJSON-1076849469-project] Neutron security group 21c3fa35-70d2-493d-8c18-fc1383c44395 not found {{(pid=123596) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 04 18:38:31.200113 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0d61d390-bb6d-42db-80cb-951c25a403e6 tempest-ServersAaction247Test-39568591 tempest-ServersAaction247Test-39568591-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:31.201599 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-4ce7d757-5977-4cff-9372-506977a93285 tempest-SecurityGroupRulesTestJSON-1076849469 tempest-SecurityGroupRulesTestJSON-1076849469-project] HTTP exception thrown: Security group 21c3fa35-70d2-493d-8c18-fc1383c44395 does not exist Oct 04 18:38:31.201599 n-d-851028-13 devstack@n-api.service[123596]: Neutron server returns request_ids: ['req-4f5af30e-1412-4885-90b6-92b134cb969b'] Oct 04 18:38:31.212825 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-4ce7d757-5977-4cff-9372-506977a93285 tempest-SecurityGroupRulesTestJSON-1076849469 tempest-SecurityGroupRulesTestJSON-1076849469-project] Request method failure captured: Oct 04 18:38:31.212825 n-d-851028-13 devstack@n-api.service[123596]: request: DELETE /compute/v2.1/os-security-groups/21c3fa35-70d2-493d-8c18-fc1383c44395 HTTP/1.1 Oct 04 18:38:31.212825 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:38:31.212825 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:38:31.212825 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:38:31.212825 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 18:38:31.212825 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:38:31.212825 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:38:31.212825 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:38:31.212825 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:38:31.212825 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPH2J04p2094A3AH1ilZvb9Xiu_lT7uEDZqpk1dpX_7VHnIYqEGClWqgjYCqM4jIGh8B57WrO5wXKPMsZaoW6jbT6hRvDXIAfSK2eD-vqeQV_zrbRG1F88GLhmfHsf90XbHI4e6pU4B0_56mZMHrgiEz9Zr3YCq8_IFLC8_M2ephk23Q Oct 04 18:38:31.212825 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:38:31.212825 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:38:31.212825 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:38:31.212825 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:38:31.212825 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:38:31.212825 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:38:31.212825 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: 056c919d1ad5402d9c92ab493d386e03 Oct 04 18:38:31.212825 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-SecurityGroupRulesTestJSON-1076849469 Oct 04 18:38:31.212825 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 18:38:31.212825 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 18:38:31.212825 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/056c919d1ad5402d9c92ab493d386e03"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_056c919d1ad5402d9c92ab493d386e03"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/056c919d1ad5402d9c92ab493d386e03"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/056c919d1ad5402d9c92ab493d386e03"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:38:31.212825 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-SecurityGroupRulesTestJSON-1076849469 Oct 04 18:38:31.212825 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: 056c919d1ad5402d9c92ab493d386e03 Oct 04 18:38:31.212825 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-SecurityGroupRulesTestJSON-1076849469 Oct 04 18:38:31.212825 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-SecurityGroupRulesTestJSON-1076849469-project Oct 04 18:38:31.212825 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:38:31.212825 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:38:31.212825 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: c224bc0024284996900ef0197ec285bf Oct 04 18:38:31.212825 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-SecurityGroupRulesTestJSON-1076849469-project Oct 04 18:38:31.212825 n-d-851028-13 devstack@n-api.service[123596]: method: Oct 04 18:38:31.212825 n-d-851028-13 devstack@n-api.service[123596]: exception: Security group 21c3fa35-70d2-493d-8c18-fc1383c44395 does not exist Oct 04 18:38:31.212825 n-d-851028-13 devstack@n-api.service[123596]: Neutron server returns request_ids: ['req-4f5af30e-1412-4885-90b6-92b134cb969b'] Oct 04 18:38:31.212825 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': '21c3fa35-70d2-493d-8c18-fc1383c44395'} Oct 04 18:38:31.212825 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:38:31.212825 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:38:31.212825 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 04 18:38:31.212825 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 04 18:38:31.212825 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:38:31.212825 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:38:31.212825 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 04 18:38:31.212825 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 04 18:38:31.212825 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:38:31.212825 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:38:31.212825 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 18:38:31.212825 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 18:38:31.212825 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:38:31.212825 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:38:31.212825 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 18:38:31.212825 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 18:38:31.212825 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:38:31.212825 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:38:31.212825 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 18:38:31.212825 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 18:38:31.212825 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:38:31.212825 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:38:31.212825 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 18:38:31.212825 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 18:38:31.212825 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 18:38:31.212825 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 18:38:31.212825 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 21c3fa35-70d2-493d-8c18-fc1383c44395 does not exist Oct 04 18:38:31.220504 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4f5af30e-1412-4885-90b6-92b134cb969b'] Oct 04 18:38:31.220504 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:38:31.220504 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:38:31.220504 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:38:31.220504 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:38:31.220504 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 04 18:38:31.220504 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 04 18:38:31.220504 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 04 18:38:31.220504 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 18:38:31.220504 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 21c3fa35-70d2-493d-8c18-fc1383c44395 does not exist Oct 04 18:38:31.220504 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4f5af30e-1412-4885-90b6-92b134cb969b'] Oct 04 18:38:31.220504 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:38:31.220504 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:38:31.220504 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:38:31.220504 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:38:31.220504 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:38:31.220504 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:38:31.220504 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:38:31.220504 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:38:31.220504 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:38:31.220504 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:38:31.220504 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:38:31.220504 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:38:31.220504 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 04 18:38:31.220504 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 04 18:38:31.220504 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 21c3fa35-70d2-493d-8c18-fc1383c44395 does not exist Oct 04 18:38:31.220504 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4f5af30e-1412-4885-90b6-92b134cb969b'] Oct 04 18:38:31.220504 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:38:31.220504 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:38:31.220504 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:38:31.220504 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:38:31.220504 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:38:31.220504 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:38:31.220504 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:38:31.220504 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:38:31.220504 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 21c3fa35-70d2-493d-8c18-fc1383c44395 does not exist Oct 04 18:38:31.220504 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4f5af30e-1412-4885-90b6-92b134cb969b'] Oct 04 18:38:31.220504 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:38:31.220504 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-4ce7d757-5977-4cff-9372-506977a93285 tempest-SecurityGroupRulesTestJSON-1076849469 tempest-SecurityGroupRulesTestJSON-1076849469-project] Returning 404 to user: Security group 21c3fa35-70d2-493d-8c18-fc1383c44395 does not exist Oct 04 18:38:31.220504 n-d-851028-13 devstack@n-api.service[123596]: Neutron server returns request_ids: ['req-4f5af30e-1412-4885-90b6-92b134cb969b'] {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:38:31.231956 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-4ce7d757-5977-4cff-9372-506977a93285 tempest-SecurityGroupRulesTestJSON-1076849469 tempest-SecurityGroupRulesTestJSON-1076849469-project] 10.222.0.43 "DELETE /compute/v2.1/os-security-groups/21c3fa35-70d2-493d-8c18-fc1383c44395" status: 404 len: 194 microversion: 2.1 time: 0.139820 Oct 04 18:38:31.231956 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1044/1936] 10.222.0.43 () {58 vars in 1272 bytes} [Tue Oct 4 18:38:31 2022] DELETE /compute/v2.1/os-security-groups/21c3fa35-70d2-493d-8c18-fc1383c44395 => generated 194 bytes in 143 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:38:31.239224 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-38c5f5eb-73d6-458f-bb21-dbe547a34c2c tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:31.239877 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-38c5f5eb-73d6-458f-bb21-dbe547a34c2c tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] [instance: 6eb9c803-dd97-4af5-b0d0-aa6fc18f8a89] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:31.276265 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-38c5f5eb-73d6-458f-bb21-dbe547a34c2c tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:31.277670 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-38c5f5eb-73d6-458f-bb21-dbe547a34c2c tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:31.279518 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-38c5f5eb-73d6-458f-bb21-dbe547a34c2c tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:31.282092 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-38c5f5eb-73d6-458f-bb21-dbe547a34c2c tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:31.282711 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-0d61d390-bb6d-42db-80cb-951c25a403e6 tempest-ServersAaction247Test-39568591 tempest-ServersAaction247Test-39568591-project] [instance: 212e4404-4e73-4fc5-aacc-e6967180a85f] Going to try to terminate instance {{(pid=123595) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:38:31.285716 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-38c5f5eb-73d6-458f-bb21-dbe547a34c2c tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:31.290952 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-38c5f5eb-73d6-458f-bb21-dbe547a34c2c tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:31.429978 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-0d61d390-bb6d-42db-80cb-951c25a403e6 tempest-ServersAaction247Test-39568591 tempest-ServersAaction247Test-39568591-project] 10.222.0.43 "DELETE /compute/v2.1/servers/212e4404-4e73-4fc5-aacc-e6967180a85f" status: 204 len: 0 microversion: 2.47 time: 0.268452 Oct 04 18:38:31.431577 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 893/1937] 10.222.0.43 () {60 vars in 1280 bytes} [Tue Oct 4 18:38:31 2022] DELETE /compute/v2.1/servers/212e4404-4e73-4fc5-aacc-e6967180a85f => generated 0 bytes in 273 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 18:38:31.455093 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-2ca50ecb-e0f6-490c-80c3-26cc446ca6ae tempest-SecurityGroupRulesTestJSON-1076849469 tempest-SecurityGroupRulesTestJSON-1076849469-project] Calling method '.version_select at 0x7fb21fef9430>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:31.911371 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-38c5f5eb-73d6-458f-bb21-dbe547a34c2c tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e30c6d7042ca444a86e2260692ea048e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c54096058d4c9a8ea436329e25ecbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:31.923584 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-38c5f5eb-73d6-458f-bb21-dbe547a34c2c tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] 10.222.0.43 "GET /compute/v2.1/servers/6eb9c803-dd97-4af5-b0d0-aa6fc18f8a89" status: 200 len: 1468 microversion: 2.1 time: 0.694788 Oct 04 18:38:31.925315 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1045/1938] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:31 2022] GET /compute/v2.1/servers/6eb9c803-dd97-4af5-b0d0-aa6fc18f8a89 => generated 1468 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:31.934103 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-4723b795-af40-4c31-898a-f83f52afdb07 tempest-ServersAaction247Test-39568591 tempest-ServersAaction247Test-39568591-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:31.935086 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-4723b795-af40-4c31-898a-f83f52afdb07 tempest-ServersAaction247Test-39568591 tempest-ServersAaction247Test-39568591-project] [instance: 212e4404-4e73-4fc5-aacc-e6967180a85f] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:31.956805 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4723b795-af40-4c31-898a-f83f52afdb07 tempest-ServersAaction247Test-39568591 tempest-ServersAaction247Test-39568591-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:31.959338 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4723b795-af40-4c31-898a-f83f52afdb07 tempest-ServersAaction247Test-39568591 tempest-ServersAaction247Test-39568591-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:31.959994 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4723b795-af40-4c31-898a-f83f52afdb07 tempest-ServersAaction247Test-39568591 tempest-ServersAaction247Test-39568591-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:31.963231 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4723b795-af40-4c31-898a-f83f52afdb07 tempest-ServersAaction247Test-39568591 tempest-ServersAaction247Test-39568591-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:31.965345 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4723b795-af40-4c31-898a-f83f52afdb07 tempest-ServersAaction247Test-39568591 tempest-ServersAaction247Test-39568591-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:31.966166 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4723b795-af40-4c31-898a-f83f52afdb07 tempest-ServersAaction247Test-39568591 tempest-ServersAaction247Test-39568591-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:32.144082 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-4723b795-af40-4c31-898a-f83f52afdb07 tempest-ServersAaction247Test-39568591 tempest-ServersAaction247Test-39568591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a11a96dc16d456493deb5d6d844dc8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c93660b078ab46a89423cafbb0c192df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:32.156400 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-4723b795-af40-4c31-898a-f83f52afdb07 tempest-ServersAaction247Test-39568591 tempest-ServersAaction247Test-39568591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a11a96dc16d456493deb5d6d844dc8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c93660b078ab46a89423cafbb0c192df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:32.159606 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-4723b795-af40-4c31-898a-f83f52afdb07 tempest-ServersAaction247Test-39568591 tempest-ServersAaction247Test-39568591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a11a96dc16d456493deb5d6d844dc8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c93660b078ab46a89423cafbb0c192df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:32.162918 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-4723b795-af40-4c31-898a-f83f52afdb07 tempest-ServersAaction247Test-39568591 tempest-ServersAaction247Test-39568591-project] 10.222.0.43 "GET /compute/v2.1/servers/212e4404-4e73-4fc5-aacc-e6967180a85f" status: 200 len: 1366 microversion: 2.47 time: 0.236337 Oct 04 18:38:32.165395 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1046/1939] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:38:31 2022] GET /compute/v2.1/servers/212e4404-4e73-4fc5-aacc-e6967180a85f => generated 1366 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:38:32.183345 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-37556c02-4104-4297-973a-5b3e265b72dd tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:32.184320 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-37556c02-4104-4297-973a-5b3e265b72dd tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] [instance: 0b7f1ede-48b3-48d8-933e-287c338b1e6a] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:32.199194 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-37556c02-4104-4297-973a-5b3e265b72dd tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:32.202953 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-37556c02-4104-4297-973a-5b3e265b72dd tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:32.203623 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-37556c02-4104-4297-973a-5b3e265b72dd tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:32.205235 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-37556c02-4104-4297-973a-5b3e265b72dd tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:32.207109 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-37556c02-4104-4297-973a-5b3e265b72dd tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:32.208201 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-37556c02-4104-4297-973a-5b3e265b72dd tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:32.587982 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-37556c02-4104-4297-973a-5b3e265b72dd tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e30c6d7042ca444a86e2260692ea048e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c54096058d4c9a8ea436329e25ecbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:32.607380 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-37556c02-4104-4297-973a-5b3e265b72dd tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] 10.222.0.43 "GET /compute/v2.1/servers/0b7f1ede-48b3-48d8-933e-287c338b1e6a" status: 200 len: 1467 microversion: 2.1 time: 0.440202 Oct 04 18:38:32.612500 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1047/1940] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:32 2022] GET /compute/v2.1/servers/0b7f1ede-48b3-48d8-933e-287c338b1e6a => generated 1467 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:32.631464 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-af2d0131-aa3e-47d1-af6a-197e0263c280 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:32.633551 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-af2d0131-aa3e-47d1-af6a-197e0263c280 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: d85af512-1b1f-42a4-9bb1-963cc956c9ae] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:32.644851 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-af2d0131-aa3e-47d1-af6a-197e0263c280 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:32.645655 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-af2d0131-aa3e-47d1-af6a-197e0263c280 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:32.646013 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-af2d0131-aa3e-47d1-af6a-197e0263c280 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:32.647021 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-af2d0131-aa3e-47d1-af6a-197e0263c280 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:32.647866 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-af2d0131-aa3e-47d1-af6a-197e0263c280 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:32.648552 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-af2d0131-aa3e-47d1-af6a-197e0263c280 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:32.957101 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-af2d0131-aa3e-47d1-af6a-197e0263c280 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:32.971610 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-af2d0131-aa3e-47d1-af6a-197e0263c280 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/d85af512-1b1f-42a4-9bb1-963cc956c9ae" status: 200 len: 1462 microversion: 2.1 time: 0.357701 Oct 04 18:38:32.972803 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1048/1941] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:32 2022] GET /compute/v2.1/servers/d85af512-1b1f-42a4-9bb1-963cc956c9ae => generated 1462 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:32.982177 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-1f1ca6ff-5594-455b-8fdf-e49cad8d34c2 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:32.983131 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-1f1ca6ff-5594-455b-8fdf-e49cad8d34c2 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] [instance: 36d7eb4f-22bc-4047-bc75-6f69142daee5] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:33.001482 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1f1ca6ff-5594-455b-8fdf-e49cad8d34c2 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:33.002570 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1f1ca6ff-5594-455b-8fdf-e49cad8d34c2 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:33.003620 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1f1ca6ff-5594-455b-8fdf-e49cad8d34c2 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:33.009593 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1f1ca6ff-5594-455b-8fdf-e49cad8d34c2 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:33.010914 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1f1ca6ff-5594-455b-8fdf-e49cad8d34c2 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:33.011705 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1f1ca6ff-5594-455b-8fdf-e49cad8d34c2 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:33.323651 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-2ca50ecb-e0f6-490c-80c3-26cc446ca6ae tempest-SecurityGroupRulesTestJSON-1076849469 tempest-SecurityGroupRulesTestJSON-1076849469-project] 10.222.0.43 "DELETE /compute/v2.1/os-security-groups/e4f1bedc-d19e-41a0-a104-5436e68dfdec" status: 202 len: 0 microversion: 2.1 time: 1.884448 Oct 04 18:38:33.324231 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 894/1942] 10.222.0.43 () {58 vars in 1272 bytes} [Tue Oct 4 18:38:31 2022] DELETE /compute/v2.1/os-security-groups/e4f1bedc-d19e-41a0-a104-5436e68dfdec => generated 0 bytes in 1892 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:38:33.334091 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-929291eb-5edd-408e-bb7e-88b482332c81 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-226989001"}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:38:33.341097 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-929291eb-5edd-408e-bb7e-88b482332c81 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] [instance: 0b7f1ede-48b3-48d8-933e-287c338b1e6a] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:33.361566 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-929291eb-5edd-408e-bb7e-88b482332c81 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:33.362058 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-929291eb-5edd-408e-bb7e-88b482332c81 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:33.366463 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-929291eb-5edd-408e-bb7e-88b482332c81 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:33.367277 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-929291eb-5edd-408e-bb7e-88b482332c81 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:33.367762 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-929291eb-5edd-408e-bb7e-88b482332c81 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:33.368204 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-929291eb-5edd-408e-bb7e-88b482332c81 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:33.412935 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:38:33.538131 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-1f1ca6ff-5594-455b-8fdf-e49cad8d34c2 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eadce040fcf3427abab9ef8b0ca19400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f4f9b0233b4fb29963b77248a236f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:33.553236 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-1f1ca6ff-5594-455b-8fdf-e49cad8d34c2 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] 10.222.0.43 "GET /compute/v2.1/servers/36d7eb4f-22bc-4047-bc75-6f69142daee5" status: 200 len: 1323 microversion: 2.1 time: 0.576455 Oct 04 18:38:33.554148 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1049/1943] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:32 2022] GET /compute/v2.1/servers/36d7eb4f-22bc-4047-bc75-6f69142daee5 => generated 1323 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:33.563387 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-a4dc6b80-3cb8-46da-b450-571d9e7d9012 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-480574222", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "1fac60ec-a479-4aec-9ef2-ec5cc4fb1c50"}], "block_device_mapping_v2": [{"uuid": "3e3fcdfa-8c31-4b78-ae4f-7999b4e06fbe", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:38:33.703811 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.network.neutron [None req-a4dc6b80-3cb8-46da-b450-571d9e7d9012 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] validate_networks() for [('1fac60ec-a479-4aec-9ef2-ec5cc4fb1c50', None, None, None, None, None)] {{(pid=123596) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:38:33.883417 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-929291eb-5edd-408e-bb7e-88b482332c81 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] 10.222.0.43 "POST /compute/v2.1/servers/0b7f1ede-48b3-48d8-933e-287c338b1e6a/action" status: 202 len: 0 microversion: 2.1 time: 0.557055 Oct 04 18:38:33.889518 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 895/1944] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 18:38:33 2022] POST /compute/v2.1/servers/0b7f1ede-48b3-48d8-933e-287c338b1e6a/action => generated 0 bytes in 564 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 04 18:38:33.911707 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-4c14ce37-6940-45e1-8543-7d2e8c78e6a1 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:33.912878 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-4c14ce37-6940-45e1-8543-7d2e8c78e6a1 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: d85af512-1b1f-42a4-9bb1-963cc956c9ae] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:33.939953 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4c14ce37-6940-45e1-8543-7d2e8c78e6a1 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:33.944680 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4c14ce37-6940-45e1-8543-7d2e8c78e6a1 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:33.949246 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4c14ce37-6940-45e1-8543-7d2e8c78e6a1 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:33.950256 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4c14ce37-6940-45e1-8543-7d2e8c78e6a1 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:33.951661 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4c14ce37-6940-45e1-8543-7d2e8c78e6a1 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:33.952431 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4c14ce37-6940-45e1-8543-7d2e8c78e6a1 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:34.327906 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-4c14ce37-6940-45e1-8543-7d2e8c78e6a1 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:34.339373 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-4c14ce37-6940-45e1-8543-7d2e8c78e6a1 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/d85af512-1b1f-42a4-9bb1-963cc956c9ae" status: 200 len: 1462 microversion: 2.1 time: 0.446280 Oct 04 18:38:34.344419 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 896/1945] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:33 2022] GET /compute/v2.1/servers/d85af512-1b1f-42a4-9bb1-963cc956c9ae => generated 1462 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:34.350027 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-c55e0c42-a98f-43ec-b9b8-fa2616f48cb7 tempest-ServersAaction247Test-39568591 tempest-ServersAaction247Test-39568591-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:34.351103 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-c55e0c42-a98f-43ec-b9b8-fa2616f48cb7 tempest-ServersAaction247Test-39568591 tempest-ServersAaction247Test-39568591-project] [instance: 212e4404-4e73-4fc5-aacc-e6967180a85f] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:34.369168 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c55e0c42-a98f-43ec-b9b8-fa2616f48cb7 tempest-ServersAaction247Test-39568591 tempest-ServersAaction247Test-39568591-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:34.369570 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c55e0c42-a98f-43ec-b9b8-fa2616f48cb7 tempest-ServersAaction247Test-39568591 tempest-ServersAaction247Test-39568591-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:34.370312 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c55e0c42-a98f-43ec-b9b8-fa2616f48cb7 tempest-ServersAaction247Test-39568591 tempest-ServersAaction247Test-39568591-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:34.370859 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c55e0c42-a98f-43ec-b9b8-fa2616f48cb7 tempest-ServersAaction247Test-39568591 tempest-ServersAaction247Test-39568591-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:34.371360 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c55e0c42-a98f-43ec-b9b8-fa2616f48cb7 tempest-ServersAaction247Test-39568591 tempest-ServersAaction247Test-39568591-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:34.371802 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c55e0c42-a98f-43ec-b9b8-fa2616f48cb7 tempest-ServersAaction247Test-39568591 tempest-ServersAaction247Test-39568591-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:34.465305 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-a4dc6b80-3cb8-46da-b450-571d9e7d9012 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Flavor limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:38:34.465858 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-a4dc6b80-3cb8-46da-b450-571d9e7d9012 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Image limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:38:34.466351 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-a4dc6b80-3cb8-46da-b450-571d9e7d9012 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Flavor pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:38:34.466764 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-a4dc6b80-3cb8-46da-b450-571d9e7d9012 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Image pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:38:34.467374 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-a4dc6b80-3cb8-46da-b450-571d9e7d9012 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:38:34.482088 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a4dc6b80-3cb8-46da-b450-571d9e7d9012 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:34.482593 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a4dc6b80-3cb8-46da-b450-571d9e7d9012 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:34.483100 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a4dc6b80-3cb8-46da-b450-571d9e7d9012 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:34.483852 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a4dc6b80-3cb8-46da-b450-571d9e7d9012 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:34.484317 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a4dc6b80-3cb8-46da-b450-571d9e7d9012 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:34.484753 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a4dc6b80-3cb8-46da-b450-571d9e7d9012 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:34.504160 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-a4dc6b80-3cb8-46da-b450-571d9e7d9012 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Getting quotas for project 34199e342c1b4158abf82384f2213b5f. Resources: {'ram', 'cores', 'instances'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:38:34.506831 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-c55e0c42-a98f-43ec-b9b8-fa2616f48cb7 tempest-ServersAaction247Test-39568591 tempest-ServersAaction247Test-39568591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a11a96dc16d456493deb5d6d844dc8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c93660b078ab46a89423cafbb0c192df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:34.508778 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-a4dc6b80-3cb8-46da-b450-571d9e7d9012 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Getting quotas for user 807a4a88319946aead73a3ccfcda6aeb and project 34199e342c1b4158abf82384f2213b5f. Resources: {'ram', 'cores', 'instances'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:38:34.527070 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-c55e0c42-a98f-43ec-b9b8-fa2616f48cb7 tempest-ServersAaction247Test-39568591 tempest-ServersAaction247Test-39568591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a11a96dc16d456493deb5d6d844dc8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c93660b078ab46a89423cafbb0c192df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:34.535708 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-c55e0c42-a98f-43ec-b9b8-fa2616f48cb7 tempest-ServersAaction247Test-39568591 tempest-ServersAaction247Test-39568591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a11a96dc16d456493deb5d6d844dc8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c93660b078ab46a89423cafbb0c192df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:34.538591 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-c55e0c42-a98f-43ec-b9b8-fa2616f48cb7 tempest-ServersAaction247Test-39568591 tempest-ServersAaction247Test-39568591-project] 10.222.0.43 "GET /compute/v2.1/servers/212e4404-4e73-4fc5-aacc-e6967180a85f" status: 200 len: 1366 microversion: 2.47 time: 0.191323 Oct 04 18:38:34.539498 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 897/1946] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:38:34 2022] GET /compute/v2.1/servers/212e4404-4e73-4fc5-aacc-e6967180a85f => generated 1366 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:38:34.545172 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-3527df51-0e5a-40f5-9af8-2a25cab82c14 tempest-SecurityGroupRulesTestJSON-1076849469 tempest-SecurityGroupRulesTestJSON-1076849469-project] Calling method '.version_select at 0x7fb21fe1e550>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:34.599867 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-a4dc6b80-3cb8-46da-b450-571d9e7d9012 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Going to run 1 instances... {{(pid=123596) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:38:34.605824 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-a4dc6b80-3cb8-46da-b450-571d9e7d9012 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] [instance: d1f298aa-ebe3-4f52-ada6-137a782cd9b7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3e3fcdfa-8c31-4b78-ae4f-7999b4e06fbe',volume_size=None,volume_type=None)] {{(pid=123596) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:38:34.858534 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-a4dc6b80-3cb8-46da-b450-571d9e7d9012 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.302855 Oct 04 18:38:34.859936 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1050/1947] 10.222.0.43 () {62 vars in 1188 bytes} [Tue Oct 4 18:38:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 1305 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 04 18:38:34.865468 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-405a5d97-5563-4bc7-9d90-f5f487390090 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Calling method '.version_select at 0x7fb21fe3af70>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:34.936429 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-3527df51-0e5a-40f5-9af8-2a25cab82c14 tempest-SecurityGroupRulesTestJSON-1076849469 tempest-SecurityGroupRulesTestJSON-1076849469-project] 10.222.0.43 "DELETE /compute/v2.1/os-security-groups/0c2e26b9-0ccf-406d-90c8-a635688a0166" status: 202 len: 0 microversion: 2.1 time: 0.395696 Oct 04 18:38:34.937433 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 898/1948] 10.222.0.43 () {58 vars in 1272 bytes} [Tue Oct 4 18:38:34 2022] DELETE /compute/v2.1/os-security-groups/0c2e26b9-0ccf-406d-90c8-a635688a0166 => generated 0 bytes in 397 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:38:34.955543 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-405a5d97-5563-4bc7-9d90-f5f487390090 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] 10.222.0.43 "GET /compute/v2.1/images/e5989b78-5925-4d33-8625-f3af6fa4e64d" status: 200 len: 1454 microversion: 2.1 time: 0.093826 Oct 04 18:38:34.957754 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1051/1949] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 18:38:34 2022] GET /compute/v2.1/images/e5989b78-5925-4d33-8625-f3af6fa4e64d => generated 1454 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:34.972623 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-01a7327c-bd1a-477c-9715-9d9aa635e80a req-936e2cf0-2246-42d9-bd49-99507398626e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36d7eb4f-22bc-4047-bc75-6f69142daee5", "name": "network-vif-plugged", "status": "completed", "tag": "e3d142e8-c4f2-49f8-af0d-f2e13e22b36f"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:38:35.002801 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-01a7327c-bd1a-477c-9715-9d9aa635e80a req-936e2cf0-2246-42d9-bd49-99507398626e service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:35.003374 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-01a7327c-bd1a-477c-9715-9d9aa635e80a req-936e2cf0-2246-42d9-bd49-99507398626e service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:35.004013 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-01a7327c-bd1a-477c-9715-9d9aa635e80a req-936e2cf0-2246-42d9-bd49-99507398626e service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:35.033355 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-01a7327c-bd1a-477c-9715-9d9aa635e80a req-936e2cf0-2246-42d9-bd49-99507398626e service nova] Creating event network-vif-plugged:e3d142e8-c4f2-49f8-af0d-f2e13e22b36f for instance 36d7eb4f-22bc-4047-bc75-6f69142daee5 on n-h2-851028-13 Oct 04 18:38:35.046245 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-01a7327c-bd1a-477c-9715-9d9aa635e80a req-936e2cf0-2246-42d9-bd49-99507398626e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085275 Oct 04 18:38:35.049470 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1052/1950] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:38:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:38:35.057887 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-1375e5d7-e1e5-4600-a354-d49d2c8ccac4 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Action: 'create', calling method: .version_select at 0x7fb21fe785e0>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-892969997", "policies": ["affinity"]}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:38:35.059249 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-6e56bd75-4343-49c8-bc51-23058270a1e0 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Action: 'create', calling method: .version_select at 0x7fb22410b940>, body: {"keypair": {"name": "tempest-keypair-769895920", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGyZwdd1M+tA1LGdt2cloLs2CgIWF0/OAmO9tsogIVS7g8Uhnyk0UNTzBW1ViJOq9tqCqvljMqy8QgtSN9C5qeFS/TNzsrRU5GIEkZMbxTwx0r9Mqh6HQCrk6ctRnnTblQ=="}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:38:35.091937 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-1375e5d7-e1e5-4600-a354-d49d2c8ccac4 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Getting quotas for project 5f3ca2b15fd24916ac47e08325464d75. Resources: {'server_groups'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:38:35.106445 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-6e56bd75-4343-49c8-bc51-23058270a1e0 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Getting quotas for project 50a6a1a86a59403dad27f6e3c628853c. Resources: {'key_pairs'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:38:35.109413 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-1375e5d7-e1e5-4600-a354-d49d2c8ccac4 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Getting quotas for user 6daea1f7b0084009ac6e24181a1b87d7 and project 5f3ca2b15fd24916ac47e08325464d75. Resources: {'server_groups'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:38:35.127417 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-6e56bd75-4343-49c8-bc51-23058270a1e0 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Getting quotas for user 581885ffa737444eafa3179cceb6ee1d and project 50a6a1a86a59403dad27f6e3c628853c. Resources: {'key_pairs'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:38:35.177369 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-6e56bd75-4343-49c8-bc51-23058270a1e0 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.123749 Oct 04 18:38:35.184949 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1053/1951] 10.222.0.43 () {60 vars in 1159 bytes} [Tue Oct 4 18:38:35 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:38:35.190502 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-24adae4a-8edf-4ff0-82ba-a859317bc557 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:35.191275 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-24adae4a-8edf-4ff0-82ba-a859317bc557 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] [instance: 36d7eb4f-22bc-4047-bc75-6f69142daee5] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:35.201191 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-24adae4a-8edf-4ff0-82ba-a859317bc557 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:35.201802 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-24adae4a-8edf-4ff0-82ba-a859317bc557 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:35.202298 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-24adae4a-8edf-4ff0-82ba-a859317bc557 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:35.203103 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-24adae4a-8edf-4ff0-82ba-a859317bc557 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:35.204579 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-24adae4a-8edf-4ff0-82ba-a859317bc557 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:35.204943 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-24adae4a-8edf-4ff0-82ba-a859317bc557 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:35.279922 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-1375e5d7-e1e5-4600-a354-d49d2c8ccac4 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Getting quotas for project 5f3ca2b15fd24916ac47e08325464d75. Resources: {'server_groups'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:38:35.286057 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-1375e5d7-e1e5-4600-a354-d49d2c8ccac4 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Getting quotas for user 6daea1f7b0084009ac6e24181a1b87d7 and project 5f3ca2b15fd24916ac47e08325464d75. Resources: {'server_groups'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:38:35.300748 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-1375e5d7-e1e5-4600-a354-d49d2c8ccac4 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] 10.222.0.43 "POST /compute/v2.1/os-server-groups" status: 200 len: 183 microversion: 2.1 time: 0.361315 Oct 04 18:38:35.302131 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 899/1952] 10.222.0.43 () {60 vars in 1174 bytes} [Tue Oct 4 18:38:34 2022] POST /compute/v2.1/os-server-groups => generated 183 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:38:35.389093 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-c6527cd5-dca2-4333-afd3-c4d31ac94867 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Action: 'create', calling method: .version_select at 0x7fb21fc5ec10>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-286313683", "description": "tempest-description-1796131283"}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:38:35.783265 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-c6527cd5-dca2-4333-afd3-c4d31ac94867 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] 10.222.0.43 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.479582 Oct 04 18:38:35.786863 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 900/1953] 10.222.0.43 () {60 vars in 1180 bytes} [Tue Oct 4 18:38:35 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:38:35.804298 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-3a08f857-484b-4d15-b1af-196a996870ba tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:35.805543 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-3a08f857-484b-4d15-b1af-196a996870ba tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] [instance: d1f298aa-ebe3-4f52-ada6-137a782cd9b7] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:35.819878 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3a08f857-484b-4d15-b1af-196a996870ba tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:35.820786 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3a08f857-484b-4d15-b1af-196a996870ba tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:35.821520 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3a08f857-484b-4d15-b1af-196a996870ba tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:35.823288 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3a08f857-484b-4d15-b1af-196a996870ba tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:35.824338 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3a08f857-484b-4d15-b1af-196a996870ba tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:35.825267 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3a08f857-484b-4d15-b1af-196a996870ba tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:35.910870 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-3a08f857-484b-4d15-b1af-196a996870ba tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:35.921474 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-3a08f857-484b-4d15-b1af-196a996870ba tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:35.923877 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-3a08f857-484b-4d15-b1af-196a996870ba tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:35.925731 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-3a08f857-484b-4d15-b1af-196a996870ba tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] 10.222.0.43 "GET /compute/v2.1/servers/d1f298aa-ebe3-4f52-ada6-137a782cd9b7" status: 200 len: 1184 microversion: 2.25 time: 0.136875 Oct 04 18:38:35.941638 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 901/1954] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:38:35 2022] GET /compute/v2.1/servers/d1f298aa-ebe3-4f52-ada6-137a782cd9b7 => generated 1184 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:38:35.941638 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-577ed5f7-7194-468f-bdea-531029ad1f25 tempest-SecurityGroupRulesTestJSON-1076849469 tempest-SecurityGroupRulesTestJSON-1076849469-project] Calling method '.version_select at 0x7fb21fecde50>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:35.947037 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-24adae4a-8edf-4ff0-82ba-a859317bc557 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eadce040fcf3427abab9ef8b0ca19400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f4f9b0233b4fb29963b77248a236f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:35.968242 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-24adae4a-8edf-4ff0-82ba-a859317bc557 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] 10.222.0.43 "GET /compute/v2.1/servers/36d7eb4f-22bc-4047-bc75-6f69142daee5" status: 200 len: 1323 microversion: 2.1 time: 0.782073 Oct 04 18:38:35.992059 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1054/1955] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:35 2022] GET /compute/v2.1/servers/36d7eb4f-22bc-4047-bc75-6f69142daee5 => generated 1323 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:36.006136 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-7855762f-4282-4a55-be4b-f320ce2fa61f tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Action: 'create', calling method: .version_select at 0x7fb22445fca0>, body: {"server_group": {"name": "tempest-server-group-1475897676", "policies": ["affinity"]}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:38:36.073743 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-7855762f-4282-4a55-be4b-f320ce2fa61f tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Getting quotas for project 5f3ca2b15fd24916ac47e08325464d75. Resources: {'server_groups'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:38:36.084645 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-7855762f-4282-4a55-be4b-f320ce2fa61f tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Getting quotas for user 6daea1f7b0084009ac6e24181a1b87d7 and project 5f3ca2b15fd24916ac47e08325464d75. Resources: {'server_groups'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:38:36.227359 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-7855762f-4282-4a55-be4b-f320ce2fa61f tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Getting quotas for project 5f3ca2b15fd24916ac47e08325464d75. Resources: {'server_groups'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:38:36.238499 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-7855762f-4282-4a55-be4b-f320ce2fa61f tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Getting quotas for user 6daea1f7b0084009ac6e24181a1b87d7 and project 5f3ca2b15fd24916ac47e08325464d75. Resources: {'server_groups'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:38:36.255753 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-7855762f-4282-4a55-be4b-f320ce2fa61f tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] 10.222.0.43 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.261044 Oct 04 18:38:36.257610 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1055/1956] 10.222.0.43 () {60 vars in 1173 bytes} [Tue Oct 4 18:38:35 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:38:36.262014 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-577ed5f7-7194-468f-bdea-531029ad1f25 tempest-SecurityGroupRulesTestJSON-1076849469 tempest-SecurityGroupRulesTestJSON-1076849469-project] 10.222.0.43 "DELETE /compute/v2.1/os-security-groups/c260fcd4-8a0b-4426-8637-b6bb824111be" status: 202 len: 0 microversion: 2.1 time: 0.332760 Oct 04 18:38:36.263048 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 902/1957] 10.222.0.43 () {58 vars in 1272 bytes} [Tue Oct 4 18:38:35 2022] DELETE /compute/v2.1/os-security-groups/c260fcd4-8a0b-4426-8637-b6bb824111be => generated 0 bytes in 335 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:38:36.273535 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-9353d135-849b-4431-a76a-19e00fe5903b tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Action: 'create', calling method: .version_select at 0x7fb21fe1e040>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1675967602", "description": "tempest-description-2023348416"}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:38:36.288829 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-9bde2811-7cf4-4da4-853a-e40a37214db7 tempest-ServersAaction247Test-39568591 tempest-ServersAaction247Test-39568591-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:36.289681 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-9bde2811-7cf4-4da4-853a-e40a37214db7 tempest-ServersAaction247Test-39568591 tempest-ServersAaction247Test-39568591-project] [instance: 212e4404-4e73-4fc5-aacc-e6967180a85f] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:36.305056 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9bde2811-7cf4-4da4-853a-e40a37214db7 tempest-ServersAaction247Test-39568591 tempest-ServersAaction247Test-39568591-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:36.305741 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9bde2811-7cf4-4da4-853a-e40a37214db7 tempest-ServersAaction247Test-39568591 tempest-ServersAaction247Test-39568591-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:36.308746 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9bde2811-7cf4-4da4-853a-e40a37214db7 tempest-ServersAaction247Test-39568591 tempest-ServersAaction247Test-39568591-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:36.309855 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9bde2811-7cf4-4da4-853a-e40a37214db7 tempest-ServersAaction247Test-39568591 tempest-ServersAaction247Test-39568591-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:36.312393 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9bde2811-7cf4-4da4-853a-e40a37214db7 tempest-ServersAaction247Test-39568591 tempest-ServersAaction247Test-39568591-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:36.313737 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9bde2811-7cf4-4da4-853a-e40a37214db7 tempest-ServersAaction247Test-39568591 tempest-ServersAaction247Test-39568591-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:36.477147 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9bde2811-7cf4-4da4-853a-e40a37214db7 tempest-ServersAaction247Test-39568591 tempest-ServersAaction247Test-39568591-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:36.478055 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9bde2811-7cf4-4da4-853a-e40a37214db7 tempest-ServersAaction247Test-39568591 tempest-ServersAaction247Test-39568591-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:36.478820 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9bde2811-7cf4-4da4-853a-e40a37214db7 tempest-ServersAaction247Test-39568591 tempest-ServersAaction247Test-39568591-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:36.479464 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.objects.instance [None req-9bde2811-7cf4-4da4-853a-e40a37214db7 tempest-ServersAaction247Test-39568591 tempest-ServersAaction247Test-39568591-project] Lazy-loading 'fault' on Instance uuid 212e4404-4e73-4fc5-aacc-e6967180a85f {{(pid=123596) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:38:36.579536 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-9bde2811-7cf4-4da4-853a-e40a37214db7 tempest-ServersAaction247Test-39568591 tempest-ServersAaction247Test-39568591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a11a96dc16d456493deb5d6d844dc8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c93660b078ab46a89423cafbb0c192df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:36.598226 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-9bde2811-7cf4-4da4-853a-e40a37214db7 tempest-ServersAaction247Test-39568591 tempest-ServersAaction247Test-39568591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a11a96dc16d456493deb5d6d844dc8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c93660b078ab46a89423cafbb0c192df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:36.602707 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-9bde2811-7cf4-4da4-853a-e40a37214db7 tempest-ServersAaction247Test-39568591 tempest-ServersAaction247Test-39568591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a11a96dc16d456493deb5d6d844dc8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c93660b078ab46a89423cafbb0c192df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:36.611009 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-9bde2811-7cf4-4da4-853a-e40a37214db7 tempest-ServersAaction247Test-39568591 tempest-ServersAaction247Test-39568591-project] 10.222.0.43 "GET /compute/v2.1/servers/212e4404-4e73-4fc5-aacc-e6967180a85f" status: 200 len: 1371 microversion: 2.47 time: 0.351565 Oct 04 18:38:36.611578 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1056/1958] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:38:36 2022] GET /compute/v2.1/servers/212e4404-4e73-4fc5-aacc-e6967180a85f => generated 1371 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:38:36.630316 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-9353d135-849b-4431-a76a-19e00fe5903b tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] 10.222.0.43 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.365778 Oct 04 18:38:36.631883 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 903/1959] 10.222.0.43 () {60 vars in 1180 bytes} [Tue Oct 4 18:38:36 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:38:36.655268 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-3cb0fea2-8b27-4971-b7e3-f14e3ef2922e tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Action: 'create', calling method: .version_select at 0x7fb21fc3c790>, body: {"server_group": {"name": "tempest-server-group-1475897676", "policies": ["affinity"]}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:38:36.664393 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-e133fb79-ff39-494e-b611-33d1e915ed83 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Calling method '.version_select at 0x7fb21fd11550>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:36.692135 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-3cb0fea2-8b27-4971-b7e3-f14e3ef2922e tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Getting quotas for project 5f3ca2b15fd24916ac47e08325464d75. Resources: {'server_groups'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:38:36.700013 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-3cb0fea2-8b27-4971-b7e3-f14e3ef2922e tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Getting quotas for user 6daea1f7b0084009ac6e24181a1b87d7 and project 5f3ca2b15fd24916ac47e08325464d75. Resources: {'server_groups'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:38:36.787329 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-3cb0fea2-8b27-4971-b7e3-f14e3ef2922e tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Getting quotas for project 5f3ca2b15fd24916ac47e08325464d75. Resources: {'server_groups'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:38:36.791021 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-e133fb79-ff39-494e-b611-33d1e915ed83 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] 10.222.0.43 "GET /compute/v2.1/images/e5989b78-5925-4d33-8625-f3af6fa4e64d" status: 200 len: 1454 microversion: 2.1 time: 0.148404 Oct 04 18:38:36.792008 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1057/1960] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 18:38:36 2022] GET /compute/v2.1/images/e5989b78-5925-4d33-8625-f3af6fa4e64d => generated 1454 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:36.798096 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-3cb0fea2-8b27-4971-b7e3-f14e3ef2922e tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Getting quotas for user 6daea1f7b0084009ac6e24181a1b87d7 and project 5f3ca2b15fd24916ac47e08325464d75. Resources: {'server_groups'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:38:36.804470 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-50acc2ec-e3b6-4369-b4ab-f3dcb8b25c72 tempest-SecurityGroupRulesTestJSON-1076849469 tempest-SecurityGroupRulesTestJSON-1076849469-project] Calling method '.version_select at 0x7fb21fccb700>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:36.820286 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-3cb0fea2-8b27-4971-b7e3-f14e3ef2922e tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] 10.222.0.43 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.186346 Oct 04 18:38:36.821486 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 904/1961] 10.222.0.43 () {60 vars in 1173 bytes} [Tue Oct 4 18:38:36 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:38:36.833988 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-69b0d254-16e5-457c-8ea8-700b17d014c2 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-528594715", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452", "networks": [{"uuid": "b18f60a6-d619-41e5-bd2d-7ab9ce4732ab"}]}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:38:36.942470 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.network.neutron [None req-69b0d254-16e5-457c-8ea8-700b17d014c2 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] validate_networks() for [('b18f60a6-d619-41e5-bd2d-7ab9ce4732ab', None, None, None, None, None)] {{(pid=123595) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:38:37.177536 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-50acc2ec-e3b6-4369-b4ab-f3dcb8b25c72 tempest-SecurityGroupRulesTestJSON-1076849469 tempest-SecurityGroupRulesTestJSON-1076849469-project] 10.222.0.43 "DELETE /compute/v2.1/os-security-groups/a35be54b-b345-49e1-a5a9-a53f2a9bde2f" status: 202 len: 0 microversion: 2.1 time: 0.383524 Oct 04 18:38:37.178161 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1058/1962] 10.222.0.43 () {58 vars in 1272 bytes} [Tue Oct 4 18:38:36 2022] DELETE /compute/v2.1/os-security-groups/a35be54b-b345-49e1-a5a9-a53f2a9bde2f => generated 0 bytes in 385 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:38:37.184067 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f9cf26c4-cb0d-48fd-bb57-1c347cb9c977 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:37.226599 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:38:37.240120 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-f9cf26c4-cb0d-48fd-bb57-1c347cb9c977 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] 10.222.0.43 "DELETE /compute/v2.1/os-server-groups/f39c1ded-8cb0-4d0c-aad2-e89edaaed42f" status: 204 len: 0 microversion: 2.1 time: 0.060689 Oct 04 18:38:37.245670 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1059/1963] 10.222.0.43 () {58 vars in 1266 bytes} [Tue Oct 4 18:38:37 2022] DELETE /compute/v2.1/os-server-groups/f39c1ded-8cb0-4d0c-aad2-e89edaaed42f => generated 0 bytes in 63 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:38:37.257149 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f5902ce9-ab52-4c8f-87e7-818d0d8c88b9 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:37.258499 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-f5902ce9-ab52-4c8f-87e7-818d0d8c88b9 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] [instance: d1f298aa-ebe3-4f52-ada6-137a782cd9b7] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:37.268737 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f5902ce9-ab52-4c8f-87e7-818d0d8c88b9 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:37.269605 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f5902ce9-ab52-4c8f-87e7-818d0d8c88b9 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:37.270333 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f5902ce9-ab52-4c8f-87e7-818d0d8c88b9 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:37.271349 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f5902ce9-ab52-4c8f-87e7-818d0d8c88b9 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:37.271856 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f5902ce9-ab52-4c8f-87e7-818d0d8c88b9 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:37.272302 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f5902ce9-ab52-4c8f-87e7-818d0d8c88b9 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:37.372190 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-f5902ce9-ab52-4c8f-87e7-818d0d8c88b9 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:37.393834 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-f5902ce9-ab52-4c8f-87e7-818d0d8c88b9 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:37.395616 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-f5902ce9-ab52-4c8f-87e7-818d0d8c88b9 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:37.396794 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-f5902ce9-ab52-4c8f-87e7-818d0d8c88b9 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] 10.222.0.43 "GET /compute/v2.1/servers/d1f298aa-ebe3-4f52-ada6-137a782cd9b7" status: 200 len: 1232 microversion: 2.25 time: 0.149760 Oct 04 18:38:37.397405 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1060/1964] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:38:37 2022] GET /compute/v2.1/servers/d1f298aa-ebe3-4f52-ada6-137a782cd9b7 => generated 1232 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:38:37.421021 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-ebe88aee-d722-4f2b-a428-85d8f5bb976c tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:37.422660 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-ebe88aee-d722-4f2b-a428-85d8f5bb976c tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] [instance: 36d7eb4f-22bc-4047-bc75-6f69142daee5] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:37.435354 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ebe88aee-d722-4f2b-a428-85d8f5bb976c tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:37.436163 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ebe88aee-d722-4f2b-a428-85d8f5bb976c tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:37.436972 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ebe88aee-d722-4f2b-a428-85d8f5bb976c tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:37.441765 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ebe88aee-d722-4f2b-a428-85d8f5bb976c tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:37.442784 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ebe88aee-d722-4f2b-a428-85d8f5bb976c tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:37.443495 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ebe88aee-d722-4f2b-a428-85d8f5bb976c tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:37.653564 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-ebe88aee-d722-4f2b-a428-85d8f5bb976c tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eadce040fcf3427abab9ef8b0ca19400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f4f9b0233b4fb29963b77248a236f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:37.663738 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-ebe88aee-d722-4f2b-a428-85d8f5bb976c tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] 10.222.0.43 "GET /compute/v2.1/servers/36d7eb4f-22bc-4047-bc75-6f69142daee5" status: 200 len: 1519 microversion: 2.1 time: 0.252704 Oct 04 18:38:37.664942 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1061/1965] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:37 2022] GET /compute/v2.1/servers/36d7eb4f-22bc-4047-bc75-6f69142daee5 => generated 1519 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:37.685054 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-90de20b5-2f4f-4b9c-b7d7-131f99d30f0b tempest-SecurityGroupRulesTestJSON-1076849469 tempest-SecurityGroupRulesTestJSON-1076849469-project] Calling method '.version_select at 0x7fb224668670>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:37.990852 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-90de20b5-2f4f-4b9c-b7d7-131f99d30f0b tempest-SecurityGroupRulesTestJSON-1076849469 tempest-SecurityGroupRulesTestJSON-1076849469-project] 10.222.0.43 "DELETE /compute/v2.1/os-security-groups/bbcb983e-f139-40f5-b5ec-148471faa6ad" status: 202 len: 0 microversion: 2.1 time: 0.324588 Oct 04 18:38:37.995606 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1062/1966] 10.222.0.43 () {58 vars in 1272 bytes} [Tue Oct 4 18:38:37 2022] DELETE /compute/v2.1/os-security-groups/bbcb983e-f139-40f5-b5ec-148471faa6ad => generated 0 bytes in 327 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:38:38.002051 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-3578a93d-8983-4da9-91c3-630800cd3e4f tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:38.040636 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-3578a93d-8983-4da9-91c3-630800cd3e4f tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] 10.222.0.43 "GET /compute/v2.1/os-server-groups" status: 200 len: 334 microversion: 2.1 time: 0.046271 Oct 04 18:38:38.044074 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1063/1967] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Oct 4 18:38:37 2022] GET /compute/v2.1/os-server-groups => generated 334 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:38:38.049822 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-847f7b88-ad77-4cf3-82a7-9b85ff603691 tempest-ServersAaction247Test-39568591 tempest-ServersAaction247Test-39568591-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:38.050757 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-847f7b88-ad77-4cf3-82a7-9b85ff603691 tempest-ServersAaction247Test-39568591 tempest-ServersAaction247Test-39568591-project] [instance: 212e4404-4e73-4fc5-aacc-e6967180a85f] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:38.064415 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-847f7b88-ad77-4cf3-82a7-9b85ff603691 tempest-ServersAaction247Test-39568591 tempest-ServersAaction247Test-39568591-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:38.064925 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-847f7b88-ad77-4cf3-82a7-9b85ff603691 tempest-ServersAaction247Test-39568591 tempest-ServersAaction247Test-39568591-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:38.065872 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-847f7b88-ad77-4cf3-82a7-9b85ff603691 tempest-ServersAaction247Test-39568591 tempest-ServersAaction247Test-39568591-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:38.066987 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-847f7b88-ad77-4cf3-82a7-9b85ff603691 tempest-ServersAaction247Test-39568591 tempest-ServersAaction247Test-39568591-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:38.067724 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-847f7b88-ad77-4cf3-82a7-9b85ff603691 tempest-ServersAaction247Test-39568591 tempest-ServersAaction247Test-39568591-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:38.067932 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-847f7b88-ad77-4cf3-82a7-9b85ff603691 tempest-ServersAaction247Test-39568591 tempest-ServersAaction247Test-39568591-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:38.091679 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-847f7b88-ad77-4cf3-82a7-9b85ff603691 tempest-ServersAaction247Test-39568591 tempest-ServersAaction247Test-39568591-project] HTTP exception thrown: Instance 212e4404-4e73-4fc5-aacc-e6967180a85f could not be found. Oct 04 18:38:38.095282 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-847f7b88-ad77-4cf3-82a7-9b85ff603691 tempest-ServersAaction247Test-39568591 tempest-ServersAaction247Test-39568591-project] Request method failure captured: Oct 04 18:38:38.095282 n-d-851028-13 devstack@n-api.service[123596]: request: GET /compute/v2.1/servers/212e4404-4e73-4fc5-aacc-e6967180a85f HTTP/1.1 Oct 04 18:38:38.095282 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:38:38.095282 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:38:38.095282 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:38:38.095282 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 18:38:38.095282 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:38:38.095282 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:38:38.095282 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:38:38.095282 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:38:38.095282 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPH2ZKBOibHWOLfKhDZqG31lk5goZ6duz6_Owci-8d3XGQ0xsGvL5xZPHBdRN4w5CPeSwjg1LI94-vlF28HW4KykoYTc--3hmGBVyDgnV-oE3mr8qQZkUXtAbRUjsGee9wvAeU6Ch8ujUtwsMFKVp1Nnj9AxefT0hUbcMPzd4FgAQxfc Oct 04 18:38:38.095282 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:38:38.095282 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:38:38.095282 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:38:38.095282 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:38:38.095282 n-d-851028-13 devstack@n-api.service[123596]: X-Openstack-Nova-Api-Version: 2.47 Oct 04 18:38:38.095282 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:38:38.095282 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:38:38.095282 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: c93660b078ab46a89423cafbb0c192df Oct 04 18:38:38.095282 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-ServersAaction247Test-39568591 Oct 04 18:38:38.095282 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 18:38:38.095282 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 18:38:38.095282 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/c93660b078ab46a89423cafbb0c192df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_c93660b078ab46a89423cafbb0c192df"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c93660b078ab46a89423cafbb0c192df"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c93660b078ab46a89423cafbb0c192df"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:38:38.095282 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-ServersAaction247Test-39568591 Oct 04 18:38:38.095282 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: c93660b078ab46a89423cafbb0c192df Oct 04 18:38:38.095282 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-ServersAaction247Test-39568591 Oct 04 18:38:38.095282 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-ServersAaction247Test-39568591-project Oct 04 18:38:38.095282 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:38:38.095282 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:38:38.095282 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 1a11a96dc16d456493deb5d6d844dc8b Oct 04 18:38:38.095282 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-ServersAaction247Test-39568591-project Oct 04 18:38:38.095282 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 18:38:38.095282 n-d-851028-13 devstack@n-api.service[123596]: exception: Instance 212e4404-4e73-4fc5-aacc-e6967180a85f could not be found. Oct 04 18:38:38.095282 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': '212e4404-4e73-4fc5-aacc-e6967180a85f'} Oct 04 18:38:38.095282 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:38:38.095282 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:38:38.095282 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:38:38.095282 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:38:38.095282 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:38:38.095282 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:38:38.095282 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:38:38.095282 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:38:38.095282 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:38:38.095282 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:38:38.095282 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 212e4404-4e73-4fc5-aacc-e6967180a85f could not be found. Oct 04 18:38:38.095282 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:38:38.095282 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:38:38.095282 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:38:38.095282 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:38:38.095282 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:38:38.095282 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:38:38.095282 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:38:38.095282 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:38:38.095282 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:38:38.095282 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:38:38.095282 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:38:38.095282 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:38:38.095282 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:38:38.095282 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:38:38.095282 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:38:38.095282 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:38:38.095282 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 212e4404-4e73-4fc5-aacc-e6967180a85f could not be found. Oct 04 18:38:38.095282 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:38:38.095282 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:38:38.095282 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:38:38.101655 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:38:38.101655 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:38:38.101655 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:38:38.101655 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:38:38.101655 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:38:38.101655 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 212e4404-4e73-4fc5-aacc-e6967180a85f could not be found. Oct 04 18:38:38.101655 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:38:38.101655 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-847f7b88-ad77-4cf3-82a7-9b85ff603691 tempest-ServersAaction247Test-39568591 tempest-ServersAaction247Test-39568591-project] Returning 404 to user: Instance 212e4404-4e73-4fc5-aacc-e6967180a85f could not be found. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:38:38.103008 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-847f7b88-ad77-4cf3-82a7-9b85ff603691 tempest-ServersAaction247Test-39568591 tempest-ServersAaction247Test-39568591-project] 10.222.0.43 "GET /compute/v2.1/servers/212e4404-4e73-4fc5-aacc-e6967180a85f" status: 404 len: 111 microversion: 2.47 time: 0.056611 Oct 04 18:38:38.115359 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1064/1968] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:38:38 2022] GET /compute/v2.1/servers/212e4404-4e73-4fc5-aacc-e6967180a85f => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:38:38.124289 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-2d4fe0a1-1eb1-46c1-800f-7d93258095df tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Action: 'create', calling method: .version_select at 0x7fb225e554c0>, body: {"pool": null} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:38:38.852294 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-69b0d254-16e5-457c-8ea8-700b17d014c2 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Flavor limits 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:38:38.852705 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-69b0d254-16e5-457c-8ea8-700b17d014c2 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Image limits 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:38:38.853225 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-69b0d254-16e5-457c-8ea8-700b17d014c2 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Flavor pref 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:38:38.853867 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-69b0d254-16e5-457c-8ea8-700b17d014c2 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Image pref 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:38:38.854479 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-69b0d254-16e5-457c-8ea8-700b17d014c2 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:38:38.895165 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-69b0d254-16e5-457c-8ea8-700b17d014c2 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:38.895869 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-69b0d254-16e5-457c-8ea8-700b17d014c2 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:38.899373 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-69b0d254-16e5-457c-8ea8-700b17d014c2 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:38.901256 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-69b0d254-16e5-457c-8ea8-700b17d014c2 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:38.905006 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-69b0d254-16e5-457c-8ea8-700b17d014c2 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:38.907415 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-69b0d254-16e5-457c-8ea8-700b17d014c2 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:38.947146 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:38:38.965332 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-69b0d254-16e5-457c-8ea8-700b17d014c2 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Getting quotas for project 7b812c85494a49898376a0dd8140f03c. Resources: {'ram', 'cores', 'instances'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:38:38.979611 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-69b0d254-16e5-457c-8ea8-700b17d014c2 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Getting quotas for user 5c96ec8b8e0a4053b0457f213e6e262d and project 7b812c85494a49898376a0dd8140f03c. Resources: {'ram', 'cores', 'instances'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:38:39.020468 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-69b0d254-16e5-457c-8ea8-700b17d014c2 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Going to run 1 instances... {{(pid=123595) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:38:39.030921 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-69b0d254-16e5-457c-8ea8-700b17d014c2 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] [instance: 23ce945d-cd4a-40d5-80be-d5548c257e07] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e8943ec5-4038-4d4b-b9b9-2415a79f5243',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:38:39.185350 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-69b0d254-16e5-457c-8ea8-700b17d014c2 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.360827 Oct 04 18:38:39.189421 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 905/1969] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 18:38:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 2366 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:38:39.215806 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-1638eb9d-3ab3-43d3-85a9-bbac2bd16c04 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Calling method '.version_select at 0x7fb21fa8a310>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:39.334867 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-1638eb9d-3ab3-43d3-85a9-bbac2bd16c04 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] 10.222.0.43 "GET /compute/v2.1/images/e5989b78-5925-4d33-8625-f3af6fa4e64d" status: 200 len: 1454 microversion: 2.1 time: 0.141778 Oct 04 18:38:39.335720 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 906/1970] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 18:38:39 2022] GET /compute/v2.1/images/e5989b78-5925-4d33-8625-f3af6fa4e64d => generated 1454 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:39.351438 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-9e5e88ac-588d-4ac5-b077-6f93d2483b83 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:39.416596 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-9e5e88ac-588d-4ac5-b077-6f93d2483b83 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] 10.222.0.43 "DELETE /compute/v2.1/os-server-groups/c4b18a44-0e8f-41f7-90d4-f53d3a5eaac4" status: 204 len: 0 microversion: 2.1 time: 0.078657 Oct 04 18:38:39.419503 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 907/1971] 10.222.0.43 () {58 vars in 1266 bytes} [Tue Oct 4 18:38:39 2022] DELETE /compute/v2.1/os-server-groups/c4b18a44-0e8f-41f7-90d4-f53d3a5eaac4 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:38:39.444135 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-4edb305b-0555-43a7-9e58-35fd061ce928 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:39.448317 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-4edb305b-0555-43a7-9e58-35fd061ce928 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] [instance: d1f298aa-ebe3-4f52-ada6-137a782cd9b7] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:39.462970 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4edb305b-0555-43a7-9e58-35fd061ce928 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:39.463469 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4edb305b-0555-43a7-9e58-35fd061ce928 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:39.466505 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4edb305b-0555-43a7-9e58-35fd061ce928 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:39.471489 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4edb305b-0555-43a7-9e58-35fd061ce928 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:39.472326 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4edb305b-0555-43a7-9e58-35fd061ce928 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:39.473032 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4edb305b-0555-43a7-9e58-35fd061ce928 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:40.116184 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-4edb305b-0555-43a7-9e58-35fd061ce928 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:40.127569 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-4edb305b-0555-43a7-9e58-35fd061ce928 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:40.138497 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-4edb305b-0555-43a7-9e58-35fd061ce928 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:40.142050 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-4edb305b-0555-43a7-9e58-35fd061ce928 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] 10.222.0.43 "GET /compute/v2.1/servers/d1f298aa-ebe3-4f52-ada6-137a782cd9b7" status: 200 len: 1250 microversion: 2.25 time: 0.717440 Oct 04 18:38:40.180151 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 908/1972] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:38:39 2022] GET /compute/v2.1/servers/d1f298aa-ebe3-4f52-ada6-137a782cd9b7 => generated 1250 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:38:40.190148 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-50976b1a-b888-4c9e-9745-66d70a9b7389 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:40.198283 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-50976b1a-b888-4c9e-9745-66d70a9b7389 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] [instance: 23ce945d-cd4a-40d5-80be-d5548c257e07] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:40.810683 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-50976b1a-b888-4c9e-9745-66d70a9b7389 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c96ec8b8e0a4053b0457f213e6e262d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b812c85494a49898376a0dd8140f03c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:40.823531 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-50976b1a-b888-4c9e-9745-66d70a9b7389 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] 10.222.0.43 "GET /compute/v2.1/servers/23ce945d-cd4a-40d5-80be-d5548c257e07" status: 200 len: 1215 microversion: 2.1 time: 0.641647 Oct 04 18:38:40.826475 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 909/1973] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:40 2022] GET /compute/v2.1/servers/23ce945d-cd4a-40d5-80be-d5548c257e07 => generated 1215 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:40.847347 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-237153f7-2170-49f5-871a-74e7db58f291 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:40.902001 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-237153f7-2170-49f5-871a-74e7db58f291 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] 10.222.0.43 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.072534 Oct 04 18:38:40.907283 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 910/1974] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Oct 4 18:38:40 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:38:40.922296 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-59fe6157-7556-4b3f-bf74-1bb826cb2eb2 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Calling method '.version_select at 0x7fb21fe1e1f0>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:41.057748 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-59fe6157-7556-4b3f-bf74-1bb826cb2eb2 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] 10.222.0.43 "GET /compute/v2.1/images/e5989b78-5925-4d33-8625-f3af6fa4e64d" status: 200 len: 1454 microversion: 2.1 time: 0.144503 Oct 04 18:38:41.070040 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 911/1975] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 18:38:40 2022] GET /compute/v2.1/images/e5989b78-5925-4d33-8625-f3af6fa4e64d => generated 1454 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:41.095432 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-8a1a44f9-1698-496e-84d6-69a749eadecd req-8bfa64ca-2d8c-4f72-bd3f-811faa4b5e9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b7f1ede-48b3-48d8-933e-287c338b1e6a", "name": "network-vif-plugged", "status": "completed", "tag": "462f1dea-cb2e-42da-a165-e6bc91610838"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:38:41.178035 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-8a1a44f9-1698-496e-84d6-69a749eadecd req-8bfa64ca-2d8c-4f72-bd3f-811faa4b5e9c service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:41.178703 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-8a1a44f9-1698-496e-84d6-69a749eadecd req-8bfa64ca-2d8c-4f72-bd3f-811faa4b5e9c service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:41.189594 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-8a1a44f9-1698-496e-84d6-69a749eadecd req-8bfa64ca-2d8c-4f72-bd3f-811faa4b5e9c service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:41.290958 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-8a1a44f9-1698-496e-84d6-69a749eadecd req-8bfa64ca-2d8c-4f72-bd3f-811faa4b5e9c service nova] Creating event network-vif-plugged:462f1dea-cb2e-42da-a165-e6bc91610838 for instance 0b7f1ede-48b3-48d8-933e-287c338b1e6a on n-h1-851028-13 Oct 04 18:38:41.339004 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-8a1a44f9-1698-496e-84d6-69a749eadecd req-8bfa64ca-2d8c-4f72-bd3f-811faa4b5e9c service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.272772 Oct 04 18:38:41.346244 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 912/1976] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:38:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:38:41.373237 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-c533d9d2-1b0f-428a-b374-4417d1707617 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Action: 'create', calling method: .version_select at 0x7fb224485d30>, body: {"server_group": {"name": "tempest-server-group-1138784683", "policies": ["affinity"]}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:38:41.490920 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-c533d9d2-1b0f-428a-b374-4417d1707617 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Getting quotas for project 5f3ca2b15fd24916ac47e08325464d75. Resources: {'server_groups'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:38:41.512190 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-c533d9d2-1b0f-428a-b374-4417d1707617 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Getting quotas for user 6daea1f7b0084009ac6e24181a1b87d7 and project 5f3ca2b15fd24916ac47e08325464d75. Resources: {'server_groups'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:38:41.661135 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-c533d9d2-1b0f-428a-b374-4417d1707617 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Getting quotas for project 5f3ca2b15fd24916ac47e08325464d75. Resources: {'server_groups'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:38:41.683816 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-c533d9d2-1b0f-428a-b374-4417d1707617 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Getting quotas for user 6daea1f7b0084009ac6e24181a1b87d7 and project 5f3ca2b15fd24916ac47e08325464d75. Resources: {'server_groups'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:38:41.724240 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-c533d9d2-1b0f-428a-b374-4417d1707617 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] 10.222.0.43 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.372729 Oct 04 18:38:41.725323 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 913/1977] 10.222.0.43 () {60 vars in 1173 bytes} [Tue Oct 4 18:38:41 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:38:41.738268 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-020154dd-0417-45fb-a9bd-bac7e0276693 tempest-MigrationsAdminTest-1571334602 tempest-MigrationsAdminTest-1571334602-project-admin] Calling method '.version_select at 0x7fb21fe1e1f0>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:41.746217 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-020154dd-0417-45fb-a9bd-bac7e0276693 tempest-MigrationsAdminTest-1571334602 tempest-MigrationsAdminTest-1571334602-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:41.752661 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-020154dd-0417-45fb-a9bd-bac7e0276693 tempest-MigrationsAdminTest-1571334602 tempest-MigrationsAdminTest-1571334602-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:41.753566 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-020154dd-0417-45fb-a9bd-bac7e0276693 tempest-MigrationsAdminTest-1571334602 tempest-MigrationsAdminTest-1571334602-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:41.772712 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-020154dd-0417-45fb-a9bd-bac7e0276693 tempest-MigrationsAdminTest-1571334602 tempest-MigrationsAdminTest-1571334602-project-admin] 10.222.0.43 "GET /compute/v2.1/os-migrations" status: 200 len: 1974 microversion: 2.1 time: 0.043100 Oct 04 18:38:41.786255 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 914/1978] 10.222.0.43 () {58 vars in 1143 bytes} [Tue Oct 4 18:38:41 2022] GET /compute/v2.1/os-migrations => generated 1974 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:41.791989 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-91b60d09-e891-4ef1-9573-126690885398 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:41.804861 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-91b60d09-e891-4ef1-9573-126690885398 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] [instance: d1f298aa-ebe3-4f52-ada6-137a782cd9b7] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:41.841138 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-91b60d09-e891-4ef1-9573-126690885398 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:41.848273 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-91b60d09-e891-4ef1-9573-126690885398 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:41.851753 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-91b60d09-e891-4ef1-9573-126690885398 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:41.852916 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-91b60d09-e891-4ef1-9573-126690885398 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:41.858366 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-91b60d09-e891-4ef1-9573-126690885398 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:41.858988 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-91b60d09-e891-4ef1-9573-126690885398 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:42.474178 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-2d4fe0a1-1eb1-46c1-800f-7d93258095df tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] 10.222.0.43 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.357323 Oct 04 18:38:42.475373 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1065/1979] 10.222.0.43 () {60 vars in 1170 bytes} [Tue Oct 4 18:38:38 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4359 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:38:42.480959 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-6d361797-7522-45f0-9607-65a8c0f3dc68 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:42.558256 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-6d361797-7522-45f0-9607-65a8c0f3dc68 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] 10.222.0.43 "DELETE /compute/v2.1/os-server-groups/55ec76e6-806e-4280-8e3f-7ec28afc26d8" status: 204 len: 0 microversion: 2.1 time: 0.080492 Oct 04 18:38:42.559696 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1066/1980] 10.222.0.43 () {58 vars in 1266 bytes} [Tue Oct 4 18:38:42 2022] DELETE /compute/v2.1/os-server-groups/55ec76e6-806e-4280-8e3f-7ec28afc26d8 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:38:42.574212 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-9ab35406-a70c-4425-bed4-923fa8c31ae9 tempest-MigrationsAdminTest-1571334602 tempest-MigrationsAdminTest-1571334602-project-admin] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:42.593679 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-9ab35406-a70c-4425-bed4-923fa8c31ae9 tempest-MigrationsAdminTest-1571334602 tempest-MigrationsAdminTest-1571334602-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.027560 Oct 04 18:38:42.595147 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1067/1981] 10.222.0.43 () {58 vars in 1137 bytes} [Tue Oct 4 18:38:42 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:38:42.605420 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-3dae847a-44f0-4b54-91d7-310b753fcaa9 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:42.610948 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-3dae847a-44f0-4b54-91d7-310b753fcaa9 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] [instance: 23ce945d-cd4a-40d5-80be-d5548c257e07] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:42.629188 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3dae847a-44f0-4b54-91d7-310b753fcaa9 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:42.634067 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3dae847a-44f0-4b54-91d7-310b753fcaa9 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:42.635053 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3dae847a-44f0-4b54-91d7-310b753fcaa9 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:42.638300 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3dae847a-44f0-4b54-91d7-310b753fcaa9 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:42.639147 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3dae847a-44f0-4b54-91d7-310b753fcaa9 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:42.640051 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3dae847a-44f0-4b54-91d7-310b753fcaa9 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:42.918227 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-3dae847a-44f0-4b54-91d7-310b753fcaa9 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c96ec8b8e0a4053b0457f213e6e262d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b812c85494a49898376a0dd8140f03c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:42.928302 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-3dae847a-44f0-4b54-91d7-310b753fcaa9 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] 10.222.0.43 "GET /compute/v2.1/servers/23ce945d-cd4a-40d5-80be-d5548c257e07" status: 200 len: 1273 microversion: 2.1 time: 0.331716 Oct 04 18:38:42.957154 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1068/1982] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:42 2022] GET /compute/v2.1/servers/23ce945d-cd4a-40d5-80be-d5548c257e07 => generated 1273 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:42.970793 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-2eeff213-6540-453a-8c53-14fa983ef9ba tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Calling method '.version_select at 0x7fb21fb695e0>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:43.062298 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-2eeff213-6540-453a-8c53-14fa983ef9ba tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] 10.222.0.43 "GET /compute/v2.1/images/e5989b78-5925-4d33-8625-f3af6fa4e64d" status: 200 len: 1454 microversion: 2.1 time: 0.109244 Oct 04 18:38:43.067523 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1069/1983] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 18:38:42 2022] GET /compute/v2.1/images/e5989b78-5925-4d33-8625-f3af6fa4e64d => generated 1454 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:43.098733 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-6c8bef1a-a130-4d5a-9e2d-4a6781cbbc8d tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:43.154308 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-6c8bef1a-a130-4d5a-9e2d-4a6781cbbc8d tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] 10.222.0.43 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.078840 Oct 04 18:38:43.158005 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1070/1984] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Oct 4 18:38:43 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:38:43.180559 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-10103aca-2a30-400b-b82d-aea971d1cea7 tempest-MigrationsAdminTest-1571334602 tempest-MigrationsAdminTest-1571334602-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-236060779", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:38:43.243327 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-10103aca-2a30-400b-b82d-aea971d1cea7 tempest-MigrationsAdminTest-1571334602 tempest-MigrationsAdminTest-1571334602-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 498 microversion: 2.1 time: 0.078696 Oct 04 18:38:43.244936 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1071/1985] 10.222.0.43 () {60 vars in 1146 bytes} [Tue Oct 4 18:38:43 2022] POST /compute/v2.1/flavors => generated 498 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:38:43.270026 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-01ddf03c-322a-41c7-baaf-98efe1ce457e tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1684164902", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452", "networks": [{"uuid": "8c78b501-c0dc-4b4a-aea6-b08dc5b06498"}]}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:38:43.379120 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.network.neutron [None req-01ddf03c-322a-41c7-baaf-98efe1ce457e tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] validate_networks() for [('8c78b501-c0dc-4b4a-aea6-b08dc5b06498', None, None, None, None, None)] {{(pid=123596) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:38:43.538325 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-91b60d09-e891-4ef1-9573-126690885398 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:43.563346 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-91b60d09-e891-4ef1-9573-126690885398 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:43.564957 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-91b60d09-e891-4ef1-9573-126690885398 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:43.566289 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-91b60d09-e891-4ef1-9573-126690885398 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] 10.222.0.43 "GET /compute/v2.1/servers/d1f298aa-ebe3-4f52-ada6-137a782cd9b7" status: 200 len: 1292 microversion: 2.25 time: 1.778438 Oct 04 18:38:43.566927 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 915/1986] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:38:41 2022] GET /compute/v2.1/servers/d1f298aa-ebe3-4f52-ada6-137a782cd9b7 => generated 1292 bytes in 1780 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:38:43.597273 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-9b16f505-2b64-4326-b458-669084764a64 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Action: 'create', calling method: .version_select at 0x7fb21fe37790>, body: {"server_group": {"name": "tempest-server-group-708462318", "policies": ["anti-affinity"]}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:38:43.661056 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-9b16f505-2b64-4326-b458-669084764a64 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Getting quotas for project 5f3ca2b15fd24916ac47e08325464d75. Resources: {'server_groups'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:38:43.675739 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-9b16f505-2b64-4326-b458-669084764a64 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Getting quotas for user 6daea1f7b0084009ac6e24181a1b87d7 and project 5f3ca2b15fd24916ac47e08325464d75. Resources: {'server_groups'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:38:43.832529 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-9b16f505-2b64-4326-b458-669084764a64 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Getting quotas for project 5f3ca2b15fd24916ac47e08325464d75. Resources: {'server_groups'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:38:43.845638 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-9b16f505-2b64-4326-b458-669084764a64 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Getting quotas for user 6daea1f7b0084009ac6e24181a1b87d7 and project 5f3ca2b15fd24916ac47e08325464d75. Resources: {'server_groups'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:38:43.871313 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-9b16f505-2b64-4326-b458-669084764a64 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] 10.222.0.43 "POST /compute/v2.1/os-server-groups" status: 200 len: 168 microversion: 2.1 time: 0.303247 Oct 04 18:38:43.876458 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 916/1987] 10.222.0.43 () {60 vars in 1173 bytes} [Tue Oct 4 18:38:43 2022] POST /compute/v2.1/os-server-groups => generated 168 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:38:43.886543 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-e5ed83ac-602c-4ce3-be6b-b93b5b20dab4 tempest-MigrationsAdminTest-1571334602 tempest-MigrationsAdminTest-1571334602-project-admin] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:43.904997 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-e5ed83ac-602c-4ce3-be6b-b93b5b20dab4 tempest-MigrationsAdminTest-1571334602 tempest-MigrationsAdminTest-1571334602-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.027114 Oct 04 18:38:43.919284 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 917/1988] 10.222.0.43 () {58 vars in 1182 bytes} [Tue Oct 4 18:38:43 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:38:43.925898 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-87f6ed67-3a0c-40ea-9c44-aa89fa7588c8 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:43.994221 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-87f6ed67-3a0c-40ea-9c44-aa89fa7588c8 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] 10.222.0.43 "DELETE /compute/v2.1/os-server-groups/366a6915-c4df-49a1-8445-4a6f5b24c62c" status: 204 len: 0 microversion: 2.1 time: 0.072303 Oct 04 18:38:43.995246 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 918/1989] 10.222.0.43 () {58 vars in 1266 bytes} [Tue Oct 4 18:38:43 2022] DELETE /compute/v2.1/os-server-groups/366a6915-c4df-49a1-8445-4a6f5b24c62c => generated 0 bytes in 75 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:38:44.003047 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-9c01750f-7694-4188-9ba6-c0f5bb9d6bac tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:44.012272 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-9c01750f-7694-4188-9ba6-c0f5bb9d6bac tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] [instance: 23ce945d-cd4a-40d5-80be-d5548c257e07] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:44.020097 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9c01750f-7694-4188-9ba6-c0f5bb9d6bac tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:44.021333 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9c01750f-7694-4188-9ba6-c0f5bb9d6bac tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:44.025771 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9c01750f-7694-4188-9ba6-c0f5bb9d6bac tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:44.026950 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9c01750f-7694-4188-9ba6-c0f5bb9d6bac tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:44.027544 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9c01750f-7694-4188-9ba6-c0f5bb9d6bac tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:44.030495 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9c01750f-7694-4188-9ba6-c0f5bb9d6bac tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:44.196936 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-9c01750f-7694-4188-9ba6-c0f5bb9d6bac tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c96ec8b8e0a4053b0457f213e6e262d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b812c85494a49898376a0dd8140f03c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:44.205881 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-9c01750f-7694-4188-9ba6-c0f5bb9d6bac tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] 10.222.0.43 "GET /compute/v2.1/servers/23ce945d-cd4a-40d5-80be-d5548c257e07" status: 200 len: 1273 microversion: 2.1 time: 0.209458 Oct 04 18:38:44.232978 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 919/1990] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:43 2022] GET /compute/v2.1/servers/23ce945d-cd4a-40d5-80be-d5548c257e07 => generated 1273 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:44.238598 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-6a95a9e2-8911-4909-9ba1-a11629fc344a tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:44.250508 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-6a95a9e2-8911-4909-9ba1-a11629fc344a tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] 10.222.0.43 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.016235 Oct 04 18:38:44.259007 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 920/1991] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Oct 4 18:38:44 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:38:44.279811 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-bfa800ad-d876-468a-9172-0c4006fc0ff1 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Calling method '.version_select at 0x7fb21fecd1f0>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:44.375017 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-bfa800ad-d876-468a-9172-0c4006fc0ff1 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] 10.222.0.43 "GET /compute/v2.1/images/e5989b78-5925-4d33-8625-f3af6fa4e64d" status: 200 len: 1454 microversion: 2.1 time: 0.112898 Oct 04 18:38:44.383534 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 921/1992] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 18:38:44 2022] GET /compute/v2.1/images/e5989b78-5925-4d33-8625-f3af6fa4e64d => generated 1454 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:44.393339 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-76b6cc42-5f4f-4ef5-9b02-d63e211c1fc8 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-305832041", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "1d83032c-1fb1-416a-868c-1915f092c006"}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:38:44.429285 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=7,nova_api:DELETE=6 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:38:44.493319 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=2 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:38:44.551039 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.network.neutron [None req-76b6cc42-5f4f-4ef5-9b02-d63e211c1fc8 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] validate_networks() for None {{(pid=123595) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:38:45.688584 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-01ddf03c-322a-41c7-baaf-98efe1ce457e tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Flavor limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:38:45.689779 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-01ddf03c-322a-41c7-baaf-98efe1ce457e tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Image limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:38:45.690543 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-01ddf03c-322a-41c7-baaf-98efe1ce457e tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Flavor pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:38:45.691424 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-01ddf03c-322a-41c7-baaf-98efe1ce457e tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Image pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:38:45.692105 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-01ddf03c-322a-41c7-baaf-98efe1ce457e tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:38:45.720479 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-01ddf03c-322a-41c7-baaf-98efe1ce457e tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:45.722564 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-01ddf03c-322a-41c7-baaf-98efe1ce457e tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:45.725177 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-01ddf03c-322a-41c7-baaf-98efe1ce457e tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:45.727476 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-01ddf03c-322a-41c7-baaf-98efe1ce457e tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:45.731363 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-01ddf03c-322a-41c7-baaf-98efe1ce457e tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:45.731991 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-01ddf03c-322a-41c7-baaf-98efe1ce457e tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:45.786800 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-01ddf03c-322a-41c7-baaf-98efe1ce457e tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Getting quotas for project 87f4f9b0233b4fb29963b77248a236f7. Resources: {'ram', 'cores', 'instances'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:38:45.793567 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-01ddf03c-322a-41c7-baaf-98efe1ce457e tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Getting quotas for user eadce040fcf3427abab9ef8b0ca19400 and project 87f4f9b0233b4fb29963b77248a236f7. Resources: {'ram', 'cores', 'instances'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:38:45.808215 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-01ddf03c-322a-41c7-baaf-98efe1ce457e tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Going to run 1 instances... {{(pid=123596) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:38:45.811343 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-01ddf03c-322a-41c7-baaf-98efe1ce457e tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] [instance: 5d937ba2-60f4-40cf-9ed8-a4a86d458e38] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e8943ec5-4038-4d4b-b9b9-2415a79f5243',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123596) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:38:45.888411 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-01ddf03c-322a-41c7-baaf-98efe1ce457e tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.641213 Oct 04 18:38:45.889196 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1072/1993] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 18:38:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 2643 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:38:45.896549 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-283c4cbf-fbce-40f9-8702-22676f763b56 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-450217553", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452", "networks": [{"uuid": "ef4102f0-1180-48db-8efa-55144ec8d91a"}]}, "os:scheduler_hints": {"group": "e20eb086-2572-400f-bbd0-163473a4eb28"}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:38:46.003513 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.network.neutron [None req-283c4cbf-fbce-40f9-8702-22676f763b56 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] validate_networks() for [('ef4102f0-1180-48db-8efa-55144ec8d91a', None, None, None, None, None)] {{(pid=123596) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:38:46.053470 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-76b6cc42-5f4f-4ef5-9b02-d63e211c1fc8 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Flavor limits 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:38:46.054078 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-76b6cc42-5f4f-4ef5-9b02-d63e211c1fc8 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Image limits 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:38:46.054773 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-76b6cc42-5f4f-4ef5-9b02-d63e211c1fc8 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Flavor pref 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:38:46.063585 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-76b6cc42-5f4f-4ef5-9b02-d63e211c1fc8 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Image pref 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:38:46.064377 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-76b6cc42-5f4f-4ef5-9b02-d63e211c1fc8 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:38:46.075685 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-76b6cc42-5f4f-4ef5-9b02-d63e211c1fc8 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:46.076453 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-76b6cc42-5f4f-4ef5-9b02-d63e211c1fc8 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:46.077092 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-76b6cc42-5f4f-4ef5-9b02-d63e211c1fc8 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:46.078142 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-76b6cc42-5f4f-4ef5-9b02-d63e211c1fc8 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:46.078928 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-76b6cc42-5f4f-4ef5-9b02-d63e211c1fc8 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:46.079731 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-76b6cc42-5f4f-4ef5-9b02-d63e211c1fc8 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:46.106459 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-76b6cc42-5f4f-4ef5-9b02-d63e211c1fc8 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Getting quotas for project 50a6a1a86a59403dad27f6e3c628853c. Resources: {'ram', 'cores', 'instances'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:38:46.115988 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-76b6cc42-5f4f-4ef5-9b02-d63e211c1fc8 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Getting quotas for user 581885ffa737444eafa3179cceb6ee1d and project 50a6a1a86a59403dad27f6e3c628853c. Resources: {'ram', 'cores', 'instances'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:38:46.137522 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-76b6cc42-5f4f-4ef5-9b02-d63e211c1fc8 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Going to run 1 instances... {{(pid=123595) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:38:46.140436 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-76b6cc42-5f4f-4ef5-9b02-d63e211c1fc8 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: d9d4332a-97b6-40f1-bd7c-a9a75a9adc43] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e8943ec5-4038-4d4b-b9b9-2415a79f5243',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:38:46.245317 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-76b6cc42-5f4f-4ef5-9b02-d63e211c1fc8 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.856476 Oct 04 18:38:46.251218 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 922/1994] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 18:38:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 1867 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:38:46.272962 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-9d8bda84-b211-4d57-ad35-90af991109b6 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:46.273784 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-9d8bda84-b211-4d57-ad35-90af991109b6 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] [instance: d1f298aa-ebe3-4f52-ada6-137a782cd9b7] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:46.295729 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9d8bda84-b211-4d57-ad35-90af991109b6 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:46.296237 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9d8bda84-b211-4d57-ad35-90af991109b6 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:46.298423 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9d8bda84-b211-4d57-ad35-90af991109b6 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:46.299183 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9d8bda84-b211-4d57-ad35-90af991109b6 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:46.299648 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9d8bda84-b211-4d57-ad35-90af991109b6 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:46.304391 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9d8bda84-b211-4d57-ad35-90af991109b6 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:46.783099 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-9d8bda84-b211-4d57-ad35-90af991109b6 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:46.801624 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-9d8bda84-b211-4d57-ad35-90af991109b6 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:46.813703 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-9d8bda84-b211-4d57-ad35-90af991109b6 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:46.814978 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-9d8bda84-b211-4d57-ad35-90af991109b6 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] 10.222.0.43 "GET /compute/v2.1/servers/d1f298aa-ebe3-4f52-ada6-137a782cd9b7" status: 200 len: 1292 microversion: 2.25 time: 0.561248 Oct 04 18:38:46.815554 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 923/1995] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:38:46 2022] GET /compute/v2.1/servers/d1f298aa-ebe3-4f52-ada6-137a782cd9b7 => generated 1292 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:38:46.842939 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-19e453e9-756f-4d3a-a2a1-77bdca7e0718 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:46.851412 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-19e453e9-756f-4d3a-a2a1-77bdca7e0718 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] [instance: 23ce945d-cd4a-40d5-80be-d5548c257e07] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:46.872126 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-19e453e9-756f-4d3a-a2a1-77bdca7e0718 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:46.876395 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-19e453e9-756f-4d3a-a2a1-77bdca7e0718 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:46.877164 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-19e453e9-756f-4d3a-a2a1-77bdca7e0718 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:46.884213 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-19e453e9-756f-4d3a-a2a1-77bdca7e0718 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:46.885279 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-19e453e9-756f-4d3a-a2a1-77bdca7e0718 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:46.889244 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-19e453e9-756f-4d3a-a2a1-77bdca7e0718 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:47.727894 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-19e453e9-756f-4d3a-a2a1-77bdca7e0718 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c96ec8b8e0a4053b0457f213e6e262d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b812c85494a49898376a0dd8140f03c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:47.752299 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-19e453e9-756f-4d3a-a2a1-77bdca7e0718 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] 10.222.0.43 "GET /compute/v2.1/servers/23ce945d-cd4a-40d5-80be-d5548c257e07" status: 200 len: 1315 microversion: 2.1 time: 0.910238 Oct 04 18:38:47.765358 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 924/1996] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:46 2022] GET /compute/v2.1/servers/23ce945d-cd4a-40d5-80be-d5548c257e07 => generated 1315 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:47.777948 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-c3236e0c-c19c-46f1-a794-e568649625d4 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Calling method '.version_select at 0x7fb21fb7af70>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:47.943723 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-c3236e0c-c19c-46f1-a794-e568649625d4 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] 10.222.0.43 "GET /compute/v2.1/images/e5989b78-5925-4d33-8625-f3af6fa4e64d" status: 200 len: 1454 microversion: 2.1 time: 0.187306 Oct 04 18:38:47.944588 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 925/1997] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 18:38:47 2022] GET /compute/v2.1/images/e5989b78-5925-4d33-8625-f3af6fa4e64d => generated 1454 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:47.965596 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-7f07b929-6865-491d-a14e-0e6bdf4781ef req-c4c9d409-fc19-4b80-8ca3-509f8d06045c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1f298aa-ebe3-4f52-ada6-137a782cd9b7", "tag": "522bbf89-d8c1-4d7d-96be-5fcee81a735a"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:38:48.002006 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-7f07b929-6865-491d-a14e-0e6bdf4781ef req-c4c9d409-fc19-4b80-8ca3-509f8d06045c service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:48.002762 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-7f07b929-6865-491d-a14e-0e6bdf4781ef req-c4c9d409-fc19-4b80-8ca3-509f8d06045c service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:48.003401 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-7f07b929-6865-491d-a14e-0e6bdf4781ef req-c4c9d409-fc19-4b80-8ca3-509f8d06045c service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:48.029411 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-7f07b929-6865-491d-a14e-0e6bdf4781ef req-c4c9d409-fc19-4b80-8ca3-509f8d06045c service nova] Creating event network-changed:522bbf89-d8c1-4d7d-96be-5fcee81a735a for instance d1f298aa-ebe3-4f52-ada6-137a782cd9b7 on n-h2-851028-13 Oct 04 18:38:48.043924 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-7f07b929-6865-491d-a14e-0e6bdf4781ef req-c4c9d409-fc19-4b80-8ca3-509f8d06045c service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089145 Oct 04 18:38:48.044977 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 926/1998] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:38:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:38:48.061946 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-684f63aa-55ba-4689-8175-f69054ff980b tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:48.066943 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-684f63aa-55ba-4689-8175-f69054ff980b tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] [instance: 5d937ba2-60f4-40cf-9ed8-a4a86d458e38] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:48.098218 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-684f63aa-55ba-4689-8175-f69054ff980b tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:48.113631 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-684f63aa-55ba-4689-8175-f69054ff980b tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:48.114505 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-684f63aa-55ba-4689-8175-f69054ff980b tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:48.119041 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-684f63aa-55ba-4689-8175-f69054ff980b tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:48.119874 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-684f63aa-55ba-4689-8175-f69054ff980b tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:48.120563 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-684f63aa-55ba-4689-8175-f69054ff980b tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:48.598997 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-283c4cbf-fbce-40f9-8702-22676f763b56 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Flavor limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:38:48.600167 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-283c4cbf-fbce-40f9-8702-22676f763b56 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Image limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:38:48.601095 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-283c4cbf-fbce-40f9-8702-22676f763b56 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Flavor pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:38:48.601842 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-283c4cbf-fbce-40f9-8702-22676f763b56 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Image pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:38:48.602501 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-283c4cbf-fbce-40f9-8702-22676f763b56 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:38:48.641187 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-283c4cbf-fbce-40f9-8702-22676f763b56 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:48.641711 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-283c4cbf-fbce-40f9-8702-22676f763b56 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:48.644543 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-283c4cbf-fbce-40f9-8702-22676f763b56 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:48.646776 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-283c4cbf-fbce-40f9-8702-22676f763b56 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:48.648665 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-283c4cbf-fbce-40f9-8702-22676f763b56 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:48.650651 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-283c4cbf-fbce-40f9-8702-22676f763b56 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:48.707146 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-283c4cbf-fbce-40f9-8702-22676f763b56 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Getting quotas for project 5f3ca2b15fd24916ac47e08325464d75. Resources: {'ram', 'cores', 'instances'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:38:48.719361 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-283c4cbf-fbce-40f9-8702-22676f763b56 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Getting quotas for user 6daea1f7b0084009ac6e24181a1b87d7 and project 5f3ca2b15fd24916ac47e08325464d75. Resources: {'ram', 'cores', 'instances'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:38:48.755532 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-283c4cbf-fbce-40f9-8702-22676f763b56 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Going to run 1 instances... {{(pid=123596) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:38:48.763949 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-283c4cbf-fbce-40f9-8702-22676f763b56 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] [instance: 237ee25f-85f0-46d4-8980-66c5bfe764ad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e8943ec5-4038-4d4b-b9b9-2415a79f5243',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123596) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:38:48.807296 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-684f63aa-55ba-4689-8175-f69054ff980b tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eadce040fcf3427abab9ef8b0ca19400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f4f9b0233b4fb29963b77248a236f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:48.822517 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-684f63aa-55ba-4689-8175-f69054ff980b tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] 10.222.0.43 "GET /compute/v2.1/servers/5d937ba2-60f4-40cf-9ed8-a4a86d458e38" status: 200 len: 1276 microversion: 2.1 time: 0.775979 Oct 04 18:38:48.844265 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 927/1999] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:48 2022] GET /compute/v2.1/servers/5d937ba2-60f4-40cf-9ed8-a4a86d458e38 => generated 1276 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:48.844265 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-5f5053e1-50a4-4006-9048-59ca4c141f6d tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:48.844265 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-5f5053e1-50a4-4006-9048-59ca4c141f6d tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: d9d4332a-97b6-40f1-bd7c-a9a75a9adc43] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:48.865836 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-283c4cbf-fbce-40f9-8702-22676f763b56 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=123596) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Oct 04 18:38:48.872196 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5f5053e1-50a4-4006-9048-59ca4c141f6d tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:48.873019 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5f5053e1-50a4-4006-9048-59ca4c141f6d tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:48.875533 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5f5053e1-50a4-4006-9048-59ca4c141f6d tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:48.881208 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5f5053e1-50a4-4006-9048-59ca4c141f6d tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:48.882233 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5f5053e1-50a4-4006-9048-59ca4c141f6d tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:48.884033 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5f5053e1-50a4-4006-9048-59ca4c141f6d tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:48.915352 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-283c4cbf-fbce-40f9-8702-22676f763b56 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Getting quotas for project 5f3ca2b15fd24916ac47e08325464d75. Resources: {'server_group_members'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:38:48.919896 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-283c4cbf-fbce-40f9-8702-22676f763b56 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Getting quotas for user 6daea1f7b0084009ac6e24181a1b87d7 and project 5f3ca2b15fd24916ac47e08325464d75. Resources: {'server_group_members'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:38:49.029019 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-283c4cbf-fbce-40f9-8702-22676f763b56 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Getting quotas for project 5f3ca2b15fd24916ac47e08325464d75. Resources: {'server_group_members'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:38:49.037124 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-283c4cbf-fbce-40f9-8702-22676f763b56 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Getting quotas for user 6daea1f7b0084009ac6e24181a1b87d7 and project 5f3ca2b15fd24916ac47e08325464d75. Resources: {'server_group_members'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:38:49.168620 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-283c4cbf-fbce-40f9-8702-22676f763b56 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.273432 Oct 04 18:38:49.181729 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1073/2000] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 18:38:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 3283 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:38:49.204431 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-0c2ff433-e689-4042-8460-38285a8799fd tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:49.207410 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-0c2ff433-e689-4042-8460-38285a8799fd tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] [instance: d1f298aa-ebe3-4f52-ada6-137a782cd9b7] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:49.240370 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0c2ff433-e689-4042-8460-38285a8799fd tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:49.246268 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0c2ff433-e689-4042-8460-38285a8799fd tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:49.246767 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0c2ff433-e689-4042-8460-38285a8799fd tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:49.254876 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0c2ff433-e689-4042-8460-38285a8799fd tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:49.255250 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0c2ff433-e689-4042-8460-38285a8799fd tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:49.255709 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0c2ff433-e689-4042-8460-38285a8799fd tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:49.524042 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-5f5053e1-50a4-4006-9048-59ca4c141f6d tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:49.539475 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-5f5053e1-50a4-4006-9048-59ca4c141f6d tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/d9d4332a-97b6-40f1-bd7c-a9a75a9adc43" status: 200 len: 1274 microversion: 2.1 time: 0.707984 Oct 04 18:38:49.540077 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 928/2001] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:48 2022] GET /compute/v2.1/servers/d9d4332a-97b6-40f1-bd7c-a9a75a9adc43 => generated 1274 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:49.560781 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-02638382-64ce-4a76-a7c7-3734a565c31b tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:49.562690 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-02638382-64ce-4a76-a7c7-3734a565c31b tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] [instance: 23ce945d-cd4a-40d5-80be-d5548c257e07] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:49.569557 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-02638382-64ce-4a76-a7c7-3734a565c31b tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:49.570470 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-02638382-64ce-4a76-a7c7-3734a565c31b tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:49.571161 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-02638382-64ce-4a76-a7c7-3734a565c31b tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:49.572123 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-02638382-64ce-4a76-a7c7-3734a565c31b tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:49.572835 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-02638382-64ce-4a76-a7c7-3734a565c31b tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:49.573541 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-02638382-64ce-4a76-a7c7-3734a565c31b tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:50.606316 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-02638382-64ce-4a76-a7c7-3734a565c31b tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c96ec8b8e0a4053b0457f213e6e262d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b812c85494a49898376a0dd8140f03c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:50.617094 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-02638382-64ce-4a76-a7c7-3734a565c31b tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] 10.222.0.43 "GET /compute/v2.1/servers/23ce945d-cd4a-40d5-80be-d5548c257e07" status: 200 len: 1315 microversion: 2.1 time: 1.062805 Oct 04 18:38:50.623633 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 929/2002] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:49 2022] GET /compute/v2.1/servers/23ce945d-cd4a-40d5-80be-d5548c257e07 => generated 1315 bytes in 1083 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:50.642536 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-28ef4eba-b150-442b-9747-b785cf30e0f6 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Calling method '.version_select at 0x7fb21fe785e0>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:50.807576 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-28ef4eba-b150-442b-9747-b785cf30e0f6 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] 10.222.0.43 "GET /compute/v2.1/images/e5989b78-5925-4d33-8625-f3af6fa4e64d" status: 200 len: 1454 microversion: 2.1 time: 0.177020 Oct 04 18:38:50.808835 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 930/2003] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 18:38:50 2022] GET /compute/v2.1/images/e5989b78-5925-4d33-8625-f3af6fa4e64d => generated 1454 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:50.824439 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-d37b356e-4d57-43a8-85d6-38cf6341e3ac tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:50.825739 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-d37b356e-4d57-43a8-85d6-38cf6341e3ac tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] [instance: 237ee25f-85f0-46d4-8980-66c5bfe764ad] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:50.840821 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d37b356e-4d57-43a8-85d6-38cf6341e3ac tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:50.841680 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d37b356e-4d57-43a8-85d6-38cf6341e3ac tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:50.842339 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d37b356e-4d57-43a8-85d6-38cf6341e3ac tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:50.843372 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d37b356e-4d57-43a8-85d6-38cf6341e3ac tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:50.844045 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d37b356e-4d57-43a8-85d6-38cf6341e3ac tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:50.844686 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d37b356e-4d57-43a8-85d6-38cf6341e3ac tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:51.037491 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-d37b356e-4d57-43a8-85d6-38cf6341e3ac tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6daea1f7b0084009ac6e24181a1b87d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f3ca2b15fd24916ac47e08325464d75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:51.097960 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-d37b356e-4d57-43a8-85d6-38cf6341e3ac tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] 10.222.0.43 "GET /compute/v2.1/servers/237ee25f-85f0-46d4-8980-66c5bfe764ad" status: 200 len: 1208 microversion: 2.1 time: 0.264300 Oct 04 18:38:51.122699 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 931/2004] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:50 2022] GET /compute/v2.1/servers/237ee25f-85f0-46d4-8980-66c5bfe764ad => generated 1208 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:51.151812 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-a334121c-b8f1-42ae-b014-805a646a5683 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:51.156818 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-a334121c-b8f1-42ae-b014-805a646a5683 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] [instance: 5d937ba2-60f4-40cf-9ed8-a4a86d458e38] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:51.193585 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a334121c-b8f1-42ae-b014-805a646a5683 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:51.194106 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a334121c-b8f1-42ae-b014-805a646a5683 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:51.194550 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a334121c-b8f1-42ae-b014-805a646a5683 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:51.195280 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a334121c-b8f1-42ae-b014-805a646a5683 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:51.195736 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a334121c-b8f1-42ae-b014-805a646a5683 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:51.196170 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a334121c-b8f1-42ae-b014-805a646a5683 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:51.450379 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-0c2ff433-e689-4042-8460-38285a8799fd tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:51.465788 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-0c2ff433-e689-4042-8460-38285a8799fd tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:51.471776 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-0c2ff433-e689-4042-8460-38285a8799fd tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:51.483469 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-0c2ff433-e689-4042-8460-38285a8799fd tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] 10.222.0.43 "GET /compute/v2.1/servers/d1f298aa-ebe3-4f52-ada6-137a782cd9b7" status: 200 len: 1292 microversion: 2.25 time: 2.302987 Oct 04 18:38:51.507615 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1074/2005] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:38:49 2022] GET /compute/v2.1/servers/d1f298aa-ebe3-4f52-ada6-137a782cd9b7 => generated 1292 bytes in 2334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:38:51.524278 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-4d5b03d6-c2ef-428c-a670-a58ac9392e3d tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:51.527516 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-4d5b03d6-c2ef-428c-a670-a58ac9392e3d tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: d9d4332a-97b6-40f1-bd7c-a9a75a9adc43] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:51.549791 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4d5b03d6-c2ef-428c-a670-a58ac9392e3d tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:51.550398 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4d5b03d6-c2ef-428c-a670-a58ac9392e3d tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:51.550838 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4d5b03d6-c2ef-428c-a670-a58ac9392e3d tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:51.551735 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4d5b03d6-c2ef-428c-a670-a58ac9392e3d tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:51.552399 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4d5b03d6-c2ef-428c-a670-a58ac9392e3d tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:51.553722 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4d5b03d6-c2ef-428c-a670-a58ac9392e3d tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:51.744714 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-4d5b03d6-c2ef-428c-a670-a58ac9392e3d tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:51.759686 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-4d5b03d6-c2ef-428c-a670-a58ac9392e3d tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/d9d4332a-97b6-40f1-bd7c-a9a75a9adc43" status: 200 len: 1336 microversion: 2.1 time: 0.250691 Oct 04 18:38:51.760588 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1075/2006] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:51 2022] GET /compute/v2.1/servers/d9d4332a-97b6-40f1-bd7c-a9a75a9adc43 => generated 1336 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:51.768529 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-a3919841-677a-454c-80f9-72f83ded6a62 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:51.769990 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-a3919841-677a-454c-80f9-72f83ded6a62 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] [instance: 23ce945d-cd4a-40d5-80be-d5548c257e07] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:51.778404 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a3919841-677a-454c-80f9-72f83ded6a62 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:51.779176 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a3919841-677a-454c-80f9-72f83ded6a62 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:51.779802 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a3919841-677a-454c-80f9-72f83ded6a62 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:51.780882 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a3919841-677a-454c-80f9-72f83ded6a62 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:51.781714 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a3919841-677a-454c-80f9-72f83ded6a62 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:51.782419 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a3919841-677a-454c-80f9-72f83ded6a62 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:52.424866 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-a3919841-677a-454c-80f9-72f83ded6a62 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c96ec8b8e0a4053b0457f213e6e262d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b812c85494a49898376a0dd8140f03c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:52.432903 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-a3919841-677a-454c-80f9-72f83ded6a62 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] 10.222.0.43 "GET /compute/v2.1/servers/23ce945d-cd4a-40d5-80be-d5548c257e07" status: 200 len: 1315 microversion: 2.1 time: 0.670986 Oct 04 18:38:52.440224 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1076/2007] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:51 2022] GET /compute/v2.1/servers/23ce945d-cd4a-40d5-80be-d5548c257e07 => generated 1315 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:52.445615 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-0b3f4387-81b1-4584-ae44-7fc370a1f99f tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Calling method '.version_select at 0x7fb22445fca0>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:52.533525 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-0b3f4387-81b1-4584-ae44-7fc370a1f99f tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] 10.222.0.43 "GET /compute/v2.1/images/e5989b78-5925-4d33-8625-f3af6fa4e64d" status: 200 len: 1454 microversion: 2.1 time: 0.091869 Oct 04 18:38:52.534881 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1077/2008] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 18:38:52 2022] GET /compute/v2.1/images/e5989b78-5925-4d33-8625-f3af6fa4e64d => generated 1454 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:52.539755 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-e609787d-b458-4656-b697-fefcede057b0 req-0491f230-01d9-490b-a04c-613035b225e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23ce945d-cd4a-40d5-80be-d5548c257e07", "tag": "cdfdd4b0-7f80-434d-ba80-684bf856bfe6"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:38:52.551749 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-e609787d-b458-4656-b697-fefcede057b0 req-0491f230-01d9-490b-a04c-613035b225e3 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:52.552606 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-e609787d-b458-4656-b697-fefcede057b0 req-0491f230-01d9-490b-a04c-613035b225e3 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:52.553290 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-e609787d-b458-4656-b697-fefcede057b0 req-0491f230-01d9-490b-a04c-613035b225e3 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:52.564996 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=100 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:38:52.567384 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-e609787d-b458-4656-b697-fefcede057b0 req-0491f230-01d9-490b-a04c-613035b225e3 service nova] Creating event network-changed:cdfdd4b0-7f80-434d-ba80-684bf856bfe6 for instance 23ce945d-cd4a-40d5-80be-d5548c257e07 on n-h1-851028-13 Oct 04 18:38:52.574303 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-e609787d-b458-4656-b697-fefcede057b0 req-0491f230-01d9-490b-a04c-613035b225e3 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037037 Oct 04 18:38:52.575912 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1078/2009] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:38:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:38:52.582178 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f60e2abe-34b2-43e0-932c-8969707eba51 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:52.583262 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-f60e2abe-34b2-43e0-932c-8969707eba51 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] [instance: 237ee25f-85f0-46d4-8980-66c5bfe764ad] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:52.591345 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f60e2abe-34b2-43e0-932c-8969707eba51 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:52.592259 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f60e2abe-34b2-43e0-932c-8969707eba51 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:52.593268 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f60e2abe-34b2-43e0-932c-8969707eba51 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:52.594440 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f60e2abe-34b2-43e0-932c-8969707eba51 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:52.595146 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f60e2abe-34b2-43e0-932c-8969707eba51 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:52.595810 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f60e2abe-34b2-43e0-932c-8969707eba51 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:52.763027 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-a334121c-b8f1-42ae-b014-805a646a5683 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eadce040fcf3427abab9ef8b0ca19400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f4f9b0233b4fb29963b77248a236f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:52.774738 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-a334121c-b8f1-42ae-b014-805a646a5683 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] 10.222.0.43 "GET /compute/v2.1/servers/5d937ba2-60f4-40cf-9ed8-a4a86d458e38" status: 200 len: 1324 microversion: 2.1 time: 1.648331 Oct 04 18:38:52.796969 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 932/2010] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:51 2022] GET /compute/v2.1/servers/5d937ba2-60f4-40cf-9ed8-a4a86d458e38 => generated 1324 bytes in 1673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:52.803787 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-0a359569-1106-4644-bce1-2c392520bcbf tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:52.805322 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-0a359569-1106-4644-bce1-2c392520bcbf tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] [instance: d1f298aa-ebe3-4f52-ada6-137a782cd9b7] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:52.814935 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0a359569-1106-4644-bce1-2c392520bcbf tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:52.815762 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0a359569-1106-4644-bce1-2c392520bcbf tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:52.816418 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0a359569-1106-4644-bce1-2c392520bcbf tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:52.817391 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0a359569-1106-4644-bce1-2c392520bcbf tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:52.818688 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0a359569-1106-4644-bce1-2c392520bcbf tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:52.819395 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0a359569-1106-4644-bce1-2c392520bcbf tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:52.825526 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:38:53.174363 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-f60e2abe-34b2-43e0-932c-8969707eba51 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6daea1f7b0084009ac6e24181a1b87d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f3ca2b15fd24916ac47e08325464d75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:53.184225 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-f60e2abe-34b2-43e0-932c-8969707eba51 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] 10.222.0.43 "GET /compute/v2.1/servers/237ee25f-85f0-46d4-8980-66c5bfe764ad" status: 200 len: 1282 microversion: 2.1 time: 0.606192 Oct 04 18:38:53.197852 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1079/2011] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:52 2022] GET /compute/v2.1/servers/237ee25f-85f0-46d4-8980-66c5bfe764ad => generated 1282 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:53.206572 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-0accc6ae-d0d1-42f8-9383-043f90ebb721 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:53.207288 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-0accc6ae-d0d1-42f8-9383-043f90ebb721 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: d9d4332a-97b6-40f1-bd7c-a9a75a9adc43] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:53.213202 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_api:DELETE=6,nova_api:SELECT=86,nova_api:INSERT=8 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:38:53.214794 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0accc6ae-d0d1-42f8-9383-043f90ebb721 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:53.215374 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0accc6ae-d0d1-42f8-9383-043f90ebb721 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:53.215930 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0accc6ae-d0d1-42f8-9383-043f90ebb721 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:53.216726 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0accc6ae-d0d1-42f8-9383-043f90ebb721 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:53.217284 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0accc6ae-d0d1-42f8-9383-043f90ebb721 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:53.218895 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0accc6ae-d0d1-42f8-9383-043f90ebb721 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:53.352478 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-0accc6ae-d0d1-42f8-9383-043f90ebb721 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:53.364674 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-0accc6ae-d0d1-42f8-9383-043f90ebb721 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/d9d4332a-97b6-40f1-bd7c-a9a75a9adc43" status: 200 len: 1336 microversion: 2.1 time: 0.165039 Oct 04 18:38:53.381837 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1080/2012] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:53 2022] GET /compute/v2.1/servers/d9d4332a-97b6-40f1-bd7c-a9a75a9adc43 => generated 1336 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:53.463520 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-1ba2d169-0de9-4da3-8243-d6d23f1b5906 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:53.464593 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-1ba2d169-0de9-4da3-8243-d6d23f1b5906 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] [instance: 23ce945d-cd4a-40d5-80be-d5548c257e07] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:53.472903 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1ba2d169-0de9-4da3-8243-d6d23f1b5906 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:53.473446 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1ba2d169-0de9-4da3-8243-d6d23f1b5906 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:53.473901 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1ba2d169-0de9-4da3-8243-d6d23f1b5906 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:53.474632 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1ba2d169-0de9-4da3-8243-d6d23f1b5906 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:53.475095 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1ba2d169-0de9-4da3-8243-d6d23f1b5906 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:53.475532 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1ba2d169-0de9-4da3-8243-d6d23f1b5906 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:53.545617 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-0a359569-1106-4644-bce1-2c392520bcbf tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:53.575632 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-0a359569-1106-4644-bce1-2c392520bcbf tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:53.578737 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-0a359569-1106-4644-bce1-2c392520bcbf tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:53.581759 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-0a359569-1106-4644-bce1-2c392520bcbf tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] 10.222.0.43 "GET /compute/v2.1/servers/d1f298aa-ebe3-4f52-ada6-137a782cd9b7" status: 200 len: 1280 microversion: 2.25 time: 0.782499 Oct 04 18:38:53.583670 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 933/2013] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:38:52 2022] GET /compute/v2.1/servers/d1f298aa-ebe3-4f52-ada6-137a782cd9b7 => generated 1280 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:38:53.594529 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-0e430ac8-c5e8-4064-9cbf-19cf5f45698d tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Calling method '.version_select at 0x7fb21fc3cee0>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:53.658074 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-0e430ac8-c5e8-4064-9cbf-19cf5f45698d tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] 10.222.0.43 "GET /compute/v2.1/images/e5989b78-5925-4d33-8625-f3af6fa4e64d" status: 200 len: 1454 microversion: 2.1 time: 0.071344 Oct 04 18:38:53.667211 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 934/2014] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 18:38:53 2022] GET /compute/v2.1/images/e5989b78-5925-4d33-8625-f3af6fa4e64d => generated 1454 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:53.803059 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-9c99e9ba-88f9-44e8-a509-03db223c9d3b tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:53.803818 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-9c99e9ba-88f9-44e8-a509-03db223c9d3b tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] [instance: 5d937ba2-60f4-40cf-9ed8-a4a86d458e38] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:53.817655 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9c99e9ba-88f9-44e8-a509-03db223c9d3b tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:53.818046 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9c99e9ba-88f9-44e8-a509-03db223c9d3b tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:53.818561 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9c99e9ba-88f9-44e8-a509-03db223c9d3b tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:53.819356 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9c99e9ba-88f9-44e8-a509-03db223c9d3b tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:53.820560 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9c99e9ba-88f9-44e8-a509-03db223c9d3b tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:53.821012 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9c99e9ba-88f9-44e8-a509-03db223c9d3b tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:54.193783 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-1ba2d169-0de9-4da3-8243-d6d23f1b5906 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c96ec8b8e0a4053b0457f213e6e262d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b812c85494a49898376a0dd8140f03c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:54.209505 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-1ba2d169-0de9-4da3-8243-d6d23f1b5906 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] 10.222.0.43 "GET /compute/v2.1/servers/23ce945d-cd4a-40d5-80be-d5548c257e07" status: 200 len: 1315 microversion: 2.1 time: 0.748520 Oct 04 18:38:54.211205 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1081/2015] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:53 2022] GET /compute/v2.1/servers/23ce945d-cd4a-40d5-80be-d5548c257e07 => generated 1315 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:54.220464 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-b883f759-1d52-4efc-a1cb-4244bce42434 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:54.221419 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-b883f759-1d52-4efc-a1cb-4244bce42434 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] [instance: 237ee25f-85f0-46d4-8980-66c5bfe764ad] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:54.231638 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b883f759-1d52-4efc-a1cb-4244bce42434 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:54.232471 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b883f759-1d52-4efc-a1cb-4244bce42434 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:54.234411 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b883f759-1d52-4efc-a1cb-4244bce42434 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:54.235355 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b883f759-1d52-4efc-a1cb-4244bce42434 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:54.235981 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b883f759-1d52-4efc-a1cb-4244bce42434 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:54.237378 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b883f759-1d52-4efc-a1cb-4244bce42434 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:54.241046 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-9c99e9ba-88f9-44e8-a509-03db223c9d3b tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eadce040fcf3427abab9ef8b0ca19400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f4f9b0233b4fb29963b77248a236f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:54.254702 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-9c99e9ba-88f9-44e8-a509-03db223c9d3b tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] 10.222.0.43 "GET /compute/v2.1/servers/5d937ba2-60f4-40cf-9ed8-a4a86d458e38" status: 200 len: 1324 microversion: 2.1 time: 0.456013 Oct 04 18:38:54.266215 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 935/2016] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:53 2022] GET /compute/v2.1/servers/5d937ba2-60f4-40cf-9ed8-a4a86d458e38 => generated 1324 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:54.388759 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-bce32006-0beb-432f-a4da-6f5318fb6fb7 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:54.389337 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-bce32006-0beb-432f-a4da-6f5318fb6fb7 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: d9d4332a-97b6-40f1-bd7c-a9a75a9adc43] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:54.400787 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bce32006-0beb-432f-a4da-6f5318fb6fb7 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:54.401322 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bce32006-0beb-432f-a4da-6f5318fb6fb7 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:54.401785 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bce32006-0beb-432f-a4da-6f5318fb6fb7 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:54.402512 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bce32006-0beb-432f-a4da-6f5318fb6fb7 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:54.402975 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bce32006-0beb-432f-a4da-6f5318fb6fb7 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:54.403393 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bce32006-0beb-432f-a4da-6f5318fb6fb7 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:54.498839 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-b883f759-1d52-4efc-a1cb-4244bce42434 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6daea1f7b0084009ac6e24181a1b87d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f3ca2b15fd24916ac47e08325464d75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:54.516215 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-b883f759-1d52-4efc-a1cb-4244bce42434 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] 10.222.0.43 "GET /compute/v2.1/servers/237ee25f-85f0-46d4-8980-66c5bfe764ad" status: 200 len: 1270 microversion: 2.1 time: 0.303169 Oct 04 18:38:54.525132 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1082/2017] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:54 2022] GET /compute/v2.1/servers/237ee25f-85f0-46d4-8980-66c5bfe764ad => generated 1270 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:54.610565 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-ea606b2a-3b6b-4ca0-a68c-4cbb8bf0df29 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:54.611460 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-ea606b2a-3b6b-4ca0-a68c-4cbb8bf0df29 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] [instance: d1f298aa-ebe3-4f52-ada6-137a782cd9b7] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:54.623322 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ea606b2a-3b6b-4ca0-a68c-4cbb8bf0df29 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:54.629310 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ea606b2a-3b6b-4ca0-a68c-4cbb8bf0df29 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:54.630174 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ea606b2a-3b6b-4ca0-a68c-4cbb8bf0df29 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:54.631155 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ea606b2a-3b6b-4ca0-a68c-4cbb8bf0df29 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:54.631837 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ea606b2a-3b6b-4ca0-a68c-4cbb8bf0df29 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:54.643156 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ea606b2a-3b6b-4ca0-a68c-4cbb8bf0df29 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:55.069610 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-bce32006-0beb-432f-a4da-6f5318fb6fb7 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:55.085548 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-bce32006-0beb-432f-a4da-6f5318fb6fb7 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/d9d4332a-97b6-40f1-bd7c-a9a75a9adc43" status: 200 len: 1378 microversion: 2.1 time: 0.700785 Oct 04 18:38:55.092479 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 936/2018] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:54 2022] GET /compute/v2.1/servers/d9d4332a-97b6-40f1-bd7c-a9a75a9adc43 => generated 1378 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:55.100162 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-4009501e-bed3-4557-b204-3d24d188099d tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Calling method '.version_select at 0x7fb21f7c0f70>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:55.191516 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-4009501e-bed3-4557-b204-3d24d188099d tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] 10.222.0.43 "GET /compute/v2.1/images/e5989b78-5925-4d33-8625-f3af6fa4e64d" status: 200 len: 1454 microversion: 2.1 time: 0.096213 Oct 04 18:38:55.193552 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 937/2019] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 18:38:55 2022] GET /compute/v2.1/images/e5989b78-5925-4d33-8625-f3af6fa4e64d => generated 1454 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:55.234038 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-98bbb3c0-a766-46f9-9cd1-82031222fa82 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:55.235088 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-98bbb3c0-a766-46f9-9cd1-82031222fa82 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] [instance: 23ce945d-cd4a-40d5-80be-d5548c257e07] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:55.244803 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-98bbb3c0-a766-46f9-9cd1-82031222fa82 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:55.245734 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-98bbb3c0-a766-46f9-9cd1-82031222fa82 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:55.246522 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-98bbb3c0-a766-46f9-9cd1-82031222fa82 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:55.247642 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-98bbb3c0-a766-46f9-9cd1-82031222fa82 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:55.248380 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-98bbb3c0-a766-46f9-9cd1-82031222fa82 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:55.249076 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-98bbb3c0-a766-46f9-9cd1-82031222fa82 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:55.618247 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-ea606b2a-3b6b-4ca0-a68c-4cbb8bf0df29 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:55.631265 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-ea606b2a-3b6b-4ca0-a68c-4cbb8bf0df29 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:55.632907 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-ea606b2a-3b6b-4ca0-a68c-4cbb8bf0df29 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:55.637442 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-ea606b2a-3b6b-4ca0-a68c-4cbb8bf0df29 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] 10.222.0.43 "GET /compute/v2.1/servers/d1f298aa-ebe3-4f52-ada6-137a782cd9b7" status: 200 len: 1280 microversion: 2.25 time: 1.031301 Oct 04 18:38:55.646665 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1083/2020] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:38:54 2022] GET /compute/v2.1/servers/d1f298aa-ebe3-4f52-ada6-137a782cd9b7 => generated 1280 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:38:55.652001 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-b378b312-53df-4f97-9b0c-eb835206d788 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:55.652796 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-b378b312-53df-4f97-9b0c-eb835206d788 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] [instance: 5d937ba2-60f4-40cf-9ed8-a4a86d458e38] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:55.668693 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b378b312-53df-4f97-9b0c-eb835206d788 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:55.669351 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b378b312-53df-4f97-9b0c-eb835206d788 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:55.670005 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b378b312-53df-4f97-9b0c-eb835206d788 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:55.670954 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b378b312-53df-4f97-9b0c-eb835206d788 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:55.671626 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b378b312-53df-4f97-9b0c-eb835206d788 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:55.672438 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b378b312-53df-4f97-9b0c-eb835206d788 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:55.859105 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-98bbb3c0-a766-46f9-9cd1-82031222fa82 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c96ec8b8e0a4053b0457f213e6e262d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b812c85494a49898376a0dd8140f03c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:55.872937 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-98bbb3c0-a766-46f9-9cd1-82031222fa82 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] 10.222.0.43 "GET /compute/v2.1/servers/23ce945d-cd4a-40d5-80be-d5548c257e07" status: 200 len: 1315 microversion: 2.1 time: 0.642595 Oct 04 18:38:55.876201 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 938/2021] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:55 2022] GET /compute/v2.1/servers/23ce945d-cd4a-40d5-80be-d5548c257e07 => generated 1315 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:55.893977 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-a457e8f1-b87f-4b19-83aa-e81c9c8f2b2e tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:55.895054 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-a457e8f1-b87f-4b19-83aa-e81c9c8f2b2e tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] [instance: 237ee25f-85f0-46d4-8980-66c5bfe764ad] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:55.910845 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a457e8f1-b87f-4b19-83aa-e81c9c8f2b2e tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:55.911829 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a457e8f1-b87f-4b19-83aa-e81c9c8f2b2e tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:55.913675 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a457e8f1-b87f-4b19-83aa-e81c9c8f2b2e tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:55.914753 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a457e8f1-b87f-4b19-83aa-e81c9c8f2b2e tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:55.916126 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a457e8f1-b87f-4b19-83aa-e81c9c8f2b2e tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:55.919653 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a457e8f1-b87f-4b19-83aa-e81c9c8f2b2e tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:56.096557 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=4 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:38:56.131909 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=46 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:38:56.183595 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-b378b312-53df-4f97-9b0c-eb835206d788 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eadce040fcf3427abab9ef8b0ca19400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f4f9b0233b4fb29963b77248a236f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:56.194899 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-b378b312-53df-4f97-9b0c-eb835206d788 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] 10.222.0.43 "GET /compute/v2.1/servers/5d937ba2-60f4-40cf-9ed8-a4a86d458e38" status: 200 len: 1324 microversion: 2.1 time: 0.546800 Oct 04 18:38:56.201194 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1084/2022] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:55 2022] GET /compute/v2.1/servers/5d937ba2-60f4-40cf-9ed8-a4a86d458e38 => generated 1324 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:56.222879 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-901c5eff-ea53-4f91-a5b7-88a076d7d84a req-4f3838b3-d2d2-4e22-ba60-324e95705ea1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d937ba2-60f4-40cf-9ed8-a4a86d458e38", "tag": "568dee2e-5618-4d07-a3bd-4aaf5000f435"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:38:56.263411 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-901c5eff-ea53-4f91-a5b7-88a076d7d84a req-4f3838b3-d2d2-4e22-ba60-324e95705ea1 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:56.263907 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-901c5eff-ea53-4f91-a5b7-88a076d7d84a req-4f3838b3-d2d2-4e22-ba60-324e95705ea1 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:56.264395 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-901c5eff-ea53-4f91-a5b7-88a076d7d84a req-4f3838b3-d2d2-4e22-ba60-324e95705ea1 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:56.331805 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-901c5eff-ea53-4f91-a5b7-88a076d7d84a req-4f3838b3-d2d2-4e22-ba60-324e95705ea1 service nova] Creating event network-changed:568dee2e-5618-4d07-a3bd-4aaf5000f435 for instance 5d937ba2-60f4-40cf-9ed8-a4a86d458e38 on n-h1-851028-13 Oct 04 18:38:56.349041 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-901c5eff-ea53-4f91-a5b7-88a076d7d84a req-4f3838b3-d2d2-4e22-ba60-324e95705ea1 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.146412 Oct 04 18:38:56.351544 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1085/2023] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:38:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:38:56.368105 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-9e691cd4-3f19-4e84-8029-2038d2fdcf28 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:56.368783 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-9e691cd4-3f19-4e84-8029-2038d2fdcf28 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: d9d4332a-97b6-40f1-bd7c-a9a75a9adc43] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:56.396215 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9e691cd4-3f19-4e84-8029-2038d2fdcf28 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:56.400922 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9e691cd4-3f19-4e84-8029-2038d2fdcf28 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:56.402572 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9e691cd4-3f19-4e84-8029-2038d2fdcf28 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:56.409567 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9e691cd4-3f19-4e84-8029-2038d2fdcf28 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:56.410194 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9e691cd4-3f19-4e84-8029-2038d2fdcf28 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:56.423452 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9e691cd4-3f19-4e84-8029-2038d2fdcf28 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:56.954212 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-9e691cd4-3f19-4e84-8029-2038d2fdcf28 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:56.984811 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-9e691cd4-3f19-4e84-8029-2038d2fdcf28 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/d9d4332a-97b6-40f1-bd7c-a9a75a9adc43" status: 200 len: 1378 microversion: 2.1 time: 0.617245 Oct 04 18:38:56.992328 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1086/2024] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:56 2022] GET /compute/v2.1/servers/d9d4332a-97b6-40f1-bd7c-a9a75a9adc43 => generated 1378 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:57.023664 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-0b6737a2-cc55-4839-b7c3-52aa6b590720 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Calling method '.version_select at 0x7fb227eb1790>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:57.134496 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-0b6737a2-cc55-4839-b7c3-52aa6b590720 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] 10.222.0.43 "GET /compute/v2.1/images/e5989b78-5925-4d33-8625-f3af6fa4e64d" status: 200 len: 1454 microversion: 2.1 time: 0.136410 Oct 04 18:38:57.135486 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1087/2025] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 18:38:56 2022] GET /compute/v2.1/images/e5989b78-5925-4d33-8625-f3af6fa4e64d => generated 1454 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:57.149566 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-de7eda16-4d97-426d-9d33-4cf564a75439 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:57.150493 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-de7eda16-4d97-426d-9d33-4cf564a75439 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] [instance: d1f298aa-ebe3-4f52-ada6-137a782cd9b7] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:57.158038 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-de7eda16-4d97-426d-9d33-4cf564a75439 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:57.158877 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-de7eda16-4d97-426d-9d33-4cf564a75439 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:57.159582 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-de7eda16-4d97-426d-9d33-4cf564a75439 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:57.160552 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-de7eda16-4d97-426d-9d33-4cf564a75439 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:57.161272 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-de7eda16-4d97-426d-9d33-4cf564a75439 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:57.161942 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-de7eda16-4d97-426d-9d33-4cf564a75439 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:57.978634 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-a457e8f1-b87f-4b19-83aa-e81c9c8f2b2e tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6daea1f7b0084009ac6e24181a1b87d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f3ca2b15fd24916ac47e08325464d75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:57.992153 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-a457e8f1-b87f-4b19-83aa-e81c9c8f2b2e tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] 10.222.0.43 "GET /compute/v2.1/servers/237ee25f-85f0-46d4-8980-66c5bfe764ad" status: 200 len: 1312 microversion: 2.1 time: 2.111461 Oct 04 18:38:57.994251 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 939/2026] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:55 2022] GET /compute/v2.1/servers/237ee25f-85f0-46d4-8980-66c5bfe764ad => generated 1312 bytes in 2114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:58.024716 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-a78d03d0-e227-4be9-bc0a-63aebfab888e tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:58.028566 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-a78d03d0-e227-4be9-bc0a-63aebfab888e tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] [instance: 23ce945d-cd4a-40d5-80be-d5548c257e07] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:58.044691 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a78d03d0-e227-4be9-bc0a-63aebfab888e tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:58.045572 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a78d03d0-e227-4be9-bc0a-63aebfab888e tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:58.046335 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a78d03d0-e227-4be9-bc0a-63aebfab888e tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:58.047571 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a78d03d0-e227-4be9-bc0a-63aebfab888e tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:58.054143 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a78d03d0-e227-4be9-bc0a-63aebfab888e tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:58.055361 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a78d03d0-e227-4be9-bc0a-63aebfab888e tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:58.206867 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-de7eda16-4d97-426d-9d33-4cf564a75439 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:58.222071 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-de7eda16-4d97-426d-9d33-4cf564a75439 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:58.225868 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-de7eda16-4d97-426d-9d33-4cf564a75439 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:58.236224 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-de7eda16-4d97-426d-9d33-4cf564a75439 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] 10.222.0.43 "GET /compute/v2.1/servers/d1f298aa-ebe3-4f52-ada6-137a782cd9b7" status: 200 len: 1280 microversion: 2.25 time: 1.091046 Oct 04 18:38:58.237146 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1088/2027] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:38:57 2022] GET /compute/v2.1/servers/d1f298aa-ebe3-4f52-ada6-137a782cd9b7 => generated 1280 bytes in 1093 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:38:58.245458 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f71d88ba-4887-420a-bee6-3634ff71fac8 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:58.246355 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-f71d88ba-4887-420a-bee6-3634ff71fac8 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] [instance: 5d937ba2-60f4-40cf-9ed8-a4a86d458e38] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:58.272854 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f71d88ba-4887-420a-bee6-3634ff71fac8 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:58.273686 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f71d88ba-4887-420a-bee6-3634ff71fac8 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:58.274332 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f71d88ba-4887-420a-bee6-3634ff71fac8 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:58.276712 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f71d88ba-4887-420a-bee6-3634ff71fac8 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:58.277818 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f71d88ba-4887-420a-bee6-3634ff71fac8 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:58.280754 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f71d88ba-4887-420a-bee6-3634ff71fac8 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:58.679029 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=4 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:38:58.774614 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-f71d88ba-4887-420a-bee6-3634ff71fac8 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eadce040fcf3427abab9ef8b0ca19400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f4f9b0233b4fb29963b77248a236f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:58.795762 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-f71d88ba-4887-420a-bee6-3634ff71fac8 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] 10.222.0.43 "GET /compute/v2.1/servers/5d937ba2-60f4-40cf-9ed8-a4a86d458e38" status: 200 len: 1324 microversion: 2.1 time: 0.554162 Oct 04 18:38:58.797439 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1089/2028] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:58 2022] GET /compute/v2.1/servers/5d937ba2-60f4-40cf-9ed8-a4a86d458e38 => generated 1324 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:58.804723 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-8b692985-800a-474a-8156-94ec6a6cf0c7 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:58.805837 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-8b692985-800a-474a-8156-94ec6a6cf0c7 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: d9d4332a-97b6-40f1-bd7c-a9a75a9adc43] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:58.819365 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8b692985-800a-474a-8156-94ec6a6cf0c7 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:58.819875 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8b692985-800a-474a-8156-94ec6a6cf0c7 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:58.820543 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8b692985-800a-474a-8156-94ec6a6cf0c7 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:58.821462 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8b692985-800a-474a-8156-94ec6a6cf0c7 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:58.821996 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8b692985-800a-474a-8156-94ec6a6cf0c7 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:58.822430 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8b692985-800a-474a-8156-94ec6a6cf0c7 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:58.977995 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-a78d03d0-e227-4be9-bc0a-63aebfab888e tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c96ec8b8e0a4053b0457f213e6e262d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b812c85494a49898376a0dd8140f03c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:59.004459 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-a78d03d0-e227-4be9-bc0a-63aebfab888e tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] 10.222.0.43 "GET /compute/v2.1/servers/23ce945d-cd4a-40d5-80be-d5548c257e07" status: 200 len: 1315 microversion: 2.1 time: 0.990227 Oct 04 18:38:59.012349 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 940/2029] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:58 2022] GET /compute/v2.1/servers/23ce945d-cd4a-40d5-80be-d5548c257e07 => generated 1315 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:59.023069 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-67fa2da5-a018-473c-9194-53a1371d16ad tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Calling method '.version_select at 0x7fb21fc54d30>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:59.074119 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=38 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:38:59.112293 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-67fa2da5-a018-473c-9194-53a1371d16ad tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] 10.222.0.43 "GET /compute/v2.1/images/e5989b78-5925-4d33-8625-f3af6fa4e64d" status: 200 len: 1454 microversion: 2.1 time: 0.098619 Oct 04 18:38:59.121899 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 941/2030] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 18:38:59 2022] GET /compute/v2.1/images/e5989b78-5925-4d33-8625-f3af6fa4e64d => generated 1454 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:59.132343 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-d534d10a-c8ac-4ffb-b2cd-51ad7545658c req-c3cda34e-f493-4ae1-88e1-7d23f11f1d12 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "237ee25f-85f0-46d4-8980-66c5bfe764ad", "tag": "9dcfd052-bd8d-45aa-915c-a8e3f094bca0"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:38:59.148542 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-d534d10a-c8ac-4ffb-b2cd-51ad7545658c req-c3cda34e-f493-4ae1-88e1-7d23f11f1d12 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:59.150573 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-d534d10a-c8ac-4ffb-b2cd-51ad7545658c req-c3cda34e-f493-4ae1-88e1-7d23f11f1d12 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:59.157737 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-d534d10a-c8ac-4ffb-b2cd-51ad7545658c req-c3cda34e-f493-4ae1-88e1-7d23f11f1d12 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:59.188470 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-d534d10a-c8ac-4ffb-b2cd-51ad7545658c req-c3cda34e-f493-4ae1-88e1-7d23f11f1d12 service nova] Creating event network-changed:9dcfd052-bd8d-45aa-915c-a8e3f094bca0 for instance 237ee25f-85f0-46d4-8980-66c5bfe764ad on n-h2-851028-13 Oct 04 18:38:59.199799 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-d534d10a-c8ac-4ffb-b2cd-51ad7545658c req-c3cda34e-f493-4ae1-88e1-7d23f11f1d12 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076467 Oct 04 18:38:59.204253 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 942/2031] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:38:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:38:59.219958 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-7aee1631-6858-428a-aab3-6afe1353480d tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:59.222348 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-7aee1631-6858-428a-aab3-6afe1353480d tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] [instance: 237ee25f-85f0-46d4-8980-66c5bfe764ad] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:59.235288 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7aee1631-6858-428a-aab3-6afe1353480d tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:59.235788 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7aee1631-6858-428a-aab3-6afe1353480d tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:59.236362 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7aee1631-6858-428a-aab3-6afe1353480d tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:59.237199 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7aee1631-6858-428a-aab3-6afe1353480d tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:59.242798 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7aee1631-6858-428a-aab3-6afe1353480d tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:59.244782 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7aee1631-6858-428a-aab3-6afe1353480d tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:59.391546 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-8b692985-800a-474a-8156-94ec6a6cf0c7 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:59.401158 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-8b692985-800a-474a-8156-94ec6a6cf0c7 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/d9d4332a-97b6-40f1-bd7c-a9a75a9adc43" status: 200 len: 1378 microversion: 2.1 time: 0.601815 Oct 04 18:38:59.414843 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1090/2032] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:58 2022] GET /compute/v2.1/servers/d9d4332a-97b6-40f1-bd7c-a9a75a9adc43 => generated 1378 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:59.423618 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f5630cff-560c-4e24-9767-faedbfc4a5a0 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:59.434124 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-f5630cff-560c-4e24-9767-faedbfc4a5a0 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] [instance: d1f298aa-ebe3-4f52-ada6-137a782cd9b7] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:59.469782 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f5630cff-560c-4e24-9767-faedbfc4a5a0 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:59.472161 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f5630cff-560c-4e24-9767-faedbfc4a5a0 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:59.472911 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f5630cff-560c-4e24-9767-faedbfc4a5a0 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:59.475408 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f5630cff-560c-4e24-9767-faedbfc4a5a0 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:59.477721 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f5630cff-560c-4e24-9767-faedbfc4a5a0 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:59.481714 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f5630cff-560c-4e24-9767-faedbfc4a5a0 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:00.079907 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-f5630cff-560c-4e24-9767-faedbfc4a5a0 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:00.094213 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-f5630cff-560c-4e24-9767-faedbfc4a5a0 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:00.098425 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-f5630cff-560c-4e24-9767-faedbfc4a5a0 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:00.100602 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-f5630cff-560c-4e24-9767-faedbfc4a5a0 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] 10.222.0.43 "GET /compute/v2.1/servers/d1f298aa-ebe3-4f52-ada6-137a782cd9b7" status: 200 len: 1280 microversion: 2.25 time: 0.683243 Oct 04 18:39:00.101214 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1091/2033] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:38:59 2022] GET /compute/v2.1/servers/d1f298aa-ebe3-4f52-ada6-137a782cd9b7 => generated 1280 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:39:00.114638 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-49a22833-a622-4044-9df2-94c8f8b850ee tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:00.116227 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-49a22833-a622-4044-9df2-94c8f8b850ee tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] [instance: 5d937ba2-60f4-40cf-9ed8-a4a86d458e38] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:00.134476 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-49a22833-a622-4044-9df2-94c8f8b850ee tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:00.137834 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-49a22833-a622-4044-9df2-94c8f8b850ee tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:00.138622 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-49a22833-a622-4044-9df2-94c8f8b850ee tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:00.140838 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-49a22833-a622-4044-9df2-94c8f8b850ee tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:00.142283 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-49a22833-a622-4044-9df2-94c8f8b850ee tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:00.144100 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-49a22833-a622-4044-9df2-94c8f8b850ee tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:00.287416 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-7aee1631-6858-428a-aab3-6afe1353480d tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6daea1f7b0084009ac6e24181a1b87d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f3ca2b15fd24916ac47e08325464d75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:00.306463 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-7aee1631-6858-428a-aab3-6afe1353480d tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] 10.222.0.43 "GET /compute/v2.1/servers/237ee25f-85f0-46d4-8980-66c5bfe764ad" status: 200 len: 1312 microversion: 2.1 time: 1.098717 Oct 04 18:39:00.309273 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 943/2034] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:59 2022] GET /compute/v2.1/servers/237ee25f-85f0-46d4-8980-66c5bfe764ad => generated 1312 bytes in 1104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:00.324031 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-e06121eb-0ff0-4ae2-8efc-e48169316dfb tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:00.329641 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-e06121eb-0ff0-4ae2-8efc-e48169316dfb tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] [instance: 23ce945d-cd4a-40d5-80be-d5548c257e07] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:00.365317 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e06121eb-0ff0-4ae2-8efc-e48169316dfb tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:00.370052 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e06121eb-0ff0-4ae2-8efc-e48169316dfb tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:00.372968 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e06121eb-0ff0-4ae2-8efc-e48169316dfb tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:00.376445 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e06121eb-0ff0-4ae2-8efc-e48169316dfb tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:00.379876 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e06121eb-0ff0-4ae2-8efc-e48169316dfb tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:00.380522 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e06121eb-0ff0-4ae2-8efc-e48169316dfb tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:00.666397 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-49a22833-a622-4044-9df2-94c8f8b850ee tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eadce040fcf3427abab9ef8b0ca19400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f4f9b0233b4fb29963b77248a236f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:00.683156 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-49a22833-a622-4044-9df2-94c8f8b850ee tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] 10.222.0.43 "GET /compute/v2.1/servers/5d937ba2-60f4-40cf-9ed8-a4a86d458e38" status: 200 len: 1324 microversion: 2.1 time: 0.580770 Oct 04 18:39:00.683771 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1092/2035] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:00 2022] GET /compute/v2.1/servers/5d937ba2-60f4-40cf-9ed8-a4a86d458e38 => generated 1324 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:00.716131 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-d400c810-3f51-47db-9510-4a7fcb7fddd0 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Calling method '.version_select at 0x7fb21fb53040>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:00.800173 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-d400c810-3f51-47db-9510-4a7fcb7fddd0 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] 10.222.0.43 "GET /compute/v2.1/images/e5989b78-5925-4d33-8625-f3af6fa4e64d" status: 200 len: 1454 microversion: 2.1 time: 0.104140 Oct 04 18:39:00.800759 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1093/2036] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 18:39:00 2022] GET /compute/v2.1/images/e5989b78-5925-4d33-8625-f3af6fa4e64d => generated 1454 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:01.021435 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-e06121eb-0ff0-4ae2-8efc-e48169316dfb tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c96ec8b8e0a4053b0457f213e6e262d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b812c85494a49898376a0dd8140f03c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:01.040550 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-e06121eb-0ff0-4ae2-8efc-e48169316dfb tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] 10.222.0.43 "GET /compute/v2.1/servers/23ce945d-cd4a-40d5-80be-d5548c257e07" status: 200 len: 1315 microversion: 2.1 time: 0.728184 Oct 04 18:39:01.049572 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 944/2037] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:00 2022] GET /compute/v2.1/servers/23ce945d-cd4a-40d5-80be-d5548c257e07 => generated 1315 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:01.086120 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-02029c35-1767-4d0a-bcfa-5bea2a6ca0d1 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:01.087139 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-02029c35-1767-4d0a-bcfa-5bea2a6ca0d1 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: d9d4332a-97b6-40f1-bd7c-a9a75a9adc43] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:01.109235 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-02029c35-1767-4d0a-bcfa-5bea2a6ca0d1 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:01.110218 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-02029c35-1767-4d0a-bcfa-5bea2a6ca0d1 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:01.112179 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-02029c35-1767-4d0a-bcfa-5bea2a6ca0d1 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:01.113189 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-02029c35-1767-4d0a-bcfa-5bea2a6ca0d1 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:01.117833 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-02029c35-1767-4d0a-bcfa-5bea2a6ca0d1 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:01.118916 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-02029c35-1767-4d0a-bcfa-5bea2a6ca0d1 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:01.368105 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-fdaa9445-912d-4a6f-bdf1-a15ea0992a54 tempest-AZV2TestJSON-1885909849 tempest-AZV2TestJSON-1885909849-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:01.370097 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fdaa9445-912d-4a6f-bdf1-a15ea0992a54 tempest-AZV2TestJSON-1885909849 tempest-AZV2TestJSON-1885909849-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:01.370599 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fdaa9445-912d-4a6f-bdf1-a15ea0992a54 tempest-AZV2TestJSON-1885909849 tempest-AZV2TestJSON-1885909849-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:01.371042 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fdaa9445-912d-4a6f-bdf1-a15ea0992a54 tempest-AZV2TestJSON-1885909849 tempest-AZV2TestJSON-1885909849-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:01.372362 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fdaa9445-912d-4a6f-bdf1-a15ea0992a54 tempest-AZV2TestJSON-1885909849 tempest-AZV2TestJSON-1885909849-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:01.372823 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fdaa9445-912d-4a6f-bdf1-a15ea0992a54 tempest-AZV2TestJSON-1885909849 tempest-AZV2TestJSON-1885909849-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:01.373282 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fdaa9445-912d-4a6f-bdf1-a15ea0992a54 tempest-AZV2TestJSON-1885909849 tempest-AZV2TestJSON-1885909849-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:01.417277 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-fdaa9445-912d-4a6f-bdf1-a15ea0992a54 tempest-AZV2TestJSON-1885909849 tempest-AZV2TestJSON-1885909849-project] 10.222.0.43 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.609251 Oct 04 18:39:01.426767 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1094/2038] 10.222.0.43 () {58 vars in 1164 bytes} [Tue Oct 4 18:39:00 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:39:01.434104 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-7472d9e0-1bfa-49cc-86b3-c96034d4c842 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:01.435029 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-7472d9e0-1bfa-49cc-86b3-c96034d4c842 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] [instance: d1f298aa-ebe3-4f52-ada6-137a782cd9b7] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:01.442440 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7472d9e0-1bfa-49cc-86b3-c96034d4c842 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:01.443232 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7472d9e0-1bfa-49cc-86b3-c96034d4c842 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:01.443848 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7472d9e0-1bfa-49cc-86b3-c96034d4c842 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:01.444732 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7472d9e0-1bfa-49cc-86b3-c96034d4c842 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:01.446674 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7472d9e0-1bfa-49cc-86b3-c96034d4c842 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:01.447642 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7472d9e0-1bfa-49cc-86b3-c96034d4c842 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:01.951118 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-02029c35-1767-4d0a-bcfa-5bea2a6ca0d1 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:01.974975 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-02029c35-1767-4d0a-bcfa-5bea2a6ca0d1 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/d9d4332a-97b6-40f1-bd7c-a9a75a9adc43" status: 200 len: 1378 microversion: 2.1 time: 0.920674 Oct 04 18:39:01.976914 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 945/2039] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:01 2022] GET /compute/v2.1/servers/d9d4332a-97b6-40f1-bd7c-a9a75a9adc43 => generated 1378 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:01.997988 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-866b1691-046c-403f-a926-cfebf16c0147 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:02.006907 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-866b1691-046c-403f-a926-cfebf16c0147 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] [instance: 237ee25f-85f0-46d4-8980-66c5bfe764ad] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:02.033012 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-866b1691-046c-403f-a926-cfebf16c0147 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:02.033590 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-866b1691-046c-403f-a926-cfebf16c0147 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:02.034055 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-866b1691-046c-403f-a926-cfebf16c0147 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:02.034804 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-866b1691-046c-403f-a926-cfebf16c0147 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:02.035271 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-866b1691-046c-403f-a926-cfebf16c0147 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:02.040756 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-866b1691-046c-403f-a926-cfebf16c0147 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:02.493460 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-866b1691-046c-403f-a926-cfebf16c0147 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6daea1f7b0084009ac6e24181a1b87d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f3ca2b15fd24916ac47e08325464d75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:02.502957 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-866b1691-046c-403f-a926-cfebf16c0147 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] 10.222.0.43 "GET /compute/v2.1/servers/237ee25f-85f0-46d4-8980-66c5bfe764ad" status: 200 len: 1312 microversion: 2.1 time: 0.521999 Oct 04 18:39:02.506390 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 946/2040] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:01 2022] GET /compute/v2.1/servers/237ee25f-85f0-46d4-8980-66c5bfe764ad => generated 1312 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:02.522057 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-541d7076-a045-459b-bae2-d2507432a04c req-b6a7731a-5604-457d-b285-61cf0a2180c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9d4332a-97b6-40f1-bd7c-a9a75a9adc43", "tag": "e64ffaa5-c4b7-4d5d-b9bd-605829597e42"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:39:02.543422 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-541d7076-a045-459b-bae2-d2507432a04c req-b6a7731a-5604-457d-b285-61cf0a2180c6 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:02.549723 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-541d7076-a045-459b-bae2-d2507432a04c req-b6a7731a-5604-457d-b285-61cf0a2180c6 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:02.550467 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-541d7076-a045-459b-bae2-d2507432a04c req-b6a7731a-5604-457d-b285-61cf0a2180c6 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:02.579540 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-541d7076-a045-459b-bae2-d2507432a04c req-b6a7731a-5604-457d-b285-61cf0a2180c6 service nova] Creating event network-changed:e64ffaa5-c4b7-4d5d-b9bd-605829597e42 for instance d9d4332a-97b6-40f1-bd7c-a9a75a9adc43 on n-h1-851028-13 Oct 04 18:39:02.594409 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-7472d9e0-1bfa-49cc-86b3-c96034d4c842 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:02.595061 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-541d7076-a045-459b-bae2-d2507432a04c req-b6a7731a-5604-457d-b285-61cf0a2180c6 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079517 Oct 04 18:39:02.596051 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 947/2041] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:39:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:39:02.604950 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-7472d9e0-1bfa-49cc-86b3-c96034d4c842 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:02.606620 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-7472d9e0-1bfa-49cc-86b3-c96034d4c842 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:02.607872 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-f0a47cf8-6c7a-46cb-88b0-7a61299d7013 req-cc505d24-f73e-4f21-9a4f-feb365f238b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23ce945d-cd4a-40d5-80be-d5548c257e07", "name": "network-vif-plugged", "status": "completed", "tag": "cdfdd4b0-7f80-434d-ba80-684bf856bfe6"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:39:02.608396 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-7472d9e0-1bfa-49cc-86b3-c96034d4c842 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] 10.222.0.43 "GET /compute/v2.1/servers/d1f298aa-ebe3-4f52-ada6-137a782cd9b7" status: 200 len: 1280 microversion: 2.25 time: 1.179999 Oct 04 18:39:02.626008 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1095/2042] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:39:01 2022] GET /compute/v2.1/servers/d1f298aa-ebe3-4f52-ada6-137a782cd9b7 => generated 1280 bytes in 1198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:39:02.633221 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-8ae9aace-58ad-4d5d-90c9-7ce4aeb32621 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:02.633406 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-f0a47cf8-6c7a-46cb-88b0-7a61299d7013 req-cc505d24-f73e-4f21-9a4f-feb365f238b0 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:02.633406 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-f0a47cf8-6c7a-46cb-88b0-7a61299d7013 req-cc505d24-f73e-4f21-9a4f-feb365f238b0 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:02.633406 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-f0a47cf8-6c7a-46cb-88b0-7a61299d7013 req-cc505d24-f73e-4f21-9a4f-feb365f238b0 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:02.634522 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-8ae9aace-58ad-4d5d-90c9-7ce4aeb32621 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] [instance: 5d937ba2-60f4-40cf-9ed8-a4a86d458e38] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:02.641543 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8ae9aace-58ad-4d5d-90c9-7ce4aeb32621 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:02.642401 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8ae9aace-58ad-4d5d-90c9-7ce4aeb32621 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:02.643127 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8ae9aace-58ad-4d5d-90c9-7ce4aeb32621 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:02.644068 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8ae9aace-58ad-4d5d-90c9-7ce4aeb32621 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:02.644753 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8ae9aace-58ad-4d5d-90c9-7ce4aeb32621 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:02.646142 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8ae9aace-58ad-4d5d-90c9-7ce4aeb32621 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:02.662981 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-f0a47cf8-6c7a-46cb-88b0-7a61299d7013 req-cc505d24-f73e-4f21-9a4f-feb365f238b0 service nova] Creating event network-vif-plugged:cdfdd4b0-7f80-434d-ba80-684bf856bfe6 for instance 23ce945d-cd4a-40d5-80be-d5548c257e07 on n-h1-851028-13 Oct 04 18:39:02.677183 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-f0a47cf8-6c7a-46cb-88b0-7a61299d7013 req-cc505d24-f73e-4f21-9a4f-feb365f238b0 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076444 Oct 04 18:39:02.678407 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 948/2043] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:39:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:39:02.689362 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-b7b9a488-b585-4266-b90f-6d69b5aef3f1 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Calling method '.version_select at 0x7fb21fc3c790>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:02.800443 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-b7b9a488-b585-4266-b90f-6d69b5aef3f1 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] 10.222.0.43 "GET /compute/v2.1/images/e5989b78-5925-4d33-8625-f3af6fa4e64d" status: 200 len: 1454 microversion: 2.1 time: 0.120750 Oct 04 18:39:02.806911 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 949/2044] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 18:39:02 2022] GET /compute/v2.1/images/e5989b78-5925-4d33-8625-f3af6fa4e64d => generated 1454 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:02.820760 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-33ac7b2e-40cd-4523-9e29-2d6e0d5cab78 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:02.822665 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-33ac7b2e-40cd-4523-9e29-2d6e0d5cab78 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] [instance: 23ce945d-cd4a-40d5-80be-d5548c257e07] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:02.834296 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-33ac7b2e-40cd-4523-9e29-2d6e0d5cab78 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:02.835148 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-33ac7b2e-40cd-4523-9e29-2d6e0d5cab78 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:02.836142 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-33ac7b2e-40cd-4523-9e29-2d6e0d5cab78 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:02.837344 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-33ac7b2e-40cd-4523-9e29-2d6e0d5cab78 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:02.838151 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-33ac7b2e-40cd-4523-9e29-2d6e0d5cab78 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:02.839169 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-33ac7b2e-40cd-4523-9e29-2d6e0d5cab78 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:03.201425 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-8ae9aace-58ad-4d5d-90c9-7ce4aeb32621 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eadce040fcf3427abab9ef8b0ca19400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f4f9b0233b4fb29963b77248a236f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:03.210315 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-8ae9aace-58ad-4d5d-90c9-7ce4aeb32621 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] 10.222.0.43 "GET /compute/v2.1/servers/5d937ba2-60f4-40cf-9ed8-a4a86d458e38" status: 200 len: 1324 microversion: 2.1 time: 0.582759 Oct 04 18:39:03.210910 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1096/2045] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:02 2022] GET /compute/v2.1/servers/5d937ba2-60f4-40cf-9ed8-a4a86d458e38 => generated 1324 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:03.230317 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-fcca2a94-959c-466d-8be5-18464c7d7681 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:03.243307 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-fcca2a94-959c-466d-8be5-18464c7d7681 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: d9d4332a-97b6-40f1-bd7c-a9a75a9adc43] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:03.260246 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fcca2a94-959c-466d-8be5-18464c7d7681 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:03.261020 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fcca2a94-959c-466d-8be5-18464c7d7681 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:03.261650 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fcca2a94-959c-466d-8be5-18464c7d7681 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:03.262564 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fcca2a94-959c-466d-8be5-18464c7d7681 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:03.263244 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fcca2a94-959c-466d-8be5-18464c7d7681 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:03.263842 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fcca2a94-959c-466d-8be5-18464c7d7681 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:03.495897 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-fcca2a94-959c-466d-8be5-18464c7d7681 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:03.506682 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-fcca2a94-959c-466d-8be5-18464c7d7681 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/d9d4332a-97b6-40f1-bd7c-a9a75a9adc43" status: 200 len: 1378 microversion: 2.1 time: 0.286165 Oct 04 18:39:03.517992 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1097/2046] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:03 2022] GET /compute/v2.1/servers/d9d4332a-97b6-40f1-bd7c-a9a75a9adc43 => generated 1378 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:03.532125 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-dab9ad96-57a6-4250-9cb9-f49d9634208c tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:03.533064 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-dab9ad96-57a6-4250-9cb9-f49d9634208c tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] [instance: 237ee25f-85f0-46d4-8980-66c5bfe764ad] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:03.539503 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dab9ad96-57a6-4250-9cb9-f49d9634208c tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:03.539996 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dab9ad96-57a6-4250-9cb9-f49d9634208c tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:03.540432 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dab9ad96-57a6-4250-9cb9-f49d9634208c tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:03.541160 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dab9ad96-57a6-4250-9cb9-f49d9634208c tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:03.541601 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dab9ad96-57a6-4250-9cb9-f49d9634208c tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:03.542223 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dab9ad96-57a6-4250-9cb9-f49d9634208c tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:03.630208 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-33ac7b2e-40cd-4523-9e29-2d6e0d5cab78 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c96ec8b8e0a4053b0457f213e6e262d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b812c85494a49898376a0dd8140f03c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:03.647488 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-33ac7b2e-40cd-4523-9e29-2d6e0d5cab78 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] 10.222.0.43 "GET /compute/v2.1/servers/23ce945d-cd4a-40d5-80be-d5548c257e07" status: 200 len: 1315 microversion: 2.1 time: 0.839094 Oct 04 18:39:03.651343 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 950/2047] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:02 2022] GET /compute/v2.1/servers/23ce945d-cd4a-40d5-80be-d5548c257e07 => generated 1315 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:03.664623 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-8c7970db-469f-4fc0-b61e-6a4750b7c9b1 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:03.667646 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-8c7970db-469f-4fc0-b61e-6a4750b7c9b1 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] [instance: d1f298aa-ebe3-4f52-ada6-137a782cd9b7] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:03.682730 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8c7970db-469f-4fc0-b61e-6a4750b7c9b1 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:03.686557 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8c7970db-469f-4fc0-b61e-6a4750b7c9b1 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:03.687288 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8c7970db-469f-4fc0-b61e-6a4750b7c9b1 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:03.691279 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8c7970db-469f-4fc0-b61e-6a4750b7c9b1 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:03.692169 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8c7970db-469f-4fc0-b61e-6a4750b7c9b1 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:03.692863 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8c7970db-469f-4fc0-b61e-6a4750b7c9b1 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:03.698520 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-dab9ad96-57a6-4250-9cb9-f49d9634208c tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6daea1f7b0084009ac6e24181a1b87d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f3ca2b15fd24916ac47e08325464d75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:03.702539 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=100 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:39:03.719646 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-dab9ad96-57a6-4250-9cb9-f49d9634208c tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] 10.222.0.43 "GET /compute/v2.1/servers/237ee25f-85f0-46d4-8980-66c5bfe764ad" status: 200 len: 1312 microversion: 2.1 time: 0.191517 Oct 04 18:39:03.737503 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1098/2048] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:03 2022] GET /compute/v2.1/servers/237ee25f-85f0-46d4-8980-66c5bfe764ad => generated 1312 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:03.819683 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-9af9faa1-2ed3-4e50-9cc8-45c0db95ea8c tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Calling method '.version_select at 0x7fb227f551f0>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:03.903954 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-9af9faa1-2ed3-4e50-9cc8-45c0db95ea8c tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] 10.222.0.43 "GET /compute/v2.1/images/e5989b78-5925-4d33-8625-f3af6fa4e64d" status: 200 len: 1454 microversion: 2.1 time: 0.088605 Oct 04 18:39:03.904457 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1099/2049] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 18:39:03 2022] GET /compute/v2.1/images/e5989b78-5925-4d33-8625-f3af6fa4e64d => generated 1454 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:39:04.147203 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-8c7970db-469f-4fc0-b61e-6a4750b7c9b1 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:04.159500 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-8c7970db-469f-4fc0-b61e-6a4750b7c9b1 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:04.166740 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-8c7970db-469f-4fc0-b61e-6a4750b7c9b1 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:04.168234 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-8c7970db-469f-4fc0-b61e-6a4750b7c9b1 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] 10.222.0.43 "GET /compute/v2.1/servers/d1f298aa-ebe3-4f52-ada6-137a782cd9b7" status: 200 len: 1280 microversion: 2.25 time: 0.515488 Oct 04 18:39:04.169477 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 951/2050] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:39:03 2022] GET /compute/v2.1/servers/d1f298aa-ebe3-4f52-ada6-137a782cd9b7 => generated 1280 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:39:04.241759 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-5c7ef232-0c20-49a4-b102-c66c19868c19 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:04.242391 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-5c7ef232-0c20-49a4-b102-c66c19868c19 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] [instance: 5d937ba2-60f4-40cf-9ed8-a4a86d458e38] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:04.256753 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5c7ef232-0c20-49a4-b102-c66c19868c19 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:04.257321 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5c7ef232-0c20-49a4-b102-c66c19868c19 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:04.257770 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5c7ef232-0c20-49a4-b102-c66c19868c19 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:04.258503 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5c7ef232-0c20-49a4-b102-c66c19868c19 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:04.259002 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5c7ef232-0c20-49a4-b102-c66c19868c19 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:04.259454 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5c7ef232-0c20-49a4-b102-c66c19868c19 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:04.588855 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-89f8077f-a85b-46af-b1f4-daac64f4b697 tempest-ServerAddressesTestJSON-638433160 tempest-ServerAddressesTestJSON-638433160-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-165056710", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452", "networks": [{"uuid": "21277a01-02bc-40d0-9393-829f9e592171"}]}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:39:04.687529 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.network.neutron [None req-89f8077f-a85b-46af-b1f4-daac64f4b697 tempest-ServerAddressesTestJSON-638433160 tempest-ServerAddressesTestJSON-638433160-project] validate_networks() for [('21277a01-02bc-40d0-9393-829f9e592171', None, None, None, None, None)] {{(pid=123595) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:39:04.795835 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-5c7ef232-0c20-49a4-b102-c66c19868c19 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eadce040fcf3427abab9ef8b0ca19400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f4f9b0233b4fb29963b77248a236f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:04.805690 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-5c7ef232-0c20-49a4-b102-c66c19868c19 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] 10.222.0.43 "GET /compute/v2.1/servers/5d937ba2-60f4-40cf-9ed8-a4a86d458e38" status: 200 len: 1324 microversion: 2.1 time: 0.570463 Oct 04 18:39:04.817012 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1100/2051] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:04 2022] GET /compute/v2.1/servers/5d937ba2-60f4-40cf-9ed8-a4a86d458e38 => generated 1324 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:04.833431 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-dd51b206-0a09-4cf1-bc4d-c91e7dd3e660 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:04.834534 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-dd51b206-0a09-4cf1-bc4d-c91e7dd3e660 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: d9d4332a-97b6-40f1-bd7c-a9a75a9adc43] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:04.850577 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dd51b206-0a09-4cf1-bc4d-c91e7dd3e660 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:04.856529 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dd51b206-0a09-4cf1-bc4d-c91e7dd3e660 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:04.859404 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dd51b206-0a09-4cf1-bc4d-c91e7dd3e660 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:04.860468 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dd51b206-0a09-4cf1-bc4d-c91e7dd3e660 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:04.861963 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dd51b206-0a09-4cf1-bc4d-c91e7dd3e660 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:04.863836 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dd51b206-0a09-4cf1-bc4d-c91e7dd3e660 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:05.311180 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-dd51b206-0a09-4cf1-bc4d-c91e7dd3e660 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:05.328962 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-dd51b206-0a09-4cf1-bc4d-c91e7dd3e660 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/d9d4332a-97b6-40f1-bd7c-a9a75a9adc43" status: 200 len: 1378 microversion: 2.1 time: 0.510957 Oct 04 18:39:05.331475 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1101/2052] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:04 2022] GET /compute/v2.1/servers/d9d4332a-97b6-40f1-bd7c-a9a75a9adc43 => generated 1378 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:05.343156 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-94622d52-cf89-4eb0-9f9a-6ae76489d0b3 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:05.348763 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-94622d52-cf89-4eb0-9f9a-6ae76489d0b3 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] [instance: 23ce945d-cd4a-40d5-80be-d5548c257e07] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:05.360193 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-94622d52-cf89-4eb0-9f9a-6ae76489d0b3 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:05.363380 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-94622d52-cf89-4eb0-9f9a-6ae76489d0b3 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:05.364412 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-94622d52-cf89-4eb0-9f9a-6ae76489d0b3 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:05.365996 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-94622d52-cf89-4eb0-9f9a-6ae76489d0b3 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:05.366732 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-94622d52-cf89-4eb0-9f9a-6ae76489d0b3 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:05.368299 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-94622d52-cf89-4eb0-9f9a-6ae76489d0b3 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:05.610928 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-89f8077f-a85b-46af-b1f4-daac64f4b697 tempest-ServerAddressesTestJSON-638433160 tempest-ServerAddressesTestJSON-638433160-project] Flavor limits 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:39:05.611702 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-89f8077f-a85b-46af-b1f4-daac64f4b697 tempest-ServerAddressesTestJSON-638433160 tempest-ServerAddressesTestJSON-638433160-project] Image limits 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:39:05.612397 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-89f8077f-a85b-46af-b1f4-daac64f4b697 tempest-ServerAddressesTestJSON-638433160 tempest-ServerAddressesTestJSON-638433160-project] Flavor pref 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:39:05.613003 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-89f8077f-a85b-46af-b1f4-daac64f4b697 tempest-ServerAddressesTestJSON-638433160 tempest-ServerAddressesTestJSON-638433160-project] Image pref 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:39:05.613775 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-89f8077f-a85b-46af-b1f4-daac64f4b697 tempest-ServerAddressesTestJSON-638433160 tempest-ServerAddressesTestJSON-638433160-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:39:05.626486 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-89f8077f-a85b-46af-b1f4-daac64f4b697 tempest-ServerAddressesTestJSON-638433160 tempest-ServerAddressesTestJSON-638433160-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:05.629167 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-89f8077f-a85b-46af-b1f4-daac64f4b697 tempest-ServerAddressesTestJSON-638433160 tempest-ServerAddressesTestJSON-638433160-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:05.630608 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-89f8077f-a85b-46af-b1f4-daac64f4b697 tempest-ServerAddressesTestJSON-638433160 tempest-ServerAddressesTestJSON-638433160-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:05.631621 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-89f8077f-a85b-46af-b1f4-daac64f4b697 tempest-ServerAddressesTestJSON-638433160 tempest-ServerAddressesTestJSON-638433160-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:05.636516 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-89f8077f-a85b-46af-b1f4-daac64f4b697 tempest-ServerAddressesTestJSON-638433160 tempest-ServerAddressesTestJSON-638433160-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:05.637203 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-89f8077f-a85b-46af-b1f4-daac64f4b697 tempest-ServerAddressesTestJSON-638433160 tempest-ServerAddressesTestJSON-638433160-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:05.695961 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-89f8077f-a85b-46af-b1f4-daac64f4b697 tempest-ServerAddressesTestJSON-638433160 tempest-ServerAddressesTestJSON-638433160-project] Getting quotas for project b241fded901d40fca9db5b5a4862a428. Resources: {'ram', 'cores', 'instances'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:39:05.705841 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-89f8077f-a85b-46af-b1f4-daac64f4b697 tempest-ServerAddressesTestJSON-638433160 tempest-ServerAddressesTestJSON-638433160-project] Getting quotas for user c41b6ddac731410085f447c3f687ef7a and project b241fded901d40fca9db5b5a4862a428. Resources: {'ram', 'cores', 'instances'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:39:05.749188 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-89f8077f-a85b-46af-b1f4-daac64f4b697 tempest-ServerAddressesTestJSON-638433160 tempest-ServerAddressesTestJSON-638433160-project] Going to run 1 instances... {{(pid=123595) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:39:05.761651 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-89f8077f-a85b-46af-b1f4-daac64f4b697 tempest-ServerAddressesTestJSON-638433160 tempest-ServerAddressesTestJSON-638433160-project] [instance: cdb73233-3522-4ddb-b7d4-463685e66bcc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e8943ec5-4038-4d4b-b9b9-2415a79f5243',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:39:05.779522 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-94622d52-cf89-4eb0-9f9a-6ae76489d0b3 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c96ec8b8e0a4053b0457f213e6e262d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b812c85494a49898376a0dd8140f03c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:05.793194 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-94622d52-cf89-4eb0-9f9a-6ae76489d0b3 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] 10.222.0.43 "GET /compute/v2.1/servers/23ce945d-cd4a-40d5-80be-d5548c257e07" status: 200 len: 1315 microversion: 2.1 time: 0.460214 Oct 04 18:39:05.797247 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1102/2053] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:05 2022] GET /compute/v2.1/servers/23ce945d-cd4a-40d5-80be-d5548c257e07 => generated 1315 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:05.818041 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-de35d5cd-c531-4576-bb42-a011eacb8c47 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:05.818785 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-de35d5cd-c531-4576-bb42-a011eacb8c47 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] [instance: 237ee25f-85f0-46d4-8980-66c5bfe764ad] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:05.837173 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-de35d5cd-c531-4576-bb42-a011eacb8c47 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:05.837173 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-de35d5cd-c531-4576-bb42-a011eacb8c47 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:05.840733 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-89f8077f-a85b-46af-b1f4-daac64f4b697 tempest-ServerAddressesTestJSON-638433160 tempest-ServerAddressesTestJSON-638433160-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.520469 Oct 04 18:39:05.842370 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 952/2054] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 18:39:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 1522 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:39:05.847552 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-f926a3e4-253d-4a5a-b7bd-a46d9034af5f req-08ff11ef-7f7a-4ee9-b01b-e5937775858c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1f298aa-ebe3-4f52-ada6-137a782cd9b7", "name": "network-vif-plugged", "status": "completed", "tag": "522bbf89-d8c1-4d7d-96be-5fcee81a735a"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:39:05.848223 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-de35d5cd-c531-4576-bb42-a011eacb8c47 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:05.849276 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-de35d5cd-c531-4576-bb42-a011eacb8c47 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:05.849776 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-de35d5cd-c531-4576-bb42-a011eacb8c47 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:05.850233 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-de35d5cd-c531-4576-bb42-a011eacb8c47 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:05.891236 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-f926a3e4-253d-4a5a-b7bd-a46d9034af5f req-08ff11ef-7f7a-4ee9-b01b-e5937775858c service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:05.892033 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-f926a3e4-253d-4a5a-b7bd-a46d9034af5f req-08ff11ef-7f7a-4ee9-b01b-e5937775858c service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:05.894227 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-f926a3e4-253d-4a5a-b7bd-a46d9034af5f req-08ff11ef-7f7a-4ee9-b01b-e5937775858c service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:05.912699 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-f926a3e4-253d-4a5a-b7bd-a46d9034af5f req-08ff11ef-7f7a-4ee9-b01b-e5937775858c service nova] Creating event network-vif-plugged:522bbf89-d8c1-4d7d-96be-5fcee81a735a for instance d1f298aa-ebe3-4f52-ada6-137a782cd9b7 on n-h2-851028-13 Oct 04 18:39:05.919717 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-f926a3e4-253d-4a5a-b7bd-a46d9034af5f req-08ff11ef-7f7a-4ee9-b01b-e5937775858c service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075775 Oct 04 18:39:05.926253 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 953/2055] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:39:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:39:05.933387 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-a1e2d553-193b-48ef-9776-4a20c985b7d5 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Calling method '.version_select at 0x7fb21fc5ef70>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:06.080323 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-a1e2d553-193b-48ef-9776-4a20c985b7d5 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] 10.222.0.43 "GET /compute/v2.1/images/e5989b78-5925-4d33-8625-f3af6fa4e64d" status: 200 len: 1454 microversion: 2.1 time: 0.152344 Oct 04 18:39:06.093477 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 954/2056] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 18:39:05 2022] GET /compute/v2.1/images/e5989b78-5925-4d33-8625-f3af6fa4e64d => generated 1454 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:06.112009 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-4c69a91c-f424-4092-b32e-b942ec926b2e tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:06.114251 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-4c69a91c-f424-4092-b32e-b942ec926b2e tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] [instance: d1f298aa-ebe3-4f52-ada6-137a782cd9b7] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:06.136459 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4c69a91c-f424-4092-b32e-b942ec926b2e tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:06.139888 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4c69a91c-f424-4092-b32e-b942ec926b2e tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:06.140647 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4c69a91c-f424-4092-b32e-b942ec926b2e tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:06.143333 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4c69a91c-f424-4092-b32e-b942ec926b2e tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:06.144123 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4c69a91c-f424-4092-b32e-b942ec926b2e tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:06.150538 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4c69a91c-f424-4092-b32e-b942ec926b2e tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:06.281409 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-de35d5cd-c531-4576-bb42-a011eacb8c47 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6daea1f7b0084009ac6e24181a1b87d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f3ca2b15fd24916ac47e08325464d75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:06.323798 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-de35d5cd-c531-4576-bb42-a011eacb8c47 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] 10.222.0.43 "GET /compute/v2.1/servers/237ee25f-85f0-46d4-8980-66c5bfe764ad" status: 200 len: 1312 microversion: 2.1 time: 0.525426 Oct 04 18:39:06.339031 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1103/2057] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:05 2022] GET /compute/v2.1/servers/237ee25f-85f0-46d4-8980-66c5bfe764ad => generated 1312 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:06.348839 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-b779c5c2-3e9a-4fc6-add5-b0a46c0aaf2e tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:06.349532 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-b779c5c2-3e9a-4fc6-add5-b0a46c0aaf2e tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] [instance: 5d937ba2-60f4-40cf-9ed8-a4a86d458e38] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:06.357607 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b779c5c2-3e9a-4fc6-add5-b0a46c0aaf2e tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:06.358773 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b779c5c2-3e9a-4fc6-add5-b0a46c0aaf2e tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:06.359225 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b779c5c2-3e9a-4fc6-add5-b0a46c0aaf2e tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:06.359942 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b779c5c2-3e9a-4fc6-add5-b0a46c0aaf2e tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:06.360700 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b779c5c2-3e9a-4fc6-add5-b0a46c0aaf2e tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:06.361341 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b779c5c2-3e9a-4fc6-add5-b0a46c0aaf2e tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:06.400242 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-4c69a91c-f424-4092-b32e-b942ec926b2e tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:06.415178 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-4c69a91c-f424-4092-b32e-b942ec926b2e tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:06.418882 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-4c69a91c-f424-4092-b32e-b942ec926b2e tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:06.440171 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-4c69a91c-f424-4092-b32e-b942ec926b2e tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] 10.222.0.43 "GET /compute/v2.1/servers/d1f298aa-ebe3-4f52-ada6-137a782cd9b7" status: 200 len: 1280 microversion: 2.25 time: 0.343678 Oct 04 18:39:06.441942 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 955/2058] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:39:06 2022] GET /compute/v2.1/servers/d1f298aa-ebe3-4f52-ada6-137a782cd9b7 => generated 1280 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:39:06.449403 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-dced6def-a5f9-467c-9c4a-13200629ce1e tempest-ServerAddressesTestJSON-638433160 tempest-ServerAddressesTestJSON-638433160-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:06.450416 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-dced6def-a5f9-467c-9c4a-13200629ce1e tempest-ServerAddressesTestJSON-638433160 tempest-ServerAddressesTestJSON-638433160-project] [instance: cdb73233-3522-4ddb-b7d4-463685e66bcc] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:06.549917 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-dced6def-a5f9-467c-9c4a-13200629ce1e tempest-ServerAddressesTestJSON-638433160 tempest-ServerAddressesTestJSON-638433160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c41b6ddac731410085f447c3f687ef7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b241fded901d40fca9db5b5a4862a428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:06.560627 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-dced6def-a5f9-467c-9c4a-13200629ce1e tempest-ServerAddressesTestJSON-638433160 tempest-ServerAddressesTestJSON-638433160-project] 10.222.0.43 "GET /compute/v2.1/servers/cdb73233-3522-4ddb-b7d4-463685e66bcc" status: 200 len: 1216 microversion: 2.1 time: 0.117241 Oct 04 18:39:06.562398 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 956/2059] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:06 2022] GET /compute/v2.1/servers/cdb73233-3522-4ddb-b7d4-463685e66bcc => generated 1216 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:06.568561 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-2002c943-cdf6-42cd-a1c8-48b8b9becefa tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:06.569739 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-2002c943-cdf6-42cd-a1c8-48b8b9becefa tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: d9d4332a-97b6-40f1-bd7c-a9a75a9adc43] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:06.588145 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2002c943-cdf6-42cd-a1c8-48b8b9becefa tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:06.589029 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2002c943-cdf6-42cd-a1c8-48b8b9becefa tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:06.589781 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2002c943-cdf6-42cd-a1c8-48b8b9becefa tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:06.591322 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2002c943-cdf6-42cd-a1c8-48b8b9becefa tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:06.591987 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2002c943-cdf6-42cd-a1c8-48b8b9becefa tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:06.592879 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2002c943-cdf6-42cd-a1c8-48b8b9becefa tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:06.703501 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-b779c5c2-3e9a-4fc6-add5-b0a46c0aaf2e tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eadce040fcf3427abab9ef8b0ca19400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f4f9b0233b4fb29963b77248a236f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:06.722573 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-b779c5c2-3e9a-4fc6-add5-b0a46c0aaf2e tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] 10.222.0.43 "GET /compute/v2.1/servers/5d937ba2-60f4-40cf-9ed8-a4a86d458e38" status: 200 len: 1324 microversion: 2.1 time: 0.382152 Oct 04 18:39:06.723517 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1104/2060] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:06 2022] GET /compute/v2.1/servers/5d937ba2-60f4-40cf-9ed8-a4a86d458e38 => generated 1324 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:06.821514 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-580ca544-55af-4c29-be5f-6c74a3f236ca tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:06.822281 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-580ca544-55af-4c29-be5f-6c74a3f236ca tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] [instance: 23ce945d-cd4a-40d5-80be-d5548c257e07] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:06.845672 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-580ca544-55af-4c29-be5f-6c74a3f236ca tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:06.846415 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-580ca544-55af-4c29-be5f-6c74a3f236ca tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:06.850539 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-580ca544-55af-4c29-be5f-6c74a3f236ca tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:06.851412 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-580ca544-55af-4c29-be5f-6c74a3f236ca tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:06.852157 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-580ca544-55af-4c29-be5f-6c74a3f236ca tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:06.854131 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-580ca544-55af-4c29-be5f-6c74a3f236ca tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:07.227434 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-2002c943-cdf6-42cd-a1c8-48b8b9becefa tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:07.243176 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-2002c943-cdf6-42cd-a1c8-48b8b9becefa tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/d9d4332a-97b6-40f1-bd7c-a9a75a9adc43" status: 200 len: 1378 microversion: 2.1 time: 0.678941 Oct 04 18:39:07.276643 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 957/2061] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:06 2022] GET /compute/v2.1/servers/d9d4332a-97b6-40f1-bd7c-a9a75a9adc43 => generated 1378 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:07.300898 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-25e7e733-42df-4e63-96dc-b68f5eb3c5ed tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Calling method '.version_select at 0x7fb21ff62940>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:07.382891 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-580ca544-55af-4c29-be5f-6c74a3f236ca tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c96ec8b8e0a4053b0457f213e6e262d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b812c85494a49898376a0dd8140f03c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:07.414035 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-580ca544-55af-4c29-be5f-6c74a3f236ca tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] 10.222.0.43 "GET /compute/v2.1/servers/23ce945d-cd4a-40d5-80be-d5548c257e07" status: 200 len: 1315 microversion: 2.1 time: 0.596865 Oct 04 18:39:07.415357 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1105/2062] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:06 2022] GET /compute/v2.1/servers/23ce945d-cd4a-40d5-80be-d5548c257e07 => generated 1315 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:07.426956 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-a6b799b0-6048-4515-a8c8-e343ebbc99a2 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:07.428443 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-a6b799b0-6048-4515-a8c8-e343ebbc99a2 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] [instance: 237ee25f-85f0-46d4-8980-66c5bfe764ad] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:07.439784 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a6b799b0-6048-4515-a8c8-e343ebbc99a2 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:07.440638 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a6b799b0-6048-4515-a8c8-e343ebbc99a2 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:07.441379 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a6b799b0-6048-4515-a8c8-e343ebbc99a2 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:07.442366 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a6b799b0-6048-4515-a8c8-e343ebbc99a2 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:07.443047 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a6b799b0-6048-4515-a8c8-e343ebbc99a2 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:07.443713 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a6b799b0-6048-4515-a8c8-e343ebbc99a2 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:07.443913 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-25e7e733-42df-4e63-96dc-b68f5eb3c5ed tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] 10.222.0.43 "GET /compute/v2.1/images/e5989b78-5925-4d33-8625-f3af6fa4e64d" status: 200 len: 1454 microversion: 2.1 time: 0.163353 Oct 04 18:39:07.450070 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 958/2063] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 18:39:07 2022] GET /compute/v2.1/images/e5989b78-5925-4d33-8625-f3af6fa4e64d => generated 1454 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:07.477049 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-bb89a327-03dd-4c0c-8717-13852ebdfef1 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:07.478829 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-bb89a327-03dd-4c0c-8717-13852ebdfef1 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] [instance: d1f298aa-ebe3-4f52-ada6-137a782cd9b7] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:07.508966 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bb89a327-03dd-4c0c-8717-13852ebdfef1 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:07.509784 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bb89a327-03dd-4c0c-8717-13852ebdfef1 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:07.511375 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bb89a327-03dd-4c0c-8717-13852ebdfef1 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:07.515496 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bb89a327-03dd-4c0c-8717-13852ebdfef1 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:07.517321 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bb89a327-03dd-4c0c-8717-13852ebdfef1 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:07.518988 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bb89a327-03dd-4c0c-8717-13852ebdfef1 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:08.000703 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-a6b799b0-6048-4515-a8c8-e343ebbc99a2 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6daea1f7b0084009ac6e24181a1b87d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f3ca2b15fd24916ac47e08325464d75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:08.018682 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-a6b799b0-6048-4515-a8c8-e343ebbc99a2 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] 10.222.0.43 "GET /compute/v2.1/servers/237ee25f-85f0-46d4-8980-66c5bfe764ad" status: 200 len: 1312 microversion: 2.1 time: 0.601658 Oct 04 18:39:08.019306 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1106/2064] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:07 2022] GET /compute/v2.1/servers/237ee25f-85f0-46d4-8980-66c5bfe764ad => generated 1312 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:08.044919 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-d7669795-741c-4ef2-a7cc-a2a95dfb7185 tempest-ServerAddressesTestJSON-638433160 tempest-ServerAddressesTestJSON-638433160-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:08.049496 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-d7669795-741c-4ef2-a7cc-a2a95dfb7185 tempest-ServerAddressesTestJSON-638433160 tempest-ServerAddressesTestJSON-638433160-project] [instance: cdb73233-3522-4ddb-b7d4-463685e66bcc] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:08.062107 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d7669795-741c-4ef2-a7cc-a2a95dfb7185 tempest-ServerAddressesTestJSON-638433160 tempest-ServerAddressesTestJSON-638433160-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:08.062829 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d7669795-741c-4ef2-a7cc-a2a95dfb7185 tempest-ServerAddressesTestJSON-638433160 tempest-ServerAddressesTestJSON-638433160-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:08.063452 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d7669795-741c-4ef2-a7cc-a2a95dfb7185 tempest-ServerAddressesTestJSON-638433160 tempest-ServerAddressesTestJSON-638433160-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:08.065460 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d7669795-741c-4ef2-a7cc-a2a95dfb7185 tempest-ServerAddressesTestJSON-638433160 tempest-ServerAddressesTestJSON-638433160-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:08.066135 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d7669795-741c-4ef2-a7cc-a2a95dfb7185 tempest-ServerAddressesTestJSON-638433160 tempest-ServerAddressesTestJSON-638433160-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:08.066781 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d7669795-741c-4ef2-a7cc-a2a95dfb7185 tempest-ServerAddressesTestJSON-638433160 tempest-ServerAddressesTestJSON-638433160-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:08.234863 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-d7669795-741c-4ef2-a7cc-a2a95dfb7185 tempest-ServerAddressesTestJSON-638433160 tempest-ServerAddressesTestJSON-638433160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c41b6ddac731410085f447c3f687ef7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b241fded901d40fca9db5b5a4862a428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:08.245001 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-d7669795-741c-4ef2-a7cc-a2a95dfb7185 tempest-ServerAddressesTestJSON-638433160 tempest-ServerAddressesTestJSON-638433160-project] 10.222.0.43 "GET /compute/v2.1/servers/cdb73233-3522-4ddb-b7d4-463685e66bcc" status: 200 len: 1212 microversion: 2.1 time: 0.224592 Oct 04 18:39:08.250495 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1107/2065] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:08 2022] GET /compute/v2.1/servers/cdb73233-3522-4ddb-b7d4-463685e66bcc => generated 1212 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:08.260414 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-91b88b65-3306-44ad-9d61-497e4069fc27 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:08.264941 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-bb89a327-03dd-4c0c-8717-13852ebdfef1 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:08.265688 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-91b88b65-3306-44ad-9d61-497e4069fc27 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] [instance: 5d937ba2-60f4-40cf-9ed8-a4a86d458e38] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:08.281038 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-91b88b65-3306-44ad-9d61-497e4069fc27 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:08.285164 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-bb89a327-03dd-4c0c-8717-13852ebdfef1 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:08.286204 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-91b88b65-3306-44ad-9d61-497e4069fc27 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:08.287155 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-91b88b65-3306-44ad-9d61-497e4069fc27 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:08.290470 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-bb89a327-03dd-4c0c-8717-13852ebdfef1 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:08.290670 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-91b88b65-3306-44ad-9d61-497e4069fc27 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:08.294878 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-91b88b65-3306-44ad-9d61-497e4069fc27 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:08.297032 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-91b88b65-3306-44ad-9d61-497e4069fc27 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:08.299239 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-bb89a327-03dd-4c0c-8717-13852ebdfef1 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] 10.222.0.43 "GET /compute/v2.1/servers/d1f298aa-ebe3-4f52-ada6-137a782cd9b7" status: 200 len: 1280 microversion: 2.25 time: 0.830320 Oct 04 18:39:08.300510 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 959/2066] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:39:07 2022] GET /compute/v2.1/servers/d1f298aa-ebe3-4f52-ada6-137a782cd9b7 => generated 1280 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:39:08.319239 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-5fe587b2-1367-4236-882b-6ae0fd9feb20 req-2fe6f19a-928c-4cf9-b490-4dfcb00588e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d937ba2-60f4-40cf-9ed8-a4a86d458e38", "name": "network-vif-plugged", "status": "completed", "tag": "568dee2e-5618-4d07-a3bd-4aaf5000f435"}, {"server_uuid": "237ee25f-85f0-46d4-8980-66c5bfe764ad", "name": "network-vif-plugged", "status": "completed", "tag": "9dcfd052-bd8d-45aa-915c-a8e3f094bca0"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:39:08.343077 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-5fe587b2-1367-4236-882b-6ae0fd9feb20 req-2fe6f19a-928c-4cf9-b490-4dfcb00588e1 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:08.343850 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-5fe587b2-1367-4236-882b-6ae0fd9feb20 req-2fe6f19a-928c-4cf9-b490-4dfcb00588e1 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:08.344535 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-5fe587b2-1367-4236-882b-6ae0fd9feb20 req-2fe6f19a-928c-4cf9-b490-4dfcb00588e1 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:08.349511 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=100 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:39:08.367996 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-5fe587b2-1367-4236-882b-6ae0fd9feb20 req-2fe6f19a-928c-4cf9-b490-4dfcb00588e1 service nova] Creating event network-vif-plugged:568dee2e-5618-4d07-a3bd-4aaf5000f435 for instance 5d937ba2-60f4-40cf-9ed8-a4a86d458e38 on n-h1-851028-13 Oct 04 18:39:08.368804 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-5fe587b2-1367-4236-882b-6ae0fd9feb20 req-2fe6f19a-928c-4cf9-b490-4dfcb00588e1 service nova] Creating event network-vif-plugged:9dcfd052-bd8d-45aa-915c-a8e3f094bca0 for instance 237ee25f-85f0-46d4-8980-66c5bfe764ad on n-h2-851028-13 Oct 04 18:39:08.411681 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-5fe587b2-1367-4236-882b-6ae0fd9feb20 req-2fe6f19a-928c-4cf9-b490-4dfcb00588e1 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.109273 Oct 04 18:39:08.412951 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 960/2067] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:39:08 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:39:08.423368 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-dccca0d8-c0a8-44c6-860e-fb423bb7e6d2 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:08.424512 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-dccca0d8-c0a8-44c6-860e-fb423bb7e6d2 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: d9d4332a-97b6-40f1-bd7c-a9a75a9adc43] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:08.437816 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dccca0d8-c0a8-44c6-860e-fb423bb7e6d2 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:08.442322 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dccca0d8-c0a8-44c6-860e-fb423bb7e6d2 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:08.443738 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dccca0d8-c0a8-44c6-860e-fb423bb7e6d2 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:08.445924 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dccca0d8-c0a8-44c6-860e-fb423bb7e6d2 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:08.451310 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dccca0d8-c0a8-44c6-860e-fb423bb7e6d2 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:08.452226 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dccca0d8-c0a8-44c6-860e-fb423bb7e6d2 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:08.797447 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-91b88b65-3306-44ad-9d61-497e4069fc27 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eadce040fcf3427abab9ef8b0ca19400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f4f9b0233b4fb29963b77248a236f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:08.807560 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-91b88b65-3306-44ad-9d61-497e4069fc27 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] 10.222.0.43 "GET /compute/v2.1/servers/5d937ba2-60f4-40cf-9ed8-a4a86d458e38" status: 200 len: 1324 microversion: 2.1 time: 0.556032 Oct 04 18:39:08.808865 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1108/2068] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:08 2022] GET /compute/v2.1/servers/5d937ba2-60f4-40cf-9ed8-a4a86d458e38 => generated 1324 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:08.822064 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-dccca0d8-c0a8-44c6-860e-fb423bb7e6d2 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:08.831151 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-4f0aba40-a1eb-4deb-8006-d79f1ecc40f3 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:08.831783 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-4f0aba40-a1eb-4deb-8006-d79f1ecc40f3 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] [instance: 23ce945d-cd4a-40d5-80be-d5548c257e07] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:08.837306 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-dccca0d8-c0a8-44c6-860e-fb423bb7e6d2 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/d9d4332a-97b6-40f1-bd7c-a9a75a9adc43" status: 200 len: 1378 microversion: 2.1 time: 0.422375 Oct 04 18:39:08.839750 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 961/2069] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:08 2022] GET /compute/v2.1/servers/d9d4332a-97b6-40f1-bd7c-a9a75a9adc43 => generated 1378 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:08.844964 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4f0aba40-a1eb-4deb-8006-d79f1ecc40f3 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:08.845506 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4f0aba40-a1eb-4deb-8006-d79f1ecc40f3 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:08.845649 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-6dbaf729-e616-4cdf-aa47-9a6c52657ba5 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Calling method '.version_select at 0x7fb21f892f70>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:08.845955 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4f0aba40-a1eb-4deb-8006-d79f1ecc40f3 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:08.846670 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4f0aba40-a1eb-4deb-8006-d79f1ecc40f3 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:08.847142 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4f0aba40-a1eb-4deb-8006-d79f1ecc40f3 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:08.847557 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4f0aba40-a1eb-4deb-8006-d79f1ecc40f3 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:08.918051 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-6dbaf729-e616-4cdf-aa47-9a6c52657ba5 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] 10.222.0.43 "GET /compute/v2.1/images/e5989b78-5925-4d33-8625-f3af6fa4e64d" status: 200 len: 1463 microversion: 2.1 time: 0.077122 Oct 04 18:39:08.919612 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 962/2070] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 18:39:08 2022] GET /compute/v2.1/images/e5989b78-5925-4d33-8625-f3af6fa4e64d => generated 1463 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:09.136998 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-4f0aba40-a1eb-4deb-8006-d79f1ecc40f3 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c96ec8b8e0a4053b0457f213e6e262d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b812c85494a49898376a0dd8140f03c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:09.148563 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-4f0aba40-a1eb-4deb-8006-d79f1ecc40f3 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] 10.222.0.43 "GET /compute/v2.1/servers/23ce945d-cd4a-40d5-80be-d5548c257e07" status: 200 len: 1502 microversion: 2.1 time: 0.338126 Oct 04 18:39:09.157298 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1109/2071] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:08 2022] GET /compute/v2.1/servers/23ce945d-cd4a-40d5-80be-d5548c257e07 => generated 1502 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:09.163767 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-708cdfb1-7073-414f-8983-ed73fe42a0d2 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Calling method '.version_select at 0x7fb227e82940>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:09.183741 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-3e105242-faff-4ac2-a365-bba29d399e20 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-2073811457", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452", "networks": [{"uuid": "4a504379-6ebf-4a63-ae82-1644e988a1d0"}]}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:39:09.242239 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-708cdfb1-7073-414f-8983-ed73fe42a0d2 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] 10.222.0.43 "GET /compute/v2.1/images/e5989b78-5925-4d33-8625-f3af6fa4e64d" status: 200 len: 1463 microversion: 2.1 time: 0.082666 Oct 04 18:39:09.243233 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1110/2072] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 18:39:09 2022] GET /compute/v2.1/images/e5989b78-5925-4d33-8625-f3af6fa4e64d => generated 1463 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:09.254767 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-08b15c7a-b08e-49d7-83b7-a98284f1b8e6 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:09.255491 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-08b15c7a-b08e-49d7-83b7-a98284f1b8e6 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] [instance: 237ee25f-85f0-46d4-8980-66c5bfe764ad] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:09.267132 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.network.neutron [None req-3e105242-faff-4ac2-a365-bba29d399e20 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] validate_networks() for [('4a504379-6ebf-4a63-ae82-1644e988a1d0', None, None, None, None, None)] {{(pid=123595) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:39:09.267680 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-08b15c7a-b08e-49d7-83b7-a98284f1b8e6 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:09.267930 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-08b15c7a-b08e-49d7-83b7-a98284f1b8e6 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:09.268479 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-08b15c7a-b08e-49d7-83b7-a98284f1b8e6 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:09.269305 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-08b15c7a-b08e-49d7-83b7-a98284f1b8e6 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:09.269838 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-08b15c7a-b08e-49d7-83b7-a98284f1b8e6 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:09.270764 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-08b15c7a-b08e-49d7-83b7-a98284f1b8e6 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:09.479516 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-08b15c7a-b08e-49d7-83b7-a98284f1b8e6 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6daea1f7b0084009ac6e24181a1b87d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f3ca2b15fd24916ac47e08325464d75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:09.493684 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-08b15c7a-b08e-49d7-83b7-a98284f1b8e6 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] 10.222.0.43 "GET /compute/v2.1/servers/237ee25f-85f0-46d4-8980-66c5bfe764ad" status: 200 len: 1312 microversion: 2.1 time: 0.248584 Oct 04 18:39:09.494590 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1111/2073] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:09 2022] GET /compute/v2.1/servers/237ee25f-85f0-46d4-8980-66c5bfe764ad => generated 1312 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:09.500120 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-2e2e0a8a-92da-4d05-822e-824535062343 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-286313683"}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:39:09.500687 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-2e2e0a8a-92da-4d05-822e-824535062343 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] [instance: 23ce945d-cd4a-40d5-80be-d5548c257e07] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:09.508283 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2e2e0a8a-92da-4d05-822e-824535062343 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:09.509260 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2e2e0a8a-92da-4d05-822e-824535062343 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:09.509260 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2e2e0a8a-92da-4d05-822e-824535062343 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:09.509965 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2e2e0a8a-92da-4d05-822e-824535062343 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:09.510468 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2e2e0a8a-92da-4d05-822e-824535062343 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:09.510842 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2e2e0a8a-92da-4d05-822e-824535062343 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:09.684810 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.network.security_group_api [None req-2e2e0a8a-92da-4d05-822e-824535062343 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Adding security group c812765a-ea2b-4bfe-b3da-082a43ef23ef to port cdfdd4b0-7f80-434d-ba80-684bf856bfe6 Oct 04 18:39:09.768505 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-3e105242-faff-4ac2-a365-bba29d399e20 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Flavor limits 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:39:09.769269 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-3e105242-faff-4ac2-a365-bba29d399e20 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Image limits 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:39:09.769947 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-3e105242-faff-4ac2-a365-bba29d399e20 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Flavor pref 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:39:09.770534 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-3e105242-faff-4ac2-a365-bba29d399e20 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Image pref 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:39:09.770979 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-3e105242-faff-4ac2-a365-bba29d399e20 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:39:09.781491 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3e105242-faff-4ac2-a365-bba29d399e20 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:09.781989 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3e105242-faff-4ac2-a365-bba29d399e20 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:09.782429 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3e105242-faff-4ac2-a365-bba29d399e20 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:09.783166 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3e105242-faff-4ac2-a365-bba29d399e20 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:09.783621 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3e105242-faff-4ac2-a365-bba29d399e20 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:09.784050 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3e105242-faff-4ac2-a365-bba29d399e20 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:09.816387 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-3e105242-faff-4ac2-a365-bba29d399e20 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Getting quotas for project dfc41f296eb44503868205ec8aa2fef3. Resources: {'ram', 'cores', 'instances'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:39:09.828566 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:39:09.832240 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-3e105242-faff-4ac2-a365-bba29d399e20 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Getting quotas for user 6a19da94e9e646028a7f73f9d0e0edda and project dfc41f296eb44503868205ec8aa2fef3. Resources: {'ram', 'cores', 'instances'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:39:09.847140 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-3e105242-faff-4ac2-a365-bba29d399e20 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Going to run 1 instances... {{(pid=123595) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:39:09.849876 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-3e105242-faff-4ac2-a365-bba29d399e20 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] [instance: 1a71ee0e-ffa8-4730-b4fb-8b6e9fd87239] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e8943ec5-4038-4d4b-b9b9-2415a79f5243',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:39:09.933392 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-3e105242-faff-4ac2-a365-bba29d399e20 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.987397 Oct 04 18:39:09.948270 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 963/2074] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 18:39:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 1028 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:39:09.954318 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-87f57097-f4fb-404c-88e5-137727b74b72 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:09.955497 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-87f57097-f4fb-404c-88e5-137727b74b72 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] [instance: 0b7f1ede-48b3-48d8-933e-287c338b1e6a] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:09.962839 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-87f57097-f4fb-404c-88e5-137727b74b72 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:09.963783 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-87f57097-f4fb-404c-88e5-137727b74b72 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:09.964725 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-87f57097-f4fb-404c-88e5-137727b74b72 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:09.975943 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-87f57097-f4fb-404c-88e5-137727b74b72 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:09.976829 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-87f57097-f4fb-404c-88e5-137727b74b72 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:09.977935 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-87f57097-f4fb-404c-88e5-137727b74b72 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:10.259384 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-87f57097-f4fb-404c-88e5-137727b74b72 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e30c6d7042ca444a86e2260692ea048e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c54096058d4c9a8ea436329e25ecbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:10.273990 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-87f57097-f4fb-404c-88e5-137727b74b72 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] 10.222.0.43 "GET /compute/v2.1/servers/0b7f1ede-48b3-48d8-933e-287c338b1e6a" status: 200 len: 1467 microversion: 2.1 time: 0.323867 Oct 04 18:39:10.288856 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-2e2e0a8a-92da-4d05-822e-824535062343 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] 10.222.0.43 "POST /compute/v2.1/servers/23ce945d-cd4a-40d5-80be-d5548c257e07/action" status: 202 len: 0 microversion: 2.1 time: 0.792445 Oct 04 18:39:10.290138 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1112/2075] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 18:39:09 2022] POST /compute/v2.1/servers/23ce945d-cd4a-40d5-80be-d5548c257e07/action => generated 0 bytes in 795 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:39:10.293946 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 964/2076] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:09 2022] GET /compute/v2.1/servers/0b7f1ede-48b3-48d8-933e-287c338b1e6a => generated 1467 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:10.296224 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-6f491e0d-2b04-488b-9356-76218f2d7251 tempest-ServerAddressesTestJSON-638433160 tempest-ServerAddressesTestJSON-638433160-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:10.297859 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-6f491e0d-2b04-488b-9356-76218f2d7251 tempest-ServerAddressesTestJSON-638433160 tempest-ServerAddressesTestJSON-638433160-project] [instance: cdb73233-3522-4ddb-b7d4-463685e66bcc] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:10.309171 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-b3f0decc-5583-4307-9111-91a2f11a416e tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:10.313291 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6f491e0d-2b04-488b-9356-76218f2d7251 tempest-ServerAddressesTestJSON-638433160 tempest-ServerAddressesTestJSON-638433160-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:10.314375 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6f491e0d-2b04-488b-9356-76218f2d7251 tempest-ServerAddressesTestJSON-638433160 tempest-ServerAddressesTestJSON-638433160-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:10.315419 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6f491e0d-2b04-488b-9356-76218f2d7251 tempest-ServerAddressesTestJSON-638433160 tempest-ServerAddressesTestJSON-638433160-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:10.316445 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6f491e0d-2b04-488b-9356-76218f2d7251 tempest-ServerAddressesTestJSON-638433160 tempest-ServerAddressesTestJSON-638433160-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:10.316843 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-b3f0decc-5583-4307-9111-91a2f11a416e tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] [instance: d1f298aa-ebe3-4f52-ada6-137a782cd9b7] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:10.318177 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6f491e0d-2b04-488b-9356-76218f2d7251 tempest-ServerAddressesTestJSON-638433160 tempest-ServerAddressesTestJSON-638433160-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:10.318897 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6f491e0d-2b04-488b-9356-76218f2d7251 tempest-ServerAddressesTestJSON-638433160 tempest-ServerAddressesTestJSON-638433160-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:10.325645 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b3f0decc-5583-4307-9111-91a2f11a416e tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:10.326698 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b3f0decc-5583-4307-9111-91a2f11a416e tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:10.327400 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b3f0decc-5583-4307-9111-91a2f11a416e tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:10.328282 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b3f0decc-5583-4307-9111-91a2f11a416e tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:10.328908 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b3f0decc-5583-4307-9111-91a2f11a416e tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:10.329598 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b3f0decc-5583-4307-9111-91a2f11a416e tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:10.476458 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-6f491e0d-2b04-488b-9356-76218f2d7251 tempest-ServerAddressesTestJSON-638433160 tempest-ServerAddressesTestJSON-638433160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c41b6ddac731410085f447c3f687ef7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b241fded901d40fca9db5b5a4862a428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:10.491622 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-6f491e0d-2b04-488b-9356-76218f2d7251 tempest-ServerAddressesTestJSON-638433160 tempest-ServerAddressesTestJSON-638433160-project] 10.222.0.43 "GET /compute/v2.1/servers/cdb73233-3522-4ddb-b7d4-463685e66bcc" status: 200 len: 1268 microversion: 2.1 time: 0.200221 Oct 04 18:39:10.498503 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1113/2077] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:10 2022] GET /compute/v2.1/servers/cdb73233-3522-4ddb-b7d4-463685e66bcc => generated 1268 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:10.517547 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-4810c456-2ac9-42f7-a191-afe78f6490b0 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:10.519160 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-4810c456-2ac9-42f7-a191-afe78f6490b0 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] [instance: 5d937ba2-60f4-40cf-9ed8-a4a86d458e38] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:10.539612 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-b3f0decc-5583-4307-9111-91a2f11a416e tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:10.540394 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4810c456-2ac9-42f7-a191-afe78f6490b0 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:10.542744 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4810c456-2ac9-42f7-a191-afe78f6490b0 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:10.543492 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4810c456-2ac9-42f7-a191-afe78f6490b0 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:10.544636 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4810c456-2ac9-42f7-a191-afe78f6490b0 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:10.545954 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4810c456-2ac9-42f7-a191-afe78f6490b0 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:10.548014 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4810c456-2ac9-42f7-a191-afe78f6490b0 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:10.554704 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-b3f0decc-5583-4307-9111-91a2f11a416e tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:10.559384 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-b3f0decc-5583-4307-9111-91a2f11a416e tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:10.560829 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-b3f0decc-5583-4307-9111-91a2f11a416e tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] 10.222.0.43 "GET /compute/v2.1/servers/d1f298aa-ebe3-4f52-ada6-137a782cd9b7" status: 200 len: 1476 microversion: 2.25 time: 0.262450 Oct 04 18:39:10.561441 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 965/2078] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:39:10 2022] GET /compute/v2.1/servers/d1f298aa-ebe3-4f52-ada6-137a782cd9b7 => generated 1476 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:39:10.568207 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-c0059ee2-18a5-4b99-be64-134f04e39316 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:10.568822 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-c0059ee2-18a5-4b99-be64-134f04e39316 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: d9d4332a-97b6-40f1-bd7c-a9a75a9adc43] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:10.586419 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c0059ee2-18a5-4b99-be64-134f04e39316 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:10.586928 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c0059ee2-18a5-4b99-be64-134f04e39316 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:10.587373 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c0059ee2-18a5-4b99-be64-134f04e39316 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:10.588097 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c0059ee2-18a5-4b99-be64-134f04e39316 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:10.588553 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c0059ee2-18a5-4b99-be64-134f04e39316 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:10.588980 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c0059ee2-18a5-4b99-be64-134f04e39316 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:10.848579 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-c0059ee2-18a5-4b99-be64-134f04e39316 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:10.857600 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-c0059ee2-18a5-4b99-be64-134f04e39316 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/d9d4332a-97b6-40f1-bd7c-a9a75a9adc43" status: 200 len: 1378 microversion: 2.1 time: 0.295006 Oct 04 18:39:10.871420 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 966/2079] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:10 2022] GET /compute/v2.1/servers/d9d4332a-97b6-40f1-bd7c-a9a75a9adc43 => generated 1378 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:10.881199 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-403096db-a0a0-4af4-85ea-5a9dfcaee33e tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1934566253", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452", "networks": [{"uuid": "4a504379-6ebf-4a63-ae82-1644e988a1d0"}]}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:39:10.932588 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-4810c456-2ac9-42f7-a191-afe78f6490b0 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eadce040fcf3427abab9ef8b0ca19400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f4f9b0233b4fb29963b77248a236f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:10.941673 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-4810c456-2ac9-42f7-a191-afe78f6490b0 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] 10.222.0.43 "GET /compute/v2.1/servers/5d937ba2-60f4-40cf-9ed8-a4a86d458e38" status: 200 len: 1324 microversion: 2.1 time: 0.441247 Oct 04 18:39:10.942270 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1114/2080] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:10 2022] GET /compute/v2.1/servers/5d937ba2-60f4-40cf-9ed8-a4a86d458e38 => generated 1324 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:10.946936 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-762f17d9-c24a-49d4-a5bd-68be609cb10d tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1675967602"}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:39:10.947516 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-762f17d9-c24a-49d4-a5bd-68be609cb10d tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] [instance: 23ce945d-cd4a-40d5-80be-d5548c257e07] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:10.951979 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.network.neutron [None req-403096db-a0a0-4af4-85ea-5a9dfcaee33e tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] validate_networks() for [('4a504379-6ebf-4a63-ae82-1644e988a1d0', None, None, None, None, None)] {{(pid=123595) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:39:10.972757 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-762f17d9-c24a-49d4-a5bd-68be609cb10d tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:10.973282 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-762f17d9-c24a-49d4-a5bd-68be609cb10d tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:10.973730 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-762f17d9-c24a-49d4-a5bd-68be609cb10d tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:10.974442 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-762f17d9-c24a-49d4-a5bd-68be609cb10d tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:10.975095 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-762f17d9-c24a-49d4-a5bd-68be609cb10d tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:10.980191 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-762f17d9-c24a-49d4-a5bd-68be609cb10d tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:11.192193 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.network.security_group_api [None req-762f17d9-c24a-49d4-a5bd-68be609cb10d tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Adding security group 13b9a9b8-6230-413c-a2ea-4d1ffca5c194 to port cdfdd4b0-7f80-434d-ba80-684bf856bfe6 Oct 04 18:39:11.397722 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=2 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:39:11.495537 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-403096db-a0a0-4af4-85ea-5a9dfcaee33e tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Flavor limits 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:39:11.495537 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-403096db-a0a0-4af4-85ea-5a9dfcaee33e tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Image limits 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:39:11.496072 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-403096db-a0a0-4af4-85ea-5a9dfcaee33e tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Flavor pref 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:39:11.496344 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-403096db-a0a0-4af4-85ea-5a9dfcaee33e tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Image pref 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:39:11.501188 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-403096db-a0a0-4af4-85ea-5a9dfcaee33e tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:39:11.518571 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-403096db-a0a0-4af4-85ea-5a9dfcaee33e tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:11.521065 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-403096db-a0a0-4af4-85ea-5a9dfcaee33e tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:11.524633 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-403096db-a0a0-4af4-85ea-5a9dfcaee33e tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:11.526292 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-403096db-a0a0-4af4-85ea-5a9dfcaee33e tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:11.527452 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-403096db-a0a0-4af4-85ea-5a9dfcaee33e tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:11.528372 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-403096db-a0a0-4af4-85ea-5a9dfcaee33e tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:11.551564 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-403096db-a0a0-4af4-85ea-5a9dfcaee33e tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Getting quotas for project dfc41f296eb44503868205ec8aa2fef3. Resources: {'ram', 'cores', 'instances'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:39:11.556376 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-403096db-a0a0-4af4-85ea-5a9dfcaee33e tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Getting quotas for user 6a19da94e9e646028a7f73f9d0e0edda and project dfc41f296eb44503868205ec8aa2fef3. Resources: {'ram', 'cores', 'instances'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:39:11.584013 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-403096db-a0a0-4af4-85ea-5a9dfcaee33e tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Going to run 1 instances... {{(pid=123595) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:39:11.586706 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-403096db-a0a0-4af4-85ea-5a9dfcaee33e tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] [instance: 5d365b7e-b516-4ae9-a1cd-7502e9d71041] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e8943ec5-4038-4d4b-b9b9-2415a79f5243',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:39:11.683854 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-403096db-a0a0-4af4-85ea-5a9dfcaee33e tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.810299 Oct 04 18:39:11.687408 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 967/2081] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 18:39:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 815 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:39:11.708243 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-1cacdc7a-f717-4b2a-a11a-b63abfe48284 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-14353844"}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:39:11.720604 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-1cacdc7a-f717-4b2a-a11a-b63abfe48284 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] [instance: 6eb9c803-dd97-4af5-b0d0-aa6fc18f8a89] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:11.732522 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1cacdc7a-f717-4b2a-a11a-b63abfe48284 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:11.733087 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1cacdc7a-f717-4b2a-a11a-b63abfe48284 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:11.737515 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1cacdc7a-f717-4b2a-a11a-b63abfe48284 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:11.738773 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1cacdc7a-f717-4b2a-a11a-b63abfe48284 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:11.739508 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1cacdc7a-f717-4b2a-a11a-b63abfe48284 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:11.740611 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1cacdc7a-f717-4b2a-a11a-b63abfe48284 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:12.036436 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-762f17d9-c24a-49d4-a5bd-68be609cb10d tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] 10.222.0.43 "POST /compute/v2.1/servers/23ce945d-cd4a-40d5-80be-d5548c257e07/action" status: 202 len: 0 microversion: 2.1 time: 1.093065 Oct 04 18:39:12.038199 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1115/2082] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 18:39:10 2022] POST /compute/v2.1/servers/23ce945d-cd4a-40d5-80be-d5548c257e07/action => generated 0 bytes in 1095 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:39:12.048284 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-0edb217f-9a82-4e2f-a1f7-da7fd4a59db3 req-15058cdb-07a7-46fb-99e0-415d0f637b4e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23ce945d-cd4a-40d5-80be-d5548c257e07", "tag": "cdfdd4b0-7f80-434d-ba80-684bf856bfe6"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:39:12.089494 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-0edb217f-9a82-4e2f-a1f7-da7fd4a59db3 req-15058cdb-07a7-46fb-99e0-415d0f637b4e service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:12.090293 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-0edb217f-9a82-4e2f-a1f7-da7fd4a59db3 req-15058cdb-07a7-46fb-99e0-415d0f637b4e service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:12.090797 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-0edb217f-9a82-4e2f-a1f7-da7fd4a59db3 req-15058cdb-07a7-46fb-99e0-415d0f637b4e service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:12.110314 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-0edb217f-9a82-4e2f-a1f7-da7fd4a59db3 req-15058cdb-07a7-46fb-99e0-415d0f637b4e service nova] Creating event network-changed:cdfdd4b0-7f80-434d-ba80-684bf856bfe6 for instance 23ce945d-cd4a-40d5-80be-d5548c257e07 on n-h1-851028-13 Oct 04 18:39:12.114607 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-1cacdc7a-f717-4b2a-a11a-b63abfe48284 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] 10.222.0.43 "POST /compute/v2.1/servers/6eb9c803-dd97-4af5-b0d0-aa6fc18f8a89/action" status: 202 len: 0 microversion: 2.1 time: 0.425879 Oct 04 18:39:12.117915 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 968/2083] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 18:39:11 2022] POST /compute/v2.1/servers/6eb9c803-dd97-4af5-b0d0-aa6fc18f8a89/action => generated 0 bytes in 430 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 04 18:39:12.118863 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-0edb217f-9a82-4e2f-a1f7-da7fd4a59db3 req-15058cdb-07a7-46fb-99e0-415d0f637b4e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078527 Oct 04 18:39:12.120226 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1116/2084] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:39:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:39:12.139363 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-dff4843e-1bd3-4650-8cca-72980d532012 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:12.140100 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-dff4843e-1bd3-4650-8cca-72980d532012 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] [instance: 237ee25f-85f0-46d4-8980-66c5bfe764ad] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:12.153674 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dff4843e-1bd3-4650-8cca-72980d532012 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:12.156797 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dff4843e-1bd3-4650-8cca-72980d532012 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:12.157753 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dff4843e-1bd3-4650-8cca-72980d532012 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:12.158348 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dff4843e-1bd3-4650-8cca-72980d532012 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:12.161356 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dff4843e-1bd3-4650-8cca-72980d532012 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:12.163930 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dff4843e-1bd3-4650-8cca-72980d532012 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:12.365048 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-b6fb46b9-7871-40d7-8979-3441829de5c1 tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:12.365813 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-b6fb46b9-7871-40d7-8979-3441829de5c1 tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] [instance: d1f298aa-ebe3-4f52-ada6-137a782cd9b7] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:12.375789 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b6fb46b9-7871-40d7-8979-3441829de5c1 tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:12.377424 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b6fb46b9-7871-40d7-8979-3441829de5c1 tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:12.378148 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b6fb46b9-7871-40d7-8979-3441829de5c1 tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:12.381093 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b6fb46b9-7871-40d7-8979-3441829de5c1 tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:12.381979 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b6fb46b9-7871-40d7-8979-3441829de5c1 tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:12.383061 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b6fb46b9-7871-40d7-8979-3441829de5c1 tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:12.427975 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-dff4843e-1bd3-4650-8cca-72980d532012 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6daea1f7b0084009ac6e24181a1b87d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f3ca2b15fd24916ac47e08325464d75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:12.438395 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-dff4843e-1bd3-4650-8cca-72980d532012 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] 10.222.0.43 "GET /compute/v2.1/servers/237ee25f-85f0-46d4-8980-66c5bfe764ad" status: 200 len: 1498 microversion: 2.1 time: 0.318082 Oct 04 18:39:12.438998 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 969/2085] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:12 2022] GET /compute/v2.1/servers/237ee25f-85f0-46d4-8980-66c5bfe764ad => generated 1498 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:12.444831 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-82780bd8-35b5-4c25-b107-24a766ae9184 tempest-ServerAddressesTestJSON-638433160 tempest-ServerAddressesTestJSON-638433160-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:12.445750 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-82780bd8-35b5-4c25-b107-24a766ae9184 tempest-ServerAddressesTestJSON-638433160 tempest-ServerAddressesTestJSON-638433160-project] [instance: cdb73233-3522-4ddb-b7d4-463685e66bcc] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:12.453907 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-82780bd8-35b5-4c25-b107-24a766ae9184 tempest-ServerAddressesTestJSON-638433160 tempest-ServerAddressesTestJSON-638433160-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:12.460363 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-82780bd8-35b5-4c25-b107-24a766ae9184 tempest-ServerAddressesTestJSON-638433160 tempest-ServerAddressesTestJSON-638433160-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:12.473588 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-82780bd8-35b5-4c25-b107-24a766ae9184 tempest-ServerAddressesTestJSON-638433160 tempest-ServerAddressesTestJSON-638433160-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:12.479213 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-82780bd8-35b5-4c25-b107-24a766ae9184 tempest-ServerAddressesTestJSON-638433160 tempest-ServerAddressesTestJSON-638433160-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:12.480559 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-82780bd8-35b5-4c25-b107-24a766ae9184 tempest-ServerAddressesTestJSON-638433160 tempest-ServerAddressesTestJSON-638433160-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:12.481181 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-82780bd8-35b5-4c25-b107-24a766ae9184 tempest-ServerAddressesTestJSON-638433160 tempest-ServerAddressesTestJSON-638433160-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:12.707059 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.objects.instance [None req-b6fb46b9-7871-40d7-8979-3441829de5c1 tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] Lazy-loading 'services' on Instance uuid d1f298aa-ebe3-4f52-ada6-137a782cd9b7 {{(pid=123596) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:39:12.749035 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-b6fb46b9-7871-40d7-8979-3441829de5c1 tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/d1f298aa-ebe3-4f52-ada6-137a782cd9b7" status: 200 len: 1970 microversion: 2.25 time: 0.613670 Oct 04 18:39:12.762391 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1117/2086] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:39:12 2022] GET /compute/v2.1/servers/d1f298aa-ebe3-4f52-ada6-137a782cd9b7 => generated 1970 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:39:12.783538 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-ff95fb33-24c1-4024-91d3-193ae9ae0162 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1436936666", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "451", "networks": [{"uuid": "4a504379-6ebf-4a63-ae82-1644e988a1d0"}]}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:39:12.849369 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.network.neutron [None req-ff95fb33-24c1-4024-91d3-193ae9ae0162 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] validate_networks() for [('4a504379-6ebf-4a63-ae82-1644e988a1d0', None, None, None, None, None)] {{(pid=123596) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:39:12.914015 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-82780bd8-35b5-4c25-b107-24a766ae9184 tempest-ServerAddressesTestJSON-638433160 tempest-ServerAddressesTestJSON-638433160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c41b6ddac731410085f447c3f687ef7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b241fded901d40fca9db5b5a4862a428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:12.924605 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-82780bd8-35b5-4c25-b107-24a766ae9184 tempest-ServerAddressesTestJSON-638433160 tempest-ServerAddressesTestJSON-638433160-project] 10.222.0.43 "GET /compute/v2.1/servers/cdb73233-3522-4ddb-b7d4-463685e66bcc" status: 200 len: 1316 microversion: 2.1 time: 0.484181 Oct 04 18:39:12.926012 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 970/2087] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:12 2022] GET /compute/v2.1/servers/cdb73233-3522-4ddb-b7d4-463685e66bcc => generated 1316 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:12.941999 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-6cc4c774-f3af-499a-bae3-42af30ac933d tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:12.942905 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-6cc4c774-f3af-499a-bae3-42af30ac933d tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: d9d4332a-97b6-40f1-bd7c-a9a75a9adc43] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:12.950504 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6cc4c774-f3af-499a-bae3-42af30ac933d tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:12.952731 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6cc4c774-f3af-499a-bae3-42af30ac933d tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:12.953419 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6cc4c774-f3af-499a-bae3-42af30ac933d tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:12.955032 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6cc4c774-f3af-499a-bae3-42af30ac933d tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:12.955696 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6cc4c774-f3af-499a-bae3-42af30ac933d tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:12.956307 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6cc4c774-f3af-499a-bae3-42af30ac933d tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:13.261286 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-6cc4c774-f3af-499a-bae3-42af30ac933d tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:13.271918 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-6cc4c774-f3af-499a-bae3-42af30ac933d tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/d9d4332a-97b6-40f1-bd7c-a9a75a9adc43" status: 200 len: 1378 microversion: 2.1 time: 0.344512 Oct 04 18:39:13.272896 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 971/2088] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:12 2022] GET /compute/v2.1/servers/d9d4332a-97b6-40f1-bd7c-a9a75a9adc43 => generated 1378 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:13.289628 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-def23eef-8a46-43b9-9422-f72039b505d2 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:13.290544 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-def23eef-8a46-43b9-9422-f72039b505d2 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] [instance: 5d937ba2-60f4-40cf-9ed8-a4a86d458e38] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:13.304517 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-def23eef-8a46-43b9-9422-f72039b505d2 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:13.305030 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-def23eef-8a46-43b9-9422-f72039b505d2 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:13.309817 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-def23eef-8a46-43b9-9422-f72039b505d2 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:13.312674 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-def23eef-8a46-43b9-9422-f72039b505d2 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:13.314448 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-def23eef-8a46-43b9-9422-f72039b505d2 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:13.315982 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-def23eef-8a46-43b9-9422-f72039b505d2 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:13.607135 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-def23eef-8a46-43b9-9422-f72039b505d2 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eadce040fcf3427abab9ef8b0ca19400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f4f9b0233b4fb29963b77248a236f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:13.619580 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-def23eef-8a46-43b9-9422-f72039b505d2 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] 10.222.0.43 "GET /compute/v2.1/servers/5d937ba2-60f4-40cf-9ed8-a4a86d458e38" status: 200 len: 1521 microversion: 2.1 time: 0.345211 Oct 04 18:39:13.636031 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 972/2089] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:13 2022] GET /compute/v2.1/servers/5d937ba2-60f4-40cf-9ed8-a4a86d458e38 => generated 1521 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:13.641541 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-c3e46780-be88-4724-b098-14db336fe53c tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:13.642278 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-c3e46780-be88-4724-b098-14db336fe53c tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] [instance: 23ce945d-cd4a-40d5-80be-d5548c257e07] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:13.649579 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c3e46780-be88-4724-b098-14db336fe53c tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:13.650381 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c3e46780-be88-4724-b098-14db336fe53c tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:13.650835 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c3e46780-be88-4724-b098-14db336fe53c tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:13.651548 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c3e46780-be88-4724-b098-14db336fe53c tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:13.652009 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c3e46780-be88-4724-b098-14db336fe53c tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:13.652442 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c3e46780-be88-4724-b098-14db336fe53c tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:13.961565 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-c3e46780-be88-4724-b098-14db336fe53c tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] 10.222.0.43 "GET /compute/v2.1/servers/23ce945d-cd4a-40d5-80be-d5548c257e07/os-security-groups" status: 200 len: 1158 microversion: 2.1 time: 0.325004 Oct 04 18:39:13.962591 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 973/2090] 10.222.0.43 () {58 vars in 1293 bytes} [Tue Oct 4 18:39:13 2022] GET /compute/v2.1/servers/23ce945d-cd4a-40d5-80be-d5548c257e07/os-security-groups => generated 1158 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:13.977153 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-e934fdac-2054-4447-a04b-0cb19539cb36 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Calling method '.version_select at 0x7fb21fecd9d0>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:14.030798 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-e934fdac-2054-4447-a04b-0cb19539cb36 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] 10.222.0.43 "GET /compute/v2.1/images/8b9606ad-88f3-4647-bc18-c5885add126b" status: 200 len: 1453 microversion: 2.1 time: 0.066326 Oct 04 18:39:14.032123 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 974/2091] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 18:39:13 2022] GET /compute/v2.1/images/8b9606ad-88f3-4647-bc18-c5885add126b => generated 1453 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:14.037257 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-0098e34a-3f22-407d-9bf4-5c03fa89a056 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:14.053857 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.compute.server_groups [None req-0098e34a-3f22-407d-9bf4-5c03fa89a056 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Querying cell 66287c68-6a08-453f-953b-bd2446fe0d25(cell1) for 1 instances {{(pid=123595) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 04 18:39:14.054776 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0098e34a-3f22-407d-9bf4-5c03fa89a056 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:14.055464 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0098e34a-3f22-407d-9bf4-5c03fa89a056 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:14.056073 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0098e34a-3f22-407d-9bf4-5c03fa89a056 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:14.086261 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-0098e34a-3f22-407d-9bf4-5c03fa89a056 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] 10.222.0.43 "GET /compute/v2.1/os-server-groups/e20eb086-2572-400f-bbd0-163473a4eb28" status: 200 len: 221 microversion: 2.1 time: 0.052755 Oct 04 18:39:14.087452 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 975/2092] 10.222.0.43 () {58 vars in 1263 bytes} [Tue Oct 4 18:39:14 2022] GET /compute/v2.1/os-server-groups/e20eb086-2572-400f-bbd0-163473a4eb28 => generated 221 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:39:14.094143 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-0cd3c709-1fc8-493b-b3e0-83f3fe385754 tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:14.095019 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-0cd3c709-1fc8-493b-b3e0-83f3fe385754 tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] [instance: d1f298aa-ebe3-4f52-ada6-137a782cd9b7] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:14.101885 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0cd3c709-1fc8-493b-b3e0-83f3fe385754 tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:14.102479 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0cd3c709-1fc8-493b-b3e0-83f3fe385754 tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:14.102929 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0cd3c709-1fc8-493b-b3e0-83f3fe385754 tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:14.103640 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0cd3c709-1fc8-493b-b3e0-83f3fe385754 tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:14.104299 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0cd3c709-1fc8-493b-b3e0-83f3fe385754 tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:14.104923 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0cd3c709-1fc8-493b-b3e0-83f3fe385754 tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:14.282015 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.objects.instance [None req-0cd3c709-1fc8-493b-b3e0-83f3fe385754 tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] Lazy-loading 'services' on Instance uuid d1f298aa-ebe3-4f52-ada6-137a782cd9b7 {{(pid=123595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:39:14.295335 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-0cd3c709-1fc8-493b-b3e0-83f3fe385754 tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/d1f298aa-ebe3-4f52-ada6-137a782cd9b7" status: 200 len: 1970 microversion: 2.25 time: 0.206152 Oct 04 18:39:14.296181 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 976/2093] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:39:14 2022] GET /compute/v2.1/servers/d1f298aa-ebe3-4f52-ada6-137a782cd9b7 => generated 1970 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:39:14.298094 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-ff95fb33-24c1-4024-91d3-193ae9ae0162 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Flavor limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:39:14.299107 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-ff95fb33-24c1-4024-91d3-193ae9ae0162 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Image limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:39:14.300303 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-ff95fb33-24c1-4024-91d3-193ae9ae0162 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Flavor pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:39:14.300714 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-e9ffa440-f58b-4835-a98a-ee9c2c3d5cea req-2399f131-1f24-4909-94e7-7223a1fd1afd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9d4332a-97b6-40f1-bd7c-a9a75a9adc43", "name": "network-vif-plugged", "status": "completed", "tag": "e64ffaa5-c4b7-4d5d-b9bd-605829597e42"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:39:14.301340 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-ff95fb33-24c1-4024-91d3-193ae9ae0162 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Image pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:39:14.302000 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-ff95fb33-24c1-4024-91d3-193ae9ae0162 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:39:14.310898 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-e9ffa440-f58b-4835-a98a-ee9c2c3d5cea req-2399f131-1f24-4909-94e7-7223a1fd1afd service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:14.311462 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-e9ffa440-f58b-4835-a98a-ee9c2c3d5cea req-2399f131-1f24-4909-94e7-7223a1fd1afd service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:14.311955 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-e9ffa440-f58b-4835-a98a-ee9c2c3d5cea req-2399f131-1f24-4909-94e7-7223a1fd1afd service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:14.317640 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ff95fb33-24c1-4024-91d3-193ae9ae0162 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:14.318500 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ff95fb33-24c1-4024-91d3-193ae9ae0162 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:14.319165 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ff95fb33-24c1-4024-91d3-193ae9ae0162 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:14.320786 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ff95fb33-24c1-4024-91d3-193ae9ae0162 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:14.321799 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ff95fb33-24c1-4024-91d3-193ae9ae0162 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:14.322654 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ff95fb33-24c1-4024-91d3-193ae9ae0162 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:14.324566 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-e9ffa440-f58b-4835-a98a-ee9c2c3d5cea req-2399f131-1f24-4909-94e7-7223a1fd1afd service nova] Creating event network-vif-plugged:e64ffaa5-c4b7-4d5d-b9bd-605829597e42 for instance d9d4332a-97b6-40f1-bd7c-a9a75a9adc43 on n-h1-851028-13 Oct 04 18:39:14.330558 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-e9ffa440-f58b-4835-a98a-ee9c2c3d5cea req-2399f131-1f24-4909-94e7-7223a1fd1afd service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033005 Oct 04 18:39:14.331578 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 977/2094] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:39:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:39:14.337135 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-624eef97-7263-4e51-8a9d-6273590aea83 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.8.167"}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:39:14.339828 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-624eef97-7263-4e51-8a9d-6273590aea83 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] [instance: 36d7eb4f-22bc-4047-bc75-6f69142daee5] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:14.347164 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-624eef97-7263-4e51-8a9d-6273590aea83 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:14.347699 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-624eef97-7263-4e51-8a9d-6273590aea83 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:14.348199 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-624eef97-7263-4e51-8a9d-6273590aea83 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:14.348931 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-624eef97-7263-4e51-8a9d-6273590aea83 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:14.349424 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-624eef97-7263-4e51-8a9d-6273590aea83 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:14.349862 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-624eef97-7263-4e51-8a9d-6273590aea83 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:14.350353 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-ff95fb33-24c1-4024-91d3-193ae9ae0162 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Getting quotas for project dfc41f296eb44503868205ec8aa2fef3. Resources: {'ram', 'cores', 'instances'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:39:14.355673 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-ff95fb33-24c1-4024-91d3-193ae9ae0162 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Getting quotas for user 6a19da94e9e646028a7f73f9d0e0edda and project dfc41f296eb44503868205ec8aa2fef3. Resources: {'ram', 'cores', 'instances'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:39:14.376164 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-ff95fb33-24c1-4024-91d3-193ae9ae0162 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Going to run 1 instances... {{(pid=123596) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:39:14.380199 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-ff95fb33-24c1-4024-91d3-193ae9ae0162 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] [instance: a4de9e6e-90d3-4317-abf8-9fc8f021b803] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e8943ec5-4038-4d4b-b9b9-2415a79f5243',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123596) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:39:14.390954 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-624eef97-7263-4e51-8a9d-6273590aea83 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Acquiring lock "refresh_cache-36d7eb4f-22bc-4047-bc75-6f69142daee5" {{(pid=123595) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 04 18:39:14.391539 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-624eef97-7263-4e51-8a9d-6273590aea83 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Acquired lock "refresh_cache-36d7eb4f-22bc-4047-bc75-6f69142daee5" {{(pid=123595) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 04 18:39:14.441373 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-ff95fb33-24c1-4024-91d3-193ae9ae0162 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.666412 Oct 04 18:39:14.442829 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1118/2095] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 18:39:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 1680 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:39:14.448422 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-53ee36a8-e5b7-4f47-8821-2aedde9ba83e tempest-ServerAddressesTestJSON-638433160 tempest-ServerAddressesTestJSON-638433160-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:14.449719 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-53ee36a8-e5b7-4f47-8821-2aedde9ba83e tempest-ServerAddressesTestJSON-638433160 tempest-ServerAddressesTestJSON-638433160-project] [instance: cdb73233-3522-4ddb-b7d4-463685e66bcc] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:14.458412 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-53ee36a8-e5b7-4f47-8821-2aedde9ba83e tempest-ServerAddressesTestJSON-638433160 tempest-ServerAddressesTestJSON-638433160-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:14.459567 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-53ee36a8-e5b7-4f47-8821-2aedde9ba83e tempest-ServerAddressesTestJSON-638433160 tempest-ServerAddressesTestJSON-638433160-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:14.460872 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-53ee36a8-e5b7-4f47-8821-2aedde9ba83e tempest-ServerAddressesTestJSON-638433160 tempest-ServerAddressesTestJSON-638433160-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:14.461852 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-53ee36a8-e5b7-4f47-8821-2aedde9ba83e tempest-ServerAddressesTestJSON-638433160 tempest-ServerAddressesTestJSON-638433160-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:14.462563 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-53ee36a8-e5b7-4f47-8821-2aedde9ba83e tempest-ServerAddressesTestJSON-638433160 tempest-ServerAddressesTestJSON-638433160-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:14.463217 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-53ee36a8-e5b7-4f47-8821-2aedde9ba83e tempest-ServerAddressesTestJSON-638433160 tempest-ServerAddressesTestJSON-638433160-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:14.468500 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=100 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:39:14.750309 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-53ee36a8-e5b7-4f47-8821-2aedde9ba83e tempest-ServerAddressesTestJSON-638433160 tempest-ServerAddressesTestJSON-638433160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c41b6ddac731410085f447c3f687ef7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b241fded901d40fca9db5b5a4862a428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:14.759283 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-53ee36a8-e5b7-4f47-8821-2aedde9ba83e tempest-ServerAddressesTestJSON-638433160 tempest-ServerAddressesTestJSON-638433160-project] 10.222.0.43 "GET /compute/v2.1/servers/cdb73233-3522-4ddb-b7d4-463685e66bcc" status: 200 len: 1316 microversion: 2.1 time: 0.314228 Oct 04 18:39:14.760083 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1119/2096] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:14 2022] GET /compute/v2.1/servers/cdb73233-3522-4ddb-b7d4-463685e66bcc => generated 1316 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:14.765265 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-e7ec7043-3654-44c3-86b2-7ae83139f5a9 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Action: 'create', calling method: .version_select at 0x7fb227e02c10>, body: {"security_group": {"name": " tempest-securitygroup -703898543 ", "description": "tempest-description-963219031"}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:39:15.331583 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-e7ec7043-3654-44c3-86b2-7ae83139f5a9 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] 10.222.0.43 "POST /compute/v2.1/os-security-groups" status: 200 len: 222 microversion: 2.1 time: 0.570094 Oct 04 18:39:15.341261 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1120/2097] 10.222.0.43 () {60 vars in 1180 bytes} [Tue Oct 4 18:39:14 2022] POST /compute/v2.1/os-security-groups => generated 222 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:39:15.348599 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-61da0c02-8d10-43a1-99e5-ebebab7c63b5 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:15.349140 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-61da0c02-8d10-43a1-99e5-ebebab7c63b5 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] [instance: 237ee25f-85f0-46d4-8980-66c5bfe764ad] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:15.355974 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-61da0c02-8d10-43a1-99e5-ebebab7c63b5 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:15.356484 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-61da0c02-8d10-43a1-99e5-ebebab7c63b5 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:15.356933 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-61da0c02-8d10-43a1-99e5-ebebab7c63b5 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:15.357739 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-61da0c02-8d10-43a1-99e5-ebebab7c63b5 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:15.358202 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-61da0c02-8d10-43a1-99e5-ebebab7c63b5 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:15.358843 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-61da0c02-8d10-43a1-99e5-ebebab7c63b5 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:15.388505 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-61da0c02-8d10-43a1-99e5-ebebab7c63b5 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] [instance: 237ee25f-85f0-46d4-8980-66c5bfe764ad] Going to try to terminate instance {{(pid=123596) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:39:15.484399 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-61da0c02-8d10-43a1-99e5-ebebab7c63b5 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] 10.222.0.43 "DELETE /compute/v2.1/servers/237ee25f-85f0-46d4-8980-66c5bfe764ad" status: 204 len: 0 microversion: 2.1 time: 0.139509 Oct 04 18:39:15.486001 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1121/2098] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 18:39:15 2022] DELETE /compute/v2.1/servers/237ee25f-85f0-46d4-8980-66c5bfe764ad => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:39:15.496158 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-77ae0735-acb0-4aef-8abd-5b217a20a6cc req-eaed3900-1aec-48ab-866e-9c17ef9834d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23ce945d-cd4a-40d5-80be-d5548c257e07", "tag": "cdfdd4b0-7f80-434d-ba80-684bf856bfe6"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:39:15.508225 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-77ae0735-acb0-4aef-8abd-5b217a20a6cc req-eaed3900-1aec-48ab-866e-9c17ef9834d1 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:15.508710 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-77ae0735-acb0-4aef-8abd-5b217a20a6cc req-eaed3900-1aec-48ab-866e-9c17ef9834d1 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:15.509407 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-77ae0735-acb0-4aef-8abd-5b217a20a6cc req-eaed3900-1aec-48ab-866e-9c17ef9834d1 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:15.522591 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-77ae0735-acb0-4aef-8abd-5b217a20a6cc req-eaed3900-1aec-48ab-866e-9c17ef9834d1 service nova] Creating event network-changed:cdfdd4b0-7f80-434d-ba80-684bf856bfe6 for instance 23ce945d-cd4a-40d5-80be-d5548c257e07 on n-h1-851028-13 Oct 04 18:39:15.527879 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-77ae0735-acb0-4aef-8abd-5b217a20a6cc req-eaed3900-1aec-48ab-866e-9c17ef9834d1 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040265 Oct 04 18:39:15.528505 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1122/2099] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:39:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:39:15.533696 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-273a9687-34a8-46ce-bcdc-6134cac4e5ce tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:15.534413 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-273a9687-34a8-46ce-bcdc-6134cac4e5ce tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: d9d4332a-97b6-40f1-bd7c-a9a75a9adc43] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:15.541549 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-273a9687-34a8-46ce-bcdc-6134cac4e5ce tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:15.542055 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-273a9687-34a8-46ce-bcdc-6134cac4e5ce tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:15.542502 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-273a9687-34a8-46ce-bcdc-6134cac4e5ce tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:15.543225 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-273a9687-34a8-46ce-bcdc-6134cac4e5ce tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:15.543683 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-273a9687-34a8-46ce-bcdc-6134cac4e5ce tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:15.544117 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-273a9687-34a8-46ce-bcdc-6134cac4e5ce tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:15.692910 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-273a9687-34a8-46ce-bcdc-6134cac4e5ce tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:15.701642 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-273a9687-34a8-46ce-bcdc-6134cac4e5ce tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/d9d4332a-97b6-40f1-bd7c-a9a75a9adc43" status: 200 len: 1378 microversion: 2.1 time: 0.171883 Oct 04 18:39:15.702343 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1123/2100] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:15 2022] GET /compute/v2.1/servers/d9d4332a-97b6-40f1-bd7c-a9a75a9adc43 => generated 1378 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:15.717366 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-c4f34434-a43e-46ae-9286-b3c72dd69ed0 tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:15.721704 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c4f34434-a43e-46ae-9286-b3c72dd69ed0 tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:15.722482 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c4f34434-a43e-46ae-9286-b3c72dd69ed0 tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:15.723179 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c4f34434-a43e-46ae-9286-b3c72dd69ed0 tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:15.724026 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c4f34434-a43e-46ae-9286-b3c72dd69ed0 tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:15.724536 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c4f34434-a43e-46ae-9286-b3c72dd69ed0 tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:15.725245 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c4f34434-a43e-46ae-9286-b3c72dd69ed0 tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:15.739918 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:39:15.762534 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-c4f34434-a43e-46ae-9286-b3c72dd69ed0 tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] 10.222.0.43 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.058271 Oct 04 18:39:15.763597 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1124/2101] 10.222.0.43 () {60 vars in 1217 bytes} [Tue Oct 4 18:39:15 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:39:15.768682 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-cec63ca1-f516-49fc-af34-962787bb5c08 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:15.769577 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-cec63ca1-f516-49fc-af34-962787bb5c08 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] [instance: a4de9e6e-90d3-4317-abf8-9fc8f021b803] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:15.778316 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cec63ca1-f516-49fc-af34-962787bb5c08 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:15.785857 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cec63ca1-f516-49fc-af34-962787bb5c08 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:15.786669 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cec63ca1-f516-49fc-af34-962787bb5c08 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:15.787644 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cec63ca1-f516-49fc-af34-962787bb5c08 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:15.790676 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cec63ca1-f516-49fc-af34-962787bb5c08 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:15.791504 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cec63ca1-f516-49fc-af34-962787bb5c08 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:15.879161 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-cec63ca1-f516-49fc-af34-962787bb5c08 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a19da94e9e646028a7f73f9d0e0edda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc41f296eb44503868205ec8aa2fef3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:15.894718 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-cec63ca1-f516-49fc-af34-962787bb5c08 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] 10.222.0.43 "GET /compute/v2.1/servers/a4de9e6e-90d3-4317-abf8-9fc8f021b803" status: 200 len: 1217 microversion: 2.1 time: 0.129277 Oct 04 18:39:15.896181 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1125/2102] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:15 2022] GET /compute/v2.1/servers/a4de9e6e-90d3-4317-abf8-9fc8f021b803 => generated 1217 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:15.913588 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-d8ce0114-c727-4c2d-89d9-06c05997823f tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Calling method '.version_select at 0x7fb227f55af0>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:15.997236 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-d8ce0114-c727-4c2d-89d9-06c05997823f tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] 10.222.0.43 "GET /compute/v2.1/images/8b9606ad-88f3-4647-bc18-c5885add126b" status: 200 len: 1453 microversion: 2.1 time: 0.099501 Oct 04 18:39:15.998598 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1126/2103] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 18:39:15 2022] GET /compute/v2.1/images/8b9606ad-88f3-4647-bc18-c5885add126b => generated 1453 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:16.006652 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-438c9e65-7452-473e-8929-6eba6fa912d6 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Calling method '.version_select at 0x7fb22417dca0>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:16.168046 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-438c9e65-7452-473e-8929-6eba6fa912d6 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] 10.222.0.43 "GET /compute/v2.1/os-security-groups/61d22f84-7693-4a39-940b-e055aab76027" status: 200 len: 222 microversion: 2.1 time: 0.167041 Oct 04 18:39:16.176781 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1127/2104] 10.222.0.43 () {58 vars in 1269 bytes} [Tue Oct 4 18:39:15 2022] GET /compute/v2.1/os-security-groups/61d22f84-7693-4a39-940b-e055aab76027 => generated 222 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:39:16.176781 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-c67dbd85-3435-4828-a086-0145692816cd tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:16.176781 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-c67dbd85-3435-4828-a086-0145692816cd tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] [instance: 237ee25f-85f0-46d4-8980-66c5bfe764ad] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:16.189655 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c67dbd85-3435-4828-a086-0145692816cd tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:16.190277 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c67dbd85-3435-4828-a086-0145692816cd tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:16.190723 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c67dbd85-3435-4828-a086-0145692816cd tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:16.191684 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c67dbd85-3435-4828-a086-0145692816cd tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:16.192168 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c67dbd85-3435-4828-a086-0145692816cd tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:16.192738 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c67dbd85-3435-4828-a086-0145692816cd tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:16.446046 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-c67dbd85-3435-4828-a086-0145692816cd tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6daea1f7b0084009ac6e24181a1b87d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f3ca2b15fd24916ac47e08325464d75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:16.464413 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-c67dbd85-3435-4828-a086-0145692816cd tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] 10.222.0.43 "GET /compute/v2.1/servers/237ee25f-85f0-46d4-8980-66c5bfe764ad" status: 200 len: 1504 microversion: 2.1 time: 0.294083 Oct 04 18:39:16.468396 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1128/2105] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:16 2022] GET /compute/v2.1/servers/237ee25f-85f0-46d4-8980-66c5bfe764ad => generated 1504 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:16.474068 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-a90f2838-23b7-4c0a-aa93-048e1da4c059 tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-851028-13", "block_migration": "auto"}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:39:16.476844 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-a90f2838-23b7-4c0a-aa93-048e1da4c059 tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] [instance: d1f298aa-ebe3-4f52-ada6-137a782cd9b7] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:16.489050 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a90f2838-23b7-4c0a-aa93-048e1da4c059 tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:16.489777 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a90f2838-23b7-4c0a-aa93-048e1da4c059 tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:16.490715 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a90f2838-23b7-4c0a-aa93-048e1da4c059 tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:16.491620 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a90f2838-23b7-4c0a-aa93-048e1da4c059 tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:16.492249 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a90f2838-23b7-4c0a-aa93-048e1da4c059 tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:16.493031 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a90f2838-23b7-4c0a-aa93-048e1da4c059 tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:16.570770 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.objects.instance [None req-a90f2838-23b7-4c0a-aa93-048e1da4c059 tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] Lazy-loading 'flavor' on Instance uuid d1f298aa-ebe3-4f52-ada6-137a782cd9b7 {{(pid=123596) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:39:16.587906 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-a90f2838-23b7-4c0a-aa93-048e1da4c059 tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] [instance: d1f298aa-ebe3-4f52-ada6-137a782cd9b7] Going to try to live migrate instance to n-h1-851028-13 {{(pid=123596) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 04 18:39:16.630289 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.network.neutron [None req-624eef97-7263-4e51-8a9d-6273590aea83 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] [instance: 36d7eb4f-22bc-4047-bc75-6f69142daee5] Building network info cache for instance {{(pid=123595) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 04 18:39:17.753443 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.network.neutron [None req-624eef97-7263-4e51-8a9d-6273590aea83 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] [instance: 36d7eb4f-22bc-4047-bc75-6f69142daee5] Updating instance_info_cache with network_info: [{"id": "e3d142e8-c4f2-49f8-af0d-f2e13e22b36f", "address": "fa:16:3e:cf:ad:3b", "network": {"id": "8c78b501-c0dc-4b4a-aea6-b08dc5b06498", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1071307667-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.8.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "87f4f9b0233b4fb29963b77248a236f7", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tape3d142e8-c4", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=123595) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 04 18:39:17.770610 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-624eef97-7263-4e51-8a9d-6273590aea83 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Releasing lock "refresh_cache-36d7eb4f-22bc-4047-bc75-6f69142daee5" {{(pid=123595) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 04 18:39:17.772459 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-624eef97-7263-4e51-8a9d-6273590aea83 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] 10.222.0.43 "POST /compute/v2.1/servers/36d7eb4f-22bc-4047-bc75-6f69142daee5/action" status: 202 len: 0 microversion: 2.1 time: 3.439374 Oct 04 18:39:17.774175 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 978/2106] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 18:39:14 2022] POST /compute/v2.1/servers/36d7eb4f-22bc-4047-bc75-6f69142daee5/action => generated 0 bytes in 3442 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 04 18:39:17.782509 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-422d8613-443b-41cd-8d9b-29be5f57f965 tempest-ServerAddressesTestJSON-638433160 tempest-ServerAddressesTestJSON-638433160-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:17.784029 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-422d8613-443b-41cd-8d9b-29be5f57f965 tempest-ServerAddressesTestJSON-638433160 tempest-ServerAddressesTestJSON-638433160-project] [instance: cdb73233-3522-4ddb-b7d4-463685e66bcc] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:17.797321 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-422d8613-443b-41cd-8d9b-29be5f57f965 tempest-ServerAddressesTestJSON-638433160 tempest-ServerAddressesTestJSON-638433160-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:17.799005 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-422d8613-443b-41cd-8d9b-29be5f57f965 tempest-ServerAddressesTestJSON-638433160 tempest-ServerAddressesTestJSON-638433160-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:17.799877 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-422d8613-443b-41cd-8d9b-29be5f57f965 tempest-ServerAddressesTestJSON-638433160 tempest-ServerAddressesTestJSON-638433160-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:17.800888 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-422d8613-443b-41cd-8d9b-29be5f57f965 tempest-ServerAddressesTestJSON-638433160 tempest-ServerAddressesTestJSON-638433160-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:17.801736 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-422d8613-443b-41cd-8d9b-29be5f57f965 tempest-ServerAddressesTestJSON-638433160 tempest-ServerAddressesTestJSON-638433160-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:17.802369 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-422d8613-443b-41cd-8d9b-29be5f57f965 tempest-ServerAddressesTestJSON-638433160 tempest-ServerAddressesTestJSON-638433160-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:17.836833 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:39:18.217779 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-422d8613-443b-41cd-8d9b-29be5f57f965 tempest-ServerAddressesTestJSON-638433160 tempest-ServerAddressesTestJSON-638433160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c41b6ddac731410085f447c3f687ef7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b241fded901d40fca9db5b5a4862a428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:18.232825 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-422d8613-443b-41cd-8d9b-29be5f57f965 tempest-ServerAddressesTestJSON-638433160 tempest-ServerAddressesTestJSON-638433160-project] 10.222.0.43 "GET /compute/v2.1/servers/cdb73233-3522-4ddb-b7d4-463685e66bcc" status: 200 len: 1316 microversion: 2.1 time: 0.455823 Oct 04 18:39:18.233579 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 979/2107] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:17 2022] GET /compute/v2.1/servers/cdb73233-3522-4ddb-b7d4-463685e66bcc => generated 1316 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:18.238034 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-ab1ecba0-82a2-4c0c-a8c3-a7282a2cc584 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Calling method '.version_select at 0x7fb21fc54c10>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:19.373948 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-ab1ecba0-82a2-4c0c-a8c3-a7282a2cc584 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] 10.222.0.43 "DELETE /compute/v2.1/os-security-groups/61d22f84-7693-4a39-940b-e055aab76027" status: 202 len: 0 microversion: 2.1 time: 1.139350 Oct 04 18:39:19.375324 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 980/2108] 10.222.0.43 () {58 vars in 1272 bytes} [Tue Oct 4 18:39:18 2022] DELETE /compute/v2.1/os-security-groups/61d22f84-7693-4a39-940b-e055aab76027 => generated 0 bytes in 1141 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:39:19.382967 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-053e32c8-0a2c-4bc5-a601-ca81962fad7d req-41acee1e-06fe-402d-9a04-2a89481ce8a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b7f1ede-48b3-48d8-933e-287c338b1e6a", "name": "network-vif-unplugged", "status": "completed", "tag": "462f1dea-cb2e-42da-a165-e6bc91610838"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:39:19.395254 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-053e32c8-0a2c-4bc5-a601-ca81962fad7d req-41acee1e-06fe-402d-9a04-2a89481ce8a1 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:19.396577 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-053e32c8-0a2c-4bc5-a601-ca81962fad7d req-41acee1e-06fe-402d-9a04-2a89481ce8a1 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:19.397142 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-053e32c8-0a2c-4bc5-a601-ca81962fad7d req-41acee1e-06fe-402d-9a04-2a89481ce8a1 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:19.424997 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-053e32c8-0a2c-4bc5-a601-ca81962fad7d req-41acee1e-06fe-402d-9a04-2a89481ce8a1 service nova] Creating event network-vif-unplugged:462f1dea-cb2e-42da-a165-e6bc91610838 for instance 0b7f1ede-48b3-48d8-933e-287c338b1e6a on n-h1-851028-13 Oct 04 18:39:19.438641 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-053e32c8-0a2c-4bc5-a601-ca81962fad7d req-41acee1e-06fe-402d-9a04-2a89481ce8a1 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.061750 Oct 04 18:39:19.441055 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 981/2109] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:39:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:39:19.447546 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-718edcb7-bd58-4b77-9ecd-8085270eea7f req-d5e15ca3-a21e-444d-a302-a49a0782f8e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36d7eb4f-22bc-4047-bc75-6f69142daee5", "tag": "e3d142e8-c4f2-49f8-af0d-f2e13e22b36f"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:39:19.460095 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-718edcb7-bd58-4b77-9ecd-8085270eea7f req-d5e15ca3-a21e-444d-a302-a49a0782f8e1 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:19.460887 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-718edcb7-bd58-4b77-9ecd-8085270eea7f req-d5e15ca3-a21e-444d-a302-a49a0782f8e1 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:19.463374 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-718edcb7-bd58-4b77-9ecd-8085270eea7f req-d5e15ca3-a21e-444d-a302-a49a0782f8e1 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:19.481395 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-718edcb7-bd58-4b77-9ecd-8085270eea7f req-d5e15ca3-a21e-444d-a302-a49a0782f8e1 service nova] Creating event network-changed:e3d142e8-c4f2-49f8-af0d-f2e13e22b36f for instance 36d7eb4f-22bc-4047-bc75-6f69142daee5 on n-h2-851028-13 Oct 04 18:39:19.487855 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-718edcb7-bd58-4b77-9ecd-8085270eea7f req-d5e15ca3-a21e-444d-a302-a49a0782f8e1 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045112 Oct 04 18:39:19.488561 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 982/2110] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:39:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:39:19.512169 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-34312b44-3e47-4f12-9f8b-8b508b265606 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:19.515177 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-34312b44-3e47-4f12-9f8b-8b508b265606 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: d9d4332a-97b6-40f1-bd7c-a9a75a9adc43] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:19.532650 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-34312b44-3e47-4f12-9f8b-8b508b265606 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:19.534031 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-34312b44-3e47-4f12-9f8b-8b508b265606 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:19.534660 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-34312b44-3e47-4f12-9f8b-8b508b265606 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:19.536527 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-34312b44-3e47-4f12-9f8b-8b508b265606 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:19.537328 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-34312b44-3e47-4f12-9f8b-8b508b265606 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:19.539460 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-34312b44-3e47-4f12-9f8b-8b508b265606 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:19.668215 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-a90f2838-23b7-4c0a-aa93-048e1da4c059 tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] 10.222.0.43 "POST /compute/v2.1/servers/d1f298aa-ebe3-4f52-ada6-137a782cd9b7/action" status: 202 len: 0 microversion: 2.25 time: 3.197960 Oct 04 18:39:19.669237 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1129/2111] 10.222.0.43 () {62 vars in 1319 bytes} [Tue Oct 4 18:39:16 2022] POST /compute/v2.1/servers/d1f298aa-ebe3-4f52-ada6-137a782cd9b7/action => generated 0 bytes in 3200 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:39:19.674597 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-67e9878f-4f84-455e-9263-525780f3feaa tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:19.675286 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-67e9878f-4f84-455e-9263-525780f3feaa tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] [instance: a4de9e6e-90d3-4317-abf8-9fc8f021b803] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:19.682543 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-67e9878f-4f84-455e-9263-525780f3feaa tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:19.683373 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-67e9878f-4f84-455e-9263-525780f3feaa tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:19.684093 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-67e9878f-4f84-455e-9263-525780f3feaa tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:19.684903 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-67e9878f-4f84-455e-9263-525780f3feaa tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:19.685908 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-67e9878f-4f84-455e-9263-525780f3feaa tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:19.686432 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-67e9878f-4f84-455e-9263-525780f3feaa tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:19.762706 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-67e9878f-4f84-455e-9263-525780f3feaa tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a19da94e9e646028a7f73f9d0e0edda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc41f296eb44503868205ec8aa2fef3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:19.774051 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-67e9878f-4f84-455e-9263-525780f3feaa tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] 10.222.0.43 "GET /compute/v2.1/servers/a4de9e6e-90d3-4317-abf8-9fc8f021b803" status: 200 len: 1279 microversion: 2.1 time: 0.103492 Oct 04 18:39:19.774646 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1130/2112] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:19 2022] GET /compute/v2.1/servers/a4de9e6e-90d3-4317-abf8-9fc8f021b803 => generated 1279 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:19.791507 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-66a2a482-8af7-4d75-b11a-e00f893fd731 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Calling method '.version_select at 0x7fb227de20d0>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:19.842162 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-34312b44-3e47-4f12-9f8b-8b508b265606 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:19.851864 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-66a2a482-8af7-4d75-b11a-e00f893fd731 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] 10.222.0.43 "GET /compute/v2.1/images/8b9606ad-88f3-4647-bc18-c5885add126b" status: 200 len: 1453 microversion: 2.1 time: 0.064446 Oct 04 18:39:19.852453 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1131/2113] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 18:39:19 2022] GET /compute/v2.1/images/8b9606ad-88f3-4647-bc18-c5885add126b => generated 1453 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:19.855771 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-34312b44-3e47-4f12-9f8b-8b508b265606 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/d9d4332a-97b6-40f1-bd7c-a9a75a9adc43" status: 200 len: 1528 microversion: 2.1 time: 0.364202 Oct 04 18:39:19.872864 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-3eb1fb84-1fbd-4d86-b6b5-c8bab431b4e3 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:19.874468 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-3eb1fb84-1fbd-4d86-b6b5-c8bab431b4e3 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] [instance: 237ee25f-85f0-46d4-8980-66c5bfe764ad] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:19.879929 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 983/2114] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:19 2022] GET /compute/v2.1/servers/d9d4332a-97b6-40f1-bd7c-a9a75a9adc43 => generated 1528 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:19.882960 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3eb1fb84-1fbd-4d86-b6b5-c8bab431b4e3 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:19.883924 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3eb1fb84-1fbd-4d86-b6b5-c8bab431b4e3 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:19.884976 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3eb1fb84-1fbd-4d86-b6b5-c8bab431b4e3 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:19.886042 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3eb1fb84-1fbd-4d86-b6b5-c8bab431b4e3 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:19.886784 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3eb1fb84-1fbd-4d86-b6b5-c8bab431b4e3 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:19.887609 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3eb1fb84-1fbd-4d86-b6b5-c8bab431b4e3 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:19.893097 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-555bf694-2a89-458b-be36-48724442d8b1 req-11221b4a-afd6-4d6c-8c69-d404f6477377 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cdb73233-3522-4ddb-b7d4-463685e66bcc", "tag": "4c38bca6-ef3f-4ba3-9bd9-54faa461803d"}, {"name": "network-changed", "server_uuid": "1a71ee0e-ffa8-4730-b4fb-8b6e9fd87239", "tag": "8da0ebc1-434a-4e48-b121-02b4d226123d"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:39:19.912269 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-555bf694-2a89-458b-be36-48724442d8b1 req-11221b4a-afd6-4d6c-8c69-d404f6477377 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:19.912873 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-555bf694-2a89-458b-be36-48724442d8b1 req-11221b4a-afd6-4d6c-8c69-d404f6477377 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:19.913459 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-555bf694-2a89-458b-be36-48724442d8b1 req-11221b4a-afd6-4d6c-8c69-d404f6477377 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:19.937487 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-555bf694-2a89-458b-be36-48724442d8b1 req-11221b4a-afd6-4d6c-8c69-d404f6477377 service nova] Creating event network-changed:4c38bca6-ef3f-4ba3-9bd9-54faa461803d for instance cdb73233-3522-4ddb-b7d4-463685e66bcc on n-h2-851028-13 Oct 04 18:39:19.938331 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-555bf694-2a89-458b-be36-48724442d8b1 req-11221b4a-afd6-4d6c-8c69-d404f6477377 service nova] Creating event network-changed:8da0ebc1-434a-4e48-b121-02b4d226123d for instance 1a71ee0e-ffa8-4730-b4fb-8b6e9fd87239 on n-h1-851028-13 Oct 04 18:39:19.943684 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3eb1fb84-1fbd-4d86-b6b5-c8bab431b4e3 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:19.944281 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3eb1fb84-1fbd-4d86-b6b5-c8bab431b4e3 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:19.944843 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3eb1fb84-1fbd-4d86-b6b5-c8bab431b4e3 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:19.945343 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.objects.instance [None req-3eb1fb84-1fbd-4d86-b6b5-c8bab431b4e3 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Lazy-loading 'fault' on Instance uuid 237ee25f-85f0-46d4-8980-66c5bfe764ad {{(pid=123596) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:39:19.951595 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-555bf694-2a89-458b-be36-48724442d8b1 req-11221b4a-afd6-4d6c-8c69-d404f6477377 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.068874 Oct 04 18:39:19.952573 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 984/2115] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:39:19 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:39:19.962133 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-3e713ed8-b520-498a-8950-b6f8403946b4 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.8.167"}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:39:19.964782 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-3e713ed8-b520-498a-8950-b6f8403946b4 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] [instance: 5d937ba2-60f4-40cf-9ed8-a4a86d458e38] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:19.972161 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3e713ed8-b520-498a-8950-b6f8403946b4 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:19.972945 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3e713ed8-b520-498a-8950-b6f8403946b4 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:19.973591 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3e713ed8-b520-498a-8950-b6f8403946b4 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:19.974493 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3e713ed8-b520-498a-8950-b6f8403946b4 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:19.974997 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3e713ed8-b520-498a-8950-b6f8403946b4 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:19.975512 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3e713ed8-b520-498a-8950-b6f8403946b4 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:19.999447 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-3eb1fb84-1fbd-4d86-b6b5-c8bab431b4e3 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6daea1f7b0084009ac6e24181a1b87d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f3ca2b15fd24916ac47e08325464d75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:20.005277 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3e713ed8-b520-498a-8950-b6f8403946b4 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Acquiring lock "refresh_cache-5d937ba2-60f4-40cf-9ed8-a4a86d458e38" {{(pid=123595) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 04 18:39:20.005667 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3e713ed8-b520-498a-8950-b6f8403946b4 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Acquired lock "refresh_cache-5d937ba2-60f4-40cf-9ed8-a4a86d458e38" {{(pid=123595) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 04 18:39:20.008351 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-3eb1fb84-1fbd-4d86-b6b5-c8bab431b4e3 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] 10.222.0.43 "GET /compute/v2.1/servers/237ee25f-85f0-46d4-8980-66c5bfe764ad" status: 200 len: 1302 microversion: 2.1 time: 0.153600 Oct 04 18:39:20.013665 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1132/2116] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:19 2022] GET /compute/v2.1/servers/237ee25f-85f0-46d4-8980-66c5bfe764ad => generated 1302 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:20.014803 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f357d1f9-86b2-4dca-ae5b-db711a2bac2f tempest-ServerAddressesTestJSON-638433160 tempest-ServerAddressesTestJSON-638433160-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:20.015511 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-f357d1f9-86b2-4dca-ae5b-db711a2bac2f tempest-ServerAddressesTestJSON-638433160 tempest-ServerAddressesTestJSON-638433160-project] [instance: cdb73233-3522-4ddb-b7d4-463685e66bcc] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:20.021887 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f357d1f9-86b2-4dca-ae5b-db711a2bac2f tempest-ServerAddressesTestJSON-638433160 tempest-ServerAddressesTestJSON-638433160-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:20.022469 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f357d1f9-86b2-4dca-ae5b-db711a2bac2f tempest-ServerAddressesTestJSON-638433160 tempest-ServerAddressesTestJSON-638433160-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:20.023038 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f357d1f9-86b2-4dca-ae5b-db711a2bac2f tempest-ServerAddressesTestJSON-638433160 tempest-ServerAddressesTestJSON-638433160-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:20.023911 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f357d1f9-86b2-4dca-ae5b-db711a2bac2f tempest-ServerAddressesTestJSON-638433160 tempest-ServerAddressesTestJSON-638433160-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:20.024413 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f357d1f9-86b2-4dca-ae5b-db711a2bac2f tempest-ServerAddressesTestJSON-638433160 tempest-ServerAddressesTestJSON-638433160-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:20.024963 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f357d1f9-86b2-4dca-ae5b-db711a2bac2f tempest-ServerAddressesTestJSON-638433160 tempest-ServerAddressesTestJSON-638433160-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:20.173297 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-f357d1f9-86b2-4dca-ae5b-db711a2bac2f tempest-ServerAddressesTestJSON-638433160 tempest-ServerAddressesTestJSON-638433160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c41b6ddac731410085f447c3f687ef7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b241fded901d40fca9db5b5a4862a428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:20.182782 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-f357d1f9-86b2-4dca-ae5b-db711a2bac2f tempest-ServerAddressesTestJSON-638433160 tempest-ServerAddressesTestJSON-638433160-project] 10.222.0.43 "GET /compute/v2.1/servers/cdb73233-3522-4ddb-b7d4-463685e66bcc" status: 200 len: 1316 microversion: 2.1 time: 0.172060 Oct 04 18:39:20.183651 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1133/2117] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:20 2022] GET /compute/v2.1/servers/cdb73233-3522-4ddb-b7d4-463685e66bcc => generated 1316 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:20.191427 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-195942db-3798-4697-84ea-9bb6bf129952 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Calling method '.version_select at 0x7fb22410baf0>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:20.219991 n-d-851028-13 devstack@n-api.service[123596]: DEBUG neutronclient.v2_0.client [None req-195942db-3798-4697-84ea-9bb6bf129952 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 61d22f84-7693-4a39-940b-e055aab76027 does not exist", "detail": ""}} {{(pid=123596) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 18:39:20.220474 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.network.security_group_api [None req-195942db-3798-4697-84ea-9bb6bf129952 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Neutron security group 61d22f84-7693-4a39-940b-e055aab76027 not found {{(pid=123596) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 04 18:39:20.221014 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-195942db-3798-4697-84ea-9bb6bf129952 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] HTTP exception thrown: Security group 61d22f84-7693-4a39-940b-e055aab76027 does not exist Oct 04 18:39:20.221014 n-d-851028-13 devstack@n-api.service[123596]: Neutron server returns request_ids: ['req-fd78adca-4bec-450e-af8e-684d6287e56d'] Oct 04 18:39:20.224018 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-195942db-3798-4697-84ea-9bb6bf129952 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Request method failure captured: Oct 04 18:39:20.224018 n-d-851028-13 devstack@n-api.service[123596]: request: GET /compute/v2.1/os-security-groups/61d22f84-7693-4a39-940b-e055aab76027 HTTP/1.1 Oct 04 18:39:20.224018 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:39:20.224018 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:39:20.224018 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:39:20.224018 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 18:39:20.224018 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:39:20.224018 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:39:20.224018 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:39:20.224018 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:39:20.224018 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPH2qE2WsiZvVd-vvN1M8uHJG40fIXDT1XURP-P4ciVfKnbP_2tplzYndj2wlvB6bSu_VMaD1xfU0nGHRYWQRmNIt_krh_S1n2RkrhietTC0-RnvJ1rzF8ilPx8zowbVefo7A8IyDn5QTaMC08kHUNyiYinJQT_Q7n9enahWrBitVOPM Oct 04 18:39:20.224018 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:39:20.224018 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:39:20.224018 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:39:20.224018 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:39:20.224018 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:39:20.224018 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:39:20.224018 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: 7b812c85494a49898376a0dd8140f03c Oct 04 18:39:20.224018 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-SecurityGroupsTestJSON-209295605 Oct 04 18:39:20.224018 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 18:39:20.224018 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 18:39:20.224018 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/7b812c85494a49898376a0dd8140f03c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_7b812c85494a49898376a0dd8140f03c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/7b812c85494a49898376a0dd8140f03c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/7b812c85494a49898376a0dd8140f03c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:39:20.224018 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-SecurityGroupsTestJSON-209295605 Oct 04 18:39:20.224018 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: 7b812c85494a49898376a0dd8140f03c Oct 04 18:39:20.224018 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-209295605 Oct 04 18:39:20.224018 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-SecurityGroupsTestJSON-209295605-project Oct 04 18:39:20.224018 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:39:20.224018 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:39:20.224018 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 5c96ec8b8e0a4053b0457f213e6e262d Oct 04 18:39:20.224018 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-SecurityGroupsTestJSON-209295605-project Oct 04 18:39:20.224018 n-d-851028-13 devstack@n-api.service[123596]: method: Oct 04 18:39:20.224018 n-d-851028-13 devstack@n-api.service[123596]: exception: Security group 61d22f84-7693-4a39-940b-e055aab76027 does not exist Oct 04 18:39:20.224018 n-d-851028-13 devstack@n-api.service[123596]: Neutron server returns request_ids: ['req-fd78adca-4bec-450e-af8e-684d6287e56d'] Oct 04 18:39:20.224018 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': '61d22f84-7693-4a39-940b-e055aab76027'} Oct 04 18:39:20.224018 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:39:20.224018 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:39:20.224018 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 04 18:39:20.224018 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 04 18:39:20.224018 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:39:20.224018 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:39:20.224018 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 04 18:39:20.224018 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 04 18:39:20.224018 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:39:20.224018 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:39:20.224018 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 18:39:20.224018 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 18:39:20.224018 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:39:20.224018 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:39:20.224018 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 18:39:20.224018 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 18:39:20.224018 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:39:20.224018 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:39:20.224018 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 18:39:20.224018 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 18:39:20.224018 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:39:20.224018 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:39:20.224018 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 18:39:20.224018 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 18:39:20.224018 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 18:39:20.224018 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 18:39:20.224018 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 61d22f84-7693-4a39-940b-e055aab76027 does not exist Oct 04 18:39:20.235583 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fd78adca-4bec-450e-af8e-684d6287e56d'] Oct 04 18:39:20.235583 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:39:20.235583 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:39:20.235583 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:39:20.235583 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:39:20.235583 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 04 18:39:20.235583 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 04 18:39:20.235583 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 04 18:39:20.235583 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 18:39:20.235583 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 61d22f84-7693-4a39-940b-e055aab76027 does not exist Oct 04 18:39:20.235583 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fd78adca-4bec-450e-af8e-684d6287e56d'] Oct 04 18:39:20.235583 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:39:20.235583 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:39:20.235583 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:39:20.235583 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:39:20.235583 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:39:20.235583 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:39:20.235583 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:39:20.235583 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:39:20.235583 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:39:20.235583 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:39:20.235583 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:39:20.235583 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:39:20.235583 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 04 18:39:20.235583 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 04 18:39:20.235583 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 61d22f84-7693-4a39-940b-e055aab76027 does not exist Oct 04 18:39:20.235583 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fd78adca-4bec-450e-af8e-684d6287e56d'] Oct 04 18:39:20.235583 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:39:20.235583 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:39:20.235583 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:39:20.235583 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:39:20.235583 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:39:20.235583 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:39:20.235583 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:39:20.235583 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:39:20.235583 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 61d22f84-7693-4a39-940b-e055aab76027 does not exist Oct 04 18:39:20.235583 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fd78adca-4bec-450e-af8e-684d6287e56d'] Oct 04 18:39:20.235583 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:39:20.235583 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-195942db-3798-4697-84ea-9bb6bf129952 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Returning 404 to user: Security group 61d22f84-7693-4a39-940b-e055aab76027 does not exist Oct 04 18:39:20.235583 n-d-851028-13 devstack@n-api.service[123596]: Neutron server returns request_ids: ['req-fd78adca-4bec-450e-af8e-684d6287e56d'] {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:39:20.235583 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-195942db-3798-4697-84ea-9bb6bf129952 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] 10.222.0.43 "GET /compute/v2.1/os-security-groups/61d22f84-7693-4a39-940b-e055aab76027" status: 404 len: 194 microversion: 2.1 time: 0.040661 Oct 04 18:39:20.235583 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1134/2118] 10.222.0.43 () {58 vars in 1269 bytes} [Tue Oct 4 18:39:20 2022] GET /compute/v2.1/os-security-groups/61d22f84-7693-4a39-940b-e055aab76027 => generated 194 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:39:20.235583 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-002d45c7-4eb3-4360-a466-a72ece100409 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:20.235583 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-002d45c7-4eb3-4360-a466-a72ece100409 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] [instance: d1f298aa-ebe3-4f52-ada6-137a782cd9b7] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:20.242119 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-002d45c7-4eb3-4360-a466-a72ece100409 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:20.242119 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-002d45c7-4eb3-4360-a466-a72ece100409 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:20.242119 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-002d45c7-4eb3-4360-a466-a72ece100409 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:20.242119 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-002d45c7-4eb3-4360-a466-a72ece100409 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:20.242526 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-002d45c7-4eb3-4360-a466-a72ece100409 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:20.242835 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-002d45c7-4eb3-4360-a466-a72ece100409 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:20.386071 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-002d45c7-4eb3-4360-a466-a72ece100409 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:20.395450 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-002d45c7-4eb3-4360-a466-a72ece100409 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:20.396946 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-002d45c7-4eb3-4360-a466-a72ece100409 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:20.398148 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-002d45c7-4eb3-4360-a466-a72ece100409 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] 10.222.0.43 "GET /compute/v2.1/servers/d1f298aa-ebe3-4f52-ada6-137a782cd9b7" status: 200 len: 1486 microversion: 2.25 time: 0.170560 Oct 04 18:39:20.398979 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1135/2119] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:39:20 2022] GET /compute/v2.1/servers/d1f298aa-ebe3-4f52-ada6-137a782cd9b7 => generated 1486 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:39:20.403758 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-ee1dea82-5bee-429b-9bf2-ea0a35bdbbd0 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:20.404372 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-ee1dea82-5bee-429b-9bf2-ea0a35bdbbd0 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: d9d4332a-97b6-40f1-bd7c-a9a75a9adc43] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:20.410576 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ee1dea82-5bee-429b-9bf2-ea0a35bdbbd0 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:20.411067 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ee1dea82-5bee-429b-9bf2-ea0a35bdbbd0 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:20.411507 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ee1dea82-5bee-429b-9bf2-ea0a35bdbbd0 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:20.412276 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ee1dea82-5bee-429b-9bf2-ea0a35bdbbd0 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:20.412730 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ee1dea82-5bee-429b-9bf2-ea0a35bdbbd0 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:20.413296 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ee1dea82-5bee-429b-9bf2-ea0a35bdbbd0 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:20.565413 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-ee1dea82-5bee-429b-9bf2-ea0a35bdbbd0 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:20.574532 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-ee1dea82-5bee-429b-9bf2-ea0a35bdbbd0 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/d9d4332a-97b6-40f1-bd7c-a9a75a9adc43" status: 200 len: 1528 microversion: 2.1 time: 0.174682 Oct 04 18:39:20.575113 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1136/2120] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:20 2022] GET /compute/v2.1/servers/d9d4332a-97b6-40f1-bd7c-a9a75a9adc43 => generated 1528 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:20.590754 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-ae2fb025-fb8b-4242-a22f-12c972f786f3 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Action: 'create', calling method: .version_select at 0x7fb227e82700>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1983641964", "description": "tempest-description-2068777697"}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:39:20.940732 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-ae2fb025-fb8b-4242-a22f-12c972f786f3 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] 10.222.0.43 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.354060 Oct 04 18:39:20.943308 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1137/2121] 10.222.0.43 () {60 vars in 1180 bytes} [Tue Oct 4 18:39:20 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:39:20.953996 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-1b38ade0-8d81-43c5-9621-d2228f97f303 tempest-MigrationsAdminTest-1571334602 tempest-MigrationsAdminTest-1571334602-project-admin] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:21.019929 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-1b38ade0-8d81-43c5-9621-d2228f97f303 tempest-MigrationsAdminTest-1571334602 tempest-MigrationsAdminTest-1571334602-project-admin] 10.222.0.43 "DELETE /compute/v2.1/flavors/1d83032c-1fb1-416a-868c-1915f092c006" status: 202 len: 0 microversion: 2.1 time: 0.075321 Oct 04 18:39:21.021644 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1138/2122] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 18:39:20 2022] DELETE /compute/v2.1/flavors/1d83032c-1fb1-416a-868c-1915f092c006 => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:39:21.027915 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-4944ea52-2dc6-4589-8f0e-00dd3ffc40f5 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:21.029140 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-4944ea52-2dc6-4589-8f0e-00dd3ffc40f5 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] [instance: a4de9e6e-90d3-4317-abf8-9fc8f021b803] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:21.038579 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4944ea52-2dc6-4589-8f0e-00dd3ffc40f5 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:21.039511 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4944ea52-2dc6-4589-8f0e-00dd3ffc40f5 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:21.040418 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4944ea52-2dc6-4589-8f0e-00dd3ffc40f5 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:21.041451 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4944ea52-2dc6-4589-8f0e-00dd3ffc40f5 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:21.042499 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4944ea52-2dc6-4589-8f0e-00dd3ffc40f5 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:21.043367 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4944ea52-2dc6-4589-8f0e-00dd3ffc40f5 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:21.334888 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-4944ea52-2dc6-4589-8f0e-00dd3ffc40f5 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a19da94e9e646028a7f73f9d0e0edda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc41f296eb44503868205ec8aa2fef3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:21.353584 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-4944ea52-2dc6-4589-8f0e-00dd3ffc40f5 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] 10.222.0.43 "GET /compute/v2.1/servers/a4de9e6e-90d3-4317-abf8-9fc8f021b803" status: 200 len: 1321 microversion: 2.1 time: 0.330595 Oct 04 18:39:21.358148 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1139/2123] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:21 2022] GET /compute/v2.1/servers/a4de9e6e-90d3-4317-abf8-9fc8f021b803 => generated 1321 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:21.368096 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-821f503e-5f3e-4959-a056-38bf7062229a tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Calling method '.version_select at 0x7fb21fccbdc0>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:21.427174 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-821f503e-5f3e-4959-a056-38bf7062229a tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] 10.222.0.43 "GET /compute/v2.1/images/8b9606ad-88f3-4647-bc18-c5885add126b" status: 200 len: 1453 microversion: 2.1 time: 0.067466 Oct 04 18:39:21.436547 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1140/2124] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 18:39:21 2022] GET /compute/v2.1/images/8b9606ad-88f3-4647-bc18-c5885add126b => generated 1453 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:21.445545 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-47255d5f-3d29-4ced-b763-91123322a862 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Action: 'create', calling method: .version_select at 0x7fb227d590d0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-587545016", "description": "tempest-description-359171159"}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:39:21.540116 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=6 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:39:21.572427 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=20 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:39:21.912590 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-47255d5f-3d29-4ced-b763-91123322a862 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] 10.222.0.43 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.478112 Oct 04 18:39:21.914036 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1141/2125] 10.222.0.43 () {60 vars in 1180 bytes} [Tue Oct 4 18:39:21 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:39:21.928605 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-48fc4029-bd7c-4399-89af-8db22388e1eb tempest-MigrationsAdminTest-1571334602 tempest-MigrationsAdminTest-1571334602-project-admin] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:21.964655 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-48fc4029-bd7c-4399-89af-8db22388e1eb tempest-MigrationsAdminTest-1571334602 tempest-MigrationsAdminTest-1571334602-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.048764 Oct 04 18:39:21.970271 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1142/2126] 10.222.0.43 () {58 vars in 1146 bytes} [Tue Oct 4 18:39:21 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:21.977907 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-30e4e876-a020-4367-ac08-4c8dcc7f8948 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:21.983922 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-30e4e876-a020-4367-ac08-4c8dcc7f8948 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] [instance: 237ee25f-85f0-46d4-8980-66c5bfe764ad] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:21.995495 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-30e4e876-a020-4367-ac08-4c8dcc7f8948 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:21.996355 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-30e4e876-a020-4367-ac08-4c8dcc7f8948 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:21.996981 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-30e4e876-a020-4367-ac08-4c8dcc7f8948 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:21.998542 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-30e4e876-a020-4367-ac08-4c8dcc7f8948 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:21.999610 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-30e4e876-a020-4367-ac08-4c8dcc7f8948 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:22.000325 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-30e4e876-a020-4367-ac08-4c8dcc7f8948 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:22.017537 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:39:22.019998 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-30e4e876-a020-4367-ac08-4c8dcc7f8948 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] HTTP exception thrown: Instance 237ee25f-85f0-46d4-8980-66c5bfe764ad could not be found. Oct 04 18:39:22.022224 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-30e4e876-a020-4367-ac08-4c8dcc7f8948 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Request method failure captured: Oct 04 18:39:22.022224 n-d-851028-13 devstack@n-api.service[123596]: request: GET /compute/v2.1/servers/237ee25f-85f0-46d4-8980-66c5bfe764ad HTTP/1.1 Oct 04 18:39:22.022224 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:39:22.022224 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:39:22.022224 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:39:22.022224 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 18:39:22.022224 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:39:22.022224 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:39:22.022224 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:39:22.022224 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:39:22.022224 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPH2pqQ0-ZftMLab_pzPrqYEgZyfWcNNZZ1BfK5sXjpIskjK9jjdNDn_UudxFMb5ZcEy61GPWPH4a7gB9mo5mh0kFvFHo_V08s4IpywIPUo-1KDJ9SZBo9z7bbYA6uENOWn04GexKLpQqRv7pcCQ-as1ctVZG5RYS36fAnubqzgfikxI Oct 04 18:39:22.022224 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:39:22.022224 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:39:22.022224 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:39:22.022224 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:39:22.022224 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:39:22.022224 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:39:22.022224 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: 5f3ca2b15fd24916ac47e08325464d75 Oct 04 18:39:22.022224 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-ServerGroupTestJSON-1457133461 Oct 04 18:39:22.022224 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 18:39:22.022224 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 18:39:22.022224 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/5f3ca2b15fd24916ac47e08325464d75"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_5f3ca2b15fd24916ac47e08325464d75"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5f3ca2b15fd24916ac47e08325464d75"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5f3ca2b15fd24916ac47e08325464d75"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:39:22.022224 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-ServerGroupTestJSON-1457133461 Oct 04 18:39:22.022224 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: 5f3ca2b15fd24916ac47e08325464d75 Oct 04 18:39:22.022224 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-ServerGroupTestJSON-1457133461 Oct 04 18:39:22.022224 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-ServerGroupTestJSON-1457133461-project Oct 04 18:39:22.022224 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:39:22.022224 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:39:22.022224 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 6daea1f7b0084009ac6e24181a1b87d7 Oct 04 18:39:22.022224 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-ServerGroupTestJSON-1457133461-project Oct 04 18:39:22.022224 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 18:39:22.022224 n-d-851028-13 devstack@n-api.service[123596]: exception: Instance 237ee25f-85f0-46d4-8980-66c5bfe764ad could not be found. Oct 04 18:39:22.022224 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': '237ee25f-85f0-46d4-8980-66c5bfe764ad'} Oct 04 18:39:22.022224 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:39:22.022224 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:39:22.022224 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:39:22.022224 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:39:22.022224 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:39:22.022224 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:39:22.022224 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:39:22.022224 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:39:22.022224 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:39:22.022224 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:39:22.022224 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 237ee25f-85f0-46d4-8980-66c5bfe764ad could not be found. Oct 04 18:39:22.022224 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:39:22.022224 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:39:22.022224 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:39:22.022224 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:39:22.022224 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:39:22.022224 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:39:22.022224 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:39:22.022224 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:39:22.022224 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:39:22.022224 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:39:22.022224 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:39:22.022224 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:39:22.022224 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:39:22.022224 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:39:22.022224 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:39:22.022224 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:39:22.022224 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 237ee25f-85f0-46d4-8980-66c5bfe764ad could not be found. Oct 04 18:39:22.022224 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:39:22.022224 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:39:22.022224 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:39:22.028500 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:39:22.028500 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:39:22.028500 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:39:22.028500 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:39:22.028500 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:39:22.028500 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 237ee25f-85f0-46d4-8980-66c5bfe764ad could not be found. Oct 04 18:39:22.028500 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:39:22.032877 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-30e4e876-a020-4367-ac08-4c8dcc7f8948 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Returning 404 to user: Instance 237ee25f-85f0-46d4-8980-66c5bfe764ad could not be found. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:39:22.034191 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-30e4e876-a020-4367-ac08-4c8dcc7f8948 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] 10.222.0.43 "GET /compute/v2.1/servers/237ee25f-85f0-46d4-8980-66c5bfe764ad" status: 404 len: 111 microversion: 2.1 time: 0.062155 Oct 04 18:39:22.035263 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1143/2127] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:21 2022] GET /compute/v2.1/servers/237ee25f-85f0-46d4-8980-66c5bfe764ad => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:39:22.057350 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-2be1f31d-9a54-45e1-a9fe-3c7dfbdbf8a4 tempest-ServerAddressesTestJSON-638433160 tempest-ServerAddressesTestJSON-638433160-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:22.058303 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-2be1f31d-9a54-45e1-a9fe-3c7dfbdbf8a4 tempest-ServerAddressesTestJSON-638433160 tempest-ServerAddressesTestJSON-638433160-project] [instance: cdb73233-3522-4ddb-b7d4-463685e66bcc] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:22.086378 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2be1f31d-9a54-45e1-a9fe-3c7dfbdbf8a4 tempest-ServerAddressesTestJSON-638433160 tempest-ServerAddressesTestJSON-638433160-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:22.087576 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2be1f31d-9a54-45e1-a9fe-3c7dfbdbf8a4 tempest-ServerAddressesTestJSON-638433160 tempest-ServerAddressesTestJSON-638433160-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:22.088254 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2be1f31d-9a54-45e1-a9fe-3c7dfbdbf8a4 tempest-ServerAddressesTestJSON-638433160 tempest-ServerAddressesTestJSON-638433160-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:22.089214 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2be1f31d-9a54-45e1-a9fe-3c7dfbdbf8a4 tempest-ServerAddressesTestJSON-638433160 tempest-ServerAddressesTestJSON-638433160-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:22.089962 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2be1f31d-9a54-45e1-a9fe-3c7dfbdbf8a4 tempest-ServerAddressesTestJSON-638433160 tempest-ServerAddressesTestJSON-638433160-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:22.090643 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2be1f31d-9a54-45e1-a9fe-3c7dfbdbf8a4 tempest-ServerAddressesTestJSON-638433160 tempest-ServerAddressesTestJSON-638433160-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:22.332857 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-2be1f31d-9a54-45e1-a9fe-3c7dfbdbf8a4 tempest-ServerAddressesTestJSON-638433160 tempest-ServerAddressesTestJSON-638433160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c41b6ddac731410085f447c3f687ef7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b241fded901d40fca9db5b5a4862a428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:22.357933 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-2be1f31d-9a54-45e1-a9fe-3c7dfbdbf8a4 tempest-ServerAddressesTestJSON-638433160 tempest-ServerAddressesTestJSON-638433160-project] 10.222.0.43 "GET /compute/v2.1/servers/cdb73233-3522-4ddb-b7d4-463685e66bcc" status: 200 len: 1316 microversion: 2.1 time: 0.319703 Oct 04 18:39:22.359354 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1144/2128] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:22 2022] GET /compute/v2.1/servers/cdb73233-3522-4ddb-b7d4-463685e66bcc => generated 1316 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:22.366938 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-67949252-d4c4-424a-bd47-76e8e2c7164a tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:22.367568 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-67949252-d4c4-424a-bd47-76e8e2c7164a tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] [instance: d1f298aa-ebe3-4f52-ada6-137a782cd9b7] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:22.390497 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-67949252-d4c4-424a-bd47-76e8e2c7164a tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:22.395237 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-67949252-d4c4-424a-bd47-76e8e2c7164a tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:22.395718 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-67949252-d4c4-424a-bd47-76e8e2c7164a tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:22.396480 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-67949252-d4c4-424a-bd47-76e8e2c7164a tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:22.397633 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-67949252-d4c4-424a-bd47-76e8e2c7164a tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:22.398820 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-67949252-d4c4-424a-bd47-76e8e2c7164a tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:22.584140 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-67949252-d4c4-424a-bd47-76e8e2c7164a tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:22.596790 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-67949252-d4c4-424a-bd47-76e8e2c7164a tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:22.599054 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-67949252-d4c4-424a-bd47-76e8e2c7164a tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:22.600823 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-67949252-d4c4-424a-bd47-76e8e2c7164a tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] 10.222.0.43 "GET /compute/v2.1/servers/d1f298aa-ebe3-4f52-ada6-137a782cd9b7" status: 200 len: 1486 microversion: 2.25 time: 0.240180 Oct 04 18:39:22.613133 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1145/2129] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:39:22 2022] GET /compute/v2.1/servers/d1f298aa-ebe3-4f52-ada6-137a782cd9b7 => generated 1486 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:39:22.613133 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-9809b0cc-1006-400a-8c22-4cad1baafd22 req-33cec922-dad2-4453-b4d1-1ada85ba58f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6eb9c803-dd97-4af5-b0d0-aa6fc18f8a89", "name": "network-vif-plugged", "status": "completed", "tag": "32bec9cb-4066-4472-bb00-a407392e684f"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:39:22.623399 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-9809b0cc-1006-400a-8c22-4cad1baafd22 req-33cec922-dad2-4453-b4d1-1ada85ba58f5 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:22.623399 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-9809b0cc-1006-400a-8c22-4cad1baafd22 req-33cec922-dad2-4453-b4d1-1ada85ba58f5 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:22.623399 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-9809b0cc-1006-400a-8c22-4cad1baafd22 req-33cec922-dad2-4453-b4d1-1ada85ba58f5 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:22.639654 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-9809b0cc-1006-400a-8c22-4cad1baafd22 req-33cec922-dad2-4453-b4d1-1ada85ba58f5 service nova] Creating event network-vif-plugged:32bec9cb-4066-4472-bb00-a407392e684f for instance 6eb9c803-dd97-4af5-b0d0-aa6fc18f8a89 on n-h1-851028-13 Oct 04 18:39:22.649369 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-9809b0cc-1006-400a-8c22-4cad1baafd22 req-33cec922-dad2-4453-b4d1-1ada85ba58f5 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045644 Oct 04 18:39:22.650808 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1146/2130] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:39:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:39:22.656621 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-dea3a454-adb2-4acf-8310-2f3d56ccabe6 req-212c2187-74c8-4ce9-8e95-c74aef4bacc8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d365b7e-b516-4ae9-a1cd-7502e9d71041", "tag": "17040db4-9498-45bc-b84d-5459ad9740f2"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:39:22.668777 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-dea3a454-adb2-4acf-8310-2f3d56ccabe6 req-212c2187-74c8-4ce9-8e95-c74aef4bacc8 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:22.669444 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-dea3a454-adb2-4acf-8310-2f3d56ccabe6 req-212c2187-74c8-4ce9-8e95-c74aef4bacc8 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:22.669987 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-dea3a454-adb2-4acf-8310-2f3d56ccabe6 req-212c2187-74c8-4ce9-8e95-c74aef4bacc8 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:22.683309 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-dea3a454-adb2-4acf-8310-2f3d56ccabe6 req-212c2187-74c8-4ce9-8e95-c74aef4bacc8 service nova] Creating event network-changed:17040db4-9498-45bc-b84d-5459ad9740f2 for instance 5d365b7e-b516-4ae9-a1cd-7502e9d71041 on n-h2-851028-13 Oct 04 18:39:22.689466 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-dea3a454-adb2-4acf-8310-2f3d56ccabe6 req-212c2187-74c8-4ce9-8e95-c74aef4bacc8 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037102 Oct 04 18:39:22.690225 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1147/2131] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:39:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:39:22.696657 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-eac4dbc6-0b6a-46bc-87d9-fea6d958cc6a tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Action: 'create', calling method: .version_select at 0x7fb227d598b0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-2079577890", "description": "tempest-description-10121719"}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:39:23.173806 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-eac4dbc6-0b6a-46bc-87d9-fea6d958cc6a tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] 10.222.0.43 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.481814 Oct 04 18:39:23.175193 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1148/2132] 10.222.0.43 () {60 vars in 1180 bytes} [Tue Oct 4 18:39:22 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:39:23.182278 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-9f76c76c-39bd-47a7-b176-43a32102aded tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:39:23.185789 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-9f76c76c-39bd-47a7-b176-43a32102aded tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: d9d4332a-97b6-40f1-bd7c-a9a75a9adc43] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:23.210537 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9f76c76c-39bd-47a7-b176-43a32102aded tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:23.211380 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9f76c76c-39bd-47a7-b176-43a32102aded tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:23.212005 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9f76c76c-39bd-47a7-b176-43a32102aded tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:23.212926 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9f76c76c-39bd-47a7-b176-43a32102aded tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:23.213577 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9f76c76c-39bd-47a7-b176-43a32102aded tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:23.214177 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9f76c76c-39bd-47a7-b176-43a32102aded tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:23.274962 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-9f76c76c-39bd-47a7-b176-43a32102aded tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:23.295999 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-9f76c76c-39bd-47a7-b176-43a32102aded tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: d9d4332a-97b6-40f1-bd7c-a9a75a9adc43] Old instance type tempest-test_resize_flavor_-236060779, new instance type m1.heat {{(pid=123596) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 04 18:39:23.305583 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-9f76c76c-39bd-47a7-b176-43a32102aded tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Flavor limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:39:23.306005 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-9f76c76c-39bd-47a7-b176-43a32102aded tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Image limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:39:23.306481 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-9f76c76c-39bd-47a7-b176-43a32102aded tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Flavor pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:39:23.306890 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-9f76c76c-39bd-47a7-b176-43a32102aded tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Image pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:39:23.307297 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-9f76c76c-39bd-47a7-b176-43a32102aded tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:39:23.471139 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-9f76c76c-39bd-47a7-b176-43a32102aded tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "POST /compute/v2.1/servers/d9d4332a-97b6-40f1-bd7c-a9a75a9adc43/action" status: 202 len: 0 microversion: 2.1 time: 0.292813 Oct 04 18:39:23.471991 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1149/2133] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 18:39:23 2022] POST /compute/v2.1/servers/d9d4332a-97b6-40f1-bd7c-a9a75a9adc43/action => generated 0 bytes in 296 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:39:23.483842 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-145be331-362c-41f1-a386-44520b199407 req-b97f6e93-6e1a-490e-8ab0-bfb19cb88217 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "237ee25f-85f0-46d4-8980-66c5bfe764ad", "name": "network-vif-deleted", "tag": "9dcfd052-bd8d-45aa-915c-a8e3f094bca0"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:39:23.510857 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-145be331-362c-41f1-a386-44520b199407 req-b97f6e93-6e1a-490e-8ab0-bfb19cb88217 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:23.511466 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-145be331-362c-41f1-a386-44520b199407 req-b97f6e93-6e1a-490e-8ab0-bfb19cb88217 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:23.511926 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-145be331-362c-41f1-a386-44520b199407 req-b97f6e93-6e1a-490e-8ab0-bfb19cb88217 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:23.533826 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-145be331-362c-41f1-a386-44520b199407 req-b97f6e93-6e1a-490e-8ab0-bfb19cb88217 service nova] Creating event network-vif-deleted:9dcfd052-bd8d-45aa-915c-a8e3f094bca0 for instance 237ee25f-85f0-46d4-8980-66c5bfe764ad on n-h2-851028-13 Oct 04 18:39:23.551260 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-145be331-362c-41f1-a386-44520b199407 req-b97f6e93-6e1a-490e-8ab0-bfb19cb88217 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074325 Oct 04 18:39:23.552444 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1150/2134] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:39:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:39:23.560946 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-152b5a31-476e-4ded-9449-021f45cd4399 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:23.595230 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.compute.server_groups [None req-152b5a31-476e-4ded-9449-021f45cd4399 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Querying cell 66287c68-6a08-453f-953b-bd2446fe0d25(cell1) for 1 instances {{(pid=123596) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 04 18:39:23.595957 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-152b5a31-476e-4ded-9449-021f45cd4399 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:23.596438 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-152b5a31-476e-4ded-9449-021f45cd4399 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:23.596873 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-152b5a31-476e-4ded-9449-021f45cd4399 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:23.622695 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-152b5a31-476e-4ded-9449-021f45cd4399 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] 10.222.0.43 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.068684 Oct 04 18:39:23.633564 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1151/2135] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Oct 4 18:39:23 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:39:23.646714 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f1cd14a7-69fd-4a97-8cb1-8d158c5649df tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:23.647364 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-f1cd14a7-69fd-4a97-8cb1-8d158c5649df tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] [instance: a4de9e6e-90d3-4317-abf8-9fc8f021b803] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:23.658792 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f1cd14a7-69fd-4a97-8cb1-8d158c5649df tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:23.659304 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f1cd14a7-69fd-4a97-8cb1-8d158c5649df tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:23.659734 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f1cd14a7-69fd-4a97-8cb1-8d158c5649df tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:23.660446 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f1cd14a7-69fd-4a97-8cb1-8d158c5649df tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:23.661263 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f1cd14a7-69fd-4a97-8cb1-8d158c5649df tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:23.664146 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f1cd14a7-69fd-4a97-8cb1-8d158c5649df tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:23.913394 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-f1cd14a7-69fd-4a97-8cb1-8d158c5649df tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a19da94e9e646028a7f73f9d0e0edda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc41f296eb44503868205ec8aa2fef3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:23.924674 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-f1cd14a7-69fd-4a97-8cb1-8d158c5649df tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] 10.222.0.43 "GET /compute/v2.1/servers/a4de9e6e-90d3-4317-abf8-9fc8f021b803" status: 200 len: 1321 microversion: 2.1 time: 0.282063 Oct 04 18:39:23.938173 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1152/2136] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:23 2022] GET /compute/v2.1/servers/a4de9e6e-90d3-4317-abf8-9fc8f021b803 => generated 1321 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:23.950129 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-bf9cb5b5-5e58-4afe-a826-4ac0c35d79b4 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Calling method '.version_select at 0x7fb227ee4a60>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:24.051700 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-bf9cb5b5-5e58-4afe-a826-4ac0c35d79b4 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] 10.222.0.43 "GET /compute/v2.1/images/8b9606ad-88f3-4647-bc18-c5885add126b" status: 200 len: 1453 microversion: 2.1 time: 0.108784 Oct 04 18:39:24.052908 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1153/2137] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 18:39:23 2022] GET /compute/v2.1/images/8b9606ad-88f3-4647-bc18-c5885add126b => generated 1453 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:24.059210 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-7b74357c-9e54-4e24-9ba8-7f68a426aa6e tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Calling method '.version_select at 0x7fb227df0dc0>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:24.367789 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=6 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:39:24.533832 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-7b74357c-9e54-4e24-9ba8-7f68a426aa6e tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] 10.222.0.43 "GET /compute/v2.1/os-security-groups" status: 200 len: 1832 microversion: 2.1 time: 0.479404 Oct 04 18:39:24.534999 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1154/2138] 10.222.0.43 () {58 vars in 1158 bytes} [Tue Oct 4 18:39:24 2022] GET /compute/v2.1/os-security-groups => generated 1832 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:24.539707 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-2d22e6b3-ec46-4af6-91cc-42a8698cbcfa tempest-ServerAddressesTestJSON-638433160 tempest-ServerAddressesTestJSON-638433160-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:24.540322 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-2d22e6b3-ec46-4af6-91cc-42a8698cbcfa tempest-ServerAddressesTestJSON-638433160 tempest-ServerAddressesTestJSON-638433160-project] [instance: cdb73233-3522-4ddb-b7d4-463685e66bcc] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:24.558325 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2d22e6b3-ec46-4af6-91cc-42a8698cbcfa tempest-ServerAddressesTestJSON-638433160 tempest-ServerAddressesTestJSON-638433160-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:24.558838 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2d22e6b3-ec46-4af6-91cc-42a8698cbcfa tempest-ServerAddressesTestJSON-638433160 tempest-ServerAddressesTestJSON-638433160-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:24.559286 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2d22e6b3-ec46-4af6-91cc-42a8698cbcfa tempest-ServerAddressesTestJSON-638433160 tempest-ServerAddressesTestJSON-638433160-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:24.560073 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2d22e6b3-ec46-4af6-91cc-42a8698cbcfa tempest-ServerAddressesTestJSON-638433160 tempest-ServerAddressesTestJSON-638433160-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:24.560535 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2d22e6b3-ec46-4af6-91cc-42a8698cbcfa tempest-ServerAddressesTestJSON-638433160 tempest-ServerAddressesTestJSON-638433160-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:24.560972 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2d22e6b3-ec46-4af6-91cc-42a8698cbcfa tempest-ServerAddressesTestJSON-638433160 tempest-ServerAddressesTestJSON-638433160-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:24.743788 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.network.neutron [None req-3e713ed8-b520-498a-8950-b6f8403946b4 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] [instance: 5d937ba2-60f4-40cf-9ed8-a4a86d458e38] re-assign floating IP 172.25.8.167 from instance 36d7eb4f-22bc-4047-bc75-6f69142daee5 Oct 04 18:39:24.823008 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-2d22e6b3-ec46-4af6-91cc-42a8698cbcfa tempest-ServerAddressesTestJSON-638433160 tempest-ServerAddressesTestJSON-638433160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c41b6ddac731410085f447c3f687ef7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b241fded901d40fca9db5b5a4862a428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:24.832508 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-2d22e6b3-ec46-4af6-91cc-42a8698cbcfa tempest-ServerAddressesTestJSON-638433160 tempest-ServerAddressesTestJSON-638433160-project] 10.222.0.43 "GET /compute/v2.1/servers/cdb73233-3522-4ddb-b7d4-463685e66bcc" status: 200 len: 1316 microversion: 2.1 time: 0.296432 Oct 04 18:39:24.845133 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1155/2139] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:24 2022] GET /compute/v2.1/servers/cdb73233-3522-4ddb-b7d4-463685e66bcc => generated 1316 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:24.851513 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-a751efca-4656-4fb0-ba23-f20f6e94a281 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:24.853397 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-a751efca-4656-4fb0-ba23-f20f6e94a281 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: d9d4332a-97b6-40f1-bd7c-a9a75a9adc43] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:24.862900 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a751efca-4656-4fb0-ba23-f20f6e94a281 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:24.863402 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a751efca-4656-4fb0-ba23-f20f6e94a281 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:24.867477 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a751efca-4656-4fb0-ba23-f20f6e94a281 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:24.868866 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a751efca-4656-4fb0-ba23-f20f6e94a281 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:24.868866 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a751efca-4656-4fb0-ba23-f20f6e94a281 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:24.869243 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a751efca-4656-4fb0-ba23-f20f6e94a281 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:24.884944 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.network.neutron [None req-3e713ed8-b520-498a-8950-b6f8403946b4 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] [instance: 36d7eb4f-22bc-4047-bc75-6f69142daee5] Building network info cache for instance {{(pid=123595) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 04 18:39:25.209623 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-a751efca-4656-4fb0-ba23-f20f6e94a281 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:25.221016 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-a751efca-4656-4fb0-ba23-f20f6e94a281 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/d9d4332a-97b6-40f1-bd7c-a9a75a9adc43" status: 200 len: 1537 microversion: 2.1 time: 0.378308 Oct 04 18:39:25.232633 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1156/2140] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:24 2022] GET /compute/v2.1/servers/d9d4332a-97b6-40f1-bd7c-a9a75a9adc43 => generated 1537 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:25.245888 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-da43db71-c071-4eaf-9d1e-bbf6a06996b1 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:25.246505 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-da43db71-c071-4eaf-9d1e-bbf6a06996b1 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] [instance: d1f298aa-ebe3-4f52-ada6-137a782cd9b7] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:25.269530 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-da43db71-c071-4eaf-9d1e-bbf6a06996b1 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:25.272700 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-da43db71-c071-4eaf-9d1e-bbf6a06996b1 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:25.275962 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-da43db71-c071-4eaf-9d1e-bbf6a06996b1 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:25.277051 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-da43db71-c071-4eaf-9d1e-bbf6a06996b1 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:25.281301 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-da43db71-c071-4eaf-9d1e-bbf6a06996b1 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:25.282070 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-da43db71-c071-4eaf-9d1e-bbf6a06996b1 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:25.569409 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-da43db71-c071-4eaf-9d1e-bbf6a06996b1 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:25.585492 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-da43db71-c071-4eaf-9d1e-bbf6a06996b1 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:25.587451 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-da43db71-c071-4eaf-9d1e-bbf6a06996b1 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:25.588393 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-da43db71-c071-4eaf-9d1e-bbf6a06996b1 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] 10.222.0.43 "GET /compute/v2.1/servers/d1f298aa-ebe3-4f52-ada6-137a782cd9b7" status: 200 len: 1486 microversion: 2.25 time: 0.354712 Oct 04 18:39:25.589037 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1157/2141] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:39:25 2022] GET /compute/v2.1/servers/d1f298aa-ebe3-4f52-ada6-137a782cd9b7 => generated 1486 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:39:25.596719 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-6a245850-abe1-43d4-96b6-3a130cfdaf0d tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:25.629477 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.compute.server_groups [None req-6a245850-abe1-43d4-96b6-3a130cfdaf0d tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Querying cell 66287c68-6a08-453f-953b-bd2446fe0d25(cell1) for 1 instances {{(pid=123596) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 04 18:39:25.631805 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6a245850-abe1-43d4-96b6-3a130cfdaf0d tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:25.633529 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6a245850-abe1-43d4-96b6-3a130cfdaf0d tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:25.634089 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6a245850-abe1-43d4-96b6-3a130cfdaf0d tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:25.660192 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-6a245850-abe1-43d4-96b6-3a130cfdaf0d tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] 10.222.0.43 "GET /compute/v2.1/os-server-groups/e20eb086-2572-400f-bbd0-163473a4eb28" status: 200 len: 183 microversion: 2.1 time: 0.069999 Oct 04 18:39:25.669636 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1158/2142] 10.222.0.43 () {58 vars in 1263 bytes} [Tue Oct 4 18:39:25 2022] GET /compute/v2.1/os-server-groups/e20eb086-2572-400f-bbd0-163473a4eb28 => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:39:25.681662 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-ca48f46c-76d9-42a9-8116-537f175d5fe0 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Calling method '.version_select at 0x7fb227de24c0>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:25.730850 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=4 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:39:26.061170 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.network.neutron [None req-3e713ed8-b520-498a-8950-b6f8403946b4 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] [instance: 36d7eb4f-22bc-4047-bc75-6f69142daee5] Updating instance_info_cache with network_info: [{"id": "e3d142e8-c4f2-49f8-af0d-f2e13e22b36f", "address": "fa:16:3e:cf:ad:3b", "network": {"id": "8c78b501-c0dc-4b4a-aea6-b08dc5b06498", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1071307667-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "87f4f9b0233b4fb29963b77248a236f7", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tape3d142e8-c4", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=123595) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 04 18:39:26.062560 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-ca48f46c-76d9-42a9-8116-537f175d5fe0 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] 10.222.0.43 "DELETE /compute/v2.1/os-security-groups/c9cce38d-5b32-4d55-a383-233f41add94d" status: 202 len: 0 microversion: 2.1 time: 0.384780 Oct 04 18:39:26.063188 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1159/2143] 10.222.0.43 () {58 vars in 1272 bytes} [Tue Oct 4 18:39:25 2022] DELETE /compute/v2.1/os-security-groups/c9cce38d-5b32-4d55-a383-233f41add94d => generated 0 bytes in 393 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:39:26.071156 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-7ff743f6-d109-454d-a8c7-1fffdc768884 req-4c6491f3-8497-46af-bc3b-6f6a7fc14cbd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cdb73233-3522-4ddb-b7d4-463685e66bcc", "name": "network-vif-plugged", "status": "completed", "tag": "4c38bca6-ef3f-4ba3-9bd9-54faa461803d"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:39:26.082158 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.network.neutron [None req-3e713ed8-b520-498a-8950-b6f8403946b4 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] [instance: 5d937ba2-60f4-40cf-9ed8-a4a86d458e38] Building network info cache for instance {{(pid=123595) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 04 18:39:26.115320 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-7ff743f6-d109-454d-a8c7-1fffdc768884 req-4c6491f3-8497-46af-bc3b-6f6a7fc14cbd service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:26.116504 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-7ff743f6-d109-454d-a8c7-1fffdc768884 req-4c6491f3-8497-46af-bc3b-6f6a7fc14cbd service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:26.117298 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-7ff743f6-d109-454d-a8c7-1fffdc768884 req-4c6491f3-8497-46af-bc3b-6f6a7fc14cbd service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:26.134132 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-7ff743f6-d109-454d-a8c7-1fffdc768884 req-4c6491f3-8497-46af-bc3b-6f6a7fc14cbd service nova] Creating event network-vif-plugged:4c38bca6-ef3f-4ba3-9bd9-54faa461803d for instance cdb73233-3522-4ddb-b7d4-463685e66bcc on n-h2-851028-13 Oct 04 18:39:26.140734 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-7ff743f6-d109-454d-a8c7-1fffdc768884 req-4c6491f3-8497-46af-bc3b-6f6a7fc14cbd service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073151 Oct 04 18:39:26.142081 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1160/2144] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:39:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:39:26.149232 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-74a3e78b-b0bf-4a45-91a7-bea09bbdfdf7 req-1fdc84f8-7a56-4d7d-85fe-7befbf95ee40 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4de9e6e-90d3-4317-abf8-9fc8f021b803", "tag": "972fc604-de2d-46a2-8fce-29a94634e352"}, {"name": "network-changed", "server_uuid": "36d7eb4f-22bc-4047-bc75-6f69142daee5", "tag": "e3d142e8-c4f2-49f8-af0d-f2e13e22b36f"}, {"name": "network-changed", "server_uuid": "5d937ba2-60f4-40cf-9ed8-a4a86d458e38", "tag": "568dee2e-5618-4d07-a3bd-4aaf5000f435"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:39:26.187540 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-74a3e78b-b0bf-4a45-91a7-bea09bbdfdf7 req-1fdc84f8-7a56-4d7d-85fe-7befbf95ee40 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:26.188314 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-74a3e78b-b0bf-4a45-91a7-bea09bbdfdf7 req-1fdc84f8-7a56-4d7d-85fe-7befbf95ee40 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:26.188946 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-74a3e78b-b0bf-4a45-91a7-bea09bbdfdf7 req-1fdc84f8-7a56-4d7d-85fe-7befbf95ee40 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:26.240130 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-74a3e78b-b0bf-4a45-91a7-bea09bbdfdf7 req-1fdc84f8-7a56-4d7d-85fe-7befbf95ee40 service nova] Creating event network-changed:972fc604-de2d-46a2-8fce-29a94634e352 for instance a4de9e6e-90d3-4317-abf8-9fc8f021b803 on n-h1-851028-13 Oct 04 18:39:26.253487 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-74a3e78b-b0bf-4a45-91a7-bea09bbdfdf7 req-1fdc84f8-7a56-4d7d-85fe-7befbf95ee40 service nova] Creating event network-changed:e3d142e8-c4f2-49f8-af0d-f2e13e22b36f for instance 36d7eb4f-22bc-4047-bc75-6f69142daee5 on n-h2-851028-13 Oct 04 18:39:26.254310 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-74a3e78b-b0bf-4a45-91a7-bea09bbdfdf7 req-1fdc84f8-7a56-4d7d-85fe-7befbf95ee40 service nova] Creating event network-changed:568dee2e-5618-4d07-a3bd-4aaf5000f435 for instance 5d937ba2-60f4-40cf-9ed8-a4a86d458e38 on n-h1-851028-13 Oct 04 18:39:26.290362 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-74a3e78b-b0bf-4a45-91a7-bea09bbdfdf7 req-1fdc84f8-7a56-4d7d-85fe-7befbf95ee40 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 513 microversion: 2.1 time: 0.146080 Oct 04 18:39:26.292426 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1161/2145] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:39:26 2022] POST /compute/v2.1/os-server-external-events => generated 513 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:39:26.313307 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-0ef7ebe3-b90e-4e63-828d-90efcd08a045 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:26.316118 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-0ef7ebe3-b90e-4e63-828d-90efcd08a045 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] [instance: a4de9e6e-90d3-4317-abf8-9fc8f021b803] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:26.333787 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0ef7ebe3-b90e-4e63-828d-90efcd08a045 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:26.334682 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0ef7ebe3-b90e-4e63-828d-90efcd08a045 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:26.335874 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0ef7ebe3-b90e-4e63-828d-90efcd08a045 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:26.338310 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0ef7ebe3-b90e-4e63-828d-90efcd08a045 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:26.340019 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0ef7ebe3-b90e-4e63-828d-90efcd08a045 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:26.343199 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0ef7ebe3-b90e-4e63-828d-90efcd08a045 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:26.614840 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-0ef7ebe3-b90e-4e63-828d-90efcd08a045 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a19da94e9e646028a7f73f9d0e0edda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc41f296eb44503868205ec8aa2fef3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:26.624554 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-0ef7ebe3-b90e-4e63-828d-90efcd08a045 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] 10.222.0.43 "GET /compute/v2.1/servers/a4de9e6e-90d3-4317-abf8-9fc8f021b803" status: 200 len: 1321 microversion: 2.1 time: 0.329557 Oct 04 18:39:26.625647 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1162/2146] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:26 2022] GET /compute/v2.1/servers/a4de9e6e-90d3-4317-abf8-9fc8f021b803 => generated 1321 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:26.646262 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-89cdb3f6-c088-4af6-ae98-43447a64c4d3 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Calling method '.version_select at 0x7fb227e5d160>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:26.709831 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-89cdb3f6-c088-4af6-ae98-43447a64c4d3 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] 10.222.0.43 "GET /compute/v2.1/images/8b9606ad-88f3-4647-bc18-c5885add126b" status: 200 len: 1453 microversion: 2.1 time: 0.083010 Oct 04 18:39:26.719630 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1163/2147] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 18:39:26 2022] GET /compute/v2.1/images/8b9606ad-88f3-4647-bc18-c5885add126b => generated 1453 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:26.726162 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-30458447-1015-4794-860a-9550acf30fcc tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:26.726797 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-30458447-1015-4794-860a-9550acf30fcc tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] [instance: 237ee25f-85f0-46d4-8980-66c5bfe764ad] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:26.734364 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-30458447-1015-4794-860a-9550acf30fcc tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:26.734996 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-30458447-1015-4794-860a-9550acf30fcc tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:26.735550 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-30458447-1015-4794-860a-9550acf30fcc tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:26.736374 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-30458447-1015-4794-860a-9550acf30fcc tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:26.737032 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-30458447-1015-4794-860a-9550acf30fcc tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:26.737587 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-30458447-1015-4794-860a-9550acf30fcc tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:26.756339 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-30458447-1015-4794-860a-9550acf30fcc tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] HTTP exception thrown: Instance 237ee25f-85f0-46d4-8980-66c5bfe764ad could not be found. Oct 04 18:39:26.758265 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-30458447-1015-4794-860a-9550acf30fcc tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Request method failure captured: Oct 04 18:39:26.758265 n-d-851028-13 devstack@n-api.service[123596]: request: DELETE /compute/v2.1/servers/237ee25f-85f0-46d4-8980-66c5bfe764ad HTTP/1.1 Oct 04 18:39:26.758265 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:39:26.758265 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:39:26.758265 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:39:26.758265 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 18:39:26.758265 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:39:26.758265 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:39:26.758265 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:39:26.758265 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:39:26.758265 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPH2pqQ0-ZftMLab_pzPrqYEgZyfWcNNZZ1BfK5sXjpIskjK9jjdNDn_UudxFMb5ZcEy61GPWPH4a7gB9mo5mh0kFvFHo_V08s4IpywIPUo-1KDJ9SZBo9z7bbYA6uENOWn04GexKLpQqRv7pcCQ-as1ctVZG5RYS36fAnubqzgfikxI Oct 04 18:39:26.758265 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:39:26.758265 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:39:26.758265 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:39:26.758265 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:39:26.758265 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:39:26.758265 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:39:26.758265 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: 5f3ca2b15fd24916ac47e08325464d75 Oct 04 18:39:26.758265 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-ServerGroupTestJSON-1457133461 Oct 04 18:39:26.758265 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 18:39:26.758265 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 18:39:26.758265 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/5f3ca2b15fd24916ac47e08325464d75"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_5f3ca2b15fd24916ac47e08325464d75"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5f3ca2b15fd24916ac47e08325464d75"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5f3ca2b15fd24916ac47e08325464d75"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:39:26.758265 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-ServerGroupTestJSON-1457133461 Oct 04 18:39:26.758265 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: 5f3ca2b15fd24916ac47e08325464d75 Oct 04 18:39:26.758265 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-ServerGroupTestJSON-1457133461 Oct 04 18:39:26.758265 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-ServerGroupTestJSON-1457133461-project Oct 04 18:39:26.758265 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:39:26.758265 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:39:26.758265 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 6daea1f7b0084009ac6e24181a1b87d7 Oct 04 18:39:26.758265 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-ServerGroupTestJSON-1457133461-project Oct 04 18:39:26.758265 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 18:39:26.758265 n-d-851028-13 devstack@n-api.service[123596]: exception: Instance 237ee25f-85f0-46d4-8980-66c5bfe764ad could not be found. Oct 04 18:39:26.758265 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': '237ee25f-85f0-46d4-8980-66c5bfe764ad'} Oct 04 18:39:26.758265 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:39:26.758265 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:39:26.758265 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:39:26.758265 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:39:26.758265 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:39:26.758265 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:39:26.758265 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:39:26.758265 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:39:26.758265 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:39:26.758265 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:39:26.758265 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 237ee25f-85f0-46d4-8980-66c5bfe764ad could not be found. Oct 04 18:39:26.758265 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:39:26.758265 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:39:26.758265 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:39:26.758265 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:39:26.758265 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:39:26.758265 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:39:26.758265 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:39:26.758265 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:39:26.758265 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:39:26.758265 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:39:26.758265 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:39:26.758265 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:39:26.758265 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:39:26.758265 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:39:26.758265 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:39:26.758265 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:39:26.758265 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:39:26.758265 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:39:26.763601 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 237ee25f-85f0-46d4-8980-66c5bfe764ad could not be found. Oct 04 18:39:26.763601 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:39:26.763601 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:39:26.763601 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:39:26.763601 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:39:26.763601 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:39:26.763601 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:39:26.763601 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:39:26.763601 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:39:26.763601 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 237ee25f-85f0-46d4-8980-66c5bfe764ad could not be found. Oct 04 18:39:26.763601 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:39:26.763601 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-30458447-1015-4794-860a-9550acf30fcc tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Returning 404 to user: Instance 237ee25f-85f0-46d4-8980-66c5bfe764ad could not be found. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:39:26.763601 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-30458447-1015-4794-860a-9550acf30fcc tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] 10.222.0.43 "DELETE /compute/v2.1/servers/237ee25f-85f0-46d4-8980-66c5bfe764ad" status: 404 len: 111 microversion: 2.1 time: 0.042034 Oct 04 18:39:26.766207 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1164/2148] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 18:39:26 2022] DELETE /compute/v2.1/servers/237ee25f-85f0-46d4-8980-66c5bfe764ad => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:39:26.773844 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-5011341a-f625-4e38-a033-5076d1842653 tempest-ServerAddressesTestJSON-638433160 tempest-ServerAddressesTestJSON-638433160-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:26.774471 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-5011341a-f625-4e38-a033-5076d1842653 tempest-ServerAddressesTestJSON-638433160 tempest-ServerAddressesTestJSON-638433160-project] [instance: cdb73233-3522-4ddb-b7d4-463685e66bcc] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:26.785596 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5011341a-f625-4e38-a033-5076d1842653 tempest-ServerAddressesTestJSON-638433160 tempest-ServerAddressesTestJSON-638433160-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:26.786262 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5011341a-f625-4e38-a033-5076d1842653 tempest-ServerAddressesTestJSON-638433160 tempest-ServerAddressesTestJSON-638433160-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:26.787009 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5011341a-f625-4e38-a033-5076d1842653 tempest-ServerAddressesTestJSON-638433160 tempest-ServerAddressesTestJSON-638433160-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:26.788083 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5011341a-f625-4e38-a033-5076d1842653 tempest-ServerAddressesTestJSON-638433160 tempest-ServerAddressesTestJSON-638433160-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:26.788641 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5011341a-f625-4e38-a033-5076d1842653 tempest-ServerAddressesTestJSON-638433160 tempest-ServerAddressesTestJSON-638433160-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:26.789213 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5011341a-f625-4e38-a033-5076d1842653 tempest-ServerAddressesTestJSON-638433160 tempest-ServerAddressesTestJSON-638433160-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:27.101527 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-5011341a-f625-4e38-a033-5076d1842653 tempest-ServerAddressesTestJSON-638433160 tempest-ServerAddressesTestJSON-638433160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c41b6ddac731410085f447c3f687ef7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b241fded901d40fca9db5b5a4862a428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:27.113423 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-5011341a-f625-4e38-a033-5076d1842653 tempest-ServerAddressesTestJSON-638433160 tempest-ServerAddressesTestJSON-638433160-project] 10.222.0.43 "GET /compute/v2.1/servers/cdb73233-3522-4ddb-b7d4-463685e66bcc" status: 200 len: 1316 microversion: 2.1 time: 0.348502 Oct 04 18:39:27.115069 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1165/2149] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:26 2022] GET /compute/v2.1/servers/cdb73233-3522-4ddb-b7d4-463685e66bcc => generated 1316 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:27.121280 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-e1104ec1-dfa9-4b55-9fd1-2ce3f83bbd6d tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Calling method '.version_select at 0x7fb2240a1820>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:27.149278 n-d-851028-13 devstack@n-api.service[123596]: DEBUG neutronclient.v2_0.client [None req-e1104ec1-dfa9-4b55-9fd1-2ce3f83bbd6d tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group c9cce38d-5b32-4d55-a383-233f41add94d does not exist", "detail": ""}} {{(pid=123596) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 18:39:27.149878 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.network.security_group_api [None req-e1104ec1-dfa9-4b55-9fd1-2ce3f83bbd6d tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Neutron security group c9cce38d-5b32-4d55-a383-233f41add94d not found {{(pid=123596) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 04 18:39:27.150474 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-e1104ec1-dfa9-4b55-9fd1-2ce3f83bbd6d tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] HTTP exception thrown: Security group c9cce38d-5b32-4d55-a383-233f41add94d does not exist Oct 04 18:39:27.150474 n-d-851028-13 devstack@n-api.service[123596]: Neutron server returns request_ids: ['req-797ef492-0ddb-4e3b-a7c3-aba8a334b2ef'] Oct 04 18:39:27.153075 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-e1104ec1-dfa9-4b55-9fd1-2ce3f83bbd6d tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Request method failure captured: Oct 04 18:39:27.153075 n-d-851028-13 devstack@n-api.service[123596]: request: GET /compute/v2.1/os-security-groups/c9cce38d-5b32-4d55-a383-233f41add94d HTTP/1.1 Oct 04 18:39:27.153075 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:39:27.153075 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:39:27.153075 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:39:27.153075 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 18:39:27.153075 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:39:27.153075 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:39:27.153075 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:39:27.153075 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:39:27.153075 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPH2qE2WsiZvVd-vvN1M8uHJG40fIXDT1XURP-P4ciVfKnbP_2tplzYndj2wlvB6bSu_VMaD1xfU0nGHRYWQRmNIt_krh_S1n2RkrhietTC0-RnvJ1rzF8ilPx8zowbVefo7A8IyDn5QTaMC08kHUNyiYinJQT_Q7n9enahWrBitVOPM Oct 04 18:39:27.153075 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:39:27.153075 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:39:27.153075 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:39:27.153075 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:39:27.153075 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:39:27.153075 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:39:27.153075 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: 7b812c85494a49898376a0dd8140f03c Oct 04 18:39:27.153075 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-SecurityGroupsTestJSON-209295605 Oct 04 18:39:27.153075 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 18:39:27.153075 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 18:39:27.153075 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/7b812c85494a49898376a0dd8140f03c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_7b812c85494a49898376a0dd8140f03c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/7b812c85494a49898376a0dd8140f03c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/7b812c85494a49898376a0dd8140f03c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:39:27.153075 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-SecurityGroupsTestJSON-209295605 Oct 04 18:39:27.153075 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: 7b812c85494a49898376a0dd8140f03c Oct 04 18:39:27.153075 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-209295605 Oct 04 18:39:27.153075 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-SecurityGroupsTestJSON-209295605-project Oct 04 18:39:27.153075 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:39:27.153075 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:39:27.153075 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 5c96ec8b8e0a4053b0457f213e6e262d Oct 04 18:39:27.153075 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-SecurityGroupsTestJSON-209295605-project Oct 04 18:39:27.153075 n-d-851028-13 devstack@n-api.service[123596]: method: Oct 04 18:39:27.153075 n-d-851028-13 devstack@n-api.service[123596]: exception: Security group c9cce38d-5b32-4d55-a383-233f41add94d does not exist Oct 04 18:39:27.153075 n-d-851028-13 devstack@n-api.service[123596]: Neutron server returns request_ids: ['req-797ef492-0ddb-4e3b-a7c3-aba8a334b2ef'] Oct 04 18:39:27.153075 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': 'c9cce38d-5b32-4d55-a383-233f41add94d'} Oct 04 18:39:27.153075 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:39:27.153075 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:39:27.153075 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 04 18:39:27.153075 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 04 18:39:27.153075 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:39:27.153075 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:39:27.153075 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 04 18:39:27.153075 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 04 18:39:27.153075 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:39:27.153075 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:39:27.153075 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 18:39:27.153075 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 18:39:27.153075 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:39:27.153075 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:39:27.153075 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 18:39:27.153075 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 18:39:27.153075 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:39:27.153075 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:39:27.153075 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 18:39:27.153075 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 18:39:27.153075 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:39:27.153075 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:39:27.153075 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 18:39:27.153075 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 18:39:27.153075 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 18:39:27.153075 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 18:39:27.153075 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group c9cce38d-5b32-4d55-a383-233f41add94d does not exist Oct 04 18:39:27.164853 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-797ef492-0ddb-4e3b-a7c3-aba8a334b2ef'] Oct 04 18:39:27.164853 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:39:27.164853 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:39:27.164853 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:39:27.164853 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:39:27.164853 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 04 18:39:27.164853 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 04 18:39:27.164853 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 04 18:39:27.164853 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 18:39:27.164853 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group c9cce38d-5b32-4d55-a383-233f41add94d does not exist Oct 04 18:39:27.164853 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-797ef492-0ddb-4e3b-a7c3-aba8a334b2ef'] Oct 04 18:39:27.164853 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:39:27.164853 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:39:27.164853 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:39:27.164853 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:39:27.164853 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:39:27.164853 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:39:27.164853 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:39:27.164853 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:39:27.164853 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:39:27.164853 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:39:27.164853 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:39:27.164853 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:39:27.164853 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 04 18:39:27.164853 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 04 18:39:27.164853 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group c9cce38d-5b32-4d55-a383-233f41add94d does not exist Oct 04 18:39:27.164853 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-797ef492-0ddb-4e3b-a7c3-aba8a334b2ef'] Oct 04 18:39:27.164853 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:39:27.164853 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:39:27.164853 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:39:27.164853 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:39:27.164853 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:39:27.164853 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:39:27.164853 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:39:27.164853 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:39:27.164853 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group c9cce38d-5b32-4d55-a383-233f41add94d does not exist Oct 04 18:39:27.164853 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-797ef492-0ddb-4e3b-a7c3-aba8a334b2ef'] Oct 04 18:39:27.164853 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:39:27.164853 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-e1104ec1-dfa9-4b55-9fd1-2ce3f83bbd6d tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Returning 404 to user: Security group c9cce38d-5b32-4d55-a383-233f41add94d does not exist Oct 04 18:39:27.164853 n-d-851028-13 devstack@n-api.service[123596]: Neutron server returns request_ids: ['req-797ef492-0ddb-4e3b-a7c3-aba8a334b2ef'] {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:39:27.164853 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-e1104ec1-dfa9-4b55-9fd1-2ce3f83bbd6d tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] 10.222.0.43 "GET /compute/v2.1/os-security-groups/c9cce38d-5b32-4d55-a383-233f41add94d" status: 404 len: 194 microversion: 2.1 time: 0.039283 Oct 04 18:39:27.164853 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1166/2150] 10.222.0.43 () {58 vars in 1269 bytes} [Tue Oct 4 18:39:27 2022] GET /compute/v2.1/os-security-groups/c9cce38d-5b32-4d55-a383-233f41add94d => generated 194 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:39:27.164853 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-4164dc6d-15da-48ca-b0d4-bf668defe472 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:27.164853 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-4164dc6d-15da-48ca-b0d4-bf668defe472 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: d9d4332a-97b6-40f1-bd7c-a9a75a9adc43] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:27.183625 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4164dc6d-15da-48ca-b0d4-bf668defe472 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:27.184154 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4164dc6d-15da-48ca-b0d4-bf668defe472 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:27.185186 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4164dc6d-15da-48ca-b0d4-bf668defe472 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:27.185985 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4164dc6d-15da-48ca-b0d4-bf668defe472 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:27.187119 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4164dc6d-15da-48ca-b0d4-bf668defe472 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:27.187574 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4164dc6d-15da-48ca-b0d4-bf668defe472 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:27.445797 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-4164dc6d-15da-48ca-b0d4-bf668defe472 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:27.459200 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-4164dc6d-15da-48ca-b0d4-bf668defe472 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/d9d4332a-97b6-40f1-bd7c-a9a75a9adc43" status: 200 len: 1537 microversion: 2.1 time: 0.300989 Oct 04 18:39:27.459818 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1167/2151] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:27 2022] GET /compute/v2.1/servers/d9d4332a-97b6-40f1-bd7c-a9a75a9adc43 => generated 1537 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:27.476022 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-07ebcb1c-2645-4f73-b35d-e6f5fab5d2d6 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:27.478904 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-07ebcb1c-2645-4f73-b35d-e6f5fab5d2d6 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] [instance: d1f298aa-ebe3-4f52-ada6-137a782cd9b7] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:27.496080 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-07ebcb1c-2645-4f73-b35d-e6f5fab5d2d6 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:27.496653 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-07ebcb1c-2645-4f73-b35d-e6f5fab5d2d6 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:27.500047 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-07ebcb1c-2645-4f73-b35d-e6f5fab5d2d6 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:27.502189 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-07ebcb1c-2645-4f73-b35d-e6f5fab5d2d6 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:27.502679 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-07ebcb1c-2645-4f73-b35d-e6f5fab5d2d6 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:27.505499 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-07ebcb1c-2645-4f73-b35d-e6f5fab5d2d6 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:27.557338 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.network.neutron [None req-3e713ed8-b520-498a-8950-b6f8403946b4 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] [instance: 5d937ba2-60f4-40cf-9ed8-a4a86d458e38] Updating instance_info_cache with network_info: [{"id": "568dee2e-5618-4d07-a3bd-4aaf5000f435", "address": "fa:16:3e:36:50:48", "network": {"id": "8c78b501-c0dc-4b4a-aea6-b08dc5b06498", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1071307667-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.8.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "87f4f9b0233b4fb29963b77248a236f7", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap568dee2e-56", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=123595) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 04 18:39:27.584777 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3e713ed8-b520-498a-8950-b6f8403946b4 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Releasing lock "refresh_cache-5d937ba2-60f4-40cf-9ed8-a4a86d458e38" {{(pid=123595) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 04 18:39:27.590108 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-3e713ed8-b520-498a-8950-b6f8403946b4 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] 10.222.0.43 "POST /compute/v2.1/servers/5d937ba2-60f4-40cf-9ed8-a4a86d458e38/action" status: 202 len: 0 microversion: 2.1 time: 7.631158 Oct 04 18:39:27.592009 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 985/2152] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 18:39:19 2022] POST /compute/v2.1/servers/5d937ba2-60f4-40cf-9ed8-a4a86d458e38/action => generated 0 bytes in 7635 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 04 18:39:27.630309 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-d51c33fa-d690-4321-acba-038a7ecc67f3 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:27.634683 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-d51c33fa-d690-4321-acba-038a7ecc67f3 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] [instance: 237ee25f-85f0-46d4-8980-66c5bfe764ad] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:27.673347 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d51c33fa-d690-4321-acba-038a7ecc67f3 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:27.677840 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d51c33fa-d690-4321-acba-038a7ecc67f3 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:27.678605 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d51c33fa-d690-4321-acba-038a7ecc67f3 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:27.679667 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d51c33fa-d690-4321-acba-038a7ecc67f3 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:27.683093 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d51c33fa-d690-4321-acba-038a7ecc67f3 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:27.683871 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d51c33fa-d690-4321-acba-038a7ecc67f3 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:27.718677 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-d51c33fa-d690-4321-acba-038a7ecc67f3 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] HTTP exception thrown: Instance 237ee25f-85f0-46d4-8980-66c5bfe764ad could not be found. Oct 04 18:39:27.728311 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-d51c33fa-d690-4321-acba-038a7ecc67f3 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Request method failure captured: Oct 04 18:39:27.728311 n-d-851028-13 devstack@n-api.service[123595]: request: GET /compute/v2.1/servers/237ee25f-85f0-46d4-8980-66c5bfe764ad HTTP/1.1 Oct 04 18:39:27.728311 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 18:39:27.728311 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 18:39:27.728311 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 18:39:27.728311 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 0 Oct 04 18:39:27.728311 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 18:39:27.728311 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 18:39:27.728311 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 18:39:27.728311 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 18:39:27.728311 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPH2pqQ0-ZftMLab_pzPrqYEgZyfWcNNZZ1BfK5sXjpIskjK9jjdNDn_UudxFMb5ZcEy61GPWPH4a7gB9mo5mh0kFvFHo_V08s4IpywIPUo-1KDJ9SZBo9z7bbYA6uENOWn04GexKLpQqRv7pcCQ-as1ctVZG5RYS36fAnubqzgfikxI Oct 04 18:39:27.728311 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 18:39:27.728311 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 18:39:27.728311 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 18:39:27.728311 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 18:39:27.728311 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 18:39:27.728311 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 18:39:27.728311 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: 5f3ca2b15fd24916ac47e08325464d75 Oct 04 18:39:27.728311 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-ServerGroupTestJSON-1457133461 Oct 04 18:39:27.728311 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 18:39:27.728311 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 18:39:27.728311 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/5f3ca2b15fd24916ac47e08325464d75"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_5f3ca2b15fd24916ac47e08325464d75"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5f3ca2b15fd24916ac47e08325464d75"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5f3ca2b15fd24916ac47e08325464d75"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:39:27.728311 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-ServerGroupTestJSON-1457133461 Oct 04 18:39:27.728311 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: 5f3ca2b15fd24916ac47e08325464d75 Oct 04 18:39:27.728311 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-ServerGroupTestJSON-1457133461 Oct 04 18:39:27.728311 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-ServerGroupTestJSON-1457133461-project Oct 04 18:39:27.728311 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 18:39:27.728311 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 18:39:27.728311 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: 6daea1f7b0084009ac6e24181a1b87d7 Oct 04 18:39:27.728311 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-ServerGroupTestJSON-1457133461-project Oct 04 18:39:27.728311 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 18:39:27.728311 n-d-851028-13 devstack@n-api.service[123595]: exception: Instance 237ee25f-85f0-46d4-8980-66c5bfe764ad could not be found. Oct 04 18:39:27.728311 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': '237ee25f-85f0-46d4-8980-66c5bfe764ad'} Oct 04 18:39:27.728311 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:39:27.728311 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:39:27.728311 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:39:27.728311 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:39:27.728311 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:39:27.728311 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:39:27.728311 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:39:27.728311 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:39:27.728311 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:39:27.728311 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:39:27.728311 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 237ee25f-85f0-46d4-8980-66c5bfe764ad could not be found. Oct 04 18:39:27.728311 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:39:27.728311 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:39:27.728311 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:39:27.728311 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:39:27.728311 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:39:27.728311 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:39:27.728311 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:39:27.728311 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:39:27.728311 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:39:27.728311 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:39:27.728311 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:39:27.728311 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:39:27.728311 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:39:27.728311 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:39:27.728311 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:39:27.728311 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:39:27.728311 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 237ee25f-85f0-46d4-8980-66c5bfe764ad could not be found. Oct 04 18:39:27.728311 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:39:27.728311 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:39:27.728311 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:39:27.734358 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:39:27.734358 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:39:27.734358 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:39:27.734358 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:39:27.734358 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:39:27.734358 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 237ee25f-85f0-46d4-8980-66c5bfe764ad could not be found. Oct 04 18:39:27.734358 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:39:27.736508 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-d51c33fa-d690-4321-acba-038a7ecc67f3 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Returning 404 to user: Instance 237ee25f-85f0-46d4-8980-66c5bfe764ad could not be found. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:39:27.737898 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-d51c33fa-d690-4321-acba-038a7ecc67f3 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] 10.222.0.43 "GET /compute/v2.1/servers/237ee25f-85f0-46d4-8980-66c5bfe764ad" status: 404 len: 111 microversion: 2.1 time: 0.140461 Oct 04 18:39:27.739176 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 986/2153] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:27 2022] GET /compute/v2.1/servers/237ee25f-85f0-46d4-8980-66c5bfe764ad => generated 111 bytes in 143 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:39:27.756378 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-38314524-6e0b-4064-bb2f-7c4c4549153d tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Calling method '.version_select at 0x7fb21f785670>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:27.869677 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-07ebcb1c-2645-4f73-b35d-e6f5fab5d2d6 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:27.892350 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-07ebcb1c-2645-4f73-b35d-e6f5fab5d2d6 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:27.893897 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-07ebcb1c-2645-4f73-b35d-e6f5fab5d2d6 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:27.895145 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-07ebcb1c-2645-4f73-b35d-e6f5fab5d2d6 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] 10.222.0.43 "GET /compute/v2.1/servers/d1f298aa-ebe3-4f52-ada6-137a782cd9b7" status: 200 len: 1486 microversion: 2.25 time: 0.434314 Oct 04 18:39:27.896074 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1168/2154] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:39:27 2022] GET /compute/v2.1/servers/d1f298aa-ebe3-4f52-ada6-137a782cd9b7 => generated 1486 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:39:27.903568 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-92246a1f-8945-4aa2-b9fe-e62d8528e563 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.8.167"}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:39:28.067472 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-92246a1f-8945-4aa2-b9fe-e62d8528e563 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] [instance: 5d937ba2-60f4-40cf-9ed8-a4a86d458e38] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:28.073818 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-92246a1f-8945-4aa2-b9fe-e62d8528e563 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:28.073818 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-92246a1f-8945-4aa2-b9fe-e62d8528e563 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:28.074331 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-92246a1f-8945-4aa2-b9fe-e62d8528e563 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:28.075132 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-92246a1f-8945-4aa2-b9fe-e62d8528e563 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:28.075603 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-92246a1f-8945-4aa2-b9fe-e62d8528e563 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:28.076072 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-92246a1f-8945-4aa2-b9fe-e62d8528e563 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:28.400642 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-92246a1f-8945-4aa2-b9fe-e62d8528e563 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] HTTP exception thrown: Floating IP 172.25.8.167 is not associated with instance 36d7eb4f-22bc-4047-bc75-6f69142daee5. Oct 04 18:39:28.402347 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-92246a1f-8945-4aa2-b9fe-e62d8528e563 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Request method failure captured: Oct 04 18:39:28.402347 n-d-851028-13 devstack@n-api.service[123596]: request: POST /compute/v2.1/servers/36d7eb4f-22bc-4047-bc75-6f69142daee5/action HTTP/1.1 Oct 04 18:39:28.402347 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:39:28.402347 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:39:28.402347 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:39:28.402347 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 49 Oct 04 18:39:28.402347 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:39:28.402347 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:39:28.402347 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:39:28.402347 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:39:28.402347 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPH2Wlo5mtodcx1M-NsUFN_Khv92vDz0zMPH8mVOTYTZ5OAT1gAk85Go0b9UJTpiT2nqrIBZHb1rGR6-5vJbaHohOtvXbKPJdv1EIpcmqFbBlLMUbRmU9t4jAnIhvhTQY821OOK2xswwXI2igtcdjh7FQoAwCHoYzR0kQUxybfNzYq9w Oct 04 18:39:28.402347 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:39:28.402347 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:39:28.402347 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:39:28.402347 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:39:28.402347 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:39:28.402347 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:39:28.402347 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: 87f4f9b0233b4fb29963b77248a236f7 Oct 04 18:39:28.402347 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-161697746 Oct 04 18:39:28.402347 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 18:39:28.402347 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 18:39:28.402347 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/87f4f9b0233b4fb29963b77248a236f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_87f4f9b0233b4fb29963b77248a236f7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/87f4f9b0233b4fb29963b77248a236f7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/87f4f9b0233b4fb29963b77248a236f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:39:28.402347 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-161697746 Oct 04 18:39:28.402347 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: 87f4f9b0233b4fb29963b77248a236f7 Oct 04 18:39:28.402347 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-161697746 Oct 04 18:39:28.402347 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-FloatingIPsAssociationTestJSON-161697746-project Oct 04 18:39:28.402347 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:39:28.402347 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:39:28.402347 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: eadce040fcf3427abab9ef8b0ca19400 Oct 04 18:39:28.402347 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-161697746-project Oct 04 18:39:28.402347 n-d-851028-13 devstack@n-api.service[123596]: Oct 04 18:39:28.402347 n-d-851028-13 devstack@n-api.service[123596]: {"removeFloatingIp": {"address": "172.25.8.167"}} Oct 04 18:39:28.402347 n-d-851028-13 devstack@n-api.service[123596]: method: Oct 04 18:39:28.402347 n-d-851028-13 devstack@n-api.service[123596]: exception: Floating IP 172.25.8.167 is not associated with instance 36d7eb4f-22bc-4047-bc75-6f69142daee5. Oct 04 18:39:28.402347 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': '36d7eb4f-22bc-4047-bc75-6f69142daee5', 'body': {'removeFloatingIp': {'address': '172.25.8.167'}}} Oct 04 18:39:28.402347 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:39:28.402347 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:39:28.402347 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:39:28.402347 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:39:28.402347 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:39:28.402347 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:39:28.402347 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:39:28.402347 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:39:28.402347 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:39:28.402347 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:39:28.402347 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:39:28.402347 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:39:28.402347 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 300, in _remove_floating_ip Oct 04 18:39:28.402347 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 04 18:39:28.402347 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Floating IP 172.25.8.167 is not associated with instance 36d7eb4f-22bc-4047-bc75-6f69142daee5. Oct 04 18:39:28.402347 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:39:28.402347 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:39:28.402347 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:39:28.402347 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:39:28.402347 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:39:28.402347 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:39:28.402347 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:39:28.402347 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:39:28.402347 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP 172.25.8.167 is not associated with instance 36d7eb4f-22bc-4047-bc75-6f69142daee5. Oct 04 18:39:28.402347 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:39:28.413665 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-92246a1f-8945-4aa2-b9fe-e62d8528e563 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Returning 409 to user: Floating IP 172.25.8.167 is not associated with instance 36d7eb4f-22bc-4047-bc75-6f69142daee5. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:39:28.414799 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-92246a1f-8945-4aa2-b9fe-e62d8528e563 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] 10.222.0.43 "POST /compute/v2.1/servers/36d7eb4f-22bc-4047-bc75-6f69142daee5/action" status: 409 len: 146 microversion: 2.1 time: 0.517709 Oct 04 18:39:28.416280 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1169/2155] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 18:39:27 2022] POST /compute/v2.1/servers/36d7eb4f-22bc-4047-bc75-6f69142daee5/action => generated 146 bytes in 520 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:39:28.424824 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-04170157-0cb7-4da5-8615-a1c7a2b4d007 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:28.425772 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-04170157-0cb7-4da5-8615-a1c7a2b4d007 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] [instance: a4de9e6e-90d3-4317-abf8-9fc8f021b803] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:28.433768 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-04170157-0cb7-4da5-8615-a1c7a2b4d007 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:28.434785 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-04170157-0cb7-4da5-8615-a1c7a2b4d007 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:28.435455 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-04170157-0cb7-4da5-8615-a1c7a2b4d007 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:28.436424 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-04170157-0cb7-4da5-8615-a1c7a2b4d007 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:28.437089 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-04170157-0cb7-4da5-8615-a1c7a2b4d007 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:28.450767 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-04170157-0cb7-4da5-8615-a1c7a2b4d007 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:28.632420 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-04170157-0cb7-4da5-8615-a1c7a2b4d007 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a19da94e9e646028a7f73f9d0e0edda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc41f296eb44503868205ec8aa2fef3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:28.636908 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:39:28.646956 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-04170157-0cb7-4da5-8615-a1c7a2b4d007 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] 10.222.0.43 "GET /compute/v2.1/servers/a4de9e6e-90d3-4317-abf8-9fc8f021b803" status: 200 len: 1321 microversion: 2.1 time: 0.228654 Oct 04 18:39:28.667356 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1170/2156] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:28 2022] GET /compute/v2.1/servers/a4de9e6e-90d3-4317-abf8-9fc8f021b803 => generated 1321 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:28.672979 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f649a7fd-2380-45e9-9bd1-cc99fbc94e72 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Calling method '.version_select at 0x7fb227eb1550>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:28.744999 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-f649a7fd-2380-45e9-9bd1-cc99fbc94e72 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] 10.222.0.43 "GET /compute/v2.1/images/8b9606ad-88f3-4647-bc18-c5885add126b" status: 200 len: 1453 microversion: 2.1 time: 0.076021 Oct 04 18:39:28.745987 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1171/2157] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 18:39:28 2022] GET /compute/v2.1/images/8b9606ad-88f3-4647-bc18-c5885add126b => generated 1453 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:28.752914 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-264f2c2c-f267-4861-8400-4e195cf0aae7 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:28.763316 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-264f2c2c-f267-4861-8400-4e195cf0aae7 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] HTTP exception thrown: Instance group 366a6915-c4df-49a1-8445-4a6f5b24c62c could not be found. Oct 04 18:39:28.771546 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-264f2c2c-f267-4861-8400-4e195cf0aae7 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Request method failure captured: Oct 04 18:39:28.771546 n-d-851028-13 devstack@n-api.service[123596]: request: DELETE /compute/v2.1/os-server-groups/366a6915-c4df-49a1-8445-4a6f5b24c62c HTTP/1.1 Oct 04 18:39:28.771546 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:39:28.771546 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:39:28.771546 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:39:28.771546 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 18:39:28.771546 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:39:28.771546 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:39:28.771546 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:39:28.771546 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:39:28.771546 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPH2pqQ0-ZftMLab_pzPrqYEgZyfWcNNZZ1BfK5sXjpIskjK9jjdNDn_UudxFMb5ZcEy61GPWPH4a7gB9mo5mh0kFvFHo_V08s4IpywIPUo-1KDJ9SZBo9z7bbYA6uENOWn04GexKLpQqRv7pcCQ-as1ctVZG5RYS36fAnubqzgfikxI Oct 04 18:39:28.771546 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:39:28.771546 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:39:28.771546 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:39:28.771546 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:39:28.771546 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:39:28.771546 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:39:28.771546 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: 5f3ca2b15fd24916ac47e08325464d75 Oct 04 18:39:28.771546 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-ServerGroupTestJSON-1457133461 Oct 04 18:39:28.771546 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 18:39:28.771546 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 18:39:28.771546 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/5f3ca2b15fd24916ac47e08325464d75"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_5f3ca2b15fd24916ac47e08325464d75"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5f3ca2b15fd24916ac47e08325464d75"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5f3ca2b15fd24916ac47e08325464d75"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:39:28.771546 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-ServerGroupTestJSON-1457133461 Oct 04 18:39:28.771546 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: 5f3ca2b15fd24916ac47e08325464d75 Oct 04 18:39:28.771546 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-ServerGroupTestJSON-1457133461 Oct 04 18:39:28.771546 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-ServerGroupTestJSON-1457133461-project Oct 04 18:39:28.771546 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:39:28.771546 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:39:28.771546 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 6daea1f7b0084009ac6e24181a1b87d7 Oct 04 18:39:28.771546 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-ServerGroupTestJSON-1457133461-project Oct 04 18:39:28.771546 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 18:39:28.771546 n-d-851028-13 devstack@n-api.service[123596]: exception: Instance group 366a6915-c4df-49a1-8445-4a6f5b24c62c could not be found. Oct 04 18:39:28.771546 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': '366a6915-c4df-49a1-8445-4a6f5b24c62c'} Oct 04 18:39:28.771546 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:39:28.771546 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:39:28.771546 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 04 18:39:28.771546 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 04 18:39:28.771546 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 18:39:28.771546 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 18:39:28.771546 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 04 18:39:28.771546 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 04 18:39:28.771546 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 18:39:28.771546 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 18:39:28.771546 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 04 18:39:28.771546 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 04 18:39:28.771546 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 366a6915-c4df-49a1-8445-4a6f5b24c62c could not be found. Oct 04 18:39:28.771546 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:39:28.771546 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:39:28.771546 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:39:28.771546 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:39:28.771546 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:39:28.771546 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:39:28.771546 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:39:28.771546 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:39:28.771546 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:39:28.771546 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:39:28.771546 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 04 18:39:28.771546 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:39:28.771546 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 366a6915-c4df-49a1-8445-4a6f5b24c62c could not be found. Oct 04 18:39:28.771546 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:39:28.771546 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:39:28.771546 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:39:28.771546 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:39:28.777333 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:39:28.777333 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:39:28.777333 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:39:28.777333 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:39:28.777333 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 366a6915-c4df-49a1-8445-4a6f5b24c62c could not be found. Oct 04 18:39:28.777333 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:39:28.780432 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-264f2c2c-f267-4861-8400-4e195cf0aae7 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Returning 404 to user: Instance group 366a6915-c4df-49a1-8445-4a6f5b24c62c could not be found. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:39:28.781525 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-264f2c2c-f267-4861-8400-4e195cf0aae7 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] 10.222.0.43 "DELETE /compute/v2.1/os-server-groups/366a6915-c4df-49a1-8445-4a6f5b24c62c" status: 404 len: 117 microversion: 2.1 time: 0.034327 Oct 04 18:39:28.790212 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1172/2158] 10.222.0.43 () {58 vars in 1266 bytes} [Tue Oct 4 18:39:28 2022] DELETE /compute/v2.1/os-server-groups/366a6915-c4df-49a1-8445-4a6f5b24c62c => generated 117 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:39:28.801997 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-684f7464-b80b-4536-9974-b578925f08e6 tempest-ServerAddressesTestJSON-638433160 tempest-ServerAddressesTestJSON-638433160-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:28.806193 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-684f7464-b80b-4536-9974-b578925f08e6 tempest-ServerAddressesTestJSON-638433160 tempest-ServerAddressesTestJSON-638433160-project] [instance: cdb73233-3522-4ddb-b7d4-463685e66bcc] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:28.838955 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-684f7464-b80b-4536-9974-b578925f08e6 tempest-ServerAddressesTestJSON-638433160 tempest-ServerAddressesTestJSON-638433160-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:28.843082 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-684f7464-b80b-4536-9974-b578925f08e6 tempest-ServerAddressesTestJSON-638433160 tempest-ServerAddressesTestJSON-638433160-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:28.843777 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-684f7464-b80b-4536-9974-b578925f08e6 tempest-ServerAddressesTestJSON-638433160 tempest-ServerAddressesTestJSON-638433160-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:28.847391 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-684f7464-b80b-4536-9974-b578925f08e6 tempest-ServerAddressesTestJSON-638433160 tempest-ServerAddressesTestJSON-638433160-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:28.849726 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-684f7464-b80b-4536-9974-b578925f08e6 tempest-ServerAddressesTestJSON-638433160 tempest-ServerAddressesTestJSON-638433160-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:28.850379 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-684f7464-b80b-4536-9974-b578925f08e6 tempest-ServerAddressesTestJSON-638433160 tempest-ServerAddressesTestJSON-638433160-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:29.092095 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-684f7464-b80b-4536-9974-b578925f08e6 tempest-ServerAddressesTestJSON-638433160 tempest-ServerAddressesTestJSON-638433160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c41b6ddac731410085f447c3f687ef7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b241fded901d40fca9db5b5a4862a428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:29.101129 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-684f7464-b80b-4536-9974-b578925f08e6 tempest-ServerAddressesTestJSON-638433160 tempest-ServerAddressesTestJSON-638433160-project] 10.222.0.43 "GET /compute/v2.1/servers/cdb73233-3522-4ddb-b7d4-463685e66bcc" status: 200 len: 1505 microversion: 2.1 time: 0.309355 Oct 04 18:39:29.113013 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1173/2159] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:28 2022] GET /compute/v2.1/servers/cdb73233-3522-4ddb-b7d4-463685e66bcc => generated 1505 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:29.130271 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-32d602bf-6c20-443b-9a9a-1933593a1a0c req-c2e7c4d9-4adf-485d-b64e-bd05faab05d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d365b7e-b516-4ae9-a1cd-7502e9d71041", "name": "network-vif-plugged", "status": "completed", "tag": "17040db4-9498-45bc-b84d-5459ad9740f2"}, {"server_uuid": "1a71ee0e-ffa8-4730-b4fb-8b6e9fd87239", "name": "network-vif-plugged", "status": "completed", "tag": "8da0ebc1-434a-4e48-b121-02b4d226123d"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:39:29.147989 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-32d602bf-6c20-443b-9a9a-1933593a1a0c req-c2e7c4d9-4adf-485d-b64e-bd05faab05d0 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:29.148485 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-32d602bf-6c20-443b-9a9a-1933593a1a0c req-c2e7c4d9-4adf-485d-b64e-bd05faab05d0 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:29.148928 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-32d602bf-6c20-443b-9a9a-1933593a1a0c req-c2e7c4d9-4adf-485d-b64e-bd05faab05d0 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:29.190906 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-32d602bf-6c20-443b-9a9a-1933593a1a0c req-c2e7c4d9-4adf-485d-b64e-bd05faab05d0 service nova] Creating event network-vif-plugged:17040db4-9498-45bc-b84d-5459ad9740f2 for instance 5d365b7e-b516-4ae9-a1cd-7502e9d71041 on n-h2-851028-13 Oct 04 18:39:29.191923 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-32d602bf-6c20-443b-9a9a-1933593a1a0c req-c2e7c4d9-4adf-485d-b64e-bd05faab05d0 service nova] Creating event network-vif-plugged:8da0ebc1-434a-4e48-b121-02b4d226123d for instance 1a71ee0e-ffa8-4730-b4fb-8b6e9fd87239 on n-h1-851028-13 Oct 04 18:39:29.204552 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-32d602bf-6c20-443b-9a9a-1933593a1a0c req-c2e7c4d9-4adf-485d-b64e-bd05faab05d0 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.080278 Oct 04 18:39:29.205543 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1174/2160] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:39:29 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:39:29.220982 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-51953b0f-c8d6-44f8-a523-7aa8ce645de5 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.8.167"}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:39:29.307985 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-38314524-6e0b-4064-bb2f-7c4c4549153d tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] 10.222.0.43 "DELETE /compute/v2.1/os-security-groups/0941539c-f752-482a-9d50-4c191967eac7" status: 202 len: 0 microversion: 2.1 time: 1.567423 Oct 04 18:39:29.309604 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 987/2161] 10.222.0.43 () {58 vars in 1272 bytes} [Tue Oct 4 18:39:27 2022] DELETE /compute/v2.1/os-security-groups/0941539c-f752-482a-9d50-4c191967eac7 => generated 0 bytes in 1569 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:39:29.315507 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-46fe8f3c-7bcc-4530-be60-c4f10a7ae026 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:29.317204 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-46fe8f3c-7bcc-4530-be60-c4f10a7ae026 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: d9d4332a-97b6-40f1-bd7c-a9a75a9adc43] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:29.334203 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-46fe8f3c-7bcc-4530-be60-c4f10a7ae026 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:29.341787 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-46fe8f3c-7bcc-4530-be60-c4f10a7ae026 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:29.345741 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-46fe8f3c-7bcc-4530-be60-c4f10a7ae026 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:29.346966 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-46fe8f3c-7bcc-4530-be60-c4f10a7ae026 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:29.350367 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-46fe8f3c-7bcc-4530-be60-c4f10a7ae026 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:29.351146 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-46fe8f3c-7bcc-4530-be60-c4f10a7ae026 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:29.480726 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-51953b0f-c8d6-44f8-a523-7aa8ce645de5 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] [instance: 5d937ba2-60f4-40cf-9ed8-a4a86d458e38] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:29.488539 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-51953b0f-c8d6-44f8-a523-7aa8ce645de5 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:29.489394 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-51953b0f-c8d6-44f8-a523-7aa8ce645de5 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:29.490657 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-51953b0f-c8d6-44f8-a523-7aa8ce645de5 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:29.493832 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-51953b0f-c8d6-44f8-a523-7aa8ce645de5 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:29.494584 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-51953b0f-c8d6-44f8-a523-7aa8ce645de5 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:29.495575 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-51953b0f-c8d6-44f8-a523-7aa8ce645de5 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:29.694941 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-46fe8f3c-7bcc-4530-be60-c4f10a7ae026 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:29.721789 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-46fe8f3c-7bcc-4530-be60-c4f10a7ae026 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/d9d4332a-97b6-40f1-bd7c-a9a75a9adc43" status: 200 len: 1537 microversion: 2.1 time: 0.405022 Oct 04 18:39:29.723073 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 988/2162] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:29 2022] GET /compute/v2.1/servers/d9d4332a-97b6-40f1-bd7c-a9a75a9adc43 => generated 1537 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:29.728203 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-da28b1b6-dc1a-4d86-aa10-15023b184c81 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:29.750267 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-da28b1b6-dc1a-4d86-aa10-15023b184c81 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] HTTP exception thrown: Instance group 55ec76e6-806e-4280-8e3f-7ec28afc26d8 could not be found. Oct 04 18:39:29.752322 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-da28b1b6-dc1a-4d86-aa10-15023b184c81 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Request method failure captured: Oct 04 18:39:29.752322 n-d-851028-13 devstack@n-api.service[123595]: request: DELETE /compute/v2.1/os-server-groups/55ec76e6-806e-4280-8e3f-7ec28afc26d8 HTTP/1.1 Oct 04 18:39:29.752322 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 18:39:29.752322 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 18:39:29.752322 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 18:39:29.752322 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 0 Oct 04 18:39:29.752322 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 18:39:29.752322 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 18:39:29.752322 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 18:39:29.752322 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 18:39:29.752322 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPH2pqQ0-ZftMLab_pzPrqYEgZyfWcNNZZ1BfK5sXjpIskjK9jjdNDn_UudxFMb5ZcEy61GPWPH4a7gB9mo5mh0kFvFHo_V08s4IpywIPUo-1KDJ9SZBo9z7bbYA6uENOWn04GexKLpQqRv7pcCQ-as1ctVZG5RYS36fAnubqzgfikxI Oct 04 18:39:29.752322 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 18:39:29.752322 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 18:39:29.752322 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 18:39:29.752322 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 18:39:29.752322 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 18:39:29.752322 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 18:39:29.752322 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: 5f3ca2b15fd24916ac47e08325464d75 Oct 04 18:39:29.752322 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-ServerGroupTestJSON-1457133461 Oct 04 18:39:29.752322 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 18:39:29.752322 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 18:39:29.752322 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/5f3ca2b15fd24916ac47e08325464d75"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_5f3ca2b15fd24916ac47e08325464d75"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5f3ca2b15fd24916ac47e08325464d75"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5f3ca2b15fd24916ac47e08325464d75"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:39:29.752322 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-ServerGroupTestJSON-1457133461 Oct 04 18:39:29.752322 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: 5f3ca2b15fd24916ac47e08325464d75 Oct 04 18:39:29.752322 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-ServerGroupTestJSON-1457133461 Oct 04 18:39:29.752322 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-ServerGroupTestJSON-1457133461-project Oct 04 18:39:29.752322 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 18:39:29.752322 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 18:39:29.752322 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: 6daea1f7b0084009ac6e24181a1b87d7 Oct 04 18:39:29.752322 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-ServerGroupTestJSON-1457133461-project Oct 04 18:39:29.752322 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 18:39:29.752322 n-d-851028-13 devstack@n-api.service[123595]: exception: Instance group 55ec76e6-806e-4280-8e3f-7ec28afc26d8 could not be found. Oct 04 18:39:29.752322 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': '55ec76e6-806e-4280-8e3f-7ec28afc26d8'} Oct 04 18:39:29.752322 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:39:29.752322 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:39:29.752322 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 04 18:39:29.752322 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 04 18:39:29.752322 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 18:39:29.752322 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 18:39:29.752322 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 04 18:39:29.752322 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 04 18:39:29.752322 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 18:39:29.752322 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 18:39:29.752322 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 04 18:39:29.752322 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 04 18:39:29.752322 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 55ec76e6-806e-4280-8e3f-7ec28afc26d8 could not be found. Oct 04 18:39:29.752322 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:39:29.752322 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:39:29.752322 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:39:29.752322 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:39:29.752322 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:39:29.752322 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:39:29.752322 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:39:29.752322 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:39:29.752322 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:39:29.752322 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:39:29.752322 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 04 18:39:29.752322 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:39:29.752322 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 55ec76e6-806e-4280-8e3f-7ec28afc26d8 could not be found. Oct 04 18:39:29.752322 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:39:29.752322 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:39:29.752322 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:39:29.752322 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:39:29.758919 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:39:29.758919 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:39:29.758919 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:39:29.758919 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:39:29.758919 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 55ec76e6-806e-4280-8e3f-7ec28afc26d8 could not be found. Oct 04 18:39:29.758919 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:39:29.758919 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-da28b1b6-dc1a-4d86-aa10-15023b184c81 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Returning 404 to user: Instance group 55ec76e6-806e-4280-8e3f-7ec28afc26d8 could not be found. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:39:29.758919 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-da28b1b6-dc1a-4d86-aa10-15023b184c81 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] 10.222.0.43 "DELETE /compute/v2.1/os-server-groups/55ec76e6-806e-4280-8e3f-7ec28afc26d8" status: 404 len: 117 microversion: 2.1 time: 0.029332 Oct 04 18:39:29.758919 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 989/2163] 10.222.0.43 () {58 vars in 1266 bytes} [Tue Oct 4 18:39:29 2022] DELETE /compute/v2.1/os-server-groups/55ec76e6-806e-4280-8e3f-7ec28afc26d8 => generated 117 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:39:29.763142 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-14c9d76e-7bd7-49de-bfd2-3a62edb155fe tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:29.763942 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-14c9d76e-7bd7-49de-bfd2-3a62edb155fe tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] [instance: d1f298aa-ebe3-4f52-ada6-137a782cd9b7] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:29.780287 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-51953b0f-c8d6-44f8-a523-7aa8ce645de5 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Acquiring lock "refresh_cache-5d937ba2-60f4-40cf-9ed8-a4a86d458e38" {{(pid=123596) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 04 18:39:29.780463 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-14c9d76e-7bd7-49de-bfd2-3a62edb155fe tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:29.780709 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-51953b0f-c8d6-44f8-a523-7aa8ce645de5 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Acquired lock "refresh_cache-5d937ba2-60f4-40cf-9ed8-a4a86d458e38" {{(pid=123596) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 04 18:39:29.780942 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-14c9d76e-7bd7-49de-bfd2-3a62edb155fe tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:29.781790 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-14c9d76e-7bd7-49de-bfd2-3a62edb155fe tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:29.782122 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-14c9d76e-7bd7-49de-bfd2-3a62edb155fe tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:29.782567 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-14c9d76e-7bd7-49de-bfd2-3a62edb155fe tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:29.782984 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-14c9d76e-7bd7-49de-bfd2-3a62edb155fe tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:30.112980 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-14c9d76e-7bd7-49de-bfd2-3a62edb155fe tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:30.123117 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-14c9d76e-7bd7-49de-bfd2-3a62edb155fe tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:30.124963 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-14c9d76e-7bd7-49de-bfd2-3a62edb155fe tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:30.126525 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-14c9d76e-7bd7-49de-bfd2-3a62edb155fe tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] 10.222.0.43 "GET /compute/v2.1/servers/d1f298aa-ebe3-4f52-ada6-137a782cd9b7" status: 200 len: 1486 microversion: 2.25 time: 0.367716 Oct 04 18:39:30.127385 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 990/2164] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:39:29 2022] GET /compute/v2.1/servers/d1f298aa-ebe3-4f52-ada6-137a782cd9b7 => generated 1486 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:39:30.132997 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-120a2c32-b14b-42f4-a593-7ba99c72fad4 tempest-ServerAddressesTestJSON-638433160 tempest-ServerAddressesTestJSON-638433160-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:30.133778 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-120a2c32-b14b-42f4-a593-7ba99c72fad4 tempest-ServerAddressesTestJSON-638433160 tempest-ServerAddressesTestJSON-638433160-project] [instance: cdb73233-3522-4ddb-b7d4-463685e66bcc] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:30.141233 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-120a2c32-b14b-42f4-a593-7ba99c72fad4 tempest-ServerAddressesTestJSON-638433160 tempest-ServerAddressesTestJSON-638433160-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:30.142562 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-120a2c32-b14b-42f4-a593-7ba99c72fad4 tempest-ServerAddressesTestJSON-638433160 tempest-ServerAddressesTestJSON-638433160-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:30.143219 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-120a2c32-b14b-42f4-a593-7ba99c72fad4 tempest-ServerAddressesTestJSON-638433160 tempest-ServerAddressesTestJSON-638433160-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:30.144104 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-120a2c32-b14b-42f4-a593-7ba99c72fad4 tempest-ServerAddressesTestJSON-638433160 tempest-ServerAddressesTestJSON-638433160-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:30.144717 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-120a2c32-b14b-42f4-a593-7ba99c72fad4 tempest-ServerAddressesTestJSON-638433160 tempest-ServerAddressesTestJSON-638433160-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:30.145334 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-120a2c32-b14b-42f4-a593-7ba99c72fad4 tempest-ServerAddressesTestJSON-638433160 tempest-ServerAddressesTestJSON-638433160-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:30.192686 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-120a2c32-b14b-42f4-a593-7ba99c72fad4 tempest-ServerAddressesTestJSON-638433160 tempest-ServerAddressesTestJSON-638433160-project] 10.222.0.43 "GET /compute/v2.1/servers/cdb73233-3522-4ddb-b7d4-463685e66bcc/ips" status: 200 len: 109 microversion: 2.1 time: 0.063543 Oct 04 18:39:30.193881 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 991/2165] 10.222.0.43 () {58 vars in 1248 bytes} [Tue Oct 4 18:39:30 2022] GET /compute/v2.1/servers/cdb73233-3522-4ddb-b7d4-463685e66bcc/ips => generated 109 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:39:30.198871 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-7a01c48f-b942-49ba-a471-7d6489486b4c tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Calling method '.version_select at 0x7fb21f9a21f0>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:30.289092 n-d-851028-13 devstack@n-api.service[123595]: DEBUG neutronclient.v2_0.client [None req-7a01c48f-b942-49ba-a471-7d6489486b4c tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 0941539c-f752-482a-9d50-4c191967eac7 does not exist", "detail": ""}} {{(pid=123595) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 18:39:30.289836 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.network.security_group_api [None req-7a01c48f-b942-49ba-a471-7d6489486b4c tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Neutron security group 0941539c-f752-482a-9d50-4c191967eac7 not found {{(pid=123595) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 04 18:39:30.290487 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-7a01c48f-b942-49ba-a471-7d6489486b4c tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] HTTP exception thrown: Security group 0941539c-f752-482a-9d50-4c191967eac7 does not exist Oct 04 18:39:30.290487 n-d-851028-13 devstack@n-api.service[123595]: Neutron server returns request_ids: ['req-9a48b488-90cb-4ecc-8a77-72de3528b07a'] Oct 04 18:39:30.292431 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-7a01c48f-b942-49ba-a471-7d6489486b4c tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Request method failure captured: Oct 04 18:39:30.292431 n-d-851028-13 devstack@n-api.service[123595]: request: GET /compute/v2.1/os-security-groups/0941539c-f752-482a-9d50-4c191967eac7 HTTP/1.1 Oct 04 18:39:30.292431 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 18:39:30.292431 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 18:39:30.292431 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 18:39:30.292431 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 0 Oct 04 18:39:30.292431 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 18:39:30.292431 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 18:39:30.292431 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 18:39:30.292431 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 18:39:30.292431 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPH2qE2WsiZvVd-vvN1M8uHJG40fIXDT1XURP-P4ciVfKnbP_2tplzYndj2wlvB6bSu_VMaD1xfU0nGHRYWQRmNIt_krh_S1n2RkrhietTC0-RnvJ1rzF8ilPx8zowbVefo7A8IyDn5QTaMC08kHUNyiYinJQT_Q7n9enahWrBitVOPM Oct 04 18:39:30.292431 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 18:39:30.292431 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 18:39:30.292431 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 18:39:30.292431 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 18:39:30.292431 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 18:39:30.292431 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 18:39:30.292431 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: 7b812c85494a49898376a0dd8140f03c Oct 04 18:39:30.292431 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-SecurityGroupsTestJSON-209295605 Oct 04 18:39:30.292431 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 18:39:30.292431 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 18:39:30.292431 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/7b812c85494a49898376a0dd8140f03c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_7b812c85494a49898376a0dd8140f03c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/7b812c85494a49898376a0dd8140f03c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/7b812c85494a49898376a0dd8140f03c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:39:30.292431 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-SecurityGroupsTestJSON-209295605 Oct 04 18:39:30.292431 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: 7b812c85494a49898376a0dd8140f03c Oct 04 18:39:30.292431 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-209295605 Oct 04 18:39:30.292431 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-SecurityGroupsTestJSON-209295605-project Oct 04 18:39:30.292431 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 18:39:30.292431 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 18:39:30.292431 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: 5c96ec8b8e0a4053b0457f213e6e262d Oct 04 18:39:30.292431 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-SecurityGroupsTestJSON-209295605-project Oct 04 18:39:30.292431 n-d-851028-13 devstack@n-api.service[123595]: method: Oct 04 18:39:30.292431 n-d-851028-13 devstack@n-api.service[123595]: exception: Security group 0941539c-f752-482a-9d50-4c191967eac7 does not exist Oct 04 18:39:30.292431 n-d-851028-13 devstack@n-api.service[123595]: Neutron server returns request_ids: ['req-9a48b488-90cb-4ecc-8a77-72de3528b07a'] Oct 04 18:39:30.292431 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': '0941539c-f752-482a-9d50-4c191967eac7'} Oct 04 18:39:30.292431 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:39:30.292431 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:39:30.292431 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 04 18:39:30.292431 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 04 18:39:30.292431 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:39:30.292431 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:39:30.292431 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 04 18:39:30.292431 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 04 18:39:30.292431 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:39:30.292431 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:39:30.292431 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 18:39:30.292431 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 18:39:30.292431 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:39:30.292431 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:39:30.292431 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 18:39:30.292431 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 18:39:30.292431 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:39:30.292431 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:39:30.292431 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 18:39:30.292431 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 18:39:30.292431 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:39:30.292431 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:39:30.292431 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 18:39:30.292431 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 18:39:30.292431 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 18:39:30.292431 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 18:39:30.292431 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 0941539c-f752-482a-9d50-4c191967eac7 does not exist Oct 04 18:39:30.297705 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9a48b488-90cb-4ecc-8a77-72de3528b07a'] Oct 04 18:39:30.297705 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:39:30.297705 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:39:30.297705 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:39:30.297705 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:39:30.297705 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 04 18:39:30.297705 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 04 18:39:30.297705 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 04 18:39:30.297705 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 18:39:30.297705 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 0941539c-f752-482a-9d50-4c191967eac7 does not exist Oct 04 18:39:30.297705 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9a48b488-90cb-4ecc-8a77-72de3528b07a'] Oct 04 18:39:30.297705 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:39:30.297705 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:39:30.297705 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:39:30.297705 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:39:30.297705 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:39:30.297705 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:39:30.297705 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:39:30.297705 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:39:30.297705 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:39:30.297705 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:39:30.297705 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:39:30.297705 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:39:30.297705 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 04 18:39:30.297705 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 04 18:39:30.297705 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 0941539c-f752-482a-9d50-4c191967eac7 does not exist Oct 04 18:39:30.297705 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9a48b488-90cb-4ecc-8a77-72de3528b07a'] Oct 04 18:39:30.297705 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:39:30.297705 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:39:30.297705 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:39:30.297705 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:39:30.297705 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:39:30.297705 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:39:30.297705 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:39:30.297705 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:39:30.297705 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 0941539c-f752-482a-9d50-4c191967eac7 does not exist Oct 04 18:39:30.297705 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9a48b488-90cb-4ecc-8a77-72de3528b07a'] Oct 04 18:39:30.297705 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:39:30.297705 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-7a01c48f-b942-49ba-a471-7d6489486b4c tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Returning 404 to user: Security group 0941539c-f752-482a-9d50-4c191967eac7 does not exist Oct 04 18:39:30.297705 n-d-851028-13 devstack@n-api.service[123595]: Neutron server returns request_ids: ['req-9a48b488-90cb-4ecc-8a77-72de3528b07a'] {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:39:30.297705 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-7a01c48f-b942-49ba-a471-7d6489486b4c tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] 10.222.0.43 "GET /compute/v2.1/os-security-groups/0941539c-f752-482a-9d50-4c191967eac7" status: 404 len: 194 microversion: 2.1 time: 0.099917 Oct 04 18:39:30.300665 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 992/2166] 10.222.0.43 () {58 vars in 1269 bytes} [Tue Oct 4 18:39:30 2022] GET /compute/v2.1/os-security-groups/0941539c-f752-482a-9d50-4c191967eac7 => generated 194 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:39:30.308686 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-aaf38fe2-e8a1-48a2-b573-374e0744909e tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:30.313912 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-aaf38fe2-e8a1-48a2-b573-374e0744909e tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] [instance: a4de9e6e-90d3-4317-abf8-9fc8f021b803] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:30.350704 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-aaf38fe2-e8a1-48a2-b573-374e0744909e tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:30.352242 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-aaf38fe2-e8a1-48a2-b573-374e0744909e tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:30.357514 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-aaf38fe2-e8a1-48a2-b573-374e0744909e tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:30.360228 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-aaf38fe2-e8a1-48a2-b573-374e0744909e tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:30.360737 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-aaf38fe2-e8a1-48a2-b573-374e0744909e tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:30.362960 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-aaf38fe2-e8a1-48a2-b573-374e0744909e tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:30.665228 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-aaf38fe2-e8a1-48a2-b573-374e0744909e tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a19da94e9e646028a7f73f9d0e0edda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc41f296eb44503868205ec8aa2fef3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:30.676849 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-aaf38fe2-e8a1-48a2-b573-374e0744909e tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] 10.222.0.43 "GET /compute/v2.1/servers/a4de9e6e-90d3-4317-abf8-9fc8f021b803" status: 200 len: 1321 microversion: 2.1 time: 0.377889 Oct 04 18:39:30.691851 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 993/2167] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:30 2022] GET /compute/v2.1/servers/a4de9e6e-90d3-4317-abf8-9fc8f021b803 => generated 1321 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:30.691851 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-b4f99ed3-964d-4eb3-80bc-053907d9187e tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Calling method '.version_select at 0x7fb21fe65af0>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:30.787056 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-b4f99ed3-964d-4eb3-80bc-053907d9187e tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] 10.222.0.43 "GET /compute/v2.1/images/8b9606ad-88f3-4647-bc18-c5885add126b" status: 200 len: 1453 microversion: 2.1 time: 0.107682 Oct 04 18:39:30.792385 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.network.neutron [None req-51953b0f-c8d6-44f8-a523-7aa8ce645de5 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] [instance: 5d937ba2-60f4-40cf-9ed8-a4a86d458e38] Building network info cache for instance {{(pid=123596) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 04 18:39:30.799338 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 994/2168] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 18:39:30 2022] GET /compute/v2.1/images/8b9606ad-88f3-4647-bc18-c5885add126b => generated 1453 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:30.811696 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-9b55b465-03c0-401c-b17f-b546c0ff2464 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:30.846599 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-9b55b465-03c0-401c-b17f-b546c0ff2464 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] HTTP exception thrown: Instance group c4b18a44-0e8f-41f7-90d4-f53d3a5eaac4 could not be found. Oct 04 18:39:30.848471 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-9b55b465-03c0-401c-b17f-b546c0ff2464 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Request method failure captured: Oct 04 18:39:30.848471 n-d-851028-13 devstack@n-api.service[123595]: request: DELETE /compute/v2.1/os-server-groups/c4b18a44-0e8f-41f7-90d4-f53d3a5eaac4 HTTP/1.1 Oct 04 18:39:30.848471 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 18:39:30.848471 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 18:39:30.848471 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 18:39:30.848471 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 0 Oct 04 18:39:30.848471 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 18:39:30.848471 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 18:39:30.848471 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 18:39:30.848471 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 18:39:30.848471 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPH2pqQ0-ZftMLab_pzPrqYEgZyfWcNNZZ1BfK5sXjpIskjK9jjdNDn_UudxFMb5ZcEy61GPWPH4a7gB9mo5mh0kFvFHo_V08s4IpywIPUo-1KDJ9SZBo9z7bbYA6uENOWn04GexKLpQqRv7pcCQ-as1ctVZG5RYS36fAnubqzgfikxI Oct 04 18:39:30.848471 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 18:39:30.848471 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 18:39:30.848471 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 18:39:30.848471 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 18:39:30.848471 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 18:39:30.848471 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 18:39:30.848471 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: 5f3ca2b15fd24916ac47e08325464d75 Oct 04 18:39:30.848471 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-ServerGroupTestJSON-1457133461 Oct 04 18:39:30.848471 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 18:39:30.848471 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 18:39:30.848471 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/5f3ca2b15fd24916ac47e08325464d75"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_5f3ca2b15fd24916ac47e08325464d75"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5f3ca2b15fd24916ac47e08325464d75"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5f3ca2b15fd24916ac47e08325464d75"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:39:30.848471 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-ServerGroupTestJSON-1457133461 Oct 04 18:39:30.848471 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: 5f3ca2b15fd24916ac47e08325464d75 Oct 04 18:39:30.848471 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-ServerGroupTestJSON-1457133461 Oct 04 18:39:30.848471 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-ServerGroupTestJSON-1457133461-project Oct 04 18:39:30.848471 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 18:39:30.848471 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 18:39:30.848471 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: 6daea1f7b0084009ac6e24181a1b87d7 Oct 04 18:39:30.848471 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-ServerGroupTestJSON-1457133461-project Oct 04 18:39:30.848471 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 18:39:30.848471 n-d-851028-13 devstack@n-api.service[123595]: exception: Instance group c4b18a44-0e8f-41f7-90d4-f53d3a5eaac4 could not be found. Oct 04 18:39:30.848471 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': 'c4b18a44-0e8f-41f7-90d4-f53d3a5eaac4'} Oct 04 18:39:30.848471 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:39:30.848471 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:39:30.848471 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 04 18:39:30.848471 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 04 18:39:30.848471 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 18:39:30.848471 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 18:39:30.848471 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 04 18:39:30.848471 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 04 18:39:30.848471 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 18:39:30.848471 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 18:39:30.848471 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 04 18:39:30.848471 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 04 18:39:30.848471 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group c4b18a44-0e8f-41f7-90d4-f53d3a5eaac4 could not be found. Oct 04 18:39:30.848471 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:39:30.848471 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:39:30.848471 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:39:30.848471 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:39:30.848471 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:39:30.848471 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:39:30.848471 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:39:30.848471 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:39:30.848471 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:39:30.848471 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:39:30.848471 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 04 18:39:30.848471 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:39:30.848471 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group c4b18a44-0e8f-41f7-90d4-f53d3a5eaac4 could not be found. Oct 04 18:39:30.848471 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:39:30.848471 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:39:30.848471 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:39:30.848471 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:39:30.854226 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:39:30.854226 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:39:30.854226 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:39:30.854226 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:39:30.854226 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group c4b18a44-0e8f-41f7-90d4-f53d3a5eaac4 could not be found. Oct 04 18:39:30.854226 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:39:30.858354 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-9b55b465-03c0-401c-b17f-b546c0ff2464 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Returning 404 to user: Instance group c4b18a44-0e8f-41f7-90d4-f53d3a5eaac4 could not be found. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:39:30.859505 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-9b55b465-03c0-401c-b17f-b546c0ff2464 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] 10.222.0.43 "DELETE /compute/v2.1/os-server-groups/c4b18a44-0e8f-41f7-90d4-f53d3a5eaac4" status: 404 len: 117 microversion: 2.1 time: 0.056813 Oct 04 18:39:30.860704 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 995/2169] 10.222.0.43 () {58 vars in 1266 bytes} [Tue Oct 4 18:39:30 2022] DELETE /compute/v2.1/os-server-groups/c4b18a44-0e8f-41f7-90d4-f53d3a5eaac4 => generated 117 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:39:30.874480 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-8cf5a962-8096-41e7-b812-1c52cd34c491 tempest-ServerAddressesTestJSON-638433160 tempest-ServerAddressesTestJSON-638433160-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:30.874998 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-8cf5a962-8096-41e7-b812-1c52cd34c491 tempest-ServerAddressesTestJSON-638433160 tempest-ServerAddressesTestJSON-638433160-project] [instance: cdb73233-3522-4ddb-b7d4-463685e66bcc] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:30.895535 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8cf5a962-8096-41e7-b812-1c52cd34c491 tempest-ServerAddressesTestJSON-638433160 tempest-ServerAddressesTestJSON-638433160-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:30.896338 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8cf5a962-8096-41e7-b812-1c52cd34c491 tempest-ServerAddressesTestJSON-638433160 tempest-ServerAddressesTestJSON-638433160-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:30.896797 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8cf5a962-8096-41e7-b812-1c52cd34c491 tempest-ServerAddressesTestJSON-638433160 tempest-ServerAddressesTestJSON-638433160-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:30.901157 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8cf5a962-8096-41e7-b812-1c52cd34c491 tempest-ServerAddressesTestJSON-638433160 tempest-ServerAddressesTestJSON-638433160-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:30.901916 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8cf5a962-8096-41e7-b812-1c52cd34c491 tempest-ServerAddressesTestJSON-638433160 tempest-ServerAddressesTestJSON-638433160-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:30.902387 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8cf5a962-8096-41e7-b812-1c52cd34c491 tempest-ServerAddressesTestJSON-638433160 tempest-ServerAddressesTestJSON-638433160-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:30.960757 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-8cf5a962-8096-41e7-b812-1c52cd34c491 tempest-ServerAddressesTestJSON-638433160 tempest-ServerAddressesTestJSON-638433160-project] 10.222.0.43 "GET /compute/v2.1/servers/cdb73233-3522-4ddb-b7d4-463685e66bcc/ips" status: 200 len: 109 microversion: 2.1 time: 0.094749 Oct 04 18:39:30.971034 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 996/2170] 10.222.0.43 () {58 vars in 1248 bytes} [Tue Oct 4 18:39:30 2022] GET /compute/v2.1/servers/cdb73233-3522-4ddb-b7d4-463685e66bcc/ips => generated 109 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:39:30.984682 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-ad69121a-6fcc-4816-a86b-86f394e7c576 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Calling method '.version_select at 0x7fb21f9a2f70>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:31.480676 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-ad69121a-6fcc-4816-a86b-86f394e7c576 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] 10.222.0.43 "DELETE /compute/v2.1/os-security-groups/a2a35cbf-fccc-4ba6-b493-2ef76c8c84ea" status: 202 len: 0 microversion: 2.1 time: 0.508370 Oct 04 18:39:31.483199 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 997/2171] 10.222.0.43 () {58 vars in 1272 bytes} [Tue Oct 4 18:39:30 2022] DELETE /compute/v2.1/os-security-groups/a2a35cbf-fccc-4ba6-b493-2ef76c8c84ea => generated 0 bytes in 512 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:39:31.488626 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-6815f606-5132-47b9-9df1-edbc76984e38 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:31.489763 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-6815f606-5132-47b9-9df1-edbc76984e38 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: d9d4332a-97b6-40f1-bd7c-a9a75a9adc43] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:31.508497 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6815f606-5132-47b9-9df1-edbc76984e38 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:31.509474 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6815f606-5132-47b9-9df1-edbc76984e38 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:31.510824 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6815f606-5132-47b9-9df1-edbc76984e38 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:31.513698 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6815f606-5132-47b9-9df1-edbc76984e38 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:31.514353 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6815f606-5132-47b9-9df1-edbc76984e38 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:31.515011 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6815f606-5132-47b9-9df1-edbc76984e38 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:31.835879 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-6815f606-5132-47b9-9df1-edbc76984e38 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:31.853561 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-6815f606-5132-47b9-9df1-edbc76984e38 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/d9d4332a-97b6-40f1-bd7c-a9a75a9adc43" status: 200 len: 1542 microversion: 2.1 time: 0.361177 Oct 04 18:39:31.854339 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 998/2172] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:31 2022] GET /compute/v2.1/servers/d9d4332a-97b6-40f1-bd7c-a9a75a9adc43 => generated 1542 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:31.864187 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-1835b8fc-11b6-4f85-b29d-48e0bc7b7cca req-d90d70e4-756f-4016-85fc-f77b5b370759 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d937ba2-60f4-40cf-9ed8-a4a86d458e38", "tag": "568dee2e-5618-4d07-a3bd-4aaf5000f435"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:39:31.899854 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-1835b8fc-11b6-4f85-b29d-48e0bc7b7cca req-d90d70e4-756f-4016-85fc-f77b5b370759 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:31.901991 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-1835b8fc-11b6-4f85-b29d-48e0bc7b7cca req-d90d70e4-756f-4016-85fc-f77b5b370759 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:31.904135 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-1835b8fc-11b6-4f85-b29d-48e0bc7b7cca req-d90d70e4-756f-4016-85fc-f77b5b370759 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:31.946587 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-1835b8fc-11b6-4f85-b29d-48e0bc7b7cca req-d90d70e4-756f-4016-85fc-f77b5b370759 service nova] Creating event network-changed:568dee2e-5618-4d07-a3bd-4aaf5000f435 for instance 5d937ba2-60f4-40cf-9ed8-a4a86d458e38 on n-h1-851028-13 Oct 04 18:39:31.962331 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-1835b8fc-11b6-4f85-b29d-48e0bc7b7cca req-d90d70e4-756f-4016-85fc-f77b5b370759 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104938 Oct 04 18:39:31.966499 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 999/2173] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:39:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:39:31.979819 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-a9c39c6d-3a5d-4a24-952c-173758c54c19 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:32.001849 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-a9c39c6d-3a5d-4a24-952c-173758c54c19 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] HTTP exception thrown: Instance group f39c1ded-8cb0-4d0c-aad2-e89edaaed42f could not be found. Oct 04 18:39:32.009637 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-a9c39c6d-3a5d-4a24-952c-173758c54c19 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Request method failure captured: Oct 04 18:39:32.009637 n-d-851028-13 devstack@n-api.service[123595]: request: DELETE /compute/v2.1/os-server-groups/f39c1ded-8cb0-4d0c-aad2-e89edaaed42f HTTP/1.1 Oct 04 18:39:32.009637 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 18:39:32.009637 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 18:39:32.009637 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 18:39:32.009637 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 0 Oct 04 18:39:32.009637 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 18:39:32.009637 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 18:39:32.009637 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 18:39:32.009637 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 18:39:32.009637 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPH2pqQ0-ZftMLab_pzPrqYEgZyfWcNNZZ1BfK5sXjpIskjK9jjdNDn_UudxFMb5ZcEy61GPWPH4a7gB9mo5mh0kFvFHo_V08s4IpywIPUo-1KDJ9SZBo9z7bbYA6uENOWn04GexKLpQqRv7pcCQ-as1ctVZG5RYS36fAnubqzgfikxI Oct 04 18:39:32.009637 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 18:39:32.009637 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 18:39:32.009637 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 18:39:32.009637 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 18:39:32.009637 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 18:39:32.009637 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 18:39:32.009637 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: 5f3ca2b15fd24916ac47e08325464d75 Oct 04 18:39:32.009637 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-ServerGroupTestJSON-1457133461 Oct 04 18:39:32.009637 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 18:39:32.009637 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 18:39:32.009637 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/5f3ca2b15fd24916ac47e08325464d75"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_5f3ca2b15fd24916ac47e08325464d75"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5f3ca2b15fd24916ac47e08325464d75"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5f3ca2b15fd24916ac47e08325464d75"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:39:32.009637 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-ServerGroupTestJSON-1457133461 Oct 04 18:39:32.009637 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: 5f3ca2b15fd24916ac47e08325464d75 Oct 04 18:39:32.009637 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-ServerGroupTestJSON-1457133461 Oct 04 18:39:32.009637 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-ServerGroupTestJSON-1457133461-project Oct 04 18:39:32.009637 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 18:39:32.009637 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 18:39:32.009637 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: 6daea1f7b0084009ac6e24181a1b87d7 Oct 04 18:39:32.009637 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-ServerGroupTestJSON-1457133461-project Oct 04 18:39:32.009637 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 18:39:32.009637 n-d-851028-13 devstack@n-api.service[123595]: exception: Instance group f39c1ded-8cb0-4d0c-aad2-e89edaaed42f could not be found. Oct 04 18:39:32.009637 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': 'f39c1ded-8cb0-4d0c-aad2-e89edaaed42f'} Oct 04 18:39:32.009637 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:39:32.009637 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:39:32.009637 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 04 18:39:32.009637 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 04 18:39:32.009637 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 18:39:32.009637 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 18:39:32.009637 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 04 18:39:32.009637 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 04 18:39:32.009637 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 18:39:32.009637 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 18:39:32.009637 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 04 18:39:32.009637 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 04 18:39:32.009637 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group f39c1ded-8cb0-4d0c-aad2-e89edaaed42f could not be found. Oct 04 18:39:32.009637 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:39:32.009637 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:39:32.009637 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:39:32.009637 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:39:32.009637 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:39:32.009637 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:39:32.009637 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:39:32.009637 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:39:32.009637 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:39:32.009637 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:39:32.009637 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 04 18:39:32.009637 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:39:32.009637 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group f39c1ded-8cb0-4d0c-aad2-e89edaaed42f could not be found. Oct 04 18:39:32.009637 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:39:32.009637 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:39:32.009637 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:39:32.009637 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:39:32.016946 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:39:32.016946 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:39:32.016946 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:39:32.016946 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:39:32.016946 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group f39c1ded-8cb0-4d0c-aad2-e89edaaed42f could not be found. Oct 04 18:39:32.016946 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:39:32.018916 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-a9c39c6d-3a5d-4a24-952c-173758c54c19 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Returning 404 to user: Instance group f39c1ded-8cb0-4d0c-aad2-e89edaaed42f could not be found. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:39:32.021954 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-a9c39c6d-3a5d-4a24-952c-173758c54c19 tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] 10.222.0.43 "DELETE /compute/v2.1/os-server-groups/f39c1ded-8cb0-4d0c-aad2-e89edaaed42f" status: 404 len: 117 microversion: 2.1 time: 0.052675 Oct 04 18:39:32.024038 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1000/2174] 10.222.0.43 () {58 vars in 1266 bytes} [Tue Oct 4 18:39:31 2022] DELETE /compute/v2.1/os-server-groups/f39c1ded-8cb0-4d0c-aad2-e89edaaed42f => generated 117 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:39:32.036257 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-34688617-02f2-4dc0-8e1c-64521e16de59 tempest-ServerAddressesTestJSON-638433160 tempest-ServerAddressesTestJSON-638433160-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:32.039823 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-34688617-02f2-4dc0-8e1c-64521e16de59 tempest-ServerAddressesTestJSON-638433160 tempest-ServerAddressesTestJSON-638433160-project] [instance: cdb73233-3522-4ddb-b7d4-463685e66bcc] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:32.058858 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-34688617-02f2-4dc0-8e1c-64521e16de59 tempest-ServerAddressesTestJSON-638433160 tempest-ServerAddressesTestJSON-638433160-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:32.060935 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-34688617-02f2-4dc0-8e1c-64521e16de59 tempest-ServerAddressesTestJSON-638433160 tempest-ServerAddressesTestJSON-638433160-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:32.061730 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-34688617-02f2-4dc0-8e1c-64521e16de59 tempest-ServerAddressesTestJSON-638433160 tempest-ServerAddressesTestJSON-638433160-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:32.062702 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-34688617-02f2-4dc0-8e1c-64521e16de59 tempest-ServerAddressesTestJSON-638433160 tempest-ServerAddressesTestJSON-638433160-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:32.064168 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-34688617-02f2-4dc0-8e1c-64521e16de59 tempest-ServerAddressesTestJSON-638433160 tempest-ServerAddressesTestJSON-638433160-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:32.066224 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-34688617-02f2-4dc0-8e1c-64521e16de59 tempest-ServerAddressesTestJSON-638433160 tempest-ServerAddressesTestJSON-638433160-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:32.142475 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-34688617-02f2-4dc0-8e1c-64521e16de59 tempest-ServerAddressesTestJSON-638433160 tempest-ServerAddressesTestJSON-638433160-project] 10.222.0.43 "GET /compute/v2.1/servers/cdb73233-3522-4ddb-b7d4-463685e66bcc/ips/tempest-ServerAddressesTestJSON-1443568012-network" status: 200 len: 94 microversion: 2.1 time: 0.116731 Oct 04 18:39:32.144535 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1001/2175] 10.222.0.43 () {58 vars in 1401 bytes} [Tue Oct 4 18:39:32 2022] GET /compute/v2.1/servers/cdb73233-3522-4ddb-b7d4-463685e66bcc/ips/tempest-ServerAddressesTestJSON-1443568012-network => generated 94 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:39:32.150153 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-d160a1eb-be1f-4d2f-98f2-3dd3dc6f4abf tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:32.151064 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-d160a1eb-be1f-4d2f-98f2-3dd3dc6f4abf tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] [instance: d1f298aa-ebe3-4f52-ada6-137a782cd9b7] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:32.158913 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d160a1eb-be1f-4d2f-98f2-3dd3dc6f4abf tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:32.159959 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d160a1eb-be1f-4d2f-98f2-3dd3dc6f4abf tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:32.160717 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d160a1eb-be1f-4d2f-98f2-3dd3dc6f4abf tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:32.161703 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d160a1eb-be1f-4d2f-98f2-3dd3dc6f4abf tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:32.162330 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d160a1eb-be1f-4d2f-98f2-3dd3dc6f4abf tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:32.162943 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d160a1eb-be1f-4d2f-98f2-3dd3dc6f4abf tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:32.538661 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.network.neutron [None req-51953b0f-c8d6-44f8-a523-7aa8ce645de5 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] [instance: 5d937ba2-60f4-40cf-9ed8-a4a86d458e38] Updating instance_info_cache with network_info: [{"id": "568dee2e-5618-4d07-a3bd-4aaf5000f435", "address": "fa:16:3e:36:50:48", "network": {"id": "8c78b501-c0dc-4b4a-aea6-b08dc5b06498", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1071307667-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "87f4f9b0233b4fb29963b77248a236f7", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap568dee2e-56", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=123596) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 04 18:39:32.576666 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-51953b0f-c8d6-44f8-a523-7aa8ce645de5 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Releasing lock "refresh_cache-5d937ba2-60f4-40cf-9ed8-a4a86d458e38" {{(pid=123596) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 04 18:39:32.578043 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-51953b0f-c8d6-44f8-a523-7aa8ce645de5 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] 10.222.0.43 "POST /compute/v2.1/servers/5d937ba2-60f4-40cf-9ed8-a4a86d458e38/action" status: 202 len: 0 microversion: 2.1 time: 3.370855 Oct 04 18:39:32.578754 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1175/2176] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 18:39:29 2022] POST /compute/v2.1/servers/5d937ba2-60f4-40cf-9ed8-a4a86d458e38/action => generated 0 bytes in 3372 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 04 18:39:32.589088 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-04b7229e-5b2c-4280-a79c-62795223ccdc tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Calling method '.version_select at 0x7fb227cf33a0>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:32.592797 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-d160a1eb-be1f-4d2f-98f2-3dd3dc6f4abf tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:32.606937 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-d160a1eb-be1f-4d2f-98f2-3dd3dc6f4abf tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:32.611962 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-d160a1eb-be1f-4d2f-98f2-3dd3dc6f4abf tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:32.615184 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-d160a1eb-be1f-4d2f-98f2-3dd3dc6f4abf tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] 10.222.0.43 "GET /compute/v2.1/servers/d1f298aa-ebe3-4f52-ada6-137a782cd9b7" status: 200 len: 1486 microversion: 2.25 time: 0.468940 Oct 04 18:39:32.615772 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1002/2177] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:39:32 2022] GET /compute/v2.1/servers/d1f298aa-ebe3-4f52-ada6-137a782cd9b7 => generated 1486 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:39:32.623218 n-d-851028-13 devstack@n-api.service[123596]: DEBUG neutronclient.v2_0.client [None req-04b7229e-5b2c-4280-a79c-62795223ccdc tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group a2a35cbf-fccc-4ba6-b493-2ef76c8c84ea does not exist", "detail": ""}} {{(pid=123596) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 18:39:32.623917 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.network.security_group_api [None req-04b7229e-5b2c-4280-a79c-62795223ccdc tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Neutron security group a2a35cbf-fccc-4ba6-b493-2ef76c8c84ea not found {{(pid=123596) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 04 18:39:32.624697 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-04b7229e-5b2c-4280-a79c-62795223ccdc tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] HTTP exception thrown: Security group a2a35cbf-fccc-4ba6-b493-2ef76c8c84ea does not exist Oct 04 18:39:32.624697 n-d-851028-13 devstack@n-api.service[123596]: Neutron server returns request_ids: ['req-29be7b98-d5cd-428f-b951-069d6703d57e'] Oct 04 18:39:32.628130 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-9f08cf7c-c2d1-484f-9d34-9bdc01a184bd tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:32.628311 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-04b7229e-5b2c-4280-a79c-62795223ccdc tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Request method failure captured: Oct 04 18:39:32.628311 n-d-851028-13 devstack@n-api.service[123596]: request: GET /compute/v2.1/os-security-groups/a2a35cbf-fccc-4ba6-b493-2ef76c8c84ea HTTP/1.1 Oct 04 18:39:32.628311 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:39:32.628311 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:39:32.628311 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:39:32.628311 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 18:39:32.628311 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:39:32.628311 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:39:32.628311 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:39:32.628311 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:39:32.628311 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPH2qE2WsiZvVd-vvN1M8uHJG40fIXDT1XURP-P4ciVfKnbP_2tplzYndj2wlvB6bSu_VMaD1xfU0nGHRYWQRmNIt_krh_S1n2RkrhietTC0-RnvJ1rzF8ilPx8zowbVefo7A8IyDn5QTaMC08kHUNyiYinJQT_Q7n9enahWrBitVOPM Oct 04 18:39:32.628311 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:39:32.628311 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:39:32.628311 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:39:32.628311 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:39:32.628311 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:39:32.628311 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:39:32.628311 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: 7b812c85494a49898376a0dd8140f03c Oct 04 18:39:32.628311 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-SecurityGroupsTestJSON-209295605 Oct 04 18:39:32.628311 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 18:39:32.628311 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 18:39:32.628311 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/7b812c85494a49898376a0dd8140f03c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_7b812c85494a49898376a0dd8140f03c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/7b812c85494a49898376a0dd8140f03c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/7b812c85494a49898376a0dd8140f03c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:39:32.628311 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-SecurityGroupsTestJSON-209295605 Oct 04 18:39:32.628311 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: 7b812c85494a49898376a0dd8140f03c Oct 04 18:39:32.628311 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-209295605 Oct 04 18:39:32.628311 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-SecurityGroupsTestJSON-209295605-project Oct 04 18:39:32.628311 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:39:32.628311 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:39:32.628311 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 5c96ec8b8e0a4053b0457f213e6e262d Oct 04 18:39:32.628311 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-SecurityGroupsTestJSON-209295605-project Oct 04 18:39:32.628311 n-d-851028-13 devstack@n-api.service[123596]: method: Oct 04 18:39:32.628311 n-d-851028-13 devstack@n-api.service[123596]: exception: Security group a2a35cbf-fccc-4ba6-b493-2ef76c8c84ea does not exist Oct 04 18:39:32.628311 n-d-851028-13 devstack@n-api.service[123596]: Neutron server returns request_ids: ['req-29be7b98-d5cd-428f-b951-069d6703d57e'] Oct 04 18:39:32.628311 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': 'a2a35cbf-fccc-4ba6-b493-2ef76c8c84ea'} Oct 04 18:39:32.628311 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:39:32.628311 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:39:32.628311 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 04 18:39:32.628311 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 04 18:39:32.628311 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:39:32.628311 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:39:32.628311 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 04 18:39:32.628311 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 04 18:39:32.628311 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:39:32.628311 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:39:32.628311 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 18:39:32.628311 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 18:39:32.628311 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:39:32.628311 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:39:32.628311 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 18:39:32.628311 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 18:39:32.628311 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:39:32.628311 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:39:32.628311 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 18:39:32.628311 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 18:39:32.628311 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:39:32.628311 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:39:32.628311 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 18:39:32.628311 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 18:39:32.628311 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 18:39:32.628311 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 18:39:32.628311 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group a2a35cbf-fccc-4ba6-b493-2ef76c8c84ea does not exist Oct 04 18:39:32.633601 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-29be7b98-d5cd-428f-b951-069d6703d57e'] Oct 04 18:39:32.633601 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:39:32.633601 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:39:32.633601 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:39:32.633601 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:39:32.633601 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 04 18:39:32.633601 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 04 18:39:32.633601 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 04 18:39:32.633601 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 18:39:32.633601 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group a2a35cbf-fccc-4ba6-b493-2ef76c8c84ea does not exist Oct 04 18:39:32.633601 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-29be7b98-d5cd-428f-b951-069d6703d57e'] Oct 04 18:39:32.633601 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:39:32.633601 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:39:32.633601 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:39:32.633601 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:39:32.633601 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:39:32.633601 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:39:32.633601 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:39:32.633601 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:39:32.633601 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:39:32.633601 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:39:32.633601 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:39:32.633601 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:39:32.633601 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 04 18:39:32.633601 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 04 18:39:32.633601 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group a2a35cbf-fccc-4ba6-b493-2ef76c8c84ea does not exist Oct 04 18:39:32.633601 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-29be7b98-d5cd-428f-b951-069d6703d57e'] Oct 04 18:39:32.633601 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:39:32.633601 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:39:32.633601 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:39:32.633601 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:39:32.633601 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:39:32.633601 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:39:32.633601 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:39:32.633601 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:39:32.633601 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group a2a35cbf-fccc-4ba6-b493-2ef76c8c84ea does not exist Oct 04 18:39:32.633601 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-29be7b98-d5cd-428f-b951-069d6703d57e'] Oct 04 18:39:32.633601 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:39:32.636816 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-04b7229e-5b2c-4280-a79c-62795223ccdc tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Returning 404 to user: Security group a2a35cbf-fccc-4ba6-b493-2ef76c8c84ea does not exist Oct 04 18:39:32.636816 n-d-851028-13 devstack@n-api.service[123596]: Neutron server returns request_ids: ['req-29be7b98-d5cd-428f-b951-069d6703d57e'] {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:39:32.640087 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-04b7229e-5b2c-4280-a79c-62795223ccdc tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] 10.222.0.43 "GET /compute/v2.1/os-security-groups/a2a35cbf-fccc-4ba6-b493-2ef76c8c84ea" status: 404 len: 194 microversion: 2.1 time: 0.057296 Oct 04 18:39:32.640253 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-9f08cf7c-c2d1-484f-9d34-9bdc01a184bd tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] [instance: a4de9e6e-90d3-4317-abf8-9fc8f021b803] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:32.640512 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1176/2178] 10.222.0.43 () {58 vars in 1269 bytes} [Tue Oct 4 18:39:32 2022] GET /compute/v2.1/os-security-groups/a2a35cbf-fccc-4ba6-b493-2ef76c8c84ea => generated 194 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:39:32.653552 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9f08cf7c-c2d1-484f-9d34-9bdc01a184bd tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:32.654407 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9f08cf7c-c2d1-484f-9d34-9bdc01a184bd tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:32.658413 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9f08cf7c-c2d1-484f-9d34-9bdc01a184bd tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:32.659426 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9f08cf7c-c2d1-484f-9d34-9bdc01a184bd tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:32.660089 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9f08cf7c-c2d1-484f-9d34-9bdc01a184bd tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:32.660696 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9f08cf7c-c2d1-484f-9d34-9bdc01a184bd tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:32.664838 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-2ce0de22-bfb9-4e09-bb01-a7c9cbc0b063 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Calling method '.version_select at 0x7fb227de9670>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:32.773194 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-2ce0de22-bfb9-4e09-bb01-a7c9cbc0b063 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] 10.222.0.43 "GET /compute/v2.1/images/8b9606ad-88f3-4647-bc18-c5885add126b" status: 200 len: 1453 microversion: 2.1 time: 0.131420 Oct 04 18:39:32.776298 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1177/2179] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 18:39:32 2022] GET /compute/v2.1/images/8b9606ad-88f3-4647-bc18-c5885add126b => generated 1453 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:32.794217 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-68a03fba-1bbb-435b-848e-9ad3e25df4ec tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:32.824523 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=4 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:39:32.845624 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-68a03fba-1bbb-435b-848e-9ad3e25df4ec tempest-ServerGroupTestJSON-1457133461 tempest-ServerGroupTestJSON-1457133461-project] 10.222.0.43 "DELETE /compute/v2.1/os-server-groups/e20eb086-2572-400f-bbd0-163473a4eb28" status: 204 len: 0 microversion: 2.1 time: 0.067968 Oct 04 18:39:32.846856 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1178/2180] 10.222.0.43 () {58 vars in 1266 bytes} [Tue Oct 4 18:39:32 2022] DELETE /compute/v2.1/os-server-groups/e20eb086-2572-400f-bbd0-163473a4eb28 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:39:32.851871 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-4e028ac3-8fcd-419f-891a-6fad933795f4 tempest-ServerAddressesTestJSON-638433160 tempest-ServerAddressesTestJSON-638433160-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:32.858005 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-4e028ac3-8fcd-419f-891a-6fad933795f4 tempest-ServerAddressesTestJSON-638433160 tempest-ServerAddressesTestJSON-638433160-project] [instance: cdb73233-3522-4ddb-b7d4-463685e66bcc] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:32.865087 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4e028ac3-8fcd-419f-891a-6fad933795f4 tempest-ServerAddressesTestJSON-638433160 tempest-ServerAddressesTestJSON-638433160-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:32.865637 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4e028ac3-8fcd-419f-891a-6fad933795f4 tempest-ServerAddressesTestJSON-638433160 tempest-ServerAddressesTestJSON-638433160-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:32.866082 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4e028ac3-8fcd-419f-891a-6fad933795f4 tempest-ServerAddressesTestJSON-638433160 tempest-ServerAddressesTestJSON-638433160-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:32.866789 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4e028ac3-8fcd-419f-891a-6fad933795f4 tempest-ServerAddressesTestJSON-638433160 tempest-ServerAddressesTestJSON-638433160-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:32.877611 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4e028ac3-8fcd-419f-891a-6fad933795f4 tempest-ServerAddressesTestJSON-638433160 tempest-ServerAddressesTestJSON-638433160-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:32.878140 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4e028ac3-8fcd-419f-891a-6fad933795f4 tempest-ServerAddressesTestJSON-638433160 tempest-ServerAddressesTestJSON-638433160-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:32.925188 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-4e028ac3-8fcd-419f-891a-6fad933795f4 tempest-ServerAddressesTestJSON-638433160 tempest-ServerAddressesTestJSON-638433160-project] [instance: cdb73233-3522-4ddb-b7d4-463685e66bcc] Going to try to terminate instance {{(pid=123596) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:39:32.947273 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-9f08cf7c-c2d1-484f-9d34-9bdc01a184bd tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a19da94e9e646028a7f73f9d0e0edda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc41f296eb44503868205ec8aa2fef3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:32.969201 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-9f08cf7c-c2d1-484f-9d34-9bdc01a184bd tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] 10.222.0.43 "GET /compute/v2.1/servers/a4de9e6e-90d3-4317-abf8-9fc8f021b803" status: 200 len: 1321 microversion: 2.1 time: 0.345912 Oct 04 18:39:32.990808 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1003/2181] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:32 2022] GET /compute/v2.1/servers/a4de9e6e-90d3-4317-abf8-9fc8f021b803 => generated 1321 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:32.998423 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-d09bf0a8-cf7f-4cdc-a9a3-2b08685507a4 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:32.999416 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-d09bf0a8-cf7f-4cdc-a9a3-2b08685507a4 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] [instance: 5d937ba2-60f4-40cf-9ed8-a4a86d458e38] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:33.008834 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d09bf0a8-cf7f-4cdc-a9a3-2b08685507a4 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:33.009817 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d09bf0a8-cf7f-4cdc-a9a3-2b08685507a4 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:33.010534 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d09bf0a8-cf7f-4cdc-a9a3-2b08685507a4 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:33.011596 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d09bf0a8-cf7f-4cdc-a9a3-2b08685507a4 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:33.012977 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d09bf0a8-cf7f-4cdc-a9a3-2b08685507a4 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:33.013771 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d09bf0a8-cf7f-4cdc-a9a3-2b08685507a4 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:33.066948 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-d09bf0a8-cf7f-4cdc-a9a3-2b08685507a4 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] [instance: 5d937ba2-60f4-40cf-9ed8-a4a86d458e38] Going to try to terminate instance {{(pid=123595) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:39:33.139326 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-4e028ac3-8fcd-419f-891a-6fad933795f4 tempest-ServerAddressesTestJSON-638433160 tempest-ServerAddressesTestJSON-638433160-project] 10.222.0.43 "DELETE /compute/v2.1/servers/cdb73233-3522-4ddb-b7d4-463685e66bcc" status: 204 len: 0 microversion: 2.1 time: 0.290453 Oct 04 18:39:33.143204 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1179/2182] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 18:39:32 2022] DELETE /compute/v2.1/servers/cdb73233-3522-4ddb-b7d4-463685e66bcc => generated 0 bytes in 293 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:39:33.160837 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-c4573dd9-e7c1-4eef-bc74-1e08dff16417 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Calling method '.version_select at 0x7fb227d6da60>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:33.209218 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=93,nova_cell1:SAVEPOINT=2,nova_cell1:UPDATE=3,nova_cell1:RELEASE=2 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:39:33.268921 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:39:33.276067 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-d09bf0a8-cf7f-4cdc-a9a3-2b08685507a4 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] 10.222.0.43 "DELETE /compute/v2.1/servers/5d937ba2-60f4-40cf-9ed8-a4a86d458e38" status: 204 len: 0 microversion: 2.1 time: 0.283251 Oct 04 18:39:33.285144 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1004/2183] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 18:39:32 2022] DELETE /compute/v2.1/servers/5d937ba2-60f4-40cf-9ed8-a4a86d458e38 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:39:33.290645 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-173fb1d5-7a1a-4df8-bca7-132f03b044f1 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:33.291666 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-173fb1d5-7a1a-4df8-bca7-132f03b044f1 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: d9d4332a-97b6-40f1-bd7c-a9a75a9adc43] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:33.300119 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-173fb1d5-7a1a-4df8-bca7-132f03b044f1 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:33.300888 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-173fb1d5-7a1a-4df8-bca7-132f03b044f1 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:33.301415 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-173fb1d5-7a1a-4df8-bca7-132f03b044f1 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:33.302222 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-173fb1d5-7a1a-4df8-bca7-132f03b044f1 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:33.303015 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-173fb1d5-7a1a-4df8-bca7-132f03b044f1 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:33.303896 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-173fb1d5-7a1a-4df8-bca7-132f03b044f1 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:33.485068 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-173fb1d5-7a1a-4df8-bca7-132f03b044f1 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:33.495120 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-173fb1d5-7a1a-4df8-bca7-132f03b044f1 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/d9d4332a-97b6-40f1-bd7c-a9a75a9adc43" status: 200 len: 1542 microversion: 2.1 time: 0.209893 Oct 04 18:39:33.496033 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1005/2184] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:33 2022] GET /compute/v2.1/servers/d9d4332a-97b6-40f1-bd7c-a9a75a9adc43 => generated 1542 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:33.513673 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-0916415a-3af7-4e34-855a-9a03098ec4cd tempest-ServerAddressesTestJSON-638433160 tempest-ServerAddressesTestJSON-638433160-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:33.514527 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-0916415a-3af7-4e34-855a-9a03098ec4cd tempest-ServerAddressesTestJSON-638433160 tempest-ServerAddressesTestJSON-638433160-project] [instance: cdb73233-3522-4ddb-b7d4-463685e66bcc] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:33.522358 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0916415a-3af7-4e34-855a-9a03098ec4cd tempest-ServerAddressesTestJSON-638433160 tempest-ServerAddressesTestJSON-638433160-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:33.522851 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0916415a-3af7-4e34-855a-9a03098ec4cd tempest-ServerAddressesTestJSON-638433160 tempest-ServerAddressesTestJSON-638433160-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:33.523290 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0916415a-3af7-4e34-855a-9a03098ec4cd tempest-ServerAddressesTestJSON-638433160 tempest-ServerAddressesTestJSON-638433160-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:33.524000 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0916415a-3af7-4e34-855a-9a03098ec4cd tempest-ServerAddressesTestJSON-638433160 tempest-ServerAddressesTestJSON-638433160-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:33.524450 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0916415a-3af7-4e34-855a-9a03098ec4cd tempest-ServerAddressesTestJSON-638433160 tempest-ServerAddressesTestJSON-638433160-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:33.524876 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0916415a-3af7-4e34-855a-9a03098ec4cd tempest-ServerAddressesTestJSON-638433160 tempest-ServerAddressesTestJSON-638433160-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:33.690509 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-0916415a-3af7-4e34-855a-9a03098ec4cd tempest-ServerAddressesTestJSON-638433160 tempest-ServerAddressesTestJSON-638433160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c41b6ddac731410085f447c3f687ef7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b241fded901d40fca9db5b5a4862a428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:33.701063 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-0916415a-3af7-4e34-855a-9a03098ec4cd tempest-ServerAddressesTestJSON-638433160 tempest-ServerAddressesTestJSON-638433160-project] 10.222.0.43 "GET /compute/v2.1/servers/cdb73233-3522-4ddb-b7d4-463685e66bcc" status: 200 len: 1511 microversion: 2.1 time: 0.203089 Oct 04 18:39:33.702065 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1006/2185] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:33 2022] GET /compute/v2.1/servers/cdb73233-3522-4ddb-b7d4-463685e66bcc => generated 1511 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:33.712770 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-c4573dd9-e7c1-4eef-bc74-1e08dff16417 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] 10.222.0.43 "GET /compute/v2.1/os-security-groups" status: 200 len: 1158 microversion: 2.1 time: 0.566773 Oct 04 18:39:33.718160 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1180/2186] 10.222.0.43 () {58 vars in 1158 bytes} [Tue Oct 4 18:39:33 2022] GET /compute/v2.1/os-security-groups => generated 1158 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:33.718865 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-a48173ea-7a25-4a30-a90a-24dcd8f97055 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:33.719540 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-a48173ea-7a25-4a30-a90a-24dcd8f97055 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] [instance: d1f298aa-ebe3-4f52-ada6-137a782cd9b7] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:33.730899 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a48173ea-7a25-4a30-a90a-24dcd8f97055 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:33.732120 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a48173ea-7a25-4a30-a90a-24dcd8f97055 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:33.732503 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a48173ea-7a25-4a30-a90a-24dcd8f97055 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:33.733338 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a48173ea-7a25-4a30-a90a-24dcd8f97055 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:33.733863 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a48173ea-7a25-4a30-a90a-24dcd8f97055 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:33.734360 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a48173ea-7a25-4a30-a90a-24dcd8f97055 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:33.740501 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-f81045d2-ee8c-47ff-b429-48aabfeca518 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.8.167"}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:39:33.757093 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-f81045d2-ee8c-47ff-b429-48aabfeca518 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] [instance: 36d7eb4f-22bc-4047-bc75-6f69142daee5] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:33.771764 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f81045d2-ee8c-47ff-b429-48aabfeca518 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:33.772433 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f81045d2-ee8c-47ff-b429-48aabfeca518 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:33.772931 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f81045d2-ee8c-47ff-b429-48aabfeca518 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:33.773828 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f81045d2-ee8c-47ff-b429-48aabfeca518 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:33.774417 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f81045d2-ee8c-47ff-b429-48aabfeca518 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:33.774935 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f81045d2-ee8c-47ff-b429-48aabfeca518 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:33.833231 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f81045d2-ee8c-47ff-b429-48aabfeca518 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Acquiring lock "refresh_cache-36d7eb4f-22bc-4047-bc75-6f69142daee5" {{(pid=123595) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 04 18:39:33.833991 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f81045d2-ee8c-47ff-b429-48aabfeca518 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Acquired lock "refresh_cache-36d7eb4f-22bc-4047-bc75-6f69142daee5" {{(pid=123595) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 04 18:39:34.034754 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-a48173ea-7a25-4a30-a90a-24dcd8f97055 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:34.046384 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-a48173ea-7a25-4a30-a90a-24dcd8f97055 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:34.047844 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-a48173ea-7a25-4a30-a90a-24dcd8f97055 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:34.049012 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-a48173ea-7a25-4a30-a90a-24dcd8f97055 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] 10.222.0.43 "GET /compute/v2.1/servers/d1f298aa-ebe3-4f52-ada6-137a782cd9b7" status: 200 len: 1486 microversion: 2.25 time: 0.334127 Oct 04 18:39:34.055178 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1181/2187] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:39:33 2022] GET /compute/v2.1/servers/d1f298aa-ebe3-4f52-ada6-137a782cd9b7 => generated 1486 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:39:34.062972 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-efe79909-fb4d-4d20-a144-2af0f75c73c5 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Action: 'create', calling method: .version_select at 0x7fb227de9160>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1129487597", "description": "tempest-description-387770519"}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:39:34.391482 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-efe79909-fb4d-4d20-a144-2af0f75c73c5 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] 10.222.0.43 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.334309 Oct 04 18:39:34.392164 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1182/2188] 10.222.0.43 () {60 vars in 1180 bytes} [Tue Oct 4 18:39:34 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:39:34.396817 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-74db0aa2-6604-4f53-8f13-65bff9c5dc1a tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Calling method '.version_select at 0x7fb227d96790>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:34.451015 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-74db0aa2-6604-4f53-8f13-65bff9c5dc1a tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] 10.222.0.43 "GET /compute/v2.1/images/8b9606ad-88f3-4647-bc18-c5885add126b" status: 200 len: 1453 microversion: 2.1 time: 0.057665 Oct 04 18:39:34.452936 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1183/2189] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 18:39:34 2022] GET /compute/v2.1/images/8b9606ad-88f3-4647-bc18-c5885add126b => generated 1453 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:34.457931 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-c2984192-9ee7-4ff9-b159-ea634c52c7d7 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:34.458964 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-c2984192-9ee7-4ff9-b159-ea634c52c7d7 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] [instance: a4de9e6e-90d3-4317-abf8-9fc8f021b803] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:34.465749 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c2984192-9ee7-4ff9-b159-ea634c52c7d7 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:34.466441 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c2984192-9ee7-4ff9-b159-ea634c52c7d7 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:34.467140 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c2984192-9ee7-4ff9-b159-ea634c52c7d7 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:34.468112 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c2984192-9ee7-4ff9-b159-ea634c52c7d7 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:34.468845 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c2984192-9ee7-4ff9-b159-ea634c52c7d7 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:34.469550 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c2984192-9ee7-4ff9-b159-ea634c52c7d7 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:34.769712 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-c2984192-9ee7-4ff9-b159-ea634c52c7d7 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a19da94e9e646028a7f73f9d0e0edda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc41f296eb44503868205ec8aa2fef3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:34.779489 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-c2984192-9ee7-4ff9-b159-ea634c52c7d7 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] 10.222.0.43 "GET /compute/v2.1/servers/a4de9e6e-90d3-4317-abf8-9fc8f021b803" status: 200 len: 1321 microversion: 2.1 time: 0.325209 Oct 04 18:39:34.792891 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1184/2190] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:34 2022] GET /compute/v2.1/servers/a4de9e6e-90d3-4317-abf8-9fc8f021b803 => generated 1321 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:34.811957 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-320bb716-93cc-4460-91ac-b0148e9881cf req-c12c854c-b770-4c77-ae6f-0eea5ba91be5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4de9e6e-90d3-4317-abf8-9fc8f021b803", "name": "network-vif-plugged", "status": "completed", "tag": "972fc604-de2d-46a2-8fce-29a94634e352"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:39:34.836793 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-320bb716-93cc-4460-91ac-b0148e9881cf req-c12c854c-b770-4c77-ae6f-0eea5ba91be5 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:34.837462 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-320bb716-93cc-4460-91ac-b0148e9881cf req-c12c854c-b770-4c77-ae6f-0eea5ba91be5 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:34.837874 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-320bb716-93cc-4460-91ac-b0148e9881cf req-c12c854c-b770-4c77-ae6f-0eea5ba91be5 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:34.868232 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-320bb716-93cc-4460-91ac-b0148e9881cf req-c12c854c-b770-4c77-ae6f-0eea5ba91be5 service nova] Creating event network-vif-plugged:972fc604-de2d-46a2-8fce-29a94634e352 for instance a4de9e6e-90d3-4317-abf8-9fc8f021b803 on n-h1-851028-13 Oct 04 18:39:34.882849 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-320bb716-93cc-4460-91ac-b0148e9881cf req-c12c854c-b770-4c77-ae6f-0eea5ba91be5 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087051 Oct 04 18:39:34.885130 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1185/2191] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:39:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:39:34.899423 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-45b98d66-a14b-4431-8c56-9d295f5fc794 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Action: 'create', calling method: .version_select at 0x7fb227d96670>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-111599204", "description": "tempest-description-376545492"}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:39:35.250481 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-45b98d66-a14b-4431-8c56-9d295f5fc794 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] 10.222.0.43 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.361996 Oct 04 18:39:35.251103 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1186/2192] 10.222.0.43 () {60 vars in 1180 bytes} [Tue Oct 4 18:39:34 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:39:35.255820 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-98d3ace3-c119-40b5-859b-fc0a22b1ac31 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:35.256616 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-98d3ace3-c119-40b5-859b-fc0a22b1ac31 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: d9d4332a-97b6-40f1-bd7c-a9a75a9adc43] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:35.271301 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-98d3ace3-c119-40b5-859b-fc0a22b1ac31 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:35.271818 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-98d3ace3-c119-40b5-859b-fc0a22b1ac31 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:35.272272 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-98d3ace3-c119-40b5-859b-fc0a22b1ac31 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:35.273000 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-98d3ace3-c119-40b5-859b-fc0a22b1ac31 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:35.273515 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-98d3ace3-c119-40b5-859b-fc0a22b1ac31 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:35.273952 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-98d3ace3-c119-40b5-859b-fc0a22b1ac31 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:35.528868 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-98d3ace3-c119-40b5-859b-fc0a22b1ac31 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:35.540198 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-98d3ace3-c119-40b5-859b-fc0a22b1ac31 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/d9d4332a-97b6-40f1-bd7c-a9a75a9adc43" status: 200 len: 1542 microversion: 2.1 time: 0.287867 Oct 04 18:39:35.541265 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1187/2193] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:35 2022] GET /compute/v2.1/servers/d9d4332a-97b6-40f1-bd7c-a9a75a9adc43 => generated 1542 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:35.572222 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-833c116d-0b57-43bb-b552-4936f51d4202 tempest-ServerAddressesTestJSON-638433160 tempest-ServerAddressesTestJSON-638433160-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:35.573677 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-833c116d-0b57-43bb-b552-4936f51d4202 tempest-ServerAddressesTestJSON-638433160 tempest-ServerAddressesTestJSON-638433160-project] [instance: cdb73233-3522-4ddb-b7d4-463685e66bcc] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:35.581963 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-833c116d-0b57-43bb-b552-4936f51d4202 tempest-ServerAddressesTestJSON-638433160 tempest-ServerAddressesTestJSON-638433160-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:35.582896 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-833c116d-0b57-43bb-b552-4936f51d4202 tempest-ServerAddressesTestJSON-638433160 tempest-ServerAddressesTestJSON-638433160-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:35.583986 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-833c116d-0b57-43bb-b552-4936f51d4202 tempest-ServerAddressesTestJSON-638433160 tempest-ServerAddressesTestJSON-638433160-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:35.585728 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-833c116d-0b57-43bb-b552-4936f51d4202 tempest-ServerAddressesTestJSON-638433160 tempest-ServerAddressesTestJSON-638433160-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:35.586435 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-833c116d-0b57-43bb-b552-4936f51d4202 tempest-ServerAddressesTestJSON-638433160 tempest-ServerAddressesTestJSON-638433160-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:35.587118 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-833c116d-0b57-43bb-b552-4936f51d4202 tempest-ServerAddressesTestJSON-638433160 tempest-ServerAddressesTestJSON-638433160-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:35.942143 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-833c116d-0b57-43bb-b552-4936f51d4202 tempest-ServerAddressesTestJSON-638433160 tempest-ServerAddressesTestJSON-638433160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c41b6ddac731410085f447c3f687ef7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b241fded901d40fca9db5b5a4862a428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:35.951958 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-833c116d-0b57-43bb-b552-4936f51d4202 tempest-ServerAddressesTestJSON-638433160 tempest-ServerAddressesTestJSON-638433160-project] 10.222.0.43 "GET /compute/v2.1/servers/cdb73233-3522-4ddb-b7d4-463685e66bcc" status: 200 len: 1511 microversion: 2.1 time: 0.387586 Oct 04 18:39:35.954552 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1188/2194] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:35 2022] GET /compute/v2.1/servers/cdb73233-3522-4ddb-b7d4-463685e66bcc => generated 1511 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:35.966977 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-8f6f2903-d471-4d5c-838e-811b0b71cc97 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:35.972996 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-8f6f2903-d471-4d5c-838e-811b0b71cc97 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] [instance: d1f298aa-ebe3-4f52-ada6-137a782cd9b7] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:35.994358 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8f6f2903-d471-4d5c-838e-811b0b71cc97 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:35.995143 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8f6f2903-d471-4d5c-838e-811b0b71cc97 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:35.996741 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8f6f2903-d471-4d5c-838e-811b0b71cc97 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:35.997973 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8f6f2903-d471-4d5c-838e-811b0b71cc97 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:35.998518 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8f6f2903-d471-4d5c-838e-811b0b71cc97 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:35.999137 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8f6f2903-d471-4d5c-838e-811b0b71cc97 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:36.348837 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.network.neutron [None req-f81045d2-ee8c-47ff-b429-48aabfeca518 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] [instance: 36d7eb4f-22bc-4047-bc75-6f69142daee5] Building network info cache for instance {{(pid=123595) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 04 18:39:36.412612 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-8f6f2903-d471-4d5c-838e-811b0b71cc97 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:36.430425 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-8f6f2903-d471-4d5c-838e-811b0b71cc97 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:36.431890 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-8f6f2903-d471-4d5c-838e-811b0b71cc97 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:36.433103 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-8f6f2903-d471-4d5c-838e-811b0b71cc97 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] 10.222.0.43 "GET /compute/v2.1/servers/d1f298aa-ebe3-4f52-ada6-137a782cd9b7" status: 200 len: 1486 microversion: 2.25 time: 0.475511 Oct 04 18:39:36.434601 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1189/2195] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:39:35 2022] GET /compute/v2.1/servers/d1f298aa-ebe3-4f52-ada6-137a782cd9b7 => generated 1486 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:39:36.444898 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-d7e16f90-a56b-4144-b64e-9b46f76314c1 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1326834683", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452", "networks": [{"uuid": "b18f60a6-d619-41e5-bd2d-7ab9ce4732ab"}]}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:39:36.585527 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.network.neutron [None req-d7e16f90-a56b-4144-b64e-9b46f76314c1 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] validate_networks() for [('b18f60a6-d619-41e5-bd2d-7ab9ce4732ab', None, None, None, None, None)] {{(pid=123596) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:39:37.712304 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.network.neutron [None req-f81045d2-ee8c-47ff-b429-48aabfeca518 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] [instance: 36d7eb4f-22bc-4047-bc75-6f69142daee5] Updating instance_info_cache with network_info: [{"id": "e3d142e8-c4f2-49f8-af0d-f2e13e22b36f", "address": "fa:16:3e:cf:ad:3b", "network": {"id": "8c78b501-c0dc-4b4a-aea6-b08dc5b06498", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1071307667-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.8.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "87f4f9b0233b4fb29963b77248a236f7", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tape3d142e8-c4", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=123595) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 04 18:39:37.730517 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f81045d2-ee8c-47ff-b429-48aabfeca518 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Releasing lock "refresh_cache-36d7eb4f-22bc-4047-bc75-6f69142daee5" {{(pid=123595) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 04 18:39:37.733396 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-f81045d2-ee8c-47ff-b429-48aabfeca518 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] 10.222.0.43 "POST /compute/v2.1/servers/36d7eb4f-22bc-4047-bc75-6f69142daee5/action" status: 202 len: 0 microversion: 2.1 time: 4.013920 Oct 04 18:39:37.735311 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1007/2196] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 18:39:33 2022] POST /compute/v2.1/servers/36d7eb4f-22bc-4047-bc75-6f69142daee5/action => generated 0 bytes in 4022 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 04 18:39:37.745512 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-cb42d699-718b-427f-9fe7-d5eac510093a tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Calling method '.version_select at 0x7fb21f7e95e0>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:37.840584 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-cb42d699-718b-427f-9fe7-d5eac510093a tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] 10.222.0.43 "GET /compute/v2.1/images/8b9606ad-88f3-4647-bc18-c5885add126b" status: 200 len: 1453 microversion: 2.1 time: 0.101295 Oct 04 18:39:37.842101 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1008/2197] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 18:39:37 2022] GET /compute/v2.1/images/8b9606ad-88f3-4647-bc18-c5885add126b => generated 1453 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:37.847756 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-774310e1-5adf-4e2c-a28e-7c5566506063 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:37.848679 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-774310e1-5adf-4e2c-a28e-7c5566506063 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] [instance: a4de9e6e-90d3-4317-abf8-9fc8f021b803] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:37.858243 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-774310e1-5adf-4e2c-a28e-7c5566506063 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:37.859689 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-774310e1-5adf-4e2c-a28e-7c5566506063 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:37.861162 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-774310e1-5adf-4e2c-a28e-7c5566506063 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:37.872495 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-774310e1-5adf-4e2c-a28e-7c5566506063 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:37.873359 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-774310e1-5adf-4e2c-a28e-7c5566506063 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:37.874059 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-774310e1-5adf-4e2c-a28e-7c5566506063 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:38.312959 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-774310e1-5adf-4e2c-a28e-7c5566506063 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a19da94e9e646028a7f73f9d0e0edda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc41f296eb44503868205ec8aa2fef3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:38.327049 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-774310e1-5adf-4e2c-a28e-7c5566506063 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] 10.222.0.43 "GET /compute/v2.1/servers/a4de9e6e-90d3-4317-abf8-9fc8f021b803" status: 200 len: 1321 microversion: 2.1 time: 0.480473 Oct 04 18:39:38.329371 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1009/2198] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:37 2022] GET /compute/v2.1/servers/a4de9e6e-90d3-4317-abf8-9fc8f021b803 => generated 1321 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:38.346678 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-8e3a990a-dcdd-4219-8b43-71353d7a12eb req-856174ce-29db-4094-8b57-848d75e4dae2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36d7eb4f-22bc-4047-bc75-6f69142daee5", "tag": "e3d142e8-c4f2-49f8-af0d-f2e13e22b36f"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:39:38.399890 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-8e3a990a-dcdd-4219-8b43-71353d7a12eb req-856174ce-29db-4094-8b57-848d75e4dae2 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:38.400391 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-8e3a990a-dcdd-4219-8b43-71353d7a12eb req-856174ce-29db-4094-8b57-848d75e4dae2 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:38.400835 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-8e3a990a-dcdd-4219-8b43-71353d7a12eb req-856174ce-29db-4094-8b57-848d75e4dae2 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:38.459362 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-8e3a990a-dcdd-4219-8b43-71353d7a12eb req-856174ce-29db-4094-8b57-848d75e4dae2 service nova] Creating event network-changed:e3d142e8-c4f2-49f8-af0d-f2e13e22b36f for instance 36d7eb4f-22bc-4047-bc75-6f69142daee5 on n-h2-851028-13 Oct 04 18:39:38.469540 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-8e3a990a-dcdd-4219-8b43-71353d7a12eb req-856174ce-29db-4094-8b57-848d75e4dae2 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.137482 Oct 04 18:39:38.474968 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1010/2199] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:39:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:39:38.481701 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-bc7e834d-903a-49e3-890b-f082f8fcc82d tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:38.482419 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-bc7e834d-903a-49e3-890b-f082f8fcc82d tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: d9d4332a-97b6-40f1-bd7c-a9a75a9adc43] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:38.490121 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bc7e834d-903a-49e3-890b-f082f8fcc82d tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:38.490624 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bc7e834d-903a-49e3-890b-f082f8fcc82d tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:38.491071 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bc7e834d-903a-49e3-890b-f082f8fcc82d tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:38.491812 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bc7e834d-903a-49e3-890b-f082f8fcc82d tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:38.492369 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bc7e834d-903a-49e3-890b-f082f8fcc82d tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:38.492890 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bc7e834d-903a-49e3-890b-f082f8fcc82d tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:38.799346 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-bc7e834d-903a-49e3-890b-f082f8fcc82d tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:38.811611 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-bc7e834d-903a-49e3-890b-f082f8fcc82d tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/d9d4332a-97b6-40f1-bd7c-a9a75a9adc43" status: 200 len: 1542 microversion: 2.1 time: 0.334644 Oct 04 18:39:38.813584 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1011/2200] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:38 2022] GET /compute/v2.1/servers/d9d4332a-97b6-40f1-bd7c-a9a75a9adc43 => generated 1542 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:38.818149 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-9a45bd6d-6cb8-4dd1-ad9d-4f8501a42651 tempest-ServerAddressesTestJSON-638433160 tempest-ServerAddressesTestJSON-638433160-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:38.818976 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-9a45bd6d-6cb8-4dd1-ad9d-4f8501a42651 tempest-ServerAddressesTestJSON-638433160 tempest-ServerAddressesTestJSON-638433160-project] [instance: cdb73233-3522-4ddb-b7d4-463685e66bcc] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:38.825781 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9a45bd6d-6cb8-4dd1-ad9d-4f8501a42651 tempest-ServerAddressesTestJSON-638433160 tempest-ServerAddressesTestJSON-638433160-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:38.826696 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9a45bd6d-6cb8-4dd1-ad9d-4f8501a42651 tempest-ServerAddressesTestJSON-638433160 tempest-ServerAddressesTestJSON-638433160-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:38.827792 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9a45bd6d-6cb8-4dd1-ad9d-4f8501a42651 tempest-ServerAddressesTestJSON-638433160 tempest-ServerAddressesTestJSON-638433160-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:38.828531 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9a45bd6d-6cb8-4dd1-ad9d-4f8501a42651 tempest-ServerAddressesTestJSON-638433160 tempest-ServerAddressesTestJSON-638433160-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:38.829184 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9a45bd6d-6cb8-4dd1-ad9d-4f8501a42651 tempest-ServerAddressesTestJSON-638433160 tempest-ServerAddressesTestJSON-638433160-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:38.829693 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9a45bd6d-6cb8-4dd1-ad9d-4f8501a42651 tempest-ServerAddressesTestJSON-638433160 tempest-ServerAddressesTestJSON-638433160-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:38.858796 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-9a45bd6d-6cb8-4dd1-ad9d-4f8501a42651 tempest-ServerAddressesTestJSON-638433160 tempest-ServerAddressesTestJSON-638433160-project] HTTP exception thrown: Instance cdb73233-3522-4ddb-b7d4-463685e66bcc could not be found. Oct 04 18:39:38.860835 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-9a45bd6d-6cb8-4dd1-ad9d-4f8501a42651 tempest-ServerAddressesTestJSON-638433160 tempest-ServerAddressesTestJSON-638433160-project] Request method failure captured: Oct 04 18:39:38.860835 n-d-851028-13 devstack@n-api.service[123595]: request: GET /compute/v2.1/servers/cdb73233-3522-4ddb-b7d4-463685e66bcc HTTP/1.1 Oct 04 18:39:38.860835 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 18:39:38.860835 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 18:39:38.860835 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 18:39:38.860835 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 0 Oct 04 18:39:38.860835 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 18:39:38.860835 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 18:39:38.860835 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 18:39:38.860835 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 18:39:38.860835 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPH3IyKVxRrTYaB13olrcYZ_e5Zv-mGcqQpqbXXqStX6QGbP6iY3NC_22jJNhmTIxs2sgzGqOluAzp_odCQZG1H-efERyo1plZWOAXJ7LBMe2Sf2M5FdIlrb6uT3n-SeugbWSWI60jl3tzTWwL0wnGlSRQzxFfgwCe2V-QJWDBpD6RRA Oct 04 18:39:38.860835 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 18:39:38.860835 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 18:39:38.860835 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 18:39:38.860835 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 18:39:38.860835 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 18:39:38.860835 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 18:39:38.860835 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: b241fded901d40fca9db5b5a4862a428 Oct 04 18:39:38.860835 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-ServerAddressesTestJSON-638433160 Oct 04 18:39:38.860835 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 18:39:38.860835 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 18:39:38.860835 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/b241fded901d40fca9db5b5a4862a428"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_b241fded901d40fca9db5b5a4862a428"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b241fded901d40fca9db5b5a4862a428"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b241fded901d40fca9db5b5a4862a428"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:39:38.860835 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-ServerAddressesTestJSON-638433160 Oct 04 18:39:38.860835 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: b241fded901d40fca9db5b5a4862a428 Oct 04 18:39:38.860835 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-ServerAddressesTestJSON-638433160 Oct 04 18:39:38.860835 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-ServerAddressesTestJSON-638433160-project Oct 04 18:39:38.860835 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 18:39:38.860835 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 18:39:38.860835 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: c41b6ddac731410085f447c3f687ef7a Oct 04 18:39:38.860835 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-ServerAddressesTestJSON-638433160-project Oct 04 18:39:38.860835 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 18:39:38.860835 n-d-851028-13 devstack@n-api.service[123595]: exception: Instance cdb73233-3522-4ddb-b7d4-463685e66bcc could not be found. Oct 04 18:39:38.860835 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': 'cdb73233-3522-4ddb-b7d4-463685e66bcc'} Oct 04 18:39:38.860835 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:39:38.860835 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:39:38.860835 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:39:38.860835 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:39:38.860835 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:39:38.860835 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:39:38.860835 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:39:38.860835 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:39:38.860835 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:39:38.860835 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:39:38.860835 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cdb73233-3522-4ddb-b7d4-463685e66bcc could not be found. Oct 04 18:39:38.860835 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:39:38.860835 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:39:38.860835 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:39:38.860835 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:39:38.860835 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:39:38.860835 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:39:38.860835 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:39:38.860835 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:39:38.860835 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:39:38.860835 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:39:38.860835 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:39:38.860835 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:39:38.860835 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:39:38.860835 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:39:38.860835 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:39:38.860835 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:39:38.860835 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cdb73233-3522-4ddb-b7d4-463685e66bcc could not be found. Oct 04 18:39:38.860835 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:39:38.860835 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:39:38.860835 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:39:38.864371 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:39:38.864371 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:39:38.864371 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:39:38.864371 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:39:38.864371 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:39:38.864371 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cdb73233-3522-4ddb-b7d4-463685e66bcc could not be found. Oct 04 18:39:38.864371 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:39:38.864371 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-9a45bd6d-6cb8-4dd1-ad9d-4f8501a42651 tempest-ServerAddressesTestJSON-638433160 tempest-ServerAddressesTestJSON-638433160-project] Returning 404 to user: Instance cdb73233-3522-4ddb-b7d4-463685e66bcc could not be found. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:39:38.864371 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-9a45bd6d-6cb8-4dd1-ad9d-4f8501a42651 tempest-ServerAddressesTestJSON-638433160 tempest-ServerAddressesTestJSON-638433160-project] 10.222.0.43 "GET /compute/v2.1/servers/cdb73233-3522-4ddb-b7d4-463685e66bcc" status: 404 len: 111 microversion: 2.1 time: 0.047897 Oct 04 18:39:38.866554 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1012/2201] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:38 2022] GET /compute/v2.1/servers/cdb73233-3522-4ddb-b7d4-463685e66bcc => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:39:38.872651 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-2b157b58-c91e-4362-b9b2-151207642633 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:38.873283 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-2b157b58-c91e-4362-b9b2-151207642633 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] [instance: d1f298aa-ebe3-4f52-ada6-137a782cd9b7] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:38.883973 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2b157b58-c91e-4362-b9b2-151207642633 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:38.884490 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2b157b58-c91e-4362-b9b2-151207642633 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:38.884920 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2b157b58-c91e-4362-b9b2-151207642633 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:38.885668 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2b157b58-c91e-4362-b9b2-151207642633 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:38.886126 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2b157b58-c91e-4362-b9b2-151207642633 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:38.886560 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2b157b58-c91e-4362-b9b2-151207642633 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:39.108685 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-d7e16f90-a56b-4144-b64e-9b46f76314c1 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Flavor limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:39:39.109303 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-d7e16f90-a56b-4144-b64e-9b46f76314c1 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Image limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:39:39.109740 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-d7e16f90-a56b-4144-b64e-9b46f76314c1 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Flavor pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:39:39.110160 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-d7e16f90-a56b-4144-b64e-9b46f76314c1 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Image pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:39:39.110573 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-d7e16f90-a56b-4144-b64e-9b46f76314c1 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:39:39.127447 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d7e16f90-a56b-4144-b64e-9b46f76314c1 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:39.129725 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d7e16f90-a56b-4144-b64e-9b46f76314c1 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:39.135743 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d7e16f90-a56b-4144-b64e-9b46f76314c1 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:39.137507 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d7e16f90-a56b-4144-b64e-9b46f76314c1 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:39.138330 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d7e16f90-a56b-4144-b64e-9b46f76314c1 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:39.138950 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d7e16f90-a56b-4144-b64e-9b46f76314c1 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:39.186565 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-d7e16f90-a56b-4144-b64e-9b46f76314c1 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Getting quotas for project 7b812c85494a49898376a0dd8140f03c. Resources: {'ram', 'cores', 'instances'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:39:39.196441 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-d7e16f90-a56b-4144-b64e-9b46f76314c1 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Getting quotas for user 5c96ec8b8e0a4053b0457f213e6e262d and project 7b812c85494a49898376a0dd8140f03c. Resources: {'ram', 'cores', 'instances'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:39:39.200640 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-2b157b58-c91e-4362-b9b2-151207642633 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:39.232588 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-2b157b58-c91e-4362-b9b2-151207642633 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:39.234329 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-d7e16f90-a56b-4144-b64e-9b46f76314c1 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Going to run 1 instances... {{(pid=123596) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:39:39.236594 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-2b157b58-c91e-4362-b9b2-151207642633 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:39.238131 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-2b157b58-c91e-4362-b9b2-151207642633 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] 10.222.0.43 "GET /compute/v2.1/servers/d1f298aa-ebe3-4f52-ada6-137a782cd9b7" status: 200 len: 1486 microversion: 2.25 time: 0.370440 Oct 04 18:39:39.247869 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-d7e16f90-a56b-4144-b64e-9b46f76314c1 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] [instance: b6474a49-d05d-4d2e-afef-cdbbe8c6d9aa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e8943ec5-4038-4d4b-b9b9-2415a79f5243',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123596) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:39:39.270030 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1013/2202] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:39:38 2022] GET /compute/v2.1/servers/d1f298aa-ebe3-4f52-ada6-137a782cd9b7 => generated 1486 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:39:39.276460 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-674d9678-dc36-4695-85ca-bff59fe6ab6a tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Calling method '.version_select at 0x7fb21f7e9280>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:39.367173 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-d7e16f90-a56b-4144-b64e-9b46f76314c1 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.931140 Oct 04 18:39:39.375903 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1190/2203] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 18:39:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 2940 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:39:39.382550 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-7a06e9d6-3021-4ae2-ace6-4be3fcfdcbcf tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Calling method '.version_select at 0x7fb21fccb280>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:39.456087 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-7a06e9d6-3021-4ae2-ace6-4be3fcfdcbcf tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] 10.222.0.43 "GET /compute/v2.1/images/8b9606ad-88f3-4647-bc18-c5885add126b" status: 200 len: 1453 microversion: 2.1 time: 0.077474 Oct 04 18:39:39.470108 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1191/2204] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 18:39:39 2022] GET /compute/v2.1/images/8b9606ad-88f3-4647-bc18-c5885add126b => generated 1453 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:39.481442 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-21bd7cac-91e0-4910-b776-3f4ea0d7e2c8 req-b04bc269-6d2d-4bf0-a7a1-0b768a445fe4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d937ba2-60f4-40cf-9ed8-a4a86d458e38", "name": "network-vif-deleted", "tag": "568dee2e-5618-4d07-a3bd-4aaf5000f435"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:39:39.500482 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-21bd7cac-91e0-4910-b776-3f4ea0d7e2c8 req-b04bc269-6d2d-4bf0-a7a1-0b768a445fe4 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:39.501266 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-21bd7cac-91e0-4910-b776-3f4ea0d7e2c8 req-b04bc269-6d2d-4bf0-a7a1-0b768a445fe4 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:39.501927 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-21bd7cac-91e0-4910-b776-3f4ea0d7e2c8 req-b04bc269-6d2d-4bf0-a7a1-0b768a445fe4 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:39.531779 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-21bd7cac-91e0-4910-b776-3f4ea0d7e2c8 req-b04bc269-6d2d-4bf0-a7a1-0b768a445fe4 service nova] Creating event network-vif-deleted:568dee2e-5618-4d07-a3bd-4aaf5000f435 for instance 5d937ba2-60f4-40cf-9ed8-a4a86d458e38 on n-h1-851028-13 Oct 04 18:39:39.543751 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-21bd7cac-91e0-4910-b776-3f4ea0d7e2c8 req-b04bc269-6d2d-4bf0-a7a1-0b768a445fe4 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071486 Oct 04 18:39:39.549147 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1192/2205] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:39:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:39:39.566828 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-0fcb016c-d4de-46c7-be7a-3b0089674953 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:39.567614 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-0fcb016c-d4de-46c7-be7a-3b0089674953 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] [instance: a4de9e6e-90d3-4317-abf8-9fc8f021b803] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:39.579216 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0fcb016c-d4de-46c7-be7a-3b0089674953 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:39.579728 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0fcb016c-d4de-46c7-be7a-3b0089674953 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:39.580211 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0fcb016c-d4de-46c7-be7a-3b0089674953 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:39.581068 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0fcb016c-d4de-46c7-be7a-3b0089674953 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:39.581562 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0fcb016c-d4de-46c7-be7a-3b0089674953 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:39.582175 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0fcb016c-d4de-46c7-be7a-3b0089674953 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:40.274250 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-0fcb016c-d4de-46c7-be7a-3b0089674953 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a19da94e9e646028a7f73f9d0e0edda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc41f296eb44503868205ec8aa2fef3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:40.290579 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-0fcb016c-d4de-46c7-be7a-3b0089674953 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] 10.222.0.43 "GET /compute/v2.1/servers/a4de9e6e-90d3-4317-abf8-9fc8f021b803" status: 200 len: 1512 microversion: 2.1 time: 0.739216 Oct 04 18:39:40.291184 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1193/2206] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:39 2022] GET /compute/v2.1/servers/a4de9e6e-90d3-4317-abf8-9fc8f021b803 => generated 1512 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:40.311207 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-2a667bda-db02-4ebd-98de-adf659dda950 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:40.322234 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-2a667bda-db02-4ebd-98de-adf659dda950 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] [instance: b6474a49-d05d-4d2e-afef-cdbbe8c6d9aa] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:40.343063 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2a667bda-db02-4ebd-98de-adf659dda950 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:40.344036 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2a667bda-db02-4ebd-98de-adf659dda950 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:40.345255 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2a667bda-db02-4ebd-98de-adf659dda950 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:40.346168 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2a667bda-db02-4ebd-98de-adf659dda950 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:40.346840 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2a667bda-db02-4ebd-98de-adf659dda950 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:40.347497 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2a667bda-db02-4ebd-98de-adf659dda950 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:40.524835 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-674d9678-dc36-4695-85ca-bff59fe6ab6a tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] 10.222.0.43 "GET /compute/v2.1/os-floating-ips/b01a1257-f8e1-4463-b887-c08216676e24" status: 200 len: 184 microversion: 2.1 time: 1.254337 Oct 04 18:39:40.528334 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-2a667bda-db02-4ebd-98de-adf659dda950 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c96ec8b8e0a4053b0457f213e6e262d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b812c85494a49898376a0dd8140f03c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:40.534019 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1014/2207] 10.222.0.43 () {58 vars in 1260 bytes} [Tue Oct 4 18:39:39 2022] GET /compute/v2.1/os-floating-ips/b01a1257-f8e1-4463-b887-c08216676e24 => generated 184 bytes in 1264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:39:40.540358 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-dc00d141-ffe2-4d6e-b054-9a2a5c79186b tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:40.541315 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-dc00d141-ffe2-4d6e-b054-9a2a5c79186b tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: d9d4332a-97b6-40f1-bd7c-a9a75a9adc43] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:40.546221 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-2a667bda-db02-4ebd-98de-adf659dda950 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] 10.222.0.43 "GET /compute/v2.1/servers/b6474a49-d05d-4d2e-afef-cdbbe8c6d9aa" status: 200 len: 1220 microversion: 2.1 time: 0.252628 Oct 04 18:39:40.548261 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1194/2208] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:40 2022] GET /compute/v2.1/servers/b6474a49-d05d-4d2e-afef-cdbbe8c6d9aa => generated 1220 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:40.562436 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-2ec3080f-2ece-4d70-b0c8-f53ac6e1f3d8 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:40.563146 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dc00d141-ffe2-4d6e-b054-9a2a5c79186b tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:40.563898 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dc00d141-ffe2-4d6e-b054-9a2a5c79186b tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:40.564561 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dc00d141-ffe2-4d6e-b054-9a2a5c79186b tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:40.565548 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dc00d141-ffe2-4d6e-b054-9a2a5c79186b tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:40.566251 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dc00d141-ffe2-4d6e-b054-9a2a5c79186b tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:40.568234 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-2ec3080f-2ece-4d70-b0c8-f53ac6e1f3d8 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] [instance: d1f298aa-ebe3-4f52-ada6-137a782cd9b7] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:40.569202 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dc00d141-ffe2-4d6e-b054-9a2a5c79186b tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:40.583427 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2ec3080f-2ece-4d70-b0c8-f53ac6e1f3d8 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:40.583985 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2ec3080f-2ece-4d70-b0c8-f53ac6e1f3d8 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:40.584850 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2ec3080f-2ece-4d70-b0c8-f53ac6e1f3d8 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:40.587920 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2ec3080f-2ece-4d70-b0c8-f53ac6e1f3d8 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:40.588684 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2ec3080f-2ece-4d70-b0c8-f53ac6e1f3d8 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:40.592445 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2ec3080f-2ece-4d70-b0c8-f53ac6e1f3d8 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:40.949907 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-2ec3080f-2ece-4d70-b0c8-f53ac6e1f3d8 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:40.965759 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-2ec3080f-2ece-4d70-b0c8-f53ac6e1f3d8 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:40.968058 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-2ec3080f-2ece-4d70-b0c8-f53ac6e1f3d8 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:40.970345 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-2ec3080f-2ece-4d70-b0c8-f53ac6e1f3d8 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] 10.222.0.43 "GET /compute/v2.1/servers/d1f298aa-ebe3-4f52-ada6-137a782cd9b7" status: 200 len: 1486 microversion: 2.25 time: 0.420027 Oct 04 18:39:40.971432 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1195/2209] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:39:40 2022] GET /compute/v2.1/servers/d1f298aa-ebe3-4f52-ada6-137a782cd9b7 => generated 1486 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:39:40.977899 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-aeedf71e-dccd-40f8-b18f-b2c81474d1a4 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:40.980251 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-aeedf71e-dccd-40f8-b18f-b2c81474d1a4 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] [instance: 1a71ee0e-ffa8-4730-b4fb-8b6e9fd87239] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:40.998491 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-aeedf71e-dccd-40f8-b18f-b2c81474d1a4 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:40.999089 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-aeedf71e-dccd-40f8-b18f-b2c81474d1a4 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:40.999601 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-aeedf71e-dccd-40f8-b18f-b2c81474d1a4 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:41.000487 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-aeedf71e-dccd-40f8-b18f-b2c81474d1a4 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:41.001164 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-aeedf71e-dccd-40f8-b18f-b2c81474d1a4 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:41.001724 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-aeedf71e-dccd-40f8-b18f-b2c81474d1a4 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:41.396560 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-aeedf71e-dccd-40f8-b18f-b2c81474d1a4 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a19da94e9e646028a7f73f9d0e0edda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc41f296eb44503868205ec8aa2fef3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:41.409277 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-aeedf71e-dccd-40f8-b18f-b2c81474d1a4 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] 10.222.0.43 "GET /compute/v2.1/servers/1a71ee0e-ffa8-4730-b4fb-8b6e9fd87239" status: 200 len: 1511 microversion: 2.1 time: 0.436386 Oct 04 18:39:41.409879 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1196/2210] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:40 2022] GET /compute/v2.1/servers/1a71ee0e-ffa8-4730-b4fb-8b6e9fd87239 => generated 1511 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:41.413699 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-dc00d141-ffe2-4d6e-b054-9a2a5c79186b tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:41.414675 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-e20c6a37-19a5-422b-844e-acf233460531 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Calling method '.version_select at 0x7fb227de2160>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:41.430491 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-dc00d141-ffe2-4d6e-b054-9a2a5c79186b tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/d9d4332a-97b6-40f1-bd7c-a9a75a9adc43" status: 200 len: 1542 microversion: 2.1 time: 0.895057 Oct 04 18:39:41.445568 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1015/2211] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:40 2022] GET /compute/v2.1/servers/d9d4332a-97b6-40f1-bd7c-a9a75a9adc43 => generated 1542 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:41.453091 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-4f64edb0-0992-4fd9-ac99-a82f1350fbcf req-028172ad-a263-4396-b327-aac875aa40f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cdb73233-3522-4ddb-b7d4-463685e66bcc", "name": "network-vif-deleted", "tag": "4c38bca6-ef3f-4ba3-9bd9-54faa461803d"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:39:41.479351 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-4f64edb0-0992-4fd9-ac99-a82f1350fbcf req-028172ad-a263-4396-b327-aac875aa40f2 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:41.482432 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-4f64edb0-0992-4fd9-ac99-a82f1350fbcf req-028172ad-a263-4396-b327-aac875aa40f2 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:41.484329 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-4f64edb0-0992-4fd9-ac99-a82f1350fbcf req-028172ad-a263-4396-b327-aac875aa40f2 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:41.506945 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-e20c6a37-19a5-422b-844e-acf233460531 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] 10.222.0.43 "GET /compute/v2.1/images/8b9606ad-88f3-4647-bc18-c5885add126b" status: 200 len: 1453 microversion: 2.1 time: 0.095891 Oct 04 18:39:41.507976 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1197/2212] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 18:39:41 2022] GET /compute/v2.1/images/8b9606ad-88f3-4647-bc18-c5885add126b => generated 1453 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:41.517511 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-4f64edb0-0992-4fd9-ac99-a82f1350fbcf req-028172ad-a263-4396-b327-aac875aa40f2 service nova] Creating event network-vif-deleted:4c38bca6-ef3f-4ba3-9bd9-54faa461803d for instance cdb73233-3522-4ddb-b7d4-463685e66bcc on n-h2-851028-13 Oct 04 18:39:41.521493 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-84348ac6-349e-447c-b125-22fdfcf9f746 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.8.167"}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:39:41.534536 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-4f64edb0-0992-4fd9-ac99-a82f1350fbcf req-028172ad-a263-4396-b327-aac875aa40f2 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087360 Oct 04 18:39:41.535246 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1016/2213] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:39:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:39:41.551939 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-a5a3d7a5-f38f-47f5-81ee-d8e08220dbef tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:41.553171 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-a5a3d7a5-f38f-47f5-81ee-d8e08220dbef tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] [instance: 5d365b7e-b516-4ae9-a1cd-7502e9d71041] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:41.588970 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a5a3d7a5-f38f-47f5-81ee-d8e08220dbef tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:41.592768 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a5a3d7a5-f38f-47f5-81ee-d8e08220dbef tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:41.594536 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a5a3d7a5-f38f-47f5-81ee-d8e08220dbef tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:41.596745 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a5a3d7a5-f38f-47f5-81ee-d8e08220dbef tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:41.607533 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a5a3d7a5-f38f-47f5-81ee-d8e08220dbef tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:41.610733 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a5a3d7a5-f38f-47f5-81ee-d8e08220dbef tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:42.134907 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-84348ac6-349e-447c-b125-22fdfcf9f746 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] [instance: 36d7eb4f-22bc-4047-bc75-6f69142daee5] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:42.148464 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-84348ac6-349e-447c-b125-22fdfcf9f746 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:42.150339 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-84348ac6-349e-447c-b125-22fdfcf9f746 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:42.151428 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-84348ac6-349e-447c-b125-22fdfcf9f746 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:42.158832 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-84348ac6-349e-447c-b125-22fdfcf9f746 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:42.161604 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-84348ac6-349e-447c-b125-22fdfcf9f746 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:42.165789 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-84348ac6-349e-447c-b125-22fdfcf9f746 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:42.443556 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-a5a3d7a5-f38f-47f5-81ee-d8e08220dbef tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a19da94e9e646028a7f73f9d0e0edda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc41f296eb44503868205ec8aa2fef3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:42.461580 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-a5a3d7a5-f38f-47f5-81ee-d8e08220dbef tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] 10.222.0.43 "GET /compute/v2.1/servers/5d365b7e-b516-4ae9-a1cd-7502e9d71041" status: 200 len: 1511 microversion: 2.1 time: 0.924949 Oct 04 18:39:42.477627 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1017/2214] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:41 2022] GET /compute/v2.1/servers/5d365b7e-b516-4ae9-a1cd-7502e9d71041 => generated 1511 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:42.486959 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-ba72c373-2b44-4c23-9a2c-6c7fad5c144e tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:42.486959 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-ba72c373-2b44-4c23-9a2c-6c7fad5c144e tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] [instance: b6474a49-d05d-4d2e-afef-cdbbe8c6d9aa] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:42.531711 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ba72c373-2b44-4c23-9a2c-6c7fad5c144e tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:42.533876 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ba72c373-2b44-4c23-9a2c-6c7fad5c144e tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:42.535262 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ba72c373-2b44-4c23-9a2c-6c7fad5c144e tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:42.538451 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ba72c373-2b44-4c23-9a2c-6c7fad5c144e tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:42.540062 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ba72c373-2b44-4c23-9a2c-6c7fad5c144e tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:42.541680 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ba72c373-2b44-4c23-9a2c-6c7fad5c144e tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:42.688079 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-ba72c373-2b44-4c23-9a2c-6c7fad5c144e tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c96ec8b8e0a4053b0457f213e6e262d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b812c85494a49898376a0dd8140f03c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:42.702978 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-ba72c373-2b44-4c23-9a2c-6c7fad5c144e tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] 10.222.0.43 "GET /compute/v2.1/servers/b6474a49-d05d-4d2e-afef-cdbbe8c6d9aa" status: 200 len: 1274 microversion: 2.1 time: 0.228442 Oct 04 18:39:42.705277 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1018/2215] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:42 2022] GET /compute/v2.1/servers/b6474a49-d05d-4d2e-afef-cdbbe8c6d9aa => generated 1274 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:42.716537 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-0819711c-0575-4bf0-8a8d-267a56dd2384 req-9d29813d-1fa1-4643-8f3c-f6e69ca63ee2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1f298aa-ebe3-4f52-ada6-137a782cd9b7", "name": "network-vif-unplugged", "status": "completed", "tag": "522bbf89-d8c1-4d7d-96be-5fcee81a735a"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:39:42.744495 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-0819711c-0575-4bf0-8a8d-267a56dd2384 req-9d29813d-1fa1-4643-8f3c-f6e69ca63ee2 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:42.747065 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-0819711c-0575-4bf0-8a8d-267a56dd2384 req-9d29813d-1fa1-4643-8f3c-f6e69ca63ee2 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:42.748252 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-0819711c-0575-4bf0-8a8d-267a56dd2384 req-9d29813d-1fa1-4643-8f3c-f6e69ca63ee2 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:42.762779 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-84348ac6-349e-447c-b125-22fdfcf9f746 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Acquiring lock "refresh_cache-36d7eb4f-22bc-4047-bc75-6f69142daee5" {{(pid=123596) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 04 18:39:42.763839 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-84348ac6-349e-447c-b125-22fdfcf9f746 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Acquired lock "refresh_cache-36d7eb4f-22bc-4047-bc75-6f69142daee5" {{(pid=123596) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 04 18:39:42.791378 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-0819711c-0575-4bf0-8a8d-267a56dd2384 req-9d29813d-1fa1-4643-8f3c-f6e69ca63ee2 service nova] Creating event network-vif-unplugged:522bbf89-d8c1-4d7d-96be-5fcee81a735a for instance d1f298aa-ebe3-4f52-ada6-137a782cd9b7 on n-h2-851028-13 Oct 04 18:39:42.803708 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-0819711c-0575-4bf0-8a8d-267a56dd2384 req-9d29813d-1fa1-4643-8f3c-f6e69ca63ee2 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.096479 Oct 04 18:39:42.806009 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1019/2216] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:39:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:39:42.818805 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-1108cc37-10b6-4a3f-a4de-ce7772150ff4 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:42.820997 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-1108cc37-10b6-4a3f-a4de-ce7772150ff4 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] [instance: d1f298aa-ebe3-4f52-ada6-137a782cd9b7] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:42.832489 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1108cc37-10b6-4a3f-a4de-ce7772150ff4 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:42.832988 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1108cc37-10b6-4a3f-a4de-ce7772150ff4 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:42.838036 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1108cc37-10b6-4a3f-a4de-ce7772150ff4 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:42.838811 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1108cc37-10b6-4a3f-a4de-ce7772150ff4 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:42.839334 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1108cc37-10b6-4a3f-a4de-ce7772150ff4 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:42.840416 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1108cc37-10b6-4a3f-a4de-ce7772150ff4 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:43.860288 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-1108cc37-10b6-4a3f-a4de-ce7772150ff4 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:43.877083 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-1108cc37-10b6-4a3f-a4de-ce7772150ff4 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:43.880426 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-1108cc37-10b6-4a3f-a4de-ce7772150ff4 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:43.883088 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-1108cc37-10b6-4a3f-a4de-ce7772150ff4 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] 10.222.0.43 "GET /compute/v2.1/servers/d1f298aa-ebe3-4f52-ada6-137a782cd9b7" status: 200 len: 1486 microversion: 2.25 time: 1.074886 Oct 04 18:39:43.909586 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1020/2217] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:39:42 2022] GET /compute/v2.1/servers/d1f298aa-ebe3-4f52-ada6-137a782cd9b7 => generated 1486 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:39:43.934803 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-a3d4473b-0d6d-4cc5-8890-d5490c05b90d tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:43.947229 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-a3d4473b-0d6d-4cc5-8890-d5490c05b90d tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: d9d4332a-97b6-40f1-bd7c-a9a75a9adc43] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:43.968384 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a3d4473b-0d6d-4cc5-8890-d5490c05b90d tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:43.968889 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a3d4473b-0d6d-4cc5-8890-d5490c05b90d tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:43.969379 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a3d4473b-0d6d-4cc5-8890-d5490c05b90d tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:43.987855 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a3d4473b-0d6d-4cc5-8890-d5490c05b90d tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:43.989390 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a3d4473b-0d6d-4cc5-8890-d5490c05b90d tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:43.990887 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a3d4473b-0d6d-4cc5-8890-d5490c05b90d tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:44.377978 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.network.neutron [None req-84348ac6-349e-447c-b125-22fdfcf9f746 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] [instance: 36d7eb4f-22bc-4047-bc75-6f69142daee5] Building network info cache for instance {{(pid=123596) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 04 18:39:44.380421 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=95,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=2,nova_cell1:RELEASE=1,nova_cell1:INSERT=1 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:39:44.550304 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-a3d4473b-0d6d-4cc5-8890-d5490c05b90d tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:44.566949 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-a3d4473b-0d6d-4cc5-8890-d5490c05b90d tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/d9d4332a-97b6-40f1-bd7c-a9a75a9adc43" status: 200 len: 1542 microversion: 2.1 time: 0.652106 Oct 04 18:39:44.582962 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1021/2218] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:43 2022] GET /compute/v2.1/servers/d9d4332a-97b6-40f1-bd7c-a9a75a9adc43 => generated 1542 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:44.592413 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-e1da2a40-7d83-48e4-9ab6-8f45f80cc06e tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:44.598043 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-e1da2a40-7d83-48e4-9ab6-8f45f80cc06e tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6a19da94e9e646028a7f73f9d0e0edda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc41f296eb44503868205ec8aa2fef3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:44.599178 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-e1da2a40-7d83-48e4-9ab6-8f45f80cc06e tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': 'dfc41f296eb44503868205ec8aa2fef3'} {{(pid=123595) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:39:44.615247 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e1da2a40-7d83-48e4-9ab6-8f45f80cc06e tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:44.615968 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e1da2a40-7d83-48e4-9ab6-8f45f80cc06e tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:44.616555 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e1da2a40-7d83-48e4-9ab6-8f45f80cc06e tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:44.617471 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e1da2a40-7d83-48e4-9ab6-8f45f80cc06e tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:44.618101 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e1da2a40-7d83-48e4-9ab6-8f45f80cc06e tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:44.618680 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e1da2a40-7d83-48e4-9ab6-8f45f80cc06e tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:44.752250 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.multi_cell_list [None req-e1da2a40-7d83-48e4-9ab6-8f45f80cc06e tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=123595) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 18:39:44.863383 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-e1da2a40-7d83-48e4-9ab6-8f45f80cc06e tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a19da94e9e646028a7f73f9d0e0edda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc41f296eb44503868205ec8aa2fef3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:44.880878 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e1da2a40-7d83-48e4-9ab6-8f45f80cc06e tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:44.883581 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e1da2a40-7d83-48e4-9ab6-8f45f80cc06e tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:44.884216 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e1da2a40-7d83-48e4-9ab6-8f45f80cc06e tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:45.379949 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-e1da2a40-7d83-48e4-9ab6-8f45f80cc06e tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] 10.222.0.43 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1515 microversion: 2.1 time: 0.795627 Oct 04 18:39:45.380559 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1022/2219] 10.222.0.43 () {58 vars in 1167 bytes} [Tue Oct 4 18:39:44 2022] GET /compute/v2.1/servers/detail?flavor=451 => generated 1515 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:45.395011 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-a7913f88-7512-4850-8a52-a68a0f90f582 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Calling method '.version_select at 0x7fb21fb25670>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:45.469556 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.network.neutron [None req-84348ac6-349e-447c-b125-22fdfcf9f746 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] [instance: 36d7eb4f-22bc-4047-bc75-6f69142daee5] Updating instance_info_cache with network_info: [{"id": "e3d142e8-c4f2-49f8-af0d-f2e13e22b36f", "address": "fa:16:3e:cf:ad:3b", "network": {"id": "8c78b501-c0dc-4b4a-aea6-b08dc5b06498", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1071307667-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "87f4f9b0233b4fb29963b77248a236f7", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tape3d142e8-c4", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=123596) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 04 18:39:45.499493 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-84348ac6-349e-447c-b125-22fdfcf9f746 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Releasing lock "refresh_cache-36d7eb4f-22bc-4047-bc75-6f69142daee5" {{(pid=123596) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 04 18:39:45.500294 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-a7913f88-7512-4850-8a52-a68a0f90f582 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] 10.222.0.43 "GET /compute/v2.1/images/8b9606ad-88f3-4647-bc18-c5885add126b" status: 200 len: 1462 microversion: 2.1 time: 0.109693 Oct 04 18:39:45.501186 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1023/2220] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 18:39:45 2022] GET /compute/v2.1/images/8b9606ad-88f3-4647-bc18-c5885add126b => generated 1462 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:45.502136 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-84348ac6-349e-447c-b125-22fdfcf9f746 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] 10.222.0.43 "POST /compute/v2.1/servers/36d7eb4f-22bc-4047-bc75-6f69142daee5/action" status: 202 len: 0 microversion: 2.1 time: 3.990691 Oct 04 18:39:45.508541 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1198/2221] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 18:39:41 2022] POST /compute/v2.1/servers/36d7eb4f-22bc-4047-bc75-6f69142daee5/action => generated 0 bytes in 4000 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 04 18:39:45.510197 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-09f55f24-6e0c-4c85-96ab-ae10bf049b5b tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:45.510885 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-09f55f24-6e0c-4c85-96ab-ae10bf049b5b tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] [instance: b6474a49-d05d-4d2e-afef-cdbbe8c6d9aa] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:45.520365 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-4d836ffd-5b1e-423f-82cc-ae01dc42e5ab req-1d7001ea-1daf-4b5f-9314-e31b85abad31 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1f298aa-ebe3-4f52-ada6-137a782cd9b7", "tag": "522bbf89-d8c1-4d7d-96be-5fcee81a735a"}, {"name": "network-changed", "server_uuid": "36d7eb4f-22bc-4047-bc75-6f69142daee5", "tag": "e3d142e8-c4f2-49f8-af0d-f2e13e22b36f"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:39:45.520861 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-09f55f24-6e0c-4c85-96ab-ae10bf049b5b tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:45.521437 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-09f55f24-6e0c-4c85-96ab-ae10bf049b5b tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:45.521874 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-09f55f24-6e0c-4c85-96ab-ae10bf049b5b tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:45.523523 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-09f55f24-6e0c-4c85-96ab-ae10bf049b5b tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:45.524727 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-09f55f24-6e0c-4c85-96ab-ae10bf049b5b tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:45.525187 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-09f55f24-6e0c-4c85-96ab-ae10bf049b5b tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:45.563497 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-4d836ffd-5b1e-423f-82cc-ae01dc42e5ab req-1d7001ea-1daf-4b5f-9314-e31b85abad31 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:45.566894 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-4d836ffd-5b1e-423f-82cc-ae01dc42e5ab req-1d7001ea-1daf-4b5f-9314-e31b85abad31 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:45.567606 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-4d836ffd-5b1e-423f-82cc-ae01dc42e5ab req-1d7001ea-1daf-4b5f-9314-e31b85abad31 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:45.603602 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-4d836ffd-5b1e-423f-82cc-ae01dc42e5ab req-1d7001ea-1daf-4b5f-9314-e31b85abad31 service nova] Creating event network-changed:522bbf89-d8c1-4d7d-96be-5fcee81a735a for instance d1f298aa-ebe3-4f52-ada6-137a782cd9b7 on n-h2-851028-13 Oct 04 18:39:45.604463 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-4d836ffd-5b1e-423f-82cc-ae01dc42e5ab req-1d7001ea-1daf-4b5f-9314-e31b85abad31 service nova] Creating event network-changed:e3d142e8-c4f2-49f8-af0d-f2e13e22b36f for instance 36d7eb4f-22bc-4047-bc75-6f69142daee5 on n-h2-851028-13 Oct 04 18:39:45.615180 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-4d836ffd-5b1e-423f-82cc-ae01dc42e5ab req-1d7001ea-1daf-4b5f-9314-e31b85abad31 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.104966 Oct 04 18:39:45.616848 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1199/2222] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:39:45 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:39:45.624401 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-6e79af71-da3d-4f81-b50e-2fe0e20d3e2e tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:45.625532 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-6e79af71-da3d-4f81-b50e-2fe0e20d3e2e tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] [instance: d1f298aa-ebe3-4f52-ada6-137a782cd9b7] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:45.633636 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6e79af71-da3d-4f81-b50e-2fe0e20d3e2e tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:45.634438 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6e79af71-da3d-4f81-b50e-2fe0e20d3e2e tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:45.635174 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6e79af71-da3d-4f81-b50e-2fe0e20d3e2e tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:45.636850 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6e79af71-da3d-4f81-b50e-2fe0e20d3e2e tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:45.637797 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6e79af71-da3d-4f81-b50e-2fe0e20d3e2e tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:45.638620 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6e79af71-da3d-4f81-b50e-2fe0e20d3e2e tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:45.923853 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-09f55f24-6e0c-4c85-96ab-ae10bf049b5b tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c96ec8b8e0a4053b0457f213e6e262d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b812c85494a49898376a0dd8140f03c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:45.932564 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-09f55f24-6e0c-4c85-96ab-ae10bf049b5b tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] 10.222.0.43 "GET /compute/v2.1/servers/b6474a49-d05d-4d2e-afef-cdbbe8c6d9aa" status: 200 len: 1316 microversion: 2.1 time: 0.430180 Oct 04 18:39:45.945139 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1024/2223] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:45 2022] GET /compute/v2.1/servers/b6474a49-d05d-4d2e-afef-cdbbe8c6d9aa => generated 1316 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:46.054018 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-6e79af71-da3d-4f81-b50e-2fe0e20d3e2e tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:46.070174 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-6e79af71-da3d-4f81-b50e-2fe0e20d3e2e tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:46.072556 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-6e79af71-da3d-4f81-b50e-2fe0e20d3e2e tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:46.076251 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-6e79af71-da3d-4f81-b50e-2fe0e20d3e2e tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] 10.222.0.43 "GET /compute/v2.1/servers/d1f298aa-ebe3-4f52-ada6-137a782cd9b7" status: 200 len: 1486 microversion: 2.25 time: 0.456918 Oct 04 18:39:46.079172 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1200/2224] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:39:45 2022] GET /compute/v2.1/servers/d1f298aa-ebe3-4f52-ada6-137a782cd9b7 => generated 1486 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:39:46.089876 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-e7856c98-1116-4a17-8a32-3b906d1594ae tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:46.098966 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-e7856c98-1116-4a17-8a32-3b906d1594ae tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6a19da94e9e646028a7f73f9d0e0edda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc41f296eb44503868205ec8aa2fef3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:46.099870 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-e7856c98-1116-4a17-8a32-3b906d1594ae tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-2073811457', 'deleted': False, 'project_id': 'dfc41f296eb44503868205ec8aa2fef3'} {{(pid=123596) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:39:46.117839 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e7856c98-1116-4a17-8a32-3b906d1594ae tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:46.118327 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e7856c98-1116-4a17-8a32-3b906d1594ae tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:46.118767 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e7856c98-1116-4a17-8a32-3b906d1594ae tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:46.119542 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e7856c98-1116-4a17-8a32-3b906d1594ae tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:46.119998 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e7856c98-1116-4a17-8a32-3b906d1594ae tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:46.120425 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e7856c98-1116-4a17-8a32-3b906d1594ae tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:46.285753 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-065a96d7-0974-4a88-aa46-806fe779268c tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-1773617193", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452", "networks": "none"}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:39:46.319305 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.multi_cell_list [None req-e7856c98-1116-4a17-8a32-3b906d1594ae tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=123596) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 18:39:46.420985 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-065a96d7-0974-4a88-aa46-806fe779268c tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Flavor limits 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:39:46.421559 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-065a96d7-0974-4a88-aa46-806fe779268c tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Image limits 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:39:46.422113 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-065a96d7-0974-4a88-aa46-806fe779268c tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Flavor pref 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:39:46.422642 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-065a96d7-0974-4a88-aa46-806fe779268c tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Image pref 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:39:46.423131 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-065a96d7-0974-4a88-aa46-806fe779268c tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:39:46.441180 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-065a96d7-0974-4a88-aa46-806fe779268c tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:46.441896 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-065a96d7-0974-4a88-aa46-806fe779268c tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:46.442476 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-065a96d7-0974-4a88-aa46-806fe779268c tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:46.443359 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-065a96d7-0974-4a88-aa46-806fe779268c tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:46.444997 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-065a96d7-0974-4a88-aa46-806fe779268c tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:46.445749 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-065a96d7-0974-4a88-aa46-806fe779268c tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:46.455831 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-e7856c98-1116-4a17-8a32-3b906d1594ae tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a19da94e9e646028a7f73f9d0e0edda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc41f296eb44503868205ec8aa2fef3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:46.462484 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e7856c98-1116-4a17-8a32-3b906d1594ae tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:46.463111 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e7856c98-1116-4a17-8a32-3b906d1594ae tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:46.464277 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e7856c98-1116-4a17-8a32-3b906d1594ae tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:46.469619 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-065a96d7-0974-4a88-aa46-806fe779268c tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Getting quotas for project 29fdc44ceeb041bcba1be2fcc2084aff. Resources: {'ram', 'cores', 'instances'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:39:46.476901 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-065a96d7-0974-4a88-aa46-806fe779268c tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Getting quotas for user 59e1add2296c4ed5830c5d90ef272ad7 and project 29fdc44ceeb041bcba1be2fcc2084aff. Resources: {'ram', 'cores', 'instances'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:39:46.492981 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-065a96d7-0974-4a88-aa46-806fe779268c tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Going to run 1 instances... {{(pid=123595) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:39:46.497475 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-065a96d7-0974-4a88-aa46-806fe779268c tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] [instance: b53d822f-e7b1-498a-b98a-35f87839dfe8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e8943ec5-4038-4d4b-b9b9-2415a79f5243',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:39:46.560921 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-065a96d7-0974-4a88-aa46-806fe779268c tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 0.623593 Oct 04 18:39:46.562304 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1025/2225] 10.222.0.43 () {62 vars in 1188 bytes} [Tue Oct 4 18:39:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 625 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 04 18:39:46.575901 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-dad3b502-6457-4476-84bd-209004d43f7b tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:46.576764 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-dad3b502-6457-4476-84bd-209004d43f7b tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] [instance: 5d937ba2-60f4-40cf-9ed8-a4a86d458e38] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:46.615767 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dad3b502-6457-4476-84bd-209004d43f7b tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:46.616890 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dad3b502-6457-4476-84bd-209004d43f7b tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:46.620990 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dad3b502-6457-4476-84bd-209004d43f7b tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:46.622103 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dad3b502-6457-4476-84bd-209004d43f7b tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:46.623668 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dad3b502-6457-4476-84bd-209004d43f7b tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:46.624211 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dad3b502-6457-4476-84bd-209004d43f7b tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:46.645860 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:39:46.649669 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-dad3b502-6457-4476-84bd-209004d43f7b tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] HTTP exception thrown: Instance 5d937ba2-60f4-40cf-9ed8-a4a86d458e38 could not be found. Oct 04 18:39:46.651971 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-dad3b502-6457-4476-84bd-209004d43f7b tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Request method failure captured: Oct 04 18:39:46.651971 n-d-851028-13 devstack@n-api.service[123595]: request: DELETE /compute/v2.1/servers/5d937ba2-60f4-40cf-9ed8-a4a86d458e38 HTTP/1.1 Oct 04 18:39:46.651971 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 18:39:46.651971 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 18:39:46.651971 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 18:39:46.651971 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 0 Oct 04 18:39:46.651971 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 18:39:46.651971 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 18:39:46.651971 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 18:39:46.651971 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 18:39:46.651971 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPH2Wlo5mtodcx1M-NsUFN_Khv92vDz0zMPH8mVOTYTZ5OAT1gAk85Go0b9UJTpiT2nqrIBZHb1rGR6-5vJbaHohOtvXbKPJdv1EIpcmqFbBlLMUbRmU9t4jAnIhvhTQY821OOK2xswwXI2igtcdjh7FQoAwCHoYzR0kQUxybfNzYq9w Oct 04 18:39:46.651971 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 18:39:46.651971 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 18:39:46.651971 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 18:39:46.651971 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 18:39:46.651971 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 18:39:46.651971 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 18:39:46.651971 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: 87f4f9b0233b4fb29963b77248a236f7 Oct 04 18:39:46.651971 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-161697746 Oct 04 18:39:46.651971 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 18:39:46.651971 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 18:39:46.651971 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/87f4f9b0233b4fb29963b77248a236f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_87f4f9b0233b4fb29963b77248a236f7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/87f4f9b0233b4fb29963b77248a236f7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/87f4f9b0233b4fb29963b77248a236f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:39:46.651971 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-161697746 Oct 04 18:39:46.651971 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: 87f4f9b0233b4fb29963b77248a236f7 Oct 04 18:39:46.651971 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-161697746 Oct 04 18:39:46.651971 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-FloatingIPsAssociationTestJSON-161697746-project Oct 04 18:39:46.651971 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 18:39:46.651971 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 18:39:46.651971 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: eadce040fcf3427abab9ef8b0ca19400 Oct 04 18:39:46.651971 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-161697746-project Oct 04 18:39:46.651971 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 18:39:46.651971 n-d-851028-13 devstack@n-api.service[123595]: exception: Instance 5d937ba2-60f4-40cf-9ed8-a4a86d458e38 could not be found. Oct 04 18:39:46.651971 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': '5d937ba2-60f4-40cf-9ed8-a4a86d458e38'} Oct 04 18:39:46.651971 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:39:46.651971 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:39:46.651971 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:39:46.651971 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:39:46.651971 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:39:46.651971 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:39:46.651971 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:39:46.651971 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:39:46.651971 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:39:46.651971 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:39:46.651971 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d937ba2-60f4-40cf-9ed8-a4a86d458e38 could not be found. Oct 04 18:39:46.651971 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:39:46.651971 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:39:46.651971 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:39:46.651971 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:39:46.651971 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:39:46.651971 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:39:46.651971 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:39:46.651971 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:39:46.651971 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:39:46.651971 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:39:46.651971 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:39:46.651971 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:39:46.651971 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:39:46.651971 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:39:46.651971 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:39:46.651971 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:39:46.651971 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:39:46.651971 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:39:46.655337 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d937ba2-60f4-40cf-9ed8-a4a86d458e38 could not be found. Oct 04 18:39:46.655337 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:39:46.655337 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:39:46.655337 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:39:46.655337 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:39:46.655337 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:39:46.655337 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:39:46.655337 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:39:46.655337 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:39:46.655337 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d937ba2-60f4-40cf-9ed8-a4a86d458e38 could not be found. Oct 04 18:39:46.655337 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:39:46.655337 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-dad3b502-6457-4476-84bd-209004d43f7b tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Returning 404 to user: Instance 5d937ba2-60f4-40cf-9ed8-a4a86d458e38 could not be found. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:39:46.655337 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-dad3b502-6457-4476-84bd-209004d43f7b tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] 10.222.0.43 "DELETE /compute/v2.1/servers/5d937ba2-60f4-40cf-9ed8-a4a86d458e38" status: 404 len: 111 microversion: 2.1 time: 0.090935 Oct 04 18:39:46.656745 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1026/2226] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 18:39:46 2022] DELETE /compute/v2.1/servers/5d937ba2-60f4-40cf-9ed8-a4a86d458e38 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:39:46.668027 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-62b5ac81-1f5a-4ef4-b584-826c7565c23f tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Calling method '.version_select at 0x7fb21fb25670>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:46.735262 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-62b5ac81-1f5a-4ef4-b584-826c7565c23f tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] 10.222.0.43 "GET /compute/v2.1/images/8b9606ad-88f3-4647-bc18-c5885add126b" status: 200 len: 1462 microversion: 2.1 time: 0.076922 Oct 04 18:39:46.736731 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1027/2227] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 18:39:46 2022] GET /compute/v2.1/images/8b9606ad-88f3-4647-bc18-c5885add126b => generated 1462 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:46.743449 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-b4ef518d-d980-4439-a841-1f39ad9edcca tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:46.744316 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-b4ef518d-d980-4439-a841-1f39ad9edcca tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: d9d4332a-97b6-40f1-bd7c-a9a75a9adc43] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:46.752132 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b4ef518d-d980-4439-a841-1f39ad9edcca tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:46.753568 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b4ef518d-d980-4439-a841-1f39ad9edcca tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:46.754012 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b4ef518d-d980-4439-a841-1f39ad9edcca tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:46.755478 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b4ef518d-d980-4439-a841-1f39ad9edcca tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:46.756043 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b4ef518d-d980-4439-a841-1f39ad9edcca tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:46.756478 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b4ef518d-d980-4439-a841-1f39ad9edcca tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:46.916782 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-e7856c98-1116-4a17-8a32-3b906d1594ae tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] 10.222.0.43 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-2073811457" status: 200 len: 1514 microversion: 2.1 time: 0.836352 Oct 04 18:39:46.937013 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1201/2228] 10.222.0.43 () {58 vars in 1263 bytes} [Tue Oct 4 18:39:46 2022] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-2073811457 => generated 1514 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:46.942094 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-58f6841b-36cf-40ef-92d2-072e76e8b3c6 req-586947bb-c4bc-4763-8d88-aef004738562 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6474a49-d05d-4d2e-afef-cdbbe8c6d9aa", "tag": "983dac01-7966-45d6-9bba-c9843044df16"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:39:46.955428 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-58f6841b-36cf-40ef-92d2-072e76e8b3c6 req-586947bb-c4bc-4763-8d88-aef004738562 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:46.962026 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-58f6841b-36cf-40ef-92d2-072e76e8b3c6 req-586947bb-c4bc-4763-8d88-aef004738562 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:46.962786 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-58f6841b-36cf-40ef-92d2-072e76e8b3c6 req-586947bb-c4bc-4763-8d88-aef004738562 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:46.992228 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-58f6841b-36cf-40ef-92d2-072e76e8b3c6 req-586947bb-c4bc-4763-8d88-aef004738562 service nova] Creating event network-changed:983dac01-7966-45d6-9bba-c9843044df16 for instance b6474a49-d05d-4d2e-afef-cdbbe8c6d9aa on n-h2-851028-13 Oct 04 18:39:47.004035 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-58f6841b-36cf-40ef-92d2-072e76e8b3c6 req-586947bb-c4bc-4763-8d88-aef004738562 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065319 Oct 04 18:39:47.005123 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1202/2229] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:39:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:39:47.020084 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-705f27c6-5df4-4ba7-af7b-44461db129de tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:47.021012 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-705f27c6-5df4-4ba7-af7b-44461db129de tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] [instance: b53d822f-e7b1-498a-b98a-35f87839dfe8] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:47.112345 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-b4ef518d-d980-4439-a841-1f39ad9edcca tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:47.124899 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-b4ef518d-d980-4439-a841-1f39ad9edcca tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/d9d4332a-97b6-40f1-bd7c-a9a75a9adc43" status: 200 len: 1542 microversion: 2.1 time: 0.386874 Oct 04 18:39:47.136009 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1028/2230] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:46 2022] GET /compute/v2.1/servers/d9d4332a-97b6-40f1-bd7c-a9a75a9adc43 => generated 1542 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:47.149839 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-15b0d773-c1ac-4007-8fa8-268e4013379c tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:47.152462 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-15b0d773-c1ac-4007-8fa8-268e4013379c tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] [instance: 5d937ba2-60f4-40cf-9ed8-a4a86d458e38] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:47.159712 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-15b0d773-c1ac-4007-8fa8-268e4013379c tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:47.160158 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-15b0d773-c1ac-4007-8fa8-268e4013379c tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:47.160611 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-15b0d773-c1ac-4007-8fa8-268e4013379c tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:47.161496 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-15b0d773-c1ac-4007-8fa8-268e4013379c tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:47.161954 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-15b0d773-c1ac-4007-8fa8-268e4013379c tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:47.162390 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-15b0d773-c1ac-4007-8fa8-268e4013379c tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:47.181310 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-15b0d773-c1ac-4007-8fa8-268e4013379c tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] HTTP exception thrown: Instance 5d937ba2-60f4-40cf-9ed8-a4a86d458e38 could not be found. Oct 04 18:39:47.182967 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-15b0d773-c1ac-4007-8fa8-268e4013379c tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Request method failure captured: Oct 04 18:39:47.182967 n-d-851028-13 devstack@n-api.service[123595]: request: GET /compute/v2.1/servers/5d937ba2-60f4-40cf-9ed8-a4a86d458e38 HTTP/1.1 Oct 04 18:39:47.182967 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 18:39:47.182967 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 18:39:47.182967 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 18:39:47.182967 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 0 Oct 04 18:39:47.182967 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 18:39:47.182967 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 18:39:47.182967 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 18:39:47.182967 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 18:39:47.182967 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPH2Wlo5mtodcx1M-NsUFN_Khv92vDz0zMPH8mVOTYTZ5OAT1gAk85Go0b9UJTpiT2nqrIBZHb1rGR6-5vJbaHohOtvXbKPJdv1EIpcmqFbBlLMUbRmU9t4jAnIhvhTQY821OOK2xswwXI2igtcdjh7FQoAwCHoYzR0kQUxybfNzYq9w Oct 04 18:39:47.182967 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 18:39:47.182967 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 18:39:47.182967 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 18:39:47.182967 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 18:39:47.182967 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 18:39:47.182967 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 18:39:47.182967 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: 87f4f9b0233b4fb29963b77248a236f7 Oct 04 18:39:47.182967 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-161697746 Oct 04 18:39:47.182967 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 18:39:47.182967 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 18:39:47.182967 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/87f4f9b0233b4fb29963b77248a236f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_87f4f9b0233b4fb29963b77248a236f7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/87f4f9b0233b4fb29963b77248a236f7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/87f4f9b0233b4fb29963b77248a236f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:39:47.182967 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-161697746 Oct 04 18:39:47.182967 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: 87f4f9b0233b4fb29963b77248a236f7 Oct 04 18:39:47.182967 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-161697746 Oct 04 18:39:47.182967 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-FloatingIPsAssociationTestJSON-161697746-project Oct 04 18:39:47.182967 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 18:39:47.182967 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 18:39:47.182967 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: eadce040fcf3427abab9ef8b0ca19400 Oct 04 18:39:47.182967 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-161697746-project Oct 04 18:39:47.182967 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 18:39:47.182967 n-d-851028-13 devstack@n-api.service[123595]: exception: Instance 5d937ba2-60f4-40cf-9ed8-a4a86d458e38 could not be found. Oct 04 18:39:47.182967 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': '5d937ba2-60f4-40cf-9ed8-a4a86d458e38'} Oct 04 18:39:47.182967 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:39:47.182967 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:39:47.182967 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:39:47.182967 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:39:47.182967 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:39:47.182967 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:39:47.182967 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:39:47.182967 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:39:47.182967 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:39:47.182967 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:39:47.182967 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d937ba2-60f4-40cf-9ed8-a4a86d458e38 could not be found. Oct 04 18:39:47.182967 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:39:47.182967 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:39:47.182967 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:39:47.182967 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:39:47.182967 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:39:47.182967 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:39:47.182967 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:39:47.182967 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:39:47.182967 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:39:47.182967 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:39:47.182967 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:39:47.182967 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:39:47.182967 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:39:47.182967 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:39:47.182967 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:39:47.182967 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:39:47.182967 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d937ba2-60f4-40cf-9ed8-a4a86d458e38 could not be found. Oct 04 18:39:47.182967 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:39:47.182967 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:39:47.186252 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:39:47.186252 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:39:47.186252 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:39:47.186252 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:39:47.186252 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:39:47.186252 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:39:47.186252 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d937ba2-60f4-40cf-9ed8-a4a86d458e38 could not be found. Oct 04 18:39:47.186252 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:39:47.186252 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-15b0d773-c1ac-4007-8fa8-268e4013379c tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Returning 404 to user: Instance 5d937ba2-60f4-40cf-9ed8-a4a86d458e38 could not be found. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:39:47.186252 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-15b0d773-c1ac-4007-8fa8-268e4013379c tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] 10.222.0.43 "GET /compute/v2.1/servers/5d937ba2-60f4-40cf-9ed8-a4a86d458e38" status: 404 len: 111 microversion: 2.1 time: 0.039870 Oct 04 18:39:47.186252 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1029/2231] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:47 2022] GET /compute/v2.1/servers/5d937ba2-60f4-40cf-9ed8-a4a86d458e38 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:39:47.191498 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-4b7bf9ec-687d-4348-92c2-2a833636f965 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:47.191498 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-4b7bf9ec-687d-4348-92c2-2a833636f965 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] [instance: 6eb9c803-dd97-4af5-b0d0-aa6fc18f8a89] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:47.202222 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4b7bf9ec-687d-4348-92c2-2a833636f965 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:47.202730 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4b7bf9ec-687d-4348-92c2-2a833636f965 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:47.203456 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4b7bf9ec-687d-4348-92c2-2a833636f965 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:47.204482 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4b7bf9ec-687d-4348-92c2-2a833636f965 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:47.205010 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4b7bf9ec-687d-4348-92c2-2a833636f965 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:47.205657 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4b7bf9ec-687d-4348-92c2-2a833636f965 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:47.239620 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-705f27c6-5df4-4ba7-af7b-44461db129de tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e1add2296c4ed5830c5d90ef272ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fdc44ceeb041bcba1be2fcc2084aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:47.254779 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-705f27c6-5df4-4ba7-af7b-44461db129de tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59e1add2296c4ed5830c5d90ef272ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fdc44ceeb041bcba1be2fcc2084aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:47.257492 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-705f27c6-5df4-4ba7-af7b-44461db129de tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59e1add2296c4ed5830c5d90ef272ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fdc44ceeb041bcba1be2fcc2084aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:47.262029 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-705f27c6-5df4-4ba7-af7b-44461db129de tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] 10.222.0.43 "GET /compute/v2.1/servers/b53d822f-e7b1-498a-b98a-35f87839dfe8" status: 200 len: 1278 microversion: 2.54 time: 0.253828 Oct 04 18:39:47.264277 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1203/2232] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:39:47 2022] GET /compute/v2.1/servers/b53d822f-e7b1-498a-b98a-35f87839dfe8 => generated 1278 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:39:47.280379 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-224be86c-5cbf-4747-975e-e9078f309ec6 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:47.310413 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-224be86c-5cbf-4747-975e-e9078f309ec6 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6a19da94e9e646028a7f73f9d0e0edda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc41f296eb44503868205ec8aa2fef3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:47.313276 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-224be86c-5cbf-4747-975e-e9078f309ec6 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': 'dfc41f296eb44503868205ec8aa2fef3'} {{(pid=123596) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:39:47.336350 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-224be86c-5cbf-4747-975e-e9078f309ec6 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:47.341707 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-224be86c-5cbf-4747-975e-e9078f309ec6 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:47.342936 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-224be86c-5cbf-4747-975e-e9078f309ec6 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:47.345123 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-224be86c-5cbf-4747-975e-e9078f309ec6 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:47.346800 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-224be86c-5cbf-4747-975e-e9078f309ec6 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:47.347333 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-224be86c-5cbf-4747-975e-e9078f309ec6 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:47.556043 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.multi_cell_list [None req-224be86c-5cbf-4747-975e-e9078f309ec6 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=123596) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 18:39:47.567485 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-4b7bf9ec-687d-4348-92c2-2a833636f965 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e30c6d7042ca444a86e2260692ea048e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c54096058d4c9a8ea436329e25ecbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:47.578372 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-4b7bf9ec-687d-4348-92c2-2a833636f965 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] 10.222.0.43 "GET /compute/v2.1/servers/6eb9c803-dd97-4af5-b0d0-aa6fc18f8a89" status: 200 len: 1468 microversion: 2.1 time: 0.392009 Oct 04 18:39:47.579327 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1030/2233] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:47 2022] GET /compute/v2.1/servers/6eb9c803-dd97-4af5-b0d0-aa6fc18f8a89 => generated 1468 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:47.586357 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-224e87f9-f668-4143-942c-727e4c6bcc5e tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:47.588099 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-224e87f9-f668-4143-942c-727e4c6bcc5e tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] [instance: b6474a49-d05d-4d2e-afef-cdbbe8c6d9aa] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:47.597848 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-224e87f9-f668-4143-942c-727e4c6bcc5e tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:47.600871 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-224e87f9-f668-4143-942c-727e4c6bcc5e tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:47.601678 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-224e87f9-f668-4143-942c-727e4c6bcc5e tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:47.603556 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-224e87f9-f668-4143-942c-727e4c6bcc5e tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:47.604557 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-224e87f9-f668-4143-942c-727e4c6bcc5e tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:47.605306 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-224e87f9-f668-4143-942c-727e4c6bcc5e tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:47.660372 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-224be86c-5cbf-4747-975e-e9078f309ec6 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a19da94e9e646028a7f73f9d0e0edda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc41f296eb44503868205ec8aa2fef3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:47.672134 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-224be86c-5cbf-4747-975e-e9078f309ec6 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:47.682378 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-224be86c-5cbf-4747-975e-e9078f309ec6 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:47.683687 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-224be86c-5cbf-4747-975e-e9078f309ec6 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:47.778792 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-224e87f9-f668-4143-942c-727e4c6bcc5e tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c96ec8b8e0a4053b0457f213e6e262d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b812c85494a49898376a0dd8140f03c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:47.787510 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-224e87f9-f668-4143-942c-727e4c6bcc5e tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] 10.222.0.43 "GET /compute/v2.1/servers/b6474a49-d05d-4d2e-afef-cdbbe8c6d9aa" status: 200 len: 1316 microversion: 2.1 time: 0.206858 Oct 04 18:39:47.804879 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1031/2234] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:47 2022] GET /compute/v2.1/servers/b6474a49-d05d-4d2e-afef-cdbbe8c6d9aa => generated 1316 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:47.804879 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-957091c9-7f1b-4ad6-9a63-fa85ea8157a4 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:47.804879 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-957091c9-7f1b-4ad6-9a63-fa85ea8157a4 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] [instance: d1f298aa-ebe3-4f52-ada6-137a782cd9b7] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:47.804879 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-957091c9-7f1b-4ad6-9a63-fa85ea8157a4 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:47.804879 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-957091c9-7f1b-4ad6-9a63-fa85ea8157a4 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:47.804879 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-957091c9-7f1b-4ad6-9a63-fa85ea8157a4 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:47.804879 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-957091c9-7f1b-4ad6-9a63-fa85ea8157a4 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:47.804879 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-957091c9-7f1b-4ad6-9a63-fa85ea8157a4 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:47.804879 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-957091c9-7f1b-4ad6-9a63-fa85ea8157a4 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:47.986397 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-957091c9-7f1b-4ad6-9a63-fa85ea8157a4 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:48.012611 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-957091c9-7f1b-4ad6-9a63-fa85ea8157a4 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:48.015136 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-957091c9-7f1b-4ad6-9a63-fa85ea8157a4 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:48.015526 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-957091c9-7f1b-4ad6-9a63-fa85ea8157a4 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] 10.222.0.43 "GET /compute/v2.1/servers/d1f298aa-ebe3-4f52-ada6-137a782cd9b7" status: 200 len: 1486 microversion: 2.25 time: 0.226257 Oct 04 18:39:48.016640 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1032/2235] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:39:47 2022] GET /compute/v2.1/servers/d1f298aa-ebe3-4f52-ada6-137a782cd9b7 => generated 1486 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:39:48.022177 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-363d89a9-92c1-4784-a4f8-1a371c43433f tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Calling method '.version_select at 0x7fb21f7e9700>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:48.278122 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-224be86c-5cbf-4747-975e-e9078f309ec6 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] 10.222.0.43 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4517 microversion: 2.1 time: 1.010953 Oct 04 18:39:48.279741 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1204/2236] 10.222.0.43 () {58 vars in 1173 bytes} [Tue Oct 4 18:39:47 2022] GET /compute/v2.1/servers/detail?status=active => generated 4517 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:48.311564 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-996379a5-fd54-4001-ba30-7a02e6df2574 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1819132365"}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:39:48.314861 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-996379a5-fd54-4001-ba30-7a02e6df2574 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] [instance: 0b7f1ede-48b3-48d8-933e-287c338b1e6a] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:48.334609 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-996379a5-fd54-4001-ba30-7a02e6df2574 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:48.335256 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-996379a5-fd54-4001-ba30-7a02e6df2574 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:48.335845 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-996379a5-fd54-4001-ba30-7a02e6df2574 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:48.336741 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-996379a5-fd54-4001-ba30-7a02e6df2574 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:48.337369 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-996379a5-fd54-4001-ba30-7a02e6df2574 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:48.337871 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-996379a5-fd54-4001-ba30-7a02e6df2574 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:48.598848 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-996379a5-fd54-4001-ba30-7a02e6df2574 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] 10.222.0.43 "POST /compute/v2.1/servers/0b7f1ede-48b3-48d8-933e-287c338b1e6a/action" status: 202 len: 0 microversion: 2.1 time: 0.317328 Oct 04 18:39:48.599513 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1205/2237] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 18:39:48 2022] POST /compute/v2.1/servers/0b7f1ede-48b3-48d8-933e-287c338b1e6a/action => generated 0 bytes in 319 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 04 18:39:48.610516 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-c0b883f7-1014-4a5d-a448-c4fb95ce9bf2 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:48.611731 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-c0b883f7-1014-4a5d-a448-c4fb95ce9bf2 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: d9d4332a-97b6-40f1-bd7c-a9a75a9adc43] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:48.621781 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c0b883f7-1014-4a5d-a448-c4fb95ce9bf2 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:48.622627 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c0b883f7-1014-4a5d-a448-c4fb95ce9bf2 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:48.623298 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c0b883f7-1014-4a5d-a448-c4fb95ce9bf2 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:48.624240 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c0b883f7-1014-4a5d-a448-c4fb95ce9bf2 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:48.624909 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c0b883f7-1014-4a5d-a448-c4fb95ce9bf2 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:48.625585 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c0b883f7-1014-4a5d-a448-c4fb95ce9bf2 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:49.160813 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-c0b883f7-1014-4a5d-a448-c4fb95ce9bf2 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:49.169279 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-c0b883f7-1014-4a5d-a448-c4fb95ce9bf2 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/d9d4332a-97b6-40f1-bd7c-a9a75a9adc43" status: 200 len: 1542 microversion: 2.1 time: 0.564819 Oct 04 18:39:49.170677 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1206/2238] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:48 2022] GET /compute/v2.1/servers/d9d4332a-97b6-40f1-bd7c-a9a75a9adc43 => generated 1542 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:49.175526 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-3133b9eb-0246-4ec0-95cf-12754a105067 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:49.176365 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-3133b9eb-0246-4ec0-95cf-12754a105067 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] [instance: b53d822f-e7b1-498a-b98a-35f87839dfe8] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:49.201973 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3133b9eb-0246-4ec0-95cf-12754a105067 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:49.204353 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3133b9eb-0246-4ec0-95cf-12754a105067 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:49.205652 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3133b9eb-0246-4ec0-95cf-12754a105067 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:49.206545 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3133b9eb-0246-4ec0-95cf-12754a105067 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:49.208872 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3133b9eb-0246-4ec0-95cf-12754a105067 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:49.210723 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3133b9eb-0246-4ec0-95cf-12754a105067 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:49.355716 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-3133b9eb-0246-4ec0-95cf-12754a105067 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e1add2296c4ed5830c5d90ef272ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fdc44ceeb041bcba1be2fcc2084aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:49.367660 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-3133b9eb-0246-4ec0-95cf-12754a105067 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59e1add2296c4ed5830c5d90ef272ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fdc44ceeb041bcba1be2fcc2084aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:49.369207 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-3133b9eb-0246-4ec0-95cf-12754a105067 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59e1add2296c4ed5830c5d90ef272ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fdc44ceeb041bcba1be2fcc2084aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:49.374783 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-3133b9eb-0246-4ec0-95cf-12754a105067 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] 10.222.0.43 "GET /compute/v2.1/servers/b53d822f-e7b1-498a-b98a-35f87839dfe8" status: 200 len: 1330 microversion: 2.54 time: 0.198715 Oct 04 18:39:49.375408 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1207/2239] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:39:49 2022] GET /compute/v2.1/servers/b53d822f-e7b1-498a-b98a-35f87839dfe8 => generated 1330 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:39:49.384747 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-cb293c2f-8e0f-4f32-93eb-2ba544d79858 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:49.396077 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-cb293c2f-8e0f-4f32-93eb-2ba544d79858 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6a19da94e9e646028a7f73f9d0e0edda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc41f296eb44503868205ec8aa2fef3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:49.396532 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.compute.servers [None req-cb293c2f-8e0f-4f32-93eb-2ba544d79858 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Removing options 'limit' from query {{(pid=123596) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 04 18:39:49.397436 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-cb293c2f-8e0f-4f32-93eb-2ba544d79858 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Searching by: {'deleted': False, 'project_id': 'dfc41f296eb44503868205ec8aa2fef3'} {{(pid=123596) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:39:49.409307 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cb293c2f-8e0f-4f32-93eb-2ba544d79858 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:49.409922 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cb293c2f-8e0f-4f32-93eb-2ba544d79858 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:49.411161 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cb293c2f-8e0f-4f32-93eb-2ba544d79858 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:49.412071 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cb293c2f-8e0f-4f32-93eb-2ba544d79858 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:49.412546 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cb293c2f-8e0f-4f32-93eb-2ba544d79858 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:49.412985 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cb293c2f-8e0f-4f32-93eb-2ba544d79858 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:49.451895 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-cb293c2f-8e0f-4f32-93eb-2ba544d79858 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a19da94e9e646028a7f73f9d0e0edda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc41f296eb44503868205ec8aa2fef3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:49.458484 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cb293c2f-8e0f-4f32-93eb-2ba544d79858 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:49.459230 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cb293c2f-8e0f-4f32-93eb-2ba544d79858 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:49.459902 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cb293c2f-8e0f-4f32-93eb-2ba544d79858 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:49.846657 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-cb293c2f-8e0f-4f32-93eb-2ba544d79858 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] 10.222.0.43 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1661 microversion: 2.1 time: 0.468365 Oct 04 18:39:49.847254 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1208/2240] 10.222.0.43 () {58 vars in 1161 bytes} [Tue Oct 4 18:39:49 2022] GET /compute/v2.1/servers/detail?limit=1 => generated 1661 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:49.852165 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-d57f0595-36b8-4c91-a396-b4e522a7b5ab tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Calling method '.version_select at 0x7fb21efbbee0>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:49.935138 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-d57f0595-36b8-4c91-a396-b4e522a7b5ab tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] 10.222.0.43 "GET /compute/v2.1/images/e4d3e808-f1b4-4480-90f6-79b6d4964f47" status: 200 len: 1455 microversion: 2.1 time: 0.086507 Oct 04 18:39:49.943511 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1209/2241] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 18:39:49 2022] GET /compute/v2.1/images/e4d3e808-f1b4-4480-90f6-79b6d4964f47 => generated 1455 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:49.948082 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-c5b1fa4a-c312-458d-8485-be69e39c4415 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:49.948807 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-c5b1fa4a-c312-458d-8485-be69e39c4415 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] [instance: b6474a49-d05d-4d2e-afef-cdbbe8c6d9aa] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:49.968221 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c5b1fa4a-c312-458d-8485-be69e39c4415 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:49.968221 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c5b1fa4a-c312-458d-8485-be69e39c4415 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:49.968434 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c5b1fa4a-c312-458d-8485-be69e39c4415 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:49.969176 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c5b1fa4a-c312-458d-8485-be69e39c4415 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:49.969623 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c5b1fa4a-c312-458d-8485-be69e39c4415 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:49.970051 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c5b1fa4a-c312-458d-8485-be69e39c4415 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:50.143989 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-363d89a9-92c1-4784-a4f8-1a371c43433f tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] 10.222.0.43 "DELETE /compute/v2.1/os-floating-ips/b01a1257-f8e1-4463-b887-c08216676e24" status: 202 len: 0 microversion: 2.1 time: 2.125981 Oct 04 18:39:50.145066 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1033/2242] 10.222.0.43 () {58 vars in 1263 bytes} [Tue Oct 4 18:39:48 2022] DELETE /compute/v2.1/os-floating-ips/b01a1257-f8e1-4463-b887-c08216676e24 => generated 0 bytes in 2128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:39:50.150018 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-1778e536-c832-4d87-a932-c8cdbe9cdba0 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:50.150813 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-1778e536-c832-4d87-a932-c8cdbe9cdba0 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] [instance: d1f298aa-ebe3-4f52-ada6-137a782cd9b7] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:50.159248 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1778e536-c832-4d87-a932-c8cdbe9cdba0 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:50.159966 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1778e536-c832-4d87-a932-c8cdbe9cdba0 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:50.160570 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1778e536-c832-4d87-a932-c8cdbe9cdba0 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:50.161601 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1778e536-c832-4d87-a932-c8cdbe9cdba0 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:50.162874 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1778e536-c832-4d87-a932-c8cdbe9cdba0 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:50.163514 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1778e536-c832-4d87-a932-c8cdbe9cdba0 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:50.225621 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-c5b1fa4a-c312-458d-8485-be69e39c4415 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c96ec8b8e0a4053b0457f213e6e262d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b812c85494a49898376a0dd8140f03c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:50.239844 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-c5b1fa4a-c312-458d-8485-be69e39c4415 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] 10.222.0.43 "GET /compute/v2.1/servers/b6474a49-d05d-4d2e-afef-cdbbe8c6d9aa" status: 200 len: 1316 microversion: 2.1 time: 0.297880 Oct 04 18:39:50.246560 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1210/2243] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:49 2022] GET /compute/v2.1/servers/b6474a49-d05d-4d2e-afef-cdbbe8c6d9aa => generated 1316 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:50.264670 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-cbddab79-822d-471c-bdca-f2010526306e tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:50.270571 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-cbddab79-822d-471c-bdca-f2010526306e tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6a19da94e9e646028a7f73f9d0e0edda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc41f296eb44503868205ec8aa2fef3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:50.271298 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-cbddab79-822d-471c-bdca-f2010526306e tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': 'dfc41f296eb44503868205ec8aa2fef3'} {{(pid=123596) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:39:50.295042 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cbddab79-822d-471c-bdca-f2010526306e tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:50.296373 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cbddab79-822d-471c-bdca-f2010526306e tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:50.297635 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cbddab79-822d-471c-bdca-f2010526306e tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:50.298528 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cbddab79-822d-471c-bdca-f2010526306e tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:50.299152 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cbddab79-822d-471c-bdca-f2010526306e tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:50.299722 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cbddab79-822d-471c-bdca-f2010526306e tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:50.392275 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-1778e536-c832-4d87-a932-c8cdbe9cdba0 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:50.406746 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-1778e536-c832-4d87-a932-c8cdbe9cdba0 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:50.410257 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-1778e536-c832-4d87-a932-c8cdbe9cdba0 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:50.412124 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-1778e536-c832-4d87-a932-c8cdbe9cdba0 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] 10.222.0.43 "GET /compute/v2.1/servers/d1f298aa-ebe3-4f52-ada6-137a782cd9b7" status: 200 len: 1486 microversion: 2.25 time: 0.265905 Oct 04 18:39:50.419384 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.multi_cell_list [None req-cbddab79-822d-471c-bdca-f2010526306e tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=123596) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 18:39:50.420542 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1034/2244] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:39:50 2022] GET /compute/v2.1/servers/d1f298aa-ebe3-4f52-ada6-137a782cd9b7 => generated 1486 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:39:50.425567 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-82e6f81b-6862-4c4a-9271-961bafe4cf7b tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:50.427096 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-82e6f81b-6862-4c4a-9271-961bafe4cf7b tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] [instance: 36d7eb4f-22bc-4047-bc75-6f69142daee5] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:50.441883 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-82e6f81b-6862-4c4a-9271-961bafe4cf7b tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:50.442494 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-82e6f81b-6862-4c4a-9271-961bafe4cf7b tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:50.443053 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-82e6f81b-6862-4c4a-9271-961bafe4cf7b tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:50.443859 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-82e6f81b-6862-4c4a-9271-961bafe4cf7b tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:50.451985 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-82e6f81b-6862-4c4a-9271-961bafe4cf7b tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:50.452589 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-82e6f81b-6862-4c4a-9271-961bafe4cf7b tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:50.505443 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-82e6f81b-6862-4c4a-9271-961bafe4cf7b tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] [instance: 36d7eb4f-22bc-4047-bc75-6f69142daee5] Going to try to terminate instance {{(pid=123595) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:39:50.571392 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-cbddab79-822d-471c-bdca-f2010526306e tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] 10.222.0.43 "GET /compute/v2.1/servers?status=active" status: 200 len: 1012 microversion: 2.1 time: 0.312715 Oct 04 18:39:50.572458 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1211/2245] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Oct 4 18:39:50 2022] GET /compute/v2.1/servers?status=active => generated 1012 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:50.604030 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-a39f510f-b8d1-4e83-a074-46f5ac2d88ec tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:50.605149 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-a39f510f-b8d1-4e83-a074-46f5ac2d88ec tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: d9d4332a-97b6-40f1-bd7c-a9a75a9adc43] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:50.619804 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a39f510f-b8d1-4e83-a074-46f5ac2d88ec tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:50.621237 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a39f510f-b8d1-4e83-a074-46f5ac2d88ec tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:50.622098 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a39f510f-b8d1-4e83-a074-46f5ac2d88ec tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:50.623430 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a39f510f-b8d1-4e83-a074-46f5ac2d88ec tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:50.624256 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a39f510f-b8d1-4e83-a074-46f5ac2d88ec tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:50.625047 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a39f510f-b8d1-4e83-a074-46f5ac2d88ec tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:50.708263 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-82e6f81b-6862-4c4a-9271-961bafe4cf7b tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] 10.222.0.43 "DELETE /compute/v2.1/servers/36d7eb4f-22bc-4047-bc75-6f69142daee5" status: 204 len: 0 microversion: 2.1 time: 0.277275 Oct 04 18:39:50.710401 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1035/2246] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 18:39:50 2022] DELETE /compute/v2.1/servers/36d7eb4f-22bc-4047-bc75-6f69142daee5 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:39:50.719247 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-554b8f97-77c2-439f-9d25-052181698abd tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:50.720269 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-554b8f97-77c2-439f-9d25-052181698abd tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] [instance: b53d822f-e7b1-498a-b98a-35f87839dfe8] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:50.727844 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-554b8f97-77c2-439f-9d25-052181698abd tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:50.728544 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-554b8f97-77c2-439f-9d25-052181698abd tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:50.729148 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-554b8f97-77c2-439f-9d25-052181698abd tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:50.730091 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-554b8f97-77c2-439f-9d25-052181698abd tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:50.730690 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-554b8f97-77c2-439f-9d25-052181698abd tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:50.731262 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-554b8f97-77c2-439f-9d25-052181698abd tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:50.954916 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-554b8f97-77c2-439f-9d25-052181698abd tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e1add2296c4ed5830c5d90ef272ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fdc44ceeb041bcba1be2fcc2084aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:50.967520 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-554b8f97-77c2-439f-9d25-052181698abd tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59e1add2296c4ed5830c5d90ef272ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fdc44ceeb041bcba1be2fcc2084aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:50.970246 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-554b8f97-77c2-439f-9d25-052181698abd tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59e1add2296c4ed5830c5d90ef272ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fdc44ceeb041bcba1be2fcc2084aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:50.973158 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-554b8f97-77c2-439f-9d25-052181698abd tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] 10.222.0.43 "GET /compute/v2.1/servers/b53d822f-e7b1-498a-b98a-35f87839dfe8" status: 200 len: 1336 microversion: 2.54 time: 0.260051 Oct 04 18:39:50.974229 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1036/2247] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:39:50 2022] GET /compute/v2.1/servers/b53d822f-e7b1-498a-b98a-35f87839dfe8 => generated 1336 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:39:50.980820 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-48a618af-f9df-4e7e-a48b-fbcc1640e94a tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:50.987162 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-48a618af-f9df-4e7e-a48b-fbcc1640e94a tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6a19da94e9e646028a7f73f9d0e0edda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc41f296eb44503868205ec8aa2fef3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:50.987596 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.compute.servers [None req-48a618af-f9df-4e7e-a48b-fbcc1640e94a tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Removing options 'limit' from query {{(pid=123595) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 04 18:39:50.988572 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-48a618af-f9df-4e7e-a48b-fbcc1640e94a tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Searching by: {'deleted': False, 'project_id': 'dfc41f296eb44503868205ec8aa2fef3'} {{(pid=123595) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:39:50.996294 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-48a618af-f9df-4e7e-a48b-fbcc1640e94a tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:50.996439 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-48a618af-f9df-4e7e-a48b-fbcc1640e94a tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:50.996852 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-48a618af-f9df-4e7e-a48b-fbcc1640e94a tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:50.997753 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-48a618af-f9df-4e7e-a48b-fbcc1640e94a tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:50.998263 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-48a618af-f9df-4e7e-a48b-fbcc1640e94a tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:50.998874 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-48a618af-f9df-4e7e-a48b-fbcc1640e94a tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:51.010188 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-a39f510f-b8d1-4e83-a074-46f5ac2d88ec tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:51.018627 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-a39f510f-b8d1-4e83-a074-46f5ac2d88ec tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/d9d4332a-97b6-40f1-bd7c-a9a75a9adc43" status: 200 len: 1542 microversion: 2.1 time: 0.436502 Oct 04 18:39:51.029157 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1212/2248] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:50 2022] GET /compute/v2.1/servers/d9d4332a-97b6-40f1-bd7c-a9a75a9adc43 => generated 1542 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:51.029157 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-69f07d79-1c85-4e17-b45c-706c527ee718 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:51.029157 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-69f07d79-1c85-4e17-b45c-706c527ee718 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] [instance: 36d7eb4f-22bc-4047-bc75-6f69142daee5] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:51.031572 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.multi_cell_list [None req-48a618af-f9df-4e7e-a48b-fbcc1640e94a tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=123595) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 18:39:51.033286 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-69f07d79-1c85-4e17-b45c-706c527ee718 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:51.033782 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-69f07d79-1c85-4e17-b45c-706c527ee718 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:51.034221 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-69f07d79-1c85-4e17-b45c-706c527ee718 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:51.034928 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-69f07d79-1c85-4e17-b45c-706c527ee718 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:51.035381 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-69f07d79-1c85-4e17-b45c-706c527ee718 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:51.035805 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-69f07d79-1c85-4e17-b45c-706c527ee718 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:51.068346 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-48a618af-f9df-4e7e-a48b-fbcc1640e94a tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] 10.222.0.43 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1012 microversion: 2.1 time: 0.092203 Oct 04 18:39:51.076946 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1037/2249] 10.222.0.43 () {58 vars in 1150 bytes} [Tue Oct 4 18:39:50 2022] GET /compute/v2.1/servers?limit=100000 => generated 1012 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:51.084370 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-34039b6d-83c9-430b-9bee-5a81ccd63030 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Calling method '.version_select at 0x7fb21f9a2820>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:51.169889 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-34039b6d-83c9-430b-9bee-5a81ccd63030 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] 10.222.0.43 "GET /compute/v2.1/images/e4d3e808-f1b4-4480-90f6-79b6d4964f47" status: 200 len: 1455 microversion: 2.1 time: 0.091667 Oct 04 18:39:51.178722 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1038/2250] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 18:39:51 2022] GET /compute/v2.1/images/e4d3e808-f1b4-4480-90f6-79b6d4964f47 => generated 1455 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:51.184384 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-22a56243-9fb1-4a07-a97c-67d08f2b5bd8 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:51.189393 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-22a56243-9fb1-4a07-a97c-67d08f2b5bd8 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6a19da94e9e646028a7f73f9d0e0edda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc41f296eb44503868205ec8aa2fef3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:51.190179 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-22a56243-9fb1-4a07-a97c-67d08f2b5bd8 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Searching by: {'deleted': False, 'project_id': 'dfc41f296eb44503868205ec8aa2fef3'} {{(pid=123595) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:39:51.197101 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-22a56243-9fb1-4a07-a97c-67d08f2b5bd8 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:51.197889 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-22a56243-9fb1-4a07-a97c-67d08f2b5bd8 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:51.198730 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-22a56243-9fb1-4a07-a97c-67d08f2b5bd8 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:51.199939 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-22a56243-9fb1-4a07-a97c-67d08f2b5bd8 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:51.200809 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-22a56243-9fb1-4a07-a97c-67d08f2b5bd8 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:51.201499 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-22a56243-9fb1-4a07-a97c-67d08f2b5bd8 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:51.241607 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.multi_cell_list [None req-22a56243-9fb1-4a07-a97c-67d08f2b5bd8 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=123595) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 18:39:51.283469 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-69f07d79-1c85-4e17-b45c-706c527ee718 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eadce040fcf3427abab9ef8b0ca19400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f4f9b0233b4fb29963b77248a236f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:51.286480 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-22a56243-9fb1-4a07-a97c-67d08f2b5bd8 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] 10.222.0.43 "GET /compute/v2.1/servers" status: 200 len: 1012 microversion: 2.1 time: 0.105967 Oct 04 18:39:51.288134 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1039/2251] 10.222.0.43 () {58 vars in 1125 bytes} [Tue Oct 4 18:39:51 2022] GET /compute/v2.1/servers => generated 1012 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:51.296482 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-a56a5fac-26b6-4320-9764-95ae69203a1c req-42a9a673-e91d-4bd5-ba34-05baef00cef4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6eb9c803-dd97-4af5-b0d0-aa6fc18f8a89", "name": "network-vif-unplugged", "status": "completed", "tag": "32bec9cb-4066-4472-bb00-a407392e684f"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:39:51.303445 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-69f07d79-1c85-4e17-b45c-706c527ee718 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] 10.222.0.43 "GET /compute/v2.1/servers/36d7eb4f-22bc-4047-bc75-6f69142daee5" status: 200 len: 1525 microversion: 2.1 time: 0.282168 Oct 04 18:39:51.304320 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1213/2252] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:51 2022] GET /compute/v2.1/servers/36d7eb4f-22bc-4047-bc75-6f69142daee5 => generated 1525 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:51.312167 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-a56a5fac-26b6-4320-9764-95ae69203a1c req-42a9a673-e91d-4bd5-ba34-05baef00cef4 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:51.312655 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-a56a5fac-26b6-4320-9764-95ae69203a1c req-42a9a673-e91d-4bd5-ba34-05baef00cef4 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:51.313091 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-a56a5fac-26b6-4320-9764-95ae69203a1c req-42a9a673-e91d-4bd5-ba34-05baef00cef4 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:51.316074 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-d5ce04cf-d000-4d86-91ab-575b45b0a462 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:51.318615 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-d5ce04cf-d000-4d86-91ab-575b45b0a462 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] [instance: b6474a49-d05d-4d2e-afef-cdbbe8c6d9aa] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:51.326045 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-a56a5fac-26b6-4320-9764-95ae69203a1c req-42a9a673-e91d-4bd5-ba34-05baef00cef4 service nova] Creating event network-vif-unplugged:32bec9cb-4066-4472-bb00-a407392e684f for instance 6eb9c803-dd97-4af5-b0d0-aa6fc18f8a89 on n-h1-851028-13 Oct 04 18:39:51.329443 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d5ce04cf-d000-4d86-91ab-575b45b0a462 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:51.331340 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-a56a5fac-26b6-4320-9764-95ae69203a1c req-42a9a673-e91d-4bd5-ba34-05baef00cef4 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041506 Oct 04 18:39:51.332223 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1040/2253] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:39:51 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:39:51.334270 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d5ce04cf-d000-4d86-91ab-575b45b0a462 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:51.334891 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d5ce04cf-d000-4d86-91ab-575b45b0a462 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:51.337057 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-b3cbff21-3941-4090-92a7-c8d6d220e70a tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:51.342585 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d5ce04cf-d000-4d86-91ab-575b45b0a462 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:51.342819 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-b3cbff21-3941-4090-92a7-c8d6d220e70a tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6a19da94e9e646028a7f73f9d0e0edda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc41f296eb44503868205ec8aa2fef3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:51.343437 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-b3cbff21-3941-4090-92a7-c8d6d220e70a tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': 'dfc41f296eb44503868205ec8aa2fef3'} {{(pid=123595) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:39:51.343720 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d5ce04cf-d000-4d86-91ab-575b45b0a462 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:51.344344 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d5ce04cf-d000-4d86-91ab-575b45b0a462 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:51.358927 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b3cbff21-3941-4090-92a7-c8d6d220e70a tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:51.360108 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b3cbff21-3941-4090-92a7-c8d6d220e70a tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:51.360108 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b3cbff21-3941-4090-92a7-c8d6d220e70a tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:51.361046 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b3cbff21-3941-4090-92a7-c8d6d220e70a tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:51.361046 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b3cbff21-3941-4090-92a7-c8d6d220e70a tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:51.361528 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b3cbff21-3941-4090-92a7-c8d6d220e70a tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:51.457463 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.multi_cell_list [None req-b3cbff21-3941-4090-92a7-c8d6d220e70a tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=123595) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 18:39:51.517725 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-b3cbff21-3941-4090-92a7-c8d6d220e70a tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] 10.222.0.43 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 346 microversion: 2.1 time: 0.184489 Oct 04 18:39:51.518310 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1041/2254] 10.222.0.43 () {58 vars in 1146 bytes} [Tue Oct 4 18:39:51 2022] GET /compute/v2.1/servers?flavor=451 => generated 346 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:39:51.523125 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-01a140ec-00a9-46e4-9607-e7fb2773a021 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:51.523846 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-01a140ec-00a9-46e4-9607-e7fb2773a021 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] [instance: d1f298aa-ebe3-4f52-ada6-137a782cd9b7] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:51.531704 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-01a140ec-00a9-46e4-9607-e7fb2773a021 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:51.532186 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-01a140ec-00a9-46e4-9607-e7fb2773a021 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:51.532617 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-01a140ec-00a9-46e4-9607-e7fb2773a021 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:51.533340 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-01a140ec-00a9-46e4-9607-e7fb2773a021 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:51.533790 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-01a140ec-00a9-46e4-9607-e7fb2773a021 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:51.534211 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-01a140ec-00a9-46e4-9607-e7fb2773a021 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:51.652274 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-d5ce04cf-d000-4d86-91ab-575b45b0a462 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c96ec8b8e0a4053b0457f213e6e262d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b812c85494a49898376a0dd8140f03c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:51.660580 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-d5ce04cf-d000-4d86-91ab-575b45b0a462 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] 10.222.0.43 "GET /compute/v2.1/servers/b6474a49-d05d-4d2e-afef-cdbbe8c6d9aa" status: 200 len: 1316 microversion: 2.1 time: 0.351045 Oct 04 18:39:51.661188 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1214/2255] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:51 2022] GET /compute/v2.1/servers/b6474a49-d05d-4d2e-afef-cdbbe8c6d9aa => generated 1316 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:51.672264 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-01a140ec-00a9-46e4-9607-e7fb2773a021 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:51.679079 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-e2477c0f-51fc-4b58-81d9-a63f5391d11a tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:51.681855 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-01a140ec-00a9-46e4-9607-e7fb2773a021 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:51.683310 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-01a140ec-00a9-46e4-9607-e7fb2773a021 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:51.684160 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-e2477c0f-51fc-4b58-81d9-a63f5391d11a tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6a19da94e9e646028a7f73f9d0e0edda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc41f296eb44503868205ec8aa2fef3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:51.684607 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.compute.servers [None req-e2477c0f-51fc-4b58-81d9-a63f5391d11a tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Removing options 'limit' from query {{(pid=123596) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 04 18:39:51.684713 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-01a140ec-00a9-46e4-9607-e7fb2773a021 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] 10.222.0.43 "GET /compute/v2.1/servers/d1f298aa-ebe3-4f52-ada6-137a782cd9b7" status: 200 len: 1486 microversion: 2.25 time: 0.165401 Oct 04 18:39:51.685546 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1042/2256] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:39:51 2022] GET /compute/v2.1/servers/d1f298aa-ebe3-4f52-ada6-137a782cd9b7 => generated 1486 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:39:51.701741 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-e2477c0f-51fc-4b58-81d9-a63f5391d11a tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Searching by: {'deleted': False, 'project_id': 'dfc41f296eb44503868205ec8aa2fef3'} {{(pid=123596) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:39:51.708883 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e2477c0f-51fc-4b58-81d9-a63f5391d11a tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:51.709491 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e2477c0f-51fc-4b58-81d9-a63f5391d11a tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:51.709934 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e2477c0f-51fc-4b58-81d9-a63f5391d11a tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:51.710654 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e2477c0f-51fc-4b58-81d9-a63f5391d11a tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:51.711104 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e2477c0f-51fc-4b58-81d9-a63f5391d11a tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:51.711676 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e2477c0f-51fc-4b58-81d9-a63f5391d11a tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:51.730086 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=95,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=2,nova_cell1:RELEASE=1,nova_cell1:INSERT=1 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:39:51.745762 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-e2477c0f-51fc-4b58-81d9-a63f5391d11a tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] 10.222.0.43 "GET /compute/v2.1/servers?limit=1" status: 200 len: 485 microversion: 2.1 time: 0.083199 Oct 04 18:39:51.746789 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1215/2257] 10.222.0.43 () {58 vars in 1140 bytes} [Tue Oct 4 18:39:51 2022] GET /compute/v2.1/servers?limit=1 => generated 485 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:39:51.759502 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-8506f724-7dc0-4265-a651-56594873186a tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:51.765254 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-8506f724-7dc0-4265-a651-56594873186a tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6a19da94e9e646028a7f73f9d0e0edda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc41f296eb44503868205ec8aa2fef3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:51.766103 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-8506f724-7dc0-4265-a651-56594873186a tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-2073811457', 'deleted': False, 'project_id': 'dfc41f296eb44503868205ec8aa2fef3'} {{(pid=123595) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:39:51.772397 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8506f724-7dc0-4265-a651-56594873186a tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:51.772999 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8506f724-7dc0-4265-a651-56594873186a tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:51.773507 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8506f724-7dc0-4265-a651-56594873186a tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:51.774376 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8506f724-7dc0-4265-a651-56594873186a tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:51.774940 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8506f724-7dc0-4265-a651-56594873186a tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:51.775475 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8506f724-7dc0-4265-a651-56594873186a tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:51.867076 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.multi_cell_list [None req-8506f724-7dc0-4265-a651-56594873186a tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=123595) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 18:39:51.932401 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-8506f724-7dc0-4265-a651-56594873186a tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] 10.222.0.43 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-2073811457" status: 200 len: 346 microversion: 2.1 time: 0.176794 Oct 04 18:39:51.933794 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1043/2258] 10.222.0.43 () {58 vars in 1242 bytes} [Tue Oct 4 18:39:51 2022] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-2073811457 => generated 346 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:39:51.947012 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-6dbbf84b-6e53-428c-9ce5-2aed6a4a32e6 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:39:51.955325 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6dbbf84b-6e53-428c-9ce5-2aed6a4a32e6 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:51.955818 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6dbbf84b-6e53-428c-9ce5-2aed6a4a32e6 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:51.956252 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6dbbf84b-6e53-428c-9ce5-2aed6a4a32e6 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:52.008387 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-878cdfae-132c-4a43-bed9-34096fe18be0 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:52.009076 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-878cdfae-132c-4a43-bed9-34096fe18be0 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] [instance: b53d822f-e7b1-498a-b98a-35f87839dfe8] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:52.015420 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-878cdfae-132c-4a43-bed9-34096fe18be0 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:52.015912 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-878cdfae-132c-4a43-bed9-34096fe18be0 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:52.016380 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-878cdfae-132c-4a43-bed9-34096fe18be0 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:52.017084 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-878cdfae-132c-4a43-bed9-34096fe18be0 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:52.017566 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-878cdfae-132c-4a43-bed9-34096fe18be0 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:52.018048 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-878cdfae-132c-4a43-bed9-34096fe18be0 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:52.019732 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-6dbbf84b-6e53-428c-9ce5-2aed6a4a32e6 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] [instance: 1a71ee0e-ffa8-4730-b4fb-8b6e9fd87239] Going to try to stop instance {{(pid=123596) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 04 18:39:52.070622 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-6dbbf84b-6e53-428c-9ce5-2aed6a4a32e6 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] 10.222.0.43 "POST /compute/v2.1/servers/1a71ee0e-ffa8-4730-b4fb-8b6e9fd87239/action" status: 202 len: 0 microversion: 2.1 time: 0.127491 Oct 04 18:39:52.074200 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1216/2259] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 18:39:51 2022] POST /compute/v2.1/servers/1a71ee0e-ffa8-4730-b4fb-8b6e9fd87239/action => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:39:52.078299 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f0106b64-9787-4c42-a399-f3b443d73183 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:52.079123 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-f0106b64-9787-4c42-a399-f3b443d73183 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: d9d4332a-97b6-40f1-bd7c-a9a75a9adc43] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:52.086440 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f0106b64-9787-4c42-a399-f3b443d73183 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:52.086990 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f0106b64-9787-4c42-a399-f3b443d73183 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:52.087430 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f0106b64-9787-4c42-a399-f3b443d73183 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:52.088136 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f0106b64-9787-4c42-a399-f3b443d73183 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:52.088586 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f0106b64-9787-4c42-a399-f3b443d73183 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:52.089531 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f0106b64-9787-4c42-a399-f3b443d73183 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:52.121996 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-878cdfae-132c-4a43-bed9-34096fe18be0 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e1add2296c4ed5830c5d90ef272ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fdc44ceeb041bcba1be2fcc2084aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:52.124291 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:39:52.133968 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-878cdfae-132c-4a43-bed9-34096fe18be0 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59e1add2296c4ed5830c5d90ef272ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fdc44ceeb041bcba1be2fcc2084aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:52.135433 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-878cdfae-132c-4a43-bed9-34096fe18be0 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59e1add2296c4ed5830c5d90ef272ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fdc44ceeb041bcba1be2fcc2084aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:52.136633 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-878cdfae-132c-4a43-bed9-34096fe18be0 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] 10.222.0.43 "GET /compute/v2.1/servers/b53d822f-e7b1-498a-b98a-35f87839dfe8" status: 200 len: 1336 microversion: 2.54 time: 0.132677 Oct 04 18:39:52.155196 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1044/2260] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:39:52 2022] GET /compute/v2.1/servers/b53d822f-e7b1-498a-b98a-35f87839dfe8 => generated 1336 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:39:52.161322 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-75646807-b830-4475-8db7-c62fa417d953 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:52.161982 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-75646807-b830-4475-8db7-c62fa417d953 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] [instance: 1a71ee0e-ffa8-4730-b4fb-8b6e9fd87239] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:52.169647 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-75646807-b830-4475-8db7-c62fa417d953 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:52.170403 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-75646807-b830-4475-8db7-c62fa417d953 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:52.171451 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-75646807-b830-4475-8db7-c62fa417d953 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:52.172177 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-75646807-b830-4475-8db7-c62fa417d953 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:52.172636 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-75646807-b830-4475-8db7-c62fa417d953 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:52.173261 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-75646807-b830-4475-8db7-c62fa417d953 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:52.300179 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-f0106b64-9787-4c42-a399-f3b443d73183 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:52.320830 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-f0106b64-9787-4c42-a399-f3b443d73183 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/d9d4332a-97b6-40f1-bd7c-a9a75a9adc43" status: 200 len: 1542 microversion: 2.1 time: 0.247251 Oct 04 18:39:52.322728 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1217/2261] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:52 2022] GET /compute/v2.1/servers/d9d4332a-97b6-40f1-bd7c-a9a75a9adc43 => generated 1542 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:52.337982 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-e2892637-6485-49dd-a18b-32a3de90c8b0 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Calling method '.version_select at 0x7fb21ef970d0>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:52.382176 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-75646807-b830-4475-8db7-c62fa417d953 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a19da94e9e646028a7f73f9d0e0edda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc41f296eb44503868205ec8aa2fef3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:52.399773 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-75646807-b830-4475-8db7-c62fa417d953 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] 10.222.0.43 "GET /compute/v2.1/servers/1a71ee0e-ffa8-4730-b4fb-8b6e9fd87239" status: 200 len: 1521 microversion: 2.1 time: 0.245195 Oct 04 18:39:52.401092 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1045/2262] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:52 2022] GET /compute/v2.1/servers/1a71ee0e-ffa8-4730-b4fb-8b6e9fd87239 => generated 1521 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:52.406782 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-b79ea487-2b7f-4a83-84a2-c149c8490669 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:52.407342 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-b79ea487-2b7f-4a83-84a2-c149c8490669 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] [instance: 36d7eb4f-22bc-4047-bc75-6f69142daee5] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:52.410674 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-e2892637-6485-49dd-a18b-32a3de90c8b0 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] 10.222.0.43 "GET /compute/v2.1/images/e4d3e808-f1b4-4480-90f6-79b6d4964f47" status: 200 len: 1455 microversion: 2.1 time: 0.086700 Oct 04 18:39:52.411749 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1218/2263] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 18:39:52 2022] GET /compute/v2.1/images/e4d3e808-f1b4-4480-90f6-79b6d4964f47 => generated 1455 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:52.422804 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b79ea487-2b7f-4a83-84a2-c149c8490669 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:52.423391 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b79ea487-2b7f-4a83-84a2-c149c8490669 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:52.423906 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b79ea487-2b7f-4a83-84a2-c149c8490669 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:52.424693 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b79ea487-2b7f-4a83-84a2-c149c8490669 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:52.425386 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b79ea487-2b7f-4a83-84a2-c149c8490669 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:52.425884 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b79ea487-2b7f-4a83-84a2-c149c8490669 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:52.585761 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-b79ea487-2b7f-4a83-84a2-c149c8490669 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eadce040fcf3427abab9ef8b0ca19400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f4f9b0233b4fb29963b77248a236f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:52.595558 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-b79ea487-2b7f-4a83-84a2-c149c8490669 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] 10.222.0.43 "GET /compute/v2.1/servers/36d7eb4f-22bc-4047-bc75-6f69142daee5" status: 200 len: 1525 microversion: 2.1 time: 0.191773 Oct 04 18:39:52.595718 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1046/2264] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:52 2022] GET /compute/v2.1/servers/36d7eb4f-22bc-4047-bc75-6f69142daee5 => generated 1525 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:52.687348 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-02fcb627-5270-4196-8c70-98451fbe2646 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:52.688585 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-02fcb627-5270-4196-8c70-98451fbe2646 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] [instance: b6474a49-d05d-4d2e-afef-cdbbe8c6d9aa] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:52.695172 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-02fcb627-5270-4196-8c70-98451fbe2646 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:52.695861 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-02fcb627-5270-4196-8c70-98451fbe2646 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:52.696611 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-02fcb627-5270-4196-8c70-98451fbe2646 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:52.697894 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-02fcb627-5270-4196-8c70-98451fbe2646 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:52.698883 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-02fcb627-5270-4196-8c70-98451fbe2646 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:52.699587 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-02fcb627-5270-4196-8c70-98451fbe2646 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:52.721433 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-2ffe092e-7d2b-4ada-9525-26a766422e20 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:52.722405 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-2ffe092e-7d2b-4ada-9525-26a766422e20 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] [instance: d1f298aa-ebe3-4f52-ada6-137a782cd9b7] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:52.734629 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:39:52.740591 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2ffe092e-7d2b-4ada-9525-26a766422e20 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:52.741698 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2ffe092e-7d2b-4ada-9525-26a766422e20 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:52.743032 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2ffe092e-7d2b-4ada-9525-26a766422e20 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:52.745307 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2ffe092e-7d2b-4ada-9525-26a766422e20 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:52.748035 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2ffe092e-7d2b-4ada-9525-26a766422e20 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:52.748681 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2ffe092e-7d2b-4ada-9525-26a766422e20 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:52.926492 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-02fcb627-5270-4196-8c70-98451fbe2646 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c96ec8b8e0a4053b0457f213e6e262d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b812c85494a49898376a0dd8140f03c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:52.936310 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-02fcb627-5270-4196-8c70-98451fbe2646 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] 10.222.0.43 "GET /compute/v2.1/servers/b6474a49-d05d-4d2e-afef-cdbbe8c6d9aa" status: 200 len: 1316 microversion: 2.1 time: 0.253927 Oct 04 18:39:52.937200 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1219/2265] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:52 2022] GET /compute/v2.1/servers/b6474a49-d05d-4d2e-afef-cdbbe8c6d9aa => generated 1316 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:52.974436 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-2ffe092e-7d2b-4ada-9525-26a766422e20 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:52.984831 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-2ffe092e-7d2b-4ada-9525-26a766422e20 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:52.986674 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-2ffe092e-7d2b-4ada-9525-26a766422e20 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:52.988348 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-2ffe092e-7d2b-4ada-9525-26a766422e20 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] 10.222.0.43 "GET /compute/v2.1/servers/d1f298aa-ebe3-4f52-ada6-137a782cd9b7" status: 200 len: 1476 microversion: 2.25 time: 0.271054 Oct 04 18:39:52.989165 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1047/2266] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:39:52 2022] GET /compute/v2.1/servers/d1f298aa-ebe3-4f52-ada6-137a782cd9b7 => generated 1476 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:39:53.014020 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-1a47119a-1871-4ff4-ac1c-ea92be92d471 tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] Calling method '.version_select at 0x7fb21ef66820>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:53.017565 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1a47119a-1871-4ff4-ac1c-ea92be92d471 tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:53.018133 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1a47119a-1871-4ff4-ac1c-ea92be92d471 tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:53.018588 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1a47119a-1871-4ff4-ac1c-ea92be92d471 tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:53.032941 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-1a47119a-1871-4ff4-ac1c-ea92be92d471 tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] 10.222.0.43 "GET /compute/v2.1/os-migrations" status: 200 len: 3234 microversion: 2.25 time: 0.022900 Oct 04 18:39:53.046082 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1220/2267] 10.222.0.43 () {60 vars in 1184 bytes} [Tue Oct 4 18:39:53 2022] GET /compute/v2.1/os-migrations => generated 3234 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:39:53.055542 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-d6e87a4b-1d44-44ef-8fc0-6cac6859302d tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:53.056203 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-d6e87a4b-1d44-44ef-8fc0-6cac6859302d tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] [instance: d1f298aa-ebe3-4f52-ada6-137a782cd9b7] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:53.062475 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d6e87a4b-1d44-44ef-8fc0-6cac6859302d tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:53.062974 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d6e87a4b-1d44-44ef-8fc0-6cac6859302d tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:53.063416 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d6e87a4b-1d44-44ef-8fc0-6cac6859302d tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:53.064120 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d6e87a4b-1d44-44ef-8fc0-6cac6859302d tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:53.064575 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d6e87a4b-1d44-44ef-8fc0-6cac6859302d tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:53.065009 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d6e87a4b-1d44-44ef-8fc0-6cac6859302d tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:53.168082 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-4a7b4b21-9be3-48d6-bcb4-190f87ccff39 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:53.168629 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-4a7b4b21-9be3-48d6-bcb4-190f87ccff39 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] [instance: b53d822f-e7b1-498a-b98a-35f87839dfe8] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:53.176234 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4a7b4b21-9be3-48d6-bcb4-190f87ccff39 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:53.176734 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4a7b4b21-9be3-48d6-bcb4-190f87ccff39 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:53.177210 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4a7b4b21-9be3-48d6-bcb4-190f87ccff39 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:53.177915 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4a7b4b21-9be3-48d6-bcb4-190f87ccff39 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:53.178374 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4a7b4b21-9be3-48d6-bcb4-190f87ccff39 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:53.178802 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4a7b4b21-9be3-48d6-bcb4-190f87ccff39 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:53.250074 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-4a7b4b21-9be3-48d6-bcb4-190f87ccff39 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e1add2296c4ed5830c5d90ef272ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fdc44ceeb041bcba1be2fcc2084aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:53.260448 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-4a7b4b21-9be3-48d6-bcb4-190f87ccff39 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59e1add2296c4ed5830c5d90ef272ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fdc44ceeb041bcba1be2fcc2084aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:53.262846 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-4a7b4b21-9be3-48d6-bcb4-190f87ccff39 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59e1add2296c4ed5830c5d90ef272ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fdc44ceeb041bcba1be2fcc2084aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:53.264026 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-4a7b4b21-9be3-48d6-bcb4-190f87ccff39 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] 10.222.0.43 "GET /compute/v2.1/servers/b53d822f-e7b1-498a-b98a-35f87839dfe8" status: 200 len: 1336 microversion: 2.54 time: 0.100047 Oct 04 18:39:53.264734 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1221/2268] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:39:53 2022] GET /compute/v2.1/servers/b53d822f-e7b1-498a-b98a-35f87839dfe8 => generated 1336 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:39:53.292241 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.objects.instance [None req-d6e87a4b-1d44-44ef-8fc0-6cac6859302d tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] Lazy-loading 'services' on Instance uuid d1f298aa-ebe3-4f52-ada6-137a782cd9b7 {{(pid=123595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:39:53.308877 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-d6e87a4b-1d44-44ef-8fc0-6cac6859302d tempest-LiveAutoBlockMigrationV225Test-585864039 tempest-LiveAutoBlockMigrationV225Test-585864039-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/d1f298aa-ebe3-4f52-ada6-137a782cd9b7" status: 200 len: 1970 microversion: 2.25 time: 0.257579 Oct 04 18:39:53.309727 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1048/2269] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:39:53 2022] GET /compute/v2.1/servers/d1f298aa-ebe3-4f52-ada6-137a782cd9b7 => generated 1970 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:39:53.350938 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-0a541689-a66e-4026-9684-95cf301b0373 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:53.355035 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f6ef4b32-0d08-46b4-a154-2430aec2b3ad tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:53.358138 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-0a541689-a66e-4026-9684-95cf301b0373 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: d9d4332a-97b6-40f1-bd7c-a9a75a9adc43] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:53.358330 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-f6ef4b32-0d08-46b4-a154-2430aec2b3ad tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] [instance: d1f298aa-ebe3-4f52-ada6-137a782cd9b7] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:53.364325 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0a541689-a66e-4026-9684-95cf301b0373 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:53.365320 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0a541689-a66e-4026-9684-95cf301b0373 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:53.365519 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0a541689-a66e-4026-9684-95cf301b0373 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:53.366400 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0a541689-a66e-4026-9684-95cf301b0373 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:53.367043 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0a541689-a66e-4026-9684-95cf301b0373 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:53.367474 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0a541689-a66e-4026-9684-95cf301b0373 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:53.369229 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_api:DELETE=2,nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:39:53.373359 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f6ef4b32-0d08-46b4-a154-2430aec2b3ad tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:53.376770 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f6ef4b32-0d08-46b4-a154-2430aec2b3ad tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:53.377272 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f6ef4b32-0d08-46b4-a154-2430aec2b3ad tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:53.378003 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f6ef4b32-0d08-46b4-a154-2430aec2b3ad tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:53.378467 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f6ef4b32-0d08-46b4-a154-2430aec2b3ad tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:53.378961 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f6ef4b32-0d08-46b4-a154-2430aec2b3ad tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:53.432317 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-f6ef4b32-0d08-46b4-a154-2430aec2b3ad tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] [instance: d1f298aa-ebe3-4f52-ada6-137a782cd9b7] Going to try to terminate instance {{(pid=123596) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:39:53.620971 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-0a541689-a66e-4026-9684-95cf301b0373 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:53.625072 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-f6ef4b32-0d08-46b4-a154-2430aec2b3ad tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] 10.222.0.43 "DELETE /compute/v2.1/servers/d1f298aa-ebe3-4f52-ada6-137a782cd9b7" status: 204 len: 0 microversion: 2.25 time: 0.277164 Oct 04 18:39:53.625799 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1222/2270] 10.222.0.43 () {60 vars in 1280 bytes} [Tue Oct 4 18:39:53 2022] DELETE /compute/v2.1/servers/d1f298aa-ebe3-4f52-ada6-137a782cd9b7 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 18:39:53.632414 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-0a541689-a66e-4026-9684-95cf301b0373 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/d9d4332a-97b6-40f1-bd7c-a9a75a9adc43" status: 200 len: 1542 microversion: 2.1 time: 0.286370 Oct 04 18:39:53.638811 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1049/2271] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:53 2022] GET /compute/v2.1/servers/d9d4332a-97b6-40f1-bd7c-a9a75a9adc43 => generated 1542 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:53.649051 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-a97b55e0-998b-4cc1-8207-0521c9685d21 req-c30a81b5-0559-4139-b819-bd6c379b0322 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6474a49-d05d-4d2e-afef-cdbbe8c6d9aa", "name": "network-vif-plugged", "status": "completed", "tag": "983dac01-7966-45d6-9bba-c9843044df16"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:39:53.664163 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-cf4fe0ee-d159-46e6-b0ed-c9238108258c tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Calling method '.version_select at 0x7fb21f06ac10>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:53.710549 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-a97b55e0-998b-4cc1-8207-0521c9685d21 req-c30a81b5-0559-4139-b819-bd6c379b0322 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:53.711728 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-a97b55e0-998b-4cc1-8207-0521c9685d21 req-c30a81b5-0559-4139-b819-bd6c379b0322 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:53.712934 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-a97b55e0-998b-4cc1-8207-0521c9685d21 req-c30a81b5-0559-4139-b819-bd6c379b0322 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:53.743685 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-a97b55e0-998b-4cc1-8207-0521c9685d21 req-c30a81b5-0559-4139-b819-bd6c379b0322 service nova] Creating event network-vif-plugged:983dac01-7966-45d6-9bba-c9843044df16 for instance b6474a49-d05d-4d2e-afef-cdbbe8c6d9aa on n-h2-851028-13 Oct 04 18:39:53.752666 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-a97b55e0-998b-4cc1-8207-0521c9685d21 req-c30a81b5-0559-4139-b819-bd6c379b0322 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125066 Oct 04 18:39:53.754038 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1223/2272] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:39:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:39:53.761393 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f81edb4d-18ca-49f6-8573-3ce8262e2343 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:53.766918 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-cf4fe0ee-d159-46e6-b0ed-c9238108258c tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] 10.222.0.43 "GET /compute/v2.1/images/e4d3e808-f1b4-4480-90f6-79b6d4964f47" status: 200 len: 1455 microversion: 2.1 time: 0.123699 Oct 04 18:39:53.768416 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1050/2273] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 18:39:53 2022] GET /compute/v2.1/images/e4d3e808-f1b4-4480-90f6-79b6d4964f47 => generated 1455 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:53.773327 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-f81edb4d-18ca-49f6-8573-3ce8262e2343 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] [instance: 1a71ee0e-ffa8-4730-b4fb-8b6e9fd87239] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:53.781253 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f81edb4d-18ca-49f6-8573-3ce8262e2343 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:53.782137 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f81edb4d-18ca-49f6-8573-3ce8262e2343 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:53.782759 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f81edb4d-18ca-49f6-8573-3ce8262e2343 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:53.783678 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f81edb4d-18ca-49f6-8573-3ce8262e2343 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:53.784277 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f81edb4d-18ca-49f6-8573-3ce8262e2343 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:53.784842 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f81edb4d-18ca-49f6-8573-3ce8262e2343 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:53.795400 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-94de51e0-6c68-4739-8e8f-de82f7a83c4c tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:53.800378 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-94de51e0-6c68-4739-8e8f-de82f7a83c4c tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] [instance: 36d7eb4f-22bc-4047-bc75-6f69142daee5] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:53.820100 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-94de51e0-6c68-4739-8e8f-de82f7a83c4c tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:53.821226 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-94de51e0-6c68-4739-8e8f-de82f7a83c4c tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:53.822742 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-94de51e0-6c68-4739-8e8f-de82f7a83c4c tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:53.824265 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-94de51e0-6c68-4739-8e8f-de82f7a83c4c tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:53.826734 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-94de51e0-6c68-4739-8e8f-de82f7a83c4c tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:53.827452 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-94de51e0-6c68-4739-8e8f-de82f7a83c4c tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:54.141672 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-f81edb4d-18ca-49f6-8573-3ce8262e2343 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a19da94e9e646028a7f73f9d0e0edda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc41f296eb44503868205ec8aa2fef3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:54.153483 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-f81edb4d-18ca-49f6-8573-3ce8262e2343 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] 10.222.0.43 "GET /compute/v2.1/servers/1a71ee0e-ffa8-4730-b4fb-8b6e9fd87239" status: 200 len: 1521 microversion: 2.1 time: 0.397765 Oct 04 18:39:54.156242 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1224/2274] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:53 2022] GET /compute/v2.1/servers/1a71ee0e-ffa8-4730-b4fb-8b6e9fd87239 => generated 1521 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:54.177982 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-70a312ba-7504-4700-b1c6-cacf16f5b809 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:54.178613 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-70a312ba-7504-4700-b1c6-cacf16f5b809 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] [instance: d1f298aa-ebe3-4f52-ada6-137a782cd9b7] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:54.186593 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-70a312ba-7504-4700-b1c6-cacf16f5b809 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:54.187119 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-70a312ba-7504-4700-b1c6-cacf16f5b809 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:54.187543 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-70a312ba-7504-4700-b1c6-cacf16f5b809 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:54.188275 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-70a312ba-7504-4700-b1c6-cacf16f5b809 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:54.189328 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-70a312ba-7504-4700-b1c6-cacf16f5b809 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:54.189328 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-70a312ba-7504-4700-b1c6-cacf16f5b809 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:54.191419 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-94de51e0-6c68-4739-8e8f-de82f7a83c4c tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eadce040fcf3427abab9ef8b0ca19400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f4f9b0233b4fb29963b77248a236f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:54.204913 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-94de51e0-6c68-4739-8e8f-de82f7a83c4c tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] 10.222.0.43 "GET /compute/v2.1/servers/36d7eb4f-22bc-4047-bc75-6f69142daee5" status: 200 len: 1525 microversion: 2.1 time: 0.433625 Oct 04 18:39:54.206074 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1051/2275] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:53 2022] GET /compute/v2.1/servers/36d7eb4f-22bc-4047-bc75-6f69142daee5 => generated 1525 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:54.210436 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-fd984adb-07a2-4572-b8f4-389a28b7b49a tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:54.211228 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-fd984adb-07a2-4572-b8f4-389a28b7b49a tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] [instance: b6474a49-d05d-4d2e-afef-cdbbe8c6d9aa] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:54.227301 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fd984adb-07a2-4572-b8f4-389a28b7b49a tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:54.227776 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fd984adb-07a2-4572-b8f4-389a28b7b49a tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:54.228381 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fd984adb-07a2-4572-b8f4-389a28b7b49a tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:54.229323 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fd984adb-07a2-4572-b8f4-389a28b7b49a tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:54.229832 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fd984adb-07a2-4572-b8f4-389a28b7b49a tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:54.230577 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fd984adb-07a2-4572-b8f4-389a28b7b49a tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:54.478374 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-fd984adb-07a2-4572-b8f4-389a28b7b49a tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c96ec8b8e0a4053b0457f213e6e262d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b812c85494a49898376a0dd8140f03c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:54.480915 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-70a312ba-7504-4700-b1c6-cacf16f5b809 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:54.496019 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-70a312ba-7504-4700-b1c6-cacf16f5b809 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:54.496219 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-fd984adb-07a2-4572-b8f4-389a28b7b49a tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] 10.222.0.43 "GET /compute/v2.1/servers/b6474a49-d05d-4d2e-afef-cdbbe8c6d9aa" status: 200 len: 1316 microversion: 2.1 time: 0.282289 Oct 04 18:39:54.496868 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1052/2276] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:54 2022] GET /compute/v2.1/servers/b6474a49-d05d-4d2e-afef-cdbbe8c6d9aa => generated 1316 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:54.498686 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-70a312ba-7504-4700-b1c6-cacf16f5b809 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:54.499876 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-70a312ba-7504-4700-b1c6-cacf16f5b809 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] 10.222.0.43 "GET /compute/v2.1/servers/d1f298aa-ebe3-4f52-ada6-137a782cd9b7" status: 200 len: 1482 microversion: 2.25 time: 0.328749 Oct 04 18:39:54.500427 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1225/2277] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:39:54 2022] GET /compute/v2.1/servers/d1f298aa-ebe3-4f52-ada6-137a782cd9b7 => generated 1482 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:39:54.501909 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-168b8ba1-624f-4ec3-8a3e-21e3b45cf18d tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:54.504254 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-168b8ba1-624f-4ec3-8a3e-21e3b45cf18d tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] [instance: b53d822f-e7b1-498a-b98a-35f87839dfe8] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:54.512931 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-1dc15f99-e082-40ec-988d-671dc1ac8a30 req-97fff4f6-8dad-4afc-bcfc-82190bd3de08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36d7eb4f-22bc-4047-bc75-6f69142daee5", "name": "network-vif-deleted", "tag": "e3d142e8-c4f2-49f8-af0d-f2e13e22b36f"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:39:54.522852 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-168b8ba1-624f-4ec3-8a3e-21e3b45cf18d tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:54.523348 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-168b8ba1-624f-4ec3-8a3e-21e3b45cf18d tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:54.524146 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-168b8ba1-624f-4ec3-8a3e-21e3b45cf18d tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:54.526126 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-168b8ba1-624f-4ec3-8a3e-21e3b45cf18d tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:54.526821 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-168b8ba1-624f-4ec3-8a3e-21e3b45cf18d tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:54.527045 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-1dc15f99-e082-40ec-988d-671dc1ac8a30 req-97fff4f6-8dad-4afc-bcfc-82190bd3de08 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:54.527146 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-168b8ba1-624f-4ec3-8a3e-21e3b45cf18d tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:54.527763 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-1dc15f99-e082-40ec-988d-671dc1ac8a30 req-97fff4f6-8dad-4afc-bcfc-82190bd3de08 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:54.528311 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-1dc15f99-e082-40ec-988d-671dc1ac8a30 req-97fff4f6-8dad-4afc-bcfc-82190bd3de08 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:54.540251 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-1dc15f99-e082-40ec-988d-671dc1ac8a30 req-97fff4f6-8dad-4afc-bcfc-82190bd3de08 service nova] Creating event network-vif-deleted:e3d142e8-c4f2-49f8-af0d-f2e13e22b36f for instance 36d7eb4f-22bc-4047-bc75-6f69142daee5 on n-h2-851028-13 Oct 04 18:39:54.546054 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-1dc15f99-e082-40ec-988d-671dc1ac8a30 req-97fff4f6-8dad-4afc-bcfc-82190bd3de08 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042679 Oct 04 18:39:54.547087 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1226/2278] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:39:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:39:54.593900 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-168b8ba1-624f-4ec3-8a3e-21e3b45cf18d tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e1add2296c4ed5830c5d90ef272ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fdc44ceeb041bcba1be2fcc2084aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:54.602112 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-168b8ba1-624f-4ec3-8a3e-21e3b45cf18d tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59e1add2296c4ed5830c5d90ef272ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fdc44ceeb041bcba1be2fcc2084aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:54.603563 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-168b8ba1-624f-4ec3-8a3e-21e3b45cf18d tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59e1add2296c4ed5830c5d90ef272ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fdc44ceeb041bcba1be2fcc2084aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:54.604982 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-168b8ba1-624f-4ec3-8a3e-21e3b45cf18d tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] 10.222.0.43 "GET /compute/v2.1/servers/b53d822f-e7b1-498a-b98a-35f87839dfe8" status: 200 len: 1357 microversion: 2.54 time: 0.106685 Oct 04 18:39:54.605833 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1053/2279] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:39:54 2022] GET /compute/v2.1/servers/b53d822f-e7b1-498a-b98a-35f87839dfe8 => generated 1357 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:39:54.633270 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-d551d22d-55a1-418e-9fb1-87075d015ba4 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Action: 'create', calling method: .version_select at 0x7fb21ee004c0>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-1921507633", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBkZMp71bZwKxk24zFMGmDt4zzK+TiQ+MON5cuxvBfXqutYlT99GyBQSLT1Xe0kvFZMEKd32KFeqpghYHM0r4wAXVlboAqVSLOTJogHFyMBukHSj5k01k5eWuy4Q7C423g=="}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:39:54.649426 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-d551d22d-55a1-418e-9fb1-87075d015ba4 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Getting quotas for project 29fdc44ceeb041bcba1be2fcc2084aff. Resources: {'key_pairs'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:39:54.653864 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-d551d22d-55a1-418e-9fb1-87075d015ba4 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Getting quotas for user 59e1add2296c4ed5830c5d90ef272ad7 and project 29fdc44ceeb041bcba1be2fcc2084aff. Resources: {'key_pairs'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:39:54.665008 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-26f3c813-dcee-4a2f-8c74-a325bc93b8d7 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:54.665877 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-26f3c813-dcee-4a2f-8c74-a325bc93b8d7 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: d9d4332a-97b6-40f1-bd7c-a9a75a9adc43] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:54.673218 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-26f3c813-dcee-4a2f-8c74-a325bc93b8d7 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:54.673880 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-26f3c813-dcee-4a2f-8c74-a325bc93b8d7 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:54.674359 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-26f3c813-dcee-4a2f-8c74-a325bc93b8d7 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:54.675243 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-26f3c813-dcee-4a2f-8c74-a325bc93b8d7 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:54.675672 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-26f3c813-dcee-4a2f-8c74-a325bc93b8d7 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:54.676138 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-26f3c813-dcee-4a2f-8c74-a325bc93b8d7 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:54.678742 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-d551d22d-55a1-418e-9fb1-87075d015ba4 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.54 time: 0.049796 Oct 04 18:39:54.679540 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1227/2280] 10.222.0.43 () {62 vars in 1200 bytes} [Tue Oct 4 18:39:54 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 51 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Oct 04 18:39:54.691603 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-d035395a-a2ee-488f-b654-2834dd17a59d tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-1921507633", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243"}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:39:54.694670 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-d035395a-a2ee-488f-b654-2834dd17a59d tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] [instance: b53d822f-e7b1-498a-b98a-35f87839dfe8] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:54.702491 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d035395a-a2ee-488f-b654-2834dd17a59d tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:54.702916 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d035395a-a2ee-488f-b654-2834dd17a59d tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:54.703353 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d035395a-a2ee-488f-b654-2834dd17a59d tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:54.704069 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d035395a-a2ee-488f-b654-2834dd17a59d tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:54.704501 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d035395a-a2ee-488f-b654-2834dd17a59d tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:54.704931 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d035395a-a2ee-488f-b654-2834dd17a59d tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:54.803344 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-d035395a-a2ee-488f-b654-2834dd17a59d tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Flavor limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:39:54.804010 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-d035395a-a2ee-488f-b654-2834dd17a59d tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Image limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:39:54.804230 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-d035395a-a2ee-488f-b654-2834dd17a59d tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Flavor pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:39:54.804815 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-d035395a-a2ee-488f-b654-2834dd17a59d tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Image pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:39:54.805406 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-d035395a-a2ee-488f-b654-2834dd17a59d tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:39:54.845914 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-26f3c813-dcee-4a2f-8c74-a325bc93b8d7 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:54.854069 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-26f3c813-dcee-4a2f-8c74-a325bc93b8d7 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/d9d4332a-97b6-40f1-bd7c-a9a75a9adc43" status: 200 len: 1542 microversion: 2.1 time: 0.193584 Oct 04 18:39:54.856241 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1054/2281] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:54 2022] GET /compute/v2.1/servers/d9d4332a-97b6-40f1-bd7c-a9a75a9adc43 => generated 1542 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:39:54.861829 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-87ba3069-44bc-4ed9-b451-80fdb1fa7a18 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Calling method '.version_select at 0x7fb21f0383a0>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:54.915321 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-d035395a-a2ee-488f-b654-2834dd17a59d tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] [instance: b53d822f-e7b1-498a-b98a-35f87839dfe8] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:54.929741 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-87ba3069-44bc-4ed9-b451-80fdb1fa7a18 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] 10.222.0.43 "GET /compute/v2.1/images/e4d3e808-f1b4-4480-90f6-79b6d4964f47" status: 200 len: 1455 microversion: 2.1 time: 0.072181 Oct 04 18:39:54.929993 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d035395a-a2ee-488f-b654-2834dd17a59d tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:54.931614 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d035395a-a2ee-488f-b654-2834dd17a59d tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:54.932077 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d035395a-a2ee-488f-b654-2834dd17a59d tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:54.935829 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d035395a-a2ee-488f-b654-2834dd17a59d tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:54.936084 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1055/2282] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 18:39:54 2022] GET /compute/v2.1/images/e4d3e808-f1b4-4480-90f6-79b6d4964f47 => generated 1455 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:54.936286 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d035395a-a2ee-488f-b654-2834dd17a59d tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:54.939093 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d035395a-a2ee-488f-b654-2834dd17a59d tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:55.013085 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-d035395a-a2ee-488f-b654-2834dd17a59d tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] 10.222.0.43 "POST /compute/v2.1/servers/b53d822f-e7b1-498a-b98a-35f87839dfe8/action" status: 202 len: 1140 microversion: 2.54 time: 0.325426 Oct 04 18:39:55.014055 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1228/2283] 10.222.0.43 () {62 vars in 1320 bytes} [Tue Oct 4 18:39:54 2022] POST /compute/v2.1/servers/b53d822f-e7b1-498a-b98a-35f87839dfe8/action => generated 1140 bytes in 327 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 04 18:39:55.035914 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-f450eecf-6700-49c0-8122-ee3ea9b2cddc tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:55.035914 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-f450eecf-6700-49c0-8122-ee3ea9b2cddc tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] [instance: b53d822f-e7b1-498a-b98a-35f87839dfe8] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:55.041841 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f450eecf-6700-49c0-8122-ee3ea9b2cddc tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:55.045331 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f450eecf-6700-49c0-8122-ee3ea9b2cddc tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:55.045331 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f450eecf-6700-49c0-8122-ee3ea9b2cddc tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:55.045331 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f450eecf-6700-49c0-8122-ee3ea9b2cddc tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:55.045331 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f450eecf-6700-49c0-8122-ee3ea9b2cddc tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:55.045331 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f450eecf-6700-49c0-8122-ee3ea9b2cddc tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:55.116611 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-f450eecf-6700-49c0-8122-ee3ea9b2cddc tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e1add2296c4ed5830c5d90ef272ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fdc44ceeb041bcba1be2fcc2084aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:55.125630 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-f450eecf-6700-49c0-8122-ee3ea9b2cddc tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59e1add2296c4ed5830c5d90ef272ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fdc44ceeb041bcba1be2fcc2084aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:55.130630 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-f450eecf-6700-49c0-8122-ee3ea9b2cddc tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59e1add2296c4ed5830c5d90ef272ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fdc44ceeb041bcba1be2fcc2084aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:55.133741 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-f450eecf-6700-49c0-8122-ee3ea9b2cddc tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] 10.222.0.43 "GET /compute/v2.1/servers/b53d822f-e7b1-498a-b98a-35f87839dfe8" status: 200 len: 1409 microversion: 2.54 time: 0.102654 Oct 04 18:39:55.138378 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1056/2284] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:39:55 2022] GET /compute/v2.1/servers/b53d822f-e7b1-498a-b98a-35f87839dfe8 => generated 1409 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:39:55.185808 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-b33013a2-06fd-4e58-a6c8-f4cd1e0b0c90 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:55.186629 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-b33013a2-06fd-4e58-a6c8-f4cd1e0b0c90 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] [instance: 1a71ee0e-ffa8-4730-b4fb-8b6e9fd87239] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:55.196594 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b33013a2-06fd-4e58-a6c8-f4cd1e0b0c90 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:55.197238 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b33013a2-06fd-4e58-a6c8-f4cd1e0b0c90 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:55.197846 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b33013a2-06fd-4e58-a6c8-f4cd1e0b0c90 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:55.198992 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b33013a2-06fd-4e58-a6c8-f4cd1e0b0c90 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:55.199557 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b33013a2-06fd-4e58-a6c8-f4cd1e0b0c90 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:55.200112 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b33013a2-06fd-4e58-a6c8-f4cd1e0b0c90 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:55.230469 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-d98a25b0-5006-4fef-90e8-4a00bd652c1a tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:55.231093 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-d98a25b0-5006-4fef-90e8-4a00bd652c1a tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] [instance: 36d7eb4f-22bc-4047-bc75-6f69142daee5] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:55.258397 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d98a25b0-5006-4fef-90e8-4a00bd652c1a tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:55.258893 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d98a25b0-5006-4fef-90e8-4a00bd652c1a tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:55.259387 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d98a25b0-5006-4fef-90e8-4a00bd652c1a tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:55.260050 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d98a25b0-5006-4fef-90e8-4a00bd652c1a tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:55.260457 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d98a25b0-5006-4fef-90e8-4a00bd652c1a tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:55.260945 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d98a25b0-5006-4fef-90e8-4a00bd652c1a tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:55.304160 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d98a25b0-5006-4fef-90e8-4a00bd652c1a tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:55.304934 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d98a25b0-5006-4fef-90e8-4a00bd652c1a tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:55.305406 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d98a25b0-5006-4fef-90e8-4a00bd652c1a tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:55.305851 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.objects.instance [None req-d98a25b0-5006-4fef-90e8-4a00bd652c1a tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Lazy-loading 'fault' on Instance uuid 36d7eb4f-22bc-4047-bc75-6f69142daee5 {{(pid=123595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:39:55.355627 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-d98a25b0-5006-4fef-90e8-4a00bd652c1a tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eadce040fcf3427abab9ef8b0ca19400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f4f9b0233b4fb29963b77248a236f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:55.363952 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-d98a25b0-5006-4fef-90e8-4a00bd652c1a tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] 10.222.0.43 "GET /compute/v2.1/servers/36d7eb4f-22bc-4047-bc75-6f69142daee5" status: 200 len: 1313 microversion: 2.1 time: 0.137765 Oct 04 18:39:55.365080 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1057/2285] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:55 2022] GET /compute/v2.1/servers/36d7eb4f-22bc-4047-bc75-6f69142daee5 => generated 1313 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:39:55.522133 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-d3317599-0a7b-42e5-883e-0b867fea571d tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:55.522765 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-d3317599-0a7b-42e5-883e-0b867fea571d tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] [instance: b6474a49-d05d-4d2e-afef-cdbbe8c6d9aa] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:55.532670 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d3317599-0a7b-42e5-883e-0b867fea571d tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:55.535282 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d3317599-0a7b-42e5-883e-0b867fea571d tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:55.538445 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d3317599-0a7b-42e5-883e-0b867fea571d tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:55.539533 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d3317599-0a7b-42e5-883e-0b867fea571d tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:55.540558 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d3317599-0a7b-42e5-883e-0b867fea571d tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:55.541650 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d3317599-0a7b-42e5-883e-0b867fea571d tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:55.557301 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-b33013a2-06fd-4e58-a6c8-f4cd1e0b0c90 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a19da94e9e646028a7f73f9d0e0edda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc41f296eb44503868205ec8aa2fef3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:55.571924 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-b33013a2-06fd-4e58-a6c8-f4cd1e0b0c90 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] 10.222.0.43 "GET /compute/v2.1/servers/1a71ee0e-ffa8-4730-b4fb-8b6e9fd87239" status: 200 len: 1521 microversion: 2.1 time: 0.391854 Oct 04 18:39:55.572767 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1229/2286] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:55 2022] GET /compute/v2.1/servers/1a71ee0e-ffa8-4730-b4fb-8b6e9fd87239 => generated 1521 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:55.610309 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-08ee87ab-91ec-4fa4-9268-44721a28ce4e tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:55.611441 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-08ee87ab-91ec-4fa4-9268-44721a28ce4e tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] [instance: d1f298aa-ebe3-4f52-ada6-137a782cd9b7] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:55.630531 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-08ee87ab-91ec-4fa4-9268-44721a28ce4e tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:55.631157 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-08ee87ab-91ec-4fa4-9268-44721a28ce4e tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:55.631507 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-08ee87ab-91ec-4fa4-9268-44721a28ce4e tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:55.635204 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-08ee87ab-91ec-4fa4-9268-44721a28ce4e tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:55.636265 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-08ee87ab-91ec-4fa4-9268-44721a28ce4e tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:55.636725 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-08ee87ab-91ec-4fa4-9268-44721a28ce4e tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:55.762903 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-d3317599-0a7b-42e5-883e-0b867fea571d tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c96ec8b8e0a4053b0457f213e6e262d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b812c85494a49898376a0dd8140f03c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:55.775763 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-d3317599-0a7b-42e5-883e-0b867fea571d tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] 10.222.0.43 "GET /compute/v2.1/servers/b6474a49-d05d-4d2e-afef-cdbbe8c6d9aa" status: 200 len: 1504 microversion: 2.1 time: 0.259414 Oct 04 18:39:55.793148 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1058/2287] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:55 2022] GET /compute/v2.1/servers/b6474a49-d05d-4d2e-afef-cdbbe8c6d9aa => generated 1504 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:55.802233 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-875c1568-f049-4946-bba0-53a735327c0d req-318ea148-2000-4bea-99e8-d7ed1fe4dc7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b7f1ede-48b3-48d8-933e-287c338b1e6a", "name": "network-vif-plugged", "status": "completed", "tag": "462f1dea-cb2e-42da-a165-e6bc91610838"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:39:55.817879 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-875c1568-f049-4946-bba0-53a735327c0d req-318ea148-2000-4bea-99e8-d7ed1fe4dc7f service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:55.818898 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-875c1568-f049-4946-bba0-53a735327c0d req-318ea148-2000-4bea-99e8-d7ed1fe4dc7f service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:55.819627 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-875c1568-f049-4946-bba0-53a735327c0d req-318ea148-2000-4bea-99e8-d7ed1fe4dc7f service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:55.839393 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-875c1568-f049-4946-bba0-53a735327c0d req-318ea148-2000-4bea-99e8-d7ed1fe4dc7f service nova] Creating event network-vif-plugged:462f1dea-cb2e-42da-a165-e6bc91610838 for instance 0b7f1ede-48b3-48d8-933e-287c338b1e6a on n-h1-851028-13 Oct 04 18:39:55.848499 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-875c1568-f049-4946-bba0-53a735327c0d req-318ea148-2000-4bea-99e8-d7ed1fe4dc7f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057142 Oct 04 18:39:55.851490 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1059/2288] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:39:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:39:55.859745 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-cb580f41-0642-4b3a-b7f0-e24baf00c655 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1129487597"}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:39:55.860877 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-cb580f41-0642-4b3a-b7f0-e24baf00c655 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] [instance: b6474a49-d05d-4d2e-afef-cdbbe8c6d9aa] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:55.873434 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cb580f41-0642-4b3a-b7f0-e24baf00c655 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:55.874261 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cb580f41-0642-4b3a-b7f0-e24baf00c655 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:55.874879 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cb580f41-0642-4b3a-b7f0-e24baf00c655 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:55.876384 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cb580f41-0642-4b3a-b7f0-e24baf00c655 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:55.877238 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cb580f41-0642-4b3a-b7f0-e24baf00c655 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:55.878253 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cb580f41-0642-4b3a-b7f0-e24baf00c655 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:56.100533 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.network.security_group_api [None req-cb580f41-0642-4b3a-b7f0-e24baf00c655 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Adding security group 1b3ff7cc-e1a4-4a6b-a935-b44264658284 to port 983dac01-7966-45d6-9bba-c9843044df16 Oct 04 18:39:56.361030 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-08ee87ab-91ec-4fa4-9268-44721a28ce4e tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:56.371537 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-08ee87ab-91ec-4fa4-9268-44721a28ce4e tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:56.384388 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-08ee87ab-91ec-4fa4-9268-44721a28ce4e tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:56.386624 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-08ee87ab-91ec-4fa4-9268-44721a28ce4e tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] 10.222.0.43 "GET /compute/v2.1/servers/d1f298aa-ebe3-4f52-ada6-137a782cd9b7" status: 200 len: 1482 microversion: 2.25 time: 0.800070 Oct 04 18:39:56.387508 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1230/2289] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:39:55 2022] GET /compute/v2.1/servers/d1f298aa-ebe3-4f52-ada6-137a782cd9b7 => generated 1482 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:39:56.392086 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-008da1fe-9cd7-4a68-a55b-9dee32bc51f6 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:56.403570 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-008da1fe-9cd7-4a68-a55b-9dee32bc51f6 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: d9d4332a-97b6-40f1-bd7c-a9a75a9adc43] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:56.424585 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-008da1fe-9cd7-4a68-a55b-9dee32bc51f6 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:56.425084 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-008da1fe-9cd7-4a68-a55b-9dee32bc51f6 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:56.425561 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-008da1fe-9cd7-4a68-a55b-9dee32bc51f6 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:56.426277 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-008da1fe-9cd7-4a68-a55b-9dee32bc51f6 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:56.426759 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-008da1fe-9cd7-4a68-a55b-9dee32bc51f6 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:56.427159 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-008da1fe-9cd7-4a68-a55b-9dee32bc51f6 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:56.438761 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:39:56.488955 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=8 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:39:56.704162 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-cb580f41-0642-4b3a-b7f0-e24baf00c655 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] 10.222.0.43 "POST /compute/v2.1/servers/b6474a49-d05d-4d2e-afef-cdbbe8c6d9aa/action" status: 202 len: 0 microversion: 2.1 time: 0.850586 Oct 04 18:39:56.704773 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1060/2290] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 18:39:55 2022] POST /compute/v2.1/servers/b6474a49-d05d-4d2e-afef-cdbbe8c6d9aa/action => generated 0 bytes in 852 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:39:56.710007 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-06a6c91e-1958-4697-8aa5-f1c2a42f4275 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Calling method '.version_select at 0x7fb21ff628b0>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:56.788422 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-06a6c91e-1958-4697-8aa5-f1c2a42f4275 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] 10.222.0.43 "GET /compute/v2.1/images/e4d3e808-f1b4-4480-90f6-79b6d4964f47" status: 200 len: 1455 microversion: 2.1 time: 0.082526 Oct 04 18:39:56.791034 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-008da1fe-9cd7-4a68-a55b-9dee32bc51f6 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:56.792189 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1061/2291] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 18:39:56 2022] GET /compute/v2.1/images/e4d3e808-f1b4-4480-90f6-79b6d4964f47 => generated 1455 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:56.802983 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-f3f9475e-b018-4f5f-8143-6f88e0718019 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:56.803844 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-f3f9475e-b018-4f5f-8143-6f88e0718019 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] [instance: b53d822f-e7b1-498a-b98a-35f87839dfe8] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:56.811624 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-008da1fe-9cd7-4a68-a55b-9dee32bc51f6 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/d9d4332a-97b6-40f1-bd7c-a9a75a9adc43" status: 200 len: 1542 microversion: 2.1 time: 0.422870 Oct 04 18:39:56.816592 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1231/2292] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:56 2022] GET /compute/v2.1/servers/d9d4332a-97b6-40f1-bd7c-a9a75a9adc43 => generated 1542 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:56.822514 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f3f9475e-b018-4f5f-8143-6f88e0718019 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:56.824761 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f3f9475e-b018-4f5f-8143-6f88e0718019 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:56.825237 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f3f9475e-b018-4f5f-8143-6f88e0718019 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:56.825979 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f3f9475e-b018-4f5f-8143-6f88e0718019 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:56.826433 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f3f9475e-b018-4f5f-8143-6f88e0718019 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:56.831723 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f3f9475e-b018-4f5f-8143-6f88e0718019 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:56.835805 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-679a8f35-31d2-42f9-85dc-ec24a54d6532 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:56.838212 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-679a8f35-31d2-42f9-85dc-ec24a54d6532 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] [instance: 36d7eb4f-22bc-4047-bc75-6f69142daee5] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:56.862556 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-679a8f35-31d2-42f9-85dc-ec24a54d6532 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:56.863131 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-679a8f35-31d2-42f9-85dc-ec24a54d6532 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:56.863863 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-679a8f35-31d2-42f9-85dc-ec24a54d6532 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:56.865998 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-679a8f35-31d2-42f9-85dc-ec24a54d6532 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:56.866754 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-679a8f35-31d2-42f9-85dc-ec24a54d6532 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:56.869475 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-679a8f35-31d2-42f9-85dc-ec24a54d6532 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:56.898528 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-679a8f35-31d2-42f9-85dc-ec24a54d6532 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] HTTP exception thrown: Instance 36d7eb4f-22bc-4047-bc75-6f69142daee5 could not be found. Oct 04 18:39:56.900836 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-679a8f35-31d2-42f9-85dc-ec24a54d6532 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Request method failure captured: Oct 04 18:39:56.900836 n-d-851028-13 devstack@n-api.service[123596]: request: GET /compute/v2.1/servers/36d7eb4f-22bc-4047-bc75-6f69142daee5 HTTP/1.1 Oct 04 18:39:56.900836 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:39:56.900836 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:39:56.900836 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:39:56.900836 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 18:39:56.900836 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:39:56.900836 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:39:56.900836 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:39:56.900836 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:39:56.900836 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPH2Wlo5mtodcx1M-NsUFN_Khv92vDz0zMPH8mVOTYTZ5OAT1gAk85Go0b9UJTpiT2nqrIBZHb1rGR6-5vJbaHohOtvXbKPJdv1EIpcmqFbBlLMUbRmU9t4jAnIhvhTQY821OOK2xswwXI2igtcdjh7FQoAwCHoYzR0kQUxybfNzYq9w Oct 04 18:39:56.900836 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:39:56.900836 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:39:56.900836 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:39:56.900836 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:39:56.900836 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:39:56.900836 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:39:56.900836 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: 87f4f9b0233b4fb29963b77248a236f7 Oct 04 18:39:56.900836 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-161697746 Oct 04 18:39:56.900836 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 18:39:56.900836 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 18:39:56.900836 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/87f4f9b0233b4fb29963b77248a236f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_87f4f9b0233b4fb29963b77248a236f7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/87f4f9b0233b4fb29963b77248a236f7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/87f4f9b0233b4fb29963b77248a236f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:39:56.900836 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-161697746 Oct 04 18:39:56.900836 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: 87f4f9b0233b4fb29963b77248a236f7 Oct 04 18:39:56.900836 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-161697746 Oct 04 18:39:56.900836 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-FloatingIPsAssociationTestJSON-161697746-project Oct 04 18:39:56.900836 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:39:56.900836 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:39:56.900836 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: eadce040fcf3427abab9ef8b0ca19400 Oct 04 18:39:56.900836 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-161697746-project Oct 04 18:39:56.900836 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 18:39:56.900836 n-d-851028-13 devstack@n-api.service[123596]: exception: Instance 36d7eb4f-22bc-4047-bc75-6f69142daee5 could not be found. Oct 04 18:39:56.900836 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': '36d7eb4f-22bc-4047-bc75-6f69142daee5'} Oct 04 18:39:56.900836 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:39:56.900836 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:39:56.900836 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:39:56.900836 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:39:56.900836 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:39:56.900836 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:39:56.900836 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:39:56.900836 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:39:56.900836 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:39:56.900836 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:39:56.900836 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 36d7eb4f-22bc-4047-bc75-6f69142daee5 could not be found. Oct 04 18:39:56.900836 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:39:56.900836 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:39:56.900836 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:39:56.900836 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:39:56.900836 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:39:56.900836 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:39:56.900836 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:39:56.900836 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:39:56.900836 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:39:56.900836 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:39:56.900836 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:39:56.900836 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:39:56.900836 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:39:56.900836 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:39:56.900836 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:39:56.900836 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:39:56.900836 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 36d7eb4f-22bc-4047-bc75-6f69142daee5 could not be found. Oct 04 18:39:56.900836 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:39:56.900836 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:39:56.904393 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:39:56.904393 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:39:56.904393 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:39:56.904393 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:39:56.904393 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:39:56.904393 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:39:56.904393 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 36d7eb4f-22bc-4047-bc75-6f69142daee5 could not be found. Oct 04 18:39:56.904393 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:39:56.919679 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-679a8f35-31d2-42f9-85dc-ec24a54d6532 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] Returning 404 to user: Instance 36d7eb4f-22bc-4047-bc75-6f69142daee5 could not be found. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:39:56.921334 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-679a8f35-31d2-42f9-85dc-ec24a54d6532 tempest-FloatingIPsAssociationTestJSON-161697746 tempest-FloatingIPsAssociationTestJSON-161697746-project] 10.222.0.43 "GET /compute/v2.1/servers/36d7eb4f-22bc-4047-bc75-6f69142daee5" status: 404 len: 111 microversion: 2.1 time: 0.101414 Oct 04 18:39:56.922171 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1232/2293] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:56 2022] GET /compute/v2.1/servers/36d7eb4f-22bc-4047-bc75-6f69142daee5 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:39:56.935840 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-d10066f5-9ecd-4f8f-8b7a-da6b160b697a tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:56.937016 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-d10066f5-9ecd-4f8f-8b7a-da6b160b697a tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] [instance: 1a71ee0e-ffa8-4730-b4fb-8b6e9fd87239] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:56.952570 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d10066f5-9ecd-4f8f-8b7a-da6b160b697a tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:56.955363 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d10066f5-9ecd-4f8f-8b7a-da6b160b697a tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:56.956442 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d10066f5-9ecd-4f8f-8b7a-da6b160b697a tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:56.958600 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d10066f5-9ecd-4f8f-8b7a-da6b160b697a tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:56.959339 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d10066f5-9ecd-4f8f-8b7a-da6b160b697a tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:56.960431 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d10066f5-9ecd-4f8f-8b7a-da6b160b697a tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:57.179662 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-f3f9475e-b018-4f5f-8143-6f88e0718019 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e1add2296c4ed5830c5d90ef272ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fdc44ceeb041bcba1be2fcc2084aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:57.190496 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-f3f9475e-b018-4f5f-8143-6f88e0718019 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59e1add2296c4ed5830c5d90ef272ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fdc44ceeb041bcba1be2fcc2084aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:57.192088 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-f3f9475e-b018-4f5f-8143-6f88e0718019 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59e1add2296c4ed5830c5d90ef272ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fdc44ceeb041bcba1be2fcc2084aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:57.193334 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-f3f9475e-b018-4f5f-8143-6f88e0718019 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] 10.222.0.43 "GET /compute/v2.1/servers/b53d822f-e7b1-498a-b98a-35f87839dfe8" status: 200 len: 1409 microversion: 2.54 time: 0.400001 Oct 04 18:39:57.226760 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1062/2294] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:39:56 2022] GET /compute/v2.1/servers/b53d822f-e7b1-498a-b98a-35f87839dfe8 => generated 1409 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:39:57.232161 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-7185ed89-90f8-4176-b9f3-d3520cf8cfee tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Calling method '.version_select at 0x7fb21f020280>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:57.458021 n-d-851028-13 devstack@n-api.service[123595]: DEBUG neutronclient.v2_0.client [None req-7185ed89-90f8-4176-b9f3-d3520cf8cfee tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 1b3ff7cc-e1a4-4a6b-a935-b44264658284 in use.", "detail": ""}} {{(pid=123595) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 18:39:57.458911 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-7185ed89-90f8-4176-b9f3-d3520cf8cfee tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] HTTP exception thrown: Security Group 1b3ff7cc-e1a4-4a6b-a935-b44264658284 in use. Oct 04 18:39:57.458911 n-d-851028-13 devstack@n-api.service[123595]: Neutron server returns request_ids: ['req-18149dab-c22b-4d1d-b9b6-f46975cc8fb1'] Oct 04 18:39:57.467637 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-7185ed89-90f8-4176-b9f3-d3520cf8cfee tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Request method failure captured: Oct 04 18:39:57.467637 n-d-851028-13 devstack@n-api.service[123595]: request: DELETE /compute/v2.1/os-security-groups/1b3ff7cc-e1a4-4a6b-a935-b44264658284 HTTP/1.1 Oct 04 18:39:57.467637 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 18:39:57.467637 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 18:39:57.467637 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 18:39:57.467637 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 0 Oct 04 18:39:57.467637 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 18:39:57.467637 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 18:39:57.467637 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 18:39:57.467637 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 18:39:57.467637 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPH2qE2WsiZvVd-vvN1M8uHJG40fIXDT1XURP-P4ciVfKnbP_2tplzYndj2wlvB6bSu_VMaD1xfU0nGHRYWQRmNIt_krh_S1n2RkrhietTC0-RnvJ1rzF8ilPx8zowbVefo7A8IyDn5QTaMC08kHUNyiYinJQT_Q7n9enahWrBitVOPM Oct 04 18:39:57.467637 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 18:39:57.467637 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 18:39:57.467637 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 18:39:57.467637 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 18:39:57.467637 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 18:39:57.467637 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 18:39:57.467637 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: 7b812c85494a49898376a0dd8140f03c Oct 04 18:39:57.467637 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-SecurityGroupsTestJSON-209295605 Oct 04 18:39:57.467637 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 18:39:57.467637 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 18:39:57.467637 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/7b812c85494a49898376a0dd8140f03c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_7b812c85494a49898376a0dd8140f03c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/7b812c85494a49898376a0dd8140f03c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/7b812c85494a49898376a0dd8140f03c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:39:57.467637 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-SecurityGroupsTestJSON-209295605 Oct 04 18:39:57.467637 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: 7b812c85494a49898376a0dd8140f03c Oct 04 18:39:57.467637 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-209295605 Oct 04 18:39:57.467637 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-SecurityGroupsTestJSON-209295605-project Oct 04 18:39:57.467637 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 18:39:57.467637 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 18:39:57.467637 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: 5c96ec8b8e0a4053b0457f213e6e262d Oct 04 18:39:57.467637 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-SecurityGroupsTestJSON-209295605-project Oct 04 18:39:57.467637 n-d-851028-13 devstack@n-api.service[123595]: method: Oct 04 18:39:57.467637 n-d-851028-13 devstack@n-api.service[123595]: exception: Security Group 1b3ff7cc-e1a4-4a6b-a935-b44264658284 in use. Oct 04 18:39:57.467637 n-d-851028-13 devstack@n-api.service[123595]: Neutron server returns request_ids: ['req-18149dab-c22b-4d1d-b9b6-f46975cc8fb1'] Oct 04 18:39:57.467637 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': '1b3ff7cc-e1a4-4a6b-a935-b44264658284'} Oct 04 18:39:57.467637 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:39:57.467637 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:39:57.467637 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 04 18:39:57.467637 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 04 18:39:57.467637 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:39:57.467637 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:39:57.467637 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 04 18:39:57.467637 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 04 18:39:57.467637 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:39:57.467637 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:39:57.467637 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 04 18:39:57.467637 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 04 18:39:57.467637 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:39:57.467637 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:39:57.467637 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 18:39:57.467637 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 18:39:57.467637 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:39:57.467637 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:39:57.467637 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 18:39:57.467637 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 18:39:57.467637 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:39:57.467637 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:39:57.467637 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 18:39:57.467637 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 18:39:57.467637 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 18:39:57.467637 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 18:39:57.467637 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 1b3ff7cc-e1a4-4a6b-a935-b44264658284 in use. Oct 04 18:39:57.470788 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-18149dab-c22b-4d1d-b9b6-f46975cc8fb1'] Oct 04 18:39:57.470788 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:39:57.470788 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:39:57.470788 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:39:57.470788 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:39:57.470788 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 04 18:39:57.470788 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 04 18:39:57.470788 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 04 18:39:57.470788 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 04 18:39:57.470788 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 1b3ff7cc-e1a4-4a6b-a935-b44264658284 in use. Oct 04 18:39:57.470788 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-18149dab-c22b-4d1d-b9b6-f46975cc8fb1'] Oct 04 18:39:57.470788 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:39:57.470788 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:39:57.470788 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:39:57.470788 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:39:57.470788 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:39:57.470788 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:39:57.470788 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:39:57.470788 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:39:57.470788 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:39:57.470788 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:39:57.470788 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:39:57.470788 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:39:57.470788 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 04 18:39:57.470788 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 04 18:39:57.470788 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 1b3ff7cc-e1a4-4a6b-a935-b44264658284 in use. Oct 04 18:39:57.470788 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-18149dab-c22b-4d1d-b9b6-f46975cc8fb1'] Oct 04 18:39:57.470788 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:39:57.470788 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:39:57.470788 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:39:57.470788 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:39:57.470788 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:39:57.470788 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:39:57.470788 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:39:57.470788 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:39:57.470788 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 1b3ff7cc-e1a4-4a6b-a935-b44264658284 in use. Oct 04 18:39:57.470788 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-18149dab-c22b-4d1d-b9b6-f46975cc8fb1'] Oct 04 18:39:57.470788 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:39:57.470788 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-7185ed89-90f8-4176-b9f3-d3520cf8cfee tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Returning 400 to user: Security Group 1b3ff7cc-e1a4-4a6b-a935-b44264658284 in use. Oct 04 18:39:57.470788 n-d-851028-13 devstack@n-api.service[123595]: Neutron server returns request_ids: ['req-18149dab-c22b-4d1d-b9b6-f46975cc8fb1'] {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:39:57.470788 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-7185ed89-90f8-4176-b9f3-d3520cf8cfee tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] 10.222.0.43 "DELETE /compute/v2.1/os-security-groups/1b3ff7cc-e1a4-4a6b-a935-b44264658284" status: 400 len: 185 microversion: 2.1 time: 0.241349 Oct 04 18:39:57.470788 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1063/2295] 10.222.0.43 () {58 vars in 1272 bytes} [Tue Oct 4 18:39:57 2022] DELETE /compute/v2.1/os-security-groups/1b3ff7cc-e1a4-4a6b-a935-b44264658284 => generated 185 bytes in 242 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:39:57.475891 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-f26b35fb-2d2f-4c8c-84dc-d9f4e576f89b req-981dc6ce-ea8d-4943-94fa-317ef8f9808f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6474a49-d05d-4d2e-afef-cdbbe8c6d9aa", "tag": "983dac01-7966-45d6-9bba-c9843044df16"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:39:57.507870 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-f26b35fb-2d2f-4c8c-84dc-d9f4e576f89b req-981dc6ce-ea8d-4943-94fa-317ef8f9808f service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:57.508362 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-f26b35fb-2d2f-4c8c-84dc-d9f4e576f89b req-981dc6ce-ea8d-4943-94fa-317ef8f9808f service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:57.508797 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-f26b35fb-2d2f-4c8c-84dc-d9f4e576f89b req-981dc6ce-ea8d-4943-94fa-317ef8f9808f service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:57.551235 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-f26b35fb-2d2f-4c8c-84dc-d9f4e576f89b req-981dc6ce-ea8d-4943-94fa-317ef8f9808f service nova] Creating event network-changed:983dac01-7966-45d6-9bba-c9843044df16 for instance b6474a49-d05d-4d2e-afef-cdbbe8c6d9aa on n-h2-851028-13 Oct 04 18:39:57.571035 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-f26b35fb-2d2f-4c8c-84dc-d9f4e576f89b req-981dc6ce-ea8d-4943-94fa-317ef8f9808f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099993 Oct 04 18:39:57.576647 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1064/2296] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:39:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:39:57.593286 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-46be7744-e878-4f9c-bb84-c42996d563bc req-745f14e0-95ea-412b-80bb-4614257759e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1f298aa-ebe3-4f52-ada6-137a782cd9b7", "name": "network-vif-deleted", "tag": "522bbf89-d8c1-4d7d-96be-5fcee81a735a"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:39:57.615256 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-46be7744-e878-4f9c-bb84-c42996d563bc req-745f14e0-95ea-412b-80bb-4614257759e6 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:57.616043 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-46be7744-e878-4f9c-bb84-c42996d563bc req-745f14e0-95ea-412b-80bb-4614257759e6 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:57.617265 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-46be7744-e878-4f9c-bb84-c42996d563bc req-745f14e0-95ea-412b-80bb-4614257759e6 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:57.631562 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-d10066f5-9ecd-4f8f-8b7a-da6b160b697a tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a19da94e9e646028a7f73f9d0e0edda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc41f296eb44503868205ec8aa2fef3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:57.648399 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-d10066f5-9ecd-4f8f-8b7a-da6b160b697a tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] 10.222.0.43 "GET /compute/v2.1/servers/1a71ee0e-ffa8-4730-b4fb-8b6e9fd87239" status: 200 len: 1521 microversion: 2.1 time: 0.724188 Oct 04 18:39:57.655032 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-46be7744-e878-4f9c-bb84-c42996d563bc req-745f14e0-95ea-412b-80bb-4614257759e6 service nova] Creating event network-vif-deleted:522bbf89-d8c1-4d7d-96be-5fcee81a735a for instance d1f298aa-ebe3-4f52-ada6-137a782cd9b7 on n-h1-851028-13 Oct 04 18:39:57.660458 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1233/2297] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:56 2022] GET /compute/v2.1/servers/1a71ee0e-ffa8-4730-b4fb-8b6e9fd87239 => generated 1521 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:57.674779 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-0710b331-3faf-4f1f-9f61-8c2b88701749 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:57.679400 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-46be7744-e878-4f9c-bb84-c42996d563bc req-745f14e0-95ea-412b-80bb-4614257759e6 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098412 Oct 04 18:39:57.680301 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1065/2298] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:39:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:39:57.687284 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-0710b331-3faf-4f1f-9f61-8c2b88701749 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] [instance: d1f298aa-ebe3-4f52-ada6-137a782cd9b7] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:57.702661 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-37ce07b3-541c-4998-b5d6-bc60e330ed72 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:39:57.705178 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-37ce07b3-541c-4998-b5d6-bc60e330ed72 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] [instance: b6474a49-d05d-4d2e-afef-cdbbe8c6d9aa] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:57.721243 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0710b331-3faf-4f1f-9f61-8c2b88701749 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:57.724313 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0710b331-3faf-4f1f-9f61-8c2b88701749 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:57.727379 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0710b331-3faf-4f1f-9f61-8c2b88701749 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:57.727706 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-37ce07b3-541c-4998-b5d6-bc60e330ed72 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:57.728553 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-37ce07b3-541c-4998-b5d6-bc60e330ed72 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:57.729141 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-37ce07b3-541c-4998-b5d6-bc60e330ed72 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:57.733389 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0710b331-3faf-4f1f-9f61-8c2b88701749 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:57.734338 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0710b331-3faf-4f1f-9f61-8c2b88701749 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:57.734922 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-37ce07b3-541c-4998-b5d6-bc60e330ed72 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:57.736575 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-37ce07b3-541c-4998-b5d6-bc60e330ed72 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:57.737250 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0710b331-3faf-4f1f-9f61-8c2b88701749 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:57.738668 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-37ce07b3-541c-4998-b5d6-bc60e330ed72 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:58.055124 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-0710b331-3faf-4f1f-9f61-8c2b88701749 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:58.079048 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-0710b331-3faf-4f1f-9f61-8c2b88701749 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:58.083023 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-0710b331-3faf-4f1f-9f61-8c2b88701749 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:58.087251 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-0710b331-3faf-4f1f-9f61-8c2b88701749 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] 10.222.0.43 "GET /compute/v2.1/servers/d1f298aa-ebe3-4f52-ada6-137a782cd9b7" status: 200 len: 1265 microversion: 2.25 time: 0.425353 Oct 04 18:39:58.090518 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1234/2299] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:39:57 2022] GET /compute/v2.1/servers/d1f298aa-ebe3-4f52-ada6-137a782cd9b7 => generated 1265 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:39:58.095443 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-56e0735c-a131-47da-9255-fb1998887cb8 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Calling method '.version_select at 0x7fb21ee7f0d0>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:58.218442 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-56e0735c-a131-47da-9255-fb1998887cb8 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] 10.222.0.43 "GET /compute/v2.1/images/e4d3e808-f1b4-4480-90f6-79b6d4964f47" status: 200 len: 1455 microversion: 2.1 time: 0.126547 Oct 04 18:39:58.219750 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1235/2300] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 18:39:58 2022] GET /compute/v2.1/images/e4d3e808-f1b4-4480-90f6-79b6d4964f47 => generated 1455 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:58.232750 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-5b602d75-e9a6-44c4-9427-c4cc8b040304 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:58.233814 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-5b602d75-e9a6-44c4-9427-c4cc8b040304 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: d9d4332a-97b6-40f1-bd7c-a9a75a9adc43] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:58.252420 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5b602d75-e9a6-44c4-9427-c4cc8b040304 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:58.253403 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5b602d75-e9a6-44c4-9427-c4cc8b040304 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:58.254068 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5b602d75-e9a6-44c4-9427-c4cc8b040304 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:58.255229 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5b602d75-e9a6-44c4-9427-c4cc8b040304 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:58.261966 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5b602d75-e9a6-44c4-9427-c4cc8b040304 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:58.262785 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5b602d75-e9a6-44c4-9427-c4cc8b040304 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:58.264577 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=100 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:39:58.342121 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-37ce07b3-541c-4998-b5d6-bc60e330ed72 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] 10.222.0.43 "POST /compute/v2.1/servers/b6474a49-d05d-4d2e-afef-cdbbe8c6d9aa/action" status: 202 len: 0 microversion: 2.1 time: 0.658406 Oct 04 18:39:58.348196 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1066/2301] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 18:39:57 2022] POST /compute/v2.1/servers/b6474a49-d05d-4d2e-afef-cdbbe8c6d9aa/action => generated 0 bytes in 667 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:39:58.362205 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-80f914dc-5b6e-43a3-8220-04d46bf54db8 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:58.363036 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-80f914dc-5b6e-43a3-8220-04d46bf54db8 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] [instance: b53d822f-e7b1-498a-b98a-35f87839dfe8] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:58.379966 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-80f914dc-5b6e-43a3-8220-04d46bf54db8 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:58.381002 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-80f914dc-5b6e-43a3-8220-04d46bf54db8 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:58.386463 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-80f914dc-5b6e-43a3-8220-04d46bf54db8 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:58.387548 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-80f914dc-5b6e-43a3-8220-04d46bf54db8 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:58.388057 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-80f914dc-5b6e-43a3-8220-04d46bf54db8 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:58.389369 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-80f914dc-5b6e-43a3-8220-04d46bf54db8 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:58.642067 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-5b602d75-e9a6-44c4-9427-c4cc8b040304 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:58.651744 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-5b602d75-e9a6-44c4-9427-c4cc8b040304 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/d9d4332a-97b6-40f1-bd7c-a9a75a9adc43" status: 200 len: 1542 microversion: 2.1 time: 0.430610 Oct 04 18:39:58.656497 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1236/2302] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:58 2022] GET /compute/v2.1/servers/d9d4332a-97b6-40f1-bd7c-a9a75a9adc43 => generated 1542 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:58.671440 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-35e6de35-927a-45ac-811e-9e32bf28fcf2 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:58.672104 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-35e6de35-927a-45ac-811e-9e32bf28fcf2 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] [instance: b6474a49-d05d-4d2e-afef-cdbbe8c6d9aa] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:58.703741 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-35e6de35-927a-45ac-811e-9e32bf28fcf2 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:58.704565 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-35e6de35-927a-45ac-811e-9e32bf28fcf2 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:58.705357 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-35e6de35-927a-45ac-811e-9e32bf28fcf2 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:58.706107 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-35e6de35-927a-45ac-811e-9e32bf28fcf2 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:58.708381 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-35e6de35-927a-45ac-811e-9e32bf28fcf2 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:58.718814 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-35e6de35-927a-45ac-811e-9e32bf28fcf2 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:58.904238 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-80f914dc-5b6e-43a3-8220-04d46bf54db8 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e1add2296c4ed5830c5d90ef272ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fdc44ceeb041bcba1be2fcc2084aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:58.913216 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-80f914dc-5b6e-43a3-8220-04d46bf54db8 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59e1add2296c4ed5830c5d90ef272ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fdc44ceeb041bcba1be2fcc2084aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:58.925379 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-80f914dc-5b6e-43a3-8220-04d46bf54db8 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59e1add2296c4ed5830c5d90ef272ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fdc44ceeb041bcba1be2fcc2084aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:58.927385 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-80f914dc-5b6e-43a3-8220-04d46bf54db8 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] 10.222.0.43 "GET /compute/v2.1/servers/b53d822f-e7b1-498a-b98a-35f87839dfe8" status: 200 len: 1409 microversion: 2.54 time: 0.577692 Oct 04 18:39:58.944630 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1067/2303] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:39:58 2022] GET /compute/v2.1/servers/b53d822f-e7b1-498a-b98a-35f87839dfe8 => generated 1409 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:39:58.957242 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-e0189c8d-0d06-4eba-b3d8-8617fab8f712 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:58.958094 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-e0189c8d-0d06-4eba-b3d8-8617fab8f712 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] [instance: 1a71ee0e-ffa8-4730-b4fb-8b6e9fd87239] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:58.965101 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e0189c8d-0d06-4eba-b3d8-8617fab8f712 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:58.966636 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e0189c8d-0d06-4eba-b3d8-8617fab8f712 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:58.967266 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e0189c8d-0d06-4eba-b3d8-8617fab8f712 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:58.968175 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e0189c8d-0d06-4eba-b3d8-8617fab8f712 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:58.968831 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e0189c8d-0d06-4eba-b3d8-8617fab8f712 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:58.969447 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e0189c8d-0d06-4eba-b3d8-8617fab8f712 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:59.192394 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-35e6de35-927a-45ac-811e-9e32bf28fcf2 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c96ec8b8e0a4053b0457f213e6e262d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b812c85494a49898376a0dd8140f03c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:59.207391 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-35e6de35-927a-45ac-811e-9e32bf28fcf2 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] 10.222.0.43 "GET /compute/v2.1/servers/b6474a49-d05d-4d2e-afef-cdbbe8c6d9aa" status: 200 len: 1575 microversion: 2.1 time: 0.549338 Oct 04 18:39:59.221136 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1237/2304] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:58 2022] GET /compute/v2.1/servers/b6474a49-d05d-4d2e-afef-cdbbe8c6d9aa => generated 1575 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:59.229812 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-706df07a-8f2c-4820-8b06-31a973286ca2 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:59.230770 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-706df07a-8f2c-4820-8b06-31a973286ca2 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] [instance: d1f298aa-ebe3-4f52-ada6-137a782cd9b7] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:59.242466 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-706df07a-8f2c-4820-8b06-31a973286ca2 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:59.242953 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-706df07a-8f2c-4820-8b06-31a973286ca2 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:59.243400 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-706df07a-8f2c-4820-8b06-31a973286ca2 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:59.244498 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-706df07a-8f2c-4820-8b06-31a973286ca2 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:59.244611 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-706df07a-8f2c-4820-8b06-31a973286ca2 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:59.245198 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-706df07a-8f2c-4820-8b06-31a973286ca2 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:59.445002 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-706df07a-8f2c-4820-8b06-31a973286ca2 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:59.462570 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-706df07a-8f2c-4820-8b06-31a973286ca2 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:59.470266 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-706df07a-8f2c-4820-8b06-31a973286ca2 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:59.473369 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-706df07a-8f2c-4820-8b06-31a973286ca2 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] 10.222.0.43 "GET /compute/v2.1/servers/d1f298aa-ebe3-4f52-ada6-137a782cd9b7" status: 200 len: 1265 microversion: 2.25 time: 0.258678 Oct 04 18:39:59.474920 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1238/2305] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:39:59 2022] GET /compute/v2.1/servers/d1f298aa-ebe3-4f52-ada6-137a782cd9b7 => generated 1265 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:39:59.482288 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-39036079-76e1-4b60-94c5-6655a1c4dfac tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Calling method '.version_select at 0x7fb21edc59d0>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:59.556122 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-39036079-76e1-4b60-94c5-6655a1c4dfac tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] 10.222.0.43 "GET /compute/v2.1/images/e4d3e808-f1b4-4480-90f6-79b6d4964f47" status: 200 len: 1455 microversion: 2.1 time: 0.079757 Oct 04 18:39:59.558546 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1239/2306] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 18:39:59 2022] GET /compute/v2.1/images/e4d3e808-f1b4-4480-90f6-79b6d4964f47 => generated 1455 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:59.678360 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-b68dd389-bb7a-4651-b0cb-5c81720557f1 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:59.679774 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-b68dd389-bb7a-4651-b0cb-5c81720557f1 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: d9d4332a-97b6-40f1-bd7c-a9a75a9adc43] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:59.700380 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b68dd389-bb7a-4651-b0cb-5c81720557f1 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:59.704365 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-e0189c8d-0d06-4eba-b3d8-8617fab8f712 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a19da94e9e646028a7f73f9d0e0edda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc41f296eb44503868205ec8aa2fef3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:59.705775 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b68dd389-bb7a-4651-b0cb-5c81720557f1 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:59.707145 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b68dd389-bb7a-4651-b0cb-5c81720557f1 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:59.711247 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b68dd389-bb7a-4651-b0cb-5c81720557f1 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:59.711915 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b68dd389-bb7a-4651-b0cb-5c81720557f1 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:59.714375 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b68dd389-bb7a-4651-b0cb-5c81720557f1 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:59.720892 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-e0189c8d-0d06-4eba-b3d8-8617fab8f712 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] 10.222.0.43 "GET /compute/v2.1/servers/1a71ee0e-ffa8-4730-b4fb-8b6e9fd87239" status: 200 len: 1521 microversion: 2.1 time: 0.767828 Oct 04 18:39:59.721534 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1068/2307] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:58 2022] GET /compute/v2.1/servers/1a71ee0e-ffa8-4730-b4fb-8b6e9fd87239 => generated 1521 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:59.961723 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-ace4bcc7-a202-4af1-b01a-46da708eb1d5 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:59.962335 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-ace4bcc7-a202-4af1-b01a-46da708eb1d5 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] [instance: b53d822f-e7b1-498a-b98a-35f87839dfe8] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:59.979948 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ace4bcc7-a202-4af1-b01a-46da708eb1d5 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:59.985554 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ace4bcc7-a202-4af1-b01a-46da708eb1d5 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:59.988289 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ace4bcc7-a202-4af1-b01a-46da708eb1d5 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:59.991148 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ace4bcc7-a202-4af1-b01a-46da708eb1d5 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:59.995196 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ace4bcc7-a202-4af1-b01a-46da708eb1d5 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:59.998234 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ace4bcc7-a202-4af1-b01a-46da708eb1d5 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:00.242261 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-b68dd389-bb7a-4651-b0cb-5c81720557f1 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:00.251676 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-b68dd389-bb7a-4651-b0cb-5c81720557f1 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/d9d4332a-97b6-40f1-bd7c-a9a75a9adc43" status: 200 len: 1542 microversion: 2.1 time: 0.577518 Oct 04 18:40:00.253502 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-ace4bcc7-a202-4af1-b01a-46da708eb1d5 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e1add2296c4ed5830c5d90ef272ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fdc44ceeb041bcba1be2fcc2084aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:00.257220 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1240/2308] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:59 2022] GET /compute/v2.1/servers/d9d4332a-97b6-40f1-bd7c-a9a75a9adc43 => generated 1542 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:00.271102 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-ace4bcc7-a202-4af1-b01a-46da708eb1d5 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59e1add2296c4ed5830c5d90ef272ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fdc44ceeb041bcba1be2fcc2084aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:00.271320 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-c6d8f4dc-e1e7-4f30-9190-01bcb6dd5a76 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:00.271732 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-c6d8f4dc-e1e7-4f30-9190-01bcb6dd5a76 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] [instance: b6474a49-d05d-4d2e-afef-cdbbe8c6d9aa] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:00.290484 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-ace4bcc7-a202-4af1-b01a-46da708eb1d5 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59e1add2296c4ed5830c5d90ef272ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fdc44ceeb041bcba1be2fcc2084aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:00.293927 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-ace4bcc7-a202-4af1-b01a-46da708eb1d5 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] 10.222.0.43 "GET /compute/v2.1/servers/b53d822f-e7b1-498a-b98a-35f87839dfe8" status: 200 len: 1409 microversion: 2.54 time: 0.334824 Oct 04 18:40:00.297459 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1069/2309] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:39:59 2022] GET /compute/v2.1/servers/b53d822f-e7b1-498a-b98a-35f87839dfe8 => generated 1409 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:40:00.308710 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c6d8f4dc-e1e7-4f30-9190-01bcb6dd5a76 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:00.322972 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c6d8f4dc-e1e7-4f30-9190-01bcb6dd5a76 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:00.323604 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c6d8f4dc-e1e7-4f30-9190-01bcb6dd5a76 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:00.324387 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c6d8f4dc-e1e7-4f30-9190-01bcb6dd5a76 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:00.332316 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c6d8f4dc-e1e7-4f30-9190-01bcb6dd5a76 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:00.332779 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c6d8f4dc-e1e7-4f30-9190-01bcb6dd5a76 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:00.511558 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-ebb5940b-38d4-49f1-906b-a0bc62729701 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:00.512323 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-ebb5940b-38d4-49f1-906b-a0bc62729701 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] [instance: d1f298aa-ebe3-4f52-ada6-137a782cd9b7] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:00.529692 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ebb5940b-38d4-49f1-906b-a0bc62729701 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:00.533942 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ebb5940b-38d4-49f1-906b-a0bc62729701 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:00.534992 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ebb5940b-38d4-49f1-906b-a0bc62729701 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:00.537603 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ebb5940b-38d4-49f1-906b-a0bc62729701 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:00.540640 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ebb5940b-38d4-49f1-906b-a0bc62729701 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:00.545198 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ebb5940b-38d4-49f1-906b-a0bc62729701 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:00.732708 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-c6d8f4dc-e1e7-4f30-9190-01bcb6dd5a76 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c96ec8b8e0a4053b0457f213e6e262d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b812c85494a49898376a0dd8140f03c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:00.746168 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-c6d8f4dc-e1e7-4f30-9190-01bcb6dd5a76 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] 10.222.0.43 "GET /compute/v2.1/servers/b6474a49-d05d-4d2e-afef-cdbbe8c6d9aa" status: 200 len: 1575 microversion: 2.1 time: 0.487796 Oct 04 18:40:00.747543 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1241/2310] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:00 2022] GET /compute/v2.1/servers/b6474a49-d05d-4d2e-afef-cdbbe8c6d9aa => generated 1575 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:00.753671 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-2cc989a9-7fe1-4a8f-a4bb-d67739e60992 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Calling method '.version_select at 0x7fb21ee00ca0>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:00.839702 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-2cc989a9-7fe1-4a8f-a4bb-d67739e60992 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] 10.222.0.43 "GET /compute/v2.1/images/e4d3e808-f1b4-4480-90f6-79b6d4964f47" status: 200 len: 1455 microversion: 2.1 time: 0.090911 Oct 04 18:40:00.841076 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1242/2311] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 18:40:00 2022] GET /compute/v2.1/images/e4d3e808-f1b4-4480-90f6-79b6d4964f47 => generated 1455 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:00.845976 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-ebb5940b-38d4-49f1-906b-a0bc62729701 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:00.851500 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-d5c78ad0-badd-48e4-8fd6-3e4ad6e9bbcc tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:00.853409 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-d5c78ad0-badd-48e4-8fd6-3e4ad6e9bbcc tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] [instance: 1a71ee0e-ffa8-4730-b4fb-8b6e9fd87239] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:00.858727 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-ebb5940b-38d4-49f1-906b-a0bc62729701 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:00.860184 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-ebb5940b-38d4-49f1-906b-a0bc62729701 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:00.865831 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-ebb5940b-38d4-49f1-906b-a0bc62729701 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] 10.222.0.43 "GET /compute/v2.1/servers/d1f298aa-ebe3-4f52-ada6-137a782cd9b7" status: 200 len: 1265 microversion: 2.25 time: 0.358979 Oct 04 18:40:00.866430 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1070/2312] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:40:00 2022] GET /compute/v2.1/servers/d1f298aa-ebe3-4f52-ada6-137a782cd9b7 => generated 1265 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:40:00.869018 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d5c78ad0-badd-48e4-8fd6-3e4ad6e9bbcc tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:00.869800 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d5c78ad0-badd-48e4-8fd6-3e4ad6e9bbcc tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:00.870256 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d5c78ad0-badd-48e4-8fd6-3e4ad6e9bbcc tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:00.875904 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d5c78ad0-badd-48e4-8fd6-3e4ad6e9bbcc tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:00.876639 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d5c78ad0-badd-48e4-8fd6-3e4ad6e9bbcc tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:00.877308 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d5c78ad0-badd-48e4-8fd6-3e4ad6e9bbcc tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:01.284019 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-046ff241-1461-4019-b829-19548d8e0edb tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:01.285277 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-046ff241-1461-4019-b829-19548d8e0edb tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: d9d4332a-97b6-40f1-bd7c-a9a75a9adc43] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:01.298271 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-046ff241-1461-4019-b829-19548d8e0edb tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:01.299029 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-046ff241-1461-4019-b829-19548d8e0edb tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:01.299704 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-046ff241-1461-4019-b829-19548d8e0edb tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:01.306099 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-046ff241-1461-4019-b829-19548d8e0edb tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:01.306934 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-046ff241-1461-4019-b829-19548d8e0edb tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:01.307598 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-046ff241-1461-4019-b829-19548d8e0edb tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:01.335977 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-d5c78ad0-badd-48e4-8fd6-3e4ad6e9bbcc tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a19da94e9e646028a7f73f9d0e0edda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc41f296eb44503868205ec8aa2fef3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:01.347153 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-d5c78ad0-badd-48e4-8fd6-3e4ad6e9bbcc tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] 10.222.0.43 "GET /compute/v2.1/servers/1a71ee0e-ffa8-4730-b4fb-8b6e9fd87239" status: 200 len: 1521 microversion: 2.1 time: 0.504834 Oct 04 18:40:01.361146 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1243/2313] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:00 2022] GET /compute/v2.1/servers/1a71ee0e-ffa8-4730-b4fb-8b6e9fd87239 => generated 1521 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:01.361146 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-32a92486-34a9-42a2-9a96-47225f02b44f tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:01.362482 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-32a92486-34a9-42a2-9a96-47225f02b44f tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] [instance: b53d822f-e7b1-498a-b98a-35f87839dfe8] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:01.375276 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-32a92486-34a9-42a2-9a96-47225f02b44f tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:01.375785 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-32a92486-34a9-42a2-9a96-47225f02b44f tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:01.376227 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-32a92486-34a9-42a2-9a96-47225f02b44f tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:01.380088 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-32a92486-34a9-42a2-9a96-47225f02b44f tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:01.380774 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-32a92486-34a9-42a2-9a96-47225f02b44f tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:01.386868 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-32a92486-34a9-42a2-9a96-47225f02b44f tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:01.642180 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-32a92486-34a9-42a2-9a96-47225f02b44f tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e1add2296c4ed5830c5d90ef272ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fdc44ceeb041bcba1be2fcc2084aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:01.651926 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-32a92486-34a9-42a2-9a96-47225f02b44f tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59e1add2296c4ed5830c5d90ef272ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fdc44ceeb041bcba1be2fcc2084aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:01.658115 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-32a92486-34a9-42a2-9a96-47225f02b44f tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59e1add2296c4ed5830c5d90ef272ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fdc44ceeb041bcba1be2fcc2084aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:01.662203 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-32a92486-34a9-42a2-9a96-47225f02b44f tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] 10.222.0.43 "GET /compute/v2.1/servers/b53d822f-e7b1-498a-b98a-35f87839dfe8" status: 200 len: 1409 microversion: 2.54 time: 0.313410 Oct 04 18:40:01.664657 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1244/2314] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:40:01 2022] GET /compute/v2.1/servers/b53d822f-e7b1-498a-b98a-35f87839dfe8 => generated 1409 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:40:01.684526 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-046ff241-1461-4019-b829-19548d8e0edb tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:01.697279 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-046ff241-1461-4019-b829-19548d8e0edb tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/d9d4332a-97b6-40f1-bd7c-a9a75a9adc43" status: 200 len: 1542 microversion: 2.1 time: 0.417126 Oct 04 18:40:01.717891 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1071/2315] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:01 2022] GET /compute/v2.1/servers/d9d4332a-97b6-40f1-bd7c-a9a75a9adc43 => generated 1542 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:40:01.776850 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-7e5fd1c3-23ee-4fce-bc42-0666979eb919 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:01.777620 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-7e5fd1c3-23ee-4fce-bc42-0666979eb919 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] [instance: b6474a49-d05d-4d2e-afef-cdbbe8c6d9aa] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:01.780304 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=12 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:40:01.813072 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7e5fd1c3-23ee-4fce-bc42-0666979eb919 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:01.820015 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7e5fd1c3-23ee-4fce-bc42-0666979eb919 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:01.837785 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7e5fd1c3-23ee-4fce-bc42-0666979eb919 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:01.837785 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7e5fd1c3-23ee-4fce-bc42-0666979eb919 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:01.837785 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7e5fd1c3-23ee-4fce-bc42-0666979eb919 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:01.837785 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7e5fd1c3-23ee-4fce-bc42-0666979eb919 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:01.856818 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-fbf70242-830b-4705-9f77-16bd295cb022 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Calling method '.version_select at 0x7fb21fd39700>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:01.882370 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=12 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:40:01.970606 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-fbf70242-830b-4705-9f77-16bd295cb022 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] 10.222.0.43 "GET /compute/v2.1/images/e4d3e808-f1b4-4480-90f6-79b6d4964f47" status: 200 len: 1455 microversion: 2.1 time: 0.108288 Oct 04 18:40:01.971534 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1072/2316] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 18:40:01 2022] GET /compute/v2.1/images/e4d3e808-f1b4-4480-90f6-79b6d4964f47 => generated 1455 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:01.985760 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-8c200d21-590a-492a-8672-614a1aaf0e83 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:01.998523 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-8c200d21-590a-492a-8672-614a1aaf0e83 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] [instance: d1f298aa-ebe3-4f52-ada6-137a782cd9b7] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:02.033398 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8c200d21-590a-492a-8672-614a1aaf0e83 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:02.037186 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8c200d21-590a-492a-8672-614a1aaf0e83 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:02.037857 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8c200d21-590a-492a-8672-614a1aaf0e83 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:02.038785 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8c200d21-590a-492a-8672-614a1aaf0e83 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:02.039405 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8c200d21-590a-492a-8672-614a1aaf0e83 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:02.051438 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8c200d21-590a-492a-8672-614a1aaf0e83 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:02.263329 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-7e5fd1c3-23ee-4fce-bc42-0666979eb919 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c96ec8b8e0a4053b0457f213e6e262d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b812c85494a49898376a0dd8140f03c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:02.271702 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-7e5fd1c3-23ee-4fce-bc42-0666979eb919 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] 10.222.0.43 "GET /compute/v2.1/servers/b6474a49-d05d-4d2e-afef-cdbbe8c6d9aa" status: 200 len: 1575 microversion: 2.1 time: 0.499511 Oct 04 18:40:02.284274 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1245/2317] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:01 2022] GET /compute/v2.1/servers/b6474a49-d05d-4d2e-afef-cdbbe8c6d9aa => generated 1575 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:02.363732 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-8c200d21-590a-492a-8672-614a1aaf0e83 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:02.375930 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-8c200d21-590a-492a-8672-614a1aaf0e83 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:02.383180 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-8c200d21-590a-492a-8672-614a1aaf0e83 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:02.384546 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-8c200d21-590a-492a-8672-614a1aaf0e83 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] 10.222.0.43 "GET /compute/v2.1/servers/d1f298aa-ebe3-4f52-ada6-137a782cd9b7" status: 200 len: 1265 microversion: 2.25 time: 0.411006 Oct 04 18:40:02.385146 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1073/2318] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:40:01 2022] GET /compute/v2.1/servers/d1f298aa-ebe3-4f52-ada6-137a782cd9b7 => generated 1265 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:40:02.426356 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-600fd9be-73bf-4281-ae47-5694db320a4e tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:02.431323 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-600fd9be-73bf-4281-ae47-5694db320a4e tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] [instance: 1a71ee0e-ffa8-4730-b4fb-8b6e9fd87239] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:02.443149 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-600fd9be-73bf-4281-ae47-5694db320a4e tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:02.445824 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-600fd9be-73bf-4281-ae47-5694db320a4e tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:02.446304 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-600fd9be-73bf-4281-ae47-5694db320a4e tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:02.449880 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-600fd9be-73bf-4281-ae47-5694db320a4e tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:02.450419 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-600fd9be-73bf-4281-ae47-5694db320a4e tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:02.451116 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-600fd9be-73bf-4281-ae47-5694db320a4e tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:02.560512 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-9ba2a0d9-17b3-4bd5-b136-087a32f2648a tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-1269176074", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:40:02.662717 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.network.neutron [None req-9ba2a0d9-17b3-4bd5-b136-087a32f2648a tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] validate_networks() for [('7e8bb2fc-4c1c-4c59-b4ef-ae5d797a32f8', None, None, None, None, None)] {{(pid=123596) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:40:02.892810 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-600fd9be-73bf-4281-ae47-5694db320a4e tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a19da94e9e646028a7f73f9d0e0edda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc41f296eb44503868205ec8aa2fef3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:02.907010 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-600fd9be-73bf-4281-ae47-5694db320a4e tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] 10.222.0.43 "GET /compute/v2.1/servers/1a71ee0e-ffa8-4730-b4fb-8b6e9fd87239" status: 200 len: 1521 microversion: 2.1 time: 0.497296 Oct 04 18:40:02.929663 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1074/2319] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:02 2022] GET /compute/v2.1/servers/1a71ee0e-ffa8-4730-b4fb-8b6e9fd87239 => generated 1521 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:02.938153 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-800e9579-45f4-47c5-b6e0-5fb35ddebd73 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:02.945630 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-800e9579-45f4-47c5-b6e0-5fb35ddebd73 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] [instance: b53d822f-e7b1-498a-b98a-35f87839dfe8] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:02.961882 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-800e9579-45f4-47c5-b6e0-5fb35ddebd73 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:02.964131 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-800e9579-45f4-47c5-b6e0-5fb35ddebd73 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:02.967367 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-800e9579-45f4-47c5-b6e0-5fb35ddebd73 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:02.968486 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-800e9579-45f4-47c5-b6e0-5fb35ddebd73 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:02.969232 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-800e9579-45f4-47c5-b6e0-5fb35ddebd73 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:02.970711 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-800e9579-45f4-47c5-b6e0-5fb35ddebd73 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:03.144164 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-800e9579-45f4-47c5-b6e0-5fb35ddebd73 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e1add2296c4ed5830c5d90ef272ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fdc44ceeb041bcba1be2fcc2084aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:03.157932 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-800e9579-45f4-47c5-b6e0-5fb35ddebd73 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59e1add2296c4ed5830c5d90ef272ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fdc44ceeb041bcba1be2fcc2084aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:03.162055 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-800e9579-45f4-47c5-b6e0-5fb35ddebd73 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59e1add2296c4ed5830c5d90ef272ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fdc44ceeb041bcba1be2fcc2084aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:03.166702 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-800e9579-45f4-47c5-b6e0-5fb35ddebd73 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] 10.222.0.43 "GET /compute/v2.1/servers/b53d822f-e7b1-498a-b98a-35f87839dfe8" status: 200 len: 1409 microversion: 2.54 time: 0.235477 Oct 04 18:40:03.168547 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1075/2320] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:40:02 2022] GET /compute/v2.1/servers/b53d822f-e7b1-498a-b98a-35f87839dfe8 => generated 1409 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:40:03.191270 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-b1706286-f84f-45d7-b77a-ab8f3983f319 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:03.201575 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-b1706286-f84f-45d7-b77a-ab8f3983f319 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: d9d4332a-97b6-40f1-bd7c-a9a75a9adc43] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:03.211585 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b1706286-f84f-45d7-b77a-ab8f3983f319 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:03.212625 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b1706286-f84f-45d7-b77a-ab8f3983f319 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:03.213964 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b1706286-f84f-45d7-b77a-ab8f3983f319 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:03.219814 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b1706286-f84f-45d7-b77a-ab8f3983f319 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:03.220556 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b1706286-f84f-45d7-b77a-ab8f3983f319 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:03.221550 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b1706286-f84f-45d7-b77a-ab8f3983f319 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:03.472558 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-b1706286-f84f-45d7-b77a-ab8f3983f319 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:03.480826 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-b1706286-f84f-45d7-b77a-ab8f3983f319 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/d9d4332a-97b6-40f1-bd7c-a9a75a9adc43" status: 200 len: 1542 microversion: 2.1 time: 0.310942 Oct 04 18:40:03.484833 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1076/2321] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:03 2022] GET /compute/v2.1/servers/d9d4332a-97b6-40f1-bd7c-a9a75a9adc43 => generated 1542 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:03.489729 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-aa871d43-68db-4834-be78-7093fa0c2179 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Calling method '.version_select at 0x7fb227d40820>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:03.542849 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-9ba2a0d9-17b3-4bd5-b136-087a32f2648a tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Flavor limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:40:03.544020 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-9ba2a0d9-17b3-4bd5-b136-087a32f2648a tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Image limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:40:03.545364 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-9ba2a0d9-17b3-4bd5-b136-087a32f2648a tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Flavor pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:40:03.546140 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-9ba2a0d9-17b3-4bd5-b136-087a32f2648a tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Image pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:40:03.546973 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-9ba2a0d9-17b3-4bd5-b136-087a32f2648a tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:40:03.566994 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9ba2a0d9-17b3-4bd5-b136-087a32f2648a tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:03.568862 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9ba2a0d9-17b3-4bd5-b136-087a32f2648a tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:03.570072 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9ba2a0d9-17b3-4bd5-b136-087a32f2648a tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:03.575833 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9ba2a0d9-17b3-4bd5-b136-087a32f2648a tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:03.578787 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9ba2a0d9-17b3-4bd5-b136-087a32f2648a tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:03.580060 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9ba2a0d9-17b3-4bd5-b136-087a32f2648a tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:03.617562 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-aa871d43-68db-4834-be78-7093fa0c2179 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] 10.222.0.43 "GET /compute/v2.1/images/e4d3e808-f1b4-4480-90f6-79b6d4964f47" status: 200 len: 1455 microversion: 2.1 time: 0.130709 Oct 04 18:40:03.619031 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1077/2322] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 18:40:03 2022] GET /compute/v2.1/images/e4d3e808-f1b4-4480-90f6-79b6d4964f47 => generated 1455 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:03.624819 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-ba15c792-b30b-437a-bf0c-1470ad2eb71d tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:03.625852 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-ba15c792-b30b-437a-bf0c-1470ad2eb71d tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] [instance: b6474a49-d05d-4d2e-afef-cdbbe8c6d9aa] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:03.632716 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ba15c792-b30b-437a-bf0c-1470ad2eb71d tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:03.633567 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ba15c792-b30b-437a-bf0c-1470ad2eb71d tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:03.634236 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ba15c792-b30b-437a-bf0c-1470ad2eb71d tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:03.635742 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ba15c792-b30b-437a-bf0c-1470ad2eb71d tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:03.636435 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ba15c792-b30b-437a-bf0c-1470ad2eb71d tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:03.637518 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ba15c792-b30b-437a-bf0c-1470ad2eb71d tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:03.660613 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-9ba2a0d9-17b3-4bd5-b136-087a32f2648a tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Getting quotas for project 75d562b670294a47b2171f4003be4cdb. Resources: {'ram', 'cores', 'instances'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:40:03.678894 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-9ba2a0d9-17b3-4bd5-b136-087a32f2648a tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Getting quotas for user 15432d1b74334e1188866004384befe3 and project 75d562b670294a47b2171f4003be4cdb. Resources: {'ram', 'cores', 'instances'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:40:03.731241 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-9ba2a0d9-17b3-4bd5-b136-087a32f2648a tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Going to run 1 instances... {{(pid=123596) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:40:03.737943 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-9ba2a0d9-17b3-4bd5-b136-087a32f2648a tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] [instance: ffbbf357-494a-40e4-8943-3159707fc2e4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e8943ec5-4038-4d4b-b9b9-2415a79f5243',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123596) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:40:03.882368 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-9ba2a0d9-17b3-4bd5-b136-087a32f2648a tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.608985 Oct 04 18:40:03.892743 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1246/2323] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 18:40:02 2022] POST /compute/v2.1/servers => generated 383 bytes in 1620 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:40:03.902817 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-ddc0100b-2798-446a-817c-a90b0add0e2a tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:03.903979 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-ddc0100b-2798-446a-817c-a90b0add0e2a tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] [instance: d1f298aa-ebe3-4f52-ada6-137a782cd9b7] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:03.918130 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ddc0100b-2798-446a-817c-a90b0add0e2a tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:03.918946 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ddc0100b-2798-446a-817c-a90b0add0e2a tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:03.920233 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ddc0100b-2798-446a-817c-a90b0add0e2a tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:03.921698 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ddc0100b-2798-446a-817c-a90b0add0e2a tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:03.922551 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-ba15c792-b30b-437a-bf0c-1470ad2eb71d tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c96ec8b8e0a4053b0457f213e6e262d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b812c85494a49898376a0dd8140f03c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:03.923464 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ddc0100b-2798-446a-817c-a90b0add0e2a tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:03.939778 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ddc0100b-2798-446a-817c-a90b0add0e2a tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:03.942096 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-ba15c792-b30b-437a-bf0c-1470ad2eb71d tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] 10.222.0.43 "GET /compute/v2.1/servers/b6474a49-d05d-4d2e-afef-cdbbe8c6d9aa" status: 200 len: 1573 microversion: 2.1 time: 0.320774 Oct 04 18:40:03.944092 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1078/2324] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:03 2022] GET /compute/v2.1/servers/b6474a49-d05d-4d2e-afef-cdbbe8c6d9aa => generated 1573 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:03.956190 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-e3fed347-2ea9-40aa-92c7-c7f5f6eb0e87 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:03.958399 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-e3fed347-2ea9-40aa-92c7-c7f5f6eb0e87 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] [instance: ffbbf357-494a-40e4-8943-3159707fc2e4] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:04.089544 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-e3fed347-2ea9-40aa-92c7-c7f5f6eb0e87 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15432d1b74334e1188866004384befe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d562b670294a47b2171f4003be4cdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:04.100356 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-e3fed347-2ea9-40aa-92c7-c7f5f6eb0e87 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] 10.222.0.43 "GET /compute/v2.1/servers/ffbbf357-494a-40e4-8943-3159707fc2e4" status: 200 len: 1223 microversion: 2.1 time: 0.154432 Oct 04 18:40:04.105589 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1079/2325] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:03 2022] GET /compute/v2.1/servers/ffbbf357-494a-40e4-8943-3159707fc2e4 => generated 1223 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:04.118345 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-7b6da811-c954-4012-9a1b-cfcf0fd1f25d tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:04.119314 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-7b6da811-c954-4012-9a1b-cfcf0fd1f25d tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] [instance: 1a71ee0e-ffa8-4730-b4fb-8b6e9fd87239] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:04.131936 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7b6da811-c954-4012-9a1b-cfcf0fd1f25d tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:04.133698 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7b6da811-c954-4012-9a1b-cfcf0fd1f25d tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:04.134385 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7b6da811-c954-4012-9a1b-cfcf0fd1f25d tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:04.138926 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7b6da811-c954-4012-9a1b-cfcf0fd1f25d tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:04.139656 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7b6da811-c954-4012-9a1b-cfcf0fd1f25d tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:04.140314 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7b6da811-c954-4012-9a1b-cfcf0fd1f25d tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:04.182945 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-ddc0100b-2798-446a-817c-a90b0add0e2a tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:04.217658 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-ddc0100b-2798-446a-817c-a90b0add0e2a tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:04.221999 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-ddc0100b-2798-446a-817c-a90b0add0e2a tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:04.234861 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-ddc0100b-2798-446a-817c-a90b0add0e2a tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] 10.222.0.43 "GET /compute/v2.1/servers/d1f298aa-ebe3-4f52-ada6-137a782cd9b7" status: 200 len: 1265 microversion: 2.25 time: 0.336221 Oct 04 18:40:04.238949 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1247/2326] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:40:03 2022] GET /compute/v2.1/servers/d1f298aa-ebe3-4f52-ada6-137a782cd9b7 => generated 1265 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:40:04.265948 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-940a3267-0735-45ce-9cd8-f36d1b526770 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-111599204"}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:40:04.268834 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-940a3267-0735-45ce-9cd8-f36d1b526770 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] [instance: b6474a49-d05d-4d2e-afef-cdbbe8c6d9aa] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:04.297972 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-940a3267-0735-45ce-9cd8-f36d1b526770 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:04.306133 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-940a3267-0735-45ce-9cd8-f36d1b526770 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:04.311096 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-940a3267-0735-45ce-9cd8-f36d1b526770 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:04.321440 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-940a3267-0735-45ce-9cd8-f36d1b526770 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:04.322290 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-940a3267-0735-45ce-9cd8-f36d1b526770 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:04.329347 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-940a3267-0735-45ce-9cd8-f36d1b526770 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:04.477122 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-7b6da811-c954-4012-9a1b-cfcf0fd1f25d tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a19da94e9e646028a7f73f9d0e0edda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc41f296eb44503868205ec8aa2fef3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:04.489604 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-7b6da811-c954-4012-9a1b-cfcf0fd1f25d tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] 10.222.0.43 "GET /compute/v2.1/servers/1a71ee0e-ffa8-4730-b4fb-8b6e9fd87239" status: 200 len: 1521 microversion: 2.1 time: 0.382588 Oct 04 18:40:04.511915 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1080/2327] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:04 2022] GET /compute/v2.1/servers/1a71ee0e-ffa8-4730-b4fb-8b6e9fd87239 => generated 1521 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:04.525433 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-5af98f8d-f434-46e7-b27e-9376d3a43277 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:04.529607 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-5af98f8d-f434-46e7-b27e-9376d3a43277 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] [instance: b53d822f-e7b1-498a-b98a-35f87839dfe8] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:04.541440 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5af98f8d-f434-46e7-b27e-9376d3a43277 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:04.542273 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5af98f8d-f434-46e7-b27e-9376d3a43277 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:04.543500 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5af98f8d-f434-46e7-b27e-9376d3a43277 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:04.544435 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5af98f8d-f434-46e7-b27e-9376d3a43277 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:04.549781 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5af98f8d-f434-46e7-b27e-9376d3a43277 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:04.550517 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5af98f8d-f434-46e7-b27e-9376d3a43277 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:04.689501 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-5af98f8d-f434-46e7-b27e-9376d3a43277 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e1add2296c4ed5830c5d90ef272ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fdc44ceeb041bcba1be2fcc2084aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:04.703566 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-5af98f8d-f434-46e7-b27e-9376d3a43277 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59e1add2296c4ed5830c5d90ef272ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fdc44ceeb041bcba1be2fcc2084aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:04.706765 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-5af98f8d-f434-46e7-b27e-9376d3a43277 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59e1add2296c4ed5830c5d90ef272ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fdc44ceeb041bcba1be2fcc2084aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:04.711917 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-5af98f8d-f434-46e7-b27e-9376d3a43277 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] 10.222.0.43 "GET /compute/v2.1/servers/b53d822f-e7b1-498a-b98a-35f87839dfe8" status: 200 len: 1409 microversion: 2.54 time: 0.195345 Oct 04 18:40:04.715007 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1081/2328] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:40:04 2022] GET /compute/v2.1/servers/b53d822f-e7b1-498a-b98a-35f87839dfe8 => generated 1409 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:40:04.733436 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-f5284922-25df-4d2a-9aaf-1a94529998d5 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:04.736301 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-f5284922-25df-4d2a-9aaf-1a94529998d5 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: d9d4332a-97b6-40f1-bd7c-a9a75a9adc43] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:04.770637 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f5284922-25df-4d2a-9aaf-1a94529998d5 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:04.771680 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f5284922-25df-4d2a-9aaf-1a94529998d5 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:04.772322 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f5284922-25df-4d2a-9aaf-1a94529998d5 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:04.773347 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f5284922-25df-4d2a-9aaf-1a94529998d5 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:04.776823 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f5284922-25df-4d2a-9aaf-1a94529998d5 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:04.777504 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f5284922-25df-4d2a-9aaf-1a94529998d5 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:04.875903 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.network.security_group_api [None req-940a3267-0735-45ce-9cd8-f36d1b526770 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Adding security group 18de9d4e-2ee8-4b41-8a08-e894ffbea260 to port 983dac01-7966-45d6-9bba-c9843044df16 Oct 04 18:40:05.110653 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-f5284922-25df-4d2a-9aaf-1a94529998d5 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:05.121922 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-f5284922-25df-4d2a-9aaf-1a94529998d5 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/d9d4332a-97b6-40f1-bd7c-a9a75a9adc43" status: 200 len: 1542 microversion: 2.1 time: 0.404083 Oct 04 18:40:05.122743 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1082/2329] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:04 2022] GET /compute/v2.1/servers/d9d4332a-97b6-40f1-bd7c-a9a75a9adc43 => generated 1542 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:05.145743 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-169ef901-7a3b-4fdc-969a-f11d1fc6b213 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Calling method '.version_select at 0x7fb21fa8a790>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:05.247154 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-169ef901-7a3b-4fdc-969a-f11d1fc6b213 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] 10.222.0.43 "GET /compute/v2.1/images/e4d3e808-f1b4-4480-90f6-79b6d4964f47" status: 200 len: 1455 microversion: 2.1 time: 0.106262 Oct 04 18:40:05.248467 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1083/2330] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 18:40:05 2022] GET /compute/v2.1/images/e4d3e808-f1b4-4480-90f6-79b6d4964f47 => generated 1455 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:05.264423 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-7854b0ae-55f3-4764-918b-361281fe413e tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:05.264907 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-7854b0ae-55f3-4764-918b-361281fe413e tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] [instance: ffbbf357-494a-40e4-8943-3159707fc2e4] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:05.280898 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7854b0ae-55f3-4764-918b-361281fe413e tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:05.281412 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7854b0ae-55f3-4764-918b-361281fe413e tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:05.281846 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7854b0ae-55f3-4764-918b-361281fe413e tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:05.290728 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7854b0ae-55f3-4764-918b-361281fe413e tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:05.292359 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7854b0ae-55f3-4764-918b-361281fe413e tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:05.293223 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7854b0ae-55f3-4764-918b-361281fe413e tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:05.399662 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-7854b0ae-55f3-4764-918b-361281fe413e tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15432d1b74334e1188866004384befe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d562b670294a47b2171f4003be4cdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:05.408718 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-7854b0ae-55f3-4764-918b-361281fe413e tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] 10.222.0.43 "GET /compute/v2.1/servers/ffbbf357-494a-40e4-8943-3159707fc2e4" status: 200 len: 1227 microversion: 2.1 time: 0.156417 Oct 04 18:40:05.409632 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1084/2331] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:05 2022] GET /compute/v2.1/servers/ffbbf357-494a-40e4-8943-3159707fc2e4 => generated 1227 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:05.431244 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-57f21185-f80d-469a-bc9f-511335f17d24 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:05.431244 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-57f21185-f80d-469a-bc9f-511335f17d24 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] [instance: d1f298aa-ebe3-4f52-ada6-137a782cd9b7] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:05.444417 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-57f21185-f80d-469a-bc9f-511335f17d24 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:05.444975 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-57f21185-f80d-469a-bc9f-511335f17d24 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:05.445380 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-57f21185-f80d-469a-bc9f-511335f17d24 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:05.446092 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-57f21185-f80d-469a-bc9f-511335f17d24 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:05.446543 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-57f21185-f80d-469a-bc9f-511335f17d24 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:05.446972 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-57f21185-f80d-469a-bc9f-511335f17d24 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:05.624183 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-57f21185-f80d-469a-bc9f-511335f17d24 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:05.645425 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-57f21185-f80d-469a-bc9f-511335f17d24 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:05.650390 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-57f21185-f80d-469a-bc9f-511335f17d24 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:05.653439 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-57f21185-f80d-469a-bc9f-511335f17d24 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] 10.222.0.43 "GET /compute/v2.1/servers/d1f298aa-ebe3-4f52-ada6-137a782cd9b7" status: 200 len: 1265 microversion: 2.25 time: 0.241223 Oct 04 18:40:05.665151 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1085/2332] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:40:05 2022] GET /compute/v2.1/servers/d1f298aa-ebe3-4f52-ada6-137a782cd9b7 => generated 1265 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:40:05.674090 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-d1d69983-5e1f-4b7c-ac15-51bd4db6bf95 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:05.674729 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-d1d69983-5e1f-4b7c-ac15-51bd4db6bf95 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] [instance: 1a71ee0e-ffa8-4730-b4fb-8b6e9fd87239] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:05.685288 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d1d69983-5e1f-4b7c-ac15-51bd4db6bf95 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:05.685795 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d1d69983-5e1f-4b7c-ac15-51bd4db6bf95 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:05.686243 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d1d69983-5e1f-4b7c-ac15-51bd4db6bf95 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:05.687140 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d1d69983-5e1f-4b7c-ac15-51bd4db6bf95 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:05.687614 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d1d69983-5e1f-4b7c-ac15-51bd4db6bf95 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:05.688037 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d1d69983-5e1f-4b7c-ac15-51bd4db6bf95 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:05.956738 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-d1d69983-5e1f-4b7c-ac15-51bd4db6bf95 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a19da94e9e646028a7f73f9d0e0edda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc41f296eb44503868205ec8aa2fef3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:05.958738 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:40:05.968830 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-d1d69983-5e1f-4b7c-ac15-51bd4db6bf95 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] 10.222.0.43 "GET /compute/v2.1/servers/1a71ee0e-ffa8-4730-b4fb-8b6e9fd87239" status: 200 len: 1521 microversion: 2.1 time: 0.311594 Oct 04 18:40:05.988508 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1086/2333] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:05 2022] GET /compute/v2.1/servers/1a71ee0e-ffa8-4730-b4fb-8b6e9fd87239 => generated 1521 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:06.017130 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-ce9eb359-a694-4df7-ac1c-d50d971b08aa tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:06.021934 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-ce9eb359-a694-4df7-ac1c-d50d971b08aa tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] [instance: b53d822f-e7b1-498a-b98a-35f87839dfe8] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:06.046597 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ce9eb359-a694-4df7-ac1c-d50d971b08aa tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:06.047090 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ce9eb359-a694-4df7-ac1c-d50d971b08aa tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:06.054697 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ce9eb359-a694-4df7-ac1c-d50d971b08aa tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:06.059103 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ce9eb359-a694-4df7-ac1c-d50d971b08aa tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:06.060486 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ce9eb359-a694-4df7-ac1c-d50d971b08aa tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:06.060956 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ce9eb359-a694-4df7-ac1c-d50d971b08aa tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:06.201668 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-ce9eb359-a694-4df7-ac1c-d50d971b08aa tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e1add2296c4ed5830c5d90ef272ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fdc44ceeb041bcba1be2fcc2084aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:06.212529 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-ce9eb359-a694-4df7-ac1c-d50d971b08aa tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59e1add2296c4ed5830c5d90ef272ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fdc44ceeb041bcba1be2fcc2084aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:06.215723 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-ce9eb359-a694-4df7-ac1c-d50d971b08aa tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59e1add2296c4ed5830c5d90ef272ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fdc44ceeb041bcba1be2fcc2084aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:06.217258 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-ce9eb359-a694-4df7-ac1c-d50d971b08aa tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] 10.222.0.43 "GET /compute/v2.1/servers/b53d822f-e7b1-498a-b98a-35f87839dfe8" status: 200 len: 1409 microversion: 2.54 time: 0.226931 Oct 04 18:40:06.218144 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1087/2334] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:40:05 2022] GET /compute/v2.1/servers/b53d822f-e7b1-498a-b98a-35f87839dfe8 => generated 1409 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:40:06.224013 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-a44501c6-0bd0-473b-a044-31186e491310 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:06.224648 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-a44501c6-0bd0-473b-a044-31186e491310 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: d9d4332a-97b6-40f1-bd7c-a9a75a9adc43] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:06.240470 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a44501c6-0bd0-473b-a044-31186e491310 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:06.240888 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a44501c6-0bd0-473b-a044-31186e491310 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:06.241325 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a44501c6-0bd0-473b-a044-31186e491310 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:06.242044 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a44501c6-0bd0-473b-a044-31186e491310 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:06.242520 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a44501c6-0bd0-473b-a044-31186e491310 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:06.243117 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a44501c6-0bd0-473b-a044-31186e491310 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:07.000761 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-a44501c6-0bd0-473b-a044-31186e491310 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:07.011066 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-a44501c6-0bd0-473b-a044-31186e491310 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/d9d4332a-97b6-40f1-bd7c-a9a75a9adc43" status: 200 len: 1542 microversion: 2.1 time: 0.791587 Oct 04 18:40:07.015451 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1088/2335] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:06 2022] GET /compute/v2.1/servers/d9d4332a-97b6-40f1-bd7c-a9a75a9adc43 => generated 1542 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:07.034791 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-1267971c-ff41-402f-9004-7969a8a35572 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Calling method '.version_select at 0x7fb227d5d8b0>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:07.125507 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-1267971c-ff41-402f-9004-7969a8a35572 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] 10.222.0.43 "GET /compute/v2.1/images/e4d3e808-f1b4-4480-90f6-79b6d4964f47" status: 200 len: 1455 microversion: 2.1 time: 0.108582 Oct 04 18:40:07.135464 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1089/2336] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 18:40:07 2022] GET /compute/v2.1/images/e4d3e808-f1b4-4480-90f6-79b6d4964f47 => generated 1455 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:07.146856 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-77b41d2a-f9ec-43ea-b1c1-2dd71a209918 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:07.147792 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-77b41d2a-f9ec-43ea-b1c1-2dd71a209918 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] [instance: ffbbf357-494a-40e4-8943-3159707fc2e4] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:07.161222 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-77b41d2a-f9ec-43ea-b1c1-2dd71a209918 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:07.164112 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-77b41d2a-f9ec-43ea-b1c1-2dd71a209918 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:07.164753 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-77b41d2a-f9ec-43ea-b1c1-2dd71a209918 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:07.166520 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-77b41d2a-f9ec-43ea-b1c1-2dd71a209918 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:07.168149 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-77b41d2a-f9ec-43ea-b1c1-2dd71a209918 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:07.171479 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-77b41d2a-f9ec-43ea-b1c1-2dd71a209918 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:07.563117 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-77b41d2a-f9ec-43ea-b1c1-2dd71a209918 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15432d1b74334e1188866004384befe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d562b670294a47b2171f4003be4cdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:07.576654 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-77b41d2a-f9ec-43ea-b1c1-2dd71a209918 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] 10.222.0.43 "GET /compute/v2.1/servers/ffbbf357-494a-40e4-8943-3159707fc2e4" status: 200 len: 1281 microversion: 2.1 time: 0.439237 Oct 04 18:40:07.579056 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1090/2337] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:07 2022] GET /compute/v2.1/servers/ffbbf357-494a-40e4-8943-3159707fc2e4 => generated 1281 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:07.598672 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-1447d52b-cc8d-481c-af4b-ca6b3786a3f7 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:07.600563 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-1447d52b-cc8d-481c-af4b-ca6b3786a3f7 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] [instance: d1f298aa-ebe3-4f52-ada6-137a782cd9b7] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:07.616556 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1447d52b-cc8d-481c-af4b-ca6b3786a3f7 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:07.617057 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1447d52b-cc8d-481c-af4b-ca6b3786a3f7 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:07.618737 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1447d52b-cc8d-481c-af4b-ca6b3786a3f7 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:07.620987 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1447d52b-cc8d-481c-af4b-ca6b3786a3f7 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:07.621644 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1447d52b-cc8d-481c-af4b-ca6b3786a3f7 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:07.622083 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1447d52b-cc8d-481c-af4b-ca6b3786a3f7 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:07.661498 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-1447d52b-cc8d-481c-af4b-ca6b3786a3f7 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] HTTP exception thrown: Instance d1f298aa-ebe3-4f52-ada6-137a782cd9b7 could not be found. Oct 04 18:40:07.665393 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-1447d52b-cc8d-481c-af4b-ca6b3786a3f7 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Request method failure captured: Oct 04 18:40:07.665393 n-d-851028-13 devstack@n-api.service[123595]: request: GET /compute/v2.1/servers/d1f298aa-ebe3-4f52-ada6-137a782cd9b7 HTTP/1.1 Oct 04 18:40:07.665393 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 18:40:07.665393 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 18:40:07.665393 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 18:40:07.665393 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 0 Oct 04 18:40:07.665393 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 18:40:07.665393 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 18:40:07.665393 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 18:40:07.665393 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 18:40:07.665393 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPHxK_ToGvcECtRTJrWYMKaCCQEh_JZZgcqc-r_A500pVGUvovsnjwjyXlRim6Z-YtMLF9D_Q9MV8m4O2Jyok1khHVlXddWmZz_Glnhlck2aiWTU2mJ-gbHAAw8sCZHyDjKgUfwQs9jySnzCV7Gx1ajTbePvcLH61LZ4g9dLjBrddiSA Oct 04 18:40:07.665393 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 18:40:07.665393 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 18:40:07.665393 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 18:40:07.665393 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 18:40:07.665393 n-d-851028-13 devstack@n-api.service[123595]: X-Openstack-Nova-Api-Version: 2.25 Oct 04 18:40:07.665393 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 18:40:07.665393 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 18:40:07.665393 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: 34199e342c1b4158abf82384f2213b5f Oct 04 18:40:07.665393 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1153487493 Oct 04 18:40:07.665393 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 18:40:07.665393 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 18:40:07.665393 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/34199e342c1b4158abf82384f2213b5f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_34199e342c1b4158abf82384f2213b5f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/34199e342c1b4158abf82384f2213b5f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/34199e342c1b4158abf82384f2213b5f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:40:07.665393 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1153487493 Oct 04 18:40:07.665393 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: 34199e342c1b4158abf82384f2213b5f Oct 04 18:40:07.665393 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1153487493 Oct 04 18:40:07.665393 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-LiveAutoBlockMigrationV225Test-1153487493-project Oct 04 18:40:07.665393 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 18:40:07.665393 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 18:40:07.665393 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: 807a4a88319946aead73a3ccfcda6aeb Oct 04 18:40:07.665393 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1153487493-project Oct 04 18:40:07.665393 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 18:40:07.665393 n-d-851028-13 devstack@n-api.service[123595]: exception: Instance d1f298aa-ebe3-4f52-ada6-137a782cd9b7 could not be found. Oct 04 18:40:07.665393 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': 'd1f298aa-ebe3-4f52-ada6-137a782cd9b7'} Oct 04 18:40:07.665393 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:40:07.665393 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:40:07.665393 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:40:07.665393 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:40:07.665393 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:40:07.665393 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:40:07.665393 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:40:07.665393 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:40:07.665393 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:40:07.665393 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:40:07.665393 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1f298aa-ebe3-4f52-ada6-137a782cd9b7 could not be found. Oct 04 18:40:07.665393 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:40:07.665393 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:40:07.665393 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:40:07.665393 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:40:07.665393 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:40:07.665393 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:40:07.665393 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:40:07.665393 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:40:07.665393 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:40:07.665393 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:40:07.665393 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:40:07.665393 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:40:07.665393 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:40:07.665393 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:40:07.665393 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:40:07.665393 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:40:07.665393 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1f298aa-ebe3-4f52-ada6-137a782cd9b7 could not be found. Oct 04 18:40:07.665393 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:40:07.670095 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:40:07.670095 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:40:07.670095 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:40:07.670095 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:40:07.670095 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:40:07.670095 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:40:07.670095 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:40:07.670095 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1f298aa-ebe3-4f52-ada6-137a782cd9b7 could not be found. Oct 04 18:40:07.670095 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:40:07.670095 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-1447d52b-cc8d-481c-af4b-ca6b3786a3f7 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Returning 404 to user: Instance d1f298aa-ebe3-4f52-ada6-137a782cd9b7 could not be found. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:40:07.670095 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-1447d52b-cc8d-481c-af4b-ca6b3786a3f7 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] 10.222.0.43 "GET /compute/v2.1/servers/d1f298aa-ebe3-4f52-ada6-137a782cd9b7" status: 404 len: 111 microversion: 2.25 time: 0.087607 Oct 04 18:40:07.676204 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1091/2338] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:40:07 2022] GET /compute/v2.1/servers/d1f298aa-ebe3-4f52-ada6-137a782cd9b7 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:40:07.684741 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-1041bb5b-c61e-46c9-b8cd-dc093c082de6 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:07.685366 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-1041bb5b-c61e-46c9-b8cd-dc093c082de6 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] [instance: 1a71ee0e-ffa8-4730-b4fb-8b6e9fd87239] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:07.701252 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1041bb5b-c61e-46c9-b8cd-dc093c082de6 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:07.701747 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1041bb5b-c61e-46c9-b8cd-dc093c082de6 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:07.708174 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1041bb5b-c61e-46c9-b8cd-dc093c082de6 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:07.709218 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1041bb5b-c61e-46c9-b8cd-dc093c082de6 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:07.709708 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1041bb5b-c61e-46c9-b8cd-dc093c082de6 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:07.710151 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1041bb5b-c61e-46c9-b8cd-dc093c082de6 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:07.948289 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-940a3267-0735-45ce-9cd8-f36d1b526770 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] 10.222.0.43 "POST /compute/v2.1/servers/b6474a49-d05d-4d2e-afef-cdbbe8c6d9aa/action" status: 202 len: 0 microversion: 2.1 time: 3.704520 Oct 04 18:40:07.954174 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1248/2339] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 18:40:04 2022] POST /compute/v2.1/servers/b6474a49-d05d-4d2e-afef-cdbbe8c6d9aa/action => generated 0 bytes in 3714 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:40:07.959192 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-251e059b-110f-4324-87df-c8fbba66579c tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:07.960077 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-251e059b-110f-4324-87df-c8fbba66579c tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] [instance: b53d822f-e7b1-498a-b98a-35f87839dfe8] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:07.998125 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-251e059b-110f-4324-87df-c8fbba66579c tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:07.998768 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-251e059b-110f-4324-87df-c8fbba66579c tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:07.999273 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-251e059b-110f-4324-87df-c8fbba66579c tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:08.007449 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-251e059b-110f-4324-87df-c8fbba66579c tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:08.009741 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-251e059b-110f-4324-87df-c8fbba66579c tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:08.011225 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-251e059b-110f-4324-87df-c8fbba66579c tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:08.219088 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-251e059b-110f-4324-87df-c8fbba66579c tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e1add2296c4ed5830c5d90ef272ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fdc44ceeb041bcba1be2fcc2084aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:08.236056 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-251e059b-110f-4324-87df-c8fbba66579c tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59e1add2296c4ed5830c5d90ef272ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fdc44ceeb041bcba1be2fcc2084aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:08.244657 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-251e059b-110f-4324-87df-c8fbba66579c tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59e1add2296c4ed5830c5d90ef272ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fdc44ceeb041bcba1be2fcc2084aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:08.250120 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-251e059b-110f-4324-87df-c8fbba66579c tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] 10.222.0.43 "GET /compute/v2.1/servers/b53d822f-e7b1-498a-b98a-35f87839dfe8" status: 200 len: 1409 microversion: 2.54 time: 0.293617 Oct 04 18:40:08.251815 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1249/2340] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:40:07 2022] GET /compute/v2.1/servers/b53d822f-e7b1-498a-b98a-35f87839dfe8 => generated 1409 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:40:08.273331 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-50e57969-d5e9-4a2d-b4f4-35fd0ad78beb tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Calling method '.version_select at 0x7fb21ee7fc10>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:09.006865 n-d-851028-13 devstack@n-api.service[123596]: DEBUG neutronclient.v2_0.client [None req-50e57969-d5e9-4a2d-b4f4-35fd0ad78beb tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 18de9d4e-2ee8-4b41-8a08-e894ffbea260 in use.", "detail": ""}} {{(pid=123596) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 18:40:09.007569 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-50e57969-d5e9-4a2d-b4f4-35fd0ad78beb tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] HTTP exception thrown: Security Group 18de9d4e-2ee8-4b41-8a08-e894ffbea260 in use. Oct 04 18:40:09.007569 n-d-851028-13 devstack@n-api.service[123596]: Neutron server returns request_ids: ['req-254fa1ab-f92e-48c0-a62e-25c6744d80d1'] Oct 04 18:40:09.011390 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-50e57969-d5e9-4a2d-b4f4-35fd0ad78beb tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Request method failure captured: Oct 04 18:40:09.011390 n-d-851028-13 devstack@n-api.service[123596]: request: DELETE /compute/v2.1/os-security-groups/18de9d4e-2ee8-4b41-8a08-e894ffbea260 HTTP/1.1 Oct 04 18:40:09.011390 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:40:09.011390 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:40:09.011390 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:40:09.011390 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 18:40:09.011390 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:40:09.011390 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:40:09.011390 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:40:09.011390 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:40:09.011390 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPH2qE2WsiZvVd-vvN1M8uHJG40fIXDT1XURP-P4ciVfKnbP_2tplzYndj2wlvB6bSu_VMaD1xfU0nGHRYWQRmNIt_krh_S1n2RkrhietTC0-RnvJ1rzF8ilPx8zowbVefo7A8IyDn5QTaMC08kHUNyiYinJQT_Q7n9enahWrBitVOPM Oct 04 18:40:09.011390 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:40:09.011390 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:40:09.011390 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:40:09.011390 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:40:09.011390 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:40:09.011390 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:40:09.011390 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: 7b812c85494a49898376a0dd8140f03c Oct 04 18:40:09.011390 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-SecurityGroupsTestJSON-209295605 Oct 04 18:40:09.011390 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 18:40:09.011390 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 18:40:09.011390 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/7b812c85494a49898376a0dd8140f03c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_7b812c85494a49898376a0dd8140f03c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/7b812c85494a49898376a0dd8140f03c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/7b812c85494a49898376a0dd8140f03c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:40:09.011390 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-SecurityGroupsTestJSON-209295605 Oct 04 18:40:09.011390 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: 7b812c85494a49898376a0dd8140f03c Oct 04 18:40:09.011390 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-209295605 Oct 04 18:40:09.011390 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-SecurityGroupsTestJSON-209295605-project Oct 04 18:40:09.011390 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:40:09.011390 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:40:09.011390 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 5c96ec8b8e0a4053b0457f213e6e262d Oct 04 18:40:09.011390 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-SecurityGroupsTestJSON-209295605-project Oct 04 18:40:09.011390 n-d-851028-13 devstack@n-api.service[123596]: method: Oct 04 18:40:09.011390 n-d-851028-13 devstack@n-api.service[123596]: exception: Security Group 18de9d4e-2ee8-4b41-8a08-e894ffbea260 in use. Oct 04 18:40:09.011390 n-d-851028-13 devstack@n-api.service[123596]: Neutron server returns request_ids: ['req-254fa1ab-f92e-48c0-a62e-25c6744d80d1'] Oct 04 18:40:09.011390 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': '18de9d4e-2ee8-4b41-8a08-e894ffbea260'} Oct 04 18:40:09.011390 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:40:09.011390 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:40:09.011390 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 04 18:40:09.011390 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 04 18:40:09.011390 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:40:09.011390 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:40:09.011390 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 04 18:40:09.011390 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 04 18:40:09.011390 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:40:09.011390 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:40:09.011390 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 04 18:40:09.011390 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 04 18:40:09.011390 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:40:09.011390 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:40:09.011390 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 18:40:09.011390 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 18:40:09.011390 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:40:09.011390 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:40:09.011390 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 18:40:09.011390 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 18:40:09.011390 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:40:09.011390 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:40:09.011390 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 18:40:09.011390 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 18:40:09.011390 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 18:40:09.011390 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 18:40:09.011390 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 18de9d4e-2ee8-4b41-8a08-e894ffbea260 in use. Oct 04 18:40:09.016629 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-254fa1ab-f92e-48c0-a62e-25c6744d80d1'] Oct 04 18:40:09.016629 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:40:09.016629 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:40:09.016629 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:40:09.016629 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:40:09.016629 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 04 18:40:09.016629 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 04 18:40:09.016629 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 04 18:40:09.016629 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 04 18:40:09.016629 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 18de9d4e-2ee8-4b41-8a08-e894ffbea260 in use. Oct 04 18:40:09.016629 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-254fa1ab-f92e-48c0-a62e-25c6744d80d1'] Oct 04 18:40:09.016629 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:40:09.016629 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:40:09.016629 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:40:09.016629 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:40:09.016629 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:40:09.016629 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:40:09.016629 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:40:09.016629 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:40:09.016629 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:40:09.016629 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:40:09.016629 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:40:09.016629 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:40:09.016629 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 04 18:40:09.016629 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 04 18:40:09.016629 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 18de9d4e-2ee8-4b41-8a08-e894ffbea260 in use. Oct 04 18:40:09.016629 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-254fa1ab-f92e-48c0-a62e-25c6744d80d1'] Oct 04 18:40:09.016629 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:40:09.016629 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:40:09.016629 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:40:09.016629 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:40:09.016629 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:40:09.016629 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:40:09.016629 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:40:09.016629 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:40:09.016629 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 18de9d4e-2ee8-4b41-8a08-e894ffbea260 in use. Oct 04 18:40:09.016629 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-254fa1ab-f92e-48c0-a62e-25c6744d80d1'] Oct 04 18:40:09.016629 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:40:09.016629 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-50e57969-d5e9-4a2d-b4f4-35fd0ad78beb tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Returning 400 to user: Security Group 18de9d4e-2ee8-4b41-8a08-e894ffbea260 in use. Oct 04 18:40:09.016629 n-d-851028-13 devstack@n-api.service[123596]: Neutron server returns request_ids: ['req-254fa1ab-f92e-48c0-a62e-25c6744d80d1'] {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:40:09.016629 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-50e57969-d5e9-4a2d-b4f4-35fd0ad78beb tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] 10.222.0.43 "DELETE /compute/v2.1/os-security-groups/18de9d4e-2ee8-4b41-8a08-e894ffbea260" status: 400 len: 185 microversion: 2.1 time: 0.758557 Oct 04 18:40:09.022368 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1250/2341] 10.222.0.43 () {58 vars in 1272 bytes} [Tue Oct 4 18:40:08 2022] DELETE /compute/v2.1/os-security-groups/18de9d4e-2ee8-4b41-8a08-e894ffbea260 => generated 185 bytes in 768 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:40:09.035148 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-276199d5-fffc-47d3-8834-483135b2a6c9 req-c981a766-f451-4f9d-b737-75b9821ddb90 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6474a49-d05d-4d2e-afef-cdbbe8c6d9aa", "tag": "983dac01-7966-45d6-9bba-c9843044df16"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:40:09.076846 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-276199d5-fffc-47d3-8834-483135b2a6c9 req-c981a766-f451-4f9d-b737-75b9821ddb90 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:09.077364 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-276199d5-fffc-47d3-8834-483135b2a6c9 req-c981a766-f451-4f9d-b737-75b9821ddb90 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:09.077804 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-276199d5-fffc-47d3-8834-483135b2a6c9 req-c981a766-f451-4f9d-b737-75b9821ddb90 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:09.096132 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-276199d5-fffc-47d3-8834-483135b2a6c9 req-c981a766-f451-4f9d-b737-75b9821ddb90 service nova] Creating event network-changed:983dac01-7966-45d6-9bba-c9843044df16 for instance b6474a49-d05d-4d2e-afef-cdbbe8c6d9aa on n-h2-851028-13 Oct 04 18:40:09.114862 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-276199d5-fffc-47d3-8834-483135b2a6c9 req-c981a766-f451-4f9d-b737-75b9821ddb90 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086054 Oct 04 18:40:09.116147 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1251/2342] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:40:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:40:09.124876 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-ed5f0136-30f5-4c7b-aaca-d54140f03e34 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:09.125622 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-ed5f0136-30f5-4c7b-aaca-d54140f03e34 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: d9d4332a-97b6-40f1-bd7c-a9a75a9adc43] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:09.152525 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-1041bb5b-c61e-46c9-b8cd-dc093c082de6 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a19da94e9e646028a7f73f9d0e0edda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc41f296eb44503868205ec8aa2fef3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:09.157360 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ed5f0136-30f5-4c7b-aaca-d54140f03e34 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:09.158072 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ed5f0136-30f5-4c7b-aaca-d54140f03e34 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:09.158663 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ed5f0136-30f5-4c7b-aaca-d54140f03e34 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:09.159551 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ed5f0136-30f5-4c7b-aaca-d54140f03e34 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:09.160156 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ed5f0136-30f5-4c7b-aaca-d54140f03e34 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:09.160734 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ed5f0136-30f5-4c7b-aaca-d54140f03e34 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:09.164452 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-1041bb5b-c61e-46c9-b8cd-dc093c082de6 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] 10.222.0.43 "GET /compute/v2.1/servers/1a71ee0e-ffa8-4730-b4fb-8b6e9fd87239" status: 200 len: 1521 microversion: 2.1 time: 1.486961 Oct 04 18:40:09.170939 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1092/2343] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:07 2022] GET /compute/v2.1/servers/1a71ee0e-ffa8-4730-b4fb-8b6e9fd87239 => generated 1521 bytes in 1494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:09.183275 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-a9fb4063-560a-4b25-9ae1-98957be35f4e tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Calling method '.version_select at 0x7fb227d5d700>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:09.289338 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-a9fb4063-560a-4b25-9ae1-98957be35f4e tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] 10.222.0.43 "GET /compute/v2.1/images/e4d3e808-f1b4-4480-90f6-79b6d4964f47" status: 200 len: 1455 microversion: 2.1 time: 0.114925 Oct 04 18:40:09.299464 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1093/2344] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 18:40:09 2022] GET /compute/v2.1/images/e4d3e808-f1b4-4480-90f6-79b6d4964f47 => generated 1455 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:09.310569 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-116b6175-cc54-4d4f-8957-23668618f212 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:09.311443 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-116b6175-cc54-4d4f-8957-23668618f212 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] [instance: ffbbf357-494a-40e4-8943-3159707fc2e4] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:09.318751 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-116b6175-cc54-4d4f-8957-23668618f212 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:09.319440 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-116b6175-cc54-4d4f-8957-23668618f212 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:09.320191 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-116b6175-cc54-4d4f-8957-23668618f212 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:09.321076 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-116b6175-cc54-4d4f-8957-23668618f212 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:09.321805 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-116b6175-cc54-4d4f-8957-23668618f212 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:09.322954 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-116b6175-cc54-4d4f-8957-23668618f212 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:09.513049 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-116b6175-cc54-4d4f-8957-23668618f212 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15432d1b74334e1188866004384befe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d562b670294a47b2171f4003be4cdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:09.527013 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-116b6175-cc54-4d4f-8957-23668618f212 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] 10.222.0.43 "GET /compute/v2.1/servers/ffbbf357-494a-40e4-8943-3159707fc2e4" status: 200 len: 1281 microversion: 2.1 time: 0.225471 Oct 04 18:40:09.529526 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1094/2345] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:09 2022] GET /compute/v2.1/servers/ffbbf357-494a-40e4-8943-3159707fc2e4 => generated 1281 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:09.548691 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-20f686da-24a3-4468-abdc-9867efd68524 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:09.553515 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-20f686da-24a3-4468-abdc-9867efd68524 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] [instance: b6474a49-d05d-4d2e-afef-cdbbe8c6d9aa] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:09.578684 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-20f686da-24a3-4468-abdc-9867efd68524 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:09.580175 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-20f686da-24a3-4468-abdc-9867efd68524 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:09.584073 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-20f686da-24a3-4468-abdc-9867efd68524 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:09.585897 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-20f686da-24a3-4468-abdc-9867efd68524 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:09.587955 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-20f686da-24a3-4468-abdc-9867efd68524 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:09.588959 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-20f686da-24a3-4468-abdc-9867efd68524 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:09.683537 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-20f686da-24a3-4468-abdc-9867efd68524 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] [instance: b6474a49-d05d-4d2e-afef-cdbbe8c6d9aa] Going to try to terminate instance {{(pid=123595) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:40:09.934060 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-20f686da-24a3-4468-abdc-9867efd68524 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] 10.222.0.43 "DELETE /compute/v2.1/servers/b6474a49-d05d-4d2e-afef-cdbbe8c6d9aa" status: 204 len: 0 microversion: 2.1 time: 0.399824 Oct 04 18:40:09.935633 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1095/2346] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 18:40:09 2022] DELETE /compute/v2.1/servers/b6474a49-d05d-4d2e-afef-cdbbe8c6d9aa => generated 0 bytes in 402 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:40:09.946485 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-14912ae2-b840-4bc8-ba31-d2c52ff78445 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:09.948462 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-14912ae2-b840-4bc8-ba31-d2c52ff78445 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] [instance: b53d822f-e7b1-498a-b98a-35f87839dfe8] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:09.963324 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-14912ae2-b840-4bc8-ba31-d2c52ff78445 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:09.966537 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-14912ae2-b840-4bc8-ba31-d2c52ff78445 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:09.967014 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-14912ae2-b840-4bc8-ba31-d2c52ff78445 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:09.967751 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-14912ae2-b840-4bc8-ba31-d2c52ff78445 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:09.968207 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-14912ae2-b840-4bc8-ba31-d2c52ff78445 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:09.973175 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-14912ae2-b840-4bc8-ba31-d2c52ff78445 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:10.208218 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-14912ae2-b840-4bc8-ba31-d2c52ff78445 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e1add2296c4ed5830c5d90ef272ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fdc44ceeb041bcba1be2fcc2084aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:10.226679 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-14912ae2-b840-4bc8-ba31-d2c52ff78445 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59e1add2296c4ed5830c5d90ef272ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fdc44ceeb041bcba1be2fcc2084aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:10.228282 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-14912ae2-b840-4bc8-ba31-d2c52ff78445 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59e1add2296c4ed5830c5d90ef272ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fdc44ceeb041bcba1be2fcc2084aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:10.229641 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-14912ae2-b840-4bc8-ba31-d2c52ff78445 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] 10.222.0.43 "GET /compute/v2.1/servers/b53d822f-e7b1-498a-b98a-35f87839dfe8" status: 200 len: 1409 microversion: 2.54 time: 0.292344 Oct 04 18:40:10.236376 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1096/2347] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:40:09 2022] GET /compute/v2.1/servers/b53d822f-e7b1-498a-b98a-35f87839dfe8 => generated 1409 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:40:10.245431 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-ec33222d-0b4b-40d8-9163-5c44699129e2 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:10.246078 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-ec33222d-0b4b-40d8-9163-5c44699129e2 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] [instance: b6474a49-d05d-4d2e-afef-cdbbe8c6d9aa] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:10.259852 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ec33222d-0b4b-40d8-9163-5c44699129e2 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:10.260366 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ec33222d-0b4b-40d8-9163-5c44699129e2 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:10.260811 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ec33222d-0b4b-40d8-9163-5c44699129e2 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:10.265630 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ec33222d-0b4b-40d8-9163-5c44699129e2 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:10.266139 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ec33222d-0b4b-40d8-9163-5c44699129e2 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:10.266562 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ec33222d-0b4b-40d8-9163-5c44699129e2 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:10.479587 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-ed5f0136-30f5-4c7b-aaca-d54140f03e34 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:10.505919 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-ed5f0136-30f5-4c7b-aaca-d54140f03e34 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/d9d4332a-97b6-40f1-bd7c-a9a75a9adc43" status: 200 len: 1542 microversion: 2.1 time: 1.388266 Oct 04 18:40:10.506591 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1252/2348] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:09 2022] GET /compute/v2.1/servers/d9d4332a-97b6-40f1-bd7c-a9a75a9adc43 => generated 1542 bytes in 1390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:10.521224 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-c54e9382-b268-4b20-9915-590e7bfa3003 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:10.526988 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-c54e9382-b268-4b20-9915-590e7bfa3003 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] [instance: 1a71ee0e-ffa8-4730-b4fb-8b6e9fd87239] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:10.544798 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c54e9382-b268-4b20-9915-590e7bfa3003 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:10.545596 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c54e9382-b268-4b20-9915-590e7bfa3003 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:10.546281 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c54e9382-b268-4b20-9915-590e7bfa3003 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:10.551912 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c54e9382-b268-4b20-9915-590e7bfa3003 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:10.552544 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c54e9382-b268-4b20-9915-590e7bfa3003 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:10.553376 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c54e9382-b268-4b20-9915-590e7bfa3003 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:10.874263 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-c54e9382-b268-4b20-9915-590e7bfa3003 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a19da94e9e646028a7f73f9d0e0edda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc41f296eb44503868205ec8aa2fef3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:10.890365 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-c54e9382-b268-4b20-9915-590e7bfa3003 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] 10.222.0.43 "GET /compute/v2.1/servers/1a71ee0e-ffa8-4730-b4fb-8b6e9fd87239" status: 200 len: 1521 microversion: 2.1 time: 0.376156 Oct 04 18:40:10.906196 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1253/2349] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:10 2022] GET /compute/v2.1/servers/1a71ee0e-ffa8-4730-b4fb-8b6e9fd87239 => generated 1521 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:10.917520 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-ec33222d-0b4b-40d8-9163-5c44699129e2 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c96ec8b8e0a4053b0457f213e6e262d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b812c85494a49898376a0dd8140f03c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:10.926946 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-ec33222d-0b4b-40d8-9163-5c44699129e2 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] 10.222.0.43 "GET /compute/v2.1/servers/b6474a49-d05d-4d2e-afef-cdbbe8c6d9aa" status: 200 len: 1647 microversion: 2.1 time: 0.689483 Oct 04 18:40:10.935626 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1097/2350] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:10 2022] GET /compute/v2.1/servers/b6474a49-d05d-4d2e-afef-cdbbe8c6d9aa => generated 1647 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:10.938828 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-c05e211d-6a73-47cf-af47-e051bac8c9bc tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Calling method '.version_select at 0x7fb21edfc820>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:10.951394 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-8369ed0e-25f2-4865-8b61-9a2b1b12897e tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:10.957272 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-8369ed0e-25f2-4865-8b61-9a2b1b12897e tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] [instance: ffbbf357-494a-40e4-8943-3159707fc2e4] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:11.002612 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8369ed0e-25f2-4865-8b61-9a2b1b12897e tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:11.003414 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8369ed0e-25f2-4865-8b61-9a2b1b12897e tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:11.005379 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8369ed0e-25f2-4865-8b61-9a2b1b12897e tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:11.008025 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8369ed0e-25f2-4865-8b61-9a2b1b12897e tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:11.016195 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8369ed0e-25f2-4865-8b61-9a2b1b12897e tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:11.017924 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8369ed0e-25f2-4865-8b61-9a2b1b12897e tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:11.053395 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-c05e211d-6a73-47cf-af47-e051bac8c9bc tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] 10.222.0.43 "GET /compute/v2.1/images/e4d3e808-f1b4-4480-90f6-79b6d4964f47" status: 200 len: 1455 microversion: 2.1 time: 0.145746 Oct 04 18:40:11.065307 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1254/2351] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 18:40:10 2022] GET /compute/v2.1/images/e4d3e808-f1b4-4480-90f6-79b6d4964f47 => generated 1455 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:11.260207 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-17bde4f6-31ac-4e73-aaa6-0aae87aff75f tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:11.261138 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-17bde4f6-31ac-4e73-aaa6-0aae87aff75f tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] [instance: b53d822f-e7b1-498a-b98a-35f87839dfe8] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:11.295057 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-17bde4f6-31ac-4e73-aaa6-0aae87aff75f tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:11.296204 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-17bde4f6-31ac-4e73-aaa6-0aae87aff75f tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:11.303238 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-17bde4f6-31ac-4e73-aaa6-0aae87aff75f tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:11.306829 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-17bde4f6-31ac-4e73-aaa6-0aae87aff75f tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:11.307460 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-17bde4f6-31ac-4e73-aaa6-0aae87aff75f tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:11.309224 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-17bde4f6-31ac-4e73-aaa6-0aae87aff75f tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:11.362798 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=100 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:40:11.463447 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-17bde4f6-31ac-4e73-aaa6-0aae87aff75f tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e1add2296c4ed5830c5d90ef272ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fdc44ceeb041bcba1be2fcc2084aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:11.485741 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-17bde4f6-31ac-4e73-aaa6-0aae87aff75f tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59e1add2296c4ed5830c5d90ef272ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fdc44ceeb041bcba1be2fcc2084aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:11.489716 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-17bde4f6-31ac-4e73-aaa6-0aae87aff75f tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59e1add2296c4ed5830c5d90ef272ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fdc44ceeb041bcba1be2fcc2084aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:11.504682 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-17bde4f6-31ac-4e73-aaa6-0aae87aff75f tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] 10.222.0.43 "GET /compute/v2.1/servers/b53d822f-e7b1-498a-b98a-35f87839dfe8" status: 200 len: 1409 microversion: 2.54 time: 0.248663 Oct 04 18:40:11.505312 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1255/2352] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:40:11 2022] GET /compute/v2.1/servers/b53d822f-e7b1-498a-b98a-35f87839dfe8 => generated 1409 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:40:11.536902 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-9a662650-104e-43e5-9767-d5f6d4d6b1f7 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:11.537594 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-9a662650-104e-43e5-9767-d5f6d4d6b1f7 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: d9d4332a-97b6-40f1-bd7c-a9a75a9adc43] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:11.550258 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-8369ed0e-25f2-4865-8b61-9a2b1b12897e tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15432d1b74334e1188866004384befe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d562b670294a47b2171f4003be4cdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:11.551998 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9a662650-104e-43e5-9767-d5f6d4d6b1f7 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:11.552512 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9a662650-104e-43e5-9767-d5f6d4d6b1f7 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:11.552965 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9a662650-104e-43e5-9767-d5f6d4d6b1f7 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:11.553727 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9a662650-104e-43e5-9767-d5f6d4d6b1f7 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:11.554190 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9a662650-104e-43e5-9767-d5f6d4d6b1f7 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:11.554642 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9a662650-104e-43e5-9767-d5f6d4d6b1f7 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:11.563809 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-8369ed0e-25f2-4865-8b61-9a2b1b12897e tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] 10.222.0.43 "GET /compute/v2.1/servers/ffbbf357-494a-40e4-8943-3159707fc2e4" status: 200 len: 1323 microversion: 2.1 time: 0.625602 Oct 04 18:40:11.565587 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1098/2353] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:10 2022] GET /compute/v2.1/servers/ffbbf357-494a-40e4-8943-3159707fc2e4 => generated 1323 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:11.921453 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-03b2f55e-64ef-4bda-a436-4481965c7881 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:11.923118 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-03b2f55e-64ef-4bda-a436-4481965c7881 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] [instance: 1a71ee0e-ffa8-4730-b4fb-8b6e9fd87239] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:11.945312 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-03b2f55e-64ef-4bda-a436-4481965c7881 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:11.945987 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-03b2f55e-64ef-4bda-a436-4481965c7881 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:11.948315 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-03b2f55e-64ef-4bda-a436-4481965c7881 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:11.950146 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-03b2f55e-64ef-4bda-a436-4481965c7881 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:11.950890 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-03b2f55e-64ef-4bda-a436-4481965c7881 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:11.952278 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-03b2f55e-64ef-4bda-a436-4481965c7881 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:12.138729 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-9a662650-104e-43e5-9767-d5f6d4d6b1f7 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:12.147773 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-9a662650-104e-43e5-9767-d5f6d4d6b1f7 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/d9d4332a-97b6-40f1-bd7c-a9a75a9adc43" status: 200 len: 1542 microversion: 2.1 time: 0.616705 Oct 04 18:40:12.149101 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1256/2354] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:11 2022] GET /compute/v2.1/servers/d9d4332a-97b6-40f1-bd7c-a9a75a9adc43 => generated 1542 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:40:12.166623 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-045065e6-b72a-42e3-9f8f-1f19c118b702 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:12.168001 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-045065e6-b72a-42e3-9f8f-1f19c118b702 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] [instance: b6474a49-d05d-4d2e-afef-cdbbe8c6d9aa] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:12.192532 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-045065e6-b72a-42e3-9f8f-1f19c118b702 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:12.195400 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-045065e6-b72a-42e3-9f8f-1f19c118b702 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:12.198244 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-045065e6-b72a-42e3-9f8f-1f19c118b702 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:12.205783 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-045065e6-b72a-42e3-9f8f-1f19c118b702 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:12.209756 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-045065e6-b72a-42e3-9f8f-1f19c118b702 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:12.210242 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-045065e6-b72a-42e3-9f8f-1f19c118b702 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:12.381913 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-03b2f55e-64ef-4bda-a436-4481965c7881 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a19da94e9e646028a7f73f9d0e0edda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc41f296eb44503868205ec8aa2fef3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:12.398119 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-03b2f55e-64ef-4bda-a436-4481965c7881 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] 10.222.0.43 "GET /compute/v2.1/servers/1a71ee0e-ffa8-4730-b4fb-8b6e9fd87239" status: 200 len: 1521 microversion: 2.1 time: 0.482523 Oct 04 18:40:12.398742 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1099/2355] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:11 2022] GET /compute/v2.1/servers/1a71ee0e-ffa8-4730-b4fb-8b6e9fd87239 => generated 1521 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:40:12.403866 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-e4b2879c-ffb0-4a22-b03e-c54df67d18b4 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Calling method '.version_select at 0x7fb21f99d430>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:12.500733 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-e4b2879c-ffb0-4a22-b03e-c54df67d18b4 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] 10.222.0.43 "GET /compute/v2.1/images/e4d3e808-f1b4-4480-90f6-79b6d4964f47" status: 200 len: 1455 microversion: 2.1 time: 0.100749 Oct 04 18:40:12.501358 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1100/2356] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 18:40:12 2022] GET /compute/v2.1/images/e4d3e808-f1b4-4480-90f6-79b6d4964f47 => generated 1455 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:12.535684 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-633fcea6-b2db-4a7d-b3ff-98d24b8fdf86 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:12.536313 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-633fcea6-b2db-4a7d-b3ff-98d24b8fdf86 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] [instance: b53d822f-e7b1-498a-b98a-35f87839dfe8] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:12.558058 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-633fcea6-b2db-4a7d-b3ff-98d24b8fdf86 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:12.558684 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-633fcea6-b2db-4a7d-b3ff-98d24b8fdf86 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:12.559468 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-633fcea6-b2db-4a7d-b3ff-98d24b8fdf86 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:12.559730 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-633fcea6-b2db-4a7d-b3ff-98d24b8fdf86 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:12.560194 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-633fcea6-b2db-4a7d-b3ff-98d24b8fdf86 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:12.560707 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-633fcea6-b2db-4a7d-b3ff-98d24b8fdf86 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:12.912908 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-045065e6-b72a-42e3-9f8f-1f19c118b702 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c96ec8b8e0a4053b0457f213e6e262d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b812c85494a49898376a0dd8140f03c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:12.921707 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-633fcea6-b2db-4a7d-b3ff-98d24b8fdf86 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e1add2296c4ed5830c5d90ef272ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fdc44ceeb041bcba1be2fcc2084aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:12.937648 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-633fcea6-b2db-4a7d-b3ff-98d24b8fdf86 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59e1add2296c4ed5830c5d90ef272ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fdc44ceeb041bcba1be2fcc2084aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:12.938417 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-045065e6-b72a-42e3-9f8f-1f19c118b702 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] 10.222.0.43 "GET /compute/v2.1/servers/b6474a49-d05d-4d2e-afef-cdbbe8c6d9aa" status: 200 len: 1647 microversion: 2.1 time: 0.787776 Oct 04 18:40:12.939035 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1257/2357] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:12 2022] GET /compute/v2.1/servers/b6474a49-d05d-4d2e-afef-cdbbe8c6d9aa => generated 1647 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:12.943531 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-633fcea6-b2db-4a7d-b3ff-98d24b8fdf86 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59e1add2296c4ed5830c5d90ef272ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fdc44ceeb041bcba1be2fcc2084aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:12.946624 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-633fcea6-b2db-4a7d-b3ff-98d24b8fdf86 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] 10.222.0.43 "GET /compute/v2.1/servers/b53d822f-e7b1-498a-b98a-35f87839dfe8" status: 200 len: 1409 microversion: 2.54 time: 0.414914 Oct 04 18:40:12.952121 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-b5a54258-6e72-40df-938e-3f06c227d3f4 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:12.953002 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-b5a54258-6e72-40df-938e-3f06c227d3f4 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] [instance: ffbbf357-494a-40e4-8943-3159707fc2e4] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:12.964645 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1101/2358] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:40:12 2022] GET /compute/v2.1/servers/b53d822f-e7b1-498a-b98a-35f87839dfe8 => generated 1409 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:40:12.981817 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b5a54258-6e72-40df-938e-3f06c227d3f4 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:12.991069 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b5a54258-6e72-40df-938e-3f06c227d3f4 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:12.991706 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b5a54258-6e72-40df-938e-3f06c227d3f4 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:12.992662 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b5a54258-6e72-40df-938e-3f06c227d3f4 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:12.993310 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b5a54258-6e72-40df-938e-3f06c227d3f4 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:12.996113 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b5a54258-6e72-40df-938e-3f06c227d3f4 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:13.174138 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-effd9be6-5f8a-4b58-b77e-a5f88c89d51c tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:13.175092 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-effd9be6-5f8a-4b58-b77e-a5f88c89d51c tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: d9d4332a-97b6-40f1-bd7c-a9a75a9adc43] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:13.184814 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:40:13.189555 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-effd9be6-5f8a-4b58-b77e-a5f88c89d51c tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:13.193012 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-effd9be6-5f8a-4b58-b77e-a5f88c89d51c tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:13.193892 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-effd9be6-5f8a-4b58-b77e-a5f88c89d51c tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:13.216804 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-effd9be6-5f8a-4b58-b77e-a5f88c89d51c tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:13.217588 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-effd9be6-5f8a-4b58-b77e-a5f88c89d51c tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:13.218857 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-effd9be6-5f8a-4b58-b77e-a5f88c89d51c tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:13.271365 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-b5a54258-6e72-40df-938e-3f06c227d3f4 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15432d1b74334e1188866004384befe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d562b670294a47b2171f4003be4cdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:13.280337 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-b5a54258-6e72-40df-938e-3f06c227d3f4 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] 10.222.0.43 "GET /compute/v2.1/servers/ffbbf357-494a-40e4-8943-3159707fc2e4" status: 200 len: 1323 microversion: 2.1 time: 0.335462 Oct 04 18:40:13.293140 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1258/2359] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:12 2022] GET /compute/v2.1/servers/ffbbf357-494a-40e4-8943-3159707fc2e4 => generated 1323 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:13.424860 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-d99ee59e-ac6d-49ff-8b0b-3b4679470d69 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:13.428705 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-d99ee59e-ac6d-49ff-8b0b-3b4679470d69 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] [instance: 1a71ee0e-ffa8-4730-b4fb-8b6e9fd87239] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:13.448290 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:40:13.458845 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d99ee59e-ac6d-49ff-8b0b-3b4679470d69 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:13.459389 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d99ee59e-ac6d-49ff-8b0b-3b4679470d69 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:13.459861 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d99ee59e-ac6d-49ff-8b0b-3b4679470d69 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:13.460681 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d99ee59e-ac6d-49ff-8b0b-3b4679470d69 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:13.461361 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d99ee59e-ac6d-49ff-8b0b-3b4679470d69 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:13.461946 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d99ee59e-ac6d-49ff-8b0b-3b4679470d69 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:13.604323 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=2 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:40:13.716673 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=24 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:40:13.898596 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-d99ee59e-ac6d-49ff-8b0b-3b4679470d69 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a19da94e9e646028a7f73f9d0e0edda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc41f296eb44503868205ec8aa2fef3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:13.925502 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-d99ee59e-ac6d-49ff-8b0b-3b4679470d69 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] 10.222.0.43 "GET /compute/v2.1/servers/1a71ee0e-ffa8-4730-b4fb-8b6e9fd87239" status: 200 len: 1521 microversion: 2.1 time: 0.504524 Oct 04 18:40:13.926114 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1259/2360] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:13 2022] GET /compute/v2.1/servers/1a71ee0e-ffa8-4730-b4fb-8b6e9fd87239 => generated 1521 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:13.955763 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-0aa0326b-6833-48ca-98a3-10bcd565408f tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Calling method '.version_select at 0x7fb21edef790>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:14.039650 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-0aa0326b-6833-48ca-98a3-10bcd565408f tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] 10.222.0.43 "GET /compute/v2.1/images/e4d3e808-f1b4-4480-90f6-79b6d4964f47" status: 200 len: 1455 microversion: 2.1 time: 0.099991 Oct 04 18:40:14.040239 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1260/2361] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 18:40:13 2022] GET /compute/v2.1/images/e4d3e808-f1b4-4480-90f6-79b6d4964f47 => generated 1455 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:14.048899 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-8a131b1c-cec9-45bb-84c3-2cafb4187268 req-542f1c91-9311-48ba-ac81-77c1608ca9cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6474a49-d05d-4d2e-afef-cdbbe8c6d9aa", "name": "network-vif-deleted", "tag": "983dac01-7966-45d6-9bba-c9843044df16"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:40:14.070685 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-8a131b1c-cec9-45bb-84c3-2cafb4187268 req-542f1c91-9311-48ba-ac81-77c1608ca9cd service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:14.071668 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-8a131b1c-cec9-45bb-84c3-2cafb4187268 req-542f1c91-9311-48ba-ac81-77c1608ca9cd service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:14.080370 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-8a131b1c-cec9-45bb-84c3-2cafb4187268 req-542f1c91-9311-48ba-ac81-77c1608ca9cd service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:14.100778 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=2 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:40:14.128753 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-effd9be6-5f8a-4b58-b77e-a5f88c89d51c tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:14.138937 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-effd9be6-5f8a-4b58-b77e-a5f88c89d51c tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/d9d4332a-97b6-40f1-bd7c-a9a75a9adc43" status: 200 len: 1542 microversion: 2.1 time: 0.969168 Oct 04 18:40:14.153794 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1102/2362] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:13 2022] GET /compute/v2.1/servers/d9d4332a-97b6-40f1-bd7c-a9a75a9adc43 => generated 1542 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:14.162503 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-8a131b1c-cec9-45bb-84c3-2cafb4187268 req-542f1c91-9311-48ba-ac81-77c1608ca9cd service nova] Creating event network-vif-deleted:983dac01-7966-45d6-9bba-c9843044df16 for instance b6474a49-d05d-4d2e-afef-cdbbe8c6d9aa on n-h2-851028-13 Oct 04 18:40:14.171020 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-6fcb982b-3f1f-4563-b6cc-4886dc0520aa tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:14.171209 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-8a131b1c-cec9-45bb-84c3-2cafb4187268 req-542f1c91-9311-48ba-ac81-77c1608ca9cd service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125119 Oct 04 18:40:14.171700 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-6fcb982b-3f1f-4563-b6cc-4886dc0520aa tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] [instance: b6474a49-d05d-4d2e-afef-cdbbe8c6d9aa] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:14.172094 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1261/2363] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:40:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:40:14.178445 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-6a642f97-5499-4e25-92e6-81d59232e80d tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:14.179444 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-6a642f97-5499-4e25-92e6-81d59232e80d tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] [instance: b53d822f-e7b1-498a-b98a-35f87839dfe8] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:14.194206 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6a642f97-5499-4e25-92e6-81d59232e80d tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:14.198340 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6fcb982b-3f1f-4563-b6cc-4886dc0520aa tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:14.198853 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6fcb982b-3f1f-4563-b6cc-4886dc0520aa tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:14.199316 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6fcb982b-3f1f-4563-b6cc-4886dc0520aa tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:14.202989 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6a642f97-5499-4e25-92e6-81d59232e80d tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:14.204273 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6fcb982b-3f1f-4563-b6cc-4886dc0520aa tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:14.206520 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6a642f97-5499-4e25-92e6-81d59232e80d tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:14.207899 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6fcb982b-3f1f-4563-b6cc-4886dc0520aa tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:14.208421 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6fcb982b-3f1f-4563-b6cc-4886dc0520aa tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:14.209217 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6a642f97-5499-4e25-92e6-81d59232e80d tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:14.212980 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6a642f97-5499-4e25-92e6-81d59232e80d tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:14.217710 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6a642f97-5499-4e25-92e6-81d59232e80d tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:14.335905 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6fcb982b-3f1f-4563-b6cc-4886dc0520aa tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:14.336435 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6fcb982b-3f1f-4563-b6cc-4886dc0520aa tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:14.336890 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6fcb982b-3f1f-4563-b6cc-4886dc0520aa tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:14.337419 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.objects.instance [None req-6fcb982b-3f1f-4563-b6cc-4886dc0520aa tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Lazy-loading 'fault' on Instance uuid b6474a49-d05d-4d2e-afef-cdbbe8c6d9aa {{(pid=123595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:40:14.493478 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-6a642f97-5499-4e25-92e6-81d59232e80d tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e1add2296c4ed5830c5d90ef272ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fdc44ceeb041bcba1be2fcc2084aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:14.499291 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-6fcb982b-3f1f-4563-b6cc-4886dc0520aa tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c96ec8b8e0a4053b0457f213e6e262d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b812c85494a49898376a0dd8140f03c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:14.508654 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-6fcb982b-3f1f-4563-b6cc-4886dc0520aa tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] 10.222.0.43 "GET /compute/v2.1/servers/b6474a49-d05d-4d2e-afef-cdbbe8c6d9aa" status: 200 len: 1306 microversion: 2.1 time: 0.353678 Oct 04 18:40:14.508814 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-6a642f97-5499-4e25-92e6-81d59232e80d tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59e1add2296c4ed5830c5d90ef272ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fdc44ceeb041bcba1be2fcc2084aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:14.509490 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1103/2364] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:14 2022] GET /compute/v2.1/servers/b6474a49-d05d-4d2e-afef-cdbbe8c6d9aa => generated 1306 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:14.511985 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-6a642f97-5499-4e25-92e6-81d59232e80d tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59e1add2296c4ed5830c5d90ef272ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fdc44ceeb041bcba1be2fcc2084aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:14.516244 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-6a642f97-5499-4e25-92e6-81d59232e80d tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] 10.222.0.43 "GET /compute/v2.1/servers/b53d822f-e7b1-498a-b98a-35f87839dfe8" status: 200 len: 1409 microversion: 2.54 time: 0.342368 Oct 04 18:40:14.518646 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-232ce3cd-8111-41a0-aefd-cc4b97adbe61 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:14.519277 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-232ce3cd-8111-41a0-aefd-cc4b97adbe61 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] [instance: ffbbf357-494a-40e4-8943-3159707fc2e4] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:14.531298 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1262/2365] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:40:14 2022] GET /compute/v2.1/servers/b53d822f-e7b1-498a-b98a-35f87839dfe8 => generated 1409 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:40:14.565832 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-232ce3cd-8111-41a0-aefd-cc4b97adbe61 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:14.565832 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-232ce3cd-8111-41a0-aefd-cc4b97adbe61 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:14.565832 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-232ce3cd-8111-41a0-aefd-cc4b97adbe61 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:14.565832 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-232ce3cd-8111-41a0-aefd-cc4b97adbe61 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:14.568970 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-232ce3cd-8111-41a0-aefd-cc4b97adbe61 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:14.568970 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-232ce3cd-8111-41a0-aefd-cc4b97adbe61 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:14.961458 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-48350415-bdc8-4c6f-aa7b-58782a8abd11 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:14.962148 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-48350415-bdc8-4c6f-aa7b-58782a8abd11 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] [instance: 1a71ee0e-ffa8-4730-b4fb-8b6e9fd87239] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:14.983454 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-48350415-bdc8-4c6f-aa7b-58782a8abd11 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:14.984858 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-48350415-bdc8-4c6f-aa7b-58782a8abd11 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:14.986156 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-48350415-bdc8-4c6f-aa7b-58782a8abd11 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:14.987693 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-48350415-bdc8-4c6f-aa7b-58782a8abd11 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:14.994936 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-48350415-bdc8-4c6f-aa7b-58782a8abd11 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:14.995395 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-48350415-bdc8-4c6f-aa7b-58782a8abd11 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:15.216290 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-232ce3cd-8111-41a0-aefd-cc4b97adbe61 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15432d1b74334e1188866004384befe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d562b670294a47b2171f4003be4cdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:15.232385 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-232ce3cd-8111-41a0-aefd-cc4b97adbe61 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] 10.222.0.43 "GET /compute/v2.1/servers/ffbbf357-494a-40e4-8943-3159707fc2e4" status: 200 len: 1323 microversion: 2.1 time: 0.721971 Oct 04 18:40:15.238337 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1104/2366] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:14 2022] GET /compute/v2.1/servers/ffbbf357-494a-40e4-8943-3159707fc2e4 => generated 1323 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:15.251959 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-f108d96b-ccd7-4de8-b905-2be3e28ceb8e tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Calling method '.version_select at 0x7fb21fc54f70>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:15.318161 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-f108d96b-ccd7-4de8-b905-2be3e28ceb8e tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] 10.222.0.43 "GET /compute/v2.1/images/e4d3e808-f1b4-4480-90f6-79b6d4964f47" status: 200 len: 1455 microversion: 2.1 time: 0.078638 Oct 04 18:40:15.318771 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1105/2367] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 18:40:15 2022] GET /compute/v2.1/images/e4d3e808-f1b4-4480-90f6-79b6d4964f47 => generated 1455 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:15.343163 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-20825c56-df9b-4600-a35e-fc3cf149fc04 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:15.344029 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-20825c56-df9b-4600-a35e-fc3cf149fc04 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: d9d4332a-97b6-40f1-bd7c-a9a75a9adc43] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:15.355339 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-20825c56-df9b-4600-a35e-fc3cf149fc04 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:15.362895 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-20825c56-df9b-4600-a35e-fc3cf149fc04 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:15.364639 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-20825c56-df9b-4600-a35e-fc3cf149fc04 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:15.365609 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-20825c56-df9b-4600-a35e-fc3cf149fc04 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:15.366255 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-20825c56-df9b-4600-a35e-fc3cf149fc04 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:15.366914 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-20825c56-df9b-4600-a35e-fc3cf149fc04 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:15.436035 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:40:15.590444 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-48350415-bdc8-4c6f-aa7b-58782a8abd11 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a19da94e9e646028a7f73f9d0e0edda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc41f296eb44503868205ec8aa2fef3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:15.601866 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-48350415-bdc8-4c6f-aa7b-58782a8abd11 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] 10.222.0.43 "GET /compute/v2.1/servers/1a71ee0e-ffa8-4730-b4fb-8b6e9fd87239" status: 200 len: 1521 microversion: 2.1 time: 0.650166 Oct 04 18:40:15.602738 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1263/2368] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:14 2022] GET /compute/v2.1/servers/1a71ee0e-ffa8-4730-b4fb-8b6e9fd87239 => generated 1521 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:15.613700 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-9037231c-3430-475b-968b-1e245e948e7f tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:15.616982 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-9037231c-3430-475b-968b-1e245e948e7f tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] [instance: b6474a49-d05d-4d2e-afef-cdbbe8c6d9aa] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:15.651134 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9037231c-3430-475b-968b-1e245e948e7f tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:15.651743 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9037231c-3430-475b-968b-1e245e948e7f tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:15.652446 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9037231c-3430-475b-968b-1e245e948e7f tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:15.653450 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9037231c-3430-475b-968b-1e245e948e7f tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:15.654063 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9037231c-3430-475b-968b-1e245e948e7f tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:15.655208 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9037231c-3430-475b-968b-1e245e948e7f tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:15.675592 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-20825c56-df9b-4600-a35e-fc3cf149fc04 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:15.689852 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-20825c56-df9b-4600-a35e-fc3cf149fc04 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/d9d4332a-97b6-40f1-bd7c-a9a75a9adc43" status: 200 len: 1542 microversion: 2.1 time: 0.361468 Oct 04 18:40:15.694641 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-9037231c-3430-475b-968b-1e245e948e7f tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] HTTP exception thrown: Instance b6474a49-d05d-4d2e-afef-cdbbe8c6d9aa could not be found. Oct 04 18:40:15.696646 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-9037231c-3430-475b-968b-1e245e948e7f tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Request method failure captured: Oct 04 18:40:15.696646 n-d-851028-13 devstack@n-api.service[123596]: request: GET /compute/v2.1/servers/b6474a49-d05d-4d2e-afef-cdbbe8c6d9aa HTTP/1.1 Oct 04 18:40:15.696646 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:40:15.696646 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:40:15.696646 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:40:15.696646 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 18:40:15.696646 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:40:15.696646 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:40:15.696646 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:40:15.696646 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:40:15.696646 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPH2qE2WsiZvVd-vvN1M8uHJG40fIXDT1XURP-P4ciVfKnbP_2tplzYndj2wlvB6bSu_VMaD1xfU0nGHRYWQRmNIt_krh_S1n2RkrhietTC0-RnvJ1rzF8ilPx8zowbVefo7A8IyDn5QTaMC08kHUNyiYinJQT_Q7n9enahWrBitVOPM Oct 04 18:40:15.696646 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:40:15.696646 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:40:15.696646 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:40:15.696646 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:40:15.696646 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:40:15.696646 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:40:15.696646 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: 7b812c85494a49898376a0dd8140f03c Oct 04 18:40:15.696646 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-SecurityGroupsTestJSON-209295605 Oct 04 18:40:15.696646 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 18:40:15.696646 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 18:40:15.696646 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/7b812c85494a49898376a0dd8140f03c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_7b812c85494a49898376a0dd8140f03c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/7b812c85494a49898376a0dd8140f03c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/7b812c85494a49898376a0dd8140f03c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:40:15.696646 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-SecurityGroupsTestJSON-209295605 Oct 04 18:40:15.696646 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: 7b812c85494a49898376a0dd8140f03c Oct 04 18:40:15.696646 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-209295605 Oct 04 18:40:15.696646 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-SecurityGroupsTestJSON-209295605-project Oct 04 18:40:15.696646 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:40:15.696646 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:40:15.696646 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 5c96ec8b8e0a4053b0457f213e6e262d Oct 04 18:40:15.696646 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-SecurityGroupsTestJSON-209295605-project Oct 04 18:40:15.696646 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 18:40:15.696646 n-d-851028-13 devstack@n-api.service[123596]: exception: Instance b6474a49-d05d-4d2e-afef-cdbbe8c6d9aa could not be found. Oct 04 18:40:15.696646 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': 'b6474a49-d05d-4d2e-afef-cdbbe8c6d9aa'} Oct 04 18:40:15.696646 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:40:15.696646 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:40:15.696646 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:40:15.696646 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:40:15.696646 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:40:15.696646 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:40:15.696646 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:40:15.696646 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:40:15.696646 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:40:15.696646 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:40:15.696646 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6474a49-d05d-4d2e-afef-cdbbe8c6d9aa could not be found. Oct 04 18:40:15.696646 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:40:15.696646 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:40:15.696646 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:40:15.696646 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:40:15.696646 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:40:15.696646 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:40:15.696646 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:40:15.696646 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:40:15.696646 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:40:15.696646 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:40:15.696646 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:40:15.696646 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:40:15.696646 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:40:15.696646 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:40:15.696646 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:40:15.696646 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:40:15.696646 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6474a49-d05d-4d2e-afef-cdbbe8c6d9aa could not be found. Oct 04 18:40:15.696646 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:40:15.696646 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:40:15.696646 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:40:15.700655 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:40:15.700655 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:40:15.700655 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:40:15.700655 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:40:15.700655 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:40:15.700655 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6474a49-d05d-4d2e-afef-cdbbe8c6d9aa could not be found. Oct 04 18:40:15.700655 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:40:15.706283 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-9037231c-3430-475b-968b-1e245e948e7f tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Returning 404 to user: Instance b6474a49-d05d-4d2e-afef-cdbbe8c6d9aa could not be found. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:40:15.707479 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-9037231c-3430-475b-968b-1e245e948e7f tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] 10.222.0.43 "GET /compute/v2.1/servers/b6474a49-d05d-4d2e-afef-cdbbe8c6d9aa" status: 404 len: 111 microversion: 2.1 time: 0.102917 Oct 04 18:40:15.708320 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1264/2370] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:15 2022] GET /compute/v2.1/servers/b6474a49-d05d-4d2e-afef-cdbbe8c6d9aa => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:40:15.708714 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1106/2370] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:15 2022] GET /compute/v2.1/servers/d9d4332a-97b6-40f1-bd7c-a9a75a9adc43 => generated 1542 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:15.718509 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-80a89f96-5e59-4b23-a53c-b7f7127f8839 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:15.719523 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-80a89f96-5e59-4b23-a53c-b7f7127f8839 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] [instance: b53d822f-e7b1-498a-b98a-35f87839dfe8] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:15.723012 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-19ae7575-9fae-4198-b3ed-23ddb0741c5a tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Calling method '.version_select at 0x7fb21fa8a940>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:15.726794 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-80a89f96-5e59-4b23-a53c-b7f7127f8839 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:15.727651 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-80a89f96-5e59-4b23-a53c-b7f7127f8839 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:15.728907 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-80a89f96-5e59-4b23-a53c-b7f7127f8839 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:15.730644 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-80a89f96-5e59-4b23-a53c-b7f7127f8839 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:15.731380 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-80a89f96-5e59-4b23-a53c-b7f7127f8839 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:15.732626 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-80a89f96-5e59-4b23-a53c-b7f7127f8839 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:16.002682 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-80a89f96-5e59-4b23-a53c-b7f7127f8839 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e1add2296c4ed5830c5d90ef272ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fdc44ceeb041bcba1be2fcc2084aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:16.040455 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-80a89f96-5e59-4b23-a53c-b7f7127f8839 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59e1add2296c4ed5830c5d90ef272ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fdc44ceeb041bcba1be2fcc2084aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:16.054002 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-80a89f96-5e59-4b23-a53c-b7f7127f8839 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59e1add2296c4ed5830c5d90ef272ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fdc44ceeb041bcba1be2fcc2084aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:16.057397 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-80a89f96-5e59-4b23-a53c-b7f7127f8839 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] 10.222.0.43 "GET /compute/v2.1/servers/b53d822f-e7b1-498a-b98a-35f87839dfe8" status: 200 len: 1409 microversion: 2.54 time: 0.346166 Oct 04 18:40:16.059152 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1265/2371] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:40:15 2022] GET /compute/v2.1/servers/b53d822f-e7b1-498a-b98a-35f87839dfe8 => generated 1409 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:40:16.088549 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-ef3e93a3-82b3-4824-acd9-0b5918e95603 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:16.090130 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-ef3e93a3-82b3-4824-acd9-0b5918e95603 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] [instance: 7222a4ce-d2a2-4b09-afc6-55bca52414d4] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:16.112141 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ef3e93a3-82b3-4824-acd9-0b5918e95603 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:16.114322 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ef3e93a3-82b3-4824-acd9-0b5918e95603 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:16.120902 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ef3e93a3-82b3-4824-acd9-0b5918e95603 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:16.121838 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ef3e93a3-82b3-4824-acd9-0b5918e95603 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:16.122459 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ef3e93a3-82b3-4824-acd9-0b5918e95603 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:16.122988 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ef3e93a3-82b3-4824-acd9-0b5918e95603 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:16.178224 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-ef3e93a3-82b3-4824-acd9-0b5918e95603 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] [instance: 7222a4ce-d2a2-4b09-afc6-55bca52414d4] Going to try to terminate instance {{(pid=123596) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:40:16.209942 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-19ae7575-9fae-4198-b3ed-23ddb0741c5a tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] 10.222.0.43 "DELETE /compute/v2.1/os-security-groups/1b3ff7cc-e1a4-4a6b-a935-b44264658284" status: 202 len: 0 microversion: 2.1 time: 0.497170 Oct 04 18:40:16.211421 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1107/2372] 10.222.0.43 () {58 vars in 1272 bytes} [Tue Oct 4 18:40:15 2022] DELETE /compute/v2.1/os-security-groups/1b3ff7cc-e1a4-4a6b-a935-b44264658284 => generated 0 bytes in 499 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:40:16.218198 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-e02e7dc6-3571-4c81-a65b-a018bfbdc729 req-9a8456ad-381c-4708-b7a9-c7eb45ba9b0b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ffbbf357-494a-40e4-8943-3159707fc2e4", "tag": "61178b4f-ada9-4139-8cac-244778b3c3e5"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:40:16.251994 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-e02e7dc6-3571-4c81-a65b-a018bfbdc729 req-9a8456ad-381c-4708-b7a9-c7eb45ba9b0b service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:16.256747 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-e02e7dc6-3571-4c81-a65b-a018bfbdc729 req-9a8456ad-381c-4708-b7a9-c7eb45ba9b0b service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:16.258447 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-e02e7dc6-3571-4c81-a65b-a018bfbdc729 req-9a8456ad-381c-4708-b7a9-c7eb45ba9b0b service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:16.288546 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-e02e7dc6-3571-4c81-a65b-a018bfbdc729 req-9a8456ad-381c-4708-b7a9-c7eb45ba9b0b service nova] Creating event network-changed:61178b4f-ada9-4139-8cac-244778b3c3e5 for instance ffbbf357-494a-40e4-8943-3159707fc2e4 on n-h2-851028-13 Oct 04 18:40:16.304245 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-e02e7dc6-3571-4c81-a65b-a018bfbdc729 req-9a8456ad-381c-4708-b7a9-c7eb45ba9b0b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089310 Oct 04 18:40:16.307239 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1108/2373] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:40:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:40:16.318977 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-99c4a222-b04e-4298-829b-f16817ec6e8a tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Calling method '.version_select at 0x7fb21fd0a0d0>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:16.456997 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-ef3e93a3-82b3-4824-acd9-0b5918e95603 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] 10.222.0.43 "DELETE /compute/v2.1/servers/7222a4ce-d2a2-4b09-afc6-55bca52414d4" status: 204 len: 0 microversion: 2.25 time: 0.395614 Oct 04 18:40:16.458216 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1266/2374] 10.222.0.43 () {60 vars in 1280 bytes} [Tue Oct 4 18:40:16 2022] DELETE /compute/v2.1/servers/7222a4ce-d2a2-4b09-afc6-55bca52414d4 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 18:40:16.463528 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-fc743537-0c92-415d-9c76-3dd19206042a tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:16.464244 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-fc743537-0c92-415d-9c76-3dd19206042a tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] [instance: ffbbf357-494a-40e4-8943-3159707fc2e4] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:16.484110 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fc743537-0c92-415d-9c76-3dd19206042a tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:16.484784 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fc743537-0c92-415d-9c76-3dd19206042a tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:16.485343 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fc743537-0c92-415d-9c76-3dd19206042a tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:16.486109 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fc743537-0c92-415d-9c76-3dd19206042a tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:16.486581 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fc743537-0c92-415d-9c76-3dd19206042a tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:16.487022 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fc743537-0c92-415d-9c76-3dd19206042a tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:16.610785 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-99c4a222-b04e-4298-829b-f16817ec6e8a tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] 10.222.0.43 "DELETE /compute/v2.1/os-security-groups/18de9d4e-2ee8-4b41-8a08-e894ffbea260" status: 202 len: 0 microversion: 2.1 time: 0.301021 Oct 04 18:40:16.611933 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1109/2375] 10.222.0.43 () {58 vars in 1272 bytes} [Tue Oct 4 18:40:16 2022] DELETE /compute/v2.1/os-security-groups/18de9d4e-2ee8-4b41-8a08-e894ffbea260 => generated 0 bytes in 304 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:40:16.624784 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-3ac8a42a-1a95-46b0-90f8-96dc402cb670 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Calling method '.version_select at 0x7fb21f8f3790>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:16.741331 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-3ac8a42a-1a95-46b0-90f8-96dc402cb670 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] 10.222.0.43 "GET /compute/v2.1/images/e4d3e808-f1b4-4480-90f6-79b6d4964f47" status: 200 len: 1455 microversion: 2.1 time: 0.127712 Oct 04 18:40:16.743308 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1110/2376] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 18:40:16 2022] GET /compute/v2.1/images/e4d3e808-f1b4-4480-90f6-79b6d4964f47 => generated 1455 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:16.756775 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-9e12e8e2-8027-4ae2-b6fa-6355b8cc1e10 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:16.759832 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-9e12e8e2-8027-4ae2-b6fa-6355b8cc1e10 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] [instance: 7222a4ce-d2a2-4b09-afc6-55bca52414d4] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:16.779769 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9e12e8e2-8027-4ae2-b6fa-6355b8cc1e10 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:16.780662 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9e12e8e2-8027-4ae2-b6fa-6355b8cc1e10 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:16.783100 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9e12e8e2-8027-4ae2-b6fa-6355b8cc1e10 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:16.784142 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9e12e8e2-8027-4ae2-b6fa-6355b8cc1e10 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:16.787543 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9e12e8e2-8027-4ae2-b6fa-6355b8cc1e10 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:16.788589 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9e12e8e2-8027-4ae2-b6fa-6355b8cc1e10 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:17.016316 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-fc743537-0c92-415d-9c76-3dd19206042a tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15432d1b74334e1188866004384befe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d562b670294a47b2171f4003be4cdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:17.031373 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-fc743537-0c92-415d-9c76-3dd19206042a tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] 10.222.0.43 "GET /compute/v2.1/servers/ffbbf357-494a-40e4-8943-3159707fc2e4" status: 200 len: 1323 microversion: 2.1 time: 0.566073 Oct 04 18:40:17.049490 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1267/2377] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:16 2022] GET /compute/v2.1/servers/ffbbf357-494a-40e4-8943-3159707fc2e4 => generated 1323 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:17.064622 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-0dded21f-5874-494d-88c7-6ac7e45231ba tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Action: 'create', calling method: .version_select at 0x7fb21edf9ee0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-266439237", "description": "tempest-description-605528832"}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:40:17.370024 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-9e12e8e2-8027-4ae2-b6fa-6355b8cc1e10 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:17.402982 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-9e12e8e2-8027-4ae2-b6fa-6355b8cc1e10 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:17.404935 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-9e12e8e2-8027-4ae2-b6fa-6355b8cc1e10 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:17.406219 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-9e12e8e2-8027-4ae2-b6fa-6355b8cc1e10 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] 10.222.0.43 "GET /compute/v2.1/servers/7222a4ce-d2a2-4b09-afc6-55bca52414d4" status: 200 len: 1733 microversion: 2.25 time: 0.661695 Oct 04 18:40:17.406846 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1111/2378] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:40:16 2022] GET /compute/v2.1/servers/7222a4ce-d2a2-4b09-afc6-55bca52414d4 => generated 1733 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:40:17.421194 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-4231ee2f-a82c-4426-838d-a2267e049999 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:17.422527 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-4231ee2f-a82c-4426-838d-a2267e049999 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] [instance: 1a71ee0e-ffa8-4730-b4fb-8b6e9fd87239] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:17.440985 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4231ee2f-a82c-4426-838d-a2267e049999 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:17.441586 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4231ee2f-a82c-4426-838d-a2267e049999 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:17.448847 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4231ee2f-a82c-4426-838d-a2267e049999 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:17.450156 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4231ee2f-a82c-4426-838d-a2267e049999 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:17.450858 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4231ee2f-a82c-4426-838d-a2267e049999 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:17.451542 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4231ee2f-a82c-4426-838d-a2267e049999 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:17.536428 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-0dded21f-5874-494d-88c7-6ac7e45231ba tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] 10.222.0.43 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.484306 Oct 04 18:40:17.545427 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1268/2379] 10.222.0.43 () {60 vars in 1180 bytes} [Tue Oct 4 18:40:17 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:40:17.551783 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-1f5de353-0181-442a-b561-abe8294f4131 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:17.552664 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-1f5de353-0181-442a-b561-abe8294f4131 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: d9d4332a-97b6-40f1-bd7c-a9a75a9adc43] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:17.573389 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1f5de353-0181-442a-b561-abe8294f4131 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:17.573899 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1f5de353-0181-442a-b561-abe8294f4131 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:17.581656 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1f5de353-0181-442a-b561-abe8294f4131 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:17.584828 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1f5de353-0181-442a-b561-abe8294f4131 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:17.588637 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1f5de353-0181-442a-b561-abe8294f4131 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:17.589140 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1f5de353-0181-442a-b561-abe8294f4131 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:17.911124 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-1f5de353-0181-442a-b561-abe8294f4131 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:17.925210 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-1f5de353-0181-442a-b561-abe8294f4131 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/d9d4332a-97b6-40f1-bd7c-a9a75a9adc43" status: 200 len: 1542 microversion: 2.1 time: 0.377748 Oct 04 18:40:17.933797 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1269/2380] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:17 2022] GET /compute/v2.1/servers/d9d4332a-97b6-40f1-bd7c-a9a75a9adc43 => generated 1542 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:17.946222 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-9bced8b4-242e-4d1f-a883-aa88d8f23357 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:17.949272 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-9bced8b4-242e-4d1f-a883-aa88d8f23357 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] [instance: b53d822f-e7b1-498a-b98a-35f87839dfe8] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:17.964192 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9bced8b4-242e-4d1f-a883-aa88d8f23357 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:17.965142 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9bced8b4-242e-4d1f-a883-aa88d8f23357 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:17.965818 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9bced8b4-242e-4d1f-a883-aa88d8f23357 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:17.969032 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9bced8b4-242e-4d1f-a883-aa88d8f23357 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:17.969748 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9bced8b4-242e-4d1f-a883-aa88d8f23357 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:17.970420 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9bced8b4-242e-4d1f-a883-aa88d8f23357 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:18.564051 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-9bced8b4-242e-4d1f-a883-aa88d8f23357 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e1add2296c4ed5830c5d90ef272ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fdc44ceeb041bcba1be2fcc2084aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:18.574755 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-9bced8b4-242e-4d1f-a883-aa88d8f23357 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59e1add2296c4ed5830c5d90ef272ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fdc44ceeb041bcba1be2fcc2084aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:18.583766 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-9bced8b4-242e-4d1f-a883-aa88d8f23357 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59e1add2296c4ed5830c5d90ef272ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fdc44ceeb041bcba1be2fcc2084aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:18.585024 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-9bced8b4-242e-4d1f-a883-aa88d8f23357 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] 10.222.0.43 "GET /compute/v2.1/servers/b53d822f-e7b1-498a-b98a-35f87839dfe8" status: 200 len: 1409 microversion: 2.54 time: 0.649835 Oct 04 18:40:18.585634 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1270/2381] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:40:17 2022] GET /compute/v2.1/servers/b53d822f-e7b1-498a-b98a-35f87839dfe8 => generated 1409 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:40:18.642673 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-d01bae9d-c20b-4689-9e87-89969e812c97 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Action: 'update', calling method: .version_select at 0x7fb21edf9940>, body: {"security_group": {"name": "tempest-sg-hth-1194966359", "description": "tempest-description-hth-127737170"}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:40:18.658097 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-4231ee2f-a82c-4426-838d-a2267e049999 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a19da94e9e646028a7f73f9d0e0edda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc41f296eb44503868205ec8aa2fef3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:18.667261 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-4231ee2f-a82c-4426-838d-a2267e049999 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] 10.222.0.43 "GET /compute/v2.1/servers/1a71ee0e-ffa8-4730-b4fb-8b6e9fd87239" status: 200 len: 1521 microversion: 2.1 time: 1.259016 Oct 04 18:40:18.669631 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1112/2382] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:17 2022] GET /compute/v2.1/servers/1a71ee0e-ffa8-4730-b4fb-8b6e9fd87239 => generated 1521 bytes in 1262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:18.725885 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-23a7ec3a-4f4d-45f2-b00b-75b7e0f2481b tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Calling method '.version_select at 0x7fb227d5dca0>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:18.848887 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-23a7ec3a-4f4d-45f2-b00b-75b7e0f2481b tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] 10.222.0.43 "GET /compute/v2.1/images/e4d3e808-f1b4-4480-90f6-79b6d4964f47" status: 200 len: 1455 microversion: 2.1 time: 0.175542 Oct 04 18:40:18.849731 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1113/2383] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 18:40:18 2022] GET /compute/v2.1/images/e4d3e808-f1b4-4480-90f6-79b6d4964f47 => generated 1455 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:18.864243 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-58e4f1f1-4fc6-44e6-b469-857d17058f8f tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:18.873579 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-58e4f1f1-4fc6-44e6-b469-857d17058f8f tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] [instance: ffbbf357-494a-40e4-8943-3159707fc2e4] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:18.888254 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-58e4f1f1-4fc6-44e6-b469-857d17058f8f tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:18.898917 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-58e4f1f1-4fc6-44e6-b469-857d17058f8f tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:18.900520 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-58e4f1f1-4fc6-44e6-b469-857d17058f8f tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:18.902131 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-58e4f1f1-4fc6-44e6-b469-857d17058f8f tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:18.902777 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-58e4f1f1-4fc6-44e6-b469-857d17058f8f tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:18.903844 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-58e4f1f1-4fc6-44e6-b469-857d17058f8f tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:19.548357 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-d01bae9d-c20b-4689-9e87-89969e812c97 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] 10.222.0.43 "PUT /compute/v2.1/os-security-groups/5a8d9ac6-eb67-42fe-a168-94a9968a5c3c" status: 200 len: 217 microversion: 2.1 time: 0.937078 Oct 04 18:40:19.548965 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1271/2384] 10.222.0.43 () {60 vars in 1290 bytes} [Tue Oct 4 18:40:18 2022] PUT /compute/v2.1/os-security-groups/5a8d9ac6-eb67-42fe-a168-94a9968a5c3c => generated 217 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:40:19.560373 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-c43b91f7-3e58-4574-af56-5e2627160fb4 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:19.561321 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-c43b91f7-3e58-4574-af56-5e2627160fb4 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] [instance: 7222a4ce-d2a2-4b09-afc6-55bca52414d4] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:19.585434 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c43b91f7-3e58-4574-af56-5e2627160fb4 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:19.585984 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c43b91f7-3e58-4574-af56-5e2627160fb4 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:19.586386 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c43b91f7-3e58-4574-af56-5e2627160fb4 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:19.587115 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c43b91f7-3e58-4574-af56-5e2627160fb4 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:19.587640 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c43b91f7-3e58-4574-af56-5e2627160fb4 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:19.588077 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c43b91f7-3e58-4574-af56-5e2627160fb4 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:19.876081 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-c43b91f7-3e58-4574-af56-5e2627160fb4 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:19.897192 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-c43b91f7-3e58-4574-af56-5e2627160fb4 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:19.901695 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-c43b91f7-3e58-4574-af56-5e2627160fb4 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:19.903126 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-c43b91f7-3e58-4574-af56-5e2627160fb4 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] 10.222.0.43 "GET /compute/v2.1/servers/7222a4ce-d2a2-4b09-afc6-55bca52414d4" status: 200 len: 1665 microversion: 2.25 time: 0.353025 Oct 04 18:40:19.905301 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1272/2385] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:40:19 2022] GET /compute/v2.1/servers/7222a4ce-d2a2-4b09-afc6-55bca52414d4 => generated 1665 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:40:19.930033 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-15d88319-8708-404e-a5e4-ce8e656552ff tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:19.931653 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-15d88319-8708-404e-a5e4-ce8e656552ff tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: d9d4332a-97b6-40f1-bd7c-a9a75a9adc43] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:19.947053 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-15d88319-8708-404e-a5e4-ce8e656552ff tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:19.952211 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-15d88319-8708-404e-a5e4-ce8e656552ff tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:19.952962 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-15d88319-8708-404e-a5e4-ce8e656552ff tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:19.953976 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-15d88319-8708-404e-a5e4-ce8e656552ff tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:19.954808 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-15d88319-8708-404e-a5e4-ce8e656552ff tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:19.955449 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-15d88319-8708-404e-a5e4-ce8e656552ff tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:19.970570 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-58e4f1f1-4fc6-44e6-b469-857d17058f8f tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15432d1b74334e1188866004384befe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d562b670294a47b2171f4003be4cdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:19.984740 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-58e4f1f1-4fc6-44e6-b469-857d17058f8f tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] 10.222.0.43 "GET /compute/v2.1/servers/ffbbf357-494a-40e4-8943-3159707fc2e4" status: 200 len: 1323 microversion: 2.1 time: 1.131739 Oct 04 18:40:19.985674 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1114/2386] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:18 2022] GET /compute/v2.1/servers/ffbbf357-494a-40e4-8943-3159707fc2e4 => generated 1323 bytes in 1135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:20.003215 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-ab11dbca-a223-424b-a5e6-051453b2d222 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Calling method '.version_select at 0x7fb21fd0a160>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:20.143074 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-ab11dbca-a223-424b-a5e6-051453b2d222 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] 10.222.0.43 "GET /compute/v2.1/os-security-groups/5a8d9ac6-eb67-42fe-a168-94a9968a5c3c" status: 200 len: 217 microversion: 2.1 time: 0.152600 Oct 04 18:40:20.144103 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1115/2387] 10.222.0.43 () {58 vars in 1269 bytes} [Tue Oct 4 18:40:19 2022] GET /compute/v2.1/os-security-groups/5a8d9ac6-eb67-42fe-a168-94a9968a5c3c => generated 217 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:40:20.153891 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-5fcb05cc-f1a8-442e-9c21-fb4ab71e7fad tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:20.154754 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-5fcb05cc-f1a8-442e-9c21-fb4ab71e7fad tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] [instance: b53d822f-e7b1-498a-b98a-35f87839dfe8] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:20.219119 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5fcb05cc-f1a8-442e-9c21-fb4ab71e7fad tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:20.219618 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5fcb05cc-f1a8-442e-9c21-fb4ab71e7fad tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:20.238056 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5fcb05cc-f1a8-442e-9c21-fb4ab71e7fad tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:20.242654 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5fcb05cc-f1a8-442e-9c21-fb4ab71e7fad tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:20.246321 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5fcb05cc-f1a8-442e-9c21-fb4ab71e7fad tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:20.253603 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5fcb05cc-f1a8-442e-9c21-fb4ab71e7fad tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:20.278944 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-15d88319-8708-404e-a5e4-ce8e656552ff tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:20.295193 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-15d88319-8708-404e-a5e4-ce8e656552ff tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/d9d4332a-97b6-40f1-bd7c-a9a75a9adc43" status: 200 len: 1541 microversion: 2.1 time: 0.385861 Oct 04 18:40:20.300576 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1273/2388] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:19 2022] GET /compute/v2.1/servers/d9d4332a-97b6-40f1-bd7c-a9a75a9adc43 => generated 1541 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:20.317787 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-9107491a-ab5e-43d0-b70d-721af60ffee5 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:20.318424 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-9107491a-ab5e-43d0-b70d-721af60ffee5 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] [instance: 1a71ee0e-ffa8-4730-b4fb-8b6e9fd87239] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:20.349526 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9107491a-ab5e-43d0-b70d-721af60ffee5 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:20.351622 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9107491a-ab5e-43d0-b70d-721af60ffee5 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:20.363980 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9107491a-ab5e-43d0-b70d-721af60ffee5 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:20.365075 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9107491a-ab5e-43d0-b70d-721af60ffee5 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:20.368876 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9107491a-ab5e-43d0-b70d-721af60ffee5 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:20.372116 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9107491a-ab5e-43d0-b70d-721af60ffee5 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:20.421431 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:40:20.572569 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-5fcb05cc-f1a8-442e-9c21-fb4ab71e7fad tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e1add2296c4ed5830c5d90ef272ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fdc44ceeb041bcba1be2fcc2084aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:20.586328 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-5fcb05cc-f1a8-442e-9c21-fb4ab71e7fad tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59e1add2296c4ed5830c5d90ef272ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fdc44ceeb041bcba1be2fcc2084aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:20.588448 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-5fcb05cc-f1a8-442e-9c21-fb4ab71e7fad tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59e1add2296c4ed5830c5d90ef272ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fdc44ceeb041bcba1be2fcc2084aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:20.591483 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-5fcb05cc-f1a8-442e-9c21-fb4ab71e7fad tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] 10.222.0.43 "GET /compute/v2.1/servers/b53d822f-e7b1-498a-b98a-35f87839dfe8" status: 200 len: 1409 microversion: 2.54 time: 0.444810 Oct 04 18:40:20.612860 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1116/2389] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:40:20 2022] GET /compute/v2.1/servers/b53d822f-e7b1-498a-b98a-35f87839dfe8 => generated 1409 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:40:20.627263 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-74891a56-a778-465c-9f04-f511d6d87bfa tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Calling method '.version_select at 0x7fb21fecdee0>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:20.654629 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-9107491a-ab5e-43d0-b70d-721af60ffee5 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a19da94e9e646028a7f73f9d0e0edda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc41f296eb44503868205ec8aa2fef3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:20.663831 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-9107491a-ab5e-43d0-b70d-721af60ffee5 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] 10.222.0.43 "GET /compute/v2.1/servers/1a71ee0e-ffa8-4730-b4fb-8b6e9fd87239" status: 200 len: 1521 microversion: 2.1 time: 0.361241 Oct 04 18:40:20.667429 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1274/2390] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:20 2022] GET /compute/v2.1/servers/1a71ee0e-ffa8-4730-b4fb-8b6e9fd87239 => generated 1521 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:20.683924 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-51c0f10f-6148-45bd-8fa2-44e3d24f2f91 req-c3139d23-5ff0-4e19-88e0-fa5c7d5f2dc7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7222a4ce-d2a2-4b09-afc6-55bca52414d4", "name": "network-vif-deleted", "tag": "dc9d53f5-3f85-42de-8651-845234788630"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:40:20.714717 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-74891a56-a778-465c-9f04-f511d6d87bfa tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] 10.222.0.43 "GET /compute/v2.1/images/e4d3e808-f1b4-4480-90f6-79b6d4964f47" status: 200 len: 1455 microversion: 2.1 time: 0.100438 Oct 04 18:40:20.715644 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1117/2391] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 18:40:20 2022] GET /compute/v2.1/images/e4d3e808-f1b4-4480-90f6-79b6d4964f47 => generated 1455 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:20.724029 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-7f874404-4c13-491b-afdf-6c83ce8498f1 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Calling method '.version_select at 0x7fb21fc54700>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:20.726605 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-51c0f10f-6148-45bd-8fa2-44e3d24f2f91 req-c3139d23-5ff0-4e19-88e0-fa5c7d5f2dc7 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:20.728301 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-51c0f10f-6148-45bd-8fa2-44e3d24f2f91 req-c3139d23-5ff0-4e19-88e0-fa5c7d5f2dc7 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:20.733848 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-51c0f10f-6148-45bd-8fa2-44e3d24f2f91 req-c3139d23-5ff0-4e19-88e0-fa5c7d5f2dc7 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:20.757413 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-51c0f10f-6148-45bd-8fa2-44e3d24f2f91 req-c3139d23-5ff0-4e19-88e0-fa5c7d5f2dc7 service nova] Creating event network-vif-deleted:dc9d53f5-3f85-42de-8651-845234788630 for instance 7222a4ce-d2a2-4b09-afc6-55bca52414d4 on n-h2-851028-13 Oct 04 18:40:20.772887 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-51c0f10f-6148-45bd-8fa2-44e3d24f2f91 req-c3139d23-5ff0-4e19-88e0-fa5c7d5f2dc7 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103873 Oct 04 18:40:20.773779 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1275/2392] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:40:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:40:20.942090 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-24493b6c-9d19-4841-b1b5-8db051787d36 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:20.943053 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-24493b6c-9d19-4841-b1b5-8db051787d36 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] [instance: 7222a4ce-d2a2-4b09-afc6-55bca52414d4] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:20.952490 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-24493b6c-9d19-4841-b1b5-8db051787d36 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:20.955350 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-24493b6c-9d19-4841-b1b5-8db051787d36 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:20.964103 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-24493b6c-9d19-4841-b1b5-8db051787d36 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:20.965048 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-24493b6c-9d19-4841-b1b5-8db051787d36 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:20.965709 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-24493b6c-9d19-4841-b1b5-8db051787d36 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:20.966389 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-24493b6c-9d19-4841-b1b5-8db051787d36 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:21.037945 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-24493b6c-9d19-4841-b1b5-8db051787d36 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:21.038552 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-24493b6c-9d19-4841-b1b5-8db051787d36 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:21.039095 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-24493b6c-9d19-4841-b1b5-8db051787d36 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:21.039683 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.objects.instance [None req-24493b6c-9d19-4841-b1b5-8db051787d36 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lazy-loading 'fault' on Instance uuid 7222a4ce-d2a2-4b09-afc6-55bca52414d4 {{(pid=123596) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:40:21.237774 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-24493b6c-9d19-4841-b1b5-8db051787d36 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:21.250785 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-24493b6c-9d19-4841-b1b5-8db051787d36 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:21.252341 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-24493b6c-9d19-4841-b1b5-8db051787d36 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:21.264718 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-24493b6c-9d19-4841-b1b5-8db051787d36 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] 10.222.0.43 "GET /compute/v2.1/servers/7222a4ce-d2a2-4b09-afc6-55bca52414d4" status: 200 len: 1375 microversion: 2.25 time: 0.327770 Oct 04 18:40:21.270266 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1276/2393] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:40:20 2022] GET /compute/v2.1/servers/7222a4ce-d2a2-4b09-afc6-55bca52414d4 => generated 1375 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:40:21.282475 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-700f17b0-c29a-42ca-b1cf-e8cca8d9d6cb tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:21.286451 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-700f17b0-c29a-42ca-b1cf-e8cca8d9d6cb tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] [instance: ffbbf357-494a-40e4-8943-3159707fc2e4] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:21.307741 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-700f17b0-c29a-42ca-b1cf-e8cca8d9d6cb tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:21.308556 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-700f17b0-c29a-42ca-b1cf-e8cca8d9d6cb tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:21.312019 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-700f17b0-c29a-42ca-b1cf-e8cca8d9d6cb tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:21.312981 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-700f17b0-c29a-42ca-b1cf-e8cca8d9d6cb tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:21.313653 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-700f17b0-c29a-42ca-b1cf-e8cca8d9d6cb tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:21.314372 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-700f17b0-c29a-42ca-b1cf-e8cca8d9d6cb tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:21.564894 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-7f874404-4c13-491b-afdf-6c83ce8498f1 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] 10.222.0.43 "DELETE /compute/v2.1/os-security-groups/5a8d9ac6-eb67-42fe-a168-94a9968a5c3c" status: 202 len: 0 microversion: 2.1 time: 0.848090 Oct 04 18:40:21.566189 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1118/2394] 10.222.0.43 () {58 vars in 1272 bytes} [Tue Oct 4 18:40:20 2022] DELETE /compute/v2.1/os-security-groups/5a8d9ac6-eb67-42fe-a168-94a9968a5c3c => generated 0 bytes in 850 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:40:21.571499 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-fdf5b22b-cf4e-4c4b-adb0-bc1b20ca9d39 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:21.573246 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-fdf5b22b-cf4e-4c4b-adb0-bc1b20ca9d39 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: d9d4332a-97b6-40f1-bd7c-a9a75a9adc43] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:21.593761 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fdf5b22b-cf4e-4c4b-adb0-bc1b20ca9d39 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:21.594644 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fdf5b22b-cf4e-4c4b-adb0-bc1b20ca9d39 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:21.595318 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fdf5b22b-cf4e-4c4b-adb0-bc1b20ca9d39 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:21.596299 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fdf5b22b-cf4e-4c4b-adb0-bc1b20ca9d39 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:21.596966 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fdf5b22b-cf4e-4c4b-adb0-bc1b20ca9d39 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:21.597626 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fdf5b22b-cf4e-4c4b-adb0-bc1b20ca9d39 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:21.881529 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-700f17b0-c29a-42ca-b1cf-e8cca8d9d6cb tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15432d1b74334e1188866004384befe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d562b670294a47b2171f4003be4cdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:21.897003 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-700f17b0-c29a-42ca-b1cf-e8cca8d9d6cb tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] 10.222.0.43 "GET /compute/v2.1/servers/ffbbf357-494a-40e4-8943-3159707fc2e4" status: 200 len: 1323 microversion: 2.1 time: 0.623075 Oct 04 18:40:21.900443 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1277/2395] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:21 2022] GET /compute/v2.1/servers/ffbbf357-494a-40e4-8943-3159707fc2e4 => generated 1323 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:21.910763 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-0111ae07-fb14-4370-8cfc-94725eb72a6c tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:21.912322 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-0111ae07-fb14-4370-8cfc-94725eb72a6c tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] [instance: b6474a49-d05d-4d2e-afef-cdbbe8c6d9aa] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:21.925398 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-fdf5b22b-cf4e-4c4b-adb0-bc1b20ca9d39 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:21.935739 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-fdf5b22b-cf4e-4c4b-adb0-bc1b20ca9d39 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/d9d4332a-97b6-40f1-bd7c-a9a75a9adc43" status: 200 len: 1541 microversion: 2.1 time: 0.368086 Oct 04 18:40:21.953822 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1119/2396] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:21 2022] GET /compute/v2.1/servers/d9d4332a-97b6-40f1-bd7c-a9a75a9adc43 => generated 1541 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:21.975343 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0111ae07-fb14-4370-8cfc-94725eb72a6c tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:21.975880 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0111ae07-fb14-4370-8cfc-94725eb72a6c tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:21.976334 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0111ae07-fb14-4370-8cfc-94725eb72a6c tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:21.977077 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0111ae07-fb14-4370-8cfc-94725eb72a6c tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:21.978183 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-98bc1b30-35e2-42d1-aa1f-867938e80a19 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:21.978886 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-98bc1b30-35e2-42d1-aa1f-867938e80a19 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] [instance: b53d822f-e7b1-498a-b98a-35f87839dfe8] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:21.981748 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0111ae07-fb14-4370-8cfc-94725eb72a6c tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:21.982204 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0111ae07-fb14-4370-8cfc-94725eb72a6c tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:22.013301 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-98bc1b30-35e2-42d1-aa1f-867938e80a19 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:22.013816 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-98bc1b30-35e2-42d1-aa1f-867938e80a19 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:22.014306 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-98bc1b30-35e2-42d1-aa1f-867938e80a19 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:22.019259 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-0111ae07-fb14-4370-8cfc-94725eb72a6c tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] HTTP exception thrown: Instance b6474a49-d05d-4d2e-afef-cdbbe8c6d9aa could not be found. Oct 04 18:40:22.021264 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-0111ae07-fb14-4370-8cfc-94725eb72a6c tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Request method failure captured: Oct 04 18:40:22.021264 n-d-851028-13 devstack@n-api.service[123596]: request: DELETE /compute/v2.1/servers/b6474a49-d05d-4d2e-afef-cdbbe8c6d9aa HTTP/1.1 Oct 04 18:40:22.021264 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:40:22.021264 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:40:22.021264 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:40:22.021264 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 18:40:22.021264 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:40:22.021264 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:40:22.021264 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:40:22.021264 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:40:22.021264 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPH2qE2WsiZvVd-vvN1M8uHJG40fIXDT1XURP-P4ciVfKnbP_2tplzYndj2wlvB6bSu_VMaD1xfU0nGHRYWQRmNIt_krh_S1n2RkrhietTC0-RnvJ1rzF8ilPx8zowbVefo7A8IyDn5QTaMC08kHUNyiYinJQT_Q7n9enahWrBitVOPM Oct 04 18:40:22.021264 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:40:22.021264 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:40:22.021264 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:40:22.021264 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:40:22.021264 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:40:22.021264 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:40:22.021264 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: 7b812c85494a49898376a0dd8140f03c Oct 04 18:40:22.021264 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-SecurityGroupsTestJSON-209295605 Oct 04 18:40:22.021264 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 18:40:22.021264 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 18:40:22.021264 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/7b812c85494a49898376a0dd8140f03c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_7b812c85494a49898376a0dd8140f03c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/7b812c85494a49898376a0dd8140f03c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/7b812c85494a49898376a0dd8140f03c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:40:22.021264 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-SecurityGroupsTestJSON-209295605 Oct 04 18:40:22.021264 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: 7b812c85494a49898376a0dd8140f03c Oct 04 18:40:22.021264 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-209295605 Oct 04 18:40:22.021264 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-SecurityGroupsTestJSON-209295605-project Oct 04 18:40:22.021264 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:40:22.021264 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:40:22.021264 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 5c96ec8b8e0a4053b0457f213e6e262d Oct 04 18:40:22.021264 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-SecurityGroupsTestJSON-209295605-project Oct 04 18:40:22.021264 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 18:40:22.021264 n-d-851028-13 devstack@n-api.service[123596]: exception: Instance b6474a49-d05d-4d2e-afef-cdbbe8c6d9aa could not be found. Oct 04 18:40:22.021264 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': 'b6474a49-d05d-4d2e-afef-cdbbe8c6d9aa'} Oct 04 18:40:22.021264 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:40:22.021264 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:40:22.021264 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:40:22.021264 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:40:22.021264 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:40:22.021264 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:40:22.021264 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:40:22.021264 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:40:22.021264 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:40:22.021264 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:40:22.021264 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6474a49-d05d-4d2e-afef-cdbbe8c6d9aa could not be found. Oct 04 18:40:22.021264 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:40:22.021264 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:40:22.021264 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:40:22.021264 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:40:22.021264 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:40:22.021264 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:40:22.021264 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:40:22.021264 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:40:22.021264 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:40:22.021264 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:40:22.021264 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:40:22.021264 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:40:22.021264 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:40:22.021264 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:40:22.021264 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:40:22.021264 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:40:22.021264 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:40:22.021264 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:40:22.025265 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6474a49-d05d-4d2e-afef-cdbbe8c6d9aa could not be found. Oct 04 18:40:22.025265 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:40:22.025265 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:40:22.025265 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:40:22.025265 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:40:22.025265 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:40:22.025265 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:40:22.025265 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:40:22.025265 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:40:22.025265 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6474a49-d05d-4d2e-afef-cdbbe8c6d9aa could not be found. Oct 04 18:40:22.025265 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:40:22.025861 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-98bc1b30-35e2-42d1-aa1f-867938e80a19 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:22.025861 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-98bc1b30-35e2-42d1-aa1f-867938e80a19 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:22.025861 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-98bc1b30-35e2-42d1-aa1f-867938e80a19 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:22.027313 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-0111ae07-fb14-4370-8cfc-94725eb72a6c tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Returning 404 to user: Instance b6474a49-d05d-4d2e-afef-cdbbe8c6d9aa could not be found. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:40:22.028384 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-0111ae07-fb14-4370-8cfc-94725eb72a6c tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] 10.222.0.43 "DELETE /compute/v2.1/servers/b6474a49-d05d-4d2e-afef-cdbbe8c6d9aa" status: 404 len: 111 microversion: 2.1 time: 0.126650 Oct 04 18:40:22.033307 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1278/2397] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 18:40:21 2022] DELETE /compute/v2.1/servers/b6474a49-d05d-4d2e-afef-cdbbe8c6d9aa => generated 111 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:40:22.038466 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-4c65e938-36f3-4eaf-9420-09f204e48bc4 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:22.047198 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-4c65e938-36f3-4eaf-9420-09f204e48bc4 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] [instance: 1a71ee0e-ffa8-4730-b4fb-8b6e9fd87239] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:22.067027 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4c65e938-36f3-4eaf-9420-09f204e48bc4 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:22.067725 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4c65e938-36f3-4eaf-9420-09f204e48bc4 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:22.068371 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4c65e938-36f3-4eaf-9420-09f204e48bc4 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:22.069303 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4c65e938-36f3-4eaf-9420-09f204e48bc4 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:22.070137 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4c65e938-36f3-4eaf-9420-09f204e48bc4 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:22.070755 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4c65e938-36f3-4eaf-9420-09f204e48bc4 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:22.181511 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-98bc1b30-35e2-42d1-aa1f-867938e80a19 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e1add2296c4ed5830c5d90ef272ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fdc44ceeb041bcba1be2fcc2084aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:22.192491 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-98bc1b30-35e2-42d1-aa1f-867938e80a19 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59e1add2296c4ed5830c5d90ef272ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fdc44ceeb041bcba1be2fcc2084aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:22.200424 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-98bc1b30-35e2-42d1-aa1f-867938e80a19 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59e1add2296c4ed5830c5d90ef272ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fdc44ceeb041bcba1be2fcc2084aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:22.204432 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-98bc1b30-35e2-42d1-aa1f-867938e80a19 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] 10.222.0.43 "GET /compute/v2.1/servers/b53d822f-e7b1-498a-b98a-35f87839dfe8" status: 200 len: 1409 microversion: 2.54 time: 0.248316 Oct 04 18:40:22.206892 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1120/2398] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:40:21 2022] GET /compute/v2.1/servers/b53d822f-e7b1-498a-b98a-35f87839dfe8 => generated 1409 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:40:22.222034 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-f75b70d7-98b4-4bb3-a560-c8edb76d7a92 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Calling method '.version_select at 0x7fb21fecde50>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:22.340314 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-f75b70d7-98b4-4bb3-a560-c8edb76d7a92 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] 10.222.0.43 "GET /compute/v2.1/images/e4d3e808-f1b4-4480-90f6-79b6d4964f47" status: 200 len: 1455 microversion: 2.1 time: 0.130631 Oct 04 18:40:22.341664 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1121/2399] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 18:40:22 2022] GET /compute/v2.1/images/e4d3e808-f1b4-4480-90f6-79b6d4964f47 => generated 1455 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:22.361039 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-4c65e938-36f3-4eaf-9420-09f204e48bc4 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a19da94e9e646028a7f73f9d0e0edda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc41f296eb44503868205ec8aa2fef3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:22.363457 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-f513f4d8-24aa-40e6-adc1-08c033fa9be7 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:22.366757 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-f513f4d8-24aa-40e6-adc1-08c033fa9be7 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] [instance: b6474a49-d05d-4d2e-afef-cdbbe8c6d9aa] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:22.374056 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-4c65e938-36f3-4eaf-9420-09f204e48bc4 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] 10.222.0.43 "GET /compute/v2.1/servers/1a71ee0e-ffa8-4730-b4fb-8b6e9fd87239" status: 200 len: 1521 microversion: 2.1 time: 0.336780 Oct 04 18:40:22.374840 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1279/2400] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:22 2022] GET /compute/v2.1/servers/1a71ee0e-ffa8-4730-b4fb-8b6e9fd87239 => generated 1521 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:22.385005 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-825c9ba0-3d91-4cdd-ac98-1590b7f093f1 req-ffa7227d-0148-4dbc-a6f4-80935c090a97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffbbf357-494a-40e4-8943-3159707fc2e4", "name": "network-vif-plugged", "status": "completed", "tag": "61178b4f-ada9-4139-8cac-244778b3c3e5"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:40:22.409074 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-825c9ba0-3d91-4cdd-ac98-1590b7f093f1 req-ffa7227d-0148-4dbc-a6f4-80935c090a97 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:22.410128 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f513f4d8-24aa-40e6-adc1-08c033fa9be7 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:22.413867 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-825c9ba0-3d91-4cdd-ac98-1590b7f093f1 req-ffa7227d-0148-4dbc-a6f4-80935c090a97 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:22.416369 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-825c9ba0-3d91-4cdd-ac98-1590b7f093f1 req-ffa7227d-0148-4dbc-a6f4-80935c090a97 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:22.417824 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f513f4d8-24aa-40e6-adc1-08c033fa9be7 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:22.418295 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f513f4d8-24aa-40e6-adc1-08c033fa9be7 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:22.421950 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f513f4d8-24aa-40e6-adc1-08c033fa9be7 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:22.422493 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f513f4d8-24aa-40e6-adc1-08c033fa9be7 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:22.423850 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f513f4d8-24aa-40e6-adc1-08c033fa9be7 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:22.445201 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-825c9ba0-3d91-4cdd-ac98-1590b7f093f1 req-ffa7227d-0148-4dbc-a6f4-80935c090a97 service nova] Creating event network-vif-plugged:61178b4f-ada9-4139-8cac-244778b3c3e5 for instance ffbbf357-494a-40e4-8943-3159707fc2e4 on n-h2-851028-13 Oct 04 18:40:22.454206 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-825c9ba0-3d91-4cdd-ac98-1590b7f093f1 req-ffa7227d-0148-4dbc-a6f4-80935c090a97 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073044 Oct 04 18:40:22.454899 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-f513f4d8-24aa-40e6-adc1-08c033fa9be7 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] HTTP exception thrown: Instance b6474a49-d05d-4d2e-afef-cdbbe8c6d9aa could not be found. Oct 04 18:40:22.457131 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1280/2401] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:40:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:40:22.458014 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-f513f4d8-24aa-40e6-adc1-08c033fa9be7 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Request method failure captured: Oct 04 18:40:22.458014 n-d-851028-13 devstack@n-api.service[123595]: request: GET /compute/v2.1/servers/b6474a49-d05d-4d2e-afef-cdbbe8c6d9aa HTTP/1.1 Oct 04 18:40:22.458014 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 18:40:22.458014 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 18:40:22.458014 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 18:40:22.458014 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 0 Oct 04 18:40:22.458014 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 18:40:22.458014 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 18:40:22.458014 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 18:40:22.458014 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 18:40:22.458014 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPH2qE2WsiZvVd-vvN1M8uHJG40fIXDT1XURP-P4ciVfKnbP_2tplzYndj2wlvB6bSu_VMaD1xfU0nGHRYWQRmNIt_krh_S1n2RkrhietTC0-RnvJ1rzF8ilPx8zowbVefo7A8IyDn5QTaMC08kHUNyiYinJQT_Q7n9enahWrBitVOPM Oct 04 18:40:22.458014 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 18:40:22.458014 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 18:40:22.458014 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 18:40:22.458014 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 18:40:22.458014 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 18:40:22.458014 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 18:40:22.458014 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: 7b812c85494a49898376a0dd8140f03c Oct 04 18:40:22.458014 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-SecurityGroupsTestJSON-209295605 Oct 04 18:40:22.458014 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 18:40:22.458014 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 18:40:22.458014 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/7b812c85494a49898376a0dd8140f03c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_7b812c85494a49898376a0dd8140f03c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/7b812c85494a49898376a0dd8140f03c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/7b812c85494a49898376a0dd8140f03c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:40:22.458014 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-SecurityGroupsTestJSON-209295605 Oct 04 18:40:22.458014 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: 7b812c85494a49898376a0dd8140f03c Oct 04 18:40:22.458014 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-209295605 Oct 04 18:40:22.458014 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-SecurityGroupsTestJSON-209295605-project Oct 04 18:40:22.458014 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 18:40:22.458014 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 18:40:22.458014 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: 5c96ec8b8e0a4053b0457f213e6e262d Oct 04 18:40:22.458014 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-SecurityGroupsTestJSON-209295605-project Oct 04 18:40:22.458014 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 18:40:22.458014 n-d-851028-13 devstack@n-api.service[123595]: exception: Instance b6474a49-d05d-4d2e-afef-cdbbe8c6d9aa could not be found. Oct 04 18:40:22.458014 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': 'b6474a49-d05d-4d2e-afef-cdbbe8c6d9aa'} Oct 04 18:40:22.458014 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:40:22.458014 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:40:22.458014 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:40:22.458014 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:40:22.458014 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:40:22.458014 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:40:22.458014 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:40:22.458014 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:40:22.458014 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:40:22.458014 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:40:22.458014 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6474a49-d05d-4d2e-afef-cdbbe8c6d9aa could not be found. Oct 04 18:40:22.458014 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:40:22.458014 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:40:22.458014 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:40:22.458014 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:40:22.458014 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:40:22.458014 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:40:22.458014 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:40:22.458014 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:40:22.458014 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:40:22.458014 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:40:22.458014 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:40:22.458014 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:40:22.458014 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:40:22.458014 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:40:22.458014 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:40:22.458014 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:40:22.458014 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6474a49-d05d-4d2e-afef-cdbbe8c6d9aa could not be found. Oct 04 18:40:22.458014 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:40:22.458014 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:40:22.458014 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:40:22.461886 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:40:22.461886 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:40:22.461886 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:40:22.461886 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:40:22.461886 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:40:22.461886 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6474a49-d05d-4d2e-afef-cdbbe8c6d9aa could not be found. Oct 04 18:40:22.461886 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:40:22.461886 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-f513f4d8-24aa-40e6-adc1-08c033fa9be7 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Returning 404 to user: Instance b6474a49-d05d-4d2e-afef-cdbbe8c6d9aa could not be found. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:40:22.461886 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-f513f4d8-24aa-40e6-adc1-08c033fa9be7 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] 10.222.0.43 "GET /compute/v2.1/servers/b6474a49-d05d-4d2e-afef-cdbbe8c6d9aa" status: 404 len: 111 microversion: 2.1 time: 0.115436 Oct 04 18:40:22.461886 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1122/2402] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:22 2022] GET /compute/v2.1/servers/b6474a49-d05d-4d2e-afef-cdbbe8c6d9aa => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:40:22.481809 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-29de7dd0-e889-4de9-825b-098f06d970fa tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Calling method '.version_select at 0x7fb21f7c0040>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:22.494479 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f353e7d6-1732-4734-912d-2a33eb7b52c9 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:22.495565 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-f353e7d6-1732-4734-912d-2a33eb7b52c9 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] [instance: 7222a4ce-d2a2-4b09-afc6-55bca52414d4] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:22.507575 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f353e7d6-1732-4734-912d-2a33eb7b52c9 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:22.512362 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f353e7d6-1732-4734-912d-2a33eb7b52c9 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:22.513154 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f353e7d6-1732-4734-912d-2a33eb7b52c9 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:22.514144 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f353e7d6-1732-4734-912d-2a33eb7b52c9 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:22.514822 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f353e7d6-1732-4734-912d-2a33eb7b52c9 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:22.519258 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f353e7d6-1732-4734-912d-2a33eb7b52c9 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:22.541545 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-f353e7d6-1732-4734-912d-2a33eb7b52c9 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] HTTP exception thrown: Instance 7222a4ce-d2a2-4b09-afc6-55bca52414d4 could not be found. Oct 04 18:40:22.552516 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f353e7d6-1732-4734-912d-2a33eb7b52c9 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Request method failure captured: Oct 04 18:40:22.552516 n-d-851028-13 devstack@n-api.service[123596]: request: GET /compute/v2.1/servers/7222a4ce-d2a2-4b09-afc6-55bca52414d4 HTTP/1.1 Oct 04 18:40:22.552516 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:40:22.552516 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:40:22.552516 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:40:22.552516 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 18:40:22.552516 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:40:22.552516 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:40:22.552516 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:40:22.552516 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:40:22.552516 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPHxK_ToGvcECtRTJrWYMKaCCQEh_JZZgcqc-r_A500pVGUvovsnjwjyXlRim6Z-YtMLF9D_Q9MV8m4O2Jyok1khHVlXddWmZz_Glnhlck2aiWTU2mJ-gbHAAw8sCZHyDjKgUfwQs9jySnzCV7Gx1ajTbePvcLH61LZ4g9dLjBrddiSA Oct 04 18:40:22.552516 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:40:22.552516 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:40:22.552516 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:40:22.552516 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:40:22.552516 n-d-851028-13 devstack@n-api.service[123596]: X-Openstack-Nova-Api-Version: 2.25 Oct 04 18:40:22.552516 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:40:22.552516 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:40:22.552516 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: 34199e342c1b4158abf82384f2213b5f Oct 04 18:40:22.552516 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1153487493 Oct 04 18:40:22.552516 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 18:40:22.552516 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 18:40:22.552516 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/34199e342c1b4158abf82384f2213b5f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_34199e342c1b4158abf82384f2213b5f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/34199e342c1b4158abf82384f2213b5f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/34199e342c1b4158abf82384f2213b5f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:40:22.552516 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1153487493 Oct 04 18:40:22.552516 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: 34199e342c1b4158abf82384f2213b5f Oct 04 18:40:22.552516 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1153487493 Oct 04 18:40:22.552516 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-LiveAutoBlockMigrationV225Test-1153487493-project Oct 04 18:40:22.552516 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:40:22.552516 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:40:22.552516 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 807a4a88319946aead73a3ccfcda6aeb Oct 04 18:40:22.552516 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1153487493-project Oct 04 18:40:22.552516 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 18:40:22.552516 n-d-851028-13 devstack@n-api.service[123596]: exception: Instance 7222a4ce-d2a2-4b09-afc6-55bca52414d4 could not be found. Oct 04 18:40:22.552516 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': '7222a4ce-d2a2-4b09-afc6-55bca52414d4'} Oct 04 18:40:22.552516 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:40:22.552516 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:40:22.552516 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:40:22.552516 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:40:22.552516 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:40:22.552516 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:40:22.552516 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:40:22.552516 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:40:22.552516 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:40:22.552516 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:40:22.552516 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7222a4ce-d2a2-4b09-afc6-55bca52414d4 could not be found. Oct 04 18:40:22.552516 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:40:22.552516 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:40:22.552516 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:40:22.552516 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:40:22.552516 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:40:22.552516 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:40:22.552516 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:40:22.552516 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:40:22.552516 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:40:22.552516 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:40:22.552516 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:40:22.552516 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:40:22.552516 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:40:22.552516 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:40:22.552516 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:40:22.552516 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:40:22.552516 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7222a4ce-d2a2-4b09-afc6-55bca52414d4 could not be found. Oct 04 18:40:22.552516 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:40:22.556199 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:40:22.556199 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:40:22.556199 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:40:22.556199 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:40:22.556199 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:40:22.556199 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:40:22.556199 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:40:22.556199 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7222a4ce-d2a2-4b09-afc6-55bca52414d4 could not be found. Oct 04 18:40:22.556199 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:40:22.558542 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f353e7d6-1732-4734-912d-2a33eb7b52c9 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Returning 404 to user: Instance 7222a4ce-d2a2-4b09-afc6-55bca52414d4 could not be found. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:40:22.559641 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-f353e7d6-1732-4734-912d-2a33eb7b52c9 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] 10.222.0.43 "GET /compute/v2.1/servers/7222a4ce-d2a2-4b09-afc6-55bca52414d4" status: 404 len: 111 microversion: 2.25 time: 0.090150 Oct 04 18:40:22.560596 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1281/2403] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:40:22 2022] GET /compute/v2.1/servers/7222a4ce-d2a2-4b09-afc6-55bca52414d4 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:40:22.586800 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-a60ea623-1dfc-4b4f-bfd0-5cab31c34500 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Calling method '.version_select at 0x7fb21edfcdc0>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:22.628660 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-a60ea623-1dfc-4b4f-bfd0-5cab31c34500 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1549185586" status: 204 len: 0 microversion: 2.25 time: 0.057954 Oct 04 18:40:22.630033 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1282/2404] 10.222.0.43 () {60 vars in 1262 bytes} [Tue Oct 4 18:40:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1549185586 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 04 18:40:22.844978 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-c4198166-fd2c-4f41-bee9-6cf83b0ff3da req-d5ea0ce9-160c-41f0-9e39-4e4678d4c055 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9d4332a-97b6-40f1-bd7c-a9a75a9adc43", "name": "network-vif-unplugged", "status": "completed", "tag": "e64ffaa5-c4b7-4d5d-b9bd-605829597e42"}, {"name": "network-changed", "server_uuid": "d9d4332a-97b6-40f1-bd7c-a9a75a9adc43", "tag": "e64ffaa5-c4b7-4d5d-b9bd-605829597e42"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:40:22.867511 n-d-851028-13 devstack@n-api.service[123595]: DEBUG neutronclient.v2_0.client [None req-29de7dd0-e889-4de9-825b-098f06d970fa tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 18de9d4e-2ee8-4b41-8a08-e894ffbea260 does not exist", "detail": ""}} {{(pid=123595) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 18:40:22.868121 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.network.security_group_api [None req-29de7dd0-e889-4de9-825b-098f06d970fa tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Neutron security group 18de9d4e-2ee8-4b41-8a08-e894ffbea260 not found {{(pid=123595) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 04 18:40:22.869280 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-29de7dd0-e889-4de9-825b-098f06d970fa tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] HTTP exception thrown: Security group 18de9d4e-2ee8-4b41-8a08-e894ffbea260 does not exist Oct 04 18:40:22.869280 n-d-851028-13 devstack@n-api.service[123595]: Neutron server returns request_ids: ['req-3c227ef6-76f4-4b28-bc97-387303e3a813'] Oct 04 18:40:22.870703 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-c4198166-fd2c-4f41-bee9-6cf83b0ff3da req-d5ea0ce9-160c-41f0-9e39-4e4678d4c055 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:22.871434 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-29de7dd0-e889-4de9-825b-098f06d970fa tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Request method failure captured: Oct 04 18:40:22.871434 n-d-851028-13 devstack@n-api.service[123595]: request: DELETE /compute/v2.1/os-security-groups/18de9d4e-2ee8-4b41-8a08-e894ffbea260 HTTP/1.1 Oct 04 18:40:22.871434 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 18:40:22.871434 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 18:40:22.871434 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 18:40:22.871434 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 0 Oct 04 18:40:22.871434 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 18:40:22.871434 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 18:40:22.871434 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 18:40:22.871434 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 18:40:22.871434 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPH2qE2WsiZvVd-vvN1M8uHJG40fIXDT1XURP-P4ciVfKnbP_2tplzYndj2wlvB6bSu_VMaD1xfU0nGHRYWQRmNIt_krh_S1n2RkrhietTC0-RnvJ1rzF8ilPx8zowbVefo7A8IyDn5QTaMC08kHUNyiYinJQT_Q7n9enahWrBitVOPM Oct 04 18:40:22.871434 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 18:40:22.871434 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 18:40:22.871434 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 18:40:22.871434 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 18:40:22.871434 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 18:40:22.871434 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 18:40:22.871434 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: 7b812c85494a49898376a0dd8140f03c Oct 04 18:40:22.871434 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-SecurityGroupsTestJSON-209295605 Oct 04 18:40:22.871434 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 18:40:22.871434 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 18:40:22.871434 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/7b812c85494a49898376a0dd8140f03c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_7b812c85494a49898376a0dd8140f03c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/7b812c85494a49898376a0dd8140f03c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/7b812c85494a49898376a0dd8140f03c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:40:22.871434 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-SecurityGroupsTestJSON-209295605 Oct 04 18:40:22.871434 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: 7b812c85494a49898376a0dd8140f03c Oct 04 18:40:22.871434 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-209295605 Oct 04 18:40:22.871434 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-SecurityGroupsTestJSON-209295605-project Oct 04 18:40:22.871434 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 18:40:22.871434 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 18:40:22.871434 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: 5c96ec8b8e0a4053b0457f213e6e262d Oct 04 18:40:22.871434 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-SecurityGroupsTestJSON-209295605-project Oct 04 18:40:22.871434 n-d-851028-13 devstack@n-api.service[123595]: method: Oct 04 18:40:22.871434 n-d-851028-13 devstack@n-api.service[123595]: exception: Security group 18de9d4e-2ee8-4b41-8a08-e894ffbea260 does not exist Oct 04 18:40:22.871434 n-d-851028-13 devstack@n-api.service[123595]: Neutron server returns request_ids: ['req-3c227ef6-76f4-4b28-bc97-387303e3a813'] Oct 04 18:40:22.871434 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': '18de9d4e-2ee8-4b41-8a08-e894ffbea260'} Oct 04 18:40:22.871434 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:40:22.871434 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:40:22.871434 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 04 18:40:22.871434 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 04 18:40:22.871434 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:40:22.871434 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:40:22.871434 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 04 18:40:22.871434 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 04 18:40:22.871434 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:40:22.871434 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:40:22.871434 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 18:40:22.871434 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 18:40:22.871434 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:40:22.871434 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:40:22.871434 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 18:40:22.871434 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 18:40:22.871434 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:40:22.871434 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:40:22.871434 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 18:40:22.871434 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 18:40:22.871434 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:40:22.871434 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:40:22.871434 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 18:40:22.871434 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 18:40:22.871434 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 18:40:22.871434 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 18:40:22.871434 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 18de9d4e-2ee8-4b41-8a08-e894ffbea260 does not exist Oct 04 18:40:22.874626 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3c227ef6-76f4-4b28-bc97-387303e3a813'] Oct 04 18:40:22.874626 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:40:22.874626 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:40:22.874626 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:40:22.874626 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:40:22.874626 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 04 18:40:22.874626 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 04 18:40:22.874626 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 04 18:40:22.874626 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 18:40:22.874626 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 18de9d4e-2ee8-4b41-8a08-e894ffbea260 does not exist Oct 04 18:40:22.874626 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3c227ef6-76f4-4b28-bc97-387303e3a813'] Oct 04 18:40:22.874626 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:40:22.874626 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:40:22.874626 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:40:22.874626 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:40:22.874626 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:40:22.874626 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:40:22.874626 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:40:22.874626 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:40:22.874626 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:40:22.874626 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:40:22.874626 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:40:22.874626 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:40:22.874626 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 04 18:40:22.874626 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 04 18:40:22.874626 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 18de9d4e-2ee8-4b41-8a08-e894ffbea260 does not exist Oct 04 18:40:22.874626 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3c227ef6-76f4-4b28-bc97-387303e3a813'] Oct 04 18:40:22.874626 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:40:22.874626 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:40:22.874626 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:40:22.874626 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:40:22.874626 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:40:22.874626 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:40:22.874626 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:40:22.874626 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:40:22.874626 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 18de9d4e-2ee8-4b41-8a08-e894ffbea260 does not exist Oct 04 18:40:22.874626 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3c227ef6-76f4-4b28-bc97-387303e3a813'] Oct 04 18:40:22.874626 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:40:22.874626 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-29de7dd0-e889-4de9-825b-098f06d970fa tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Returning 404 to user: Security group 18de9d4e-2ee8-4b41-8a08-e894ffbea260 does not exist Oct 04 18:40:22.874626 n-d-851028-13 devstack@n-api.service[123595]: Neutron server returns request_ids: ['req-3c227ef6-76f4-4b28-bc97-387303e3a813'] {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:40:22.874626 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-29de7dd0-e889-4de9-825b-098f06d970fa tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] 10.222.0.43 "DELETE /compute/v2.1/os-security-groups/18de9d4e-2ee8-4b41-8a08-e894ffbea260" status: 404 len: 194 microversion: 2.1 time: 0.398262 Oct 04 18:40:22.874626 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1123/2405] 10.222.0.43 () {58 vars in 1272 bytes} [Tue Oct 4 18:40:22 2022] DELETE /compute/v2.1/os-security-groups/18de9d4e-2ee8-4b41-8a08-e894ffbea260 => generated 194 bytes in 399 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:40:22.881349 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-3eb170c8-be73-4b58-90d8-960e27cb70ed tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Calling method '.version_select at 0x7fb21fd391f0>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:22.881727 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-c4198166-fd2c-4f41-bee9-6cf83b0ff3da req-d5ea0ce9-160c-41f0-9e39-4e4678d4c055 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:22.882251 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-c4198166-fd2c-4f41-bee9-6cf83b0ff3da req-d5ea0ce9-160c-41f0-9e39-4e4678d4c055 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:22.925287 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-c4198166-fd2c-4f41-bee9-6cf83b0ff3da req-d5ea0ce9-160c-41f0-9e39-4e4678d4c055 service nova] Creating event network-vif-unplugged:e64ffaa5-c4b7-4d5d-b9bd-605829597e42 for instance d9d4332a-97b6-40f1-bd7c-a9a75a9adc43 on n-h2-851028-13 Oct 04 18:40:22.926915 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-c4198166-fd2c-4f41-bee9-6cf83b0ff3da req-d5ea0ce9-160c-41f0-9e39-4e4678d4c055 service nova] Creating event network-changed:e64ffaa5-c4b7-4d5d-b9bd-605829597e42 for instance d9d4332a-97b6-40f1-bd7c-a9a75a9adc43 on n-h2-851028-13 Oct 04 18:40:22.944829 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [req-c4198166-fd2c-4f41-bee9-6cf83b0ff3da req-d5ea0ce9-160c-41f0-9e39-4e4678d4c055 service nova] Instance d9d4332a-97b6-40f1-bd7c-a9a75a9adc43 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851028-13', 'n-h2-851028-13'} {{(pid=123596) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 18:40:22.973295 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-c4198166-fd2c-4f41-bee9-6cf83b0ff3da req-d5ea0ce9-160c-41f0-9e39-4e4678d4c055 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.139461 Oct 04 18:40:22.977955 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1283/2406] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:40:22 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:40:22.986983 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-00f45325-836e-4735-aac2-2b079ec88754 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:22.992736 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-00f45325-836e-4735-aac2-2b079ec88754 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] [instance: ffbbf357-494a-40e4-8943-3159707fc2e4] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:23.016892 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-00f45325-836e-4735-aac2-2b079ec88754 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:23.020635 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-00f45325-836e-4735-aac2-2b079ec88754 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:23.021743 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-00f45325-836e-4735-aac2-2b079ec88754 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:23.023755 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-00f45325-836e-4735-aac2-2b079ec88754 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:23.026622 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-00f45325-836e-4735-aac2-2b079ec88754 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:23.027399 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-00f45325-836e-4735-aac2-2b079ec88754 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:23.094209 n-d-851028-13 devstack@n-api.service[123595]: DEBUG neutronclient.v2_0.client [None req-3eb170c8-be73-4b58-90d8-960e27cb70ed tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 1b3ff7cc-e1a4-4a6b-a935-b44264658284 does not exist", "detail": ""}} {{(pid=123595) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 18:40:23.094818 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.network.security_group_api [None req-3eb170c8-be73-4b58-90d8-960e27cb70ed tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Neutron security group 1b3ff7cc-e1a4-4a6b-a935-b44264658284 not found {{(pid=123595) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 04 18:40:23.095345 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-3eb170c8-be73-4b58-90d8-960e27cb70ed tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] HTTP exception thrown: Security group 1b3ff7cc-e1a4-4a6b-a935-b44264658284 does not exist Oct 04 18:40:23.095345 n-d-851028-13 devstack@n-api.service[123595]: Neutron server returns request_ids: ['req-8e73f631-972d-4e50-ad73-4c1dcbccbb5e'] Oct 04 18:40:23.101653 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-3eb170c8-be73-4b58-90d8-960e27cb70ed tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Request method failure captured: Oct 04 18:40:23.101653 n-d-851028-13 devstack@n-api.service[123595]: request: DELETE /compute/v2.1/os-security-groups/1b3ff7cc-e1a4-4a6b-a935-b44264658284 HTTP/1.1 Oct 04 18:40:23.101653 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 18:40:23.101653 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 18:40:23.101653 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 18:40:23.101653 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 0 Oct 04 18:40:23.101653 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 18:40:23.101653 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 18:40:23.101653 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 18:40:23.101653 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 18:40:23.101653 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPH2qE2WsiZvVd-vvN1M8uHJG40fIXDT1XURP-P4ciVfKnbP_2tplzYndj2wlvB6bSu_VMaD1xfU0nGHRYWQRmNIt_krh_S1n2RkrhietTC0-RnvJ1rzF8ilPx8zowbVefo7A8IyDn5QTaMC08kHUNyiYinJQT_Q7n9enahWrBitVOPM Oct 04 18:40:23.101653 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 18:40:23.101653 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 18:40:23.101653 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 18:40:23.101653 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 18:40:23.101653 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 18:40:23.101653 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 18:40:23.101653 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: 7b812c85494a49898376a0dd8140f03c Oct 04 18:40:23.101653 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-SecurityGroupsTestJSON-209295605 Oct 04 18:40:23.101653 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 18:40:23.101653 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 18:40:23.101653 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/7b812c85494a49898376a0dd8140f03c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_7b812c85494a49898376a0dd8140f03c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/7b812c85494a49898376a0dd8140f03c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/7b812c85494a49898376a0dd8140f03c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:40:23.101653 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-SecurityGroupsTestJSON-209295605 Oct 04 18:40:23.101653 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: 7b812c85494a49898376a0dd8140f03c Oct 04 18:40:23.101653 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-209295605 Oct 04 18:40:23.101653 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-SecurityGroupsTestJSON-209295605-project Oct 04 18:40:23.101653 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 18:40:23.101653 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 18:40:23.101653 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: 5c96ec8b8e0a4053b0457f213e6e262d Oct 04 18:40:23.101653 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-SecurityGroupsTestJSON-209295605-project Oct 04 18:40:23.101653 n-d-851028-13 devstack@n-api.service[123595]: method: Oct 04 18:40:23.101653 n-d-851028-13 devstack@n-api.service[123595]: exception: Security group 1b3ff7cc-e1a4-4a6b-a935-b44264658284 does not exist Oct 04 18:40:23.101653 n-d-851028-13 devstack@n-api.service[123595]: Neutron server returns request_ids: ['req-8e73f631-972d-4e50-ad73-4c1dcbccbb5e'] Oct 04 18:40:23.101653 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': '1b3ff7cc-e1a4-4a6b-a935-b44264658284'} Oct 04 18:40:23.101653 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:40:23.101653 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:40:23.101653 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 04 18:40:23.101653 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 04 18:40:23.101653 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:40:23.101653 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:40:23.101653 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 04 18:40:23.101653 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 04 18:40:23.101653 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:40:23.101653 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:40:23.101653 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 18:40:23.101653 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 18:40:23.101653 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:40:23.101653 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:40:23.101653 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 18:40:23.101653 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 18:40:23.101653 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:40:23.101653 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:40:23.101653 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 18:40:23.101653 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 18:40:23.101653 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:40:23.101653 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:40:23.101653 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 18:40:23.101653 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 18:40:23.101653 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 18:40:23.101653 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 18:40:23.101653 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 1b3ff7cc-e1a4-4a6b-a935-b44264658284 does not exist Oct 04 18:40:23.109146 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8e73f631-972d-4e50-ad73-4c1dcbccbb5e'] Oct 04 18:40:23.109146 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:40:23.109146 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:40:23.109146 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:40:23.109146 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:40:23.109146 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 04 18:40:23.109146 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 04 18:40:23.109146 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 04 18:40:23.109146 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 18:40:23.109146 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 1b3ff7cc-e1a4-4a6b-a935-b44264658284 does not exist Oct 04 18:40:23.109146 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8e73f631-972d-4e50-ad73-4c1dcbccbb5e'] Oct 04 18:40:23.109146 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:40:23.109146 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:40:23.109146 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:40:23.109146 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:40:23.109146 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:40:23.109146 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:40:23.109146 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:40:23.109146 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:40:23.109146 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:40:23.109146 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:40:23.109146 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:40:23.109146 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:40:23.109146 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 04 18:40:23.109146 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 04 18:40:23.109146 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 1b3ff7cc-e1a4-4a6b-a935-b44264658284 does not exist Oct 04 18:40:23.109146 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8e73f631-972d-4e50-ad73-4c1dcbccbb5e'] Oct 04 18:40:23.109146 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:40:23.109146 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:40:23.109146 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:40:23.109146 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:40:23.109146 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:40:23.109146 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:40:23.109146 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:40:23.109146 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:40:23.109146 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 1b3ff7cc-e1a4-4a6b-a935-b44264658284 does not exist Oct 04 18:40:23.109146 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8e73f631-972d-4e50-ad73-4c1dcbccbb5e'] Oct 04 18:40:23.109146 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:40:23.109146 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-3eb170c8-be73-4b58-90d8-960e27cb70ed tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Returning 404 to user: Security group 1b3ff7cc-e1a4-4a6b-a935-b44264658284 does not exist Oct 04 18:40:23.109146 n-d-851028-13 devstack@n-api.service[123595]: Neutron server returns request_ids: ['req-8e73f631-972d-4e50-ad73-4c1dcbccbb5e'] {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:40:23.109146 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-3eb170c8-be73-4b58-90d8-960e27cb70ed tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] 10.222.0.43 "DELETE /compute/v2.1/os-security-groups/1b3ff7cc-e1a4-4a6b-a935-b44264658284" status: 404 len: 194 microversion: 2.1 time: 0.226271 Oct 04 18:40:23.109146 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1124/2407] 10.222.0.43 () {58 vars in 1272 bytes} [Tue Oct 4 18:40:22 2022] DELETE /compute/v2.1/os-security-groups/1b3ff7cc-e1a4-4a6b-a935-b44264658284 => generated 194 bytes in 227 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:40:23.113600 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-b1d965fb-ba27-4db1-9a43-d9c0b1f8a4e0 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:23.114230 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-b1d965fb-ba27-4db1-9a43-d9c0b1f8a4e0 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: d9d4332a-97b6-40f1-bd7c-a9a75a9adc43] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:23.135199 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b1d965fb-ba27-4db1-9a43-d9c0b1f8a4e0 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:23.137594 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b1d965fb-ba27-4db1-9a43-d9c0b1f8a4e0 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:23.139115 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b1d965fb-ba27-4db1-9a43-d9c0b1f8a4e0 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:23.140001 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b1d965fb-ba27-4db1-9a43-d9c0b1f8a4e0 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:23.142849 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b1d965fb-ba27-4db1-9a43-d9c0b1f8a4e0 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:23.143632 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b1d965fb-ba27-4db1-9a43-d9c0b1f8a4e0 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:23.441382 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-b1d965fb-ba27-4db1-9a43-d9c0b1f8a4e0 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:23.466260 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-b1d965fb-ba27-4db1-9a43-d9c0b1f8a4e0 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/d9d4332a-97b6-40f1-bd7c-a9a75a9adc43" status: 200 len: 1541 microversion: 2.1 time: 0.359125 Oct 04 18:40:23.469496 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1125/2408] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:23 2022] GET /compute/v2.1/servers/d9d4332a-97b6-40f1-bd7c-a9a75a9adc43 => generated 1541 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:23.480376 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-549d393a-7bc3-498b-82df-bc74ba05e79d tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Calling method '.version_select at 0x7fb21fb2ae50>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:23.641443 n-d-851028-13 devstack@n-api.service[123595]: DEBUG neutronclient.v2_0.client [None req-549d393a-7bc3-498b-82df-bc74ba05e79d tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group a2a35cbf-fccc-4ba6-b493-2ef76c8c84ea does not exist", "detail": ""}} {{(pid=123595) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 18:40:23.642050 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.network.security_group_api [None req-549d393a-7bc3-498b-82df-bc74ba05e79d tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Neutron security group a2a35cbf-fccc-4ba6-b493-2ef76c8c84ea not found {{(pid=123595) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 04 18:40:23.642576 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-549d393a-7bc3-498b-82df-bc74ba05e79d tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] HTTP exception thrown: Security group a2a35cbf-fccc-4ba6-b493-2ef76c8c84ea does not exist Oct 04 18:40:23.642576 n-d-851028-13 devstack@n-api.service[123595]: Neutron server returns request_ids: ['req-8482329c-19de-4d56-9d56-f7ca92df980c'] Oct 04 18:40:23.644492 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-549d393a-7bc3-498b-82df-bc74ba05e79d tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Request method failure captured: Oct 04 18:40:23.644492 n-d-851028-13 devstack@n-api.service[123595]: request: DELETE /compute/v2.1/os-security-groups/a2a35cbf-fccc-4ba6-b493-2ef76c8c84ea HTTP/1.1 Oct 04 18:40:23.644492 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 18:40:23.644492 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 18:40:23.644492 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 18:40:23.644492 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 0 Oct 04 18:40:23.644492 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 18:40:23.644492 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 18:40:23.644492 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 18:40:23.644492 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 18:40:23.644492 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPH2qE2WsiZvVd-vvN1M8uHJG40fIXDT1XURP-P4ciVfKnbP_2tplzYndj2wlvB6bSu_VMaD1xfU0nGHRYWQRmNIt_krh_S1n2RkrhietTC0-RnvJ1rzF8ilPx8zowbVefo7A8IyDn5QTaMC08kHUNyiYinJQT_Q7n9enahWrBitVOPM Oct 04 18:40:23.644492 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 18:40:23.644492 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 18:40:23.644492 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 18:40:23.644492 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 18:40:23.644492 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 18:40:23.644492 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 18:40:23.644492 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: 7b812c85494a49898376a0dd8140f03c Oct 04 18:40:23.644492 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-SecurityGroupsTestJSON-209295605 Oct 04 18:40:23.644492 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 18:40:23.644492 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 18:40:23.644492 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/7b812c85494a49898376a0dd8140f03c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_7b812c85494a49898376a0dd8140f03c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/7b812c85494a49898376a0dd8140f03c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/7b812c85494a49898376a0dd8140f03c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:40:23.644492 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-SecurityGroupsTestJSON-209295605 Oct 04 18:40:23.644492 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: 7b812c85494a49898376a0dd8140f03c Oct 04 18:40:23.644492 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-209295605 Oct 04 18:40:23.644492 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-SecurityGroupsTestJSON-209295605-project Oct 04 18:40:23.644492 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 18:40:23.644492 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 18:40:23.644492 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: 5c96ec8b8e0a4053b0457f213e6e262d Oct 04 18:40:23.644492 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-SecurityGroupsTestJSON-209295605-project Oct 04 18:40:23.644492 n-d-851028-13 devstack@n-api.service[123595]: method: Oct 04 18:40:23.644492 n-d-851028-13 devstack@n-api.service[123595]: exception: Security group a2a35cbf-fccc-4ba6-b493-2ef76c8c84ea does not exist Oct 04 18:40:23.644492 n-d-851028-13 devstack@n-api.service[123595]: Neutron server returns request_ids: ['req-8482329c-19de-4d56-9d56-f7ca92df980c'] Oct 04 18:40:23.644492 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': 'a2a35cbf-fccc-4ba6-b493-2ef76c8c84ea'} Oct 04 18:40:23.644492 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:40:23.644492 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:40:23.644492 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 04 18:40:23.644492 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 04 18:40:23.644492 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:40:23.644492 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:40:23.644492 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 04 18:40:23.644492 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 04 18:40:23.644492 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:40:23.644492 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:40:23.644492 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 18:40:23.644492 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 18:40:23.644492 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:40:23.644492 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:40:23.644492 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 18:40:23.644492 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 18:40:23.644492 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:40:23.644492 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:40:23.644492 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 18:40:23.644492 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 18:40:23.644492 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:40:23.644492 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:40:23.644492 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 18:40:23.644492 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 18:40:23.644492 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 18:40:23.644492 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 18:40:23.644492 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group a2a35cbf-fccc-4ba6-b493-2ef76c8c84ea does not exist Oct 04 18:40:23.648433 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8482329c-19de-4d56-9d56-f7ca92df980c'] Oct 04 18:40:23.648433 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:40:23.648433 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:40:23.648433 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:40:23.648433 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:40:23.648433 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 04 18:40:23.648433 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 04 18:40:23.648433 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 04 18:40:23.648433 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 18:40:23.648433 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group a2a35cbf-fccc-4ba6-b493-2ef76c8c84ea does not exist Oct 04 18:40:23.648433 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8482329c-19de-4d56-9d56-f7ca92df980c'] Oct 04 18:40:23.648433 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:40:23.648433 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:40:23.648433 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:40:23.648433 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:40:23.648433 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:40:23.648433 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:40:23.648433 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:40:23.648433 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:40:23.648433 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:40:23.648433 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:40:23.648433 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:40:23.648433 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:40:23.648433 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 04 18:40:23.648433 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 04 18:40:23.648433 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group a2a35cbf-fccc-4ba6-b493-2ef76c8c84ea does not exist Oct 04 18:40:23.648433 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8482329c-19de-4d56-9d56-f7ca92df980c'] Oct 04 18:40:23.648433 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:40:23.648433 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:40:23.648433 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:40:23.648433 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:40:23.648433 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:40:23.648433 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:40:23.648433 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:40:23.648433 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:40:23.648433 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group a2a35cbf-fccc-4ba6-b493-2ef76c8c84ea does not exist Oct 04 18:40:23.648433 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8482329c-19de-4d56-9d56-f7ca92df980c'] Oct 04 18:40:23.648433 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:40:23.648433 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-549d393a-7bc3-498b-82df-bc74ba05e79d tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Returning 404 to user: Security group a2a35cbf-fccc-4ba6-b493-2ef76c8c84ea does not exist Oct 04 18:40:23.648433 n-d-851028-13 devstack@n-api.service[123595]: Neutron server returns request_ids: ['req-8482329c-19de-4d56-9d56-f7ca92df980c'] {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:40:23.648433 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-549d393a-7bc3-498b-82df-bc74ba05e79d tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] 10.222.0.43 "DELETE /compute/v2.1/os-security-groups/a2a35cbf-fccc-4ba6-b493-2ef76c8c84ea" status: 404 len: 194 microversion: 2.1 time: 0.175236 Oct 04 18:40:23.648433 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1126/2409] 10.222.0.43 () {58 vars in 1272 bytes} [Tue Oct 4 18:40:23 2022] DELETE /compute/v2.1/os-security-groups/a2a35cbf-fccc-4ba6-b493-2ef76c8c84ea => generated 194 bytes in 176 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:40:23.655844 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-e27af885-a0dd-4ae3-a924-ac7fcb0bf0cc tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:23.656485 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-e27af885-a0dd-4ae3-a924-ac7fcb0bf0cc tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] [instance: b53d822f-e7b1-498a-b98a-35f87839dfe8] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:23.667869 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e27af885-a0dd-4ae3-a924-ac7fcb0bf0cc tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:23.668830 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e27af885-a0dd-4ae3-a924-ac7fcb0bf0cc tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:23.670111 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e27af885-a0dd-4ae3-a924-ac7fcb0bf0cc tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:23.671542 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e27af885-a0dd-4ae3-a924-ac7fcb0bf0cc tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:23.672674 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e27af885-a0dd-4ae3-a924-ac7fcb0bf0cc tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:23.673713 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e27af885-a0dd-4ae3-a924-ac7fcb0bf0cc tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:23.812031 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-e27af885-a0dd-4ae3-a924-ac7fcb0bf0cc tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e1add2296c4ed5830c5d90ef272ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fdc44ceeb041bcba1be2fcc2084aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:23.822861 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-e27af885-a0dd-4ae3-a924-ac7fcb0bf0cc tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59e1add2296c4ed5830c5d90ef272ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fdc44ceeb041bcba1be2fcc2084aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:23.824990 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-e27af885-a0dd-4ae3-a924-ac7fcb0bf0cc tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59e1add2296c4ed5830c5d90ef272ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fdc44ceeb041bcba1be2fcc2084aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:23.826292 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-e27af885-a0dd-4ae3-a924-ac7fcb0bf0cc tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] 10.222.0.43 "GET /compute/v2.1/servers/b53d822f-e7b1-498a-b98a-35f87839dfe8" status: 200 len: 1409 microversion: 2.54 time: 0.178676 Oct 04 18:40:23.830485 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1127/2410] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:40:23 2022] GET /compute/v2.1/servers/b53d822f-e7b1-498a-b98a-35f87839dfe8 => generated 1409 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:40:23.836179 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-59bc58dd-302a-4a80-8f0d-49463874413d tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Calling method '.version_select at 0x7fb21fb2ae50>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:23.862296 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-00f45325-836e-4735-aac2-2b079ec88754 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15432d1b74334e1188866004384befe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d562b670294a47b2171f4003be4cdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:23.915586 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-00f45325-836e-4735-aac2-2b079ec88754 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] 10.222.0.43 "GET /compute/v2.1/servers/ffbbf357-494a-40e4-8943-3159707fc2e4" status: 200 len: 1323 microversion: 2.1 time: 0.935734 Oct 04 18:40:23.945605 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1284/2411] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:22 2022] GET /compute/v2.1/servers/ffbbf357-494a-40e4-8943-3159707fc2e4 => generated 1323 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:23.964062 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-3225874c-54d7-4668-9286-e68b7634efcb tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:23.964920 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-3225874c-54d7-4668-9286-e68b7634efcb tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] [instance: 1a71ee0e-ffa8-4730-b4fb-8b6e9fd87239] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:23.984584 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3225874c-54d7-4668-9286-e68b7634efcb tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:23.985436 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3225874c-54d7-4668-9286-e68b7634efcb tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:23.986093 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3225874c-54d7-4668-9286-e68b7634efcb tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:23.986982 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3225874c-54d7-4668-9286-e68b7634efcb tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:23.987759 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-59bc58dd-302a-4a80-8f0d-49463874413d tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] 10.222.0.43 "GET /compute/v2.1/images/e4d3e808-f1b4-4480-90f6-79b6d4964f47" status: 200 len: 1455 microversion: 2.1 time: 0.155413 Oct 04 18:40:23.988728 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3225874c-54d7-4668-9286-e68b7634efcb tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:23.989202 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1128/2412] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 18:40:23 2022] GET /compute/v2.1/images/e4d3e808-f1b4-4480-90f6-79b6d4964f47 => generated 1455 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:23.989647 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3225874c-54d7-4668-9286-e68b7634efcb tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:24.001846 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-14d28489-a244-4d4b-a1be-b85c8d1eab7c tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Calling method '.version_select at 0x7fb227d5d820>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:24.128489 n-d-851028-13 devstack@n-api.service[123595]: DEBUG neutronclient.v2_0.client [None req-14d28489-a244-4d4b-a1be-b85c8d1eab7c tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 0941539c-f752-482a-9d50-4c191967eac7 does not exist", "detail": ""}} {{(pid=123595) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 18:40:24.129238 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.network.security_group_api [None req-14d28489-a244-4d4b-a1be-b85c8d1eab7c tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Neutron security group 0941539c-f752-482a-9d50-4c191967eac7 not found {{(pid=123595) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 04 18:40:24.129885 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-14d28489-a244-4d4b-a1be-b85c8d1eab7c tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] HTTP exception thrown: Security group 0941539c-f752-482a-9d50-4c191967eac7 does not exist Oct 04 18:40:24.129885 n-d-851028-13 devstack@n-api.service[123595]: Neutron server returns request_ids: ['req-21bc80e3-2ab8-4e3d-b391-c0a641aedfe7'] Oct 04 18:40:24.132260 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-14d28489-a244-4d4b-a1be-b85c8d1eab7c tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Request method failure captured: Oct 04 18:40:24.132260 n-d-851028-13 devstack@n-api.service[123595]: request: DELETE /compute/v2.1/os-security-groups/0941539c-f752-482a-9d50-4c191967eac7 HTTP/1.1 Oct 04 18:40:24.132260 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 18:40:24.132260 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 18:40:24.132260 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 18:40:24.132260 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 0 Oct 04 18:40:24.132260 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 18:40:24.132260 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 18:40:24.132260 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 18:40:24.132260 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 18:40:24.132260 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPH2qE2WsiZvVd-vvN1M8uHJG40fIXDT1XURP-P4ciVfKnbP_2tplzYndj2wlvB6bSu_VMaD1xfU0nGHRYWQRmNIt_krh_S1n2RkrhietTC0-RnvJ1rzF8ilPx8zowbVefo7A8IyDn5QTaMC08kHUNyiYinJQT_Q7n9enahWrBitVOPM Oct 04 18:40:24.132260 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 18:40:24.132260 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 18:40:24.132260 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 18:40:24.132260 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 18:40:24.132260 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 18:40:24.132260 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 18:40:24.132260 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: 7b812c85494a49898376a0dd8140f03c Oct 04 18:40:24.132260 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-SecurityGroupsTestJSON-209295605 Oct 04 18:40:24.132260 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 18:40:24.132260 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 18:40:24.132260 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/7b812c85494a49898376a0dd8140f03c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_7b812c85494a49898376a0dd8140f03c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/7b812c85494a49898376a0dd8140f03c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/7b812c85494a49898376a0dd8140f03c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:40:24.132260 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-SecurityGroupsTestJSON-209295605 Oct 04 18:40:24.132260 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: 7b812c85494a49898376a0dd8140f03c Oct 04 18:40:24.132260 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-209295605 Oct 04 18:40:24.132260 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-SecurityGroupsTestJSON-209295605-project Oct 04 18:40:24.132260 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 18:40:24.132260 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 18:40:24.132260 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: 5c96ec8b8e0a4053b0457f213e6e262d Oct 04 18:40:24.132260 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-SecurityGroupsTestJSON-209295605-project Oct 04 18:40:24.132260 n-d-851028-13 devstack@n-api.service[123595]: method: Oct 04 18:40:24.132260 n-d-851028-13 devstack@n-api.service[123595]: exception: Security group 0941539c-f752-482a-9d50-4c191967eac7 does not exist Oct 04 18:40:24.132260 n-d-851028-13 devstack@n-api.service[123595]: Neutron server returns request_ids: ['req-21bc80e3-2ab8-4e3d-b391-c0a641aedfe7'] Oct 04 18:40:24.132260 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': '0941539c-f752-482a-9d50-4c191967eac7'} Oct 04 18:40:24.132260 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:40:24.132260 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:40:24.132260 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 04 18:40:24.132260 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 04 18:40:24.132260 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:40:24.132260 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:40:24.132260 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 04 18:40:24.132260 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 04 18:40:24.132260 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:40:24.132260 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:40:24.132260 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 18:40:24.132260 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 18:40:24.132260 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:40:24.132260 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:40:24.132260 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 18:40:24.132260 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 18:40:24.132260 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:40:24.132260 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:40:24.132260 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 18:40:24.132260 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 18:40:24.132260 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:40:24.132260 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:40:24.132260 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 18:40:24.132260 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 18:40:24.132260 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 18:40:24.132260 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 18:40:24.132260 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 0941539c-f752-482a-9d50-4c191967eac7 does not exist Oct 04 18:40:24.136475 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-21bc80e3-2ab8-4e3d-b391-c0a641aedfe7'] Oct 04 18:40:24.136475 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:40:24.136475 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:40:24.136475 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:40:24.136475 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:40:24.136475 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 04 18:40:24.136475 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 04 18:40:24.136475 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 04 18:40:24.136475 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 18:40:24.136475 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 0941539c-f752-482a-9d50-4c191967eac7 does not exist Oct 04 18:40:24.136475 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-21bc80e3-2ab8-4e3d-b391-c0a641aedfe7'] Oct 04 18:40:24.136475 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:40:24.136475 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:40:24.136475 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:40:24.136475 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:40:24.136475 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:40:24.136475 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:40:24.136475 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:40:24.136475 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:40:24.136475 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:40:24.136475 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:40:24.136475 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:40:24.136475 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:40:24.136475 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 04 18:40:24.136475 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 04 18:40:24.136475 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 0941539c-f752-482a-9d50-4c191967eac7 does not exist Oct 04 18:40:24.136475 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-21bc80e3-2ab8-4e3d-b391-c0a641aedfe7'] Oct 04 18:40:24.136475 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:40:24.136475 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:40:24.136475 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:40:24.136475 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:40:24.136475 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:40:24.136475 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:40:24.136475 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:40:24.136475 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:40:24.136475 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 0941539c-f752-482a-9d50-4c191967eac7 does not exist Oct 04 18:40:24.136475 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-21bc80e3-2ab8-4e3d-b391-c0a641aedfe7'] Oct 04 18:40:24.136475 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:40:24.136475 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-14d28489-a244-4d4b-a1be-b85c8d1eab7c tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Returning 404 to user: Security group 0941539c-f752-482a-9d50-4c191967eac7 does not exist Oct 04 18:40:24.136475 n-d-851028-13 devstack@n-api.service[123595]: Neutron server returns request_ids: ['req-21bc80e3-2ab8-4e3d-b391-c0a641aedfe7'] {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:40:24.144245 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-14d28489-a244-4d4b-a1be-b85c8d1eab7c tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] 10.222.0.43 "DELETE /compute/v2.1/os-security-groups/0941539c-f752-482a-9d50-4c191967eac7" status: 404 len: 194 microversion: 2.1 time: 0.139941 Oct 04 18:40:24.144245 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1129/2413] 10.222.0.43 () {58 vars in 1272 bytes} [Tue Oct 4 18:40:23 2022] DELETE /compute/v2.1/os-security-groups/0941539c-f752-482a-9d50-4c191967eac7 => generated 194 bytes in 148 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:40:24.153623 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-ee762642-f16d-4150-9cbb-060a5b003f76 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Calling method '.version_select at 0x7fb21fa8a310>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:24.286457 n-d-851028-13 devstack@n-api.service[123595]: DEBUG neutronclient.v2_0.client [None req-ee762642-f16d-4150-9cbb-060a5b003f76 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group c9cce38d-5b32-4d55-a383-233f41add94d does not exist", "detail": ""}} {{(pid=123595) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 18:40:24.287405 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.network.security_group_api [None req-ee762642-f16d-4150-9cbb-060a5b003f76 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Neutron security group c9cce38d-5b32-4d55-a383-233f41add94d not found {{(pid=123595) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 04 18:40:24.292989 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-ee762642-f16d-4150-9cbb-060a5b003f76 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] HTTP exception thrown: Security group c9cce38d-5b32-4d55-a383-233f41add94d does not exist Oct 04 18:40:24.292989 n-d-851028-13 devstack@n-api.service[123595]: Neutron server returns request_ids: ['req-18d89f8c-f5aa-4f8b-af2a-4618977bfedc'] Oct 04 18:40:24.295467 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-ee762642-f16d-4150-9cbb-060a5b003f76 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Request method failure captured: Oct 04 18:40:24.295467 n-d-851028-13 devstack@n-api.service[123595]: request: DELETE /compute/v2.1/os-security-groups/c9cce38d-5b32-4d55-a383-233f41add94d HTTP/1.1 Oct 04 18:40:24.295467 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 18:40:24.295467 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 18:40:24.295467 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 18:40:24.295467 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 0 Oct 04 18:40:24.295467 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 18:40:24.295467 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 18:40:24.295467 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 18:40:24.295467 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 18:40:24.295467 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPH2qE2WsiZvVd-vvN1M8uHJG40fIXDT1XURP-P4ciVfKnbP_2tplzYndj2wlvB6bSu_VMaD1xfU0nGHRYWQRmNIt_krh_S1n2RkrhietTC0-RnvJ1rzF8ilPx8zowbVefo7A8IyDn5QTaMC08kHUNyiYinJQT_Q7n9enahWrBitVOPM Oct 04 18:40:24.295467 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 18:40:24.295467 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 18:40:24.295467 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 18:40:24.295467 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 18:40:24.295467 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 18:40:24.295467 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 18:40:24.295467 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: 7b812c85494a49898376a0dd8140f03c Oct 04 18:40:24.295467 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-SecurityGroupsTestJSON-209295605 Oct 04 18:40:24.295467 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 18:40:24.295467 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 18:40:24.295467 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/7b812c85494a49898376a0dd8140f03c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_7b812c85494a49898376a0dd8140f03c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/7b812c85494a49898376a0dd8140f03c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/7b812c85494a49898376a0dd8140f03c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:40:24.295467 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-SecurityGroupsTestJSON-209295605 Oct 04 18:40:24.295467 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: 7b812c85494a49898376a0dd8140f03c Oct 04 18:40:24.295467 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-209295605 Oct 04 18:40:24.295467 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-SecurityGroupsTestJSON-209295605-project Oct 04 18:40:24.295467 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 18:40:24.295467 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 18:40:24.295467 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: 5c96ec8b8e0a4053b0457f213e6e262d Oct 04 18:40:24.295467 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-SecurityGroupsTestJSON-209295605-project Oct 04 18:40:24.295467 n-d-851028-13 devstack@n-api.service[123595]: method: Oct 04 18:40:24.295467 n-d-851028-13 devstack@n-api.service[123595]: exception: Security group c9cce38d-5b32-4d55-a383-233f41add94d does not exist Oct 04 18:40:24.295467 n-d-851028-13 devstack@n-api.service[123595]: Neutron server returns request_ids: ['req-18d89f8c-f5aa-4f8b-af2a-4618977bfedc'] Oct 04 18:40:24.295467 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': 'c9cce38d-5b32-4d55-a383-233f41add94d'} Oct 04 18:40:24.295467 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:40:24.295467 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:40:24.295467 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 04 18:40:24.295467 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 04 18:40:24.295467 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:40:24.295467 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:40:24.295467 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 04 18:40:24.295467 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 04 18:40:24.295467 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:40:24.295467 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:40:24.295467 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 18:40:24.295467 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 18:40:24.295467 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:40:24.295467 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:40:24.295467 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 18:40:24.295467 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 18:40:24.295467 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:40:24.295467 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:40:24.295467 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 18:40:24.295467 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 18:40:24.295467 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:40:24.295467 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:40:24.295467 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 18:40:24.295467 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 18:40:24.295467 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 18:40:24.295467 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 18:40:24.295467 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group c9cce38d-5b32-4d55-a383-233f41add94d does not exist Oct 04 18:40:24.298698 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-18d89f8c-f5aa-4f8b-af2a-4618977bfedc'] Oct 04 18:40:24.298698 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:40:24.298698 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:40:24.298698 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:40:24.298698 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:40:24.298698 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 04 18:40:24.298698 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 04 18:40:24.298698 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 04 18:40:24.298698 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 18:40:24.298698 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group c9cce38d-5b32-4d55-a383-233f41add94d does not exist Oct 04 18:40:24.298698 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-18d89f8c-f5aa-4f8b-af2a-4618977bfedc'] Oct 04 18:40:24.298698 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:40:24.298698 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:40:24.298698 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:40:24.298698 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:40:24.298698 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:40:24.298698 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:40:24.298698 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:40:24.298698 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:40:24.298698 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:40:24.298698 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:40:24.298698 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:40:24.298698 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:40:24.298698 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 04 18:40:24.298698 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 04 18:40:24.298698 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group c9cce38d-5b32-4d55-a383-233f41add94d does not exist Oct 04 18:40:24.298698 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-18d89f8c-f5aa-4f8b-af2a-4618977bfedc'] Oct 04 18:40:24.298698 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:40:24.298698 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:40:24.298698 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:40:24.298698 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:40:24.298698 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:40:24.298698 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:40:24.298698 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:40:24.298698 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:40:24.298698 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group c9cce38d-5b32-4d55-a383-233f41add94d does not exist Oct 04 18:40:24.298698 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-18d89f8c-f5aa-4f8b-af2a-4618977bfedc'] Oct 04 18:40:24.298698 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:40:24.302683 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-ee762642-f16d-4150-9cbb-060a5b003f76 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Returning 404 to user: Security group c9cce38d-5b32-4d55-a383-233f41add94d does not exist Oct 04 18:40:24.302683 n-d-851028-13 devstack@n-api.service[123595]: Neutron server returns request_ids: ['req-18d89f8c-f5aa-4f8b-af2a-4618977bfedc'] {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:40:24.303776 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-ee762642-f16d-4150-9cbb-060a5b003f76 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] 10.222.0.43 "DELETE /compute/v2.1/os-security-groups/c9cce38d-5b32-4d55-a383-233f41add94d" status: 404 len: 194 microversion: 2.1 time: 0.161409 Oct 04 18:40:24.304856 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1130/2414] 10.222.0.43 () {58 vars in 1272 bytes} [Tue Oct 4 18:40:24 2022] DELETE /compute/v2.1/os-security-groups/c9cce38d-5b32-4d55-a383-233f41add94d => generated 194 bytes in 163 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:40:24.314177 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-aa56d0a6-d883-4fe5-b195-ab774b79c832 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Calling method '.version_select at 0x7fb227d5d160>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:24.347852 n-d-851028-13 devstack@n-api.service[123595]: DEBUG neutronclient.v2_0.client [None req-aa56d0a6-d883-4fe5-b195-ab774b79c832 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 61d22f84-7693-4a39-940b-e055aab76027 does not exist", "detail": ""}} {{(pid=123595) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 18:40:24.348701 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.network.security_group_api [None req-aa56d0a6-d883-4fe5-b195-ab774b79c832 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Neutron security group 61d22f84-7693-4a39-940b-e055aab76027 not found {{(pid=123595) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 04 18:40:24.349464 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-aa56d0a6-d883-4fe5-b195-ab774b79c832 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] HTTP exception thrown: Security group 61d22f84-7693-4a39-940b-e055aab76027 does not exist Oct 04 18:40:24.349464 n-d-851028-13 devstack@n-api.service[123595]: Neutron server returns request_ids: ['req-d61b4f36-79f2-4572-a827-eb3605dc03ea'] Oct 04 18:40:24.351558 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-aa56d0a6-d883-4fe5-b195-ab774b79c832 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Request method failure captured: Oct 04 18:40:24.351558 n-d-851028-13 devstack@n-api.service[123595]: request: DELETE /compute/v2.1/os-security-groups/61d22f84-7693-4a39-940b-e055aab76027 HTTP/1.1 Oct 04 18:40:24.351558 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 18:40:24.351558 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 18:40:24.351558 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 18:40:24.351558 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 0 Oct 04 18:40:24.351558 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 18:40:24.351558 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 18:40:24.351558 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 18:40:24.351558 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 18:40:24.351558 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPH2qE2WsiZvVd-vvN1M8uHJG40fIXDT1XURP-P4ciVfKnbP_2tplzYndj2wlvB6bSu_VMaD1xfU0nGHRYWQRmNIt_krh_S1n2RkrhietTC0-RnvJ1rzF8ilPx8zowbVefo7A8IyDn5QTaMC08kHUNyiYinJQT_Q7n9enahWrBitVOPM Oct 04 18:40:24.351558 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 18:40:24.351558 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 18:40:24.351558 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 18:40:24.351558 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 18:40:24.351558 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 18:40:24.351558 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 18:40:24.351558 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: 7b812c85494a49898376a0dd8140f03c Oct 04 18:40:24.351558 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-SecurityGroupsTestJSON-209295605 Oct 04 18:40:24.351558 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 18:40:24.351558 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 18:40:24.351558 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/7b812c85494a49898376a0dd8140f03c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_7b812c85494a49898376a0dd8140f03c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/7b812c85494a49898376a0dd8140f03c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/7b812c85494a49898376a0dd8140f03c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:40:24.351558 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-SecurityGroupsTestJSON-209295605 Oct 04 18:40:24.351558 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: 7b812c85494a49898376a0dd8140f03c Oct 04 18:40:24.351558 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-209295605 Oct 04 18:40:24.351558 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-SecurityGroupsTestJSON-209295605-project Oct 04 18:40:24.351558 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 18:40:24.351558 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 18:40:24.351558 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: 5c96ec8b8e0a4053b0457f213e6e262d Oct 04 18:40:24.351558 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-SecurityGroupsTestJSON-209295605-project Oct 04 18:40:24.351558 n-d-851028-13 devstack@n-api.service[123595]: method: Oct 04 18:40:24.351558 n-d-851028-13 devstack@n-api.service[123595]: exception: Security group 61d22f84-7693-4a39-940b-e055aab76027 does not exist Oct 04 18:40:24.351558 n-d-851028-13 devstack@n-api.service[123595]: Neutron server returns request_ids: ['req-d61b4f36-79f2-4572-a827-eb3605dc03ea'] Oct 04 18:40:24.351558 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': '61d22f84-7693-4a39-940b-e055aab76027'} Oct 04 18:40:24.351558 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:40:24.351558 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:40:24.351558 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 04 18:40:24.351558 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 04 18:40:24.351558 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:40:24.351558 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:40:24.351558 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 04 18:40:24.351558 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 04 18:40:24.351558 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:40:24.351558 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:40:24.351558 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 18:40:24.351558 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 18:40:24.351558 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:40:24.351558 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:40:24.351558 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 18:40:24.351558 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 18:40:24.351558 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:40:24.351558 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:40:24.351558 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 18:40:24.351558 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 18:40:24.351558 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:40:24.351558 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:40:24.351558 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 18:40:24.351558 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 18:40:24.351558 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 18:40:24.351558 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 18:40:24.351558 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 61d22f84-7693-4a39-940b-e055aab76027 does not exist Oct 04 18:40:24.355388 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d61b4f36-79f2-4572-a827-eb3605dc03ea'] Oct 04 18:40:24.355388 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:40:24.355388 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:40:24.355388 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:40:24.355388 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:40:24.355388 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 04 18:40:24.355388 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 04 18:40:24.355388 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 04 18:40:24.355388 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 18:40:24.355388 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 61d22f84-7693-4a39-940b-e055aab76027 does not exist Oct 04 18:40:24.355388 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d61b4f36-79f2-4572-a827-eb3605dc03ea'] Oct 04 18:40:24.355388 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:40:24.355388 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:40:24.355388 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:40:24.355388 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:40:24.355388 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:40:24.355388 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:40:24.355388 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:40:24.355388 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:40:24.355388 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:40:24.355388 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:40:24.355388 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:40:24.355388 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:40:24.355388 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 04 18:40:24.355388 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 04 18:40:24.355388 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 61d22f84-7693-4a39-940b-e055aab76027 does not exist Oct 04 18:40:24.355388 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d61b4f36-79f2-4572-a827-eb3605dc03ea'] Oct 04 18:40:24.355388 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:40:24.355388 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:40:24.355388 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:40:24.355388 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:40:24.355388 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:40:24.355388 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:40:24.355388 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:40:24.355388 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:40:24.355388 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 61d22f84-7693-4a39-940b-e055aab76027 does not exist Oct 04 18:40:24.355388 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d61b4f36-79f2-4572-a827-eb3605dc03ea'] Oct 04 18:40:24.355388 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:40:24.359662 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-aa56d0a6-d883-4fe5-b195-ab774b79c832 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Returning 404 to user: Security group 61d22f84-7693-4a39-940b-e055aab76027 does not exist Oct 04 18:40:24.359662 n-d-851028-13 devstack@n-api.service[123595]: Neutron server returns request_ids: ['req-d61b4f36-79f2-4572-a827-eb3605dc03ea'] {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:40:24.360825 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-aa56d0a6-d883-4fe5-b195-ab774b79c832 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] 10.222.0.43 "DELETE /compute/v2.1/os-security-groups/61d22f84-7693-4a39-940b-e055aab76027" status: 404 len: 194 microversion: 2.1 time: 0.052110 Oct 04 18:40:24.361611 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1131/2415] 10.222.0.43 () {58 vars in 1272 bytes} [Tue Oct 4 18:40:24 2022] DELETE /compute/v2.1/os-security-groups/61d22f84-7693-4a39-940b-e055aab76027 => generated 194 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:40:24.370468 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-3a0686b4-7087-454a-b721-be86585d8037 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:24.371810 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-3a0686b4-7087-454a-b721-be86585d8037 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] [instance: 23ce945d-cd4a-40d5-80be-d5548c257e07] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:24.382490 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3a0686b4-7087-454a-b721-be86585d8037 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:24.382965 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3a0686b4-7087-454a-b721-be86585d8037 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:24.383467 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3a0686b4-7087-454a-b721-be86585d8037 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:24.384622 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3a0686b4-7087-454a-b721-be86585d8037 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:24.385072 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3a0686b4-7087-454a-b721-be86585d8037 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:24.385595 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3a0686b4-7087-454a-b721-be86585d8037 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:24.465805 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-3a0686b4-7087-454a-b721-be86585d8037 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] [instance: 23ce945d-cd4a-40d5-80be-d5548c257e07] Going to try to terminate instance {{(pid=123595) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:40:24.571757 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-3225874c-54d7-4668-9286-e68b7634efcb tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a19da94e9e646028a7f73f9d0e0edda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc41f296eb44503868205ec8aa2fef3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:24.582498 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-3225874c-54d7-4668-9286-e68b7634efcb tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] 10.222.0.43 "GET /compute/v2.1/servers/1a71ee0e-ffa8-4730-b4fb-8b6e9fd87239" status: 200 len: 1498 microversion: 2.1 time: 0.632778 Oct 04 18:40:24.583174 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1285/2416] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:23 2022] GET /compute/v2.1/servers/1a71ee0e-ffa8-4730-b4fb-8b6e9fd87239 => generated 1498 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:24.614830 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-c7a2e53b-c7eb-4c5f-a01d-44ac2ea66546 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:24.615459 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-c7a2e53b-c7eb-4c5f-a01d-44ac2ea66546 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: d9d4332a-97b6-40f1-bd7c-a9a75a9adc43] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:24.632321 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c7a2e53b-c7eb-4c5f-a01d-44ac2ea66546 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:24.632829 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c7a2e53b-c7eb-4c5f-a01d-44ac2ea66546 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:24.633310 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c7a2e53b-c7eb-4c5f-a01d-44ac2ea66546 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:24.634670 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c7a2e53b-c7eb-4c5f-a01d-44ac2ea66546 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:24.635229 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c7a2e53b-c7eb-4c5f-a01d-44ac2ea66546 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:24.635816 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c7a2e53b-c7eb-4c5f-a01d-44ac2ea66546 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:24.641318 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-3a0686b4-7087-454a-b721-be86585d8037 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] 10.222.0.43 "DELETE /compute/v2.1/servers/23ce945d-cd4a-40d5-80be-d5548c257e07" status: 204 len: 0 microversion: 2.1 time: 0.272457 Oct 04 18:40:24.642465 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1132/2417] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 18:40:24 2022] DELETE /compute/v2.1/servers/23ce945d-cd4a-40d5-80be-d5548c257e07 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 18:40:24.653539 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-d652e6b8-210a-43c6-ae28-229210208f7f tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:24.661683 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-d652e6b8-210a-43c6-ae28-229210208f7f tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6a19da94e9e646028a7f73f9d0e0edda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc41f296eb44503868205ec8aa2fef3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:24.666708 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-d652e6b8-210a-43c6-ae28-229210208f7f tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': 'dfc41f296eb44503868205ec8aa2fef3'} {{(pid=123595) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:40:24.682148 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d652e6b8-210a-43c6-ae28-229210208f7f tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:24.682886 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d652e6b8-210a-43c6-ae28-229210208f7f tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:24.683535 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d652e6b8-210a-43c6-ae28-229210208f7f tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:24.684502 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d652e6b8-210a-43c6-ae28-229210208f7f tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:24.686869 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d652e6b8-210a-43c6-ae28-229210208f7f tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:24.687565 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d652e6b8-210a-43c6-ae28-229210208f7f tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:24.901142 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-c7a2e53b-c7eb-4c5f-a01d-44ac2ea66546 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:24.915489 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-c7a2e53b-c7eb-4c5f-a01d-44ac2ea66546 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/d9d4332a-97b6-40f1-bd7c-a9a75a9adc43" status: 200 len: 1473 microversion: 2.1 time: 0.307010 Oct 04 18:40:24.916987 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1286/2418] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:24 2022] GET /compute/v2.1/servers/d9d4332a-97b6-40f1-bd7c-a9a75a9adc43 => generated 1473 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:24.940622 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.multi_cell_list [None req-d652e6b8-210a-43c6-ae28-229210208f7f tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=123595) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 18:40:24.946826 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-0b4c6b07-e608-481e-bdb3-7ab2893b9469 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:24.947473 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-0b4c6b07-e608-481e-bdb3-7ab2893b9469 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] [instance: 23ce945d-cd4a-40d5-80be-d5548c257e07] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:24.971908 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0b4c6b07-e608-481e-bdb3-7ab2893b9469 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:24.972449 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0b4c6b07-e608-481e-bdb3-7ab2893b9469 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:24.973526 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0b4c6b07-e608-481e-bdb3-7ab2893b9469 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:24.974264 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0b4c6b07-e608-481e-bdb3-7ab2893b9469 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:24.975511 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0b4c6b07-e608-481e-bdb3-7ab2893b9469 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:24.975950 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0b4c6b07-e608-481e-bdb3-7ab2893b9469 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:25.076201 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-d652e6b8-210a-43c6-ae28-229210208f7f tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] 10.222.0.43 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 346 microversion: 2.1 time: 0.432279 Oct 04 18:40:25.084996 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1133/2419] 10.222.0.43 () {58 vars in 1154 bytes} [Tue Oct 4 18:40:24 2022] GET /compute/v2.1/servers?status=shutoff => generated 346 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:40:25.090854 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-b59e8c8d-6d9f-4444-8ece-e774a11ee498 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:25.091871 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-b59e8c8d-6d9f-4444-8ece-e774a11ee498 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] [instance: b53d822f-e7b1-498a-b98a-35f87839dfe8] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:25.109434 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b59e8c8d-6d9f-4444-8ece-e774a11ee498 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:25.111138 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b59e8c8d-6d9f-4444-8ece-e774a11ee498 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:25.111816 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b59e8c8d-6d9f-4444-8ece-e774a11ee498 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:25.112997 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b59e8c8d-6d9f-4444-8ece-e774a11ee498 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:25.113751 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b59e8c8d-6d9f-4444-8ece-e774a11ee498 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:25.114449 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b59e8c8d-6d9f-4444-8ece-e774a11ee498 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:25.200998 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-b59e8c8d-6d9f-4444-8ece-e774a11ee498 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e1add2296c4ed5830c5d90ef272ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fdc44ceeb041bcba1be2fcc2084aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:25.210915 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-b59e8c8d-6d9f-4444-8ece-e774a11ee498 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59e1add2296c4ed5830c5d90ef272ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fdc44ceeb041bcba1be2fcc2084aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:25.213987 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-b59e8c8d-6d9f-4444-8ece-e774a11ee498 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59e1add2296c4ed5830c5d90ef272ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fdc44ceeb041bcba1be2fcc2084aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:25.215517 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-b59e8c8d-6d9f-4444-8ece-e774a11ee498 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] 10.222.0.43 "GET /compute/v2.1/servers/b53d822f-e7b1-498a-b98a-35f87839dfe8" status: 200 len: 1409 microversion: 2.54 time: 0.129145 Oct 04 18:40:25.225525 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1134/2420] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:40:25 2022] GET /compute/v2.1/servers/b53d822f-e7b1-498a-b98a-35f87839dfe8 => generated 1409 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:40:25.225525 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-f1fc215e-d2cb-4990-9eb5-fc508de608ba tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:25.225525 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-f1fc215e-d2cb-4990-9eb5-fc508de608ba tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] [instance: ffbbf357-494a-40e4-8943-3159707fc2e4] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:25.236204 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f1fc215e-d2cb-4990-9eb5-fc508de608ba tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:25.236204 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f1fc215e-d2cb-4990-9eb5-fc508de608ba tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:25.236204 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f1fc215e-d2cb-4990-9eb5-fc508de608ba tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:25.237677 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f1fc215e-d2cb-4990-9eb5-fc508de608ba tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:25.238403 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f1fc215e-d2cb-4990-9eb5-fc508de608ba tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:25.238916 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f1fc215e-d2cb-4990-9eb5-fc508de608ba tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:25.496533 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-f1fc215e-d2cb-4990-9eb5-fc508de608ba tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15432d1b74334e1188866004384befe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d562b670294a47b2171f4003be4cdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:25.508168 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-f1fc215e-d2cb-4990-9eb5-fc508de608ba tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] 10.222.0.43 "GET /compute/v2.1/servers/ffbbf357-494a-40e4-8943-3159707fc2e4" status: 200 len: 1323 microversion: 2.1 time: 0.290199 Oct 04 18:40:25.509879 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1135/2421] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:25 2022] GET /compute/v2.1/servers/ffbbf357-494a-40e4-8943-3159707fc2e4 => generated 1323 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:25.517515 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-9a4bc466-dcd8-4b8b-ad14-41f69ca8cfc8 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Calling method '.version_select at 0x7fb21fc3c820>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:25.581519 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-9a4bc466-dcd8-4b8b-ad14-41f69ca8cfc8 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] 10.222.0.43 "GET /compute/v2.1/images/e4d3e808-f1b4-4480-90f6-79b6d4964f47" status: 200 len: 1455 microversion: 2.1 time: 0.070270 Oct 04 18:40:25.590235 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1136/2422] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 18:40:25 2022] GET /compute/v2.1/images/e4d3e808-f1b4-4480-90f6-79b6d4964f47 => generated 1455 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:25.604616 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-b8f858cd-2c2c-4d6b-b243-35dbfe6b442e tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:25.605012 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-b8f858cd-2c2c-4d6b-b243-35dbfe6b442e tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] [instance: 9895c2ec-35ea-419e-9565-0c0f2fc5bbbc] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:25.614457 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b8f858cd-2c2c-4d6b-b243-35dbfe6b442e tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:25.615028 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b8f858cd-2c2c-4d6b-b243-35dbfe6b442e tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:25.615646 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b8f858cd-2c2c-4d6b-b243-35dbfe6b442e tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:25.616309 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b8f858cd-2c2c-4d6b-b243-35dbfe6b442e tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:25.616841 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b8f858cd-2c2c-4d6b-b243-35dbfe6b442e tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:25.617415 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b8f858cd-2c2c-4d6b-b243-35dbfe6b442e tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:25.693910 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-b8f858cd-2c2c-4d6b-b243-35dbfe6b442e tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] [instance: 9895c2ec-35ea-419e-9565-0c0f2fc5bbbc] Going to try to terminate instance {{(pid=123595) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:40:25.723551 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:40:25.889921 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-b8f858cd-2c2c-4d6b-b243-35dbfe6b442e tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] 10.222.0.43 "DELETE /compute/v2.1/servers/9895c2ec-35ea-419e-9565-0c0f2fc5bbbc" status: 204 len: 0 microversion: 2.25 time: 0.298150 Oct 04 18:40:25.893371 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1137/2423] 10.222.0.43 () {60 vars in 1280 bytes} [Tue Oct 4 18:40:25 2022] DELETE /compute/v2.1/servers/9895c2ec-35ea-419e-9565-0c0f2fc5bbbc => generated 0 bytes in 300 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 18:40:25.902541 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-7f5ce564-e9ef-4972-820a-d62fc16e6fff tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:40:25.908815 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7f5ce564-e9ef-4972-820a-d62fc16e6fff tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:25.909513 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7f5ce564-e9ef-4972-820a-d62fc16e6fff tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:25.910032 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7f5ce564-e9ef-4972-820a-d62fc16e6fff tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:25.912550 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-0b4c6b07-e608-481e-bdb3-7ab2893b9469 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c96ec8b8e0a4053b0457f213e6e262d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b812c85494a49898376a0dd8140f03c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:25.921663 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-0b4c6b07-e608-481e-bdb3-7ab2893b9469 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] 10.222.0.43 "GET /compute/v2.1/servers/23ce945d-cd4a-40d5-80be-d5548c257e07" status: 200 len: 1645 microversion: 2.1 time: 1.002630 Oct 04 18:40:25.936988 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-7f5ce564-e9ef-4972-820a-d62fc16e6fff tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] [instance: 1a71ee0e-ffa8-4730-b4fb-8b6e9fd87239] Going to try to start instance {{(pid=123595) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 04 18:40:25.937408 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1287/2424] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:24 2022] GET /compute/v2.1/servers/23ce945d-cd4a-40d5-80be-d5548c257e07 => generated 1645 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:25.957127 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-ceb4bdde-3a3f-4155-bd34-c79dbeefa72b tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:25.958181 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-ceb4bdde-3a3f-4155-bd34-c79dbeefa72b tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] [instance: 9895c2ec-35ea-419e-9565-0c0f2fc5bbbc] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:25.966284 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ceb4bdde-3a3f-4155-bd34-c79dbeefa72b tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:25.967018 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ceb4bdde-3a3f-4155-bd34-c79dbeefa72b tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:25.967645 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ceb4bdde-3a3f-4155-bd34-c79dbeefa72b tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:25.968551 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ceb4bdde-3a3f-4155-bd34-c79dbeefa72b tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:25.969256 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ceb4bdde-3a3f-4155-bd34-c79dbeefa72b tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:25.969905 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ceb4bdde-3a3f-4155-bd34-c79dbeefa72b tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:26.003870 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-7f5ce564-e9ef-4972-820a-d62fc16e6fff tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] 10.222.0.43 "POST /compute/v2.1/servers/1a71ee0e-ffa8-4730-b4fb-8b6e9fd87239/action" status: 202 len: 0 microversion: 2.1 time: 0.107316 Oct 04 18:40:26.007561 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1138/2425] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 18:40:25 2022] POST /compute/v2.1/servers/1a71ee0e-ffa8-4730-b4fb-8b6e9fd87239/action => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:40:26.022389 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-5d687e95-b911-4f7d-a97a-da79938883b6 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:26.023317 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-5d687e95-b911-4f7d-a97a-da79938883b6 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: d9d4332a-97b6-40f1-bd7c-a9a75a9adc43] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:26.037036 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5d687e95-b911-4f7d-a97a-da79938883b6 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:26.037905 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5d687e95-b911-4f7d-a97a-da79938883b6 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:26.038428 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5d687e95-b911-4f7d-a97a-da79938883b6 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:26.039226 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5d687e95-b911-4f7d-a97a-da79938883b6 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:26.039753 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5d687e95-b911-4f7d-a97a-da79938883b6 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:26.040377 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5d687e95-b911-4f7d-a97a-da79938883b6 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:26.280968 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-5d687e95-b911-4f7d-a97a-da79938883b6 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:26.292541 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-5d687e95-b911-4f7d-a97a-da79938883b6 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/d9d4332a-97b6-40f1-bd7c-a9a75a9adc43" status: 200 len: 1470 microversion: 2.1 time: 0.284487 Oct 04 18:40:26.295586 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1139/2426] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:26 2022] GET /compute/v2.1/servers/d9d4332a-97b6-40f1-bd7c-a9a75a9adc43 => generated 1470 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:26.312936 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-76f92d80-d40e-4726-b91e-deecca2a2957 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:26.314029 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-76f92d80-d40e-4726-b91e-deecca2a2957 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] [instance: 1a71ee0e-ffa8-4730-b4fb-8b6e9fd87239] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:26.319121 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-ceb4bdde-3a3f-4155-bd34-c79dbeefa72b tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:26.324565 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-76f92d80-d40e-4726-b91e-deecca2a2957 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:26.325059 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-76f92d80-d40e-4726-b91e-deecca2a2957 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:26.325524 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-76f92d80-d40e-4726-b91e-deecca2a2957 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:26.326233 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-76f92d80-d40e-4726-b91e-deecca2a2957 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:26.326684 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-76f92d80-d40e-4726-b91e-deecca2a2957 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:26.327107 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-76f92d80-d40e-4726-b91e-deecca2a2957 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:26.339015 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-ceb4bdde-3a3f-4155-bd34-c79dbeefa72b tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:26.340761 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-ceb4bdde-3a3f-4155-bd34-c79dbeefa72b tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:26.342186 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-ceb4bdde-3a3f-4155-bd34-c79dbeefa72b tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] 10.222.0.43 "GET /compute/v2.1/servers/9895c2ec-35ea-419e-9565-0c0f2fc5bbbc" status: 200 len: 1547 microversion: 2.25 time: 0.403570 Oct 04 18:40:26.342998 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1288/2427] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:40:25 2022] GET /compute/v2.1/servers/9895c2ec-35ea-419e-9565-0c0f2fc5bbbc => generated 1547 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:40:26.538625 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f2f571de-fcc3-4fcf-84d0-9c2eb845b9ca tempest-FloatingIPDetailsNegativeTestJSON-1734850631 tempest-FloatingIPDetailsNegativeTestJSON-1734850631-project] Calling method '.version_select at 0x7fb21ee5b940>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:26.614177 n-d-851028-13 devstack@n-api.service[123596]: DEBUG neutronclient.v2_0.client [None req-f2f571de-fcc3-4fcf-84d0-9c2eb845b9ca tempest-FloatingIPDetailsNegativeTestJSON-1734850631 tempest-FloatingIPDetailsNegativeTestJSON-1734850631-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP d80a562f-2444-4ff7-8a9e-702fe908d2c6 could not be found", "detail": ""}} {{(pid=123596) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 18:40:26.614915 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-f2f571de-fcc3-4fcf-84d0-9c2eb845b9ca tempest-FloatingIPDetailsNegativeTestJSON-1734850631 tempest-FloatingIPDetailsNegativeTestJSON-1734850631-project] HTTP exception thrown: Floating IP not found for ID d80a562f-2444-4ff7-8a9e-702fe908d2c6 Oct 04 18:40:26.616963 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f2f571de-fcc3-4fcf-84d0-9c2eb845b9ca tempest-FloatingIPDetailsNegativeTestJSON-1734850631 tempest-FloatingIPDetailsNegativeTestJSON-1734850631-project] Request method failure captured: Oct 04 18:40:26.616963 n-d-851028-13 devstack@n-api.service[123596]: request: GET /compute/v2.1/os-floating-ips/d80a562f-2444-4ff7-8a9e-702fe908d2c6 HTTP/1.1 Oct 04 18:40:26.616963 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:40:26.616963 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:40:26.616963 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:40:26.616963 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 18:40:26.616963 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:40:26.616963 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:40:26.616963 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:40:26.616963 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:40:26.616963 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPH4axvWYUCFbuve_TOHDfom0_L4MyYl-H2ycc1wXoN-pdHpdpRQzCgFcbhaiQCp-8WK57xTMIhOadjm_B-VKwpmyPTRhLFSp-IfSDt5SgPPNrB7bCw7qoINLZimoeNaYaXMjpVJT3ER7ysODuFj3nPCpHuXsgh1NyZYd9cQLm9JUmxY Oct 04 18:40:26.616963 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:40:26.616963 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:40:26.616963 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:40:26.616963 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:40:26.616963 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:40:26.616963 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:40:26.616963 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: 921bc5af9d134950809ac48cddd89dd1 Oct 04 18:40:26.616963 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-FloatingIPDetailsNegativeTestJSON-1734850631 Oct 04 18:40:26.616963 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 18:40:26.616963 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 18:40:26.616963 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/921bc5af9d134950809ac48cddd89dd1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_921bc5af9d134950809ac48cddd89dd1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/921bc5af9d134950809ac48cddd89dd1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/921bc5af9d134950809ac48cddd89dd1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:40:26.616963 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-FloatingIPDetailsNegativeTestJSON-1734850631 Oct 04 18:40:26.616963 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: 921bc5af9d134950809ac48cddd89dd1 Oct 04 18:40:26.616963 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-FloatingIPDetailsNegativeTestJSON-1734850631 Oct 04 18:40:26.616963 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-FloatingIPDetailsNegativeTestJSON-1734850631-project Oct 04 18:40:26.616963 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:40:26.616963 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:40:26.616963 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: a81b2c03c6e5475a924a41c9b84ff782 Oct 04 18:40:26.616963 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-FloatingIPDetailsNegativeTestJSON-1734850631-project Oct 04 18:40:26.616963 n-d-851028-13 devstack@n-api.service[123596]: method: Oct 04 18:40:26.616963 n-d-851028-13 devstack@n-api.service[123596]: exception: Floating IP not found for ID d80a562f-2444-4ff7-8a9e-702fe908d2c6 Oct 04 18:40:26.616963 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': 'd80a562f-2444-4ff7-8a9e-702fe908d2c6'} Oct 04 18:40:26.616963 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:40:26.616963 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:40:26.616963 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 04 18:40:26.616963 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 04 18:40:26.616963 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:40:26.616963 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:40:26.616963 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 04 18:40:26.616963 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 04 18:40:26.616963 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:40:26.616963 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:40:26.616963 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 18:40:26.616963 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 18:40:26.616963 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:40:26.616963 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:40:26.616963 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 18:40:26.616963 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 18:40:26.616963 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:40:26.616963 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:40:26.616963 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 18:40:26.616963 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 18:40:26.616963 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:40:26.616963 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:40:26.616963 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 18:40:26.616963 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 18:40:26.616963 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 18:40:26.616963 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 18:40:26.616963 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP d80a562f-2444-4ff7-8a9e-702fe908d2c6 could not be found Oct 04 18:40:26.620903 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f5a3e5e3-d542-4067-ad80-2c8305d1db47'] Oct 04 18:40:26.620903 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:40:26.620903 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:40:26.620903 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:40:26.620903 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:40:26.620903 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Oct 04 18:40:26.620903 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 04 18:40:26.620903 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 04 18:40:26.620903 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 04 18:40:26.620903 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID d80a562f-2444-4ff7-8a9e-702fe908d2c6. Oct 04 18:40:26.620903 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:40:26.620903 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:40:26.620903 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:40:26.620903 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:40:26.620903 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:40:26.620903 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:40:26.620903 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:40:26.620903 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:40:26.620903 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:40:26.620903 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:40:26.620903 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:40:26.620903 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:40:26.620903 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Oct 04 18:40:26.620903 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 04 18:40:26.620903 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID d80a562f-2444-4ff7-8a9e-702fe908d2c6 Oct 04 18:40:26.620903 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:40:26.620903 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:40:26.620903 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:40:26.620903 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:40:26.620903 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:40:26.620903 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:40:26.620903 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:40:26.620903 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:40:26.620903 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID d80a562f-2444-4ff7-8a9e-702fe908d2c6 Oct 04 18:40:26.620903 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:40:26.620903 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f2f571de-fcc3-4fcf-84d0-9c2eb845b9ca tempest-FloatingIPDetailsNegativeTestJSON-1734850631 tempest-FloatingIPDetailsNegativeTestJSON-1734850631-project] Returning 404 to user: Floating IP not found for ID d80a562f-2444-4ff7-8a9e-702fe908d2c6 {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:40:26.620903 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-f2f571de-fcc3-4fcf-84d0-9c2eb845b9ca tempest-FloatingIPDetailsNegativeTestJSON-1734850631 tempest-FloatingIPDetailsNegativeTestJSON-1734850631-project] 10.222.0.43 "GET /compute/v2.1/os-floating-ips/d80a562f-2444-4ff7-8a9e-702fe908d2c6" status: 404 len: 111 microversion: 2.1 time: 0.260830 Oct 04 18:40:26.620903 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1289/2428] 10.222.0.43 () {58 vars in 1260 bytes} [Tue Oct 4 18:40:26 2022] GET /compute/v2.1/os-floating-ips/d80a562f-2444-4ff7-8a9e-702fe908d2c6 => generated 111 bytes in 262 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:40:26.629320 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-76f92d80-d40e-4726-b91e-deecca2a2957 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a19da94e9e646028a7f73f9d0e0edda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc41f296eb44503868205ec8aa2fef3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:26.629601 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-bd10e6de-20c4-40b5-baeb-e24718c66eca tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:26.630832 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-bd10e6de-20c4-40b5-baeb-e24718c66eca tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] [instance: b53d822f-e7b1-498a-b98a-35f87839dfe8] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:26.637257 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-76f92d80-d40e-4726-b91e-deecca2a2957 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] 10.222.0.43 "GET /compute/v2.1/servers/1a71ee0e-ffa8-4730-b4fb-8b6e9fd87239" status: 200 len: 1507 microversion: 2.1 time: 0.330667 Oct 04 18:40:26.638032 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1140/2429] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:26 2022] GET /compute/v2.1/servers/1a71ee0e-ffa8-4730-b4fb-8b6e9fd87239 => generated 1507 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:26.642411 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-f8eb88b1-3684-4b34-9073-ce8dc737924e tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:40:26.642939 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-f8eb88b1-3684-4b34-9073-ce8dc737924e tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: d9d4332a-97b6-40f1-bd7c-a9a75a9adc43] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:26.647242 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bd10e6de-20c4-40b5-baeb-e24718c66eca tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:26.649688 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bd10e6de-20c4-40b5-baeb-e24718c66eca tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:26.650463 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bd10e6de-20c4-40b5-baeb-e24718c66eca tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:26.651281 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bd10e6de-20c4-40b5-baeb-e24718c66eca tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:26.653564 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bd10e6de-20c4-40b5-baeb-e24718c66eca tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:26.654034 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bd10e6de-20c4-40b5-baeb-e24718c66eca tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:26.670911 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f8eb88b1-3684-4b34-9073-ce8dc737924e tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:26.671410 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f8eb88b1-3684-4b34-9073-ce8dc737924e tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:26.671846 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f8eb88b1-3684-4b34-9073-ce8dc737924e tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:26.672568 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f8eb88b1-3684-4b34-9073-ce8dc737924e tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:26.673022 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f8eb88b1-3684-4b34-9073-ce8dc737924e tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:26.673485 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f8eb88b1-3684-4b34-9073-ce8dc737924e tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:26.716357 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f8eb88b1-3684-4b34-9073-ce8dc737924e tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:26.717065 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f8eb88b1-3684-4b34-9073-ce8dc737924e tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:26.717961 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f8eb88b1-3684-4b34-9073-ce8dc737924e tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:26.719456 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f8eb88b1-3684-4b34-9073-ce8dc737924e tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:26.720200 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f8eb88b1-3684-4b34-9073-ce8dc737924e tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:26.720937 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f8eb88b1-3684-4b34-9073-ce8dc737924e tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:26.745004 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-bd10e6de-20c4-40b5-baeb-e24718c66eca tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e1add2296c4ed5830c5d90ef272ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fdc44ceeb041bcba1be2fcc2084aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:26.754872 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-f8eb88b1-3684-4b34-9073-ce8dc737924e tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Getting quotas for project 50a6a1a86a59403dad27f6e3c628853c. Resources: {'ram', 'cores'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:40:26.757603 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-bd10e6de-20c4-40b5-baeb-e24718c66eca tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59e1add2296c4ed5830c5d90ef272ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fdc44ceeb041bcba1be2fcc2084aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:26.761385 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-bd10e6de-20c4-40b5-baeb-e24718c66eca tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59e1add2296c4ed5830c5d90ef272ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fdc44ceeb041bcba1be2fcc2084aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:26.763150 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-bd10e6de-20c4-40b5-baeb-e24718c66eca tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] 10.222.0.43 "GET /compute/v2.1/servers/b53d822f-e7b1-498a-b98a-35f87839dfe8" status: 200 len: 1409 microversion: 2.54 time: 0.141921 Oct 04 18:40:26.764302 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1290/2430] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:40:26 2022] GET /compute/v2.1/servers/b53d822f-e7b1-498a-b98a-35f87839dfe8 => generated 1409 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:40:26.767835 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-f8eb88b1-3684-4b34-9073-ce8dc737924e tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Getting quotas for user 581885ffa737444eafa3179cceb6ee1d and project 50a6a1a86a59403dad27f6e3c628853c. Resources: {'ram', 'cores'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:40:26.785785 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-a15180b8-3e29-4048-a2d3-f7c9640cf5f5 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:26.786769 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-a15180b8-3e29-4048-a2d3-f7c9640cf5f5 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] [instance: ffbbf357-494a-40e4-8943-3159707fc2e4] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:26.796662 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a15180b8-3e29-4048-a2d3-f7c9640cf5f5 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:26.797663 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a15180b8-3e29-4048-a2d3-f7c9640cf5f5 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:26.798641 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a15180b8-3e29-4048-a2d3-f7c9640cf5f5 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:26.799578 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a15180b8-3e29-4048-a2d3-f7c9640cf5f5 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:26.801167 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a15180b8-3e29-4048-a2d3-f7c9640cf5f5 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:26.801884 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a15180b8-3e29-4048-a2d3-f7c9640cf5f5 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:26.963686 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-f8eb88b1-3684-4b34-9073-ce8dc737924e tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "POST /compute/v2.1/servers/d9d4332a-97b6-40f1-bd7c-a9a75a9adc43/action" status: 202 len: 0 microversion: 2.1 time: 0.324582 Oct 04 18:40:26.967477 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1141/2431] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 18:40:26 2022] POST /compute/v2.1/servers/d9d4332a-97b6-40f1-bd7c-a9a75a9adc43/action => generated 0 bytes in 326 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:40:26.974599 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-e15bc4c2-5ccf-4659-84d3-3ca206414c09 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Calling method '.version_select at 0x7fb21fb2a9d0>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:27.069768 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-e15bc4c2-5ccf-4659-84d3-3ca206414c09 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] 10.222.0.43 "GET /compute/v2.1/images/e4d3e808-f1b4-4480-90f6-79b6d4964f47" status: 200 len: 1464 microversion: 2.1 time: 0.103562 Oct 04 18:40:27.077335 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1142/2432] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 18:40:26 2022] GET /compute/v2.1/images/e4d3e808-f1b4-4480-90f6-79b6d4964f47 => generated 1464 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:27.086557 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-083d80ac-3cc5-4967-8a87-7d0b57e33f53 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:27.087382 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-083d80ac-3cc5-4967-8a87-7d0b57e33f53 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] [instance: 23ce945d-cd4a-40d5-80be-d5548c257e07] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:27.107008 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-083d80ac-3cc5-4967-8a87-7d0b57e33f53 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:27.107496 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-083d80ac-3cc5-4967-8a87-7d0b57e33f53 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:27.107993 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-083d80ac-3cc5-4967-8a87-7d0b57e33f53 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:27.108686 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-083d80ac-3cc5-4967-8a87-7d0b57e33f53 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:27.109178 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-083d80ac-3cc5-4967-8a87-7d0b57e33f53 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:27.112626 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-083d80ac-3cc5-4967-8a87-7d0b57e33f53 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:27.186753 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-a15180b8-3e29-4048-a2d3-f7c9640cf5f5 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15432d1b74334e1188866004384befe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d562b670294a47b2171f4003be4cdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:27.196103 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-a15180b8-3e29-4048-a2d3-f7c9640cf5f5 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] 10.222.0.43 "GET /compute/v2.1/servers/ffbbf357-494a-40e4-8943-3159707fc2e4" status: 200 len: 1518 microversion: 2.1 time: 0.430480 Oct 04 18:40:27.199315 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1291/2433] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:26 2022] GET /compute/v2.1/servers/ffbbf357-494a-40e4-8943-3159707fc2e4 => generated 1518 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:27.204169 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-ba15f8e8-c2bf-4732-8cb4-f1e63253a081 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:27.206969 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-ba15f8e8-c2bf-4732-8cb4-f1e63253a081 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: d9d4332a-97b6-40f1-bd7c-a9a75a9adc43] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:27.225491 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ba15f8e8-c2bf-4732-8cb4-f1e63253a081 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:27.225992 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ba15f8e8-c2bf-4732-8cb4-f1e63253a081 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:27.226427 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ba15f8e8-c2bf-4732-8cb4-f1e63253a081 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:27.227328 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ba15f8e8-c2bf-4732-8cb4-f1e63253a081 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:27.227845 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ba15f8e8-c2bf-4732-8cb4-f1e63253a081 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:27.228269 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ba15f8e8-c2bf-4732-8cb4-f1e63253a081 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:27.542061 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-ba15f8e8-c2bf-4732-8cb4-f1e63253a081 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:27.572416 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-ba15f8e8-c2bf-4732-8cb4-f1e63253a081 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/d9d4332a-97b6-40f1-bd7c-a9a75a9adc43" status: 200 len: 1469 microversion: 2.1 time: 0.371828 Oct 04 18:40:27.573230 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1292/2434] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:27 2022] GET /compute/v2.1/servers/d9d4332a-97b6-40f1-bd7c-a9a75a9adc43 => generated 1469 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:27.596702 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-59c7f478-e77b-4972-b6b4-500621165f49 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Calling method '.version_select at 0x7fb21ed825e0>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:27.673534 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-59c7f478-e77b-4972-b6b4-500621165f49 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] 10.222.0.43 "GET /compute/v2.1/images/e4d3e808-f1b4-4480-90f6-79b6d4964f47" status: 200 len: 1464 microversion: 2.1 time: 0.097334 Oct 04 18:40:27.685090 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1293/2435] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 18:40:27 2022] GET /compute/v2.1/images/e4d3e808-f1b4-4480-90f6-79b6d4964f47 => generated 1464 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:27.712076 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-5114d15c-bf36-40a3-a30c-03f940b38537 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:40:27.716778 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-5114d15c-bf36-40a3-a30c-03f940b38537 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] [instance: ffbbf357-494a-40e4-8943-3159707fc2e4] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:27.732976 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5114d15c-bf36-40a3-a30c-03f940b38537 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:27.734056 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5114d15c-bf36-40a3-a30c-03f940b38537 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:27.734902 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5114d15c-bf36-40a3-a30c-03f940b38537 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:27.735878 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5114d15c-bf36-40a3-a30c-03f940b38537 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:27.737689 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5114d15c-bf36-40a3-a30c-03f940b38537 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:27.738738 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5114d15c-bf36-40a3-a30c-03f940b38537 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:27.765528 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.objects.instance [None req-5114d15c-bf36-40a3-a30c-03f940b38537 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Lazy-loading 'flavor' on Instance uuid ffbbf357-494a-40e4-8943-3159707fc2e4 {{(pid=123596) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:40:27.885618 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:40:27.896838 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-5114d15c-bf36-40a3-a30c-03f940b38537 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] 10.222.0.43 "POST /compute/v2.1/servers/ffbbf357-494a-40e4-8943-3159707fc2e4/action" status: 200 len: 32 microversion: 2.1 time: 0.209842 Oct 04 18:40:27.898295 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1294/2436] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 18:40:27 2022] POST /compute/v2.1/servers/ffbbf357-494a-40e4-8943-3159707fc2e4/action => generated 32 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:40:27.905457 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-2fe2a7e9-0cf7-4401-9af4-6eca861925b3 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:27.906246 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-2fe2a7e9-0cf7-4401-9af4-6eca861925b3 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] [instance: 9895c2ec-35ea-419e-9565-0c0f2fc5bbbc] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:27.920468 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2fe2a7e9-0cf7-4401-9af4-6eca861925b3 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:27.924991 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2fe2a7e9-0cf7-4401-9af4-6eca861925b3 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:27.925547 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2fe2a7e9-0cf7-4401-9af4-6eca861925b3 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:27.926312 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2fe2a7e9-0cf7-4401-9af4-6eca861925b3 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:27.926813 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2fe2a7e9-0cf7-4401-9af4-6eca861925b3 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:27.927247 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2fe2a7e9-0cf7-4401-9af4-6eca861925b3 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:28.098548 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-2fe2a7e9-0cf7-4401-9af4-6eca861925b3 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:28.114308 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-2fe2a7e9-0cf7-4401-9af4-6eca861925b3 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:28.125100 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-2fe2a7e9-0cf7-4401-9af4-6eca861925b3 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:28.130421 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-2fe2a7e9-0cf7-4401-9af4-6eca861925b3 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] 10.222.0.43 "GET /compute/v2.1/servers/9895c2ec-35ea-419e-9565-0c0f2fc5bbbc" status: 200 len: 1505 microversion: 2.25 time: 0.227946 Oct 04 18:40:28.131515 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1295/2437] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:40:27 2022] GET /compute/v2.1/servers/9895c2ec-35ea-419e-9565-0c0f2fc5bbbc => generated 1505 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:40:28.139308 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-4ba6c4f5-f963-4358-8713-de449065b48e tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:28.139869 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-4ba6c4f5-f963-4358-8713-de449065b48e tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] [instance: 1a71ee0e-ffa8-4730-b4fb-8b6e9fd87239] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:28.169954 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4ba6c4f5-f963-4358-8713-de449065b48e tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:28.171738 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4ba6c4f5-f963-4358-8713-de449065b48e tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:28.172214 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4ba6c4f5-f963-4358-8713-de449065b48e tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:28.172956 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4ba6c4f5-f963-4358-8713-de449065b48e tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:28.181986 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4ba6c4f5-f963-4358-8713-de449065b48e tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:28.182460 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4ba6c4f5-f963-4358-8713-de449065b48e tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:28.187616 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-083d80ac-3cc5-4967-8a87-7d0b57e33f53 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c96ec8b8e0a4053b0457f213e6e262d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b812c85494a49898376a0dd8140f03c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:28.195723 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-083d80ac-3cc5-4967-8a87-7d0b57e33f53 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] 10.222.0.43 "GET /compute/v2.1/servers/23ce945d-cd4a-40d5-80be-d5548c257e07" status: 200 len: 1645 microversion: 2.1 time: 1.120828 Oct 04 18:40:28.205893 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1143/2438] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:27 2022] GET /compute/v2.1/servers/23ce945d-cd4a-40d5-80be-d5548c257e07 => generated 1645 bytes in 1135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:28.211368 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-494857b8-6a8c-4b85-ac88-ff954689d046 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:28.212803 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-494857b8-6a8c-4b85-ac88-ff954689d046 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] [instance: 0b7f1ede-48b3-48d8-933e-287c338b1e6a] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:28.226245 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-494857b8-6a8c-4b85-ac88-ff954689d046 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:28.226728 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-494857b8-6a8c-4b85-ac88-ff954689d046 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:28.238704 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-494857b8-6a8c-4b85-ac88-ff954689d046 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:28.239797 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-494857b8-6a8c-4b85-ac88-ff954689d046 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:28.240438 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-494857b8-6a8c-4b85-ac88-ff954689d046 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:28.241025 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-494857b8-6a8c-4b85-ac88-ff954689d046 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:28.560006 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-4ba6c4f5-f963-4358-8713-de449065b48e tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a19da94e9e646028a7f73f9d0e0edda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc41f296eb44503868205ec8aa2fef3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:28.574911 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-4ba6c4f5-f963-4358-8713-de449065b48e tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] 10.222.0.43 "GET /compute/v2.1/servers/1a71ee0e-ffa8-4730-b4fb-8b6e9fd87239" status: 200 len: 1507 microversion: 2.1 time: 0.441820 Oct 04 18:40:28.585373 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-494857b8-6a8c-4b85-ac88-ff954689d046 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e30c6d7042ca444a86e2260692ea048e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c54096058d4c9a8ea436329e25ecbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:28.595150 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1296/2439] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:28 2022] GET /compute/v2.1/servers/1a71ee0e-ffa8-4730-b4fb-8b6e9fd87239 => generated 1507 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:28.597214 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-494857b8-6a8c-4b85-ac88-ff954689d046 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] 10.222.0.43 "GET /compute/v2.1/servers/0b7f1ede-48b3-48d8-933e-287c338b1e6a" status: 200 len: 1467 microversion: 2.1 time: 0.389746 Oct 04 18:40:28.601777 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-2e6d9759-3277-4adc-896a-305fdf13abd5 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:28.602718 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-2e6d9759-3277-4adc-896a-305fdf13abd5 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] [instance: b53d822f-e7b1-498a-b98a-35f87839dfe8] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:28.610155 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2e6d9759-3277-4adc-896a-305fdf13abd5 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:28.610884 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2e6d9759-3277-4adc-896a-305fdf13abd5 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:28.611498 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2e6d9759-3277-4adc-896a-305fdf13abd5 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:28.612516 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2e6d9759-3277-4adc-896a-305fdf13abd5 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:28.613365 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2e6d9759-3277-4adc-896a-305fdf13abd5 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:28.613993 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2e6d9759-3277-4adc-896a-305fdf13abd5 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:28.620308 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1144/2440] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:28 2022] GET /compute/v2.1/servers/0b7f1ede-48b3-48d8-933e-287c338b1e6a => generated 1467 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:28.635952 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-c1a3b1d5-2edf-4705-8697-7c95c82e9c9e tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:28.636603 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-c1a3b1d5-2edf-4705-8697-7c95c82e9c9e tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] [instance: ffbbf357-494a-40e4-8943-3159707fc2e4] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:28.657455 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c1a3b1d5-2edf-4705-8697-7c95c82e9c9e tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:28.658252 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c1a3b1d5-2edf-4705-8697-7c95c82e9c9e tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:28.665923 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c1a3b1d5-2edf-4705-8697-7c95c82e9c9e tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:28.669467 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c1a3b1d5-2edf-4705-8697-7c95c82e9c9e tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:28.671355 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c1a3b1d5-2edf-4705-8697-7c95c82e9c9e tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:28.671949 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c1a3b1d5-2edf-4705-8697-7c95c82e9c9e tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:28.809816 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-2e6d9759-3277-4adc-896a-305fdf13abd5 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e1add2296c4ed5830c5d90ef272ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fdc44ceeb041bcba1be2fcc2084aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:28.835780 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-2e6d9759-3277-4adc-896a-305fdf13abd5 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59e1add2296c4ed5830c5d90ef272ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fdc44ceeb041bcba1be2fcc2084aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:28.841295 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-2e6d9759-3277-4adc-896a-305fdf13abd5 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59e1add2296c4ed5830c5d90ef272ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fdc44ceeb041bcba1be2fcc2084aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:28.844193 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-2e6d9759-3277-4adc-896a-305fdf13abd5 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] 10.222.0.43 "GET /compute/v2.1/servers/b53d822f-e7b1-498a-b98a-35f87839dfe8" status: 200 len: 1415 microversion: 2.54 time: 0.246696 Oct 04 18:40:28.847858 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1297/2441] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:40:28 2022] GET /compute/v2.1/servers/b53d822f-e7b1-498a-b98a-35f87839dfe8 => generated 1415 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:40:28.855908 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-a8022fa8-8d86-45cb-a0ff-aca2007dd4dc req-9817e888-b9ec-43df-8cb6-dd0e7b4a8036 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9895c2ec-35ea-419e-9565-0c0f2fc5bbbc", "name": "network-vif-deleted", "tag": "d1c13a57-f549-4198-9a2d-173f2932d012"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:40:28.871350 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-a8022fa8-8d86-45cb-a0ff-aca2007dd4dc req-9817e888-b9ec-43df-8cb6-dd0e7b4a8036 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:28.872092 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-a8022fa8-8d86-45cb-a0ff-aca2007dd4dc req-9817e888-b9ec-43df-8cb6-dd0e7b4a8036 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:28.875438 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-a8022fa8-8d86-45cb-a0ff-aca2007dd4dc req-9817e888-b9ec-43df-8cb6-dd0e7b4a8036 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:28.934121 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-a8022fa8-8d86-45cb-a0ff-aca2007dd4dc req-9817e888-b9ec-43df-8cb6-dd0e7b4a8036 service nova] Creating event network-vif-deleted:d1c13a57-f549-4198-9a2d-173f2932d012 for instance 9895c2ec-35ea-419e-9565-0c0f2fc5bbbc on n-h2-851028-13 Oct 04 18:40:28.950293 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-a8022fa8-8d86-45cb-a0ff-aca2007dd4dc req-9817e888-b9ec-43df-8cb6-dd0e7b4a8036 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098682 Oct 04 18:40:28.953140 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1298/2442] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:40:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:40:28.970953 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-36e1f534-2a8d-4fbe-9272-d194e54253d9 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:28.972007 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-36e1f534-2a8d-4fbe-9272-d194e54253d9 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: d9d4332a-97b6-40f1-bd7c-a9a75a9adc43] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:28.986520 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-36e1f534-2a8d-4fbe-9272-d194e54253d9 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:28.989672 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-36e1f534-2a8d-4fbe-9272-d194e54253d9 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:28.991343 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-36e1f534-2a8d-4fbe-9272-d194e54253d9 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:28.992224 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-36e1f534-2a8d-4fbe-9272-d194e54253d9 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:28.995402 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-36e1f534-2a8d-4fbe-9272-d194e54253d9 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:28.995982 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-36e1f534-2a8d-4fbe-9272-d194e54253d9 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:29.012226 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-c1a3b1d5-2edf-4705-8697-7c95c82e9c9e tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15432d1b74334e1188866004384befe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d562b670294a47b2171f4003be4cdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:29.023603 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-c1a3b1d5-2edf-4705-8697-7c95c82e9c9e tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] 10.222.0.43 "GET /compute/v2.1/servers/ffbbf357-494a-40e4-8943-3159707fc2e4" status: 200 len: 1524 microversion: 2.1 time: 0.401955 Oct 04 18:40:29.025134 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1145/2443] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:28 2022] GET /compute/v2.1/servers/ffbbf357-494a-40e4-8943-3159707fc2e4 => generated 1524 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:29.030422 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-a344fa92-806a-4192-acee-24dfacee68ff tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Calling method '.version_select at 0x7fb21fe78280>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:29.239084 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-a344fa92-806a-4192-acee-24dfacee68ff tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] 10.222.0.43 "GET /compute/v2.1/images?changes-since=2022-10-04T18%3A37%3A58Z" status: 200 len: 1900 microversion: 2.1 time: 0.211401 Oct 04 18:40:29.263226 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1146/2444] 10.222.0.43 () {58 vars in 1199 bytes} [Tue Oct 4 18:40:29 2022] GET /compute/v2.1/images?changes-since=2022-10-04T18%3A37%3A58Z => generated 1900 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:29.279747 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-0a668c03-dea5-4eb9-8a1e-8295deff8142 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:29.288388 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-0a668c03-dea5-4eb9-8a1e-8295deff8142 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] [instance: 9895c2ec-35ea-419e-9565-0c0f2fc5bbbc] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:29.301976 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0a668c03-dea5-4eb9-8a1e-8295deff8142 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:29.307118 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0a668c03-dea5-4eb9-8a1e-8295deff8142 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:29.308194 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0a668c03-dea5-4eb9-8a1e-8295deff8142 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:29.309440 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0a668c03-dea5-4eb9-8a1e-8295deff8142 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:29.315915 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0a668c03-dea5-4eb9-8a1e-8295deff8142 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:29.316768 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0a668c03-dea5-4eb9-8a1e-8295deff8142 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:29.521416 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-0a668c03-dea5-4eb9-8a1e-8295deff8142 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:29.535275 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-0a668c03-dea5-4eb9-8a1e-8295deff8142 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:29.540022 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-0a668c03-dea5-4eb9-8a1e-8295deff8142 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:29.542841 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-0a668c03-dea5-4eb9-8a1e-8295deff8142 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] 10.222.0.43 "GET /compute/v2.1/servers/9895c2ec-35ea-419e-9565-0c0f2fc5bbbc" status: 200 len: 1330 microversion: 2.25 time: 0.278130 Oct 04 18:40:29.544165 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1147/2445] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:40:29 2022] GET /compute/v2.1/servers/9895c2ec-35ea-419e-9565-0c0f2fc5bbbc => generated 1330 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:40:29.550115 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-2b43c985-9290-47c6-950e-f1bf962f406b tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:29.551024 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-2b43c985-9290-47c6-950e-f1bf962f406b tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] [instance: 23ce945d-cd4a-40d5-80be-d5548c257e07] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:29.564424 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2b43c985-9290-47c6-950e-f1bf962f406b tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:29.567511 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2b43c985-9290-47c6-950e-f1bf962f406b tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:29.568000 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2b43c985-9290-47c6-950e-f1bf962f406b tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:29.569541 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2b43c985-9290-47c6-950e-f1bf962f406b tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:29.570297 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2b43c985-9290-47c6-950e-f1bf962f406b tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:29.571651 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2b43c985-9290-47c6-950e-f1bf962f406b tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:29.614111 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2b43c985-9290-47c6-950e-f1bf962f406b tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:29.615016 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2b43c985-9290-47c6-950e-f1bf962f406b tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:29.615470 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2b43c985-9290-47c6-950e-f1bf962f406b tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:29.615930 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.objects.instance [None req-2b43c985-9290-47c6-950e-f1bf962f406b tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Lazy-loading 'fault' on Instance uuid 23ce945d-cd4a-40d5-80be-d5548c257e07 {{(pid=123595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:40:29.698400 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-2b43c985-9290-47c6-950e-f1bf962f406b tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c96ec8b8e0a4053b0457f213e6e262d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b812c85494a49898376a0dd8140f03c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:29.720937 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-2b43c985-9290-47c6-950e-f1bf962f406b tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] 10.222.0.43 "GET /compute/v2.1/servers/23ce945d-cd4a-40d5-80be-d5548c257e07" status: 200 len: 1305 microversion: 2.1 time: 0.175429 Oct 04 18:40:29.723321 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1148/2446] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:29 2022] GET /compute/v2.1/servers/23ce945d-cd4a-40d5-80be-d5548c257e07 => generated 1305 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:29.736527 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-af5332a9-d10e-4f44-8bbd-028114e74664 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Calling method '.version_select at 0x7fb21fbc0670>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:29.775327 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-36e1f534-2a8d-4fbe-9272-d194e54253d9 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:29.799503 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-36e1f534-2a8d-4fbe-9272-d194e54253d9 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/d9d4332a-97b6-40f1-bd7c-a9a75a9adc43" status: 200 len: 1469 microversion: 2.1 time: 0.844950 Oct 04 18:40:29.800112 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1299/2447] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:28 2022] GET /compute/v2.1/servers/d9d4332a-97b6-40f1-bd7c-a9a75a9adc43 => generated 1469 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:29.813597 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-592695c3-d98a-47b4-ba27-2c2ba28d4142 req-10d43c8b-bd18-49fa-b5c1-d5fcd29f5a8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9d4332a-97b6-40f1-bd7c-a9a75a9adc43", "name": "network-vif-plugged", "status": "completed", "tag": "e64ffaa5-c4b7-4d5d-b9bd-605829597e42"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:40:29.842437 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-af5332a9-d10e-4f44-8bbd-028114e74664 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] 10.222.0.43 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-999534851" status: 200 len: 484 microversion: 2.1 time: 0.116928 Oct 04 18:40:29.846164 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-592695c3-d98a-47b4-ba27-2c2ba28d4142 req-10d43c8b-bd18-49fa-b5c1-d5fcd29f5a8f service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:29.846644 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-592695c3-d98a-47b4-ba27-2c2ba28d4142 req-10d43c8b-bd18-49fa-b5c1-d5fcd29f5a8f service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:29.848406 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1149/2448] 10.222.0.43 () {58 vars in 1229 bytes} [Tue Oct 4 18:40:29 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-999534851 => generated 484 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:40:29.854889 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-592695c3-d98a-47b4-ba27-2c2ba28d4142 req-10d43c8b-bd18-49fa-b5c1-d5fcd29f5a8f service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:29.863683 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-fea6fe38-d252-4782-ba65-0b24733d593e tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:29.864319 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-fea6fe38-d252-4782-ba65-0b24733d593e tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] [instance: 1a71ee0e-ffa8-4730-b4fb-8b6e9fd87239] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:29.876847 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fea6fe38-d252-4782-ba65-0b24733d593e tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:29.877492 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fea6fe38-d252-4782-ba65-0b24733d593e tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:29.877833 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fea6fe38-d252-4782-ba65-0b24733d593e tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:29.880268 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fea6fe38-d252-4782-ba65-0b24733d593e tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:29.881512 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fea6fe38-d252-4782-ba65-0b24733d593e tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:29.882753 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-592695c3-d98a-47b4-ba27-2c2ba28d4142 req-10d43c8b-bd18-49fa-b5c1-d5fcd29f5a8f service nova] Creating event network-vif-plugged:e64ffaa5-c4b7-4d5d-b9bd-605829597e42 for instance d9d4332a-97b6-40f1-bd7c-a9a75a9adc43 on n-h2-851028-13 Oct 04 18:40:29.884535 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fea6fe38-d252-4782-ba65-0b24733d593e tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:29.894198 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [req-592695c3-d98a-47b4-ba27-2c2ba28d4142 req-10d43c8b-bd18-49fa-b5c1-d5fcd29f5a8f service nova] Instance d9d4332a-97b6-40f1-bd7c-a9a75a9adc43 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851028-13', 'n-h2-851028-13'} {{(pid=123596) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 18:40:29.934836 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-592695c3-d98a-47b4-ba27-2c2ba28d4142 req-10d43c8b-bd18-49fa-b5c1-d5fcd29f5a8f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133315 Oct 04 18:40:29.941793 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1300/2449] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:40:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:40:29.951314 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-3d13a5c6-c674-492c-aec6-5a6bf69ffcbf tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Calling method '.version_select at 0x7fb21ee5b280>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:30.082460 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-fea6fe38-d252-4782-ba65-0b24733d593e tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a19da94e9e646028a7f73f9d0e0edda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc41f296eb44503868205ec8aa2fef3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:30.087412 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-3d13a5c6-c674-492c-aec6-5a6bf69ffcbf tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] 10.222.0.43 "GET /compute/v2.1/images?server=0b7f1ede-48b3-48d8-933e-287c338b1e6a" status: 200 len: 957 microversion: 2.1 time: 0.143907 Oct 04 18:40:30.088011 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1301/2450] 10.222.0.43 () {58 vars in 1209 bytes} [Tue Oct 4 18:40:29 2022] GET /compute/v2.1/images?server=0b7f1ede-48b3-48d8-933e-287c338b1e6a => generated 957 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:40:30.106459 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-fea6fe38-d252-4782-ba65-0b24733d593e tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] 10.222.0.43 "GET /compute/v2.1/servers/1a71ee0e-ffa8-4730-b4fb-8b6e9fd87239" status: 200 len: 1511 microversion: 2.1 time: 0.256183 Oct 04 18:40:30.107058 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1150/2451] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:29 2022] GET /compute/v2.1/servers/1a71ee0e-ffa8-4730-b4fb-8b6e9fd87239 => generated 1511 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:30.111541 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-2e90c7bd-f7ab-4c03-b0e1-4d1dfa6a6f35 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:30.113294 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-792bd6ec-cc6b-49f3-a6ae-63645fc9068e tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:30.114085 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-2e90c7bd-f7ab-4c03-b0e1-4d1dfa6a6f35 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] [instance: ffbbf357-494a-40e4-8943-3159707fc2e4] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:30.114994 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-792bd6ec-cc6b-49f3-a6ae-63645fc9068e tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] [instance: b53d822f-e7b1-498a-b98a-35f87839dfe8] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:30.127183 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-792bd6ec-cc6b-49f3-a6ae-63645fc9068e tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:30.127682 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-792bd6ec-cc6b-49f3-a6ae-63645fc9068e tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:30.128120 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-792bd6ec-cc6b-49f3-a6ae-63645fc9068e tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:30.128833 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-792bd6ec-cc6b-49f3-a6ae-63645fc9068e tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:30.129569 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-792bd6ec-cc6b-49f3-a6ae-63645fc9068e tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:30.129997 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-792bd6ec-cc6b-49f3-a6ae-63645fc9068e tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:30.131150 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2e90c7bd-f7ab-4c03-b0e1-4d1dfa6a6f35 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:30.131656 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2e90c7bd-f7ab-4c03-b0e1-4d1dfa6a6f35 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:30.132101 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2e90c7bd-f7ab-4c03-b0e1-4d1dfa6a6f35 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:30.132820 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2e90c7bd-f7ab-4c03-b0e1-4d1dfa6a6f35 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:30.133337 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2e90c7bd-f7ab-4c03-b0e1-4d1dfa6a6f35 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:30.134362 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2e90c7bd-f7ab-4c03-b0e1-4d1dfa6a6f35 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:30.249584 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-792bd6ec-cc6b-49f3-a6ae-63645fc9068e tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e1add2296c4ed5830c5d90ef272ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fdc44ceeb041bcba1be2fcc2084aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:30.280329 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-792bd6ec-cc6b-49f3-a6ae-63645fc9068e tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59e1add2296c4ed5830c5d90ef272ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fdc44ceeb041bcba1be2fcc2084aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:30.288291 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-792bd6ec-cc6b-49f3-a6ae-63645fc9068e tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59e1add2296c4ed5830c5d90ef272ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fdc44ceeb041bcba1be2fcc2084aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:30.294452 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-792bd6ec-cc6b-49f3-a6ae-63645fc9068e tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] 10.222.0.43 "GET /compute/v2.1/servers/b53d822f-e7b1-498a-b98a-35f87839dfe8" status: 200 len: 1415 microversion: 2.54 time: 0.193610 Oct 04 18:40:30.296788 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1302/2452] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:40:30 2022] GET /compute/v2.1/servers/b53d822f-e7b1-498a-b98a-35f87839dfe8 => generated 1415 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:40:30.314304 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-30c2cf0a-389a-4293-999b-c44352a9ddfa tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Calling method '.version_select at 0x7fb21ee14790>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:30.394923 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-2e90c7bd-f7ab-4c03-b0e1-4d1dfa6a6f35 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15432d1b74334e1188866004384befe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d562b670294a47b2171f4003be4cdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:30.403347 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:40:30.415266 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-30c2cf0a-389a-4293-999b-c44352a9ddfa tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] 10.222.0.43 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.43%2Fcompute%2Fv2.1%2Fservers%2F6eb9c803-dd97-4af5-b0d0-aa6fc18f8a89" status: 200 len: 483 microversion: 2.1 time: 0.117183 Oct 04 18:40:30.419747 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-2e90c7bd-f7ab-4c03-b0e1-4d1dfa6a6f35 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] 10.222.0.43 "GET /compute/v2.1/servers/ffbbf357-494a-40e4-8943-3159707fc2e4" status: 200 len: 1524 microversion: 2.1 time: 0.310821 Oct 04 18:40:30.420518 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1151/2453] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:30 2022] GET /compute/v2.1/servers/ffbbf357-494a-40e4-8943-3159707fc2e4 => generated 1524 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:30.424647 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1303/2454] 10.222.0.43 () {58 vars in 1317 bytes} [Tue Oct 4 18:40:30 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.43%2Fcompute%2Fv2.1%2Fservers%2F6eb9c803-dd97-4af5-b0d0-aa6fc18f8a89 => generated 483 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:40:30.432474 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-9dd8b287-e235-4fa1-94ee-04a4ed1a853b tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Calling method '.version_select at 0x7fb21ee5b550>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:30.443730 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-0ab46db1-78f5-4e1a-8635-dbdc5605ae88 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:30.449521 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-0ab46db1-78f5-4e1a-8635-dbdc5605ae88 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6a19da94e9e646028a7f73f9d0e0edda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc41f296eb44503868205ec8aa2fef3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:30.449977 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.compute.servers [None req-0ab46db1-78f5-4e1a-8635-dbdc5605ae88 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Removing options 'limit' from query {{(pid=123595) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 04 18:40:30.450639 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-0ab46db1-78f5-4e1a-8635-dbdc5605ae88 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Searching by: {'deleted': False, 'project_id': 'dfc41f296eb44503868205ec8aa2fef3'} {{(pid=123595) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:40:30.452517 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0ab46db1-78f5-4e1a-8635-dbdc5605ae88 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:30.453004 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0ab46db1-78f5-4e1a-8635-dbdc5605ae88 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:30.453476 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0ab46db1-78f5-4e1a-8635-dbdc5605ae88 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:30.454217 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0ab46db1-78f5-4e1a-8635-dbdc5605ae88 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:30.454672 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0ab46db1-78f5-4e1a-8635-dbdc5605ae88 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:30.455101 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0ab46db1-78f5-4e1a-8635-dbdc5605ae88 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:30.456845 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-0ab46db1-78f5-4e1a-8635-dbdc5605ae88 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] 10.222.0.43 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.035076 Oct 04 18:40:30.457550 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1152/2455] 10.222.0.43 () {58 vars in 1140 bytes} [Tue Oct 4 18:40:30 2022] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:40:30.469599 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-5e3d5c71-e405-44c2-9417-19c5d739e17a tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:30.470326 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-5e3d5c71-e405-44c2-9417-19c5d739e17a tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] [instance: 1a71ee0e-ffa8-4730-b4fb-8b6e9fd87239] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:30.478189 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5e3d5c71-e405-44c2-9417-19c5d739e17a tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:30.478823 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5e3d5c71-e405-44c2-9417-19c5d739e17a tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:30.479387 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5e3d5c71-e405-44c2-9417-19c5d739e17a tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:30.480202 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5e3d5c71-e405-44c2-9417-19c5d739e17a tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:30.480763 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5e3d5c71-e405-44c2-9417-19c5d739e17a tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:30.481422 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5e3d5c71-e405-44c2-9417-19c5d739e17a tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:30.498796 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-9dd8b287-e235-4fa1-94ee-04a4ed1a853b tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] 10.222.0.43 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.43%2Fcompute%2Fservers%2F6eb9c803-dd97-4af5-b0d0-aa6fc18f8a89" status: 200 len: 483 microversion: 2.1 time: 0.072769 Oct 04 18:40:30.507328 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1304/2456] 10.222.0.43 () {58 vars in 1303 bytes} [Tue Oct 4 18:40:30 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.43%2Fcompute%2Fservers%2F6eb9c803-dd97-4af5-b0d0-aa6fc18f8a89 => generated 483 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:40:30.512717 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-6547bde1-857d-44eb-829d-67e2fcbe4377 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Calling method '.version_select at 0x7fb21edf95e0>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:30.652642 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-5e3d5c71-e405-44c2-9417-19c5d739e17a tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a19da94e9e646028a7f73f9d0e0edda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc41f296eb44503868205ec8aa2fef3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:30.662813 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-5e3d5c71-e405-44c2-9417-19c5d739e17a tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] 10.222.0.43 "GET /compute/v2.1/servers/1a71ee0e-ffa8-4730-b4fb-8b6e9fd87239" status: 200 len: 1511 microversion: 2.1 time: 0.197016 Oct 04 18:40:30.677571 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1153/2457] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:30 2022] GET /compute/v2.1/servers/1a71ee0e-ffa8-4730-b4fb-8b6e9fd87239 => generated 1511 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:40:30.688332 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-6547bde1-857d-44eb-829d-67e2fcbe4377 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] 10.222.0.43 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3278 microversion: 2.1 time: 0.179857 Oct 04 18:40:30.688611 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-15d28275-b96b-4283-ac32-efcb4e6a1c87 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:30.689515 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-15d28275-b96b-4283-ac32-efcb4e6a1c87 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] [instance: 9895c2ec-35ea-419e-9565-0c0f2fc5bbbc] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:30.700708 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1305/2458] 10.222.0.43 () {58 vars in 1149 bytes} [Tue Oct 4 18:40:30 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3278 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:30.708799 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-15d28275-b96b-4283-ac32-efcb4e6a1c87 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:30.710307 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-15d28275-b96b-4283-ac32-efcb4e6a1c87 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:30.711277 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-15d28275-b96b-4283-ac32-efcb4e6a1c87 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:30.712779 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-15d28275-b96b-4283-ac32-efcb4e6a1c87 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:30.714298 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-15d28275-b96b-4283-ac32-efcb4e6a1c87 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:30.715439 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-15d28275-b96b-4283-ac32-efcb4e6a1c87 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:30.731207 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-b1c79595-5fff-47ec-8bb2-472ca44e4f97 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:30.733513 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-b1c79595-5fff-47ec-8bb2-472ca44e4f97 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] [instance: 5d365b7e-b516-4ae9-a1cd-7502e9d71041] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:30.750625 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b1c79595-5fff-47ec-8bb2-472ca44e4f97 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:30.751122 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b1c79595-5fff-47ec-8bb2-472ca44e4f97 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:30.751619 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b1c79595-5fff-47ec-8bb2-472ca44e4f97 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:30.754915 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b1c79595-5fff-47ec-8bb2-472ca44e4f97 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:30.755889 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b1c79595-5fff-47ec-8bb2-472ca44e4f97 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:30.756057 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b1c79595-5fff-47ec-8bb2-472ca44e4f97 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:30.774545 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-15d28275-b96b-4283-ac32-efcb4e6a1c87 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:30.775002 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-15d28275-b96b-4283-ac32-efcb4e6a1c87 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:30.775495 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-15d28275-b96b-4283-ac32-efcb4e6a1c87 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:30.775946 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.objects.instance [None req-15d28275-b96b-4283-ac32-efcb4e6a1c87 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lazy-loading 'fault' on Instance uuid 9895c2ec-35ea-419e-9565-0c0f2fc5bbbc {{(pid=123595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:40:30.896293 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-15d28275-b96b-4283-ac32-efcb4e6a1c87 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:30.914079 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-15d28275-b96b-4283-ac32-efcb4e6a1c87 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:30.918541 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-15d28275-b96b-4283-ac32-efcb4e6a1c87 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:30.924162 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-15d28275-b96b-4283-ac32-efcb4e6a1c87 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] 10.222.0.43 "GET /compute/v2.1/servers/9895c2ec-35ea-419e-9565-0c0f2fc5bbbc" status: 200 len: 1350 microversion: 2.25 time: 0.244277 Oct 04 18:40:30.926949 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1154/2459] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:40:30 2022] GET /compute/v2.1/servers/9895c2ec-35ea-419e-9565-0c0f2fc5bbbc => generated 1350 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:40:30.955888 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-aa4ffce1-69fe-42e1-b0ac-e00adcd600cb tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Calling method '.version_select at 0x7fb21fecde50>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:31.131794 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-b1c79595-5fff-47ec-8bb2-472ca44e4f97 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a19da94e9e646028a7f73f9d0e0edda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc41f296eb44503868205ec8aa2fef3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:31.140874 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-aa4ffce1-69fe-42e1-b0ac-e00adcd600cb tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] 10.222.0.43 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1428 microversion: 2.1 time: 0.195936 Oct 04 18:40:31.141505 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1155/2460] 10.222.0.43 () {58 vars in 1149 bytes} [Tue Oct 4 18:40:30 2022] GET /compute/v2.1/images?type=snapshot => generated 1428 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:31.142901 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-b1c79595-5fff-47ec-8bb2-472ca44e4f97 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] 10.222.0.43 "GET /compute/v2.1/servers/5d365b7e-b516-4ae9-a1cd-7502e9d71041" status: 200 len: 1511 microversion: 2.1 time: 0.440959 Oct 04 18:40:31.153217 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1306/2461] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:30 2022] GET /compute/v2.1/servers/5d365b7e-b516-4ae9-a1cd-7502e9d71041 => generated 1511 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:31.153416 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-0a419e0f-d222-4c41-87a1-709f309218df tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:31.153416 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-0a419e0f-d222-4c41-87a1-709f309218df tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] [instance: 23ce945d-cd4a-40d5-80be-d5548c257e07] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:31.154037 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-2616be06-d518-4b92-9e4f-fbe112f99bf7 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:31.154915 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-2616be06-d518-4b92-9e4f-fbe112f99bf7 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: d9d4332a-97b6-40f1-bd7c-a9a75a9adc43] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:31.156274 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0a419e0f-d222-4c41-87a1-709f309218df tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:31.156768 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0a419e0f-d222-4c41-87a1-709f309218df tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:31.157406 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0a419e0f-d222-4c41-87a1-709f309218df tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:31.158290 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0a419e0f-d222-4c41-87a1-709f309218df tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:31.158916 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0a419e0f-d222-4c41-87a1-709f309218df tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:31.159497 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0a419e0f-d222-4c41-87a1-709f309218df tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:31.162558 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2616be06-d518-4b92-9e4f-fbe112f99bf7 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:31.163168 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2616be06-d518-4b92-9e4f-fbe112f99bf7 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:31.163725 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2616be06-d518-4b92-9e4f-fbe112f99bf7 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:31.164587 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2616be06-d518-4b92-9e4f-fbe112f99bf7 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:31.165893 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2616be06-d518-4b92-9e4f-fbe112f99bf7 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:31.166432 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2616be06-d518-4b92-9e4f-fbe112f99bf7 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:31.175519 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-0a419e0f-d222-4c41-87a1-709f309218df tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] HTTP exception thrown: Instance 23ce945d-cd4a-40d5-80be-d5548c257e07 could not be found. Oct 04 18:40:31.177408 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-0a419e0f-d222-4c41-87a1-709f309218df tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Request method failure captured: Oct 04 18:40:31.177408 n-d-851028-13 devstack@n-api.service[123595]: request: GET /compute/v2.1/servers/23ce945d-cd4a-40d5-80be-d5548c257e07 HTTP/1.1 Oct 04 18:40:31.177408 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 18:40:31.177408 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 18:40:31.177408 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 18:40:31.177408 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 0 Oct 04 18:40:31.177408 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 18:40:31.177408 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 18:40:31.177408 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 18:40:31.177408 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 18:40:31.177408 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPH2qE2WsiZvVd-vvN1M8uHJG40fIXDT1XURP-P4ciVfKnbP_2tplzYndj2wlvB6bSu_VMaD1xfU0nGHRYWQRmNIt_krh_S1n2RkrhietTC0-RnvJ1rzF8ilPx8zowbVefo7A8IyDn5QTaMC08kHUNyiYinJQT_Q7n9enahWrBitVOPM Oct 04 18:40:31.177408 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 18:40:31.177408 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 18:40:31.177408 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 18:40:31.177408 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 18:40:31.177408 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 18:40:31.177408 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 18:40:31.177408 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: 7b812c85494a49898376a0dd8140f03c Oct 04 18:40:31.177408 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-SecurityGroupsTestJSON-209295605 Oct 04 18:40:31.177408 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 18:40:31.177408 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 18:40:31.177408 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/7b812c85494a49898376a0dd8140f03c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_7b812c85494a49898376a0dd8140f03c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/7b812c85494a49898376a0dd8140f03c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/7b812c85494a49898376a0dd8140f03c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:40:31.177408 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-SecurityGroupsTestJSON-209295605 Oct 04 18:40:31.177408 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: 7b812c85494a49898376a0dd8140f03c Oct 04 18:40:31.177408 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-209295605 Oct 04 18:40:31.177408 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-SecurityGroupsTestJSON-209295605-project Oct 04 18:40:31.177408 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 18:40:31.177408 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 18:40:31.177408 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: 5c96ec8b8e0a4053b0457f213e6e262d Oct 04 18:40:31.177408 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-SecurityGroupsTestJSON-209295605-project Oct 04 18:40:31.177408 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 18:40:31.177408 n-d-851028-13 devstack@n-api.service[123595]: exception: Instance 23ce945d-cd4a-40d5-80be-d5548c257e07 could not be found. Oct 04 18:40:31.177408 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': '23ce945d-cd4a-40d5-80be-d5548c257e07'} Oct 04 18:40:31.177408 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:40:31.177408 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:40:31.177408 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:40:31.177408 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:40:31.177408 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:40:31.177408 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:40:31.177408 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:40:31.177408 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:40:31.177408 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:40:31.177408 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:40:31.177408 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23ce945d-cd4a-40d5-80be-d5548c257e07 could not be found. Oct 04 18:40:31.177408 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:40:31.177408 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:40:31.177408 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:40:31.177408 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:40:31.177408 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:40:31.177408 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:40:31.177408 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:40:31.177408 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:40:31.177408 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:40:31.177408 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:40:31.177408 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:40:31.177408 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:40:31.177408 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:40:31.177408 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:40:31.177408 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:40:31.177408 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:40:31.177408 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23ce945d-cd4a-40d5-80be-d5548c257e07 could not be found. Oct 04 18:40:31.177408 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:40:31.177408 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:40:31.177408 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:40:31.181475 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:40:31.181475 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:40:31.181475 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:40:31.181475 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:40:31.181475 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:40:31.181475 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23ce945d-cd4a-40d5-80be-d5548c257e07 could not be found. Oct 04 18:40:31.181475 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:40:31.181475 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-0a419e0f-d222-4c41-87a1-709f309218df tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Returning 404 to user: Instance 23ce945d-cd4a-40d5-80be-d5548c257e07 could not be found. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:40:31.181475 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-0a419e0f-d222-4c41-87a1-709f309218df tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] 10.222.0.43 "GET /compute/v2.1/servers/23ce945d-cd4a-40d5-80be-d5548c257e07" status: 404 len: 111 microversion: 2.1 time: 0.036334 Oct 04 18:40:31.181475 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1156/2462] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:31 2022] GET /compute/v2.1/servers/23ce945d-cd4a-40d5-80be-d5548c257e07 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:40:31.186402 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-f236d412-c13b-4303-8a67-d62ce2f6513a req-1265381a-0da3-4a9c-97bd-0b98aa14d3fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23ce945d-cd4a-40d5-80be-d5548c257e07", "name": "network-vif-deleted", "tag": "cdfdd4b0-7f80-434d-ba80-684bf856bfe6"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:40:31.198008 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:40:31.200591 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-f236d412-c13b-4303-8a67-d62ce2f6513a req-1265381a-0da3-4a9c-97bd-0b98aa14d3fb service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:31.201347 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-f236d412-c13b-4303-8a67-d62ce2f6513a req-1265381a-0da3-4a9c-97bd-0b98aa14d3fb service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:31.202207 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-f236d412-c13b-4303-8a67-d62ce2f6513a req-1265381a-0da3-4a9c-97bd-0b98aa14d3fb service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:31.219872 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-f236d412-c13b-4303-8a67-d62ce2f6513a req-1265381a-0da3-4a9c-97bd-0b98aa14d3fb service nova] Creating event network-vif-deleted:cdfdd4b0-7f80-434d-ba80-684bf856bfe6 for instance 23ce945d-cd4a-40d5-80be-d5548c257e07 on n-h1-851028-13 Oct 04 18:40:31.229541 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-f236d412-c13b-4303-8a67-d62ce2f6513a req-1265381a-0da3-4a9c-97bd-0b98aa14d3fb service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047690 Oct 04 18:40:31.230694 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1157/2463] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:40:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:40:31.238359 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-2b21da98-7971-4824-917b-43ecc37042f9 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Calling method '.version_select at 0x7fb21fbc0790>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:31.345203 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-2b21da98-7971-4824-917b-43ecc37042f9 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] 10.222.0.43 "GET /compute/v2.1/images?limit=1" status: 200 len: 622 microversion: 2.1 time: 0.112341 Oct 04 18:40:31.354624 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1158/2464] 10.222.0.43 () {58 vars in 1137 bytes} [Tue Oct 4 18:40:31 2022] GET /compute/v2.1/images?limit=1 => generated 622 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:40:31.354624 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-92cffe64-b041-4ce9-b948-6500c3ccda56 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:31.354624 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-92cffe64-b041-4ce9-b948-6500c3ccda56 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] [instance: a4de9e6e-90d3-4317-abf8-9fc8f021b803] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:31.361488 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-92cffe64-b041-4ce9-b948-6500c3ccda56 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:31.361904 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-92cffe64-b041-4ce9-b948-6500c3ccda56 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:31.362349 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-92cffe64-b041-4ce9-b948-6500c3ccda56 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:31.363076 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-92cffe64-b041-4ce9-b948-6500c3ccda56 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:31.364602 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-92cffe64-b041-4ce9-b948-6500c3ccda56 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:31.365609 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-92cffe64-b041-4ce9-b948-6500c3ccda56 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:31.528605 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-92cffe64-b041-4ce9-b948-6500c3ccda56 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a19da94e9e646028a7f73f9d0e0edda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc41f296eb44503868205ec8aa2fef3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:31.536812 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-92cffe64-b041-4ce9-b948-6500c3ccda56 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] 10.222.0.43 "GET /compute/v2.1/servers/a4de9e6e-90d3-4317-abf8-9fc8f021b803" status: 200 len: 1512 microversion: 2.1 time: 0.189556 Oct 04 18:40:31.537601 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1159/2465] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:31 2022] GET /compute/v2.1/servers/a4de9e6e-90d3-4317-abf8-9fc8f021b803 => generated 1512 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:31.542936 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-13ebc802-97b6-4a6f-ab19-f95005f26063 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Calling method '.version_select at 0x7fb21fa3f8b0>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:31.735999 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-2616be06-d518-4b92-9e4f-fbe112f99bf7 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:31.746091 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-13ebc802-97b6-4a6f-ab19-f95005f26063 tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] 10.222.0.43 "DELETE /compute/v2.1/os-security-groups/13b9a9b8-6230-413c-a2ea-4d1ffca5c194" status: 202 len: 0 microversion: 2.1 time: 0.207261 Oct 04 18:40:31.746994 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1160/2466] 10.222.0.43 () {58 vars in 1272 bytes} [Tue Oct 4 18:40:31 2022] DELETE /compute/v2.1/os-security-groups/13b9a9b8-6230-413c-a2ea-4d1ffca5c194 => generated 0 bytes in 209 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:40:31.753076 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-2616be06-d518-4b92-9e4f-fbe112f99bf7 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/d9d4332a-97b6-40f1-bd7c-a9a75a9adc43" status: 200 len: 1469 microversion: 2.1 time: 0.608055 Oct 04 18:40:31.754553 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1307/2467] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:31 2022] GET /compute/v2.1/servers/d9d4332a-97b6-40f1-bd7c-a9a75a9adc43 => generated 1469 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:31.765099 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-e658f6f5-9470-4751-85d8-75d9ceaa96ff tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Calling method '.version_select at 0x7fb21ee5b940>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:31.774456 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-cbf22f19-ecc7-4830-9149-f9ec4a67d1d9 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:31.774899 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-cbf22f19-ecc7-4830-9149-f9ec4a67d1d9 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] [instance: b53d822f-e7b1-498a-b98a-35f87839dfe8] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:31.787949 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cbf22f19-ecc7-4830-9149-f9ec4a67d1d9 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:31.788512 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cbf22f19-ecc7-4830-9149-f9ec4a67d1d9 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:31.788898 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cbf22f19-ecc7-4830-9149-f9ec4a67d1d9 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:31.789693 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cbf22f19-ecc7-4830-9149-f9ec4a67d1d9 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:31.790571 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cbf22f19-ecc7-4830-9149-f9ec4a67d1d9 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:31.791014 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cbf22f19-ecc7-4830-9149-f9ec4a67d1d9 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:31.879195 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-e658f6f5-9470-4751-85d8-75d9ceaa96ff tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] 10.222.0.43 "GET /compute/v2.1/images/detail?changes-since=2022-10-04T18%3A37%3A54Z" status: 200 len: 6331 microversion: 2.1 time: 0.122845 Oct 04 18:40:31.879970 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-cbf22f19-ecc7-4830-9149-f9ec4a67d1d9 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e1add2296c4ed5830c5d90ef272ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fdc44ceeb041bcba1be2fcc2084aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:31.884598 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1308/2468] 10.222.0.43 () {58 vars in 1220 bytes} [Tue Oct 4 18:40:31 2022] GET /compute/v2.1/images/detail?changes-since=2022-10-04T18%3A37%3A54Z => generated 6331 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:31.889855 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-34fa7e2a-e7d1-46a4-8751-53c9b38cfbc9 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:31.890616 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-34fa7e2a-e7d1-46a4-8751-53c9b38cfbc9 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] [instance: ffbbf357-494a-40e4-8943-3159707fc2e4] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:31.891268 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-cbf22f19-ecc7-4830-9149-f9ec4a67d1d9 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59e1add2296c4ed5830c5d90ef272ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fdc44ceeb041bcba1be2fcc2084aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:31.892748 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-cbf22f19-ecc7-4830-9149-f9ec4a67d1d9 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59e1add2296c4ed5830c5d90ef272ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fdc44ceeb041bcba1be2fcc2084aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:31.893973 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-cbf22f19-ecc7-4830-9149-f9ec4a67d1d9 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] 10.222.0.43 "GET /compute/v2.1/servers/b53d822f-e7b1-498a-b98a-35f87839dfe8" status: 200 len: 1400 microversion: 2.54 time: 0.141338 Oct 04 18:40:31.898180 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-34fa7e2a-e7d1-46a4-8751-53c9b38cfbc9 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:31.898791 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-34fa7e2a-e7d1-46a4-8751-53c9b38cfbc9 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:31.899501 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-34fa7e2a-e7d1-46a4-8751-53c9b38cfbc9 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:31.900580 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-34fa7e2a-e7d1-46a4-8751-53c9b38cfbc9 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:31.901342 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-34fa7e2a-e7d1-46a4-8751-53c9b38cfbc9 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:31.901993 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-34fa7e2a-e7d1-46a4-8751-53c9b38cfbc9 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:31.906577 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1161/2469] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:40:31 2022] GET /compute/v2.1/servers/b53d822f-e7b1-498a-b98a-35f87839dfe8 => generated 1400 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:40:31.918255 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-f38aafb3-92f9-410f-817f-c959ddc7527b tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:31.923933 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-f38aafb3-92f9-410f-817f-c959ddc7527b tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6a19da94e9e646028a7f73f9d0e0edda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc41f296eb44503868205ec8aa2fef3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:31.924798 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-f38aafb3-92f9-410f-817f-c959ddc7527b tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Searching by: {'ip': '172.20.0.10', 'deleted': False, 'project_id': 'dfc41f296eb44503868205ec8aa2fef3'} {{(pid=123595) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:40:32.047807 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f38aafb3-92f9-410f-817f-c959ddc7527b tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:32.048368 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f38aafb3-92f9-410f-817f-c959ddc7527b tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:32.048938 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f38aafb3-92f9-410f-817f-c959ddc7527b tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:32.050236 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f38aafb3-92f9-410f-817f-c959ddc7527b tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:32.051093 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f38aafb3-92f9-410f-817f-c959ddc7527b tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:32.051703 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f38aafb3-92f9-410f-817f-c959ddc7527b tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:32.126812 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-34fa7e2a-e7d1-46a4-8751-53c9b38cfbc9 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15432d1b74334e1188866004384befe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d562b670294a47b2171f4003be4cdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:32.144415 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-34fa7e2a-e7d1-46a4-8751-53c9b38cfbc9 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] 10.222.0.43 "GET /compute/v2.1/servers/ffbbf357-494a-40e4-8943-3159707fc2e4" status: 200 len: 1524 microversion: 2.1 time: 0.258322 Oct 04 18:40:32.145383 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1309/2470] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:31 2022] GET /compute/v2.1/servers/ffbbf357-494a-40e4-8943-3159707fc2e4 => generated 1524 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:32.156417 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-e659e206-76aa-4648-9917-6f381ae7686f tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] Calling method '.version_select at 0x7fb21ee00ca0>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:32.170777 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.multi_cell_list [None req-f38aafb3-92f9-410f-817f-c959ddc7527b tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=123595) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 18:40:32.249626 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-f38aafb3-92f9-410f-817f-c959ddc7527b tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] 10.222.0.43 "GET /compute/v2.1/servers?ip=172.20.0.10" status: 200 len: 346 microversion: 2.1 time: 0.341460 Oct 04 18:40:32.250823 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1162/2471] 10.222.0.43 () {58 vars in 1154 bytes} [Tue Oct 4 18:40:31 2022] GET /compute/v2.1/servers?ip=172.20.0.10 => generated 346 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:40:32.264837 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-9be0dfaf-3a65-407b-b0c3-70f22ebe72da tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Calling method '.version_select at 0x7fb21fa1c9d0>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:32.340658 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-9be0dfaf-3a65-407b-b0c3-70f22ebe72da tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] 10.222.0.43 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-999534851" status: 200 len: 664 microversion: 2.1 time: 0.088731 Oct 04 18:40:32.352515 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1163/2472] 10.222.0.43 () {58 vars in 1250 bytes} [Tue Oct 4 18:40:32 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-999534851 => generated 664 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:40:32.357926 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-0135a0f2-405a-4566-a3f9-482209cf519b tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Calling method '.version_select at 0x7fb21faf0dc0>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:32.385966 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-0135a0f2-405a-4566-a3f9-482209cf519b tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-1921507633" status: 204 len: 0 microversion: 2.54 time: 0.031856 Oct 04 18:40:32.386977 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1164/2473] 10.222.0.43 () {60 vars in 1319 bytes} [Tue Oct 4 18:40:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-1921507633 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 18:40:32.406608 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-54e6f6ff-f33b-4313-a67f-2427c3c14520 req-dbf076a0-91a5-48e8-a05d-204378a262de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b7f1ede-48b3-48d8-933e-287c338b1e6a", "name": "network-vif-unplugged", "status": "completed", "tag": "462f1dea-cb2e-42da-a165-e6bc91610838"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:40:32.442709 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-54e6f6ff-f33b-4313-a67f-2427c3c14520 req-dbf076a0-91a5-48e8-a05d-204378a262de service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:32.444117 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-54e6f6ff-f33b-4313-a67f-2427c3c14520 req-dbf076a0-91a5-48e8-a05d-204378a262de service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:32.444350 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-54e6f6ff-f33b-4313-a67f-2427c3c14520 req-dbf076a0-91a5-48e8-a05d-204378a262de service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:32.457054 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-e659e206-76aa-4648-9917-6f381ae7686f tempest-SecurityGroupsTestJSON-209295605 tempest-SecurityGroupsTestJSON-209295605-project] 10.222.0.43 "DELETE /compute/v2.1/os-security-groups/c812765a-ea2b-4bfe-b3da-082a43ef23ef" status: 202 len: 0 microversion: 2.1 time: 0.310763 Oct 04 18:40:32.458451 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1310/2474] 10.222.0.43 () {58 vars in 1272 bytes} [Tue Oct 4 18:40:32 2022] DELETE /compute/v2.1/os-security-groups/c812765a-ea2b-4bfe-b3da-082a43ef23ef => generated 0 bytes in 313 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:40:32.460142 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-54e6f6ff-f33b-4313-a67f-2427c3c14520 req-dbf076a0-91a5-48e8-a05d-204378a262de service nova] Creating event network-vif-unplugged:462f1dea-cb2e-42da-a165-e6bc91610838 for instance 0b7f1ede-48b3-48d8-933e-287c338b1e6a on n-h1-851028-13 Oct 04 18:40:32.466340 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-3341d61d-b65c-48f1-98a3-de1bc516de6c tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:32.467362 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-3341d61d-b65c-48f1-98a3-de1bc516de6c tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] [instance: 9895c2ec-35ea-419e-9565-0c0f2fc5bbbc] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:32.481806 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3341d61d-b65c-48f1-98a3-de1bc516de6c tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:32.482626 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3341d61d-b65c-48f1-98a3-de1bc516de6c tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:32.483337 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3341d61d-b65c-48f1-98a3-de1bc516de6c tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:32.484668 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3341d61d-b65c-48f1-98a3-de1bc516de6c tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:32.485421 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3341d61d-b65c-48f1-98a3-de1bc516de6c tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:32.486465 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3341d61d-b65c-48f1-98a3-de1bc516de6c tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:32.492216 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-54e6f6ff-f33b-4313-a67f-2427c3c14520 req-dbf076a0-91a5-48e8-a05d-204378a262de service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.103789 Oct 04 18:40:32.498141 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1165/2475] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:40:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:40:32.508278 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-3341d61d-b65c-48f1-98a3-de1bc516de6c tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] HTTP exception thrown: Instance 9895c2ec-35ea-419e-9565-0c0f2fc5bbbc could not be found. Oct 04 18:40:32.511995 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-3341d61d-b65c-48f1-98a3-de1bc516de6c tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Request method failure captured: Oct 04 18:40:32.511995 n-d-851028-13 devstack@n-api.service[123596]: request: GET /compute/v2.1/servers/9895c2ec-35ea-419e-9565-0c0f2fc5bbbc HTTP/1.1 Oct 04 18:40:32.511995 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:40:32.511995 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:40:32.511995 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:40:32.511995 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 18:40:32.511995 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:40:32.511995 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:40:32.511995 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:40:32.511995 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:40:32.511995 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPHxK_ToGvcECtRTJrWYMKaCCQEh_JZZgcqc-r_A500pVGUvovsnjwjyXlRim6Z-YtMLF9D_Q9MV8m4O2Jyok1khHVlXddWmZz_Glnhlck2aiWTU2mJ-gbHAAw8sCZHyDjKgUfwQs9jySnzCV7Gx1ajTbePvcLH61LZ4g9dLjBrddiSA Oct 04 18:40:32.511995 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:40:32.511995 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:40:32.511995 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:40:32.511995 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:40:32.511995 n-d-851028-13 devstack@n-api.service[123596]: X-Openstack-Nova-Api-Version: 2.25 Oct 04 18:40:32.511995 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:40:32.511995 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:40:32.511995 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: 34199e342c1b4158abf82384f2213b5f Oct 04 18:40:32.511995 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1153487493 Oct 04 18:40:32.511995 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 18:40:32.511995 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 18:40:32.511995 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/34199e342c1b4158abf82384f2213b5f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_34199e342c1b4158abf82384f2213b5f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/34199e342c1b4158abf82384f2213b5f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/34199e342c1b4158abf82384f2213b5f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:40:32.511995 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1153487493 Oct 04 18:40:32.511995 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: 34199e342c1b4158abf82384f2213b5f Oct 04 18:40:32.511995 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1153487493 Oct 04 18:40:32.511995 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-LiveAutoBlockMigrationV225Test-1153487493-project Oct 04 18:40:32.511995 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:40:32.511995 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:40:32.511995 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 807a4a88319946aead73a3ccfcda6aeb Oct 04 18:40:32.511995 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1153487493-project Oct 04 18:40:32.511995 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 18:40:32.511995 n-d-851028-13 devstack@n-api.service[123596]: exception: Instance 9895c2ec-35ea-419e-9565-0c0f2fc5bbbc could not be found. Oct 04 18:40:32.511995 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': '9895c2ec-35ea-419e-9565-0c0f2fc5bbbc'} Oct 04 18:40:32.511995 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:40:32.511995 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:40:32.511995 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:40:32.511995 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:40:32.511995 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:40:32.511995 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:40:32.511995 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:40:32.511995 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:40:32.511995 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:40:32.511995 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:40:32.511995 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9895c2ec-35ea-419e-9565-0c0f2fc5bbbc could not be found. Oct 04 18:40:32.511995 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:40:32.511995 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:40:32.511995 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:40:32.511995 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:40:32.511995 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:40:32.511995 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:40:32.511995 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:40:32.511995 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:40:32.511995 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:40:32.511995 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:40:32.511995 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:40:32.511995 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:40:32.511995 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:40:32.511995 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:40:32.511995 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:40:32.511995 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:40:32.511995 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9895c2ec-35ea-419e-9565-0c0f2fc5bbbc could not be found. Oct 04 18:40:32.511995 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:40:32.515665 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:40:32.515665 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:40:32.515665 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:40:32.515665 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:40:32.515665 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:40:32.515665 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:40:32.515665 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:40:32.515665 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9895c2ec-35ea-419e-9565-0c0f2fc5bbbc could not be found. Oct 04 18:40:32.515665 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:40:32.516149 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-f5c93bac-9a2c-41cc-9e10-0322a8562c5f tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:32.516149 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-f5c93bac-9a2c-41cc-9e10-0322a8562c5f tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] [instance: 1a71ee0e-ffa8-4730-b4fb-8b6e9fd87239] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:32.518735 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-3341d61d-b65c-48f1-98a3-de1bc516de6c tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Returning 404 to user: Instance 9895c2ec-35ea-419e-9565-0c0f2fc5bbbc could not be found. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:40:32.521066 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-3341d61d-b65c-48f1-98a3-de1bc516de6c tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] 10.222.0.43 "GET /compute/v2.1/servers/9895c2ec-35ea-419e-9565-0c0f2fc5bbbc" status: 404 len: 111 microversion: 2.25 time: 0.060871 Oct 04 18:40:32.522555 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1311/2476] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:40:32 2022] GET /compute/v2.1/servers/9895c2ec-35ea-419e-9565-0c0f2fc5bbbc => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:40:32.528515 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-e5269a66-189e-46c9-89fc-9dc627a990ea tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Calling method '.version_select at 0x7fb224690ca0>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:32.531018 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f5c93bac-9a2c-41cc-9e10-0322a8562c5f tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:32.531498 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f5c93bac-9a2c-41cc-9e10-0322a8562c5f tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:32.532007 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f5c93bac-9a2c-41cc-9e10-0322a8562c5f tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:32.532773 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f5c93bac-9a2c-41cc-9e10-0322a8562c5f tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:32.533261 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f5c93bac-9a2c-41cc-9e10-0322a8562c5f tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:32.536955 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f5c93bac-9a2c-41cc-9e10-0322a8562c5f tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:32.607198 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-e5269a66-189e-46c9-89fc-9dc627a990ea tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] 10.222.0.43 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.43%2Fcompute%2Fv2.1%2Fservers%2F6eb9c803-dd97-4af5-b0d0-aa6fc18f8a89" status: 200 len: 1465 microversion: 2.1 time: 0.081788 Oct 04 18:40:32.621865 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1312/2477] 10.222.0.43 () {58 vars in 1338 bytes} [Tue Oct 4 18:40:32 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.43%2Fcompute%2Fv2.1%2Fservers%2F6eb9c803-dd97-4af5-b0d0-aa6fc18f8a89 => generated 1465 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:32.630438 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-de9a35b4-f9db-49cd-b932-34414ad5eb92 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:32.631269 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-de9a35b4-f9db-49cd-b932-34414ad5eb92 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] [instance: b53d822f-e7b1-498a-b98a-35f87839dfe8] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:32.638998 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-de9a35b4-f9db-49cd-b932-34414ad5eb92 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:32.639537 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-de9a35b4-f9db-49cd-b932-34414ad5eb92 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:32.640030 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-de9a35b4-f9db-49cd-b932-34414ad5eb92 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:32.640880 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-de9a35b4-f9db-49cd-b932-34414ad5eb92 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:32.641426 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-de9a35b4-f9db-49cd-b932-34414ad5eb92 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:32.641887 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-de9a35b4-f9db-49cd-b932-34414ad5eb92 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:32.677423 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-de9a35b4-f9db-49cd-b932-34414ad5eb92 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] [instance: b53d822f-e7b1-498a-b98a-35f87839dfe8] Going to try to terminate instance {{(pid=123596) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:40:32.789073 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:40:32.803949 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-de9a35b4-f9db-49cd-b932-34414ad5eb92 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] 10.222.0.43 "DELETE /compute/v2.1/servers/b53d822f-e7b1-498a-b98a-35f87839dfe8" status: 204 len: 0 microversion: 2.54 time: 0.177543 Oct 04 18:40:32.808748 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1313/2478] 10.222.0.43 () {60 vars in 1280 bytes} [Tue Oct 4 18:40:32 2022] DELETE /compute/v2.1/servers/b53d822f-e7b1-498a-b98a-35f87839dfe8 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 18:40:32.816026 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-27b2d79d-88bd-427d-87d2-22f7dc6c3296 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:32.817298 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-27b2d79d-88bd-427d-87d2-22f7dc6c3296 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] [instance: fd5fe360-8ecf-41d0-9376-9d5533fc6ba8] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:32.830050 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-27b2d79d-88bd-427d-87d2-22f7dc6c3296 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:32.830997 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-27b2d79d-88bd-427d-87d2-22f7dc6c3296 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:32.831869 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-27b2d79d-88bd-427d-87d2-22f7dc6c3296 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:32.833334 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-27b2d79d-88bd-427d-87d2-22f7dc6c3296 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:32.834020 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-27b2d79d-88bd-427d-87d2-22f7dc6c3296 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:32.835270 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-27b2d79d-88bd-427d-87d2-22f7dc6c3296 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:32.882340 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-27b2d79d-88bd-427d-87d2-22f7dc6c3296 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] [instance: fd5fe360-8ecf-41d0-9376-9d5533fc6ba8] Going to try to terminate instance {{(pid=123596) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:40:33.005832 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-27b2d79d-88bd-427d-87d2-22f7dc6c3296 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] 10.222.0.43 "DELETE /compute/v2.1/servers/fd5fe360-8ecf-41d0-9376-9d5533fc6ba8" status: 204 len: 0 microversion: 2.25 time: 0.194237 Oct 04 18:40:33.011342 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1314/2479] 10.222.0.43 () {60 vars in 1280 bytes} [Tue Oct 4 18:40:32 2022] DELETE /compute/v2.1/servers/fd5fe360-8ecf-41d0-9376-9d5533fc6ba8 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 18:40:33.017694 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-bf567313-895a-4848-ba8e-fd7c326bc07c tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Calling method '.version_select at 0x7fb21edac3a0>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:33.034460 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-f5c93bac-9a2c-41cc-9e10-0322a8562c5f tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a19da94e9e646028a7f73f9d0e0edda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc41f296eb44503868205ec8aa2fef3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:33.047699 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-f5c93bac-9a2c-41cc-9e10-0322a8562c5f tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] 10.222.0.43 "GET /compute/v2.1/servers/1a71ee0e-ffa8-4730-b4fb-8b6e9fd87239" status: 200 len: 1511 microversion: 2.1 time: 0.548066 Oct 04 18:40:33.065033 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1166/2480] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:32 2022] GET /compute/v2.1/servers/1a71ee0e-ffa8-4730-b4fb-8b6e9fd87239 => generated 1511 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:33.074488 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-c8347d0b-f087-4f44-ba8c-eb0de0d66ba6 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:33.078118 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-c8347d0b-f087-4f44-ba8c-eb0de0d66ba6 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: d9d4332a-97b6-40f1-bd7c-a9a75a9adc43] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:33.087064 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c8347d0b-f087-4f44-ba8c-eb0de0d66ba6 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:33.087669 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c8347d0b-f087-4f44-ba8c-eb0de0d66ba6 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:33.088226 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c8347d0b-f087-4f44-ba8c-eb0de0d66ba6 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:33.089067 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c8347d0b-f087-4f44-ba8c-eb0de0d66ba6 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:33.089653 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c8347d0b-f087-4f44-ba8c-eb0de0d66ba6 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:33.090294 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c8347d0b-f087-4f44-ba8c-eb0de0d66ba6 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:33.105703 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-bf567313-895a-4848-ba8e-fd7c326bc07c tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] 10.222.0.43 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.43%2Fcompute%2Fservers%2F6eb9c803-dd97-4af5-b0d0-aa6fc18f8a89" status: 200 len: 1465 microversion: 2.1 time: 0.095577 Oct 04 18:40:33.108384 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1315/2481] 10.222.0.43 () {58 vars in 1324 bytes} [Tue Oct 4 18:40:33 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.43%2Fcompute%2Fservers%2F6eb9c803-dd97-4af5-b0d0-aa6fc18f8a89 => generated 1465 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:33.113570 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-300f2475-fe95-4e0d-b1f9-92be39c15ced tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:33.114605 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-300f2475-fe95-4e0d-b1f9-92be39c15ced tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] [instance: b53d822f-e7b1-498a-b98a-35f87839dfe8] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:33.128731 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-300f2475-fe95-4e0d-b1f9-92be39c15ced tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:33.129874 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-300f2475-fe95-4e0d-b1f9-92be39c15ced tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:33.130524 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-300f2475-fe95-4e0d-b1f9-92be39c15ced tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:33.132400 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-300f2475-fe95-4e0d-b1f9-92be39c15ced tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:33.134181 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-300f2475-fe95-4e0d-b1f9-92be39c15ced tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:33.134894 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-300f2475-fe95-4e0d-b1f9-92be39c15ced tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:33.240623 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-300f2475-fe95-4e0d-b1f9-92be39c15ced tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e1add2296c4ed5830c5d90ef272ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fdc44ceeb041bcba1be2fcc2084aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:33.252290 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-300f2475-fe95-4e0d-b1f9-92be39c15ced tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59e1add2296c4ed5830c5d90ef272ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fdc44ceeb041bcba1be2fcc2084aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:33.254711 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-300f2475-fe95-4e0d-b1f9-92be39c15ced tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59e1add2296c4ed5830c5d90ef272ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fdc44ceeb041bcba1be2fcc2084aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:33.256159 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-300f2475-fe95-4e0d-b1f9-92be39c15ced tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] 10.222.0.43 "GET /compute/v2.1/servers/b53d822f-e7b1-498a-b98a-35f87839dfe8" status: 200 len: 1406 microversion: 2.54 time: 0.146566 Oct 04 18:40:33.269877 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1316/2482] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:40:33 2022] GET /compute/v2.1/servers/b53d822f-e7b1-498a-b98a-35f87839dfe8 => generated 1406 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:40:33.282129 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-bb27ced6-2d22-4027-b575-931b9c7bebb3 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:33.282741 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-bb27ced6-2d22-4027-b575-931b9c7bebb3 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] [instance: fd5fe360-8ecf-41d0-9376-9d5533fc6ba8] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:33.288912 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bb27ced6-2d22-4027-b575-931b9c7bebb3 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:33.289458 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bb27ced6-2d22-4027-b575-931b9c7bebb3 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:33.290041 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bb27ced6-2d22-4027-b575-931b9c7bebb3 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:33.290740 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bb27ced6-2d22-4027-b575-931b9c7bebb3 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:33.291190 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bb27ced6-2d22-4027-b575-931b9c7bebb3 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:33.291612 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bb27ced6-2d22-4027-b575-931b9c7bebb3 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:33.426624 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-c8347d0b-f087-4f44-ba8c-eb0de0d66ba6 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:33.442212 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-c8347d0b-f087-4f44-ba8c-eb0de0d66ba6 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/d9d4332a-97b6-40f1-bd7c-a9a75a9adc43" status: 200 len: 1469 microversion: 2.1 time: 0.373147 Oct 04 18:40:33.442212 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1167/2483] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:33 2022] GET /compute/v2.1/servers/d9d4332a-97b6-40f1-bd7c-a9a75a9adc43 => generated 1469 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:33.450003 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-fb31d06a-19d2-4f21-9fd6-876a0d188463 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:33.451450 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-fb31d06a-19d2-4f21-9fd6-876a0d188463 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] [instance: 5d365b7e-b516-4ae9-a1cd-7502e9d71041] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:33.463069 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fb31d06a-19d2-4f21-9fd6-876a0d188463 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:33.477017 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fb31d06a-19d2-4f21-9fd6-876a0d188463 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:33.477744 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fb31d06a-19d2-4f21-9fd6-876a0d188463 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:33.479640 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fb31d06a-19d2-4f21-9fd6-876a0d188463 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:33.479783 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fb31d06a-19d2-4f21-9fd6-876a0d188463 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:33.480447 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fb31d06a-19d2-4f21-9fd6-876a0d188463 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:33.538293 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-bb27ced6-2d22-4027-b575-931b9c7bebb3 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:33.551741 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:40:33.569991 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-bb27ced6-2d22-4027-b575-931b9c7bebb3 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:33.574658 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-bb27ced6-2d22-4027-b575-931b9c7bebb3 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:33.576787 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-bb27ced6-2d22-4027-b575-931b9c7bebb3 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] 10.222.0.43 "GET /compute/v2.1/servers/fd5fe360-8ecf-41d0-9376-9d5533fc6ba8" status: 200 len: 1564 microversion: 2.25 time: 0.305406 Oct 04 18:40:33.585516 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1317/2484] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:40:33 2022] GET /compute/v2.1/servers/fd5fe360-8ecf-41d0-9376-9d5533fc6ba8 => generated 1564 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:40:33.601072 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-c1dde066-ead4-4e4a-8d83-5002db4f634e tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Calling method '.version_select at 0x7fb21edf9280>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:33.733823 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-c1dde066-ead4-4e4a-8d83-5002db4f634e tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] 10.222.0.43 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7106 microversion: 2.1 time: 0.146660 Oct 04 18:40:33.734975 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1318/2485] 10.222.0.43 () {58 vars in 1170 bytes} [Tue Oct 4 18:40:33 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7106 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:33.740350 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-899eb290-c149-409e-a310-981c5d41c322 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:33.742314 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-899eb290-c149-409e-a310-981c5d41c322 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] [instance: ffbbf357-494a-40e4-8943-3159707fc2e4] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:33.750957 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-899eb290-c149-409e-a310-981c5d41c322 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:33.752096 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-899eb290-c149-409e-a310-981c5d41c322 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:33.752780 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-899eb290-c149-409e-a310-981c5d41c322 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:33.753813 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-899eb290-c149-409e-a310-981c5d41c322 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:33.754489 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-899eb290-c149-409e-a310-981c5d41c322 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:33.755211 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-899eb290-c149-409e-a310-981c5d41c322 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:33.914919 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-fb31d06a-19d2-4f21-9fd6-876a0d188463 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a19da94e9e646028a7f73f9d0e0edda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc41f296eb44503868205ec8aa2fef3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:33.923960 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-fb31d06a-19d2-4f21-9fd6-876a0d188463 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] 10.222.0.43 "GET /compute/v2.1/servers/5d365b7e-b516-4ae9-a1cd-7502e9d71041" status: 200 len: 1511 microversion: 2.1 time: 0.480222 Oct 04 18:40:33.925977 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1168/2486] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:33 2022] GET /compute/v2.1/servers/5d365b7e-b516-4ae9-a1cd-7502e9d71041 => generated 1511 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:33.931442 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-9a9cd927-a435-4223-b26a-2d1df6654a1e tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Calling method '.version_select at 0x7fb21fbc08b0>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:34.014907 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-9a9cd927-a435-4223-b26a-2d1df6654a1e tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] 10.222.0.43 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4374 microversion: 2.1 time: 0.087610 Oct 04 18:40:34.016140 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1169/2487] 10.222.0.43 () {58 vars in 1170 bytes} [Tue Oct 4 18:40:33 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4374 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:34.021879 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-0d458e68-1f51-434f-a02a-33dd60be25f7 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:34.022845 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-0d458e68-1f51-434f-a02a-33dd60be25f7 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] [instance: a4de9e6e-90d3-4317-abf8-9fc8f021b803] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:34.030556 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0d458e68-1f51-434f-a02a-33dd60be25f7 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:34.031350 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0d458e68-1f51-434f-a02a-33dd60be25f7 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:34.032069 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0d458e68-1f51-434f-a02a-33dd60be25f7 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:34.033023 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0d458e68-1f51-434f-a02a-33dd60be25f7 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:34.034216 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0d458e68-1f51-434f-a02a-33dd60be25f7 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:34.035171 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0d458e68-1f51-434f-a02a-33dd60be25f7 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:34.094904 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-899eb290-c149-409e-a310-981c5d41c322 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15432d1b74334e1188866004384befe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d562b670294a47b2171f4003be4cdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:34.105002 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-899eb290-c149-409e-a310-981c5d41c322 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] 10.222.0.43 "GET /compute/v2.1/servers/ffbbf357-494a-40e4-8943-3159707fc2e4" status: 200 len: 1524 microversion: 2.1 time: 0.368752 Oct 04 18:40:34.105789 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1319/2488] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:33 2022] GET /compute/v2.1/servers/ffbbf357-494a-40e4-8943-3159707fc2e4 => generated 1524 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:34.127570 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-0ce2a697-be1c-4984-8050-3c2433963480 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Calling method '.version_select at 0x7fb21ed41c10>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:34.182133 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-0ce2a697-be1c-4984-8050-3c2433963480 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] 10.222.0.43 "GET /compute/v2.1/images/e8943ec5-4038-4d4b-b9b9-2415a79f5243" status: 200 len: 784 microversion: 2.1 time: 0.075001 Oct 04 18:40:34.183035 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1320/2489] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 18:40:34 2022] GET /compute/v2.1/images/e8943ec5-4038-4d4b-b9b9-2415a79f5243 => generated 784 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:40:34.197993 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-60fade0d-1fd9-4a9f-b59c-dc68be84bc96 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Calling method '.version_select at 0x7fb21ed75e50>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:34.267348 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-60fade0d-1fd9-4a9f-b59c-dc68be84bc96 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] 10.222.0.43 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 1611 microversion: 2.1 time: 0.073346 Oct 04 18:40:34.281524 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1321/2490] 10.222.0.43 () {58 vars in 1158 bytes} [Tue Oct 4 18:40:34 2022] GET /compute/v2.1/images/detail?limit=1 => generated 1611 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:34.287092 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-6fa8a6ae-3521-4b34-8dbd-f209a5107495 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:34.287942 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-6fa8a6ae-3521-4b34-8dbd-f209a5107495 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] [instance: b53d822f-e7b1-498a-b98a-35f87839dfe8] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:34.295265 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6fa8a6ae-3521-4b34-8dbd-f209a5107495 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:34.296078 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6fa8a6ae-3521-4b34-8dbd-f209a5107495 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:34.296673 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6fa8a6ae-3521-4b34-8dbd-f209a5107495 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:34.297405 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6fa8a6ae-3521-4b34-8dbd-f209a5107495 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:34.298004 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6fa8a6ae-3521-4b34-8dbd-f209a5107495 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:34.298576 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6fa8a6ae-3521-4b34-8dbd-f209a5107495 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:34.335293 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-0d458e68-1f51-434f-a02a-33dd60be25f7 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a19da94e9e646028a7f73f9d0e0edda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc41f296eb44503868205ec8aa2fef3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:34.346399 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-0d458e68-1f51-434f-a02a-33dd60be25f7 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] 10.222.0.43 "GET /compute/v2.1/servers/a4de9e6e-90d3-4317-abf8-9fc8f021b803" status: 200 len: 1512 microversion: 2.1 time: 0.328821 Oct 04 18:40:34.347302 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1170/2491] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:34 2022] GET /compute/v2.1/servers/a4de9e6e-90d3-4317-abf8-9fc8f021b803 => generated 1512 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:34.353255 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-20d4f660-343f-4c6c-96f4-eb1e84bf1712 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Calling method '.version_select at 0x7fb21fc3cd30>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:34.401471 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-6fa8a6ae-3521-4b34-8dbd-f209a5107495 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e1add2296c4ed5830c5d90ef272ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fdc44ceeb041bcba1be2fcc2084aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:34.410903 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-6fa8a6ae-3521-4b34-8dbd-f209a5107495 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59e1add2296c4ed5830c5d90ef272ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fdc44ceeb041bcba1be2fcc2084aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:34.412415 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-6fa8a6ae-3521-4b34-8dbd-f209a5107495 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59e1add2296c4ed5830c5d90ef272ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fdc44ceeb041bcba1be2fcc2084aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:34.413858 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-6fa8a6ae-3521-4b34-8dbd-f209a5107495 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] 10.222.0.43 "GET /compute/v2.1/servers/b53d822f-e7b1-498a-b98a-35f87839dfe8" status: 200 len: 1406 microversion: 2.54 time: 0.130958 Oct 04 18:40:34.414617 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1322/2492] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:40:34 2022] GET /compute/v2.1/servers/b53d822f-e7b1-498a-b98a-35f87839dfe8 => generated 1406 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:40:34.427982 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-0ba4bd19-e705-414c-b053-0c69330ee525 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:34.434555 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-0ba4bd19-e705-414c-b053-0c69330ee525 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6a19da94e9e646028a7f73f9d0e0edda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc41f296eb44503868205ec8aa2fef3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:34.435325 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-0ba4bd19-e705-414c-b053-0c69330ee525 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Searching by: {'deleted': False, 'project_id': 'dfc41f296eb44503868205ec8aa2fef3'} {{(pid=123596) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:40:34.441635 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0ba4bd19-e705-414c-b053-0c69330ee525 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:34.442400 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0ba4bd19-e705-414c-b053-0c69330ee525 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:34.442860 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0ba4bd19-e705-414c-b053-0c69330ee525 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:34.443583 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0ba4bd19-e705-414c-b053-0c69330ee525 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:34.444036 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0ba4bd19-e705-414c-b053-0c69330ee525 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:34.444461 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0ba4bd19-e705-414c-b053-0c69330ee525 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:34.477749 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.multi_cell_list [None req-0ba4bd19-e705-414c-b053-0c69330ee525 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=123596) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 18:40:34.515960 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-0ba4bd19-e705-414c-b053-0c69330ee525 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a19da94e9e646028a7f73f9d0e0edda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc41f296eb44503868205ec8aa2fef3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:34.526930 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0ba4bd19-e705-414c-b053-0c69330ee525 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:34.526930 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0ba4bd19-e705-414c-b053-0c69330ee525 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:34.526930 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0ba4bd19-e705-414c-b053-0c69330ee525 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:34.671010 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-0ba4bd19-e705-414c-b053-0c69330ee525 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] 10.222.0.43 "GET /compute/v2.1/servers/detail" status: 200 len: 4517 microversion: 2.1 time: 0.255322 Oct 04 18:40:34.672033 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1323/2493] 10.222.0.43 () {58 vars in 1146 bytes} [Tue Oct 4 18:40:34 2022] GET /compute/v2.1/servers/detail => generated 4517 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:34.677140 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-77bf296c-499d-4a13-b004-ed989551d227 req-4a502ae6-ef11-45e9-bd16-ccc115cfcb94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd5fe360-8ecf-41d0-9376-9d5533fc6ba8", "name": "network-vif-deleted", "tag": "c60c6944-7112-4929-bd6e-03bb7d4559d0"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:40:34.708083 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-77bf296c-499d-4a13-b004-ed989551d227 req-4a502ae6-ef11-45e9-bd16-ccc115cfcb94 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:34.708796 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-77bf296c-499d-4a13-b004-ed989551d227 req-4a502ae6-ef11-45e9-bd16-ccc115cfcb94 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:34.709295 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-77bf296c-499d-4a13-b004-ed989551d227 req-4a502ae6-ef11-45e9-bd16-ccc115cfcb94 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:34.722603 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-77bf296c-499d-4a13-b004-ed989551d227 req-4a502ae6-ef11-45e9-bd16-ccc115cfcb94 service nova] Creating event network-vif-deleted:c60c6944-7112-4929-bd6e-03bb7d4559d0 for instance fd5fe360-8ecf-41d0-9376-9d5533fc6ba8 on n-h2-851028-13 Oct 04 18:40:34.728782 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-77bf296c-499d-4a13-b004-ed989551d227 req-4a502ae6-ef11-45e9-bd16-ccc115cfcb94 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054733 Oct 04 18:40:34.733559 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1324/2494] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:40:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:40:34.755368 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-2ad79e1f-c0a4-4d98-805d-149c8128705f tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:34.756036 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-2ad79e1f-c0a4-4d98-805d-149c8128705f tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: d9d4332a-97b6-40f1-bd7c-a9a75a9adc43] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:34.774422 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2ad79e1f-c0a4-4d98-805d-149c8128705f tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:34.775041 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2ad79e1f-c0a4-4d98-805d-149c8128705f tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:34.775499 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2ad79e1f-c0a4-4d98-805d-149c8128705f tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:34.776713 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2ad79e1f-c0a4-4d98-805d-149c8128705f tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:34.776713 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2ad79e1f-c0a4-4d98-805d-149c8128705f tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:34.777170 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2ad79e1f-c0a4-4d98-805d-149c8128705f tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:35.091729 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-2ad79e1f-c0a4-4d98-805d-149c8128705f tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:35.104688 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-2ad79e1f-c0a4-4d98-805d-149c8128705f tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/d9d4332a-97b6-40f1-bd7c-a9a75a9adc43" status: 200 len: 1535 microversion: 2.1 time: 0.367272 Oct 04 18:40:35.106011 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1325/2495] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:34 2022] GET /compute/v2.1/servers/d9d4332a-97b6-40f1-bd7c-a9a75a9adc43 => generated 1535 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:35.121413 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-19c5063e-f967-48c4-8287-1560614cff4b tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:35.122399 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-19c5063e-f967-48c4-8287-1560614cff4b tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] [instance: fd5fe360-8ecf-41d0-9376-9d5533fc6ba8] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:35.136817 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-19c5063e-f967-48c4-8287-1560614cff4b tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:35.150918 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-19c5063e-f967-48c4-8287-1560614cff4b tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:35.151572 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-19c5063e-f967-48c4-8287-1560614cff4b tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:35.152598 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-19c5063e-f967-48c4-8287-1560614cff4b tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:35.153841 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-19c5063e-f967-48c4-8287-1560614cff4b tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:35.167674 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-19c5063e-f967-48c4-8287-1560614cff4b tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:35.287050 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-19c5063e-f967-48c4-8287-1560614cff4b tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:35.287695 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-19c5063e-f967-48c4-8287-1560614cff4b tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:35.288350 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-19c5063e-f967-48c4-8287-1560614cff4b tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:35.291469 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.objects.instance [None req-19c5063e-f967-48c4-8287-1560614cff4b tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lazy-loading 'fault' on Instance uuid fd5fe360-8ecf-41d0-9376-9d5533fc6ba8 {{(pid=123596) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:40:35.329159 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-20d4f660-343f-4c6c-96f4-eb1e84bf1712 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] 10.222.0.43 "DELETE /compute/v2.1/images/e4d3e808-f1b4-4480-90f6-79b6d4964f47" status: 204 len: 0 microversion: 2.1 time: 0.980648 Oct 04 18:40:35.330260 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1171/2496] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:34 2022] DELETE /compute/v2.1/images/e4d3e808-f1b4-4480-90f6-79b6d4964f47 => generated 0 bytes in 982 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:40:35.335509 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-82c1cbd0-9d21-40c6-8a2a-e7bd2b0134b7 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:35.343230 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-82c1cbd0-9d21-40c6-8a2a-e7bd2b0134b7 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6a19da94e9e646028a7f73f9d0e0edda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc41f296eb44503868205ec8aa2fef3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:35.343950 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-82c1cbd0-9d21-40c6-8a2a-e7bd2b0134b7 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Searching by: {'ip': '172.20.0.', 'deleted': False, 'project_id': 'dfc41f296eb44503868205ec8aa2fef3'} {{(pid=123595) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:40:35.347149 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-19c5063e-f967-48c4-8287-1560614cff4b tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:35.356751 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-19c5063e-f967-48c4-8287-1560614cff4b tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:35.358933 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-19c5063e-f967-48c4-8287-1560614cff4b tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '807a4a88319946aead73a3ccfcda6aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34199e342c1b4158abf82384f2213b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:35.360349 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-19c5063e-f967-48c4-8287-1560614cff4b tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] 10.222.0.43 "GET /compute/v2.1/servers/fd5fe360-8ecf-41d0-9376-9d5533fc6ba8" status: 200 len: 1351 microversion: 2.25 time: 0.253165 Oct 04 18:40:35.361157 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1326/2497] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:40:35 2022] GET /compute/v2.1/servers/fd5fe360-8ecf-41d0-9376-9d5533fc6ba8 => generated 1351 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:40:35.374579 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-55ae2418-7ca6-44a5-94be-3647c79e8fdb tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:35.375675 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-55ae2418-7ca6-44a5-94be-3647c79e8fdb tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] [instance: ffbbf357-494a-40e4-8943-3159707fc2e4] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:35.384026 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-55ae2418-7ca6-44a5-94be-3647c79e8fdb tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:35.384684 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-55ae2418-7ca6-44a5-94be-3647c79e8fdb tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:35.385157 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-55ae2418-7ca6-44a5-94be-3647c79e8fdb tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:35.386034 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-55ae2418-7ca6-44a5-94be-3647c79e8fdb tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:35.386623 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-55ae2418-7ca6-44a5-94be-3647c79e8fdb tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:35.387060 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-55ae2418-7ca6-44a5-94be-3647c79e8fdb tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:35.628027 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-55ae2418-7ca6-44a5-94be-3647c79e8fdb tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15432d1b74334e1188866004384befe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d562b670294a47b2171f4003be4cdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:35.638956 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-55ae2418-7ca6-44a5-94be-3647c79e8fdb tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] 10.222.0.43 "GET /compute/v2.1/servers/ffbbf357-494a-40e4-8943-3159707fc2e4" status: 200 len: 1524 microversion: 2.1 time: 0.276120 Oct 04 18:40:35.640417 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1327/2498] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:35 2022] GET /compute/v2.1/servers/ffbbf357-494a-40e4-8943-3159707fc2e4 => generated 1524 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:35.654312 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-420128de-e2f2-479b-91fc-9ebaa3ec5dc8 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Calling method '.version_select at 0x7fb21ee5b280>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:35.662893 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-82c1cbd0-9d21-40c6-8a2a-e7bd2b0134b7 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:35.663675 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-82c1cbd0-9d21-40c6-8a2a-e7bd2b0134b7 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:35.665208 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-82c1cbd0-9d21-40c6-8a2a-e7bd2b0134b7 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:35.666686 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-82c1cbd0-9d21-40c6-8a2a-e7bd2b0134b7 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:35.668036 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-82c1cbd0-9d21-40c6-8a2a-e7bd2b0134b7 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:35.669165 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-82c1cbd0-9d21-40c6-8a2a-e7bd2b0134b7 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:35.731997 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.multi_cell_list [None req-82c1cbd0-9d21-40c6-8a2a-e7bd2b0134b7 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=123595) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 18:40:35.796634 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-82c1cbd0-9d21-40c6-8a2a-e7bd2b0134b7 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] 10.222.0.43 "GET /compute/v2.1/servers?ip=172.20.0." status: 200 len: 1012 microversion: 2.1 time: 0.465276 Oct 04 18:40:35.797596 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1172/2499] 10.222.0.43 () {58 vars in 1150 bytes} [Tue Oct 4 18:40:35 2022] GET /compute/v2.1/servers?ip=172.20.0. => generated 1012 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:35.811996 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-0279e9b9-5997-4a29-88a4-523cc21ffc26 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:35.812700 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-0279e9b9-5997-4a29-88a4-523cc21ffc26 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] [instance: b53d822f-e7b1-498a-b98a-35f87839dfe8] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:35.819843 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0279e9b9-5997-4a29-88a4-523cc21ffc26 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:35.820313 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0279e9b9-5997-4a29-88a4-523cc21ffc26 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:35.821523 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0279e9b9-5997-4a29-88a4-523cc21ffc26 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:35.822455 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0279e9b9-5997-4a29-88a4-523cc21ffc26 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:35.823070 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0279e9b9-5997-4a29-88a4-523cc21ffc26 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:35.823764 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0279e9b9-5997-4a29-88a4-523cc21ffc26 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:35.867689 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0279e9b9-5997-4a29-88a4-523cc21ffc26 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:35.868459 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0279e9b9-5997-4a29-88a4-523cc21ffc26 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:35.869093 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0279e9b9-5997-4a29-88a4-523cc21ffc26 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:35.869793 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.objects.instance [None req-0279e9b9-5997-4a29-88a4-523cc21ffc26 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Lazy-loading 'fault' on Instance uuid b53d822f-e7b1-498a-b98a-35f87839dfe8 {{(pid=123595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:40:35.975489 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-0279e9b9-5997-4a29-88a4-523cc21ffc26 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e1add2296c4ed5830c5d90ef272ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fdc44ceeb041bcba1be2fcc2084aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:36.000563 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-0279e9b9-5997-4a29-88a4-523cc21ffc26 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59e1add2296c4ed5830c5d90ef272ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fdc44ceeb041bcba1be2fcc2084aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:36.006482 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-0279e9b9-5997-4a29-88a4-523cc21ffc26 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59e1add2296c4ed5830c5d90ef272ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fdc44ceeb041bcba1be2fcc2084aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:36.007821 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-0279e9b9-5997-4a29-88a4-523cc21ffc26 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] 10.222.0.43 "GET /compute/v2.1/servers/b53d822f-e7b1-498a-b98a-35f87839dfe8" status: 200 len: 1411 microversion: 2.54 time: 0.209141 Oct 04 18:40:36.012037 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1173/2500] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:40:35 2022] GET /compute/v2.1/servers/b53d822f-e7b1-498a-b98a-35f87839dfe8 => generated 1411 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:40:36.019162 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-f6ab1b25-4a51-463a-9351-fc75f997ef39 req-697477a1-d370-4955-ae40-901be23f4bbd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9d4332a-97b6-40f1-bd7c-a9a75a9adc43", "name": "network-vif-unplugged", "status": "completed", "tag": "e64ffaa5-c4b7-4d5d-b9bd-605829597e42"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:40:36.029979 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-f6ab1b25-4a51-463a-9351-fc75f997ef39 req-697477a1-d370-4955-ae40-901be23f4bbd service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:36.030669 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-f6ab1b25-4a51-463a-9351-fc75f997ef39 req-697477a1-d370-4955-ae40-901be23f4bbd service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:36.031321 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-f6ab1b25-4a51-463a-9351-fc75f997ef39 req-697477a1-d370-4955-ae40-901be23f4bbd service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:36.055019 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-f6ab1b25-4a51-463a-9351-fc75f997ef39 req-697477a1-d370-4955-ae40-901be23f4bbd service nova] Creating event network-vif-unplugged:e64ffaa5-c4b7-4d5d-b9bd-605829597e42 for instance d9d4332a-97b6-40f1-bd7c-a9a75a9adc43 on n-h1-851028-13 Oct 04 18:40:36.065473 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [req-f6ab1b25-4a51-463a-9351-fc75f997ef39 req-697477a1-d370-4955-ae40-901be23f4bbd service nova] Instance d9d4332a-97b6-40f1-bd7c-a9a75a9adc43 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851028-13', 'n-h2-851028-13'} {{(pid=123595) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 18:40:36.082012 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-f6ab1b25-4a51-463a-9351-fc75f997ef39 req-697477a1-d370-4955-ae40-901be23f4bbd service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.068717 Oct 04 18:40:36.082746 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1174/2501] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:40:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:40:36.088588 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-606ef9f0-9740-419b-8412-ba275704423a tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:36.094494 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-606ef9f0-9740-419b-8412-ba275704423a tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6a19da94e9e646028a7f73f9d0e0edda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc41f296eb44503868205ec8aa2fef3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:36.095373 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-606ef9f0-9740-419b-8412-ba275704423a tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': 'dfc41f296eb44503868205ec8aa2fef3'} {{(pid=123595) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:40:36.101152 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-606ef9f0-9740-419b-8412-ba275704423a tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:36.102248 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-606ef9f0-9740-419b-8412-ba275704423a tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:36.102765 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-606ef9f0-9740-419b-8412-ba275704423a tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:36.103581 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-606ef9f0-9740-419b-8412-ba275704423a tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:36.104108 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-606ef9f0-9740-419b-8412-ba275704423a tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:36.104709 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-606ef9f0-9740-419b-8412-ba275704423a tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:36.231756 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.multi_cell_list [None req-606ef9f0-9740-419b-8412-ba275704423a tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=123595) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 18:40:36.314610 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-606ef9f0-9740-419b-8412-ba275704423a tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] 10.222.0.43 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1012 microversion: 2.1 time: 0.230409 Oct 04 18:40:36.315203 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1175/2502] 10.222.0.43 () {58 vars in 1212 bytes} [Tue Oct 4 18:40:36 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1012 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:36.470644 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-fcd48178-f41e-429b-b584-2e4a75b48166 tempest-ImagesMetadataNegativeTestJSON-1890424188 tempest-ImagesMetadataNegativeTestJSON-1890424188-project] Calling method '.version_select at 0x7fb21fc3c790>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:36.497225 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-fcd48178-f41e-429b-b584-2e4a75b48166 tempest-ImagesMetadataNegativeTestJSON-1890424188 tempest-ImagesMetadataNegativeTestJSON-1890424188-project] HTTP exception thrown: Image not found. Oct 04 18:40:36.503422 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-fcd48178-f41e-429b-b584-2e4a75b48166 tempest-ImagesMetadataNegativeTestJSON-1890424188 tempest-ImagesMetadataNegativeTestJSON-1890424188-project] Request method failure captured: Oct 04 18:40:36.503422 n-d-851028-13 devstack@n-api.service[123595]: request: DELETE /compute/v2.1/images/4f90371a-b2dc-46a9-8001-82655563fe65/metadata/os_distro HTTP/1.1 Oct 04 18:40:36.503422 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 18:40:36.503422 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 18:40:36.503422 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 18:40:36.503422 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 0 Oct 04 18:40:36.503422 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 18:40:36.503422 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 18:40:36.503422 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 18:40:36.503422 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 18:40:36.503422 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPH4jvA-YMj_U9SKy6Gba4xbg2vvWX2L41fCYnriFDCRsJlXsL1p693mR1vuWTfHEu4V22Qsh4__8QaMnI5mAag4pQ1GLrqdX2zIKQu5l8TXYpNFuI4QXG7yd5mzS429xwuZDwyhKK-VehO--kd3kxyH7vxn1Kv1LhMT-bliZyqsEKeE Oct 04 18:40:36.503422 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 18:40:36.503422 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 18:40:36.503422 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 18:40:36.503422 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 18:40:36.503422 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 18:40:36.503422 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 18:40:36.503422 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: 06dc253b0843415b943c81a95eda4ceb Oct 04 18:40:36.503422 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1890424188 Oct 04 18:40:36.503422 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 18:40:36.503422 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 18:40:36.503422 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/06dc253b0843415b943c81a95eda4ceb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_06dc253b0843415b943c81a95eda4ceb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/06dc253b0843415b943c81a95eda4ceb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/06dc253b0843415b943c81a95eda4ceb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:40:36.503422 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1890424188 Oct 04 18:40:36.503422 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: 06dc253b0843415b943c81a95eda4ceb Oct 04 18:40:36.503422 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1890424188 Oct 04 18:40:36.503422 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-ImagesMetadataNegativeTestJSON-1890424188-project Oct 04 18:40:36.503422 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 18:40:36.503422 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 18:40:36.503422 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: 619f0ef484f144f79ad43255b13854d8 Oct 04 18:40:36.503422 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1890424188-project Oct 04 18:40:36.503422 n-d-851028-13 devstack@n-api.service[123595]: method: Oct 04 18:40:36.503422 n-d-851028-13 devstack@n-api.service[123595]: exception: Image not found. Oct 04 18:40:36.503422 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'image_id': '4f90371a-b2dc-46a9-8001-82655563fe65', 'id': 'os_distro'} Oct 04 18:40:36.503422 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:40:36.503422 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:40:36.503422 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 18:40:36.503422 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 18:40:36.503422 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 18:40:36.503422 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 18:40:36.503422 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 18:40:36.503422 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 18:40:36.503422 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 18:40:36.503422 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 18:40:36.503422 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 18:40:36.503422 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 18:40:36.503422 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 18:40:36.503422 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 18:40:36.503422 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 18:40:36.503422 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 18:40:36.503422 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 18:40:36.503422 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 18:40:36.503422 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 4f90371a-b2dc-46a9-8001-82655563fe65 Oct 04 18:40:36.503422 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:40:36.503422 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:40:36.503422 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:40:36.503422 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:40:36.503422 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 04 18:40:36.503422 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 04 18:40:36.503422 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 04 18:40:36.503422 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 04 18:40:36.503422 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 04 18:40:36.503422 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 04 18:40:36.506890 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 04 18:40:36.506890 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 04 18:40:36.506890 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 18:40:36.506890 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 18:40:36.506890 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 18:40:36.506890 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 18:40:36.506890 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 18:40:36.506890 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 18:40:36.506890 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 18:40:36.506890 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 18:40:36.506890 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 18:40:36.506890 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 18:40:36.506890 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 18:40:36.506890 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 18:40:36.506890 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 18:40:36.506890 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 18:40:36.506890 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 18:40:36.506890 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 18:40:36.506890 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 4f90371a-b2dc-46a9-8001-82655563fe65 could not be found. Oct 04 18:40:36.506890 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:40:36.506890 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:40:36.506890 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:40:36.506890 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:40:36.506890 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:40:36.506890 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:40:36.506890 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:40:36.506890 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:40:36.506890 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:40:36.506890 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:40:36.506890 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:40:36.506890 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:40:36.506890 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 125, in delete Oct 04 18:40:36.506890 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 04 18:40:36.506890 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 04 18:40:36.506890 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 04 18:40:36.506890 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 18:40:36.506890 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:40:36.506890 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:40:36.506890 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:40:36.506890 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:40:36.506890 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:40:36.506890 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:40:36.506890 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:40:36.506890 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:40:36.506890 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 18:40:36.506890 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:40:36.506890 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-fcd48178-f41e-429b-b584-2e4a75b48166 tempest-ImagesMetadataNegativeTestJSON-1890424188 tempest-ImagesMetadataNegativeTestJSON-1890424188-project] Returning 404 to user: Image not found. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:40:36.506890 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-fcd48178-f41e-429b-b584-2e4a75b48166 tempest-ImagesMetadataNegativeTestJSON-1890424188 tempest-ImagesMetadataNegativeTestJSON-1890424188-project] 10.222.0.43 "DELETE /compute/v2.1/images/4f90371a-b2dc-46a9-8001-82655563fe65/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.189140 Oct 04 18:40:36.513750 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1176/2503] 10.222.0.43 () {58 vars in 1293 bytes} [Tue Oct 4 18:40:36 2022] DELETE /compute/v2.1/images/4f90371a-b2dc-46a9-8001-82655563fe65/metadata/os_distro => generated 62 bytes in 196 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:40:36.517779 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-e1d1c046-0ad5-40a3-8a7a-a1882f9785c3 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:36.518675 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-e1d1c046-0ad5-40a3-8a7a-a1882f9785c3 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: d9d4332a-97b6-40f1-bd7c-a9a75a9adc43] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:36.529441 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e1d1c046-0ad5-40a3-8a7a-a1882f9785c3 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:36.529940 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e1d1c046-0ad5-40a3-8a7a-a1882f9785c3 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:36.530382 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e1d1c046-0ad5-40a3-8a7a-a1882f9785c3 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:36.531090 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e1d1c046-0ad5-40a3-8a7a-a1882f9785c3 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:36.531707 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e1d1c046-0ad5-40a3-8a7a-a1882f9785c3 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:36.532153 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e1d1c046-0ad5-40a3-8a7a-a1882f9785c3 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:36.667799 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-420128de-e2f2-479b-91fc-9ebaa3ec5dc8 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] 10.222.0.43 "DELETE /compute/v2.1/images/8b9606ad-88f3-4647-bc18-c5885add126b" status: 204 len: 0 microversion: 2.1 time: 1.026081 Oct 04 18:40:36.669100 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1328/2504] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:35 2022] DELETE /compute/v2.1/images/8b9606ad-88f3-4647-bc18-c5885add126b => generated 0 bytes in 1028 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:40:36.673943 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-e85d545e-2ac0-4038-bc3a-eb468ad00cda tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:36.680185 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-e85d545e-2ac0-4038-bc3a-eb468ad00cda tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6a19da94e9e646028a7f73f9d0e0edda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc41f296eb44503868205ec8aa2fef3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:36.681253 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-e85d545e-2ac0-4038-bc3a-eb468ad00cda tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': 'dfc41f296eb44503868205ec8aa2fef3'} {{(pid=123596) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:40:36.687654 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e85d545e-2ac0-4038-bc3a-eb468ad00cda tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:36.688425 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e85d545e-2ac0-4038-bc3a-eb468ad00cda tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:36.689479 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e85d545e-2ac0-4038-bc3a-eb468ad00cda tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:36.690480 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e85d545e-2ac0-4038-bc3a-eb468ad00cda tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:36.691149 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e85d545e-2ac0-4038-bc3a-eb468ad00cda tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:36.691811 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e85d545e-2ac0-4038-bc3a-eb468ad00cda tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:36.787107 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-e1d1c046-0ad5-40a3-8a7a-a1882f9785c3 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:36.800203 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-e1d1c046-0ad5-40a3-8a7a-a1882f9785c3 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/d9d4332a-97b6-40f1-bd7c-a9a75a9adc43" status: 200 len: 1535 microversion: 2.1 time: 0.286899 Oct 04 18:40:36.802747 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1177/2505] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:36 2022] GET /compute/v2.1/servers/d9d4332a-97b6-40f1-bd7c-a9a75a9adc43 => generated 1535 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:36.811453 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.multi_cell_list [None req-e85d545e-2ac0-4038-bc3a-eb468ad00cda tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=123596) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 18:40:36.813271 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-b4265fd4-6a3e-48e3-bde6-ae085d1d14e8 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:36.814177 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-b4265fd4-6a3e-48e3-bde6-ae085d1d14e8 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] [instance: fd5fe360-8ecf-41d0-9376-9d5533fc6ba8] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:36.821312 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b4265fd4-6a3e-48e3-bde6-ae085d1d14e8 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:36.822185 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b4265fd4-6a3e-48e3-bde6-ae085d1d14e8 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:36.822971 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b4265fd4-6a3e-48e3-bde6-ae085d1d14e8 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:36.823835 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b4265fd4-6a3e-48e3-bde6-ae085d1d14e8 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:36.824446 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b4265fd4-6a3e-48e3-bde6-ae085d1d14e8 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:36.825039 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b4265fd4-6a3e-48e3-bde6-ae085d1d14e8 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:36.829894 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=100 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:40:36.846904 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-b4265fd4-6a3e-48e3-bde6-ae085d1d14e8 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] HTTP exception thrown: Instance fd5fe360-8ecf-41d0-9376-9d5533fc6ba8 could not be found. Oct 04 18:40:36.848597 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-b4265fd4-6a3e-48e3-bde6-ae085d1d14e8 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Request method failure captured: Oct 04 18:40:36.848597 n-d-851028-13 devstack@n-api.service[123595]: request: GET /compute/v2.1/servers/fd5fe360-8ecf-41d0-9376-9d5533fc6ba8 HTTP/1.1 Oct 04 18:40:36.848597 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 18:40:36.848597 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 18:40:36.848597 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 18:40:36.848597 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 0 Oct 04 18:40:36.848597 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 18:40:36.848597 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 18:40:36.848597 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 18:40:36.848597 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 18:40:36.848597 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPHxK_ToGvcECtRTJrWYMKaCCQEh_JZZgcqc-r_A500pVGUvovsnjwjyXlRim6Z-YtMLF9D_Q9MV8m4O2Jyok1khHVlXddWmZz_Glnhlck2aiWTU2mJ-gbHAAw8sCZHyDjKgUfwQs9jySnzCV7Gx1ajTbePvcLH61LZ4g9dLjBrddiSA Oct 04 18:40:36.848597 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 18:40:36.848597 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 18:40:36.848597 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 18:40:36.848597 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 18:40:36.848597 n-d-851028-13 devstack@n-api.service[123595]: X-Openstack-Nova-Api-Version: 2.25 Oct 04 18:40:36.848597 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 18:40:36.848597 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 18:40:36.848597 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: 34199e342c1b4158abf82384f2213b5f Oct 04 18:40:36.848597 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1153487493 Oct 04 18:40:36.848597 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 18:40:36.848597 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 18:40:36.848597 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/34199e342c1b4158abf82384f2213b5f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_34199e342c1b4158abf82384f2213b5f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/34199e342c1b4158abf82384f2213b5f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/34199e342c1b4158abf82384f2213b5f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:40:36.848597 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1153487493 Oct 04 18:40:36.848597 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: 34199e342c1b4158abf82384f2213b5f Oct 04 18:40:36.848597 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1153487493 Oct 04 18:40:36.848597 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-LiveAutoBlockMigrationV225Test-1153487493-project Oct 04 18:40:36.848597 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 18:40:36.848597 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 18:40:36.848597 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: 807a4a88319946aead73a3ccfcda6aeb Oct 04 18:40:36.848597 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1153487493-project Oct 04 18:40:36.848597 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 18:40:36.848597 n-d-851028-13 devstack@n-api.service[123595]: exception: Instance fd5fe360-8ecf-41d0-9376-9d5533fc6ba8 could not be found. Oct 04 18:40:36.848597 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': 'fd5fe360-8ecf-41d0-9376-9d5533fc6ba8'} Oct 04 18:40:36.848597 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:40:36.848597 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:40:36.848597 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:40:36.848597 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:40:36.848597 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:40:36.848597 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:40:36.848597 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:40:36.848597 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:40:36.848597 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:40:36.848597 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:40:36.848597 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd5fe360-8ecf-41d0-9376-9d5533fc6ba8 could not be found. Oct 04 18:40:36.848597 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:40:36.848597 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:40:36.848597 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:40:36.848597 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:40:36.848597 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:40:36.848597 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:40:36.848597 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:40:36.848597 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:40:36.848597 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:40:36.848597 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:40:36.848597 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:40:36.848597 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:40:36.848597 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:40:36.848597 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:40:36.848597 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:40:36.848597 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:40:36.848597 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd5fe360-8ecf-41d0-9376-9d5533fc6ba8 could not be found. Oct 04 18:40:36.848597 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:40:36.853572 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:40:36.853572 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:40:36.853572 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:40:36.853572 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:40:36.853572 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:40:36.853572 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:40:36.853572 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:40:36.853572 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd5fe360-8ecf-41d0-9376-9d5533fc6ba8 could not be found. Oct 04 18:40:36.853572 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:40:36.855208 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-b4265fd4-6a3e-48e3-bde6-ae085d1d14e8 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] Returning 404 to user: Instance fd5fe360-8ecf-41d0-9376-9d5533fc6ba8 could not be found. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:40:36.856290 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-b4265fd4-6a3e-48e3-bde6-ae085d1d14e8 tempest-LiveAutoBlockMigrationV225Test-1153487493 tempest-LiveAutoBlockMigrationV225Test-1153487493-project] 10.222.0.43 "GET /compute/v2.1/servers/fd5fe360-8ecf-41d0-9376-9d5533fc6ba8" status: 404 len: 111 microversion: 2.25 time: 0.052602 Oct 04 18:40:36.860821 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1178/2506] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:40:36 2022] GET /compute/v2.1/servers/fd5fe360-8ecf-41d0-9376-9d5533fc6ba8 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:40:36.885331 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-e85d545e-2ac0-4038-bc3a-eb468ad00cda tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] 10.222.0.43 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1012 microversion: 2.1 time: 0.214874 Oct 04 18:40:36.886385 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1329/2507] 10.222.0.43 () {58 vars in 1196 bytes} [Tue Oct 4 18:40:36 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1012 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:36.892763 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-547f11e1-2a0e-47fc-819b-4e065ccdc7c6 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:36.893698 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-547f11e1-2a0e-47fc-819b-4e065ccdc7c6 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] [instance: ffbbf357-494a-40e4-8943-3159707fc2e4] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:36.894985 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-0ea3a6e2-49d9-4fbc-8c73-4e476f6e4156 tempest-ImagesMetadataNegativeTestJSON-1890424188 tempest-ImagesMetadataNegativeTestJSON-1890424188-project] Calling method '.version_select at 0x7fb21fbc0f70>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:36.901630 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-547f11e1-2a0e-47fc-819b-4e065ccdc7c6 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:36.902134 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-547f11e1-2a0e-47fc-819b-4e065ccdc7c6 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:36.902581 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-547f11e1-2a0e-47fc-819b-4e065ccdc7c6 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:36.903322 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-547f11e1-2a0e-47fc-819b-4e065ccdc7c6 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:36.903936 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-547f11e1-2a0e-47fc-819b-4e065ccdc7c6 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:36.904370 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-547f11e1-2a0e-47fc-819b-4e065ccdc7c6 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:36.927241 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-0ea3a6e2-49d9-4fbc-8c73-4e476f6e4156 tempest-ImagesMetadataNegativeTestJSON-1890424188 tempest-ImagesMetadataNegativeTestJSON-1890424188-project] HTTP exception thrown: Image not found. Oct 04 18:40:36.933822 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-0ea3a6e2-49d9-4fbc-8c73-4e476f6e4156 tempest-ImagesMetadataNegativeTestJSON-1890424188 tempest-ImagesMetadataNegativeTestJSON-1890424188-project] Request method failure captured: Oct 04 18:40:36.933822 n-d-851028-13 devstack@n-api.service[123595]: request: GET /compute/v2.1/images/540cf818-d952-4a8a-9bec-f1c2caa82bb0/metadata/os_version HTTP/1.1 Oct 04 18:40:36.933822 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 18:40:36.933822 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 18:40:36.933822 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 18:40:36.933822 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 0 Oct 04 18:40:36.933822 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 18:40:36.933822 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 18:40:36.933822 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 18:40:36.933822 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 18:40:36.933822 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPH4jvA-YMj_U9SKy6Gba4xbg2vvWX2L41fCYnriFDCRsJlXsL1p693mR1vuWTfHEu4V22Qsh4__8QaMnI5mAag4pQ1GLrqdX2zIKQu5l8TXYpNFuI4QXG7yd5mzS429xwuZDwyhKK-VehO--kd3kxyH7vxn1Kv1LhMT-bliZyqsEKeE Oct 04 18:40:36.933822 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 18:40:36.933822 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 18:40:36.933822 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 18:40:36.933822 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 18:40:36.933822 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 18:40:36.933822 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 18:40:36.933822 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: 06dc253b0843415b943c81a95eda4ceb Oct 04 18:40:36.933822 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1890424188 Oct 04 18:40:36.933822 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 18:40:36.933822 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 18:40:36.933822 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/06dc253b0843415b943c81a95eda4ceb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_06dc253b0843415b943c81a95eda4ceb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/06dc253b0843415b943c81a95eda4ceb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/06dc253b0843415b943c81a95eda4ceb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:40:36.933822 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1890424188 Oct 04 18:40:36.933822 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: 06dc253b0843415b943c81a95eda4ceb Oct 04 18:40:36.933822 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1890424188 Oct 04 18:40:36.933822 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-ImagesMetadataNegativeTestJSON-1890424188-project Oct 04 18:40:36.933822 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 18:40:36.933822 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 18:40:36.933822 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: 619f0ef484f144f79ad43255b13854d8 Oct 04 18:40:36.933822 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1890424188-project Oct 04 18:40:36.933822 n-d-851028-13 devstack@n-api.service[123595]: method: Oct 04 18:40:36.933822 n-d-851028-13 devstack@n-api.service[123595]: exception: Image not found. Oct 04 18:40:36.933822 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'image_id': '540cf818-d952-4a8a-9bec-f1c2caa82bb0', 'id': 'os_version'} Oct 04 18:40:36.933822 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:40:36.933822 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:40:36.933822 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 18:40:36.933822 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 18:40:36.933822 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 18:40:36.933822 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 18:40:36.933822 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 18:40:36.933822 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 18:40:36.933822 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 18:40:36.933822 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 18:40:36.933822 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 18:40:36.933822 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 18:40:36.933822 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 18:40:36.933822 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 18:40:36.933822 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 18:40:36.933822 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 18:40:36.933822 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 18:40:36.933822 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 18:40:36.933822 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 540cf818-d952-4a8a-9bec-f1c2caa82bb0 Oct 04 18:40:36.933822 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:40:36.933822 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:40:36.933822 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:40:36.933822 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:40:36.933822 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 04 18:40:36.933822 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 04 18:40:36.933822 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 04 18:40:36.933822 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 04 18:40:36.933822 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 04 18:40:36.933822 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 04 18:40:36.937324 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 04 18:40:36.937324 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 04 18:40:36.937324 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 18:40:36.937324 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 18:40:36.937324 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 18:40:36.937324 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 18:40:36.937324 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 18:40:36.937324 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 18:40:36.937324 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 18:40:36.937324 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 18:40:36.937324 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 18:40:36.937324 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 18:40:36.937324 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 18:40:36.937324 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 18:40:36.937324 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 18:40:36.937324 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 18:40:36.937324 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 18:40:36.937324 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 18:40:36.937324 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 540cf818-d952-4a8a-9bec-f1c2caa82bb0 could not be found. Oct 04 18:40:36.937324 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:40:36.937324 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:40:36.937324 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:40:36.937324 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:40:36.937324 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:40:36.937324 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:40:36.937324 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:40:36.937324 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:40:36.937324 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:40:36.937324 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:40:36.937324 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:40:36.937324 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:40:36.937324 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 58, in show Oct 04 18:40:36.937324 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Oct 04 18:40:36.937324 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 04 18:40:36.937324 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 04 18:40:36.937324 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 18:40:36.937324 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:40:36.937324 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:40:36.937324 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:40:36.937324 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:40:36.937324 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:40:36.937324 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:40:36.937324 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:40:36.937324 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:40:36.937324 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 18:40:36.937324 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:40:36.937324 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-0ea3a6e2-49d9-4fbc-8c73-4e476f6e4156 tempest-ImagesMetadataNegativeTestJSON-1890424188 tempest-ImagesMetadataNegativeTestJSON-1890424188-project] Returning 404 to user: Image not found. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:40:36.937324 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-0ea3a6e2-49d9-4fbc-8c73-4e476f6e4156 tempest-ImagesMetadataNegativeTestJSON-1890424188 tempest-ImagesMetadataNegativeTestJSON-1890424188-project] 10.222.0.43 "GET /compute/v2.1/images/540cf818-d952-4a8a-9bec-f1c2caa82bb0/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.051344 Oct 04 18:40:36.941787 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1179/2508] 10.222.0.43 () {58 vars in 1293 bytes} [Tue Oct 4 18:40:36 2022] GET /compute/v2.1/images/540cf818-d952-4a8a-9bec-f1c2caa82bb0/metadata/os_version => generated 62 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:40:36.950473 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-9f4a63e9-03ce-4b73-89f5-2d8c0f6b3b68 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Calling method '.version_select at 0x7fb21fc31dc0>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:37.248243 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-547f11e1-2a0e-47fc-819b-4e065ccdc7c6 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15432d1b74334e1188866004384befe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d562b670294a47b2171f4003be4cdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:37.256336 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-547f11e1-2a0e-47fc-819b-4e065ccdc7c6 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] 10.222.0.43 "GET /compute/v2.1/servers/ffbbf357-494a-40e4-8943-3159707fc2e4" status: 200 len: 1524 microversion: 2.1 time: 0.368829 Oct 04 18:40:37.256930 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1330/2509] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:36 2022] GET /compute/v2.1/servers/ffbbf357-494a-40e4-8943-3159707fc2e4 => generated 1524 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:37.274613 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-62731db1-45f7-4542-a1a9-7697ddb302fc tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:37.279833 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-62731db1-45f7-4542-a1a9-7697ddb302fc tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6a19da94e9e646028a7f73f9d0e0edda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc41f296eb44503868205ec8aa2fef3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:37.280511 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-62731db1-45f7-4542-a1a9-7697ddb302fc tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Searching by: {'name': '2073811457', 'deleted': False, 'project_id': 'dfc41f296eb44503868205ec8aa2fef3'} {{(pid=123596) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:40:37.288665 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-62731db1-45f7-4542-a1a9-7697ddb302fc tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:37.290312 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-62731db1-45f7-4542-a1a9-7697ddb302fc tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:37.291063 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-62731db1-45f7-4542-a1a9-7697ddb302fc tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:37.292034 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-62731db1-45f7-4542-a1a9-7697ddb302fc tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:37.292705 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-62731db1-45f7-4542-a1a9-7697ddb302fc tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:37.293351 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-62731db1-45f7-4542-a1a9-7697ddb302fc tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:37.450268 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.multi_cell_list [None req-62731db1-45f7-4542-a1a9-7697ddb302fc tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=123596) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 18:40:37.515161 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-62731db1-45f7-4542-a1a9-7697ddb302fc tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] 10.222.0.43 "GET /compute/v2.1/servers?name=2073811457" status: 200 len: 346 microversion: 2.1 time: 0.244648 Oct 04 18:40:37.515775 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1331/2510] 10.222.0.43 () {58 vars in 1156 bytes} [Tue Oct 4 18:40:37 2022] GET /compute/v2.1/servers?name=2073811457 => generated 346 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:40:37.520903 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-83ecbe6e-eab8-4090-b1da-c43d85146588 tempest-ImagesMetadataNegativeTestJSON-1890424188 tempest-ImagesMetadataNegativeTestJSON-1890424188-project] Calling method '.version_select at 0x7fb21ed41790>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:37.544511 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-83ecbe6e-eab8-4090-b1da-c43d85146588 tempest-ImagesMetadataNegativeTestJSON-1890424188 tempest-ImagesMetadataNegativeTestJSON-1890424188-project] HTTP exception thrown: Image not found. Oct 04 18:40:37.547424 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-83ecbe6e-eab8-4090-b1da-c43d85146588 tempest-ImagesMetadataNegativeTestJSON-1890424188 tempest-ImagesMetadataNegativeTestJSON-1890424188-project] Request method failure captured: Oct 04 18:40:37.547424 n-d-851028-13 devstack@n-api.service[123596]: request: GET /compute/v2.1/images/2c11fedb-beab-401b-9f4c-6c8a68595e9a/metadata HTTP/1.1 Oct 04 18:40:37.547424 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:40:37.547424 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:40:37.547424 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:40:37.547424 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 18:40:37.547424 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:40:37.547424 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:40:37.547424 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:40:37.547424 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:40:37.547424 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPH4jvA-YMj_U9SKy6Gba4xbg2vvWX2L41fCYnriFDCRsJlXsL1p693mR1vuWTfHEu4V22Qsh4__8QaMnI5mAag4pQ1GLrqdX2zIKQu5l8TXYpNFuI4QXG7yd5mzS429xwuZDwyhKK-VehO--kd3kxyH7vxn1Kv1LhMT-bliZyqsEKeE Oct 04 18:40:37.547424 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:40:37.547424 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:40:37.547424 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:40:37.547424 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:40:37.547424 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:40:37.547424 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:40:37.547424 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: 06dc253b0843415b943c81a95eda4ceb Oct 04 18:40:37.547424 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1890424188 Oct 04 18:40:37.547424 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 18:40:37.547424 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 18:40:37.547424 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/06dc253b0843415b943c81a95eda4ceb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_06dc253b0843415b943c81a95eda4ceb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/06dc253b0843415b943c81a95eda4ceb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/06dc253b0843415b943c81a95eda4ceb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:40:37.547424 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1890424188 Oct 04 18:40:37.547424 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: 06dc253b0843415b943c81a95eda4ceb Oct 04 18:40:37.547424 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1890424188 Oct 04 18:40:37.547424 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-ImagesMetadataNegativeTestJSON-1890424188-project Oct 04 18:40:37.547424 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:40:37.547424 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:40:37.547424 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 619f0ef484f144f79ad43255b13854d8 Oct 04 18:40:37.547424 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1890424188-project Oct 04 18:40:37.547424 n-d-851028-13 devstack@n-api.service[123596]: method: Oct 04 18:40:37.547424 n-d-851028-13 devstack@n-api.service[123596]: exception: Image not found. Oct 04 18:40:37.547424 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'image_id': '2c11fedb-beab-401b-9f4c-6c8a68595e9a'} Oct 04 18:40:37.547424 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:40:37.547424 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:40:37.547424 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 18:40:37.547424 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 18:40:37.547424 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 18:40:37.547424 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 18:40:37.547424 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 18:40:37.547424 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 18:40:37.547424 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 18:40:37.547424 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 18:40:37.547424 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 18:40:37.547424 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 18:40:37.547424 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 18:40:37.547424 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 18:40:37.547424 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 18:40:37.547424 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 18:40:37.547424 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 18:40:37.547424 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 18:40:37.547424 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 2c11fedb-beab-401b-9f4c-6c8a68595e9a Oct 04 18:40:37.547424 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:40:37.547424 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:40:37.547424 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:40:37.547424 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:40:37.547424 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 04 18:40:37.547424 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 04 18:40:37.547424 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 04 18:40:37.547424 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 04 18:40:37.547424 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 04 18:40:37.547424 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 04 18:40:37.551037 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 04 18:40:37.551037 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 04 18:40:37.551037 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 18:40:37.551037 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 18:40:37.551037 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 18:40:37.551037 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 18:40:37.551037 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 18:40:37.551037 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 18:40:37.551037 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 18:40:37.551037 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 18:40:37.551037 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 18:40:37.551037 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 18:40:37.551037 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 18:40:37.551037 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 18:40:37.551037 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 18:40:37.551037 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 18:40:37.551037 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 18:40:37.551037 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 18:40:37.551037 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 2c11fedb-beab-401b-9f4c-6c8a68595e9a could not be found. Oct 04 18:40:37.551037 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:40:37.551037 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:40:37.551037 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:40:37.551037 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:40:37.551037 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:40:37.551037 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:40:37.551037 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:40:37.551037 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:40:37.551037 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:40:37.551037 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:40:37.551037 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:40:37.551037 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:40:37.551037 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 51, in index Oct 04 18:40:37.551037 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Oct 04 18:40:37.551037 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 04 18:40:37.551037 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 04 18:40:37.551037 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 18:40:37.551037 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:40:37.551037 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:40:37.551037 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:40:37.551037 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:40:37.551037 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:40:37.551037 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:40:37.551037 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:40:37.551037 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:40:37.551037 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 18:40:37.551037 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:40:37.551037 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-83ecbe6e-eab8-4090-b1da-c43d85146588 tempest-ImagesMetadataNegativeTestJSON-1890424188 tempest-ImagesMetadataNegativeTestJSON-1890424188-project] Returning 404 to user: Image not found. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:40:37.551037 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-83ecbe6e-eab8-4090-b1da-c43d85146588 tempest-ImagesMetadataNegativeTestJSON-1890424188 tempest-ImagesMetadataNegativeTestJSON-1890424188-project] 10.222.0.43 "GET /compute/v2.1/images/2c11fedb-beab-401b-9f4c-6c8a68595e9a/metadata" status: 404 len: 62 microversion: 2.1 time: 0.031733 Oct 04 18:40:37.557287 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1332/2511] 10.222.0.43 () {58 vars in 1260 bytes} [Tue Oct 4 18:40:37 2022] GET /compute/v2.1/images/2c11fedb-beab-401b-9f4c-6c8a68595e9a/metadata => generated 62 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:40:37.562398 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-4d5e1965-b8b1-4244-ac31-224868a97ec3 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:37.563069 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-4d5e1965-b8b1-4244-ac31-224868a97ec3 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] [instance: b53d822f-e7b1-498a-b98a-35f87839dfe8] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:37.570044 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4d5e1965-b8b1-4244-ac31-224868a97ec3 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:37.570682 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4d5e1965-b8b1-4244-ac31-224868a97ec3 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:37.571124 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4d5e1965-b8b1-4244-ac31-224868a97ec3 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:37.571823 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4d5e1965-b8b1-4244-ac31-224868a97ec3 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:37.572285 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4d5e1965-b8b1-4244-ac31-224868a97ec3 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:37.572720 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4d5e1965-b8b1-4244-ac31-224868a97ec3 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:37.587662 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-4d5e1965-b8b1-4244-ac31-224868a97ec3 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] HTTP exception thrown: Instance b53d822f-e7b1-498a-b98a-35f87839dfe8 could not be found. Oct 04 18:40:37.589049 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-4d5e1965-b8b1-4244-ac31-224868a97ec3 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Request method failure captured: Oct 04 18:40:37.589049 n-d-851028-13 devstack@n-api.service[123596]: request: GET /compute/v2.1/servers/b53d822f-e7b1-498a-b98a-35f87839dfe8 HTTP/1.1 Oct 04 18:40:37.589049 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:40:37.589049 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:40:37.589049 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:40:37.589049 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 18:40:37.589049 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:40:37.589049 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:40:37.589049 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:40:37.589049 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:40:37.589049 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPH3wDekE6tGn-LrvWHZVGKObgLfG2iEO-nHLYazuelmkzpsxufVUCaZeFegIBH61CNTyJN5rx8cbmYgsvpGoGAhkzPkpImgKzShYlclvre_pkKr9wmcBTVdiaYygnn3dNeEWyqHIjnIIMD0V06WGYO04SZuAPP45zgt-OF6P4v5CDmA Oct 04 18:40:37.589049 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:40:37.589049 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:40:37.589049 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:40:37.589049 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:40:37.589049 n-d-851028-13 devstack@n-api.service[123596]: X-Openstack-Nova-Api-Version: 2.54 Oct 04 18:40:37.589049 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:40:37.589049 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:40:37.589049 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: 29fdc44ceeb041bcba1be2fcc2084aff Oct 04 18:40:37.589049 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-ServerShowV254Test-1972433230 Oct 04 18:40:37.589049 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 18:40:37.589049 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 18:40:37.589049 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/29fdc44ceeb041bcba1be2fcc2084aff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_29fdc44ceeb041bcba1be2fcc2084aff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/29fdc44ceeb041bcba1be2fcc2084aff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/29fdc44ceeb041bcba1be2fcc2084aff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:40:37.589049 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-ServerShowV254Test-1972433230 Oct 04 18:40:37.589049 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: 29fdc44ceeb041bcba1be2fcc2084aff Oct 04 18:40:37.589049 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-ServerShowV254Test-1972433230 Oct 04 18:40:37.589049 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-ServerShowV254Test-1972433230-project Oct 04 18:40:37.589049 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:40:37.589049 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:40:37.589049 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 59e1add2296c4ed5830c5d90ef272ad7 Oct 04 18:40:37.589049 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-ServerShowV254Test-1972433230-project Oct 04 18:40:37.589049 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 18:40:37.589049 n-d-851028-13 devstack@n-api.service[123596]: exception: Instance b53d822f-e7b1-498a-b98a-35f87839dfe8 could not be found. Oct 04 18:40:37.589049 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': 'b53d822f-e7b1-498a-b98a-35f87839dfe8'} Oct 04 18:40:37.589049 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:40:37.589049 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:40:37.589049 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:40:37.589049 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:40:37.589049 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:40:37.589049 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:40:37.589049 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:40:37.589049 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:40:37.589049 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:40:37.589049 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:40:37.589049 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b53d822f-e7b1-498a-b98a-35f87839dfe8 could not be found. Oct 04 18:40:37.589049 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:40:37.589049 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:40:37.589049 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:40:37.589049 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:40:37.589049 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:40:37.589049 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:40:37.589049 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:40:37.589049 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:40:37.589049 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:40:37.589049 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:40:37.589049 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:40:37.589049 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:40:37.589049 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:40:37.589049 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:40:37.589049 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:40:37.589049 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:40:37.589049 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b53d822f-e7b1-498a-b98a-35f87839dfe8 could not be found. Oct 04 18:40:37.589049 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:40:37.589049 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:40:37.589049 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:40:37.593317 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:40:37.593317 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:40:37.593317 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:40:37.593317 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:40:37.593317 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:40:37.593317 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b53d822f-e7b1-498a-b98a-35f87839dfe8 could not be found. Oct 04 18:40:37.593317 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:40:37.593317 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-4d5e1965-b8b1-4244-ac31-224868a97ec3 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] Returning 404 to user: Instance b53d822f-e7b1-498a-b98a-35f87839dfe8 could not be found. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:40:37.593317 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-4d5e1965-b8b1-4244-ac31-224868a97ec3 tempest-ServerShowV254Test-1972433230 tempest-ServerShowV254Test-1972433230-project] 10.222.0.43 "GET /compute/v2.1/servers/b53d822f-e7b1-498a-b98a-35f87839dfe8" status: 404 len: 111 microversion: 2.54 time: 0.032120 Oct 04 18:40:37.593317 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1333/2512] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:40:37 2022] GET /compute/v2.1/servers/b53d822f-e7b1-498a-b98a-35f87839dfe8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:40:37.609537 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-913933f8-c1a1-441f-9203-55ebd1225f28 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:37.618164 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-9f4a63e9-03ce-4b73-89f5-2d8c0f6b3b68 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] 10.222.0.43 "DELETE /compute/v2.1/images/e5989b78-5925-4d33-8625-f3af6fa4e64d" status: 204 len: 0 microversion: 2.1 time: 0.676078 Oct 04 18:40:37.619087 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-913933f8-c1a1-441f-9203-55ebd1225f28 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6a19da94e9e646028a7f73f9d0e0edda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc41f296eb44503868205ec8aa2fef3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:37.619311 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1180/2513] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:36 2022] DELETE /compute/v2.1/images/e5989b78-5925-4d33-8625-f3af6fa4e64d => generated 0 bytes in 678 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:40:37.620280 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-913933f8-c1a1-441f-9203-55ebd1225f28 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': 'dfc41f296eb44503868205ec8aa2fef3'} {{(pid=123596) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:40:37.624180 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-6ddaa5ea-8413-4398-9fd4-59d645791ddc tempest-ImagesMetadataNegativeTestJSON-1890424188 tempest-ImagesMetadataNegativeTestJSON-1890424188-project] Action: 'update_all', calling method: .version_select at 0x7fb21fbc0a60>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:40:37.627187 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-913933f8-c1a1-441f-9203-55ebd1225f28 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:37.627903 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-913933f8-c1a1-441f-9203-55ebd1225f28 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:37.628565 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-913933f8-c1a1-441f-9203-55ebd1225f28 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:37.629653 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-913933f8-c1a1-441f-9203-55ebd1225f28 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:37.630792 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-913933f8-c1a1-441f-9203-55ebd1225f28 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:37.631446 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-913933f8-c1a1-441f-9203-55ebd1225f28 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:37.658232 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-6ddaa5ea-8413-4398-9fd4-59d645791ddc tempest-ImagesMetadataNegativeTestJSON-1890424188 tempest-ImagesMetadataNegativeTestJSON-1890424188-project] HTTP exception thrown: Image not found. Oct 04 18:40:37.661174 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-6ddaa5ea-8413-4398-9fd4-59d645791ddc tempest-ImagesMetadataNegativeTestJSON-1890424188 tempest-ImagesMetadataNegativeTestJSON-1890424188-project] Request method failure captured: Oct 04 18:40:37.661174 n-d-851028-13 devstack@n-api.service[123595]: request: PUT /compute/v2.1/images/301b18f0-4f2a-4f9c-804f-a8e4d0e63406/metadata HTTP/1.1 Oct 04 18:40:37.661174 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 18:40:37.661174 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 18:40:37.661174 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 18:40:37.661174 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 57 Oct 04 18:40:37.661174 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 18:40:37.661174 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 18:40:37.661174 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 18:40:37.661174 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 18:40:37.661174 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPH4jvA-YMj_U9SKy6Gba4xbg2vvWX2L41fCYnriFDCRsJlXsL1p693mR1vuWTfHEu4V22Qsh4__8QaMnI5mAag4pQ1GLrqdX2zIKQu5l8TXYpNFuI4QXG7yd5mzS429xwuZDwyhKK-VehO--kd3kxyH7vxn1Kv1LhMT-bliZyqsEKeE Oct 04 18:40:37.661174 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 18:40:37.661174 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 18:40:37.661174 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 18:40:37.661174 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 18:40:37.661174 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 18:40:37.661174 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 18:40:37.661174 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: 06dc253b0843415b943c81a95eda4ceb Oct 04 18:40:37.661174 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1890424188 Oct 04 18:40:37.661174 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 18:40:37.661174 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 18:40:37.661174 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/06dc253b0843415b943c81a95eda4ceb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_06dc253b0843415b943c81a95eda4ceb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/06dc253b0843415b943c81a95eda4ceb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/06dc253b0843415b943c81a95eda4ceb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:40:37.661174 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1890424188 Oct 04 18:40:37.661174 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: 06dc253b0843415b943c81a95eda4ceb Oct 04 18:40:37.661174 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1890424188 Oct 04 18:40:37.661174 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-ImagesMetadataNegativeTestJSON-1890424188-project Oct 04 18:40:37.661174 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 18:40:37.661174 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 18:40:37.661174 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: 619f0ef484f144f79ad43255b13854d8 Oct 04 18:40:37.661174 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1890424188-project Oct 04 18:40:37.661174 n-d-851028-13 devstack@n-api.service[123595]: Oct 04 18:40:37.661174 n-d-851028-13 devstack@n-api.service[123595]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Oct 04 18:40:37.661174 n-d-851028-13 devstack@n-api.service[123595]: method: Oct 04 18:40:37.661174 n-d-851028-13 devstack@n-api.service[123595]: exception: Image not found. Oct 04 18:40:37.661174 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'image_id': '301b18f0-4f2a-4f9c-804f-a8e4d0e63406', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Oct 04 18:40:37.661174 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:40:37.661174 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:40:37.661174 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 18:40:37.661174 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 18:40:37.661174 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 18:40:37.661174 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 18:40:37.661174 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 18:40:37.661174 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 18:40:37.661174 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 18:40:37.661174 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 18:40:37.661174 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 18:40:37.661174 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 18:40:37.661174 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 18:40:37.661174 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 18:40:37.661174 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 18:40:37.661174 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 18:40:37.661174 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 18:40:37.661174 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 18:40:37.661174 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 301b18f0-4f2a-4f9c-804f-a8e4d0e63406 Oct 04 18:40:37.661174 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:40:37.661174 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:40:37.661174 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:40:37.661174 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:40:37.661174 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 04 18:40:37.661174 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 04 18:40:37.661174 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 04 18:40:37.661174 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 04 18:40:37.661174 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 04 18:40:37.665714 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 04 18:40:37.665714 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 04 18:40:37.665714 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 04 18:40:37.665714 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 18:40:37.665714 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 18:40:37.665714 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 18:40:37.665714 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 18:40:37.665714 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 18:40:37.665714 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 18:40:37.665714 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 18:40:37.665714 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 18:40:37.665714 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 18:40:37.665714 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 18:40:37.665714 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 18:40:37.665714 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 18:40:37.665714 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 18:40:37.665714 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 18:40:37.665714 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 18:40:37.665714 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 18:40:37.665714 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 301b18f0-4f2a-4f9c-804f-a8e4d0e63406 could not be found. Oct 04 18:40:37.665714 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:40:37.665714 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:40:37.665714 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:40:37.665714 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:40:37.665714 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:40:37.665714 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:40:37.665714 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:40:37.665714 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:40:37.665714 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:40:37.665714 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:40:37.665714 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:40:37.665714 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:40:37.665714 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:40:37.665714 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:40:37.665714 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 109, in update_all Oct 04 18:40:37.665714 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 04 18:40:37.665714 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 04 18:40:37.665714 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 04 18:40:37.665714 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 18:40:37.665714 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:40:37.665714 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:40:37.665714 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:40:37.665714 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:40:37.665714 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:40:37.665714 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:40:37.665714 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:40:37.665714 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:40:37.665714 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 18:40:37.665714 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:40:37.665714 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-6ddaa5ea-8413-4398-9fd4-59d645791ddc tempest-ImagesMetadataNegativeTestJSON-1890424188 tempest-ImagesMetadataNegativeTestJSON-1890424188-project] Returning 404 to user: Image not found. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:40:37.665714 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-6ddaa5ea-8413-4398-9fd4-59d645791ddc tempest-ImagesMetadataNegativeTestJSON-1890424188 tempest-ImagesMetadataNegativeTestJSON-1890424188-project] 10.222.0.43 "PUT /compute/v2.1/images/301b18f0-4f2a-4f9c-804f-a8e4d0e63406/metadata" status: 404 len: 62 microversion: 2.1 time: 0.044609 Oct 04 18:40:37.668756 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1181/2514] 10.222.0.43 () {60 vars in 1280 bytes} [Tue Oct 4 18:40:37 2022] PUT /compute/v2.1/images/301b18f0-4f2a-4f9c-804f-a8e4d0e63406/metadata => generated 62 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:40:37.671519 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-0c67c8ba-098b-4e4d-b669-9f923d536dcc tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:37.672434 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-0c67c8ba-098b-4e4d-b669-9f923d536dcc tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] [instance: 6eb9c803-dd97-4af5-b0d0-aa6fc18f8a89] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:37.684091 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0c67c8ba-098b-4e4d-b669-9f923d536dcc tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:37.684508 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0c67c8ba-098b-4e4d-b669-9f923d536dcc tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:37.684952 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0c67c8ba-098b-4e4d-b669-9f923d536dcc tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:37.685715 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0c67c8ba-098b-4e4d-b669-9f923d536dcc tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:37.686172 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0c67c8ba-098b-4e4d-b669-9f923d536dcc tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:37.686713 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0c67c8ba-098b-4e4d-b669-9f923d536dcc tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:37.734830 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-0c67c8ba-098b-4e4d-b669-9f923d536dcc tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] [instance: 6eb9c803-dd97-4af5-b0d0-aa6fc18f8a89] Going to try to terminate instance {{(pid=123595) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:40:37.871492 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-0c67c8ba-098b-4e4d-b669-9f923d536dcc tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] 10.222.0.43 "DELETE /compute/v2.1/servers/6eb9c803-dd97-4af5-b0d0-aa6fc18f8a89" status: 204 len: 0 microversion: 2.1 time: 0.204131 Oct 04 18:40:37.873292 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1182/2515] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 18:40:37 2022] DELETE /compute/v2.1/servers/6eb9c803-dd97-4af5-b0d0-aa6fc18f8a89 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:40:37.879802 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-1674bafa-8c33-401e-95ea-1e7ab5913f0d tempest-ImagesMetadataNegativeTestJSON-1890424188 tempest-ImagesMetadataNegativeTestJSON-1890424188-project] Action: 'update', calling method: .version_select at 0x7fb21fbee550>, body: {"meta": {"os_distro": "alt"}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:40:37.923850 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-1674bafa-8c33-401e-95ea-1e7ab5913f0d tempest-ImagesMetadataNegativeTestJSON-1890424188 tempest-ImagesMetadataNegativeTestJSON-1890424188-project] HTTP exception thrown: Image not found. Oct 04 18:40:37.929066 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-1674bafa-8c33-401e-95ea-1e7ab5913f0d tempest-ImagesMetadataNegativeTestJSON-1890424188 tempest-ImagesMetadataNegativeTestJSON-1890424188-project] Request method failure captured: Oct 04 18:40:37.929066 n-d-851028-13 devstack@n-api.service[123595]: request: PUT /compute/v2.1/images/9d0bd82d-aafc-4335-83f6-ff14e0443dd2/metadata/os_distro HTTP/1.1 Oct 04 18:40:37.929066 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 18:40:37.929066 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 18:40:37.929066 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 18:40:37.929066 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 30 Oct 04 18:40:37.929066 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 18:40:37.929066 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 18:40:37.929066 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 18:40:37.929066 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 18:40:37.929066 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPH4jvA-YMj_U9SKy6Gba4xbg2vvWX2L41fCYnriFDCRsJlXsL1p693mR1vuWTfHEu4V22Qsh4__8QaMnI5mAag4pQ1GLrqdX2zIKQu5l8TXYpNFuI4QXG7yd5mzS429xwuZDwyhKK-VehO--kd3kxyH7vxn1Kv1LhMT-bliZyqsEKeE Oct 04 18:40:37.929066 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 18:40:37.929066 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 18:40:37.929066 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 18:40:37.929066 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 18:40:37.929066 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 18:40:37.929066 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 18:40:37.929066 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: 06dc253b0843415b943c81a95eda4ceb Oct 04 18:40:37.929066 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1890424188 Oct 04 18:40:37.929066 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 18:40:37.929066 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 18:40:37.929066 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/06dc253b0843415b943c81a95eda4ceb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_06dc253b0843415b943c81a95eda4ceb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/06dc253b0843415b943c81a95eda4ceb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/06dc253b0843415b943c81a95eda4ceb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:40:37.929066 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1890424188 Oct 04 18:40:37.929066 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: 06dc253b0843415b943c81a95eda4ceb Oct 04 18:40:37.929066 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1890424188 Oct 04 18:40:37.929066 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-ImagesMetadataNegativeTestJSON-1890424188-project Oct 04 18:40:37.929066 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 18:40:37.929066 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 18:40:37.929066 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: 619f0ef484f144f79ad43255b13854d8 Oct 04 18:40:37.929066 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1890424188-project Oct 04 18:40:37.929066 n-d-851028-13 devstack@n-api.service[123595]: Oct 04 18:40:37.929066 n-d-851028-13 devstack@n-api.service[123595]: {"meta": {"os_distro": "alt"}} Oct 04 18:40:37.929066 n-d-851028-13 devstack@n-api.service[123595]: method: Oct 04 18:40:37.929066 n-d-851028-13 devstack@n-api.service[123595]: exception: Image not found. Oct 04 18:40:37.929066 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'image_id': '9d0bd82d-aafc-4335-83f6-ff14e0443dd2', 'id': 'os_distro', 'body': {'meta': {'os_distro': 'alt'}}} Oct 04 18:40:37.929066 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:40:37.929066 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:40:37.929066 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 18:40:37.929066 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 18:40:37.929066 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 18:40:37.929066 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 18:40:37.929066 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 18:40:37.929066 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 18:40:37.929066 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 18:40:37.929066 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 18:40:37.929066 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 18:40:37.929066 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 18:40:37.929066 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 18:40:37.929066 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 18:40:37.929066 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 18:40:37.929066 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 18:40:37.929066 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 18:40:37.929066 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 18:40:37.929066 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 9d0bd82d-aafc-4335-83f6-ff14e0443dd2 Oct 04 18:40:37.929066 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:40:37.929066 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:40:37.929066 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:40:37.929066 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:40:37.929066 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 04 18:40:37.929066 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 04 18:40:37.929066 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 04 18:40:37.929066 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 04 18:40:37.929066 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 04 18:40:37.929066 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 04 18:40:37.933830 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 04 18:40:37.933830 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 04 18:40:37.933830 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 18:40:37.933830 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 18:40:37.933830 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 18:40:37.933830 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 18:40:37.933830 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 18:40:37.933830 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 18:40:37.933830 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 18:40:37.933830 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 18:40:37.933830 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 18:40:37.933830 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 18:40:37.933830 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 18:40:37.933830 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 18:40:37.933830 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 18:40:37.933830 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 18:40:37.933830 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 18:40:37.933830 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 18:40:37.933830 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 9d0bd82d-aafc-4335-83f6-ff14e0443dd2 could not be found. Oct 04 18:40:37.933830 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:40:37.933830 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:40:37.933830 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:40:37.933830 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:40:37.933830 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:40:37.933830 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:40:37.933830 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:40:37.933830 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:40:37.933830 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:40:37.933830 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:40:37.933830 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:40:37.933830 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:40:37.933830 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:40:37.933830 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:40:37.933830 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 93, in update Oct 04 18:40:37.933830 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 04 18:40:37.933830 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 04 18:40:37.933830 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 04 18:40:37.933830 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 18:40:37.933830 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:40:37.933830 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:40:37.933830 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:40:37.933830 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:40:37.933830 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:40:37.933830 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:40:37.933830 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:40:37.933830 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:40:37.933830 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 18:40:37.933830 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:40:37.933830 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-1674bafa-8c33-401e-95ea-1e7ab5913f0d tempest-ImagesMetadataNegativeTestJSON-1890424188 tempest-ImagesMetadataNegativeTestJSON-1890424188-project] Returning 404 to user: Image not found. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:40:37.933830 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-1674bafa-8c33-401e-95ea-1e7ab5913f0d tempest-ImagesMetadataNegativeTestJSON-1890424188 tempest-ImagesMetadataNegativeTestJSON-1890424188-project] 10.222.0.43 "PUT /compute/v2.1/images/9d0bd82d-aafc-4335-83f6-ff14e0443dd2/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.057181 Oct 04 18:40:37.933830 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1183/2516] 10.222.0.43 () {60 vars in 1310 bytes} [Tue Oct 4 18:40:37 2022] PUT /compute/v2.1/images/9d0bd82d-aafc-4335-83f6-ff14e0443dd2/metadata/os_distro => generated 62 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:40:37.939112 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-02ef92f7-9973-4487-ab7f-ce78dfd53802 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:37.940222 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-02ef92f7-9973-4487-ab7f-ce78dfd53802 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: d9d4332a-97b6-40f1-bd7c-a9a75a9adc43] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:37.957622 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-02ef92f7-9973-4487-ab7f-ce78dfd53802 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:37.958356 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-02ef92f7-9973-4487-ab7f-ce78dfd53802 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:37.958957 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-02ef92f7-9973-4487-ab7f-ce78dfd53802 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:37.961741 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-02ef92f7-9973-4487-ab7f-ce78dfd53802 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:37.962408 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-02ef92f7-9973-4487-ab7f-ce78dfd53802 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:37.963128 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-02ef92f7-9973-4487-ab7f-ce78dfd53802 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:38.029948 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.multi_cell_list [None req-913933f8-c1a1-441f-9203-55ebd1225f28 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=123596) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 18:40:38.112660 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-913933f8-c1a1-441f-9203-55ebd1225f28 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] 10.222.0.43 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1012 microversion: 2.1 time: 0.509876 Oct 04 18:40:38.114326 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1334/2517] 10.222.0.43 () {58 vars in 1154 bytes} [Tue Oct 4 18:40:37 2022] GET /compute/v2.1/servers?name=-instance => generated 1012 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:38.120064 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-5523d0cc-7902-46ac-ac0d-158f32d0de0c tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:38.120865 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-5523d0cc-7902-46ac-ac0d-158f32d0de0c tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] [instance: 6eb9c803-dd97-4af5-b0d0-aa6fc18f8a89] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:38.127072 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5523d0cc-7902-46ac-ac0d-158f32d0de0c tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:38.127566 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5523d0cc-7902-46ac-ac0d-158f32d0de0c tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:38.128001 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5523d0cc-7902-46ac-ac0d-158f32d0de0c tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:38.130144 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5523d0cc-7902-46ac-ac0d-158f32d0de0c tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:38.130783 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5523d0cc-7902-46ac-ac0d-158f32d0de0c tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:38.131909 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5523d0cc-7902-46ac-ac0d-158f32d0de0c tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:38.159647 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-02ef92f7-9973-4487-ab7f-ce78dfd53802 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:38.171042 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-02ef92f7-9973-4487-ab7f-ce78dfd53802 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/d9d4332a-97b6-40f1-bd7c-a9a75a9adc43" status: 200 len: 1535 microversion: 2.1 time: 0.237191 Oct 04 18:40:38.171619 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1184/2518] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:37 2022] GET /compute/v2.1/servers/d9d4332a-97b6-40f1-bd7c-a9a75a9adc43 => generated 1535 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:38.177073 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-8a55504b-ae49-401e-956c-053b526aa6d2 tempest-ImagesMetadataNegativeTestJSON-1890424188 tempest-ImagesMetadataNegativeTestJSON-1890424188-project] Action: 'create', calling method: .version_select at 0x7fb21fd103a0>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:40:38.202305 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-8a55504b-ae49-401e-956c-053b526aa6d2 tempest-ImagesMetadataNegativeTestJSON-1890424188 tempest-ImagesMetadataNegativeTestJSON-1890424188-project] HTTP exception thrown: Image not found. Oct 04 18:40:38.205969 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-8a55504b-ae49-401e-956c-053b526aa6d2 tempest-ImagesMetadataNegativeTestJSON-1890424188 tempest-ImagesMetadataNegativeTestJSON-1890424188-project] Request method failure captured: Oct 04 18:40:38.205969 n-d-851028-13 devstack@n-api.service[123595]: request: POST /compute/v2.1/images/71b59e3f-1f96-4eef-8760-036a1f537b0c/metadata HTTP/1.1 Oct 04 18:40:38.205969 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 18:40:38.205969 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 18:40:38.205969 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 18:40:38.205969 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 57 Oct 04 18:40:38.205969 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 18:40:38.205969 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 18:40:38.205969 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 18:40:38.205969 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 18:40:38.205969 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPH4jvA-YMj_U9SKy6Gba4xbg2vvWX2L41fCYnriFDCRsJlXsL1p693mR1vuWTfHEu4V22Qsh4__8QaMnI5mAag4pQ1GLrqdX2zIKQu5l8TXYpNFuI4QXG7yd5mzS429xwuZDwyhKK-VehO--kd3kxyH7vxn1Kv1LhMT-bliZyqsEKeE Oct 04 18:40:38.205969 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 18:40:38.205969 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 18:40:38.205969 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 18:40:38.205969 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 18:40:38.205969 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 18:40:38.205969 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 18:40:38.205969 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: 06dc253b0843415b943c81a95eda4ceb Oct 04 18:40:38.205969 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1890424188 Oct 04 18:40:38.205969 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 18:40:38.205969 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 18:40:38.205969 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/06dc253b0843415b943c81a95eda4ceb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_06dc253b0843415b943c81a95eda4ceb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/06dc253b0843415b943c81a95eda4ceb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/06dc253b0843415b943c81a95eda4ceb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:40:38.205969 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1890424188 Oct 04 18:40:38.205969 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: 06dc253b0843415b943c81a95eda4ceb Oct 04 18:40:38.205969 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1890424188 Oct 04 18:40:38.205969 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-ImagesMetadataNegativeTestJSON-1890424188-project Oct 04 18:40:38.205969 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 18:40:38.205969 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 18:40:38.205969 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: 619f0ef484f144f79ad43255b13854d8 Oct 04 18:40:38.205969 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1890424188-project Oct 04 18:40:38.205969 n-d-851028-13 devstack@n-api.service[123595]: Oct 04 18:40:38.205969 n-d-851028-13 devstack@n-api.service[123595]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Oct 04 18:40:38.205969 n-d-851028-13 devstack@n-api.service[123595]: method: Oct 04 18:40:38.205969 n-d-851028-13 devstack@n-api.service[123595]: exception: Image not found. Oct 04 18:40:38.205969 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'image_id': '71b59e3f-1f96-4eef-8760-036a1f537b0c', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Oct 04 18:40:38.205969 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:40:38.205969 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:40:38.205969 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 18:40:38.205969 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 18:40:38.205969 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 18:40:38.205969 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 18:40:38.205969 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 18:40:38.205969 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 18:40:38.205969 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 18:40:38.205969 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 18:40:38.205969 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 18:40:38.205969 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 18:40:38.205969 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 18:40:38.205969 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 18:40:38.205969 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 18:40:38.205969 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 18:40:38.205969 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 18:40:38.205969 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 18:40:38.205969 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 71b59e3f-1f96-4eef-8760-036a1f537b0c Oct 04 18:40:38.205969 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:40:38.205969 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:40:38.205969 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:40:38.205969 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:40:38.205969 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 04 18:40:38.205969 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 04 18:40:38.205969 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 04 18:40:38.205969 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 04 18:40:38.205969 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 04 18:40:38.210305 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 04 18:40:38.210305 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 04 18:40:38.210305 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 04 18:40:38.210305 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 18:40:38.210305 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 18:40:38.210305 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 18:40:38.210305 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 18:40:38.210305 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 18:40:38.210305 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 18:40:38.210305 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 18:40:38.210305 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 18:40:38.210305 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 18:40:38.210305 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 18:40:38.210305 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 18:40:38.210305 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 18:40:38.210305 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 18:40:38.210305 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 18:40:38.210305 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 18:40:38.210305 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 18:40:38.210305 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 71b59e3f-1f96-4eef-8760-036a1f537b0c could not be found. Oct 04 18:40:38.210305 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:40:38.210305 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:40:38.210305 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:40:38.210305 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:40:38.210305 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:40:38.210305 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:40:38.210305 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:40:38.210305 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:40:38.210305 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:40:38.210305 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:40:38.210305 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:40:38.210305 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:40:38.210305 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:40:38.210305 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:40:38.210305 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 69, in create Oct 04 18:40:38.210305 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 04 18:40:38.210305 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 04 18:40:38.210305 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 04 18:40:38.210305 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 18:40:38.210305 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:40:38.210305 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:40:38.210305 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:40:38.210305 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:40:38.210305 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:40:38.210305 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:40:38.210305 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:40:38.210305 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:40:38.210305 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 18:40:38.210305 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:40:38.210305 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-8a55504b-ae49-401e-956c-053b526aa6d2 tempest-ImagesMetadataNegativeTestJSON-1890424188 tempest-ImagesMetadataNegativeTestJSON-1890424188-project] Returning 404 to user: Image not found. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:40:38.210305 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-8a55504b-ae49-401e-956c-053b526aa6d2 tempest-ImagesMetadataNegativeTestJSON-1890424188 tempest-ImagesMetadataNegativeTestJSON-1890424188-project] 10.222.0.43 "POST /compute/v2.1/images/71b59e3f-1f96-4eef-8760-036a1f537b0c/metadata" status: 404 len: 62 microversion: 2.1 time: 0.035222 Oct 04 18:40:38.210305 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1185/2519] 10.222.0.43 () {60 vars in 1281 bytes} [Tue Oct 4 18:40:38 2022] POST /compute/v2.1/images/71b59e3f-1f96-4eef-8760-036a1f537b0c/metadata => generated 62 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:40:38.214941 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-e09539a3-d387-46a5-a9c9-0346911843b8 req-a60885fe-a7d1-4043-ad62-247a56d856ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9d4332a-97b6-40f1-bd7c-a9a75a9adc43", "tag": "e64ffaa5-c4b7-4d5d-b9bd-605829597e42"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:40:38.231797 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-e09539a3-d387-46a5-a9c9-0346911843b8 req-a60885fe-a7d1-4043-ad62-247a56d856ec service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:38.232466 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-e09539a3-d387-46a5-a9c9-0346911843b8 req-a60885fe-a7d1-4043-ad62-247a56d856ec service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:38.233008 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-e09539a3-d387-46a5-a9c9-0346911843b8 req-a60885fe-a7d1-4043-ad62-247a56d856ec service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:38.254093 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-e09539a3-d387-46a5-a9c9-0346911843b8 req-a60885fe-a7d1-4043-ad62-247a56d856ec service nova] Creating event network-changed:e64ffaa5-c4b7-4d5d-b9bd-605829597e42 for instance d9d4332a-97b6-40f1-bd7c-a9a75a9adc43 on n-h1-851028-13 Oct 04 18:40:38.263400 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [req-e09539a3-d387-46a5-a9c9-0346911843b8 req-a60885fe-a7d1-4043-ad62-247a56d856ec service nova] Instance d9d4332a-97b6-40f1-bd7c-a9a75a9adc43 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851028-13', 'n-h2-851028-13'} {{(pid=123595) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 18:40:38.287500 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-e09539a3-d387-46a5-a9c9-0346911843b8 req-a60885fe-a7d1-4043-ad62-247a56d856ec service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077325 Oct 04 18:40:38.291430 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1186/2520] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:40:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:40:38.298983 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-9e0e0de8-3f11-43fe-a9d2-327caa86b277 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:38.313290 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-9e0e0de8-3f11-43fe-a9d2-327caa86b277 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6a19da94e9e646028a7f73f9d0e0edda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc41f296eb44503868205ec8aa2fef3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:38.321543 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-9e0e0de8-3f11-43fe-a9d2-327caa86b277 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-207381145', 'deleted': False, 'project_id': 'dfc41f296eb44503868205ec8aa2fef3'} {{(pid=123595) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:40:38.332208 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9e0e0de8-3f11-43fe-a9d2-327caa86b277 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:38.332700 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9e0e0de8-3f11-43fe-a9d2-327caa86b277 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:38.333167 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9e0e0de8-3f11-43fe-a9d2-327caa86b277 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:38.333918 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9e0e0de8-3f11-43fe-a9d2-327caa86b277 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:38.334394 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9e0e0de8-3f11-43fe-a9d2-327caa86b277 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:38.334832 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9e0e0de8-3f11-43fe-a9d2-327caa86b277 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:38.493005 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.multi_cell_list [None req-9e0e0de8-3f11-43fe-a9d2-327caa86b277 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=123595) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 18:40:38.592389 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-9e0e0de8-3f11-43fe-a9d2-327caa86b277 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] 10.222.0.43 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-207381145" status: 200 len: 346 microversion: 2.1 time: 0.299084 Oct 04 18:40:38.597333 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1187/2521] 10.222.0.43 () {58 vars in 1228 bytes} [Tue Oct 4 18:40:38 2022] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-207381145 => generated 346 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:40:38.603751 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-84c7496c-c578-4714-b012-6404a24c71f8 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:38.604696 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-84c7496c-c578-4714-b012-6404a24c71f8 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] [instance: ffbbf357-494a-40e4-8943-3159707fc2e4] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:38.615338 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-84c7496c-c578-4714-b012-6404a24c71f8 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:38.616106 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-84c7496c-c578-4714-b012-6404a24c71f8 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:38.617669 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-84c7496c-c578-4714-b012-6404a24c71f8 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:38.619013 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-84c7496c-c578-4714-b012-6404a24c71f8 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:38.620484 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-84c7496c-c578-4714-b012-6404a24c71f8 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:38.621381 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-84c7496c-c578-4714-b012-6404a24c71f8 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:38.838079 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-84c7496c-c578-4714-b012-6404a24c71f8 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15432d1b74334e1188866004384befe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d562b670294a47b2171f4003be4cdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:38.848586 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-84c7496c-c578-4714-b012-6404a24c71f8 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] 10.222.0.43 "GET /compute/v2.1/servers/ffbbf357-494a-40e4-8943-3159707fc2e4" status: 200 len: 1524 microversion: 2.1 time: 0.254107 Oct 04 18:40:38.849202 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1188/2522] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:38 2022] GET /compute/v2.1/servers/ffbbf357-494a-40e4-8943-3159707fc2e4 => generated 1524 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:38.864168 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-5523d0cc-7902-46ac-ac0d-158f32d0de0c tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e30c6d7042ca444a86e2260692ea048e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c54096058d4c9a8ea436329e25ecbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:38.869388 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-fbe32b15-d5e6-4477-9e77-c1010d4e919b tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:38.869950 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-fbe32b15-d5e6-4477-9e77-c1010d4e919b tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] [instance: a4de9e6e-90d3-4317-abf8-9fc8f021b803] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:38.872802 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-5523d0cc-7902-46ac-ac0d-158f32d0de0c tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] 10.222.0.43 "GET /compute/v2.1/servers/6eb9c803-dd97-4af5-b0d0-aa6fc18f8a89" status: 200 len: 1474 microversion: 2.1 time: 0.757118 Oct 04 18:40:38.874953 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1335/2523] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:38 2022] GET /compute/v2.1/servers/6eb9c803-dd97-4af5-b0d0-aa6fc18f8a89 => generated 1474 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:38.886127 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fbe32b15-d5e6-4477-9e77-c1010d4e919b tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:38.886817 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fbe32b15-d5e6-4477-9e77-c1010d4e919b tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:38.887455 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fbe32b15-d5e6-4477-9e77-c1010d4e919b tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:38.888332 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fbe32b15-d5e6-4477-9e77-c1010d4e919b tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:38.888948 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fbe32b15-d5e6-4477-9e77-c1010d4e919b tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:38.894399 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fbe32b15-d5e6-4477-9e77-c1010d4e919b tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:38.949771 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-fbe32b15-d5e6-4477-9e77-c1010d4e919b tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] [instance: a4de9e6e-90d3-4317-abf8-9fc8f021b803] Going to try to terminate instance {{(pid=123595) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:40:39.099868 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-fbe32b15-d5e6-4477-9e77-c1010d4e919b tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] 10.222.0.43 "DELETE /compute/v2.1/servers/a4de9e6e-90d3-4317-abf8-9fc8f021b803" status: 204 len: 0 microversion: 2.1 time: 0.246640 Oct 04 18:40:39.100554 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1189/2524] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 18:40:38 2022] DELETE /compute/v2.1/servers/a4de9e6e-90d3-4317-abf8-9fc8f021b803 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:40:39.109689 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-be746c23-d288-4724-a4e1-dcf855f68762 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:39.110399 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-be746c23-d288-4724-a4e1-dcf855f68762 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] [instance: a4de9e6e-90d3-4317-abf8-9fc8f021b803] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:39.121239 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-be746c23-d288-4724-a4e1-dcf855f68762 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:39.122572 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-be746c23-d288-4724-a4e1-dcf855f68762 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:39.123185 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-be746c23-d288-4724-a4e1-dcf855f68762 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:39.124757 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-be746c23-d288-4724-a4e1-dcf855f68762 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:39.126509 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-be746c23-d288-4724-a4e1-dcf855f68762 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:39.127130 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-be746c23-d288-4724-a4e1-dcf855f68762 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:39.199367 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-b9673bde-a919-4ee5-8322-dac0dbba72bb tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:39.200562 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-b9673bde-a919-4ee5-8322-dac0dbba72bb tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: d9d4332a-97b6-40f1-bd7c-a9a75a9adc43] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:39.207804 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b9673bde-a919-4ee5-8322-dac0dbba72bb tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:39.208787 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b9673bde-a919-4ee5-8322-dac0dbba72bb tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:39.209525 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b9673bde-a919-4ee5-8322-dac0dbba72bb tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:39.210683 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b9673bde-a919-4ee5-8322-dac0dbba72bb tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:39.212084 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b9673bde-a919-4ee5-8322-dac0dbba72bb tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:39.212547 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b9673bde-a919-4ee5-8322-dac0dbba72bb tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:39.438424 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-b9673bde-a919-4ee5-8322-dac0dbba72bb tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:39.447874 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-b9673bde-a919-4ee5-8322-dac0dbba72bb tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/d9d4332a-97b6-40f1-bd7c-a9a75a9adc43" status: 200 len: 1535 microversion: 2.1 time: 0.253370 Oct 04 18:40:39.448784 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1190/2525] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:39 2022] GET /compute/v2.1/servers/d9d4332a-97b6-40f1-bd7c-a9a75a9adc43 => generated 1535 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:39.656874 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-be746c23-d288-4724-a4e1-dcf855f68762 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a19da94e9e646028a7f73f9d0e0edda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc41f296eb44503868205ec8aa2fef3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:39.669851 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-be746c23-d288-4724-a4e1-dcf855f68762 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] 10.222.0.43 "GET /compute/v2.1/servers/a4de9e6e-90d3-4317-abf8-9fc8f021b803" status: 200 len: 1518 microversion: 2.1 time: 0.564698 Oct 04 18:40:39.682103 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1336/2526] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:39 2022] GET /compute/v2.1/servers/a4de9e6e-90d3-4317-abf8-9fc8f021b803 => generated 1518 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:39.880636 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-090e1e8c-ace2-41b4-a9cd-7e8fe4f560a3 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:39.882444 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-090e1e8c-ace2-41b4-a9cd-7e8fe4f560a3 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] [instance: ffbbf357-494a-40e4-8943-3159707fc2e4] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:39.894927 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-090e1e8c-ace2-41b4-a9cd-7e8fe4f560a3 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:39.903708 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-afb1d3e1-48ad-4106-9c15-3d4d933241ea tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:39.904414 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-afb1d3e1-48ad-4106-9c15-3d4d933241ea tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] [instance: 6eb9c803-dd97-4af5-b0d0-aa6fc18f8a89] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:39.909977 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-090e1e8c-ace2-41b4-a9cd-7e8fe4f560a3 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:39.911450 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-090e1e8c-ace2-41b4-a9cd-7e8fe4f560a3 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:39.913722 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-afb1d3e1-48ad-4106-9c15-3d4d933241ea tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:39.914630 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-090e1e8c-ace2-41b4-a9cd-7e8fe4f560a3 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:39.915330 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-090e1e8c-ace2-41b4-a9cd-7e8fe4f560a3 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:39.916116 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-090e1e8c-ace2-41b4-a9cd-7e8fe4f560a3 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:39.918608 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-afb1d3e1-48ad-4106-9c15-3d4d933241ea tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:39.919292 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-afb1d3e1-48ad-4106-9c15-3d4d933241ea tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:39.920316 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-afb1d3e1-48ad-4106-9c15-3d4d933241ea tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:39.921841 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-afb1d3e1-48ad-4106-9c15-3d4d933241ea tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:39.923839 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-afb1d3e1-48ad-4106-9c15-3d4d933241ea tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:40.293199 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-090e1e8c-ace2-41b4-a9cd-7e8fe4f560a3 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15432d1b74334e1188866004384befe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d562b670294a47b2171f4003be4cdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:40.304324 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-090e1e8c-ace2-41b4-a9cd-7e8fe4f560a3 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] 10.222.0.43 "GET /compute/v2.1/servers/ffbbf357-494a-40e4-8943-3159707fc2e4" status: 200 len: 1524 microversion: 2.1 time: 0.433857 Oct 04 18:40:40.307086 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1191/2527] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:39 2022] GET /compute/v2.1/servers/ffbbf357-494a-40e4-8943-3159707fc2e4 => generated 1524 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:40.319788 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-afb1d3e1-48ad-4106-9c15-3d4d933241ea tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e30c6d7042ca444a86e2260692ea048e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c54096058d4c9a8ea436329e25ecbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:40.333088 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-afb1d3e1-48ad-4106-9c15-3d4d933241ea tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] 10.222.0.43 "GET /compute/v2.1/servers/6eb9c803-dd97-4af5-b0d0-aa6fc18f8a89" status: 200 len: 1474 microversion: 2.1 time: 0.434034 Oct 04 18:40:40.347007 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1337/2528] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:39 2022] GET /compute/v2.1/servers/6eb9c803-dd97-4af5-b0d0-aa6fc18f8a89 => generated 1474 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:40.476126 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-c0230da7-8dce-48c5-9028-4cd5686dd715 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:40.477971 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-c0230da7-8dce-48c5-9028-4cd5686dd715 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: d9d4332a-97b6-40f1-bd7c-a9a75a9adc43] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:40.486743 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c0230da7-8dce-48c5-9028-4cd5686dd715 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:40.487653 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c0230da7-8dce-48c5-9028-4cd5686dd715 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:40.488304 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c0230da7-8dce-48c5-9028-4cd5686dd715 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:40.489260 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c0230da7-8dce-48c5-9028-4cd5686dd715 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:40.489938 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c0230da7-8dce-48c5-9028-4cd5686dd715 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:40.494932 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c0230da7-8dce-48c5-9028-4cd5686dd715 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:40.795483 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-c0230da7-8dce-48c5-9028-4cd5686dd715 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:40.803839 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-c0230da7-8dce-48c5-9028-4cd5686dd715 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/d9d4332a-97b6-40f1-bd7c-a9a75a9adc43" status: 200 len: 1535 microversion: 2.1 time: 0.335478 Oct 04 18:40:40.805163 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1192/2529] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:40 2022] GET /compute/v2.1/servers/d9d4332a-97b6-40f1-bd7c-a9a75a9adc43 => generated 1535 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:40.828293 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-ca0dc0cb-b56f-4d27-a43e-5e4d2266534f tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:40.829861 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-ca0dc0cb-b56f-4d27-a43e-5e4d2266534f tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] [instance: a4de9e6e-90d3-4317-abf8-9fc8f021b803] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:40.839850 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ca0dc0cb-b56f-4d27-a43e-5e4d2266534f tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:40.839850 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ca0dc0cb-b56f-4d27-a43e-5e4d2266534f tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:40.839850 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ca0dc0cb-b56f-4d27-a43e-5e4d2266534f tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:40.839850 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ca0dc0cb-b56f-4d27-a43e-5e4d2266534f tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:40.840300 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ca0dc0cb-b56f-4d27-a43e-5e4d2266534f tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:40.840401 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ca0dc0cb-b56f-4d27-a43e-5e4d2266534f tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:40.948970 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-efc2fdc0-954c-4427-a8d7-bc55972738d2 tempest-ListImageFiltersNegativeTestJSON-1099519724 tempest-ListImageFiltersNegativeTestJSON-1099519724-project] Calling method '.version_select at 0x7fb21edc5ca0>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:40.973003 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-efc2fdc0-954c-4427-a8d7-bc55972738d2 tempest-ListImageFiltersNegativeTestJSON-1099519724 tempest-ListImageFiltersNegativeTestJSON-1099519724-project] HTTP exception thrown: Image not found. Oct 04 18:40:40.975077 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-efc2fdc0-954c-4427-a8d7-bc55972738d2 tempest-ListImageFiltersNegativeTestJSON-1099519724 tempest-ListImageFiltersNegativeTestJSON-1099519724-project] Request method failure captured: Oct 04 18:40:40.975077 n-d-851028-13 devstack@n-api.service[123596]: request: GET /compute/v2.1/images/c9dd2bd9-b0c4-4fb0-8ec1-5fd1a4785442 HTTP/1.1 Oct 04 18:40:40.975077 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:40:40.975077 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:40:40.975077 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:40:40.975077 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 18:40:40.975077 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:40:40.975077 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:40:40.975077 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:40:40.975077 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:40:40.975077 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPH4obfgoER3XOZqFFC3xIKi8xDZGKxqwJ8UQO7_hkMYovNWT4whrjWYJkYZGaICupGc8xZ_mdSCU03bTk3nrgU_TzHoi3vr55-ouf26Io1-RZPIRs-D99zEl7N1yVvguo8NnkYQPYfmqbZ820jobWuV9D0JLkNBs3japa_0KVmikrEk Oct 04 18:40:40.975077 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:40:40.975077 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:40:40.975077 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:40:40.975077 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:40:40.975077 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:40:40.975077 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:40:40.975077 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: 9263a785978a430d8772ab0b2ef155c3 Oct 04 18:40:40.975077 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-ListImageFiltersNegativeTestJSON-1099519724 Oct 04 18:40:40.975077 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 18:40:40.975077 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 18:40:40.975077 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/9263a785978a430d8772ab0b2ef155c3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_9263a785978a430d8772ab0b2ef155c3"}]}, {"type": "tempest-type-2052560788", "name": "tempest-service-1365666183", "endpoints": []}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/9263a785978a430d8772ab0b2ef155c3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/9263a785978a430d8772ab0b2ef155c3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:40:40.975077 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-ListImageFiltersNegativeTestJSON-1099519724 Oct 04 18:40:40.975077 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: 9263a785978a430d8772ab0b2ef155c3 Oct 04 18:40:40.975077 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-ListImageFiltersNegativeTestJSON-1099519724 Oct 04 18:40:40.975077 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-ListImageFiltersNegativeTestJSON-1099519724-project Oct 04 18:40:40.975077 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:40:40.975077 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:40:40.975077 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 1829b0d62a84469bb7a4ac3c3fffd57f Oct 04 18:40:40.975077 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-ListImageFiltersNegativeTestJSON-1099519724-project Oct 04 18:40:40.975077 n-d-851028-13 devstack@n-api.service[123596]: method: Oct 04 18:40:40.975077 n-d-851028-13 devstack@n-api.service[123596]: exception: Image not found. Oct 04 18:40:40.975077 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': 'c9dd2bd9-b0c4-4fb0-8ec1-5fd1a4785442'} Oct 04 18:40:40.975077 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:40:40.975077 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:40:40.975077 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 18:40:40.975077 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 18:40:40.975077 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 18:40:40.975077 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 18:40:40.975077 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 18:40:40.975077 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 18:40:40.975077 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 18:40:40.975077 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 18:40:40.975077 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 18:40:40.975077 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 18:40:40.975077 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 18:40:40.975077 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 18:40:40.975077 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 18:40:40.975077 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 18:40:40.975077 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 18:40:40.975077 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 18:40:40.975077 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID c9dd2bd9-b0c4-4fb0-8ec1-5fd1a4785442 Oct 04 18:40:40.975077 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:40:40.975077 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:40:40.975077 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:40:40.975077 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:40:40.975077 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 04 18:40:40.975077 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 04 18:40:40.975077 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 04 18:40:40.975077 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 04 18:40:40.975077 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 04 18:40:40.975077 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 04 18:40:40.984050 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 04 18:40:40.984050 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 04 18:40:40.984050 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 18:40:40.984050 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 18:40:40.984050 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 18:40:40.984050 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 18:40:40.984050 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 18:40:40.984050 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 18:40:40.984050 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 18:40:40.984050 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 18:40:40.984050 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 18:40:40.984050 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 18:40:40.984050 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 18:40:40.984050 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 18:40:40.984050 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 18:40:40.984050 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 18:40:40.984050 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 18:40:40.984050 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 18:40:40.984050 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image c9dd2bd9-b0c4-4fb0-8ec1-5fd1a4785442 could not be found. Oct 04 18:40:40.984050 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:40:40.984050 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:40:40.984050 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:40:40.984050 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:40:40.984050 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:40:40.984050 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:40:40.984050 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:40:40.984050 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:40:40.984050 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:40:40.984050 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:40:40.984050 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:40:40.984050 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:40:40.984050 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 04 18:40:40.984050 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 18:40:40.984050 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 18:40:40.984050 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:40:40.984050 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:40:40.984050 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:40:40.984050 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:40:40.984050 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:40:40.984050 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:40:40.984050 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:40:40.984050 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:40:40.984050 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 18:40:40.984050 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:40:40.984050 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-efc2fdc0-954c-4427-a8d7-bc55972738d2 tempest-ListImageFiltersNegativeTestJSON-1099519724 tempest-ListImageFiltersNegativeTestJSON-1099519724-project] Returning 404 to user: Image not found. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:40:40.984050 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-efc2fdc0-954c-4427-a8d7-bc55972738d2 tempest-ListImageFiltersNegativeTestJSON-1099519724 tempest-ListImageFiltersNegativeTestJSON-1099519724-project] 10.222.0.43 "GET /compute/v2.1/images/c9dd2bd9-b0c4-4fb0-8ec1-5fd1a4785442" status: 404 len: 62 microversion: 2.1 time: 0.304819 Oct 04 18:40:40.984050 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1338/2530] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 18:40:40 2022] GET /compute/v2.1/images/c9dd2bd9-b0c4-4fb0-8ec1-5fd1a4785442 => generated 62 bytes in 307 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 04 18:40:41.184061 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-ca0dc0cb-b56f-4d27-a43e-5e4d2266534f tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a19da94e9e646028a7f73f9d0e0edda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc41f296eb44503868205ec8aa2fef3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:41.197853 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-ca0dc0cb-b56f-4d27-a43e-5e4d2266534f tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] 10.222.0.43 "GET /compute/v2.1/servers/a4de9e6e-90d3-4317-abf8-9fc8f021b803" status: 200 len: 1518 microversion: 2.1 time: 0.378415 Oct 04 18:40:41.198581 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1193/2531] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:40 2022] GET /compute/v2.1/servers/a4de9e6e-90d3-4317-abf8-9fc8f021b803 => generated 1518 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:41.336489 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-5d7d5d55-1fd5-40e8-bd53-6d9a32345ef5 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:41.338427 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-5d7d5d55-1fd5-40e8-bd53-6d9a32345ef5 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] [instance: ffbbf357-494a-40e4-8943-3159707fc2e4] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:41.354023 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5d7d5d55-1fd5-40e8-bd53-6d9a32345ef5 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:41.363577 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-84bab34a-ce7c-4670-b87d-436804f467f8 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:41.364305 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-84bab34a-ce7c-4670-b87d-436804f467f8 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] [instance: 6eb9c803-dd97-4af5-b0d0-aa6fc18f8a89] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:41.368091 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5d7d5d55-1fd5-40e8-bd53-6d9a32345ef5 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:41.371403 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-84bab34a-ce7c-4670-b87d-436804f467f8 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:41.372219 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5d7d5d55-1fd5-40e8-bd53-6d9a32345ef5 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:41.373679 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5d7d5d55-1fd5-40e8-bd53-6d9a32345ef5 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:41.374346 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5d7d5d55-1fd5-40e8-bd53-6d9a32345ef5 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:41.374993 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5d7d5d55-1fd5-40e8-bd53-6d9a32345ef5 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:41.375702 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-84bab34a-ce7c-4670-b87d-436804f467f8 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:41.377644 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-84bab34a-ce7c-4670-b87d-436804f467f8 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:41.378607 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-84bab34a-ce7c-4670-b87d-436804f467f8 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:41.382426 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-84bab34a-ce7c-4670-b87d-436804f467f8 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:41.383903 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-84bab34a-ce7c-4670-b87d-436804f467f8 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:41.632448 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-84bab34a-ce7c-4670-b87d-436804f467f8 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e30c6d7042ca444a86e2260692ea048e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c54096058d4c9a8ea436329e25ecbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:41.641890 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-84bab34a-ce7c-4670-b87d-436804f467f8 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] 10.222.0.43 "GET /compute/v2.1/servers/6eb9c803-dd97-4af5-b0d0-aa6fc18f8a89" status: 200 len: 1474 microversion: 2.1 time: 0.283744 Oct 04 18:40:41.642662 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1194/2532] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:41 2022] GET /compute/v2.1/servers/6eb9c803-dd97-4af5-b0d0-aa6fc18f8a89 => generated 1474 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:40:41.693656 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-5d7d5d55-1fd5-40e8-bd53-6d9a32345ef5 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15432d1b74334e1188866004384befe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d562b670294a47b2171f4003be4cdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:41.697661 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=100 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:40:41.706561 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-5d7d5d55-1fd5-40e8-bd53-6d9a32345ef5 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] 10.222.0.43 "GET /compute/v2.1/servers/ffbbf357-494a-40e4-8943-3159707fc2e4" status: 200 len: 1524 microversion: 2.1 time: 0.379368 Oct 04 18:40:41.725810 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1339/2533] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:41 2022] GET /compute/v2.1/servers/ffbbf357-494a-40e4-8943-3159707fc2e4 => generated 1524 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:41.832871 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-afc6a032-c73d-48c3-8fbe-da7d3c6ef1cb tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:41.834520 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-afc6a032-c73d-48c3-8fbe-da7d3c6ef1cb tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: d9d4332a-97b6-40f1-bd7c-a9a75a9adc43] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:41.841286 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-afc6a032-c73d-48c3-8fbe-da7d3c6ef1cb tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:41.841784 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-afc6a032-c73d-48c3-8fbe-da7d3c6ef1cb tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:41.842228 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-afc6a032-c73d-48c3-8fbe-da7d3c6ef1cb tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:41.842948 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-afc6a032-c73d-48c3-8fbe-da7d3c6ef1cb tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:41.843421 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-afc6a032-c73d-48c3-8fbe-da7d3c6ef1cb tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:41.852502 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-afc6a032-c73d-48c3-8fbe-da7d3c6ef1cb tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:42.109585 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-afc6a032-c73d-48c3-8fbe-da7d3c6ef1cb tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:42.119868 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-afc6a032-c73d-48c3-8fbe-da7d3c6ef1cb tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/d9d4332a-97b6-40f1-bd7c-a9a75a9adc43" status: 200 len: 1535 microversion: 2.1 time: 0.292249 Oct 04 18:40:42.119868 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1195/2534] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:41 2022] GET /compute/v2.1/servers/d9d4332a-97b6-40f1-bd7c-a9a75a9adc43 => generated 1535 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:42.236613 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-000a1447-c676-4614-97d1-c68bec946719 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:42.240616 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-000a1447-c676-4614-97d1-c68bec946719 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] [instance: a4de9e6e-90d3-4317-abf8-9fc8f021b803] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:42.268896 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-000a1447-c676-4614-97d1-c68bec946719 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:42.270234 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-000a1447-c676-4614-97d1-c68bec946719 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:42.272529 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-000a1447-c676-4614-97d1-c68bec946719 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:42.275595 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-000a1447-c676-4614-97d1-c68bec946719 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:42.277631 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-000a1447-c676-4614-97d1-c68bec946719 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:42.280048 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-000a1447-c676-4614-97d1-c68bec946719 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:42.662601 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-000a1447-c676-4614-97d1-c68bec946719 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a19da94e9e646028a7f73f9d0e0edda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc41f296eb44503868205ec8aa2fef3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:42.667136 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-d3144c36-2422-4392-be75-4324b3c9db17 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:42.667764 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-d3144c36-2422-4392-be75-4324b3c9db17 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] [instance: 6eb9c803-dd97-4af5-b0d0-aa6fc18f8a89] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:42.676837 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-000a1447-c676-4614-97d1-c68bec946719 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] 10.222.0.43 "GET /compute/v2.1/servers/a4de9e6e-90d3-4317-abf8-9fc8f021b803" status: 200 len: 1518 microversion: 2.1 time: 0.454080 Oct 04 18:40:42.691076 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d3144c36-2422-4392-be75-4324b3c9db17 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:42.691536 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d3144c36-2422-4392-be75-4324b3c9db17 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:42.692073 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d3144c36-2422-4392-be75-4324b3c9db17 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:42.692941 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d3144c36-2422-4392-be75-4324b3c9db17 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:42.693431 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d3144c36-2422-4392-be75-4324b3c9db17 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:42.694427 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d3144c36-2422-4392-be75-4324b3c9db17 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:42.694552 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1340/2535] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:42 2022] GET /compute/v2.1/servers/a4de9e6e-90d3-4317-abf8-9fc8f021b803 => generated 1518 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:42.734684 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-cc3202dc-a41e-458e-a0d4-6ad630cc6d76 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:42.735423 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-cc3202dc-a41e-458e-a0d4-6ad630cc6d76 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] [instance: ffbbf357-494a-40e4-8943-3159707fc2e4] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:42.744473 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cc3202dc-a41e-458e-a0d4-6ad630cc6d76 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:42.748279 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cc3202dc-a41e-458e-a0d4-6ad630cc6d76 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:42.748861 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cc3202dc-a41e-458e-a0d4-6ad630cc6d76 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:42.750029 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cc3202dc-a41e-458e-a0d4-6ad630cc6d76 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:42.751524 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cc3202dc-a41e-458e-a0d4-6ad630cc6d76 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:42.752507 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cc3202dc-a41e-458e-a0d4-6ad630cc6d76 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:42.980718 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-cc3202dc-a41e-458e-a0d4-6ad630cc6d76 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15432d1b74334e1188866004384befe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d562b670294a47b2171f4003be4cdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:42.993308 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-cc3202dc-a41e-458e-a0d4-6ad630cc6d76 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] 10.222.0.43 "GET /compute/v2.1/servers/ffbbf357-494a-40e4-8943-3159707fc2e4" status: 200 len: 1524 microversion: 2.1 time: 0.263485 Oct 04 18:40:43.006134 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1341/2536] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:42 2022] GET /compute/v2.1/servers/ffbbf357-494a-40e4-8943-3159707fc2e4 => generated 1524 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:40:43.145148 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-94320bb5-dbda-49e7-a4b2-17290dd7053b tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:43.145934 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-94320bb5-dbda-49e7-a4b2-17290dd7053b tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: d9d4332a-97b6-40f1-bd7c-a9a75a9adc43] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:43.156913 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-94320bb5-dbda-49e7-a4b2-17290dd7053b tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:43.157368 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-94320bb5-dbda-49e7-a4b2-17290dd7053b tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:43.157817 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-94320bb5-dbda-49e7-a4b2-17290dd7053b tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:43.160222 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-94320bb5-dbda-49e7-a4b2-17290dd7053b tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:43.161941 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-94320bb5-dbda-49e7-a4b2-17290dd7053b tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:43.162395 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-94320bb5-dbda-49e7-a4b2-17290dd7053b tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:43.217675 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-d3144c36-2422-4392-be75-4324b3c9db17 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e30c6d7042ca444a86e2260692ea048e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c54096058d4c9a8ea436329e25ecbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:43.233677 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-d3144c36-2422-4392-be75-4324b3c9db17 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] 10.222.0.43 "GET /compute/v2.1/servers/6eb9c803-dd97-4af5-b0d0-aa6fc18f8a89" status: 200 len: 1474 microversion: 2.1 time: 0.570761 Oct 04 18:40:43.234804 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1196/2537] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:42 2022] GET /compute/v2.1/servers/6eb9c803-dd97-4af5-b0d0-aa6fc18f8a89 => generated 1474 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:40:43.700703 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-94320bb5-dbda-49e7-a4b2-17290dd7053b tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:43.706448 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-e6d15c60-f4c3-4ed3-8e1f-dfbcb6735818 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:43.707268 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-e6d15c60-f4c3-4ed3-8e1f-dfbcb6735818 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] [instance: a4de9e6e-90d3-4317-abf8-9fc8f021b803] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:43.712039 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-94320bb5-dbda-49e7-a4b2-17290dd7053b tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/d9d4332a-97b6-40f1-bd7c-a9a75a9adc43" status: 200 len: 1528 microversion: 2.1 time: 0.572038 Oct 04 18:40:43.715665 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1342/2538] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:43 2022] GET /compute/v2.1/servers/d9d4332a-97b6-40f1-bd7c-a9a75a9adc43 => generated 1528 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:43.723557 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e6d15c60-f4c3-4ed3-8e1f-dfbcb6735818 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:43.727196 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e6d15c60-f4c3-4ed3-8e1f-dfbcb6735818 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:43.735806 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e6d15c60-f4c3-4ed3-8e1f-dfbcb6735818 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:43.743744 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-c61ec47f-151c-4810-9e52-95cfe5d11dcb tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:43.744660 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-c61ec47f-151c-4810-9e52-95cfe5d11dcb tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: d9d4332a-97b6-40f1-bd7c-a9a75a9adc43] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:43.745143 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e6d15c60-f4c3-4ed3-8e1f-dfbcb6735818 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:43.750645 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e6d15c60-f4c3-4ed3-8e1f-dfbcb6735818 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:43.751330 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e6d15c60-f4c3-4ed3-8e1f-dfbcb6735818 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:43.757253 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:40:43.772639 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c61ec47f-151c-4810-9e52-95cfe5d11dcb tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:43.777743 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c61ec47f-151c-4810-9e52-95cfe5d11dcb tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:43.778374 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c61ec47f-151c-4810-9e52-95cfe5d11dcb tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:43.779165 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c61ec47f-151c-4810-9e52-95cfe5d11dcb tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:43.779637 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c61ec47f-151c-4810-9e52-95cfe5d11dcb tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:43.780071 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c61ec47f-151c-4810-9e52-95cfe5d11dcb tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:44.512903 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=2 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:40:44.608454 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-c61ec47f-151c-4810-9e52-95cfe5d11dcb tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:44.621487 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-c61ec47f-151c-4810-9e52-95cfe5d11dcb tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/d9d4332a-97b6-40f1-bd7c-a9a75a9adc43" status: 200 len: 1528 microversion: 2.1 time: 0.880999 Oct 04 18:40:44.637787 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1343/2539] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:43 2022] GET /compute/v2.1/servers/d9d4332a-97b6-40f1-bd7c-a9a75a9adc43 => generated 1528 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:44.646287 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-e6d15c60-f4c3-4ed3-8e1f-dfbcb6735818 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a19da94e9e646028a7f73f9d0e0edda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc41f296eb44503868205ec8aa2fef3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:44.652945 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-1a4144c1-8c6c-42db-9a15-5476eaa97c2b tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:44.653766 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-1a4144c1-8c6c-42db-9a15-5476eaa97c2b tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] [instance: ffbbf357-494a-40e4-8943-3159707fc2e4] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:44.657909 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-e6d15c60-f4c3-4ed3-8e1f-dfbcb6735818 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] 10.222.0.43 "GET /compute/v2.1/servers/a4de9e6e-90d3-4317-abf8-9fc8f021b803" status: 200 len: 1518 microversion: 2.1 time: 0.956727 Oct 04 18:40:44.674474 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1197/2540] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:43 2022] GET /compute/v2.1/servers/a4de9e6e-90d3-4317-abf8-9fc8f021b803 => generated 1518 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:40:44.678316 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1a4144c1-8c6c-42db-9a15-5476eaa97c2b tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:44.678804 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1a4144c1-8c6c-42db-9a15-5476eaa97c2b tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:44.679794 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1a4144c1-8c6c-42db-9a15-5476eaa97c2b tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:44.680675 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1a4144c1-8c6c-42db-9a15-5476eaa97c2b tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:44.681169 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1a4144c1-8c6c-42db-9a15-5476eaa97c2b tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:44.681607 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1a4144c1-8c6c-42db-9a15-5476eaa97c2b tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:44.689036 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-ed8b70bc-0662-4cde-89ad-945395ebe39f tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:44.691838 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-ed8b70bc-0662-4cde-89ad-945395ebe39f tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] [instance: 6eb9c803-dd97-4af5-b0d0-aa6fc18f8a89] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:44.716141 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ed8b70bc-0662-4cde-89ad-945395ebe39f tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:44.717510 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ed8b70bc-0662-4cde-89ad-945395ebe39f tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:44.719086 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ed8b70bc-0662-4cde-89ad-945395ebe39f tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:44.720956 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ed8b70bc-0662-4cde-89ad-945395ebe39f tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:44.724015 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ed8b70bc-0662-4cde-89ad-945395ebe39f tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:44.724685 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ed8b70bc-0662-4cde-89ad-945395ebe39f tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:45.213991 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-ed8b70bc-0662-4cde-89ad-945395ebe39f tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e30c6d7042ca444a86e2260692ea048e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c54096058d4c9a8ea436329e25ecbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:45.230406 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-ed8b70bc-0662-4cde-89ad-945395ebe39f tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] 10.222.0.43 "GET /compute/v2.1/servers/6eb9c803-dd97-4af5-b0d0-aa6fc18f8a89" status: 200 len: 1474 microversion: 2.1 time: 0.554576 Oct 04 18:40:45.231707 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1198/2541] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:44 2022] GET /compute/v2.1/servers/6eb9c803-dd97-4af5-b0d0-aa6fc18f8a89 => generated 1474 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:45.236839 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-c3db84a6-6f34-4eca-82dc-23e2b052f0e9 req-9163f39c-f254-4d87-90bf-dda6facbdcc4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9d4332a-97b6-40f1-bd7c-a9a75a9adc43", "name": "network-vif-plugged", "status": "completed", "tag": "e64ffaa5-c4b7-4d5d-b9bd-605829597e42"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:40:45.256018 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-c3db84a6-6f34-4eca-82dc-23e2b052f0e9 req-9163f39c-f254-4d87-90bf-dda6facbdcc4 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:45.256784 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-c3db84a6-6f34-4eca-82dc-23e2b052f0e9 req-9163f39c-f254-4d87-90bf-dda6facbdcc4 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:45.258136 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-c3db84a6-6f34-4eca-82dc-23e2b052f0e9 req-9163f39c-f254-4d87-90bf-dda6facbdcc4 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:45.270186 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-c3db84a6-6f34-4eca-82dc-23e2b052f0e9 req-9163f39c-f254-4d87-90bf-dda6facbdcc4 service nova] Creating event network-vif-plugged:e64ffaa5-c4b7-4d5d-b9bd-605829597e42 for instance d9d4332a-97b6-40f1-bd7c-a9a75a9adc43 on n-h1-851028-13 Oct 04 18:40:45.275854 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-c3db84a6-6f34-4eca-82dc-23e2b052f0e9 req-9163f39c-f254-4d87-90bf-dda6facbdcc4 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042718 Oct 04 18:40:45.276944 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1199/2542] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:40:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:40:45.282757 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-f119be34-75cc-448c-9516-e8c0e63f9ee3 tempest-MigrationsAdminTest-1571334602 tempest-MigrationsAdminTest-1571334602-project-admin] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:45.289409 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-f119be34-75cc-448c-9516-e8c0e63f9ee3 tempest-MigrationsAdminTest-1571334602 tempest-MigrationsAdminTest-1571334602-project-admin] HTTP exception thrown: Flavor 1d83032c-1fb1-416a-868c-1915f092c006 could not be found. Oct 04 18:40:45.297021 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-f119be34-75cc-448c-9516-e8c0e63f9ee3 tempest-MigrationsAdminTest-1571334602 tempest-MigrationsAdminTest-1571334602-project-admin] Request method failure captured: Oct 04 18:40:45.297021 n-d-851028-13 devstack@n-api.service[123595]: request: DELETE /compute/v2.1/flavors/1d83032c-1fb1-416a-868c-1915f092c006 HTTP/1.1 Oct 04 18:40:45.297021 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 18:40:45.297021 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 18:40:45.297021 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 18:40:45.297021 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 0 Oct 04 18:40:45.297021 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 18:40:45.297021 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 18:40:45.297021 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 18:40:45.297021 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 18:40:45.297021 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPH0PfUTA13i6cpli_zIvytBxOEoUahtb5PjJxzhuQQxec4FpbwCzzT2V0GPaUYBd738ZN-w8iRMSSpuKezn0ff9PXaqs5XoMVSBQnuQSe6uRgIioNvmqU4B4ovlVLxK60BBwRv8oAcQQ673VBowleZnBwNJIl95c5ZFeaiunE7W1zPM Oct 04 18:40:45.297021 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 18:40:45.297021 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 18:40:45.297021 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 18:40:45.297021 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 18:40:45.297021 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 18:40:45.297021 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 18:40:45.297021 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: 5d8fea69caf14ba4875edc783cd7025b Oct 04 18:40:45.297021 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-MigrationsAdminTest-1571334602 Oct 04 18:40:45.297021 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,admin,reader Oct 04 18:40:45.297021 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,admin,reader Oct 04 18:40:45.297021 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/5d8fea69caf14ba4875edc783cd7025b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_5d8fea69caf14ba4875edc783cd7025b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5d8fea69caf14ba4875edc783cd7025b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5d8fea69caf14ba4875edc783cd7025b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:40:45.297021 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-MigrationsAdminTest-1571334602 Oct 04 18:40:45.297021 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: 5d8fea69caf14ba4875edc783cd7025b Oct 04 18:40:45.297021 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-MigrationsAdminTest-1571334602 Oct 04 18:40:45.297021 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-MigrationsAdminTest-1571334602-project-admin Oct 04 18:40:45.297021 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 18:40:45.297021 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 18:40:45.297021 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: 1a7436d44aba4786b9faeaedd5763591 Oct 04 18:40:45.297021 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-MigrationsAdminTest-1571334602-project-admin Oct 04 18:40:45.297021 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 18:40:45.297021 n-d-851028-13 devstack@n-api.service[123595]: exception: Flavor 1d83032c-1fb1-416a-868c-1915f092c006 could not be found. Oct 04 18:40:45.297021 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': '1d83032c-1fb1-416a-868c-1915f092c006'} Oct 04 18:40:45.297021 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:40:45.297021 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:40:45.297021 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 43, in _delete Oct 04 18:40:45.297021 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi flavor.destroy() Oct 04 18:40:45.297021 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 04 18:40:45.297021 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 04 18:40:45.297021 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 558, in destroy Oct 04 18:40:45.297021 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi db_flavor = self._flavor_destroy(self._context, Oct 04 18:40:45.297021 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 544, in _flavor_destroy Oct 04 18:40:45.297021 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return _flavor_destroy(context, flavor_id=flavor_id, flavorid=flavorid) Oct 04 18:40:45.297021 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 18:40:45.297021 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 18:40:45.297021 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 185, in _flavor_destroy Oct 04 18:40:45.297021 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=(flavor_id or flavorid)) Oct 04 18:40:45.297021 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 1d83032c-1fb1-416a-868c-1915f092c006 could not be found. Oct 04 18:40:45.297021 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:40:45.297021 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:40:45.297021 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:40:45.297021 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:40:45.297021 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:40:45.297021 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:40:45.297021 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:40:45.297021 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:40:45.297021 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:40:45.297021 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:40:45.297021 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 45, in _delete Oct 04 18:40:45.297021 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:40:45.297021 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 1d83032c-1fb1-416a-868c-1915f092c006 could not be found. Oct 04 18:40:45.297021 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:40:45.297021 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:40:45.300581 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:40:45.300581 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:40:45.300581 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:40:45.300581 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:40:45.300581 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:40:45.300581 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:40:45.300581 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1d83032c-1fb1-416a-868c-1915f092c006 could not be found. Oct 04 18:40:45.300581 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:40:45.300581 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-f119be34-75cc-448c-9516-e8c0e63f9ee3 tempest-MigrationsAdminTest-1571334602 tempest-MigrationsAdminTest-1571334602-project-admin] Returning 404 to user: Flavor 1d83032c-1fb1-416a-868c-1915f092c006 could not be found. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:40:45.300581 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-f119be34-75cc-448c-9516-e8c0e63f9ee3 tempest-MigrationsAdminTest-1571334602 tempest-MigrationsAdminTest-1571334602-project-admin] 10.222.0.43 "DELETE /compute/v2.1/flavors/1d83032c-1fb1-416a-868c-1915f092c006" status: 404 len: 109 microversion: 2.1 time: 0.020339 Oct 04 18:40:45.300581 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1200/2543] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 18:40:45 2022] DELETE /compute/v2.1/flavors/1d83032c-1fb1-416a-868c-1915f092c006 => generated 109 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:40:45.511426 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-41ff8b4e-b47e-4431-951a-1de8f274e6dc tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1008946125", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452"}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:40:45.591535 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.network.neutron [None req-41ff8b4e-b47e-4431-951a-1de8f274e6dc tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] validate_networks() for None {{(pid=123595) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:40:45.704459 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-1a4144c1-8c6c-42db-9a15-5476eaa97c2b tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15432d1b74334e1188866004384befe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d562b670294a47b2171f4003be4cdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:45.717022 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-1a4144c1-8c6c-42db-9a15-5476eaa97c2b tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] 10.222.0.43 "GET /compute/v2.1/servers/ffbbf357-494a-40e4-8943-3159707fc2e4" status: 200 len: 1524 microversion: 2.1 time: 1.077770 Oct 04 18:40:45.718060 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1344/2544] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:44 2022] GET /compute/v2.1/servers/ffbbf357-494a-40e4-8943-3159707fc2e4 => generated 1524 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:45.733878 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-38c25181-d345-40f5-8001-24ab9d2e6661 req-a100494a-e18c-45a2-be55-facba2c67083 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4de9e6e-90d3-4317-abf8-9fc8f021b803", "name": "network-vif-deleted", "tag": "972fc604-de2d-46a2-8fce-29a94634e352"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:40:45.749438 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-38c25181-d345-40f5-8001-24ab9d2e6661 req-a100494a-e18c-45a2-be55-facba2c67083 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:45.762046 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-38c25181-d345-40f5-8001-24ab9d2e6661 req-a100494a-e18c-45a2-be55-facba2c67083 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:45.762760 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-38c25181-d345-40f5-8001-24ab9d2e6661 req-a100494a-e18c-45a2-be55-facba2c67083 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:45.774775 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-38c25181-d345-40f5-8001-24ab9d2e6661 req-a100494a-e18c-45a2-be55-facba2c67083 service nova] Creating event network-vif-deleted:972fc604-de2d-46a2-8fce-29a94634e352 for instance a4de9e6e-90d3-4317-abf8-9fc8f021b803 on n-h1-851028-13 Oct 04 18:40:45.788184 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-38c25181-d345-40f5-8001-24ab9d2e6661 req-a100494a-e18c-45a2-be55-facba2c67083 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067798 Oct 04 18:40:45.794653 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1345/2545] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:40:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:40:45.806900 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-b9075970-bea0-47de-806f-5975720781b1 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:45.808808 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-b9075970-bea0-47de-806f-5975720781b1 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] [instance: a4de9e6e-90d3-4317-abf8-9fc8f021b803] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:45.825674 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b9075970-bea0-47de-806f-5975720781b1 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:45.826172 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b9075970-bea0-47de-806f-5975720781b1 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:45.826614 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b9075970-bea0-47de-806f-5975720781b1 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:45.827414 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b9075970-bea0-47de-806f-5975720781b1 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:45.827869 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b9075970-bea0-47de-806f-5975720781b1 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:45.828296 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b9075970-bea0-47de-806f-5975720781b1 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:45.916572 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b9075970-bea0-47de-806f-5975720781b1 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:45.919764 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b9075970-bea0-47de-806f-5975720781b1 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:45.921720 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b9075970-bea0-47de-806f-5975720781b1 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:45.922726 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.objects.instance [None req-b9075970-bea0-47de-806f-5975720781b1 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lazy-loading 'fault' on Instance uuid a4de9e6e-90d3-4317-abf8-9fc8f021b803 {{(pid=123596) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:40:46.095984 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-b9075970-bea0-47de-806f-5975720781b1 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a19da94e9e646028a7f73f9d0e0edda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc41f296eb44503868205ec8aa2fef3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:46.113616 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-b9075970-bea0-47de-806f-5975720781b1 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] 10.222.0.43 "GET /compute/v2.1/servers/a4de9e6e-90d3-4317-abf8-9fc8f021b803" status: 200 len: 1311 microversion: 2.1 time: 0.316935 Oct 04 18:40:46.139512 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1346/2546] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:45 2022] GET /compute/v2.1/servers/a4de9e6e-90d3-4317-abf8-9fc8f021b803 => generated 1311 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:46.150400 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-41ff8b4e-b47e-4431-951a-1de8f274e6dc tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Flavor limits 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:40:46.151429 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-41ff8b4e-b47e-4431-951a-1de8f274e6dc tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Image limits 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:40:46.152210 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-41ff8b4e-b47e-4431-951a-1de8f274e6dc tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Flavor pref 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:40:46.152802 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-41ff8b4e-b47e-4431-951a-1de8f274e6dc tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Image pref 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:40:46.153436 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-41ff8b4e-b47e-4431-951a-1de8f274e6dc tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:40:46.181001 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-41ff8b4e-b47e-4431-951a-1de8f274e6dc tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:46.182106 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-41ff8b4e-b47e-4431-951a-1de8f274e6dc tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:46.182750 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-41ff8b4e-b47e-4431-951a-1de8f274e6dc tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:46.183690 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-41ff8b4e-b47e-4431-951a-1de8f274e6dc tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:46.187997 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-41ff8b4e-b47e-4431-951a-1de8f274e6dc tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:46.188766 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-41ff8b4e-b47e-4431-951a-1de8f274e6dc tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:46.229097 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-41ff8b4e-b47e-4431-951a-1de8f274e6dc tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Getting quotas for project 50a6a1a86a59403dad27f6e3c628853c. Resources: {'ram', 'cores', 'instances'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:40:46.235437 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-41ff8b4e-b47e-4431-951a-1de8f274e6dc tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Getting quotas for user 581885ffa737444eafa3179cceb6ee1d and project 50a6a1a86a59403dad27f6e3c628853c. Resources: {'ram', 'cores', 'instances'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:40:46.256377 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-9b46c58a-5f8d-42bd-8248-8b9cfa55b9be tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:46.257101 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-9b46c58a-5f8d-42bd-8248-8b9cfa55b9be tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] [instance: 6eb9c803-dd97-4af5-b0d0-aa6fc18f8a89] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:46.269649 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9b46c58a-5f8d-42bd-8248-8b9cfa55b9be tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:46.272510 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9b46c58a-5f8d-42bd-8248-8b9cfa55b9be tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:46.276804 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9b46c58a-5f8d-42bd-8248-8b9cfa55b9be tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:46.278463 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9b46c58a-5f8d-42bd-8248-8b9cfa55b9be tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:46.279826 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9b46c58a-5f8d-42bd-8248-8b9cfa55b9be tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:46.281178 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9b46c58a-5f8d-42bd-8248-8b9cfa55b9be tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:46.281680 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-41ff8b4e-b47e-4431-951a-1de8f274e6dc tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Going to run 1 instances... {{(pid=123595) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:40:46.290776 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-41ff8b4e-b47e-4431-951a-1de8f274e6dc tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: 07ed4416-8fdc-4468-97bd-3fa1b039f77b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e8943ec5-4038-4d4b-b9b9-2415a79f5243',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:40:46.393368 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-41ff8b4e-b47e-4431-951a-1de8f274e6dc tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.885862 Oct 04 18:40:46.400751 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1201/2547] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 18:40:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 888 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 18:40:46.402694 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-fe7ee06c-dc5c-474f-86dc-a1dba6d444f1 req-cf7f01da-5d07-44c0-8ac0-3048a3157db3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6eb9c803-dd97-4af5-b0d0-aa6fc18f8a89", "name": "network-vif-deleted", "tag": "32bec9cb-4066-4472-bb00-a407392e684f"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:40:46.415068 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-fe7ee06c-dc5c-474f-86dc-a1dba6d444f1 req-cf7f01da-5d07-44c0-8ac0-3048a3157db3 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:46.416276 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-fe7ee06c-dc5c-474f-86dc-a1dba6d444f1 req-cf7f01da-5d07-44c0-8ac0-3048a3157db3 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:46.416983 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-fe7ee06c-dc5c-474f-86dc-a1dba6d444f1 req-cf7f01da-5d07-44c0-8ac0-3048a3157db3 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:46.423745 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-9b46c58a-5f8d-42bd-8248-8b9cfa55b9be tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e30c6d7042ca444a86e2260692ea048e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c54096058d4c9a8ea436329e25ecbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:46.441006 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-9b46c58a-5f8d-42bd-8248-8b9cfa55b9be tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] 10.222.0.43 "GET /compute/v2.1/servers/6eb9c803-dd97-4af5-b0d0-aa6fc18f8a89" status: 200 len: 1432 microversion: 2.1 time: 0.188131 Oct 04 18:40:46.455453 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1347/2548] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:46 2022] GET /compute/v2.1/servers/6eb9c803-dd97-4af5-b0d0-aa6fc18f8a89 => generated 1432 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:46.472109 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-0c61ab58-434f-4ed5-9260-15ceaa3b9425 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:46.473420 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-0c61ab58-434f-4ed5-9260-15ceaa3b9425 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: 07ed4416-8fdc-4468-97bd-3fa1b039f77b] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:46.476890 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-fe7ee06c-dc5c-474f-86dc-a1dba6d444f1 req-cf7f01da-5d07-44c0-8ac0-3048a3157db3 service nova] Creating event network-vif-deleted:32bec9cb-4066-4472-bb00-a407392e684f for instance 6eb9c803-dd97-4af5-b0d0-aa6fc18f8a89 on n-h1-851028-13 Oct 04 18:40:46.490975 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-fe7ee06c-dc5c-474f-86dc-a1dba6d444f1 req-cf7f01da-5d07-44c0-8ac0-3048a3157db3 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092330 Oct 04 18:40:46.493531 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1202/2549] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:40:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:40:46.580562 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-0c61ab58-434f-4ed5-9260-15ceaa3b9425 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:46.592780 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-0c61ab58-434f-4ed5-9260-15ceaa3b9425 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/07ed4416-8fdc-4468-97bd-3fa1b039f77b" status: 200 len: 1213 microversion: 2.1 time: 0.130732 Oct 04 18:40:46.595627 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1348/2550] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:46 2022] GET /compute/v2.1/servers/07ed4416-8fdc-4468-97bd-3fa1b039f77b => generated 1213 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:46.749772 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-11d536c9-1cb1-4d98-98f8-e29ff5315ce6 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:46.752411 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-11d536c9-1cb1-4d98-98f8-e29ff5315ce6 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] [instance: ffbbf357-494a-40e4-8943-3159707fc2e4] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:46.768783 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-11d536c9-1cb1-4d98-98f8-e29ff5315ce6 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:46.769720 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-11d536c9-1cb1-4d98-98f8-e29ff5315ce6 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:46.770398 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-11d536c9-1cb1-4d98-98f8-e29ff5315ce6 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:46.780333 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-11d536c9-1cb1-4d98-98f8-e29ff5315ce6 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:46.780797 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-11d536c9-1cb1-4d98-98f8-e29ff5315ce6 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:46.781367 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-11d536c9-1cb1-4d98-98f8-e29ff5315ce6 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:47.145226 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-b7ec555b-2b2c-472b-8a48-c637574a50d8 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:47.146495 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-b7ec555b-2b2c-472b-8a48-c637574a50d8 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] [instance: a4de9e6e-90d3-4317-abf8-9fc8f021b803] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:47.159341 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b7ec555b-2b2c-472b-8a48-c637574a50d8 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:47.161285 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b7ec555b-2b2c-472b-8a48-c637574a50d8 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:47.164509 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b7ec555b-2b2c-472b-8a48-c637574a50d8 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:47.166802 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b7ec555b-2b2c-472b-8a48-c637574a50d8 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:47.171292 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b7ec555b-2b2c-472b-8a48-c637574a50d8 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:47.172335 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b7ec555b-2b2c-472b-8a48-c637574a50d8 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:47.191666 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-b7ec555b-2b2c-472b-8a48-c637574a50d8 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] HTTP exception thrown: Instance a4de9e6e-90d3-4317-abf8-9fc8f021b803 could not be found. Oct 04 18:40:47.206921 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-b7ec555b-2b2c-472b-8a48-c637574a50d8 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Request method failure captured: Oct 04 18:40:47.206921 n-d-851028-13 devstack@n-api.service[123596]: request: GET /compute/v2.1/servers/a4de9e6e-90d3-4317-abf8-9fc8f021b803 HTTP/1.1 Oct 04 18:40:47.206921 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:40:47.206921 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:40:47.206921 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:40:47.206921 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 18:40:47.206921 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:40:47.206921 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:40:47.206921 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:40:47.206921 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:40:47.206921 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPH3M5g9TEr3Lf7YJMYPkPo2WOkYjOhFE0Q5LhMQAzzhmK3eQxETV845CMBg7c0_ZV7-5DWYZ2nkF_Wi0eLNUR3qxf9aOxzgcNegM9tuZDkUhWOQ2HAuRNpP2Pg9r2sJob7xNJtskNpPrCRmvVvkXu0hD9u3i_sptwn63J_YA2AS0Vu0 Oct 04 18:40:47.206921 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:40:47.206921 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:40:47.206921 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:40:47.206921 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:40:47.206921 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:40:47.206921 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:40:47.206921 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: dfc41f296eb44503868205ec8aa2fef3 Oct 04 18:40:47.206921 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-ListServerFiltersTestJSON-788951939 Oct 04 18:40:47.206921 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 18:40:47.206921 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 18:40:47.206921 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/dfc41f296eb44503868205ec8aa2fef3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_dfc41f296eb44503868205ec8aa2fef3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/dfc41f296eb44503868205ec8aa2fef3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/dfc41f296eb44503868205ec8aa2fef3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:40:47.206921 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-ListServerFiltersTestJSON-788951939 Oct 04 18:40:47.206921 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: dfc41f296eb44503868205ec8aa2fef3 Oct 04 18:40:47.206921 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-788951939 Oct 04 18:40:47.206921 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-ListServerFiltersTestJSON-788951939-project Oct 04 18:40:47.206921 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:40:47.206921 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:40:47.206921 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 6a19da94e9e646028a7f73f9d0e0edda Oct 04 18:40:47.206921 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-ListServerFiltersTestJSON-788951939-project Oct 04 18:40:47.206921 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 18:40:47.206921 n-d-851028-13 devstack@n-api.service[123596]: exception: Instance a4de9e6e-90d3-4317-abf8-9fc8f021b803 could not be found. Oct 04 18:40:47.206921 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': 'a4de9e6e-90d3-4317-abf8-9fc8f021b803'} Oct 04 18:40:47.206921 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:40:47.206921 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:40:47.206921 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:40:47.206921 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:40:47.206921 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:40:47.206921 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:40:47.206921 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:40:47.206921 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:40:47.206921 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:40:47.206921 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:40:47.206921 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4de9e6e-90d3-4317-abf8-9fc8f021b803 could not be found. Oct 04 18:40:47.206921 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:40:47.206921 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:40:47.206921 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:40:47.206921 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:40:47.206921 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:40:47.206921 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:40:47.206921 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:40:47.206921 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:40:47.206921 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:40:47.206921 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:40:47.206921 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:40:47.206921 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:40:47.206921 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:40:47.206921 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:40:47.206921 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:40:47.206921 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:40:47.206921 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4de9e6e-90d3-4317-abf8-9fc8f021b803 could not be found. Oct 04 18:40:47.206921 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:40:47.206921 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:40:47.206921 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:40:47.211100 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:40:47.211100 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:40:47.211100 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:40:47.211100 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:40:47.211100 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:40:47.211100 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4de9e6e-90d3-4317-abf8-9fc8f021b803 could not be found. Oct 04 18:40:47.211100 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:40:47.211100 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-b7ec555b-2b2c-472b-8a48-c637574a50d8 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Returning 404 to user: Instance a4de9e6e-90d3-4317-abf8-9fc8f021b803 could not be found. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:40:47.211100 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-b7ec555b-2b2c-472b-8a48-c637574a50d8 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] 10.222.0.43 "GET /compute/v2.1/servers/a4de9e6e-90d3-4317-abf8-9fc8f021b803" status: 404 len: 111 microversion: 2.1 time: 0.068589 Oct 04 18:40:47.211100 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1349/2551] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:47 2022] GET /compute/v2.1/servers/a4de9e6e-90d3-4317-abf8-9fc8f021b803 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:40:47.227817 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-68b235fc-84ee-458a-a4ac-5fbbda18b8dc tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:47.228472 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-68b235fc-84ee-458a-a4ac-5fbbda18b8dc tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] [instance: 5d365b7e-b516-4ae9-a1cd-7502e9d71041] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:47.247908 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-68b235fc-84ee-458a-a4ac-5fbbda18b8dc tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:47.248408 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-68b235fc-84ee-458a-a4ac-5fbbda18b8dc tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:47.249334 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-68b235fc-84ee-458a-a4ac-5fbbda18b8dc tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:47.261807 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-68b235fc-84ee-458a-a4ac-5fbbda18b8dc tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:47.262463 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-68b235fc-84ee-458a-a4ac-5fbbda18b8dc tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:47.262935 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-68b235fc-84ee-458a-a4ac-5fbbda18b8dc tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:47.311798 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-68b235fc-84ee-458a-a4ac-5fbbda18b8dc tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] [instance: 5d365b7e-b516-4ae9-a1cd-7502e9d71041] Going to try to terminate instance {{(pid=123596) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:40:47.421824 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-68b235fc-84ee-458a-a4ac-5fbbda18b8dc tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] 10.222.0.43 "DELETE /compute/v2.1/servers/5d365b7e-b516-4ae9-a1cd-7502e9d71041" status: 204 len: 0 microversion: 2.1 time: 0.202063 Oct 04 18:40:47.422963 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1350/2552] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 18:40:47 2022] DELETE /compute/v2.1/servers/5d365b7e-b516-4ae9-a1cd-7502e9d71041 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:40:47.444706 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-cedd52f6-585b-4c66-bbb5-0363f2e8f648 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:47.445455 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-cedd52f6-585b-4c66-bbb5-0363f2e8f648 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] [instance: 5d365b7e-b516-4ae9-a1cd-7502e9d71041] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:47.461026 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cedd52f6-585b-4c66-bbb5-0363f2e8f648 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:47.462862 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cedd52f6-585b-4c66-bbb5-0363f2e8f648 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:47.462862 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cedd52f6-585b-4c66-bbb5-0363f2e8f648 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:47.466026 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cedd52f6-585b-4c66-bbb5-0363f2e8f648 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:47.467718 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cedd52f6-585b-4c66-bbb5-0363f2e8f648 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:47.468131 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cedd52f6-585b-4c66-bbb5-0363f2e8f648 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:47.530348 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-11d536c9-1cb1-4d98-98f8-e29ff5315ce6 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15432d1b74334e1188866004384befe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d562b670294a47b2171f4003be4cdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:47.550343 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-11d536c9-1cb1-4d98-98f8-e29ff5315ce6 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] 10.222.0.43 "GET /compute/v2.1/servers/ffbbf357-494a-40e4-8943-3159707fc2e4" status: 200 len: 1524 microversion: 2.1 time: 0.809018 Oct 04 18:40:47.556522 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1203/2553] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:46 2022] GET /compute/v2.1/servers/ffbbf357-494a-40e4-8943-3159707fc2e4 => generated 1524 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:47.564510 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-dc5b92fe-12d6-4d7c-b53f-0fe05c8ef20a tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:47.566552 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-dc5b92fe-12d6-4d7c-b53f-0fe05c8ef20a tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] [instance: 6eb9c803-dd97-4af5-b0d0-aa6fc18f8a89] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:47.592774 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dc5b92fe-12d6-4d7c-b53f-0fe05c8ef20a tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:47.593848 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dc5b92fe-12d6-4d7c-b53f-0fe05c8ef20a tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:47.595573 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dc5b92fe-12d6-4d7c-b53f-0fe05c8ef20a tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:47.600049 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dc5b92fe-12d6-4d7c-b53f-0fe05c8ef20a tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:47.600854 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dc5b92fe-12d6-4d7c-b53f-0fe05c8ef20a tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:47.602618 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dc5b92fe-12d6-4d7c-b53f-0fe05c8ef20a tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:47.643826 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=1,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:40:47.649901 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dc5b92fe-12d6-4d7c-b53f-0fe05c8ef20a tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:47.650861 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dc5b92fe-12d6-4d7c-b53f-0fe05c8ef20a tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:47.653172 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dc5b92fe-12d6-4d7c-b53f-0fe05c8ef20a tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:47.653972 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.objects.instance [None req-dc5b92fe-12d6-4d7c-b53f-0fe05c8ef20a tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Lazy-loading 'fault' on Instance uuid 6eb9c803-dd97-4af5-b0d0-aa6fc18f8a89 {{(pid=123595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:40:47.871135 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-cedd52f6-585b-4c66-bbb5-0363f2e8f648 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a19da94e9e646028a7f73f9d0e0edda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc41f296eb44503868205ec8aa2fef3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:47.879868 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-cedd52f6-585b-4c66-bbb5-0363f2e8f648 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] 10.222.0.43 "GET /compute/v2.1/servers/5d365b7e-b516-4ae9-a1cd-7502e9d71041" status: 200 len: 1517 microversion: 2.1 time: 0.445832 Oct 04 18:40:47.880738 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1351/2554] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:47 2022] GET /compute/v2.1/servers/5d365b7e-b516-4ae9-a1cd-7502e9d71041 => generated 1517 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:40:47.882686 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-dc5b92fe-12d6-4d7c-b53f-0fe05c8ef20a tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e30c6d7042ca444a86e2260692ea048e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c54096058d4c9a8ea436329e25ecbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:47.887011 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-6d59e209-439f-4fd5-8331-7ab30d8483a3 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:47.887998 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-6d59e209-439f-4fd5-8331-7ab30d8483a3 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: 07ed4416-8fdc-4468-97bd-3fa1b039f77b] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:47.897663 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-dc5b92fe-12d6-4d7c-b53f-0fe05c8ef20a tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] 10.222.0.43 "GET /compute/v2.1/servers/6eb9c803-dd97-4af5-b0d0-aa6fc18f8a89" status: 200 len: 1308 microversion: 2.1 time: 0.337866 Oct 04 18:40:47.898720 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6d59e209-439f-4fd5-8331-7ab30d8483a3 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:47.899486 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6d59e209-439f-4fd5-8331-7ab30d8483a3 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:47.900249 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1204/2555] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:47 2022] GET /compute/v2.1/servers/6eb9c803-dd97-4af5-b0d0-aa6fc18f8a89 => generated 1308 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:47.900944 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6d59e209-439f-4fd5-8331-7ab30d8483a3 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:47.903020 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6d59e209-439f-4fd5-8331-7ab30d8483a3 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:47.903765 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6d59e209-439f-4fd5-8331-7ab30d8483a3 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:47.904417 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6d59e209-439f-4fd5-8331-7ab30d8483a3 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:47.968197 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=8 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:40:48.000373 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-6d59e209-439f-4fd5-8331-7ab30d8483a3 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:48.019911 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-6d59e209-439f-4fd5-8331-7ab30d8483a3 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/07ed4416-8fdc-4468-97bd-3fa1b039f77b" status: 200 len: 1209 microversion: 2.1 time: 0.137623 Oct 04 18:40:48.021903 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1352/2556] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:47 2022] GET /compute/v2.1/servers/07ed4416-8fdc-4468-97bd-3fa1b039f77b => generated 1209 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:48.584501 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-3ff44aab-e05e-4e0f-995d-14256e5d13bd tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:48.585616 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-3ff44aab-e05e-4e0f-995d-14256e5d13bd tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] [instance: ffbbf357-494a-40e4-8943-3159707fc2e4] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:48.596995 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3ff44aab-e05e-4e0f-995d-14256e5d13bd tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:48.597771 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3ff44aab-e05e-4e0f-995d-14256e5d13bd tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:48.599640 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3ff44aab-e05e-4e0f-995d-14256e5d13bd tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:48.600549 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3ff44aab-e05e-4e0f-995d-14256e5d13bd tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:48.601993 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3ff44aab-e05e-4e0f-995d-14256e5d13bd tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:48.606094 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3ff44aab-e05e-4e0f-995d-14256e5d13bd tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:48.915973 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-9dc2cca3-4310-4ab2-a04b-932a79bcf485 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:48.919763 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-9dc2cca3-4310-4ab2-a04b-932a79bcf485 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] [instance: 5d365b7e-b516-4ae9-a1cd-7502e9d71041] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:48.935518 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9dc2cca3-4310-4ab2-a04b-932a79bcf485 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:48.945806 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9dc2cca3-4310-4ab2-a04b-932a79bcf485 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:48.946809 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9dc2cca3-4310-4ab2-a04b-932a79bcf485 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:48.948292 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9dc2cca3-4310-4ab2-a04b-932a79bcf485 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:48.949066 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9dc2cca3-4310-4ab2-a04b-932a79bcf485 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:48.949748 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9dc2cca3-4310-4ab2-a04b-932a79bcf485 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:49.537295 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-9dc2cca3-4310-4ab2-a04b-932a79bcf485 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a19da94e9e646028a7f73f9d0e0edda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc41f296eb44503868205ec8aa2fef3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:49.553230 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-9dc2cca3-4310-4ab2-a04b-932a79bcf485 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] 10.222.0.43 "GET /compute/v2.1/servers/5d365b7e-b516-4ae9-a1cd-7502e9d71041" status: 200 len: 1517 microversion: 2.1 time: 0.642839 Oct 04 18:40:49.566841 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1353/2557] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:48 2022] GET /compute/v2.1/servers/5d365b7e-b516-4ae9-a1cd-7502e9d71041 => generated 1517 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:40:49.580084 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-58d573bc-67bd-4253-819e-745523d0afd2 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:49.580966 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-58d573bc-67bd-4253-819e-745523d0afd2 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] [instance: 6eb9c803-dd97-4af5-b0d0-aa6fc18f8a89] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:49.588873 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-58d573bc-67bd-4253-819e-745523d0afd2 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:49.589741 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-58d573bc-67bd-4253-819e-745523d0afd2 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:49.590482 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-58d573bc-67bd-4253-819e-745523d0afd2 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:49.592059 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-58d573bc-67bd-4253-819e-745523d0afd2 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:49.592758 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-58d573bc-67bd-4253-819e-745523d0afd2 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:49.593451 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-58d573bc-67bd-4253-819e-745523d0afd2 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:49.627328 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-58d573bc-67bd-4253-819e-745523d0afd2 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] HTTP exception thrown: Instance 6eb9c803-dd97-4af5-b0d0-aa6fc18f8a89 could not be found. Oct 04 18:40:49.667547 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-58d573bc-67bd-4253-819e-745523d0afd2 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Request method failure captured: Oct 04 18:40:49.667547 n-d-851028-13 devstack@n-api.service[123596]: request: GET /compute/v2.1/servers/6eb9c803-dd97-4af5-b0d0-aa6fc18f8a89 HTTP/1.1 Oct 04 18:40:49.667547 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:40:49.667547 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:40:49.667547 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:40:49.667547 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 18:40:49.667547 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:40:49.667547 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:40:49.667547 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:40:49.667547 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:40:49.667547 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPH2AxxEMgDFQRTa18tWGAfU7ClBeWy6rE6djhALWEkCUkYv9ZCJ1kBnVw5xJ-pGn9jQaY5DOQySOGRoBbYCWI7nhHmSGxsrxpN-A0HWqQWIUS07mjFjTmT8WAPZHWvwFVURCsmipwrwGdCaYLzhnek6YKh28ndiC3nduAIfNAO_sv9w Oct 04 18:40:49.667547 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:40:49.667547 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:40:49.667547 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:40:49.667547 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:40:49.667547 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:40:49.667547 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:40:49.667547 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: 59c54096058d4c9a8ea436329e25ecbf Oct 04 18:40:49.667547 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-ListImageFiltersTestJSON-1068934925 Oct 04 18:40:49.667547 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 18:40:49.667547 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 18:40:49.667547 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/59c54096058d4c9a8ea436329e25ecbf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_59c54096058d4c9a8ea436329e25ecbf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/59c54096058d4c9a8ea436329e25ecbf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/59c54096058d4c9a8ea436329e25ecbf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:40:49.667547 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-ListImageFiltersTestJSON-1068934925 Oct 04 18:40:49.667547 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: 59c54096058d4c9a8ea436329e25ecbf Oct 04 18:40:49.667547 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1068934925 Oct 04 18:40:49.667547 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-ListImageFiltersTestJSON-1068934925-project Oct 04 18:40:49.667547 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:40:49.667547 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:40:49.667547 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: e30c6d7042ca444a86e2260692ea048e Oct 04 18:40:49.667547 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-ListImageFiltersTestJSON-1068934925-project Oct 04 18:40:49.667547 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 18:40:49.667547 n-d-851028-13 devstack@n-api.service[123596]: exception: Instance 6eb9c803-dd97-4af5-b0d0-aa6fc18f8a89 could not be found. Oct 04 18:40:49.667547 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': '6eb9c803-dd97-4af5-b0d0-aa6fc18f8a89'} Oct 04 18:40:49.667547 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:40:49.667547 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:40:49.667547 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:40:49.667547 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:40:49.667547 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:40:49.667547 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:40:49.667547 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:40:49.667547 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:40:49.667547 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:40:49.667547 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:40:49.667547 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6eb9c803-dd97-4af5-b0d0-aa6fc18f8a89 could not be found. Oct 04 18:40:49.667547 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:40:49.667547 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:40:49.667547 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:40:49.667547 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:40:49.667547 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:40:49.667547 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:40:49.667547 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:40:49.667547 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:40:49.667547 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:40:49.667547 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:40:49.667547 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:40:49.667547 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:40:49.667547 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:40:49.667547 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:40:49.667547 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:40:49.667547 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:40:49.667547 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6eb9c803-dd97-4af5-b0d0-aa6fc18f8a89 could not be found. Oct 04 18:40:49.667547 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:40:49.667547 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:40:49.667547 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:40:49.671506 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:40:49.671506 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:40:49.671506 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:40:49.671506 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:40:49.671506 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:40:49.671506 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6eb9c803-dd97-4af5-b0d0-aa6fc18f8a89 could not be found. Oct 04 18:40:49.671506 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:40:49.671506 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-58d573bc-67bd-4253-819e-745523d0afd2 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Returning 404 to user: Instance 6eb9c803-dd97-4af5-b0d0-aa6fc18f8a89 could not be found. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:40:49.671506 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-58d573bc-67bd-4253-819e-745523d0afd2 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] 10.222.0.43 "GET /compute/v2.1/servers/6eb9c803-dd97-4af5-b0d0-aa6fc18f8a89" status: 404 len: 111 microversion: 2.1 time: 0.101216 Oct 04 18:40:49.672014 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-3ff44aab-e05e-4e0f-995d-14256e5d13bd tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15432d1b74334e1188866004384befe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d562b670294a47b2171f4003be4cdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:49.674561 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1354/2558] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:49 2022] GET /compute/v2.1/servers/6eb9c803-dd97-4af5-b0d0-aa6fc18f8a89 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:40:49.693153 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-85117eb1-a99b-4c65-b56f-cd92f1c82c73 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:49.694155 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-85117eb1-a99b-4c65-b56f-cd92f1c82c73 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: 07ed4416-8fdc-4468-97bd-3fa1b039f77b] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:49.711493 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-85117eb1-a99b-4c65-b56f-cd92f1c82c73 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:49.714924 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-85117eb1-a99b-4c65-b56f-cd92f1c82c73 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:49.717941 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-85117eb1-a99b-4c65-b56f-cd92f1c82c73 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:49.723261 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-85117eb1-a99b-4c65-b56f-cd92f1c82c73 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:49.725980 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-85117eb1-a99b-4c65-b56f-cd92f1c82c73 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:49.726663 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-85117eb1-a99b-4c65-b56f-cd92f1c82c73 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:49.744220 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-3ff44aab-e05e-4e0f-995d-14256e5d13bd tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] 10.222.0.43 "GET /compute/v2.1/servers/ffbbf357-494a-40e4-8943-3159707fc2e4" status: 200 len: 1524 microversion: 2.1 time: 1.164189 Oct 04 18:40:49.765360 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1205/2559] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:48 2022] GET /compute/v2.1/servers/ffbbf357-494a-40e4-8943-3159707fc2e4 => generated 1524 bytes in 1186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:49.784320 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-80a3a2d8-3c64-4960-b94b-1dee94831aaa tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:49.784835 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-80a3a2d8-3c64-4960-b94b-1dee94831aaa tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] [instance: 0b7f1ede-48b3-48d8-933e-287c338b1e6a] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:49.808104 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-80a3a2d8-3c64-4960-b94b-1dee94831aaa tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:49.809034 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-80a3a2d8-3c64-4960-b94b-1dee94831aaa tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:49.809694 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-80a3a2d8-3c64-4960-b94b-1dee94831aaa tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:49.810588 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-80a3a2d8-3c64-4960-b94b-1dee94831aaa tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:49.811308 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-80a3a2d8-3c64-4960-b94b-1dee94831aaa tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:49.811947 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-80a3a2d8-3c64-4960-b94b-1dee94831aaa tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:49.846327 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-80a3a2d8-3c64-4960-b94b-1dee94831aaa tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] [instance: 0b7f1ede-48b3-48d8-933e-287c338b1e6a] Going to try to terminate instance {{(pid=123595) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:40:49.957444 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-80a3a2d8-3c64-4960-b94b-1dee94831aaa tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] 10.222.0.43 "DELETE /compute/v2.1/servers/0b7f1ede-48b3-48d8-933e-287c338b1e6a" status: 204 len: 0 microversion: 2.1 time: 0.184461 Oct 04 18:40:49.959009 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1206/2560] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 18:40:49 2022] DELETE /compute/v2.1/servers/0b7f1ede-48b3-48d8-933e-287c338b1e6a => generated 0 bytes in 193 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:40:49.968092 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-cf43babf-82f4-425e-bab8-15b3ab01a647 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:49.969153 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-cf43babf-82f4-425e-bab8-15b3ab01a647 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] [instance: 0b7f1ede-48b3-48d8-933e-287c338b1e6a] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:49.975361 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cf43babf-82f4-425e-bab8-15b3ab01a647 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:49.976315 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cf43babf-82f4-425e-bab8-15b3ab01a647 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:49.976949 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cf43babf-82f4-425e-bab8-15b3ab01a647 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:49.977908 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cf43babf-82f4-425e-bab8-15b3ab01a647 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:49.978619 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cf43babf-82f4-425e-bab8-15b3ab01a647 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:49.979252 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cf43babf-82f4-425e-bab8-15b3ab01a647 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:50.038918 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-85117eb1-a99b-4c65-b56f-cd92f1c82c73 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:50.053441 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-85117eb1-a99b-4c65-b56f-cd92f1c82c73 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/07ed4416-8fdc-4468-97bd-3fa1b039f77b" status: 200 len: 1265 microversion: 2.1 time: 0.370344 Oct 04 18:40:50.055661 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1355/2561] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:49 2022] GET /compute/v2.1/servers/07ed4416-8fdc-4468-97bd-3fa1b039f77b => generated 1265 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:50.582877 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f6474f08-efbb-4c1c-816d-bcc0f7f4db06 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:50.583500 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-f6474f08-efbb-4c1c-816d-bcc0f7f4db06 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] [instance: 5d365b7e-b516-4ae9-a1cd-7502e9d71041] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:50.596746 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f6474f08-efbb-4c1c-816d-bcc0f7f4db06 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:50.597811 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f6474f08-efbb-4c1c-816d-bcc0f7f4db06 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:50.598922 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f6474f08-efbb-4c1c-816d-bcc0f7f4db06 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:50.600655 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f6474f08-efbb-4c1c-816d-bcc0f7f4db06 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:50.608093 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f6474f08-efbb-4c1c-816d-bcc0f7f4db06 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:50.608590 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f6474f08-efbb-4c1c-816d-bcc0f7f4db06 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:51.233934 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-f6474f08-efbb-4c1c-816d-bcc0f7f4db06 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a19da94e9e646028a7f73f9d0e0edda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc41f296eb44503868205ec8aa2fef3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:51.254026 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-f6474f08-efbb-4c1c-816d-bcc0f7f4db06 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] 10.222.0.43 "GET /compute/v2.1/servers/5d365b7e-b516-4ae9-a1cd-7502e9d71041" status: 200 len: 1517 microversion: 2.1 time: 0.675359 Oct 04 18:40:51.278848 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1356/2562] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:50 2022] GET /compute/v2.1/servers/5d365b7e-b516-4ae9-a1cd-7502e9d71041 => generated 1517 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:51.288686 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-4c05b97f-4113-4277-9e2a-cb31dca54501 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:51.291218 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-4c05b97f-4113-4277-9e2a-cb31dca54501 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] [instance: ffbbf357-494a-40e4-8943-3159707fc2e4] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:51.302558 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4c05b97f-4113-4277-9e2a-cb31dca54501 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:51.303453 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4c05b97f-4113-4277-9e2a-cb31dca54501 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:51.304966 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4c05b97f-4113-4277-9e2a-cb31dca54501 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:51.306624 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4c05b97f-4113-4277-9e2a-cb31dca54501 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:51.307785 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4c05b97f-4113-4277-9e2a-cb31dca54501 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:51.309825 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4c05b97f-4113-4277-9e2a-cb31dca54501 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:51.349572 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:40:51.360291 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-cf43babf-82f4-425e-bab8-15b3ab01a647 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e30c6d7042ca444a86e2260692ea048e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c54096058d4c9a8ea436329e25ecbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:51.410127 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-cf43babf-82f4-425e-bab8-15b3ab01a647 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] 10.222.0.43 "GET /compute/v2.1/servers/0b7f1ede-48b3-48d8-933e-287c338b1e6a" status: 200 len: 1473 microversion: 2.1 time: 1.446223 Oct 04 18:40:51.431285 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1207/2563] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:49 2022] GET /compute/v2.1/servers/0b7f1ede-48b3-48d8-933e-287c338b1e6a => generated 1473 bytes in 1468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:40:51.440675 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-cadaa536-84d6-40c8-864e-9f76f4ec9031 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:51.441960 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-cadaa536-84d6-40c8-864e-9f76f4ec9031 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: 07ed4416-8fdc-4468-97bd-3fa1b039f77b] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:51.456305 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cadaa536-84d6-40c8-864e-9f76f4ec9031 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:51.456788 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cadaa536-84d6-40c8-864e-9f76f4ec9031 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:51.457440 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cadaa536-84d6-40c8-864e-9f76f4ec9031 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:51.458254 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cadaa536-84d6-40c8-864e-9f76f4ec9031 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:51.458680 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cadaa536-84d6-40c8-864e-9f76f4ec9031 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:51.459126 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cadaa536-84d6-40c8-864e-9f76f4ec9031 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:51.793822 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-cadaa536-84d6-40c8-864e-9f76f4ec9031 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:51.797581 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-4c05b97f-4113-4277-9e2a-cb31dca54501 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15432d1b74334e1188866004384befe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d562b670294a47b2171f4003be4cdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:51.809460 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-4c05b97f-4113-4277-9e2a-cb31dca54501 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] 10.222.0.43 "GET /compute/v2.1/servers/ffbbf357-494a-40e4-8943-3159707fc2e4" status: 200 len: 1504 microversion: 2.1 time: 0.526994 Oct 04 18:40:51.810099 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1357/2564] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:51 2022] GET /compute/v2.1/servers/ffbbf357-494a-40e4-8943-3159707fc2e4 => generated 1504 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:51.815499 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-63a3eee2-755c-4551-b543-bdbe7c0d984f req-9f38eef3-4345-4bdb-94e1-8957f66f314f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d365b7e-b516-4ae9-a1cd-7502e9d71041", "name": "network-vif-deleted", "tag": "17040db4-9498-45bc-b84d-5459ad9740f2"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:40:51.840816 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-cadaa536-84d6-40c8-864e-9f76f4ec9031 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/07ed4416-8fdc-4468-97bd-3fa1b039f77b" status: 200 len: 1271 microversion: 2.1 time: 0.407939 Oct 04 18:40:51.847857 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1208/2565] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:51 2022] GET /compute/v2.1/servers/07ed4416-8fdc-4468-97bd-3fa1b039f77b => generated 1271 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:51.864411 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-160be1de-0076-47cd-a2eb-d27e8c951353 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Action: 'create', calling method: .version_select at 0x7fb21fa3fee0>, body: {"security_group": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1376276428", "description": "tempest-description-1885409322"}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:40:51.878455 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-63a3eee2-755c-4551-b543-bdbe7c0d984f req-9f38eef3-4345-4bdb-94e1-8957f66f314f service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:51.879026 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-63a3eee2-755c-4551-b543-bdbe7c0d984f req-9f38eef3-4345-4bdb-94e1-8957f66f314f service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:51.879679 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-63a3eee2-755c-4551-b543-bdbe7c0d984f req-9f38eef3-4345-4bdb-94e1-8957f66f314f service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:51.911609 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-63a3eee2-755c-4551-b543-bdbe7c0d984f req-9f38eef3-4345-4bdb-94e1-8957f66f314f service nova] Creating event network-vif-deleted:17040db4-9498-45bc-b84d-5459ad9740f2 for instance 5d365b7e-b516-4ae9-a1cd-7502e9d71041 on n-h2-851028-13 Oct 04 18:40:51.931540 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-63a3eee2-755c-4551-b543-bdbe7c0d984f req-9f38eef3-4345-4bdb-94e1-8957f66f314f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120172 Oct 04 18:40:51.932330 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1358/2566] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:40:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:40:52.282607 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-4ae5377b-d9a8-400b-993c-2e61acffa831 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:52.284116 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-4ae5377b-d9a8-400b-993c-2e61acffa831 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] [instance: 5d365b7e-b516-4ae9-a1cd-7502e9d71041] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:52.305689 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4ae5377b-d9a8-400b-993c-2e61acffa831 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:52.307116 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4ae5377b-d9a8-400b-993c-2e61acffa831 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:52.307738 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4ae5377b-d9a8-400b-993c-2e61acffa831 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:52.308804 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4ae5377b-d9a8-400b-993c-2e61acffa831 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:52.309446 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4ae5377b-d9a8-400b-993c-2e61acffa831 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:52.310049 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4ae5377b-d9a8-400b-993c-2e61acffa831 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:52.334846 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-4ae5377b-d9a8-400b-993c-2e61acffa831 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] HTTP exception thrown: Instance 5d365b7e-b516-4ae9-a1cd-7502e9d71041 could not be found. Oct 04 18:40:52.336795 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-4ae5377b-d9a8-400b-993c-2e61acffa831 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Request method failure captured: Oct 04 18:40:52.336795 n-d-851028-13 devstack@n-api.service[123596]: request: GET /compute/v2.1/servers/5d365b7e-b516-4ae9-a1cd-7502e9d71041 HTTP/1.1 Oct 04 18:40:52.336795 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:40:52.336795 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:40:52.336795 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:40:52.336795 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 18:40:52.336795 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:40:52.336795 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:40:52.336795 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:40:52.336795 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:40:52.336795 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPH3M5g9TEr3Lf7YJMYPkPo2WOkYjOhFE0Q5LhMQAzzhmK3eQxETV845CMBg7c0_ZV7-5DWYZ2nkF_Wi0eLNUR3qxf9aOxzgcNegM9tuZDkUhWOQ2HAuRNpP2Pg9r2sJob7xNJtskNpPrCRmvVvkXu0hD9u3i_sptwn63J_YA2AS0Vu0 Oct 04 18:40:52.336795 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:40:52.336795 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:40:52.336795 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:40:52.336795 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:40:52.336795 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:40:52.336795 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:40:52.336795 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: dfc41f296eb44503868205ec8aa2fef3 Oct 04 18:40:52.336795 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-ListServerFiltersTestJSON-788951939 Oct 04 18:40:52.336795 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 18:40:52.336795 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 18:40:52.336795 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/dfc41f296eb44503868205ec8aa2fef3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_dfc41f296eb44503868205ec8aa2fef3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/dfc41f296eb44503868205ec8aa2fef3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/dfc41f296eb44503868205ec8aa2fef3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:40:52.336795 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-ListServerFiltersTestJSON-788951939 Oct 04 18:40:52.336795 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: dfc41f296eb44503868205ec8aa2fef3 Oct 04 18:40:52.336795 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-788951939 Oct 04 18:40:52.336795 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-ListServerFiltersTestJSON-788951939-project Oct 04 18:40:52.336795 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:40:52.336795 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:40:52.336795 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 6a19da94e9e646028a7f73f9d0e0edda Oct 04 18:40:52.336795 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-ListServerFiltersTestJSON-788951939-project Oct 04 18:40:52.336795 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 18:40:52.336795 n-d-851028-13 devstack@n-api.service[123596]: exception: Instance 5d365b7e-b516-4ae9-a1cd-7502e9d71041 could not be found. Oct 04 18:40:52.336795 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': '5d365b7e-b516-4ae9-a1cd-7502e9d71041'} Oct 04 18:40:52.336795 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:40:52.336795 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:40:52.336795 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:40:52.336795 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:40:52.336795 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:40:52.336795 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:40:52.336795 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:40:52.336795 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:40:52.336795 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:40:52.336795 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:40:52.336795 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d365b7e-b516-4ae9-a1cd-7502e9d71041 could not be found. Oct 04 18:40:52.336795 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:40:52.336795 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:40:52.336795 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:40:52.336795 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:40:52.336795 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:40:52.336795 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:40:52.336795 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:40:52.336795 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:40:52.336795 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:40:52.336795 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:40:52.336795 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:40:52.336795 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:40:52.336795 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:40:52.336795 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:40:52.336795 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:40:52.336795 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:40:52.336795 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d365b7e-b516-4ae9-a1cd-7502e9d71041 could not be found. Oct 04 18:40:52.336795 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:40:52.336795 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:40:52.336795 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:40:52.340442 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:40:52.340442 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:40:52.340442 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:40:52.340442 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:40:52.340442 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:40:52.340442 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d365b7e-b516-4ae9-a1cd-7502e9d71041 could not be found. Oct 04 18:40:52.340442 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:40:52.342053 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-4ae5377b-d9a8-400b-993c-2e61acffa831 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Returning 404 to user: Instance 5d365b7e-b516-4ae9-a1cd-7502e9d71041 could not be found. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:40:52.355271 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-4ae5377b-d9a8-400b-993c-2e61acffa831 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] 10.222.0.43 "GET /compute/v2.1/servers/5d365b7e-b516-4ae9-a1cd-7502e9d71041" status: 404 len: 111 microversion: 2.1 time: 0.077935 Oct 04 18:40:52.360831 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1359/2567] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:52 2022] GET /compute/v2.1/servers/5d365b7e-b516-4ae9-a1cd-7502e9d71041 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:40:52.367481 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-461b46af-6018-4627-803f-3a6fe5bb2a28 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:52.368090 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-461b46af-6018-4627-803f-3a6fe5bb2a28 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] [instance: 1a71ee0e-ffa8-4730-b4fb-8b6e9fd87239] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:52.377358 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:40:52.382823 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-461b46af-6018-4627-803f-3a6fe5bb2a28 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:52.384130 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-461b46af-6018-4627-803f-3a6fe5bb2a28 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:52.386639 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-461b46af-6018-4627-803f-3a6fe5bb2a28 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:52.387745 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-461b46af-6018-4627-803f-3a6fe5bb2a28 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:52.388859 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-461b46af-6018-4627-803f-3a6fe5bb2a28 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:52.389515 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-461b46af-6018-4627-803f-3a6fe5bb2a28 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:52.442918 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-461b46af-6018-4627-803f-3a6fe5bb2a28 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] [instance: 1a71ee0e-ffa8-4730-b4fb-8b6e9fd87239] Going to try to terminate instance {{(pid=123596) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:40:52.557963 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-461b46af-6018-4627-803f-3a6fe5bb2a28 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] 10.222.0.43 "DELETE /compute/v2.1/servers/1a71ee0e-ffa8-4730-b4fb-8b6e9fd87239" status: 204 len: 0 microversion: 2.1 time: 0.195466 Oct 04 18:40:52.559290 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1360/2568] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 18:40:52 2022] DELETE /compute/v2.1/servers/1a71ee0e-ffa8-4730-b4fb-8b6e9fd87239 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:40:52.570060 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f948dcce-c218-4d36-8340-ba244c945523 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:52.571152 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-f948dcce-c218-4d36-8340-ba244c945523 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] [instance: 0b7f1ede-48b3-48d8-933e-287c338b1e6a] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:52.578069 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f948dcce-c218-4d36-8340-ba244c945523 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:52.578789 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f948dcce-c218-4d36-8340-ba244c945523 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:52.579472 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f948dcce-c218-4d36-8340-ba244c945523 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:52.580375 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f948dcce-c218-4d36-8340-ba244c945523 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:52.581024 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f948dcce-c218-4d36-8340-ba244c945523 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:52.582235 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f948dcce-c218-4d36-8340-ba244c945523 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:52.902007 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-f948dcce-c218-4d36-8340-ba244c945523 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e30c6d7042ca444a86e2260692ea048e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c54096058d4c9a8ea436329e25ecbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:52.918826 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-f948dcce-c218-4d36-8340-ba244c945523 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] 10.222.0.43 "GET /compute/v2.1/servers/0b7f1ede-48b3-48d8-933e-287c338b1e6a" status: 200 len: 1473 microversion: 2.1 time: 0.357384 Oct 04 18:40:52.939563 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1361/2569] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:52 2022] GET /compute/v2.1/servers/0b7f1ede-48b3-48d8-933e-287c338b1e6a => generated 1473 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:52.953724 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-498ed4cc-9da7-4bd9-81ee-c043b8bc8fae tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:52.970338 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-498ed4cc-9da7-4bd9-81ee-c043b8bc8fae tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] [instance: 1a71ee0e-ffa8-4730-b4fb-8b6e9fd87239] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:52.994412 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-498ed4cc-9da7-4bd9-81ee-c043b8bc8fae tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:52.996897 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-498ed4cc-9da7-4bd9-81ee-c043b8bc8fae tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:53.000103 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-498ed4cc-9da7-4bd9-81ee-c043b8bc8fae tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:53.002101 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-498ed4cc-9da7-4bd9-81ee-c043b8bc8fae tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:53.007218 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-498ed4cc-9da7-4bd9-81ee-c043b8bc8fae tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:53.008755 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-498ed4cc-9da7-4bd9-81ee-c043b8bc8fae tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:53.318763 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-160be1de-0076-47cd-a2eb-d27e8c951353 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] 10.222.0.43 "POST /compute/v2.1/os-security-groups" status: 200 len: 251 microversion: 2.1 time: 1.471947 Oct 04 18:40:53.319884 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1209/2570] 10.222.0.43 () {60 vars in 1180 bytes} [Tue Oct 4 18:40:51 2022] POST /compute/v2.1/os-security-groups => generated 251 bytes in 1475 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:40:53.336066 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-9e78d703-37e9-440b-ad1a-93101234dda3 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:53.336691 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-9e78d703-37e9-440b-ad1a-93101234dda3 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: 07ed4416-8fdc-4468-97bd-3fa1b039f77b] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:53.345259 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9e78d703-37e9-440b-ad1a-93101234dda3 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:53.345727 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9e78d703-37e9-440b-ad1a-93101234dda3 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:53.346725 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9e78d703-37e9-440b-ad1a-93101234dda3 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:53.347940 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9e78d703-37e9-440b-ad1a-93101234dda3 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:53.348686 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9e78d703-37e9-440b-ad1a-93101234dda3 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:53.349152 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9e78d703-37e9-440b-ad1a-93101234dda3 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:53.479304 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-9e78d703-37e9-440b-ad1a-93101234dda3 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:53.493913 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-9e78d703-37e9-440b-ad1a-93101234dda3 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/07ed4416-8fdc-4468-97bd-3fa1b039f77b" status: 200 len: 1271 microversion: 2.1 time: 0.161155 Oct 04 18:40:53.495734 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1210/2571] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:53 2022] GET /compute/v2.1/servers/07ed4416-8fdc-4468-97bd-3fa1b039f77b => generated 1271 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:53.509408 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-a6c952c5-6d78-4c5b-b30b-dd35c23fb6b6 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1376276428"}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:40:53.509408 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-a6c952c5-6d78-4c5b-b30b-dd35c23fb6b6 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] [instance: ffbbf357-494a-40e4-8943-3159707fc2e4] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:53.523847 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a6c952c5-6d78-4c5b-b30b-dd35c23fb6b6 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:53.524348 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a6c952c5-6d78-4c5b-b30b-dd35c23fb6b6 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:53.524796 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a6c952c5-6d78-4c5b-b30b-dd35c23fb6b6 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:53.525552 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a6c952c5-6d78-4c5b-b30b-dd35c23fb6b6 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:53.529955 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a6c952c5-6d78-4c5b-b30b-dd35c23fb6b6 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:53.530500 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a6c952c5-6d78-4c5b-b30b-dd35c23fb6b6 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:53.843195 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-498ed4cc-9da7-4bd9-81ee-c043b8bc8fae tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a19da94e9e646028a7f73f9d0e0edda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc41f296eb44503868205ec8aa2fef3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:53.862246 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-498ed4cc-9da7-4bd9-81ee-c043b8bc8fae tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] 10.222.0.43 "GET /compute/v2.1/servers/1a71ee0e-ffa8-4730-b4fb-8b6e9fd87239" status: 200 len: 1517 microversion: 2.1 time: 0.917283 Oct 04 18:40:53.865328 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1362/2572] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:52 2022] GET /compute/v2.1/servers/1a71ee0e-ffa8-4730-b4fb-8b6e9fd87239 => generated 1517 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:53.948149 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-0536c70c-af47-44c6-aaaa-f53836b15827 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:53.949379 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-0536c70c-af47-44c6-aaaa-f53836b15827 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] [instance: 0b7f1ede-48b3-48d8-933e-287c338b1e6a] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:53.960659 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.network.security_group_api [None req-a6c952c5-6d78-4c5b-b30b-dd35c23fb6b6 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Adding security group baf30a83-da7c-4c41-8763-1bd0e133c99d to port 61178b4f-ada9-4139-8cac-244778b3c3e5 Oct 04 18:40:53.962365 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0536c70c-af47-44c6-aaaa-f53836b15827 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:53.962626 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0536c70c-af47-44c6-aaaa-f53836b15827 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:53.962998 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0536c70c-af47-44c6-aaaa-f53836b15827 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:53.964554 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0536c70c-af47-44c6-aaaa-f53836b15827 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:53.964554 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0536c70c-af47-44c6-aaaa-f53836b15827 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:53.969360 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0536c70c-af47-44c6-aaaa-f53836b15827 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:54.513760 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-0536c70c-af47-44c6-aaaa-f53836b15827 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e30c6d7042ca444a86e2260692ea048e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c54096058d4c9a8ea436329e25ecbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:54.525901 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-0536c70c-af47-44c6-aaaa-f53836b15827 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] 10.222.0.43 "GET /compute/v2.1/servers/0b7f1ede-48b3-48d8-933e-287c338b1e6a" status: 200 len: 1473 microversion: 2.1 time: 0.583525 Oct 04 18:40:54.527679 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1363/2573] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:53 2022] GET /compute/v2.1/servers/0b7f1ede-48b3-48d8-933e-287c338b1e6a => generated 1473 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:40:54.550243 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-0e6f0742-72fc-4ef3-b356-8ca6fa9ce3f8 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:54.550717 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-0e6f0742-72fc-4ef3-b356-8ca6fa9ce3f8 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: 07ed4416-8fdc-4468-97bd-3fa1b039f77b] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:54.576787 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0e6f0742-72fc-4ef3-b356-8ca6fa9ce3f8 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:54.594111 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0e6f0742-72fc-4ef3-b356-8ca6fa9ce3f8 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:54.594677 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0e6f0742-72fc-4ef3-b356-8ca6fa9ce3f8 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:54.595449 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0e6f0742-72fc-4ef3-b356-8ca6fa9ce3f8 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:54.603365 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0e6f0742-72fc-4ef3-b356-8ca6fa9ce3f8 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:54.606546 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0e6f0742-72fc-4ef3-b356-8ca6fa9ce3f8 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:54.974430 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-0e6f0742-72fc-4ef3-b356-8ca6fa9ce3f8 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:54.996628 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-0e6f0742-72fc-4ef3-b356-8ca6fa9ce3f8 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/07ed4416-8fdc-4468-97bd-3fa1b039f77b" status: 200 len: 1313 microversion: 2.1 time: 0.462795 Oct 04 18:40:54.999797 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1364/2574] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:54 2022] GET /compute/v2.1/servers/07ed4416-8fdc-4468-97bd-3fa1b039f77b => generated 1313 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:55.021623 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-443b07c1-3630-4376-a56a-82556669aa39 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:55.022558 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-443b07c1-3630-4376-a56a-82556669aa39 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] [instance: 1a71ee0e-ffa8-4730-b4fb-8b6e9fd87239] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:55.048170 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-443b07c1-3630-4376-a56a-82556669aa39 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:55.066647 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-443b07c1-3630-4376-a56a-82556669aa39 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:55.073208 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-443b07c1-3630-4376-a56a-82556669aa39 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:55.074181 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-443b07c1-3630-4376-a56a-82556669aa39 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:55.074771 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-443b07c1-3630-4376-a56a-82556669aa39 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:55.081894 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-443b07c1-3630-4376-a56a-82556669aa39 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:55.761245 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-443b07c1-3630-4376-a56a-82556669aa39 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a19da94e9e646028a7f73f9d0e0edda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc41f296eb44503868205ec8aa2fef3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:55.777137 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-443b07c1-3630-4376-a56a-82556669aa39 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] 10.222.0.43 "GET /compute/v2.1/servers/1a71ee0e-ffa8-4730-b4fb-8b6e9fd87239" status: 200 len: 1517 microversion: 2.1 time: 0.766506 Oct 04 18:40:55.778912 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1365/2575] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:55 2022] GET /compute/v2.1/servers/1a71ee0e-ffa8-4730-b4fb-8b6e9fd87239 => generated 1517 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:55.785266 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-3019f844-ee5b-497d-a525-cfa9f19f160b tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:55.793615 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-3019f844-ee5b-497d-a525-cfa9f19f160b tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] [instance: 0b7f1ede-48b3-48d8-933e-287c338b1e6a] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:55.812730 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3019f844-ee5b-497d-a525-cfa9f19f160b tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:55.814090 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3019f844-ee5b-497d-a525-cfa9f19f160b tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:55.816308 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3019f844-ee5b-497d-a525-cfa9f19f160b tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:55.817810 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3019f844-ee5b-497d-a525-cfa9f19f160b tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:55.819529 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3019f844-ee5b-497d-a525-cfa9f19f160b tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:55.821366 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3019f844-ee5b-497d-a525-cfa9f19f160b tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:56.203362 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=15 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:40:56.267285 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=6 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:40:56.422712 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-3019f844-ee5b-497d-a525-cfa9f19f160b tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e30c6d7042ca444a86e2260692ea048e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c54096058d4c9a8ea436329e25ecbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:56.435501 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-3019f844-ee5b-497d-a525-cfa9f19f160b tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] 10.222.0.43 "GET /compute/v2.1/servers/0b7f1ede-48b3-48d8-933e-287c338b1e6a" status: 200 len: 1431 microversion: 2.1 time: 0.653871 Oct 04 18:40:56.438588 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1366/2576] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:55 2022] GET /compute/v2.1/servers/0b7f1ede-48b3-48d8-933e-287c338b1e6a => generated 1431 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:56.447259 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-43feb28c-d996-4b22-9329-7b65685d7dcb tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:56.450788 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-43feb28c-d996-4b22-9329-7b65685d7dcb tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: 07ed4416-8fdc-4468-97bd-3fa1b039f77b] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:56.476155 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-43feb28c-d996-4b22-9329-7b65685d7dcb tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:56.476611 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-43feb28c-d996-4b22-9329-7b65685d7dcb tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:56.477060 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-43feb28c-d996-4b22-9329-7b65685d7dcb tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:56.477804 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-43feb28c-d996-4b22-9329-7b65685d7dcb tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:56.478437 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-43feb28c-d996-4b22-9329-7b65685d7dcb tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:56.479029 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-43feb28c-d996-4b22-9329-7b65685d7dcb tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:56.585956 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=2 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:40:56.923851 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-a6c952c5-6d78-4c5b-b30b-dd35c23fb6b6 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] 10.222.0.43 "POST /compute/v2.1/servers/ffbbf357-494a-40e4-8943-3159707fc2e4/action" status: 202 len: 0 microversion: 2.1 time: 3.426509 Oct 04 18:40:56.924490 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1211/2577] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 18:40:53 2022] POST /compute/v2.1/servers/ffbbf357-494a-40e4-8943-3159707fc2e4/action => generated 0 bytes in 3428 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:40:56.931489 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-a4f89733-b1c6-4ad0-b12f-1b04da978428 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:56.932108 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-a4f89733-b1c6-4ad0-b12f-1b04da978428 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] [instance: 1a71ee0e-ffa8-4730-b4fb-8b6e9fd87239] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:56.967053 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a4f89733-b1c6-4ad0-b12f-1b04da978428 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:56.968375 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a4f89733-b1c6-4ad0-b12f-1b04da978428 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:56.968859 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a4f89733-b1c6-4ad0-b12f-1b04da978428 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:56.969670 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a4f89733-b1c6-4ad0-b12f-1b04da978428 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:56.970264 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a4f89733-b1c6-4ad0-b12f-1b04da978428 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:56.970906 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a4f89733-b1c6-4ad0-b12f-1b04da978428 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:57.123122 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-43feb28c-d996-4b22-9329-7b65685d7dcb tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:57.145076 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-43feb28c-d996-4b22-9329-7b65685d7dcb tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/07ed4416-8fdc-4468-97bd-3fa1b039f77b" status: 200 len: 1313 microversion: 2.1 time: 0.696540 Oct 04 18:40:57.146070 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1367/2578] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:56 2022] GET /compute/v2.1/servers/07ed4416-8fdc-4468-97bd-3fa1b039f77b => generated 1313 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:57.151523 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-36aa386b-2ebb-4bfd-ab7f-ab676361f680 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1376276428"}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:40:57.161148 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-36aa386b-2ebb-4bfd-ab7f-ab676361f680 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] [instance: ffbbf357-494a-40e4-8943-3159707fc2e4] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:57.173229 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-36aa386b-2ebb-4bfd-ab7f-ab676361f680 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:57.174088 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-36aa386b-2ebb-4bfd-ab7f-ab676361f680 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:57.178923 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-36aa386b-2ebb-4bfd-ab7f-ab676361f680 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:57.180068 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-36aa386b-2ebb-4bfd-ab7f-ab676361f680 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:57.180961 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-36aa386b-2ebb-4bfd-ab7f-ab676361f680 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:57.186696 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-36aa386b-2ebb-4bfd-ab7f-ab676361f680 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:57.344315 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-a4f89733-b1c6-4ad0-b12f-1b04da978428 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a19da94e9e646028a7f73f9d0e0edda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc41f296eb44503868205ec8aa2fef3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:57.400186 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-a4f89733-b1c6-4ad0-b12f-1b04da978428 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] 10.222.0.43 "GET /compute/v2.1/servers/1a71ee0e-ffa8-4730-b4fb-8b6e9fd87239" status: 200 len: 1475 microversion: 2.1 time: 0.472478 Oct 04 18:40:57.402003 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1212/2579] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:56 2022] GET /compute/v2.1/servers/1a71ee0e-ffa8-4730-b4fb-8b6e9fd87239 => generated 1475 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:57.416581 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-abe42f57-d370-41e7-9e6b-bb140694b70f req-450d109f-b149-4bd2-8dff-a7231ccfe1e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ffbbf357-494a-40e4-8943-3159707fc2e4", "tag": "61178b4f-ada9-4139-8cac-244778b3c3e5"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:40:57.490684 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-abe42f57-d370-41e7-9e6b-bb140694b70f req-450d109f-b149-4bd2-8dff-a7231ccfe1e4 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:57.497976 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-abe42f57-d370-41e7-9e6b-bb140694b70f req-450d109f-b149-4bd2-8dff-a7231ccfe1e4 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:57.500565 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-abe42f57-d370-41e7-9e6b-bb140694b70f req-450d109f-b149-4bd2-8dff-a7231ccfe1e4 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:57.567602 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-abe42f57-d370-41e7-9e6b-bb140694b70f req-450d109f-b149-4bd2-8dff-a7231ccfe1e4 service nova] Creating event network-changed:61178b4f-ada9-4139-8cac-244778b3c3e5 for instance ffbbf357-494a-40e4-8943-3159707fc2e4 on n-h2-851028-13 Oct 04 18:40:57.591775 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-abe42f57-d370-41e7-9e6b-bb140694b70f req-450d109f-b149-4bd2-8dff-a7231ccfe1e4 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.187984 Oct 04 18:40:57.596068 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1213/2580] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:40:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:40:57.629198 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-07f4b983-e7cb-4e3c-8759-da20ae9f0072 req-af5f75c1-dfee-47c6-a75a-2266d82e0b69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b7f1ede-48b3-48d8-933e-287c338b1e6a", "name": "network-vif-deleted", "tag": "462f1dea-cb2e-42da-a165-e6bc91610838"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:40:57.674440 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-07f4b983-e7cb-4e3c-8759-da20ae9f0072 req-af5f75c1-dfee-47c6-a75a-2266d82e0b69 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:57.684449 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-07f4b983-e7cb-4e3c-8759-da20ae9f0072 req-af5f75c1-dfee-47c6-a75a-2266d82e0b69 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:57.686084 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-07f4b983-e7cb-4e3c-8759-da20ae9f0072 req-af5f75c1-dfee-47c6-a75a-2266d82e0b69 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:57.729689 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-07f4b983-e7cb-4e3c-8759-da20ae9f0072 req-af5f75c1-dfee-47c6-a75a-2266d82e0b69 service nova] Creating event network-vif-deleted:462f1dea-cb2e-42da-a165-e6bc91610838 for instance 0b7f1ede-48b3-48d8-933e-287c338b1e6a on n-h1-851028-13 Oct 04 18:40:57.736496 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-07f4b983-e7cb-4e3c-8759-da20ae9f0072 req-af5f75c1-dfee-47c6-a75a-2266d82e0b69 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135552 Oct 04 18:40:57.738735 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1214/2581] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:40:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:40:57.745900 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-86727bb4-f2f7-48c2-9b68-ba5debc9c5ca tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:57.747236 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-86727bb4-f2f7-48c2-9b68-ba5debc9c5ca tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] [instance: 0b7f1ede-48b3-48d8-933e-287c338b1e6a] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:57.757424 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-86727bb4-f2f7-48c2-9b68-ba5debc9c5ca tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:57.758152 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-86727bb4-f2f7-48c2-9b68-ba5debc9c5ca tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:57.759071 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-86727bb4-f2f7-48c2-9b68-ba5debc9c5ca tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:57.760255 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-86727bb4-f2f7-48c2-9b68-ba5debc9c5ca tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:57.761054 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-86727bb4-f2f7-48c2-9b68-ba5debc9c5ca tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:57.761858 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-86727bb4-f2f7-48c2-9b68-ba5debc9c5ca tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:57.816713 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-86727bb4-f2f7-48c2-9b68-ba5debc9c5ca tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:57.817946 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-86727bb4-f2f7-48c2-9b68-ba5debc9c5ca tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:57.818577 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-86727bb4-f2f7-48c2-9b68-ba5debc9c5ca tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:57.819279 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.objects.instance [None req-86727bb4-f2f7-48c2-9b68-ba5debc9c5ca tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Lazy-loading 'fault' on Instance uuid 0b7f1ede-48b3-48d8-933e-287c338b1e6a {{(pid=123595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:40:57.928016 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-86727bb4-f2f7-48c2-9b68-ba5debc9c5ca tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e30c6d7042ca444a86e2260692ea048e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c54096058d4c9a8ea436329e25ecbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:57.939864 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-86727bb4-f2f7-48c2-9b68-ba5debc9c5ca tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] 10.222.0.43 "GET /compute/v2.1/servers/0b7f1ede-48b3-48d8-933e-287c338b1e6a" status: 200 len: 1307 microversion: 2.1 time: 0.199785 Oct 04 18:40:57.949980 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1215/2582] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:57 2022] GET /compute/v2.1/servers/0b7f1ede-48b3-48d8-933e-287c338b1e6a => generated 1307 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:58.175086 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-bc578d04-e04c-4197-913a-9046f9569198 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:58.175831 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-bc578d04-e04c-4197-913a-9046f9569198 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: 07ed4416-8fdc-4468-97bd-3fa1b039f77b] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:58.196764 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bc578d04-e04c-4197-913a-9046f9569198 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:58.197445 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bc578d04-e04c-4197-913a-9046f9569198 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:58.199126 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bc578d04-e04c-4197-913a-9046f9569198 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:58.201928 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bc578d04-e04c-4197-913a-9046f9569198 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:58.203176 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bc578d04-e04c-4197-913a-9046f9569198 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:58.219959 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bc578d04-e04c-4197-913a-9046f9569198 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:58.566423 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.network.security_group_api [None req-36aa386b-2ebb-4bfd-ab7f-ab676361f680 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Removing security group baf30a83-da7c-4c41-8763-1bd0e133c99d from port 61178b4f-ada9-4139-8cac-244778b3c3e5 Oct 04 18:40:58.918945 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-bc578d04-e04c-4197-913a-9046f9569198 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:58.935505 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-bc578d04-e04c-4197-913a-9046f9569198 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/07ed4416-8fdc-4468-97bd-3fa1b039f77b" status: 200 len: 1313 microversion: 2.1 time: 0.766190 Oct 04 18:40:58.948119 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1216/2583] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:58 2022] GET /compute/v2.1/servers/07ed4416-8fdc-4468-97bd-3fa1b039f77b => generated 1313 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:40:58.965296 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-21771188-4c72-4fde-b058-40a6163756e6 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:58.965921 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-21771188-4c72-4fde-b058-40a6163756e6 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] [instance: 1a71ee0e-ffa8-4730-b4fb-8b6e9fd87239] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:58.980623 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-21771188-4c72-4fde-b058-40a6163756e6 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:58.981102 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-21771188-4c72-4fde-b058-40a6163756e6 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:58.981600 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-21771188-4c72-4fde-b058-40a6163756e6 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:58.982347 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-21771188-4c72-4fde-b058-40a6163756e6 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:58.982754 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-21771188-4c72-4fde-b058-40a6163756e6 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:58.983178 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-21771188-4c72-4fde-b058-40a6163756e6 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:58.987888 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:40:59.018981 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-21771188-4c72-4fde-b058-40a6163756e6 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] HTTP exception thrown: Instance 1a71ee0e-ffa8-4730-b4fb-8b6e9fd87239 could not be found. Oct 04 18:40:59.020733 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-21771188-4c72-4fde-b058-40a6163756e6 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Request method failure captured: Oct 04 18:40:59.020733 n-d-851028-13 devstack@n-api.service[123595]: request: GET /compute/v2.1/servers/1a71ee0e-ffa8-4730-b4fb-8b6e9fd87239 HTTP/1.1 Oct 04 18:40:59.020733 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 18:40:59.020733 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 18:40:59.020733 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 18:40:59.020733 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 0 Oct 04 18:40:59.020733 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 18:40:59.020733 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 18:40:59.020733 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 18:40:59.020733 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 18:40:59.020733 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPH3M5g9TEr3Lf7YJMYPkPo2WOkYjOhFE0Q5LhMQAzzhmK3eQxETV845CMBg7c0_ZV7-5DWYZ2nkF_Wi0eLNUR3qxf9aOxzgcNegM9tuZDkUhWOQ2HAuRNpP2Pg9r2sJob7xNJtskNpPrCRmvVvkXu0hD9u3i_sptwn63J_YA2AS0Vu0 Oct 04 18:40:59.020733 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 18:40:59.020733 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 18:40:59.020733 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 18:40:59.020733 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 18:40:59.020733 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 18:40:59.020733 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 18:40:59.020733 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: dfc41f296eb44503868205ec8aa2fef3 Oct 04 18:40:59.020733 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-ListServerFiltersTestJSON-788951939 Oct 04 18:40:59.020733 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 18:40:59.020733 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 18:40:59.020733 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/dfc41f296eb44503868205ec8aa2fef3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_dfc41f296eb44503868205ec8aa2fef3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/dfc41f296eb44503868205ec8aa2fef3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/dfc41f296eb44503868205ec8aa2fef3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:40:59.020733 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-ListServerFiltersTestJSON-788951939 Oct 04 18:40:59.020733 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: dfc41f296eb44503868205ec8aa2fef3 Oct 04 18:40:59.020733 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-788951939 Oct 04 18:40:59.020733 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-ListServerFiltersTestJSON-788951939-project Oct 04 18:40:59.020733 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 18:40:59.020733 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 18:40:59.020733 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: 6a19da94e9e646028a7f73f9d0e0edda Oct 04 18:40:59.020733 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-ListServerFiltersTestJSON-788951939-project Oct 04 18:40:59.020733 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 18:40:59.020733 n-d-851028-13 devstack@n-api.service[123595]: exception: Instance 1a71ee0e-ffa8-4730-b4fb-8b6e9fd87239 could not be found. Oct 04 18:40:59.020733 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': '1a71ee0e-ffa8-4730-b4fb-8b6e9fd87239'} Oct 04 18:40:59.020733 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:40:59.020733 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:40:59.020733 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:40:59.020733 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:40:59.020733 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:40:59.020733 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:40:59.020733 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:40:59.020733 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:40:59.020733 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:40:59.020733 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:40:59.020733 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a71ee0e-ffa8-4730-b4fb-8b6e9fd87239 could not be found. Oct 04 18:40:59.020733 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:40:59.020733 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:40:59.020733 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:40:59.020733 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:40:59.020733 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:40:59.020733 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:40:59.020733 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:40:59.020733 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:40:59.020733 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:40:59.020733 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:40:59.020733 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:40:59.020733 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:40:59.020733 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:40:59.020733 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:40:59.020733 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:40:59.020733 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:40:59.020733 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a71ee0e-ffa8-4730-b4fb-8b6e9fd87239 could not be found. Oct 04 18:40:59.020733 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:40:59.020733 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:40:59.020733 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:40:59.026215 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:40:59.026215 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:40:59.026215 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:40:59.026215 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:40:59.026215 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:40:59.026215 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a71ee0e-ffa8-4730-b4fb-8b6e9fd87239 could not be found. Oct 04 18:40:59.026215 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:40:59.026215 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-21771188-4c72-4fde-b058-40a6163756e6 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] Returning 404 to user: Instance 1a71ee0e-ffa8-4730-b4fb-8b6e9fd87239 could not be found. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:40:59.026215 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-21771188-4c72-4fde-b058-40a6163756e6 tempest-ListServerFiltersTestJSON-788951939 tempest-ListServerFiltersTestJSON-788951939-project] 10.222.0.43 "GET /compute/v2.1/servers/1a71ee0e-ffa8-4730-b4fb-8b6e9fd87239" status: 404 len: 111 microversion: 2.1 time: 0.073129 Oct 04 18:40:59.029483 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1217/2584] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:58 2022] GET /compute/v2.1/servers/1a71ee0e-ffa8-4730-b4fb-8b6e9fd87239 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:40:59.034858 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-a8ed9bf3-8d65-45d2-a9c9-1ceea755f62a tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:59.035483 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-a8ed9bf3-8d65-45d2-a9c9-1ceea755f62a tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] [instance: 0b7f1ede-48b3-48d8-933e-287c338b1e6a] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:59.065880 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a8ed9bf3-8d65-45d2-a9c9-1ceea755f62a tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:59.066371 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a8ed9bf3-8d65-45d2-a9c9-1ceea755f62a tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:59.078612 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a8ed9bf3-8d65-45d2-a9c9-1ceea755f62a tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:59.079646 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a8ed9bf3-8d65-45d2-a9c9-1ceea755f62a tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:59.080111 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a8ed9bf3-8d65-45d2-a9c9-1ceea755f62a tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:59.080554 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a8ed9bf3-8d65-45d2-a9c9-1ceea755f62a tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:59.109366 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-a8ed9bf3-8d65-45d2-a9c9-1ceea755f62a tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] HTTP exception thrown: Instance 0b7f1ede-48b3-48d8-933e-287c338b1e6a could not be found. Oct 04 18:40:59.110938 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-a8ed9bf3-8d65-45d2-a9c9-1ceea755f62a tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Request method failure captured: Oct 04 18:40:59.110938 n-d-851028-13 devstack@n-api.service[123595]: request: GET /compute/v2.1/servers/0b7f1ede-48b3-48d8-933e-287c338b1e6a HTTP/1.1 Oct 04 18:40:59.110938 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 18:40:59.110938 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 18:40:59.110938 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 18:40:59.110938 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 0 Oct 04 18:40:59.110938 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 18:40:59.110938 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 18:40:59.110938 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 18:40:59.110938 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 18:40:59.110938 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPH2AxxEMgDFQRTa18tWGAfU7ClBeWy6rE6djhALWEkCUkYv9ZCJ1kBnVw5xJ-pGn9jQaY5DOQySOGRoBbYCWI7nhHmSGxsrxpN-A0HWqQWIUS07mjFjTmT8WAPZHWvwFVURCsmipwrwGdCaYLzhnek6YKh28ndiC3nduAIfNAO_sv9w Oct 04 18:40:59.110938 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 18:40:59.110938 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 18:40:59.110938 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 18:40:59.110938 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 18:40:59.110938 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 18:40:59.110938 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 18:40:59.110938 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: 59c54096058d4c9a8ea436329e25ecbf Oct 04 18:40:59.110938 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-ListImageFiltersTestJSON-1068934925 Oct 04 18:40:59.110938 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 18:40:59.110938 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 18:40:59.110938 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/59c54096058d4c9a8ea436329e25ecbf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_59c54096058d4c9a8ea436329e25ecbf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/59c54096058d4c9a8ea436329e25ecbf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/59c54096058d4c9a8ea436329e25ecbf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:40:59.110938 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-ListImageFiltersTestJSON-1068934925 Oct 04 18:40:59.110938 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: 59c54096058d4c9a8ea436329e25ecbf Oct 04 18:40:59.110938 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1068934925 Oct 04 18:40:59.110938 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-ListImageFiltersTestJSON-1068934925-project Oct 04 18:40:59.110938 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 18:40:59.110938 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 18:40:59.110938 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: e30c6d7042ca444a86e2260692ea048e Oct 04 18:40:59.110938 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-ListImageFiltersTestJSON-1068934925-project Oct 04 18:40:59.110938 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 18:40:59.110938 n-d-851028-13 devstack@n-api.service[123595]: exception: Instance 0b7f1ede-48b3-48d8-933e-287c338b1e6a could not be found. Oct 04 18:40:59.110938 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': '0b7f1ede-48b3-48d8-933e-287c338b1e6a'} Oct 04 18:40:59.110938 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:40:59.110938 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:40:59.110938 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:40:59.110938 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:40:59.110938 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:40:59.110938 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:40:59.110938 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:40:59.110938 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:40:59.110938 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:40:59.110938 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:40:59.110938 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b7f1ede-48b3-48d8-933e-287c338b1e6a could not be found. Oct 04 18:40:59.110938 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:40:59.110938 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:40:59.110938 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:40:59.110938 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:40:59.110938 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:40:59.110938 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:40:59.110938 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:40:59.110938 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:40:59.110938 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:40:59.110938 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:40:59.110938 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:40:59.110938 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:40:59.110938 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:40:59.110938 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:40:59.110938 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:40:59.110938 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:40:59.110938 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b7f1ede-48b3-48d8-933e-287c338b1e6a could not be found. Oct 04 18:40:59.110938 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:40:59.110938 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:40:59.110938 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:40:59.114455 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:40:59.114455 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:40:59.114455 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:40:59.114455 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:40:59.114455 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:40:59.114455 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b7f1ede-48b3-48d8-933e-287c338b1e6a could not be found. Oct 04 18:40:59.114455 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:40:59.114455 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-a8ed9bf3-8d65-45d2-a9c9-1ceea755f62a tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Returning 404 to user: Instance 0b7f1ede-48b3-48d8-933e-287c338b1e6a could not be found. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:40:59.114455 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-a8ed9bf3-8d65-45d2-a9c9-1ceea755f62a tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] 10.222.0.43 "GET /compute/v2.1/servers/0b7f1ede-48b3-48d8-933e-287c338b1e6a" status: 404 len: 111 microversion: 2.1 time: 0.081777 Oct 04 18:40:59.114455 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1218/2585] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:59 2022] GET /compute/v2.1/servers/0b7f1ede-48b3-48d8-933e-287c338b1e6a => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:40:59.130025 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-93252b25-25c1-4fa9-b392-18b05021599c tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Calling method '.version_select at 0x7fb21f74c0d0>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:00.022943 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-93252b25-25c1-4fa9-b392-18b05021599c tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] 10.222.0.43 "DELETE /compute/v2.1/images/4922dc1e-3377-471c-b125-be6842ef59ec" status: 204 len: 0 microversion: 2.1 time: 0.892118 Oct 04 18:41:00.025931 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1219/2586] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:59 2022] DELETE /compute/v2.1/images/4922dc1e-3377-471c-b125-be6842ef59ec => generated 0 bytes in 901 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:41:00.060676 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-45d3c7d7-ffa5-4b0a-9f91-3066205ca0f1 req-dd13777d-6312-4cef-b464-771cc6b1f790 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a71ee0e-ffa8-4730-b4fb-8b6e9fd87239", "name": "network-vif-deleted", "tag": "8da0ebc1-434a-4e48-b121-02b4d226123d"}, {"name": "network-changed", "server_uuid": "07ed4416-8fdc-4468-97bd-3fa1b039f77b", "tag": "8ca0d053-912a-4590-9b08-aa9f36208d96"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:41:00.103089 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-45d3c7d7-ffa5-4b0a-9f91-3066205ca0f1 req-dd13777d-6312-4cef-b464-771cc6b1f790 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:00.103779 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-45d3c7d7-ffa5-4b0a-9f91-3066205ca0f1 req-dd13777d-6312-4cef-b464-771cc6b1f790 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:00.106719 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-45d3c7d7-ffa5-4b0a-9f91-3066205ca0f1 req-dd13777d-6312-4cef-b464-771cc6b1f790 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:00.144963 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-45d3c7d7-ffa5-4b0a-9f91-3066205ca0f1 req-dd13777d-6312-4cef-b464-771cc6b1f790 service nova] Creating event network-vif-deleted:8da0ebc1-434a-4e48-b121-02b4d226123d for instance 1a71ee0e-ffa8-4730-b4fb-8b6e9fd87239 on n-h1-851028-13 Oct 04 18:41:00.149235 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-45d3c7d7-ffa5-4b0a-9f91-3066205ca0f1 req-dd13777d-6312-4cef-b464-771cc6b1f790 service nova] Creating event network-changed:8ca0d053-912a-4590-9b08-aa9f36208d96 for instance 07ed4416-8fdc-4468-97bd-3fa1b039f77b on n-h2-851028-13 Oct 04 18:41:00.166500 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-45d3c7d7-ffa5-4b0a-9f91-3066205ca0f1 req-dd13777d-6312-4cef-b464-771cc6b1f790 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.127358 Oct 04 18:41:00.167134 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1220/2587] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:41:00 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:41:00.181749 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-4ba7f8a4-c56e-4083-9a4b-7e3215b7f5be tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:00.183488 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-4ba7f8a4-c56e-4083-9a4b-7e3215b7f5be tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: 07ed4416-8fdc-4468-97bd-3fa1b039f77b] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:00.201338 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4ba7f8a4-c56e-4083-9a4b-7e3215b7f5be tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:00.201853 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4ba7f8a4-c56e-4083-9a4b-7e3215b7f5be tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:00.202300 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4ba7f8a4-c56e-4083-9a4b-7e3215b7f5be tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:00.203844 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4ba7f8a4-c56e-4083-9a4b-7e3215b7f5be tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:00.204479 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4ba7f8a4-c56e-4083-9a4b-7e3215b7f5be tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:00.204926 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4ba7f8a4-c56e-4083-9a4b-7e3215b7f5be tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:00.296812 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-36aa386b-2ebb-4bfd-ab7f-ab676361f680 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] 10.222.0.43 "POST /compute/v2.1/servers/ffbbf357-494a-40e4-8943-3159707fc2e4/action" status: 202 len: 0 microversion: 2.1 time: 3.149430 Oct 04 18:41:00.298201 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1368/2588] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 18:40:57 2022] POST /compute/v2.1/servers/ffbbf357-494a-40e4-8943-3159707fc2e4/action => generated 0 bytes in 3151 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:41:00.304400 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-a7d9ba2e-8174-412f-b903-b8bfddb885a0 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Calling method '.version_select at 0x7fb21efbb5e0>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:01.561035 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-a7d9ba2e-8174-412f-b903-b8bfddb885a0 tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] 10.222.0.43 "DELETE /compute/v2.1/images/52610c6d-facb-4b22-af71-212112120503" status: 204 len: 0 microversion: 2.1 time: 1.261280 Oct 04 18:41:01.564571 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1369/2589] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:00 2022] DELETE /compute/v2.1/images/52610c6d-facb-4b22-af71-212112120503 => generated 0 bytes in 1263 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:41:01.566532 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-69766f6a-3aaf-474a-b5ef-c0847d927f41 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Action: 'create', calling method: .version_select at 0x7fb21f0e8ee0>, body: {"pool": null} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:41:01.603942 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-4ba7f8a4-c56e-4083-9a4b-7e3215b7f5be tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:01.619809 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-4ba7f8a4-c56e-4083-9a4b-7e3215b7f5be tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/07ed4416-8fdc-4468-97bd-3fa1b039f77b" status: 200 len: 1313 microversion: 2.1 time: 1.451192 Oct 04 18:41:01.620412 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1221/2590] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:00 2022] GET /compute/v2.1/servers/07ed4416-8fdc-4468-97bd-3fa1b039f77b => generated 1313 bytes in 1453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:41:01.637754 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-0d8a1169-f9dc-4c7a-b940-6b90f26fb91c req-0eebf3ab-492a-4a89-a6d2-16f8eaf0e645 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ffbbf357-494a-40e4-8943-3159707fc2e4", "tag": "61178b4f-ada9-4139-8cac-244778b3c3e5"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:41:01.651986 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-0d8a1169-f9dc-4c7a-b940-6b90f26fb91c req-0eebf3ab-492a-4a89-a6d2-16f8eaf0e645 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:01.652754 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-0d8a1169-f9dc-4c7a-b940-6b90f26fb91c req-0eebf3ab-492a-4a89-a6d2-16f8eaf0e645 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:01.653386 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-0d8a1169-f9dc-4c7a-b940-6b90f26fb91c req-0eebf3ab-492a-4a89-a6d2-16f8eaf0e645 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:01.665962 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-0d8a1169-f9dc-4c7a-b940-6b90f26fb91c req-0eebf3ab-492a-4a89-a6d2-16f8eaf0e645 service nova] Creating event network-changed:61178b4f-ada9-4139-8cac-244778b3c3e5 for instance ffbbf357-494a-40e4-8943-3159707fc2e4 on n-h2-851028-13 Oct 04 18:41:01.671565 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-0d8a1169-f9dc-4c7a-b940-6b90f26fb91c req-0eebf3ab-492a-4a89-a6d2-16f8eaf0e645 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045245 Oct 04 18:41:01.672683 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1222/2591] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:41:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:41:02.158632 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-513ff563-d32c-4b6c-9197-4149a98bc921 tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-1660493628", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452", "networks": [{"uuid": "437542d4-0db1-4303-a39c-65f5cc039358"}]}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:41:02.291575 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.network.neutron [None req-513ff563-d32c-4b6c-9197-4149a98bc921 tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] validate_networks() for [('437542d4-0db1-4303-a39c-65f5cc039358', None, None, None, None, None)] {{(pid=123595) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:41:04.614345 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-69766f6a-3aaf-474a-b5ef-c0847d927f41 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] 10.222.0.43 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.051449 Oct 04 18:41:04.615251 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1370/2592] 10.222.0.43 () {60 vars in 1170 bytes} [Tue Oct 4 18:41:01 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3053 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:41:04.621177 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-c2316a35-bd0e-49f4-bc2a-5ea7aecf528d tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] Calling method '.version_select at 0x7fb227d6df70>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:04.916711 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-513ff563-d32c-4b6c-9197-4149a98bc921 tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Flavor limits 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:41:04.918206 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-513ff563-d32c-4b6c-9197-4149a98bc921 tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Image limits 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:41:04.918786 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-513ff563-d32c-4b6c-9197-4149a98bc921 tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Flavor pref 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:41:04.919257 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-513ff563-d32c-4b6c-9197-4149a98bc921 tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Image pref 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:41:04.919679 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-513ff563-d32c-4b6c-9197-4149a98bc921 tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:41:04.938201 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-513ff563-d32c-4b6c-9197-4149a98bc921 tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:04.938701 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-513ff563-d32c-4b6c-9197-4149a98bc921 tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:04.939150 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-513ff563-d32c-4b6c-9197-4149a98bc921 tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:04.939897 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-513ff563-d32c-4b6c-9197-4149a98bc921 tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:04.940357 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-513ff563-d32c-4b6c-9197-4149a98bc921 tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:04.940781 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-513ff563-d32c-4b6c-9197-4149a98bc921 tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:04.995759 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-513ff563-d32c-4b6c-9197-4149a98bc921 tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Getting quotas for project 4962d2bd82fd4d59b4a50ecda9825236. Resources: {'ram', 'cores', 'instances'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:41:05.002421 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-513ff563-d32c-4b6c-9197-4149a98bc921 tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Getting quotas for user 28575c19f44e4aa2b87f06719880de28 and project 4962d2bd82fd4d59b4a50ecda9825236. Resources: {'ram', 'cores', 'instances'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:41:05.031717 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-513ff563-d32c-4b6c-9197-4149a98bc921 tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Going to run 1 instances... {{(pid=123595) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:41:05.040032 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-513ff563-d32c-4b6c-9197-4149a98bc921 tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] [instance: 485dd126-4ea5-4f31-b551-b653e649b2f7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e8943ec5-4038-4d4b-b9b9-2415a79f5243',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:41:05.107611 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-513ff563-d32c-4b6c-9197-4149a98bc921 tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 3.433225 Oct 04 18:41:05.108946 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1223/2593] 10.222.0.43 () {62 vars in 1188 bytes} [Tue Oct 4 18:41:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 3435 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 04 18:41:05.116550 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-4bdd1cae-8143-4a7d-b832-f15b49e0083c tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:05.118822 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-4bdd1cae-8143-4a7d-b832-f15b49e0083c tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: 07ed4416-8fdc-4468-97bd-3fa1b039f77b] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:05.157055 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4bdd1cae-8143-4a7d-b832-f15b49e0083c tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:05.158005 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4bdd1cae-8143-4a7d-b832-f15b49e0083c tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:05.158655 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4bdd1cae-8143-4a7d-b832-f15b49e0083c tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:05.159906 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4bdd1cae-8143-4a7d-b832-f15b49e0083c tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:05.164787 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4bdd1cae-8143-4a7d-b832-f15b49e0083c tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:05.165815 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4bdd1cae-8143-4a7d-b832-f15b49e0083c tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:05.494010 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-4bdd1cae-8143-4a7d-b832-f15b49e0083c tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:05.506710 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-4bdd1cae-8143-4a7d-b832-f15b49e0083c tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/07ed4416-8fdc-4468-97bd-3fa1b039f77b" status: 200 len: 1313 microversion: 2.1 time: 0.395926 Oct 04 18:41:05.507311 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1224/2594] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:05 2022] GET /compute/v2.1/servers/07ed4416-8fdc-4468-97bd-3fa1b039f77b => generated 1313 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:41:05.801578 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-c2316a35-bd0e-49f4-bc2a-5ea7aecf528d tempest-ListImageFiltersTestJSON-1068934925 tempest-ListImageFiltersTestJSON-1068934925-project] 10.222.0.43 "DELETE /compute/v2.1/images/d9a9dd34-fad4-41fd-9adf-f9f1a890d9a6" status: 204 len: 0 microversion: 2.1 time: 1.184971 Oct 04 18:41:05.802471 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1371/2595] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:04 2022] DELETE /compute/v2.1/images/d9a9dd34-fad4-41fd-9adf-f9f1a890d9a6 => generated 0 bytes in 1186 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:41:05.807812 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-4766fcfd-9cb6-4bbc-9b7d-83c5f4421a5b tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.8.166"}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:41:05.819408 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-4766fcfd-9cb6-4bbc-9b7d-83c5f4421a5b tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] [instance: ffbbf357-494a-40e4-8943-3159707fc2e4] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:05.836857 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4766fcfd-9cb6-4bbc-9b7d-83c5f4421a5b tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:05.837612 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4766fcfd-9cb6-4bbc-9b7d-83c5f4421a5b tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:05.838712 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4766fcfd-9cb6-4bbc-9b7d-83c5f4421a5b tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:05.842515 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4766fcfd-9cb6-4bbc-9b7d-83c5f4421a5b tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:05.843222 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4766fcfd-9cb6-4bbc-9b7d-83c5f4421a5b tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:05.844901 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4766fcfd-9cb6-4bbc-9b7d-83c5f4421a5b tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:05.908317 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4766fcfd-9cb6-4bbc-9b7d-83c5f4421a5b tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Acquiring lock "refresh_cache-ffbbf357-494a-40e4-8943-3159707fc2e4" {{(pid=123596) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 04 18:41:05.908737 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4766fcfd-9cb6-4bbc-9b7d-83c5f4421a5b tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Acquired lock "refresh_cache-ffbbf357-494a-40e4-8943-3159707fc2e4" {{(pid=123596) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 04 18:41:06.076266 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-50392cb7-1abf-4729-bce6-e91506fc541b tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Action: 'create', calling method: .version_select at 0x7fb21f7854c0>, body: {"keypair": {"name": "tempest-keypair-1624991526", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP8geTvZTwpstZwDFfpWMHbvo2l7hiCQ3XoQGxyY/dyBIBzY4z0b3gSqLbrq0fOJw4SIu8MLQRTai0IuzPUxHeZQXChdvbc76T5cPfiuqZ0/FEzVp/kXCWnOsBBoReVj4A=="}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:41:06.156051 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-50392cb7-1abf-4729-bce6-e91506fc541b tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Getting quotas for project f379b9ce44d942959b67137e546191c3. Resources: {'key_pairs'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:41:06.181032 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-50392cb7-1abf-4729-bce6-e91506fc541b tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Getting quotas for user b2df20485e3d4c75b2f4fc7375adebb8 and project f379b9ce44d942959b67137e546191c3. Resources: {'key_pairs'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:41:06.246517 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-50392cb7-1abf-4729-bce6-e91506fc541b tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.732294 Oct 04 18:41:06.251097 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1225/2596] 10.222.0.43 () {60 vars in 1159 bytes} [Tue Oct 4 18:41:05 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:41:06.265214 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-474eb2e5-ec7e-4f9b-bc98-0c7e563a8c02 tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:06.267940 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-474eb2e5-ec7e-4f9b-bc98-0c7e563a8c02 tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] [instance: 485dd126-4ea5-4f31-b551-b653e649b2f7] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:06.299474 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-474eb2e5-ec7e-4f9b-bc98-0c7e563a8c02 tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:06.303782 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-474eb2e5-ec7e-4f9b-bc98-0c7e563a8c02 tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:06.304340 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-474eb2e5-ec7e-4f9b-bc98-0c7e563a8c02 tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:06.308369 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-474eb2e5-ec7e-4f9b-bc98-0c7e563a8c02 tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:06.312667 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-474eb2e5-ec7e-4f9b-bc98-0c7e563a8c02 tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:06.317343 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-474eb2e5-ec7e-4f9b-bc98-0c7e563a8c02 tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:06.618513 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-474eb2e5-ec7e-4f9b-bc98-0c7e563a8c02 tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28575c19f44e4aa2b87f06719880de28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4962d2bd82fd4d59b4a50ecda9825236', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:06.634810 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-474eb2e5-ec7e-4f9b-bc98-0c7e563a8c02 tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28575c19f44e4aa2b87f06719880de28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4962d2bd82fd4d59b4a50ecda9825236', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:06.644147 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-474eb2e5-ec7e-4f9b-bc98-0c7e563a8c02 tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28575c19f44e4aa2b87f06719880de28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4962d2bd82fd4d59b4a50ecda9825236', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:06.648577 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-474eb2e5-ec7e-4f9b-bc98-0c7e563a8c02 tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] 10.222.0.43 "GET /compute/v2.1/servers/485dd126-4ea5-4f31-b551-b653e649b2f7" status: 200 len: 1263 microversion: 2.21 time: 0.395008 Oct 04 18:41:06.663726 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1226/2597] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:41:06 2022] GET /compute/v2.1/servers/485dd126-4ea5-4f31-b551-b653e649b2f7 => generated 1263 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:41:06.679879 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-c96fca4a-5325-4eb8-8b73-2746f69a3207 req-5bb0c560-0ef5-4e48-a510-ff66bbd8a5f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07ed4416-8fdc-4468-97bd-3fa1b039f77b", "name": "network-vif-plugged", "status": "completed", "tag": "8ca0d053-912a-4590-9b08-aa9f36208d96"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:41:06.711936 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-c96fca4a-5325-4eb8-8b73-2746f69a3207 req-5bb0c560-0ef5-4e48-a510-ff66bbd8a5f6 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:06.713709 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-c96fca4a-5325-4eb8-8b73-2746f69a3207 req-5bb0c560-0ef5-4e48-a510-ff66bbd8a5f6 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:06.717211 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-c96fca4a-5325-4eb8-8b73-2746f69a3207 req-5bb0c560-0ef5-4e48-a510-ff66bbd8a5f6 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:06.749197 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-c96fca4a-5325-4eb8-8b73-2746f69a3207 req-5bb0c560-0ef5-4e48-a510-ff66bbd8a5f6 service nova] Creating event network-vif-plugged:8ca0d053-912a-4590-9b08-aa9f36208d96 for instance 07ed4416-8fdc-4468-97bd-3fa1b039f77b on n-h2-851028-13 Oct 04 18:41:06.763906 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-c96fca4a-5325-4eb8-8b73-2746f69a3207 req-5bb0c560-0ef5-4e48-a510-ff66bbd8a5f6 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086699 Oct 04 18:41:06.767048 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1227/2598] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:41:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:41:06.786624 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-5754308e-4d70-42cf-9da0-061beecb32c7 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:06.788480 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-5754308e-4d70-42cf-9da0-061beecb32c7 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: 07ed4416-8fdc-4468-97bd-3fa1b039f77b] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:06.805211 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5754308e-4d70-42cf-9da0-061beecb32c7 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:06.809380 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5754308e-4d70-42cf-9da0-061beecb32c7 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:06.810352 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5754308e-4d70-42cf-9da0-061beecb32c7 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:06.813714 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5754308e-4d70-42cf-9da0-061beecb32c7 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:06.814511 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5754308e-4d70-42cf-9da0-061beecb32c7 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:06.815393 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5754308e-4d70-42cf-9da0-061beecb32c7 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:07.591137 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-5754308e-4d70-42cf-9da0-061beecb32c7 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:07.602557 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-5754308e-4d70-42cf-9da0-061beecb32c7 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/07ed4416-8fdc-4468-97bd-3fa1b039f77b" status: 200 len: 1313 microversion: 2.1 time: 0.830420 Oct 04 18:41:07.611247 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1228/2599] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:06 2022] GET /compute/v2.1/servers/07ed4416-8fdc-4468-97bd-3fa1b039f77b => generated 1313 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:41:07.681094 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-c5cc857d-dfce-4ab7-b1a2-10a6c181d6ab tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:07.681760 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-c5cc857d-dfce-4ab7-b1a2-10a6c181d6ab tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] [instance: 485dd126-4ea5-4f31-b551-b653e649b2f7] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:07.690398 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c5cc857d-dfce-4ab7-b1a2-10a6c181d6ab tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:07.691411 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c5cc857d-dfce-4ab7-b1a2-10a6c181d6ab tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:07.692002 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c5cc857d-dfce-4ab7-b1a2-10a6c181d6ab tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:07.692877 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c5cc857d-dfce-4ab7-b1a2-10a6c181d6ab tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:07.693601 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c5cc857d-dfce-4ab7-b1a2-10a6c181d6ab tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:07.694203 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c5cc857d-dfce-4ab7-b1a2-10a6c181d6ab tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:07.861757 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-c5cc857d-dfce-4ab7-b1a2-10a6c181d6ab tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28575c19f44e4aa2b87f06719880de28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4962d2bd82fd4d59b4a50ecda9825236', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:07.892238 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-c5cc857d-dfce-4ab7-b1a2-10a6c181d6ab tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28575c19f44e4aa2b87f06719880de28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4962d2bd82fd4d59b4a50ecda9825236', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:07.897737 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-c5cc857d-dfce-4ab7-b1a2-10a6c181d6ab tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28575c19f44e4aa2b87f06719880de28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4962d2bd82fd4d59b4a50ecda9825236', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:07.904649 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-c5cc857d-dfce-4ab7-b1a2-10a6c181d6ab tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] 10.222.0.43 "GET /compute/v2.1/servers/485dd126-4ea5-4f31-b551-b653e649b2f7" status: 200 len: 1319 microversion: 2.21 time: 0.228550 Oct 04 18:41:07.938894 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1229/2600] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:41:07 2022] GET /compute/v2.1/servers/485dd126-4ea5-4f31-b551-b653e649b2f7 => generated 1319 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:41:08.633995 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-f83929d6-9030-412c-aa14-e539c852e205 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:08.635396 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-f83929d6-9030-412c-aa14-e539c852e205 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: 07ed4416-8fdc-4468-97bd-3fa1b039f77b] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:08.646265 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f83929d6-9030-412c-aa14-e539c852e205 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:08.650762 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f83929d6-9030-412c-aa14-e539c852e205 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:08.652153 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f83929d6-9030-412c-aa14-e539c852e205 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:08.655907 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f83929d6-9030-412c-aa14-e539c852e205 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:08.656415 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f83929d6-9030-412c-aa14-e539c852e205 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:08.659949 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f83929d6-9030-412c-aa14-e539c852e205 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:09.275092 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-f83929d6-9030-412c-aa14-e539c852e205 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:09.301834 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-f83929d6-9030-412c-aa14-e539c852e205 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/07ed4416-8fdc-4468-97bd-3fa1b039f77b" status: 200 len: 1462 microversion: 2.1 time: 0.659176 Oct 04 18:41:09.302720 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1230/2601] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:08 2022] GET /compute/v2.1/servers/07ed4416-8fdc-4468-97bd-3fa1b039f77b => generated 1462 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:41:09.319545 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-ae5c1376-2e58-4afb-b1f5-b41903bd9b42 tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:09.320446 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-ae5c1376-2e58-4afb-b1f5-b41903bd9b42 tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] [instance: 485dd126-4ea5-4f31-b551-b653e649b2f7] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:09.337638 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ae5c1376-2e58-4afb-b1f5-b41903bd9b42 tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:09.347571 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ae5c1376-2e58-4afb-b1f5-b41903bd9b42 tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:09.349746 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ae5c1376-2e58-4afb-b1f5-b41903bd9b42 tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:09.351941 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ae5c1376-2e58-4afb-b1f5-b41903bd9b42 tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:09.352678 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ae5c1376-2e58-4afb-b1f5-b41903bd9b42 tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:09.353281 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ae5c1376-2e58-4afb-b1f5-b41903bd9b42 tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:09.594031 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-ae5c1376-2e58-4afb-b1f5-b41903bd9b42 tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28575c19f44e4aa2b87f06719880de28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4962d2bd82fd4d59b4a50ecda9825236', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:09.608821 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-ae5c1376-2e58-4afb-b1f5-b41903bd9b42 tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28575c19f44e4aa2b87f06719880de28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4962d2bd82fd4d59b4a50ecda9825236', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:09.613026 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-ae5c1376-2e58-4afb-b1f5-b41903bd9b42 tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28575c19f44e4aa2b87f06719880de28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4962d2bd82fd4d59b4a50ecda9825236', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:09.615588 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-ae5c1376-2e58-4afb-b1f5-b41903bd9b42 tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] 10.222.0.43 "GET /compute/v2.1/servers/485dd126-4ea5-4f31-b551-b653e649b2f7" status: 200 len: 1317 microversion: 2.21 time: 0.310547 Oct 04 18:41:09.616199 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1231/2602] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:41:09 2022] GET /compute/v2.1/servers/485dd126-4ea5-4f31-b551-b653e649b2f7 => generated 1317 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:41:09.628047 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-8843ae8d-c28b-4f3f-905a-876400e13958 tempest-MigrationsAdminTest-1571334602 tempest-MigrationsAdminTest-1571334602-project-admin] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:09.629724 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-8843ae8d-c28b-4f3f-905a-876400e13958 tempest-MigrationsAdminTest-1571334602 tempest-MigrationsAdminTest-1571334602-project-admin] [instance: 07ed4416-8fdc-4468-97bd-3fa1b039f77b] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:09.644325 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8843ae8d-c28b-4f3f-905a-876400e13958 tempest-MigrationsAdminTest-1571334602 tempest-MigrationsAdminTest-1571334602-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:09.648219 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8843ae8d-c28b-4f3f-905a-876400e13958 tempest-MigrationsAdminTest-1571334602 tempest-MigrationsAdminTest-1571334602-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:09.649423 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8843ae8d-c28b-4f3f-905a-876400e13958 tempest-MigrationsAdminTest-1571334602 tempest-MigrationsAdminTest-1571334602-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:09.651357 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8843ae8d-c28b-4f3f-905a-876400e13958 tempest-MigrationsAdminTest-1571334602 tempest-MigrationsAdminTest-1571334602-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:09.651869 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8843ae8d-c28b-4f3f-905a-876400e13958 tempest-MigrationsAdminTest-1571334602 tempest-MigrationsAdminTest-1571334602-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:09.652312 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8843ae8d-c28b-4f3f-905a-876400e13958 tempest-MigrationsAdminTest-1571334602 tempest-MigrationsAdminTest-1571334602-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:10.683365 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-8843ae8d-c28b-4f3f-905a-876400e13958 tempest-MigrationsAdminTest-1571334602 tempest-MigrationsAdminTest-1571334602-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/07ed4416-8fdc-4468-97bd-3fa1b039f77b" status: 200 len: 1615 microversion: 2.1 time: 1.064101 Oct 04 18:41:10.690782 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1232/2603] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:09 2022] GET /compute/v2.1/servers/07ed4416-8fdc-4468-97bd-3fa1b039f77b => generated 1615 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:41:10.696869 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-a31254d4-6161-47b6-8e6f-30876686cf84 tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:10.701556 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-a31254d4-6161-47b6-8e6f-30876686cf84 tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] [instance: 485dd126-4ea5-4f31-b551-b653e649b2f7] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:10.725777 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a31254d4-6161-47b6-8e6f-30876686cf84 tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:10.726216 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a31254d4-6161-47b6-8e6f-30876686cf84 tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:10.726663 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a31254d4-6161-47b6-8e6f-30876686cf84 tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:10.727395 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a31254d4-6161-47b6-8e6f-30876686cf84 tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:10.737515 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a31254d4-6161-47b6-8e6f-30876686cf84 tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:10.738056 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a31254d4-6161-47b6-8e6f-30876686cf84 tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:11.069194 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.network.neutron [None req-4766fcfd-9cb6-4bbc-9b7d-83c5f4421a5b tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] [instance: ffbbf357-494a-40e4-8943-3159707fc2e4] Building network info cache for instance {{(pid=123596) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 04 18:41:11.106290 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-a31254d4-6161-47b6-8e6f-30876686cf84 tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28575c19f44e4aa2b87f06719880de28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4962d2bd82fd4d59b4a50ecda9825236', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:11.119652 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-a31254d4-6161-47b6-8e6f-30876686cf84 tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28575c19f44e4aa2b87f06719880de28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4962d2bd82fd4d59b4a50ecda9825236', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:11.128093 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-a31254d4-6161-47b6-8e6f-30876686cf84 tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28575c19f44e4aa2b87f06719880de28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4962d2bd82fd4d59b4a50ecda9825236', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:11.129761 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-a31254d4-6161-47b6-8e6f-30876686cf84 tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] 10.222.0.43 "GET /compute/v2.1/servers/485dd126-4ea5-4f31-b551-b653e649b2f7" status: 200 len: 1359 microversion: 2.21 time: 0.437785 Oct 04 18:41:11.130489 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1233/2604] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:41:10 2022] GET /compute/v2.1/servers/485dd126-4ea5-4f31-b551-b653e649b2f7 => generated 1359 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:41:11.140934 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-b1537ffc-c71a-4f55-8ee5-67c6b59aaf91 tempest-MigrationsAdminTest-1571334602 tempest-MigrationsAdminTest-1571334602-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:41:11.144911 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-b1537ffc-c71a-4f55-8ee5-67c6b59aaf91 tempest-MigrationsAdminTest-1571334602 tempest-MigrationsAdminTest-1571334602-project-admin] [instance: 07ed4416-8fdc-4468-97bd-3fa1b039f77b] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:11.155518 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b1537ffc-c71a-4f55-8ee5-67c6b59aaf91 tempest-MigrationsAdminTest-1571334602 tempest-MigrationsAdminTest-1571334602-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:11.156434 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b1537ffc-c71a-4f55-8ee5-67c6b59aaf91 tempest-MigrationsAdminTest-1571334602 tempest-MigrationsAdminTest-1571334602-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:11.157166 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b1537ffc-c71a-4f55-8ee5-67c6b59aaf91 tempest-MigrationsAdminTest-1571334602 tempest-MigrationsAdminTest-1571334602-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:11.162574 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b1537ffc-c71a-4f55-8ee5-67c6b59aaf91 tempest-MigrationsAdminTest-1571334602 tempest-MigrationsAdminTest-1571334602-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:11.168520 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b1537ffc-c71a-4f55-8ee5-67c6b59aaf91 tempest-MigrationsAdminTest-1571334602 tempest-MigrationsAdminTest-1571334602-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:11.169491 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b1537ffc-c71a-4f55-8ee5-67c6b59aaf91 tempest-MigrationsAdminTest-1571334602 tempest-MigrationsAdminTest-1571334602-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:11.238490 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-b1537ffc-c71a-4f55-8ee5-67c6b59aaf91 tempest-MigrationsAdminTest-1571334602 tempest-MigrationsAdminTest-1571334602-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '1a7436d44aba4786b9faeaedd5763591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8fea69caf14ba4875edc783cd7025b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:11.239294 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-b1537ffc-c71a-4f55-8ee5-67c6b59aaf91 tempest-MigrationsAdminTest-1571334602 tempest-MigrationsAdminTest-1571334602-project-admin] [instance: 07ed4416-8fdc-4468-97bd-3fa1b039f77b] flavor_id is None. Assuming migration. {{(pid=123595) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 04 18:41:11.242411 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-b1537ffc-c71a-4f55-8ee5-67c6b59aaf91 tempest-MigrationsAdminTest-1571334602 tempest-MigrationsAdminTest-1571334602-project-admin] [instance: 07ed4416-8fdc-4468-97bd-3fa1b039f77b] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=123595) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 04 18:41:11.786713 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-b1537ffc-c71a-4f55-8ee5-67c6b59aaf91 tempest-MigrationsAdminTest-1571334602 tempest-MigrationsAdminTest-1571334602-project-admin] 10.222.0.43 "POST /compute/v2.1/servers/07ed4416-8fdc-4468-97bd-3fa1b039f77b/action" status: 202 len: 0 microversion: 2.1 time: 0.654306 Oct 04 18:41:11.787874 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1234/2605] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 18:41:11 2022] POST /compute/v2.1/servers/07ed4416-8fdc-4468-97bd-3fa1b039f77b/action => generated 0 bytes in 656 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:41:11.798424 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-85aa7ff0-935c-4245-b0d9-8233c5f308c4 req-5d9c5b17-fbf3-4b2e-a4fc-f7c12f36e2ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ffbbf357-494a-40e4-8943-3159707fc2e4", "tag": "61178b4f-ada9-4139-8cac-244778b3c3e5"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:41:11.825571 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-85aa7ff0-935c-4245-b0d9-8233c5f308c4 req-5d9c5b17-fbf3-4b2e-a4fc-f7c12f36e2ff service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:11.826054 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-85aa7ff0-935c-4245-b0d9-8233c5f308c4 req-5d9c5b17-fbf3-4b2e-a4fc-f7c12f36e2ff service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:11.826487 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-85aa7ff0-935c-4245-b0d9-8233c5f308c4 req-5d9c5b17-fbf3-4b2e-a4fc-f7c12f36e2ff service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:11.857135 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-85aa7ff0-935c-4245-b0d9-8233c5f308c4 req-5d9c5b17-fbf3-4b2e-a4fc-f7c12f36e2ff service nova] Creating event network-changed:61178b4f-ada9-4139-8cac-244778b3c3e5 for instance ffbbf357-494a-40e4-8943-3159707fc2e4 on n-h2-851028-13 Oct 04 18:41:11.865124 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-85aa7ff0-935c-4245-b0d9-8233c5f308c4 req-5d9c5b17-fbf3-4b2e-a4fc-f7c12f36e2ff service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074362 Oct 04 18:41:11.866389 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1235/2606] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:41:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:41:12.442124 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-b0527de3-cc10-42eb-94a1-9afe0a795c82 tempest-AbsoluteLimitsTestJSON-438808274 tempest-AbsoluteLimitsTestJSON-438808274-project] Calling method '.version_select at 0x7fb227e05310>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:12.460923 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b0527de3-cc10-42eb-94a1-9afe0a795c82 tempest-AbsoluteLimitsTestJSON-438808274 tempest-AbsoluteLimitsTestJSON-438808274-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:12.462226 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b0527de3-cc10-42eb-94a1-9afe0a795c82 tempest-AbsoluteLimitsTestJSON-438808274 tempest-AbsoluteLimitsTestJSON-438808274-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:12.473421 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b0527de3-cc10-42eb-94a1-9afe0a795c82 tempest-AbsoluteLimitsTestJSON-438808274 tempest-AbsoluteLimitsTestJSON-438808274-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:12.475143 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b0527de3-cc10-42eb-94a1-9afe0a795c82 tempest-AbsoluteLimitsTestJSON-438808274 tempest-AbsoluteLimitsTestJSON-438808274-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:12.475856 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b0527de3-cc10-42eb-94a1-9afe0a795c82 tempest-AbsoluteLimitsTestJSON-438808274 tempest-AbsoluteLimitsTestJSON-438808274-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:12.476539 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b0527de3-cc10-42eb-94a1-9afe0a795c82 tempest-AbsoluteLimitsTestJSON-438808274 tempest-AbsoluteLimitsTestJSON-438808274-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:12.509644 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-b0527de3-cc10-42eb-94a1-9afe0a795c82 tempest-AbsoluteLimitsTestJSON-438808274 tempest-AbsoluteLimitsTestJSON-438808274-project] 10.222.0.43 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.640162 Oct 04 18:41:12.512643 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1236/2607] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Oct 4 18:41:11 2022] GET /compute/v2.1/limits => generated 511 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:41:12.522360 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-c9b4d650-36eb-4428-b965-cdb4c28b265b tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:12.546599 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-c9b4d650-36eb-4428-b965-cdb4c28b265b tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: 07ed4416-8fdc-4468-97bd-3fa1b039f77b] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:12.562261 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:41:12.563952 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c9b4d650-36eb-4428-b965-cdb4c28b265b tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:12.574191 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c9b4d650-36eb-4428-b965-cdb4c28b265b tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:12.574874 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c9b4d650-36eb-4428-b965-cdb4c28b265b tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:12.575811 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c9b4d650-36eb-4428-b965-cdb4c28b265b tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:12.576474 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c9b4d650-36eb-4428-b965-cdb4c28b265b tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:12.577102 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c9b4d650-36eb-4428-b965-cdb4c28b265b tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:13.149025 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-c9b4d650-36eb-4428-b965-cdb4c28b265b tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:13.164257 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-c9b4d650-36eb-4428-b965-cdb4c28b265b tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/07ed4416-8fdc-4468-97bd-3fa1b039f77b" status: 200 len: 1471 microversion: 2.1 time: 0.647276 Oct 04 18:41:13.165299 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1237/2608] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:12 2022] GET /compute/v2.1/servers/07ed4416-8fdc-4468-97bd-3fa1b039f77b => generated 1471 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:41:13.184137 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-3b0d328a-9d15-486b-9208-731d9f96cb93 tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:13.185880 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-3b0d328a-9d15-486b-9208-731d9f96cb93 tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] [instance: 485dd126-4ea5-4f31-b551-b653e649b2f7] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:13.200694 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3b0d328a-9d15-486b-9208-731d9f96cb93 tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:13.201255 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3b0d328a-9d15-486b-9208-731d9f96cb93 tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:13.201699 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3b0d328a-9d15-486b-9208-731d9f96cb93 tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:13.202409 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3b0d328a-9d15-486b-9208-731d9f96cb93 tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:13.202860 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3b0d328a-9d15-486b-9208-731d9f96cb93 tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:13.203301 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3b0d328a-9d15-486b-9208-731d9f96cb93 tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:13.854895 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-3b0d328a-9d15-486b-9208-731d9f96cb93 tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28575c19f44e4aa2b87f06719880de28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4962d2bd82fd4d59b4a50ecda9825236', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:13.871123 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-3b0d328a-9d15-486b-9208-731d9f96cb93 tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28575c19f44e4aa2b87f06719880de28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4962d2bd82fd4d59b4a50ecda9825236', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:13.872897 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-3b0d328a-9d15-486b-9208-731d9f96cb93 tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28575c19f44e4aa2b87f06719880de28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4962d2bd82fd4d59b4a50ecda9825236', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:13.874267 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-3b0d328a-9d15-486b-9208-731d9f96cb93 tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] 10.222.0.43 "GET /compute/v2.1/servers/485dd126-4ea5-4f31-b551-b653e649b2f7" status: 200 len: 1359 microversion: 2.21 time: 0.707889 Oct 04 18:41:13.875035 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1238/2609] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:41:13 2022] GET /compute/v2.1/servers/485dd126-4ea5-4f31-b551-b653e649b2f7 => generated 1359 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:41:13.947534 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-6191812b-9095-4cd6-a5c2-52acfca5e251 req-9ba334ae-5269-4363-a64b-4b1197da3f30 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "485dd126-4ea5-4f31-b551-b653e649b2f7", "tag": "4b318cb1-08f5-4b86-b15f-3a082d42f7e5"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:41:13.967849 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-6191812b-9095-4cd6-a5c2-52acfca5e251 req-9ba334ae-5269-4363-a64b-4b1197da3f30 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:13.969229 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-6191812b-9095-4cd6-a5c2-52acfca5e251 req-9ba334ae-5269-4363-a64b-4b1197da3f30 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:13.969766 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-6191812b-9095-4cd6-a5c2-52acfca5e251 req-9ba334ae-5269-4363-a64b-4b1197da3f30 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:13.997735 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-6191812b-9095-4cd6-a5c2-52acfca5e251 req-9ba334ae-5269-4363-a64b-4b1197da3f30 service nova] Creating event network-changed:4b318cb1-08f5-4b86-b15f-3a082d42f7e5 for instance 485dd126-4ea5-4f31-b551-b653e649b2f7 on n-h1-851028-13 Oct 04 18:41:14.012152 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-6191812b-9095-4cd6-a5c2-52acfca5e251 req-9ba334ae-5269-4363-a64b-4b1197da3f30 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072942 Oct 04 18:41:14.013007 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1239/2610] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:41:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:41:14.191252 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-8ae0af6c-66b4-40d5-9dd6-508a5cf33e3e tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:14.193780 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-8ae0af6c-66b4-40d5-9dd6-508a5cf33e3e tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: 07ed4416-8fdc-4468-97bd-3fa1b039f77b] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:14.200327 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8ae0af6c-66b4-40d5-9dd6-508a5cf33e3e tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:14.201467 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8ae0af6c-66b4-40d5-9dd6-508a5cf33e3e tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:14.202156 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8ae0af6c-66b4-40d5-9dd6-508a5cf33e3e tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:14.203081 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8ae0af6c-66b4-40d5-9dd6-508a5cf33e3e tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:14.203745 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8ae0af6c-66b4-40d5-9dd6-508a5cf33e3e tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:14.204454 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8ae0af6c-66b4-40d5-9dd6-508a5cf33e3e tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:14.227609 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:41:14.235831 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.network.neutron [None req-4766fcfd-9cb6-4bbc-9b7d-83c5f4421a5b tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] [instance: ffbbf357-494a-40e4-8943-3159707fc2e4] Updating instance_info_cache with network_info: [{"id": "61178b4f-ada9-4139-8cac-244778b3c3e5", "address": "fa:16:3e:18:c7:3f", "network": {"id": "7e8bb2fc-4c1c-4c59-b4ef-ae5d797a32f8", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-138809301-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.8.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "75d562b670294a47b2171f4003be4cdb", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap61178b4f-ad", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=123596) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 04 18:41:14.263576 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4766fcfd-9cb6-4bbc-9b7d-83c5f4421a5b tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Releasing lock "refresh_cache-ffbbf357-494a-40e4-8943-3159707fc2e4" {{(pid=123596) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 04 18:41:14.267896 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-4766fcfd-9cb6-4bbc-9b7d-83c5f4421a5b tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] 10.222.0.43 "POST /compute/v2.1/servers/ffbbf357-494a-40e4-8943-3159707fc2e4/action" status: 202 len: 0 microversion: 2.1 time: 8.461039 Oct 04 18:41:14.268960 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1372/2611] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 18:41:05 2022] POST /compute/v2.1/servers/ffbbf357-494a-40e4-8943-3159707fc2e4/action => generated 0 bytes in 8466 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 04 18:41:14.293506 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-4d198cad-d03f-4417-a948-328da3f6bb11 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.8.166"}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:41:14.680746 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-4d198cad-d03f-4417-a948-328da3f6bb11 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] [instance: ffbbf357-494a-40e4-8943-3159707fc2e4] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:14.687486 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4d198cad-d03f-4417-a948-328da3f6bb11 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:14.688171 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4d198cad-d03f-4417-a948-328da3f6bb11 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:14.688610 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4d198cad-d03f-4417-a948-328da3f6bb11 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:14.693518 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4d198cad-d03f-4417-a948-328da3f6bb11 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:14.694077 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4d198cad-d03f-4417-a948-328da3f6bb11 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:14.694534 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4d198cad-d03f-4417-a948-328da3f6bb11 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:15.493803 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-8ae0af6c-66b4-40d5-9dd6-508a5cf33e3e tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:15.510122 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-8ae0af6c-66b4-40d5-9dd6-508a5cf33e3e tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/07ed4416-8fdc-4468-97bd-3fa1b039f77b" status: 200 len: 1471 microversion: 2.1 time: 1.322976 Oct 04 18:41:15.528018 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1240/2612] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:14 2022] GET /compute/v2.1/servers/07ed4416-8fdc-4468-97bd-3fa1b039f77b => generated 1471 bytes in 1341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:41:15.538278 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-e4bbd851-7089-47ec-a5c9-6fc45d173d90 tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:15.539480 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-e4bbd851-7089-47ec-a5c9-6fc45d173d90 tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] [instance: 485dd126-4ea5-4f31-b551-b653e649b2f7] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:15.549296 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e4bbd851-7089-47ec-a5c9-6fc45d173d90 tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:15.550041 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e4bbd851-7089-47ec-a5c9-6fc45d173d90 tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:15.550686 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e4bbd851-7089-47ec-a5c9-6fc45d173d90 tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:15.552047 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e4bbd851-7089-47ec-a5c9-6fc45d173d90 tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:15.553516 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e4bbd851-7089-47ec-a5c9-6fc45d173d90 tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:15.554146 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e4bbd851-7089-47ec-a5c9-6fc45d173d90 tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:16.207089 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4d198cad-d03f-4417-a948-328da3f6bb11 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Acquiring lock "refresh_cache-ffbbf357-494a-40e4-8943-3159707fc2e4" {{(pid=123596) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 04 18:41:16.208270 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4d198cad-d03f-4417-a948-328da3f6bb11 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Acquired lock "refresh_cache-ffbbf357-494a-40e4-8943-3159707fc2e4" {{(pid=123596) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 04 18:41:16.409980 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-e4bbd851-7089-47ec-a5c9-6fc45d173d90 tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28575c19f44e4aa2b87f06719880de28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4962d2bd82fd4d59b4a50ecda9825236', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:16.429719 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-e4bbd851-7089-47ec-a5c9-6fc45d173d90 tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28575c19f44e4aa2b87f06719880de28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4962d2bd82fd4d59b4a50ecda9825236', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:16.432625 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-e4bbd851-7089-47ec-a5c9-6fc45d173d90 tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28575c19f44e4aa2b87f06719880de28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4962d2bd82fd4d59b4a50ecda9825236', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:16.436972 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-e4bbd851-7089-47ec-a5c9-6fc45d173d90 tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] 10.222.0.43 "GET /compute/v2.1/servers/485dd126-4ea5-4f31-b551-b653e649b2f7" status: 200 len: 1359 microversion: 2.21 time: 0.906610 Oct 04 18:41:16.439928 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1241/2613] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:41:15 2022] GET /compute/v2.1/servers/485dd126-4ea5-4f31-b551-b653e649b2f7 => generated 1359 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:41:16.539562 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-0ca4de24-8997-43ef-a567-db5170e3dea8 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:16.541139 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-0ca4de24-8997-43ef-a567-db5170e3dea8 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: 07ed4416-8fdc-4468-97bd-3fa1b039f77b] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:16.550998 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0ca4de24-8997-43ef-a567-db5170e3dea8 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:16.555839 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0ca4de24-8997-43ef-a567-db5170e3dea8 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:16.556506 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0ca4de24-8997-43ef-a567-db5170e3dea8 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:16.561828 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0ca4de24-8997-43ef-a567-db5170e3dea8 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:16.562793 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0ca4de24-8997-43ef-a567-db5170e3dea8 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:16.563393 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0ca4de24-8997-43ef-a567-db5170e3dea8 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:17.607559 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-0ca4de24-8997-43ef-a567-db5170e3dea8 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:17.619831 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-0ca4de24-8997-43ef-a567-db5170e3dea8 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/07ed4416-8fdc-4468-97bd-3fa1b039f77b" status: 200 len: 1471 microversion: 2.1 time: 1.085214 Oct 04 18:41:17.623977 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1242/2614] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:16 2022] GET /compute/v2.1/servers/07ed4416-8fdc-4468-97bd-3fa1b039f77b => generated 1471 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:41:17.632762 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-ab959e90-87e2-4a36-99ed-1d682fc9c96e tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:17.633388 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-ab959e90-87e2-4a36-99ed-1d682fc9c96e tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] [instance: 485dd126-4ea5-4f31-b551-b653e649b2f7] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:17.647274 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ab959e90-87e2-4a36-99ed-1d682fc9c96e tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:17.648340 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ab959e90-87e2-4a36-99ed-1d682fc9c96e tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:17.649079 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ab959e90-87e2-4a36-99ed-1d682fc9c96e tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:17.650015 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ab959e90-87e2-4a36-99ed-1d682fc9c96e tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:17.650629 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ab959e90-87e2-4a36-99ed-1d682fc9c96e tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:17.651357 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ab959e90-87e2-4a36-99ed-1d682fc9c96e tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:18.205013 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.network.neutron [None req-4d198cad-d03f-4417-a948-328da3f6bb11 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] [instance: ffbbf357-494a-40e4-8943-3159707fc2e4] Building network info cache for instance {{(pid=123596) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 04 18:41:18.422613 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-ab959e90-87e2-4a36-99ed-1d682fc9c96e tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28575c19f44e4aa2b87f06719880de28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4962d2bd82fd4d59b4a50ecda9825236', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:18.433825 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-ab959e90-87e2-4a36-99ed-1d682fc9c96e tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28575c19f44e4aa2b87f06719880de28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4962d2bd82fd4d59b4a50ecda9825236', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:18.435303 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-ab959e90-87e2-4a36-99ed-1d682fc9c96e tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28575c19f44e4aa2b87f06719880de28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4962d2bd82fd4d59b4a50ecda9825236', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:18.436453 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-ab959e90-87e2-4a36-99ed-1d682fc9c96e tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] 10.222.0.43 "GET /compute/v2.1/servers/485dd126-4ea5-4f31-b551-b653e649b2f7" status: 200 len: 1359 microversion: 2.21 time: 0.811154 Oct 04 18:41:18.437052 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1243/2615] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:41:17 2022] GET /compute/v2.1/servers/485dd126-4ea5-4f31-b551-b653e649b2f7 => generated 1359 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:41:18.454268 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-155a3aa5-2ad9-46cd-97dc-fd01fed189d2 req-e7901cff-5327-475b-8c55-422ccaccdcee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ffbbf357-494a-40e4-8943-3159707fc2e4", "tag": "61178b4f-ada9-4139-8cac-244778b3c3e5"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:41:18.495272 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-155a3aa5-2ad9-46cd-97dc-fd01fed189d2 req-e7901cff-5327-475b-8c55-422ccaccdcee service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:18.495757 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-155a3aa5-2ad9-46cd-97dc-fd01fed189d2 req-e7901cff-5327-475b-8c55-422ccaccdcee service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:18.500874 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-155a3aa5-2ad9-46cd-97dc-fd01fed189d2 req-e7901cff-5327-475b-8c55-422ccaccdcee service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:18.539719 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-155a3aa5-2ad9-46cd-97dc-fd01fed189d2 req-e7901cff-5327-475b-8c55-422ccaccdcee service nova] Creating event network-changed:61178b4f-ada9-4139-8cac-244778b3c3e5 for instance ffbbf357-494a-40e4-8943-3159707fc2e4 on n-h2-851028-13 Oct 04 18:41:18.571149 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-155a3aa5-2ad9-46cd-97dc-fd01fed189d2 req-e7901cff-5327-475b-8c55-422ccaccdcee service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120536 Oct 04 18:41:18.571942 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1244/2616] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:41:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:41:18.654122 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-b4f0876a-5cbc-43a3-9c05-980695c99899 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:18.655576 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-b4f0876a-5cbc-43a3-9c05-980695c99899 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: 07ed4416-8fdc-4468-97bd-3fa1b039f77b] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:18.664461 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b4f0876a-5cbc-43a3-9c05-980695c99899 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:18.677445 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b4f0876a-5cbc-43a3-9c05-980695c99899 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:18.678190 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b4f0876a-5cbc-43a3-9c05-980695c99899 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:18.678967 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b4f0876a-5cbc-43a3-9c05-980695c99899 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:18.679445 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b4f0876a-5cbc-43a3-9c05-980695c99899 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:18.679899 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b4f0876a-5cbc-43a3-9c05-980695c99899 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:19.350954 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-b4f0876a-5cbc-43a3-9c05-980695c99899 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:19.366745 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-b4f0876a-5cbc-43a3-9c05-980695c99899 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/07ed4416-8fdc-4468-97bd-3fa1b039f77b" status: 200 len: 1476 microversion: 2.1 time: 0.716786 Oct 04 18:41:19.367344 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1245/2617] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:18 2022] GET /compute/v2.1/servers/07ed4416-8fdc-4468-97bd-3fa1b039f77b => generated 1476 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:41:19.464425 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-cb68bf58-3587-4b95-b6eb-96c47d3d6ddd tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:19.465331 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-cb68bf58-3587-4b95-b6eb-96c47d3d6ddd tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] [instance: 485dd126-4ea5-4f31-b551-b653e649b2f7] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:19.479993 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cb68bf58-3587-4b95-b6eb-96c47d3d6ddd tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:19.482941 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cb68bf58-3587-4b95-b6eb-96c47d3d6ddd tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:19.491989 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cb68bf58-3587-4b95-b6eb-96c47d3d6ddd tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:19.493864 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cb68bf58-3587-4b95-b6eb-96c47d3d6ddd tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:19.495510 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cb68bf58-3587-4b95-b6eb-96c47d3d6ddd tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:19.495971 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cb68bf58-3587-4b95-b6eb-96c47d3d6ddd tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:20.587876 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.network.neutron [None req-4d198cad-d03f-4417-a948-328da3f6bb11 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] [instance: ffbbf357-494a-40e4-8943-3159707fc2e4] Updating instance_info_cache with network_info: [{"id": "61178b4f-ada9-4139-8cac-244778b3c3e5", "address": "fa:16:3e:18:c7:3f", "network": {"id": "7e8bb2fc-4c1c-4c59-b4ef-ae5d797a32f8", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-138809301-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "75d562b670294a47b2171f4003be4cdb", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap61178b4f-ad", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=123596) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 04 18:41:20.608058 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4d198cad-d03f-4417-a948-328da3f6bb11 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Releasing lock "refresh_cache-ffbbf357-494a-40e4-8943-3159707fc2e4" {{(pid=123596) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 04 18:41:20.609455 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-4d198cad-d03f-4417-a948-328da3f6bb11 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] 10.222.0.43 "POST /compute/v2.1/servers/ffbbf357-494a-40e4-8943-3159707fc2e4/action" status: 202 len: 0 microversion: 2.1 time: 6.334186 Oct 04 18:41:20.610409 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1373/2618] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 18:41:14 2022] POST /compute/v2.1/servers/ffbbf357-494a-40e4-8943-3159707fc2e4/action => generated 0 bytes in 6336 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 04 18:41:20.617549 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-d1d30ee2-bba4-4245-bfe5-8e228a2ee302 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:20.619423 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-d1d30ee2-bba4-4245-bfe5-8e228a2ee302 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: 07ed4416-8fdc-4468-97bd-3fa1b039f77b] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:20.632960 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d1d30ee2-bba4-4245-bfe5-8e228a2ee302 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:20.635144 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d1d30ee2-bba4-4245-bfe5-8e228a2ee302 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:20.635839 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d1d30ee2-bba4-4245-bfe5-8e228a2ee302 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:20.643065 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d1d30ee2-bba4-4245-bfe5-8e228a2ee302 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:20.643946 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d1d30ee2-bba4-4245-bfe5-8e228a2ee302 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:20.644813 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d1d30ee2-bba4-4245-bfe5-8e228a2ee302 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:20.699409 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-cb68bf58-3587-4b95-b6eb-96c47d3d6ddd tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28575c19f44e4aa2b87f06719880de28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4962d2bd82fd4d59b4a50ecda9825236', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:20.724563 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-cb68bf58-3587-4b95-b6eb-96c47d3d6ddd tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28575c19f44e4aa2b87f06719880de28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4962d2bd82fd4d59b4a50ecda9825236', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:20.732420 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-cb68bf58-3587-4b95-b6eb-96c47d3d6ddd tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28575c19f44e4aa2b87f06719880de28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4962d2bd82fd4d59b4a50ecda9825236', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:20.741137 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-cb68bf58-3587-4b95-b6eb-96c47d3d6ddd tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] 10.222.0.43 "GET /compute/v2.1/servers/485dd126-4ea5-4f31-b551-b653e649b2f7" status: 200 len: 1359 microversion: 2.21 time: 1.278488 Oct 04 18:41:20.769886 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1246/2619] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:41:19 2022] GET /compute/v2.1/servers/485dd126-4ea5-4f31-b551-b653e649b2f7 => generated 1359 bytes in 1311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:41:20.788090 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-07024d55-1b5d-4f31-a208-80f20363e234 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Calling method '.version_select at 0x7fb21f785940>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:21.138690 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-d1d30ee2-bba4-4245-bfe5-8e228a2ee302 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:21.148062 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-d1d30ee2-bba4-4245-bfe5-8e228a2ee302 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/07ed4416-8fdc-4468-97bd-3fa1b039f77b" status: 200 len: 1476 microversion: 2.1 time: 0.536145 Oct 04 18:41:21.151319 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1374/2620] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:20 2022] GET /compute/v2.1/servers/07ed4416-8fdc-4468-97bd-3fa1b039f77b => generated 1476 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:41:21.771217 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-5b4653df-8d4f-41b1-8333-389ed7212e3a tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:21.771995 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-5b4653df-8d4f-41b1-8333-389ed7212e3a tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] [instance: 485dd126-4ea5-4f31-b551-b653e649b2f7] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:21.807122 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5b4653df-8d4f-41b1-8333-389ed7212e3a tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:21.812355 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5b4653df-8d4f-41b1-8333-389ed7212e3a tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:21.813667 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5b4653df-8d4f-41b1-8333-389ed7212e3a tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:21.824278 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5b4653df-8d4f-41b1-8333-389ed7212e3a tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:21.825165 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5b4653df-8d4f-41b1-8333-389ed7212e3a tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:21.827535 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5b4653df-8d4f-41b1-8333-389ed7212e3a tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:21.845996 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=3,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=2,nova_cell1:RELEASE=2 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:41:22.460421 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=12 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:41:22.486718 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=4 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:41:22.621558 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-5b4653df-8d4f-41b1-8333-389ed7212e3a tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28575c19f44e4aa2b87f06719880de28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4962d2bd82fd4d59b4a50ecda9825236', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:22.634805 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-5b4653df-8d4f-41b1-8333-389ed7212e3a tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28575c19f44e4aa2b87f06719880de28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4962d2bd82fd4d59b4a50ecda9825236', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:22.637284 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-5b4653df-8d4f-41b1-8333-389ed7212e3a tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28575c19f44e4aa2b87f06719880de28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4962d2bd82fd4d59b4a50ecda9825236', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:22.638948 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-5b4653df-8d4f-41b1-8333-389ed7212e3a tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] 10.222.0.43 "GET /compute/v2.1/servers/485dd126-4ea5-4f31-b551-b653e649b2f7" status: 200 len: 1359 microversion: 2.21 time: 0.873849 Oct 04 18:41:22.665064 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1375/2621] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:41:21 2022] GET /compute/v2.1/servers/485dd126-4ea5-4f31-b551-b653e649b2f7 => generated 1359 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:41:22.671026 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-0e825096-c766-4e8b-9b6c-a097dd06e0b2 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:22.672158 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-0e825096-c766-4e8b-9b6c-a097dd06e0b2 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: 07ed4416-8fdc-4468-97bd-3fa1b039f77b] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:22.681589 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:41:22.684513 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0e825096-c766-4e8b-9b6c-a097dd06e0b2 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:22.685354 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0e825096-c766-4e8b-9b6c-a097dd06e0b2 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:22.686136 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0e825096-c766-4e8b-9b6c-a097dd06e0b2 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:22.687110 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0e825096-c766-4e8b-9b6c-a097dd06e0b2 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:22.687788 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0e825096-c766-4e8b-9b6c-a097dd06e0b2 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:22.688463 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0e825096-c766-4e8b-9b6c-a097dd06e0b2 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:23.437206 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-0e825096-c766-4e8b-9b6c-a097dd06e0b2 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:23.453078 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-0e825096-c766-4e8b-9b6c-a097dd06e0b2 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/07ed4416-8fdc-4468-97bd-3fa1b039f77b" status: 200 len: 1476 microversion: 2.1 time: 0.784109 Oct 04 18:41:23.455017 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1376/2622] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:22 2022] GET /compute/v2.1/servers/07ed4416-8fdc-4468-97bd-3fa1b039f77b => generated 1476 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:41:23.655386 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-07024d55-1b5d-4f31-a208-80f20363e234 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] 10.222.0.43 "DELETE /compute/v2.1/os-floating-ips/2b585ddf-35d7-4c0e-8123-1f58ccee2289" status: 202 len: 0 microversion: 2.1 time: 2.882597 Oct 04 18:41:23.656068 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1247/2623] 10.222.0.43 () {58 vars in 1263 bytes} [Tue Oct 4 18:41:20 2022] DELETE /compute/v2.1/os-floating-ips/2b585ddf-35d7-4c0e-8123-1f58ccee2289 => generated 0 bytes in 2886 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:41:23.671762 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-59269c0f-8a99-4192-a3a6-e34d4c76724d tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Calling method '.version_select at 0x7fb21ef97e50>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:23.683568 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-8c300297-d61d-47d7-8304-6fc1a75aefb2 tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:23.684275 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-8c300297-d61d-47d7-8304-6fc1a75aefb2 tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] [instance: 485dd126-4ea5-4f31-b551-b653e649b2f7] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:23.737057 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8c300297-d61d-47d7-8304-6fc1a75aefb2 tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:23.742301 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8c300297-d61d-47d7-8304-6fc1a75aefb2 tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:23.742769 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8c300297-d61d-47d7-8304-6fc1a75aefb2 tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:23.743529 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8c300297-d61d-47d7-8304-6fc1a75aefb2 tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:23.744023 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8c300297-d61d-47d7-8304-6fc1a75aefb2 tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:23.745439 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8c300297-d61d-47d7-8304-6fc1a75aefb2 tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:25.014535 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-8c300297-d61d-47d7-8304-6fc1a75aefb2 tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28575c19f44e4aa2b87f06719880de28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4962d2bd82fd4d59b4a50ecda9825236', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:25.037336 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-8c300297-d61d-47d7-8304-6fc1a75aefb2 tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28575c19f44e4aa2b87f06719880de28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4962d2bd82fd4d59b4a50ecda9825236', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:25.038883 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-8c300297-d61d-47d7-8304-6fc1a75aefb2 tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28575c19f44e4aa2b87f06719880de28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4962d2bd82fd4d59b4a50ecda9825236', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:25.040073 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-8c300297-d61d-47d7-8304-6fc1a75aefb2 tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] 10.222.0.43 "GET /compute/v2.1/servers/485dd126-4ea5-4f31-b551-b653e649b2f7" status: 200 len: 1359 microversion: 2.21 time: 1.371832 Oct 04 18:41:25.047389 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1248/2624] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:41:23 2022] GET /compute/v2.1/servers/485dd126-4ea5-4f31-b551-b653e649b2f7 => generated 1359 bytes in 1381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:41:25.052980 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-81f26149-a57e-4064-8328-e4d95717e885 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:25.067553 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-81f26149-a57e-4064-8328-e4d95717e885 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: 07ed4416-8fdc-4468-97bd-3fa1b039f77b] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:25.095736 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-81f26149-a57e-4064-8328-e4d95717e885 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:25.096313 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-81f26149-a57e-4064-8328-e4d95717e885 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:25.096980 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-81f26149-a57e-4064-8328-e4d95717e885 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:25.097937 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-81f26149-a57e-4064-8328-e4d95717e885 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:25.099205 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-81f26149-a57e-4064-8328-e4d95717e885 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:25.100026 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-81f26149-a57e-4064-8328-e4d95717e885 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:25.120379 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-59269c0f-8a99-4192-a3a6-e34d4c76724d tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] 10.222.0.43 "DELETE /compute/v2.1/os-security-groups/baf30a83-da7c-4c41-8763-1bd0e133c99d" status: 202 len: 0 microversion: 2.1 time: 1.457318 Oct 04 18:41:25.121606 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1377/2625] 10.222.0.43 () {58 vars in 1272 bytes} [Tue Oct 4 18:41:23 2022] DELETE /compute/v2.1/os-security-groups/baf30a83-da7c-4c41-8763-1bd0e133c99d => generated 0 bytes in 1461 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:41:25.130040 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-69fb871a-b60d-41eb-b000-c2d6742b0949 req-7bd8629a-409e-49bc-9f1f-09988579313f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "485dd126-4ea5-4f31-b551-b653e649b2f7", "name": "network-vif-plugged", "status": "completed", "tag": "4b318cb1-08f5-4b86-b15f-3a082d42f7e5"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:41:25.169712 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-69fb871a-b60d-41eb-b000-c2d6742b0949 req-7bd8629a-409e-49bc-9f1f-09988579313f service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:25.170143 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-69fb871a-b60d-41eb-b000-c2d6742b0949 req-7bd8629a-409e-49bc-9f1f-09988579313f service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:25.170574 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-69fb871a-b60d-41eb-b000-c2d6742b0949 req-7bd8629a-409e-49bc-9f1f-09988579313f service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:25.205805 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-69fb871a-b60d-41eb-b000-c2d6742b0949 req-7bd8629a-409e-49bc-9f1f-09988579313f service nova] Creating event network-vif-plugged:4b318cb1-08f5-4b86-b15f-3a082d42f7e5 for instance 485dd126-4ea5-4f31-b551-b653e649b2f7 on n-h1-851028-13 Oct 04 18:41:25.220745 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-69fb871a-b60d-41eb-b000-c2d6742b0949 req-7bd8629a-409e-49bc-9f1f-09988579313f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097391 Oct 04 18:41:25.222047 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1378/2626] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:41:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:41:25.232418 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-a6546eff-ca20-4992-acf8-9494f3b95304 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:25.233347 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-a6546eff-ca20-4992-acf8-9494f3b95304 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] [instance: ffbbf357-494a-40e4-8943-3159707fc2e4] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:25.250963 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a6546eff-ca20-4992-acf8-9494f3b95304 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:25.253089 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a6546eff-ca20-4992-acf8-9494f3b95304 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:25.258904 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a6546eff-ca20-4992-acf8-9494f3b95304 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:25.261786 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a6546eff-ca20-4992-acf8-9494f3b95304 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:25.262279 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a6546eff-ca20-4992-acf8-9494f3b95304 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:25.265099 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a6546eff-ca20-4992-acf8-9494f3b95304 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:25.343311 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-a6546eff-ca20-4992-acf8-9494f3b95304 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] [instance: ffbbf357-494a-40e4-8943-3159707fc2e4] Going to try to terminate instance {{(pid=123596) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:41:25.645643 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-a6546eff-ca20-4992-acf8-9494f3b95304 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] 10.222.0.43 "DELETE /compute/v2.1/servers/ffbbf357-494a-40e4-8943-3159707fc2e4" status: 204 len: 0 microversion: 2.1 time: 0.421759 Oct 04 18:41:25.648469 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1379/2627] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 18:41:25 2022] DELETE /compute/v2.1/servers/ffbbf357-494a-40e4-8943-3159707fc2e4 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:41:25.678341 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-b68ecaf8-ec70-47c9-b4a6-6229d1e32074 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:25.679187 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-b68ecaf8-ec70-47c9-b4a6-6229d1e32074 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] [instance: ffbbf357-494a-40e4-8943-3159707fc2e4] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:25.693742 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b68ecaf8-ec70-47c9-b4a6-6229d1e32074 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:25.694257 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b68ecaf8-ec70-47c9-b4a6-6229d1e32074 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:25.694728 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b68ecaf8-ec70-47c9-b4a6-6229d1e32074 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:25.695525 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b68ecaf8-ec70-47c9-b4a6-6229d1e32074 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:25.695960 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b68ecaf8-ec70-47c9-b4a6-6229d1e32074 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:25.705771 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b68ecaf8-ec70-47c9-b4a6-6229d1e32074 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:26.264456 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-b68ecaf8-ec70-47c9-b4a6-6229d1e32074 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15432d1b74334e1188866004384befe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d562b670294a47b2171f4003be4cdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:26.290674 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-b68ecaf8-ec70-47c9-b4a6-6229d1e32074 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] 10.222.0.43 "GET /compute/v2.1/servers/ffbbf357-494a-40e4-8943-3159707fc2e4" status: 200 len: 1510 microversion: 2.1 time: 0.627092 Oct 04 18:41:26.290674 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1380/2628] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:25 2022] GET /compute/v2.1/servers/ffbbf357-494a-40e4-8943-3159707fc2e4 => generated 1510 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:41:26.320336 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-8b59714d-ccc5-41e5-80fd-049c9052bb84 tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:26.322069 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-8b59714d-ccc5-41e5-80fd-049c9052bb84 tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] [instance: 485dd126-4ea5-4f31-b551-b653e649b2f7] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:26.342679 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8b59714d-ccc5-41e5-80fd-049c9052bb84 tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:26.343459 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8b59714d-ccc5-41e5-80fd-049c9052bb84 tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:26.344782 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8b59714d-ccc5-41e5-80fd-049c9052bb84 tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:26.346854 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8b59714d-ccc5-41e5-80fd-049c9052bb84 tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:26.350237 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8b59714d-ccc5-41e5-80fd-049c9052bb84 tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:26.350970 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8b59714d-ccc5-41e5-80fd-049c9052bb84 tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:26.449200 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-81f26149-a57e-4064-8328-e4d95717e885 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:26.458980 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-81f26149-a57e-4064-8328-e4d95717e885 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/07ed4416-8fdc-4468-97bd-3fa1b039f77b" status: 200 len: 1476 microversion: 2.1 time: 1.410198 Oct 04 18:41:26.474128 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1249/2629] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:25 2022] GET /compute/v2.1/servers/07ed4416-8fdc-4468-97bd-3fa1b039f77b => generated 1476 bytes in 1426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:41:27.087138 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-8b59714d-ccc5-41e5-80fd-049c9052bb84 tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28575c19f44e4aa2b87f06719880de28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4962d2bd82fd4d59b4a50ecda9825236', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:27.107934 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-8b59714d-ccc5-41e5-80fd-049c9052bb84 tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28575c19f44e4aa2b87f06719880de28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4962d2bd82fd4d59b4a50ecda9825236', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:27.109816 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-8b59714d-ccc5-41e5-80fd-049c9052bb84 tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28575c19f44e4aa2b87f06719880de28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4962d2bd82fd4d59b4a50ecda9825236', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:27.111073 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-8b59714d-ccc5-41e5-80fd-049c9052bb84 tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] 10.222.0.43 "GET /compute/v2.1/servers/485dd126-4ea5-4f31-b551-b653e649b2f7" status: 200 len: 1359 microversion: 2.21 time: 0.820209 Oct 04 18:41:27.111655 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1381/2630] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:41:26 2022] GET /compute/v2.1/servers/485dd126-4ea5-4f31-b551-b653e649b2f7 => generated 1359 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:41:27.316316 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-cdc30839-210c-4fe1-b3b2-6232d45d7b60 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:27.316937 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-cdc30839-210c-4fe1-b3b2-6232d45d7b60 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] [instance: ffbbf357-494a-40e4-8943-3159707fc2e4] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:27.362355 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cdc30839-210c-4fe1-b3b2-6232d45d7b60 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:27.363598 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cdc30839-210c-4fe1-b3b2-6232d45d7b60 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:27.364875 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cdc30839-210c-4fe1-b3b2-6232d45d7b60 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:27.373204 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cdc30839-210c-4fe1-b3b2-6232d45d7b60 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:27.384896 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cdc30839-210c-4fe1-b3b2-6232d45d7b60 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:27.386842 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cdc30839-210c-4fe1-b3b2-6232d45d7b60 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:27.487455 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-d15e998e-3cf0-4901-9161-df1b29b77adb tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:27.489514 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-d15e998e-3cf0-4901-9161-df1b29b77adb tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: 07ed4416-8fdc-4468-97bd-3fa1b039f77b] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:27.518150 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d15e998e-3cf0-4901-9161-df1b29b77adb tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:27.522867 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d15e998e-3cf0-4901-9161-df1b29b77adb tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:27.524201 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d15e998e-3cf0-4901-9161-df1b29b77adb tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:27.526601 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d15e998e-3cf0-4901-9161-df1b29b77adb tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:27.532437 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d15e998e-3cf0-4901-9161-df1b29b77adb tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:27.535072 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d15e998e-3cf0-4901-9161-df1b29b77adb tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:27.840467 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-cdc30839-210c-4fe1-b3b2-6232d45d7b60 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15432d1b74334e1188866004384befe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d562b670294a47b2171f4003be4cdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:27.855893 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-cdc30839-210c-4fe1-b3b2-6232d45d7b60 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] 10.222.0.43 "GET /compute/v2.1/servers/ffbbf357-494a-40e4-8943-3159707fc2e4" status: 200 len: 1510 microversion: 2.1 time: 0.544113 Oct 04 18:41:27.861838 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1250/2631] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:27 2022] GET /compute/v2.1/servers/ffbbf357-494a-40e4-8943-3159707fc2e4 => generated 1510 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:41:28.141728 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-8d1ef6de-df1b-4f7f-8aad-ae122fc49c8a tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:28.142786 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-8d1ef6de-df1b-4f7f-8aad-ae122fc49c8a tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] [instance: 485dd126-4ea5-4f31-b551-b653e649b2f7] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:28.169535 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8d1ef6de-df1b-4f7f-8aad-ae122fc49c8a tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:28.169535 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8d1ef6de-df1b-4f7f-8aad-ae122fc49c8a tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:28.169535 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8d1ef6de-df1b-4f7f-8aad-ae122fc49c8a tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:28.177925 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8d1ef6de-df1b-4f7f-8aad-ae122fc49c8a tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:28.178533 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8d1ef6de-df1b-4f7f-8aad-ae122fc49c8a tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:28.178998 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8d1ef6de-df1b-4f7f-8aad-ae122fc49c8a tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:28.823013 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-8d1ef6de-df1b-4f7f-8aad-ae122fc49c8a tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28575c19f44e4aa2b87f06719880de28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4962d2bd82fd4d59b4a50ecda9825236', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:28.845561 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-8d1ef6de-df1b-4f7f-8aad-ae122fc49c8a tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28575c19f44e4aa2b87f06719880de28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4962d2bd82fd4d59b4a50ecda9825236', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:28.851543 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-8d1ef6de-df1b-4f7f-8aad-ae122fc49c8a tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28575c19f44e4aa2b87f06719880de28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4962d2bd82fd4d59b4a50ecda9825236', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:28.856137 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-8d1ef6de-df1b-4f7f-8aad-ae122fc49c8a tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] 10.222.0.43 "GET /compute/v2.1/servers/485dd126-4ea5-4f31-b551-b653e649b2f7" status: 200 len: 1552 microversion: 2.21 time: 0.719836 Oct 04 18:41:28.856939 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1251/2632] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:41:28 2022] GET /compute/v2.1/servers/485dd126-4ea5-4f31-b551-b653e649b2f7 => generated 1552 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:41:29.250008 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-d15e998e-3cf0-4901-9161-df1b29b77adb tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:29.268895 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-d15e998e-3cf0-4901-9161-df1b29b77adb tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/07ed4416-8fdc-4468-97bd-3fa1b039f77b" status: 200 len: 1476 microversion: 2.1 time: 1.786150 Oct 04 18:41:29.273404 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1382/2633] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:27 2022] GET /compute/v2.1/servers/07ed4416-8fdc-4468-97bd-3fa1b039f77b => generated 1476 bytes in 1791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:41:29.285476 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-8c6b9497-4776-4b6d-a273-4c007f7cfc69 tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:29.289576 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-8c6b9497-4776-4b6d-a273-4c007f7cfc69 tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] [instance: 485dd126-4ea5-4f31-b551-b653e649b2f7] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:29.307656 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8c6b9497-4776-4b6d-a273-4c007f7cfc69 tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:29.308918 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8c6b9497-4776-4b6d-a273-4c007f7cfc69 tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:29.310740 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8c6b9497-4776-4b6d-a273-4c007f7cfc69 tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:29.311644 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8c6b9497-4776-4b6d-a273-4c007f7cfc69 tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:29.315172 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8c6b9497-4776-4b6d-a273-4c007f7cfc69 tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:29.315852 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8c6b9497-4776-4b6d-a273-4c007f7cfc69 tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:29.468401 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-8c6b9497-4776-4b6d-a273-4c007f7cfc69 tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] [instance: 485dd126-4ea5-4f31-b551-b653e649b2f7] Going to try to terminate instance {{(pid=123596) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:41:29.524605 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-9def3a4c-2184-4245-91f7-ff1f992d1f90 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Action: 'create', calling method: .version_select at 0x7fb21fb7a280>, body: {"keypair": {"name": "tempest-keypair-1249556403", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM6gcpBqkFMNwp69VyLMKH0VCd5CYauOsfV2GQg089/P77T7Ph9+d2sXmyOf6sWHfNxL86xt61rGRrGnQ85lpuU3DN6G1brU6mnqJ7oJA4nLuKcQWm2vDdPpWkDPLgRbzA=="}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:41:29.573233 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-9def3a4c-2184-4245-91f7-ff1f992d1f90 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Getting quotas for project b928ae7385da4599bbe0ea701681b233. Resources: {'key_pairs'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:41:29.597892 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-9def3a4c-2184-4245-91f7-ff1f992d1f90 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Getting quotas for user 93c36c0802f4473f96d0721caa50374a and project b928ae7385da4599bbe0ea701681b233. Resources: {'key_pairs'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:41:29.681263 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-9def3a4c-2184-4245-91f7-ff1f992d1f90 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.817977 Oct 04 18:41:29.691061 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1252/2634] 10.222.0.43 () {60 vars in 1159 bytes} [Tue Oct 4 18:41:28 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:41:29.703438 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-a6d5a731-cd62-4c58-97ca-176f32d5be79 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:29.708843 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-8c6b9497-4776-4b6d-a273-4c007f7cfc69 tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] 10.222.0.43 "DELETE /compute/v2.1/servers/485dd126-4ea5-4f31-b551-b653e649b2f7" status: 204 len: 0 microversion: 2.21 time: 0.433036 Oct 04 18:41:29.710162 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1383/2635] 10.222.0.43 () {60 vars in 1280 bytes} [Tue Oct 4 18:41:29 2022] DELETE /compute/v2.1/servers/485dd126-4ea5-4f31-b551-b653e649b2f7 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 18:41:29.716215 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-a6d5a731-cd62-4c58-97ca-176f32d5be79 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] [instance: ffbbf357-494a-40e4-8943-3159707fc2e4] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:29.723532 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-acc87c66-aaf4-4e2e-8292-2d73facbed4d tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:29.724769 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-acc87c66-aaf4-4e2e-8292-2d73facbed4d tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] [instance: 485dd126-4ea5-4f31-b551-b653e649b2f7] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:29.732065 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-acc87c66-aaf4-4e2e-8292-2d73facbed4d tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:29.734240 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-acc87c66-aaf4-4e2e-8292-2d73facbed4d tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:29.734909 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-acc87c66-aaf4-4e2e-8292-2d73facbed4d tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:29.735813 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-acc87c66-aaf4-4e2e-8292-2d73facbed4d tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:29.736454 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-acc87c66-aaf4-4e2e-8292-2d73facbed4d tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:29.737813 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-acc87c66-aaf4-4e2e-8292-2d73facbed4d tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:29.747684 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a6d5a731-cd62-4c58-97ca-176f32d5be79 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:29.748192 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a6d5a731-cd62-4c58-97ca-176f32d5be79 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:29.748633 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a6d5a731-cd62-4c58-97ca-176f32d5be79 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:29.755124 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a6d5a731-cd62-4c58-97ca-176f32d5be79 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:29.757177 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a6d5a731-cd62-4c58-97ca-176f32d5be79 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:29.759334 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a6d5a731-cd62-4c58-97ca-176f32d5be79 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:30.137806 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-a6d5a731-cd62-4c58-97ca-176f32d5be79 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15432d1b74334e1188866004384befe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d562b670294a47b2171f4003be4cdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:30.152117 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-a6d5a731-cd62-4c58-97ca-176f32d5be79 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] 10.222.0.43 "GET /compute/v2.1/servers/ffbbf357-494a-40e4-8943-3159707fc2e4" status: 200 len: 1510 microversion: 2.1 time: 0.459244 Oct 04 18:41:30.154914 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1253/2636] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:29 2022] GET /compute/v2.1/servers/ffbbf357-494a-40e4-8943-3159707fc2e4 => generated 1510 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:41:30.295202 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-1d784f65-2481-4a8a-b3c3-b63438aaa2a8 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:30.296065 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-1d784f65-2481-4a8a-b3c3-b63438aaa2a8 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: 07ed4416-8fdc-4468-97bd-3fa1b039f77b] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:30.303675 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1d784f65-2481-4a8a-b3c3-b63438aaa2a8 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:30.311867 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1d784f65-2481-4a8a-b3c3-b63438aaa2a8 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:30.312781 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1d784f65-2481-4a8a-b3c3-b63438aaa2a8 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:30.316125 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1d784f65-2481-4a8a-b3c3-b63438aaa2a8 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:30.321042 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1d784f65-2481-4a8a-b3c3-b63438aaa2a8 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:30.323216 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1d784f65-2481-4a8a-b3c3-b63438aaa2a8 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:30.691351 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-1d784f65-2481-4a8a-b3c3-b63438aaa2a8 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:30.704692 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-1d784f65-2481-4a8a-b3c3-b63438aaa2a8 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/07ed4416-8fdc-4468-97bd-3fa1b039f77b" status: 200 len: 1476 microversion: 2.1 time: 0.410715 Oct 04 18:41:30.705610 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1254/2637] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:30 2022] GET /compute/v2.1/servers/07ed4416-8fdc-4468-97bd-3fa1b039f77b => generated 1476 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:41:30.914865 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-acc87c66-aaf4-4e2e-8292-2d73facbed4d tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28575c19f44e4aa2b87f06719880de28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4962d2bd82fd4d59b4a50ecda9825236', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:30.925836 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-acc87c66-aaf4-4e2e-8292-2d73facbed4d tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28575c19f44e4aa2b87f06719880de28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4962d2bd82fd4d59b4a50ecda9825236', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:30.932333 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-acc87c66-aaf4-4e2e-8292-2d73facbed4d tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28575c19f44e4aa2b87f06719880de28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4962d2bd82fd4d59b4a50ecda9825236', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:30.935849 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-acc87c66-aaf4-4e2e-8292-2d73facbed4d tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] 10.222.0.43 "GET /compute/v2.1/servers/485dd126-4ea5-4f31-b551-b653e649b2f7" status: 200 len: 1558 microversion: 2.21 time: 1.219243 Oct 04 18:41:30.949816 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1384/2638] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:41:29 2022] GET /compute/v2.1/servers/485dd126-4ea5-4f31-b551-b653e649b2f7 => generated 1558 bytes in 1236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:41:31.182275 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-88653160-2034-4c17-964b-a8f030445317 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:31.183521 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-88653160-2034-4c17-964b-a8f030445317 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] [instance: ffbbf357-494a-40e4-8943-3159707fc2e4] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:31.192858 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-88653160-2034-4c17-964b-a8f030445317 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:31.193381 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-88653160-2034-4c17-964b-a8f030445317 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:31.193882 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-88653160-2034-4c17-964b-a8f030445317 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:31.194618 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-88653160-2034-4c17-964b-a8f030445317 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:31.195070 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-88653160-2034-4c17-964b-a8f030445317 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:31.195499 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-88653160-2034-4c17-964b-a8f030445317 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:31.734396 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-901f3396-91df-4601-9ee6-48430c7f6ddd tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:31.735027 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-901f3396-91df-4601-9ee6-48430c7f6ddd tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: 07ed4416-8fdc-4468-97bd-3fa1b039f77b] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:31.752344 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-901f3396-91df-4601-9ee6-48430c7f6ddd tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:31.761351 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-901f3396-91df-4601-9ee6-48430c7f6ddd tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:31.762430 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-901f3396-91df-4601-9ee6-48430c7f6ddd tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:31.763660 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-901f3396-91df-4601-9ee6-48430c7f6ddd tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:31.764571 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-901f3396-91df-4601-9ee6-48430c7f6ddd tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:31.765287 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-901f3396-91df-4601-9ee6-48430c7f6ddd tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:31.850725 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-88653160-2034-4c17-964b-a8f030445317 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15432d1b74334e1188866004384befe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d562b670294a47b2171f4003be4cdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:31.890611 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-88653160-2034-4c17-964b-a8f030445317 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] 10.222.0.43 "GET /compute/v2.1/servers/ffbbf357-494a-40e4-8943-3159707fc2e4" status: 200 len: 1510 microversion: 2.1 time: 0.712937 Oct 04 18:41:31.897903 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1255/2639] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:31 2022] GET /compute/v2.1/servers/ffbbf357-494a-40e4-8943-3159707fc2e4 => generated 1510 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:41:31.970749 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-fb7bfc52-d30c-4b4a-b4fc-4187445c68d5 tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:31.971747 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-fb7bfc52-d30c-4b4a-b4fc-4187445c68d5 tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] [instance: 485dd126-4ea5-4f31-b551-b653e649b2f7] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:31.984328 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fb7bfc52-d30c-4b4a-b4fc-4187445c68d5 tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:31.988476 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fb7bfc52-d30c-4b4a-b4fc-4187445c68d5 tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:31.991029 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fb7bfc52-d30c-4b4a-b4fc-4187445c68d5 tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:31.992093 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fb7bfc52-d30c-4b4a-b4fc-4187445c68d5 tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:32.002315 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fb7bfc52-d30c-4b4a-b4fc-4187445c68d5 tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:32.002998 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fb7bfc52-d30c-4b4a-b4fc-4187445c68d5 tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:32.664492 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-fb7bfc52-d30c-4b4a-b4fc-4187445c68d5 tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28575c19f44e4aa2b87f06719880de28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4962d2bd82fd4d59b4a50ecda9825236', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:32.666827 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-901f3396-91df-4601-9ee6-48430c7f6ddd tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:32.683843 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-901f3396-91df-4601-9ee6-48430c7f6ddd tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/07ed4416-8fdc-4468-97bd-3fa1b039f77b" status: 200 len: 1476 microversion: 2.1 time: 0.955742 Oct 04 18:41:32.697210 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1385/2640] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:31 2022] GET /compute/v2.1/servers/07ed4416-8fdc-4468-97bd-3fa1b039f77b => generated 1476 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:41:32.697441 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-fb7bfc52-d30c-4b4a-b4fc-4187445c68d5 tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28575c19f44e4aa2b87f06719880de28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4962d2bd82fd4d59b4a50ecda9825236', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:32.697557 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-858ed5b6-bb2d-4796-bd08-42618ade9dd1 req-4bfcfd55-78e8-4d96-af8b-c10b750d2e42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffbbf357-494a-40e4-8943-3159707fc2e4", "name": "network-vif-deleted", "tag": "61178b4f-ada9-4139-8cac-244778b3c3e5"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:41:32.697698 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-fb7bfc52-d30c-4b4a-b4fc-4187445c68d5 tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28575c19f44e4aa2b87f06719880de28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4962d2bd82fd4d59b4a50ecda9825236', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:32.706124 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-fb7bfc52-d30c-4b4a-b4fc-4187445c68d5 tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] 10.222.0.43 "GET /compute/v2.1/servers/485dd126-4ea5-4f31-b551-b653e649b2f7" status: 200 len: 1558 microversion: 2.21 time: 0.739116 Oct 04 18:41:32.721232 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1256/2641] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:41:31 2022] GET /compute/v2.1/servers/485dd126-4ea5-4f31-b551-b653e649b2f7 => generated 1558 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:41:32.723191 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-858ed5b6-bb2d-4796-bd08-42618ade9dd1 req-4bfcfd55-78e8-4d96-af8b-c10b750d2e42 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:32.724196 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-858ed5b6-bb2d-4796-bd08-42618ade9dd1 req-4bfcfd55-78e8-4d96-af8b-c10b750d2e42 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:32.725246 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-858ed5b6-bb2d-4796-bd08-42618ade9dd1 req-4bfcfd55-78e8-4d96-af8b-c10b750d2e42 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:32.749436 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-858ed5b6-bb2d-4796-bd08-42618ade9dd1 req-4bfcfd55-78e8-4d96-af8b-c10b750d2e42 service nova] Creating event network-vif-deleted:61178b4f-ada9-4139-8cac-244778b3c3e5 for instance ffbbf357-494a-40e4-8943-3159707fc2e4 on n-h2-851028-13 Oct 04 18:41:32.771489 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-858ed5b6-bb2d-4796-bd08-42618ade9dd1 req-4bfcfd55-78e8-4d96-af8b-c10b750d2e42 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084991 Oct 04 18:41:32.772368 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1386/2642] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:41:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:41:32.934878 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-1ec4fe13-4e37-4b4d-a948-b111d63f6526 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:32.935761 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-1ec4fe13-4e37-4b4d-a948-b111d63f6526 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] [instance: ffbbf357-494a-40e4-8943-3159707fc2e4] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:32.950756 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1ec4fe13-4e37-4b4d-a948-b111d63f6526 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:32.952132 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1ec4fe13-4e37-4b4d-a948-b111d63f6526 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:32.954442 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1ec4fe13-4e37-4b4d-a948-b111d63f6526 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:32.957868 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1ec4fe13-4e37-4b4d-a948-b111d63f6526 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:32.958368 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1ec4fe13-4e37-4b4d-a948-b111d63f6526 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:32.962494 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1ec4fe13-4e37-4b4d-a948-b111d63f6526 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:33.009100 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-1ec4fe13-4e37-4b4d-a948-b111d63f6526 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] HTTP exception thrown: Instance ffbbf357-494a-40e4-8943-3159707fc2e4 could not be found. Oct 04 18:41:33.016896 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-1ec4fe13-4e37-4b4d-a948-b111d63f6526 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Request method failure captured: Oct 04 18:41:33.016896 n-d-851028-13 devstack@n-api.service[123595]: request: GET /compute/v2.1/servers/ffbbf357-494a-40e4-8943-3159707fc2e4 HTTP/1.1 Oct 04 18:41:33.016896 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 18:41:33.016896 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 18:41:33.016896 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 18:41:33.016896 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 0 Oct 04 18:41:33.016896 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 18:41:33.016896 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 18:41:33.016896 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 18:41:33.016896 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 18:41:33.016896 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPH4Bpv0zXCfuuUsHhybsZ2oJpvBBJYcK3cA9Vx8wn-_KE1mOcro-AtHTLHFHrb2SbKAwDS9-zAyNtJkt9scABEEuNqd6tXzLpHIAFzQ7LqYqxG_9bh7rv_sKSPxBJTmDJJtX7zZN-TOIgEmaFdD1rYBjX47WcTeVyMPX0-Fp70Fr1aE Oct 04 18:41:33.016896 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 18:41:33.016896 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 18:41:33.016896 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 18:41:33.016896 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 18:41:33.016896 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 18:41:33.016896 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 18:41:33.016896 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: 75d562b670294a47b2171f4003be4cdb Oct 04 18:41:33.016896 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-ServerRescueTestJSONUnderV235-2020725869 Oct 04 18:41:33.016896 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 18:41:33.016896 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 18:41:33.016896 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/75d562b670294a47b2171f4003be4cdb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_75d562b670294a47b2171f4003be4cdb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/75d562b670294a47b2171f4003be4cdb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/75d562b670294a47b2171f4003be4cdb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:41:33.016896 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-ServerRescueTestJSONUnderV235-2020725869 Oct 04 18:41:33.016896 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: 75d562b670294a47b2171f4003be4cdb Oct 04 18:41:33.016896 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-ServerRescueTestJSONUnderV235-2020725869 Oct 04 18:41:33.016896 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-ServerRescueTestJSONUnderV235-2020725869-project Oct 04 18:41:33.016896 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 18:41:33.016896 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 18:41:33.016896 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: 15432d1b74334e1188866004384befe3 Oct 04 18:41:33.016896 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-ServerRescueTestJSONUnderV235-2020725869-project Oct 04 18:41:33.016896 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 18:41:33.016896 n-d-851028-13 devstack@n-api.service[123595]: exception: Instance ffbbf357-494a-40e4-8943-3159707fc2e4 could not be found. Oct 04 18:41:33.016896 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': 'ffbbf357-494a-40e4-8943-3159707fc2e4'} Oct 04 18:41:33.016896 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:41:33.016896 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:41:33.016896 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:41:33.016896 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:41:33.016896 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:41:33.016896 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:41:33.016896 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:41:33.016896 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:41:33.016896 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:41:33.016896 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:41:33.016896 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ffbbf357-494a-40e4-8943-3159707fc2e4 could not be found. Oct 04 18:41:33.016896 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:41:33.016896 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:41:33.016896 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:41:33.016896 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:41:33.016896 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:41:33.016896 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:41:33.016896 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:41:33.016896 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:41:33.016896 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:41:33.016896 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:41:33.016896 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:41:33.016896 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:41:33.016896 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:41:33.016896 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:41:33.016896 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:41:33.016896 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:41:33.016896 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ffbbf357-494a-40e4-8943-3159707fc2e4 could not be found. Oct 04 18:41:33.016896 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:41:33.016896 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:41:33.021660 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:41:33.021660 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:41:33.021660 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:41:33.021660 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:41:33.021660 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:41:33.021660 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:41:33.021660 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ffbbf357-494a-40e4-8943-3159707fc2e4 could not be found. Oct 04 18:41:33.021660 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:41:33.024356 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-1ec4fe13-4e37-4b4d-a948-b111d63f6526 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] Returning 404 to user: Instance ffbbf357-494a-40e4-8943-3159707fc2e4 could not be found. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:41:33.027357 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-1ec4fe13-4e37-4b4d-a948-b111d63f6526 tempest-ServerRescueTestJSONUnderV235-2020725869 tempest-ServerRescueTestJSONUnderV235-2020725869-project] 10.222.0.43 "GET /compute/v2.1/servers/ffbbf357-494a-40e4-8943-3159707fc2e4" status: 404 len: 111 microversion: 2.1 time: 0.097353 Oct 04 18:41:33.029840 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1257/2643] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:32 2022] GET /compute/v2.1/servers/ffbbf357-494a-40e4-8943-3159707fc2e4 => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:41:33.713454 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-2a26b9af-996a-4a15-ab9b-da282ff331a3 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:33.714787 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-2a26b9af-996a-4a15-ab9b-da282ff331a3 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: 07ed4416-8fdc-4468-97bd-3fa1b039f77b] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:33.728268 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2a26b9af-996a-4a15-ab9b-da282ff331a3 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:33.732042 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2a26b9af-996a-4a15-ab9b-da282ff331a3 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:33.733203 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2a26b9af-996a-4a15-ab9b-da282ff331a3 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:33.734216 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2a26b9af-996a-4a15-ab9b-da282ff331a3 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:33.735070 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2a26b9af-996a-4a15-ab9b-da282ff331a3 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:33.738143 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2a26b9af-996a-4a15-ab9b-da282ff331a3 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:33.740367 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-878ab419-8bcc-4c38-aec9-18d02db659c9 tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:33.742093 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-878ab419-8bcc-4c38-aec9-18d02db659c9 tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] [instance: 485dd126-4ea5-4f31-b551-b653e649b2f7] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:33.759105 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-878ab419-8bcc-4c38-aec9-18d02db659c9 tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:33.761863 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-878ab419-8bcc-4c38-aec9-18d02db659c9 tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:33.764494 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-878ab419-8bcc-4c38-aec9-18d02db659c9 tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:33.770494 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-878ab419-8bcc-4c38-aec9-18d02db659c9 tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:33.771344 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-878ab419-8bcc-4c38-aec9-18d02db659c9 tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:33.772194 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-878ab419-8bcc-4c38-aec9-18d02db659c9 tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:33.914030 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-878ab419-8bcc-4c38-aec9-18d02db659c9 tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:33.915127 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-878ab419-8bcc-4c38-aec9-18d02db659c9 tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:33.916910 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-878ab419-8bcc-4c38-aec9-18d02db659c9 tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:33.917696 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.objects.instance [None req-878ab419-8bcc-4c38-aec9-18d02db659c9 tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Lazy-loading 'fault' on Instance uuid 485dd126-4ea5-4f31-b551-b653e649b2f7 {{(pid=123595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:41:34.061269 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-878ab419-8bcc-4c38-aec9-18d02db659c9 tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28575c19f44e4aa2b87f06719880de28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4962d2bd82fd4d59b4a50ecda9825236', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:34.075136 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-878ab419-8bcc-4c38-aec9-18d02db659c9 tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28575c19f44e4aa2b87f06719880de28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4962d2bd82fd4d59b4a50ecda9825236', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:34.077074 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-878ab419-8bcc-4c38-aec9-18d02db659c9 tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28575c19f44e4aa2b87f06719880de28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4962d2bd82fd4d59b4a50ecda9825236', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:34.086998 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-878ab419-8bcc-4c38-aec9-18d02db659c9 tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] 10.222.0.43 "GET /compute/v2.1/servers/485dd126-4ea5-4f31-b551-b653e649b2f7" status: 200 len: 1349 microversion: 2.21 time: 0.352756 Oct 04 18:41:34.088589 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1258/2644] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:41:33 2022] GET /compute/v2.1/servers/485dd126-4ea5-4f31-b551-b653e649b2f7 => generated 1349 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:41:34.138377 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-2a26b9af-996a-4a15-ab9b-da282ff331a3 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:34.149418 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-2a26b9af-996a-4a15-ab9b-da282ff331a3 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/07ed4416-8fdc-4468-97bd-3fa1b039f77b" status: 200 len: 1476 microversion: 2.1 time: 0.440667 Oct 04 18:41:34.165400 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1387/2645] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:33 2022] GET /compute/v2.1/servers/07ed4416-8fdc-4468-97bd-3fa1b039f77b => generated 1476 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:41:34.814629 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-b43b169b-de34-424e-b887-3a540b45c124 req-a336def8-9c96-438b-b115-d5bad533b778 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "485dd126-4ea5-4f31-b551-b653e649b2f7", "name": "network-vif-deleted", "tag": "4b318cb1-08f5-4b86-b15f-3a082d42f7e5"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:41:34.841405 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-b43b169b-de34-424e-b887-3a540b45c124 req-a336def8-9c96-438b-b115-d5bad533b778 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:34.843395 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-b43b169b-de34-424e-b887-3a540b45c124 req-a336def8-9c96-438b-b115-d5bad533b778 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:34.845700 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-b43b169b-de34-424e-b887-3a540b45c124 req-a336def8-9c96-438b-b115-d5bad533b778 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:34.878757 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-b43b169b-de34-424e-b887-3a540b45c124 req-a336def8-9c96-438b-b115-d5bad533b778 service nova] Creating event network-vif-deleted:4b318cb1-08f5-4b86-b15f-3a082d42f7e5 for instance 485dd126-4ea5-4f31-b551-b653e649b2f7 on n-h1-851028-13 Oct 04 18:41:34.896985 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-b43b169b-de34-424e-b887-3a540b45c124 req-a336def8-9c96-438b-b115-d5bad533b778 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086292 Oct 04 18:41:34.902331 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1259/2646] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:41:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:41:35.114572 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-d63e5453-61d9-4d77-846c-9bd1a69f6673 tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:35.115245 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-d63e5453-61d9-4d77-846c-9bd1a69f6673 tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] [instance: 485dd126-4ea5-4f31-b551-b653e649b2f7] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:35.128795 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d63e5453-61d9-4d77-846c-9bd1a69f6673 tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:35.130359 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d63e5453-61d9-4d77-846c-9bd1a69f6673 tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:35.137359 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d63e5453-61d9-4d77-846c-9bd1a69f6673 tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:35.138375 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d63e5453-61d9-4d77-846c-9bd1a69f6673 tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:35.143807 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d63e5453-61d9-4d77-846c-9bd1a69f6673 tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:35.144422 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d63e5453-61d9-4d77-846c-9bd1a69f6673 tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:35.175025 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-ec2007fb-cbf2-4b14-ad9b-374e747ae3cb tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:35.176164 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-ec2007fb-cbf2-4b14-ad9b-374e747ae3cb tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: 07ed4416-8fdc-4468-97bd-3fa1b039f77b] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:35.193728 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-d63e5453-61d9-4d77-846c-9bd1a69f6673 tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] HTTP exception thrown: Instance 485dd126-4ea5-4f31-b551-b653e649b2f7 could not be found. Oct 04 18:41:35.195453 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-d63e5453-61d9-4d77-846c-9bd1a69f6673 tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Request method failure captured: Oct 04 18:41:35.195453 n-d-851028-13 devstack@n-api.service[123596]: request: GET /compute/v2.1/servers/485dd126-4ea5-4f31-b551-b653e649b2f7 HTTP/1.1 Oct 04 18:41:35.195453 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:41:35.195453 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:41:35.195453 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:41:35.195453 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 18:41:35.195453 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:41:35.195453 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:41:35.195453 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:41:35.195453 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:41:35.195453 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPH48pCwaikQc5lzrlMVfERBPYBn_HQoo4dGPrqy82MLadz2tk1lRBHHbUHkY4vq3vBTSLmwMrfH6y2gzdaHjkCZ7y_Y04vtH8d8V27zMD8WCqKA9v2zyvm-I8hErzfmwtRoVWH-bKFdDOpbZR_B95-Qno_o4QSVVunXmH-T-TzYVSno Oct 04 18:41:35.195453 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:41:35.195453 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:41:35.195453 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:41:35.195453 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:41:35.195453 n-d-851028-13 devstack@n-api.service[123596]: X-Openstack-Nova-Api-Version: 2.21 Oct 04 18:41:35.195453 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:41:35.195453 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:41:35.195453 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: 4962d2bd82fd4d59b4a50ecda9825236 Oct 04 18:41:35.195453 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-InstanceActionsV221TestJSON-817792967 Oct 04 18:41:35.195453 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 18:41:35.195453 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 18:41:35.195453 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/4962d2bd82fd4d59b4a50ecda9825236"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_4962d2bd82fd4d59b4a50ecda9825236"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4962d2bd82fd4d59b4a50ecda9825236"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4962d2bd82fd4d59b4a50ecda9825236"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:41:35.195453 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-InstanceActionsV221TestJSON-817792967 Oct 04 18:41:35.195453 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: 4962d2bd82fd4d59b4a50ecda9825236 Oct 04 18:41:35.195453 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-817792967 Oct 04 18:41:35.195453 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-InstanceActionsV221TestJSON-817792967-project Oct 04 18:41:35.195453 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:41:35.195453 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:41:35.195453 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 28575c19f44e4aa2b87f06719880de28 Oct 04 18:41:35.195453 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-InstanceActionsV221TestJSON-817792967-project Oct 04 18:41:35.195453 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 18:41:35.195453 n-d-851028-13 devstack@n-api.service[123596]: exception: Instance 485dd126-4ea5-4f31-b551-b653e649b2f7 could not be found. Oct 04 18:41:35.195453 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': '485dd126-4ea5-4f31-b551-b653e649b2f7'} Oct 04 18:41:35.195453 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:41:35.195453 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:41:35.195453 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:41:35.195453 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:41:35.195453 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:41:35.195453 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:41:35.195453 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:41:35.195453 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:41:35.195453 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:41:35.195453 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:41:35.195453 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 485dd126-4ea5-4f31-b551-b653e649b2f7 could not be found. Oct 04 18:41:35.195453 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:41:35.195453 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:41:35.195453 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:41:35.195453 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:41:35.195453 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:41:35.195453 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:41:35.195453 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:41:35.195453 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:41:35.195453 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:41:35.195453 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:41:35.195453 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:41:35.195453 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:41:35.195453 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:41:35.195453 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:41:35.195453 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:41:35.195453 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:41:35.195453 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 485dd126-4ea5-4f31-b551-b653e649b2f7 could not be found. Oct 04 18:41:35.195453 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:41:35.195453 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:41:35.200240 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:41:35.200240 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:41:35.200240 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:41:35.200240 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:41:35.200240 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:41:35.200240 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:41:35.200240 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 485dd126-4ea5-4f31-b551-b653e649b2f7 could not be found. Oct 04 18:41:35.200240 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:41:35.200240 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-d63e5453-61d9-4d77-846c-9bd1a69f6673 tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Returning 404 to user: Instance 485dd126-4ea5-4f31-b551-b653e649b2f7 could not be found. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:41:35.200877 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ec2007fb-cbf2-4b14-ad9b-374e747ae3cb tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:35.200877 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ec2007fb-cbf2-4b14-ad9b-374e747ae3cb tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:35.204467 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ec2007fb-cbf2-4b14-ad9b-374e747ae3cb tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:35.206347 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ec2007fb-cbf2-4b14-ad9b-374e747ae3cb tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:35.211303 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ec2007fb-cbf2-4b14-ad9b-374e747ae3cb tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:35.213353 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ec2007fb-cbf2-4b14-ad9b-374e747ae3cb tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:35.250828 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-d63e5453-61d9-4d77-846c-9bd1a69f6673 tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] 10.222.0.43 "GET /compute/v2.1/servers/485dd126-4ea5-4f31-b551-b653e649b2f7" status: 404 len: 111 microversion: 2.21 time: 0.112444 Oct 04 18:41:35.250828 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1388/2647] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:41:35 2022] GET /compute/v2.1/servers/485dd126-4ea5-4f31-b551-b653e649b2f7 => generated 111 bytes in 141 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:41:35.287427 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-d7b441f4-0902-477a-97ea-19e691c90443 tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Calling method '.version_select at 0x7fb21edc5040>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:35.288219 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-d7b441f4-0902-477a-97ea-19e691c90443 tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] [instance: 485dd126-4ea5-4f31-b551-b653e649b2f7] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:35.321077 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d7b441f4-0902-477a-97ea-19e691c90443 tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:35.333349 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d7b441f4-0902-477a-97ea-19e691c90443 tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:35.333843 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d7b441f4-0902-477a-97ea-19e691c90443 tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:35.334426 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=100 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:41:35.336489 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d7b441f4-0902-477a-97ea-19e691c90443 tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:35.337049 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d7b441f4-0902-477a-97ea-19e691c90443 tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:35.343179 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d7b441f4-0902-477a-97ea-19e691c90443 tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:35.556314 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-d7b441f4-0902-477a-97ea-19e691c90443 tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] 10.222.0.43 "GET /compute/v2.1/servers/485dd126-4ea5-4f31-b551-b653e649b2f7/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.300304 Oct 04 18:41:35.558045 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1389/2648] 10.222.0.43 () {60 vars in 1337 bytes} [Tue Oct 4 18:41:35 2022] GET /compute/v2.1/servers/485dd126-4ea5-4f31-b551-b653e649b2f7/os-instance-actions => generated 611 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:41:36.277829 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-09982a10-4ab5-4d21-886f-4a5301ccd210 tempest-SecurityGroupsNegativeTestJSON-1814611902 tempest-SecurityGroupsNegativeTestJSON-1814611902-project] Calling method '.version_select at 0x7fb21ef66820>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:36.418071 n-d-851028-13 devstack@n-api.service[123596]: DEBUG neutronclient.v2_0.client [None req-09982a10-4ab5-4d21-886f-4a5301ccd210 tempest-SecurityGroupsNegativeTestJSON-1814611902 tempest-SecurityGroupsNegativeTestJSON-1814611902-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group f9c3fd6a-0053-4fc6-8a19-272824eac0f4 does not exist", "detail": ""}} {{(pid=123596) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 18:41:36.418992 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.network.security_group_api [None req-09982a10-4ab5-4d21-886f-4a5301ccd210 tempest-SecurityGroupsNegativeTestJSON-1814611902 tempest-SecurityGroupsNegativeTestJSON-1814611902-project] Neutron security group f9c3fd6a-0053-4fc6-8a19-272824eac0f4 not found {{(pid=123596) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 04 18:41:36.419620 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-09982a10-4ab5-4d21-886f-4a5301ccd210 tempest-SecurityGroupsNegativeTestJSON-1814611902 tempest-SecurityGroupsNegativeTestJSON-1814611902-project] HTTP exception thrown: Security group f9c3fd6a-0053-4fc6-8a19-272824eac0f4 does not exist Oct 04 18:41:36.419620 n-d-851028-13 devstack@n-api.service[123596]: Neutron server returns request_ids: ['req-9c271c9b-ec74-4008-bf80-030a9b7bdd06'] Oct 04 18:41:36.421672 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-09982a10-4ab5-4d21-886f-4a5301ccd210 tempest-SecurityGroupsNegativeTestJSON-1814611902 tempest-SecurityGroupsNegativeTestJSON-1814611902-project] Request method failure captured: Oct 04 18:41:36.421672 n-d-851028-13 devstack@n-api.service[123596]: request: DELETE /compute/v2.1/os-security-groups/f9c3fd6a-0053-4fc6-8a19-272824eac0f4 HTTP/1.1 Oct 04 18:41:36.421672 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:41:36.421672 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:41:36.421672 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:41:36.421672 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 18:41:36.421672 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:41:36.421672 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:41:36.421672 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:41:36.421672 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:41:36.421672 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPH5fJV4rL1r7qhqXUTO1XujE3LIO2LDKw7UqGWlY3lbTwFLpWwa_-Y4UhinLBteKr4bHiFS-8ByErmCdzQxXaR7UFcHKk-13ABkYCKDbzhqyvsnxSI9a7XRJVRKKhn6UdJNtbPXTu2-UfRHymYoDD5Z-UyTi7n5MH4FfethzL9cxGVo Oct 04 18:41:36.421672 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:41:36.421672 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:41:36.421672 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:41:36.421672 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:41:36.421672 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:41:36.421672 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:41:36.421672 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: 69029a6205734cc9910150d21887175a Oct 04 18:41:36.421672 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1814611902 Oct 04 18:41:36.421672 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 18:41:36.421672 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 18:41:36.421672 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/69029a6205734cc9910150d21887175a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_69029a6205734cc9910150d21887175a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/69029a6205734cc9910150d21887175a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/69029a6205734cc9910150d21887175a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:41:36.421672 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1814611902 Oct 04 18:41:36.421672 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: 69029a6205734cc9910150d21887175a Oct 04 18:41:36.421672 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1814611902 Oct 04 18:41:36.421672 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-SecurityGroupsNegativeTestJSON-1814611902-project Oct 04 18:41:36.421672 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:41:36.421672 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:41:36.421672 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 423a9cffa0404a3eb8c09fd32b505085 Oct 04 18:41:36.421672 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1814611902-project Oct 04 18:41:36.421672 n-d-851028-13 devstack@n-api.service[123596]: method: Oct 04 18:41:36.421672 n-d-851028-13 devstack@n-api.service[123596]: exception: Security group f9c3fd6a-0053-4fc6-8a19-272824eac0f4 does not exist Oct 04 18:41:36.421672 n-d-851028-13 devstack@n-api.service[123596]: Neutron server returns request_ids: ['req-9c271c9b-ec74-4008-bf80-030a9b7bdd06'] Oct 04 18:41:36.421672 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': 'f9c3fd6a-0053-4fc6-8a19-272824eac0f4'} Oct 04 18:41:36.421672 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:41:36.421672 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:41:36.421672 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 04 18:41:36.421672 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 04 18:41:36.421672 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:41:36.421672 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:41:36.421672 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 04 18:41:36.421672 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 04 18:41:36.421672 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:41:36.421672 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:41:36.421672 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 18:41:36.421672 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 18:41:36.421672 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:41:36.421672 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:41:36.421672 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 18:41:36.421672 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 18:41:36.421672 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:41:36.421672 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:41:36.421672 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 18:41:36.421672 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 18:41:36.421672 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:41:36.421672 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:41:36.421672 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 18:41:36.421672 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 18:41:36.421672 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 18:41:36.421672 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 18:41:36.421672 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group f9c3fd6a-0053-4fc6-8a19-272824eac0f4 does not exist Oct 04 18:41:36.425253 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9c271c9b-ec74-4008-bf80-030a9b7bdd06'] Oct 04 18:41:36.425253 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:41:36.425253 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:41:36.425253 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:41:36.425253 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:41:36.425253 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 04 18:41:36.425253 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 04 18:41:36.425253 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 04 18:41:36.425253 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 18:41:36.425253 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group f9c3fd6a-0053-4fc6-8a19-272824eac0f4 does not exist Oct 04 18:41:36.425253 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9c271c9b-ec74-4008-bf80-030a9b7bdd06'] Oct 04 18:41:36.425253 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:41:36.425253 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:41:36.425253 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:41:36.425253 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:41:36.425253 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:41:36.425253 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:41:36.425253 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:41:36.425253 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:41:36.425253 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:41:36.425253 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:41:36.425253 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:41:36.425253 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:41:36.425253 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 04 18:41:36.425253 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 04 18:41:36.425253 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group f9c3fd6a-0053-4fc6-8a19-272824eac0f4 does not exist Oct 04 18:41:36.425253 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9c271c9b-ec74-4008-bf80-030a9b7bdd06'] Oct 04 18:41:36.425253 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:41:36.425253 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:41:36.425253 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:41:36.425253 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:41:36.425253 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:41:36.425253 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:41:36.425253 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:41:36.425253 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:41:36.425253 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group f9c3fd6a-0053-4fc6-8a19-272824eac0f4 does not exist Oct 04 18:41:36.425253 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9c271c9b-ec74-4008-bf80-030a9b7bdd06'] Oct 04 18:41:36.425253 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:41:36.425253 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-09982a10-4ab5-4d21-886f-4a5301ccd210 tempest-SecurityGroupsNegativeTestJSON-1814611902 tempest-SecurityGroupsNegativeTestJSON-1814611902-project] Returning 404 to user: Security group f9c3fd6a-0053-4fc6-8a19-272824eac0f4 does not exist Oct 04 18:41:36.425253 n-d-851028-13 devstack@n-api.service[123596]: Neutron server returns request_ids: ['req-9c271c9b-ec74-4008-bf80-030a9b7bdd06'] {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:41:36.425253 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-09982a10-4ab5-4d21-886f-4a5301ccd210 tempest-SecurityGroupsNegativeTestJSON-1814611902 tempest-SecurityGroupsNegativeTestJSON-1814611902-project] 10.222.0.43 "DELETE /compute/v2.1/os-security-groups/f9c3fd6a-0053-4fc6-8a19-272824eac0f4" status: 404 len: 194 microversion: 2.1 time: 0.863950 Oct 04 18:41:36.425253 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1390/2649] 10.222.0.43 () {58 vars in 1272 bytes} [Tue Oct 4 18:41:35 2022] DELETE /compute/v2.1/os-security-groups/f9c3fd6a-0053-4fc6-8a19-272824eac0f4 => generated 194 bytes in 865 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:41:36.449544 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-2d0f87c0-4d85-4c47-aa28-3a55f456561b tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:36.450063 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-2d0f87c0-4d85-4c47-aa28-3a55f456561b tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] [instance: 485dd126-4ea5-4f31-b551-b653e649b2f7] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:36.470971 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2d0f87c0-4d85-4c47-aa28-3a55f456561b tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:36.471489 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2d0f87c0-4d85-4c47-aa28-3a55f456561b tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:36.471939 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2d0f87c0-4d85-4c47-aa28-3a55f456561b tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:36.472739 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2d0f87c0-4d85-4c47-aa28-3a55f456561b tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:36.486065 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2d0f87c0-4d85-4c47-aa28-3a55f456561b tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:36.486727 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2d0f87c0-4d85-4c47-aa28-3a55f456561b tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:36.545695 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-2d0f87c0-4d85-4c47-aa28-3a55f456561b tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] HTTP exception thrown: Instance 485dd126-4ea5-4f31-b551-b653e649b2f7 could not be found. Oct 04 18:41:36.553841 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-2d0f87c0-4d85-4c47-aa28-3a55f456561b tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Request method failure captured: Oct 04 18:41:36.553841 n-d-851028-13 devstack@n-api.service[123596]: request: DELETE /compute/v2.1/servers/485dd126-4ea5-4f31-b551-b653e649b2f7 HTTP/1.1 Oct 04 18:41:36.553841 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:41:36.553841 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:41:36.553841 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:41:36.553841 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 18:41:36.553841 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:41:36.553841 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:41:36.553841 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:41:36.553841 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:41:36.553841 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPH48pCwaikQc5lzrlMVfERBPYBn_HQoo4dGPrqy82MLadz2tk1lRBHHbUHkY4vq3vBTSLmwMrfH6y2gzdaHjkCZ7y_Y04vtH8d8V27zMD8WCqKA9v2zyvm-I8hErzfmwtRoVWH-bKFdDOpbZR_B95-Qno_o4QSVVunXmH-T-TzYVSno Oct 04 18:41:36.553841 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:41:36.553841 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:41:36.553841 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:41:36.553841 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:41:36.553841 n-d-851028-13 devstack@n-api.service[123596]: X-Openstack-Nova-Api-Version: 2.21 Oct 04 18:41:36.553841 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:41:36.553841 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:41:36.553841 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: 4962d2bd82fd4d59b4a50ecda9825236 Oct 04 18:41:36.553841 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-InstanceActionsV221TestJSON-817792967 Oct 04 18:41:36.553841 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 18:41:36.553841 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 18:41:36.553841 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/4962d2bd82fd4d59b4a50ecda9825236"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_4962d2bd82fd4d59b4a50ecda9825236"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4962d2bd82fd4d59b4a50ecda9825236"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4962d2bd82fd4d59b4a50ecda9825236"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:41:36.553841 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-InstanceActionsV221TestJSON-817792967 Oct 04 18:41:36.553841 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: 4962d2bd82fd4d59b4a50ecda9825236 Oct 04 18:41:36.553841 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-817792967 Oct 04 18:41:36.553841 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-InstanceActionsV221TestJSON-817792967-project Oct 04 18:41:36.553841 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:41:36.553841 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:41:36.553841 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 28575c19f44e4aa2b87f06719880de28 Oct 04 18:41:36.553841 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-InstanceActionsV221TestJSON-817792967-project Oct 04 18:41:36.553841 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 18:41:36.553841 n-d-851028-13 devstack@n-api.service[123596]: exception: Instance 485dd126-4ea5-4f31-b551-b653e649b2f7 could not be found. Oct 04 18:41:36.553841 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': '485dd126-4ea5-4f31-b551-b653e649b2f7'} Oct 04 18:41:36.553841 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:41:36.553841 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:41:36.553841 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:41:36.553841 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:41:36.553841 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:41:36.553841 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:41:36.553841 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:41:36.553841 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:41:36.553841 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:41:36.553841 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:41:36.553841 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 485dd126-4ea5-4f31-b551-b653e649b2f7 could not be found. Oct 04 18:41:36.553841 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:41:36.553841 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:41:36.553841 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:41:36.553841 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:41:36.553841 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:41:36.553841 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:41:36.553841 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:41:36.553841 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:41:36.553841 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:41:36.553841 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:41:36.553841 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:41:36.553841 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:41:36.553841 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:41:36.553841 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:41:36.553841 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:41:36.553841 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:41:36.553841 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:41:36.553841 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:41:36.558835 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 485dd126-4ea5-4f31-b551-b653e649b2f7 could not be found. Oct 04 18:41:36.558835 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:41:36.558835 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:41:36.558835 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:41:36.558835 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:41:36.558835 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:41:36.558835 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:41:36.558835 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:41:36.558835 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:41:36.558835 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 485dd126-4ea5-4f31-b551-b653e649b2f7 could not be found. Oct 04 18:41:36.558835 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:41:36.558835 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-2d0f87c0-4d85-4c47-aa28-3a55f456561b tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Returning 404 to user: Instance 485dd126-4ea5-4f31-b551-b653e649b2f7 could not be found. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:41:36.561202 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-2d0f87c0-4d85-4c47-aa28-3a55f456561b tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] 10.222.0.43 "DELETE /compute/v2.1/servers/485dd126-4ea5-4f31-b551-b653e649b2f7" status: 404 len: 111 microversion: 2.21 time: 0.130246 Oct 04 18:41:36.561883 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1391/2650] 10.222.0.43 () {60 vars in 1280 bytes} [Tue Oct 4 18:41:36 2022] DELETE /compute/v2.1/servers/485dd126-4ea5-4f31-b551-b653e649b2f7 => generated 111 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:41:36.573036 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-b2dbfe56-4963-4a16-96b9-05a571f9473c tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-64058410", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4c7a4f44-d147-4a8b-8217-07c763ce3b07"}], "security_groups": [{"name": "tempest-securitygroup--729673072"}], "key_name": "tempest-keypair-1249556403", "user_data": "}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:41:36.625585 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-ec2007fb-cbf2-4b14-ad9b-374e747ae3cb tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:36.642855 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-ec2007fb-cbf2-4b14-ad9b-374e747ae3cb tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/07ed4416-8fdc-4468-97bd-3fa1b039f77b" status: 200 len: 1476 microversion: 2.1 time: 1.468616 Oct 04 18:41:36.644077 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1260/2651] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:35 2022] GET /compute/v2.1/servers/07ed4416-8fdc-4468-97bd-3fa1b039f77b => generated 1476 bytes in 1476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:41:36.657492 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-24cb094f-cc01-457f-a199-281451260ff4 tempest-SecurityGroupsNegativeTestJSON-1814611902 tempest-SecurityGroupsNegativeTestJSON-1814611902-project] 10.222.0.43 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.011449 Oct 04 18:41:36.669449 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1261/2652] 10.222.0.43 () {58 vars in 1164 bytes} [Tue Oct 4 18:41:36 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 21 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 04 18:41:36.684253 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-f03958cc-2ca6-47de-adb1-5b04d260ccf8 tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:36.685834 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-f03958cc-2ca6-47de-adb1-5b04d260ccf8 tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] [instance: 485dd126-4ea5-4f31-b551-b653e649b2f7] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:36.700211 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f03958cc-2ca6-47de-adb1-5b04d260ccf8 tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:36.706278 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f03958cc-2ca6-47de-adb1-5b04d260ccf8 tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:36.707064 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f03958cc-2ca6-47de-adb1-5b04d260ccf8 tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:36.708238 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f03958cc-2ca6-47de-adb1-5b04d260ccf8 tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:36.708710 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f03958cc-2ca6-47de-adb1-5b04d260ccf8 tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:36.709359 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f03958cc-2ca6-47de-adb1-5b04d260ccf8 tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:36.759768 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-f03958cc-2ca6-47de-adb1-5b04d260ccf8 tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] HTTP exception thrown: Instance 485dd126-4ea5-4f31-b551-b653e649b2f7 could not be found. Oct 04 18:41:36.765322 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-f03958cc-2ca6-47de-adb1-5b04d260ccf8 tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Request method failure captured: Oct 04 18:41:36.765322 n-d-851028-13 devstack@n-api.service[123595]: request: GET /compute/v2.1/servers/485dd126-4ea5-4f31-b551-b653e649b2f7 HTTP/1.1 Oct 04 18:41:36.765322 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 18:41:36.765322 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 18:41:36.765322 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 18:41:36.765322 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 0 Oct 04 18:41:36.765322 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 18:41:36.765322 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 18:41:36.765322 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 18:41:36.765322 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 18:41:36.765322 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPH48pCwaikQc5lzrlMVfERBPYBn_HQoo4dGPrqy82MLadz2tk1lRBHHbUHkY4vq3vBTSLmwMrfH6y2gzdaHjkCZ7y_Y04vtH8d8V27zMD8WCqKA9v2zyvm-I8hErzfmwtRoVWH-bKFdDOpbZR_B95-Qno_o4QSVVunXmH-T-TzYVSno Oct 04 18:41:36.765322 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 18:41:36.765322 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 18:41:36.765322 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 18:41:36.765322 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 18:41:36.765322 n-d-851028-13 devstack@n-api.service[123595]: X-Openstack-Nova-Api-Version: 2.21 Oct 04 18:41:36.765322 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 18:41:36.765322 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 18:41:36.765322 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: 4962d2bd82fd4d59b4a50ecda9825236 Oct 04 18:41:36.765322 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-InstanceActionsV221TestJSON-817792967 Oct 04 18:41:36.765322 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 18:41:36.765322 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 18:41:36.765322 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/4962d2bd82fd4d59b4a50ecda9825236"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_4962d2bd82fd4d59b4a50ecda9825236"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4962d2bd82fd4d59b4a50ecda9825236"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4962d2bd82fd4d59b4a50ecda9825236"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:41:36.765322 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-InstanceActionsV221TestJSON-817792967 Oct 04 18:41:36.765322 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: 4962d2bd82fd4d59b4a50ecda9825236 Oct 04 18:41:36.765322 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-817792967 Oct 04 18:41:36.765322 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-InstanceActionsV221TestJSON-817792967-project Oct 04 18:41:36.765322 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 18:41:36.765322 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 18:41:36.765322 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: 28575c19f44e4aa2b87f06719880de28 Oct 04 18:41:36.765322 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-InstanceActionsV221TestJSON-817792967-project Oct 04 18:41:36.765322 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 18:41:36.765322 n-d-851028-13 devstack@n-api.service[123595]: exception: Instance 485dd126-4ea5-4f31-b551-b653e649b2f7 could not be found. Oct 04 18:41:36.765322 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': '485dd126-4ea5-4f31-b551-b653e649b2f7'} Oct 04 18:41:36.765322 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:41:36.765322 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:41:36.765322 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:41:36.765322 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:41:36.765322 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:41:36.765322 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:41:36.765322 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:41:36.765322 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:41:36.765322 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:41:36.765322 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:41:36.765322 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 485dd126-4ea5-4f31-b551-b653e649b2f7 could not be found. Oct 04 18:41:36.765322 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:41:36.765322 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:41:36.765322 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:41:36.765322 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:41:36.765322 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:41:36.765322 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:41:36.765322 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:41:36.765322 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:41:36.765322 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:41:36.765322 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:41:36.765322 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:41:36.765322 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:41:36.765322 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:41:36.765322 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:41:36.765322 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:41:36.765322 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:41:36.765322 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 485dd126-4ea5-4f31-b551-b653e649b2f7 could not be found. Oct 04 18:41:36.765322 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:41:36.765322 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:41:36.769172 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:41:36.769172 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:41:36.769172 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:41:36.769172 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:41:36.769172 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:41:36.769172 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:41:36.769172 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 485dd126-4ea5-4f31-b551-b653e649b2f7 could not be found. Oct 04 18:41:36.769172 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:41:36.773853 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-f03958cc-2ca6-47de-adb1-5b04d260ccf8 tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] Returning 404 to user: Instance 485dd126-4ea5-4f31-b551-b653e649b2f7 could not be found. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:41:36.775290 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-f03958cc-2ca6-47de-adb1-5b04d260ccf8 tempest-InstanceActionsV221TestJSON-817792967 tempest-InstanceActionsV221TestJSON-817792967-project] 10.222.0.43 "GET /compute/v2.1/servers/485dd126-4ea5-4f31-b551-b653e649b2f7" status: 404 len: 111 microversion: 2.21 time: 0.104703 Oct 04 18:41:36.778225 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1262/2653] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:41:36 2022] GET /compute/v2.1/servers/485dd126-4ea5-4f31-b551-b653e649b2f7 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:41:36.792282 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-3456a8c7-4be0-4ba0-98fe-7e4cb5de81d3 tempest-SecurityGroupsNegativeTestJSON-1814611902 tempest-SecurityGroupsNegativeTestJSON-1814611902-project] Calling method '.version_select at 0x7fb21f7b8040>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:36.857717 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.network.neutron [None req-b2dbfe56-4963-4a16-96b9-05a571f9473c tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] validate_networks() for [('4c7a4f44-d147-4a8b-8217-07c763ce3b07', None, None, None, None, None)] {{(pid=123596) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:41:38.275295 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-b2dbfe56-4963-4a16-96b9-05a571f9473c tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Flavor limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:41:38.275885 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-b2dbfe56-4963-4a16-96b9-05a571f9473c tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Image limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:41:38.276099 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-b2dbfe56-4963-4a16-96b9-05a571f9473c tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Flavor pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:41:38.276664 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-b2dbfe56-4963-4a16-96b9-05a571f9473c tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Image pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:41:38.277304 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-b2dbfe56-4963-4a16-96b9-05a571f9473c tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:41:38.298503 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b2dbfe56-4963-4a16-96b9-05a571f9473c tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:38.301705 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b2dbfe56-4963-4a16-96b9-05a571f9473c tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:38.302347 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b2dbfe56-4963-4a16-96b9-05a571f9473c tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:38.308406 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b2dbfe56-4963-4a16-96b9-05a571f9473c tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:38.309205 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b2dbfe56-4963-4a16-96b9-05a571f9473c tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:38.309900 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b2dbfe56-4963-4a16-96b9-05a571f9473c tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:38.356269 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-b2dbfe56-4963-4a16-96b9-05a571f9473c tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Getting quotas for project b928ae7385da4599bbe0ea701681b233. Resources: {'ram', 'cores', 'instances'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:41:38.369677 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-b2dbfe56-4963-4a16-96b9-05a571f9473c tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Getting quotas for user 93c36c0802f4473f96d0721caa50374a and project b928ae7385da4599bbe0ea701681b233. Resources: {'ram', 'cores', 'instances'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:41:38.400063 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-b2dbfe56-4963-4a16-96b9-05a571f9473c tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Going to run 1 instances... {{(pid=123596) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:41:38.402485 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-b2dbfe56-4963-4a16-96b9-05a571f9473c tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 82b86465-afb0-49ef-9932-1538010c1ae5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e8943ec5-4038-4d4b-b9b9-2415a79f5243',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123596) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:41:38.522912 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-b2dbfe56-4963-4a16-96b9-05a571f9473c tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.959870 Oct 04 18:41:38.527388 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1392/2654] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 18:41:36 2022] POST /compute/v2.1/servers => generated 408 bytes in 1965 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:41:38.540593 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-718c05b1-c689-4ad6-b185-eb8372047fdb tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:38.542724 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-718c05b1-c689-4ad6-b185-eb8372047fdb tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: 07ed4416-8fdc-4468-97bd-3fa1b039f77b] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:38.558983 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-718c05b1-c689-4ad6-b185-eb8372047fdb tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:38.559501 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-718c05b1-c689-4ad6-b185-eb8372047fdb tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:38.561321 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-718c05b1-c689-4ad6-b185-eb8372047fdb tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:38.576690 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-718c05b1-c689-4ad6-b185-eb8372047fdb tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:38.580037 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-718c05b1-c689-4ad6-b185-eb8372047fdb tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:38.581287 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-718c05b1-c689-4ad6-b185-eb8372047fdb tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:39.011418 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-718c05b1-c689-4ad6-b185-eb8372047fdb tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:39.014093 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:41:39.023219 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-718c05b1-c689-4ad6-b185-eb8372047fdb tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/07ed4416-8fdc-4468-97bd-3fa1b039f77b" status: 200 len: 1476 microversion: 2.1 time: 0.494499 Oct 04 18:41:39.035980 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1393/2655] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:38 2022] GET /compute/v2.1/servers/07ed4416-8fdc-4468-97bd-3fa1b039f77b => generated 1476 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:41:39.063771 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f230c41e-0386-477b-b148-8b5a0a39c63c tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:39.064550 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-f230c41e-0386-477b-b148-8b5a0a39c63c tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 82b86465-afb0-49ef-9932-1538010c1ae5] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:39.167387 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-f230c41e-0386-477b-b148-8b5a0a39c63c tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:39.176262 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-f230c41e-0386-477b-b148-8b5a0a39c63c tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5" status: 200 len: 1237 microversion: 2.1 time: 0.124416 Oct 04 18:41:39.177544 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1394/2656] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:39 2022] GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5 => generated 1237 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:41:39.632528 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=4 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:41:39.701024 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-3456a8c7-4be0-4ba0-98fe-7e4cb5de81d3 tempest-SecurityGroupsNegativeTestJSON-1814611902 tempest-SecurityGroupsNegativeTestJSON-1814611902-project] 10.222.0.43 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 2.921590 Oct 04 18:41:39.701781 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1263/2657] 10.222.0.43 () {58 vars in 1158 bytes} [Tue Oct 4 18:41:36 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 2923 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:41:39.720190 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-d23c58ef-5394-400b-81cd-629d919c2b14 tempest-SecurityGroupsNegativeTestJSON-1814611902 tempest-SecurityGroupsNegativeTestJSON-1814611902-project] Calling method '.version_select at 0x7fb21ef975e0>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:40.017722 n-d-851028-13 devstack@n-api.service[123596]: DEBUG neutronclient.v2_0.client [None req-d23c58ef-5394-400b-81cd-629d919c2b14 tempest-SecurityGroupsNegativeTestJSON-1814611902 tempest-SecurityGroupsNegativeTestJSON-1814611902-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=123596) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 18:41:40.019047 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-d23c58ef-5394-400b-81cd-629d919c2b14 tempest-SecurityGroupsNegativeTestJSON-1814611902 tempest-SecurityGroupsNegativeTestJSON-1814611902-project] HTTP exception thrown: Insufficient rights for removing default security group. Oct 04 18:41:40.019047 n-d-851028-13 devstack@n-api.service[123596]: Neutron server returns request_ids: ['req-09f90862-f549-4082-984a-f0c36ed68d6f'] Oct 04 18:41:40.023020 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-d23c58ef-5394-400b-81cd-629d919c2b14 tempest-SecurityGroupsNegativeTestJSON-1814611902 tempest-SecurityGroupsNegativeTestJSON-1814611902-project] Request method failure captured: Oct 04 18:41:40.023020 n-d-851028-13 devstack@n-api.service[123596]: request: DELETE /compute/v2.1/os-security-groups/1edf8e8a-493c-4927-b5b3-c0940986d519 HTTP/1.1 Oct 04 18:41:40.023020 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:41:40.023020 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:41:40.023020 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:41:40.023020 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 18:41:40.023020 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:41:40.023020 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:41:40.023020 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:41:40.023020 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:41:40.023020 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPH5fJV4rL1r7qhqXUTO1XujE3LIO2LDKw7UqGWlY3lbTwFLpWwa_-Y4UhinLBteKr4bHiFS-8ByErmCdzQxXaR7UFcHKk-13ABkYCKDbzhqyvsnxSI9a7XRJVRKKhn6UdJNtbPXTu2-UfRHymYoDD5Z-UyTi7n5MH4FfethzL9cxGVo Oct 04 18:41:40.023020 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:41:40.023020 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:41:40.023020 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:41:40.023020 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:41:40.023020 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:41:40.023020 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:41:40.023020 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: 69029a6205734cc9910150d21887175a Oct 04 18:41:40.023020 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1814611902 Oct 04 18:41:40.023020 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 18:41:40.023020 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 18:41:40.023020 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/69029a6205734cc9910150d21887175a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_69029a6205734cc9910150d21887175a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/69029a6205734cc9910150d21887175a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/69029a6205734cc9910150d21887175a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:41:40.023020 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1814611902 Oct 04 18:41:40.023020 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: 69029a6205734cc9910150d21887175a Oct 04 18:41:40.023020 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1814611902 Oct 04 18:41:40.023020 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-SecurityGroupsNegativeTestJSON-1814611902-project Oct 04 18:41:40.023020 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:41:40.023020 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:41:40.023020 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 423a9cffa0404a3eb8c09fd32b505085 Oct 04 18:41:40.023020 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1814611902-project Oct 04 18:41:40.023020 n-d-851028-13 devstack@n-api.service[123596]: method: Oct 04 18:41:40.023020 n-d-851028-13 devstack@n-api.service[123596]: exception: Insufficient rights for removing default security group. Oct 04 18:41:40.023020 n-d-851028-13 devstack@n-api.service[123596]: Neutron server returns request_ids: ['req-09f90862-f549-4082-984a-f0c36ed68d6f'] Oct 04 18:41:40.023020 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': '1edf8e8a-493c-4927-b5b3-c0940986d519'} Oct 04 18:41:40.023020 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:41:40.023020 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:41:40.023020 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 04 18:41:40.023020 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 04 18:41:40.023020 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:41:40.023020 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:41:40.023020 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 04 18:41:40.023020 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 04 18:41:40.023020 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:41:40.023020 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:41:40.023020 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 04 18:41:40.023020 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 04 18:41:40.023020 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:41:40.023020 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:41:40.023020 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 18:41:40.023020 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 18:41:40.023020 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:41:40.023020 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:41:40.023020 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 18:41:40.023020 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 18:41:40.023020 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:41:40.023020 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:41:40.023020 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 18:41:40.023020 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 18:41:40.023020 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 18:41:40.023020 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 18:41:40.023020 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Insufficient rights for removing default security group. Oct 04 18:41:40.027901 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-09f90862-f549-4082-984a-f0c36ed68d6f'] Oct 04 18:41:40.027901 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:41:40.027901 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:41:40.027901 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:41:40.027901 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:41:40.027901 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 04 18:41:40.027901 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 04 18:41:40.027901 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 04 18:41:40.027901 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 04 18:41:40.027901 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Insufficient rights for removing default security group. Oct 04 18:41:40.027901 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-09f90862-f549-4082-984a-f0c36ed68d6f'] Oct 04 18:41:40.027901 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:41:40.027901 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:41:40.027901 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:41:40.027901 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:41:40.027901 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:41:40.027901 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:41:40.027901 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:41:40.027901 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:41:40.027901 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:41:40.027901 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:41:40.027901 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:41:40.027901 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:41:40.027901 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 04 18:41:40.027901 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 04 18:41:40.027901 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Insufficient rights for removing default security group. Oct 04 18:41:40.027901 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-09f90862-f549-4082-984a-f0c36ed68d6f'] Oct 04 18:41:40.027901 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:41:40.027901 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:41:40.027901 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:41:40.027901 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:41:40.027901 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:41:40.027901 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:41:40.027901 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:41:40.027901 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:41:40.027901 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Insufficient rights for removing default security group. Oct 04 18:41:40.027901 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-09f90862-f549-4082-984a-f0c36ed68d6f'] Oct 04 18:41:40.027901 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:41:40.031624 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-d23c58ef-5394-400b-81cd-629d919c2b14 tempest-SecurityGroupsNegativeTestJSON-1814611902 tempest-SecurityGroupsNegativeTestJSON-1814611902-project] Returning 400 to user: Insufficient rights for removing default security group. Oct 04 18:41:40.031624 n-d-851028-13 devstack@n-api.service[123596]: Neutron server returns request_ids: ['req-09f90862-f549-4082-984a-f0c36ed68d6f'] {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:41:40.033337 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-d23c58ef-5394-400b-81cd-629d919c2b14 tempest-SecurityGroupsNegativeTestJSON-1814611902 tempest-SecurityGroupsNegativeTestJSON-1814611902-project] 10.222.0.43 "DELETE /compute/v2.1/os-security-groups/1edf8e8a-493c-4927-b5b3-c0940986d519" status: 400 len: 182 microversion: 2.1 time: 0.320791 Oct 04 18:41:40.034096 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1395/2658] 10.222.0.43 () {58 vars in 1272 bytes} [Tue Oct 4 18:41:39 2022] DELETE /compute/v2.1/os-security-groups/1edf8e8a-493c-4927-b5b3-c0940986d519 => generated 182 bytes in 323 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:41:40.046853 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-052b8052-1244-4043-a228-0663742db608 tempest-SecurityGroupsNegativeTestJSON-1814611902 tempest-SecurityGroupsNegativeTestJSON-1814611902-project] Calling method '.version_select at 0x7fb21f7e9a60>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:40.070643 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-622d5059-e3bf-4e33-918c-4dae01ac7ccc tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:40.071468 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-622d5059-e3bf-4e33-918c-4dae01ac7ccc tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: 07ed4416-8fdc-4468-97bd-3fa1b039f77b] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:40.088815 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-622d5059-e3bf-4e33-918c-4dae01ac7ccc tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:40.095620 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-622d5059-e3bf-4e33-918c-4dae01ac7ccc tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:40.096264 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-622d5059-e3bf-4e33-918c-4dae01ac7ccc tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:40.099285 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-622d5059-e3bf-4e33-918c-4dae01ac7ccc tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:40.100075 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-622d5059-e3bf-4e33-918c-4dae01ac7ccc tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:40.102023 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-622d5059-e3bf-4e33-918c-4dae01ac7ccc tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:40.428746 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-622d5059-e3bf-4e33-918c-4dae01ac7ccc tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:40.442347 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-622d5059-e3bf-4e33-918c-4dae01ac7ccc tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/07ed4416-8fdc-4468-97bd-3fa1b039f77b" status: 200 len: 1475 microversion: 2.1 time: 0.377786 Oct 04 18:41:40.459050 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1396/2659] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:40 2022] GET /compute/v2.1/servers/07ed4416-8fdc-4468-97bd-3fa1b039f77b => generated 1475 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:41:40.473390 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-faf9a00e-ef06-4051-a20c-16a2182d2a03 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:40.473953 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-faf9a00e-ef06-4051-a20c-16a2182d2a03 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 82b86465-afb0-49ef-9932-1538010c1ae5] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:40.483316 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-faf9a00e-ef06-4051-a20c-16a2182d2a03 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:40.489169 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-faf9a00e-ef06-4051-a20c-16a2182d2a03 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:40.494871 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-faf9a00e-ef06-4051-a20c-16a2182d2a03 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:40.495643 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-faf9a00e-ef06-4051-a20c-16a2182d2a03 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:40.496120 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-faf9a00e-ef06-4051-a20c-16a2182d2a03 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:40.496553 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-faf9a00e-ef06-4051-a20c-16a2182d2a03 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:40.658568 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-faf9a00e-ef06-4051-a20c-16a2182d2a03 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:40.671975 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-faf9a00e-ef06-4051-a20c-16a2182d2a03 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5" status: 200 len: 1289 microversion: 2.1 time: 0.210413 Oct 04 18:41:40.672904 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1397/2660] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:40 2022] GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5 => generated 1289 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:41:40.706623 n-d-851028-13 devstack@n-api.service[123595]: DEBUG neutronclient.v2_0.client [None req-052b8052-1244-4043-a228-0663742db608 tempest-SecurityGroupsNegativeTestJSON-1814611902 tempest-SecurityGroupsNegativeTestJSON-1814611902-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 2d45128e-24de-4296-94ce-c8b941610525 does not exist", "detail": ""}} {{(pid=123595) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 18:41:40.707659 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.network.security_group_api [None req-052b8052-1244-4043-a228-0663742db608 tempest-SecurityGroupsNegativeTestJSON-1814611902 tempest-SecurityGroupsNegativeTestJSON-1814611902-project] Neutron security group 2d45128e-24de-4296-94ce-c8b941610525 not found {{(pid=123595) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 04 18:41:40.707920 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-052b8052-1244-4043-a228-0663742db608 tempest-SecurityGroupsNegativeTestJSON-1814611902 tempest-SecurityGroupsNegativeTestJSON-1814611902-project] HTTP exception thrown: Security group 2d45128e-24de-4296-94ce-c8b941610525 does not exist Oct 04 18:41:40.707920 n-d-851028-13 devstack@n-api.service[123595]: Neutron server returns request_ids: ['req-0314bda4-46c9-4fac-8ba1-1de82bf675a2'] Oct 04 18:41:40.710232 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-052b8052-1244-4043-a228-0663742db608 tempest-SecurityGroupsNegativeTestJSON-1814611902 tempest-SecurityGroupsNegativeTestJSON-1814611902-project] Request method failure captured: Oct 04 18:41:40.710232 n-d-851028-13 devstack@n-api.service[123595]: request: GET /compute/v2.1/os-security-groups/2d45128e-24de-4296-94ce-c8b941610525 HTTP/1.1 Oct 04 18:41:40.710232 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 18:41:40.710232 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 18:41:40.710232 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 18:41:40.710232 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 0 Oct 04 18:41:40.710232 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 18:41:40.710232 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 18:41:40.710232 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 18:41:40.710232 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 18:41:40.710232 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPH5fJV4rL1r7qhqXUTO1XujE3LIO2LDKw7UqGWlY3lbTwFLpWwa_-Y4UhinLBteKr4bHiFS-8ByErmCdzQxXaR7UFcHKk-13ABkYCKDbzhqyvsnxSI9a7XRJVRKKhn6UdJNtbPXTu2-UfRHymYoDD5Z-UyTi7n5MH4FfethzL9cxGVo Oct 04 18:41:40.710232 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 18:41:40.710232 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 18:41:40.710232 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 18:41:40.710232 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 18:41:40.710232 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 18:41:40.710232 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 18:41:40.710232 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: 69029a6205734cc9910150d21887175a Oct 04 18:41:40.710232 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1814611902 Oct 04 18:41:40.710232 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 18:41:40.710232 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 18:41:40.710232 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/69029a6205734cc9910150d21887175a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_69029a6205734cc9910150d21887175a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/69029a6205734cc9910150d21887175a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/69029a6205734cc9910150d21887175a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:41:40.710232 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1814611902 Oct 04 18:41:40.710232 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: 69029a6205734cc9910150d21887175a Oct 04 18:41:40.710232 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1814611902 Oct 04 18:41:40.710232 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-SecurityGroupsNegativeTestJSON-1814611902-project Oct 04 18:41:40.710232 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 18:41:40.710232 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 18:41:40.710232 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: 423a9cffa0404a3eb8c09fd32b505085 Oct 04 18:41:40.710232 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1814611902-project Oct 04 18:41:40.710232 n-d-851028-13 devstack@n-api.service[123595]: method: Oct 04 18:41:40.710232 n-d-851028-13 devstack@n-api.service[123595]: exception: Security group 2d45128e-24de-4296-94ce-c8b941610525 does not exist Oct 04 18:41:40.710232 n-d-851028-13 devstack@n-api.service[123595]: Neutron server returns request_ids: ['req-0314bda4-46c9-4fac-8ba1-1de82bf675a2'] Oct 04 18:41:40.710232 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': '2d45128e-24de-4296-94ce-c8b941610525'} Oct 04 18:41:40.710232 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:41:40.710232 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:41:40.710232 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 04 18:41:40.710232 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 04 18:41:40.710232 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:41:40.710232 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:41:40.710232 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 04 18:41:40.710232 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 04 18:41:40.710232 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:41:40.710232 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:41:40.710232 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 18:41:40.710232 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 18:41:40.710232 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:41:40.710232 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:41:40.710232 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 18:41:40.710232 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 18:41:40.710232 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:41:40.710232 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:41:40.710232 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 18:41:40.710232 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 18:41:40.710232 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:41:40.710232 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:41:40.710232 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 18:41:40.710232 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 18:41:40.710232 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 18:41:40.710232 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 18:41:40.710232 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 2d45128e-24de-4296-94ce-c8b941610525 does not exist Oct 04 18:41:40.714790 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0314bda4-46c9-4fac-8ba1-1de82bf675a2'] Oct 04 18:41:40.714790 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:41:40.714790 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:41:40.714790 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:41:40.714790 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:41:40.714790 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 04 18:41:40.714790 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 04 18:41:40.714790 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 04 18:41:40.714790 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 18:41:40.714790 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 2d45128e-24de-4296-94ce-c8b941610525 does not exist Oct 04 18:41:40.714790 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0314bda4-46c9-4fac-8ba1-1de82bf675a2'] Oct 04 18:41:40.714790 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:41:40.714790 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:41:40.714790 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:41:40.714790 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:41:40.714790 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:41:40.714790 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:41:40.714790 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:41:40.714790 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:41:40.714790 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:41:40.714790 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:41:40.714790 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:41:40.714790 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:41:40.714790 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 04 18:41:40.714790 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 04 18:41:40.714790 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 2d45128e-24de-4296-94ce-c8b941610525 does not exist Oct 04 18:41:40.714790 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0314bda4-46c9-4fac-8ba1-1de82bf675a2'] Oct 04 18:41:40.714790 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:41:40.714790 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:41:40.714790 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:41:40.714790 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:41:40.714790 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:41:40.714790 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:41:40.714790 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:41:40.714790 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:41:40.714790 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 2d45128e-24de-4296-94ce-c8b941610525 does not exist Oct 04 18:41:40.714790 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0314bda4-46c9-4fac-8ba1-1de82bf675a2'] Oct 04 18:41:40.714790 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:41:40.714790 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-052b8052-1244-4043-a228-0663742db608 tempest-SecurityGroupsNegativeTestJSON-1814611902 tempest-SecurityGroupsNegativeTestJSON-1814611902-project] Returning 404 to user: Security group 2d45128e-24de-4296-94ce-c8b941610525 does not exist Oct 04 18:41:40.714790 n-d-851028-13 devstack@n-api.service[123595]: Neutron server returns request_ids: ['req-0314bda4-46c9-4fac-8ba1-1de82bf675a2'] {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:41:40.714790 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-052b8052-1244-4043-a228-0663742db608 tempest-SecurityGroupsNegativeTestJSON-1814611902 tempest-SecurityGroupsNegativeTestJSON-1814611902-project] 10.222.0.43 "GET /compute/v2.1/os-security-groups/2d45128e-24de-4296-94ce-c8b941610525" status: 404 len: 194 microversion: 2.1 time: 0.670380 Oct 04 18:41:40.714790 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1264/2661] 10.222.0.43 () {58 vars in 1269 bytes} [Tue Oct 4 18:41:40 2022] GET /compute/v2.1/os-security-groups/2d45128e-24de-4296-94ce-c8b941610525 => generated 194 bytes in 672 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:41:40.721665 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-c361409e-6c94-4e10-9e76-395d401df5f9 tempest-SecurityGroupsNegativeTestJSON-1814611902 tempest-SecurityGroupsNegativeTestJSON-1814611902-project] Action: 'update', calling method: .version_select at 0x7fb21edef550>, body: {"security_group": {"name": "tempest-sg-558783510", "description": "tempest-description-72950427"}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:41:40.816914 n-d-851028-13 devstack@n-api.service[123596]: DEBUG neutronclient.v2_0.client [None req-c361409e-6c94-4e10-9e76-395d401df5f9 tempest-SecurityGroupsNegativeTestJSON-1814611902 tempest-SecurityGroupsNegativeTestJSON-1814611902-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 25ea5693-8b07-4e31-b80f-f09fa09b3a53 does not exist", "detail": ""}} {{(pid=123596) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 18:41:40.817679 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.network.security_group_api [None req-c361409e-6c94-4e10-9e76-395d401df5f9 tempest-SecurityGroupsNegativeTestJSON-1814611902 tempest-SecurityGroupsNegativeTestJSON-1814611902-project] Neutron security group 25ea5693-8b07-4e31-b80f-f09fa09b3a53 not found {{(pid=123596) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 04 18:41:40.818227 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-c361409e-6c94-4e10-9e76-395d401df5f9 tempest-SecurityGroupsNegativeTestJSON-1814611902 tempest-SecurityGroupsNegativeTestJSON-1814611902-project] HTTP exception thrown: Security group 25ea5693-8b07-4e31-b80f-f09fa09b3a53 does not exist Oct 04 18:41:40.818227 n-d-851028-13 devstack@n-api.service[123596]: Neutron server returns request_ids: ['req-822f5331-535a-4c95-8f1b-088736cdcac4'] Oct 04 18:41:40.820706 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-c361409e-6c94-4e10-9e76-395d401df5f9 tempest-SecurityGroupsNegativeTestJSON-1814611902 tempest-SecurityGroupsNegativeTestJSON-1814611902-project] Request method failure captured: Oct 04 18:41:40.820706 n-d-851028-13 devstack@n-api.service[123596]: request: PUT /compute/v2.1/os-security-groups/25ea5693-8b07-4e31-b80f-f09fa09b3a53 HTTP/1.1 Oct 04 18:41:40.820706 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:41:40.820706 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:41:40.820706 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:41:40.820706 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 99 Oct 04 18:41:40.820706 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:41:40.820706 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:41:40.820706 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:41:40.820706 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:41:40.820706 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPH5fJV4rL1r7qhqXUTO1XujE3LIO2LDKw7UqGWlY3lbTwFLpWwa_-Y4UhinLBteKr4bHiFS-8ByErmCdzQxXaR7UFcHKk-13ABkYCKDbzhqyvsnxSI9a7XRJVRKKhn6UdJNtbPXTu2-UfRHymYoDD5Z-UyTi7n5MH4FfethzL9cxGVo Oct 04 18:41:40.820706 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:41:40.820706 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:41:40.820706 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:41:40.820706 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:41:40.820706 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:41:40.820706 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:41:40.820706 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: 69029a6205734cc9910150d21887175a Oct 04 18:41:40.820706 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1814611902 Oct 04 18:41:40.820706 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 18:41:40.820706 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 18:41:40.820706 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/69029a6205734cc9910150d21887175a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_69029a6205734cc9910150d21887175a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/69029a6205734cc9910150d21887175a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/69029a6205734cc9910150d21887175a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:41:40.820706 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1814611902 Oct 04 18:41:40.820706 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: 69029a6205734cc9910150d21887175a Oct 04 18:41:40.820706 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1814611902 Oct 04 18:41:40.820706 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-SecurityGroupsNegativeTestJSON-1814611902-project Oct 04 18:41:40.820706 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:41:40.820706 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:41:40.820706 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 423a9cffa0404a3eb8c09fd32b505085 Oct 04 18:41:40.820706 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1814611902-project Oct 04 18:41:40.820706 n-d-851028-13 devstack@n-api.service[123596]: Oct 04 18:41:40.820706 n-d-851028-13 devstack@n-api.service[123596]: {"security_group": {"name": "tempest-sg-558783510", "description": "tempest-description-72950427"}} Oct 04 18:41:40.820706 n-d-851028-13 devstack@n-api.service[123596]: method: Oct 04 18:41:40.820706 n-d-851028-13 devstack@n-api.service[123596]: exception: Security group 25ea5693-8b07-4e31-b80f-f09fa09b3a53 does not exist Oct 04 18:41:40.820706 n-d-851028-13 devstack@n-api.service[123596]: Neutron server returns request_ids: ['req-822f5331-535a-4c95-8f1b-088736cdcac4'] Oct 04 18:41:40.820706 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': '25ea5693-8b07-4e31-b80f-f09fa09b3a53', 'body': {'security_group': {'name': 'tempest-sg-558783510', 'description': 'tempest-description-72950427'}}} Oct 04 18:41:40.820706 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:41:40.820706 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:41:40.820706 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 04 18:41:40.820706 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 04 18:41:40.820706 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:41:40.820706 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:41:40.820706 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 04 18:41:40.820706 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 04 18:41:40.820706 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:41:40.820706 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:41:40.820706 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 18:41:40.820706 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 18:41:40.820706 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:41:40.820706 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:41:40.820706 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 18:41:40.820706 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 18:41:40.820706 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:41:40.820706 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:41:40.820706 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 18:41:40.820706 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 18:41:40.820706 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:41:40.820706 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:41:40.820706 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 18:41:40.820706 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 18:41:40.820706 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 18:41:40.824326 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 18:41:40.824326 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 25ea5693-8b07-4e31-b80f-f09fa09b3a53 does not exist Oct 04 18:41:40.824326 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-822f5331-535a-4c95-8f1b-088736cdcac4'] Oct 04 18:41:40.824326 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:41:40.824326 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:41:40.824326 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:41:40.824326 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:41:40.824326 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 246, in update Oct 04 18:41:40.824326 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 04 18:41:40.824326 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 04 18:41:40.824326 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 18:41:40.824326 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 25ea5693-8b07-4e31-b80f-f09fa09b3a53 does not exist Oct 04 18:41:40.824326 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-822f5331-535a-4c95-8f1b-088736cdcac4'] Oct 04 18:41:40.824326 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:41:40.824326 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:41:40.824326 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:41:40.824326 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:41:40.824326 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:41:40.824326 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:41:40.824326 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:41:40.824326 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:41:40.824326 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:41:40.824326 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:41:40.824326 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:41:40.824326 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:41:40.824326 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 248, in update Oct 04 18:41:40.824326 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 04 18:41:40.824326 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 25ea5693-8b07-4e31-b80f-f09fa09b3a53 does not exist Oct 04 18:41:40.824326 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-822f5331-535a-4c95-8f1b-088736cdcac4'] Oct 04 18:41:40.824326 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:41:40.824326 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:41:40.824326 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:41:40.824326 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:41:40.824326 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:41:40.824326 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:41:40.824326 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:41:40.824326 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:41:40.824326 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 25ea5693-8b07-4e31-b80f-f09fa09b3a53 does not exist Oct 04 18:41:40.824326 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-822f5331-535a-4c95-8f1b-088736cdcac4'] Oct 04 18:41:40.824326 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:41:40.824326 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-c361409e-6c94-4e10-9e76-395d401df5f9 tempest-SecurityGroupsNegativeTestJSON-1814611902 tempest-SecurityGroupsNegativeTestJSON-1814611902-project] Returning 404 to user: Security group 25ea5693-8b07-4e31-b80f-f09fa09b3a53 does not exist Oct 04 18:41:40.824326 n-d-851028-13 devstack@n-api.service[123596]: Neutron server returns request_ids: ['req-822f5331-535a-4c95-8f1b-088736cdcac4'] {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:41:40.824326 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-c361409e-6c94-4e10-9e76-395d401df5f9 tempest-SecurityGroupsNegativeTestJSON-1814611902 tempest-SecurityGroupsNegativeTestJSON-1814611902-project] 10.222.0.43 "PUT /compute/v2.1/os-security-groups/25ea5693-8b07-4e31-b80f-f09fa09b3a53" status: 404 len: 194 microversion: 2.1 time: 0.104468 Oct 04 18:41:40.824326 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1398/2662] 10.222.0.43 () {60 vars in 1289 bytes} [Tue Oct 4 18:41:40 2022] PUT /compute/v2.1/os-security-groups/25ea5693-8b07-4e31-b80f-f09fa09b3a53 => generated 194 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:41:41.479873 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-47852c03-de91-4076-aec1-6da06aefd268 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:41.480785 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-47852c03-de91-4076-aec1-6da06aefd268 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: 07ed4416-8fdc-4468-97bd-3fa1b039f77b] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:41.488914 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-47852c03-de91-4076-aec1-6da06aefd268 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:41.489679 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-47852c03-de91-4076-aec1-6da06aefd268 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:41.490277 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-47852c03-de91-4076-aec1-6da06aefd268 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:41.491158 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-47852c03-de91-4076-aec1-6da06aefd268 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:41.491763 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-47852c03-de91-4076-aec1-6da06aefd268 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:41.492349 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-47852c03-de91-4076-aec1-6da06aefd268 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:41.701649 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-541e9cc3-cd43-4af9-b838-8a1aad7f3683 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:41.702311 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-541e9cc3-cd43-4af9-b838-8a1aad7f3683 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 82b86465-afb0-49ef-9932-1538010c1ae5] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:41.727467 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-541e9cc3-cd43-4af9-b838-8a1aad7f3683 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:41.729445 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-541e9cc3-cd43-4af9-b838-8a1aad7f3683 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:41.730400 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-541e9cc3-cd43-4af9-b838-8a1aad7f3683 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:41.735030 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-541e9cc3-cd43-4af9-b838-8a1aad7f3683 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:41.735583 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-541e9cc3-cd43-4af9-b838-8a1aad7f3683 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:41.737260 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-541e9cc3-cd43-4af9-b838-8a1aad7f3683 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:41.973851 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-541e9cc3-cd43-4af9-b838-8a1aad7f3683 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:41.992109 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-541e9cc3-cd43-4af9-b838-8a1aad7f3683 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5" status: 200 len: 1295 microversion: 2.1 time: 0.296045 Oct 04 18:41:42.012190 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1399/2663] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:41 2022] GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5 => generated 1295 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:41:42.798825 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-e94be7e2-f084-4456-8ca8-61fbceb5ca7e req-d7201834-20a0-45e5-a882-fdc85fecc64b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07ed4416-8fdc-4468-97bd-3fa1b039f77b", "name": "network-vif-unplugged", "status": "completed", "tag": "8ca0d053-912a-4590-9b08-aa9f36208d96"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:41:42.821216 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-e94be7e2-f084-4456-8ca8-61fbceb5ca7e req-d7201834-20a0-45e5-a882-fdc85fecc64b service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:42.822858 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-e94be7e2-f084-4456-8ca8-61fbceb5ca7e req-d7201834-20a0-45e5-a882-fdc85fecc64b service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:42.823740 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-e94be7e2-f084-4456-8ca8-61fbceb5ca7e req-d7201834-20a0-45e5-a882-fdc85fecc64b service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:42.864011 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-e94be7e2-f084-4456-8ca8-61fbceb5ca7e req-d7201834-20a0-45e5-a882-fdc85fecc64b service nova] Creating event network-vif-unplugged:8ca0d053-912a-4590-9b08-aa9f36208d96 for instance 07ed4416-8fdc-4468-97bd-3fa1b039f77b on n-h1-851028-13 Oct 04 18:41:42.871454 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [req-e94be7e2-f084-4456-8ca8-61fbceb5ca7e req-d7201834-20a0-45e5-a882-fdc85fecc64b service nova] Instance 07ed4416-8fdc-4468-97bd-3fa1b039f77b is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851028-13', 'n-h2-851028-13'} {{(pid=123596) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 18:41:42.890380 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-e94be7e2-f084-4456-8ca8-61fbceb5ca7e req-d7201834-20a0-45e5-a882-fdc85fecc64b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.094260 Oct 04 18:41:42.891559 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1400/2664] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:41:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:41:43.020985 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-09f2da49-37a1-4044-aebf-e0355c5b71e2 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:43.022068 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-09f2da49-37a1-4044-aebf-e0355c5b71e2 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 82b86465-afb0-49ef-9932-1538010c1ae5] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:43.034283 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-09f2da49-37a1-4044-aebf-e0355c5b71e2 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:43.035118 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-09f2da49-37a1-4044-aebf-e0355c5b71e2 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:43.035738 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-09f2da49-37a1-4044-aebf-e0355c5b71e2 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:43.038433 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-09f2da49-37a1-4044-aebf-e0355c5b71e2 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:43.042372 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-09f2da49-37a1-4044-aebf-e0355c5b71e2 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:43.043093 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-09f2da49-37a1-4044-aebf-e0355c5b71e2 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:43.178877 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-09f2da49-37a1-4044-aebf-e0355c5b71e2 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:43.190791 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-09f2da49-37a1-4044-aebf-e0355c5b71e2 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5" status: 200 len: 1295 microversion: 2.1 time: 0.175189 Oct 04 18:41:43.210176 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1401/2665] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:43 2022] GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5 => generated 1295 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:41:43.304903 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-47852c03-de91-4076-aec1-6da06aefd268 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:43.313063 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-47852c03-de91-4076-aec1-6da06aefd268 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/07ed4416-8fdc-4468-97bd-3fa1b039f77b" status: 200 len: 1475 microversion: 2.1 time: 1.838695 Oct 04 18:41:43.334435 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1265/2666] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:41 2022] GET /compute/v2.1/servers/07ed4416-8fdc-4468-97bd-3fa1b039f77b => generated 1475 bytes in 1860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:41:44.217892 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-3faeac71-5df2-4df2-87f9-1801c9f98358 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:44.219802 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-3faeac71-5df2-4df2-87f9-1801c9f98358 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 82b86465-afb0-49ef-9932-1538010c1ae5] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:44.236913 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3faeac71-5df2-4df2-87f9-1801c9f98358 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:44.239817 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3faeac71-5df2-4df2-87f9-1801c9f98358 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:44.240288 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3faeac71-5df2-4df2-87f9-1801c9f98358 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:44.241031 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3faeac71-5df2-4df2-87f9-1801c9f98358 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:44.241522 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3faeac71-5df2-4df2-87f9-1801c9f98358 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:44.241957 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3faeac71-5df2-4df2-87f9-1801c9f98358 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:44.341409 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-07548173-5d11-4df8-a41e-8f4ad4edc9a7 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:44.342759 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-07548173-5d11-4df8-a41e-8f4ad4edc9a7 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: 07ed4416-8fdc-4468-97bd-3fa1b039f77b] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:44.352836 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=1 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:41:44.356761 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-07548173-5d11-4df8-a41e-8f4ad4edc9a7 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:44.359749 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-07548173-5d11-4df8-a41e-8f4ad4edc9a7 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:44.360397 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-07548173-5d11-4df8-a41e-8f4ad4edc9a7 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:44.362277 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-07548173-5d11-4df8-a41e-8f4ad4edc9a7 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:44.369653 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-07548173-5d11-4df8-a41e-8f4ad4edc9a7 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:44.371052 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-07548173-5d11-4df8-a41e-8f4ad4edc9a7 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:44.489721 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-3faeac71-5df2-4df2-87f9-1801c9f98358 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:44.505007 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-3faeac71-5df2-4df2-87f9-1801c9f98358 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5" status: 200 len: 1295 microversion: 2.1 time: 0.291090 Oct 04 18:41:44.510945 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1402/2667] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:44 2022] GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5 => generated 1295 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:41:44.932101 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-90946891-3098-4ea1-bca5-d4718ade2cbd req-afe9c73a-ec78-47a7-9a97-b2dac025f31a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07ed4416-8fdc-4468-97bd-3fa1b039f77b", "tag": "8ca0d053-912a-4590-9b08-aa9f36208d96"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:41:44.950685 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-90946891-3098-4ea1-bca5-d4718ade2cbd req-afe9c73a-ec78-47a7-9a97-b2dac025f31a service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:44.952691 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-90946891-3098-4ea1-bca5-d4718ade2cbd req-afe9c73a-ec78-47a7-9a97-b2dac025f31a service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:44.953340 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-90946891-3098-4ea1-bca5-d4718ade2cbd req-afe9c73a-ec78-47a7-9a97-b2dac025f31a service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:44.982413 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-90946891-3098-4ea1-bca5-d4718ade2cbd req-afe9c73a-ec78-47a7-9a97-b2dac025f31a service nova] Creating event network-changed:8ca0d053-912a-4590-9b08-aa9f36208d96 for instance 07ed4416-8fdc-4468-97bd-3fa1b039f77b on n-h1-851028-13 Oct 04 18:41:44.993628 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [req-90946891-3098-4ea1-bca5-d4718ade2cbd req-afe9c73a-ec78-47a7-9a97-b2dac025f31a service nova] Instance 07ed4416-8fdc-4468-97bd-3fa1b039f77b is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851028-13', 'n-h2-851028-13'} {{(pid=123596) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 18:41:45.022193 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-90946891-3098-4ea1-bca5-d4718ade2cbd req-afe9c73a-ec78-47a7-9a97-b2dac025f31a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093706 Oct 04 18:41:45.026258 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1403/2668] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:41:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:41:45.539319 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-34354d78-cacc-43be-a110-5adeff13bcc6 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:45.540845 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-34354d78-cacc-43be-a110-5adeff13bcc6 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 82b86465-afb0-49ef-9932-1538010c1ae5] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:45.549668 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-34354d78-cacc-43be-a110-5adeff13bcc6 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:45.550451 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-34354d78-cacc-43be-a110-5adeff13bcc6 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:45.551316 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-34354d78-cacc-43be-a110-5adeff13bcc6 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:45.552240 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-34354d78-cacc-43be-a110-5adeff13bcc6 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:45.552871 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-34354d78-cacc-43be-a110-5adeff13bcc6 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:45.553708 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-34354d78-cacc-43be-a110-5adeff13bcc6 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:45.751981 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-07548173-5d11-4df8-a41e-8f4ad4edc9a7 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:45.764349 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-07548173-5d11-4df8-a41e-8f4ad4edc9a7 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/07ed4416-8fdc-4468-97bd-3fa1b039f77b" status: 200 len: 1475 microversion: 2.1 time: 1.426954 Oct 04 18:41:45.766650 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1266/2669] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:44 2022] GET /compute/v2.1/servers/07ed4416-8fdc-4468-97bd-3fa1b039f77b => generated 1475 bytes in 1430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:41:46.587492 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-34354d78-cacc-43be-a110-5adeff13bcc6 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:46.608177 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-34354d78-cacc-43be-a110-5adeff13bcc6 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5" status: 200 len: 1362 microversion: 2.1 time: 1.074146 Oct 04 18:41:46.629998 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1404/2670] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:45 2022] GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5 => generated 1362 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:41:46.799045 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-39e08133-831c-4ce7-b944-20256fdd6493 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:46.799692 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-39e08133-831c-4ce7-b944-20256fdd6493 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: 07ed4416-8fdc-4468-97bd-3fa1b039f77b] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:46.809328 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-39e08133-831c-4ce7-b944-20256fdd6493 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:46.809911 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-39e08133-831c-4ce7-b944-20256fdd6493 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:46.810471 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-39e08133-831c-4ce7-b944-20256fdd6493 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:46.811467 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-39e08133-831c-4ce7-b944-20256fdd6493 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:46.812049 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-39e08133-831c-4ce7-b944-20256fdd6493 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:46.812586 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-39e08133-831c-4ce7-b944-20256fdd6493 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:47.639475 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-27150700-7b0a-41b3-94ea-d8b943ddbb77 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:47.641216 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-27150700-7b0a-41b3-94ea-d8b943ddbb77 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 82b86465-afb0-49ef-9932-1538010c1ae5] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:47.653292 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-27150700-7b0a-41b3-94ea-d8b943ddbb77 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:47.654627 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-27150700-7b0a-41b3-94ea-d8b943ddbb77 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:47.655497 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-27150700-7b0a-41b3-94ea-d8b943ddbb77 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:47.656455 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-27150700-7b0a-41b3-94ea-d8b943ddbb77 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:47.657184 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-27150700-7b0a-41b3-94ea-d8b943ddbb77 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:47.657880 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-27150700-7b0a-41b3-94ea-d8b943ddbb77 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:47.913018 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-39e08133-831c-4ce7-b944-20256fdd6493 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:47.931509 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-39e08133-831c-4ce7-b944-20256fdd6493 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/07ed4416-8fdc-4468-97bd-3fa1b039f77b" status: 200 len: 1475 microversion: 2.1 time: 1.142536 Oct 04 18:41:47.935257 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1267/2671] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:46 2022] GET /compute/v2.1/servers/07ed4416-8fdc-4468-97bd-3fa1b039f77b => generated 1475 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:41:48.332918 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=2 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:41:48.955868 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-8b9ac14c-e959-4645-838b-e9021bf4bd14 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:48.957892 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-8b9ac14c-e959-4645-838b-e9021bf4bd14 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: 07ed4416-8fdc-4468-97bd-3fa1b039f77b] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:48.974496 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8b9ac14c-e959-4645-838b-e9021bf4bd14 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:48.977284 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8b9ac14c-e959-4645-838b-e9021bf4bd14 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:48.978023 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8b9ac14c-e959-4645-838b-e9021bf4bd14 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:48.979599 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8b9ac14c-e959-4645-838b-e9021bf4bd14 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:48.981735 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8b9ac14c-e959-4645-838b-e9021bf4bd14 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:48.983560 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8b9ac14c-e959-4645-838b-e9021bf4bd14 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:49.185942 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=8 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:41:49.308471 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-8b9ac14c-e959-4645-838b-e9021bf4bd14 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:49.317778 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-8b9ac14c-e959-4645-838b-e9021bf4bd14 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/07ed4416-8fdc-4468-97bd-3fa1b039f77b" status: 200 len: 1473 microversion: 2.1 time: 0.366302 Oct 04 18:41:49.318374 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1268/2672] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:48 2022] GET /compute/v2.1/servers/07ed4416-8fdc-4468-97bd-3fa1b039f77b => generated 1473 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:41:49.497017 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-27150700-7b0a-41b3-94ea-d8b943ddbb77 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:49.510783 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-27150700-7b0a-41b3-94ea-d8b943ddbb77 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5" status: 200 len: 1362 microversion: 2.1 time: 1.876667 Oct 04 18:41:49.512419 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1405/2673] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:47 2022] GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5 => generated 1362 bytes in 1879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:41:49.520485 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-e1afe3ab-d128-4ebd-b6c3-41145d7c495a tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-710087314", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "612ae520-c11e-4b5d-bc36-0faaa61c308b"}], "security_groups": [{"name": "tempest-securitygroup--533234630"}], "key_name": "tempest-keypair-1624991526", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "80827170-2d17-4364-8ff9-de4f7983c87d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:41:49.931391 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-c8c08803-aea5-4853-b106-a854ee5f23f0 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1161497714", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452", "networks": [{"uuid": "3b95df32-80ff-41d3-8ca9-09785472b92e"}]}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:41:50.120971 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.network.neutron [None req-c8c08803-aea5-4853-b106-a854ee5f23f0 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] validate_networks() for [('3b95df32-80ff-41d3-8ca9-09785472b92e', None, None, None, None, None)] {{(pid=123595) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:41:50.812671 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-c8c08803-aea5-4853-b106-a854ee5f23f0 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Flavor limits 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:41:50.813101 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-c8c08803-aea5-4853-b106-a854ee5f23f0 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Image limits 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:41:50.813630 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-c8c08803-aea5-4853-b106-a854ee5f23f0 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Flavor pref 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:41:50.814042 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-c8c08803-aea5-4853-b106-a854ee5f23f0 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Image pref 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:41:50.814455 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-c8c08803-aea5-4853-b106-a854ee5f23f0 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:41:50.834203 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c8c08803-aea5-4853-b106-a854ee5f23f0 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:50.834701 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c8c08803-aea5-4853-b106-a854ee5f23f0 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:50.835145 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c8c08803-aea5-4853-b106-a854ee5f23f0 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:50.835887 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c8c08803-aea5-4853-b106-a854ee5f23f0 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:50.836347 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c8c08803-aea5-4853-b106-a854ee5f23f0 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:50.836779 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c8c08803-aea5-4853-b106-a854ee5f23f0 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:50.900078 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-c8c08803-aea5-4853-b106-a854ee5f23f0 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Getting quotas for project a9f809b8ae704988961908bef0f3cb24. Resources: {'ram', 'cores', 'instances'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:41:50.921971 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-c8c08803-aea5-4853-b106-a854ee5f23f0 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Getting quotas for user ae9971b5861f44c1a1da94eda0f8f02d and project a9f809b8ae704988961908bef0f3cb24. Resources: {'ram', 'cores', 'instances'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:41:50.963269 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-c8c08803-aea5-4853-b106-a854ee5f23f0 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Going to run 1 instances... {{(pid=123595) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:41:50.973060 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-c8c08803-aea5-4853-b106-a854ee5f23f0 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] [instance: 3d03e642-62aa-4ed5-8427-a10c4bd9698e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e8943ec5-4038-4d4b-b9b9-2415a79f5243',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:41:51.125589 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-c8c08803-aea5-4853-b106-a854ee5f23f0 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.794102 Oct 04 18:41:51.126983 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1269/2674] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 18:41:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 1808 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:41:51.136100 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-80c01bf5-5a03-49e7-9d9b-2241709f4ef7 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:51.140597 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-80c01bf5-5a03-49e7-9d9b-2241709f4ef7 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: 07ed4416-8fdc-4468-97bd-3fa1b039f77b] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:51.154569 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.network.neutron [None req-e1afe3ab-d128-4ebd-b6c3-41145d7c495a tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] validate_networks() for [('612ae520-c11e-4b5d-bc36-0faaa61c308b', None, None, None, None, None)] {{(pid=123596) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:41:51.161229 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-80c01bf5-5a03-49e7-9d9b-2241709f4ef7 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:51.162080 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-80c01bf5-5a03-49e7-9d9b-2241709f4ef7 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:51.162726 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-80c01bf5-5a03-49e7-9d9b-2241709f4ef7 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:51.163816 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-80c01bf5-5a03-49e7-9d9b-2241709f4ef7 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:51.164692 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-80c01bf5-5a03-49e7-9d9b-2241709f4ef7 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:51.165411 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-80c01bf5-5a03-49e7-9d9b-2241709f4ef7 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:51.448239 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-80c01bf5-5a03-49e7-9d9b-2241709f4ef7 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:51.458579 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-80c01bf5-5a03-49e7-9d9b-2241709f4ef7 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/07ed4416-8fdc-4468-97bd-3fa1b039f77b" status: 200 len: 1470 microversion: 2.1 time: 0.330169 Oct 04 18:41:51.466301 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1270/2675] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:51 2022] GET /compute/v2.1/servers/07ed4416-8fdc-4468-97bd-3fa1b039f77b => generated 1470 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:41:51.475253 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-aafe8f58-19f7-4e6f-a726-df8759689fee tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:51.477124 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-aafe8f58-19f7-4e6f-a726-df8759689fee tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 82b86465-afb0-49ef-9932-1538010c1ae5] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:51.485871 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-aafe8f58-19f7-4e6f-a726-df8759689fee tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:51.489136 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-aafe8f58-19f7-4e6f-a726-df8759689fee tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:51.495136 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-aafe8f58-19f7-4e6f-a726-df8759689fee tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:51.496138 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-aafe8f58-19f7-4e6f-a726-df8759689fee tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:51.496921 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-aafe8f58-19f7-4e6f-a726-df8759689fee tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:51.502677 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-aafe8f58-19f7-4e6f-a726-df8759689fee tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:51.894424 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-aafe8f58-19f7-4e6f-a726-df8759689fee tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:51.911501 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-aafe8f58-19f7-4e6f-a726-df8759689fee tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5" status: 200 len: 1362 microversion: 2.1 time: 0.438348 Oct 04 18:41:51.936533 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1271/2676] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:51 2022] GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5 => generated 1362 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:41:51.947223 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-e6871c58-e72b-45c4-bca9-3ad8854c15d6 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:51.948244 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-e6871c58-e72b-45c4-bca9-3ad8854c15d6 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] [instance: 3d03e642-62aa-4ed5-8427-a10c4bd9698e] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:52.063772 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-e6871c58-e72b-45c4-bca9-3ad8854c15d6 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9971b5861f44c1a1da94eda0f8f02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f809b8ae704988961908bef0f3cb24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:52.089348 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-e6871c58-e72b-45c4-bca9-3ad8854c15d6 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] 10.222.0.43 "GET /compute/v2.1/servers/3d03e642-62aa-4ed5-8427-a10c4bd9698e" status: 200 len: 1211 microversion: 2.1 time: 0.151106 Oct 04 18:41:52.101806 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1272/2677] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:51 2022] GET /compute/v2.1/servers/3d03e642-62aa-4ed5-8427-a10c4bd9698e => generated 1211 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:41:52.119451 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-b499f136-26db-4c41-a770-080a9678cf95 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:41:52.129500 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-b499f136-26db-4c41-a770-080a9678cf95 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: 07ed4416-8fdc-4468-97bd-3fa1b039f77b] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:52.138840 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b499f136-26db-4c41-a770-080a9678cf95 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:52.139364 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b499f136-26db-4c41-a770-080a9678cf95 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:52.139831 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b499f136-26db-4c41-a770-080a9678cf95 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:52.140709 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b499f136-26db-4c41-a770-080a9678cf95 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:52.141190 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b499f136-26db-4c41-a770-080a9678cf95 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:52.141624 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b499f136-26db-4c41-a770-080a9678cf95 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:52.450450 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-b499f136-26db-4c41-a770-080a9678cf95 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "POST /compute/v2.1/servers/07ed4416-8fdc-4468-97bd-3fa1b039f77b/action" status: 202 len: 0 microversion: 2.1 time: 0.344137 Oct 04 18:41:52.451799 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1273/2678] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 18:41:52 2022] POST /compute/v2.1/servers/07ed4416-8fdc-4468-97bd-3fa1b039f77b/action => generated 0 bytes in 349 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:41:52.462947 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-c893a3b7-fcb7-41d8-a0b2-8b3217d4b7bc req-1993e0b8-c391-4ba8-887d-d029950489ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82b86465-afb0-49ef-9932-1538010c1ae5", "tag": "7e7a43a5-3a15-49a6-b50e-0ac0ac9faa8d"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:41:52.483143 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-c893a3b7-fcb7-41d8-a0b2-8b3217d4b7bc req-1993e0b8-c391-4ba8-887d-d029950489ba service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:52.484014 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-c893a3b7-fcb7-41d8-a0b2-8b3217d4b7bc req-1993e0b8-c391-4ba8-887d-d029950489ba service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:52.485349 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-c893a3b7-fcb7-41d8-a0b2-8b3217d4b7bc req-1993e0b8-c391-4ba8-887d-d029950489ba service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:52.500862 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-c893a3b7-fcb7-41d8-a0b2-8b3217d4b7bc req-1993e0b8-c391-4ba8-887d-d029950489ba service nova] Creating event network-changed:7e7a43a5-3a15-49a6-b50e-0ac0ac9faa8d for instance 82b86465-afb0-49ef-9932-1538010c1ae5 on n-h2-851028-13 Oct 04 18:41:52.511603 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-c893a3b7-fcb7-41d8-a0b2-8b3217d4b7bc req-1993e0b8-c391-4ba8-887d-d029950489ba service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058129 Oct 04 18:41:52.512701 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1274/2679] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:41:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:41:52.518542 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-d88ce647-85e1-4808-8ec7-8eea3764cc0a tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:52.519623 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-d88ce647-85e1-4808-8ec7-8eea3764cc0a tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: 07ed4416-8fdc-4468-97bd-3fa1b039f77b] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:52.528177 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d88ce647-85e1-4808-8ec7-8eea3764cc0a tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:52.529021 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d88ce647-85e1-4808-8ec7-8eea3764cc0a tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:52.529784 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d88ce647-85e1-4808-8ec7-8eea3764cc0a tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:52.530820 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d88ce647-85e1-4808-8ec7-8eea3764cc0a tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:52.531573 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d88ce647-85e1-4808-8ec7-8eea3764cc0a tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:52.532318 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d88ce647-85e1-4808-8ec7-8eea3764cc0a tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:53.006035 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-d88ce647-85e1-4808-8ec7-8eea3764cc0a tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:53.016352 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-d88ce647-85e1-4808-8ec7-8eea3764cc0a tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/07ed4416-8fdc-4468-97bd-3fa1b039f77b" status: 200 len: 1469 microversion: 2.1 time: 0.502089 Oct 04 18:41:53.036001 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1275/2680] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:52 2022] GET /compute/v2.1/servers/07ed4416-8fdc-4468-97bd-3fa1b039f77b => generated 1469 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:41:53.804212 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-26486c79-998b-4857-99f2-a1b81e4c38b6 req-18679b2e-e748-4420-b6d0-9492c76c3f7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07ed4416-8fdc-4468-97bd-3fa1b039f77b", "name": "network-vif-plugged", "status": "completed", "tag": "8ca0d053-912a-4590-9b08-aa9f36208d96"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:41:53.823654 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-26486c79-998b-4857-99f2-a1b81e4c38b6 req-18679b2e-e748-4420-b6d0-9492c76c3f7c service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:53.827386 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-26486c79-998b-4857-99f2-a1b81e4c38b6 req-18679b2e-e748-4420-b6d0-9492c76c3f7c service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:53.828132 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-26486c79-998b-4857-99f2-a1b81e4c38b6 req-18679b2e-e748-4420-b6d0-9492c76c3f7c service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:53.849857 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-26486c79-998b-4857-99f2-a1b81e4c38b6 req-18679b2e-e748-4420-b6d0-9492c76c3f7c service nova] Creating event network-vif-plugged:8ca0d053-912a-4590-9b08-aa9f36208d96 for instance 07ed4416-8fdc-4468-97bd-3fa1b039f77b on n-h1-851028-13 Oct 04 18:41:53.863100 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [req-26486c79-998b-4857-99f2-a1b81e4c38b6 req-18679b2e-e748-4420-b6d0-9492c76c3f7c service nova] Instance 07ed4416-8fdc-4468-97bd-3fa1b039f77b is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851028-13', 'n-h2-851028-13'} {{(pid=123595) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 18:41:53.865256 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:41:53.883967 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-e1afe3ab-d128-4ebd-b6c3-41145d7c495a tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Getting quotas for project f379b9ce44d942959b67137e546191c3. Resources: dict_keys(['metadata_items']) {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:41:53.889724 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-26486c79-998b-4857-99f2-a1b81e4c38b6 req-18679b2e-e748-4420-b6d0-9492c76c3f7c service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.848849 Oct 04 18:41:53.890332 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1276/2681] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:41:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:41:53.893263 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-e1afe3ab-d128-4ebd-b6c3-41145d7c495a tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Getting quotas for user b2df20485e3d4c75b2f4fc7375adebb8 and project f379b9ce44d942959b67137e546191c3. Resources: dict_keys(['metadata_items']) {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:41:53.904176 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-03d9adc4-b9c1-4812-9c6d-f9d5524938ea tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:53.905103 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-03d9adc4-b9c1-4812-9c6d-f9d5524938ea tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 82b86465-afb0-49ef-9932-1538010c1ae5] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:53.916182 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-03d9adc4-b9c1-4812-9c6d-f9d5524938ea tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:53.922560 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-03d9adc4-b9c1-4812-9c6d-f9d5524938ea tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:53.923210 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-03d9adc4-b9c1-4812-9c6d-f9d5524938ea tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:53.926160 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-03d9adc4-b9c1-4812-9c6d-f9d5524938ea tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:53.926702 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-03d9adc4-b9c1-4812-9c6d-f9d5524938ea tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:53.927241 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-03d9adc4-b9c1-4812-9c6d-f9d5524938ea tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:53.947057 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-e1afe3ab-d128-4ebd-b6c3-41145d7c495a tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Flavor limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:41:53.948969 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-e1afe3ab-d128-4ebd-b6c3-41145d7c495a tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Image limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:41:53.949948 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-e1afe3ab-d128-4ebd-b6c3-41145d7c495a tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Flavor pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:41:53.950716 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-e1afe3ab-d128-4ebd-b6c3-41145d7c495a tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Image pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:41:53.951586 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-e1afe3ab-d128-4ebd-b6c3-41145d7c495a tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:41:53.967393 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e1afe3ab-d128-4ebd-b6c3-41145d7c495a tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:53.968727 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e1afe3ab-d128-4ebd-b6c3-41145d7c495a tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:53.969403 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e1afe3ab-d128-4ebd-b6c3-41145d7c495a tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:53.970382 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e1afe3ab-d128-4ebd-b6c3-41145d7c495a tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:53.971946 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e1afe3ab-d128-4ebd-b6c3-41145d7c495a tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:53.975381 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e1afe3ab-d128-4ebd-b6c3-41145d7c495a tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:54.055261 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-e1afe3ab-d128-4ebd-b6c3-41145d7c495a tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Getting quotas for project f379b9ce44d942959b67137e546191c3. Resources: {'ram', 'cores', 'instances'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:41:54.072390 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-e1afe3ab-d128-4ebd-b6c3-41145d7c495a tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Getting quotas for user b2df20485e3d4c75b2f4fc7375adebb8 and project f379b9ce44d942959b67137e546191c3. Resources: {'ram', 'cores', 'instances'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:41:54.195619 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-e1afe3ab-d128-4ebd-b6c3-41145d7c495a tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Going to run 1 instances... {{(pid=123596) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:41:54.198098 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-e1afe3ab-d128-4ebd-b6c3-41145d7c495a tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] [instance: cbae126b-e99a-4c70-a9e7-0921a41e01ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='80827170-2d17-4364-8ff9-de4f7983c87d',volume_size=None,volume_type=None)] {{(pid=123596) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:41:54.288540 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-03d9adc4-b9c1-4812-9c6d-f9d5524938ea tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:54.312004 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-03d9adc4-b9c1-4812-9c6d-f9d5524938ea tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5" status: 200 len: 1362 microversion: 2.1 time: 0.417567 Oct 04 18:41:54.316113 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1277/2682] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:53 2022] GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5 => generated 1362 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:41:54.324755 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-1a0e02c1-8ac4-47a6-9d15-dca038a761b1 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:54.340450 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-1a0e02c1-8ac4-47a6-9d15-dca038a761b1 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] [instance: 3d03e642-62aa-4ed5-8427-a10c4bd9698e] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:54.359564 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1a0e02c1-8ac4-47a6-9d15-dca038a761b1 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:54.360079 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1a0e02c1-8ac4-47a6-9d15-dca038a761b1 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:54.360524 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1a0e02c1-8ac4-47a6-9d15-dca038a761b1 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:54.361448 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1a0e02c1-8ac4-47a6-9d15-dca038a761b1 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:54.362379 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1a0e02c1-8ac4-47a6-9d15-dca038a761b1 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:54.362978 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1a0e02c1-8ac4-47a6-9d15-dca038a761b1 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:54.456595 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-e1afe3ab-d128-4ebd-b6c3-41145d7c495a tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 4.942205 Oct 04 18:41:54.457594 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1406/2683] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 18:41:49 2022] POST /compute/v2.1/servers => generated 406 bytes in 4944 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:41:54.465863 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-ad4962e6-2b45-42ea-822d-9172f10cd39d tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:54.466482 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-ad4962e6-2b45-42ea-822d-9172f10cd39d tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: 07ed4416-8fdc-4468-97bd-3fa1b039f77b] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:54.474321 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ad4962e6-2b45-42ea-822d-9172f10cd39d tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:54.475854 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ad4962e6-2b45-42ea-822d-9172f10cd39d tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:54.477224 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ad4962e6-2b45-42ea-822d-9172f10cd39d tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:54.478506 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ad4962e6-2b45-42ea-822d-9172f10cd39d tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:54.479129 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ad4962e6-2b45-42ea-822d-9172f10cd39d tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:54.483813 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ad4962e6-2b45-42ea-822d-9172f10cd39d tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:54.569859 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-1a0e02c1-8ac4-47a6-9d15-dca038a761b1 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9971b5861f44c1a1da94eda0f8f02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f809b8ae704988961908bef0f3cb24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:54.582714 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-1a0e02c1-8ac4-47a6-9d15-dca038a761b1 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] 10.222.0.43 "GET /compute/v2.1/servers/3d03e642-62aa-4ed5-8427-a10c4bd9698e" status: 200 len: 1269 microversion: 2.1 time: 0.265481 Oct 04 18:41:54.583559 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1278/2684] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:54 2022] GET /compute/v2.1/servers/3d03e642-62aa-4ed5-8427-a10c4bd9698e => generated 1269 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:41:54.594513 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-42243c9a-142d-48a1-91e4-a5a9e6b3f0bf tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:54.595136 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-42243c9a-142d-48a1-91e4-a5a9e6b3f0bf tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] [instance: cbae126b-e99a-4c70-a9e7-0921a41e01ca] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:54.702066 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-42243c9a-142d-48a1-91e4-a5a9e6b3f0bf tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2df20485e3d4c75b2f4fc7375adebb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f379b9ce44d942959b67137e546191c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:54.711268 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-42243c9a-142d-48a1-91e4-a5a9e6b3f0bf tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] 10.222.0.43 "GET /compute/v2.1/servers/cbae126b-e99a-4c70-a9e7-0921a41e01ca" status: 200 len: 1121 microversion: 2.1 time: 0.126440 Oct 04 18:41:54.725139 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1279/2685] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:54 2022] GET /compute/v2.1/servers/cbae126b-e99a-4c70-a9e7-0921a41e01ca => generated 1121 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:41:55.339422 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-48c4d5e2-2eda-4a72-a2b5-53aa0eddabe6 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:55.340848 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-48c4d5e2-2eda-4a72-a2b5-53aa0eddabe6 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 82b86465-afb0-49ef-9932-1538010c1ae5] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:55.352569 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-48c4d5e2-2eda-4a72-a2b5-53aa0eddabe6 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:55.353553 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-48c4d5e2-2eda-4a72-a2b5-53aa0eddabe6 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:55.354245 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-48c4d5e2-2eda-4a72-a2b5-53aa0eddabe6 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:55.355507 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-48c4d5e2-2eda-4a72-a2b5-53aa0eddabe6 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:55.356060 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-48c4d5e2-2eda-4a72-a2b5-53aa0eddabe6 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:55.356568 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-48c4d5e2-2eda-4a72-a2b5-53aa0eddabe6 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:55.487215 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-ad4962e6-2b45-42ea-822d-9172f10cd39d tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:55.515751 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-ad4962e6-2b45-42ea-822d-9172f10cd39d tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/07ed4416-8fdc-4468-97bd-3fa1b039f77b" status: 200 len: 1469 microversion: 2.1 time: 1.054719 Oct 04 18:41:55.522751 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1407/2686] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:54 2022] GET /compute/v2.1/servers/07ed4416-8fdc-4468-97bd-3fa1b039f77b => generated 1469 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:41:55.609402 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-6289d047-ea03-46cd-936d-70e1ed90ab9a tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:55.610635 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-6289d047-ea03-46cd-936d-70e1ed90ab9a tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] [instance: 3d03e642-62aa-4ed5-8427-a10c4bd9698e] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:55.623278 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6289d047-ea03-46cd-936d-70e1ed90ab9a tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:55.624215 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-48c4d5e2-2eda-4a72-a2b5-53aa0eddabe6 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:55.625687 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6289d047-ea03-46cd-936d-70e1ed90ab9a tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:55.627985 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6289d047-ea03-46cd-936d-70e1ed90ab9a tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:55.628839 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6289d047-ea03-46cd-936d-70e1ed90ab9a tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:55.629378 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6289d047-ea03-46cd-936d-70e1ed90ab9a tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:55.629819 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6289d047-ea03-46cd-936d-70e1ed90ab9a tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:55.633426 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-48c4d5e2-2eda-4a72-a2b5-53aa0eddabe6 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5" status: 200 len: 1362 microversion: 2.1 time: 0.298355 Oct 04 18:41:55.641348 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1280/2687] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:55 2022] GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5 => generated 1362 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:41:55.737799 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-384c833b-5103-4952-bc61-1454d7111e12 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:55.737799 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-384c833b-5103-4952-bc61-1454d7111e12 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] [instance: cbae126b-e99a-4c70-a9e7-0921a41e01ca] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:55.755554 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-384c833b-5103-4952-bc61-1454d7111e12 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:55.756054 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-384c833b-5103-4952-bc61-1454d7111e12 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:55.756488 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-384c833b-5103-4952-bc61-1454d7111e12 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:55.757399 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-384c833b-5103-4952-bc61-1454d7111e12 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:55.758012 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-384c833b-5103-4952-bc61-1454d7111e12 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:55.758679 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-384c833b-5103-4952-bc61-1454d7111e12 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:55.897158 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-6289d047-ea03-46cd-936d-70e1ed90ab9a tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9971b5861f44c1a1da94eda0f8f02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f809b8ae704988961908bef0f3cb24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:55.909780 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-6289d047-ea03-46cd-936d-70e1ed90ab9a tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] 10.222.0.43 "GET /compute/v2.1/servers/3d03e642-62aa-4ed5-8427-a10c4bd9698e" status: 200 len: 1269 microversion: 2.1 time: 0.305550 Oct 04 18:41:55.912481 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1408/2688] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:55 2022] GET /compute/v2.1/servers/3d03e642-62aa-4ed5-8427-a10c4bd9698e => generated 1269 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:41:55.918899 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-384c833b-5103-4952-bc61-1454d7111e12 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2df20485e3d4c75b2f4fc7375adebb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f379b9ce44d942959b67137e546191c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:55.949409 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-384c833b-5103-4952-bc61-1454d7111e12 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] 10.222.0.43 "GET /compute/v2.1/servers/cbae126b-e99a-4c70-a9e7-0921a41e01ca" status: 200 len: 1171 microversion: 2.1 time: 0.216518 Oct 04 18:41:55.958856 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1281/2689] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:55 2022] GET /compute/v2.1/servers/cbae126b-e99a-4c70-a9e7-0921a41e01ca => generated 1171 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:41:56.548911 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-b186d2dd-638b-4d62-8b20-5d8c8381be81 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:56.550118 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-b186d2dd-638b-4d62-8b20-5d8c8381be81 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: 07ed4416-8fdc-4468-97bd-3fa1b039f77b] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:56.567249 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b186d2dd-638b-4d62-8b20-5d8c8381be81 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:56.571363 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b186d2dd-638b-4d62-8b20-5d8c8381be81 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:56.572189 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b186d2dd-638b-4d62-8b20-5d8c8381be81 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:56.573198 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b186d2dd-638b-4d62-8b20-5d8c8381be81 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:56.574355 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b186d2dd-638b-4d62-8b20-5d8c8381be81 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:56.575086 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b186d2dd-638b-4d62-8b20-5d8c8381be81 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:56.696506 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-804d5c74-08b5-43d3-b7e6-556d1692e138 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:56.698894 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-804d5c74-08b5-43d3-b7e6-556d1692e138 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 82b86465-afb0-49ef-9932-1538010c1ae5] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:56.730477 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-804d5c74-08b5-43d3-b7e6-556d1692e138 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:56.731490 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-804d5c74-08b5-43d3-b7e6-556d1692e138 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:56.732603 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-804d5c74-08b5-43d3-b7e6-556d1692e138 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:56.733585 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-804d5c74-08b5-43d3-b7e6-556d1692e138 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:56.734352 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-804d5c74-08b5-43d3-b7e6-556d1692e138 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:56.734927 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-804d5c74-08b5-43d3-b7e6-556d1692e138 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:56.796720 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:41:57.436857 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-b186d2dd-638b-4d62-8b20-5d8c8381be81 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:57.493933 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-b186d2dd-638b-4d62-8b20-5d8c8381be81 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/07ed4416-8fdc-4468-97bd-3fa1b039f77b" status: 200 len: 1469 microversion: 2.1 time: 0.950146 Oct 04 18:41:57.497058 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1409/2690] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:56 2022] GET /compute/v2.1/servers/07ed4416-8fdc-4468-97bd-3fa1b039f77b => generated 1469 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:41:57.531240 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-0d709667-6e46-4944-bbbe-2422a14a662d tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:57.533218 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-0d709667-6e46-4944-bbbe-2422a14a662d tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] [instance: 3d03e642-62aa-4ed5-8427-a10c4bd9698e] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:57.541935 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0d709667-6e46-4944-bbbe-2422a14a662d tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:57.542769 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0d709667-6e46-4944-bbbe-2422a14a662d tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:57.543554 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0d709667-6e46-4944-bbbe-2422a14a662d tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:57.546037 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0d709667-6e46-4944-bbbe-2422a14a662d tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:57.547252 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0d709667-6e46-4944-bbbe-2422a14a662d tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:57.548344 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0d709667-6e46-4944-bbbe-2422a14a662d tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:58.436223 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-0d709667-6e46-4944-bbbe-2422a14a662d tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9971b5861f44c1a1da94eda0f8f02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f809b8ae704988961908bef0f3cb24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:58.450139 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-0d709667-6e46-4944-bbbe-2422a14a662d tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] 10.222.0.43 "GET /compute/v2.1/servers/3d03e642-62aa-4ed5-8427-a10c4bd9698e" status: 200 len: 1311 microversion: 2.1 time: 0.928275 Oct 04 18:41:58.451064 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1410/2691] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:57 2022] GET /compute/v2.1/servers/3d03e642-62aa-4ed5-8427-a10c4bd9698e => generated 1311 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:41:58.451064 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-576f8dea-a5ed-4252-a70c-6af1b91ef444 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:58.465184 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-576f8dea-a5ed-4252-a70c-6af1b91ef444 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] [instance: cbae126b-e99a-4c70-a9e7-0921a41e01ca] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:58.501372 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-576f8dea-a5ed-4252-a70c-6af1b91ef444 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:58.502284 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-576f8dea-a5ed-4252-a70c-6af1b91ef444 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:58.506971 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-576f8dea-a5ed-4252-a70c-6af1b91ef444 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:58.508449 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-576f8dea-a5ed-4252-a70c-6af1b91ef444 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:58.509100 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-576f8dea-a5ed-4252-a70c-6af1b91ef444 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:58.512132 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-576f8dea-a5ed-4252-a70c-6af1b91ef444 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:58.776746 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-576f8dea-a5ed-4252-a70c-6af1b91ef444 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2df20485e3d4c75b2f4fc7375adebb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f379b9ce44d942959b67137e546191c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:58.795837 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-576f8dea-a5ed-4252-a70c-6af1b91ef444 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] 10.222.0.43 "GET /compute/v2.1/servers/cbae126b-e99a-4c70-a9e7-0921a41e01ca" status: 200 len: 1237 microversion: 2.1 time: 0.343445 Oct 04 18:41:58.809212 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1411/2692] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:58 2022] GET /compute/v2.1/servers/cbae126b-e99a-4c70-a9e7-0921a41e01ca => generated 1237 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:41:58.809212 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-70bb8f47-fa08-45a8-9a14-ed3826345933 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:58.809212 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-70bb8f47-fa08-45a8-9a14-ed3826345933 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: 07ed4416-8fdc-4468-97bd-3fa1b039f77b] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:58.822840 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-70bb8f47-fa08-45a8-9a14-ed3826345933 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:58.823456 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-70bb8f47-fa08-45a8-9a14-ed3826345933 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:58.824080 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-70bb8f47-fa08-45a8-9a14-ed3826345933 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:58.824943 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-70bb8f47-fa08-45a8-9a14-ed3826345933 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:58.827225 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-70bb8f47-fa08-45a8-9a14-ed3826345933 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:58.827760 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-70bb8f47-fa08-45a8-9a14-ed3826345933 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:59.124918 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-804d5c74-08b5-43d3-b7e6-556d1692e138 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:59.139534 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-804d5c74-08b5-43d3-b7e6-556d1692e138 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5" status: 200 len: 1362 microversion: 2.1 time: 2.472709 Oct 04 18:41:59.140501 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1282/2693] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:56 2022] GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5 => generated 1362 bytes in 2476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:41:59.154121 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-c763875b-6470-4a71-ac93-60e7842c4896 req-440248aa-1121-452e-8adb-16322157e6b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07ed4416-8fdc-4468-97bd-3fa1b039f77b", "name": "network-vif-unplugged", "status": "completed", "tag": "8ca0d053-912a-4590-9b08-aa9f36208d96"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:41:59.176614 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-70bb8f47-fa08-45a8-9a14-ed3826345933 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:59.181026 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-c763875b-6470-4a71-ac93-60e7842c4896 req-440248aa-1121-452e-8adb-16322157e6b9 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:59.181801 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-c763875b-6470-4a71-ac93-60e7842c4896 req-440248aa-1121-452e-8adb-16322157e6b9 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:59.182514 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-c763875b-6470-4a71-ac93-60e7842c4896 req-440248aa-1121-452e-8adb-16322157e6b9 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:59.193792 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-70bb8f47-fa08-45a8-9a14-ed3826345933 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/07ed4416-8fdc-4468-97bd-3fa1b039f77b" status: 200 len: 1469 microversion: 2.1 time: 0.395844 Oct 04 18:41:59.194439 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1412/2694] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:58 2022] GET /compute/v2.1/servers/07ed4416-8fdc-4468-97bd-3fa1b039f77b => generated 1469 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:41:59.214039 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-c763875b-6470-4a71-ac93-60e7842c4896 req-440248aa-1121-452e-8adb-16322157e6b9 service nova] Creating event network-vif-unplugged:8ca0d053-912a-4590-9b08-aa9f36208d96 for instance 07ed4416-8fdc-4468-97bd-3fa1b039f77b on n-h2-851028-13 Oct 04 18:41:59.227979 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [req-c763875b-6470-4a71-ac93-60e7842c4896 req-440248aa-1121-452e-8adb-16322157e6b9 service nova] Instance 07ed4416-8fdc-4468-97bd-3fa1b039f77b is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851028-13', 'n-h2-851028-13'} {{(pid=123595) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 18:41:59.255782 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-c763875b-6470-4a71-ac93-60e7842c4896 req-440248aa-1121-452e-8adb-16322157e6b9 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.109812 Oct 04 18:41:59.257234 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1283/2695] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:41:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:41:59.477864 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-09953c18-eb5b-491a-b6b7-aa625b589d37 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:59.479185 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-09953c18-eb5b-491a-b6b7-aa625b589d37 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] [instance: 3d03e642-62aa-4ed5-8427-a10c4bd9698e] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:59.497678 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-09953c18-eb5b-491a-b6b7-aa625b589d37 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:59.498432 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-09953c18-eb5b-491a-b6b7-aa625b589d37 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:59.498580 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-09953c18-eb5b-491a-b6b7-aa625b589d37 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:59.499305 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-09953c18-eb5b-491a-b6b7-aa625b589d37 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:59.499769 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-09953c18-eb5b-491a-b6b7-aa625b589d37 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:59.500213 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-09953c18-eb5b-491a-b6b7-aa625b589d37 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:59.829557 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-5bcb6a0f-d8c9-4a75-8026-79156959f7b6 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:59.832410 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-5bcb6a0f-d8c9-4a75-8026-79156959f7b6 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] [instance: cbae126b-e99a-4c70-a9e7-0921a41e01ca] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:59.849084 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5bcb6a0f-d8c9-4a75-8026-79156959f7b6 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:59.850490 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5bcb6a0f-d8c9-4a75-8026-79156959f7b6 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:59.852390 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5bcb6a0f-d8c9-4a75-8026-79156959f7b6 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:59.853804 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5bcb6a0f-d8c9-4a75-8026-79156959f7b6 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:59.856610 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5bcb6a0f-d8c9-4a75-8026-79156959f7b6 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:59.857860 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5bcb6a0f-d8c9-4a75-8026-79156959f7b6 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:59.960327 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-09953c18-eb5b-491a-b6b7-aa625b589d37 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9971b5861f44c1a1da94eda0f8f02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f809b8ae704988961908bef0f3cb24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:59.971983 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-09953c18-eb5b-491a-b6b7-aa625b589d37 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] 10.222.0.43 "GET /compute/v2.1/servers/3d03e642-62aa-4ed5-8427-a10c4bd9698e" status: 200 len: 1311 microversion: 2.1 time: 0.499049 Oct 04 18:41:59.972594 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1413/2696] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:59 2022] GET /compute/v2.1/servers/3d03e642-62aa-4ed5-8427-a10c4bd9698e => generated 1311 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:00.082437 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-5bcb6a0f-d8c9-4a75-8026-79156959f7b6 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2df20485e3d4c75b2f4fc7375adebb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f379b9ce44d942959b67137e546191c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:00.112086 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-5bcb6a0f-d8c9-4a75-8026-79156959f7b6 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] 10.222.0.43 "GET /compute/v2.1/servers/cbae126b-e99a-4c70-a9e7-0921a41e01ca" status: 200 len: 1237 microversion: 2.1 time: 0.291509 Oct 04 18:42:00.113012 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1284/2697] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:59 2022] GET /compute/v2.1/servers/cbae126b-e99a-4c70-a9e7-0921a41e01ca => generated 1237 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:42:00.162981 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-1d2f7d34-af37-4f00-b57b-1b3606e459c4 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:00.163606 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-1d2f7d34-af37-4f00-b57b-1b3606e459c4 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 82b86465-afb0-49ef-9932-1538010c1ae5] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:00.179589 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1d2f7d34-af37-4f00-b57b-1b3606e459c4 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:00.180168 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1d2f7d34-af37-4f00-b57b-1b3606e459c4 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:00.192634 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1d2f7d34-af37-4f00-b57b-1b3606e459c4 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:00.193818 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1d2f7d34-af37-4f00-b57b-1b3606e459c4 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:00.194466 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1d2f7d34-af37-4f00-b57b-1b3606e459c4 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:00.198300 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1d2f7d34-af37-4f00-b57b-1b3606e459c4 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:00.218424 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-28f8078f-dec2-489d-a059-ea986ee9c26b tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:00.219080 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-28f8078f-dec2-489d-a059-ea986ee9c26b tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: 07ed4416-8fdc-4468-97bd-3fa1b039f77b] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:00.235533 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-28f8078f-dec2-489d-a059-ea986ee9c26b tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:00.236054 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-28f8078f-dec2-489d-a059-ea986ee9c26b tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:00.236509 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-28f8078f-dec2-489d-a059-ea986ee9c26b tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:00.245947 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-28f8078f-dec2-489d-a059-ea986ee9c26b tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:00.246318 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-28f8078f-dec2-489d-a059-ea986ee9c26b tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:00.246774 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-28f8078f-dec2-489d-a059-ea986ee9c26b tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:00.862940 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=2 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:42:01.031902 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-1d2f7d34-af37-4f00-b57b-1b3606e459c4 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:01.034550 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=100 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:42:01.066659 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-1d2f7d34-af37-4f00-b57b-1b3606e459c4 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5" status: 200 len: 1362 microversion: 2.1 time: 0.907752 Oct 04 18:42:01.072129 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1414/2698] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:00 2022] GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5 => generated 1362 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:01.356298 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-b09d5531-c611-4665-baec-231feaafdfb5 req-7228cf56-f040-4b0a-b9a6-9f5d8f8e3d12 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d03e642-62aa-4ed5-8427-a10c4bd9698e", "tag": "53dfc1e3-b31a-4aab-8977-3a9c6a1f79ae"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:42:01.375628 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-b09d5531-c611-4665-baec-231feaafdfb5 req-7228cf56-f040-4b0a-b9a6-9f5d8f8e3d12 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:01.376430 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-b09d5531-c611-4665-baec-231feaafdfb5 req-7228cf56-f040-4b0a-b9a6-9f5d8f8e3d12 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:01.377975 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-b09d5531-c611-4665-baec-231feaafdfb5 req-7228cf56-f040-4b0a-b9a6-9f5d8f8e3d12 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:01.392827 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-b09d5531-c611-4665-baec-231feaafdfb5 req-7228cf56-f040-4b0a-b9a6-9f5d8f8e3d12 service nova] Creating event network-changed:53dfc1e3-b31a-4aab-8977-3a9c6a1f79ae for instance 3d03e642-62aa-4ed5-8427-a10c4bd9698e on n-h1-851028-13 Oct 04 18:42:01.400431 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-b09d5531-c611-4665-baec-231feaafdfb5 req-7228cf56-f040-4b0a-b9a6-9f5d8f8e3d12 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.326365 Oct 04 18:42:01.401598 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1415/2699] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:42:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:42:01.407391 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-634fa263-a806-4499-baa4-1246d16c6963 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:01.408318 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-634fa263-a806-4499-baa4-1246d16c6963 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] [instance: 3d03e642-62aa-4ed5-8427-a10c4bd9698e] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:01.419515 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-634fa263-a806-4499-baa4-1246d16c6963 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:01.420214 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-634fa263-a806-4499-baa4-1246d16c6963 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:01.420852 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-634fa263-a806-4499-baa4-1246d16c6963 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:01.421786 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-634fa263-a806-4499-baa4-1246d16c6963 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:01.422402 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-634fa263-a806-4499-baa4-1246d16c6963 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:01.423632 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-634fa263-a806-4499-baa4-1246d16c6963 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:01.455826 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-28f8078f-dec2-489d-a059-ea986ee9c26b tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:01.480031 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-28f8078f-dec2-489d-a059-ea986ee9c26b tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/07ed4416-8fdc-4468-97bd-3fa1b039f77b" status: 200 len: 1469 microversion: 2.1 time: 1.263752 Oct 04 18:42:01.501491 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1285/2700] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:00 2022] GET /compute/v2.1/servers/07ed4416-8fdc-4468-97bd-3fa1b039f77b => generated 1469 bytes in 1288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:01.511162 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-3a77a8c8-efd5-4952-b388-3da867bdd916 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:01.512005 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-3a77a8c8-efd5-4952-b388-3da867bdd916 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] [instance: cbae126b-e99a-4c70-a9e7-0921a41e01ca] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:01.519716 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3a77a8c8-efd5-4952-b388-3da867bdd916 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:01.520592 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3a77a8c8-efd5-4952-b388-3da867bdd916 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:01.521261 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3a77a8c8-efd5-4952-b388-3da867bdd916 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:01.523463 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3a77a8c8-efd5-4952-b388-3da867bdd916 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:01.524246 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3a77a8c8-efd5-4952-b388-3da867bdd916 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:01.524849 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3a77a8c8-efd5-4952-b388-3da867bdd916 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:02.130062 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-3a77a8c8-efd5-4952-b388-3da867bdd916 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2df20485e3d4c75b2f4fc7375adebb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f379b9ce44d942959b67137e546191c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:02.146178 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-3a77a8c8-efd5-4952-b388-3da867bdd916 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] 10.222.0.43 "GET /compute/v2.1/servers/cbae126b-e99a-4c70-a9e7-0921a41e01ca" status: 200 len: 1304 microversion: 2.1 time: 0.641091 Oct 04 18:42:02.162768 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1286/2701] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:01 2022] GET /compute/v2.1/servers/cbae126b-e99a-4c70-a9e7-0921a41e01ca => generated 1304 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:02.344637 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-5a1e76e2-d248-4b16-809b-8819b084cf70 req-a2a4a6d6-067b-4341-8428-e177ddf64a4f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07ed4416-8fdc-4468-97bd-3fa1b039f77b", "tag": "8ca0d053-912a-4590-9b08-aa9f36208d96"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:42:02.357036 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-5a1e76e2-d248-4b16-809b-8819b084cf70 req-a2a4a6d6-067b-4341-8428-e177ddf64a4f service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:02.357808 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-5a1e76e2-d248-4b16-809b-8819b084cf70 req-a2a4a6d6-067b-4341-8428-e177ddf64a4f service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:02.358414 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-5a1e76e2-d248-4b16-809b-8819b084cf70 req-a2a4a6d6-067b-4341-8428-e177ddf64a4f service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:02.374077 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-5a1e76e2-d248-4b16-809b-8819b084cf70 req-a2a4a6d6-067b-4341-8428-e177ddf64a4f service nova] Creating event network-changed:8ca0d053-912a-4590-9b08-aa9f36208d96 for instance 07ed4416-8fdc-4468-97bd-3fa1b039f77b on n-h2-851028-13 Oct 04 18:42:02.381079 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [req-5a1e76e2-d248-4b16-809b-8819b084cf70 req-a2a4a6d6-067b-4341-8428-e177ddf64a4f service nova] Instance 07ed4416-8fdc-4468-97bd-3fa1b039f77b is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851028-13', 'n-h2-851028-13'} {{(pid=123595) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 18:42:02.393623 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-5a1e76e2-d248-4b16-809b-8819b084cf70 req-a2a4a6d6-067b-4341-8428-e177ddf64a4f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.228499 Oct 04 18:42:02.395550 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1287/2702] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:42:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:42:02.403584 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-fb49ceeb-dd25-4fc1-83c6-58d38ef7c76d req-4e47a834-3cdf-4f04-99a3-472e2facbb58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82b86465-afb0-49ef-9932-1538010c1ae5", "name": "network-vif-plugged", "status": "completed", "tag": "7e7a43a5-3a15-49a6-b50e-0ac0ac9faa8d"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:42:02.418132 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-fb49ceeb-dd25-4fc1-83c6-58d38ef7c76d req-4e47a834-3cdf-4f04-99a3-472e2facbb58 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:02.418995 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-fb49ceeb-dd25-4fc1-83c6-58d38ef7c76d req-4e47a834-3cdf-4f04-99a3-472e2facbb58 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:02.419674 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-fb49ceeb-dd25-4fc1-83c6-58d38ef7c76d req-4e47a834-3cdf-4f04-99a3-472e2facbb58 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:02.434214 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-fb49ceeb-dd25-4fc1-83c6-58d38ef7c76d req-4e47a834-3cdf-4f04-99a3-472e2facbb58 service nova] Creating event network-vif-plugged:7e7a43a5-3a15-49a6-b50e-0ac0ac9faa8d for instance 82b86465-afb0-49ef-9932-1538010c1ae5 on n-h2-851028-13 Oct 04 18:42:02.441537 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-fb49ceeb-dd25-4fc1-83c6-58d38ef7c76d req-4e47a834-3cdf-4f04-99a3-472e2facbb58 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044172 Oct 04 18:42:02.442580 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1288/2703] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:42:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:42:02.449324 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-9e516d22-f795-41b8-9a7f-73217db12ad5 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:02.450363 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-9e516d22-f795-41b8-9a7f-73217db12ad5 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 82b86465-afb0-49ef-9932-1538010c1ae5] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:02.474739 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9e516d22-f795-41b8-9a7f-73217db12ad5 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:02.479815 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9e516d22-f795-41b8-9a7f-73217db12ad5 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:02.480485 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9e516d22-f795-41b8-9a7f-73217db12ad5 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:02.481541 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9e516d22-f795-41b8-9a7f-73217db12ad5 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:02.485275 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9e516d22-f795-41b8-9a7f-73217db12ad5 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:02.485951 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9e516d22-f795-41b8-9a7f-73217db12ad5 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:02.862222 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-634fa263-a806-4499-baa4-1246d16c6963 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9971b5861f44c1a1da94eda0f8f02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f809b8ae704988961908bef0f3cb24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:02.873572 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-634fa263-a806-4499-baa4-1246d16c6963 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] 10.222.0.43 "GET /compute/v2.1/servers/3d03e642-62aa-4ed5-8427-a10c4bd9698e" status: 200 len: 1311 microversion: 2.1 time: 1.470311 Oct 04 18:42:02.874725 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1416/2704] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:01 2022] GET /compute/v2.1/servers/3d03e642-62aa-4ed5-8427-a10c4bd9698e => generated 1311 bytes in 1472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:02.886893 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-23ac072d-9b5b-4ada-9c3b-848d818e0601 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:02.889606 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-23ac072d-9b5b-4ada-9c3b-848d818e0601 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: 07ed4416-8fdc-4468-97bd-3fa1b039f77b] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:02.897057 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-23ac072d-9b5b-4ada-9c3b-848d818e0601 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:02.897814 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-23ac072d-9b5b-4ada-9c3b-848d818e0601 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:02.898452 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-23ac072d-9b5b-4ada-9c3b-848d818e0601 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:02.899330 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-23ac072d-9b5b-4ada-9c3b-848d818e0601 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:02.899951 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-23ac072d-9b5b-4ada-9c3b-848d818e0601 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:02.900624 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-23ac072d-9b5b-4ada-9c3b-848d818e0601 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:03.268370 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-23ac072d-9b5b-4ada-9c3b-848d818e0601 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:03.285208 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-23ac072d-9b5b-4ada-9c3b-848d818e0601 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/07ed4416-8fdc-4468-97bd-3fa1b039f77b" status: 200 len: 1469 microversion: 2.1 time: 0.408572 Oct 04 18:42:03.286393 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1417/2705] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:02 2022] GET /compute/v2.1/servers/07ed4416-8fdc-4468-97bd-3fa1b039f77b => generated 1469 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:03.294357 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-a176aa49-eed0-488c-a0a7-36dc58f5ca6f tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:03.295315 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-a176aa49-eed0-488c-a0a7-36dc58f5ca6f tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] [instance: cbae126b-e99a-4c70-a9e7-0921a41e01ca] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:03.305358 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a176aa49-eed0-488c-a0a7-36dc58f5ca6f tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:03.306159 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a176aa49-eed0-488c-a0a7-36dc58f5ca6f tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:03.306856 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a176aa49-eed0-488c-a0a7-36dc58f5ca6f tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:03.307819 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a176aa49-eed0-488c-a0a7-36dc58f5ca6f tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:03.308571 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a176aa49-eed0-488c-a0a7-36dc58f5ca6f tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:03.309510 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a176aa49-eed0-488c-a0a7-36dc58f5ca6f tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:03.623569 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-9e516d22-f795-41b8-9a7f-73217db12ad5 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:03.640479 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-9e516d22-f795-41b8-9a7f-73217db12ad5 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5" status: 200 len: 1362 microversion: 2.1 time: 1.196365 Oct 04 18:42:03.657234 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1289/2706] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:02 2022] GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5 => generated 1362 bytes in 1200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:03.723016 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-a176aa49-eed0-488c-a0a7-36dc58f5ca6f tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2df20485e3d4c75b2f4fc7375adebb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f379b9ce44d942959b67137e546191c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:03.734736 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-a176aa49-eed0-488c-a0a7-36dc58f5ca6f tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] 10.222.0.43 "GET /compute/v2.1/servers/cbae126b-e99a-4c70-a9e7-0921a41e01ca" status: 200 len: 1304 microversion: 2.1 time: 0.446849 Oct 04 18:42:03.749137 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1418/2707] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:03 2022] GET /compute/v2.1/servers/cbae126b-e99a-4c70-a9e7-0921a41e01ca => generated 1304 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:03.901045 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-8fda5800-1764-4256-b5aa-9c03ce5de628 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:03.901810 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-8fda5800-1764-4256-b5aa-9c03ce5de628 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] [instance: 3d03e642-62aa-4ed5-8427-a10c4bd9698e] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:03.916066 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8fda5800-1764-4256-b5aa-9c03ce5de628 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:03.916766 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8fda5800-1764-4256-b5aa-9c03ce5de628 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:03.917739 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8fda5800-1764-4256-b5aa-9c03ce5de628 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:03.918692 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8fda5800-1764-4256-b5aa-9c03ce5de628 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:03.919951 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8fda5800-1764-4256-b5aa-9c03ce5de628 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:03.920497 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8fda5800-1764-4256-b5aa-9c03ce5de628 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:04.322530 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-aac2f0e6-7729-4e9d-9996-916a1d64afd1 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:04.326346 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-aac2f0e6-7729-4e9d-9996-916a1d64afd1 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: 07ed4416-8fdc-4468-97bd-3fa1b039f77b] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:04.337739 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=2 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:42:04.338926 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=10 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:42:04.343282 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-aac2f0e6-7729-4e9d-9996-916a1d64afd1 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:04.345378 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-aac2f0e6-7729-4e9d-9996-916a1d64afd1 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:04.364498 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-aac2f0e6-7729-4e9d-9996-916a1d64afd1 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:04.367374 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-aac2f0e6-7729-4e9d-9996-916a1d64afd1 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:04.380054 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-aac2f0e6-7729-4e9d-9996-916a1d64afd1 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:04.380911 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-aac2f0e6-7729-4e9d-9996-916a1d64afd1 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:04.535501 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-8fda5800-1764-4256-b5aa-9c03ce5de628 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9971b5861f44c1a1da94eda0f8f02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f809b8ae704988961908bef0f3cb24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:04.546524 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-8fda5800-1764-4256-b5aa-9c03ce5de628 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] 10.222.0.43 "GET /compute/v2.1/servers/3d03e642-62aa-4ed5-8427-a10c4bd9698e" status: 200 len: 1311 microversion: 2.1 time: 0.651545 Oct 04 18:42:04.552011 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1290/2708] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:03 2022] GET /compute/v2.1/servers/3d03e642-62aa-4ed5-8427-a10c4bd9698e => generated 1311 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:04.666179 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-71add4f1-9c68-4cfb-8944-dbd2c6596fc4 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:04.666772 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-71add4f1-9c68-4cfb-8944-dbd2c6596fc4 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 82b86465-afb0-49ef-9932-1538010c1ae5] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:04.680841 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-71add4f1-9c68-4cfb-8944-dbd2c6596fc4 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:04.681377 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-71add4f1-9c68-4cfb-8944-dbd2c6596fc4 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:04.681827 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-71add4f1-9c68-4cfb-8944-dbd2c6596fc4 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:04.682541 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-71add4f1-9c68-4cfb-8944-dbd2c6596fc4 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:04.682999 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-71add4f1-9c68-4cfb-8944-dbd2c6596fc4 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:04.683429 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-71add4f1-9c68-4cfb-8944-dbd2c6596fc4 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:04.760980 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=10 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:42:04.861940 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-aac2f0e6-7729-4e9d-9996-916a1d64afd1 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:04.876688 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-aac2f0e6-7729-4e9d-9996-916a1d64afd1 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/07ed4416-8fdc-4468-97bd-3fa1b039f77b" status: 200 len: 1469 microversion: 2.1 time: 0.565790 Oct 04 18:42:04.880986 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1419/2709] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:04 2022] GET /compute/v2.1/servers/07ed4416-8fdc-4468-97bd-3fa1b039f77b => generated 1469 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:04.904003 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-6ae7caeb-ceb4-48b9-be3a-824d4641d073 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:04.904627 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-6ae7caeb-ceb4-48b9-be3a-824d4641d073 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] [instance: cbae126b-e99a-4c70-a9e7-0921a41e01ca] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:04.929078 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6ae7caeb-ceb4-48b9-be3a-824d4641d073 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:04.935959 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6ae7caeb-ceb4-48b9-be3a-824d4641d073 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:04.936480 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6ae7caeb-ceb4-48b9-be3a-824d4641d073 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:04.941509 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6ae7caeb-ceb4-48b9-be3a-824d4641d073 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:04.943142 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6ae7caeb-ceb4-48b9-be3a-824d4641d073 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:04.943620 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6ae7caeb-ceb4-48b9-be3a-824d4641d073 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:05.539771 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-6ae7caeb-ceb4-48b9-be3a-824d4641d073 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2df20485e3d4c75b2f4fc7375adebb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f379b9ce44d942959b67137e546191c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:05.553786 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-6ae7caeb-ceb4-48b9-be3a-824d4641d073 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] 10.222.0.43 "GET /compute/v2.1/servers/cbae126b-e99a-4c70-a9e7-0921a41e01ca" status: 200 len: 1304 microversion: 2.1 time: 0.671536 Oct 04 18:42:05.554435 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1420/2710] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:04 2022] GET /compute/v2.1/servers/cbae126b-e99a-4c70-a9e7-0921a41e01ca => generated 1304 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:05.574672 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-9b6717f8-9fbc-4faa-86e0-dd38824ff897 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:05.575729 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-9b6717f8-9fbc-4faa-86e0-dd38824ff897 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] [instance: 3d03e642-62aa-4ed5-8427-a10c4bd9698e] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:05.589894 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9b6717f8-9fbc-4faa-86e0-dd38824ff897 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:05.590612 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9b6717f8-9fbc-4faa-86e0-dd38824ff897 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:05.591275 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9b6717f8-9fbc-4faa-86e0-dd38824ff897 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:05.592194 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9b6717f8-9fbc-4faa-86e0-dd38824ff897 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:05.596813 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9b6717f8-9fbc-4faa-86e0-dd38824ff897 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:05.597573 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9b6717f8-9fbc-4faa-86e0-dd38824ff897 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:06.271221 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-9b6717f8-9fbc-4faa-86e0-dd38824ff897 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9971b5861f44c1a1da94eda0f8f02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f809b8ae704988961908bef0f3cb24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:06.302827 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-9b6717f8-9fbc-4faa-86e0-dd38824ff897 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] 10.222.0.43 "GET /compute/v2.1/servers/3d03e642-62aa-4ed5-8427-a10c4bd9698e" status: 200 len: 1311 microversion: 2.1 time: 0.723935 Oct 04 18:42:06.316213 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1421/2711] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:05 2022] GET /compute/v2.1/servers/3d03e642-62aa-4ed5-8427-a10c4bd9698e => generated 1311 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:42:06.328082 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-a1db492d-227b-45ea-a7ab-e185343485ba tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:06.332949 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-a1db492d-227b-45ea-a7ab-e185343485ba tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: 07ed4416-8fdc-4468-97bd-3fa1b039f77b] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:06.352652 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a1db492d-227b-45ea-a7ab-e185343485ba tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:06.354324 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a1db492d-227b-45ea-a7ab-e185343485ba tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:06.355954 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a1db492d-227b-45ea-a7ab-e185343485ba tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:06.358896 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a1db492d-227b-45ea-a7ab-e185343485ba tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:06.359463 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a1db492d-227b-45ea-a7ab-e185343485ba tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:06.359923 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a1db492d-227b-45ea-a7ab-e185343485ba tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:06.700838 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-a1db492d-227b-45ea-a7ab-e185343485ba tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:06.709756 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-a1db492d-227b-45ea-a7ab-e185343485ba tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/07ed4416-8fdc-4468-97bd-3fa1b039f77b" status: 200 len: 1462 microversion: 2.1 time: 0.391903 Oct 04 18:42:06.715277 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1422/2712] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:06 2022] GET /compute/v2.1/servers/07ed4416-8fdc-4468-97bd-3fa1b039f77b => generated 1462 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:06.720278 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-16987fc8-531b-4c10-9adc-57f1fddf7dad tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:06.726169 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-16987fc8-531b-4c10-9adc-57f1fddf7dad tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] [instance: cbae126b-e99a-4c70-a9e7-0921a41e01ca] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:06.739786 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-16987fc8-531b-4c10-9adc-57f1fddf7dad tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:06.750044 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-16987fc8-531b-4c10-9adc-57f1fddf7dad tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:06.750759 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-16987fc8-531b-4c10-9adc-57f1fddf7dad tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:06.751702 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-16987fc8-531b-4c10-9adc-57f1fddf7dad tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:06.752360 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-16987fc8-531b-4c10-9adc-57f1fddf7dad tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:06.753003 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-16987fc8-531b-4c10-9adc-57f1fddf7dad tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:06.912509 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-71add4f1-9c68-4cfb-8944-dbd2c6596fc4 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:06.920876 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-71add4f1-9c68-4cfb-8944-dbd2c6596fc4 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5" status: 200 len: 1548 microversion: 2.1 time: 2.259598 Oct 04 18:42:06.927330 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1291/2713] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:04 2022] GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5 => generated 1548 bytes in 2267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:42:06.945888 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-0e45454b-904f-4ade-a258-59b113aafb27 tempest-MigrationsAdminTest-1571334602 tempest-MigrationsAdminTest-1571334602-project-admin] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:06.946917 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-0e45454b-904f-4ade-a258-59b113aafb27 tempest-MigrationsAdminTest-1571334602 tempest-MigrationsAdminTest-1571334602-project-admin] [instance: 07ed4416-8fdc-4468-97bd-3fa1b039f77b] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:06.958289 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0e45454b-904f-4ade-a258-59b113aafb27 tempest-MigrationsAdminTest-1571334602 tempest-MigrationsAdminTest-1571334602-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:06.959098 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0e45454b-904f-4ade-a258-59b113aafb27 tempest-MigrationsAdminTest-1571334602 tempest-MigrationsAdminTest-1571334602-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:06.959758 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0e45454b-904f-4ade-a258-59b113aafb27 tempest-MigrationsAdminTest-1571334602 tempest-MigrationsAdminTest-1571334602-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:06.960692 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0e45454b-904f-4ade-a258-59b113aafb27 tempest-MigrationsAdminTest-1571334602 tempest-MigrationsAdminTest-1571334602-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:06.961410 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0e45454b-904f-4ade-a258-59b113aafb27 tempest-MigrationsAdminTest-1571334602 tempest-MigrationsAdminTest-1571334602-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:06.962056 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0e45454b-904f-4ade-a258-59b113aafb27 tempest-MigrationsAdminTest-1571334602 tempest-MigrationsAdminTest-1571334602-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:07.211584 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-16987fc8-531b-4c10-9adc-57f1fddf7dad tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2df20485e3d4c75b2f4fc7375adebb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f379b9ce44d942959b67137e546191c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:07.226065 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-16987fc8-531b-4c10-9adc-57f1fddf7dad tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] 10.222.0.43 "GET /compute/v2.1/servers/cbae126b-e99a-4c70-a9e7-0921a41e01ca" status: 200 len: 1292 microversion: 2.1 time: 0.509505 Oct 04 18:42:07.226672 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1423/2714] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:06 2022] GET /compute/v2.1/servers/cbae126b-e99a-4c70-a9e7-0921a41e01ca => generated 1292 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:07.238151 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-df54e4c2-777d-45c6-b488-e44e1d163f51 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:07.238660 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-df54e4c2-777d-45c6-b488-e44e1d163f51 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 82b86465-afb0-49ef-9932-1538010c1ae5] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:07.257722 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-df54e4c2-777d-45c6-b488-e44e1d163f51 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:07.258288 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-df54e4c2-777d-45c6-b488-e44e1d163f51 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:07.258727 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-df54e4c2-777d-45c6-b488-e44e1d163f51 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:07.259449 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-df54e4c2-777d-45c6-b488-e44e1d163f51 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:07.260254 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-df54e4c2-777d-45c6-b488-e44e1d163f51 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:07.260630 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-df54e4c2-777d-45c6-b488-e44e1d163f51 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:07.585827 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-df54e4c2-777d-45c6-b488-e44e1d163f51 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.352288 Oct 04 18:42:07.587041 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1424/2715] 10.222.0.43 () {58 vars in 1275 bytes} [Tue Oct 4 18:42:07 2022] GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5/os-interface => generated 284 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:42:07.592172 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f3d75abe-fbeb-4c10-9d05-dae56122c593 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:07.593016 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-f3d75abe-fbeb-4c10-9d05-dae56122c593 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] [instance: 3d03e642-62aa-4ed5-8427-a10c4bd9698e] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:07.612648 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f3d75abe-fbeb-4c10-9d05-dae56122c593 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:07.613238 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f3d75abe-fbeb-4c10-9d05-dae56122c593 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:07.613622 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f3d75abe-fbeb-4c10-9d05-dae56122c593 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:07.614345 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f3d75abe-fbeb-4c10-9d05-dae56122c593 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:07.614810 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f3d75abe-fbeb-4c10-9d05-dae56122c593 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:07.615242 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f3d75abe-fbeb-4c10-9d05-dae56122c593 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:07.894512 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-0e45454b-904f-4ade-a258-59b113aafb27 tempest-MigrationsAdminTest-1571334602 tempest-MigrationsAdminTest-1571334602-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/07ed4416-8fdc-4468-97bd-3fa1b039f77b" status: 200 len: 1615 microversion: 2.1 time: 0.965662 Oct 04 18:42:07.896552 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1292/2716] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:06 2022] GET /compute/v2.1/servers/07ed4416-8fdc-4468-97bd-3fa1b039f77b => generated 1615 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:07.930681 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-3b0227d4-567c-49cc-8ea6-cb4f2d1651ab tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:07.931910 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-3b0227d4-567c-49cc-8ea6-cb4f2d1651ab tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: 07ed4416-8fdc-4468-97bd-3fa1b039f77b] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:07.944870 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3b0227d4-567c-49cc-8ea6-cb4f2d1651ab tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:07.945732 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3b0227d4-567c-49cc-8ea6-cb4f2d1651ab tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:07.946362 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3b0227d4-567c-49cc-8ea6-cb4f2d1651ab tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:07.947878 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3b0227d4-567c-49cc-8ea6-cb4f2d1651ab tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:07.948534 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3b0227d4-567c-49cc-8ea6-cb4f2d1651ab tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:07.949799 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3b0227d4-567c-49cc-8ea6-cb4f2d1651ab tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:07.989801 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-3b0227d4-567c-49cc-8ea6-cb4f2d1651ab tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: 07ed4416-8fdc-4468-97bd-3fa1b039f77b] Going to try to terminate instance {{(pid=123595) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:42:08.137769 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-3b0227d4-567c-49cc-8ea6-cb4f2d1651ab tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "DELETE /compute/v2.1/servers/07ed4416-8fdc-4468-97bd-3fa1b039f77b" status: 204 len: 0 microversion: 2.1 time: 0.213579 Oct 04 18:42:08.138729 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1293/2717] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 18:42:07 2022] DELETE /compute/v2.1/servers/07ed4416-8fdc-4468-97bd-3fa1b039f77b => generated 0 bytes in 215 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:42:08.151946 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-3f0cae01-3e9a-425d-99d2-fafb8582c83a tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:08.153868 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-3f0cae01-3e9a-425d-99d2-fafb8582c83a tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: 07ed4416-8fdc-4468-97bd-3fa1b039f77b] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:08.174966 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3f0cae01-3e9a-425d-99d2-fafb8582c83a tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:08.176308 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3f0cae01-3e9a-425d-99d2-fafb8582c83a tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:08.176937 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3f0cae01-3e9a-425d-99d2-fafb8582c83a tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:08.177906 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3f0cae01-3e9a-425d-99d2-fafb8582c83a tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:08.178649 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3f0cae01-3e9a-425d-99d2-fafb8582c83a tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:08.179236 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3f0cae01-3e9a-425d-99d2-fafb8582c83a tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:08.711319 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-3f0cae01-3e9a-425d-99d2-fafb8582c83a tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:08.713911 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-f3d75abe-fbeb-4c10-9d05-dae56122c593 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9971b5861f44c1a1da94eda0f8f02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f809b8ae704988961908bef0f3cb24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:08.732411 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-3f0cae01-3e9a-425d-99d2-fafb8582c83a tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/07ed4416-8fdc-4468-97bd-3fa1b039f77b" status: 200 len: 1468 microversion: 2.1 time: 0.588123 Oct 04 18:42:08.737043 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1294/2718] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:08 2022] GET /compute/v2.1/servers/07ed4416-8fdc-4468-97bd-3fa1b039f77b => generated 1468 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:08.752042 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-7a801e13-d824-4afb-baa6-8d6351c84ce2 req-957f3ee5-f72f-428c-adbf-403436ab1c1e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cbae126b-e99a-4c70-a9e7-0921a41e01ca", "tag": "c406a273-b78c-4fe1-b66a-ad30e702c41b"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:42:08.774879 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-f3d75abe-fbeb-4c10-9d05-dae56122c593 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] 10.222.0.43 "GET /compute/v2.1/servers/3d03e642-62aa-4ed5-8427-a10c4bd9698e" status: 200 len: 1311 microversion: 2.1 time: 1.184128 Oct 04 18:42:08.781228 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1425/2719] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:07 2022] GET /compute/v2.1/servers/3d03e642-62aa-4ed5-8427-a10c4bd9698e => generated 1311 bytes in 1193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:08.781693 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-7a801e13-d824-4afb-baa6-8d6351c84ce2 req-957f3ee5-f72f-428c-adbf-403436ab1c1e service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:08.785410 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-7a801e13-d824-4afb-baa6-8d6351c84ce2 req-957f3ee5-f72f-428c-adbf-403436ab1c1e service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:08.786117 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-7a801e13-d824-4afb-baa6-8d6351c84ce2 req-957f3ee5-f72f-428c-adbf-403436ab1c1e service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:08.789165 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-ea07e5d6-8aef-464c-aec8-613cc37e5cbe tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:08.796263 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-ea07e5d6-8aef-464c-aec8-613cc37e5cbe tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] [instance: cbae126b-e99a-4c70-a9e7-0921a41e01ca] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:08.810476 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ea07e5d6-8aef-464c-aec8-613cc37e5cbe tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:08.813764 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-7a801e13-d824-4afb-baa6-8d6351c84ce2 req-957f3ee5-f72f-428c-adbf-403436ab1c1e service nova] Creating event network-changed:c406a273-b78c-4fe1-b66a-ad30e702c41b for instance cbae126b-e99a-4c70-a9e7-0921a41e01ca on n-h2-851028-13 Oct 04 18:42:08.814912 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ea07e5d6-8aef-464c-aec8-613cc37e5cbe tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:08.815710 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ea07e5d6-8aef-464c-aec8-613cc37e5cbe tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:08.817782 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ea07e5d6-8aef-464c-aec8-613cc37e5cbe tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:08.829295 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ea07e5d6-8aef-464c-aec8-613cc37e5cbe tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:08.831075 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-7a801e13-d824-4afb-baa6-8d6351c84ce2 req-957f3ee5-f72f-428c-adbf-403436ab1c1e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091906 Oct 04 18:42:08.832037 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1295/2720] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:42:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:42:08.834866 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ea07e5d6-8aef-464c-aec8-613cc37e5cbe tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:09.278944 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-aa813002-5230-417c-8256-1bd71d74ff14 req-33cfdf56-075b-464b-a3ba-065951ccba11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d03e642-62aa-4ed5-8427-a10c4bd9698e", "name": "network-vif-plugged", "status": "completed", "tag": "53dfc1e3-b31a-4aab-8977-3a9c6a1f79ae"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:42:09.319662 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-aa813002-5230-417c-8256-1bd71d74ff14 req-33cfdf56-075b-464b-a3ba-065951ccba11 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:09.320367 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-aa813002-5230-417c-8256-1bd71d74ff14 req-33cfdf56-075b-464b-a3ba-065951ccba11 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:09.328357 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-aa813002-5230-417c-8256-1bd71d74ff14 req-33cfdf56-075b-464b-a3ba-065951ccba11 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:09.365271 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-aa813002-5230-417c-8256-1bd71d74ff14 req-33cfdf56-075b-464b-a3ba-065951ccba11 service nova] Creating event network-vif-plugged:53dfc1e3-b31a-4aab-8977-3a9c6a1f79ae for instance 3d03e642-62aa-4ed5-8427-a10c4bd9698e on n-h1-851028-13 Oct 04 18:42:09.373377 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-aa813002-5230-417c-8256-1bd71d74ff14 req-33cfdf56-075b-464b-a3ba-065951ccba11 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110125 Oct 04 18:42:09.374448 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1296/2721] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:42:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:42:09.386011 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-ea07e5d6-8aef-464c-aec8-613cc37e5cbe tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2df20485e3d4c75b2f4fc7375adebb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f379b9ce44d942959b67137e546191c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:09.406135 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-ea07e5d6-8aef-464c-aec8-613cc37e5cbe tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] 10.222.0.43 "GET /compute/v2.1/servers/cbae126b-e99a-4c70-a9e7-0921a41e01ca" status: 200 len: 1292 microversion: 2.1 time: 0.622979 Oct 04 18:42:09.406734 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1426/2722] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:08 2022] GET /compute/v2.1/servers/cbae126b-e99a-4c70-a9e7-0921a41e01ca => generated 1292 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:09.760435 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-8896feb7-5839-4e68-8d92-ac14749ffd3a tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:09.761182 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-8896feb7-5839-4e68-8d92-ac14749ffd3a tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: 07ed4416-8fdc-4468-97bd-3fa1b039f77b] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:09.770600 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8896feb7-5839-4e68-8d92-ac14749ffd3a tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:09.771643 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8896feb7-5839-4e68-8d92-ac14749ffd3a tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:09.772522 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8896feb7-5839-4e68-8d92-ac14749ffd3a tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:09.773814 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8896feb7-5839-4e68-8d92-ac14749ffd3a tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:09.776405 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8896feb7-5839-4e68-8d92-ac14749ffd3a tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:09.779875 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8896feb7-5839-4e68-8d92-ac14749ffd3a tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:09.804257 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-eef50ab3-5e2e-46d0-8c0b-31aedbe16f9d tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:09.804876 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-eef50ab3-5e2e-46d0-8c0b-31aedbe16f9d tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] [instance: 3d03e642-62aa-4ed5-8427-a10c4bd9698e] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:09.824689 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-eef50ab3-5e2e-46d0-8c0b-31aedbe16f9d tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:09.825593 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-eef50ab3-5e2e-46d0-8c0b-31aedbe16f9d tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:09.826260 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-eef50ab3-5e2e-46d0-8c0b-31aedbe16f9d tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:09.827183 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-eef50ab3-5e2e-46d0-8c0b-31aedbe16f9d tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:09.827870 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-eef50ab3-5e2e-46d0-8c0b-31aedbe16f9d tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:09.828557 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-eef50ab3-5e2e-46d0-8c0b-31aedbe16f9d tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:10.552314 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-8896feb7-5839-4e68-8d92-ac14749ffd3a tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:10.563234 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-8896feb7-5839-4e68-8d92-ac14749ffd3a tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/07ed4416-8fdc-4468-97bd-3fa1b039f77b" status: 200 len: 1468 microversion: 2.1 time: 0.806960 Oct 04 18:42:10.565462 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1297/2723] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:09 2022] GET /compute/v2.1/servers/07ed4416-8fdc-4468-97bd-3fa1b039f77b => generated 1468 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:10.573908 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-d5a0ae80-a384-428a-a470-41c6d9c03880 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:10.577842 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-d5a0ae80-a384-428a-a470-41c6d9c03880 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] [instance: cbae126b-e99a-4c70-a9e7-0921a41e01ca] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:10.586316 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d5a0ae80-a384-428a-a470-41c6d9c03880 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:10.589779 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d5a0ae80-a384-428a-a470-41c6d9c03880 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:10.590453 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d5a0ae80-a384-428a-a470-41c6d9c03880 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:10.591390 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d5a0ae80-a384-428a-a470-41c6d9c03880 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:10.592016 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d5a0ae80-a384-428a-a470-41c6d9c03880 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:10.593216 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d5a0ae80-a384-428a-a470-41c6d9c03880 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:10.804891 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-eef50ab3-5e2e-46d0-8c0b-31aedbe16f9d tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9971b5861f44c1a1da94eda0f8f02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f809b8ae704988961908bef0f3cb24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:10.814243 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-eef50ab3-5e2e-46d0-8c0b-31aedbe16f9d tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] 10.222.0.43 "GET /compute/v2.1/servers/3d03e642-62aa-4ed5-8427-a10c4bd9698e" status: 200 len: 1311 microversion: 2.1 time: 1.013630 Oct 04 18:42:10.817169 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1427/2724] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:09 2022] GET /compute/v2.1/servers/3d03e642-62aa-4ed5-8427-a10c4bd9698e => generated 1311 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:11.180451 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-d5a0ae80-a384-428a-a470-41c6d9c03880 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2df20485e3d4c75b2f4fc7375adebb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f379b9ce44d942959b67137e546191c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:11.197903 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-d5a0ae80-a384-428a-a470-41c6d9c03880 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] 10.222.0.43 "GET /compute/v2.1/servers/cbae126b-e99a-4c70-a9e7-0921a41e01ca" status: 200 len: 1292 microversion: 2.1 time: 0.630455 Oct 04 18:42:11.198502 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1298/2725] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:10 2022] GET /compute/v2.1/servers/cbae126b-e99a-4c70-a9e7-0921a41e01ca => generated 1292 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:11.588236 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-9653450f-daee-498c-99ba-70e9757aafe5 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:11.589090 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-9653450f-daee-498c-99ba-70e9757aafe5 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: 07ed4416-8fdc-4468-97bd-3fa1b039f77b] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:11.605068 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9653450f-daee-498c-99ba-70e9757aafe5 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:11.606115 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9653450f-daee-498c-99ba-70e9757aafe5 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:11.606848 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9653450f-daee-498c-99ba-70e9757aafe5 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:11.607839 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9653450f-daee-498c-99ba-70e9757aafe5 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:11.608522 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9653450f-daee-498c-99ba-70e9757aafe5 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:11.609313 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9653450f-daee-498c-99ba-70e9757aafe5 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:11.849056 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-57a938fe-0b90-4dd6-9ed9-807f4b4e975c tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:11.849767 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-57a938fe-0b90-4dd6-9ed9-807f4b4e975c tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] [instance: 3d03e642-62aa-4ed5-8427-a10c4bd9698e] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:11.857860 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-57a938fe-0b90-4dd6-9ed9-807f4b4e975c tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:11.858364 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-57a938fe-0b90-4dd6-9ed9-807f4b4e975c tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:11.858808 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-57a938fe-0b90-4dd6-9ed9-807f4b4e975c tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:11.864233 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-57a938fe-0b90-4dd6-9ed9-807f4b4e975c tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:11.865304 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-57a938fe-0b90-4dd6-9ed9-807f4b4e975c tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:11.865922 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-57a938fe-0b90-4dd6-9ed9-807f4b4e975c tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:12.180511 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-9653450f-daee-498c-99ba-70e9757aafe5 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:12.189430 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-9653450f-daee-498c-99ba-70e9757aafe5 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/07ed4416-8fdc-4468-97bd-3fa1b039f77b" status: 200 len: 1468 microversion: 2.1 time: 0.605198 Oct 04 18:42:12.196475 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1428/2726] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:11 2022] GET /compute/v2.1/servers/07ed4416-8fdc-4468-97bd-3fa1b039f77b => generated 1468 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:12.211227 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-5db8131e-f3e3-4a5d-a554-7d52808e2111 req-28adb5b2-91f3-423f-822e-86c77597e040 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82b86465-afb0-49ef-9932-1538010c1ae5", "tag": "7e7a43a5-3a15-49a6-b50e-0ac0ac9faa8d"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:42:12.239935 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-5db8131e-f3e3-4a5d-a554-7d52808e2111 req-28adb5b2-91f3-423f-822e-86c77597e040 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:12.242724 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-5db8131e-f3e3-4a5d-a554-7d52808e2111 req-28adb5b2-91f3-423f-822e-86c77597e040 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:12.243250 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-5db8131e-f3e3-4a5d-a554-7d52808e2111 req-28adb5b2-91f3-423f-822e-86c77597e040 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:12.272829 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-5db8131e-f3e3-4a5d-a554-7d52808e2111 req-28adb5b2-91f3-423f-822e-86c77597e040 service nova] Creating event network-changed:7e7a43a5-3a15-49a6-b50e-0ac0ac9faa8d for instance 82b86465-afb0-49ef-9932-1538010c1ae5 on n-h2-851028-13 Oct 04 18:42:12.298874 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-5db8131e-f3e3-4a5d-a554-7d52808e2111 req-28adb5b2-91f3-423f-822e-86c77597e040 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100283 Oct 04 18:42:12.299514 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1429/2727] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:42:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:42:12.311976 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-d8588a70-6965-4bf9-87fb-c756a65586e4 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:12.315823 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-d8588a70-6965-4bf9-87fb-c756a65586e4 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] [instance: cbae126b-e99a-4c70-a9e7-0921a41e01ca] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:12.322408 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d8588a70-6965-4bf9-87fb-c756a65586e4 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:12.323111 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d8588a70-6965-4bf9-87fb-c756a65586e4 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:12.323756 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d8588a70-6965-4bf9-87fb-c756a65586e4 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:12.324621 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d8588a70-6965-4bf9-87fb-c756a65586e4 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:12.325262 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d8588a70-6965-4bf9-87fb-c756a65586e4 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:12.325866 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d8588a70-6965-4bf9-87fb-c756a65586e4 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:12.602308 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-57a938fe-0b90-4dd6-9ed9-807f4b4e975c tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9971b5861f44c1a1da94eda0f8f02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f809b8ae704988961908bef0f3cb24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:12.618159 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-57a938fe-0b90-4dd6-9ed9-807f4b4e975c tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] 10.222.0.43 "GET /compute/v2.1/servers/3d03e642-62aa-4ed5-8427-a10c4bd9698e" status: 200 len: 1493 microversion: 2.1 time: 0.773111 Oct 04 18:42:12.619069 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1299/2728] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:11 2022] GET /compute/v2.1/servers/3d03e642-62aa-4ed5-8427-a10c4bd9698e => generated 1493 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:12.975587 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-d8588a70-6965-4bf9-87fb-c756a65586e4 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2df20485e3d4c75b2f4fc7375adebb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f379b9ce44d942959b67137e546191c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:12.993540 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-d8588a70-6965-4bf9-87fb-c756a65586e4 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] 10.222.0.43 "GET /compute/v2.1/servers/cbae126b-e99a-4c70-a9e7-0921a41e01ca" status: 200 len: 1292 microversion: 2.1 time: 0.692563 Oct 04 18:42:12.999564 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1430/2729] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:12 2022] GET /compute/v2.1/servers/cbae126b-e99a-4c70-a9e7-0921a41e01ca => generated 1292 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:13.075655 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-e5365bab-bc3b-43d6-acd6-a458f53c9f0e tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:13.076351 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-e5365bab-bc3b-43d6-acd6-a458f53c9f0e tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] [instance: 3d03e642-62aa-4ed5-8427-a10c4bd9698e] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:13.093457 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-e0e41f98-81b9-4cd5-8138-ffa952a7751f req-1458a2b3-7e61-4e43-975a-162bf36e03eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07ed4416-8fdc-4468-97bd-3fa1b039f77b", "name": "network-vif-deleted", "tag": "8ca0d053-912a-4590-9b08-aa9f36208d96"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:42:13.102728 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e5365bab-bc3b-43d6-acd6-a458f53c9f0e tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:13.104782 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e5365bab-bc3b-43d6-acd6-a458f53c9f0e tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:13.106368 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e5365bab-bc3b-43d6-acd6-a458f53c9f0e tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:13.109050 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e5365bab-bc3b-43d6-acd6-a458f53c9f0e tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:13.112316 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e5365bab-bc3b-43d6-acd6-a458f53c9f0e tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:13.114941 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e5365bab-bc3b-43d6-acd6-a458f53c9f0e tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:13.121993 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-e0e41f98-81b9-4cd5-8138-ffa952a7751f req-1458a2b3-7e61-4e43-975a-162bf36e03eb service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:13.124326 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-e0e41f98-81b9-4cd5-8138-ffa952a7751f req-1458a2b3-7e61-4e43-975a-162bf36e03eb service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:13.126672 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-e0e41f98-81b9-4cd5-8138-ffa952a7751f req-1458a2b3-7e61-4e43-975a-162bf36e03eb service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:13.143268 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:42:13.162593 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-e0e41f98-81b9-4cd5-8138-ffa952a7751f req-1458a2b3-7e61-4e43-975a-162bf36e03eb service nova] Creating event network-vif-deleted:8ca0d053-912a-4590-9b08-aa9f36208d96 for instance 07ed4416-8fdc-4468-97bd-3fa1b039f77b on n-h2-851028-13 Oct 04 18:42:13.174086 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-e0e41f98-81b9-4cd5-8138-ffa952a7751f req-1458a2b3-7e61-4e43-975a-162bf36e03eb service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097027 Oct 04 18:42:13.176630 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1431/2730] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:42:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:42:13.221906 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-c329950c-9ae9-42e0-9b59-af6a89e6f021 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:13.223639 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-c329950c-9ae9-42e0-9b59-af6a89e6f021 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: 07ed4416-8fdc-4468-97bd-3fa1b039f77b] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:13.236865 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c329950c-9ae9-42e0-9b59-af6a89e6f021 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:13.239067 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c329950c-9ae9-42e0-9b59-af6a89e6f021 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:13.242394 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c329950c-9ae9-42e0-9b59-af6a89e6f021 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:13.246028 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c329950c-9ae9-42e0-9b59-af6a89e6f021 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:13.249318 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c329950c-9ae9-42e0-9b59-af6a89e6f021 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:13.250102 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c329950c-9ae9-42e0-9b59-af6a89e6f021 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:13.379751 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c329950c-9ae9-42e0-9b59-af6a89e6f021 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:13.380243 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c329950c-9ae9-42e0-9b59-af6a89e6f021 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:13.380879 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c329950c-9ae9-42e0-9b59-af6a89e6f021 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:13.381517 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.objects.instance [None req-c329950c-9ae9-42e0-9b59-af6a89e6f021 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lazy-loading 'fault' on Instance uuid 07ed4416-8fdc-4468-97bd-3fa1b039f77b {{(pid=123596) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:42:13.530735 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-c329950c-9ae9-42e0-9b59-af6a89e6f021 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:13.542745 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-c329950c-9ae9-42e0-9b59-af6a89e6f021 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/07ed4416-8fdc-4468-97bd-3fa1b039f77b" status: 200 len: 1303 microversion: 2.1 time: 0.326425 Oct 04 18:42:13.543669 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1432/2731] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:13 2022] GET /compute/v2.1/servers/07ed4416-8fdc-4468-97bd-3fa1b039f77b => generated 1303 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:14.022791 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-644c6c81-0691-45f5-88cc-091cac21b888 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:14.023412 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-644c6c81-0691-45f5-88cc-091cac21b888 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] [instance: cbae126b-e99a-4c70-a9e7-0921a41e01ca] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:14.043944 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-644c6c81-0691-45f5-88cc-091cac21b888 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:14.044443 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-644c6c81-0691-45f5-88cc-091cac21b888 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:14.044887 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-644c6c81-0691-45f5-88cc-091cac21b888 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:14.045629 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-644c6c81-0691-45f5-88cc-091cac21b888 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:14.046086 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-644c6c81-0691-45f5-88cc-091cac21b888 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:14.046512 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-644c6c81-0691-45f5-88cc-091cac21b888 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:14.072581 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=100 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:42:14.078694 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-e5365bab-bc3b-43d6-acd6-a458f53c9f0e tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/3d03e642-62aa-4ed5-8427-a10c4bd9698e" status: 200 len: 1646 microversion: 2.1 time: 1.434272 Oct 04 18:42:14.080381 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1300/2732] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:12 2022] GET /compute/v2.1/servers/3d03e642-62aa-4ed5-8427-a10c4bd9698e => generated 1646 bytes in 1437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:14.103429 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-715570ba-a652-44a0-9e38-59d11483507c tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:14.104347 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-715570ba-a652-44a0-9e38-59d11483507c tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] [instance: 3d03e642-62aa-4ed5-8427-a10c4bd9698e] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:14.111719 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-715570ba-a652-44a0-9e38-59d11483507c tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:14.116729 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-715570ba-a652-44a0-9e38-59d11483507c tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:14.117505 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-715570ba-a652-44a0-9e38-59d11483507c tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:14.118601 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-715570ba-a652-44a0-9e38-59d11483507c tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:14.119406 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-715570ba-a652-44a0-9e38-59d11483507c tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:14.120949 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-715570ba-a652-44a0-9e38-59d11483507c tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:14.462680 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-644c6c81-0691-45f5-88cc-091cac21b888 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2df20485e3d4c75b2f4fc7375adebb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f379b9ce44d942959b67137e546191c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:14.539318 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-644c6c81-0691-45f5-88cc-091cac21b888 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] 10.222.0.43 "GET /compute/v2.1/servers/cbae126b-e99a-4c70-a9e7-0921a41e01ca" status: 200 len: 1292 microversion: 2.1 time: 0.519486 Oct 04 18:42:14.539318 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1433/2733] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:14 2022] GET /compute/v2.1/servers/cbae126b-e99a-4c70-a9e7-0921a41e01ca => generated 1292 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:14.566640 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-68ec3402-3ed5-4874-9a46-1a393ed96ef5 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:14.567299 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-68ec3402-3ed5-4874-9a46-1a393ed96ef5 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: 07ed4416-8fdc-4468-97bd-3fa1b039f77b] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:14.574269 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-68ec3402-3ed5-4874-9a46-1a393ed96ef5 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:14.574950 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-68ec3402-3ed5-4874-9a46-1a393ed96ef5 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:14.575564 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-68ec3402-3ed5-4874-9a46-1a393ed96ef5 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:14.576646 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-68ec3402-3ed5-4874-9a46-1a393ed96ef5 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:14.577455 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-68ec3402-3ed5-4874-9a46-1a393ed96ef5 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:14.578196 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-68ec3402-3ed5-4874-9a46-1a393ed96ef5 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:14.597834 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-68ec3402-3ed5-4874-9a46-1a393ed96ef5 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] HTTP exception thrown: Instance 07ed4416-8fdc-4468-97bd-3fa1b039f77b could not be found. Oct 04 18:42:14.604100 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-68ec3402-3ed5-4874-9a46-1a393ed96ef5 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Request method failure captured: Oct 04 18:42:14.604100 n-d-851028-13 devstack@n-api.service[123596]: request: GET /compute/v2.1/servers/07ed4416-8fdc-4468-97bd-3fa1b039f77b HTTP/1.1 Oct 04 18:42:14.604100 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:42:14.604100 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:42:14.604100 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:42:14.604100 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 18:42:14.604100 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:42:14.604100 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:42:14.604100 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:42:14.604100 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:42:14.604100 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPH0NoXgCy3n6sh1IGXjtfaHzlhYMuJpKcXPppfdRHbcKj96890BlFug3pTj2ae4hfUq7QwMio-uyNDngu9EC-WiWL2uy_k9NT0WkTh-babPsSjAzcuYjZjQlwoCrlTamTWYDHmmNVgGFwgEOV5-_lM17JGx4pac-wizTUHPmJe6XS4g Oct 04 18:42:14.604100 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:42:14.604100 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:42:14.604100 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:42:14.604100 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:42:14.604100 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:42:14.604100 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:42:14.604100 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: 50a6a1a86a59403dad27f6e3c628853c Oct 04 18:42:14.604100 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-MigrationsAdminTest-1383787507 Oct 04 18:42:14.604100 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 18:42:14.604100 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 18:42:14.604100 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/50a6a1a86a59403dad27f6e3c628853c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_50a6a1a86a59403dad27f6e3c628853c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/50a6a1a86a59403dad27f6e3c628853c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/50a6a1a86a59403dad27f6e3c628853c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:42:14.604100 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-MigrationsAdminTest-1383787507 Oct 04 18:42:14.604100 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: 50a6a1a86a59403dad27f6e3c628853c Oct 04 18:42:14.604100 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-MigrationsAdminTest-1383787507 Oct 04 18:42:14.604100 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-MigrationsAdminTest-1383787507-project Oct 04 18:42:14.604100 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:42:14.604100 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:42:14.604100 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 581885ffa737444eafa3179cceb6ee1d Oct 04 18:42:14.604100 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-MigrationsAdminTest-1383787507-project Oct 04 18:42:14.604100 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 18:42:14.604100 n-d-851028-13 devstack@n-api.service[123596]: exception: Instance 07ed4416-8fdc-4468-97bd-3fa1b039f77b could not be found. Oct 04 18:42:14.604100 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': '07ed4416-8fdc-4468-97bd-3fa1b039f77b'} Oct 04 18:42:14.604100 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:42:14.604100 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:42:14.604100 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:42:14.604100 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:42:14.604100 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:42:14.604100 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:42:14.604100 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:42:14.604100 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:42:14.604100 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:42:14.604100 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:42:14.604100 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 07ed4416-8fdc-4468-97bd-3fa1b039f77b could not be found. Oct 04 18:42:14.604100 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:42:14.604100 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:42:14.604100 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:42:14.604100 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:42:14.604100 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:42:14.604100 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:42:14.604100 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:42:14.604100 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:42:14.604100 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:42:14.604100 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:42:14.604100 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:42:14.604100 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:42:14.604100 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:42:14.604100 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:42:14.604100 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:42:14.604100 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:42:14.604100 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 07ed4416-8fdc-4468-97bd-3fa1b039f77b could not be found. Oct 04 18:42:14.604100 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:42:14.604100 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:42:14.604100 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:42:14.608349 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:42:14.608349 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:42:14.608349 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:42:14.608349 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:42:14.608349 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:42:14.608349 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 07ed4416-8fdc-4468-97bd-3fa1b039f77b could not be found. Oct 04 18:42:14.608349 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:42:14.611257 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-68ec3402-3ed5-4874-9a46-1a393ed96ef5 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Returning 404 to user: Instance 07ed4416-8fdc-4468-97bd-3fa1b039f77b could not be found. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:42:14.612357 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-68ec3402-3ed5-4874-9a46-1a393ed96ef5 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/07ed4416-8fdc-4468-97bd-3fa1b039f77b" status: 404 len: 111 microversion: 2.1 time: 0.050304 Oct 04 18:42:14.613578 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1434/2734] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:14 2022] GET /compute/v2.1/servers/07ed4416-8fdc-4468-97bd-3fa1b039f77b => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:42:14.621417 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-a62a7477-fd82-4eb1-b070-93a0549fbdc0 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:14.622161 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-a62a7477-fd82-4eb1-b070-93a0549fbdc0 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: d9d4332a-97b6-40f1-bd7c-a9a75a9adc43] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:14.629685 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a62a7477-fd82-4eb1-b070-93a0549fbdc0 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:14.630482 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a62a7477-fd82-4eb1-b070-93a0549fbdc0 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:14.631089 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a62a7477-fd82-4eb1-b070-93a0549fbdc0 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:14.631949 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a62a7477-fd82-4eb1-b070-93a0549fbdc0 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:14.632576 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a62a7477-fd82-4eb1-b070-93a0549fbdc0 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:14.633184 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a62a7477-fd82-4eb1-b070-93a0549fbdc0 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:14.672271 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-a62a7477-fd82-4eb1-b070-93a0549fbdc0 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: d9d4332a-97b6-40f1-bd7c-a9a75a9adc43] Going to try to terminate instance {{(pid=123596) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:42:14.807749 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-715570ba-a652-44a0-9e38-59d11483507c tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/3d03e642-62aa-4ed5-8427-a10c4bd9698e" status: 200 len: 1646 microversion: 2.1 time: 0.698819 Oct 04 18:42:14.809982 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1301/2735] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:14 2022] GET /compute/v2.1/servers/3d03e642-62aa-4ed5-8427-a10c4bd9698e => generated 1646 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:14.815306 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-a62a7477-fd82-4eb1-b070-93a0549fbdc0 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "DELETE /compute/v2.1/servers/d9d4332a-97b6-40f1-bd7c-a9a75a9adc43" status: 204 len: 0 microversion: 2.1 time: 0.197374 Oct 04 18:42:14.816087 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1435/2736] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 18:42:14 2022] DELETE /compute/v2.1/servers/d9d4332a-97b6-40f1-bd7c-a9a75a9adc43 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 18:42:14.827355 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-78b811a4-b148-435e-a997-6a76b1bc2bac tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:14.830340 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-78b811a4-b148-435e-a997-6a76b1bc2bac tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: d9d4332a-97b6-40f1-bd7c-a9a75a9adc43] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:14.837203 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-5a0b7b34-f802-4581-87a6-a220c65eb29c tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:14.841150 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5a0b7b34-f802-4581-87a6-a220c65eb29c tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:14.843383 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5a0b7b34-f802-4581-87a6-a220c65eb29c tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:14.843843 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5a0b7b34-f802-4581-87a6-a220c65eb29c tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:14.846413 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5a0b7b34-f802-4581-87a6-a220c65eb29c tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:14.846891 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5a0b7b34-f802-4581-87a6-a220c65eb29c tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:14.848014 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5a0b7b34-f802-4581-87a6-a220c65eb29c tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:14.851037 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:42:14.852944 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-78b811a4-b148-435e-a997-6a76b1bc2bac tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:14.853484 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-78b811a4-b148-435e-a997-6a76b1bc2bac tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:14.855057 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-78b811a4-b148-435e-a997-6a76b1bc2bac tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:14.856387 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-78b811a4-b148-435e-a997-6a76b1bc2bac tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:14.857031 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-78b811a4-b148-435e-a997-6a76b1bc2bac tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:14.857945 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-78b811a4-b148-435e-a997-6a76b1bc2bac tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:14.907245 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-5a0b7b34-f802-4581-87a6-a220c65eb29c tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] 10.222.0.43 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.074731 Oct 04 18:42:14.915380 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1436/2737] 10.222.0.43 () {58 vars in 1176 bytes} [Tue Oct 4 18:42:14 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:42:14.928339 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f52a25fe-72dd-4787-b042-e0d3adb91019 tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-851028-13", "block_migration": true, "disk_over_commit": false}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:42:14.931346 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-f52a25fe-72dd-4787-b042-e0d3adb91019 tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] [instance: 3d03e642-62aa-4ed5-8427-a10c4bd9698e] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:14.942957 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f52a25fe-72dd-4787-b042-e0d3adb91019 tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:14.956798 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f52a25fe-72dd-4787-b042-e0d3adb91019 tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:14.957980 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f52a25fe-72dd-4787-b042-e0d3adb91019 tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:14.964283 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f52a25fe-72dd-4787-b042-e0d3adb91019 tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:14.965245 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f52a25fe-72dd-4787-b042-e0d3adb91019 tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:14.965874 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f52a25fe-72dd-4787-b042-e0d3adb91019 tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:15.019445 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.objects.instance [None req-f52a25fe-72dd-4787-b042-e0d3adb91019 tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] Lazy-loading 'flavor' on Instance uuid 3d03e642-62aa-4ed5-8427-a10c4bd9698e {{(pid=123596) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:42:15.038971 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-f52a25fe-72dd-4787-b042-e0d3adb91019 tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] [instance: 3d03e642-62aa-4ed5-8427-a10c4bd9698e] Going to try to live migrate instance to n-h2-851028-13 {{(pid=123596) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 04 18:42:16.005530 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-78b811a4-b148-435e-a997-6a76b1bc2bac tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:16.014693 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-78b811a4-b148-435e-a997-6a76b1bc2bac tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/d9d4332a-97b6-40f1-bd7c-a9a75a9adc43" status: 200 len: 1534 microversion: 2.1 time: 1.192877 Oct 04 18:42:16.029956 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1302/2738] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:14 2022] GET /compute/v2.1/servers/d9d4332a-97b6-40f1-bd7c-a9a75a9adc43 => generated 1534 bytes in 1209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:16.035750 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-ed85db2c-170a-480a-a843-491aee81588f tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:16.036668 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-ed85db2c-170a-480a-a843-491aee81588f tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] [instance: cbae126b-e99a-4c70-a9e7-0921a41e01ca] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:16.044040 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ed85db2c-170a-480a-a843-491aee81588f tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:16.048656 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ed85db2c-170a-480a-a843-491aee81588f tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:16.049407 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ed85db2c-170a-480a-a843-491aee81588f tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:16.050397 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ed85db2c-170a-480a-a843-491aee81588f tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:16.061545 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ed85db2c-170a-480a-a843-491aee81588f tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:16.062355 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ed85db2c-170a-480a-a843-491aee81588f tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:16.431980 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-ed85db2c-170a-480a-a843-491aee81588f tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2df20485e3d4c75b2f4fc7375adebb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f379b9ce44d942959b67137e546191c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:16.446007 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-ed85db2c-170a-480a-a843-491aee81588f tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] 10.222.0.43 "GET /compute/v2.1/servers/cbae126b-e99a-4c70-a9e7-0921a41e01ca" status: 200 len: 1292 microversion: 2.1 time: 0.413133 Oct 04 18:42:16.448463 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1303/2739] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:16 2022] GET /compute/v2.1/servers/cbae126b-e99a-4c70-a9e7-0921a41e01ca => generated 1292 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:16.668573 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-1df6564e-4fcf-4288-b824-d106ec512def tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-149495936", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:42:16.777508 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.network.neutron [None req-1df6564e-4fcf-4288-b824-d106ec512def tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] validate_networks() for [('b4aa97d5-c2a2-43c0-80f6-feae0c060a28', None, None, None, None, None)] {{(pid=123595) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:42:17.882973 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-1df6564e-4fcf-4288-b824-d106ec512def tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Flavor limits 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:42:17.889167 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-1df6564e-4fcf-4288-b824-d106ec512def tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Image limits 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:42:17.890036 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-1df6564e-4fcf-4288-b824-d106ec512def tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Flavor pref 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:42:17.893779 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-1df6564e-4fcf-4288-b824-d106ec512def tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Image pref 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:42:17.894493 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-1df6564e-4fcf-4288-b824-d106ec512def tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:42:17.931583 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1df6564e-4fcf-4288-b824-d106ec512def tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:17.932425 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1df6564e-4fcf-4288-b824-d106ec512def tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:17.934366 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1df6564e-4fcf-4288-b824-d106ec512def tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:17.938002 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1df6564e-4fcf-4288-b824-d106ec512def tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:17.943152 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1df6564e-4fcf-4288-b824-d106ec512def tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:17.943865 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1df6564e-4fcf-4288-b824-d106ec512def tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:17.999441 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-1df6564e-4fcf-4288-b824-d106ec512def tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Getting quotas for project eda6bd34bf5540ee95c8144f185eb22d. Resources: {'ram', 'cores', 'instances'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:42:18.009188 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-1df6564e-4fcf-4288-b824-d106ec512def tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Getting quotas for user 96e7480de94c43909045ac1087e40cd8 and project eda6bd34bf5540ee95c8144f185eb22d. Resources: {'ram', 'cores', 'instances'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:42:18.054136 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-1df6564e-4fcf-4288-b824-d106ec512def tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Going to run 1 instances... {{(pid=123595) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:42:18.057552 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-1df6564e-4fcf-4288-b824-d106ec512def tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] [instance: f726f3f3-4731-4380-9163-b2273b629810] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e8943ec5-4038-4d4b-b9b9-2415a79f5243',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:42:18.196255 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-1df6564e-4fcf-4288-b824-d106ec512def tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.623037 Oct 04 18:42:18.198832 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1304/2740] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 18:42:16 2022] POST /compute/v2.1/servers => generated 383 bytes in 1628 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:42:18.218697 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-4dbf91ff-2f11-477b-860a-690184408bb1 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:18.221404 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-4dbf91ff-2f11-477b-860a-690184408bb1 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: d9d4332a-97b6-40f1-bd7c-a9a75a9adc43] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:18.229831 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4dbf91ff-2f11-477b-860a-690184408bb1 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:18.230624 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4dbf91ff-2f11-477b-860a-690184408bb1 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:18.231139 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4dbf91ff-2f11-477b-860a-690184408bb1 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:18.231957 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4dbf91ff-2f11-477b-860a-690184408bb1 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:18.232857 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4dbf91ff-2f11-477b-860a-690184408bb1 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:18.233392 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4dbf91ff-2f11-477b-860a-690184408bb1 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:18.333345 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4dbf91ff-2f11-477b-860a-690184408bb1 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:18.333945 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4dbf91ff-2f11-477b-860a-690184408bb1 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:18.334490 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4dbf91ff-2f11-477b-860a-690184408bb1 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:18.335096 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.objects.instance [None req-4dbf91ff-2f11-477b-860a-690184408bb1 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lazy-loading 'fault' on Instance uuid d9d4332a-97b6-40f1-bd7c-a9a75a9adc43 {{(pid=123595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:42:18.448478 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-4dbf91ff-2f11-477b-860a-690184408bb1 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:18.481852 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-4dbf91ff-2f11-477b-860a-690184408bb1 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/d9d4332a-97b6-40f1-bd7c-a9a75a9adc43" status: 200 len: 1368 microversion: 2.1 time: 0.263850 Oct 04 18:42:18.507153 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1305/2741] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:18 2022] GET /compute/v2.1/servers/d9d4332a-97b6-40f1-bd7c-a9a75a9adc43 => generated 1368 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:18.520381 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-de2ebfbd-febb-4cc0-95f6-983973fe1dce tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:18.524378 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-de2ebfbd-febb-4cc0-95f6-983973fe1dce tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] [instance: cbae126b-e99a-4c70-a9e7-0921a41e01ca] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:18.544410 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-de2ebfbd-febb-4cc0-95f6-983973fe1dce tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:18.545385 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-de2ebfbd-febb-4cc0-95f6-983973fe1dce tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:18.546000 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-de2ebfbd-febb-4cc0-95f6-983973fe1dce tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:18.546871 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-de2ebfbd-febb-4cc0-95f6-983973fe1dce tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:18.550126 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-de2ebfbd-febb-4cc0-95f6-983973fe1dce tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:18.550793 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-de2ebfbd-febb-4cc0-95f6-983973fe1dce tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:18.897194 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-de2ebfbd-febb-4cc0-95f6-983973fe1dce tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2df20485e3d4c75b2f4fc7375adebb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f379b9ce44d942959b67137e546191c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:18.912267 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-de2ebfbd-febb-4cc0-95f6-983973fe1dce tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] 10.222.0.43 "GET /compute/v2.1/servers/cbae126b-e99a-4c70-a9e7-0921a41e01ca" status: 200 len: 1292 microversion: 2.1 time: 0.403480 Oct 04 18:42:18.913138 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1306/2742] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:18 2022] GET /compute/v2.1/servers/cbae126b-e99a-4c70-a9e7-0921a41e01ca => generated 1292 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:18.919701 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-0eb5d5e6-d68e-49fc-ba3d-0f6b1b020922 req-69690900-a7a8-427e-8175-07abcc3507dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9d4332a-97b6-40f1-bd7c-a9a75a9adc43", "name": "network-vif-deleted", "tag": "e64ffaa5-c4b7-4d5d-b9bd-605829597e42"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:42:18.932815 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-0eb5d5e6-d68e-49fc-ba3d-0f6b1b020922 req-69690900-a7a8-427e-8175-07abcc3507dc service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:18.934102 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-0eb5d5e6-d68e-49fc-ba3d-0f6b1b020922 req-69690900-a7a8-427e-8175-07abcc3507dc service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:18.934971 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-0eb5d5e6-d68e-49fc-ba3d-0f6b1b020922 req-69690900-a7a8-427e-8175-07abcc3507dc service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:18.951331 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-0eb5d5e6-d68e-49fc-ba3d-0f6b1b020922 req-69690900-a7a8-427e-8175-07abcc3507dc service nova] Creating event network-vif-deleted:e64ffaa5-c4b7-4d5d-b9bd-605829597e42 for instance d9d4332a-97b6-40f1-bd7c-a9a75a9adc43 on n-h1-851028-13 Oct 04 18:42:18.959596 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-0eb5d5e6-d68e-49fc-ba3d-0f6b1b020922 req-69690900-a7a8-427e-8175-07abcc3507dc service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044791 Oct 04 18:42:18.965598 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1307/2743] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:42:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:42:18.972362 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-612a4749-9347-41b1-b0af-6cc5f5b30017 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:18.973748 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-612a4749-9347-41b1-b0af-6cc5f5b30017 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] [instance: f726f3f3-4731-4380-9163-b2273b629810] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:19.077280 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-612a4749-9347-41b1-b0af-6cc5f5b30017 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96e7480de94c43909045ac1087e40cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6bd34bf5540ee95c8144f185eb22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:19.085030 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-f52a25fe-72dd-4787-b042-e0d3adb91019 tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] 10.222.0.43 "POST /compute/v2.1/servers/3d03e642-62aa-4ed5-8427-a10c4bd9698e/action" status: 202 len: 0 microversion: 2.1 time: 4.160532 Oct 04 18:42:19.086523 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1437/2744] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 18:42:14 2022] POST /compute/v2.1/servers/3d03e642-62aa-4ed5-8427-a10c4bd9698e/action => generated 0 bytes in 4163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 18:42:19.092148 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-612a4749-9347-41b1-b0af-6cc5f5b30017 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] 10.222.0.43 "GET /compute/v2.1/servers/f726f3f3-4731-4380-9163-b2273b629810" status: 200 len: 1221 microversion: 2.1 time: 0.123754 Oct 04 18:42:19.094439 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1308/2745] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:18 2022] GET /compute/v2.1/servers/f726f3f3-4731-4380-9163-b2273b629810 => generated 1221 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:19.096345 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-5e36577c-7590-4717-ba9b-2b76d0e4ab03 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:19.097276 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-5e36577c-7590-4717-ba9b-2b76d0e4ab03 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] [instance: 3d03e642-62aa-4ed5-8427-a10c4bd9698e] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:19.129527 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5e36577c-7590-4717-ba9b-2b76d0e4ab03 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:19.130425 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5e36577c-7590-4717-ba9b-2b76d0e4ab03 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:19.136348 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5e36577c-7590-4717-ba9b-2b76d0e4ab03 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:19.137151 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5e36577c-7590-4717-ba9b-2b76d0e4ab03 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:19.137631 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5e36577c-7590-4717-ba9b-2b76d0e4ab03 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:19.138064 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5e36577c-7590-4717-ba9b-2b76d0e4ab03 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:19.381718 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-7cf396c9-9e51-4869-b02e-09e42ad9142c tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-151662341", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:42:19.487489 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.network.neutron [None req-7cf396c9-9e51-4869-b02e-09e42ad9142c tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] validate_networks() for [('b4aa97d5-c2a2-43c0-80f6-feae0c060a28', None, None, None, None, None)] {{(pid=123595) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:42:19.841628 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-5e36577c-7590-4717-ba9b-2b76d0e4ab03 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9971b5861f44c1a1da94eda0f8f02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f809b8ae704988961908bef0f3cb24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:19.864641 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-5e36577c-7590-4717-ba9b-2b76d0e4ab03 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] 10.222.0.43 "GET /compute/v2.1/servers/3d03e642-62aa-4ed5-8427-a10c4bd9698e" status: 200 len: 1503 microversion: 2.1 time: 0.773756 Oct 04 18:42:19.889305 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1438/2746] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:19 2022] GET /compute/v2.1/servers/3d03e642-62aa-4ed5-8427-a10c4bd9698e => generated 1503 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:42:19.912897 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-8f0e4294-5797-4ecb-88dd-4a3d2bf37ad9 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:19.918113 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-8f0e4294-5797-4ecb-88dd-4a3d2bf37ad9 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: d9d4332a-97b6-40f1-bd7c-a9a75a9adc43] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:19.965950 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8f0e4294-5797-4ecb-88dd-4a3d2bf37ad9 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:19.968164 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8f0e4294-5797-4ecb-88dd-4a3d2bf37ad9 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:19.970098 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8f0e4294-5797-4ecb-88dd-4a3d2bf37ad9 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:19.976179 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8f0e4294-5797-4ecb-88dd-4a3d2bf37ad9 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:19.976813 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8f0e4294-5797-4ecb-88dd-4a3d2bf37ad9 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:19.978035 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8f0e4294-5797-4ecb-88dd-4a3d2bf37ad9 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:20.004229 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-8f0e4294-5797-4ecb-88dd-4a3d2bf37ad9 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] HTTP exception thrown: Instance d9d4332a-97b6-40f1-bd7c-a9a75a9adc43 could not be found. Oct 04 18:42:20.006879 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-8f0e4294-5797-4ecb-88dd-4a3d2bf37ad9 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Request method failure captured: Oct 04 18:42:20.006879 n-d-851028-13 devstack@n-api.service[123596]: request: GET /compute/v2.1/servers/d9d4332a-97b6-40f1-bd7c-a9a75a9adc43 HTTP/1.1 Oct 04 18:42:20.006879 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:42:20.006879 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:42:20.006879 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:42:20.006879 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 18:42:20.006879 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:42:20.006879 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:42:20.006879 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:42:20.006879 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:42:20.006879 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPH0NoXgCy3n6sh1IGXjtfaHzlhYMuJpKcXPppfdRHbcKj96890BlFug3pTj2ae4hfUq7QwMio-uyNDngu9EC-WiWL2uy_k9NT0WkTh-babPsSjAzcuYjZjQlwoCrlTamTWYDHmmNVgGFwgEOV5-_lM17JGx4pac-wizTUHPmJe6XS4g Oct 04 18:42:20.006879 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:42:20.006879 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:42:20.006879 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:42:20.006879 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:42:20.006879 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:42:20.006879 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:42:20.006879 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: 50a6a1a86a59403dad27f6e3c628853c Oct 04 18:42:20.006879 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-MigrationsAdminTest-1383787507 Oct 04 18:42:20.006879 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 18:42:20.006879 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 18:42:20.006879 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/50a6a1a86a59403dad27f6e3c628853c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_50a6a1a86a59403dad27f6e3c628853c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/50a6a1a86a59403dad27f6e3c628853c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/50a6a1a86a59403dad27f6e3c628853c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:42:20.006879 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-MigrationsAdminTest-1383787507 Oct 04 18:42:20.006879 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: 50a6a1a86a59403dad27f6e3c628853c Oct 04 18:42:20.006879 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-MigrationsAdminTest-1383787507 Oct 04 18:42:20.006879 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-MigrationsAdminTest-1383787507-project Oct 04 18:42:20.006879 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:42:20.006879 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:42:20.006879 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 581885ffa737444eafa3179cceb6ee1d Oct 04 18:42:20.006879 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-MigrationsAdminTest-1383787507-project Oct 04 18:42:20.006879 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 18:42:20.006879 n-d-851028-13 devstack@n-api.service[123596]: exception: Instance d9d4332a-97b6-40f1-bd7c-a9a75a9adc43 could not be found. Oct 04 18:42:20.006879 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': 'd9d4332a-97b6-40f1-bd7c-a9a75a9adc43'} Oct 04 18:42:20.006879 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:42:20.006879 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:42:20.006879 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:42:20.006879 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:42:20.006879 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:42:20.006879 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:42:20.006879 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:42:20.006879 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:42:20.006879 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:42:20.006879 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:42:20.006879 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9d4332a-97b6-40f1-bd7c-a9a75a9adc43 could not be found. Oct 04 18:42:20.006879 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:42:20.006879 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:42:20.006879 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:42:20.006879 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:42:20.006879 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:42:20.006879 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:42:20.006879 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:42:20.006879 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:42:20.006879 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:42:20.006879 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:42:20.006879 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:42:20.006879 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:42:20.006879 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:42:20.006879 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:42:20.006879 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:42:20.006879 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:42:20.006879 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9d4332a-97b6-40f1-bd7c-a9a75a9adc43 could not be found. Oct 04 18:42:20.006879 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:42:20.006879 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:42:20.006879 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:42:20.011104 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:42:20.011104 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:42:20.011104 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:42:20.011104 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:42:20.011104 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:42:20.011104 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9d4332a-97b6-40f1-bd7c-a9a75a9adc43 could not be found. Oct 04 18:42:20.011104 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:42:20.011104 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-8f0e4294-5797-4ecb-88dd-4a3d2bf37ad9 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Returning 404 to user: Instance d9d4332a-97b6-40f1-bd7c-a9a75a9adc43 could not be found. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:42:20.011576 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-8f0e4294-5797-4ecb-88dd-4a3d2bf37ad9 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/d9d4332a-97b6-40f1-bd7c-a9a75a9adc43" status: 404 len: 111 microversion: 2.1 time: 0.119905 Oct 04 18:42:20.012143 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1439/2747] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:19 2022] GET /compute/v2.1/servers/d9d4332a-97b6-40f1-bd7c-a9a75a9adc43 => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:42:20.031457 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-32894a6f-a536-47e4-97a5-ecaae4783ec5 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:20.032911 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-32894a6f-a536-47e4-97a5-ecaae4783ec5 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] [instance: cbae126b-e99a-4c70-a9e7-0921a41e01ca] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:20.040829 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:42:20.042730 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-32894a6f-a536-47e4-97a5-ecaae4783ec5 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:20.043473 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-32894a6f-a536-47e4-97a5-ecaae4783ec5 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:20.044184 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-32894a6f-a536-47e4-97a5-ecaae4783ec5 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:20.049125 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-32894a6f-a536-47e4-97a5-ecaae4783ec5 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:20.051898 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-32894a6f-a536-47e4-97a5-ecaae4783ec5 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:20.054769 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-32894a6f-a536-47e4-97a5-ecaae4783ec5 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:21.211227 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-32894a6f-a536-47e4-97a5-ecaae4783ec5 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2df20485e3d4c75b2f4fc7375adebb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f379b9ce44d942959b67137e546191c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:21.231700 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-32894a6f-a536-47e4-97a5-ecaae4783ec5 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] 10.222.0.43 "GET /compute/v2.1/servers/cbae126b-e99a-4c70-a9e7-0921a41e01ca" status: 200 len: 1292 microversion: 2.1 time: 1.213505 Oct 04 18:42:21.232819 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1440/2748] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:20 2022] GET /compute/v2.1/servers/cbae126b-e99a-4c70-a9e7-0921a41e01ca => generated 1292 bytes in 1220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:21.249848 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-9136c2d8-addb-471c-b5e4-7e885ff37300 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '.version_select at 0x7fb227de2a60>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:21.299453 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-9136c2d8-addb-471c-b5e4-7e885ff37300 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-769895920" status: 202 len: 0 microversion: 2.1 time: 0.063112 Oct 04 18:42:21.300740 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1441/2749] 10.222.0.43 () {58 vars in 1218 bytes} [Tue Oct 4 18:42:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-769895920 => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:42:21.314125 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-199e8371-7757-416f-b0b0-ecd276ddef6d tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:21.315171 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-199e8371-7757-416f-b0b0-ecd276ddef6d tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] [instance: 3d03e642-62aa-4ed5-8427-a10c4bd9698e] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:21.358130 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-199e8371-7757-416f-b0b0-ecd276ddef6d tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:21.359133 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-199e8371-7757-416f-b0b0-ecd276ddef6d tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:21.359772 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-199e8371-7757-416f-b0b0-ecd276ddef6d tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:21.362039 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-199e8371-7757-416f-b0b0-ecd276ddef6d tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:21.363626 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-199e8371-7757-416f-b0b0-ecd276ddef6d tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:21.364122 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-199e8371-7757-416f-b0b0-ecd276ddef6d tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:21.875523 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-199e8371-7757-416f-b0b0-ecd276ddef6d tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9971b5861f44c1a1da94eda0f8f02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f809b8ae704988961908bef0f3cb24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:21.882390 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-7cf396c9-9e51-4869-b02e-09e42ad9142c tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Flavor limits 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:42:21.884251 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-199e8371-7757-416f-b0b0-ecd276ddef6d tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] 10.222.0.43 "GET /compute/v2.1/servers/3d03e642-62aa-4ed5-8427-a10c4bd9698e" status: 200 len: 1503 microversion: 2.1 time: 0.582084 Oct 04 18:42:21.884837 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1442/2750] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:21 2022] GET /compute/v2.1/servers/3d03e642-62aa-4ed5-8427-a10c4bd9698e => generated 1503 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:21.886340 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-7cf396c9-9e51-4869-b02e-09e42ad9142c tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Image limits 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:42:21.886856 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-7cf396c9-9e51-4869-b02e-09e42ad9142c tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Flavor pref 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:42:21.887341 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-7cf396c9-9e51-4869-b02e-09e42ad9142c tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Image pref 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:42:21.887767 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-7cf396c9-9e51-4869-b02e-09e42ad9142c tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:42:21.913990 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7cf396c9-9e51-4869-b02e-09e42ad9142c tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:21.915215 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7cf396c9-9e51-4869-b02e-09e42ad9142c tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:21.916137 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7cf396c9-9e51-4869-b02e-09e42ad9142c tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:21.917439 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7cf396c9-9e51-4869-b02e-09e42ad9142c tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:21.918151 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7cf396c9-9e51-4869-b02e-09e42ad9142c tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:21.919478 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7cf396c9-9e51-4869-b02e-09e42ad9142c tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:22.015957 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-7cf396c9-9e51-4869-b02e-09e42ad9142c tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Getting quotas for project eda6bd34bf5540ee95c8144f185eb22d. Resources: {'ram', 'cores', 'instances'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:42:22.031755 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-7cf396c9-9e51-4869-b02e-09e42ad9142c tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Getting quotas for user 96e7480de94c43909045ac1087e40cd8 and project eda6bd34bf5540ee95c8144f185eb22d. Resources: {'ram', 'cores', 'instances'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:42:22.072987 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-7cf396c9-9e51-4869-b02e-09e42ad9142c tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Going to run 1 instances... {{(pid=123595) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:42:22.075988 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-7cf396c9-9e51-4869-b02e-09e42ad9142c tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] [instance: d7f06829-6beb-4d35-ab81-c99f9dd3027d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e8943ec5-4038-4d4b-b9b9-2415a79f5243',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:42:22.161795 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-7cf396c9-9e51-4869-b02e-09e42ad9142c tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.785680 Oct 04 18:42:22.170555 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1309/2751] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 18:42:19 2022] POST /compute/v2.1/servers => generated 383 bytes in 2794 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 18:42:22.177220 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-013084a9-8124-46b1-9b7d-b1c6883b100e tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:22.182755 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-221cc55d-0752-4b76-831a-90ab7b23e6d0 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-1313885893", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "8029e731-b49c-47e3-865b-225091c44dcf"}]}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:42:22.186022 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-013084a9-8124-46b1-9b7d-b1c6883b100e tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] [instance: d7f06829-6beb-4d35-ab81-c99f9dd3027d] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:22.333590 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.network.neutron [None req-221cc55d-0752-4b76-831a-90ab7b23e6d0 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] validate_networks() for [('8029e731-b49c-47e3-865b-225091c44dcf', None, None, None, None, None)] {{(pid=123596) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:42:22.429134 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-013084a9-8124-46b1-9b7d-b1c6883b100e tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96e7480de94c43909045ac1087e40cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6bd34bf5540ee95c8144f185eb22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:22.443973 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-013084a9-8124-46b1-9b7d-b1c6883b100e tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] 10.222.0.43 "GET /compute/v2.1/servers/d7f06829-6beb-4d35-ab81-c99f9dd3027d" status: 200 len: 1221 microversion: 2.1 time: 0.271771 Oct 04 18:42:22.465025 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1310/2752] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:22 2022] GET /compute/v2.1/servers/d7f06829-6beb-4d35-ab81-c99f9dd3027d => generated 1221 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:22.474217 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-a6fbfb82-a85d-44ff-8be9-0b712505243a req-0e976887-8de8-4831-8276-61da7ba31891 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbae126b-e99a-4c70-a9e7-0921a41e01ca", "name": "network-vif-plugged", "status": "completed", "tag": "c406a273-b78c-4fe1-b66a-ad30e702c41b"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:42:22.508864 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-a6fbfb82-a85d-44ff-8be9-0b712505243a req-0e976887-8de8-4831-8276-61da7ba31891 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:22.509889 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-a6fbfb82-a85d-44ff-8be9-0b712505243a req-0e976887-8de8-4831-8276-61da7ba31891 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:22.510881 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-a6fbfb82-a85d-44ff-8be9-0b712505243a req-0e976887-8de8-4831-8276-61da7ba31891 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:22.562159 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-a6fbfb82-a85d-44ff-8be9-0b712505243a req-0e976887-8de8-4831-8276-61da7ba31891 service nova] Creating event network-vif-plugged:c406a273-b78c-4fe1-b66a-ad30e702c41b for instance cbae126b-e99a-4c70-a9e7-0921a41e01ca on n-h2-851028-13 Oct 04 18:42:22.570286 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-a6fbfb82-a85d-44ff-8be9-0b712505243a req-0e976887-8de8-4831-8276-61da7ba31891 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103827 Oct 04 18:42:22.572357 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1311/2753] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:42:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:42:22.581604 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-e73d2e0f-2efe-4ab1-a4e8-7ce866defd45 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:22.583005 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-e73d2e0f-2efe-4ab1-a4e8-7ce866defd45 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] [instance: cbae126b-e99a-4c70-a9e7-0921a41e01ca] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:22.602591 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e73d2e0f-2efe-4ab1-a4e8-7ce866defd45 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:22.603091 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e73d2e0f-2efe-4ab1-a4e8-7ce866defd45 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:22.603798 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e73d2e0f-2efe-4ab1-a4e8-7ce866defd45 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:22.604936 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e73d2e0f-2efe-4ab1-a4e8-7ce866defd45 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:22.605425 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e73d2e0f-2efe-4ab1-a4e8-7ce866defd45 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:22.605857 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e73d2e0f-2efe-4ab1-a4e8-7ce866defd45 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:23.214761 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-e73d2e0f-2efe-4ab1-a4e8-7ce866defd45 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2df20485e3d4c75b2f4fc7375adebb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f379b9ce44d942959b67137e546191c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:23.223698 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-e73d2e0f-2efe-4ab1-a4e8-7ce866defd45 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] 10.222.0.43 "GET /compute/v2.1/servers/cbae126b-e99a-4c70-a9e7-0921a41e01ca" status: 200 len: 1292 microversion: 2.1 time: 0.647793 Oct 04 18:42:23.228612 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1312/2754] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:22 2022] GET /compute/v2.1/servers/cbae126b-e99a-4c70-a9e7-0921a41e01ca => generated 1292 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:23.330151 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-c20927f9-86a3-4403-8971-fa3713567b54 tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] Action: 'create', calling method: .version_select at 0x7fb21ed16820>, body: {"keypair": {"name": "tempest-keypair-1350490735", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBET+oaDLX2CwzpkNXtWwL3ypLWBWwcFr8pxbvg1IBczGP0Sgd9zWVGbps2iR/VLwWk9WFmuyudOYj0fQeUS70jEuj4+nuARJZTqSfdYIzEVxXlhFnc7XsQSvmIB57Xq6A=="}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:42:23.363344 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-c20927f9-86a3-4403-8971-fa3713567b54 tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] Getting quotas for project 1bc84144bf334722b4798851268b5f32. Resources: {'key_pairs'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:42:23.391876 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-c20927f9-86a3-4403-8971-fa3713567b54 tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] Getting quotas for user 4ecd189792024ba298f451523033386e and project 1bc84144bf334722b4798851268b5f32. Resources: {'key_pairs'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:42:23.456899 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-c20927f9-86a3-4403-8971-fa3713567b54 tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.227089 Oct 04 18:42:23.457843 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1313/2755] 10.222.0.43 () {60 vars in 1159 bytes} [Tue Oct 4 18:42:23 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:42:23.464572 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-7d99a0dd-76db-4f53-83a6-c6c5b10dd5a5 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:23.465378 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-7d99a0dd-76db-4f53-83a6-c6c5b10dd5a5 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] [instance: 3d03e642-62aa-4ed5-8427-a10c4bd9698e] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:23.487077 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7d99a0dd-76db-4f53-83a6-c6c5b10dd5a5 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:23.487882 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7d99a0dd-76db-4f53-83a6-c6c5b10dd5a5 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:23.488481 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7d99a0dd-76db-4f53-83a6-c6c5b10dd5a5 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:23.489389 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7d99a0dd-76db-4f53-83a6-c6c5b10dd5a5 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:23.490002 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7d99a0dd-76db-4f53-83a6-c6c5b10dd5a5 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:23.490589 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7d99a0dd-76db-4f53-83a6-c6c5b10dd5a5 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:24.033346 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-221cc55d-0752-4b76-831a-90ab7b23e6d0 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Flavor limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:42:24.033790 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-221cc55d-0752-4b76-831a-90ab7b23e6d0 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Image limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:42:24.034258 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-221cc55d-0752-4b76-831a-90ab7b23e6d0 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Flavor pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:42:24.034682 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-221cc55d-0752-4b76-831a-90ab7b23e6d0 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Image pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:42:24.035108 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-221cc55d-0752-4b76-831a-90ab7b23e6d0 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:42:24.070167 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-221cc55d-0752-4b76-831a-90ab7b23e6d0 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:24.070807 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-221cc55d-0752-4b76-831a-90ab7b23e6d0 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:24.071250 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-221cc55d-0752-4b76-831a-90ab7b23e6d0 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:24.072001 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-221cc55d-0752-4b76-831a-90ab7b23e6d0 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:24.074989 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-221cc55d-0752-4b76-831a-90ab7b23e6d0 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:24.075452 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-221cc55d-0752-4b76-831a-90ab7b23e6d0 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:24.121092 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-221cc55d-0752-4b76-831a-90ab7b23e6d0 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Getting quotas for project 5419b9532d52479d8d99336b90ebe9ae. Resources: {'ram', 'cores', 'instances'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:42:24.135600 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-221cc55d-0752-4b76-831a-90ab7b23e6d0 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Getting quotas for user 2ee90610168a4d46b456d7a278991091 and project 5419b9532d52479d8d99336b90ebe9ae. Resources: {'ram', 'cores', 'instances'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:42:24.140752 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-7d99a0dd-76db-4f53-83a6-c6c5b10dd5a5 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9971b5861f44c1a1da94eda0f8f02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f809b8ae704988961908bef0f3cb24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:24.160727 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-7d99a0dd-76db-4f53-83a6-c6c5b10dd5a5 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] 10.222.0.43 "GET /compute/v2.1/servers/3d03e642-62aa-4ed5-8427-a10c4bd9698e" status: 200 len: 1503 microversion: 2.1 time: 0.701453 Oct 04 18:42:24.171869 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-221cc55d-0752-4b76-831a-90ab7b23e6d0 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Going to run 2 instances... {{(pid=123596) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:42:24.177396 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1314/2756] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:23 2022] GET /compute/v2.1/servers/3d03e642-62aa-4ed5-8427-a10c4bd9698e => generated 1503 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:24.193067 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-039e1d8b-081d-41f9-9e46-c70f8bdf8c07 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:24.195485 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-039e1d8b-081d-41f9-9e46-c70f8bdf8c07 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] [instance: d7f06829-6beb-4d35-ab81-c99f9dd3027d] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:24.206765 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-221cc55d-0752-4b76-831a-90ab7b23e6d0 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] [instance: 861427d4-c606-4a99-9c94-2b8e9dc42c1c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e8943ec5-4038-4d4b-b9b9-2415a79f5243',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123596) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:42:24.213942 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-039e1d8b-081d-41f9-9e46-c70f8bdf8c07 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:24.215860 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-039e1d8b-081d-41f9-9e46-c70f8bdf8c07 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:24.219304 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-039e1d8b-081d-41f9-9e46-c70f8bdf8c07 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:24.221858 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-039e1d8b-081d-41f9-9e46-c70f8bdf8c07 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:24.224377 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-039e1d8b-081d-41f9-9e46-c70f8bdf8c07 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:24.226638 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-039e1d8b-081d-41f9-9e46-c70f8bdf8c07 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:24.322214 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-221cc55d-0752-4b76-831a-90ab7b23e6d0 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] [instance: 67f7e060-f4e1-4f23-86f3-6f8ed96e4e22] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e8943ec5-4038-4d4b-b9b9-2415a79f5243',instance=,instance_uuid=861427d4-c606-4a99-9c94-2b8e9dc42c1c,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123596) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:42:24.442197 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-221cc55d-0752-4b76-831a-90ab7b23e6d0 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.550461 Oct 04 18:42:24.446385 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1443/2757] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 18:42:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 2555 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:42:24.457922 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-d0afc5fd-9137-4674-a079-6349ca9b5243 req-403dbd6c-a6ce-4019-b3aa-66cc359d314b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d03e642-62aa-4ed5-8427-a10c4bd9698e", "name": "network-vif-unplugged", "status": "completed", "tag": "53dfc1e3-b31a-4aab-8977-3a9c6a1f79ae"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:42:24.480002 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-d0afc5fd-9137-4674-a079-6349ca9b5243 req-403dbd6c-a6ce-4019-b3aa-66cc359d314b service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:24.482556 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-d0afc5fd-9137-4674-a079-6349ca9b5243 req-403dbd6c-a6ce-4019-b3aa-66cc359d314b service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:24.486463 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-d0afc5fd-9137-4674-a079-6349ca9b5243 req-403dbd6c-a6ce-4019-b3aa-66cc359d314b service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:24.527495 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-d0afc5fd-9137-4674-a079-6349ca9b5243 req-403dbd6c-a6ce-4019-b3aa-66cc359d314b service nova] Creating event network-vif-unplugged:53dfc1e3-b31a-4aab-8977-3a9c6a1f79ae for instance 3d03e642-62aa-4ed5-8427-a10c4bd9698e on n-h1-851028-13 Oct 04 18:42:24.533740 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-d0afc5fd-9137-4674-a079-6349ca9b5243 req-403dbd6c-a6ce-4019-b3aa-66cc359d314b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.085804 Oct 04 18:42:24.534900 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1444/2758] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:42:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:42:24.541318 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-05ed69b3-d695-4dfa-825f-47c7b33d5e06 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:24.543154 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-05ed69b3-d695-4dfa-825f-47c7b33d5e06 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] [instance: cbae126b-e99a-4c70-a9e7-0921a41e01ca] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:24.550955 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-05ed69b3-d695-4dfa-825f-47c7b33d5e06 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:24.552062 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-05ed69b3-d695-4dfa-825f-47c7b33d5e06 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:24.552667 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-05ed69b3-d695-4dfa-825f-47c7b33d5e06 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:24.553676 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-05ed69b3-d695-4dfa-825f-47c7b33d5e06 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:24.554298 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-05ed69b3-d695-4dfa-825f-47c7b33d5e06 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:24.555557 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-05ed69b3-d695-4dfa-825f-47c7b33d5e06 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:24.873677 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-039e1d8b-081d-41f9-9e46-c70f8bdf8c07 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96e7480de94c43909045ac1087e40cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6bd34bf5540ee95c8144f185eb22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:24.884951 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-039e1d8b-081d-41f9-9e46-c70f8bdf8c07 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] 10.222.0.43 "GET /compute/v2.1/servers/d7f06829-6beb-4d35-ab81-c99f9dd3027d" status: 200 len: 1273 microversion: 2.1 time: 0.705916 Oct 04 18:42:24.886565 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1315/2759] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:24 2022] GET /compute/v2.1/servers/d7f06829-6beb-4d35-ab81-c99f9dd3027d => generated 1273 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:24.903976 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-00105277-edbe-423c-8764-74727fe494c3 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:24.909825 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-00105277-edbe-423c-8764-74727fe494c3 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2ee90610168a4d46b456d7a278991091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5419b9532d52479d8d99336b90ebe9ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:24.910828 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-00105277-edbe-423c-8764-74727fe494c3 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Searching by: {'deleted': False, 'project_id': '5419b9532d52479d8d99336b90ebe9ae'} {{(pid=123595) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:42:24.947206 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-00105277-edbe-423c-8764-74727fe494c3 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:24.947703 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-00105277-edbe-423c-8764-74727fe494c3 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:24.953934 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-00105277-edbe-423c-8764-74727fe494c3 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:24.959786 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-00105277-edbe-423c-8764-74727fe494c3 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:24.960332 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-00105277-edbe-423c-8764-74727fe494c3 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:24.960795 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-00105277-edbe-423c-8764-74727fe494c3 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:25.012809 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-00105277-edbe-423c-8764-74727fe494c3 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] 10.222.0.43 "GET /compute/v2.1/servers" status: 200 len: 677 microversion: 2.1 time: 0.125154 Oct 04 18:42:25.014546 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1316/2760] 10.222.0.43 () {58 vars in 1125 bytes} [Tue Oct 4 18:42:24 2022] GET /compute/v2.1/servers => generated 677 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:42:25.028869 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-2821e12c-64da-4450-8c04-e753647a6df5 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:25.031349 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-2821e12c-64da-4450-8c04-e753647a6df5 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] [instance: 67f7e060-f4e1-4f23-86f3-6f8ed96e4e22] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:25.228463 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-2821e12c-64da-4450-8c04-e753647a6df5 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ee90610168a4d46b456d7a278991091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5419b9532d52479d8d99336b90ebe9ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:25.236307 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-2821e12c-64da-4450-8c04-e753647a6df5 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] 10.222.0.43 "GET /compute/v2.1/servers/67f7e060-f4e1-4f23-86f3-6f8ed96e4e22" status: 200 len: 1220 microversion: 2.1 time: 0.213874 Oct 04 18:42:25.238407 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1317/2761] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:25 2022] GET /compute/v2.1/servers/67f7e060-f4e1-4f23-86f3-6f8ed96e4e22 => generated 1220 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:25.256490 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-fda676d9-a142-4521-b327-f59a6474e97b tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:25.257008 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-fda676d9-a142-4521-b327-f59a6474e97b tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: d85af512-1b1f-42a4-9bb1-963cc956c9ae] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:25.264509 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fda676d9-a142-4521-b327-f59a6474e97b tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:25.265014 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fda676d9-a142-4521-b327-f59a6474e97b tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:25.271813 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fda676d9-a142-4521-b327-f59a6474e97b tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:25.272701 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fda676d9-a142-4521-b327-f59a6474e97b tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:25.273235 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fda676d9-a142-4521-b327-f59a6474e97b tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:25.273687 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fda676d9-a142-4521-b327-f59a6474e97b tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:25.290423 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-05ed69b3-d695-4dfa-825f-47c7b33d5e06 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2df20485e3d4c75b2f4fc7375adebb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f379b9ce44d942959b67137e546191c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:25.306208 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-05ed69b3-d695-4dfa-825f-47c7b33d5e06 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] 10.222.0.43 "GET /compute/v2.1/servers/cbae126b-e99a-4c70-a9e7-0921a41e01ca" status: 200 len: 1484 microversion: 2.1 time: 0.770189 Oct 04 18:42:25.307137 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1445/2762] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:24 2022] GET /compute/v2.1/servers/cbae126b-e99a-4c70-a9e7-0921a41e01ca => generated 1484 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:25.311860 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-a710bae0-ae2b-450b-aa94-1fc774cf7e9e tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:25.315431 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-a710bae0-ae2b-450b-aa94-1fc774cf7e9e tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] [instance: 3d03e642-62aa-4ed5-8427-a10c4bd9698e] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:25.329292 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a710bae0-ae2b-450b-aa94-1fc774cf7e9e tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:25.331856 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-fda676d9-a142-4521-b327-f59a6474e97b tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: d85af512-1b1f-42a4-9bb1-963cc956c9ae] Going to try to terminate instance {{(pid=123595) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:42:25.332675 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a710bae0-ae2b-450b-aa94-1fc774cf7e9e tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:25.333183 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a710bae0-ae2b-450b-aa94-1fc774cf7e9e tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:25.335917 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a710bae0-ae2b-450b-aa94-1fc774cf7e9e tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:25.337640 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a710bae0-ae2b-450b-aa94-1fc774cf7e9e tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:25.338421 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a710bae0-ae2b-450b-aa94-1fc774cf7e9e tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:25.502619 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-fda676d9-a142-4521-b327-f59a6474e97b tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "DELETE /compute/v2.1/servers/d85af512-1b1f-42a4-9bb1-963cc956c9ae" status: 204 len: 0 microversion: 2.1 time: 0.262357 Oct 04 18:42:25.506096 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1318/2763] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 18:42:25 2022] DELETE /compute/v2.1/servers/d85af512-1b1f-42a4-9bb1-963cc956c9ae => generated 0 bytes in 267 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:42:25.520869 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-1951608b-3f07-47ef-940d-e786a477653f tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:25.521908 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-1951608b-3f07-47ef-940d-e786a477653f tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] [instance: cbae126b-e99a-4c70-a9e7-0921a41e01ca] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:25.536447 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1951608b-3f07-47ef-940d-e786a477653f tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:25.537232 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1951608b-3f07-47ef-940d-e786a477653f tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:25.539162 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1951608b-3f07-47ef-940d-e786a477653f tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:25.540385 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1951608b-3f07-47ef-940d-e786a477653f tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:25.543420 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1951608b-3f07-47ef-940d-e786a477653f tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:25.544053 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1951608b-3f07-47ef-940d-e786a477653f tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:25.810419 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-a710bae0-ae2b-450b-aa94-1fc774cf7e9e tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9971b5861f44c1a1da94eda0f8f02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f809b8ae704988961908bef0f3cb24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:25.834752 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-a710bae0-ae2b-450b-aa94-1fc774cf7e9e tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] 10.222.0.43 "GET /compute/v2.1/servers/3d03e642-62aa-4ed5-8427-a10c4bd9698e" status: 200 len: 1503 microversion: 2.1 time: 0.520768 Oct 04 18:42:25.852222 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1446/2764] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:25 2022] GET /compute/v2.1/servers/3d03e642-62aa-4ed5-8427-a10c4bd9698e => generated 1503 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:25.858081 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-a3ae938a-40cc-408c-8811-5d427b916b91 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:25.859027 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-a3ae938a-40cc-408c-8811-5d427b916b91 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: d85af512-1b1f-42a4-9bb1-963cc956c9ae] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:25.866606 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a3ae938a-40cc-408c-8811-5d427b916b91 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:25.867986 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a3ae938a-40cc-408c-8811-5d427b916b91 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:25.868614 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a3ae938a-40cc-408c-8811-5d427b916b91 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:25.869524 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a3ae938a-40cc-408c-8811-5d427b916b91 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:25.870289 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a3ae938a-40cc-408c-8811-5d427b916b91 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:25.870987 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a3ae938a-40cc-408c-8811-5d427b916b91 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:25.903239 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-1951608b-3f07-47ef-940d-e786a477653f tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] 10.222.0.43 "GET /compute/v2.1/servers/cbae126b-e99a-4c70-a9e7-0921a41e01ca/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.395419 Oct 04 18:42:25.908569 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1319/2765] 10.222.0.43 () {58 vars in 1275 bytes} [Tue Oct 4 18:42:25 2022] GET /compute/v2.1/servers/cbae126b-e99a-4c70-a9e7-0921a41e01ca/os-interface => generated 285 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:42:25.920821 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-9aca3c59-cf21-412e-8b9d-bd9a684631b8 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:25.922000 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-9aca3c59-cf21-412e-8b9d-bd9a684631b8 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] [instance: d7f06829-6beb-4d35-ab81-c99f9dd3027d] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:25.944192 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9aca3c59-cf21-412e-8b9d-bd9a684631b8 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:25.944756 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9aca3c59-cf21-412e-8b9d-bd9a684631b8 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:25.945317 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9aca3c59-cf21-412e-8b9d-bd9a684631b8 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:25.952104 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9aca3c59-cf21-412e-8b9d-bd9a684631b8 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:25.952712 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9aca3c59-cf21-412e-8b9d-bd9a684631b8 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:25.953194 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9aca3c59-cf21-412e-8b9d-bd9a684631b8 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:26.243571 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-a3ae938a-40cc-408c-8811-5d427b916b91 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:26.268477 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-a3ae938a-40cc-408c-8811-5d427b916b91 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/d85af512-1b1f-42a4-9bb1-963cc956c9ae" status: 200 len: 1468 microversion: 2.1 time: 0.414814 Oct 04 18:42:26.281338 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1447/2766] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:25 2022] GET /compute/v2.1/servers/d85af512-1b1f-42a4-9bb1-963cc956c9ae => generated 1468 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:26.320463 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-6780c227-1c6e-4567-be17-4e9dfb8aec9c tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:26.323194 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-6780c227-1c6e-4567-be17-4e9dfb8aec9c tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] [instance: 67f7e060-f4e1-4f23-86f3-6f8ed96e4e22] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:26.364440 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6780c227-1c6e-4567-be17-4e9dfb8aec9c tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:26.369860 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6780c227-1c6e-4567-be17-4e9dfb8aec9c tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:26.374268 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6780c227-1c6e-4567-be17-4e9dfb8aec9c tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:26.379534 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6780c227-1c6e-4567-be17-4e9dfb8aec9c tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:26.380264 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6780c227-1c6e-4567-be17-4e9dfb8aec9c tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:26.381165 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6780c227-1c6e-4567-be17-4e9dfb8aec9c tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:26.478787 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-9aca3c59-cf21-412e-8b9d-bd9a684631b8 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96e7480de94c43909045ac1087e40cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6bd34bf5540ee95c8144f185eb22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:26.488988 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-9aca3c59-cf21-412e-8b9d-bd9a684631b8 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] 10.222.0.43 "GET /compute/v2.1/servers/d7f06829-6beb-4d35-ab81-c99f9dd3027d" status: 200 len: 1279 microversion: 2.1 time: 0.575399 Oct 04 18:42:26.507087 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1320/2767] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:25 2022] GET /compute/v2.1/servers/d7f06829-6beb-4d35-ab81-c99f9dd3027d => generated 1279 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:26.738886 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-a5ce6fe6-1565-4363-8cac-478724d1d4e3 req-d432e0e4-e042-4936-b053-252c59488f61 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d03e642-62aa-4ed5-8427-a10c4bd9698e", "tag": "53dfc1e3-b31a-4aab-8977-3a9c6a1f79ae"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:42:26.755651 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-a5ce6fe6-1565-4363-8cac-478724d1d4e3 req-d432e0e4-e042-4936-b053-252c59488f61 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:26.756136 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-a5ce6fe6-1565-4363-8cac-478724d1d4e3 req-d432e0e4-e042-4936-b053-252c59488f61 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:26.756569 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-a5ce6fe6-1565-4363-8cac-478724d1d4e3 req-d432e0e4-e042-4936-b053-252c59488f61 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:26.795531 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-a5ce6fe6-1565-4363-8cac-478724d1d4e3 req-d432e0e4-e042-4936-b053-252c59488f61 service nova] Creating event network-changed:53dfc1e3-b31a-4aab-8977-3a9c6a1f79ae for instance 3d03e642-62aa-4ed5-8427-a10c4bd9698e on n-h1-851028-13 Oct 04 18:42:26.804409 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-a5ce6fe6-1565-4363-8cac-478724d1d4e3 req-d432e0e4-e042-4936-b053-252c59488f61 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069625 Oct 04 18:42:26.805340 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1321/2768] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:42:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:42:26.860549 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-66db6da4-3e1b-45bc-98cb-bf014af680e2 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:26.861307 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-66db6da4-3e1b-45bc-98cb-bf014af680e2 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] [instance: 3d03e642-62aa-4ed5-8427-a10c4bd9698e] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:26.873044 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-66db6da4-3e1b-45bc-98cb-bf014af680e2 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:26.873583 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-66db6da4-3e1b-45bc-98cb-bf014af680e2 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:26.874340 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-66db6da4-3e1b-45bc-98cb-bf014af680e2 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:26.882598 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-66db6da4-3e1b-45bc-98cb-bf014af680e2 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:26.883380 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-66db6da4-3e1b-45bc-98cb-bf014af680e2 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:26.884052 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-66db6da4-3e1b-45bc-98cb-bf014af680e2 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:27.099493 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-6780c227-1c6e-4567-be17-4e9dfb8aec9c tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ee90610168a4d46b456d7a278991091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5419b9532d52479d8d99336b90ebe9ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:27.111059 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-6780c227-1c6e-4567-be17-4e9dfb8aec9c tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] 10.222.0.43 "GET /compute/v2.1/servers/67f7e060-f4e1-4f23-86f3-6f8ed96e4e22" status: 200 len: 1224 microversion: 2.1 time: 0.813418 Oct 04 18:42:27.127474 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1448/2769] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:26 2022] GET /compute/v2.1/servers/67f7e060-f4e1-4f23-86f3-6f8ed96e4e22 => generated 1224 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:27.293041 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-0b78a80f-b355-4e23-aae4-7bb0b710ebcc tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:27.293689 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-0b78a80f-b355-4e23-aae4-7bb0b710ebcc tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: d85af512-1b1f-42a4-9bb1-963cc956c9ae] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:27.305549 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0b78a80f-b355-4e23-aae4-7bb0b710ebcc tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:27.308122 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0b78a80f-b355-4e23-aae4-7bb0b710ebcc tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:27.309955 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0b78a80f-b355-4e23-aae4-7bb0b710ebcc tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:27.310874 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0b78a80f-b355-4e23-aae4-7bb0b710ebcc tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:27.312880 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0b78a80f-b355-4e23-aae4-7bb0b710ebcc tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:27.313754 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0b78a80f-b355-4e23-aae4-7bb0b710ebcc tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:27.764312 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-0b78a80f-b355-4e23-aae4-7bb0b710ebcc tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:27.774898 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-0b78a80f-b355-4e23-aae4-7bb0b710ebcc tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/d85af512-1b1f-42a4-9bb1-963cc956c9ae" status: 200 len: 1468 microversion: 2.1 time: 0.486870 Oct 04 18:42:27.794554 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1449/2770] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:27 2022] GET /compute/v2.1/servers/d85af512-1b1f-42a4-9bb1-963cc956c9ae => generated 1468 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:42:27.804245 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-3aa663d0-5baf-4531-a871-4add299ef000 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:27.805395 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-3aa663d0-5baf-4531-a871-4add299ef000 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] [instance: d7f06829-6beb-4d35-ab81-c99f9dd3027d] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:27.812072 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3aa663d0-5baf-4531-a871-4add299ef000 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:27.813763 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3aa663d0-5baf-4531-a871-4add299ef000 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:27.814840 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3aa663d0-5baf-4531-a871-4add299ef000 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:27.816031 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3aa663d0-5baf-4531-a871-4add299ef000 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:27.816828 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3aa663d0-5baf-4531-a871-4add299ef000 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:27.817592 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3aa663d0-5baf-4531-a871-4add299ef000 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:27.971731 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-66db6da4-3e1b-45bc-98cb-bf014af680e2 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9971b5861f44c1a1da94eda0f8f02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f809b8ae704988961908bef0f3cb24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:27.979722 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-66db6da4-3e1b-45bc-98cb-bf014af680e2 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] 10.222.0.43 "GET /compute/v2.1/servers/3d03e642-62aa-4ed5-8427-a10c4bd9698e" status: 200 len: 1503 microversion: 2.1 time: 1.123563 Oct 04 18:42:27.985711 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1322/2771] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:26 2022] GET /compute/v2.1/servers/3d03e642-62aa-4ed5-8427-a10c4bd9698e => generated 1503 bytes in 1131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:42:28.137408 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-ca55527b-cb4d-4bf5-9501-a4e890d0c569 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:28.138025 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-ca55527b-cb4d-4bf5-9501-a4e890d0c569 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] [instance: 67f7e060-f4e1-4f23-86f3-6f8ed96e4e22] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:28.147730 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ca55527b-cb4d-4bf5-9501-a4e890d0c569 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:28.148309 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ca55527b-cb4d-4bf5-9501-a4e890d0c569 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:28.148750 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ca55527b-cb4d-4bf5-9501-a4e890d0c569 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:28.149493 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ca55527b-cb4d-4bf5-9501-a4e890d0c569 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:28.150692 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ca55527b-cb4d-4bf5-9501-a4e890d0c569 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:28.151281 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ca55527b-cb4d-4bf5-9501-a4e890d0c569 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:28.187364 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:42:28.422649 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-3aa663d0-5baf-4531-a871-4add299ef000 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96e7480de94c43909045ac1087e40cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6bd34bf5540ee95c8144f185eb22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:28.425931 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:42:28.436300 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-3aa663d0-5baf-4531-a871-4add299ef000 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] 10.222.0.43 "GET /compute/v2.1/servers/d7f06829-6beb-4d35-ab81-c99f9dd3027d" status: 200 len: 1321 microversion: 2.1 time: 0.640227 Oct 04 18:42:28.436897 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1450/2772] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:27 2022] GET /compute/v2.1/servers/d7f06829-6beb-4d35-ab81-c99f9dd3027d => generated 1321 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:28.475137 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-ca55527b-cb4d-4bf5-9501-a4e890d0c569 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ee90610168a4d46b456d7a278991091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5419b9532d52479d8d99336b90ebe9ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:28.484229 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-ca55527b-cb4d-4bf5-9501-a4e890d0c569 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] 10.222.0.43 "GET /compute/v2.1/servers/67f7e060-f4e1-4f23-86f3-6f8ed96e4e22" status: 200 len: 1272 microversion: 2.1 time: 0.350782 Oct 04 18:42:28.489088 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1323/2773] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:28 2022] GET /compute/v2.1/servers/67f7e060-f4e1-4f23-86f3-6f8ed96e4e22 => generated 1272 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:28.801646 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-c945cfc1-8047-4b3b-8665-2ed06d8ca35f tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:28.802410 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-c945cfc1-8047-4b3b-8665-2ed06d8ca35f tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: d85af512-1b1f-42a4-9bb1-963cc956c9ae] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:28.810033 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c945cfc1-8047-4b3b-8665-2ed06d8ca35f tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:28.810836 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c945cfc1-8047-4b3b-8665-2ed06d8ca35f tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:28.811465 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c945cfc1-8047-4b3b-8665-2ed06d8ca35f tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:28.812398 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c945cfc1-8047-4b3b-8665-2ed06d8ca35f tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:28.813149 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c945cfc1-8047-4b3b-8665-2ed06d8ca35f tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:28.813851 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c945cfc1-8047-4b3b-8665-2ed06d8ca35f tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:29.013745 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-af4da997-a062-4ef5-86fd-3fc1386f0e28 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:29.015773 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-af4da997-a062-4ef5-86fd-3fc1386f0e28 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] [instance: 3d03e642-62aa-4ed5-8427-a10c4bd9698e] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:29.023693 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-af4da997-a062-4ef5-86fd-3fc1386f0e28 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:29.028849 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-af4da997-a062-4ef5-86fd-3fc1386f0e28 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:29.029385 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-af4da997-a062-4ef5-86fd-3fc1386f0e28 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:29.030062 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-af4da997-a062-4ef5-86fd-3fc1386f0e28 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:29.030525 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-af4da997-a062-4ef5-86fd-3fc1386f0e28 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:29.030952 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-af4da997-a062-4ef5-86fd-3fc1386f0e28 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:29.593654 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-c945cfc1-8047-4b3b-8665-2ed06d8ca35f tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:29.603356 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-c945cfc1-8047-4b3b-8665-2ed06d8ca35f tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/d85af512-1b1f-42a4-9bb1-963cc956c9ae" status: 200 len: 1468 microversion: 2.1 time: 0.807034 Oct 04 18:42:29.604070 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1451/2774] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:28 2022] GET /compute/v2.1/servers/d85af512-1b1f-42a4-9bb1-963cc956c9ae => generated 1468 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:29.611843 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-e2807014-c7ff-47b5-8d6d-f6e1272638ea tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:29.612685 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-e2807014-c7ff-47b5-8d6d-f6e1272638ea tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] [instance: d7f06829-6beb-4d35-ab81-c99f9dd3027d] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:29.621976 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e2807014-c7ff-47b5-8d6d-f6e1272638ea tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:29.622831 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e2807014-c7ff-47b5-8d6d-f6e1272638ea tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:29.623496 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e2807014-c7ff-47b5-8d6d-f6e1272638ea tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:29.624441 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e2807014-c7ff-47b5-8d6d-f6e1272638ea tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:29.625326 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e2807014-c7ff-47b5-8d6d-f6e1272638ea tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:29.626569 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e2807014-c7ff-47b5-8d6d-f6e1272638ea tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:29.874800 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-af4da997-a062-4ef5-86fd-3fc1386f0e28 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9971b5861f44c1a1da94eda0f8f02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f809b8ae704988961908bef0f3cb24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:29.895930 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-af4da997-a062-4ef5-86fd-3fc1386f0e28 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] 10.222.0.43 "GET /compute/v2.1/servers/3d03e642-62aa-4ed5-8427-a10c4bd9698e" status: 200 len: 1503 microversion: 2.1 time: 0.887840 Oct 04 18:42:29.897190 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1324/2775] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:29 2022] GET /compute/v2.1/servers/3d03e642-62aa-4ed5-8427-a10c4bd9698e => generated 1503 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:29.904915 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-d84edebb-a1eb-4c93-92b3-c70e8c1eb7c6 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:29.906116 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-d84edebb-a1eb-4c93-92b3-c70e8c1eb7c6 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] [instance: 67f7e060-f4e1-4f23-86f3-6f8ed96e4e22] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:29.915669 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d84edebb-a1eb-4c93-92b3-c70e8c1eb7c6 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:29.916584 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d84edebb-a1eb-4c93-92b3-c70e8c1eb7c6 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:29.917339 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d84edebb-a1eb-4c93-92b3-c70e8c1eb7c6 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:29.918509 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d84edebb-a1eb-4c93-92b3-c70e8c1eb7c6 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:29.919890 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d84edebb-a1eb-4c93-92b3-c70e8c1eb7c6 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:29.920545 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d84edebb-a1eb-4c93-92b3-c70e8c1eb7c6 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:29.973329 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-e2807014-c7ff-47b5-8d6d-f6e1272638ea tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96e7480de94c43909045ac1087e40cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6bd34bf5540ee95c8144f185eb22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:29.989672 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-e2807014-c7ff-47b5-8d6d-f6e1272638ea tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] 10.222.0.43 "GET /compute/v2.1/servers/d7f06829-6beb-4d35-ab81-c99f9dd3027d" status: 200 len: 1321 microversion: 2.1 time: 0.381578 Oct 04 18:42:29.993713 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1452/2776] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:29 2022] GET /compute/v2.1/servers/d7f06829-6beb-4d35-ab81-c99f9dd3027d => generated 1321 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:30.172961 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-d84edebb-a1eb-4c93-92b3-c70e8c1eb7c6 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ee90610168a4d46b456d7a278991091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5419b9532d52479d8d99336b90ebe9ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:30.187633 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-d84edebb-a1eb-4c93-92b3-c70e8c1eb7c6 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] 10.222.0.43 "GET /compute/v2.1/servers/67f7e060-f4e1-4f23-86f3-6f8ed96e4e22" status: 200 len: 1278 microversion: 2.1 time: 0.286493 Oct 04 18:42:30.190453 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1325/2777] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:29 2022] GET /compute/v2.1/servers/67f7e060-f4e1-4f23-86f3-6f8ed96e4e22 => generated 1278 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:30.269204 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-ac9d81cc-2f28-4781-84bb-0af6e3d83be5 tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "ed22906c-c8ab-41e7-999e-e7fa766d7467"}], "security_groups": [{"name": "tempest-securitygroup--2039084325"}], "key_name": "tempest-keypair-1350490735", "user_data": "}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:42:30.486588 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.network.neutron [None req-ac9d81cc-2f28-4781-84bb-0af6e3d83be5 tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] validate_networks() for [('ed22906c-c8ab-41e7-999e-e7fa766d7467', None, None, None, None, None)] {{(pid=123596) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:42:30.632255 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-eb8e2feb-fb06-454a-be62-1697eec7519a tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:30.634063 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-eb8e2feb-fb06-454a-be62-1697eec7519a tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: d85af512-1b1f-42a4-9bb1-963cc956c9ae] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:30.637513 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:42:30.648925 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-eb8e2feb-fb06-454a-be62-1697eec7519a tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:30.649589 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-eb8e2feb-fb06-454a-be62-1697eec7519a tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:30.650276 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-eb8e2feb-fb06-454a-be62-1697eec7519a tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:30.650996 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-eb8e2feb-fb06-454a-be62-1697eec7519a tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:30.651485 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-eb8e2feb-fb06-454a-be62-1697eec7519a tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:30.651913 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-eb8e2feb-fb06-454a-be62-1697eec7519a tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:31.554032 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-eb8e2feb-fb06-454a-be62-1697eec7519a tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:31.592811 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-eb8e2feb-fb06-454a-be62-1697eec7519a tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/d85af512-1b1f-42a4-9bb1-963cc956c9ae" status: 200 len: 1468 microversion: 2.1 time: 0.963727 Oct 04 18:42:31.595814 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1326/2778] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:30 2022] GET /compute/v2.1/servers/d85af512-1b1f-42a4-9bb1-963cc956c9ae => generated 1468 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:42:31.608554 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-4771b26c-961f-4618-b7da-c94ae88b8c08 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:31.628261 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-4771b26c-961f-4618-b7da-c94ae88b8c08 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] [instance: 3d03e642-62aa-4ed5-8427-a10c4bd9698e] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:31.665787 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4771b26c-961f-4618-b7da-c94ae88b8c08 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:31.667385 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4771b26c-961f-4618-b7da-c94ae88b8c08 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:31.670983 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4771b26c-961f-4618-b7da-c94ae88b8c08 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:31.674968 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4771b26c-961f-4618-b7da-c94ae88b8c08 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:31.677168 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4771b26c-961f-4618-b7da-c94ae88b8c08 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:31.678737 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4771b26c-961f-4618-b7da-c94ae88b8c08 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:32.073507 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-ac9d81cc-2f28-4781-84bb-0af6e3d83be5 tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] Flavor limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:42:32.074499 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-ac9d81cc-2f28-4781-84bb-0af6e3d83be5 tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] Image limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:42:32.075220 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-ac9d81cc-2f28-4781-84bb-0af6e3d83be5 tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] Flavor pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:42:32.076240 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-ac9d81cc-2f28-4781-84bb-0af6e3d83be5 tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] Image pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:42:32.076891 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-ac9d81cc-2f28-4781-84bb-0af6e3d83be5 tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:42:32.087963 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ac9d81cc-2f28-4781-84bb-0af6e3d83be5 tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:32.089050 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ac9d81cc-2f28-4781-84bb-0af6e3d83be5 tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:32.089753 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ac9d81cc-2f28-4781-84bb-0af6e3d83be5 tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:32.090714 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ac9d81cc-2f28-4781-84bb-0af6e3d83be5 tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:32.091470 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ac9d81cc-2f28-4781-84bb-0af6e3d83be5 tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:32.092156 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ac9d81cc-2f28-4781-84bb-0af6e3d83be5 tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:32.114571 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-ac9d81cc-2f28-4781-84bb-0af6e3d83be5 tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] Getting quotas for project 1bc84144bf334722b4798851268b5f32. Resources: {'ram', 'cores', 'instances'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:42:32.120265 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-ac9d81cc-2f28-4781-84bb-0af6e3d83be5 tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] Getting quotas for user 4ecd189792024ba298f451523033386e and project 1bc84144bf334722b4798851268b5f32. Resources: {'ram', 'cores', 'instances'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:42:32.133686 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-ac9d81cc-2f28-4781-84bb-0af6e3d83be5 tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] Going to run 1 instances... {{(pid=123596) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:42:32.136804 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-ac9d81cc-2f28-4781-84bb-0af6e3d83be5 tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] [instance: 74d78f04-e2a4-46ce-9da3-fe52e90f2090] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e8943ec5-4038-4d4b-b9b9-2415a79f5243',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123596) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:42:32.199254 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-ac9d81cc-2f28-4781-84bb-0af6e3d83be5 tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.942323 Oct 04 18:42:32.200758 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1453/2779] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 18:42:30 2022] POST /compute/v2.1/servers => generated 409 bytes in 1945 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:42:32.206081 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-d685f8bb-bd49-4264-9983-4c4c24aa47a6 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:32.207428 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-d685f8bb-bd49-4264-9983-4c4c24aa47a6 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] [instance: d7f06829-6beb-4d35-ab81-c99f9dd3027d] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:32.219643 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d685f8bb-bd49-4264-9983-4c4c24aa47a6 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:32.220748 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d685f8bb-bd49-4264-9983-4c4c24aa47a6 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:32.221444 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d685f8bb-bd49-4264-9983-4c4c24aa47a6 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:32.222494 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d685f8bb-bd49-4264-9983-4c4c24aa47a6 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:32.223679 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d685f8bb-bd49-4264-9983-4c4c24aa47a6 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:32.224323 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d685f8bb-bd49-4264-9983-4c4c24aa47a6 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:32.332369 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-4771b26c-961f-4618-b7da-c94ae88b8c08 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9971b5861f44c1a1da94eda0f8f02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f809b8ae704988961908bef0f3cb24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:32.347174 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-4771b26c-961f-4618-b7da-c94ae88b8c08 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] 10.222.0.43 "GET /compute/v2.1/servers/3d03e642-62aa-4ed5-8427-a10c4bd9698e" status: 200 len: 1503 microversion: 2.1 time: 0.747851 Oct 04 18:42:32.349674 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1327/2780] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:31 2022] GET /compute/v2.1/servers/3d03e642-62aa-4ed5-8427-a10c4bd9698e => generated 1503 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:32.371648 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-27535942-30f0-4271-854a-d7643c304704 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:32.374952 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-27535942-30f0-4271-854a-d7643c304704 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] [instance: 67f7e060-f4e1-4f23-86f3-6f8ed96e4e22] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:32.392485 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-27535942-30f0-4271-854a-d7643c304704 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:32.393291 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-27535942-30f0-4271-854a-d7643c304704 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:32.393917 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-27535942-30f0-4271-854a-d7643c304704 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:32.395020 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-27535942-30f0-4271-854a-d7643c304704 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:32.395638 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-27535942-30f0-4271-854a-d7643c304704 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:32.396746 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-27535942-30f0-4271-854a-d7643c304704 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:32.560784 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-27535942-30f0-4271-854a-d7643c304704 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ee90610168a4d46b456d7a278991091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5419b9532d52479d8d99336b90ebe9ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:32.573010 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-27535942-30f0-4271-854a-d7643c304704 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] 10.222.0.43 "GET /compute/v2.1/servers/67f7e060-f4e1-4f23-86f3-6f8ed96e4e22" status: 200 len: 1278 microversion: 2.1 time: 0.207742 Oct 04 18:42:32.576508 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1328/2781] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:32 2022] GET /compute/v2.1/servers/67f7e060-f4e1-4f23-86f3-6f8ed96e4e22 => generated 1278 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:32.591086 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-4c750e68-8915-40db-8b88-13255204113b tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:32.591888 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-4c750e68-8915-40db-8b88-13255204113b tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] [instance: cbae126b-e99a-4c70-a9e7-0921a41e01ca] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:32.605737 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4c750e68-8915-40db-8b88-13255204113b tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:32.606710 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4c750e68-8915-40db-8b88-13255204113b tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:32.607512 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4c750e68-8915-40db-8b88-13255204113b tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:32.608434 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4c750e68-8915-40db-8b88-13255204113b tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:32.609101 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4c750e68-8915-40db-8b88-13255204113b tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:32.610009 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4c750e68-8915-40db-8b88-13255204113b tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:32.700224 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-d685f8bb-bd49-4264-9983-4c4c24aa47a6 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96e7480de94c43909045ac1087e40cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6bd34bf5540ee95c8144f185eb22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:32.715289 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-d685f8bb-bd49-4264-9983-4c4c24aa47a6 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] 10.222.0.43 "GET /compute/v2.1/servers/d7f06829-6beb-4d35-ab81-c99f9dd3027d" status: 200 len: 1321 microversion: 2.1 time: 0.512313 Oct 04 18:42:32.716576 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1454/2782] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:32 2022] GET /compute/v2.1/servers/d7f06829-6beb-4d35-ab81-c99f9dd3027d => generated 1321 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:32.727302 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-037e1b3a-6f3b-4234-ab99-676cb4d280d0 req-01c1dbbc-5287-45d3-97fa-36e9775ecc12 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cbae126b-e99a-4c70-a9e7-0921a41e01ca", "tag": "c406a273-b78c-4fe1-b66a-ad30e702c41b"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:42:32.755892 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-037e1b3a-6f3b-4234-ab99-676cb4d280d0 req-01c1dbbc-5287-45d3-97fa-36e9775ecc12 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:32.756434 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-037e1b3a-6f3b-4234-ab99-676cb4d280d0 req-01c1dbbc-5287-45d3-97fa-36e9775ecc12 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:32.756942 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-037e1b3a-6f3b-4234-ab99-676cb4d280d0 req-01c1dbbc-5287-45d3-97fa-36e9775ecc12 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:32.775387 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-037e1b3a-6f3b-4234-ab99-676cb4d280d0 req-01c1dbbc-5287-45d3-97fa-36e9775ecc12 service nova] Creating event network-changed:c406a273-b78c-4fe1-b66a-ad30e702c41b for instance cbae126b-e99a-4c70-a9e7-0921a41e01ca on n-h2-851028-13 Oct 04 18:42:32.782495 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-037e1b3a-6f3b-4234-ab99-676cb4d280d0 req-01c1dbbc-5287-45d3-97fa-36e9775ecc12 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062131 Oct 04 18:42:32.784155 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1455/2783] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:42:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:42:32.790740 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-0a19b388-9bc9-4160-994d-9ffdc9687c50 tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:32.792001 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-0a19b388-9bc9-4160-994d-9ffdc9687c50 tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] [instance: 74d78f04-e2a4-46ce-9da3-fe52e90f2090] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:32.929667 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-0a19b388-9bc9-4160-994d-9ffdc9687c50 tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecd189792024ba298f451523033386e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bc84144bf334722b4798851268b5f32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:32.940559 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-0a19b388-9bc9-4160-994d-9ffdc9687c50 tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] 10.222.0.43 "GET /compute/v2.1/servers/74d78f04-e2a4-46ce-9da3-fe52e90f2090" status: 200 len: 1226 microversion: 2.1 time: 0.154829 Oct 04 18:42:32.941533 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1456/2784] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:32 2022] GET /compute/v2.1/servers/74d78f04-e2a4-46ce-9da3-fe52e90f2090 => generated 1226 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:32.946730 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-c8044bf2-50c3-4f72-8fef-5f400cc2e923 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:32.947470 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-c8044bf2-50c3-4f72-8fef-5f400cc2e923 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: d85af512-1b1f-42a4-9bb1-963cc956c9ae] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:32.953975 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c8044bf2-50c3-4f72-8fef-5f400cc2e923 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:32.954703 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c8044bf2-50c3-4f72-8fef-5f400cc2e923 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:32.955407 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c8044bf2-50c3-4f72-8fef-5f400cc2e923 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:32.956343 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c8044bf2-50c3-4f72-8fef-5f400cc2e923 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:32.957031 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c8044bf2-50c3-4f72-8fef-5f400cc2e923 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:32.957723 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c8044bf2-50c3-4f72-8fef-5f400cc2e923 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:32.998474 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-c8044bf2-50c3-4f72-8fef-5f400cc2e923 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] HTTP exception thrown: Instance d85af512-1b1f-42a4-9bb1-963cc956c9ae could not be found. Oct 04 18:42:33.001673 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-c8044bf2-50c3-4f72-8fef-5f400cc2e923 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Request method failure captured: Oct 04 18:42:33.001673 n-d-851028-13 devstack@n-api.service[123596]: request: GET /compute/v2.1/servers/d85af512-1b1f-42a4-9bb1-963cc956c9ae HTTP/1.1 Oct 04 18:42:33.001673 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:42:33.001673 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:42:33.001673 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:42:33.001673 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 18:42:33.001673 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:42:33.001673 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:42:33.001673 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:42:33.001673 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:42:33.001673 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPH0NoXgCy3n6sh1IGXjtfaHzlhYMuJpKcXPppfdRHbcKj96890BlFug3pTj2ae4hfUq7QwMio-uyNDngu9EC-WiWL2uy_k9NT0WkTh-babPsSjAzcuYjZjQlwoCrlTamTWYDHmmNVgGFwgEOV5-_lM17JGx4pac-wizTUHPmJe6XS4g Oct 04 18:42:33.001673 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:42:33.001673 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:42:33.001673 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:42:33.001673 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:42:33.001673 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:42:33.001673 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:42:33.001673 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: 50a6a1a86a59403dad27f6e3c628853c Oct 04 18:42:33.001673 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-MigrationsAdminTest-1383787507 Oct 04 18:42:33.001673 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 18:42:33.001673 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 18:42:33.001673 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/50a6a1a86a59403dad27f6e3c628853c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_50a6a1a86a59403dad27f6e3c628853c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/50a6a1a86a59403dad27f6e3c628853c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/50a6a1a86a59403dad27f6e3c628853c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:42:33.001673 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-MigrationsAdminTest-1383787507 Oct 04 18:42:33.001673 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: 50a6a1a86a59403dad27f6e3c628853c Oct 04 18:42:33.001673 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-MigrationsAdminTest-1383787507 Oct 04 18:42:33.001673 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-MigrationsAdminTest-1383787507-project Oct 04 18:42:33.001673 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:42:33.001673 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:42:33.001673 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 581885ffa737444eafa3179cceb6ee1d Oct 04 18:42:33.001673 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-MigrationsAdminTest-1383787507-project Oct 04 18:42:33.001673 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 18:42:33.001673 n-d-851028-13 devstack@n-api.service[123596]: exception: Instance d85af512-1b1f-42a4-9bb1-963cc956c9ae could not be found. Oct 04 18:42:33.001673 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': 'd85af512-1b1f-42a4-9bb1-963cc956c9ae'} Oct 04 18:42:33.001673 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:42:33.001673 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:42:33.001673 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:42:33.001673 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:42:33.001673 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:42:33.001673 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:42:33.001673 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:42:33.001673 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:42:33.001673 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:42:33.001673 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:42:33.001673 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d85af512-1b1f-42a4-9bb1-963cc956c9ae could not be found. Oct 04 18:42:33.001673 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:42:33.001673 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:42:33.001673 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:42:33.001673 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:42:33.001673 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:42:33.001673 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:42:33.001673 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:42:33.001673 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:42:33.001673 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:42:33.001673 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:42:33.001673 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:42:33.001673 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:42:33.001673 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:42:33.001673 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:42:33.001673 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:42:33.001673 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:42:33.001673 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d85af512-1b1f-42a4-9bb1-963cc956c9ae could not be found. Oct 04 18:42:33.001673 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:42:33.001673 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:42:33.001673 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:42:33.006854 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:42:33.006854 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:42:33.006854 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:42:33.006854 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:42:33.006854 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:42:33.006854 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d85af512-1b1f-42a4-9bb1-963cc956c9ae could not be found. Oct 04 18:42:33.006854 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:42:33.006854 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-c8044bf2-50c3-4f72-8fef-5f400cc2e923 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Returning 404 to user: Instance d85af512-1b1f-42a4-9bb1-963cc956c9ae could not be found. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:42:33.008153 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-c8044bf2-50c3-4f72-8fef-5f400cc2e923 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/d85af512-1b1f-42a4-9bb1-963cc956c9ae" status: 404 len: 111 microversion: 2.1 time: 0.065197 Oct 04 18:42:33.010044 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1457/2785] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:32 2022] GET /compute/v2.1/servers/d85af512-1b1f-42a4-9bb1-963cc956c9ae => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:42:33.018760 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-3de12233-1366-47ca-af0f-c34cf9fb5ff0 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:33.019539 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-3de12233-1366-47ca-af0f-c34cf9fb5ff0 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: ce0d629a-068c-4a62-8a03-fc43fc0be9b3] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:33.026261 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3de12233-1366-47ca-af0f-c34cf9fb5ff0 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:33.027233 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3de12233-1366-47ca-af0f-c34cf9fb5ff0 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:33.027866 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3de12233-1366-47ca-af0f-c34cf9fb5ff0 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:33.029383 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3de12233-1366-47ca-af0f-c34cf9fb5ff0 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:33.030164 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3de12233-1366-47ca-af0f-c34cf9fb5ff0 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:33.030885 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3de12233-1366-47ca-af0f-c34cf9fb5ff0 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:33.063951 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-3de12233-1366-47ca-af0f-c34cf9fb5ff0 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: ce0d629a-068c-4a62-8a03-fc43fc0be9b3] Going to try to terminate instance {{(pid=123596) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:42:33.176308 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-3de12233-1366-47ca-af0f-c34cf9fb5ff0 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "DELETE /compute/v2.1/servers/ce0d629a-068c-4a62-8a03-fc43fc0be9b3" status: 204 len: 0 microversion: 2.1 time: 0.157582 Oct 04 18:42:33.176853 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1458/2786] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 18:42:33 2022] DELETE /compute/v2.1/servers/ce0d629a-068c-4a62-8a03-fc43fc0be9b3 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 18:42:33.189177 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-4efa86cc-6064-465d-8d1c-ff52f3384d3b tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:33.189853 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-4efa86cc-6064-465d-8d1c-ff52f3384d3b tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: ce0d629a-068c-4a62-8a03-fc43fc0be9b3] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:33.201055 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4efa86cc-6064-465d-8d1c-ff52f3384d3b tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:33.201597 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4efa86cc-6064-465d-8d1c-ff52f3384d3b tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:33.202039 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4efa86cc-6064-465d-8d1c-ff52f3384d3b tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:33.202746 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4efa86cc-6064-465d-8d1c-ff52f3384d3b tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:33.203820 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4efa86cc-6064-465d-8d1c-ff52f3384d3b tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:33.204719 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4efa86cc-6064-465d-8d1c-ff52f3384d3b tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:33.394738 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-4c750e68-8915-40db-8b88-13255204113b tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2df20485e3d4c75b2f4fc7375adebb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f379b9ce44d942959b67137e546191c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:33.408918 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-4c750e68-8915-40db-8b88-13255204113b tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] 10.222.0.43 "GET /compute/v2.1/servers/cbae126b-e99a-4c70-a9e7-0921a41e01ca" status: 200 len: 1484 microversion: 2.1 time: 0.831125 Oct 04 18:42:33.429908 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1329/2787] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:32 2022] GET /compute/v2.1/servers/cbae126b-e99a-4c70-a9e7-0921a41e01ca => generated 1484 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:33.448359 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-9292af08-b155-4915-9397-ef09eac370a9 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:33.449511 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-9292af08-b155-4915-9397-ef09eac370a9 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] [instance: 3d03e642-62aa-4ed5-8427-a10c4bd9698e] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:33.463572 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9292af08-b155-4915-9397-ef09eac370a9 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:33.464279 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9292af08-b155-4915-9397-ef09eac370a9 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:33.465600 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9292af08-b155-4915-9397-ef09eac370a9 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:33.466493 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9292af08-b155-4915-9397-ef09eac370a9 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:33.468271 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9292af08-b155-4915-9397-ef09eac370a9 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:33.469611 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9292af08-b155-4915-9397-ef09eac370a9 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:33.591576 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-4efa86cc-6064-465d-8d1c-ff52f3384d3b tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:33.603301 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-4efa86cc-6064-465d-8d1c-ff52f3384d3b tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/ce0d629a-068c-4a62-8a03-fc43fc0be9b3" status: 200 len: 1469 microversion: 2.1 time: 0.420523 Oct 04 18:42:33.603914 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1459/2788] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:33 2022] GET /compute/v2.1/servers/ce0d629a-068c-4a62-8a03-fc43fc0be9b3 => generated 1469 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:42:33.621417 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-9ec3f38d-f248-4d30-8ac5-7afea31b2f06 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:33.629576 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-9ec3f38d-f248-4d30-8ac5-7afea31b2f06 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] [instance: 67f7e060-f4e1-4f23-86f3-6f8ed96e4e22] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:33.641567 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9ec3f38d-f248-4d30-8ac5-7afea31b2f06 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:33.642197 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9ec3f38d-f248-4d30-8ac5-7afea31b2f06 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:33.643281 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9ec3f38d-f248-4d30-8ac5-7afea31b2f06 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:33.644370 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9ec3f38d-f248-4d30-8ac5-7afea31b2f06 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:33.644896 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9ec3f38d-f248-4d30-8ac5-7afea31b2f06 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:33.645648 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9ec3f38d-f248-4d30-8ac5-7afea31b2f06 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:34.315760 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-9292af08-b155-4915-9397-ef09eac370a9 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9971b5861f44c1a1da94eda0f8f02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f809b8ae704988961908bef0f3cb24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:34.324900 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-9292af08-b155-4915-9397-ef09eac370a9 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] 10.222.0.43 "GET /compute/v2.1/servers/3d03e642-62aa-4ed5-8427-a10c4bd9698e" status: 200 len: 1503 microversion: 2.1 time: 0.891325 Oct 04 18:42:34.325549 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1330/2789] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:33 2022] GET /compute/v2.1/servers/3d03e642-62aa-4ed5-8427-a10c4bd9698e => generated 1503 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:34.331222 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-a1d5ed42-3695-43ac-866c-bd1acc9a1453 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:34.332152 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-a1d5ed42-3695-43ac-866c-bd1acc9a1453 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] [instance: d7f06829-6beb-4d35-ab81-c99f9dd3027d] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:34.338930 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a1d5ed42-3695-43ac-866c-bd1acc9a1453 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:34.339689 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a1d5ed42-3695-43ac-866c-bd1acc9a1453 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:34.340365 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a1d5ed42-3695-43ac-866c-bd1acc9a1453 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:34.341865 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a1d5ed42-3695-43ac-866c-bd1acc9a1453 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:34.342663 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a1d5ed42-3695-43ac-866c-bd1acc9a1453 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:34.344093 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a1d5ed42-3695-43ac-866c-bd1acc9a1453 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:34.461666 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-9ec3f38d-f248-4d30-8ac5-7afea31b2f06 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ee90610168a4d46b456d7a278991091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5419b9532d52479d8d99336b90ebe9ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:34.470985 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-9ec3f38d-f248-4d30-8ac5-7afea31b2f06 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] 10.222.0.43 "GET /compute/v2.1/servers/67f7e060-f4e1-4f23-86f3-6f8ed96e4e22" status: 200 len: 1320 microversion: 2.1 time: 0.865375 Oct 04 18:42:34.472037 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1460/2790] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:33 2022] GET /compute/v2.1/servers/67f7e060-f4e1-4f23-86f3-6f8ed96e4e22 => generated 1320 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:34.479816 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-501ef506-c7d1-4ec0-b69d-0b7fa87030e8 tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:34.480720 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-501ef506-c7d1-4ec0-b69d-0b7fa87030e8 tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] [instance: 74d78f04-e2a4-46ce-9da3-fe52e90f2090] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:34.488201 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-501ef506-c7d1-4ec0-b69d-0b7fa87030e8 tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:34.489306 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-501ef506-c7d1-4ec0-b69d-0b7fa87030e8 tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:34.489998 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-501ef506-c7d1-4ec0-b69d-0b7fa87030e8 tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:34.490809 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-501ef506-c7d1-4ec0-b69d-0b7fa87030e8 tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:34.491347 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-501ef506-c7d1-4ec0-b69d-0b7fa87030e8 tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:34.491870 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-501ef506-c7d1-4ec0-b69d-0b7fa87030e8 tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:34.608044 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-501ef506-c7d1-4ec0-b69d-0b7fa87030e8 tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecd189792024ba298f451523033386e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bc84144bf334722b4798851268b5f32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:34.618449 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-501ef506-c7d1-4ec0-b69d-0b7fa87030e8 tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] 10.222.0.43 "GET /compute/v2.1/servers/74d78f04-e2a4-46ce-9da3-fe52e90f2090" status: 200 len: 1284 microversion: 2.1 time: 0.144503 Oct 04 18:42:34.619953 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1461/2791] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:34 2022] GET /compute/v2.1/servers/74d78f04-e2a4-46ce-9da3-fe52e90f2090 => generated 1284 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:34.628646 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-11942edc-4e1a-4b7a-9e1f-ede7ce9e6880 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:34.629507 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-11942edc-4e1a-4b7a-9e1f-ede7ce9e6880 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: ce0d629a-068c-4a62-8a03-fc43fc0be9b3] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:34.638656 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-11942edc-4e1a-4b7a-9e1f-ede7ce9e6880 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:34.639661 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-11942edc-4e1a-4b7a-9e1f-ede7ce9e6880 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:34.640314 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-11942edc-4e1a-4b7a-9e1f-ede7ce9e6880 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:34.642133 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-11942edc-4e1a-4b7a-9e1f-ede7ce9e6880 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:34.643379 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-11942edc-4e1a-4b7a-9e1f-ede7ce9e6880 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:34.644346 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-11942edc-4e1a-4b7a-9e1f-ede7ce9e6880 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:34.923839 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-11942edc-4e1a-4b7a-9e1f-ede7ce9e6880 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:34.935643 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-11942edc-4e1a-4b7a-9e1f-ede7ce9e6880 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/ce0d629a-068c-4a62-8a03-fc43fc0be9b3" status: 200 len: 1469 microversion: 2.1 time: 0.309588 Oct 04 18:42:34.940705 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1462/2792] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:34 2022] GET /compute/v2.1/servers/ce0d629a-068c-4a62-8a03-fc43fc0be9b3 => generated 1469 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:34.950260 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-b90eceba-4e49-45bd-9274-5502b65afd8c req-cccd2040-ca41-40fc-9d98-e9f6d54ea48e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d85af512-1b1f-42a4-9bb1-963cc956c9ae", "name": "network-vif-deleted", "tag": "002dee45-b64c-4706-ab5c-1e8e34d83258"}, {"name": "network-changed", "server_uuid": "f726f3f3-4731-4380-9163-b2273b629810", "tag": "e0981442-7ddc-47a4-b476-d7804751bfec"}, {"name": "network-changed", "server_uuid": "d7f06829-6beb-4d35-ab81-c99f9dd3027d", "tag": "2735d07e-0a18-4de8-a88d-c4f6ed3f9244"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:42:34.987206 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-b90eceba-4e49-45bd-9274-5502b65afd8c req-cccd2040-ca41-40fc-9d98-e9f6d54ea48e service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:34.990187 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=6 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:42:34.990888 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-b90eceba-4e49-45bd-9274-5502b65afd8c req-cccd2040-ca41-40fc-9d98-e9f6d54ea48e service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:34.994360 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-b90eceba-4e49-45bd-9274-5502b65afd8c req-cccd2040-ca41-40fc-9d98-e9f6d54ea48e service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:35.040160 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-b90eceba-4e49-45bd-9274-5502b65afd8c req-cccd2040-ca41-40fc-9d98-e9f6d54ea48e service nova] Creating event network-vif-deleted:002dee45-b64c-4706-ab5c-1e8e34d83258 for instance d85af512-1b1f-42a4-9bb1-963cc956c9ae on n-h1-851028-13 Oct 04 18:42:35.042495 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-b90eceba-4e49-45bd-9274-5502b65afd8c req-cccd2040-ca41-40fc-9d98-e9f6d54ea48e service nova] Creating event network-changed:e0981442-7ddc-47a4-b476-d7804751bfec for instance f726f3f3-4731-4380-9163-b2273b629810 on n-h2-851028-13 Oct 04 18:42:35.043980 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-b90eceba-4e49-45bd-9274-5502b65afd8c req-cccd2040-ca41-40fc-9d98-e9f6d54ea48e service nova] Creating event network-changed:2735d07e-0a18-4de8-a88d-c4f6ed3f9244 for instance d7f06829-6beb-4d35-ab81-c99f9dd3027d on n-h1-851028-13 Oct 04 18:42:35.071065 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-b90eceba-4e49-45bd-9274-5502b65afd8c req-cccd2040-ca41-40fc-9d98-e9f6d54ea48e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 517 microversion: 2.1 time: 0.128413 Oct 04 18:42:35.073056 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-a1d5ed42-3695-43ac-866c-bd1acc9a1453 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96e7480de94c43909045ac1087e40cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6bd34bf5540ee95c8144f185eb22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:35.073271 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1463/2793] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:42:34 2022] POST /compute/v2.1/os-server-external-events => generated 517 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:42:35.085306 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-a1d5ed42-3695-43ac-866c-bd1acc9a1453 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] 10.222.0.43 "GET /compute/v2.1/servers/d7f06829-6beb-4d35-ab81-c99f9dd3027d" status: 200 len: 1321 microversion: 2.1 time: 0.755656 Oct 04 18:42:35.088279 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1331/2794] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:34 2022] GET /compute/v2.1/servers/d7f06829-6beb-4d35-ab81-c99f9dd3027d => generated 1321 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:35.285758 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-ed2a85b2-ba7a-418f-b002-cc725fbd71c4 req-b1e60467-a81a-4297-af95-743404916af2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce0d629a-068c-4a62-8a03-fc43fc0be9b3", "name": "network-vif-deleted", "tag": "5b0b787d-0181-4910-a488-5e61d24675ce"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:42:35.307759 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-ed2a85b2-ba7a-418f-b002-cc725fbd71c4 req-b1e60467-a81a-4297-af95-743404916af2 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:35.316012 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-ed2a85b2-ba7a-418f-b002-cc725fbd71c4 req-b1e60467-a81a-4297-af95-743404916af2 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:35.316598 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-ed2a85b2-ba7a-418f-b002-cc725fbd71c4 req-b1e60467-a81a-4297-af95-743404916af2 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:35.338358 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-ed2a85b2-ba7a-418f-b002-cc725fbd71c4 req-b1e60467-a81a-4297-af95-743404916af2 service nova] Creating event network-vif-deleted:5b0b787d-0181-4910-a488-5e61d24675ce for instance ce0d629a-068c-4a62-8a03-fc43fc0be9b3 on n-h1-851028-13 Oct 04 18:42:35.347225 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-ed2a85b2-ba7a-418f-b002-cc725fbd71c4 req-b1e60467-a81a-4297-af95-743404916af2 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066117 Oct 04 18:42:35.348289 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1464/2795] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:42:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:42:35.348691 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-45ff6743-7aba-4bad-82c2-f3c92124ef64 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:35.349345 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-45ff6743-7aba-4bad-82c2-f3c92124ef64 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] [instance: 3d03e642-62aa-4ed5-8427-a10c4bd9698e] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:35.351287 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=22 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:42:35.378187 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-45ff6743-7aba-4bad-82c2-f3c92124ef64 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:35.378694 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-45ff6743-7aba-4bad-82c2-f3c92124ef64 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:35.379133 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-45ff6743-7aba-4bad-82c2-f3c92124ef64 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:35.385631 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-45ff6743-7aba-4bad-82c2-f3c92124ef64 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:35.386404 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-45ff6743-7aba-4bad-82c2-f3c92124ef64 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:35.386868 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-45ff6743-7aba-4bad-82c2-f3c92124ef64 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:35.496949 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-ac14d133-5ff3-4d3d-860c-5124a9c334d0 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:35.497952 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-ac14d133-5ff3-4d3d-860c-5124a9c334d0 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] [instance: 67f7e060-f4e1-4f23-86f3-6f8ed96e4e22] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:35.511687 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ac14d133-5ff3-4d3d-860c-5124a9c334d0 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:35.512194 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ac14d133-5ff3-4d3d-860c-5124a9c334d0 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:35.517080 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ac14d133-5ff3-4d3d-860c-5124a9c334d0 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:35.521917 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ac14d133-5ff3-4d3d-860c-5124a9c334d0 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:35.522482 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ac14d133-5ff3-4d3d-860c-5124a9c334d0 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:35.523084 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ac14d133-5ff3-4d3d-860c-5124a9c334d0 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:35.874158 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-ac14d133-5ff3-4d3d-860c-5124a9c334d0 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ee90610168a4d46b456d7a278991091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5419b9532d52479d8d99336b90ebe9ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:35.889597 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-ac14d133-5ff3-4d3d-860c-5124a9c334d0 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] 10.222.0.43 "GET /compute/v2.1/servers/67f7e060-f4e1-4f23-86f3-6f8ed96e4e22" status: 200 len: 1320 microversion: 2.1 time: 0.397191 Oct 04 18:42:35.907669 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1465/2796] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:35 2022] GET /compute/v2.1/servers/67f7e060-f4e1-4f23-86f3-6f8ed96e4e22 => generated 1320 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:42:35.907669 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-ad0e594e-b154-4326-83e9-08e9b97d3887 tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:35.907669 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-ad0e594e-b154-4326-83e9-08e9b97d3887 tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] [instance: 74d78f04-e2a4-46ce-9da3-fe52e90f2090] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:35.910924 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ad0e594e-b154-4326-83e9-08e9b97d3887 tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:35.910924 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ad0e594e-b154-4326-83e9-08e9b97d3887 tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:35.910924 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ad0e594e-b154-4326-83e9-08e9b97d3887 tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:35.910924 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ad0e594e-b154-4326-83e9-08e9b97d3887 tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:35.910924 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ad0e594e-b154-4326-83e9-08e9b97d3887 tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:35.910924 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ad0e594e-b154-4326-83e9-08e9b97d3887 tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:36.060605 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-ad0e594e-b154-4326-83e9-08e9b97d3887 tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecd189792024ba298f451523033386e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bc84144bf334722b4798851268b5f32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:36.072354 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-ad0e594e-b154-4326-83e9-08e9b97d3887 tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] 10.222.0.43 "GET /compute/v2.1/servers/74d78f04-e2a4-46ce-9da3-fe52e90f2090" status: 200 len: 1284 microversion: 2.1 time: 0.178768 Oct 04 18:42:36.074773 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1466/2797] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:35 2022] GET /compute/v2.1/servers/74d78f04-e2a4-46ce-9da3-fe52e90f2090 => generated 1284 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:36.081404 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-1e7c0c93-e6e8-4223-838d-5d57f77b7817 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:36.082218 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-1e7c0c93-e6e8-4223-838d-5d57f77b7817 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: ce0d629a-068c-4a62-8a03-fc43fc0be9b3] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:36.105455 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1e7c0c93-e6e8-4223-838d-5d57f77b7817 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:36.111919 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1e7c0c93-e6e8-4223-838d-5d57f77b7817 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:36.112388 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1e7c0c93-e6e8-4223-838d-5d57f77b7817 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:36.113151 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1e7c0c93-e6e8-4223-838d-5d57f77b7817 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:36.115217 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1e7c0c93-e6e8-4223-838d-5d57f77b7817 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:36.116648 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1e7c0c93-e6e8-4223-838d-5d57f77b7817 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:36.186977 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_api:SELECT=89,nova_api:DELETE=1,nova_api:INSERT=9,nova_api:UPDATE=1 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:42:36.189157 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1e7c0c93-e6e8-4223-838d-5d57f77b7817 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:36.189823 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1e7c0c93-e6e8-4223-838d-5d57f77b7817 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:36.190423 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1e7c0c93-e6e8-4223-838d-5d57f77b7817 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:36.191030 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.objects.instance [None req-1e7c0c93-e6e8-4223-838d-5d57f77b7817 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lazy-loading 'fault' on Instance uuid ce0d629a-068c-4a62-8a03-fc43fc0be9b3 {{(pid=123596) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:42:36.215694 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-45ff6743-7aba-4bad-82c2-f3c92124ef64 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9971b5861f44c1a1da94eda0f8f02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f809b8ae704988961908bef0f3cb24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:36.231831 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-45ff6743-7aba-4bad-82c2-f3c92124ef64 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] 10.222.0.43 "GET /compute/v2.1/servers/3d03e642-62aa-4ed5-8427-a10c4bd9698e" status: 200 len: 1503 microversion: 2.1 time: 0.887761 Oct 04 18:42:36.233168 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1332/2798] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:35 2022] GET /compute/v2.1/servers/3d03e642-62aa-4ed5-8427-a10c4bd9698e => generated 1503 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:42:36.238262 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-a2a93e93-3e5c-40ce-9a81-ee6540e23e64 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:36.250070 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-a2a93e93-3e5c-40ce-9a81-ee6540e23e64 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] [instance: d7f06829-6beb-4d35-ab81-c99f9dd3027d] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:36.256285 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a2a93e93-3e5c-40ce-9a81-ee6540e23e64 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:36.256781 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a2a93e93-3e5c-40ce-9a81-ee6540e23e64 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:36.257256 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a2a93e93-3e5c-40ce-9a81-ee6540e23e64 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:36.257962 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a2a93e93-3e5c-40ce-9a81-ee6540e23e64 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:36.258419 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a2a93e93-3e5c-40ce-9a81-ee6540e23e64 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:36.258913 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a2a93e93-3e5c-40ce-9a81-ee6540e23e64 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:36.288367 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-1e7c0c93-e6e8-4223-838d-5d57f77b7817 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581885ffa737444eafa3179cceb6ee1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a6a1a86a59403dad27f6e3c628853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:36.301493 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-1e7c0c93-e6e8-4223-838d-5d57f77b7817 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/ce0d629a-068c-4a62-8a03-fc43fc0be9b3" status: 200 len: 1303 microversion: 2.1 time: 0.225413 Oct 04 18:42:36.302679 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1467/2799] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:36 2022] GET /compute/v2.1/servers/ce0d629a-068c-4a62-8a03-fc43fc0be9b3 => generated 1303 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:36.915161 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-3f3adb54-3309-448a-867d-388f034a6f5c tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:36.915816 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-3f3adb54-3309-448a-867d-388f034a6f5c tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] [instance: 67f7e060-f4e1-4f23-86f3-6f8ed96e4e22] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:36.930497 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3f3adb54-3309-448a-867d-388f034a6f5c tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:36.931061 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3f3adb54-3309-448a-867d-388f034a6f5c tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:36.931447 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3f3adb54-3309-448a-867d-388f034a6f5c tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:36.932362 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3f3adb54-3309-448a-867d-388f034a6f5c tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:36.932998 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3f3adb54-3309-448a-867d-388f034a6f5c tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:36.933466 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3f3adb54-3309-448a-867d-388f034a6f5c tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:37.240121 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-a2a93e93-3e5c-40ce-9a81-ee6540e23e64 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96e7480de94c43909045ac1087e40cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6bd34bf5540ee95c8144f185eb22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:37.255255 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-a2a93e93-3e5c-40ce-9a81-ee6540e23e64 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] 10.222.0.43 "GET /compute/v2.1/servers/d7f06829-6beb-4d35-ab81-c99f9dd3027d" status: 200 len: 1321 microversion: 2.1 time: 1.020752 Oct 04 18:42:37.255872 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1333/2800] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:36 2022] GET /compute/v2.1/servers/d7f06829-6beb-4d35-ab81-c99f9dd3027d => generated 1321 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:37.260862 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-631c073f-a65a-4684-ba58-fd9ab2c6f23a tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:37.261838 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-631c073f-a65a-4684-ba58-fd9ab2c6f23a tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] [instance: 74d78f04-e2a4-46ce-9da3-fe52e90f2090] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:37.268402 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-631c073f-a65a-4684-ba58-fd9ab2c6f23a tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:37.269358 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-631c073f-a65a-4684-ba58-fd9ab2c6f23a tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:37.270024 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-631c073f-a65a-4684-ba58-fd9ab2c6f23a tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:37.270993 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-631c073f-a65a-4684-ba58-fd9ab2c6f23a tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:37.271675 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-631c073f-a65a-4684-ba58-fd9ab2c6f23a tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:37.272333 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-631c073f-a65a-4684-ba58-fd9ab2c6f23a tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:37.491903 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-631c073f-a65a-4684-ba58-fd9ab2c6f23a tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecd189792024ba298f451523033386e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bc84144bf334722b4798851268b5f32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:37.501351 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-631c073f-a65a-4684-ba58-fd9ab2c6f23a tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] 10.222.0.43 "GET /compute/v2.1/servers/74d78f04-e2a4-46ce-9da3-fe52e90f2090" status: 200 len: 1284 microversion: 2.1 time: 0.244160 Oct 04 18:42:37.517552 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1334/2801] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:37 2022] GET /compute/v2.1/servers/74d78f04-e2a4-46ce-9da3-fe52e90f2090 => generated 1284 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:37.523129 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-709ad15c-83a5-413f-a36b-d49017352486 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:37.524093 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-709ad15c-83a5-413f-a36b-d49017352486 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] [instance: 3d03e642-62aa-4ed5-8427-a10c4bd9698e] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:37.530884 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-709ad15c-83a5-413f-a36b-d49017352486 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:37.531804 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-709ad15c-83a5-413f-a36b-d49017352486 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:37.532510 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-709ad15c-83a5-413f-a36b-d49017352486 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:37.533522 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-709ad15c-83a5-413f-a36b-d49017352486 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:37.534216 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-709ad15c-83a5-413f-a36b-d49017352486 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:37.534860 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-709ad15c-83a5-413f-a36b-d49017352486 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:37.669232 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-3f3adb54-3309-448a-867d-388f034a6f5c tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ee90610168a4d46b456d7a278991091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5419b9532d52479d8d99336b90ebe9ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:37.679497 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-3f3adb54-3309-448a-867d-388f034a6f5c tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] 10.222.0.43 "GET /compute/v2.1/servers/67f7e060-f4e1-4f23-86f3-6f8ed96e4e22" status: 200 len: 1320 microversion: 2.1 time: 0.768216 Oct 04 18:42:37.680116 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1468/2802] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:36 2022] GET /compute/v2.1/servers/67f7e060-f4e1-4f23-86f3-6f8ed96e4e22 => generated 1320 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:37.686091 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-56e26c9d-5dfe-4a07-9bb9-34df39af6a54 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:37.687021 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-56e26c9d-5dfe-4a07-9bb9-34df39af6a54 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] [instance: ce0d629a-068c-4a62-8a03-fc43fc0be9b3] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:37.699072 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-56e26c9d-5dfe-4a07-9bb9-34df39af6a54 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:37.700166 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-56e26c9d-5dfe-4a07-9bb9-34df39af6a54 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:37.700730 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-56e26c9d-5dfe-4a07-9bb9-34df39af6a54 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:37.701689 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-56e26c9d-5dfe-4a07-9bb9-34df39af6a54 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:37.702586 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-56e26c9d-5dfe-4a07-9bb9-34df39af6a54 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:37.703613 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-56e26c9d-5dfe-4a07-9bb9-34df39af6a54 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:37.721941 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-56e26c9d-5dfe-4a07-9bb9-34df39af6a54 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] HTTP exception thrown: Instance ce0d629a-068c-4a62-8a03-fc43fc0be9b3 could not be found. Oct 04 18:42:37.723782 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-56e26c9d-5dfe-4a07-9bb9-34df39af6a54 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Request method failure captured: Oct 04 18:42:37.723782 n-d-851028-13 devstack@n-api.service[123596]: request: GET /compute/v2.1/servers/ce0d629a-068c-4a62-8a03-fc43fc0be9b3 HTTP/1.1 Oct 04 18:42:37.723782 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:42:37.723782 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:42:37.723782 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:42:37.723782 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 18:42:37.723782 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:42:37.723782 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:42:37.723782 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:42:37.723782 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:42:37.723782 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPH0NoXgCy3n6sh1IGXjtfaHzlhYMuJpKcXPppfdRHbcKj96890BlFug3pTj2ae4hfUq7QwMio-uyNDngu9EC-WiWL2uy_k9NT0WkTh-babPsSjAzcuYjZjQlwoCrlTamTWYDHmmNVgGFwgEOV5-_lM17JGx4pac-wizTUHPmJe6XS4g Oct 04 18:42:37.723782 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:42:37.723782 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:42:37.723782 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:42:37.723782 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:42:37.723782 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:42:37.723782 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:42:37.723782 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: 50a6a1a86a59403dad27f6e3c628853c Oct 04 18:42:37.723782 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-MigrationsAdminTest-1383787507 Oct 04 18:42:37.723782 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 18:42:37.723782 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 18:42:37.723782 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/50a6a1a86a59403dad27f6e3c628853c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_50a6a1a86a59403dad27f6e3c628853c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/50a6a1a86a59403dad27f6e3c628853c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/50a6a1a86a59403dad27f6e3c628853c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:42:37.723782 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-MigrationsAdminTest-1383787507 Oct 04 18:42:37.723782 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: 50a6a1a86a59403dad27f6e3c628853c Oct 04 18:42:37.723782 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-MigrationsAdminTest-1383787507 Oct 04 18:42:37.723782 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-MigrationsAdminTest-1383787507-project Oct 04 18:42:37.723782 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:42:37.723782 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:42:37.723782 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 581885ffa737444eafa3179cceb6ee1d Oct 04 18:42:37.723782 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-MigrationsAdminTest-1383787507-project Oct 04 18:42:37.723782 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 18:42:37.723782 n-d-851028-13 devstack@n-api.service[123596]: exception: Instance ce0d629a-068c-4a62-8a03-fc43fc0be9b3 could not be found. Oct 04 18:42:37.723782 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': 'ce0d629a-068c-4a62-8a03-fc43fc0be9b3'} Oct 04 18:42:37.723782 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:42:37.723782 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:42:37.723782 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:42:37.723782 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:42:37.723782 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:42:37.723782 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:42:37.723782 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:42:37.723782 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:42:37.723782 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:42:37.723782 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:42:37.723782 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce0d629a-068c-4a62-8a03-fc43fc0be9b3 could not be found. Oct 04 18:42:37.723782 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:42:37.723782 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:42:37.723782 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:42:37.723782 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:42:37.723782 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:42:37.723782 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:42:37.723782 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:42:37.723782 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:42:37.723782 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:42:37.723782 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:42:37.723782 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:42:37.723782 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:42:37.723782 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:42:37.723782 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:42:37.723782 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:42:37.723782 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:42:37.723782 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce0d629a-068c-4a62-8a03-fc43fc0be9b3 could not be found. Oct 04 18:42:37.723782 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:42:37.723782 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:42:37.723782 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:42:37.728435 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:42:37.728435 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:42:37.728435 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:42:37.728435 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:42:37.728435 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:42:37.728435 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce0d629a-068c-4a62-8a03-fc43fc0be9b3 could not be found. Oct 04 18:42:37.728435 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:42:37.730214 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-56e26c9d-5dfe-4a07-9bb9-34df39af6a54 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] Returning 404 to user: Instance ce0d629a-068c-4a62-8a03-fc43fc0be9b3 could not be found. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:42:37.731106 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-56e26c9d-5dfe-4a07-9bb9-34df39af6a54 tempest-MigrationsAdminTest-1383787507 tempest-MigrationsAdminTest-1383787507-project] 10.222.0.43 "GET /compute/v2.1/servers/ce0d629a-068c-4a62-8a03-fc43fc0be9b3" status: 404 len: 111 microversion: 2.1 time: 0.049736 Oct 04 18:42:37.732007 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1469/2803] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:37 2022] GET /compute/v2.1/servers/ce0d629a-068c-4a62-8a03-fc43fc0be9b3 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:42:37.748615 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-cae06699-c9e4-4a38-aa5f-4b3767703f2e req-5f4e4d44-2b7d-4855-9667-18bbc5062d16 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "861427d4-c606-4a99-9c94-2b8e9dc42c1c", "tag": "00befd08-4583-44c6-95c5-b39c21d82c7f"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:42:37.761679 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-cae06699-c9e4-4a38-aa5f-4b3767703f2e req-5f4e4d44-2b7d-4855-9667-18bbc5062d16 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:37.763197 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-cae06699-c9e4-4a38-aa5f-4b3767703f2e req-5f4e4d44-2b7d-4855-9667-18bbc5062d16 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:37.770421 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-cae06699-c9e4-4a38-aa5f-4b3767703f2e req-5f4e4d44-2b7d-4855-9667-18bbc5062d16 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:37.786536 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-cae06699-c9e4-4a38-aa5f-4b3767703f2e req-5f4e4d44-2b7d-4855-9667-18bbc5062d16 service nova] Creating event network-changed:00befd08-4583-44c6-95c5-b39c21d82c7f for instance 861427d4-c606-4a99-9c94-2b8e9dc42c1c on n-h2-851028-13 Oct 04 18:42:37.802745 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-cae06699-c9e4-4a38-aa5f-4b3767703f2e req-5f4e4d44-2b7d-4855-9667-18bbc5062d16 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058622 Oct 04 18:42:37.804293 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1470/2804] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:42:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:42:38.287682 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-11d18b5c-5fad-4591-8c69-8072ac2cbe53 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:38.288552 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-11d18b5c-5fad-4591-8c69-8072ac2cbe53 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] [instance: d7f06829-6beb-4d35-ab81-c99f9dd3027d] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:38.292868 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-709ad15c-83a5-413f-a36b-d49017352486 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9971b5861f44c1a1da94eda0f8f02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f809b8ae704988961908bef0f3cb24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:38.307563 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-11d18b5c-5fad-4591-8c69-8072ac2cbe53 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:38.308167 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-11d18b5c-5fad-4591-8c69-8072ac2cbe53 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:38.310449 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-11d18b5c-5fad-4591-8c69-8072ac2cbe53 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:38.311433 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-11d18b5c-5fad-4591-8c69-8072ac2cbe53 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:38.315397 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-709ad15c-83a5-413f-a36b-d49017352486 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] 10.222.0.43 "GET /compute/v2.1/servers/3d03e642-62aa-4ed5-8427-a10c4bd9698e" status: 200 len: 1503 microversion: 2.1 time: 0.796129 Oct 04 18:42:38.321651 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-11d18b5c-5fad-4591-8c69-8072ac2cbe53 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:38.329860 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-11d18b5c-5fad-4591-8c69-8072ac2cbe53 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:38.335292 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:42:38.336002 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1335/2805] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:37 2022] GET /compute/v2.1/servers/3d03e642-62aa-4ed5-8427-a10c4bd9698e => generated 1503 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:38.530386 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-766076d1-c11f-4473-ad28-88e17ab58e18 tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:38.531495 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-766076d1-c11f-4473-ad28-88e17ab58e18 tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] [instance: 74d78f04-e2a4-46ce-9da3-fe52e90f2090] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:38.543177 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-766076d1-c11f-4473-ad28-88e17ab58e18 tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:38.543908 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-766076d1-c11f-4473-ad28-88e17ab58e18 tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:38.544620 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-766076d1-c11f-4473-ad28-88e17ab58e18 tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:38.545601 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-766076d1-c11f-4473-ad28-88e17ab58e18 tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:38.546252 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-766076d1-c11f-4473-ad28-88e17ab58e18 tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:38.551859 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-766076d1-c11f-4473-ad28-88e17ab58e18 tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:38.923894 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-11d18b5c-5fad-4591-8c69-8072ac2cbe53 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96e7480de94c43909045ac1087e40cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6bd34bf5540ee95c8144f185eb22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:38.949502 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-11d18b5c-5fad-4591-8c69-8072ac2cbe53 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] 10.222.0.43 "GET /compute/v2.1/servers/d7f06829-6beb-4d35-ab81-c99f9dd3027d" status: 200 len: 1321 microversion: 2.1 time: 0.668164 Oct 04 18:42:38.952030 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1471/2806] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:38 2022] GET /compute/v2.1/servers/d7f06829-6beb-4d35-ab81-c99f9dd3027d => generated 1321 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:38.959268 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-d52b2a6e-0b3c-4b00-8ac3-f924f4840905 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:38.960880 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-d52b2a6e-0b3c-4b00-8ac3-f924f4840905 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] [instance: 67f7e060-f4e1-4f23-86f3-6f8ed96e4e22] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:38.971103 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d52b2a6e-0b3c-4b00-8ac3-f924f4840905 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:38.971903 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d52b2a6e-0b3c-4b00-8ac3-f924f4840905 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:38.972436 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d52b2a6e-0b3c-4b00-8ac3-f924f4840905 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:38.973388 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d52b2a6e-0b3c-4b00-8ac3-f924f4840905 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:38.973887 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d52b2a6e-0b3c-4b00-8ac3-f924f4840905 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:38.974588 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d52b2a6e-0b3c-4b00-8ac3-f924f4840905 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:39.290189 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-766076d1-c11f-4473-ad28-88e17ab58e18 tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecd189792024ba298f451523033386e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bc84144bf334722b4798851268b5f32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:39.302311 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-766076d1-c11f-4473-ad28-88e17ab58e18 tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] 10.222.0.43 "GET /compute/v2.1/servers/74d78f04-e2a4-46ce-9da3-fe52e90f2090" status: 200 len: 1352 microversion: 2.1 time: 0.776684 Oct 04 18:42:39.315009 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-d52b2a6e-0b3c-4b00-8ac3-f924f4840905 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ee90610168a4d46b456d7a278991091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5419b9532d52479d8d99336b90ebe9ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:39.317651 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1336/2807] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:38 2022] GET /compute/v2.1/servers/74d78f04-e2a4-46ce-9da3-fe52e90f2090 => generated 1352 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:42:39.326000 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-d52b2a6e-0b3c-4b00-8ac3-f924f4840905 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] 10.222.0.43 "GET /compute/v2.1/servers/67f7e060-f4e1-4f23-86f3-6f8ed96e4e22" status: 200 len: 1320 microversion: 2.1 time: 0.372036 Oct 04 18:42:39.326600 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1472/2808] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:38 2022] GET /compute/v2.1/servers/67f7e060-f4e1-4f23-86f3-6f8ed96e4e22 => generated 1320 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:39.352175 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-4594ad4a-6976-451a-abd8-67d0166033d7 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:39.352827 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-4594ad4a-6976-451a-abd8-67d0166033d7 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] [instance: 3d03e642-62aa-4ed5-8427-a10c4bd9698e] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:39.360933 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4594ad4a-6976-451a-abd8-67d0166033d7 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:39.363346 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4594ad4a-6976-451a-abd8-67d0166033d7 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:39.381555 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4594ad4a-6976-451a-abd8-67d0166033d7 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:39.382686 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4594ad4a-6976-451a-abd8-67d0166033d7 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:39.383387 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4594ad4a-6976-451a-abd8-67d0166033d7 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:39.384040 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4594ad4a-6976-451a-abd8-67d0166033d7 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:39.974637 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-533019d5-340a-405c-b292-c8da24040da9 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:39.975520 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-533019d5-340a-405c-b292-c8da24040da9 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] [instance: d7f06829-6beb-4d35-ab81-c99f9dd3027d] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:39.985928 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-533019d5-340a-405c-b292-c8da24040da9 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:39.986724 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-533019d5-340a-405c-b292-c8da24040da9 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:39.987368 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-533019d5-340a-405c-b292-c8da24040da9 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:39.988318 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-533019d5-340a-405c-b292-c8da24040da9 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:39.988981 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-533019d5-340a-405c-b292-c8da24040da9 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:39.989630 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-533019d5-340a-405c-b292-c8da24040da9 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:40.373231 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-533019d5-340a-405c-b292-c8da24040da9 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96e7480de94c43909045ac1087e40cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6bd34bf5540ee95c8144f185eb22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:40.397131 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-533019d5-340a-405c-b292-c8da24040da9 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] 10.222.0.43 "GET /compute/v2.1/servers/d7f06829-6beb-4d35-ab81-c99f9dd3027d" status: 200 len: 1321 microversion: 2.1 time: 0.426232 Oct 04 18:42:40.415184 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1473/2809] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:39 2022] GET /compute/v2.1/servers/d7f06829-6beb-4d35-ab81-c99f9dd3027d => generated 1321 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:42:40.422433 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-79faecc7-f33f-45c9-8136-3ea09df4be5c req-d90c6381-9cf3-49b6-80c6-a676602642ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67f7e060-f4e1-4f23-86f3-6f8ed96e4e22", "tag": "2b3a1d4f-3f20-490f-a873-011a2860f667"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:42:40.432804 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-4594ad4a-6976-451a-abd8-67d0166033d7 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9971b5861f44c1a1da94eda0f8f02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f809b8ae704988961908bef0f3cb24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:40.444988 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-4594ad4a-6976-451a-abd8-67d0166033d7 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] 10.222.0.43 "GET /compute/v2.1/servers/3d03e642-62aa-4ed5-8427-a10c4bd9698e" status: 200 len: 1493 microversion: 2.1 time: 1.101671 Oct 04 18:42:40.447798 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-79faecc7-f33f-45c9-8136-3ea09df4be5c req-d90c6381-9cf3-49b6-80c6-a676602642ce service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:40.449239 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1337/2810] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:39 2022] GET /compute/v2.1/servers/3d03e642-62aa-4ed5-8427-a10c4bd9698e => generated 1493 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:40.452483 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-79faecc7-f33f-45c9-8136-3ea09df4be5c req-d90c6381-9cf3-49b6-80c6-a676602642ce service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:40.453293 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-79faecc7-f33f-45c9-8136-3ea09df4be5c req-d90c6381-9cf3-49b6-80c6-a676602642ce service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:40.460945 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-76af988f-cc12-4b38-ae0f-9f794e8a8063 tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:40.461844 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-76af988f-cc12-4b38-ae0f-9f794e8a8063 tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] [instance: 74d78f04-e2a4-46ce-9da3-fe52e90f2090] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:40.474525 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-76af988f-cc12-4b38-ae0f-9f794e8a8063 tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:40.478384 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-76af988f-cc12-4b38-ae0f-9f794e8a8063 tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:40.478384 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-76af988f-cc12-4b38-ae0f-9f794e8a8063 tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:40.479156 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-76af988f-cc12-4b38-ae0f-9f794e8a8063 tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:40.479760 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-76af988f-cc12-4b38-ae0f-9f794e8a8063 tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:40.481540 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-79faecc7-f33f-45c9-8136-3ea09df4be5c req-d90c6381-9cf3-49b6-80c6-a676602642ce service nova] Creating event network-changed:2b3a1d4f-3f20-490f-a873-011a2860f667 for instance 67f7e060-f4e1-4f23-86f3-6f8ed96e4e22 on n-h1-851028-13 Oct 04 18:42:40.482166 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-76af988f-cc12-4b38-ae0f-9f794e8a8063 tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:40.493454 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-79faecc7-f33f-45c9-8136-3ea09df4be5c req-d90c6381-9cf3-49b6-80c6-a676602642ce service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076561 Oct 04 18:42:40.497042 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1474/2811] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:42:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:42:40.507089 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-15b82295-f1d2-489a-8dd1-71a767d04e8f tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:40.513747 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-15b82295-f1d2-489a-8dd1-71a767d04e8f tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] [instance: 67f7e060-f4e1-4f23-86f3-6f8ed96e4e22] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:40.530031 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-15b82295-f1d2-489a-8dd1-71a767d04e8f tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:40.531879 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-15b82295-f1d2-489a-8dd1-71a767d04e8f tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:40.532410 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-15b82295-f1d2-489a-8dd1-71a767d04e8f tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:40.534679 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-15b82295-f1d2-489a-8dd1-71a767d04e8f tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:40.535235 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-15b82295-f1d2-489a-8dd1-71a767d04e8f tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:40.536258 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-15b82295-f1d2-489a-8dd1-71a767d04e8f tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:40.806020 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-15b82295-f1d2-489a-8dd1-71a767d04e8f tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ee90610168a4d46b456d7a278991091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5419b9532d52479d8d99336b90ebe9ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:40.824450 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-15b82295-f1d2-489a-8dd1-71a767d04e8f tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] 10.222.0.43 "GET /compute/v2.1/servers/67f7e060-f4e1-4f23-86f3-6f8ed96e4e22" status: 200 len: 1320 microversion: 2.1 time: 0.320618 Oct 04 18:42:40.825975 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1475/2812] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:40 2022] GET /compute/v2.1/servers/67f7e060-f4e1-4f23-86f3-6f8ed96e4e22 => generated 1320 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:40.836335 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-fcca9309-4610-4e6d-9d7a-03d9fffe1ca1 tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] Calling method '.version_select at 0x7fb2246bc310>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:40.853014 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fcca9309-4610-4e6d-9d7a-03d9fffe1ca1 tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:40.854015 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fcca9309-4610-4e6d-9d7a-03d9fffe1ca1 tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:40.857289 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fcca9309-4610-4e6d-9d7a-03d9fffe1ca1 tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:40.876440 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-fcca9309-4610-4e6d-9d7a-03d9fffe1ca1 tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] 10.222.0.43 "GET /compute/v2.1/os-migrations" status: 200 len: 404 microversion: 2.1 time: 0.046889 Oct 04 18:42:40.879572 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1476/2813] 10.222.0.43 () {58 vars in 1143 bytes} [Tue Oct 4 18:42:40 2022] GET /compute/v2.1/os-migrations => generated 404 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:42:40.904464 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-0dc2d8bc-3ca9-469c-90d1-9d7ba8e7bf84 tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:40.905720 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-0dc2d8bc-3ca9-469c-90d1-9d7ba8e7bf84 tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] [instance: 3d03e642-62aa-4ed5-8427-a10c4bd9698e] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:40.930299 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0dc2d8bc-3ca9-469c-90d1-9d7ba8e7bf84 tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:40.930805 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0dc2d8bc-3ca9-469c-90d1-9d7ba8e7bf84 tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:40.931427 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0dc2d8bc-3ca9-469c-90d1-9d7ba8e7bf84 tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:40.932291 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0dc2d8bc-3ca9-469c-90d1-9d7ba8e7bf84 tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:40.932766 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0dc2d8bc-3ca9-469c-90d1-9d7ba8e7bf84 tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:40.933225 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0dc2d8bc-3ca9-469c-90d1-9d7ba8e7bf84 tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:41.182868 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-76af988f-cc12-4b38-ae0f-9f794e8a8063 tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecd189792024ba298f451523033386e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bc84144bf334722b4798851268b5f32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:41.194114 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-76af988f-cc12-4b38-ae0f-9f794e8a8063 tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] 10.222.0.43 "GET /compute/v2.1/servers/74d78f04-e2a4-46ce-9da3-fe52e90f2090" status: 200 len: 1352 microversion: 2.1 time: 0.743402 Oct 04 18:42:41.195478 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1338/2814] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:40 2022] GET /compute/v2.1/servers/74d78f04-e2a4-46ce-9da3-fe52e90f2090 => generated 1352 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:41.208125 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-3f868388-816c-4016-8e18-7f824046f4f8 req-49a05f45-1c68-41bb-8b29-a558679c8079 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f726f3f3-4731-4380-9163-b2273b629810", "name": "network-vif-plugged", "status": "completed", "tag": "e0981442-7ddc-47a4-b476-d7804751bfec"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:42:41.231041 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-3f868388-816c-4016-8e18-7f824046f4f8 req-49a05f45-1c68-41bb-8b29-a558679c8079 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:41.242359 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-3f868388-816c-4016-8e18-7f824046f4f8 req-49a05f45-1c68-41bb-8b29-a558679c8079 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:41.242829 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-3f868388-816c-4016-8e18-7f824046f4f8 req-49a05f45-1c68-41bb-8b29-a558679c8079 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:41.260925 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-3f868388-816c-4016-8e18-7f824046f4f8 req-49a05f45-1c68-41bb-8b29-a558679c8079 service nova] Creating event network-vif-plugged:e0981442-7ddc-47a4-b476-d7804751bfec for instance f726f3f3-4731-4380-9163-b2273b629810 on n-h2-851028-13 Oct 04 18:42:41.267587 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-3f868388-816c-4016-8e18-7f824046f4f8 req-49a05f45-1c68-41bb-8b29-a558679c8079 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070141 Oct 04 18:42:41.268823 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1339/2815] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:42:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:42:41.361269 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-0dc2d8bc-3ca9-469c-90d1-9d7ba8e7bf84 tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/3d03e642-62aa-4ed5-8427-a10c4bd9698e" status: 200 len: 1646 microversion: 2.1 time: 0.468799 Oct 04 18:42:41.376050 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1477/2816] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:40 2022] GET /compute/v2.1/servers/3d03e642-62aa-4ed5-8427-a10c4bd9698e => generated 1646 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:41.427883 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-65b8c5f4-d0bf-4b00-ab3e-538e4f1b9568 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:41.428895 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-65b8c5f4-d0bf-4b00-ab3e-538e4f1b9568 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] [instance: d7f06829-6beb-4d35-ab81-c99f9dd3027d] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:41.435401 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-65b8c5f4-d0bf-4b00-ab3e-538e4f1b9568 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:41.437425 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-65b8c5f4-d0bf-4b00-ab3e-538e4f1b9568 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:41.438416 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-65b8c5f4-d0bf-4b00-ab3e-538e4f1b9568 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:41.439388 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-65b8c5f4-d0bf-4b00-ab3e-538e4f1b9568 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:41.440100 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-65b8c5f4-d0bf-4b00-ab3e-538e4f1b9568 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:41.441334 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-65b8c5f4-d0bf-4b00-ab3e-538e4f1b9568 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:41.472227 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=100 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:42:41.559437 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-02e37676-9192-48a7-aabc-9cb4de4676b0 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-528434838", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452", "networks": [{"uuid": "3b95df32-80ff-41d3-8ca9-09785472b92e"}]}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:42:41.628138 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.network.neutron [None req-02e37676-9192-48a7-aabc-9cb4de4676b0 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] validate_networks() for [('3b95df32-80ff-41d3-8ca9-09785472b92e', None, None, None, None, None)] {{(pid=123596) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:42:41.796394 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-65b8c5f4-d0bf-4b00-ab3e-538e4f1b9568 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96e7480de94c43909045ac1087e40cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6bd34bf5540ee95c8144f185eb22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:41.815794 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-65b8c5f4-d0bf-4b00-ab3e-538e4f1b9568 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] 10.222.0.43 "GET /compute/v2.1/servers/d7f06829-6beb-4d35-ab81-c99f9dd3027d" status: 200 len: 1321 microversion: 2.1 time: 0.388355 Oct 04 18:42:41.816678 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1340/2817] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:41 2022] GET /compute/v2.1/servers/d7f06829-6beb-4d35-ab81-c99f9dd3027d => generated 1321 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:41.850440 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-69fc71c3-ae84-4487-bf2f-861dd5d3a11b tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:41.854296 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-69fc71c3-ae84-4487-bf2f-861dd5d3a11b tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] [instance: 67f7e060-f4e1-4f23-86f3-6f8ed96e4e22] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:41.867363 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-69fc71c3-ae84-4487-bf2f-861dd5d3a11b tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:41.868165 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-69fc71c3-ae84-4487-bf2f-861dd5d3a11b tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:41.870390 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-69fc71c3-ae84-4487-bf2f-861dd5d3a11b tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:41.872653 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-69fc71c3-ae84-4487-bf2f-861dd5d3a11b tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:41.873372 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-69fc71c3-ae84-4487-bf2f-861dd5d3a11b tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:41.874585 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-69fc71c3-ae84-4487-bf2f-861dd5d3a11b tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:42.104982 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=6 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:42:42.328078 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-69fc71c3-ae84-4487-bf2f-861dd5d3a11b tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ee90610168a4d46b456d7a278991091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5419b9532d52479d8d99336b90ebe9ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:42.341066 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-69fc71c3-ae84-4487-bf2f-861dd5d3a11b tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] 10.222.0.43 "GET /compute/v2.1/servers/67f7e060-f4e1-4f23-86f3-6f8ed96e4e22" status: 200 len: 1320 microversion: 2.1 time: 0.493780 Oct 04 18:42:42.342454 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1341/2818] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:41 2022] GET /compute/v2.1/servers/67f7e060-f4e1-4f23-86f3-6f8ed96e4e22 => generated 1320 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:42.348699 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-3c45e6bb-1b35-4973-921a-7e6c340f4062 tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:42.349755 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-3c45e6bb-1b35-4973-921a-7e6c340f4062 tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] [instance: 74d78f04-e2a4-46ce-9da3-fe52e90f2090] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:42.357001 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3c45e6bb-1b35-4973-921a-7e6c340f4062 tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:42.358260 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3c45e6bb-1b35-4973-921a-7e6c340f4062 tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:42.360095 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3c45e6bb-1b35-4973-921a-7e6c340f4062 tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:42.361080 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3c45e6bb-1b35-4973-921a-7e6c340f4062 tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:42.362071 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3c45e6bb-1b35-4973-921a-7e6c340f4062 tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:42.362700 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3c45e6bb-1b35-4973-921a-7e6c340f4062 tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:42.629895 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-02e37676-9192-48a7-aabc-9cb4de4676b0 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Flavor limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:42:42.631469 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-02e37676-9192-48a7-aabc-9cb4de4676b0 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Image limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:42:42.632133 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-02e37676-9192-48a7-aabc-9cb4de4676b0 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Flavor pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:42:42.632721 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-02e37676-9192-48a7-aabc-9cb4de4676b0 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Image pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:42:42.633354 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-02e37676-9192-48a7-aabc-9cb4de4676b0 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:42:42.650733 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-02e37676-9192-48a7-aabc-9cb4de4676b0 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:42.651233 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-02e37676-9192-48a7-aabc-9cb4de4676b0 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:42.651689 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-02e37676-9192-48a7-aabc-9cb4de4676b0 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:42.652430 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-02e37676-9192-48a7-aabc-9cb4de4676b0 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:42.652892 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-02e37676-9192-48a7-aabc-9cb4de4676b0 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:42.653362 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-02e37676-9192-48a7-aabc-9cb4de4676b0 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:42.653599 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-3c45e6bb-1b35-4973-921a-7e6c340f4062 tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecd189792024ba298f451523033386e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bc84144bf334722b4798851268b5f32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:42.668588 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-3c45e6bb-1b35-4973-921a-7e6c340f4062 tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] 10.222.0.43 "GET /compute/v2.1/servers/74d78f04-e2a4-46ce-9da3-fe52e90f2090" status: 200 len: 1352 microversion: 2.1 time: 0.323653 Oct 04 18:42:42.682127 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1342/2819] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:42 2022] GET /compute/v2.1/servers/74d78f04-e2a4-46ce-9da3-fe52e90f2090 => generated 1352 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:42.693081 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-837e52e2-85b6-4137-b261-092baae5cd6d req-0f6cf031-936b-4b0a-a801-2234583618cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74d78f04-e2a4-46ce-9da3-fe52e90f2090", "tag": "28ad400f-e2ec-4faf-bb1a-cf2726a0831a"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:42:42.697464 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-02e37676-9192-48a7-aabc-9cb4de4676b0 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Getting quotas for project a9f809b8ae704988961908bef0f3cb24. Resources: {'ram', 'cores', 'instances'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:42:42.706590 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-837e52e2-85b6-4137-b261-092baae5cd6d req-0f6cf031-936b-4b0a-a801-2234583618cd service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:42.707285 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-837e52e2-85b6-4137-b261-092baae5cd6d req-0f6cf031-936b-4b0a-a801-2234583618cd service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:42.707920 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-837e52e2-85b6-4137-b261-092baae5cd6d req-0f6cf031-936b-4b0a-a801-2234583618cd service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:42.711715 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-02e37676-9192-48a7-aabc-9cb4de4676b0 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Getting quotas for user ae9971b5861f44c1a1da94eda0f8f02d and project a9f809b8ae704988961908bef0f3cb24. Resources: {'ram', 'cores', 'instances'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:42:42.723136 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-837e52e2-85b6-4137-b261-092baae5cd6d req-0f6cf031-936b-4b0a-a801-2234583618cd service nova] Creating event network-changed:28ad400f-e2ec-4faf-bb1a-cf2726a0831a for instance 74d78f04-e2a4-46ce-9da3-fe52e90f2090 on n-h2-851028-13 Oct 04 18:42:42.728941 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-837e52e2-85b6-4137-b261-092baae5cd6d req-0f6cf031-936b-4b0a-a801-2234583618cd service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045521 Oct 04 18:42:42.729786 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1343/2820] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:42:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:42:42.736023 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-02e37676-9192-48a7-aabc-9cb4de4676b0 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Going to run 1 instances... {{(pid=123596) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:42:42.738455 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-02e37676-9192-48a7-aabc-9cb4de4676b0 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] [instance: 2d229458-6857-4662-ad59-30770808e2a1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e8943ec5-4038-4d4b-b9b9-2415a79f5243',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123596) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:42:42.799845 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-02e37676-9192-48a7-aabc-9cb4de4676b0 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.244915 Oct 04 18:42:42.808091 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1478/2821] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 18:42:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 1254 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:42:42.819454 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-2c1a73bd-3322-491e-80c8-b431597935f7 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:42.820241 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-2c1a73bd-3322-491e-80c8-b431597935f7 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] [instance: 2d229458-6857-4662-ad59-30770808e2a1] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:42.897094 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-2c1a73bd-3322-491e-80c8-b431597935f7 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9971b5861f44c1a1da94eda0f8f02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f809b8ae704988961908bef0f3cb24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:42.906620 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-2c1a73bd-3322-491e-80c8-b431597935f7 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] 10.222.0.43 "GET /compute/v2.1/servers/2d229458-6857-4662-ad59-30770808e2a1" status: 200 len: 1210 microversion: 2.1 time: 0.089580 Oct 04 18:42:42.907835 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1479/2822] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:42 2022] GET /compute/v2.1/servers/2d229458-6857-4662-ad59-30770808e2a1 => generated 1210 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:42:42.928067 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-e386cd57-6a48-40f7-a04c-bc38ae72b220 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:42.929083 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-e386cd57-6a48-40f7-a04c-bc38ae72b220 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] [instance: d7f06829-6beb-4d35-ab81-c99f9dd3027d] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:42.945825 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-2f6088d5-e74e-4345-95b3-f9fc2a32a9b4 tempest-QuotaClassesAdmin257Test-1724533736 tempest-QuotaClassesAdmin257Test-1724533736-project-admin] Calling method '.version_select at 0x7fb21f0209d0>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:42.956081 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e386cd57-6a48-40f7-a04c-bc38ae72b220 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:42.957725 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e386cd57-6a48-40f7-a04c-bc38ae72b220 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:42.958183 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e386cd57-6a48-40f7-a04c-bc38ae72b220 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:42.958932 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e386cd57-6a48-40f7-a04c-bc38ae72b220 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:42.961534 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e386cd57-6a48-40f7-a04c-bc38ae72b220 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:42.962045 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e386cd57-6a48-40f7-a04c-bc38ae72b220 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:42.977907 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-2f6088d5-e74e-4345-95b3-f9fc2a32a9b4 tempest-QuotaClassesAdmin257Test-1724533736 tempest-QuotaClassesAdmin257Test-1724533736-project-admin] 10.222.0.43 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 0.247029 Oct 04 18:42:42.984779 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1344/2823] 10.222.0.43 () {60 vars in 1226 bytes} [Tue Oct 4 18:42:42 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:42:42.990522 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-596f207d-7dbe-42b8-8d72-4c753bc2f9be tempest-QuotaClassesAdmin257Test-1724533736 tempest-QuotaClassesAdmin257Test-1724533736-project-admin] Action: 'update', calling method: .version_select at 0x7fb21f0205e0>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:42:43.335053 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-596f207d-7dbe-42b8-8d72-4c753bc2f9be tempest-QuotaClassesAdmin257Test-1724533736 tempest-QuotaClassesAdmin257Test-1724533736-project-admin] 10.222.0.43 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 0.348715 Oct 04 18:42:43.336062 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1345/2824] 10.222.0.43 () {62 vars in 1247 bytes} [Tue Oct 4 18:42:42 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:42:43.342774 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-e386cd57-6a48-40f7-a04c-bc38ae72b220 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96e7480de94c43909045ac1087e40cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6bd34bf5540ee95c8144f185eb22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:43.370146 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-17ca94c4-349a-4318-9d97-fae005f6117b tempest-QuotaClassesAdmin257Test-1724533736 tempest-QuotaClassesAdmin257Test-1724533736-project-admin] Calling method '.version_select at 0x7fb21fd1fca0>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:43.385592 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-e386cd57-6a48-40f7-a04c-bc38ae72b220 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] 10.222.0.43 "GET /compute/v2.1/servers/d7f06829-6beb-4d35-ab81-c99f9dd3027d" status: 200 len: 1321 microversion: 2.1 time: 0.471687 Oct 04 18:42:43.392963 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1480/2825] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:42 2022] GET /compute/v2.1/servers/d7f06829-6beb-4d35-ab81-c99f9dd3027d => generated 1321 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:43.404687 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-3ae2b7bb-7f8a-4f6d-a947-3b26708ebcfe tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:43.406323 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-3ae2b7bb-7f8a-4f6d-a947-3b26708ebcfe tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] [instance: 67f7e060-f4e1-4f23-86f3-6f8ed96e4e22] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:43.417545 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-17ca94c4-349a-4318-9d97-fae005f6117b tempest-QuotaClassesAdmin257Test-1724533736 tempest-QuotaClassesAdmin257Test-1724533736-project-admin] 10.222.0.43 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.050974 Oct 04 18:42:43.420217 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1346/2826] 10.222.0.43 () {60 vars in 1226 bytes} [Tue Oct 4 18:42:43 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:42:43.434418 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-5e190fb5-ef87-48c4-a855-82fcd4b33370 tempest-QuotaClassesAdmin257Test-1724533736 tempest-QuotaClassesAdmin257Test-1724533736-project-admin] Action: 'update', calling method: .version_select at 0x7fb21ed16550>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:42:43.435123 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3ae2b7bb-7f8a-4f6d-a947-3b26708ebcfe tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:43.435637 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3ae2b7bb-7f8a-4f6d-a947-3b26708ebcfe tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:43.438122 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3ae2b7bb-7f8a-4f6d-a947-3b26708ebcfe tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:43.438891 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3ae2b7bb-7f8a-4f6d-a947-3b26708ebcfe tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:43.439363 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3ae2b7bb-7f8a-4f6d-a947-3b26708ebcfe tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:43.439806 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3ae2b7bb-7f8a-4f6d-a947-3b26708ebcfe tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:43.559731 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-5e190fb5-ef87-48c4-a855-82fcd4b33370 tempest-QuotaClassesAdmin257Test-1724533736 tempest-QuotaClassesAdmin257Test-1724533736-project-admin] 10.222.0.43 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 0.131764 Oct 04 18:42:43.560955 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1347/2827] 10.222.0.43 () {62 vars in 1247 bytes} [Tue Oct 4 18:42:43 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 18:42:43.627807 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-1bfb6d47-ca5e-4f76-8c57-ac6d1c296e2b req-d6ceb1c6-6eb8-4c22-a6a2-7d22ed4274ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7f06829-6beb-4d35-ab81-c99f9dd3027d", "name": "network-vif-plugged", "status": "completed", "tag": "2735d07e-0a18-4de8-a88d-c4f6ed3f9244"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:42:43.652461 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-1bfb6d47-ca5e-4f76-8c57-ac6d1c296e2b req-d6ceb1c6-6eb8-4c22-a6a2-7d22ed4274ea service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:43.657550 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-1bfb6d47-ca5e-4f76-8c57-ac6d1c296e2b req-d6ceb1c6-6eb8-4c22-a6a2-7d22ed4274ea service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:43.659545 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-1bfb6d47-ca5e-4f76-8c57-ac6d1c296e2b req-d6ceb1c6-6eb8-4c22-a6a2-7d22ed4274ea service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:43.690591 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-1bfb6d47-ca5e-4f76-8c57-ac6d1c296e2b req-d6ceb1c6-6eb8-4c22-a6a2-7d22ed4274ea service nova] Creating event network-vif-plugged:2735d07e-0a18-4de8-a88d-c4f6ed3f9244 for instance d7f06829-6beb-4d35-ab81-c99f9dd3027d on n-h1-851028-13 Oct 04 18:42:43.695975 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-1bfb6d47-ca5e-4f76-8c57-ac6d1c296e2b req-d6ceb1c6-6eb8-4c22-a6a2-7d22ed4274ea service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076487 Oct 04 18:42:43.696970 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1348/2828] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:42:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:42:43.703106 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-73080a6b-3af9-4228-8b77-a5a780346eb1 tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:43.704314 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-73080a6b-3af9-4228-8b77-a5a780346eb1 tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] [instance: 74d78f04-e2a4-46ce-9da3-fe52e90f2090] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:43.719639 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-73080a6b-3af9-4228-8b77-a5a780346eb1 tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:43.720318 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-73080a6b-3af9-4228-8b77-a5a780346eb1 tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:43.720991 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-73080a6b-3af9-4228-8b77-a5a780346eb1 tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:43.721885 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-73080a6b-3af9-4228-8b77-a5a780346eb1 tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:43.722504 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-73080a6b-3af9-4228-8b77-a5a780346eb1 tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:43.723395 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-73080a6b-3af9-4228-8b77-a5a780346eb1 tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:43.870939 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-3ae2b7bb-7f8a-4f6d-a947-3b26708ebcfe tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ee90610168a4d46b456d7a278991091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5419b9532d52479d8d99336b90ebe9ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:43.893234 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-3ae2b7bb-7f8a-4f6d-a947-3b26708ebcfe tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] 10.222.0.43 "GET /compute/v2.1/servers/67f7e060-f4e1-4f23-86f3-6f8ed96e4e22" status: 200 len: 1320 microversion: 2.1 time: 0.498602 Oct 04 18:42:43.904977 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1481/2829] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:43 2022] GET /compute/v2.1/servers/67f7e060-f4e1-4f23-86f3-6f8ed96e4e22 => generated 1320 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:43.935139 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-eedd9d0e-b42e-4d2c-a718-123e04d8c45d tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:43.935771 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-eedd9d0e-b42e-4d2c-a718-123e04d8c45d tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] [instance: 2d229458-6857-4662-ad59-30770808e2a1] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:43.947569 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-eedd9d0e-b42e-4d2c-a718-123e04d8c45d tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:43.948087 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-eedd9d0e-b42e-4d2c-a718-123e04d8c45d tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:43.948532 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-eedd9d0e-b42e-4d2c-a718-123e04d8c45d tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:43.956140 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-eedd9d0e-b42e-4d2c-a718-123e04d8c45d tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:43.961155 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-eedd9d0e-b42e-4d2c-a718-123e04d8c45d tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:43.961819 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-eedd9d0e-b42e-4d2c-a718-123e04d8c45d tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:44.246283 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-eedd9d0e-b42e-4d2c-a718-123e04d8c45d tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9971b5861f44c1a1da94eda0f8f02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f809b8ae704988961908bef0f3cb24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:44.263909 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-eedd9d0e-b42e-4d2c-a718-123e04d8c45d tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] 10.222.0.43 "GET /compute/v2.1/servers/2d229458-6857-4662-ad59-30770808e2a1" status: 200 len: 1206 microversion: 2.1 time: 0.329343 Oct 04 18:42:44.280400 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1482/2830] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:43 2022] GET /compute/v2.1/servers/2d229458-6857-4662-ad59-30770808e2a1 => generated 1206 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:44.328299 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-73080a6b-3af9-4228-8b77-a5a780346eb1 tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecd189792024ba298f451523033386e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bc84144bf334722b4798851268b5f32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:44.337924 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-73080a6b-3af9-4228-8b77-a5a780346eb1 tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] 10.222.0.43 "GET /compute/v2.1/servers/74d78f04-e2a4-46ce-9da3-fe52e90f2090" status: 200 len: 1352 microversion: 2.1 time: 0.639613 Oct 04 18:42:44.349910 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1349/2831] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:43 2022] GET /compute/v2.1/servers/74d78f04-e2a4-46ce-9da3-fe52e90f2090 => generated 1352 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:44.413652 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f8c934c3-5b1a-43f2-ba22-81ece57ebe19 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:44.414746 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-f8c934c3-5b1a-43f2-ba22-81ece57ebe19 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] [instance: d7f06829-6beb-4d35-ab81-c99f9dd3027d] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:44.426397 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f8c934c3-5b1a-43f2-ba22-81ece57ebe19 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:44.427155 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f8c934c3-5b1a-43f2-ba22-81ece57ebe19 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:44.427763 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f8c934c3-5b1a-43f2-ba22-81ece57ebe19 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:44.429901 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f8c934c3-5b1a-43f2-ba22-81ece57ebe19 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:44.430633 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f8c934c3-5b1a-43f2-ba22-81ece57ebe19 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:44.431238 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f8c934c3-5b1a-43f2-ba22-81ece57ebe19 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:44.669228 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-f8c934c3-5b1a-43f2-ba22-81ece57ebe19 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96e7480de94c43909045ac1087e40cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6bd34bf5540ee95c8144f185eb22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:44.688854 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-f8c934c3-5b1a-43f2-ba22-81ece57ebe19 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] 10.222.0.43 "GET /compute/v2.1/servers/d7f06829-6beb-4d35-ab81-c99f9dd3027d" status: 200 len: 1321 microversion: 2.1 time: 0.280054 Oct 04 18:42:44.690157 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1483/2832] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:44 2022] GET /compute/v2.1/servers/d7f06829-6beb-4d35-ab81-c99f9dd3027d => generated 1321 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:44.928460 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-bbc94f77-dda0-48b7-8341-a8f096cb3efd tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:44.931050 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-bbc94f77-dda0-48b7-8341-a8f096cb3efd tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] [instance: 67f7e060-f4e1-4f23-86f3-6f8ed96e4e22] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:44.954749 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bbc94f77-dda0-48b7-8341-a8f096cb3efd tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:44.963126 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bbc94f77-dda0-48b7-8341-a8f096cb3efd tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:44.963700 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bbc94f77-dda0-48b7-8341-a8f096cb3efd tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:44.965675 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bbc94f77-dda0-48b7-8341-a8f096cb3efd tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:44.966012 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-dcbf9c0e-d9a1-42e9-ac28-932ca1e03605 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:44.967313 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bbc94f77-dda0-48b7-8341-a8f096cb3efd tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:44.967531 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-dcbf9c0e-d9a1-42e9-ac28-932ca1e03605 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 82b86465-afb0-49ef-9932-1538010c1ae5] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:44.967776 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bbc94f77-dda0-48b7-8341-a8f096cb3efd tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:44.978029 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dcbf9c0e-d9a1-42e9-ac28-932ca1e03605 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:44.979065 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dcbf9c0e-d9a1-42e9-ac28-932ca1e03605 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:44.979805 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dcbf9c0e-d9a1-42e9-ac28-932ca1e03605 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:44.981259 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dcbf9c0e-d9a1-42e9-ac28-932ca1e03605 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:44.988955 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dcbf9c0e-d9a1-42e9-ac28-932ca1e03605 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:44.989768 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dcbf9c0e-d9a1-42e9-ac28-932ca1e03605 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:45.249142 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-dcbf9c0e-d9a1-42e9-ac28-932ca1e03605 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:45.261519 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-dcbf9c0e-d9a1-42e9-ac28-932ca1e03605 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5" status: 200 len: 1667 microversion: 2.1 time: 0.301258 Oct 04 18:42:45.263632 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1484/2833] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:44 2022] GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5 => generated 1667 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:45.298945 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-880deced-69bb-44b8-93f6-8b6bc3056629 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:45.299745 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-880deced-69bb-44b8-93f6-8b6bc3056629 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 82b86465-afb0-49ef-9932-1538010c1ae5] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:45.307241 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-880deced-69bb-44b8-93f6-8b6bc3056629 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:45.307772 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-880deced-69bb-44b8-93f6-8b6bc3056629 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:45.308225 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-880deced-69bb-44b8-93f6-8b6bc3056629 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:45.308949 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-880deced-69bb-44b8-93f6-8b6bc3056629 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:45.309444 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-880deced-69bb-44b8-93f6-8b6bc3056629 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:45.309881 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-880deced-69bb-44b8-93f6-8b6bc3056629 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:45.546173 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-880deced-69bb-44b8-93f6-8b6bc3056629 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:45.555410 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-880deced-69bb-44b8-93f6-8b6bc3056629 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5" status: 200 len: 1667 microversion: 2.1 time: 0.272345 Oct 04 18:42:45.566628 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1485/2834] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:45 2022] GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5 => generated 1667 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:45.566628 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-ef471a01-b611-436a-a452-b9c3ab85f5bf tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:45.566628 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-ef471a01-b611-436a-a452-b9c3ab85f5bf tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] [instance: 2d229458-6857-4662-ad59-30770808e2a1] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:45.568690 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ef471a01-b611-436a-a452-b9c3ab85f5bf tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:45.569894 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ef471a01-b611-436a-a452-b9c3ab85f5bf tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:45.570344 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ef471a01-b611-436a-a452-b9c3ab85f5bf tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:45.571056 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ef471a01-b611-436a-a452-b9c3ab85f5bf tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:45.571646 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ef471a01-b611-436a-a452-b9c3ab85f5bf tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:45.572496 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ef471a01-b611-436a-a452-b9c3ab85f5bf tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:45.655799 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-bbc94f77-dda0-48b7-8341-a8f096cb3efd tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ee90610168a4d46b456d7a278991091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5419b9532d52479d8d99336b90ebe9ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:45.667209 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-ef471a01-b611-436a-a452-b9c3ab85f5bf tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9971b5861f44c1a1da94eda0f8f02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f809b8ae704988961908bef0f3cb24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:45.668277 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-bbc94f77-dda0-48b7-8341-a8f096cb3efd tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] 10.222.0.43 "GET /compute/v2.1/servers/67f7e060-f4e1-4f23-86f3-6f8ed96e4e22" status: 200 len: 1320 microversion: 2.1 time: 0.744404 Oct 04 18:42:45.668874 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1350/2835] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:44 2022] GET /compute/v2.1/servers/67f7e060-f4e1-4f23-86f3-6f8ed96e4e22 => generated 1320 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:45.681703 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-ef471a01-b611-436a-a452-b9c3ab85f5bf tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] 10.222.0.43 "GET /compute/v2.1/servers/2d229458-6857-4662-ad59-30770808e2a1" status: 200 len: 1268 microversion: 2.1 time: 0.124033 Oct 04 18:42:45.682082 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-64540417-40c3-448e-a44d-fd45db5a20b9 tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:45.682917 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-64540417-40c3-448e-a44d-fd45db5a20b9 tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] [instance: 74d78f04-e2a4-46ce-9da3-fe52e90f2090] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:45.686452 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=14,nova_api:INSERT=7 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:42:45.689976 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1486/2836] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:45 2022] GET /compute/v2.1/servers/2d229458-6857-4662-ad59-30770808e2a1 => generated 1268 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:45.696260 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-64540417-40c3-448e-a44d-fd45db5a20b9 tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:45.696757 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-64540417-40c3-448e-a44d-fd45db5a20b9 tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:45.697221 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-64540417-40c3-448e-a44d-fd45db5a20b9 tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:45.698129 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-64540417-40c3-448e-a44d-fd45db5a20b9 tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:45.698342 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-8499861b-389a-467f-a634-ce93d7998914 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:45.698941 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-64540417-40c3-448e-a44d-fd45db5a20b9 tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:45.699118 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-8499861b-389a-467f-a634-ce93d7998914 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 82b86465-afb0-49ef-9932-1538010c1ae5] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:45.699666 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-64540417-40c3-448e-a44d-fd45db5a20b9 tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:45.713571 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8499861b-389a-467f-a634-ce93d7998914 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:45.714135 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8499861b-389a-467f-a634-ce93d7998914 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:45.714627 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8499861b-389a-467f-a634-ce93d7998914 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:45.715406 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8499861b-389a-467f-a634-ce93d7998914 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:45.715926 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8499861b-389a-467f-a634-ce93d7998914 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:45.716362 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8499861b-389a-467f-a634-ce93d7998914 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:46.072072 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-8499861b-389a-467f-a634-ce93d7998914 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:46.085714 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-8499861b-389a-467f-a634-ce93d7998914 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5" status: 200 len: 1667 microversion: 2.1 time: 0.393616 Oct 04 18:42:46.085922 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-64540417-40c3-448e-a44d-fd45db5a20b9 tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecd189792024ba298f451523033386e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bc84144bf334722b4798851268b5f32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:46.098217 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1487/2837] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:45 2022] GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5 => generated 1667 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:46.103116 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-64540417-40c3-448e-a44d-fd45db5a20b9 tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] 10.222.0.43 "GET /compute/v2.1/servers/74d78f04-e2a4-46ce-9da3-fe52e90f2090" status: 200 len: 1352 microversion: 2.1 time: 0.432483 Oct 04 18:42:46.111335 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-75147831-7ccb-4d34-ac19-abdcb591455d tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:46.112775 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-75147831-7ccb-4d34-ac19-abdcb591455d tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] [instance: d7f06829-6beb-4d35-ab81-c99f9dd3027d] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:46.118888 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1351/2838] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:45 2022] GET /compute/v2.1/servers/74d78f04-e2a4-46ce-9da3-fe52e90f2090 => generated 1352 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:46.120853 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-75147831-7ccb-4d34-ac19-abdcb591455d tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:46.121896 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-75147831-7ccb-4d34-ac19-abdcb591455d tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:46.122451 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-75147831-7ccb-4d34-ac19-abdcb591455d tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:46.123822 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-75147831-7ccb-4d34-ac19-abdcb591455d tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:46.125054 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-75147831-7ccb-4d34-ac19-abdcb591455d tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:46.125818 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-75147831-7ccb-4d34-ac19-abdcb591455d tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:46.133994 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-33db27b7-f4a2-4f77-94ed-952b05f43f96 req-226de928-5e97-4203-86be-3e9e72b3cc81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "861427d4-c606-4a99-9c94-2b8e9dc42c1c", "name": "network-vif-plugged", "status": "completed", "tag": "00befd08-4583-44c6-95c5-b39c21d82c7f"}, {"server_uuid": "67f7e060-f4e1-4f23-86f3-6f8ed96e4e22", "name": "network-vif-plugged", "status": "completed", "tag": "2b3a1d4f-3f20-490f-a873-011a2860f667"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:42:46.146712 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-33db27b7-f4a2-4f77-94ed-952b05f43f96 req-226de928-5e97-4203-86be-3e9e72b3cc81 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:46.147906 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-33db27b7-f4a2-4f77-94ed-952b05f43f96 req-226de928-5e97-4203-86be-3e9e72b3cc81 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:46.148529 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-33db27b7-f4a2-4f77-94ed-952b05f43f96 req-226de928-5e97-4203-86be-3e9e72b3cc81 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:46.167204 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-33db27b7-f4a2-4f77-94ed-952b05f43f96 req-226de928-5e97-4203-86be-3e9e72b3cc81 service nova] Creating event network-vif-plugged:00befd08-4583-44c6-95c5-b39c21d82c7f for instance 861427d4-c606-4a99-9c94-2b8e9dc42c1c on n-h2-851028-13 Oct 04 18:42:46.167997 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-33db27b7-f4a2-4f77-94ed-952b05f43f96 req-226de928-5e97-4203-86be-3e9e72b3cc81 service nova] Creating event network-vif-plugged:2b3a1d4f-3f20-490f-a873-011a2860f667 for instance 67f7e060-f4e1-4f23-86f3-6f8ed96e4e22 on n-h1-851028-13 Oct 04 18:42:46.178176 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-33db27b7-f4a2-4f77-94ed-952b05f43f96 req-226de928-5e97-4203-86be-3e9e72b3cc81 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.057789 Oct 04 18:42:46.179037 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1352/2839] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:42:46 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:42:46.185273 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-0e6bad8f-acad-481a-a5fe-f21dd9ff50db tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-250176244"}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:42:46.188710 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-0e6bad8f-acad-481a-a5fe-f21dd9ff50db tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 82b86465-afb0-49ef-9932-1538010c1ae5] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:46.195520 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0e6bad8f-acad-481a-a5fe-f21dd9ff50db tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:46.196399 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0e6bad8f-acad-481a-a5fe-f21dd9ff50db tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:46.196865 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0e6bad8f-acad-481a-a5fe-f21dd9ff50db tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:46.198038 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0e6bad8f-acad-481a-a5fe-f21dd9ff50db tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:46.198681 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0e6bad8f-acad-481a-a5fe-f21dd9ff50db tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:46.199691 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0e6bad8f-acad-481a-a5fe-f21dd9ff50db tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:46.360814 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-75147831-7ccb-4d34-ac19-abdcb591455d tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96e7480de94c43909045ac1087e40cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6bd34bf5540ee95c8144f185eb22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:46.381370 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-75147831-7ccb-4d34-ac19-abdcb591455d tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] 10.222.0.43 "GET /compute/v2.1/servers/d7f06829-6beb-4d35-ab81-c99f9dd3027d" status: 200 len: 1514 microversion: 2.1 time: 0.281390 Oct 04 18:42:46.382864 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1488/2840] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:46 2022] GET /compute/v2.1/servers/d7f06829-6beb-4d35-ab81-c99f9dd3027d => generated 1514 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:46.427564 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-7058513d-e81c-4446-a137-ea938293d781 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:42:46.431527 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-7058513d-e81c-4446-a137-ea938293d781 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] [instance: d7f06829-6beb-4d35-ab81-c99f9dd3027d] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:46.441189 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7058513d-e81c-4446-a137-ea938293d781 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:46.441868 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7058513d-e81c-4446-a137-ea938293d781 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:46.442798 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7058513d-e81c-4446-a137-ea938293d781 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:46.444179 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7058513d-e81c-4446-a137-ea938293d781 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:46.445687 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7058513d-e81c-4446-a137-ea938293d781 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:46.446454 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7058513d-e81c-4446-a137-ea938293d781 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:46.486640 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.objects.instance [None req-7058513d-e81c-4446-a137-ea938293d781 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lazy-loading 'flavor' on Instance uuid d7f06829-6beb-4d35-ab81-c99f9dd3027d {{(pid=123596) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:42:46.514943 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-0e6bad8f-acad-481a-a5fe-f21dd9ff50db tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "POST /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5/action" status: 202 len: 0 microversion: 2.1 time: 0.331410 Oct 04 18:42:46.519228 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1353/2841] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 18:42:46 2022] POST /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5/action => generated 0 bytes in 339 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Oct 04 18:42:46.588078 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:42:46.644608 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-7058513d-e81c-4446-a137-ea938293d781 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] 10.222.0.43 "POST /compute/v2.1/servers/d7f06829-6beb-4d35-ab81-c99f9dd3027d/action" status: 200 len: 32 microversion: 2.1 time: 0.231728 Oct 04 18:42:46.646391 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1489/2842] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 18:42:46 2022] POST /compute/v2.1/servers/d7f06829-6beb-4d35-ab81-c99f9dd3027d/action => generated 32 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:42:46.660222 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-a3f12b24-2cc5-440c-84ab-f16e23b7b684 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:46.660998 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-a3f12b24-2cc5-440c-84ab-f16e23b7b684 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] [instance: d7f06829-6beb-4d35-ab81-c99f9dd3027d] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:46.676570 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a3f12b24-2cc5-440c-84ab-f16e23b7b684 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:46.678915 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a3f12b24-2cc5-440c-84ab-f16e23b7b684 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:46.679371 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a3f12b24-2cc5-440c-84ab-f16e23b7b684 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:46.680169 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a3f12b24-2cc5-440c-84ab-f16e23b7b684 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:46.680631 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a3f12b24-2cc5-440c-84ab-f16e23b7b684 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:46.681047 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a3f12b24-2cc5-440c-84ab-f16e23b7b684 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:46.692190 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-e57c2cfd-d34f-4b07-8a9d-1a6d320b5851 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:46.692898 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-e57c2cfd-d34f-4b07-8a9d-1a6d320b5851 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] [instance: 67f7e060-f4e1-4f23-86f3-6f8ed96e4e22] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:46.705725 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e57c2cfd-d34f-4b07-8a9d-1a6d320b5851 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:46.706217 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e57c2cfd-d34f-4b07-8a9d-1a6d320b5851 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:46.706841 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e57c2cfd-d34f-4b07-8a9d-1a6d320b5851 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:46.707715 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e57c2cfd-d34f-4b07-8a9d-1a6d320b5851 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:46.710921 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e57c2cfd-d34f-4b07-8a9d-1a6d320b5851 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:46.714350 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e57c2cfd-d34f-4b07-8a9d-1a6d320b5851 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:47.135416 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-e57c2cfd-d34f-4b07-8a9d-1a6d320b5851 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ee90610168a4d46b456d7a278991091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5419b9532d52479d8d99336b90ebe9ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:47.146368 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-e57c2cfd-d34f-4b07-8a9d-1a6d320b5851 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] 10.222.0.43 "GET /compute/v2.1/servers/67f7e060-f4e1-4f23-86f3-6f8ed96e4e22" status: 200 len: 1320 microversion: 2.1 time: 0.458284 Oct 04 18:42:47.147262 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1490/2843] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:46 2022] GET /compute/v2.1/servers/67f7e060-f4e1-4f23-86f3-6f8ed96e4e22 => generated 1320 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:42:47.173579 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-a3f12b24-2cc5-440c-84ab-f16e23b7b684 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96e7480de94c43909045ac1087e40cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6bd34bf5540ee95c8144f185eb22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:47.174758 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-fd401f9b-c113-4d36-bfab-c8cc7c5b3a56 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:47.175484 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-fd401f9b-c113-4d36-bfab-c8cc7c5b3a56 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] [instance: 2d229458-6857-4662-ad59-30770808e2a1] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:47.181620 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-a3f12b24-2cc5-440c-84ab-f16e23b7b684 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] 10.222.0.43 "GET /compute/v2.1/servers/d7f06829-6beb-4d35-ab81-c99f9dd3027d" status: 200 len: 1520 microversion: 2.1 time: 0.529183 Oct 04 18:42:47.183463 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fd401f9b-c113-4d36-bfab-c8cc7c5b3a56 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:47.184240 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fd401f9b-c113-4d36-bfab-c8cc7c5b3a56 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:47.184752 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fd401f9b-c113-4d36-bfab-c8cc7c5b3a56 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:47.185455 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1354/2844] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:46 2022] GET /compute/v2.1/servers/d7f06829-6beb-4d35-ab81-c99f9dd3027d => generated 1520 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:47.185687 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fd401f9b-c113-4d36-bfab-c8cc7c5b3a56 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:47.186208 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fd401f9b-c113-4d36-bfab-c8cc7c5b3a56 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:47.188048 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fd401f9b-c113-4d36-bfab-c8cc7c5b3a56 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:47.196803 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-975be134-d0de-4a56-93eb-c03480ff6df4 tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:47.197541 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-975be134-d0de-4a56-93eb-c03480ff6df4 tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] [instance: 74d78f04-e2a4-46ce-9da3-fe52e90f2090] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:47.212768 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-975be134-d0de-4a56-93eb-c03480ff6df4 tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:47.213303 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-975be134-d0de-4a56-93eb-c03480ff6df4 tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:47.213753 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-975be134-d0de-4a56-93eb-c03480ff6df4 tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:47.214451 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-975be134-d0de-4a56-93eb-c03480ff6df4 tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:47.214909 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-975be134-d0de-4a56-93eb-c03480ff6df4 tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:47.215338 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-975be134-d0de-4a56-93eb-c03480ff6df4 tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:47.368101 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-fd401f9b-c113-4d36-bfab-c8cc7c5b3a56 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9971b5861f44c1a1da94eda0f8f02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f809b8ae704988961908bef0f3cb24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:47.379560 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-fd401f9b-c113-4d36-bfab-c8cc7c5b3a56 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] 10.222.0.43 "GET /compute/v2.1/servers/2d229458-6857-4662-ad59-30770808e2a1" status: 200 len: 1310 microversion: 2.1 time: 0.215182 Oct 04 18:42:47.380772 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1491/2845] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:47 2022] GET /compute/v2.1/servers/2d229458-6857-4662-ad59-30770808e2a1 => generated 1310 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:47.552578 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-975be134-d0de-4a56-93eb-c03480ff6df4 tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecd189792024ba298f451523033386e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bc84144bf334722b4798851268b5f32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:47.560917 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-975be134-d0de-4a56-93eb-c03480ff6df4 tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] 10.222.0.43 "GET /compute/v2.1/servers/74d78f04-e2a4-46ce-9da3-fe52e90f2090" status: 200 len: 1352 microversion: 2.1 time: 0.374407 Oct 04 18:42:47.575463 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1355/2846] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:47 2022] GET /compute/v2.1/servers/74d78f04-e2a4-46ce-9da3-fe52e90f2090 => generated 1352 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:48.175223 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-e6b1b7f0-4b09-49bb-b620-fbba1bc84f03 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:48.175948 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-e6b1b7f0-4b09-49bb-b620-fbba1bc84f03 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] [instance: 67f7e060-f4e1-4f23-86f3-6f8ed96e4e22] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:48.206069 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e6b1b7f0-4b09-49bb-b620-fbba1bc84f03 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:48.206287 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e6b1b7f0-4b09-49bb-b620-fbba1bc84f03 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:48.206921 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e6b1b7f0-4b09-49bb-b620-fbba1bc84f03 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:48.207240 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-15f8a83f-c72a-4850-aecc-f7861f08569a tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:48.208488 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e6b1b7f0-4b09-49bb-b620-fbba1bc84f03 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:48.209040 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e6b1b7f0-4b09-49bb-b620-fbba1bc84f03 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:48.209460 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e6b1b7f0-4b09-49bb-b620-fbba1bc84f03 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:48.209740 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-15f8a83f-c72a-4850-aecc-f7861f08569a tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] [instance: d7f06829-6beb-4d35-ab81-c99f9dd3027d] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:48.222248 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-15f8a83f-c72a-4850-aecc-f7861f08569a tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:48.226724 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-15f8a83f-c72a-4850-aecc-f7861f08569a tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:48.227449 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-15f8a83f-c72a-4850-aecc-f7861f08569a tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:48.228481 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-15f8a83f-c72a-4850-aecc-f7861f08569a tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:48.233873 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-15f8a83f-c72a-4850-aecc-f7861f08569a tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:48.234633 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-15f8a83f-c72a-4850-aecc-f7861f08569a tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:48.439377 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-e6b1b7f0-4b09-49bb-b620-fbba1bc84f03 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ee90610168a4d46b456d7a278991091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5419b9532d52479d8d99336b90ebe9ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:48.454155 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-e6b1b7f0-4b09-49bb-b620-fbba1bc84f03 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] 10.222.0.43 "GET /compute/v2.1/servers/67f7e060-f4e1-4f23-86f3-6f8ed96e4e22" status: 200 len: 1320 microversion: 2.1 time: 0.283210 Oct 04 18:42:48.454777 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1492/2847] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:48 2022] GET /compute/v2.1/servers/67f7e060-f4e1-4f23-86f3-6f8ed96e4e22 => generated 1320 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:48.474970 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-95d1157f-56ce-4829-943b-1278c2706242 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:48.475707 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-95d1157f-56ce-4829-943b-1278c2706242 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] [instance: 2d229458-6857-4662-ad59-30770808e2a1] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:48.498697 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-95d1157f-56ce-4829-943b-1278c2706242 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:48.501058 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-95d1157f-56ce-4829-943b-1278c2706242 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:48.501769 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-95d1157f-56ce-4829-943b-1278c2706242 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:48.504103 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-95d1157f-56ce-4829-943b-1278c2706242 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:48.504919 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-95d1157f-56ce-4829-943b-1278c2706242 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:48.505725 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-95d1157f-56ce-4829-943b-1278c2706242 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:48.627230 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-15f8a83f-c72a-4850-aecc-f7861f08569a tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96e7480de94c43909045ac1087e40cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6bd34bf5540ee95c8144f185eb22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:48.638142 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-15f8a83f-c72a-4850-aecc-f7861f08569a tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] 10.222.0.43 "GET /compute/v2.1/servers/d7f06829-6beb-4d35-ab81-c99f9dd3027d" status: 200 len: 1520 microversion: 2.1 time: 0.435565 Oct 04 18:42:48.648716 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1356/2848] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:48 2022] GET /compute/v2.1/servers/d7f06829-6beb-4d35-ab81-c99f9dd3027d => generated 1520 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:48.693857 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-95d1157f-56ce-4829-943b-1278c2706242 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9971b5861f44c1a1da94eda0f8f02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f809b8ae704988961908bef0f3cb24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:48.704364 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-95d1157f-56ce-4829-943b-1278c2706242 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] 10.222.0.43 "GET /compute/v2.1/servers/2d229458-6857-4662-ad59-30770808e2a1" status: 200 len: 1310 microversion: 2.1 time: 0.248048 Oct 04 18:42:48.706077 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1493/2849] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:48 2022] GET /compute/v2.1/servers/2d229458-6857-4662-ad59-30770808e2a1 => generated 1310 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:48.729282 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-3236c918-9966-4573-b9bf-827c6c527f4a tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:48.730668 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-3236c918-9966-4573-b9bf-827c6c527f4a tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] [instance: 74d78f04-e2a4-46ce-9da3-fe52e90f2090] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:48.737280 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3236c918-9966-4573-b9bf-827c6c527f4a tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:48.738036 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3236c918-9966-4573-b9bf-827c6c527f4a tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:48.738561 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3236c918-9966-4573-b9bf-827c6c527f4a tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:48.739504 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3236c918-9966-4573-b9bf-827c6c527f4a tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:48.740331 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3236c918-9966-4573-b9bf-827c6c527f4a tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:48.740943 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3236c918-9966-4573-b9bf-827c6c527f4a tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:48.800338 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-a6737191-b32a-423e-8761-3e6f870afbfe tempest-QuotasAdminTestJSON-1824655489 tempest-QuotasAdminTestJSON-1824655489-project-admin] Calling method '.version_select at 0x7fb21ed39ca0>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:48.896368 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-a6737191-b32a-423e-8761-3e6f870afbfe tempest-QuotasAdminTestJSON-1824655489 tempest-QuotasAdminTestJSON-1824655489-project-admin] 10.222.0.43 "GET /compute/v2.1/os-quota-sets/0a8adb6859e9442194e5593e0693c22d" status: 200 len: 371 microversion: 2.1 time: 0.246153 Oct 04 18:42:48.900589 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1357/2850] 10.222.0.43 () {58 vars in 1242 bytes} [Tue Oct 4 18:42:48 2022] GET /compute/v2.1/os-quota-sets/0a8adb6859e9442194e5593e0693c22d => generated 371 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:42:48.909942 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-d0a37f68-3d6c-49b6-95bd-9889a6b39348 tempest-QuotasAdminTestJSON-1824655489 tempest-QuotasAdminTestJSON-1824655489-project-admin] Action: 'update', calling method: .version_select at 0x7fb21ed321f0>, body: {"quota_set": {"ram": "5120"}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:42:48.929332 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-3236c918-9966-4573-b9bf-827c6c527f4a tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecd189792024ba298f451523033386e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bc84144bf334722b4798851268b5f32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:48.938995 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-3236c918-9966-4573-b9bf-827c6c527f4a tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] 10.222.0.43 "GET /compute/v2.1/servers/74d78f04-e2a4-46ce-9da3-fe52e90f2090" status: 200 len: 1352 microversion: 2.1 time: 0.218066 Oct 04 18:42:48.941180 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1494/2851] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:48 2022] GET /compute/v2.1/servers/74d78f04-e2a4-46ce-9da3-fe52e90f2090 => generated 1352 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:48.980419 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d0a37f68-3d6c-49b6-95bd-9889a6b39348 tempest-QuotasAdminTestJSON-1824655489 tempest-QuotasAdminTestJSON-1824655489-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:48.980933 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d0a37f68-3d6c-49b6-95bd-9889a6b39348 tempest-QuotasAdminTestJSON-1824655489 tempest-QuotasAdminTestJSON-1824655489-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:48.981424 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d0a37f68-3d6c-49b6-95bd-9889a6b39348 tempest-QuotasAdminTestJSON-1824655489 tempest-QuotasAdminTestJSON-1824655489-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:48.982184 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d0a37f68-3d6c-49b6-95bd-9889a6b39348 tempest-QuotasAdminTestJSON-1824655489 tempest-QuotasAdminTestJSON-1824655489-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:48.982662 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d0a37f68-3d6c-49b6-95bd-9889a6b39348 tempest-QuotasAdminTestJSON-1824655489 tempest-QuotasAdminTestJSON-1824655489-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:48.983124 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d0a37f68-3d6c-49b6-95bd-9889a6b39348 tempest-QuotasAdminTestJSON-1824655489 tempest-QuotasAdminTestJSON-1824655489-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:49.037431 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-d0a37f68-3d6c-49b6-95bd-9889a6b39348 tempest-QuotasAdminTestJSON-1824655489 tempest-QuotasAdminTestJSON-1824655489-project-admin] 10.222.0.43 "PUT /compute/v2.1/os-quota-sets/0a8adb6859e9442194e5593e0693c22d" status: 200 len: 328 microversion: 2.1 time: 0.132448 Oct 04 18:42:49.041170 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1358/2852] 10.222.0.43 () {60 vars in 1262 bytes} [Tue Oct 4 18:42:48 2022] PUT /compute/v2.1/os-quota-sets/0a8adb6859e9442194e5593e0693c22d => generated 328 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:42:49.051460 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-047bac90-7a72-4f95-929b-bb5a0a1de38a tempest-QuotasAdminTestJSON-1824655489 tempest-QuotasAdminTestJSON-1824655489-project-admin] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:49.068812 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-047bac90-7a72-4f95-929b-bb5a0a1de38a tempest-QuotasAdminTestJSON-1824655489 tempest-QuotasAdminTestJSON-1824655489-project-admin] 10.222.0.43 "DELETE /compute/v2.1/os-quota-sets/0a8adb6859e9442194e5593e0693c22d" status: 202 len: 0 microversion: 2.1 time: 0.022118 Oct 04 18:42:49.072329 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1495/2853] 10.222.0.43 () {58 vars in 1245 bytes} [Tue Oct 4 18:42:49 2022] DELETE /compute/v2.1/os-quota-sets/0a8adb6859e9442194e5593e0693c22d => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:42:49.077538 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-b5290ad4-bd80-48df-a15a-a8523becf35b tempest-QuotasAdminTestJSON-1824655489 tempest-QuotasAdminTestJSON-1824655489-project-admin] Calling method '.version_select at 0x7fb21ecc13a0>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:49.157159 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-b5290ad4-bd80-48df-a15a-a8523becf35b tempest-QuotasAdminTestJSON-1824655489 tempest-QuotasAdminTestJSON-1824655489-project-admin] 10.222.0.43 "GET /compute/v2.1/os-quota-sets/0a8adb6859e9442194e5593e0693c22d" status: 200 len: 371 microversion: 2.1 time: 0.083253 Oct 04 18:42:49.158187 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1359/2854] 10.222.0.43 () {58 vars in 1242 bytes} [Tue Oct 4 18:42:49 2022] GET /compute/v2.1/os-quota-sets/0a8adb6859e9442194e5593e0693c22d => generated 371 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:42:49.313850 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-46214c0d-2807-40a2-a9f5-8fbd94c39f25 tempest-QuotasAdminTestJSON-1824655489 tempest-QuotasAdminTestJSON-1824655489-project-admin] Calling method '.version_select at 0x7fb21f100670>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:49.461945 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-3e2a9752-d9ed-46af-9415-81ae2df36873 req-17161a16-dea5-4f29-9940-6c5d3e63d1aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d229458-6857-4662-ad59-30770808e2a1", "tag": "84b873b9-38f0-4a0b-975a-a315fbcad8ab"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:42:49.473213 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-3e2a9752-d9ed-46af-9415-81ae2df36873 req-17161a16-dea5-4f29-9940-6c5d3e63d1aa service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:49.474075 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-3e2a9752-d9ed-46af-9415-81ae2df36873 req-17161a16-dea5-4f29-9940-6c5d3e63d1aa service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:49.474757 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-3e2a9752-d9ed-46af-9415-81ae2df36873 req-17161a16-dea5-4f29-9940-6c5d3e63d1aa service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:49.488300 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-3e2a9752-d9ed-46af-9415-81ae2df36873 req-17161a16-dea5-4f29-9940-6c5d3e63d1aa service nova] Creating event network-changed:84b873b9-38f0-4a0b-975a-a315fbcad8ab for instance 2d229458-6857-4662-ad59-30770808e2a1 on n-h1-851028-13 Oct 04 18:42:49.497267 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-3e2a9752-d9ed-46af-9415-81ae2df36873 req-17161a16-dea5-4f29-9940-6c5d3e63d1aa service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038488 Oct 04 18:42:49.498472 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1360/2855] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:42:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:42:49.505291 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-efed1253-19aa-4005-9b5c-b120b69fd3b1 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:49.506218 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-efed1253-19aa-4005-9b5c-b120b69fd3b1 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] [instance: 67f7e060-f4e1-4f23-86f3-6f8ed96e4e22] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:49.516750 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-efed1253-19aa-4005-9b5c-b120b69fd3b1 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:49.518832 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-efed1253-19aa-4005-9b5c-b120b69fd3b1 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:49.519964 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-efed1253-19aa-4005-9b5c-b120b69fd3b1 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:49.520890 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-efed1253-19aa-4005-9b5c-b120b69fd3b1 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:49.521619 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-efed1253-19aa-4005-9b5c-b120b69fd3b1 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:49.522246 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-efed1253-19aa-4005-9b5c-b120b69fd3b1 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:49.554751 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-46214c0d-2807-40a2-a9f5-8fbd94c39f25 tempest-QuotasAdminTestJSON-1824655489 tempest-QuotasAdminTestJSON-1824655489-project-admin] 10.222.0.43 "GET /compute/v2.1/os-quota-sets/4ba80f2d36b34de3ae7973746d9303ea/defaults" status: 200 len: 371 microversion: 2.1 time: 0.245379 Oct 04 18:42:49.574632 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1496/2856] 10.222.0.43 () {58 vars in 1269 bytes} [Tue Oct 4 18:42:49 2022] GET /compute/v2.1/os-quota-sets/4ba80f2d36b34de3ae7973746d9303ea/defaults => generated 371 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:42:49.668917 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-c440ad69-d81b-4821-b7c0-d84a016c5c13 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:49.669573 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-c440ad69-d81b-4821-b7c0-d84a016c5c13 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] [instance: d7f06829-6beb-4d35-ab81-c99f9dd3027d] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:49.682637 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c440ad69-d81b-4821-b7c0-d84a016c5c13 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:49.687675 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c440ad69-d81b-4821-b7c0-d84a016c5c13 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:49.688164 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c440ad69-d81b-4821-b7c0-d84a016c5c13 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:49.688928 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c440ad69-d81b-4821-b7c0-d84a016c5c13 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:49.689429 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c440ad69-d81b-4821-b7c0-d84a016c5c13 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:49.689870 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c440ad69-d81b-4821-b7c0-d84a016c5c13 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:49.800592 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-efed1253-19aa-4005-9b5c-b120b69fd3b1 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ee90610168a4d46b456d7a278991091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5419b9532d52479d8d99336b90ebe9ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:49.808595 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-efed1253-19aa-4005-9b5c-b120b69fd3b1 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] 10.222.0.43 "GET /compute/v2.1/servers/67f7e060-f4e1-4f23-86f3-6f8ed96e4e22" status: 200 len: 1508 microversion: 2.1 time: 0.308384 Oct 04 18:42:49.809441 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1361/2857] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:49 2022] GET /compute/v2.1/servers/67f7e060-f4e1-4f23-86f3-6f8ed96e4e22 => generated 1508 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:49.814752 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-afb78c44-f811-43c8-8192-a7b6d17fe0d1 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:49.815360 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-afb78c44-f811-43c8-8192-a7b6d17fe0d1 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] [instance: 2d229458-6857-4662-ad59-30770808e2a1] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:49.821289 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-afb78c44-f811-43c8-8192-a7b6d17fe0d1 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:49.821768 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-afb78c44-f811-43c8-8192-a7b6d17fe0d1 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:49.822189 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-afb78c44-f811-43c8-8192-a7b6d17fe0d1 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:49.823094 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-afb78c44-f811-43c8-8192-a7b6d17fe0d1 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:49.823707 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-afb78c44-f811-43c8-8192-a7b6d17fe0d1 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:49.824320 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-afb78c44-f811-43c8-8192-a7b6d17fe0d1 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:49.920181 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-c440ad69-d81b-4821-b7c0-d84a016c5c13 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96e7480de94c43909045ac1087e40cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6bd34bf5540ee95c8144f185eb22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:49.934507 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-c440ad69-d81b-4821-b7c0-d84a016c5c13 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] 10.222.0.43 "GET /compute/v2.1/servers/d7f06829-6beb-4d35-ab81-c99f9dd3027d" status: 200 len: 1520 microversion: 2.1 time: 0.270225 Oct 04 18:42:49.950364 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1497/2858] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:49 2022] GET /compute/v2.1/servers/d7f06829-6beb-4d35-ab81-c99f9dd3027d => generated 1520 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:42:49.950364 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-fa94f040-1e55-4eb3-b7a4-d12d79fd73c4 tempest-QuotasAdminTestJSON-1824655489 tempest-QuotasAdminTestJSON-1824655489-project-admin] Action: 'update', calling method: .version_select at 0x7fb21fd11040>, body: {"quota_set": {"ram": "5120"}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:42:50.032505 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-afb78c44-f811-43c8-8192-a7b6d17fe0d1 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9971b5861f44c1a1da94eda0f8f02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f809b8ae704988961908bef0f3cb24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:50.043337 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-afb78c44-f811-43c8-8192-a7b6d17fe0d1 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] 10.222.0.43 "GET /compute/v2.1/servers/2d229458-6857-4662-ad59-30770808e2a1" status: 200 len: 1310 microversion: 2.1 time: 0.232608 Oct 04 18:42:50.043931 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1362/2859] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:49 2022] GET /compute/v2.1/servers/2d229458-6857-4662-ad59-30770808e2a1 => generated 1310 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:50.069404 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-7b2c114c-b161-4e80-883d-251beb406045 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:50.072057 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-7b2c114c-b161-4e80-883d-251beb406045 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] [instance: 861427d4-c606-4a99-9c94-2b8e9dc42c1c] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:50.085009 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7b2c114c-b161-4e80-883d-251beb406045 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:50.085540 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7b2c114c-b161-4e80-883d-251beb406045 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:50.091061 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7b2c114c-b161-4e80-883d-251beb406045 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:50.091887 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7b2c114c-b161-4e80-883d-251beb406045 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:50.092343 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7b2c114c-b161-4e80-883d-251beb406045 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:50.093340 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7b2c114c-b161-4e80-883d-251beb406045 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:50.145342 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=23 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:42:50.150672 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fa94f040-1e55-4eb3-b7a4-d12d79fd73c4 tempest-QuotasAdminTestJSON-1824655489 tempest-QuotasAdminTestJSON-1824655489-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:50.151164 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fa94f040-1e55-4eb3-b7a4-d12d79fd73c4 tempest-QuotasAdminTestJSON-1824655489 tempest-QuotasAdminTestJSON-1824655489-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:50.151603 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fa94f040-1e55-4eb3-b7a4-d12d79fd73c4 tempest-QuotasAdminTestJSON-1824655489 tempest-QuotasAdminTestJSON-1824655489-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:50.152366 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fa94f040-1e55-4eb3-b7a4-d12d79fd73c4 tempest-QuotasAdminTestJSON-1824655489 tempest-QuotasAdminTestJSON-1824655489-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:50.152832 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fa94f040-1e55-4eb3-b7a4-d12d79fd73c4 tempest-QuotasAdminTestJSON-1824655489 tempest-QuotasAdminTestJSON-1824655489-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:50.153291 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fa94f040-1e55-4eb3-b7a4-d12d79fd73c4 tempest-QuotasAdminTestJSON-1824655489 tempest-QuotasAdminTestJSON-1824655489-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:50.216123 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-fa94f040-1e55-4eb3-b7a4-d12d79fd73c4 tempest-QuotasAdminTestJSON-1824655489 tempest-QuotasAdminTestJSON-1824655489-project-admin] 10.222.0.43 "PUT /compute/v2.1/os-quota-sets/9ae7c8826f244f0abe375801adce349e" status: 200 len: 328 microversion: 2.1 time: 0.279577 Oct 04 18:42:50.217686 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1498/2860] 10.222.0.43 () {60 vars in 1262 bytes} [Tue Oct 4 18:42:49 2022] PUT /compute/v2.1/os-quota-sets/9ae7c8826f244f0abe375801adce349e => generated 328 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:42:50.223195 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-2086943b-094c-492d-8350-dec07d9a111f tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:50.224619 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-2086943b-094c-492d-8350-dec07d9a111f tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] [instance: 74d78f04-e2a4-46ce-9da3-fe52e90f2090] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:50.232185 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2086943b-094c-492d-8350-dec07d9a111f tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:50.233008 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2086943b-094c-492d-8350-dec07d9a111f tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:50.233949 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2086943b-094c-492d-8350-dec07d9a111f tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:50.235311 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2086943b-094c-492d-8350-dec07d9a111f tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:50.236229 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2086943b-094c-492d-8350-dec07d9a111f tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:50.237183 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2086943b-094c-492d-8350-dec07d9a111f tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:50.323524 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-7b2c114c-b161-4e80-883d-251beb406045 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ee90610168a4d46b456d7a278991091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5419b9532d52479d8d99336b90ebe9ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:50.336486 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-7b2c114c-b161-4e80-883d-251beb406045 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] 10.222.0.43 "GET /compute/v2.1/servers/861427d4-c606-4a99-9c94-2b8e9dc42c1c" status: 200 len: 1508 microversion: 2.1 time: 0.291047 Oct 04 18:42:50.337347 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1363/2861] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:50 2022] GET /compute/v2.1/servers/861427d4-c606-4a99-9c94-2b8e9dc42c1c => generated 1508 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:50.346495 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-bd23a7bc-252f-4452-ac78-66971a078d43 tempest-QuotasAdminTestJSON-1824655489 tempest-QuotasAdminTestJSON-1824655489-project-admin] Calling method '.version_select at 0x7fb21f06a430>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:50.482901 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bd23a7bc-252f-4452-ac78-66971a078d43 tempest-QuotasAdminTestJSON-1824655489 tempest-QuotasAdminTestJSON-1824655489-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:50.483638 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bd23a7bc-252f-4452-ac78-66971a078d43 tempest-QuotasAdminTestJSON-1824655489 tempest-QuotasAdminTestJSON-1824655489-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:50.484186 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bd23a7bc-252f-4452-ac78-66971a078d43 tempest-QuotasAdminTestJSON-1824655489 tempest-QuotasAdminTestJSON-1824655489-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:50.484916 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bd23a7bc-252f-4452-ac78-66971a078d43 tempest-QuotasAdminTestJSON-1824655489 tempest-QuotasAdminTestJSON-1824655489-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:50.485619 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bd23a7bc-252f-4452-ac78-66971a078d43 tempest-QuotasAdminTestJSON-1824655489 tempest-QuotasAdminTestJSON-1824655489-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:50.486251 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bd23a7bc-252f-4452-ac78-66971a078d43 tempest-QuotasAdminTestJSON-1824655489 tempest-QuotasAdminTestJSON-1824655489-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:50.515369 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-bd23a7bc-252f-4452-ac78-66971a078d43 tempest-QuotasAdminTestJSON-1824655489 tempest-QuotasAdminTestJSON-1824655489-project-admin] 10.222.0.43 "GET /compute/v2.1/os-quota-sets/9ae7c8826f244f0abe375801adce349e/detail" status: 200 len: 916 microversion: 2.1 time: 0.174904 Oct 04 18:42:50.536114 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1364/2862] 10.222.0.43 () {58 vars in 1263 bytes} [Tue Oct 4 18:42:50 2022] GET /compute/v2.1/os-quota-sets/9ae7c8826f244f0abe375801adce349e/detail => generated 916 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:42:50.543937 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-34b833fe-51ec-4815-b8e0-de700967b636 req-7ec8c000-b478-4154-beeb-1fe28749c61e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74d78f04-e2a4-46ce-9da3-fe52e90f2090", "name": "network-vif-plugged", "status": "completed", "tag": "28ad400f-e2ec-4faf-bb1a-cf2726a0831a"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:42:50.568170 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-34b833fe-51ec-4815-b8e0-de700967b636 req-7ec8c000-b478-4154-beeb-1fe28749c61e service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:50.568682 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-34b833fe-51ec-4815-b8e0-de700967b636 req-7ec8c000-b478-4154-beeb-1fe28749c61e service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:50.569164 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-34b833fe-51ec-4815-b8e0-de700967b636 req-7ec8c000-b478-4154-beeb-1fe28749c61e service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:50.584494 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-34b833fe-51ec-4815-b8e0-de700967b636 req-7ec8c000-b478-4154-beeb-1fe28749c61e service nova] Creating event network-vif-plugged:28ad400f-e2ec-4faf-bb1a-cf2726a0831a for instance 74d78f04-e2a4-46ce-9da3-fe52e90f2090 on n-h2-851028-13 Oct 04 18:42:50.592511 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-34b833fe-51ec-4815-b8e0-de700967b636 req-7ec8c000-b478-4154-beeb-1fe28749c61e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054721 Oct 04 18:42:50.594413 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1365/2863] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:42:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:42:50.603745 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-2086943b-094c-492d-8350-dec07d9a111f tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecd189792024ba298f451523033386e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bc84144bf334722b4798851268b5f32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:50.625322 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-2086943b-094c-492d-8350-dec07d9a111f tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] 10.222.0.43 "GET /compute/v2.1/servers/74d78f04-e2a4-46ce-9da3-fe52e90f2090" status: 200 len: 1352 microversion: 2.1 time: 0.406043 Oct 04 18:42:50.628642 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1499/2864] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:50 2022] GET /compute/v2.1/servers/74d78f04-e2a4-46ce-9da3-fe52e90f2090 => generated 1352 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:50.632993 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-0620d3c6-c003-4440-9c48-ab138388e7cb tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:50.633916 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-0620d3c6-c003-4440-9c48-ab138388e7cb tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] [instance: 861427d4-c606-4a99-9c94-2b8e9dc42c1c] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:50.642313 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0620d3c6-c003-4440-9c48-ab138388e7cb tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:50.643266 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0620d3c6-c003-4440-9c48-ab138388e7cb tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:50.644084 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0620d3c6-c003-4440-9c48-ab138388e7cb tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:50.645653 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0620d3c6-c003-4440-9c48-ab138388e7cb tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:50.646427 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0620d3c6-c003-4440-9c48-ab138388e7cb tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:50.648092 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0620d3c6-c003-4440-9c48-ab138388e7cb tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:50.688991 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:42:50.702677 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-0620d3c6-c003-4440-9c48-ab138388e7cb tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] [instance: 861427d4-c606-4a99-9c94-2b8e9dc42c1c] Going to try to terminate instance {{(pid=123595) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:42:50.749995 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-dc2baf2e-93d5-4a1d-9843-c7d978aef772 tempest-QuotasAdminTestJSON-1824655489 tempest-QuotasAdminTestJSON-1824655489-project-admin] Action: 'update', calling method: .version_select at 0x7fb21f176ee0>, body: {"quota_set": {"ram": "2048"}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:42:50.873449 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dc2baf2e-93d5-4a1d-9843-c7d978aef772 tempest-QuotasAdminTestJSON-1824655489 tempest-QuotasAdminTestJSON-1824655489-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:50.874744 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dc2baf2e-93d5-4a1d-9843-c7d978aef772 tempest-QuotasAdminTestJSON-1824655489 tempest-QuotasAdminTestJSON-1824655489-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:50.875404 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dc2baf2e-93d5-4a1d-9843-c7d978aef772 tempest-QuotasAdminTestJSON-1824655489 tempest-QuotasAdminTestJSON-1824655489-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:50.876687 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dc2baf2e-93d5-4a1d-9843-c7d978aef772 tempest-QuotasAdminTestJSON-1824655489 tempest-QuotasAdminTestJSON-1824655489-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:50.876827 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dc2baf2e-93d5-4a1d-9843-c7d978aef772 tempest-QuotasAdminTestJSON-1824655489 tempest-QuotasAdminTestJSON-1824655489-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:50.877360 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dc2baf2e-93d5-4a1d-9843-c7d978aef772 tempest-QuotasAdminTestJSON-1824655489 tempest-QuotasAdminTestJSON-1824655489-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:50.879764 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-0620d3c6-c003-4440-9c48-ab138388e7cb tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] 10.222.0.43 "DELETE /compute/v2.1/servers/861427d4-c606-4a99-9c94-2b8e9dc42c1c" status: 204 len: 0 microversion: 2.1 time: 0.280313 Oct 04 18:42:50.880736 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1366/2865] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 18:42:50 2022] DELETE /compute/v2.1/servers/861427d4-c606-4a99-9c94-2b8e9dc42c1c => generated 0 bytes in 286 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:42:50.890522 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-0b208622-adab-4a47-a8d3-89b5b3c5d9e4 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:50.891738 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-0b208622-adab-4a47-a8d3-89b5b3c5d9e4 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] [instance: 67f7e060-f4e1-4f23-86f3-6f8ed96e4e22] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:50.899199 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0b208622-adab-4a47-a8d3-89b5b3c5d9e4 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:50.899830 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0b208622-adab-4a47-a8d3-89b5b3c5d9e4 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:50.901330 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0b208622-adab-4a47-a8d3-89b5b3c5d9e4 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:50.902572 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0b208622-adab-4a47-a8d3-89b5b3c5d9e4 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:50.903276 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0b208622-adab-4a47-a8d3-89b5b3c5d9e4 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:50.903952 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0b208622-adab-4a47-a8d3-89b5b3c5d9e4 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:50.907848 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:DELETE=2 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:42:50.925744 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dc2baf2e-93d5-4a1d-9843-c7d978aef772 tempest-QuotasAdminTestJSON-1824655489 tempest-QuotasAdminTestJSON-1824655489-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:50.926976 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dc2baf2e-93d5-4a1d-9843-c7d978aef772 tempest-QuotasAdminTestJSON-1824655489 tempest-QuotasAdminTestJSON-1824655489-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:50.927626 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dc2baf2e-93d5-4a1d-9843-c7d978aef772 tempest-QuotasAdminTestJSON-1824655489 tempest-QuotasAdminTestJSON-1824655489-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:50.928552 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dc2baf2e-93d5-4a1d-9843-c7d978aef772 tempest-QuotasAdminTestJSON-1824655489 tempest-QuotasAdminTestJSON-1824655489-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:50.929232 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dc2baf2e-93d5-4a1d-9843-c7d978aef772 tempest-QuotasAdminTestJSON-1824655489 tempest-QuotasAdminTestJSON-1824655489-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:50.929875 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dc2baf2e-93d5-4a1d-9843-c7d978aef772 tempest-QuotasAdminTestJSON-1824655489 tempest-QuotasAdminTestJSON-1824655489-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:50.938521 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-0b208622-adab-4a47-a8d3-89b5b3c5d9e4 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] [instance: 67f7e060-f4e1-4f23-86f3-6f8ed96e4e22] Going to try to terminate instance {{(pid=123595) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:42:51.006344 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-dc2baf2e-93d5-4a1d-9843-c7d978aef772 tempest-QuotasAdminTestJSON-1824655489 tempest-QuotasAdminTestJSON-1824655489-project-admin] 10.222.0.43 "PUT /compute/v2.1/os-quota-sets/9ae7c8826f244f0abe375801adce349e?user_id=931b6ffcfa6640619e48e7c6998c284e" status: 200 len: 328 microversion: 2.1 time: 0.262622 Oct 04 18:42:51.013204 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1500/2866] 10.222.0.43 () {60 vars in 1343 bytes} [Tue Oct 4 18:42:50 2022] PUT /compute/v2.1/os-quota-sets/9ae7c8826f244f0abe375801adce349e?user_id=931b6ffcfa6640619e48e7c6998c284e => generated 328 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:42:51.019582 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-4cc1eb48-2cfd-4abf-9882-6c27ed761c38 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:51.020206 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-4cc1eb48-2cfd-4abf-9882-6c27ed761c38 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] [instance: d7f06829-6beb-4d35-ab81-c99f9dd3027d] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:51.027835 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4cc1eb48-2cfd-4abf-9882-6c27ed761c38 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:51.028479 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4cc1eb48-2cfd-4abf-9882-6c27ed761c38 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:51.028931 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4cc1eb48-2cfd-4abf-9882-6c27ed761c38 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:51.029676 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4cc1eb48-2cfd-4abf-9882-6c27ed761c38 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:51.030680 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4cc1eb48-2cfd-4abf-9882-6c27ed761c38 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:51.031218 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4cc1eb48-2cfd-4abf-9882-6c27ed761c38 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:51.059180 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-0b208622-adab-4a47-a8d3-89b5b3c5d9e4 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] 10.222.0.43 "DELETE /compute/v2.1/servers/67f7e060-f4e1-4f23-86f3-6f8ed96e4e22" status: 204 len: 0 microversion: 2.1 time: 0.172296 Oct 04 18:42:51.061072 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1367/2867] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 18:42:50 2022] DELETE /compute/v2.1/servers/67f7e060-f4e1-4f23-86f3-6f8ed96e4e22 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:42:51.080064 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-e9c724db-7e4d-4351-97d5-21160d470f37 tempest-QuotasAdminTestJSON-1824655489 tempest-QuotasAdminTestJSON-1824655489-project-admin] Calling method '.version_select at 0x7fb21efcbdc0>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:51.187185 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-e9c724db-7e4d-4351-97d5-21160d470f37 tempest-QuotasAdminTestJSON-1824655489 tempest-QuotasAdminTestJSON-1824655489-project-admin] 10.222.0.43 "GET /compute/v2.1/os-quota-sets/9ae7c8826f244f0abe375801adce349e?user_id=931b6ffcfa6640619e48e7c6998c284e" status: 200 len: 370 microversion: 2.1 time: 0.123313 Oct 04 18:42:51.188145 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1368/2868] 10.222.0.43 () {58 vars in 1323 bytes} [Tue Oct 4 18:42:51 2022] GET /compute/v2.1/os-quota-sets/9ae7c8826f244f0abe375801adce349e?user_id=931b6ffcfa6640619e48e7c6998c284e => generated 370 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:42:51.193259 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-9f6896fc-56a6-4052-8f24-da286860003b tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:51.193863 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-9f6896fc-56a6-4052-8f24-da286860003b tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] [instance: 2d229458-6857-4662-ad59-30770808e2a1] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:51.204042 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9f6896fc-56a6-4052-8f24-da286860003b tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:51.204621 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9f6896fc-56a6-4052-8f24-da286860003b tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:51.205275 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9f6896fc-56a6-4052-8f24-da286860003b tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:51.205994 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9f6896fc-56a6-4052-8f24-da286860003b tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:51.206447 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9f6896fc-56a6-4052-8f24-da286860003b tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:51.207447 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9f6896fc-56a6-4052-8f24-da286860003b tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:51.319832 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-4cc1eb48-2cfd-4abf-9882-6c27ed761c38 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96e7480de94c43909045ac1087e40cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6bd34bf5540ee95c8144f185eb22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:51.329300 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-4cc1eb48-2cfd-4abf-9882-6c27ed761c38 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] 10.222.0.43 "GET /compute/v2.1/servers/d7f06829-6beb-4d35-ab81-c99f9dd3027d" status: 200 len: 1520 microversion: 2.1 time: 0.314214 Oct 04 18:42:51.329891 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1501/2869] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:51 2022] GET /compute/v2.1/servers/d7f06829-6beb-4d35-ab81-c99f9dd3027d => generated 1520 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:51.345273 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-d7412d0a-7595-421e-ad03-020b9d139a84 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-2082778158", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "8029e731-b49c-47e3-865b-225091c44dcf"}]}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:42:51.376707 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-9f6896fc-56a6-4052-8f24-da286860003b tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9971b5861f44c1a1da94eda0f8f02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f809b8ae704988961908bef0f3cb24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:51.385813 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-9f6896fc-56a6-4052-8f24-da286860003b tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] 10.222.0.43 "GET /compute/v2.1/servers/2d229458-6857-4662-ad59-30770808e2a1" status: 200 len: 1310 microversion: 2.1 time: 0.196325 Oct 04 18:42:51.401538 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1369/2870] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:51 2022] GET /compute/v2.1/servers/2d229458-6857-4662-ad59-30770808e2a1 => generated 1310 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:51.411386 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.network.neutron [None req-d7412d0a-7595-421e-ad03-020b9d139a84 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] validate_networks() for [('8029e731-b49c-47e3-865b-225091c44dcf', None, None, None, None, None)] {{(pid=123596) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:42:51.547283 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-80ee8ad1-5955-41b2-adcd-8de619ac365e tempest-QuotasAdminTestJSON-1824655489 tempest-QuotasAdminTestJSON-1824655489-project-admin] Calling method '.version_select at 0x7fb21f020670>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:51.756671 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-80ee8ad1-5955-41b2-adcd-8de619ac365e tempest-QuotasAdminTestJSON-1824655489 tempest-QuotasAdminTestJSON-1824655489-project-admin] 10.222.0.43 "GET /compute/v2.1/os-quota-sets/4ba80f2d36b34de3ae7973746d9303ea/defaults" status: 200 len: 371 microversion: 2.1 time: 0.213401 Oct 04 18:42:51.757274 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1370/2871] 10.222.0.43 () {58 vars in 1269 bytes} [Tue Oct 4 18:42:51 2022] GET /compute/v2.1/os-quota-sets/4ba80f2d36b34de3ae7973746d9303ea/defaults => generated 371 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:42:51.772071 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-3e501470-34aa-4cae-9c2a-731ad238c293 tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:51.772703 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-3e501470-34aa-4cae-9c2a-731ad238c293 tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] [instance: 74d78f04-e2a4-46ce-9da3-fe52e90f2090] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:51.782172 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3e501470-34aa-4cae-9c2a-731ad238c293 tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:51.782655 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3e501470-34aa-4cae-9c2a-731ad238c293 tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:51.783087 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3e501470-34aa-4cae-9c2a-731ad238c293 tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:51.783813 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3e501470-34aa-4cae-9c2a-731ad238c293 tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:51.784263 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3e501470-34aa-4cae-9c2a-731ad238c293 tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:51.784686 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3e501470-34aa-4cae-9c2a-731ad238c293 tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:51.924421 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-3e501470-34aa-4cae-9c2a-731ad238c293 tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecd189792024ba298f451523033386e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bc84144bf334722b4798851268b5f32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:51.932411 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-3e501470-34aa-4cae-9c2a-731ad238c293 tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] 10.222.0.43 "GET /compute/v2.1/servers/74d78f04-e2a4-46ce-9da3-fe52e90f2090" status: 200 len: 1352 microversion: 2.1 time: 0.174136 Oct 04 18:42:51.933013 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1371/2872] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:51 2022] GET /compute/v2.1/servers/74d78f04-e2a4-46ce-9da3-fe52e90f2090 => generated 1352 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:51.938509 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-5894e5c3-43b1-442a-a784-b1c27bcd20a6 tempest-QuotasAdminTestJSON-1824655489 tempest-QuotasAdminTestJSON-1824655489-project-admin] Action: 'update', calling method: .version_select at 0x7fb21f834040>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:42:52.007275 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5894e5c3-43b1-442a-a784-b1c27bcd20a6 tempest-QuotasAdminTestJSON-1824655489 tempest-QuotasAdminTestJSON-1824655489-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:52.007758 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5894e5c3-43b1-442a-a784-b1c27bcd20a6 tempest-QuotasAdminTestJSON-1824655489 tempest-QuotasAdminTestJSON-1824655489-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:52.008262 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5894e5c3-43b1-442a-a784-b1c27bcd20a6 tempest-QuotasAdminTestJSON-1824655489 tempest-QuotasAdminTestJSON-1824655489-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:52.009057 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5894e5c3-43b1-442a-a784-b1c27bcd20a6 tempest-QuotasAdminTestJSON-1824655489 tempest-QuotasAdminTestJSON-1824655489-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:52.009535 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5894e5c3-43b1-442a-a784-b1c27bcd20a6 tempest-QuotasAdminTestJSON-1824655489 tempest-QuotasAdminTestJSON-1824655489-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:52.009960 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5894e5c3-43b1-442a-a784-b1c27bcd20a6 tempest-QuotasAdminTestJSON-1824655489 tempest-QuotasAdminTestJSON-1824655489-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:52.150638 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=9,nova_api:UPDATE=2 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:42:52.250553 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-5894e5c3-43b1-442a-a784-b1c27bcd20a6 tempest-QuotasAdminTestJSON-1824655489 tempest-QuotasAdminTestJSON-1824655489-project-admin] 10.222.0.43 "PUT /compute/v2.1/os-quota-sets/4ba80f2d36b34de3ae7973746d9303ea" status: 200 len: 329 microversion: 2.1 time: 0.316282 Oct 04 18:42:52.251385 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1372/2873] 10.222.0.43 () {60 vars in 1263 bytes} [Tue Oct 4 18:42:51 2022] PUT /compute/v2.1/os-quota-sets/4ba80f2d36b34de3ae7973746d9303ea => generated 329 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:42:52.263301 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-67646085-ae36-417e-95e4-2edd1a8fc875 tempest-QuotasAdminTestJSON-1824655489 tempest-QuotasAdminTestJSON-1824655489-project-admin] Action: 'update', calling method: .version_select at 0x7fb21fa3ab80>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:42:52.331173 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-67646085-ae36-417e-95e4-2edd1a8fc875 tempest-QuotasAdminTestJSON-1824655489 tempest-QuotasAdminTestJSON-1824655489-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:52.331656 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-67646085-ae36-417e-95e4-2edd1a8fc875 tempest-QuotasAdminTestJSON-1824655489 tempest-QuotasAdminTestJSON-1824655489-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:52.332163 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-67646085-ae36-417e-95e4-2edd1a8fc875 tempest-QuotasAdminTestJSON-1824655489 tempest-QuotasAdminTestJSON-1824655489-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:52.332892 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-67646085-ae36-417e-95e4-2edd1a8fc875 tempest-QuotasAdminTestJSON-1824655489 tempest-QuotasAdminTestJSON-1824655489-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:52.333364 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-67646085-ae36-417e-95e4-2edd1a8fc875 tempest-QuotasAdminTestJSON-1824655489 tempest-QuotasAdminTestJSON-1824655489-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:52.333794 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-67646085-ae36-417e-95e4-2edd1a8fc875 tempest-QuotasAdminTestJSON-1824655489 tempest-QuotasAdminTestJSON-1824655489-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:52.438114 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-d7412d0a-7595-421e-ad03-020b9d139a84 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Flavor limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:42:52.438589 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-d7412d0a-7595-421e-ad03-020b9d139a84 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Image limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:42:52.439021 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-d7412d0a-7595-421e-ad03-020b9d139a84 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Flavor pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:42:52.439649 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-d7412d0a-7595-421e-ad03-020b9d139a84 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Image pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:42:52.440471 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-d7412d0a-7595-421e-ad03-020b9d139a84 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:42:52.450054 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=93,nova_cell0:UPDATE=7 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:42:52.457786 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d7412d0a-7595-421e-ad03-020b9d139a84 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:52.459032 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d7412d0a-7595-421e-ad03-020b9d139a84 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:52.459741 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d7412d0a-7595-421e-ad03-020b9d139a84 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:52.460505 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d7412d0a-7595-421e-ad03-020b9d139a84 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:52.461001 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d7412d0a-7595-421e-ad03-020b9d139a84 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:52.461668 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d7412d0a-7595-421e-ad03-020b9d139a84 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:52.484887 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-d7412d0a-7595-421e-ad03-020b9d139a84 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Getting quotas for project 5419b9532d52479d8d99336b90ebe9ae. Resources: {'ram', 'cores', 'instances'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:42:52.490467 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-d7412d0a-7595-421e-ad03-020b9d139a84 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Getting quotas for user 2ee90610168a4d46b456d7a278991091 and project 5419b9532d52479d8d99336b90ebe9ae. Resources: {'ram', 'cores', 'instances'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:42:52.505939 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-d7412d0a-7595-421e-ad03-020b9d139a84 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Going to run 2 instances... {{(pid=123596) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:42:52.508668 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-d7412d0a-7595-421e-ad03-020b9d139a84 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] [instance: f0b19cd2-3133-4782-87d9-93f72979db40] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e8943ec5-4038-4d4b-b9b9-2415a79f5243',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123596) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:42:52.557483 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-d7412d0a-7595-421e-ad03-020b9d139a84 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] [instance: bd12a90d-60fb-4627-9ea1-9e60a1565528] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e8943ec5-4038-4d4b-b9b9-2415a79f5243',instance=,instance_uuid=f0b19cd2-3133-4782-87d9-93f72979db40,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123596) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:42:52.624895 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-d7412d0a-7595-421e-ad03-020b9d139a84 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.293162 Oct 04 18:42:52.625632 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1502/2874] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 18:42:51 2022] POST /compute/v2.1/servers => generated 32 bytes in 1295 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Oct 04 18:42:52.632953 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-45cc0abd-307b-45b6-91c0-7d0f8f6e7a20 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:52.633572 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-45cc0abd-307b-45b6-91c0-7d0f8f6e7a20 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] [instance: d7f06829-6beb-4d35-ab81-c99f9dd3027d] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:52.640772 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-45cc0abd-307b-45b6-91c0-7d0f8f6e7a20 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:52.641303 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-45cc0abd-307b-45b6-91c0-7d0f8f6e7a20 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:52.641746 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-45cc0abd-307b-45b6-91c0-7d0f8f6e7a20 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:52.642464 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-45cc0abd-307b-45b6-91c0-7d0f8f6e7a20 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:52.642916 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-45cc0abd-307b-45b6-91c0-7d0f8f6e7a20 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:52.643342 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-45cc0abd-307b-45b6-91c0-7d0f8f6e7a20 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:52.716199 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-67646085-ae36-417e-95e4-2edd1a8fc875 tempest-QuotasAdminTestJSON-1824655489 tempest-QuotasAdminTestJSON-1824655489-project-admin] 10.222.0.43 "PUT /compute/v2.1/os-quota-sets/4ba80f2d36b34de3ae7973746d9303ea" status: 200 len: 329 microversion: 2.1 time: 0.456579 Oct 04 18:42:52.718159 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1373/2875] 10.222.0.43 () {60 vars in 1263 bytes} [Tue Oct 4 18:42:52 2022] PUT /compute/v2.1/os-quota-sets/4ba80f2d36b34de3ae7973746d9303ea => generated 329 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:42:52.724075 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-18c99063-e04e-4ad7-8ce5-2173d86c4835 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:52.725233 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-18c99063-e04e-4ad7-8ce5-2173d86c4835 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] [instance: 2d229458-6857-4662-ad59-30770808e2a1] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:52.734554 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-18c99063-e04e-4ad7-8ce5-2173d86c4835 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:52.736759 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-18c99063-e04e-4ad7-8ce5-2173d86c4835 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:52.737704 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-18c99063-e04e-4ad7-8ce5-2173d86c4835 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:52.738656 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-18c99063-e04e-4ad7-8ce5-2173d86c4835 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:52.739341 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-18c99063-e04e-4ad7-8ce5-2173d86c4835 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:52.739950 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-18c99063-e04e-4ad7-8ce5-2173d86c4835 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:52.955341 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-45cc0abd-307b-45b6-91c0-7d0f8f6e7a20 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96e7480de94c43909045ac1087e40cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6bd34bf5540ee95c8144f185eb22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:52.958897 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-18c99063-e04e-4ad7-8ce5-2173d86c4835 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9971b5861f44c1a1da94eda0f8f02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f809b8ae704988961908bef0f3cb24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:52.966642 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-45cc0abd-307b-45b6-91c0-7d0f8f6e7a20 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] 10.222.0.43 "GET /compute/v2.1/servers/d7f06829-6beb-4d35-ab81-c99f9dd3027d" status: 200 len: 1520 microversion: 2.1 time: 0.339923 Oct 04 18:42:52.966830 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-18c99063-e04e-4ad7-8ce5-2173d86c4835 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] 10.222.0.43 "GET /compute/v2.1/servers/2d229458-6857-4662-ad59-30770808e2a1" status: 200 len: 1310 microversion: 2.1 time: 0.246944 Oct 04 18:42:52.969035 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1503/2876] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:52 2022] GET /compute/v2.1/servers/d7f06829-6beb-4d35-ab81-c99f9dd3027d => generated 1520 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:52.982046 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1374/2877] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:52 2022] GET /compute/v2.1/servers/2d229458-6857-4662-ad59-30770808e2a1 => generated 1310 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:52.986116 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-92daf4db-3a86-4ecb-a2e6-aba61a5b9a0e tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:52.988340 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-0cf4c2d6-ff58-473d-9028-f8a866d65f70 req-155575ee-c7a2-4c9e-bce3-863aa869f29e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82b86465-afb0-49ef-9932-1538010c1ae5", "name": "network-vif-plugged", "status": "completed", "tag": "7e7a43a5-3a15-49a6-b50e-0ac0ac9faa8d"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:42:52.998282 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-92daf4db-3a86-4ecb-a2e6-aba61a5b9a0e tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2ee90610168a4d46b456d7a278991091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5419b9532d52479d8d99336b90ebe9ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:53.001341 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-92daf4db-3a86-4ecb-a2e6-aba61a5b9a0e tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Searching by: {'deleted': False, 'project_id': '5419b9532d52479d8d99336b90ebe9ae'} {{(pid=123596) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:42:53.003962 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-0cf4c2d6-ff58-473d-9028-f8a866d65f70 req-155575ee-c7a2-4c9e-bce3-863aa869f29e service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:53.004547 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-0cf4c2d6-ff58-473d-9028-f8a866d65f70 req-155575ee-c7a2-4c9e-bce3-863aa869f29e service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:53.004904 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-0cf4c2d6-ff58-473d-9028-f8a866d65f70 req-155575ee-c7a2-4c9e-bce3-863aa869f29e service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:53.021055 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-0cf4c2d6-ff58-473d-9028-f8a866d65f70 req-155575ee-c7a2-4c9e-bce3-863aa869f29e service nova] Creating event network-vif-plugged:7e7a43a5-3a15-49a6-b50e-0ac0ac9faa8d for instance 82b86465-afb0-49ef-9932-1538010c1ae5 on n-h2-851028-13 Oct 04 18:42:53.028670 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-0cf4c2d6-ff58-473d-9028-f8a866d65f70 req-155575ee-c7a2-4c9e-bce3-863aa869f29e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045334 Oct 04 18:42:53.029644 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1375/2878] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:42:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:42:53.035899 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-7063d6fd-3b48-41cf-a5e1-e3a5fbe67eb9 tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:53.036614 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-7063d6fd-3b48-41cf-a5e1-e3a5fbe67eb9 tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] [instance: 74d78f04-e2a4-46ce-9da3-fe52e90f2090] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:53.047113 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7063d6fd-3b48-41cf-a5e1-e3a5fbe67eb9 tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:53.047113 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7063d6fd-3b48-41cf-a5e1-e3a5fbe67eb9 tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:53.047113 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7063d6fd-3b48-41cf-a5e1-e3a5fbe67eb9 tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:53.047113 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7063d6fd-3b48-41cf-a5e1-e3a5fbe67eb9 tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:53.047667 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7063d6fd-3b48-41cf-a5e1-e3a5fbe67eb9 tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:53.047667 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7063d6fd-3b48-41cf-a5e1-e3a5fbe67eb9 tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:53.053473 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-92daf4db-3a86-4ecb-a2e6-aba61a5b9a0e tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:53.054375 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-92daf4db-3a86-4ecb-a2e6-aba61a5b9a0e tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:53.055038 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-92daf4db-3a86-4ecb-a2e6-aba61a5b9a0e tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:53.055855 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-92daf4db-3a86-4ecb-a2e6-aba61a5b9a0e tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:53.056407 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-92daf4db-3a86-4ecb-a2e6-aba61a5b9a0e tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:53.056920 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-92daf4db-3a86-4ecb-a2e6-aba61a5b9a0e tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:53.091066 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.multi_cell_list [None req-92daf4db-3a86-4ecb-a2e6-aba61a5b9a0e tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Listed batch of 2 results from cell out of 998 limit. Returned 2 total so far. {{(pid=123596) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 18:42:53.150880 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-92daf4db-3a86-4ecb-a2e6-aba61a5b9a0e tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] 10.222.0.43 "GET /compute/v2.1/servers" status: 200 len: 1337 microversion: 2.1 time: 0.180614 Oct 04 18:42:53.161615 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1504/2879] 10.222.0.43 () {58 vars in 1125 bytes} [Tue Oct 4 18:42:52 2022] GET /compute/v2.1/servers => generated 1337 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:53.171141 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-7be053ca-e5e1-4419-9dc5-7c464aea3cc6 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:53.172692 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-7be053ca-e5e1-4419-9dc5-7c464aea3cc6 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] [instance: bd12a90d-60fb-4627-9ea1-9e60a1565528] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:53.331535 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-7063d6fd-3b48-41cf-a5e1-e3a5fbe67eb9 tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecd189792024ba298f451523033386e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bc84144bf334722b4798851268b5f32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:53.342217 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-7be053ca-e5e1-4419-9dc5-7c464aea3cc6 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ee90610168a4d46b456d7a278991091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5419b9532d52479d8d99336b90ebe9ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:53.345460 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-7063d6fd-3b48-41cf-a5e1-e3a5fbe67eb9 tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] 10.222.0.43 "GET /compute/v2.1/servers/74d78f04-e2a4-46ce-9da3-fe52e90f2090" status: 200 len: 1352 microversion: 2.1 time: 0.309467 Oct 04 18:42:53.364644 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1376/2880] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:53 2022] GET /compute/v2.1/servers/74d78f04-e2a4-46ce-9da3-fe52e90f2090 => generated 1352 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:53.369092 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-7be053ca-e5e1-4419-9dc5-7c464aea3cc6 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] 10.222.0.43 "GET /compute/v2.1/servers/bd12a90d-60fb-4627-9ea1-9e60a1565528" status: 200 len: 1218 microversion: 2.1 time: 0.204213 Oct 04 18:42:53.369556 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1505/2881] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:53 2022] GET /compute/v2.1/servers/bd12a90d-60fb-4627-9ea1-9e60a1565528 => generated 1218 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:53.995851 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-7021d3c0-4699-4b91-8791-dfb0311355f8 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:53.996656 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-7021d3c0-4699-4b91-8791-dfb0311355f8 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] [instance: 2d229458-6857-4662-ad59-30770808e2a1] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:54.005381 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-649fadad-525b-4c53-bece-723f43c8310d tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:54.006384 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-649fadad-525b-4c53-bece-723f43c8310d tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] [instance: d7f06829-6beb-4d35-ab81-c99f9dd3027d] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:54.019681 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-649fadad-525b-4c53-bece-723f43c8310d tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:54.019945 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7021d3c0-4699-4b91-8791-dfb0311355f8 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:54.020435 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-649fadad-525b-4c53-bece-723f43c8310d tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:54.020568 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7021d3c0-4699-4b91-8791-dfb0311355f8 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:54.020856 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7021d3c0-4699-4b91-8791-dfb0311355f8 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:54.021610 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7021d3c0-4699-4b91-8791-dfb0311355f8 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:54.021897 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-649fadad-525b-4c53-bece-723f43c8310d tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:54.022487 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7021d3c0-4699-4b91-8791-dfb0311355f8 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:54.025942 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-649fadad-525b-4c53-bece-723f43c8310d tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:54.026592 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7021d3c0-4699-4b91-8791-dfb0311355f8 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:54.026905 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-649fadad-525b-4c53-bece-723f43c8310d tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:54.027842 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-649fadad-525b-4c53-bece-723f43c8310d tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:54.500618 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-649fadad-525b-4c53-bece-723f43c8310d tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96e7480de94c43909045ac1087e40cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6bd34bf5540ee95c8144f185eb22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:54.520301 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-649fadad-525b-4c53-bece-723f43c8310d tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] 10.222.0.43 "GET /compute/v2.1/servers/d7f06829-6beb-4d35-ab81-c99f9dd3027d" status: 200 len: 1520 microversion: 2.1 time: 0.528672 Oct 04 18:42:54.520941 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1377/2882] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:53 2022] GET /compute/v2.1/servers/d7f06829-6beb-4d35-ab81-c99f9dd3027d => generated 1520 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:54.537672 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-995c667b-b435-4d07-9b12-6a3e9cc4b039 tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:54.539038 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-995c667b-b435-4d07-9b12-6a3e9cc4b039 tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] [instance: 74d78f04-e2a4-46ce-9da3-fe52e90f2090] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:54.557918 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-995c667b-b435-4d07-9b12-6a3e9cc4b039 tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:54.558968 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-995c667b-b435-4d07-9b12-6a3e9cc4b039 tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:54.559976 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-995c667b-b435-4d07-9b12-6a3e9cc4b039 tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:54.566108 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-995c667b-b435-4d07-9b12-6a3e9cc4b039 tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:54.567048 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-995c667b-b435-4d07-9b12-6a3e9cc4b039 tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:54.568566 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-995c667b-b435-4d07-9b12-6a3e9cc4b039 tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:54.899119 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-995c667b-b435-4d07-9b12-6a3e9cc4b039 tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecd189792024ba298f451523033386e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bc84144bf334722b4798851268b5f32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:54.917009 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-995c667b-b435-4d07-9b12-6a3e9cc4b039 tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] 10.222.0.43 "GET /compute/v2.1/servers/74d78f04-e2a4-46ce-9da3-fe52e90f2090" status: 200 len: 1542 microversion: 2.1 time: 0.386795 Oct 04 18:42:54.947623 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1378/2883] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:54 2022] GET /compute/v2.1/servers/74d78f04-e2a4-46ce-9da3-fe52e90f2090 => generated 1542 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:54.960664 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-644d9503-157f-4369-8332-bd880ac624c8 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:54.963159 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-644d9503-157f-4369-8332-bd880ac624c8 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] [instance: bd12a90d-60fb-4627-9ea1-9e60a1565528] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:54.982178 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-644d9503-157f-4369-8332-bd880ac624c8 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:54.982726 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-644d9503-157f-4369-8332-bd880ac624c8 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:54.984614 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-644d9503-157f-4369-8332-bd880ac624c8 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:54.988237 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-644d9503-157f-4369-8332-bd880ac624c8 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:54.988858 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-644d9503-157f-4369-8332-bd880ac624c8 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:54.989369 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-644d9503-157f-4369-8332-bd880ac624c8 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:55.182525 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-7021d3c0-4699-4b91-8791-dfb0311355f8 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9971b5861f44c1a1da94eda0f8f02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f809b8ae704988961908bef0f3cb24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:55.199456 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-7021d3c0-4699-4b91-8791-dfb0311355f8 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] 10.222.0.43 "GET /compute/v2.1/servers/2d229458-6857-4662-ad59-30770808e2a1" status: 200 len: 1310 microversion: 2.1 time: 1.203154 Oct 04 18:42:55.203365 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1506/2884] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:53 2022] GET /compute/v2.1/servers/2d229458-6857-4662-ad59-30770808e2a1 => generated 1310 bytes in 1212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:55.211576 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-644d9503-157f-4369-8332-bd880ac624c8 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ee90610168a4d46b456d7a278991091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5419b9532d52479d8d99336b90ebe9ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:55.217561 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-de6e0792-2af2-4e39-8d3c-47daf68e9f4f req-e5f2b285-89fe-45b6-b834-58fe94aa8d68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67f7e060-f4e1-4f23-86f3-6f8ed96e4e22", "name": "network-vif-deleted", "tag": "2b3a1d4f-3f20-490f-a873-011a2860f667"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:42:55.231767 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-644d9503-157f-4369-8332-bd880ac624c8 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] 10.222.0.43 "GET /compute/v2.1/servers/bd12a90d-60fb-4627-9ea1-9e60a1565528" status: 200 len: 1214 microversion: 2.1 time: 0.278474 Oct 04 18:42:55.239559 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1379/2885] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:54 2022] GET /compute/v2.1/servers/bd12a90d-60fb-4627-9ea1-9e60a1565528 => generated 1214 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:55.249715 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-de6e0792-2af2-4e39-8d3c-47daf68e9f4f req-e5f2b285-89fe-45b6-b834-58fe94aa8d68 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:55.250700 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-de6e0792-2af2-4e39-8d3c-47daf68e9f4f req-e5f2b285-89fe-45b6-b834-58fe94aa8d68 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:55.251300 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-de6e0792-2af2-4e39-8d3c-47daf68e9f4f req-e5f2b285-89fe-45b6-b834-58fe94aa8d68 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:55.278488 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-f1089897-25b7-4469-9157-f08adac09d99 tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:55.281181 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-de6e0792-2af2-4e39-8d3c-47daf68e9f4f req-e5f2b285-89fe-45b6-b834-58fe94aa8d68 service nova] Creating event network-vif-deleted:2b3a1d4f-3f20-490f-a873-011a2860f667 for instance 67f7e060-f4e1-4f23-86f3-6f8ed96e4e22 on n-h1-851028-13 Oct 04 18:42:55.283692 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-f1089897-25b7-4469-9157-f08adac09d99 tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] [instance: 74d78f04-e2a4-46ce-9da3-fe52e90f2090] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:55.295957 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-de6e0792-2af2-4e39-8d3c-47daf68e9f4f req-e5f2b285-89fe-45b6-b834-58fe94aa8d68 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090403 Oct 04 18:42:55.307285 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1507/2886] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:42:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:42:55.308127 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f1089897-25b7-4469-9157-f08adac09d99 tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:55.309824 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f1089897-25b7-4469-9157-f08adac09d99 tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:55.314072 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f1089897-25b7-4469-9157-f08adac09d99 tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:55.319917 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f1089897-25b7-4469-9157-f08adac09d99 tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:55.320842 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f1089897-25b7-4469-9157-f08adac09d99 tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:55.323638 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f1089897-25b7-4469-9157-f08adac09d99 tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:55.326883 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-c5c22703-9a58-4834-b7ac-3fec067370c3 req-c6339f5d-601f-44c5-b94d-426c6a9b532b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "861427d4-c606-4a99-9c94-2b8e9dc42c1c", "name": "network-vif-deleted", "tag": "00befd08-4583-44c6-95c5-b39c21d82c7f"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:42:55.361921 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-c5c22703-9a58-4834-b7ac-3fec067370c3 req-c6339f5d-601f-44c5-b94d-426c6a9b532b service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:55.389521 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-c5c22703-9a58-4834-b7ac-3fec067370c3 req-c6339f5d-601f-44c5-b94d-426c6a9b532b service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:55.394354 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-c5c22703-9a58-4834-b7ac-3fec067370c3 req-c6339f5d-601f-44c5-b94d-426c6a9b532b service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:55.441262 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-c5c22703-9a58-4834-b7ac-3fec067370c3 req-c6339f5d-601f-44c5-b94d-426c6a9b532b service nova] Creating event network-vif-deleted:00befd08-4583-44c6-95c5-b39c21d82c7f for instance 861427d4-c606-4a99-9c94-2b8e9dc42c1c on n-h2-851028-13 Oct 04 18:42:55.462561 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-c5c22703-9a58-4834-b7ac-3fec067370c3 req-c6339f5d-601f-44c5-b94d-426c6a9b532b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.153537 Oct 04 18:42:55.463193 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1508/2887] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:42:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:42:55.549638 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-98fe0fa6-38e5-48dd-9275-e76cd61f1f8c tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:55.550353 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-98fe0fa6-38e5-48dd-9275-e76cd61f1f8c tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] [instance: d7f06829-6beb-4d35-ab81-c99f9dd3027d] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:55.568053 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-98fe0fa6-38e5-48dd-9275-e76cd61f1f8c tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:55.575382 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-98fe0fa6-38e5-48dd-9275-e76cd61f1f8c tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:55.577838 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-98fe0fa6-38e5-48dd-9275-e76cd61f1f8c tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:55.586276 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-98fe0fa6-38e5-48dd-9275-e76cd61f1f8c tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:55.586854 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-98fe0fa6-38e5-48dd-9275-e76cd61f1f8c tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:55.587317 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-98fe0fa6-38e5-48dd-9275-e76cd61f1f8c tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:56.127687 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-98fe0fa6-38e5-48dd-9275-e76cd61f1f8c tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96e7480de94c43909045ac1087e40cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6bd34bf5540ee95c8144f185eb22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:56.138592 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-98fe0fa6-38e5-48dd-9275-e76cd61f1f8c tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] 10.222.0.43 "GET /compute/v2.1/servers/d7f06829-6beb-4d35-ab81-c99f9dd3027d" status: 200 len: 1520 microversion: 2.1 time: 0.594839 Oct 04 18:42:56.150057 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1509/2888] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:55 2022] GET /compute/v2.1/servers/d7f06829-6beb-4d35-ab81-c99f9dd3027d => generated 1520 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:56.156006 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-10a6739f-54b9-4449-9c09-80f9673e15b7 req-431d3c13-2496-4a08-ba31-a7c40b7bef75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d229458-6857-4662-ad59-30770808e2a1", "name": "network-vif-plugged", "status": "completed", "tag": "84b873b9-38f0-4a0b-975a-a315fbcad8ab"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:42:56.177132 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-10a6739f-54b9-4449-9c09-80f9673e15b7 req-431d3c13-2496-4a08-ba31-a7c40b7bef75 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:56.190051 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-10a6739f-54b9-4449-9c09-80f9673e15b7 req-431d3c13-2496-4a08-ba31-a7c40b7bef75 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:56.191213 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-10a6739f-54b9-4449-9c09-80f9673e15b7 req-431d3c13-2496-4a08-ba31-a7c40b7bef75 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:56.220739 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-10a6739f-54b9-4449-9c09-80f9673e15b7 req-431d3c13-2496-4a08-ba31-a7c40b7bef75 service nova] Creating event network-vif-plugged:84b873b9-38f0-4a0b-975a-a315fbcad8ab for instance 2d229458-6857-4662-ad59-30770808e2a1 on n-h1-851028-13 Oct 04 18:42:56.233239 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-10a6739f-54b9-4449-9c09-80f9673e15b7 req-431d3c13-2496-4a08-ba31-a7c40b7bef75 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079622 Oct 04 18:42:56.240109 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1510/2889] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:42:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:42:56.271556 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-0ba73ab6-cb6f-4acd-8ae0-331bfa8be222 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:56.278216 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-0ba73ab6-cb6f-4acd-8ae0-331bfa8be222 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] [instance: 2d229458-6857-4662-ad59-30770808e2a1] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:56.293271 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0ba73ab6-cb6f-4acd-8ae0-331bfa8be222 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:56.294166 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0ba73ab6-cb6f-4acd-8ae0-331bfa8be222 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:56.294803 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0ba73ab6-cb6f-4acd-8ae0-331bfa8be222 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:56.298385 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0ba73ab6-cb6f-4acd-8ae0-331bfa8be222 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:56.299059 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0ba73ab6-cb6f-4acd-8ae0-331bfa8be222 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:56.299686 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0ba73ab6-cb6f-4acd-8ae0-331bfa8be222 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:56.396201 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:42:56.451127 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-f1089897-25b7-4469-9157-f08adac09d99 tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] 10.222.0.43 "GET /compute/v2.1/servers/74d78f04-e2a4-46ce-9da3-fe52e90f2090/os-interface" status: 200 len: 285 microversion: 2.1 time: 1.209582 Oct 04 18:42:56.453339 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1380/2890] 10.222.0.43 () {58 vars in 1275 bytes} [Tue Oct 4 18:42:55 2022] GET /compute/v2.1/servers/74d78f04-e2a4-46ce-9da3-fe52e90f2090/os-interface => generated 285 bytes in 1212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:42:56.468489 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-a86ab654-3fe6-429d-9b8b-a9e95381a806 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:56.489346 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-a86ab654-3fe6-429d-9b8b-a9e95381a806 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] [instance: bd12a90d-60fb-4627-9ea1-9e60a1565528] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:56.519022 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=20,nova_api:UPDATE=14 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:42:56.523760 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a86ab654-3fe6-429d-9b8b-a9e95381a806 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:56.528517 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a86ab654-3fe6-429d-9b8b-a9e95381a806 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:56.529905 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a86ab654-3fe6-429d-9b8b-a9e95381a806 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:56.535251 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a86ab654-3fe6-429d-9b8b-a9e95381a806 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:56.539965 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a86ab654-3fe6-429d-9b8b-a9e95381a806 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:56.543741 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a86ab654-3fe6-429d-9b8b-a9e95381a806 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:56.736910 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-0ba73ab6-cb6f-4acd-8ae0-331bfa8be222 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9971b5861f44c1a1da94eda0f8f02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f809b8ae704988961908bef0f3cb24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:56.753437 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-0ba73ab6-cb6f-4acd-8ae0-331bfa8be222 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] 10.222.0.43 "GET /compute/v2.1/servers/2d229458-6857-4662-ad59-30770808e2a1" status: 200 len: 1310 microversion: 2.1 time: 0.511134 Oct 04 18:42:56.754605 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1511/2891] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:56 2022] GET /compute/v2.1/servers/2d229458-6857-4662-ad59-30770808e2a1 => generated 1310 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:56.858327 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-a86ab654-3fe6-429d-9b8b-a9e95381a806 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ee90610168a4d46b456d7a278991091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5419b9532d52479d8d99336b90ebe9ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:56.872607 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-a86ab654-3fe6-429d-9b8b-a9e95381a806 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] 10.222.0.43 "GET /compute/v2.1/servers/bd12a90d-60fb-4627-9ea1-9e60a1565528" status: 200 len: 1278 microversion: 2.1 time: 0.417850 Oct 04 18:42:56.889766 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1381/2892] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:56 2022] GET /compute/v2.1/servers/bd12a90d-60fb-4627-9ea1-9e60a1565528 => generated 1278 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:57.185023 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-38f37438-1d62-438b-bf30-ebbcb2afd3b3 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:57.186997 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-38f37438-1d62-438b-bf30-ebbcb2afd3b3 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] [instance: d7f06829-6beb-4d35-ab81-c99f9dd3027d] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:57.198807 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-38f37438-1d62-438b-bf30-ebbcb2afd3b3 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:57.200265 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-38f37438-1d62-438b-bf30-ebbcb2afd3b3 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:57.201008 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-38f37438-1d62-438b-bf30-ebbcb2afd3b3 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:57.202899 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-38f37438-1d62-438b-bf30-ebbcb2afd3b3 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:57.204370 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-38f37438-1d62-438b-bf30-ebbcb2afd3b3 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:57.205304 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-38f37438-1d62-438b-bf30-ebbcb2afd3b3 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:57.780317 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-daf85515-1057-4536-a776-20a55b809c15 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:57.781552 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-daf85515-1057-4536-a776-20a55b809c15 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] [instance: 2d229458-6857-4662-ad59-30770808e2a1] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:57.802255 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-daf85515-1057-4536-a776-20a55b809c15 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:57.804564 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-daf85515-1057-4536-a776-20a55b809c15 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:57.806260 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-daf85515-1057-4536-a776-20a55b809c15 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:57.810777 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-daf85515-1057-4536-a776-20a55b809c15 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:57.812241 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-daf85515-1057-4536-a776-20a55b809c15 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:57.812914 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-daf85515-1057-4536-a776-20a55b809c15 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:57.831725 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-38f37438-1d62-438b-bf30-ebbcb2afd3b3 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96e7480de94c43909045ac1087e40cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6bd34bf5540ee95c8144f185eb22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:57.840722 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-38f37438-1d62-438b-bf30-ebbcb2afd3b3 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] 10.222.0.43 "GET /compute/v2.1/servers/d7f06829-6beb-4d35-ab81-c99f9dd3027d" status: 200 len: 1520 microversion: 2.1 time: 0.666050 Oct 04 18:42:57.846448 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1512/2893] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:57 2022] GET /compute/v2.1/servers/d7f06829-6beb-4d35-ab81-c99f9dd3027d => generated 1520 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:57.901443 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-88e6d87c-eced-4296-a3f5-1fed3dc0e33d tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:57.902298 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-88e6d87c-eced-4296-a3f5-1fed3dc0e33d tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] [instance: bd12a90d-60fb-4627-9ea1-9e60a1565528] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:57.913224 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-88e6d87c-eced-4296-a3f5-1fed3dc0e33d tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:57.914196 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-88e6d87c-eced-4296-a3f5-1fed3dc0e33d tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:57.914842 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-88e6d87c-eced-4296-a3f5-1fed3dc0e33d tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:57.916706 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-88e6d87c-eced-4296-a3f5-1fed3dc0e33d tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:57.922801 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-88e6d87c-eced-4296-a3f5-1fed3dc0e33d tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:57.923414 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-88e6d87c-eced-4296-a3f5-1fed3dc0e33d tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:58.100389 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-88e6d87c-eced-4296-a3f5-1fed3dc0e33d tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ee90610168a4d46b456d7a278991091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5419b9532d52479d8d99336b90ebe9ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:58.111883 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-88e6d87c-eced-4296-a3f5-1fed3dc0e33d tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] 10.222.0.43 "GET /compute/v2.1/servers/bd12a90d-60fb-4627-9ea1-9e60a1565528" status: 200 len: 1276 microversion: 2.1 time: 0.215504 Oct 04 18:42:58.113432 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1513/2894] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:57 2022] GET /compute/v2.1/servers/bd12a90d-60fb-4627-9ea1-9e60a1565528 => generated 1276 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:42:58.281829 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-daf85515-1057-4536-a776-20a55b809c15 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9971b5861f44c1a1da94eda0f8f02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f809b8ae704988961908bef0f3cb24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:58.290640 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-daf85515-1057-4536-a776-20a55b809c15 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] 10.222.0.43 "GET /compute/v2.1/servers/2d229458-6857-4662-ad59-30770808e2a1" status: 200 len: 1310 microversion: 2.1 time: 0.514268 Oct 04 18:42:58.295876 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1382/2895] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:57 2022] GET /compute/v2.1/servers/2d229458-6857-4662-ad59-30770808e2a1 => generated 1310 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:42:58.880083 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-82467cc5-13c5-46b4-a947-e7b719267822 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:58.890614 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-82467cc5-13c5-46b4-a947-e7b719267822 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] [instance: d7f06829-6beb-4d35-ab81-c99f9dd3027d] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:58.945074 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-82467cc5-13c5-46b4-a947-e7b719267822 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:58.967278 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-82467cc5-13c5-46b4-a947-e7b719267822 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:58.976401 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-82467cc5-13c5-46b4-a947-e7b719267822 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:58.988552 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-82467cc5-13c5-46b4-a947-e7b719267822 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:58.990862 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-82467cc5-13c5-46b4-a947-e7b719267822 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:59.024773 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-82467cc5-13c5-46b4-a947-e7b719267822 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:59.135759 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-6e28dfb9-7a76-468b-b905-ac44b28ce881 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:59.136554 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-6e28dfb9-7a76-468b-b905-ac44b28ce881 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] [instance: bd12a90d-60fb-4627-9ea1-9e60a1565528] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:59.159114 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6e28dfb9-7a76-468b-b905-ac44b28ce881 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:59.160028 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6e28dfb9-7a76-468b-b905-ac44b28ce881 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:59.161443 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6e28dfb9-7a76-468b-b905-ac44b28ce881 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:59.162516 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6e28dfb9-7a76-468b-b905-ac44b28ce881 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:59.165123 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6e28dfb9-7a76-468b-b905-ac44b28ce881 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:59.170035 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6e28dfb9-7a76-468b-b905-ac44b28ce881 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:59.490626 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-82467cc5-13c5-46b4-a947-e7b719267822 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96e7480de94c43909045ac1087e40cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6bd34bf5540ee95c8144f185eb22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:59.501772 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-82467cc5-13c5-46b4-a947-e7b719267822 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] 10.222.0.43 "GET /compute/v2.1/servers/d7f06829-6beb-4d35-ab81-c99f9dd3027d" status: 200 len: 1520 microversion: 2.1 time: 0.634151 Oct 04 18:42:59.504431 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1514/2896] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:58 2022] GET /compute/v2.1/servers/d7f06829-6beb-4d35-ab81-c99f9dd3027d => generated 1520 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:59.511788 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-8f96bec3-7ea4-4409-a349-4f46d03bd085 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:59.512497 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-8f96bec3-7ea4-4409-a349-4f46d03bd085 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] [instance: 2d229458-6857-4662-ad59-30770808e2a1] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:59.534321 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8f96bec3-7ea4-4409-a349-4f46d03bd085 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:59.534851 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8f96bec3-7ea4-4409-a349-4f46d03bd085 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:59.535315 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8f96bec3-7ea4-4409-a349-4f46d03bd085 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:59.536129 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8f96bec3-7ea4-4409-a349-4f46d03bd085 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:59.536534 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8f96bec3-7ea4-4409-a349-4f46d03bd085 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:59.536981 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8f96bec3-7ea4-4409-a349-4f46d03bd085 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:59.765654 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-6e28dfb9-7a76-468b-b905-ac44b28ce881 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ee90610168a4d46b456d7a278991091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5419b9532d52479d8d99336b90ebe9ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:59.778286 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-6e28dfb9-7a76-468b-b905-ac44b28ce881 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] 10.222.0.43 "GET /compute/v2.1/servers/bd12a90d-60fb-4627-9ea1-9e60a1565528" status: 200 len: 1318 microversion: 2.1 time: 0.646339 Oct 04 18:42:59.779355 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1383/2897] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:59 2022] GET /compute/v2.1/servers/bd12a90d-60fb-4627-9ea1-9e60a1565528 => generated 1318 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:42:59.885836 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-8f96bec3-7ea4-4409-a349-4f46d03bd085 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9971b5861f44c1a1da94eda0f8f02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f809b8ae704988961908bef0f3cb24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:59.899868 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-8f96bec3-7ea4-4409-a349-4f46d03bd085 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] 10.222.0.43 "GET /compute/v2.1/servers/2d229458-6857-4662-ad59-30770808e2a1" status: 200 len: 1493 microversion: 2.1 time: 0.391245 Oct 04 18:42:59.901522 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1515/2898] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:59 2022] GET /compute/v2.1/servers/2d229458-6857-4662-ad59-30770808e2a1 => generated 1493 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:59.939266 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-802c457c-57e6-4b76-8da0-9a7edc2cbe6a tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:59.940082 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-802c457c-57e6-4b76-8da0-9a7edc2cbe6a tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] [instance: 2d229458-6857-4662-ad59-30770808e2a1] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:59.960876 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-802c457c-57e6-4b76-8da0-9a7edc2cbe6a tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:59.969882 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-802c457c-57e6-4b76-8da0-9a7edc2cbe6a tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:59.970580 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-802c457c-57e6-4b76-8da0-9a7edc2cbe6a tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:59.971463 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-802c457c-57e6-4b76-8da0-9a7edc2cbe6a tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:59.971964 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-802c457c-57e6-4b76-8da0-9a7edc2cbe6a tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:59.977549 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-802c457c-57e6-4b76-8da0-9a7edc2cbe6a tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:59.998867 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:43:00.548008 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-dd414fbd-434c-46a8-93f3-95f80cdeaa08 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:00.553035 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-dd414fbd-434c-46a8-93f3-95f80cdeaa08 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] [instance: d7f06829-6beb-4d35-ab81-c99f9dd3027d] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:00.586755 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dd414fbd-434c-46a8-93f3-95f80cdeaa08 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:00.587347 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dd414fbd-434c-46a8-93f3-95f80cdeaa08 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:00.587810 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dd414fbd-434c-46a8-93f3-95f80cdeaa08 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:00.588848 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dd414fbd-434c-46a8-93f3-95f80cdeaa08 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:00.589513 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dd414fbd-434c-46a8-93f3-95f80cdeaa08 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:00.590118 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dd414fbd-434c-46a8-93f3-95f80cdeaa08 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:01.186823 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-dd414fbd-434c-46a8-93f3-95f80cdeaa08 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96e7480de94c43909045ac1087e40cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6bd34bf5540ee95c8144f185eb22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:01.202864 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-dd414fbd-434c-46a8-93f3-95f80cdeaa08 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] 10.222.0.43 "GET /compute/v2.1/servers/d7f06829-6beb-4d35-ab81-c99f9dd3027d" status: 200 len: 1520 microversion: 2.1 time: 0.666499 Oct 04 18:43:01.240836 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1516/2899] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:00 2022] GET /compute/v2.1/servers/d7f06829-6beb-4d35-ab81-c99f9dd3027d => generated 1520 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:01.249564 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-802c457c-57e6-4b76-8da0-9a7edc2cbe6a tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/2d229458-6857-4662-ad59-30770808e2a1" status: 200 len: 1646 microversion: 2.1 time: 1.314156 Oct 04 18:43:01.266271 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1384/2900] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:59 2022] GET /compute/v2.1/servers/2d229458-6857-4662-ad59-30770808e2a1 => generated 1646 bytes in 1332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:01.272495 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-3d067f88-bcd5-426a-8211-f713b5e3ab09 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:01.273463 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-3d067f88-bcd5-426a-8211-f713b5e3ab09 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] [instance: bd12a90d-60fb-4627-9ea1-9e60a1565528] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:01.287053 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3d067f88-bcd5-426a-8211-f713b5e3ab09 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:01.289074 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3d067f88-bcd5-426a-8211-f713b5e3ab09 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:01.289749 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3d067f88-bcd5-426a-8211-f713b5e3ab09 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:01.291517 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3d067f88-bcd5-426a-8211-f713b5e3ab09 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:01.292453 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3d067f88-bcd5-426a-8211-f713b5e3ab09 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:01.293211 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3d067f88-bcd5-426a-8211-f713b5e3ab09 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:01.546525 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-3d067f88-bcd5-426a-8211-f713b5e3ab09 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ee90610168a4d46b456d7a278991091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5419b9532d52479d8d99336b90ebe9ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:01.554812 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-413a00e0-7901-407a-8895-9dbd50191147 tempest-QuotasAdminTestV236-920401372 tempest-QuotasAdminTestV236-920401372-project-admin] Action: 'update', calling method: .version_select at 0x7fb21efcb1f0>, body: {"quota_set": {"ram": "5120"}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:43:01.559656 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-3d067f88-bcd5-426a-8211-f713b5e3ab09 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] 10.222.0.43 "GET /compute/v2.1/servers/bd12a90d-60fb-4627-9ea1-9e60a1565528" status: 200 len: 1318 microversion: 2.1 time: 0.314883 Oct 04 18:43:01.561835 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1517/2901] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:01 2022] GET /compute/v2.1/servers/bd12a90d-60fb-4627-9ea1-9e60a1565528 => generated 1318 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:01.573507 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-cb15d6c7-d0f5-4c93-a1ba-b26f0319f6c4 req-12ec5a0a-d35d-4411-b401-2f97ad603119 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74d78f04-e2a4-46ce-9da3-fe52e90f2090", "tag": "28ad400f-e2ec-4faf-bb1a-cf2726a0831a"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:43:01.603679 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-cb15d6c7-d0f5-4c93-a1ba-b26f0319f6c4 req-12ec5a0a-d35d-4411-b401-2f97ad603119 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:01.605530 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-cb15d6c7-d0f5-4c93-a1ba-b26f0319f6c4 req-12ec5a0a-d35d-4411-b401-2f97ad603119 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:01.606837 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-cb15d6c7-d0f5-4c93-a1ba-b26f0319f6c4 req-12ec5a0a-d35d-4411-b401-2f97ad603119 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:01.637137 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-cb15d6c7-d0f5-4c93-a1ba-b26f0319f6c4 req-12ec5a0a-d35d-4411-b401-2f97ad603119 service nova] Creating event network-changed:28ad400f-e2ec-4faf-bb1a-cf2726a0831a for instance 74d78f04-e2a4-46ce-9da3-fe52e90f2090 on n-h2-851028-13 Oct 04 18:43:01.648304 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-cb15d6c7-d0f5-4c93-a1ba-b26f0319f6c4 req-12ec5a0a-d35d-4411-b401-2f97ad603119 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084745 Oct 04 18:43:01.652771 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1518/2902] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:43:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:43:01.675054 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-09417a0b-6cd9-439d-abc1-aff2ac8cac79 tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:01.678375 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-09417a0b-6cd9-439d-abc1-aff2ac8cac79 tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] [instance: 2d229458-6857-4662-ad59-30770808e2a1] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:01.682972 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-413a00e0-7901-407a-8895-9dbd50191147 tempest-QuotasAdminTestV236-920401372 tempest-QuotasAdminTestV236-920401372-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:01.683746 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-413a00e0-7901-407a-8895-9dbd50191147 tempest-QuotasAdminTestV236-920401372 tempest-QuotasAdminTestV236-920401372-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:01.684356 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-413a00e0-7901-407a-8895-9dbd50191147 tempest-QuotasAdminTestV236-920401372 tempest-QuotasAdminTestV236-920401372-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:01.687253 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-413a00e0-7901-407a-8895-9dbd50191147 tempest-QuotasAdminTestV236-920401372 tempest-QuotasAdminTestV236-920401372-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:01.689515 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-413a00e0-7901-407a-8895-9dbd50191147 tempest-QuotasAdminTestV236-920401372 tempest-QuotasAdminTestV236-920401372-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:01.690150 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-413a00e0-7901-407a-8895-9dbd50191147 tempest-QuotasAdminTestV236-920401372 tempest-QuotasAdminTestV236-920401372-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:01.711170 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-09417a0b-6cd9-439d-abc1-aff2ac8cac79 tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:01.712489 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-09417a0b-6cd9-439d-abc1-aff2ac8cac79 tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:01.716445 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-09417a0b-6cd9-439d-abc1-aff2ac8cac79 tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:01.719096 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-09417a0b-6cd9-439d-abc1-aff2ac8cac79 tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:01.722865 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-09417a0b-6cd9-439d-abc1-aff2ac8cac79 tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:01.725447 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-09417a0b-6cd9-439d-abc1-aff2ac8cac79 tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:01.820263 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-413a00e0-7901-407a-8895-9dbd50191147 tempest-QuotasAdminTestV236-920401372 tempest-QuotasAdminTestV236-920401372-project-admin] 10.222.0.43 "PUT /compute/v2.1/os-quota-sets/baba6c2c487041fbb7e30b081de57ca2" status: 200 len: 240 microversion: 2.36 time: 0.552706 Oct 04 18:43:01.823478 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1385/2903] 10.222.0.43 () {62 vars in 1303 bytes} [Tue Oct 4 18:43:01 2022] PUT /compute/v2.1/os-quota-sets/baba6c2c487041fbb7e30b081de57ca2 => generated 240 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:43:01.835121 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-1e5a14aa-cdcb-410e-8e2c-d710a1303ae2 tempest-QuotasAdminTestV236-920401372 tempest-QuotasAdminTestV236-920401372-project-admin] Calling method '.version_select at 0x7fb21f06a670>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:01.916988 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1e5a14aa-cdcb-410e-8e2c-d710a1303ae2 tempest-QuotasAdminTestV236-920401372 tempest-QuotasAdminTestV236-920401372-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:01.918010 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1e5a14aa-cdcb-410e-8e2c-d710a1303ae2 tempest-QuotasAdminTestV236-920401372 tempest-QuotasAdminTestV236-920401372-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:01.918692 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1e5a14aa-cdcb-410e-8e2c-d710a1303ae2 tempest-QuotasAdminTestV236-920401372 tempest-QuotasAdminTestV236-920401372-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:01.919707 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1e5a14aa-cdcb-410e-8e2c-d710a1303ae2 tempest-QuotasAdminTestV236-920401372 tempest-QuotasAdminTestV236-920401372-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:01.921063 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1e5a14aa-cdcb-410e-8e2c-d710a1303ae2 tempest-QuotasAdminTestV236-920401372 tempest-QuotasAdminTestV236-920401372-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:01.922114 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1e5a14aa-cdcb-410e-8e2c-d710a1303ae2 tempest-QuotasAdminTestV236-920401372 tempest-QuotasAdminTestV236-920401372-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:01.943191 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-1e5a14aa-cdcb-410e-8e2c-d710a1303ae2 tempest-QuotasAdminTestV236-920401372 tempest-QuotasAdminTestV236-920401372-project-admin] 10.222.0.43 "GET /compute/v2.1/os-quota-sets/baba6c2c487041fbb7e30b081de57ca2/detail" status: 200 len: 672 microversion: 2.36 time: 0.112475 Oct 04 18:43:01.944537 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1386/2904] 10.222.0.43 () {60 vars in 1304 bytes} [Tue Oct 4 18:43:01 2022] GET /compute/v2.1/os-quota-sets/baba6c2c487041fbb7e30b081de57ca2/detail => generated 672 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:43:02.223684 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-eda13f53-2f41-46de-8672-659532ce0984 tempest-QuotasAdminTestV236-920401372 tempest-QuotasAdminTestV236-920401372-project-admin] Action: 'update', calling method: .version_select at 0x7fb227e08550>, body: {"quota_set": {"ram": "2048"}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:43:02.347875 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-eda13f53-2f41-46de-8672-659532ce0984 tempest-QuotasAdminTestV236-920401372 tempest-QuotasAdminTestV236-920401372-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:02.350989 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-eda13f53-2f41-46de-8672-659532ce0984 tempest-QuotasAdminTestV236-920401372 tempest-QuotasAdminTestV236-920401372-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:02.350989 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-eda13f53-2f41-46de-8672-659532ce0984 tempest-QuotasAdminTestV236-920401372 tempest-QuotasAdminTestV236-920401372-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:02.355429 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-eda13f53-2f41-46de-8672-659532ce0984 tempest-QuotasAdminTestV236-920401372 tempest-QuotasAdminTestV236-920401372-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:02.356107 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-eda13f53-2f41-46de-8672-659532ce0984 tempest-QuotasAdminTestV236-920401372 tempest-QuotasAdminTestV236-920401372-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:02.356711 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-eda13f53-2f41-46de-8672-659532ce0984 tempest-QuotasAdminTestV236-920401372 tempest-QuotasAdminTestV236-920401372-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:02.398108 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-eda13f53-2f41-46de-8672-659532ce0984 tempest-QuotasAdminTestV236-920401372 tempest-QuotasAdminTestV236-920401372-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:02.399109 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-eda13f53-2f41-46de-8672-659532ce0984 tempest-QuotasAdminTestV236-920401372 tempest-QuotasAdminTestV236-920401372-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:02.400591 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-eda13f53-2f41-46de-8672-659532ce0984 tempest-QuotasAdminTestV236-920401372 tempest-QuotasAdminTestV236-920401372-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:02.401575 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-eda13f53-2f41-46de-8672-659532ce0984 tempest-QuotasAdminTestV236-920401372 tempest-QuotasAdminTestV236-920401372-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:02.402877 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-eda13f53-2f41-46de-8672-659532ce0984 tempest-QuotasAdminTestV236-920401372 tempest-QuotasAdminTestV236-920401372-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:02.404133 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-eda13f53-2f41-46de-8672-659532ce0984 tempest-QuotasAdminTestV236-920401372 tempest-QuotasAdminTestV236-920401372-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:02.488832 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-eda13f53-2f41-46de-8672-659532ce0984 tempest-QuotasAdminTestV236-920401372 tempest-QuotasAdminTestV236-920401372-project-admin] 10.222.0.43 "PUT /compute/v2.1/os-quota-sets/baba6c2c487041fbb7e30b081de57ca2?user_id=01b06ee091de43d9be2e1ace8ce25aa3" status: 200 len: 240 microversion: 2.36 time: 0.269433 Oct 04 18:43:02.490100 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1387/2905] 10.222.0.43 () {62 vars in 1384 bytes} [Tue Oct 4 18:43:02 2022] PUT /compute/v2.1/os-quota-sets/baba6c2c487041fbb7e30b081de57ca2?user_id=01b06ee091de43d9be2e1ace8ce25aa3 => generated 240 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:43:02.497084 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-a8de81d1-cf14-4c89-b117-cab656f9772f tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:02.497853 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-a8de81d1-cf14-4c89-b117-cab656f9772f tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] [instance: d7f06829-6beb-4d35-ab81-c99f9dd3027d] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:02.505458 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a8de81d1-cf14-4c89-b117-cab656f9772f tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:02.506048 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a8de81d1-cf14-4c89-b117-cab656f9772f tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:02.506835 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a8de81d1-cf14-4c89-b117-cab656f9772f tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:02.508596 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a8de81d1-cf14-4c89-b117-cab656f9772f tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:02.509364 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a8de81d1-cf14-4c89-b117-cab656f9772f tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:02.509874 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a8de81d1-cf14-4c89-b117-cab656f9772f tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:02.905167 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-09417a0b-6cd9-439d-abc1-aff2ac8cac79 tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/2d229458-6857-4662-ad59-30770808e2a1" status: 200 len: 1646 microversion: 2.1 time: 1.247695 Oct 04 18:43:02.906590 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1519/2906] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:01 2022] GET /compute/v2.1/servers/2d229458-6857-4662-ad59-30770808e2a1 => generated 1646 bytes in 1253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:02.928146 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-d53efe98-8623-415a-a742-89bfdc3ed360 tempest-QuotasAdminTestV236-920401372 tempest-QuotasAdminTestV236-920401372-project-admin] Calling method '.version_select at 0x7fb21fd118b0>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:03.071392 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=13 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:43:03.125332 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-d53efe98-8623-415a-a742-89bfdc3ed360 tempest-QuotasAdminTestV236-920401372 tempest-QuotasAdminTestV236-920401372-project-admin] 10.222.0.43 "GET /compute/v2.1/os-quota-sets/baba6c2c487041fbb7e30b081de57ca2?user_id=01b06ee091de43d9be2e1ace8ce25aa3" status: 200 len: 282 microversion: 2.36 time: 0.215269 Oct 04 18:43:03.126377 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1520/2907] 10.222.0.43 () {60 vars in 1364 bytes} [Tue Oct 4 18:43:02 2022] GET /compute/v2.1/os-quota-sets/baba6c2c487041fbb7e30b081de57ca2?user_id=01b06ee091de43d9be2e1ace8ce25aa3 => generated 282 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:43:03.146395 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-c34715ff-391a-4d92-871c-7b5e569d3718 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:03.148075 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-c34715ff-391a-4d92-871c-7b5e569d3718 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] [instance: bd12a90d-60fb-4627-9ea1-9e60a1565528] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:03.164660 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c34715ff-391a-4d92-871c-7b5e569d3718 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:03.166137 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c34715ff-391a-4d92-871c-7b5e569d3718 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:03.167504 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c34715ff-391a-4d92-871c-7b5e569d3718 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:03.169264 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c34715ff-391a-4d92-871c-7b5e569d3718 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:03.170956 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c34715ff-391a-4d92-871c-7b5e569d3718 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:03.172208 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c34715ff-391a-4d92-871c-7b5e569d3718 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:03.228984 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-a8de81d1-cf14-4c89-b117-cab656f9772f tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96e7480de94c43909045ac1087e40cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6bd34bf5540ee95c8144f185eb22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:03.256003 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-a8de81d1-cf14-4c89-b117-cab656f9772f tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] 10.222.0.43 "GET /compute/v2.1/servers/d7f06829-6beb-4d35-ab81-c99f9dd3027d" status: 200 len: 1520 microversion: 2.1 time: 0.764642 Oct 04 18:43:03.282007 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1388/2908] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:02 2022] GET /compute/v2.1/servers/d7f06829-6beb-4d35-ab81-c99f9dd3027d => generated 1520 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:03.301325 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-ecc5f10a-7fc6-4bad-9415-c2bfc8a5f9a2 tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:03.310029 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ecc5f10a-7fc6-4bad-9415-c2bfc8a5f9a2 tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:03.310670 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ecc5f10a-7fc6-4bad-9415-c2bfc8a5f9a2 tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:03.337895 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ecc5f10a-7fc6-4bad-9415-c2bfc8a5f9a2 tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:03.350498 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ecc5f10a-7fc6-4bad-9415-c2bfc8a5f9a2 tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:03.351784 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ecc5f10a-7fc6-4bad-9415-c2bfc8a5f9a2 tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:03.355381 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ecc5f10a-7fc6-4bad-9415-c2bfc8a5f9a2 tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:03.415284 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-ecc5f10a-7fc6-4bad-9415-c2bfc8a5f9a2 tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] 10.222.0.43 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.130197 Oct 04 18:43:03.417158 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1389/2909] 10.222.0.43 () {58 vars in 1176 bytes} [Tue Oct 4 18:43:03 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:43:03.433001 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-fbadd9e8-666c-40ae-8797-2f188b5ab05b tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:43:03.434964 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-fbadd9e8-666c-40ae-8797-2f188b5ab05b tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] [instance: 2d229458-6857-4662-ad59-30770808e2a1] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:03.444195 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fbadd9e8-666c-40ae-8797-2f188b5ab05b tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:03.445432 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fbadd9e8-666c-40ae-8797-2f188b5ab05b tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:03.446155 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fbadd9e8-666c-40ae-8797-2f188b5ab05b tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:03.447869 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fbadd9e8-666c-40ae-8797-2f188b5ab05b tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:03.448876 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fbadd9e8-666c-40ae-8797-2f188b5ab05b tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:03.449677 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fbadd9e8-666c-40ae-8797-2f188b5ab05b tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:03.636295 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-fbadd9e8-666c-40ae-8797-2f188b5ab05b tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] 10.222.0.43 "POST /compute/v2.1/servers/2d229458-6857-4662-ad59-30770808e2a1/action" status: 202 len: 0 microversion: 2.1 time: 0.208753 Oct 04 18:43:03.637390 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1390/2910] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 18:43:03 2022] POST /compute/v2.1/servers/2d229458-6857-4662-ad59-30770808e2a1/action => generated 0 bytes in 212 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:43:03.661253 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-b8b551cb-b945-4ce6-b433-131d40aa8bdc tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:03.662539 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-b8b551cb-b945-4ce6-b433-131d40aa8bdc tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] [instance: 2d229458-6857-4662-ad59-30770808e2a1] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:03.679063 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b8b551cb-b945-4ce6-b433-131d40aa8bdc tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:03.679280 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b8b551cb-b945-4ce6-b433-131d40aa8bdc tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:03.680847 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b8b551cb-b945-4ce6-b433-131d40aa8bdc tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:03.683750 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b8b551cb-b945-4ce6-b433-131d40aa8bdc tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:03.684498 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b8b551cb-b945-4ce6-b433-131d40aa8bdc tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:03.685009 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b8b551cb-b945-4ce6-b433-131d40aa8bdc tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:03.699023 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-c34715ff-391a-4d92-871c-7b5e569d3718 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ee90610168a4d46b456d7a278991091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5419b9532d52479d8d99336b90ebe9ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:03.710655 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-c34715ff-391a-4d92-871c-7b5e569d3718 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] 10.222.0.43 "GET /compute/v2.1/servers/bd12a90d-60fb-4627-9ea1-9e60a1565528" status: 200 len: 1318 microversion: 2.1 time: 0.572927 Oct 04 18:43:03.711241 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1521/2911] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:03 2022] GET /compute/v2.1/servers/bd12a90d-60fb-4627-9ea1-9e60a1565528 => generated 1318 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:03.862046 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-02ee89ab-bd37-4a4c-b639-b951e1fd4a59 req-d988741e-e6e2-49c7-875f-5bcb9be931be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0b19cd2-3133-4782-87d9-93f72979db40", "tag": "06fcd034-41cc-4794-96e8-fd6827d1c4f3"}, {"name": "network-changed", "server_uuid": "bd12a90d-60fb-4627-9ea1-9e60a1565528", "tag": "9b8d3102-96fe-45fd-97e0-d7cd99f53ad0"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:43:03.879146 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-02ee89ab-bd37-4a4c-b639-b951e1fd4a59 req-d988741e-e6e2-49c7-875f-5bcb9be931be service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:03.884271 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-02ee89ab-bd37-4a4c-b639-b951e1fd4a59 req-d988741e-e6e2-49c7-875f-5bcb9be931be service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:03.884991 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-02ee89ab-bd37-4a4c-b639-b951e1fd4a59 req-d988741e-e6e2-49c7-875f-5bcb9be931be service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:03.923476 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-02ee89ab-bd37-4a4c-b639-b951e1fd4a59 req-d988741e-e6e2-49c7-875f-5bcb9be931be service nova] Creating event network-changed:06fcd034-41cc-4794-96e8-fd6827d1c4f3 for instance f0b19cd2-3133-4782-87d9-93f72979db40 on n-h1-851028-13 Oct 04 18:43:03.925126 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-02ee89ab-bd37-4a4c-b639-b951e1fd4a59 req-d988741e-e6e2-49c7-875f-5bcb9be931be service nova] Creating event network-changed:9b8d3102-96fe-45fd-97e0-d7cd99f53ad0 for instance bd12a90d-60fb-4627-9ea1-9e60a1565528 on n-h1-851028-13 Oct 04 18:43:03.942405 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-02ee89ab-bd37-4a4c-b639-b951e1fd4a59 req-d988741e-e6e2-49c7-875f-5bcb9be931be service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.083614 Oct 04 18:43:03.944773 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1522/2912] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:43:03 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:43:04.290794 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-b8b551cb-b945-4ce6-b433-131d40aa8bdc tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/2d229458-6857-4662-ad59-30770808e2a1" status: 200 len: 1651 microversion: 2.1 time: 0.645425 Oct 04 18:43:04.291043 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-0a843534-91bc-4ec2-b265-a2a1806fc289 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:04.291868 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-0a843534-91bc-4ec2-b265-a2a1806fc289 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] [instance: d7f06829-6beb-4d35-ab81-c99f9dd3027d] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:04.292239 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1391/2913] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:03 2022] GET /compute/v2.1/servers/2d229458-6857-4662-ad59-30770808e2a1 => generated 1651 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:04.303427 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0a843534-91bc-4ec2-b265-a2a1806fc289 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:04.308793 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0a843534-91bc-4ec2-b265-a2a1806fc289 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:04.309711 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0a843534-91bc-4ec2-b265-a2a1806fc289 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:04.311897 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0a843534-91bc-4ec2-b265-a2a1806fc289 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:04.313979 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0a843534-91bc-4ec2-b265-a2a1806fc289 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:04.315291 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0a843534-91bc-4ec2-b265-a2a1806fc289 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:04.645906 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-0a843534-91bc-4ec2-b265-a2a1806fc289 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96e7480de94c43909045ac1087e40cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6bd34bf5540ee95c8144f185eb22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:04.661158 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-0a843534-91bc-4ec2-b265-a2a1806fc289 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] 10.222.0.43 "GET /compute/v2.1/servers/d7f06829-6beb-4d35-ab81-c99f9dd3027d" status: 200 len: 1520 microversion: 2.1 time: 0.376753 Oct 04 18:43:04.676895 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1523/2914] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:04 2022] GET /compute/v2.1/servers/d7f06829-6beb-4d35-ab81-c99f9dd3027d => generated 1520 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:04.749535 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-cf847d33-1955-4768-bbac-a9ac6cec28a1 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:04.751601 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-cf847d33-1955-4768-bbac-a9ac6cec28a1 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] [instance: bd12a90d-60fb-4627-9ea1-9e60a1565528] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:04.764511 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cf847d33-1955-4768-bbac-a9ac6cec28a1 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:04.765435 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cf847d33-1955-4768-bbac-a9ac6cec28a1 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:04.766294 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cf847d33-1955-4768-bbac-a9ac6cec28a1 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:04.767547 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cf847d33-1955-4768-bbac-a9ac6cec28a1 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:04.768094 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cf847d33-1955-4768-bbac-a9ac6cec28a1 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:04.770790 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cf847d33-1955-4768-bbac-a9ac6cec28a1 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:05.097571 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-cf847d33-1955-4768-bbac-a9ac6cec28a1 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ee90610168a4d46b456d7a278991091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5419b9532d52479d8d99336b90ebe9ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:05.113593 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-cf847d33-1955-4768-bbac-a9ac6cec28a1 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] 10.222.0.43 "GET /compute/v2.1/servers/bd12a90d-60fb-4627-9ea1-9e60a1565528" status: 200 len: 1318 microversion: 2.1 time: 0.376898 Oct 04 18:43:05.114700 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1392/2915] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:04 2022] GET /compute/v2.1/servers/bd12a90d-60fb-4627-9ea1-9e60a1565528 => generated 1318 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:05.318560 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-4316628c-1486-4159-959a-41022d38c004 tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:05.319257 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-4316628c-1486-4159-959a-41022d38c004 tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] [instance: 2d229458-6857-4662-ad59-30770808e2a1] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:05.328729 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4316628c-1486-4159-959a-41022d38c004 tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:05.329597 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4316628c-1486-4159-959a-41022d38c004 tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:05.330243 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4316628c-1486-4159-959a-41022d38c004 tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:05.331447 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4316628c-1486-4159-959a-41022d38c004 tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:05.332155 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4316628c-1486-4159-959a-41022d38c004 tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:05.332832 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4316628c-1486-4159-959a-41022d38c004 tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:05.544408 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-4316628c-1486-4159-959a-41022d38c004 tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/2d229458-6857-4662-ad59-30770808e2a1" status: 200 len: 1631 microversion: 2.1 time: 0.232665 Oct 04 18:43:05.545965 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1524/2916] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:05 2022] GET /compute/v2.1/servers/2d229458-6857-4662-ad59-30770808e2a1 => generated 1631 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:05.574953 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-3dcf0db0-be6a-4e26-9e16-783ab91dfa6d tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-851028-13", "block_migration": true, "disk_over_commit": false}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:43:05.580514 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-3dcf0db0-be6a-4e26-9e16-783ab91dfa6d tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] [instance: 2d229458-6857-4662-ad59-30770808e2a1] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:05.592051 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3dcf0db0-be6a-4e26-9e16-783ab91dfa6d tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:05.592783 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3dcf0db0-be6a-4e26-9e16-783ab91dfa6d tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:05.593250 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3dcf0db0-be6a-4e26-9e16-783ab91dfa6d tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:05.594752 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3dcf0db0-be6a-4e26-9e16-783ab91dfa6d tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:05.595392 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3dcf0db0-be6a-4e26-9e16-783ab91dfa6d tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:05.595893 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3dcf0db0-be6a-4e26-9e16-783ab91dfa6d tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:05.629240 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.objects.instance [None req-3dcf0db0-be6a-4e26-9e16-783ab91dfa6d tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] Lazy-loading 'flavor' on Instance uuid 2d229458-6857-4662-ad59-30770808e2a1 {{(pid=123595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:43:05.648926 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-3dcf0db0-be6a-4e26-9e16-783ab91dfa6d tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] [instance: 2d229458-6857-4662-ad59-30770808e2a1] Going to try to live migrate instance to n-h2-851028-13 {{(pid=123595) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 04 18:43:05.695408 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-d4def672-9ab3-4c81-be07-3f2e6cc18e49 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:05.696146 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-d4def672-9ab3-4c81-be07-3f2e6cc18e49 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] [instance: d7f06829-6beb-4d35-ab81-c99f9dd3027d] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:05.709976 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d4def672-9ab3-4c81-be07-3f2e6cc18e49 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:05.712668 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d4def672-9ab3-4c81-be07-3f2e6cc18e49 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:05.713245 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d4def672-9ab3-4c81-be07-3f2e6cc18e49 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:05.714441 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d4def672-9ab3-4c81-be07-3f2e6cc18e49 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:05.715129 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d4def672-9ab3-4c81-be07-3f2e6cc18e49 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:05.718409 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d4def672-9ab3-4c81-be07-3f2e6cc18e49 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:05.968319 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-d4def672-9ab3-4c81-be07-3f2e6cc18e49 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96e7480de94c43909045ac1087e40cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6bd34bf5540ee95c8144f185eb22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:05.980910 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-d4def672-9ab3-4c81-be07-3f2e6cc18e49 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] 10.222.0.43 "GET /compute/v2.1/servers/d7f06829-6beb-4d35-ab81-c99f9dd3027d" status: 200 len: 1520 microversion: 2.1 time: 0.292821 Oct 04 18:43:06.009147 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1525/2917] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:05 2022] GET /compute/v2.1/servers/d7f06829-6beb-4d35-ab81-c99f9dd3027d => generated 1520 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:43:06.136602 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-99939c5d-15bd-4ee0-bbd0-9d92edfdea59 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:06.137806 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-99939c5d-15bd-4ee0-bbd0-9d92edfdea59 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] [instance: bd12a90d-60fb-4627-9ea1-9e60a1565528] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:06.152047 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-99939c5d-15bd-4ee0-bbd0-9d92edfdea59 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:06.154148 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-99939c5d-15bd-4ee0-bbd0-9d92edfdea59 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:06.156109 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-99939c5d-15bd-4ee0-bbd0-9d92edfdea59 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:06.158697 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-99939c5d-15bd-4ee0-bbd0-9d92edfdea59 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:06.160720 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-99939c5d-15bd-4ee0-bbd0-9d92edfdea59 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:06.160720 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-99939c5d-15bd-4ee0-bbd0-9d92edfdea59 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:06.401235 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-99939c5d-15bd-4ee0-bbd0-9d92edfdea59 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ee90610168a4d46b456d7a278991091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5419b9532d52479d8d99336b90ebe9ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:06.415264 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-99939c5d-15bd-4ee0-bbd0-9d92edfdea59 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] 10.222.0.43 "GET /compute/v2.1/servers/bd12a90d-60fb-4627-9ea1-9e60a1565528" status: 200 len: 1318 microversion: 2.1 time: 0.282341 Oct 04 18:43:06.437276 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1526/2918] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:06 2022] GET /compute/v2.1/servers/bd12a90d-60fb-4627-9ea1-9e60a1565528 => generated 1318 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:07.012781 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f2eee31d-c88e-4fad-9a95-ffe0d1c66ae2 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:07.014070 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-f2eee31d-c88e-4fad-9a95-ffe0d1c66ae2 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] [instance: d7f06829-6beb-4d35-ab81-c99f9dd3027d] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:07.024915 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f2eee31d-c88e-4fad-9a95-ffe0d1c66ae2 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:07.031249 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f2eee31d-c88e-4fad-9a95-ffe0d1c66ae2 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:07.032060 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f2eee31d-c88e-4fad-9a95-ffe0d1c66ae2 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:07.033645 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f2eee31d-c88e-4fad-9a95-ffe0d1c66ae2 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:07.034354 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f2eee31d-c88e-4fad-9a95-ffe0d1c66ae2 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:07.035041 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f2eee31d-c88e-4fad-9a95-ffe0d1c66ae2 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:07.351520 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-f2eee31d-c88e-4fad-9a95-ffe0d1c66ae2 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96e7480de94c43909045ac1087e40cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6bd34bf5540ee95c8144f185eb22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:07.360997 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-f2eee31d-c88e-4fad-9a95-ffe0d1c66ae2 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] 10.222.0.43 "GET /compute/v2.1/servers/d7f06829-6beb-4d35-ab81-c99f9dd3027d" status: 200 len: 1520 microversion: 2.1 time: 0.353321 Oct 04 18:43:07.370232 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1527/2919] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:07 2022] GET /compute/v2.1/servers/d7f06829-6beb-4d35-ab81-c99f9dd3027d => generated 1520 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:43:07.446107 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-39dbad2e-26ff-489f-9812-08b58b131653 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:07.447386 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-39dbad2e-26ff-489f-9812-08b58b131653 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] [instance: bd12a90d-60fb-4627-9ea1-9e60a1565528] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:07.465792 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-39dbad2e-26ff-489f-9812-08b58b131653 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:07.468664 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-39dbad2e-26ff-489f-9812-08b58b131653 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:07.469444 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-39dbad2e-26ff-489f-9812-08b58b131653 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:07.471172 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-39dbad2e-26ff-489f-9812-08b58b131653 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:07.472136 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-39dbad2e-26ff-489f-9812-08b58b131653 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:07.474604 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-39dbad2e-26ff-489f-9812-08b58b131653 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:07.772341 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-39dbad2e-26ff-489f-9812-08b58b131653 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ee90610168a4d46b456d7a278991091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5419b9532d52479d8d99336b90ebe9ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:07.791441 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-39dbad2e-26ff-489f-9812-08b58b131653 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] 10.222.0.43 "GET /compute/v2.1/servers/bd12a90d-60fb-4627-9ea1-9e60a1565528" status: 200 len: 1318 microversion: 2.1 time: 0.350234 Oct 04 18:43:07.793050 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1528/2920] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:07 2022] GET /compute/v2.1/servers/bd12a90d-60fb-4627-9ea1-9e60a1565528 => generated 1318 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:43:08.385218 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-72d93632-5ff4-4b83-91c4-9e61a14abfb9 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:08.386443 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-72d93632-5ff4-4b83-91c4-9e61a14abfb9 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] [instance: d7f06829-6beb-4d35-ab81-c99f9dd3027d] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:08.408433 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-72d93632-5ff4-4b83-91c4-9e61a14abfb9 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:08.409368 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-72d93632-5ff4-4b83-91c4-9e61a14abfb9 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:08.410200 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-72d93632-5ff4-4b83-91c4-9e61a14abfb9 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:08.416672 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-72d93632-5ff4-4b83-91c4-9e61a14abfb9 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:08.417499 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-72d93632-5ff4-4b83-91c4-9e61a14abfb9 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:08.418663 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-72d93632-5ff4-4b83-91c4-9e61a14abfb9 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:08.679141 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-72d93632-5ff4-4b83-91c4-9e61a14abfb9 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96e7480de94c43909045ac1087e40cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6bd34bf5540ee95c8144f185eb22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:08.690467 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-72d93632-5ff4-4b83-91c4-9e61a14abfb9 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] 10.222.0.43 "GET /compute/v2.1/servers/d7f06829-6beb-4d35-ab81-c99f9dd3027d" status: 200 len: 1520 microversion: 2.1 time: 0.309110 Oct 04 18:43:08.691629 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1529/2921] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:08 2022] GET /compute/v2.1/servers/d7f06829-6beb-4d35-ab81-c99f9dd3027d => generated 1520 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:08.818932 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-af7bfb4a-ada8-4faf-9b4b-3e0973e45674 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:08.819523 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-af7bfb4a-ada8-4faf-9b4b-3e0973e45674 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] [instance: bd12a90d-60fb-4627-9ea1-9e60a1565528] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:08.827155 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-af7bfb4a-ada8-4faf-9b4b-3e0973e45674 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:08.828110 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-af7bfb4a-ada8-4faf-9b4b-3e0973e45674 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:08.830492 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-af7bfb4a-ada8-4faf-9b4b-3e0973e45674 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:08.832710 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-af7bfb4a-ada8-4faf-9b4b-3e0973e45674 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:08.834682 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-af7bfb4a-ada8-4faf-9b4b-3e0973e45674 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:08.836639 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-af7bfb4a-ada8-4faf-9b4b-3e0973e45674 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:08.881699 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=100 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:43:09.182141 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-af7bfb4a-ada8-4faf-9b4b-3e0973e45674 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ee90610168a4d46b456d7a278991091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5419b9532d52479d8d99336b90ebe9ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:09.194687 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-af7bfb4a-ada8-4faf-9b4b-3e0973e45674 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] 10.222.0.43 "GET /compute/v2.1/servers/bd12a90d-60fb-4627-9ea1-9e60a1565528" status: 200 len: 1318 microversion: 2.1 time: 0.379624 Oct 04 18:43:09.207694 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1530/2922] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:08 2022] GET /compute/v2.1/servers/bd12a90d-60fb-4627-9ea1-9e60a1565528 => generated 1318 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:09.583185 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-3dcf0db0-be6a-4e26-9e16-783ab91dfa6d tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] 10.222.0.43 "POST /compute/v2.1/servers/2d229458-6857-4662-ad59-30770808e2a1/action" status: 202 len: 0 microversion: 2.1 time: 4.012882 Oct 04 18:43:09.583849 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1393/2923] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 18:43:05 2022] POST /compute/v2.1/servers/2d229458-6857-4662-ad59-30770808e2a1/action => generated 0 bytes in 4015 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:43:09.596740 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-d9d972ee-7090-44ef-a731-c3a35c8338bc tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:09.598586 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-d9d972ee-7090-44ef-a731-c3a35c8338bc tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] [instance: 2d229458-6857-4662-ad59-30770808e2a1] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:09.632878 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d9d972ee-7090-44ef-a731-c3a35c8338bc tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:09.635919 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d9d972ee-7090-44ef-a731-c3a35c8338bc tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:09.639808 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d9d972ee-7090-44ef-a731-c3a35c8338bc tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:09.642842 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d9d972ee-7090-44ef-a731-c3a35c8338bc tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:09.644261 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d9d972ee-7090-44ef-a731-c3a35c8338bc tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:09.647416 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d9d972ee-7090-44ef-a731-c3a35c8338bc tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:09.800872 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-347ea0ab-adf3-417d-8253-0afae1c45020 tempest-SecurityGroupsTestAdminJSON-78164343 tempest-SecurityGroupsTestAdminJSON-78164343-project] Action: 'create', calling method: .version_select at 0x7fb227dd9310>, body: {"security_group": {"name": "tempest-securitygroup-975446259", "description": "tempest-description-1222831449"}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:43:10.378326 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-d9d972ee-7090-44ef-a731-c3a35c8338bc tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9971b5861f44c1a1da94eda0f8f02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f809b8ae704988961908bef0f3cb24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:10.397253 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-d9d972ee-7090-44ef-a731-c3a35c8338bc tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] 10.222.0.43 "GET /compute/v2.1/servers/2d229458-6857-4662-ad59-30770808e2a1" status: 200 len: 1503 microversion: 2.1 time: 0.807978 Oct 04 18:43:10.400161 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1394/2924] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:09 2022] GET /compute/v2.1/servers/2d229458-6857-4662-ad59-30770808e2a1 => generated 1503 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:10.418659 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-88cf197e-7693-4799-89ec-4aa912107f12 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:10.419600 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-88cf197e-7693-4799-89ec-4aa912107f12 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] [instance: d7f06829-6beb-4d35-ab81-c99f9dd3027d] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:10.458667 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-88cf197e-7693-4799-89ec-4aa912107f12 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:10.460457 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-88cf197e-7693-4799-89ec-4aa912107f12 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.029s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:10.463915 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-88cf197e-7693-4799-89ec-4aa912107f12 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:10.469255 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-88cf197e-7693-4799-89ec-4aa912107f12 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:10.471573 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-88cf197e-7693-4799-89ec-4aa912107f12 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:10.472347 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-88cf197e-7693-4799-89ec-4aa912107f12 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:10.563852 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-347ea0ab-adf3-417d-8253-0afae1c45020 tempest-SecurityGroupsTestAdminJSON-78164343 tempest-SecurityGroupsTestAdminJSON-78164343-project] 10.222.0.43 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 1.216176 Oct 04 18:43:10.564726 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1531/2925] 10.222.0.43 () {60 vars in 1180 bytes} [Tue Oct 4 18:43:09 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 1218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:43:10.570278 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-34825c4e-9d94-4293-a57e-21abff155ad0 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:10.571079 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-34825c4e-9d94-4293-a57e-21abff155ad0 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] [instance: bd12a90d-60fb-4627-9ea1-9e60a1565528] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:10.586209 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:43:10.587981 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-34825c4e-9d94-4293-a57e-21abff155ad0 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:10.594073 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-34825c4e-9d94-4293-a57e-21abff155ad0 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:10.594884 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-34825c4e-9d94-4293-a57e-21abff155ad0 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:10.596470 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-34825c4e-9d94-4293-a57e-21abff155ad0 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:10.597395 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-34825c4e-9d94-4293-a57e-21abff155ad0 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:10.597996 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-34825c4e-9d94-4293-a57e-21abff155ad0 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:10.818446 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-34825c4e-9d94-4293-a57e-21abff155ad0 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ee90610168a4d46b456d7a278991091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5419b9532d52479d8d99336b90ebe9ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:10.830377 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-34825c4e-9d94-4293-a57e-21abff155ad0 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] 10.222.0.43 "GET /compute/v2.1/servers/bd12a90d-60fb-4627-9ea1-9e60a1565528" status: 200 len: 1318 microversion: 2.1 time: 0.264051 Oct 04 18:43:10.831430 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1532/2926] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:10 2022] GET /compute/v2.1/servers/bd12a90d-60fb-4627-9ea1-9e60a1565528 => generated 1318 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:10.836760 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-7db6bab9-5f0d-4c0b-8029-df32bdaf0546 req-43869888-3e21-4066-b4d2-62816a0c029d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd12a90d-60fb-4627-9ea1-9e60a1565528", "name": "network-vif-plugged", "status": "completed", "tag": "9b8d3102-96fe-45fd-97e0-d7cd99f53ad0"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:43:10.853894 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-7db6bab9-5f0d-4c0b-8029-df32bdaf0546 req-43869888-3e21-4066-b4d2-62816a0c029d service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:10.854956 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-7db6bab9-5f0d-4c0b-8029-df32bdaf0546 req-43869888-3e21-4066-b4d2-62816a0c029d service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:10.855585 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-7db6bab9-5f0d-4c0b-8029-df32bdaf0546 req-43869888-3e21-4066-b4d2-62816a0c029d service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:10.870620 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-7db6bab9-5f0d-4c0b-8029-df32bdaf0546 req-43869888-3e21-4066-b4d2-62816a0c029d service nova] Creating event network-vif-plugged:9b8d3102-96fe-45fd-97e0-d7cd99f53ad0 for instance bd12a90d-60fb-4627-9ea1-9e60a1565528 on n-h1-851028-13 Oct 04 18:43:10.882921 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-7db6bab9-5f0d-4c0b-8029-df32bdaf0546 req-43869888-3e21-4066-b4d2-62816a0c029d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049991 Oct 04 18:43:10.884091 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1533/2927] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:43:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:43:10.893261 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-8e0cae7b-e805-4d09-98c6-52ef75493ffc tempest-SecurityGroupsTestAdminJSON-78164343 tempest-SecurityGroupsTestAdminJSON-78164343-project] Action: 'create', calling method: .version_select at 0x7fb21ec21af0>, body: {"security_group": {"name": "tempest-securitygroup-1464572388", "description": "tempest-description-1996303512"}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:43:11.103984 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-8e0cae7b-e805-4d09-98c6-52ef75493ffc tempest-SecurityGroupsTestAdminJSON-78164343 tempest-SecurityGroupsTestAdminJSON-78164343-project] 10.222.0.43 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 0.217628 Oct 04 18:43:11.104806 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1534/2928] 10.222.0.43 () {60 vars in 1180 bytes} [Tue Oct 4 18:43:10 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:43:11.185500 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-b9897e69-5aea-46e8-a49e-483ade037006 tempest-SecurityGroupsTestAdminJSON-892445791 tempest-SecurityGroupsTestAdminJSON-892445791-project-admin] Action: 'create', calling method: .version_select at 0x7fb21f146700>, body: {"security_group": {"name": "tempest-securitygroup-580916805", "description": "tempest-description-603235526"}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:43:11.453526 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-88cf197e-7693-4799-89ec-4aa912107f12 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96e7480de94c43909045ac1087e40cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6bd34bf5540ee95c8144f185eb22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:11.467413 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-88cf197e-7693-4799-89ec-4aa912107f12 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] 10.222.0.43 "GET /compute/v2.1/servers/d7f06829-6beb-4d35-ab81-c99f9dd3027d" status: 200 len: 1520 microversion: 2.1 time: 1.063285 Oct 04 18:43:11.468003 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1395/2929] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:10 2022] GET /compute/v2.1/servers/d7f06829-6beb-4d35-ab81-c99f9dd3027d => generated 1520 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:11.475725 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-b9897e69-5aea-46e8-a49e-483ade037006 tempest-SecurityGroupsTestAdminJSON-892445791 tempest-SecurityGroupsTestAdminJSON-892445791-project-admin] 10.222.0.43 "POST /compute/v2.1/os-security-groups" status: 200 len: 219 microversion: 2.1 time: 0.360246 Oct 04 18:43:11.476610 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1535/2930] 10.222.0.43 () {60 vars in 1180 bytes} [Tue Oct 4 18:43:11 2022] POST /compute/v2.1/os-security-groups => generated 219 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:43:11.481317 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-880ff114-5a05-4edd-a918-db0b5f1251fe tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:11.482796 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-880ff114-5a05-4edd-a918-db0b5f1251fe tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] [instance: 2d229458-6857-4662-ad59-30770808e2a1] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:11.493458 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-880ff114-5a05-4edd-a918-db0b5f1251fe tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:11.494143 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-880ff114-5a05-4edd-a918-db0b5f1251fe tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:11.494761 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-880ff114-5a05-4edd-a918-db0b5f1251fe tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:11.495636 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-880ff114-5a05-4edd-a918-db0b5f1251fe tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:11.496170 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-e7c1b67b-25df-40a6-9bb3-f6d96e464359 tempest-SecurityGroupsTestAdminJSON-892445791 tempest-SecurityGroupsTestAdminJSON-892445791-project-admin] Action: 'create', calling method: .version_select at 0x7fb21f834040>, body: {"security_group": {"name": "tempest-securitygroup-741918375", "description": "tempest-description-1077424227"}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:43:11.496446 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-880ff114-5a05-4edd-a918-db0b5f1251fe tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:11.497032 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-880ff114-5a05-4edd-a918-db0b5f1251fe tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:11.703427 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-880ff114-5a05-4edd-a918-db0b5f1251fe tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9971b5861f44c1a1da94eda0f8f02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f809b8ae704988961908bef0f3cb24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:11.721440 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-880ff114-5a05-4edd-a918-db0b5f1251fe tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] 10.222.0.43 "GET /compute/v2.1/servers/2d229458-6857-4662-ad59-30770808e2a1" status: 200 len: 1503 microversion: 2.1 time: 0.240359 Oct 04 18:43:11.721440 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1536/2931] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:11 2022] GET /compute/v2.1/servers/2d229458-6857-4662-ad59-30770808e2a1 => generated 1503 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:11.859308 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-6559411d-eba6-4cde-8bef-586a7b6c67d7 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:11.860950 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-6559411d-eba6-4cde-8bef-586a7b6c67d7 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] [instance: bd12a90d-60fb-4627-9ea1-9e60a1565528] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:11.868080 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6559411d-eba6-4cde-8bef-586a7b6c67d7 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:11.868213 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6559411d-eba6-4cde-8bef-586a7b6c67d7 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:11.868585 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6559411d-eba6-4cde-8bef-586a7b6c67d7 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:11.869326 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6559411d-eba6-4cde-8bef-586a7b6c67d7 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:11.873057 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6559411d-eba6-4cde-8bef-586a7b6c67d7 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:11.873057 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6559411d-eba6-4cde-8bef-586a7b6c67d7 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:12.020273 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-6559411d-eba6-4cde-8bef-586a7b6c67d7 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ee90610168a4d46b456d7a278991091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5419b9532d52479d8d99336b90ebe9ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:12.029344 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-6559411d-eba6-4cde-8bef-586a7b6c67d7 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] 10.222.0.43 "GET /compute/v2.1/servers/bd12a90d-60fb-4627-9ea1-9e60a1565528" status: 200 len: 1318 microversion: 2.1 time: 0.174184 Oct 04 18:43:12.030685 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1537/2932] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:11 2022] GET /compute/v2.1/servers/bd12a90d-60fb-4627-9ea1-9e60a1565528 => generated 1318 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:12.177462 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-e7c1b67b-25df-40a6-9bb3-f6d96e464359 tempest-SecurityGroupsTestAdminJSON-892445791 tempest-SecurityGroupsTestAdminJSON-892445791-project-admin] 10.222.0.43 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.684841 Oct 04 18:43:12.179854 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1396/2933] 10.222.0.43 () {60 vars in 1180 bytes} [Tue Oct 4 18:43:11 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:43:12.193638 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-eafc1b32-755e-4ee8-a761-0891206a67ed tempest-SecurityGroupsTestAdminJSON-892445791 tempest-SecurityGroupsTestAdminJSON-892445791-project-admin] Calling method '.version_select at 0x7fb21edac430>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:12.492008 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=44 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:43:12.496377 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-5209c09c-adc5-4011-9675-bc94ea05e49f tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:12.497295 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-5209c09c-adc5-4011-9675-bc94ea05e49f tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] [instance: d7f06829-6beb-4d35-ab81-c99f9dd3027d] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:12.513777 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5209c09c-adc5-4011-9675-bc94ea05e49f tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:12.515235 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5209c09c-adc5-4011-9675-bc94ea05e49f tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:12.516015 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5209c09c-adc5-4011-9675-bc94ea05e49f tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:12.518750 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5209c09c-adc5-4011-9675-bc94ea05e49f tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:12.521465 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5209c09c-adc5-4011-9675-bc94ea05e49f tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:12.522134 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5209c09c-adc5-4011-9675-bc94ea05e49f tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:12.879769 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-5209c09c-adc5-4011-9675-bc94ea05e49f tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96e7480de94c43909045ac1087e40cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6bd34bf5540ee95c8144f185eb22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:12.890409 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-5209c09c-adc5-4011-9675-bc94ea05e49f tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] 10.222.0.43 "GET /compute/v2.1/servers/d7f06829-6beb-4d35-ab81-c99f9dd3027d" status: 200 len: 1520 microversion: 2.1 time: 0.399162 Oct 04 18:43:12.920159 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1397/2934] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:12 2022] GET /compute/v2.1/servers/d7f06829-6beb-4d35-ab81-c99f9dd3027d => generated 1520 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:12.927352 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-e7608d6b-a75e-4fd5-8291-1016838b16e0 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:12.928235 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-e7608d6b-a75e-4fd5-8291-1016838b16e0 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] [instance: 2d229458-6857-4662-ad59-30770808e2a1] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:12.935729 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e7608d6b-a75e-4fd5-8291-1016838b16e0 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:12.936214 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e7608d6b-a75e-4fd5-8291-1016838b16e0 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:12.936871 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e7608d6b-a75e-4fd5-8291-1016838b16e0 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:12.937588 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e7608d6b-a75e-4fd5-8291-1016838b16e0 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:12.938204 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e7608d6b-a75e-4fd5-8291-1016838b16e0 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:12.938774 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e7608d6b-a75e-4fd5-8291-1016838b16e0 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:13.116618 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=31 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:43:13.267874 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-e7608d6b-a75e-4fd5-8291-1016838b16e0 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9971b5861f44c1a1da94eda0f8f02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f809b8ae704988961908bef0f3cb24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:13.277854 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-e7608d6b-a75e-4fd5-8291-1016838b16e0 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] 10.222.0.43 "GET /compute/v2.1/servers/2d229458-6857-4662-ad59-30770808e2a1" status: 200 len: 1503 microversion: 2.1 time: 0.354104 Oct 04 18:43:13.278447 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1398/2935] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:12 2022] GET /compute/v2.1/servers/2d229458-6857-4662-ad59-30770808e2a1 => generated 1503 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:13.289924 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-66802e48-76ff-43c9-b840-d5440acb0083 req-f37016a5-b233-4c57-8634-ed02be22c681 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0b19cd2-3133-4782-87d9-93f72979db40", "name": "network-vif-plugged", "status": "completed", "tag": "06fcd034-41cc-4794-96e8-fd6827d1c4f3"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:43:13.312364 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-66802e48-76ff-43c9-b840-d5440acb0083 req-f37016a5-b233-4c57-8634-ed02be22c681 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:13.312941 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-66802e48-76ff-43c9-b840-d5440acb0083 req-f37016a5-b233-4c57-8634-ed02be22c681 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:13.313625 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-66802e48-76ff-43c9-b840-d5440acb0083 req-f37016a5-b233-4c57-8634-ed02be22c681 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:13.327031 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-66802e48-76ff-43c9-b840-d5440acb0083 req-f37016a5-b233-4c57-8634-ed02be22c681 service nova] Creating event network-vif-plugged:06fcd034-41cc-4794-96e8-fd6827d1c4f3 for instance f0b19cd2-3133-4782-87d9-93f72979db40 on n-h1-851028-13 Oct 04 18:43:13.332562 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-66802e48-76ff-43c9-b840-d5440acb0083 req-f37016a5-b233-4c57-8634-ed02be22c681 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051794 Oct 04 18:43:13.336425 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1399/2936] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:43:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:43:13.342924 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-582fd836-8777-4c89-94e3-3cdcd002c761 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:13.343907 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-582fd836-8777-4c89-94e3-3cdcd002c761 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] [instance: bd12a90d-60fb-4627-9ea1-9e60a1565528] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:13.351042 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-582fd836-8777-4c89-94e3-3cdcd002c761 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:13.351801 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-582fd836-8777-4c89-94e3-3cdcd002c761 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:13.352399 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-582fd836-8777-4c89-94e3-3cdcd002c761 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:13.353369 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-582fd836-8777-4c89-94e3-3cdcd002c761 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:13.354092 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-582fd836-8777-4c89-94e3-3cdcd002c761 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:13.354694 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-582fd836-8777-4c89-94e3-3cdcd002c761 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:13.373701 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=19 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:43:13.786332 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-582fd836-8777-4c89-94e3-3cdcd002c761 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ee90610168a4d46b456d7a278991091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5419b9532d52479d8d99336b90ebe9ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:13.802792 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-582fd836-8777-4c89-94e3-3cdcd002c761 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] 10.222.0.43 "GET /compute/v2.1/servers/bd12a90d-60fb-4627-9ea1-9e60a1565528" status: 200 len: 1505 microversion: 2.1 time: 0.464516 Oct 04 18:43:13.803797 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1400/2937] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:13 2022] GET /compute/v2.1/servers/bd12a90d-60fb-4627-9ea1-9e60a1565528 => generated 1505 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:13.810424 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-7c6f5324-ef8b-41cf-93eb-1b2bdbc490bb req-386f4db1-bd7c-4b21-ad48-419730d70710 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d229458-6857-4662-ad59-30770808e2a1", "name": "network-vif-unplugged", "status": "completed", "tag": "84b873b9-38f0-4a0b-975a-a315fbcad8ab"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:43:13.823104 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-7c6f5324-ef8b-41cf-93eb-1b2bdbc490bb req-386f4db1-bd7c-4b21-ad48-419730d70710 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:13.824204 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-7c6f5324-ef8b-41cf-93eb-1b2bdbc490bb req-386f4db1-bd7c-4b21-ad48-419730d70710 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:13.825930 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-7c6f5324-ef8b-41cf-93eb-1b2bdbc490bb req-386f4db1-bd7c-4b21-ad48-419730d70710 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:13.847194 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-7c6f5324-ef8b-41cf-93eb-1b2bdbc490bb req-386f4db1-bd7c-4b21-ad48-419730d70710 service nova] Creating event network-vif-unplugged:84b873b9-38f0-4a0b-975a-a315fbcad8ab for instance 2d229458-6857-4662-ad59-30770808e2a1 on n-h1-851028-13 Oct 04 18:43:13.852505 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-7c6f5324-ef8b-41cf-93eb-1b2bdbc490bb req-386f4db1-bd7c-4b21-ad48-419730d70710 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047046 Oct 04 18:43:13.853413 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1401/2938] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:43:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:43:13.858855 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-8219b338-ea28-4a11-bb1d-b15e70abedda tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:13.859805 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-8219b338-ea28-4a11-bb1d-b15e70abedda tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] [instance: f0b19cd2-3133-4782-87d9-93f72979db40] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:13.868395 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8219b338-ea28-4a11-bb1d-b15e70abedda tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:13.869359 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8219b338-ea28-4a11-bb1d-b15e70abedda tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:13.869990 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8219b338-ea28-4a11-bb1d-b15e70abedda tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:13.870919 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8219b338-ea28-4a11-bb1d-b15e70abedda tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:13.871575 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8219b338-ea28-4a11-bb1d-b15e70abedda tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:13.872159 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8219b338-ea28-4a11-bb1d-b15e70abedda tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:13.898078 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:43:14.228330 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-8219b338-ea28-4a11-bb1d-b15e70abedda tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ee90610168a4d46b456d7a278991091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5419b9532d52479d8d99336b90ebe9ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:14.237771 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-8219b338-ea28-4a11-bb1d-b15e70abedda tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] 10.222.0.43 "GET /compute/v2.1/servers/f0b19cd2-3133-4782-87d9-93f72979db40" status: 200 len: 1318 microversion: 2.1 time: 0.382704 Oct 04 18:43:14.238709 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1402/2939] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:13 2022] GET /compute/v2.1/servers/f0b19cd2-3133-4782-87d9-93f72979db40 => generated 1318 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:14.243919 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-13f0d570-abf6-4d50-9983-34a41b109738 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:14.244665 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-13f0d570-abf6-4d50-9983-34a41b109738 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 82b86465-afb0-49ef-9932-1538010c1ae5] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:14.253013 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-13f0d570-abf6-4d50-9983-34a41b109738 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:14.253618 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-13f0d570-abf6-4d50-9983-34a41b109738 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:14.254133 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-13f0d570-abf6-4d50-9983-34a41b109738 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:14.254915 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-13f0d570-abf6-4d50-9983-34a41b109738 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:14.255454 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-13f0d570-abf6-4d50-9983-34a41b109738 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:14.256020 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-13f0d570-abf6-4d50-9983-34a41b109738 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:14.417386 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-eafc1b32-755e-4ee8-a761-0891206a67ed tempest-SecurityGroupsTestAdminJSON-892445791 tempest-SecurityGroupsTestAdminJSON-892445791-project-admin] 10.222.0.43 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 11609 microversion: 2.1 time: 2.228239 Oct 04 18:43:14.418745 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1538/2940] 10.222.0.43 () {58 vars in 1191 bytes} [Tue Oct 4 18:43:12 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 11609 bytes in 2230 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:43:14.425080 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-558fae29-29b2-4f4c-b487-474a38ee1aa5 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:14.426074 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-558fae29-29b2-4f4c-b487-474a38ee1aa5 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] [instance: d7f06829-6beb-4d35-ab81-c99f9dd3027d] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:14.439923 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-558fae29-29b2-4f4c-b487-474a38ee1aa5 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:14.440437 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-558fae29-29b2-4f4c-b487-474a38ee1aa5 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:14.440858 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-558fae29-29b2-4f4c-b487-474a38ee1aa5 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:14.441601 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-558fae29-29b2-4f4c-b487-474a38ee1aa5 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:14.442048 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-558fae29-29b2-4f4c-b487-474a38ee1aa5 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:14.442475 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-558fae29-29b2-4f4c-b487-474a38ee1aa5 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:14.554893 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-13f0d570-abf6-4d50-9983-34a41b109738 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:14.565442 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-13f0d570-abf6-4d50-9983-34a41b109738 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5" status: 200 len: 1667 microversion: 2.1 time: 0.325236 Oct 04 18:43:14.566336 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1403/2941] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:14 2022] GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5 => generated 1667 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:14.571159 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-a5ec753e-8662-40e0-aa02-6dbdb8c5380c tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:14.572435 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-a5ec753e-8662-40e0-aa02-6dbdb8c5380c tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] [instance: 2d229458-6857-4662-ad59-30770808e2a1] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:14.580300 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a5ec753e-8662-40e0-aa02-6dbdb8c5380c tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:14.581229 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a5ec753e-8662-40e0-aa02-6dbdb8c5380c tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:14.582069 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a5ec753e-8662-40e0-aa02-6dbdb8c5380c tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:14.583141 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a5ec753e-8662-40e0-aa02-6dbdb8c5380c tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:14.583774 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a5ec753e-8662-40e0-aa02-6dbdb8c5380c tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:14.584408 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a5ec753e-8662-40e0-aa02-6dbdb8c5380c tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:14.609813 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-558fae29-29b2-4f4c-b487-474a38ee1aa5 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96e7480de94c43909045ac1087e40cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6bd34bf5540ee95c8144f185eb22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:14.618387 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-558fae29-29b2-4f4c-b487-474a38ee1aa5 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] 10.222.0.43 "GET /compute/v2.1/servers/d7f06829-6beb-4d35-ab81-c99f9dd3027d" status: 200 len: 1520 microversion: 2.1 time: 0.197879 Oct 04 18:43:14.618966 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1539/2942] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:14 2022] GET /compute/v2.1/servers/d7f06829-6beb-4d35-ab81-c99f9dd3027d => generated 1520 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:14.624670 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-6e57deb8-d086-49d4-951c-ca94e3fe982e tempest-SecurityGroupsTestAdminJSON-78164343 tempest-SecurityGroupsTestAdminJSON-78164343-project] Calling method '.version_select at 0x7fb21fd118b0>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:14.811698 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-6e57deb8-d086-49d4-951c-ca94e3fe982e tempest-SecurityGroupsTestAdminJSON-78164343 tempest-SecurityGroupsTestAdminJSON-78164343-project] 10.222.0.43 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1112 microversion: 2.1 time: 0.191644 Oct 04 18:43:14.812330 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1540/2943] 10.222.0.43 () {58 vars in 1191 bytes} [Tue Oct 4 18:43:14 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1112 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:14.817252 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-e8ee8a33-40ed-4ac0-a868-b9308fcee174 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-620640908"}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:43:14.819879 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-e8ee8a33-40ed-4ac0-a868-b9308fcee174 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 82b86465-afb0-49ef-9932-1538010c1ae5] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:14.827316 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e8ee8a33-40ed-4ac0-a868-b9308fcee174 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:14.827977 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e8ee8a33-40ed-4ac0-a868-b9308fcee174 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:14.828428 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e8ee8a33-40ed-4ac0-a868-b9308fcee174 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:14.829227 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e8ee8a33-40ed-4ac0-a868-b9308fcee174 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:14.829684 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e8ee8a33-40ed-4ac0-a868-b9308fcee174 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:14.830111 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e8ee8a33-40ed-4ac0-a868-b9308fcee174 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:15.050860 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-e8ee8a33-40ed-4ac0-a868-b9308fcee174 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "POST /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5/action" status: 202 len: 0 microversion: 2.1 time: 0.237071 Oct 04 18:43:15.056595 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1541/2944] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 18:43:14 2022] POST /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5/action => generated 0 bytes in 239 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Oct 04 18:43:15.057714 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-3e583703-e9cd-47e6-ac19-7e1e30adf6fd tempest-SecurityGroupsTestAdminJSON-892445791 tempest-SecurityGroupsTestAdminJSON-892445791-project-admin] Calling method '.version_select at 0x7fb224556820>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:15.188808 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-a5ec753e-8662-40e0-aa02-6dbdb8c5380c tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9971b5861f44c1a1da94eda0f8f02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f809b8ae704988961908bef0f3cb24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:15.202919 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-a5ec753e-8662-40e0-aa02-6dbdb8c5380c tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] 10.222.0.43 "GET /compute/v2.1/servers/2d229458-6857-4662-ad59-30770808e2a1" status: 200 len: 1503 microversion: 2.1 time: 0.635346 Oct 04 18:43:15.204470 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1404/2945] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:14 2022] GET /compute/v2.1/servers/2d229458-6857-4662-ad59-30770808e2a1 => generated 1503 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:15.263290 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-5ae6b8c0-56be-49ad-b54a-ce4c4ca2adc5 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:15.263964 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-5ae6b8c0-56be-49ad-b54a-ce4c4ca2adc5 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] [instance: f0b19cd2-3133-4782-87d9-93f72979db40] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:15.265031 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-3e583703-e9cd-47e6-ac19-7e1e30adf6fd tempest-SecurityGroupsTestAdminJSON-892445791 tempest-SecurityGroupsTestAdminJSON-892445791-project-admin] 10.222.0.43 "DELETE /compute/v2.1/os-security-groups/41a64e50-220e-494e-8dda-b81ad4f67a60" status: 202 len: 0 microversion: 2.1 time: 0.212149 Oct 04 18:43:15.265876 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1542/2946] 10.222.0.43 () {58 vars in 1272 bytes} [Tue Oct 4 18:43:15 2022] DELETE /compute/v2.1/os-security-groups/41a64e50-220e-494e-8dda-b81ad4f67a60 => generated 0 bytes in 214 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:43:15.274785 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-c768e74b-3e7a-4d5b-9350-a8ec4557bf03 tempest-SecurityGroupsTestAdminJSON-892445791 tempest-SecurityGroupsTestAdminJSON-892445791-project-admin] Calling method '.version_select at 0x7fb21eb2cee0>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:15.275070 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5ae6b8c0-56be-49ad-b54a-ce4c4ca2adc5 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:15.275996 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5ae6b8c0-56be-49ad-b54a-ce4c4ca2adc5 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:15.276485 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5ae6b8c0-56be-49ad-b54a-ce4c4ca2adc5 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:15.277776 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5ae6b8c0-56be-49ad-b54a-ce4c4ca2adc5 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:15.278248 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5ae6b8c0-56be-49ad-b54a-ce4c4ca2adc5 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:15.279082 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5ae6b8c0-56be-49ad-b54a-ce4c4ca2adc5 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:15.459892 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-c768e74b-3e7a-4d5b-9350-a8ec4557bf03 tempest-SecurityGroupsTestAdminJSON-892445791 tempest-SecurityGroupsTestAdminJSON-892445791-project-admin] 10.222.0.43 "DELETE /compute/v2.1/os-security-groups/2a6a2d6f-58b0-4275-8fa2-380d3d7b27dc" status: 202 len: 0 microversion: 2.1 time: 0.189199 Oct 04 18:43:15.468175 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1543/2947] 10.222.0.43 () {58 vars in 1272 bytes} [Tue Oct 4 18:43:15 2022] DELETE /compute/v2.1/os-security-groups/2a6a2d6f-58b0-4275-8fa2-380d3d7b27dc => generated 0 bytes in 198 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:43:15.474219 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-d815ea8f-a3e1-4f1a-ac86-3ff1fb2853f6 tempest-SecurityGroupsTestAdminJSON-78164343 tempest-SecurityGroupsTestAdminJSON-78164343-project] Calling method '.version_select at 0x7fb227d6d9d0>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:15.539610 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-5ae6b8c0-56be-49ad-b54a-ce4c4ca2adc5 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ee90610168a4d46b456d7a278991091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5419b9532d52479d8d99336b90ebe9ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:15.549025 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-5ae6b8c0-56be-49ad-b54a-ce4c4ca2adc5 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] 10.222.0.43 "GET /compute/v2.1/servers/f0b19cd2-3133-4782-87d9-93f72979db40" status: 200 len: 1318 microversion: 2.1 time: 0.290657 Oct 04 18:43:15.550437 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1405/2948] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:15 2022] GET /compute/v2.1/servers/f0b19cd2-3133-4782-87d9-93f72979db40 => generated 1318 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:15.643403 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-2ef23d85-ba3e-47f5-ba15-0bdfdda5322b tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:15.644281 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-2ef23d85-ba3e-47f5-ba15-0bdfdda5322b tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] [instance: d7f06829-6beb-4d35-ab81-c99f9dd3027d] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:15.650666 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2ef23d85-ba3e-47f5-ba15-0bdfdda5322b tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:15.651156 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2ef23d85-ba3e-47f5-ba15-0bdfdda5322b tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:15.651589 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2ef23d85-ba3e-47f5-ba15-0bdfdda5322b tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:15.652464 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2ef23d85-ba3e-47f5-ba15-0bdfdda5322b tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:15.653082 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2ef23d85-ba3e-47f5-ba15-0bdfdda5322b tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:15.654078 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2ef23d85-ba3e-47f5-ba15-0bdfdda5322b tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:15.692207 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-d815ea8f-a3e1-4f1a-ac86-3ff1fb2853f6 tempest-SecurityGroupsTestAdminJSON-78164343 tempest-SecurityGroupsTestAdminJSON-78164343-project] 10.222.0.43 "DELETE /compute/v2.1/os-security-groups/b4333d9d-f354-4328-9ea0-551379712f5a" status: 202 len: 0 microversion: 2.1 time: 0.222592 Oct 04 18:43:15.692794 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1544/2949] 10.222.0.43 () {58 vars in 1272 bytes} [Tue Oct 4 18:43:15 2022] DELETE /compute/v2.1/os-security-groups/b4333d9d-f354-4328-9ea0-551379712f5a => generated 0 bytes in 224 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:43:15.702643 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-9afd32e1-8d6a-42b3-94fa-629364e670c4 tempest-SecurityGroupsTestAdminJSON-78164343 tempest-SecurityGroupsTestAdminJSON-78164343-project] Calling method '.version_select at 0x7fb21fd041f0>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:15.905102 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-9afd32e1-8d6a-42b3-94fa-629364e670c4 tempest-SecurityGroupsTestAdminJSON-78164343 tempest-SecurityGroupsTestAdminJSON-78164343-project] 10.222.0.43 "DELETE /compute/v2.1/os-security-groups/0fca2625-677f-4b83-81ea-b2e2a913d129" status: 202 len: 0 microversion: 2.1 time: 0.207342 Oct 04 18:43:15.907664 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-2ef23d85-ba3e-47f5-ba15-0bdfdda5322b tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96e7480de94c43909045ac1087e40cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6bd34bf5540ee95c8144f185eb22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:15.912656 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1545/2950] 10.222.0.43 () {58 vars in 1272 bytes} [Tue Oct 4 18:43:15 2022] DELETE /compute/v2.1/os-security-groups/0fca2625-677f-4b83-81ea-b2e2a913d129 => generated 0 bytes in 215 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 18:43:15.918380 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-05d9eec7-7dca-4c04-8dc3-719cf709e9e7 req-ebb7f2d9-9b7d-4356-b384-81ca53b264fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d229458-6857-4662-ad59-30770808e2a1", "tag": "84b873b9-38f0-4a0b-975a-a315fbcad8ab"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:43:15.936114 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-2ef23d85-ba3e-47f5-ba15-0bdfdda5322b tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] 10.222.0.43 "GET /compute/v2.1/servers/d7f06829-6beb-4d35-ab81-c99f9dd3027d" status: 200 len: 1520 microversion: 2.1 time: 0.296418 Oct 04 18:43:15.939399 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1406/2951] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:15 2022] GET /compute/v2.1/servers/d7f06829-6beb-4d35-ab81-c99f9dd3027d => generated 1520 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:15.946526 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-05d9eec7-7dca-4c04-8dc3-719cf709e9e7 req-ebb7f2d9-9b7d-4356-b384-81ca53b264fe service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:15.947124 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-05d9eec7-7dca-4c04-8dc3-719cf709e9e7 req-ebb7f2d9-9b7d-4356-b384-81ca53b264fe service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:15.947669 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-05d9eec7-7dca-4c04-8dc3-719cf709e9e7 req-ebb7f2d9-9b7d-4356-b384-81ca53b264fe service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:15.959912 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-05d9eec7-7dca-4c04-8dc3-719cf709e9e7 req-ebb7f2d9-9b7d-4356-b384-81ca53b264fe service nova] Creating event network-changed:84b873b9-38f0-4a0b-975a-a315fbcad8ab for instance 2d229458-6857-4662-ad59-30770808e2a1 on n-h1-851028-13 Oct 04 18:43:15.965684 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-05d9eec7-7dca-4c04-8dc3-719cf709e9e7 req-ebb7f2d9-9b7d-4356-b384-81ca53b264fe service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051711 Oct 04 18:43:15.966706 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1546/2952] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:43:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:43:16.228010 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-8bde7611-de75-4c9a-8aea-2a4ad71830f0 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:16.228582 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-8bde7611-de75-4c9a-8aea-2a4ad71830f0 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] [instance: 2d229458-6857-4662-ad59-30770808e2a1] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:16.235757 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8bde7611-de75-4c9a-8aea-2a4ad71830f0 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:16.236351 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8bde7611-de75-4c9a-8aea-2a4ad71830f0 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:16.236903 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8bde7611-de75-4c9a-8aea-2a4ad71830f0 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:16.237807 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8bde7611-de75-4c9a-8aea-2a4ad71830f0 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:16.238372 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8bde7611-de75-4c9a-8aea-2a4ad71830f0 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:16.238901 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8bde7611-de75-4c9a-8aea-2a4ad71830f0 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:16.578393 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-81833500-2791-4e3a-b44f-f2abad2b28aa tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:16.579809 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-81833500-2791-4e3a-b44f-f2abad2b28aa tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] [instance: f0b19cd2-3133-4782-87d9-93f72979db40] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:16.597144 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-81833500-2791-4e3a-b44f-f2abad2b28aa tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:16.597647 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-81833500-2791-4e3a-b44f-f2abad2b28aa tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:16.598132 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-81833500-2791-4e3a-b44f-f2abad2b28aa tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:16.598925 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-81833500-2791-4e3a-b44f-f2abad2b28aa tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:16.599415 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-81833500-2791-4e3a-b44f-f2abad2b28aa tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:16.599855 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-81833500-2791-4e3a-b44f-f2abad2b28aa tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:16.606751 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-8bde7611-de75-4c9a-8aea-2a4ad71830f0 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9971b5861f44c1a1da94eda0f8f02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f809b8ae704988961908bef0f3cb24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:16.618417 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-8bde7611-de75-4c9a-8aea-2a4ad71830f0 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] 10.222.0.43 "GET /compute/v2.1/servers/2d229458-6857-4662-ad59-30770808e2a1" status: 200 len: 1503 microversion: 2.1 time: 0.394247 Oct 04 18:43:16.630039 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1407/2953] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:16 2022] GET /compute/v2.1/servers/2d229458-6857-4662-ad59-30770808e2a1 => generated 1503 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:16.762556 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-81833500-2791-4e3a-b44f-f2abad2b28aa tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ee90610168a4d46b456d7a278991091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5419b9532d52479d8d99336b90ebe9ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:16.772341 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-81833500-2791-4e3a-b44f-f2abad2b28aa tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] 10.222.0.43 "GET /compute/v2.1/servers/f0b19cd2-3133-4782-87d9-93f72979db40" status: 200 len: 1506 microversion: 2.1 time: 0.199251 Oct 04 18:43:16.772948 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1547/2954] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:16 2022] GET /compute/v2.1/servers/f0b19cd2-3133-4782-87d9-93f72979db40 => generated 1506 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:16.797570 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-fe7e6556-7b77-4e89-8fff-b3d3225294e4 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:16.798337 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-fe7e6556-7b77-4e89-8fff-b3d3225294e4 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] [instance: f0b19cd2-3133-4782-87d9-93f72979db40] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:16.805104 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fe7e6556-7b77-4e89-8fff-b3d3225294e4 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:16.805619 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fe7e6556-7b77-4e89-8fff-b3d3225294e4 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:16.806064 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fe7e6556-7b77-4e89-8fff-b3d3225294e4 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:16.806785 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fe7e6556-7b77-4e89-8fff-b3d3225294e4 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:16.807237 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fe7e6556-7b77-4e89-8fff-b3d3225294e4 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:16.807784 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fe7e6556-7b77-4e89-8fff-b3d3225294e4 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:16.840647 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-fe7e6556-7b77-4e89-8fff-b3d3225294e4 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] [instance: f0b19cd2-3133-4782-87d9-93f72979db40] Going to try to terminate instance {{(pid=123595) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:43:16.934358 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-fe7e6556-7b77-4e89-8fff-b3d3225294e4 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] 10.222.0.43 "DELETE /compute/v2.1/servers/f0b19cd2-3133-4782-87d9-93f72979db40" status: 204 len: 0 microversion: 2.1 time: 0.140217 Oct 04 18:43:16.935936 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1408/2955] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 18:43:16 2022] DELETE /compute/v2.1/servers/f0b19cd2-3133-4782-87d9-93f72979db40 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:43:16.944994 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-ee925159-2621-4218-934a-450161c0877c tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:16.945559 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-ee925159-2621-4218-934a-450161c0877c tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] [instance: bd12a90d-60fb-4627-9ea1-9e60a1565528] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:16.954637 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ee925159-2621-4218-934a-450161c0877c tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:16.955463 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ee925159-2621-4218-934a-450161c0877c tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:16.956282 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ee925159-2621-4218-934a-450161c0877c tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:16.957478 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ee925159-2621-4218-934a-450161c0877c tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:16.961841 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ee925159-2621-4218-934a-450161c0877c tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:16.962263 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ee925159-2621-4218-934a-450161c0877c tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:16.966653 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-ac9d5820-1f3e-4e1e-a662-221995f87090 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:16.967595 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-ac9d5820-1f3e-4e1e-a662-221995f87090 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] [instance: d7f06829-6beb-4d35-ab81-c99f9dd3027d] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:16.973826 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=2,nova_api:UPDATE=1 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:43:16.975683 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ac9d5820-1f3e-4e1e-a662-221995f87090 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:16.977005 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ac9d5820-1f3e-4e1e-a662-221995f87090 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:16.977482 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ac9d5820-1f3e-4e1e-a662-221995f87090 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:16.978524 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ac9d5820-1f3e-4e1e-a662-221995f87090 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:16.979103 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ac9d5820-1f3e-4e1e-a662-221995f87090 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:16.980245 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ac9d5820-1f3e-4e1e-a662-221995f87090 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:16.994854 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-ee925159-2621-4218-934a-450161c0877c tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] [instance: bd12a90d-60fb-4627-9ea1-9e60a1565528] Going to try to terminate instance {{(pid=123596) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:43:17.082954 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-ee925159-2621-4218-934a-450161c0877c tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] 10.222.0.43 "DELETE /compute/v2.1/servers/bd12a90d-60fb-4627-9ea1-9e60a1565528" status: 204 len: 0 microversion: 2.1 time: 0.142223 Oct 04 18:43:17.083556 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1548/2956] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 18:43:16 2022] DELETE /compute/v2.1/servers/bd12a90d-60fb-4627-9ea1-9e60a1565528 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:43:17.092974 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-98a4ac4c-ef5e-493a-ac56-22d801afecf5 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:17.093744 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-98a4ac4c-ef5e-493a-ac56-22d801afecf5 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] [instance: f0b19cd2-3133-4782-87d9-93f72979db40] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:17.099686 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-98a4ac4c-ef5e-493a-ac56-22d801afecf5 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:17.100452 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-98a4ac4c-ef5e-493a-ac56-22d801afecf5 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:17.100614 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-98a4ac4c-ef5e-493a-ac56-22d801afecf5 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:17.101467 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-98a4ac4c-ef5e-493a-ac56-22d801afecf5 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:17.101924 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-98a4ac4c-ef5e-493a-ac56-22d801afecf5 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:17.102435 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-98a4ac4c-ef5e-493a-ac56-22d801afecf5 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:17.247674 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-98a4ac4c-ef5e-493a-ac56-22d801afecf5 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ee90610168a4d46b456d7a278991091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5419b9532d52479d8d99336b90ebe9ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:17.256399 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-98a4ac4c-ef5e-493a-ac56-22d801afecf5 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] 10.222.0.43 "GET /compute/v2.1/servers/f0b19cd2-3133-4782-87d9-93f72979db40" status: 200 len: 1512 microversion: 2.1 time: 0.168515 Oct 04 18:43:17.257588 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1549/2957] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:17 2022] GET /compute/v2.1/servers/f0b19cd2-3133-4782-87d9-93f72979db40 => generated 1512 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:43:17.354144 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-ac9d5820-1f3e-4e1e-a662-221995f87090 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96e7480de94c43909045ac1087e40cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6bd34bf5540ee95c8144f185eb22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:17.366855 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-ac9d5820-1f3e-4e1e-a662-221995f87090 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] 10.222.0.43 "GET /compute/v2.1/servers/d7f06829-6beb-4d35-ab81-c99f9dd3027d" status: 200 len: 1520 microversion: 2.1 time: 0.404385 Oct 04 18:43:17.381519 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1409/2958] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:16 2022] GET /compute/v2.1/servers/d7f06829-6beb-4d35-ab81-c99f9dd3027d => generated 1520 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:43:17.645963 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-56c29933-f912-4ffb-acc9-7395412f3955 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:17.646632 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-56c29933-f912-4ffb-acc9-7395412f3955 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] [instance: 2d229458-6857-4662-ad59-30770808e2a1] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:17.657419 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-56c29933-f912-4ffb-acc9-7395412f3955 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:17.658488 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-56c29933-f912-4ffb-acc9-7395412f3955 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:17.659373 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-56c29933-f912-4ffb-acc9-7395412f3955 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:17.660458 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-56c29933-f912-4ffb-acc9-7395412f3955 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:17.661034 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-56c29933-f912-4ffb-acc9-7395412f3955 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:17.661626 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-56c29933-f912-4ffb-acc9-7395412f3955 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:17.862117 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-56c29933-f912-4ffb-acc9-7395412f3955 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9971b5861f44c1a1da94eda0f8f02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f809b8ae704988961908bef0f3cb24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:17.870176 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-56c29933-f912-4ffb-acc9-7395412f3955 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] 10.222.0.43 "GET /compute/v2.1/servers/2d229458-6857-4662-ad59-30770808e2a1" status: 200 len: 1503 microversion: 2.1 time: 0.228587 Oct 04 18:43:17.870892 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1550/2959] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:17 2022] GET /compute/v2.1/servers/2d229458-6857-4662-ad59-30770808e2a1 => generated 1503 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:18.280694 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-206d1d0d-0463-4cec-9b0e-ab799d05f646 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:18.281708 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-206d1d0d-0463-4cec-9b0e-ab799d05f646 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] [instance: f0b19cd2-3133-4782-87d9-93f72979db40] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:18.288563 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-206d1d0d-0463-4cec-9b0e-ab799d05f646 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:18.290417 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-206d1d0d-0463-4cec-9b0e-ab799d05f646 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:18.290860 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-206d1d0d-0463-4cec-9b0e-ab799d05f646 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:18.292582 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-206d1d0d-0463-4cec-9b0e-ab799d05f646 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:18.297992 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-206d1d0d-0463-4cec-9b0e-ab799d05f646 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:18.298446 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-206d1d0d-0463-4cec-9b0e-ab799d05f646 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:18.322139 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-cb2cf449-7f64-4d16-8714-27d90569a73b req-f4227b59-9148-4e99-8bc6-66c4463e9764 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82b86465-afb0-49ef-9932-1538010c1ae5", "name": "network-vif-unplugged", "status": "completed", "tag": "7e7a43a5-3a15-49a6-b50e-0ac0ac9faa8d"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:43:18.343864 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-cb2cf449-7f64-4d16-8714-27d90569a73b req-f4227b59-9148-4e99-8bc6-66c4463e9764 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:18.344622 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-cb2cf449-7f64-4d16-8714-27d90569a73b req-f4227b59-9148-4e99-8bc6-66c4463e9764 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:18.345800 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-cb2cf449-7f64-4d16-8714-27d90569a73b req-f4227b59-9148-4e99-8bc6-66c4463e9764 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:18.362656 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-cb2cf449-7f64-4d16-8714-27d90569a73b req-f4227b59-9148-4e99-8bc6-66c4463e9764 service nova] Creating event network-vif-unplugged:7e7a43a5-3a15-49a6-b50e-0ac0ac9faa8d for instance 82b86465-afb0-49ef-9932-1538010c1ae5 on n-h2-851028-13 Oct 04 18:43:18.384302 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-cb2cf449-7f64-4d16-8714-27d90569a73b req-f4227b59-9148-4e99-8bc6-66c4463e9764 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.065658 Oct 04 18:43:18.384964 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1551/2960] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:43:18 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:43:18.395022 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-bb0633a8-c7c7-4745-a0a3-60c8f81dd95b tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:18.395655 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-bb0633a8-c7c7-4745-a0a3-60c8f81dd95b tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] [instance: d7f06829-6beb-4d35-ab81-c99f9dd3027d] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:18.402407 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bb0633a8-c7c7-4745-a0a3-60c8f81dd95b tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:18.402914 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bb0633a8-c7c7-4745-a0a3-60c8f81dd95b tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:18.403448 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bb0633a8-c7c7-4745-a0a3-60c8f81dd95b tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:18.404224 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bb0633a8-c7c7-4745-a0a3-60c8f81dd95b tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:18.404691 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bb0633a8-c7c7-4745-a0a3-60c8f81dd95b tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:18.405142 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bb0633a8-c7c7-4745-a0a3-60c8f81dd95b tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:18.482011 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-206d1d0d-0463-4cec-9b0e-ab799d05f646 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ee90610168a4d46b456d7a278991091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5419b9532d52479d8d99336b90ebe9ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:18.490803 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-206d1d0d-0463-4cec-9b0e-ab799d05f646 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] 10.222.0.43 "GET /compute/v2.1/servers/f0b19cd2-3133-4782-87d9-93f72979db40" status: 200 len: 1512 microversion: 2.1 time: 0.214478 Oct 04 18:43:18.513520 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1410/2961] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:18 2022] GET /compute/v2.1/servers/f0b19cd2-3133-4782-87d9-93f72979db40 => generated 1512 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:18.700829 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-bb0633a8-c7c7-4745-a0a3-60c8f81dd95b tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96e7480de94c43909045ac1087e40cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6bd34bf5540ee95c8144f185eb22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:18.710704 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-bb0633a8-c7c7-4745-a0a3-60c8f81dd95b tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] 10.222.0.43 "GET /compute/v2.1/servers/d7f06829-6beb-4d35-ab81-c99f9dd3027d" status: 200 len: 1520 microversion: 2.1 time: 0.323900 Oct 04 18:43:18.711311 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1552/2962] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:18 2022] GET /compute/v2.1/servers/d7f06829-6beb-4d35-ab81-c99f9dd3027d => generated 1520 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:18.894935 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-5c5bdf62-93ba-486c-bb9d-7b33b79d36a2 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:18.895973 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-5c5bdf62-93ba-486c-bb9d-7b33b79d36a2 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] [instance: 2d229458-6857-4662-ad59-30770808e2a1] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:18.904318 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5c5bdf62-93ba-486c-bb9d-7b33b79d36a2 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:18.905154 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5c5bdf62-93ba-486c-bb9d-7b33b79d36a2 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:18.905835 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5c5bdf62-93ba-486c-bb9d-7b33b79d36a2 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:18.907097 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5c5bdf62-93ba-486c-bb9d-7b33b79d36a2 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:18.907765 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5c5bdf62-93ba-486c-bb9d-7b33b79d36a2 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:18.908398 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5c5bdf62-93ba-486c-bb9d-7b33b79d36a2 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:19.187082 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-5c5bdf62-93ba-486c-bb9d-7b33b79d36a2 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9971b5861f44c1a1da94eda0f8f02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f809b8ae704988961908bef0f3cb24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:19.195240 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-5c5bdf62-93ba-486c-bb9d-7b33b79d36a2 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] 10.222.0.43 "GET /compute/v2.1/servers/2d229458-6857-4662-ad59-30770808e2a1" status: 200 len: 1503 microversion: 2.1 time: 0.304224 Oct 04 18:43:19.196316 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1411/2963] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:18 2022] GET /compute/v2.1/servers/2d229458-6857-4662-ad59-30770808e2a1 => generated 1503 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:19.317082 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-3773f4de-c8e3-4b97-b71c-c3b7a60b5811 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-329110963", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452"}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:43:19.377119 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.network.neutron [None req-3773f4de-c8e3-4b97-b71c-c3b7a60b5811 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] validate_networks() for None {{(pid=123596) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:43:19.520861 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-54a406fe-4960-4992-908a-2be02d7999cc tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:19.521572 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-54a406fe-4960-4992-908a-2be02d7999cc tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] [instance: f0b19cd2-3133-4782-87d9-93f72979db40] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:19.527979 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-54a406fe-4960-4992-908a-2be02d7999cc tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:19.529303 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-54a406fe-4960-4992-908a-2be02d7999cc tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:19.529934 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-54a406fe-4960-4992-908a-2be02d7999cc tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:19.530843 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-54a406fe-4960-4992-908a-2be02d7999cc tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:19.531309 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-54a406fe-4960-4992-908a-2be02d7999cc tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:19.531746 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-54a406fe-4960-4992-908a-2be02d7999cc tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:19.721958 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-3773f4de-c8e3-4b97-b71c-c3b7a60b5811 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Flavor limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:43:19.722452 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-3773f4de-c8e3-4b97-b71c-c3b7a60b5811 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Image limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:43:19.723041 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-3773f4de-c8e3-4b97-b71c-c3b7a60b5811 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Flavor pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:43:19.723460 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-3773f4de-c8e3-4b97-b71c-c3b7a60b5811 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Image pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:43:19.723881 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-3773f4de-c8e3-4b97-b71c-c3b7a60b5811 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:43:19.735794 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3773f4de-c8e3-4b97-b71c-c3b7a60b5811 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:19.736276 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3773f4de-c8e3-4b97-b71c-c3b7a60b5811 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:19.736741 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3773f4de-c8e3-4b97-b71c-c3b7a60b5811 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:19.737505 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3773f4de-c8e3-4b97-b71c-c3b7a60b5811 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:19.738156 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3773f4de-c8e3-4b97-b71c-c3b7a60b5811 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:19.738370 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3773f4de-c8e3-4b97-b71c-c3b7a60b5811 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:19.757925 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-3773f4de-c8e3-4b97-b71c-c3b7a60b5811 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Getting quotas for project 29876d6805924df882d6861b0f6ab4f0. Resources: {'ram', 'cores', 'instances'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:43:19.763309 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-3773f4de-c8e3-4b97-b71c-c3b7a60b5811 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Getting quotas for user 608fc9ed7cdb487c9bf4b783c26ceeb6 and project 29876d6805924df882d6861b0f6ab4f0. Resources: {'ram', 'cores', 'instances'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:43:19.780435 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-3773f4de-c8e3-4b97-b71c-c3b7a60b5811 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Going to run 1 instances... {{(pid=123596) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:43:19.782072 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-54a406fe-4960-4992-908a-2be02d7999cc tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ee90610168a4d46b456d7a278991091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5419b9532d52479d8d99336b90ebe9ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:19.782811 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-3773f4de-c8e3-4b97-b71c-c3b7a60b5811 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] [instance: cf78a645-458e-4dc2-a60d-a51754ab6258] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e8943ec5-4038-4d4b-b9b9-2415a79f5243',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123596) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:43:19.795199 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-54a406fe-4960-4992-908a-2be02d7999cc tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] 10.222.0.43 "GET /compute/v2.1/servers/f0b19cd2-3133-4782-87d9-93f72979db40" status: 200 len: 1512 microversion: 2.1 time: 0.277306 Oct 04 18:43:19.796446 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1412/2964] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:19 2022] GET /compute/v2.1/servers/f0b19cd2-3133-4782-87d9-93f72979db40 => generated 1512 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:43:19.801729 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-48c2fa97-bcf4-439a-8ddc-ded17d0d29d5 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:19.802594 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-48c2fa97-bcf4-439a-8ddc-ded17d0d29d5 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] [instance: d7f06829-6beb-4d35-ab81-c99f9dd3027d] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:19.809042 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-48c2fa97-bcf4-439a-8ddc-ded17d0d29d5 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:19.810258 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-48c2fa97-bcf4-439a-8ddc-ded17d0d29d5 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:19.811065 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-48c2fa97-bcf4-439a-8ddc-ded17d0d29d5 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:19.812199 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-48c2fa97-bcf4-439a-8ddc-ded17d0d29d5 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:19.812927 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-48c2fa97-bcf4-439a-8ddc-ded17d0d29d5 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:19.813582 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-48c2fa97-bcf4-439a-8ddc-ded17d0d29d5 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:19.841090 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-3773f4de-c8e3-4b97-b71c-c3b7a60b5811 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.665250 Oct 04 18:43:19.841973 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1553/2965] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 18:43:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 667 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 18:43:19.852886 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-47257e94-6113-4585-9fd9-5693521e382b tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:19.860506 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-47257e94-6113-4585-9fd9-5693521e382b tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b2df20485e3d4c75b2f4fc7375adebb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f379b9ce44d942959b67137e546191c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:19.861827 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-47257e94-6113-4585-9fd9-5693521e382b tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Searching by: {'deleted': False, 'project_id': 'f379b9ce44d942959b67137e546191c3'} {{(pid=123596) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:43:19.870058 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-47257e94-6113-4585-9fd9-5693521e382b tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:19.872678 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-47257e94-6113-4585-9fd9-5693521e382b tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:19.873953 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-47257e94-6113-4585-9fd9-5693521e382b tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:19.874920 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-47257e94-6113-4585-9fd9-5693521e382b tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:19.876075 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-47257e94-6113-4585-9fd9-5693521e382b tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:19.876441 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-47257e94-6113-4585-9fd9-5693521e382b tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:19.931881 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.multi_cell_list [None req-47257e94-6113-4585-9fd9-5693521e382b tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=123596) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 18:43:19.975948 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-47257e94-6113-4585-9fd9-5693521e382b tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] 10.222.0.43 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.129564 Oct 04 18:43:19.978206 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1554/2966] 10.222.0.43 () {58 vars in 1125 bytes} [Tue Oct 4 18:43:19 2022] GET /compute/v2.1/servers => generated 343 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:43:19.983346 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-c2062e36-f298-46e2-9668-77f32d1a5e34 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-817220962", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452"}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:43:20.056509 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.network.neutron [None req-c2062e36-f298-46e2-9668-77f32d1a5e34 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] validate_networks() for None {{(pid=123596) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:43:20.066058 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-48c2fa97-bcf4-439a-8ddc-ded17d0d29d5 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96e7480de94c43909045ac1087e40cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6bd34bf5540ee95c8144f185eb22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:20.078303 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-48c2fa97-bcf4-439a-8ddc-ded17d0d29d5 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] 10.222.0.43 "GET /compute/v2.1/servers/d7f06829-6beb-4d35-ab81-c99f9dd3027d" status: 200 len: 1520 microversion: 2.1 time: 0.280728 Oct 04 18:43:20.080030 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1413/2967] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:19 2022] GET /compute/v2.1/servers/d7f06829-6beb-4d35-ab81-c99f9dd3027d => generated 1520 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:20.097384 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-c34403b6-9f0e-4422-aed5-f20b26619acc tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:20.103905 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-c34403b6-9f0e-4422-aed5-f20b26619acc tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b2df20485e3d4c75b2f4fc7375adebb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f379b9ce44d942959b67137e546191c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:20.104833 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-c34403b6-9f0e-4422-aed5-f20b26619acc tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Searching by: {'deleted': False, 'project_id': 'f379b9ce44d942959b67137e546191c3'} {{(pid=123595) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:43:20.110645 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c34403b6-9f0e-4422-aed5-f20b26619acc tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:20.111125 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c34403b6-9f0e-4422-aed5-f20b26619acc tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:20.111719 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c34403b6-9f0e-4422-aed5-f20b26619acc tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:20.112477 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c34403b6-9f0e-4422-aed5-f20b26619acc tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:20.113352 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c34403b6-9f0e-4422-aed5-f20b26619acc tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:20.113906 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c34403b6-9f0e-4422-aed5-f20b26619acc tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:20.145434 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.multi_cell_list [None req-c34403b6-9f0e-4422-aed5-f20b26619acc tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=123595) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 18:43:20.204993 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-c34403b6-9f0e-4422-aed5-f20b26619acc tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2df20485e3d4c75b2f4fc7375adebb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f379b9ce44d942959b67137e546191c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:20.211826 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c34403b6-9f0e-4422-aed5-f20b26619acc tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:20.212768 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c34403b6-9f0e-4422-aed5-f20b26619acc tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:20.215381 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c34403b6-9f0e-4422-aed5-f20b26619acc tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:20.351051 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-c2062e36-f298-46e2-9668-77f32d1a5e34 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Flavor limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:43:20.351855 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-c2062e36-f298-46e2-9668-77f32d1a5e34 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Image limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:43:20.353436 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-c2062e36-f298-46e2-9668-77f32d1a5e34 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Flavor pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:43:20.354044 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-c2062e36-f298-46e2-9668-77f32d1a5e34 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Image pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:43:20.354649 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-c2062e36-f298-46e2-9668-77f32d1a5e34 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:43:20.366843 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c2062e36-f298-46e2-9668-77f32d1a5e34 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:20.367391 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c2062e36-f298-46e2-9668-77f32d1a5e34 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:20.368233 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c2062e36-f298-46e2-9668-77f32d1a5e34 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:20.369144 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c2062e36-f298-46e2-9668-77f32d1a5e34 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:20.370611 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c2062e36-f298-46e2-9668-77f32d1a5e34 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:20.371495 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c2062e36-f298-46e2-9668-77f32d1a5e34 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:20.403058 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-c2062e36-f298-46e2-9668-77f32d1a5e34 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Getting quotas for project 29876d6805924df882d6861b0f6ab4f0. Resources: {'ram', 'cores', 'instances'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:43:20.411501 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-c2062e36-f298-46e2-9668-77f32d1a5e34 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Getting quotas for user 608fc9ed7cdb487c9bf4b783c26ceeb6 and project 29876d6805924df882d6861b0f6ab4f0. Resources: {'ram', 'cores', 'instances'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:43:20.432224 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-c2062e36-f298-46e2-9668-77f32d1a5e34 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Going to run 1 instances... {{(pid=123596) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:43:20.439163 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-c2062e36-f298-46e2-9668-77f32d1a5e34 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] [instance: 601869a4-7b03-4c37-acb2-a7f8a94e3f26] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e8943ec5-4038-4d4b-b9b9-2415a79f5243',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123596) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:43:20.458084 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-c34403b6-9f0e-4422-aed5-f20b26619acc tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] 10.222.0.43 "GET /compute/v2.1/servers/detail" status: 200 len: 1605 microversion: 2.1 time: 0.376636 Oct 04 18:43:20.458691 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1414/2968] 10.222.0.43 () {58 vars in 1146 bytes} [Tue Oct 4 18:43:20 2022] GET /compute/v2.1/servers/detail => generated 1605 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:20.464081 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-133055ec-a929-4ccb-b4a7-15153eda23d4 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:20.464903 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-133055ec-a929-4ccb-b4a7-15153eda23d4 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] [instance: 2d229458-6857-4662-ad59-30770808e2a1] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:20.483889 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-133055ec-a929-4ccb-b4a7-15153eda23d4 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:20.484455 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-133055ec-a929-4ccb-b4a7-15153eda23d4 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:20.484976 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-133055ec-a929-4ccb-b4a7-15153eda23d4 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:20.485886 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-133055ec-a929-4ccb-b4a7-15153eda23d4 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:20.491546 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-133055ec-a929-4ccb-b4a7-15153eda23d4 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:20.493753 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-133055ec-a929-4ccb-b4a7-15153eda23d4 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:20.570097 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-c2062e36-f298-46e2-9668-77f32d1a5e34 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.590742 Oct 04 18:43:20.573204 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1555/2969] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 18:43:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 594 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:43:20.588137 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f49b0bfe-ff60-4afb-bbe1-0602b665fa20 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:20.613820 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-f49b0bfe-ff60-4afb-bbe1-0602b665fa20 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] 10.222.0.43 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.038499 Oct 04 18:43:20.614839 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1556/2970] 10.222.0.43 () {58 vars in 1137 bytes} [Tue Oct 4 18:43:20 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:43:20.625971 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-436a67f5-5018-4705-8562-ed6f4808c2ee tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:20.634003 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-436a67f5-5018-4705-8562-ed6f4808c2ee tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] [instance: 601869a4-7b03-4c37-acb2-a7f8a94e3f26] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:20.789277 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-436a67f5-5018-4705-8562-ed6f4808c2ee tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608fc9ed7cdb487c9bf4b783c26ceeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29876d6805924df882d6861b0f6ab4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:20.810195 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-436a67f5-5018-4705-8562-ed6f4808c2ee tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] 10.222.0.43 "GET /compute/v2.1/servers/601869a4-7b03-4c37-acb2-a7f8a94e3f26" status: 200 len: 1213 microversion: 2.1 time: 0.193121 Oct 04 18:43:20.811119 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1557/2971] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:20 2022] GET /compute/v2.1/servers/601869a4-7b03-4c37-acb2-a7f8a94e3f26 => generated 1213 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:20.820164 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-001f5075-17d4-43fb-a6b8-cbe562364a3e req-4d837555-e4d8-46bb-a2cd-24e22e19a39c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82b86465-afb0-49ef-9932-1538010c1ae5", "name": "network-vif-plugged", "status": "completed", "tag": "7e7a43a5-3a15-49a6-b50e-0ac0ac9faa8d"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:43:20.836429 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-001f5075-17d4-43fb-a6b8-cbe562364a3e req-4d837555-e4d8-46bb-a2cd-24e22e19a39c service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:20.838201 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-001f5075-17d4-43fb-a6b8-cbe562364a3e req-4d837555-e4d8-46bb-a2cd-24e22e19a39c service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:20.838977 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-001f5075-17d4-43fb-a6b8-cbe562364a3e req-4d837555-e4d8-46bb-a2cd-24e22e19a39c service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:20.847805 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:43:20.860825 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-001f5075-17d4-43fb-a6b8-cbe562364a3e req-4d837555-e4d8-46bb-a2cd-24e22e19a39c service nova] Creating event network-vif-plugged:7e7a43a5-3a15-49a6-b50e-0ac0ac9faa8d for instance 82b86465-afb0-49ef-9932-1538010c1ae5 on n-h2-851028-13 Oct 04 18:43:20.871396 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-001f5075-17d4-43fb-a6b8-cbe562364a3e req-4d837555-e4d8-46bb-a2cd-24e22e19a39c service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057961 Oct 04 18:43:20.872877 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1558/2972] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:43:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:43:20.879821 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-51850faf-86e2-4135-a956-19d9da5ee115 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:20.881248 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-51850faf-86e2-4135-a956-19d9da5ee115 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] [instance: f0b19cd2-3133-4782-87d9-93f72979db40] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:20.905844 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-51850faf-86e2-4135-a956-19d9da5ee115 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:20.906346 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-51850faf-86e2-4135-a956-19d9da5ee115 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:20.906805 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-51850faf-86e2-4135-a956-19d9da5ee115 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:20.910897 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-51850faf-86e2-4135-a956-19d9da5ee115 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:20.913370 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-51850faf-86e2-4135-a956-19d9da5ee115 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:20.915406 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-51850faf-86e2-4135-a956-19d9da5ee115 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:21.101739 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-133055ec-a929-4ccb-b4a7-15153eda23d4 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9971b5861f44c1a1da94eda0f8f02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f809b8ae704988961908bef0f3cb24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:21.113019 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-133055ec-a929-4ccb-b4a7-15153eda23d4 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] 10.222.0.43 "GET /compute/v2.1/servers/2d229458-6857-4662-ad59-30770808e2a1" status: 200 len: 1503 microversion: 2.1 time: 0.653270 Oct 04 18:43:21.118593 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1415/2973] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:20 2022] GET /compute/v2.1/servers/2d229458-6857-4662-ad59-30770808e2a1 => generated 1503 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:21.128211 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-19588e12-21ad-4ccd-aa9f-1c67e60b23ea tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:21.131486 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-19588e12-21ad-4ccd-aa9f-1c67e60b23ea tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] [instance: d7f06829-6beb-4d35-ab81-c99f9dd3027d] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:21.144209 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-19588e12-21ad-4ccd-aa9f-1c67e60b23ea tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:21.149945 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-19588e12-21ad-4ccd-aa9f-1c67e60b23ea tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:21.150650 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-19588e12-21ad-4ccd-aa9f-1c67e60b23ea tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:21.151599 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-19588e12-21ad-4ccd-aa9f-1c67e60b23ea tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:21.152315 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-19588e12-21ad-4ccd-aa9f-1c67e60b23ea tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:21.152946 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-19588e12-21ad-4ccd-aa9f-1c67e60b23ea tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:21.211253 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-51850faf-86e2-4135-a956-19d9da5ee115 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ee90610168a4d46b456d7a278991091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5419b9532d52479d8d99336b90ebe9ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:21.229819 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-51850faf-86e2-4135-a956-19d9da5ee115 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] 10.222.0.43 "GET /compute/v2.1/servers/f0b19cd2-3133-4782-87d9-93f72979db40" status: 200 len: 1512 microversion: 2.1 time: 0.354973 Oct 04 18:43:21.231080 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1559/2974] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:20 2022] GET /compute/v2.1/servers/f0b19cd2-3133-4782-87d9-93f72979db40 => generated 1512 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:21.239792 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-b10ea393-b392-42dd-94f2-dc8156b131c2 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:21.240705 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-b10ea393-b392-42dd-94f2-dc8156b131c2 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] [instance: cbae126b-e99a-4c70-a9e7-0921a41e01ca] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:21.251862 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b10ea393-b392-42dd-94f2-dc8156b131c2 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:21.253075 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b10ea393-b392-42dd-94f2-dc8156b131c2 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:21.253838 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b10ea393-b392-42dd-94f2-dc8156b131c2 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:21.259661 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b10ea393-b392-42dd-94f2-dc8156b131c2 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:21.260463 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b10ea393-b392-42dd-94f2-dc8156b131c2 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:21.261027 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b10ea393-b392-42dd-94f2-dc8156b131c2 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:21.324050 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-b10ea393-b392-42dd-94f2-dc8156b131c2 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] [instance: cbae126b-e99a-4c70-a9e7-0921a41e01ca] Going to try to terminate instance {{(pid=123596) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:43:21.510604 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-b10ea393-b392-42dd-94f2-dc8156b131c2 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] 10.222.0.43 "DELETE /compute/v2.1/servers/cbae126b-e99a-4c70-a9e7-0921a41e01ca" status: 204 len: 0 microversion: 2.1 time: 0.275887 Oct 04 18:43:21.511226 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1560/2975] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 18:43:21 2022] DELETE /compute/v2.1/servers/cbae126b-e99a-4c70-a9e7-0921a41e01ca => generated 0 bytes in 280 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:43:21.532720 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-44543789-28be-44fd-a584-03bce306c50f tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:21.533469 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-44543789-28be-44fd-a584-03bce306c50f tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] [instance: cbae126b-e99a-4c70-a9e7-0921a41e01ca] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:21.552468 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-44543789-28be-44fd-a584-03bce306c50f tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:21.553066 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-44543789-28be-44fd-a584-03bce306c50f tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:21.553618 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-44543789-28be-44fd-a584-03bce306c50f tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:21.554342 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-44543789-28be-44fd-a584-03bce306c50f tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:21.555020 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-44543789-28be-44fd-a584-03bce306c50f tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:21.555468 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-44543789-28be-44fd-a584-03bce306c50f tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:21.955107 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-44543789-28be-44fd-a584-03bce306c50f tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2df20485e3d4c75b2f4fc7375adebb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f379b9ce44d942959b67137e546191c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:21.970860 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-44543789-28be-44fd-a584-03bce306c50f tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] 10.222.0.43 "GET /compute/v2.1/servers/cbae126b-e99a-4c70-a9e7-0921a41e01ca" status: 200 len: 1608 microversion: 2.1 time: 0.452374 Oct 04 18:43:21.972172 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1561/2976] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:21 2022] GET /compute/v2.1/servers/cbae126b-e99a-4c70-a9e7-0921a41e01ca => generated 1608 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:21.978266 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-25d50f21-fa9f-4376-859d-54572c9cadb3 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:21.979235 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-25d50f21-fa9f-4376-859d-54572c9cadb3 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] [instance: 601869a4-7b03-4c37-acb2-a7f8a94e3f26] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:21.996363 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-25d50f21-fa9f-4376-859d-54572c9cadb3 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:21.996861 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-25d50f21-fa9f-4376-859d-54572c9cadb3 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:21.997455 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-25d50f21-fa9f-4376-859d-54572c9cadb3 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:21.998223 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-25d50f21-fa9f-4376-859d-54572c9cadb3 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:21.998647 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-25d50f21-fa9f-4376-859d-54572c9cadb3 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:21.999156 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-25d50f21-fa9f-4376-859d-54572c9cadb3 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:22.062878 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-19588e12-21ad-4ccd-aa9f-1c67e60b23ea tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96e7480de94c43909045ac1087e40cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6bd34bf5540ee95c8144f185eb22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:22.065135 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:43:22.096835 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-19588e12-21ad-4ccd-aa9f-1c67e60b23ea tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] 10.222.0.43 "GET /compute/v2.1/servers/d7f06829-6beb-4d35-ab81-c99f9dd3027d" status: 200 len: 1520 microversion: 2.1 time: 0.976452 Oct 04 18:43:22.097736 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1416/2977] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:21 2022] GET /compute/v2.1/servers/d7f06829-6beb-4d35-ab81-c99f9dd3027d => generated 1520 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:22.138603 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-25d50f21-fa9f-4376-859d-54572c9cadb3 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608fc9ed7cdb487c9bf4b783c26ceeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29876d6805924df882d6861b0f6ab4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:22.148183 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-f24d0b9b-eac9-4c5d-a9f7-8584bfecc536 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:22.148931 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-f24d0b9b-eac9-4c5d-a9f7-8584bfecc536 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] [instance: 2d229458-6857-4662-ad59-30770808e2a1] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:22.151682 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-25d50f21-fa9f-4376-859d-54572c9cadb3 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] 10.222.0.43 "GET /compute/v2.1/servers/601869a4-7b03-4c37-acb2-a7f8a94e3f26" status: 200 len: 1217 microversion: 2.1 time: 0.177932 Oct 04 18:43:22.153650 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1562/2978] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:21 2022] GET /compute/v2.1/servers/601869a4-7b03-4c37-acb2-a7f8a94e3f26 => generated 1217 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:22.176386 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f24d0b9b-eac9-4c5d-a9f7-8584bfecc536 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:22.182903 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f24d0b9b-eac9-4c5d-a9f7-8584bfecc536 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:22.183609 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f24d0b9b-eac9-4c5d-a9f7-8584bfecc536 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:22.185247 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f24d0b9b-eac9-4c5d-a9f7-8584bfecc536 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:22.185966 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f24d0b9b-eac9-4c5d-a9f7-8584bfecc536 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:22.186890 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f24d0b9b-eac9-4c5d-a9f7-8584bfecc536 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:22.259385 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-780dedef-bfd7-48d4-ab46-e790ee1747d0 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:22.260012 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-780dedef-bfd7-48d4-ab46-e790ee1747d0 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] [instance: f0b19cd2-3133-4782-87d9-93f72979db40] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:22.276851 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-780dedef-bfd7-48d4-ab46-e790ee1747d0 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:22.279590 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-780dedef-bfd7-48d4-ab46-e790ee1747d0 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:22.281343 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-780dedef-bfd7-48d4-ab46-e790ee1747d0 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:22.285134 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-780dedef-bfd7-48d4-ab46-e790ee1747d0 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:22.286079 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-780dedef-bfd7-48d4-ab46-e790ee1747d0 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:22.288467 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-780dedef-bfd7-48d4-ab46-e790ee1747d0 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:22.847121 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-780dedef-bfd7-48d4-ab46-e790ee1747d0 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ee90610168a4d46b456d7a278991091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5419b9532d52479d8d99336b90ebe9ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:22.857708 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-780dedef-bfd7-48d4-ab46-e790ee1747d0 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] 10.222.0.43 "GET /compute/v2.1/servers/f0b19cd2-3133-4782-87d9-93f72979db40" status: 200 len: 1512 microversion: 2.1 time: 0.600545 Oct 04 18:43:22.858934 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1563/2979] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:22 2022] GET /compute/v2.1/servers/f0b19cd2-3133-4782-87d9-93f72979db40 => generated 1512 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:43:22.930196 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-f24d0b9b-eac9-4c5d-a9f7-8584bfecc536 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9971b5861f44c1a1da94eda0f8f02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f809b8ae704988961908bef0f3cb24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:22.948402 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-f24d0b9b-eac9-4c5d-a9f7-8584bfecc536 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] 10.222.0.43 "GET /compute/v2.1/servers/2d229458-6857-4662-ad59-30770808e2a1" status: 200 len: 1503 microversion: 2.1 time: 0.795689 Oct 04 18:43:22.949426 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1417/2980] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:22 2022] GET /compute/v2.1/servers/2d229458-6857-4662-ad59-30770808e2a1 => generated 1503 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:22.995888 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-36aaf503-d5b1-4615-b23a-b05765f15d6c tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:22.997431 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-36aaf503-d5b1-4615-b23a-b05765f15d6c tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] [instance: cbae126b-e99a-4c70-a9e7-0921a41e01ca] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:23.004474 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-36aaf503-d5b1-4615-b23a-b05765f15d6c tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:23.017915 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-36aaf503-d5b1-4615-b23a-b05765f15d6c tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:23.018673 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-36aaf503-d5b1-4615-b23a-b05765f15d6c tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:23.019640 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-36aaf503-d5b1-4615-b23a-b05765f15d6c tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:23.020285 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-36aaf503-d5b1-4615-b23a-b05765f15d6c tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:23.020980 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-36aaf503-d5b1-4615-b23a-b05765f15d6c tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:23.125937 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-18d06580-f26c-4338-bf17-74507839160c tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:23.126790 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-18d06580-f26c-4338-bf17-74507839160c tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] [instance: d7f06829-6beb-4d35-ab81-c99f9dd3027d] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:23.140343 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-18d06580-f26c-4338-bf17-74507839160c tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:23.141900 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-18d06580-f26c-4338-bf17-74507839160c tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:23.149982 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-18d06580-f26c-4338-bf17-74507839160c tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:23.151063 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-18d06580-f26c-4338-bf17-74507839160c tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:23.151947 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-18d06580-f26c-4338-bf17-74507839160c tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:23.152642 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-18d06580-f26c-4338-bf17-74507839160c tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:23.373927 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-36aaf503-d5b1-4615-b23a-b05765f15d6c tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2df20485e3d4c75b2f4fc7375adebb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f379b9ce44d942959b67137e546191c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:23.383969 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-36aaf503-d5b1-4615-b23a-b05765f15d6c tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] 10.222.0.43 "GET /compute/v2.1/servers/cbae126b-e99a-4c70-a9e7-0921a41e01ca" status: 200 len: 1608 microversion: 2.1 time: 0.391977 Oct 04 18:43:23.438553 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1564/2981] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:22 2022] GET /compute/v2.1/servers/cbae126b-e99a-4c70-a9e7-0921a41e01ca => generated 1608 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:23.444186 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-bde455b0-de2b-4e71-9a10-56f761a5652d tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:23.444875 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-bde455b0-de2b-4e71-9a10-56f761a5652d tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] [instance: 601869a4-7b03-4c37-acb2-a7f8a94e3f26] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:23.451691 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bde455b0-de2b-4e71-9a10-56f761a5652d tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:23.452189 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bde455b0-de2b-4e71-9a10-56f761a5652d tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:23.452719 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bde455b0-de2b-4e71-9a10-56f761a5652d tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:23.453489 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bde455b0-de2b-4e71-9a10-56f761a5652d tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:23.453846 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bde455b0-de2b-4e71-9a10-56f761a5652d tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:23.454280 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bde455b0-de2b-4e71-9a10-56f761a5652d tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:23.546931 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-bde455b0-de2b-4e71-9a10-56f761a5652d tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608fc9ed7cdb487c9bf4b783c26ceeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29876d6805924df882d6861b0f6ab4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:23.557488 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-bde455b0-de2b-4e71-9a10-56f761a5652d tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] 10.222.0.43 "GET /compute/v2.1/servers/601869a4-7b03-4c37-acb2-a7f8a94e3f26" status: 200 len: 1209 microversion: 2.1 time: 0.118556 Oct 04 18:43:23.558139 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1565/2982] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:23 2022] GET /compute/v2.1/servers/601869a4-7b03-4c37-acb2-a7f8a94e3f26 => generated 1209 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:23.799226 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-18d06580-f26c-4338-bf17-74507839160c tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96e7480de94c43909045ac1087e40cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6bd34bf5540ee95c8144f185eb22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:23.813424 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-18d06580-f26c-4338-bf17-74507839160c tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] 10.222.0.43 "GET /compute/v2.1/servers/d7f06829-6beb-4d35-ab81-c99f9dd3027d" status: 200 len: 1520 microversion: 2.1 time: 0.688936 Oct 04 18:43:23.815888 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1418/2983] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:23 2022] GET /compute/v2.1/servers/d7f06829-6beb-4d35-ab81-c99f9dd3027d => generated 1520 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:23.883705 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-67de8397-dd13-4805-b51f-d67bc1ab2350 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:23.884865 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-67de8397-dd13-4805-b51f-d67bc1ab2350 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] [instance: f0b19cd2-3133-4782-87d9-93f72979db40] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:23.903383 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-67de8397-dd13-4805-b51f-d67bc1ab2350 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:23.904172 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-67de8397-dd13-4805-b51f-d67bc1ab2350 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:23.906871 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-67de8397-dd13-4805-b51f-d67bc1ab2350 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:23.908443 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-67de8397-dd13-4805-b51f-d67bc1ab2350 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:23.910769 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-67de8397-dd13-4805-b51f-d67bc1ab2350 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:23.913802 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-67de8397-dd13-4805-b51f-d67bc1ab2350 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:23.976198 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-f600f882-6d89-4e53-89c2-c503f5c3ad3b tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:23.978248 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-f600f882-6d89-4e53-89c2-c503f5c3ad3b tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] [instance: 2d229458-6857-4662-ad59-30770808e2a1] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:23.997430 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f600f882-6d89-4e53-89c2-c503f5c3ad3b tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:24.000875 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f600f882-6d89-4e53-89c2-c503f5c3ad3b tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:24.001499 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f600f882-6d89-4e53-89c2-c503f5c3ad3b tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:24.003367 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f600f882-6d89-4e53-89c2-c503f5c3ad3b tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:24.006472 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f600f882-6d89-4e53-89c2-c503f5c3ad3b tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:24.007624 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f600f882-6d89-4e53-89c2-c503f5c3ad3b tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:24.311218 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-67de8397-dd13-4805-b51f-d67bc1ab2350 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ee90610168a4d46b456d7a278991091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5419b9532d52479d8d99336b90ebe9ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:24.338306 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-67de8397-dd13-4805-b51f-d67bc1ab2350 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] 10.222.0.43 "GET /compute/v2.1/servers/f0b19cd2-3133-4782-87d9-93f72979db40" status: 200 len: 1470 microversion: 2.1 time: 0.458599 Oct 04 18:43:24.346355 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1566/2984] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:23 2022] GET /compute/v2.1/servers/f0b19cd2-3133-4782-87d9-93f72979db40 => generated 1470 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:24.370058 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-8c4066e8-e410-4e91-aa98-460c718efcce req-7cc4ba69-aa7b-4441-ad5b-3f4db3533fe9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd12a90d-60fb-4627-9ea1-9e60a1565528", "name": "network-vif-deleted", "tag": "9b8d3102-96fe-45fd-97e0-d7cd99f53ad0"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:43:24.431583 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-8c4066e8-e410-4e91-aa98-460c718efcce req-7cc4ba69-aa7b-4441-ad5b-3f4db3533fe9 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:24.434998 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-8c4066e8-e410-4e91-aa98-460c718efcce req-7cc4ba69-aa7b-4441-ad5b-3f4db3533fe9 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:24.440408 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-8c4066e8-e410-4e91-aa98-460c718efcce req-7cc4ba69-aa7b-4441-ad5b-3f4db3533fe9 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:24.517234 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-8c4066e8-e410-4e91-aa98-460c718efcce req-7cc4ba69-aa7b-4441-ad5b-3f4db3533fe9 service nova] Creating event network-vif-deleted:9b8d3102-96fe-45fd-97e0-d7cd99f53ad0 for instance bd12a90d-60fb-4627-9ea1-9e60a1565528 on n-h1-851028-13 Oct 04 18:43:24.526537 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-8c4066e8-e410-4e91-aa98-460c718efcce req-7cc4ba69-aa7b-4441-ad5b-3f4db3533fe9 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.177730 Oct 04 18:43:24.528783 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1567/2985] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:43:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:43:24.552458 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-292c5dac-da3d-419c-a388-6f7032e31c8a tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:24.558856 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-292c5dac-da3d-419c-a388-6f7032e31c8a tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] [instance: cbae126b-e99a-4c70-a9e7-0921a41e01ca] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:24.596949 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-292c5dac-da3d-419c-a388-6f7032e31c8a tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:24.597505 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-292c5dac-da3d-419c-a388-6f7032e31c8a tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:24.599508 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-292c5dac-da3d-419c-a388-6f7032e31c8a tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:24.601726 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-292c5dac-da3d-419c-a388-6f7032e31c8a tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:24.603720 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-292c5dac-da3d-419c-a388-6f7032e31c8a tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:24.604170 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-292c5dac-da3d-419c-a388-6f7032e31c8a tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:24.906440 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-f600f882-6d89-4e53-89c2-c503f5c3ad3b tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9971b5861f44c1a1da94eda0f8f02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f809b8ae704988961908bef0f3cb24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:24.915393 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-f600f882-6d89-4e53-89c2-c503f5c3ad3b tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] 10.222.0.43 "GET /compute/v2.1/servers/2d229458-6857-4662-ad59-30770808e2a1" status: 200 len: 1503 microversion: 2.1 time: 0.944917 Oct 04 18:43:24.919704 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1419/2986] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:23 2022] GET /compute/v2.1/servers/2d229458-6857-4662-ad59-30770808e2a1 => generated 1503 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:43:24.939355 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-1ae12b7f-a76c-4443-aad5-8d63715ed3a3 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:24.940270 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-1ae12b7f-a76c-4443-aad5-8d63715ed3a3 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] [instance: 601869a4-7b03-4c37-acb2-a7f8a94e3f26] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:24.960304 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1ae12b7f-a76c-4443-aad5-8d63715ed3a3 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:24.962257 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1ae12b7f-a76c-4443-aad5-8d63715ed3a3 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:24.963589 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1ae12b7f-a76c-4443-aad5-8d63715ed3a3 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:24.964952 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1ae12b7f-a76c-4443-aad5-8d63715ed3a3 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:24.966615 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1ae12b7f-a76c-4443-aad5-8d63715ed3a3 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:24.968482 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1ae12b7f-a76c-4443-aad5-8d63715ed3a3 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:25.160590 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-292c5dac-da3d-419c-a388-6f7032e31c8a tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2df20485e3d4c75b2f4fc7375adebb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f379b9ce44d942959b67137e546191c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:25.172885 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-292c5dac-da3d-419c-a388-6f7032e31c8a tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] 10.222.0.43 "GET /compute/v2.1/servers/cbae126b-e99a-4c70-a9e7-0921a41e01ca" status: 200 len: 1608 microversion: 2.1 time: 0.641207 Oct 04 18:43:25.175125 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1568/2987] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:24 2022] GET /compute/v2.1/servers/cbae126b-e99a-4c70-a9e7-0921a41e01ca => generated 1608 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:25.194353 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-a6bf0238-6413-461a-b8ab-5c93b33583a9 req-d5b44d54-d7a9-4ab9-9f51-d284e23fbc56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbae126b-e99a-4c70-a9e7-0921a41e01ca", "name": "network-vif-unplugged", "status": "completed", "tag": "c406a273-b78c-4fe1-b66a-ad30e702c41b"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:43:25.212315 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:INSERT=6 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:43:25.217269 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-a6bf0238-6413-461a-b8ab-5c93b33583a9 req-d5b44d54-d7a9-4ab9-9f51-d284e23fbc56 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:25.218286 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-a6bf0238-6413-461a-b8ab-5c93b33583a9 req-d5b44d54-d7a9-4ab9-9f51-d284e23fbc56 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:25.220377 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-a6bf0238-6413-461a-b8ab-5c93b33583a9 req-d5b44d54-d7a9-4ab9-9f51-d284e23fbc56 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:25.249175 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-a6bf0238-6413-461a-b8ab-5c93b33583a9 req-d5b44d54-d7a9-4ab9-9f51-d284e23fbc56 service nova] Creating event network-vif-unplugged:c406a273-b78c-4fe1-b66a-ad30e702c41b for instance cbae126b-e99a-4c70-a9e7-0921a41e01ca on n-h2-851028-13 Oct 04 18:43:25.260969 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-a6bf0238-6413-461a-b8ab-5c93b33583a9 req-d5b44d54-d7a9-4ab9-9f51-d284e23fbc56 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.083081 Oct 04 18:43:25.268121 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1569/2988] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:43:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:43:25.283524 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-49fd421b-5266-4ae6-a24b-1fc07c615ded tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:25.285354 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-49fd421b-5266-4ae6-a24b-1fc07c615ded tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] [instance: d7f06829-6beb-4d35-ab81-c99f9dd3027d] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:25.308390 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-49fd421b-5266-4ae6-a24b-1fc07c615ded tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:25.315823 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-49fd421b-5266-4ae6-a24b-1fc07c615ded tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:25.316679 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-49fd421b-5266-4ae6-a24b-1fc07c615ded tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:25.317434 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-1ae12b7f-a76c-4443-aad5-8d63715ed3a3 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608fc9ed7cdb487c9bf4b783c26ceeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29876d6805924df882d6861b0f6ab4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:25.321860 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-49fd421b-5266-4ae6-a24b-1fc07c615ded tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:25.325083 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-49fd421b-5266-4ae6-a24b-1fc07c615ded tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:25.328265 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-49fd421b-5266-4ae6-a24b-1fc07c615ded tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:25.330452 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-1ae12b7f-a76c-4443-aad5-8d63715ed3a3 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] 10.222.0.43 "GET /compute/v2.1/servers/601869a4-7b03-4c37-acb2-a7f8a94e3f26" status: 200 len: 1265 microversion: 2.1 time: 0.406790 Oct 04 18:43:25.332099 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1420/2989] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:24 2022] GET /compute/v2.1/servers/601869a4-7b03-4c37-acb2-a7f8a94e3f26 => generated 1265 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:25.372304 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-da4bfd8f-84a5-411f-a9b2-ee2fef9f432c tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:25.373450 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-da4bfd8f-84a5-411f-a9b2-ee2fef9f432c tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] [instance: f0b19cd2-3133-4782-87d9-93f72979db40] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:25.386186 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-da4bfd8f-84a5-411f-a9b2-ee2fef9f432c tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:25.390665 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-da4bfd8f-84a5-411f-a9b2-ee2fef9f432c tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:25.394157 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-da4bfd8f-84a5-411f-a9b2-ee2fef9f432c tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:25.396907 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-da4bfd8f-84a5-411f-a9b2-ee2fef9f432c tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:25.401031 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-da4bfd8f-84a5-411f-a9b2-ee2fef9f432c tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:25.407084 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-da4bfd8f-84a5-411f-a9b2-ee2fef9f432c tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:25.513626 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-da4bfd8f-84a5-411f-a9b2-ee2fef9f432c tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:25.514061 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-da4bfd8f-84a5-411f-a9b2-ee2fef9f432c tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:25.514496 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-da4bfd8f-84a5-411f-a9b2-ee2fef9f432c tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:25.515000 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.objects.instance [None req-da4bfd8f-84a5-411f-a9b2-ee2fef9f432c tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lazy-loading 'fault' on Instance uuid f0b19cd2-3133-4782-87d9-93f72979db40 {{(pid=123595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:43:25.732009 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-da4bfd8f-84a5-411f-a9b2-ee2fef9f432c tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ee90610168a4d46b456d7a278991091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5419b9532d52479d8d99336b90ebe9ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:25.750120 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-da4bfd8f-84a5-411f-a9b2-ee2fef9f432c tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] 10.222.0.43 "GET /compute/v2.1/servers/f0b19cd2-3133-4782-87d9-93f72979db40" status: 200 len: 1308 microversion: 2.1 time: 0.377861 Oct 04 18:43:25.751280 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1421/2990] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:25 2022] GET /compute/v2.1/servers/f0b19cd2-3133-4782-87d9-93f72979db40 => generated 1308 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:43:25.947195 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-4c4e078b-64b8-4bf7-960c-c8dcdeeac8b1 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:25.950111 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-4c4e078b-64b8-4bf7-960c-c8dcdeeac8b1 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] [instance: 2d229458-6857-4662-ad59-30770808e2a1] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:25.967256 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-49fd421b-5266-4ae6-a24b-1fc07c615ded tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96e7480de94c43909045ac1087e40cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6bd34bf5540ee95c8144f185eb22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:25.971400 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4c4e078b-64b8-4bf7-960c-c8dcdeeac8b1 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:25.972724 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4c4e078b-64b8-4bf7-960c-c8dcdeeac8b1 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:25.973390 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4c4e078b-64b8-4bf7-960c-c8dcdeeac8b1 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:25.974263 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4c4e078b-64b8-4bf7-960c-c8dcdeeac8b1 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:25.974871 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4c4e078b-64b8-4bf7-960c-c8dcdeeac8b1 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:25.975825 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4c4e078b-64b8-4bf7-960c-c8dcdeeac8b1 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:25.978352 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-49fd421b-5266-4ae6-a24b-1fc07c615ded tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] 10.222.0.43 "GET /compute/v2.1/servers/d7f06829-6beb-4d35-ab81-c99f9dd3027d" status: 200 len: 1500 microversion: 2.1 time: 0.708707 Oct 04 18:43:25.980014 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1570/2991] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:25 2022] GET /compute/v2.1/servers/d7f06829-6beb-4d35-ab81-c99f9dd3027d => generated 1500 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:26.008838 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-69b0bb22-3472-4095-848c-3aa6d3f3e62e tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:26.009891 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-69b0bb22-3472-4095-848c-3aa6d3f3e62e tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] [instance: f726f3f3-4731-4380-9163-b2273b629810] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:26.021736 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-69b0bb22-3472-4095-848c-3aa6d3f3e62e tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:26.022651 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-69b0bb22-3472-4095-848c-3aa6d3f3e62e tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:26.024485 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-69b0bb22-3472-4095-848c-3aa6d3f3e62e tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:26.025521 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-69b0bb22-3472-4095-848c-3aa6d3f3e62e tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:26.026867 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-69b0bb22-3472-4095-848c-3aa6d3f3e62e tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:26.028935 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-69b0bb22-3472-4095-848c-3aa6d3f3e62e tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:26.423471 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-69b0bb22-3472-4095-848c-3aa6d3f3e62e tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96e7480de94c43909045ac1087e40cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6bd34bf5540ee95c8144f185eb22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:26.440095 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-69b0bb22-3472-4095-848c-3aa6d3f3e62e tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] 10.222.0.43 "GET /compute/v2.1/servers/f726f3f3-4731-4380-9163-b2273b629810" status: 200 len: 1514 microversion: 2.1 time: 0.435418 Oct 04 18:43:26.441735 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1571/2992] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:26 2022] GET /compute/v2.1/servers/f726f3f3-4731-4380-9163-b2273b629810 => generated 1514 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:26.457305 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-19be1ada-0201-4f27-83bc-13db34c2f018 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:26.458158 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-19be1ada-0201-4f27-83bc-13db34c2f018 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] [instance: cbae126b-e99a-4c70-a9e7-0921a41e01ca] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:26.467236 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-19be1ada-0201-4f27-83bc-13db34c2f018 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:26.467733 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-19be1ada-0201-4f27-83bc-13db34c2f018 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:26.468175 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-19be1ada-0201-4f27-83bc-13db34c2f018 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:26.468883 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-19be1ada-0201-4f27-83bc-13db34c2f018 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:26.473731 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-19be1ada-0201-4f27-83bc-13db34c2f018 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:26.474161 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-19be1ada-0201-4f27-83bc-13db34c2f018 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:26.595070 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-4c4e078b-64b8-4bf7-960c-c8dcdeeac8b1 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9971b5861f44c1a1da94eda0f8f02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f809b8ae704988961908bef0f3cb24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:26.624698 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-4c4e078b-64b8-4bf7-960c-c8dcdeeac8b1 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] 10.222.0.43 "GET /compute/v2.1/servers/2d229458-6857-4662-ad59-30770808e2a1" status: 200 len: 1503 microversion: 2.1 time: 0.683811 Oct 04 18:43:26.625686 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1422/2993] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:25 2022] GET /compute/v2.1/servers/2d229458-6857-4662-ad59-30770808e2a1 => generated 1503 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:43:26.664353 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-2ef2d718-afea-4958-9626-539cfdb5ba6a tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:26.667098 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-2ef2d718-afea-4958-9626-539cfdb5ba6a tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] [instance: 601869a4-7b03-4c37-acb2-a7f8a94e3f26] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:26.678625 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2ef2d718-afea-4958-9626-539cfdb5ba6a tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:26.679623 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2ef2d718-afea-4958-9626-539cfdb5ba6a tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:26.680325 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2ef2d718-afea-4958-9626-539cfdb5ba6a tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:26.682525 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2ef2d718-afea-4958-9626-539cfdb5ba6a tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:26.683223 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2ef2d718-afea-4958-9626-539cfdb5ba6a tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:26.683869 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2ef2d718-afea-4958-9626-539cfdb5ba6a tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:26.844099 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-2ef2d718-afea-4958-9626-539cfdb5ba6a tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608fc9ed7cdb487c9bf4b783c26ceeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29876d6805924df882d6861b0f6ab4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:26.857776 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-2ef2d718-afea-4958-9626-539cfdb5ba6a tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] 10.222.0.43 "GET /compute/v2.1/servers/601869a4-7b03-4c37-acb2-a7f8a94e3f26" status: 200 len: 1271 microversion: 2.1 time: 0.230570 Oct 04 18:43:26.858769 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1423/2994] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:26 2022] GET /compute/v2.1/servers/601869a4-7b03-4c37-acb2-a7f8a94e3f26 => generated 1271 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:26.877146 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-19be1ada-0201-4f27-83bc-13db34c2f018 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2df20485e3d4c75b2f4fc7375adebb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f379b9ce44d942959b67137e546191c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:26.879827 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-ca6f6030-25e6-4ef8-b1e8-d55d4d043e8c tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:43:26.890122 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-19be1ada-0201-4f27-83bc-13db34c2f018 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] 10.222.0.43 "GET /compute/v2.1/servers/cbae126b-e99a-4c70-a9e7-0921a41e01ca" status: 200 len: 1608 microversion: 2.1 time: 0.445562 Oct 04 18:43:26.890678 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-ca6f6030-25e6-4ef8-b1e8-d55d4d043e8c tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] [instance: 492cb290-6a40-4f48-9b4c-aa3a2b14d1da] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:26.891266 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1572/2995] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:26 2022] GET /compute/v2.1/servers/cbae126b-e99a-4c70-a9e7-0921a41e01ca => generated 1608 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:26.903682 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-ca6f6030-25e6-4ef8-b1e8-d55d4d043e8c tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] HTTP exception thrown: Instance 492cb290-6a40-4f48-9b4c-aa3a2b14d1da could not be found. Oct 04 18:43:26.908283 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-ee5666b3-d13f-42ac-bafd-b8bffe1e1d30 req-5706b2b1-8d4b-464d-b535-ab076607a5f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0b19cd2-3133-4782-87d9-93f72979db40", "name": "network-vif-deleted", "tag": "06fcd034-41cc-4794-96e8-fd6827d1c4f3"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:43:26.920958 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-ca6f6030-25e6-4ef8-b1e8-d55d4d043e8c tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Request method failure captured: Oct 04 18:43:26.920958 n-d-851028-13 devstack@n-api.service[123595]: request: POST /compute/v2.1/servers/492cb290-6a40-4f48-9b4c-aa3a2b14d1da/action HTTP/1.1 Oct 04 18:43:26.920958 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 18:43:26.920958 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 18:43:26.920958 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 18:43:26.920958 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 14 Oct 04 18:43:26.920958 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 18:43:26.920958 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 18:43:26.920958 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 18:43:26.920958 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 18:43:26.920958 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPH6ImUsc0v5avJaXbAf95n6vmfztxEtTiW32SRLH_bOmBbny3fOGIWm6DaSHmvRnWhZ-84faOFvXqXs-7dDoMftV5mgOWVN0Q9OrVISe3irL7FfmyYZmGssWLEuXGLXQhTtdNOFN9115Lqu5biPYPUWU74K-2mRSRsiih09WbGDmZQI Oct 04 18:43:26.920958 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 18:43:26.920958 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 18:43:26.920958 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 18:43:26.920958 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 18:43:26.920958 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 18:43:26.920958 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 18:43:26.920958 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: eda6bd34bf5540ee95c8144f185eb22d Oct 04 18:43:26.920958 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1155401912 Oct 04 18:43:26.920958 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 18:43:26.920958 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 18:43:26.920958 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/eda6bd34bf5540ee95c8144f185eb22d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_eda6bd34bf5540ee95c8144f185eb22d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/eda6bd34bf5540ee95c8144f185eb22d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/eda6bd34bf5540ee95c8144f185eb22d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:43:26.920958 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1155401912 Oct 04 18:43:26.920958 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: eda6bd34bf5540ee95c8144f185eb22d Oct 04 18:43:26.920958 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1155401912 Oct 04 18:43:26.920958 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-ServerRescueNegativeTestJSON-1155401912-project Oct 04 18:43:26.920958 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 18:43:26.920958 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 18:43:26.920958 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: 96e7480de94c43909045ac1087e40cd8 Oct 04 18:43:26.920958 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1155401912-project Oct 04 18:43:26.920958 n-d-851028-13 devstack@n-api.service[123595]: Oct 04 18:43:26.920958 n-d-851028-13 devstack@n-api.service[123595]: {"rescue": {}} Oct 04 18:43:26.920958 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 18:43:26.920958 n-d-851028-13 devstack@n-api.service[123595]: exception: Instance 492cb290-6a40-4f48-9b4c-aa3a2b14d1da could not be found. Oct 04 18:43:26.920958 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': '492cb290-6a40-4f48-9b4c-aa3a2b14d1da', 'body': {'rescue': {}}} Oct 04 18:43:26.920958 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:43:26.920958 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:43:26.920958 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:43:26.920958 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:43:26.920958 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:43:26.920958 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:43:26.920958 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 18:43:26.920958 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 18:43:26.920958 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 492cb290-6a40-4f48-9b4c-aa3a2b14d1da could not be found. Oct 04 18:43:26.920958 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:43:26.920958 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:43:26.920958 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:43:26.920958 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:43:26.920958 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:43:26.920958 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:43:26.920958 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:43:26.920958 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:43:26.920958 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:43:26.920958 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:43:26.920958 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:43:26.920958 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:43:26.920958 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 53, in _rescue Oct 04 18:43:26.920958 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 04 18:43:26.920958 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:43:26.920958 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:43:26.920958 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 492cb290-6a40-4f48-9b4c-aa3a2b14d1da could not be found. Oct 04 18:43:26.920958 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:43:26.920958 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:43:26.920958 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:43:26.920958 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:43:26.929909 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:43:26.929909 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:43:26.929909 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:43:26.929909 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:43:26.929909 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 492cb290-6a40-4f48-9b4c-aa3a2b14d1da could not be found. Oct 04 18:43:26.929909 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:43:26.929909 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-ca6f6030-25e6-4ef8-b1e8-d55d4d043e8c tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Returning 404 to user: Instance 492cb290-6a40-4f48-9b4c-aa3a2b14d1da could not be found. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:43:26.929909 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-ca6f6030-25e6-4ef8-b1e8-d55d4d043e8c tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] 10.222.0.43 "POST /compute/v2.1/servers/492cb290-6a40-4f48-9b4c-aa3a2b14d1da/action" status: 404 len: 111 microversion: 2.1 time: 0.049438 Oct 04 18:43:26.929909 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1424/2996] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 18:43:26 2022] POST /compute/v2.1/servers/492cb290-6a40-4f48-9b4c-aa3a2b14d1da/action => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:43:26.930493 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-ee5666b3-d13f-42ac-bafd-b8bffe1e1d30 req-5706b2b1-8d4b-464d-b535-ab076607a5f6 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:26.930493 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-ee5666b3-d13f-42ac-bafd-b8bffe1e1d30 req-5706b2b1-8d4b-464d-b535-ab076607a5f6 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:26.930493 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-ee5666b3-d13f-42ac-bafd-b8bffe1e1d30 req-5706b2b1-8d4b-464d-b535-ab076607a5f6 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:26.930873 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-8abc5852-9cc3-4960-9196-3fa04b40e378 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:26.931648 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-8abc5852-9cc3-4960-9196-3fa04b40e378 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] [instance: f0b19cd2-3133-4782-87d9-93f72979db40] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:26.947245 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-ee5666b3-d13f-42ac-bafd-b8bffe1e1d30 req-5706b2b1-8d4b-464d-b535-ab076607a5f6 service nova] Creating event network-vif-deleted:06fcd034-41cc-4794-96e8-fd6827d1c4f3 for instance f0b19cd2-3133-4782-87d9-93f72979db40 on n-h1-851028-13 Oct 04 18:43:26.949771 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8abc5852-9cc3-4960-9196-3fa04b40e378 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:26.950252 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8abc5852-9cc3-4960-9196-3fa04b40e378 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:26.950705 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8abc5852-9cc3-4960-9196-3fa04b40e378 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:26.951642 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8abc5852-9cc3-4960-9196-3fa04b40e378 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:26.952251 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8abc5852-9cc3-4960-9196-3fa04b40e378 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:26.952833 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8abc5852-9cc3-4960-9196-3fa04b40e378 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:26.959381 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-ee5666b3-d13f-42ac-bafd-b8bffe1e1d30 req-5706b2b1-8d4b-464d-b535-ab076607a5f6 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062326 Oct 04 18:43:26.960551 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1573/2997] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:43:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:43:26.969516 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-2d723cb5-7f8f-4c9c-b048-eb22ca8c1e4c tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:43:26.970432 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-2d723cb5-7f8f-4c9c-b048-eb22ca8c1e4c tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] [instance: f726f3f3-4731-4380-9163-b2273b629810] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:26.977841 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2d723cb5-7f8f-4c9c-b048-eb22ca8c1e4c tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:26.978805 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2d723cb5-7f8f-4c9c-b048-eb22ca8c1e4c tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:26.980163 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2d723cb5-7f8f-4c9c-b048-eb22ca8c1e4c tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:26.981806 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2d723cb5-7f8f-4c9c-b048-eb22ca8c1e4c tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:26.982497 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2d723cb5-7f8f-4c9c-b048-eb22ca8c1e4c tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:26.983126 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2d723cb5-7f8f-4c9c-b048-eb22ca8c1e4c tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:26.985609 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-8abc5852-9cc3-4960-9196-3fa04b40e378 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] HTTP exception thrown: Instance f0b19cd2-3133-4782-87d9-93f72979db40 could not be found. Oct 04 18:43:26.987181 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-8abc5852-9cc3-4960-9196-3fa04b40e378 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Request method failure captured: Oct 04 18:43:26.987181 n-d-851028-13 devstack@n-api.service[123595]: request: GET /compute/v2.1/servers/f0b19cd2-3133-4782-87d9-93f72979db40 HTTP/1.1 Oct 04 18:43:26.987181 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 18:43:26.987181 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 18:43:26.987181 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 18:43:26.987181 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 0 Oct 04 18:43:26.987181 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 18:43:26.987181 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 18:43:26.987181 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 18:43:26.987181 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 18:43:26.987181 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPH6NKn52JF1pLfS0S7BxcCDQy4HAMsavLf7xY8SKkUOXM3CwyaYS9wz-QMJC8RwMTS9cuk-V1C3JuHluurHKCURf4yKQJbEJDT69bRp31hD0R4m-NF0wJfBq89z9BAvwMul5ek92CDM1YLhz4volXmnRDp9TgBQENGZFixdMMbXzUJU Oct 04 18:43:26.987181 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 18:43:26.987181 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 18:43:26.987181 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 18:43:26.987181 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 18:43:26.987181 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 18:43:26.987181 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 18:43:26.987181 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: 5419b9532d52479d8d99336b90ebe9ae Oct 04 18:43:26.987181 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-MultipleCreateTestJSON-1215318955 Oct 04 18:43:26.987181 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 18:43:26.987181 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 18:43:26.987181 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/5419b9532d52479d8d99336b90ebe9ae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_5419b9532d52479d8d99336b90ebe9ae"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5419b9532d52479d8d99336b90ebe9ae"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5419b9532d52479d8d99336b90ebe9ae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:43:26.987181 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-MultipleCreateTestJSON-1215318955 Oct 04 18:43:26.987181 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: 5419b9532d52479d8d99336b90ebe9ae Oct 04 18:43:26.987181 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1215318955 Oct 04 18:43:26.987181 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-MultipleCreateTestJSON-1215318955-project Oct 04 18:43:26.987181 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 18:43:26.987181 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 18:43:26.987181 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: 2ee90610168a4d46b456d7a278991091 Oct 04 18:43:26.987181 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-MultipleCreateTestJSON-1215318955-project Oct 04 18:43:26.987181 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 18:43:26.987181 n-d-851028-13 devstack@n-api.service[123595]: exception: Instance f0b19cd2-3133-4782-87d9-93f72979db40 could not be found. Oct 04 18:43:26.987181 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': 'f0b19cd2-3133-4782-87d9-93f72979db40'} Oct 04 18:43:26.987181 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:43:26.987181 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:43:26.987181 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:43:26.987181 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:43:26.987181 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:43:26.987181 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:43:26.987181 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:43:26.987181 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:43:26.987181 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:43:26.987181 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:43:26.987181 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f0b19cd2-3133-4782-87d9-93f72979db40 could not be found. Oct 04 18:43:26.987181 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:43:26.987181 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:43:26.987181 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:43:26.987181 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:43:26.987181 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:43:26.987181 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:43:26.987181 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:43:26.987181 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:43:26.987181 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:43:26.987181 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:43:26.987181 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:43:26.987181 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:43:26.987181 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:43:26.987181 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:43:26.987181 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:43:26.987181 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:43:26.987181 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f0b19cd2-3133-4782-87d9-93f72979db40 could not be found. Oct 04 18:43:26.987181 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:43:26.987181 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:43:26.987181 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:43:26.992117 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:43:26.992117 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:43:26.992117 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:43:26.992117 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:43:26.992117 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:43:26.992117 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f0b19cd2-3133-4782-87d9-93f72979db40 could not be found. Oct 04 18:43:26.992117 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:43:26.992117 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-8abc5852-9cc3-4960-9196-3fa04b40e378 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Returning 404 to user: Instance f0b19cd2-3133-4782-87d9-93f72979db40 could not be found. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:43:26.992117 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-8abc5852-9cc3-4960-9196-3fa04b40e378 tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] 10.222.0.43 "GET /compute/v2.1/servers/f0b19cd2-3133-4782-87d9-93f72979db40" status: 404 len: 111 microversion: 2.1 time: 0.066579 Oct 04 18:43:26.997507 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1425/2998] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:26 2022] GET /compute/v2.1/servers/f0b19cd2-3133-4782-87d9-93f72979db40 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:43:27.006488 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-f8738966-c04b-44c0-8163-287dd8de627a tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:27.007118 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-f8738966-c04b-44c0-8163-287dd8de627a tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] [instance: bd12a90d-60fb-4627-9ea1-9e60a1565528] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:27.018514 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f8738966-c04b-44c0-8163-287dd8de627a tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:27.019011 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f8738966-c04b-44c0-8163-287dd8de627a tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:27.019448 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f8738966-c04b-44c0-8163-287dd8de627a tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:27.020155 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f8738966-c04b-44c0-8163-287dd8de627a tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:27.020605 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f8738966-c04b-44c0-8163-287dd8de627a tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:27.021033 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f8738966-c04b-44c0-8163-287dd8de627a tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:27.061419 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-f8738966-c04b-44c0-8163-287dd8de627a tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] HTTP exception thrown: Instance bd12a90d-60fb-4627-9ea1-9e60a1565528 could not be found. Oct 04 18:43:27.061419 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-f8738966-c04b-44c0-8163-287dd8de627a tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Request method failure captured: Oct 04 18:43:27.061419 n-d-851028-13 devstack@n-api.service[123595]: request: GET /compute/v2.1/servers/bd12a90d-60fb-4627-9ea1-9e60a1565528 HTTP/1.1 Oct 04 18:43:27.061419 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 18:43:27.061419 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 18:43:27.061419 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 18:43:27.061419 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 0 Oct 04 18:43:27.061419 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 18:43:27.061419 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 18:43:27.061419 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 18:43:27.061419 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 18:43:27.061419 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPH6NKn52JF1pLfS0S7BxcCDQy4HAMsavLf7xY8SKkUOXM3CwyaYS9wz-QMJC8RwMTS9cuk-V1C3JuHluurHKCURf4yKQJbEJDT69bRp31hD0R4m-NF0wJfBq89z9BAvwMul5ek92CDM1YLhz4volXmnRDp9TgBQENGZFixdMMbXzUJU Oct 04 18:43:27.061419 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 18:43:27.061419 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 18:43:27.061419 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 18:43:27.061419 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 18:43:27.061419 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 18:43:27.061419 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 18:43:27.061419 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: 5419b9532d52479d8d99336b90ebe9ae Oct 04 18:43:27.061419 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-MultipleCreateTestJSON-1215318955 Oct 04 18:43:27.061419 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 18:43:27.061419 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 18:43:27.061419 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/5419b9532d52479d8d99336b90ebe9ae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_5419b9532d52479d8d99336b90ebe9ae"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5419b9532d52479d8d99336b90ebe9ae"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5419b9532d52479d8d99336b90ebe9ae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:43:27.061419 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-MultipleCreateTestJSON-1215318955 Oct 04 18:43:27.061419 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: 5419b9532d52479d8d99336b90ebe9ae Oct 04 18:43:27.061419 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1215318955 Oct 04 18:43:27.061419 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-MultipleCreateTestJSON-1215318955-project Oct 04 18:43:27.061419 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 18:43:27.061419 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 18:43:27.061419 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: 2ee90610168a4d46b456d7a278991091 Oct 04 18:43:27.061419 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-MultipleCreateTestJSON-1215318955-project Oct 04 18:43:27.061419 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 18:43:27.061419 n-d-851028-13 devstack@n-api.service[123595]: exception: Instance bd12a90d-60fb-4627-9ea1-9e60a1565528 could not be found. Oct 04 18:43:27.061419 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': 'bd12a90d-60fb-4627-9ea1-9e60a1565528'} Oct 04 18:43:27.061419 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:43:27.061419 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:43:27.061419 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:43:27.061419 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:43:27.061419 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:43:27.061419 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:43:27.061419 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:43:27.061419 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:43:27.061419 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:43:27.061419 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:43:27.061419 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd12a90d-60fb-4627-9ea1-9e60a1565528 could not be found. Oct 04 18:43:27.061419 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:43:27.061419 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:43:27.061419 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:43:27.061419 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:43:27.061419 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:43:27.061419 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:43:27.061419 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:43:27.061419 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:43:27.061419 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:43:27.061419 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:43:27.061419 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:43:27.061419 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:43:27.061419 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:43:27.061419 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:43:27.061419 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:43:27.061419 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:43:27.065933 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd12a90d-60fb-4627-9ea1-9e60a1565528 could not be found. Oct 04 18:43:27.065933 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:43:27.065933 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:43:27.065933 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:43:27.065933 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:43:27.065933 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:43:27.065933 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:43:27.065933 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:43:27.065933 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:43:27.065933 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd12a90d-60fb-4627-9ea1-9e60a1565528 could not be found. Oct 04 18:43:27.065933 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:43:27.065933 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-f8738966-c04b-44c0-8163-287dd8de627a tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] Returning 404 to user: Instance bd12a90d-60fb-4627-9ea1-9e60a1565528 could not be found. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:43:27.065933 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-f8738966-c04b-44c0-8163-287dd8de627a tempest-MultipleCreateTestJSON-1215318955 tempest-MultipleCreateTestJSON-1215318955-project] 10.222.0.43 "GET /compute/v2.1/servers/bd12a90d-60fb-4627-9ea1-9e60a1565528" status: 404 len: 111 microversion: 2.1 time: 0.062765 Oct 04 18:43:27.073619 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1426/2999] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:26 2022] GET /compute/v2.1/servers/bd12a90d-60fb-4627-9ea1-9e60a1565528 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:43:27.127889 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:43:27.149805 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-2d723cb5-7f8f-4c9c-b048-eb22ca8c1e4c tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] 10.222.0.43 "POST /compute/v2.1/servers/f726f3f3-4731-4380-9163-b2273b629810/action" status: 202 len: 0 microversion: 2.1 time: 0.184581 Oct 04 18:43:27.167598 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1574/3000] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 18:43:26 2022] POST /compute/v2.1/servers/f726f3f3-4731-4380-9163-b2273b629810/action => generated 0 bytes in 206 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:43:27.172269 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-67150bf9-2370-4a3f-b225-6ef77b68e015 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:27.173175 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-67150bf9-2370-4a3f-b225-6ef77b68e015 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] [instance: f726f3f3-4731-4380-9163-b2273b629810] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:27.184814 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-67150bf9-2370-4a3f-b225-6ef77b68e015 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:27.191715 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-67150bf9-2370-4a3f-b225-6ef77b68e015 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:27.191715 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-67150bf9-2370-4a3f-b225-6ef77b68e015 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:27.199322 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-67150bf9-2370-4a3f-b225-6ef77b68e015 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:27.200403 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-67150bf9-2370-4a3f-b225-6ef77b68e015 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:27.201154 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-67150bf9-2370-4a3f-b225-6ef77b68e015 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:27.651511 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-0a78c259-2236-4215-9bf0-da5529c3ab48 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:27.652488 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-0a78c259-2236-4215-9bf0-da5529c3ab48 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] [instance: 2d229458-6857-4662-ad59-30770808e2a1] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:27.696520 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0a78c259-2236-4215-9bf0-da5529c3ab48 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:27.697596 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0a78c259-2236-4215-9bf0-da5529c3ab48 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:27.701463 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0a78c259-2236-4215-9bf0-da5529c3ab48 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:27.702729 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0a78c259-2236-4215-9bf0-da5529c3ab48 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:27.703443 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0a78c259-2236-4215-9bf0-da5529c3ab48 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:27.704116 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0a78c259-2236-4215-9bf0-da5529c3ab48 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:27.977885 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-67150bf9-2370-4a3f-b225-6ef77b68e015 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96e7480de94c43909045ac1087e40cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6bd34bf5540ee95c8144f185eb22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:27.993835 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-67150bf9-2370-4a3f-b225-6ef77b68e015 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] 10.222.0.43 "GET /compute/v2.1/servers/f726f3f3-4731-4380-9163-b2273b629810" status: 200 len: 1519 microversion: 2.1 time: 0.826057 Oct 04 18:43:27.994824 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1427/3001] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:27 2022] GET /compute/v2.1/servers/f726f3f3-4731-4380-9163-b2273b629810 => generated 1519 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:28.009319 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-0089e196-fa70-42b6-896b-2344e0a4a12e tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:28.009934 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-0089e196-fa70-42b6-896b-2344e0a4a12e tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] [instance: 601869a4-7b03-4c37-acb2-a7f8a94e3f26] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:28.016182 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0089e196-fa70-42b6-896b-2344e0a4a12e tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:28.016668 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0089e196-fa70-42b6-896b-2344e0a4a12e tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:28.025893 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0089e196-fa70-42b6-896b-2344e0a4a12e tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:28.030792 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0089e196-fa70-42b6-896b-2344e0a4a12e tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:28.031413 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0089e196-fa70-42b6-896b-2344e0a4a12e tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:28.031967 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0089e196-fa70-42b6-896b-2344e0a4a12e tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:28.194178 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-0a78c259-2236-4215-9bf0-da5529c3ab48 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9971b5861f44c1a1da94eda0f8f02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f809b8ae704988961908bef0f3cb24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:28.206051 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-0a78c259-2236-4215-9bf0-da5529c3ab48 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] 10.222.0.43 "GET /compute/v2.1/servers/2d229458-6857-4662-ad59-30770808e2a1" status: 200 len: 1503 microversion: 2.1 time: 0.559527 Oct 04 18:43:28.207054 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1575/3002] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:27 2022] GET /compute/v2.1/servers/2d229458-6857-4662-ad59-30770808e2a1 => generated 1503 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:28.228801 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f494762c-bb88-4bf6-85d8-a6570e39e0b7 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:28.230389 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-f494762c-bb88-4bf6-85d8-a6570e39e0b7 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] [instance: cbae126b-e99a-4c70-a9e7-0921a41e01ca] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:28.238316 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f494762c-bb88-4bf6-85d8-a6570e39e0b7 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:28.239095 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f494762c-bb88-4bf6-85d8-a6570e39e0b7 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:28.239769 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f494762c-bb88-4bf6-85d8-a6570e39e0b7 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:28.240699 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f494762c-bb88-4bf6-85d8-a6570e39e0b7 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:28.241412 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f494762c-bb88-4bf6-85d8-a6570e39e0b7 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:28.242087 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f494762c-bb88-4bf6-85d8-a6570e39e0b7 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:28.395026 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-f494762c-bb88-4bf6-85d8-a6570e39e0b7 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2df20485e3d4c75b2f4fc7375adebb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f379b9ce44d942959b67137e546191c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:28.418283 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-f494762c-bb88-4bf6-85d8-a6570e39e0b7 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] 10.222.0.43 "GET /compute/v2.1/servers/cbae126b-e99a-4c70-a9e7-0921a41e01ca" status: 200 len: 1541 microversion: 2.1 time: 0.198792 Oct 04 18:43:28.419948 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1576/3003] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:28 2022] GET /compute/v2.1/servers/cbae126b-e99a-4c70-a9e7-0921a41e01ca => generated 1541 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:28.530927 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-0089e196-fa70-42b6-896b-2344e0a4a12e tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608fc9ed7cdb487c9bf4b783c26ceeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29876d6805924df882d6861b0f6ab4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:28.539326 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-0089e196-fa70-42b6-896b-2344e0a4a12e tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] 10.222.0.43 "GET /compute/v2.1/servers/601869a4-7b03-4c37-acb2-a7f8a94e3f26" status: 200 len: 1313 microversion: 2.1 time: 0.543165 Oct 04 18:43:28.545530 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1428/3004] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:27 2022] GET /compute/v2.1/servers/601869a4-7b03-4c37-acb2-a7f8a94e3f26 => generated 1313 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:28.921572 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-698f2b72-3b0a-490d-9cae-e35bdf18ad70 req-a3d15a32-cf3c-4308-bf9b-62114d15dcc2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf78a645-458e-4dc2-a60d-a51754ab6258", "tag": "68b980e1-728c-40ba-bdae-e6a747ef6688"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:43:28.963335 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-698f2b72-3b0a-490d-9cae-e35bdf18ad70 req-a3d15a32-cf3c-4308-bf9b-62114d15dcc2 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:28.966376 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-698f2b72-3b0a-490d-9cae-e35bdf18ad70 req-a3d15a32-cf3c-4308-bf9b-62114d15dcc2 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:28.969018 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-698f2b72-3b0a-490d-9cae-e35bdf18ad70 req-a3d15a32-cf3c-4308-bf9b-62114d15dcc2 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:29.019384 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-b6e5ed37-b4e1-4177-9bf9-abf8e0d999f6 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:29.020144 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-b6e5ed37-b4e1-4177-9bf9-abf8e0d999f6 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] [instance: f726f3f3-4731-4380-9163-b2273b629810] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:29.024629 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-698f2b72-3b0a-490d-9cae-e35bdf18ad70 req-a3d15a32-cf3c-4308-bf9b-62114d15dcc2 service nova] Creating event network-changed:68b980e1-728c-40ba-bdae-e6a747ef6688 for instance cf78a645-458e-4dc2-a60d-a51754ab6258 on n-h2-851028-13 Oct 04 18:43:29.028652 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b6e5ed37-b4e1-4177-9bf9-abf8e0d999f6 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:29.042593 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b6e5ed37-b4e1-4177-9bf9-abf8e0d999f6 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:29.043387 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b6e5ed37-b4e1-4177-9bf9-abf8e0d999f6 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:29.044251 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b6e5ed37-b4e1-4177-9bf9-abf8e0d999f6 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:29.045831 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b6e5ed37-b4e1-4177-9bf9-abf8e0d999f6 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:29.052253 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b6e5ed37-b4e1-4177-9bf9-abf8e0d999f6 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:29.068542 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-698f2b72-3b0a-490d-9cae-e35bdf18ad70 req-a3d15a32-cf3c-4308-bf9b-62114d15dcc2 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.138714 Oct 04 18:43:29.074261 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1577/3005] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:43:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:43:29.106205 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-b25eb0dd-1988-4ec2-8289-88baaed82d05 req-e0aca79e-9bd9-4efc-972b-b63a0608fc87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbae126b-e99a-4c70-a9e7-0921a41e01ca", "name": "network-vif-deleted", "tag": "c406a273-b78c-4fe1-b66a-ad30e702c41b"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:43:29.143984 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-b25eb0dd-1988-4ec2-8289-88baaed82d05 req-e0aca79e-9bd9-4efc-972b-b63a0608fc87 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:29.156389 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-b25eb0dd-1988-4ec2-8289-88baaed82d05 req-e0aca79e-9bd9-4efc-972b-b63a0608fc87 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:29.156988 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-b25eb0dd-1988-4ec2-8289-88baaed82d05 req-e0aca79e-9bd9-4efc-972b-b63a0608fc87 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:29.188711 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-b25eb0dd-1988-4ec2-8289-88baaed82d05 req-e0aca79e-9bd9-4efc-972b-b63a0608fc87 service nova] Creating event network-vif-deleted:c406a273-b78c-4fe1-b66a-ad30e702c41b for instance cbae126b-e99a-4c70-a9e7-0921a41e01ca on n-h2-851028-13 Oct 04 18:43:29.200583 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-b25eb0dd-1988-4ec2-8289-88baaed82d05 req-e0aca79e-9bd9-4efc-972b-b63a0608fc87 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124565 Oct 04 18:43:29.205893 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1578/3006] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:43:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:43:29.233239 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-c9006977-922e-468b-8bb6-e8e0b3812caa tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:29.234439 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-c9006977-922e-468b-8bb6-e8e0b3812caa tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] [instance: 2d229458-6857-4662-ad59-30770808e2a1] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:29.245611 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c9006977-922e-468b-8bb6-e8e0b3812caa tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:29.247068 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c9006977-922e-468b-8bb6-e8e0b3812caa tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:29.251176 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c9006977-922e-468b-8bb6-e8e0b3812caa tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:29.252179 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c9006977-922e-468b-8bb6-e8e0b3812caa tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:29.252859 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c9006977-922e-468b-8bb6-e8e0b3812caa tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:29.255230 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c9006977-922e-468b-8bb6-e8e0b3812caa tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:29.667086 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-c9006977-922e-468b-8bb6-e8e0b3812caa tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9971b5861f44c1a1da94eda0f8f02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f809b8ae704988961908bef0f3cb24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:29.685419 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-c9006977-922e-468b-8bb6-e8e0b3812caa tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] 10.222.0.43 "GET /compute/v2.1/servers/2d229458-6857-4662-ad59-30770808e2a1" status: 200 len: 1478 microversion: 2.1 time: 0.448584 Oct 04 18:43:29.686527 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1579/3007] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:29 2022] GET /compute/v2.1/servers/2d229458-6857-4662-ad59-30770808e2a1 => generated 1478 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:43:29.698596 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-d18be77e-cf0b-4aa1-b1b7-aac5db2becd2 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:29.705981 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-d18be77e-cf0b-4aa1-b1b7-aac5db2becd2 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] [instance: cbae126b-e99a-4c70-a9e7-0921a41e01ca] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:29.732127 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d18be77e-cf0b-4aa1-b1b7-aac5db2becd2 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:29.732873 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d18be77e-cf0b-4aa1-b1b7-aac5db2becd2 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:29.733581 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d18be77e-cf0b-4aa1-b1b7-aac5db2becd2 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:29.734562 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d18be77e-cf0b-4aa1-b1b7-aac5db2becd2 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:29.735239 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d18be77e-cf0b-4aa1-b1b7-aac5db2becd2 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:29.738072 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d18be77e-cf0b-4aa1-b1b7-aac5db2becd2 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:30.078541 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-b6e5ed37-b4e1-4177-9bf9-abf8e0d999f6 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96e7480de94c43909045ac1087e40cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6bd34bf5540ee95c8144f185eb22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:30.087733 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-b6e5ed37-b4e1-4177-9bf9-abf8e0d999f6 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] 10.222.0.43 "GET /compute/v2.1/servers/f726f3f3-4731-4380-9163-b2273b629810" status: 200 len: 1499 microversion: 2.1 time: 1.072115 Oct 04 18:43:30.089840 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1429/3008] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:29 2022] GET /compute/v2.1/servers/f726f3f3-4731-4380-9163-b2273b629810 => generated 1499 bytes in 1075 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:43:30.111388 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-50043dd4-cc75-4e36-9d87-dd0be176979a tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:30.114468 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-50043dd4-cc75-4e36-9d87-dd0be176979a tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] [instance: 601869a4-7b03-4c37-acb2-a7f8a94e3f26] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:30.128332 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=2 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:43:30.134503 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-50043dd4-cc75-4e36-9d87-dd0be176979a tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:30.135382 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-50043dd4-cc75-4e36-9d87-dd0be176979a tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:30.144876 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-50043dd4-cc75-4e36-9d87-dd0be176979a tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:30.146182 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-50043dd4-cc75-4e36-9d87-dd0be176979a tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:30.146891 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-50043dd4-cc75-4e36-9d87-dd0be176979a tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:30.147544 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-50043dd4-cc75-4e36-9d87-dd0be176979a tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:30.203782 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=2 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:43:30.298397 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-d18be77e-cf0b-4aa1-b1b7-aac5db2becd2 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2df20485e3d4c75b2f4fc7375adebb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f379b9ce44d942959b67137e546191c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:30.313955 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-d18be77e-cf0b-4aa1-b1b7-aac5db2becd2 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] 10.222.0.43 "GET /compute/v2.1/servers/cbae126b-e99a-4c70-a9e7-0921a41e01ca" status: 200 len: 1252 microversion: 2.1 time: 0.625919 Oct 04 18:43:30.316301 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1580/3009] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:29 2022] GET /compute/v2.1/servers/cbae126b-e99a-4c70-a9e7-0921a41e01ca => generated 1252 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:30.323916 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-80f9e4bd-38ab-4e1b-9b32-063dd5ac9451 tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] Calling method '.version_select at 0x7fb21eadadc0>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:30.343427 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-80f9e4bd-38ab-4e1b-9b32-063dd5ac9451 tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:30.352705 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-80f9e4bd-38ab-4e1b-9b32-063dd5ac9451 tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:30.353693 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-80f9e4bd-38ab-4e1b-9b32-063dd5ac9451 tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:30.390513 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-80f9e4bd-38ab-4e1b-9b32-063dd5ac9451 tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] 10.222.0.43 "GET /compute/v2.1/os-migrations" status: 200 len: 791 microversion: 2.1 time: 0.068618 Oct 04 18:43:30.408853 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1581/3010] 10.222.0.43 () {58 vars in 1143 bytes} [Tue Oct 4 18:43:30 2022] GET /compute/v2.1/os-migrations => generated 791 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:43:30.412995 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=6 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:43:30.422430 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-df6a931e-9248-4e93-a629-3477b9ea586f tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:43:30.425607 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-df6a931e-9248-4e93-a629-3477b9ea586f tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] [instance: f726f3f3-4731-4380-9163-b2273b629810] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:30.440948 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-df6a931e-9248-4e93-a629-3477b9ea586f tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:30.445894 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-df6a931e-9248-4e93-a629-3477b9ea586f tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:30.446584 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-df6a931e-9248-4e93-a629-3477b9ea586f tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:30.447577 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-df6a931e-9248-4e93-a629-3477b9ea586f tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:30.448269 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-df6a931e-9248-4e93-a629-3477b9ea586f tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:30.448920 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-df6a931e-9248-4e93-a629-3477b9ea586f tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:30.516621 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.objects.instance [None req-df6a931e-9248-4e93-a629-3477b9ea586f tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lazy-loading 'flavor' on Instance uuid f726f3f3-4731-4380-9163-b2273b629810 {{(pid=123596) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:43:30.541500 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-df6a931e-9248-4e93-a629-3477b9ea586f tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] HTTP exception thrown: Cannot 'rescue' instance f726f3f3-4731-4380-9163-b2273b629810 while it is in vm_state paused Oct 04 18:43:30.544528 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-df6a931e-9248-4e93-a629-3477b9ea586f tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Request method failure captured: Oct 04 18:43:30.544528 n-d-851028-13 devstack@n-api.service[123596]: request: POST /compute/v2.1/servers/f726f3f3-4731-4380-9163-b2273b629810/action HTTP/1.1 Oct 04 18:43:30.544528 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:43:30.544528 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:43:30.544528 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:43:30.544528 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 14 Oct 04 18:43:30.544528 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:43:30.544528 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:43:30.544528 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:43:30.544528 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:43:30.544528 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPH6ImUsc0v5avJaXbAf95n6vmfztxEtTiW32SRLH_bOmBbny3fOGIWm6DaSHmvRnWhZ-84faOFvXqXs-7dDoMftV5mgOWVN0Q9OrVISe3irL7FfmyYZmGssWLEuXGLXQhTtdNOFN9115Lqu5biPYPUWU74K-2mRSRsiih09WbGDmZQI Oct 04 18:43:30.544528 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:43:30.544528 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:43:30.544528 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:43:30.544528 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:43:30.544528 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:43:30.544528 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:43:30.544528 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: eda6bd34bf5540ee95c8144f185eb22d Oct 04 18:43:30.544528 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1155401912 Oct 04 18:43:30.544528 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 18:43:30.544528 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 18:43:30.544528 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/eda6bd34bf5540ee95c8144f185eb22d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_eda6bd34bf5540ee95c8144f185eb22d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/eda6bd34bf5540ee95c8144f185eb22d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/eda6bd34bf5540ee95c8144f185eb22d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:43:30.544528 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1155401912 Oct 04 18:43:30.544528 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: eda6bd34bf5540ee95c8144f185eb22d Oct 04 18:43:30.544528 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1155401912 Oct 04 18:43:30.544528 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-ServerRescueNegativeTestJSON-1155401912-project Oct 04 18:43:30.544528 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:43:30.544528 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:43:30.544528 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 96e7480de94c43909045ac1087e40cd8 Oct 04 18:43:30.544528 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1155401912-project Oct 04 18:43:30.544528 n-d-851028-13 devstack@n-api.service[123596]: Oct 04 18:43:30.544528 n-d-851028-13 devstack@n-api.service[123596]: {"rescue": {}} Oct 04 18:43:30.544528 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 18:43:30.544528 n-d-851028-13 devstack@n-api.service[123596]: exception: Cannot 'rescue' instance f726f3f3-4731-4380-9163-b2273b629810 while it is in vm_state paused Oct 04 18:43:30.544528 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': 'f726f3f3-4731-4380-9163-b2273b629810', 'body': {'rescue': {}}} Oct 04 18:43:30.544528 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:43:30.544528 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:43:30.544528 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 62, in _rescue Oct 04 18:43:30.544528 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi self.compute_api.rescue(context, instance, Oct 04 18:43:30.544528 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 04 18:43:30.544528 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 18:43:30.544528 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 18:43:30.544528 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 18:43:30.544528 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 04 18:43:30.544528 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 04 18:43:30.544528 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f726f3f3-4731-4380-9163-b2273b629810 in vm_state paused. Cannot rescue while the instance is in this state. Oct 04 18:43:30.544528 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:43:30.544528 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:43:30.544528 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:43:30.544528 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:43:30.544528 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:43:30.544528 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:43:30.544528 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:43:30.544528 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:43:30.544528 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:43:30.544528 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:43:30.544528 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:43:30.544528 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:43:30.544528 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 72, in _rescue Oct 04 18:43:30.544528 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Oct 04 18:43:30.544528 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 04 18:43:30.544528 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 04 18:43:30.544528 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rescue' instance f726f3f3-4731-4380-9163-b2273b629810 while it is in vm_state paused Oct 04 18:43:30.544528 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:43:30.548749 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:43:30.548749 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:43:30.548749 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:43:30.548749 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:43:30.548749 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:43:30.548749 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:43:30.548749 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:43:30.548749 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rescue' instance f726f3f3-4731-4380-9163-b2273b629810 while it is in vm_state paused Oct 04 18:43:30.548749 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:43:30.556117 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-df6a931e-9248-4e93-a629-3477b9ea586f tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Returning 409 to user: Cannot 'rescue' instance f726f3f3-4731-4380-9163-b2273b629810 while it is in vm_state paused {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:43:30.557419 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-df6a931e-9248-4e93-a629-3477b9ea586f tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] 10.222.0.43 "POST /compute/v2.1/servers/f726f3f3-4731-4380-9163-b2273b629810/action" status: 409 len: 144 microversion: 2.1 time: 0.145468 Oct 04 18:43:30.558242 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1582/3011] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 18:43:30 2022] POST /compute/v2.1/servers/f726f3f3-4731-4380-9163-b2273b629810/action => generated 144 bytes in 148 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:43:30.572101 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-6aa565bd-e4aa-4324-8b15-75a56fb6ccb0 tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:30.573027 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-6aa565bd-e4aa-4324-8b15-75a56fb6ccb0 tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] [instance: 2d229458-6857-4662-ad59-30770808e2a1] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:30.585197 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6aa565bd-e4aa-4324-8b15-75a56fb6ccb0 tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:30.586446 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6aa565bd-e4aa-4324-8b15-75a56fb6ccb0 tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:30.587184 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6aa565bd-e4aa-4324-8b15-75a56fb6ccb0 tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:30.588234 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6aa565bd-e4aa-4324-8b15-75a56fb6ccb0 tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:30.588929 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6aa565bd-e4aa-4324-8b15-75a56fb6ccb0 tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:30.589613 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6aa565bd-e4aa-4324-8b15-75a56fb6ccb0 tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:30.803208 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=14 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:43:31.095734 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-6aa565bd-e4aa-4324-8b15-75a56fb6ccb0 tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/2d229458-6857-4662-ad59-30770808e2a1" status: 200 len: 1631 microversion: 2.1 time: 0.535527 Oct 04 18:43:31.096324 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1583/3012] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:30 2022] GET /compute/v2.1/servers/2d229458-6857-4662-ad59-30770808e2a1 => generated 1631 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:31.116995 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-13c7e1e5-e9c4-410a-88d0-e9ebcbd2dc1d tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:43:31.117645 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-13c7e1e5-e9c4-410a-88d0-e9ebcbd2dc1d tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] [instance: f726f3f3-4731-4380-9163-b2273b629810] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:31.142929 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-13c7e1e5-e9c4-410a-88d0-e9ebcbd2dc1d tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:31.143331 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-13c7e1e5-e9c4-410a-88d0-e9ebcbd2dc1d tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:31.144082 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-13c7e1e5-e9c4-410a-88d0-e9ebcbd2dc1d tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:31.144462 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-13c7e1e5-e9c4-410a-88d0-e9ebcbd2dc1d tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:31.144916 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-13c7e1e5-e9c4-410a-88d0-e9ebcbd2dc1d tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:31.147472 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-50043dd4-cc75-4e36-9d87-dd0be176979a tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608fc9ed7cdb487c9bf4b783c26ceeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29876d6805924df882d6861b0f6ab4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:31.154348 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-13c7e1e5-e9c4-410a-88d0-e9ebcbd2dc1d tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:31.162006 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-50043dd4-cc75-4e36-9d87-dd0be176979a tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] 10.222.0.43 "GET /compute/v2.1/servers/601869a4-7b03-4c37-acb2-a7f8a94e3f26" status: 200 len: 1313 microversion: 2.1 time: 1.066756 Oct 04 18:43:31.165358 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1430/3013] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:30 2022] GET /compute/v2.1/servers/601869a4-7b03-4c37-acb2-a7f8a94e3f26 => generated 1313 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:31.187484 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-8582d094-8579-4f55-a0b9-0a5b8ec9a651 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Action: 'create', calling method: .version_select at 0x7fb21fa3ab80>, body: {"keypair": {"name": "tempest-keypair-1772492792", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBC8b5MFrPh2EoTRa0x9enO//WH71PtmH0IdO88FjGJKuCb85ltTRsitFyrmtl9vt16AXexGvCwVfWCdD+zRZGYJxT/7GqB21o+264mUiXhld0pAnAeT/j2l1jVOdfmGpQ=="}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:43:31.255017 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-8582d094-8579-4f55-a0b9-0a5b8ec9a651 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Getting quotas for project a9f809b8ae704988961908bef0f3cb24. Resources: {'key_pairs'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:43:31.276980 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-8582d094-8579-4f55-a0b9-0a5b8ec9a651 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Getting quotas for user ae9971b5861f44c1a1da94eda0f8f02d and project a9f809b8ae704988961908bef0f3cb24. Resources: {'key_pairs'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:43:31.328592 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-8582d094-8579-4f55-a0b9-0a5b8ec9a651 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.159097 Oct 04 18:43:31.332452 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1431/3014] 10.222.0.43 () {60 vars in 1159 bytes} [Tue Oct 4 18:43:31 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:43:31.359000 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-a03d3f4f-7032-4073-af77-54e998e33b9e tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:31.359846 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-a03d3f4f-7032-4073-af77-54e998e33b9e tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] [instance: cbae126b-e99a-4c70-a9e7-0921a41e01ca] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:31.369634 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-13c7e1e5-e9c4-410a-88d0-e9ebcbd2dc1d tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] 10.222.0.43 "POST /compute/v2.1/servers/f726f3f3-4731-4380-9163-b2273b629810/action" status: 202 len: 0 microversion: 2.1 time: 0.258553 Oct 04 18:43:31.370675 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1584/3015] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 18:43:31 2022] POST /compute/v2.1/servers/f726f3f3-4731-4380-9163-b2273b629810/action => generated 0 bytes in 274 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:43:31.386318 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-af6c874c-5adf-49bb-8990-36fc7a9b0102 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:31.387110 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-af6c874c-5adf-49bb-8990-36fc7a9b0102 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] [instance: f726f3f3-4731-4380-9163-b2273b629810] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:31.390148 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a03d3f4f-7032-4073-af77-54e998e33b9e tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:31.396436 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a03d3f4f-7032-4073-af77-54e998e33b9e tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:31.398943 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a03d3f4f-7032-4073-af77-54e998e33b9e tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:31.403973 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a03d3f4f-7032-4073-af77-54e998e33b9e tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:31.404641 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a03d3f4f-7032-4073-af77-54e998e33b9e tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:31.407939 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a03d3f4f-7032-4073-af77-54e998e33b9e tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:31.408438 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-af6c874c-5adf-49bb-8990-36fc7a9b0102 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:31.408981 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-af6c874c-5adf-49bb-8990-36fc7a9b0102 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:31.409613 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-af6c874c-5adf-49bb-8990-36fc7a9b0102 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:31.410338 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-af6c874c-5adf-49bb-8990-36fc7a9b0102 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:31.410822 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-af6c874c-5adf-49bb-8990-36fc7a9b0102 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:31.411230 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-af6c874c-5adf-49bb-8990-36fc7a9b0102 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:31.879387 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-a03d3f4f-7032-4073-af77-54e998e33b9e tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2df20485e3d4c75b2f4fc7375adebb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f379b9ce44d942959b67137e546191c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:31.901556 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-a03d3f4f-7032-4073-af77-54e998e33b9e tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] 10.222.0.43 "GET /compute/v2.1/servers/cbae126b-e99a-4c70-a9e7-0921a41e01ca" status: 200 len: 1252 microversion: 2.1 time: 0.563879 Oct 04 18:43:31.914453 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1432/3016] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:31 2022] GET /compute/v2.1/servers/cbae126b-e99a-4c70-a9e7-0921a41e01ca => generated 1252 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:32.008472 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-af6c874c-5adf-49bb-8990-36fc7a9b0102 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96e7480de94c43909045ac1087e40cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6bd34bf5540ee95c8144f185eb22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:32.018415 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-af6c874c-5adf-49bb-8990-36fc7a9b0102 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] 10.222.0.43 "GET /compute/v2.1/servers/f726f3f3-4731-4380-9163-b2273b629810" status: 200 len: 1506 microversion: 2.1 time: 0.642133 Oct 04 18:43:32.019614 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1585/3017] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:31 2022] GET /compute/v2.1/servers/f726f3f3-4731-4380-9163-b2273b629810 => generated 1506 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:32.192344 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-1529fa4c-ce98-4c9c-8cf9-c9b462a037d2 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:32.193040 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-1529fa4c-ce98-4c9c-8cf9-c9b462a037d2 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] [instance: 601869a4-7b03-4c37-acb2-a7f8a94e3f26] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:32.203477 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1529fa4c-ce98-4c9c-8cf9-c9b462a037d2 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:32.203972 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1529fa4c-ce98-4c9c-8cf9-c9b462a037d2 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:32.216975 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1529fa4c-ce98-4c9c-8cf9-c9b462a037d2 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:32.217845 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1529fa4c-ce98-4c9c-8cf9-c9b462a037d2 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:32.218338 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1529fa4c-ce98-4c9c-8cf9-c9b462a037d2 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:32.218789 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1529fa4c-ce98-4c9c-8cf9-c9b462a037d2 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:32.961153 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-7ef03931-5f0b-4fa4-9bb3-403e416dbab3 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:32.964195 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-7ef03931-5f0b-4fa4-9bb3-403e416dbab3 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] [instance: cbae126b-e99a-4c70-a9e7-0921a41e01ca] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:32.994611 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7ef03931-5f0b-4fa4-9bb3-403e416dbab3 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:32.997086 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7ef03931-5f0b-4fa4-9bb3-403e416dbab3 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:32.998489 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7ef03931-5f0b-4fa4-9bb3-403e416dbab3 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:32.999613 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7ef03931-5f0b-4fa4-9bb3-403e416dbab3 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:33.001537 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7ef03931-5f0b-4fa4-9bb3-403e416dbab3 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:33.003411 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7ef03931-5f0b-4fa4-9bb3-403e416dbab3 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:33.264359 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-7ef03931-5f0b-4fa4-9bb3-403e416dbab3 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2df20485e3d4c75b2f4fc7375adebb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f379b9ce44d942959b67137e546191c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:33.283830 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-7ef03931-5f0b-4fa4-9bb3-403e416dbab3 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] 10.222.0.43 "GET /compute/v2.1/servers/cbae126b-e99a-4c70-a9e7-0921a41e01ca" status: 200 len: 1252 microversion: 2.1 time: 0.346327 Oct 04 18:43:33.291951 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1586/3018] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:32 2022] GET /compute/v2.1/servers/cbae126b-e99a-4c70-a9e7-0921a41e01ca => generated 1252 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:33.306511 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-917fd88d-b0b3-4708-87ed-1e38c991bdde tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:33.309155 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-917fd88d-b0b3-4708-87ed-1e38c991bdde tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] [instance: f726f3f3-4731-4380-9163-b2273b629810] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:33.332121 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-917fd88d-b0b3-4708-87ed-1e38c991bdde tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:33.350016 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-917fd88d-b0b3-4708-87ed-1e38c991bdde tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:33.351182 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-917fd88d-b0b3-4708-87ed-1e38c991bdde tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:33.352235 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-917fd88d-b0b3-4708-87ed-1e38c991bdde tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:33.353090 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-917fd88d-b0b3-4708-87ed-1e38c991bdde tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:33.354085 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-917fd88d-b0b3-4708-87ed-1e38c991bdde tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:33.998818 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-1529fa4c-ce98-4c9c-8cf9-c9b462a037d2 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608fc9ed7cdb487c9bf4b783c26ceeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29876d6805924df882d6861b0f6ab4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:34.015410 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-1529fa4c-ce98-4c9c-8cf9-c9b462a037d2 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] 10.222.0.43 "GET /compute/v2.1/servers/601869a4-7b03-4c37-acb2-a7f8a94e3f26" status: 200 len: 1313 microversion: 2.1 time: 1.827567 Oct 04 18:43:34.037834 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1433/3019] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:32 2022] GET /compute/v2.1/servers/601869a4-7b03-4c37-acb2-a7f8a94e3f26 => generated 1313 bytes in 1851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:34.319611 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-655cfe15-4a0e-497b-bd08-6fea89d218cd tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:34.320322 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-655cfe15-4a0e-497b-bd08-6fea89d218cd tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] [instance: cbae126b-e99a-4c70-a9e7-0921a41e01ca] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:34.328462 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-917fd88d-b0b3-4708-87ed-1e38c991bdde tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96e7480de94c43909045ac1087e40cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6bd34bf5540ee95c8144f185eb22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:34.341882 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-655cfe15-4a0e-497b-bd08-6fea89d218cd tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:34.342145 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-917fd88d-b0b3-4708-87ed-1e38c991bdde tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] 10.222.0.43 "GET /compute/v2.1/servers/f726f3f3-4731-4380-9163-b2273b629810" status: 200 len: 1514 microversion: 2.1 time: 1.039780 Oct 04 18:43:34.342588 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-655cfe15-4a0e-497b-bd08-6fea89d218cd tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:34.343172 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-655cfe15-4a0e-497b-bd08-6fea89d218cd tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:34.344126 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-655cfe15-4a0e-497b-bd08-6fea89d218cd tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:34.344823 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-655cfe15-4a0e-497b-bd08-6fea89d218cd tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:34.348926 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1587/3020] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:33 2022] GET /compute/v2.1/servers/f726f3f3-4731-4380-9163-b2273b629810 => generated 1514 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:34.349761 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-655cfe15-4a0e-497b-bd08-6fea89d218cd tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:34.360810 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-93909dfd-9678-4a4b-9098-f89fabc48d9c req-064afe34-98f5-4c6a-81a1-e32fd9512f29 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "601869a4-7b03-4c37-acb2-a7f8a94e3f26", "tag": "4e55aee8-a71d-40a5-bff3-55f31acb30ca"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:43:34.385932 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-93909dfd-9678-4a4b-9098-f89fabc48d9c req-064afe34-98f5-4c6a-81a1-e32fd9512f29 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:34.386640 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-93909dfd-9678-4a4b-9098-f89fabc48d9c req-064afe34-98f5-4c6a-81a1-e32fd9512f29 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:34.389444 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-93909dfd-9678-4a4b-9098-f89fabc48d9c req-064afe34-98f5-4c6a-81a1-e32fd9512f29 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:34.420191 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-93909dfd-9678-4a4b-9098-f89fabc48d9c req-064afe34-98f5-4c6a-81a1-e32fd9512f29 service nova] Creating event network-changed:4e55aee8-a71d-40a5-bff3-55f31acb30ca for instance 601869a4-7b03-4c37-acb2-a7f8a94e3f26 on n-h2-851028-13 Oct 04 18:43:34.428923 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-93909dfd-9678-4a4b-9098-f89fabc48d9c req-064afe34-98f5-4c6a-81a1-e32fd9512f29 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078502 Oct 04 18:43:34.429573 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1588/3021] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:43:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:43:34.701785 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-655cfe15-4a0e-497b-bd08-6fea89d218cd tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2df20485e3d4c75b2f4fc7375adebb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f379b9ce44d942959b67137e546191c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:34.711837 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-655cfe15-4a0e-497b-bd08-6fea89d218cd tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] 10.222.0.43 "GET /compute/v2.1/servers/cbae126b-e99a-4c70-a9e7-0921a41e01ca" status: 200 len: 1252 microversion: 2.1 time: 0.397661 Oct 04 18:43:34.716319 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1434/3022] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:34 2022] GET /compute/v2.1/servers/cbae126b-e99a-4c70-a9e7-0921a41e01ca => generated 1252 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:43:35.047327 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-57afbcae-f1ee-4e11-8766-e75ecef3ff2a tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:35.048104 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-57afbcae-f1ee-4e11-8766-e75ecef3ff2a tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] [instance: 601869a4-7b03-4c37-acb2-a7f8a94e3f26] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:35.067830 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-57afbcae-f1ee-4e11-8766-e75ecef3ff2a tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:35.068254 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-57afbcae-f1ee-4e11-8766-e75ecef3ff2a tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:35.071128 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-57afbcae-f1ee-4e11-8766-e75ecef3ff2a tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:35.073257 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-57afbcae-f1ee-4e11-8766-e75ecef3ff2a tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:35.086922 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-57afbcae-f1ee-4e11-8766-e75ecef3ff2a tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:35.093818 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-57afbcae-f1ee-4e11-8766-e75ecef3ff2a tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:35.267024 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-078e1d64-ca8a-4e4e-9491-ebdb10fe16b9 req-5cbbe39b-d9e2-4e9a-b06f-04a8a71134e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf78a645-458e-4dc2-a60d-a51754ab6258", "name": "network-vif-plugged", "status": "completed", "tag": "68b980e1-728c-40ba-bdae-e6a747ef6688"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:43:35.305216 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-078e1d64-ca8a-4e4e-9491-ebdb10fe16b9 req-5cbbe39b-d9e2-4e9a-b06f-04a8a71134e2 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:35.306115 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-078e1d64-ca8a-4e4e-9491-ebdb10fe16b9 req-5cbbe39b-d9e2-4e9a-b06f-04a8a71134e2 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:35.306730 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-078e1d64-ca8a-4e4e-9491-ebdb10fe16b9 req-5cbbe39b-d9e2-4e9a-b06f-04a8a71134e2 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:35.348595 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-078e1d64-ca8a-4e4e-9491-ebdb10fe16b9 req-5cbbe39b-d9e2-4e9a-b06f-04a8a71134e2 service nova] Creating event network-vif-plugged:68b980e1-728c-40ba-bdae-e6a747ef6688 for instance cf78a645-458e-4dc2-a60d-a51754ab6258 on n-h2-851028-13 Oct 04 18:43:35.374619 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-078e1d64-ca8a-4e4e-9491-ebdb10fe16b9 req-5cbbe39b-d9e2-4e9a-b06f-04a8a71134e2 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111728 Oct 04 18:43:35.381508 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1435/3023] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:43:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:43:35.745373 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-82638015-9942-4cf6-9b8e-d56db3843800 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:35.746611 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-82638015-9942-4cf6-9b8e-d56db3843800 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] [instance: cbae126b-e99a-4c70-a9e7-0921a41e01ca] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:35.764779 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-82638015-9942-4cf6-9b8e-d56db3843800 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:35.765921 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-82638015-9942-4cf6-9b8e-d56db3843800 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:35.766778 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-82638015-9942-4cf6-9b8e-d56db3843800 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:35.769319 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-82638015-9942-4cf6-9b8e-d56db3843800 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:35.775342 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-82638015-9942-4cf6-9b8e-d56db3843800 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:35.776953 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-82638015-9942-4cf6-9b8e-d56db3843800 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:35.872327 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-57afbcae-f1ee-4e11-8766-e75ecef3ff2a tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608fc9ed7cdb487c9bf4b783c26ceeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29876d6805924df882d6861b0f6ab4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:35.881483 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-57afbcae-f1ee-4e11-8766-e75ecef3ff2a tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] 10.222.0.43 "GET /compute/v2.1/servers/601869a4-7b03-4c37-acb2-a7f8a94e3f26" status: 200 len: 1313 microversion: 2.1 time: 0.839619 Oct 04 18:43:35.883289 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1589/3024] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:35 2022] GET /compute/v2.1/servers/601869a4-7b03-4c37-acb2-a7f8a94e3f26 => generated 1313 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:36.086668 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-82638015-9942-4cf6-9b8e-d56db3843800 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2df20485e3d4c75b2f4fc7375adebb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f379b9ce44d942959b67137e546191c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:36.120455 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-82638015-9942-4cf6-9b8e-d56db3843800 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] 10.222.0.43 "GET /compute/v2.1/servers/cbae126b-e99a-4c70-a9e7-0921a41e01ca" status: 200 len: 1252 microversion: 2.1 time: 0.380678 Oct 04 18:43:36.124433 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1436/3025] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:35 2022] GET /compute/v2.1/servers/cbae126b-e99a-4c70-a9e7-0921a41e01ca => generated 1252 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:43:36.910587 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-32c32729-6909-4b31-bfe6-54f2d70c16fa tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:36.911787 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-32c32729-6909-4b31-bfe6-54f2d70c16fa tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] [instance: 601869a4-7b03-4c37-acb2-a7f8a94e3f26] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:36.932606 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-32c32729-6909-4b31-bfe6-54f2d70c16fa tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:36.936978 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-32c32729-6909-4b31-bfe6-54f2d70c16fa tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:36.938012 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-32c32729-6909-4b31-bfe6-54f2d70c16fa tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:36.942372 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-32c32729-6909-4b31-bfe6-54f2d70c16fa tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:36.943073 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-32c32729-6909-4b31-bfe6-54f2d70c16fa tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:36.944512 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-32c32729-6909-4b31-bfe6-54f2d70c16fa tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:36.988933 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-424d3cdf-7d93-415c-a7db-1f5bfe50fe41 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1871957296", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452", "networks": [{"uuid": "3b95df32-80ff-41d3-8ca9-09785472b92e"}], "security_groups": [{"name": "tempest-securitygroup--834861908"}], "key_name": "tempest-keypair-1772492792", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:43:37.493480 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.network.neutron [None req-424d3cdf-7d93-415c-a7db-1f5bfe50fe41 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] validate_networks() for [('3b95df32-80ff-41d3-8ca9-09785472b92e', None, None, None, None, None)] {{(pid=123595) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:43:37.669216 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-32c32729-6909-4b31-bfe6-54f2d70c16fa tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608fc9ed7cdb487c9bf4b783c26ceeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29876d6805924df882d6861b0f6ab4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:37.682895 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-32c32729-6909-4b31-bfe6-54f2d70c16fa tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] 10.222.0.43 "GET /compute/v2.1/servers/601869a4-7b03-4c37-acb2-a7f8a94e3f26" status: 200 len: 1313 microversion: 2.1 time: 0.777783 Oct 04 18:43:37.687969 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1590/3026] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:36 2022] GET /compute/v2.1/servers/601869a4-7b03-4c37-acb2-a7f8a94e3f26 => generated 1313 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:37.693712 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f3a3f0ef-83f4-41ff-87fd-5cd82b0ff446 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:37.706065 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-f3a3f0ef-83f4-41ff-87fd-5cd82b0ff446 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] [instance: cbae126b-e99a-4c70-a9e7-0921a41e01ca] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:37.765100 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f3a3f0ef-83f4-41ff-87fd-5cd82b0ff446 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:37.765636 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f3a3f0ef-83f4-41ff-87fd-5cd82b0ff446 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:37.766082 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f3a3f0ef-83f4-41ff-87fd-5cd82b0ff446 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:37.766818 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f3a3f0ef-83f4-41ff-87fd-5cd82b0ff446 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:37.767281 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f3a3f0ef-83f4-41ff-87fd-5cd82b0ff446 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:37.767720 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f3a3f0ef-83f4-41ff-87fd-5cd82b0ff446 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:37.920099 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-f3a3f0ef-83f4-41ff-87fd-5cd82b0ff446 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2df20485e3d4c75b2f4fc7375adebb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f379b9ce44d942959b67137e546191c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:37.940948 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-f3a3f0ef-83f4-41ff-87fd-5cd82b0ff446 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] 10.222.0.43 "GET /compute/v2.1/servers/cbae126b-e99a-4c70-a9e7-0921a41e01ca" status: 200 len: 1252 microversion: 2.1 time: 0.251280 Oct 04 18:43:37.949351 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1591/3027] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:37 2022] GET /compute/v2.1/servers/cbae126b-e99a-4c70-a9e7-0921a41e01ca => generated 1252 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:37.949351 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-3b0c070d-bf46-4d19-81e2-f7b00972f1b3 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:43:37.951579 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-3b0c070d-bf46-4d19-81e2-f7b00972f1b3 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] [instance: f726f3f3-4731-4380-9163-b2273b629810] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:37.971946 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3b0c070d-bf46-4d19-81e2-f7b00972f1b3 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:37.977061 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3b0c070d-bf46-4d19-81e2-f7b00972f1b3 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:37.980680 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3b0c070d-bf46-4d19-81e2-f7b00972f1b3 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:37.981835 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3b0c070d-bf46-4d19-81e2-f7b00972f1b3 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:37.989807 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3b0c070d-bf46-4d19-81e2-f7b00972f1b3 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:38.001918 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3b0c070d-bf46-4d19-81e2-f7b00972f1b3 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:38.060767 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.objects.instance [None req-3b0c070d-bf46-4d19-81e2-f7b00972f1b3 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lazy-loading 'flavor' on Instance uuid f726f3f3-4731-4380-9163-b2273b629810 {{(pid=123596) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:43:38.107276 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:43:38.324488 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-3b0c070d-bf46-4d19-81e2-f7b00972f1b3 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] 10.222.0.43 "POST /compute/v2.1/servers/f726f3f3-4731-4380-9163-b2273b629810/action" status: 200 len: 32 microversion: 2.1 time: 0.381137 Oct 04 18:43:38.334898 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1592/3028] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 18:43:37 2022] POST /compute/v2.1/servers/f726f3f3-4731-4380-9163-b2273b629810/action => generated 32 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:43:38.347128 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-be233d0c-237b-4a83-a923-bcc229db17ed tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:38.347993 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-be233d0c-237b-4a83-a923-bcc229db17ed tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] [instance: 74d78f04-e2a4-46ce-9da3-fe52e90f2090] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:38.367889 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-be233d0c-237b-4a83-a923-bcc229db17ed tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:38.368385 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-be233d0c-237b-4a83-a923-bcc229db17ed tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:38.368825 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-be233d0c-237b-4a83-a923-bcc229db17ed tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:38.377538 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-be233d0c-237b-4a83-a923-bcc229db17ed tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:38.378047 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-be233d0c-237b-4a83-a923-bcc229db17ed tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:38.378496 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-be233d0c-237b-4a83-a923-bcc229db17ed tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:38.413662 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-be233d0c-237b-4a83-a923-bcc229db17ed tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] [instance: 74d78f04-e2a4-46ce-9da3-fe52e90f2090] Going to try to terminate instance {{(pid=123596) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:43:38.545785 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-be233d0c-237b-4a83-a923-bcc229db17ed tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] 10.222.0.43 "DELETE /compute/v2.1/servers/74d78f04-e2a4-46ce-9da3-fe52e90f2090" status: 204 len: 0 microversion: 2.1 time: 0.208765 Oct 04 18:43:38.550053 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1593/3029] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 18:43:38 2022] DELETE /compute/v2.1/servers/74d78f04-e2a4-46ce-9da3-fe52e90f2090 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:43:38.564013 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-d0bd7bc3-e65f-492e-99fb-f01a7e2e2214 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:38.564745 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-d0bd7bc3-e65f-492e-99fb-f01a7e2e2214 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] [instance: f726f3f3-4731-4380-9163-b2273b629810] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:38.587368 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d0bd7bc3-e65f-492e-99fb-f01a7e2e2214 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:38.587929 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d0bd7bc3-e65f-492e-99fb-f01a7e2e2214 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:38.588565 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d0bd7bc3-e65f-492e-99fb-f01a7e2e2214 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:38.593561 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d0bd7bc3-e65f-492e-99fb-f01a7e2e2214 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:38.594304 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d0bd7bc3-e65f-492e-99fb-f01a7e2e2214 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:38.594943 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d0bd7bc3-e65f-492e-99fb-f01a7e2e2214 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:38.991748 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-d0bd7bc3-e65f-492e-99fb-f01a7e2e2214 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96e7480de94c43909045ac1087e40cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6bd34bf5540ee95c8144f185eb22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:39.000819 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-d0bd7bc3-e65f-492e-99fb-f01a7e2e2214 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] 10.222.0.43 "GET /compute/v2.1/servers/f726f3f3-4731-4380-9163-b2273b629810" status: 200 len: 1520 microversion: 2.1 time: 0.449409 Oct 04 18:43:39.001439 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1594/3030] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:38 2022] GET /compute/v2.1/servers/f726f3f3-4731-4380-9163-b2273b629810 => generated 1520 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:39.007532 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-36d33701-aa51-49a4-aec3-4ede9ed4cd92 tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:39.008392 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-36d33701-aa51-49a4-aec3-4ede9ed4cd92 tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] [instance: 74d78f04-e2a4-46ce-9da3-fe52e90f2090] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:39.014680 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-36d33701-aa51-49a4-aec3-4ede9ed4cd92 tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:39.015419 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-36d33701-aa51-49a4-aec3-4ede9ed4cd92 tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:39.016034 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-36d33701-aa51-49a4-aec3-4ede9ed4cd92 tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:39.016944 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-36d33701-aa51-49a4-aec3-4ede9ed4cd92 tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:39.017573 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-36d33701-aa51-49a4-aec3-4ede9ed4cd92 tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:39.018157 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-36d33701-aa51-49a4-aec3-4ede9ed4cd92 tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:39.138512 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-424d3cdf-7d93-415c-a7db-1f5bfe50fe41 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Flavor limits 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:43:39.139730 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-424d3cdf-7d93-415c-a7db-1f5bfe50fe41 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Image limits 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:43:39.140429 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-424d3cdf-7d93-415c-a7db-1f5bfe50fe41 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Flavor pref 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:43:39.141063 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-424d3cdf-7d93-415c-a7db-1f5bfe50fe41 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Image pref 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:43:39.141765 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-424d3cdf-7d93-415c-a7db-1f5bfe50fe41 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:43:39.152944 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-424d3cdf-7d93-415c-a7db-1f5bfe50fe41 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:39.153977 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-424d3cdf-7d93-415c-a7db-1f5bfe50fe41 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:39.154833 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-424d3cdf-7d93-415c-a7db-1f5bfe50fe41 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:39.155916 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-424d3cdf-7d93-415c-a7db-1f5bfe50fe41 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:39.156878 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-424d3cdf-7d93-415c-a7db-1f5bfe50fe41 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:39.157566 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-424d3cdf-7d93-415c-a7db-1f5bfe50fe41 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:39.163659 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-36d33701-aa51-49a4-aec3-4ede9ed4cd92 tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecd189792024ba298f451523033386e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bc84144bf334722b4798851268b5f32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:39.172179 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=100 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:43:39.173561 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-36d33701-aa51-49a4-aec3-4ede9ed4cd92 tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] 10.222.0.43 "GET /compute/v2.1/servers/74d78f04-e2a4-46ce-9da3-fe52e90f2090" status: 200 len: 1667 microversion: 2.1 time: 0.168540 Oct 04 18:43:39.187068 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-424d3cdf-7d93-415c-a7db-1f5bfe50fe41 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Getting quotas for project a9f809b8ae704988961908bef0f3cb24. Resources: {'ram', 'cores', 'instances'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:43:39.190280 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1595/3031] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:39 2022] GET /compute/v2.1/servers/74d78f04-e2a4-46ce-9da3-fe52e90f2090 => generated 1667 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:39.194918 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-424d3cdf-7d93-415c-a7db-1f5bfe50fe41 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Getting quotas for user ae9971b5861f44c1a1da94eda0f8f02d and project a9f809b8ae704988961908bef0f3cb24. Resources: {'ram', 'cores', 'instances'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:43:39.195097 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-2c1492e2-fd8d-4ca9-8bd6-6a48ab854f50 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:39.195628 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-2c1492e2-fd8d-4ca9-8bd6-6a48ab854f50 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] [instance: 601869a4-7b03-4c37-acb2-a7f8a94e3f26] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:39.203128 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2c1492e2-fd8d-4ca9-8bd6-6a48ab854f50 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:39.203610 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2c1492e2-fd8d-4ca9-8bd6-6a48ab854f50 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:39.204269 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2c1492e2-fd8d-4ca9-8bd6-6a48ab854f50 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:39.205182 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2c1492e2-fd8d-4ca9-8bd6-6a48ab854f50 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:39.205827 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2c1492e2-fd8d-4ca9-8bd6-6a48ab854f50 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:39.206441 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2c1492e2-fd8d-4ca9-8bd6-6a48ab854f50 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:39.219623 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-424d3cdf-7d93-415c-a7db-1f5bfe50fe41 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Going to run 1 instances... {{(pid=123595) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:43:39.223075 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-424d3cdf-7d93-415c-a7db-1f5bfe50fe41 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] [instance: 6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e8943ec5-4038-4d4b-b9b9-2415a79f5243',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:43:39.309006 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-424d3cdf-7d93-415c-a7db-1f5bfe50fe41 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.325473 Oct 04 18:43:39.336142 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1437/3032] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 18:43:36 2022] POST /compute/v2.1/servers => generated 405 bytes in 2355 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:43:39.361280 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-b7b652c3-6d13-49b0-b338-f35daeefbd7d tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:39.362393 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-b7b652c3-6d13-49b0-b338-f35daeefbd7d tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] [instance: cbae126b-e99a-4c70-a9e7-0921a41e01ca] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:39.376143 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b7b652c3-6d13-49b0-b338-f35daeefbd7d tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:39.380054 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b7b652c3-6d13-49b0-b338-f35daeefbd7d tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:39.381710 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b7b652c3-6d13-49b0-b338-f35daeefbd7d tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:39.383881 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b7b652c3-6d13-49b0-b338-f35daeefbd7d tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:39.385291 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b7b652c3-6d13-49b0-b338-f35daeefbd7d tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:39.387740 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b7b652c3-6d13-49b0-b338-f35daeefbd7d tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:39.388010 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-2c1492e2-fd8d-4ca9-8bd6-6a48ab854f50 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608fc9ed7cdb487c9bf4b783c26ceeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29876d6805924df882d6861b0f6ab4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:39.396973 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-2c1492e2-fd8d-4ca9-8bd6-6a48ab854f50 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] 10.222.0.43 "GET /compute/v2.1/servers/601869a4-7b03-4c37-acb2-a7f8a94e3f26" status: 200 len: 1313 microversion: 2.1 time: 0.205807 Oct 04 18:43:39.410559 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1596/3033] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:39 2022] GET /compute/v2.1/servers/601869a4-7b03-4c37-acb2-a7f8a94e3f26 => generated 1313 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:39.420618 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-03c42fd3-2bd9-4941-a709-ac06c7325d6f tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:39.421580 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-03c42fd3-2bd9-4941-a709-ac06c7325d6f tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] [instance: 6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:39.487776 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-03c42fd3-2bd9-4941-a709-ac06c7325d6f tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9971b5861f44c1a1da94eda0f8f02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f809b8ae704988961908bef0f3cb24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:39.501168 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-03c42fd3-2bd9-4941-a709-ac06c7325d6f tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] 10.222.0.43 "GET /compute/v2.1/servers/6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75" status: 200 len: 1235 microversion: 2.1 time: 0.089377 Oct 04 18:43:39.501770 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1597/3034] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:39 2022] GET /compute/v2.1/servers/6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75 => generated 1235 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:39.823248 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-b7b652c3-6d13-49b0-b338-f35daeefbd7d tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2df20485e3d4c75b2f4fc7375adebb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f379b9ce44d942959b67137e546191c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:39.849365 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-b7b652c3-6d13-49b0-b338-f35daeefbd7d tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] 10.222.0.43 "GET /compute/v2.1/servers/cbae126b-e99a-4c70-a9e7-0921a41e01ca" status: 200 len: 1252 microversion: 2.1 time: 0.510500 Oct 04 18:43:39.854405 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1438/3035] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:39 2022] GET /compute/v2.1/servers/cbae126b-e99a-4c70-a9e7-0921a41e01ca => generated 1252 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:40.029174 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-ccde919e-b1ba-4646-a359-a1c95bbbf721 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:40.030455 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-ccde919e-b1ba-4646-a359-a1c95bbbf721 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] [instance: f726f3f3-4731-4380-9163-b2273b629810] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:40.040849 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ccde919e-b1ba-4646-a359-a1c95bbbf721 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:40.067776 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ccde919e-b1ba-4646-a359-a1c95bbbf721 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:40.070264 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ccde919e-b1ba-4646-a359-a1c95bbbf721 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:40.074570 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ccde919e-b1ba-4646-a359-a1c95bbbf721 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:40.080684 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ccde919e-b1ba-4646-a359-a1c95bbbf721 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:40.083058 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ccde919e-b1ba-4646-a359-a1c95bbbf721 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:40.209870 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-82c234b3-11fe-4a6b-9462-c9dc428fe7eb tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:40.210565 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-82c234b3-11fe-4a6b-9462-c9dc428fe7eb tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] [instance: 74d78f04-e2a4-46ce-9da3-fe52e90f2090] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:40.227784 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-82c234b3-11fe-4a6b-9462-c9dc428fe7eb tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:40.230612 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-82c234b3-11fe-4a6b-9462-c9dc428fe7eb tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:40.235622 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-82c234b3-11fe-4a6b-9462-c9dc428fe7eb tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:40.236602 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-82c234b3-11fe-4a6b-9462-c9dc428fe7eb tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:40.240546 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-82c234b3-11fe-4a6b-9462-c9dc428fe7eb tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:40.243151 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-82c234b3-11fe-4a6b-9462-c9dc428fe7eb tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:40.971603 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-82c234b3-11fe-4a6b-9462-c9dc428fe7eb tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecd189792024ba298f451523033386e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bc84144bf334722b4798851268b5f32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:40.985009 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-82c234b3-11fe-4a6b-9462-c9dc428fe7eb tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] 10.222.0.43 "GET /compute/v2.1/servers/74d78f04-e2a4-46ce-9da3-fe52e90f2090" status: 200 len: 1667 microversion: 2.1 time: 0.782869 Oct 04 18:43:40.987244 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1439/3036] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:40 2022] GET /compute/v2.1/servers/74d78f04-e2a4-46ce-9da3-fe52e90f2090 => generated 1667 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:43:40.999307 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-d4dd9b07-dc6c-445d-b466-3261f9476fe2 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:41.002399 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-d4dd9b07-dc6c-445d-b466-3261f9476fe2 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] [instance: 601869a4-7b03-4c37-acb2-a7f8a94e3f26] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:41.063064 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d4dd9b07-dc6c-445d-b466-3261f9476fe2 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:41.065013 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d4dd9b07-dc6c-445d-b466-3261f9476fe2 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:41.067463 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d4dd9b07-dc6c-445d-b466-3261f9476fe2 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:41.071915 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d4dd9b07-dc6c-445d-b466-3261f9476fe2 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:41.075508 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d4dd9b07-dc6c-445d-b466-3261f9476fe2 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:41.077584 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d4dd9b07-dc6c-445d-b466-3261f9476fe2 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:41.083896 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-ccde919e-b1ba-4646-a359-a1c95bbbf721 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96e7480de94c43909045ac1087e40cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6bd34bf5540ee95c8144f185eb22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:41.105221 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-ccde919e-b1ba-4646-a359-a1c95bbbf721 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] 10.222.0.43 "GET /compute/v2.1/servers/f726f3f3-4731-4380-9163-b2273b629810" status: 200 len: 1520 microversion: 2.1 time: 1.073793 Oct 04 18:43:41.106501 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1598/3037] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:40 2022] GET /compute/v2.1/servers/f726f3f3-4731-4380-9163-b2273b629810 => generated 1520 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:41.112004 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-9cef3941-a805-4148-9014-4c3056fe3b98 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:41.115015 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-9cef3941-a805-4148-9014-4c3056fe3b98 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] [instance: 6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:41.138054 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9cef3941-a805-4148-9014-4c3056fe3b98 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:41.146121 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9cef3941-a805-4148-9014-4c3056fe3b98 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:41.146997 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9cef3941-a805-4148-9014-4c3056fe3b98 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:41.148378 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9cef3941-a805-4148-9014-4c3056fe3b98 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:41.150424 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9cef3941-a805-4148-9014-4c3056fe3b98 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:41.151044 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9cef3941-a805-4148-9014-4c3056fe3b98 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:41.283710 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-9cef3941-a805-4148-9014-4c3056fe3b98 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9971b5861f44c1a1da94eda0f8f02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f809b8ae704988961908bef0f3cb24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:41.298477 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-9cef3941-a805-4148-9014-4c3056fe3b98 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] 10.222.0.43 "GET /compute/v2.1/servers/6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75" status: 200 len: 1287 microversion: 2.1 time: 0.189588 Oct 04 18:43:41.299634 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1599/3038] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:41 2022] GET /compute/v2.1/servers/6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75 => generated 1287 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:41.309672 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-5b5da865-0d74-41f6-af41-63a565e8ba4c tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:41.310649 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-5b5da865-0d74-41f6-af41-63a565e8ba4c tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] [instance: cbae126b-e99a-4c70-a9e7-0921a41e01ca] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:41.333819 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5b5da865-0d74-41f6-af41-63a565e8ba4c tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:41.337820 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5b5da865-0d74-41f6-af41-63a565e8ba4c tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:41.338539 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5b5da865-0d74-41f6-af41-63a565e8ba4c tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:41.349592 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5b5da865-0d74-41f6-af41-63a565e8ba4c tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:41.350519 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5b5da865-0d74-41f6-af41-63a565e8ba4c tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:41.351221 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5b5da865-0d74-41f6-af41-63a565e8ba4c tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:41.402716 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5b5da865-0d74-41f6-af41-63a565e8ba4c tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:41.407165 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5b5da865-0d74-41f6-af41-63a565e8ba4c tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:41.407907 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5b5da865-0d74-41f6-af41-63a565e8ba4c tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:41.408609 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.objects.instance [None req-5b5da865-0d74-41f6-af41-63a565e8ba4c tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Lazy-loading 'fault' on Instance uuid cbae126b-e99a-4c70-a9e7-0921a41e01ca {{(pid=123596) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:43:42.219516 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-5b5da865-0d74-41f6-af41-63a565e8ba4c tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2df20485e3d4c75b2f4fc7375adebb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f379b9ce44d942959b67137e546191c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:42.222420 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-d4dd9b07-dc6c-445d-b466-3261f9476fe2 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608fc9ed7cdb487c9bf4b783c26ceeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29876d6805924df882d6861b0f6ab4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:42.229322 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-5b5da865-0d74-41f6-af41-63a565e8ba4c tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] 10.222.0.43 "GET /compute/v2.1/servers/cbae126b-e99a-4c70-a9e7-0921a41e01ca" status: 200 len: 1211 microversion: 2.1 time: 0.928308 Oct 04 18:43:42.235840 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-d4dd9b07-dc6c-445d-b466-3261f9476fe2 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] 10.222.0.43 "GET /compute/v2.1/servers/601869a4-7b03-4c37-acb2-a7f8a94e3f26" status: 200 len: 1313 microversion: 2.1 time: 1.244235 Oct 04 18:43:42.236398 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1600/3039] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:41 2022] GET /compute/v2.1/servers/cbae126b-e99a-4c70-a9e7-0921a41e01ca => generated 1211 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:42.244016 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-c76a0490-a515-4ed2-b1d2-149cecdeebd0 tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:42.246741 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-c76a0490-a515-4ed2-b1d2-149cecdeebd0 tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] [instance: 74d78f04-e2a4-46ce-9da3-fe52e90f2090] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:42.253560 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c76a0490-a515-4ed2-b1d2-149cecdeebd0 tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:42.254375 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c76a0490-a515-4ed2-b1d2-149cecdeebd0 tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:42.254767 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1440/3040] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:40 2022] GET /compute/v2.1/servers/601869a4-7b03-4c37-acb2-a7f8a94e3f26 => generated 1313 bytes in 1266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:42.255312 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c76a0490-a515-4ed2-b1d2-149cecdeebd0 tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:42.256261 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c76a0490-a515-4ed2-b1d2-149cecdeebd0 tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:42.256947 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c76a0490-a515-4ed2-b1d2-149cecdeebd0 tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:42.257686 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c76a0490-a515-4ed2-b1d2-149cecdeebd0 tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:42.261321 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-7fac57da-2c23-42bc-a6a8-80b391d1a987 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:42.267038 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-7fac57da-2c23-42bc-a6a8-80b391d1a987 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] [instance: f726f3f3-4731-4380-9163-b2273b629810] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:42.283028 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7fac57da-2c23-42bc-a6a8-80b391d1a987 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:42.283533 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7fac57da-2c23-42bc-a6a8-80b391d1a987 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:42.284062 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7fac57da-2c23-42bc-a6a8-80b391d1a987 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:42.285816 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7fac57da-2c23-42bc-a6a8-80b391d1a987 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:42.286284 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7fac57da-2c23-42bc-a6a8-80b391d1a987 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:42.286971 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7fac57da-2c23-42bc-a6a8-80b391d1a987 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:42.660045 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-c76a0490-a515-4ed2-b1d2-149cecdeebd0 tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecd189792024ba298f451523033386e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bc84144bf334722b4798851268b5f32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:42.673247 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-c76a0490-a515-4ed2-b1d2-149cecdeebd0 tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] 10.222.0.43 "GET /compute/v2.1/servers/74d78f04-e2a4-46ce-9da3-fe52e90f2090" status: 200 len: 1599 microversion: 2.1 time: 0.435421 Oct 04 18:43:42.674193 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1601/3041] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:42 2022] GET /compute/v2.1/servers/74d78f04-e2a4-46ce-9da3-fe52e90f2090 => generated 1599 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:42.679062 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-eca7d318-57d2-4579-95a0-736dc7dcdbbf tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:42.679680 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-eca7d318-57d2-4579-95a0-736dc7dcdbbf tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] [instance: 6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:42.702220 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-eca7d318-57d2-4579-95a0-736dc7dcdbbf tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:42.702983 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-eca7d318-57d2-4579-95a0-736dc7dcdbbf tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:42.704196 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-eca7d318-57d2-4579-95a0-736dc7dcdbbf tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:42.705090 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-eca7d318-57d2-4579-95a0-736dc7dcdbbf tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:42.707865 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-eca7d318-57d2-4579-95a0-736dc7dcdbbf tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:42.708711 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-eca7d318-57d2-4579-95a0-736dc7dcdbbf tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:42.897305 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-eca7d318-57d2-4579-95a0-736dc7dcdbbf tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9971b5861f44c1a1da94eda0f8f02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f809b8ae704988961908bef0f3cb24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:42.918352 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-eca7d318-57d2-4579-95a0-736dc7dcdbbf tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] 10.222.0.43 "GET /compute/v2.1/servers/6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75" status: 200 len: 1293 microversion: 2.1 time: 0.230064 Oct 04 18:43:42.919906 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1602/3042] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:42 2022] GET /compute/v2.1/servers/6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75 => generated 1293 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:43.176440 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-e6a30cde-a90f-421e-be6e-08b6e9c4d089 req-006f2a5e-ed05-41da-a852-4235c64ab5f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74d78f04-e2a4-46ce-9da3-fe52e90f2090", "name": "network-vif-deleted", "tag": "28ad400f-e2ec-4faf-bb1a-cf2726a0831a"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:43:43.215543 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-e6a30cde-a90f-421e-be6e-08b6e9c4d089 req-006f2a5e-ed05-41da-a852-4235c64ab5f6 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:43.229195 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-e6a30cde-a90f-421e-be6e-08b6e9c4d089 req-006f2a5e-ed05-41da-a852-4235c64ab5f6 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:43.229965 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-e6a30cde-a90f-421e-be6e-08b6e9c4d089 req-006f2a5e-ed05-41da-a852-4235c64ab5f6 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:43.296746 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-e6a30cde-a90f-421e-be6e-08b6e9c4d089 req-006f2a5e-ed05-41da-a852-4235c64ab5f6 service nova] Creating event network-vif-deleted:28ad400f-e2ec-4faf-bb1a-cf2726a0831a for instance 74d78f04-e2a4-46ce-9da3-fe52e90f2090 on n-h2-851028-13 Oct 04 18:43:43.316265 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-e6a30cde-a90f-421e-be6e-08b6e9c4d089 req-006f2a5e-ed05-41da-a852-4235c64ab5f6 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.144083 Oct 04 18:43:43.318372 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1603/3043] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:43:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:43:43.328460 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-949e7431-a5cf-40e6-aa06-bd35640936c6 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:43.338721 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-949e7431-a5cf-40e6-aa06-bd35640936c6 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] [instance: cbae126b-e99a-4c70-a9e7-0921a41e01ca] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:43.384501 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-949e7431-a5cf-40e6-aa06-bd35640936c6 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:43.391898 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-949e7431-a5cf-40e6-aa06-bd35640936c6 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:43.394813 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-949e7431-a5cf-40e6-aa06-bd35640936c6 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:43.398685 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-949e7431-a5cf-40e6-aa06-bd35640936c6 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:43.402337 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-949e7431-a5cf-40e6-aa06-bd35640936c6 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:43.406795 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-949e7431-a5cf-40e6-aa06-bd35640936c6 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:43.501777 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-949e7431-a5cf-40e6-aa06-bd35640936c6 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] HTTP exception thrown: Instance cbae126b-e99a-4c70-a9e7-0921a41e01ca could not be found. Oct 04 18:43:43.515919 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-949e7431-a5cf-40e6-aa06-bd35640936c6 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Request method failure captured: Oct 04 18:43:43.515919 n-d-851028-13 devstack@n-api.service[123596]: request: GET /compute/v2.1/servers/cbae126b-e99a-4c70-a9e7-0921a41e01ca HTTP/1.1 Oct 04 18:43:43.515919 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:43:43.515919 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:43:43.515919 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:43:43.515919 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 18:43:43.515919 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:43:43.515919 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:43:43.515919 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:43:43.515919 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:43:43.515919 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPH5ADZL2yGANDAxjGIhfuSQh5_SV2TADFgF_WK5yTZLylOOzfuRX4OsGp3MioBrjk4T4K0bHebEzJuqUmzCZqSe13BIGRYeRicx5GvANPp_RWEO59zQXUbHR-j4dC571P2B7CPjzpTBKS_s3DQ9WbxhqEHExBhM8WS97qG7Ur149LWg Oct 04 18:43:43.515919 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:43:43.515919 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:43:43.515919 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:43:43.515919 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:43:43.515919 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:43:43.515919 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:43:43.515919 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: f379b9ce44d942959b67137e546191c3 Oct 04 18:43:43.515919 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-ServersTestBootFromVolume-1289404622 Oct 04 18:43:43.515919 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 18:43:43.515919 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 18:43:43.515919 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/f379b9ce44d942959b67137e546191c3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_f379b9ce44d942959b67137e546191c3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f379b9ce44d942959b67137e546191c3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f379b9ce44d942959b67137e546191c3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:43:43.515919 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-ServersTestBootFromVolume-1289404622 Oct 04 18:43:43.515919 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: f379b9ce44d942959b67137e546191c3 Oct 04 18:43:43.515919 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-ServersTestBootFromVolume-1289404622 Oct 04 18:43:43.515919 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-ServersTestBootFromVolume-1289404622-project Oct 04 18:43:43.515919 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:43:43.515919 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:43:43.515919 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: b2df20485e3d4c75b2f4fc7375adebb8 Oct 04 18:43:43.515919 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-ServersTestBootFromVolume-1289404622-project Oct 04 18:43:43.515919 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 18:43:43.515919 n-d-851028-13 devstack@n-api.service[123596]: exception: Instance cbae126b-e99a-4c70-a9e7-0921a41e01ca could not be found. Oct 04 18:43:43.515919 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': 'cbae126b-e99a-4c70-a9e7-0921a41e01ca'} Oct 04 18:43:43.515919 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:43:43.515919 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:43:43.515919 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:43:43.515919 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:43:43.515919 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:43:43.515919 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:43:43.515919 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:43:43.515919 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:43:43.515919 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:43:43.515919 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:43:43.515919 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cbae126b-e99a-4c70-a9e7-0921a41e01ca could not be found. Oct 04 18:43:43.515919 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:43:43.515919 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:43:43.515919 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:43:43.515919 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:43:43.515919 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:43:43.515919 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:43:43.515919 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:43:43.515919 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:43:43.515919 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:43:43.515919 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:43:43.515919 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:43:43.515919 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:43:43.515919 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:43:43.515919 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:43:43.515919 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:43:43.515919 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:43:43.515919 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cbae126b-e99a-4c70-a9e7-0921a41e01ca could not be found. Oct 04 18:43:43.515919 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:43:43.515919 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:43:43.515919 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:43:43.521287 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:43:43.521287 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:43:43.521287 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:43:43.521287 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:43:43.521287 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:43:43.521287 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cbae126b-e99a-4c70-a9e7-0921a41e01ca could not be found. Oct 04 18:43:43.521287 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:43:43.524205 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-949e7431-a5cf-40e6-aa06-bd35640936c6 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Returning 404 to user: Instance cbae126b-e99a-4c70-a9e7-0921a41e01ca could not be found. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:43:43.529940 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-949e7431-a5cf-40e6-aa06-bd35640936c6 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] 10.222.0.43 "GET /compute/v2.1/servers/cbae126b-e99a-4c70-a9e7-0921a41e01ca" status: 404 len: 111 microversion: 2.1 time: 0.210068 Oct 04 18:43:43.538456 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1604/3044] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:43 2022] GET /compute/v2.1/servers/cbae126b-e99a-4c70-a9e7-0921a41e01ca => generated 111 bytes in 219 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:43:43.567837 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-d292fb76-5492-4119-bcdb-dd7c94a3cc63 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:43.568960 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-d292fb76-5492-4119-bcdb-dd7c94a3cc63 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] [instance: 601869a4-7b03-4c37-acb2-a7f8a94e3f26] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:43.602321 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d292fb76-5492-4119-bcdb-dd7c94a3cc63 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:43.611851 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d292fb76-5492-4119-bcdb-dd7c94a3cc63 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:43.613375 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d292fb76-5492-4119-bcdb-dd7c94a3cc63 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:43.617998 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d292fb76-5492-4119-bcdb-dd7c94a3cc63 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:43.623534 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d292fb76-5492-4119-bcdb-dd7c94a3cc63 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:43.625975 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d292fb76-5492-4119-bcdb-dd7c94a3cc63 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:43.778718 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-7fac57da-2c23-42bc-a6a8-80b391d1a987 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96e7480de94c43909045ac1087e40cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6bd34bf5540ee95c8144f185eb22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:43.813018 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-7fac57da-2c23-42bc-a6a8-80b391d1a987 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] 10.222.0.43 "GET /compute/v2.1/servers/f726f3f3-4731-4380-9163-b2273b629810" status: 200 len: 1520 microversion: 2.1 time: 1.556996 Oct 04 18:43:43.815451 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1441/3045] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:42 2022] GET /compute/v2.1/servers/f726f3f3-4731-4380-9163-b2273b629810 => generated 1520 bytes in 1560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:43.824345 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-af45ae88-abbf-4d24-9bc5-3adb401e9915 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] Calling method '.version_select at 0x7fb21ec94a60>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:43.890065 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-af45ae88-abbf-4d24-9bc5-3adb401e9915 tempest-ServersTestBootFromVolume-1289404622 tempest-ServersTestBootFromVolume-1289404622-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1624991526" status: 202 len: 0 microversion: 2.1 time: 0.070028 Oct 04 18:43:43.891633 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1442/3046] 10.222.0.43 () {58 vars in 1221 bytes} [Tue Oct 4 18:43:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1624991526 => generated 0 bytes in 72 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:43:43.907347 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-2ec7c744-2b1a-4505-bda4-5709829fbcea tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:43.910178 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-2ec7c744-2b1a-4505-bda4-5709829fbcea tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] [instance: 74d78f04-e2a4-46ce-9da3-fe52e90f2090] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:43.923153 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:43:43.924957 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2ec7c744-2b1a-4505-bda4-5709829fbcea tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:43.928061 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2ec7c744-2b1a-4505-bda4-5709829fbcea tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:43.928707 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2ec7c744-2b1a-4505-bda4-5709829fbcea tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:43.935587 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2ec7c744-2b1a-4505-bda4-5709829fbcea tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:43.936409 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2ec7c744-2b1a-4505-bda4-5709829fbcea tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:43.937015 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2ec7c744-2b1a-4505-bda4-5709829fbcea tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:44.026115 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2ec7c744-2b1a-4505-bda4-5709829fbcea tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:44.027331 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2ec7c744-2b1a-4505-bda4-5709829fbcea tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:44.037869 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2ec7c744-2b1a-4505-bda4-5709829fbcea tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:44.038628 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.objects.instance [None req-2ec7c744-2b1a-4505-bda4-5709829fbcea tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] Lazy-loading 'fault' on Instance uuid 74d78f04-e2a4-46ce-9da3-fe52e90f2090 {{(pid=123595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:43:44.132015 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-2ec7c744-2b1a-4505-bda4-5709829fbcea tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecd189792024ba298f451523033386e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bc84144bf334722b4798851268b5f32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:44.144083 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-2ec7c744-2b1a-4505-bda4-5709829fbcea tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] 10.222.0.43 "GET /compute/v2.1/servers/74d78f04-e2a4-46ce-9da3-fe52e90f2090" status: 200 len: 1316 microversion: 2.1 time: 0.241633 Oct 04 18:43:44.149876 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1443/3047] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:43 2022] GET /compute/v2.1/servers/74d78f04-e2a4-46ce-9da3-fe52e90f2090 => generated 1316 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:44.161464 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-93fef794-d98a-4db9-9849-a36c1b43d585 req-a594efb3-4dae-42be-91ea-2e13b81c638c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "601869a4-7b03-4c37-acb2-a7f8a94e3f26", "name": "network-vif-plugged", "status": "completed", "tag": "4e55aee8-a71d-40a5-bff3-55f31acb30ca"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:43:44.188781 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-93fef794-d98a-4db9-9849-a36c1b43d585 req-a594efb3-4dae-42be-91ea-2e13b81c638c service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:44.188904 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-93fef794-d98a-4db9-9849-a36c1b43d585 req-a594efb3-4dae-42be-91ea-2e13b81c638c service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:44.197482 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-93fef794-d98a-4db9-9849-a36c1b43d585 req-a594efb3-4dae-42be-91ea-2e13b81c638c service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:44.221895 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-93fef794-d98a-4db9-9849-a36c1b43d585 req-a594efb3-4dae-42be-91ea-2e13b81c638c service nova] Creating event network-vif-plugged:4e55aee8-a71d-40a5-bff3-55f31acb30ca for instance 601869a4-7b03-4c37-acb2-a7f8a94e3f26 on n-h2-851028-13 Oct 04 18:43:44.228983 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-93fef794-d98a-4db9-9849-a36c1b43d585 req-a594efb3-4dae-42be-91ea-2e13b81c638c service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075678 Oct 04 18:43:44.233620 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1444/3048] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:43:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:43:44.245824 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-0d772d46-9c40-49d7-a6be-75685ff88b4e tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:44.262230 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-0d772d46-9c40-49d7-a6be-75685ff88b4e tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] [instance: 6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:44.274760 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0d772d46-9c40-49d7-a6be-75685ff88b4e tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:44.277736 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0d772d46-9c40-49d7-a6be-75685ff88b4e tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:44.281752 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0d772d46-9c40-49d7-a6be-75685ff88b4e tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:44.282511 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0d772d46-9c40-49d7-a6be-75685ff88b4e tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:44.283013 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0d772d46-9c40-49d7-a6be-75685ff88b4e tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:44.283468 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0d772d46-9c40-49d7-a6be-75685ff88b4e tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:44.385561 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-d292fb76-5492-4119-bcdb-dd7c94a3cc63 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608fc9ed7cdb487c9bf4b783c26ceeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29876d6805924df882d6861b0f6ab4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:44.395979 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-d292fb76-5492-4119-bcdb-dd7c94a3cc63 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] 10.222.0.43 "GET /compute/v2.1/servers/601869a4-7b03-4c37-acb2-a7f8a94e3f26" status: 200 len: 1313 microversion: 2.1 time: 0.852731 Oct 04 18:43:44.411375 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1605/3049] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:43 2022] GET /compute/v2.1/servers/601869a4-7b03-4c37-acb2-a7f8a94e3f26 => generated 1313 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:44.585724 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-0d772d46-9c40-49d7-a6be-75685ff88b4e tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9971b5861f44c1a1da94eda0f8f02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f809b8ae704988961908bef0f3cb24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:44.609920 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-0d772d46-9c40-49d7-a6be-75685ff88b4e tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] 10.222.0.43 "GET /compute/v2.1/servers/6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75" status: 200 len: 1293 microversion: 2.1 time: 0.369340 Oct 04 18:43:44.615575 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1445/3050] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:44 2022] GET /compute/v2.1/servers/6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75 => generated 1293 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:44.845852 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-49cdaf32-9a7a-4b8e-b1d6-cb6eb04b7c24 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:44.846752 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-49cdaf32-9a7a-4b8e-b1d6-cb6eb04b7c24 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] [instance: f726f3f3-4731-4380-9163-b2273b629810] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:44.867825 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-49cdaf32-9a7a-4b8e-b1d6-cb6eb04b7c24 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:44.868430 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-49cdaf32-9a7a-4b8e-b1d6-cb6eb04b7c24 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:44.869015 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-49cdaf32-9a7a-4b8e-b1d6-cb6eb04b7c24 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:44.874506 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-49cdaf32-9a7a-4b8e-b1d6-cb6eb04b7c24 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:44.875222 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-49cdaf32-9a7a-4b8e-b1d6-cb6eb04b7c24 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:44.876001 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-49cdaf32-9a7a-4b8e-b1d6-cb6eb04b7c24 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:45.177310 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-d2d64722-8e49-44cb-acdc-1a5221b9c22f tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:45.178579 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-d2d64722-8e49-44cb-acdc-1a5221b9c22f tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] [instance: 74d78f04-e2a4-46ce-9da3-fe52e90f2090] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:45.192924 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d2d64722-8e49-44cb-acdc-1a5221b9c22f tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:45.196633 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d2d64722-8e49-44cb-acdc-1a5221b9c22f tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:45.200544 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d2d64722-8e49-44cb-acdc-1a5221b9c22f tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:45.205067 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d2d64722-8e49-44cb-acdc-1a5221b9c22f tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:45.212393 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d2d64722-8e49-44cb-acdc-1a5221b9c22f tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:45.213482 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d2d64722-8e49-44cb-acdc-1a5221b9c22f tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:45.236409 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-49cdaf32-9a7a-4b8e-b1d6-cb6eb04b7c24 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96e7480de94c43909045ac1087e40cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6bd34bf5540ee95c8144f185eb22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:45.249333 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-49cdaf32-9a7a-4b8e-b1d6-cb6eb04b7c24 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] 10.222.0.43 "GET /compute/v2.1/servers/f726f3f3-4731-4380-9163-b2273b629810" status: 200 len: 1520 microversion: 2.1 time: 0.410338 Oct 04 18:43:45.267097 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-d2d64722-8e49-44cb-acdc-1a5221b9c22f tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] HTTP exception thrown: Instance 74d78f04-e2a4-46ce-9da3-fe52e90f2090 could not be found. Oct 04 18:43:45.269514 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1606/3051] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:44 2022] GET /compute/v2.1/servers/f726f3f3-4731-4380-9163-b2273b629810 => generated 1520 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:45.271561 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-d2d64722-8e49-44cb-acdc-1a5221b9c22f tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] Request method failure captured: Oct 04 18:43:45.271561 n-d-851028-13 devstack@n-api.service[123595]: request: GET /compute/v2.1/servers/74d78f04-e2a4-46ce-9da3-fe52e90f2090 HTTP/1.1 Oct 04 18:43:45.271561 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 18:43:45.271561 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 18:43:45.271561 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 18:43:45.271561 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 0 Oct 04 18:43:45.271561 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 18:43:45.271561 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 18:43:45.271561 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 18:43:45.271561 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 18:43:45.271561 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPH6OsS6LR22QgJu1eZpgxqS5J09yAliotkj5_7msrBwv3QOiqcDUOIgLizIsdOmPEEcbnF0UzVQyN7qP7rn7-J-Q4DZR5j3suAIEGd0D3ZvroDhCzoqQJMFMkeUq0Q9XG9aUuKJ0HbxPpWqNKi8Iv2Yynpvy97VxRzEChaxbTSO7D2E Oct 04 18:43:45.271561 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 18:43:45.271561 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 18:43:45.271561 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 18:43:45.271561 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 18:43:45.271561 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 18:43:45.271561 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 18:43:45.271561 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: 1bc84144bf334722b4798851268b5f32 Oct 04 18:43:45.271561 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-ServersTestFqdnHostnames-593030245 Oct 04 18:43:45.271561 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 18:43:45.271561 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 18:43:45.271561 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/1bc84144bf334722b4798851268b5f32"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_1bc84144bf334722b4798851268b5f32"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1bc84144bf334722b4798851268b5f32"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1bc84144bf334722b4798851268b5f32"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:43:45.271561 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-ServersTestFqdnHostnames-593030245 Oct 04 18:43:45.271561 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: 1bc84144bf334722b4798851268b5f32 Oct 04 18:43:45.271561 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-ServersTestFqdnHostnames-593030245 Oct 04 18:43:45.271561 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-ServersTestFqdnHostnames-593030245-project Oct 04 18:43:45.271561 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 18:43:45.271561 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 18:43:45.271561 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: 4ecd189792024ba298f451523033386e Oct 04 18:43:45.271561 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-ServersTestFqdnHostnames-593030245-project Oct 04 18:43:45.271561 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 18:43:45.271561 n-d-851028-13 devstack@n-api.service[123595]: exception: Instance 74d78f04-e2a4-46ce-9da3-fe52e90f2090 could not be found. Oct 04 18:43:45.271561 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': '74d78f04-e2a4-46ce-9da3-fe52e90f2090'} Oct 04 18:43:45.271561 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:43:45.271561 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:43:45.271561 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:43:45.271561 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:43:45.271561 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:43:45.271561 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:43:45.271561 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:43:45.271561 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:43:45.271561 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:43:45.271561 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:43:45.271561 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74d78f04-e2a4-46ce-9da3-fe52e90f2090 could not be found. Oct 04 18:43:45.271561 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:43:45.271561 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:43:45.271561 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:43:45.271561 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:43:45.271561 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:43:45.271561 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:43:45.271561 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:43:45.271561 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:43:45.271561 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:43:45.271561 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:43:45.271561 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:43:45.271561 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:43:45.271561 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:43:45.271561 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:43:45.271561 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:43:45.271561 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:43:45.271561 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74d78f04-e2a4-46ce-9da3-fe52e90f2090 could not be found. Oct 04 18:43:45.271561 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:43:45.271561 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:43:45.271561 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:43:45.276621 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:43:45.276621 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:43:45.276621 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:43:45.276621 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:43:45.276621 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:43:45.276621 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74d78f04-e2a4-46ce-9da3-fe52e90f2090 could not be found. Oct 04 18:43:45.276621 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:43:45.283487 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-d2d64722-8e49-44cb-acdc-1a5221b9c22f tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] Returning 404 to user: Instance 74d78f04-e2a4-46ce-9da3-fe52e90f2090 could not be found. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:43:45.285433 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-d2d64722-8e49-44cb-acdc-1a5221b9c22f tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] 10.222.0.43 "GET /compute/v2.1/servers/74d78f04-e2a4-46ce-9da3-fe52e90f2090" status: 404 len: 111 microversion: 2.1 time: 0.111225 Oct 04 18:43:45.288116 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1446/3052] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:45 2022] GET /compute/v2.1/servers/74d78f04-e2a4-46ce-9da3-fe52e90f2090 => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:43:45.297949 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-aee848d6-3e08-42d0-9a68-6d99cbfe302e tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] Calling method '.version_select at 0x7fb21eaa83a0>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:45.340582 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-aee848d6-3e08-42d0-9a68-6d99cbfe302e tempest-ServersTestFqdnHostnames-593030245 tempest-ServersTestFqdnHostnames-593030245-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1350490735" status: 202 len: 0 microversion: 2.1 time: 0.049419 Oct 04 18:43:45.342510 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1607/3053] 10.222.0.43 () {58 vars in 1221 bytes} [Tue Oct 4 18:43:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1350490735 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:43:45.432206 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-3f13bea0-cae5-498c-be7a-707829acdc95 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:45.433976 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-3f13bea0-cae5-498c-be7a-707829acdc95 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] [instance: 601869a4-7b03-4c37-acb2-a7f8a94e3f26] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:45.450011 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3f13bea0-cae5-498c-be7a-707829acdc95 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:45.453409 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3f13bea0-cae5-498c-be7a-707829acdc95 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:45.455452 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3f13bea0-cae5-498c-be7a-707829acdc95 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:45.457930 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3f13bea0-cae5-498c-be7a-707829acdc95 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:45.461764 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3f13bea0-cae5-498c-be7a-707829acdc95 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:45.467183 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3f13bea0-cae5-498c-be7a-707829acdc95 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:45.639759 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-e86a5c60-c07f-4977-8728-45a72874d63f tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:45.640379 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-e86a5c60-c07f-4977-8728-45a72874d63f tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] [instance: 6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:45.659428 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e86a5c60-c07f-4977-8728-45a72874d63f tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:45.663227 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e86a5c60-c07f-4977-8728-45a72874d63f tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:45.663796 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e86a5c60-c07f-4977-8728-45a72874d63f tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:45.665955 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e86a5c60-c07f-4977-8728-45a72874d63f tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:45.668570 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e86a5c60-c07f-4977-8728-45a72874d63f tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:45.673089 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e86a5c60-c07f-4977-8728-45a72874d63f tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:46.024959 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-e86a5c60-c07f-4977-8728-45a72874d63f tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9971b5861f44c1a1da94eda0f8f02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f809b8ae704988961908bef0f3cb24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:46.040479 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-e86a5c60-c07f-4977-8728-45a72874d63f tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] 10.222.0.43 "GET /compute/v2.1/servers/6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75" status: 200 len: 1293 microversion: 2.1 time: 0.405064 Oct 04 18:43:46.051465 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1608/3054] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:45 2022] GET /compute/v2.1/servers/6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75 => generated 1293 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:43:46.110066 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-3f13bea0-cae5-498c-be7a-707829acdc95 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608fc9ed7cdb487c9bf4b783c26ceeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29876d6805924df882d6861b0f6ab4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:46.122157 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-3f13bea0-cae5-498c-be7a-707829acdc95 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] 10.222.0.43 "GET /compute/v2.1/servers/601869a4-7b03-4c37-acb2-a7f8a94e3f26" status: 200 len: 1313 microversion: 2.1 time: 0.690616 Oct 04 18:43:46.124596 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1447/3055] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:45 2022] GET /compute/v2.1/servers/601869a4-7b03-4c37-acb2-a7f8a94e3f26 => generated 1313 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:46.275995 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-a48e7d3f-4340-4abe-84db-b356cc5905df tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:46.277653 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-a48e7d3f-4340-4abe-84db-b356cc5905df tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] [instance: f726f3f3-4731-4380-9163-b2273b629810] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:46.295510 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a48e7d3f-4340-4abe-84db-b356cc5905df tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:46.306050 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a48e7d3f-4340-4abe-84db-b356cc5905df tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:46.310271 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a48e7d3f-4340-4abe-84db-b356cc5905df tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:46.313814 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a48e7d3f-4340-4abe-84db-b356cc5905df tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:46.318785 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a48e7d3f-4340-4abe-84db-b356cc5905df tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:46.323129 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a48e7d3f-4340-4abe-84db-b356cc5905df tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:46.395136 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:43:47.077249 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-269b0589-7a06-4f33-8902-be683108d7e6 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:47.078182 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-269b0589-7a06-4f33-8902-be683108d7e6 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] [instance: 6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:47.102845 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-269b0589-7a06-4f33-8902-be683108d7e6 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:47.107516 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-269b0589-7a06-4f33-8902-be683108d7e6 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:47.108129 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-269b0589-7a06-4f33-8902-be683108d7e6 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:47.113129 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-269b0589-7a06-4f33-8902-be683108d7e6 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:47.117672 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-269b0589-7a06-4f33-8902-be683108d7e6 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:47.119124 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-269b0589-7a06-4f33-8902-be683108d7e6 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:47.332090 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-a48e7d3f-4340-4abe-84db-b356cc5905df tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96e7480de94c43909045ac1087e40cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6bd34bf5540ee95c8144f185eb22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:47.347989 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-a48e7d3f-4340-4abe-84db-b356cc5905df tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] 10.222.0.43 "GET /compute/v2.1/servers/f726f3f3-4731-4380-9163-b2273b629810" status: 200 len: 1520 microversion: 2.1 time: 1.072608 Oct 04 18:43:47.348821 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1609/3056] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:46 2022] GET /compute/v2.1/servers/f726f3f3-4731-4380-9163-b2273b629810 => generated 1520 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:47.353680 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-b5715291-b7f9-48e4-8b97-7ad42207743a tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:47.361633 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-b5715291-b7f9-48e4-8b97-7ad42207743a tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] [instance: 601869a4-7b03-4c37-acb2-a7f8a94e3f26] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:47.378567 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b5715291-b7f9-48e4-8b97-7ad42207743a tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:47.379360 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b5715291-b7f9-48e4-8b97-7ad42207743a tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:47.381542 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b5715291-b7f9-48e4-8b97-7ad42207743a tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:47.382532 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b5715291-b7f9-48e4-8b97-7ad42207743a tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:47.386715 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b5715291-b7f9-48e4-8b97-7ad42207743a tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:47.387377 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b5715291-b7f9-48e4-8b97-7ad42207743a tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:47.825393 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-b5715291-b7f9-48e4-8b97-7ad42207743a tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608fc9ed7cdb487c9bf4b783c26ceeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29876d6805924df882d6861b0f6ab4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:47.838413 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-b5715291-b7f9-48e4-8b97-7ad42207743a tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] 10.222.0.43 "GET /compute/v2.1/servers/601869a4-7b03-4c37-acb2-a7f8a94e3f26" status: 200 len: 1463 microversion: 2.1 time: 0.488247 Oct 04 18:43:47.839676 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1610/3057] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:47 2022] GET /compute/v2.1/servers/601869a4-7b03-4c37-acb2-a7f8a94e3f26 => generated 1463 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:47.885249 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-80c67f38-d2c8-429e-9eab-848e86c60c5b tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:47.890035 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-80c67f38-d2c8-429e-9eab-848e86c60c5b tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] [instance: cf78a645-458e-4dc2-a60d-a51754ab6258] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:47.931505 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-80c67f38-d2c8-429e-9eab-848e86c60c5b tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:47.935483 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-80c67f38-d2c8-429e-9eab-848e86c60c5b tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:47.937327 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-80c67f38-d2c8-429e-9eab-848e86c60c5b tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:47.940208 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-80c67f38-d2c8-429e-9eab-848e86c60c5b tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:47.943457 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-80c67f38-d2c8-429e-9eab-848e86c60c5b tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:47.948019 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-80c67f38-d2c8-429e-9eab-848e86c60c5b tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:48.096095 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-269b0589-7a06-4f33-8902-be683108d7e6 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9971b5861f44c1a1da94eda0f8f02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f809b8ae704988961908bef0f3cb24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:48.116219 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-269b0589-7a06-4f33-8902-be683108d7e6 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] 10.222.0.43 "GET /compute/v2.1/servers/6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75" status: 200 len: 1360 microversion: 2.1 time: 1.043246 Oct 04 18:43:48.117523 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1448/3058] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:47 2022] GET /compute/v2.1/servers/6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75 => generated 1360 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:43:48.373502 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-c4eea7d3-da95-4bd4-8265-b8a32f4d8a2c tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:48.375003 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-c4eea7d3-da95-4bd4-8265-b8a32f4d8a2c tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] [instance: f726f3f3-4731-4380-9163-b2273b629810] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:48.388650 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c4eea7d3-da95-4bd4-8265-b8a32f4d8a2c tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:48.396501 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c4eea7d3-da95-4bd4-8265-b8a32f4d8a2c tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:48.397706 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c4eea7d3-da95-4bd4-8265-b8a32f4d8a2c tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:48.398719 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c4eea7d3-da95-4bd4-8265-b8a32f4d8a2c tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:48.400347 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c4eea7d3-da95-4bd4-8265-b8a32f4d8a2c tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:48.401090 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c4eea7d3-da95-4bd4-8265-b8a32f4d8a2c tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:48.879615 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-c4eea7d3-da95-4bd4-8265-b8a32f4d8a2c tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96e7480de94c43909045ac1087e40cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6bd34bf5540ee95c8144f185eb22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:48.889343 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-c4eea7d3-da95-4bd4-8265-b8a32f4d8a2c tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] 10.222.0.43 "GET /compute/v2.1/servers/f726f3f3-4731-4380-9163-b2273b629810" status: 200 len: 1520 microversion: 2.1 time: 0.520480 Oct 04 18:43:48.889652 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1449/3059] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:48 2022] GET /compute/v2.1/servers/f726f3f3-4731-4380-9163-b2273b629810 => generated 1520 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:43:48.973643 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-451acb7c-9c25-41ca-a3b2-701c8ea2d8e6 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:48.974502 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-451acb7c-9c25-41ca-a3b2-701c8ea2d8e6 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 82b86465-afb0-49ef-9932-1538010c1ae5] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:48.981882 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-451acb7c-9c25-41ca-a3b2-701c8ea2d8e6 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:48.982392 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-451acb7c-9c25-41ca-a3b2-701c8ea2d8e6 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:48.982811 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-451acb7c-9c25-41ca-a3b2-701c8ea2d8e6 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:48.983817 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-451acb7c-9c25-41ca-a3b2-701c8ea2d8e6 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:48.984126 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-451acb7c-9c25-41ca-a3b2-701c8ea2d8e6 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:48.984552 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-451acb7c-9c25-41ca-a3b2-701c8ea2d8e6 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:49.170471 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-80c67f38-d2c8-429e-9eab-848e86c60c5b tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608fc9ed7cdb487c9bf4b783c26ceeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29876d6805924df882d6861b0f6ab4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:49.172606 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=2 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:43:49.182466 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-80c67f38-d2c8-429e-9eab-848e86c60c5b tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] 10.222.0.43 "GET /compute/v2.1/servers/cf78a645-458e-4dc2-a60d-a51754ab6258" status: 200 len: 1463 microversion: 2.1 time: 1.313097 Oct 04 18:43:49.183076 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1611/3060] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:47 2022] GET /compute/v2.1/servers/cf78a645-458e-4dc2-a60d-a51754ab6258 => generated 1463 bytes in 1314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:49.201966 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-07d64079-326a-47da-b20e-7bba486ad6fc req-98e05f0a-309c-4154-bcd9-ce753f71ef82 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75", "tag": "3b617c59-561d-4917-87cb-5c5ab7f63852"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:43:49.209933 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=10 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:43:49.219200 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-07d64079-326a-47da-b20e-7bba486ad6fc req-98e05f0a-309c-4154-bcd9-ce753f71ef82 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:49.220155 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-07d64079-326a-47da-b20e-7bba486ad6fc req-98e05f0a-309c-4154-bcd9-ce753f71ef82 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:49.220505 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-07d64079-326a-47da-b20e-7bba486ad6fc req-98e05f0a-309c-4154-bcd9-ce753f71ef82 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:49.243459 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-07d64079-326a-47da-b20e-7bba486ad6fc req-98e05f0a-309c-4154-bcd9-ce753f71ef82 service nova] Creating event network-changed:3b617c59-561d-4917-87cb-5c5ab7f63852 for instance 6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75 on n-h1-851028-13 Oct 04 18:43:49.251685 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-07d64079-326a-47da-b20e-7bba486ad6fc req-98e05f0a-309c-4154-bcd9-ce753f71ef82 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067193 Oct 04 18:43:49.267586 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1612/3061] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:43:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:43:49.273921 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-e9899255-7092-4685-a1af-88514e17ecc7 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:49.275552 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-e9899255-7092-4685-a1af-88514e17ecc7 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] [instance: 6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:49.283600 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e9899255-7092-4685-a1af-88514e17ecc7 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:49.284414 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e9899255-7092-4685-a1af-88514e17ecc7 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:49.285100 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e9899255-7092-4685-a1af-88514e17ecc7 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:49.286772 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e9899255-7092-4685-a1af-88514e17ecc7 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:49.287563 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e9899255-7092-4685-a1af-88514e17ecc7 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:49.288228 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e9899255-7092-4685-a1af-88514e17ecc7 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:49.439191 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-451acb7c-9c25-41ca-a3b2-701c8ea2d8e6 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:49.448212 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-451acb7c-9c25-41ca-a3b2-701c8ea2d8e6 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5" status: 200 len: 1680 microversion: 2.1 time: 0.479772 Oct 04 18:43:49.449938 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1450/3062] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:48 2022] GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5 => generated 1680 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:43:49.456283 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-e778d6cc-61d4-4ee3-9366-6ed7a82d7a14 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-2118256426", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "cf78a645-458e-4dc2-a60d-a51754ab6258"}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:43:49.492539 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=2 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:43:49.519375 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.network.neutron [None req-e778d6cc-61d4-4ee3-9366-6ed7a82d7a14 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] validate_networks() for None {{(pid=123595) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:43:49.884185 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-e9899255-7092-4685-a1af-88514e17ecc7 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9971b5861f44c1a1da94eda0f8f02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f809b8ae704988961908bef0f3cb24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:49.893404 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-e9899255-7092-4685-a1af-88514e17ecc7 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] 10.222.0.43 "GET /compute/v2.1/servers/6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75" status: 200 len: 1360 microversion: 2.1 time: 0.624424 Oct 04 18:43:49.894335 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1613/3063] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:49 2022] GET /compute/v2.1/servers/6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75 => generated 1360 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:49.925627 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-d58be7d4-b123-4183-be8f-fe1cdad4652c tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:49.927150 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-d58be7d4-b123-4183-be8f-fe1cdad4652c tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] [instance: f726f3f3-4731-4380-9163-b2273b629810] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:49.932719 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:43:49.934515 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d58be7d4-b123-4183-be8f-fe1cdad4652c tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:49.936389 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d58be7d4-b123-4183-be8f-fe1cdad4652c tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:49.937209 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d58be7d4-b123-4183-be8f-fe1cdad4652c tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:49.938647 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d58be7d4-b123-4183-be8f-fe1cdad4652c tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:49.939293 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d58be7d4-b123-4183-be8f-fe1cdad4652c tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:49.939861 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d58be7d4-b123-4183-be8f-fe1cdad4652c tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:50.067987 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-e778d6cc-61d4-4ee3-9366-6ed7a82d7a14 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Flavor limits 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:43:50.068409 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-e778d6cc-61d4-4ee3-9366-6ed7a82d7a14 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Image limits 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:43:50.069067 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-e778d6cc-61d4-4ee3-9366-6ed7a82d7a14 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Flavor pref 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:43:50.069651 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-e778d6cc-61d4-4ee3-9366-6ed7a82d7a14 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Image pref 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:43:50.070073 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-e778d6cc-61d4-4ee3-9366-6ed7a82d7a14 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:43:50.085161 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e778d6cc-61d4-4ee3-9366-6ed7a82d7a14 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:50.085656 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e778d6cc-61d4-4ee3-9366-6ed7a82d7a14 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:50.086304 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e778d6cc-61d4-4ee3-9366-6ed7a82d7a14 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:50.087329 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e778d6cc-61d4-4ee3-9366-6ed7a82d7a14 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:50.087941 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e778d6cc-61d4-4ee3-9366-6ed7a82d7a14 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:50.088571 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e778d6cc-61d4-4ee3-9366-6ed7a82d7a14 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:50.114995 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-e778d6cc-61d4-4ee3-9366-6ed7a82d7a14 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Getting quotas for project 29876d6805924df882d6861b0f6ab4f0. Resources: {'ram', 'cores', 'instances'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:43:50.120356 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-e778d6cc-61d4-4ee3-9366-6ed7a82d7a14 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Getting quotas for user 608fc9ed7cdb487c9bf4b783c26ceeb6 and project 29876d6805924df882d6861b0f6ab4f0. Resources: {'ram', 'cores', 'instances'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:43:50.133370 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-e778d6cc-61d4-4ee3-9366-6ed7a82d7a14 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Going to run 1 instances... {{(pid=123595) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:43:50.135780 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-e778d6cc-61d4-4ee3-9366-6ed7a82d7a14 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] [instance: a721ca75-1707-4a91-96d0-431dece9b401] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e8943ec5-4038-4d4b-b9b9-2415a79f5243',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:43:50.202211 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-e778d6cc-61d4-4ee3-9366-6ed7a82d7a14 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.750767 Oct 04 18:43:50.205666 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1451/3064] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 18:43:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 755 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:43:50.219108 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-86ad39b6-8a28-49c5-9d3e-a80d8a240b86 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:50.220068 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-86ad39b6-8a28-49c5-9d3e-a80d8a240b86 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] [instance: a721ca75-1707-4a91-96d0-431dece9b401] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:50.392187 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-d58be7d4-b123-4183-be8f-fe1cdad4652c tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96e7480de94c43909045ac1087e40cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6bd34bf5540ee95c8144f185eb22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:50.402265 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-d58be7d4-b123-4183-be8f-fe1cdad4652c tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] 10.222.0.43 "GET /compute/v2.1/servers/f726f3f3-4731-4380-9163-b2273b629810" status: 200 len: 1520 microversion: 2.1 time: 0.480927 Oct 04 18:43:50.407072 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1614/3065] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:49 2022] GET /compute/v2.1/servers/f726f3f3-4731-4380-9163-b2273b629810 => generated 1520 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:50.430263 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-86ad39b6-8a28-49c5-9d3e-a80d8a240b86 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608fc9ed7cdb487c9bf4b783c26ceeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29876d6805924df882d6861b0f6ab4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:50.443148 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-86ad39b6-8a28-49c5-9d3e-a80d8a240b86 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] 10.222.0.43 "GET /compute/v2.1/servers/a721ca75-1707-4a91-96d0-431dece9b401" status: 200 len: 1214 microversion: 2.1 time: 0.230305 Oct 04 18:43:50.443678 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1452/3066] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:50 2022] GET /compute/v2.1/servers/a721ca75-1707-4a91-96d0-431dece9b401 => generated 1214 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:43:50.476905 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f23965a8-dcc7-489f-864e-e6b2e81dc8a2 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:50.477976 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-f23965a8-dcc7-489f-864e-e6b2e81dc8a2 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 82b86465-afb0-49ef-9932-1538010c1ae5] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:50.490947 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f23965a8-dcc7-489f-864e-e6b2e81dc8a2 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:50.491459 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f23965a8-dcc7-489f-864e-e6b2e81dc8a2 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:50.491906 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f23965a8-dcc7-489f-864e-e6b2e81dc8a2 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:50.492623 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f23965a8-dcc7-489f-864e-e6b2e81dc8a2 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:50.493089 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f23965a8-dcc7-489f-864e-e6b2e81dc8a2 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:50.493546 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f23965a8-dcc7-489f-864e-e6b2e81dc8a2 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:50.919638 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-a5603ade-ddc8-4e9b-a1a6-49aa45ee358a tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:50.920921 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-a5603ade-ddc8-4e9b-a1a6-49aa45ee358a tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] [instance: 6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:50.943080 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a5603ade-ddc8-4e9b-a1a6-49aa45ee358a tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:50.945871 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a5603ade-ddc8-4e9b-a1a6-49aa45ee358a tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:50.950108 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a5603ade-ddc8-4e9b-a1a6-49aa45ee358a tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:50.952291 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a5603ade-ddc8-4e9b-a1a6-49aa45ee358a tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:50.953130 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a5603ade-ddc8-4e9b-a1a6-49aa45ee358a tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:50.956471 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a5603ade-ddc8-4e9b-a1a6-49aa45ee358a tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:51.258968 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-a5603ade-ddc8-4e9b-a1a6-49aa45ee358a tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9971b5861f44c1a1da94eda0f8f02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f809b8ae704988961908bef0f3cb24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:51.277319 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-a5603ade-ddc8-4e9b-a1a6-49aa45ee358a tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] 10.222.0.43 "GET /compute/v2.1/servers/6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75" status: 200 len: 1360 microversion: 2.1 time: 0.362506 Oct 04 18:43:51.288951 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1453/3067] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:50 2022] GET /compute/v2.1/servers/6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75 => generated 1360 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:51.439860 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-ae65d130-d0aa-4973-a496-b388ddce3e18 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:51.441020 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-ae65d130-d0aa-4973-a496-b388ddce3e18 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] [instance: f726f3f3-4731-4380-9163-b2273b629810] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:51.454225 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ae65d130-d0aa-4973-a496-b388ddce3e18 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:51.456698 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ae65d130-d0aa-4973-a496-b388ddce3e18 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:51.458525 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ae65d130-d0aa-4973-a496-b388ddce3e18 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:51.465163 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ae65d130-d0aa-4973-a496-b388ddce3e18 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:51.466400 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ae65d130-d0aa-4973-a496-b388ddce3e18 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:51.467759 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ae65d130-d0aa-4973-a496-b388ddce3e18 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:51.829357 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-f23965a8-dcc7-489f-864e-e6b2e81dc8a2 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:51.837956 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-ae65d130-d0aa-4973-a496-b388ddce3e18 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96e7480de94c43909045ac1087e40cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6bd34bf5540ee95c8144f185eb22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:51.843121 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-f23965a8-dcc7-489f-864e-e6b2e81dc8a2 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5" status: 200 len: 1667 microversion: 2.1 time: 1.370165 Oct 04 18:43:51.844948 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1615/3068] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:50 2022] GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5 => generated 1667 bytes in 1373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:51.852658 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-ae65d130-d0aa-4973-a496-b388ddce3e18 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] 10.222.0.43 "GET /compute/v2.1/servers/f726f3f3-4731-4380-9163-b2273b629810" status: 200 len: 1520 microversion: 2.1 time: 0.424608 Oct 04 18:43:51.854073 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1454/3069] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:51 2022] GET /compute/v2.1/servers/f726f3f3-4731-4380-9163-b2273b629810 => generated 1520 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:43:51.869161 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-a0d311ff-1cad-4f3a-bd9d-1001d8949ca7 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:51.870149 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-a0d311ff-1cad-4f3a-bd9d-1001d8949ca7 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] [instance: a721ca75-1707-4a91-96d0-431dece9b401] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:51.878092 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a0d311ff-1cad-4f3a-bd9d-1001d8949ca7 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:51.878732 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a0d311ff-1cad-4f3a-bd9d-1001d8949ca7 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:51.879261 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a0d311ff-1cad-4f3a-bd9d-1001d8949ca7 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:51.880069 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a0d311ff-1cad-4f3a-bd9d-1001d8949ca7 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:51.880675 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a0d311ff-1cad-4f3a-bd9d-1001d8949ca7 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:51.881214 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a0d311ff-1cad-4f3a-bd9d-1001d8949ca7 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:51.884187 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-6af7baa5-7f93-46d5-bb57-b18a7a92edfe tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-1381660519"}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:43:51.891504 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-6af7baa5-7f93-46d5-bb57-b18a7a92edfe tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 82b86465-afb0-49ef-9932-1538010c1ae5] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:51.955083 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6af7baa5-7f93-46d5-bb57-b18a7a92edfe tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:51.957254 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6af7baa5-7f93-46d5-bb57-b18a7a92edfe tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:51.961100 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6af7baa5-7f93-46d5-bb57-b18a7a92edfe tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:51.965662 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6af7baa5-7f93-46d5-bb57-b18a7a92edfe tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:51.967137 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6af7baa5-7f93-46d5-bb57-b18a7a92edfe tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:51.967942 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6af7baa5-7f93-46d5-bb57-b18a7a92edfe tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:52.024687 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-a0d311ff-1cad-4f3a-bd9d-1001d8949ca7 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608fc9ed7cdb487c9bf4b783c26ceeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29876d6805924df882d6861b0f6ab4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:52.045897 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-a0d311ff-1cad-4f3a-bd9d-1001d8949ca7 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] 10.222.0.43 "GET /compute/v2.1/servers/a721ca75-1707-4a91-96d0-431dece9b401" status: 200 len: 1266 microversion: 2.1 time: 0.187379 Oct 04 18:43:52.057947 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1616/3070] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:51 2022] GET /compute/v2.1/servers/a721ca75-1707-4a91-96d0-431dece9b401 => generated 1266 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:52.313483 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-29580adc-66bf-484a-b772-c131e80e71e6 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:52.314487 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-29580adc-66bf-484a-b772-c131e80e71e6 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] [instance: 6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:52.325688 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-29580adc-66bf-484a-b772-c131e80e71e6 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:52.327001 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-29580adc-66bf-484a-b772-c131e80e71e6 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:52.327690 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-29580adc-66bf-484a-b772-c131e80e71e6 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:52.330436 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-29580adc-66bf-484a-b772-c131e80e71e6 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:52.331314 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-29580adc-66bf-484a-b772-c131e80e71e6 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:52.332018 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-29580adc-66bf-484a-b772-c131e80e71e6 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:52.372443 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-6af7baa5-7f93-46d5-bb57-b18a7a92edfe tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "POST /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5/action" status: 202 len: 0 microversion: 2.1 time: 0.491207 Oct 04 18:43:52.375981 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1455/3071] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 18:43:51 2022] POST /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5/action => generated 0 bytes in 500 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Oct 04 18:43:52.390010 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-94e9d1bf-5c7b-42fa-9457-db240cc031db tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:52.394132 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-94e9d1bf-5c7b-42fa-9457-db240cc031db tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 82b86465-afb0-49ef-9932-1538010c1ae5] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:52.410992 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-94e9d1bf-5c7b-42fa-9457-db240cc031db tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:52.414213 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-94e9d1bf-5c7b-42fa-9457-db240cc031db tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:52.414932 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-94e9d1bf-5c7b-42fa-9457-db240cc031db tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:52.416191 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-94e9d1bf-5c7b-42fa-9457-db240cc031db tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:52.418463 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-94e9d1bf-5c7b-42fa-9457-db240cc031db tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:52.419144 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-94e9d1bf-5c7b-42fa-9457-db240cc031db tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:53.081190 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-29580adc-66bf-484a-b772-c131e80e71e6 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9971b5861f44c1a1da94eda0f8f02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f809b8ae704988961908bef0f3cb24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:53.091714 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-29580adc-66bf-484a-b772-c131e80e71e6 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] 10.222.0.43 "GET /compute/v2.1/servers/6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75" status: 200 len: 1360 microversion: 2.1 time: 0.783895 Oct 04 18:43:53.097150 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1617/3072] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:52 2022] GET /compute/v2.1/servers/6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75 => generated 1360 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:53.106421 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-7250862e-8e35-4b12-8abe-12412f98fce6 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:53.107016 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-7250862e-8e35-4b12-8abe-12412f98fce6 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] [instance: f726f3f3-4731-4380-9163-b2273b629810] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:53.117524 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7250862e-8e35-4b12-8abe-12412f98fce6 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:53.118374 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7250862e-8e35-4b12-8abe-12412f98fce6 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:53.118869 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7250862e-8e35-4b12-8abe-12412f98fce6 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:53.120901 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7250862e-8e35-4b12-8abe-12412f98fce6 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:53.121415 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7250862e-8e35-4b12-8abe-12412f98fce6 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:53.122027 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7250862e-8e35-4b12-8abe-12412f98fce6 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:53.432456 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-94e9d1bf-5c7b-42fa-9457-db240cc031db tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:53.442304 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:43:53.446470 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-94e9d1bf-5c7b-42fa-9457-db240cc031db tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5" status: 200 len: 1677 microversion: 2.1 time: 1.065987 Oct 04 18:43:53.450276 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1456/3073] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:52 2022] GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5 => generated 1677 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:53.456760 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-d5d2d061-466f-433a-93ee-af5a9e4b02ef tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:53.457629 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-d5d2d061-466f-433a-93ee-af5a9e4b02ef tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] [instance: a721ca75-1707-4a91-96d0-431dece9b401] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:53.467716 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d5d2d061-466f-433a-93ee-af5a9e4b02ef tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:53.468606 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d5d2d061-466f-433a-93ee-af5a9e4b02ef tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:53.469547 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d5d2d061-466f-433a-93ee-af5a9e4b02ef tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:53.471162 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d5d2d061-466f-433a-93ee-af5a9e4b02ef tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:53.471937 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d5d2d061-466f-433a-93ee-af5a9e4b02ef tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:53.473770 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d5d2d061-466f-433a-93ee-af5a9e4b02ef tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:53.624667 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-d5d2d061-466f-433a-93ee-af5a9e4b02ef tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608fc9ed7cdb487c9bf4b783c26ceeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29876d6805924df882d6861b0f6ab4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:53.633913 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-d5d2d061-466f-433a-93ee-af5a9e4b02ef tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] 10.222.0.43 "GET /compute/v2.1/servers/a721ca75-1707-4a91-96d0-431dece9b401" status: 200 len: 1272 microversion: 2.1 time: 0.182165 Oct 04 18:43:53.652363 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1457/3074] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:53 2022] GET /compute/v2.1/servers/a721ca75-1707-4a91-96d0-431dece9b401 => generated 1272 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:53.658022 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-b9477142-b58e-48b7-8743-6a060fd3e51e req-7b1a629c-8113-4700-8be5-26c49da1bbec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82b86465-afb0-49ef-9932-1538010c1ae5", "name": "network-vif-unplugged", "status": "completed", "tag": "7e7a43a5-3a15-49a6-b50e-0ac0ac9faa8d"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:43:53.677625 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-7250862e-8e35-4b12-8abe-12412f98fce6 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96e7480de94c43909045ac1087e40cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6bd34bf5540ee95c8144f185eb22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:53.686531 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-b9477142-b58e-48b7-8743-6a060fd3e51e req-7b1a629c-8113-4700-8be5-26c49da1bbec service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:53.690908 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-7250862e-8e35-4b12-8abe-12412f98fce6 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] 10.222.0.43 "GET /compute/v2.1/servers/f726f3f3-4731-4380-9163-b2273b629810" status: 200 len: 1520 microversion: 2.1 time: 0.592526 Oct 04 18:43:53.691525 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1618/3075] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:53 2022] GET /compute/v2.1/servers/f726f3f3-4731-4380-9163-b2273b629810 => generated 1520 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:53.692960 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-b9477142-b58e-48b7-8743-6a060fd3e51e req-7b1a629c-8113-4700-8be5-26c49da1bbec service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:53.693707 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-b9477142-b58e-48b7-8743-6a060fd3e51e req-7b1a629c-8113-4700-8be5-26c49da1bbec service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:53.717157 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-b9477142-b58e-48b7-8743-6a060fd3e51e req-7b1a629c-8113-4700-8be5-26c49da1bbec service nova] Creating event network-vif-unplugged:7e7a43a5-3a15-49a6-b50e-0ac0ac9faa8d for instance 82b86465-afb0-49ef-9932-1538010c1ae5 on n-h2-851028-13 Oct 04 18:43:53.737914 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-b9477142-b58e-48b7-8743-6a060fd3e51e req-7b1a629c-8113-4700-8be5-26c49da1bbec service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.080150 Oct 04 18:43:53.739042 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1458/3076] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:43:53 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:43:54.117221 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-5cf15ee0-07f8-4c93-a005-73935d8f1bd4 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:54.119195 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-5cf15ee0-07f8-4c93-a005-73935d8f1bd4 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] [instance: 6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:54.127627 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5cf15ee0-07f8-4c93-a005-73935d8f1bd4 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:54.128469 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5cf15ee0-07f8-4c93-a005-73935d8f1bd4 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:54.129198 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5cf15ee0-07f8-4c93-a005-73935d8f1bd4 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:54.131037 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5cf15ee0-07f8-4c93-a005-73935d8f1bd4 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:54.131742 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5cf15ee0-07f8-4c93-a005-73935d8f1bd4 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:54.132445 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5cf15ee0-07f8-4c93-a005-73935d8f1bd4 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:54.479911 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-83266c03-2490-43fc-b8e6-cb22feb98ef8 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:54.479911 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-83266c03-2490-43fc-b8e6-cb22feb98ef8 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 82b86465-afb0-49ef-9932-1538010c1ae5] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:54.494393 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-83266c03-2490-43fc-b8e6-cb22feb98ef8 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:54.494970 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-83266c03-2490-43fc-b8e6-cb22feb98ef8 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:54.495434 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-83266c03-2490-43fc-b8e6-cb22feb98ef8 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:54.496141 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-83266c03-2490-43fc-b8e6-cb22feb98ef8 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:54.496606 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-83266c03-2490-43fc-b8e6-cb22feb98ef8 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:54.497040 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-83266c03-2490-43fc-b8e6-cb22feb98ef8 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:54.878871 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-83266c03-2490-43fc-b8e6-cb22feb98ef8 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:54.898065 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-83266c03-2490-43fc-b8e6-cb22feb98ef8 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5" status: 200 len: 1677 microversion: 2.1 time: 0.424812 Oct 04 18:43:54.899519 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1459/3077] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:54 2022] GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5 => generated 1677 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:54.905637 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-9fcad04c-84d2-43f3-84d1-4a0e015e1dd3 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:54.906989 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-9fcad04c-84d2-43f3-84d1-4a0e015e1dd3 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] [instance: a721ca75-1707-4a91-96d0-431dece9b401] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:54.915223 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9fcad04c-84d2-43f3-84d1-4a0e015e1dd3 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:54.916996 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9fcad04c-84d2-43f3-84d1-4a0e015e1dd3 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:54.917691 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9fcad04c-84d2-43f3-84d1-4a0e015e1dd3 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:54.918639 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9fcad04c-84d2-43f3-84d1-4a0e015e1dd3 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:54.920643 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9fcad04c-84d2-43f3-84d1-4a0e015e1dd3 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:54.921352 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9fcad04c-84d2-43f3-84d1-4a0e015e1dd3 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:55.036840 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-5cf15ee0-07f8-4c93-a005-73935d8f1bd4 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9971b5861f44c1a1da94eda0f8f02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f809b8ae704988961908bef0f3cb24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:55.053523 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-5cf15ee0-07f8-4c93-a005-73935d8f1bd4 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] 10.222.0.43 "GET /compute/v2.1/servers/6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75" status: 200 len: 1360 microversion: 2.1 time: 0.941521 Oct 04 18:43:55.076969 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1619/3078] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:54 2022] GET /compute/v2.1/servers/6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75 => generated 1360 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:55.082045 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f22e8d7f-b436-41a6-9d0d-fac790efa96c tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:55.082785 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-f22e8d7f-b436-41a6-9d0d-fac790efa96c tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] [instance: f726f3f3-4731-4380-9163-b2273b629810] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:55.089011 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f22e8d7f-b436-41a6-9d0d-fac790efa96c tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:55.089530 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f22e8d7f-b436-41a6-9d0d-fac790efa96c tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:55.090190 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f22e8d7f-b436-41a6-9d0d-fac790efa96c tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:55.090896 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f22e8d7f-b436-41a6-9d0d-fac790efa96c tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:55.091353 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f22e8d7f-b436-41a6-9d0d-fac790efa96c tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:55.091967 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f22e8d7f-b436-41a6-9d0d-fac790efa96c tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:55.148314 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-9fcad04c-84d2-43f3-84d1-4a0e015e1dd3 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608fc9ed7cdb487c9bf4b783c26ceeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29876d6805924df882d6861b0f6ab4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:55.156754 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-9fcad04c-84d2-43f3-84d1-4a0e015e1dd3 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] 10.222.0.43 "GET /compute/v2.1/servers/a721ca75-1707-4a91-96d0-431dece9b401" status: 200 len: 1314 microversion: 2.1 time: 0.255008 Oct 04 18:43:55.164452 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1460/3079] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:54 2022] GET /compute/v2.1/servers/a721ca75-1707-4a91-96d0-431dece9b401 => generated 1314 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:55.638357 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-f22e8d7f-b436-41a6-9d0d-fac790efa96c tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96e7480de94c43909045ac1087e40cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6bd34bf5540ee95c8144f185eb22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:55.649617 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-f22e8d7f-b436-41a6-9d0d-fac790efa96c tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] 10.222.0.43 "GET /compute/v2.1/servers/f726f3f3-4731-4380-9163-b2273b629810" status: 200 len: 1520 microversion: 2.1 time: 0.569136 Oct 04 18:43:55.651731 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1620/3080] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:55 2022] GET /compute/v2.1/servers/f726f3f3-4731-4380-9163-b2273b629810 => generated 1520 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:55.758291 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-c086931c-5b66-4235-a108-0309adf408f6 req-c07fa0b2-f008-4be0-aa36-84c5651cd9fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75", "name": "network-vif-plugged", "status": "completed", "tag": "3b617c59-561d-4917-87cb-5c5ab7f63852"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:43:55.780321 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-c086931c-5b66-4235-a108-0309adf408f6 req-c07fa0b2-f008-4be0-aa36-84c5651cd9fc service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:55.783564 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-c086931c-5b66-4235-a108-0309adf408f6 req-c07fa0b2-f008-4be0-aa36-84c5651cd9fc service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:55.784054 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-c086931c-5b66-4235-a108-0309adf408f6 req-c07fa0b2-f008-4be0-aa36-84c5651cd9fc service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:55.815353 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-c086931c-5b66-4235-a108-0309adf408f6 req-c07fa0b2-f008-4be0-aa36-84c5651cd9fc service nova] Creating event network-vif-plugged:3b617c59-561d-4917-87cb-5c5ab7f63852 for instance 6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75 on n-h1-851028-13 Oct 04 18:43:55.830074 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-c086931c-5b66-4235-a108-0309adf408f6 req-c07fa0b2-f008-4be0-aa36-84c5651cd9fc service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077046 Oct 04 18:43:55.832053 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1461/3081] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:43:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:43:55.927026 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-b2656d44-400c-4776-a254-9dd4b6ba2e36 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:55.927661 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-b2656d44-400c-4776-a254-9dd4b6ba2e36 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 82b86465-afb0-49ef-9932-1538010c1ae5] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:55.945056 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b2656d44-400c-4776-a254-9dd4b6ba2e36 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:55.945594 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b2656d44-400c-4776-a254-9dd4b6ba2e36 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:55.946040 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b2656d44-400c-4776-a254-9dd4b6ba2e36 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:55.951509 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b2656d44-400c-4776-a254-9dd4b6ba2e36 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:55.952010 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b2656d44-400c-4776-a254-9dd4b6ba2e36 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:55.952457 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b2656d44-400c-4776-a254-9dd4b6ba2e36 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:56.083481 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-fe286e89-ea71-4172-88cf-845bd69a610d tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:56.084238 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-fe286e89-ea71-4172-88cf-845bd69a610d tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] [instance: 6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:56.098275 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fe286e89-ea71-4172-88cf-845bd69a610d tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:56.098815 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fe286e89-ea71-4172-88cf-845bd69a610d tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:56.099271 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fe286e89-ea71-4172-88cf-845bd69a610d tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:56.100020 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fe286e89-ea71-4172-88cf-845bd69a610d tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:56.100475 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fe286e89-ea71-4172-88cf-845bd69a610d tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:56.100903 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fe286e89-ea71-4172-88cf-845bd69a610d tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:56.435955 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-fe286e89-ea71-4172-88cf-845bd69a610d tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9971b5861f44c1a1da94eda0f8f02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f809b8ae704988961908bef0f3cb24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:56.446670 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-fe286e89-ea71-4172-88cf-845bd69a610d tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] 10.222.0.43 "GET /compute/v2.1/servers/6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75" status: 200 len: 1360 microversion: 2.1 time: 0.367686 Oct 04 18:43:56.449238 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1462/3082] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:56 2022] GET /compute/v2.1/servers/6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75 => generated 1360 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:56.455129 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-a858fc14-1cc2-4292-a6ec-3f13853272f0 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:56.456283 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-a858fc14-1cc2-4292-a6ec-3f13853272f0 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] [instance: a721ca75-1707-4a91-96d0-431dece9b401] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:56.464958 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a858fc14-1cc2-4292-a6ec-3f13853272f0 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:56.466017 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a858fc14-1cc2-4292-a6ec-3f13853272f0 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:56.466696 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a858fc14-1cc2-4292-a6ec-3f13853272f0 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:56.467743 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a858fc14-1cc2-4292-a6ec-3f13853272f0 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:56.468507 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a858fc14-1cc2-4292-a6ec-3f13853272f0 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:56.469801 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a858fc14-1cc2-4292-a6ec-3f13853272f0 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:56.714750 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-a858fc14-1cc2-4292-a6ec-3f13853272f0 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608fc9ed7cdb487c9bf4b783c26ceeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29876d6805924df882d6861b0f6ab4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:56.722720 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-a858fc14-1cc2-4292-a6ec-3f13853272f0 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] 10.222.0.43 "GET /compute/v2.1/servers/a721ca75-1707-4a91-96d0-431dece9b401" status: 200 len: 1314 microversion: 2.1 time: 0.271472 Oct 04 18:43:56.723910 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1463/3083] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:56 2022] GET /compute/v2.1/servers/a721ca75-1707-4a91-96d0-431dece9b401 => generated 1314 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:56.732344 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-941cd854-2690-440a-b613-77fb83e797ec tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:56.733365 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-941cd854-2690-440a-b613-77fb83e797ec tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] [instance: f726f3f3-4731-4380-9163-b2273b629810] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:56.742663 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-941cd854-2690-440a-b613-77fb83e797ec tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:56.743417 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-941cd854-2690-440a-b613-77fb83e797ec tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:56.743856 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-941cd854-2690-440a-b613-77fb83e797ec tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:56.745360 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-941cd854-2690-440a-b613-77fb83e797ec tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:56.745988 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-941cd854-2690-440a-b613-77fb83e797ec tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:56.746583 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-941cd854-2690-440a-b613-77fb83e797ec tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:56.892509 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-941cd854-2690-440a-b613-77fb83e797ec tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96e7480de94c43909045ac1087e40cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6bd34bf5540ee95c8144f185eb22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:56.901663 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-941cd854-2690-440a-b613-77fb83e797ec tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] 10.222.0.43 "GET /compute/v2.1/servers/f726f3f3-4731-4380-9163-b2273b629810" status: 200 len: 1520 microversion: 2.1 time: 0.175898 Oct 04 18:43:56.902266 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1464/3084] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:56 2022] GET /compute/v2.1/servers/f726f3f3-4731-4380-9163-b2273b629810 => generated 1520 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:56.910152 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-fbbe26a3-eef0-4479-9d56-677c0b2f427c req-75c3bfb8-8929-42aa-837f-cde66fcc1eca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a721ca75-1707-4a91-96d0-431dece9b401", "tag": "8c86755f-b407-4528-abb1-6c70d6106ad8"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:43:56.920679 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-fbbe26a3-eef0-4479-9d56-677c0b2f427c req-75c3bfb8-8929-42aa-837f-cde66fcc1eca service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:56.921248 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-fbbe26a3-eef0-4479-9d56-677c0b2f427c req-75c3bfb8-8929-42aa-837f-cde66fcc1eca service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:56.921692 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-fbbe26a3-eef0-4479-9d56-677c0b2f427c req-75c3bfb8-8929-42aa-837f-cde66fcc1eca service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:56.935821 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-fbbe26a3-eef0-4479-9d56-677c0b2f427c req-75c3bfb8-8929-42aa-837f-cde66fcc1eca service nova] Creating event network-changed:8c86755f-b407-4528-abb1-6c70d6106ad8 for instance a721ca75-1707-4a91-96d0-431dece9b401 on n-h2-851028-13 Oct 04 18:43:56.944901 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-fbbe26a3-eef0-4479-9d56-677c0b2f427c req-75c3bfb8-8929-42aa-837f-cde66fcc1eca service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039037 Oct 04 18:43:56.946096 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1465/3085] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:43:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:43:56.956229 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-b2656d44-400c-4776-a254-9dd4b6ba2e36 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:56.964695 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-b2656d44-400c-4776-a254-9dd4b6ba2e36 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5" status: 200 len: 1685 microversion: 2.1 time: 1.042228 Oct 04 18:43:56.966398 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1621/3086] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:55 2022] GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5 => generated 1685 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:57.474548 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-dc864e9e-a97a-4dac-a587-6a73957e9520 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:57.477953 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-dc864e9e-a97a-4dac-a587-6a73957e9520 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] [instance: 6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:57.485738 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dc864e9e-a97a-4dac-a587-6a73957e9520 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:57.486587 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dc864e9e-a97a-4dac-a587-6a73957e9520 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:57.487033 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dc864e9e-a97a-4dac-a587-6a73957e9520 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:57.487752 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dc864e9e-a97a-4dac-a587-6a73957e9520 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:57.488208 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dc864e9e-a97a-4dac-a587-6a73957e9520 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:57.488637 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dc864e9e-a97a-4dac-a587-6a73957e9520 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:57.750513 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-e9afd8cc-574a-4c01-a9b5-08bdb14e9d55 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:57.754538 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-e9afd8cc-574a-4c01-a9b5-08bdb14e9d55 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] [instance: a721ca75-1707-4a91-96d0-431dece9b401] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:57.769754 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e9afd8cc-574a-4c01-a9b5-08bdb14e9d55 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:57.770536 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e9afd8cc-574a-4c01-a9b5-08bdb14e9d55 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:57.773061 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e9afd8cc-574a-4c01-a9b5-08bdb14e9d55 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:57.774309 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e9afd8cc-574a-4c01-a9b5-08bdb14e9d55 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:57.775172 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e9afd8cc-574a-4c01-a9b5-08bdb14e9d55 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:57.782517 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e9afd8cc-574a-4c01-a9b5-08bdb14e9d55 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:57.898751 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-dc864e9e-a97a-4dac-a587-6a73957e9520 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9971b5861f44c1a1da94eda0f8f02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f809b8ae704988961908bef0f3cb24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:57.915130 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-dc864e9e-a97a-4dac-a587-6a73957e9520 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] 10.222.0.43 "GET /compute/v2.1/servers/6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75" status: 200 len: 1360 microversion: 2.1 time: 0.446633 Oct 04 18:43:57.916116 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1466/3087] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:57 2022] GET /compute/v2.1/servers/6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75 => generated 1360 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:57.930564 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-e3f38dc8-9ab1-42c3-978f-ab709ea5b191 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:57.931303 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-e3f38dc8-9ab1-42c3-978f-ab709ea5b191 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] [instance: f726f3f3-4731-4380-9163-b2273b629810] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:57.955736 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e3f38dc8-9ab1-42c3-978f-ab709ea5b191 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:57.958207 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e3f38dc8-9ab1-42c3-978f-ab709ea5b191 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:57.959399 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e3f38dc8-9ab1-42c3-978f-ab709ea5b191 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:57.965549 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e3f38dc8-9ab1-42c3-978f-ab709ea5b191 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:57.966271 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e3f38dc8-9ab1-42c3-978f-ab709ea5b191 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:57.967120 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e3f38dc8-9ab1-42c3-978f-ab709ea5b191 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:58.144182 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-e9afd8cc-574a-4c01-a9b5-08bdb14e9d55 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608fc9ed7cdb487c9bf4b783c26ceeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29876d6805924df882d6861b0f6ab4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:58.169376 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-e9afd8cc-574a-4c01-a9b5-08bdb14e9d55 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] 10.222.0.43 "GET /compute/v2.1/servers/a721ca75-1707-4a91-96d0-431dece9b401" status: 200 len: 1314 microversion: 2.1 time: 0.421057 Oct 04 18:43:58.170500 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1622/3088] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:57 2022] GET /compute/v2.1/servers/a721ca75-1707-4a91-96d0-431dece9b401 => generated 1314 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:58.180903 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-2452dd45-c376-4cd8-a157-27eda1c068f5 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:58.185683 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-2452dd45-c376-4cd8-a157-27eda1c068f5 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 82b86465-afb0-49ef-9932-1538010c1ae5] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:58.197535 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2452dd45-c376-4cd8-a157-27eda1c068f5 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:58.198347 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2452dd45-c376-4cd8-a157-27eda1c068f5 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:58.198958 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2452dd45-c376-4cd8-a157-27eda1c068f5 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:58.199861 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2452dd45-c376-4cd8-a157-27eda1c068f5 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:58.200487 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2452dd45-c376-4cd8-a157-27eda1c068f5 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:58.201079 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2452dd45-c376-4cd8-a157-27eda1c068f5 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:58.412941 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-e3f38dc8-9ab1-42c3-978f-ab709ea5b191 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96e7480de94c43909045ac1087e40cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6bd34bf5540ee95c8144f185eb22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:58.445164 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-e3f38dc8-9ab1-42c3-978f-ab709ea5b191 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] 10.222.0.43 "GET /compute/v2.1/servers/f726f3f3-4731-4380-9163-b2273b629810" status: 200 len: 1500 microversion: 2.1 time: 0.524900 Oct 04 18:43:58.447869 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1467/3089] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:57 2022] GET /compute/v2.1/servers/f726f3f3-4731-4380-9163-b2273b629810 => generated 1500 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:58.483012 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-40360f83-934d-49aa-8f67-bdb9779afacc tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c124adfe-ef13-4915-ba3b-3d9e334c44fe"}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:43:58.517760 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-40360f83-934d-49aa-8f67-bdb9779afacc tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] [instance: f726f3f3-4731-4380-9163-b2273b629810] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:58.543284 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-40360f83-934d-49aa-8f67-bdb9779afacc tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:58.544957 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-40360f83-934d-49aa-8f67-bdb9779afacc tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:58.545447 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-40360f83-934d-49aa-8f67-bdb9779afacc tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:58.547581 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-40360f83-934d-49aa-8f67-bdb9779afacc tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:58.548225 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-40360f83-934d-49aa-8f67-bdb9779afacc tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:58.555933 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-40360f83-934d-49aa-8f67-bdb9779afacc tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:58.618021 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-40360f83-934d-49aa-8f67-bdb9779afacc tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] HTTP exception thrown: Cannot 'attach_volume' instance f726f3f3-4731-4380-9163-b2273b629810 while it is in vm_state rescued Oct 04 18:43:58.620610 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-40360f83-934d-49aa-8f67-bdb9779afacc tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Request method failure captured: Oct 04 18:43:58.620610 n-d-851028-13 devstack@n-api.service[123595]: request: POST /compute/v2.1/servers/f726f3f3-4731-4380-9163-b2273b629810/os-volume_attachments HTTP/1.1 Oct 04 18:43:58.620610 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 18:43:58.620610 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 18:43:58.620610 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 18:43:58.620610 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 74 Oct 04 18:43:58.620610 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 18:43:58.620610 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 18:43:58.620610 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 18:43:58.620610 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 18:43:58.620610 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPH6ImUsc0v5avJaXbAf95n6vmfztxEtTiW32SRLH_bOmBbny3fOGIWm6DaSHmvRnWhZ-84faOFvXqXs-7dDoMftV5mgOWVN0Q9OrVISe3irL7FfmyYZmGssWLEuXGLXQhTtdNOFN9115Lqu5biPYPUWU74K-2mRSRsiih09WbGDmZQI Oct 04 18:43:58.620610 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 18:43:58.620610 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 18:43:58.620610 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 18:43:58.620610 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 18:43:58.620610 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 18:43:58.620610 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 18:43:58.620610 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: eda6bd34bf5540ee95c8144f185eb22d Oct 04 18:43:58.620610 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1155401912 Oct 04 18:43:58.620610 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 18:43:58.620610 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 18:43:58.620610 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/eda6bd34bf5540ee95c8144f185eb22d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_eda6bd34bf5540ee95c8144f185eb22d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/eda6bd34bf5540ee95c8144f185eb22d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/eda6bd34bf5540ee95c8144f185eb22d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:43:58.620610 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1155401912 Oct 04 18:43:58.620610 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: eda6bd34bf5540ee95c8144f185eb22d Oct 04 18:43:58.620610 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1155401912 Oct 04 18:43:58.620610 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-ServerRescueNegativeTestJSON-1155401912-project Oct 04 18:43:58.620610 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 18:43:58.620610 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 18:43:58.620610 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: 96e7480de94c43909045ac1087e40cd8 Oct 04 18:43:58.620610 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1155401912-project Oct 04 18:43:58.620610 n-d-851028-13 devstack@n-api.service[123595]: Oct 04 18:43:58.620610 n-d-851028-13 devstack@n-api.service[123595]: {"volumeAttachment": {"volumeId": "c124adfe-ef13-4915-ba3b-3d9e334c44fe"}} Oct 04 18:43:58.620610 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 18:43:58.620610 n-d-851028-13 devstack@n-api.service[123595]: exception: Cannot 'attach_volume' instance f726f3f3-4731-4380-9163-b2273b629810 while it is in vm_state rescued Oct 04 18:43:58.620610 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'server_id': 'f726f3f3-4731-4380-9163-b2273b629810', 'body': {'volumeAttachment': {'volumeId': 'c124adfe-ef13-4915-ba3b-3d9e334c44fe'}}} Oct 04 18:43:58.620610 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:43:58.620610 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:43:58.620610 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 04 18:43:58.620610 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 04 18:43:58.620610 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 18:43:58.620610 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 18:43:58.620610 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 04 18:43:58.620610 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 04 18:43:58.620610 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f726f3f3-4731-4380-9163-b2273b629810 in vm_state rescued. Cannot attach_volume while the instance is in this state. Oct 04 18:43:58.620610 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:43:58.620610 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:43:58.620610 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:43:58.620610 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:43:58.620610 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:43:58.620610 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:43:58.620610 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:43:58.620610 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:43:58.620610 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:43:58.620610 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:43:58.620610 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:43:58.620610 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:43:58.620610 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:43:58.620610 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:43:58.620610 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:43:58.620610 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:43:58.620610 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Oct 04 18:43:58.620610 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 04 18:43:58.626410 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 04 18:43:58.626410 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 04 18:43:58.626410 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance f726f3f3-4731-4380-9163-b2273b629810 while it is in vm_state rescued Oct 04 18:43:58.626410 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:43:58.626410 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:43:58.626410 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:43:58.626410 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:43:58.626410 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:43:58.626410 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:43:58.626410 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:43:58.626410 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:43:58.626410 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance f726f3f3-4731-4380-9163-b2273b629810 while it is in vm_state rescued Oct 04 18:43:58.626410 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:43:58.626410 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-40360f83-934d-49aa-8f67-bdb9779afacc tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Returning 409 to user: Cannot 'attach_volume' instance f726f3f3-4731-4380-9163-b2273b629810 while it is in vm_state rescued {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:43:58.626410 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-40360f83-934d-49aa-8f67-bdb9779afacc tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] 10.222.0.43 "POST /compute/v2.1/servers/f726f3f3-4731-4380-9163-b2273b629810/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.150069 Oct 04 18:43:58.632380 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1468/3090] 10.222.0.43 () {60 vars in 1323 bytes} [Tue Oct 4 18:43:58 2022] POST /compute/v2.1/servers/f726f3f3-4731-4380-9163-b2273b629810/os-volume_attachments => generated 152 bytes in 164 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:43:58.637761 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-5e50eb0f-b4b7-4d7c-95f6-9c498bf873da tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:43:58.638565 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-5e50eb0f-b4b7-4d7c-95f6-9c498bf873da tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] [instance: f726f3f3-4731-4380-9163-b2273b629810] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:58.647048 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5e50eb0f-b4b7-4d7c-95f6-9c498bf873da tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:58.647540 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5e50eb0f-b4b7-4d7c-95f6-9c498bf873da tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:58.648417 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5e50eb0f-b4b7-4d7c-95f6-9c498bf873da tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:58.649503 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5e50eb0f-b4b7-4d7c-95f6-9c498bf873da tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:58.650235 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5e50eb0f-b4b7-4d7c-95f6-9c498bf873da tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:58.650906 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5e50eb0f-b4b7-4d7c-95f6-9c498bf873da tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:58.805530 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-5e50eb0f-b4b7-4d7c-95f6-9c498bf873da tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] 10.222.0.43 "POST /compute/v2.1/servers/f726f3f3-4731-4380-9163-b2273b629810/action" status: 202 len: 0 microversion: 2.1 time: 0.170709 Oct 04 18:43:58.811908 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1469/3091] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 18:43:58 2022] POST /compute/v2.1/servers/f726f3f3-4731-4380-9163-b2273b629810/action => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:43:58.821652 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-46d8925d-7315-4d92-9db5-30c4273a1f47 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:58.822773 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-46d8925d-7315-4d92-9db5-30c4273a1f47 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] [instance: f726f3f3-4731-4380-9163-b2273b629810] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:58.830278 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-46d8925d-7315-4d92-9db5-30c4273a1f47 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:58.831088 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-46d8925d-7315-4d92-9db5-30c4273a1f47 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:58.832098 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-46d8925d-7315-4d92-9db5-30c4273a1f47 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:58.833081 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-46d8925d-7315-4d92-9db5-30c4273a1f47 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:58.833780 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-46d8925d-7315-4d92-9db5-30c4273a1f47 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:58.834403 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-46d8925d-7315-4d92-9db5-30c4273a1f47 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:59.026746 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-2452dd45-c376-4cd8-a157-27eda1c068f5 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:59.050046 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-2452dd45-c376-4cd8-a157-27eda1c068f5 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5" status: 200 len: 1685 microversion: 2.1 time: 0.875410 Oct 04 18:43:59.074226 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1623/3092] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:58 2022] GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5 => generated 1685 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:59.083780 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-c0bec9d8-6ee0-4dc5-b327-a1d0fd0b386d tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:59.085788 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-c0bec9d8-6ee0-4dc5-b327-a1d0fd0b386d tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] [instance: 6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:59.101013 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c0bec9d8-6ee0-4dc5-b327-a1d0fd0b386d tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:59.101931 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c0bec9d8-6ee0-4dc5-b327-a1d0fd0b386d tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:59.103407 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c0bec9d8-6ee0-4dc5-b327-a1d0fd0b386d tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:59.106948 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c0bec9d8-6ee0-4dc5-b327-a1d0fd0b386d tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:59.108356 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c0bec9d8-6ee0-4dc5-b327-a1d0fd0b386d tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:59.109901 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c0bec9d8-6ee0-4dc5-b327-a1d0fd0b386d tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:59.944503 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-c0bec9d8-6ee0-4dc5-b327-a1d0fd0b386d tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9971b5861f44c1a1da94eda0f8f02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f809b8ae704988961908bef0f3cb24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:59.956823 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-c0bec9d8-6ee0-4dc5-b327-a1d0fd0b386d tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] 10.222.0.43 "GET /compute/v2.1/servers/6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75" status: 200 len: 1543 microversion: 2.1 time: 0.880947 Oct 04 18:43:59.970239 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1624/3093] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:59 2022] GET /compute/v2.1/servers/6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75 => generated 1543 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:59.978348 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-b38a514f-a6ad-4135-9c3e-2e6d370eea1e tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:59.979100 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-b38a514f-a6ad-4135-9c3e-2e6d370eea1e tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] [instance: a721ca75-1707-4a91-96d0-431dece9b401] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:59.996095 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b38a514f-a6ad-4135-9c3e-2e6d370eea1e tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:59.996607 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b38a514f-a6ad-4135-9c3e-2e6d370eea1e tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:59.997054 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b38a514f-a6ad-4135-9c3e-2e6d370eea1e tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:59.997797 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b38a514f-a6ad-4135-9c3e-2e6d370eea1e tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:59.998255 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b38a514f-a6ad-4135-9c3e-2e6d370eea1e tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:59.998686 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b38a514f-a6ad-4135-9c3e-2e6d370eea1e tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:00.104312 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=2 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:44:00.435138 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=8 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:44:00.454579 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-b38a514f-a6ad-4135-9c3e-2e6d370eea1e tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608fc9ed7cdb487c9bf4b783c26ceeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29876d6805924df882d6861b0f6ab4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:00.470662 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-b38a514f-a6ad-4135-9c3e-2e6d370eea1e tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] 10.222.0.43 "GET /compute/v2.1/servers/a721ca75-1707-4a91-96d0-431dece9b401" status: 200 len: 1314 microversion: 2.1 time: 0.493475 Oct 04 18:44:00.471599 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1625/3094] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:59 2022] GET /compute/v2.1/servers/a721ca75-1707-4a91-96d0-431dece9b401 => generated 1314 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:00.481619 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-2bf2480a-5900-48ab-9c59-551e201f431e req-9650381b-31de-438d-97d1-ac3479524bac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82b86465-afb0-49ef-9932-1538010c1ae5", "name": "network-vif-plugged", "status": "completed", "tag": "7e7a43a5-3a15-49a6-b50e-0ac0ac9faa8d"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:44:00.503919 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-2bf2480a-5900-48ab-9c59-551e201f431e req-9650381b-31de-438d-97d1-ac3479524bac service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:00.511264 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-2bf2480a-5900-48ab-9c59-551e201f431e req-9650381b-31de-438d-97d1-ac3479524bac service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:00.513244 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-2bf2480a-5900-48ab-9c59-551e201f431e req-9650381b-31de-438d-97d1-ac3479524bac service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:00.567164 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-2bf2480a-5900-48ab-9c59-551e201f431e req-9650381b-31de-438d-97d1-ac3479524bac service nova] Creating event network-vif-plugged:7e7a43a5-3a15-49a6-b50e-0ac0ac9faa8d for instance 82b86465-afb0-49ef-9932-1538010c1ae5 on n-h2-851028-13 Oct 04 18:44:00.585471 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-2bf2480a-5900-48ab-9c59-551e201f431e req-9650381b-31de-438d-97d1-ac3479524bac service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112217 Oct 04 18:44:00.590005 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1626/3095] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:44:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:44:00.602409 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-2e22931a-7cfa-4207-b1e9-0934e7fde50d tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:00.609737 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-2e22931a-7cfa-4207-b1e9-0934e7fde50d tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] [instance: 6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:00.627616 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2e22931a-7cfa-4207-b1e9-0934e7fde50d tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:00.630639 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2e22931a-7cfa-4207-b1e9-0934e7fde50d tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:00.634073 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2e22931a-7cfa-4207-b1e9-0934e7fde50d tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:00.635705 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2e22931a-7cfa-4207-b1e9-0934e7fde50d tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:00.639981 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2e22931a-7cfa-4207-b1e9-0934e7fde50d tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:00.641494 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2e22931a-7cfa-4207-b1e9-0934e7fde50d tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:00.655373 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=100 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:44:00.927801 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-2e22931a-7cfa-4207-b1e9-0934e7fde50d tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] 10.222.0.43 "GET /compute/v2.1/servers/6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.336028 Oct 04 18:44:00.928715 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1627/3096] 10.222.0.43 () {58 vars in 1275 bytes} [Tue Oct 4 18:44:00 2022] GET /compute/v2.1/servers/6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75/os-interface => generated 285 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:44:00.941547 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-3ced3e33-5ea7-42b6-9b26-01d193ec2113 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:00.943052 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-3ced3e33-5ea7-42b6-9b26-01d193ec2113 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 82b86465-afb0-49ef-9932-1538010c1ae5] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:00.966753 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3ced3e33-5ea7-42b6-9b26-01d193ec2113 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:00.984090 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3ced3e33-5ea7-42b6-9b26-01d193ec2113 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:00.984800 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3ced3e33-5ea7-42b6-9b26-01d193ec2113 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:00.985983 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3ced3e33-5ea7-42b6-9b26-01d193ec2113 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:00.986462 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3ced3e33-5ea7-42b6-9b26-01d193ec2113 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:00.986896 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3ced3e33-5ea7-42b6-9b26-01d193ec2113 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:01.158176 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-46d8925d-7315-4d92-9db5-30c4273a1f47 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96e7480de94c43909045ac1087e40cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6bd34bf5540ee95c8144f185eb22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:01.174946 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-46d8925d-7315-4d92-9db5-30c4273a1f47 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] 10.222.0.43 "GET /compute/v2.1/servers/f726f3f3-4731-4380-9163-b2273b629810" status: 200 len: 1508 microversion: 2.1 time: 2.357823 Oct 04 18:44:01.176294 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1470/3097] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:58 2022] GET /compute/v2.1/servers/f726f3f3-4731-4380-9163-b2273b629810 => generated 1508 bytes in 2363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:01.496849 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-d4b6a824-1e0d-4af2-8ba0-67b3c0f179b1 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:01.497722 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-d4b6a824-1e0d-4af2-8ba0-67b3c0f179b1 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] [instance: a721ca75-1707-4a91-96d0-431dece9b401] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:01.510521 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d4b6a824-1e0d-4af2-8ba0-67b3c0f179b1 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:01.514429 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d4b6a824-1e0d-4af2-8ba0-67b3c0f179b1 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:01.517806 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d4b6a824-1e0d-4af2-8ba0-67b3c0f179b1 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:01.522324 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d4b6a824-1e0d-4af2-8ba0-67b3c0f179b1 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:01.523203 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d4b6a824-1e0d-4af2-8ba0-67b3c0f179b1 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:01.524485 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d4b6a824-1e0d-4af2-8ba0-67b3c0f179b1 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:01.647285 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-3ced3e33-5ea7-42b6-9b26-01d193ec2113 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:01.665502 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-3ced3e33-5ea7-42b6-9b26-01d193ec2113 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5" status: 200 len: 1680 microversion: 2.1 time: 0.730063 Oct 04 18:44:01.672515 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1628/3098] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:00 2022] GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5 => generated 1680 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:02.200073 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-526107ac-c7d1-414b-8a80-723edabdd7a4 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:02.200723 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-526107ac-c7d1-414b-8a80-723edabdd7a4 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] [instance: f726f3f3-4731-4380-9163-b2273b629810] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:02.221640 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-526107ac-c7d1-414b-8a80-723edabdd7a4 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:02.222153 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-526107ac-c7d1-414b-8a80-723edabdd7a4 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:02.222600 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-526107ac-c7d1-414b-8a80-723edabdd7a4 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:02.223331 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-526107ac-c7d1-414b-8a80-723edabdd7a4 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:02.223800 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-526107ac-c7d1-414b-8a80-723edabdd7a4 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:02.224220 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-526107ac-c7d1-414b-8a80-723edabdd7a4 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:02.843030 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-d4b6a824-1e0d-4af2-8ba0-67b3c0f179b1 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608fc9ed7cdb487c9bf4b783c26ceeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29876d6805924df882d6861b0f6ab4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:02.855245 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-d4b6a824-1e0d-4af2-8ba0-67b3c0f179b1 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] 10.222.0.43 "GET /compute/v2.1/servers/a721ca75-1707-4a91-96d0-431dece9b401" status: 200 len: 1314 microversion: 2.1 time: 1.362962 Oct 04 18:44:02.856527 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1471/3099] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:01 2022] GET /compute/v2.1/servers/a721ca75-1707-4a91-96d0-431dece9b401 => generated 1314 bytes in 1365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:44:02.875913 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-b2940a4d-e422-4ec1-8c14-c7697d2f0b72 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:02.876933 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-b2940a4d-e422-4ec1-8c14-c7697d2f0b72 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 82b86465-afb0-49ef-9932-1538010c1ae5] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:02.889086 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b2940a4d-e422-4ec1-8c14-c7697d2f0b72 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:02.891561 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b2940a4d-e422-4ec1-8c14-c7697d2f0b72 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:02.894019 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b2940a4d-e422-4ec1-8c14-c7697d2f0b72 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:02.894988 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b2940a4d-e422-4ec1-8c14-c7697d2f0b72 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:02.896562 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b2940a4d-e422-4ec1-8c14-c7697d2f0b72 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:02.899796 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b2940a4d-e422-4ec1-8c14-c7697d2f0b72 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:03.261950 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-b2940a4d-e422-4ec1-8c14-c7697d2f0b72 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:03.273285 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-b2940a4d-e422-4ec1-8c14-c7697d2f0b72 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5" status: 200 len: 1680 microversion: 2.1 time: 0.412836 Oct 04 18:44:03.273946 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1472/3100] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:02 2022] GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5 => generated 1680 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:03.814917 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-526107ac-c7d1-414b-8a80-723edabdd7a4 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96e7480de94c43909045ac1087e40cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6bd34bf5540ee95c8144f185eb22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:03.828926 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-526107ac-c7d1-414b-8a80-723edabdd7a4 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] 10.222.0.43 "GET /compute/v2.1/servers/f726f3f3-4731-4380-9163-b2273b629810" status: 200 len: 1508 microversion: 2.1 time: 1.633500 Oct 04 18:44:03.830634 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1629/3101] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:02 2022] GET /compute/v2.1/servers/f726f3f3-4731-4380-9163-b2273b629810 => generated 1508 bytes in 1636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:03.890201 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-a7920ed3-1dc7-4fa7-8950-c6481c2d7e0d tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:03.890863 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-a7920ed3-1dc7-4fa7-8950-c6481c2d7e0d tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] [instance: a721ca75-1707-4a91-96d0-431dece9b401] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:03.900381 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a7920ed3-1dc7-4fa7-8950-c6481c2d7e0d tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:03.900878 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a7920ed3-1dc7-4fa7-8950-c6481c2d7e0d tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:03.901350 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a7920ed3-1dc7-4fa7-8950-c6481c2d7e0d tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:03.902056 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a7920ed3-1dc7-4fa7-8950-c6481c2d7e0d tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:03.921553 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a7920ed3-1dc7-4fa7-8950-c6481c2d7e0d tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:03.922014 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a7920ed3-1dc7-4fa7-8950-c6481c2d7e0d tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:04.305385 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-59c3b722-d312-4dc5-92d5-6c095598385f tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:04.307304 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-59c3b722-d312-4dc5-92d5-6c095598385f tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 82b86465-afb0-49ef-9932-1538010c1ae5] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:04.332411 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-a7920ed3-1dc7-4fa7-8950-c6481c2d7e0d tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608fc9ed7cdb487c9bf4b783c26ceeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29876d6805924df882d6861b0f6ab4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:04.340175 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-59c3b722-d312-4dc5-92d5-6c095598385f tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:04.345806 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-59c3b722-d312-4dc5-92d5-6c095598385f tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:04.347487 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-59c3b722-d312-4dc5-92d5-6c095598385f tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:04.348949 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-59c3b722-d312-4dc5-92d5-6c095598385f tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:04.349917 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-a7920ed3-1dc7-4fa7-8950-c6481c2d7e0d tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] 10.222.0.43 "GET /compute/v2.1/servers/a721ca75-1707-4a91-96d0-431dece9b401" status: 200 len: 1314 microversion: 2.1 time: 0.466815 Oct 04 18:44:04.351277 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-59c3b722-d312-4dc5-92d5-6c095598385f tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:04.351846 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-59c3b722-d312-4dc5-92d5-6c095598385f tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:04.352237 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1473/3102] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:03 2022] GET /compute/v2.1/servers/a721ca75-1707-4a91-96d0-431dece9b401 => generated 1314 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:04.833503 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-59c3b722-d312-4dc5-92d5-6c095598385f tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:04.847676 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-59c3b722-d312-4dc5-92d5-6c095598385f tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5" status: 200 len: 1680 microversion: 2.1 time: 0.551590 Oct 04 18:44:04.855743 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-92ad40a6-f595-4e9f-a06b-c70bcd4e009e tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:04.856632 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-92ad40a6-f595-4e9f-a06b-c70bcd4e009e tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] [instance: f726f3f3-4731-4380-9163-b2273b629810] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:04.866294 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-92ad40a6-f595-4e9f-a06b-c70bcd4e009e tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:04.868042 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-92ad40a6-f595-4e9f-a06b-c70bcd4e009e tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:04.870347 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-92ad40a6-f595-4e9f-a06b-c70bcd4e009e tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:04.872103 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1630/3103] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:04 2022] GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5 => generated 1680 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:44:04.877774 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-92ad40a6-f595-4e9f-a06b-c70bcd4e009e tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:04.881473 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-92ad40a6-f595-4e9f-a06b-c70bcd4e009e tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:04.882275 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-92ad40a6-f595-4e9f-a06b-c70bcd4e009e tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:05.291555 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-92ad40a6-f595-4e9f-a06b-c70bcd4e009e tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96e7480de94c43909045ac1087e40cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6bd34bf5540ee95c8144f185eb22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:05.292958 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-87fda105-f27b-491e-96ec-73dd600aa178 req-e60df2dd-9c82-4ab7-8ede-4c817f93c8bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75", "tag": "3b617c59-561d-4917-87cb-5c5ab7f63852"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:44:05.298530 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:44:05.307816 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-92ad40a6-f595-4e9f-a06b-c70bcd4e009e tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] 10.222.0.43 "GET /compute/v2.1/servers/f726f3f3-4731-4380-9163-b2273b629810" status: 200 len: 1508 microversion: 2.1 time: 0.455451 Oct 04 18:44:05.324668 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-87fda105-f27b-491e-96ec-73dd600aa178 req-e60df2dd-9c82-4ab7-8ede-4c817f93c8bb service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:05.328291 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-87fda105-f27b-491e-96ec-73dd600aa178 req-e60df2dd-9c82-4ab7-8ede-4c817f93c8bb service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:05.328792 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-87fda105-f27b-491e-96ec-73dd600aa178 req-e60df2dd-9c82-4ab7-8ede-4c817f93c8bb service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:05.344775 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1474/3104] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:04 2022] GET /compute/v2.1/servers/f726f3f3-4731-4380-9163-b2273b629810 => generated 1508 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:05.361285 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-87fda105-f27b-491e-96ec-73dd600aa178 req-e60df2dd-9c82-4ab7-8ede-4c817f93c8bb service nova] Creating event network-changed:3b617c59-561d-4917-87cb-5c5ab7f63852 for instance 6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75 on n-h1-851028-13 Oct 04 18:44:05.380416 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-819299da-f082-4da5-b540-c2e6ccfae0d9 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:05.381039 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-819299da-f082-4da5-b540-c2e6ccfae0d9 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] [instance: a721ca75-1707-4a91-96d0-431dece9b401] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:05.384236 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-87fda105-f27b-491e-96ec-73dd600aa178 req-e60df2dd-9c82-4ab7-8ede-4c817f93c8bb service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096331 Oct 04 18:44:05.391546 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-819299da-f082-4da5-b540-c2e6ccfae0d9 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:05.392070 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-819299da-f082-4da5-b540-c2e6ccfae0d9 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:05.392494 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-819299da-f082-4da5-b540-c2e6ccfae0d9 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:05.393214 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-819299da-f082-4da5-b540-c2e6ccfae0d9 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:05.394842 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1631/3105] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:44:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:44:05.398137 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-819299da-f082-4da5-b540-c2e6ccfae0d9 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:05.405798 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-819299da-f082-4da5-b540-c2e6ccfae0d9 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:05.880695 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-699c9a8d-2a5f-4003-9954-50e953ce9ac3 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:05.881619 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-699c9a8d-2a5f-4003-9954-50e953ce9ac3 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 82b86465-afb0-49ef-9932-1538010c1ae5] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:05.892768 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-699c9a8d-2a5f-4003-9954-50e953ce9ac3 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:05.894799 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-699c9a8d-2a5f-4003-9954-50e953ce9ac3 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:05.895779 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-699c9a8d-2a5f-4003-9954-50e953ce9ac3 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:05.897050 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-699c9a8d-2a5f-4003-9954-50e953ce9ac3 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:05.898095 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-699c9a8d-2a5f-4003-9954-50e953ce9ac3 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:05.899353 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-699c9a8d-2a5f-4003-9954-50e953ce9ac3 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:06.218082 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-819299da-f082-4da5-b540-c2e6ccfae0d9 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608fc9ed7cdb487c9bf4b783c26ceeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29876d6805924df882d6861b0f6ab4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:06.228984 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-819299da-f082-4da5-b540-c2e6ccfae0d9 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] 10.222.0.43 "GET /compute/v2.1/servers/a721ca75-1707-4a91-96d0-431dece9b401" status: 200 len: 1314 microversion: 2.1 time: 0.852004 Oct 04 18:44:06.236166 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1475/3106] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:05 2022] GET /compute/v2.1/servers/a721ca75-1707-4a91-96d0-431dece9b401 => generated 1314 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:06.275051 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-699c9a8d-2a5f-4003-9954-50e953ce9ac3 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:06.289741 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-699c9a8d-2a5f-4003-9954-50e953ce9ac3 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5" status: 200 len: 1680 microversion: 2.1 time: 0.413980 Oct 04 18:44:06.292068 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1632/3107] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:05 2022] GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5 => generated 1680 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:44:06.339403 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-2a1d213a-9abf-404c-a7a6-3329e67914e6 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:06.340091 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-2a1d213a-9abf-404c-a7a6-3329e67914e6 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] [instance: f726f3f3-4731-4380-9163-b2273b629810] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:06.358450 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2a1d213a-9abf-404c-a7a6-3329e67914e6 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:06.363029 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2a1d213a-9abf-404c-a7a6-3329e67914e6 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:06.365747 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2a1d213a-9abf-404c-a7a6-3329e67914e6 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:06.369980 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2a1d213a-9abf-404c-a7a6-3329e67914e6 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:06.371349 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2a1d213a-9abf-404c-a7a6-3329e67914e6 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:06.373821 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2a1d213a-9abf-404c-a7a6-3329e67914e6 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:06.653842 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-b62154c4-59d8-4eeb-bdd2-0fc578cff93d req-97182030-f0d2-4792-b99f-7698d4f0eaf0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a721ca75-1707-4a91-96d0-431dece9b401", "name": "network-vif-plugged", "status": "completed", "tag": "8c86755f-b407-4528-abb1-6c70d6106ad8"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:44:06.674496 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-b62154c4-59d8-4eeb-bdd2-0fc578cff93d req-97182030-f0d2-4792-b99f-7698d4f0eaf0 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:06.675515 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-b62154c4-59d8-4eeb-bdd2-0fc578cff93d req-97182030-f0d2-4792-b99f-7698d4f0eaf0 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:06.679685 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-b62154c4-59d8-4eeb-bdd2-0fc578cff93d req-97182030-f0d2-4792-b99f-7698d4f0eaf0 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:06.716691 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-b62154c4-59d8-4eeb-bdd2-0fc578cff93d req-97182030-f0d2-4792-b99f-7698d4f0eaf0 service nova] Creating event network-vif-plugged:8c86755f-b407-4528-abb1-6c70d6106ad8 for instance a721ca75-1707-4a91-96d0-431dece9b401 on n-h2-851028-13 Oct 04 18:44:06.731407 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-b62154c4-59d8-4eeb-bdd2-0fc578cff93d req-97182030-f0d2-4792-b99f-7698d4f0eaf0 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081649 Oct 04 18:44:06.733970 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1633/3108] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:44:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:44:07.258664 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-078f65bb-dbd7-4ce4-82d4-ced27358af17 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:07.259410 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-078f65bb-dbd7-4ce4-82d4-ced27358af17 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] [instance: a721ca75-1707-4a91-96d0-431dece9b401] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:07.282969 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-078f65bb-dbd7-4ce4-82d4-ced27358af17 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:07.283488 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-078f65bb-dbd7-4ce4-82d4-ced27358af17 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:07.283943 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-078f65bb-dbd7-4ce4-82d4-ced27358af17 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:07.293213 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-078f65bb-dbd7-4ce4-82d4-ced27358af17 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:07.293999 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-078f65bb-dbd7-4ce4-82d4-ced27358af17 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:07.294474 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-078f65bb-dbd7-4ce4-82d4-ced27358af17 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:07.686751 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-078f65bb-dbd7-4ce4-82d4-ced27358af17 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608fc9ed7cdb487c9bf4b783c26ceeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29876d6805924df882d6861b0f6ab4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:07.704906 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-078f65bb-dbd7-4ce4-82d4-ced27358af17 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] 10.222.0.43 "GET /compute/v2.1/servers/a721ca75-1707-4a91-96d0-431dece9b401" status: 200 len: 1314 microversion: 2.1 time: 0.450562 Oct 04 18:44:07.705948 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1634/3109] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:07 2022] GET /compute/v2.1/servers/a721ca75-1707-4a91-96d0-431dece9b401 => generated 1314 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:07.720788 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-0a0d0969-127e-4f30-81e8-06c6b83874f9 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:07.721825 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-0a0d0969-127e-4f30-81e8-06c6b83874f9 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 82b86465-afb0-49ef-9932-1538010c1ae5] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:07.736448 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0a0d0969-127e-4f30-81e8-06c6b83874f9 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:07.738546 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0a0d0969-127e-4f30-81e8-06c6b83874f9 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:07.740480 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0a0d0969-127e-4f30-81e8-06c6b83874f9 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:07.741602 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0a0d0969-127e-4f30-81e8-06c6b83874f9 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:07.743155 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0a0d0969-127e-4f30-81e8-06c6b83874f9 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:07.744030 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0a0d0969-127e-4f30-81e8-06c6b83874f9 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:08.035263 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-2a1d213a-9abf-404c-a7a6-3329e67914e6 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96e7480de94c43909045ac1087e40cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6bd34bf5540ee95c8144f185eb22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:08.057728 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-2a1d213a-9abf-404c-a7a6-3329e67914e6 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] 10.222.0.43 "GET /compute/v2.1/servers/f726f3f3-4731-4380-9163-b2273b629810" status: 200 len: 1514 microversion: 2.1 time: 1.719347 Oct 04 18:44:08.074850 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1476/3110] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:06 2022] GET /compute/v2.1/servers/f726f3f3-4731-4380-9163-b2273b629810 => generated 1514 bytes in 1740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:08.178871 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-0a0d0969-127e-4f30-81e8-06c6b83874f9 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:08.192942 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-0a0d0969-127e-4f30-81e8-06c6b83874f9 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5" status: 200 len: 1680 microversion: 2.1 time: 0.485245 Oct 04 18:44:08.198868 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1635/3111] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:07 2022] GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5 => generated 1680 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:08.438929 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-08c8ef93-6060-4ac9-a6c4-5e7ab5fbb336 tempest-ServerGroup264TestJSON-1037716031 tempest-ServerGroup264TestJSON-1037716031-project] Action: 'create', calling method: .version_select at 0x7fb21ec94790>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:44:08.475249 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-08c8ef93-6060-4ac9-a6c4-5e7ab5fbb336 tempest-ServerGroup264TestJSON-1037716031 tempest-ServerGroup264TestJSON-1037716031-project] Getting quotas for project 4cbf3306014048819d9bf56689914992. Resources: {'server_groups'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:44:08.490786 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-08c8ef93-6060-4ac9-a6c4-5e7ab5fbb336 tempest-ServerGroup264TestJSON-1037716031 tempest-ServerGroup264TestJSON-1037716031-project] Getting quotas for user 76db1667f2444511881070096042ee76 and project 4cbf3306014048819d9bf56689914992. Resources: {'server_groups'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:44:08.555081 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:44:08.614471 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-08c8ef93-6060-4ac9-a6c4-5e7ab5fbb336 tempest-ServerGroup264TestJSON-1037716031 tempest-ServerGroup264TestJSON-1037716031-project] Getting quotas for project 4cbf3306014048819d9bf56689914992. Resources: {'server_groups'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:44:08.624807 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-08c8ef93-6060-4ac9-a6c4-5e7ab5fbb336 tempest-ServerGroup264TestJSON-1037716031 tempest-ServerGroup264TestJSON-1037716031-project] Getting quotas for user 76db1667f2444511881070096042ee76 and project 4cbf3306014048819d9bf56689914992. Resources: {'server_groups'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:44:08.663160 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-08c8ef93-6060-4ac9-a6c4-5e7ab5fbb336 tempest-ServerGroup264TestJSON-1037716031 tempest-ServerGroup264TestJSON-1037716031-project] 10.222.0.43 "POST /compute/v2.1/os-server-groups" status: 200 len: 235 microversion: 2.64 time: 0.587081 Oct 04 18:44:08.666085 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1477/3112] 10.222.0.43 () {62 vars in 1214 bytes} [Tue Oct 4 18:44:08 2022] POST /compute/v2.1/os-server-groups => generated 235 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:44:08.684971 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-8facad4f-f477-447f-816e-6f6929724b32 tempest-ServerGroup264TestJSON-1037716031 tempest-ServerGroup264TestJSON-1037716031-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:08.731256 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-40584696-0681-4596-83f7-73cf4787e9d9 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:08.732441 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-40584696-0681-4596-83f7-73cf4787e9d9 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] [instance: a721ca75-1707-4a91-96d0-431dece9b401] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:08.751823 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-8facad4f-f477-447f-816e-6f6929724b32 tempest-ServerGroup264TestJSON-1037716031 tempest-ServerGroup264TestJSON-1037716031-project] 10.222.0.43 "GET /compute/v2.1/os-server-groups" status: 200 len: 238 microversion: 2.64 time: 0.076873 Oct 04 18:44:08.759108 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1636/3113] 10.222.0.43 () {60 vars in 1193 bytes} [Tue Oct 4 18:44:08 2022] GET /compute/v2.1/os-server-groups => generated 238 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:44:08.763250 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-40584696-0681-4596-83f7-73cf4787e9d9 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:08.763749 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-40584696-0681-4596-83f7-73cf4787e9d9 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:08.765649 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-40584696-0681-4596-83f7-73cf4787e9d9 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:08.770686 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-3efebe44-4629-4f39-b0f9-55b8df552357 tempest-ServerGroup264TestJSON-1037716031 tempest-ServerGroup264TestJSON-1037716031-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:08.773605 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-40584696-0681-4596-83f7-73cf4787e9d9 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:08.774270 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-40584696-0681-4596-83f7-73cf4787e9d9 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:08.775769 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-40584696-0681-4596-83f7-73cf4787e9d9 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:08.809831 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-3efebe44-4629-4f39-b0f9-55b8df552357 tempest-ServerGroup264TestJSON-1037716031 tempest-ServerGroup264TestJSON-1037716031-project] 10.222.0.43 "GET /compute/v2.1/os-server-groups/6214e734-ba39-49ad-ac7e-1e40d6d5a40f" status: 200 len: 235 microversion: 2.64 time: 0.041233 Oct 04 18:44:08.816313 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1637/3114] 10.222.0.43 () {60 vars in 1304 bytes} [Tue Oct 4 18:44:08 2022] GET /compute/v2.1/os-server-groups/6214e734-ba39-49ad-ac7e-1e40d6d5a40f => generated 235 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 18:44:08.830930 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-8516190f-a8fe-44c0-9da3-068de3b22d8f tempest-ServerGroup264TestJSON-1037716031 tempest-ServerGroup264TestJSON-1037716031-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:08.927160 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-8516190f-a8fe-44c0-9da3-068de3b22d8f tempest-ServerGroup264TestJSON-1037716031 tempest-ServerGroup264TestJSON-1037716031-project] 10.222.0.43 "DELETE /compute/v2.1/os-server-groups/6214e734-ba39-49ad-ac7e-1e40d6d5a40f" status: 204 len: 0 microversion: 2.64 time: 0.102755 Oct 04 18:44:08.927752 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1638/3115] 10.222.0.43 () {60 vars in 1307 bytes} [Tue Oct 4 18:44:08 2022] DELETE /compute/v2.1/os-server-groups/6214e734-ba39-49ad-ac7e-1e40d6d5a40f => generated 0 bytes in 105 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 04 18:44:08.943318 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-c0032c0b-0d12-4b72-bd4c-e5e25aafa48c tempest-ServerGroup264TestJSON-1037716031 tempest-ServerGroup264TestJSON-1037716031-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:08.959602 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-c0032c0b-0d12-4b72-bd4c-e5e25aafa48c tempest-ServerGroup264TestJSON-1037716031 tempest-ServerGroup264TestJSON-1037716031-project] HTTP exception thrown: Instance group 6214e734-ba39-49ad-ac7e-1e40d6d5a40f could not be found. Oct 04 18:44:08.961318 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-c0032c0b-0d12-4b72-bd4c-e5e25aafa48c tempest-ServerGroup264TestJSON-1037716031 tempest-ServerGroup264TestJSON-1037716031-project] Request method failure captured: Oct 04 18:44:08.961318 n-d-851028-13 devstack@n-api.service[123596]: request: DELETE /compute/v2.1/os-server-groups/6214e734-ba39-49ad-ac7e-1e40d6d5a40f HTTP/1.1 Oct 04 18:44:08.961318 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:44:08.961318 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:44:08.961318 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:44:08.961318 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 18:44:08.961318 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:44:08.961318 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:44:08.961318 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:44:08.961318 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:44:08.961318 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPH73c2R8XAHOjfcXc1Wis8s3jVGCIwBrow66BHlwnEHK1bw3q7TYbWLu6MiNcP_ajid2fZWrEqGlXVBW49PtGyyyMNPoKKah6AaJDAa_Q5tKvjwxae-z1fMuaKV2UVdw3sM6krZpAePrLOwDBq5Sv-RK35QDTGz1TREAyiWaBGkvKmA Oct 04 18:44:08.961318 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:44:08.961318 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:44:08.961318 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:44:08.961318 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:44:08.961318 n-d-851028-13 devstack@n-api.service[123596]: X-Openstack-Nova-Api-Version: 2.64 Oct 04 18:44:08.961318 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:44:08.961318 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:44:08.961318 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: 4cbf3306014048819d9bf56689914992 Oct 04 18:44:08.961318 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-ServerGroup264TestJSON-1037716031 Oct 04 18:44:08.961318 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 18:44:08.961318 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 18:44:08.961318 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/4cbf3306014048819d9bf56689914992"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_4cbf3306014048819d9bf56689914992"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4cbf3306014048819d9bf56689914992"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4cbf3306014048819d9bf56689914992"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:44:08.961318 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-ServerGroup264TestJSON-1037716031 Oct 04 18:44:08.961318 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: 4cbf3306014048819d9bf56689914992 Oct 04 18:44:08.961318 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-ServerGroup264TestJSON-1037716031 Oct 04 18:44:08.961318 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-ServerGroup264TestJSON-1037716031-project Oct 04 18:44:08.961318 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:44:08.961318 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:44:08.961318 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 76db1667f2444511881070096042ee76 Oct 04 18:44:08.961318 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-ServerGroup264TestJSON-1037716031-project Oct 04 18:44:08.961318 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 18:44:08.961318 n-d-851028-13 devstack@n-api.service[123596]: exception: Instance group 6214e734-ba39-49ad-ac7e-1e40d6d5a40f could not be found. Oct 04 18:44:08.961318 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': '6214e734-ba39-49ad-ac7e-1e40d6d5a40f'} Oct 04 18:44:08.961318 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:44:08.961318 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:44:08.961318 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 04 18:44:08.961318 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 04 18:44:08.961318 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 18:44:08.961318 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 18:44:08.961318 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 04 18:44:08.961318 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 04 18:44:08.961318 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 18:44:08.961318 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 18:44:08.961318 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 04 18:44:08.961318 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 04 18:44:08.961318 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 6214e734-ba39-49ad-ac7e-1e40d6d5a40f could not be found. Oct 04 18:44:08.961318 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:44:08.961318 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:44:08.961318 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:44:08.961318 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:44:08.961318 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:44:08.961318 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:44:08.961318 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:44:08.961318 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:44:08.961318 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:44:08.961318 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:44:08.961318 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 04 18:44:08.961318 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:44:08.961318 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 6214e734-ba39-49ad-ac7e-1e40d6d5a40f could not be found. Oct 04 18:44:08.961318 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:44:08.961318 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:44:08.961318 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:44:08.961318 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:44:08.966333 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:44:08.966333 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:44:08.966333 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:44:08.966333 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:44:08.966333 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 6214e734-ba39-49ad-ac7e-1e40d6d5a40f could not be found. Oct 04 18:44:08.966333 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:44:08.967670 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-c0032c0b-0d12-4b72-bd4c-e5e25aafa48c tempest-ServerGroup264TestJSON-1037716031 tempest-ServerGroup264TestJSON-1037716031-project] Returning 404 to user: Instance group 6214e734-ba39-49ad-ac7e-1e40d6d5a40f could not be found. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:44:08.968569 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-c0032c0b-0d12-4b72-bd4c-e5e25aafa48c tempest-ServerGroup264TestJSON-1037716031 tempest-ServerGroup264TestJSON-1037716031-project] 10.222.0.43 "DELETE /compute/v2.1/os-server-groups/6214e734-ba39-49ad-ac7e-1e40d6d5a40f" status: 404 len: 117 microversion: 2.64 time: 0.034310 Oct 04 18:44:08.969448 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1639/3116] 10.222.0.43 () {60 vars in 1307 bytes} [Tue Oct 4 18:44:08 2022] DELETE /compute/v2.1/os-server-groups/6214e734-ba39-49ad-ac7e-1e40d6d5a40f => generated 117 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:44:09.226492 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-e7038eb4-2ecd-45bd-86f0-467899066810 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:09.227320 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-e7038eb4-2ecd-45bd-86f0-467899066810 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 82b86465-afb0-49ef-9932-1538010c1ae5] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:09.240276 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e7038eb4-2ecd-45bd-86f0-467899066810 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:09.241445 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e7038eb4-2ecd-45bd-86f0-467899066810 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:09.244465 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e7038eb4-2ecd-45bd-86f0-467899066810 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:09.248487 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e7038eb4-2ecd-45bd-86f0-467899066810 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:09.249970 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e7038eb4-2ecd-45bd-86f0-467899066810 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:09.251823 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e7038eb4-2ecd-45bd-86f0-467899066810 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:09.516978 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-40584696-0681-4596-83f7-73cf4787e9d9 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608fc9ed7cdb487c9bf4b783c26ceeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29876d6805924df882d6861b0f6ab4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:09.529526 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-40584696-0681-4596-83f7-73cf4787e9d9 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] 10.222.0.43 "GET /compute/v2.1/servers/a721ca75-1707-4a91-96d0-431dece9b401" status: 200 len: 1314 microversion: 2.1 time: 0.802580 Oct 04 18:44:09.530743 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1478/3117] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:08 2022] GET /compute/v2.1/servers/a721ca75-1707-4a91-96d0-431dece9b401 => generated 1314 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:10.555536 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-eb7034b9-db07-49b6-bc17-2ba7c4acb7ae tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:10.557262 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-eb7034b9-db07-49b6-bc17-2ba7c4acb7ae tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] [instance: a721ca75-1707-4a91-96d0-431dece9b401] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:10.571419 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-eb7034b9-db07-49b6-bc17-2ba7c4acb7ae tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:10.577751 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-eb7034b9-db07-49b6-bc17-2ba7c4acb7ae tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:10.579202 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-eb7034b9-db07-49b6-bc17-2ba7c4acb7ae tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:10.584548 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-eb7034b9-db07-49b6-bc17-2ba7c4acb7ae tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:10.588019 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-eb7034b9-db07-49b6-bc17-2ba7c4acb7ae tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:10.590521 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-eb7034b9-db07-49b6-bc17-2ba7c4acb7ae tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:10.990279 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-e7038eb4-2ecd-45bd-86f0-467899066810 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:11.005420 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-e7038eb4-2ecd-45bd-86f0-467899066810 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5" status: 200 len: 1680 microversion: 2.1 time: 1.782812 Oct 04 18:44:11.019389 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1640/3118] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:09 2022] GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5 => generated 1680 bytes in 1797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:44:11.034485 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-70fd96b1-bfe9-41a9-944c-fa8eafbe666b tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Action: 'create', calling method: .version_select at 0x7fb21eab5f70>, body: {"keypair": {"name": "tempest-keypair-235700876", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBlgEzApiri78ai37ejdYXMk+V56Qs3KQkVqJCIHOMDjsRwd4AK7wmj5+aLaRQcWc2i4T6cR2+VPznT0g0im7U0P2ufz0J+2Ez4Oy5mRv80OzbafUFb7J46rSReSn5vQJQ=="}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:44:11.096108 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-70fd96b1-bfe9-41a9-944c-fa8eafbe666b tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Getting quotas for project eda6bd34bf5540ee95c8144f185eb22d. Resources: {'key_pairs'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:44:11.117501 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-70fd96b1-bfe9-41a9-944c-fa8eafbe666b tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Getting quotas for user 96e7480de94c43909045ac1087e40cd8 and project eda6bd34bf5540ee95c8144f185eb22d. Resources: {'key_pairs'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:44:11.180890 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-70fd96b1-bfe9-41a9-944c-fa8eafbe666b tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.159784 Oct 04 18:44:11.181943 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1641/3119] 10.222.0.43 () {60 vars in 1159 bytes} [Tue Oct 4 18:44:11 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:44:11.329937 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-eb7034b9-db07-49b6-bc17-2ba7c4acb7ae tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608fc9ed7cdb487c9bf4b783c26ceeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29876d6805924df882d6861b0f6ab4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:11.347514 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-eb7034b9-db07-49b6-bc17-2ba7c4acb7ae tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] 10.222.0.43 "GET /compute/v2.1/servers/a721ca75-1707-4a91-96d0-431dece9b401" status: 200 len: 1464 microversion: 2.1 time: 0.799310 Oct 04 18:44:11.350861 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1479/3120] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:10 2022] GET /compute/v2.1/servers/a721ca75-1707-4a91-96d0-431dece9b401 => generated 1464 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:44:11.694759 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-8e0afa18-785d-4f94-9166-aebc84c62e71 tempest-ServersAdminTestJSON-1312894221 tempest-ServersAdminTestJSON-1312894221-project-admin] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:11.713772 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-8e0afa18-785d-4f94-9166-aebc84c62e71 tempest-ServersAdminTestJSON-1312894221 tempest-ServersAdminTestJSON-1312894221-project-admin] Searching by: {'deleted': False, 'project_id': 'eee3422c48a44a7e8beb6149a31387b2'} {{(pid=123596) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:44:11.751026 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8e0afa18-785d-4f94-9166-aebc84c62e71 tempest-ServersAdminTestJSON-1312894221 tempest-ServersAdminTestJSON-1312894221-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:11.752935 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8e0afa18-785d-4f94-9166-aebc84c62e71 tempest-ServersAdminTestJSON-1312894221 tempest-ServersAdminTestJSON-1312894221-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:11.753719 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8e0afa18-785d-4f94-9166-aebc84c62e71 tempest-ServersAdminTestJSON-1312894221 tempest-ServersAdminTestJSON-1312894221-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:11.770504 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8e0afa18-785d-4f94-9166-aebc84c62e71 tempest-ServersAdminTestJSON-1312894221 tempest-ServersAdminTestJSON-1312894221-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:11.772610 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8e0afa18-785d-4f94-9166-aebc84c62e71 tempest-ServersAdminTestJSON-1312894221 tempest-ServersAdminTestJSON-1312894221-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:11.774011 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8e0afa18-785d-4f94-9166-aebc84c62e71 tempest-ServersAdminTestJSON-1312894221 tempest-ServersAdminTestJSON-1312894221-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:11.875714 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-8e0afa18-785d-4f94-9166-aebc84c62e71 tempest-ServersAdminTestJSON-1312894221 tempest-ServersAdminTestJSON-1312894221-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 0.502314 Oct 04 18:44:11.879198 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1642/3121] 10.222.0.43 () {58 vars in 1146 bytes} [Tue Oct 4 18:44:11 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:44:11.908114 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-d3020fea-9c35-4394-b75f-fb69c9850af1 tempest-ServersAdminTestJSON-1312894221 tempest-ServersAdminTestJSON-1312894221-project-admin] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:11.923551 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-d3020fea-9c35-4394-b75f-fb69c9850af1 tempest-ServersAdminTestJSON-1312894221 tempest-ServersAdminTestJSON-1312894221-project-admin] Searching by: {'deleted': False} {{(pid=123595) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:44:11.940582 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d3020fea-9c35-4394-b75f-fb69c9850af1 tempest-ServersAdminTestJSON-1312894221 tempest-ServersAdminTestJSON-1312894221-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:11.942452 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d3020fea-9c35-4394-b75f-fb69c9850af1 tempest-ServersAdminTestJSON-1312894221 tempest-ServersAdminTestJSON-1312894221-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:11.943921 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d3020fea-9c35-4394-b75f-fb69c9850af1 tempest-ServersAdminTestJSON-1312894221 tempest-ServersAdminTestJSON-1312894221-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:11.949591 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d3020fea-9c35-4394-b75f-fb69c9850af1 tempest-ServersAdminTestJSON-1312894221 tempest-ServersAdminTestJSON-1312894221-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:11.950318 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d3020fea-9c35-4394-b75f-fb69c9850af1 tempest-ServersAdminTestJSON-1312894221 tempest-ServersAdminTestJSON-1312894221-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:11.950931 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d3020fea-9c35-4394-b75f-fb69c9850af1 tempest-ServersAdminTestJSON-1312894221 tempest-ServersAdminTestJSON-1312894221-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:12.041250 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-d3cf4b82-9d68-4153-9c51-b44a9022941c tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:12.042662 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-d3cf4b82-9d68-4153-9c51-b44a9022941c tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 82b86465-afb0-49ef-9932-1538010c1ae5] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:12.080422 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d3cf4b82-9d68-4153-9c51-b44a9022941c tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:12.080926 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d3cf4b82-9d68-4153-9c51-b44a9022941c tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:12.084799 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d3cf4b82-9d68-4153-9c51-b44a9022941c tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:12.094038 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d3cf4b82-9d68-4153-9c51-b44a9022941c tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:12.096869 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d3cf4b82-9d68-4153-9c51-b44a9022941c tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:12.097588 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d3cf4b82-9d68-4153-9c51-b44a9022941c tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:12.303504 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.multi_cell_list [None req-d3020fea-9c35-4394-b75f-fb69c9850af1 tempest-ServersAdminTestJSON-1312894221 tempest-ServersAdminTestJSON-1312894221-project-admin] Listed batch of 9 results from cell out of 1000 limit. Returned 9 total so far. {{(pid=123595) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 18:44:12.574769 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d3020fea-9c35-4394-b75f-fb69c9850af1 tempest-ServersAdminTestJSON-1312894221 tempest-ServersAdminTestJSON-1312894221-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:12.575642 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d3020fea-9c35-4394-b75f-fb69c9850af1 tempest-ServersAdminTestJSON-1312894221 tempest-ServersAdminTestJSON-1312894221-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:12.578240 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d3020fea-9c35-4394-b75f-fb69c9850af1 tempest-ServersAdminTestJSON-1312894221 tempest-ServersAdminTestJSON-1312894221-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:12.816556 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-d3cf4b82-9d68-4153-9c51-b44a9022941c tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:12.830445 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-d3cf4b82-9d68-4153-9c51-b44a9022941c tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5" status: 200 len: 1680 microversion: 2.1 time: 0.795317 Oct 04 18:44:12.833318 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1643/3122] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:12 2022] GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5 => generated 1680 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:44:13.605260 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-d3020fea-9c35-4394-b75f-fb69c9850af1 tempest-ServersAdminTestJSON-1312894221 tempest-ServersAdminTestJSON-1312894221-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 15017 microversion: 2.1 time: 1.701492 Oct 04 18:44:13.605849 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1480/3123] 10.222.0.43 () {58 vars in 1171 bytes} [Tue Oct 4 18:44:11 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 15017 bytes in 1703 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:44:13.646714 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-3965507b-db4c-4608-b230-917ab5a4302e tempest-ServersAdminTestJSON-1312894221 tempest-ServersAdminTestJSON-1312894221-project-admin] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:13.652955 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-3965507b-db4c-4608-b230-917ab5a4302e tempest-ServersAdminTestJSON-1312894221 tempest-ServersAdminTestJSON-1312894221-project-admin] Searching by: {'deleted': False, 'project_id': 'eee3422c48a44a7e8beb6149a31387b2'} {{(pid=123596) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:44:13.661197 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3965507b-db4c-4608-b230-917ab5a4302e tempest-ServersAdminTestJSON-1312894221 tempest-ServersAdminTestJSON-1312894221-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:13.661963 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3965507b-db4c-4608-b230-917ab5a4302e tempest-ServersAdminTestJSON-1312894221 tempest-ServersAdminTestJSON-1312894221-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:13.662615 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3965507b-db4c-4608-b230-917ab5a4302e tempest-ServersAdminTestJSON-1312894221 tempest-ServersAdminTestJSON-1312894221-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:13.663572 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3965507b-db4c-4608-b230-917ab5a4302e tempest-ServersAdminTestJSON-1312894221 tempest-ServersAdminTestJSON-1312894221-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:13.664290 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3965507b-db4c-4608-b230-917ab5a4302e tempest-ServersAdminTestJSON-1312894221 tempest-ServersAdminTestJSON-1312894221-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:13.664889 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3965507b-db4c-4608-b230-917ab5a4302e tempest-ServersAdminTestJSON-1312894221 tempest-ServersAdminTestJSON-1312894221-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:13.713923 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-3965507b-db4c-4608-b230-917ab5a4302e tempest-ServersAdminTestJSON-1312894221 tempest-ServersAdminTestJSON-1312894221-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/detail?tenant_id=29876d6805924df882d6861b0f6ab4f0" status: 200 len: 15 microversion: 2.1 time: 0.071339 Oct 04 18:44:13.715479 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1644/3124] 10.222.0.43 () {58 vars in 1231 bytes} [Tue Oct 4 18:44:13 2022] GET /compute/v2.1/servers/detail?tenant_id=29876d6805924df882d6861b0f6ab4f0 => generated 15 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:44:13.740942 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-b4b7f062-e03a-4591-a881-1bba8f8fb484 tempest-ServersAdminTestJSON-1312894221 tempest-ServersAdminTestJSON-1312894221-project-admin] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:13.750071 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-b4b7f062-e03a-4591-a881-1bba8f8fb484 tempest-ServersAdminTestJSON-1312894221 tempest-ServersAdminTestJSON-1312894221-project-admin] Searching by: {'tenant_id': '29876d6805924df882d6861b0f6ab4f0', 'deleted': False} {{(pid=123595) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:44:13.757523 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b4b7f062-e03a-4591-a881-1bba8f8fb484 tempest-ServersAdminTestJSON-1312894221 tempest-ServersAdminTestJSON-1312894221-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:13.758270 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b4b7f062-e03a-4591-a881-1bba8f8fb484 tempest-ServersAdminTestJSON-1312894221 tempest-ServersAdminTestJSON-1312894221-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:13.759510 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b4b7f062-e03a-4591-a881-1bba8f8fb484 tempest-ServersAdminTestJSON-1312894221 tempest-ServersAdminTestJSON-1312894221-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:13.760616 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b4b7f062-e03a-4591-a881-1bba8f8fb484 tempest-ServersAdminTestJSON-1312894221 tempest-ServersAdminTestJSON-1312894221-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:13.761521 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b4b7f062-e03a-4591-a881-1bba8f8fb484 tempest-ServersAdminTestJSON-1312894221 tempest-ServersAdminTestJSON-1312894221-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:13.762212 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b4b7f062-e03a-4591-a881-1bba8f8fb484 tempest-ServersAdminTestJSON-1312894221 tempest-ServersAdminTestJSON-1312894221-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:13.807128 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.multi_cell_list [None req-b4b7f062-e03a-4591-a881-1bba8f8fb484 tempest-ServersAdminTestJSON-1312894221 tempest-ServersAdminTestJSON-1312894221-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=123595) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 18:44:13.861398 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-53342d04-2568-4ca7-8dcb-d662cf7b75ff tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:13.862020 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-53342d04-2568-4ca7-8dcb-d662cf7b75ff tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 82b86465-afb0-49ef-9932-1538010c1ae5] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:13.886829 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-53342d04-2568-4ca7-8dcb-d662cf7b75ff tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:13.887439 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-53342d04-2568-4ca7-8dcb-d662cf7b75ff tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:13.887893 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-53342d04-2568-4ca7-8dcb-d662cf7b75ff tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:13.888643 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-53342d04-2568-4ca7-8dcb-d662cf7b75ff tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:13.889102 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-53342d04-2568-4ca7-8dcb-d662cf7b75ff tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:13.889572 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-53342d04-2568-4ca7-8dcb-d662cf7b75ff tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:13.923830 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b4b7f062-e03a-4591-a881-1bba8f8fb484 tempest-ServersAdminTestJSON-1312894221 tempest-ServersAdminTestJSON-1312894221-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:13.924748 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b4b7f062-e03a-4591-a881-1bba8f8fb484 tempest-ServersAdminTestJSON-1312894221 tempest-ServersAdminTestJSON-1312894221-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:13.925595 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b4b7f062-e03a-4591-a881-1bba8f8fb484 tempest-ServersAdminTestJSON-1312894221 tempest-ServersAdminTestJSON-1312894221-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:14.439472 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-b4b7f062-e03a-4591-a881-1bba8f8fb484 tempest-ServersAdminTestJSON-1312894221 tempest-ServersAdminTestJSON-1312894221-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=29876d6805924df882d6861b0f6ab4f0" status: 200 len: 4832 microversion: 2.1 time: 0.703117 Oct 04 18:44:14.453135 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1481/3125] 10.222.0.43 () {58 vars in 1257 bytes} [Tue Oct 4 18:44:13 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=29876d6805924df882d6861b0f6ab4f0 => generated 4832 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:14.470377 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-d897c28c-52eb-45c6-aea4-a0d426662a70 tempest-ServersAdminTestJSON-1312894221 tempest-ServersAdminTestJSON-1312894221-project-admin] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:14.498652 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-d897c28c-52eb-45c6-aea4-a0d426662a70 tempest-ServersAdminTestJSON-1312894221 tempest-ServersAdminTestJSON-1312894221-project-admin] Searching by: {'tenant_id': 'eee3422c48a44a7e8beb6149a31387b2', 'deleted': False} {{(pid=123595) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:44:14.518317 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d897c28c-52eb-45c6-aea4-a0d426662a70 tempest-ServersAdminTestJSON-1312894221 tempest-ServersAdminTestJSON-1312894221-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:14.520716 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d897c28c-52eb-45c6-aea4-a0d426662a70 tempest-ServersAdminTestJSON-1312894221 tempest-ServersAdminTestJSON-1312894221-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:14.522742 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d897c28c-52eb-45c6-aea4-a0d426662a70 tempest-ServersAdminTestJSON-1312894221 tempest-ServersAdminTestJSON-1312894221-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:14.530075 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d897c28c-52eb-45c6-aea4-a0d426662a70 tempest-ServersAdminTestJSON-1312894221 tempest-ServersAdminTestJSON-1312894221-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:14.530935 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d897c28c-52eb-45c6-aea4-a0d426662a70 tempest-ServersAdminTestJSON-1312894221 tempest-ServersAdminTestJSON-1312894221-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:14.534683 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d897c28c-52eb-45c6-aea4-a0d426662a70 tempest-ServersAdminTestJSON-1312894221 tempest-ServersAdminTestJSON-1312894221-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:14.674193 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-d897c28c-52eb-45c6-aea4-a0d426662a70 tempest-ServersAdminTestJSON-1312894221 tempest-ServersAdminTestJSON-1312894221-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=eee3422c48a44a7e8beb6149a31387b2" status: 200 len: 15 microversion: 2.1 time: 0.204158 Oct 04 18:44:14.678134 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1482/3126] 10.222.0.43 () {58 vars in 1257 bytes} [Tue Oct 4 18:44:14 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=eee3422c48a44a7e8beb6149a31387b2 => generated 15 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:44:14.705783 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-f0bf7375-f2ad-44a1-8fbc-af7743e7486e tempest-ServersAdminTestJSON-1312894221 tempest-ServersAdminTestJSON-1312894221-project-admin] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:14.716149 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-f0bf7375-f2ad-44a1-8fbc-af7743e7486e tempest-ServersAdminTestJSON-1312894221 tempest-ServersAdminTestJSON-1312894221-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.015561 Oct 04 18:44:14.717921 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1483/3127] 10.222.0.43 () {58 vars in 1189 bytes} [Tue Oct 4 18:44:14 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 04 18:44:14.740249 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-738213af-821c-4c6a-bc23-d283a16c64d8 tempest-ServersAdminTestJSON-1312894221 tempest-ServersAdminTestJSON-1312894221-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:44:14.742756 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-738213af-821c-4c6a-bc23-d283a16c64d8 tempest-ServersAdminTestJSON-1312894221 tempest-ServersAdminTestJSON-1312894221-project-admin] [instance: cf78a645-458e-4dc2-a60d-a51754ab6258] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:14.751050 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-738213af-821c-4c6a-bc23-d283a16c64d8 tempest-ServersAdminTestJSON-1312894221 tempest-ServersAdminTestJSON-1312894221-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:14.751984 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-738213af-821c-4c6a-bc23-d283a16c64d8 tempest-ServersAdminTestJSON-1312894221 tempest-ServersAdminTestJSON-1312894221-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:14.752696 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-738213af-821c-4c6a-bc23-d283a16c64d8 tempest-ServersAdminTestJSON-1312894221 tempest-ServersAdminTestJSON-1312894221-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:14.753633 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-738213af-821c-4c6a-bc23-d283a16c64d8 tempest-ServersAdminTestJSON-1312894221 tempest-ServersAdminTestJSON-1312894221-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:14.754281 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-738213af-821c-4c6a-bc23-d283a16c64d8 tempest-ServersAdminTestJSON-1312894221 tempest-ServersAdminTestJSON-1312894221-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:14.754934 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-738213af-821c-4c6a-bc23-d283a16c64d8 tempest-ServersAdminTestJSON-1312894221 tempest-ServersAdminTestJSON-1312894221-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:14.945686 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-738213af-821c-4c6a-bc23-d283a16c64d8 tempest-ServersAdminTestJSON-1312894221 tempest-ServersAdminTestJSON-1312894221-project-admin] 10.222.0.43 "POST /compute/v2.1/servers/cf78a645-458e-4dc2-a60d-a51754ab6258/action" status: 202 len: 0 microversion: 2.1 time: 0.210190 Oct 04 18:44:14.950226 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1484/3128] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 18:44:14 2022] POST /compute/v2.1/servers/cf78a645-458e-4dc2-a60d-a51754ab6258/action => generated 0 bytes in 215 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 18:44:14.965413 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-cebc9052-ea18-4b3b-acf1-eb7629816186 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:14.981282 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-cebc9052-ea18-4b3b-acf1-eb7629816186 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '608fc9ed7cdb487c9bf4b783c26ceeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29876d6805924df882d6861b0f6ab4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:14.988966 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-cebc9052-ea18-4b3b-acf1-eb7629816186 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': '29876d6805924df882d6861b0f6ab4f0'} {{(pid=123595) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:44:15.003081 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cebc9052-ea18-4b3b-acf1-eb7629816186 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:15.003930 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cebc9052-ea18-4b3b-acf1-eb7629816186 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:15.004537 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cebc9052-ea18-4b3b-acf1-eb7629816186 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:15.008636 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cebc9052-ea18-4b3b-acf1-eb7629816186 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:15.009549 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cebc9052-ea18-4b3b-acf1-eb7629816186 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:15.010326 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cebc9052-ea18-4b3b-acf1-eb7629816186 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:15.073862 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.multi_cell_list [None req-cebc9052-ea18-4b3b-acf1-eb7629816186 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=123595) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 18:44:15.124051 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-53342d04-2568-4ca7-8dcb-d662cf7b75ff tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:15.132165 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-53342d04-2568-4ca7-8dcb-d662cf7b75ff tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5" status: 200 len: 1680 microversion: 2.1 time: 1.274610 Oct 04 18:44:15.152124 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1645/3129] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:13 2022] GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5 => generated 1680 bytes in 1295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:44:15.164678 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-cebc9052-ea18-4b3b-acf1-eb7629816186 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] 10.222.0.43 "GET /compute/v2.1/servers?status=error" status: 200 len: 338 microversion: 2.1 time: 0.212904 Oct 04 18:44:15.176621 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1485/3130] 10.222.0.43 () {58 vars in 1150 bytes} [Tue Oct 4 18:44:14 2022] GET /compute/v2.1/servers?status=error => generated 338 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:44:15.182835 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-6622f37d-664e-448f-8158-d5f02b4db7c3 tempest-ServersAdminTestJSON-1312894221 tempest-ServersAdminTestJSON-1312894221-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:44:15.193532 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-6622f37d-664e-448f-8158-d5f02b4db7c3 tempest-ServersAdminTestJSON-1312894221 tempest-ServersAdminTestJSON-1312894221-project-admin] [instance: cf78a645-458e-4dc2-a60d-a51754ab6258] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:15.200630 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6622f37d-664e-448f-8158-d5f02b4db7c3 tempest-ServersAdminTestJSON-1312894221 tempest-ServersAdminTestJSON-1312894221-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:15.201169 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6622f37d-664e-448f-8158-d5f02b4db7c3 tempest-ServersAdminTestJSON-1312894221 tempest-ServersAdminTestJSON-1312894221-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:15.201778 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6622f37d-664e-448f-8158-d5f02b4db7c3 tempest-ServersAdminTestJSON-1312894221 tempest-ServersAdminTestJSON-1312894221-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:15.202574 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6622f37d-664e-448f-8158-d5f02b4db7c3 tempest-ServersAdminTestJSON-1312894221 tempest-ServersAdminTestJSON-1312894221-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:15.203044 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6622f37d-664e-448f-8158-d5f02b4db7c3 tempest-ServersAdminTestJSON-1312894221 tempest-ServersAdminTestJSON-1312894221-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:15.203512 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6622f37d-664e-448f-8158-d5f02b4db7c3 tempest-ServersAdminTestJSON-1312894221 tempest-ServersAdminTestJSON-1312894221-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:15.395496 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-6622f37d-664e-448f-8158-d5f02b4db7c3 tempest-ServersAdminTestJSON-1312894221 tempest-ServersAdminTestJSON-1312894221-project-admin] 10.222.0.43 "POST /compute/v2.1/servers/cf78a645-458e-4dc2-a60d-a51754ab6258/action" status: 202 len: 0 microversion: 2.1 time: 0.218042 Oct 04 18:44:15.396893 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1646/3131] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 18:44:15 2022] POST /compute/v2.1/servers/cf78a645-458e-4dc2-a60d-a51754ab6258/action => generated 0 bytes in 220 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:44:15.405797 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-15939c7b-167a-4736-96a9-9028cd86b4f5 tempest-ServersAdminTestJSON-1312894221 tempest-ServersAdminTestJSON-1312894221-project-admin] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:15.406445 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-15939c7b-167a-4736-96a9-9028cd86b4f5 tempest-ServersAdminTestJSON-1312894221 tempest-ServersAdminTestJSON-1312894221-project-admin] [instance: cf78a645-458e-4dc2-a60d-a51754ab6258] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:15.418875 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-15939c7b-167a-4736-96a9-9028cd86b4f5 tempest-ServersAdminTestJSON-1312894221 tempest-ServersAdminTestJSON-1312894221-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:15.419388 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-15939c7b-167a-4736-96a9-9028cd86b4f5 tempest-ServersAdminTestJSON-1312894221 tempest-ServersAdminTestJSON-1312894221-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:15.419836 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-15939c7b-167a-4736-96a9-9028cd86b4f5 tempest-ServersAdminTestJSON-1312894221 tempest-ServersAdminTestJSON-1312894221-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:15.420554 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-15939c7b-167a-4736-96a9-9028cd86b4f5 tempest-ServersAdminTestJSON-1312894221 tempest-ServersAdminTestJSON-1312894221-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:15.425432 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-15939c7b-167a-4736-96a9-9028cd86b4f5 tempest-ServersAdminTestJSON-1312894221 tempest-ServersAdminTestJSON-1312894221-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:15.426023 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-15939c7b-167a-4736-96a9-9028cd86b4f5 tempest-ServersAdminTestJSON-1312894221 tempest-ServersAdminTestJSON-1312894221-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:16.158152 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-b6237886-20fa-4eda-892e-dc40817f23d9 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:16.158803 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-b6237886-20fa-4eda-892e-dc40817f23d9 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 82b86465-afb0-49ef-9932-1538010c1ae5] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:16.182188 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b6237886-20fa-4eda-892e-dc40817f23d9 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:16.182701 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b6237886-20fa-4eda-892e-dc40817f23d9 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:16.183155 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b6237886-20fa-4eda-892e-dc40817f23d9 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:16.183888 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b6237886-20fa-4eda-892e-dc40817f23d9 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:16.184352 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b6237886-20fa-4eda-892e-dc40817f23d9 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:16.184788 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b6237886-20fa-4eda-892e-dc40817f23d9 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:17.067998 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-15939c7b-167a-4736-96a9-9028cd86b4f5 tempest-ServersAdminTestJSON-1312894221 tempest-ServersAdminTestJSON-1312894221-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/cf78a645-458e-4dc2-a60d-a51754ab6258" status: 200 len: 1616 microversion: 2.1 time: 1.666939 Oct 04 18:44:17.083162 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1486/3132] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:15 2022] GET /compute/v2.1/servers/cf78a645-458e-4dc2-a60d-a51754ab6258 => generated 1616 bytes in 1669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:17.097556 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-2f3c2e35-8fa3-4423-971c-4558578d90c2 tempest-ServersAdminTestJSON-1312894221 tempest-ServersAdminTestJSON-1312894221-project-admin] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:17.098308 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-2f3c2e35-8fa3-4423-971c-4558578d90c2 tempest-ServersAdminTestJSON-1312894221 tempest-ServersAdminTestJSON-1312894221-project-admin] [instance: cf78a645-458e-4dc2-a60d-a51754ab6258] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:17.112166 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2f3c2e35-8fa3-4423-971c-4558578d90c2 tempest-ServersAdminTestJSON-1312894221 tempest-ServersAdminTestJSON-1312894221-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:17.112779 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2f3c2e35-8fa3-4423-971c-4558578d90c2 tempest-ServersAdminTestJSON-1312894221 tempest-ServersAdminTestJSON-1312894221-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:17.113359 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2f3c2e35-8fa3-4423-971c-4558578d90c2 tempest-ServersAdminTestJSON-1312894221 tempest-ServersAdminTestJSON-1312894221-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:17.117595 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2f3c2e35-8fa3-4423-971c-4558578d90c2 tempest-ServersAdminTestJSON-1312894221 tempest-ServersAdminTestJSON-1312894221-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:17.124285 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2f3c2e35-8fa3-4423-971c-4558578d90c2 tempest-ServersAdminTestJSON-1312894221 tempest-ServersAdminTestJSON-1312894221-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:17.124459 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2f3c2e35-8fa3-4423-971c-4558578d90c2 tempest-ServersAdminTestJSON-1312894221 tempest-ServersAdminTestJSON-1312894221-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:17.423505 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-b6237886-20fa-4eda-892e-dc40817f23d9 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:17.444547 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-b6237886-20fa-4eda-892e-dc40817f23d9 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5" status: 200 len: 1680 microversion: 2.1 time: 1.288862 Oct 04 18:44:17.447471 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1647/3133] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:16 2022] GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5 => generated 1680 bytes in 1294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:18.367973 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-2f3c2e35-8fa3-4423-971c-4558578d90c2 tempest-ServersAdminTestJSON-1312894221 tempest-ServersAdminTestJSON-1312894221-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/cf78a645-458e-4dc2-a60d-a51754ab6258" status: 200 len: 1616 microversion: 2.1 time: 1.276895 Oct 04 18:44:18.368616 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1487/3134] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:17 2022] GET /compute/v2.1/servers/cf78a645-458e-4dc2-a60d-a51754ab6258 => generated 1616 bytes in 1278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:44:18.396447 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-9192288b-81e8-48e4-9960-211a7d556a03 tempest-ServersAdminTestJSON-1312894221 tempest-ServersAdminTestJSON-1312894221-project-admin] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:18.413214 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-9192288b-81e8-48e4-9960-211a7d556a03 tempest-ServersAdminTestJSON-1312894221 tempest-ServersAdminTestJSON-1312894221-project-admin] Searching by: {'host': 'n-h2-851028-13', 'deleted': False} {{(pid=123596) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:44:18.430352 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9192288b-81e8-48e4-9960-211a7d556a03 tempest-ServersAdminTestJSON-1312894221 tempest-ServersAdminTestJSON-1312894221-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:18.431036 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9192288b-81e8-48e4-9960-211a7d556a03 tempest-ServersAdminTestJSON-1312894221 tempest-ServersAdminTestJSON-1312894221-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:18.445740 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9192288b-81e8-48e4-9960-211a7d556a03 tempest-ServersAdminTestJSON-1312894221 tempest-ServersAdminTestJSON-1312894221-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:18.447320 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9192288b-81e8-48e4-9960-211a7d556a03 tempest-ServersAdminTestJSON-1312894221 tempest-ServersAdminTestJSON-1312894221-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:18.452191 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9192288b-81e8-48e4-9960-211a7d556a03 tempest-ServersAdminTestJSON-1312894221 tempest-ServersAdminTestJSON-1312894221-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:18.452735 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9192288b-81e8-48e4-9960-211a7d556a03 tempest-ServersAdminTestJSON-1312894221 tempest-ServersAdminTestJSON-1312894221-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:18.470961 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-27462923-5450-4f41-af47-5266b7b324c8 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:18.472204 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-27462923-5450-4f41-af47-5266b7b324c8 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 82b86465-afb0-49ef-9932-1538010c1ae5] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:18.488057 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-27462923-5450-4f41-af47-5266b7b324c8 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:18.488867 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-27462923-5450-4f41-af47-5266b7b324c8 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:18.489584 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-27462923-5450-4f41-af47-5266b7b324c8 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:18.490556 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-27462923-5450-4f41-af47-5266b7b324c8 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:18.491249 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-27462923-5450-4f41-af47-5266b7b324c8 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:18.492057 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-27462923-5450-4f41-af47-5266b7b324c8 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:18.719752 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.multi_cell_list [None req-9192288b-81e8-48e4-9960-211a7d556a03 tempest-ServersAdminTestJSON-1312894221 tempest-ServersAdminTestJSON-1312894221-project-admin] Listed batch of 7 results from cell out of 1000 limit. Returned 7 total so far. {{(pid=123596) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 18:44:18.890913 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-9192288b-81e8-48e4-9960-211a7d556a03 tempest-ServersAdminTestJSON-1312894221 tempest-ServersAdminTestJSON-1312894221-project-admin] 10.222.0.43 "GET /compute/v2.1/servers?host=n-h2-851028-13&all_tenants=1" status: 200 len: 2292 microversion: 2.1 time: 0.494271 Oct 04 18:44:18.901531 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1648/3135] 10.222.0.43 () {58 vars in 1192 bytes} [Tue Oct 4 18:44:18 2022] GET /compute/v2.1/servers?host=n-h2-851028-13&all_tenants=1 => generated 2292 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:18.913636 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-17dc8673-8f44-4b3c-a9c6-2d60540da5b3 tempest-ServersAdminTestJSON-1312894221 tempest-ServersAdminTestJSON-1312894221-project-admin] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:18.926834 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-17dc8673-8f44-4b3c-a9c6-2d60540da5b3 tempest-ServersAdminTestJSON-1312894221 tempest-ServersAdminTestJSON-1312894221-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=123596) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:44:18.938675 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-17dc8673-8f44-4b3c-a9c6-2d60540da5b3 tempest-ServersAdminTestJSON-1312894221 tempest-ServersAdminTestJSON-1312894221-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:18.943879 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-17dc8673-8f44-4b3c-a9c6-2d60540da5b3 tempest-ServersAdminTestJSON-1312894221 tempest-ServersAdminTestJSON-1312894221-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:18.944638 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-17dc8673-8f44-4b3c-a9c6-2d60540da5b3 tempest-ServersAdminTestJSON-1312894221 tempest-ServersAdminTestJSON-1312894221-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:18.945660 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-17dc8673-8f44-4b3c-a9c6-2d60540da5b3 tempest-ServersAdminTestJSON-1312894221 tempest-ServersAdminTestJSON-1312894221-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:18.948082 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-17dc8673-8f44-4b3c-a9c6-2d60540da5b3 tempest-ServersAdminTestJSON-1312894221 tempest-ServersAdminTestJSON-1312894221-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:18.952161 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-17dc8673-8f44-4b3c-a9c6-2d60540da5b3 tempest-ServersAdminTestJSON-1312894221 tempest-ServersAdminTestJSON-1312894221-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:18.994503 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-17dc8673-8f44-4b3c-a9c6-2d60540da5b3 tempest-ServersAdminTestJSON-1312894221 tempest-ServersAdminTestJSON-1312894221-project-admin] 10.222.0.43 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.089651 Oct 04 18:44:18.995193 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1649/3136] 10.222.0.43 () {58 vars in 1196 bytes} [Tue Oct 4 18:44:18 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:44:19.010996 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-d4893305-3633-42ba-8cdc-70d2a76b6dd0 tempest-ServersAdminTestJSON-1312894221 tempest-ServersAdminTestJSON-1312894221-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:44:19.013439 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-d4893305-3633-42ba-8cdc-70d2a76b6dd0 tempest-ServersAdminTestJSON-1312894221 tempest-ServersAdminTestJSON-1312894221-project-admin] [instance: cf78a645-458e-4dc2-a60d-a51754ab6258] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:19.031097 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d4893305-3633-42ba-8cdc-70d2a76b6dd0 tempest-ServersAdminTestJSON-1312894221 tempest-ServersAdminTestJSON-1312894221-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:19.036375 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d4893305-3633-42ba-8cdc-70d2a76b6dd0 tempest-ServersAdminTestJSON-1312894221 tempest-ServersAdminTestJSON-1312894221-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:19.038313 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d4893305-3633-42ba-8cdc-70d2a76b6dd0 tempest-ServersAdminTestJSON-1312894221 tempest-ServersAdminTestJSON-1312894221-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:19.042834 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d4893305-3633-42ba-8cdc-70d2a76b6dd0 tempest-ServersAdminTestJSON-1312894221 tempest-ServersAdminTestJSON-1312894221-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:19.045737 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d4893305-3633-42ba-8cdc-70d2a76b6dd0 tempest-ServersAdminTestJSON-1312894221 tempest-ServersAdminTestJSON-1312894221-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:19.048862 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d4893305-3633-42ba-8cdc-70d2a76b6dd0 tempest-ServersAdminTestJSON-1312894221 tempest-ServersAdminTestJSON-1312894221-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:19.122884 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:44:19.271754 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-d4893305-3633-42ba-8cdc-70d2a76b6dd0 tempest-ServersAdminTestJSON-1312894221 tempest-ServersAdminTestJSON-1312894221-project-admin] 10.222.0.43 "POST /compute/v2.1/servers/cf78a645-458e-4dc2-a60d-a51754ab6258/action" status: 202 len: 0 microversion: 2.1 time: 0.263871 Oct 04 18:44:19.274694 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1650/3137] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 18:44:19 2022] POST /compute/v2.1/servers/cf78a645-458e-4dc2-a60d-a51754ab6258/action => generated 0 bytes in 268 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 18:44:19.300303 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-42f8210f-1009-4535-a316-bea9b02bacb8 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243"}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:44:19.308451 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-42f8210f-1009-4535-a316-bea9b02bacb8 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] [instance: cf78a645-458e-4dc2-a60d-a51754ab6258] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:19.321839 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-42f8210f-1009-4535-a316-bea9b02bacb8 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:19.325816 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-42f8210f-1009-4535-a316-bea9b02bacb8 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:19.326463 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-42f8210f-1009-4535-a316-bea9b02bacb8 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:19.327333 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-42f8210f-1009-4535-a316-bea9b02bacb8 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:19.329918 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-42f8210f-1009-4535-a316-bea9b02bacb8 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:19.330940 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-42f8210f-1009-4535-a316-bea9b02bacb8 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:19.498647 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-42f8210f-1009-4535-a316-bea9b02bacb8 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Flavor limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:44:19.499787 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-42f8210f-1009-4535-a316-bea9b02bacb8 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Image limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:44:19.502233 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-42f8210f-1009-4535-a316-bea9b02bacb8 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Flavor pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:44:19.502865 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-42f8210f-1009-4535-a316-bea9b02bacb8 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Image pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:44:19.503450 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-42f8210f-1009-4535-a316-bea9b02bacb8 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:44:19.638419 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-42f8210f-1009-4535-a316-bea9b02bacb8 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] [instance: cf78a645-458e-4dc2-a60d-a51754ab6258] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:19.652332 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-42f8210f-1009-4535-a316-bea9b02bacb8 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:19.654214 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-42f8210f-1009-4535-a316-bea9b02bacb8 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:19.654926 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-42f8210f-1009-4535-a316-bea9b02bacb8 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:19.658126 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-42f8210f-1009-4535-a316-bea9b02bacb8 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:19.659289 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-42f8210f-1009-4535-a316-bea9b02bacb8 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:19.659845 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-42f8210f-1009-4535-a316-bea9b02bacb8 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:19.732728 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-42f8210f-1009-4535-a316-bea9b02bacb8 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] 10.222.0.43 "POST /compute/v2.1/servers/cf78a645-458e-4dc2-a60d-a51754ab6258/action" status: 202 len: 1067 microversion: 2.1 time: 0.450413 Oct 04 18:44:19.747018 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1651/3138] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 18:44:19 2022] POST /compute/v2.1/servers/cf78a645-458e-4dc2-a60d-a51754ab6258/action => generated 1067 bytes in 454 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 04 18:44:19.753644 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f59af2a5-b856-4507-bb0a-e3e32619f6c0 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:19.753791 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-f59af2a5-b856-4507-bb0a-e3e32619f6c0 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] [instance: cf78a645-458e-4dc2-a60d-a51754ab6258] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:19.762213 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=3,nova_api:INSERT=1 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:44:19.769505 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f59af2a5-b856-4507-bb0a-e3e32619f6c0 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:19.770054 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f59af2a5-b856-4507-bb0a-e3e32619f6c0 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:19.771482 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f59af2a5-b856-4507-bb0a-e3e32619f6c0 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:19.772234 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f59af2a5-b856-4507-bb0a-e3e32619f6c0 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:19.772712 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f59af2a5-b856-4507-bb0a-e3e32619f6c0 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:19.773173 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f59af2a5-b856-4507-bb0a-e3e32619f6c0 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:19.971853 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-27462923-5450-4f41-af47-5266b7b324c8 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:19.984110 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-27462923-5450-4f41-af47-5266b7b324c8 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5" status: 200 len: 1680 microversion: 2.1 time: 1.517093 Oct 04 18:44:19.988849 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1488/3139] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:18 2022] GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5 => generated 1680 bytes in 1523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:20.434618 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-f59af2a5-b856-4507-bb0a-e3e32619f6c0 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608fc9ed7cdb487c9bf4b783c26ceeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29876d6805924df882d6861b0f6ab4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:20.447753 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-f59af2a5-b856-4507-bb0a-e3e32619f6c0 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] 10.222.0.43 "GET /compute/v2.1/servers/cf78a645-458e-4dc2-a60d-a51754ab6258" status: 200 len: 1471 microversion: 2.1 time: 0.698743 Oct 04 18:44:20.449391 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1652/3140] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:19 2022] GET /compute/v2.1/servers/cf78a645-458e-4dc2-a60d-a51754ab6258 => generated 1471 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:44:20.813586 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-ba54cd18-f836-4ba9-82fd-3e0fa906eaac tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2105911815", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b4aa97d5-c2a2-43c0-80f6-feae0c060a28"}], "security_groups": [{"name": "tempest-securitygroup--223111208"}], "key_name": "tempest-keypair-235700876", "user_data": "}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:44:21.015620 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-ca719dd8-3dd1-4c49-b4ca-75a45db021c2 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:21.018097 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-ca719dd8-3dd1-4c49-b4ca-75a45db021c2 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 82b86465-afb0-49ef-9932-1538010c1ae5] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:21.029946 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ca719dd8-3dd1-4c49-b4ca-75a45db021c2 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:21.030712 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ca719dd8-3dd1-4c49-b4ca-75a45db021c2 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:21.031363 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ca719dd8-3dd1-4c49-b4ca-75a45db021c2 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:21.033189 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ca719dd8-3dd1-4c49-b4ca-75a45db021c2 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:21.036774 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ca719dd8-3dd1-4c49-b4ca-75a45db021c2 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:21.038261 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ca719dd8-3dd1-4c49-b4ca-75a45db021c2 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:21.127017 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.network.neutron [None req-ba54cd18-f836-4ba9-82fd-3e0fa906eaac tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] validate_networks() for [('b4aa97d5-c2a2-43c0-80f6-feae0c060a28', None, None, None, None, None)] {{(pid=123595) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:44:21.136954 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=4 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:44:21.477727 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-ca719dd8-3dd1-4c49-b4ca-75a45db021c2 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:21.501402 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-ca719dd8-3dd1-4c49-b4ca-75a45db021c2 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5" status: 200 len: 1680 microversion: 2.1 time: 0.487307 Oct 04 18:44:21.502763 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1653/3141] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:21 2022] GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5 => generated 1680 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:44:21.510333 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-a795a796-5fd1-4497-b199-aecd84250c06 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:21.511214 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-a795a796-5fd1-4497-b199-aecd84250c06 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] [instance: cf78a645-458e-4dc2-a60d-a51754ab6258] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:21.520996 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a795a796-5fd1-4497-b199-aecd84250c06 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:21.521848 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a795a796-5fd1-4497-b199-aecd84250c06 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:21.522517 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a795a796-5fd1-4497-b199-aecd84250c06 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:21.523580 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a795a796-5fd1-4497-b199-aecd84250c06 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:21.525018 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a795a796-5fd1-4497-b199-aecd84250c06 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:21.525780 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a795a796-5fd1-4497-b199-aecd84250c06 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:22.186745 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-ba54cd18-f836-4ba9-82fd-3e0fa906eaac tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Flavor limits 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:44:22.188763 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-ba54cd18-f836-4ba9-82fd-3e0fa906eaac tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Image limits 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:44:22.189462 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-ba54cd18-f836-4ba9-82fd-3e0fa906eaac tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Flavor pref 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:44:22.192172 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-ba54cd18-f836-4ba9-82fd-3e0fa906eaac tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Image pref 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:44:22.192950 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-ba54cd18-f836-4ba9-82fd-3e0fa906eaac tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:44:22.206602 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ba54cd18-f836-4ba9-82fd-3e0fa906eaac tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:22.207404 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ba54cd18-f836-4ba9-82fd-3e0fa906eaac tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:22.208651 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ba54cd18-f836-4ba9-82fd-3e0fa906eaac tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:22.209661 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ba54cd18-f836-4ba9-82fd-3e0fa906eaac tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:22.210344 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ba54cd18-f836-4ba9-82fd-3e0fa906eaac tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:22.211058 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ba54cd18-f836-4ba9-82fd-3e0fa906eaac tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:22.259263 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-ba54cd18-f836-4ba9-82fd-3e0fa906eaac tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Getting quotas for project eda6bd34bf5540ee95c8144f185eb22d. Resources: {'ram', 'cores', 'instances'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:44:22.267658 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-ba54cd18-f836-4ba9-82fd-3e0fa906eaac tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Getting quotas for user 96e7480de94c43909045ac1087e40cd8 and project eda6bd34bf5540ee95c8144f185eb22d. Resources: {'ram', 'cores', 'instances'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:44:22.312491 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-ba54cd18-f836-4ba9-82fd-3e0fa906eaac tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Going to run 1 instances... {{(pid=123595) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:44:22.320160 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-ba54cd18-f836-4ba9-82fd-3e0fa906eaac tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] [instance: 15541ec9-3112-4adc-9fad-6d20a88f2c09] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e8943ec5-4038-4d4b-b9b9-2415a79f5243',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:44:22.331510 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-a795a796-5fd1-4497-b199-aecd84250c06 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608fc9ed7cdb487c9bf4b783c26ceeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29876d6805924df882d6861b0f6ab4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:22.344003 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-a795a796-5fd1-4497-b199-aecd84250c06 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] 10.222.0.43 "GET /compute/v2.1/servers/cf78a645-458e-4dc2-a60d-a51754ab6258" status: 200 len: 1471 microversion: 2.1 time: 0.837001 Oct 04 18:44:22.346515 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1654/3142] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:21 2022] GET /compute/v2.1/servers/cf78a645-458e-4dc2-a60d-a51754ab6258 => generated 1471 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:22.517517 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-ba54cd18-f836-4ba9-82fd-3e0fa906eaac tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.703179 Oct 04 18:44:22.520611 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1489/3143] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 18:44:20 2022] POST /compute/v2.1/servers => generated 408 bytes in 1712 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:44:22.532222 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-48126475-1479-4f7c-9908-7ace3d3c098b tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:22.533478 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-48126475-1479-4f7c-9908-7ace3d3c098b tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 82b86465-afb0-49ef-9932-1538010c1ae5] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:22.553954 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-76f05729-241e-482f-aa26-50e9fcd92656 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:22.554614 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-76f05729-241e-482f-aa26-50e9fcd92656 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] [instance: 15541ec9-3112-4adc-9fad-6d20a88f2c09] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:22.576101 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-48126475-1479-4f7c-9908-7ace3d3c098b tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:22.581503 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-48126475-1479-4f7c-9908-7ace3d3c098b tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:22.582403 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-48126475-1479-4f7c-9908-7ace3d3c098b tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:22.585659 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-48126475-1479-4f7c-9908-7ace3d3c098b tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:22.587794 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-48126475-1479-4f7c-9908-7ace3d3c098b tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:22.590809 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-48126475-1479-4f7c-9908-7ace3d3c098b tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:23.363621 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-48126475-1479-4f7c-9908-7ace3d3c098b tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:23.376411 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-76f05729-241e-482f-aa26-50e9fcd92656 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96e7480de94c43909045ac1087e40cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6bd34bf5540ee95c8144f185eb22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:23.377411 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-48126475-1479-4f7c-9908-7ace3d3c098b tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5" status: 200 len: 1680 microversion: 2.1 time: 0.849160 Oct 04 18:44:23.392820 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1655/3144] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:22 2022] GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5 => generated 1680 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:23.392820 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-ce56856a-6bf9-4bc3-a5af-c78e460d9bc5 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:23.392820 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-ce56856a-6bf9-4bc3-a5af-c78e460d9bc5 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] [instance: cf78a645-458e-4dc2-a60d-a51754ab6258] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:23.410717 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ce56856a-6bf9-4bc3-a5af-c78e460d9bc5 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:23.411225 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ce56856a-6bf9-4bc3-a5af-c78e460d9bc5 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:23.411814 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ce56856a-6bf9-4bc3-a5af-c78e460d9bc5 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:23.417777 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ce56856a-6bf9-4bc3-a5af-c78e460d9bc5 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:23.418277 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ce56856a-6bf9-4bc3-a5af-c78e460d9bc5 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:23.418730 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ce56856a-6bf9-4bc3-a5af-c78e460d9bc5 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:23.419405 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-76f05729-241e-482f-aa26-50e9fcd92656 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] 10.222.0.43 "GET /compute/v2.1/servers/15541ec9-3112-4adc-9fad-6d20a88f2c09" status: 200 len: 1245 microversion: 2.1 time: 0.889442 Oct 04 18:44:23.423484 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1490/3145] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:22 2022] GET /compute/v2.1/servers/15541ec9-3112-4adc-9fad-6d20a88f2c09 => generated 1245 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:23.998915 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-ce56856a-6bf9-4bc3-a5af-c78e460d9bc5 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608fc9ed7cdb487c9bf4b783c26ceeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29876d6805924df882d6861b0f6ab4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:24.012131 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-ce56856a-6bf9-4bc3-a5af-c78e460d9bc5 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] 10.222.0.43 "GET /compute/v2.1/servers/cf78a645-458e-4dc2-a60d-a51754ab6258" status: 200 len: 1471 microversion: 2.1 time: 0.630463 Oct 04 18:44:24.018730 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1656/3146] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:23 2022] GET /compute/v2.1/servers/cf78a645-458e-4dc2-a60d-a51754ab6258 => generated 1471 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:24.407180 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-a7f4e2bc-43ce-452d-8450-a1d9bae0b7c8 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:24.409458 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-a7f4e2bc-43ce-452d-8450-a1d9bae0b7c8 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 82b86465-afb0-49ef-9932-1538010c1ae5] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:24.422003 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a7f4e2bc-43ce-452d-8450-a1d9bae0b7c8 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:24.438079 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a7f4e2bc-43ce-452d-8450-a1d9bae0b7c8 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:24.438749 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a7f4e2bc-43ce-452d-8450-a1d9bae0b7c8 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:24.439813 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a7f4e2bc-43ce-452d-8450-a1d9bae0b7c8 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:24.440427 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a7f4e2bc-43ce-452d-8450-a1d9bae0b7c8 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:24.443508 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a7f4e2bc-43ce-452d-8450-a1d9bae0b7c8 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:24.447603 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-7824d9b9-7826-4b59-aece-b76a99ac0ac6 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:24.449022 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-7824d9b9-7826-4b59-aece-b76a99ac0ac6 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] [instance: 15541ec9-3112-4adc-9fad-6d20a88f2c09] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:24.463751 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7824d9b9-7826-4b59-aece-b76a99ac0ac6 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:24.464527 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7824d9b9-7826-4b59-aece-b76a99ac0ac6 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:24.465167 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7824d9b9-7826-4b59-aece-b76a99ac0ac6 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:24.466085 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7824d9b9-7826-4b59-aece-b76a99ac0ac6 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:24.466704 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7824d9b9-7826-4b59-aece-b76a99ac0ac6 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:24.467299 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7824d9b9-7826-4b59-aece-b76a99ac0ac6 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:24.886720 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-7824d9b9-7826-4b59-aece-b76a99ac0ac6 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96e7480de94c43909045ac1087e40cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6bd34bf5540ee95c8144f185eb22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:24.895761 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-7824d9b9-7826-4b59-aece-b76a99ac0ac6 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] 10.222.0.43 "GET /compute/v2.1/servers/15541ec9-3112-4adc-9fad-6d20a88f2c09" status: 200 len: 1297 microversion: 2.1 time: 0.452332 Oct 04 18:44:24.909752 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1657/3147] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:24 2022] GET /compute/v2.1/servers/15541ec9-3112-4adc-9fad-6d20a88f2c09 => generated 1297 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:25.040453 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-df03d0b4-89f5-43ac-bdb2-3adffd5eb5d9 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:25.041072 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-df03d0b4-89f5-43ac-bdb2-3adffd5eb5d9 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] [instance: cf78a645-458e-4dc2-a60d-a51754ab6258] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:25.071519 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-df03d0b4-89f5-43ac-bdb2-3adffd5eb5d9 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:25.072392 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-df03d0b4-89f5-43ac-bdb2-3adffd5eb5d9 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:25.073942 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-df03d0b4-89f5-43ac-bdb2-3adffd5eb5d9 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:25.094452 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-df03d0b4-89f5-43ac-bdb2-3adffd5eb5d9 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:25.096201 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-df03d0b4-89f5-43ac-bdb2-3adffd5eb5d9 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:25.104981 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-df03d0b4-89f5-43ac-bdb2-3adffd5eb5d9 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:25.783014 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-a7f4e2bc-43ce-452d-8450-a1d9bae0b7c8 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:25.796833 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-a7f4e2bc-43ce-452d-8450-a1d9bae0b7c8 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5" status: 200 len: 1680 microversion: 2.1 time: 1.392758 Oct 04 18:44:25.797461 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1491/3148] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:24 2022] GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5 => generated 1680 bytes in 1395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:25.922897 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-ff9a31fe-4c23-4bb6-bb6d-75fa38e133d0 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:25.923418 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-ff9a31fe-4c23-4bb6-bb6d-75fa38e133d0 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] [instance: 15541ec9-3112-4adc-9fad-6d20a88f2c09] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:25.941516 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ff9a31fe-4c23-4bb6-bb6d-75fa38e133d0 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:25.942400 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ff9a31fe-4c23-4bb6-bb6d-75fa38e133d0 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:25.943992 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ff9a31fe-4c23-4bb6-bb6d-75fa38e133d0 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:25.949252 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ff9a31fe-4c23-4bb6-bb6d-75fa38e133d0 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:25.949912 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ff9a31fe-4c23-4bb6-bb6d-75fa38e133d0 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:25.950531 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ff9a31fe-4c23-4bb6-bb6d-75fa38e133d0 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:26.004094 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:44:26.428310 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-ff9a31fe-4c23-4bb6-bb6d-75fa38e133d0 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96e7480de94c43909045ac1087e40cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6bd34bf5540ee95c8144f185eb22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:26.437086 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-ff9a31fe-4c23-4bb6-bb6d-75fa38e133d0 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] 10.222.0.43 "GET /compute/v2.1/servers/15541ec9-3112-4adc-9fad-6d20a88f2c09" status: 200 len: 1303 microversion: 2.1 time: 0.518021 Oct 04 18:44:26.444785 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1492/3149] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:25 2022] GET /compute/v2.1/servers/15541ec9-3112-4adc-9fad-6d20a88f2c09 => generated 1303 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:44:26.534726 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-df03d0b4-89f5-43ac-bdb2-3adffd5eb5d9 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608fc9ed7cdb487c9bf4b783c26ceeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29876d6805924df882d6861b0f6ab4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:26.548330 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-df03d0b4-89f5-43ac-bdb2-3adffd5eb5d9 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] 10.222.0.43 "GET /compute/v2.1/servers/cf78a645-458e-4dc2-a60d-a51754ab6258" status: 200 len: 1471 microversion: 2.1 time: 1.509493 Oct 04 18:44:26.549582 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1658/3150] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:25 2022] GET /compute/v2.1/servers/cf78a645-458e-4dc2-a60d-a51754ab6258 => generated 1471 bytes in 1514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:26.820547 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-c167ba5f-aa58-446b-83e7-5e18cff76dd8 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:26.824207 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-c167ba5f-aa58-446b-83e7-5e18cff76dd8 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 82b86465-afb0-49ef-9932-1538010c1ae5] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:26.833374 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c167ba5f-aa58-446b-83e7-5e18cff76dd8 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:26.833876 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c167ba5f-aa58-446b-83e7-5e18cff76dd8 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:26.834315 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c167ba5f-aa58-446b-83e7-5e18cff76dd8 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:26.835028 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c167ba5f-aa58-446b-83e7-5e18cff76dd8 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:26.835481 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c167ba5f-aa58-446b-83e7-5e18cff76dd8 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:26.835907 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c167ba5f-aa58-446b-83e7-5e18cff76dd8 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:27.466403 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-fc72846f-6429-46dc-8b05-b8fbe5655e05 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:27.466912 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-fc72846f-6429-46dc-8b05-b8fbe5655e05 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] [instance: 15541ec9-3112-4adc-9fad-6d20a88f2c09] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:27.481686 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fc72846f-6429-46dc-8b05-b8fbe5655e05 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:27.482498 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fc72846f-6429-46dc-8b05-b8fbe5655e05 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:27.483632 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fc72846f-6429-46dc-8b05-b8fbe5655e05 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:27.484719 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fc72846f-6429-46dc-8b05-b8fbe5655e05 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:27.485373 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fc72846f-6429-46dc-8b05-b8fbe5655e05 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:27.485976 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fc72846f-6429-46dc-8b05-b8fbe5655e05 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:27.823885 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-fc72846f-6429-46dc-8b05-b8fbe5655e05 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96e7480de94c43909045ac1087e40cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6bd34bf5540ee95c8144f185eb22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:27.839813 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-fc72846f-6429-46dc-8b05-b8fbe5655e05 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] 10.222.0.43 "GET /compute/v2.1/servers/15541ec9-3112-4adc-9fad-6d20a88f2c09" status: 200 len: 1370 microversion: 2.1 time: 0.377428 Oct 04 18:44:27.840759 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1659/3151] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:27 2022] GET /compute/v2.1/servers/15541ec9-3112-4adc-9fad-6d20a88f2c09 => generated 1370 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:27.850324 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-77d11877-d7e8-4181-b8f2-bdec5017c7b9 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:27.850946 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-77d11877-d7e8-4181-b8f2-bdec5017c7b9 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] [instance: cf78a645-458e-4dc2-a60d-a51754ab6258] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:27.876423 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-77d11877-d7e8-4181-b8f2-bdec5017c7b9 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:27.879722 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-c167ba5f-aa58-446b-83e7-5e18cff76dd8 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:27.887284 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-77d11877-d7e8-4181-b8f2-bdec5017c7b9 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:27.888539 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-77d11877-d7e8-4181-b8f2-bdec5017c7b9 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:27.890121 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-77d11877-d7e8-4181-b8f2-bdec5017c7b9 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:27.893703 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-77d11877-d7e8-4181-b8f2-bdec5017c7b9 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:27.894354 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-77d11877-d7e8-4181-b8f2-bdec5017c7b9 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:27.908561 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-c167ba5f-aa58-446b-83e7-5e18cff76dd8 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5" status: 200 len: 1680 microversion: 2.1 time: 1.092413 Oct 04 18:44:27.913008 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1493/3152] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:26 2022] GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5 => generated 1680 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:28.475944 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-77d11877-d7e8-4181-b8f2-bdec5017c7b9 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608fc9ed7cdb487c9bf4b783c26ceeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29876d6805924df882d6861b0f6ab4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:28.489940 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-77d11877-d7e8-4181-b8f2-bdec5017c7b9 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] 10.222.0.43 "GET /compute/v2.1/servers/cf78a645-458e-4dc2-a60d-a51754ab6258" status: 200 len: 1471 microversion: 2.1 time: 0.643226 Oct 04 18:44:28.490921 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1660/3153] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:27 2022] GET /compute/v2.1/servers/cf78a645-458e-4dc2-a60d-a51754ab6258 => generated 1471 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:28.867818 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-cb68f384-00f0-494a-a322-9c82171c8774 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:28.868913 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-cb68f384-00f0-494a-a322-9c82171c8774 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] [instance: 15541ec9-3112-4adc-9fad-6d20a88f2c09] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:28.885670 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cb68f384-00f0-494a-a322-9c82171c8774 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:28.886459 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cb68f384-00f0-494a-a322-9c82171c8774 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:28.889964 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cb68f384-00f0-494a-a322-9c82171c8774 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:28.890854 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cb68f384-00f0-494a-a322-9c82171c8774 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:28.891360 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cb68f384-00f0-494a-a322-9c82171c8774 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:28.894403 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cb68f384-00f0-494a-a322-9c82171c8774 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:28.943301 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-5af11b78-be1e-4bf0-b559-63bab9506afc tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:28.946754 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-5af11b78-be1e-4bf0-b559-63bab9506afc tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 82b86465-afb0-49ef-9932-1538010c1ae5] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:28.967886 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=8 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:44:28.970781 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5af11b78-be1e-4bf0-b559-63bab9506afc tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:28.971762 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5af11b78-be1e-4bf0-b559-63bab9506afc tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:28.974895 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5af11b78-be1e-4bf0-b559-63bab9506afc tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:28.975897 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5af11b78-be1e-4bf0-b559-63bab9506afc tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:28.987604 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5af11b78-be1e-4bf0-b559-63bab9506afc tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:28.988882 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5af11b78-be1e-4bf0-b559-63bab9506afc tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:29.382349 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-cb68f384-00f0-494a-a322-9c82171c8774 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96e7480de94c43909045ac1087e40cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6bd34bf5540ee95c8144f185eb22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:29.392727 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-cb68f384-00f0-494a-a322-9c82171c8774 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] 10.222.0.43 "GET /compute/v2.1/servers/15541ec9-3112-4adc-9fad-6d20a88f2c09" status: 200 len: 1370 microversion: 2.1 time: 0.529720 Oct 04 18:44:29.395927 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1494/3154] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:28 2022] GET /compute/v2.1/servers/15541ec9-3112-4adc-9fad-6d20a88f2c09 => generated 1370 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:29.602325 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-051a1af3-c7c9-489f-83fe-72a619dd0843 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-179445634", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452", "networks": [{"uuid": "3ad3e58b-246e-4a9b-9a40-0c1782e343b8"}]}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:44:29.706549 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.network.neutron [None req-051a1af3-c7c9-489f-83fe-72a619dd0843 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] validate_networks() for [('3ad3e58b-246e-4a9b-9a40-0c1782e343b8', None, None, None, None, None)] {{(pid=123595) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:44:29.720724 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-5af11b78-be1e-4bf0-b559-63bab9506afc tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:29.743811 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-5af11b78-be1e-4bf0-b559-63bab9506afc tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5" status: 200 len: 1667 microversion: 2.1 time: 0.811543 Oct 04 18:44:29.767271 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1661/3155] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:28 2022] GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5 => generated 1667 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:29.781361 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-57f5a653-4af9-4ccf-b04d-9096affda9a7 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:29.782235 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-57f5a653-4af9-4ccf-b04d-9096affda9a7 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] [instance: cf78a645-458e-4dc2-a60d-a51754ab6258] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:29.790957 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-57f5a653-4af9-4ccf-b04d-9096affda9a7 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:29.791747 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-57f5a653-4af9-4ccf-b04d-9096affda9a7 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:29.792406 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-57f5a653-4af9-4ccf-b04d-9096affda9a7 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:29.793345 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-57f5a653-4af9-4ccf-b04d-9096affda9a7 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:29.794099 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-57f5a653-4af9-4ccf-b04d-9096affda9a7 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:29.795253 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-57f5a653-4af9-4ccf-b04d-9096affda9a7 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:30.342910 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-57f5a653-4af9-4ccf-b04d-9096affda9a7 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608fc9ed7cdb487c9bf4b783c26ceeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29876d6805924df882d6861b0f6ab4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:30.357033 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-57f5a653-4af9-4ccf-b04d-9096affda9a7 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] 10.222.0.43 "GET /compute/v2.1/servers/cf78a645-458e-4dc2-a60d-a51754ab6258" status: 200 len: 1471 microversion: 2.1 time: 0.585232 Oct 04 18:44:30.360464 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1662/3156] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:29 2022] GET /compute/v2.1/servers/cf78a645-458e-4dc2-a60d-a51754ab6258 => generated 1471 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:30.419016 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-76a01bdd-79a5-4974-946d-4046a181fde3 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:30.420015 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-76a01bdd-79a5-4974-946d-4046a181fde3 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] [instance: 15541ec9-3112-4adc-9fad-6d20a88f2c09] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:30.431314 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-76a01bdd-79a5-4974-946d-4046a181fde3 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:30.434563 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-76a01bdd-79a5-4974-946d-4046a181fde3 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:30.435320 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-76a01bdd-79a5-4974-946d-4046a181fde3 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:30.437973 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-76a01bdd-79a5-4974-946d-4046a181fde3 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:30.438710 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-76a01bdd-79a5-4974-946d-4046a181fde3 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:30.439405 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-76a01bdd-79a5-4974-946d-4046a181fde3 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:30.948635 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-76a01bdd-79a5-4974-946d-4046a181fde3 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96e7480de94c43909045ac1087e40cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6bd34bf5540ee95c8144f185eb22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:30.952058 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=95,nova_cell1:UPDATE=3 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:44:30.961969 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-76a01bdd-79a5-4974-946d-4046a181fde3 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] 10.222.0.43 "GET /compute/v2.1/servers/15541ec9-3112-4adc-9fad-6d20a88f2c09" status: 200 len: 1370 microversion: 2.1 time: 0.547423 Oct 04 18:44:30.962746 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1663/3157] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:30 2022] GET /compute/v2.1/servers/15541ec9-3112-4adc-9fad-6d20a88f2c09 => generated 1370 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:44:30.980789 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-2f6be332-214c-4bba-9af9-98a4cdbbe655 req-beb2e81a-b66f-4665-9ffa-46599bbae6bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15541ec9-3112-4adc-9fad-6d20a88f2c09", "tag": "ae7d73fe-313a-45b9-8e8c-91a97a4dd13a"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:44:31.017187 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-2f6be332-214c-4bba-9af9-98a4cdbbe655 req-beb2e81a-b66f-4665-9ffa-46599bbae6bf service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:31.018504 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-2f6be332-214c-4bba-9af9-98a4cdbbe655 req-beb2e81a-b66f-4665-9ffa-46599bbae6bf service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:31.019027 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-2f6be332-214c-4bba-9af9-98a4cdbbe655 req-beb2e81a-b66f-4665-9ffa-46599bbae6bf service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:31.063914 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-2f6be332-214c-4bba-9af9-98a4cdbbe655 req-beb2e81a-b66f-4665-9ffa-46599bbae6bf service nova] Creating event network-changed:ae7d73fe-313a-45b9-8e8c-91a97a4dd13a for instance 15541ec9-3112-4adc-9fad-6d20a88f2c09 on n-h1-851028-13 Oct 04 18:44:31.072585 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-2f6be332-214c-4bba-9af9-98a4cdbbe655 req-beb2e81a-b66f-4665-9ffa-46599bbae6bf service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106962 Oct 04 18:44:31.081485 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1664/3158] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:44:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:44:31.087025 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-1b1b7085-0607-49fa-b482-d9776c002a34 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:31.087719 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-1b1b7085-0607-49fa-b482-d9776c002a34 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 82b86465-afb0-49ef-9932-1538010c1ae5] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:31.099651 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1b1b7085-0607-49fa-b482-d9776c002a34 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:31.100383 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1b1b7085-0607-49fa-b482-d9776c002a34 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:31.101055 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1b1b7085-0607-49fa-b482-d9776c002a34 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:31.102570 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1b1b7085-0607-49fa-b482-d9776c002a34 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:31.103219 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1b1b7085-0607-49fa-b482-d9776c002a34 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:31.103839 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1b1b7085-0607-49fa-b482-d9776c002a34 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:31.433699 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-1b1b7085-0607-49fa-b482-d9776c002a34 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:31.443386 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-1b1b7085-0607-49fa-b482-d9776c002a34 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5" status: 200 len: 1667 microversion: 2.1 time: 0.360529 Oct 04 18:44:31.450363 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-051a1af3-c7c9-489f-83fe-72a619dd0843 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Flavor limits 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:44:31.451183 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-051a1af3-c7c9-489f-83fe-72a619dd0843 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Image limits 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:44:31.452038 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-051a1af3-c7c9-489f-83fe-72a619dd0843 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Flavor pref 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:44:31.452571 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-051a1af3-c7c9-489f-83fe-72a619dd0843 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Image pref 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:44:31.453438 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-051a1af3-c7c9-489f-83fe-72a619dd0843 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:44:31.462166 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1665/3159] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:31 2022] GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5 => generated 1667 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:31.475949 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=21 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:44:31.492985 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-bc2aba22-fbb9-4905-866a-705b20c188f3 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:31.492985 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-bc2aba22-fbb9-4905-866a-705b20c188f3 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] [instance: cf78a645-458e-4dc2-a60d-a51754ab6258] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:31.504854 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-051a1af3-c7c9-489f-83fe-72a619dd0843 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:31.509970 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-051a1af3-c7c9-489f-83fe-72a619dd0843 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:31.512874 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-051a1af3-c7c9-489f-83fe-72a619dd0843 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:31.516336 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-051a1af3-c7c9-489f-83fe-72a619dd0843 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:31.517020 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-051a1af3-c7c9-489f-83fe-72a619dd0843 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:31.521066 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-051a1af3-c7c9-489f-83fe-72a619dd0843 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:31.529924 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bc2aba22-fbb9-4905-866a-705b20c188f3 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:31.529924 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bc2aba22-fbb9-4905-866a-705b20c188f3 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:31.529924 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bc2aba22-fbb9-4905-866a-705b20c188f3 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:31.540649 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bc2aba22-fbb9-4905-866a-705b20c188f3 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:31.541180 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bc2aba22-fbb9-4905-866a-705b20c188f3 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:31.544820 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bc2aba22-fbb9-4905-866a-705b20c188f3 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:31.569668 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-051a1af3-c7c9-489f-83fe-72a619dd0843 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Getting quotas for project 65037d4ea5124d749e42928032e803fd. Resources: {'ram', 'cores', 'instances'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:44:31.585724 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-051a1af3-c7c9-489f-83fe-72a619dd0843 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Getting quotas for user d2c710f394164b89b16bcac2fe51c58a and project 65037d4ea5124d749e42928032e803fd. Resources: {'ram', 'cores', 'instances'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:44:31.614916 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-051a1af3-c7c9-489f-83fe-72a619dd0843 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Going to run 1 instances... {{(pid=123595) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:44:31.620591 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-051a1af3-c7c9-489f-83fe-72a619dd0843 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] [instance: b28a95a5-c6c2-4781-8c1a-62e7d3eac5a7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e8943ec5-4038-4d4b-b9b9-2415a79f5243',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:44:31.728210 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-051a1af3-c7c9-489f-83fe-72a619dd0843 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.329738 Oct 04 18:44:31.730414 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1495/3160] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 18:44:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 2334 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:44:31.741454 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-16e58767-6af4-45c7-9da4-374ccb0cd023 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:31.744523 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-16e58767-6af4-45c7-9da4-374ccb0cd023 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] [instance: b28a95a5-c6c2-4781-8c1a-62e7d3eac5a7] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:31.973396 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-16e58767-6af4-45c7-9da4-374ccb0cd023 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c710f394164b89b16bcac2fe51c58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65037d4ea5124d749e42928032e803fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:31.984593 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-16e58767-6af4-45c7-9da4-374ccb0cd023 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] 10.222.0.43 "GET /compute/v2.1/servers/b28a95a5-c6c2-4781-8c1a-62e7d3eac5a7" status: 200 len: 1217 microversion: 2.1 time: 0.248152 Oct 04 18:44:31.987360 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1496/3161] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:31 2022] GET /compute/v2.1/servers/b28a95a5-c6c2-4781-8c1a-62e7d3eac5a7 => generated 1217 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:44:31.996698 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-661fe048-d6f1-48ed-8795-eedf1b303ad0 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:32.003006 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-661fe048-d6f1-48ed-8795-eedf1b303ad0 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] [instance: 15541ec9-3112-4adc-9fad-6d20a88f2c09] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:32.019989 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-661fe048-d6f1-48ed-8795-eedf1b303ad0 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:32.024021 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-661fe048-d6f1-48ed-8795-eedf1b303ad0 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:32.025451 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-661fe048-d6f1-48ed-8795-eedf1b303ad0 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:32.027584 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-661fe048-d6f1-48ed-8795-eedf1b303ad0 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:32.031566 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-661fe048-d6f1-48ed-8795-eedf1b303ad0 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:32.032034 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-661fe048-d6f1-48ed-8795-eedf1b303ad0 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:32.142556 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-bc2aba22-fbb9-4905-866a-705b20c188f3 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608fc9ed7cdb487c9bf4b783c26ceeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29876d6805924df882d6861b0f6ab4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:32.193240 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-bc2aba22-fbb9-4905-866a-705b20c188f3 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] 10.222.0.43 "GET /compute/v2.1/servers/cf78a645-458e-4dc2-a60d-a51754ab6258" status: 200 len: 1471 microversion: 2.1 time: 0.712816 Oct 04 18:44:32.212675 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1666/3162] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:31 2022] GET /compute/v2.1/servers/cf78a645-458e-4dc2-a60d-a51754ab6258 => generated 1471 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:33.021151 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-5b3456c6-299b-4fbd-b8c7-fb7c4a6a8a2a tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:33.028317 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-5b3456c6-299b-4fbd-b8c7-fb7c4a6a8a2a tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] [instance: b28a95a5-c6c2-4781-8c1a-62e7d3eac5a7] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:33.043861 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5b3456c6-299b-4fbd-b8c7-fb7c4a6a8a2a tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:33.048831 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5b3456c6-299b-4fbd-b8c7-fb7c4a6a8a2a tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:33.050384 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5b3456c6-299b-4fbd-b8c7-fb7c4a6a8a2a tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:33.055423 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5b3456c6-299b-4fbd-b8c7-fb7c4a6a8a2a tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:33.056247 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5b3456c6-299b-4fbd-b8c7-fb7c4a6a8a2a tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:33.056866 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5b3456c6-299b-4fbd-b8c7-fb7c4a6a8a2a tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:33.222355 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-661fe048-d6f1-48ed-8795-eedf1b303ad0 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96e7480de94c43909045ac1087e40cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6bd34bf5540ee95c8144f185eb22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:33.235996 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-661fe048-d6f1-48ed-8795-eedf1b303ad0 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] 10.222.0.43 "GET /compute/v2.1/servers/15541ec9-3112-4adc-9fad-6d20a88f2c09" status: 200 len: 1370 microversion: 2.1 time: 1.246901 Oct 04 18:44:33.239885 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1497/3163] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:31 2022] GET /compute/v2.1/servers/15541ec9-3112-4adc-9fad-6d20a88f2c09 => generated 1370 bytes in 1252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:33.259833 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-5fdfc894-dc81-4be2-8f5e-028c3f5bd768 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:33.261889 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-5fdfc894-dc81-4be2-8f5e-028c3f5bd768 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] [instance: cf78a645-458e-4dc2-a60d-a51754ab6258] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:33.278180 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5fdfc894-dc81-4be2-8f5e-028c3f5bd768 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:33.278751 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5fdfc894-dc81-4be2-8f5e-028c3f5bd768 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:33.281292 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5fdfc894-dc81-4be2-8f5e-028c3f5bd768 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:33.283757 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5fdfc894-dc81-4be2-8f5e-028c3f5bd768 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:33.288198 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5fdfc894-dc81-4be2-8f5e-028c3f5bd768 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:33.289374 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5fdfc894-dc81-4be2-8f5e-028c3f5bd768 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:33.417097 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-5b3456c6-299b-4fbd-b8c7-fb7c4a6a8a2a tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c710f394164b89b16bcac2fe51c58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65037d4ea5124d749e42928032e803fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:33.428545 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-5b3456c6-299b-4fbd-b8c7-fb7c4a6a8a2a tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] 10.222.0.43 "GET /compute/v2.1/servers/b28a95a5-c6c2-4781-8c1a-62e7d3eac5a7" status: 200 len: 1213 microversion: 2.1 time: 0.416674 Oct 04 18:44:33.431539 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1667/3164] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:33 2022] GET /compute/v2.1/servers/b28a95a5-c6c2-4781-8c1a-62e7d3eac5a7 => generated 1213 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:33.492874 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-6768a239-793d-48cf-9b5c-6f59bc329ca9 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:33.496175 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-6768a239-793d-48cf-9b5c-6f59bc329ca9 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 82b86465-afb0-49ef-9932-1538010c1ae5] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:33.506670 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6768a239-793d-48cf-9b5c-6f59bc329ca9 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:33.507450 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6768a239-793d-48cf-9b5c-6f59bc329ca9 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:33.508299 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6768a239-793d-48cf-9b5c-6f59bc329ca9 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:33.509487 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6768a239-793d-48cf-9b5c-6f59bc329ca9 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:33.513103 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6768a239-793d-48cf-9b5c-6f59bc329ca9 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:33.513854 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6768a239-793d-48cf-9b5c-6f59bc329ca9 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:33.834910 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-6768a239-793d-48cf-9b5c-6f59bc329ca9 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:33.846179 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-6768a239-793d-48cf-9b5c-6f59bc329ca9 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5" status: 200 len: 1667 microversion: 2.1 time: 0.362585 Oct 04 18:44:33.849284 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1668/3165] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:33 2022] GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5 => generated 1667 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:33.875231 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-492aca92-653c-4735-bd18-d6d6a2b524a0 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:33.875960 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-492aca92-653c-4735-bd18-d6d6a2b524a0 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 82b86465-afb0-49ef-9932-1538010c1ae5] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:33.892159 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-492aca92-653c-4735-bd18-d6d6a2b524a0 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:33.894017 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-492aca92-653c-4735-bd18-d6d6a2b524a0 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:33.895682 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-492aca92-653c-4735-bd18-d6d6a2b524a0 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:33.899300 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-492aca92-653c-4735-bd18-d6d6a2b524a0 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:33.901847 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-492aca92-653c-4735-bd18-d6d6a2b524a0 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:33.902466 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-492aca92-653c-4735-bd18-d6d6a2b524a0 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:34.156998 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-5fdfc894-dc81-4be2-8f5e-028c3f5bd768 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608fc9ed7cdb487c9bf4b783c26ceeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29876d6805924df882d6861b0f6ab4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:34.181988 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-5fdfc894-dc81-4be2-8f5e-028c3f5bd768 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] 10.222.0.43 "GET /compute/v2.1/servers/cf78a645-458e-4dc2-a60d-a51754ab6258" status: 200 len: 1471 microversion: 2.1 time: 0.940763 Oct 04 18:44:34.182835 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1498/3166] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:33 2022] GET /compute/v2.1/servers/cf78a645-458e-4dc2-a60d-a51754ab6258 => generated 1471 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:34.195067 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-ec6c2b0e-5fd4-4d87-b755-714d79d0b168 req-8cf39990-cadc-40f3-8153-6864b2352150 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82b86465-afb0-49ef-9932-1538010c1ae5", "name": "network-vif-unplugged", "status": "completed", "tag": "7e7a43a5-3a15-49a6-b50e-0ac0ac9faa8d"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:44:34.235346 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-ec6c2b0e-5fd4-4d87-b755-714d79d0b168 req-8cf39990-cadc-40f3-8153-6864b2352150 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:34.235346 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-ec6c2b0e-5fd4-4d87-b755-714d79d0b168 req-8cf39990-cadc-40f3-8153-6864b2352150 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:34.235346 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-ec6c2b0e-5fd4-4d87-b755-714d79d0b168 req-8cf39990-cadc-40f3-8153-6864b2352150 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:34.270259 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-ec6c2b0e-5fd4-4d87-b755-714d79d0b168 req-8cf39990-cadc-40f3-8153-6864b2352150 service nova] Creating event network-vif-unplugged:7e7a43a5-3a15-49a6-b50e-0ac0ac9faa8d for instance 82b86465-afb0-49ef-9932-1538010c1ae5 on n-h2-851028-13 Oct 04 18:44:34.283983 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-ec6c2b0e-5fd4-4d87-b755-714d79d0b168 req-8cf39990-cadc-40f3-8153-6864b2352150 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.097216 Oct 04 18:44:34.287778 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1499/3167] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:44:34 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:44:34.298129 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-492aca92-653c-4735-bd18-d6d6a2b524a0 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:34.310905 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-492aca92-653c-4735-bd18-d6d6a2b524a0 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5" status: 200 len: 1667 microversion: 2.1 time: 0.440308 Oct 04 18:44:34.311511 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1669/3168] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:33 2022] GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5 => generated 1667 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:34.321655 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-beda80fc-2d0d-407a-b3ce-13aa806584e2 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:34.321655 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-beda80fc-2d0d-407a-b3ce-13aa806584e2 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] [instance: 15541ec9-3112-4adc-9fad-6d20a88f2c09] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:34.337758 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-beda80fc-2d0d-407a-b3ce-13aa806584e2 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:34.339084 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-beda80fc-2d0d-407a-b3ce-13aa806584e2 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:34.339847 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-beda80fc-2d0d-407a-b3ce-13aa806584e2 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:34.340833 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-beda80fc-2d0d-407a-b3ce-13aa806584e2 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:34.341691 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-beda80fc-2d0d-407a-b3ce-13aa806584e2 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:34.342804 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-beda80fc-2d0d-407a-b3ce-13aa806584e2 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:34.353834 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-6aed7dd7-ae13-40c0-b7f4-fdf4d0a9489e tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:34.355950 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-6aed7dd7-ae13-40c0-b7f4-fdf4d0a9489e tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 82b86465-afb0-49ef-9932-1538010c1ae5] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:34.369842 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6aed7dd7-ae13-40c0-b7f4-fdf4d0a9489e tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:34.372254 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6aed7dd7-ae13-40c0-b7f4-fdf4d0a9489e tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:34.372974 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6aed7dd7-ae13-40c0-b7f4-fdf4d0a9489e tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:34.376269 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6aed7dd7-ae13-40c0-b7f4-fdf4d0a9489e tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:34.377103 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6aed7dd7-ae13-40c0-b7f4-fdf4d0a9489e tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:34.378563 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6aed7dd7-ae13-40c0-b7f4-fdf4d0a9489e tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:35.075289 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-6aed7dd7-ae13-40c0-b7f4-fdf4d0a9489e tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:35.087302 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-6aed7dd7-ae13-40c0-b7f4-fdf4d0a9489e tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5" status: 200 len: 1667 microversion: 2.1 time: 0.751337 Oct 04 18:44:35.088675 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1670/3169] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:34 2022] GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5 => generated 1667 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:44:35.095249 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-bda46605-39c5-4d76-ac2d-5c62d6a347b2 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:35.096333 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-bda46605-39c5-4d76-ac2d-5c62d6a347b2 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] [instance: b28a95a5-c6c2-4781-8c1a-62e7d3eac5a7] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:35.104579 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bda46605-39c5-4d76-ac2d-5c62d6a347b2 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:35.105454 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bda46605-39c5-4d76-ac2d-5c62d6a347b2 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:35.106130 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bda46605-39c5-4d76-ac2d-5c62d6a347b2 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:35.107218 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bda46605-39c5-4d76-ac2d-5c62d6a347b2 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:35.107886 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bda46605-39c5-4d76-ac2d-5c62d6a347b2 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:35.108588 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bda46605-39c5-4d76-ac2d-5c62d6a347b2 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:35.111287 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-beda80fc-2d0d-407a-b3ce-13aa806584e2 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96e7480de94c43909045ac1087e40cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6bd34bf5540ee95c8144f185eb22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:35.125679 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-beda80fc-2d0d-407a-b3ce-13aa806584e2 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] 10.222.0.43 "GET /compute/v2.1/servers/15541ec9-3112-4adc-9fad-6d20a88f2c09" status: 200 len: 1370 microversion: 2.1 time: 0.836540 Oct 04 18:44:35.126279 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1500/3170] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:34 2022] GET /compute/v2.1/servers/15541ec9-3112-4adc-9fad-6d20a88f2c09 => generated 1370 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:35.147277 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-5497ab4c-0ca2-4213-9f40-f66e0f11bcb5 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:44:35.157811 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-5497ab4c-0ca2-4213-9f40-f66e0f11bcb5 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 82b86465-afb0-49ef-9932-1538010c1ae5] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:35.168902 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5497ab4c-0ca2-4213-9f40-f66e0f11bcb5 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:35.169974 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5497ab4c-0ca2-4213-9f40-f66e0f11bcb5 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:35.170434 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5497ab4c-0ca2-4213-9f40-f66e0f11bcb5 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:35.171238 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5497ab4c-0ca2-4213-9f40-f66e0f11bcb5 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:35.171720 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5497ab4c-0ca2-4213-9f40-f66e0f11bcb5 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:35.172153 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5497ab4c-0ca2-4213-9f40-f66e0f11bcb5 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:35.234245 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-bda46605-39c5-4d76-ac2d-5c62d6a347b2 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c710f394164b89b16bcac2fe51c58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65037d4ea5124d749e42928032e803fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:35.245952 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-bda46605-39c5-4d76-ac2d-5c62d6a347b2 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] 10.222.0.43 "GET /compute/v2.1/servers/b28a95a5-c6c2-4781-8c1a-62e7d3eac5a7" status: 200 len: 1275 microversion: 2.1 time: 0.155478 Oct 04 18:44:35.247378 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1671/3171] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:35 2022] GET /compute/v2.1/servers/b28a95a5-c6c2-4781-8c1a-62e7d3eac5a7 => generated 1275 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:35.263912 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-7ed0ce64-21e4-4687-9820-7a0f9dfe468a tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:35.265568 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-7ed0ce64-21e4-4687-9820-7a0f9dfe468a tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] [instance: cf78a645-458e-4dc2-a60d-a51754ab6258] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:35.276114 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7ed0ce64-21e4-4687-9820-7a0f9dfe468a tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:35.277526 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7ed0ce64-21e4-4687-9820-7a0f9dfe468a tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:35.278277 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7ed0ce64-21e4-4687-9820-7a0f9dfe468a tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:35.279895 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7ed0ce64-21e4-4687-9820-7a0f9dfe468a tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:35.281346 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7ed0ce64-21e4-4687-9820-7a0f9dfe468a tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:35.281932 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7ed0ce64-21e4-4687-9820-7a0f9dfe468a tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:35.291651 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-5497ab4c-0ca2-4213-9f40-f66e0f11bcb5 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "POST /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5/action" status: 202 len: 0 microversion: 2.1 time: 0.149092 Oct 04 18:44:35.292660 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1501/3172] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 18:44:35 2022] POST /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5/action => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:44:35.320556 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-ba544e65-3fac-4924-9826-e88898d71563 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:35.321729 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-ba544e65-3fac-4924-9826-e88898d71563 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 82b86465-afb0-49ef-9932-1538010c1ae5] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:35.341977 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:44:35.344766 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ba544e65-3fac-4924-9826-e88898d71563 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:35.345716 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ba544e65-3fac-4924-9826-e88898d71563 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:35.346798 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ba544e65-3fac-4924-9826-e88898d71563 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:35.347768 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ba544e65-3fac-4924-9826-e88898d71563 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:35.348532 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ba544e65-3fac-4924-9826-e88898d71563 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:35.349842 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ba544e65-3fac-4924-9826-e88898d71563 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:35.581361 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-7ed0ce64-21e4-4687-9820-7a0f9dfe468a tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608fc9ed7cdb487c9bf4b783c26ceeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29876d6805924df882d6861b0f6ab4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:35.589920 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-7ed0ce64-21e4-4687-9820-7a0f9dfe468a tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] 10.222.0.43 "GET /compute/v2.1/servers/cf78a645-458e-4dc2-a60d-a51754ab6258" status: 200 len: 1471 microversion: 2.1 time: 0.340847 Oct 04 18:44:35.602133 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1672/3173] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:35 2022] GET /compute/v2.1/servers/cf78a645-458e-4dc2-a60d-a51754ab6258 => generated 1471 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:35.935138 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-ba544e65-3fac-4924-9826-e88898d71563 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:35.944021 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-ba544e65-3fac-4924-9826-e88898d71563 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5" status: 200 len: 1669 microversion: 2.1 time: 0.646947 Oct 04 18:44:35.945933 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1502/3174] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:35 2022] GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5 => generated 1669 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:44:36.163006 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-aa543cf7-ff10-44da-b494-ef84441b741a tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:36.166701 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-aa543cf7-ff10-44da-b494-ef84441b741a tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] [instance: 15541ec9-3112-4adc-9fad-6d20a88f2c09] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:36.188460 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-aa543cf7-ff10-44da-b494-ef84441b741a tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:36.190339 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-aa543cf7-ff10-44da-b494-ef84441b741a tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:36.195711 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-aa543cf7-ff10-44da-b494-ef84441b741a tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:36.197285 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-aa543cf7-ff10-44da-b494-ef84441b741a tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:36.198276 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-aa543cf7-ff10-44da-b494-ef84441b741a tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:36.199098 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-aa543cf7-ff10-44da-b494-ef84441b741a tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:36.274410 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-1e6d7388-54de-4b9b-b7a2-a88e8b2298fa tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:36.275734 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-1e6d7388-54de-4b9b-b7a2-a88e8b2298fa tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] [instance: b28a95a5-c6c2-4781-8c1a-62e7d3eac5a7] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:36.286080 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1e6d7388-54de-4b9b-b7a2-a88e8b2298fa tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:36.287284 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1e6d7388-54de-4b9b-b7a2-a88e8b2298fa tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:36.289411 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1e6d7388-54de-4b9b-b7a2-a88e8b2298fa tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:36.290654 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1e6d7388-54de-4b9b-b7a2-a88e8b2298fa tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:36.291631 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1e6d7388-54de-4b9b-b7a2-a88e8b2298fa tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:36.292377 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1e6d7388-54de-4b9b-b7a2-a88e8b2298fa tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:36.422694 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-1e6d7388-54de-4b9b-b7a2-a88e8b2298fa tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c710f394164b89b16bcac2fe51c58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65037d4ea5124d749e42928032e803fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:36.433862 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-1e6d7388-54de-4b9b-b7a2-a88e8b2298fa tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] 10.222.0.43 "GET /compute/v2.1/servers/b28a95a5-c6c2-4781-8c1a-62e7d3eac5a7" status: 200 len: 1275 microversion: 2.1 time: 0.164327 Oct 04 18:44:36.435498 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1503/3175] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:36 2022] GET /compute/v2.1/servers/b28a95a5-c6c2-4781-8c1a-62e7d3eac5a7 => generated 1275 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:44:36.534619 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-aa543cf7-ff10-44da-b494-ef84441b741a tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96e7480de94c43909045ac1087e40cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6bd34bf5540ee95c8144f185eb22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:36.550844 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-aa543cf7-ff10-44da-b494-ef84441b741a tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] 10.222.0.43 "GET /compute/v2.1/servers/15541ec9-3112-4adc-9fad-6d20a88f2c09" status: 200 len: 1370 microversion: 2.1 time: 0.396175 Oct 04 18:44:36.551528 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1673/3176] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:36 2022] GET /compute/v2.1/servers/15541ec9-3112-4adc-9fad-6d20a88f2c09 => generated 1370 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:36.614817 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-813f87a2-3851-47d3-afeb-cae34b47872b tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:36.615840 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-813f87a2-3851-47d3-afeb-cae34b47872b tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] [instance: cf78a645-458e-4dc2-a60d-a51754ab6258] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:36.631454 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-813f87a2-3851-47d3-afeb-cae34b47872b tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:36.634920 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-813f87a2-3851-47d3-afeb-cae34b47872b tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:36.635644 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-813f87a2-3851-47d3-afeb-cae34b47872b tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:36.636626 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-813f87a2-3851-47d3-afeb-cae34b47872b tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:36.642736 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-813f87a2-3851-47d3-afeb-cae34b47872b tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:36.643303 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-813f87a2-3851-47d3-afeb-cae34b47872b tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:36.828595 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-813f87a2-3851-47d3-afeb-cae34b47872b tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608fc9ed7cdb487c9bf4b783c26ceeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29876d6805924df882d6861b0f6ab4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:36.841527 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-813f87a2-3851-47d3-afeb-cae34b47872b tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] 10.222.0.43 "GET /compute/v2.1/servers/cf78a645-458e-4dc2-a60d-a51754ab6258" status: 200 len: 1471 microversion: 2.1 time: 0.229716 Oct 04 18:44:36.842893 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1504/3177] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:36 2022] GET /compute/v2.1/servers/cf78a645-458e-4dc2-a60d-a51754ab6258 => generated 1471 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:36.972274 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f4d82032-d67d-4727-b196-bc48a57ab309 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:36.977146 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-f4d82032-d67d-4727-b196-bc48a57ab309 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 82b86465-afb0-49ef-9932-1538010c1ae5] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:37.005741 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f4d82032-d67d-4727-b196-bc48a57ab309 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:37.006433 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f4d82032-d67d-4727-b196-bc48a57ab309 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:37.007754 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f4d82032-d67d-4727-b196-bc48a57ab309 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:37.009223 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f4d82032-d67d-4727-b196-bc48a57ab309 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:37.010273 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f4d82032-d67d-4727-b196-bc48a57ab309 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:37.010706 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f4d82032-d67d-4727-b196-bc48a57ab309 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:37.457828 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-0790400c-354d-4d84-a6d9-8c295401c8ac tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:37.458447 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-0790400c-354d-4d84-a6d9-8c295401c8ac tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] [instance: b28a95a5-c6c2-4781-8c1a-62e7d3eac5a7] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:37.468457 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0790400c-354d-4d84-a6d9-8c295401c8ac tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:37.468926 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0790400c-354d-4d84-a6d9-8c295401c8ac tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:37.469391 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0790400c-354d-4d84-a6d9-8c295401c8ac tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:37.470098 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0790400c-354d-4d84-a6d9-8c295401c8ac tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:37.470595 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0790400c-354d-4d84-a6d9-8c295401c8ac tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:37.471026 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0790400c-354d-4d84-a6d9-8c295401c8ac tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:37.543380 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-f4d82032-d67d-4727-b196-bc48a57ab309 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:37.551795 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-f4d82032-d67d-4727-b196-bc48a57ab309 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5" status: 200 len: 1669 microversion: 2.1 time: 0.584816 Oct 04 18:44:37.552387 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1674/3178] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:36 2022] GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5 => generated 1669 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:37.574800 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-6449a1b8-38ff-491e-aa1e-a1218b9400b9 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:37.575683 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-6449a1b8-38ff-491e-aa1e-a1218b9400b9 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] [instance: 15541ec9-3112-4adc-9fad-6d20a88f2c09] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:37.591945 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6449a1b8-38ff-491e-aa1e-a1218b9400b9 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:37.594081 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6449a1b8-38ff-491e-aa1e-a1218b9400b9 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:37.597305 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6449a1b8-38ff-491e-aa1e-a1218b9400b9 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:37.598627 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6449a1b8-38ff-491e-aa1e-a1218b9400b9 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:37.599417 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6449a1b8-38ff-491e-aa1e-a1218b9400b9 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:37.600100 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6449a1b8-38ff-491e-aa1e-a1218b9400b9 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:37.894543 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-0790400c-354d-4d84-a6d9-8c295401c8ac tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c710f394164b89b16bcac2fe51c58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65037d4ea5124d749e42928032e803fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:37.911102 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-0790400c-354d-4d84-a6d9-8c295401c8ac tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] 10.222.0.43 "GET /compute/v2.1/servers/b28a95a5-c6c2-4781-8c1a-62e7d3eac5a7" status: 200 len: 1317 microversion: 2.1 time: 0.457030 Oct 04 18:44:37.934220 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1505/3179] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:37 2022] GET /compute/v2.1/servers/b28a95a5-c6c2-4781-8c1a-62e7d3eac5a7 => generated 1317 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:44:37.943935 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-3da588c7-1853-40aa-8b99-92a4c6122d2c tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:37.944564 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-3da588c7-1853-40aa-8b99-92a4c6122d2c tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] [instance: cf78a645-458e-4dc2-a60d-a51754ab6258] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:37.955305 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3da588c7-1853-40aa-8b99-92a4c6122d2c tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:37.955922 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3da588c7-1853-40aa-8b99-92a4c6122d2c tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:37.956346 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3da588c7-1853-40aa-8b99-92a4c6122d2c tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:37.957151 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3da588c7-1853-40aa-8b99-92a4c6122d2c tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:37.963747 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3da588c7-1853-40aa-8b99-92a4c6122d2c tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:37.964291 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3da588c7-1853-40aa-8b99-92a4c6122d2c tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:38.055587 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-6449a1b8-38ff-491e-aa1e-a1218b9400b9 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96e7480de94c43909045ac1087e40cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6bd34bf5540ee95c8144f185eb22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:38.072146 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-6449a1b8-38ff-491e-aa1e-a1218b9400b9 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] 10.222.0.43 "GET /compute/v2.1/servers/15541ec9-3112-4adc-9fad-6d20a88f2c09" status: 200 len: 1370 microversion: 2.1 time: 0.501117 Oct 04 18:44:38.077786 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1675/3180] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:37 2022] GET /compute/v2.1/servers/15541ec9-3112-4adc-9fad-6d20a88f2c09 => generated 1370 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:44:38.094199 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-0e3a9238-7ccb-4c95-b44e-8b19bf164223 tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:38.098698 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-0e3a9238-7ccb-4c95-b44e-8b19bf164223 tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] [instance: 6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:38.106783 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0e3a9238-7ccb-4c95-b44e-8b19bf164223 tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:38.107406 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0e3a9238-7ccb-4c95-b44e-8b19bf164223 tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:38.108600 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0e3a9238-7ccb-4c95-b44e-8b19bf164223 tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:38.109829 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0e3a9238-7ccb-4c95-b44e-8b19bf164223 tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:38.110458 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0e3a9238-7ccb-4c95-b44e-8b19bf164223 tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:38.110960 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0e3a9238-7ccb-4c95-b44e-8b19bf164223 tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:38.748401 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-3da588c7-1853-40aa-8b99-92a4c6122d2c tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608fc9ed7cdb487c9bf4b783c26ceeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29876d6805924df882d6861b0f6ab4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:38.756711 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-3da588c7-1853-40aa-8b99-92a4c6122d2c tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] 10.222.0.43 "GET /compute/v2.1/servers/cf78a645-458e-4dc2-a60d-a51754ab6258" status: 200 len: 1477 microversion: 2.1 time: 0.819420 Oct 04 18:44:38.772722 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1506/3181] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:37 2022] GET /compute/v2.1/servers/cf78a645-458e-4dc2-a60d-a51754ab6258 => generated 1477 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:38.778510 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-1ce097ed-96a6-4102-b4f9-14e27e08e1be tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:38.779320 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-1ce097ed-96a6-4102-b4f9-14e27e08e1be tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 82b86465-afb0-49ef-9932-1538010c1ae5] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:38.786384 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1ce097ed-96a6-4102-b4f9-14e27e08e1be tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:38.787195 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1ce097ed-96a6-4102-b4f9-14e27e08e1be tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:38.787628 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1ce097ed-96a6-4102-b4f9-14e27e08e1be tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:38.789161 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1ce097ed-96a6-4102-b4f9-14e27e08e1be tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:38.789843 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1ce097ed-96a6-4102-b4f9-14e27e08e1be tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:38.790342 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1ce097ed-96a6-4102-b4f9-14e27e08e1be tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:38.810816 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-0e3a9238-7ccb-4c95-b44e-8b19bf164223 tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75" status: 200 len: 1815 microversion: 2.1 time: 0.730999 Oct 04 18:44:38.811404 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1676/3182] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:38 2022] GET /compute/v2.1/servers/6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75 => generated 1815 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:38.838479 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-4d9e894a-d23b-4b63-ab31-740d58e1aaf4 tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:38.843602 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4d9e894a-d23b-4b63-ab31-740d58e1aaf4 tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:38.844416 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4d9e894a-d23b-4b63-ab31-740d58e1aaf4 tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:38.845078 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4d9e894a-d23b-4b63-ab31-740d58e1aaf4 tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:38.846048 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4d9e894a-d23b-4b63-ab31-740d58e1aaf4 tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:38.846702 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4d9e894a-d23b-4b63-ab31-740d58e1aaf4 tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:38.847407 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4d9e894a-d23b-4b63-ab31-740d58e1aaf4 tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:38.885769 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-4d9e894a-d23b-4b63-ab31-740d58e1aaf4 tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] 10.222.0.43 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.051393 Oct 04 18:44:38.886868 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1677/3183] 10.222.0.43 () {58 vars in 1176 bytes} [Tue Oct 4 18:44:38 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:44:38.936798 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-bf0b5ffd-6fb8-4775-852b-189922c223fa tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:38.937655 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-bf0b5ffd-6fb8-4775-852b-189922c223fa tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] [instance: b28a95a5-c6c2-4781-8c1a-62e7d3eac5a7] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:38.944726 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bf0b5ffd-6fb8-4775-852b-189922c223fa tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:38.945259 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bf0b5ffd-6fb8-4775-852b-189922c223fa tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:38.945706 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bf0b5ffd-6fb8-4775-852b-189922c223fa tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:38.946416 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bf0b5ffd-6fb8-4775-852b-189922c223fa tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:38.946869 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bf0b5ffd-6fb8-4775-852b-189922c223fa tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:38.947303 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bf0b5ffd-6fb8-4775-852b-189922c223fa tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:39.410955 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-bf0b5ffd-6fb8-4775-852b-189922c223fa tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c710f394164b89b16bcac2fe51c58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65037d4ea5124d749e42928032e803fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:39.423680 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-bf0b5ffd-6fb8-4775-852b-189922c223fa tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] 10.222.0.43 "GET /compute/v2.1/servers/b28a95a5-c6c2-4781-8c1a-62e7d3eac5a7" status: 200 len: 1317 microversion: 2.1 time: 0.490479 Oct 04 18:44:39.446295 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-1ce097ed-96a6-4102-b4f9-14e27e08e1be tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:39.455892 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1678/3184] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:38 2022] GET /compute/v2.1/servers/b28a95a5-c6c2-4781-8c1a-62e7d3eac5a7 => generated 1317 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:39.463666 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-1ce097ed-96a6-4102-b4f9-14e27e08e1be tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5" status: 200 len: 1669 microversion: 2.1 time: 0.688894 Oct 04 18:44:39.464258 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1507/3185] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:38 2022] GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5 => generated 1669 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:39.465792 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-05d87d84-a0d8-4064-8ef9-93c6a19c3c13 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:39.466413 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-05d87d84-a0d8-4064-8ef9-93c6a19c3c13 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] [instance: 15541ec9-3112-4adc-9fad-6d20a88f2c09] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:39.482648 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-05d87d84-a0d8-4064-8ef9-93c6a19c3c13 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:39.485300 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-05d87d84-a0d8-4064-8ef9-93c6a19c3c13 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:39.485844 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-05d87d84-a0d8-4064-8ef9-93c6a19c3c13 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:39.486978 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-05d87d84-a0d8-4064-8ef9-93c6a19c3c13 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:39.489238 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-05d87d84-a0d8-4064-8ef9-93c6a19c3c13 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:39.505082 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-05d87d84-a0d8-4064-8ef9-93c6a19c3c13 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:39.784264 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-c49dd5f5-be0f-483b-aa25-c9fffe85c9b1 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:39.787396 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-c49dd5f5-be0f-483b-aa25-c9fffe85c9b1 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] [instance: cf78a645-458e-4dc2-a60d-a51754ab6258] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:39.798667 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c49dd5f5-be0f-483b-aa25-c9fffe85c9b1 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:39.799198 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c49dd5f5-be0f-483b-aa25-c9fffe85c9b1 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:39.799629 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c49dd5f5-be0f-483b-aa25-c9fffe85c9b1 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:39.800361 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c49dd5f5-be0f-483b-aa25-c9fffe85c9b1 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:39.800817 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c49dd5f5-be0f-483b-aa25-c9fffe85c9b1 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:39.801354 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c49dd5f5-be0f-483b-aa25-c9fffe85c9b1 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:40.240768 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-05d87d84-a0d8-4064-8ef9-93c6a19c3c13 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96e7480de94c43909045ac1087e40cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6bd34bf5540ee95c8144f185eb22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:40.254039 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-05d87d84-a0d8-4064-8ef9-93c6a19c3c13 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] 10.222.0.43 "GET /compute/v2.1/servers/15541ec9-3112-4adc-9fad-6d20a88f2c09" status: 200 len: 1370 microversion: 2.1 time: 0.793628 Oct 04 18:44:40.255625 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1679/3186] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:39 2022] GET /compute/v2.1/servers/15541ec9-3112-4adc-9fad-6d20a88f2c09 => generated 1370 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:40.264134 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-54e0da38-8787-4b8e-9541-cbadde5b99e6 req-9de0a10c-f2dc-4830-b973-b45281b4c75e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b28a95a5-c6c2-4781-8c1a-62e7d3eac5a7", "tag": "f42c238a-1ff4-4b31-8e94-8e0d356f5cfb"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:44:40.303598 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-54e0da38-8787-4b8e-9541-cbadde5b99e6 req-9de0a10c-f2dc-4830-b973-b45281b4c75e service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:40.304695 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-54e0da38-8787-4b8e-9541-cbadde5b99e6 req-9de0a10c-f2dc-4830-b973-b45281b4c75e service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:40.305163 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-54e0da38-8787-4b8e-9541-cbadde5b99e6 req-9de0a10c-f2dc-4830-b973-b45281b4c75e service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:40.339434 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-54e0da38-8787-4b8e-9541-cbadde5b99e6 req-9de0a10c-f2dc-4830-b973-b45281b4c75e service nova] Creating event network-changed:f42c238a-1ff4-4b31-8e94-8e0d356f5cfb for instance b28a95a5-c6c2-4781-8c1a-62e7d3eac5a7 on n-h2-851028-13 Oct 04 18:44:40.347450 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-54e0da38-8787-4b8e-9541-cbadde5b99e6 req-9de0a10c-f2dc-4830-b973-b45281b4c75e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089848 Oct 04 18:44:40.348332 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1680/3187] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:44:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:44:40.427709 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-c49dd5f5-be0f-483b-aa25-c9fffe85c9b1 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608fc9ed7cdb487c9bf4b783c26ceeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29876d6805924df882d6861b0f6ab4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:40.440174 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-c49dd5f5-be0f-483b-aa25-c9fffe85c9b1 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] 10.222.0.43 "GET /compute/v2.1/servers/cf78a645-458e-4dc2-a60d-a51754ab6258" status: 200 len: 1477 microversion: 2.1 time: 0.663486 Oct 04 18:44:40.441394 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1508/3188] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:39 2022] GET /compute/v2.1/servers/cf78a645-458e-4dc2-a60d-a51754ab6258 => generated 1477 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:40.466937 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-0ae31031-5bae-433e-aca8-65ba7feb385d tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:40.485251 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-0ae31031-5bae-433e-aca8-65ba7feb385d tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] [instance: b28a95a5-c6c2-4781-8c1a-62e7d3eac5a7] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:40.493810 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-a96e4015-519d-488f-a406-01292bb025b6 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:40.494439 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-a96e4015-519d-488f-a406-01292bb025b6 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 82b86465-afb0-49ef-9932-1538010c1ae5] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:40.495554 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0ae31031-5bae-433e-aca8-65ba7feb385d tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:40.496055 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0ae31031-5bae-433e-aca8-65ba7feb385d tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:40.496559 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0ae31031-5bae-433e-aca8-65ba7feb385d tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:40.497295 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0ae31031-5bae-433e-aca8-65ba7feb385d tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:40.497975 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0ae31031-5bae-433e-aca8-65ba7feb385d tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:40.498592 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0ae31031-5bae-433e-aca8-65ba7feb385d tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:40.503685 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a96e4015-519d-488f-a406-01292bb025b6 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:40.504110 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a96e4015-519d-488f-a406-01292bb025b6 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:40.504553 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a96e4015-519d-488f-a406-01292bb025b6 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:40.511308 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a96e4015-519d-488f-a406-01292bb025b6 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:40.511872 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a96e4015-519d-488f-a406-01292bb025b6 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:40.512325 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a96e4015-519d-488f-a406-01292bb025b6 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:41.017171 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-0ae31031-5bae-433e-aca8-65ba7feb385d tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c710f394164b89b16bcac2fe51c58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65037d4ea5124d749e42928032e803fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:41.029581 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-a96e4015-519d-488f-a406-01292bb025b6 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:41.038194 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-a96e4015-519d-488f-a406-01292bb025b6 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5" status: 200 len: 1674 microversion: 2.1 time: 0.549984 Oct 04 18:44:41.043201 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-0ae31031-5bae-433e-aca8-65ba7feb385d tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] 10.222.0.43 "GET /compute/v2.1/servers/b28a95a5-c6c2-4781-8c1a-62e7d3eac5a7" status: 200 len: 1317 microversion: 2.1 time: 0.583523 Oct 04 18:44:41.044307 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1681/3189] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:40 2022] GET /compute/v2.1/servers/b28a95a5-c6c2-4781-8c1a-62e7d3eac5a7 => generated 1317 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:41.044686 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1509/3190] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:40 2022] GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5 => generated 1674 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:41.111164 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-5941f5ed-3058-430d-bdb0-19c2962b577f req-7bf0b14c-bc2d-4753-80b9-ece6f009b60f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15541ec9-3112-4adc-9fad-6d20a88f2c09", "name": "network-vif-plugged", "status": "completed", "tag": "ae7d73fe-313a-45b9-8e8c-91a97a4dd13a"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:44:41.137573 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-5941f5ed-3058-430d-bdb0-19c2962b577f req-7bf0b14c-bc2d-4753-80b9-ece6f009b60f service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:41.138137 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-5941f5ed-3058-430d-bdb0-19c2962b577f req-7bf0b14c-bc2d-4753-80b9-ece6f009b60f service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:41.138683 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-5941f5ed-3058-430d-bdb0-19c2962b577f req-7bf0b14c-bc2d-4753-80b9-ece6f009b60f service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:41.168082 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-5941f5ed-3058-430d-bdb0-19c2962b577f req-7bf0b14c-bc2d-4753-80b9-ece6f009b60f service nova] Creating event network-vif-plugged:ae7d73fe-313a-45b9-8e8c-91a97a4dd13a for instance 15541ec9-3112-4adc-9fad-6d20a88f2c09 on n-h1-851028-13 Oct 04 18:44:41.182638 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-5941f5ed-3058-430d-bdb0-19c2962b577f req-7bf0b14c-bc2d-4753-80b9-ece6f009b60f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072039 Oct 04 18:44:41.183696 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1682/3191] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:44:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:44:41.285319 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-5d31cec9-6fd5-46ed-b9e9-b1ad1107909e tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:41.286954 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-5d31cec9-6fd5-46ed-b9e9-b1ad1107909e tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] [instance: 15541ec9-3112-4adc-9fad-6d20a88f2c09] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:41.306319 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5d31cec9-6fd5-46ed-b9e9-b1ad1107909e tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:41.310683 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5d31cec9-6fd5-46ed-b9e9-b1ad1107909e tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:41.311303 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5d31cec9-6fd5-46ed-b9e9-b1ad1107909e tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:41.312251 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5d31cec9-6fd5-46ed-b9e9-b1ad1107909e tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:41.313012 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5d31cec9-6fd5-46ed-b9e9-b1ad1107909e tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:41.313576 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5d31cec9-6fd5-46ed-b9e9-b1ad1107909e tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:41.349002 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:44:41.466094 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-819ed354-8544-466c-b8c3-310f64f368b7 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:41.466827 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-819ed354-8544-466c-b8c3-310f64f368b7 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] [instance: cf78a645-458e-4dc2-a60d-a51754ab6258] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:41.476611 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-819ed354-8544-466c-b8c3-310f64f368b7 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:41.477787 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-819ed354-8544-466c-b8c3-310f64f368b7 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:41.478328 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-819ed354-8544-466c-b8c3-310f64f368b7 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:41.479476 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-819ed354-8544-466c-b8c3-310f64f368b7 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:41.481469 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-819ed354-8544-466c-b8c3-310f64f368b7 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:41.482884 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-819ed354-8544-466c-b8c3-310f64f368b7 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:41.504622 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=100 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:44:41.543874 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=12 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:44:41.730823 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-819ed354-8544-466c-b8c3-310f64f368b7 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608fc9ed7cdb487c9bf4b783c26ceeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29876d6805924df882d6861b0f6ab4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:41.742105 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-819ed354-8544-466c-b8c3-310f64f368b7 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] 10.222.0.43 "GET /compute/v2.1/servers/cf78a645-458e-4dc2-a60d-a51754ab6258" status: 200 len: 1477 microversion: 2.1 time: 0.281704 Oct 04 18:44:41.755246 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1683/3192] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:41 2022] GET /compute/v2.1/servers/cf78a645-458e-4dc2-a60d-a51754ab6258 => generated 1477 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:41.765849 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-1063d35c-9711-4bda-8199-d4bd62b1ae8d tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ac1da745-1280-4614-b0b5-7c0dcb0dc11d", "device": "/dev/xvdb"}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:44:41.770643 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-1063d35c-9711-4bda-8199-d4bd62b1ae8d tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] [instance: 6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:41.778496 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1063d35c-9711-4bda-8199-d4bd62b1ae8d tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:41.779220 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1063d35c-9711-4bda-8199-d4bd62b1ae8d tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:41.779838 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1063d35c-9711-4bda-8199-d4bd62b1ae8d tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:41.780714 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1063d35c-9711-4bda-8199-d4bd62b1ae8d tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:41.781385 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1063d35c-9711-4bda-8199-d4bd62b1ae8d tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:41.781969 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1063d35c-9711-4bda-8199-d4bd62b1ae8d tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:41.924711 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-5d31cec9-6fd5-46ed-b9e9-b1ad1107909e tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96e7480de94c43909045ac1087e40cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6bd34bf5540ee95c8144f185eb22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:41.947218 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-5d31cec9-6fd5-46ed-b9e9-b1ad1107909e tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] 10.222.0.43 "GET /compute/v2.1/servers/15541ec9-3112-4adc-9fad-6d20a88f2c09" status: 200 len: 1370 microversion: 2.1 time: 0.670045 Oct 04 18:44:41.949222 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1510/3193] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:41 2022] GET /compute/v2.1/servers/15541ec9-3112-4adc-9fad-6d20a88f2c09 => generated 1370 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:42.068862 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-b4b29240-d647-4714-bad4-629e068f7150 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:42.071024 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-b4b29240-d647-4714-bad4-629e068f7150 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 82b86465-afb0-49ef-9932-1538010c1ae5] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:42.078526 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=7 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:44:42.081001 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b4b29240-d647-4714-bad4-629e068f7150 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:42.081860 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b4b29240-d647-4714-bad4-629e068f7150 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:42.082975 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b4b29240-d647-4714-bad4-629e068f7150 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:42.084390 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b4b29240-d647-4714-bad4-629e068f7150 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:42.085659 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b4b29240-d647-4714-bad4-629e068f7150 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:42.086682 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b4b29240-d647-4714-bad4-629e068f7150 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:42.247148 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-1063d35c-9711-4bda-8199-d4bd62b1ae8d tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] 10.222.0.43 "POST /compute/v2.1/servers/6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.489962 Oct 04 18:44:42.249137 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1684/3194] 10.222.0.43 () {60 vars in 1323 bytes} [Tue Oct 4 18:44:41 2022] POST /compute/v2.1/servers/6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75/os-volume_attachments => generated 194 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:44:42.268193 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-88e45210-c179-47a7-b81e-b347f5cba607 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:42.271614 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-88e45210-c179-47a7-b81e-b347f5cba607 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] [instance: b28a95a5-c6c2-4781-8c1a-62e7d3eac5a7] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:42.285847 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-88e45210-c179-47a7-b81e-b347f5cba607 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:42.290349 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-88e45210-c179-47a7-b81e-b347f5cba607 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:42.292131 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-88e45210-c179-47a7-b81e-b347f5cba607 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:42.294436 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-88e45210-c179-47a7-b81e-b347f5cba607 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:42.295099 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-88e45210-c179-47a7-b81e-b347f5cba607 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:42.296248 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-88e45210-c179-47a7-b81e-b347f5cba607 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:42.567924 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-88e45210-c179-47a7-b81e-b347f5cba607 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c710f394164b89b16bcac2fe51c58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65037d4ea5124d749e42928032e803fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:42.577140 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-88e45210-c179-47a7-b81e-b347f5cba607 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] 10.222.0.43 "GET /compute/v2.1/servers/b28a95a5-c6c2-4781-8c1a-62e7d3eac5a7" status: 200 len: 1317 microversion: 2.1 time: 0.326446 Oct 04 18:44:42.592336 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1685/3195] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:42 2022] GET /compute/v2.1/servers/b28a95a5-c6c2-4781-8c1a-62e7d3eac5a7 => generated 1317 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:42.774241 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-92664b56-c118-4ef1-b147-38e25b0a573b tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:42.774857 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-92664b56-c118-4ef1-b147-38e25b0a573b tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] [instance: cf78a645-458e-4dc2-a60d-a51754ab6258] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:42.785024 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-92664b56-c118-4ef1-b147-38e25b0a573b tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:42.785838 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-92664b56-c118-4ef1-b147-38e25b0a573b tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:42.786449 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-92664b56-c118-4ef1-b147-38e25b0a573b tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:42.788158 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-92664b56-c118-4ef1-b147-38e25b0a573b tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:42.789146 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-92664b56-c118-4ef1-b147-38e25b0a573b tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:42.789733 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-92664b56-c118-4ef1-b147-38e25b0a573b tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:43.071452 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-92664b56-c118-4ef1-b147-38e25b0a573b tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608fc9ed7cdb487c9bf4b783c26ceeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29876d6805924df882d6861b0f6ab4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:43.078881 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-b4b29240-d647-4714-bad4-629e068f7150 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:43.094751 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-b4b29240-d647-4714-bad4-629e068f7150 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5" status: 200 len: 1667 microversion: 2.1 time: 1.033323 Oct 04 18:44:43.098890 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1511/3196] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:42 2022] GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5 => generated 1667 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:43.114541 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-eef4ebad-92aa-4070-a009-4511d0a7a166 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:43.115601 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-92664b56-c118-4ef1-b147-38e25b0a573b tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] 10.222.0.43 "GET /compute/v2.1/servers/cf78a645-458e-4dc2-a60d-a51754ab6258" status: 200 len: 1477 microversion: 2.1 time: 0.345270 Oct 04 18:44:43.116203 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1686/3197] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:42 2022] GET /compute/v2.1/servers/cf78a645-458e-4dc2-a60d-a51754ab6258 => generated 1477 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:43.121685 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-eef4ebad-92aa-4070-a009-4511d0a7a166 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] [instance: 15541ec9-3112-4adc-9fad-6d20a88f2c09] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:43.127142 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-a5037f91-ed47-4a98-8d48-bb45e2a76477 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:44:43.132636 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-a5037f91-ed47-4a98-8d48-bb45e2a76477 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 82b86465-afb0-49ef-9932-1538010c1ae5] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:43.140816 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a5037f91-ed47-4a98-8d48-bb45e2a76477 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:43.141605 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a5037f91-ed47-4a98-8d48-bb45e2a76477 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:43.142044 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-eef4ebad-92aa-4070-a009-4511d0a7a166 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:43.142651 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-eef4ebad-92aa-4070-a009-4511d0a7a166 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:43.146936 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-eef4ebad-92aa-4070-a009-4511d0a7a166 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:43.149025 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a5037f91-ed47-4a98-8d48-bb45e2a76477 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:43.150070 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a5037f91-ed47-4a98-8d48-bb45e2a76477 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:43.153087 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-eef4ebad-92aa-4070-a009-4511d0a7a166 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:43.153674 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-eef4ebad-92aa-4070-a009-4511d0a7a166 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:43.153863 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a5037f91-ed47-4a98-8d48-bb45e2a76477 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:43.154341 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a5037f91-ed47-4a98-8d48-bb45e2a76477 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:43.157968 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-eef4ebad-92aa-4070-a009-4511d0a7a166 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:43.254853 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-a5037f91-ed47-4a98-8d48-bb45e2a76477 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "POST /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5/action" status: 200 len: 322 microversion: 2.1 time: 0.135911 Oct 04 18:44:43.256190 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1687/3198] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 18:44:43 2022] POST /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5/action => generated 322 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:44:43.267378 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-e3142c1c-7b52-44e1-945f-1de9db8a6bbb req-06d36523-1976-453a-9fa2-292fb473c176 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf78a645-458e-4dc2-a60d-a51754ab6258", "name": "network-vif-unplugged", "status": "completed", "tag": "68b980e1-728c-40ba-bdae-e6a747ef6688"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:44:43.302127 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-e3142c1c-7b52-44e1-945f-1de9db8a6bbb req-06d36523-1976-453a-9fa2-292fb473c176 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:43.306752 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-e3142c1c-7b52-44e1-945f-1de9db8a6bbb req-06d36523-1976-453a-9fa2-292fb473c176 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:43.308082 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-e3142c1c-7b52-44e1-945f-1de9db8a6bbb req-06d36523-1976-453a-9fa2-292fb473c176 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:43.337437 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-e3142c1c-7b52-44e1-945f-1de9db8a6bbb req-06d36523-1976-453a-9fa2-292fb473c176 service nova] Creating event network-vif-unplugged:68b980e1-728c-40ba-bdae-e6a747ef6688 for instance cf78a645-458e-4dc2-a60d-a51754ab6258 on n-h2-851028-13 Oct 04 18:44:43.351127 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-e3142c1c-7b52-44e1-945f-1de9db8a6bbb req-06d36523-1976-453a-9fa2-292fb473c176 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.087779 Oct 04 18:44:43.354769 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1688/3199] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:44:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:44:43.385674 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-afe68b8f-a107-42d2-90f8-07f9744a5df2 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:43.386980 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-afe68b8f-a107-42d2-90f8-07f9744a5df2 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 82b86465-afb0-49ef-9932-1538010c1ae5] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:43.413793 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-afe68b8f-a107-42d2-90f8-07f9744a5df2 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:43.414304 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-afe68b8f-a107-42d2-90f8-07f9744a5df2 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:43.414809 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-afe68b8f-a107-42d2-90f8-07f9744a5df2 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:43.415568 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-afe68b8f-a107-42d2-90f8-07f9744a5df2 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:43.426398 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-afe68b8f-a107-42d2-90f8-07f9744a5df2 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:43.426398 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-afe68b8f-a107-42d2-90f8-07f9744a5df2 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:43.548916 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-eef4ebad-92aa-4070-a009-4511d0a7a166 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96e7480de94c43909045ac1087e40cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6bd34bf5540ee95c8144f185eb22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:43.565804 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-eef4ebad-92aa-4070-a009-4511d0a7a166 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] 10.222.0.43 "GET /compute/v2.1/servers/15541ec9-3112-4adc-9fad-6d20a88f2c09" status: 200 len: 1370 microversion: 2.1 time: 0.465362 Oct 04 18:44:43.566399 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1512/3200] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:43 2022] GET /compute/v2.1/servers/15541ec9-3112-4adc-9fad-6d20a88f2c09 => generated 1370 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:43.602974 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-6fdcbef4-93b1-4291-9063-c176466dfb2d tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:43.603595 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-6fdcbef4-93b1-4291-9063-c176466dfb2d tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] [instance: b28a95a5-c6c2-4781-8c1a-62e7d3eac5a7] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:43.613597 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6fdcbef4-93b1-4291-9063-c176466dfb2d tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:43.614080 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6fdcbef4-93b1-4291-9063-c176466dfb2d tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:43.617881 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6fdcbef4-93b1-4291-9063-c176466dfb2d tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:43.618714 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6fdcbef4-93b1-4291-9063-c176466dfb2d tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:43.619234 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6fdcbef4-93b1-4291-9063-c176466dfb2d tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:43.619632 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6fdcbef4-93b1-4291-9063-c176466dfb2d tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:43.717367 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-afe68b8f-a107-42d2-90f8-07f9744a5df2 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:43.732343 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-afe68b8f-a107-42d2-90f8-07f9744a5df2 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5" status: 200 len: 1667 microversion: 2.1 time: 0.374790 Oct 04 18:44:43.733311 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1689/3201] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:43 2022] GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5 => generated 1667 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:43.765265 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-8f9c7e70-b358-469e-95bb-c328e217b4f4 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:43.765783 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-8f9c7e70-b358-469e-95bb-c328e217b4f4 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 82b86465-afb0-49ef-9932-1538010c1ae5] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:43.779728 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8f9c7e70-b358-469e-95bb-c328e217b4f4 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:43.780240 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8f9c7e70-b358-469e-95bb-c328e217b4f4 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:43.780675 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8f9c7e70-b358-469e-95bb-c328e217b4f4 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:43.781604 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8f9c7e70-b358-469e-95bb-c328e217b4f4 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:43.782401 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8f9c7e70-b358-469e-95bb-c328e217b4f4 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:43.783015 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8f9c7e70-b358-469e-95bb-c328e217b4f4 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:44.042339 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-8f9c7e70-b358-469e-95bb-c328e217b4f4 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:44.056645 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-8f9c7e70-b358-469e-95bb-c328e217b4f4 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5" status: 200 len: 1667 microversion: 2.1 time: 0.291878 Oct 04 18:44:44.057775 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1690/3202] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:43 2022] GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5 => generated 1667 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:44.083234 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-60b2852a-b25d-43da-9e9d-bb366662eb2f tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:44.084011 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-60b2852a-b25d-43da-9e9d-bb366662eb2f tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 82b86465-afb0-49ef-9932-1538010c1ae5] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:44.097604 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-60b2852a-b25d-43da-9e9d-bb366662eb2f tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:44.098601 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-60b2852a-b25d-43da-9e9d-bb366662eb2f tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:44.099355 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-60b2852a-b25d-43da-9e9d-bb366662eb2f tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:44.100276 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-60b2852a-b25d-43da-9e9d-bb366662eb2f tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:44.101889 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-60b2852a-b25d-43da-9e9d-bb366662eb2f tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:44.103441 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-60b2852a-b25d-43da-9e9d-bb366662eb2f tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:44.406803 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-60b2852a-b25d-43da-9e9d-bb366662eb2f tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:44.435318 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-60b2852a-b25d-43da-9e9d-bb366662eb2f tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5" status: 200 len: 1667 microversion: 2.1 time: 0.354582 Oct 04 18:44:44.438331 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1691/3203] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:44 2022] GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5 => generated 1667 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:44:44.449011 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-bca73b75-6c0a-447d-9dd5-b8c054146aae tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:44.450733 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-bca73b75-6c0a-447d-9dd5-b8c054146aae tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] [instance: cf78a645-458e-4dc2-a60d-a51754ab6258] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:44.464610 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bca73b75-6c0a-447d-9dd5-b8c054146aae tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:44.467279 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bca73b75-6c0a-447d-9dd5-b8c054146aae tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:44.469912 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bca73b75-6c0a-447d-9dd5-b8c054146aae tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:44.470614 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bca73b75-6c0a-447d-9dd5-b8c054146aae tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:44.471080 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bca73b75-6c0a-447d-9dd5-b8c054146aae tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:44.471514 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bca73b75-6c0a-447d-9dd5-b8c054146aae tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:44.862139 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-6fdcbef4-93b1-4291-9063-c176466dfb2d tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c710f394164b89b16bcac2fe51c58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65037d4ea5124d749e42928032e803fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:44.899002 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-6fdcbef4-93b1-4291-9063-c176466dfb2d tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] 10.222.0.43 "GET /compute/v2.1/servers/b28a95a5-c6c2-4781-8c1a-62e7d3eac5a7" status: 200 len: 1317 microversion: 2.1 time: 1.298195 Oct 04 18:44:44.902854 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1513/3204] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:43 2022] GET /compute/v2.1/servers/b28a95a5-c6c2-4781-8c1a-62e7d3eac5a7 => generated 1317 bytes in 1305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:44:44.922810 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-e83d9741-e26c-4f06-a0c1-f5f763e0882a tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:44.925092 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-e83d9741-e26c-4f06-a0c1-f5f763e0882a tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 82b86465-afb0-49ef-9932-1538010c1ae5] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:44.931344 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-bca73b75-6c0a-447d-9dd5-b8c054146aae tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608fc9ed7cdb487c9bf4b783c26ceeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29876d6805924df882d6861b0f6ab4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:44.943243 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e83d9741-e26c-4f06-a0c1-f5f763e0882a tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:44.946468 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e83d9741-e26c-4f06-a0c1-f5f763e0882a tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:44.949295 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e83d9741-e26c-4f06-a0c1-f5f763e0882a tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:44.950476 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e83d9741-e26c-4f06-a0c1-f5f763e0882a tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:44.953830 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e83d9741-e26c-4f06-a0c1-f5f763e0882a tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:44.954157 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-bca73b75-6c0a-447d-9dd5-b8c054146aae tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] 10.222.0.43 "GET /compute/v2.1/servers/cf78a645-458e-4dc2-a60d-a51754ab6258" status: 200 len: 1477 microversion: 2.1 time: 0.514089 Oct 04 18:44:44.954896 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1692/3205] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:44 2022] GET /compute/v2.1/servers/cf78a645-458e-4dc2-a60d-a51754ab6258 => generated 1477 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:44.956167 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e83d9741-e26c-4f06-a0c1-f5f763e0882a tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:44.978386 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-4204b7f9-4c61-4dd7-bf2f-2c85b9db5811 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:44.990203 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-4204b7f9-4c61-4dd7-bf2f-2c85b9db5811 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] [instance: 15541ec9-3112-4adc-9fad-6d20a88f2c09] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:45.006046 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4204b7f9-4c61-4dd7-bf2f-2c85b9db5811 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:45.007420 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4204b7f9-4c61-4dd7-bf2f-2c85b9db5811 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:45.010893 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4204b7f9-4c61-4dd7-bf2f-2c85b9db5811 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:45.018345 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4204b7f9-4c61-4dd7-bf2f-2c85b9db5811 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:45.018850 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4204b7f9-4c61-4dd7-bf2f-2c85b9db5811 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:45.020986 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4204b7f9-4c61-4dd7-bf2f-2c85b9db5811 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:45.309751 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-4204b7f9-4c61-4dd7-bf2f-2c85b9db5811 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96e7480de94c43909045ac1087e40cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6bd34bf5540ee95c8144f185eb22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:45.318924 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-4204b7f9-4c61-4dd7-bf2f-2c85b9db5811 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] 10.222.0.43 "GET /compute/v2.1/servers/15541ec9-3112-4adc-9fad-6d20a88f2c09" status: 200 len: 1564 microversion: 2.1 time: 0.347497 Oct 04 18:44:45.321166 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1693/3206] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:44 2022] GET /compute/v2.1/servers/15541ec9-3112-4adc-9fad-6d20a88f2c09 => generated 1564 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:45.344197 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-45cd1a5f-c6d3-464e-8171-137d567803bf tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:45.345233 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-45cd1a5f-c6d3-464e-8171-137d567803bf tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] [instance: 15541ec9-3112-4adc-9fad-6d20a88f2c09] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:45.354246 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-45cd1a5f-c6d3-464e-8171-137d567803bf tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:45.355207 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-45cd1a5f-c6d3-464e-8171-137d567803bf tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:45.355916 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-45cd1a5f-c6d3-464e-8171-137d567803bf tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:45.357036 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-45cd1a5f-c6d3-464e-8171-137d567803bf tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:45.357800 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-45cd1a5f-c6d3-464e-8171-137d567803bf tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:45.358514 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-45cd1a5f-c6d3-464e-8171-137d567803bf tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:45.460746 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-e83d9741-e26c-4f06-a0c1-f5f763e0882a tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:45.474253 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-e83d9741-e26c-4f06-a0c1-f5f763e0882a tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5" status: 200 len: 1667 microversion: 2.1 time: 0.568413 Oct 04 18:44:45.482005 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1514/3207] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:44 2022] GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5 => generated 1667 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:45.548617 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-45cd1a5f-c6d3-464e-8171-137d567803bf tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] 10.222.0.43 "GET /compute/v2.1/servers/15541ec9-3112-4adc-9fad-6d20a88f2c09/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.209532 Oct 04 18:44:45.557528 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1694/3208] 10.222.0.43 () {58 vars in 1275 bytes} [Tue Oct 4 18:44:45 2022] GET /compute/v2.1/servers/15541ec9-3112-4adc-9fad-6d20a88f2c09/os-interface => generated 285 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:44:45.666494 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-4e8d4f44-aeed-4e5c-9065-0f75527685d5 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1521176085", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452", "networks": [{"uuid": "4c7a4f44-d147-4a8b-8217-07c763ce3b07"}]}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:44:45.828041 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.network.neutron [None req-4e8d4f44-aeed-4e5c-9065-0f75527685d5 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] validate_networks() for [('4c7a4f44-d147-4a8b-8217-07c763ce3b07', None, None, None, None, None)] {{(pid=123595) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:44:45.931161 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f5d6e508-7c0f-400e-b72f-355b77025c73 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:45.931788 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-f5d6e508-7c0f-400e-b72f-355b77025c73 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] [instance: b28a95a5-c6c2-4781-8c1a-62e7d3eac5a7] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:45.955002 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f5d6e508-7c0f-400e-b72f-355b77025c73 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:45.955801 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f5d6e508-7c0f-400e-b72f-355b77025c73 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:45.956428 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f5d6e508-7c0f-400e-b72f-355b77025c73 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:45.957438 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f5d6e508-7c0f-400e-b72f-355b77025c73 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:45.958061 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f5d6e508-7c0f-400e-b72f-355b77025c73 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:45.958669 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f5d6e508-7c0f-400e-b72f-355b77025c73 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:46.812621 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-f5d6e508-7c0f-400e-b72f-355b77025c73 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c710f394164b89b16bcac2fe51c58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65037d4ea5124d749e42928032e803fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:46.821216 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-f5d6e508-7c0f-400e-b72f-355b77025c73 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] 10.222.0.43 "GET /compute/v2.1/servers/b28a95a5-c6c2-4781-8c1a-62e7d3eac5a7" status: 200 len: 1317 microversion: 2.1 time: 0.893816 Oct 04 18:44:46.824674 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1695/3209] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:45 2022] GET /compute/v2.1/servers/b28a95a5-c6c2-4781-8c1a-62e7d3eac5a7 => generated 1317 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:46.835584 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-8d66807c-83c6-4e13-9aff-7ac9b0900656 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:46.836222 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-8d66807c-83c6-4e13-9aff-7ac9b0900656 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] [instance: cf78a645-458e-4dc2-a60d-a51754ab6258] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:46.848681 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8d66807c-83c6-4e13-9aff-7ac9b0900656 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:46.849219 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8d66807c-83c6-4e13-9aff-7ac9b0900656 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:46.849681 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8d66807c-83c6-4e13-9aff-7ac9b0900656 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:46.850921 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8d66807c-83c6-4e13-9aff-7ac9b0900656 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:46.851398 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8d66807c-83c6-4e13-9aff-7ac9b0900656 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:46.852066 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8d66807c-83c6-4e13-9aff-7ac9b0900656 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:47.218871 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-8d66807c-83c6-4e13-9aff-7ac9b0900656 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608fc9ed7cdb487c9bf4b783c26ceeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29876d6805924df882d6861b0f6ab4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:47.247245 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-8d66807c-83c6-4e13-9aff-7ac9b0900656 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] 10.222.0.43 "GET /compute/v2.1/servers/cf78a645-458e-4dc2-a60d-a51754ab6258" status: 200 len: 1477 microversion: 2.1 time: 0.421187 Oct 04 18:44:47.248210 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1696/3210] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:46 2022] GET /compute/v2.1/servers/cf78a645-458e-4dc2-a60d-a51754ab6258 => generated 1477 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:47.259624 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-918c490d-3a69-4e58-8e1f-3ff5cdf1cb27 req-878a6821-8e7e-4be1-aee2-d0230d34f0f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf78a645-458e-4dc2-a60d-a51754ab6258", "name": "network-vif-plugged", "status": "completed", "tag": "68b980e1-728c-40ba-bdae-e6a747ef6688"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:44:47.289535 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-918c490d-3a69-4e58-8e1f-3ff5cdf1cb27 req-878a6821-8e7e-4be1-aee2-d0230d34f0f1 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:47.290029 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-918c490d-3a69-4e58-8e1f-3ff5cdf1cb27 req-878a6821-8e7e-4be1-aee2-d0230d34f0f1 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:47.290477 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-918c490d-3a69-4e58-8e1f-3ff5cdf1cb27 req-878a6821-8e7e-4be1-aee2-d0230d34f0f1 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:47.309171 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-918c490d-3a69-4e58-8e1f-3ff5cdf1cb27 req-878a6821-8e7e-4be1-aee2-d0230d34f0f1 service nova] Creating event network-vif-plugged:68b980e1-728c-40ba-bdae-e6a747ef6688 for instance cf78a645-458e-4dc2-a60d-a51754ab6258 on n-h2-851028-13 Oct 04 18:44:47.317695 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-918c490d-3a69-4e58-8e1f-3ff5cdf1cb27 req-878a6821-8e7e-4be1-aee2-d0230d34f0f1 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067680 Oct 04 18:44:47.319340 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1697/3211] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:44:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:44:47.845807 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-65beb661-3054-4bca-8bb2-194dd5a2f001 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:47.846461 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-65beb661-3054-4bca-8bb2-194dd5a2f001 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] [instance: b28a95a5-c6c2-4781-8c1a-62e7d3eac5a7] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:47.858743 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-65beb661-3054-4bca-8bb2-194dd5a2f001 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:47.859475 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-65beb661-3054-4bca-8bb2-194dd5a2f001 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:47.862224 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-65beb661-3054-4bca-8bb2-194dd5a2f001 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:47.864020 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-65beb661-3054-4bca-8bb2-194dd5a2f001 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:47.867223 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-65beb661-3054-4bca-8bb2-194dd5a2f001 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:47.867844 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-65beb661-3054-4bca-8bb2-194dd5a2f001 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:48.103131 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-4e8d4f44-aeed-4e5c-9065-0f75527685d5 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Flavor limits 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:44:48.103660 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-4e8d4f44-aeed-4e5c-9065-0f75527685d5 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Image limits 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:44:48.104044 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-4e8d4f44-aeed-4e5c-9065-0f75527685d5 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Flavor pref 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:44:48.104464 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-4e8d4f44-aeed-4e5c-9065-0f75527685d5 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Image pref 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:44:48.105023 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-4e8d4f44-aeed-4e5c-9065-0f75527685d5 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:44:48.142925 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4e8d4f44-aeed-4e5c-9065-0f75527685d5 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:48.146429 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4e8d4f44-aeed-4e5c-9065-0f75527685d5 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:48.148554 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4e8d4f44-aeed-4e5c-9065-0f75527685d5 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:48.149504 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4e8d4f44-aeed-4e5c-9065-0f75527685d5 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:48.150149 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4e8d4f44-aeed-4e5c-9065-0f75527685d5 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:48.151856 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4e8d4f44-aeed-4e5c-9065-0f75527685d5 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:48.234759 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-4e8d4f44-aeed-4e5c-9065-0f75527685d5 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Getting quotas for project b928ae7385da4599bbe0ea701681b233. Resources: {'ram', 'cores', 'instances'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:44:48.251768 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-4e8d4f44-aeed-4e5c-9065-0f75527685d5 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Getting quotas for user 93c36c0802f4473f96d0721caa50374a and project b928ae7385da4599bbe0ea701681b233. Resources: {'ram', 'cores', 'instances'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:44:48.322862 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-4e8d4f44-aeed-4e5c-9065-0f75527685d5 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Going to run 1 instances... {{(pid=123595) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:44:48.330848 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-4e8d4f44-aeed-4e5c-9065-0f75527685d5 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: d5e2bc9f-76da-4028-9b48-d00a8ae20d33] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e8943ec5-4038-4d4b-b9b9-2415a79f5243',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:44:48.501684 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-4e8d4f44-aeed-4e5c-9065-0f75527685d5 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.839340 Oct 04 18:44:48.507632 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1515/3212] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 18:44:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 2845 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:44:48.520663 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-dba2b467-2577-4e97-a50f-c2c57aa90697 req-37c5aac8-d0a5-49ff-88ce-d250b40f5af7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15541ec9-3112-4adc-9fad-6d20a88f2c09", "tag": "ae7d73fe-313a-45b9-8e8c-91a97a4dd13a"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:44:48.556420 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-dba2b467-2577-4e97-a50f-c2c57aa90697 req-37c5aac8-d0a5-49ff-88ce-d250b40f5af7 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:48.556912 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-dba2b467-2577-4e97-a50f-c2c57aa90697 req-37c5aac8-d0a5-49ff-88ce-d250b40f5af7 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:48.580203 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-dba2b467-2577-4e97-a50f-c2c57aa90697 req-37c5aac8-d0a5-49ff-88ce-d250b40f5af7 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:48.608274 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-dba2b467-2577-4e97-a50f-c2c57aa90697 req-37c5aac8-d0a5-49ff-88ce-d250b40f5af7 service nova] Creating event network-changed:ae7d73fe-313a-45b9-8e8c-91a97a4dd13a for instance 15541ec9-3112-4adc-9fad-6d20a88f2c09 on n-h1-851028-13 Oct 04 18:44:48.625244 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-dba2b467-2577-4e97-a50f-c2c57aa90697 req-37c5aac8-d0a5-49ff-88ce-d250b40f5af7 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115371 Oct 04 18:44:48.629387 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1516/3213] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:44:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:44:48.656140 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-bddaa5d6-5609-417e-90bc-034b161b5182 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:48.656884 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-bddaa5d6-5609-417e-90bc-034b161b5182 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] [instance: cf78a645-458e-4dc2-a60d-a51754ab6258] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:48.670602 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bddaa5d6-5609-417e-90bc-034b161b5182 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:48.677815 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bddaa5d6-5609-417e-90bc-034b161b5182 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:48.679064 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bddaa5d6-5609-417e-90bc-034b161b5182 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:48.680004 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bddaa5d6-5609-417e-90bc-034b161b5182 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:48.685900 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bddaa5d6-5609-417e-90bc-034b161b5182 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:48.686309 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bddaa5d6-5609-417e-90bc-034b161b5182 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:48.745422 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-65beb661-3054-4bca-8bb2-194dd5a2f001 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c710f394164b89b16bcac2fe51c58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65037d4ea5124d749e42928032e803fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:48.755295 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-65beb661-3054-4bca-8bb2-194dd5a2f001 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] 10.222.0.43 "GET /compute/v2.1/servers/b28a95a5-c6c2-4781-8c1a-62e7d3eac5a7" status: 200 len: 1317 microversion: 2.1 time: 0.914752 Oct 04 18:44:48.760006 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1698/3214] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:47 2022] GET /compute/v2.1/servers/b28a95a5-c6c2-4781-8c1a-62e7d3eac5a7 => generated 1317 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:44:48.767872 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-fd41861f-3791-4425-a3ec-92b533865a0b tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:48.771461 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-fd41861f-3791-4425-a3ec-92b533865a0b tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: d5e2bc9f-76da-4028-9b48-d00a8ae20d33] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:48.854710 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=2 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:44:48.878329 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-fd41861f-3791-4425-a3ec-92b533865a0b tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:48.887726 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-fd41861f-3791-4425-a3ec-92b533865a0b tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/d5e2bc9f-76da-4028-9b48-d00a8ae20d33" status: 200 len: 1215 microversion: 2.1 time: 0.125479 Oct 04 18:44:48.901144 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1699/3215] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:48 2022] GET /compute/v2.1/servers/d5e2bc9f-76da-4028-9b48-d00a8ae20d33 => generated 1215 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:49.190397 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-bddaa5d6-5609-417e-90bc-034b161b5182 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608fc9ed7cdb487c9bf4b783c26ceeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29876d6805924df882d6861b0f6ab4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:49.200287 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-bddaa5d6-5609-417e-90bc-034b161b5182 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] 10.222.0.43 "GET /compute/v2.1/servers/cf78a645-458e-4dc2-a60d-a51754ab6258" status: 200 len: 1477 microversion: 2.1 time: 0.569337 Oct 04 18:44:49.200885 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1517/3216] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:48 2022] GET /compute/v2.1/servers/cf78a645-458e-4dc2-a60d-a51754ab6258 => generated 1477 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:49.463405 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-2f915380-805a-40d0-a1da-d5acaf2679c6 req-4f691e9d-c73e-4b25-afec-66dff8728020 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b28a95a5-c6c2-4781-8c1a-62e7d3eac5a7", "name": "network-vif-plugged", "status": "completed", "tag": "f42c238a-1ff4-4b31-8e94-8e0d356f5cfb"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:44:49.472374 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_api:SELECT=100 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:44:49.494940 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-2f915380-805a-40d0-a1da-d5acaf2679c6 req-4f691e9d-c73e-4b25-afec-66dff8728020 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:49.499168 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-2f915380-805a-40d0-a1da-d5acaf2679c6 req-4f691e9d-c73e-4b25-afec-66dff8728020 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:49.501766 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-2f915380-805a-40d0-a1da-d5acaf2679c6 req-4f691e9d-c73e-4b25-afec-66dff8728020 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:49.533932 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-2f915380-805a-40d0-a1da-d5acaf2679c6 req-4f691e9d-c73e-4b25-afec-66dff8728020 service nova] Creating event network-vif-plugged:f42c238a-1ff4-4b31-8e94-8e0d356f5cfb for instance b28a95a5-c6c2-4781-8c1a-62e7d3eac5a7 on n-h2-851028-13 Oct 04 18:44:49.545458 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-2f915380-805a-40d0-a1da-d5acaf2679c6 req-4f691e9d-c73e-4b25-afec-66dff8728020 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087660 Oct 04 18:44:49.548619 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1700/3217] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:44:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:44:49.784156 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-996012bc-03b5-44c6-9eeb-f85b33bff43a tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:49.785198 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-996012bc-03b5-44c6-9eeb-f85b33bff43a tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] [instance: b28a95a5-c6c2-4781-8c1a-62e7d3eac5a7] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:49.801533 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-996012bc-03b5-44c6-9eeb-f85b33bff43a tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:49.802164 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-996012bc-03b5-44c6-9eeb-f85b33bff43a tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:49.803675 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-996012bc-03b5-44c6-9eeb-f85b33bff43a tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:49.807134 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-996012bc-03b5-44c6-9eeb-f85b33bff43a tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:49.809224 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-996012bc-03b5-44c6-9eeb-f85b33bff43a tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:49.809741 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-996012bc-03b5-44c6-9eeb-f85b33bff43a tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:49.917580 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-e232a08f-af0a-4bf1-9c26-9c293f5c9bde tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:49.918389 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-e232a08f-af0a-4bf1-9c26-9c293f5c9bde tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: d5e2bc9f-76da-4028-9b48-d00a8ae20d33] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:49.943259 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e232a08f-af0a-4bf1-9c26-9c293f5c9bde tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:49.945550 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e232a08f-af0a-4bf1-9c26-9c293f5c9bde tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:49.947483 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e232a08f-af0a-4bf1-9c26-9c293f5c9bde tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:49.949363 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e232a08f-af0a-4bf1-9c26-9c293f5c9bde tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:49.951199 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e232a08f-af0a-4bf1-9c26-9c293f5c9bde tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:49.952304 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e232a08f-af0a-4bf1-9c26-9c293f5c9bde tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:50.154150 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-e232a08f-af0a-4bf1-9c26-9c293f5c9bde tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:50.170721 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-e232a08f-af0a-4bf1-9c26-9c293f5c9bde tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/d5e2bc9f-76da-4028-9b48-d00a8ae20d33" status: 200 len: 1267 microversion: 2.1 time: 0.257434 Oct 04 18:44:50.172393 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1701/3218] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:49 2022] GET /compute/v2.1/servers/d5e2bc9f-76da-4028-9b48-d00a8ae20d33 => generated 1267 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:44:50.230846 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-b591e0b4-ade4-4009-b1e4-db191bae4dee tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:50.231987 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-b591e0b4-ade4-4009-b1e4-db191bae4dee tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] [instance: cf78a645-458e-4dc2-a60d-a51754ab6258] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:50.240999 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b591e0b4-ade4-4009-b1e4-db191bae4dee tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:50.241838 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b591e0b4-ade4-4009-b1e4-db191bae4dee tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:50.242698 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b591e0b4-ade4-4009-b1e4-db191bae4dee tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:50.243959 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b591e0b4-ade4-4009-b1e4-db191bae4dee tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:50.244762 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b591e0b4-ade4-4009-b1e4-db191bae4dee tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:50.245536 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b591e0b4-ade4-4009-b1e4-db191bae4dee tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:50.253589 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:44:50.512930 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-b591e0b4-ade4-4009-b1e4-db191bae4dee tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608fc9ed7cdb487c9bf4b783c26ceeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29876d6805924df882d6861b0f6ab4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:50.528706 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-b591e0b4-ade4-4009-b1e4-db191bae4dee tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] 10.222.0.43 "GET /compute/v2.1/servers/cf78a645-458e-4dc2-a60d-a51754ab6258" status: 200 len: 1463 microversion: 2.1 time: 0.304901 Oct 04 18:44:50.532888 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1702/3219] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:50 2022] GET /compute/v2.1/servers/cf78a645-458e-4dc2-a60d-a51754ab6258 => generated 1463 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:50.566859 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-2e844f19-9414-46cb-9fe1-4ae692805e5a tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:50.567722 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-2e844f19-9414-46cb-9fe1-4ae692805e5a tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] [instance: cf78a645-458e-4dc2-a60d-a51754ab6258] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:50.575720 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2e844f19-9414-46cb-9fe1-4ae692805e5a tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:50.576495 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2e844f19-9414-46cb-9fe1-4ae692805e5a tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:50.577218 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2e844f19-9414-46cb-9fe1-4ae692805e5a tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:50.578103 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2e844f19-9414-46cb-9fe1-4ae692805e5a tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:50.578909 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2e844f19-9414-46cb-9fe1-4ae692805e5a tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:50.579999 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2e844f19-9414-46cb-9fe1-4ae692805e5a tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:50.843571 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-2e844f19-9414-46cb-9fe1-4ae692805e5a tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608fc9ed7cdb487c9bf4b783c26ceeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29876d6805924df882d6861b0f6ab4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:50.855834 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-2e844f19-9414-46cb-9fe1-4ae692805e5a tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] 10.222.0.43 "GET /compute/v2.1/servers/cf78a645-458e-4dc2-a60d-a51754ab6258" status: 200 len: 1463 microversion: 2.1 time: 0.301488 Oct 04 18:44:50.865210 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1703/3220] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:50 2022] GET /compute/v2.1/servers/cf78a645-458e-4dc2-a60d-a51754ab6258 => generated 1463 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:44:50.883985 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-920191a2-6a85-4541-9666-7296f5777da7 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243"}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:44:50.886905 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-920191a2-6a85-4541-9666-7296f5777da7 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] [instance: cf78a645-458e-4dc2-a60d-a51754ab6258] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:50.904836 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-920191a2-6a85-4541-9666-7296f5777da7 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:50.905657 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-920191a2-6a85-4541-9666-7296f5777da7 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:50.906272 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-920191a2-6a85-4541-9666-7296f5777da7 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:50.907229 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-920191a2-6a85-4541-9666-7296f5777da7 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:50.907976 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-920191a2-6a85-4541-9666-7296f5777da7 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:50.908299 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-920191a2-6a85-4541-9666-7296f5777da7 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:51.101070 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-920191a2-6a85-4541-9666-7296f5777da7 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Flavor limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:44:51.102256 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-920191a2-6a85-4541-9666-7296f5777da7 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Image limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:44:51.102907 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-920191a2-6a85-4541-9666-7296f5777da7 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Flavor pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:44:51.103505 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-920191a2-6a85-4541-9666-7296f5777da7 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Image pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:44:51.104098 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-920191a2-6a85-4541-9666-7296f5777da7 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:44:51.185467 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-996012bc-03b5-44c6-9eeb-f85b33bff43a tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c710f394164b89b16bcac2fe51c58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65037d4ea5124d749e42928032e803fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:51.203117 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-996012bc-03b5-44c6-9eeb-f85b33bff43a tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] 10.222.0.43 "GET /compute/v2.1/servers/b28a95a5-c6c2-4781-8c1a-62e7d3eac5a7" status: 200 len: 1317 microversion: 2.1 time: 1.417125 Oct 04 18:44:51.203944 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1518/3221] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:49 2022] GET /compute/v2.1/servers/b28a95a5-c6c2-4781-8c1a-62e7d3eac5a7 => generated 1317 bytes in 1425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:51.211126 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-bbe23339-0f09-4c98-b299-4b52beafa2eb tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:51.214250 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-bbe23339-0f09-4c98-b299-4b52beafa2eb tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: d5e2bc9f-76da-4028-9b48-d00a8ae20d33] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:51.223459 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bbe23339-0f09-4c98-b299-4b52beafa2eb tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:51.224262 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bbe23339-0f09-4c98-b299-4b52beafa2eb tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:51.224894 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bbe23339-0f09-4c98-b299-4b52beafa2eb tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:51.226453 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bbe23339-0f09-4c98-b299-4b52beafa2eb tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:51.227681 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bbe23339-0f09-4c98-b299-4b52beafa2eb tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:51.228325 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bbe23339-0f09-4c98-b299-4b52beafa2eb tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:51.238288 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-920191a2-6a85-4541-9666-7296f5777da7 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] [instance: cf78a645-458e-4dc2-a60d-a51754ab6258] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:51.247637 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-920191a2-6a85-4541-9666-7296f5777da7 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:51.248394 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-920191a2-6a85-4541-9666-7296f5777da7 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:51.249021 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-920191a2-6a85-4541-9666-7296f5777da7 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:51.249916 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-920191a2-6a85-4541-9666-7296f5777da7 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:51.250824 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-920191a2-6a85-4541-9666-7296f5777da7 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:51.251411 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-920191a2-6a85-4541-9666-7296f5777da7 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:51.325402 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-920191a2-6a85-4541-9666-7296f5777da7 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] 10.222.0.43 "POST /compute/v2.1/servers/cf78a645-458e-4dc2-a60d-a51754ab6258/action" status: 202 len: 1067 microversion: 2.1 time: 0.444898 Oct 04 18:44:51.327552 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1704/3222] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 18:44:50 2022] POST /compute/v2.1/servers/cf78a645-458e-4dc2-a60d-a51754ab6258/action => generated 1067 bytes in 449 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Oct 04 18:44:51.360199 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-8c582f52-77f0-4f05-86c5-c51dd1f5cc14 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:51.363147 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-8c582f52-77f0-4f05-86c5-c51dd1f5cc14 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] [instance: cf78a645-458e-4dc2-a60d-a51754ab6258] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:51.382127 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8c582f52-77f0-4f05-86c5-c51dd1f5cc14 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:51.384760 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8c582f52-77f0-4f05-86c5-c51dd1f5cc14 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:51.386988 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8c582f52-77f0-4f05-86c5-c51dd1f5cc14 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:51.388547 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8c582f52-77f0-4f05-86c5-c51dd1f5cc14 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:51.389414 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8c582f52-77f0-4f05-86c5-c51dd1f5cc14 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:51.402840 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8c582f52-77f0-4f05-86c5-c51dd1f5cc14 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:51.452860 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-bbe23339-0f09-4c98-b299-4b52beafa2eb tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:51.479521 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-bbe23339-0f09-4c98-b299-4b52beafa2eb tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/d5e2bc9f-76da-4028-9b48-d00a8ae20d33" status: 200 len: 1273 microversion: 2.1 time: 0.272276 Oct 04 18:44:51.482320 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1519/3223] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:51 2022] GET /compute/v2.1/servers/d5e2bc9f-76da-4028-9b48-d00a8ae20d33 => generated 1273 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:51.722647 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-8c582f52-77f0-4f05-86c5-c51dd1f5cc14 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608fc9ed7cdb487c9bf4b783c26ceeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29876d6805924df882d6861b0f6ab4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:51.743080 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-8c582f52-77f0-4f05-86c5-c51dd1f5cc14 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] 10.222.0.43 "GET /compute/v2.1/servers/cf78a645-458e-4dc2-a60d-a51754ab6258" status: 200 len: 1472 microversion: 2.1 time: 0.395849 Oct 04 18:44:51.744037 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1705/3224] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:51 2022] GET /compute/v2.1/servers/cf78a645-458e-4dc2-a60d-a51754ab6258 => generated 1472 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:52.228653 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-a7938180-d8a2-40a0-86e3-1869b2ac68a8 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:52.230077 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-a7938180-d8a2-40a0-86e3-1869b2ac68a8 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] [instance: b28a95a5-c6c2-4781-8c1a-62e7d3eac5a7] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:52.246773 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a7938180-d8a2-40a0-86e3-1869b2ac68a8 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:52.247899 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a7938180-d8a2-40a0-86e3-1869b2ac68a8 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:52.248365 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a7938180-d8a2-40a0-86e3-1869b2ac68a8 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:52.251451 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a7938180-d8a2-40a0-86e3-1869b2ac68a8 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:52.253735 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a7938180-d8a2-40a0-86e3-1869b2ac68a8 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:52.254304 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a7938180-d8a2-40a0-86e3-1869b2ac68a8 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:52.506289 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-b662fab5-460a-43a2-b27b-1e9966fd77d4 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:52.506912 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-b662fab5-460a-43a2-b27b-1e9966fd77d4 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: d5e2bc9f-76da-4028-9b48-d00a8ae20d33] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:52.519138 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b662fab5-460a-43a2-b27b-1e9966fd77d4 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:52.519633 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b662fab5-460a-43a2-b27b-1e9966fd77d4 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:52.520081 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b662fab5-460a-43a2-b27b-1e9966fd77d4 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:52.520809 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b662fab5-460a-43a2-b27b-1e9966fd77d4 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:52.527078 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b662fab5-460a-43a2-b27b-1e9966fd77d4 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:52.527902 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b662fab5-460a-43a2-b27b-1e9966fd77d4 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:52.669024 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-b662fab5-460a-43a2-b27b-1e9966fd77d4 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:52.681584 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-b662fab5-460a-43a2-b27b-1e9966fd77d4 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/d5e2bc9f-76da-4028-9b48-d00a8ae20d33" status: 200 len: 1273 microversion: 2.1 time: 0.179569 Oct 04 18:44:52.682194 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1706/3225] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:52 2022] GET /compute/v2.1/servers/d5e2bc9f-76da-4028-9b48-d00a8ae20d33 => generated 1273 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:52.770831 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-4f275bb8-1e65-4986-80e0-228e2ac710bd tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:52.771909 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-4f275bb8-1e65-4986-80e0-228e2ac710bd tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] [instance: cf78a645-458e-4dc2-a60d-a51754ab6258] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:52.784649 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4f275bb8-1e65-4986-80e0-228e2ac710bd tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:52.785225 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4f275bb8-1e65-4986-80e0-228e2ac710bd tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:52.785676 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4f275bb8-1e65-4986-80e0-228e2ac710bd tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:52.786395 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4f275bb8-1e65-4986-80e0-228e2ac710bd tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:52.786853 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4f275bb8-1e65-4986-80e0-228e2ac710bd tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:52.790328 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4f275bb8-1e65-4986-80e0-228e2ac710bd tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:52.993139 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-a7938180-d8a2-40a0-86e3-1869b2ac68a8 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c710f394164b89b16bcac2fe51c58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65037d4ea5124d749e42928032e803fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:53.009899 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-a7938180-d8a2-40a0-86e3-1869b2ac68a8 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] 10.222.0.43 "GET /compute/v2.1/servers/b28a95a5-c6c2-4781-8c1a-62e7d3eac5a7" status: 200 len: 1317 microversion: 2.1 time: 0.786491 Oct 04 18:44:53.016960 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1520/3226] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:52 2022] GET /compute/v2.1/servers/b28a95a5-c6c2-4781-8c1a-62e7d3eac5a7 => generated 1317 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:53.175311 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-4f275bb8-1e65-4986-80e0-228e2ac710bd tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608fc9ed7cdb487c9bf4b783c26ceeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29876d6805924df882d6861b0f6ab4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:53.188523 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-4f275bb8-1e65-4986-80e0-228e2ac710bd tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] 10.222.0.43 "GET /compute/v2.1/servers/cf78a645-458e-4dc2-a60d-a51754ab6258" status: 200 len: 1472 microversion: 2.1 time: 0.420985 Oct 04 18:44:53.203732 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1707/3227] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:52 2022] GET /compute/v2.1/servers/cf78a645-458e-4dc2-a60d-a51754ab6258 => generated 1472 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:53.514688 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-a08ac990-a777-4fd7-8c4e-40bf4b18918d tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Action: 'create', calling method: .version_select at 0x7fb21ecd3040>, body: {"keypair": {"name": "tempest-keypair-1847053334", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIxImZDOwT0SXWVsnbL36Pk9l2j4MN7lRt9zZuKJR5Bxrksx/GE1r0H1pRXR9oieeHI7/r3dc3j5PDFLSwmgZQMU+KoR+25Rgw6eMEZXPGYtTheIxw7R8in4jgw3UwGohg=="}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:44:53.584161 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-a08ac990-a777-4fd7-8c4e-40bf4b18918d tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Getting quotas for project ff3c3dc76405401baf72fe00c5d50b56. Resources: {'key_pairs'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:44:53.599552 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-a08ac990-a777-4fd7-8c4e-40bf4b18918d tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Getting quotas for user a116f2d9656548458264cc4fb1934c18 and project ff3c3dc76405401baf72fe00c5d50b56. Resources: {'key_pairs'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:44:53.666004 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-a08ac990-a777-4fd7-8c4e-40bf4b18918d tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.402518 Oct 04 18:44:53.675858 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1521/3228] 10.222.0.43 () {60 vars in 1159 bytes} [Tue Oct 4 18:44:53 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:44:53.705658 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-6857fa92-5a26-4e6b-8390-b6b1984da623 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:53.707104 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-6857fa92-5a26-4e6b-8390-b6b1984da623 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: d5e2bc9f-76da-4028-9b48-d00a8ae20d33] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:53.721206 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6857fa92-5a26-4e6b-8390-b6b1984da623 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:53.721797 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6857fa92-5a26-4e6b-8390-b6b1984da623 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:53.722156 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6857fa92-5a26-4e6b-8390-b6b1984da623 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:53.722876 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6857fa92-5a26-4e6b-8390-b6b1984da623 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:53.723324 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6857fa92-5a26-4e6b-8390-b6b1984da623 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:53.723755 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6857fa92-5a26-4e6b-8390-b6b1984da623 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:54.040036 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-d1b02ff9-d242-4c39-be7e-c651033bb5cf tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:54.042085 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-d1b02ff9-d242-4c39-be7e-c651033bb5cf tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] [instance: b28a95a5-c6c2-4781-8c1a-62e7d3eac5a7] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:54.070310 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d1b02ff9-d242-4c39-be7e-c651033bb5cf tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:54.072768 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d1b02ff9-d242-4c39-be7e-c651033bb5cf tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:54.073645 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d1b02ff9-d242-4c39-be7e-c651033bb5cf tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:54.075012 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d1b02ff9-d242-4c39-be7e-c651033bb5cf tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:54.078798 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d1b02ff9-d242-4c39-be7e-c651033bb5cf tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:54.081909 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d1b02ff9-d242-4c39-be7e-c651033bb5cf tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:54.429418 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-6857fa92-5a26-4e6b-8390-b6b1984da623 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:54.474610 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-6857fa92-5a26-4e6b-8390-b6b1984da623 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/d5e2bc9f-76da-4028-9b48-d00a8ae20d33" status: 200 len: 1315 microversion: 2.1 time: 0.773993 Oct 04 18:44:54.485892 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1708/3229] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:53 2022] GET /compute/v2.1/servers/d5e2bc9f-76da-4028-9b48-d00a8ae20d33 => generated 1315 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:54.495381 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-39fd8672-593f-42ed-983f-cce7cb13d93c tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:54.507446 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-39fd8672-593f-42ed-983f-cce7cb13d93c tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] [instance: cf78a645-458e-4dc2-a60d-a51754ab6258] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:54.535019 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-39fd8672-593f-42ed-983f-cce7cb13d93c tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:54.535906 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-39fd8672-593f-42ed-983f-cce7cb13d93c tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:54.536521 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-39fd8672-593f-42ed-983f-cce7cb13d93c tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:54.541386 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-39fd8672-593f-42ed-983f-cce7cb13d93c tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:54.541857 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-39fd8672-593f-42ed-983f-cce7cb13d93c tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:54.542335 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-39fd8672-593f-42ed-983f-cce7cb13d93c tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:54.665474 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-d1b02ff9-d242-4c39-be7e-c651033bb5cf tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c710f394164b89b16bcac2fe51c58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65037d4ea5124d749e42928032e803fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:54.681006 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-d1b02ff9-d242-4c39-be7e-c651033bb5cf tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] 10.222.0.43 "GET /compute/v2.1/servers/b28a95a5-c6c2-4781-8c1a-62e7d3eac5a7" status: 200 len: 1507 microversion: 2.1 time: 0.646483 Oct 04 18:44:54.682561 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1522/3230] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:54 2022] GET /compute/v2.1/servers/b28a95a5-c6c2-4781-8c1a-62e7d3eac5a7 => generated 1507 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:54.712192 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-f064e29d-ea7d-4c7c-bce7-bcf3fddfff68 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:54.713216 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-f064e29d-ea7d-4c7c-bce7-bcf3fddfff68 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] [instance: b28a95a5-c6c2-4781-8c1a-62e7d3eac5a7] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:54.729261 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f064e29d-ea7d-4c7c-bce7-bcf3fddfff68 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:54.732427 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f064e29d-ea7d-4c7c-bce7-bcf3fddfff68 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:54.733433 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f064e29d-ea7d-4c7c-bce7-bcf3fddfff68 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:54.734313 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f064e29d-ea7d-4c7c-bce7-bcf3fddfff68 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:54.735895 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f064e29d-ea7d-4c7c-bce7-bcf3fddfff68 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:54.736598 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f064e29d-ea7d-4c7c-bce7-bcf3fddfff68 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:54.973187 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-39fd8672-593f-42ed-983f-cce7cb13d93c tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608fc9ed7cdb487c9bf4b783c26ceeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29876d6805924df882d6861b0f6ab4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:54.993715 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-39fd8672-593f-42ed-983f-cce7cb13d93c tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] 10.222.0.43 "GET /compute/v2.1/servers/cf78a645-458e-4dc2-a60d-a51754ab6258" status: 200 len: 1472 microversion: 2.1 time: 0.505368 Oct 04 18:44:54.997450 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1709/3231] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:54 2022] GET /compute/v2.1/servers/cf78a645-458e-4dc2-a60d-a51754ab6258 => generated 1472 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:55.226539 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-f064e29d-ea7d-4c7c-bce7-bcf3fddfff68 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c710f394164b89b16bcac2fe51c58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65037d4ea5124d749e42928032e803fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:55.267708 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-f064e29d-ea7d-4c7c-bce7-bcf3fddfff68 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] 10.222.0.43 "GET /compute/v2.1/servers/b28a95a5-c6c2-4781-8c1a-62e7d3eac5a7" status: 200 len: 1507 microversion: 2.1 time: 0.534619 Oct 04 18:44:55.274576 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1523/3232] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:54 2022] GET /compute/v2.1/servers/b28a95a5-c6c2-4781-8c1a-62e7d3eac5a7 => generated 1507 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:55.297233 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-e87dc7af-c0d9-48f1-876d-372f63bdc3c0 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "OS-DCF:diskConfig": "AUTO"}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:44:55.300355 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-e87dc7af-c0d9-48f1-876d-372f63bdc3c0 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] [instance: b28a95a5-c6c2-4781-8c1a-62e7d3eac5a7] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:55.319435 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e87dc7af-c0d9-48f1-876d-372f63bdc3c0 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:55.319931 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e87dc7af-c0d9-48f1-876d-372f63bdc3c0 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:55.320368 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e87dc7af-c0d9-48f1-876d-372f63bdc3c0 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:55.321077 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e87dc7af-c0d9-48f1-876d-372f63bdc3c0 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:55.321559 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e87dc7af-c0d9-48f1-876d-372f63bdc3c0 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:55.321982 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e87dc7af-c0d9-48f1-876d-372f63bdc3c0 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:55.511490 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-c566bb23-558f-4afc-9e00-d11441a01222 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:55.512439 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-c566bb23-558f-4afc-9e00-d11441a01222 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: d5e2bc9f-76da-4028-9b48-d00a8ae20d33] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:55.528256 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c566bb23-558f-4afc-9e00-d11441a01222 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:55.533360 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c566bb23-558f-4afc-9e00-d11441a01222 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:55.533903 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c566bb23-558f-4afc-9e00-d11441a01222 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:55.534838 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c566bb23-558f-4afc-9e00-d11441a01222 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:55.536761 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c566bb23-558f-4afc-9e00-d11441a01222 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:55.539031 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-e87dc7af-c0d9-48f1-876d-372f63bdc3c0 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Flavor limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:44:55.541339 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-e87dc7af-c0d9-48f1-876d-372f63bdc3c0 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Image limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:44:55.542146 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-e87dc7af-c0d9-48f1-876d-372f63bdc3c0 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Flavor pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:44:55.543155 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-e87dc7af-c0d9-48f1-876d-372f63bdc3c0 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Image pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:44:55.544133 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-e87dc7af-c0d9-48f1-876d-372f63bdc3c0 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:44:55.544619 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c566bb23-558f-4afc-9e00-d11441a01222 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:55.768634 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-e87dc7af-c0d9-48f1-876d-372f63bdc3c0 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] [instance: b28a95a5-c6c2-4781-8c1a-62e7d3eac5a7] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:55.785942 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e87dc7af-c0d9-48f1-876d-372f63bdc3c0 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:55.786386 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e87dc7af-c0d9-48f1-876d-372f63bdc3c0 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:55.790134 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e87dc7af-c0d9-48f1-876d-372f63bdc3c0 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:55.790956 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e87dc7af-c0d9-48f1-876d-372f63bdc3c0 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:55.791726 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e87dc7af-c0d9-48f1-876d-372f63bdc3c0 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:55.792421 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e87dc7af-c0d9-48f1-876d-372f63bdc3c0 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:55.854893 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-e87dc7af-c0d9-48f1-876d-372f63bdc3c0 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] 10.222.0.43 "POST /compute/v2.1/servers/b28a95a5-c6c2-4781-8c1a-62e7d3eac5a7/action" status: 202 len: 1109 microversion: 2.1 time: 0.562943 Oct 04 18:44:55.857370 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1710/3233] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 18:44:55 2022] POST /compute/v2.1/servers/b28a95a5-c6c2-4781-8c1a-62e7d3eac5a7/action => generated 1109 bytes in 566 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 04 18:44:55.895522 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f5a7d3d2-612b-46d2-9a03-81b022fdcdd5 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:55.896253 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-f5a7d3d2-612b-46d2-9a03-81b022fdcdd5 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] [instance: b28a95a5-c6c2-4781-8c1a-62e7d3eac5a7] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:55.903229 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f5a7d3d2-612b-46d2-9a03-81b022fdcdd5 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:55.909762 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f5a7d3d2-612b-46d2-9a03-81b022fdcdd5 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:55.910611 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f5a7d3d2-612b-46d2-9a03-81b022fdcdd5 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:55.911530 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f5a7d3d2-612b-46d2-9a03-81b022fdcdd5 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:55.912171 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f5a7d3d2-612b-46d2-9a03-81b022fdcdd5 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:55.914349 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f5a7d3d2-612b-46d2-9a03-81b022fdcdd5 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:55.997194 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-c566bb23-558f-4afc-9e00-d11441a01222 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:56.008703 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-c566bb23-558f-4afc-9e00-d11441a01222 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/d5e2bc9f-76da-4028-9b48-d00a8ae20d33" status: 200 len: 1315 microversion: 2.1 time: 0.501733 Oct 04 18:44:56.009640 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1524/3234] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:55 2022] GET /compute/v2.1/servers/d5e2bc9f-76da-4028-9b48-d00a8ae20d33 => generated 1315 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:56.030987 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-1e3149fb-dfea-4f34-8829-484fb9731a24 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:56.031861 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-1e3149fb-dfea-4f34-8829-484fb9731a24 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] [instance: cf78a645-458e-4dc2-a60d-a51754ab6258] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:56.040587 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1e3149fb-dfea-4f34-8829-484fb9731a24 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:56.041352 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1e3149fb-dfea-4f34-8829-484fb9731a24 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:56.041945 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1e3149fb-dfea-4f34-8829-484fb9731a24 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:56.051927 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1e3149fb-dfea-4f34-8829-484fb9731a24 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:56.052606 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1e3149fb-dfea-4f34-8829-484fb9731a24 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:56.053764 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1e3149fb-dfea-4f34-8829-484fb9731a24 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:56.401915 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-f5a7d3d2-612b-46d2-9a03-81b022fdcdd5 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c710f394164b89b16bcac2fe51c58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65037d4ea5124d749e42928032e803fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:56.419527 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-f5a7d3d2-612b-46d2-9a03-81b022fdcdd5 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] 10.222.0.43 "GET /compute/v2.1/servers/b28a95a5-c6c2-4781-8c1a-62e7d3eac5a7" status: 200 len: 1514 microversion: 2.1 time: 0.546431 Oct 04 18:44:56.426772 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-1e3149fb-dfea-4f34-8829-484fb9731a24 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608fc9ed7cdb487c9bf4b783c26ceeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29876d6805924df882d6861b0f6ab4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:56.434608 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1711/3235] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:55 2022] GET /compute/v2.1/servers/b28a95a5-c6c2-4781-8c1a-62e7d3eac5a7 => generated 1514 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:56.464794 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-1e3149fb-dfea-4f34-8829-484fb9731a24 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] 10.222.0.43 "GET /compute/v2.1/servers/cf78a645-458e-4dc2-a60d-a51754ab6258" status: 200 len: 1472 microversion: 2.1 time: 0.444745 Oct 04 18:44:56.468182 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1525/3236] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:56 2022] GET /compute/v2.1/servers/cf78a645-458e-4dc2-a60d-a51754ab6258 => generated 1472 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:44:56.545661 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-3dfe1515-42de-4d84-a51e-1ebc5b060b35 req-157b7f4f-b14d-4b67-a8ee-5118ffd8d73a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5e2bc9f-76da-4028-9b48-d00a8ae20d33", "tag": "1ee9e9af-2dc0-4bc8-96bb-0b3bdf80570b"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:44:56.562916 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-3dfe1515-42de-4d84-a51e-1ebc5b060b35 req-157b7f4f-b14d-4b67-a8ee-5118ffd8d73a service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:56.566786 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-3dfe1515-42de-4d84-a51e-1ebc5b060b35 req-157b7f4f-b14d-4b67-a8ee-5118ffd8d73a service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:56.567900 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-3dfe1515-42de-4d84-a51e-1ebc5b060b35 req-157b7f4f-b14d-4b67-a8ee-5118ffd8d73a service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:56.645553 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-3dfe1515-42de-4d84-a51e-1ebc5b060b35 req-157b7f4f-b14d-4b67-a8ee-5118ffd8d73a service nova] Creating event network-changed:1ee9e9af-2dc0-4bc8-96bb-0b3bdf80570b for instance d5e2bc9f-76da-4028-9b48-d00a8ae20d33 on n-h1-851028-13 Oct 04 18:44:56.659463 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-3dfe1515-42de-4d84-a51e-1ebc5b060b35 req-157b7f4f-b14d-4b67-a8ee-5118ffd8d73a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123862 Oct 04 18:44:56.660079 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1712/3237] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:44:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:44:57.036572 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-fa6173e1-3111-4b67-b052-72d1ffb75aff tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:57.037261 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-fa6173e1-3111-4b67-b052-72d1ffb75aff tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: d5e2bc9f-76da-4028-9b48-d00a8ae20d33] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:57.075132 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fa6173e1-3111-4b67-b052-72d1ffb75aff tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:57.079637 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fa6173e1-3111-4b67-b052-72d1ffb75aff tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:57.080103 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fa6173e1-3111-4b67-b052-72d1ffb75aff tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:57.081057 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fa6173e1-3111-4b67-b052-72d1ffb75aff tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:57.082187 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fa6173e1-3111-4b67-b052-72d1ffb75aff tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:57.083410 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fa6173e1-3111-4b67-b052-72d1ffb75aff tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:57.454180 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-ab597f71-20a4-4afb-8f5a-c656b2a08001 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:57.456007 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-ab597f71-20a4-4afb-8f5a-c656b2a08001 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] [instance: b28a95a5-c6c2-4781-8c1a-62e7d3eac5a7] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:57.466126 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ab597f71-20a4-4afb-8f5a-c656b2a08001 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:57.467051 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ab597f71-20a4-4afb-8f5a-c656b2a08001 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:57.467946 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ab597f71-20a4-4afb-8f5a-c656b2a08001 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:57.468924 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ab597f71-20a4-4afb-8f5a-c656b2a08001 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:57.469613 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ab597f71-20a4-4afb-8f5a-c656b2a08001 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:57.470311 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ab597f71-20a4-4afb-8f5a-c656b2a08001 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:57.593575 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-fa6173e1-3111-4b67-b052-72d1ffb75aff tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:57.611384 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-fa6173e1-3111-4b67-b052-72d1ffb75aff tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/d5e2bc9f-76da-4028-9b48-d00a8ae20d33" status: 200 len: 1315 microversion: 2.1 time: 0.579258 Oct 04 18:44:57.625689 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1526/3238] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:57 2022] GET /compute/v2.1/servers/d5e2bc9f-76da-4028-9b48-d00a8ae20d33 => generated 1315 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:57.630824 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-1720ddfc-684a-421f-8e87-a42d7a298956 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:57.631562 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-1720ddfc-684a-421f-8e87-a42d7a298956 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] [instance: cf78a645-458e-4dc2-a60d-a51754ab6258] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:57.641597 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1720ddfc-684a-421f-8e87-a42d7a298956 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:57.642415 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1720ddfc-684a-421f-8e87-a42d7a298956 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:57.643389 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1720ddfc-684a-421f-8e87-a42d7a298956 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:57.644743 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1720ddfc-684a-421f-8e87-a42d7a298956 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:57.645761 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1720ddfc-684a-421f-8e87-a42d7a298956 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:57.647243 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1720ddfc-684a-421f-8e87-a42d7a298956 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:57.826548 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-ab597f71-20a4-4afb-8f5a-c656b2a08001 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c710f394164b89b16bcac2fe51c58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65037d4ea5124d749e42928032e803fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:57.847345 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-ab597f71-20a4-4afb-8f5a-c656b2a08001 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] 10.222.0.43 "GET /compute/v2.1/servers/b28a95a5-c6c2-4781-8c1a-62e7d3eac5a7" status: 200 len: 1514 microversion: 2.1 time: 0.399986 Oct 04 18:44:57.856974 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1713/3239] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:57 2022] GET /compute/v2.1/servers/b28a95a5-c6c2-4781-8c1a-62e7d3eac5a7 => generated 1514 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:44:58.070892 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-1720ddfc-684a-421f-8e87-a42d7a298956 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608fc9ed7cdb487c9bf4b783c26ceeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29876d6805924df882d6861b0f6ab4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:58.086471 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-1720ddfc-684a-421f-8e87-a42d7a298956 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] 10.222.0.43 "GET /compute/v2.1/servers/cf78a645-458e-4dc2-a60d-a51754ab6258" status: 200 len: 1472 microversion: 2.1 time: 0.465165 Oct 04 18:44:58.093263 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1527/3240] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:57 2022] GET /compute/v2.1/servers/cf78a645-458e-4dc2-a60d-a51754ab6258 => generated 1472 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:58.113166 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-654456e1-eb73-4476-a6ee-247258108a9f tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1647638548", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "24a7c972-666b-4964-a95c-3716199da34e"}], "security_groups": [{"name": "tempest-securitygroup--1476122625"}], "key_name": "tempest-keypair-1847053334", "user_data": "}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:44:58.318086 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.network.neutron [None req-654456e1-eb73-4476-a6ee-247258108a9f tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] validate_networks() for [('24a7c972-666b-4964-a95c-3716199da34e', None, None, None, None, None)] {{(pid=123596) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:44:58.643989 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-e0ef9919-4cce-4c4a-b44d-a81dafb6546e tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:58.644683 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-e0ef9919-4cce-4c4a-b44d-a81dafb6546e tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: d5e2bc9f-76da-4028-9b48-d00a8ae20d33] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:58.647035 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=2 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:44:58.663330 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e0ef9919-4cce-4c4a-b44d-a81dafb6546e tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:58.663839 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e0ef9919-4cce-4c4a-b44d-a81dafb6546e tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:58.664296 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e0ef9919-4cce-4c4a-b44d-a81dafb6546e tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:58.665337 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e0ef9919-4cce-4c4a-b44d-a81dafb6546e tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:58.666699 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e0ef9919-4cce-4c4a-b44d-a81dafb6546e tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:58.667318 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e0ef9919-4cce-4c4a-b44d-a81dafb6546e tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:58.887115 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=2 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:44:58.940579 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-e0ef9919-4cce-4c4a-b44d-a81dafb6546e tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:58.940830 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-654456e1-eb73-4476-a6ee-247258108a9f tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Flavor limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:44:58.941285 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-654456e1-eb73-4476-a6ee-247258108a9f tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Image limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:44:58.941765 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-654456e1-eb73-4476-a6ee-247258108a9f tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Flavor pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:44:58.942179 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-654456e1-eb73-4476-a6ee-247258108a9f tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Image pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:44:58.942800 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-654456e1-eb73-4476-a6ee-247258108a9f tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:44:58.955240 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-654456e1-eb73-4476-a6ee-247258108a9f tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:58.955738 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-654456e1-eb73-4476-a6ee-247258108a9f tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:58.957279 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-e0ef9919-4cce-4c4a-b44d-a81dafb6546e tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/d5e2bc9f-76da-4028-9b48-d00a8ae20d33" status: 200 len: 1315 microversion: 2.1 time: 0.320760 Oct 04 18:44:58.973443 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1528/3241] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:58 2022] GET /compute/v2.1/servers/d5e2bc9f-76da-4028-9b48-d00a8ae20d33 => generated 1315 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:58.973555 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-654456e1-eb73-4476-a6ee-247258108a9f tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:58.973555 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-654456e1-eb73-4476-a6ee-247258108a9f tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:58.973555 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-654456e1-eb73-4476-a6ee-247258108a9f tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:58.973555 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-654456e1-eb73-4476-a6ee-247258108a9f tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:58.973917 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-32425fd4-de21-498f-9fe8-942de3535d03 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:58.975176 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-32425fd4-de21-498f-9fe8-942de3535d03 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] [instance: b28a95a5-c6c2-4781-8c1a-62e7d3eac5a7] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:58.982552 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-32425fd4-de21-498f-9fe8-942de3535d03 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:58.983395 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-32425fd4-de21-498f-9fe8-942de3535d03 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:58.984243 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-32425fd4-de21-498f-9fe8-942de3535d03 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:58.985334 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-32425fd4-de21-498f-9fe8-942de3535d03 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:58.986062 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-32425fd4-de21-498f-9fe8-942de3535d03 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:58.986742 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-32425fd4-de21-498f-9fe8-942de3535d03 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:59.012906 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=100 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:44:59.027586 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-654456e1-eb73-4476-a6ee-247258108a9f tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Getting quotas for project ff3c3dc76405401baf72fe00c5d50b56. Resources: {'ram', 'cores', 'instances'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:44:59.033622 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-654456e1-eb73-4476-a6ee-247258108a9f tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Getting quotas for user a116f2d9656548458264cc4fb1934c18 and project ff3c3dc76405401baf72fe00c5d50b56. Resources: {'ram', 'cores', 'instances'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:44:59.056630 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-654456e1-eb73-4476-a6ee-247258108a9f tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Going to run 1 instances... {{(pid=123596) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:44:59.062315 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-654456e1-eb73-4476-a6ee-247258108a9f tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] [instance: 76d475ab-f41c-44df-8aaa-10242bdbfcde] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e8943ec5-4038-4d4b-b9b9-2415a79f5243',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123596) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:44:59.128867 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-654456e1-eb73-4476-a6ee-247258108a9f tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.031137 Oct 04 18:44:59.136409 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1714/3242] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 18:44:58 2022] POST /compute/v2.1/servers => generated 402 bytes in 1033 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:44:59.136409 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-ef8c1464-48c6-4420-a721-bd85d78fd810 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:59.136885 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-ef8c1464-48c6-4420-a721-bd85d78fd810 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] [instance: cf78a645-458e-4dc2-a60d-a51754ab6258] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:59.145026 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ef8c1464-48c6-4420-a721-bd85d78fd810 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:59.145695 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ef8c1464-48c6-4420-a721-bd85d78fd810 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:59.146146 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ef8c1464-48c6-4420-a721-bd85d78fd810 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:59.147394 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ef8c1464-48c6-4420-a721-bd85d78fd810 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:59.147854 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ef8c1464-48c6-4420-a721-bd85d78fd810 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:59.149202 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ef8c1464-48c6-4420-a721-bd85d78fd810 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:59.261099 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-32425fd4-de21-498f-9fe8-942de3535d03 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c710f394164b89b16bcac2fe51c58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65037d4ea5124d749e42928032e803fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:59.278340 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-32425fd4-de21-498f-9fe8-942de3535d03 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] 10.222.0.43 "GET /compute/v2.1/servers/b28a95a5-c6c2-4781-8c1a-62e7d3eac5a7" status: 200 len: 1514 microversion: 2.1 time: 0.315104 Oct 04 18:44:59.279170 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1529/3243] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:58 2022] GET /compute/v2.1/servers/b28a95a5-c6c2-4781-8c1a-62e7d3eac5a7 => generated 1514 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:59.295671 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-cbe656f7-1f31-44a0-930c-b0517ed418d2 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:59.296593 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-cbe656f7-1f31-44a0-930c-b0517ed418d2 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] [instance: 76d475ab-f41c-44df-8aaa-10242bdbfcde] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:59.392835 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-cbe656f7-1f31-44a0-930c-b0517ed418d2 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a116f2d9656548458264cc4fb1934c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff3c3dc76405401baf72fe00c5d50b56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:59.400363 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-cbe656f7-1f31-44a0-930c-b0517ed418d2 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] 10.222.0.43 "GET /compute/v2.1/servers/76d475ab-f41c-44df-8aaa-10242bdbfcde" status: 200 len: 1238 microversion: 2.1 time: 0.120015 Oct 04 18:44:59.401091 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1530/3244] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:59 2022] GET /compute/v2.1/servers/76d475ab-f41c-44df-8aaa-10242bdbfcde => generated 1238 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:59.413462 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-f8d29eb8-3435-488d-aecc-0be7020cdbe1 tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:59.414086 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-f8d29eb8-3435-488d-aecc-0be7020cdbe1 tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] [instance: 6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:59.426883 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f8d29eb8-3435-488d-aecc-0be7020cdbe1 tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:59.427389 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f8d29eb8-3435-488d-aecc-0be7020cdbe1 tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:59.428086 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f8d29eb8-3435-488d-aecc-0be7020cdbe1 tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:59.428651 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f8d29eb8-3435-488d-aecc-0be7020cdbe1 tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:59.429140 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f8d29eb8-3435-488d-aecc-0be7020cdbe1 tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:59.429595 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f8d29eb8-3435-488d-aecc-0be7020cdbe1 tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:59.433097 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-ef8c1464-48c6-4420-a721-bd85d78fd810 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608fc9ed7cdb487c9bf4b783c26ceeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29876d6805924df882d6861b0f6ab4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:59.442043 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-ef8c1464-48c6-4420-a721-bd85d78fd810 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] 10.222.0.43 "GET /compute/v2.1/servers/cf78a645-458e-4dc2-a60d-a51754ab6258" status: 200 len: 1472 microversion: 2.1 time: 0.310713 Oct 04 18:44:59.443987 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1715/3245] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:59 2022] GET /compute/v2.1/servers/cf78a645-458e-4dc2-a60d-a51754ab6258 => generated 1472 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:59.863239 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-f8d29eb8-3435-488d-aecc-0be7020cdbe1 tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75" status: 200 len: 1861 microversion: 2.1 time: 0.461175 Oct 04 18:44:59.864079 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1531/3246] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:59 2022] GET /compute/v2.1/servers/6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75 => generated 1861 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:59.891706 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-4f379448-299b-4267-bc53-985d3a631c92 tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-851028-13", "block_migration": true, "disk_over_commit": false}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:44:59.895035 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-4f379448-299b-4267-bc53-985d3a631c92 tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] [instance: 6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:59.917841 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4f379448-299b-4267-bc53-985d3a631c92 tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:59.918356 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4f379448-299b-4267-bc53-985d3a631c92 tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:59.918813 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4f379448-299b-4267-bc53-985d3a631c92 tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:59.919557 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4f379448-299b-4267-bc53-985d3a631c92 tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:59.920011 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4f379448-299b-4267-bc53-985d3a631c92 tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:59.920442 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4f379448-299b-4267-bc53-985d3a631c92 tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:59.932155 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:44:59.980463 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-5504ff28-3323-414f-aa51-1f13c14e4a96 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:59.982046 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-5504ff28-3323-414f-aa51-1f13c14e4a96 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: d5e2bc9f-76da-4028-9b48-d00a8ae20d33] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:59.995923 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5504ff28-3323-414f-aa51-1f13c14e4a96 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:59.999480 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5504ff28-3323-414f-aa51-1f13c14e4a96 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:00.002705 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5504ff28-3323-414f-aa51-1f13c14e4a96 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:00.003640 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5504ff28-3323-414f-aa51-1f13c14e4a96 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:00.004278 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5504ff28-3323-414f-aa51-1f13c14e4a96 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:00.005515 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5504ff28-3323-414f-aa51-1f13c14e4a96 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:00.329842 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-5504ff28-3323-414f-aa51-1f13c14e4a96 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:00.340515 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-5504ff28-3323-414f-aa51-1f13c14e4a96 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/d5e2bc9f-76da-4028-9b48-d00a8ae20d33" status: 200 len: 1315 microversion: 2.1 time: 0.364485 Oct 04 18:45:00.346648 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1532/3247] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:59 2022] GET /compute/v2.1/servers/d5e2bc9f-76da-4028-9b48-d00a8ae20d33 => generated 1315 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:45:00.352939 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-1e0f9d71-e6ff-404b-974d-22f9dd6e46ff tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:00.368797 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-1e0f9d71-e6ff-404b-974d-22f9dd6e46ff tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] [instance: b28a95a5-c6c2-4781-8c1a-62e7d3eac5a7] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:00.382139 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1e0f9d71-e6ff-404b-974d-22f9dd6e46ff tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:00.384568 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.objects.instance [None req-4f379448-299b-4267-bc53-985d3a631c92 tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] Lazy-loading 'flavor' on Instance uuid 6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75 {{(pid=123596) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:45:00.388776 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1e0f9d71-e6ff-404b-974d-22f9dd6e46ff tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:00.389384 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1e0f9d71-e6ff-404b-974d-22f9dd6e46ff tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:00.390163 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1e0f9d71-e6ff-404b-974d-22f9dd6e46ff tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:00.390648 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1e0f9d71-e6ff-404b-974d-22f9dd6e46ff tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:00.391090 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1e0f9d71-e6ff-404b-974d-22f9dd6e46ff tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:00.411247 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-4f379448-299b-4267-bc53-985d3a631c92 tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] [instance: 6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75] Going to try to live migrate instance to n-h2-851028-13 {{(pid=123596) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 04 18:45:00.816455 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-1e0f9d71-e6ff-404b-974d-22f9dd6e46ff tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c710f394164b89b16bcac2fe51c58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65037d4ea5124d749e42928032e803fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:00.833164 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-1e0f9d71-e6ff-404b-974d-22f9dd6e46ff tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] 10.222.0.43 "GET /compute/v2.1/servers/b28a95a5-c6c2-4781-8c1a-62e7d3eac5a7" status: 200 len: 1514 microversion: 2.1 time: 0.483225 Oct 04 18:45:00.836718 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1533/3248] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:00 2022] GET /compute/v2.1/servers/b28a95a5-c6c2-4781-8c1a-62e7d3eac5a7 => generated 1514 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:00.848974 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-96d5f271-664e-48a6-8f10-561676c1071f tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:00.850811 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-96d5f271-664e-48a6-8f10-561676c1071f tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] [instance: 76d475ab-f41c-44df-8aaa-10242bdbfcde] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:00.868711 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-96d5f271-664e-48a6-8f10-561676c1071f tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:00.869551 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-96d5f271-664e-48a6-8f10-561676c1071f tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:00.870009 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-96d5f271-664e-48a6-8f10-561676c1071f tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:00.870726 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-96d5f271-664e-48a6-8f10-561676c1071f tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:00.871393 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-96d5f271-664e-48a6-8f10-561676c1071f tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:00.872152 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-96d5f271-664e-48a6-8f10-561676c1071f tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:01.010041 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-96d5f271-664e-48a6-8f10-561676c1071f tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a116f2d9656548458264cc4fb1934c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff3c3dc76405401baf72fe00c5d50b56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:01.020719 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-96d5f271-664e-48a6-8f10-561676c1071f tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] 10.222.0.43 "GET /compute/v2.1/servers/76d475ab-f41c-44df-8aaa-10242bdbfcde" status: 200 len: 1290 microversion: 2.1 time: 0.179872 Oct 04 18:45:01.021951 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1534/3249] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:00 2022] GET /compute/v2.1/servers/76d475ab-f41c-44df-8aaa-10242bdbfcde => generated 1290 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:01.048219 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-bd5a2b8c-b779-40ba-9b2d-0f1ce39c8871 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:01.049375 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-bd5a2b8c-b779-40ba-9b2d-0f1ce39c8871 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] [instance: cf78a645-458e-4dc2-a60d-a51754ab6258] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:01.074907 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bd5a2b8c-b779-40ba-9b2d-0f1ce39c8871 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:01.077413 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bd5a2b8c-b779-40ba-9b2d-0f1ce39c8871 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:01.081036 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bd5a2b8c-b779-40ba-9b2d-0f1ce39c8871 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:01.084368 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bd5a2b8c-b779-40ba-9b2d-0f1ce39c8871 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:01.086068 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bd5a2b8c-b779-40ba-9b2d-0f1ce39c8871 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:01.087281 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bd5a2b8c-b779-40ba-9b2d-0f1ce39c8871 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:01.599007 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-bd5a2b8c-b779-40ba-9b2d-0f1ce39c8871 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608fc9ed7cdb487c9bf4b783c26ceeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29876d6805924df882d6861b0f6ab4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:01.612851 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-bd5a2b8c-b779-40ba-9b2d-0f1ce39c8871 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] 10.222.0.43 "GET /compute/v2.1/servers/cf78a645-458e-4dc2-a60d-a51754ab6258" status: 200 len: 1472 microversion: 2.1 time: 0.573750 Oct 04 18:45:01.613711 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1535/3250] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:01 2022] GET /compute/v2.1/servers/cf78a645-458e-4dc2-a60d-a51754ab6258 => generated 1472 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:01.632737 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-4afbb999-55f1-4ecc-b89a-22749a5a6010 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:01.633920 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-4afbb999-55f1-4ecc-b89a-22749a5a6010 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: d5e2bc9f-76da-4028-9b48-d00a8ae20d33] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:01.648625 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4afbb999-55f1-4ecc-b89a-22749a5a6010 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:01.652398 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4afbb999-55f1-4ecc-b89a-22749a5a6010 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:01.653604 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4afbb999-55f1-4ecc-b89a-22749a5a6010 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:01.656116 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4afbb999-55f1-4ecc-b89a-22749a5a6010 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:01.656807 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4afbb999-55f1-4ecc-b89a-22749a5a6010 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:01.657730 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4afbb999-55f1-4ecc-b89a-22749a5a6010 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:02.074629 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-4afbb999-55f1-4ecc-b89a-22749a5a6010 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:02.091585 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-4afbb999-55f1-4ecc-b89a-22749a5a6010 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/d5e2bc9f-76da-4028-9b48-d00a8ae20d33" status: 200 len: 1315 microversion: 2.1 time: 0.475982 Oct 04 18:45:02.093817 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1536/3251] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:01 2022] GET /compute/v2.1/servers/d5e2bc9f-76da-4028-9b48-d00a8ae20d33 => generated 1315 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:02.100107 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-a346a424-d64b-4792-acc4-26e035adfa2a tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:02.101027 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-a346a424-d64b-4792-acc4-26e035adfa2a tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] [instance: b28a95a5-c6c2-4781-8c1a-62e7d3eac5a7] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:02.108691 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a346a424-d64b-4792-acc4-26e035adfa2a tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:02.110037 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a346a424-d64b-4792-acc4-26e035adfa2a tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:02.110934 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a346a424-d64b-4792-acc4-26e035adfa2a tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:02.112067 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a346a424-d64b-4792-acc4-26e035adfa2a tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:02.113125 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a346a424-d64b-4792-acc4-26e035adfa2a tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:02.113785 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a346a424-d64b-4792-acc4-26e035adfa2a tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:02.899337 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-a346a424-d64b-4792-acc4-26e035adfa2a tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c710f394164b89b16bcac2fe51c58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65037d4ea5124d749e42928032e803fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:02.908232 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-a346a424-d64b-4792-acc4-26e035adfa2a tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] 10.222.0.43 "GET /compute/v2.1/servers/b28a95a5-c6c2-4781-8c1a-62e7d3eac5a7" status: 200 len: 1514 microversion: 2.1 time: 0.812212 Oct 04 18:45:02.925352 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1537/3252] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:02 2022] GET /compute/v2.1/servers/b28a95a5-c6c2-4781-8c1a-62e7d3eac5a7 => generated 1514 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:02.930607 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-5b67f84c-800b-4d10-a383-1a6d6a9879d1 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:02.931223 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-5b67f84c-800b-4d10-a383-1a6d6a9879d1 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] [instance: 76d475ab-f41c-44df-8aaa-10242bdbfcde] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:02.937409 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5b67f84c-800b-4d10-a383-1a6d6a9879d1 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:02.938135 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5b67f84c-800b-4d10-a383-1a6d6a9879d1 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:02.938580 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5b67f84c-800b-4d10-a383-1a6d6a9879d1 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:02.939292 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5b67f84c-800b-4d10-a383-1a6d6a9879d1 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:02.939744 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5b67f84c-800b-4d10-a383-1a6d6a9879d1 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:02.940401 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5b67f84c-800b-4d10-a383-1a6d6a9879d1 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:03.067735 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-5b67f84c-800b-4d10-a383-1a6d6a9879d1 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a116f2d9656548458264cc4fb1934c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff3c3dc76405401baf72fe00c5d50b56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:03.076923 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-5b67f84c-800b-4d10-a383-1a6d6a9879d1 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] 10.222.0.43 "GET /compute/v2.1/servers/76d475ab-f41c-44df-8aaa-10242bdbfcde" status: 200 len: 1296 microversion: 2.1 time: 0.150117 Oct 04 18:45:03.077555 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1538/3253] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:02 2022] GET /compute/v2.1/servers/76d475ab-f41c-44df-8aaa-10242bdbfcde => generated 1296 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:03.093055 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-f7768185-6bf8-4bb5-b3bb-fa9ea78af6a9 req-d274d320-92b0-4fb8-8356-c19df13a9631 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5e2bc9f-76da-4028-9b48-d00a8ae20d33", "name": "network-vif-plugged", "status": "completed", "tag": "1ee9e9af-2dc0-4bc8-96bb-0b3bdf80570b"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:45:03.096366 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:45:03.101013 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-f7768185-6bf8-4bb5-b3bb-fa9ea78af6a9 req-d274d320-92b0-4fb8-8356-c19df13a9631 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:03.101537 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-f7768185-6bf8-4bb5-b3bb-fa9ea78af6a9 req-d274d320-92b0-4fb8-8356-c19df13a9631 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:03.101971 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-f7768185-6bf8-4bb5-b3bb-fa9ea78af6a9 req-d274d320-92b0-4fb8-8356-c19df13a9631 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:03.117159 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-f7768185-6bf8-4bb5-b3bb-fa9ea78af6a9 req-d274d320-92b0-4fb8-8356-c19df13a9631 service nova] Creating event network-vif-plugged:1ee9e9af-2dc0-4bc8-96bb-0b3bdf80570b for instance d5e2bc9f-76da-4028-9b48-d00a8ae20d33 on n-h1-851028-13 Oct 04 18:45:03.122625 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-f7768185-6bf8-4bb5-b3bb-fa9ea78af6a9 req-d274d320-92b0-4fb8-8356-c19df13a9631 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038473 Oct 04 18:45:03.123621 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1539/3254] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:45:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:45:03.128815 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-e0785736-b497-47ed-adac-4a78e8014135 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:03.129541 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-e0785736-b497-47ed-adac-4a78e8014135 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] [instance: cf78a645-458e-4dc2-a60d-a51754ab6258] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:03.145453 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e0785736-b497-47ed-adac-4a78e8014135 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:03.145960 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e0785736-b497-47ed-adac-4a78e8014135 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:03.146873 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e0785736-b497-47ed-adac-4a78e8014135 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:03.147642 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e0785736-b497-47ed-adac-4a78e8014135 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:03.148254 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e0785736-b497-47ed-adac-4a78e8014135 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:03.148845 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e0785736-b497-47ed-adac-4a78e8014135 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:03.642228 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-e0785736-b497-47ed-adac-4a78e8014135 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608fc9ed7cdb487c9bf4b783c26ceeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29876d6805924df882d6861b0f6ab4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:03.656303 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-e0785736-b497-47ed-adac-4a78e8014135 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] 10.222.0.43 "GET /compute/v2.1/servers/cf78a645-458e-4dc2-a60d-a51754ab6258" status: 200 len: 1472 microversion: 2.1 time: 0.530898 Oct 04 18:45:03.657016 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1540/3255] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:03 2022] GET /compute/v2.1/servers/cf78a645-458e-4dc2-a60d-a51754ab6258 => generated 1472 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:03.672179 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-d4818e1a-e105-4f24-a337-4f49f299e889 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:03.674847 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-d4818e1a-e105-4f24-a337-4f49f299e889 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: d5e2bc9f-76da-4028-9b48-d00a8ae20d33] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:03.688383 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d4818e1a-e105-4f24-a337-4f49f299e889 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:03.691936 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d4818e1a-e105-4f24-a337-4f49f299e889 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:03.694625 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d4818e1a-e105-4f24-a337-4f49f299e889 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:03.695850 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d4818e1a-e105-4f24-a337-4f49f299e889 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:03.701974 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d4818e1a-e105-4f24-a337-4f49f299e889 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:03.702704 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d4818e1a-e105-4f24-a337-4f49f299e889 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:03.780153 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-4f379448-299b-4267-bc53-985d3a631c92 tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] 10.222.0.43 "POST /compute/v2.1/servers/6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75/action" status: 202 len: 0 microversion: 2.1 time: 3.893425 Oct 04 18:45:03.781509 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1716/3256] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 18:44:59 2022] POST /compute/v2.1/servers/6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75/action => generated 0 bytes in 3896 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:45:03.790418 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-7161f125-ce9a-4520-8d66-391aa0eb5306 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:03.791074 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-7161f125-ce9a-4520-8d66-391aa0eb5306 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] [instance: 6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:03.800163 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7161f125-ce9a-4520-8d66-391aa0eb5306 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:03.801269 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7161f125-ce9a-4520-8d66-391aa0eb5306 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:03.802133 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7161f125-ce9a-4520-8d66-391aa0eb5306 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:03.804022 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7161f125-ce9a-4520-8d66-391aa0eb5306 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:03.804779 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7161f125-ce9a-4520-8d66-391aa0eb5306 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:03.805691 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7161f125-ce9a-4520-8d66-391aa0eb5306 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:04.006460 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-d4818e1a-e105-4f24-a337-4f49f299e889 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:04.014507 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-d4818e1a-e105-4f24-a337-4f49f299e889 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/d5e2bc9f-76da-4028-9b48-d00a8ae20d33" status: 200 len: 1315 microversion: 2.1 time: 0.356091 Oct 04 18:45:04.015097 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1541/3257] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:03 2022] GET /compute/v2.1/servers/d5e2bc9f-76da-4028-9b48-d00a8ae20d33 => generated 1315 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:04.027079 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-4c069d74-c865-4114-9f06-fa3f6c5e34e4 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:04.028720 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-4c069d74-c865-4114-9f06-fa3f6c5e34e4 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] [instance: b28a95a5-c6c2-4781-8c1a-62e7d3eac5a7] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:04.049103 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4c069d74-c865-4114-9f06-fa3f6c5e34e4 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:04.050048 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4c069d74-c865-4114-9f06-fa3f6c5e34e4 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:04.051313 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4c069d74-c865-4114-9f06-fa3f6c5e34e4 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:04.052606 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4c069d74-c865-4114-9f06-fa3f6c5e34e4 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:04.053275 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4c069d74-c865-4114-9f06-fa3f6c5e34e4 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:04.066422 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4c069d74-c865-4114-9f06-fa3f6c5e34e4 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:04.163447 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-7161f125-ce9a-4520-8d66-391aa0eb5306 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9971b5861f44c1a1da94eda0f8f02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f809b8ae704988961908bef0f3cb24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:04.183039 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-7161f125-ce9a-4520-8d66-391aa0eb5306 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] 10.222.0.43 "GET /compute/v2.1/servers/6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75" status: 200 len: 1718 microversion: 2.1 time: 0.391806 Oct 04 18:45:04.197134 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1717/3258] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:03 2022] GET /compute/v2.1/servers/6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75 => generated 1718 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:45:04.197134 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-ca528743-664a-4543-b920-b76287d00d19 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:04.197134 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-ca528743-664a-4543-b920-b76287d00d19 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] [instance: 76d475ab-f41c-44df-8aaa-10242bdbfcde] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:04.215531 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ca528743-664a-4543-b920-b76287d00d19 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:04.216042 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ca528743-664a-4543-b920-b76287d00d19 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:04.216809 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ca528743-664a-4543-b920-b76287d00d19 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:04.218825 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ca528743-664a-4543-b920-b76287d00d19 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:04.219435 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ca528743-664a-4543-b920-b76287d00d19 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:04.219888 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ca528743-664a-4543-b920-b76287d00d19 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:04.468966 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-ca528743-664a-4543-b920-b76287d00d19 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a116f2d9656548458264cc4fb1934c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff3c3dc76405401baf72fe00c5d50b56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:04.482963 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-ca528743-664a-4543-b920-b76287d00d19 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] 10.222.0.43 "GET /compute/v2.1/servers/76d475ab-f41c-44df-8aaa-10242bdbfcde" status: 200 len: 1364 microversion: 2.1 time: 0.296005 Oct 04 18:45:04.484066 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1718/3259] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:04 2022] GET /compute/v2.1/servers/76d475ab-f41c-44df-8aaa-10242bdbfcde => generated 1364 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:04.548948 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-4c069d74-c865-4114-9f06-fa3f6c5e34e4 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c710f394164b89b16bcac2fe51c58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65037d4ea5124d749e42928032e803fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:04.561927 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-4c069d74-c865-4114-9f06-fa3f6c5e34e4 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] 10.222.0.43 "GET /compute/v2.1/servers/b28a95a5-c6c2-4781-8c1a-62e7d3eac5a7" status: 200 len: 1514 microversion: 2.1 time: 0.541120 Oct 04 18:45:04.562885 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1542/3260] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:04 2022] GET /compute/v2.1/servers/b28a95a5-c6c2-4781-8c1a-62e7d3eac5a7 => generated 1514 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:04.686981 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-d5d9faf7-c7e2-4c7c-a11e-b1f51d450359 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:04.687603 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-d5d9faf7-c7e2-4c7c-a11e-b1f51d450359 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] [instance: cf78a645-458e-4dc2-a60d-a51754ab6258] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:04.695027 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d5d9faf7-c7e2-4c7c-a11e-b1f51d450359 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:04.696488 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d5d9faf7-c7e2-4c7c-a11e-b1f51d450359 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:04.697168 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d5d9faf7-c7e2-4c7c-a11e-b1f51d450359 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:04.698071 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d5d9faf7-c7e2-4c7c-a11e-b1f51d450359 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:04.698689 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d5d9faf7-c7e2-4c7c-a11e-b1f51d450359 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:04.699442 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d5d9faf7-c7e2-4c7c-a11e-b1f51d450359 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:05.019110 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-d5d9faf7-c7e2-4c7c-a11e-b1f51d450359 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608fc9ed7cdb487c9bf4b783c26ceeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29876d6805924df882d6861b0f6ab4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:05.041998 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-d5d9faf7-c7e2-4c7c-a11e-b1f51d450359 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] 10.222.0.43 "GET /compute/v2.1/servers/cf78a645-458e-4dc2-a60d-a51754ab6258" status: 200 len: 1472 microversion: 2.1 time: 0.356876 Oct 04 18:45:05.058277 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-e87dba3a-7550-46b8-b8c7-7b30dfbe852b tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:05.079852 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1719/3261] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:04 2022] GET /compute/v2.1/servers/cf78a645-458e-4dc2-a60d-a51754ab6258 => generated 1472 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:05.089416 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-e87dba3a-7550-46b8-b8c7-7b30dfbe852b tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: d5e2bc9f-76da-4028-9b48-d00a8ae20d33] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:05.136775 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e87dba3a-7550-46b8-b8c7-7b30dfbe852b tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:05.140055 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e87dba3a-7550-46b8-b8c7-7b30dfbe852b tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:05.143186 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e87dba3a-7550-46b8-b8c7-7b30dfbe852b tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:05.149214 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e87dba3a-7550-46b8-b8c7-7b30dfbe852b tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:05.150097 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e87dba3a-7550-46b8-b8c7-7b30dfbe852b tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:05.153197 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e87dba3a-7550-46b8-b8c7-7b30dfbe852b tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:05.217955 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-8280b16f-08e5-454d-b526-c01c8b575ec1 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:05.219089 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-8280b16f-08e5-454d-b526-c01c8b575ec1 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] [instance: 6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:05.245748 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8280b16f-08e5-454d-b526-c01c8b575ec1 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:05.247007 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8280b16f-08e5-454d-b526-c01c8b575ec1 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:05.249591 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8280b16f-08e5-454d-b526-c01c8b575ec1 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:05.253868 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8280b16f-08e5-454d-b526-c01c8b575ec1 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:05.255758 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8280b16f-08e5-454d-b526-c01c8b575ec1 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:05.259269 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8280b16f-08e5-454d-b526-c01c8b575ec1 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:05.510215 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-e87dba3a-7550-46b8-b8c7-7b30dfbe852b tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:05.524856 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-e87dba3a-7550-46b8-b8c7-7b30dfbe852b tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/d5e2bc9f-76da-4028-9b48-d00a8ae20d33" status: 200 len: 1501 microversion: 2.1 time: 0.486954 Oct 04 18:45:05.527656 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1543/3262] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:05 2022] GET /compute/v2.1/servers/d5e2bc9f-76da-4028-9b48-d00a8ae20d33 => generated 1501 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:05.548994 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-abc8561b-f5fa-4c3d-bf83-19801efde2da tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:05.550256 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-abc8561b-f5fa-4c3d-bf83-19801efde2da tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] [instance: 76d475ab-f41c-44df-8aaa-10242bdbfcde] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:05.640870 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-abc8561b-f5fa-4c3d-bf83-19801efde2da tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:05.643584 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-abc8561b-f5fa-4c3d-bf83-19801efde2da tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:05.644149 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-abc8561b-f5fa-4c3d-bf83-19801efde2da tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:05.645798 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-abc8561b-f5fa-4c3d-bf83-19801efde2da tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:05.648297 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-abc8561b-f5fa-4c3d-bf83-19801efde2da tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:05.649707 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-abc8561b-f5fa-4c3d-bf83-19801efde2da tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:05.902772 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-8280b16f-08e5-454d-b526-c01c8b575ec1 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9971b5861f44c1a1da94eda0f8f02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f809b8ae704988961908bef0f3cb24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:05.916550 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-8280b16f-08e5-454d-b526-c01c8b575ec1 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] 10.222.0.43 "GET /compute/v2.1/servers/6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75" status: 200 len: 1718 microversion: 2.1 time: 0.703651 Oct 04 18:45:05.923184 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1720/3263] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:05 2022] GET /compute/v2.1/servers/6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75 => generated 1718 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:45:05.939227 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-0527b98d-e9b7-4ce2-b83d-b1ad449a6f16 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:45:05.947771 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-abc8561b-f5fa-4c3d-bf83-19801efde2da tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a116f2d9656548458264cc4fb1934c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff3c3dc76405401baf72fe00c5d50b56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:05.960728 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-abc8561b-f5fa-4c3d-bf83-19801efde2da tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] 10.222.0.43 "GET /compute/v2.1/servers/76d475ab-f41c-44df-8aaa-10242bdbfcde" status: 200 len: 1364 microversion: 2.1 time: 0.429568 Oct 04 18:45:05.964498 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1544/3264] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:05 2022] GET /compute/v2.1/servers/76d475ab-f41c-44df-8aaa-10242bdbfcde => generated 1364 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:05.965286 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0527b98d-e9b7-4ce2-b83d-b1ad449a6f16 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:05.965913 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0527b98d-e9b7-4ce2-b83d-b1ad449a6f16 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:05.966370 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0527b98d-e9b7-4ce2-b83d-b1ad449a6f16 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:05.977055 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-e6bb2428-91dc-406e-aac5-f68ea5e11217 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:05.977733 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-e6bb2428-91dc-406e-aac5-f68ea5e11217 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] [instance: b28a95a5-c6c2-4781-8c1a-62e7d3eac5a7] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:06.012964 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e6bb2428-91dc-406e-aac5-f68ea5e11217 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:06.013989 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e6bb2428-91dc-406e-aac5-f68ea5e11217 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:06.014686 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e6bb2428-91dc-406e-aac5-f68ea5e11217 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:06.015584 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e6bb2428-91dc-406e-aac5-f68ea5e11217 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:06.017594 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-0527b98d-e9b7-4ce2-b83d-b1ad449a6f16 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: d5e2bc9f-76da-4028-9b48-d00a8ae20d33] Going to try to stop instance {{(pid=123596) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 04 18:45:06.018542 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e6bb2428-91dc-406e-aac5-f68ea5e11217 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:06.019546 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e6bb2428-91dc-406e-aac5-f68ea5e11217 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:06.112571 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-0527b98d-e9b7-4ce2-b83d-b1ad449a6f16 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "POST /compute/v2.1/servers/d5e2bc9f-76da-4028-9b48-d00a8ae20d33/action" status: 202 len: 0 microversion: 2.1 time: 0.183195 Oct 04 18:45:06.116589 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1721/3265] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 18:45:05 2022] POST /compute/v2.1/servers/d5e2bc9f-76da-4028-9b48-d00a8ae20d33/action => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:45:06.127879 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-78c78e61-4502-491e-a56b-b935e184a7c7 req-50866d72-5344-43ed-8a39-9bf521687a39 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76d475ab-f41c-44df-8aaa-10242bdbfcde", "tag": "6e1cef82-3551-4e96-9dfa-49e00c5fb483"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:45:06.142351 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-78c78e61-4502-491e-a56b-b935e184a7c7 req-50866d72-5344-43ed-8a39-9bf521687a39 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:06.143092 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-78c78e61-4502-491e-a56b-b935e184a7c7 req-50866d72-5344-43ed-8a39-9bf521687a39 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:06.143725 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-78c78e61-4502-491e-a56b-b935e184a7c7 req-50866d72-5344-43ed-8a39-9bf521687a39 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:06.180368 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-78c78e61-4502-491e-a56b-b935e184a7c7 req-50866d72-5344-43ed-8a39-9bf521687a39 service nova] Creating event network-changed:6e1cef82-3551-4e96-9dfa-49e00c5fb483 for instance 76d475ab-f41c-44df-8aaa-10242bdbfcde on n-h2-851028-13 Oct 04 18:45:06.186232 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-78c78e61-4502-491e-a56b-b935e184a7c7 req-50866d72-5344-43ed-8a39-9bf521687a39 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069613 Oct 04 18:45:06.187399 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1722/3266] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:45:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:45:06.193679 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-a64c86df-8577-43c8-9667-74bb89575326 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:06.194844 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-a64c86df-8577-43c8-9667-74bb89575326 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] [instance: cf78a645-458e-4dc2-a60d-a51754ab6258] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:06.203118 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a64c86df-8577-43c8-9667-74bb89575326 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:06.206040 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a64c86df-8577-43c8-9667-74bb89575326 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:06.206679 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a64c86df-8577-43c8-9667-74bb89575326 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:06.207841 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a64c86df-8577-43c8-9667-74bb89575326 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:06.209848 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a64c86df-8577-43c8-9667-74bb89575326 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:06.210444 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a64c86df-8577-43c8-9667-74bb89575326 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:06.325122 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-e6bb2428-91dc-406e-aac5-f68ea5e11217 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c710f394164b89b16bcac2fe51c58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65037d4ea5124d749e42928032e803fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:06.334467 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-e6bb2428-91dc-406e-aac5-f68ea5e11217 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] 10.222.0.43 "GET /compute/v2.1/servers/b28a95a5-c6c2-4781-8c1a-62e7d3eac5a7" status: 200 len: 1514 microversion: 2.1 time: 0.368183 Oct 04 18:45:06.335073 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1545/3267] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:05 2022] GET /compute/v2.1/servers/b28a95a5-c6c2-4781-8c1a-62e7d3eac5a7 => generated 1514 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:06.350625 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-95b13d2f-bd60-4307-9d4e-ec5e70bd453e tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:06.352472 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-95b13d2f-bd60-4307-9d4e-ec5e70bd453e tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: d5e2bc9f-76da-4028-9b48-d00a8ae20d33] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:06.368448 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-95b13d2f-bd60-4307-9d4e-ec5e70bd453e tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:06.369306 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-95b13d2f-bd60-4307-9d4e-ec5e70bd453e tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:06.369955 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-95b13d2f-bd60-4307-9d4e-ec5e70bd453e tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:06.371197 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-95b13d2f-bd60-4307-9d4e-ec5e70bd453e tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:06.371836 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-95b13d2f-bd60-4307-9d4e-ec5e70bd453e tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:06.372469 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-95b13d2f-bd60-4307-9d4e-ec5e70bd453e tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:06.491286 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-a64c86df-8577-43c8-9667-74bb89575326 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608fc9ed7cdb487c9bf4b783c26ceeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29876d6805924df882d6861b0f6ab4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:06.510132 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-a64c86df-8577-43c8-9667-74bb89575326 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] 10.222.0.43 "GET /compute/v2.1/servers/cf78a645-458e-4dc2-a60d-a51754ab6258" status: 200 len: 1472 microversion: 2.1 time: 0.321230 Oct 04 18:45:06.511395 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1723/3268] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:06 2022] GET /compute/v2.1/servers/cf78a645-458e-4dc2-a60d-a51754ab6258 => generated 1472 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:06.564162 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-95b13d2f-bd60-4307-9d4e-ec5e70bd453e tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:06.573370 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-95b13d2f-bd60-4307-9d4e-ec5e70bd453e tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/d5e2bc9f-76da-4028-9b48-d00a8ae20d33" status: 200 len: 1511 microversion: 2.1 time: 0.233675 Oct 04 18:45:06.573947 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1546/3269] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:06 2022] GET /compute/v2.1/servers/d5e2bc9f-76da-4028-9b48-d00a8ae20d33 => generated 1511 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:06.958832 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-06356dc8-56e9-47e2-b758-7e2cbff30619 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:06.960220 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-06356dc8-56e9-47e2-b758-7e2cbff30619 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] [instance: 6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:06.976659 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-06356dc8-56e9-47e2-b758-7e2cbff30619 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:06.978805 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-06356dc8-56e9-47e2-b758-7e2cbff30619 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:06.979460 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-06356dc8-56e9-47e2-b758-7e2cbff30619 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:06.982094 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-06356dc8-56e9-47e2-b758-7e2cbff30619 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:06.982409 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-06356dc8-56e9-47e2-b758-7e2cbff30619 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:06.983595 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-06356dc8-56e9-47e2-b758-7e2cbff30619 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:06.987445 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-16f2f21c-70ed-47d0-bfb8-84143636f8cc tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:06.988143 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-16f2f21c-70ed-47d0-bfb8-84143636f8cc tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] [instance: 76d475ab-f41c-44df-8aaa-10242bdbfcde] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:06.997178 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-16f2f21c-70ed-47d0-bfb8-84143636f8cc tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:06.999197 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-16f2f21c-70ed-47d0-bfb8-84143636f8cc tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:06.999873 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-16f2f21c-70ed-47d0-bfb8-84143636f8cc tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:07.001581 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-16f2f21c-70ed-47d0-bfb8-84143636f8cc tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:07.004271 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-16f2f21c-70ed-47d0-bfb8-84143636f8cc tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:07.004970 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-16f2f21c-70ed-47d0-bfb8-84143636f8cc tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:07.220792 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-16f2f21c-70ed-47d0-bfb8-84143636f8cc tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a116f2d9656548458264cc4fb1934c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff3c3dc76405401baf72fe00c5d50b56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:07.225623 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=100 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:45:07.235247 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-16f2f21c-70ed-47d0-bfb8-84143636f8cc tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] 10.222.0.43 "GET /compute/v2.1/servers/76d475ab-f41c-44df-8aaa-10242bdbfcde" status: 200 len: 1364 microversion: 2.1 time: 0.251865 Oct 04 18:45:07.253683 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-06356dc8-56e9-47e2-b758-7e2cbff30619 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9971b5861f44c1a1da94eda0f8f02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f809b8ae704988961908bef0f3cb24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:07.257208 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1547/3270] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:06 2022] GET /compute/v2.1/servers/76d475ab-f41c-44df-8aaa-10242bdbfcde => generated 1364 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:45:07.265351 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-06356dc8-56e9-47e2-b758-7e2cbff30619 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] 10.222.0.43 "GET /compute/v2.1/servers/6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75" status: 200 len: 1718 microversion: 2.1 time: 0.314099 Oct 04 18:45:07.281856 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1724/3271] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:06 2022] GET /compute/v2.1/servers/6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75 => generated 1718 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:07.363887 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-ea2bb6f0-0bd2-4cab-8b98-28065af8ea68 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:07.366214 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-ea2bb6f0-0bd2-4cab-8b98-28065af8ea68 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] [instance: b28a95a5-c6c2-4781-8c1a-62e7d3eac5a7] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:07.381776 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ea2bb6f0-0bd2-4cab-8b98-28065af8ea68 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:07.382936 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ea2bb6f0-0bd2-4cab-8b98-28065af8ea68 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:07.383550 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ea2bb6f0-0bd2-4cab-8b98-28065af8ea68 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:07.384484 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ea2bb6f0-0bd2-4cab-8b98-28065af8ea68 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:07.385158 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ea2bb6f0-0bd2-4cab-8b98-28065af8ea68 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:07.385764 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ea2bb6f0-0bd2-4cab-8b98-28065af8ea68 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:07.535602 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-82414e8a-377a-40b8-a802-b76d360a327d tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:07.537622 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-82414e8a-377a-40b8-a802-b76d360a327d tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] [instance: cf78a645-458e-4dc2-a60d-a51754ab6258] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:07.547229 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-82414e8a-377a-40b8-a802-b76d360a327d tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:07.548039 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-82414e8a-377a-40b8-a802-b76d360a327d tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:07.548941 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-82414e8a-377a-40b8-a802-b76d360a327d tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:07.550063 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-82414e8a-377a-40b8-a802-b76d360a327d tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:07.550530 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-82414e8a-377a-40b8-a802-b76d360a327d tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:07.551136 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-82414e8a-377a-40b8-a802-b76d360a327d tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:07.680908 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-ea2bb6f0-0bd2-4cab-8b98-28065af8ea68 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c710f394164b89b16bcac2fe51c58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65037d4ea5124d749e42928032e803fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:07.702580 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-ea2bb6f0-0bd2-4cab-8b98-28065af8ea68 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] 10.222.0.43 "GET /compute/v2.1/servers/b28a95a5-c6c2-4781-8c1a-62e7d3eac5a7" status: 200 len: 1514 microversion: 2.1 time: 0.344202 Oct 04 18:45:07.706256 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1548/3272] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:07 2022] GET /compute/v2.1/servers/b28a95a5-c6c2-4781-8c1a-62e7d3eac5a7 => generated 1514 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:07.712921 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-596f3f39-2814-4846-b069-a130415d4e08 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:07.714420 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-596f3f39-2814-4846-b069-a130415d4e08 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: d5e2bc9f-76da-4028-9b48-d00a8ae20d33] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:07.723016 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-596f3f39-2814-4846-b069-a130415d4e08 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:07.725360 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-596f3f39-2814-4846-b069-a130415d4e08 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:07.726783 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-596f3f39-2814-4846-b069-a130415d4e08 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:07.729524 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-596f3f39-2814-4846-b069-a130415d4e08 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:07.730889 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-596f3f39-2814-4846-b069-a130415d4e08 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:07.732214 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-596f3f39-2814-4846-b069-a130415d4e08 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:07.781645 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-82414e8a-377a-40b8-a802-b76d360a327d tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608fc9ed7cdb487c9bf4b783c26ceeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29876d6805924df882d6861b0f6ab4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:07.798013 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-82414e8a-377a-40b8-a802-b76d360a327d tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] 10.222.0.43 "GET /compute/v2.1/servers/cf78a645-458e-4dc2-a60d-a51754ab6258" status: 200 len: 1472 microversion: 2.1 time: 0.263400 Oct 04 18:45:07.809562 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1725/3273] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:07 2022] GET /compute/v2.1/servers/cf78a645-458e-4dc2-a60d-a51754ab6258 => generated 1472 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:45:07.979148 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-596f3f39-2814-4846-b069-a130415d4e08 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:07.987146 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-596f3f39-2814-4846-b069-a130415d4e08 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/d5e2bc9f-76da-4028-9b48-d00a8ae20d33" status: 200 len: 1511 microversion: 2.1 time: 0.278767 Oct 04 18:45:08.001819 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1549/3274] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:07 2022] GET /compute/v2.1/servers/d5e2bc9f-76da-4028-9b48-d00a8ae20d33 => generated 1511 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:08.269927 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-e3574c93-0e22-4592-96b3-57388f08b675 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:08.270652 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-e3574c93-0e22-4592-96b3-57388f08b675 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] [instance: 76d475ab-f41c-44df-8aaa-10242bdbfcde] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:08.278129 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e3574c93-0e22-4592-96b3-57388f08b675 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:08.279810 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e3574c93-0e22-4592-96b3-57388f08b675 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:08.281056 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e3574c93-0e22-4592-96b3-57388f08b675 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:08.282481 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e3574c93-0e22-4592-96b3-57388f08b675 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:08.284039 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e3574c93-0e22-4592-96b3-57388f08b675 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:08.291742 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-6029e0ca-80bf-4e2a-904b-79f7f1fa925c tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:08.292715 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-6029e0ca-80bf-4e2a-904b-79f7f1fa925c tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] [instance: 6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:08.298412 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e3574c93-0e22-4592-96b3-57388f08b675 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:08.305904 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6029e0ca-80bf-4e2a-904b-79f7f1fa925c tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:08.310226 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6029e0ca-80bf-4e2a-904b-79f7f1fa925c tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:08.310950 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6029e0ca-80bf-4e2a-904b-79f7f1fa925c tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:08.311766 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6029e0ca-80bf-4e2a-904b-79f7f1fa925c tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:08.313750 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6029e0ca-80bf-4e2a-904b-79f7f1fa925c tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:08.316060 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6029e0ca-80bf-4e2a-904b-79f7f1fa925c tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:08.593229 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-e3574c93-0e22-4592-96b3-57388f08b675 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a116f2d9656548458264cc4fb1934c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff3c3dc76405401baf72fe00c5d50b56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:08.605342 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-e3574c93-0e22-4592-96b3-57388f08b675 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] 10.222.0.43 "GET /compute/v2.1/servers/76d475ab-f41c-44df-8aaa-10242bdbfcde" status: 200 len: 1364 microversion: 2.1 time: 0.340158 Oct 04 18:45:08.615884 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1726/3275] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:08 2022] GET /compute/v2.1/servers/76d475ab-f41c-44df-8aaa-10242bdbfcde => generated 1364 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:08.679858 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-6029e0ca-80bf-4e2a-904b-79f7f1fa925c tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9971b5861f44c1a1da94eda0f8f02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f809b8ae704988961908bef0f3cb24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:08.692122 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-6029e0ca-80bf-4e2a-904b-79f7f1fa925c tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] 10.222.0.43 "GET /compute/v2.1/servers/6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75" status: 200 len: 1718 microversion: 2.1 time: 0.404176 Oct 04 18:45:08.693851 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1550/3276] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:08 2022] GET /compute/v2.1/servers/6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75 => generated 1718 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:45:08.740282 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-c57bdca9-7cd4-4b00-8bc5-58647f7f91a1 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:08.740982 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-c57bdca9-7cd4-4b00-8bc5-58647f7f91a1 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] [instance: b28a95a5-c6c2-4781-8c1a-62e7d3eac5a7] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:08.755352 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c57bdca9-7cd4-4b00-8bc5-58647f7f91a1 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:08.756189 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c57bdca9-7cd4-4b00-8bc5-58647f7f91a1 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:08.756825 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c57bdca9-7cd4-4b00-8bc5-58647f7f91a1 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:08.758250 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c57bdca9-7cd4-4b00-8bc5-58647f7f91a1 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:08.759180 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c57bdca9-7cd4-4b00-8bc5-58647f7f91a1 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:08.759793 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c57bdca9-7cd4-4b00-8bc5-58647f7f91a1 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:08.826286 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-02ae7de7-1d96-4b3e-b1d6-c4bbceb23fb3 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:08.826914 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-02ae7de7-1d96-4b3e-b1d6-c4bbceb23fb3 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] [instance: cf78a645-458e-4dc2-a60d-a51754ab6258] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:08.835857 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-02ae7de7-1d96-4b3e-b1d6-c4bbceb23fb3 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:08.836600 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-02ae7de7-1d96-4b3e-b1d6-c4bbceb23fb3 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:08.839406 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-02ae7de7-1d96-4b3e-b1d6-c4bbceb23fb3 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:08.845864 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-02ae7de7-1d96-4b3e-b1d6-c4bbceb23fb3 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:08.846615 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-02ae7de7-1d96-4b3e-b1d6-c4bbceb23fb3 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:08.847231 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-02ae7de7-1d96-4b3e-b1d6-c4bbceb23fb3 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:09.003669 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=2 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:45:09.048392 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=6 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:45:09.065134 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-c57bdca9-7cd4-4b00-8bc5-58647f7f91a1 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c710f394164b89b16bcac2fe51c58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65037d4ea5124d749e42928032e803fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:09.075559 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-c57bdca9-7cd4-4b00-8bc5-58647f7f91a1 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] 10.222.0.43 "GET /compute/v2.1/servers/b28a95a5-c6c2-4781-8c1a-62e7d3eac5a7" status: 200 len: 1514 microversion: 2.1 time: 0.345366 Oct 04 18:45:09.085816 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1727/3277] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:08 2022] GET /compute/v2.1/servers/b28a95a5-c6c2-4781-8c1a-62e7d3eac5a7 => generated 1514 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:09.091285 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-25c6bcd4-b078-43ec-a3f5-dc1c8b9c4cf7 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:09.092340 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-25c6bcd4-b078-43ec-a3f5-dc1c8b9c4cf7 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: d5e2bc9f-76da-4028-9b48-d00a8ae20d33] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:09.106675 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-25c6bcd4-b078-43ec-a3f5-dc1c8b9c4cf7 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:09.107447 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-25c6bcd4-b078-43ec-a3f5-dc1c8b9c4cf7 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:09.108067 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-25c6bcd4-b078-43ec-a3f5-dc1c8b9c4cf7 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:09.108940 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-25c6bcd4-b078-43ec-a3f5-dc1c8b9c4cf7 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:09.109595 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-25c6bcd4-b078-43ec-a3f5-dc1c8b9c4cf7 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:09.110430 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-25c6bcd4-b078-43ec-a3f5-dc1c8b9c4cf7 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:09.148139 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-02ae7de7-1d96-4b3e-b1d6-c4bbceb23fb3 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608fc9ed7cdb487c9bf4b783c26ceeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29876d6805924df882d6861b0f6ab4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:09.169083 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-02ae7de7-1d96-4b3e-b1d6-c4bbceb23fb3 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] 10.222.0.43 "GET /compute/v2.1/servers/cf78a645-458e-4dc2-a60d-a51754ab6258" status: 200 len: 1472 microversion: 2.1 time: 0.345180 Oct 04 18:45:09.182686 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1551/3278] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:08 2022] GET /compute/v2.1/servers/cf78a645-458e-4dc2-a60d-a51754ab6258 => generated 1472 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:09.289799 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-25c6bcd4-b078-43ec-a3f5-dc1c8b9c4cf7 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:09.298479 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-25c6bcd4-b078-43ec-a3f5-dc1c8b9c4cf7 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/d5e2bc9f-76da-4028-9b48-d00a8ae20d33" status: 200 len: 1511 microversion: 2.1 time: 0.211368 Oct 04 18:45:09.299867 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1728/3279] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:09 2022] GET /compute/v2.1/servers/d5e2bc9f-76da-4028-9b48-d00a8ae20d33 => generated 1511 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:09.632964 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-2c8e32ed-af06-4cde-87c9-a64af153c505 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:09.633973 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-2c8e32ed-af06-4cde-87c9-a64af153c505 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] [instance: 76d475ab-f41c-44df-8aaa-10242bdbfcde] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:09.637232 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=12 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:45:09.644380 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2c8e32ed-af06-4cde-87c9-a64af153c505 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:09.645177 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2c8e32ed-af06-4cde-87c9-a64af153c505 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:09.647902 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2c8e32ed-af06-4cde-87c9-a64af153c505 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:09.648805 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2c8e32ed-af06-4cde-87c9-a64af153c505 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:09.649328 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2c8e32ed-af06-4cde-87c9-a64af153c505 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:09.649947 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2c8e32ed-af06-4cde-87c9-a64af153c505 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:09.717940 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-50782c5f-ce41-43ab-b76e-3914333fc6cb tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:09.718634 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-50782c5f-ce41-43ab-b76e-3914333fc6cb tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] [instance: 6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:09.726732 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-50782c5f-ce41-43ab-b76e-3914333fc6cb tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:09.728874 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-50782c5f-ce41-43ab-b76e-3914333fc6cb tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:09.731042 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-50782c5f-ce41-43ab-b76e-3914333fc6cb tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:09.731844 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-50782c5f-ce41-43ab-b76e-3914333fc6cb tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:09.732604 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-50782c5f-ce41-43ab-b76e-3914333fc6cb tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:09.735808 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-50782c5f-ce41-43ab-b76e-3914333fc6cb tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:09.914946 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-2c8e32ed-af06-4cde-87c9-a64af153c505 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a116f2d9656548458264cc4fb1934c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff3c3dc76405401baf72fe00c5d50b56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:09.925251 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-2c8e32ed-af06-4cde-87c9-a64af153c505 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] 10.222.0.43 "GET /compute/v2.1/servers/76d475ab-f41c-44df-8aaa-10242bdbfcde" status: 200 len: 1364 microversion: 2.1 time: 0.297609 Oct 04 18:45:09.926509 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1552/3280] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:09 2022] GET /compute/v2.1/servers/76d475ab-f41c-44df-8aaa-10242bdbfcde => generated 1364 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:10.006298 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-50782c5f-ce41-43ab-b76e-3914333fc6cb tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9971b5861f44c1a1da94eda0f8f02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f809b8ae704988961908bef0f3cb24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:10.015473 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-50782c5f-ce41-43ab-b76e-3914333fc6cb tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] 10.222.0.43 "GET /compute/v2.1/servers/6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75" status: 200 len: 1718 microversion: 2.1 time: 0.302097 Oct 04 18:45:10.016072 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1729/3281] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:09 2022] GET /compute/v2.1/servers/6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75 => generated 1718 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:45:10.112993 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-19d2d2be-4726-4b98-a3eb-1ef509aff601 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:10.114091 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-19d2d2be-4726-4b98-a3eb-1ef509aff601 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] [instance: b28a95a5-c6c2-4781-8c1a-62e7d3eac5a7] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:10.120721 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-19d2d2be-4726-4b98-a3eb-1ef509aff601 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:10.121509 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-19d2d2be-4726-4b98-a3eb-1ef509aff601 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:10.122129 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-19d2d2be-4726-4b98-a3eb-1ef509aff601 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:10.123012 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-19d2d2be-4726-4b98-a3eb-1ef509aff601 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:10.123631 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-19d2d2be-4726-4b98-a3eb-1ef509aff601 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:10.124221 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-19d2d2be-4726-4b98-a3eb-1ef509aff601 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:10.202954 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-83b149da-4b8c-461c-8fb6-01f88d2ed2f7 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:10.203586 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-83b149da-4b8c-461c-8fb6-01f88d2ed2f7 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] [instance: cf78a645-458e-4dc2-a60d-a51754ab6258] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:10.218912 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-83b149da-4b8c-461c-8fb6-01f88d2ed2f7 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:10.219418 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-83b149da-4b8c-461c-8fb6-01f88d2ed2f7 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:10.219872 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-83b149da-4b8c-461c-8fb6-01f88d2ed2f7 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:10.220602 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-83b149da-4b8c-461c-8fb6-01f88d2ed2f7 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:10.221047 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-83b149da-4b8c-461c-8fb6-01f88d2ed2f7 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:10.221501 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-83b149da-4b8c-461c-8fb6-01f88d2ed2f7 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:10.272010 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:45:10.376257 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-19d2d2be-4726-4b98-a3eb-1ef509aff601 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c710f394164b89b16bcac2fe51c58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65037d4ea5124d749e42928032e803fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:10.386945 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-19d2d2be-4726-4b98-a3eb-1ef509aff601 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] 10.222.0.43 "GET /compute/v2.1/servers/b28a95a5-c6c2-4781-8c1a-62e7d3eac5a7" status: 200 len: 1514 microversion: 2.1 time: 0.279240 Oct 04 18:45:10.389429 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1553/3282] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:10 2022] GET /compute/v2.1/servers/b28a95a5-c6c2-4781-8c1a-62e7d3eac5a7 => generated 1514 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:10.397042 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-9435a6ff-3987-4249-9711-80981b63a57f tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:10.399637 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-9435a6ff-3987-4249-9711-80981b63a57f tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: d5e2bc9f-76da-4028-9b48-d00a8ae20d33] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:10.411847 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9435a6ff-3987-4249-9711-80981b63a57f tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:10.412578 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9435a6ff-3987-4249-9711-80981b63a57f tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:10.413323 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9435a6ff-3987-4249-9711-80981b63a57f tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:10.414360 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9435a6ff-3987-4249-9711-80981b63a57f tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:10.415118 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9435a6ff-3987-4249-9711-80981b63a57f tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:10.415790 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9435a6ff-3987-4249-9711-80981b63a57f tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:10.594315 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-83b149da-4b8c-461c-8fb6-01f88d2ed2f7 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608fc9ed7cdb487c9bf4b783c26ceeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29876d6805924df882d6861b0f6ab4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:10.608647 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-83b149da-4b8c-461c-8fb6-01f88d2ed2f7 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] 10.222.0.43 "GET /compute/v2.1/servers/cf78a645-458e-4dc2-a60d-a51754ab6258" status: 200 len: 1472 microversion: 2.1 time: 0.412463 Oct 04 18:45:10.621495 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1730/3283] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:10 2022] GET /compute/v2.1/servers/cf78a645-458e-4dc2-a60d-a51754ab6258 => generated 1472 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:10.882843 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-9435a6ff-3987-4249-9711-80981b63a57f tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:10.895734 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-9435a6ff-3987-4249-9711-80981b63a57f tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/d5e2bc9f-76da-4028-9b48-d00a8ae20d33" status: 200 len: 1511 microversion: 2.1 time: 0.505073 Oct 04 18:45:10.900029 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1554/3284] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:10 2022] GET /compute/v2.1/servers/d5e2bc9f-76da-4028-9b48-d00a8ae20d33 => generated 1511 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:10.957551 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-c0f4c699-1fb0-4446-be21-cf047d10140f tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:10.958604 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-c0f4c699-1fb0-4446-be21-cf047d10140f tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] [instance: 76d475ab-f41c-44df-8aaa-10242bdbfcde] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:10.978579 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c0f4c699-1fb0-4446-be21-cf047d10140f tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:10.979085 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c0f4c699-1fb0-4446-be21-cf047d10140f tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:10.979526 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c0f4c699-1fb0-4446-be21-cf047d10140f tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:10.980250 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c0f4c699-1fb0-4446-be21-cf047d10140f tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:10.980704 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c0f4c699-1fb0-4446-be21-cf047d10140f tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:10.982186 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c0f4c699-1fb0-4446-be21-cf047d10140f tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:11.053853 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-1243a554-ddeb-4f32-813f-f0893f925850 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:11.054466 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-1243a554-ddeb-4f32-813f-f0893f925850 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] [instance: 6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:11.069880 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1243a554-ddeb-4f32-813f-f0893f925850 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:11.070399 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1243a554-ddeb-4f32-813f-f0893f925850 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:11.070830 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1243a554-ddeb-4f32-813f-f0893f925850 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:11.071827 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1243a554-ddeb-4f32-813f-f0893f925850 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:11.072304 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1243a554-ddeb-4f32-813f-f0893f925850 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:11.073420 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1243a554-ddeb-4f32-813f-f0893f925850 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:11.416913 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-c0f4c699-1fb0-4446-be21-cf047d10140f tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a116f2d9656548458264cc4fb1934c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff3c3dc76405401baf72fe00c5d50b56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:11.431535 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-c0f4c699-1fb0-4446-be21-cf047d10140f tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] 10.222.0.43 "GET /compute/v2.1/servers/76d475ab-f41c-44df-8aaa-10242bdbfcde" status: 200 len: 1364 microversion: 2.1 time: 0.477419 Oct 04 18:45:11.433338 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1731/3285] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:10 2022] GET /compute/v2.1/servers/76d475ab-f41c-44df-8aaa-10242bdbfcde => generated 1364 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:11.448361 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-116ca980-1f3c-4509-8398-9c8d97329a74 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:11.449816 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-116ca980-1f3c-4509-8398-9c8d97329a74 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] [instance: b28a95a5-c6c2-4781-8c1a-62e7d3eac5a7] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:11.471901 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-116ca980-1f3c-4509-8398-9c8d97329a74 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:11.472754 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-116ca980-1f3c-4509-8398-9c8d97329a74 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:11.473514 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-116ca980-1f3c-4509-8398-9c8d97329a74 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:11.475672 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-116ca980-1f3c-4509-8398-9c8d97329a74 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:11.476721 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-116ca980-1f3c-4509-8398-9c8d97329a74 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:11.477924 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-116ca980-1f3c-4509-8398-9c8d97329a74 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:11.531128 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-1243a554-ddeb-4f32-813f-f0893f925850 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9971b5861f44c1a1da94eda0f8f02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f809b8ae704988961908bef0f3cb24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:11.546525 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-1243a554-ddeb-4f32-813f-f0893f925850 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] 10.222.0.43 "GET /compute/v2.1/servers/6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75" status: 200 len: 1718 microversion: 2.1 time: 0.503996 Oct 04 18:45:11.561714 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1555/3286] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:11 2022] GET /compute/v2.1/servers/6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75 => generated 1718 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:11.642328 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-daa3f749-8519-4831-91ad-2335df2dcb17 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:11.642948 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-daa3f749-8519-4831-91ad-2335df2dcb17 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] [instance: cf78a645-458e-4dc2-a60d-a51754ab6258] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:11.657398 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-daa3f749-8519-4831-91ad-2335df2dcb17 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:11.657883 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-daa3f749-8519-4831-91ad-2335df2dcb17 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:11.658321 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-daa3f749-8519-4831-91ad-2335df2dcb17 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:11.659287 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-daa3f749-8519-4831-91ad-2335df2dcb17 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:11.659795 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-daa3f749-8519-4831-91ad-2335df2dcb17 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:11.660146 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-daa3f749-8519-4831-91ad-2335df2dcb17 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:11.824428 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-116ca980-1f3c-4509-8398-9c8d97329a74 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c710f394164b89b16bcac2fe51c58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65037d4ea5124d749e42928032e803fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:11.835506 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-116ca980-1f3c-4509-8398-9c8d97329a74 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] 10.222.0.43 "GET /compute/v2.1/servers/b28a95a5-c6c2-4781-8c1a-62e7d3eac5a7" status: 200 len: 1514 microversion: 2.1 time: 0.399965 Oct 04 18:45:11.836448 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1732/3287] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:11 2022] GET /compute/v2.1/servers/b28a95a5-c6c2-4781-8c1a-62e7d3eac5a7 => generated 1514 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:11.915399 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-daa3f749-8519-4831-91ad-2335df2dcb17 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608fc9ed7cdb487c9bf4b783c26ceeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29876d6805924df882d6861b0f6ab4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:11.924815 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-6ffcf59d-efad-4946-8dad-76530caf8b92 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:11.925486 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-6ffcf59d-efad-4946-8dad-76530caf8b92 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: d5e2bc9f-76da-4028-9b48-d00a8ae20d33] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:11.939573 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-daa3f749-8519-4831-91ad-2335df2dcb17 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] 10.222.0.43 "GET /compute/v2.1/servers/cf78a645-458e-4dc2-a60d-a51754ab6258" status: 200 len: 1472 microversion: 2.1 time: 0.301129 Oct 04 18:45:11.943266 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1556/3288] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:11 2022] GET /compute/v2.1/servers/cf78a645-458e-4dc2-a60d-a51754ab6258 => generated 1472 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:45:11.944830 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6ffcf59d-efad-4946-8dad-76530caf8b92 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:11.945552 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6ffcf59d-efad-4946-8dad-76530caf8b92 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:11.946171 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6ffcf59d-efad-4946-8dad-76530caf8b92 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:11.951459 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6ffcf59d-efad-4946-8dad-76530caf8b92 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:11.952196 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6ffcf59d-efad-4946-8dad-76530caf8b92 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:11.952512 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6ffcf59d-efad-4946-8dad-76530caf8b92 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:12.262776 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-6ffcf59d-efad-4946-8dad-76530caf8b92 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:12.271521 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-6ffcf59d-efad-4946-8dad-76530caf8b92 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/d5e2bc9f-76da-4028-9b48-d00a8ae20d33" status: 200 len: 1511 microversion: 2.1 time: 0.350967 Oct 04 18:45:12.290361 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1733/3289] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:11 2022] GET /compute/v2.1/servers/d5e2bc9f-76da-4028-9b48-d00a8ae20d33 => generated 1511 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:45:12.455265 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-6a761c9f-d57f-4ad0-893a-80f9443b3b6b tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:12.455887 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-6a761c9f-d57f-4ad0-893a-80f9443b3b6b tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] [instance: 76d475ab-f41c-44df-8aaa-10242bdbfcde] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:12.471145 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6a761c9f-d57f-4ad0-893a-80f9443b3b6b tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:12.471652 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6a761c9f-d57f-4ad0-893a-80f9443b3b6b tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:12.472095 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6a761c9f-d57f-4ad0-893a-80f9443b3b6b tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:12.472810 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6a761c9f-d57f-4ad0-893a-80f9443b3b6b tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:12.481981 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6a761c9f-d57f-4ad0-893a-80f9443b3b6b tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:12.482752 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6a761c9f-d57f-4ad0-893a-80f9443b3b6b tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:12.572652 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-48c0c1c8-5909-4667-aa31-3517f7fd671c tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:12.573461 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-48c0c1c8-5909-4667-aa31-3517f7fd671c tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] [instance: 6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:12.582782 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-48c0c1c8-5909-4667-aa31-3517f7fd671c tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:12.583798 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-48c0c1c8-5909-4667-aa31-3517f7fd671c tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:12.591344 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-48c0c1c8-5909-4667-aa31-3517f7fd671c tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:12.599143 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-48c0c1c8-5909-4667-aa31-3517f7fd671c tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:12.599985 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-48c0c1c8-5909-4667-aa31-3517f7fd671c tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:12.600650 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-48c0c1c8-5909-4667-aa31-3517f7fd671c tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:12.838070 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-48c0c1c8-5909-4667-aa31-3517f7fd671c tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9971b5861f44c1a1da94eda0f8f02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f809b8ae704988961908bef0f3cb24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:12.865376 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-48c0c1c8-5909-4667-aa31-3517f7fd671c tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] 10.222.0.43 "GET /compute/v2.1/servers/6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75" status: 200 len: 1718 microversion: 2.1 time: 0.296090 Oct 04 18:45:12.866216 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1734/3290] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:12 2022] GET /compute/v2.1/servers/6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75 => generated 1718 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:45:12.887173 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-22e4c9cb-d675-4d90-a1ed-067b4db73772 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:12.888406 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-22e4c9cb-d675-4d90-a1ed-067b4db73772 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] [instance: b28a95a5-c6c2-4781-8c1a-62e7d3eac5a7] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:12.899072 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-22e4c9cb-d675-4d90-a1ed-067b4db73772 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:12.900352 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-22e4c9cb-d675-4d90-a1ed-067b4db73772 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:12.901447 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-22e4c9cb-d675-4d90-a1ed-067b4db73772 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:12.902572 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-22e4c9cb-d675-4d90-a1ed-067b4db73772 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:12.903348 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-22e4c9cb-d675-4d90-a1ed-067b4db73772 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:12.903857 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-22e4c9cb-d675-4d90-a1ed-067b4db73772 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:13.014425 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-6a761c9f-d57f-4ad0-893a-80f9443b3b6b tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a116f2d9656548458264cc4fb1934c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff3c3dc76405401baf72fe00c5d50b56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:13.023063 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-6a761c9f-d57f-4ad0-893a-80f9443b3b6b tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] 10.222.0.43 "GET /compute/v2.1/servers/76d475ab-f41c-44df-8aaa-10242bdbfcde" status: 200 len: 1364 microversion: 2.1 time: 0.571592 Oct 04 18:45:13.023656 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1557/3291] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:12 2022] GET /compute/v2.1/servers/76d475ab-f41c-44df-8aaa-10242bdbfcde => generated 1364 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:13.034193 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-6273e60f-4beb-43df-bd65-dfa65c87df8b tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:13.034193 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-6273e60f-4beb-43df-bd65-dfa65c87df8b tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] [instance: cf78a645-458e-4dc2-a60d-a51754ab6258] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:13.048103 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6273e60f-4beb-43df-bd65-dfa65c87df8b tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:13.048103 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6273e60f-4beb-43df-bd65-dfa65c87df8b tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:13.048103 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6273e60f-4beb-43df-bd65-dfa65c87df8b tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:13.048103 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6273e60f-4beb-43df-bd65-dfa65c87df8b tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:13.048103 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6273e60f-4beb-43df-bd65-dfa65c87df8b tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:13.048103 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6273e60f-4beb-43df-bd65-dfa65c87df8b tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:13.145589 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-22e4c9cb-d675-4d90-a1ed-067b4db73772 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c710f394164b89b16bcac2fe51c58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65037d4ea5124d749e42928032e803fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:13.155698 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-22e4c9cb-d675-4d90-a1ed-067b4db73772 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] 10.222.0.43 "GET /compute/v2.1/servers/b28a95a5-c6c2-4781-8c1a-62e7d3eac5a7" status: 200 len: 1514 microversion: 2.1 time: 0.286802 Oct 04 18:45:13.157279 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1735/3292] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:12 2022] GET /compute/v2.1/servers/b28a95a5-c6c2-4781-8c1a-62e7d3eac5a7 => generated 1514 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:13.208498 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-6273e60f-4beb-43df-bd65-dfa65c87df8b tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608fc9ed7cdb487c9bf4b783c26ceeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29876d6805924df882d6861b0f6ab4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:13.217479 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-6273e60f-4beb-43df-bd65-dfa65c87df8b tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] 10.222.0.43 "GET /compute/v2.1/servers/cf78a645-458e-4dc2-a60d-a51754ab6258" status: 200 len: 1472 microversion: 2.1 time: 0.192699 Oct 04 18:45:13.218063 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1558/3293] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:13 2022] GET /compute/v2.1/servers/cf78a645-458e-4dc2-a60d-a51754ab6258 => generated 1472 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:13.297932 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-4a697657-d865-4e6f-b55b-45e51439922c tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:13.298596 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-4a697657-d865-4e6f-b55b-45e51439922c tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: d5e2bc9f-76da-4028-9b48-d00a8ae20d33] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:13.305065 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4a697657-d865-4e6f-b55b-45e51439922c tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:13.305747 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4a697657-d865-4e6f-b55b-45e51439922c tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:13.306428 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4a697657-d865-4e6f-b55b-45e51439922c tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:13.307249 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4a697657-d865-4e6f-b55b-45e51439922c tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:13.307781 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4a697657-d865-4e6f-b55b-45e51439922c tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:13.308288 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4a697657-d865-4e6f-b55b-45e51439922c tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:13.457049 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-4a697657-d865-4e6f-b55b-45e51439922c tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:13.462407 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-362cd692-9aa5-40c8-979b-d6eeb5c46b34 req-a07d1ef3-e18b-405a-b317-556d87437826 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76d475ab-f41c-44df-8aaa-10242bdbfcde", "name": "network-vif-plugged", "status": "completed", "tag": "6e1cef82-3551-4e96-9dfa-49e00c5fb483"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:45:13.466485 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-4a697657-d865-4e6f-b55b-45e51439922c tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/d5e2bc9f-76da-4028-9b48-d00a8ae20d33" status: 200 len: 1511 microversion: 2.1 time: 0.172468 Oct 04 18:45:13.467970 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1736/3294] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:13 2022] GET /compute/v2.1/servers/d5e2bc9f-76da-4028-9b48-d00a8ae20d33 => generated 1511 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:13.535259 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-362cd692-9aa5-40c8-979b-d6eeb5c46b34 req-a07d1ef3-e18b-405a-b317-556d87437826 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:13.535259 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-362cd692-9aa5-40c8-979b-d6eeb5c46b34 req-a07d1ef3-e18b-405a-b317-556d87437826 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:13.535259 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-362cd692-9aa5-40c8-979b-d6eeb5c46b34 req-a07d1ef3-e18b-405a-b317-556d87437826 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:13.581187 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-362cd692-9aa5-40c8-979b-d6eeb5c46b34 req-a07d1ef3-e18b-405a-b317-556d87437826 service nova] Creating event network-vif-plugged:6e1cef82-3551-4e96-9dfa-49e00c5fb483 for instance 76d475ab-f41c-44df-8aaa-10242bdbfcde on n-h2-851028-13 Oct 04 18:45:13.587559 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-362cd692-9aa5-40c8-979b-d6eeb5c46b34 req-a07d1ef3-e18b-405a-b317-556d87437826 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131885 Oct 04 18:45:13.588530 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1559/3295] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:45:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:45:13.893460 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-d1a6fdba-d10d-4960-9b77-b6ea728f4a44 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:13.894032 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-d1a6fdba-d10d-4960-9b77-b6ea728f4a44 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] [instance: 6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:13.904704 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:45:13.908140 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d1a6fdba-d10d-4960-9b77-b6ea728f4a44 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:13.908928 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d1a6fdba-d10d-4960-9b77-b6ea728f4a44 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:13.909406 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d1a6fdba-d10d-4960-9b77-b6ea728f4a44 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:13.910206 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d1a6fdba-d10d-4960-9b77-b6ea728f4a44 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:13.910712 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d1a6fdba-d10d-4960-9b77-b6ea728f4a44 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:13.912384 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d1a6fdba-d10d-4960-9b77-b6ea728f4a44 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:14.074263 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-bebb14f2-9798-41ef-99ba-aa13f77d6a7c tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:14.075350 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-bebb14f2-9798-41ef-99ba-aa13f77d6a7c tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] [instance: 76d475ab-f41c-44df-8aaa-10242bdbfcde] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:14.099068 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bebb14f2-9798-41ef-99ba-aa13f77d6a7c tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:14.101235 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bebb14f2-9798-41ef-99ba-aa13f77d6a7c tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:14.102037 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bebb14f2-9798-41ef-99ba-aa13f77d6a7c tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:14.103206 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bebb14f2-9798-41ef-99ba-aa13f77d6a7c tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:14.103834 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bebb14f2-9798-41ef-99ba-aa13f77d6a7c tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:14.104493 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bebb14f2-9798-41ef-99ba-aa13f77d6a7c tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:14.186437 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-d1a6fdba-d10d-4960-9b77-b6ea728f4a44 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9971b5861f44c1a1da94eda0f8f02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f809b8ae704988961908bef0f3cb24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:14.204965 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-d1a6fdba-d10d-4960-9b77-b6ea728f4a44 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] 10.222.0.43 "GET /compute/v2.1/servers/6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75" status: 200 len: 1718 microversion: 2.1 time: 0.313868 Oct 04 18:45:14.217134 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1737/3296] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:13 2022] GET /compute/v2.1/servers/6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75 => generated 1718 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:14.217134 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-5c0bef9e-aa63-4302-a7c6-8977ab2d640c tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:14.217134 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-5c0bef9e-aa63-4302-a7c6-8977ab2d640c tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] [instance: b28a95a5-c6c2-4781-8c1a-62e7d3eac5a7] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:14.226188 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5c0bef9e-aa63-4302-a7c6-8977ab2d640c tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:14.229129 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5c0bef9e-aa63-4302-a7c6-8977ab2d640c tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:14.229835 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5c0bef9e-aa63-4302-a7c6-8977ab2d640c tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:14.230665 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5c0bef9e-aa63-4302-a7c6-8977ab2d640c tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:14.231230 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5c0bef9e-aa63-4302-a7c6-8977ab2d640c tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:14.231759 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5c0bef9e-aa63-4302-a7c6-8977ab2d640c tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:14.347478 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-bebb14f2-9798-41ef-99ba-aa13f77d6a7c tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a116f2d9656548458264cc4fb1934c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff3c3dc76405401baf72fe00c5d50b56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:14.363249 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-bebb14f2-9798-41ef-99ba-aa13f77d6a7c tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] 10.222.0.43 "GET /compute/v2.1/servers/76d475ab-f41c-44df-8aaa-10242bdbfcde" status: 200 len: 1364 microversion: 2.1 time: 0.311529 Oct 04 18:45:14.364725 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1560/3297] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:14 2022] GET /compute/v2.1/servers/76d475ab-f41c-44df-8aaa-10242bdbfcde => generated 1364 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:14.375281 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-865b96bd-37ba-45fc-bc0a-22f29f858fb7 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:14.376086 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-865b96bd-37ba-45fc-bc0a-22f29f858fb7 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] [instance: cf78a645-458e-4dc2-a60d-a51754ab6258] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:14.410823 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-865b96bd-37ba-45fc-bc0a-22f29f858fb7 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:14.411940 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-865b96bd-37ba-45fc-bc0a-22f29f858fb7 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:14.412393 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-865b96bd-37ba-45fc-bc0a-22f29f858fb7 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:14.413172 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-865b96bd-37ba-45fc-bc0a-22f29f858fb7 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:14.413714 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-865b96bd-37ba-45fc-bc0a-22f29f858fb7 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:14.414255 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-865b96bd-37ba-45fc-bc0a-22f29f858fb7 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:14.562562 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-5c0bef9e-aa63-4302-a7c6-8977ab2d640c tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c710f394164b89b16bcac2fe51c58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65037d4ea5124d749e42928032e803fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:14.572356 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-5c0bef9e-aa63-4302-a7c6-8977ab2d640c tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] 10.222.0.43 "GET /compute/v2.1/servers/b28a95a5-c6c2-4781-8c1a-62e7d3eac5a7" status: 200 len: 1514 microversion: 2.1 time: 0.365263 Oct 04 18:45:14.572960 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1738/3298] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:14 2022] GET /compute/v2.1/servers/b28a95a5-c6c2-4781-8c1a-62e7d3eac5a7 => generated 1514 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:14.582928 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-77783bf7-d0fc-428f-8257-ad0041cc8f31 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:14.583963 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-77783bf7-d0fc-428f-8257-ad0041cc8f31 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: d5e2bc9f-76da-4028-9b48-d00a8ae20d33] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:14.590801 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-77783bf7-d0fc-428f-8257-ad0041cc8f31 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:14.591522 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-77783bf7-d0fc-428f-8257-ad0041cc8f31 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:14.592091 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-77783bf7-d0fc-428f-8257-ad0041cc8f31 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:14.592910 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-77783bf7-d0fc-428f-8257-ad0041cc8f31 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:14.597287 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-77783bf7-d0fc-428f-8257-ad0041cc8f31 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:14.597533 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-77783bf7-d0fc-428f-8257-ad0041cc8f31 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:14.841284 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-865b96bd-37ba-45fc-bc0a-22f29f858fb7 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608fc9ed7cdb487c9bf4b783c26ceeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29876d6805924df882d6861b0f6ab4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:14.854240 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-865b96bd-37ba-45fc-bc0a-22f29f858fb7 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] 10.222.0.43 "GET /compute/v2.1/servers/cf78a645-458e-4dc2-a60d-a51754ab6258" status: 200 len: 1472 microversion: 2.1 time: 0.488324 Oct 04 18:45:14.854924 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1561/3299] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:14 2022] GET /compute/v2.1/servers/cf78a645-458e-4dc2-a60d-a51754ab6258 => generated 1472 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:15.215355 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-77783bf7-d0fc-428f-8257-ad0041cc8f31 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:15.228190 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-77783bf7-d0fc-428f-8257-ad0041cc8f31 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/d5e2bc9f-76da-4028-9b48-d00a8ae20d33" status: 200 len: 1511 microversion: 2.1 time: 0.647970 Oct 04 18:45:15.232582 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-0fd89760-2a8e-41ac-aefa-8d4d35fc5b30 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:15.233278 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-0fd89760-2a8e-41ac-aefa-8d4d35fc5b30 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] [instance: 6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:15.241956 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1739/3300] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:14 2022] GET /compute/v2.1/servers/d5e2bc9f-76da-4028-9b48-d00a8ae20d33 => generated 1511 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:45:15.243840 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0fd89760-2a8e-41ac-aefa-8d4d35fc5b30 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:15.247131 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0fd89760-2a8e-41ac-aefa-8d4d35fc5b30 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:15.247863 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0fd89760-2a8e-41ac-aefa-8d4d35fc5b30 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:15.249875 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0fd89760-2a8e-41ac-aefa-8d4d35fc5b30 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:15.254051 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0fd89760-2a8e-41ac-aefa-8d4d35fc5b30 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:15.254698 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0fd89760-2a8e-41ac-aefa-8d4d35fc5b30 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:15.396632 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-b0e4061c-90a6-49a3-af7f-7c62c48414d1 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:15.397817 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-b0e4061c-90a6-49a3-af7f-7c62c48414d1 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] [instance: 76d475ab-f41c-44df-8aaa-10242bdbfcde] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:15.415322 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b0e4061c-90a6-49a3-af7f-7c62c48414d1 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:15.416374 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b0e4061c-90a6-49a3-af7f-7c62c48414d1 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:15.417848 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b0e4061c-90a6-49a3-af7f-7c62c48414d1 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:15.419609 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b0e4061c-90a6-49a3-af7f-7c62c48414d1 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:15.420815 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b0e4061c-90a6-49a3-af7f-7c62c48414d1 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:15.422511 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b0e4061c-90a6-49a3-af7f-7c62c48414d1 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:15.621325 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-0fd89760-2a8e-41ac-aefa-8d4d35fc5b30 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9971b5861f44c1a1da94eda0f8f02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f809b8ae704988961908bef0f3cb24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:15.630685 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-0fd89760-2a8e-41ac-aefa-8d4d35fc5b30 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] 10.222.0.43 "GET /compute/v2.1/servers/6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75" status: 200 len: 1718 microversion: 2.1 time: 0.402081 Oct 04 18:45:15.631292 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1562/3301] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:15 2022] GET /compute/v2.1/servers/6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75 => generated 1718 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:45:15.659729 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-00e71a46-774f-49b8-9711-2e7a02c25511 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:15.659729 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-00e71a46-774f-49b8-9711-2e7a02c25511 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] [instance: b28a95a5-c6c2-4781-8c1a-62e7d3eac5a7] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:15.674799 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-00e71a46-774f-49b8-9711-2e7a02c25511 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:15.675792 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-00e71a46-774f-49b8-9711-2e7a02c25511 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:15.676404 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-00e71a46-774f-49b8-9711-2e7a02c25511 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:15.677868 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-00e71a46-774f-49b8-9711-2e7a02c25511 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:15.681846 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-00e71a46-774f-49b8-9711-2e7a02c25511 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:15.682530 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-00e71a46-774f-49b8-9711-2e7a02c25511 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:15.852261 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-b0e4061c-90a6-49a3-af7f-7c62c48414d1 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a116f2d9656548458264cc4fb1934c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff3c3dc76405401baf72fe00c5d50b56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:15.860836 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-b0e4061c-90a6-49a3-af7f-7c62c48414d1 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] 10.222.0.43 "GET /compute/v2.1/servers/76d475ab-f41c-44df-8aaa-10242bdbfcde" status: 200 len: 1364 microversion: 2.1 time: 0.477090 Oct 04 18:45:15.867280 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1740/3302] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:15 2022] GET /compute/v2.1/servers/76d475ab-f41c-44df-8aaa-10242bdbfcde => generated 1364 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:15.884059 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-d4120d2c-2598-48e3-a1a0-aa39f1b9abc3 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:15.885722 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-d4120d2c-2598-48e3-a1a0-aa39f1b9abc3 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] [instance: cf78a645-458e-4dc2-a60d-a51754ab6258] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:15.898953 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d4120d2c-2598-48e3-a1a0-aa39f1b9abc3 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:15.904011 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d4120d2c-2598-48e3-a1a0-aa39f1b9abc3 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:15.905752 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d4120d2c-2598-48e3-a1a0-aa39f1b9abc3 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:15.910219 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d4120d2c-2598-48e3-a1a0-aa39f1b9abc3 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:15.911667 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d4120d2c-2598-48e3-a1a0-aa39f1b9abc3 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:15.913568 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d4120d2c-2598-48e3-a1a0-aa39f1b9abc3 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:15.921895 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-00e71a46-774f-49b8-9711-2e7a02c25511 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c710f394164b89b16bcac2fe51c58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65037d4ea5124d749e42928032e803fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:15.932734 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-00e71a46-774f-49b8-9711-2e7a02c25511 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] 10.222.0.43 "GET /compute/v2.1/servers/b28a95a5-c6c2-4781-8c1a-62e7d3eac5a7" status: 200 len: 1514 microversion: 2.1 time: 0.282051 Oct 04 18:45:15.936605 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1563/3303] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:15 2022] GET /compute/v2.1/servers/b28a95a5-c6c2-4781-8c1a-62e7d3eac5a7 => generated 1514 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:16.174879 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-d4120d2c-2598-48e3-a1a0-aa39f1b9abc3 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608fc9ed7cdb487c9bf4b783c26ceeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29876d6805924df882d6861b0f6ab4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:16.189079 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-d4120d2c-2598-48e3-a1a0-aa39f1b9abc3 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] 10.222.0.43 "GET /compute/v2.1/servers/cf78a645-458e-4dc2-a60d-a51754ab6258" status: 200 len: 1472 microversion: 2.1 time: 0.310100 Oct 04 18:45:16.207385 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1741/3304] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:15 2022] GET /compute/v2.1/servers/cf78a645-458e-4dc2-a60d-a51754ab6258 => generated 1472 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:45:16.252628 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-e68965a8-c885-4a6b-af8d-bc6d9446e65b tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:16.253704 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-e68965a8-c885-4a6b-af8d-bc6d9446e65b tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: d5e2bc9f-76da-4028-9b48-d00a8ae20d33] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:16.262546 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e68965a8-c885-4a6b-af8d-bc6d9446e65b tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:16.263328 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e68965a8-c885-4a6b-af8d-bc6d9446e65b tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:16.263982 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e68965a8-c885-4a6b-af8d-bc6d9446e65b tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:16.264924 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e68965a8-c885-4a6b-af8d-bc6d9446e65b tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:16.265657 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e68965a8-c885-4a6b-af8d-bc6d9446e65b tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:16.266566 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e68965a8-c885-4a6b-af8d-bc6d9446e65b tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:16.443866 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-e68965a8-c885-4a6b-af8d-bc6d9446e65b tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:16.454888 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-e68965a8-c885-4a6b-af8d-bc6d9446e65b tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/d5e2bc9f-76da-4028-9b48-d00a8ae20d33" status: 200 len: 1511 microversion: 2.1 time: 0.206837 Oct 04 18:45:16.457332 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1564/3305] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:16 2022] GET /compute/v2.1/servers/d5e2bc9f-76da-4028-9b48-d00a8ae20d33 => generated 1511 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:16.656821 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-c982ad52-bfb2-4082-84b8-c5e971b38b78 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:16.659425 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-c982ad52-bfb2-4082-84b8-c5e971b38b78 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] [instance: 6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:16.669745 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c982ad52-bfb2-4082-84b8-c5e971b38b78 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:16.670549 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c982ad52-bfb2-4082-84b8-c5e971b38b78 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:16.671241 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c982ad52-bfb2-4082-84b8-c5e971b38b78 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:16.672123 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c982ad52-bfb2-4082-84b8-c5e971b38b78 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:16.672739 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c982ad52-bfb2-4082-84b8-c5e971b38b78 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:16.673370 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c982ad52-bfb2-4082-84b8-c5e971b38b78 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:16.874586 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-c982ad52-bfb2-4082-84b8-c5e971b38b78 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9971b5861f44c1a1da94eda0f8f02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f809b8ae704988961908bef0f3cb24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:16.891581 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-c982ad52-bfb2-4082-84b8-c5e971b38b78 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] 10.222.0.43 "GET /compute/v2.1/servers/6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75" status: 200 len: 1718 microversion: 2.1 time: 0.238765 Oct 04 18:45:16.892533 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-90a590e2-b1cc-4ada-9440-09d694c75537 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:16.892690 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1742/3306] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:16 2022] GET /compute/v2.1/servers/6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75 => generated 1718 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:45:16.898414 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-90a590e2-b1cc-4ada-9440-09d694c75537 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] [instance: 76d475ab-f41c-44df-8aaa-10242bdbfcde] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:16.905914 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-90a590e2-b1cc-4ada-9440-09d694c75537 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:16.907052 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-90a590e2-b1cc-4ada-9440-09d694c75537 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:16.907998 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-90a590e2-b1cc-4ada-9440-09d694c75537 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:16.909415 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-90a590e2-b1cc-4ada-9440-09d694c75537 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:16.910943 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-90a590e2-b1cc-4ada-9440-09d694c75537 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:16.911703 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-90a590e2-b1cc-4ada-9440-09d694c75537 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:16.917357 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=100 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:45:16.964289 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f0596886-ae16-4790-a728-4a9bc402f9a9 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:16.964923 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-f0596886-ae16-4790-a728-4a9bc402f9a9 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] [instance: b28a95a5-c6c2-4781-8c1a-62e7d3eac5a7] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:16.979047 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f0596886-ae16-4790-a728-4a9bc402f9a9 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:16.979712 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f0596886-ae16-4790-a728-4a9bc402f9a9 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:16.980431 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f0596886-ae16-4790-a728-4a9bc402f9a9 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:16.981319 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f0596886-ae16-4790-a728-4a9bc402f9a9 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:16.982157 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f0596886-ae16-4790-a728-4a9bc402f9a9 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:16.982769 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f0596886-ae16-4790-a728-4a9bc402f9a9 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:17.110731 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-90a590e2-b1cc-4ada-9440-09d694c75537 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a116f2d9656548458264cc4fb1934c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff3c3dc76405401baf72fe00c5d50b56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:17.121994 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-90a590e2-b1cc-4ada-9440-09d694c75537 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] 10.222.0.43 "GET /compute/v2.1/servers/76d475ab-f41c-44df-8aaa-10242bdbfcde" status: 200 len: 1549 microversion: 2.1 time: 0.233700 Oct 04 18:45:17.128240 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1565/3307] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:16 2022] GET /compute/v2.1/servers/76d475ab-f41c-44df-8aaa-10242bdbfcde => generated 1549 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:45:17.146390 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-4ae2bce6-c9dd-424d-92ed-fa5378a7295d tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:17.146890 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-4ae2bce6-c9dd-424d-92ed-fa5378a7295d tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] [instance: 76d475ab-f41c-44df-8aaa-10242bdbfcde] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:17.153275 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4ae2bce6-c9dd-424d-92ed-fa5378a7295d tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:17.154025 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4ae2bce6-c9dd-424d-92ed-fa5378a7295d tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:17.154687 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4ae2bce6-c9dd-424d-92ed-fa5378a7295d tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:17.155586 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4ae2bce6-c9dd-424d-92ed-fa5378a7295d tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:17.156232 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4ae2bce6-c9dd-424d-92ed-fa5378a7295d tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:17.157341 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4ae2bce6-c9dd-424d-92ed-fa5378a7295d tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:17.232053 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-f0596886-ae16-4790-a728-4a9bc402f9a9 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c710f394164b89b16bcac2fe51c58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65037d4ea5124d749e42928032e803fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:17.243992 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-f0596886-ae16-4790-a728-4a9bc402f9a9 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] 10.222.0.43 "GET /compute/v2.1/servers/b28a95a5-c6c2-4781-8c1a-62e7d3eac5a7" status: 200 len: 1514 microversion: 2.1 time: 0.284074 Oct 04 18:45:17.246564 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1743/3308] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:16 2022] GET /compute/v2.1/servers/b28a95a5-c6c2-4781-8c1a-62e7d3eac5a7 => generated 1514 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:17.247218 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-4ae2bce6-c9dd-424d-92ed-fa5378a7295d tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] 10.222.0.43 "GET /compute/v2.1/servers/76d475ab-f41c-44df-8aaa-10242bdbfcde/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.104335 Oct 04 18:45:17.248259 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1566/3309] 10.222.0.43 () {58 vars in 1275 bytes} [Tue Oct 4 18:45:17 2022] GET /compute/v2.1/servers/76d475ab-f41c-44df-8aaa-10242bdbfcde/os-interface => generated 284 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:45:17.260916 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-11a07989-16c8-4250-8489-ec8adf7f32b8 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:17.261592 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-11a07989-16c8-4250-8489-ec8adf7f32b8 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] [instance: cf78a645-458e-4dc2-a60d-a51754ab6258] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:17.271848 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-11a07989-16c8-4250-8489-ec8adf7f32b8 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:17.272351 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-11a07989-16c8-4250-8489-ec8adf7f32b8 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:17.272796 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-11a07989-16c8-4250-8489-ec8adf7f32b8 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:17.273614 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-11a07989-16c8-4250-8489-ec8adf7f32b8 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:17.274075 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-11a07989-16c8-4250-8489-ec8adf7f32b8 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:17.274503 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-11a07989-16c8-4250-8489-ec8adf7f32b8 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:17.483236 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-42ddff94-18d4-4f5f-a28f-83d3e9b420d6 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:17.483849 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-42ddff94-18d4-4f5f-a28f-83d3e9b420d6 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: d5e2bc9f-76da-4028-9b48-d00a8ae20d33] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:17.492031 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-42ddff94-18d4-4f5f-a28f-83d3e9b420d6 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:17.492521 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-42ddff94-18d4-4f5f-a28f-83d3e9b420d6 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:17.492962 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-42ddff94-18d4-4f5f-a28f-83d3e9b420d6 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:17.493700 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-42ddff94-18d4-4f5f-a28f-83d3e9b420d6 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:17.494150 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-42ddff94-18d4-4f5f-a28f-83d3e9b420d6 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:17.494569 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-42ddff94-18d4-4f5f-a28f-83d3e9b420d6 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:17.533078 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-11a07989-16c8-4250-8489-ec8adf7f32b8 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608fc9ed7cdb487c9bf4b783c26ceeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29876d6805924df882d6861b0f6ab4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:17.543112 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-11a07989-16c8-4250-8489-ec8adf7f32b8 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] 10.222.0.43 "GET /compute/v2.1/servers/cf78a645-458e-4dc2-a60d-a51754ab6258" status: 200 len: 1472 microversion: 2.1 time: 0.295636 Oct 04 18:45:17.554248 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1744/3310] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:17 2022] GET /compute/v2.1/servers/cf78a645-458e-4dc2-a60d-a51754ab6258 => generated 1472 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:17.918139 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-a916d886-fea0-4e0f-83be-27de1a181b50 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:17.919146 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-a916d886-fea0-4e0f-83be-27de1a181b50 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] [instance: 6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:17.931324 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a916d886-fea0-4e0f-83be-27de1a181b50 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:17.932120 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a916d886-fea0-4e0f-83be-27de1a181b50 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:17.932817 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a916d886-fea0-4e0f-83be-27de1a181b50 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:17.933556 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a916d886-fea0-4e0f-83be-27de1a181b50 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:17.934176 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a916d886-fea0-4e0f-83be-27de1a181b50 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:17.934840 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a916d886-fea0-4e0f-83be-27de1a181b50 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:18.040625 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-42ddff94-18d4-4f5f-a28f-83d3e9b420d6 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:18.055277 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-42ddff94-18d4-4f5f-a28f-83d3e9b420d6 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/d5e2bc9f-76da-4028-9b48-d00a8ae20d33" status: 200 len: 1511 microversion: 2.1 time: 0.575813 Oct 04 18:45:18.056569 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1567/3311] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:17 2022] GET /compute/v2.1/servers/d5e2bc9f-76da-4028-9b48-d00a8ae20d33 => generated 1511 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:18.168881 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-a916d886-fea0-4e0f-83be-27de1a181b50 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9971b5861f44c1a1da94eda0f8f02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f809b8ae704988961908bef0f3cb24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:18.182569 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-a916d886-fea0-4e0f-83be-27de1a181b50 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] 10.222.0.43 "GET /compute/v2.1/servers/6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75" status: 200 len: 1718 microversion: 2.1 time: 0.270160 Oct 04 18:45:18.183101 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1745/3312] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:17 2022] GET /compute/v2.1/servers/6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75 => generated 1718 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:45:18.270181 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-1994600f-cb19-477d-a030-d77cbd3b3ab9 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:18.271569 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-1994600f-cb19-477d-a030-d77cbd3b3ab9 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] [instance: b28a95a5-c6c2-4781-8c1a-62e7d3eac5a7] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:18.280331 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1994600f-cb19-477d-a030-d77cbd3b3ab9 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:18.281386 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1994600f-cb19-477d-a030-d77cbd3b3ab9 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:18.282038 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1994600f-cb19-477d-a030-d77cbd3b3ab9 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:18.283020 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1994600f-cb19-477d-a030-d77cbd3b3ab9 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:18.283953 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1994600f-cb19-477d-a030-d77cbd3b3ab9 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:18.284539 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1994600f-cb19-477d-a030-d77cbd3b3ab9 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:18.578565 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-1994600f-cb19-477d-a030-d77cbd3b3ab9 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c710f394164b89b16bcac2fe51c58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65037d4ea5124d749e42928032e803fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:18.581624 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-7d7f4463-b11d-4562-923a-f58b3fda6e8e tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:18.583556 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-7d7f4463-b11d-4562-923a-f58b3fda6e8e tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] [instance: cf78a645-458e-4dc2-a60d-a51754ab6258] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:18.588782 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-1994600f-cb19-477d-a030-d77cbd3b3ab9 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] 10.222.0.43 "GET /compute/v2.1/servers/b28a95a5-c6c2-4781-8c1a-62e7d3eac5a7" status: 200 len: 1514 microversion: 2.1 time: 0.322853 Oct 04 18:45:18.593559 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1568/3313] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:18 2022] GET /compute/v2.1/servers/b28a95a5-c6c2-4781-8c1a-62e7d3eac5a7 => generated 1514 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:18.607930 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7d7f4463-b11d-4562-923a-f58b3fda6e8e tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:18.608609 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7d7f4463-b11d-4562-923a-f58b3fda6e8e tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:18.609969 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7d7f4463-b11d-4562-923a-f58b3fda6e8e tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:18.611014 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7d7f4463-b11d-4562-923a-f58b3fda6e8e tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:18.611560 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7d7f4463-b11d-4562-923a-f58b3fda6e8e tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:18.613195 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7d7f4463-b11d-4562-923a-f58b3fda6e8e tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:18.818945 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-7d7f4463-b11d-4562-923a-f58b3fda6e8e tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608fc9ed7cdb487c9bf4b783c26ceeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29876d6805924df882d6861b0f6ab4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:18.830763 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-7d7f4463-b11d-4562-923a-f58b3fda6e8e tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] 10.222.0.43 "GET /compute/v2.1/servers/cf78a645-458e-4dc2-a60d-a51754ab6258" status: 200 len: 1472 microversion: 2.1 time: 0.254614 Oct 04 18:45:18.839430 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1746/3314] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:18 2022] GET /compute/v2.1/servers/cf78a645-458e-4dc2-a60d-a51754ab6258 => generated 1472 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:18.975874 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-77fd2004-f2cc-4529-b58c-a4f240c81f68 req-3b4bd3fd-5326-47a0-a0c7-e4f4c5fffd95 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76d475ab-f41c-44df-8aaa-10242bdbfcde", "tag": "6e1cef82-3551-4e96-9dfa-49e00c5fb483"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:45:18.990907 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-77fd2004-f2cc-4529-b58c-a4f240c81f68 req-3b4bd3fd-5326-47a0-a0c7-e4f4c5fffd95 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:18.991507 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-77fd2004-f2cc-4529-b58c-a4f240c81f68 req-3b4bd3fd-5326-47a0-a0c7-e4f4c5fffd95 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:18.992156 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-77fd2004-f2cc-4529-b58c-a4f240c81f68 req-3b4bd3fd-5326-47a0-a0c7-e4f4c5fffd95 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:19.015747 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-77fd2004-f2cc-4529-b58c-a4f240c81f68 req-3b4bd3fd-5326-47a0-a0c7-e4f4c5fffd95 service nova] Creating event network-changed:6e1cef82-3551-4e96-9dfa-49e00c5fb483 for instance 76d475ab-f41c-44df-8aaa-10242bdbfcde on n-h2-851028-13 Oct 04 18:45:19.022400 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-77fd2004-f2cc-4529-b58c-a4f240c81f68 req-3b4bd3fd-5326-47a0-a0c7-e4f4c5fffd95 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052603 Oct 04 18:45:19.023013 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1569/3315] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:45:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:45:19.080046 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-4eb73c15-47a6-4574-84f4-c5d428ad0f4f tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:19.080708 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-4eb73c15-47a6-4574-84f4-c5d428ad0f4f tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: d5e2bc9f-76da-4028-9b48-d00a8ae20d33] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:19.089633 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4eb73c15-47a6-4574-84f4-c5d428ad0f4f tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:19.090301 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4eb73c15-47a6-4574-84f4-c5d428ad0f4f tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:19.090751 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4eb73c15-47a6-4574-84f4-c5d428ad0f4f tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:19.091466 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4eb73c15-47a6-4574-84f4-c5d428ad0f4f tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:19.091948 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4eb73c15-47a6-4574-84f4-c5d428ad0f4f tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:19.092627 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4eb73c15-47a6-4574-84f4-c5d428ad0f4f tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:19.126568 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=100 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:45:19.209450 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-fe09605c-6519-4177-99b1-b926f7f575c1 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:19.210718 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-fe09605c-6519-4177-99b1-b926f7f575c1 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] [instance: 6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:19.224176 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fe09605c-6519-4177-99b1-b926f7f575c1 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:19.224797 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fe09605c-6519-4177-99b1-b926f7f575c1 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:19.225571 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fe09605c-6519-4177-99b1-b926f7f575c1 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:19.227217 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fe09605c-6519-4177-99b1-b926f7f575c1 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:19.227869 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fe09605c-6519-4177-99b1-b926f7f575c1 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:19.228658 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fe09605c-6519-4177-99b1-b926f7f575c1 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:19.319476 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-4eb73c15-47a6-4574-84f4-c5d428ad0f4f tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:19.331106 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-4eb73c15-47a6-4574-84f4-c5d428ad0f4f tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/d5e2bc9f-76da-4028-9b48-d00a8ae20d33" status: 200 len: 1511 microversion: 2.1 time: 0.255352 Oct 04 18:45:19.332565 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1747/3316] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:19 2022] GET /compute/v2.1/servers/d5e2bc9f-76da-4028-9b48-d00a8ae20d33 => generated 1511 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:19.620081 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-7e608b50-4bcf-4868-8199-9d8528c68682 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:19.621617 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-7e608b50-4bcf-4868-8199-9d8528c68682 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] [instance: b28a95a5-c6c2-4781-8c1a-62e7d3eac5a7] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:19.634551 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7e608b50-4bcf-4868-8199-9d8528c68682 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:19.636094 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7e608b50-4bcf-4868-8199-9d8528c68682 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:19.638123 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7e608b50-4bcf-4868-8199-9d8528c68682 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:19.642000 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7e608b50-4bcf-4868-8199-9d8528c68682 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:19.643026 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7e608b50-4bcf-4868-8199-9d8528c68682 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:19.644806 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7e608b50-4bcf-4868-8199-9d8528c68682 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:19.964425 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-fe09605c-6519-4177-99b1-b926f7f575c1 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9971b5861f44c1a1da94eda0f8f02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f809b8ae704988961908bef0f3cb24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:19.997365 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-fe09605c-6519-4177-99b1-b926f7f575c1 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] 10.222.0.43 "GET /compute/v2.1/servers/6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75" status: 200 len: 1718 microversion: 2.1 time: 0.779243 Oct 04 18:45:19.997365 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1570/3317] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:19 2022] GET /compute/v2.1/servers/6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75 => generated 1718 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:45:20.008083 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-a6ac4dde-cdba-4f6f-ab47-8f474487fa53 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:20.008650 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-a6ac4dde-cdba-4f6f-ab47-8f474487fa53 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] [instance: cf78a645-458e-4dc2-a60d-a51754ab6258] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:20.025294 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a6ac4dde-cdba-4f6f-ab47-8f474487fa53 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:20.026088 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a6ac4dde-cdba-4f6f-ab47-8f474487fa53 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:20.026882 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a6ac4dde-cdba-4f6f-ab47-8f474487fa53 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:20.033017 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a6ac4dde-cdba-4f6f-ab47-8f474487fa53 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:20.034559 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a6ac4dde-cdba-4f6f-ab47-8f474487fa53 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:20.035390 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a6ac4dde-cdba-4f6f-ab47-8f474487fa53 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:20.122326 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-7e608b50-4bcf-4868-8199-9d8528c68682 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c710f394164b89b16bcac2fe51c58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65037d4ea5124d749e42928032e803fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:20.136891 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-7e608b50-4bcf-4868-8199-9d8528c68682 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] 10.222.0.43 "GET /compute/v2.1/servers/b28a95a5-c6c2-4781-8c1a-62e7d3eac5a7" status: 200 len: 1514 microversion: 2.1 time: 0.527875 Oct 04 18:45:20.148840 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1748/3318] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:19 2022] GET /compute/v2.1/servers/b28a95a5-c6c2-4781-8c1a-62e7d3eac5a7 => generated 1514 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:20.356814 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-91893436-869b-4e9b-ab18-5ad8d622160a tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:20.357798 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-91893436-869b-4e9b-ab18-5ad8d622160a tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: d5e2bc9f-76da-4028-9b48-d00a8ae20d33] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:20.367081 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-91893436-869b-4e9b-ab18-5ad8d622160a tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:20.369346 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-91893436-869b-4e9b-ab18-5ad8d622160a tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:20.370003 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-91893436-869b-4e9b-ab18-5ad8d622160a tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:20.371308 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-91893436-869b-4e9b-ab18-5ad8d622160a tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:20.371712 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-91893436-869b-4e9b-ab18-5ad8d622160a tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:20.372357 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-91893436-869b-4e9b-ab18-5ad8d622160a tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:20.490088 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-a6ac4dde-cdba-4f6f-ab47-8f474487fa53 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608fc9ed7cdb487c9bf4b783c26ceeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29876d6805924df882d6861b0f6ab4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:20.500363 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-a6ac4dde-cdba-4f6f-ab47-8f474487fa53 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] 10.222.0.43 "GET /compute/v2.1/servers/cf78a645-458e-4dc2-a60d-a51754ab6258" status: 200 len: 1472 microversion: 2.1 time: 0.514245 Oct 04 18:45:20.518158 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1571/3319] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:19 2022] GET /compute/v2.1/servers/cf78a645-458e-4dc2-a60d-a51754ab6258 => generated 1472 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:20.635038 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-91893436-869b-4e9b-ab18-5ad8d622160a tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:20.646609 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-91893436-869b-4e9b-ab18-5ad8d622160a tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/d5e2bc9f-76da-4028-9b48-d00a8ae20d33" status: 200 len: 1511 microversion: 2.1 time: 0.294856 Oct 04 18:45:20.658106 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1749/3320] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:20 2022] GET /compute/v2.1/servers/d5e2bc9f-76da-4028-9b48-d00a8ae20d33 => generated 1511 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:21.010476 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-6b2bb096-505d-48c1-a920-2d73d23d1a11 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:21.011818 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-6b2bb096-505d-48c1-a920-2d73d23d1a11 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] [instance: 6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:21.018324 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6b2bb096-505d-48c1-a920-2d73d23d1a11 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:21.019105 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6b2bb096-505d-48c1-a920-2d73d23d1a11 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:21.019793 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6b2bb096-505d-48c1-a920-2d73d23d1a11 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:21.021181 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6b2bb096-505d-48c1-a920-2d73d23d1a11 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:21.022073 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6b2bb096-505d-48c1-a920-2d73d23d1a11 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:21.023535 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6b2bb096-505d-48c1-a920-2d73d23d1a11 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:21.050774 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-12c35f1b-03e0-4505-898d-6afe5920a341 req-e6785d00-b68b-4bc6-8824-307614a7f092 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75", "name": "network-vif-unplugged", "status": "completed", "tag": "3b617c59-561d-4917-87cb-5c5ab7f63852"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:45:21.069572 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-12c35f1b-03e0-4505-898d-6afe5920a341 req-e6785d00-b68b-4bc6-8824-307614a7f092 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:21.070083 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-12c35f1b-03e0-4505-898d-6afe5920a341 req-e6785d00-b68b-4bc6-8824-307614a7f092 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:21.070735 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-12c35f1b-03e0-4505-898d-6afe5920a341 req-e6785d00-b68b-4bc6-8824-307614a7f092 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:21.083617 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-12c35f1b-03e0-4505-898d-6afe5920a341 req-e6785d00-b68b-4bc6-8824-307614a7f092 service nova] Creating event network-vif-unplugged:3b617c59-561d-4917-87cb-5c5ab7f63852 for instance 6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75 on n-h1-851028-13 Oct 04 18:45:21.089039 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-12c35f1b-03e0-4505-898d-6afe5920a341 req-e6785d00-b68b-4bc6-8824-307614a7f092 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044410 Oct 04 18:45:21.090286 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1750/3321] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:45:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:45:21.166308 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-3f16d05a-cdaa-4b33-8933-fa934660db81 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:21.167986 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-3f16d05a-cdaa-4b33-8933-fa934660db81 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] [instance: b28a95a5-c6c2-4781-8c1a-62e7d3eac5a7] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:21.176720 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3f16d05a-cdaa-4b33-8933-fa934660db81 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:21.177661 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3f16d05a-cdaa-4b33-8933-fa934660db81 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:21.178316 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3f16d05a-cdaa-4b33-8933-fa934660db81 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:21.179227 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3f16d05a-cdaa-4b33-8933-fa934660db81 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:21.179875 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3f16d05a-cdaa-4b33-8933-fa934660db81 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:21.180504 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3f16d05a-cdaa-4b33-8933-fa934660db81 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:21.378076 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-3f16d05a-cdaa-4b33-8933-fa934660db81 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c710f394164b89b16bcac2fe51c58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65037d4ea5124d749e42928032e803fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:21.390299 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-3f16d05a-cdaa-4b33-8933-fa934660db81 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] 10.222.0.43 "GET /compute/v2.1/servers/b28a95a5-c6c2-4781-8c1a-62e7d3eac5a7" status: 200 len: 1514 microversion: 2.1 time: 0.229950 Oct 04 18:45:21.394407 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-6b2bb096-505d-48c1-a920-2d73d23d1a11 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9971b5861f44c1a1da94eda0f8f02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f809b8ae704988961908bef0f3cb24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:21.412408 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1751/3322] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:21 2022] GET /compute/v2.1/servers/b28a95a5-c6c2-4781-8c1a-62e7d3eac5a7 => generated 1514 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:21.428034 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-6b2bb096-505d-48c1-a920-2d73d23d1a11 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] 10.222.0.43 "GET /compute/v2.1/servers/6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75" status: 200 len: 1718 microversion: 2.1 time: 0.423067 Oct 04 18:45:21.429399 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1572/3323] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:21 2022] GET /compute/v2.1/servers/6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75 => generated 1718 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:21.543476 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-69e2400d-c097-430c-9d12-f2e143833f27 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:21.544562 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-69e2400d-c097-430c-9d12-f2e143833f27 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] [instance: cf78a645-458e-4dc2-a60d-a51754ab6258] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:21.567128 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-69e2400d-c097-430c-9d12-f2e143833f27 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:21.567896 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-69e2400d-c097-430c-9d12-f2e143833f27 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:21.568502 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-69e2400d-c097-430c-9d12-f2e143833f27 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:21.569427 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-69e2400d-c097-430c-9d12-f2e143833f27 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:21.570051 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-69e2400d-c097-430c-9d12-f2e143833f27 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:21.570643 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-69e2400d-c097-430c-9d12-f2e143833f27 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:21.674426 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-94d6cd59-c2b7-489e-a070-29544f915619 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:21.675082 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-94d6cd59-c2b7-489e-a070-29544f915619 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: d5e2bc9f-76da-4028-9b48-d00a8ae20d33] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:21.684275 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-94d6cd59-c2b7-489e-a070-29544f915619 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:21.684771 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-94d6cd59-c2b7-489e-a070-29544f915619 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:21.685251 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-94d6cd59-c2b7-489e-a070-29544f915619 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:21.687160 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-94d6cd59-c2b7-489e-a070-29544f915619 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:21.687632 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-94d6cd59-c2b7-489e-a070-29544f915619 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:21.688444 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-94d6cd59-c2b7-489e-a070-29544f915619 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:21.769198 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-69e2400d-c097-430c-9d12-f2e143833f27 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608fc9ed7cdb487c9bf4b783c26ceeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29876d6805924df882d6861b0f6ab4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:21.785339 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-69e2400d-c097-430c-9d12-f2e143833f27 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] 10.222.0.43 "GET /compute/v2.1/servers/cf78a645-458e-4dc2-a60d-a51754ab6258" status: 200 len: 1472 microversion: 2.1 time: 0.246217 Oct 04 18:45:21.788380 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1752/3324] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:21 2022] GET /compute/v2.1/servers/cf78a645-458e-4dc2-a60d-a51754ab6258 => generated 1472 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:21.863643 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-94d6cd59-c2b7-489e-a070-29544f915619 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:21.872706 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-94d6cd59-c2b7-489e-a070-29544f915619 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/d5e2bc9f-76da-4028-9b48-d00a8ae20d33" status: 200 len: 1511 microversion: 2.1 time: 0.201983 Oct 04 18:45:21.873345 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1573/3325] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:21 2022] GET /compute/v2.1/servers/d5e2bc9f-76da-4028-9b48-d00a8ae20d33 => generated 1511 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:22.433531 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-ef0aa13f-0949-42c9-8f4e-02db5efc7651 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:22.434167 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-ef0aa13f-0949-42c9-8f4e-02db5efc7651 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] [instance: b28a95a5-c6c2-4781-8c1a-62e7d3eac5a7] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:22.441243 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ef0aa13f-0949-42c9-8f4e-02db5efc7651 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:22.441745 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ef0aa13f-0949-42c9-8f4e-02db5efc7651 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:22.442188 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ef0aa13f-0949-42c9-8f4e-02db5efc7651 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:22.443636 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ef0aa13f-0949-42c9-8f4e-02db5efc7651 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:22.444250 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ef0aa13f-0949-42c9-8f4e-02db5efc7651 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:22.444796 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ef0aa13f-0949-42c9-8f4e-02db5efc7651 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:22.455802 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-cfaa49e2-b805-4e55-bc09-07a9d1172701 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:22.456416 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-cfaa49e2-b805-4e55-bc09-07a9d1172701 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] [instance: 6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:22.463663 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cfaa49e2-b805-4e55-bc09-07a9d1172701 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:22.464153 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cfaa49e2-b805-4e55-bc09-07a9d1172701 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:22.465244 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cfaa49e2-b805-4e55-bc09-07a9d1172701 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:22.466028 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cfaa49e2-b805-4e55-bc09-07a9d1172701 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:22.466491 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cfaa49e2-b805-4e55-bc09-07a9d1172701 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:22.466921 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cfaa49e2-b805-4e55-bc09-07a9d1172701 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:22.597471 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-ef0aa13f-0949-42c9-8f4e-02db5efc7651 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c710f394164b89b16bcac2fe51c58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65037d4ea5124d749e42928032e803fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:22.611585 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-ef0aa13f-0949-42c9-8f4e-02db5efc7651 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] 10.222.0.43 "GET /compute/v2.1/servers/b28a95a5-c6c2-4781-8c1a-62e7d3eac5a7" status: 200 len: 1514 microversion: 2.1 time: 0.181836 Oct 04 18:45:22.612267 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1753/3326] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:22 2022] GET /compute/v2.1/servers/b28a95a5-c6c2-4781-8c1a-62e7d3eac5a7 => generated 1514 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:22.652227 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-cfaa49e2-b805-4e55-bc09-07a9d1172701 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9971b5861f44c1a1da94eda0f8f02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f809b8ae704988961908bef0f3cb24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:22.661816 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-cfaa49e2-b805-4e55-bc09-07a9d1172701 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] 10.222.0.43 "GET /compute/v2.1/servers/6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75" status: 200 len: 1718 microversion: 2.1 time: 0.209948 Oct 04 18:45:22.673637 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1574/3327] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:22 2022] GET /compute/v2.1/servers/6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75 => generated 1718 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:22.817760 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f187c2f3-cc7e-4f6c-ba63-d5bf20046b39 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:22.819069 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-f187c2f3-cc7e-4f6c-ba63-d5bf20046b39 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] [instance: cf78a645-458e-4dc2-a60d-a51754ab6258] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:22.828308 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f187c2f3-cc7e-4f6c-ba63-d5bf20046b39 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:22.829469 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f187c2f3-cc7e-4f6c-ba63-d5bf20046b39 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:22.830148 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f187c2f3-cc7e-4f6c-ba63-d5bf20046b39 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:22.831210 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f187c2f3-cc7e-4f6c-ba63-d5bf20046b39 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:22.831911 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f187c2f3-cc7e-4f6c-ba63-d5bf20046b39 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:22.833339 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f187c2f3-cc7e-4f6c-ba63-d5bf20046b39 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:22.916841 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-4fe9fbc9-a4da-41f7-82d2-b763c4ba2ea0 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:22.924001 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-4fe9fbc9-a4da-41f7-82d2-b763c4ba2ea0 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: d5e2bc9f-76da-4028-9b48-d00a8ae20d33] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:22.932897 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4fe9fbc9-a4da-41f7-82d2-b763c4ba2ea0 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:22.935302 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4fe9fbc9-a4da-41f7-82d2-b763c4ba2ea0 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:22.935774 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4fe9fbc9-a4da-41f7-82d2-b763c4ba2ea0 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:22.942670 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4fe9fbc9-a4da-41f7-82d2-b763c4ba2ea0 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:22.942670 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4fe9fbc9-a4da-41f7-82d2-b763c4ba2ea0 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:22.942913 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4fe9fbc9-a4da-41f7-82d2-b763c4ba2ea0 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:23.141352 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-f187c2f3-cc7e-4f6c-ba63-d5bf20046b39 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608fc9ed7cdb487c9bf4b783c26ceeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29876d6805924df882d6861b0f6ab4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:23.153556 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-f187c2f3-cc7e-4f6c-ba63-d5bf20046b39 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] 10.222.0.43 "GET /compute/v2.1/servers/cf78a645-458e-4dc2-a60d-a51754ab6258" status: 200 len: 1472 microversion: 2.1 time: 0.341016 Oct 04 18:45:23.154535 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1754/3328] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:22 2022] GET /compute/v2.1/servers/cf78a645-458e-4dc2-a60d-a51754ab6258 => generated 1472 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:23.162365 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-a44efec7-1e38-468c-8216-1141628e7c0a req-224ec734-1fbf-4007-bce6-8a8d487aa81f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75", "tag": "3b617c59-561d-4917-87cb-5c5ab7f63852"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:45:23.173428 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-a44efec7-1e38-468c-8216-1141628e7c0a req-224ec734-1fbf-4007-bce6-8a8d487aa81f service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:23.174045 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-a44efec7-1e38-468c-8216-1141628e7c0a req-224ec734-1fbf-4007-bce6-8a8d487aa81f service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:23.174480 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-a44efec7-1e38-468c-8216-1141628e7c0a req-224ec734-1fbf-4007-bce6-8a8d487aa81f service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:23.188918 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-a44efec7-1e38-468c-8216-1141628e7c0a req-224ec734-1fbf-4007-bce6-8a8d487aa81f service nova] Creating event network-changed:3b617c59-561d-4917-87cb-5c5ab7f63852 for instance 6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75 on n-h1-851028-13 Oct 04 18:45:23.194454 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-a44efec7-1e38-468c-8216-1141628e7c0a req-224ec734-1fbf-4007-bce6-8a8d487aa81f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037958 Oct 04 18:45:23.195115 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-4fe9fbc9-a4da-41f7-82d2-b763c4ba2ea0 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:23.195956 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1755/3329] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:45:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:45:23.203937 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-4fe9fbc9-a4da-41f7-82d2-b763c4ba2ea0 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/d5e2bc9f-76da-4028-9b48-d00a8ae20d33" status: 200 len: 1511 microversion: 2.1 time: 0.298887 Oct 04 18:45:23.205664 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1575/3330] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:22 2022] GET /compute/v2.1/servers/d5e2bc9f-76da-4028-9b48-d00a8ae20d33 => generated 1511 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:23.448206 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-04854d8f-eac7-4f26-97c1-20f6d7831fe1 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "383ace23-6782-4417-b230-f573687bab01"}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:45:23.451013 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-04854d8f-eac7-4f26-97c1-20f6d7831fe1 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] [instance: 15541ec9-3112-4adc-9fad-6d20a88f2c09] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:23.457557 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-04854d8f-eac7-4f26-97c1-20f6d7831fe1 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:23.458193 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-04854d8f-eac7-4f26-97c1-20f6d7831fe1 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:23.458898 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-04854d8f-eac7-4f26-97c1-20f6d7831fe1 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:23.459677 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-04854d8f-eac7-4f26-97c1-20f6d7831fe1 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:23.460199 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-04854d8f-eac7-4f26-97c1-20f6d7831fe1 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:23.460714 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-04854d8f-eac7-4f26-97c1-20f6d7831fe1 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:23.641602 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-ff6116a2-b8a1-44ed-9298-611801db885e tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:23.644502 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-ff6116a2-b8a1-44ed-9298-611801db885e tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] [instance: b28a95a5-c6c2-4781-8c1a-62e7d3eac5a7] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:23.654732 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ff6116a2-b8a1-44ed-9298-611801db885e tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:23.655645 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ff6116a2-b8a1-44ed-9298-611801db885e tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:23.656304 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ff6116a2-b8a1-44ed-9298-611801db885e tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:23.657263 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ff6116a2-b8a1-44ed-9298-611801db885e tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:23.657936 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ff6116a2-b8a1-44ed-9298-611801db885e tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:23.659186 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ff6116a2-b8a1-44ed-9298-611801db885e tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:23.784890 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-04854d8f-eac7-4f26-97c1-20f6d7831fe1 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] 10.222.0.43 "POST /compute/v2.1/servers/15541ec9-3112-4adc-9fad-6d20a88f2c09/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.342811 Oct 04 18:45:23.786081 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1756/3331] 10.222.0.43 () {60 vars in 1323 bytes} [Tue Oct 4 18:45:23 2022] POST /compute/v2.1/servers/15541ec9-3112-4adc-9fad-6d20a88f2c09/os-volume_attachments => generated 194 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:45:23.792185 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-190f14a2-681d-486d-8f1b-901c855c1cbd tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:23.793549 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-190f14a2-681d-486d-8f1b-901c855c1cbd tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] [instance: 6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:23.802812 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-190f14a2-681d-486d-8f1b-901c855c1cbd tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:23.803336 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-190f14a2-681d-486d-8f1b-901c855c1cbd tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:23.803789 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-190f14a2-681d-486d-8f1b-901c855c1cbd tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:23.804515 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-190f14a2-681d-486d-8f1b-901c855c1cbd tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:23.804975 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-190f14a2-681d-486d-8f1b-901c855c1cbd tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:23.805626 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-190f14a2-681d-486d-8f1b-901c855c1cbd tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:24.069371 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-190f14a2-681d-486d-8f1b-901c855c1cbd tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9971b5861f44c1a1da94eda0f8f02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f809b8ae704988961908bef0f3cb24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:24.079702 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-190f14a2-681d-486d-8f1b-901c855c1cbd tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] 10.222.0.43 "GET /compute/v2.1/servers/6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75" status: 200 len: 1718 microversion: 2.1 time: 0.292165 Oct 04 18:45:24.080314 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1757/3332] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:23 2022] GET /compute/v2.1/servers/6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75 => generated 1718 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:24.093417 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-ff6116a2-b8a1-44ed-9298-611801db885e tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c710f394164b89b16bcac2fe51c58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65037d4ea5124d749e42928032e803fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:24.093752 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-ff6116a2-b8a1-44ed-9298-611801db885e tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] 10.222.0.43 "GET /compute/v2.1/servers/b28a95a5-c6c2-4781-8c1a-62e7d3eac5a7" status: 200 len: 1514 microversion: 2.1 time: 0.456145 Oct 04 18:45:24.105878 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1576/3333] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:23 2022] GET /compute/v2.1/servers/b28a95a5-c6c2-4781-8c1a-62e7d3eac5a7 => generated 1514 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:24.184925 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-0e93e64f-fead-44cc-b7d5-653f4a38e99b tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:24.185914 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-0e93e64f-fead-44cc-b7d5-653f4a38e99b tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] [instance: cf78a645-458e-4dc2-a60d-a51754ab6258] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:24.196739 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0e93e64f-fead-44cc-b7d5-653f4a38e99b tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:24.197506 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0e93e64f-fead-44cc-b7d5-653f4a38e99b tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:24.198516 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0e93e64f-fead-44cc-b7d5-653f4a38e99b tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:24.199395 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0e93e64f-fead-44cc-b7d5-653f4a38e99b tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:24.200013 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0e93e64f-fead-44cc-b7d5-653f4a38e99b tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:24.200606 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0e93e64f-fead-44cc-b7d5-653f4a38e99b tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:24.231120 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-8682cd2e-cac7-45d6-962d-9e5dbeded0ec tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:24.231712 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-8682cd2e-cac7-45d6-962d-9e5dbeded0ec tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: d5e2bc9f-76da-4028-9b48-d00a8ae20d33] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:24.249704 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8682cd2e-cac7-45d6-962d-9e5dbeded0ec tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:24.250176 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8682cd2e-cac7-45d6-962d-9e5dbeded0ec tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:24.250617 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8682cd2e-cac7-45d6-962d-9e5dbeded0ec tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:24.251337 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8682cd2e-cac7-45d6-962d-9e5dbeded0ec tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:24.252000 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8682cd2e-cac7-45d6-962d-9e5dbeded0ec tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:24.252669 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8682cd2e-cac7-45d6-962d-9e5dbeded0ec tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:24.595277 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-0e93e64f-fead-44cc-b7d5-653f4a38e99b tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608fc9ed7cdb487c9bf4b783c26ceeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29876d6805924df882d6861b0f6ab4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:24.604787 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-0e93e64f-fead-44cc-b7d5-653f4a38e99b tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] 10.222.0.43 "GET /compute/v2.1/servers/cf78a645-458e-4dc2-a60d-a51754ab6258" status: 200 len: 1472 microversion: 2.1 time: 0.424351 Oct 04 18:45:24.609013 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1758/3334] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:24 2022] GET /compute/v2.1/servers/cf78a645-458e-4dc2-a60d-a51754ab6258 => generated 1472 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:24.839719 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-8682cd2e-cac7-45d6-962d-9e5dbeded0ec tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:24.849457 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-8682cd2e-cac7-45d6-962d-9e5dbeded0ec tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/d5e2bc9f-76da-4028-9b48-d00a8ae20d33" status: 200 len: 1511 microversion: 2.1 time: 0.622994 Oct 04 18:45:24.849980 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1577/3335] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:24 2022] GET /compute/v2.1/servers/d5e2bc9f-76da-4028-9b48-d00a8ae20d33 => generated 1511 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:25.106398 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-58e5d78d-603c-4171-aac3-430355158068 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:25.107396 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-58e5d78d-603c-4171-aac3-430355158068 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] [instance: 6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:25.114528 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-58e5d78d-603c-4171-aac3-430355158068 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:25.124247 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-760b90db-af5b-461f-98a2-0c3b60fa9fb3 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:25.125573 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-760b90db-af5b-461f-98a2-0c3b60fa9fb3 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] [instance: b28a95a5-c6c2-4781-8c1a-62e7d3eac5a7] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:25.125886 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-58e5d78d-603c-4171-aac3-430355158068 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:25.126529 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-58e5d78d-603c-4171-aac3-430355158068 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:25.127837 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-58e5d78d-603c-4171-aac3-430355158068 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:25.128498 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-58e5d78d-603c-4171-aac3-430355158068 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:25.129776 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-58e5d78d-603c-4171-aac3-430355158068 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:25.142343 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-760b90db-af5b-461f-98a2-0c3b60fa9fb3 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:25.142863 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-760b90db-af5b-461f-98a2-0c3b60fa9fb3 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:25.143308 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-760b90db-af5b-461f-98a2-0c3b60fa9fb3 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:25.147033 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-760b90db-af5b-461f-98a2-0c3b60fa9fb3 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:25.147554 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-760b90db-af5b-461f-98a2-0c3b60fa9fb3 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:25.147992 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-760b90db-af5b-461f-98a2-0c3b60fa9fb3 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:25.452855 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-760b90db-af5b-461f-98a2-0c3b60fa9fb3 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c710f394164b89b16bcac2fe51c58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65037d4ea5124d749e42928032e803fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:25.474243 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-760b90db-af5b-461f-98a2-0c3b60fa9fb3 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] 10.222.0.43 "GET /compute/v2.1/servers/b28a95a5-c6c2-4781-8c1a-62e7d3eac5a7" status: 200 len: 1514 microversion: 2.1 time: 0.346122 Oct 04 18:45:25.476754 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1578/3336] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:25 2022] GET /compute/v2.1/servers/b28a95a5-c6c2-4781-8c1a-62e7d3eac5a7 => generated 1514 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:45:25.511634 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-58e5d78d-603c-4171-aac3-430355158068 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9971b5861f44c1a1da94eda0f8f02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f809b8ae704988961908bef0f3cb24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:25.525977 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-58e5d78d-603c-4171-aac3-430355158068 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] 10.222.0.43 "GET /compute/v2.1/servers/6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75" status: 200 len: 1718 microversion: 2.1 time: 0.424170 Oct 04 18:45:25.527903 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1759/3337] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:25 2022] GET /compute/v2.1/servers/6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75 => generated 1718 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:25.636054 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-2c5c5602-39a0-4066-b1d8-ccbd22521e64 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:25.636798 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-2c5c5602-39a0-4066-b1d8-ccbd22521e64 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] [instance: cf78a645-458e-4dc2-a60d-a51754ab6258] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:25.649584 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2c5c5602-39a0-4066-b1d8-ccbd22521e64 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:25.650150 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2c5c5602-39a0-4066-b1d8-ccbd22521e64 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:25.650847 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2c5c5602-39a0-4066-b1d8-ccbd22521e64 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:25.651928 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2c5c5602-39a0-4066-b1d8-ccbd22521e64 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:25.652624 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2c5c5602-39a0-4066-b1d8-ccbd22521e64 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:25.654527 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2c5c5602-39a0-4066-b1d8-ccbd22521e64 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:25.873757 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-b9450dff-36a4-4606-965d-96ee59b429d1 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:25.874684 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-b9450dff-36a4-4606-965d-96ee59b429d1 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: d5e2bc9f-76da-4028-9b48-d00a8ae20d33] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:25.891944 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b9450dff-36a4-4606-965d-96ee59b429d1 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:25.892647 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b9450dff-36a4-4606-965d-96ee59b429d1 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:25.894447 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b9450dff-36a4-4606-965d-96ee59b429d1 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:25.900532 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b9450dff-36a4-4606-965d-96ee59b429d1 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:25.900532 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b9450dff-36a4-4606-965d-96ee59b429d1 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:25.901822 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b9450dff-36a4-4606-965d-96ee59b429d1 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:25.904355 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-2c5c5602-39a0-4066-b1d8-ccbd22521e64 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608fc9ed7cdb487c9bf4b783c26ceeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29876d6805924df882d6861b0f6ab4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:25.919442 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-2c5c5602-39a0-4066-b1d8-ccbd22521e64 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] 10.222.0.43 "GET /compute/v2.1/servers/cf78a645-458e-4dc2-a60d-a51754ab6258" status: 200 len: 1478 microversion: 2.1 time: 0.287714 Oct 04 18:45:25.920325 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1579/3338] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:25 2022] GET /compute/v2.1/servers/cf78a645-458e-4dc2-a60d-a51754ab6258 => generated 1478 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:26.273665 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-b9450dff-36a4-4606-965d-96ee59b429d1 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:26.285199 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-b9450dff-36a4-4606-965d-96ee59b429d1 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/d5e2bc9f-76da-4028-9b48-d00a8ae20d33" status: 200 len: 1511 microversion: 2.1 time: 0.416731 Oct 04 18:45:26.306108 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1760/3339] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:25 2022] GET /compute/v2.1/servers/d5e2bc9f-76da-4028-9b48-d00a8ae20d33 => generated 1511 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:26.501668 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-1fec7f54-3446-4317-ad50-31d1843b1c21 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:26.502484 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-1fec7f54-3446-4317-ad50-31d1843b1c21 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] [instance: b28a95a5-c6c2-4781-8c1a-62e7d3eac5a7] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:26.514954 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1fec7f54-3446-4317-ad50-31d1843b1c21 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:26.520600 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1fec7f54-3446-4317-ad50-31d1843b1c21 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:26.521401 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1fec7f54-3446-4317-ad50-31d1843b1c21 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:26.522350 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1fec7f54-3446-4317-ad50-31d1843b1c21 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:26.522981 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1fec7f54-3446-4317-ad50-31d1843b1c21 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:26.524381 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1fec7f54-3446-4317-ad50-31d1843b1c21 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:26.551050 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-056ad30e-fba6-4be5-92fd-b3269c15c4d0 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:26.551823 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-056ad30e-fba6-4be5-92fd-b3269c15c4d0 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] [instance: 6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:26.571387 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-056ad30e-fba6-4be5-92fd-b3269c15c4d0 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:26.572113 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-056ad30e-fba6-4be5-92fd-b3269c15c4d0 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:26.572783 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-056ad30e-fba6-4be5-92fd-b3269c15c4d0 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:26.573730 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-056ad30e-fba6-4be5-92fd-b3269c15c4d0 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:26.574388 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-056ad30e-fba6-4be5-92fd-b3269c15c4d0 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:26.575024 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-056ad30e-fba6-4be5-92fd-b3269c15c4d0 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:26.872398 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-1fec7f54-3446-4317-ad50-31d1843b1c21 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c710f394164b89b16bcac2fe51c58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65037d4ea5124d749e42928032e803fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:26.888775 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-1fec7f54-3446-4317-ad50-31d1843b1c21 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] 10.222.0.43 "GET /compute/v2.1/servers/b28a95a5-c6c2-4781-8c1a-62e7d3eac5a7" status: 200 len: 1514 microversion: 2.1 time: 0.391505 Oct 04 18:45:26.891357 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1580/3340] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:26 2022] GET /compute/v2.1/servers/b28a95a5-c6c2-4781-8c1a-62e7d3eac5a7 => generated 1514 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:26.908638 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-056ad30e-fba6-4be5-92fd-b3269c15c4d0 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9971b5861f44c1a1da94eda0f8f02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f809b8ae704988961908bef0f3cb24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:26.927098 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-056ad30e-fba6-4be5-92fd-b3269c15c4d0 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] 10.222.0.43 "GET /compute/v2.1/servers/6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75" status: 200 len: 1718 microversion: 2.1 time: 0.374048 Oct 04 18:45:26.929740 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1761/3341] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:26 2022] GET /compute/v2.1/servers/6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75 => generated 1718 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:45:26.981612 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-55f85793-5769-4eea-82e4-417824748c6c tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:26.982291 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-55f85793-5769-4eea-82e4-417824748c6c tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] [instance: cf78a645-458e-4dc2-a60d-a51754ab6258] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:26.996359 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-55f85793-5769-4eea-82e4-417824748c6c tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:26.998939 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-55f85793-5769-4eea-82e4-417824748c6c tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:26.999814 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-55f85793-5769-4eea-82e4-417824748c6c tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:27.002360 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-55f85793-5769-4eea-82e4-417824748c6c tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:27.002843 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-55f85793-5769-4eea-82e4-417824748c6c tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:27.004188 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-55f85793-5769-4eea-82e4-417824748c6c tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:27.301919 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-55f85793-5769-4eea-82e4-417824748c6c tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608fc9ed7cdb487c9bf4b783c26ceeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29876d6805924df882d6861b0f6ab4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:27.310533 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-55f85793-5769-4eea-82e4-417824748c6c tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] 10.222.0.43 "GET /compute/v2.1/servers/cf78a645-458e-4dc2-a60d-a51754ab6258" status: 200 len: 1478 microversion: 2.1 time: 0.333978 Oct 04 18:45:27.312669 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-5c9b1e83-9e4b-4c91-a8a3-32c8d87436c6 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:27.313429 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-5c9b1e83-9e4b-4c91-a8a3-32c8d87436c6 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: d5e2bc9f-76da-4028-9b48-d00a8ae20d33] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:27.313893 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1581/3342] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:26 2022] GET /compute/v2.1/servers/cf78a645-458e-4dc2-a60d-a51754ab6258 => generated 1478 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:27.337284 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5c9b1e83-9e4b-4c91-a8a3-32c8d87436c6 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:27.337871 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5c9b1e83-9e4b-4c91-a8a3-32c8d87436c6 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:27.338561 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5c9b1e83-9e4b-4c91-a8a3-32c8d87436c6 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:27.339348 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5c9b1e83-9e4b-4c91-a8a3-32c8d87436c6 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:27.340644 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5c9b1e83-9e4b-4c91-a8a3-32c8d87436c6 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:27.341183 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5c9b1e83-9e4b-4c91-a8a3-32c8d87436c6 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:27.614702 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-5c9b1e83-9e4b-4c91-a8a3-32c8d87436c6 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:27.623788 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-5c9b1e83-9e4b-4c91-a8a3-32c8d87436c6 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/d5e2bc9f-76da-4028-9b48-d00a8ae20d33" status: 200 len: 1511 microversion: 2.1 time: 0.314916 Oct 04 18:45:27.638149 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1762/3343] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:27 2022] GET /compute/v2.1/servers/d5e2bc9f-76da-4028-9b48-d00a8ae20d33 => generated 1511 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:27.916066 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-d6bc6278-8d87-4177-9d4f-dead698e9352 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:27.917629 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-d6bc6278-8d87-4177-9d4f-dead698e9352 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] [instance: b28a95a5-c6c2-4781-8c1a-62e7d3eac5a7] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:27.929772 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d6bc6278-8d87-4177-9d4f-dead698e9352 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:27.937627 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d6bc6278-8d87-4177-9d4f-dead698e9352 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:27.938186 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d6bc6278-8d87-4177-9d4f-dead698e9352 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:27.938972 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d6bc6278-8d87-4177-9d4f-dead698e9352 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:27.939459 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d6bc6278-8d87-4177-9d4f-dead698e9352 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:27.940003 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d6bc6278-8d87-4177-9d4f-dead698e9352 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:27.958385 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-1042c34e-a502-4a94-ab1d-c84791c553e9 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:27.960544 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-1042c34e-a502-4a94-ab1d-c84791c553e9 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] [instance: 6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:27.978044 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1042c34e-a502-4a94-ab1d-c84791c553e9 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:27.982935 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1042c34e-a502-4a94-ab1d-c84791c553e9 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:27.989545 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1042c34e-a502-4a94-ab1d-c84791c553e9 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:27.992922 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1042c34e-a502-4a94-ab1d-c84791c553e9 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:27.995227 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1042c34e-a502-4a94-ab1d-c84791c553e9 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:27.998716 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1042c34e-a502-4a94-ab1d-c84791c553e9 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:28.210911 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-d6bc6278-8d87-4177-9d4f-dead698e9352 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c710f394164b89b16bcac2fe51c58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65037d4ea5124d749e42928032e803fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:28.214666 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=100 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:45:28.220446 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-d6bc6278-8d87-4177-9d4f-dead698e9352 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] 10.222.0.43 "GET /compute/v2.1/servers/b28a95a5-c6c2-4781-8c1a-62e7d3eac5a7" status: 200 len: 1514 microversion: 2.1 time: 0.310610 Oct 04 18:45:28.221301 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1582/3344] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:27 2022] GET /compute/v2.1/servers/b28a95a5-c6c2-4781-8c1a-62e7d3eac5a7 => generated 1514 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:28.338621 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-777fe7a9-b56b-4704-b3db-d746c8de76b4 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:28.339728 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-777fe7a9-b56b-4704-b3db-d746c8de76b4 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] [instance: cf78a645-458e-4dc2-a60d-a51754ab6258] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:28.351770 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-777fe7a9-b56b-4704-b3db-d746c8de76b4 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:28.353577 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-777fe7a9-b56b-4704-b3db-d746c8de76b4 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:28.354228 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-777fe7a9-b56b-4704-b3db-d746c8de76b4 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:28.361174 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-777fe7a9-b56b-4704-b3db-d746c8de76b4 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:28.362086 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-777fe7a9-b56b-4704-b3db-d746c8de76b4 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:28.362805 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-777fe7a9-b56b-4704-b3db-d746c8de76b4 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:28.546542 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-1042c34e-a502-4a94-ab1d-c84791c553e9 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9971b5861f44c1a1da94eda0f8f02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f809b8ae704988961908bef0f3cb24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:28.553063 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:45:28.569902 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-1042c34e-a502-4a94-ab1d-c84791c553e9 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] 10.222.0.43 "GET /compute/v2.1/servers/6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75" status: 200 len: 1718 microversion: 2.1 time: 0.621819 Oct 04 18:45:28.586620 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1763/3345] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:27 2022] GET /compute/v2.1/servers/6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75 => generated 1718 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:28.655421 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-fbc600d1-78d1-40ba-8320-80329664d3d1 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:28.656410 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-fbc600d1-78d1-40ba-8320-80329664d3d1 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: d5e2bc9f-76da-4028-9b48-d00a8ae20d33] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:28.672534 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fbc600d1-78d1-40ba-8320-80329664d3d1 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:28.673421 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fbc600d1-78d1-40ba-8320-80329664d3d1 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:28.674077 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fbc600d1-78d1-40ba-8320-80329664d3d1 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:28.675000 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fbc600d1-78d1-40ba-8320-80329664d3d1 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:28.678467 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fbc600d1-78d1-40ba-8320-80329664d3d1 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:28.679172 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fbc600d1-78d1-40ba-8320-80329664d3d1 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:28.701145 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-777fe7a9-b56b-4704-b3db-d746c8de76b4 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608fc9ed7cdb487c9bf4b783c26ceeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29876d6805924df882d6861b0f6ab4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:28.711023 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-777fe7a9-b56b-4704-b3db-d746c8de76b4 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] 10.222.0.43 "GET /compute/v2.1/servers/cf78a645-458e-4dc2-a60d-a51754ab6258" status: 200 len: 1478 microversion: 2.1 time: 0.377471 Oct 04 18:45:28.724379 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1583/3346] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:28 2022] GET /compute/v2.1/servers/cf78a645-458e-4dc2-a60d-a51754ab6258 => generated 1478 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:45:29.059152 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-fbc600d1-78d1-40ba-8320-80329664d3d1 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:29.075235 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-fbc600d1-78d1-40ba-8320-80329664d3d1 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/d5e2bc9f-76da-4028-9b48-d00a8ae20d33" status: 200 len: 1511 microversion: 2.1 time: 0.426233 Oct 04 18:45:29.075850 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1764/3347] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:28 2022] GET /compute/v2.1/servers/d5e2bc9f-76da-4028-9b48-d00a8ae20d33 => generated 1511 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:29.246039 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-1a45c46a-58eb-4eeb-a505-b7ea12cbfc30 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:29.248352 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-1a45c46a-58eb-4eeb-a505-b7ea12cbfc30 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] [instance: b28a95a5-c6c2-4781-8c1a-62e7d3eac5a7] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:29.267676 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1a45c46a-58eb-4eeb-a505-b7ea12cbfc30 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:29.271297 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1a45c46a-58eb-4eeb-a505-b7ea12cbfc30 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:29.274566 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1a45c46a-58eb-4eeb-a505-b7ea12cbfc30 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:29.277437 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1a45c46a-58eb-4eeb-a505-b7ea12cbfc30 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:29.279191 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1a45c46a-58eb-4eeb-a505-b7ea12cbfc30 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:29.281885 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1a45c46a-58eb-4eeb-a505-b7ea12cbfc30 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:29.598592 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-7b71247c-9969-434f-a308-bb585b1dce95 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:29.599211 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-7b71247c-9969-434f-a308-bb585b1dce95 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] [instance: 6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:29.625727 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7b71247c-9969-434f-a308-bb585b1dce95 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:29.626889 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7b71247c-9969-434f-a308-bb585b1dce95 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:29.627350 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7b71247c-9969-434f-a308-bb585b1dce95 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:29.628092 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7b71247c-9969-434f-a308-bb585b1dce95 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:29.633460 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7b71247c-9969-434f-a308-bb585b1dce95 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:29.634655 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7b71247c-9969-434f-a308-bb585b1dce95 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:29.784544 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-1a45c46a-58eb-4eeb-a505-b7ea12cbfc30 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c710f394164b89b16bcac2fe51c58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65037d4ea5124d749e42928032e803fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:29.805980 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-1a45c46a-58eb-4eeb-a505-b7ea12cbfc30 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] 10.222.0.43 "GET /compute/v2.1/servers/b28a95a5-c6c2-4781-8c1a-62e7d3eac5a7" status: 200 len: 1514 microversion: 2.1 time: 0.565276 Oct 04 18:45:29.806783 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1584/3348] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:29 2022] GET /compute/v2.1/servers/b28a95a5-c6c2-4781-8c1a-62e7d3eac5a7 => generated 1514 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:29.825061 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-a4d8e8a2-c46d-4b77-9869-b3872383d604 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:29.834068 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-a4d8e8a2-c46d-4b77-9869-b3872383d604 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] [instance: cf78a645-458e-4dc2-a60d-a51754ab6258] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:29.852063 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a4d8e8a2-c46d-4b77-9869-b3872383d604 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:29.853243 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a4d8e8a2-c46d-4b77-9869-b3872383d604 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:29.855294 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a4d8e8a2-c46d-4b77-9869-b3872383d604 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:29.857020 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a4d8e8a2-c46d-4b77-9869-b3872383d604 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:29.861757 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a4d8e8a2-c46d-4b77-9869-b3872383d604 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:29.862142 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a4d8e8a2-c46d-4b77-9869-b3872383d604 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:29.942420 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-7b71247c-9969-434f-a308-bb585b1dce95 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9971b5861f44c1a1da94eda0f8f02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f809b8ae704988961908bef0f3cb24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:29.958952 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-7b71247c-9969-434f-a308-bb585b1dce95 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] 10.222.0.43 "GET /compute/v2.1/servers/6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75" status: 200 len: 1718 microversion: 2.1 time: 0.361830 Oct 04 18:45:29.973165 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1765/3349] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:29 2022] GET /compute/v2.1/servers/6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75 => generated 1718 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:30.100048 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-62357d65-468c-4a95-8d97-e3ce2990a629 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:30.100606 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-62357d65-468c-4a95-8d97-e3ce2990a629 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: d5e2bc9f-76da-4028-9b48-d00a8ae20d33] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:30.122720 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-62357d65-468c-4a95-8d97-e3ce2990a629 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:30.131545 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-62357d65-468c-4a95-8d97-e3ce2990a629 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:30.133486 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-62357d65-468c-4a95-8d97-e3ce2990a629 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:30.138791 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-62357d65-468c-4a95-8d97-e3ce2990a629 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:30.141716 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-62357d65-468c-4a95-8d97-e3ce2990a629 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:30.148894 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-62357d65-468c-4a95-8d97-e3ce2990a629 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:30.447358 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-a4d8e8a2-c46d-4b77-9869-b3872383d604 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608fc9ed7cdb487c9bf4b783c26ceeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29876d6805924df882d6861b0f6ab4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:30.458944 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-a4d8e8a2-c46d-4b77-9869-b3872383d604 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] 10.222.0.43 "GET /compute/v2.1/servers/cf78a645-458e-4dc2-a60d-a51754ab6258" status: 200 len: 1478 microversion: 2.1 time: 0.651272 Oct 04 18:45:30.482508 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1585/3350] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:29 2022] GET /compute/v2.1/servers/cf78a645-458e-4dc2-a60d-a51754ab6258 => generated 1478 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:30.671441 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-62357d65-468c-4a95-8d97-e3ce2990a629 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:30.684650 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-62357d65-468c-4a95-8d97-e3ce2990a629 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/d5e2bc9f-76da-4028-9b48-d00a8ae20d33" status: 200 len: 1511 microversion: 2.1 time: 0.588440 Oct 04 18:45:30.685370 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1766/3351] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:30 2022] GET /compute/v2.1/servers/d5e2bc9f-76da-4028-9b48-d00a8ae20d33 => generated 1511 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:30.854146 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-989236e0-5d2b-4a2f-bdab-1e56daf3a2d3 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:30.856005 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-989236e0-5d2b-4a2f-bdab-1e56daf3a2d3 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] [instance: b28a95a5-c6c2-4781-8c1a-62e7d3eac5a7] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:30.882249 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-989236e0-5d2b-4a2f-bdab-1e56daf3a2d3 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:30.882999 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-989236e0-5d2b-4a2f-bdab-1e56daf3a2d3 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:30.886332 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-989236e0-5d2b-4a2f-bdab-1e56daf3a2d3 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:30.890362 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-989236e0-5d2b-4a2f-bdab-1e56daf3a2d3 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:30.892323 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-989236e0-5d2b-4a2f-bdab-1e56daf3a2d3 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:30.893026 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-989236e0-5d2b-4a2f-bdab-1e56daf3a2d3 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:30.926164 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-6907c066-5780-43ca-ac8f-9bfb634024f4 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Action: 'create', calling method: .version_select at 0x7fb21ea78a60>, body: {"keypair": {"name": "tempest-keypair-1444947530", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAczSGSlsh3x77ynXt/I83MH3zKYIOo+KYYG5igap10z9KgcGjT+66/tutaZ2X+EHPYnX0pryvXEKzqVVZ/dY+xxA/OHu8rg0T8DcXjYsfdCjTPXwmVl2E74Y2TlfVsA3Q=="}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:45:30.970463 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-6907c066-5780-43ca-ac8f-9bfb634024f4 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Getting quotas for project 98ecf69d8220477bb3006361f7a67825. Resources: {'key_pairs'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:45:30.985915 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-6907c066-5780-43ca-ac8f-9bfb634024f4 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Getting quotas for user a0de7f497fae40aa885875065db35656 and project 98ecf69d8220477bb3006361f7a67825. Resources: {'key_pairs'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:45:31.020807 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-6907c066-5780-43ca-ac8f-9bfb634024f4 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.32 time: 0.098706 Oct 04 18:45:31.021466 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1767/3352] 10.222.0.43 () {62 vars in 1200 bytes} [Tue Oct 4 18:45:30 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 100 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 04 18:45:31.037390 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f32e2ba7-f085-44db-8448-07f865f31fc9 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:31.038428 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-f32e2ba7-f085-44db-8448-07f865f31fc9 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] [instance: 6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:31.046458 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f32e2ba7-f085-44db-8448-07f865f31fc9 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:31.047186 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f32e2ba7-f085-44db-8448-07f865f31fc9 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:31.047816 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f32e2ba7-f085-44db-8448-07f865f31fc9 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:31.048700 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f32e2ba7-f085-44db-8448-07f865f31fc9 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:31.049884 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f32e2ba7-f085-44db-8448-07f865f31fc9 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:31.050480 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f32e2ba7-f085-44db-8448-07f865f31fc9 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:31.230549 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-989236e0-5d2b-4a2f-bdab-1e56daf3a2d3 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c710f394164b89b16bcac2fe51c58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65037d4ea5124d749e42928032e803fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:31.239493 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-989236e0-5d2b-4a2f-bdab-1e56daf3a2d3 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] 10.222.0.43 "GET /compute/v2.1/servers/b28a95a5-c6c2-4781-8c1a-62e7d3eac5a7" status: 200 len: 1520 microversion: 2.1 time: 0.403231 Oct 04 18:45:31.253737 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1586/3353] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:30 2022] GET /compute/v2.1/servers/b28a95a5-c6c2-4781-8c1a-62e7d3eac5a7 => generated 1520 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:31.495069 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-601d42c6-0cd5-46b5-bbba-94be4b91373a tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:31.495807 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-601d42c6-0cd5-46b5-bbba-94be4b91373a tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] [instance: cf78a645-458e-4dc2-a60d-a51754ab6258] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:31.515620 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-601d42c6-0cd5-46b5-bbba-94be4b91373a tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:31.516121 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-601d42c6-0cd5-46b5-bbba-94be4b91373a tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:31.516770 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-601d42c6-0cd5-46b5-bbba-94be4b91373a tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:31.521452 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-601d42c6-0cd5-46b5-bbba-94be4b91373a tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:31.522428 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-601d42c6-0cd5-46b5-bbba-94be4b91373a tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:31.523082 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-601d42c6-0cd5-46b5-bbba-94be4b91373a tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:31.543758 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-f32e2ba7-f085-44db-8448-07f865f31fc9 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9971b5861f44c1a1da94eda0f8f02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f809b8ae704988961908bef0f3cb24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:31.562448 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-f32e2ba7-f085-44db-8448-07f865f31fc9 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] 10.222.0.43 "GET /compute/v2.1/servers/6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75" status: 200 len: 1718 microversion: 2.1 time: 0.539135 Oct 04 18:45:31.582716 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1768/3354] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:31 2022] GET /compute/v2.1/servers/6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75 => generated 1718 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:31.712855 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-9418432a-a396-4813-bbb5-7d7edb88da9b tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:31.713521 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-9418432a-a396-4813-bbb5-7d7edb88da9b tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: d5e2bc9f-76da-4028-9b48-d00a8ae20d33] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:31.727063 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9418432a-a396-4813-bbb5-7d7edb88da9b tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:31.727929 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9418432a-a396-4813-bbb5-7d7edb88da9b tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:31.728843 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9418432a-a396-4813-bbb5-7d7edb88da9b tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:31.730023 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9418432a-a396-4813-bbb5-7d7edb88da9b tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:31.730697 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9418432a-a396-4813-bbb5-7d7edb88da9b tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:31.731303 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9418432a-a396-4813-bbb5-7d7edb88da9b tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:31.842660 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-601d42c6-0cd5-46b5-bbba-94be4b91373a tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608fc9ed7cdb487c9bf4b783c26ceeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29876d6805924df882d6861b0f6ab4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:31.851589 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-601d42c6-0cd5-46b5-bbba-94be4b91373a tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] 10.222.0.43 "GET /compute/v2.1/servers/cf78a645-458e-4dc2-a60d-a51754ab6258" status: 200 len: 1478 microversion: 2.1 time: 0.360991 Oct 04 18:45:31.858058 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1587/3355] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:31 2022] GET /compute/v2.1/servers/cf78a645-458e-4dc2-a60d-a51754ab6258 => generated 1478 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:32.281299 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-03aa9454-405d-4fd1-b660-d256763ee404 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:32.282289 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-03aa9454-405d-4fd1-b660-d256763ee404 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] [instance: b28a95a5-c6c2-4781-8c1a-62e7d3eac5a7] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:32.303285 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-03aa9454-405d-4fd1-b660-d256763ee404 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:32.303783 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-03aa9454-405d-4fd1-b660-d256763ee404 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:32.304582 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-03aa9454-405d-4fd1-b660-d256763ee404 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:32.305525 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-03aa9454-405d-4fd1-b660-d256763ee404 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:32.307074 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-03aa9454-405d-4fd1-b660-d256763ee404 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:32.309079 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-03aa9454-405d-4fd1-b660-d256763ee404 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:32.463685 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-9418432a-a396-4813-bbb5-7d7edb88da9b tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:32.476633 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-9418432a-a396-4813-bbb5-7d7edb88da9b tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/d5e2bc9f-76da-4028-9b48-d00a8ae20d33" status: 200 len: 1511 microversion: 2.1 time: 0.771272 Oct 04 18:45:32.478949 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1769/3356] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:31 2022] GET /compute/v2.1/servers/d5e2bc9f-76da-4028-9b48-d00a8ae20d33 => generated 1511 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:45:32.588029 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-a946ed36-0267-4e4c-80e9-3d7fddf0d4aa tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:32.590586 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-a946ed36-0267-4e4c-80e9-3d7fddf0d4aa tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] [instance: 6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:32.599019 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a946ed36-0267-4e4c-80e9-3d7fddf0d4aa tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:32.599975 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a946ed36-0267-4e4c-80e9-3d7fddf0d4aa tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:32.602435 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a946ed36-0267-4e4c-80e9-3d7fddf0d4aa tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:32.603594 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a946ed36-0267-4e4c-80e9-3d7fddf0d4aa tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:32.604287 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a946ed36-0267-4e4c-80e9-3d7fddf0d4aa tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:32.604886 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a946ed36-0267-4e4c-80e9-3d7fddf0d4aa tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:32.626070 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-03aa9454-405d-4fd1-b660-d256763ee404 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c710f394164b89b16bcac2fe51c58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65037d4ea5124d749e42928032e803fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:32.643243 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-03aa9454-405d-4fd1-b660-d256763ee404 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] 10.222.0.43 "GET /compute/v2.1/servers/b28a95a5-c6c2-4781-8c1a-62e7d3eac5a7" status: 200 len: 1520 microversion: 2.1 time: 0.367276 Oct 04 18:45:32.644514 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1588/3357] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:32 2022] GET /compute/v2.1/servers/b28a95a5-c6c2-4781-8c1a-62e7d3eac5a7 => generated 1520 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:32.880360 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-9a770162-040d-478a-a81f-111238e73ea2 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:32.881264 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-9a770162-040d-478a-a81f-111238e73ea2 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] [instance: cf78a645-458e-4dc2-a60d-a51754ab6258] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:32.888581 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_api:SELECT=100 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:45:32.896291 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9a770162-040d-478a-a81f-111238e73ea2 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:32.904149 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9a770162-040d-478a-a81f-111238e73ea2 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:32.904849 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9a770162-040d-478a-a81f-111238e73ea2 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:32.905822 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9a770162-040d-478a-a81f-111238e73ea2 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:32.906775 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9a770162-040d-478a-a81f-111238e73ea2 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:32.908557 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9a770162-040d-478a-a81f-111238e73ea2 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:33.033804 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-a946ed36-0267-4e4c-80e9-3d7fddf0d4aa tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9971b5861f44c1a1da94eda0f8f02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f809b8ae704988961908bef0f3cb24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:33.071098 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-a946ed36-0267-4e4c-80e9-3d7fddf0d4aa tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] 10.222.0.43 "GET /compute/v2.1/servers/6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75" status: 200 len: 1718 microversion: 2.1 time: 0.485324 Oct 04 18:45:33.086308 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1770/3358] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:32 2022] GET /compute/v2.1/servers/6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75 => generated 1718 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:45:33.294405 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-ad9e9af4-9778-4749-8f0b-6ce3d61c942f req-cc73ebe1-c76a-4e11-b538-d866c75c5103 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf78a645-458e-4dc2-a60d-a51754ab6258", "name": "network-vif-plugged", "status": "completed", "tag": "68b980e1-728c-40ba-bdae-e6a747ef6688"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:45:33.330642 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-ad9e9af4-9778-4749-8f0b-6ce3d61c942f req-cc73ebe1-c76a-4e11-b538-d866c75c5103 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:33.331131 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-ad9e9af4-9778-4749-8f0b-6ce3d61c942f req-cc73ebe1-c76a-4e11-b538-d866c75c5103 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:33.335995 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-ad9e9af4-9778-4749-8f0b-6ce3d61c942f req-cc73ebe1-c76a-4e11-b538-d866c75c5103 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:33.368169 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-ad9e9af4-9778-4749-8f0b-6ce3d61c942f req-cc73ebe1-c76a-4e11-b538-d866c75c5103 service nova] Creating event network-vif-plugged:68b980e1-728c-40ba-bdae-e6a747ef6688 for instance cf78a645-458e-4dc2-a60d-a51754ab6258 on n-h2-851028-13 Oct 04 18:45:33.385339 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-ad9e9af4-9778-4749-8f0b-6ce3d61c942f req-cc73ebe1-c76a-4e11-b538-d866c75c5103 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091383 Oct 04 18:45:33.386980 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1771/3359] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:45:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:45:33.512560 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-ac0bc894-62d1-404c-9281-d80bf6c634c3 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:33.515753 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-ac0bc894-62d1-404c-9281-d80bf6c634c3 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: d5e2bc9f-76da-4028-9b48-d00a8ae20d33] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:33.540312 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ac0bc894-62d1-404c-9281-d80bf6c634c3 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:33.547471 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ac0bc894-62d1-404c-9281-d80bf6c634c3 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:33.548280 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ac0bc894-62d1-404c-9281-d80bf6c634c3 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:33.555353 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ac0bc894-62d1-404c-9281-d80bf6c634c3 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:33.555923 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ac0bc894-62d1-404c-9281-d80bf6c634c3 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:33.556378 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ac0bc894-62d1-404c-9281-d80bf6c634c3 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:34.089061 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-ac0bc894-62d1-404c-9281-d80bf6c634c3 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:34.110628 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-ac0bc894-62d1-404c-9281-d80bf6c634c3 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/d5e2bc9f-76da-4028-9b48-d00a8ae20d33" status: 200 len: 1511 microversion: 2.1 time: 0.608348 Oct 04 18:45:34.112074 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1772/3360] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:33 2022] GET /compute/v2.1/servers/d5e2bc9f-76da-4028-9b48-d00a8ae20d33 => generated 1511 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:45:34.125999 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-e3d495f0-d364-4ee6-8253-03b22ce75598 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:34.131527 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-e3d495f0-d364-4ee6-8253-03b22ce75598 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] [instance: b28a95a5-c6c2-4781-8c1a-62e7d3eac5a7] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:34.173470 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e3d495f0-d364-4ee6-8253-03b22ce75598 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:34.175822 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e3d495f0-d364-4ee6-8253-03b22ce75598 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:34.176479 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e3d495f0-d364-4ee6-8253-03b22ce75598 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:34.177533 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e3d495f0-d364-4ee6-8253-03b22ce75598 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:34.178785 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e3d495f0-d364-4ee6-8253-03b22ce75598 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:34.179406 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e3d495f0-d364-4ee6-8253-03b22ce75598 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:34.332157 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-9a770162-040d-478a-a81f-111238e73ea2 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608fc9ed7cdb487c9bf4b783c26ceeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29876d6805924df882d6861b0f6ab4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:34.343934 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-9a770162-040d-478a-a81f-111238e73ea2 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] 10.222.0.43 "GET /compute/v2.1/servers/cf78a645-458e-4dc2-a60d-a51754ab6258" status: 200 len: 1478 microversion: 2.1 time: 1.464966 Oct 04 18:45:34.347008 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1589/3361] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:32 2022] GET /compute/v2.1/servers/cf78a645-458e-4dc2-a60d-a51754ab6258 => generated 1478 bytes in 1472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:34.368439 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-1f0b0354-2b93-44e8-b4e9-a482cc70c628 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:34.371075 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-1f0b0354-2b93-44e8-b4e9-a482cc70c628 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] [instance: 6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:34.391023 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1f0b0354-2b93-44e8-b4e9-a482cc70c628 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:34.391546 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1f0b0354-2b93-44e8-b4e9-a482cc70c628 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:34.391996 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1f0b0354-2b93-44e8-b4e9-a482cc70c628 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:34.393404 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1f0b0354-2b93-44e8-b4e9-a482cc70c628 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:34.393875 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1f0b0354-2b93-44e8-b4e9-a482cc70c628 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:34.395075 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1f0b0354-2b93-44e8-b4e9-a482cc70c628 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:34.749963 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-e3d495f0-d364-4ee6-8253-03b22ce75598 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c710f394164b89b16bcac2fe51c58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65037d4ea5124d749e42928032e803fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:34.759670 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-e3d495f0-d364-4ee6-8253-03b22ce75598 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] 10.222.0.43 "GET /compute/v2.1/servers/b28a95a5-c6c2-4781-8c1a-62e7d3eac5a7" status: 200 len: 1520 microversion: 2.1 time: 0.644844 Oct 04 18:45:34.770254 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1773/3362] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:34 2022] GET /compute/v2.1/servers/b28a95a5-c6c2-4781-8c1a-62e7d3eac5a7 => generated 1520 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:34.812747 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-1f0b0354-2b93-44e8-b4e9-a482cc70c628 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9971b5861f44c1a1da94eda0f8f02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f809b8ae704988961908bef0f3cb24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:34.826214 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-1f0b0354-2b93-44e8-b4e9-a482cc70c628 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] 10.222.0.43 "GET /compute/v2.1/servers/6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75" status: 200 len: 1718 microversion: 2.1 time: 0.478001 Oct 04 18:45:34.827077 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1590/3363] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:34 2022] GET /compute/v2.1/servers/6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75 => generated 1718 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:35.140878 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-1332704f-37d8-4b0d-9460-dc2722520183 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:35.142772 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-1332704f-37d8-4b0d-9460-dc2722520183 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: d5e2bc9f-76da-4028-9b48-d00a8ae20d33] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:35.161513 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1332704f-37d8-4b0d-9460-dc2722520183 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:35.162091 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1332704f-37d8-4b0d-9460-dc2722520183 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:35.163109 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1332704f-37d8-4b0d-9460-dc2722520183 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:35.164515 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1332704f-37d8-4b0d-9460-dc2722520183 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:35.165663 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1332704f-37d8-4b0d-9460-dc2722520183 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:35.166291 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1332704f-37d8-4b0d-9460-dc2722520183 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:35.374628 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-f36108df-8ec9-423a-b2fa-fd10a54ac1be tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:35.375227 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-f36108df-8ec9-423a-b2fa-fd10a54ac1be tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] [instance: cf78a645-458e-4dc2-a60d-a51754ab6258] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:35.386331 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f36108df-8ec9-423a-b2fa-fd10a54ac1be tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:35.389092 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f36108df-8ec9-423a-b2fa-fd10a54ac1be tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:35.389748 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f36108df-8ec9-423a-b2fa-fd10a54ac1be tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:35.390797 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f36108df-8ec9-423a-b2fa-fd10a54ac1be tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:35.391441 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f36108df-8ec9-423a-b2fa-fd10a54ac1be tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:35.391879 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f36108df-8ec9-423a-b2fa-fd10a54ac1be tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:35.493846 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-1332704f-37d8-4b0d-9460-dc2722520183 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:35.502767 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-1332704f-37d8-4b0d-9460-dc2722520183 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/d5e2bc9f-76da-4028-9b48-d00a8ae20d33" status: 200 len: 1511 microversion: 2.1 time: 0.368330 Oct 04 18:45:35.507007 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1774/3364] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:35 2022] GET /compute/v2.1/servers/d5e2bc9f-76da-4028-9b48-d00a8ae20d33 => generated 1511 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:35.796432 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-5a017389-7d20-4e24-bd94-72ed34ec938f tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:35.797494 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-5a017389-7d20-4e24-bd94-72ed34ec938f tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] [instance: b28a95a5-c6c2-4781-8c1a-62e7d3eac5a7] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:35.809629 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5a017389-7d20-4e24-bd94-72ed34ec938f tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:35.811454 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5a017389-7d20-4e24-bd94-72ed34ec938f tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:35.812566 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5a017389-7d20-4e24-bd94-72ed34ec938f tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:35.814674 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5a017389-7d20-4e24-bd94-72ed34ec938f tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:35.815472 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5a017389-7d20-4e24-bd94-72ed34ec938f tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:35.818506 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5a017389-7d20-4e24-bd94-72ed34ec938f tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:35.836702 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-f36108df-8ec9-423a-b2fa-fd10a54ac1be tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608fc9ed7cdb487c9bf4b783c26ceeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29876d6805924df882d6861b0f6ab4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:35.867445 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-f36108df-8ec9-423a-b2fa-fd10a54ac1be tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] 10.222.0.43 "GET /compute/v2.1/servers/cf78a645-458e-4dc2-a60d-a51754ab6258" status: 200 len: 1478 microversion: 2.1 time: 0.498439 Oct 04 18:45:35.869207 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1591/3365] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:35 2022] GET /compute/v2.1/servers/cf78a645-458e-4dc2-a60d-a51754ab6258 => generated 1478 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:35.876791 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-bd461cb6-1b64-4c8d-8068-b10a03730516 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:35.882515 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-bd461cb6-1b64-4c8d-8068-b10a03730516 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] [instance: 6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:35.904856 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bd461cb6-1b64-4c8d-8068-b10a03730516 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:35.906241 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bd461cb6-1b64-4c8d-8068-b10a03730516 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:35.907390 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bd461cb6-1b64-4c8d-8068-b10a03730516 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:35.908921 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bd461cb6-1b64-4c8d-8068-b10a03730516 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:35.909772 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bd461cb6-1b64-4c8d-8068-b10a03730516 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:35.910464 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bd461cb6-1b64-4c8d-8068-b10a03730516 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:36.150569 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-5a017389-7d20-4e24-bd94-72ed34ec938f tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c710f394164b89b16bcac2fe51c58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65037d4ea5124d749e42928032e803fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:36.192722 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-5a017389-7d20-4e24-bd94-72ed34ec938f tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] 10.222.0.43 "GET /compute/v2.1/servers/b28a95a5-c6c2-4781-8c1a-62e7d3eac5a7" status: 200 len: 1520 microversion: 2.1 time: 0.400460 Oct 04 18:45:36.195848 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1775/3366] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:35 2022] GET /compute/v2.1/servers/b28a95a5-c6c2-4781-8c1a-62e7d3eac5a7 => generated 1520 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:36.451679 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-bd461cb6-1b64-4c8d-8068-b10a03730516 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9971b5861f44c1a1da94eda0f8f02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f809b8ae704988961908bef0f3cb24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:36.466827 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-bd461cb6-1b64-4c8d-8068-b10a03730516 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] 10.222.0.43 "GET /compute/v2.1/servers/6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75" status: 200 len: 1718 microversion: 2.1 time: 0.596215 Oct 04 18:45:36.486171 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1592/3367] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:35 2022] GET /compute/v2.1/servers/6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75 => generated 1718 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:36.529801 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-af5c7c1e-7d50-412a-8cbe-0c6abcf7f91f tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:36.530443 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-af5c7c1e-7d50-412a-8cbe-0c6abcf7f91f tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: d5e2bc9f-76da-4028-9b48-d00a8ae20d33] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:36.545011 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-af5c7c1e-7d50-412a-8cbe-0c6abcf7f91f tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:36.545011 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-af5c7c1e-7d50-412a-8cbe-0c6abcf7f91f tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:36.545011 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-af5c7c1e-7d50-412a-8cbe-0c6abcf7f91f tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:36.545633 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-af5c7c1e-7d50-412a-8cbe-0c6abcf7f91f tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:36.545798 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-af5c7c1e-7d50-412a-8cbe-0c6abcf7f91f tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:36.548470 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-af5c7c1e-7d50-412a-8cbe-0c6abcf7f91f tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:36.833431 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-5db32c15-0358-4848-9db4-c2224611f34f tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-613946384", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "c594eaf5-40bd-4b94-a736-0d15ef64bf26"}, {"port": "501fb3c2-8b52-4abe-9556-64d2ee5b20db", "tag": "port-1"}, {"port": "39a6795d-0bd0-4b90-a450-c5f7f85686c6", "tag": "port-2"}, {"uuid": "2fb124a5-9ded-46d4-a895-40dbd457ca80", "tag": "net-1"}, {"uuid": "2fb124a5-9ded-46d4-a895-40dbd457ca80"}, {"uuid": "7f84c4ca-4c39-403b-b5a7-6a3be5bd1664", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "7f84c4ca-4c39-403b-b5a7-6a3be5bd1664", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "4171c8e4-84ce-4f4c-b8a8-1d2bf616f9a3", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "cae9f7ae-57c7-4d23-a6a0-d79aa4c4e3ac", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "909e8e6b-e7e8-4c46-bec1-3b7dbe15cc42", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--929282321"}], "key_name": "tempest-keypair-1444947530", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:45:36.974003 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-af5c7c1e-7d50-412a-8cbe-0c6abcf7f91f tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:36.981719 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-af5c7c1e-7d50-412a-8cbe-0c6abcf7f91f tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/d5e2bc9f-76da-4028-9b48-d00a8ae20d33" status: 200 len: 1511 microversion: 2.1 time: 0.457361 Oct 04 18:45:36.998904 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1776/3368] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:36 2022] GET /compute/v2.1/servers/d5e2bc9f-76da-4028-9b48-d00a8ae20d33 => generated 1511 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:37.005490 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-b4e44653-44ba-4da9-9897-cce518e470b9 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:37.006362 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-b4e44653-44ba-4da9-9897-cce518e470b9 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] [instance: cf78a645-458e-4dc2-a60d-a51754ab6258] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:37.013079 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b4e44653-44ba-4da9-9897-cce518e470b9 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:37.013926 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b4e44653-44ba-4da9-9897-cce518e470b9 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:37.014590 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b4e44653-44ba-4da9-9897-cce518e470b9 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:37.015521 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b4e44653-44ba-4da9-9897-cce518e470b9 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:37.016198 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b4e44653-44ba-4da9-9897-cce518e470b9 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:37.016849 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b4e44653-44ba-4da9-9897-cce518e470b9 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:37.056316 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.network.neutron [None req-5db32c15-0358-4848-9db4-c2224611f34f tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] validate_networks() for [('c594eaf5-40bd-4b94-a736-0d15ef64bf26', None, None, None, None, None), (None, None, '501fb3c2-8b52-4abe-9556-64d2ee5b20db', None, None, None), (None, None, '39a6795d-0bd0-4b90-a450-c5f7f85686c6', None, None, None), ('2fb124a5-9ded-46d4-a895-40dbd457ca80', None, None, None, None, None), ('2fb124a5-9ded-46d4-a895-40dbd457ca80', None, None, None, None, None), ('7f84c4ca-4c39-403b-b5a7-6a3be5bd1664', '10.2.2.100', None, None, None, None), ('7f84c4ca-4c39-403b-b5a7-6a3be5bd1664', '10.2.2.200', None, None, None, None)] {{(pid=123595) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:45:37.289434 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-b4e44653-44ba-4da9-9897-cce518e470b9 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608fc9ed7cdb487c9bf4b783c26ceeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29876d6805924df882d6861b0f6ab4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:37.302128 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-b4e44653-44ba-4da9-9897-cce518e470b9 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] 10.222.0.43 "GET /compute/v2.1/servers/cf78a645-458e-4dc2-a60d-a51754ab6258" status: 200 len: 1463 microversion: 2.1 time: 0.301763 Oct 04 18:45:37.313669 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1777/3369] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:36 2022] GET /compute/v2.1/servers/cf78a645-458e-4dc2-a60d-a51754ab6258 => generated 1463 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:37.338432 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-b9fed8a3-4734-4df0-a86a-1a11dd24f41f tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:37.339519 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-b9fed8a3-4734-4df0-a86a-1a11dd24f41f tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] [instance: b28a95a5-c6c2-4781-8c1a-62e7d3eac5a7] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:37.347237 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b9fed8a3-4734-4df0-a86a-1a11dd24f41f tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:37.348603 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b9fed8a3-4734-4df0-a86a-1a11dd24f41f tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:37.349829 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b9fed8a3-4734-4df0-a86a-1a11dd24f41f tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:37.350713 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b9fed8a3-4734-4df0-a86a-1a11dd24f41f tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:37.351333 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b9fed8a3-4734-4df0-a86a-1a11dd24f41f tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:37.352017 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b9fed8a3-4734-4df0-a86a-1a11dd24f41f tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:37.560466 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-b9fed8a3-4734-4df0-a86a-1a11dd24f41f tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c710f394164b89b16bcac2fe51c58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65037d4ea5124d749e42928032e803fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:37.574047 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-b9fed8a3-4734-4df0-a86a-1a11dd24f41f tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] 10.222.0.43 "GET /compute/v2.1/servers/b28a95a5-c6c2-4781-8c1a-62e7d3eac5a7" status: 200 len: 1520 microversion: 2.1 time: 0.258883 Oct 04 18:45:37.577671 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1778/3370] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:37 2022] GET /compute/v2.1/servers/b28a95a5-c6c2-4781-8c1a-62e7d3eac5a7 => generated 1520 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:37.594699 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-6bca52f9-d133-4ba5-a0e3-c9afeff48c79 tempest-ServersAdminTestJSON-1312894221 tempest-ServersAdminTestJSON-1312894221-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:45:37.597138 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-6bca52f9-d133-4ba5-a0e3-c9afeff48c79 tempest-ServersAdminTestJSON-1312894221 tempest-ServersAdminTestJSON-1312894221-project-admin] [instance: cf78a645-458e-4dc2-a60d-a51754ab6258] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:37.604618 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6bca52f9-d133-4ba5-a0e3-c9afeff48c79 tempest-ServersAdminTestJSON-1312894221 tempest-ServersAdminTestJSON-1312894221-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:37.605419 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6bca52f9-d133-4ba5-a0e3-c9afeff48c79 tempest-ServersAdminTestJSON-1312894221 tempest-ServersAdminTestJSON-1312894221-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:37.606030 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6bca52f9-d133-4ba5-a0e3-c9afeff48c79 tempest-ServersAdminTestJSON-1312894221 tempest-ServersAdminTestJSON-1312894221-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:37.606933 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6bca52f9-d133-4ba5-a0e3-c9afeff48c79 tempest-ServersAdminTestJSON-1312894221 tempest-ServersAdminTestJSON-1312894221-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:37.607554 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6bca52f9-d133-4ba5-a0e3-c9afeff48c79 tempest-ServersAdminTestJSON-1312894221 tempest-ServersAdminTestJSON-1312894221-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:37.608145 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6bca52f9-d133-4ba5-a0e3-c9afeff48c79 tempest-ServersAdminTestJSON-1312894221 tempest-ServersAdminTestJSON-1312894221-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:37.765265 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-6bca52f9-d133-4ba5-a0e3-c9afeff48c79 tempest-ServersAdminTestJSON-1312894221 tempest-ServersAdminTestJSON-1312894221-project-admin] 10.222.0.43 "POST /compute/v2.1/servers/cf78a645-458e-4dc2-a60d-a51754ab6258/action" status: 202 len: 0 microversion: 2.1 time: 0.183692 Oct 04 18:45:37.769201 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1779/3371] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 18:45:37 2022] POST /compute/v2.1/servers/cf78a645-458e-4dc2-a60d-a51754ab6258/action => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:45:37.773037 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-066eac9b-9f67-4189-8cfd-45fa4c7f4a32 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:37.773693 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-066eac9b-9f67-4189-8cfd-45fa4c7f4a32 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] [instance: 6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:37.787558 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-066eac9b-9f67-4189-8cfd-45fa4c7f4a32 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:37.787839 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-066eac9b-9f67-4189-8cfd-45fa4c7f4a32 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:37.788412 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-066eac9b-9f67-4189-8cfd-45fa4c7f4a32 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:37.789454 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-066eac9b-9f67-4189-8cfd-45fa4c7f4a32 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:37.790023 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-066eac9b-9f67-4189-8cfd-45fa4c7f4a32 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:37.790737 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-066eac9b-9f67-4189-8cfd-45fa4c7f4a32 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:38.063328 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-066eac9b-9f67-4189-8cfd-45fa4c7f4a32 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9971b5861f44c1a1da94eda0f8f02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f809b8ae704988961908bef0f3cb24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:38.065393 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:45:38.075429 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-066eac9b-9f67-4189-8cfd-45fa4c7f4a32 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] 10.222.0.43 "GET /compute/v2.1/servers/6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75" status: 200 len: 1708 microversion: 2.1 time: 0.305981 Oct 04 18:45:38.089143 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1780/3372] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:37 2022] GET /compute/v2.1/servers/6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75 => generated 1708 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:38.089143 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-371659c4-9916-4969-84fe-7a1804142d9e tempest-ServersAdminTestJSON-1312894221 tempest-ServersAdminTestJSON-1312894221-project-admin] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:38.089143 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-371659c4-9916-4969-84fe-7a1804142d9e tempest-ServersAdminTestJSON-1312894221 tempest-ServersAdminTestJSON-1312894221-project-admin] [instance: cf78a645-458e-4dc2-a60d-a51754ab6258] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:38.091032 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-371659c4-9916-4969-84fe-7a1804142d9e tempest-ServersAdminTestJSON-1312894221 tempest-ServersAdminTestJSON-1312894221-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:38.091948 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-371659c4-9916-4969-84fe-7a1804142d9e tempest-ServersAdminTestJSON-1312894221 tempest-ServersAdminTestJSON-1312894221-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:38.092631 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-371659c4-9916-4969-84fe-7a1804142d9e tempest-ServersAdminTestJSON-1312894221 tempest-ServersAdminTestJSON-1312894221-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:38.093902 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-371659c4-9916-4969-84fe-7a1804142d9e tempest-ServersAdminTestJSON-1312894221 tempest-ServersAdminTestJSON-1312894221-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:38.094618 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-371659c4-9916-4969-84fe-7a1804142d9e tempest-ServersAdminTestJSON-1312894221 tempest-ServersAdminTestJSON-1312894221-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:38.095221 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-371659c4-9916-4969-84fe-7a1804142d9e tempest-ServersAdminTestJSON-1312894221 tempest-ServersAdminTestJSON-1312894221-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:38.144248 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:45:38.148338 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-371659c4-9916-4969-84fe-7a1804142d9e tempest-ServersAdminTestJSON-1312894221 tempest-ServersAdminTestJSON-1312894221-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:38.148844 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-371659c4-9916-4969-84fe-7a1804142d9e tempest-ServersAdminTestJSON-1312894221 tempest-ServersAdminTestJSON-1312894221-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:38.149323 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-371659c4-9916-4969-84fe-7a1804142d9e tempest-ServersAdminTestJSON-1312894221 tempest-ServersAdminTestJSON-1312894221-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:38.149976 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.objects.instance [None req-371659c4-9916-4969-84fe-7a1804142d9e tempest-ServersAdminTestJSON-1312894221 tempest-ServersAdminTestJSON-1312894221-project-admin] Lazy-loading 'fault' on Instance uuid cf78a645-458e-4dc2-a60d-a51754ab6258 {{(pid=123596) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:45:38.386168 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-371659c4-9916-4969-84fe-7a1804142d9e tempest-ServersAdminTestJSON-1312894221 tempest-ServersAdminTestJSON-1312894221-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/cf78a645-458e-4dc2-a60d-a51754ab6258" status: 200 len: 1599 microversion: 2.1 time: 0.305929 Oct 04 18:45:38.390477 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1781/3373] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:38 2022] GET /compute/v2.1/servers/cf78a645-458e-4dc2-a60d-a51754ab6258 => generated 1599 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:38.400405 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-0c3be21b-d83a-4d58-8323-224b84a4ac26 req-c7d1f6a3-bcba-4a2c-9b7a-6b9eb3414a7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b28a95a5-c6c2-4781-8c1a-62e7d3eac5a7", "name": "network-vif-plugged", "status": "completed", "tag": "f42c238a-1ff4-4b31-8e94-8e0d356f5cfb"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:45:38.412355 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-0c3be21b-d83a-4d58-8323-224b84a4ac26 req-c7d1f6a3-bcba-4a2c-9b7a-6b9eb3414a7e service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:38.413168 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-0c3be21b-d83a-4d58-8323-224b84a4ac26 req-c7d1f6a3-bcba-4a2c-9b7a-6b9eb3414a7e service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:38.413772 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-0c3be21b-d83a-4d58-8323-224b84a4ac26 req-c7d1f6a3-bcba-4a2c-9b7a-6b9eb3414a7e service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:38.426675 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-0c3be21b-d83a-4d58-8323-224b84a4ac26 req-c7d1f6a3-bcba-4a2c-9b7a-6b9eb3414a7e service nova] Creating event network-vif-plugged:f42c238a-1ff4-4b31-8e94-8e0d356f5cfb for instance b28a95a5-c6c2-4781-8c1a-62e7d3eac5a7 on n-h2-851028-13 Oct 04 18:45:38.431929 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-0c3be21b-d83a-4d58-8323-224b84a4ac26 req-c7d1f6a3-bcba-4a2c-9b7a-6b9eb3414a7e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039598 Oct 04 18:45:38.433006 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1782/3374] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:45:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:45:38.438257 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-dfd01588-e4d5-4c3d-bb1e-f54fc8bbd730 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:38.439194 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-dfd01588-e4d5-4c3d-bb1e-f54fc8bbd730 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: d5e2bc9f-76da-4028-9b48-d00a8ae20d33] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:38.446353 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dfd01588-e4d5-4c3d-bb1e-f54fc8bbd730 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:38.447132 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dfd01588-e4d5-4c3d-bb1e-f54fc8bbd730 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:38.447762 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dfd01588-e4d5-4c3d-bb1e-f54fc8bbd730 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:38.448649 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dfd01588-e4d5-4c3d-bb1e-f54fc8bbd730 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:38.449297 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dfd01588-e4d5-4c3d-bb1e-f54fc8bbd730 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:38.450008 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dfd01588-e4d5-4c3d-bb1e-f54fc8bbd730 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:38.772216 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-dfd01588-e4d5-4c3d-bb1e-f54fc8bbd730 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:38.781527 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-dfd01588-e4d5-4c3d-bb1e-f54fc8bbd730 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/d5e2bc9f-76da-4028-9b48-d00a8ae20d33" status: 200 len: 1488 microversion: 2.1 time: 0.346999 Oct 04 18:45:38.782450 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1783/3375] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:38 2022] GET /compute/v2.1/servers/d5e2bc9f-76da-4028-9b48-d00a8ae20d33 => generated 1488 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:38.787928 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-d3b30406-a290-4f6b-aa86-cc92211f096f tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] Calling method '.version_select at 0x7fb21e8e1af0>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:38.793133 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d3b30406-a290-4f6b-aa86-cc92211f096f tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:38.793888 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d3b30406-a290-4f6b-aa86-cc92211f096f tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:38.794563 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d3b30406-a290-4f6b-aa86-cc92211f096f tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:38.812202 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-d3b30406-a290-4f6b-aa86-cc92211f096f tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] 10.222.0.43 "GET /compute/v2.1/os-migrations" status: 200 len: 1180 microversion: 2.1 time: 0.028163 Oct 04 18:45:38.826079 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1784/3376] 10.222.0.43 () {58 vars in 1143 bytes} [Tue Oct 4 18:45:38 2022] GET /compute/v2.1/os-migrations => generated 1180 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:38.828541 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-a0786e49-dbba-4544-94c9-9077f6078d4b tempest-ServersAdminTestJSON-1312894221 tempest-ServersAdminTestJSON-1312894221-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:45:38.832651 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-a0786e49-dbba-4544-94c9-9077f6078d4b tempest-ServersAdminTestJSON-1312894221 tempest-ServersAdminTestJSON-1312894221-project-admin] [instance: cf78a645-458e-4dc2-a60d-a51754ab6258] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:38.853981 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a0786e49-dbba-4544-94c9-9077f6078d4b tempest-ServersAdminTestJSON-1312894221 tempest-ServersAdminTestJSON-1312894221-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:38.854499 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a0786e49-dbba-4544-94c9-9077f6078d4b tempest-ServersAdminTestJSON-1312894221 tempest-ServersAdminTestJSON-1312894221-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:38.854952 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a0786e49-dbba-4544-94c9-9077f6078d4b tempest-ServersAdminTestJSON-1312894221 tempest-ServersAdminTestJSON-1312894221-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:38.855695 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a0786e49-dbba-4544-94c9-9077f6078d4b tempest-ServersAdminTestJSON-1312894221 tempest-ServersAdminTestJSON-1312894221-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:38.856164 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a0786e49-dbba-4544-94c9-9077f6078d4b tempest-ServersAdminTestJSON-1312894221 tempest-ServersAdminTestJSON-1312894221-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:38.856649 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a0786e49-dbba-4544-94c9-9077f6078d4b tempest-ServersAdminTestJSON-1312894221 tempest-ServersAdminTestJSON-1312894221-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:38.989475 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-a0786e49-dbba-4544-94c9-9077f6078d4b tempest-ServersAdminTestJSON-1312894221 tempest-ServersAdminTestJSON-1312894221-project-admin] 10.222.0.43 "POST /compute/v2.1/servers/cf78a645-458e-4dc2-a60d-a51754ab6258/action" status: 202 len: 0 microversion: 2.1 time: 0.165811 Oct 04 18:45:38.995688 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1785/3377] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 18:45:38 2022] POST /compute/v2.1/servers/cf78a645-458e-4dc2-a60d-a51754ab6258/action => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:45:39.000985 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-09002cf6-83c5-4484-82fe-5ebe6402496d tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:39.007343 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-09002cf6-83c5-4484-82fe-5ebe6402496d tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] [instance: b28a95a5-c6c2-4781-8c1a-62e7d3eac5a7] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:39.023405 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-09002cf6-83c5-4484-82fe-5ebe6402496d tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:39.023993 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-09002cf6-83c5-4484-82fe-5ebe6402496d tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:39.024446 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-09002cf6-83c5-4484-82fe-5ebe6402496d tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:39.025284 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-09002cf6-83c5-4484-82fe-5ebe6402496d tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:39.025840 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-09002cf6-83c5-4484-82fe-5ebe6402496d tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:39.026285 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-09002cf6-83c5-4484-82fe-5ebe6402496d tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:39.340696 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-09002cf6-83c5-4484-82fe-5ebe6402496d tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c710f394164b89b16bcac2fe51c58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65037d4ea5124d749e42928032e803fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:39.350987 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-09002cf6-83c5-4484-82fe-5ebe6402496d tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] 10.222.0.43 "GET /compute/v2.1/servers/b28a95a5-c6c2-4781-8c1a-62e7d3eac5a7" status: 200 len: 1520 microversion: 2.1 time: 0.353665 Oct 04 18:45:39.351598 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1786/3378] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:38 2022] GET /compute/v2.1/servers/b28a95a5-c6c2-4781-8c1a-62e7d3eac5a7 => generated 1520 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:39.357551 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-9ebe77a7-2169-420a-b85d-539e7892abe1 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:45:39.360765 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-9ebe77a7-2169-420a-b85d-539e7892abe1 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 82b86465-afb0-49ef-9932-1538010c1ae5] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:39.388294 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9ebe77a7-2169-420a-b85d-539e7892abe1 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:39.389873 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9ebe77a7-2169-420a-b85d-539e7892abe1 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:39.390970 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9ebe77a7-2169-420a-b85d-539e7892abe1 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:39.392290 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9ebe77a7-2169-420a-b85d-539e7892abe1 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:39.393631 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9ebe77a7-2169-420a-b85d-539e7892abe1 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:39.394573 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9ebe77a7-2169-420a-b85d-539e7892abe1 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:39.871549 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-9ebe77a7-2169-420a-b85d-539e7892abe1 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "POST /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5/action" status: 200 len: 137 microversion: 2.1 time: 0.517812 Oct 04 18:45:39.877314 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1787/3379] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 18:45:39 2022] POST /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5/action => generated 137 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:45:39.894081 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-27bd3241-1f17-47f1-a815-3a3904ed13f0 tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:39.898009 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-27bd3241-1f17-47f1-a815-3a3904ed13f0 tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] [instance: 6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:39.920323 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-27bd3241-1f17-47f1-a815-3a3904ed13f0 tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:39.921792 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-27bd3241-1f17-47f1-a815-3a3904ed13f0 tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:39.924592 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-27bd3241-1f17-47f1-a815-3a3904ed13f0 tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:39.928499 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-27bd3241-1f17-47f1-a815-3a3904ed13f0 tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:39.931216 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-27bd3241-1f17-47f1-a815-3a3904ed13f0 tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:39.933887 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-27bd3241-1f17-47f1-a815-3a3904ed13f0 tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:40.221342 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-27bd3241-1f17-47f1-a815-3a3904ed13f0 tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75" status: 200 len: 1861 microversion: 2.1 time: 0.346394 Oct 04 18:45:40.221952 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1788/3380] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:39 2022] GET /compute/v2.1/servers/6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75 => generated 1861 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:40.231288 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-685172f2-3161-4dc9-8330-78a4d6a905a5 tempest-ServersAdminTestJSON-1312894221 tempest-ServersAdminTestJSON-1312894221-project-admin] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:40.231914 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-685172f2-3161-4dc9-8330-78a4d6a905a5 tempest-ServersAdminTestJSON-1312894221 tempest-ServersAdminTestJSON-1312894221-project-admin] [instance: cf78a645-458e-4dc2-a60d-a51754ab6258] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:40.240291 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-685172f2-3161-4dc9-8330-78a4d6a905a5 tempest-ServersAdminTestJSON-1312894221 tempest-ServersAdminTestJSON-1312894221-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:40.241036 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-685172f2-3161-4dc9-8330-78a4d6a905a5 tempest-ServersAdminTestJSON-1312894221 tempest-ServersAdminTestJSON-1312894221-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:40.241674 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-685172f2-3161-4dc9-8330-78a4d6a905a5 tempest-ServersAdminTestJSON-1312894221 tempest-ServersAdminTestJSON-1312894221-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:40.242370 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-685172f2-3161-4dc9-8330-78a4d6a905a5 tempest-ServersAdminTestJSON-1312894221 tempest-ServersAdminTestJSON-1312894221-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:40.243007 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-685172f2-3161-4dc9-8330-78a4d6a905a5 tempest-ServersAdminTestJSON-1312894221 tempest-ServersAdminTestJSON-1312894221-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:40.243608 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-685172f2-3161-4dc9-8330-78a4d6a905a5 tempest-ServersAdminTestJSON-1312894221 tempest-ServersAdminTestJSON-1312894221-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:40.835637 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-685172f2-3161-4dc9-8330-78a4d6a905a5 tempest-ServersAdminTestJSON-1312894221 tempest-ServersAdminTestJSON-1312894221-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/cf78a645-458e-4dc2-a60d-a51754ab6258" status: 200 len: 1616 microversion: 2.1 time: 0.612364 Oct 04 18:45:40.840099 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1789/3381] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:40 2022] GET /compute/v2.1/servers/cf78a645-458e-4dc2-a60d-a51754ab6258 => generated 1616 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:40.847683 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-da19deb7-ab17-4c35-9b35-41eeb0b3ccdf tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:40.853876 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-da19deb7-ab17-4c35-9b35-41eeb0b3ccdf tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 82b86465-afb0-49ef-9932-1538010c1ae5] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:40.861036 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-da19deb7-ab17-4c35-9b35-41eeb0b3ccdf tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:40.861908 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-da19deb7-ab17-4c35-9b35-41eeb0b3ccdf tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:40.862675 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-da19deb7-ab17-4c35-9b35-41eeb0b3ccdf tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:40.863736 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-da19deb7-ab17-4c35-9b35-41eeb0b3ccdf tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:40.864451 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-da19deb7-ab17-4c35-9b35-41eeb0b3ccdf tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:40.865373 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-da19deb7-ab17-4c35-9b35-41eeb0b3ccdf tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:40.954466 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-5db32c15-0358-4848-9db4-c2224611f34f tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Flavor limits 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:45:40.955649 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-5db32c15-0358-4848-9db4-c2224611f34f tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Image limits 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:45:40.956330 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-5db32c15-0358-4848-9db4-c2224611f34f tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Flavor pref 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:45:40.957487 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-5db32c15-0358-4848-9db4-c2224611f34f tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Image pref 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:45:40.957995 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-5db32c15-0358-4848-9db4-c2224611f34f tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:45:40.968204 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5db32c15-0358-4848-9db4-c2224611f34f tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:40.968811 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5db32c15-0358-4848-9db4-c2224611f34f tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:40.969294 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5db32c15-0358-4848-9db4-c2224611f34f tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:40.970341 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5db32c15-0358-4848-9db4-c2224611f34f tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:40.970844 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5db32c15-0358-4848-9db4-c2224611f34f tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:40.971233 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5db32c15-0358-4848-9db4-c2224611f34f tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:40.997807 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=4 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:45:41.004545 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-5db32c15-0358-4848-9db4-c2224611f34f tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Getting quotas for project 98ecf69d8220477bb3006361f7a67825. Resources: {'ram', 'cores', 'instances'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:45:41.012505 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-5db32c15-0358-4848-9db4-c2224611f34f tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Getting quotas for user a0de7f497fae40aa885875065db35656 and project 98ecf69d8220477bb3006361f7a67825. Resources: {'ram', 'cores', 'instances'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:45:41.149849 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-da19deb7-ab17-4c35-9b35-41eeb0b3ccdf tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:41.167357 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-da19deb7-ab17-4c35-9b35-41eeb0b3ccdf tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5" status: 200 len: 1667 microversion: 2.1 time: 0.318527 Oct 04 18:45:41.168504 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1790/3382] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:40 2022] GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5 => generated 1667 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:41.192826 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-576e19ea-48e5-4b29-ae10-a4a9764f610e tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:41.193586 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-576e19ea-48e5-4b29-ae10-a4a9764f610e tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] [instance: 6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:41.202278 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-576e19ea-48e5-4b29-ae10-a4a9764f610e tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:41.202936 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-576e19ea-48e5-4b29-ae10-a4a9764f610e tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:41.203531 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-576e19ea-48e5-4b29-ae10-a4a9764f610e tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:41.204261 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-576e19ea-48e5-4b29-ae10-a4a9764f610e tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:41.204711 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-576e19ea-48e5-4b29-ae10-a4a9764f610e tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:41.205416 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-576e19ea-48e5-4b29-ae10-a4a9764f610e tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:41.277669 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-5db32c15-0358-4848-9db4-c2224611f34f tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Going to run 1 instances... {{(pid=123595) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:45:41.281379 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-5db32c15-0358-4848-9db4-c2224611f34f tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] [instance: fa47906d-d394-46fe-9143-780bcd27a715] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='4171c8e4-84ce-4f4c-b8a8-1d2bf616f9a3',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='cae9f7ae-57c7-4d23-a6a0-d79aa4c4e3ac',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='909e8e6b-e7e8-4c46-bec1-3b7dbe15cc42',volume_size=None,volume_type=None)] {{(pid=123595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:45:41.417091 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-576e19ea-48e5-4b29-ae10-a4a9764f610e tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75" status: 200 len: 1861 microversion: 2.1 time: 0.245942 Oct 04 18:45:41.430149 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1791/3383] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:41 2022] GET /compute/v2.1/servers/6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75 => generated 1861 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:41.437520 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-211f6176-4d79-4b67-afaf-b47a6520705c tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:41.446621 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-211f6176-4d79-4b67-afaf-b47a6520705c tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] [instance: b28a95a5-c6c2-4781-8c1a-62e7d3eac5a7] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:41.469359 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-211f6176-4d79-4b67-afaf-b47a6520705c tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:41.470161 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-211f6176-4d79-4b67-afaf-b47a6520705c tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:41.472377 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-211f6176-4d79-4b67-afaf-b47a6520705c tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:41.473473 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-211f6176-4d79-4b67-afaf-b47a6520705c tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:41.474140 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-211f6176-4d79-4b67-afaf-b47a6520705c tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:41.476351 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-211f6176-4d79-4b67-afaf-b47a6520705c tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:41.694730 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-211f6176-4d79-4b67-afaf-b47a6520705c tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c710f394164b89b16bcac2fe51c58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65037d4ea5124d749e42928032e803fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:41.707951 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-211f6176-4d79-4b67-afaf-b47a6520705c tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] 10.222.0.43 "GET /compute/v2.1/servers/b28a95a5-c6c2-4781-8c1a-62e7d3eac5a7" status: 200 len: 1505 microversion: 2.1 time: 0.275188 Oct 04 18:45:41.708599 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1792/3384] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:41 2022] GET /compute/v2.1/servers/b28a95a5-c6c2-4781-8c1a-62e7d3eac5a7 => generated 1505 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:41.723015 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-310eb634-e636-42cf-9548-838f36a40453 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:41.723523 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-310eb634-e636-42cf-9548-838f36a40453 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] [instance: a721ca75-1707-4a91-96d0-431dece9b401] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:41.734714 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-310eb634-e636-42cf-9548-838f36a40453 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:41.736379 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-310eb634-e636-42cf-9548-838f36a40453 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:41.738058 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-310eb634-e636-42cf-9548-838f36a40453 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:41.740271 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-310eb634-e636-42cf-9548-838f36a40453 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:41.741876 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-310eb634-e636-42cf-9548-838f36a40453 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:41.742549 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-310eb634-e636-42cf-9548-838f36a40453 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:41.763676 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-5db32c15-0358-4848-9db4-c2224611f34f tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.32 time: 4.937303 Oct 04 18:45:41.766661 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1593/3385] 10.222.0.43 () {62 vars in 1189 bytes} [Tue Oct 4 18:45:36 2022] POST /compute/v2.1/servers => generated 405 bytes in 4941 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Oct 04 18:45:41.774107 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-8ebb23bf-1958-4308-8f3a-f6387798dd87 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:45:41.777031 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-8ebb23bf-1958-4308-8f3a-f6387798dd87 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] [instance: 15541ec9-3112-4adc-9fad-6d20a88f2c09] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:41.782281 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-310eb634-e636-42cf-9548-838f36a40453 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] [instance: a721ca75-1707-4a91-96d0-431dece9b401] Going to try to terminate instance {{(pid=123596) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:45:41.784990 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8ebb23bf-1958-4308-8f3a-f6387798dd87 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:41.785284 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8ebb23bf-1958-4308-8f3a-f6387798dd87 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:41.785806 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8ebb23bf-1958-4308-8f3a-f6387798dd87 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:41.786631 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8ebb23bf-1958-4308-8f3a-f6387798dd87 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:41.787200 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8ebb23bf-1958-4308-8f3a-f6387798dd87 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:41.787753 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8ebb23bf-1958-4308-8f3a-f6387798dd87 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:41.823249 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.objects.instance [None req-8ebb23bf-1958-4308-8f3a-f6387798dd87 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lazy-loading 'flavor' on Instance uuid 15541ec9-3112-4adc-9fad-6d20a88f2c09 {{(pid=123595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:45:41.926755 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-310eb634-e636-42cf-9548-838f36a40453 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] 10.222.0.43 "DELETE /compute/v2.1/servers/a721ca75-1707-4a91-96d0-431dece9b401" status: 204 len: 0 microversion: 2.1 time: 0.216660 Oct 04 18:45:41.931381 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1793/3386] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 18:45:41 2022] DELETE /compute/v2.1/servers/a721ca75-1707-4a91-96d0-431dece9b401 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:45:41.935588 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-c01a7da1-06d9-4ead-8297-8f18d628859f tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:41.938365 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-c01a7da1-06d9-4ead-8297-8f18d628859f tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 82b86465-afb0-49ef-9932-1538010c1ae5] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:41.945687 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c01a7da1-06d9-4ead-8297-8f18d628859f tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:41.946279 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c01a7da1-06d9-4ead-8297-8f18d628859f tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:41.947152 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c01a7da1-06d9-4ead-8297-8f18d628859f tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:41.947951 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c01a7da1-06d9-4ead-8297-8f18d628859f tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:41.949479 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c01a7da1-06d9-4ead-8297-8f18d628859f tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:41.949994 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c01a7da1-06d9-4ead-8297-8f18d628859f tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:41.991942 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-8ebb23bf-1958-4308-8f3a-f6387798dd87 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] 10.222.0.43 "POST /compute/v2.1/servers/15541ec9-3112-4adc-9fad-6d20a88f2c09/action" status: 200 len: 32 microversion: 2.1 time: 0.223843 Oct 04 18:45:41.994444 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1594/3387] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 18:45:41 2022] POST /compute/v2.1/servers/15541ec9-3112-4adc-9fad-6d20a88f2c09/action => generated 32 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:45:42.005871 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-c80241e7-c758-469f-88b1-3084f39be3d6 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:42.006653 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-c80241e7-c758-469f-88b1-3084f39be3d6 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] [instance: 6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:42.013795 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c80241e7-c758-469f-88b1-3084f39be3d6 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:42.014428 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c80241e7-c758-469f-88b1-3084f39be3d6 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:42.014990 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c80241e7-c758-469f-88b1-3084f39be3d6 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:42.015797 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c80241e7-c758-469f-88b1-3084f39be3d6 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:42.016347 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c80241e7-c758-469f-88b1-3084f39be3d6 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:42.017002 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c80241e7-c758-469f-88b1-3084f39be3d6 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:42.170584 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.objects.instance [None req-c80241e7-c758-469f-88b1-3084f39be3d6 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lazy-loading 'services' on Instance uuid 6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75 {{(pid=123595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:45:42.288446 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-c01a7da1-06d9-4ead-8297-8f18d628859f tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:42.332431 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-c01a7da1-06d9-4ead-8297-8f18d628859f tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5" status: 200 len: 1667 microversion: 2.1 time: 0.367415 Oct 04 18:45:42.333149 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1794/3388] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:41 2022] GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5 => generated 1667 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:42.360474 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-c80241e7-c758-469f-88b1-3084f39be3d6 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] 10.222.0.43 "DELETE /compute/v2.1/servers/6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75/os-volume_attachments/ac1da745-1280-4614-b0b5-7c0dcb0dc11d" status: 202 len: 0 microversion: 2.1 time: 0.355048 Oct 04 18:45:42.361515 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1595/3389] 10.222.0.43 () {58 vars in 1416 bytes} [Tue Oct 4 18:45:41 2022] DELETE /compute/v2.1/servers/6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75/os-volume_attachments/ac1da745-1280-4614-b0b5-7c0dcb0dc11d => generated 0 bytes in 361 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:45:42.363418 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-3c385257-1426-42b1-baa2-151859c3a63f tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:42.364476 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-3c385257-1426-42b1-baa2-151859c3a63f tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] [instance: b28a95a5-c6c2-4781-8c1a-62e7d3eac5a7] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:42.373868 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-00bcce40-1c8f-482f-8ef0-70a061c86c02 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:42.378807 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-00bcce40-1c8f-482f-8ef0-70a061c86c02 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] [instance: fa47906d-d394-46fe-9143-780bcd27a715] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:42.382120 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3c385257-1426-42b1-baa2-151859c3a63f tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:42.382938 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3c385257-1426-42b1-baa2-151859c3a63f tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:42.384878 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3c385257-1426-42b1-baa2-151859c3a63f tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:42.385957 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3c385257-1426-42b1-baa2-151859c3a63f tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:42.392068 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3c385257-1426-42b1-baa2-151859c3a63f tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:42.392887 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3c385257-1426-42b1-baa2-151859c3a63f tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:42.447873 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:45:42.531422 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-00bcce40-1c8f-482f-8ef0-70a061c86c02 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:42.540312 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-00bcce40-1c8f-482f-8ef0-70a061c86c02 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:42.541825 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-00bcce40-1c8f-482f-8ef0-70a061c86c02 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:42.553940 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-00bcce40-1c8f-482f-8ef0-70a061c86c02 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] 10.222.0.43 "GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715" status: 200 len: 1285 microversion: 2.32 time: 0.180058 Oct 04 18:45:42.554653 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1596/3390] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:45:42 2022] GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715 => generated 1285 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:45:42.572309 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-f1423866-0f08-4108-be95-f0e19d68105f tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:42.573408 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-f1423866-0f08-4108-be95-f0e19d68105f tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] [instance: a721ca75-1707-4a91-96d0-431dece9b401] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:42.586757 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f1423866-0f08-4108-be95-f0e19d68105f tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:42.587756 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f1423866-0f08-4108-be95-f0e19d68105f tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:42.588448 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f1423866-0f08-4108-be95-f0e19d68105f tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:42.589420 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f1423866-0f08-4108-be95-f0e19d68105f tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:42.590067 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f1423866-0f08-4108-be95-f0e19d68105f tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:42.593838 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f1423866-0f08-4108-be95-f0e19d68105f tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:42.685223 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-3c385257-1426-42b1-baa2-151859c3a63f tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c710f394164b89b16bcac2fe51c58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65037d4ea5124d749e42928032e803fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:42.722266 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-3c385257-1426-42b1-baa2-151859c3a63f tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] 10.222.0.43 "GET /compute/v2.1/servers/b28a95a5-c6c2-4781-8c1a-62e7d3eac5a7" status: 200 len: 1505 microversion: 2.1 time: 0.386537 Oct 04 18:45:42.725371 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1795/3391] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:42 2022] GET /compute/v2.1/servers/b28a95a5-c6c2-4781-8c1a-62e7d3eac5a7 => generated 1505 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:42.732105 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-c725bf6e-8a7f-4b87-9090-9d6c256e64b8 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:42.732704 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-c725bf6e-8a7f-4b87-9090-9d6c256e64b8 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] [instance: 15541ec9-3112-4adc-9fad-6d20a88f2c09] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:42.750299 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c725bf6e-8a7f-4b87-9090-9d6c256e64b8 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:42.750799 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c725bf6e-8a7f-4b87-9090-9d6c256e64b8 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:42.751362 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c725bf6e-8a7f-4b87-9090-9d6c256e64b8 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:42.751962 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c725bf6e-8a7f-4b87-9090-9d6c256e64b8 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:42.752416 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c725bf6e-8a7f-4b87-9090-9d6c256e64b8 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:42.752877 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c725bf6e-8a7f-4b87-9090-9d6c256e64b8 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:42.947553 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-c725bf6e-8a7f-4b87-9090-9d6c256e64b8 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96e7480de94c43909045ac1087e40cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6bd34bf5540ee95c8144f185eb22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:42.961489 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-c725bf6e-8a7f-4b87-9090-9d6c256e64b8 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] 10.222.0.43 "GET /compute/v2.1/servers/15541ec9-3112-4adc-9fad-6d20a88f2c09" status: 200 len: 1734 microversion: 2.1 time: 0.234386 Oct 04 18:45:42.962522 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1796/3392] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:42 2022] GET /compute/v2.1/servers/15541ec9-3112-4adc-9fad-6d20a88f2c09 => generated 1734 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:42.968080 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-484b1767-8502-4cb5-9e33-ef934f25966e tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:42.969399 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-484b1767-8502-4cb5-9e33-ef934f25966e tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 82b86465-afb0-49ef-9932-1538010c1ae5] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:42.978815 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-484b1767-8502-4cb5-9e33-ef934f25966e tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:42.980659 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-484b1767-8502-4cb5-9e33-ef934f25966e tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:42.980659 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-484b1767-8502-4cb5-9e33-ef934f25966e tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:42.981062 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-484b1767-8502-4cb5-9e33-ef934f25966e tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:42.981777 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-484b1767-8502-4cb5-9e33-ef934f25966e tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:42.982364 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-484b1767-8502-4cb5-9e33-ef934f25966e tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:43.082111 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-f1423866-0f08-4108-be95-f0e19d68105f tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608fc9ed7cdb487c9bf4b783c26ceeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29876d6805924df882d6861b0f6ab4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:43.091151 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-f1423866-0f08-4108-be95-f0e19d68105f tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] 10.222.0.43 "GET /compute/v2.1/servers/a721ca75-1707-4a91-96d0-431dece9b401" status: 200 len: 1470 microversion: 2.1 time: 0.535190 Oct 04 18:45:43.111579 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1597/3393] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:42 2022] GET /compute/v2.1/servers/a721ca75-1707-4a91-96d0-431dece9b401 => generated 1470 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:43.118201 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-53fce6a9-4648-4d26-bb5f-84636c9cc318 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:43.121064 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-53fce6a9-4648-4d26-bb5f-84636c9cc318 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] [instance: 6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:43.127785 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-53fce6a9-4648-4d26-bb5f-84636c9cc318 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:43.128668 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-53fce6a9-4648-4d26-bb5f-84636c9cc318 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:43.129392 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-53fce6a9-4648-4d26-bb5f-84636c9cc318 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:43.130372 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-53fce6a9-4648-4d26-bb5f-84636c9cc318 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:43.131059 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-53fce6a9-4648-4d26-bb5f-84636c9cc318 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:43.131757 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-53fce6a9-4648-4d26-bb5f-84636c9cc318 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:43.159048 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:45:43.162851 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-484b1767-8502-4cb5-9e33-ef934f25966e tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:43.175105 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-484b1767-8502-4cb5-9e33-ef934f25966e tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5" status: 200 len: 1667 microversion: 2.1 time: 0.211096 Oct 04 18:45:43.175586 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-53fce6a9-4648-4d26-bb5f-84636c9cc318 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] 10.222.0.43 "GET /compute/v2.1/servers/6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061745 Oct 04 18:45:43.176826 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1598/3394] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Oct 4 18:45:43 2022] GET /compute/v2.1/servers/6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:45:43.186999 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-9d86bd48-9eeb-4f3e-b6b5-10689a5f20ac tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:43.188812 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1797/3395] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:42 2022] GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5 => generated 1667 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:43.189934 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-9d86bd48-9eeb-4f3e-b6b5-10689a5f20ac tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] [instance: b28a95a5-c6c2-4781-8c1a-62e7d3eac5a7] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:43.200849 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9d86bd48-9eeb-4f3e-b6b5-10689a5f20ac tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:43.201400 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9d86bd48-9eeb-4f3e-b6b5-10689a5f20ac tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:43.208757 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9d86bd48-9eeb-4f3e-b6b5-10689a5f20ac tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:43.209955 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9d86bd48-9eeb-4f3e-b6b5-10689a5f20ac tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:43.210677 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9d86bd48-9eeb-4f3e-b6b5-10689a5f20ac tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:43.211370 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9d86bd48-9eeb-4f3e-b6b5-10689a5f20ac tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:43.214622 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-94ca679c-56fa-4dff-962f-ab3a55ce85c2 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:43.215476 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-94ca679c-56fa-4dff-962f-ab3a55ce85c2 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 82b86465-afb0-49ef-9932-1538010c1ae5] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:43.227896 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-94ca679c-56fa-4dff-962f-ab3a55ce85c2 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:43.228429 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-94ca679c-56fa-4dff-962f-ab3a55ce85c2 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:43.228875 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-94ca679c-56fa-4dff-962f-ab3a55ce85c2 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:43.229603 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-94ca679c-56fa-4dff-962f-ab3a55ce85c2 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:43.230230 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-94ca679c-56fa-4dff-962f-ab3a55ce85c2 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:43.231027 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-94ca679c-56fa-4dff-962f-ab3a55ce85c2 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:43.276124 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-9d86bd48-9eeb-4f3e-b6b5-10689a5f20ac tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] [instance: b28a95a5-c6c2-4781-8c1a-62e7d3eac5a7] Going to try to terminate instance {{(pid=123595) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:45:43.457824 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-9d86bd48-9eeb-4f3e-b6b5-10689a5f20ac tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] 10.222.0.43 "DELETE /compute/v2.1/servers/b28a95a5-c6c2-4781-8c1a-62e7d3eac5a7" status: 204 len: 0 microversion: 2.1 time: 0.277702 Oct 04 18:45:43.464506 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1599/3396] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 18:45:43 2022] DELETE /compute/v2.1/servers/b28a95a5-c6c2-4781-8c1a-62e7d3eac5a7 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:45:43.582428 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-ef5303bc-1a40-443b-afb9-f5646f04501b tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:43.583782 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-ef5303bc-1a40-443b-afb9-f5646f04501b tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] [instance: fa47906d-d394-46fe-9143-780bcd27a715] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:43.595813 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ef5303bc-1a40-443b-afb9-f5646f04501b tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:43.599048 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ef5303bc-1a40-443b-afb9-f5646f04501b tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:43.601134 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ef5303bc-1a40-443b-afb9-f5646f04501b tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:43.601994 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ef5303bc-1a40-443b-afb9-f5646f04501b tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:43.605926 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ef5303bc-1a40-443b-afb9-f5646f04501b tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:43.606422 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ef5303bc-1a40-443b-afb9-f5646f04501b tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:43.813412 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-ef5303bc-1a40-443b-afb9-f5646f04501b tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:43.842318 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-ef5303bc-1a40-443b-afb9-f5646f04501b tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:43.843816 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-ef5303bc-1a40-443b-afb9-f5646f04501b tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:43.845021 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-ef5303bc-1a40-443b-afb9-f5646f04501b tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] 10.222.0.43 "GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715" status: 200 len: 1575 microversion: 2.32 time: 0.267807 Oct 04 18:45:43.845632 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1600/3397] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:45:43 2022] GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715 => generated 1575 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:45:43.864625 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-39bf5f0a-2a3f-4a87-86f6-704d82acf738 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1823612287", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452", "networks": [{"uuid": "3ad3e58b-246e-4a9b-9a40-0c1782e343b8"}]}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:45:43.934193 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-94ca679c-56fa-4dff-962f-ab3a55ce85c2 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:43.944697 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-94ca679c-56fa-4dff-962f-ab3a55ce85c2 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5" status: 200 len: 1667 microversion: 2.1 time: 0.735194 Oct 04 18:45:43.945588 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1798/3398] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:43 2022] GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5 => generated 1667 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:45:43.994680 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-195b6668-7bbe-423c-9dd8-703f34fa30d5 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:43.995376 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-195b6668-7bbe-423c-9dd8-703f34fa30d5 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] [instance: 15541ec9-3112-4adc-9fad-6d20a88f2c09] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:43.999957 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.network.neutron [None req-39bf5f0a-2a3f-4a87-86f6-704d82acf738 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] validate_networks() for [('3ad3e58b-246e-4a9b-9a40-0c1782e343b8', None, None, None, None, None)] {{(pid=123595) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:45:44.005601 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-195b6668-7bbe-423c-9dd8-703f34fa30d5 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:44.006106 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-195b6668-7bbe-423c-9dd8-703f34fa30d5 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:44.006553 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-195b6668-7bbe-423c-9dd8-703f34fa30d5 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:44.007429 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-195b6668-7bbe-423c-9dd8-703f34fa30d5 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:44.007993 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-195b6668-7bbe-423c-9dd8-703f34fa30d5 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:44.033898 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-195b6668-7bbe-423c-9dd8-703f34fa30d5 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:44.384368 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-195b6668-7bbe-423c-9dd8-703f34fa30d5 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96e7480de94c43909045ac1087e40cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6bd34bf5540ee95c8144f185eb22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:44.395812 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-195b6668-7bbe-423c-9dd8-703f34fa30d5 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] 10.222.0.43 "GET /compute/v2.1/servers/15541ec9-3112-4adc-9fad-6d20a88f2c09" status: 200 len: 1734 microversion: 2.1 time: 0.405068 Oct 04 18:45:44.410370 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1799/3399] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:43 2022] GET /compute/v2.1/servers/15541ec9-3112-4adc-9fad-6d20a88f2c09 => generated 1734 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:44.418685 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-cb7e2206-8207-4a39-92e8-e3d9fb5cef86 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:44.419574 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-cb7e2206-8207-4a39-92e8-e3d9fb5cef86 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] [instance: a721ca75-1707-4a91-96d0-431dece9b401] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:44.426830 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cb7e2206-8207-4a39-92e8-e3d9fb5cef86 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:44.427678 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cb7e2206-8207-4a39-92e8-e3d9fb5cef86 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:44.428434 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cb7e2206-8207-4a39-92e8-e3d9fb5cef86 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:44.429624 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cb7e2206-8207-4a39-92e8-e3d9fb5cef86 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:44.430601 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cb7e2206-8207-4a39-92e8-e3d9fb5cef86 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:44.431247 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cb7e2206-8207-4a39-92e8-e3d9fb5cef86 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:44.656850 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-cb7e2206-8207-4a39-92e8-e3d9fb5cef86 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608fc9ed7cdb487c9bf4b783c26ceeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29876d6805924df882d6861b0f6ab4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:44.670226 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-cb7e2206-8207-4a39-92e8-e3d9fb5cef86 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] 10.222.0.43 "GET /compute/v2.1/servers/a721ca75-1707-4a91-96d0-431dece9b401" status: 200 len: 1470 microversion: 2.1 time: 0.258512 Oct 04 18:45:44.671877 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1800/3400] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:44 2022] GET /compute/v2.1/servers/a721ca75-1707-4a91-96d0-431dece9b401 => generated 1470 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:44.695702 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-9a81353d-cbf0-4211-a9bb-8c5627d1c23d tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1699745676", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452", "networks": [{"uuid": "4c7a4f44-d147-4a8b-8217-07c763ce3b07"}]}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:45:44.789725 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.network.neutron [None req-9a81353d-cbf0-4211-a9bb-8c5627d1c23d tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] validate_networks() for [('4c7a4f44-d147-4a8b-8217-07c763ce3b07', None, None, None, None, None)] {{(pid=123596) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:45:45.382092 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-9a81353d-cbf0-4211-a9bb-8c5627d1c23d tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Flavor limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:45:45.382693 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-9a81353d-cbf0-4211-a9bb-8c5627d1c23d tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Image limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:45:45.382995 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-9a81353d-cbf0-4211-a9bb-8c5627d1c23d tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Flavor pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:45:45.383416 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-9a81353d-cbf0-4211-a9bb-8c5627d1c23d tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Image pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:45:45.383837 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-9a81353d-cbf0-4211-a9bb-8c5627d1c23d tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:45:45.394771 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9a81353d-cbf0-4211-a9bb-8c5627d1c23d tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:45.395698 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9a81353d-cbf0-4211-a9bb-8c5627d1c23d tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:45.396391 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9a81353d-cbf0-4211-a9bb-8c5627d1c23d tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:45.398352 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9a81353d-cbf0-4211-a9bb-8c5627d1c23d tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:45.399164 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9a81353d-cbf0-4211-a9bb-8c5627d1c23d tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:45.399989 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9a81353d-cbf0-4211-a9bb-8c5627d1c23d tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:45.423796 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-9a81353d-cbf0-4211-a9bb-8c5627d1c23d tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Getting quotas for project b928ae7385da4599bbe0ea701681b233. Resources: {'ram', 'cores', 'instances'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:45:45.430345 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-9a81353d-cbf0-4211-a9bb-8c5627d1c23d tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Getting quotas for user 93c36c0802f4473f96d0721caa50374a and project b928ae7385da4599bbe0ea701681b233. Resources: {'ram', 'cores', 'instances'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:45:45.445923 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-9a81353d-cbf0-4211-a9bb-8c5627d1c23d tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Going to run 1 instances... {{(pid=123596) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:45:45.449128 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-9a81353d-cbf0-4211-a9bb-8c5627d1c23d tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: bb651218-4475-4df2-b470-56e737801e3b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e8943ec5-4038-4d4b-b9b9-2415a79f5243',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123596) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:45:45.478649 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-39bf5f0a-2a3f-4a87-86f6-704d82acf738 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Flavor limits 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:45:45.479287 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-39bf5f0a-2a3f-4a87-86f6-704d82acf738 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Image limits 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:45:45.480002 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-39bf5f0a-2a3f-4a87-86f6-704d82acf738 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Flavor pref 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:45:45.480438 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-39bf5f0a-2a3f-4a87-86f6-704d82acf738 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Image pref 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:45:45.480965 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-39bf5f0a-2a3f-4a87-86f6-704d82acf738 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:45:45.508571 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-39bf5f0a-2a3f-4a87-86f6-704d82acf738 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:45.509155 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-39bf5f0a-2a3f-4a87-86f6-704d82acf738 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:45.509488 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-9a81353d-cbf0-4211-a9bb-8c5627d1c23d tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.826348 Oct 04 18:45:45.509613 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-39bf5f0a-2a3f-4a87-86f6-704d82acf738 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:45.510411 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-39bf5f0a-2a3f-4a87-86f6-704d82acf738 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:45.510880 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-39bf5f0a-2a3f-4a87-86f6-704d82acf738 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:45.511318 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-39bf5f0a-2a3f-4a87-86f6-704d82acf738 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:45.516821 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1801/3401] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 18:45:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 844 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:45:45.522853 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-17d1af2f-4703-4bb0-a20c-d69e4a152806 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:45.525217 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-17d1af2f-4703-4bb0-a20c-d69e4a152806 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] [instance: 6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:45.533902 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-17d1af2f-4703-4bb0-a20c-d69e4a152806 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:45.535071 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-17d1af2f-4703-4bb0-a20c-d69e4a152806 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:45.535770 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-17d1af2f-4703-4bb0-a20c-d69e4a152806 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:45.536738 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-17d1af2f-4703-4bb0-a20c-d69e4a152806 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:45.537571 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-17d1af2f-4703-4bb0-a20c-d69e4a152806 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:45.538274 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-17d1af2f-4703-4bb0-a20c-d69e4a152806 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:45.568382 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-39bf5f0a-2a3f-4a87-86f6-704d82acf738 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Getting quotas for project 65037d4ea5124d749e42928032e803fd. Resources: {'ram', 'cores', 'instances'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:45:45.575841 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-39bf5f0a-2a3f-4a87-86f6-704d82acf738 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Getting quotas for user d2c710f394164b89b16bcac2fe51c58a and project 65037d4ea5124d749e42928032e803fd. Resources: {'ram', 'cores', 'instances'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:45:45.579021 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-17d1af2f-4703-4bb0-a20c-d69e4a152806 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] 10.222.0.43 "GET /compute/v2.1/servers/6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060957 Oct 04 18:45:45.581421 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1802/3402] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Oct 4 18:45:45 2022] GET /compute/v2.1/servers/6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:45:45.594052 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-39bf5f0a-2a3f-4a87-86f6-704d82acf738 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Going to run 1 instances... {{(pid=123595) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:45:45.596466 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-d2a31629-5833-4704-977b-10ca6b9fe86a tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:45.599747 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-d2a31629-5833-4704-977b-10ca6b9fe86a tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] [instance: fa47906d-d394-46fe-9143-780bcd27a715] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:45.603166 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-39bf5f0a-2a3f-4a87-86f6-704d82acf738 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] [instance: 00c17e4b-c80e-463e-a3e9-486c118552be] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e8943ec5-4038-4d4b-b9b9-2415a79f5243',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:45:45.619692 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d2a31629-5833-4704-977b-10ca6b9fe86a tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:45.620194 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d2a31629-5833-4704-977b-10ca6b9fe86a tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:45.620635 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d2a31629-5833-4704-977b-10ca6b9fe86a tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:45.621375 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d2a31629-5833-4704-977b-10ca6b9fe86a tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:45.621849 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d2a31629-5833-4704-977b-10ca6b9fe86a tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:45.622261 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d2a31629-5833-4704-977b-10ca6b9fe86a tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:45.682015 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-39bf5f0a-2a3f-4a87-86f6-704d82acf738 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.831876 Oct 04 18:45:45.683752 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1601/3403] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 18:45:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 1834 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:45:45.689355 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-3ed4d515-33a8-4845-b9d5-eaed1c6f3979 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:45.690682 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-3ed4d515-33a8-4845-b9d5-eaed1c6f3979 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] [instance: 15541ec9-3112-4adc-9fad-6d20a88f2c09] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:45.704943 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3ed4d515-33a8-4845-b9d5-eaed1c6f3979 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:45.705511 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3ed4d515-33a8-4845-b9d5-eaed1c6f3979 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:45.706540 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3ed4d515-33a8-4845-b9d5-eaed1c6f3979 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:45.707352 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3ed4d515-33a8-4845-b9d5-eaed1c6f3979 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:45.707956 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3ed4d515-33a8-4845-b9d5-eaed1c6f3979 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:45.708405 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3ed4d515-33a8-4845-b9d5-eaed1c6f3979 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:45.760483 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-d2a31629-5833-4704-977b-10ca6b9fe86a tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:45.781649 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-d2a31629-5833-4704-977b-10ca6b9fe86a tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:45.783369 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-d2a31629-5833-4704-977b-10ca6b9fe86a tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:45.785121 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-d2a31629-5833-4704-977b-10ca6b9fe86a tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] 10.222.0.43 "GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715" status: 200 len: 1593 microversion: 2.32 time: 0.202709 Oct 04 18:45:45.787186 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1803/3404] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:45:45 2022] GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715 => generated 1593 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:45:45.796112 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-873e0bfb-615a-41d8-98d9-68307806722a tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:45.796974 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-873e0bfb-615a-41d8-98d9-68307806722a tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: bb651218-4475-4df2-b470-56e737801e3b] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:45.900256 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-873e0bfb-615a-41d8-98d9-68307806722a tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:45.910740 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-873e0bfb-615a-41d8-98d9-68307806722a tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/bb651218-4475-4df2-b470-56e737801e3b" status: 200 len: 1215 microversion: 2.1 time: 0.118124 Oct 04 18:45:45.914881 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1804/3405] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:45 2022] GET /compute/v2.1/servers/bb651218-4475-4df2-b470-56e737801e3b => generated 1215 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:45.920892 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-465a3659-b125-41cd-bc29-c4c2fffdd5d3 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:45.922889 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-465a3659-b125-41cd-bc29-c4c2fffdd5d3 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] [instance: 00c17e4b-c80e-463e-a3e9-486c118552be] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:46.020786 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-465a3659-b125-41cd-bc29-c4c2fffdd5d3 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c710f394164b89b16bcac2fe51c58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65037d4ea5124d749e42928032e803fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:46.032776 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-465a3659-b125-41cd-bc29-c4c2fffdd5d3 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] 10.222.0.43 "GET /compute/v2.1/servers/00c17e4b-c80e-463e-a3e9-486c118552be" status: 200 len: 1218 microversion: 2.1 time: 0.116362 Oct 04 18:45:46.038313 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1805/3406] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:45 2022] GET /compute/v2.1/servers/00c17e4b-c80e-463e-a3e9-486c118552be => generated 1218 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:46.043618 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-eeecef06-0e7e-4006-aa9f-e8765b20e90e tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:46.049230 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-eeecef06-0e7e-4006-aa9f-e8765b20e90e tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] [instance: a721ca75-1707-4a91-96d0-431dece9b401] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:46.076621 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-eeecef06-0e7e-4006-aa9f-e8765b20e90e tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:46.077526 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-eeecef06-0e7e-4006-aa9f-e8765b20e90e tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:46.078220 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-eeecef06-0e7e-4006-aa9f-e8765b20e90e tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:46.079128 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-eeecef06-0e7e-4006-aa9f-e8765b20e90e tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:46.079790 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-eeecef06-0e7e-4006-aa9f-e8765b20e90e tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:46.080433 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-eeecef06-0e7e-4006-aa9f-e8765b20e90e tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:46.308050 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-eeecef06-0e7e-4006-aa9f-e8765b20e90e tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608fc9ed7cdb487c9bf4b783c26ceeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29876d6805924df882d6861b0f6ab4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:46.318030 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-eeecef06-0e7e-4006-aa9f-e8765b20e90e tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] 10.222.0.43 "GET /compute/v2.1/servers/a721ca75-1707-4a91-96d0-431dece9b401" status: 200 len: 1470 microversion: 2.1 time: 0.277664 Oct 04 18:45:46.318882 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1806/3407] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:46 2022] GET /compute/v2.1/servers/a721ca75-1707-4a91-96d0-431dece9b401 => generated 1470 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:46.593156 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-60fcf927-1688-4090-b4b0-d28904963cb1 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:46.597200 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-60fcf927-1688-4090-b4b0-d28904963cb1 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] [instance: 6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:46.629284 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-60fcf927-1688-4090-b4b0-d28904963cb1 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:46.632443 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-60fcf927-1688-4090-b4b0-d28904963cb1 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:46.634925 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-60fcf927-1688-4090-b4b0-d28904963cb1 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:46.635807 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-60fcf927-1688-4090-b4b0-d28904963cb1 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:46.637906 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-60fcf927-1688-4090-b4b0-d28904963cb1 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:46.641866 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-60fcf927-1688-4090-b4b0-d28904963cb1 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:46.682801 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-3ed4d515-33a8-4845-b9d5-eaed1c6f3979 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96e7480de94c43909045ac1087e40cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6bd34bf5540ee95c8144f185eb22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:46.698421 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-3ed4d515-33a8-4845-b9d5-eaed1c6f3979 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] 10.222.0.43 "GET /compute/v2.1/servers/15541ec9-3112-4adc-9fad-6d20a88f2c09" status: 200 len: 1734 microversion: 2.1 time: 1.008666 Oct 04 18:45:46.699593 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1602/3408] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:45 2022] GET /compute/v2.1/servers/15541ec9-3112-4adc-9fad-6d20a88f2c09 => generated 1734 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:46.718230 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-60fcf927-1688-4090-b4b0-d28904963cb1 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] 10.222.0.43 "GET /compute/v2.1/servers/6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.129784 Oct 04 18:45:46.719417 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1807/3409] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Oct 4 18:45:46 2022] GET /compute/v2.1/servers/6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75/os-volume_attachments => generated 197 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:45:46.824117 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-38209226-9176-4835-b40c-06ba48969f28 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:46.824738 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-38209226-9176-4835-b40c-06ba48969f28 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] [instance: fa47906d-d394-46fe-9143-780bcd27a715] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:46.831545 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-38209226-9176-4835-b40c-06ba48969f28 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:46.832232 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-38209226-9176-4835-b40c-06ba48969f28 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:46.833079 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-38209226-9176-4835-b40c-06ba48969f28 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:46.834058 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-38209226-9176-4835-b40c-06ba48969f28 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:46.834682 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-38209226-9176-4835-b40c-06ba48969f28 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:46.835275 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-38209226-9176-4835-b40c-06ba48969f28 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:46.936752 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-535e3dd5-3c26-4d74-a125-1f6606510b54 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:46.937788 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-535e3dd5-3c26-4d74-a125-1f6606510b54 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: bb651218-4475-4df2-b470-56e737801e3b] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:46.950687 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-535e3dd5-3c26-4d74-a125-1f6606510b54 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:46.952123 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-535e3dd5-3c26-4d74-a125-1f6606510b54 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:46.952123 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-535e3dd5-3c26-4d74-a125-1f6606510b54 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:46.956805 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-535e3dd5-3c26-4d74-a125-1f6606510b54 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:46.956805 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-535e3dd5-3c26-4d74-a125-1f6606510b54 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:46.956805 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-535e3dd5-3c26-4d74-a125-1f6606510b54 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:47.068965 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-535e3dd5-3c26-4d74-a125-1f6606510b54 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:47.087133 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-38209226-9176-4835-b40c-06ba48969f28 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:47.103610 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-535e3dd5-3c26-4d74-a125-1f6606510b54 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/bb651218-4475-4df2-b470-56e737801e3b" status: 200 len: 1267 microversion: 2.1 time: 0.164670 Oct 04 18:45:47.104624 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1808/3410] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:46 2022] GET /compute/v2.1/servers/bb651218-4475-4df2-b470-56e737801e3b => generated 1267 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:47.108542 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-38209226-9176-4835-b40c-06ba48969f28 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:47.117957 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-38209226-9176-4835-b40c-06ba48969f28 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:47.119251 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-38209226-9176-4835-b40c-06ba48969f28 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] 10.222.0.43 "GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715" status: 200 len: 1593 microversion: 2.32 time: 0.308792 Oct 04 18:45:47.121442 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-a2047c4e-9918-4338-8687-ad2e9665cee2 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:47.122064 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-a2047c4e-9918-4338-8687-ad2e9665cee2 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] [instance: 00c17e4b-c80e-463e-a3e9-486c118552be] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:47.124226 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1603/3411] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:45:46 2022] GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715 => generated 1593 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:45:47.149157 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a2047c4e-9918-4338-8687-ad2e9665cee2 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:47.149642 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a2047c4e-9918-4338-8687-ad2e9665cee2 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:47.150219 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a2047c4e-9918-4338-8687-ad2e9665cee2 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:47.150968 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a2047c4e-9918-4338-8687-ad2e9665cee2 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:47.151424 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a2047c4e-9918-4338-8687-ad2e9665cee2 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:47.151852 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a2047c4e-9918-4338-8687-ad2e9665cee2 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:47.186471 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-30214dd2-3063-4e37-bd47-9b6849b4e178 req-78f0b21e-ff1b-461a-a476-bf6590b64172 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a721ca75-1707-4a91-96d0-431dece9b401", "name": "network-vif-deleted", "tag": "8c86755f-b407-4528-abb1-6c70d6106ad8"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:45:47.212689 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-30214dd2-3063-4e37-bd47-9b6849b4e178 req-78f0b21e-ff1b-461a-a476-bf6590b64172 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:47.220876 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-30214dd2-3063-4e37-bd47-9b6849b4e178 req-78f0b21e-ff1b-461a-a476-bf6590b64172 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:47.221771 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-30214dd2-3063-4e37-bd47-9b6849b4e178 req-78f0b21e-ff1b-461a-a476-bf6590b64172 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:47.265158 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-30214dd2-3063-4e37-bd47-9b6849b4e178 req-78f0b21e-ff1b-461a-a476-bf6590b64172 service nova] Creating event network-vif-deleted:8c86755f-b407-4528-abb1-6c70d6106ad8 for instance a721ca75-1707-4a91-96d0-431dece9b401 on n-h2-851028-13 Oct 04 18:45:47.279795 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-30214dd2-3063-4e37-bd47-9b6849b4e178 req-78f0b21e-ff1b-461a-a476-bf6590b64172 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097952 Oct 04 18:45:47.280513 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1604/3412] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:45:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:45:47.348820 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-76486f3a-0af4-4454-b196-52b3f29d3e75 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:47.356087 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-a2047c4e-9918-4338-8687-ad2e9665cee2 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c710f394164b89b16bcac2fe51c58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65037d4ea5124d749e42928032e803fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:47.361304 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-76486f3a-0af4-4454-b196-52b3f29d3e75 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] [instance: a721ca75-1707-4a91-96d0-431dece9b401] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:47.378399 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-a2047c4e-9918-4338-8687-ad2e9665cee2 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] 10.222.0.43 "GET /compute/v2.1/servers/00c17e4b-c80e-463e-a3e9-486c118552be" status: 200 len: 1214 microversion: 2.1 time: 0.272608 Oct 04 18:45:47.385788 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-76486f3a-0af4-4454-b196-52b3f29d3e75 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:47.386624 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1809/3413] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:47 2022] GET /compute/v2.1/servers/00c17e4b-c80e-463e-a3e9-486c118552be => generated 1214 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:47.391002 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-76486f3a-0af4-4454-b196-52b3f29d3e75 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:47.391738 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-76486f3a-0af4-4454-b196-52b3f29d3e75 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:47.394652 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-76486f3a-0af4-4454-b196-52b3f29d3e75 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:47.398195 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-76486f3a-0af4-4454-b196-52b3f29d3e75 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:47.398862 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-76486f3a-0af4-4454-b196-52b3f29d3e75 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:47.518781 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-76486f3a-0af4-4454-b196-52b3f29d3e75 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:47.519603 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-76486f3a-0af4-4454-b196-52b3f29d3e75 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:47.520244 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-76486f3a-0af4-4454-b196-52b3f29d3e75 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:47.520892 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.objects.instance [None req-76486f3a-0af4-4454-b196-52b3f29d3e75 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lazy-loading 'fault' on Instance uuid a721ca75-1707-4a91-96d0-431dece9b401 {{(pid=123595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:45:47.725881 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-2aa60d2d-a922-4b12-aee3-4679a0b675e1 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:47.726323 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-2aa60d2d-a922-4b12-aee3-4679a0b675e1 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] [instance: 15541ec9-3112-4adc-9fad-6d20a88f2c09] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:47.736142 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2aa60d2d-a922-4b12-aee3-4679a0b675e1 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:47.744515 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2aa60d2d-a922-4b12-aee3-4679a0b675e1 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:47.744983 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2aa60d2d-a922-4b12-aee3-4679a0b675e1 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:47.745861 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2aa60d2d-a922-4b12-aee3-4679a0b675e1 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:47.746452 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2aa60d2d-a922-4b12-aee3-4679a0b675e1 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:47.746973 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2aa60d2d-a922-4b12-aee3-4679a0b675e1 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:48.318219 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-76486f3a-0af4-4454-b196-52b3f29d3e75 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608fc9ed7cdb487c9bf4b783c26ceeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29876d6805924df882d6861b0f6ab4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:48.335017 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-76486f3a-0af4-4454-b196-52b3f29d3e75 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] 10.222.0.43 "GET /compute/v2.1/servers/a721ca75-1707-4a91-96d0-431dece9b401" status: 200 len: 1304 microversion: 2.1 time: 0.988951 Oct 04 18:45:48.337575 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1605/3414] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:47 2022] GET /compute/v2.1/servers/a721ca75-1707-4a91-96d0-431dece9b401 => generated 1304 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:48.343001 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-ff71fc6c-3104-4ac4-a5c8-ab965c8e977b tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:48.345899 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-ff71fc6c-3104-4ac4-a5c8-ab965c8e977b tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] [instance: 6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:48.359118 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ff71fc6c-3104-4ac4-a5c8-ab965c8e977b tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:48.359960 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ff71fc6c-3104-4ac4-a5c8-ab965c8e977b tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:48.360597 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ff71fc6c-3104-4ac4-a5c8-ab965c8e977b tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:48.361612 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ff71fc6c-3104-4ac4-a5c8-ab965c8e977b tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:48.362428 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ff71fc6c-3104-4ac4-a5c8-ab965c8e977b tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:48.363872 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ff71fc6c-3104-4ac4-a5c8-ab965c8e977b tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:48.403200 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-ff71fc6c-3104-4ac4-a5c8-ab965c8e977b tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] 10.222.0.43 "GET /compute/v2.1/servers/6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064123 Oct 04 18:45:48.414734 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1606/3415] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Oct 4 18:45:48 2022] GET /compute/v2.1/servers/6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:45:48.420948 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-dbb4eccc-71d0-4560-9bdb-6369034ba8d1 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:48.425555 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-dbb4eccc-71d0-4560-9bdb-6369034ba8d1 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: bb651218-4475-4df2-b470-56e737801e3b] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:48.441616 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dbb4eccc-71d0-4560-9bdb-6369034ba8d1 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:48.442365 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dbb4eccc-71d0-4560-9bdb-6369034ba8d1 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:48.442929 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dbb4eccc-71d0-4560-9bdb-6369034ba8d1 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:48.444113 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dbb4eccc-71d0-4560-9bdb-6369034ba8d1 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:48.444796 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dbb4eccc-71d0-4560-9bdb-6369034ba8d1 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:48.452617 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dbb4eccc-71d0-4560-9bdb-6369034ba8d1 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:48.693348 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-2aa60d2d-a922-4b12-aee3-4679a0b675e1 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96e7480de94c43909045ac1087e40cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6bd34bf5540ee95c8144f185eb22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:48.711423 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-2aa60d2d-a922-4b12-aee3-4679a0b675e1 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] 10.222.0.43 "GET /compute/v2.1/servers/15541ec9-3112-4adc-9fad-6d20a88f2c09" status: 200 len: 1734 microversion: 2.1 time: 0.985173 Oct 04 18:45:48.712702 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1810/3416] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:47 2022] GET /compute/v2.1/servers/15541ec9-3112-4adc-9fad-6d20a88f2c09 => generated 1734 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:48.735905 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-dbb4eccc-71d0-4560-9bdb-6369034ba8d1 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:48.739621 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-22c621e8-2771-477f-8342-6d576d950d82 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:48.744820 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-22c621e8-2771-477f-8342-6d576d950d82 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] [instance: fa47906d-d394-46fe-9143-780bcd27a715] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:48.748604 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-dbb4eccc-71d0-4560-9bdb-6369034ba8d1 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/bb651218-4475-4df2-b470-56e737801e3b" status: 200 len: 1273 microversion: 2.1 time: 0.331487 Oct 04 18:45:48.750307 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1607/3417] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:48 2022] GET /compute/v2.1/servers/bb651218-4475-4df2-b470-56e737801e3b => generated 1273 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:48.759997 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-6c8c91fb-7150-4828-8ded-a3d8854cc016 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:48.760891 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-6c8c91fb-7150-4828-8ded-a3d8854cc016 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] [instance: 00c17e4b-c80e-463e-a3e9-486c118552be] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:48.770682 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6c8c91fb-7150-4828-8ded-a3d8854cc016 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:48.771133 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-22c621e8-2771-477f-8342-6d576d950d82 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:48.771753 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-22c621e8-2771-477f-8342-6d576d950d82 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:48.772055 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6c8c91fb-7150-4828-8ded-a3d8854cc016 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:48.772602 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-22c621e8-2771-477f-8342-6d576d950d82 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:48.773433 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-22c621e8-2771-477f-8342-6d576d950d82 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:48.773847 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6c8c91fb-7150-4828-8ded-a3d8854cc016 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:48.774096 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-22c621e8-2771-477f-8342-6d576d950d82 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:48.774801 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-22c621e8-2771-477f-8342-6d576d950d82 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:48.775692 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6c8c91fb-7150-4828-8ded-a3d8854cc016 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:48.776329 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6c8c91fb-7150-4828-8ded-a3d8854cc016 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:48.776935 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6c8c91fb-7150-4828-8ded-a3d8854cc016 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:49.107798 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-6c8c91fb-7150-4828-8ded-a3d8854cc016 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c710f394164b89b16bcac2fe51c58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65037d4ea5124d749e42928032e803fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:49.120979 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-6c8c91fb-7150-4828-8ded-a3d8854cc016 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] 10.222.0.43 "GET /compute/v2.1/servers/00c17e4b-c80e-463e-a3e9-486c118552be" status: 200 len: 1276 microversion: 2.1 time: 0.366977 Oct 04 18:45:49.134640 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1608/3418] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:48 2022] GET /compute/v2.1/servers/00c17e4b-c80e-463e-a3e9-486c118552be => generated 1276 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:49.226259 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-22c621e8-2771-477f-8342-6d576d950d82 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:49.237002 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-22c621e8-2771-477f-8342-6d576d950d82 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:49.243122 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-22c621e8-2771-477f-8342-6d576d950d82 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:49.248019 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-22c621e8-2771-477f-8342-6d576d950d82 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] 10.222.0.43 "GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715" status: 200 len: 1660 microversion: 2.32 time: 0.532640 Oct 04 18:45:49.248638 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1811/3419] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:45:48 2022] GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715 => generated 1660 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:45:49.361018 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-6eb170cb-10b1-4e8a-9a72-ff51be10366e tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:49.362848 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-6eb170cb-10b1-4e8a-9a72-ff51be10366e tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] [instance: a721ca75-1707-4a91-96d0-431dece9b401] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:49.370204 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6eb170cb-10b1-4e8a-9a72-ff51be10366e tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:49.370934 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6eb170cb-10b1-4e8a-9a72-ff51be10366e tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:49.371573 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6eb170cb-10b1-4e8a-9a72-ff51be10366e tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:49.372456 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6eb170cb-10b1-4e8a-9a72-ff51be10366e tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:49.373077 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6eb170cb-10b1-4e8a-9a72-ff51be10366e tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:49.374667 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6eb170cb-10b1-4e8a-9a72-ff51be10366e tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:49.392329 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-6eb170cb-10b1-4e8a-9a72-ff51be10366e tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] HTTP exception thrown: Instance a721ca75-1707-4a91-96d0-431dece9b401 could not be found. Oct 04 18:45:49.394928 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-6eb170cb-10b1-4e8a-9a72-ff51be10366e tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Request method failure captured: Oct 04 18:45:49.394928 n-d-851028-13 devstack@n-api.service[123595]: request: GET /compute/v2.1/servers/a721ca75-1707-4a91-96d0-431dece9b401 HTTP/1.1 Oct 04 18:45:49.394928 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 18:45:49.394928 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 18:45:49.394928 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 18:45:49.394928 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 0 Oct 04 18:45:49.394928 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 18:45:49.394928 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 18:45:49.394928 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 18:45:49.394928 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 18:45:49.394928 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPH7GZKnmB5jFGNi35AdfhGkUxvQgLWK_ByIsMnuX5WZD-YmlNbqY6vCDVU-VOKkrPgfJbarP0ZGlSIBvUSrp9dt-QfnnR-dWwJlu63En7a9aSoLgQcbpsneoFbZX4GUvbv0gs2fIgnKUM4OCVlCc6_rIPczaA5JqIaFc-1vDRGzJeKk Oct 04 18:45:49.394928 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 18:45:49.394928 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 18:45:49.394928 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 18:45:49.394928 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 18:45:49.394928 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 18:45:49.394928 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 18:45:49.394928 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: 29876d6805924df882d6861b0f6ab4f0 Oct 04 18:45:49.394928 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-ServersAdminTestJSON-654254714 Oct 04 18:45:49.394928 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 18:45:49.394928 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 18:45:49.394928 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/29876d6805924df882d6861b0f6ab4f0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_29876d6805924df882d6861b0f6ab4f0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/29876d6805924df882d6861b0f6ab4f0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/29876d6805924df882d6861b0f6ab4f0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:45:49.394928 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-ServersAdminTestJSON-654254714 Oct 04 18:45:49.394928 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: 29876d6805924df882d6861b0f6ab4f0 Oct 04 18:45:49.394928 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-ServersAdminTestJSON-654254714 Oct 04 18:45:49.394928 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-ServersAdminTestJSON-654254714-project Oct 04 18:45:49.394928 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 18:45:49.394928 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 18:45:49.394928 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: 608fc9ed7cdb487c9bf4b783c26ceeb6 Oct 04 18:45:49.394928 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-ServersAdminTestJSON-654254714-project Oct 04 18:45:49.394928 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 18:45:49.394928 n-d-851028-13 devstack@n-api.service[123595]: exception: Instance a721ca75-1707-4a91-96d0-431dece9b401 could not be found. Oct 04 18:45:49.394928 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': 'a721ca75-1707-4a91-96d0-431dece9b401'} Oct 04 18:45:49.394928 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:45:49.394928 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:45:49.394928 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:45:49.394928 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:45:49.394928 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:45:49.394928 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:45:49.394928 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:45:49.394928 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:45:49.394928 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:45:49.394928 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:45:49.394928 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a721ca75-1707-4a91-96d0-431dece9b401 could not be found. Oct 04 18:45:49.394928 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:45:49.394928 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:45:49.394928 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:45:49.394928 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:45:49.394928 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:45:49.394928 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:45:49.394928 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:45:49.394928 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:45:49.394928 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:45:49.394928 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:45:49.394928 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:45:49.394928 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:45:49.394928 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:45:49.394928 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:45:49.394928 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:45:49.394928 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:45:49.394928 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a721ca75-1707-4a91-96d0-431dece9b401 could not be found. Oct 04 18:45:49.394928 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:45:49.394928 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:45:49.394928 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:45:49.399770 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:45:49.399770 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:45:49.399770 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:45:49.399770 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:45:49.399770 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:45:49.399770 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a721ca75-1707-4a91-96d0-431dece9b401 could not be found. Oct 04 18:45:49.399770 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:45:49.401374 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-6eb170cb-10b1-4e8a-9a72-ff51be10366e tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Returning 404 to user: Instance a721ca75-1707-4a91-96d0-431dece9b401 could not be found. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:45:49.402473 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-6eb170cb-10b1-4e8a-9a72-ff51be10366e tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] 10.222.0.43 "GET /compute/v2.1/servers/a721ca75-1707-4a91-96d0-431dece9b401" status: 404 len: 111 microversion: 2.1 time: 0.045364 Oct 04 18:45:49.407861 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1609/3420] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:49 2022] GET /compute/v2.1/servers/a721ca75-1707-4a91-96d0-431dece9b401 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:45:49.412378 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-57aa67c4-e6c1-4a06-91ec-18434c4a3426 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:49.412910 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-57aa67c4-e6c1-4a06-91ec-18434c4a3426 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] [instance: 601869a4-7b03-4c37-acb2-a7f8a94e3f26] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:49.426382 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-57aa67c4-e6c1-4a06-91ec-18434c4a3426 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:49.427210 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-57aa67c4-e6c1-4a06-91ec-18434c4a3426 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:49.427885 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-57aa67c4-e6c1-4a06-91ec-18434c4a3426 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:49.428842 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-57aa67c4-e6c1-4a06-91ec-18434c4a3426 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:49.429603 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-57aa67c4-e6c1-4a06-91ec-18434c4a3426 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:49.430326 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-57aa67c4-e6c1-4a06-91ec-18434c4a3426 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:49.432291 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-54f1a6a7-7520-48e9-9557-6da7554fe3d6 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:49.436499 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-54f1a6a7-7520-48e9-9557-6da7554fe3d6 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] [instance: 6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:49.450840 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-54f1a6a7-7520-48e9-9557-6da7554fe3d6 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:49.451351 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-54f1a6a7-7520-48e9-9557-6da7554fe3d6 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:49.454261 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-54f1a6a7-7520-48e9-9557-6da7554fe3d6 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:49.455276 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-54f1a6a7-7520-48e9-9557-6da7554fe3d6 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:49.461159 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-54f1a6a7-7520-48e9-9557-6da7554fe3d6 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:49.461828 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-54f1a6a7-7520-48e9-9557-6da7554fe3d6 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:49.466137 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-57aa67c4-e6c1-4a06-91ec-18434c4a3426 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] [instance: 601869a4-7b03-4c37-acb2-a7f8a94e3f26] Going to try to terminate instance {{(pid=123596) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:45:49.581618 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-54f1a6a7-7520-48e9-9557-6da7554fe3d6 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] 10.222.0.43 "GET /compute/v2.1/servers/6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.163202 Oct 04 18:45:49.583913 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1610/3421] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Oct 4 18:45:49 2022] GET /compute/v2.1/servers/6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75/os-volume_attachments => generated 197 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:45:49.593066 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-be5608e9-5ed0-4506-b420-9d07ac87da71 req-aa9991ab-f7a3-4135-9556-3e5092e12890 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b28a95a5-c6c2-4781-8c1a-62e7d3eac5a7", "name": "network-vif-deleted", "tag": "f42c238a-1ff4-4b31-8e94-8e0d356f5cfb"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:45:49.614400 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-be5608e9-5ed0-4506-b420-9d07ac87da71 req-aa9991ab-f7a3-4135-9556-3e5092e12890 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:49.615409 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-be5608e9-5ed0-4506-b420-9d07ac87da71 req-aa9991ab-f7a3-4135-9556-3e5092e12890 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:49.616196 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-be5608e9-5ed0-4506-b420-9d07ac87da71 req-aa9991ab-f7a3-4135-9556-3e5092e12890 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:49.639200 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-be5608e9-5ed0-4506-b420-9d07ac87da71 req-aa9991ab-f7a3-4135-9556-3e5092e12890 service nova] Creating event network-vif-deleted:f42c238a-1ff4-4b31-8e94-8e0d356f5cfb for instance b28a95a5-c6c2-4781-8c1a-62e7d3eac5a7 on n-h2-851028-13 Oct 04 18:45:49.644026 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-57aa67c4-e6c1-4a06-91ec-18434c4a3426 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] 10.222.0.43 "DELETE /compute/v2.1/servers/601869a4-7b03-4c37-acb2-a7f8a94e3f26" status: 204 len: 0 microversion: 2.1 time: 0.236000 Oct 04 18:45:49.644658 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1812/3422] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 18:45:49 2022] DELETE /compute/v2.1/servers/601869a4-7b03-4c37-acb2-a7f8a94e3f26 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 18:45:49.657486 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-be5608e9-5ed0-4506-b420-9d07ac87da71 req-aa9991ab-f7a3-4135-9556-3e5092e12890 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071143 Oct 04 18:45:49.661992 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-eca19ee3-4aef-40bf-ac29-f5831cb6df5d tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:49.663023 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1611/3423] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:45:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:45:49.663575 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-eca19ee3-4aef-40bf-ac29-f5831cb6df5d tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] [instance: 601869a4-7b03-4c37-acb2-a7f8a94e3f26] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:49.672254 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-eca19ee3-4aef-40bf-ac29-f5831cb6df5d tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:49.672782 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-eca19ee3-4aef-40bf-ac29-f5831cb6df5d tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:49.673272 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-eca19ee3-4aef-40bf-ac29-f5831cb6df5d tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:49.674745 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-eca19ee3-4aef-40bf-ac29-f5831cb6df5d tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:49.674745 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-eca19ee3-4aef-40bf-ac29-f5831cb6df5d tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:49.675153 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-eca19ee3-4aef-40bf-ac29-f5831cb6df5d tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:49.703023 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:45:49.737685 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-05869023-3d56-4fc9-a984-72078d3ca9b8 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:49.738685 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-05869023-3d56-4fc9-a984-72078d3ca9b8 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] [instance: 15541ec9-3112-4adc-9fad-6d20a88f2c09] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:49.758793 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-05869023-3d56-4fc9-a984-72078d3ca9b8 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:49.759343 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-05869023-3d56-4fc9-a984-72078d3ca9b8 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:49.761412 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-05869023-3d56-4fc9-a984-72078d3ca9b8 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:49.763181 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-05869023-3d56-4fc9-a984-72078d3ca9b8 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:49.764081 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-05869023-3d56-4fc9-a984-72078d3ca9b8 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:49.765851 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-05869023-3d56-4fc9-a984-72078d3ca9b8 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:49.967020 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-eca19ee3-4aef-40bf-ac29-f5831cb6df5d tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608fc9ed7cdb487c9bf4b783c26ceeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29876d6805924df882d6861b0f6ab4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:49.994729 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-eca19ee3-4aef-40bf-ac29-f5831cb6df5d tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] 10.222.0.43 "GET /compute/v2.1/servers/601869a4-7b03-4c37-acb2-a7f8a94e3f26" status: 200 len: 1469 microversion: 2.1 time: 0.344831 Oct 04 18:45:49.996073 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1813/3424] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:49 2022] GET /compute/v2.1/servers/601869a4-7b03-4c37-acb2-a7f8a94e3f26 => generated 1469 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:50.003219 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-d06514de-aed0-40ec-8c37-5e45e9fba38c tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:50.006162 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-d06514de-aed0-40ec-8c37-5e45e9fba38c tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: bb651218-4475-4df2-b470-56e737801e3b] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:50.015523 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d06514de-aed0-40ec-8c37-5e45e9fba38c tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:50.016039 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d06514de-aed0-40ec-8c37-5e45e9fba38c tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:50.016491 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d06514de-aed0-40ec-8c37-5e45e9fba38c tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:50.017261 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d06514de-aed0-40ec-8c37-5e45e9fba38c tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:50.017728 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d06514de-aed0-40ec-8c37-5e45e9fba38c tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:50.018712 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d06514de-aed0-40ec-8c37-5e45e9fba38c tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:50.118462 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-d06514de-aed0-40ec-8c37-5e45e9fba38c tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:50.127690 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-d06514de-aed0-40ec-8c37-5e45e9fba38c tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/bb651218-4475-4df2-b470-56e737801e3b" status: 200 len: 1273 microversion: 2.1 time: 0.129095 Oct 04 18:45:50.135290 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-05869023-3d56-4fc9-a984-72078d3ca9b8 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96e7480de94c43909045ac1087e40cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6bd34bf5540ee95c8144f185eb22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:50.144185 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1814/3425] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:49 2022] GET /compute/v2.1/servers/bb651218-4475-4df2-b470-56e737801e3b => generated 1273 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:50.150098 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-05869023-3d56-4fc9-a984-72078d3ca9b8 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] 10.222.0.43 "GET /compute/v2.1/servers/15541ec9-3112-4adc-9fad-6d20a88f2c09" status: 200 len: 1734 microversion: 2.1 time: 0.417218 Oct 04 18:45:50.150289 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-38dc3085-fb26-42d9-a690-9efc50b3aadf tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:50.150691 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1612/3426] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:49 2022] GET /compute/v2.1/servers/15541ec9-3112-4adc-9fad-6d20a88f2c09 => generated 1734 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:45:50.150917 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-38dc3085-fb26-42d9-a690-9efc50b3aadf tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] [instance: 00c17e4b-c80e-463e-a3e9-486c118552be] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:50.175926 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-38dc3085-fb26-42d9-a690-9efc50b3aadf tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:50.176440 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-38dc3085-fb26-42d9-a690-9efc50b3aadf tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:50.176892 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-38dc3085-fb26-42d9-a690-9efc50b3aadf tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:50.177653 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-38dc3085-fb26-42d9-a690-9efc50b3aadf tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:50.178116 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-38dc3085-fb26-42d9-a690-9efc50b3aadf tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:50.178555 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-38dc3085-fb26-42d9-a690-9efc50b3aadf tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:50.274053 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-38dc3085-fb26-42d9-a690-9efc50b3aadf tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c710f394164b89b16bcac2fe51c58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65037d4ea5124d749e42928032e803fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:50.276069 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-f5e428f0-9c15-472c-938d-02735acff1aa tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:50.276993 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-f5e428f0-9c15-472c-938d-02735acff1aa tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] [instance: fa47906d-d394-46fe-9143-780bcd27a715] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:50.285156 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f5e428f0-9c15-472c-938d-02735acff1aa tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:50.289727 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-38dc3085-fb26-42d9-a690-9efc50b3aadf tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] 10.222.0.43 "GET /compute/v2.1/servers/00c17e4b-c80e-463e-a3e9-486c118552be" status: 200 len: 1276 microversion: 2.1 time: 0.143810 Oct 04 18:45:50.291379 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1815/3427] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:50 2022] GET /compute/v2.1/servers/00c17e4b-c80e-463e-a3e9-486c118552be => generated 1276 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:50.306852 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f5e428f0-9c15-472c-938d-02735acff1aa tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:50.306852 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f5e428f0-9c15-472c-938d-02735acff1aa tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:50.306852 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f5e428f0-9c15-472c-938d-02735acff1aa tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:50.306852 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f5e428f0-9c15-472c-938d-02735acff1aa tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:50.306852 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f5e428f0-9c15-472c-938d-02735acff1aa tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:50.596739 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-e48a71c5-a3fd-443c-af1f-5678917e895a tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:50.603923 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-e48a71c5-a3fd-443c-af1f-5678917e895a tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] [instance: 6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:50.617597 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e48a71c5-a3fd-443c-af1f-5678917e895a tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:50.621553 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e48a71c5-a3fd-443c-af1f-5678917e895a tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:50.622230 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e48a71c5-a3fd-443c-af1f-5678917e895a tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:50.623155 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e48a71c5-a3fd-443c-af1f-5678917e895a tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:50.624996 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e48a71c5-a3fd-443c-af1f-5678917e895a tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:50.627033 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e48a71c5-a3fd-443c-af1f-5678917e895a tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:50.676050 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-e48a71c5-a3fd-443c-af1f-5678917e895a tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] 10.222.0.43 "GET /compute/v2.1/servers/6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.083614 Oct 04 18:45:50.681867 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1816/3428] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Oct 4 18:45:50 2022] GET /compute/v2.1/servers/6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:45:50.849044 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-f5e428f0-9c15-472c-938d-02735acff1aa tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:50.863722 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-f5e428f0-9c15-472c-938d-02735acff1aa tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:50.867529 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-f5e428f0-9c15-472c-938d-02735acff1aa tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:50.872647 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-f5e428f0-9c15-472c-938d-02735acff1aa tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] 10.222.0.43 "GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715" status: 200 len: 1660 microversion: 2.32 time: 0.601147 Oct 04 18:45:50.873423 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1613/3429] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:45:50 2022] GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715 => generated 1660 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:45:51.029739 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-e9db67fe-ac95-4a12-848a-cd0bafd59dc9 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:51.033541 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-e9db67fe-ac95-4a12-848a-cd0bafd59dc9 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] [instance: 601869a4-7b03-4c37-acb2-a7f8a94e3f26] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:51.049816 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:45:51.053019 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e9db67fe-ac95-4a12-848a-cd0bafd59dc9 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:51.053644 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e9db67fe-ac95-4a12-848a-cd0bafd59dc9 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:51.054102 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e9db67fe-ac95-4a12-848a-cd0bafd59dc9 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:51.054916 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e9db67fe-ac95-4a12-848a-cd0bafd59dc9 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:51.055547 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e9db67fe-ac95-4a12-848a-cd0bafd59dc9 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:51.056139 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e9db67fe-ac95-4a12-848a-cd0bafd59dc9 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:51.151424 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-69824ad5-be7e-4b3c-bcc5-36d36aade53a tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:51.152329 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-69824ad5-be7e-4b3c-bcc5-36d36aade53a tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: bb651218-4475-4df2-b470-56e737801e3b] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:51.159447 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-69824ad5-be7e-4b3c-bcc5-36d36aade53a tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:51.160623 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-69824ad5-be7e-4b3c-bcc5-36d36aade53a tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:51.161280 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-69824ad5-be7e-4b3c-bcc5-36d36aade53a tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:51.162386 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-69824ad5-be7e-4b3c-bcc5-36d36aade53a tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:51.163017 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-69824ad5-be7e-4b3c-bcc5-36d36aade53a tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:51.164486 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-69824ad5-be7e-4b3c-bcc5-36d36aade53a tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:51.271653 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-e9db67fe-ac95-4a12-848a-cd0bafd59dc9 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608fc9ed7cdb487c9bf4b783c26ceeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29876d6805924df882d6861b0f6ab4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:51.284185 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-e9db67fe-ac95-4a12-848a-cd0bafd59dc9 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] 10.222.0.43 "GET /compute/v2.1/servers/601869a4-7b03-4c37-acb2-a7f8a94e3f26" status: 200 len: 1469 microversion: 2.1 time: 0.268090 Oct 04 18:45:51.284724 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1817/3430] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:51 2022] GET /compute/v2.1/servers/601869a4-7b03-4c37-acb2-a7f8a94e3f26 => generated 1469 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:45:51.291801 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-9ebf68fa-8a75-4861-8136-8407f0ad814b tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:51.292539 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-9ebf68fa-8a75-4861-8136-8407f0ad814b tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] [instance: 15541ec9-3112-4adc-9fad-6d20a88f2c09] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:51.300521 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9ebf68fa-8a75-4861-8136-8407f0ad814b tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:51.301015 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9ebf68fa-8a75-4861-8136-8407f0ad814b tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:51.301724 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9ebf68fa-8a75-4861-8136-8407f0ad814b tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:51.302689 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9ebf68fa-8a75-4861-8136-8407f0ad814b tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:51.303383 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9ebf68fa-8a75-4861-8136-8407f0ad814b tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:51.304132 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9ebf68fa-8a75-4861-8136-8407f0ad814b tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:51.542895 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-9ebf68fa-8a75-4861-8136-8407f0ad814b tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96e7480de94c43909045ac1087e40cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6bd34bf5540ee95c8144f185eb22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:51.556017 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-9ebf68fa-8a75-4861-8136-8407f0ad814b tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] 10.222.0.43 "GET /compute/v2.1/servers/15541ec9-3112-4adc-9fad-6d20a88f2c09" status: 200 len: 1734 microversion: 2.1 time: 0.270238 Oct 04 18:45:51.560152 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1818/3431] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:51 2022] GET /compute/v2.1/servers/15541ec9-3112-4adc-9fad-6d20a88f2c09 => generated 1734 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:51.572561 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-ad9bfb70-a88f-4d96-81e0-04c1f8e2734e tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:51.573559 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-ad9bfb70-a88f-4d96-81e0-04c1f8e2734e tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] [instance: 00c17e4b-c80e-463e-a3e9-486c118552be] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:51.588182 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ad9bfb70-a88f-4d96-81e0-04c1f8e2734e tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:51.588860 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ad9bfb70-a88f-4d96-81e0-04c1f8e2734e tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:51.589483 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ad9bfb70-a88f-4d96-81e0-04c1f8e2734e tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:51.590345 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ad9bfb70-a88f-4d96-81e0-04c1f8e2734e tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:51.590954 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ad9bfb70-a88f-4d96-81e0-04c1f8e2734e tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:51.591537 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ad9bfb70-a88f-4d96-81e0-04c1f8e2734e tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:51.786851 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-ad9bfb70-a88f-4d96-81e0-04c1f8e2734e tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c710f394164b89b16bcac2fe51c58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65037d4ea5124d749e42928032e803fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:51.796567 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-ad9bfb70-a88f-4d96-81e0-04c1f8e2734e tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] 10.222.0.43 "GET /compute/v2.1/servers/00c17e4b-c80e-463e-a3e9-486c118552be" status: 200 len: 1318 microversion: 2.1 time: 0.234961 Oct 04 18:45:51.800693 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1819/3432] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:51 2022] GET /compute/v2.1/servers/00c17e4b-c80e-463e-a3e9-486c118552be => generated 1318 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:51.813481 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-2b684516-1312-4879-9168-bc5964740d9c tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:51.817501 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-2b684516-1312-4879-9168-bc5964740d9c tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] [instance: 6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:51.832569 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2b684516-1312-4879-9168-bc5964740d9c tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:51.834187 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2b684516-1312-4879-9168-bc5964740d9c tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:51.839135 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2b684516-1312-4879-9168-bc5964740d9c tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:51.840340 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2b684516-1312-4879-9168-bc5964740d9c tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:51.841326 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2b684516-1312-4879-9168-bc5964740d9c tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:51.841744 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2b684516-1312-4879-9168-bc5964740d9c tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:51.905081 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-2b684516-1312-4879-9168-bc5964740d9c tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] 10.222.0.43 "GET /compute/v2.1/servers/6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.101192 Oct 04 18:45:51.906119 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1820/3433] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Oct 4 18:45:51 2022] GET /compute/v2.1/servers/6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75/os-volume_attachments => generated 197 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:45:51.916543 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-36c9025a-6dd2-4328-abb0-d427b0f870c8 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:51.917194 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-36c9025a-6dd2-4328-abb0-d427b0f870c8 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] [instance: fa47906d-d394-46fe-9143-780bcd27a715] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:51.930968 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-36c9025a-6dd2-4328-abb0-d427b0f870c8 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:51.936170 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-36c9025a-6dd2-4328-abb0-d427b0f870c8 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:51.936634 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-36c9025a-6dd2-4328-abb0-d427b0f870c8 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:51.937413 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-36c9025a-6dd2-4328-abb0-d427b0f870c8 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:51.937885 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-36c9025a-6dd2-4328-abb0-d427b0f870c8 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:51.938318 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-36c9025a-6dd2-4328-abb0-d427b0f870c8 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:52.039486 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-69824ad5-be7e-4b3c-bcc5-36d36aade53a tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:52.048924 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-69824ad5-be7e-4b3c-bcc5-36d36aade53a tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/bb651218-4475-4df2-b470-56e737801e3b" status: 200 len: 1315 microversion: 2.1 time: 0.901561 Oct 04 18:45:52.050246 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1614/3434] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:51 2022] GET /compute/v2.1/servers/bb651218-4475-4df2-b470-56e737801e3b => generated 1315 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:45:52.311062 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-389f3b84-5434-4be9-9a73-eae8655b1105 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:52.313427 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-389f3b84-5434-4be9-9a73-eae8655b1105 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] [instance: 601869a4-7b03-4c37-acb2-a7f8a94e3f26] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:52.322068 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-389f3b84-5434-4be9-9a73-eae8655b1105 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:52.322930 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-389f3b84-5434-4be9-9a73-eae8655b1105 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:52.323701 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-389f3b84-5434-4be9-9a73-eae8655b1105 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:52.324817 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-389f3b84-5434-4be9-9a73-eae8655b1105 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:52.325583 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-389f3b84-5434-4be9-9a73-eae8655b1105 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:52.326261 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-389f3b84-5434-4be9-9a73-eae8655b1105 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:52.786907 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-36c9025a-6dd2-4328-abb0-d427b0f870c8 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:52.803164 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-36c9025a-6dd2-4328-abb0-d427b0f870c8 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:52.806997 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-36c9025a-6dd2-4328-abb0-d427b0f870c8 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:52.809264 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-36c9025a-6dd2-4328-abb0-d427b0f870c8 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] 10.222.0.43 "GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715" status: 200 len: 1706 microversion: 2.32 time: 0.901868 Oct 04 18:45:52.813955 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1821/3435] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:45:51 2022] GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715 => generated 1706 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:45:52.834213 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-8a3170bc-2759-4945-a331-eaf6e032991a tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:52.834953 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-8a3170bc-2759-4945-a331-eaf6e032991a tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] [instance: 15541ec9-3112-4adc-9fad-6d20a88f2c09] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:52.848368 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8a3170bc-2759-4945-a331-eaf6e032991a tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:52.848879 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8a3170bc-2759-4945-a331-eaf6e032991a tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:52.849354 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8a3170bc-2759-4945-a331-eaf6e032991a tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:52.850077 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8a3170bc-2759-4945-a331-eaf6e032991a tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:52.850787 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8a3170bc-2759-4945-a331-eaf6e032991a tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:52.851230 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8a3170bc-2759-4945-a331-eaf6e032991a tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:53.179721 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-8a3170bc-2759-4945-a331-eaf6e032991a tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96e7480de94c43909045ac1087e40cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6bd34bf5540ee95c8144f185eb22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:53.200250 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-8a3170bc-2759-4945-a331-eaf6e032991a tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] 10.222.0.43 "GET /compute/v2.1/servers/15541ec9-3112-4adc-9fad-6d20a88f2c09" status: 200 len: 1734 microversion: 2.1 time: 0.384525 Oct 04 18:45:53.201193 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1822/3436] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:52 2022] GET /compute/v2.1/servers/15541ec9-3112-4adc-9fad-6d20a88f2c09 => generated 1734 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:53.207329 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-b31597cc-0188-4f07-879a-83ab0db3f7ab tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:53.208305 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-b31597cc-0188-4f07-879a-83ab0db3f7ab tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] [instance: 00c17e4b-c80e-463e-a3e9-486c118552be] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:53.217508 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b31597cc-0188-4f07-879a-83ab0db3f7ab tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:53.218414 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b31597cc-0188-4f07-879a-83ab0db3f7ab tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:53.219863 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b31597cc-0188-4f07-879a-83ab0db3f7ab tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:53.220969 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b31597cc-0188-4f07-879a-83ab0db3f7ab tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:53.221712 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b31597cc-0188-4f07-879a-83ab0db3f7ab tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:53.222549 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b31597cc-0188-4f07-879a-83ab0db3f7ab tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:53.500799 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-b31597cc-0188-4f07-879a-83ab0db3f7ab tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c710f394164b89b16bcac2fe51c58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65037d4ea5124d749e42928032e803fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:53.519472 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-b31597cc-0188-4f07-879a-83ab0db3f7ab tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] 10.222.0.43 "GET /compute/v2.1/servers/00c17e4b-c80e-463e-a3e9-486c118552be" status: 200 len: 1318 microversion: 2.1 time: 0.316183 Oct 04 18:45:53.520267 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1823/3437] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:53 2022] GET /compute/v2.1/servers/00c17e4b-c80e-463e-a3e9-486c118552be => generated 1318 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:53.535417 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-bf989db2-9291-4bb8-a9b3-8f9c6f315352 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:53.538101 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-bf989db2-9291-4bb8-a9b3-8f9c6f315352 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] [instance: 6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:53.552897 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bf989db2-9291-4bb8-a9b3-8f9c6f315352 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:53.553674 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bf989db2-9291-4bb8-a9b3-8f9c6f315352 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:53.555199 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bf989db2-9291-4bb8-a9b3-8f9c6f315352 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:53.557019 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bf989db2-9291-4bb8-a9b3-8f9c6f315352 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:53.561219 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bf989db2-9291-4bb8-a9b3-8f9c6f315352 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:53.561934 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bf989db2-9291-4bb8-a9b3-8f9c6f315352 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:53.658605 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-bf989db2-9291-4bb8-a9b3-8f9c6f315352 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] 10.222.0.43 "GET /compute/v2.1/servers/6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.135668 Oct 04 18:45:53.660013 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1824/3438] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Oct 4 18:45:53 2022] GET /compute/v2.1/servers/6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75/os-volume_attachments => generated 197 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:45:53.679159 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-908560dd-3c77-4d28-8484-6314f6f419ef tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:53.680102 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-908560dd-3c77-4d28-8484-6314f6f419ef tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: bb651218-4475-4df2-b470-56e737801e3b] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:53.694713 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-908560dd-3c77-4d28-8484-6314f6f419ef tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:53.695481 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-908560dd-3c77-4d28-8484-6314f6f419ef tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:53.696095 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-908560dd-3c77-4d28-8484-6314f6f419ef tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:53.697023 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-908560dd-3c77-4d28-8484-6314f6f419ef tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:53.697938 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-908560dd-3c77-4d28-8484-6314f6f419ef tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:53.699355 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-908560dd-3c77-4d28-8484-6314f6f419ef tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:53.742017 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-389f3b84-5434-4be9-9a73-eae8655b1105 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608fc9ed7cdb487c9bf4b783c26ceeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29876d6805924df882d6861b0f6ab4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:53.746172 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:45:53.764778 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-389f3b84-5434-4be9-9a73-eae8655b1105 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] 10.222.0.43 "GET /compute/v2.1/servers/601869a4-7b03-4c37-acb2-a7f8a94e3f26" status: 200 len: 1469 microversion: 2.1 time: 1.455129 Oct 04 18:45:53.784075 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1615/3439] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:52 2022] GET /compute/v2.1/servers/601869a4-7b03-4c37-acb2-a7f8a94e3f26 => generated 1469 bytes in 1477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:53.791250 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-9ab4463a-9967-4a85-9ac9-1da109061c7c req-2eb363fd-1fd1-4c07-b877-ffd6550c8023 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "601869a4-7b03-4c37-acb2-a7f8a94e3f26", "name": "network-vif-deleted", "tag": "4e55aee8-a71d-40a5-bff3-55f31acb30ca"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:45:53.836355 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-9ab4463a-9967-4a85-9ac9-1da109061c7c req-2eb363fd-1fd1-4c07-b877-ffd6550c8023 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:53.839294 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-9ab4463a-9967-4a85-9ac9-1da109061c7c req-2eb363fd-1fd1-4c07-b877-ffd6550c8023 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:53.839925 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-9ab4463a-9967-4a85-9ac9-1da109061c7c req-2eb363fd-1fd1-4c07-b877-ffd6550c8023 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:53.862662 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-9ab4463a-9967-4a85-9ac9-1da109061c7c req-2eb363fd-1fd1-4c07-b877-ffd6550c8023 service nova] Creating event network-vif-deleted:4e55aee8-a71d-40a5-bff3-55f31acb30ca for instance 601869a4-7b03-4c37-acb2-a7f8a94e3f26 on n-h2-851028-13 Oct 04 18:45:53.869861 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-9ab4463a-9967-4a85-9ac9-1da109061c7c req-2eb363fd-1fd1-4c07-b877-ffd6550c8023 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082646 Oct 04 18:45:53.871071 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1616/3440] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:45:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:45:53.879830 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-f92f5e5b-264e-47f3-8496-25d391fce46f tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:53.881243 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-f92f5e5b-264e-47f3-8496-25d391fce46f tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] [instance: fa47906d-d394-46fe-9143-780bcd27a715] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:53.890703 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f92f5e5b-264e-47f3-8496-25d391fce46f tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:53.891876 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f92f5e5b-264e-47f3-8496-25d391fce46f tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:53.892558 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f92f5e5b-264e-47f3-8496-25d391fce46f tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:53.894210 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f92f5e5b-264e-47f3-8496-25d391fce46f tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:53.894906 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f92f5e5b-264e-47f3-8496-25d391fce46f tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:53.896808 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f92f5e5b-264e-47f3-8496-25d391fce46f tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:54.087594 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-908560dd-3c77-4d28-8484-6314f6f419ef tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:54.098831 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-908560dd-3c77-4d28-8484-6314f6f419ef tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/bb651218-4475-4df2-b470-56e737801e3b" status: 200 len: 1315 microversion: 2.1 time: 0.430108 Oct 04 18:45:54.100783 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1825/3441] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:53 2022] GET /compute/v2.1/servers/bb651218-4475-4df2-b470-56e737801e3b => generated 1315 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:54.229731 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-05b3a680-990c-4dd4-a727-759e17dfab61 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:54.230508 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-05b3a680-990c-4dd4-a727-759e17dfab61 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] [instance: 15541ec9-3112-4adc-9fad-6d20a88f2c09] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:54.241013 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-05b3a680-990c-4dd4-a727-759e17dfab61 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:54.241617 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-05b3a680-990c-4dd4-a727-759e17dfab61 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:54.241999 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-05b3a680-990c-4dd4-a727-759e17dfab61 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:54.250277 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-05b3a680-990c-4dd4-a727-759e17dfab61 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:54.251013 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-05b3a680-990c-4dd4-a727-759e17dfab61 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:54.251660 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-05b3a680-990c-4dd4-a727-759e17dfab61 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:54.526327 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-f92f5e5b-264e-47f3-8496-25d391fce46f tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:54.542019 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-f92f5e5b-264e-47f3-8496-25d391fce46f tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:54.544421 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-f92f5e5b-264e-47f3-8496-25d391fce46f tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:54.549393 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-05b3a680-990c-4dd4-a727-759e17dfab61 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96e7480de94c43909045ac1087e40cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6bd34bf5540ee95c8144f185eb22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:54.551013 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-f92f5e5b-264e-47f3-8496-25d391fce46f tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] 10.222.0.43 "GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715" status: 200 len: 1706 microversion: 2.32 time: 0.678374 Oct 04 18:45:54.551607 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1617/3442] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:45:53 2022] GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715 => generated 1706 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:45:54.563882 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-05b3a680-990c-4dd4-a727-759e17dfab61 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] 10.222.0.43 "GET /compute/v2.1/servers/15541ec9-3112-4adc-9fad-6d20a88f2c09" status: 200 len: 1734 microversion: 2.1 time: 0.338883 Oct 04 18:45:54.567096 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1826/3443] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:54 2022] GET /compute/v2.1/servers/15541ec9-3112-4adc-9fad-6d20a88f2c09 => generated 1734 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:54.572721 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-5e7c423d-aff8-4779-9df6-30fddddf658a tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:54.573495 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-5e7c423d-aff8-4779-9df6-30fddddf658a tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] [instance: 00c17e4b-c80e-463e-a3e9-486c118552be] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:54.583463 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5e7c423d-aff8-4779-9df6-30fddddf658a tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:54.592249 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5e7c423d-aff8-4779-9df6-30fddddf658a tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:54.592462 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5e7c423d-aff8-4779-9df6-30fddddf658a tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:54.593211 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5e7c423d-aff8-4779-9df6-30fddddf658a tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:54.593902 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5e7c423d-aff8-4779-9df6-30fddddf658a tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:54.594509 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5e7c423d-aff8-4779-9df6-30fddddf658a tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:54.681850 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-d220e93d-9fee-44db-bc60-8cf392af9fb4 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:54.684139 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-d220e93d-9fee-44db-bc60-8cf392af9fb4 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] [instance: 6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:54.706039 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d220e93d-9fee-44db-bc60-8cf392af9fb4 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:54.706549 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d220e93d-9fee-44db-bc60-8cf392af9fb4 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:54.706997 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d220e93d-9fee-44db-bc60-8cf392af9fb4 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:54.707720 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d220e93d-9fee-44db-bc60-8cf392af9fb4 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:54.708182 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d220e93d-9fee-44db-bc60-8cf392af9fb4 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:54.708624 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d220e93d-9fee-44db-bc60-8cf392af9fb4 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:54.762913 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-d220e93d-9fee-44db-bc60-8cf392af9fb4 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] 10.222.0.43 "GET /compute/v2.1/servers/6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.093027 Oct 04 18:45:54.764029 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1827/3444] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Oct 4 18:45:54 2022] GET /compute/v2.1/servers/6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75/os-volume_attachments => generated 197 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:45:54.794011 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-0f454cdd-b48a-4fba-a1a9-47b49c289605 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:54.794881 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-0f454cdd-b48a-4fba-a1a9-47b49c289605 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] [instance: 601869a4-7b03-4c37-acb2-a7f8a94e3f26] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:54.810625 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0f454cdd-b48a-4fba-a1a9-47b49c289605 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:54.811602 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0f454cdd-b48a-4fba-a1a9-47b49c289605 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:54.812817 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0f454cdd-b48a-4fba-a1a9-47b49c289605 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:54.813946 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0f454cdd-b48a-4fba-a1a9-47b49c289605 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:54.814651 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0f454cdd-b48a-4fba-a1a9-47b49c289605 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:54.815340 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0f454cdd-b48a-4fba-a1a9-47b49c289605 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:54.866845 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0f454cdd-b48a-4fba-a1a9-47b49c289605 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:54.867594 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0f454cdd-b48a-4fba-a1a9-47b49c289605 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:54.868226 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0f454cdd-b48a-4fba-a1a9-47b49c289605 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:54.869019 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.objects.instance [None req-0f454cdd-b48a-4fba-a1a9-47b49c289605 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lazy-loading 'fault' on Instance uuid 601869a4-7b03-4c37-acb2-a7f8a94e3f26 {{(pid=123596) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:45:54.972928 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-0f454cdd-b48a-4fba-a1a9-47b49c289605 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608fc9ed7cdb487c9bf4b783c26ceeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29876d6805924df882d6861b0f6ab4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:54.980760 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-0f454cdd-b48a-4fba-a1a9-47b49c289605 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] 10.222.0.43 "GET /compute/v2.1/servers/601869a4-7b03-4c37-acb2-a7f8a94e3f26" status: 200 len: 1303 microversion: 2.1 time: 0.191458 Oct 04 18:45:54.985954 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1828/3445] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:54 2022] GET /compute/v2.1/servers/601869a4-7b03-4c37-acb2-a7f8a94e3f26 => generated 1303 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:55.123849 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-bfdac3db-b48e-4d21-ac26-425ff1f6f3bc tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:55.124487 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-bfdac3db-b48e-4d21-ac26-425ff1f6f3bc tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: bb651218-4475-4df2-b470-56e737801e3b] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:55.144528 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bfdac3db-b48e-4d21-ac26-425ff1f6f3bc tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:55.145029 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bfdac3db-b48e-4d21-ac26-425ff1f6f3bc tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:55.145582 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bfdac3db-b48e-4d21-ac26-425ff1f6f3bc tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:55.151587 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bfdac3db-b48e-4d21-ac26-425ff1f6f3bc tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:55.151587 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bfdac3db-b48e-4d21-ac26-425ff1f6f3bc tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:55.151587 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bfdac3db-b48e-4d21-ac26-425ff1f6f3bc tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:55.181057 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=100 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:45:55.410502 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=2 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:45:55.420924 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-5e7c423d-aff8-4779-9df6-30fddddf658a tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c710f394164b89b16bcac2fe51c58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65037d4ea5124d749e42928032e803fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:55.434457 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-bfdac3db-b48e-4d21-ac26-425ff1f6f3bc tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:55.450059 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-5e7c423d-aff8-4779-9df6-30fddddf658a tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] 10.222.0.43 "GET /compute/v2.1/servers/00c17e4b-c80e-463e-a3e9-486c118552be" status: 200 len: 1318 microversion: 2.1 time: 0.888964 Oct 04 18:45:55.456382 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1618/3446] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:54 2022] GET /compute/v2.1/servers/00c17e4b-c80e-463e-a3e9-486c118552be => generated 1318 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:55.459291 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-bfdac3db-b48e-4d21-ac26-425ff1f6f3bc tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/bb651218-4475-4df2-b470-56e737801e3b" status: 200 len: 1315 microversion: 2.1 time: 0.339177 Oct 04 18:45:55.470335 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1829/3447] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:55 2022] GET /compute/v2.1/servers/bb651218-4475-4df2-b470-56e737801e3b => generated 1315 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:45:55.579955 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-2ffc9387-4f1a-4f3e-92e7-0313db7e7266 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:55.581250 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-2ffc9387-4f1a-4f3e-92e7-0313db7e7266 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] [instance: fa47906d-d394-46fe-9143-780bcd27a715] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:55.583882 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=4 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:45:55.587097 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:45:55.596435 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-34e99247-003c-4ed2-bb0d-f78a728a9d0d tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:55.597363 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-34e99247-003c-4ed2-bb0d-f78a728a9d0d tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] [instance: 15541ec9-3112-4adc-9fad-6d20a88f2c09] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:55.601994 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=14 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:45:55.615610 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-34e99247-003c-4ed2-bb0d-f78a728a9d0d tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:55.619294 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-34e99247-003c-4ed2-bb0d-f78a728a9d0d tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:55.620039 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-34e99247-003c-4ed2-bb0d-f78a728a9d0d tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:55.620530 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2ffc9387-4f1a-4f3e-92e7-0313db7e7266 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:55.622550 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-34e99247-003c-4ed2-bb0d-f78a728a9d0d tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:55.623021 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2ffc9387-4f1a-4f3e-92e7-0313db7e7266 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:55.623686 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2ffc9387-4f1a-4f3e-92e7-0313db7e7266 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:55.624372 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-34e99247-003c-4ed2-bb0d-f78a728a9d0d tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:55.625460 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2ffc9387-4f1a-4f3e-92e7-0313db7e7266 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:55.626075 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-34e99247-003c-4ed2-bb0d-f78a728a9d0d tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:55.631245 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2ffc9387-4f1a-4f3e-92e7-0313db7e7266 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:55.632013 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2ffc9387-4f1a-4f3e-92e7-0313db7e7266 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:55.969034 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-34e99247-003c-4ed2-bb0d-f78a728a9d0d tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96e7480de94c43909045ac1087e40cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6bd34bf5540ee95c8144f185eb22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:55.987050 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-34e99247-003c-4ed2-bb0d-f78a728a9d0d tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] 10.222.0.43 "GET /compute/v2.1/servers/15541ec9-3112-4adc-9fad-6d20a88f2c09" status: 200 len: 1734 microversion: 2.1 time: 0.395094 Oct 04 18:45:55.989565 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1830/3448] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:55 2022] GET /compute/v2.1/servers/15541ec9-3112-4adc-9fad-6d20a88f2c09 => generated 1734 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:45:56.004789 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-a5f37231-3999-4c5e-922e-f0e2d02940b5 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:56.015327 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-a5f37231-3999-4c5e-922e-f0e2d02940b5 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] [instance: 6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:56.026121 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a5f37231-3999-4c5e-922e-f0e2d02940b5 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:56.029431 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a5f37231-3999-4c5e-922e-f0e2d02940b5 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:56.030805 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a5f37231-3999-4c5e-922e-f0e2d02940b5 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:56.031633 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a5f37231-3999-4c5e-922e-f0e2d02940b5 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:56.033545 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a5f37231-3999-4c5e-922e-f0e2d02940b5 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:56.035996 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a5f37231-3999-4c5e-922e-f0e2d02940b5 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:56.036574 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=10 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:45:56.137685 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-2ffc9387-4f1a-4f3e-92e7-0313db7e7266 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:56.142361 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-a5f37231-3999-4c5e-922e-f0e2d02940b5 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] 10.222.0.43 "GET /compute/v2.1/servers/6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.150376 Oct 04 18:45:56.144694 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1831/3449] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Oct 4 18:45:55 2022] GET /compute/v2.1/servers/6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75/os-volume_attachments => generated 25 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:45:56.154022 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-ca18c368-0fc2-41a2-8f28-0c7d2f471960 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:56.155087 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-ca18c368-0fc2-41a2-8f28-0c7d2f471960 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] [instance: 601869a4-7b03-4c37-acb2-a7f8a94e3f26] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:56.163968 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-2ffc9387-4f1a-4f3e-92e7-0313db7e7266 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:56.168009 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-2ffc9387-4f1a-4f3e-92e7-0313db7e7266 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:56.169389 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ca18c368-0fc2-41a2-8f28-0c7d2f471960 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:56.170632 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-2ffc9387-4f1a-4f3e-92e7-0313db7e7266 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] 10.222.0.43 "GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715" status: 200 len: 1752 microversion: 2.32 time: 0.594595 Oct 04 18:45:56.171185 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ca18c368-0fc2-41a2-8f28-0c7d2f471960 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:56.172155 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ca18c368-0fc2-41a2-8f28-0c7d2f471960 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:56.173077 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ca18c368-0fc2-41a2-8f28-0c7d2f471960 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:56.173257 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1619/3450] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:45:55 2022] GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715 => generated 1752 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:45:56.174636 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ca18c368-0fc2-41a2-8f28-0c7d2f471960 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:56.175674 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ca18c368-0fc2-41a2-8f28-0c7d2f471960 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:56.185636 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-039ef6ed-a66c-496d-acb8-a7a452dcefe2 req-7d642342-8473-470b-8d9c-85fa651511a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb651218-4475-4df2-b470-56e737801e3b", "tag": "73a0c9e9-44f1-433f-b0e2-be2bd37c67e0"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:45:56.205056 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-ca18c368-0fc2-41a2-8f28-0c7d2f471960 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] HTTP exception thrown: Instance 601869a4-7b03-4c37-acb2-a7f8a94e3f26 could not be found. Oct 04 18:45:56.207766 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-ca18c368-0fc2-41a2-8f28-0c7d2f471960 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Request method failure captured: Oct 04 18:45:56.207766 n-d-851028-13 devstack@n-api.service[123596]: request: GET /compute/v2.1/servers/601869a4-7b03-4c37-acb2-a7f8a94e3f26 HTTP/1.1 Oct 04 18:45:56.207766 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:45:56.207766 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:45:56.207766 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:45:56.207766 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 18:45:56.207766 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:45:56.207766 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:45:56.207766 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:45:56.207766 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:45:56.207766 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPH7GZKnmB5jFGNi35AdfhGkUxvQgLWK_ByIsMnuX5WZD-YmlNbqY6vCDVU-VOKkrPgfJbarP0ZGlSIBvUSrp9dt-QfnnR-dWwJlu63En7a9aSoLgQcbpsneoFbZX4GUvbv0gs2fIgnKUM4OCVlCc6_rIPczaA5JqIaFc-1vDRGzJeKk Oct 04 18:45:56.207766 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:45:56.207766 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:45:56.207766 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:45:56.207766 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:45:56.207766 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:45:56.207766 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:45:56.207766 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: 29876d6805924df882d6861b0f6ab4f0 Oct 04 18:45:56.207766 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-ServersAdminTestJSON-654254714 Oct 04 18:45:56.207766 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 18:45:56.207766 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 18:45:56.207766 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/29876d6805924df882d6861b0f6ab4f0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_29876d6805924df882d6861b0f6ab4f0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/29876d6805924df882d6861b0f6ab4f0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/29876d6805924df882d6861b0f6ab4f0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:45:56.207766 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-ServersAdminTestJSON-654254714 Oct 04 18:45:56.207766 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: 29876d6805924df882d6861b0f6ab4f0 Oct 04 18:45:56.207766 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-ServersAdminTestJSON-654254714 Oct 04 18:45:56.207766 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-ServersAdminTestJSON-654254714-project Oct 04 18:45:56.207766 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:45:56.207766 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:45:56.207766 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 608fc9ed7cdb487c9bf4b783c26ceeb6 Oct 04 18:45:56.207766 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-ServersAdminTestJSON-654254714-project Oct 04 18:45:56.207766 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 18:45:56.207766 n-d-851028-13 devstack@n-api.service[123596]: exception: Instance 601869a4-7b03-4c37-acb2-a7f8a94e3f26 could not be found. Oct 04 18:45:56.207766 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': '601869a4-7b03-4c37-acb2-a7f8a94e3f26'} Oct 04 18:45:56.207766 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:45:56.207766 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:45:56.207766 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:45:56.207766 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:45:56.207766 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:45:56.207766 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:45:56.207766 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:45:56.207766 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:45:56.207766 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:45:56.207766 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:45:56.207766 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 601869a4-7b03-4c37-acb2-a7f8a94e3f26 could not be found. Oct 04 18:45:56.207766 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:45:56.207766 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:45:56.207766 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:45:56.207766 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:45:56.207766 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:45:56.207766 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:45:56.207766 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:45:56.207766 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:45:56.207766 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:45:56.207766 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:45:56.207766 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:45:56.207766 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:45:56.207766 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:45:56.207766 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:45:56.207766 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:45:56.207766 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:45:56.207766 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 601869a4-7b03-4c37-acb2-a7f8a94e3f26 could not be found. Oct 04 18:45:56.207766 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:45:56.207766 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:45:56.207766 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:45:56.214621 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:45:56.214621 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:45:56.214621 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:45:56.214621 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:45:56.214621 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:45:56.214621 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 601869a4-7b03-4c37-acb2-a7f8a94e3f26 could not be found. Oct 04 18:45:56.214621 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:45:56.215516 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-039ef6ed-a66c-496d-acb8-a7a452dcefe2 req-7d642342-8473-470b-8d9c-85fa651511a3 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:56.215516 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-039ef6ed-a66c-496d-acb8-a7a452dcefe2 req-7d642342-8473-470b-8d9c-85fa651511a3 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:56.215743 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-ca18c368-0fc2-41a2-8f28-0c7d2f471960 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Returning 404 to user: Instance 601869a4-7b03-4c37-acb2-a7f8a94e3f26 could not be found. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:45:56.215743 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-ca18c368-0fc2-41a2-8f28-0c7d2f471960 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] 10.222.0.43 "GET /compute/v2.1/servers/601869a4-7b03-4c37-acb2-a7f8a94e3f26" status: 404 len: 111 microversion: 2.1 time: 0.066900 Oct 04 18:45:56.215936 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-039ef6ed-a66c-496d-acb8-a7a452dcefe2 req-7d642342-8473-470b-8d9c-85fa651511a3 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:56.217858 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1832/3451] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:56 2022] GET /compute/v2.1/servers/601869a4-7b03-4c37-acb2-a7f8a94e3f26 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:45:56.228562 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-01161506-1d19-4220-becc-8c89190f4ece tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:56.229914 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-01161506-1d19-4220-becc-8c89190f4ece tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] [instance: cf78a645-458e-4dc2-a60d-a51754ab6258] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:56.255429 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-039ef6ed-a66c-496d-acb8-a7a452dcefe2 req-7d642342-8473-470b-8d9c-85fa651511a3 service nova] Creating event network-changed:73a0c9e9-44f1-433f-b0e2-be2bd37c67e0 for instance bb651218-4475-4df2-b470-56e737801e3b on n-h1-851028-13 Oct 04 18:45:56.256834 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-01161506-1d19-4220-becc-8c89190f4ece tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:56.259366 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-01161506-1d19-4220-becc-8c89190f4ece tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:56.260219 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-01161506-1d19-4220-becc-8c89190f4ece tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:56.261938 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-01161506-1d19-4220-becc-8c89190f4ece tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:56.269448 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-01161506-1d19-4220-becc-8c89190f4ece tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:56.270346 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-01161506-1d19-4220-becc-8c89190f4ece tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:56.292653 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-039ef6ed-a66c-496d-acb8-a7a452dcefe2 req-7d642342-8473-470b-8d9c-85fa651511a3 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115472 Oct 04 18:45:56.293474 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1620/3452] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:45:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:45:56.327289 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-01161506-1d19-4220-becc-8c89190f4ece tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] [instance: cf78a645-458e-4dc2-a60d-a51754ab6258] Going to try to terminate instance {{(pid=123596) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:45:56.494669 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-3a4908e7-a230-435c-9dbc-6bfe6e2dbc76 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:56.496115 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-3a4908e7-a230-435c-9dbc-6bfe6e2dbc76 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] [instance: 00c17e4b-c80e-463e-a3e9-486c118552be] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:56.536755 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3a4908e7-a230-435c-9dbc-6bfe6e2dbc76 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:56.537322 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3a4908e7-a230-435c-9dbc-6bfe6e2dbc76 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:56.537785 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3a4908e7-a230-435c-9dbc-6bfe6e2dbc76 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:56.543805 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3a4908e7-a230-435c-9dbc-6bfe6e2dbc76 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:56.544498 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3a4908e7-a230-435c-9dbc-6bfe6e2dbc76 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:56.544958 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3a4908e7-a230-435c-9dbc-6bfe6e2dbc76 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:56.550566 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-01161506-1d19-4220-becc-8c89190f4ece tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] 10.222.0.43 "DELETE /compute/v2.1/servers/cf78a645-458e-4dc2-a60d-a51754ab6258" status: 204 len: 0 microversion: 2.1 time: 0.326025 Oct 04 18:45:56.554379 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1833/3453] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 18:45:56 2022] DELETE /compute/v2.1/servers/cf78a645-458e-4dc2-a60d-a51754ab6258 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 18:45:56.579600 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-6c060d44-e8dd-4ccd-a16f-967f033338ee tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:56.588205 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-6c060d44-e8dd-4ccd-a16f-967f033338ee tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: bb651218-4475-4df2-b470-56e737801e3b] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:56.632833 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6c060d44-e8dd-4ccd-a16f-967f033338ee tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:56.638215 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6c060d44-e8dd-4ccd-a16f-967f033338ee tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:56.638787 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6c060d44-e8dd-4ccd-a16f-967f033338ee tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:56.643276 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6c060d44-e8dd-4ccd-a16f-967f033338ee tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:56.643775 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6c060d44-e8dd-4ccd-a16f-967f033338ee tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:56.644221 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6c060d44-e8dd-4ccd-a16f-967f033338ee tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:56.967342 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-6c060d44-e8dd-4ccd-a16f-967f033338ee tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:56.979309 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-6c060d44-e8dd-4ccd-a16f-967f033338ee tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/bb651218-4475-4df2-b470-56e737801e3b" status: 200 len: 1315 microversion: 2.1 time: 0.422501 Oct 04 18:45:56.991802 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1834/3454] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:56 2022] GET /compute/v2.1/servers/bb651218-4475-4df2-b470-56e737801e3b => generated 1315 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:57.010553 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-e76235e0-d6e1-4565-97b6-0904b489f5a5 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:57.012364 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-e76235e0-d6e1-4565-97b6-0904b489f5a5 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] [instance: cf78a645-458e-4dc2-a60d-a51754ab6258] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:57.025753 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e76235e0-d6e1-4565-97b6-0904b489f5a5 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:57.026484 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e76235e0-d6e1-4565-97b6-0904b489f5a5 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:57.032648 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e76235e0-d6e1-4565-97b6-0904b489f5a5 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:57.034129 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e76235e0-d6e1-4565-97b6-0904b489f5a5 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:57.034773 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e76235e0-d6e1-4565-97b6-0904b489f5a5 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:57.035980 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e76235e0-d6e1-4565-97b6-0904b489f5a5 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:57.341880 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-3a4908e7-a230-435c-9dbc-6bfe6e2dbc76 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c710f394164b89b16bcac2fe51c58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65037d4ea5124d749e42928032e803fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:57.357770 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-3a4908e7-a230-435c-9dbc-6bfe6e2dbc76 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] 10.222.0.43 "GET /compute/v2.1/servers/00c17e4b-c80e-463e-a3e9-486c118552be" status: 200 len: 1318 microversion: 2.1 time: 0.876897 Oct 04 18:45:57.358394 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1621/3455] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:56 2022] GET /compute/v2.1/servers/00c17e4b-c80e-463e-a3e9-486c118552be => generated 1318 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:57.368372 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-26cdb829-6f56-4169-b12c-0f18dd4143dd tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:57.370334 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-26cdb829-6f56-4169-b12c-0f18dd4143dd tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] [instance: 15541ec9-3112-4adc-9fad-6d20a88f2c09] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:57.392362 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-26cdb829-6f56-4169-b12c-0f18dd4143dd tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:57.395095 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-26cdb829-6f56-4169-b12c-0f18dd4143dd tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:57.395734 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-26cdb829-6f56-4169-b12c-0f18dd4143dd tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:57.401080 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-26cdb829-6f56-4169-b12c-0f18dd4143dd tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:57.401782 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-26cdb829-6f56-4169-b12c-0f18dd4143dd tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:57.402448 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-26cdb829-6f56-4169-b12c-0f18dd4143dd tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:57.540535 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-e76235e0-d6e1-4565-97b6-0904b489f5a5 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608fc9ed7cdb487c9bf4b783c26ceeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29876d6805924df882d6861b0f6ab4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:57.553864 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-e76235e0-d6e1-4565-97b6-0904b489f5a5 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] 10.222.0.43 "GET /compute/v2.1/servers/cf78a645-458e-4dc2-a60d-a51754ab6258" status: 200 len: 1469 microversion: 2.1 time: 0.560863 Oct 04 18:45:57.554648 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1835/3456] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:56 2022] GET /compute/v2.1/servers/cf78a645-458e-4dc2-a60d-a51754ab6258 => generated 1469 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:57.584853 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-d51d78df-f218-45bb-b16c-778400d218e7 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:57.585506 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-d51d78df-f218-45bb-b16c-778400d218e7 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] [instance: fa47906d-d394-46fe-9143-780bcd27a715] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:57.596181 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d51d78df-f218-45bb-b16c-778400d218e7 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:57.605402 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d51d78df-f218-45bb-b16c-778400d218e7 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:57.606456 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d51d78df-f218-45bb-b16c-778400d218e7 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:57.607378 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d51d78df-f218-45bb-b16c-778400d218e7 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:57.608010 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d51d78df-f218-45bb-b16c-778400d218e7 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:57.608607 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d51d78df-f218-45bb-b16c-778400d218e7 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:57.977656 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-d51d78df-f218-45bb-b16c-778400d218e7 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:57.991244 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-d51d78df-f218-45bb-b16c-778400d218e7 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:58.006652 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-d51d78df-f218-45bb-b16c-778400d218e7 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:58.008902 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-d51d78df-f218-45bb-b16c-778400d218e7 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] 10.222.0.43 "GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715" status: 200 len: 1752 microversion: 2.32 time: 0.434942 Oct 04 18:45:58.018524 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1836/3457] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:45:57 2022] GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715 => generated 1752 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:45:58.029650 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-c37850ff-840c-4595-b311-848fc69ee44d tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:58.032716 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-c37850ff-840c-4595-b311-848fc69ee44d tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: bb651218-4475-4df2-b470-56e737801e3b] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:58.060792 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c37850ff-840c-4595-b311-848fc69ee44d tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:58.075196 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c37850ff-840c-4595-b311-848fc69ee44d tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:58.079009 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c37850ff-840c-4595-b311-848fc69ee44d tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:58.080716 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c37850ff-840c-4595-b311-848fc69ee44d tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:58.082047 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c37850ff-840c-4595-b311-848fc69ee44d tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:58.090467 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c37850ff-840c-4595-b311-848fc69ee44d tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:58.303336 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-26cdb829-6f56-4169-b12c-0f18dd4143dd tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96e7480de94c43909045ac1087e40cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6bd34bf5540ee95c8144f185eb22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:58.339616 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-26cdb829-6f56-4169-b12c-0f18dd4143dd tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] 10.222.0.43 "GET /compute/v2.1/servers/15541ec9-3112-4adc-9fad-6d20a88f2c09" status: 200 len: 1714 microversion: 2.1 time: 0.979803 Oct 04 18:45:58.340675 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1622/3458] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:57 2022] GET /compute/v2.1/servers/15541ec9-3112-4adc-9fad-6d20a88f2c09 => generated 1714 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:58.375096 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-cd826a52-f02a-4203-908d-783beb036bbc req-f2aa1863-983c-4041-9beb-cc30ea6ab06a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00c17e4b-c80e-463e-a3e9-486c118552be", "tag": "45676c3f-b64a-480d-b44c-aab2a72fcd1e"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:45:58.407896 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-cd826a52-f02a-4203-908d-783beb036bbc req-f2aa1863-983c-4041-9beb-cc30ea6ab06a service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:58.408471 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-cd826a52-f02a-4203-908d-783beb036bbc req-f2aa1863-983c-4041-9beb-cc30ea6ab06a service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:58.416061 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-cd826a52-f02a-4203-908d-783beb036bbc req-f2aa1863-983c-4041-9beb-cc30ea6ab06a service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:58.453592 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-cd826a52-f02a-4203-908d-783beb036bbc req-f2aa1863-983c-4041-9beb-cc30ea6ab06a service nova] Creating event network-changed:45676c3f-b64a-480d-b44c-aab2a72fcd1e for instance 00c17e4b-c80e-463e-a3e9-486c118552be on n-h1-851028-13 Oct 04 18:45:58.467542 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-cd826a52-f02a-4203-908d-783beb036bbc req-f2aa1863-983c-4041-9beb-cc30ea6ab06a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095708 Oct 04 18:45:58.468152 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1623/3459] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:45:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:45:58.478039 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-4887304b-f4c1-45e9-8832-5d0153c12dd0 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:58.480855 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-4887304b-f4c1-45e9-8832-5d0153c12dd0 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] [instance: 00c17e4b-c80e-463e-a3e9-486c118552be] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:58.499422 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4887304b-f4c1-45e9-8832-5d0153c12dd0 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:58.499927 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4887304b-f4c1-45e9-8832-5d0153c12dd0 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:58.500376 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4887304b-f4c1-45e9-8832-5d0153c12dd0 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:58.501101 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4887304b-f4c1-45e9-8832-5d0153c12dd0 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:58.503059 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4887304b-f4c1-45e9-8832-5d0153c12dd0 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:58.505290 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4887304b-f4c1-45e9-8832-5d0153c12dd0 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:58.682969 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-c37850ff-840c-4595-b311-848fc69ee44d tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:58.707135 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-c37850ff-840c-4595-b311-848fc69ee44d tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/bb651218-4475-4df2-b470-56e737801e3b" status: 200 len: 1315 microversion: 2.1 time: 0.686494 Oct 04 18:45:58.710636 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1837/3460] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:58 2022] GET /compute/v2.1/servers/bb651218-4475-4df2-b470-56e737801e3b => generated 1315 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:58.725873 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-00e915d5-d361-41e7-a842-9399e0508074 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:58.726655 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-00e915d5-d361-41e7-a842-9399e0508074 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] [instance: 15541ec9-3112-4adc-9fad-6d20a88f2c09] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:58.742352 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-00e915d5-d361-41e7-a842-9399e0508074 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:58.755031 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-00e915d5-d361-41e7-a842-9399e0508074 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:58.756320 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-00e915d5-d361-41e7-a842-9399e0508074 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:58.757614 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-00e915d5-d361-41e7-a842-9399e0508074 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:58.758268 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-00e915d5-d361-41e7-a842-9399e0508074 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:58.758851 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-00e915d5-d361-41e7-a842-9399e0508074 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:58.912422 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-00e915d5-d361-41e7-a842-9399e0508074 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] HTTP exception thrown: Cannot 'detach_volume' instance 15541ec9-3112-4adc-9fad-6d20a88f2c09 while it is in vm_state rescued Oct 04 18:45:58.916513 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-00e915d5-d361-41e7-a842-9399e0508074 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Request method failure captured: Oct 04 18:45:58.916513 n-d-851028-13 devstack@n-api.service[123596]: request: DELETE /compute/v2.1/servers/15541ec9-3112-4adc-9fad-6d20a88f2c09/os-volume_attachments/383ace23-6782-4417-b230-f573687bab01 HTTP/1.1 Oct 04 18:45:58.916513 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:45:58.916513 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:45:58.916513 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:45:58.916513 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 18:45:58.916513 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:45:58.916513 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:45:58.916513 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:45:58.916513 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:45:58.916513 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPH6ImUsc0v5avJaXbAf95n6vmfztxEtTiW32SRLH_bOmBbny3fOGIWm6DaSHmvRnWhZ-84faOFvXqXs-7dDoMftV5mgOWVN0Q9OrVISe3irL7FfmyYZmGssWLEuXGLXQhTtdNOFN9115Lqu5biPYPUWU74K-2mRSRsiih09WbGDmZQI Oct 04 18:45:58.916513 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:45:58.916513 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:45:58.916513 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:45:58.916513 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:45:58.916513 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:45:58.916513 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:45:58.916513 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: eda6bd34bf5540ee95c8144f185eb22d Oct 04 18:45:58.916513 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1155401912 Oct 04 18:45:58.916513 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 18:45:58.916513 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 18:45:58.916513 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/eda6bd34bf5540ee95c8144f185eb22d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_eda6bd34bf5540ee95c8144f185eb22d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/eda6bd34bf5540ee95c8144f185eb22d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/eda6bd34bf5540ee95c8144f185eb22d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:45:58.916513 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1155401912 Oct 04 18:45:58.916513 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: eda6bd34bf5540ee95c8144f185eb22d Oct 04 18:45:58.916513 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1155401912 Oct 04 18:45:58.916513 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-ServerRescueNegativeTestJSON-1155401912-project Oct 04 18:45:58.916513 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:45:58.916513 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:45:58.916513 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 96e7480de94c43909045ac1087e40cd8 Oct 04 18:45:58.916513 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1155401912-project Oct 04 18:45:58.916513 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 18:45:58.916513 n-d-851028-13 devstack@n-api.service[123596]: exception: Cannot 'detach_volume' instance 15541ec9-3112-4adc-9fad-6d20a88f2c09 while it is in vm_state rescued Oct 04 18:45:58.916513 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'server_id': '15541ec9-3112-4adc-9fad-6d20a88f2c09', 'id': '383ace23-6782-4417-b230-f573687bab01'} Oct 04 18:45:58.916513 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:45:58.916513 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:45:58.916513 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Oct 04 18:45:58.916513 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Oct 04 18:45:58.916513 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 18:45:58.916513 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 18:45:58.916513 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 04 18:45:58.916513 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 04 18:45:58.916513 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 15541ec9-3112-4adc-9fad-6d20a88f2c09 in vm_state rescued. Cannot detach_volume while the instance is in this state. Oct 04 18:45:58.916513 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:45:58.916513 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:45:58.916513 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:45:58.916513 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:45:58.916513 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:45:58.916513 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:45:58.916513 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:45:58.916513 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:45:58.916513 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:45:58.916513 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:45:58.916513 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Oct 04 18:45:58.916513 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 04 18:45:58.916513 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 04 18:45:58.916513 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 04 18:45:58.916513 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 15541ec9-3112-4adc-9fad-6d20a88f2c09 while it is in vm_state rescued Oct 04 18:45:58.916513 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:45:58.916513 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:45:58.916513 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:45:58.916513 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:45:58.921319 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:45:58.921319 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:45:58.921319 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:45:58.921319 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:45:58.921319 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 15541ec9-3112-4adc-9fad-6d20a88f2c09 while it is in vm_state rescued Oct 04 18:45:58.921319 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:45:58.921319 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-00e915d5-d361-41e7-a842-9399e0508074 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Returning 409 to user: Cannot 'detach_volume' instance 15541ec9-3112-4adc-9fad-6d20a88f2c09 while it is in vm_state rescued {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:45:58.922377 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-00e915d5-d361-41e7-a842-9399e0508074 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] 10.222.0.43 "DELETE /compute/v2.1/servers/15541ec9-3112-4adc-9fad-6d20a88f2c09/os-volume_attachments/383ace23-6782-4417-b230-f573687bab01" status: 409 len: 152 microversion: 2.1 time: 0.205827 Oct 04 18:45:58.922899 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1838/3461] 10.222.0.43 () {58 vars in 1416 bytes} [Tue Oct 4 18:45:58 2022] DELETE /compute/v2.1/servers/15541ec9-3112-4adc-9fad-6d20a88f2c09/os-volume_attachments/383ace23-6782-4417-b230-f573687bab01 => generated 152 bytes in 211 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:45:58.930746 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-958940a4-09ca-46b6-975c-43b77fffc608 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:58.931375 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-958940a4-09ca-46b6-975c-43b77fffc608 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] [instance: cf78a645-458e-4dc2-a60d-a51754ab6258] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:58.943898 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-958940a4-09ca-46b6-975c-43b77fffc608 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:58.944852 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-958940a4-09ca-46b6-975c-43b77fffc608 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:58.946230 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-958940a4-09ca-46b6-975c-43b77fffc608 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:58.948779 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-958940a4-09ca-46b6-975c-43b77fffc608 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:58.950313 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-958940a4-09ca-46b6-975c-43b77fffc608 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:58.951331 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-958940a4-09ca-46b6-975c-43b77fffc608 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:59.179596 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-4887304b-f4c1-45e9-8832-5d0153c12dd0 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c710f394164b89b16bcac2fe51c58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65037d4ea5124d749e42928032e803fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:59.192449 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-4887304b-f4c1-45e9-8832-5d0153c12dd0 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] 10.222.0.43 "GET /compute/v2.1/servers/00c17e4b-c80e-463e-a3e9-486c118552be" status: 200 len: 1318 microversion: 2.1 time: 0.722906 Oct 04 18:45:59.193921 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1624/3462] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:58 2022] GET /compute/v2.1/servers/00c17e4b-c80e-463e-a3e9-486c118552be => generated 1318 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:59.201760 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-a50135ee-26d3-4e91-b20e-3aae3d52a1e1 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:45:59.204501 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-a50135ee-26d3-4e91-b20e-3aae3d52a1e1 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] [instance: 15541ec9-3112-4adc-9fad-6d20a88f2c09] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:59.219616 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a50135ee-26d3-4e91-b20e-3aae3d52a1e1 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:59.223010 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a50135ee-26d3-4e91-b20e-3aae3d52a1e1 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:59.223735 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a50135ee-26d3-4e91-b20e-3aae3d52a1e1 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:59.224851 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a50135ee-26d3-4e91-b20e-3aae3d52a1e1 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:59.225702 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a50135ee-26d3-4e91-b20e-3aae3d52a1e1 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:59.229222 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a50135ee-26d3-4e91-b20e-3aae3d52a1e1 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:59.304712 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-958940a4-09ca-46b6-975c-43b77fffc608 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608fc9ed7cdb487c9bf4b783c26ceeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29876d6805924df882d6861b0f6ab4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:59.314581 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-958940a4-09ca-46b6-975c-43b77fffc608 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] 10.222.0.43 "GET /compute/v2.1/servers/cf78a645-458e-4dc2-a60d-a51754ab6258" status: 200 len: 1469 microversion: 2.1 time: 0.390652 Oct 04 18:45:59.320040 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1839/3463] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:58 2022] GET /compute/v2.1/servers/cf78a645-458e-4dc2-a60d-a51754ab6258 => generated 1469 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:59.332253 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-bf5fad0a-1127-41a9-b989-148aeee9f86b tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:59.332927 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-bf5fad0a-1127-41a9-b989-148aeee9f86b tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] [instance: fa47906d-d394-46fe-9143-780bcd27a715] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:59.348546 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bf5fad0a-1127-41a9-b989-148aeee9f86b tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:59.349191 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bf5fad0a-1127-41a9-b989-148aeee9f86b tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:59.349606 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bf5fad0a-1127-41a9-b989-148aeee9f86b tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:59.350531 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bf5fad0a-1127-41a9-b989-148aeee9f86b tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:59.351143 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bf5fad0a-1127-41a9-b989-148aeee9f86b tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:59.351582 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bf5fad0a-1127-41a9-b989-148aeee9f86b tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:59.360715 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-a50135ee-26d3-4e91-b20e-3aae3d52a1e1 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] 10.222.0.43 "POST /compute/v2.1/servers/15541ec9-3112-4adc-9fad-6d20a88f2c09/action" status: 202 len: 0 microversion: 2.1 time: 0.163147 Oct 04 18:45:59.363133 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1625/3464] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 18:45:59 2022] POST /compute/v2.1/servers/15541ec9-3112-4adc-9fad-6d20a88f2c09/action => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:45:59.391086 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-2e452a46-644e-4125-ba20-0e94b70b3681 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:59.392158 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-2e452a46-644e-4125-ba20-0e94b70b3681 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] [instance: 15541ec9-3112-4adc-9fad-6d20a88f2c09] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:59.400846 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2e452a46-644e-4125-ba20-0e94b70b3681 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:59.402113 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2e452a46-644e-4125-ba20-0e94b70b3681 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:59.406219 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2e452a46-644e-4125-ba20-0e94b70b3681 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:59.407524 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2e452a46-644e-4125-ba20-0e94b70b3681 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:59.408752 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2e452a46-644e-4125-ba20-0e94b70b3681 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:59.409459 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2e452a46-644e-4125-ba20-0e94b70b3681 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:59.753086 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-bf5fad0a-1127-41a9-b989-148aeee9f86b tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:59.811271 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-bf5fad0a-1127-41a9-b989-148aeee9f86b tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:59.812689 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-bf5fad0a-1127-41a9-b989-148aeee9f86b tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:59.817467 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-bf5fad0a-1127-41a9-b989-148aeee9f86b tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] 10.222.0.43 "GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715" status: 200 len: 1752 microversion: 2.32 time: 0.496186 Oct 04 18:45:59.819410 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1840/3465] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:45:59 2022] GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715 => generated 1752 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:45:59.857335 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-fda53b91-d274-474c-8551-ea8e05285c5c tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:59.858306 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-fda53b91-d274-474c-8551-ea8e05285c5c tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: bb651218-4475-4df2-b470-56e737801e3b] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:59.882068 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fda53b91-d274-474c-8551-ea8e05285c5c tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:59.882907 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fda53b91-d274-474c-8551-ea8e05285c5c tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:59.884016 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fda53b91-d274-474c-8551-ea8e05285c5c tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:59.885289 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fda53b91-d274-474c-8551-ea8e05285c5c tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:59.886014 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fda53b91-d274-474c-8551-ea8e05285c5c tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:59.886674 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fda53b91-d274-474c-8551-ea8e05285c5c tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:59.982371 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-2e452a46-644e-4125-ba20-0e94b70b3681 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96e7480de94c43909045ac1087e40cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6bd34bf5540ee95c8144f185eb22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:00.000231 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-2e452a46-644e-4125-ba20-0e94b70b3681 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] 10.222.0.43 "GET /compute/v2.1/servers/15541ec9-3112-4adc-9fad-6d20a88f2c09" status: 200 len: 1722 microversion: 2.1 time: 0.609478 Oct 04 18:46:00.000927 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1626/3466] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:59 2022] GET /compute/v2.1/servers/15541ec9-3112-4adc-9fad-6d20a88f2c09 => generated 1722 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:00.222097 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-3ae6be52-e661-41a3-9449-971bb86c4766 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:00.222722 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-3ae6be52-e661-41a3-9449-971bb86c4766 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] [instance: 00c17e4b-c80e-463e-a3e9-486c118552be] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:00.243293 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3ae6be52-e661-41a3-9449-971bb86c4766 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:00.243917 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3ae6be52-e661-41a3-9449-971bb86c4766 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:00.249675 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3ae6be52-e661-41a3-9449-971bb86c4766 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:00.250528 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3ae6be52-e661-41a3-9449-971bb86c4766 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:00.251019 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3ae6be52-e661-41a3-9449-971bb86c4766 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:00.251466 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3ae6be52-e661-41a3-9449-971bb86c4766 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:00.307795 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-fda53b91-d274-474c-8551-ea8e05285c5c tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:00.318729 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-fda53b91-d274-474c-8551-ea8e05285c5c tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/bb651218-4475-4df2-b470-56e737801e3b" status: 200 len: 1315 microversion: 2.1 time: 0.498047 Oct 04 18:46:00.319386 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1841/3467] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:59 2022] GET /compute/v2.1/servers/bb651218-4475-4df2-b470-56e737801e3b => generated 1315 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:00.344164 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-5d151593-6708-400a-9a79-63d0087386d2 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:00.344905 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-5d151593-6708-400a-9a79-63d0087386d2 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] [instance: cf78a645-458e-4dc2-a60d-a51754ab6258] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:00.367812 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5d151593-6708-400a-9a79-63d0087386d2 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:00.368429 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5d151593-6708-400a-9a79-63d0087386d2 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:00.368752 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5d151593-6708-400a-9a79-63d0087386d2 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:00.369500 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5d151593-6708-400a-9a79-63d0087386d2 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:00.370275 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5d151593-6708-400a-9a79-63d0087386d2 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:00.370683 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5d151593-6708-400a-9a79-63d0087386d2 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:00.535734 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-5d151593-6708-400a-9a79-63d0087386d2 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608fc9ed7cdb487c9bf4b783c26ceeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29876d6805924df882d6861b0f6ab4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:00.554393 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-5d151593-6708-400a-9a79-63d0087386d2 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] 10.222.0.43 "GET /compute/v2.1/servers/cf78a645-458e-4dc2-a60d-a51754ab6258" status: 200 len: 1427 microversion: 2.1 time: 0.215787 Oct 04 18:46:00.556138 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1842/3468] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:00 2022] GET /compute/v2.1/servers/cf78a645-458e-4dc2-a60d-a51754ab6258 => generated 1427 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:46:00.596025 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-651f273b-bd0f-4454-b2df-da369cf9e237 req-d3ee119e-6d23-49de-ab84-a9d37c119908 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf78a645-458e-4dc2-a60d-a51754ab6258", "name": "network-vif-deleted", "tag": "68b980e1-728c-40ba-bdae-e6a747ef6688"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:46:00.620832 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-651f273b-bd0f-4454-b2df-da369cf9e237 req-d3ee119e-6d23-49de-ab84-a9d37c119908 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:00.624225 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-651f273b-bd0f-4454-b2df-da369cf9e237 req-d3ee119e-6d23-49de-ab84-a9d37c119908 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:00.625514 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-651f273b-bd0f-4454-b2df-da369cf9e237 req-d3ee119e-6d23-49de-ab84-a9d37c119908 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:00.671343 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-651f273b-bd0f-4454-b2df-da369cf9e237 req-d3ee119e-6d23-49de-ab84-a9d37c119908 service nova] Creating event network-vif-deleted:68b980e1-728c-40ba-bdae-e6a747ef6688 for instance cf78a645-458e-4dc2-a60d-a51754ab6258 on n-h2-851028-13 Oct 04 18:46:00.674767 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-3ae6be52-e661-41a3-9449-971bb86c4766 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c710f394164b89b16bcac2fe51c58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65037d4ea5124d749e42928032e803fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:00.682745 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-651f273b-bd0f-4454-b2df-da369cf9e237 req-d3ee119e-6d23-49de-ab84-a9d37c119908 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092784 Oct 04 18:46:00.688404 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-3ae6be52-e661-41a3-9449-971bb86c4766 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] 10.222.0.43 "GET /compute/v2.1/servers/00c17e4b-c80e-463e-a3e9-486c118552be" status: 200 len: 1318 microversion: 2.1 time: 0.470897 Oct 04 18:46:00.690901 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1843/3469] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:46:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:46:00.706780 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1627/3470] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:00 2022] GET /compute/v2.1/servers/00c17e4b-c80e-463e-a3e9-486c118552be => generated 1318 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:00.855819 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-80c8ad97-6136-4407-afa5-456fae5cdb03 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:00.857356 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-80c8ad97-6136-4407-afa5-456fae5cdb03 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] [instance: fa47906d-d394-46fe-9143-780bcd27a715] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:00.869961 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-80c8ad97-6136-4407-afa5-456fae5cdb03 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:00.871125 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-80c8ad97-6136-4407-afa5-456fae5cdb03 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:00.873038 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-80c8ad97-6136-4407-afa5-456fae5cdb03 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:00.874113 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-80c8ad97-6136-4407-afa5-456fae5cdb03 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:00.875208 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-80c8ad97-6136-4407-afa5-456fae5cdb03 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:00.877377 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-80c8ad97-6136-4407-afa5-456fae5cdb03 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:01.025882 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-bdf23a7c-398d-4846-a23e-a8e2222b73ae tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:01.027524 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-bdf23a7c-398d-4846-a23e-a8e2222b73ae tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] [instance: 15541ec9-3112-4adc-9fad-6d20a88f2c09] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:01.067109 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bdf23a7c-398d-4846-a23e-a8e2222b73ae tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:01.069882 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bdf23a7c-398d-4846-a23e-a8e2222b73ae tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:01.071256 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bdf23a7c-398d-4846-a23e-a8e2222b73ae tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:01.072872 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bdf23a7c-398d-4846-a23e-a8e2222b73ae tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:01.075317 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bdf23a7c-398d-4846-a23e-a8e2222b73ae tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:01.077489 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bdf23a7c-398d-4846-a23e-a8e2222b73ae tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:01.448263 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-80c8ad97-6136-4407-afa5-456fae5cdb03 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:01.467280 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-80c8ad97-6136-4407-afa5-456fae5cdb03 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:01.473298 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-80c8ad97-6136-4407-afa5-456fae5cdb03 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:01.475084 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-80c8ad97-6136-4407-afa5-456fae5cdb03 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] 10.222.0.43 "GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715" status: 200 len: 1798 microversion: 2.32 time: 0.626201 Oct 04 18:46:01.479630 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1844/3471] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:46:00 2022] GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715 => generated 1798 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:46:01.499140 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-499aea74-0bcc-4384-9dee-4ed0b0ff8ee3 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:01.501885 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-499aea74-0bcc-4384-9dee-4ed0b0ff8ee3 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: bb651218-4475-4df2-b470-56e737801e3b] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:01.531683 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-499aea74-0bcc-4384-9dee-4ed0b0ff8ee3 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:01.534121 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-499aea74-0bcc-4384-9dee-4ed0b0ff8ee3 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:01.534610 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-499aea74-0bcc-4384-9dee-4ed0b0ff8ee3 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:01.535922 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-499aea74-0bcc-4384-9dee-4ed0b0ff8ee3 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:01.536541 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-499aea74-0bcc-4384-9dee-4ed0b0ff8ee3 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:01.537163 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-499aea74-0bcc-4384-9dee-4ed0b0ff8ee3 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:01.849535 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-bdf23a7c-398d-4846-a23e-a8e2222b73ae tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96e7480de94c43909045ac1087e40cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6bd34bf5540ee95c8144f185eb22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:01.861159 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-bdf23a7c-398d-4846-a23e-a8e2222b73ae tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] 10.222.0.43 "GET /compute/v2.1/servers/15541ec9-3112-4adc-9fad-6d20a88f2c09" status: 200 len: 1722 microversion: 2.1 time: 0.840882 Oct 04 18:46:01.863285 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1628/3472] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:01 2022] GET /compute/v2.1/servers/15541ec9-3112-4adc-9fad-6d20a88f2c09 => generated 1722 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:01.870466 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-0e18a5cd-dff7-44fa-922b-471acf333759 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:01.871542 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-0e18a5cd-dff7-44fa-922b-471acf333759 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] [instance: cf78a645-458e-4dc2-a60d-a51754ab6258] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:01.881465 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0e18a5cd-dff7-44fa-922b-471acf333759 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:01.882414 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0e18a5cd-dff7-44fa-922b-471acf333759 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:01.883113 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0e18a5cd-dff7-44fa-922b-471acf333759 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:01.884173 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0e18a5cd-dff7-44fa-922b-471acf333759 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:01.885095 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0e18a5cd-dff7-44fa-922b-471acf333759 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:01.885876 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0e18a5cd-dff7-44fa-922b-471acf333759 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:01.912455 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-0e18a5cd-dff7-44fa-922b-471acf333759 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] HTTP exception thrown: Instance cf78a645-458e-4dc2-a60d-a51754ab6258 could not be found. Oct 04 18:46:01.914706 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-0e18a5cd-dff7-44fa-922b-471acf333759 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Request method failure captured: Oct 04 18:46:01.914706 n-d-851028-13 devstack@n-api.service[123595]: request: GET /compute/v2.1/servers/cf78a645-458e-4dc2-a60d-a51754ab6258 HTTP/1.1 Oct 04 18:46:01.914706 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 18:46:01.914706 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 18:46:01.914706 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 18:46:01.914706 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 0 Oct 04 18:46:01.914706 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 18:46:01.914706 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 18:46:01.914706 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 18:46:01.914706 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 18:46:01.914706 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPH7GZKnmB5jFGNi35AdfhGkUxvQgLWK_ByIsMnuX5WZD-YmlNbqY6vCDVU-VOKkrPgfJbarP0ZGlSIBvUSrp9dt-QfnnR-dWwJlu63En7a9aSoLgQcbpsneoFbZX4GUvbv0gs2fIgnKUM4OCVlCc6_rIPczaA5JqIaFc-1vDRGzJeKk Oct 04 18:46:01.914706 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 18:46:01.914706 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 18:46:01.914706 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 18:46:01.914706 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 18:46:01.914706 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 18:46:01.914706 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 18:46:01.914706 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: 29876d6805924df882d6861b0f6ab4f0 Oct 04 18:46:01.914706 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-ServersAdminTestJSON-654254714 Oct 04 18:46:01.914706 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 18:46:01.914706 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 18:46:01.914706 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/29876d6805924df882d6861b0f6ab4f0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_29876d6805924df882d6861b0f6ab4f0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/29876d6805924df882d6861b0f6ab4f0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/29876d6805924df882d6861b0f6ab4f0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:46:01.914706 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-ServersAdminTestJSON-654254714 Oct 04 18:46:01.914706 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: 29876d6805924df882d6861b0f6ab4f0 Oct 04 18:46:01.914706 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-ServersAdminTestJSON-654254714 Oct 04 18:46:01.914706 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-ServersAdminTestJSON-654254714-project Oct 04 18:46:01.914706 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 18:46:01.914706 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 18:46:01.914706 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: 608fc9ed7cdb487c9bf4b783c26ceeb6 Oct 04 18:46:01.914706 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-ServersAdminTestJSON-654254714-project Oct 04 18:46:01.914706 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 18:46:01.914706 n-d-851028-13 devstack@n-api.service[123595]: exception: Instance cf78a645-458e-4dc2-a60d-a51754ab6258 could not be found. Oct 04 18:46:01.914706 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': 'cf78a645-458e-4dc2-a60d-a51754ab6258'} Oct 04 18:46:01.914706 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:46:01.914706 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:46:01.914706 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:46:01.914706 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:46:01.914706 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:46:01.914706 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:46:01.914706 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:46:01.914706 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:46:01.914706 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:46:01.914706 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:46:01.914706 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cf78a645-458e-4dc2-a60d-a51754ab6258 could not be found. Oct 04 18:46:01.914706 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:46:01.914706 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:46:01.914706 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:46:01.914706 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:46:01.914706 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:46:01.914706 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:46:01.914706 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:46:01.914706 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:46:01.914706 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:46:01.914706 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:46:01.914706 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:46:01.914706 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:46:01.914706 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:46:01.914706 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:46:01.914706 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:46:01.914706 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:46:01.914706 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf78a645-458e-4dc2-a60d-a51754ab6258 could not be found. Oct 04 18:46:01.914706 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:46:01.914706 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:46:01.914706 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:46:01.919061 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:46:01.919061 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:46:01.919061 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:46:01.919061 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:46:01.919061 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:46:01.919061 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf78a645-458e-4dc2-a60d-a51754ab6258 could not be found. Oct 04 18:46:01.919061 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:46:01.919061 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-0e18a5cd-dff7-44fa-922b-471acf333759 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] Returning 404 to user: Instance cf78a645-458e-4dc2-a60d-a51754ab6258 could not be found. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:46:01.919061 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-0e18a5cd-dff7-44fa-922b-471acf333759 tempest-ServersAdminTestJSON-654254714 tempest-ServersAdminTestJSON-654254714-project] 10.222.0.43 "GET /compute/v2.1/servers/cf78a645-458e-4dc2-a60d-a51754ab6258" status: 404 len: 111 microversion: 2.1 time: 0.050921 Oct 04 18:46:01.921577 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1629/3473] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:01 2022] GET /compute/v2.1/servers/cf78a645-458e-4dc2-a60d-a51754ab6258 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:46:01.929127 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-2d91fa2d-aea0-47cf-8a51-5cef2b070b51 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:01.929954 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-2d91fa2d-aea0-47cf-8a51-5cef2b070b51 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] [instance: 00c17e4b-c80e-463e-a3e9-486c118552be] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:01.940146 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2d91fa2d-aea0-47cf-8a51-5cef2b070b51 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:01.940966 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2d91fa2d-aea0-47cf-8a51-5cef2b070b51 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:01.942266 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2d91fa2d-aea0-47cf-8a51-5cef2b070b51 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:01.943158 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2d91fa2d-aea0-47cf-8a51-5cef2b070b51 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:01.943823 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2d91fa2d-aea0-47cf-8a51-5cef2b070b51 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:01.944602 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2d91fa2d-aea0-47cf-8a51-5cef2b070b51 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:02.628941 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-499aea74-0bcc-4384-9dee-4ed0b0ff8ee3 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:02.633918 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:46:02.650974 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-499aea74-0bcc-4384-9dee-4ed0b0ff8ee3 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/bb651218-4475-4df2-b470-56e737801e3b" status: 200 len: 1315 microversion: 2.1 time: 1.169635 Oct 04 18:46:02.651800 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1845/3474] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:01 2022] GET /compute/v2.1/servers/bb651218-4475-4df2-b470-56e737801e3b => generated 1315 bytes in 1171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:02.657283 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-5ea5300e-8cc1-4ae3-bbd3-ff62e13b1b6a tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:02.662492 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-5ea5300e-8cc1-4ae3-bbd3-ff62e13b1b6a tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] [instance: fa47906d-d394-46fe-9143-780bcd27a715] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:02.681942 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5ea5300e-8cc1-4ae3-bbd3-ff62e13b1b6a tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:02.682474 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5ea5300e-8cc1-4ae3-bbd3-ff62e13b1b6a tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:02.693831 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5ea5300e-8cc1-4ae3-bbd3-ff62e13b1b6a tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:02.694609 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5ea5300e-8cc1-4ae3-bbd3-ff62e13b1b6a tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:02.695089 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5ea5300e-8cc1-4ae3-bbd3-ff62e13b1b6a tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:02.695531 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5ea5300e-8cc1-4ae3-bbd3-ff62e13b1b6a tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:02.944011 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-2d91fa2d-aea0-47cf-8a51-5cef2b070b51 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c710f394164b89b16bcac2fe51c58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65037d4ea5124d749e42928032e803fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:02.958862 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-2d91fa2d-aea0-47cf-8a51-5cef2b070b51 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] 10.222.0.43 "GET /compute/v2.1/servers/00c17e4b-c80e-463e-a3e9-486c118552be" status: 200 len: 1318 microversion: 2.1 time: 1.035104 Oct 04 18:46:02.973361 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1630/3475] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:01 2022] GET /compute/v2.1/servers/00c17e4b-c80e-463e-a3e9-486c118552be => generated 1318 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:02.989758 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-7cedeb69-0680-4bb9-b1d7-8e3bba8543fc tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:02.994496 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-7cedeb69-0680-4bb9-b1d7-8e3bba8543fc tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] [instance: 15541ec9-3112-4adc-9fad-6d20a88f2c09] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:03.018877 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7cedeb69-0680-4bb9-b1d7-8e3bba8543fc tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:03.021647 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7cedeb69-0680-4bb9-b1d7-8e3bba8543fc tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:03.022133 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7cedeb69-0680-4bb9-b1d7-8e3bba8543fc tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:03.022890 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7cedeb69-0680-4bb9-b1d7-8e3bba8543fc tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:03.023359 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7cedeb69-0680-4bb9-b1d7-8e3bba8543fc tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:03.023797 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7cedeb69-0680-4bb9-b1d7-8e3bba8543fc tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:03.281971 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-5ea5300e-8cc1-4ae3-bbd3-ff62e13b1b6a tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:03.293763 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-5ea5300e-8cc1-4ae3-bbd3-ff62e13b1b6a tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:03.295518 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-5ea5300e-8cc1-4ae3-bbd3-ff62e13b1b6a tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:03.297196 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-5ea5300e-8cc1-4ae3-bbd3-ff62e13b1b6a tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] 10.222.0.43 "GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715" status: 200 len: 1798 microversion: 2.32 time: 0.643652 Oct 04 18:46:03.298016 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1846/3476] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:46:02 2022] GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715 => generated 1798 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:46:03.315972 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-d30f8f6c-376f-43f3-b4a0-b40f2f0d01da req-b285e239-4c58-4680-a21b-1b141e8fae9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb651218-4475-4df2-b470-56e737801e3b", "name": "network-vif-plugged", "status": "completed", "tag": "73a0c9e9-44f1-433f-b0e2-be2bd37c67e0"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:46:03.360206 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-d30f8f6c-376f-43f3-b4a0-b40f2f0d01da req-b285e239-4c58-4680-a21b-1b141e8fae9d service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:03.361293 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-d30f8f6c-376f-43f3-b4a0-b40f2f0d01da req-b285e239-4c58-4680-a21b-1b141e8fae9d service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:03.362514 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-d30f8f6c-376f-43f3-b4a0-b40f2f0d01da req-b285e239-4c58-4680-a21b-1b141e8fae9d service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:03.382257 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-d30f8f6c-376f-43f3-b4a0-b40f2f0d01da req-b285e239-4c58-4680-a21b-1b141e8fae9d service nova] Creating event network-vif-plugged:73a0c9e9-44f1-433f-b0e2-be2bd37c67e0 for instance bb651218-4475-4df2-b470-56e737801e3b on n-h1-851028-13 Oct 04 18:46:03.388581 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-d30f8f6c-376f-43f3-b4a0-b40f2f0d01da req-b285e239-4c58-4680-a21b-1b141e8fae9d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088851 Oct 04 18:46:03.390093 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1847/3477] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:46:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:46:03.398080 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-da1061f6-1830-4fdc-8314-0f021e1b7cb8 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:03.398946 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-da1061f6-1830-4fdc-8314-0f021e1b7cb8 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] [instance: 76d475ab-f41c-44df-8aaa-10242bdbfcde] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:03.408374 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-da1061f6-1830-4fdc-8314-0f021e1b7cb8 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:03.409284 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-da1061f6-1830-4fdc-8314-0f021e1b7cb8 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:03.409999 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-da1061f6-1830-4fdc-8314-0f021e1b7cb8 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:03.411133 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-da1061f6-1830-4fdc-8314-0f021e1b7cb8 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:03.411817 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-da1061f6-1830-4fdc-8314-0f021e1b7cb8 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:03.413648 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-da1061f6-1830-4fdc-8314-0f021e1b7cb8 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:03.442463 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-7cedeb69-0680-4bb9-b1d7-8e3bba8543fc tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96e7480de94c43909045ac1087e40cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6bd34bf5540ee95c8144f185eb22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:03.460840 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-7cedeb69-0680-4bb9-b1d7-8e3bba8543fc tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] 10.222.0.43 "GET /compute/v2.1/servers/15541ec9-3112-4adc-9fad-6d20a88f2c09" status: 200 len: 1722 microversion: 2.1 time: 0.490125 Oct 04 18:46:03.463150 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1631/3478] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:02 2022] GET /compute/v2.1/servers/15541ec9-3112-4adc-9fad-6d20a88f2c09 => generated 1722 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:03.481648 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-da1061f6-1830-4fdc-8314-0f021e1b7cb8 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] 10.222.0.43 "GET /compute/v2.1/servers/76d475ab-f41c-44df-8aaa-10242bdbfcde/ips" status: 200 len: 145 microversion: 2.1 time: 0.087838 Oct 04 18:46:03.490578 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1848/3479] 10.222.0.43 () {58 vars in 1248 bytes} [Tue Oct 4 18:46:03 2022] GET /compute/v2.1/servers/76d475ab-f41c-44df-8aaa-10242bdbfcde/ips => generated 145 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:46:03.681596 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-4f779988-846f-4e5b-b3c3-8aa3a8ef344a tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:03.682249 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-4f779988-846f-4e5b-b3c3-8aa3a8ef344a tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: bb651218-4475-4df2-b470-56e737801e3b] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:03.703657 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4f779988-846f-4e5b-b3c3-8aa3a8ef344a tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:03.704247 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4f779988-846f-4e5b-b3c3-8aa3a8ef344a tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:03.706116 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4f779988-846f-4e5b-b3c3-8aa3a8ef344a tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:03.707572 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4f779988-846f-4e5b-b3c3-8aa3a8ef344a tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:03.708270 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4f779988-846f-4e5b-b3c3-8aa3a8ef344a tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:03.709030 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4f779988-846f-4e5b-b3c3-8aa3a8ef344a tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:03.986951 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-187101f3-0910-4b9c-a415-a4f1b814fade tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:03.991291 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-187101f3-0910-4b9c-a415-a4f1b814fade tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] [instance: 00c17e4b-c80e-463e-a3e9-486c118552be] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:04.010529 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-187101f3-0910-4b9c-a415-a4f1b814fade tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:04.011268 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-187101f3-0910-4b9c-a415-a4f1b814fade tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:04.011728 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-187101f3-0910-4b9c-a415-a4f1b814fade tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:04.012476 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-187101f3-0910-4b9c-a415-a4f1b814fade tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:04.020173 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-187101f3-0910-4b9c-a415-a4f1b814fade tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:04.021016 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-187101f3-0910-4b9c-a415-a4f1b814fade tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:04.226222 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-4f779988-846f-4e5b-b3c3-8aa3a8ef344a tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:04.242749 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-4f779988-846f-4e5b-b3c3-8aa3a8ef344a tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/bb651218-4475-4df2-b470-56e737801e3b" status: 200 len: 1315 microversion: 2.1 time: 0.567569 Oct 04 18:46:04.244857 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1632/3480] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:03 2022] GET /compute/v2.1/servers/bb651218-4475-4df2-b470-56e737801e3b => generated 1315 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:04.336572 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-0b037963-a97c-4b94-92ca-8d4fef0a01bd tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:04.338091 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-0b037963-a97c-4b94-92ca-8d4fef0a01bd tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] [instance: fa47906d-d394-46fe-9143-780bcd27a715] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:04.352822 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0b037963-a97c-4b94-92ca-8d4fef0a01bd tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:04.354450 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0b037963-a97c-4b94-92ca-8d4fef0a01bd tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:04.355935 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0b037963-a97c-4b94-92ca-8d4fef0a01bd tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:04.358309 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0b037963-a97c-4b94-92ca-8d4fef0a01bd tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:04.359169 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0b037963-a97c-4b94-92ca-8d4fef0a01bd tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:04.360226 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0b037963-a97c-4b94-92ca-8d4fef0a01bd tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:04.766809 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-187101f3-0910-4b9c-a415-a4f1b814fade tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c710f394164b89b16bcac2fe51c58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65037d4ea5124d749e42928032e803fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:04.780721 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-187101f3-0910-4b9c-a415-a4f1b814fade tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] 10.222.0.43 "GET /compute/v2.1/servers/00c17e4b-c80e-463e-a3e9-486c118552be" status: 200 len: 1318 microversion: 2.1 time: 0.795291 Oct 04 18:46:04.784878 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1849/3481] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:03 2022] GET /compute/v2.1/servers/00c17e4b-c80e-463e-a3e9-486c118552be => generated 1318 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:46:04.805527 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-33c08f61-d7cc-4aa7-853a-bd2b5c32a1ee tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:04.806303 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-33c08f61-d7cc-4aa7-853a-bd2b5c32a1ee tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] [instance: 15541ec9-3112-4adc-9fad-6d20a88f2c09] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:04.832500 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-33c08f61-d7cc-4aa7-853a-bd2b5c32a1ee tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:04.833000 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-33c08f61-d7cc-4aa7-853a-bd2b5c32a1ee tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:04.833500 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-33c08f61-d7cc-4aa7-853a-bd2b5c32a1ee tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:04.839287 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-33c08f61-d7cc-4aa7-853a-bd2b5c32a1ee tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:04.839978 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-33c08f61-d7cc-4aa7-853a-bd2b5c32a1ee tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:04.840563 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-33c08f61-d7cc-4aa7-853a-bd2b5c32a1ee tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:05.163405 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-33c08f61-d7cc-4aa7-853a-bd2b5c32a1ee tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96e7480de94c43909045ac1087e40cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6bd34bf5540ee95c8144f185eb22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:05.180901 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-0b037963-a97c-4b94-92ca-8d4fef0a01bd tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:05.184423 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-33c08f61-d7cc-4aa7-853a-bd2b5c32a1ee tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] 10.222.0.43 "GET /compute/v2.1/servers/15541ec9-3112-4adc-9fad-6d20a88f2c09" status: 200 len: 1722 microversion: 2.1 time: 0.398368 Oct 04 18:46:05.185426 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1850/3482] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:04 2022] GET /compute/v2.1/servers/15541ec9-3112-4adc-9fad-6d20a88f2c09 => generated 1722 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:05.199224 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-0b037963-a97c-4b94-92ca-8d4fef0a01bd tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:05.205087 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-0b037963-a97c-4b94-92ca-8d4fef0a01bd tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:05.208432 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-0b037963-a97c-4b94-92ca-8d4fef0a01bd tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] 10.222.0.43 "GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715" status: 200 len: 1844 microversion: 2.32 time: 0.879632 Oct 04 18:46:05.211539 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1633/3483] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:46:04 2022] GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715 => generated 1844 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:46:05.273472 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-2d8d35c8-c972-4f6b-add7-bf188c9d1d07 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:05.274108 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-2d8d35c8-c972-4f6b-add7-bf188c9d1d07 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: bb651218-4475-4df2-b470-56e737801e3b] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:05.285354 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2d8d35c8-c972-4f6b-add7-bf188c9d1d07 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:05.285865 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2d8d35c8-c972-4f6b-add7-bf188c9d1d07 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:05.286344 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2d8d35c8-c972-4f6b-add7-bf188c9d1d07 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:05.287067 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2d8d35c8-c972-4f6b-add7-bf188c9d1d07 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:05.292116 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2d8d35c8-c972-4f6b-add7-bf188c9d1d07 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:05.292641 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2d8d35c8-c972-4f6b-add7-bf188c9d1d07 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:05.784047 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-2d8d35c8-c972-4f6b-add7-bf188c9d1d07 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:05.795940 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-2d8d35c8-c972-4f6b-add7-bf188c9d1d07 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/bb651218-4475-4df2-b470-56e737801e3b" status: 200 len: 1315 microversion: 2.1 time: 0.527395 Oct 04 18:46:05.800343 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1851/3484] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:05 2022] GET /compute/v2.1/servers/bb651218-4475-4df2-b470-56e737801e3b => generated 1315 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:05.817697 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-5b524bc3-1cc8-451e-b313-a9a83fcfae60 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:05.819051 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-5b524bc3-1cc8-451e-b313-a9a83fcfae60 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] [instance: 00c17e4b-c80e-463e-a3e9-486c118552be] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:05.833064 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5b524bc3-1cc8-451e-b313-a9a83fcfae60 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:05.834150 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5b524bc3-1cc8-451e-b313-a9a83fcfae60 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:05.837031 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5b524bc3-1cc8-451e-b313-a9a83fcfae60 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:05.843119 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5b524bc3-1cc8-451e-b313-a9a83fcfae60 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:05.844005 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5b524bc3-1cc8-451e-b313-a9a83fcfae60 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:05.845909 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5b524bc3-1cc8-451e-b313-a9a83fcfae60 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:05.860508 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:46:06.208972 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-6a48483b-b3c4-494d-a9b8-0d136acda86a tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:06.209627 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-6a48483b-b3c4-494d-a9b8-0d136acda86a tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] [instance: 15541ec9-3112-4adc-9fad-6d20a88f2c09] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:06.234272 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6a48483b-b3c4-494d-a9b8-0d136acda86a tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:06.234783 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6a48483b-b3c4-494d-a9b8-0d136acda86a tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:06.237340 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6a48483b-b3c4-494d-a9b8-0d136acda86a tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:06.239157 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6a48483b-b3c4-494d-a9b8-0d136acda86a tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:06.241383 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6a48483b-b3c4-494d-a9b8-0d136acda86a tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:06.242648 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6a48483b-b3c4-494d-a9b8-0d136acda86a tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:06.257475 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-5b524bc3-1cc8-451e-b313-a9a83fcfae60 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c710f394164b89b16bcac2fe51c58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65037d4ea5124d749e42928032e803fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:06.268114 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-5b524bc3-1cc8-451e-b313-a9a83fcfae60 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] 10.222.0.43 "GET /compute/v2.1/servers/00c17e4b-c80e-463e-a3e9-486c118552be" status: 200 len: 1318 microversion: 2.1 time: 0.463635 Oct 04 18:46:06.272661 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1634/3485] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:05 2022] GET /compute/v2.1/servers/00c17e4b-c80e-463e-a3e9-486c118552be => generated 1318 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:06.279782 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-fff310c8-dd1a-49bb-9b1f-329cbfb789af tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:06.291951 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-fff310c8-dd1a-49bb-9b1f-329cbfb789af tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] [instance: fa47906d-d394-46fe-9143-780bcd27a715] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:06.315867 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fff310c8-dd1a-49bb-9b1f-329cbfb789af tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:06.316408 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fff310c8-dd1a-49bb-9b1f-329cbfb789af tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:06.316870 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fff310c8-dd1a-49bb-9b1f-329cbfb789af tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:06.320198 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fff310c8-dd1a-49bb-9b1f-329cbfb789af tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:06.320733 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fff310c8-dd1a-49bb-9b1f-329cbfb789af tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:06.328260 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fff310c8-dd1a-49bb-9b1f-329cbfb789af tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:06.646938 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-6a48483b-b3c4-494d-a9b8-0d136acda86a tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96e7480de94c43909045ac1087e40cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6bd34bf5540ee95c8144f185eb22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:06.667575 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-6a48483b-b3c4-494d-a9b8-0d136acda86a tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] 10.222.0.43 "GET /compute/v2.1/servers/15541ec9-3112-4adc-9fad-6d20a88f2c09" status: 200 len: 1728 microversion: 2.1 time: 0.463556 Oct 04 18:46:06.670162 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1852/3486] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:06 2022] GET /compute/v2.1/servers/15541ec9-3112-4adc-9fad-6d20a88f2c09 => generated 1728 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:06.701893 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-e3003ee9-4cef-4981-8ffa-21c28b82b77c tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:06.702425 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-e3003ee9-4cef-4981-8ffa-21c28b82b77c tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] [instance: 15541ec9-3112-4adc-9fad-6d20a88f2c09] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:06.723480 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e3003ee9-4cef-4981-8ffa-21c28b82b77c tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:06.726051 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e3003ee9-4cef-4981-8ffa-21c28b82b77c tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:06.726565 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e3003ee9-4cef-4981-8ffa-21c28b82b77c tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:06.727351 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e3003ee9-4cef-4981-8ffa-21c28b82b77c tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:06.727835 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e3003ee9-4cef-4981-8ffa-21c28b82b77c tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:06.728282 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e3003ee9-4cef-4981-8ffa-21c28b82b77c tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:06.850888 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-fff310c8-dd1a-49bb-9b1f-329cbfb789af tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:06.872701 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-fff310c8-dd1a-49bb-9b1f-329cbfb789af tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:06.877202 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-fff310c8-dd1a-49bb-9b1f-329cbfb789af tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:06.879440 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-fff310c8-dd1a-49bb-9b1f-329cbfb789af tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] 10.222.0.43 "GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715" status: 200 len: 1844 microversion: 2.32 time: 0.605300 Oct 04 18:46:06.883360 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1635/3487] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:46:06 2022] GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715 => generated 1844 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:46:06.898620 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-d4424842-09c8-4bc7-8213-a46df2dfc627 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:06.899572 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-d4424842-09c8-4bc7-8213-a46df2dfc627 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: bb651218-4475-4df2-b470-56e737801e3b] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:06.915731 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d4424842-09c8-4bc7-8213-a46df2dfc627 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:06.916915 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d4424842-09c8-4bc7-8213-a46df2dfc627 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:06.917845 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d4424842-09c8-4bc7-8213-a46df2dfc627 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:06.918950 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d4424842-09c8-4bc7-8213-a46df2dfc627 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:06.919647 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d4424842-09c8-4bc7-8213-a46df2dfc627 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:06.920315 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d4424842-09c8-4bc7-8213-a46df2dfc627 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:06.980087 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-e3003ee9-4cef-4981-8ffa-21c28b82b77c tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] 10.222.0.43 "GET /compute/v2.1/servers/15541ec9-3112-4adc-9fad-6d20a88f2c09/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.292075 Oct 04 18:46:06.990412 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1853/3488] 10.222.0.43 () {58 vars in 1275 bytes} [Tue Oct 4 18:46:06 2022] GET /compute/v2.1/servers/15541ec9-3112-4adc-9fad-6d20a88f2c09/os-interface => generated 285 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:46:07.006745 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-5be81469-30e6-4ff3-91c6-92faad6c4007 req-52e2adf7-6df0-47c7-9815-2e1ff12f3621 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa47906d-d394-46fe-9143-780bcd27a715", "tag": "4dedaa7a-5245-4fee-80eb-d2092ad95c1e"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:46:07.041020 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-5be81469-30e6-4ff3-91c6-92faad6c4007 req-52e2adf7-6df0-47c7-9815-2e1ff12f3621 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:07.051793 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-5be81469-30e6-4ff3-91c6-92faad6c4007 req-52e2adf7-6df0-47c7-9815-2e1ff12f3621 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:07.052260 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-5be81469-30e6-4ff3-91c6-92faad6c4007 req-52e2adf7-6df0-47c7-9815-2e1ff12f3621 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:07.094377 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-5be81469-30e6-4ff3-91c6-92faad6c4007 req-52e2adf7-6df0-47c7-9815-2e1ff12f3621 service nova] Creating event network-changed:4dedaa7a-5245-4fee-80eb-d2092ad95c1e for instance fa47906d-d394-46fe-9143-780bcd27a715 on n-h1-851028-13 Oct 04 18:46:07.107651 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-5be81469-30e6-4ff3-91c6-92faad6c4007 req-52e2adf7-6df0-47c7-9815-2e1ff12f3621 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114190 Oct 04 18:46:07.110773 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1854/3489] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:46:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:46:07.295601 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-23c3292f-bc1b-4ae7-9495-5731debb69a0 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:07.296435 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-23c3292f-bc1b-4ae7-9495-5731debb69a0 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] [instance: 00c17e4b-c80e-463e-a3e9-486c118552be] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:07.317353 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-23c3292f-bc1b-4ae7-9495-5731debb69a0 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:07.325294 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-23c3292f-bc1b-4ae7-9495-5731debb69a0 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:07.327082 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-23c3292f-bc1b-4ae7-9495-5731debb69a0 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:07.328745 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-23c3292f-bc1b-4ae7-9495-5731debb69a0 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:07.331591 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-23c3292f-bc1b-4ae7-9495-5731debb69a0 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:07.333131 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-23c3292f-bc1b-4ae7-9495-5731debb69a0 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:07.532873 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-d4424842-09c8-4bc7-8213-a46df2dfc627 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:07.562160 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-d4424842-09c8-4bc7-8213-a46df2dfc627 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/bb651218-4475-4df2-b470-56e737801e3b" status: 200 len: 1502 microversion: 2.1 time: 0.675581 Oct 04 18:46:07.567128 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1636/3490] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:06 2022] GET /compute/v2.1/servers/bb651218-4475-4df2-b470-56e737801e3b => generated 1502 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:07.589210 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-86808098-8aa6-48fd-9ca2-aba6f93b3a3e req-f1fabeaf-375d-4e73-9cf8-71452c8f56e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00c17e4b-c80e-463e-a3e9-486c118552be", "name": "network-vif-plugged", "status": "completed", "tag": "45676c3f-b64a-480d-b44c-aab2a72fcd1e"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:46:07.627685 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-86808098-8aa6-48fd-9ca2-aba6f93b3a3e req-f1fabeaf-375d-4e73-9cf8-71452c8f56e1 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:07.630697 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-86808098-8aa6-48fd-9ca2-aba6f93b3a3e req-f1fabeaf-375d-4e73-9cf8-71452c8f56e1 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:07.632927 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-86808098-8aa6-48fd-9ca2-aba6f93b3a3e req-f1fabeaf-375d-4e73-9cf8-71452c8f56e1 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:07.685995 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-86808098-8aa6-48fd-9ca2-aba6f93b3a3e req-f1fabeaf-375d-4e73-9cf8-71452c8f56e1 service nova] Creating event network-vif-plugged:45676c3f-b64a-480d-b44c-aab2a72fcd1e for instance 00c17e4b-c80e-463e-a3e9-486c118552be on n-h1-851028-13 Oct 04 18:46:07.706963 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-86808098-8aa6-48fd-9ca2-aba6f93b3a3e req-f1fabeaf-375d-4e73-9cf8-71452c8f56e1 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.138220 Oct 04 18:46:07.707593 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1637/3491] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:46:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:46:07.712880 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-559243e1-8c29-475e-aac9-351ce27826bd tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:46:07.715515 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-559243e1-8c29-475e-aac9-351ce27826bd tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: bb651218-4475-4df2-b470-56e737801e3b] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:07.736988 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-559243e1-8c29-475e-aac9-351ce27826bd tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:07.737670 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-559243e1-8c29-475e-aac9-351ce27826bd tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:07.738125 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-559243e1-8c29-475e-aac9-351ce27826bd tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:07.738989 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-559243e1-8c29-475e-aac9-351ce27826bd tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:07.741178 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-559243e1-8c29-475e-aac9-351ce27826bd tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:07.741840 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-559243e1-8c29-475e-aac9-351ce27826bd tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:07.827150 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-559243e1-8c29-475e-aac9-351ce27826bd tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "POST /compute/v2.1/servers/bb651218-4475-4df2-b470-56e737801e3b/action" status: 200 len: 14 microversion: 2.1 time: 0.118123 Oct 04 18:46:07.827807 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1638/3492] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 18:46:07 2022] POST /compute/v2.1/servers/bb651218-4475-4df2-b470-56e737801e3b/action => generated 14 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:46:07.914455 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-29507d2a-f5e4-4bfb-adaf-07e129846e92 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:07.915194 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-29507d2a-f5e4-4bfb-adaf-07e129846e92 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] [instance: fa47906d-d394-46fe-9143-780bcd27a715] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:07.933840 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-29507d2a-f5e4-4bfb-adaf-07e129846e92 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:07.934461 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-29507d2a-f5e4-4bfb-adaf-07e129846e92 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:07.937887 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-29507d2a-f5e4-4bfb-adaf-07e129846e92 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:07.939292 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-29507d2a-f5e4-4bfb-adaf-07e129846e92 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:07.939834 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-29507d2a-f5e4-4bfb-adaf-07e129846e92 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:07.940343 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-29507d2a-f5e4-4bfb-adaf-07e129846e92 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:07.983215 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-23c3292f-bc1b-4ae7-9495-5731debb69a0 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c710f394164b89b16bcac2fe51c58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65037d4ea5124d749e42928032e803fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:07.996799 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-23c3292f-bc1b-4ae7-9495-5731debb69a0 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] 10.222.0.43 "GET /compute/v2.1/servers/00c17e4b-c80e-463e-a3e9-486c118552be" status: 200 len: 1318 microversion: 2.1 time: 0.707423 Oct 04 18:46:07.999816 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1855/3493] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:07 2022] GET /compute/v2.1/servers/00c17e4b-c80e-463e-a3e9-486c118552be => generated 1318 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:08.242134 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-64eff805-37bf-4b04-956f-cfaf877e4162 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a2630be4-30c5-4e17-ac5c-fc387b663760"}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:46:08.244902 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-64eff805-37bf-4b04-956f-cfaf877e4162 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] [instance: 76d475ab-f41c-44df-8aaa-10242bdbfcde] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:08.273561 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-64eff805-37bf-4b04-956f-cfaf877e4162 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:08.274300 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-64eff805-37bf-4b04-956f-cfaf877e4162 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:08.274992 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-64eff805-37bf-4b04-956f-cfaf877e4162 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:08.275948 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-64eff805-37bf-4b04-956f-cfaf877e4162 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:08.283087 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-64eff805-37bf-4b04-956f-cfaf877e4162 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:08.283865 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-64eff805-37bf-4b04-956f-cfaf877e4162 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:08.576236 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-29507d2a-f5e4-4bfb-adaf-07e129846e92 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:08.597447 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-29507d2a-f5e4-4bfb-adaf-07e129846e92 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:08.607636 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-29507d2a-f5e4-4bfb-adaf-07e129846e92 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:08.611589 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-29507d2a-f5e4-4bfb-adaf-07e129846e92 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] 10.222.0.43 "GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715" status: 200 len: 1844 microversion: 2.32 time: 0.702482 Oct 04 18:46:08.616300 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1639/3494] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:46:07 2022] GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715 => generated 1844 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:46:08.796661 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-64eff805-37bf-4b04-956f-cfaf877e4162 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] 10.222.0.43 "POST /compute/v2.1/servers/76d475ab-f41c-44df-8aaa-10242bdbfcde/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.558050 Oct 04 18:46:08.812024 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1856/3495] 10.222.0.43 () {60 vars in 1323 bytes} [Tue Oct 4 18:46:08 2022] POST /compute/v2.1/servers/76d475ab-f41c-44df-8aaa-10242bdbfcde/os-volume_attachments => generated 194 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:46:08.851227 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-b89a4ae9-a37d-42fa-9ce3-e102fb83c4d5 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:46:08.853838 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-b89a4ae9-a37d-42fa-9ce3-e102fb83c4d5 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: bb651218-4475-4df2-b470-56e737801e3b] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:08.880738 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b89a4ae9-a37d-42fa-9ce3-e102fb83c4d5 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:08.890180 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b89a4ae9-a37d-42fa-9ce3-e102fb83c4d5 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:08.894144 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b89a4ae9-a37d-42fa-9ce3-e102fb83c4d5 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:08.896736 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b89a4ae9-a37d-42fa-9ce3-e102fb83c4d5 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:08.897971 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b89a4ae9-a37d-42fa-9ce3-e102fb83c4d5 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:08.905798 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b89a4ae9-a37d-42fa-9ce3-e102fb83c4d5 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:09.047528 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-8ddf7656-613d-4b44-ac6b-05dd525fdca4 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:09.047528 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-8ddf7656-613d-4b44-ac6b-05dd525fdca4 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] [instance: 00c17e4b-c80e-463e-a3e9-486c118552be] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:09.056154 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8ddf7656-613d-4b44-ac6b-05dd525fdca4 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:09.056677 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8ddf7656-613d-4b44-ac6b-05dd525fdca4 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:09.057162 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8ddf7656-613d-4b44-ac6b-05dd525fdca4 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:09.057894 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8ddf7656-613d-4b44-ac6b-05dd525fdca4 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:09.058684 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8ddf7656-613d-4b44-ac6b-05dd525fdca4 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:09.062693 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8ddf7656-613d-4b44-ac6b-05dd525fdca4 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:09.137050 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-b89a4ae9-a37d-42fa-9ce3-e102fb83c4d5 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "POST /compute/v2.1/servers/bb651218-4475-4df2-b470-56e737801e3b/action" status: 200 len: 14 microversion: 2.1 time: 0.299324 Oct 04 18:46:09.138723 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1640/3496] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 18:46:08 2022] POST /compute/v2.1/servers/bb651218-4475-4df2-b470-56e737801e3b/action => generated 14 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:46:09.274322 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-3fe9e1e1-5c1a-43c7-816b-c5227f1a092a req-cbf6cfbc-b230-4946-ba44-9710d81f3669 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa47906d-d394-46fe-9143-780bcd27a715", "tag": "501fb3c2-8b52-4abe-9556-64d2ee5b20db"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:46:09.321989 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-3fe9e1e1-5c1a-43c7-816b-c5227f1a092a req-cbf6cfbc-b230-4946-ba44-9710d81f3669 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:09.324977 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-3fe9e1e1-5c1a-43c7-816b-c5227f1a092a req-cbf6cfbc-b230-4946-ba44-9710d81f3669 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:09.325629 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-3fe9e1e1-5c1a-43c7-816b-c5227f1a092a req-cbf6cfbc-b230-4946-ba44-9710d81f3669 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:09.364245 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-3fe9e1e1-5c1a-43c7-816b-c5227f1a092a req-cbf6cfbc-b230-4946-ba44-9710d81f3669 service nova] Creating event network-changed:501fb3c2-8b52-4abe-9556-64d2ee5b20db for instance fa47906d-d394-46fe-9143-780bcd27a715 on n-h1-851028-13 Oct 04 18:46:09.376532 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-3fe9e1e1-5c1a-43c7-816b-c5227f1a092a req-cbf6cfbc-b230-4946-ba44-9710d81f3669 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105866 Oct 04 18:46:09.378781 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1641/3497] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:46:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:46:09.646948 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-659a6fa2-f0a8-4ea9-9113-d191083cad36 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:09.650152 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-659a6fa2-f0a8-4ea9-9113-d191083cad36 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] [instance: fa47906d-d394-46fe-9143-780bcd27a715] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:09.694829 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-659a6fa2-f0a8-4ea9-9113-d191083cad36 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:09.695861 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-659a6fa2-f0a8-4ea9-9113-d191083cad36 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:09.698342 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-659a6fa2-f0a8-4ea9-9113-d191083cad36 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:09.703197 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-659a6fa2-f0a8-4ea9-9113-d191083cad36 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:09.705414 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-659a6fa2-f0a8-4ea9-9113-d191083cad36 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:09.708832 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-659a6fa2-f0a8-4ea9-9113-d191083cad36 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:10.234819 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-8ddf7656-613d-4b44-ac6b-05dd525fdca4 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c710f394164b89b16bcac2fe51c58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65037d4ea5124d749e42928032e803fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:10.254681 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-8ddf7656-613d-4b44-ac6b-05dd525fdca4 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] 10.222.0.43 "GET /compute/v2.1/servers/00c17e4b-c80e-463e-a3e9-486c118552be" status: 200 len: 1318 microversion: 2.1 time: 1.229404 Oct 04 18:46:10.273308 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1857/3498] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:09 2022] GET /compute/v2.1/servers/00c17e4b-c80e-463e-a3e9-486c118552be => generated 1318 bytes in 1250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:10.286460 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-3b028cd8-33f7-4803-b2d0-5ec2e8291a04 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:46:10.293812 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-3b028cd8-33f7-4803-b2d0-5ec2e8291a04 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: bb651218-4475-4df2-b470-56e737801e3b] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:10.310054 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3b028cd8-33f7-4803-b2d0-5ec2e8291a04 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:10.312201 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3b028cd8-33f7-4803-b2d0-5ec2e8291a04 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:10.312864 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3b028cd8-33f7-4803-b2d0-5ec2e8291a04 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:10.314839 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3b028cd8-33f7-4803-b2d0-5ec2e8291a04 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:10.316907 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3b028cd8-33f7-4803-b2d0-5ec2e8291a04 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:10.317849 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3b028cd8-33f7-4803-b2d0-5ec2e8291a04 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:10.407591 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-3b028cd8-33f7-4803-b2d0-5ec2e8291a04 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "POST /compute/v2.1/servers/bb651218-4475-4df2-b470-56e737801e3b/action" status: 200 len: 14 microversion: 2.1 time: 0.132440 Oct 04 18:46:10.408957 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1858/3499] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 18:46:10 2022] POST /compute/v2.1/servers/bb651218-4475-4df2-b470-56e737801e3b/action => generated 14 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:46:10.746430 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-0fbab612-b6c5-4ec5-a6c2-226807613fdc req-60245dae-cdbf-43c0-9c04-97c03c7b94eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15541ec9-3112-4adc-9fad-6d20a88f2c09", "tag": "ae7d73fe-313a-45b9-8e8c-91a97a4dd13a"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:46:10.768972 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-0fbab612-b6c5-4ec5-a6c2-226807613fdc req-60245dae-cdbf-43c0-9c04-97c03c7b94eb service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:10.775467 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-0fbab612-b6c5-4ec5-a6c2-226807613fdc req-60245dae-cdbf-43c0-9c04-97c03c7b94eb service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:10.776223 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-0fbab612-b6c5-4ec5-a6c2-226807613fdc req-60245dae-cdbf-43c0-9c04-97c03c7b94eb service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:10.801644 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-0fbab612-b6c5-4ec5-a6c2-226807613fdc req-60245dae-cdbf-43c0-9c04-97c03c7b94eb service nova] Creating event network-changed:ae7d73fe-313a-45b9-8e8c-91a97a4dd13a for instance 15541ec9-3112-4adc-9fad-6d20a88f2c09 on n-h1-851028-13 Oct 04 18:46:10.820811 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-0fbab612-b6c5-4ec5-a6c2-226807613fdc req-60245dae-cdbf-43c0-9c04-97c03c7b94eb service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079065 Oct 04 18:46:10.825485 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1859/3500] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:46:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:46:11.282881 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f52aad5d-040f-4adc-acf9-e6e675df220c tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:11.283564 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-f52aad5d-040f-4adc-acf9-e6e675df220c tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] [instance: 00c17e4b-c80e-463e-a3e9-486c118552be] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:11.301664 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f52aad5d-040f-4adc-acf9-e6e675df220c tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:11.302181 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f52aad5d-040f-4adc-acf9-e6e675df220c tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:11.302636 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f52aad5d-040f-4adc-acf9-e6e675df220c tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:11.303377 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f52aad5d-040f-4adc-acf9-e6e675df220c tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:11.303841 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f52aad5d-040f-4adc-acf9-e6e675df220c tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:11.304278 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f52aad5d-040f-4adc-acf9-e6e675df220c tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:11.700614 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-659a6fa2-f0a8-4ea9-9113-d191083cad36 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:11.727584 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-659a6fa2-f0a8-4ea9-9113-d191083cad36 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:11.729564 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-659a6fa2-f0a8-4ea9-9113-d191083cad36 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:11.731052 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-659a6fa2-f0a8-4ea9-9113-d191083cad36 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] 10.222.0.43 "GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715" status: 200 len: 1886 microversion: 2.32 time: 2.091088 Oct 04 18:46:11.741647 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1642/3501] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:46:09 2022] GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715 => generated 1886 bytes in 2103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:46:11.762581 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-0bb38c56-e021-45d9-a9a7-6ccb6ac5db69 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:46:11.765603 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-0bb38c56-e021-45d9-a9a7-6ccb6ac5db69 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: bb651218-4475-4df2-b470-56e737801e3b] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:11.777921 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0bb38c56-e021-45d9-a9a7-6ccb6ac5db69 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:11.778636 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0bb38c56-e021-45d9-a9a7-6ccb6ac5db69 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:11.779366 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0bb38c56-e021-45d9-a9a7-6ccb6ac5db69 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:11.780302 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0bb38c56-e021-45d9-a9a7-6ccb6ac5db69 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:11.781844 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0bb38c56-e021-45d9-a9a7-6ccb6ac5db69 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:11.783165 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0bb38c56-e021-45d9-a9a7-6ccb6ac5db69 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:11.849900 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-0bb38c56-e021-45d9-a9a7-6ccb6ac5db69 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "POST /compute/v2.1/servers/bb651218-4475-4df2-b470-56e737801e3b/action" status: 200 len: 14 microversion: 2.1 time: 0.105756 Oct 04 18:46:11.850586 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1643/3502] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 18:46:11 2022] POST /compute/v2.1/servers/bb651218-4475-4df2-b470-56e737801e3b/action => generated 14 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:46:12.049869 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-f52aad5d-040f-4adc-acf9-e6e675df220c tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c710f394164b89b16bcac2fe51c58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65037d4ea5124d749e42928032e803fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:12.082942 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-f52aad5d-040f-4adc-acf9-e6e675df220c tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] 10.222.0.43 "GET /compute/v2.1/servers/00c17e4b-c80e-463e-a3e9-486c118552be" status: 200 len: 1508 microversion: 2.1 time: 0.801391 Oct 04 18:46:12.087623 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1860/3503] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:11 2022] GET /compute/v2.1/servers/00c17e4b-c80e-463e-a3e9-486c118552be => generated 1508 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:46:12.108637 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-0f6e323b-9a8b-4249-b289-e8ee99aa41f7 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:12.109653 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-0f6e323b-9a8b-4249-b289-e8ee99aa41f7 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] [instance: 00c17e4b-c80e-463e-a3e9-486c118552be] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:12.124344 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0f6e323b-9a8b-4249-b289-e8ee99aa41f7 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:12.125997 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0f6e323b-9a8b-4249-b289-e8ee99aa41f7 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:12.127413 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0f6e323b-9a8b-4249-b289-e8ee99aa41f7 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:12.131350 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0f6e323b-9a8b-4249-b289-e8ee99aa41f7 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:12.132899 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0f6e323b-9a8b-4249-b289-e8ee99aa41f7 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:12.134346 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0f6e323b-9a8b-4249-b289-e8ee99aa41f7 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:12.500806 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-67fa91fd-666a-4084-b719-5a0167eb6906 req-a25ce05c-525d-480c-a3a2-b8aeadbfb146 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa47906d-d394-46fe-9143-780bcd27a715", "tag": "39a6795d-0bd0-4b90-a450-c5f7f85686c6"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:46:12.522559 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-67fa91fd-666a-4084-b719-5a0167eb6906 req-a25ce05c-525d-480c-a3a2-b8aeadbfb146 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:12.523085 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-67fa91fd-666a-4084-b719-5a0167eb6906 req-a25ce05c-525d-480c-a3a2-b8aeadbfb146 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:12.523516 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-67fa91fd-666a-4084-b719-5a0167eb6906 req-a25ce05c-525d-480c-a3a2-b8aeadbfb146 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:12.568088 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-67fa91fd-666a-4084-b719-5a0167eb6906 req-a25ce05c-525d-480c-a3a2-b8aeadbfb146 service nova] Creating event network-changed:39a6795d-0bd0-4b90-a450-c5f7f85686c6 for instance fa47906d-d394-46fe-9143-780bcd27a715 on n-h1-851028-13 Oct 04 18:46:12.585920 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-67fa91fd-666a-4084-b719-5a0167eb6906 req-a25ce05c-525d-480c-a3a2-b8aeadbfb146 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094538 Oct 04 18:46:12.587928 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1861/3504] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:46:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Oct 04 18:46:12.611010 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-0f6e323b-9a8b-4249-b289-e8ee99aa41f7 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c710f394164b89b16bcac2fe51c58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65037d4ea5124d749e42928032e803fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:12.620096 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-0f6e323b-9a8b-4249-b289-e8ee99aa41f7 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] 10.222.0.43 "GET /compute/v2.1/servers/00c17e4b-c80e-463e-a3e9-486c118552be" status: 200 len: 1508 microversion: 2.1 time: 0.516147 Oct 04 18:46:12.637840 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1644/3505] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:12 2022] GET /compute/v2.1/servers/00c17e4b-c80e-463e-a3e9-486c118552be => generated 1508 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:12.652384 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-c89a86db-e6c1-459d-aa09-7a2a0923c7c4 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:46:12.655692 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-c89a86db-e6c1-459d-aa09-7a2a0923c7c4 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] [instance: 00c17e4b-c80e-463e-a3e9-486c118552be] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:12.675660 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c89a86db-e6c1-459d-aa09-7a2a0923c7c4 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:12.677668 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c89a86db-e6c1-459d-aa09-7a2a0923c7c4 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:12.678822 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c89a86db-e6c1-459d-aa09-7a2a0923c7c4 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:12.683335 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c89a86db-e6c1-459d-aa09-7a2a0923c7c4 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:12.687408 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c89a86db-e6c1-459d-aa09-7a2a0923c7c4 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:12.688369 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c89a86db-e6c1-459d-aa09-7a2a0923c7c4 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:12.769550 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-f5c8bbb4-9927-4736-a61a-d20804ebd3ca tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:12.770679 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-f5c8bbb4-9927-4736-a61a-d20804ebd3ca tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] [instance: fa47906d-d394-46fe-9143-780bcd27a715] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:12.867960 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-c89a86db-e6c1-459d-aa09-7a2a0923c7c4 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] 10.222.0.43 "PUT /compute/v2.1/servers/00c17e4b-c80e-463e-a3e9-486c118552be" status: 200 len: 1080 microversion: 2.1 time: 0.219935 Oct 04 18:46:12.869243 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1862/3506] 10.222.0.43 () {60 vars in 1256 bytes} [Tue Oct 4 18:46:12 2022] PUT /compute/v2.1/servers/00c17e4b-c80e-463e-a3e9-486c118552be => generated 1080 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:12.870668 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f5c8bbb4-9927-4736-a61a-d20804ebd3ca tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:12.872690 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f5c8bbb4-9927-4736-a61a-d20804ebd3ca tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:12.877578 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-61ac15de-a2f5-4144-b666-667801dd073c req-29433ca2-5eaf-4c7f-9a6c-c0ced03788c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15541ec9-3112-4adc-9fad-6d20a88f2c09", "tag": "ae7d73fe-313a-45b9-8e8c-91a97a4dd13a"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:46:12.879522 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f5c8bbb4-9927-4736-a61a-d20804ebd3ca tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:12.886654 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f5c8bbb4-9927-4736-a61a-d20804ebd3ca tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:12.887764 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:46:12.894239 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f5c8bbb4-9927-4736-a61a-d20804ebd3ca tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:12.897847 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f5c8bbb4-9927-4736-a61a-d20804ebd3ca tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:12.901422 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-61ac15de-a2f5-4144-b666-667801dd073c req-29433ca2-5eaf-4c7f-9a6c-c0ced03788c2 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:12.901918 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-61ac15de-a2f5-4144-b666-667801dd073c req-29433ca2-5eaf-4c7f-9a6c-c0ced03788c2 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:12.902360 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-61ac15de-a2f5-4144-b666-667801dd073c req-29433ca2-5eaf-4c7f-9a6c-c0ced03788c2 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:12.933520 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-61ac15de-a2f5-4144-b666-667801dd073c req-29433ca2-5eaf-4c7f-9a6c-c0ced03788c2 service nova] Creating event network-changed:ae7d73fe-313a-45b9-8e8c-91a97a4dd13a for instance 15541ec9-3112-4adc-9fad-6d20a88f2c09 on n-h1-851028-13 Oct 04 18:46:12.947269 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-61ac15de-a2f5-4144-b666-667801dd073c req-29433ca2-5eaf-4c7f-9a6c-c0ced03788c2 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076501 Oct 04 18:46:12.951773 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1863/3507] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:46:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:46:12.965255 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-d7483ea3-9aae-4d0f-9643-00bf7eb0569b tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:46:12.970209 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-d7483ea3-9aae-4d0f-9643-00bf7eb0569b tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: bb651218-4475-4df2-b470-56e737801e3b] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:12.983999 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d7483ea3-9aae-4d0f-9643-00bf7eb0569b tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:12.985242 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d7483ea3-9aae-4d0f-9643-00bf7eb0569b tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:12.986376 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d7483ea3-9aae-4d0f-9643-00bf7eb0569b tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:12.988659 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d7483ea3-9aae-4d0f-9643-00bf7eb0569b tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:12.990879 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d7483ea3-9aae-4d0f-9643-00bf7eb0569b tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:12.991499 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d7483ea3-9aae-4d0f-9643-00bf7eb0569b tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:13.105992 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-d7483ea3-9aae-4d0f-9643-00bf7eb0569b tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "POST /compute/v2.1/servers/bb651218-4475-4df2-b470-56e737801e3b/action" status: 200 len: 14 microversion: 2.1 time: 0.152350 Oct 04 18:46:13.107274 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1864/3508] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 18:46:12 2022] POST /compute/v2.1/servers/bb651218-4475-4df2-b470-56e737801e3b/action => generated 14 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:46:13.113399 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-45f75979-996b-479a-bc91-7bb291c5a1e4 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:13.118031 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-45f75979-996b-479a-bc91-7bb291c5a1e4 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] [instance: 00c17e4b-c80e-463e-a3e9-486c118552be] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:13.130246 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-45f75979-996b-479a-bc91-7bb291c5a1e4 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:13.132497 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-45f75979-996b-479a-bc91-7bb291c5a1e4 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:13.136692 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-45f75979-996b-479a-bc91-7bb291c5a1e4 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:13.137761 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-45f75979-996b-479a-bc91-7bb291c5a1e4 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:13.139910 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-45f75979-996b-479a-bc91-7bb291c5a1e4 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:13.140527 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-45f75979-996b-479a-bc91-7bb291c5a1e4 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:13.189891 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:46:13.628447 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-45f75979-996b-479a-bc91-7bb291c5a1e4 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c710f394164b89b16bcac2fe51c58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65037d4ea5124d749e42928032e803fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:13.643041 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-45f75979-996b-479a-bc91-7bb291c5a1e4 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] 10.222.0.43 "GET /compute/v2.1/servers/00c17e4b-c80e-463e-a3e9-486c118552be" status: 200 len: 1506 microversion: 2.1 time: 0.532716 Oct 04 18:46:13.646080 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1865/3509] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:13 2022] GET /compute/v2.1/servers/00c17e4b-c80e-463e-a3e9-486c118552be => generated 1506 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:13.680892 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-2e6c69aa-ff7f-45e9-b897-91a60fce3326 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:13.682092 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-2e6c69aa-ff7f-45e9-b897-91a60fce3326 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] [instance: 00c17e4b-c80e-463e-a3e9-486c118552be] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:13.701773 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2e6c69aa-ff7f-45e9-b897-91a60fce3326 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:13.702617 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2e6c69aa-ff7f-45e9-b897-91a60fce3326 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:13.703267 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2e6c69aa-ff7f-45e9-b897-91a60fce3326 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:13.704297 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2e6c69aa-ff7f-45e9-b897-91a60fce3326 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:13.704940 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2e6c69aa-ff7f-45e9-b897-91a60fce3326 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:13.705578 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2e6c69aa-ff7f-45e9-b897-91a60fce3326 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:14.251209 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-2e6c69aa-ff7f-45e9-b897-91a60fce3326 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c710f394164b89b16bcac2fe51c58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65037d4ea5124d749e42928032e803fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:14.262667 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-2e6c69aa-ff7f-45e9-b897-91a60fce3326 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] 10.222.0.43 "GET /compute/v2.1/servers/00c17e4b-c80e-463e-a3e9-486c118552be" status: 200 len: 1506 microversion: 2.1 time: 0.587716 Oct 04 18:46:14.263901 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1866/3510] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:13 2022] GET /compute/v2.1/servers/00c17e4b-c80e-463e-a3e9-486c118552be => generated 1506 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:46:14.269758 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-937a79c0-7a34-491b-b426-49d6eb376507 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:46:14.272606 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-937a79c0-7a34-491b-b426-49d6eb376507 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: bb651218-4475-4df2-b470-56e737801e3b] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:14.279126 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-937a79c0-7a34-491b-b426-49d6eb376507 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:14.281044 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-937a79c0-7a34-491b-b426-49d6eb376507 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:14.281987 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-937a79c0-7a34-491b-b426-49d6eb376507 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:14.282981 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-937a79c0-7a34-491b-b426-49d6eb376507 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:14.283627 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-937a79c0-7a34-491b-b426-49d6eb376507 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:14.284232 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-937a79c0-7a34-491b-b426-49d6eb376507 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:14.337317 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-937a79c0-7a34-491b-b426-49d6eb376507 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "POST /compute/v2.1/servers/bb651218-4475-4df2-b470-56e737801e3b/action" status: 200 len: 14 microversion: 2.1 time: 0.071545 Oct 04 18:46:14.338511 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1867/3511] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 18:46:14 2022] POST /compute/v2.1/servers/bb651218-4475-4df2-b470-56e737801e3b/action => generated 14 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:46:14.345413 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-87568286-3e40-4d5f-bbc6-cd747883b055 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:46:14.349756 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-87568286-3e40-4d5f-bbc6-cd747883b055 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] [instance: 00c17e4b-c80e-463e-a3e9-486c118552be] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:14.363045 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-87568286-3e40-4d5f-bbc6-cd747883b055 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:14.364056 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-87568286-3e40-4d5f-bbc6-cd747883b055 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:14.364835 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-87568286-3e40-4d5f-bbc6-cd747883b055 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:14.365765 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-87568286-3e40-4d5f-bbc6-cd747883b055 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:14.366640 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-87568286-3e40-4d5f-bbc6-cd747883b055 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:14.367281 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-87568286-3e40-4d5f-bbc6-cd747883b055 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:14.593857 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-87568286-3e40-4d5f-bbc6-cd747883b055 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Flavor limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:46:14.594303 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-87568286-3e40-4d5f-bbc6-cd747883b055 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Image limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:46:14.595589 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-87568286-3e40-4d5f-bbc6-cd747883b055 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Flavor pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:46:14.598126 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-87568286-3e40-4d5f-bbc6-cd747883b055 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Image pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:46:14.600692 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-87568286-3e40-4d5f-bbc6-cd747883b055 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:46:14.746771 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-87568286-3e40-4d5f-bbc6-cd747883b055 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] [instance: 00c17e4b-c80e-463e-a3e9-486c118552be] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:14.760760 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-87568286-3e40-4d5f-bbc6-cd747883b055 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:14.764995 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-87568286-3e40-4d5f-bbc6-cd747883b055 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:14.766283 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-87568286-3e40-4d5f-bbc6-cd747883b055 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:14.769343 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-87568286-3e40-4d5f-bbc6-cd747883b055 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:14.780725 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-87568286-3e40-4d5f-bbc6-cd747883b055 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:14.783654 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-87568286-3e40-4d5f-bbc6-cd747883b055 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:14.879073 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-87568286-3e40-4d5f-bbc6-cd747883b055 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] 10.222.0.43 "POST /compute/v2.1/servers/00c17e4b-c80e-463e-a3e9-486c118552be/action" status: 202 len: 1112 microversion: 2.1 time: 0.538851 Oct 04 18:46:14.881829 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1868/3512] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 18:46:14 2022] POST /compute/v2.1/servers/00c17e4b-c80e-463e-a3e9-486c118552be/action => generated 1112 bytes in 542 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 04 18:46:14.899517 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-f5c8bbb4-9927-4736-a61a-d20804ebd3ca tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:14.908362 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-455b5e56-5409-4f9b-b02f-ce322fb8e072 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:14.909185 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-455b5e56-5409-4f9b-b02f-ce322fb8e072 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] [instance: 00c17e4b-c80e-463e-a3e9-486c118552be] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:14.941160 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-f5c8bbb4-9927-4736-a61a-d20804ebd3ca tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:14.949637 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-f5c8bbb4-9927-4736-a61a-d20804ebd3ca tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:14.949912 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-455b5e56-5409-4f9b-b02f-ce322fb8e072 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:14.950736 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-455b5e56-5409-4f9b-b02f-ce322fb8e072 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:14.951093 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-f5c8bbb4-9927-4736-a61a-d20804ebd3ca tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] 10.222.0.43 "GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715" status: 200 len: 1886 microversion: 2.32 time: 2.192409 Oct 04 18:46:14.951689 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1645/3513] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:46:12 2022] GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715 => generated 1886 bytes in 2194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:46:14.955147 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-455b5e56-5409-4f9b-b02f-ce322fb8e072 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:14.956218 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-455b5e56-5409-4f9b-b02f-ce322fb8e072 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:14.961472 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-455b5e56-5409-4f9b-b02f-ce322fb8e072 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:14.967353 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-455b5e56-5409-4f9b-b02f-ce322fb8e072 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:15.348793 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-86d705ec-6a31-41fb-a9e3-69e2bde9fd9b tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:46:15.352557 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-86d705ec-6a31-41fb-a9e3-69e2bde9fd9b tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: bb651218-4475-4df2-b470-56e737801e3b] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:15.384740 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-86d705ec-6a31-41fb-a9e3-69e2bde9fd9b tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:15.385523 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-86d705ec-6a31-41fb-a9e3-69e2bde9fd9b tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:15.388108 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-86d705ec-6a31-41fb-a9e3-69e2bde9fd9b tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:15.392098 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-86d705ec-6a31-41fb-a9e3-69e2bde9fd9b tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:15.394112 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-86d705ec-6a31-41fb-a9e3-69e2bde9fd9b tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:15.397052 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-86d705ec-6a31-41fb-a9e3-69e2bde9fd9b tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:15.507422 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-86d705ec-6a31-41fb-a9e3-69e2bde9fd9b tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "POST /compute/v2.1/servers/bb651218-4475-4df2-b470-56e737801e3b/action" status: 200 len: 14 microversion: 2.1 time: 0.163088 Oct 04 18:46:15.512066 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1646/3514] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 18:46:15 2022] POST /compute/v2.1/servers/bb651218-4475-4df2-b470-56e737801e3b/action => generated 14 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 04 18:46:15.983268 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-a9b1db89-ace5-4c35-ae9b-1da30e378704 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:15.983964 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-a9b1db89-ace5-4c35-ae9b-1da30e378704 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] [instance: fa47906d-d394-46fe-9143-780bcd27a715] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:15.996929 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a9b1db89-ace5-4c35-ae9b-1da30e378704 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:15.997453 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a9b1db89-ace5-4c35-ae9b-1da30e378704 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:15.997897 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a9b1db89-ace5-4c35-ae9b-1da30e378704 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:16.006064 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a9b1db89-ace5-4c35-ae9b-1da30e378704 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:16.006686 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a9b1db89-ace5-4c35-ae9b-1da30e378704 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:16.007405 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a9b1db89-ace5-4c35-ae9b-1da30e378704 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:16.175786 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-455b5e56-5409-4f9b-b02f-ce322fb8e072 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c710f394164b89b16bcac2fe51c58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65037d4ea5124d749e42928032e803fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:16.190158 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-455b5e56-5409-4f9b-b02f-ce322fb8e072 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] 10.222.0.43 "GET /compute/v2.1/servers/00c17e4b-c80e-463e-a3e9-486c118552be" status: 200 len: 1517 microversion: 2.1 time: 1.287479 Oct 04 18:46:16.193467 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1869/3515] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:14 2022] GET /compute/v2.1/servers/00c17e4b-c80e-463e-a3e9-486c118552be => generated 1517 bytes in 1292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:16.520020 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-3f329c52-ec63-4dd0-abea-f6004c10a636 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:46:16.522870 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-3f329c52-ec63-4dd0-abea-f6004c10a636 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: bb651218-4475-4df2-b470-56e737801e3b] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:16.541414 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3f329c52-ec63-4dd0-abea-f6004c10a636 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:16.542316 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3f329c52-ec63-4dd0-abea-f6004c10a636 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:16.542952 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3f329c52-ec63-4dd0-abea-f6004c10a636 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:16.543851 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3f329c52-ec63-4dd0-abea-f6004c10a636 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:16.544478 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3f329c52-ec63-4dd0-abea-f6004c10a636 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:16.545075 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3f329c52-ec63-4dd0-abea-f6004c10a636 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:16.624051 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-3f329c52-ec63-4dd0-abea-f6004c10a636 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "POST /compute/v2.1/servers/bb651218-4475-4df2-b470-56e737801e3b/action" status: 200 len: 14 microversion: 2.1 time: 0.108437 Oct 04 18:46:16.625305 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1870/3516] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 18:46:16 2022] POST /compute/v2.1/servers/bb651218-4475-4df2-b470-56e737801e3b/action => generated 14 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 04 18:46:16.795875 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-a9b1db89-ace5-4c35-ae9b-1da30e378704 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:16.830434 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-a9b1db89-ace5-4c35-ae9b-1da30e378704 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:16.838887 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-a9b1db89-ace5-4c35-ae9b-1da30e378704 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:16.849908 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-a9b1db89-ace5-4c35-ae9b-1da30e378704 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] 10.222.0.43 "GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715" status: 200 len: 1886 microversion: 2.32 time: 0.873246 Oct 04 18:46:16.858101 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1647/3517] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:46:15 2022] GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715 => generated 1886 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:46:17.052733 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-b09bf184-6180-41ce-82b0-1af5de9ec2e1 req-f3f89de8-e971-404f-9fb7-e7d960f34a0e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa47906d-d394-46fe-9143-780bcd27a715", "tag": "076a121c-741e-46ac-a9c1-c4bae9e304a4"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:46:17.077490 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-b09bf184-6180-41ce-82b0-1af5de9ec2e1 req-f3f89de8-e971-404f-9fb7-e7d960f34a0e service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:17.078370 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-b09bf184-6180-41ce-82b0-1af5de9ec2e1 req-f3f89de8-e971-404f-9fb7-e7d960f34a0e service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:17.079052 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-b09bf184-6180-41ce-82b0-1af5de9ec2e1 req-f3f89de8-e971-404f-9fb7-e7d960f34a0e service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:17.095070 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-b09bf184-6180-41ce-82b0-1af5de9ec2e1 req-f3f89de8-e971-404f-9fb7-e7d960f34a0e service nova] Creating event network-changed:076a121c-741e-46ac-a9c1-c4bae9e304a4 for instance fa47906d-d394-46fe-9143-780bcd27a715 on n-h1-851028-13 Oct 04 18:46:17.102842 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-b09bf184-6180-41ce-82b0-1af5de9ec2e1 req-f3f89de8-e971-404f-9fb7-e7d960f34a0e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064380 Oct 04 18:46:17.105272 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1871/3518] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:46:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:46:17.215743 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-5a790952-d92a-4dbe-9fc2-878cd69b02c1 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:17.217681 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-5a790952-d92a-4dbe-9fc2-878cd69b02c1 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] [instance: 00c17e4b-c80e-463e-a3e9-486c118552be] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:17.230735 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5a790952-d92a-4dbe-9fc2-878cd69b02c1 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:17.231535 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5a790952-d92a-4dbe-9fc2-878cd69b02c1 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:17.234891 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5a790952-d92a-4dbe-9fc2-878cd69b02c1 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:17.236491 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5a790952-d92a-4dbe-9fc2-878cd69b02c1 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:17.237505 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5a790952-d92a-4dbe-9fc2-878cd69b02c1 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:17.238193 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5a790952-d92a-4dbe-9fc2-878cd69b02c1 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:17.636863 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-d2fff470-5037-490f-9f4f-d2f2abbee7b3 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:46:17.640318 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-d2fff470-5037-490f-9f4f-d2f2abbee7b3 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: bb651218-4475-4df2-b470-56e737801e3b] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:17.669542 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d2fff470-5037-490f-9f4f-d2f2abbee7b3 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:17.670045 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d2fff470-5037-490f-9f4f-d2f2abbee7b3 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:17.670495 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d2fff470-5037-490f-9f4f-d2f2abbee7b3 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:17.671222 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d2fff470-5037-490f-9f4f-d2f2abbee7b3 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:17.671688 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d2fff470-5037-490f-9f4f-d2f2abbee7b3 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:17.672124 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d2fff470-5037-490f-9f4f-d2f2abbee7b3 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:17.758101 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-d2fff470-5037-490f-9f4f-d2f2abbee7b3 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "POST /compute/v2.1/servers/bb651218-4475-4df2-b470-56e737801e3b/action" status: 200 len: 14 microversion: 2.1 time: 0.125922 Oct 04 18:46:17.761575 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1872/3519] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 18:46:17 2022] POST /compute/v2.1/servers/bb651218-4475-4df2-b470-56e737801e3b/action => generated 14 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:46:17.888477 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-5d713981-178e-4392-b877-fe66e7bcc02c tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:17.889487 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-5d713981-178e-4392-b877-fe66e7bcc02c tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] [instance: fa47906d-d394-46fe-9143-780bcd27a715] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:17.905423 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5d713981-178e-4392-b877-fe66e7bcc02c tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:17.905927 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5d713981-178e-4392-b877-fe66e7bcc02c tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:17.906701 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5d713981-178e-4392-b877-fe66e7bcc02c tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:17.907498 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5d713981-178e-4392-b877-fe66e7bcc02c tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:17.907961 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5d713981-178e-4392-b877-fe66e7bcc02c tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:17.908398 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5d713981-178e-4392-b877-fe66e7bcc02c tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:17.950608 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-5a790952-d92a-4dbe-9fc2-878cd69b02c1 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c710f394164b89b16bcac2fe51c58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65037d4ea5124d749e42928032e803fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:17.961699 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-5a790952-d92a-4dbe-9fc2-878cd69b02c1 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] 10.222.0.43 "GET /compute/v2.1/servers/00c17e4b-c80e-463e-a3e9-486c118552be" status: 200 len: 1517 microversion: 2.1 time: 0.750167 Oct 04 18:46:17.970630 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1648/3520] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:17 2022] GET /compute/v2.1/servers/00c17e4b-c80e-463e-a3e9-486c118552be => generated 1517 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:18.467096 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-5d713981-178e-4392-b877-fe66e7bcc02c tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:18.479444 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-5d713981-178e-4392-b877-fe66e7bcc02c tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:18.487161 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-5d713981-178e-4392-b877-fe66e7bcc02c tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:18.493052 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-5d713981-178e-4392-b877-fe66e7bcc02c tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] 10.222.0.43 "GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715" status: 200 len: 1886 microversion: 2.32 time: 0.607995 Oct 04 18:46:18.520005 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1873/3521] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:46:17 2022] GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715 => generated 1886 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:46:18.770850 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-85346a1b-fa0e-46ba-9071-8afb58a00294 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:46:18.773656 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-85346a1b-fa0e-46ba-9071-8afb58a00294 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: bb651218-4475-4df2-b470-56e737801e3b] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:18.789713 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-85346a1b-fa0e-46ba-9071-8afb58a00294 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:18.790498 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-85346a1b-fa0e-46ba-9071-8afb58a00294 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:18.791138 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-85346a1b-fa0e-46ba-9071-8afb58a00294 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:18.792059 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-85346a1b-fa0e-46ba-9071-8afb58a00294 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:18.795153 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-85346a1b-fa0e-46ba-9071-8afb58a00294 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:18.795853 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-85346a1b-fa0e-46ba-9071-8afb58a00294 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:18.883512 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-85346a1b-fa0e-46ba-9071-8afb58a00294 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "POST /compute/v2.1/servers/bb651218-4475-4df2-b470-56e737801e3b/action" status: 200 len: 14 microversion: 2.1 time: 0.117394 Oct 04 18:46:18.884578 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1649/3522] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 18:46:18 2022] POST /compute/v2.1/servers/bb651218-4475-4df2-b470-56e737801e3b/action => generated 14 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:46:19.003705 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-7c0657cc-4ec8-4a6f-8b28-5ab416632b30 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:19.004476 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-7c0657cc-4ec8-4a6f-8b28-5ab416632b30 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] [instance: 00c17e4b-c80e-463e-a3e9-486c118552be] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:19.022633 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7c0657cc-4ec8-4a6f-8b28-5ab416632b30 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:19.026604 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7c0657cc-4ec8-4a6f-8b28-5ab416632b30 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:19.027318 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7c0657cc-4ec8-4a6f-8b28-5ab416632b30 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:19.032915 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7c0657cc-4ec8-4a6f-8b28-5ab416632b30 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:19.034449 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7c0657cc-4ec8-4a6f-8b28-5ab416632b30 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:19.036303 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7c0657cc-4ec8-4a6f-8b28-5ab416632b30 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:19.455709 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-7c0657cc-4ec8-4a6f-8b28-5ab416632b30 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c710f394164b89b16bcac2fe51c58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65037d4ea5124d749e42928032e803fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:19.465224 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-7c0657cc-4ec8-4a6f-8b28-5ab416632b30 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] 10.222.0.43 "GET /compute/v2.1/servers/00c17e4b-c80e-463e-a3e9-486c118552be" status: 200 len: 1517 microversion: 2.1 time: 0.468311 Oct 04 18:46:19.466583 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1874/3523] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:18 2022] GET /compute/v2.1/servers/00c17e4b-c80e-463e-a3e9-486c118552be => generated 1517 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:19.527349 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-a4612edd-dd9f-469a-a347-eb5741d3e3a2 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:19.528338 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-a4612edd-dd9f-469a-a347-eb5741d3e3a2 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] [instance: fa47906d-d394-46fe-9143-780bcd27a715] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:19.543398 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a4612edd-dd9f-469a-a347-eb5741d3e3a2 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:19.544867 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a4612edd-dd9f-469a-a347-eb5741d3e3a2 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:19.546939 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a4612edd-dd9f-469a-a347-eb5741d3e3a2 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:19.549710 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a4612edd-dd9f-469a-a347-eb5741d3e3a2 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:19.551644 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a4612edd-dd9f-469a-a347-eb5741d3e3a2 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:19.553702 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a4612edd-dd9f-469a-a347-eb5741d3e3a2 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:19.832820 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-602caac6-d206-4251-9ecf-47d9e2430721 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1511871268", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452", "networks": [{"uuid": "9a73c20c-974b-45c7-afb7-3b01737eb50f"}]}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:46:19.991403 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.network.neutron [None req-602caac6-d206-4251-9ecf-47d9e2430721 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] validate_networks() for [('9a73c20c-974b-45c7-afb7-3b01737eb50f', None, None, None, None, None)] {{(pid=123596) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:46:20.042896 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-a4612edd-dd9f-469a-a347-eb5741d3e3a2 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:20.058782 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-a4612edd-dd9f-469a-a347-eb5741d3e3a2 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:20.067799 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-a4612edd-dd9f-469a-a347-eb5741d3e3a2 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:20.089585 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-a4612edd-dd9f-469a-a347-eb5741d3e3a2 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] 10.222.0.43 "GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715" status: 200 len: 1886 microversion: 2.32 time: 0.549987 Oct 04 18:46:20.092681 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1650/3524] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:46:19 2022] GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715 => generated 1886 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:46:20.111544 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-f38c1b5c-ad04-4762-9ec9-56df1a61efaf tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:46:20.115876 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-f38c1b5c-ad04-4762-9ec9-56df1a61efaf tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: bb651218-4475-4df2-b470-56e737801e3b] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:20.141861 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f38c1b5c-ad04-4762-9ec9-56df1a61efaf tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:20.142942 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f38c1b5c-ad04-4762-9ec9-56df1a61efaf tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:20.143731 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f38c1b5c-ad04-4762-9ec9-56df1a61efaf tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:20.147476 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f38c1b5c-ad04-4762-9ec9-56df1a61efaf tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:20.148496 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f38c1b5c-ad04-4762-9ec9-56df1a61efaf tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:20.149306 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f38c1b5c-ad04-4762-9ec9-56df1a61efaf tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:20.229342 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-f38c1b5c-ad04-4762-9ec9-56df1a61efaf tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "POST /compute/v2.1/servers/bb651218-4475-4df2-b470-56e737801e3b/action" status: 200 len: 14 microversion: 2.1 time: 0.134826 Oct 04 18:46:20.233475 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1651/3525] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 18:46:20 2022] POST /compute/v2.1/servers/bb651218-4475-4df2-b470-56e737801e3b/action => generated 14 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:46:20.495325 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-18194361-1d89-462f-b4d8-c06f7aa03588 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:20.496050 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-18194361-1d89-462f-b4d8-c06f7aa03588 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] [instance: 00c17e4b-c80e-463e-a3e9-486c118552be] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:20.514603 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-18194361-1d89-462f-b4d8-c06f7aa03588 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:20.516056 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-18194361-1d89-462f-b4d8-c06f7aa03588 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:20.517425 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-18194361-1d89-462f-b4d8-c06f7aa03588 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:20.520610 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-18194361-1d89-462f-b4d8-c06f7aa03588 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:20.521923 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-18194361-1d89-462f-b4d8-c06f7aa03588 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:20.523732 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-18194361-1d89-462f-b4d8-c06f7aa03588 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:20.850313 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-602caac6-d206-4251-9ecf-47d9e2430721 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Flavor limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:46:20.851150 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-602caac6-d206-4251-9ecf-47d9e2430721 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Image limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:46:20.851296 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-602caac6-d206-4251-9ecf-47d9e2430721 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Flavor pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:46:20.851618 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-602caac6-d206-4251-9ecf-47d9e2430721 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Image pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:46:20.852263 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-602caac6-d206-4251-9ecf-47d9e2430721 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:46:20.871416 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-602caac6-d206-4251-9ecf-47d9e2430721 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:20.871913 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-602caac6-d206-4251-9ecf-47d9e2430721 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:20.872363 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-602caac6-d206-4251-9ecf-47d9e2430721 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:20.873126 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-602caac6-d206-4251-9ecf-47d9e2430721 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:20.877292 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-602caac6-d206-4251-9ecf-47d9e2430721 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:20.877762 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-602caac6-d206-4251-9ecf-47d9e2430721 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:20.931212 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-602caac6-d206-4251-9ecf-47d9e2430721 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Getting quotas for project 8ab4da2b9b9f4c7a9c25b7edaab3027d. Resources: {'ram', 'cores', 'instances'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:46:20.940818 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-602caac6-d206-4251-9ecf-47d9e2430721 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Getting quotas for user cdcbf2b4b95743af9e6fa1be54554baa and project 8ab4da2b9b9f4c7a9c25b7edaab3027d. Resources: {'ram', 'cores', 'instances'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:46:20.981052 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-602caac6-d206-4251-9ecf-47d9e2430721 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Going to run 1 instances... {{(pid=123596) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:46:20.990696 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-602caac6-d206-4251-9ecf-47d9e2430721 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] [instance: 9886f261-8e00-4908-8fd8-f6ce9c6fd5b4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e8943ec5-4038-4d4b-b9b9-2415a79f5243',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123596) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:46:21.077791 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-602caac6-d206-4251-9ecf-47d9e2430721 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.353285 Oct 04 18:46:21.080026 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1875/3526] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 18:46:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 1357 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:46:21.088562 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-20ad604d-eb8c-4d20-aa2b-dddd1bd1c82a req-9a292c0c-ba2c-4777-b2f5-71d42b75c51d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa47906d-d394-46fe-9143-780bcd27a715", "tag": "f2b979d5-599c-4c02-8f73-2a3d8e34cd17"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:46:21.121693 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-20ad604d-eb8c-4d20-aa2b-dddd1bd1c82a req-9a292c0c-ba2c-4777-b2f5-71d42b75c51d service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:21.122729 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-20ad604d-eb8c-4d20-aa2b-dddd1bd1c82a req-9a292c0c-ba2c-4777-b2f5-71d42b75c51d service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:21.123895 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-20ad604d-eb8c-4d20-aa2b-dddd1bd1c82a req-9a292c0c-ba2c-4777-b2f5-71d42b75c51d service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:21.145918 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-20ad604d-eb8c-4d20-aa2b-dddd1bd1c82a req-9a292c0c-ba2c-4777-b2f5-71d42b75c51d service nova] Creating event network-changed:f2b979d5-599c-4c02-8f73-2a3d8e34cd17 for instance fa47906d-d394-46fe-9143-780bcd27a715 on n-h1-851028-13 Oct 04 18:46:21.196703 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-20ad604d-eb8c-4d20-aa2b-dddd1bd1c82a req-9a292c0c-ba2c-4777-b2f5-71d42b75c51d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105465 Oct 04 18:46:21.198711 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1876/3527] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:46:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:46:21.215410 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-b0b419c2-008b-489e-96d7-a3309a6d7648 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:21.216591 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-b0b419c2-008b-489e-96d7-a3309a6d7648 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] [instance: 9886f261-8e00-4908-8fd8-f6ce9c6fd5b4] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:21.326664 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-b0b419c2-008b-489e-96d7-a3309a6d7648 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcbf2b4b95743af9e6fa1be54554baa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab4da2b9b9f4c7a9c25b7edaab3027d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:21.335463 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-b0b419c2-008b-489e-96d7-a3309a6d7648 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] 10.222.0.43 "GET /compute/v2.1/servers/9886f261-8e00-4908-8fd8-f6ce9c6fd5b4" status: 200 len: 1225 microversion: 2.1 time: 0.134637 Oct 04 18:46:21.338347 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1877/3528] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:21 2022] GET /compute/v2.1/servers/9886f261-8e00-4908-8fd8-f6ce9c6fd5b4 => generated 1225 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:21.343677 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-db8396d0-f48a-42d3-b41f-edb7488bfe11 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:21.345298 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-db8396d0-f48a-42d3-b41f-edb7488bfe11 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] [instance: fa47906d-d394-46fe-9143-780bcd27a715] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:21.352147 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-db8396d0-f48a-42d3-b41f-edb7488bfe11 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:21.353020 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-db8396d0-f48a-42d3-b41f-edb7488bfe11 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:21.353734 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-db8396d0-f48a-42d3-b41f-edb7488bfe11 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:21.354846 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-db8396d0-f48a-42d3-b41f-edb7488bfe11 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:21.355576 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-db8396d0-f48a-42d3-b41f-edb7488bfe11 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:21.356241 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-db8396d0-f48a-42d3-b41f-edb7488bfe11 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:21.542390 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-18194361-1d89-462f-b4d8-c06f7aa03588 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c710f394164b89b16bcac2fe51c58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65037d4ea5124d749e42928032e803fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:21.551261 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-18194361-1d89-462f-b4d8-c06f7aa03588 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] 10.222.0.43 "GET /compute/v2.1/servers/00c17e4b-c80e-463e-a3e9-486c118552be" status: 200 len: 1517 microversion: 2.1 time: 1.060381 Oct 04 18:46:21.555054 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1652/3529] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:20 2022] GET /compute/v2.1/servers/00c17e4b-c80e-463e-a3e9-486c118552be => generated 1517 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:21.567082 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-f7509505-3cd8-47c8-96b5-90e1b8c159cd tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:46:21.573157 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-f7509505-3cd8-47c8-96b5-90e1b8c159cd tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: bb651218-4475-4df2-b470-56e737801e3b] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:21.586876 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f7509505-3cd8-47c8-96b5-90e1b8c159cd tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:21.589803 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f7509505-3cd8-47c8-96b5-90e1b8c159cd tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:21.590436 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f7509505-3cd8-47c8-96b5-90e1b8c159cd tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:21.596023 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f7509505-3cd8-47c8-96b5-90e1b8c159cd tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:21.596528 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f7509505-3cd8-47c8-96b5-90e1b8c159cd tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:21.596970 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f7509505-3cd8-47c8-96b5-90e1b8c159cd tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:21.692282 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-f7509505-3cd8-47c8-96b5-90e1b8c159cd tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "POST /compute/v2.1/servers/bb651218-4475-4df2-b470-56e737801e3b/action" status: 200 len: 8205 microversion: 2.1 time: 0.135884 Oct 04 18:46:21.697858 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1653/3530] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 18:46:21 2022] POST /compute/v2.1/servers/bb651218-4475-4df2-b470-56e737801e3b/action => generated 8205 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:21.703963 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-796a2037-7faa-4d29-9650-f497bc11c177 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:21.706812 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-796a2037-7faa-4d29-9650-f497bc11c177 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 82b86465-afb0-49ef-9932-1538010c1ae5] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:21.721944 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-796a2037-7faa-4d29-9650-f497bc11c177 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:21.729460 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-796a2037-7faa-4d29-9650-f497bc11c177 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:21.730176 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-796a2037-7faa-4d29-9650-f497bc11c177 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:21.731045 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-db8396d0-f48a-42d3-b41f-edb7488bfe11 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:21.731351 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-796a2037-7faa-4d29-9650-f497bc11c177 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:21.731996 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-796a2037-7faa-4d29-9650-f497bc11c177 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:21.732592 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-796a2037-7faa-4d29-9650-f497bc11c177 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:21.741958 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-db8396d0-f48a-42d3-b41f-edb7488bfe11 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:21.754431 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-db8396d0-f48a-42d3-b41f-edb7488bfe11 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:21.755863 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-db8396d0-f48a-42d3-b41f-edb7488bfe11 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] 10.222.0.43 "GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715" status: 200 len: 1886 microversion: 2.32 time: 0.416190 Oct 04 18:46:21.756817 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1878/3531] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:46:21 2022] GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715 => generated 1886 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:46:21.781728 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=100 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:46:22.363007 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-1c12e56a-5e6b-4b97-8b65-fa7e33916a9c tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:22.365484 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-1c12e56a-5e6b-4b97-8b65-fa7e33916a9c tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] [instance: 9886f261-8e00-4908-8fd8-f6ce9c6fd5b4] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:22.374241 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1c12e56a-5e6b-4b97-8b65-fa7e33916a9c tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:22.375081 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1c12e56a-5e6b-4b97-8b65-fa7e33916a9c tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:22.375844 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1c12e56a-5e6b-4b97-8b65-fa7e33916a9c tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:22.376827 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1c12e56a-5e6b-4b97-8b65-fa7e33916a9c tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:22.377766 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1c12e56a-5e6b-4b97-8b65-fa7e33916a9c tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:22.380884 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1c12e56a-5e6b-4b97-8b65-fa7e33916a9c tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:22.561720 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-1c12e56a-5e6b-4b97-8b65-fa7e33916a9c tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcbf2b4b95743af9e6fa1be54554baa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab4da2b9b9f4c7a9c25b7edaab3027d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:22.591173 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-1c12e56a-5e6b-4b97-8b65-fa7e33916a9c tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] 10.222.0.43 "GET /compute/v2.1/servers/9886f261-8e00-4908-8fd8-f6ce9c6fd5b4" status: 200 len: 1221 microversion: 2.1 time: 0.234785 Oct 04 18:46:22.593102 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1879/3532] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:22 2022] GET /compute/v2.1/servers/9886f261-8e00-4908-8fd8-f6ce9c6fd5b4 => generated 1221 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:46:22.603474 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-7aae0786-096b-4fbb-94d3-b8ed1f3b86a6 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:22.604900 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-7aae0786-096b-4fbb-94d3-b8ed1f3b86a6 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] [instance: 00c17e4b-c80e-463e-a3e9-486c118552be] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:22.634343 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7aae0786-096b-4fbb-94d3-b8ed1f3b86a6 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:22.634964 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7aae0786-096b-4fbb-94d3-b8ed1f3b86a6 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:22.635516 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7aae0786-096b-4fbb-94d3-b8ed1f3b86a6 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:22.636722 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7aae0786-096b-4fbb-94d3-b8ed1f3b86a6 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:22.637325 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7aae0786-096b-4fbb-94d3-b8ed1f3b86a6 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:22.637947 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7aae0786-096b-4fbb-94d3-b8ed1f3b86a6 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:22.649268 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-796a2037-7faa-4d29-9650-f497bc11c177 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:22.670878 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-796a2037-7faa-4d29-9650-f497bc11c177 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5" status: 200 len: 1667 microversion: 2.1 time: 0.971505 Oct 04 18:46:22.672309 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1654/3533] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:21 2022] GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5 => generated 1667 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:22.703531 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-c8163437-7fbb-46cc-b8ff-065c47a53e71 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:22.704014 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-c8163437-7fbb-46cc-b8ff-065c47a53e71 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 82b86465-afb0-49ef-9932-1538010c1ae5] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:22.725026 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c8163437-7fbb-46cc-b8ff-065c47a53e71 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:22.728215 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c8163437-7fbb-46cc-b8ff-065c47a53e71 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:22.728684 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c8163437-7fbb-46cc-b8ff-065c47a53e71 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:22.731649 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c8163437-7fbb-46cc-b8ff-065c47a53e71 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:22.732331 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c8163437-7fbb-46cc-b8ff-065c47a53e71 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:22.732837 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c8163437-7fbb-46cc-b8ff-065c47a53e71 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:23.053555 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-7aae0786-096b-4fbb-94d3-b8ed1f3b86a6 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c710f394164b89b16bcac2fe51c58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65037d4ea5124d749e42928032e803fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:23.079517 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-7aae0786-096b-4fbb-94d3-b8ed1f3b86a6 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] 10.222.0.43 "GET /compute/v2.1/servers/00c17e4b-c80e-463e-a3e9-486c118552be" status: 200 len: 1517 microversion: 2.1 time: 0.484881 Oct 04 18:46:23.080819 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1880/3534] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:22 2022] GET /compute/v2.1/servers/00c17e4b-c80e-463e-a3e9-486c118552be => generated 1517 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:23.091567 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-ed54bd6c-cec5-4e4f-85de-5cb62b33504c tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:23.092518 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-ed54bd6c-cec5-4e4f-85de-5cb62b33504c tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] [instance: fa47906d-d394-46fe-9143-780bcd27a715] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:23.106656 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ed54bd6c-cec5-4e4f-85de-5cb62b33504c tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:23.107684 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ed54bd6c-cec5-4e4f-85de-5cb62b33504c tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:23.108358 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ed54bd6c-cec5-4e4f-85de-5cb62b33504c tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:23.109372 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ed54bd6c-cec5-4e4f-85de-5cb62b33504c tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:23.115458 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ed54bd6c-cec5-4e4f-85de-5cb62b33504c tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:23.116171 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ed54bd6c-cec5-4e4f-85de-5cb62b33504c tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:23.245608 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-c8163437-7fbb-46cc-b8ff-065c47a53e71 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:23.256649 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-c8163437-7fbb-46cc-b8ff-065c47a53e71 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5" status: 200 len: 1667 microversion: 2.1 time: 0.556994 Oct 04 18:46:23.258485 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1655/3535] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:22 2022] GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5 => generated 1667 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:46:23.282537 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-48e93f84-ed82-4e5b-9e40-7f6a0604992b tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:23.283521 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-48e93f84-ed82-4e5b-9e40-7f6a0604992b tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 82b86465-afb0-49ef-9932-1538010c1ae5] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:23.294097 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-48e93f84-ed82-4e5b-9e40-7f6a0604992b tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:23.294980 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-48e93f84-ed82-4e5b-9e40-7f6a0604992b tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:23.296472 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-48e93f84-ed82-4e5b-9e40-7f6a0604992b tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:23.297507 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-48e93f84-ed82-4e5b-9e40-7f6a0604992b tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:23.300824 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-48e93f84-ed82-4e5b-9e40-7f6a0604992b tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:23.301550 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-48e93f84-ed82-4e5b-9e40-7f6a0604992b tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:23.835050 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-ed54bd6c-cec5-4e4f-85de-5cb62b33504c tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:23.853959 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-ed54bd6c-cec5-4e4f-85de-5cb62b33504c tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:23.855801 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-ed54bd6c-cec5-4e4f-85de-5cb62b33504c tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:23.857251 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-ed54bd6c-cec5-4e4f-85de-5cb62b33504c tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] 10.222.0.43 "GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715" status: 200 len: 1886 microversion: 2.32 time: 0.775187 Oct 04 18:46:23.862460 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1881/3536] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:46:23 2022] GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715 => generated 1886 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:46:23.872233 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-a6219da3-7369-419c-ae53-f3ef984dc12f tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:23.872885 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-a6219da3-7369-419c-ae53-f3ef984dc12f tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] [instance: 9886f261-8e00-4908-8fd8-f6ce9c6fd5b4] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:23.885173 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a6219da3-7369-419c-ae53-f3ef984dc12f tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:23.885619 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a6219da3-7369-419c-ae53-f3ef984dc12f tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:23.886063 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a6219da3-7369-419c-ae53-f3ef984dc12f tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:23.886790 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a6219da3-7369-419c-ae53-f3ef984dc12f tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:23.887211 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a6219da3-7369-419c-ae53-f3ef984dc12f tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:23.887641 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a6219da3-7369-419c-ae53-f3ef984dc12f tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:24.111193 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-a6219da3-7369-419c-ae53-f3ef984dc12f tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcbf2b4b95743af9e6fa1be54554baa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab4da2b9b9f4c7a9c25b7edaab3027d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:24.120711 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-a6219da3-7369-419c-ae53-f3ef984dc12f tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] 10.222.0.43 "GET /compute/v2.1/servers/9886f261-8e00-4908-8fd8-f6ce9c6fd5b4" status: 200 len: 1283 microversion: 2.1 time: 0.256144 Oct 04 18:46:24.137156 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1882/3537] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:23 2022] GET /compute/v2.1/servers/9886f261-8e00-4908-8fd8-f6ce9c6fd5b4 => generated 1283 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:24.137481 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-48e93f84-ed82-4e5b-9e40-7f6a0604992b tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:24.138565 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-0eda7344-b69e-4236-a468-c6aa0dfc57a2 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:24.139196 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-0eda7344-b69e-4236-a468-c6aa0dfc57a2 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] [instance: 00c17e4b-c80e-463e-a3e9-486c118552be] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:24.154764 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-48e93f84-ed82-4e5b-9e40-7f6a0604992b tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5" status: 200 len: 1667 microversion: 2.1 time: 0.871665 Oct 04 18:46:24.158087 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1656/3538] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:23 2022] GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5 => generated 1667 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:24.173372 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0eda7344-b69e-4236-a468-c6aa0dfc57a2 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:24.173962 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0eda7344-b69e-4236-a468-c6aa0dfc57a2 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:24.174424 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0eda7344-b69e-4236-a468-c6aa0dfc57a2 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:24.175174 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0eda7344-b69e-4236-a468-c6aa0dfc57a2 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:24.175632 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0eda7344-b69e-4236-a468-c6aa0dfc57a2 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:24.176676 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0eda7344-b69e-4236-a468-c6aa0dfc57a2 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:24.179014 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-9339d14c-732e-42a6-a283-de228e1980e4 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:24.179703 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-9339d14c-732e-42a6-a283-de228e1980e4 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 82b86465-afb0-49ef-9932-1538010c1ae5] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:24.200223 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9339d14c-732e-42a6-a283-de228e1980e4 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:24.200734 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9339d14c-732e-42a6-a283-de228e1980e4 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:24.206960 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9339d14c-732e-42a6-a283-de228e1980e4 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:24.207841 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9339d14c-732e-42a6-a283-de228e1980e4 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:24.208333 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9339d14c-732e-42a6-a283-de228e1980e4 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:24.211782 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9339d14c-732e-42a6-a283-de228e1980e4 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:24.619089 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-0eda7344-b69e-4236-a468-c6aa0dfc57a2 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c710f394164b89b16bcac2fe51c58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65037d4ea5124d749e42928032e803fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:24.626716 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:46:24.634994 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-0eda7344-b69e-4236-a468-c6aa0dfc57a2 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] 10.222.0.43 "GET /compute/v2.1/servers/00c17e4b-c80e-463e-a3e9-486c118552be" status: 200 len: 1517 microversion: 2.1 time: 0.508392 Oct 04 18:46:24.641975 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1883/3539] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:24 2022] GET /compute/v2.1/servers/00c17e4b-c80e-463e-a3e9-486c118552be => generated 1517 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:24.679912 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-9339d14c-732e-42a6-a283-de228e1980e4 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:24.695704 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-9339d14c-732e-42a6-a283-de228e1980e4 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5" status: 200 len: 1667 microversion: 2.1 time: 0.521263 Oct 04 18:46:24.696992 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1657/3540] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:24 2022] GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5 => generated 1667 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:24.725171 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-8aa3e051-b7c2-4831-9bac-49672aa9fbd3 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:46:24.725826 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-8aa3e051-b7c2-4831-9bac-49672aa9fbd3 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 82b86465-afb0-49ef-9932-1538010c1ae5] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:24.740669 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8aa3e051-b7c2-4831-9bac-49672aa9fbd3 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:24.741245 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8aa3e051-b7c2-4831-9bac-49672aa9fbd3 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:24.745906 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8aa3e051-b7c2-4831-9bac-49672aa9fbd3 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:24.747915 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8aa3e051-b7c2-4831-9bac-49672aa9fbd3 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:24.748436 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8aa3e051-b7c2-4831-9bac-49672aa9fbd3 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:24.750587 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8aa3e051-b7c2-4831-9bac-49672aa9fbd3 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:24.870818 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-d8de8dd6-8b42-4ae2-93fc-199c36116eb1 req-2007c369-07ca-45cf-ac95-612557cc2370 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa47906d-d394-46fe-9143-780bcd27a715", "tag": "c894730c-7cbc-41ef-a7b9-c9eb574e1489"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:46:24.892773 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-8aa3e051-b7c2-4831-9bac-49672aa9fbd3 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 82b86465-afb0-49ef-9932-1538010c1ae5] Locking {{(pid=123596) lock /opt/stack/nova/nova/compute/api.py:4845}} Oct 04 18:46:24.899862 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-d8de8dd6-8b42-4ae2-93fc-199c36116eb1 req-2007c369-07ca-45cf-ac95-612557cc2370 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:24.901338 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-d8de8dd6-8b42-4ae2-93fc-199c36116eb1 req-2007c369-07ca-45cf-ac95-612557cc2370 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:24.902692 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-d8de8dd6-8b42-4ae2-93fc-199c36116eb1 req-2007c369-07ca-45cf-ac95-612557cc2370 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:24.944978 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-d8de8dd6-8b42-4ae2-93fc-199c36116eb1 req-2007c369-07ca-45cf-ac95-612557cc2370 service nova] Creating event network-changed:c894730c-7cbc-41ef-a7b9-c9eb574e1489 for instance fa47906d-d394-46fe-9143-780bcd27a715 on n-h1-851028-13 Oct 04 18:46:24.952464 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-d8de8dd6-8b42-4ae2-93fc-199c36116eb1 req-2007c369-07ca-45cf-ac95-612557cc2370 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085271 Oct 04 18:46:24.954650 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1658/3541] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:46:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:46:24.966424 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-d2a6c112-1af2-44fd-869b-ab7d10abceb5 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:24.968530 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-d2a6c112-1af2-44fd-869b-ab7d10abceb5 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] [instance: fa47906d-d394-46fe-9143-780bcd27a715] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:24.978370 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d2a6c112-1af2-44fd-869b-ab7d10abceb5 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:24.979459 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d2a6c112-1af2-44fd-869b-ab7d10abceb5 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:24.980250 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d2a6c112-1af2-44fd-869b-ab7d10abceb5 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:24.981232 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d2a6c112-1af2-44fd-869b-ab7d10abceb5 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:24.988585 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d2a6c112-1af2-44fd-869b-ab7d10abceb5 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:24.993135 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d2a6c112-1af2-44fd-869b-ab7d10abceb5 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:25.049623 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-8aa3e051-b7c2-4831-9bac-49672aa9fbd3 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "POST /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5/action" status: 202 len: 0 microversion: 2.1 time: 0.327897 Oct 04 18:46:25.053302 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1884/3542] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 18:46:24 2022] POST /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5/action => generated 0 bytes in 331 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:46:25.060752 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-2270482f-3f26-464c-8980-512587ca3302 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:25.061862 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-2270482f-3f26-464c-8980-512587ca3302 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 82b86465-afb0-49ef-9932-1538010c1ae5] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:25.079194 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2270482f-3f26-464c-8980-512587ca3302 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:25.080009 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2270482f-3f26-464c-8980-512587ca3302 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:25.080694 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2270482f-3f26-464c-8980-512587ca3302 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:25.081713 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2270482f-3f26-464c-8980-512587ca3302 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:25.082374 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2270482f-3f26-464c-8980-512587ca3302 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:25.083004 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2270482f-3f26-464c-8980-512587ca3302 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:25.659982 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-2270482f-3f26-464c-8980-512587ca3302 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:25.673167 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-2270482f-3f26-464c-8980-512587ca3302 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5" status: 200 len: 1667 microversion: 2.1 time: 0.615890 Oct 04 18:46:25.692494 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1885/3543] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:25 2022] GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5 => generated 1667 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:25.692494 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-2040cf94-f679-42e3-837a-78cc241c4c96 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:25.692494 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-2040cf94-f679-42e3-837a-78cc241c4c96 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] [instance: 9886f261-8e00-4908-8fd8-f6ce9c6fd5b4] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:25.708991 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2040cf94-f679-42e3-837a-78cc241c4c96 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:25.709916 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2040cf94-f679-42e3-837a-78cc241c4c96 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:25.710656 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2040cf94-f679-42e3-837a-78cc241c4c96 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:25.715821 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2040cf94-f679-42e3-837a-78cc241c4c96 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:25.727759 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2040cf94-f679-42e3-837a-78cc241c4c96 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:25.734065 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2040cf94-f679-42e3-837a-78cc241c4c96 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:25.835716 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-d2a6c112-1af2-44fd-869b-ab7d10abceb5 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:25.852455 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-d2a6c112-1af2-44fd-869b-ab7d10abceb5 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:25.870989 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-d2a6c112-1af2-44fd-869b-ab7d10abceb5 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:25.872332 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-d2a6c112-1af2-44fd-869b-ab7d10abceb5 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] 10.222.0.43 "GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715" status: 200 len: 1886 microversion: 2.32 time: 0.914199 Oct 04 18:46:25.877501 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1659/3544] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:46:24 2022] GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715 => generated 1886 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:46:25.882805 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-91dcd3c9-6fb3-47a5-8aca-1783e0ffced4 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:25.894700 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-91dcd3c9-6fb3-47a5-8aca-1783e0ffced4 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] [instance: 00c17e4b-c80e-463e-a3e9-486c118552be] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:25.911535 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_api:SELECT=81 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:46:25.942996 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-91dcd3c9-6fb3-47a5-8aca-1783e0ffced4 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:25.945428 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-91dcd3c9-6fb3-47a5-8aca-1783e0ffced4 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:25.946893 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-91dcd3c9-6fb3-47a5-8aca-1783e0ffced4 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:25.948624 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-91dcd3c9-6fb3-47a5-8aca-1783e0ffced4 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:25.949419 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-91dcd3c9-6fb3-47a5-8aca-1783e0ffced4 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:25.950103 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-91dcd3c9-6fb3-47a5-8aca-1783e0ffced4 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:26.739313 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-2040cf94-f679-42e3-837a-78cc241c4c96 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcbf2b4b95743af9e6fa1be54554baa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab4da2b9b9f4c7a9c25b7edaab3027d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:26.758718 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-2040cf94-f679-42e3-837a-78cc241c4c96 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] 10.222.0.43 "GET /compute/v2.1/servers/9886f261-8e00-4908-8fd8-f6ce9c6fd5b4" status: 200 len: 1283 microversion: 2.1 time: 1.075455 Oct 04 18:46:26.760805 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1886/3545] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:25 2022] GET /compute/v2.1/servers/9886f261-8e00-4908-8fd8-f6ce9c6fd5b4 => generated 1283 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:26.774609 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-20e63845-d513-49ba-a82c-d59574aa831a tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:46:26.794775 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-20e63845-d513-49ba-a82c-d59574aa831a tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:26.798467 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-20e63845-d513-49ba-a82c-d59574aa831a tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:26.799114 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-20e63845-d513-49ba-a82c-d59574aa831a tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:26.829705 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-20e63845-d513-49ba-a82c-d59574aa831a tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] HTTP exception thrown: Instance 82b86465-afb0-49ef-9932-1538010c1ae5 is locked Oct 04 18:46:26.831597 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-20e63845-d513-49ba-a82c-d59574aa831a tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Request method failure captured: Oct 04 18:46:26.831597 n-d-851028-13 devstack@n-api.service[123596]: request: POST /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5/action HTTP/1.1 Oct 04 18:46:26.831597 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:46:26.831597 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:46:26.831597 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:46:26.831597 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 15 Oct 04 18:46:26.831597 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:46:26.831597 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:46:26.831597 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:46:26.831597 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:46:26.831597 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPH5Y8VwBda5zUzX7ascLTB3Qbosoo60vZOoFyoP9LMQR5mhyf58gwOhX5OQ1_45choDiQHF8u029lzYPJiPJTmy12iHuGw0ye25qipylbXQG76rB007_6q71vYweTO_w2ZGSDLwZR6h4S4zanUtwJXkJkZX2y1e-onEmHtUGHW_6bUQ Oct 04 18:46:26.831597 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:46:26.831597 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:46:26.831597 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:46:26.831597 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:46:26.831597 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:46:26.831597 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:46:26.831597 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: b928ae7385da4599bbe0ea701681b233 Oct 04 18:46:26.831597 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-ServerActionsTestJSON-1452535557 Oct 04 18:46:26.831597 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 18:46:26.831597 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 18:46:26.831597 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/b928ae7385da4599bbe0ea701681b233"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_b928ae7385da4599bbe0ea701681b233"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b928ae7385da4599bbe0ea701681b233"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b928ae7385da4599bbe0ea701681b233"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:46:26.831597 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-ServerActionsTestJSON-1452535557 Oct 04 18:46:26.831597 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: b928ae7385da4599bbe0ea701681b233 Oct 04 18:46:26.831597 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-ServerActionsTestJSON-1452535557 Oct 04 18:46:26.831597 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-ServerActionsTestJSON-1452535557-project Oct 04 18:46:26.831597 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:46:26.831597 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:46:26.831597 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 93c36c0802f4473f96d0721caa50374a Oct 04 18:46:26.831597 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-ServerActionsTestJSON-1452535557-project Oct 04 18:46:26.831597 n-d-851028-13 devstack@n-api.service[123596]: Oct 04 18:46:26.831597 n-d-851028-13 devstack@n-api.service[123596]: {"os-stop": {}} Oct 04 18:46:26.831597 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 18:46:26.831597 n-d-851028-13 devstack@n-api.service[123596]: exception: Instance 82b86465-afb0-49ef-9932-1538010c1ae5 is locked Oct 04 18:46:26.831597 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': '82b86465-afb0-49ef-9932-1538010c1ae5', 'body': {'os-stop': {}}} Oct 04 18:46:26.831597 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:46:26.831597 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:46:26.831597 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1449, in _stop_server Oct 04 18:46:26.831597 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi self.compute_api.stop(context, instance) Oct 04 18:46:26.831597 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 240, in inner Oct 04 18:46:26.831597 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.InstanceIsLocked(instance_uuid=instance.uuid) Oct 04 18:46:26.831597 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceIsLocked: Instance 82b86465-afb0-49ef-9932-1538010c1ae5 is locked Oct 04 18:46:26.831597 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:46:26.831597 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:46:26.831597 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:46:26.831597 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:46:26.831597 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:46:26.831597 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:46:26.831597 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:46:26.831597 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:46:26.831597 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:46:26.831597 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:46:26.831597 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1451, in _stop_server Oct 04 18:46:26.831597 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=e.format_message()) Oct 04 18:46:26.831597 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Instance 82b86465-afb0-49ef-9932-1538010c1ae5 is locked Oct 04 18:46:26.831597 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:46:26.831597 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:46:26.831597 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:46:26.831597 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:46:26.831597 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:46:26.831597 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:46:26.831597 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:46:26.831597 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:46:26.831597 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 82b86465-afb0-49ef-9932-1538010c1ae5 is locked Oct 04 18:46:26.831597 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:46:26.837996 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-20e63845-d513-49ba-a82c-d59574aa831a tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Returning 409 to user: Instance 82b86465-afb0-49ef-9932-1538010c1ae5 is locked {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:46:26.839041 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-20e63845-d513-49ba-a82c-d59574aa831a tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "POST /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5/action" status: 409 len: 107 microversion: 2.1 time: 0.071522 Oct 04 18:46:26.840143 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1887/3546] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 18:46:26 2022] POST /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5/action => generated 107 bytes in 78 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:46:26.848799 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-00e8ef7e-ed8f-4972-9c67-5afa89ea7ab6 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:46:26.849886 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-00e8ef7e-ed8f-4972-9c67-5afa89ea7ab6 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 82b86465-afb0-49ef-9932-1538010c1ae5] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:26.858126 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-00e8ef7e-ed8f-4972-9c67-5afa89ea7ab6 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:26.858896 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-00e8ef7e-ed8f-4972-9c67-5afa89ea7ab6 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:26.860073 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-00e8ef7e-ed8f-4972-9c67-5afa89ea7ab6 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:26.860961 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-00e8ef7e-ed8f-4972-9c67-5afa89ea7ab6 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:26.861609 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-00e8ef7e-ed8f-4972-9c67-5afa89ea7ab6 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:26.862196 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-00e8ef7e-ed8f-4972-9c67-5afa89ea7ab6 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:26.945480 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-00e8ef7e-ed8f-4972-9c67-5afa89ea7ab6 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 82b86465-afb0-49ef-9932-1538010c1ae5] Unlocking {{(pid=123596) unlock /opt/stack/nova/nova/compute/api.py:4874}} Oct 04 18:46:27.073465 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-00e8ef7e-ed8f-4972-9c67-5afa89ea7ab6 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "POST /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5/action" status: 202 len: 0 microversion: 2.1 time: 0.228641 Oct 04 18:46:27.074950 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1888/3547] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 18:46:26 2022] POST /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5/action => generated 0 bytes in 231 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:46:27.089364 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-755bb5b3-d97d-45d4-ae5e-9d29ba296ac9 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:27.091537 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-755bb5b3-d97d-45d4-ae5e-9d29ba296ac9 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] [instance: fa47906d-d394-46fe-9143-780bcd27a715] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:27.099758 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-755bb5b3-d97d-45d4-ae5e-9d29ba296ac9 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:27.101655 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-755bb5b3-d97d-45d4-ae5e-9d29ba296ac9 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:27.102788 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-755bb5b3-d97d-45d4-ae5e-9d29ba296ac9 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:27.103947 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-755bb5b3-d97d-45d4-ae5e-9d29ba296ac9 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:27.104627 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-755bb5b3-d97d-45d4-ae5e-9d29ba296ac9 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:27.105276 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-755bb5b3-d97d-45d4-ae5e-9d29ba296ac9 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:27.721061 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-91dcd3c9-6fb3-47a5-8aca-1783e0ffced4 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c710f394164b89b16bcac2fe51c58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65037d4ea5124d749e42928032e803fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:27.741580 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-91dcd3c9-6fb3-47a5-8aca-1783e0ffced4 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] 10.222.0.43 "GET /compute/v2.1/servers/00c17e4b-c80e-463e-a3e9-486c118552be" status: 200 len: 1517 microversion: 2.1 time: 1.862517 Oct 04 18:46:27.742502 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1660/3548] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:25 2022] GET /compute/v2.1/servers/00c17e4b-c80e-463e-a3e9-486c118552be => generated 1517 bytes in 1864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:27.752280 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-72c3df34-ff4b-47db-908e-13c21197f910 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:46:27.770644 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-72c3df34-ff4b-47db-908e-13c21197f910 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:27.772008 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-72c3df34-ff4b-47db-908e-13c21197f910 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:27.774638 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-72c3df34-ff4b-47db-908e-13c21197f910 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:27.853253 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-72c3df34-ff4b-47db-908e-13c21197f910 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 82b86465-afb0-49ef-9932-1538010c1ae5] Going to try to stop instance {{(pid=123595) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 04 18:46:27.969789 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-72c3df34-ff4b-47db-908e-13c21197f910 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "POST /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5/action" status: 202 len: 0 microversion: 2.1 time: 0.221496 Oct 04 18:46:27.978318 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1661/3549] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 18:46:27 2022] POST /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5/action => generated 0 bytes in 235 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:46:27.997052 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-e8cd8638-1829-4eaa-9da4-1a821a8de23c tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:27.998693 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-e8cd8638-1829-4eaa-9da4-1a821a8de23c tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] [instance: 9886f261-8e00-4908-8fd8-f6ce9c6fd5b4] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:28.035529 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e8cd8638-1829-4eaa-9da4-1a821a8de23c tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:28.036042 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e8cd8638-1829-4eaa-9da4-1a821a8de23c tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:28.036494 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e8cd8638-1829-4eaa-9da4-1a821a8de23c tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:28.039618 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e8cd8638-1829-4eaa-9da4-1a821a8de23c tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:28.040702 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e8cd8638-1829-4eaa-9da4-1a821a8de23c tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:28.041837 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e8cd8638-1829-4eaa-9da4-1a821a8de23c tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:28.616586 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-755bb5b3-d97d-45d4-ae5e-9d29ba296ac9 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:28.644226 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-755bb5b3-d97d-45d4-ae5e-9d29ba296ac9 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:28.657567 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-755bb5b3-d97d-45d4-ae5e-9d29ba296ac9 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:28.658902 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-755bb5b3-d97d-45d4-ae5e-9d29ba296ac9 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] 10.222.0.43 "GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715" status: 200 len: 1886 microversion: 2.32 time: 1.582740 Oct 04 18:46:28.684055 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1889/3550] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:46:27 2022] GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715 => generated 1886 bytes in 1608 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:46:28.818158 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-e8cd8638-1829-4eaa-9da4-1a821a8de23c tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcbf2b4b95743af9e6fa1be54554baa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab4da2b9b9f4c7a9c25b7edaab3027d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:28.833570 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-e8cd8638-1829-4eaa-9da4-1a821a8de23c tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] 10.222.0.43 "GET /compute/v2.1/servers/9886f261-8e00-4908-8fd8-f6ce9c6fd5b4" status: 200 len: 1325 microversion: 2.1 time: 0.851759 Oct 04 18:46:28.842034 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1662/3551] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:27 2022] GET /compute/v2.1/servers/9886f261-8e00-4908-8fd8-f6ce9c6fd5b4 => generated 1325 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:28.856841 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-7d5004e8-a4e6-4ed7-8b2b-ce81b2c0bbd0 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:28.858259 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-7d5004e8-a4e6-4ed7-8b2b-ce81b2c0bbd0 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] [instance: 00c17e4b-c80e-463e-a3e9-486c118552be] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:28.882415 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7d5004e8-a4e6-4ed7-8b2b-ce81b2c0bbd0 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:28.904209 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7d5004e8-a4e6-4ed7-8b2b-ce81b2c0bbd0 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:28.904871 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7d5004e8-a4e6-4ed7-8b2b-ce81b2c0bbd0 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:28.910967 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7d5004e8-a4e6-4ed7-8b2b-ce81b2c0bbd0 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:28.911556 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7d5004e8-a4e6-4ed7-8b2b-ce81b2c0bbd0 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:28.911963 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7d5004e8-a4e6-4ed7-8b2b-ce81b2c0bbd0 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:28.997193 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-751734cc-078a-4c09-b553-d83b1d081f64 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:28.997822 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-751734cc-078a-4c09-b553-d83b1d081f64 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 82b86465-afb0-49ef-9932-1538010c1ae5] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:29.007050 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-751734cc-078a-4c09-b553-d83b1d081f64 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:29.007814 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-751734cc-078a-4c09-b553-d83b1d081f64 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:29.008453 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-751734cc-078a-4c09-b553-d83b1d081f64 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:29.010422 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-751734cc-078a-4c09-b553-d83b1d081f64 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:29.016363 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-751734cc-078a-4c09-b553-d83b1d081f64 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:29.017356 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-751734cc-078a-4c09-b553-d83b1d081f64 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:29.358938 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-7d5004e8-a4e6-4ed7-8b2b-ce81b2c0bbd0 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c710f394164b89b16bcac2fe51c58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65037d4ea5124d749e42928032e803fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:29.367682 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-7d5004e8-a4e6-4ed7-8b2b-ce81b2c0bbd0 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] 10.222.0.43 "GET /compute/v2.1/servers/00c17e4b-c80e-463e-a3e9-486c118552be" status: 200 len: 1517 microversion: 2.1 time: 0.522661 Oct 04 18:46:29.381467 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1663/3552] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:28 2022] GET /compute/v2.1/servers/00c17e4b-c80e-463e-a3e9-486c118552be => generated 1517 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:29.411146 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-751734cc-078a-4c09-b553-d83b1d081f64 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:29.421675 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-751734cc-078a-4c09-b553-d83b1d081f64 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5" status: 200 len: 1677 microversion: 2.1 time: 0.734649 Oct 04 18:46:29.434373 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1890/3553] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:28 2022] GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5 => generated 1677 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:29.690778 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-357d8b62-fc86-4bbc-8547-39732c6dc718 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:29.691543 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-357d8b62-fc86-4bbc-8547-39732c6dc718 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] [instance: fa47906d-d394-46fe-9143-780bcd27a715] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:29.698081 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-357d8b62-fc86-4bbc-8547-39732c6dc718 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:29.698810 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-357d8b62-fc86-4bbc-8547-39732c6dc718 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:29.708910 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-357d8b62-fc86-4bbc-8547-39732c6dc718 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:29.709702 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-357d8b62-fc86-4bbc-8547-39732c6dc718 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:29.710190 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-357d8b62-fc86-4bbc-8547-39732c6dc718 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:29.710638 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-357d8b62-fc86-4bbc-8547-39732c6dc718 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:29.779541 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-cd70174f-e166-4d0a-be81-d9990879c7a7 req-7a4f6332-1b7e-4fc6-b070-293aa883ec37 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa47906d-d394-46fe-9143-780bcd27a715", "tag": "11c4d4a8-fea9-4b92-8ccb-46013ebd8b06"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:46:29.811819 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-cd70174f-e166-4d0a-be81-d9990879c7a7 req-7a4f6332-1b7e-4fc6-b070-293aa883ec37 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:29.813272 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-cd70174f-e166-4d0a-be81-d9990879c7a7 req-7a4f6332-1b7e-4fc6-b070-293aa883ec37 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:29.813721 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-cd70174f-e166-4d0a-be81-d9990879c7a7 req-7a4f6332-1b7e-4fc6-b070-293aa883ec37 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:29.843554 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-cd70174f-e166-4d0a-be81-d9990879c7a7 req-7a4f6332-1b7e-4fc6-b070-293aa883ec37 service nova] Creating event network-changed:11c4d4a8-fea9-4b92-8ccb-46013ebd8b06 for instance fa47906d-d394-46fe-9143-780bcd27a715 on n-h1-851028-13 Oct 04 18:46:29.853817 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-cd70174f-e166-4d0a-be81-d9990879c7a7 req-7a4f6332-1b7e-4fc6-b070-293aa883ec37 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084469 Oct 04 18:46:29.854585 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1891/3554] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:46:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:46:29.869030 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-dce9c1ff-0cd2-41ac-af43-9f41ca55c03c tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:29.870765 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-dce9c1ff-0cd2-41ac-af43-9f41ca55c03c tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] [instance: 9886f261-8e00-4908-8fd8-f6ce9c6fd5b4] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:29.878792 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dce9c1ff-0cd2-41ac-af43-9f41ca55c03c tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:29.879592 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dce9c1ff-0cd2-41ac-af43-9f41ca55c03c tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:29.880423 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dce9c1ff-0cd2-41ac-af43-9f41ca55c03c tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:29.881733 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dce9c1ff-0cd2-41ac-af43-9f41ca55c03c tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:29.882205 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dce9c1ff-0cd2-41ac-af43-9f41ca55c03c tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:29.882640 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dce9c1ff-0cd2-41ac-af43-9f41ca55c03c tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:30.053033 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-dce9c1ff-0cd2-41ac-af43-9f41ca55c03c tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcbf2b4b95743af9e6fa1be54554baa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab4da2b9b9f4c7a9c25b7edaab3027d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:30.066171 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-dce9c1ff-0cd2-41ac-af43-9f41ca55c03c tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] 10.222.0.43 "GET /compute/v2.1/servers/9886f261-8e00-4908-8fd8-f6ce9c6fd5b4" status: 200 len: 1325 microversion: 2.1 time: 0.201288 Oct 04 18:46:30.066769 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1892/3555] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:29 2022] GET /compute/v2.1/servers/9886f261-8e00-4908-8fd8-f6ce9c6fd5b4 => generated 1325 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:30.071610 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-62dffdd6-1d6a-4370-a1c4-8f96178bc7d5 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:46:30.078029 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-62dffdd6-1d6a-4370-a1c4-8f96178bc7d5 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:30.078521 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-62dffdd6-1d6a-4370-a1c4-8f96178bc7d5 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:30.078961 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-62dffdd6-1d6a-4370-a1c4-8f96178bc7d5 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:30.101420 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-62dffdd6-1d6a-4370-a1c4-8f96178bc7d5 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] [instance: 76d475ab-f41c-44df-8aaa-10242bdbfcde] Going to try to stop instance {{(pid=123596) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 04 18:46:30.148088 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-62dffdd6-1d6a-4370-a1c4-8f96178bc7d5 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] 10.222.0.43 "POST /compute/v2.1/servers/76d475ab-f41c-44df-8aaa-10242bdbfcde/action" status: 202 len: 0 microversion: 2.1 time: 0.080069 Oct 04 18:46:30.148710 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1893/3556] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 18:46:30 2022] POST /compute/v2.1/servers/76d475ab-f41c-44df-8aaa-10242bdbfcde/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:46:30.154994 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f24abe51-3aed-4fc4-b5db-8528471e8cad tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1620364633", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "3b95df32-80ff-41d3-8ca9-09785472b92e"}], "block_device_mapping_v2": [{"uuid": "5d5e6453-6c99-48ca-855c-65f967d78aaa", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:46:30.221804 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.network.neutron [None req-f24abe51-3aed-4fc4-b5db-8528471e8cad tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] validate_networks() for [('3b95df32-80ff-41d3-8ca9-09785472b92e', None, None, None, None, None)] {{(pid=123596) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:46:30.360414 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-357d8b62-fc86-4bbc-8547-39732c6dc718 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:30.369954 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-357d8b62-fc86-4bbc-8547-39732c6dc718 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:30.371514 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-357d8b62-fc86-4bbc-8547-39732c6dc718 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:30.372890 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-357d8b62-fc86-4bbc-8547-39732c6dc718 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] 10.222.0.43 "GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715" status: 200 len: 1874 microversion: 2.32 time: 0.686815 Oct 04 18:46:30.386321 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1664/3557] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:46:29 2022] GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715 => generated 1874 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:46:30.399299 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-916fef36-5d4b-47bd-b264-116d9ee431bd tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:30.399924 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-916fef36-5d4b-47bd-b264-116d9ee431bd tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] [instance: 76d475ab-f41c-44df-8aaa-10242bdbfcde] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:30.406908 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-916fef36-5d4b-47bd-b264-116d9ee431bd tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:30.407330 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-916fef36-5d4b-47bd-b264-116d9ee431bd tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:30.407778 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-916fef36-5d4b-47bd-b264-116d9ee431bd tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:30.408482 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-916fef36-5d4b-47bd-b264-116d9ee431bd tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:30.408942 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-916fef36-5d4b-47bd-b264-116d9ee431bd tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:30.409395 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-916fef36-5d4b-47bd-b264-116d9ee431bd tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:30.648806 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-f24abe51-3aed-4fc4-b5db-8528471e8cad tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Flavor limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:46:30.649373 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-f24abe51-3aed-4fc4-b5db-8528471e8cad tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Image limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:46:30.649864 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-f24abe51-3aed-4fc4-b5db-8528471e8cad tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Flavor pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:46:30.650284 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-f24abe51-3aed-4fc4-b5db-8528471e8cad tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Image pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:46:30.650708 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-f24abe51-3aed-4fc4-b5db-8528471e8cad tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:46:30.665625 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f24abe51-3aed-4fc4-b5db-8528471e8cad tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:30.666038 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f24abe51-3aed-4fc4-b5db-8528471e8cad tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:30.666487 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f24abe51-3aed-4fc4-b5db-8528471e8cad tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:30.667235 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f24abe51-3aed-4fc4-b5db-8528471e8cad tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:30.667702 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f24abe51-3aed-4fc4-b5db-8528471e8cad tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:30.668144 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f24abe51-3aed-4fc4-b5db-8528471e8cad tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:30.689004 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-f24abe51-3aed-4fc4-b5db-8528471e8cad tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Getting quotas for project a9f809b8ae704988961908bef0f3cb24. Resources: {'ram', 'cores', 'instances'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:46:30.694446 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-f24abe51-3aed-4fc4-b5db-8528471e8cad tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Getting quotas for user ae9971b5861f44c1a1da94eda0f8f02d and project a9f809b8ae704988961908bef0f3cb24. Resources: {'ram', 'cores', 'instances'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:46:30.756732 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-f24abe51-3aed-4fc4-b5db-8528471e8cad tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Going to run 1 instances... {{(pid=123596) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:46:30.759021 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-f24abe51-3aed-4fc4-b5db-8528471e8cad tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] [instance: fd09cc9b-d9dd-4133-8665-eeb6d8f51df8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5d5e6453-6c99-48ca-855c-65f967d78aaa',volume_size=None,volume_type=None)] {{(pid=123596) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:46:30.898778 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-f24abe51-3aed-4fc4-b5db-8528471e8cad tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.748800 Oct 04 18:46:30.906576 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1894/3558] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 18:46:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 750 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:46:30.906576 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-6b29a31d-4617-4e76-af5b-58de7b152a4d tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:30.907084 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-6b29a31d-4617-4e76-af5b-58de7b152a4d tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] [instance: 00c17e4b-c80e-463e-a3e9-486c118552be] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:30.914342 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6b29a31d-4617-4e76-af5b-58de7b152a4d tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:30.914870 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6b29a31d-4617-4e76-af5b-58de7b152a4d tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:30.915359 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6b29a31d-4617-4e76-af5b-58de7b152a4d tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:30.916139 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6b29a31d-4617-4e76-af5b-58de7b152a4d tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:30.916678 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6b29a31d-4617-4e76-af5b-58de7b152a4d tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:30.917199 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6b29a31d-4617-4e76-af5b-58de7b152a4d tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:31.094603 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-6b29a31d-4617-4e76-af5b-58de7b152a4d tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c710f394164b89b16bcac2fe51c58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65037d4ea5124d749e42928032e803fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:31.104088 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-6b29a31d-4617-4e76-af5b-58de7b152a4d tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] 10.222.0.43 "GET /compute/v2.1/servers/00c17e4b-c80e-463e-a3e9-486c118552be" status: 200 len: 1517 microversion: 2.1 time: 0.202697 Oct 04 18:46:31.107799 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1895/3559] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:30 2022] GET /compute/v2.1/servers/00c17e4b-c80e-463e-a3e9-486c118552be => generated 1517 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:31.113426 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-5625101b-daca-4da8-8e11-c2dd68bbec2d tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:31.114263 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-5625101b-daca-4da8-8e11-c2dd68bbec2d tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 82b86465-afb0-49ef-9932-1538010c1ae5] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:31.120661 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:46:31.122592 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5625101b-daca-4da8-8e11-c2dd68bbec2d tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:31.123239 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5625101b-daca-4da8-8e11-c2dd68bbec2d tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:31.123616 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5625101b-daca-4da8-8e11-c2dd68bbec2d tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:31.124330 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5625101b-daca-4da8-8e11-c2dd68bbec2d tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:31.125413 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5625101b-daca-4da8-8e11-c2dd68bbec2d tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:31.126107 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5625101b-daca-4da8-8e11-c2dd68bbec2d tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:31.131461 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=86,nova_cell1:INSERT=5,nova_cell1:UPDATE=9 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:46:31.159226 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-916fef36-5d4b-47bd-b264-116d9ee431bd tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a116f2d9656548458264cc4fb1934c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff3c3dc76405401baf72fe00c5d50b56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:31.173636 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-916fef36-5d4b-47bd-b264-116d9ee431bd tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] 10.222.0.43 "GET /compute/v2.1/servers/76d475ab-f41c-44df-8aaa-10242bdbfcde" status: 200 len: 1724 microversion: 2.1 time: 0.785953 Oct 04 18:46:31.184073 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1665/3560] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:30 2022] GET /compute/v2.1/servers/76d475ab-f41c-44df-8aaa-10242bdbfcde => generated 1724 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:31.199049 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-0dedb409-ea49-43a0-8df7-02519418c058 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:31.200377 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-0dedb409-ea49-43a0-8df7-02519418c058 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] [instance: fd09cc9b-d9dd-4133-8665-eeb6d8f51df8] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:31.302760 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-5625101b-daca-4da8-8e11-c2dd68bbec2d tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:31.314346 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-5625101b-daca-4da8-8e11-c2dd68bbec2d tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5" status: 200 len: 1677 microversion: 2.1 time: 0.205278 Oct 04 18:46:31.314938 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1896/3561] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:31 2022] GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5 => generated 1677 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:31.326425 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-0dedb409-ea49-43a0-8df7-02519418c058 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9971b5861f44c1a1da94eda0f8f02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f809b8ae704988961908bef0f3cb24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:31.333678 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-0dedb409-ea49-43a0-8df7-02519418c058 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] 10.222.0.43 "GET /compute/v2.1/servers/fd09cc9b-d9dd-4133-8665-eeb6d8f51df8" status: 200 len: 1053 microversion: 2.1 time: 0.143680 Oct 04 18:46:31.334265 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1666/3562] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:31 2022] GET /compute/v2.1/servers/fd09cc9b-d9dd-4133-8665-eeb6d8f51df8 => generated 1053 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:31.337140 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-a86da3bf-5b77-4fc3-88a3-9b17b3ace857 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:31.337806 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-a86da3bf-5b77-4fc3-88a3-9b17b3ace857 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] [instance: 9886f261-8e00-4908-8fd8-f6ce9c6fd5b4] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:31.345537 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a86da3bf-5b77-4fc3-88a3-9b17b3ace857 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:31.346583 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a86da3bf-5b77-4fc3-88a3-9b17b3ace857 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:31.347040 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a86da3bf-5b77-4fc3-88a3-9b17b3ace857 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:31.347966 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a86da3bf-5b77-4fc3-88a3-9b17b3ace857 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:31.348595 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a86da3bf-5b77-4fc3-88a3-9b17b3ace857 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:31.349041 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a86da3bf-5b77-4fc3-88a3-9b17b3ace857 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:31.404674 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-3e3ed4c7-5a9f-4f78-80d3-1b2915137182 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:31.405504 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-3e3ed4c7-5a9f-4f78-80d3-1b2915137182 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] [instance: fa47906d-d394-46fe-9143-780bcd27a715] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:31.415992 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3e3ed4c7-5a9f-4f78-80d3-1b2915137182 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:31.416900 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3e3ed4c7-5a9f-4f78-80d3-1b2915137182 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:31.417457 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3e3ed4c7-5a9f-4f78-80d3-1b2915137182 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:31.419575 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3e3ed4c7-5a9f-4f78-80d3-1b2915137182 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:31.420223 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3e3ed4c7-5a9f-4f78-80d3-1b2915137182 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:31.420769 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3e3ed4c7-5a9f-4f78-80d3-1b2915137182 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:31.528602 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-a86da3bf-5b77-4fc3-88a3-9b17b3ace857 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcbf2b4b95743af9e6fa1be54554baa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab4da2b9b9f4c7a9c25b7edaab3027d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:31.539059 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-a86da3bf-5b77-4fc3-88a3-9b17b3ace857 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] 10.222.0.43 "GET /compute/v2.1/servers/9886f261-8e00-4908-8fd8-f6ce9c6fd5b4" status: 200 len: 1325 microversion: 2.1 time: 0.205713 Oct 04 18:46:31.539912 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1897/3563] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:31 2022] GET /compute/v2.1/servers/9886f261-8e00-4908-8fd8-f6ce9c6fd5b4 => generated 1325 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:31.939349 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-6e4aabf5-02bd-40cd-b859-70adb8565442 req-9074852f-500e-40ed-804f-578845ca5700 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9886f261-8e00-4908-8fd8-f6ce9c6fd5b4", "tag": "7ad7933b-bb26-49b9-bc61-e535f1317b72"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:46:31.950403 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-6e4aabf5-02bd-40cd-b859-70adb8565442 req-9074852f-500e-40ed-804f-578845ca5700 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:31.950959 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-6e4aabf5-02bd-40cd-b859-70adb8565442 req-9074852f-500e-40ed-804f-578845ca5700 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:31.957989 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-6e4aabf5-02bd-40cd-b859-70adb8565442 req-9074852f-500e-40ed-804f-578845ca5700 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:31.968237 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-3e3ed4c7-5a9f-4f78-80d3-1b2915137182 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:31.979978 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-3e3ed4c7-5a9f-4f78-80d3-1b2915137182 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:31.980367 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-6e4aabf5-02bd-40cd-b859-70adb8565442 req-9074852f-500e-40ed-804f-578845ca5700 service nova] Creating event network-changed:7ad7933b-bb26-49b9-bc61-e535f1317b72 for instance 9886f261-8e00-4908-8fd8-f6ce9c6fd5b4 on n-h2-851028-13 Oct 04 18:46:31.981615 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-3e3ed4c7-5a9f-4f78-80d3-1b2915137182 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:31.983036 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-3e3ed4c7-5a9f-4f78-80d3-1b2915137182 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] 10.222.0.43 "GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715" status: 200 len: 1874 microversion: 2.32 time: 0.583898 Oct 04 18:46:31.983684 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1667/3564] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:46:31 2022] GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715 => generated 1874 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:46:31.991379 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-6e4aabf5-02bd-40cd-b859-70adb8565442 req-9074852f-500e-40ed-804f-578845ca5700 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055632 Oct 04 18:46:31.992600 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1898/3565] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:46:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:46:32.129642 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-cc0352ae-2ccc-49f6-9a87-5f39918cce16 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:32.130424 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-cc0352ae-2ccc-49f6-9a87-5f39918cce16 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] [instance: 00c17e4b-c80e-463e-a3e9-486c118552be] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:32.136524 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cc0352ae-2ccc-49f6-9a87-5f39918cce16 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:32.137156 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cc0352ae-2ccc-49f6-9a87-5f39918cce16 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:32.137608 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cc0352ae-2ccc-49f6-9a87-5f39918cce16 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:32.138310 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cc0352ae-2ccc-49f6-9a87-5f39918cce16 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:32.138769 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cc0352ae-2ccc-49f6-9a87-5f39918cce16 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:32.139199 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cc0352ae-2ccc-49f6-9a87-5f39918cce16 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:32.201869 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-31c8b889-10de-4607-a0c2-c51e629bd3e2 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:32.202413 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-31c8b889-10de-4607-a0c2-c51e629bd3e2 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] [instance: 76d475ab-f41c-44df-8aaa-10242bdbfcde] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:32.208595 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-31c8b889-10de-4607-a0c2-c51e629bd3e2 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:32.209457 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-31c8b889-10de-4607-a0c2-c51e629bd3e2 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:32.210355 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-31c8b889-10de-4607-a0c2-c51e629bd3e2 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:32.211170 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-31c8b889-10de-4607-a0c2-c51e629bd3e2 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:32.211707 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-31c8b889-10de-4607-a0c2-c51e629bd3e2 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:32.212215 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-31c8b889-10de-4607-a0c2-c51e629bd3e2 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:32.279970 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-cc0352ae-2ccc-49f6-9a87-5f39918cce16 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c710f394164b89b16bcac2fe51c58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65037d4ea5124d749e42928032e803fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:32.288161 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-cc0352ae-2ccc-49f6-9a87-5f39918cce16 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] 10.222.0.43 "GET /compute/v2.1/servers/00c17e4b-c80e-463e-a3e9-486c118552be" status: 200 len: 1517 microversion: 2.1 time: 0.163785 Oct 04 18:46:32.288746 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1899/3566] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:32 2022] GET /compute/v2.1/servers/00c17e4b-c80e-463e-a3e9-486c118552be => generated 1517 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:32.338374 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-e29a3e22-4705-41fa-aa44-5cbe786c9319 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:32.339026 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-e29a3e22-4705-41fa-aa44-5cbe786c9319 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 82b86465-afb0-49ef-9932-1538010c1ae5] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:32.345720 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e29a3e22-4705-41fa-aa44-5cbe786c9319 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:32.346219 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e29a3e22-4705-41fa-aa44-5cbe786c9319 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:32.346658 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e29a3e22-4705-41fa-aa44-5cbe786c9319 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:32.347356 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e29a3e22-4705-41fa-aa44-5cbe786c9319 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:32.347809 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e29a3e22-4705-41fa-aa44-5cbe786c9319 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:32.348231 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e29a3e22-4705-41fa-aa44-5cbe786c9319 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:32.514277 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-e29a3e22-4705-41fa-aa44-5cbe786c9319 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:32.525801 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-e29a3e22-4705-41fa-aa44-5cbe786c9319 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5" status: 200 len: 1677 microversion: 2.1 time: 0.191455 Oct 04 18:46:32.543617 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1900/3567] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:32 2022] GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5 => generated 1677 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:32.543617 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-a1f023d2-e365-400e-9c43-5dc313fdd8dd tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:32.543617 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-a1f023d2-e365-400e-9c43-5dc313fdd8dd tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] [instance: fd09cc9b-d9dd-4133-8665-eeb6d8f51df8] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:32.543617 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a1f023d2-e365-400e-9c43-5dc313fdd8dd tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:32.543617 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a1f023d2-e365-400e-9c43-5dc313fdd8dd tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:32.543617 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a1f023d2-e365-400e-9c43-5dc313fdd8dd tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:32.544323 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a1f023d2-e365-400e-9c43-5dc313fdd8dd tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:32.545032 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a1f023d2-e365-400e-9c43-5dc313fdd8dd tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:32.545699 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a1f023d2-e365-400e-9c43-5dc313fdd8dd tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:32.627177 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-a1f023d2-e365-400e-9c43-5dc313fdd8dd tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9971b5861f44c1a1da94eda0f8f02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f809b8ae704988961908bef0f3cb24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:32.655349 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-a1f023d2-e365-400e-9c43-5dc313fdd8dd tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] 10.222.0.43 "GET /compute/v2.1/servers/fd09cc9b-d9dd-4133-8665-eeb6d8f51df8" status: 200 len: 1159 microversion: 2.1 time: 0.124633 Oct 04 18:46:32.661340 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1901/3568] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:32 2022] GET /compute/v2.1/servers/fd09cc9b-d9dd-4133-8665-eeb6d8f51df8 => generated 1159 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:32.677878 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-43b116a0-1091-4cd8-8284-a519e00f6d73 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:32.679046 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-43b116a0-1091-4cd8-8284-a519e00f6d73 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] [instance: 9886f261-8e00-4908-8fd8-f6ce9c6fd5b4] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:32.690819 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-43b116a0-1091-4cd8-8284-a519e00f6d73 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:32.692464 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-43b116a0-1091-4cd8-8284-a519e00f6d73 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:32.692464 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-43b116a0-1091-4cd8-8284-a519e00f6d73 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:32.693372 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-43b116a0-1091-4cd8-8284-a519e00f6d73 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:32.694761 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-43b116a0-1091-4cd8-8284-a519e00f6d73 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:32.695765 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-43b116a0-1091-4cd8-8284-a519e00f6d73 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:32.723500 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-31c8b889-10de-4607-a0c2-c51e629bd3e2 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a116f2d9656548458264cc4fb1934c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff3c3dc76405401baf72fe00c5d50b56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:32.736909 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-31c8b889-10de-4607-a0c2-c51e629bd3e2 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] 10.222.0.43 "GET /compute/v2.1/servers/76d475ab-f41c-44df-8aaa-10242bdbfcde" status: 200 len: 1724 microversion: 2.1 time: 0.539634 Oct 04 18:46:32.737534 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1668/3569] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:32 2022] GET /compute/v2.1/servers/76d475ab-f41c-44df-8aaa-10242bdbfcde => generated 1724 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:32.887066 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-43b116a0-1091-4cd8-8284-a519e00f6d73 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcbf2b4b95743af9e6fa1be54554baa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab4da2b9b9f4c7a9c25b7edaab3027d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:32.897889 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-43b116a0-1091-4cd8-8284-a519e00f6d73 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] 10.222.0.43 "GET /compute/v2.1/servers/9886f261-8e00-4908-8fd8-f6ce9c6fd5b4" status: 200 len: 1325 microversion: 2.1 time: 0.234965 Oct 04 18:46:32.899490 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1902/3570] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:32 2022] GET /compute/v2.1/servers/9886f261-8e00-4908-8fd8-f6ce9c6fd5b4 => generated 1325 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:33.010994 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-4858d17c-e560-482e-b665-61da31c36504 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:33.012167 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-4858d17c-e560-482e-b665-61da31c36504 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] [instance: fa47906d-d394-46fe-9143-780bcd27a715] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:33.022924 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4858d17c-e560-482e-b665-61da31c36504 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:33.024846 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4858d17c-e560-482e-b665-61da31c36504 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:33.026056 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4858d17c-e560-482e-b665-61da31c36504 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:33.027016 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4858d17c-e560-482e-b665-61da31c36504 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:33.028193 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4858d17c-e560-482e-b665-61da31c36504 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:33.028646 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4858d17c-e560-482e-b665-61da31c36504 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:33.312810 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-b971fad3-b23c-45be-be34-6200d93b4e78 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:33.314257 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-b971fad3-b23c-45be-be34-6200d93b4e78 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] [instance: 00c17e4b-c80e-463e-a3e9-486c118552be] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:33.321035 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b971fad3-b23c-45be-be34-6200d93b4e78 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:33.321582 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b971fad3-b23c-45be-be34-6200d93b4e78 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:33.322033 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b971fad3-b23c-45be-be34-6200d93b4e78 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:33.322752 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b971fad3-b23c-45be-be34-6200d93b4e78 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:33.323407 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b971fad3-b23c-45be-be34-6200d93b4e78 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:33.323948 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b971fad3-b23c-45be-be34-6200d93b4e78 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:33.480944 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-b971fad3-b23c-45be-be34-6200d93b4e78 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c710f394164b89b16bcac2fe51c58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65037d4ea5124d749e42928032e803fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:33.493140 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-b971fad3-b23c-45be-be34-6200d93b4e78 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] 10.222.0.43 "GET /compute/v2.1/servers/00c17e4b-c80e-463e-a3e9-486c118552be" status: 200 len: 1517 microversion: 2.1 time: 0.184484 Oct 04 18:46:33.511295 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1903/3571] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:33 2022] GET /compute/v2.1/servers/00c17e4b-c80e-463e-a3e9-486c118552be => generated 1517 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:46:33.551398 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-a33e9332-f18d-4e50-885c-cbf479c92808 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:33.552023 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-a33e9332-f18d-4e50-885c-cbf479c92808 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 82b86465-afb0-49ef-9932-1538010c1ae5] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:33.562415 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a33e9332-f18d-4e50-885c-cbf479c92808 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:33.562984 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a33e9332-f18d-4e50-885c-cbf479c92808 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:33.563468 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a33e9332-f18d-4e50-885c-cbf479c92808 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:33.564214 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a33e9332-f18d-4e50-885c-cbf479c92808 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:33.564670 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a33e9332-f18d-4e50-885c-cbf479c92808 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:33.565135 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a33e9332-f18d-4e50-885c-cbf479c92808 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:33.715103 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-a33e9332-f18d-4e50-885c-cbf479c92808 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:33.724668 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-a33e9332-f18d-4e50-885c-cbf479c92808 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5" status: 200 len: 1677 microversion: 2.1 time: 0.177599 Oct 04 18:46:33.730422 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1904/3572] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:33 2022] GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5 => generated 1677 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:46:33.739064 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-66953e68-a94f-4bcf-bea0-e9e318fbcab0 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:33.740609 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-66953e68-a94f-4bcf-bea0-e9e318fbcab0 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] [instance: fd09cc9b-d9dd-4133-8665-eeb6d8f51df8] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:33.747963 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-66953e68-a94f-4bcf-bea0-e9e318fbcab0 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:33.748617 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-66953e68-a94f-4bcf-bea0-e9e318fbcab0 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:33.749098 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-66953e68-a94f-4bcf-bea0-e9e318fbcab0 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:33.751079 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-66953e68-a94f-4bcf-bea0-e9e318fbcab0 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:33.751079 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-66953e68-a94f-4bcf-bea0-e9e318fbcab0 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:33.753500 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-66953e68-a94f-4bcf-bea0-e9e318fbcab0 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:33.826061 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-4858d17c-e560-482e-b665-61da31c36504 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:33.832480 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-66953e68-a94f-4bcf-bea0-e9e318fbcab0 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9971b5861f44c1a1da94eda0f8f02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f809b8ae704988961908bef0f3cb24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:33.841505 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-4858d17c-e560-482e-b665-61da31c36504 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:33.841722 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-66953e68-a94f-4bcf-bea0-e9e318fbcab0 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] 10.222.0.43 "GET /compute/v2.1/servers/fd09cc9b-d9dd-4133-8665-eeb6d8f51df8" status: 200 len: 1169 microversion: 2.1 time: 0.109671 Oct 04 18:46:33.843908 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-4858d17c-e560-482e-b665-61da31c36504 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:33.845532 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-4858d17c-e560-482e-b665-61da31c36504 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] 10.222.0.43 "GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715" status: 200 len: 1874 microversion: 2.32 time: 0.838436 Oct 04 18:46:33.846678 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1669/3573] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:46:33 2022] GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715 => generated 1874 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:46:33.852174 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-ac7b42d5-ae05-40b8-a464-e367ceaf823b tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:33.853153 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-ac7b42d5-ae05-40b8-a464-e367ceaf823b tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] [instance: 76d475ab-f41c-44df-8aaa-10242bdbfcde] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:33.857713 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1905/3574] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:33 2022] GET /compute/v2.1/servers/fd09cc9b-d9dd-4133-8665-eeb6d8f51df8 => generated 1169 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:33.861404 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ac7b42d5-ae05-40b8-a464-e367ceaf823b tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:33.861982 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ac7b42d5-ae05-40b8-a464-e367ceaf823b tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:33.862665 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ac7b42d5-ae05-40b8-a464-e367ceaf823b tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:33.863570 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ac7b42d5-ae05-40b8-a464-e367ceaf823b tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:33.864183 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ac7b42d5-ae05-40b8-a464-e367ceaf823b tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:33.864762 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ac7b42d5-ae05-40b8-a464-e367ceaf823b tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:33.925483 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-322b0ff8-fd8f-472c-afbb-b186214dc036 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:33.926699 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-322b0ff8-fd8f-472c-afbb-b186214dc036 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] [instance: 9886f261-8e00-4908-8fd8-f6ce9c6fd5b4] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:33.936158 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-322b0ff8-fd8f-472c-afbb-b186214dc036 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:33.936790 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-322b0ff8-fd8f-472c-afbb-b186214dc036 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:33.938065 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-322b0ff8-fd8f-472c-afbb-b186214dc036 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:33.938924 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-322b0ff8-fd8f-472c-afbb-b186214dc036 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:33.939698 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-322b0ff8-fd8f-472c-afbb-b186214dc036 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:33.940375 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-322b0ff8-fd8f-472c-afbb-b186214dc036 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:34.108405 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-322b0ff8-fd8f-472c-afbb-b186214dc036 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcbf2b4b95743af9e6fa1be54554baa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab4da2b9b9f4c7a9c25b7edaab3027d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:34.117612 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-322b0ff8-fd8f-472c-afbb-b186214dc036 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] 10.222.0.43 "GET /compute/v2.1/servers/9886f261-8e00-4908-8fd8-f6ce9c6fd5b4" status: 200 len: 1325 microversion: 2.1 time: 0.199099 Oct 04 18:46:34.118245 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1906/3575] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:33 2022] GET /compute/v2.1/servers/9886f261-8e00-4908-8fd8-f6ce9c6fd5b4 => generated 1325 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:46:34.303406 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-ac7b42d5-ae05-40b8-a464-e367ceaf823b tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a116f2d9656548458264cc4fb1934c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff3c3dc76405401baf72fe00c5d50b56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:34.314078 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-ac7b42d5-ae05-40b8-a464-e367ceaf823b tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] 10.222.0.43 "GET /compute/v2.1/servers/76d475ab-f41c-44df-8aaa-10242bdbfcde" status: 200 len: 1724 microversion: 2.1 time: 0.465793 Oct 04 18:46:34.314998 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1670/3576] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:33 2022] GET /compute/v2.1/servers/76d475ab-f41c-44df-8aaa-10242bdbfcde => generated 1724 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:34.516499 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-dc6b3488-cf1d-4e84-881b-49c5f316ec3a tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:34.517147 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-dc6b3488-cf1d-4e84-881b-49c5f316ec3a tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] [instance: 00c17e4b-c80e-463e-a3e9-486c118552be] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:34.524215 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dc6b3488-cf1d-4e84-881b-49c5f316ec3a tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:34.524711 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dc6b3488-cf1d-4e84-881b-49c5f316ec3a tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:34.525261 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dc6b3488-cf1d-4e84-881b-49c5f316ec3a tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:34.525980 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dc6b3488-cf1d-4e84-881b-49c5f316ec3a tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:34.526443 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dc6b3488-cf1d-4e84-881b-49c5f316ec3a tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:34.526874 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dc6b3488-cf1d-4e84-881b-49c5f316ec3a tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:34.687316 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-dc6b3488-cf1d-4e84-881b-49c5f316ec3a tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c710f394164b89b16bcac2fe51c58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65037d4ea5124d749e42928032e803fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:34.704060 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-dc6b3488-cf1d-4e84-881b-49c5f316ec3a tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] 10.222.0.43 "GET /compute/v2.1/servers/00c17e4b-c80e-463e-a3e9-486c118552be" status: 200 len: 1517 microversion: 2.1 time: 0.191942 Oct 04 18:46:34.704765 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1907/3577] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:34 2022] GET /compute/v2.1/servers/00c17e4b-c80e-463e-a3e9-486c118552be => generated 1517 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:34.751339 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-2dcdeb94-ba7e-424f-8779-c56bb663cda6 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:34.752429 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-2dcdeb94-ba7e-424f-8779-c56bb663cda6 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 82b86465-afb0-49ef-9932-1538010c1ae5] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:34.760388 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2dcdeb94-ba7e-424f-8779-c56bb663cda6 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:34.761245 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2dcdeb94-ba7e-424f-8779-c56bb663cda6 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:34.762134 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2dcdeb94-ba7e-424f-8779-c56bb663cda6 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:34.763149 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2dcdeb94-ba7e-424f-8779-c56bb663cda6 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:34.763813 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2dcdeb94-ba7e-424f-8779-c56bb663cda6 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:34.764471 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2dcdeb94-ba7e-424f-8779-c56bb663cda6 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:34.869760 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-48e80c33-8edb-4a7f-a00f-a2c3da19cfca tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:34.870999 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-48e80c33-8edb-4a7f-a00f-a2c3da19cfca tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] [instance: fd09cc9b-d9dd-4133-8665-eeb6d8f51df8] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:34.880912 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-48e80c33-8edb-4a7f-a00f-a2c3da19cfca tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:34.881983 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-48e80c33-8edb-4a7f-a00f-a2c3da19cfca tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:34.882709 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-48e80c33-8edb-4a7f-a00f-a2c3da19cfca tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:34.885391 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-48e80c33-8edb-4a7f-a00f-a2c3da19cfca tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:34.887906 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-48e80c33-8edb-4a7f-a00f-a2c3da19cfca tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:34.888591 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-48e80c33-8edb-4a7f-a00f-a2c3da19cfca tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:34.990116 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-48e80c33-8edb-4a7f-a00f-a2c3da19cfca tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9971b5861f44c1a1da94eda0f8f02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f809b8ae704988961908bef0f3cb24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:35.003449 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-48e80c33-8edb-4a7f-a00f-a2c3da19cfca tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] 10.222.0.43 "GET /compute/v2.1/servers/fd09cc9b-d9dd-4133-8665-eeb6d8f51df8" status: 200 len: 1169 microversion: 2.1 time: 0.137106 Oct 04 18:46:35.017350 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1908/3578] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:34 2022] GET /compute/v2.1/servers/fd09cc9b-d9dd-4133-8665-eeb6d8f51df8 => generated 1169 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:35.017350 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-00504235-fbc5-47fd-9856-84f3e51dc59e tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:35.017350 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-00504235-fbc5-47fd-9856-84f3e51dc59e tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] [instance: fa47906d-d394-46fe-9143-780bcd27a715] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:35.037440 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-00504235-fbc5-47fd-9856-84f3e51dc59e tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:35.038404 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-00504235-fbc5-47fd-9856-84f3e51dc59e tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:35.038404 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-00504235-fbc5-47fd-9856-84f3e51dc59e tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:35.039241 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-00504235-fbc5-47fd-9856-84f3e51dc59e tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:35.040683 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-00504235-fbc5-47fd-9856-84f3e51dc59e tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:35.042275 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-00504235-fbc5-47fd-9856-84f3e51dc59e tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:35.243345 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-2dcdeb94-ba7e-424f-8779-c56bb663cda6 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:35.247109 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:46:35.260489 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-2dcdeb94-ba7e-424f-8779-c56bb663cda6 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5" status: 200 len: 1677 microversion: 2.1 time: 0.514391 Oct 04 18:46:35.261327 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1671/3579] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:34 2022] GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5 => generated 1677 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:35.271889 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-2c50e3b2-1132-4ab8-adaf-cabaacbe01ce tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:35.272615 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-2c50e3b2-1132-4ab8-adaf-cabaacbe01ce tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] [instance: 9886f261-8e00-4908-8fd8-f6ce9c6fd5b4] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:35.287012 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2c50e3b2-1132-4ab8-adaf-cabaacbe01ce tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:35.287520 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2c50e3b2-1132-4ab8-adaf-cabaacbe01ce tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:35.287979 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2c50e3b2-1132-4ab8-adaf-cabaacbe01ce tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:35.288711 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2c50e3b2-1132-4ab8-adaf-cabaacbe01ce tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:35.289202 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2c50e3b2-1132-4ab8-adaf-cabaacbe01ce tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:35.292741 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2c50e3b2-1132-4ab8-adaf-cabaacbe01ce tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:35.320155 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-00504235-fbc5-47fd-9856-84f3e51dc59e tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:35.331443 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-00504235-fbc5-47fd-9856-84f3e51dc59e tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:35.333888 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-00504235-fbc5-47fd-9856-84f3e51dc59e tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:35.335478 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-00504235-fbc5-47fd-9856-84f3e51dc59e tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] 10.222.0.43 "GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715" status: 200 len: 1874 microversion: 2.32 time: 0.328608 Oct 04 18:46:35.336922 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1909/3580] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:46:35 2022] GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715 => generated 1874 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:46:35.342782 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-ac8c1f36-d1f3-4145-9df3-d02ffe4e48d3 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:35.344256 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-ac8c1f36-d1f3-4145-9df3-d02ffe4e48d3 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] [instance: 76d475ab-f41c-44df-8aaa-10242bdbfcde] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:35.351274 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ac8c1f36-d1f3-4145-9df3-d02ffe4e48d3 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:35.351848 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ac8c1f36-d1f3-4145-9df3-d02ffe4e48d3 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:35.352503 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ac8c1f36-d1f3-4145-9df3-d02ffe4e48d3 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:35.353391 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ac8c1f36-d1f3-4145-9df3-d02ffe4e48d3 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:35.353962 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ac8c1f36-d1f3-4145-9df3-d02ffe4e48d3 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:35.354523 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ac8c1f36-d1f3-4145-9df3-d02ffe4e48d3 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:35.541403 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-ac8c1f36-d1f3-4145-9df3-d02ffe4e48d3 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a116f2d9656548458264cc4fb1934c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff3c3dc76405401baf72fe00c5d50b56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:35.551849 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-ac8c1f36-d1f3-4145-9df3-d02ffe4e48d3 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] 10.222.0.43 "GET /compute/v2.1/servers/76d475ab-f41c-44df-8aaa-10242bdbfcde" status: 200 len: 1724 microversion: 2.1 time: 0.213266 Oct 04 18:46:35.552825 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1910/3581] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:35 2022] GET /compute/v2.1/servers/76d475ab-f41c-44df-8aaa-10242bdbfcde => generated 1724 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:35.735154 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-2c1f9079-ad62-49cd-b23f-82972785921a tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:35.736017 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-2c1f9079-ad62-49cd-b23f-82972785921a tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] [instance: 00c17e4b-c80e-463e-a3e9-486c118552be] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:35.742634 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2c1f9079-ad62-49cd-b23f-82972785921a tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:35.743499 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2c1f9079-ad62-49cd-b23f-82972785921a tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:35.744015 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2c1f9079-ad62-49cd-b23f-82972785921a tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:35.744796 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2c1f9079-ad62-49cd-b23f-82972785921a tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:35.745352 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2c1f9079-ad62-49cd-b23f-82972785921a tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:35.746050 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2c1f9079-ad62-49cd-b23f-82972785921a tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:35.893021 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-2c1f9079-ad62-49cd-b23f-82972785921a tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c710f394164b89b16bcac2fe51c58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65037d4ea5124d749e42928032e803fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:35.902829 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-2c1f9079-ad62-49cd-b23f-82972785921a tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] 10.222.0.43 "GET /compute/v2.1/servers/00c17e4b-c80e-463e-a3e9-486c118552be" status: 200 len: 1517 microversion: 2.1 time: 0.172416 Oct 04 18:46:35.904424 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1911/3582] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:35 2022] GET /compute/v2.1/servers/00c17e4b-c80e-463e-a3e9-486c118552be => generated 1517 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:46:36.034256 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-01b0e417-2912-41ce-a38d-2423119d8128 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:36.035014 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-01b0e417-2912-41ce-a38d-2423119d8128 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] [instance: fd09cc9b-d9dd-4133-8665-eeb6d8f51df8] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:36.042782 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-01b0e417-2912-41ce-a38d-2423119d8128 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:36.043450 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-01b0e417-2912-41ce-a38d-2423119d8128 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:36.043993 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-01b0e417-2912-41ce-a38d-2423119d8128 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:36.044937 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-01b0e417-2912-41ce-a38d-2423119d8128 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:36.045523 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-01b0e417-2912-41ce-a38d-2423119d8128 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:36.046315 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-01b0e417-2912-41ce-a38d-2423119d8128 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:36.329702 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-2c50e3b2-1132-4ab8-adaf-cabaacbe01ce tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcbf2b4b95743af9e6fa1be54554baa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab4da2b9b9f4c7a9c25b7edaab3027d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:36.368380 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-2c50e3b2-1132-4ab8-adaf-cabaacbe01ce tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] 10.222.0.43 "GET /compute/v2.1/servers/9886f261-8e00-4908-8fd8-f6ce9c6fd5b4" status: 200 len: 1325 microversion: 2.1 time: 1.105479 Oct 04 18:46:36.372010 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1672/3583] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:35 2022] GET /compute/v2.1/servers/9886f261-8e00-4908-8fd8-f6ce9c6fd5b4 => generated 1325 bytes in 1110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:36.391660 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-bc526816-3f2b-47a7-a078-6767fddbe99f tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:36.394298 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-bc526816-3f2b-47a7-a078-6767fddbe99f tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 82b86465-afb0-49ef-9932-1538010c1ae5] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:36.395672 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-01b0e417-2912-41ce-a38d-2423119d8128 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9971b5861f44c1a1da94eda0f8f02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f809b8ae704988961908bef0f3cb24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:36.421966 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bc526816-3f2b-47a7-a078-6767fddbe99f tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:36.425995 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-01b0e417-2912-41ce-a38d-2423119d8128 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] 10.222.0.43 "GET /compute/v2.1/servers/fd09cc9b-d9dd-4133-8665-eeb6d8f51df8" status: 200 len: 1211 microversion: 2.1 time: 0.391856 Oct 04 18:46:36.426408 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bc526816-3f2b-47a7-a078-6767fddbe99f tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:36.428830 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bc526816-3f2b-47a7-a078-6767fddbe99f tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:36.429033 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1912/3584] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:36 2022] GET /compute/v2.1/servers/fd09cc9b-d9dd-4133-8665-eeb6d8f51df8 => generated 1211 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:46:36.432245 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bc526816-3f2b-47a7-a078-6767fddbe99f tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:36.433666 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bc526816-3f2b-47a7-a078-6767fddbe99f tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:36.440840 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bc526816-3f2b-47a7-a078-6767fddbe99f tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:36.454229 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-d9c05a62-7df3-4798-91a4-449c5291cd7f tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:36.456621 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-d9c05a62-7df3-4798-91a4-449c5291cd7f tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] [instance: fa47906d-d394-46fe-9143-780bcd27a715] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:36.488742 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d9c05a62-7df3-4798-91a4-449c5291cd7f tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:36.489829 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d9c05a62-7df3-4798-91a4-449c5291cd7f tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:36.493266 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d9c05a62-7df3-4798-91a4-449c5291cd7f tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:36.495507 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d9c05a62-7df3-4798-91a4-449c5291cd7f tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:36.497842 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d9c05a62-7df3-4798-91a4-449c5291cd7f tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:36.499183 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d9c05a62-7df3-4798-91a4-449c5291cd7f tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:36.560366 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=100 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:46:36.902831 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-bc526816-3f2b-47a7-a078-6767fddbe99f tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:36.922165 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-bc526816-3f2b-47a7-a078-6767fddbe99f tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5" status: 200 len: 1677 microversion: 2.1 time: 0.545550 Oct 04 18:46:36.924730 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1673/3585] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:36 2022] GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5 => generated 1677 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:36.939636 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-3cf3e80b-0ec7-4d25-ab82-42c5d4ef911a tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:36.940641 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-3cf3e80b-0ec7-4d25-ab82-42c5d4ef911a tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] [instance: 76d475ab-f41c-44df-8aaa-10242bdbfcde] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:36.954333 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3cf3e80b-0ec7-4d25-ab82-42c5d4ef911a tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:36.955328 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3cf3e80b-0ec7-4d25-ab82-42c5d4ef911a tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:36.956017 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3cf3e80b-0ec7-4d25-ab82-42c5d4ef911a tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:36.956969 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3cf3e80b-0ec7-4d25-ab82-42c5d4ef911a tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:36.959355 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3cf3e80b-0ec7-4d25-ab82-42c5d4ef911a tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:36.960141 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3cf3e80b-0ec7-4d25-ab82-42c5d4ef911a tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:36.987116 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-d9c05a62-7df3-4798-91a4-449c5291cd7f tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:37.018387 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-d9c05a62-7df3-4798-91a4-449c5291cd7f tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:37.024233 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-d9c05a62-7df3-4798-91a4-449c5291cd7f tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:37.031832 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-d9c05a62-7df3-4798-91a4-449c5291cd7f tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] 10.222.0.43 "GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715" status: 200 len: 1874 microversion: 2.32 time: 0.599185 Oct 04 18:46:37.036344 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1913/3586] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:46:36 2022] GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715 => generated 1874 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:46:37.045586 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-ed4b45d8-7b82-4c32-a22a-351d9ab0e478 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:37.052659 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-ed4b45d8-7b82-4c32-a22a-351d9ab0e478 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] [instance: 00c17e4b-c80e-463e-a3e9-486c118552be] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:37.065478 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ed4b45d8-7b82-4c32-a22a-351d9ab0e478 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:37.066095 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ed4b45d8-7b82-4c32-a22a-351d9ab0e478 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:37.066650 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ed4b45d8-7b82-4c32-a22a-351d9ab0e478 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:37.067471 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ed4b45d8-7b82-4c32-a22a-351d9ab0e478 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:37.068181 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ed4b45d8-7b82-4c32-a22a-351d9ab0e478 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:37.068850 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ed4b45d8-7b82-4c32-a22a-351d9ab0e478 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:37.327292 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-ed4b45d8-7b82-4c32-a22a-351d9ab0e478 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c710f394164b89b16bcac2fe51c58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65037d4ea5124d749e42928032e803fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:37.344525 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-ed4b45d8-7b82-4c32-a22a-351d9ab0e478 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] 10.222.0.43 "GET /compute/v2.1/servers/00c17e4b-c80e-463e-a3e9-486c118552be" status: 200 len: 1517 microversion: 2.1 time: 0.306882 Oct 04 18:46:37.347328 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1914/3587] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:37 2022] GET /compute/v2.1/servers/00c17e4b-c80e-463e-a3e9-486c118552be => generated 1517 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:37.350693 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-3cf3e80b-0ec7-4d25-ab82-42c5d4ef911a tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a116f2d9656548458264cc4fb1934c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff3c3dc76405401baf72fe00c5d50b56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:37.364585 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-3cf3e80b-0ec7-4d25-ab82-42c5d4ef911a tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] 10.222.0.43 "GET /compute/v2.1/servers/76d475ab-f41c-44df-8aaa-10242bdbfcde" status: 200 len: 1724 microversion: 2.1 time: 0.438508 Oct 04 18:46:37.365405 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1674/3588] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:36 2022] GET /compute/v2.1/servers/76d475ab-f41c-44df-8aaa-10242bdbfcde => generated 1724 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:37.399058 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-67f017e8-cb22-47a5-bd1a-d68226f9d0b8 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:37.400069 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-67f017e8-cb22-47a5-bd1a-d68226f9d0b8 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] [instance: 9886f261-8e00-4908-8fd8-f6ce9c6fd5b4] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:37.407034 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-67f017e8-cb22-47a5-bd1a-d68226f9d0b8 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:37.408015 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-67f017e8-cb22-47a5-bd1a-d68226f9d0b8 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:37.408691 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-67f017e8-cb22-47a5-bd1a-d68226f9d0b8 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:37.409735 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-67f017e8-cb22-47a5-bd1a-d68226f9d0b8 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:37.410438 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-67f017e8-cb22-47a5-bd1a-d68226f9d0b8 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:37.411093 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-67f017e8-cb22-47a5-bd1a-d68226f9d0b8 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:37.451878 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-88a8ff2a-4e27-4610-adb8-f59fa6846cb9 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:37.452837 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-88a8ff2a-4e27-4610-adb8-f59fa6846cb9 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] [instance: fd09cc9b-d9dd-4133-8665-eeb6d8f51df8] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:37.465875 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-88a8ff2a-4e27-4610-adb8-f59fa6846cb9 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:37.466656 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-88a8ff2a-4e27-4610-adb8-f59fa6846cb9 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:37.473798 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-88a8ff2a-4e27-4610-adb8-f59fa6846cb9 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:37.474867 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-88a8ff2a-4e27-4610-adb8-f59fa6846cb9 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:37.475586 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-88a8ff2a-4e27-4610-adb8-f59fa6846cb9 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:37.476245 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-88a8ff2a-4e27-4610-adb8-f59fa6846cb9 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:37.667470 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-67f017e8-cb22-47a5-bd1a-d68226f9d0b8 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcbf2b4b95743af9e6fa1be54554baa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab4da2b9b9f4c7a9c25b7edaab3027d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:37.677356 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-67f017e8-cb22-47a5-bd1a-d68226f9d0b8 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] 10.222.0.43 "GET /compute/v2.1/servers/9886f261-8e00-4908-8fd8-f6ce9c6fd5b4" status: 200 len: 1325 microversion: 2.1 time: 0.282135 Oct 04 18:46:37.692411 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1915/3589] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:37 2022] GET /compute/v2.1/servers/9886f261-8e00-4908-8fd8-f6ce9c6fd5b4 => generated 1325 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:37.824014 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-88a8ff2a-4e27-4610-adb8-f59fa6846cb9 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9971b5861f44c1a1da94eda0f8f02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f809b8ae704988961908bef0f3cb24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:37.836321 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-88a8ff2a-4e27-4610-adb8-f59fa6846cb9 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] 10.222.0.43 "GET /compute/v2.1/servers/fd09cc9b-d9dd-4133-8665-eeb6d8f51df8" status: 200 len: 1211 microversion: 2.1 time: 0.388207 Oct 04 18:46:37.851697 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1675/3590] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:37 2022] GET /compute/v2.1/servers/fd09cc9b-d9dd-4133-8665-eeb6d8f51df8 => generated 1211 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:37.948394 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-2a1c8943-16e9-482b-8d04-838262971508 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:37.949022 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-2a1c8943-16e9-482b-8d04-838262971508 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 82b86465-afb0-49ef-9932-1538010c1ae5] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:37.958368 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2a1c8943-16e9-482b-8d04-838262971508 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:37.958528 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2a1c8943-16e9-482b-8d04-838262971508 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:37.958918 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2a1c8943-16e9-482b-8d04-838262971508 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:37.959614 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2a1c8943-16e9-482b-8d04-838262971508 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:37.960066 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2a1c8943-16e9-482b-8d04-838262971508 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:37.966985 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2a1c8943-16e9-482b-8d04-838262971508 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:38.070522 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-48f3debe-f996-4ac7-9482-b441131528d3 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:38.072090 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-48f3debe-f996-4ac7-9482-b441131528d3 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] [instance: fa47906d-d394-46fe-9143-780bcd27a715] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:38.099878 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-48f3debe-f996-4ac7-9482-b441131528d3 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:38.100915 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-48f3debe-f996-4ac7-9482-b441131528d3 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:38.101843 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-48f3debe-f996-4ac7-9482-b441131528d3 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:38.103590 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-48f3debe-f996-4ac7-9482-b441131528d3 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:38.104360 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-48f3debe-f996-4ac7-9482-b441131528d3 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:38.105055 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-48f3debe-f996-4ac7-9482-b441131528d3 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:38.323536 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-2a1c8943-16e9-482b-8d04-838262971508 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:38.332722 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-2a1c8943-16e9-482b-8d04-838262971508 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5" status: 200 len: 1677 microversion: 2.1 time: 0.388417 Oct 04 18:46:38.335628 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1916/3591] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:37 2022] GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5 => generated 1677 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:38.347748 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-74da9c63-97ac-4e0d-ae87-4cab45ff2751 req-7c04001f-a96e-405a-842b-b25e82a0b7e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9886f261-8e00-4908-8fd8-f6ce9c6fd5b4", "name": "network-vif-plugged", "status": "completed", "tag": "7ad7933b-bb26-49b9-bc61-e535f1317b72"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:46:38.369791 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-74da9c63-97ac-4e0d-ae87-4cab45ff2751 req-7c04001f-a96e-405a-842b-b25e82a0b7e2 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:38.370431 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-74da9c63-97ac-4e0d-ae87-4cab45ff2751 req-7c04001f-a96e-405a-842b-b25e82a0b7e2 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:38.370871 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-74da9c63-97ac-4e0d-ae87-4cab45ff2751 req-7c04001f-a96e-405a-842b-b25e82a0b7e2 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:38.384440 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-74da9c63-97ac-4e0d-ae87-4cab45ff2751 req-7c04001f-a96e-405a-842b-b25e82a0b7e2 service nova] Creating event network-vif-plugged:7ad7933b-bb26-49b9-bc61-e535f1317b72 for instance 9886f261-8e00-4908-8fd8-f6ce9c6fd5b4 on n-h2-851028-13 Oct 04 18:46:38.391396 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-74da9c63-97ac-4e0d-ae87-4cab45ff2751 req-7c04001f-a96e-405a-842b-b25e82a0b7e2 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051592 Oct 04 18:46:38.396528 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1917/3592] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:46:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:46:38.402917 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-78c5af97-c951-4dfb-8eba-12edb2f64a7c req-5fffda13-2ab4-4fca-ad33-c9aaec06e502 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd09cc9b-d9dd-4133-8665-eeb6d8f51df8", "tag": "538a7aa2-5b2b-4b33-a253-770b58f4066e"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:46:38.418236 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-78c5af97-c951-4dfb-8eba-12edb2f64a7c req-5fffda13-2ab4-4fca-ad33-c9aaec06e502 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:38.428211 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-78c5af97-c951-4dfb-8eba-12edb2f64a7c req-5fffda13-2ab4-4fca-ad33-c9aaec06e502 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:38.428778 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-78c5af97-c951-4dfb-8eba-12edb2f64a7c req-5fffda13-2ab4-4fca-ad33-c9aaec06e502 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:38.460147 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-78c5af97-c951-4dfb-8eba-12edb2f64a7c req-5fffda13-2ab4-4fca-ad33-c9aaec06e502 service nova] Creating event network-changed:538a7aa2-5b2b-4b33-a253-770b58f4066e for instance fd09cc9b-d9dd-4133-8665-eeb6d8f51df8 on n-h1-851028-13 Oct 04 18:46:38.470356 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-78c5af97-c951-4dfb-8eba-12edb2f64a7c req-5fffda13-2ab4-4fca-ad33-c9aaec06e502 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071507 Oct 04 18:46:38.472832 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1918/3593] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:46:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:46:38.479045 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-8e566dd9-a2f4-4ac9-bf2a-b459cea691b0 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:38.479818 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-8e566dd9-a2f4-4ac9-bf2a-b459cea691b0 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] [instance: 00c17e4b-c80e-463e-a3e9-486c118552be] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:38.489036 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8e566dd9-a2f4-4ac9-bf2a-b459cea691b0 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:38.491894 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8e566dd9-a2f4-4ac9-bf2a-b459cea691b0 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:38.492377 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8e566dd9-a2f4-4ac9-bf2a-b459cea691b0 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:38.497713 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8e566dd9-a2f4-4ac9-bf2a-b459cea691b0 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:38.498401 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8e566dd9-a2f4-4ac9-bf2a-b459cea691b0 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:38.499039 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8e566dd9-a2f4-4ac9-bf2a-b459cea691b0 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:38.714912 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-48f3debe-f996-4ac7-9482-b441131528d3 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:38.735322 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-48f3debe-f996-4ac7-9482-b441131528d3 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:38.738043 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-48f3debe-f996-4ac7-9482-b441131528d3 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:38.739909 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-48f3debe-f996-4ac7-9482-b441131528d3 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] 10.222.0.43 "GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715" status: 200 len: 1874 microversion: 2.32 time: 0.677613 Oct 04 18:46:38.741255 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1676/3594] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:46:38 2022] GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715 => generated 1874 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:46:38.747798 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-25acb72c-b613-4af5-8433-acdc41990d48 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:38.748757 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-25acb72c-b613-4af5-8433-acdc41990d48 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] [instance: 76d475ab-f41c-44df-8aaa-10242bdbfcde] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:38.757064 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-25acb72c-b613-4af5-8433-acdc41990d48 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:38.758201 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-25acb72c-b613-4af5-8433-acdc41990d48 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:38.758852 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-25acb72c-b613-4af5-8433-acdc41990d48 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:38.760143 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-25acb72c-b613-4af5-8433-acdc41990d48 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:38.761032 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-25acb72c-b613-4af5-8433-acdc41990d48 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:38.761744 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-25acb72c-b613-4af5-8433-acdc41990d48 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:39.120105 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-8e566dd9-a2f4-4ac9-bf2a-b459cea691b0 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c710f394164b89b16bcac2fe51c58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65037d4ea5124d749e42928032e803fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:39.131382 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-8e566dd9-a2f4-4ac9-bf2a-b459cea691b0 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] 10.222.0.43 "GET /compute/v2.1/servers/00c17e4b-c80e-463e-a3e9-486c118552be" status: 200 len: 1517 microversion: 2.1 time: 0.657118 Oct 04 18:46:39.132298 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1919/3595] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:38 2022] GET /compute/v2.1/servers/00c17e4b-c80e-463e-a3e9-486c118552be => generated 1517 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:39.142370 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-4b7f90d5-a2e2-4d2d-a914-26d481fdb6dc tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:39.143292 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-4b7f90d5-a2e2-4d2d-a914-26d481fdb6dc tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] [instance: 9886f261-8e00-4908-8fd8-f6ce9c6fd5b4] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:39.150342 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4b7f90d5-a2e2-4d2d-a914-26d481fdb6dc tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:39.151129 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4b7f90d5-a2e2-4d2d-a914-26d481fdb6dc tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:39.151570 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4b7f90d5-a2e2-4d2d-a914-26d481fdb6dc tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:39.152476 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4b7f90d5-a2e2-4d2d-a914-26d481fdb6dc tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:39.167290 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4b7f90d5-a2e2-4d2d-a914-26d481fdb6dc tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:39.167768 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4b7f90d5-a2e2-4d2d-a914-26d481fdb6dc tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:39.428913 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-25acb72c-b613-4af5-8433-acdc41990d48 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a116f2d9656548458264cc4fb1934c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff3c3dc76405401baf72fe00c5d50b56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:39.441153 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-25acb72c-b613-4af5-8433-acdc41990d48 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] 10.222.0.43 "GET /compute/v2.1/servers/76d475ab-f41c-44df-8aaa-10242bdbfcde" status: 200 len: 1724 microversion: 2.1 time: 0.698443 Oct 04 18:46:39.449902 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-4b7f90d5-a2e2-4d2d-a914-26d481fdb6dc tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcbf2b4b95743af9e6fa1be54554baa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab4da2b9b9f4c7a9c25b7edaab3027d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:39.456841 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1677/3596] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:38 2022] GET /compute/v2.1/servers/76d475ab-f41c-44df-8aaa-10242bdbfcde => generated 1724 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:39.461781 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-27c1487a-071d-4983-bd34-9aaeea2fd00c tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:39.462411 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-27c1487a-071d-4983-bd34-9aaeea2fd00c tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] [instance: fd09cc9b-d9dd-4133-8665-eeb6d8f51df8] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:39.464975 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-4b7f90d5-a2e2-4d2d-a914-26d481fdb6dc tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] 10.222.0.43 "GET /compute/v2.1/servers/9886f261-8e00-4908-8fd8-f6ce9c6fd5b4" status: 200 len: 1325 microversion: 2.1 time: 0.331465 Oct 04 18:46:39.474539 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-27c1487a-071d-4983-bd34-9aaeea2fd00c tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:39.474539 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-27c1487a-071d-4983-bd34-9aaeea2fd00c tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:39.474539 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-27c1487a-071d-4983-bd34-9aaeea2fd00c tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:39.474539 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-27c1487a-071d-4983-bd34-9aaeea2fd00c tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:39.474539 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-27c1487a-071d-4983-bd34-9aaeea2fd00c tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:39.474539 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-27c1487a-071d-4983-bd34-9aaeea2fd00c tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:39.475824 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1920/3597] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:39 2022] GET /compute/v2.1/servers/9886f261-8e00-4908-8fd8-f6ce9c6fd5b4 => generated 1325 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:39.484365 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-88bde0d0-62c5-486c-9794-6839b55b31b3 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:39.486313 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-88bde0d0-62c5-486c-9794-6839b55b31b3 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 82b86465-afb0-49ef-9932-1538010c1ae5] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:39.493166 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-88bde0d0-62c5-486c-9794-6839b55b31b3 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:39.493808 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-88bde0d0-62c5-486c-9794-6839b55b31b3 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:39.494352 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-88bde0d0-62c5-486c-9794-6839b55b31b3 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:39.495817 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-88bde0d0-62c5-486c-9794-6839b55b31b3 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:39.496397 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-88bde0d0-62c5-486c-9794-6839b55b31b3 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:39.497773 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-88bde0d0-62c5-486c-9794-6839b55b31b3 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:39.739642 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-88bde0d0-62c5-486c-9794-6839b55b31b3 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:39.745507 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-27c1487a-071d-4983-bd34-9aaeea2fd00c tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9971b5861f44c1a1da94eda0f8f02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f809b8ae704988961908bef0f3cb24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:39.748677 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-88bde0d0-62c5-486c-9794-6839b55b31b3 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5" status: 200 len: 1654 microversion: 2.1 time: 0.271554 Oct 04 18:46:39.750223 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1921/3598] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:39 2022] GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5 => generated 1654 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:39.754621 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-27c1487a-071d-4983-bd34-9aaeea2fd00c tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] 10.222.0.43 "GET /compute/v2.1/servers/fd09cc9b-d9dd-4133-8665-eeb6d8f51df8" status: 200 len: 1199 microversion: 2.1 time: 0.296589 Oct 04 18:46:39.756521 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1678/3599] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:39 2022] GET /compute/v2.1/servers/fd09cc9b-d9dd-4133-8665-eeb6d8f51df8 => generated 1199 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:39.776459 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-bdcdde6d-0ac2-4c4b-aefc-3a907dbe1a12 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:39.777166 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-bdcdde6d-0ac2-4c4b-aefc-3a907dbe1a12 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] [instance: fa47906d-d394-46fe-9143-780bcd27a715] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:39.777431 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-da36da2a-37bb-4c78-bc30-082c224740d6 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:46:39.784560 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-da36da2a-37bb-4c78-bc30-082c224740d6 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:39.784735 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bdcdde6d-0ac2-4c4b-aefc-3a907dbe1a12 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:39.785057 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-da36da2a-37bb-4c78-bc30-082c224740d6 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:39.785207 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bdcdde6d-0ac2-4c4b-aefc-3a907dbe1a12 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:39.785541 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-da36da2a-37bb-4c78-bc30-082c224740d6 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:39.785660 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bdcdde6d-0ac2-4c4b-aefc-3a907dbe1a12 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:39.786303 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bdcdde6d-0ac2-4c4b-aefc-3a907dbe1a12 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:39.786767 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bdcdde6d-0ac2-4c4b-aefc-3a907dbe1a12 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:39.787202 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bdcdde6d-0ac2-4c4b-aefc-3a907dbe1a12 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:39.812619 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-da36da2a-37bb-4c78-bc30-082c224740d6 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 82b86465-afb0-49ef-9932-1538010c1ae5] Going to try to start instance {{(pid=123595) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 04 18:46:39.865529 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-da36da2a-37bb-4c78-bc30-082c224740d6 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "POST /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5/action" status: 202 len: 0 microversion: 2.1 time: 0.092701 Oct 04 18:46:39.866136 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1679/3600] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 18:46:39 2022] POST /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:46:39.875307 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-97936d18-8a92-4d0f-a6cf-11d5846d9d25 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:39.875958 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-97936d18-8a92-4d0f-a6cf-11d5846d9d25 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 82b86465-afb0-49ef-9932-1538010c1ae5] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:39.882941 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-97936d18-8a92-4d0f-a6cf-11d5846d9d25 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:39.883438 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-97936d18-8a92-4d0f-a6cf-11d5846d9d25 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:39.883880 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-97936d18-8a92-4d0f-a6cf-11d5846d9d25 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:39.884572 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-97936d18-8a92-4d0f-a6cf-11d5846d9d25 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:39.885025 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-97936d18-8a92-4d0f-a6cf-11d5846d9d25 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:39.885505 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-97936d18-8a92-4d0f-a6cf-11d5846d9d25 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:40.054226 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-97936d18-8a92-4d0f-a6cf-11d5846d9d25 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:40.078889 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-97936d18-8a92-4d0f-a6cf-11d5846d9d25 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5" status: 200 len: 1663 microversion: 2.1 time: 0.208247 Oct 04 18:46:40.081015 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1680/3601] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:39 2022] GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5 => generated 1663 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:46:40.104672 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-bdcdde6d-0ac2-4c4b-aefc-3a907dbe1a12 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:40.115796 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-bdcdde6d-0ac2-4c4b-aefc-3a907dbe1a12 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:40.117678 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-bdcdde6d-0ac2-4c4b-aefc-3a907dbe1a12 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:40.118916 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-bdcdde6d-0ac2-4c4b-aefc-3a907dbe1a12 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] 10.222.0.43 "GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715" status: 200 len: 1874 microversion: 2.32 time: 0.350944 Oct 04 18:46:40.119713 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1922/3602] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:46:39 2022] GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715 => generated 1874 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:46:40.156360 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-65abb035-47dc-42e2-995a-6ffc3a340aad tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:40.157576 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-65abb035-47dc-42e2-995a-6ffc3a340aad tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] [instance: 00c17e4b-c80e-463e-a3e9-486c118552be] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:40.164734 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-65abb035-47dc-42e2-995a-6ffc3a340aad tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:40.165373 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-65abb035-47dc-42e2-995a-6ffc3a340aad tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:40.165923 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-65abb035-47dc-42e2-995a-6ffc3a340aad tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:40.166738 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-65abb035-47dc-42e2-995a-6ffc3a340aad tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:40.167355 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-65abb035-47dc-42e2-995a-6ffc3a340aad tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:40.167892 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-65abb035-47dc-42e2-995a-6ffc3a340aad tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:40.362347 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-65abb035-47dc-42e2-995a-6ffc3a340aad tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c710f394164b89b16bcac2fe51c58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65037d4ea5124d749e42928032e803fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:40.371096 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-65abb035-47dc-42e2-995a-6ffc3a340aad tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] 10.222.0.43 "GET /compute/v2.1/servers/00c17e4b-c80e-463e-a3e9-486c118552be" status: 200 len: 1517 microversion: 2.1 time: 0.218941 Oct 04 18:46:40.372132 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1681/3603] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:40 2022] GET /compute/v2.1/servers/00c17e4b-c80e-463e-a3e9-486c118552be => generated 1517 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:40.464413 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-bc756717-e30b-4bc4-927f-3229e8e0e123 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:40.465132 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-bc756717-e30b-4bc4-927f-3229e8e0e123 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] [instance: 76d475ab-f41c-44df-8aaa-10242bdbfcde] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:40.474217 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bc756717-e30b-4bc4-927f-3229e8e0e123 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:40.479501 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bc756717-e30b-4bc4-927f-3229e8e0e123 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:40.480260 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bc756717-e30b-4bc4-927f-3229e8e0e123 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:40.481217 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bc756717-e30b-4bc4-927f-3229e8e0e123 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:40.481854 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bc756717-e30b-4bc4-927f-3229e8e0e123 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:40.482450 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bc756717-e30b-4bc4-927f-3229e8e0e123 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:40.495485 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-7c712f84-567a-4017-8ca3-39185df50c84 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:40.496619 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-7c712f84-567a-4017-8ca3-39185df50c84 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] [instance: 9886f261-8e00-4908-8fd8-f6ce9c6fd5b4] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:40.505909 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7c712f84-567a-4017-8ca3-39185df50c84 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:40.506558 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7c712f84-567a-4017-8ca3-39185df50c84 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:40.507109 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7c712f84-567a-4017-8ca3-39185df50c84 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:40.508049 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7c712f84-567a-4017-8ca3-39185df50c84 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:40.508627 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7c712f84-567a-4017-8ca3-39185df50c84 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:40.509199 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7c712f84-567a-4017-8ca3-39185df50c84 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:40.677503 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=4 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:46:40.702141 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=14 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:46:40.740225 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-7c712f84-567a-4017-8ca3-39185df50c84 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcbf2b4b95743af9e6fa1be54554baa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab4da2b9b9f4c7a9c25b7edaab3027d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:40.743931 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-bc756717-e30b-4bc4-927f-3229e8e0e123 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a116f2d9656548458264cc4fb1934c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff3c3dc76405401baf72fe00c5d50b56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:40.749701 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-7c712f84-567a-4017-8ca3-39185df50c84 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] 10.222.0.43 "GET /compute/v2.1/servers/9886f261-8e00-4908-8fd8-f6ce9c6fd5b4" status: 200 len: 1521 microversion: 2.1 time: 0.261042 Oct 04 18:46:40.750611 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1682/3604] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:40 2022] GET /compute/v2.1/servers/9886f261-8e00-4908-8fd8-f6ce9c6fd5b4 => generated 1521 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:40.754073 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-bc756717-e30b-4bc4-927f-3229e8e0e123 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] 10.222.0.43 "GET /compute/v2.1/servers/76d475ab-f41c-44df-8aaa-10242bdbfcde" status: 200 len: 1724 microversion: 2.1 time: 0.294006 Oct 04 18:46:40.755092 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1923/3605] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:40 2022] GET /compute/v2.1/servers/76d475ab-f41c-44df-8aaa-10242bdbfcde => generated 1724 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:40.772915 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-2688ebe6-5d53-445d-84c6-999134302ce1 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:40.773592 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-2688ebe6-5d53-445d-84c6-999134302ce1 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] [instance: 9886f261-8e00-4908-8fd8-f6ce9c6fd5b4] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:40.784077 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-70fa1258-83d8-44e4-a0c9-c2fa880f6acb tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:40.784695 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-70fa1258-83d8-44e4-a0c9-c2fa880f6acb tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] [instance: fd09cc9b-d9dd-4133-8665-eeb6d8f51df8] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:40.790007 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2688ebe6-5d53-445d-84c6-999134302ce1 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:40.790506 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2688ebe6-5d53-445d-84c6-999134302ce1 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:40.790955 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2688ebe6-5d53-445d-84c6-999134302ce1 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:40.791676 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2688ebe6-5d53-445d-84c6-999134302ce1 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:40.792131 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2688ebe6-5d53-445d-84c6-999134302ce1 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:40.792560 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2688ebe6-5d53-445d-84c6-999134302ce1 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:40.800591 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-70fa1258-83d8-44e4-a0c9-c2fa880f6acb tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:40.801085 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-70fa1258-83d8-44e4-a0c9-c2fa880f6acb tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:40.801553 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-70fa1258-83d8-44e4-a0c9-c2fa880f6acb tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:40.802266 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-70fa1258-83d8-44e4-a0c9-c2fa880f6acb tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:40.802720 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-70fa1258-83d8-44e4-a0c9-c2fa880f6acb tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:40.803152 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-70fa1258-83d8-44e4-a0c9-c2fa880f6acb tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:40.986488 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-70fa1258-83d8-44e4-a0c9-c2fa880f6acb tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9971b5861f44c1a1da94eda0f8f02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f809b8ae704988961908bef0f3cb24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:40.999505 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-70fa1258-83d8-44e4-a0c9-c2fa880f6acb tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] 10.222.0.43 "GET /compute/v2.1/servers/fd09cc9b-d9dd-4133-8665-eeb6d8f51df8" status: 200 len: 1199 microversion: 2.1 time: 0.221479 Oct 04 18:46:41.000346 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1924/3606] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:40 2022] GET /compute/v2.1/servers/fd09cc9b-d9dd-4133-8665-eeb6d8f51df8 => generated 1199 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:41.103909 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-81a364f7-2144-4ecd-af86-e80a7532d2c3 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:41.104569 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-81a364f7-2144-4ecd-af86-e80a7532d2c3 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 82b86465-afb0-49ef-9932-1538010c1ae5] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:41.111867 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-81a364f7-2144-4ecd-af86-e80a7532d2c3 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:41.112368 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-81a364f7-2144-4ecd-af86-e80a7532d2c3 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:41.112809 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-81a364f7-2144-4ecd-af86-e80a7532d2c3 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:41.113552 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-81a364f7-2144-4ecd-af86-e80a7532d2c3 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:41.114013 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-81a364f7-2144-4ecd-af86-e80a7532d2c3 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:41.114445 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-81a364f7-2144-4ecd-af86-e80a7532d2c3 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:41.233995 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-2688ebe6-5d53-445d-84c6-999134302ce1 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcbf2b4b95743af9e6fa1be54554baa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab4da2b9b9f4c7a9c25b7edaab3027d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:41.246119 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-2688ebe6-5d53-445d-84c6-999134302ce1 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] 10.222.0.43 "GET /compute/v2.1/servers/9886f261-8e00-4908-8fd8-f6ce9c6fd5b4" status: 200 len: 1521 microversion: 2.1 time: 0.476945 Oct 04 18:46:41.247290 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1683/3607] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:40 2022] GET /compute/v2.1/servers/9886f261-8e00-4908-8fd8-f6ce9c6fd5b4 => generated 1521 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:41.256839 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-cd492da7-a9e3-4b9b-9d7a-d39933053b4f tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:41.258064 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-cd492da7-a9e3-4b9b-9d7a-d39933053b4f tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] [instance: fa47906d-d394-46fe-9143-780bcd27a715] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:41.268635 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cd492da7-a9e3-4b9b-9d7a-d39933053b4f tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:41.269535 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cd492da7-a9e3-4b9b-9d7a-d39933053b4f tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:41.270302 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cd492da7-a9e3-4b9b-9d7a-d39933053b4f tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:41.271426 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cd492da7-a9e3-4b9b-9d7a-d39933053b4f tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:41.272203 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cd492da7-a9e3-4b9b-9d7a-d39933053b4f tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:41.272972 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cd492da7-a9e3-4b9b-9d7a-d39933053b4f tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:41.278437 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-81a364f7-2144-4ecd-af86-e80a7532d2c3 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:41.288282 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-81a364f7-2144-4ecd-af86-e80a7532d2c3 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5" status: 200 len: 1663 microversion: 2.1 time: 0.188220 Oct 04 18:46:41.289139 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1925/3608] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:41 2022] GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5 => generated 1663 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:46:41.294623 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-64d1917e-3b30-4d60-a1d3-87ca963e7d35 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-52814728", "metadata": {"": ""}}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:46:41.299348 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-64d1917e-3b30-4d60-a1d3-87ca963e7d35 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Request method failure captured: Oct 04 18:46:41.299348 n-d-851028-13 devstack@n-api.service[123596]: request: POST /compute/v2.1/servers/9886f261-8e00-4908-8fd8-f6ce9c6fd5b4/action HTTP/1.1 Oct 04 18:46:41.299348 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:46:41.299348 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:46:41.299348 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:46:41.299348 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 105 Oct 04 18:46:41.299348 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:46:41.299348 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:46:41.299348 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:46:41.299348 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:46:41.299348 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPH978iZmaQey9qRFmivrOEN9WI4gFjhDc3nSUPEBZXv1WUgd7GTFhNQGJ_Nm2KHTEzU5QZw7VgnyxDt5Dwy3JGK8gUnF9wIKq6iB3FX5CCTGK5JwEw-XtwnwemZOTSVwZU_4nc3l4c2itfEGLVIoX2yb6G-IjSzn-sL8697UlYQlcew Oct 04 18:46:41.299348 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:46:41.299348 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:46:41.299348 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:46:41.299348 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:46:41.299348 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:46:41.299348 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:46:41.299348 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: 8ab4da2b9b9f4c7a9c25b7edaab3027d Oct 04 18:46:41.299348 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2004915413 Oct 04 18:46:41.299348 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 18:46:41.299348 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 18:46:41.299348 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/8ab4da2b9b9f4c7a9c25b7edaab3027d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_8ab4da2b9b9f4c7a9c25b7edaab3027d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8ab4da2b9b9f4c7a9c25b7edaab3027d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8ab4da2b9b9f4c7a9c25b7edaab3027d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:46:41.299348 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2004915413 Oct 04 18:46:41.299348 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: 8ab4da2b9b9f4c7a9c25b7edaab3027d Oct 04 18:46:41.299348 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2004915413 Oct 04 18:46:41.299348 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-ImagesOneServerNegativeTestJSON-2004915413-project Oct 04 18:46:41.299348 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:46:41.299348 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:46:41.299348 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: cdcbf2b4b95743af9e6fa1be54554baa Oct 04 18:46:41.299348 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2004915413-project Oct 04 18:46:41.299348 n-d-851028-13 devstack@n-api.service[123596]: Oct 04 18:46:41.299348 n-d-851028-13 devstack@n-api.service[123596]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-52814728", "metadata": {"": ""}}} Oct 04 18:46:41.299348 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 18:46:41.299348 n-d-851028-13 devstack@n-api.service[123596]: exception: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 18:46:41.299348 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': '9886f261-8e00-4908-8fd8-f6ce9c6fd5b4', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-52814728', 'metadata': {'': ''}}}} Oct 04 18:46:41.299348 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:46:41.299348 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:46:41.299348 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:46:41.299348 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:46:41.299348 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:46:41.299348 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:46:41.299348 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 18:46:41.299348 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:46:41.299348 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Oct 04 18:46:41.299348 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 04 18:46:41.299348 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 04 18:46:41.299348 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 04 18:46:41.299348 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 04 18:46:41.299348 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:46:41.299348 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 04 18:46:41.299348 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi {'': ''} Oct 04 18:46:41.299348 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:46:41.299348 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:46:41.299348 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:46:41.299348 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:46:41.299348 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:46:41.299348 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:46:41.299348 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:46:41.299348 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:46:41.299348 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:46:41.299348 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:46:41.299348 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:46:41.299348 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:46:41.299348 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 18:46:41.304864 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 18:46:41.304864 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:46:41.304864 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:46:41.304864 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:46:41.304864 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:46:41.304864 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 18:46:41.304864 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:46:41.304864 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:46:41.304864 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:46:41.304864 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:46:41.304864 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:46:41.304864 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:46:41.304864 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:46:41.304864 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:46:41.304864 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 18:46:41.304864 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:46:41.307408 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-64d1917e-3b30-4d60-a1d3-87ca963e7d35 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:46:41.308370 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-64d1917e-3b30-4d60-a1d3-87ca963e7d35 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] 10.222.0.43 "POST /compute/v2.1/servers/9886f261-8e00-4908-8fd8-f6ce9c6fd5b4/action" status: 400 len: 170 microversion: 2.1 time: 0.017839 Oct 04 18:46:41.308989 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1926/3609] 10.222.0.43 () {60 vars in 1279 bytes} [Tue Oct 4 18:46:41 2022] POST /compute/v2.1/servers/9886f261-8e00-4908-8fd8-f6ce9c6fd5b4/action => generated 170 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:46:41.317781 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-1f9109da-bf90-4472-ac79-27bd8e96601b tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:41.318398 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-1f9109da-bf90-4472-ac79-27bd8e96601b tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] [instance: 9886f261-8e00-4908-8fd8-f6ce9c6fd5b4] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:41.326780 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1f9109da-bf90-4472-ac79-27bd8e96601b tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:41.328994 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1f9109da-bf90-4472-ac79-27bd8e96601b tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:41.329519 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1f9109da-bf90-4472-ac79-27bd8e96601b tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:41.330238 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1f9109da-bf90-4472-ac79-27bd8e96601b tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:41.330897 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1f9109da-bf90-4472-ac79-27bd8e96601b tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:41.331346 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1f9109da-bf90-4472-ac79-27bd8e96601b tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:41.369176 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=2 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:46:41.505576 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-1f9109da-bf90-4472-ac79-27bd8e96601b tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcbf2b4b95743af9e6fa1be54554baa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab4da2b9b9f4c7a9c25b7edaab3027d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:41.514860 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-1f9109da-bf90-4472-ac79-27bd8e96601b tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] 10.222.0.43 "GET /compute/v2.1/servers/9886f261-8e00-4908-8fd8-f6ce9c6fd5b4" status: 200 len: 1521 microversion: 2.1 time: 0.201066 Oct 04 18:46:41.529852 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1927/3610] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:41 2022] GET /compute/v2.1/servers/9886f261-8e00-4908-8fd8-f6ce9c6fd5b4 => generated 1521 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:46:41.529852 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-08014ae5-e933-42cf-b03b-d3baec210ce8 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:41.529852 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-08014ae5-e933-42cf-b03b-d3baec210ce8 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] [instance: 00c17e4b-c80e-463e-a3e9-486c118552be] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:41.537061 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-08014ae5-e933-42cf-b03b-d3baec210ce8 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:41.537061 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-08014ae5-e933-42cf-b03b-d3baec210ce8 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:41.537061 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-08014ae5-e933-42cf-b03b-d3baec210ce8 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:41.537061 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-08014ae5-e933-42cf-b03b-d3baec210ce8 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:41.537061 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-08014ae5-e933-42cf-b03b-d3baec210ce8 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:41.537061 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-08014ae5-e933-42cf-b03b-d3baec210ce8 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:41.766948 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-cd492da7-a9e3-4b9b-9d7a-d39933053b4f tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:41.779968 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-cd492da7-a9e3-4b9b-9d7a-d39933053b4f tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:41.782133 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-cd492da7-a9e3-4b9b-9d7a-d39933053b4f tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:41.783361 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-cd492da7-a9e3-4b9b-9d7a-d39933053b4f tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] 10.222.0.43 "GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715" status: 200 len: 1874 microversion: 2.32 time: 0.534016 Oct 04 18:46:41.784157 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1684/3611] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:46:41 2022] GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715 => generated 1874 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:46:41.789171 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-fa54eee1-3048-4714-b238-59b845e7a9aa tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:41.790015 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-fa54eee1-3048-4714-b238-59b845e7a9aa tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] [instance: 9886f261-8e00-4908-8fd8-f6ce9c6fd5b4] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:41.796979 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fa54eee1-3048-4714-b238-59b845e7a9aa tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:41.797765 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fa54eee1-3048-4714-b238-59b845e7a9aa tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:41.798418 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fa54eee1-3048-4714-b238-59b845e7a9aa tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:41.799333 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fa54eee1-3048-4714-b238-59b845e7a9aa tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:41.799971 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fa54eee1-3048-4714-b238-59b845e7a9aa tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:41.800581 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fa54eee1-3048-4714-b238-59b845e7a9aa tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:41.837152 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-08014ae5-e933-42cf-b03b-d3baec210ce8 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c710f394164b89b16bcac2fe51c58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65037d4ea5124d749e42928032e803fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:41.846387 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-08014ae5-e933-42cf-b03b-d3baec210ce8 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] 10.222.0.43 "GET /compute/v2.1/servers/00c17e4b-c80e-463e-a3e9-486c118552be" status: 200 len: 1517 microversion: 2.1 time: 0.328935 Oct 04 18:46:41.846980 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1928/3612] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:41 2022] GET /compute/v2.1/servers/00c17e4b-c80e-463e-a3e9-486c118552be => generated 1517 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:41.851633 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-0f961ece-2023-4317-be9c-c1f3e98b1f55 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:41.852267 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-0f961ece-2023-4317-be9c-c1f3e98b1f55 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] [instance: 76d475ab-f41c-44df-8aaa-10242bdbfcde] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:41.862436 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0f961ece-2023-4317-be9c-c1f3e98b1f55 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:41.862945 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0f961ece-2023-4317-be9c-c1f3e98b1f55 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:41.863395 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0f961ece-2023-4317-be9c-c1f3e98b1f55 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:41.864119 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0f961ece-2023-4317-be9c-c1f3e98b1f55 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:41.864580 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0f961ece-2023-4317-be9c-c1f3e98b1f55 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:41.865014 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0f961ece-2023-4317-be9c-c1f3e98b1f55 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:42.112141 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-0f961ece-2023-4317-be9c-c1f3e98b1f55 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a116f2d9656548458264cc4fb1934c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff3c3dc76405401baf72fe00c5d50b56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:42.131820 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-fa54eee1-3048-4714-b238-59b845e7a9aa tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcbf2b4b95743af9e6fa1be54554baa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab4da2b9b9f4c7a9c25b7edaab3027d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:42.139708 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-0f961ece-2023-4317-be9c-c1f3e98b1f55 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] 10.222.0.43 "GET /compute/v2.1/servers/76d475ab-f41c-44df-8aaa-10242bdbfcde" status: 200 len: 1724 microversion: 2.1 time: 0.291603 Oct 04 18:46:42.140412 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1929/3613] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:41 2022] GET /compute/v2.1/servers/76d475ab-f41c-44df-8aaa-10242bdbfcde => generated 1724 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:42.142577 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-fa54eee1-3048-4714-b238-59b845e7a9aa tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] 10.222.0.43 "GET /compute/v2.1/servers/9886f261-8e00-4908-8fd8-f6ce9c6fd5b4" status: 200 len: 1521 microversion: 2.1 time: 0.357203 Oct 04 18:46:42.144377 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1685/3614] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:41 2022] GET /compute/v2.1/servers/9886f261-8e00-4908-8fd8-f6ce9c6fd5b4 => generated 1521 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:42.149551 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-afb62341-67e4-4f90-9cdc-f91e7f902ca1 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:42.151222 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-afb62341-67e4-4f90-9cdc-f91e7f902ca1 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] [instance: fd09cc9b-d9dd-4133-8665-eeb6d8f51df8] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:42.166634 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-afb62341-67e4-4f90-9cdc-f91e7f902ca1 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:42.167132 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-afb62341-67e4-4f90-9cdc-f91e7f902ca1 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:42.167574 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-afb62341-67e4-4f90-9cdc-f91e7f902ca1 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:42.168280 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-afb62341-67e4-4f90-9cdc-f91e7f902ca1 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:42.168879 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-afb62341-67e4-4f90-9cdc-f91e7f902ca1 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:42.169063 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-6d758c67-5c81-4c47-aac0-ddc2c523bf36 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-644176513", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:46:42.169463 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-afb62341-67e4-4f90-9cdc-f91e7f902ca1 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:42.174330 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-6d758c67-5c81-4c47-aac0-ddc2c523bf36 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Request method failure captured: Oct 04 18:46:42.174330 n-d-851028-13 devstack@n-api.service[123595]: request: POST /compute/v2.1/servers/9886f261-8e00-4908-8fd8-f6ce9c6fd5b4/action HTTP/1.1 Oct 04 18:46:42.174330 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 18:46:42.174330 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 18:46:42.174330 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 18:46:42.174330 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 618 Oct 04 18:46:42.174330 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 18:46:42.174330 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 18:46:42.174330 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 18:46:42.174330 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 18:46:42.174330 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPH978iZmaQey9qRFmivrOEN9WI4gFjhDc3nSUPEBZXv1WUgd7GTFhNQGJ_Nm2KHTEzU5QZw7VgnyxDt5Dwy3JGK8gUnF9wIKq6iB3FX5CCTGK5JwEw-XtwnwemZOTSVwZU_4nc3l4c2itfEGLVIoX2yb6G-IjSzn-sL8697UlYQlcew Oct 04 18:46:42.174330 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 18:46:42.174330 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 18:46:42.174330 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 18:46:42.174330 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 18:46:42.174330 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 18:46:42.174330 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 18:46:42.174330 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: 8ab4da2b9b9f4c7a9c25b7edaab3027d Oct 04 18:46:42.174330 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2004915413 Oct 04 18:46:42.174330 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 18:46:42.174330 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 18:46:42.174330 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/8ab4da2b9b9f4c7a9c25b7edaab3027d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_8ab4da2b9b9f4c7a9c25b7edaab3027d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8ab4da2b9b9f4c7a9c25b7edaab3027d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8ab4da2b9b9f4c7a9c25b7edaab3027d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:46:42.174330 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2004915413 Oct 04 18:46:42.174330 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: 8ab4da2b9b9f4c7a9c25b7edaab3027d Oct 04 18:46:42.174330 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2004915413 Oct 04 18:46:42.174330 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-ImagesOneServerNegativeTestJSON-2004915413-project Oct 04 18:46:42.174330 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 18:46:42.174330 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 18:46:42.174330 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: cdcbf2b4b95743af9e6fa1be54554baa Oct 04 18:46:42.174330 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2004915413-project Oct 04 18:46:42.174330 n-d-851028-13 devstack@n-api.service[123595]: Oct 04 18:46:42.174330 n-d-851028-13 devstack@n-api.service[123595]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-644176513", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} Oct 04 18:46:42.174330 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 18:46:42.174330 n-d-851028-13 devstack@n-api.service[123595]: exception: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 18:46:42.174330 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': '9886f261-8e00-4908-8fd8-f6ce9c6fd5b4', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-644176513', 'metadata': {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}}}} Oct 04 18:46:42.174330 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:46:42.174330 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:46:42.174330 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:46:42.174330 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:46:42.174330 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:46:42.174330 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:46:42.178091 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 18:46:42.178091 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:46:42.178091 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Oct 04 18:46:42.178091 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 04 18:46:42.178091 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 04 18:46:42.178091 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 04 18:46:42.178091 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 04 18:46:42.178091 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:46:42.178091 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 04 18:46:42.178091 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'} Oct 04 18:46:42.178091 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:46:42.178091 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:46:42.178091 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:46:42.178091 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:46:42.178091 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:46:42.178091 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:46:42.178091 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:46:42.178091 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:46:42.178091 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:46:42.178091 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:46:42.178091 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:46:42.178091 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:46:42.178091 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 18:46:42.178091 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 18:46:42.178091 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:46:42.178091 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:46:42.178091 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:46:42.178091 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:46:42.178091 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 18:46:42.178091 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:46:42.178091 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:46:42.178091 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:46:42.178091 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:46:42.178091 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:46:42.178091 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:46:42.178091 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:46:42.178091 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:46:42.178091 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 18:46:42.178091 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:46:42.181439 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-6d758c67-5c81-4c47-aac0-ddc2c523bf36 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:46:42.182375 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-6d758c67-5c81-4c47-aac0-ddc2c523bf36 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] 10.222.0.43 "POST /compute/v2.1/servers/9886f261-8e00-4908-8fd8-f6ce9c6fd5b4/action" status: 400 len: 938 microversion: 2.1 time: 0.018565 Oct 04 18:46:42.183090 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1686/3615] 10.222.0.43 () {60 vars in 1279 bytes} [Tue Oct 4 18:46:42 2022] POST /compute/v2.1/servers/9886f261-8e00-4908-8fd8-f6ce9c6fd5b4/action => generated 938 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 04 18:46:42.192481 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-67740e25-5cc2-4a77-9631-33f87fee8f97 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:42.193727 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-67740e25-5cc2-4a77-9631-33f87fee8f97 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] [instance: 9886f261-8e00-4908-8fd8-f6ce9c6fd5b4] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:42.203103 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-67740e25-5cc2-4a77-9631-33f87fee8f97 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:42.203751 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-67740e25-5cc2-4a77-9631-33f87fee8f97 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:42.204299 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-67740e25-5cc2-4a77-9631-33f87fee8f97 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:42.205156 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-67740e25-5cc2-4a77-9631-33f87fee8f97 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:42.205728 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-67740e25-5cc2-4a77-9631-33f87fee8f97 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:42.206263 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-67740e25-5cc2-4a77-9631-33f87fee8f97 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:42.339989 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-afb62341-67e4-4f90-9cdc-f91e7f902ca1 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9971b5861f44c1a1da94eda0f8f02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f809b8ae704988961908bef0f3cb24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:42.348745 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-afb62341-67e4-4f90-9cdc-f91e7f902ca1 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] 10.222.0.43 "GET /compute/v2.1/servers/fd09cc9b-d9dd-4133-8665-eeb6d8f51df8" status: 200 len: 1199 microversion: 2.1 time: 0.206820 Oct 04 18:46:42.349547 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1930/3616] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:42 2022] GET /compute/v2.1/servers/fd09cc9b-d9dd-4133-8665-eeb6d8f51df8 => generated 1199 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:42.354673 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-b005ba24-8919-48b9-9b97-67461a91b972 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:42.355590 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-b005ba24-8919-48b9-9b97-67461a91b972 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 82b86465-afb0-49ef-9932-1538010c1ae5] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:42.369562 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b005ba24-8919-48b9-9b97-67461a91b972 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:42.370276 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b005ba24-8919-48b9-9b97-67461a91b972 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:42.370881 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b005ba24-8919-48b9-9b97-67461a91b972 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:42.371760 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b005ba24-8919-48b9-9b97-67461a91b972 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:42.372392 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b005ba24-8919-48b9-9b97-67461a91b972 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:42.372939 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b005ba24-8919-48b9-9b97-67461a91b972 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:42.520694 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-b005ba24-8919-48b9-9b97-67461a91b972 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:42.529304 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-b005ba24-8919-48b9-9b97-67461a91b972 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5" status: 200 len: 1667 microversion: 2.1 time: 0.178340 Oct 04 18:46:42.529833 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1931/3617] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:42 2022] GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5 => generated 1667 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:42.553049 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-03fddf38-7125-4631-9cbf-9da9ddfe56e3 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:42.553668 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-03fddf38-7125-4631-9cbf-9da9ddfe56e3 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 82b86465-afb0-49ef-9932-1538010c1ae5] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:42.560293 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-03fddf38-7125-4631-9cbf-9da9ddfe56e3 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:42.560533 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-03fddf38-7125-4631-9cbf-9da9ddfe56e3 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:42.560911 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-03fddf38-7125-4631-9cbf-9da9ddfe56e3 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:42.561878 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-03fddf38-7125-4631-9cbf-9da9ddfe56e3 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:42.562136 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-03fddf38-7125-4631-9cbf-9da9ddfe56e3 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:42.562747 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-03fddf38-7125-4631-9cbf-9da9ddfe56e3 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:42.586746 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=100 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:46:42.766819 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-03fddf38-7125-4631-9cbf-9da9ddfe56e3 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:42.768325 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-03fddf38-7125-4631-9cbf-9da9ddfe56e3 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5" status: 200 len: 1667 microversion: 2.1 time: 0.214811 Oct 04 18:46:42.768961 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1932/3618] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:42 2022] GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5 => generated 1667 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:46:42.791550 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-9f135546-dd40-473d-99cd-658d957f7974 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:46:42.792112 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-9f135546-dd40-473d-99cd-658d957f7974 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 82b86465-afb0-49ef-9932-1538010c1ae5] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:42.798851 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9f135546-dd40-473d-99cd-658d957f7974 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:42.799522 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9f135546-dd40-473d-99cd-658d957f7974 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:42.800101 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9f135546-dd40-473d-99cd-658d957f7974 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:42.800947 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9f135546-dd40-473d-99cd-658d957f7974 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:42.801559 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9f135546-dd40-473d-99cd-658d957f7974 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:42.802107 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9f135546-dd40-473d-99cd-658d957f7974 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:42.854770 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-9f135546-dd40-473d-99cd-658d957f7974 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 82b86465-afb0-49ef-9932-1538010c1ae5] Unlocking {{(pid=123596) unlock /opt/stack/nova/nova/compute/api.py:4874}} Oct 04 18:46:42.919555 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-9f135546-dd40-473d-99cd-658d957f7974 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "POST /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5/action" status: 202 len: 0 microversion: 2.1 time: 0.132083 Oct 04 18:46:42.920841 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1933/3619] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 18:46:42 2022] POST /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5/action => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 18:46:42.927745 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-54fae225-7631-4cf9-8b46-b60ca895b3c8 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:42.927745 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-54fae225-7631-4cf9-8b46-b60ca895b3c8 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] [instance: fa47906d-d394-46fe-9143-780bcd27a715] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:42.932768 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-54fae225-7631-4cf9-8b46-b60ca895b3c8 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:42.933415 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-54fae225-7631-4cf9-8b46-b60ca895b3c8 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:42.933875 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-54fae225-7631-4cf9-8b46-b60ca895b3c8 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:42.934604 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-54fae225-7631-4cf9-8b46-b60ca895b3c8 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:42.935073 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-54fae225-7631-4cf9-8b46-b60ca895b3c8 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:42.935511 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-54fae225-7631-4cf9-8b46-b60ca895b3c8 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:42.963738 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-67740e25-5cc2-4a77-9631-33f87fee8f97 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcbf2b4b95743af9e6fa1be54554baa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab4da2b9b9f4c7a9c25b7edaab3027d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:42.977819 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-67740e25-5cc2-4a77-9631-33f87fee8f97 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] 10.222.0.43 "GET /compute/v2.1/servers/9886f261-8e00-4908-8fd8-f6ce9c6fd5b4" status: 200 len: 1521 microversion: 2.1 time: 0.789192 Oct 04 18:46:42.980161 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1687/3620] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:42 2022] GET /compute/v2.1/servers/9886f261-8e00-4908-8fd8-f6ce9c6fd5b4 => generated 1521 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:42.986314 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-af88fab9-45b8-4dbb-98ae-1e3d5d729b8e tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:42.987318 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-af88fab9-45b8-4dbb-98ae-1e3d5d729b8e tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] [instance: 00c17e4b-c80e-463e-a3e9-486c118552be] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:42.999336 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-af88fab9-45b8-4dbb-98ae-1e3d5d729b8e tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:43.000208 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-af88fab9-45b8-4dbb-98ae-1e3d5d729b8e tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:43.000752 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-af88fab9-45b8-4dbb-98ae-1e3d5d729b8e tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:43.001715 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-af88fab9-45b8-4dbb-98ae-1e3d5d729b8e tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:43.002422 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-af88fab9-45b8-4dbb-98ae-1e3d5d729b8e tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:43.003075 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-af88fab9-45b8-4dbb-98ae-1e3d5d729b8e tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:43.028128 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:46:43.162493 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-54fae225-7631-4cf9-8b46-b60ca895b3c8 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:43.173378 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-54fae225-7631-4cf9-8b46-b60ca895b3c8 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:43.174917 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-54fae225-7631-4cf9-8b46-b60ca895b3c8 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:43.176137 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-54fae225-7631-4cf9-8b46-b60ca895b3c8 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] 10.222.0.43 "GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715" status: 200 len: 1874 microversion: 2.32 time: 0.254293 Oct 04 18:46:43.189353 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1934/3621] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:46:42 2022] GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715 => generated 1874 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:46:43.189353 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-1ac5b77b-6f67-42bb-9ed6-eb4be0208b43 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:43.189353 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-1ac5b77b-6f67-42bb-9ed6-eb4be0208b43 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 82b86465-afb0-49ef-9932-1538010c1ae5] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:43.189353 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1ac5b77b-6f67-42bb-9ed6-eb4be0208b43 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:43.189353 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1ac5b77b-6f67-42bb-9ed6-eb4be0208b43 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:43.189353 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1ac5b77b-6f67-42bb-9ed6-eb4be0208b43 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:43.190743 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1ac5b77b-6f67-42bb-9ed6-eb4be0208b43 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:43.190743 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1ac5b77b-6f67-42bb-9ed6-eb4be0208b43 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:43.191720 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1ac5b77b-6f67-42bb-9ed6-eb4be0208b43 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:43.247187 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-af88fab9-45b8-4dbb-98ae-1e3d5d729b8e tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c710f394164b89b16bcac2fe51c58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65037d4ea5124d749e42928032e803fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:43.255631 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-af88fab9-45b8-4dbb-98ae-1e3d5d729b8e tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] 10.222.0.43 "GET /compute/v2.1/servers/00c17e4b-c80e-463e-a3e9-486c118552be" status: 200 len: 1517 microversion: 2.1 time: 0.274043 Oct 04 18:46:43.256214 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1688/3622] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:42 2022] GET /compute/v2.1/servers/00c17e4b-c80e-463e-a3e9-486c118552be => generated 1517 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:43.273008 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-d9c3c424-561f-4515-a7dd-8c4cecd1ebe3 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:43.273813 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-d9c3c424-561f-4515-a7dd-8c4cecd1ebe3 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] [instance: 9886f261-8e00-4908-8fd8-f6ce9c6fd5b4] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:43.282817 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d9c3c424-561f-4515-a7dd-8c4cecd1ebe3 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:43.284367 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d9c3c424-561f-4515-a7dd-8c4cecd1ebe3 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:43.287541 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d9c3c424-561f-4515-a7dd-8c4cecd1ebe3 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:43.288613 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d9c3c424-561f-4515-a7dd-8c4cecd1ebe3 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:43.289313 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d9c3c424-561f-4515-a7dd-8c4cecd1ebe3 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:43.291633 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d9c3c424-561f-4515-a7dd-8c4cecd1ebe3 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:43.408852 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-1ac5b77b-6f67-42bb-9ed6-eb4be0208b43 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:43.418468 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-1ac5b77b-6f67-42bb-9ed6-eb4be0208b43 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5" status: 200 len: 1667 microversion: 2.1 time: 0.240674 Oct 04 18:46:43.420290 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1935/3623] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:43 2022] GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5 => generated 1667 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:43.431924 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-357130ff-6e29-4163-9efc-7e513aec01b0 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:43.432843 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-357130ff-6e29-4163-9efc-7e513aec01b0 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] [instance: 76d475ab-f41c-44df-8aaa-10242bdbfcde] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:43.440886 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-357130ff-6e29-4163-9efc-7e513aec01b0 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:43.442652 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-357130ff-6e29-4163-9efc-7e513aec01b0 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:43.443491 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-357130ff-6e29-4163-9efc-7e513aec01b0 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:43.444443 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-357130ff-6e29-4163-9efc-7e513aec01b0 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:43.445098 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-357130ff-6e29-4163-9efc-7e513aec01b0 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:43.445716 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-357130ff-6e29-4163-9efc-7e513aec01b0 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:43.638527 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-357130ff-6e29-4163-9efc-7e513aec01b0 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a116f2d9656548458264cc4fb1934c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff3c3dc76405401baf72fe00c5d50b56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:43.649884 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-357130ff-6e29-4163-9efc-7e513aec01b0 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] 10.222.0.43 "GET /compute/v2.1/servers/76d475ab-f41c-44df-8aaa-10242bdbfcde" status: 200 len: 1724 microversion: 2.1 time: 0.225715 Oct 04 18:46:43.667440 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1936/3624] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:43 2022] GET /compute/v2.1/servers/76d475ab-f41c-44df-8aaa-10242bdbfcde => generated 1724 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:43.673547 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-2a6afb89-0aa6-43ca-906f-9a49e8421ed5 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:43.674426 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-2a6afb89-0aa6-43ca-906f-9a49e8421ed5 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] [instance: fd09cc9b-d9dd-4133-8665-eeb6d8f51df8] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:43.680707 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2a6afb89-0aa6-43ca-906f-9a49e8421ed5 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:43.684669 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-d9c3c424-561f-4515-a7dd-8c4cecd1ebe3 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcbf2b4b95743af9e6fa1be54554baa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab4da2b9b9f4c7a9c25b7edaab3027d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:43.689766 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2a6afb89-0aa6-43ca-906f-9a49e8421ed5 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:43.694819 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2a6afb89-0aa6-43ca-906f-9a49e8421ed5 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:43.696967 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-d9c3c424-561f-4515-a7dd-8c4cecd1ebe3 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] 10.222.0.43 "GET /compute/v2.1/servers/9886f261-8e00-4908-8fd8-f6ce9c6fd5b4" status: 200 len: 1521 microversion: 2.1 time: 0.439702 Oct 04 18:46:43.697433 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2a6afb89-0aa6-43ca-906f-9a49e8421ed5 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:43.698103 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2a6afb89-0aa6-43ca-906f-9a49e8421ed5 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:43.698732 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2a6afb89-0aa6-43ca-906f-9a49e8421ed5 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:43.699525 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1689/3625] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:43 2022] GET /compute/v2.1/servers/9886f261-8e00-4908-8fd8-f6ce9c6fd5b4 => generated 1521 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:43.709099 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-16ed8057-37c0-4164-af43-45b227dfef94 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:43.712024 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-16ed8057-37c0-4164-af43-45b227dfef94 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 82b86465-afb0-49ef-9932-1538010c1ae5] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:43.727179 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-16ed8057-37c0-4164-af43-45b227dfef94 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:43.727962 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-16ed8057-37c0-4164-af43-45b227dfef94 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:43.729653 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-16ed8057-37c0-4164-af43-45b227dfef94 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:43.734023 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-16ed8057-37c0-4164-af43-45b227dfef94 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:43.734765 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-16ed8057-37c0-4164-af43-45b227dfef94 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:43.735399 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-16ed8057-37c0-4164-af43-45b227dfef94 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:43.899743 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-2a6afb89-0aa6-43ca-906f-9a49e8421ed5 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9971b5861f44c1a1da94eda0f8f02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f809b8ae704988961908bef0f3cb24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:43.908361 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-2a6afb89-0aa6-43ca-906f-9a49e8421ed5 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] 10.222.0.43 "GET /compute/v2.1/servers/fd09cc9b-d9dd-4133-8665-eeb6d8f51df8" status: 200 len: 1199 microversion: 2.1 time: 0.239417 Oct 04 18:46:43.909253 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1937/3626] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:43 2022] GET /compute/v2.1/servers/fd09cc9b-d9dd-4133-8665-eeb6d8f51df8 => generated 1199 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:43.913814 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-ce585e83-707f-42a1-b9ae-e11385cce1d4 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:46:43.917738 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-ce585e83-707f-42a1-b9ae-e11385cce1d4 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Request method failure captured: Oct 04 18:46:43.917738 n-d-851028-13 devstack@n-api.service[123596]: request: POST /compute/v2.1/servers/9886f261-8e00-4908-8fd8-f6ce9c6fd5b4/action HTTP/1.1 Oct 04 18:46:43.917738 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:46:43.917738 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:46:43.917738 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:46:43.917738 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 285 Oct 04 18:46:43.917738 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:46:43.917738 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:46:43.917738 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:46:43.917738 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:46:43.917738 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPH978iZmaQey9qRFmivrOEN9WI4gFjhDc3nSUPEBZXv1WUgd7GTFhNQGJ_Nm2KHTEzU5QZw7VgnyxDt5Dwy3JGK8gUnF9wIKq6iB3FX5CCTGK5JwEw-XtwnwemZOTSVwZU_4nc3l4c2itfEGLVIoX2yb6G-IjSzn-sL8697UlYQlcew Oct 04 18:46:43.917738 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:46:43.917738 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:46:43.917738 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:46:43.917738 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:46:43.917738 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:46:43.917738 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:46:43.917738 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: 8ab4da2b9b9f4c7a9c25b7edaab3027d Oct 04 18:46:43.917738 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2004915413 Oct 04 18:46:43.917738 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 18:46:43.917738 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 18:46:43.917738 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/8ab4da2b9b9f4c7a9c25b7edaab3027d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_8ab4da2b9b9f4c7a9c25b7edaab3027d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8ab4da2b9b9f4c7a9c25b7edaab3027d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8ab4da2b9b9f4c7a9c25b7edaab3027d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:46:43.917738 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2004915413 Oct 04 18:46:43.917738 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: 8ab4da2b9b9f4c7a9c25b7edaab3027d Oct 04 18:46:43.917738 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2004915413 Oct 04 18:46:43.917738 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-ImagesOneServerNegativeTestJSON-2004915413-project Oct 04 18:46:43.917738 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:46:43.917738 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:46:43.917738 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: cdcbf2b4b95743af9e6fa1be54554baa Oct 04 18:46:43.917738 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2004915413-project Oct 04 18:46:43.917738 n-d-851028-13 devstack@n-api.service[123596]: Oct 04 18:46:43.917738 n-d-851028-13 devstack@n-api.service[123596]: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 04 18:46:43.917738 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 18:46:43.917738 n-d-851028-13 devstack@n-api.service[123596]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 04 18:46:43.917738 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': '9886f261-8e00-4908-8fd8-f6ce9c6fd5b4', 'body': {'createImage': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 04 18:46:43.917738 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:46:43.917738 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:46:43.917738 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:46:43.917738 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:46:43.917738 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:46:43.917738 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:46:43.917738 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 04 18:46:43.917738 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:46:43.917738 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['createImage']['properties']['name']: Oct 04 18:46:43.917738 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 04 18:46:43.917738 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:46:43.917738 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 04 18:46:43.917738 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 04 18:46:43.917738 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:46:43.917738 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:46:43.917738 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:46:43.922976 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:46:43.922976 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:46:43.922976 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:46:43.922976 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:46:43.922976 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:46:43.922976 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:46:43.922976 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:46:43.922976 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:46:43.922976 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:46:43.922976 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 18:46:43.922976 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 18:46:43.922976 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:46:43.922976 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:46:43.922976 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:46:43.922976 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:46:43.922976 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 04 18:46:43.922976 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:46:43.922976 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:46:43.922976 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:46:43.922976 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:46:43.922976 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:46:43.922976 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:46:43.922976 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:46:43.922976 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:46:43.922976 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 04 18:46:43.922976 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:46:43.922976 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-ce585e83-707f-42a1-b9ae-e11385cce1d4 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:46:43.922976 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-ce585e83-707f-42a1-b9ae-e11385cce1d4 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] 10.222.0.43 "POST /compute/v2.1/servers/9886f261-8e00-4908-8fd8-f6ce9c6fd5b4/action" status: 400 len: 619 microversion: 2.1 time: 0.009254 Oct 04 18:46:43.927580 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1938/3627] 10.222.0.43 () {60 vars in 1279 bytes} [Tue Oct 4 18:46:43 2022] POST /compute/v2.1/servers/9886f261-8e00-4908-8fd8-f6ce9c6fd5b4/action => generated 619 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:46:43.928723 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-c5ba2491-88f9-4e73-a85a-2c2193a1a0ae tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:43.929101 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-c5ba2491-88f9-4e73-a85a-2c2193a1a0ae tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] [instance: 9886f261-8e00-4908-8fd8-f6ce9c6fd5b4] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:43.941978 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c5ba2491-88f9-4e73-a85a-2c2193a1a0ae tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:43.942662 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c5ba2491-88f9-4e73-a85a-2c2193a1a0ae tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:43.943212 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c5ba2491-88f9-4e73-a85a-2c2193a1a0ae tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:43.944083 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c5ba2491-88f9-4e73-a85a-2c2193a1a0ae tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:43.944663 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c5ba2491-88f9-4e73-a85a-2c2193a1a0ae tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:43.945837 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c5ba2491-88f9-4e73-a85a-2c2193a1a0ae tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:44.039940 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-16ed8057-37c0-4164-af43-45b227dfef94 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:44.055764 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-16ed8057-37c0-4164-af43-45b227dfef94 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5" status: 200 len: 1667 microversion: 2.1 time: 0.348840 Oct 04 18:46:44.056965 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1690/3628] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:43 2022] GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5 => generated 1667 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:44.083735 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-80ea812d-1e68-4977-ab27-ac28f455e767 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:44.085085 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-80ea812d-1e68-4977-ab27-ac28f455e767 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 82b86465-afb0-49ef-9932-1538010c1ae5] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:44.093570 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-80ea812d-1e68-4977-ab27-ac28f455e767 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:44.094391 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-80ea812d-1e68-4977-ab27-ac28f455e767 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:44.096593 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-80ea812d-1e68-4977-ab27-ac28f455e767 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:44.097791 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-80ea812d-1e68-4977-ab27-ac28f455e767 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:44.099072 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-80ea812d-1e68-4977-ab27-ac28f455e767 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:44.099712 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-80ea812d-1e68-4977-ab27-ac28f455e767 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:44.116780 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-c5ba2491-88f9-4e73-a85a-2c2193a1a0ae tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcbf2b4b95743af9e6fa1be54554baa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab4da2b9b9f4c7a9c25b7edaab3027d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:44.127952 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-c5ba2491-88f9-4e73-a85a-2c2193a1a0ae tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] 10.222.0.43 "GET /compute/v2.1/servers/9886f261-8e00-4908-8fd8-f6ce9c6fd5b4" status: 200 len: 1521 microversion: 2.1 time: 0.202933 Oct 04 18:46:44.129590 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1939/3629] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:43 2022] GET /compute/v2.1/servers/9886f261-8e00-4908-8fd8-f6ce9c6fd5b4 => generated 1521 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:44.156121 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-5ff3f354-95b2-4bf9-b3fb-5309c07d3e0f tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:44.156892 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-5ff3f354-95b2-4bf9-b3fb-5309c07d3e0f tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] [instance: 9886f261-8e00-4908-8fd8-f6ce9c6fd5b4] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:44.164691 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5ff3f354-95b2-4bf9-b3fb-5309c07d3e0f tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:44.165383 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5ff3f354-95b2-4bf9-b3fb-5309c07d3e0f tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:44.165935 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5ff3f354-95b2-4bf9-b3fb-5309c07d3e0f tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:44.166764 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5ff3f354-95b2-4bf9-b3fb-5309c07d3e0f tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:44.167493 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5ff3f354-95b2-4bf9-b3fb-5309c07d3e0f tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:44.168388 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5ff3f354-95b2-4bf9-b3fb-5309c07d3e0f tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:44.333542 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-5ff3f354-95b2-4bf9-b3fb-5309c07d3e0f tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcbf2b4b95743af9e6fa1be54554baa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab4da2b9b9f4c7a9c25b7edaab3027d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:44.342835 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-5ff3f354-95b2-4bf9-b3fb-5309c07d3e0f tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] 10.222.0.43 "GET /compute/v2.1/servers/9886f261-8e00-4908-8fd8-f6ce9c6fd5b4" status: 200 len: 1521 microversion: 2.1 time: 0.192122 Oct 04 18:46:44.343877 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1940/3630] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:44 2022] GET /compute/v2.1/servers/9886f261-8e00-4908-8fd8-f6ce9c6fd5b4 => generated 1521 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:46:44.354575 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-156f0914-9143-431f-8782-5e3538df860a tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:44.355470 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-156f0914-9143-431f-8782-5e3538df860a tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] [instance: fa47906d-d394-46fe-9143-780bcd27a715] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:44.363417 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-156f0914-9143-431f-8782-5e3538df860a tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:44.364177 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-156f0914-9143-431f-8782-5e3538df860a tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:44.364797 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-156f0914-9143-431f-8782-5e3538df860a tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:44.366063 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-156f0914-9143-431f-8782-5e3538df860a tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:44.366707 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-156f0914-9143-431f-8782-5e3538df860a tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:44.367314 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-156f0914-9143-431f-8782-5e3538df860a tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:44.388248 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-80ea812d-1e68-4977-ab27-ac28f455e767 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:44.402559 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-80ea812d-1e68-4977-ab27-ac28f455e767 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5" status: 200 len: 1667 microversion: 2.1 time: 0.322611 Oct 04 18:46:44.417660 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1691/3631] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:44 2022] GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5 => generated 1667 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:46:44.427160 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-71a275ce-a363-4e08-bc9a-44d34814c26d tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:44.428226 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-71a275ce-a363-4e08-bc9a-44d34814c26d tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] [instance: 00c17e4b-c80e-463e-a3e9-486c118552be] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:44.441540 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-71a275ce-a363-4e08-bc9a-44d34814c26d tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:44.443836 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-71a275ce-a363-4e08-bc9a-44d34814c26d tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:44.444936 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-71a275ce-a363-4e08-bc9a-44d34814c26d tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:44.445600 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-71a275ce-a363-4e08-bc9a-44d34814c26d tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:44.445927 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-71a275ce-a363-4e08-bc9a-44d34814c26d tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:44.446366 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-71a275ce-a363-4e08-bc9a-44d34814c26d tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:44.607153 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-71a275ce-a363-4e08-bc9a-44d34814c26d tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c710f394164b89b16bcac2fe51c58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65037d4ea5124d749e42928032e803fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:44.616783 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-71a275ce-a363-4e08-bc9a-44d34814c26d tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] 10.222.0.43 "GET /compute/v2.1/servers/00c17e4b-c80e-463e-a3e9-486c118552be" status: 200 len: 1517 microversion: 2.1 time: 0.197852 Oct 04 18:46:44.621153 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1692/3632] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:44 2022] GET /compute/v2.1/servers/00c17e4b-c80e-463e-a3e9-486c118552be => generated 1517 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:44.623000 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-1ecea8ca-6ca6-4393-8b1d-fc2db3f051f9 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1697858819"}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:46:44.625969 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-1ecea8ca-6ca6-4393-8b1d-fc2db3f051f9 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] [instance: 9886f261-8e00-4908-8fd8-f6ce9c6fd5b4] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:44.633352 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1ecea8ca-6ca6-4393-8b1d-fc2db3f051f9 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:44.633864 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1ecea8ca-6ca6-4393-8b1d-fc2db3f051f9 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:44.634327 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1ecea8ca-6ca6-4393-8b1d-fc2db3f051f9 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:44.635223 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1ecea8ca-6ca6-4393-8b1d-fc2db3f051f9 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:44.635652 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1ecea8ca-6ca6-4393-8b1d-fc2db3f051f9 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:44.636103 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1ecea8ca-6ca6-4393-8b1d-fc2db3f051f9 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:44.652188 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-156f0914-9143-431f-8782-5e3538df860a tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:44.666275 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-156f0914-9143-431f-8782-5e3538df860a tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:44.668038 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-156f0914-9143-431f-8782-5e3538df860a tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:44.669289 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-156f0914-9143-431f-8782-5e3538df860a tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] 10.222.0.43 "GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715" status: 200 len: 1874 microversion: 2.32 time: 0.318526 Oct 04 18:46:44.670165 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1941/3633] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:46:44 2022] GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715 => generated 1874 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:46:44.675766 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-bb99c4e4-ec91-4450-acca-1588368a4685 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:46:44.676311 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-bb99c4e4-ec91-4450-acca-1588368a4685 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 82b86465-afb0-49ef-9932-1538010c1ae5] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:44.682979 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bb99c4e4-ec91-4450-acca-1588368a4685 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:44.683449 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bb99c4e4-ec91-4450-acca-1588368a4685 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:44.683892 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bb99c4e4-ec91-4450-acca-1588368a4685 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:44.684595 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bb99c4e4-ec91-4450-acca-1588368a4685 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:44.685053 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bb99c4e4-ec91-4450-acca-1588368a4685 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:44.685511 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bb99c4e4-ec91-4450-acca-1588368a4685 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:44.762149 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-bb99c4e4-ec91-4450-acca-1588368a4685 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "POST /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5/action" status: 202 len: 0 microversion: 2.1 time: 0.089845 Oct 04 18:46:44.766395 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1942/3634] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 18:46:44 2022] POST /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5/action => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:46:44.785619 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-dbef1177-3a52-4e58-9de6-14528942db6a tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:44.785619 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-dbef1177-3a52-4e58-9de6-14528942db6a tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] [instance: 76d475ab-f41c-44df-8aaa-10242bdbfcde] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:44.790423 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dbef1177-3a52-4e58-9de6-14528942db6a tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:44.790827 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dbef1177-3a52-4e58-9de6-14528942db6a tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:44.791346 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dbef1177-3a52-4e58-9de6-14528942db6a tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:44.792591 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dbef1177-3a52-4e58-9de6-14528942db6a tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:44.793072 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dbef1177-3a52-4e58-9de6-14528942db6a tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:44.795783 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dbef1177-3a52-4e58-9de6-14528942db6a tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:44.985083 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-1ecea8ca-6ca6-4393-8b1d-fc2db3f051f9 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] 10.222.0.43 "POST /compute/v2.1/servers/9886f261-8e00-4908-8fd8-f6ce9c6fd5b4/action" status: 202 len: 0 microversion: 2.1 time: 0.365871 Oct 04 18:46:44.986930 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1693/3635] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 18:46:44 2022] POST /compute/v2.1/servers/9886f261-8e00-4908-8fd8-f6ce9c6fd5b4/action => generated 0 bytes in 369 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 04 18:46:44.998147 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-16880287-1b9d-47ac-b4f9-04fed8bb8d1b tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:44.999017 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-16880287-1b9d-47ac-b4f9-04fed8bb8d1b tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 82b86465-afb0-49ef-9932-1538010c1ae5] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:44.999595 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-dbef1177-3a52-4e58-9de6-14528942db6a tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a116f2d9656548458264cc4fb1934c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff3c3dc76405401baf72fe00c5d50b56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:45.006002 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-16880287-1b9d-47ac-b4f9-04fed8bb8d1b tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:45.006921 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-16880287-1b9d-47ac-b4f9-04fed8bb8d1b tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:45.007473 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-16880287-1b9d-47ac-b4f9-04fed8bb8d1b tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:45.008331 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-16880287-1b9d-47ac-b4f9-04fed8bb8d1b tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:45.009036 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-16880287-1b9d-47ac-b4f9-04fed8bb8d1b tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:45.009595 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-16880287-1b9d-47ac-b4f9-04fed8bb8d1b tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:45.030681 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-dbef1177-3a52-4e58-9de6-14528942db6a tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] 10.222.0.43 "GET /compute/v2.1/servers/76d475ab-f41c-44df-8aaa-10242bdbfcde" status: 200 len: 1724 microversion: 2.1 time: 0.265635 Oct 04 18:46:45.031682 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1943/3636] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:44 2022] GET /compute/v2.1/servers/76d475ab-f41c-44df-8aaa-10242bdbfcde => generated 1724 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:45.037030 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-a3f99400-0953-4c94-b1e2-f5d3a11a3116 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:45.038165 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-a3f99400-0953-4c94-b1e2-f5d3a11a3116 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] [instance: fd09cc9b-d9dd-4133-8665-eeb6d8f51df8] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:45.046366 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a3f99400-0953-4c94-b1e2-f5d3a11a3116 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:45.047157 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a3f99400-0953-4c94-b1e2-f5d3a11a3116 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:45.047821 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a3f99400-0953-4c94-b1e2-f5d3a11a3116 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:45.048705 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a3f99400-0953-4c94-b1e2-f5d3a11a3116 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:45.049795 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a3f99400-0953-4c94-b1e2-f5d3a11a3116 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:45.051067 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a3f99400-0953-4c94-b1e2-f5d3a11a3116 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:45.215376 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-a3f99400-0953-4c94-b1e2-f5d3a11a3116 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9971b5861f44c1a1da94eda0f8f02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f809b8ae704988961908bef0f3cb24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:45.223929 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-a3f99400-0953-4c94-b1e2-f5d3a11a3116 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] 10.222.0.43 "GET /compute/v2.1/servers/fd09cc9b-d9dd-4133-8665-eeb6d8f51df8" status: 200 len: 1199 microversion: 2.1 time: 0.191020 Oct 04 18:46:45.224821 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1944/3637] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:45 2022] GET /compute/v2.1/servers/fd09cc9b-d9dd-4133-8665-eeb6d8f51df8 => generated 1199 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:45.229850 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-b0379c61-5a22-4dea-a826-e0125b8b3f3a tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1527837389"}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:46:45.232567 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-b0379c61-5a22-4dea-a826-e0125b8b3f3a tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] [instance: 9886f261-8e00-4908-8fd8-f6ce9c6fd5b4] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:45.236547 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-16880287-1b9d-47ac-b4f9-04fed8bb8d1b tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:45.245341 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-16880287-1b9d-47ac-b4f9-04fed8bb8d1b tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5" status: 200 len: 1672 microversion: 2.1 time: 0.252787 Oct 04 18:46:45.249303 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1694/3638] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:44 2022] GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5 => generated 1672 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:45.253037 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b0379c61-5a22-4dea-a826-e0125b8b3f3a tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:45.253704 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b0379c61-5a22-4dea-a826-e0125b8b3f3a tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:45.254214 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b0379c61-5a22-4dea-a826-e0125b8b3f3a tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:45.254986 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b0379c61-5a22-4dea-a826-e0125b8b3f3a tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:45.255554 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b0379c61-5a22-4dea-a826-e0125b8b3f3a tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:45.256044 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b0379c61-5a22-4dea-a826-e0125b8b3f3a tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:45.293072 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-b0379c61-5a22-4dea-a826-e0125b8b3f3a tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] HTTP exception thrown: Cannot 'createImage' instance 9886f261-8e00-4908-8fd8-f6ce9c6fd5b4 while it is in task_state image_snapshot Oct 04 18:46:45.294914 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-b0379c61-5a22-4dea-a826-e0125b8b3f3a tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Request method failure captured: Oct 04 18:46:45.294914 n-d-851028-13 devstack@n-api.service[123596]: request: POST /compute/v2.1/servers/9886f261-8e00-4908-8fd8-f6ce9c6fd5b4/action HTTP/1.1 Oct 04 18:46:45.294914 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:46:45.294914 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:46:45.294914 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:46:45.294914 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 85 Oct 04 18:46:45.294914 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:46:45.294914 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:46:45.294914 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:46:45.294914 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:46:45.294914 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPH978iZmaQey9qRFmivrOEN9WI4gFjhDc3nSUPEBZXv1WUgd7GTFhNQGJ_Nm2KHTEzU5QZw7VgnyxDt5Dwy3JGK8gUnF9wIKq6iB3FX5CCTGK5JwEw-XtwnwemZOTSVwZU_4nc3l4c2itfEGLVIoX2yb6G-IjSzn-sL8697UlYQlcew Oct 04 18:46:45.294914 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:46:45.294914 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:46:45.294914 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:46:45.294914 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:46:45.294914 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:46:45.294914 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:46:45.294914 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: 8ab4da2b9b9f4c7a9c25b7edaab3027d Oct 04 18:46:45.294914 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2004915413 Oct 04 18:46:45.294914 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 18:46:45.294914 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 18:46:45.294914 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/8ab4da2b9b9f4c7a9c25b7edaab3027d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_8ab4da2b9b9f4c7a9c25b7edaab3027d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8ab4da2b9b9f4c7a9c25b7edaab3027d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8ab4da2b9b9f4c7a9c25b7edaab3027d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:46:45.294914 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2004915413 Oct 04 18:46:45.294914 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: 8ab4da2b9b9f4c7a9c25b7edaab3027d Oct 04 18:46:45.294914 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2004915413 Oct 04 18:46:45.294914 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-ImagesOneServerNegativeTestJSON-2004915413-project Oct 04 18:46:45.294914 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:46:45.294914 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:46:45.294914 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: cdcbf2b4b95743af9e6fa1be54554baa Oct 04 18:46:45.294914 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2004915413-project Oct 04 18:46:45.294914 n-d-851028-13 devstack@n-api.service[123596]: Oct 04 18:46:45.294914 n-d-851028-13 devstack@n-api.service[123596]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1527837389"}} Oct 04 18:46:45.294914 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 18:46:45.294914 n-d-851028-13 devstack@n-api.service[123596]: exception: Cannot 'createImage' instance 9886f261-8e00-4908-8fd8-f6ce9c6fd5b4 while it is in task_state image_snapshot Oct 04 18:46:45.294914 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': '9886f261-8e00-4908-8fd8-f6ce9c6fd5b4', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1527837389'}}} Oct 04 18:46:45.294914 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:46:45.294914 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:46:45.294914 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1349, in _action_create_image Oct 04 18:46:45.294914 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi image = self.compute_api.snapshot(context, Oct 04 18:46:45.294914 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 155, in inner Oct 04 18:46:45.294914 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 04 18:46:45.294914 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 9886f261-8e00-4908-8fd8-f6ce9c6fd5b4 in task_state image_snapshot. Cannot snapshot while the instance is in this state. Oct 04 18:46:45.294914 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:46:45.294914 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:46:45.294914 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:46:45.294914 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:46:45.294914 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:46:45.294914 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:46:45.294914 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:46:45.294914 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:46:45.294914 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:46:45.294914 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:46:45.294914 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:46:45.294914 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:46:45.294914 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:46:45.294914 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:46:45.294914 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1354, in _action_create_image Oct 04 18:46:45.294914 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 04 18:46:45.294914 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 04 18:46:45.294914 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 04 18:46:45.294914 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'createImage' instance 9886f261-8e00-4908-8fd8-f6ce9c6fd5b4 while it is in task_state image_snapshot Oct 04 18:46:45.299564 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:46:45.299564 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:46:45.299564 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:46:45.299564 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:46:45.299564 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:46:45.299564 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:46:45.299564 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:46:45.299564 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:46:45.299564 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'createImage' instance 9886f261-8e00-4908-8fd8-f6ce9c6fd5b4 while it is in task_state image_snapshot Oct 04 18:46:45.299564 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:46:45.299564 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-b0379c61-5a22-4dea-a826-e0125b8b3f3a tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Returning 409 to user: Cannot 'createImage' instance 9886f261-8e00-4908-8fd8-f6ce9c6fd5b4 while it is in task_state image_snapshot {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:46:45.299564 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-b0379c61-5a22-4dea-a826-e0125b8b3f3a tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] 10.222.0.43 "POST /compute/v2.1/servers/9886f261-8e00-4908-8fd8-f6ce9c6fd5b4/action" status: 409 len: 159 microversion: 2.1 time: 0.070355 Oct 04 18:46:45.299564 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1945/3639] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 18:46:45 2022] POST /compute/v2.1/servers/9886f261-8e00-4908-8fd8-f6ce9c6fd5b4/action => generated 159 bytes in 71 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:46:45.305194 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-c209c1f2-4280-4250-92ae-6cd243e5ce49 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Calling method '.version_select at 0x7fb21fd10820>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:45.455339 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-c209c1f2-4280-4250-92ae-6cd243e5ce49 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] 10.222.0.43 "DELETE /compute/v2.1/images/07e07d19-dc02-4998-b7ed-fc8c9ba099c1" status: 204 len: 0 microversion: 2.1 time: 0.154008 Oct 04 18:46:45.455929 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1695/3640] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:45 2022] DELETE /compute/v2.1/images/07e07d19-dc02-4998-b7ed-fc8c9ba099c1 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:46:45.464127 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-64085335-e5f5-431f-9814-2c60243a7c2f tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:45.464742 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-64085335-e5f5-431f-9814-2c60243a7c2f tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] [instance: 9886f261-8e00-4908-8fd8-f6ce9c6fd5b4] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:45.471057 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-64085335-e5f5-431f-9814-2c60243a7c2f tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:45.471523 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-64085335-e5f5-431f-9814-2c60243a7c2f tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:45.471953 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-64085335-e5f5-431f-9814-2c60243a7c2f tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:45.472669 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-64085335-e5f5-431f-9814-2c60243a7c2f tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:45.473144 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-64085335-e5f5-431f-9814-2c60243a7c2f tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:45.473577 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-64085335-e5f5-431f-9814-2c60243a7c2f tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:45.642671 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-b92e53a9-864c-45f1-96cf-429584807053 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:45.643607 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-b92e53a9-864c-45f1-96cf-429584807053 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] [instance: 00c17e4b-c80e-463e-a3e9-486c118552be] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:45.650828 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b92e53a9-864c-45f1-96cf-429584807053 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:45.651374 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b92e53a9-864c-45f1-96cf-429584807053 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:45.651819 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b92e53a9-864c-45f1-96cf-429584807053 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:45.652520 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b92e53a9-864c-45f1-96cf-429584807053 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:45.652973 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b92e53a9-864c-45f1-96cf-429584807053 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:45.653466 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b92e53a9-864c-45f1-96cf-429584807053 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:45.687186 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-64085335-e5f5-431f-9814-2c60243a7c2f tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcbf2b4b95743af9e6fa1be54554baa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab4da2b9b9f4c7a9c25b7edaab3027d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:45.690973 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:46:45.706780 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-64085335-e5f5-431f-9814-2c60243a7c2f tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] 10.222.0.43 "GET /compute/v2.1/servers/9886f261-8e00-4908-8fd8-f6ce9c6fd5b4" status: 200 len: 1533 microversion: 2.1 time: 0.246413 Oct 04 18:46:45.721137 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1946/3641] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:45 2022] GET /compute/v2.1/servers/9886f261-8e00-4908-8fd8-f6ce9c6fd5b4 => generated 1533 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:46:45.721137 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-3fc739af-6319-444b-a303-b28d58d07855 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:45.721137 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-3fc739af-6319-444b-a303-b28d58d07855 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] [instance: fa47906d-d394-46fe-9143-780bcd27a715] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:45.721137 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3fc739af-6319-444b-a303-b28d58d07855 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:45.721137 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3fc739af-6319-444b-a303-b28d58d07855 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:45.721137 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3fc739af-6319-444b-a303-b28d58d07855 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:45.721788 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3fc739af-6319-444b-a303-b28d58d07855 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:45.721882 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3fc739af-6319-444b-a303-b28d58d07855 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:45.723805 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3fc739af-6319-444b-a303-b28d58d07855 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:45.855229 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-b92e53a9-864c-45f1-96cf-429584807053 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c710f394164b89b16bcac2fe51c58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65037d4ea5124d749e42928032e803fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:45.868163 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-b92e53a9-864c-45f1-96cf-429584807053 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] 10.222.0.43 "GET /compute/v2.1/servers/00c17e4b-c80e-463e-a3e9-486c118552be" status: 200 len: 1517 microversion: 2.1 time: 0.229293 Oct 04 18:46:45.869072 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1696/3642] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:45 2022] GET /compute/v2.1/servers/00c17e4b-c80e-463e-a3e9-486c118552be => generated 1517 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:46:45.939742 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-3fc739af-6319-444b-a303-b28d58d07855 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:45.950590 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-3fc739af-6319-444b-a303-b28d58d07855 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:45.955501 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-3fc739af-6319-444b-a303-b28d58d07855 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:45.958106 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-3fc739af-6319-444b-a303-b28d58d07855 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] 10.222.0.43 "GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715" status: 200 len: 1874 microversion: 2.32 time: 0.249402 Oct 04 18:46:45.959360 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1947/3643] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:46:45 2022] GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715 => generated 1874 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:46:46.061649 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-8df9feb6-db53-4627-8dcd-8c75ed104b13 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:46.062705 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-8df9feb6-db53-4627-8dcd-8c75ed104b13 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] [instance: 76d475ab-f41c-44df-8aaa-10242bdbfcde] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:46.070929 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8df9feb6-db53-4627-8dcd-8c75ed104b13 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:46.071576 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8df9feb6-db53-4627-8dcd-8c75ed104b13 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:46.072122 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8df9feb6-db53-4627-8dcd-8c75ed104b13 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:46.072959 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8df9feb6-db53-4627-8dcd-8c75ed104b13 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:46.073548 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8df9feb6-db53-4627-8dcd-8c75ed104b13 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:46.074221 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8df9feb6-db53-4627-8dcd-8c75ed104b13 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:46.248035 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-8a2d31e8-0b1d-43f0-919f-f88cbc8fef12 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:46.249710 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-8a2d31e8-0b1d-43f0-919f-f88cbc8fef12 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] [instance: fd09cc9b-d9dd-4133-8665-eeb6d8f51df8] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:46.257748 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_api:SELECT=100 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:46:46.259901 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8a2d31e8-0b1d-43f0-919f-f88cbc8fef12 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:46.260654 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8a2d31e8-0b1d-43f0-919f-f88cbc8fef12 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:46.261329 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8a2d31e8-0b1d-43f0-919f-f88cbc8fef12 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:46.262509 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8a2d31e8-0b1d-43f0-919f-f88cbc8fef12 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:46.263087 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8a2d31e8-0b1d-43f0-919f-f88cbc8fef12 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:46.263619 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8a2d31e8-0b1d-43f0-919f-f88cbc8fef12 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:46.313153 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-8df9feb6-db53-4627-8dcd-8c75ed104b13 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a116f2d9656548458264cc4fb1934c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff3c3dc76405401baf72fe00c5d50b56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:46.321870 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-8df9feb6-db53-4627-8dcd-8c75ed104b13 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] 10.222.0.43 "GET /compute/v2.1/servers/76d475ab-f41c-44df-8aaa-10242bdbfcde" status: 200 len: 1724 microversion: 2.1 time: 0.264764 Oct 04 18:46:46.323693 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1697/3644] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:46 2022] GET /compute/v2.1/servers/76d475ab-f41c-44df-8aaa-10242bdbfcde => generated 1724 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:46.328734 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-1f02f1b6-15c6-44e2-9afc-f7f8bb0c21ef tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:46.329634 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-1f02f1b6-15c6-44e2-9afc-f7f8bb0c21ef tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 82b86465-afb0-49ef-9932-1538010c1ae5] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:46.337232 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1f02f1b6-15c6-44e2-9afc-f7f8bb0c21ef tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:46.338071 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1f02f1b6-15c6-44e2-9afc-f7f8bb0c21ef tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:46.338895 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1f02f1b6-15c6-44e2-9afc-f7f8bb0c21ef tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:46.340197 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1f02f1b6-15c6-44e2-9afc-f7f8bb0c21ef tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:46.340877 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1f02f1b6-15c6-44e2-9afc-f7f8bb0c21ef tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:46.342559 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1f02f1b6-15c6-44e2-9afc-f7f8bb0c21ef tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:46.464287 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-8a2d31e8-0b1d-43f0-919f-f88cbc8fef12 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9971b5861f44c1a1da94eda0f8f02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f809b8ae704988961908bef0f3cb24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:46.472896 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-8a2d31e8-0b1d-43f0-919f-f88cbc8fef12 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] 10.222.0.43 "GET /compute/v2.1/servers/fd09cc9b-d9dd-4133-8665-eeb6d8f51df8" status: 200 len: 1199 microversion: 2.1 time: 0.228882 Oct 04 18:46:46.473582 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1948/3645] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:46 2022] GET /compute/v2.1/servers/fd09cc9b-d9dd-4133-8665-eeb6d8f51df8 => generated 1199 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:46.596686 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-1f02f1b6-15c6-44e2-9afc-f7f8bb0c21ef tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:46.610914 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-1f02f1b6-15c6-44e2-9afc-f7f8bb0c21ef tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5" status: 200 len: 1652 microversion: 2.1 time: 0.281943 Oct 04 18:46:46.612130 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1698/3646] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:46 2022] GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5 => generated 1652 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:46.637068 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f45c6675-07f8-41be-935e-aef8f5e5894f tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:46:46.640687 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-f45c6675-07f8-41be-935e-aef8f5e5894f tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 82b86465-afb0-49ef-9932-1538010c1ae5] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:46.648537 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f45c6675-07f8-41be-935e-aef8f5e5894f tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:46.648904 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f45c6675-07f8-41be-935e-aef8f5e5894f tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:46.649546 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f45c6675-07f8-41be-935e-aef8f5e5894f tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:46.650485 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f45c6675-07f8-41be-935e-aef8f5e5894f tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:46.651198 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f45c6675-07f8-41be-935e-aef8f5e5894f tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:46.651723 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f45c6675-07f8-41be-935e-aef8f5e5894f tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:46.729349 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-f45c6675-07f8-41be-935e-aef8f5e5894f tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "POST /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5/action" status: 202 len: 0 microversion: 2.1 time: 0.096032 Oct 04 18:46:46.730242 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1949/3647] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 18:46:46 2022] POST /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5/action => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 18:46:46.740778 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-8111d0c9-5523-48c0-810b-9cb542d22d08 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:46.741833 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-8111d0c9-5523-48c0-810b-9cb542d22d08 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 82b86465-afb0-49ef-9932-1538010c1ae5] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:46.745773 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-1c031f6d-9dfd-4463-a38b-4506b6b73a91 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:46.748882 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8111d0c9-5523-48c0-810b-9cb542d22d08 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:46.749419 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8111d0c9-5523-48c0-810b-9cb542d22d08 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:46.749863 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8111d0c9-5523-48c0-810b-9cb542d22d08 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:46.750572 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8111d0c9-5523-48c0-810b-9cb542d22d08 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:46.751031 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8111d0c9-5523-48c0-810b-9cb542d22d08 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:46.751498 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8111d0c9-5523-48c0-810b-9cb542d22d08 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:46.752267 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-1c031f6d-9dfd-4463-a38b-4506b6b73a91 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] [instance: 9886f261-8e00-4908-8fd8-f6ce9c6fd5b4] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:46.769692 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1c031f6d-9dfd-4463-a38b-4506b6b73a91 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:46.773675 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1c031f6d-9dfd-4463-a38b-4506b6b73a91 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:46.775392 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1c031f6d-9dfd-4463-a38b-4506b6b73a91 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:46.776305 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1c031f6d-9dfd-4463-a38b-4506b6b73a91 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:46.777026 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1c031f6d-9dfd-4463-a38b-4506b6b73a91 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:46.778177 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1c031f6d-9dfd-4463-a38b-4506b6b73a91 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:46.981511 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-8111d0c9-5523-48c0-810b-9cb542d22d08 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:46.999778 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-8111d0c9-5523-48c0-810b-9cb542d22d08 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5" status: 200 len: 1659 microversion: 2.1 time: 0.262564 Oct 04 18:46:47.000656 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1950/3648] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:46 2022] GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5 => generated 1659 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:47.016407 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-a91421ef-4ee5-46be-9d4b-c68e8e2ea49c tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:47.017432 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-a91421ef-4ee5-46be-9d4b-c68e8e2ea49c tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] [instance: 00c17e4b-c80e-463e-a3e9-486c118552be] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:47.019599 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-1c031f6d-9dfd-4463-a38b-4506b6b73a91 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcbf2b4b95743af9e6fa1be54554baa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab4da2b9b9f4c7a9c25b7edaab3027d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:47.024191 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a91421ef-4ee5-46be-9d4b-c68e8e2ea49c tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:47.024191 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a91421ef-4ee5-46be-9d4b-c68e8e2ea49c tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:47.024191 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a91421ef-4ee5-46be-9d4b-c68e8e2ea49c tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:47.025562 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a91421ef-4ee5-46be-9d4b-c68e8e2ea49c tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:47.025945 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a91421ef-4ee5-46be-9d4b-c68e8e2ea49c tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:47.026329 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a91421ef-4ee5-46be-9d4b-c68e8e2ea49c tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:47.032897 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-1c031f6d-9dfd-4463-a38b-4506b6b73a91 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] 10.222.0.43 "GET /compute/v2.1/servers/9886f261-8e00-4908-8fd8-f6ce9c6fd5b4" status: 200 len: 1539 microversion: 2.1 time: 0.305553 Oct 04 18:46:47.071504 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1699/3649] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:46 2022] GET /compute/v2.1/servers/9886f261-8e00-4908-8fd8-f6ce9c6fd5b4 => generated 1539 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:47.077215 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-5e266af9-203b-455b-8c2f-abebaa31c36a tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:47.077997 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-5e266af9-203b-455b-8c2f-abebaa31c36a tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] [instance: fa47906d-d394-46fe-9143-780bcd27a715] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:47.089782 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5e266af9-203b-455b-8c2f-abebaa31c36a tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:47.094885 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5e266af9-203b-455b-8c2f-abebaa31c36a tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:47.096956 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5e266af9-203b-455b-8c2f-abebaa31c36a tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:47.098483 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5e266af9-203b-455b-8c2f-abebaa31c36a tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:47.099132 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5e266af9-203b-455b-8c2f-abebaa31c36a tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:47.099770 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5e266af9-203b-455b-8c2f-abebaa31c36a tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:47.338557 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-5e266af9-203b-455b-8c2f-abebaa31c36a tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:47.349850 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-5e266af9-203b-455b-8c2f-abebaa31c36a tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:47.352411 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-5e266af9-203b-455b-8c2f-abebaa31c36a tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:47.353910 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-5e266af9-203b-455b-8c2f-abebaa31c36a tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] 10.222.0.43 "GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715" status: 200 len: 1874 microversion: 2.32 time: 0.280964 Oct 04 18:46:47.354587 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1700/3650] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:46:47 2022] GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715 => generated 1874 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:46:47.370893 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-bd9aa331-1c62-4080-9ede-ee0e28d61383 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:47.371683 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-bd9aa331-1c62-4080-9ede-ee0e28d61383 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] [instance: 76d475ab-f41c-44df-8aaa-10242bdbfcde] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:47.379250 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bd9aa331-1c62-4080-9ede-ee0e28d61383 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:47.379788 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bd9aa331-1c62-4080-9ede-ee0e28d61383 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:47.380531 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bd9aa331-1c62-4080-9ede-ee0e28d61383 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:47.381468 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bd9aa331-1c62-4080-9ede-ee0e28d61383 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:47.381917 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bd9aa331-1c62-4080-9ede-ee0e28d61383 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:47.382364 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bd9aa331-1c62-4080-9ede-ee0e28d61383 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:47.536807 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-bd9aa331-1c62-4080-9ede-ee0e28d61383 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a116f2d9656548458264cc4fb1934c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff3c3dc76405401baf72fe00c5d50b56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:47.546429 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-bd9aa331-1c62-4080-9ede-ee0e28d61383 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] 10.222.0.43 "GET /compute/v2.1/servers/76d475ab-f41c-44df-8aaa-10242bdbfcde" status: 200 len: 1724 microversion: 2.1 time: 0.179434 Oct 04 18:46:47.547151 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1701/3651] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:47 2022] GET /compute/v2.1/servers/76d475ab-f41c-44df-8aaa-10242bdbfcde => generated 1724 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:47.552114 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-537de8d6-0d63-47fb-93d6-d7ca5c724b4b tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:47.552974 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-537de8d6-0d63-47fb-93d6-d7ca5c724b4b tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] [instance: fd09cc9b-d9dd-4133-8665-eeb6d8f51df8] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:47.562560 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-537de8d6-0d63-47fb-93d6-d7ca5c724b4b tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:47.563331 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-537de8d6-0d63-47fb-93d6-d7ca5c724b4b tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:47.564481 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-537de8d6-0d63-47fb-93d6-d7ca5c724b4b tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:47.565226 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-537de8d6-0d63-47fb-93d6-d7ca5c724b4b tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:47.565684 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-537de8d6-0d63-47fb-93d6-d7ca5c724b4b tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:47.566799 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-537de8d6-0d63-47fb-93d6-d7ca5c724b4b tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:47.742884 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-537de8d6-0d63-47fb-93d6-d7ca5c724b4b tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9971b5861f44c1a1da94eda0f8f02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f809b8ae704988961908bef0f3cb24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:47.754277 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-537de8d6-0d63-47fb-93d6-d7ca5c724b4b tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] 10.222.0.43 "GET /compute/v2.1/servers/fd09cc9b-d9dd-4133-8665-eeb6d8f51df8" status: 200 len: 1199 microversion: 2.1 time: 0.205656 Oct 04 18:46:47.755755 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1702/3652] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:47 2022] GET /compute/v2.1/servers/fd09cc9b-d9dd-4133-8665-eeb6d8f51df8 => generated 1199 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:47.775059 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-a91421ef-4ee5-46be-9d4b-c68e8e2ea49c tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c710f394164b89b16bcac2fe51c58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65037d4ea5124d749e42928032e803fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:47.788659 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-a91421ef-4ee5-46be-9d4b-c68e8e2ea49c tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] 10.222.0.43 "GET /compute/v2.1/servers/00c17e4b-c80e-463e-a3e9-486c118552be" status: 200 len: 1517 microversion: 2.1 time: 0.786471 Oct 04 18:46:47.793740 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1951/3653] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:47 2022] GET /compute/v2.1/servers/00c17e4b-c80e-463e-a3e9-486c118552be => generated 1517 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:48.024112 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-3f417c23-9e50-492b-8a11-d6b9d2e3cc6f tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:48.024855 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-3f417c23-9e50-492b-8a11-d6b9d2e3cc6f tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 82b86465-afb0-49ef-9932-1538010c1ae5] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:48.034405 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3f417c23-9e50-492b-8a11-d6b9d2e3cc6f tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:48.035042 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3f417c23-9e50-492b-8a11-d6b9d2e3cc6f tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:48.035628 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3f417c23-9e50-492b-8a11-d6b9d2e3cc6f tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:48.036450 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3f417c23-9e50-492b-8a11-d6b9d2e3cc6f tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:48.037021 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3f417c23-9e50-492b-8a11-d6b9d2e3cc6f tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:48.037663 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3f417c23-9e50-492b-8a11-d6b9d2e3cc6f tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:48.058557 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-8dd6e1da-b642-42e3-b8d1-52d16eb47f3f tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:48.059567 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-8dd6e1da-b642-42e3-b8d1-52d16eb47f3f tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] [instance: 9886f261-8e00-4908-8fd8-f6ce9c6fd5b4] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:48.078330 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8dd6e1da-b642-42e3-b8d1-52d16eb47f3f tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:48.079078 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8dd6e1da-b642-42e3-b8d1-52d16eb47f3f tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:48.079742 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8dd6e1da-b642-42e3-b8d1-52d16eb47f3f tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:48.082727 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8dd6e1da-b642-42e3-b8d1-52d16eb47f3f tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:48.083466 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8dd6e1da-b642-42e3-b8d1-52d16eb47f3f tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:48.084090 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8dd6e1da-b642-42e3-b8d1-52d16eb47f3f tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:48.268398 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-3f417c23-9e50-492b-8a11-d6b9d2e3cc6f tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:48.277174 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-3f417c23-9e50-492b-8a11-d6b9d2e3cc6f tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5" status: 200 len: 1667 microversion: 2.1 time: 0.257068 Oct 04 18:46:48.278140 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1703/3654] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:48 2022] GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5 => generated 1667 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:48.304403 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-b7b3e1f1-8c1c-4819-90af-58f5e2f4c89d tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:48.305037 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-b7b3e1f1-8c1c-4819-90af-58f5e2f4c89d tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 82b86465-afb0-49ef-9932-1538010c1ae5] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:48.312274 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b7b3e1f1-8c1c-4819-90af-58f5e2f4c89d tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:48.313154 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b7b3e1f1-8c1c-4819-90af-58f5e2f4c89d tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:48.313991 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b7b3e1f1-8c1c-4819-90af-58f5e2f4c89d tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:48.314900 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b7b3e1f1-8c1c-4819-90af-58f5e2f4c89d tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:48.315544 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b7b3e1f1-8c1c-4819-90af-58f5e2f4c89d tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:48.316167 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b7b3e1f1-8c1c-4819-90af-58f5e2f4c89d tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:48.346276 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-8dd6e1da-b642-42e3-b8d1-52d16eb47f3f tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcbf2b4b95743af9e6fa1be54554baa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab4da2b9b9f4c7a9c25b7edaab3027d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:48.357029 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-8dd6e1da-b642-42e3-b8d1-52d16eb47f3f tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] 10.222.0.43 "GET /compute/v2.1/servers/9886f261-8e00-4908-8fd8-f6ce9c6fd5b4" status: 200 len: 1539 microversion: 2.1 time: 0.302717 Oct 04 18:46:48.358464 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1952/3655] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:48 2022] GET /compute/v2.1/servers/9886f261-8e00-4908-8fd8-f6ce9c6fd5b4 => generated 1539 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:46:48.388201 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-2f159ed9-3f52-486d-a47f-c37365e43b5c tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:48.389493 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-2f159ed9-3f52-486d-a47f-c37365e43b5c tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] [instance: fa47906d-d394-46fe-9143-780bcd27a715] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:48.398374 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2f159ed9-3f52-486d-a47f-c37365e43b5c tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:48.399182 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2f159ed9-3f52-486d-a47f-c37365e43b5c tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:48.399800 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2f159ed9-3f52-486d-a47f-c37365e43b5c tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:48.400757 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2f159ed9-3f52-486d-a47f-c37365e43b5c tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:48.401422 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2f159ed9-3f52-486d-a47f-c37365e43b5c tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:48.402026 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2f159ed9-3f52-486d-a47f-c37365e43b5c tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:48.476438 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-b7b3e1f1-8c1c-4819-90af-58f5e2f4c89d tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:48.480295 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:46:48.488892 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-b7b3e1f1-8c1c-4819-90af-58f5e2f4c89d tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5" status: 200 len: 1667 microversion: 2.1 time: 0.188548 Oct 04 18:46:48.501764 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1704/3656] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:48 2022] GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5 => generated 1667 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:48.513662 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-991cd65b-b97a-488f-8710-c819d119ef47 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:48.514756 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-991cd65b-b97a-488f-8710-c819d119ef47 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 82b86465-afb0-49ef-9932-1538010c1ae5] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:48.521655 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-991cd65b-b97a-488f-8710-c819d119ef47 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:48.522435 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-991cd65b-b97a-488f-8710-c819d119ef47 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:48.523125 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-991cd65b-b97a-488f-8710-c819d119ef47 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:48.524087 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-991cd65b-b97a-488f-8710-c819d119ef47 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:48.525011 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-991cd65b-b97a-488f-8710-c819d119ef47 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:48.525796 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-991cd65b-b97a-488f-8710-c819d119ef47 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:48.763651 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-991cd65b-b97a-488f-8710-c819d119ef47 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:48.774168 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-991cd65b-b97a-488f-8710-c819d119ef47 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5" status: 200 len: 1667 microversion: 2.1 time: 0.264417 Oct 04 18:46:48.779145 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1705/3657] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:48 2022] GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5 => generated 1667 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:46:48.786126 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-23034888-acf8-49f2-a7d3-b5200a2a5ab2 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:48.787012 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-23034888-acf8-49f2-a7d3-b5200a2a5ab2 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] [instance: 76d475ab-f41c-44df-8aaa-10242bdbfcde] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:48.797446 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-23034888-acf8-49f2-a7d3-b5200a2a5ab2 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:48.798312 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-23034888-acf8-49f2-a7d3-b5200a2a5ab2 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:48.798720 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-23034888-acf8-49f2-a7d3-b5200a2a5ab2 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:48.799514 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-23034888-acf8-49f2-a7d3-b5200a2a5ab2 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:48.800057 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-23034888-acf8-49f2-a7d3-b5200a2a5ab2 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:48.800562 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-23034888-acf8-49f2-a7d3-b5200a2a5ab2 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:48.895123 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-2f159ed9-3f52-486d-a47f-c37365e43b5c tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:48.913732 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-2f159ed9-3f52-486d-a47f-c37365e43b5c tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:48.915500 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-2f159ed9-3f52-486d-a47f-c37365e43b5c tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:48.916989 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-2f159ed9-3f52-486d-a47f-c37365e43b5c tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] 10.222.0.43 "GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715" status: 200 len: 1874 microversion: 2.32 time: 0.537243 Oct 04 18:46:48.917511 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1953/3658] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:46:48 2022] GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715 => generated 1874 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:46:48.923535 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-46a3496f-a084-4960-8813-7eca8b1c9619 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:48.924392 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-46a3496f-a084-4960-8813-7eca8b1c9619 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] [instance: 15541ec9-3112-4adc-9fad-6d20a88f2c09] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:48.931530 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-46a3496f-a084-4960-8813-7eca8b1c9619 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:48.932232 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-46a3496f-a084-4960-8813-7eca8b1c9619 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:48.932860 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-46a3496f-a084-4960-8813-7eca8b1c9619 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:48.933784 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-46a3496f-a084-4960-8813-7eca8b1c9619 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:48.934407 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-46a3496f-a084-4960-8813-7eca8b1c9619 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:48.935014 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-46a3496f-a084-4960-8813-7eca8b1c9619 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:48.969971 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-23034888-acf8-49f2-a7d3-b5200a2a5ab2 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a116f2d9656548458264cc4fb1934c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff3c3dc76405401baf72fe00c5d50b56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:48.979153 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-23034888-acf8-49f2-a7d3-b5200a2a5ab2 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] 10.222.0.43 "GET /compute/v2.1/servers/76d475ab-f41c-44df-8aaa-10242bdbfcde" status: 200 len: 1724 microversion: 2.1 time: 0.198081 Oct 04 18:46:48.989164 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1706/3659] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:48 2022] GET /compute/v2.1/servers/76d475ab-f41c-44df-8aaa-10242bdbfcde => generated 1724 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:49.069484 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.objects.instance [None req-46a3496f-a084-4960-8813-7eca8b1c9619 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lazy-loading 'services' on Instance uuid 15541ec9-3112-4adc-9fad-6d20a88f2c09 {{(pid=123596) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:46:49.140421 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-5c0a0baa-286c-4682-9113-c784f4f80c40 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:49.141040 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-5c0a0baa-286c-4682-9113-c784f4f80c40 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] [instance: fd09cc9b-d9dd-4133-8665-eeb6d8f51df8] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:49.147932 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5c0a0baa-286c-4682-9113-c784f4f80c40 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:49.148757 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5c0a0baa-286c-4682-9113-c784f4f80c40 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:49.149462 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5c0a0baa-286c-4682-9113-c784f4f80c40 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:49.150371 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5c0a0baa-286c-4682-9113-c784f4f80c40 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:49.150989 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5c0a0baa-286c-4682-9113-c784f4f80c40 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:49.155985 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5c0a0baa-286c-4682-9113-c784f4f80c40 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:49.163657 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-46a3496f-a084-4960-8813-7eca8b1c9619 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] 10.222.0.43 "DELETE /compute/v2.1/servers/15541ec9-3112-4adc-9fad-6d20a88f2c09/os-volume_attachments/383ace23-6782-4417-b230-f573687bab01" status: 202 len: 0 microversion: 2.1 time: 0.244590 Oct 04 18:46:49.164399 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1954/3660] 10.222.0.43 () {58 vars in 1416 bytes} [Tue Oct 4 18:46:48 2022] DELETE /compute/v2.1/servers/15541ec9-3112-4adc-9fad-6d20a88f2c09/os-volume_attachments/383ace23-6782-4417-b230-f573687bab01 => generated 0 bytes in 246 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:46:49.171647 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-d66b1aa4-2b19-42bf-b935-75f94fb7c918 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:49.172461 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-d66b1aa4-2b19-42bf-b935-75f94fb7c918 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 82b86465-afb0-49ef-9932-1538010c1ae5] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:49.179536 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d66b1aa4-2b19-42bf-b935-75f94fb7c918 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:49.180115 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d66b1aa4-2b19-42bf-b935-75f94fb7c918 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:49.180990 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d66b1aa4-2b19-42bf-b935-75f94fb7c918 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:49.181568 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d66b1aa4-2b19-42bf-b935-75f94fb7c918 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:49.182255 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d66b1aa4-2b19-42bf-b935-75f94fb7c918 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:49.182903 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d66b1aa4-2b19-42bf-b935-75f94fb7c918 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:49.352432 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-5c0a0baa-286c-4682-9113-c784f4f80c40 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9971b5861f44c1a1da94eda0f8f02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f809b8ae704988961908bef0f3cb24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:49.363224 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-5c0a0baa-286c-4682-9113-c784f4f80c40 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] 10.222.0.43 "GET /compute/v2.1/servers/fd09cc9b-d9dd-4133-8665-eeb6d8f51df8" status: 200 len: 1199 microversion: 2.1 time: 0.381685 Oct 04 18:46:49.364037 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1707/3661] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:48 2022] GET /compute/v2.1/servers/fd09cc9b-d9dd-4133-8665-eeb6d8f51df8 => generated 1199 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:49.367430 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-d66b1aa4-2b19-42bf-b935-75f94fb7c918 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:49.373826 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-1171f391-0add-46f1-9bdf-17e31bb678f4 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:49.374955 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-1171f391-0add-46f1-9bdf-17e31bb678f4 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] [instance: 00c17e4b-c80e-463e-a3e9-486c118552be] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:49.383802 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1171f391-0add-46f1-9bdf-17e31bb678f4 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:49.384855 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1171f391-0add-46f1-9bdf-17e31bb678f4 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:49.385574 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1171f391-0add-46f1-9bdf-17e31bb678f4 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:49.387982 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-d66b1aa4-2b19-42bf-b935-75f94fb7c918 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5" status: 200 len: 1667 microversion: 2.1 time: 0.221446 Oct 04 18:46:49.388593 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1955/3662] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:49 2022] GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5 => generated 1667 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:49.390571 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1171f391-0add-46f1-9bdf-17e31bb678f4 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:49.391287 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1171f391-0add-46f1-9bdf-17e31bb678f4 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:49.393371 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1171f391-0add-46f1-9bdf-17e31bb678f4 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:49.402152 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-04f2bee4-7f6f-4caf-bce2-90a45b76aac1 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:49.405422 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-04f2bee4-7f6f-4caf-bce2-90a45b76aac1 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] [instance: 15541ec9-3112-4adc-9fad-6d20a88f2c09] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:49.423004 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-04f2bee4-7f6f-4caf-bce2-90a45b76aac1 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:49.423438 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-04f2bee4-7f6f-4caf-bce2-90a45b76aac1 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:49.423898 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-04f2bee4-7f6f-4caf-bce2-90a45b76aac1 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:49.424638 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-04f2bee4-7f6f-4caf-bce2-90a45b76aac1 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:49.425101 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-04f2bee4-7f6f-4caf-bce2-90a45b76aac1 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:49.425616 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-04f2bee4-7f6f-4caf-bce2-90a45b76aac1 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:49.476273 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-04f2bee4-7f6f-4caf-bce2-90a45b76aac1 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] 10.222.0.43 "GET /compute/v2.1/servers/15541ec9-3112-4adc-9fad-6d20a88f2c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.085802 Oct 04 18:46:49.478930 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1956/3663] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Oct 4 18:46:49 2022] GET /compute/v2.1/servers/15541ec9-3112-4adc-9fad-6d20a88f2c09/os-volume_attachments => generated 197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:46:49.486309 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-53d66dd1-106f-4235-953a-33ad27b6b7fc tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:49.487065 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-53d66dd1-106f-4235-953a-33ad27b6b7fc tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] [instance: 9886f261-8e00-4908-8fd8-f6ce9c6fd5b4] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:49.493467 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-53d66dd1-106f-4235-953a-33ad27b6b7fc tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:49.494083 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-53d66dd1-106f-4235-953a-33ad27b6b7fc tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:49.494806 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-53d66dd1-106f-4235-953a-33ad27b6b7fc tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:49.495625 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-53d66dd1-106f-4235-953a-33ad27b6b7fc tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:49.496157 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-53d66dd1-106f-4235-953a-33ad27b6b7fc tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:49.496665 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-53d66dd1-106f-4235-953a-33ad27b6b7fc tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:49.574272 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-1171f391-0add-46f1-9bdf-17e31bb678f4 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c710f394164b89b16bcac2fe51c58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65037d4ea5124d749e42928032e803fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:49.586256 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-1171f391-0add-46f1-9bdf-17e31bb678f4 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] 10.222.0.43 "GET /compute/v2.1/servers/00c17e4b-c80e-463e-a3e9-486c118552be" status: 200 len: 1523 microversion: 2.1 time: 0.219407 Oct 04 18:46:49.587472 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1708/3664] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:49 2022] GET /compute/v2.1/servers/00c17e4b-c80e-463e-a3e9-486c118552be => generated 1523 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:49.592614 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-79ea65e7-dc7c-42f6-af58-af00be078b70 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:49.594379 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-79ea65e7-dc7c-42f6-af58-af00be078b70 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 82b86465-afb0-49ef-9932-1538010c1ae5] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:49.601252 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-79ea65e7-dc7c-42f6-af58-af00be078b70 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:49.602008 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-79ea65e7-dc7c-42f6-af58-af00be078b70 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:49.602718 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-79ea65e7-dc7c-42f6-af58-af00be078b70 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:49.603606 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-79ea65e7-dc7c-42f6-af58-af00be078b70 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:49.604134 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-79ea65e7-dc7c-42f6-af58-af00be078b70 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:49.604628 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-79ea65e7-dc7c-42f6-af58-af00be078b70 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:49.758889 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-79ea65e7-dc7c-42f6-af58-af00be078b70 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:49.767054 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-79ea65e7-dc7c-42f6-af58-af00be078b70 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5" status: 200 len: 1667 microversion: 2.1 time: 0.178103 Oct 04 18:46:49.767680 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1709/3665] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:49 2022] GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5 => generated 1667 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:49.791298 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-5d368f63-9209-428c-87f4-b0de93d478f2 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:49.791830 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-5d368f63-9209-428c-87f4-b0de93d478f2 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 82b86465-afb0-49ef-9932-1538010c1ae5] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:49.809166 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5d368f63-9209-428c-87f4-b0de93d478f2 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:49.809505 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5d368f63-9209-428c-87f4-b0de93d478f2 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:49.809950 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5d368f63-9209-428c-87f4-b0de93d478f2 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:49.810673 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5d368f63-9209-428c-87f4-b0de93d478f2 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:49.811814 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5d368f63-9209-428c-87f4-b0de93d478f2 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:49.812257 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5d368f63-9209-428c-87f4-b0de93d478f2 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:49.832519 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-53d66dd1-106f-4235-953a-33ad27b6b7fc tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcbf2b4b95743af9e6fa1be54554baa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab4da2b9b9f4c7a9c25b7edaab3027d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:49.843144 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-53d66dd1-106f-4235-953a-33ad27b6b7fc tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] 10.222.0.43 "GET /compute/v2.1/servers/9886f261-8e00-4908-8fd8-f6ce9c6fd5b4" status: 200 len: 1521 microversion: 2.1 time: 0.362244 Oct 04 18:46:49.843777 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1957/3666] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:49 2022] GET /compute/v2.1/servers/9886f261-8e00-4908-8fd8-f6ce9c6fd5b4 => generated 1521 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:49.866869 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-58ee23a2-2309-4a19-a9dc-f1799c3e37c6 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:49.867515 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-58ee23a2-2309-4a19-a9dc-f1799c3e37c6 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] [instance: 9886f261-8e00-4908-8fd8-f6ce9c6fd5b4] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:49.873989 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-58ee23a2-2309-4a19-a9dc-f1799c3e37c6 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:49.874830 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-58ee23a2-2309-4a19-a9dc-f1799c3e37c6 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:49.875422 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-58ee23a2-2309-4a19-a9dc-f1799c3e37c6 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:49.876196 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-58ee23a2-2309-4a19-a9dc-f1799c3e37c6 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:49.876866 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-58ee23a2-2309-4a19-a9dc-f1799c3e37c6 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:49.877570 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-58ee23a2-2309-4a19-a9dc-f1799c3e37c6 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:49.909891 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-58ee23a2-2309-4a19-a9dc-f1799c3e37c6 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] [instance: 9886f261-8e00-4908-8fd8-f6ce9c6fd5b4] Going to try to terminate instance {{(pid=123596) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:46:50.022420 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-5d368f63-9209-428c-87f4-b0de93d478f2 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:50.034719 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-5d368f63-9209-428c-87f4-b0de93d478f2 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5" status: 200 len: 1667 microversion: 2.1 time: 0.247453 Oct 04 18:46:50.045308 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1710/3667] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:49 2022] GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5 => generated 1667 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:50.045308 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-bff8b734-e311-4cd3-8814-9764fce1afc8 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:50.049322 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-58ee23a2-2309-4a19-a9dc-f1799c3e37c6 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] 10.222.0.43 "DELETE /compute/v2.1/servers/9886f261-8e00-4908-8fd8-f6ce9c6fd5b4" status: 204 len: 0 microversion: 2.1 time: 0.186002 Oct 04 18:46:50.050963 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1958/3668] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 18:46:49 2022] DELETE /compute/v2.1/servers/9886f261-8e00-4908-8fd8-f6ce9c6fd5b4 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 18:46:50.054179 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-bff8b734-e311-4cd3-8814-9764fce1afc8 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] [instance: fa47906d-d394-46fe-9143-780bcd27a715] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:50.065288 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_api:SELECT=100 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:46:50.066986 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-810af1a6-e5d8-4c68-a0e8-10e99e49bc1c tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:50.067456 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bff8b734-e311-4cd3-8814-9764fce1afc8 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:50.068064 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bff8b734-e311-4cd3-8814-9764fce1afc8 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:50.068548 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-810af1a6-e5d8-4c68-a0e8-10e99e49bc1c tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] [instance: 76d475ab-f41c-44df-8aaa-10242bdbfcde] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:50.068854 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bff8b734-e311-4cd3-8814-9764fce1afc8 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:50.069739 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bff8b734-e311-4cd3-8814-9764fce1afc8 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:50.070308 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bff8b734-e311-4cd3-8814-9764fce1afc8 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:50.070838 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bff8b734-e311-4cd3-8814-9764fce1afc8 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:50.076112 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-810af1a6-e5d8-4c68-a0e8-10e99e49bc1c tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:50.077624 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-810af1a6-e5d8-4c68-a0e8-10e99e49bc1c tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:50.078083 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-810af1a6-e5d8-4c68-a0e8-10e99e49bc1c tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:50.078810 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-810af1a6-e5d8-4c68-a0e8-10e99e49bc1c tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:50.079272 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-810af1a6-e5d8-4c68-a0e8-10e99e49bc1c tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:50.079709 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-810af1a6-e5d8-4c68-a0e8-10e99e49bc1c tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:50.318190 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-bff8b734-e311-4cd3-8814-9764fce1afc8 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:50.330637 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-bff8b734-e311-4cd3-8814-9764fce1afc8 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:50.332565 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-bff8b734-e311-4cd3-8814-9764fce1afc8 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:50.334801 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-bff8b734-e311-4cd3-8814-9764fce1afc8 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] 10.222.0.43 "GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715" status: 200 len: 1874 microversion: 2.32 time: 0.297932 Oct 04 18:46:50.335389 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1711/3669] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:46:50 2022] GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715 => generated 1874 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:46:50.341494 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-9507668a-d57d-42b7-953e-7e859c18437b tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:50.342449 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-9507668a-d57d-42b7-953e-7e859c18437b tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] [instance: 9886f261-8e00-4908-8fd8-f6ce9c6fd5b4] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:50.350706 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9507668a-d57d-42b7-953e-7e859c18437b tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:50.351310 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9507668a-d57d-42b7-953e-7e859c18437b tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:50.353901 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9507668a-d57d-42b7-953e-7e859c18437b tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:50.353901 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9507668a-d57d-42b7-953e-7e859c18437b tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:50.353901 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9507668a-d57d-42b7-953e-7e859c18437b tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:50.354267 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9507668a-d57d-42b7-953e-7e859c18437b tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:50.393090 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-810af1a6-e5d8-4c68-a0e8-10e99e49bc1c tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a116f2d9656548458264cc4fb1934c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff3c3dc76405401baf72fe00c5d50b56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:50.406367 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-810af1a6-e5d8-4c68-a0e8-10e99e49bc1c tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] 10.222.0.43 "GET /compute/v2.1/servers/76d475ab-f41c-44df-8aaa-10242bdbfcde" status: 200 len: 1724 microversion: 2.1 time: 0.348236 Oct 04 18:46:50.407754 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1959/3670] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:50 2022] GET /compute/v2.1/servers/76d475ab-f41c-44df-8aaa-10242bdbfcde => generated 1724 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:50.413328 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-414485f8-cebc-4ecb-9548-54fc16b93e8a tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:50.414295 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-414485f8-cebc-4ecb-9548-54fc16b93e8a tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] [instance: fd09cc9b-d9dd-4133-8665-eeb6d8f51df8] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:50.422331 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-414485f8-cebc-4ecb-9548-54fc16b93e8a tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:50.423146 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-414485f8-cebc-4ecb-9548-54fc16b93e8a tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:50.423842 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-414485f8-cebc-4ecb-9548-54fc16b93e8a tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:50.424644 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-414485f8-cebc-4ecb-9548-54fc16b93e8a tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:50.425396 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-414485f8-cebc-4ecb-9548-54fc16b93e8a tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:50.426058 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-414485f8-cebc-4ecb-9548-54fc16b93e8a tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:50.430817 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:46:50.520996 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-9507668a-d57d-42b7-953e-7e859c18437b tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcbf2b4b95743af9e6fa1be54554baa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab4da2b9b9f4c7a9c25b7edaab3027d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:50.529365 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-9507668a-d57d-42b7-953e-7e859c18437b tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] 10.222.0.43 "GET /compute/v2.1/servers/9886f261-8e00-4908-8fd8-f6ce9c6fd5b4" status: 200 len: 1527 microversion: 2.1 time: 0.192529 Oct 04 18:46:50.530227 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1712/3671] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:50 2022] GET /compute/v2.1/servers/9886f261-8e00-4908-8fd8-f6ce9c6fd5b4 => generated 1527 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:50.537350 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-07dec5e6-dda1-4175-bd1c-b82427d5b529 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:50.539727 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-07dec5e6-dda1-4175-bd1c-b82427d5b529 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] [instance: 15541ec9-3112-4adc-9fad-6d20a88f2c09] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:50.546945 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-07dec5e6-dda1-4175-bd1c-b82427d5b529 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:50.547917 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-07dec5e6-dda1-4175-bd1c-b82427d5b529 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:50.548559 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-07dec5e6-dda1-4175-bd1c-b82427d5b529 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:50.549506 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-07dec5e6-dda1-4175-bd1c-b82427d5b529 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:50.550183 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-07dec5e6-dda1-4175-bd1c-b82427d5b529 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:50.550624 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-07dec5e6-dda1-4175-bd1c-b82427d5b529 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:50.586509 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-07dec5e6-dda1-4175-bd1c-b82427d5b529 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] 10.222.0.43 "GET /compute/v2.1/servers/15541ec9-3112-4adc-9fad-6d20a88f2c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055001 Oct 04 18:46:50.587203 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1713/3672] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Oct 4 18:46:50 2022] GET /compute/v2.1/servers/15541ec9-3112-4adc-9fad-6d20a88f2c09/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:46:50.610445 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-2259ad76-baf1-4fdf-a46e-46b080d8e70d tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:50.611068 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-2259ad76-baf1-4fdf-a46e-46b080d8e70d tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] [instance: 00c17e4b-c80e-463e-a3e9-486c118552be] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:50.617245 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2259ad76-baf1-4fdf-a46e-46b080d8e70d tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:50.617743 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2259ad76-baf1-4fdf-a46e-46b080d8e70d tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:50.618329 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2259ad76-baf1-4fdf-a46e-46b080d8e70d tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:50.619052 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2259ad76-baf1-4fdf-a46e-46b080d8e70d tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:50.619509 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2259ad76-baf1-4fdf-a46e-46b080d8e70d tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:50.619941 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2259ad76-baf1-4fdf-a46e-46b080d8e70d tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:50.657589 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-414485f8-cebc-4ecb-9548-54fc16b93e8a tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9971b5861f44c1a1da94eda0f8f02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f809b8ae704988961908bef0f3cb24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:50.666932 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-414485f8-cebc-4ecb-9548-54fc16b93e8a tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] 10.222.0.43 "GET /compute/v2.1/servers/fd09cc9b-d9dd-4133-8665-eeb6d8f51df8" status: 200 len: 1199 microversion: 2.1 time: 0.257521 Oct 04 18:46:50.667542 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1960/3673] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:50 2022] GET /compute/v2.1/servers/fd09cc9b-d9dd-4133-8665-eeb6d8f51df8 => generated 1199 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:50.764013 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-2259ad76-baf1-4fdf-a46e-46b080d8e70d tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c710f394164b89b16bcac2fe51c58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65037d4ea5124d749e42928032e803fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:50.771811 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-2259ad76-baf1-4fdf-a46e-46b080d8e70d tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] 10.222.0.43 "GET /compute/v2.1/servers/00c17e4b-c80e-463e-a3e9-486c118552be" status: 200 len: 1523 microversion: 2.1 time: 0.165454 Oct 04 18:46:50.772398 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1714/3674] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:50 2022] GET /compute/v2.1/servers/00c17e4b-c80e-463e-a3e9-486c118552be => generated 1523 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:46:51.361449 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-1d0e9273-23e4-41e7-95be-9a9c20df43be tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:51.362878 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-1d0e9273-23e4-41e7-95be-9a9c20df43be tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] [instance: fa47906d-d394-46fe-9143-780bcd27a715] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:51.370179 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1d0e9273-23e4-41e7-95be-9a9c20df43be tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:51.371026 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1d0e9273-23e4-41e7-95be-9a9c20df43be tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:51.371689 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1d0e9273-23e4-41e7-95be-9a9c20df43be tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:51.372639 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1d0e9273-23e4-41e7-95be-9a9c20df43be tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:51.373380 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1d0e9273-23e4-41e7-95be-9a9c20df43be tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:51.374030 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1d0e9273-23e4-41e7-95be-9a9c20df43be tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:51.431872 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-45be4180-cdcd-483a-aff9-efd156db4323 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:51.432407 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-45be4180-cdcd-483a-aff9-efd156db4323 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] [instance: 76d475ab-f41c-44df-8aaa-10242bdbfcde] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:51.451538 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-45be4180-cdcd-483a-aff9-efd156db4323 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:51.452058 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-45be4180-cdcd-483a-aff9-efd156db4323 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:51.452634 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-45be4180-cdcd-483a-aff9-efd156db4323 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:51.453391 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-45be4180-cdcd-483a-aff9-efd156db4323 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:51.453943 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-45be4180-cdcd-483a-aff9-efd156db4323 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:51.454385 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-45be4180-cdcd-483a-aff9-efd156db4323 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:51.601481 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-1d0e9273-23e4-41e7-95be-9a9c20df43be tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:51.616356 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-1d0e9273-23e4-41e7-95be-9a9c20df43be tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:51.618161 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-1d0e9273-23e4-41e7-95be-9a9c20df43be tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:51.619601 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-1d0e9273-23e4-41e7-95be-9a9c20df43be tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] 10.222.0.43 "GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715" status: 200 len: 1874 microversion: 2.32 time: 0.263553 Oct 04 18:46:51.629815 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1961/3675] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:46:51 2022] GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715 => generated 1874 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:46:51.647762 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-60119aa4-771e-44e4-8643-1cd6d0c59030 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:51.649850 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-60119aa4-771e-44e4-8643-1cd6d0c59030 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] [instance: 9886f261-8e00-4908-8fd8-f6ce9c6fd5b4] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:51.657861 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-60119aa4-771e-44e4-8643-1cd6d0c59030 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:51.658562 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-45be4180-cdcd-483a-aff9-efd156db4323 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a116f2d9656548458264cc4fb1934c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff3c3dc76405401baf72fe00c5d50b56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:51.659099 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-60119aa4-771e-44e4-8643-1cd6d0c59030 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:51.659728 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-60119aa4-771e-44e4-8643-1cd6d0c59030 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:51.660637 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-60119aa4-771e-44e4-8643-1cd6d0c59030 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:51.661285 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-60119aa4-771e-44e4-8643-1cd6d0c59030 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:51.661879 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-60119aa4-771e-44e4-8643-1cd6d0c59030 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:51.667995 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-45be4180-cdcd-483a-aff9-efd156db4323 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] 10.222.0.43 "GET /compute/v2.1/servers/76d475ab-f41c-44df-8aaa-10242bdbfcde" status: 200 len: 1724 microversion: 2.1 time: 0.240232 Oct 04 18:46:51.669358 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1715/3676] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:51 2022] GET /compute/v2.1/servers/76d475ab-f41c-44df-8aaa-10242bdbfcde => generated 1724 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:46:51.674495 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-0b7fe445-dc6b-492f-836b-687ac45c8f0b tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:51.677060 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-0b7fe445-dc6b-492f-836b-687ac45c8f0b tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] [instance: 15541ec9-3112-4adc-9fad-6d20a88f2c09] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:51.683724 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0b7fe445-dc6b-492f-836b-687ac45c8f0b tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:51.684490 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0b7fe445-dc6b-492f-836b-687ac45c8f0b tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:51.685301 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0b7fe445-dc6b-492f-836b-687ac45c8f0b tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:51.686280 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0b7fe445-dc6b-492f-836b-687ac45c8f0b tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:51.686953 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0b7fe445-dc6b-492f-836b-687ac45c8f0b tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:51.687601 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0b7fe445-dc6b-492f-836b-687ac45c8f0b tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:51.727512 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-0b7fe445-dc6b-492f-836b-687ac45c8f0b tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] 10.222.0.43 "GET /compute/v2.1/servers/15541ec9-3112-4adc-9fad-6d20a88f2c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056544 Oct 04 18:46:51.734146 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1716/3677] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Oct 4 18:46:51 2022] GET /compute/v2.1/servers/15541ec9-3112-4adc-9fad-6d20a88f2c09/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:46:51.742473 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-87f05298-39d8-4e47-9eec-0082d005c376 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:51.744613 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-87f05298-39d8-4e47-9eec-0082d005c376 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] [instance: fd09cc9b-d9dd-4133-8665-eeb6d8f51df8] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:51.753028 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-87f05298-39d8-4e47-9eec-0082d005c376 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:51.753518 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-87f05298-39d8-4e47-9eec-0082d005c376 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:51.754152 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-87f05298-39d8-4e47-9eec-0082d005c376 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:51.754867 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-87f05298-39d8-4e47-9eec-0082d005c376 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:51.755325 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-87f05298-39d8-4e47-9eec-0082d005c376 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:51.756050 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-87f05298-39d8-4e47-9eec-0082d005c376 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:51.946004 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-87f05298-39d8-4e47-9eec-0082d005c376 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9971b5861f44c1a1da94eda0f8f02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f809b8ae704988961908bef0f3cb24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:51.960702 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-87f05298-39d8-4e47-9eec-0082d005c376 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] 10.222.0.43 "GET /compute/v2.1/servers/fd09cc9b-d9dd-4133-8665-eeb6d8f51df8" status: 200 len: 1199 microversion: 2.1 time: 0.224849 Oct 04 18:46:51.963951 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1717/3678] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:51 2022] GET /compute/v2.1/servers/fd09cc9b-d9dd-4133-8665-eeb6d8f51df8 => generated 1199 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:51.971731 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-284778cb-f513-486d-8929-18e79d566790 req-a1578ce0-8d4b-4d88-ad41-6797e3307ab0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd09cc9b-d9dd-4133-8665-eeb6d8f51df8", "name": "network-vif-plugged", "status": "completed", "tag": "538a7aa2-5b2b-4b33-a253-770b58f4066e"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:46:51.990560 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-284778cb-f513-486d-8929-18e79d566790 req-a1578ce0-8d4b-4d88-ad41-6797e3307ab0 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:51.991471 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-284778cb-f513-486d-8929-18e79d566790 req-a1578ce0-8d4b-4d88-ad41-6797e3307ab0 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:51.992145 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-284778cb-f513-486d-8929-18e79d566790 req-a1578ce0-8d4b-4d88-ad41-6797e3307ab0 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:52.010190 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-284778cb-f513-486d-8929-18e79d566790 req-a1578ce0-8d4b-4d88-ad41-6797e3307ab0 service nova] Creating event network-vif-plugged:538a7aa2-5b2b-4b33-a253-770b58f4066e for instance fd09cc9b-d9dd-4133-8665-eeb6d8f51df8 on n-h1-851028-13 Oct 04 18:46:52.017812 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-284778cb-f513-486d-8929-18e79d566790 req-a1578ce0-8d4b-4d88-ad41-6797e3307ab0 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051538 Oct 04 18:46:52.018996 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1718/3679] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:46:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:46:52.028980 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-7c66f83f-f889-40e3-9567-48ba1054f155 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:52.030431 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-7c66f83f-f889-40e3-9567-48ba1054f155 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] [instance: 00c17e4b-c80e-463e-a3e9-486c118552be] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:52.040387 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7c66f83f-f889-40e3-9567-48ba1054f155 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:52.041041 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7c66f83f-f889-40e3-9567-48ba1054f155 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:52.041776 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7c66f83f-f889-40e3-9567-48ba1054f155 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:52.042592 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7c66f83f-f889-40e3-9567-48ba1054f155 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:52.043731 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7c66f83f-f889-40e3-9567-48ba1054f155 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:52.044566 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7c66f83f-f889-40e3-9567-48ba1054f155 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:52.433394 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-60119aa4-771e-44e4-8643-1cd6d0c59030 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcbf2b4b95743af9e6fa1be54554baa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab4da2b9b9f4c7a9c25b7edaab3027d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:52.444045 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-60119aa4-771e-44e4-8643-1cd6d0c59030 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] 10.222.0.43 "GET /compute/v2.1/servers/9886f261-8e00-4908-8fd8-f6ce9c6fd5b4" status: 200 len: 1527 microversion: 2.1 time: 0.812869 Oct 04 18:46:52.461135 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1962/3680] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:51 2022] GET /compute/v2.1/servers/9886f261-8e00-4908-8fd8-f6ce9c6fd5b4 => generated 1527 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:52.465827 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-7c66f83f-f889-40e3-9567-48ba1054f155 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c710f394164b89b16bcac2fe51c58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65037d4ea5124d749e42928032e803fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:52.474353 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-7c66f83f-f889-40e3-9567-48ba1054f155 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] 10.222.0.43 "GET /compute/v2.1/servers/00c17e4b-c80e-463e-a3e9-486c118552be" status: 200 len: 1523 microversion: 2.1 time: 0.453877 Oct 04 18:46:52.479372 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1719/3681] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:52 2022] GET /compute/v2.1/servers/00c17e4b-c80e-463e-a3e9-486c118552be => generated 1523 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:52.650950 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-968acea0-f101-4b6d-9b90-26b625f828de tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:52.651750 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-968acea0-f101-4b6d-9b90-26b625f828de tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] [instance: fa47906d-d394-46fe-9143-780bcd27a715] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:52.669532 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-968acea0-f101-4b6d-9b90-26b625f828de tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:52.670187 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-968acea0-f101-4b6d-9b90-26b625f828de tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:52.671285 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-968acea0-f101-4b6d-9b90-26b625f828de tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:52.672245 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-968acea0-f101-4b6d-9b90-26b625f828de tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:52.672972 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-968acea0-f101-4b6d-9b90-26b625f828de tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:52.673852 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-968acea0-f101-4b6d-9b90-26b625f828de tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:52.697103 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-b9a0c69b-284c-4cd5-84b6-f7f6b36da486 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:52.698479 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-b9a0c69b-284c-4cd5-84b6-f7f6b36da486 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] [instance: 76d475ab-f41c-44df-8aaa-10242bdbfcde] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:52.712049 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b9a0c69b-284c-4cd5-84b6-f7f6b36da486 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:52.712923 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b9a0c69b-284c-4cd5-84b6-f7f6b36da486 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:52.713624 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b9a0c69b-284c-4cd5-84b6-f7f6b36da486 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:52.714579 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b9a0c69b-284c-4cd5-84b6-f7f6b36da486 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:52.715249 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b9a0c69b-284c-4cd5-84b6-f7f6b36da486 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:52.715889 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b9a0c69b-284c-4cd5-84b6-f7f6b36da486 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:53.136358 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-b9a0c69b-284c-4cd5-84b6-f7f6b36da486 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a116f2d9656548458264cc4fb1934c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff3c3dc76405401baf72fe00c5d50b56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:53.147973 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-b9a0c69b-284c-4cd5-84b6-f7f6b36da486 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] 10.222.0.43 "GET /compute/v2.1/servers/76d475ab-f41c-44df-8aaa-10242bdbfcde" status: 200 len: 1701 microversion: 2.1 time: 0.455912 Oct 04 18:46:53.150501 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1720/3682] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:52 2022] GET /compute/v2.1/servers/76d475ab-f41c-44df-8aaa-10242bdbfcde => generated 1701 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:46:53.162094 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-821a9e2e-0597-4f39-a061-7edeb74704b7 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:53.164792 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-821a9e2e-0597-4f39-a061-7edeb74704b7 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] [instance: 15541ec9-3112-4adc-9fad-6d20a88f2c09] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:53.194498 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-821a9e2e-0597-4f39-a061-7edeb74704b7 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:53.195028 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-821a9e2e-0597-4f39-a061-7edeb74704b7 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:53.196870 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-821a9e2e-0597-4f39-a061-7edeb74704b7 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:53.202662 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-821a9e2e-0597-4f39-a061-7edeb74704b7 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:53.203189 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-821a9e2e-0597-4f39-a061-7edeb74704b7 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:53.204966 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-821a9e2e-0597-4f39-a061-7edeb74704b7 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:53.206177 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-968acea0-f101-4b6d-9b90-26b625f828de tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:53.215938 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-968acea0-f101-4b6d-9b90-26b625f828de tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:53.217483 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-968acea0-f101-4b6d-9b90-26b625f828de tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:53.224035 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-968acea0-f101-4b6d-9b90-26b625f828de tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] 10.222.0.43 "GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715" status: 200 len: 1874 microversion: 2.32 time: 0.571693 Oct 04 18:46:53.224035 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1963/3683] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:46:52 2022] GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715 => generated 1874 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:46:53.237531 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-d93e03df-1fc1-4999-a2c2-8a6414add46e tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:53.238766 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-d93e03df-1fc1-4999-a2c2-8a6414add46e tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] [instance: fd09cc9b-d9dd-4133-8665-eeb6d8f51df8] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:53.246294 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d93e03df-1fc1-4999-a2c2-8a6414add46e tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:53.247119 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d93e03df-1fc1-4999-a2c2-8a6414add46e tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:53.247617 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d93e03df-1fc1-4999-a2c2-8a6414add46e tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:53.248386 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d93e03df-1fc1-4999-a2c2-8a6414add46e tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:53.248850 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d93e03df-1fc1-4999-a2c2-8a6414add46e tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:53.250068 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d93e03df-1fc1-4999-a2c2-8a6414add46e tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:53.279517 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-821a9e2e-0597-4f39-a061-7edeb74704b7 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] 10.222.0.43 "GET /compute/v2.1/servers/15541ec9-3112-4adc-9fad-6d20a88f2c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.127535 Oct 04 18:46:53.284912 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1721/3684] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Oct 4 18:46:53 2022] GET /compute/v2.1/servers/15541ec9-3112-4adc-9fad-6d20a88f2c09/os-volume_attachments => generated 197 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:46:53.289696 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-488ab5b8-a566-42b8-b3c3-ded0ceaad518 req-0fe6786d-d948-4d6d-8d28-ac3a6991bd21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9886f261-8e00-4908-8fd8-f6ce9c6fd5b4", "name": "network-vif-deleted", "tag": "7ad7933b-bb26-49b9-bc61-e535f1317b72"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:46:53.325811 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-488ab5b8-a566-42b8-b3c3-ded0ceaad518 req-0fe6786d-d948-4d6d-8d28-ac3a6991bd21 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:53.328422 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-488ab5b8-a566-42b8-b3c3-ded0ceaad518 req-0fe6786d-d948-4d6d-8d28-ac3a6991bd21 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:53.329153 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-488ab5b8-a566-42b8-b3c3-ded0ceaad518 req-0fe6786d-d948-4d6d-8d28-ac3a6991bd21 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:53.346231 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=100 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:46:53.364263 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-488ab5b8-a566-42b8-b3c3-ded0ceaad518 req-0fe6786d-d948-4d6d-8d28-ac3a6991bd21 service nova] Creating event network-vif-deleted:7ad7933b-bb26-49b9-bc61-e535f1317b72 for instance 9886f261-8e00-4908-8fd8-f6ce9c6fd5b4 on n-h2-851028-13 Oct 04 18:46:53.369770 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-488ab5b8-a566-42b8-b3c3-ded0ceaad518 req-0fe6786d-d948-4d6d-8d28-ac3a6991bd21 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087205 Oct 04 18:46:53.371068 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1722/3685] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:46:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:46:53.376989 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-8a0cb162-538a-4e91-9c73-65c8627fcefb tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:46:53.383968 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8a0cb162-538a-4e91-9c73-65c8627fcefb tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:53.385270 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8a0cb162-538a-4e91-9c73-65c8627fcefb tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:53.385890 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8a0cb162-538a-4e91-9c73-65c8627fcefb tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:53.430514 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-8a0cb162-538a-4e91-9c73-65c8627fcefb tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] [instance: 76d475ab-f41c-44df-8aaa-10242bdbfcde] Going to try to start instance {{(pid=123595) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 04 18:46:53.513492 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-8a0cb162-538a-4e91-9c73-65c8627fcefb tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] 10.222.0.43 "POST /compute/v2.1/servers/76d475ab-f41c-44df-8aaa-10242bdbfcde/action" status: 202 len: 0 microversion: 2.1 time: 0.140740 Oct 04 18:46:53.518471 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1723/3686] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 18:46:53 2022] POST /compute/v2.1/servers/76d475ab-f41c-44df-8aaa-10242bdbfcde/action => generated 0 bytes in 147 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:46:53.526410 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-483879d2-d68b-494e-97d1-72907d2f672c tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:53.528850 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-483879d2-d68b-494e-97d1-72907d2f672c tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] [instance: 9886f261-8e00-4908-8fd8-f6ce9c6fd5b4] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:53.545868 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-483879d2-d68b-494e-97d1-72907d2f672c tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:53.546669 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-483879d2-d68b-494e-97d1-72907d2f672c tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:53.547415 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-483879d2-d68b-494e-97d1-72907d2f672c tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:53.548803 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-483879d2-d68b-494e-97d1-72907d2f672c tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:53.549732 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-483879d2-d68b-494e-97d1-72907d2f672c tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:53.550454 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-483879d2-d68b-494e-97d1-72907d2f672c tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:53.571190 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-d93e03df-1fc1-4999-a2c2-8a6414add46e tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9971b5861f44c1a1da94eda0f8f02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f809b8ae704988961908bef0f3cb24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:53.585190 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-d93e03df-1fc1-4999-a2c2-8a6414add46e tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] 10.222.0.43 "GET /compute/v2.1/servers/fd09cc9b-d9dd-4133-8665-eeb6d8f51df8" status: 200 len: 1199 microversion: 2.1 time: 0.354244 Oct 04 18:46:53.586498 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1964/3687] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:53 2022] GET /compute/v2.1/servers/fd09cc9b-d9dd-4133-8665-eeb6d8f51df8 => generated 1199 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:53.599777 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-0cb9106d-dcc0-4fbb-8f72-22ed133d72e2 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:53.600639 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-0cb9106d-dcc0-4fbb-8f72-22ed133d72e2 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] [instance: 00c17e4b-c80e-463e-a3e9-486c118552be] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:53.613893 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0cb9106d-dcc0-4fbb-8f72-22ed133d72e2 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:53.614393 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0cb9106d-dcc0-4fbb-8f72-22ed133d72e2 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:53.616988 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0cb9106d-dcc0-4fbb-8f72-22ed133d72e2 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:53.617799 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0cb9106d-dcc0-4fbb-8f72-22ed133d72e2 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:53.618280 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0cb9106d-dcc0-4fbb-8f72-22ed133d72e2 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:53.618725 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0cb9106d-dcc0-4fbb-8f72-22ed133d72e2 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:53.620250 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-483879d2-d68b-494e-97d1-72907d2f672c tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:53.620746 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-483879d2-d68b-494e-97d1-72907d2f672c tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:53.621215 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-483879d2-d68b-494e-97d1-72907d2f672c tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:53.621676 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.objects.instance [None req-483879d2-d68b-494e-97d1-72907d2f672c tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lazy-loading 'fault' on Instance uuid 9886f261-8e00-4908-8fd8-f6ce9c6fd5b4 {{(pid=123595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:46:53.728898 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-483879d2-d68b-494e-97d1-72907d2f672c tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcbf2b4b95743af9e6fa1be54554baa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab4da2b9b9f4c7a9c25b7edaab3027d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:53.739654 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-483879d2-d68b-494e-97d1-72907d2f672c tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] 10.222.0.43 "GET /compute/v2.1/servers/9886f261-8e00-4908-8fd8-f6ce9c6fd5b4" status: 200 len: 1315 microversion: 2.1 time: 0.219723 Oct 04 18:46:53.746102 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1724/3688] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:53 2022] GET /compute/v2.1/servers/9886f261-8e00-4908-8fd8-f6ce9c6fd5b4 => generated 1315 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:53.753050 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-25c92a46-80ed-4240-8435-b7d24d4ff04d tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:53.757258 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-25c92a46-80ed-4240-8435-b7d24d4ff04d tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] [instance: 76d475ab-f41c-44df-8aaa-10242bdbfcde] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:53.776323 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-25c92a46-80ed-4240-8435-b7d24d4ff04d tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:53.777102 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-25c92a46-80ed-4240-8435-b7d24d4ff04d tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:53.777668 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-25c92a46-80ed-4240-8435-b7d24d4ff04d tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:53.781304 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-25c92a46-80ed-4240-8435-b7d24d4ff04d tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:53.781915 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-25c92a46-80ed-4240-8435-b7d24d4ff04d tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:53.782428 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-25c92a46-80ed-4240-8435-b7d24d4ff04d tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:53.871947 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-0cb9106d-dcc0-4fbb-8f72-22ed133d72e2 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c710f394164b89b16bcac2fe51c58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65037d4ea5124d749e42928032e803fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:53.882279 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-0cb9106d-dcc0-4fbb-8f72-22ed133d72e2 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] 10.222.0.43 "GET /compute/v2.1/servers/00c17e4b-c80e-463e-a3e9-486c118552be" status: 200 len: 1523 microversion: 2.1 time: 0.294224 Oct 04 18:46:53.883658 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1965/3689] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:53 2022] GET /compute/v2.1/servers/00c17e4b-c80e-463e-a3e9-486c118552be => generated 1523 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:54.172896 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-d72d1963-6d2e-4469-8533-8d3a534ffbae req-dfccdb80-dd2b-447a-97cc-89964ab1c3ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00c17e4b-c80e-463e-a3e9-486c118552be", "name": "network-vif-plugged", "status": "completed", "tag": "45676c3f-b64a-480d-b44c-aab2a72fcd1e"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:46:54.184481 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-d72d1963-6d2e-4469-8533-8d3a534ffbae req-dfccdb80-dd2b-447a-97cc-89964ab1c3ee service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:54.185611 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-d72d1963-6d2e-4469-8533-8d3a534ffbae req-dfccdb80-dd2b-447a-97cc-89964ab1c3ee service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:54.186139 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-d72d1963-6d2e-4469-8533-8d3a534ffbae req-dfccdb80-dd2b-447a-97cc-89964ab1c3ee service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:54.199816 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-d72d1963-6d2e-4469-8533-8d3a534ffbae req-dfccdb80-dd2b-447a-97cc-89964ab1c3ee service nova] Creating event network-vif-plugged:45676c3f-b64a-480d-b44c-aab2a72fcd1e for instance 00c17e4b-c80e-463e-a3e9-486c118552be on n-h1-851028-13 Oct 04 18:46:54.205352 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-d72d1963-6d2e-4469-8533-8d3a534ffbae req-dfccdb80-dd2b-447a-97cc-89964ab1c3ee service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121632 Oct 04 18:46:54.209614 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1966/3690] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:46:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:46:54.254917 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-2e4064a7-8439-46a4-b80b-751025aa6a12 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:54.255669 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-2e4064a7-8439-46a4-b80b-751025aa6a12 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] [instance: fa47906d-d394-46fe-9143-780bcd27a715] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:54.263402 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2e4064a7-8439-46a4-b80b-751025aa6a12 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:54.263875 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2e4064a7-8439-46a4-b80b-751025aa6a12 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:54.264331 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2e4064a7-8439-46a4-b80b-751025aa6a12 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:54.265045 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2e4064a7-8439-46a4-b80b-751025aa6a12 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:54.265534 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2e4064a7-8439-46a4-b80b-751025aa6a12 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:54.265970 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2e4064a7-8439-46a4-b80b-751025aa6a12 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:54.456640 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-25c92a46-80ed-4240-8435-b7d24d4ff04d tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a116f2d9656548458264cc4fb1934c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff3c3dc76405401baf72fe00c5d50b56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:54.472535 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-2e4064a7-8439-46a4-b80b-751025aa6a12 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:54.483316 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-25c92a46-80ed-4240-8435-b7d24d4ff04d tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] 10.222.0.43 "GET /compute/v2.1/servers/76d475ab-f41c-44df-8aaa-10242bdbfcde" status: 200 len: 1710 microversion: 2.1 time: 0.733260 Oct 04 18:46:54.487216 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1725/3691] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:53 2022] GET /compute/v2.1/servers/76d475ab-f41c-44df-8aaa-10242bdbfcde => generated 1710 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:54.495631 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-469b4b1c-4bc3-4f10-a337-20eda7689cc5 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:54.498497 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-469b4b1c-4bc3-4f10-a337-20eda7689cc5 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] [instance: 15541ec9-3112-4adc-9fad-6d20a88f2c09] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:54.499360 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-2e4064a7-8439-46a4-b80b-751025aa6a12 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:54.500883 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-2e4064a7-8439-46a4-b80b-751025aa6a12 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:54.506227 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-2e4064a7-8439-46a4-b80b-751025aa6a12 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] 10.222.0.43 "GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715" status: 200 len: 1874 microversion: 2.32 time: 0.256069 Oct 04 18:46:54.506588 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-469b4b1c-4bc3-4f10-a337-20eda7689cc5 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:54.507272 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-469b4b1c-4bc3-4f10-a337-20eda7689cc5 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:54.507720 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-469b4b1c-4bc3-4f10-a337-20eda7689cc5 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:54.508575 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-469b4b1c-4bc3-4f10-a337-20eda7689cc5 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:54.508738 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1967/3692] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:46:54 2022] GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715 => generated 1874 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:46:54.509042 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-469b4b1c-4bc3-4f10-a337-20eda7689cc5 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:54.509701 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-469b4b1c-4bc3-4f10-a337-20eda7689cc5 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:54.548206 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-469b4b1c-4bc3-4f10-a337-20eda7689cc5 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] 10.222.0.43 "GET /compute/v2.1/servers/15541ec9-3112-4adc-9fad-6d20a88f2c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059625 Oct 04 18:46:54.549143 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1726/3693] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Oct 4 18:46:54 2022] GET /compute/v2.1/servers/15541ec9-3112-4adc-9fad-6d20a88f2c09/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:46:54.608461 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f4c10bf4-6a90-4a09-8db2-b0334966b65a tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:54.609084 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-f4c10bf4-6a90-4a09-8db2-b0334966b65a tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] [instance: fd09cc9b-d9dd-4133-8665-eeb6d8f51df8] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:54.621443 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f4c10bf4-6a90-4a09-8db2-b0334966b65a tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:54.622303 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f4c10bf4-6a90-4a09-8db2-b0334966b65a tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:54.623279 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f4c10bf4-6a90-4a09-8db2-b0334966b65a tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:54.624409 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f4c10bf4-6a90-4a09-8db2-b0334966b65a tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:54.625499 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f4c10bf4-6a90-4a09-8db2-b0334966b65a tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:54.626365 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f4c10bf4-6a90-4a09-8db2-b0334966b65a tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:54.774177 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-559b9f33-e897-4c04-8510-2fce09928ba1 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:54.778045 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-559b9f33-e897-4c04-8510-2fce09928ba1 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] [instance: 9886f261-8e00-4908-8fd8-f6ce9c6fd5b4] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:54.788439 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-559b9f33-e897-4c04-8510-2fce09928ba1 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:54.793060 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-559b9f33-e897-4c04-8510-2fce09928ba1 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:54.793551 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-559b9f33-e897-4c04-8510-2fce09928ba1 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:54.794324 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-559b9f33-e897-4c04-8510-2fce09928ba1 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:54.794761 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-559b9f33-e897-4c04-8510-2fce09928ba1 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:54.796418 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-559b9f33-e897-4c04-8510-2fce09928ba1 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:54.816067 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-559b9f33-e897-4c04-8510-2fce09928ba1 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] HTTP exception thrown: Instance 9886f261-8e00-4908-8fd8-f6ce9c6fd5b4 could not be found. Oct 04 18:46:54.817573 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-559b9f33-e897-4c04-8510-2fce09928ba1 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Request method failure captured: Oct 04 18:46:54.817573 n-d-851028-13 devstack@n-api.service[123595]: request: GET /compute/v2.1/servers/9886f261-8e00-4908-8fd8-f6ce9c6fd5b4 HTTP/1.1 Oct 04 18:46:54.817573 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 18:46:54.817573 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 18:46:54.817573 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 18:46:54.817573 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 0 Oct 04 18:46:54.817573 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 18:46:54.817573 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 18:46:54.817573 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 18:46:54.817573 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 18:46:54.817573 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPH978iZmaQey9qRFmivrOEN9WI4gFjhDc3nSUPEBZXv1WUgd7GTFhNQGJ_Nm2KHTEzU5QZw7VgnyxDt5Dwy3JGK8gUnF9wIKq6iB3FX5CCTGK5JwEw-XtwnwemZOTSVwZU_4nc3l4c2itfEGLVIoX2yb6G-IjSzn-sL8697UlYQlcew Oct 04 18:46:54.817573 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 18:46:54.817573 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 18:46:54.817573 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 18:46:54.817573 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 18:46:54.817573 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 18:46:54.817573 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 18:46:54.817573 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: 8ab4da2b9b9f4c7a9c25b7edaab3027d Oct 04 18:46:54.817573 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2004915413 Oct 04 18:46:54.817573 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 18:46:54.817573 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 18:46:54.817573 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/8ab4da2b9b9f4c7a9c25b7edaab3027d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_8ab4da2b9b9f4c7a9c25b7edaab3027d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8ab4da2b9b9f4c7a9c25b7edaab3027d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8ab4da2b9b9f4c7a9c25b7edaab3027d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:46:54.817573 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2004915413 Oct 04 18:46:54.817573 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: 8ab4da2b9b9f4c7a9c25b7edaab3027d Oct 04 18:46:54.817573 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2004915413 Oct 04 18:46:54.817573 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-ImagesOneServerNegativeTestJSON-2004915413-project Oct 04 18:46:54.817573 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 18:46:54.817573 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 18:46:54.817573 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: cdcbf2b4b95743af9e6fa1be54554baa Oct 04 18:46:54.817573 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2004915413-project Oct 04 18:46:54.817573 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 18:46:54.817573 n-d-851028-13 devstack@n-api.service[123595]: exception: Instance 9886f261-8e00-4908-8fd8-f6ce9c6fd5b4 could not be found. Oct 04 18:46:54.817573 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': '9886f261-8e00-4908-8fd8-f6ce9c6fd5b4'} Oct 04 18:46:54.817573 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:46:54.817573 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:46:54.817573 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:46:54.817573 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:46:54.817573 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:46:54.817573 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:46:54.817573 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:46:54.817573 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:46:54.817573 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:46:54.817573 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:46:54.817573 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9886f261-8e00-4908-8fd8-f6ce9c6fd5b4 could not be found. Oct 04 18:46:54.817573 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:46:54.817573 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:46:54.817573 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:46:54.817573 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:46:54.817573 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:46:54.817573 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:46:54.817573 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:46:54.817573 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:46:54.817573 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:46:54.817573 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:46:54.817573 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:46:54.817573 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:46:54.817573 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:46:54.817573 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:46:54.817573 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:46:54.817573 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:46:54.817573 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9886f261-8e00-4908-8fd8-f6ce9c6fd5b4 could not be found. Oct 04 18:46:54.817573 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:46:54.817573 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:46:54.824074 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:46:54.824074 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:46:54.824074 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:46:54.824074 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:46:54.824074 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:46:54.824074 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:46:54.824074 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9886f261-8e00-4908-8fd8-f6ce9c6fd5b4 could not be found. Oct 04 18:46:54.824074 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:46:54.824074 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-559b9f33-e897-4c04-8510-2fce09928ba1 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Returning 404 to user: Instance 9886f261-8e00-4908-8fd8-f6ce9c6fd5b4 could not be found. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:46:54.824074 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-559b9f33-e897-4c04-8510-2fce09928ba1 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] 10.222.0.43 "GET /compute/v2.1/servers/9886f261-8e00-4908-8fd8-f6ce9c6fd5b4" status: 404 len: 111 microversion: 2.1 time: 0.049738 Oct 04 18:46:54.827312 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1727/3694] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:54 2022] GET /compute/v2.1/servers/9886f261-8e00-4908-8fd8-f6ce9c6fd5b4 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:46:54.844500 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-936a1666-ff47-4e29-873a-0ecf8ec2e77b tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Action: 'create', calling method: .version_select at 0x7fb21fe37a60>, body: {"keypair": {"name": "tempest-keypair-1858502817", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNSCHD/aMVbPVpiRIXTDxKujmlKjh2G5WF0wwAyVFCqkFqcfWc5CeTDRD4k2ZxiEX6H0GzWonhvkcsO4x940jyMDtzLwLiRN1ToCRq8u8+nHD6n1ncNXpOzrqyy2YmB1Zw=="}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:46:54.866755 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-936a1666-ff47-4e29-873a-0ecf8ec2e77b tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Getting quotas for project 8ab4da2b9b9f4c7a9c25b7edaab3027d. Resources: {'key_pairs'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:46:54.874028 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-936a1666-ff47-4e29-873a-0ecf8ec2e77b tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Getting quotas for user cdcbf2b4b95743af9e6fa1be54554baa and project 8ab4da2b9b9f4c7a9c25b7edaab3027d. Resources: {'key_pairs'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:46:54.886514 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-f4c10bf4-6a90-4a09-8db2-b0334966b65a tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9971b5861f44c1a1da94eda0f8f02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f809b8ae704988961908bef0f3cb24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:54.906838 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-936a1666-ff47-4e29-873a-0ecf8ec2e77b tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.078166 Oct 04 18:46:54.915187 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1728/3695] 10.222.0.43 () {60 vars in 1159 bytes} [Tue Oct 4 18:46:54 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:46:54.926971 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-56259da3-6bc0-413b-ab97-08ca71f83e02 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:54.928018 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-56259da3-6bc0-413b-ab97-08ca71f83e02 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] [instance: 00c17e4b-c80e-463e-a3e9-486c118552be] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:54.930491 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-f4c10bf4-6a90-4a09-8db2-b0334966b65a tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] 10.222.0.43 "GET /compute/v2.1/servers/fd09cc9b-d9dd-4133-8665-eeb6d8f51df8" status: 200 len: 1381 microversion: 2.1 time: 0.324723 Oct 04 18:46:54.939459 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-56259da3-6bc0-413b-ab97-08ca71f83e02 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:54.940303 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-56259da3-6bc0-413b-ab97-08ca71f83e02 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:54.941090 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-56259da3-6bc0-413b-ab97-08ca71f83e02 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:54.942085 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-56259da3-6bc0-413b-ab97-08ca71f83e02 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:54.942816 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-56259da3-6bc0-413b-ab97-08ca71f83e02 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:54.943560 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-56259da3-6bc0-413b-ab97-08ca71f83e02 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:54.947278 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1968/3696] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:54 2022] GET /compute/v2.1/servers/fd09cc9b-d9dd-4133-8665-eeb6d8f51df8 => generated 1381 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:54.962172 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-40b9fdd0-ba8d-48a7-ac9e-1e11f752796f tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:54.962801 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-40b9fdd0-ba8d-48a7-ac9e-1e11f752796f tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] [instance: fd09cc9b-d9dd-4133-8665-eeb6d8f51df8] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:54.984934 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-40b9fdd0-ba8d-48a7-ac9e-1e11f752796f tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:54.985472 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-40b9fdd0-ba8d-48a7-ac9e-1e11f752796f tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:54.985922 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-40b9fdd0-ba8d-48a7-ac9e-1e11f752796f tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:54.986652 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-40b9fdd0-ba8d-48a7-ac9e-1e11f752796f tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:54.987119 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-40b9fdd0-ba8d-48a7-ac9e-1e11f752796f tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:54.987548 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-40b9fdd0-ba8d-48a7-ac9e-1e11f752796f tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:55.253059 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-40b9fdd0-ba8d-48a7-ac9e-1e11f752796f tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/fd09cc9b-d9dd-4133-8665-eeb6d8f51df8" status: 200 len: 1534 microversion: 2.1 time: 0.294492 Oct 04 18:46:55.254541 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1969/3697] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:54 2022] GET /compute/v2.1/servers/fd09cc9b-d9dd-4133-8665-eeb6d8f51df8 => generated 1534 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:55.269065 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-56259da3-6bc0-413b-ab97-08ca71f83e02 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c710f394164b89b16bcac2fe51c58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65037d4ea5124d749e42928032e803fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:55.284501 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-4e4734d1-ce24-4b48-99f8-fb34d48aa6e9 tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:55.288185 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-56259da3-6bc0-413b-ab97-08ca71f83e02 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] 10.222.0.43 "GET /compute/v2.1/servers/00c17e4b-c80e-463e-a3e9-486c118552be" status: 200 len: 1523 microversion: 2.1 time: 0.371137 Oct 04 18:46:55.288783 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1729/3698] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:54 2022] GET /compute/v2.1/servers/00c17e4b-c80e-463e-a3e9-486c118552be => generated 1523 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:55.289948 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-4e4734d1-ce24-4b48-99f8-fb34d48aa6e9 tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] [instance: fd09cc9b-d9dd-4133-8665-eeb6d8f51df8] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:55.297643 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4e4734d1-ce24-4b48-99f8-fb34d48aa6e9 tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:55.298385 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4e4734d1-ce24-4b48-99f8-fb34d48aa6e9 tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:55.299027 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4e4734d1-ce24-4b48-99f8-fb34d48aa6e9 tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:55.299924 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4e4734d1-ce24-4b48-99f8-fb34d48aa6e9 tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:55.300762 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4e4734d1-ce24-4b48-99f8-fb34d48aa6e9 tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:55.301589 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4e4734d1-ce24-4b48-99f8-fb34d48aa6e9 tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:55.532650 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-8473e243-a661-4445-ab7d-8f6cba473dbb tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:55.533325 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-8473e243-a661-4445-ab7d-8f6cba473dbb tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] [instance: 76d475ab-f41c-44df-8aaa-10242bdbfcde] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:55.562173 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-4e4734d1-ce24-4b48-99f8-fb34d48aa6e9 tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/fd09cc9b-d9dd-4133-8665-eeb6d8f51df8" status: 200 len: 1534 microversion: 2.1 time: 0.287664 Oct 04 18:46:55.562675 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1970/3699] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:55 2022] GET /compute/v2.1/servers/fd09cc9b-d9dd-4133-8665-eeb6d8f51df8 => generated 1534 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:55.566573 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8473e243-a661-4445-ab7d-8f6cba473dbb tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:55.572890 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-6dbf276f-db1f-44e8-910d-19e5da746274 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:55.574551 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8473e243-a661-4445-ab7d-8f6cba473dbb tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:55.577302 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8473e243-a661-4445-ab7d-8f6cba473dbb tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:55.578927 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8473e243-a661-4445-ab7d-8f6cba473dbb tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:55.580322 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8473e243-a661-4445-ab7d-8f6cba473dbb tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:55.580973 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8473e243-a661-4445-ab7d-8f6cba473dbb tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:55.585592 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-6dbf276f-db1f-44e8-910d-19e5da746274 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] [instance: fa47906d-d394-46fe-9143-780bcd27a715] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:55.595024 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6dbf276f-db1f-44e8-910d-19e5da746274 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:55.595911 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6dbf276f-db1f-44e8-910d-19e5da746274 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:55.596715 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6dbf276f-db1f-44e8-910d-19e5da746274 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:55.597651 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6dbf276f-db1f-44e8-910d-19e5da746274 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:55.598302 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6dbf276f-db1f-44e8-910d-19e5da746274 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:55.599268 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6dbf276f-db1f-44e8-910d-19e5da746274 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:55.865717 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-8473e243-a661-4445-ab7d-8f6cba473dbb tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a116f2d9656548458264cc4fb1934c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff3c3dc76405401baf72fe00c5d50b56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:55.874927 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-6dbf276f-db1f-44e8-910d-19e5da746274 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:55.889415 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-6dbf276f-db1f-44e8-910d-19e5da746274 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:55.894765 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-6dbf276f-db1f-44e8-910d-19e5da746274 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:55.895998 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-6dbf276f-db1f-44e8-910d-19e5da746274 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] 10.222.0.43 "GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715" status: 200 len: 1874 microversion: 2.32 time: 0.332345 Oct 04 18:46:55.909136 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1971/3700] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:46:55 2022] GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715 => generated 1874 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:46:55.912431 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-4d12249e-81c1-45a7-972b-4f72af97be6c tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:55.922494 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-4d12249e-81c1-45a7-972b-4f72af97be6c tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] [instance: 15541ec9-3112-4adc-9fad-6d20a88f2c09] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:55.924944 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-8473e243-a661-4445-ab7d-8f6cba473dbb tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] 10.222.0.43 "GET /compute/v2.1/servers/76d475ab-f41c-44df-8aaa-10242bdbfcde" status: 200 len: 1710 microversion: 2.1 time: 0.371225 Oct 04 18:46:55.939922 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4d12249e-81c1-45a7-972b-4f72af97be6c tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:55.940825 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4d12249e-81c1-45a7-972b-4f72af97be6c tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:55.942433 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4d12249e-81c1-45a7-972b-4f72af97be6c tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:55.943425 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4d12249e-81c1-45a7-972b-4f72af97be6c tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:55.944121 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4d12249e-81c1-45a7-972b-4f72af97be6c tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:55.944787 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4d12249e-81c1-45a7-972b-4f72af97be6c tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:55.948236 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1730/3701] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:55 2022] GET /compute/v2.1/servers/76d475ab-f41c-44df-8aaa-10242bdbfcde => generated 1710 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:55.959834 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-b3dc3d49-7fe1-47e6-b40a-215b37cb88b3 tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:55.973574 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b3dc3d49-7fe1-47e6-b40a-215b37cb88b3 tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:55.977658 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b3dc3d49-7fe1-47e6-b40a-215b37cb88b3 tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:55.978616 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b3dc3d49-7fe1-47e6-b40a-215b37cb88b3 tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:55.981718 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b3dc3d49-7fe1-47e6-b40a-215b37cb88b3 tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:55.983759 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b3dc3d49-7fe1-47e6-b40a-215b37cb88b3 tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:55.984452 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b3dc3d49-7fe1-47e6-b40a-215b37cb88b3 tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:56.014724 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-4d12249e-81c1-45a7-972b-4f72af97be6c tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] 10.222.0.43 "GET /compute/v2.1/servers/15541ec9-3112-4adc-9fad-6d20a88f2c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.114219 Oct 04 18:46:56.021462 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1972/3702] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Oct 4 18:46:55 2022] GET /compute/v2.1/servers/15541ec9-3112-4adc-9fad-6d20a88f2c09/os-volume_attachments => generated 197 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:46:56.028894 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-b3dc3d49-7fe1-47e6-b40a-215b37cb88b3 tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] 10.222.0.43 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.079159 Oct 04 18:46:56.038273 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1731/3703] 10.222.0.43 () {58 vars in 1176 bytes} [Tue Oct 4 18:46:55 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:46:56.042702 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-5951fc9e-cd0e-4404-8b6b-5f831c51b634 tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-851028-13", "block_migration": false, "disk_over_commit": false}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:46:56.045778 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-5951fc9e-cd0e-4404-8b6b-5f831c51b634 tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] [instance: fd09cc9b-d9dd-4133-8665-eeb6d8f51df8] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:56.060489 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5951fc9e-cd0e-4404-8b6b-5f831c51b634 tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:56.061561 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5951fc9e-cd0e-4404-8b6b-5f831c51b634 tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:56.062011 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5951fc9e-cd0e-4404-8b6b-5f831c51b634 tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:56.062726 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5951fc9e-cd0e-4404-8b6b-5f831c51b634 tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:56.063191 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5951fc9e-cd0e-4404-8b6b-5f831c51b634 tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:56.063623 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5951fc9e-cd0e-4404-8b6b-5f831c51b634 tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:56.089281 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.objects.instance [None req-5951fc9e-cd0e-4404-8b6b-5f831c51b634 tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] Lazy-loading 'flavor' on Instance uuid fd09cc9b-d9dd-4133-8665-eeb6d8f51df8 {{(pid=123596) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:46:56.102122 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-5951fc9e-cd0e-4404-8b6b-5f831c51b634 tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] [instance: fd09cc9b-d9dd-4133-8665-eeb6d8f51df8] Going to try to live migrate instance to n-h2-851028-13 {{(pid=123596) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 04 18:46:56.317513 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-256224fb-4358-4afc-9883-7b34a199e9d8 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:56.320132 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-256224fb-4358-4afc-9883-7b34a199e9d8 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] [instance: 00c17e4b-c80e-463e-a3e9-486c118552be] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:56.346544 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-256224fb-4358-4afc-9883-7b34a199e9d8 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:56.350421 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-256224fb-4358-4afc-9883-7b34a199e9d8 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:56.350950 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-256224fb-4358-4afc-9883-7b34a199e9d8 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:56.356223 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-256224fb-4358-4afc-9883-7b34a199e9d8 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:56.356966 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-256224fb-4358-4afc-9883-7b34a199e9d8 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:56.365172 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-256224fb-4358-4afc-9883-7b34a199e9d8 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:56.672403 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-256224fb-4358-4afc-9883-7b34a199e9d8 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c710f394164b89b16bcac2fe51c58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65037d4ea5124d749e42928032e803fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:56.691733 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-256224fb-4358-4afc-9883-7b34a199e9d8 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] 10.222.0.43 "GET /compute/v2.1/servers/00c17e4b-c80e-463e-a3e9-486c118552be" status: 200 len: 1523 microversion: 2.1 time: 0.376793 Oct 04 18:46:56.694473 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1732/3704] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:56 2022] GET /compute/v2.1/servers/00c17e4b-c80e-463e-a3e9-486c118552be => generated 1523 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:56.924765 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-7c1add98-cc81-440e-8e71-ee9e27d19083 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:56.925502 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-7c1add98-cc81-440e-8e71-ee9e27d19083 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] [instance: fa47906d-d394-46fe-9143-780bcd27a715] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:56.935456 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7c1add98-cc81-440e-8e71-ee9e27d19083 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:56.937483 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7c1add98-cc81-440e-8e71-ee9e27d19083 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:56.939958 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7c1add98-cc81-440e-8e71-ee9e27d19083 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:56.940765 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7c1add98-cc81-440e-8e71-ee9e27d19083 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:56.941278 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7c1add98-cc81-440e-8e71-ee9e27d19083 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:56.941913 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7c1add98-cc81-440e-8e71-ee9e27d19083 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:57.202299 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-7c1add98-cc81-440e-8e71-ee9e27d19083 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:57.216986 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-7c1add98-cc81-440e-8e71-ee9e27d19083 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:57.219004 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-7c1add98-cc81-440e-8e71-ee9e27d19083 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:57.220612 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-7c1add98-cc81-440e-8e71-ee9e27d19083 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] 10.222.0.43 "GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715" status: 200 len: 1874 microversion: 2.32 time: 0.300576 Oct 04 18:46:57.223515 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1733/3705] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:46:56 2022] GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715 => generated 1874 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:46:57.230897 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-95fce409-1d78-4bd5-8df1-eb69a7270a75 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:57.231830 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-95fce409-1d78-4bd5-8df1-eb69a7270a75 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] [instance: 76d475ab-f41c-44df-8aaa-10242bdbfcde] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:57.239051 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-95fce409-1d78-4bd5-8df1-eb69a7270a75 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:57.240020 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-95fce409-1d78-4bd5-8df1-eb69a7270a75 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:57.240864 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-95fce409-1d78-4bd5-8df1-eb69a7270a75 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:57.242769 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-95fce409-1d78-4bd5-8df1-eb69a7270a75 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:57.243381 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-95fce409-1d78-4bd5-8df1-eb69a7270a75 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:57.244344 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-95fce409-1d78-4bd5-8df1-eb69a7270a75 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:57.458866 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-95fce409-1d78-4bd5-8df1-eb69a7270a75 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a116f2d9656548458264cc4fb1934c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff3c3dc76405401baf72fe00c5d50b56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:57.468855 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-95fce409-1d78-4bd5-8df1-eb69a7270a75 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] 10.222.0.43 "GET /compute/v2.1/servers/76d475ab-f41c-44df-8aaa-10242bdbfcde" status: 200 len: 1714 microversion: 2.1 time: 0.243325 Oct 04 18:46:57.469835 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1734/3706] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:57 2022] GET /compute/v2.1/servers/76d475ab-f41c-44df-8aaa-10242bdbfcde => generated 1714 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:57.491507 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-485d9581-0b42-4ba2-927a-4a072bbe0449 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:57.493865 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-485d9581-0b42-4ba2-927a-4a072bbe0449 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] [instance: 15541ec9-3112-4adc-9fad-6d20a88f2c09] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:57.501133 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-485d9581-0b42-4ba2-927a-4a072bbe0449 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:57.501905 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-485d9581-0b42-4ba2-927a-4a072bbe0449 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:57.502524 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-485d9581-0b42-4ba2-927a-4a072bbe0449 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:57.503789 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-485d9581-0b42-4ba2-927a-4a072bbe0449 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:57.504444 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-485d9581-0b42-4ba2-927a-4a072bbe0449 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:57.505051 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-485d9581-0b42-4ba2-927a-4a072bbe0449 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:57.541710 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-485d9581-0b42-4ba2-927a-4a072bbe0449 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] 10.222.0.43 "GET /compute/v2.1/servers/15541ec9-3112-4adc-9fad-6d20a88f2c09/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.070435 Oct 04 18:46:57.549504 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1735/3707] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Oct 4 18:46:57 2022] GET /compute/v2.1/servers/15541ec9-3112-4adc-9fad-6d20a88f2c09/os-volume_attachments => generated 25 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:46:57.644042 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-954ed087-4dbb-4da0-a5bf-3d55962c366f tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:46:57.653959 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-954ed087-4dbb-4da0-a5bf-3d55962c366f tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] [instance: d7f06829-6beb-4d35-ab81-c99f9dd3027d] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:57.662469 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-954ed087-4dbb-4da0-a5bf-3d55962c366f tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:57.662959 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-954ed087-4dbb-4da0-a5bf-3d55962c366f tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:57.663400 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-954ed087-4dbb-4da0-a5bf-3d55962c366f tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:57.664110 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-954ed087-4dbb-4da0-a5bf-3d55962c366f tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:57.664559 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-954ed087-4dbb-4da0-a5bf-3d55962c366f tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:57.664981 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-954ed087-4dbb-4da0-a5bf-3d55962c366f tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:57.699090 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-954ed087-4dbb-4da0-a5bf-3d55962c366f tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] HTTP exception thrown: Cannot 'reboot' instance d7f06829-6beb-4d35-ab81-c99f9dd3027d while it is in vm_state rescued Oct 04 18:46:57.701476 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-954ed087-4dbb-4da0-a5bf-3d55962c366f tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Request method failure captured: Oct 04 18:46:57.701476 n-d-851028-13 devstack@n-api.service[123595]: request: POST /compute/v2.1/servers/d7f06829-6beb-4d35-ab81-c99f9dd3027d/action HTTP/1.1 Oct 04 18:46:57.701476 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 18:46:57.701476 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 18:46:57.701476 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 18:46:57.701476 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 28 Oct 04 18:46:57.701476 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 18:46:57.701476 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 18:46:57.701476 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 18:46:57.701476 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 18:46:57.701476 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPH6ImUsc0v5avJaXbAf95n6vmfztxEtTiW32SRLH_bOmBbny3fOGIWm6DaSHmvRnWhZ-84faOFvXqXs-7dDoMftV5mgOWVN0Q9OrVISe3irL7FfmyYZmGssWLEuXGLXQhTtdNOFN9115Lqu5biPYPUWU74K-2mRSRsiih09WbGDmZQI Oct 04 18:46:57.701476 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 18:46:57.701476 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 18:46:57.701476 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 18:46:57.701476 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 18:46:57.701476 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 18:46:57.701476 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 18:46:57.701476 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: eda6bd34bf5540ee95c8144f185eb22d Oct 04 18:46:57.701476 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1155401912 Oct 04 18:46:57.701476 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 18:46:57.701476 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 18:46:57.701476 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/eda6bd34bf5540ee95c8144f185eb22d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_eda6bd34bf5540ee95c8144f185eb22d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/eda6bd34bf5540ee95c8144f185eb22d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/eda6bd34bf5540ee95c8144f185eb22d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:46:57.701476 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1155401912 Oct 04 18:46:57.701476 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: eda6bd34bf5540ee95c8144f185eb22d Oct 04 18:46:57.701476 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1155401912 Oct 04 18:46:57.701476 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-ServerRescueNegativeTestJSON-1155401912-project Oct 04 18:46:57.701476 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 18:46:57.701476 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 18:46:57.701476 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: 96e7480de94c43909045ac1087e40cd8 Oct 04 18:46:57.701476 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1155401912-project Oct 04 18:46:57.701476 n-d-851028-13 devstack@n-api.service[123595]: Oct 04 18:46:57.701476 n-d-851028-13 devstack@n-api.service[123595]: {"reboot": {"type": "HARD"}} Oct 04 18:46:57.701476 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 18:46:57.701476 n-d-851028-13 devstack@n-api.service[123595]: exception: Cannot 'reboot' instance d7f06829-6beb-4d35-ab81-c99f9dd3027d while it is in vm_state rescued Oct 04 18:46:57.701476 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': 'd7f06829-6beb-4d35-ab81-c99f9dd3027d', 'body': {'reboot': {'type': 'HARD'}}} Oct 04 18:46:57.701476 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:46:57.701476 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:46:57.701476 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1036, in _action_reboot Oct 04 18:46:57.701476 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi self.compute_api.reboot(context, instance, reboot_type) Oct 04 18:46:57.701476 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 18:46:57.701476 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 18:46:57.701476 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3552, in reboot Oct 04 18:46:57.701476 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi self._hard_reboot(context, instance) Oct 04 18:46:57.701476 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 04 18:46:57.701476 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 04 18:46:57.701476 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance d7f06829-6beb-4d35-ab81-c99f9dd3027d in vm_state rescued. Cannot _hard_reboot while the instance is in this state. Oct 04 18:46:57.701476 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:46:57.701476 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:46:57.701476 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:46:57.701476 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:46:57.701476 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:46:57.701476 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:46:57.701476 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:46:57.701476 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:46:57.701476 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:46:57.701476 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:46:57.701476 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:46:57.701476 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:46:57.701476 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1040, in _action_reboot Oct 04 18:46:57.701476 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 04 18:46:57.701476 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 04 18:46:57.701476 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 04 18:46:57.707589 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'reboot' instance d7f06829-6beb-4d35-ab81-c99f9dd3027d while it is in vm_state rescued Oct 04 18:46:57.707589 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:46:57.707589 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:46:57.707589 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:46:57.707589 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:46:57.707589 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:46:57.707589 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:46:57.707589 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:46:57.707589 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:46:57.707589 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'reboot' instance d7f06829-6beb-4d35-ab81-c99f9dd3027d while it is in vm_state rescued Oct 04 18:46:57.707589 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:46:57.707589 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-954ed087-4dbb-4da0-a5bf-3d55962c366f tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Returning 409 to user: Cannot 'reboot' instance d7f06829-6beb-4d35-ab81-c99f9dd3027d while it is in vm_state rescued {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:46:57.707589 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-954ed087-4dbb-4da0-a5bf-3d55962c366f tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] 10.222.0.43 "POST /compute/v2.1/servers/d7f06829-6beb-4d35-ab81-c99f9dd3027d/action" status: 409 len: 145 microversion: 2.1 time: 0.067124 Oct 04 18:46:57.709149 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1736/3708] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 18:46:57 2022] POST /compute/v2.1/servers/d7f06829-6beb-4d35-ab81-c99f9dd3027d/action => generated 145 bytes in 74 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:46:57.716728 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-d2dae52f-942a-4c52-91a7-d417662af222 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243"}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:46:57.719526 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-d2dae52f-942a-4c52-91a7-d417662af222 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] [instance: d7f06829-6beb-4d35-ab81-c99f9dd3027d] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:57.725993 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d2dae52f-942a-4c52-91a7-d417662af222 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:57.726482 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d2dae52f-942a-4c52-91a7-d417662af222 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:57.726921 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d2dae52f-942a-4c52-91a7-d417662af222 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:57.727632 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d2dae52f-942a-4c52-91a7-d417662af222 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:57.728740 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d2dae52f-942a-4c52-91a7-d417662af222 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:57.729210 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d2dae52f-942a-4c52-91a7-d417662af222 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:57.761252 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-d2dae52f-942a-4c52-91a7-d417662af222 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] HTTP exception thrown: Cannot 'rebuild' instance d7f06829-6beb-4d35-ab81-c99f9dd3027d while it is in vm_state rescued Oct 04 18:46:57.763095 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-d2dae52f-942a-4c52-91a7-d417662af222 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Request method failure captured: Oct 04 18:46:57.763095 n-d-851028-13 devstack@n-api.service[123595]: request: POST /compute/v2.1/servers/d7f06829-6beb-4d35-ab81-c99f9dd3027d/action HTTP/1.1 Oct 04 18:46:57.763095 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 18:46:57.763095 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 18:46:57.763095 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 18:46:57.763095 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 65 Oct 04 18:46:57.763095 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 18:46:57.763095 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 18:46:57.763095 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 18:46:57.763095 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 18:46:57.763095 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPH6ImUsc0v5avJaXbAf95n6vmfztxEtTiW32SRLH_bOmBbny3fOGIWm6DaSHmvRnWhZ-84faOFvXqXs-7dDoMftV5mgOWVN0Q9OrVISe3irL7FfmyYZmGssWLEuXGLXQhTtdNOFN9115Lqu5biPYPUWU74K-2mRSRsiih09WbGDmZQI Oct 04 18:46:57.763095 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 18:46:57.763095 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 18:46:57.763095 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 18:46:57.763095 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 18:46:57.763095 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 18:46:57.763095 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 18:46:57.763095 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: eda6bd34bf5540ee95c8144f185eb22d Oct 04 18:46:57.763095 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1155401912 Oct 04 18:46:57.763095 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 18:46:57.763095 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 18:46:57.763095 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/eda6bd34bf5540ee95c8144f185eb22d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_eda6bd34bf5540ee95c8144f185eb22d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/eda6bd34bf5540ee95c8144f185eb22d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/eda6bd34bf5540ee95c8144f185eb22d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:46:57.763095 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1155401912 Oct 04 18:46:57.763095 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: eda6bd34bf5540ee95c8144f185eb22d Oct 04 18:46:57.763095 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1155401912 Oct 04 18:46:57.763095 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-ServerRescueNegativeTestJSON-1155401912-project Oct 04 18:46:57.763095 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 18:46:57.763095 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 18:46:57.763095 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: 96e7480de94c43909045ac1087e40cd8 Oct 04 18:46:57.763095 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1155401912-project Oct 04 18:46:57.763095 n-d-851028-13 devstack@n-api.service[123595]: Oct 04 18:46:57.763095 n-d-851028-13 devstack@n-api.service[123595]: {"rebuild": {"imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243"}} Oct 04 18:46:57.763095 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 18:46:57.763095 n-d-851028-13 devstack@n-api.service[123595]: exception: Cannot 'rebuild' instance d7f06829-6beb-4d35-ab81-c99f9dd3027d while it is in vm_state rescued Oct 04 18:46:57.763095 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': 'd7f06829-6beb-4d35-ab81-c99f9dd3027d', 'body': {'rebuild': {'imageRef': 'e8943ec5-4038-4d4b-b9b9-2415a79f5243'}}} Oct 04 18:46:57.763095 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:46:57.763095 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:46:57.763095 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1223, in _action_rebuild Oct 04 18:46:57.763095 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi self.compute_api.rebuild(context, Oct 04 18:46:57.763095 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 04 18:46:57.763095 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 18:46:57.763095 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 04 18:46:57.763095 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 04 18:46:57.763095 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 18:46:57.763095 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 18:46:57.763095 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 04 18:46:57.763095 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 04 18:46:57.763095 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance d7f06829-6beb-4d35-ab81-c99f9dd3027d in vm_state rescued. Cannot rebuild while the instance is in this state. Oct 04 18:46:57.763095 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:46:57.763095 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:46:57.763095 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:46:57.763095 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:46:57.763095 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:46:57.763095 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:46:57.763095 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:46:57.763095 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:46:57.763095 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:46:57.763095 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:46:57.763095 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:46:57.763095 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:46:57.763095 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:46:57.763095 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:46:57.763095 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:46:57.768090 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:46:57.768090 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 04 18:46:57.768090 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1231, in _action_rebuild Oct 04 18:46:57.768090 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 04 18:46:57.768090 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 04 18:46:57.768090 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 04 18:46:57.768090 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rebuild' instance d7f06829-6beb-4d35-ab81-c99f9dd3027d while it is in vm_state rescued Oct 04 18:46:57.768090 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:46:57.768090 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:46:57.768090 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:46:57.768090 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:46:57.768090 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:46:57.768090 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:46:57.768090 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:46:57.768090 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:46:57.768090 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rebuild' instance d7f06829-6beb-4d35-ab81-c99f9dd3027d while it is in vm_state rescued Oct 04 18:46:57.768090 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:46:57.768090 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-d2dae52f-942a-4c52-91a7-d417662af222 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Returning 409 to user: Cannot 'rebuild' instance d7f06829-6beb-4d35-ab81-c99f9dd3027d while it is in vm_state rescued {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:46:57.768090 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-d2dae52f-942a-4c52-91a7-d417662af222 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] 10.222.0.43 "POST /compute/v2.1/servers/d7f06829-6beb-4d35-ab81-c99f9dd3027d/action" status: 409 len: 146 microversion: 2.1 time: 0.054179 Oct 04 18:46:57.768090 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1737/3709] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 18:46:57 2022] POST /compute/v2.1/servers/d7f06829-6beb-4d35-ab81-c99f9dd3027d/action => generated 146 bytes in 55 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:46:57.773516 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-ddb5d700-0894-4650-ae84-0effdbb00c15 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:57.774152 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-ddb5d700-0894-4650-ae84-0effdbb00c15 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] [instance: 00c17e4b-c80e-463e-a3e9-486c118552be] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:57.781293 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ddb5d700-0894-4650-ae84-0effdbb00c15 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:57.781775 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ddb5d700-0894-4650-ae84-0effdbb00c15 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:57.782434 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ddb5d700-0894-4650-ae84-0effdbb00c15 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:57.783153 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ddb5d700-0894-4650-ae84-0effdbb00c15 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:57.783610 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ddb5d700-0894-4650-ae84-0effdbb00c15 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:57.784041 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ddb5d700-0894-4650-ae84-0effdbb00c15 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:57.919250 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-ddb5d700-0894-4650-ae84-0effdbb00c15 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c710f394164b89b16bcac2fe51c58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65037d4ea5124d749e42928032e803fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:57.933506 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-ddb5d700-0894-4650-ae84-0effdbb00c15 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] 10.222.0.43 "GET /compute/v2.1/servers/00c17e4b-c80e-463e-a3e9-486c118552be" status: 200 len: 1508 microversion: 2.1 time: 0.166931 Oct 04 18:46:57.941277 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1738/3710] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:57 2022] GET /compute/v2.1/servers/00c17e4b-c80e-463e-a3e9-486c118552be => generated 1508 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:57.946674 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-b80c6215-02c4-4636-8f98-354fb22bd055 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:57.947186 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-b80c6215-02c4-4636-8f98-354fb22bd055 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] [instance: 15541ec9-3112-4adc-9fad-6d20a88f2c09] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:57.953675 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b80c6215-02c4-4636-8f98-354fb22bd055 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:57.954100 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b80c6215-02c4-4636-8f98-354fb22bd055 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:57.954546 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b80c6215-02c4-4636-8f98-354fb22bd055 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:57.955411 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b80c6215-02c4-4636-8f98-354fb22bd055 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:57.955871 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b80c6215-02c4-4636-8f98-354fb22bd055 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:57.956303 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b80c6215-02c4-4636-8f98-354fb22bd055 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:57.984628 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-b80c6215-02c4-4636-8f98-354fb22bd055 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] [instance: 15541ec9-3112-4adc-9fad-6d20a88f2c09] Going to try to terminate instance {{(pid=123595) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:46:58.064585 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:46:58.098237 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-b80c6215-02c4-4636-8f98-354fb22bd055 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] 10.222.0.43 "DELETE /compute/v2.1/servers/15541ec9-3112-4adc-9fad-6d20a88f2c09" status: 204 len: 0 microversion: 2.1 time: 0.155632 Oct 04 18:46:58.098923 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1739/3711] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 18:46:57 2022] DELETE /compute/v2.1/servers/15541ec9-3112-4adc-9fad-6d20a88f2c09 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:46:58.104581 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-1085a93f-d400-4bfd-9ecd-75c49c340ecd tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:58.105449 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-1085a93f-d400-4bfd-9ecd-75c49c340ecd tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] [instance: 00c17e4b-c80e-463e-a3e9-486c118552be] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:58.112078 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1085a93f-d400-4bfd-9ecd-75c49c340ecd tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:58.112707 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1085a93f-d400-4bfd-9ecd-75c49c340ecd tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:58.113246 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1085a93f-d400-4bfd-9ecd-75c49c340ecd tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:58.114058 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1085a93f-d400-4bfd-9ecd-75c49c340ecd tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:58.114521 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1085a93f-d400-4bfd-9ecd-75c49c340ecd tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:58.115137 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1085a93f-d400-4bfd-9ecd-75c49c340ecd tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:58.257409 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-1085a93f-d400-4bfd-9ecd-75c49c340ecd tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c710f394164b89b16bcac2fe51c58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65037d4ea5124d749e42928032e803fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:58.266502 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-1085a93f-d400-4bfd-9ecd-75c49c340ecd tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] 10.222.0.43 "GET /compute/v2.1/servers/00c17e4b-c80e-463e-a3e9-486c118552be" status: 200 len: 1508 microversion: 2.1 time: 0.166015 Oct 04 18:46:58.281139 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1740/3712] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:58 2022] GET /compute/v2.1/servers/00c17e4b-c80e-463e-a3e9-486c118552be => generated 1508 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:58.281770 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-58a33ff4-f801-45bc-9b0b-4b9d6b0f7ce4 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-757103828", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:46:58.353491 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.network.neutron [None req-58a33ff4-f801-45bc-9b0b-4b9d6b0f7ce4 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] validate_networks() for [('9a73c20c-974b-45c7-afb7-3b01737eb50f', None, None, None, None, None)] {{(pid=123595) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:46:58.416310 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-5951fc9e-cd0e-4404-8b6b-5f831c51b634 tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] 10.222.0.43 "POST /compute/v2.1/servers/fd09cc9b-d9dd-4133-8665-eeb6d8f51df8/action" status: 202 len: 0 microversion: 2.1 time: 2.377367 Oct 04 18:46:58.417480 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1973/3713] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 18:46:56 2022] POST /compute/v2.1/servers/fd09cc9b-d9dd-4133-8665-eeb6d8f51df8/action => generated 0 bytes in 2379 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:46:58.424482 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-614901d8-aad2-4a8d-8402-3b5ccc20e0a6 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:58.426400 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-614901d8-aad2-4a8d-8402-3b5ccc20e0a6 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] [instance: 15541ec9-3112-4adc-9fad-6d20a88f2c09] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:58.433785 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-614901d8-aad2-4a8d-8402-3b5ccc20e0a6 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:58.434579 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-614901d8-aad2-4a8d-8402-3b5ccc20e0a6 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:58.435278 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-614901d8-aad2-4a8d-8402-3b5ccc20e0a6 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:58.436564 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-614901d8-aad2-4a8d-8402-3b5ccc20e0a6 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:58.437285 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-614901d8-aad2-4a8d-8402-3b5ccc20e0a6 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:58.437898 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-614901d8-aad2-4a8d-8402-3b5ccc20e0a6 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:58.691261 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-614901d8-aad2-4a8d-8402-3b5ccc20e0a6 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96e7480de94c43909045ac1087e40cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6bd34bf5540ee95c8144f185eb22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:58.701394 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-614901d8-aad2-4a8d-8402-3b5ccc20e0a6 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] 10.222.0.43 "GET /compute/v2.1/servers/15541ec9-3112-4adc-9fad-6d20a88f2c09" status: 200 len: 1688 microversion: 2.1 time: 0.282476 Oct 04 18:46:58.705189 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1974/3714] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:58 2022] GET /compute/v2.1/servers/15541ec9-3112-4adc-9fad-6d20a88f2c09 => generated 1688 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:58.728385 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f956d2df-94c5-4606-b988-37769dc7cdd3 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:58.728929 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-f956d2df-94c5-4606-b988-37769dc7cdd3 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] [instance: fa47906d-d394-46fe-9143-780bcd27a715] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:58.740175 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f956d2df-94c5-4606-b988-37769dc7cdd3 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:58.740705 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f956d2df-94c5-4606-b988-37769dc7cdd3 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:58.741188 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f956d2df-94c5-4606-b988-37769dc7cdd3 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:58.741924 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f956d2df-94c5-4606-b988-37769dc7cdd3 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:58.742462 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f956d2df-94c5-4606-b988-37769dc7cdd3 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:58.742949 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f956d2df-94c5-4606-b988-37769dc7cdd3 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:58.762957 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:46:58.831937 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-58a33ff4-f801-45bc-9b0b-4b9d6b0f7ce4 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Flavor limits 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:46:58.832366 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-58a33ff4-f801-45bc-9b0b-4b9d6b0f7ce4 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Image limits 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:46:58.833018 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-58a33ff4-f801-45bc-9b0b-4b9d6b0f7ce4 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Flavor pref 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:46:58.833463 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-58a33ff4-f801-45bc-9b0b-4b9d6b0f7ce4 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Image pref 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:46:58.833880 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-58a33ff4-f801-45bc-9b0b-4b9d6b0f7ce4 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:46:58.844258 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-58a33ff4-f801-45bc-9b0b-4b9d6b0f7ce4 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:58.844752 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-58a33ff4-f801-45bc-9b0b-4b9d6b0f7ce4 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:58.846818 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-58a33ff4-f801-45bc-9b0b-4b9d6b0f7ce4 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:58.846818 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-58a33ff4-f801-45bc-9b0b-4b9d6b0f7ce4 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:58.846818 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-58a33ff4-f801-45bc-9b0b-4b9d6b0f7ce4 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:58.847386 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-58a33ff4-f801-45bc-9b0b-4b9d6b0f7ce4 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:58.872205 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-58a33ff4-f801-45bc-9b0b-4b9d6b0f7ce4 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Getting quotas for project 8ab4da2b9b9f4c7a9c25b7edaab3027d. Resources: {'ram', 'cores', 'instances'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:46:58.882333 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-58a33ff4-f801-45bc-9b0b-4b9d6b0f7ce4 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Getting quotas for user cdcbf2b4b95743af9e6fa1be54554baa and project 8ab4da2b9b9f4c7a9c25b7edaab3027d. Resources: {'ram', 'cores', 'instances'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:46:58.900779 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-58a33ff4-f801-45bc-9b0b-4b9d6b0f7ce4 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Going to run 1 instances... {{(pid=123595) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:46:58.903304 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-58a33ff4-f801-45bc-9b0b-4b9d6b0f7ce4 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] [instance: 5f6ad9ae-93d7-4774-aadf-b1fbbadc224c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e8943ec5-4038-4d4b-b9b9-2415a79f5243',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:46:58.987916 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-58a33ff4-f801-45bc-9b0b-4b9d6b0f7ce4 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.711587 Oct 04 18:46:58.996823 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1741/3715] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 18:46:58 2022] POST /compute/v2.1/servers => generated 383 bytes in 722 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:46:59.003768 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-8600efa7-2744-453b-931f-cc81f23d2f65 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:59.004536 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-8600efa7-2744-453b-931f-cc81f23d2f65 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] [instance: 00c17e4b-c80e-463e-a3e9-486c118552be] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:59.012475 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8600efa7-2744-453b-931f-cc81f23d2f65 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:59.013248 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8600efa7-2744-453b-931f-cc81f23d2f65 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:59.014392 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8600efa7-2744-453b-931f-cc81f23d2f65 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:59.015298 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8600efa7-2744-453b-931f-cc81f23d2f65 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:59.030480 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8600efa7-2744-453b-931f-cc81f23d2f65 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:59.031522 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8600efa7-2744-453b-931f-cc81f23d2f65 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:59.079694 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-8600efa7-2744-453b-931f-cc81f23d2f65 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] [instance: 00c17e4b-c80e-463e-a3e9-486c118552be] Going to try to terminate instance {{(pid=123595) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:46:59.173347 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:46:59.201530 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-8600efa7-2744-453b-931f-cc81f23d2f65 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] 10.222.0.43 "DELETE /compute/v2.1/servers/00c17e4b-c80e-463e-a3e9-486c118552be" status: 204 len: 0 microversion: 2.1 time: 0.202889 Oct 04 18:46:59.202698 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1742/3716] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 18:46:58 2022] DELETE /compute/v2.1/servers/00c17e4b-c80e-463e-a3e9-486c118552be => generated 0 bytes in 205 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:46:59.218980 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-113fae48-2a87-4b9d-ba14-2b9de5e1a34a tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:59.219737 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-113fae48-2a87-4b9d-ba14-2b9de5e1a34a tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] [instance: fd09cc9b-d9dd-4133-8665-eeb6d8f51df8] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:59.226548 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-113fae48-2a87-4b9d-ba14-2b9de5e1a34a tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:59.227286 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-113fae48-2a87-4b9d-ba14-2b9de5e1a34a tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:59.228039 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-113fae48-2a87-4b9d-ba14-2b9de5e1a34a tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:59.229024 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-113fae48-2a87-4b9d-ba14-2b9de5e1a34a tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:59.229434 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-113fae48-2a87-4b9d-ba14-2b9de5e1a34a tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:59.229841 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-113fae48-2a87-4b9d-ba14-2b9de5e1a34a tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:59.496264 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-113fae48-2a87-4b9d-ba14-2b9de5e1a34a tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9971b5861f44c1a1da94eda0f8f02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f809b8ae704988961908bef0f3cb24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:59.505810 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-113fae48-2a87-4b9d-ba14-2b9de5e1a34a tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] 10.222.0.43 "GET /compute/v2.1/servers/fd09cc9b-d9dd-4133-8665-eeb6d8f51df8" status: 200 len: 1391 microversion: 2.1 time: 0.301555 Oct 04 18:46:59.506772 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1743/3717] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:59 2022] GET /compute/v2.1/servers/fd09cc9b-d9dd-4133-8665-eeb6d8f51df8 => generated 1391 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:59.512737 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-fc0e1c32-4ee9-4e6d-b3bf-5f6d30dfc488 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:59.514210 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-fc0e1c32-4ee9-4e6d-b3bf-5f6d30dfc488 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] [instance: 5f6ad9ae-93d7-4774-aadf-b1fbbadc224c] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:59.619268 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-fc0e1c32-4ee9-4e6d-b3bf-5f6d30dfc488 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcbf2b4b95743af9e6fa1be54554baa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab4da2b9b9f4c7a9c25b7edaab3027d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:59.629100 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-fc0e1c32-4ee9-4e6d-b3bf-5f6d30dfc488 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] 10.222.0.43 "GET /compute/v2.1/servers/5f6ad9ae-93d7-4774-aadf-b1fbbadc224c" status: 200 len: 1224 microversion: 2.1 time: 0.120930 Oct 04 18:46:59.630517 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1744/3718] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:59 2022] GET /compute/v2.1/servers/5f6ad9ae-93d7-4774-aadf-b1fbbadc224c => generated 1224 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:59.636506 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-08b3e6d2-3e74-40f8-b2b4-d6885537d627 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-647353731", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452", "networks": [{"uuid": "3ad3e58b-246e-4a9b-9a40-0c1782e343b8"}]}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:46:59.706236 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.network.neutron [None req-08b3e6d2-3e74-40f8-b2b4-d6885537d627 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] validate_networks() for [('3ad3e58b-246e-4a9b-9a40-0c1782e343b8', None, None, None, None, None)] {{(pid=123595) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:46:59.734348 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-f956d2df-94c5-4606-b988-37769dc7cdd3 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:59.761375 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-f956d2df-94c5-4606-b988-37769dc7cdd3 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:59.763511 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-f956d2df-94c5-4606-b988-37769dc7cdd3 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:59.765383 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-f956d2df-94c5-4606-b988-37769dc7cdd3 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] 10.222.0.43 "GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715" status: 200 len: 1874 microversion: 2.32 time: 1.043569 Oct 04 18:46:59.783828 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1975/3719] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:46:58 2022] GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715 => generated 1874 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:46:59.793624 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-38fe5e89-38da-4222-a4d2-c5eb3902128a tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:59.794324 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-38fe5e89-38da-4222-a4d2-c5eb3902128a tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] [instance: 15541ec9-3112-4adc-9fad-6d20a88f2c09] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:59.802296 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-38fe5e89-38da-4222-a4d2-c5eb3902128a tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:59.803586 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-38fe5e89-38da-4222-a4d2-c5eb3902128a tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:59.804061 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-38fe5e89-38da-4222-a4d2-c5eb3902128a tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:59.804828 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-38fe5e89-38da-4222-a4d2-c5eb3902128a tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:59.805349 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-38fe5e89-38da-4222-a4d2-c5eb3902128a tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:59.805799 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-38fe5e89-38da-4222-a4d2-c5eb3902128a tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:00.074062 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-38fe5e89-38da-4222-a4d2-c5eb3902128a tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96e7480de94c43909045ac1087e40cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6bd34bf5540ee95c8144f185eb22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:00.084058 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-38fe5e89-38da-4222-a4d2-c5eb3902128a tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] 10.222.0.43 "GET /compute/v2.1/servers/15541ec9-3112-4adc-9fad-6d20a88f2c09" status: 200 len: 1688 microversion: 2.1 time: 0.297998 Oct 04 18:47:00.085089 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1976/3720] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:59 2022] GET /compute/v2.1/servers/15541ec9-3112-4adc-9fad-6d20a88f2c09 => generated 1688 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:00.444009 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-08b3e6d2-3e74-40f8-b2b4-d6885537d627 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Flavor limits 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:47:00.444440 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-08b3e6d2-3e74-40f8-b2b4-d6885537d627 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Image limits 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:47:00.445094 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-08b3e6d2-3e74-40f8-b2b4-d6885537d627 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Flavor pref 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:47:00.446072 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-08b3e6d2-3e74-40f8-b2b4-d6885537d627 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Image pref 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:47:00.446611 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-08b3e6d2-3e74-40f8-b2b4-d6885537d627 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:47:00.457689 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-08b3e6d2-3e74-40f8-b2b4-d6885537d627 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:00.458183 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-08b3e6d2-3e74-40f8-b2b4-d6885537d627 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:00.458628 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-08b3e6d2-3e74-40f8-b2b4-d6885537d627 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:00.459373 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-08b3e6d2-3e74-40f8-b2b4-d6885537d627 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:00.459830 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-08b3e6d2-3e74-40f8-b2b4-d6885537d627 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:00.460265 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-08b3e6d2-3e74-40f8-b2b4-d6885537d627 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:00.478440 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-08b3e6d2-3e74-40f8-b2b4-d6885537d627 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Getting quotas for project 65037d4ea5124d749e42928032e803fd. Resources: {'ram', 'cores', 'instances'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:47:00.484097 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-08b3e6d2-3e74-40f8-b2b4-d6885537d627 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Getting quotas for user d2c710f394164b89b16bcac2fe51c58a and project 65037d4ea5124d749e42928032e803fd. Resources: {'ram', 'cores', 'instances'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:47:00.496003 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-08b3e6d2-3e74-40f8-b2b4-d6885537d627 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Going to run 1 instances... {{(pid=123595) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:47:00.498386 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-08b3e6d2-3e74-40f8-b2b4-d6885537d627 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] [instance: 4c82269a-db15-463d-a48b-0ca4ff3c1a71] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e8943ec5-4038-4d4b-b9b9-2415a79f5243',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:47:00.533982 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f67e9210-9804-4b59-9385-68dd10a5f4db tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:00.534789 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-f67e9210-9804-4b59-9385-68dd10a5f4db tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] [instance: fd09cc9b-d9dd-4133-8665-eeb6d8f51df8] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:00.541555 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f67e9210-9804-4b59-9385-68dd10a5f4db tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:00.542056 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f67e9210-9804-4b59-9385-68dd10a5f4db tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:00.542514 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f67e9210-9804-4b59-9385-68dd10a5f4db tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:00.543207 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f67e9210-9804-4b59-9385-68dd10a5f4db tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:00.543666 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f67e9210-9804-4b59-9385-68dd10a5f4db tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:00.544100 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f67e9210-9804-4b59-9385-68dd10a5f4db tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:00.550087 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-08b3e6d2-3e74-40f8-b2b4-d6885537d627 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.917762 Oct 04 18:47:00.551225 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1745/3721] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 18:46:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 920 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:47:00.563285 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-0f05b93a-41e8-4295-be15-42841697bef4 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:00.563914 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-0f05b93a-41e8-4295-be15-42841697bef4 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] [instance: 4c82269a-db15-463d-a48b-0ca4ff3c1a71] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:00.652958 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-0f05b93a-41e8-4295-be15-42841697bef4 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c710f394164b89b16bcac2fe51c58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65037d4ea5124d749e42928032e803fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:00.664991 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-0f05b93a-41e8-4295-be15-42841697bef4 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] 10.222.0.43 "GET /compute/v2.1/servers/4c82269a-db15-463d-a48b-0ca4ff3c1a71" status: 200 len: 1217 microversion: 2.1 time: 0.106635 Oct 04 18:47:00.666302 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1746/3722] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:00 2022] GET /compute/v2.1/servers/4c82269a-db15-463d-a48b-0ca4ff3c1a71 => generated 1217 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:47:00.671033 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-74e5ccab-25b2-4c23-939c-d511da66be3f tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:00.671840 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-74e5ccab-25b2-4c23-939c-d511da66be3f tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] [instance: 5f6ad9ae-93d7-4774-aadf-b1fbbadc224c] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:00.678813 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-74e5ccab-25b2-4c23-939c-d511da66be3f tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:00.679238 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-74e5ccab-25b2-4c23-939c-d511da66be3f tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:00.683111 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-74e5ccab-25b2-4c23-939c-d511da66be3f tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:00.683111 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-74e5ccab-25b2-4c23-939c-d511da66be3f tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:00.683111 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-74e5ccab-25b2-4c23-939c-d511da66be3f tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:00.683111 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-74e5ccab-25b2-4c23-939c-d511da66be3f tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:00.694245 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-f67e9210-9804-4b59-9385-68dd10a5f4db tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9971b5861f44c1a1da94eda0f8f02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f809b8ae704988961908bef0f3cb24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:00.704696 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-f67e9210-9804-4b59-9385-68dd10a5f4db tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] 10.222.0.43 "GET /compute/v2.1/servers/fd09cc9b-d9dd-4133-8665-eeb6d8f51df8" status: 200 len: 1391 microversion: 2.1 time: 0.175506 Oct 04 18:47:00.705364 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1977/3723] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:00 2022] GET /compute/v2.1/servers/fd09cc9b-d9dd-4133-8665-eeb6d8f51df8 => generated 1391 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:47:00.783511 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-74e5ccab-25b2-4c23-939c-d511da66be3f tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcbf2b4b95743af9e6fa1be54554baa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab4da2b9b9f4c7a9c25b7edaab3027d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:00.792396 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-74e5ccab-25b2-4c23-939c-d511da66be3f tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] 10.222.0.43 "GET /compute/v2.1/servers/5f6ad9ae-93d7-4774-aadf-b1fbbadc224c" status: 200 len: 1276 microversion: 2.1 time: 0.124681 Oct 04 18:47:00.793295 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1747/3724] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:00 2022] GET /compute/v2.1/servers/5f6ad9ae-93d7-4774-aadf-b1fbbadc224c => generated 1276 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:00.800091 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-4ab3495c-8a86-4007-9c70-50b8cbc3a749 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:00.800848 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-4ab3495c-8a86-4007-9c70-50b8cbc3a749 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] [instance: fa47906d-d394-46fe-9143-780bcd27a715] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:00.809137 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4ab3495c-8a86-4007-9c70-50b8cbc3a749 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:00.809717 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4ab3495c-8a86-4007-9c70-50b8cbc3a749 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:00.810274 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4ab3495c-8a86-4007-9c70-50b8cbc3a749 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:00.810994 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4ab3495c-8a86-4007-9c70-50b8cbc3a749 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:00.811456 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4ab3495c-8a86-4007-9c70-50b8cbc3a749 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:00.811888 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4ab3495c-8a86-4007-9c70-50b8cbc3a749 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:01.110507 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-724d8098-1f16-4e00-b89f-4764cf8f95f3 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:01.110965 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-4ab3495c-8a86-4007-9c70-50b8cbc3a749 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:01.112069 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-724d8098-1f16-4e00-b89f-4764cf8f95f3 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] [instance: 15541ec9-3112-4adc-9fad-6d20a88f2c09] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:01.121484 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-724d8098-1f16-4e00-b89f-4764cf8f95f3 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:01.122076 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-724d8098-1f16-4e00-b89f-4764cf8f95f3 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:01.123172 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-724d8098-1f16-4e00-b89f-4764cf8f95f3 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:01.124312 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-724d8098-1f16-4e00-b89f-4764cf8f95f3 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:01.124797 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-4ab3495c-8a86-4007-9c70-50b8cbc3a749 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:01.129089 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-724d8098-1f16-4e00-b89f-4764cf8f95f3 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:01.130812 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-4ab3495c-8a86-4007-9c70-50b8cbc3a749 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:01.131436 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-724d8098-1f16-4e00-b89f-4764cf8f95f3 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:01.132015 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-4ab3495c-8a86-4007-9c70-50b8cbc3a749 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] 10.222.0.43 "GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715" status: 200 len: 1874 microversion: 2.32 time: 0.336091 Oct 04 18:47:01.132589 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1978/3725] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:47:00 2022] GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715 => generated 1874 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:47:01.691223 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-855249a6-e64b-413a-a838-d3b367d5b7fe tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:01.692069 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-855249a6-e64b-413a-a838-d3b367d5b7fe tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] [instance: 4c82269a-db15-463d-a48b-0ca4ff3c1a71] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:01.699402 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-855249a6-e64b-413a-a838-d3b367d5b7fe tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:01.699905 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-855249a6-e64b-413a-a838-d3b367d5b7fe tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:01.700347 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-855249a6-e64b-413a-a838-d3b367d5b7fe tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:01.701829 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-855249a6-e64b-413a-a838-d3b367d5b7fe tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:01.702288 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-855249a6-e64b-413a-a838-d3b367d5b7fe tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:01.703605 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-855249a6-e64b-413a-a838-d3b367d5b7fe tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:01.728797 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-724d8098-1f16-4e00-b89f-4764cf8f95f3 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96e7480de94c43909045ac1087e40cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6bd34bf5540ee95c8144f185eb22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:01.737866 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-724d8098-1f16-4e00-b89f-4764cf8f95f3 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] 10.222.0.43 "GET /compute/v2.1/servers/15541ec9-3112-4adc-9fad-6d20a88f2c09" status: 200 len: 1688 microversion: 2.1 time: 0.633856 Oct 04 18:47:01.738909 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1748/3726] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:01 2022] GET /compute/v2.1/servers/15541ec9-3112-4adc-9fad-6d20a88f2c09 => generated 1688 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:47:01.758241 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-109ab310-be2a-4bb3-95f0-8d052e68dce3 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:01.764097 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-109ab310-be2a-4bb3-95f0-8d052e68dce3 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] [instance: fd09cc9b-d9dd-4133-8665-eeb6d8f51df8] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:01.778741 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-109ab310-be2a-4bb3-95f0-8d052e68dce3 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:01.779393 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-109ab310-be2a-4bb3-95f0-8d052e68dce3 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:01.780155 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-109ab310-be2a-4bb3-95f0-8d052e68dce3 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:01.780928 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-109ab310-be2a-4bb3-95f0-8d052e68dce3 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:01.781481 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-109ab310-be2a-4bb3-95f0-8d052e68dce3 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:01.782193 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-109ab310-be2a-4bb3-95f0-8d052e68dce3 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:01.782644 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-855249a6-e64b-413a-a838-d3b367d5b7fe tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c710f394164b89b16bcac2fe51c58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65037d4ea5124d749e42928032e803fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:01.790710 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-855249a6-e64b-413a-a838-d3b367d5b7fe tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] 10.222.0.43 "GET /compute/v2.1/servers/4c82269a-db15-463d-a48b-0ca4ff3c1a71" status: 200 len: 1269 microversion: 2.1 time: 0.103269 Oct 04 18:47:01.791385 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1979/3727] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:01 2022] GET /compute/v2.1/servers/4c82269a-db15-463d-a48b-0ca4ff3c1a71 => generated 1269 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:47:01.815941 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-2ebdde29-fece-4256-8265-4a2092134653 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:01.816618 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-2ebdde29-fece-4256-8265-4a2092134653 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] [instance: 5f6ad9ae-93d7-4774-aadf-b1fbbadc224c] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:01.822983 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2ebdde29-fece-4256-8265-4a2092134653 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:01.823431 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2ebdde29-fece-4256-8265-4a2092134653 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:01.823881 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2ebdde29-fece-4256-8265-4a2092134653 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:01.824599 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2ebdde29-fece-4256-8265-4a2092134653 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:01.825061 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2ebdde29-fece-4256-8265-4a2092134653 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:01.825523 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2ebdde29-fece-4256-8265-4a2092134653 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:01.887664 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-2ebdde29-fece-4256-8265-4a2092134653 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcbf2b4b95743af9e6fa1be54554baa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab4da2b9b9f4c7a9c25b7edaab3027d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:01.895991 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-2ebdde29-fece-4256-8265-4a2092134653 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] 10.222.0.43 "GET /compute/v2.1/servers/5f6ad9ae-93d7-4774-aadf-b1fbbadc224c" status: 200 len: 1282 microversion: 2.1 time: 0.084486 Oct 04 18:47:01.896698 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1980/3728] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:01 2022] GET /compute/v2.1/servers/5f6ad9ae-93d7-4774-aadf-b1fbbadc224c => generated 1282 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:47:02.087127 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-109ab310-be2a-4bb3-95f0-8d052e68dce3 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9971b5861f44c1a1da94eda0f8f02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f809b8ae704988961908bef0f3cb24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:02.100361 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-109ab310-be2a-4bb3-95f0-8d052e68dce3 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] 10.222.0.43 "GET /compute/v2.1/servers/fd09cc9b-d9dd-4133-8665-eeb6d8f51df8" status: 200 len: 1391 microversion: 2.1 time: 0.350118 Oct 04 18:47:02.101080 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1749/3729] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:01 2022] GET /compute/v2.1/servers/fd09cc9b-d9dd-4133-8665-eeb6d8f51df8 => generated 1391 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:02.166028 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-aba9b18f-83d8-4b4c-aacf-86624eb0622a tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:02.166819 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-aba9b18f-83d8-4b4c-aacf-86624eb0622a tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] [instance: fa47906d-d394-46fe-9143-780bcd27a715] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:02.174359 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-aba9b18f-83d8-4b4c-aacf-86624eb0622a tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:02.175286 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-aba9b18f-83d8-4b4c-aacf-86624eb0622a tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:02.175826 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-aba9b18f-83d8-4b4c-aacf-86624eb0622a tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:02.176616 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-aba9b18f-83d8-4b4c-aacf-86624eb0622a tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:02.177390 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-aba9b18f-83d8-4b4c-aacf-86624eb0622a tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:02.178172 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-aba9b18f-83d8-4b4c-aacf-86624eb0622a tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:02.412192 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-aba9b18f-83d8-4b4c-aacf-86624eb0622a tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:02.422817 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-aba9b18f-83d8-4b4c-aacf-86624eb0622a tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:02.424600 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-aba9b18f-83d8-4b4c-aacf-86624eb0622a tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:02.426001 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-aba9b18f-83d8-4b4c-aacf-86624eb0622a tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] 10.222.0.43 "GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715" status: 200 len: 1874 microversion: 2.32 time: 0.264404 Oct 04 18:47:02.429188 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1981/3730] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:47:02 2022] GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715 => generated 1874 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:47:02.765433 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-7e9001bb-6cbe-480b-ae76-717bac436ac0 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:02.766063 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-7e9001bb-6cbe-480b-ae76-717bac436ac0 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] [instance: 15541ec9-3112-4adc-9fad-6d20a88f2c09] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:02.773308 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7e9001bb-6cbe-480b-ae76-717bac436ac0 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:02.773802 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7e9001bb-6cbe-480b-ae76-717bac436ac0 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:02.774244 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7e9001bb-6cbe-480b-ae76-717bac436ac0 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:02.775437 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7e9001bb-6cbe-480b-ae76-717bac436ac0 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:02.776241 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7e9001bb-6cbe-480b-ae76-717bac436ac0 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:02.776876 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7e9001bb-6cbe-480b-ae76-717bac436ac0 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:02.815437 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-c0df95ca-1ed3-4d4c-afd6-ec24a7646614 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:02.816317 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-c0df95ca-1ed3-4d4c-afd6-ec24a7646614 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] [instance: 4c82269a-db15-463d-a48b-0ca4ff3c1a71] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:02.825192 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c0df95ca-1ed3-4d4c-afd6-ec24a7646614 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:02.826684 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c0df95ca-1ed3-4d4c-afd6-ec24a7646614 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:02.827372 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c0df95ca-1ed3-4d4c-afd6-ec24a7646614 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:02.828317 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c0df95ca-1ed3-4d4c-afd6-ec24a7646614 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:02.829328 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c0df95ca-1ed3-4d4c-afd6-ec24a7646614 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:02.830073 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c0df95ca-1ed3-4d4c-afd6-ec24a7646614 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:02.909712 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-c0df95ca-1ed3-4d4c-afd6-ec24a7646614 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c710f394164b89b16bcac2fe51c58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65037d4ea5124d749e42928032e803fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:02.921559 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-c0df95ca-1ed3-4d4c-afd6-ec24a7646614 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] 10.222.0.43 "GET /compute/v2.1/servers/4c82269a-db15-463d-a48b-0ca4ff3c1a71" status: 200 len: 1275 microversion: 2.1 time: 0.111275 Oct 04 18:47:02.923424 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1982/3731] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:02 2022] GET /compute/v2.1/servers/4c82269a-db15-463d-a48b-0ca4ff3c1a71 => generated 1275 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:47:02.928590 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-3d88344a-0d24-4889-9aec-18ae2d7e22b7 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:02.929472 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-3d88344a-0d24-4889-9aec-18ae2d7e22b7 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] [instance: 5f6ad9ae-93d7-4774-aadf-b1fbbadc224c] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:02.937080 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3d88344a-0d24-4889-9aec-18ae2d7e22b7 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:02.937837 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3d88344a-0d24-4889-9aec-18ae2d7e22b7 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:02.938434 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3d88344a-0d24-4889-9aec-18ae2d7e22b7 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:02.939303 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3d88344a-0d24-4889-9aec-18ae2d7e22b7 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:02.939937 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3d88344a-0d24-4889-9aec-18ae2d7e22b7 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:02.940529 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3d88344a-0d24-4889-9aec-18ae2d7e22b7 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:03.182022 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-7e9001bb-6cbe-480b-ae76-717bac436ac0 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96e7480de94c43909045ac1087e40cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6bd34bf5540ee95c8144f185eb22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:03.197688 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-7e9001bb-6cbe-480b-ae76-717bac436ac0 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] 10.222.0.43 "GET /compute/v2.1/servers/15541ec9-3112-4adc-9fad-6d20a88f2c09" status: 200 len: 1688 microversion: 2.1 time: 0.437007 Oct 04 18:47:03.209876 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1750/3732] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:02 2022] GET /compute/v2.1/servers/15541ec9-3112-4adc-9fad-6d20a88f2c09 => generated 1688 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:03.217098 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-c91f5789-834b-426c-8050-cee508896a1d tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:03.218278 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-c91f5789-834b-426c-8050-cee508896a1d tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] [instance: fd09cc9b-d9dd-4133-8665-eeb6d8f51df8] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:03.225756 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c91f5789-834b-426c-8050-cee508896a1d tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:03.226253 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c91f5789-834b-426c-8050-cee508896a1d tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:03.226962 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c91f5789-834b-426c-8050-cee508896a1d tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:03.227677 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c91f5789-834b-426c-8050-cee508896a1d tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:03.228237 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c91f5789-834b-426c-8050-cee508896a1d tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:03.228543 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c91f5789-834b-426c-8050-cee508896a1d tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:03.228680 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-3d88344a-0d24-4889-9aec-18ae2d7e22b7 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcbf2b4b95743af9e6fa1be54554baa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab4da2b9b9f4c7a9c25b7edaab3027d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:03.238889 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-3d88344a-0d24-4889-9aec-18ae2d7e22b7 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] 10.222.0.43 "GET /compute/v2.1/servers/5f6ad9ae-93d7-4774-aadf-b1fbbadc224c" status: 200 len: 1324 microversion: 2.1 time: 0.314119 Oct 04 18:47:03.239490 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1983/3733] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:02 2022] GET /compute/v2.1/servers/5f6ad9ae-93d7-4774-aadf-b1fbbadc224c => generated 1324 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:03.454421 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-e287dd3b-4458-4c50-9b39-d9582b48ff7d tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:03.455117 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-e287dd3b-4458-4c50-9b39-d9582b48ff7d tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] [instance: fa47906d-d394-46fe-9143-780bcd27a715] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:03.462577 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e287dd3b-4458-4c50-9b39-d9582b48ff7d tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:03.463186 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e287dd3b-4458-4c50-9b39-d9582b48ff7d tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:03.463636 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e287dd3b-4458-4c50-9b39-d9582b48ff7d tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:03.464358 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e287dd3b-4458-4c50-9b39-d9582b48ff7d tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:03.464827 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e287dd3b-4458-4c50-9b39-d9582b48ff7d tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:03.465599 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e287dd3b-4458-4c50-9b39-d9582b48ff7d tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:03.578518 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-c91f5789-834b-426c-8050-cee508896a1d tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9971b5861f44c1a1da94eda0f8f02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f809b8ae704988961908bef0f3cb24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:03.588411 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-c91f5789-834b-426c-8050-cee508896a1d tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] 10.222.0.43 "GET /compute/v2.1/servers/fd09cc9b-d9dd-4133-8665-eeb6d8f51df8" status: 200 len: 1391 microversion: 2.1 time: 0.375964 Oct 04 18:47:03.589359 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1751/3734] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:03 2022] GET /compute/v2.1/servers/fd09cc9b-d9dd-4133-8665-eeb6d8f51df8 => generated 1391 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:03.766674 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-e287dd3b-4458-4c50-9b39-d9582b48ff7d tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:03.782636 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-e287dd3b-4458-4c50-9b39-d9582b48ff7d tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:03.784506 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-e287dd3b-4458-4c50-9b39-d9582b48ff7d tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:03.790518 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-e287dd3b-4458-4c50-9b39-d9582b48ff7d tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] 10.222.0.43 "GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715" status: 200 len: 1874 microversion: 2.32 time: 0.340715 Oct 04 18:47:03.791561 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1984/3735] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:47:03 2022] GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715 => generated 1874 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:47:03.947451 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-0fe09c40-a8db-42c0-9cd1-245805ce631d tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:03.948080 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-0fe09c40-a8db-42c0-9cd1-245805ce631d tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] [instance: 4c82269a-db15-463d-a48b-0ca4ff3c1a71] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:03.957953 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0fe09c40-a8db-42c0-9cd1-245805ce631d tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:03.958175 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0fe09c40-a8db-42c0-9cd1-245805ce631d tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:03.958536 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0fe09c40-a8db-42c0-9cd1-245805ce631d tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:03.959242 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0fe09c40-a8db-42c0-9cd1-245805ce631d tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:03.959973 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0fe09c40-a8db-42c0-9cd1-245805ce631d tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:03.960132 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0fe09c40-a8db-42c0-9cd1-245805ce631d tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:04.226199 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-43bd83f1-06b3-43bf-8b83-8b6b1230319e tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:04.226845 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-43bd83f1-06b3-43bf-8b83-8b6b1230319e tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] [instance: 15541ec9-3112-4adc-9fad-6d20a88f2c09] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:04.239945 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-43bd83f1-06b3-43bf-8b83-8b6b1230319e tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:04.241329 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-43bd83f1-06b3-43bf-8b83-8b6b1230319e tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:04.241890 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-43bd83f1-06b3-43bf-8b83-8b6b1230319e tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:04.242740 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-43bd83f1-06b3-43bf-8b83-8b6b1230319e tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:04.243325 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-43bd83f1-06b3-43bf-8b83-8b6b1230319e tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:04.244519 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-43bd83f1-06b3-43bf-8b83-8b6b1230319e tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:04.416722 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-0fe09c40-a8db-42c0-9cd1-245805ce631d tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c710f394164b89b16bcac2fe51c58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65037d4ea5124d749e42928032e803fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:04.440373 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-0fe09c40-a8db-42c0-9cd1-245805ce631d tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] 10.222.0.43 "GET /compute/v2.1/servers/4c82269a-db15-463d-a48b-0ca4ff3c1a71" status: 200 len: 1317 microversion: 2.1 time: 0.497458 Oct 04 18:47:04.441998 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1752/3736] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:03 2022] GET /compute/v2.1/servers/4c82269a-db15-463d-a48b-0ca4ff3c1a71 => generated 1317 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:04.448264 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-9f7e0d1b-312a-43c4-9df2-ce67dd941967 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:04.449264 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-9f7e0d1b-312a-43c4-9df2-ce67dd941967 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] [instance: 5f6ad9ae-93d7-4774-aadf-b1fbbadc224c] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:04.458835 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9f7e0d1b-312a-43c4-9df2-ce67dd941967 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:04.459840 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9f7e0d1b-312a-43c4-9df2-ce67dd941967 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:04.461441 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9f7e0d1b-312a-43c4-9df2-ce67dd941967 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:04.462772 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9f7e0d1b-312a-43c4-9df2-ce67dd941967 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:04.463526 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9f7e0d1b-312a-43c4-9df2-ce67dd941967 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:04.464602 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9f7e0d1b-312a-43c4-9df2-ce67dd941967 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:04.543570 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-43bd83f1-06b3-43bf-8b83-8b6b1230319e tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96e7480de94c43909045ac1087e40cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6bd34bf5540ee95c8144f185eb22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:04.567218 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-43bd83f1-06b3-43bf-8b83-8b6b1230319e tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] 10.222.0.43 "GET /compute/v2.1/servers/15541ec9-3112-4adc-9fad-6d20a88f2c09" status: 200 len: 1688 microversion: 2.1 time: 0.344952 Oct 04 18:47:04.594275 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1985/3737] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:04 2022] GET /compute/v2.1/servers/15541ec9-3112-4adc-9fad-6d20a88f2c09 => generated 1688 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:04.612687 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-78ef79df-d001-4585-b877-25247bb62d3d tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:04.613590 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-78ef79df-d001-4585-b877-25247bb62d3d tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] [instance: fd09cc9b-d9dd-4133-8665-eeb6d8f51df8] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:04.619978 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-78ef79df-d001-4585-b877-25247bb62d3d tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:04.620466 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-78ef79df-d001-4585-b877-25247bb62d3d tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:04.621096 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-78ef79df-d001-4585-b877-25247bb62d3d tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:04.623534 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-78ef79df-d001-4585-b877-25247bb62d3d tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:04.624167 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-78ef79df-d001-4585-b877-25247bb62d3d tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:04.624768 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-78ef79df-d001-4585-b877-25247bb62d3d tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:04.781177 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-9f7e0d1b-312a-43c4-9df2-ce67dd941967 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcbf2b4b95743af9e6fa1be54554baa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab4da2b9b9f4c7a9c25b7edaab3027d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:04.789452 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-9f7e0d1b-312a-43c4-9df2-ce67dd941967 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] 10.222.0.43 "GET /compute/v2.1/servers/5f6ad9ae-93d7-4774-aadf-b1fbbadc224c" status: 200 len: 1324 microversion: 2.1 time: 0.346001 Oct 04 18:47:04.804803 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1753/3738] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:04 2022] GET /compute/v2.1/servers/5f6ad9ae-93d7-4774-aadf-b1fbbadc224c => generated 1324 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:04.821385 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-863974a8-825a-4140-81bb-e8bd0e2221b1 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:04.822191 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-863974a8-825a-4140-81bb-e8bd0e2221b1 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] [instance: fa47906d-d394-46fe-9143-780bcd27a715] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:04.863793 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-863974a8-825a-4140-81bb-e8bd0e2221b1 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:04.864868 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-863974a8-825a-4140-81bb-e8bd0e2221b1 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:04.865317 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-863974a8-825a-4140-81bb-e8bd0e2221b1 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:04.867942 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-863974a8-825a-4140-81bb-e8bd0e2221b1 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:04.868703 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-863974a8-825a-4140-81bb-e8bd0e2221b1 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:04.871298 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-863974a8-825a-4140-81bb-e8bd0e2221b1 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:04.888239 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-78ef79df-d001-4585-b877-25247bb62d3d tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9971b5861f44c1a1da94eda0f8f02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f809b8ae704988961908bef0f3cb24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:04.905789 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-78ef79df-d001-4585-b877-25247bb62d3d tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] 10.222.0.43 "GET /compute/v2.1/servers/fd09cc9b-d9dd-4133-8665-eeb6d8f51df8" status: 200 len: 1391 microversion: 2.1 time: 0.296995 Oct 04 18:47:04.921138 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1986/3739] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:04 2022] GET /compute/v2.1/servers/fd09cc9b-d9dd-4133-8665-eeb6d8f51df8 => generated 1391 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:04.994576 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-8372b320-d948-4163-856c-fc5d8b5af3a9 req-7e460510-4a8b-409a-b59b-7a0de983e241 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f6ad9ae-93d7-4774-aadf-b1fbbadc224c", "tag": "49e89ec3-e909-4e55-83af-1707032f6599"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:47:05.004896 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-8372b320-d948-4163-856c-fc5d8b5af3a9 req-7e460510-4a8b-409a-b59b-7a0de983e241 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:05.005543 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-8372b320-d948-4163-856c-fc5d8b5af3a9 req-7e460510-4a8b-409a-b59b-7a0de983e241 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:05.006251 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-8372b320-d948-4163-856c-fc5d8b5af3a9 req-7e460510-4a8b-409a-b59b-7a0de983e241 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:05.021450 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-8372b320-d948-4163-856c-fc5d8b5af3a9 req-7e460510-4a8b-409a-b59b-7a0de983e241 service nova] Creating event network-changed:49e89ec3-e909-4e55-83af-1707032f6599 for instance 5f6ad9ae-93d7-4774-aadf-b1fbbadc224c on n-h2-851028-13 Oct 04 18:47:05.026570 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-8372b320-d948-4163-856c-fc5d8b5af3a9 req-7e460510-4a8b-409a-b59b-7a0de983e241 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111619 Oct 04 18:47:05.027193 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1987/3740] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:47:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:47:05.470712 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-771abaaa-df4f-4a26-8bdf-324c6f474efa tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:05.472666 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-771abaaa-df4f-4a26-8bdf-324c6f474efa tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] [instance: 4c82269a-db15-463d-a48b-0ca4ff3c1a71] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:05.482441 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-771abaaa-df4f-4a26-8bdf-324c6f474efa tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:05.483201 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-771abaaa-df4f-4a26-8bdf-324c6f474efa tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:05.484202 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-771abaaa-df4f-4a26-8bdf-324c6f474efa tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:05.485254 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-771abaaa-df4f-4a26-8bdf-324c6f474efa tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:05.485717 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-771abaaa-df4f-4a26-8bdf-324c6f474efa tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:05.486144 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-771abaaa-df4f-4a26-8bdf-324c6f474efa tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:05.700688 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-771abaaa-df4f-4a26-8bdf-324c6f474efa tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c710f394164b89b16bcac2fe51c58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65037d4ea5124d749e42928032e803fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:05.719328 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-771abaaa-df4f-4a26-8bdf-324c6f474efa tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] 10.222.0.43 "GET /compute/v2.1/servers/4c82269a-db15-463d-a48b-0ca4ff3c1a71" status: 200 len: 1317 microversion: 2.1 time: 0.254568 Oct 04 18:47:05.721812 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1988/3741] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:05 2022] GET /compute/v2.1/servers/4c82269a-db15-463d-a48b-0ca4ff3c1a71 => generated 1317 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:47:05.745711 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-b812fa48-1c6b-4c23-99c6-24500137f290 req-bf392905-9522-4c04-bf34-2102721e1664 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15541ec9-3112-4adc-9fad-6d20a88f2c09", "name": "network-vif-unplugged", "status": "completed", "tag": "ae7d73fe-313a-45b9-8e8c-91a97a4dd13a"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:47:05.751189 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-863974a8-825a-4140-81bb-e8bd0e2221b1 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:05.774147 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-863974a8-825a-4140-81bb-e8bd0e2221b1 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:05.776791 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-b812fa48-1c6b-4c23-99c6-24500137f290 req-bf392905-9522-4c04-bf34-2102721e1664 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:05.777009 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-863974a8-825a-4140-81bb-e8bd0e2221b1 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:05.777630 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-b812fa48-1c6b-4c23-99c6-24500137f290 req-bf392905-9522-4c04-bf34-2102721e1664 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:05.779787 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-863974a8-825a-4140-81bb-e8bd0e2221b1 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] 10.222.0.43 "GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715" status: 200 len: 1874 microversion: 2.32 time: 0.963155 Oct 04 18:47:05.780341 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-b812fa48-1c6b-4c23-99c6-24500137f290 req-bf392905-9522-4c04-bf34-2102721e1664 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:05.781755 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1754/3742] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:47:04 2022] GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715 => generated 1874 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:47:05.794038 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-b812fa48-1c6b-4c23-99c6-24500137f290 req-bf392905-9522-4c04-bf34-2102721e1664 service nova] Creating event network-vif-unplugged:ae7d73fe-313a-45b9-8e8c-91a97a4dd13a for instance 15541ec9-3112-4adc-9fad-6d20a88f2c09 on n-h1-851028-13 Oct 04 18:47:05.798524 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-0cf5125e-d97c-470e-8f07-473a84a26766 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:05.799370 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-0cf5125e-d97c-470e-8f07-473a84a26766 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] [instance: 15541ec9-3112-4adc-9fad-6d20a88f2c09] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:05.800401 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-b812fa48-1c6b-4c23-99c6-24500137f290 req-bf392905-9522-4c04-bf34-2102721e1664 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.077206 Oct 04 18:47:05.810267 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1989/3743] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:47:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:47:05.815146 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0cf5125e-d97c-470e-8f07-473a84a26766 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:05.815867 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0cf5125e-d97c-470e-8f07-473a84a26766 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:05.816491 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0cf5125e-d97c-470e-8f07-473a84a26766 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:05.818091 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0cf5125e-d97c-470e-8f07-473a84a26766 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:05.818467 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-ee71292e-0672-4cbb-b136-9cb1fe34e88f tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:05.819436 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-ee71292e-0672-4cbb-b136-9cb1fe34e88f tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] [instance: 5f6ad9ae-93d7-4774-aadf-b1fbbadc224c] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:05.824109 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0cf5125e-d97c-470e-8f07-473a84a26766 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:05.824676 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0cf5125e-d97c-470e-8f07-473a84a26766 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:05.827894 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ee71292e-0672-4cbb-b136-9cb1fe34e88f tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:05.829937 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ee71292e-0672-4cbb-b136-9cb1fe34e88f tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:05.830655 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ee71292e-0672-4cbb-b136-9cb1fe34e88f tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:05.831618 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ee71292e-0672-4cbb-b136-9cb1fe34e88f tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:05.832306 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ee71292e-0672-4cbb-b136-9cb1fe34e88f tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:05.832970 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ee71292e-0672-4cbb-b136-9cb1fe34e88f tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:06.131761 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-ee71292e-0672-4cbb-b136-9cb1fe34e88f tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcbf2b4b95743af9e6fa1be54554baa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab4da2b9b9f4c7a9c25b7edaab3027d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:06.141519 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-ee71292e-0672-4cbb-b136-9cb1fe34e88f tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] 10.222.0.43 "GET /compute/v2.1/servers/5f6ad9ae-93d7-4774-aadf-b1fbbadc224c" status: 200 len: 1324 microversion: 2.1 time: 0.329835 Oct 04 18:47:06.157306 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1990/3744] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:05 2022] GET /compute/v2.1/servers/5f6ad9ae-93d7-4774-aadf-b1fbbadc224c => generated 1324 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:06.157306 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f9f84177-fbcd-4706-9953-73b81cb7283d tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:06.161351 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-f9f84177-fbcd-4706-9953-73b81cb7283d tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] [instance: fd09cc9b-d9dd-4133-8665-eeb6d8f51df8] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:06.168239 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f9f84177-fbcd-4706-9953-73b81cb7283d tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:06.168874 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f9f84177-fbcd-4706-9953-73b81cb7283d tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:06.170105 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f9f84177-fbcd-4706-9953-73b81cb7283d tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:06.171055 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f9f84177-fbcd-4706-9953-73b81cb7283d tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:06.171514 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f9f84177-fbcd-4706-9953-73b81cb7283d tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:06.172301 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f9f84177-fbcd-4706-9953-73b81cb7283d tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:06.442903 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-f9f84177-fbcd-4706-9953-73b81cb7283d tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9971b5861f44c1a1da94eda0f8f02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f809b8ae704988961908bef0f3cb24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:06.459750 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-f9f84177-fbcd-4706-9953-73b81cb7283d tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] 10.222.0.43 "GET /compute/v2.1/servers/fd09cc9b-d9dd-4133-8665-eeb6d8f51df8" status: 200 len: 1391 microversion: 2.1 time: 0.309757 Oct 04 18:47:06.475420 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-0cf5125e-d97c-470e-8f07-473a84a26766 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96e7480de94c43909045ac1087e40cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6bd34bf5540ee95c8144f185eb22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:06.479076 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1991/3745] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:06 2022] GET /compute/v2.1/servers/fd09cc9b-d9dd-4133-8665-eeb6d8f51df8 => generated 1391 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:06.489254 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-0cf5125e-d97c-470e-8f07-473a84a26766 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] 10.222.0.43 "GET /compute/v2.1/servers/15541ec9-3112-4adc-9fad-6d20a88f2c09" status: 200 len: 1688 microversion: 2.1 time: 0.699366 Oct 04 18:47:06.504141 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1755/3746] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:05 2022] GET /compute/v2.1/servers/15541ec9-3112-4adc-9fad-6d20a88f2c09 => generated 1688 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:06.750757 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-0ccdf184-6011-40ca-b1a5-10b56f55b501 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:06.751466 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-0ccdf184-6011-40ca-b1a5-10b56f55b501 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] [instance: 4c82269a-db15-463d-a48b-0ca4ff3c1a71] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:06.762014 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0ccdf184-6011-40ca-b1a5-10b56f55b501 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:06.763552 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0ccdf184-6011-40ca-b1a5-10b56f55b501 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:06.764872 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0ccdf184-6011-40ca-b1a5-10b56f55b501 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:06.766483 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0ccdf184-6011-40ca-b1a5-10b56f55b501 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:06.767334 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0ccdf184-6011-40ca-b1a5-10b56f55b501 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:06.768042 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0ccdf184-6011-40ca-b1a5-10b56f55b501 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:06.807577 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-474b15e7-0efd-48de-b243-25236f84a583 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:06.808209 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-474b15e7-0efd-48de-b243-25236f84a583 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] [instance: fa47906d-d394-46fe-9143-780bcd27a715] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:06.821277 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-474b15e7-0efd-48de-b243-25236f84a583 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:06.822152 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-474b15e7-0efd-48de-b243-25236f84a583 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:06.823587 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-474b15e7-0efd-48de-b243-25236f84a583 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:06.826820 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-474b15e7-0efd-48de-b243-25236f84a583 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:06.827807 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-474b15e7-0efd-48de-b243-25236f84a583 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:06.828280 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-474b15e7-0efd-48de-b243-25236f84a583 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:06.941925 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-0ccdf184-6011-40ca-b1a5-10b56f55b501 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c710f394164b89b16bcac2fe51c58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65037d4ea5124d749e42928032e803fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:06.953394 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-0ccdf184-6011-40ca-b1a5-10b56f55b501 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] 10.222.0.43 "GET /compute/v2.1/servers/4c82269a-db15-463d-a48b-0ca4ff3c1a71" status: 200 len: 1317 microversion: 2.1 time: 0.210503 Oct 04 18:47:06.954603 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1992/3747] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:06 2022] GET /compute/v2.1/servers/4c82269a-db15-463d-a48b-0ca4ff3c1a71 => generated 1317 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:07.167352 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-3b57a285-081f-49b2-a277-dad20a281f71 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:07.168058 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-3b57a285-081f-49b2-a277-dad20a281f71 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] [instance: 5f6ad9ae-93d7-4774-aadf-b1fbbadc224c] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:07.174438 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3b57a285-081f-49b2-a277-dad20a281f71 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:07.174939 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3b57a285-081f-49b2-a277-dad20a281f71 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:07.175385 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3b57a285-081f-49b2-a277-dad20a281f71 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:07.176089 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3b57a285-081f-49b2-a277-dad20a281f71 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:07.176551 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3b57a285-081f-49b2-a277-dad20a281f71 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:07.176980 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3b57a285-081f-49b2-a277-dad20a281f71 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:07.194122 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=100 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:47:07.333419 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-3b57a285-081f-49b2-a277-dad20a281f71 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcbf2b4b95743af9e6fa1be54554baa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab4da2b9b9f4c7a9c25b7edaab3027d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:07.341305 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-3b57a285-081f-49b2-a277-dad20a281f71 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] 10.222.0.43 "GET /compute/v2.1/servers/5f6ad9ae-93d7-4774-aadf-b1fbbadc224c" status: 200 len: 1324 microversion: 2.1 time: 0.177968 Oct 04 18:47:07.352823 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1993/3748] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:07 2022] GET /compute/v2.1/servers/5f6ad9ae-93d7-4774-aadf-b1fbbadc224c => generated 1324 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:47:07.485477 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f85db6fa-36b7-4f90-9eca-811d13533d98 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:07.486987 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-f85db6fa-36b7-4f90-9eca-811d13533d98 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] [instance: fd09cc9b-d9dd-4133-8665-eeb6d8f51df8] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:07.490194 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:47:07.494842 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f85db6fa-36b7-4f90-9eca-811d13533d98 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:07.495575 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f85db6fa-36b7-4f90-9eca-811d13533d98 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:07.496215 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f85db6fa-36b7-4f90-9eca-811d13533d98 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:07.497340 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f85db6fa-36b7-4f90-9eca-811d13533d98 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:07.498577 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f85db6fa-36b7-4f90-9eca-811d13533d98 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:07.499209 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f85db6fa-36b7-4f90-9eca-811d13533d98 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:07.660861 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-f85db6fa-36b7-4f90-9eca-811d13533d98 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9971b5861f44c1a1da94eda0f8f02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f809b8ae704988961908bef0f3cb24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:07.669478 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-f85db6fa-36b7-4f90-9eca-811d13533d98 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] 10.222.0.43 "GET /compute/v2.1/servers/fd09cc9b-d9dd-4133-8665-eeb6d8f51df8" status: 200 len: 1391 microversion: 2.1 time: 0.188317 Oct 04 18:47:07.670308 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1994/3749] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:07 2022] GET /compute/v2.1/servers/fd09cc9b-d9dd-4133-8665-eeb6d8f51df8 => generated 1391 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:47:07.677178 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-6a8cbcdf-6e61-49de-b9ad-3b92dbc5e9b7 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:07.678039 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-6a8cbcdf-6e61-49de-b9ad-3b92dbc5e9b7 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] [instance: 15541ec9-3112-4adc-9fad-6d20a88f2c09] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:07.685562 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6a8cbcdf-6e61-49de-b9ad-3b92dbc5e9b7 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:07.686422 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6a8cbcdf-6e61-49de-b9ad-3b92dbc5e9b7 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:07.687163 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6a8cbcdf-6e61-49de-b9ad-3b92dbc5e9b7 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:07.688039 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6a8cbcdf-6e61-49de-b9ad-3b92dbc5e9b7 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:07.688741 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6a8cbcdf-6e61-49de-b9ad-3b92dbc5e9b7 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:07.689302 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6a8cbcdf-6e61-49de-b9ad-3b92dbc5e9b7 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:07.833882 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-6a8cbcdf-6e61-49de-b9ad-3b92dbc5e9b7 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96e7480de94c43909045ac1087e40cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6bd34bf5540ee95c8144f185eb22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:07.834233 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-474b15e7-0efd-48de-b243-25236f84a583 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:07.844900 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-474b15e7-0efd-48de-b243-25236f84a583 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:07.846762 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-474b15e7-0efd-48de-b243-25236f84a583 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:07.847256 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-6a8cbcdf-6e61-49de-b9ad-3b92dbc5e9b7 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] 10.222.0.43 "GET /compute/v2.1/servers/15541ec9-3112-4adc-9fad-6d20a88f2c09" status: 200 len: 1688 microversion: 2.1 time: 0.175397 Oct 04 18:47:07.848095 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-474b15e7-0efd-48de-b243-25236f84a583 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] 10.222.0.43 "GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715" status: 200 len: 1874 microversion: 2.32 time: 1.045042 Oct 04 18:47:07.848782 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1995/3750] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:07 2022] GET /compute/v2.1/servers/15541ec9-3112-4adc-9fad-6d20a88f2c09 => generated 1688 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:07.853811 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-c27370e0-74c8-44e9-94b4-81e809670ae6 req-de97612e-f5e1-49d5-bf71-e69a74de44bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c82269a-db15-463d-a48b-0ca4ff3c1a71", "tag": "0878c18a-2642-414b-96de-4698dafde40e"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:47:07.861669 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1756/3751] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:47:06 2022] GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715 => generated 1874 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:47:07.871858 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-c27370e0-74c8-44e9-94b4-81e809670ae6 req-de97612e-f5e1-49d5-bf71-e69a74de44bc service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:07.872965 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-c27370e0-74c8-44e9-94b4-81e809670ae6 req-de97612e-f5e1-49d5-bf71-e69a74de44bc service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:07.873590 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-c27370e0-74c8-44e9-94b4-81e809670ae6 req-de97612e-f5e1-49d5-bf71-e69a74de44bc service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:07.891672 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-c27370e0-74c8-44e9-94b4-81e809670ae6 req-de97612e-f5e1-49d5-bf71-e69a74de44bc service nova] Creating event network-changed:0878c18a-2642-414b-96de-4698dafde40e for instance 4c82269a-db15-463d-a48b-0ca4ff3c1a71 on n-h2-851028-13 Oct 04 18:47:07.897732 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-c27370e0-74c8-44e9-94b4-81e809670ae6 req-de97612e-f5e1-49d5-bf71-e69a74de44bc service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046501 Oct 04 18:47:07.898902 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1996/3752] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:47:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:47:07.978856 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-440d4400-eec8-4518-96ef-1aac9044594f tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:07.979793 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-440d4400-eec8-4518-96ef-1aac9044594f tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] [instance: 4c82269a-db15-463d-a48b-0ca4ff3c1a71] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:08.015012 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-440d4400-eec8-4518-96ef-1aac9044594f tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:08.015972 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-440d4400-eec8-4518-96ef-1aac9044594f tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:08.017001 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-440d4400-eec8-4518-96ef-1aac9044594f tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:08.017998 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-440d4400-eec8-4518-96ef-1aac9044594f tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:08.018629 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-440d4400-eec8-4518-96ef-1aac9044594f tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:08.019458 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-440d4400-eec8-4518-96ef-1aac9044594f tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:08.366275 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-4c4869b4-1f50-4066-9cc6-a34f6e1470c3 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:08.366989 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-4c4869b4-1f50-4066-9cc6-a34f6e1470c3 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] [instance: 5f6ad9ae-93d7-4774-aadf-b1fbbadc224c] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:08.378349 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4c4869b4-1f50-4066-9cc6-a34f6e1470c3 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:08.379400 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4c4869b4-1f50-4066-9cc6-a34f6e1470c3 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:08.379868 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4c4869b4-1f50-4066-9cc6-a34f6e1470c3 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:08.380611 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4c4869b4-1f50-4066-9cc6-a34f6e1470c3 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:08.389592 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4c4869b4-1f50-4066-9cc6-a34f6e1470c3 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:08.390066 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4c4869b4-1f50-4066-9cc6-a34f6e1470c3 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:08.468161 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-440d4400-eec8-4518-96ef-1aac9044594f tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c710f394164b89b16bcac2fe51c58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65037d4ea5124d749e42928032e803fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:08.473521 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:47:08.491016 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-440d4400-eec8-4518-96ef-1aac9044594f tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] 10.222.0.43 "GET /compute/v2.1/servers/4c82269a-db15-463d-a48b-0ca4ff3c1a71" status: 200 len: 1317 microversion: 2.1 time: 0.515009 Oct 04 18:47:08.492320 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1757/3753] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:07 2022] GET /compute/v2.1/servers/4c82269a-db15-463d-a48b-0ca4ff3c1a71 => generated 1317 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:08.695717 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-d40e13ef-e77d-4974-9b18-fb6c9425864f tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:08.696751 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-d40e13ef-e77d-4974-9b18-fb6c9425864f tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] [instance: fd09cc9b-d9dd-4133-8665-eeb6d8f51df8] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:08.706799 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d40e13ef-e77d-4974-9b18-fb6c9425864f tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:08.709835 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d40e13ef-e77d-4974-9b18-fb6c9425864f tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:08.710658 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d40e13ef-e77d-4974-9b18-fb6c9425864f tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:08.711672 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d40e13ef-e77d-4974-9b18-fb6c9425864f tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:08.713044 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d40e13ef-e77d-4974-9b18-fb6c9425864f tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:08.715292 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d40e13ef-e77d-4974-9b18-fb6c9425864f tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:08.751656 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-4c4869b4-1f50-4066-9cc6-a34f6e1470c3 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcbf2b4b95743af9e6fa1be54554baa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab4da2b9b9f4c7a9c25b7edaab3027d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:08.762873 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-4c4869b4-1f50-4066-9cc6-a34f6e1470c3 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] 10.222.0.43 "GET /compute/v2.1/servers/5f6ad9ae-93d7-4774-aadf-b1fbbadc224c" status: 200 len: 1324 microversion: 2.1 time: 0.400644 Oct 04 18:47:08.793548 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1997/3754] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:08 2022] GET /compute/v2.1/servers/5f6ad9ae-93d7-4774-aadf-b1fbbadc224c => generated 1324 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:47:08.876957 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-d8645f5c-d293-490b-bb4f-04c1e197368f tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:08.880069 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-d8645f5c-d293-490b-bb4f-04c1e197368f tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] [instance: 15541ec9-3112-4adc-9fad-6d20a88f2c09] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:08.896959 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d8645f5c-d293-490b-bb4f-04c1e197368f tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:08.901376 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d8645f5c-d293-490b-bb4f-04c1e197368f tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:08.906518 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d8645f5c-d293-490b-bb4f-04c1e197368f tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:08.907591 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d8645f5c-d293-490b-bb4f-04c1e197368f tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:08.908955 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d8645f5c-d293-490b-bb4f-04c1e197368f tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:08.911231 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d8645f5c-d293-490b-bb4f-04c1e197368f tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:09.018231 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-d8645f5c-d293-490b-bb4f-04c1e197368f tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96e7480de94c43909045ac1087e40cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6bd34bf5540ee95c8144f185eb22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:09.027357 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-d8645f5c-d293-490b-bb4f-04c1e197368f tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] 10.222.0.43 "GET /compute/v2.1/servers/15541ec9-3112-4adc-9fad-6d20a88f2c09" status: 200 len: 1621 microversion: 2.1 time: 0.160497 Oct 04 18:47:09.033620 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1998/3755] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:08 2022] GET /compute/v2.1/servers/15541ec9-3112-4adc-9fad-6d20a88f2c09 => generated 1621 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:47:09.039108 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-c7fc2c4c-c3ab-4321-a831-fba90a4778fe tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:09.040130 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-c7fc2c4c-c3ab-4321-a831-fba90a4778fe tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] [instance: fa47906d-d394-46fe-9143-780bcd27a715] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:09.066668 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c7fc2c4c-c3ab-4321-a831-fba90a4778fe tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:09.067591 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c7fc2c4c-c3ab-4321-a831-fba90a4778fe tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:09.068263 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c7fc2c4c-c3ab-4321-a831-fba90a4778fe tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:09.069247 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c7fc2c4c-c3ab-4321-a831-fba90a4778fe tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:09.069915 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c7fc2c4c-c3ab-4321-a831-fba90a4778fe tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:09.070646 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c7fc2c4c-c3ab-4321-a831-fba90a4778fe tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:09.322565 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-c7fc2c4c-c3ab-4321-a831-fba90a4778fe tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:09.335378 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-c7fc2c4c-c3ab-4321-a831-fba90a4778fe tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:09.337073 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-c7fc2c4c-c3ab-4321-a831-fba90a4778fe tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:09.338633 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-c7fc2c4c-c3ab-4321-a831-fba90a4778fe tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] 10.222.0.43 "GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715" status: 200 len: 1874 microversion: 2.32 time: 0.303717 Oct 04 18:47:09.339557 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 1999/3756] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:47:09 2022] GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715 => generated 1874 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:47:09.387768 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-d40e13ef-e77d-4974-9b18-fb6c9425864f tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9971b5861f44c1a1da94eda0f8f02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f809b8ae704988961908bef0f3cb24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:09.404027 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-d40e13ef-e77d-4974-9b18-fb6c9425864f tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] 10.222.0.43 "GET /compute/v2.1/servers/fd09cc9b-d9dd-4133-8665-eeb6d8f51df8" status: 200 len: 1391 microversion: 2.1 time: 0.711845 Oct 04 18:47:09.404272 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1758/3757] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:08 2022] GET /compute/v2.1/servers/fd09cc9b-d9dd-4133-8665-eeb6d8f51df8 => generated 1391 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:47:09.529970 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-387a210d-6259-484f-b185-b18f6682d5be tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:09.530682 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-387a210d-6259-484f-b185-b18f6682d5be tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] [instance: 4c82269a-db15-463d-a48b-0ca4ff3c1a71] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:09.543188 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-387a210d-6259-484f-b185-b18f6682d5be tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:09.543690 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-387a210d-6259-484f-b185-b18f6682d5be tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:09.544730 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-387a210d-6259-484f-b185-b18f6682d5be tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:09.548379 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-387a210d-6259-484f-b185-b18f6682d5be tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:09.550195 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-387a210d-6259-484f-b185-b18f6682d5be tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:09.550719 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-387a210d-6259-484f-b185-b18f6682d5be tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:09.756330 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-387a210d-6259-484f-b185-b18f6682d5be tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c710f394164b89b16bcac2fe51c58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65037d4ea5124d749e42928032e803fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:09.769909 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-387a210d-6259-484f-b185-b18f6682d5be tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] 10.222.0.43 "GET /compute/v2.1/servers/4c82269a-db15-463d-a48b-0ca4ff3c1a71" status: 200 len: 1317 microversion: 2.1 time: 0.253688 Oct 04 18:47:09.771319 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2000/3758] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:09 2022] GET /compute/v2.1/servers/4c82269a-db15-463d-a48b-0ca4ff3c1a71 => generated 1317 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:09.800643 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-c5f2547e-35d9-410a-ac29-c643e7c80224 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:09.801668 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-c5f2547e-35d9-410a-ac29-c643e7c80224 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] [instance: 5f6ad9ae-93d7-4774-aadf-b1fbbadc224c] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:09.808559 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c5f2547e-35d9-410a-ac29-c643e7c80224 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:09.809050 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c5f2547e-35d9-410a-ac29-c643e7c80224 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:09.809548 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c5f2547e-35d9-410a-ac29-c643e7c80224 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:09.810836 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c5f2547e-35d9-410a-ac29-c643e7c80224 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:09.811290 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c5f2547e-35d9-410a-ac29-c643e7c80224 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:09.811714 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c5f2547e-35d9-410a-ac29-c643e7c80224 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:09.940874 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-c87176cb-ed6f-4e57-a4cc-5687951e870f req-ecf3825c-ed88-41cd-9eef-ba23c19ed1b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00c17e4b-c80e-463e-a3e9-486c118552be", "name": "network-vif-deleted", "tag": "45676c3f-b64a-480d-b44c-aab2a72fcd1e"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:47:09.952079 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-c87176cb-ed6f-4e57-a4cc-5687951e870f req-ecf3825c-ed88-41cd-9eef-ba23c19ed1b6 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:09.952835 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-c87176cb-ed6f-4e57-a4cc-5687951e870f req-ecf3825c-ed88-41cd-9eef-ba23c19ed1b6 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:09.953869 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-c87176cb-ed6f-4e57-a4cc-5687951e870f req-ecf3825c-ed88-41cd-9eef-ba23c19ed1b6 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:09.969526 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-c87176cb-ed6f-4e57-a4cc-5687951e870f req-ecf3825c-ed88-41cd-9eef-ba23c19ed1b6 service nova] Creating event network-vif-deleted:45676c3f-b64a-480d-b44c-aab2a72fcd1e for instance 00c17e4b-c80e-463e-a3e9-486c118552be on n-h1-851028-13 Oct 04 18:47:09.975332 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-c87176cb-ed6f-4e57-a4cc-5687951e870f req-ecf3825c-ed88-41cd-9eef-ba23c19ed1b6 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038041 Oct 04 18:47:09.977067 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2001/3759] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:47:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:47:10.078013 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-202784a2-388f-479c-adfe-bab04b014110 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:10.085490 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-202784a2-388f-479c-adfe-bab04b014110 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] [instance: 15541ec9-3112-4adc-9fad-6d20a88f2c09] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:10.106412 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-202784a2-388f-479c-adfe-bab04b014110 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:10.114638 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-202784a2-388f-479c-adfe-bab04b014110 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:10.115269 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-202784a2-388f-479c-adfe-bab04b014110 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:10.116085 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-202784a2-388f-479c-adfe-bab04b014110 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:10.116580 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-202784a2-388f-479c-adfe-bab04b014110 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:10.117015 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-202784a2-388f-479c-adfe-bab04b014110 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:10.234505 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-202784a2-388f-479c-adfe-bab04b014110 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96e7480de94c43909045ac1087e40cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6bd34bf5540ee95c8144f185eb22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:10.243836 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-202784a2-388f-479c-adfe-bab04b014110 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] 10.222.0.43 "GET /compute/v2.1/servers/15541ec9-3112-4adc-9fad-6d20a88f2c09" status: 200 len: 1621 microversion: 2.1 time: 0.189245 Oct 04 18:47:10.245549 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2002/3760] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:10 2022] GET /compute/v2.1/servers/15541ec9-3112-4adc-9fad-6d20a88f2c09 => generated 1621 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:47:10.365838 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-69c6568e-624d-44c7-8391-716ed634887f tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:10.366473 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-69c6568e-624d-44c7-8391-716ed634887f tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] [instance: fa47906d-d394-46fe-9143-780bcd27a715] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:10.374801 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-69c6568e-624d-44c7-8391-716ed634887f tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:10.375325 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-69c6568e-624d-44c7-8391-716ed634887f tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:10.375778 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-69c6568e-624d-44c7-8391-716ed634887f tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:10.376505 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-69c6568e-624d-44c7-8391-716ed634887f tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:10.376968 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-69c6568e-624d-44c7-8391-716ed634887f tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:10.377452 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-69c6568e-624d-44c7-8391-716ed634887f tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:10.469524 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=6 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:47:10.598476 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-69c6568e-624d-44c7-8391-716ed634887f tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:10.609590 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-69c6568e-624d-44c7-8391-716ed634887f tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:10.611378 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-69c6568e-624d-44c7-8391-716ed634887f tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:10.612799 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-69c6568e-624d-44c7-8391-716ed634887f tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] 10.222.0.43 "GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715" status: 200 len: 1874 microversion: 2.32 time: 0.251273 Oct 04 18:47:10.614080 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2003/3761] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:47:10 2022] GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715 => generated 1874 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:47:10.619053 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-ec1162b8-3c3f-4e07-a3e4-8f868b0a94f8 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:10.620070 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-ec1162b8-3c3f-4e07-a3e4-8f868b0a94f8 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] [instance: fd09cc9b-d9dd-4133-8665-eeb6d8f51df8] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:10.627666 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ec1162b8-3c3f-4e07-a3e4-8f868b0a94f8 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:10.628475 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ec1162b8-3c3f-4e07-a3e4-8f868b0a94f8 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:10.629193 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ec1162b8-3c3f-4e07-a3e4-8f868b0a94f8 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:10.630186 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ec1162b8-3c3f-4e07-a3e4-8f868b0a94f8 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:10.631501 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ec1162b8-3c3f-4e07-a3e4-8f868b0a94f8 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:10.632246 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ec1162b8-3c3f-4e07-a3e4-8f868b0a94f8 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:10.659720 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=20 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:47:10.899659 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-ec1162b8-3c3f-4e07-a3e4-8f868b0a94f8 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9971b5861f44c1a1da94eda0f8f02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f809b8ae704988961908bef0f3cb24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:10.919979 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-ec1162b8-3c3f-4e07-a3e4-8f868b0a94f8 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] 10.222.0.43 "GET /compute/v2.1/servers/fd09cc9b-d9dd-4133-8665-eeb6d8f51df8" status: 200 len: 1391 microversion: 2.1 time: 0.303934 Oct 04 18:47:10.942703 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2004/3762] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:10 2022] GET /compute/v2.1/servers/fd09cc9b-d9dd-4133-8665-eeb6d8f51df8 => generated 1391 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:10.954481 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-7901f712-de15-472e-b020-0c61708a7c3c tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:10.955107 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-7901f712-de15-472e-b020-0c61708a7c3c tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] [instance: 4c82269a-db15-463d-a48b-0ca4ff3c1a71] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:10.967154 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7901f712-de15-472e-b020-0c61708a7c3c tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:10.968226 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7901f712-de15-472e-b020-0c61708a7c3c tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:10.968935 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7901f712-de15-472e-b020-0c61708a7c3c tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:10.970028 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7901f712-de15-472e-b020-0c61708a7c3c tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:10.970661 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7901f712-de15-472e-b020-0c61708a7c3c tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:10.971784 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7901f712-de15-472e-b020-0c61708a7c3c tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:11.012198 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-c5f2547e-35d9-410a-ac29-c643e7c80224 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcbf2b4b95743af9e6fa1be54554baa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab4da2b9b9f4c7a9c25b7edaab3027d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:11.022190 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-c5f2547e-35d9-410a-ac29-c643e7c80224 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] 10.222.0.43 "GET /compute/v2.1/servers/5f6ad9ae-93d7-4774-aadf-b1fbbadc224c" status: 200 len: 1324 microversion: 2.1 time: 1.225346 Oct 04 18:47:11.025276 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1759/3763] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:09 2022] GET /compute/v2.1/servers/5f6ad9ae-93d7-4774-aadf-b1fbbadc224c => generated 1324 bytes in 1229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:11.225412 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-7901f712-de15-472e-b020-0c61708a7c3c tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c710f394164b89b16bcac2fe51c58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65037d4ea5124d749e42928032e803fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:11.250022 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-7901f712-de15-472e-b020-0c61708a7c3c tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] 10.222.0.43 "GET /compute/v2.1/servers/4c82269a-db15-463d-a48b-0ca4ff3c1a71" status: 200 len: 1317 microversion: 2.1 time: 0.305875 Oct 04 18:47:11.272989 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-af4accfe-b487-4f51-bb2d-c242e322a3a3 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:11.279658 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2005/3764] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:10 2022] GET /compute/v2.1/servers/4c82269a-db15-463d-a48b-0ca4ff3c1a71 => generated 1317 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:11.283259 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-af4accfe-b487-4f51-bb2d-c242e322a3a3 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] [instance: 15541ec9-3112-4adc-9fad-6d20a88f2c09] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:11.312316 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-af4accfe-b487-4f51-bb2d-c242e322a3a3 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:11.315989 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-af4accfe-b487-4f51-bb2d-c242e322a3a3 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:11.316554 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-af4accfe-b487-4f51-bb2d-c242e322a3a3 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:11.317367 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-af4accfe-b487-4f51-bb2d-c242e322a3a3 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:11.317845 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-af4accfe-b487-4f51-bb2d-c242e322a3a3 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:11.318278 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-af4accfe-b487-4f51-bb2d-c242e322a3a3 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:11.359685 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-af4accfe-b487-4f51-bb2d-c242e322a3a3 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:11.360186 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-af4accfe-b487-4f51-bb2d-c242e322a3a3 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:11.360636 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-af4accfe-b487-4f51-bb2d-c242e322a3a3 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:11.361101 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.objects.instance [None req-af4accfe-b487-4f51-bb2d-c242e322a3a3 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lazy-loading 'fault' on Instance uuid 15541ec9-3112-4adc-9fad-6d20a88f2c09 {{(pid=123595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:47:11.445896 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-af4accfe-b487-4f51-bb2d-c242e322a3a3 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96e7480de94c43909045ac1087e40cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6bd34bf5540ee95c8144f185eb22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:11.459226 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-af4accfe-b487-4f51-bb2d-c242e322a3a3 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] 10.222.0.43 "GET /compute/v2.1/servers/15541ec9-3112-4adc-9fad-6d20a88f2c09" status: 200 len: 1335 microversion: 2.1 time: 0.194300 Oct 04 18:47:11.460555 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1760/3765] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:11 2022] GET /compute/v2.1/servers/15541ec9-3112-4adc-9fad-6d20a88f2c09 => generated 1335 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:11.644185 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-c1013688-0d80-4367-a97c-cc5924c79a53 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:11.645093 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-c1013688-0d80-4367-a97c-cc5924c79a53 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] [instance: fa47906d-d394-46fe-9143-780bcd27a715] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:11.652628 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c1013688-0d80-4367-a97c-cc5924c79a53 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:11.653537 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c1013688-0d80-4367-a97c-cc5924c79a53 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:11.654162 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c1013688-0d80-4367-a97c-cc5924c79a53 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:11.655611 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c1013688-0d80-4367-a97c-cc5924c79a53 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:11.656077 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c1013688-0d80-4367-a97c-cc5924c79a53 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:11.656729 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c1013688-0d80-4367-a97c-cc5924c79a53 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:11.943958 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-aafb3a14-54be-419c-88a8-1db9e37f9e8e tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:11.944741 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-aafb3a14-54be-419c-88a8-1db9e37f9e8e tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] [instance: fd09cc9b-d9dd-4133-8665-eeb6d8f51df8] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:11.959264 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-aafb3a14-54be-419c-88a8-1db9e37f9e8e tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:11.961179 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-aafb3a14-54be-419c-88a8-1db9e37f9e8e tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:11.963001 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-aafb3a14-54be-419c-88a8-1db9e37f9e8e tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:11.965582 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-aafb3a14-54be-419c-88a8-1db9e37f9e8e tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:11.966921 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-aafb3a14-54be-419c-88a8-1db9e37f9e8e tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:11.969059 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-aafb3a14-54be-419c-88a8-1db9e37f9e8e tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:11.982079 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-c1013688-0d80-4367-a97c-cc5924c79a53 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:11.993822 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-c1013688-0d80-4367-a97c-cc5924c79a53 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:11.995549 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-c1013688-0d80-4367-a97c-cc5924c79a53 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:11.997450 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-c1013688-0d80-4367-a97c-cc5924c79a53 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] 10.222.0.43 "GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715" status: 200 len: 1874 microversion: 2.32 time: 0.357414 Oct 04 18:47:11.998823 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2006/3766] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:47:11 2022] GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715 => generated 1874 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:47:12.052001 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-1e481580-8763-436a-96cf-c44882cdff49 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:12.055605 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-1e481580-8763-436a-96cf-c44882cdff49 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] [instance: 5f6ad9ae-93d7-4774-aadf-b1fbbadc224c] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:12.093293 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1e481580-8763-436a-96cf-c44882cdff49 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:12.096579 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1e481580-8763-436a-96cf-c44882cdff49 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:12.103072 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1e481580-8763-436a-96cf-c44882cdff49 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:12.106391 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1e481580-8763-436a-96cf-c44882cdff49 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:12.108110 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1e481580-8763-436a-96cf-c44882cdff49 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:12.110475 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1e481580-8763-436a-96cf-c44882cdff49 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:12.412529 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-1e481580-8763-436a-96cf-c44882cdff49 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcbf2b4b95743af9e6fa1be54554baa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab4da2b9b9f4c7a9c25b7edaab3027d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:12.430506 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-1e481580-8763-436a-96cf-c44882cdff49 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] 10.222.0.43 "GET /compute/v2.1/servers/5f6ad9ae-93d7-4774-aadf-b1fbbadc224c" status: 200 len: 1324 microversion: 2.1 time: 0.385611 Oct 04 18:47:12.431946 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2007/3767] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:12 2022] GET /compute/v2.1/servers/5f6ad9ae-93d7-4774-aadf-b1fbbadc224c => generated 1324 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:47:12.440102 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-44e17b97-b1e3-4af4-b297-aac991651439 req-21b187fc-c3ee-41b5-aef5-a2607152ec01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15541ec9-3112-4adc-9fad-6d20a88f2c09", "name": "network-vif-deleted", "tag": "ae7d73fe-313a-45b9-8e8c-91a97a4dd13a"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:47:12.453392 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-44e17b97-b1e3-4af4-b297-aac991651439 req-21b187fc-c3ee-41b5-aef5-a2607152ec01 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:12.456410 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-44e17b97-b1e3-4af4-b297-aac991651439 req-21b187fc-c3ee-41b5-aef5-a2607152ec01 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:12.457125 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-44e17b97-b1e3-4af4-b297-aac991651439 req-21b187fc-c3ee-41b5-aef5-a2607152ec01 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:12.475927 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-44e17b97-b1e3-4af4-b297-aac991651439 req-21b187fc-c3ee-41b5-aef5-a2607152ec01 service nova] Creating event network-vif-deleted:ae7d73fe-313a-45b9-8e8c-91a97a4dd13a for instance 15541ec9-3112-4adc-9fad-6d20a88f2c09 on n-h1-851028-13 Oct 04 18:47:12.483415 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-44e17b97-b1e3-4af4-b297-aac991651439 req-21b187fc-c3ee-41b5-aef5-a2607152ec01 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049457 Oct 04 18:47:12.484385 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2008/3768] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:47:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:47:12.491177 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-46b62bc5-f080-451d-8858-34273df9612a req-afb2da78-85c2-4b32-b002-fc9d93b93e21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f6ad9ae-93d7-4774-aadf-b1fbbadc224c", "name": "network-vif-plugged", "status": "completed", "tag": "49e89ec3-e909-4e55-83af-1707032f6599"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:47:12.504326 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-46b62bc5-f080-451d-8858-34273df9612a req-afb2da78-85c2-4b32-b002-fc9d93b93e21 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:12.505307 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-46b62bc5-f080-451d-8858-34273df9612a req-afb2da78-85c2-4b32-b002-fc9d93b93e21 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:12.506016 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-46b62bc5-f080-451d-8858-34273df9612a req-afb2da78-85c2-4b32-b002-fc9d93b93e21 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:12.525455 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-aafb3a14-54be-419c-88a8-1db9e37f9e8e tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9971b5861f44c1a1da94eda0f8f02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f809b8ae704988961908bef0f3cb24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:12.537226 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-46b62bc5-f080-451d-8858-34273df9612a req-afb2da78-85c2-4b32-b002-fc9d93b93e21 service nova] Creating event network-vif-plugged:49e89ec3-e909-4e55-83af-1707032f6599 for instance 5f6ad9ae-93d7-4774-aadf-b1fbbadc224c on n-h2-851028-13 Oct 04 18:47:12.541506 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-aafb3a14-54be-419c-88a8-1db9e37f9e8e tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] 10.222.0.43 "GET /compute/v2.1/servers/fd09cc9b-d9dd-4133-8665-eeb6d8f51df8" status: 200 len: 1391 microversion: 2.1 time: 0.595514 Oct 04 18:47:12.542840 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1761/3769] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:11 2022] GET /compute/v2.1/servers/fd09cc9b-d9dd-4133-8665-eeb6d8f51df8 => generated 1391 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:12.545284 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-46b62bc5-f080-451d-8858-34273df9612a req-afb2da78-85c2-4b32-b002-fc9d93b93e21 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059182 Oct 04 18:47:12.547461 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2009/3770] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:47:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:47:12.552786 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-16a4074b-c463-4350-9ebd-baa3f1ab6993 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:12.553485 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-16a4074b-c463-4350-9ebd-baa3f1ab6993 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] [instance: 4c82269a-db15-463d-a48b-0ca4ff3c1a71] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:12.567565 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-5598fc73-e373-47e8-9332-3f53d4d6efa3 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:12.568679 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-5598fc73-e373-47e8-9332-3f53d4d6efa3 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] [instance: 15541ec9-3112-4adc-9fad-6d20a88f2c09] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:12.580020 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5598fc73-e373-47e8-9332-3f53d4d6efa3 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:12.580517 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5598fc73-e373-47e8-9332-3f53d4d6efa3 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:12.580961 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5598fc73-e373-47e8-9332-3f53d4d6efa3 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:12.581727 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5598fc73-e373-47e8-9332-3f53d4d6efa3 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:12.582183 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5598fc73-e373-47e8-9332-3f53d4d6efa3 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:12.582316 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-16a4074b-c463-4350-9ebd-baa3f1ab6993 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:12.582611 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5598fc73-e373-47e8-9332-3f53d4d6efa3 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:12.583204 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-16a4074b-c463-4350-9ebd-baa3f1ab6993 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:12.584360 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-16a4074b-c463-4350-9ebd-baa3f1ab6993 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:12.585461 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-16a4074b-c463-4350-9ebd-baa3f1ab6993 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:12.585936 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-16a4074b-c463-4350-9ebd-baa3f1ab6993 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:12.586376 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-16a4074b-c463-4350-9ebd-baa3f1ab6993 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:12.603314 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-5598fc73-e373-47e8-9332-3f53d4d6efa3 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] HTTP exception thrown: Instance 15541ec9-3112-4adc-9fad-6d20a88f2c09 could not be found. Oct 04 18:47:12.605219 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-5598fc73-e373-47e8-9332-3f53d4d6efa3 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Request method failure captured: Oct 04 18:47:12.605219 n-d-851028-13 devstack@n-api.service[123596]: request: GET /compute/v2.1/servers/15541ec9-3112-4adc-9fad-6d20a88f2c09 HTTP/1.1 Oct 04 18:47:12.605219 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:47:12.605219 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:47:12.605219 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:47:12.605219 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 18:47:12.605219 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:47:12.605219 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:47:12.605219 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:47:12.605219 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:47:12.605219 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPH6ImUsc0v5avJaXbAf95n6vmfztxEtTiW32SRLH_bOmBbny3fOGIWm6DaSHmvRnWhZ-84faOFvXqXs-7dDoMftV5mgOWVN0Q9OrVISe3irL7FfmyYZmGssWLEuXGLXQhTtdNOFN9115Lqu5biPYPUWU74K-2mRSRsiih09WbGDmZQI Oct 04 18:47:12.605219 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:47:12.605219 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:47:12.605219 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:47:12.605219 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:47:12.605219 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:47:12.605219 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:47:12.605219 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: eda6bd34bf5540ee95c8144f185eb22d Oct 04 18:47:12.605219 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1155401912 Oct 04 18:47:12.605219 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 18:47:12.605219 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 18:47:12.605219 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/eda6bd34bf5540ee95c8144f185eb22d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_eda6bd34bf5540ee95c8144f185eb22d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/eda6bd34bf5540ee95c8144f185eb22d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/eda6bd34bf5540ee95c8144f185eb22d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:47:12.605219 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1155401912 Oct 04 18:47:12.605219 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: eda6bd34bf5540ee95c8144f185eb22d Oct 04 18:47:12.605219 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1155401912 Oct 04 18:47:12.605219 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-ServerRescueNegativeTestJSON-1155401912-project Oct 04 18:47:12.605219 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:47:12.605219 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:47:12.605219 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 96e7480de94c43909045ac1087e40cd8 Oct 04 18:47:12.605219 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1155401912-project Oct 04 18:47:12.605219 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 18:47:12.605219 n-d-851028-13 devstack@n-api.service[123596]: exception: Instance 15541ec9-3112-4adc-9fad-6d20a88f2c09 could not be found. Oct 04 18:47:12.605219 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': '15541ec9-3112-4adc-9fad-6d20a88f2c09'} Oct 04 18:47:12.605219 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:47:12.605219 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:47:12.605219 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:47:12.605219 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:47:12.605219 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:47:12.605219 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:47:12.605219 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:47:12.605219 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:47:12.605219 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:47:12.605219 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:47:12.605219 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15541ec9-3112-4adc-9fad-6d20a88f2c09 could not be found. Oct 04 18:47:12.605219 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:47:12.605219 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:47:12.605219 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:47:12.605219 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:47:12.605219 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:47:12.605219 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:47:12.605219 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:47:12.605219 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:47:12.605219 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:47:12.605219 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:47:12.605219 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:47:12.605219 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:47:12.605219 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:47:12.605219 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:47:12.605219 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:47:12.605219 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:47:12.605219 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15541ec9-3112-4adc-9fad-6d20a88f2c09 could not be found. Oct 04 18:47:12.605219 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:47:12.605219 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:47:12.610318 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:47:12.610318 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:47:12.610318 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:47:12.610318 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:47:12.610318 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:47:12.610318 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:47:12.610318 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15541ec9-3112-4adc-9fad-6d20a88f2c09 could not be found. Oct 04 18:47:12.610318 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:47:12.610318 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-5598fc73-e373-47e8-9332-3f53d4d6efa3 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Returning 404 to user: Instance 15541ec9-3112-4adc-9fad-6d20a88f2c09 could not be found. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:47:12.610318 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-5598fc73-e373-47e8-9332-3f53d4d6efa3 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] 10.222.0.43 "GET /compute/v2.1/servers/15541ec9-3112-4adc-9fad-6d20a88f2c09" status: 404 len: 111 microversion: 2.1 time: 0.058369 Oct 04 18:47:12.611730 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2010/3771] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:12 2022] GET /compute/v2.1/servers/15541ec9-3112-4adc-9fad-6d20a88f2c09 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:47:12.615865 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-d37ec428-aa61-4d36-ba27-1157d0fc935a tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Calling method '.version_select at 0x7fb227f25550>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:12.638300 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-d37ec428-aa61-4d36-ba27-1157d0fc935a tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-235700876" status: 202 len: 0 microversion: 2.1 time: 0.026054 Oct 04 18:47:12.642536 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2011/3772] 10.222.0.43 () {58 vars in 1218 bytes} [Tue Oct 4 18:47:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-235700876 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:47:12.910957 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-16a4074b-c463-4350-9ebd-baa3f1ab6993 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c710f394164b89b16bcac2fe51c58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65037d4ea5124d749e42928032e803fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:12.922998 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-16a4074b-c463-4350-9ebd-baa3f1ab6993 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] 10.222.0.43 "GET /compute/v2.1/servers/4c82269a-db15-463d-a48b-0ca4ff3c1a71" status: 200 len: 1317 microversion: 2.1 time: 0.378557 Oct 04 18:47:12.924359 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1762/3773] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:12 2022] GET /compute/v2.1/servers/4c82269a-db15-463d-a48b-0ca4ff3c1a71 => generated 1317 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:13.030514 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-5f1eecfb-74df-4f02-859c-bbebb612dceb tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:13.031136 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-5f1eecfb-74df-4f02-859c-bbebb612dceb tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] [instance: fa47906d-d394-46fe-9143-780bcd27a715] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:13.038416 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5f1eecfb-74df-4f02-859c-bbebb612dceb tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:13.039126 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5f1eecfb-74df-4f02-859c-bbebb612dceb tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:13.039564 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5f1eecfb-74df-4f02-859c-bbebb612dceb tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:13.047059 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5f1eecfb-74df-4f02-859c-bbebb612dceb tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:13.052546 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5f1eecfb-74df-4f02-859c-bbebb612dceb tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:13.052897 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5f1eecfb-74df-4f02-859c-bbebb612dceb tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:13.459652 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-807c1cce-6316-4bd9-8420-12300f020ae1 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:13.461017 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-807c1cce-6316-4bd9-8420-12300f020ae1 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] [instance: 5f6ad9ae-93d7-4774-aadf-b1fbbadc224c] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:13.468663 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-807c1cce-6316-4bd9-8420-12300f020ae1 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:13.469346 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-807c1cce-6316-4bd9-8420-12300f020ae1 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:13.469929 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-807c1cce-6316-4bd9-8420-12300f020ae1 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:13.470681 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-807c1cce-6316-4bd9-8420-12300f020ae1 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:13.471569 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-807c1cce-6316-4bd9-8420-12300f020ae1 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:13.472452 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-807c1cce-6316-4bd9-8420-12300f020ae1 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:13.615216 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-807c1cce-6316-4bd9-8420-12300f020ae1 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcbf2b4b95743af9e6fa1be54554baa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab4da2b9b9f4c7a9c25b7edaab3027d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:13.623842 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-807c1cce-6316-4bd9-8420-12300f020ae1 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] 10.222.0.43 "GET /compute/v2.1/servers/5f6ad9ae-93d7-4774-aadf-b1fbbadc224c" status: 200 len: 1324 microversion: 2.1 time: 0.169194 Oct 04 18:47:13.624419 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1763/3774] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:13 2022] GET /compute/v2.1/servers/5f6ad9ae-93d7-4774-aadf-b1fbbadc224c => generated 1324 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:13.628859 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-3f4282c9-06e9-4416-8839-d8658fecd1fa tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:13.630236 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-3f4282c9-06e9-4416-8839-d8658fecd1fa tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] [instance: fd09cc9b-d9dd-4133-8665-eeb6d8f51df8] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:13.636951 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3f4282c9-06e9-4416-8839-d8658fecd1fa tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:13.638098 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3f4282c9-06e9-4416-8839-d8658fecd1fa tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:13.638550 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3f4282c9-06e9-4416-8839-d8658fecd1fa tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:13.639256 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3f4282c9-06e9-4416-8839-d8658fecd1fa tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:13.639951 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3f4282c9-06e9-4416-8839-d8658fecd1fa tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:13.640380 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3f4282c9-06e9-4416-8839-d8658fecd1fa tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:13.778684 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-3f4282c9-06e9-4416-8839-d8658fecd1fa tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9971b5861f44c1a1da94eda0f8f02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f809b8ae704988961908bef0f3cb24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:13.789476 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-3f4282c9-06e9-4416-8839-d8658fecd1fa tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] 10.222.0.43 "GET /compute/v2.1/servers/fd09cc9b-d9dd-4133-8665-eeb6d8f51df8" status: 200 len: 1391 microversion: 2.1 time: 0.163991 Oct 04 18:47:13.790524 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1764/3775] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:13 2022] GET /compute/v2.1/servers/fd09cc9b-d9dd-4133-8665-eeb6d8f51df8 => generated 1391 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:13.801531 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-5f1eecfb-74df-4f02-859c-bbebb612dceb tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:13.813958 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-5f1eecfb-74df-4f02-859c-bbebb612dceb tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:13.815452 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-5f1eecfb-74df-4f02-859c-bbebb612dceb tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:13.817506 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-5f1eecfb-74df-4f02-859c-bbebb612dceb tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] 10.222.0.43 "GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715" status: 200 len: 1874 microversion: 2.32 time: 0.795824 Oct 04 18:47:13.834008 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2012/3776] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:47:13 2022] GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715 => generated 1874 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:47:13.957858 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-bf1c4bf7-578d-4987-8bc3-5ffbc1df2cf7 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:13.959152 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-bf1c4bf7-578d-4987-8bc3-5ffbc1df2cf7 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] [instance: 4c82269a-db15-463d-a48b-0ca4ff3c1a71] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:13.966762 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bf1c4bf7-578d-4987-8bc3-5ffbc1df2cf7 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:13.967490 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bf1c4bf7-578d-4987-8bc3-5ffbc1df2cf7 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:13.968146 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bf1c4bf7-578d-4987-8bc3-5ffbc1df2cf7 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:13.968995 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bf1c4bf7-578d-4987-8bc3-5ffbc1df2cf7 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:13.969482 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bf1c4bf7-578d-4987-8bc3-5ffbc1df2cf7 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:13.969922 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bf1c4bf7-578d-4987-8bc3-5ffbc1df2cf7 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:14.180667 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-bf1c4bf7-578d-4987-8bc3-5ffbc1df2cf7 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c710f394164b89b16bcac2fe51c58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65037d4ea5124d749e42928032e803fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:14.192686 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-bf1c4bf7-578d-4987-8bc3-5ffbc1df2cf7 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] 10.222.0.43 "GET /compute/v2.1/servers/4c82269a-db15-463d-a48b-0ca4ff3c1a71" status: 200 len: 1317 microversion: 2.1 time: 0.240495 Oct 04 18:47:14.193884 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1765/3777] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:13 2022] GET /compute/v2.1/servers/4c82269a-db15-463d-a48b-0ca4ff3c1a71 => generated 1317 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:14.646929 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-696f1198-837d-44b3-b883-2db5bd2b6ccd tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:14.648415 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-696f1198-837d-44b3-b883-2db5bd2b6ccd tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] [instance: 5f6ad9ae-93d7-4774-aadf-b1fbbadc224c] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:14.657446 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-696f1198-837d-44b3-b883-2db5bd2b6ccd tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:14.658297 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-696f1198-837d-44b3-b883-2db5bd2b6ccd tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:14.659251 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-696f1198-837d-44b3-b883-2db5bd2b6ccd tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:14.660293 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-696f1198-837d-44b3-b883-2db5bd2b6ccd tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:14.661031 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-696f1198-837d-44b3-b883-2db5bd2b6ccd tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:14.661732 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-696f1198-837d-44b3-b883-2db5bd2b6ccd tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:14.816368 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-8d3a0834-dca5-4860-868e-aaaae0e88ca5 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:14.818708 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-8d3a0834-dca5-4860-868e-aaaae0e88ca5 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] [instance: fd09cc9b-d9dd-4133-8665-eeb6d8f51df8] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:14.828407 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-696f1198-837d-44b3-b883-2db5bd2b6ccd tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcbf2b4b95743af9e6fa1be54554baa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab4da2b9b9f4c7a9c25b7edaab3027d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:14.832825 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8d3a0834-dca5-4860-868e-aaaae0e88ca5 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:14.834365 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8d3a0834-dca5-4860-868e-aaaae0e88ca5 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:14.837018 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8d3a0834-dca5-4860-868e-aaaae0e88ca5 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:14.838663 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-696f1198-837d-44b3-b883-2db5bd2b6ccd tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] 10.222.0.43 "GET /compute/v2.1/servers/5f6ad9ae-93d7-4774-aadf-b1fbbadc224c" status: 200 len: 1324 microversion: 2.1 time: 0.195457 Oct 04 18:47:14.839055 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8d3a0834-dca5-4860-868e-aaaae0e88ca5 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:14.840608 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2013/3778] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:14 2022] GET /compute/v2.1/servers/5f6ad9ae-93d7-4774-aadf-b1fbbadc224c => generated 1324 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:14.842358 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8d3a0834-dca5-4860-868e-aaaae0e88ca5 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:14.844570 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8d3a0834-dca5-4860-868e-aaaae0e88ca5 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:14.849982 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-5c14b8c3-f982-472f-a858-a91562c2570f tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:14.852766 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-5c14b8c3-f982-472f-a858-a91562c2570f tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] [instance: fa47906d-d394-46fe-9143-780bcd27a715] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:14.875071 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5c14b8c3-f982-472f-a858-a91562c2570f tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:14.875592 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5c14b8c3-f982-472f-a858-a91562c2570f tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:14.876265 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5c14b8c3-f982-472f-a858-a91562c2570f tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:14.877793 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5c14b8c3-f982-472f-a858-a91562c2570f tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:14.878470 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5c14b8c3-f982-472f-a858-a91562c2570f tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:14.879111 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5c14b8c3-f982-472f-a858-a91562c2570f tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:14.913432 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=100 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:47:15.118282 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-8d3a0834-dca5-4860-868e-aaaae0e88ca5 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9971b5861f44c1a1da94eda0f8f02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f809b8ae704988961908bef0f3cb24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:15.134782 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-8d3a0834-dca5-4860-868e-aaaae0e88ca5 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] 10.222.0.43 "GET /compute/v2.1/servers/fd09cc9b-d9dd-4133-8665-eeb6d8f51df8" status: 200 len: 1391 microversion: 2.1 time: 0.317312 Oct 04 18:47:15.135603 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1766/3779] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:14 2022] GET /compute/v2.1/servers/fd09cc9b-d9dd-4133-8665-eeb6d8f51df8 => generated 1391 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:15.146119 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-a7e21509-bb2d-468b-a641-b9112eb101ee req-44a5d747-9350-4c23-b0c5-a1e75c125ff0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa47906d-d394-46fe-9143-780bcd27a715", "name": "network-vif-plugged", "status": "completed", "tag": "501fb3c2-8b52-4abe-9556-64d2ee5b20db"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:47:15.169748 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-5c14b8c3-f982-472f-a858-a91562c2570f tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:15.171430 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-a7e21509-bb2d-468b-a641-b9112eb101ee req-44a5d747-9350-4c23-b0c5-a1e75c125ff0 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:15.171931 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-a7e21509-bb2d-468b-a641-b9112eb101ee req-44a5d747-9350-4c23-b0c5-a1e75c125ff0 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:15.172415 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-a7e21509-bb2d-468b-a641-b9112eb101ee req-44a5d747-9350-4c23-b0c5-a1e75c125ff0 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:15.183088 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-5c14b8c3-f982-472f-a858-a91562c2570f tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:15.185467 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-5c14b8c3-f982-472f-a858-a91562c2570f tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:15.186851 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-5c14b8c3-f982-472f-a858-a91562c2570f tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] 10.222.0.43 "GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715" status: 200 len: 1874 microversion: 2.32 time: 0.344986 Oct 04 18:47:15.187957 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2014/3780] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:47:14 2022] GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715 => generated 1874 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:47:15.197740 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-a7e21509-bb2d-468b-a641-b9112eb101ee req-44a5d747-9350-4c23-b0c5-a1e75c125ff0 service nova] Creating event network-vif-plugged:501fb3c2-8b52-4abe-9556-64d2ee5b20db for instance fa47906d-d394-46fe-9143-780bcd27a715 on n-h1-851028-13 Oct 04 18:47:15.204836 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-a7e21509-bb2d-468b-a641-b9112eb101ee req-44a5d747-9350-4c23-b0c5-a1e75c125ff0 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067976 Oct 04 18:47:15.207331 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1767/3781] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:47:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:47:15.217042 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-16bdd181-48c7-46a4-8e28-727935d59ccd tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:15.218709 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-16bdd181-48c7-46a4-8e28-727935d59ccd tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] [instance: 4c82269a-db15-463d-a48b-0ca4ff3c1a71] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:15.226508 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-16bdd181-48c7-46a4-8e28-727935d59ccd tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:15.227288 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-16bdd181-48c7-46a4-8e28-727935d59ccd tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:15.228306 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-16bdd181-48c7-46a4-8e28-727935d59ccd tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:15.229360 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-16bdd181-48c7-46a4-8e28-727935d59ccd tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:15.230024 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-16bdd181-48c7-46a4-8e28-727935d59ccd tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:15.230632 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-16bdd181-48c7-46a4-8e28-727935d59ccd tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:15.416437 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-16bdd181-48c7-46a4-8e28-727935d59ccd tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c710f394164b89b16bcac2fe51c58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65037d4ea5124d749e42928032e803fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:15.434337 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-16bdd181-48c7-46a4-8e28-727935d59ccd tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] 10.222.0.43 "GET /compute/v2.1/servers/4c82269a-db15-463d-a48b-0ca4ff3c1a71" status: 200 len: 1317 microversion: 2.1 time: 0.222371 Oct 04 18:47:15.456091 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2015/3782] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:15 2022] GET /compute/v2.1/servers/4c82269a-db15-463d-a48b-0ca4ff3c1a71 => generated 1317 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:15.868412 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-1cef9a17-a98b-4d8a-a4c2-f5d954ad5c57 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:15.869136 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-1cef9a17-a98b-4d8a-a4c2-f5d954ad5c57 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] [instance: 5f6ad9ae-93d7-4774-aadf-b1fbbadc224c] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:15.882778 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1cef9a17-a98b-4d8a-a4c2-f5d954ad5c57 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:15.884595 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1cef9a17-a98b-4d8a-a4c2-f5d954ad5c57 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:15.885339 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1cef9a17-a98b-4d8a-a4c2-f5d954ad5c57 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:15.887283 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1cef9a17-a98b-4d8a-a4c2-f5d954ad5c57 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:15.888467 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1cef9a17-a98b-4d8a-a4c2-f5d954ad5c57 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:15.889419 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1cef9a17-a98b-4d8a-a4c2-f5d954ad5c57 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:16.098713 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-1cef9a17-a98b-4d8a-a4c2-f5d954ad5c57 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcbf2b4b95743af9e6fa1be54554baa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab4da2b9b9f4c7a9c25b7edaab3027d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:16.110224 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-1cef9a17-a98b-4d8a-a4c2-f5d954ad5c57 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] 10.222.0.43 "GET /compute/v2.1/servers/5f6ad9ae-93d7-4774-aadf-b1fbbadc224c" status: 200 len: 1520 microversion: 2.1 time: 0.247036 Oct 04 18:47:16.111590 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1768/3783] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:15 2022] GET /compute/v2.1/servers/5f6ad9ae-93d7-4774-aadf-b1fbbadc224c => generated 1520 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:16.141344 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-8cbbada5-aadb-4646-acdd-f30a30e3bec7 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:16.141934 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-8cbbada5-aadb-4646-acdd-f30a30e3bec7 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] [instance: 5f6ad9ae-93d7-4774-aadf-b1fbbadc224c] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:16.164287 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-724c888f-1e7f-425b-9ef5-c3ee13a51b93 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:16.165290 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-724c888f-1e7f-425b-9ef5-c3ee13a51b93 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] [instance: fd09cc9b-d9dd-4133-8665-eeb6d8f51df8] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:16.174149 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8cbbada5-aadb-4646-acdd-f30a30e3bec7 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:16.174655 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8cbbada5-aadb-4646-acdd-f30a30e3bec7 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:16.176499 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8cbbada5-aadb-4646-acdd-f30a30e3bec7 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:16.177259 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8cbbada5-aadb-4646-acdd-f30a30e3bec7 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:16.177639 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-724c888f-1e7f-425b-9ef5-c3ee13a51b93 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:16.177794 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8cbbada5-aadb-4646-acdd-f30a30e3bec7 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:16.178143 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8cbbada5-aadb-4646-acdd-f30a30e3bec7 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:16.178629 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-724c888f-1e7f-425b-9ef5-c3ee13a51b93 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:16.179266 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-724c888f-1e7f-425b-9ef5-c3ee13a51b93 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:16.181090 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-724c888f-1e7f-425b-9ef5-c3ee13a51b93 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:16.183897 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-724c888f-1e7f-425b-9ef5-c3ee13a51b93 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:16.184556 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-724c888f-1e7f-425b-9ef5-c3ee13a51b93 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:16.407295 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-724c888f-1e7f-425b-9ef5-c3ee13a51b93 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9971b5861f44c1a1da94eda0f8f02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f809b8ae704988961908bef0f3cb24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:16.416627 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-724c888f-1e7f-425b-9ef5-c3ee13a51b93 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] 10.222.0.43 "GET /compute/v2.1/servers/fd09cc9b-d9dd-4133-8665-eeb6d8f51df8" status: 200 len: 1391 microversion: 2.1 time: 0.256748 Oct 04 18:47:16.418253 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1769/3784] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:16 2022] GET /compute/v2.1/servers/fd09cc9b-d9dd-4133-8665-eeb6d8f51df8 => generated 1391 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:47:16.423507 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-7b65b393-5c49-41d0-9235-baf958a8b0d5 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:16.424576 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-7b65b393-5c49-41d0-9235-baf958a8b0d5 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] [instance: fa47906d-d394-46fe-9143-780bcd27a715] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:16.431288 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7b65b393-5c49-41d0-9235-baf958a8b0d5 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:16.432083 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7b65b393-5c49-41d0-9235-baf958a8b0d5 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:16.432761 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7b65b393-5c49-41d0-9235-baf958a8b0d5 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:16.433757 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7b65b393-5c49-41d0-9235-baf958a8b0d5 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:16.434538 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7b65b393-5c49-41d0-9235-baf958a8b0d5 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:16.435301 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7b65b393-5c49-41d0-9235-baf958a8b0d5 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:16.521584 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-8cbbada5-aadb-4646-acdd-f30a30e3bec7 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcbf2b4b95743af9e6fa1be54554baa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab4da2b9b9f4c7a9c25b7edaab3027d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:16.541360 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-8cbbada5-aadb-4646-acdd-f30a30e3bec7 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] 10.222.0.43 "GET /compute/v2.1/servers/5f6ad9ae-93d7-4774-aadf-b1fbbadc224c" status: 200 len: 1520 microversion: 2.1 time: 0.405153 Oct 04 18:47:16.549572 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2016/3785] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:16 2022] GET /compute/v2.1/servers/5f6ad9ae-93d7-4774-aadf-b1fbbadc224c => generated 1520 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:16.568091 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-9e3d6435-db46-4e41-9a79-0e044b8c8098 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:16.568723 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-9e3d6435-db46-4e41-9a79-0e044b8c8098 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] [instance: 4c82269a-db15-463d-a48b-0ca4ff3c1a71] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:16.595974 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9e3d6435-db46-4e41-9a79-0e044b8c8098 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:16.596497 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9e3d6435-db46-4e41-9a79-0e044b8c8098 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:16.596949 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9e3d6435-db46-4e41-9a79-0e044b8c8098 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:16.597716 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9e3d6435-db46-4e41-9a79-0e044b8c8098 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:16.598167 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9e3d6435-db46-4e41-9a79-0e044b8c8098 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:16.604656 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9e3d6435-db46-4e41-9a79-0e044b8c8098 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:16.826142 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-9e3d6435-db46-4e41-9a79-0e044b8c8098 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c710f394164b89b16bcac2fe51c58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65037d4ea5124d749e42928032e803fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:16.840480 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-9e3d6435-db46-4e41-9a79-0e044b8c8098 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] 10.222.0.43 "GET /compute/v2.1/servers/4c82269a-db15-463d-a48b-0ca4ff3c1a71" status: 200 len: 1317 microversion: 2.1 time: 0.288666 Oct 04 18:47:16.842945 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2017/3786] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:16 2022] GET /compute/v2.1/servers/4c82269a-db15-463d-a48b-0ca4ff3c1a71 => generated 1317 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:16.848954 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-db7ccd67-1e1c-4aa3-a7b2-ac186dee4392 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1496620494"}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:47:16.854165 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-db7ccd67-1e1c-4aa3-a7b2-ac186dee4392 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] [instance: 5f6ad9ae-93d7-4774-aadf-b1fbbadc224c] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:16.861535 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-db7ccd67-1e1c-4aa3-a7b2-ac186dee4392 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:16.862601 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-db7ccd67-1e1c-4aa3-a7b2-ac186dee4392 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:16.863941 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-db7ccd67-1e1c-4aa3-a7b2-ac186dee4392 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:16.864891 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-db7ccd67-1e1c-4aa3-a7b2-ac186dee4392 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:16.865607 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-db7ccd67-1e1c-4aa3-a7b2-ac186dee4392 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:16.866290 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-db7ccd67-1e1c-4aa3-a7b2-ac186dee4392 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:16.898106 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-7b65b393-5c49-41d0-9235-baf958a8b0d5 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:16.916689 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-7b65b393-5c49-41d0-9235-baf958a8b0d5 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:16.919957 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-7b65b393-5c49-41d0-9235-baf958a8b0d5 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:16.923966 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-7b65b393-5c49-41d0-9235-baf958a8b0d5 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] 10.222.0.43 "GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715" status: 200 len: 1874 microversion: 2.32 time: 0.504454 Oct 04 18:47:16.925260 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1770/3787] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:47:16 2022] GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715 => generated 1874 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:47:17.220613 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-db7ccd67-1e1c-4aa3-a7b2-ac186dee4392 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] 10.222.0.43 "POST /compute/v2.1/servers/5f6ad9ae-93d7-4774-aadf-b1fbbadc224c/action" status: 202 len: 0 microversion: 2.1 time: 0.350055 Oct 04 18:47:17.224459 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2018/3788] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 18:47:16 2022] POST /compute/v2.1/servers/5f6ad9ae-93d7-4774-aadf-b1fbbadc224c/action => generated 0 bytes in 381 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 04 18:47:17.234937 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-d7d18a42-95fc-4e05-85f3-482091f21fff tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Calling method '.version_select at 0x7fb21f7c0ca0>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:17.271749 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-dbdcb675-0378-40dd-9b9f-82b0ad8e8200 req-fb80c98a-c22d-4964-90c6-11cd3aae04a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa47906d-d394-46fe-9143-780bcd27a715", "name": "network-vif-plugged", "status": "completed", "tag": "c894730c-7cbc-41ef-a7b9-c9eb574e1489"}, {"server_uuid": "fa47906d-d394-46fe-9143-780bcd27a715", "name": "network-vif-plugged", "status": "completed", "tag": "39a6795d-0bd0-4b90-a450-c5f7f85686c6"}, {"server_uuid": "4c82269a-db15-463d-a48b-0ca4ff3c1a71", "name": "network-vif-plugged", "status": "completed", "tag": "0878c18a-2642-414b-96de-4698dafde40e"}, {"server_uuid": "fa47906d-d394-46fe-9143-780bcd27a715", "name": "network-vif-plugged", "status": "completed", "tag": "4dedaa7a-5245-4fee-80eb-d2092ad95c1e"}, {"server_uuid": "fa47906d-d394-46fe-9143-780bcd27a715", "name": "network-vif-plugged", "status": "completed", "tag": "076a121c-741e-46ac-a9c1-c4bae9e304a4"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:47:17.288903 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-dbdcb675-0378-40dd-9b9f-82b0ad8e8200 req-fb80c98a-c22d-4964-90c6-11cd3aae04a6 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:17.289639 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-dbdcb675-0378-40dd-9b9f-82b0ad8e8200 req-fb80c98a-c22d-4964-90c6-11cd3aae04a6 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:17.290160 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-dbdcb675-0378-40dd-9b9f-82b0ad8e8200 req-fb80c98a-c22d-4964-90c6-11cd3aae04a6 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:17.320289 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-dbdcb675-0378-40dd-9b9f-82b0ad8e8200 req-fb80c98a-c22d-4964-90c6-11cd3aae04a6 service nova] Creating event network-vif-plugged:c894730c-7cbc-41ef-a7b9-c9eb574e1489 for instance fa47906d-d394-46fe-9143-780bcd27a715 on n-h1-851028-13 Oct 04 18:47:17.320923 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-dbdcb675-0378-40dd-9b9f-82b0ad8e8200 req-fb80c98a-c22d-4964-90c6-11cd3aae04a6 service nova] Creating event network-vif-plugged:39a6795d-0bd0-4b90-a450-c5f7f85686c6 for instance fa47906d-d394-46fe-9143-780bcd27a715 on n-h1-851028-13 Oct 04 18:47:17.321578 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-dbdcb675-0378-40dd-9b9f-82b0ad8e8200 req-fb80c98a-c22d-4964-90c6-11cd3aae04a6 service nova] Creating event network-vif-plugged:0878c18a-2642-414b-96de-4698dafde40e for instance 4c82269a-db15-463d-a48b-0ca4ff3c1a71 on n-h2-851028-13 Oct 04 18:47:17.322222 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-dbdcb675-0378-40dd-9b9f-82b0ad8e8200 req-fb80c98a-c22d-4964-90c6-11cd3aae04a6 service nova] Creating event network-vif-plugged:4dedaa7a-5245-4fee-80eb-d2092ad95c1e for instance fa47906d-d394-46fe-9143-780bcd27a715 on n-h1-851028-13 Oct 04 18:47:17.322734 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-dbdcb675-0378-40dd-9b9f-82b0ad8e8200 req-fb80c98a-c22d-4964-90c6-11cd3aae04a6 service nova] Creating event network-vif-plugged:076a121c-741e-46ac-a9c1-c4bae9e304a4 for instance fa47906d-d394-46fe-9143-780bcd27a715 on n-h1-851028-13 Oct 04 18:47:17.336555 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-dbdcb675-0378-40dd-9b9f-82b0ad8e8200 req-fb80c98a-c22d-4964-90c6-11cd3aae04a6 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 867 microversion: 2.1 time: 0.074833 Oct 04 18:47:17.337692 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2019/3789] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:47:17 2022] POST /compute/v2.1/os-server-external-events => generated 867 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:47:17.440571 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-d7d18a42-95fc-4e05-85f3-482091f21fff tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] 10.222.0.43 "DELETE /compute/v2.1/images/20e21a28-ef77-4800-96ae-20475aa9df31" status: 204 len: 0 microversion: 2.1 time: 0.210131 Oct 04 18:47:17.444882 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f17607a1-dfcf-4c4d-a1e8-d432e128029a tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:17.445762 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1771/3790] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:17 2022] DELETE /compute/v2.1/images/20e21a28-ef77-4800-96ae-20475aa9df31 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:47:17.449333 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-f17607a1-dfcf-4c4d-a1e8-d432e128029a tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] [instance: fd09cc9b-d9dd-4133-8665-eeb6d8f51df8] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:17.456772 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f17607a1-dfcf-4c4d-a1e8-d432e128029a tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:17.458371 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f17607a1-dfcf-4c4d-a1e8-d432e128029a tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:17.458948 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-7d51cd38-cc8c-4151-b83b-e60326a7681e tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Calling method '.version_select at 0x7fb21fc4f280>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:17.459702 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f17607a1-dfcf-4c4d-a1e8-d432e128029a tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:17.460649 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f17607a1-dfcf-4c4d-a1e8-d432e128029a tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:17.462176 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f17607a1-dfcf-4c4d-a1e8-d432e128029a tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:17.462873 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f17607a1-dfcf-4c4d-a1e8-d432e128029a tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:17.490917 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-7d51cd38-cc8c-4151-b83b-e60326a7681e tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] HTTP exception thrown: Image not found. Oct 04 18:47:17.494723 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-7d51cd38-cc8c-4151-b83b-e60326a7681e tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Request method failure captured: Oct 04 18:47:17.494723 n-d-851028-13 devstack@n-api.service[123595]: request: GET /compute/v2.1/images/20e21a28-ef77-4800-96ae-20475aa9df31 HTTP/1.1 Oct 04 18:47:17.494723 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 18:47:17.494723 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 18:47:17.494723 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 18:47:17.494723 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 0 Oct 04 18:47:17.494723 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 18:47:17.494723 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 18:47:17.494723 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 18:47:17.494723 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 18:47:17.494723 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPH978iZmaQey9qRFmivrOEN9WI4gFjhDc3nSUPEBZXv1WUgd7GTFhNQGJ_Nm2KHTEzU5QZw7VgnyxDt5Dwy3JGK8gUnF9wIKq6iB3FX5CCTGK5JwEw-XtwnwemZOTSVwZU_4nc3l4c2itfEGLVIoX2yb6G-IjSzn-sL8697UlYQlcew Oct 04 18:47:17.494723 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 18:47:17.494723 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 18:47:17.494723 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 18:47:17.494723 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 18:47:17.494723 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 18:47:17.494723 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 18:47:17.494723 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: 8ab4da2b9b9f4c7a9c25b7edaab3027d Oct 04 18:47:17.494723 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2004915413 Oct 04 18:47:17.494723 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 18:47:17.494723 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 18:47:17.494723 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/8ab4da2b9b9f4c7a9c25b7edaab3027d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_8ab4da2b9b9f4c7a9c25b7edaab3027d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8ab4da2b9b9f4c7a9c25b7edaab3027d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8ab4da2b9b9f4c7a9c25b7edaab3027d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:47:17.494723 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2004915413 Oct 04 18:47:17.494723 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: 8ab4da2b9b9f4c7a9c25b7edaab3027d Oct 04 18:47:17.494723 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2004915413 Oct 04 18:47:17.494723 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-ImagesOneServerNegativeTestJSON-2004915413-project Oct 04 18:47:17.494723 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 18:47:17.494723 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 18:47:17.494723 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: cdcbf2b4b95743af9e6fa1be54554baa Oct 04 18:47:17.494723 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2004915413-project Oct 04 18:47:17.494723 n-d-851028-13 devstack@n-api.service[123595]: method: Oct 04 18:47:17.494723 n-d-851028-13 devstack@n-api.service[123595]: exception: Image not found. Oct 04 18:47:17.494723 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': '20e21a28-ef77-4800-96ae-20475aa9df31'} Oct 04 18:47:17.494723 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:47:17.494723 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:47:17.494723 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 18:47:17.494723 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 18:47:17.494723 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 18:47:17.494723 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 18:47:17.494723 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 18:47:17.494723 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 18:47:17.494723 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 18:47:17.494723 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 18:47:17.494723 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 18:47:17.494723 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 18:47:17.494723 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 18:47:17.494723 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 18:47:17.494723 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 18:47:17.494723 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 18:47:17.494723 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 18:47:17.494723 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 18:47:17.494723 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 20e21a28-ef77-4800-96ae-20475aa9df31 Oct 04 18:47:17.494723 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:47:17.494723 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:47:17.494723 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:47:17.494723 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:47:17.494723 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 04 18:47:17.494723 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 04 18:47:17.494723 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 04 18:47:17.494723 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 04 18:47:17.494723 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 04 18:47:17.494723 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 04 18:47:17.494723 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 04 18:47:17.499753 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 04 18:47:17.499753 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 18:47:17.499753 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 18:47:17.499753 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 18:47:17.499753 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 18:47:17.499753 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 18:47:17.499753 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 18:47:17.499753 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 18:47:17.499753 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 18:47:17.499753 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 18:47:17.499753 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 18:47:17.499753 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 18:47:17.499753 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 18:47:17.499753 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 18:47:17.499753 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 18:47:17.499753 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 18:47:17.499753 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 18:47:17.499753 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 20e21a28-ef77-4800-96ae-20475aa9df31 could not be found. Oct 04 18:47:17.499753 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:47:17.499753 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:47:17.499753 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:47:17.499753 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:47:17.499753 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:47:17.499753 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:47:17.499753 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:47:17.499753 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:47:17.499753 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:47:17.499753 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:47:17.499753 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:47:17.499753 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:47:17.499753 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 04 18:47:17.499753 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 18:47:17.499753 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 18:47:17.499753 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:47:17.499753 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:47:17.499753 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:47:17.499753 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:47:17.499753 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:47:17.499753 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:47:17.499753 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:47:17.499753 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:47:17.499753 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 18:47:17.499753 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:47:17.507010 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-7d51cd38-cc8c-4151-b83b-e60326a7681e tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Returning 404 to user: Image not found. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:47:17.508090 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-7d51cd38-cc8c-4151-b83b-e60326a7681e tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] 10.222.0.43 "GET /compute/v2.1/images/20e21a28-ef77-4800-96ae-20475aa9df31" status: 404 len: 62 microversion: 2.1 time: 0.057681 Oct 04 18:47:17.509362 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1772/3791] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 18:47:17 2022] GET /compute/v2.1/images/20e21a28-ef77-4800-96ae-20475aa9df31 => generated 62 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 04 18:47:17.525613 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-140ad027-ee51-4845-817c-72e13dd4afe9 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:17.526479 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-140ad027-ee51-4845-817c-72e13dd4afe9 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] [instance: 5f6ad9ae-93d7-4774-aadf-b1fbbadc224c] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:17.536629 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-140ad027-ee51-4845-817c-72e13dd4afe9 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:17.537539 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-140ad027-ee51-4845-817c-72e13dd4afe9 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:17.538070 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-140ad027-ee51-4845-817c-72e13dd4afe9 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:17.538875 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-140ad027-ee51-4845-817c-72e13dd4afe9 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:17.539426 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-140ad027-ee51-4845-817c-72e13dd4afe9 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:17.540079 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-140ad027-ee51-4845-817c-72e13dd4afe9 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:17.933735 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-140ad027-ee51-4845-817c-72e13dd4afe9 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcbf2b4b95743af9e6fa1be54554baa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab4da2b9b9f4c7a9c25b7edaab3027d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:17.946450 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-140ad027-ee51-4845-817c-72e13dd4afe9 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] 10.222.0.43 "GET /compute/v2.1/servers/5f6ad9ae-93d7-4774-aadf-b1fbbadc224c" status: 200 len: 1532 microversion: 2.1 time: 0.433100 Oct 04 18:47:17.949689 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1773/3792] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:17 2022] GET /compute/v2.1/servers/5f6ad9ae-93d7-4774-aadf-b1fbbadc224c => generated 1532 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:47:17.961103 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-0734b11e-5ca1-41af-b179-db14595d54e1 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:17.963458 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-0734b11e-5ca1-41af-b179-db14595d54e1 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] [instance: 4c82269a-db15-463d-a48b-0ca4ff3c1a71] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:17.974947 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0734b11e-5ca1-41af-b179-db14595d54e1 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:17.979492 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0734b11e-5ca1-41af-b179-db14595d54e1 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:17.982081 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0734b11e-5ca1-41af-b179-db14595d54e1 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:17.983908 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0734b11e-5ca1-41af-b179-db14595d54e1 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:17.984621 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0734b11e-5ca1-41af-b179-db14595d54e1 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:17.985848 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0734b11e-5ca1-41af-b179-db14595d54e1 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:18.010812 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-f17607a1-dfcf-4c4d-a1e8-d432e128029a tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9971b5861f44c1a1da94eda0f8f02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f809b8ae704988961908bef0f3cb24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:18.023693 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-f17607a1-dfcf-4c4d-a1e8-d432e128029a tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] 10.222.0.43 "GET /compute/v2.1/servers/fd09cc9b-d9dd-4133-8665-eeb6d8f51df8" status: 200 len: 1391 microversion: 2.1 time: 0.585427 Oct 04 18:47:18.028141 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2020/3793] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:17 2022] GET /compute/v2.1/servers/fd09cc9b-d9dd-4133-8665-eeb6d8f51df8 => generated 1391 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:47:18.035050 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-632c7e8c-ae1f-4d88-8397-3659634953eb tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:18.037939 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-632c7e8c-ae1f-4d88-8397-3659634953eb tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] [instance: fa47906d-d394-46fe-9143-780bcd27a715] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:18.072873 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-632c7e8c-ae1f-4d88-8397-3659634953eb tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:18.074163 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-632c7e8c-ae1f-4d88-8397-3659634953eb tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:18.075219 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-632c7e8c-ae1f-4d88-8397-3659634953eb tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:18.076129 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-632c7e8c-ae1f-4d88-8397-3659634953eb tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:18.076630 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-632c7e8c-ae1f-4d88-8397-3659634953eb tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:18.077374 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-632c7e8c-ae1f-4d88-8397-3659634953eb tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:18.225937 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-0734b11e-5ca1-41af-b179-db14595d54e1 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c710f394164b89b16bcac2fe51c58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65037d4ea5124d749e42928032e803fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:18.235291 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-0734b11e-5ca1-41af-b179-db14595d54e1 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] 10.222.0.43 "GET /compute/v2.1/servers/4c82269a-db15-463d-a48b-0ca4ff3c1a71" status: 200 len: 1317 microversion: 2.1 time: 0.284211 Oct 04 18:47:18.253292 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1774/3794] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:17 2022] GET /compute/v2.1/servers/4c82269a-db15-463d-a48b-0ca4ff3c1a71 => generated 1317 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:18.468642 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-632c7e8c-ae1f-4d88-8397-3659634953eb tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:18.484998 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-632c7e8c-ae1f-4d88-8397-3659634953eb tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:18.486905 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-632c7e8c-ae1f-4d88-8397-3659634953eb tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:18.488196 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-632c7e8c-ae1f-4d88-8397-3659634953eb tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] 10.222.0.43 "GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715" status: 200 len: 1874 microversion: 2.32 time: 0.458794 Oct 04 18:47:18.488895 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2021/3795] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:47:18 2022] GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715 => generated 1874 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:47:18.977439 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-e4a455d3-2ce3-4ef8-9d52-530b7708b4dd tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:18.978926 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-e4a455d3-2ce3-4ef8-9d52-530b7708b4dd tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] [instance: 5f6ad9ae-93d7-4774-aadf-b1fbbadc224c] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:18.995607 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e4a455d3-2ce3-4ef8-9d52-530b7708b4dd tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:19.000340 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e4a455d3-2ce3-4ef8-9d52-530b7708b4dd tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:19.001717 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e4a455d3-2ce3-4ef8-9d52-530b7708b4dd tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:19.003069 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e4a455d3-2ce3-4ef8-9d52-530b7708b4dd tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:19.003923 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e4a455d3-2ce3-4ef8-9d52-530b7708b4dd tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:19.004879 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e4a455d3-2ce3-4ef8-9d52-530b7708b4dd tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:19.053801 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-605d3dba-e36f-4322-ba61-c1e1e1ccc50c tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:19.054800 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-605d3dba-e36f-4322-ba61-c1e1e1ccc50c tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] [instance: fd09cc9b-d9dd-4133-8665-eeb6d8f51df8] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:19.063026 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-605d3dba-e36f-4322-ba61-c1e1e1ccc50c tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:19.066088 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-605d3dba-e36f-4322-ba61-c1e1e1ccc50c tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:19.066961 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-605d3dba-e36f-4322-ba61-c1e1e1ccc50c tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:19.070907 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-605d3dba-e36f-4322-ba61-c1e1e1ccc50c tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:19.073428 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-605d3dba-e36f-4322-ba61-c1e1e1ccc50c tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:19.075573 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-605d3dba-e36f-4322-ba61-c1e1e1ccc50c tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:19.222596 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-e4a455d3-2ce3-4ef8-9d52-530b7708b4dd tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcbf2b4b95743af9e6fa1be54554baa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab4da2b9b9f4c7a9c25b7edaab3027d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:19.235725 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-e4a455d3-2ce3-4ef8-9d52-530b7708b4dd tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] 10.222.0.43 "GET /compute/v2.1/servers/5f6ad9ae-93d7-4774-aadf-b1fbbadc224c" status: 200 len: 1538 microversion: 2.1 time: 0.263222 Oct 04 18:47:19.236895 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1775/3796] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:18 2022] GET /compute/v2.1/servers/5f6ad9ae-93d7-4774-aadf-b1fbbadc224c => generated 1538 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:19.263525 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-534f7ff7-a260-4b3b-b824-cab83bec4d36 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:19.264516 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-534f7ff7-a260-4b3b-b824-cab83bec4d36 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] [instance: 4c82269a-db15-463d-a48b-0ca4ff3c1a71] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:19.277502 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-534f7ff7-a260-4b3b-b824-cab83bec4d36 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:19.278040 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-534f7ff7-a260-4b3b-b824-cab83bec4d36 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:19.278475 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-534f7ff7-a260-4b3b-b824-cab83bec4d36 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:19.279184 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-534f7ff7-a260-4b3b-b824-cab83bec4d36 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:19.282277 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-534f7ff7-a260-4b3b-b824-cab83bec4d36 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:19.282740 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-534f7ff7-a260-4b3b-b824-cab83bec4d36 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:19.467800 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-534f7ff7-a260-4b3b-b824-cab83bec4d36 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c710f394164b89b16bcac2fe51c58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65037d4ea5124d749e42928032e803fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:19.475313 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=100 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:47:19.479059 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-534f7ff7-a260-4b3b-b824-cab83bec4d36 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] 10.222.0.43 "GET /compute/v2.1/servers/4c82269a-db15-463d-a48b-0ca4ff3c1a71" status: 200 len: 1317 microversion: 2.1 time: 0.219347 Oct 04 18:47:19.479699 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1776/3797] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:19 2022] GET /compute/v2.1/servers/4c82269a-db15-463d-a48b-0ca4ff3c1a71 => generated 1317 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:47:19.490848 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-da1275f1-0d0f-4e76-9b09-c706c106d3f8 req-0552a375-3304-45c2-9249-4ebc0e5c168b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa47906d-d394-46fe-9143-780bcd27a715", "name": "network-vif-plugged", "status": "completed", "tag": "f2b979d5-599c-4c02-8f73-2a3d8e34cd17"}, {"server_uuid": "fa47906d-d394-46fe-9143-780bcd27a715", "name": "network-vif-plugged", "status": "completed", "tag": "11c4d4a8-fea9-4b92-8ccb-46013ebd8b06"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:47:19.508129 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-da1275f1-0d0f-4e76-9b09-c706c106d3f8 req-0552a375-3304-45c2-9249-4ebc0e5c168b service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:19.508908 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-da1275f1-0d0f-4e76-9b09-c706c106d3f8 req-0552a375-3304-45c2-9249-4ebc0e5c168b service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:19.509655 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-da1275f1-0d0f-4e76-9b09-c706c106d3f8 req-0552a375-3304-45c2-9249-4ebc0e5c168b service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:19.526407 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-da1275f1-0d0f-4e76-9b09-c706c106d3f8 req-0552a375-3304-45c2-9249-4ebc0e5c168b service nova] Creating event network-vif-plugged:f2b979d5-599c-4c02-8f73-2a3d8e34cd17 for instance fa47906d-d394-46fe-9143-780bcd27a715 on n-h1-851028-13 Oct 04 18:47:19.527396 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-da1275f1-0d0f-4e76-9b09-c706c106d3f8 req-0552a375-3304-45c2-9249-4ebc0e5c168b service nova] Creating event network-vif-plugged:11c4d4a8-fea9-4b92-8ccb-46013ebd8b06 for instance fa47906d-d394-46fe-9143-780bcd27a715 on n-h1-851028-13 Oct 04 18:47:19.529877 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-605d3dba-e36f-4322-ba61-c1e1e1ccc50c tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9971b5861f44c1a1da94eda0f8f02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f809b8ae704988961908bef0f3cb24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:19.536241 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-da1275f1-0d0f-4e76-9b09-c706c106d3f8 req-0552a375-3304-45c2-9249-4ebc0e5c168b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.053788 Oct 04 18:47:19.537188 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1777/3798] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:47:19 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:47:19.543806 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-605d3dba-e36f-4322-ba61-c1e1e1ccc50c tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] 10.222.0.43 "GET /compute/v2.1/servers/fd09cc9b-d9dd-4133-8665-eeb6d8f51df8" status: 200 len: 1391 microversion: 2.1 time: 0.496167 Oct 04 18:47:19.544150 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-f0218990-cc6c-4d8b-87de-2e7ee31c972e tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:19.545540 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-f0218990-cc6c-4d8b-87de-2e7ee31c972e tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] [instance: fa47906d-d394-46fe-9143-780bcd27a715] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:19.546377 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2022/3799] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:19 2022] GET /compute/v2.1/servers/fd09cc9b-d9dd-4133-8665-eeb6d8f51df8 => generated 1391 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:19.555062 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f0218990-cc6c-4d8b-87de-2e7ee31c972e tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:19.556061 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f0218990-cc6c-4d8b-87de-2e7ee31c972e tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:19.556663 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f0218990-cc6c-4d8b-87de-2e7ee31c972e tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:19.557554 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f0218990-cc6c-4d8b-87de-2e7ee31c972e tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:19.558158 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f0218990-cc6c-4d8b-87de-2e7ee31c972e tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:19.558734 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f0218990-cc6c-4d8b-87de-2e7ee31c972e tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:19.995897 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-f0218990-cc6c-4d8b-87de-2e7ee31c972e tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:20.016057 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-f0218990-cc6c-4d8b-87de-2e7ee31c972e tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:20.018640 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-f0218990-cc6c-4d8b-87de-2e7ee31c972e tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:20.021663 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-f0218990-cc6c-4d8b-87de-2e7ee31c972e tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] 10.222.0.43 "GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715" status: 200 len: 1874 microversion: 2.32 time: 0.481512 Oct 04 18:47:20.039792 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1778/3800] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:47:19 2022] GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715 => generated 1874 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:47:20.265652 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-b35c5ccc-52b3-49d4-b648-a6e3df559831 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:20.266655 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-b35c5ccc-52b3-49d4-b648-a6e3df559831 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] [instance: 5f6ad9ae-93d7-4774-aadf-b1fbbadc224c] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:20.275058 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b35c5ccc-52b3-49d4-b648-a6e3df559831 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:20.276111 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b35c5ccc-52b3-49d4-b648-a6e3df559831 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:20.276851 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b35c5ccc-52b3-49d4-b648-a6e3df559831 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:20.277974 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b35c5ccc-52b3-49d4-b648-a6e3df559831 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:20.279307 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b35c5ccc-52b3-49d4-b648-a6e3df559831 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:20.281649 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b35c5ccc-52b3-49d4-b648-a6e3df559831 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:20.503571 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-adc76335-6f4a-40f3-acc0-873b6162e774 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:20.504492 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-adc76335-6f4a-40f3-acc0-873b6162e774 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] [instance: 4c82269a-db15-463d-a48b-0ca4ff3c1a71] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:20.512245 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-adc76335-6f4a-40f3-acc0-873b6162e774 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:20.513078 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-adc76335-6f4a-40f3-acc0-873b6162e774 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:20.513728 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-adc76335-6f4a-40f3-acc0-873b6162e774 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:20.514607 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-adc76335-6f4a-40f3-acc0-873b6162e774 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:20.515251 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-adc76335-6f4a-40f3-acc0-873b6162e774 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:20.516413 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-adc76335-6f4a-40f3-acc0-873b6162e774 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:20.558957 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-b35c5ccc-52b3-49d4-b648-a6e3df559831 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcbf2b4b95743af9e6fa1be54554baa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab4da2b9b9f4c7a9c25b7edaab3027d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:20.573373 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-b35c5ccc-52b3-49d4-b648-a6e3df559831 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] 10.222.0.43 "GET /compute/v2.1/servers/5f6ad9ae-93d7-4774-aadf-b1fbbadc224c" status: 200 len: 1538 microversion: 2.1 time: 0.311069 Oct 04 18:47:20.576467 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2023/3801] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:20 2022] GET /compute/v2.1/servers/5f6ad9ae-93d7-4774-aadf-b1fbbadc224c => generated 1538 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:47:20.591642 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-d5f6284f-3b9e-4328-a475-81407108566b tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:20.592277 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-d5f6284f-3b9e-4328-a475-81407108566b tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] [instance: fd09cc9b-d9dd-4133-8665-eeb6d8f51df8] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:20.611170 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d5f6284f-3b9e-4328-a475-81407108566b tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:20.612333 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d5f6284f-3b9e-4328-a475-81407108566b tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:20.616282 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d5f6284f-3b9e-4328-a475-81407108566b tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:20.618155 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d5f6284f-3b9e-4328-a475-81407108566b tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:20.618681 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d5f6284f-3b9e-4328-a475-81407108566b tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:20.619215 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d5f6284f-3b9e-4328-a475-81407108566b tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:20.836877 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-adc76335-6f4a-40f3-acc0-873b6162e774 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c710f394164b89b16bcac2fe51c58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65037d4ea5124d749e42928032e803fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:20.851475 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-adc76335-6f4a-40f3-acc0-873b6162e774 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] 10.222.0.43 "GET /compute/v2.1/servers/4c82269a-db15-463d-a48b-0ca4ff3c1a71" status: 200 len: 1508 microversion: 2.1 time: 0.352283 Oct 04 18:47:20.852077 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1779/3802] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:20 2022] GET /compute/v2.1/servers/4c82269a-db15-463d-a48b-0ca4ff3c1a71 => generated 1508 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:47:20.877814 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-053a971d-6292-4e26-846f-93bcb1eb0073 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:20.878495 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-053a971d-6292-4e26-846f-93bcb1eb0073 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] [instance: 4c82269a-db15-463d-a48b-0ca4ff3c1a71] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:20.888386 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-053a971d-6292-4e26-846f-93bcb1eb0073 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:20.889643 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-053a971d-6292-4e26-846f-93bcb1eb0073 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:20.893621 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-053a971d-6292-4e26-846f-93bcb1eb0073 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:20.894637 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-053a971d-6292-4e26-846f-93bcb1eb0073 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:20.897613 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-053a971d-6292-4e26-846f-93bcb1eb0073 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:20.898282 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-053a971d-6292-4e26-846f-93bcb1eb0073 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:20.913642 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-d5f6284f-3b9e-4328-a475-81407108566b tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9971b5861f44c1a1da94eda0f8f02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f809b8ae704988961908bef0f3cb24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:20.931551 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-d5f6284f-3b9e-4328-a475-81407108566b tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] 10.222.0.43 "GET /compute/v2.1/servers/fd09cc9b-d9dd-4133-8665-eeb6d8f51df8" status: 200 len: 1391 microversion: 2.1 time: 0.353726 Oct 04 18:47:20.932403 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2024/3803] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:20 2022] GET /compute/v2.1/servers/fd09cc9b-d9dd-4133-8665-eeb6d8f51df8 => generated 1391 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:21.051915 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-7f302021-34a9-4a14-b822-61c058e4c854 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:21.052725 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-7f302021-34a9-4a14-b822-61c058e4c854 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] [instance: fa47906d-d394-46fe-9143-780bcd27a715] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:21.077913 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7f302021-34a9-4a14-b822-61c058e4c854 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:21.078722 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7f302021-34a9-4a14-b822-61c058e4c854 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:21.079363 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7f302021-34a9-4a14-b822-61c058e4c854 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:21.083390 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7f302021-34a9-4a14-b822-61c058e4c854 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:21.084108 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7f302021-34a9-4a14-b822-61c058e4c854 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:21.084776 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7f302021-34a9-4a14-b822-61c058e4c854 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:21.527349 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-053a971d-6292-4e26-846f-93bcb1eb0073 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c710f394164b89b16bcac2fe51c58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65037d4ea5124d749e42928032e803fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:21.541476 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-053a971d-6292-4e26-846f-93bcb1eb0073 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] 10.222.0.43 "GET /compute/v2.1/servers/4c82269a-db15-463d-a48b-0ca4ff3c1a71" status: 200 len: 1508 microversion: 2.1 time: 0.667479 Oct 04 18:47:21.545441 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1780/3804] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:20 2022] GET /compute/v2.1/servers/4c82269a-db15-463d-a48b-0ca4ff3c1a71 => generated 1508 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:21.564779 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-d25b50d2-3deb-47ec-8752-00e03b141e4a tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:47:21.567460 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-d25b50d2-3deb-47ec-8752-00e03b141e4a tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] [instance: 4c82269a-db15-463d-a48b-0ca4ff3c1a71] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:21.583466 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d25b50d2-3deb-47ec-8752-00e03b141e4a tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:21.584071 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d25b50d2-3deb-47ec-8752-00e03b141e4a tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:21.584518 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d25b50d2-3deb-47ec-8752-00e03b141e4a tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:21.585332 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d25b50d2-3deb-47ec-8752-00e03b141e4a tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:21.589897 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d25b50d2-3deb-47ec-8752-00e03b141e4a tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:21.591393 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d25b50d2-3deb-47ec-8752-00e03b141e4a tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:21.615566 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-7f302021-34a9-4a14-b822-61c058e4c854 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:21.637721 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-7f302021-34a9-4a14-b822-61c058e4c854 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:21.639526 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-7f302021-34a9-4a14-b822-61c058e4c854 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:21.640948 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-7f302021-34a9-4a14-b822-61c058e4c854 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] 10.222.0.43 "GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715" status: 200 len: 1874 microversion: 2.32 time: 0.595346 Oct 04 18:47:21.652089 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2025/3805] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:47:21 2022] GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715 => generated 1874 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:47:21.661427 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-4dc69ea0-529b-4931-ad73-1c02316d06af tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:21.661771 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-4dc69ea0-529b-4931-ad73-1c02316d06af tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] [instance: 5f6ad9ae-93d7-4774-aadf-b1fbbadc224c] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:21.678440 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4dc69ea0-529b-4931-ad73-1c02316d06af tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:21.689142 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4dc69ea0-529b-4931-ad73-1c02316d06af tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:21.689719 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4dc69ea0-529b-4931-ad73-1c02316d06af tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:21.690490 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4dc69ea0-529b-4931-ad73-1c02316d06af tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:21.690953 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4dc69ea0-529b-4931-ad73-1c02316d06af tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:21.691387 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4dc69ea0-529b-4931-ad73-1c02316d06af tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:21.732751 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-d25b50d2-3deb-47ec-8752-00e03b141e4a tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] 10.222.0.43 "PUT /compute/v2.1/servers/4c82269a-db15-463d-a48b-0ca4ff3c1a71" status: 200 len: 1080 microversion: 2.1 time: 0.172608 Oct 04 18:47:21.753626 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1781/3806] 10.222.0.43 () {60 vars in 1256 bytes} [Tue Oct 4 18:47:21 2022] PUT /compute/v2.1/servers/4c82269a-db15-463d-a48b-0ca4ff3c1a71 => generated 1080 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:47:21.760870 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-9cb86605-2617-4d7f-9225-e6b0f5bdcb98 req-c9766f0e-4978-407d-8209-e530cec5587a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd09cc9b-d9dd-4133-8665-eeb6d8f51df8", "name": "network-vif-unplugged", "status": "completed", "tag": "538a7aa2-5b2b-4b33-a253-770b58f4066e"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:47:21.771685 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-9cb86605-2617-4d7f-9225-e6b0f5bdcb98 req-c9766f0e-4978-407d-8209-e530cec5587a service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:21.772460 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-9cb86605-2617-4d7f-9225-e6b0f5bdcb98 req-c9766f0e-4978-407d-8209-e530cec5587a service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:21.773079 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-9cb86605-2617-4d7f-9225-e6b0f5bdcb98 req-c9766f0e-4978-407d-8209-e530cec5587a service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:21.795755 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-9cb86605-2617-4d7f-9225-e6b0f5bdcb98 req-c9766f0e-4978-407d-8209-e530cec5587a service nova] Creating event network-vif-unplugged:538a7aa2-5b2b-4b33-a253-770b58f4066e for instance fd09cc9b-d9dd-4133-8665-eeb6d8f51df8 on n-h1-851028-13 Oct 04 18:47:21.810511 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-9cb86605-2617-4d7f-9225-e6b0f5bdcb98 req-c9766f0e-4978-407d-8209-e530cec5587a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.053079 Oct 04 18:47:21.811508 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1782/3807] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:47:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:47:21.818141 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-5d5f12f5-e528-4f83-a123-c6ad0bf57994 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:21.820966 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-5d5f12f5-e528-4f83-a123-c6ad0bf57994 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] [instance: 4c82269a-db15-463d-a48b-0ca4ff3c1a71] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:21.827858 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:47:21.843002 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5d5f12f5-e528-4f83-a123-c6ad0bf57994 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:21.843843 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5d5f12f5-e528-4f83-a123-c6ad0bf57994 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:21.844508 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5d5f12f5-e528-4f83-a123-c6ad0bf57994 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:21.846092 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5d5f12f5-e528-4f83-a123-c6ad0bf57994 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:21.846539 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5d5f12f5-e528-4f83-a123-c6ad0bf57994 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:21.847687 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5d5f12f5-e528-4f83-a123-c6ad0bf57994 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:22.150543 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-5d5f12f5-e528-4f83-a123-c6ad0bf57994 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c710f394164b89b16bcac2fe51c58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65037d4ea5124d749e42928032e803fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:22.172100 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-4dc69ea0-529b-4931-ad73-1c02316d06af tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcbf2b4b95743af9e6fa1be54554baa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab4da2b9b9f4c7a9c25b7edaab3027d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:22.175870 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-5d5f12f5-e528-4f83-a123-c6ad0bf57994 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] 10.222.0.43 "GET /compute/v2.1/servers/4c82269a-db15-463d-a48b-0ca4ff3c1a71" status: 200 len: 1506 microversion: 2.1 time: 0.362297 Oct 04 18:47:22.186178 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-4dc69ea0-529b-4931-ad73-1c02316d06af tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] 10.222.0.43 "GET /compute/v2.1/servers/5f6ad9ae-93d7-4774-aadf-b1fbbadc224c" status: 200 len: 1520 microversion: 2.1 time: 0.535502 Oct 04 18:47:22.187754 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2026/3809] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:21 2022] GET /compute/v2.1/servers/5f6ad9ae-93d7-4774-aadf-b1fbbadc224c => generated 1520 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:22.189604 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1783/3809] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:21 2022] GET /compute/v2.1/servers/4c82269a-db15-463d-a48b-0ca4ff3c1a71 => generated 1506 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:22.198249 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-a360c2cb-c7d9-4bb7-b40b-7a787d832337 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:22.199024 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-a360c2cb-c7d9-4bb7-b40b-7a787d832337 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] [instance: fd09cc9b-d9dd-4133-8665-eeb6d8f51df8] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:22.205423 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a360c2cb-c7d9-4bb7-b40b-7a787d832337 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:22.206041 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a360c2cb-c7d9-4bb7-b40b-7a787d832337 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:22.206594 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a360c2cb-c7d9-4bb7-b40b-7a787d832337 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:22.207410 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a360c2cb-c7d9-4bb7-b40b-7a787d832337 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:22.207988 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a360c2cb-c7d9-4bb7-b40b-7a787d832337 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:22.208524 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a360c2cb-c7d9-4bb7-b40b-7a787d832337 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:22.223749 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-8897095e-079c-4baa-85f3-e3cc3b8d0200 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:22.224363 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-8897095e-079c-4baa-85f3-e3cc3b8d0200 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] [instance: 4c82269a-db15-463d-a48b-0ca4ff3c1a71] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:22.233183 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8897095e-079c-4baa-85f3-e3cc3b8d0200 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:22.242218 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8897095e-079c-4baa-85f3-e3cc3b8d0200 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:22.242995 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8897095e-079c-4baa-85f3-e3cc3b8d0200 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:22.243925 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8897095e-079c-4baa-85f3-e3cc3b8d0200 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:22.244582 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8897095e-079c-4baa-85f3-e3cc3b8d0200 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:22.245228 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8897095e-079c-4baa-85f3-e3cc3b8d0200 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:22.480157 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-8897095e-079c-4baa-85f3-e3cc3b8d0200 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c710f394164b89b16bcac2fe51c58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65037d4ea5124d749e42928032e803fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:22.492138 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-8897095e-079c-4baa-85f3-e3cc3b8d0200 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] 10.222.0.43 "GET /compute/v2.1/servers/4c82269a-db15-463d-a48b-0ca4ff3c1a71" status: 200 len: 1506 microversion: 2.1 time: 0.273187 Oct 04 18:47:22.494815 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1784/3810] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:22 2022] GET /compute/v2.1/servers/4c82269a-db15-463d-a48b-0ca4ff3c1a71 => generated 1506 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:47:22.502010 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-3bfa4fee-1bc2-43b1-a986-476d78d92a08 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:22.502775 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-3bfa4fee-1bc2-43b1-a986-476d78d92a08 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] [instance: 5f6ad9ae-93d7-4774-aadf-b1fbbadc224c] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:22.510022 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3bfa4fee-1bc2-43b1-a986-476d78d92a08 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:22.510762 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3bfa4fee-1bc2-43b1-a986-476d78d92a08 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:22.511552 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3bfa4fee-1bc2-43b1-a986-476d78d92a08 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:22.512462 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3bfa4fee-1bc2-43b1-a986-476d78d92a08 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:22.513085 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3bfa4fee-1bc2-43b1-a986-476d78d92a08 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:22.513722 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3bfa4fee-1bc2-43b1-a986-476d78d92a08 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:22.556629 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-3bfa4fee-1bc2-43b1-a986-476d78d92a08 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] [instance: 5f6ad9ae-93d7-4774-aadf-b1fbbadc224c] Going to try to terminate instance {{(pid=123595) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:47:22.594503 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-a360c2cb-c7d9-4bb7-b40b-7a787d832337 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9971b5861f44c1a1da94eda0f8f02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f809b8ae704988961908bef0f3cb24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:22.609620 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-a360c2cb-c7d9-4bb7-b40b-7a787d832337 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] 10.222.0.43 "GET /compute/v2.1/servers/fd09cc9b-d9dd-4133-8665-eeb6d8f51df8" status: 200 len: 1391 microversion: 2.1 time: 0.419167 Oct 04 18:47:22.610538 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2027/3811] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:22 2022] GET /compute/v2.1/servers/fd09cc9b-d9dd-4133-8665-eeb6d8f51df8 => generated 1391 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:22.628842 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-9f904502-7fea-4436-8c2c-fe9636795a93 req-c96d24b4-61aa-43b7-b5bf-63b3253353ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f6ad9ae-93d7-4774-aadf-b1fbbadc224c", "name": "network-vif-plugged", "status": "completed", "tag": "49e89ec3-e909-4e55-83af-1707032f6599"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:47:22.659239 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-3bfa4fee-1bc2-43b1-a986-476d78d92a08 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] 10.222.0.43 "DELETE /compute/v2.1/servers/5f6ad9ae-93d7-4774-aadf-b1fbbadc224c" status: 204 len: 0 microversion: 2.1 time: 0.161008 Oct 04 18:47:22.660110 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-9f904502-7fea-4436-8c2c-fe9636795a93 req-c96d24b4-61aa-43b7-b5bf-63b3253353ce service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:22.660365 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1785/3812] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 18:47:22 2022] DELETE /compute/v2.1/servers/5f6ad9ae-93d7-4774-aadf-b1fbbadc224c => generated 0 bytes in 165 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:47:22.663939 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-9f904502-7fea-4436-8c2c-fe9636795a93 req-c96d24b4-61aa-43b7-b5bf-63b3253353ce service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:22.663939 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-9f904502-7fea-4436-8c2c-fe9636795a93 req-c96d24b4-61aa-43b7-b5bf-63b3253353ce service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:22.672661 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-8955620f-b11b-41ac-a3fd-5a1395600f08 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:47:22.676550 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-8955620f-b11b-41ac-a3fd-5a1395600f08 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] [instance: 4c82269a-db15-463d-a48b-0ca4ff3c1a71] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:22.685180 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8955620f-b11b-41ac-a3fd-5a1395600f08 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:22.685180 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8955620f-b11b-41ac-a3fd-5a1395600f08 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:22.685180 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8955620f-b11b-41ac-a3fd-5a1395600f08 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:22.686617 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8955620f-b11b-41ac-a3fd-5a1395600f08 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:22.687096 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8955620f-b11b-41ac-a3fd-5a1395600f08 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:22.687599 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8955620f-b11b-41ac-a3fd-5a1395600f08 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:22.707089 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-9f904502-7fea-4436-8c2c-fe9636795a93 req-c96d24b4-61aa-43b7-b5bf-63b3253353ce service nova] Creating event network-vif-plugged:49e89ec3-e909-4e55-83af-1707032f6599 for instance 5f6ad9ae-93d7-4774-aadf-b1fbbadc224c on n-h2-851028-13 Oct 04 18:47:22.720073 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-9f904502-7fea-4436-8c2c-fe9636795a93 req-c96d24b4-61aa-43b7-b5bf-63b3253353ce service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099584 Oct 04 18:47:22.721336 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2028/3813] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:47:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:47:22.729005 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-3a588c22-4672-4ccf-86f8-7d5ab9334043 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:22.732045 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-3a588c22-4672-4ccf-86f8-7d5ab9334043 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] [instance: d7f06829-6beb-4d35-ab81-c99f9dd3027d] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:22.743414 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3a588c22-4672-4ccf-86f8-7d5ab9334043 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:22.748152 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3a588c22-4672-4ccf-86f8-7d5ab9334043 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:22.748928 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3a588c22-4672-4ccf-86f8-7d5ab9334043 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:22.749732 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3a588c22-4672-4ccf-86f8-7d5ab9334043 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:22.750209 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3a588c22-4672-4ccf-86f8-7d5ab9334043 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:22.750646 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3a588c22-4672-4ccf-86f8-7d5ab9334043 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:22.772164 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-8955620f-b11b-41ac-a3fd-5a1395600f08 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] 10.222.0.43 "PUT /compute/v2.1/servers/4c82269a-db15-463d-a48b-0ca4ff3c1a71" status: 200 len: 1082 microversion: 2.1 time: 0.104525 Oct 04 18:47:22.785339 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1786/3814] 10.222.0.43 () {60 vars in 1256 bytes} [Tue Oct 4 18:47:22 2022] PUT /compute/v2.1/servers/4c82269a-db15-463d-a48b-0ca4ff3c1a71 => generated 1082 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:22.785339 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-962833a6-4f2a-46ab-aa00-9bb3dbc0b27a tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:22.785339 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-962833a6-4f2a-46ab-aa00-9bb3dbc0b27a tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] [instance: fa47906d-d394-46fe-9143-780bcd27a715] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:22.802287 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-962833a6-4f2a-46ab-aa00-9bb3dbc0b27a tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:22.802796 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-962833a6-4f2a-46ab-aa00-9bb3dbc0b27a tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:22.803238 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-962833a6-4f2a-46ab-aa00-9bb3dbc0b27a tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:22.803950 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-962833a6-4f2a-46ab-aa00-9bb3dbc0b27a tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:22.804407 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-962833a6-4f2a-46ab-aa00-9bb3dbc0b27a tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:22.805465 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-962833a6-4f2a-46ab-aa00-9bb3dbc0b27a tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:22.812087 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-3a588c22-4672-4ccf-86f8-7d5ab9334043 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] [instance: d7f06829-6beb-4d35-ab81-c99f9dd3027d] Going to try to terminate instance {{(pid=123596) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:47:22.896188 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:47:22.955714 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-3a588c22-4672-4ccf-86f8-7d5ab9334043 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] 10.222.0.43 "DELETE /compute/v2.1/servers/d7f06829-6beb-4d35-ab81-c99f9dd3027d" status: 204 len: 0 microversion: 2.1 time: 0.232404 Oct 04 18:47:22.957133 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2029/3815] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 18:47:22 2022] DELETE /compute/v2.1/servers/d7f06829-6beb-4d35-ab81-c99f9dd3027d => generated 0 bytes in 235 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:47:22.964906 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-56587dc5-26ac-4d3a-9530-03d50f822adc tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:22.968185 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-56587dc5-26ac-4d3a-9530-03d50f822adc tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] [instance: 5f6ad9ae-93d7-4774-aadf-b1fbbadc224c] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:22.980220 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-56587dc5-26ac-4d3a-9530-03d50f822adc tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:22.984733 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-56587dc5-26ac-4d3a-9530-03d50f822adc tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:22.987044 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-56587dc5-26ac-4d3a-9530-03d50f822adc tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:22.988106 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-56587dc5-26ac-4d3a-9530-03d50f822adc tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:22.989727 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-56587dc5-26ac-4d3a-9530-03d50f822adc tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:22.992706 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-56587dc5-26ac-4d3a-9530-03d50f822adc tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:23.224489 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-56587dc5-26ac-4d3a-9530-03d50f822adc tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcbf2b4b95743af9e6fa1be54554baa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab4da2b9b9f4c7a9c25b7edaab3027d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:23.232431 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-56587dc5-26ac-4d3a-9530-03d50f822adc tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] 10.222.0.43 "GET /compute/v2.1/servers/5f6ad9ae-93d7-4774-aadf-b1fbbadc224c" status: 200 len: 1526 microversion: 2.1 time: 0.273274 Oct 04 18:47:23.233914 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2030/3816] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:22 2022] GET /compute/v2.1/servers/5f6ad9ae-93d7-4774-aadf-b1fbbadc224c => generated 1526 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:23.238252 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f06c671f-762a-4aef-bf4d-e4bdf1a79ca7 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:47:23.240647 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-f06c671f-762a-4aef-bf4d-e4bdf1a79ca7 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 82b86465-afb0-49ef-9932-1538010c1ae5] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:23.246386 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-962833a6-4f2a-46ab-aa00-9bb3dbc0b27a tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:23.253485 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f06c671f-762a-4aef-bf4d-e4bdf1a79ca7 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:23.253989 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f06c671f-762a-4aef-bf4d-e4bdf1a79ca7 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:23.254436 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f06c671f-762a-4aef-bf4d-e4bdf1a79ca7 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:23.255185 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f06c671f-762a-4aef-bf4d-e4bdf1a79ca7 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:23.255650 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f06c671f-762a-4aef-bf4d-e4bdf1a79ca7 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:23.256084 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f06c671f-762a-4aef-bf4d-e4bdf1a79ca7 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:23.256847 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-962833a6-4f2a-46ab-aa00-9bb3dbc0b27a tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:23.258431 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-962833a6-4f2a-46ab-aa00-9bb3dbc0b27a tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:23.260275 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-962833a6-4f2a-46ab-aa00-9bb3dbc0b27a tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] 10.222.0.43 "GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715" status: 200 len: 2826 microversion: 2.32 time: 0.483247 Oct 04 18:47:23.261096 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1787/3817] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:47:22 2022] GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715 => generated 2826 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:47:23.266002 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-1fd7aef5-1a6b-44c5-93e4-e1ab40c14fc8 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:23.266906 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-1fd7aef5-1a6b-44c5-93e4-e1ab40c14fc8 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] [instance: 4c82269a-db15-463d-a48b-0ca4ff3c1a71] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:23.274537 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1fd7aef5-1a6b-44c5-93e4-e1ab40c14fc8 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:23.275347 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1fd7aef5-1a6b-44c5-93e4-e1ab40c14fc8 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:23.275951 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1fd7aef5-1a6b-44c5-93e4-e1ab40c14fc8 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:23.277154 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1fd7aef5-1a6b-44c5-93e4-e1ab40c14fc8 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:23.277804 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1fd7aef5-1a6b-44c5-93e4-e1ab40c14fc8 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:23.278473 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1fd7aef5-1a6b-44c5-93e4-e1ab40c14fc8 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:23.369628 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-f06c671f-762a-4aef-bf4d-e4bdf1a79ca7 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "POST /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5/action" status: 202 len: 0 microversion: 2.1 time: 0.134727 Oct 04 18:47:23.370159 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2031/3818] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 18:47:23 2022] POST /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5/action => generated 0 bytes in 136 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:47:23.375516 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-881f7a1f-f735-4bbc-95ad-709281aaef30 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:23.376289 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-881f7a1f-f735-4bbc-95ad-709281aaef30 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] [instance: d7f06829-6beb-4d35-ab81-c99f9dd3027d] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:23.383918 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-881f7a1f-f735-4bbc-95ad-709281aaef30 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:23.384411 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-881f7a1f-f735-4bbc-95ad-709281aaef30 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:23.384859 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-881f7a1f-f735-4bbc-95ad-709281aaef30 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:23.385672 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-881f7a1f-f735-4bbc-95ad-709281aaef30 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:23.386127 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-881f7a1f-f735-4bbc-95ad-709281aaef30 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:23.386560 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-881f7a1f-f735-4bbc-95ad-709281aaef30 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:23.536515 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-881f7a1f-f735-4bbc-95ad-709281aaef30 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96e7480de94c43909045ac1087e40cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6bd34bf5540ee95c8144f185eb22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:23.543430 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-1fd7aef5-1a6b-44c5-93e4-e1ab40c14fc8 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c710f394164b89b16bcac2fe51c58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65037d4ea5124d749e42928032e803fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:23.545462 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-881f7a1f-f735-4bbc-95ad-709281aaef30 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] 10.222.0.43 "GET /compute/v2.1/servers/d7f06829-6beb-4d35-ab81-c99f9dd3027d" status: 200 len: 1506 microversion: 2.1 time: 0.173758 Oct 04 18:47:23.553650 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-1fd7aef5-1a6b-44c5-93e4-e1ab40c14fc8 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] 10.222.0.43 "GET /compute/v2.1/servers/4c82269a-db15-463d-a48b-0ca4ff3c1a71" status: 200 len: 1508 microversion: 2.1 time: 0.291011 Oct 04 18:47:23.565174 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2032/3819] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:23 2022] GET /compute/v2.1/servers/d7f06829-6beb-4d35-ab81-c99f9dd3027d => generated 1506 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:23.572471 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-888e10a3-1c2f-4ffc-b1aa-32150e094873 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:23.572471 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-888e10a3-1c2f-4ffc-b1aa-32150e094873 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] [instance: fa47906d-d394-46fe-9143-780bcd27a715] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:23.574838 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1788/3820] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:23 2022] GET /compute/v2.1/servers/4c82269a-db15-463d-a48b-0ca4ff3c1a71 => generated 1508 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:23.581654 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-1f8d4c06-4ed4-4952-bbff-688ec868efd4 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:23.582404 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-1f8d4c06-4ed4-4952-bbff-688ec868efd4 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 82b86465-afb0-49ef-9932-1538010c1ae5] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:23.583508 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-888e10a3-1c2f-4ffc-b1aa-32150e094873 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:23.584188 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-888e10a3-1c2f-4ffc-b1aa-32150e094873 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:23.584974 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-888e10a3-1c2f-4ffc-b1aa-32150e094873 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:23.586001 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-888e10a3-1c2f-4ffc-b1aa-32150e094873 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:23.586987 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-888e10a3-1c2f-4ffc-b1aa-32150e094873 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:23.587871 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-888e10a3-1c2f-4ffc-b1aa-32150e094873 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:23.589938 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1f8d4c06-4ed4-4952-bbff-688ec868efd4 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:23.590912 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1f8d4c06-4ed4-4952-bbff-688ec868efd4 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:23.591273 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1f8d4c06-4ed4-4952-bbff-688ec868efd4 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:23.591881 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1f8d4c06-4ed4-4952-bbff-688ec868efd4 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:23.592460 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1f8d4c06-4ed4-4952-bbff-688ec868efd4 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:23.592991 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1f8d4c06-4ed4-4952-bbff-688ec868efd4 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:23.718898 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-888e10a3-1c2f-4ffc-b1aa-32150e094873 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] 10.222.0.43 "GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715/os-interface" status: 200 len: 1832 microversion: 2.32 time: 0.158720 Oct 04 18:47:23.719680 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2033/3821] 10.222.0.43 () {60 vars in 1316 bytes} [Tue Oct 4 18:47:23 2022] GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715/os-interface => generated 1832 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:47:23.725398 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-75e7b714-bd69-44e2-a598-a36313c93826 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:23.726017 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-75e7b714-bd69-44e2-a598-a36313c93826 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] [instance: 4c82269a-db15-463d-a48b-0ca4ff3c1a71] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:23.733488 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-75e7b714-bd69-44e2-a598-a36313c93826 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:23.734244 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-75e7b714-bd69-44e2-a598-a36313c93826 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:23.734864 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-75e7b714-bd69-44e2-a598-a36313c93826 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:23.735760 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-75e7b714-bd69-44e2-a598-a36313c93826 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:23.736897 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-75e7b714-bd69-44e2-a598-a36313c93826 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:23.737899 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-75e7b714-bd69-44e2-a598-a36313c93826 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:23.836028 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-1f8d4c06-4ed4-4952-bbff-688ec868efd4 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:23.848371 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-1f8d4c06-4ed4-4952-bbff-688ec868efd4 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5" status: 200 len: 1669 microversion: 2.1 time: 0.272291 Oct 04 18:47:23.850364 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1789/3822] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:23 2022] GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5 => generated 1669 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:23.857671 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-cb2d61a2-6898-466f-88e8-c6fcbeafa419 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:23.858642 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-cb2d61a2-6898-466f-88e8-c6fcbeafa419 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] [instance: fd09cc9b-d9dd-4133-8665-eeb6d8f51df8] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:23.870951 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cb2d61a2-6898-466f-88e8-c6fcbeafa419 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:23.871902 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cb2d61a2-6898-466f-88e8-c6fcbeafa419 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:23.873258 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cb2d61a2-6898-466f-88e8-c6fcbeafa419 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:23.874725 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cb2d61a2-6898-466f-88e8-c6fcbeafa419 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:23.875780 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cb2d61a2-6898-466f-88e8-c6fcbeafa419 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:23.876611 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cb2d61a2-6898-466f-88e8-c6fcbeafa419 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:24.066028 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-75e7b714-bd69-44e2-a598-a36313c93826 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c710f394164b89b16bcac2fe51c58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65037d4ea5124d749e42928032e803fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:24.074932 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-75e7b714-bd69-44e2-a598-a36313c93826 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] 10.222.0.43 "GET /compute/v2.1/servers/4c82269a-db15-463d-a48b-0ca4ff3c1a71" status: 200 len: 1508 microversion: 2.1 time: 0.353433 Oct 04 18:47:24.075668 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2034/3823] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:23 2022] GET /compute/v2.1/servers/4c82269a-db15-463d-a48b-0ca4ff3c1a71 => generated 1508 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:24.081726 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-7a93c4c7-847e-4a02-8b46-44a3bcd5e041 req-e85f7b3a-7361-4212-9d0c-8ff7509ba080 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd09cc9b-d9dd-4133-8665-eeb6d8f51df8", "tag": "538a7aa2-5b2b-4b33-a253-770b58f4066e"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:47:24.102334 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-7a93c4c7-847e-4a02-8b46-44a3bcd5e041 req-e85f7b3a-7361-4212-9d0c-8ff7509ba080 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:24.103426 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-7a93c4c7-847e-4a02-8b46-44a3bcd5e041 req-e85f7b3a-7361-4212-9d0c-8ff7509ba080 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:24.104630 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-7a93c4c7-847e-4a02-8b46-44a3bcd5e041 req-e85f7b3a-7361-4212-9d0c-8ff7509ba080 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:24.107762 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-cb2d61a2-6898-466f-88e8-c6fcbeafa419 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9971b5861f44c1a1da94eda0f8f02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f809b8ae704988961908bef0f3cb24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:24.120212 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-7a93c4c7-847e-4a02-8b46-44a3bcd5e041 req-e85f7b3a-7361-4212-9d0c-8ff7509ba080 service nova] Creating event network-changed:538a7aa2-5b2b-4b33-a253-770b58f4066e for instance fd09cc9b-d9dd-4133-8665-eeb6d8f51df8 on n-h1-851028-13 Oct 04 18:47:24.124174 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-cb2d61a2-6898-466f-88e8-c6fcbeafa419 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] 10.222.0.43 "GET /compute/v2.1/servers/fd09cc9b-d9dd-4133-8665-eeb6d8f51df8" status: 200 len: 1391 microversion: 2.1 time: 0.270160 Oct 04 18:47:24.124854 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1790/3824] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:23 2022] GET /compute/v2.1/servers/fd09cc9b-d9dd-4133-8665-eeb6d8f51df8 => generated 1391 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:24.135724 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-73a8cdc7-71bd-447d-b7a3-20c50ff2f426 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:24.137889 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-73a8cdc7-71bd-447d-b7a3-20c50ff2f426 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] [instance: 4c82269a-db15-463d-a48b-0ca4ff3c1a71] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:24.143916 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-7a93c4c7-847e-4a02-8b46-44a3bcd5e041 req-e85f7b3a-7361-4212-9d0c-8ff7509ba080 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066422 Oct 04 18:47:24.145258 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2035/3825] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:47:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:47:24.151035 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-73a8cdc7-71bd-447d-b7a3-20c50ff2f426 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:24.151788 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-73a8cdc7-71bd-447d-b7a3-20c50ff2f426 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:24.152395 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-73a8cdc7-71bd-447d-b7a3-20c50ff2f426 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:24.153621 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-73a8cdc7-71bd-447d-b7a3-20c50ff2f426 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:24.154253 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-73a8cdc7-71bd-447d-b7a3-20c50ff2f426 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:24.154852 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-73a8cdc7-71bd-447d-b7a3-20c50ff2f426 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:24.188479 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-73a8cdc7-71bd-447d-b7a3-20c50ff2f426 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] [instance: 4c82269a-db15-463d-a48b-0ca4ff3c1a71] Going to try to terminate instance {{(pid=123595) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:47:24.192851 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:47:24.257355 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-179eebe3-1695-474d-a8d4-8ef0ea3325ae tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:24.258924 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-179eebe3-1695-474d-a8d4-8ef0ea3325ae tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] [instance: 5f6ad9ae-93d7-4774-aadf-b1fbbadc224c] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:24.267967 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-179eebe3-1695-474d-a8d4-8ef0ea3325ae tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:24.268582 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-179eebe3-1695-474d-a8d4-8ef0ea3325ae tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:24.269150 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-179eebe3-1695-474d-a8d4-8ef0ea3325ae tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:24.269991 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-179eebe3-1695-474d-a8d4-8ef0ea3325ae tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:24.270560 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-179eebe3-1695-474d-a8d4-8ef0ea3325ae tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:24.271153 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-179eebe3-1695-474d-a8d4-8ef0ea3325ae tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:24.316729 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-73a8cdc7-71bd-447d-b7a3-20c50ff2f426 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] 10.222.0.43 "DELETE /compute/v2.1/servers/4c82269a-db15-463d-a48b-0ca4ff3c1a71" status: 204 len: 0 microversion: 2.1 time: 0.190262 Oct 04 18:47:24.317660 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1791/3826] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 18:47:24 2022] DELETE /compute/v2.1/servers/4c82269a-db15-463d-a48b-0ca4ff3c1a71 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:47:24.331236 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-e485da17-9ebd-41fb-89ac-da3fbb2f4d99 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:24.332154 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-e485da17-9ebd-41fb-89ac-da3fbb2f4d99 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] [instance: 4c82269a-db15-463d-a48b-0ca4ff3c1a71] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:24.338875 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e485da17-9ebd-41fb-89ac-da3fbb2f4d99 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:24.339631 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e485da17-9ebd-41fb-89ac-da3fbb2f4d99 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:24.340246 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e485da17-9ebd-41fb-89ac-da3fbb2f4d99 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:24.341174 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e485da17-9ebd-41fb-89ac-da3fbb2f4d99 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:24.341821 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e485da17-9ebd-41fb-89ac-da3fbb2f4d99 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:24.342414 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e485da17-9ebd-41fb-89ac-da3fbb2f4d99 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:24.373274 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-e485da17-9ebd-41fb-89ac-da3fbb2f4d99 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] [instance: 4c82269a-db15-463d-a48b-0ca4ff3c1a71] Going to try to terminate instance {{(pid=123595) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:47:24.426387 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.compute.api [None req-e485da17-9ebd-41fb-89ac-da3fbb2f4d99 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] [instance: 4c82269a-db15-463d-a48b-0ca4ff3c1a71] Instance is already in deleting state, ignoring this request Oct 04 18:47:24.427338 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-e485da17-9ebd-41fb-89ac-da3fbb2f4d99 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] 10.222.0.43 "DELETE /compute/v2.1/servers/4c82269a-db15-463d-a48b-0ca4ff3c1a71" status: 204 len: 0 microversion: 2.1 time: 0.100625 Oct 04 18:47:24.428202 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1792/3827] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 18:47:24 2022] DELETE /compute/v2.1/servers/4c82269a-db15-463d-a48b-0ca4ff3c1a71 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:47:24.437031 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-a47dbaa8-31ef-4933-aad9-e43d314900ca tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:24.437691 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-a47dbaa8-31ef-4933-aad9-e43d314900ca tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] [instance: 4c82269a-db15-463d-a48b-0ca4ff3c1a71] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:24.444464 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a47dbaa8-31ef-4933-aad9-e43d314900ca tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:24.444879 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a47dbaa8-31ef-4933-aad9-e43d314900ca tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:24.445357 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a47dbaa8-31ef-4933-aad9-e43d314900ca tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:24.446069 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a47dbaa8-31ef-4933-aad9-e43d314900ca tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:24.446525 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a47dbaa8-31ef-4933-aad9-e43d314900ca tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:24.446954 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a47dbaa8-31ef-4933-aad9-e43d314900ca tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:24.636937 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-179eebe3-1695-474d-a8d4-8ef0ea3325ae tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcbf2b4b95743af9e6fa1be54554baa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab4da2b9b9f4c7a9c25b7edaab3027d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:24.647088 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-179eebe3-1695-474d-a8d4-8ef0ea3325ae tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] 10.222.0.43 "GET /compute/v2.1/servers/5f6ad9ae-93d7-4774-aadf-b1fbbadc224c" status: 200 len: 1526 microversion: 2.1 time: 0.394686 Oct 04 18:47:24.647996 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2036/3828] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:24 2022] GET /compute/v2.1/servers/5f6ad9ae-93d7-4774-aadf-b1fbbadc224c => generated 1526 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:47:24.653716 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-4357cd80-55bb-4a48-a2cb-e204e59201b0 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:24.654562 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-4357cd80-55bb-4a48-a2cb-e204e59201b0 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] [instance: d7f06829-6beb-4d35-ab81-c99f9dd3027d] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:24.661828 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4357cd80-55bb-4a48-a2cb-e204e59201b0 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:24.662572 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4357cd80-55bb-4a48-a2cb-e204e59201b0 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:24.663231 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4357cd80-55bb-4a48-a2cb-e204e59201b0 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:24.664126 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4357cd80-55bb-4a48-a2cb-e204e59201b0 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:24.664758 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4357cd80-55bb-4a48-a2cb-e204e59201b0 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:24.665397 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4357cd80-55bb-4a48-a2cb-e204e59201b0 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:24.769282 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-a47dbaa8-31ef-4933-aad9-e43d314900ca tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c710f394164b89b16bcac2fe51c58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65037d4ea5124d749e42928032e803fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:24.778414 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-a47dbaa8-31ef-4933-aad9-e43d314900ca tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] 10.222.0.43 "GET /compute/v2.1/servers/4c82269a-db15-463d-a48b-0ca4ff3c1a71" status: 200 len: 1514 microversion: 2.1 time: 0.345935 Oct 04 18:47:24.781552 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1793/3829] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:24 2022] GET /compute/v2.1/servers/4c82269a-db15-463d-a48b-0ca4ff3c1a71 => generated 1514 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:47:24.788060 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-45292b07-9784-467c-8479-9bd902a3f3c8 req-d8d535ce-db52-40c3-be20-7d4f30f86925 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f6ad9ae-93d7-4774-aadf-b1fbbadc224c", "name": "network-vif-unplugged", "status": "completed", "tag": "49e89ec3-e909-4e55-83af-1707032f6599"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:47:24.801756 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-45292b07-9784-467c-8479-9bd902a3f3c8 req-d8d535ce-db52-40c3-be20-7d4f30f86925 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:24.801756 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-45292b07-9784-467c-8479-9bd902a3f3c8 req-d8d535ce-db52-40c3-be20-7d4f30f86925 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:24.802402 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-45292b07-9784-467c-8479-9bd902a3f3c8 req-d8d535ce-db52-40c3-be20-7d4f30f86925 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:24.817557 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-45292b07-9784-467c-8479-9bd902a3f3c8 req-d8d535ce-db52-40c3-be20-7d4f30f86925 service nova] Creating event network-vif-unplugged:49e89ec3-e909-4e55-83af-1707032f6599 for instance 5f6ad9ae-93d7-4774-aadf-b1fbbadc224c on n-h2-851028-13 Oct 04 18:47:24.822848 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-45292b07-9784-467c-8479-9bd902a3f3c8 req-d8d535ce-db52-40c3-be20-7d4f30f86925 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039656 Oct 04 18:47:24.824458 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1794/3830] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:47:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:47:24.878957 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-16fa0ce8-180c-4b7d-9323-954690c7424d tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:24.879676 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-16fa0ce8-180c-4b7d-9323-954690c7424d tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 82b86465-afb0-49ef-9932-1538010c1ae5] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:24.886768 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-16fa0ce8-180c-4b7d-9323-954690c7424d tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:24.887276 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-16fa0ce8-180c-4b7d-9323-954690c7424d tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:24.887781 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-16fa0ce8-180c-4b7d-9323-954690c7424d tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:24.888563 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-16fa0ce8-180c-4b7d-9323-954690c7424d tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:24.889031 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-16fa0ce8-180c-4b7d-9323-954690c7424d tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:24.889692 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-16fa0ce8-180c-4b7d-9323-954690c7424d tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:25.175421 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-4357cd80-55bb-4a48-a2cb-e204e59201b0 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96e7480de94c43909045ac1087e40cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6bd34bf5540ee95c8144f185eb22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:25.184093 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-4357cd80-55bb-4a48-a2cb-e204e59201b0 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] 10.222.0.43 "GET /compute/v2.1/servers/d7f06829-6beb-4d35-ab81-c99f9dd3027d" status: 200 len: 1506 microversion: 2.1 time: 0.534840 Oct 04 18:47:25.185383 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2037/3831] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:24 2022] GET /compute/v2.1/servers/d7f06829-6beb-4d35-ab81-c99f9dd3027d => generated 1506 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:25.190347 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-247c2281-6097-4b36-aab7-6d853d0a24aa tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:25.191066 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-247c2281-6097-4b36-aab7-6d853d0a24aa tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] [instance: fd09cc9b-d9dd-4133-8665-eeb6d8f51df8] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:25.197513 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-247c2281-6097-4b36-aab7-6d853d0a24aa tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:25.198081 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-247c2281-6097-4b36-aab7-6d853d0a24aa tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:25.198595 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-247c2281-6097-4b36-aab7-6d853d0a24aa tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:25.199371 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-247c2281-6097-4b36-aab7-6d853d0a24aa tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:25.199898 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-247c2281-6097-4b36-aab7-6d853d0a24aa tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:25.200418 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-247c2281-6097-4b36-aab7-6d853d0a24aa tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:25.331599 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-16fa0ce8-180c-4b7d-9323-954690c7424d tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:25.342309 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-16fa0ce8-180c-4b7d-9323-954690c7424d tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5" status: 200 len: 1669 microversion: 2.1 time: 0.468707 Oct 04 18:47:25.343256 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1795/3832] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:24 2022] GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5 => generated 1669 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:25.455219 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-247c2281-6097-4b36-aab7-6d853d0a24aa tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9971b5861f44c1a1da94eda0f8f02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f809b8ae704988961908bef0f3cb24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:25.464855 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-247c2281-6097-4b36-aab7-6d853d0a24aa tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] 10.222.0.43 "GET /compute/v2.1/servers/fd09cc9b-d9dd-4133-8665-eeb6d8f51df8" status: 200 len: 1391 microversion: 2.1 time: 0.278188 Oct 04 18:47:25.465867 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2038/3833] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:25 2022] GET /compute/v2.1/servers/fd09cc9b-d9dd-4133-8665-eeb6d8f51df8 => generated 1391 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:25.675846 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f1e2722e-e8ae-4acf-90b8-9b9fcc476adc tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:25.676927 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-f1e2722e-e8ae-4acf-90b8-9b9fcc476adc tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] [instance: 5f6ad9ae-93d7-4774-aadf-b1fbbadc224c] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:25.695312 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f1e2722e-e8ae-4acf-90b8-9b9fcc476adc tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:25.704987 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f1e2722e-e8ae-4acf-90b8-9b9fcc476adc tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:25.705759 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f1e2722e-e8ae-4acf-90b8-9b9fcc476adc tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:25.707059 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f1e2722e-e8ae-4acf-90b8-9b9fcc476adc tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:25.716094 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f1e2722e-e8ae-4acf-90b8-9b9fcc476adc tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:25.716738 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f1e2722e-e8ae-4acf-90b8-9b9fcc476adc tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:25.755816 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-3d5c3dc9-1c9c-427b-bf98-861f80878ef7 req-6a5f1c31-43f0-430d-9d20-c9204740e090 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa47906d-d394-46fe-9143-780bcd27a715", "tag": "4dedaa7a-5245-4fee-80eb-d2092ad95c1e"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:47:25.774529 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-3d5c3dc9-1c9c-427b-bf98-861f80878ef7 req-6a5f1c31-43f0-430d-9d20-c9204740e090 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:25.775758 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-3d5c3dc9-1c9c-427b-bf98-861f80878ef7 req-6a5f1c31-43f0-430d-9d20-c9204740e090 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:25.776399 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-3d5c3dc9-1c9c-427b-bf98-861f80878ef7 req-6a5f1c31-43f0-430d-9d20-c9204740e090 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:25.799393 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-3d5c3dc9-1c9c-427b-bf98-861f80878ef7 req-6a5f1c31-43f0-430d-9d20-c9204740e090 service nova] Creating event network-changed:4dedaa7a-5245-4fee-80eb-d2092ad95c1e for instance fa47906d-d394-46fe-9143-780bcd27a715 on n-h1-851028-13 Oct 04 18:47:25.814762 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-3d5c3dc9-1c9c-427b-bf98-861f80878ef7 req-6a5f1c31-43f0-430d-9d20-c9204740e090 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.188681 Oct 04 18:47:25.815385 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1796/3834] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:47:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:47:25.820766 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-c91cae93-1fde-48d8-b27d-aae58c1e8426 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:25.829795 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-c91cae93-1fde-48d8-b27d-aae58c1e8426 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] [instance: 4c82269a-db15-463d-a48b-0ca4ff3c1a71] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:25.843348 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c91cae93-1fde-48d8-b27d-aae58c1e8426 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:25.844070 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c91cae93-1fde-48d8-b27d-aae58c1e8426 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:25.844724 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c91cae93-1fde-48d8-b27d-aae58c1e8426 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:25.845644 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c91cae93-1fde-48d8-b27d-aae58c1e8426 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:25.846298 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c91cae93-1fde-48d8-b27d-aae58c1e8426 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:25.847485 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c91cae93-1fde-48d8-b27d-aae58c1e8426 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:25.952416 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-f1e2722e-e8ae-4acf-90b8-9b9fcc476adc tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcbf2b4b95743af9e6fa1be54554baa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab4da2b9b9f4c7a9c25b7edaab3027d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:25.961439 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-f1e2722e-e8ae-4acf-90b8-9b9fcc476adc tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] 10.222.0.43 "GET /compute/v2.1/servers/5f6ad9ae-93d7-4774-aadf-b1fbbadc224c" status: 200 len: 1526 microversion: 2.1 time: 0.289882 Oct 04 18:47:25.962694 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2039/3835] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:25 2022] GET /compute/v2.1/servers/5f6ad9ae-93d7-4774-aadf-b1fbbadc224c => generated 1526 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:26.108184 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-c91cae93-1fde-48d8-b27d-aae58c1e8426 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c710f394164b89b16bcac2fe51c58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65037d4ea5124d749e42928032e803fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:26.123139 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-c91cae93-1fde-48d8-b27d-aae58c1e8426 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] 10.222.0.43 "GET /compute/v2.1/servers/4c82269a-db15-463d-a48b-0ca4ff3c1a71" status: 200 len: 1514 microversion: 2.1 time: 0.303544 Oct 04 18:47:26.124137 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1797/3836] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:25 2022] GET /compute/v2.1/servers/4c82269a-db15-463d-a48b-0ca4ff3c1a71 => generated 1514 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:26.208601 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-5aea67ed-3d99-46aa-b1e0-319aa2ea35af tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:26.209286 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-5aea67ed-3d99-46aa-b1e0-319aa2ea35af tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] [instance: d7f06829-6beb-4d35-ab81-c99f9dd3027d] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:26.212242 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:47:26.229384 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5aea67ed-3d99-46aa-b1e0-319aa2ea35af tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:26.230897 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5aea67ed-3d99-46aa-b1e0-319aa2ea35af tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:26.231367 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5aea67ed-3d99-46aa-b1e0-319aa2ea35af tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:26.232136 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5aea67ed-3d99-46aa-b1e0-319aa2ea35af tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:26.232623 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5aea67ed-3d99-46aa-b1e0-319aa2ea35af tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:26.233062 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5aea67ed-3d99-46aa-b1e0-319aa2ea35af tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:26.374084 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-015f95e6-8329-4ea6-b5cd-e2a8d3610c34 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:26.380621 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-015f95e6-8329-4ea6-b5cd-e2a8d3610c34 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 82b86465-afb0-49ef-9932-1538010c1ae5] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:26.397219 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-015f95e6-8329-4ea6-b5cd-e2a8d3610c34 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:26.397761 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-015f95e6-8329-4ea6-b5cd-e2a8d3610c34 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:26.398211 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-015f95e6-8329-4ea6-b5cd-e2a8d3610c34 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:26.398940 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-015f95e6-8329-4ea6-b5cd-e2a8d3610c34 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:26.414436 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-015f95e6-8329-4ea6-b5cd-e2a8d3610c34 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:26.414436 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-015f95e6-8329-4ea6-b5cd-e2a8d3610c34 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:26.469811 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-5aea67ed-3d99-46aa-b1e0-319aa2ea35af tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96e7480de94c43909045ac1087e40cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6bd34bf5540ee95c8144f185eb22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:26.478642 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-5aea67ed-3d99-46aa-b1e0-319aa2ea35af tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] 10.222.0.43 "GET /compute/v2.1/servers/d7f06829-6beb-4d35-ab81-c99f9dd3027d" status: 200 len: 1506 microversion: 2.1 time: 0.274500 Oct 04 18:47:26.491287 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2040/3837] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:26 2022] GET /compute/v2.1/servers/d7f06829-6beb-4d35-ab81-c99f9dd3027d => generated 1506 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:26.503497 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-5b4e8d84-8011-40ee-917e-24224e69ac5f tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:26.504338 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-5b4e8d84-8011-40ee-917e-24224e69ac5f tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] [instance: fd09cc9b-d9dd-4133-8665-eeb6d8f51df8] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:26.513435 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5b4e8d84-8011-40ee-917e-24224e69ac5f tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:26.513932 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5b4e8d84-8011-40ee-917e-24224e69ac5f tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:26.514377 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5b4e8d84-8011-40ee-917e-24224e69ac5f tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:26.515089 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5b4e8d84-8011-40ee-917e-24224e69ac5f tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:26.516105 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5b4e8d84-8011-40ee-917e-24224e69ac5f tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:26.516553 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5b4e8d84-8011-40ee-917e-24224e69ac5f tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:26.701721 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-5b4e8d84-8011-40ee-917e-24224e69ac5f tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9971b5861f44c1a1da94eda0f8f02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f809b8ae704988961908bef0f3cb24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:26.710833 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-5b4e8d84-8011-40ee-917e-24224e69ac5f tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] 10.222.0.43 "GET /compute/v2.1/servers/fd09cc9b-d9dd-4133-8665-eeb6d8f51df8" status: 200 len: 1391 microversion: 2.1 time: 0.212293 Oct 04 18:47:26.711758 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2041/3838] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:26 2022] GET /compute/v2.1/servers/fd09cc9b-d9dd-4133-8665-eeb6d8f51df8 => generated 1391 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:26.981467 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-015f95e6-8329-4ea6-b5cd-e2a8d3610c34 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:26.991270 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-015f95e6-8329-4ea6-b5cd-e2a8d3610c34 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5" status: 200 len: 1669 microversion: 2.1 time: 0.621073 Oct 04 18:47:26.992398 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-16b05461-db76-4fc8-8b8b-cfd63435c6d4 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:26.992960 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-16b05461-db76-4fc8-8b8b-cfd63435c6d4 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] [instance: 5f6ad9ae-93d7-4774-aadf-b1fbbadc224c] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:26.996710 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1798/3839] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:26 2022] GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5 => generated 1669 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:27.018431 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-16b05461-db76-4fc8-8b8b-cfd63435c6d4 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:27.021333 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-16b05461-db76-4fc8-8b8b-cfd63435c6d4 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:27.021891 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-16b05461-db76-4fc8-8b8b-cfd63435c6d4 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:27.022704 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-16b05461-db76-4fc8-8b8b-cfd63435c6d4 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:27.026453 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-16b05461-db76-4fc8-8b8b-cfd63435c6d4 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:27.027863 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-16b05461-db76-4fc8-8b8b-cfd63435c6d4 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:27.151091 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-8f5028f9-a8fe-4fb5-a498-cdd23c17fc74 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:27.152935 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-8f5028f9-a8fe-4fb5-a498-cdd23c17fc74 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] [instance: 4c82269a-db15-463d-a48b-0ca4ff3c1a71] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:27.168438 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8f5028f9-a8fe-4fb5-a498-cdd23c17fc74 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:27.170344 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8f5028f9-a8fe-4fb5-a498-cdd23c17fc74 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:27.171807 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8f5028f9-a8fe-4fb5-a498-cdd23c17fc74 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:27.173538 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8f5028f9-a8fe-4fb5-a498-cdd23c17fc74 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:27.176181 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8f5028f9-a8fe-4fb5-a498-cdd23c17fc74 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:27.177146 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8f5028f9-a8fe-4fb5-a498-cdd23c17fc74 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:27.596170 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-16b05461-db76-4fc8-8b8b-cfd63435c6d4 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcbf2b4b95743af9e6fa1be54554baa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab4da2b9b9f4c7a9c25b7edaab3027d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:27.611134 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-16b05461-db76-4fc8-8b8b-cfd63435c6d4 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] 10.222.0.43 "GET /compute/v2.1/servers/5f6ad9ae-93d7-4774-aadf-b1fbbadc224c" status: 200 len: 1526 microversion: 2.1 time: 0.626723 Oct 04 18:47:27.631210 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2042/3840] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:26 2022] GET /compute/v2.1/servers/5f6ad9ae-93d7-4774-aadf-b1fbbadc224c => generated 1526 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:27.647848 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-d96e4d36-2331-4767-9255-65290b19c1d4 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:27.648801 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-d96e4d36-2331-4767-9255-65290b19c1d4 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] [instance: d7f06829-6beb-4d35-ab81-c99f9dd3027d] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:27.663605 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d96e4d36-2331-4767-9255-65290b19c1d4 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:27.664434 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d96e4d36-2331-4767-9255-65290b19c1d4 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:27.665079 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d96e4d36-2331-4767-9255-65290b19c1d4 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:27.668123 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d96e4d36-2331-4767-9255-65290b19c1d4 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:27.668849 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d96e4d36-2331-4767-9255-65290b19c1d4 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:27.669490 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d96e4d36-2331-4767-9255-65290b19c1d4 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:28.053591 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-d96e4d36-2331-4767-9255-65290b19c1d4 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96e7480de94c43909045ac1087e40cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6bd34bf5540ee95c8144f185eb22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:28.081056 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-d96e4d36-2331-4767-9255-65290b19c1d4 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] 10.222.0.43 "GET /compute/v2.1/servers/d7f06829-6beb-4d35-ab81-c99f9dd3027d" status: 200 len: 1506 microversion: 2.1 time: 0.448328 Oct 04 18:47:28.082467 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2043/3841] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:27 2022] GET /compute/v2.1/servers/d7f06829-6beb-4d35-ab81-c99f9dd3027d => generated 1506 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:28.089375 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-1da230ff-4283-4e6a-9e05-a448ec86d470 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:28.090217 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-1da230ff-4283-4e6a-9e05-a448ec86d470 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] [instance: fd09cc9b-d9dd-4133-8665-eeb6d8f51df8] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:28.097442 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1da230ff-4283-4e6a-9e05-a448ec86d470 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:28.098378 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1da230ff-4283-4e6a-9e05-a448ec86d470 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:28.099022 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1da230ff-4283-4e6a-9e05-a448ec86d470 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:28.099908 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1da230ff-4283-4e6a-9e05-a448ec86d470 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:28.100545 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1da230ff-4283-4e6a-9e05-a448ec86d470 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:28.101171 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1da230ff-4283-4e6a-9e05-a448ec86d470 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:28.461737 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-8f5028f9-a8fe-4fb5-a498-cdd23c17fc74 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c710f394164b89b16bcac2fe51c58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65037d4ea5124d749e42928032e803fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:28.471510 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-8f5028f9-a8fe-4fb5-a498-cdd23c17fc74 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] 10.222.0.43 "GET /compute/v2.1/servers/4c82269a-db15-463d-a48b-0ca4ff3c1a71" status: 200 len: 1514 microversion: 2.1 time: 1.327030 Oct 04 18:47:28.488558 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-1da230ff-4283-4e6a-9e05-a448ec86d470 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9971b5861f44c1a1da94eda0f8f02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f809b8ae704988961908bef0f3cb24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:28.490077 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1799/3842] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:27 2022] GET /compute/v2.1/servers/4c82269a-db15-463d-a48b-0ca4ff3c1a71 => generated 1514 bytes in 1346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:28.500583 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-1da230ff-4283-4e6a-9e05-a448ec86d470 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] 10.222.0.43 "GET /compute/v2.1/servers/fd09cc9b-d9dd-4133-8665-eeb6d8f51df8" status: 200 len: 1391 microversion: 2.1 time: 0.416270 Oct 04 18:47:28.501625 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2044/3843] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:28 2022] GET /compute/v2.1/servers/fd09cc9b-d9dd-4133-8665-eeb6d8f51df8 => generated 1391 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:28.507541 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-f4863cbe-095c-42cc-acd1-c10e5c990006 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:28.508366 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-f4863cbe-095c-42cc-acd1-c10e5c990006 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 82b86465-afb0-49ef-9932-1538010c1ae5] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:28.530303 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f4863cbe-095c-42cc-acd1-c10e5c990006 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:28.531385 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f4863cbe-095c-42cc-acd1-c10e5c990006 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:28.532111 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f4863cbe-095c-42cc-acd1-c10e5c990006 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:28.533395 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f4863cbe-095c-42cc-acd1-c10e5c990006 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:28.534160 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f4863cbe-095c-42cc-acd1-c10e5c990006 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:28.535210 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f4863cbe-095c-42cc-acd1-c10e5c990006 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:28.642353 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f9d496f6-195e-4497-a51c-31a238d9da3d tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:28.643252 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-f9d496f6-195e-4497-a51c-31a238d9da3d tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] [instance: 5f6ad9ae-93d7-4774-aadf-b1fbbadc224c] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:28.658910 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f9d496f6-195e-4497-a51c-31a238d9da3d tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:28.660379 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f9d496f6-195e-4497-a51c-31a238d9da3d tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:28.671146 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f9d496f6-195e-4497-a51c-31a238d9da3d tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:28.673075 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f9d496f6-195e-4497-a51c-31a238d9da3d tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:28.673828 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f9d496f6-195e-4497-a51c-31a238d9da3d tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:28.674560 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f9d496f6-195e-4497-a51c-31a238d9da3d tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:29.238855 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-f4863cbe-095c-42cc-acd1-c10e5c990006 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:29.251538 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-f4863cbe-095c-42cc-acd1-c10e5c990006 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5" status: 200 len: 1669 microversion: 2.1 time: 0.759948 Oct 04 18:47:29.270392 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1800/3844] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:28 2022] GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5 => generated 1669 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:29.280856 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-f9d496f6-195e-4497-a51c-31a238d9da3d tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcbf2b4b95743af9e6fa1be54554baa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab4da2b9b9f4c7a9c25b7edaab3027d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:29.290494 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-413107f7-e50f-4c04-ae02-26095d6b9ca4 req-9fdbad3e-3ce2-494c-9274-e3850ef97891 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c82269a-db15-463d-a48b-0ca4ff3c1a71", "name": "network-vif-deleted", "tag": "0878c18a-2642-414b-96de-4698dafde40e"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:47:29.295647 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-f9d496f6-195e-4497-a51c-31a238d9da3d tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] 10.222.0.43 "GET /compute/v2.1/servers/5f6ad9ae-93d7-4774-aadf-b1fbbadc224c" status: 200 len: 1526 microversion: 2.1 time: 0.657395 Oct 04 18:47:29.303624 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2045/3845] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:28 2022] GET /compute/v2.1/servers/5f6ad9ae-93d7-4774-aadf-b1fbbadc224c => generated 1526 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:29.310964 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-b66b98e5-487b-4a53-8f9a-185fba9f9971 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:29.312079 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-b66b98e5-487b-4a53-8f9a-185fba9f9971 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] [instance: d7f06829-6beb-4d35-ab81-c99f9dd3027d] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:29.320996 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b66b98e5-487b-4a53-8f9a-185fba9f9971 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:29.321914 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b66b98e5-487b-4a53-8f9a-185fba9f9971 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:29.322555 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b66b98e5-487b-4a53-8f9a-185fba9f9971 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:29.323635 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b66b98e5-487b-4a53-8f9a-185fba9f9971 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:29.324332 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b66b98e5-487b-4a53-8f9a-185fba9f9971 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:29.324553 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-413107f7-e50f-4c04-ae02-26095d6b9ca4 req-9fdbad3e-3ce2-494c-9274-e3850ef97891 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:29.325043 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-413107f7-e50f-4c04-ae02-26095d6b9ca4 req-9fdbad3e-3ce2-494c-9274-e3850ef97891 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:29.325351 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b66b98e5-487b-4a53-8f9a-185fba9f9971 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:29.325487 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-413107f7-e50f-4c04-ae02-26095d6b9ca4 req-9fdbad3e-3ce2-494c-9274-e3850ef97891 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:29.332570 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:47:29.366166 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-413107f7-e50f-4c04-ae02-26095d6b9ca4 req-9fdbad3e-3ce2-494c-9274-e3850ef97891 service nova] Creating event network-vif-deleted:0878c18a-2642-414b-96de-4698dafde40e for instance 4c82269a-db15-463d-a48b-0ca4ff3c1a71 on n-h2-851028-13 Oct 04 18:47:29.375556 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-413107f7-e50f-4c04-ae02-26095d6b9ca4 req-9fdbad3e-3ce2-494c-9274-e3850ef97891 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103386 Oct 04 18:47:29.376426 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1801/3846] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:47:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:47:29.496403 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-140dd3c1-9bc8-43c3-9ea0-f948057e8a09 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:29.497504 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-140dd3c1-9bc8-43c3-9ea0-f948057e8a09 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] [instance: 4c82269a-db15-463d-a48b-0ca4ff3c1a71] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:29.511560 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-140dd3c1-9bc8-43c3-9ea0-f948057e8a09 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:29.514107 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-140dd3c1-9bc8-43c3-9ea0-f948057e8a09 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:29.516523 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-140dd3c1-9bc8-43c3-9ea0-f948057e8a09 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:29.518900 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-140dd3c1-9bc8-43c3-9ea0-f948057e8a09 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:29.521408 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-140dd3c1-9bc8-43c3-9ea0-f948057e8a09 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:29.523551 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-140dd3c1-9bc8-43c3-9ea0-f948057e8a09 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:29.582777 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-140dd3c1-9bc8-43c3-9ea0-f948057e8a09 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:29.583986 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-140dd3c1-9bc8-43c3-9ea0-f948057e8a09 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:29.584694 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-140dd3c1-9bc8-43c3-9ea0-f948057e8a09 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:29.585412 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.objects.instance [None req-140dd3c1-9bc8-43c3-9ea0-f948057e8a09 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lazy-loading 'fault' on Instance uuid 4c82269a-db15-463d-a48b-0ca4ff3c1a71 {{(pid=123595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:47:29.737173 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-140dd3c1-9bc8-43c3-9ea0-f948057e8a09 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c710f394164b89b16bcac2fe51c58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65037d4ea5124d749e42928032e803fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:29.752471 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-140dd3c1-9bc8-43c3-9ea0-f948057e8a09 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] 10.222.0.43 "GET /compute/v2.1/servers/4c82269a-db15-463d-a48b-0ca4ff3c1a71" status: 200 len: 1307 microversion: 2.1 time: 0.260788 Oct 04 18:47:29.766168 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1802/3847] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:29 2022] GET /compute/v2.1/servers/4c82269a-db15-463d-a48b-0ca4ff3c1a71 => generated 1307 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:47:29.776335 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-d961f9fc-668c-46a4-b34d-3eb8e8e424b3 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:29.777337 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-d961f9fc-668c-46a4-b34d-3eb8e8e424b3 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] [instance: fd09cc9b-d9dd-4133-8665-eeb6d8f51df8] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:29.784451 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d961f9fc-668c-46a4-b34d-3eb8e8e424b3 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:29.785292 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d961f9fc-668c-46a4-b34d-3eb8e8e424b3 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:29.785925 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d961f9fc-668c-46a4-b34d-3eb8e8e424b3 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:29.786994 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d961f9fc-668c-46a4-b34d-3eb8e8e424b3 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:29.787628 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d961f9fc-668c-46a4-b34d-3eb8e8e424b3 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:29.788480 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d961f9fc-668c-46a4-b34d-3eb8e8e424b3 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:30.299307 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-b66b98e5-487b-4a53-8f9a-185fba9f9971 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96e7480de94c43909045ac1087e40cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6bd34bf5540ee95c8144f185eb22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:30.310332 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-b66b98e5-487b-4a53-8f9a-185fba9f9971 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] 10.222.0.43 "GET /compute/v2.1/servers/d7f06829-6beb-4d35-ab81-c99f9dd3027d" status: 200 len: 1506 microversion: 2.1 time: 1.005096 Oct 04 18:47:30.313641 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2046/3848] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:29 2022] GET /compute/v2.1/servers/d7f06829-6beb-4d35-ab81-c99f9dd3027d => generated 1506 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:30.322390 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-52ca1b9e-78bc-42de-9c7d-db0308098cc2 req-00704239-9531-4bb2-a278-e8334df03762 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7f06829-6beb-4d35-ab81-c99f9dd3027d", "name": "network-vif-deleted", "tag": "2735d07e-0a18-4de8-a88d-c4f6ed3f9244"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:47:30.361868 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-52ca1b9e-78bc-42de-9c7d-db0308098cc2 req-00704239-9531-4bb2-a278-e8334df03762 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:30.362624 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-52ca1b9e-78bc-42de-9c7d-db0308098cc2 req-00704239-9531-4bb2-a278-e8334df03762 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:30.363435 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-52ca1b9e-78bc-42de-9c7d-db0308098cc2 req-00704239-9531-4bb2-a278-e8334df03762 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:30.387568 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-52ca1b9e-78bc-42de-9c7d-db0308098cc2 req-00704239-9531-4bb2-a278-e8334df03762 service nova] Creating event network-vif-deleted:2735d07e-0a18-4de8-a88d-c4f6ed3f9244 for instance d7f06829-6beb-4d35-ab81-c99f9dd3027d on n-h1-851028-13 Oct 04 18:47:30.394704 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-52ca1b9e-78bc-42de-9c7d-db0308098cc2 req-00704239-9531-4bb2-a278-e8334df03762 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078188 Oct 04 18:47:30.397355 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2047/3849] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:47:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:47:30.415321 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-5cb29e31-b1af-48b4-8fcd-a974657a861e tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:30.416594 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-5cb29e31-b1af-48b4-8fcd-a974657a861e tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 82b86465-afb0-49ef-9932-1538010c1ae5] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:30.471782 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5cb29e31-b1af-48b4-8fcd-a974657a861e tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:30.483947 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5cb29e31-b1af-48b4-8fcd-a974657a861e tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:30.484608 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5cb29e31-b1af-48b4-8fcd-a974657a861e tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:30.492710 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5cb29e31-b1af-48b4-8fcd-a974657a861e tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:30.513935 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5cb29e31-b1af-48b4-8fcd-a974657a861e tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:30.524906 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-d961f9fc-668c-46a4-b34d-3eb8e8e424b3 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9971b5861f44c1a1da94eda0f8f02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f809b8ae704988961908bef0f3cb24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:30.529614 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5cb29e31-b1af-48b4-8fcd-a974657a861e tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:30.541381 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-d961f9fc-668c-46a4-b34d-3eb8e8e424b3 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] 10.222.0.43 "GET /compute/v2.1/servers/fd09cc9b-d9dd-4133-8665-eeb6d8f51df8" status: 200 len: 1391 microversion: 2.1 time: 0.769684 Oct 04 18:47:30.544403 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1803/3850] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:29 2022] GET /compute/v2.1/servers/fd09cc9b-d9dd-4133-8665-eeb6d8f51df8 => generated 1391 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:30.550362 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-332eaaa6-3ac3-47e7-88e8-2d2ffba32550 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:30.558214 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-332eaaa6-3ac3-47e7-88e8-2d2ffba32550 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] [instance: 5f6ad9ae-93d7-4774-aadf-b1fbbadc224c] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:30.572564 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-332eaaa6-3ac3-47e7-88e8-2d2ffba32550 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:30.573374 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-332eaaa6-3ac3-47e7-88e8-2d2ffba32550 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:30.574065 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-332eaaa6-3ac3-47e7-88e8-2d2ffba32550 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:30.576651 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-332eaaa6-3ac3-47e7-88e8-2d2ffba32550 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:30.577267 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-332eaaa6-3ac3-47e7-88e8-2d2ffba32550 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:30.579443 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-332eaaa6-3ac3-47e7-88e8-2d2ffba32550 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:30.694382 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-332eaaa6-3ac3-47e7-88e8-2d2ffba32550 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcbf2b4b95743af9e6fa1be54554baa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab4da2b9b9f4c7a9c25b7edaab3027d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:30.702617 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-332eaaa6-3ac3-47e7-88e8-2d2ffba32550 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] 10.222.0.43 "GET /compute/v2.1/servers/5f6ad9ae-93d7-4774-aadf-b1fbbadc224c" status: 200 len: 1309 microversion: 2.1 time: 0.156062 Oct 04 18:47:30.703479 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1804/3851] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:30 2022] GET /compute/v2.1/servers/5f6ad9ae-93d7-4774-aadf-b1fbbadc224c => generated 1309 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:30.783928 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-1bae6668-7a63-4e7d-b1d0-aa2cdfa7ea50 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:30.784821 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-1bae6668-7a63-4e7d-b1d0-aa2cdfa7ea50 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] [instance: 4c82269a-db15-463d-a48b-0ca4ff3c1a71] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:30.796831 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1bae6668-7a63-4e7d-b1d0-aa2cdfa7ea50 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:30.799287 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1bae6668-7a63-4e7d-b1d0-aa2cdfa7ea50 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:30.800293 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1bae6668-7a63-4e7d-b1d0-aa2cdfa7ea50 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:30.803543 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1bae6668-7a63-4e7d-b1d0-aa2cdfa7ea50 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:30.804213 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1bae6668-7a63-4e7d-b1d0-aa2cdfa7ea50 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:30.807948 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1bae6668-7a63-4e7d-b1d0-aa2cdfa7ea50 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:30.844831 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-1bae6668-7a63-4e7d-b1d0-aa2cdfa7ea50 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] HTTP exception thrown: Instance 4c82269a-db15-463d-a48b-0ca4ff3c1a71 could not be found. Oct 04 18:47:30.846895 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-1bae6668-7a63-4e7d-b1d0-aa2cdfa7ea50 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Request method failure captured: Oct 04 18:47:30.846895 n-d-851028-13 devstack@n-api.service[123595]: request: GET /compute/v2.1/servers/4c82269a-db15-463d-a48b-0ca4ff3c1a71 HTTP/1.1 Oct 04 18:47:30.846895 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 18:47:30.846895 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 18:47:30.846895 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 18:47:30.846895 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 0 Oct 04 18:47:30.846895 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 18:47:30.846895 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 18:47:30.846895 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 18:47:30.846895 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 18:47:30.846895 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPH8N3JICoSxI2g1StM6bobUrrKHcS2dLGwh62NiwRXgJpjOASIjz8Wug0T58uNg3Qg3AaujMM95jbfyoFeNLtDDxaEz0xr9u024HLNJ9XUSq3IwruOt2smUT5qkZI-wReGz1w70gH7PBpXU6RUKRXRIFYaFOyMEXares4l6o7GTixeM Oct 04 18:47:30.846895 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 18:47:30.846895 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 18:47:30.846895 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 18:47:30.846895 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 18:47:30.846895 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 18:47:30.846895 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 18:47:30.846895 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: 65037d4ea5124d749e42928032e803fd Oct 04 18:47:30.846895 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-ServerDiskConfigTestJSON-2135995142 Oct 04 18:47:30.846895 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 18:47:30.846895 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 18:47:30.846895 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/65037d4ea5124d749e42928032e803fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_65037d4ea5124d749e42928032e803fd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/65037d4ea5124d749e42928032e803fd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/65037d4ea5124d749e42928032e803fd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:47:30.846895 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-ServerDiskConfigTestJSON-2135995142 Oct 04 18:47:30.846895 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: 65037d4ea5124d749e42928032e803fd Oct 04 18:47:30.846895 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-2135995142 Oct 04 18:47:30.846895 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-ServerDiskConfigTestJSON-2135995142-project Oct 04 18:47:30.846895 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 18:47:30.846895 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 18:47:30.846895 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: d2c710f394164b89b16bcac2fe51c58a Oct 04 18:47:30.846895 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-ServerDiskConfigTestJSON-2135995142-project Oct 04 18:47:30.846895 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 18:47:30.846895 n-d-851028-13 devstack@n-api.service[123595]: exception: Instance 4c82269a-db15-463d-a48b-0ca4ff3c1a71 could not be found. Oct 04 18:47:30.846895 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': '4c82269a-db15-463d-a48b-0ca4ff3c1a71'} Oct 04 18:47:30.846895 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:47:30.846895 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:47:30.846895 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:47:30.846895 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:47:30.846895 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:47:30.846895 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:47:30.846895 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:47:30.846895 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:47:30.846895 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:47:30.846895 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:47:30.846895 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c82269a-db15-463d-a48b-0ca4ff3c1a71 could not be found. Oct 04 18:47:30.846895 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:47:30.846895 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:47:30.846895 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:47:30.846895 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:47:30.846895 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:47:30.846895 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:47:30.846895 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:47:30.846895 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:47:30.846895 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:47:30.846895 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:47:30.846895 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:47:30.846895 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:47:30.846895 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:47:30.846895 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:47:30.846895 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:47:30.846895 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:47:30.846895 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c82269a-db15-463d-a48b-0ca4ff3c1a71 could not be found. Oct 04 18:47:30.846895 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:47:30.846895 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:47:30.846895 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:47:30.852845 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:47:30.852845 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:47:30.852845 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:47:30.852845 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:47:30.852845 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:47:30.852845 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c82269a-db15-463d-a48b-0ca4ff3c1a71 could not be found. Oct 04 18:47:30.852845 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:47:30.855000 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-1bae6668-7a63-4e7d-b1d0-aa2cdfa7ea50 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Returning 404 to user: Instance 4c82269a-db15-463d-a48b-0ca4ff3c1a71 could not be found. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:47:30.856106 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-1bae6668-7a63-4e7d-b1d0-aa2cdfa7ea50 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] 10.222.0.43 "GET /compute/v2.1/servers/4c82269a-db15-463d-a48b-0ca4ff3c1a71" status: 404 len: 111 microversion: 2.1 time: 0.077832 Oct 04 18:47:30.857221 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1805/3852] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:30 2022] GET /compute/v2.1/servers/4c82269a-db15-463d-a48b-0ca4ff3c1a71 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:47:30.873842 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-5b92c199-601a-4f7a-9895-e910b7899230 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:30.874690 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-5b92c199-601a-4f7a-9895-e910b7899230 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] [instance: 00c17e4b-c80e-463e-a3e9-486c118552be] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:30.884017 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5b92c199-601a-4f7a-9895-e910b7899230 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:30.884857 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5b92c199-601a-4f7a-9895-e910b7899230 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:30.885514 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5b92c199-601a-4f7a-9895-e910b7899230 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:30.886509 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5b92c199-601a-4f7a-9895-e910b7899230 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:30.887227 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5b92c199-601a-4f7a-9895-e910b7899230 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:30.889648 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5b92c199-601a-4f7a-9895-e910b7899230 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:30.923461 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-5b92c199-601a-4f7a-9895-e910b7899230 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] HTTP exception thrown: Instance 00c17e4b-c80e-463e-a3e9-486c118552be could not be found. Oct 04 18:47:30.927237 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-5b92c199-601a-4f7a-9895-e910b7899230 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Request method failure captured: Oct 04 18:47:30.927237 n-d-851028-13 devstack@n-api.service[123595]: request: DELETE /compute/v2.1/servers/00c17e4b-c80e-463e-a3e9-486c118552be HTTP/1.1 Oct 04 18:47:30.927237 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 18:47:30.927237 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 18:47:30.927237 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 18:47:30.927237 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 0 Oct 04 18:47:30.927237 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 18:47:30.927237 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 18:47:30.927237 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 18:47:30.927237 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 18:47:30.927237 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPH8N3JICoSxI2g1StM6bobUrrKHcS2dLGwh62NiwRXgJpjOASIjz8Wug0T58uNg3Qg3AaujMM95jbfyoFeNLtDDxaEz0xr9u024HLNJ9XUSq3IwruOt2smUT5qkZI-wReGz1w70gH7PBpXU6RUKRXRIFYaFOyMEXares4l6o7GTixeM Oct 04 18:47:30.927237 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 18:47:30.927237 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 18:47:30.927237 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 18:47:30.927237 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 18:47:30.927237 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 18:47:30.927237 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 18:47:30.927237 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: 65037d4ea5124d749e42928032e803fd Oct 04 18:47:30.927237 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-ServerDiskConfigTestJSON-2135995142 Oct 04 18:47:30.927237 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 18:47:30.927237 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 18:47:30.927237 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/65037d4ea5124d749e42928032e803fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_65037d4ea5124d749e42928032e803fd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/65037d4ea5124d749e42928032e803fd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/65037d4ea5124d749e42928032e803fd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:47:30.927237 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-ServerDiskConfigTestJSON-2135995142 Oct 04 18:47:30.927237 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: 65037d4ea5124d749e42928032e803fd Oct 04 18:47:30.927237 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-2135995142 Oct 04 18:47:30.927237 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-ServerDiskConfigTestJSON-2135995142-project Oct 04 18:47:30.927237 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 18:47:30.927237 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 18:47:30.927237 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: d2c710f394164b89b16bcac2fe51c58a Oct 04 18:47:30.927237 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-ServerDiskConfigTestJSON-2135995142-project Oct 04 18:47:30.927237 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 18:47:30.927237 n-d-851028-13 devstack@n-api.service[123595]: exception: Instance 00c17e4b-c80e-463e-a3e9-486c118552be could not be found. Oct 04 18:47:30.927237 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': '00c17e4b-c80e-463e-a3e9-486c118552be'} Oct 04 18:47:30.927237 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:47:30.927237 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:47:30.927237 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:47:30.927237 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:47:30.927237 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:47:30.927237 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:47:30.927237 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:47:30.927237 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:47:30.927237 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:47:30.927237 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:47:30.927237 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00c17e4b-c80e-463e-a3e9-486c118552be could not be found. Oct 04 18:47:30.927237 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:47:30.927237 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:47:30.927237 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:47:30.927237 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:47:30.927237 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:47:30.927237 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:47:30.927237 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:47:30.927237 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:47:30.927237 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:47:30.927237 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:47:30.927237 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:47:30.927237 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:47:30.927237 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:47:30.927237 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:47:30.927237 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:47:30.927237 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:47:30.927237 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:47:30.927237 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:47:30.933229 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00c17e4b-c80e-463e-a3e9-486c118552be could not be found. Oct 04 18:47:30.933229 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:47:30.933229 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:47:30.933229 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:47:30.933229 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:47:30.933229 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:47:30.933229 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:47:30.933229 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:47:30.933229 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:47:30.933229 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00c17e4b-c80e-463e-a3e9-486c118552be could not be found. Oct 04 18:47:30.933229 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:47:30.935497 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-5b92c199-601a-4f7a-9895-e910b7899230 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Returning 404 to user: Instance 00c17e4b-c80e-463e-a3e9-486c118552be could not be found. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:47:30.938418 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-5b92c199-601a-4f7a-9895-e910b7899230 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] 10.222.0.43 "DELETE /compute/v2.1/servers/00c17e4b-c80e-463e-a3e9-486c118552be" status: 404 len: 111 microversion: 2.1 time: 0.075239 Oct 04 18:47:30.939470 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1806/3853] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 18:47:30 2022] DELETE /compute/v2.1/servers/00c17e4b-c80e-463e-a3e9-486c118552be => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:47:30.950939 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-0c6cf8cb-faea-4956-a385-de8313404043 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:30.951803 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-0c6cf8cb-faea-4956-a385-de8313404043 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] [instance: 00c17e4b-c80e-463e-a3e9-486c118552be] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:30.963102 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0c6cf8cb-faea-4956-a385-de8313404043 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:30.964128 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0c6cf8cb-faea-4956-a385-de8313404043 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:30.964893 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0c6cf8cb-faea-4956-a385-de8313404043 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:30.966345 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0c6cf8cb-faea-4956-a385-de8313404043 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:30.967050 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0c6cf8cb-faea-4956-a385-de8313404043 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:30.967681 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0c6cf8cb-faea-4956-a385-de8313404043 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:30.994979 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-0c6cf8cb-faea-4956-a385-de8313404043 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] HTTP exception thrown: Instance 00c17e4b-c80e-463e-a3e9-486c118552be could not be found. Oct 04 18:47:30.998185 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-0c6cf8cb-faea-4956-a385-de8313404043 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Request method failure captured: Oct 04 18:47:30.998185 n-d-851028-13 devstack@n-api.service[123595]: request: GET /compute/v2.1/servers/00c17e4b-c80e-463e-a3e9-486c118552be HTTP/1.1 Oct 04 18:47:30.998185 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 18:47:30.998185 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 18:47:30.998185 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 18:47:30.998185 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 0 Oct 04 18:47:30.998185 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 18:47:30.998185 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 18:47:30.998185 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 18:47:30.998185 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 18:47:30.998185 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPH8N3JICoSxI2g1StM6bobUrrKHcS2dLGwh62NiwRXgJpjOASIjz8Wug0T58uNg3Qg3AaujMM95jbfyoFeNLtDDxaEz0xr9u024HLNJ9XUSq3IwruOt2smUT5qkZI-wReGz1w70gH7PBpXU6RUKRXRIFYaFOyMEXares4l6o7GTixeM Oct 04 18:47:30.998185 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 18:47:30.998185 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 18:47:30.998185 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 18:47:30.998185 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 18:47:30.998185 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 18:47:30.998185 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 18:47:30.998185 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: 65037d4ea5124d749e42928032e803fd Oct 04 18:47:30.998185 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-ServerDiskConfigTestJSON-2135995142 Oct 04 18:47:30.998185 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 18:47:30.998185 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 18:47:30.998185 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/65037d4ea5124d749e42928032e803fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_65037d4ea5124d749e42928032e803fd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/65037d4ea5124d749e42928032e803fd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/65037d4ea5124d749e42928032e803fd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:47:30.998185 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-ServerDiskConfigTestJSON-2135995142 Oct 04 18:47:30.998185 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: 65037d4ea5124d749e42928032e803fd Oct 04 18:47:30.998185 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-2135995142 Oct 04 18:47:30.998185 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-ServerDiskConfigTestJSON-2135995142-project Oct 04 18:47:30.998185 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 18:47:30.998185 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 18:47:30.998185 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: d2c710f394164b89b16bcac2fe51c58a Oct 04 18:47:30.998185 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-ServerDiskConfigTestJSON-2135995142-project Oct 04 18:47:30.998185 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 18:47:30.998185 n-d-851028-13 devstack@n-api.service[123595]: exception: Instance 00c17e4b-c80e-463e-a3e9-486c118552be could not be found. Oct 04 18:47:30.998185 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': '00c17e4b-c80e-463e-a3e9-486c118552be'} Oct 04 18:47:30.998185 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:47:30.998185 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:47:30.998185 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:47:30.998185 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:47:30.998185 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:47:30.998185 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:47:30.998185 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:47:30.998185 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:47:30.998185 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:47:30.998185 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:47:30.998185 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00c17e4b-c80e-463e-a3e9-486c118552be could not be found. Oct 04 18:47:30.998185 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:47:30.998185 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:47:30.998185 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:47:30.998185 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:47:30.998185 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:47:30.998185 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:47:30.998185 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:47:30.998185 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:47:30.998185 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:47:30.998185 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:47:30.998185 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:47:30.998185 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:47:30.998185 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:47:30.998185 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:47:30.998185 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:47:30.998185 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:47:30.998185 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00c17e4b-c80e-463e-a3e9-486c118552be could not be found. Oct 04 18:47:30.998185 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:47:30.998185 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:47:30.998185 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:47:31.006425 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:47:31.006425 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:47:31.006425 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:47:31.006425 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:47:31.006425 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:47:31.006425 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00c17e4b-c80e-463e-a3e9-486c118552be could not be found. Oct 04 18:47:31.006425 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:47:31.009760 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-0c6cf8cb-faea-4956-a385-de8313404043 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Returning 404 to user: Instance 00c17e4b-c80e-463e-a3e9-486c118552be could not be found. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:47:31.011030 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-0c6cf8cb-faea-4956-a385-de8313404043 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] 10.222.0.43 "GET /compute/v2.1/servers/00c17e4b-c80e-463e-a3e9-486c118552be" status: 404 len: 111 microversion: 2.1 time: 0.067666 Oct 04 18:47:31.012148 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1807/3854] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:30 2022] GET /compute/v2.1/servers/00c17e4b-c80e-463e-a3e9-486c118552be => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:47:31.020941 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-bcb1c971-5379-4c0c-80f6-14ec862748a4 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:31.021791 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-bcb1c971-5379-4c0c-80f6-14ec862748a4 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] [instance: b28a95a5-c6c2-4781-8c1a-62e7d3eac5a7] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:31.029430 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bcb1c971-5379-4c0c-80f6-14ec862748a4 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:31.029932 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bcb1c971-5379-4c0c-80f6-14ec862748a4 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:31.030459 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bcb1c971-5379-4c0c-80f6-14ec862748a4 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:31.031352 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bcb1c971-5379-4c0c-80f6-14ec862748a4 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:31.032069 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bcb1c971-5379-4c0c-80f6-14ec862748a4 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:31.032514 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bcb1c971-5379-4c0c-80f6-14ec862748a4 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:31.075472 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-bcb1c971-5379-4c0c-80f6-14ec862748a4 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] HTTP exception thrown: Instance b28a95a5-c6c2-4781-8c1a-62e7d3eac5a7 could not be found. Oct 04 18:47:31.080272 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-bcb1c971-5379-4c0c-80f6-14ec862748a4 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Request method failure captured: Oct 04 18:47:31.080272 n-d-851028-13 devstack@n-api.service[123595]: request: DELETE /compute/v2.1/servers/b28a95a5-c6c2-4781-8c1a-62e7d3eac5a7 HTTP/1.1 Oct 04 18:47:31.080272 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 18:47:31.080272 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 18:47:31.080272 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 18:47:31.080272 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 0 Oct 04 18:47:31.080272 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 18:47:31.080272 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 18:47:31.080272 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 18:47:31.080272 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 18:47:31.080272 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPH8N3JICoSxI2g1StM6bobUrrKHcS2dLGwh62NiwRXgJpjOASIjz8Wug0T58uNg3Qg3AaujMM95jbfyoFeNLtDDxaEz0xr9u024HLNJ9XUSq3IwruOt2smUT5qkZI-wReGz1w70gH7PBpXU6RUKRXRIFYaFOyMEXares4l6o7GTixeM Oct 04 18:47:31.080272 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 18:47:31.080272 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 18:47:31.080272 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 18:47:31.080272 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 18:47:31.080272 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 18:47:31.080272 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 18:47:31.080272 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: 65037d4ea5124d749e42928032e803fd Oct 04 18:47:31.080272 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-ServerDiskConfigTestJSON-2135995142 Oct 04 18:47:31.080272 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 18:47:31.080272 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 18:47:31.080272 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/65037d4ea5124d749e42928032e803fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_65037d4ea5124d749e42928032e803fd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/65037d4ea5124d749e42928032e803fd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/65037d4ea5124d749e42928032e803fd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:47:31.080272 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-ServerDiskConfigTestJSON-2135995142 Oct 04 18:47:31.080272 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: 65037d4ea5124d749e42928032e803fd Oct 04 18:47:31.080272 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-2135995142 Oct 04 18:47:31.080272 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-ServerDiskConfigTestJSON-2135995142-project Oct 04 18:47:31.080272 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 18:47:31.080272 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 18:47:31.080272 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: d2c710f394164b89b16bcac2fe51c58a Oct 04 18:47:31.080272 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-ServerDiskConfigTestJSON-2135995142-project Oct 04 18:47:31.080272 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 18:47:31.080272 n-d-851028-13 devstack@n-api.service[123595]: exception: Instance b28a95a5-c6c2-4781-8c1a-62e7d3eac5a7 could not be found. Oct 04 18:47:31.080272 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': 'b28a95a5-c6c2-4781-8c1a-62e7d3eac5a7'} Oct 04 18:47:31.080272 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:47:31.080272 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:47:31.080272 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:47:31.080272 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:47:31.080272 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:47:31.080272 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:47:31.080272 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:47:31.080272 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:47:31.080272 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:47:31.080272 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:47:31.080272 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b28a95a5-c6c2-4781-8c1a-62e7d3eac5a7 could not be found. Oct 04 18:47:31.080272 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:47:31.080272 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:47:31.080272 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:47:31.080272 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:47:31.080272 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:47:31.080272 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:47:31.080272 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:47:31.080272 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:47:31.080272 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:47:31.080272 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:47:31.080272 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:47:31.080272 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:47:31.080272 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:47:31.080272 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:47:31.080272 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:47:31.080272 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:47:31.080272 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:47:31.080272 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:47:31.087265 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b28a95a5-c6c2-4781-8c1a-62e7d3eac5a7 could not be found. Oct 04 18:47:31.087265 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:47:31.087265 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:47:31.087265 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:47:31.087265 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:47:31.087265 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:47:31.087265 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:47:31.087265 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:47:31.087265 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:47:31.087265 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b28a95a5-c6c2-4781-8c1a-62e7d3eac5a7 could not be found. Oct 04 18:47:31.087265 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:47:31.089351 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-bcb1c971-5379-4c0c-80f6-14ec862748a4 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Returning 404 to user: Instance b28a95a5-c6c2-4781-8c1a-62e7d3eac5a7 could not be found. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:47:31.095253 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-bcb1c971-5379-4c0c-80f6-14ec862748a4 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] 10.222.0.43 "DELETE /compute/v2.1/servers/b28a95a5-c6c2-4781-8c1a-62e7d3eac5a7" status: 404 len: 111 microversion: 2.1 time: 0.077955 Oct 04 18:47:31.100372 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1808/3855] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 18:47:31 2022] DELETE /compute/v2.1/servers/b28a95a5-c6c2-4781-8c1a-62e7d3eac5a7 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:47:31.105432 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-56697067-7016-41df-884a-e829f8dfbc56 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:31.106061 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-56697067-7016-41df-884a-e829f8dfbc56 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] [instance: b28a95a5-c6c2-4781-8c1a-62e7d3eac5a7] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:31.119575 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-56697067-7016-41df-884a-e829f8dfbc56 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:31.120077 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-56697067-7016-41df-884a-e829f8dfbc56 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:31.120677 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-56697067-7016-41df-884a-e829f8dfbc56 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:31.121606 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-56697067-7016-41df-884a-e829f8dfbc56 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:31.122188 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-56697067-7016-41df-884a-e829f8dfbc56 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:31.122612 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-56697067-7016-41df-884a-e829f8dfbc56 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:31.155479 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-56697067-7016-41df-884a-e829f8dfbc56 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] HTTP exception thrown: Instance b28a95a5-c6c2-4781-8c1a-62e7d3eac5a7 could not be found. Oct 04 18:47:31.157140 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-56697067-7016-41df-884a-e829f8dfbc56 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Request method failure captured: Oct 04 18:47:31.157140 n-d-851028-13 devstack@n-api.service[123595]: request: GET /compute/v2.1/servers/b28a95a5-c6c2-4781-8c1a-62e7d3eac5a7 HTTP/1.1 Oct 04 18:47:31.157140 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 18:47:31.157140 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 18:47:31.157140 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 18:47:31.157140 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 0 Oct 04 18:47:31.157140 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 18:47:31.157140 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 18:47:31.157140 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 18:47:31.157140 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 18:47:31.157140 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPH8N3JICoSxI2g1StM6bobUrrKHcS2dLGwh62NiwRXgJpjOASIjz8Wug0T58uNg3Qg3AaujMM95jbfyoFeNLtDDxaEz0xr9u024HLNJ9XUSq3IwruOt2smUT5qkZI-wReGz1w70gH7PBpXU6RUKRXRIFYaFOyMEXares4l6o7GTixeM Oct 04 18:47:31.157140 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 18:47:31.157140 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 18:47:31.157140 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 18:47:31.157140 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 18:47:31.157140 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 18:47:31.157140 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 18:47:31.157140 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: 65037d4ea5124d749e42928032e803fd Oct 04 18:47:31.157140 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-ServerDiskConfigTestJSON-2135995142 Oct 04 18:47:31.157140 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 18:47:31.157140 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 18:47:31.157140 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/65037d4ea5124d749e42928032e803fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_65037d4ea5124d749e42928032e803fd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/65037d4ea5124d749e42928032e803fd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/65037d4ea5124d749e42928032e803fd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:47:31.157140 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-ServerDiskConfigTestJSON-2135995142 Oct 04 18:47:31.157140 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: 65037d4ea5124d749e42928032e803fd Oct 04 18:47:31.157140 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-2135995142 Oct 04 18:47:31.157140 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-ServerDiskConfigTestJSON-2135995142-project Oct 04 18:47:31.157140 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 18:47:31.157140 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 18:47:31.157140 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: d2c710f394164b89b16bcac2fe51c58a Oct 04 18:47:31.157140 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-ServerDiskConfigTestJSON-2135995142-project Oct 04 18:47:31.157140 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 18:47:31.157140 n-d-851028-13 devstack@n-api.service[123595]: exception: Instance b28a95a5-c6c2-4781-8c1a-62e7d3eac5a7 could not be found. Oct 04 18:47:31.157140 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': 'b28a95a5-c6c2-4781-8c1a-62e7d3eac5a7'} Oct 04 18:47:31.157140 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:47:31.157140 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:47:31.157140 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:47:31.157140 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:47:31.157140 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:47:31.157140 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:47:31.157140 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:47:31.157140 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:47:31.157140 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:47:31.157140 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:47:31.157140 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b28a95a5-c6c2-4781-8c1a-62e7d3eac5a7 could not be found. Oct 04 18:47:31.157140 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:47:31.157140 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:47:31.157140 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:47:31.157140 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:47:31.157140 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:47:31.157140 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:47:31.157140 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:47:31.157140 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:47:31.157140 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:47:31.157140 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:47:31.157140 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:47:31.157140 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:47:31.157140 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:47:31.157140 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:47:31.157140 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:47:31.157140 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:47:31.157140 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b28a95a5-c6c2-4781-8c1a-62e7d3eac5a7 could not be found. Oct 04 18:47:31.157140 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:47:31.157140 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:47:31.157140 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:47:31.163236 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:47:31.163236 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:47:31.163236 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:47:31.163236 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:47:31.163236 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:47:31.163236 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b28a95a5-c6c2-4781-8c1a-62e7d3eac5a7 could not be found. Oct 04 18:47:31.163236 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:47:31.165510 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-56697067-7016-41df-884a-e829f8dfbc56 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] Returning 404 to user: Instance b28a95a5-c6c2-4781-8c1a-62e7d3eac5a7 could not be found. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:47:31.166490 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-56697067-7016-41df-884a-e829f8dfbc56 tempest-ServerDiskConfigTestJSON-2135995142 tempest-ServerDiskConfigTestJSON-2135995142-project] 10.222.0.43 "GET /compute/v2.1/servers/b28a95a5-c6c2-4781-8c1a-62e7d3eac5a7" status: 404 len: 111 microversion: 2.1 time: 0.064957 Oct 04 18:47:31.167159 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1809/3856] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:31 2022] GET /compute/v2.1/servers/b28a95a5-c6c2-4781-8c1a-62e7d3eac5a7 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:47:31.177258 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-5cb29e31-b1af-48b4-8fcd-a974657a861e tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:31.192521 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-5cb29e31-b1af-48b4-8fcd-a974657a861e tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5" status: 200 len: 1669 microversion: 2.1 time: 0.793562 Oct 04 18:47:31.195664 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2048/3857] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:30 2022] GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5 => generated 1669 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:31.344118 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-ee359787-02e0-499f-8bdf-8341ce81e92d tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:31.347939 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-ee359787-02e0-499f-8bdf-8341ce81e92d tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] [instance: d7f06829-6beb-4d35-ab81-c99f9dd3027d] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:31.377343 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ee359787-02e0-499f-8bdf-8341ce81e92d tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:31.378898 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ee359787-02e0-499f-8bdf-8341ce81e92d tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:31.382033 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ee359787-02e0-499f-8bdf-8341ce81e92d tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:31.387858 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ee359787-02e0-499f-8bdf-8341ce81e92d tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:31.391150 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ee359787-02e0-499f-8bdf-8341ce81e92d tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:31.393143 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ee359787-02e0-499f-8bdf-8341ce81e92d tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:31.441484 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-ee359787-02e0-499f-8bdf-8341ce81e92d tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] HTTP exception thrown: Instance d7f06829-6beb-4d35-ab81-c99f9dd3027d could not be found. Oct 04 18:47:31.447694 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-ee359787-02e0-499f-8bdf-8341ce81e92d tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Request method failure captured: Oct 04 18:47:31.447694 n-d-851028-13 devstack@n-api.service[123595]: request: GET /compute/v2.1/servers/d7f06829-6beb-4d35-ab81-c99f9dd3027d HTTP/1.1 Oct 04 18:47:31.447694 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 18:47:31.447694 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 18:47:31.447694 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 18:47:31.447694 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 0 Oct 04 18:47:31.447694 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 18:47:31.447694 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 18:47:31.447694 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 18:47:31.447694 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 18:47:31.447694 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPH6ImUsc0v5avJaXbAf95n6vmfztxEtTiW32SRLH_bOmBbny3fOGIWm6DaSHmvRnWhZ-84faOFvXqXs-7dDoMftV5mgOWVN0Q9OrVISe3irL7FfmyYZmGssWLEuXGLXQhTtdNOFN9115Lqu5biPYPUWU74K-2mRSRsiih09WbGDmZQI Oct 04 18:47:31.447694 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 18:47:31.447694 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 18:47:31.447694 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 18:47:31.447694 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 18:47:31.447694 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 18:47:31.447694 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 18:47:31.447694 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: eda6bd34bf5540ee95c8144f185eb22d Oct 04 18:47:31.447694 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1155401912 Oct 04 18:47:31.447694 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 18:47:31.447694 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 18:47:31.447694 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/eda6bd34bf5540ee95c8144f185eb22d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_eda6bd34bf5540ee95c8144f185eb22d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/eda6bd34bf5540ee95c8144f185eb22d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/eda6bd34bf5540ee95c8144f185eb22d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:47:31.447694 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1155401912 Oct 04 18:47:31.447694 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: eda6bd34bf5540ee95c8144f185eb22d Oct 04 18:47:31.447694 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1155401912 Oct 04 18:47:31.447694 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-ServerRescueNegativeTestJSON-1155401912-project Oct 04 18:47:31.447694 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 18:47:31.447694 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 18:47:31.447694 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: 96e7480de94c43909045ac1087e40cd8 Oct 04 18:47:31.447694 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1155401912-project Oct 04 18:47:31.447694 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 18:47:31.447694 n-d-851028-13 devstack@n-api.service[123595]: exception: Instance d7f06829-6beb-4d35-ab81-c99f9dd3027d could not be found. Oct 04 18:47:31.447694 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': 'd7f06829-6beb-4d35-ab81-c99f9dd3027d'} Oct 04 18:47:31.447694 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:47:31.447694 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:47:31.447694 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:47:31.447694 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:47:31.447694 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:47:31.447694 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:47:31.447694 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:47:31.447694 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:47:31.447694 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:47:31.447694 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:47:31.447694 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7f06829-6beb-4d35-ab81-c99f9dd3027d could not be found. Oct 04 18:47:31.447694 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:47:31.447694 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:47:31.447694 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:47:31.447694 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:47:31.447694 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:47:31.447694 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:47:31.447694 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:47:31.447694 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:47:31.447694 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:47:31.447694 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:47:31.447694 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:47:31.447694 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:47:31.447694 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:47:31.447694 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:47:31.447694 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:47:31.447694 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:47:31.447694 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7f06829-6beb-4d35-ab81-c99f9dd3027d could not be found. Oct 04 18:47:31.447694 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:47:31.447694 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:47:31.453308 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:47:31.453308 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:47:31.453308 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:47:31.453308 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:47:31.453308 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:47:31.453308 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:47:31.453308 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7f06829-6beb-4d35-ab81-c99f9dd3027d could not be found. Oct 04 18:47:31.453308 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:47:31.458280 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-ee359787-02e0-499f-8bdf-8341ce81e92d tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Returning 404 to user: Instance d7f06829-6beb-4d35-ab81-c99f9dd3027d could not be found. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:47:31.459837 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-ee359787-02e0-499f-8bdf-8341ce81e92d tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] 10.222.0.43 "GET /compute/v2.1/servers/d7f06829-6beb-4d35-ab81-c99f9dd3027d" status: 404 len: 111 microversion: 2.1 time: 0.124438 Oct 04 18:47:31.463365 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1810/3858] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:31 2022] GET /compute/v2.1/servers/d7f06829-6beb-4d35-ab81-c99f9dd3027d => generated 111 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:47:31.472262 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-fa31736e-05a1-4a96-80e3-683a1edbc0ba tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:31.472818 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-fa31736e-05a1-4a96-80e3-683a1edbc0ba tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] [instance: f726f3f3-4731-4380-9163-b2273b629810] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:31.481217 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fa31736e-05a1-4a96-80e3-683a1edbc0ba tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:31.481873 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fa31736e-05a1-4a96-80e3-683a1edbc0ba tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:31.482550 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fa31736e-05a1-4a96-80e3-683a1edbc0ba tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:31.483510 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fa31736e-05a1-4a96-80e3-683a1edbc0ba tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:31.484260 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fa31736e-05a1-4a96-80e3-683a1edbc0ba tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:31.484716 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fa31736e-05a1-4a96-80e3-683a1edbc0ba tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:31.519136 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-fa31736e-05a1-4a96-80e3-683a1edbc0ba tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] [instance: f726f3f3-4731-4380-9163-b2273b629810] Going to try to terminate instance {{(pid=123596) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:47:31.572094 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-860ae758-e61e-4b3e-8cc6-5bc667684295 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:31.572959 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-860ae758-e61e-4b3e-8cc6-5bc667684295 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] [instance: fd09cc9b-d9dd-4133-8665-eeb6d8f51df8] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:31.583246 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-860ae758-e61e-4b3e-8cc6-5bc667684295 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:31.583785 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-860ae758-e61e-4b3e-8cc6-5bc667684295 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:31.584225 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-860ae758-e61e-4b3e-8cc6-5bc667684295 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:31.585796 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-860ae758-e61e-4b3e-8cc6-5bc667684295 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:31.586562 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-860ae758-e61e-4b3e-8cc6-5bc667684295 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:31.587170 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-860ae758-e61e-4b3e-8cc6-5bc667684295 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:31.604636 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:47:31.675437 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-fa31736e-05a1-4a96-80e3-683a1edbc0ba tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] 10.222.0.43 "DELETE /compute/v2.1/servers/f726f3f3-4731-4380-9163-b2273b629810" status: 204 len: 0 microversion: 2.1 time: 0.207325 Oct 04 18:47:31.678442 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2049/3859] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 18:47:31 2022] DELETE /compute/v2.1/servers/f726f3f3-4731-4380-9163-b2273b629810 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:47:31.687076 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-9ea13583-d1f5-4de9-aed8-b13fc1897c3e tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:31.687786 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-9ea13583-d1f5-4de9-aed8-b13fc1897c3e tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] [instance: f726f3f3-4731-4380-9163-b2273b629810] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:31.694755 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9ea13583-d1f5-4de9-aed8-b13fc1897c3e tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:31.695308 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9ea13583-d1f5-4de9-aed8-b13fc1897c3e tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:31.695749 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9ea13583-d1f5-4de9-aed8-b13fc1897c3e tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:31.696656 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9ea13583-d1f5-4de9-aed8-b13fc1897c3e tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:31.697302 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9ea13583-d1f5-4de9-aed8-b13fc1897c3e tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:31.697895 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9ea13583-d1f5-4de9-aed8-b13fc1897c3e tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:31.959778 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-9ea13583-d1f5-4de9-aed8-b13fc1897c3e tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96e7480de94c43909045ac1087e40cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6bd34bf5540ee95c8144f185eb22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:31.968225 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-9ea13583-d1f5-4de9-aed8-b13fc1897c3e tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] 10.222.0.43 "GET /compute/v2.1/servers/f726f3f3-4731-4380-9163-b2273b629810" status: 200 len: 1520 microversion: 2.1 time: 0.285207 Oct 04 18:47:31.986589 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2050/3860] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:31 2022] GET /compute/v2.1/servers/f726f3f3-4731-4380-9163-b2273b629810 => generated 1520 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:47:31.994006 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-4d5ca77b-7f3e-4045-b5d5-023046edbea0 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:31.995002 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-4d5ca77b-7f3e-4045-b5d5-023046edbea0 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] [instance: 5f6ad9ae-93d7-4774-aadf-b1fbbadc224c] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:32.001624 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4d5ca77b-7f3e-4045-b5d5-023046edbea0 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:32.003242 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4d5ca77b-7f3e-4045-b5d5-023046edbea0 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:32.003932 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4d5ca77b-7f3e-4045-b5d5-023046edbea0 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:32.004884 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4d5ca77b-7f3e-4045-b5d5-023046edbea0 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:32.005607 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4d5ca77b-7f3e-4045-b5d5-023046edbea0 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:32.006242 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4d5ca77b-7f3e-4045-b5d5-023046edbea0 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:32.048551 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4d5ca77b-7f3e-4045-b5d5-023046edbea0 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:32.049835 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4d5ca77b-7f3e-4045-b5d5-023046edbea0 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:32.050485 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4d5ca77b-7f3e-4045-b5d5-023046edbea0 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:32.051152 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.objects.instance [None req-4d5ca77b-7f3e-4045-b5d5-023046edbea0 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lazy-loading 'fault' on Instance uuid 5f6ad9ae-93d7-4774-aadf-b1fbbadc224c {{(pid=123596) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:47:32.160276 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-4d5ca77b-7f3e-4045-b5d5-023046edbea0 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcbf2b4b95743af9e6fa1be54554baa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab4da2b9b9f4c7a9c25b7edaab3027d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:32.171081 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-4d5ca77b-7f3e-4045-b5d5-023046edbea0 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] 10.222.0.43 "GET /compute/v2.1/servers/5f6ad9ae-93d7-4774-aadf-b1fbbadc224c" status: 200 len: 1314 microversion: 2.1 time: 0.182452 Oct 04 18:47:32.172449 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2051/3861] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:31 2022] GET /compute/v2.1/servers/5f6ad9ae-93d7-4774-aadf-b1fbbadc224c => generated 1314 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:32.225517 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-a19c9cb5-7a81-4fa9-91e6-0d2495117387 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:32.226277 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-a19c9cb5-7a81-4fa9-91e6-0d2495117387 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 82b86465-afb0-49ef-9932-1538010c1ae5] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:32.240672 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a19c9cb5-7a81-4fa9-91e6-0d2495117387 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:32.244053 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a19c9cb5-7a81-4fa9-91e6-0d2495117387 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:32.244919 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a19c9cb5-7a81-4fa9-91e6-0d2495117387 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:32.245784 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a19c9cb5-7a81-4fa9-91e6-0d2495117387 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:32.246328 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a19c9cb5-7a81-4fa9-91e6-0d2495117387 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:32.246843 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a19c9cb5-7a81-4fa9-91e6-0d2495117387 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:32.347389 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-860ae758-e61e-4b3e-8cc6-5bc667684295 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9971b5861f44c1a1da94eda0f8f02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f809b8ae704988961908bef0f3cb24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:32.358011 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-860ae758-e61e-4b3e-8cc6-5bc667684295 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] 10.222.0.43 "GET /compute/v2.1/servers/fd09cc9b-d9dd-4133-8665-eeb6d8f51df8" status: 200 len: 1391 microversion: 2.1 time: 0.790118 Oct 04 18:47:32.365323 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1811/3862] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:31 2022] GET /compute/v2.1/servers/fd09cc9b-d9dd-4133-8665-eeb6d8f51df8 => generated 1391 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:47:32.487395 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-a19c9cb5-7a81-4fa9-91e6-0d2495117387 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:32.494056 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-20d91e58-7407-429a-8eef-f53a9baddfd2 req-134cc22b-b9fb-4a7a-bf1c-c89d6d2c11e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f6ad9ae-93d7-4774-aadf-b1fbbadc224c", "name": "network-vif-deleted", "tag": "49e89ec3-e909-4e55-83af-1707032f6599"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:47:32.500139 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-a19c9cb5-7a81-4fa9-91e6-0d2495117387 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5" status: 200 len: 1667 microversion: 2.1 time: 0.284563 Oct 04 18:47:32.501123 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2052/3863] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:32 2022] GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5 => generated 1667 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:47:32.507124 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-20d91e58-7407-429a-8eef-f53a9baddfd2 req-134cc22b-b9fb-4a7a-bf1c-c89d6d2c11e4 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:32.508814 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-20d91e58-7407-429a-8eef-f53a9baddfd2 req-134cc22b-b9fb-4a7a-bf1c-c89d6d2c11e4 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:32.509467 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-20d91e58-7407-429a-8eef-f53a9baddfd2 req-134cc22b-b9fb-4a7a-bf1c-c89d6d2c11e4 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:32.539991 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-20d91e58-7407-429a-8eef-f53a9baddfd2 req-134cc22b-b9fb-4a7a-bf1c-c89d6d2c11e4 service nova] Creating event network-vif-deleted:49e89ec3-e909-4e55-83af-1707032f6599 for instance 5f6ad9ae-93d7-4774-aadf-b1fbbadc224c on n-h2-851028-13 Oct 04 18:47:32.550211 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-20d91e58-7407-429a-8eef-f53a9baddfd2 req-134cc22b-b9fb-4a7a-bf1c-c89d6d2c11e4 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065113 Oct 04 18:47:32.553219 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1812/3864] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:47:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:47:32.994383 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-643f966e-84e6-4717-9cee-2a60c571be43 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:32.995455 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-643f966e-84e6-4717-9cee-2a60c571be43 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] [instance: f726f3f3-4731-4380-9163-b2273b629810] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:33.002976 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-643f966e-84e6-4717-9cee-2a60c571be43 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:33.004062 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-643f966e-84e6-4717-9cee-2a60c571be43 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:33.004757 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-643f966e-84e6-4717-9cee-2a60c571be43 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:33.005726 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-643f966e-84e6-4717-9cee-2a60c571be43 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:33.006405 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-643f966e-84e6-4717-9cee-2a60c571be43 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:33.007114 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-643f966e-84e6-4717-9cee-2a60c571be43 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:33.199803 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-25406300-d6fa-49e9-8d24-a2148c6107cf tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:33.201481 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-25406300-d6fa-49e9-8d24-a2148c6107cf tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] [instance: 5f6ad9ae-93d7-4774-aadf-b1fbbadc224c] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:33.217009 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-25406300-d6fa-49e9-8d24-a2148c6107cf tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:33.220102 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-25406300-d6fa-49e9-8d24-a2148c6107cf tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:33.223033 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-25406300-d6fa-49e9-8d24-a2148c6107cf tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:33.224913 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-25406300-d6fa-49e9-8d24-a2148c6107cf tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:33.225608 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-25406300-d6fa-49e9-8d24-a2148c6107cf tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:33.228816 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-25406300-d6fa-49e9-8d24-a2148c6107cf tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:33.269547 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-643f966e-84e6-4717-9cee-2a60c571be43 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96e7480de94c43909045ac1087e40cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6bd34bf5540ee95c8144f185eb22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:33.279515 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-643f966e-84e6-4717-9cee-2a60c571be43 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] 10.222.0.43 "GET /compute/v2.1/servers/f726f3f3-4731-4380-9163-b2273b629810" status: 200 len: 1520 microversion: 2.1 time: 0.289362 Oct 04 18:47:33.282795 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2053/3865] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:32 2022] GET /compute/v2.1/servers/f726f3f3-4731-4380-9163-b2273b629810 => generated 1520 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:33.295161 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-25406300-d6fa-49e9-8d24-a2148c6107cf tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:33.296707 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-25406300-d6fa-49e9-8d24-a2148c6107cf tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:33.298090 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-25406300-d6fa-49e9-8d24-a2148c6107cf tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:33.298848 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.objects.instance [None req-25406300-d6fa-49e9-8d24-a2148c6107cf tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lazy-loading 'fault' on Instance uuid 5f6ad9ae-93d7-4774-aadf-b1fbbadc224c {{(pid=123595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:47:33.387518 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-fbd2b070-8644-448e-9d89-a405ab19bfe2 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:33.388735 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-fbd2b070-8644-448e-9d89-a405ab19bfe2 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] [instance: fd09cc9b-d9dd-4133-8665-eeb6d8f51df8] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:33.389283 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-25406300-d6fa-49e9-8d24-a2148c6107cf tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcbf2b4b95743af9e6fa1be54554baa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab4da2b9b9f4c7a9c25b7edaab3027d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:33.397097 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fbd2b070-8644-448e-9d89-a405ab19bfe2 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:33.398695 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fbd2b070-8644-448e-9d89-a405ab19bfe2 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:33.399378 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-25406300-d6fa-49e9-8d24-a2148c6107cf tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] 10.222.0.43 "GET /compute/v2.1/servers/5f6ad9ae-93d7-4774-aadf-b1fbbadc224c" status: 200 len: 1314 microversion: 2.1 time: 0.205633 Oct 04 18:47:33.399809 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fbd2b070-8644-448e-9d89-a405ab19bfe2 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:33.400790 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fbd2b070-8644-448e-9d89-a405ab19bfe2 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:33.401600 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fbd2b070-8644-448e-9d89-a405ab19bfe2 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:33.402339 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fbd2b070-8644-448e-9d89-a405ab19bfe2 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:33.402622 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1813/3866] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:33 2022] GET /compute/v2.1/servers/5f6ad9ae-93d7-4774-aadf-b1fbbadc224c => generated 1314 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:33.655347 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-fbd2b070-8644-448e-9d89-a405ab19bfe2 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9971b5861f44c1a1da94eda0f8f02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f809b8ae704988961908bef0f3cb24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:33.667860 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-fbd2b070-8644-448e-9d89-a405ab19bfe2 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] 10.222.0.43 "GET /compute/v2.1/servers/fd09cc9b-d9dd-4133-8665-eeb6d8f51df8" status: 200 len: 1391 microversion: 2.1 time: 0.287219 Oct 04 18:47:33.682776 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2054/3867] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:33 2022] GET /compute/v2.1/servers/fd09cc9b-d9dd-4133-8665-eeb6d8f51df8 => generated 1391 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:34.309317 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-9bff6538-5400-46cc-b898-506f63b88de6 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:34.311793 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-9bff6538-5400-46cc-b898-506f63b88de6 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] [instance: f726f3f3-4731-4380-9163-b2273b629810] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:34.324049 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9bff6538-5400-46cc-b898-506f63b88de6 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:34.326393 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9bff6538-5400-46cc-b898-506f63b88de6 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:34.326885 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9bff6538-5400-46cc-b898-506f63b88de6 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:34.327656 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9bff6538-5400-46cc-b898-506f63b88de6 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:34.328524 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9bff6538-5400-46cc-b898-506f63b88de6 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:34.328975 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9bff6538-5400-46cc-b898-506f63b88de6 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:34.429978 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-09b73daf-e2ee-4a7b-98ed-117e32761063 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:34.430685 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-09b73daf-e2ee-4a7b-98ed-117e32761063 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] [instance: 5f6ad9ae-93d7-4774-aadf-b1fbbadc224c] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:34.448765 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-09b73daf-e2ee-4a7b-98ed-117e32761063 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:34.454130 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-09b73daf-e2ee-4a7b-98ed-117e32761063 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:34.454991 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-09b73daf-e2ee-4a7b-98ed-117e32761063 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:34.457861 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-09b73daf-e2ee-4a7b-98ed-117e32761063 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:34.463585 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-09b73daf-e2ee-4a7b-98ed-117e32761063 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:34.464474 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-09b73daf-e2ee-4a7b-98ed-117e32761063 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:34.555066 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-09b73daf-e2ee-4a7b-98ed-117e32761063 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:34.555968 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-09b73daf-e2ee-4a7b-98ed-117e32761063 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:34.556663 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-09b73daf-e2ee-4a7b-98ed-117e32761063 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:34.557679 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.objects.instance [None req-09b73daf-e2ee-4a7b-98ed-117e32761063 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lazy-loading 'fault' on Instance uuid 5f6ad9ae-93d7-4774-aadf-b1fbbadc224c {{(pid=123596) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:47:34.630711 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-9bff6538-5400-46cc-b898-506f63b88de6 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96e7480de94c43909045ac1087e40cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6bd34bf5540ee95c8144f185eb22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:34.632217 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-09b73daf-e2ee-4a7b-98ed-117e32761063 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcbf2b4b95743af9e6fa1be54554baa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab4da2b9b9f4c7a9c25b7edaab3027d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:34.647176 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-09b73daf-e2ee-4a7b-98ed-117e32761063 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] 10.222.0.43 "GET /compute/v2.1/servers/5f6ad9ae-93d7-4774-aadf-b1fbbadc224c" status: 200 len: 1314 microversion: 2.1 time: 0.222705 Oct 04 18:47:34.650423 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-9bff6538-5400-46cc-b898-506f63b88de6 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] 10.222.0.43 "GET /compute/v2.1/servers/f726f3f3-4731-4380-9163-b2273b629810" status: 200 len: 1520 microversion: 2.1 time: 0.347187 Oct 04 18:47:34.666967 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1814/3868] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:34 2022] GET /compute/v2.1/servers/f726f3f3-4731-4380-9163-b2273b629810 => generated 1520 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:34.667477 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2055/3869] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:34 2022] GET /compute/v2.1/servers/5f6ad9ae-93d7-4774-aadf-b1fbbadc224c => generated 1314 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:34.694286 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-284cbb7d-8653-4619-83f9-7cca3d7255d5 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:34.694908 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-284cbb7d-8653-4619-83f9-7cca3d7255d5 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] [instance: fd09cc9b-d9dd-4133-8665-eeb6d8f51df8] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:34.702179 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-284cbb7d-8653-4619-83f9-7cca3d7255d5 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:34.702970 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-284cbb7d-8653-4619-83f9-7cca3d7255d5 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:34.703606 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-284cbb7d-8653-4619-83f9-7cca3d7255d5 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:34.704660 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-284cbb7d-8653-4619-83f9-7cca3d7255d5 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:34.705366 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-284cbb7d-8653-4619-83f9-7cca3d7255d5 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:34.706106 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-284cbb7d-8653-4619-83f9-7cca3d7255d5 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:34.924106 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-284cbb7d-8653-4619-83f9-7cca3d7255d5 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9971b5861f44c1a1da94eda0f8f02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f809b8ae704988961908bef0f3cb24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:34.939999 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-284cbb7d-8653-4619-83f9-7cca3d7255d5 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] 10.222.0.43 "GET /compute/v2.1/servers/fd09cc9b-d9dd-4133-8665-eeb6d8f51df8" status: 200 len: 1391 microversion: 2.1 time: 0.249667 Oct 04 18:47:34.942567 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1815/3870] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:34 2022] GET /compute/v2.1/servers/fd09cc9b-d9dd-4133-8665-eeb6d8f51df8 => generated 1391 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:47:35.683773 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-54d47eaf-3719-45f6-85cc-f9c9b4412035 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:35.685575 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-54d47eaf-3719-45f6-85cc-f9c9b4412035 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] [instance: f726f3f3-4731-4380-9163-b2273b629810] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:35.690889 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-24938cad-a265-412a-81ef-8e0be44c6a7e tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:35.691282 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-24938cad-a265-412a-81ef-8e0be44c6a7e tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] [instance: 5f6ad9ae-93d7-4774-aadf-b1fbbadc224c] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:35.705554 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-24938cad-a265-412a-81ef-8e0be44c6a7e tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:35.706071 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-24938cad-a265-412a-81ef-8e0be44c6a7e tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:35.706521 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-54d47eaf-3719-45f6-85cc-f9c9b4412035 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:35.707602 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-54d47eaf-3719-45f6-85cc-f9c9b4412035 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:35.707855 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-24938cad-a265-412a-81ef-8e0be44c6a7e tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:35.708585 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-54d47eaf-3719-45f6-85cc-f9c9b4412035 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:35.708755 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-24938cad-a265-412a-81ef-8e0be44c6a7e tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:35.710335 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-24938cad-a265-412a-81ef-8e0be44c6a7e tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:35.710680 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-54d47eaf-3719-45f6-85cc-f9c9b4412035 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:35.710814 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-24938cad-a265-412a-81ef-8e0be44c6a7e tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:35.711528 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-54d47eaf-3719-45f6-85cc-f9c9b4412035 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:35.712467 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-54d47eaf-3719-45f6-85cc-f9c9b4412035 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:35.748787 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-24938cad-a265-412a-81ef-8e0be44c6a7e tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] HTTP exception thrown: Instance 5f6ad9ae-93d7-4774-aadf-b1fbbadc224c could not be found. Oct 04 18:47:35.756213 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-24938cad-a265-412a-81ef-8e0be44c6a7e tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Request method failure captured: Oct 04 18:47:35.756213 n-d-851028-13 devstack@n-api.service[123595]: request: GET /compute/v2.1/servers/5f6ad9ae-93d7-4774-aadf-b1fbbadc224c HTTP/1.1 Oct 04 18:47:35.756213 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 18:47:35.756213 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 18:47:35.756213 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 18:47:35.756213 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 0 Oct 04 18:47:35.756213 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 18:47:35.756213 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 18:47:35.756213 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 18:47:35.756213 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 18:47:35.756213 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPH978iZmaQey9qRFmivrOEN9WI4gFjhDc3nSUPEBZXv1WUgd7GTFhNQGJ_Nm2KHTEzU5QZw7VgnyxDt5Dwy3JGK8gUnF9wIKq6iB3FX5CCTGK5JwEw-XtwnwemZOTSVwZU_4nc3l4c2itfEGLVIoX2yb6G-IjSzn-sL8697UlYQlcew Oct 04 18:47:35.756213 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 18:47:35.756213 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 18:47:35.756213 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 18:47:35.756213 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 18:47:35.756213 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 18:47:35.756213 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 18:47:35.756213 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: 8ab4da2b9b9f4c7a9c25b7edaab3027d Oct 04 18:47:35.756213 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2004915413 Oct 04 18:47:35.756213 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 18:47:35.756213 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 18:47:35.756213 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/8ab4da2b9b9f4c7a9c25b7edaab3027d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_8ab4da2b9b9f4c7a9c25b7edaab3027d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8ab4da2b9b9f4c7a9c25b7edaab3027d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8ab4da2b9b9f4c7a9c25b7edaab3027d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:47:35.756213 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2004915413 Oct 04 18:47:35.756213 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: 8ab4da2b9b9f4c7a9c25b7edaab3027d Oct 04 18:47:35.756213 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2004915413 Oct 04 18:47:35.756213 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-ImagesOneServerNegativeTestJSON-2004915413-project Oct 04 18:47:35.756213 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 18:47:35.756213 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 18:47:35.756213 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: cdcbf2b4b95743af9e6fa1be54554baa Oct 04 18:47:35.756213 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2004915413-project Oct 04 18:47:35.756213 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 18:47:35.756213 n-d-851028-13 devstack@n-api.service[123595]: exception: Instance 5f6ad9ae-93d7-4774-aadf-b1fbbadc224c could not be found. Oct 04 18:47:35.756213 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': '5f6ad9ae-93d7-4774-aadf-b1fbbadc224c'} Oct 04 18:47:35.756213 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:47:35.756213 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:47:35.756213 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:47:35.756213 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:47:35.756213 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:47:35.756213 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:47:35.756213 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:47:35.756213 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:47:35.756213 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:47:35.756213 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:47:35.756213 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f6ad9ae-93d7-4774-aadf-b1fbbadc224c could not be found. Oct 04 18:47:35.756213 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:47:35.756213 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:47:35.756213 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:47:35.756213 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:47:35.756213 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:47:35.756213 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:47:35.756213 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:47:35.756213 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:47:35.756213 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:47:35.756213 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:47:35.756213 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:47:35.756213 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:47:35.756213 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:47:35.756213 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:47:35.756213 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:47:35.756213 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:47:35.756213 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f6ad9ae-93d7-4774-aadf-b1fbbadc224c could not be found. Oct 04 18:47:35.756213 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:47:35.756213 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:47:35.762578 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:47:35.762578 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:47:35.762578 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:47:35.762578 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:47:35.762578 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:47:35.762578 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:47:35.762578 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f6ad9ae-93d7-4774-aadf-b1fbbadc224c could not be found. Oct 04 18:47:35.762578 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:47:35.762578 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-24938cad-a265-412a-81ef-8e0be44c6a7e tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Returning 404 to user: Instance 5f6ad9ae-93d7-4774-aadf-b1fbbadc224c could not be found. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:47:35.762578 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-24938cad-a265-412a-81ef-8e0be44c6a7e tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] 10.222.0.43 "GET /compute/v2.1/servers/5f6ad9ae-93d7-4774-aadf-b1fbbadc224c" status: 404 len: 111 microversion: 2.1 time: 0.071810 Oct 04 18:47:35.763742 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1816/3871] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:35 2022] GET /compute/v2.1/servers/5f6ad9ae-93d7-4774-aadf-b1fbbadc224c => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:47:35.839155 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-09f82777-53bf-4e95-af27-80f30e32eb9d tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-2063765218", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:47:35.956127 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.network.neutron [None req-09f82777-53bf-4e95-af27-80f30e32eb9d tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] validate_networks() for [('9a73c20c-974b-45c7-afb7-3b01737eb50f', None, None, None, None, None)] {{(pid=123595) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:47:36.277986 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-54d47eaf-3719-45f6-85cc-f9c9b4412035 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96e7480de94c43909045ac1087e40cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6bd34bf5540ee95c8144f185eb22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:36.301255 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-54d47eaf-3719-45f6-85cc-f9c9b4412035 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] 10.222.0.43 "GET /compute/v2.1/servers/f726f3f3-4731-4380-9163-b2273b629810" status: 200 len: 1520 microversion: 2.1 time: 0.626191 Oct 04 18:47:36.302542 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2056/3872] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:35 2022] GET /compute/v2.1/servers/f726f3f3-4731-4380-9163-b2273b629810 => generated 1520 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:36.309894 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-8721dddf-2d42-4f0b-915e-7f87484b0769 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:36.310821 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-8721dddf-2d42-4f0b-915e-7f87484b0769 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] [instance: fd09cc9b-d9dd-4133-8665-eeb6d8f51df8] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:36.323872 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8721dddf-2d42-4f0b-915e-7f87484b0769 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:36.325392 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8721dddf-2d42-4f0b-915e-7f87484b0769 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:36.351670 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8721dddf-2d42-4f0b-915e-7f87484b0769 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:36.354018 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8721dddf-2d42-4f0b-915e-7f87484b0769 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:36.360651 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8721dddf-2d42-4f0b-915e-7f87484b0769 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:36.363442 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8721dddf-2d42-4f0b-915e-7f87484b0769 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:36.767675 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-8721dddf-2d42-4f0b-915e-7f87484b0769 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9971b5861f44c1a1da94eda0f8f02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f809b8ae704988961908bef0f3cb24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:36.792480 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-8721dddf-2d42-4f0b-915e-7f87484b0769 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] 10.222.0.43 "GET /compute/v2.1/servers/fd09cc9b-d9dd-4133-8665-eeb6d8f51df8" status: 200 len: 1391 microversion: 2.1 time: 0.486485 Oct 04 18:47:36.793808 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2057/3873] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:36 2022] GET /compute/v2.1/servers/fd09cc9b-d9dd-4133-8665-eeb6d8f51df8 => generated 1391 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:37.127990 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-09f82777-53bf-4e95-af27-80f30e32eb9d tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Flavor limits 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:47:37.128533 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-09f82777-53bf-4e95-af27-80f30e32eb9d tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Image limits 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:47:37.128990 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-09f82777-53bf-4e95-af27-80f30e32eb9d tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Flavor pref 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:47:37.129514 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-09f82777-53bf-4e95-af27-80f30e32eb9d tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Image pref 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:47:37.129930 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-09f82777-53bf-4e95-af27-80f30e32eb9d tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:47:37.148523 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-09f82777-53bf-4e95-af27-80f30e32eb9d tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:37.152922 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-09f82777-53bf-4e95-af27-80f30e32eb9d tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:37.153827 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-09f82777-53bf-4e95-af27-80f30e32eb9d tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:37.157211 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-09f82777-53bf-4e95-af27-80f30e32eb9d tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:37.157903 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-09f82777-53bf-4e95-af27-80f30e32eb9d tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:37.158357 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-09f82777-53bf-4e95-af27-80f30e32eb9d tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:37.242504 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-09f82777-53bf-4e95-af27-80f30e32eb9d tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Getting quotas for project 8ab4da2b9b9f4c7a9c25b7edaab3027d. Resources: {'ram', 'cores', 'instances'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:47:37.252536 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-09f82777-53bf-4e95-af27-80f30e32eb9d tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Getting quotas for user cdcbf2b4b95743af9e6fa1be54554baa and project 8ab4da2b9b9f4c7a9c25b7edaab3027d. Resources: {'ram', 'cores', 'instances'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:47:37.296090 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-09f82777-53bf-4e95-af27-80f30e32eb9d tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Going to run 1 instances... {{(pid=123595) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:47:37.300219 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-09f82777-53bf-4e95-af27-80f30e32eb9d tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] [instance: 78c4f56c-fc4d-403b-98aa-5ff2cdf1931c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e8943ec5-4038-4d4b-b9b9-2415a79f5243',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:47:37.344612 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-e8494445-37a1-480f-9e7c-ed7ee27417cd tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:37.346159 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-e8494445-37a1-480f-9e7c-ed7ee27417cd tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] [instance: f726f3f3-4731-4380-9163-b2273b629810] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:37.361513 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e8494445-37a1-480f-9e7c-ed7ee27417cd tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:37.363212 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e8494445-37a1-480f-9e7c-ed7ee27417cd tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:37.365291 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e8494445-37a1-480f-9e7c-ed7ee27417cd tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:37.366703 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e8494445-37a1-480f-9e7c-ed7ee27417cd tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:37.369743 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e8494445-37a1-480f-9e7c-ed7ee27417cd tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:37.371908 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e8494445-37a1-480f-9e7c-ed7ee27417cd tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:37.468564 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-09f82777-53bf-4e95-af27-80f30e32eb9d tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.635343 Oct 04 18:47:37.470674 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1817/3874] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 18:47:35 2022] POST /compute/v2.1/servers => generated 383 bytes in 1638 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 18:47:37.486835 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-8f8b066d-227b-40ce-817d-cd8689b6ab87 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:37.487848 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-8f8b066d-227b-40ce-817d-cd8689b6ab87 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] [instance: 78c4f56c-fc4d-403b-98aa-5ff2cdf1931c] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:37.491280 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:47:37.704788 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-8f8b066d-227b-40ce-817d-cd8689b6ab87 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcbf2b4b95743af9e6fa1be54554baa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab4da2b9b9f4c7a9c25b7edaab3027d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:37.745355 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-8f8b066d-227b-40ce-817d-cd8689b6ab87 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] 10.222.0.43 "GET /compute/v2.1/servers/78c4f56c-fc4d-403b-98aa-5ff2cdf1931c" status: 200 len: 1225 microversion: 2.1 time: 0.259774 Oct 04 18:47:37.749948 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1818/3875] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:37 2022] GET /compute/v2.1/servers/78c4f56c-fc4d-403b-98aa-5ff2cdf1931c => generated 1225 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:37.808050 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-11651ed5-7e32-4079-890e-3b219118e2c6 req-91730427-021a-4af7-935b-c4b44bd778af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f726f3f3-4731-4380-9163-b2273b629810", "name": "network-vif-deleted", "tag": "e0981442-7ddc-47a4-b476-d7804751bfec"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:47:37.877834 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-11651ed5-7e32-4079-890e-3b219118e2c6 req-91730427-021a-4af7-935b-c4b44bd778af service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:37.881421 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-11651ed5-7e32-4079-890e-3b219118e2c6 req-91730427-021a-4af7-935b-c4b44bd778af service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:37.883495 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-11651ed5-7e32-4079-890e-3b219118e2c6 req-91730427-021a-4af7-935b-c4b44bd778af service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:37.946400 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-11651ed5-7e32-4079-890e-3b219118e2c6 req-91730427-021a-4af7-935b-c4b44bd778af service nova] Creating event network-vif-deleted:e0981442-7ddc-47a4-b476-d7804751bfec for instance f726f3f3-4731-4380-9163-b2273b629810 on n-h2-851028-13 Oct 04 18:47:37.967695 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-11651ed5-7e32-4079-890e-3b219118e2c6 req-91730427-021a-4af7-935b-c4b44bd778af service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.180673 Oct 04 18:47:37.969149 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1819/3876] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:47:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:47:37.993585 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-18a87421-54c5-4683-85b4-064b8e22286c tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:37.998084 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-18a87421-54c5-4683-85b4-064b8e22286c tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] [instance: fd09cc9b-d9dd-4133-8665-eeb6d8f51df8] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:38.016392 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-18a87421-54c5-4683-85b4-064b8e22286c tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:38.018364 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-18a87421-54c5-4683-85b4-064b8e22286c tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:38.019330 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-18a87421-54c5-4683-85b4-064b8e22286c tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:38.021682 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-18a87421-54c5-4683-85b4-064b8e22286c tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:38.022836 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-18a87421-54c5-4683-85b4-064b8e22286c tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:38.050668 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-18a87421-54c5-4683-85b4-064b8e22286c tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:38.313420 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-e8494445-37a1-480f-9e7c-ed7ee27417cd tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96e7480de94c43909045ac1087e40cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda6bd34bf5540ee95c8144f185eb22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:38.325159 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-e8494445-37a1-480f-9e7c-ed7ee27417cd tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] 10.222.0.43 "GET /compute/v2.1/servers/f726f3f3-4731-4380-9163-b2273b629810" status: 200 len: 1478 microversion: 2.1 time: 0.995067 Oct 04 18:47:38.326820 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2058/3877] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:37 2022] GET /compute/v2.1/servers/f726f3f3-4731-4380-9163-b2273b629810 => generated 1478 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:38.384680 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-18a87421-54c5-4683-85b4-064b8e22286c tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9971b5861f44c1a1da94eda0f8f02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f809b8ae704988961908bef0f3cb24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:38.409820 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-18a87421-54c5-4683-85b4-064b8e22286c tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] 10.222.0.43 "GET /compute/v2.1/servers/fd09cc9b-d9dd-4133-8665-eeb6d8f51df8" status: 200 len: 1391 microversion: 2.1 time: 0.426956 Oct 04 18:47:38.412347 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1820/3878] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:37 2022] GET /compute/v2.1/servers/fd09cc9b-d9dd-4133-8665-eeb6d8f51df8 => generated 1391 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:38.790085 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-18cc81ed-d472-41dc-8bfb-097dcdd6f3bf tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:38.790806 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-18cc81ed-d472-41dc-8bfb-097dcdd6f3bf tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] [instance: 78c4f56c-fc4d-403b-98aa-5ff2cdf1931c] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:38.805765 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-18cc81ed-d472-41dc-8bfb-097dcdd6f3bf tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:38.817875 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-18cc81ed-d472-41dc-8bfb-097dcdd6f3bf tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:38.820128 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-18cc81ed-d472-41dc-8bfb-097dcdd6f3bf tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:38.822733 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-18cc81ed-d472-41dc-8bfb-097dcdd6f3bf tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:38.824133 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-18cc81ed-d472-41dc-8bfb-097dcdd6f3bf tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:38.825814 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-18cc81ed-d472-41dc-8bfb-097dcdd6f3bf tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:39.096897 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-18cc81ed-d472-41dc-8bfb-097dcdd6f3bf tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcbf2b4b95743af9e6fa1be54554baa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab4da2b9b9f4c7a9c25b7edaab3027d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:39.106551 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-18cc81ed-d472-41dc-8bfb-097dcdd6f3bf tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] 10.222.0.43 "GET /compute/v2.1/servers/78c4f56c-fc4d-403b-98aa-5ff2cdf1931c" status: 200 len: 1221 microversion: 2.1 time: 0.321942 Oct 04 18:47:39.121025 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2059/3879] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:38 2022] GET /compute/v2.1/servers/78c4f56c-fc4d-403b-98aa-5ff2cdf1931c => generated 1221 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:39.375830 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-dc53da07-b523-4756-a881-0de0371f6c16 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:39.379951 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-dc53da07-b523-4756-a881-0de0371f6c16 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] [instance: f726f3f3-4731-4380-9163-b2273b629810] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:39.411397 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dc53da07-b523-4756-a881-0de0371f6c16 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:39.437947 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dc53da07-b523-4756-a881-0de0371f6c16 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.028s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:39.442633 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dc53da07-b523-4756-a881-0de0371f6c16 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:39.445148 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dc53da07-b523-4756-a881-0de0371f6c16 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:39.445999 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dc53da07-b523-4756-a881-0de0371f6c16 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:39.446672 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dc53da07-b523-4756-a881-0de0371f6c16 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:39.447618 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-8b1c1120-8c39-4bd7-8a12-ffb01b99dbae tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:39.448531 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-8b1c1120-8c39-4bd7-8a12-ffb01b99dbae tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] [instance: fd09cc9b-d9dd-4133-8665-eeb6d8f51df8] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:39.469230 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8b1c1120-8c39-4bd7-8a12-ffb01b99dbae tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:39.469914 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8b1c1120-8c39-4bd7-8a12-ffb01b99dbae tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:39.470613 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8b1c1120-8c39-4bd7-8a12-ffb01b99dbae tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:39.471658 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8b1c1120-8c39-4bd7-8a12-ffb01b99dbae tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:39.472354 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8b1c1120-8c39-4bd7-8a12-ffb01b99dbae tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:39.482560 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8b1c1120-8c39-4bd7-8a12-ffb01b99dbae tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:39.491343 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-dc53da07-b523-4756-a881-0de0371f6c16 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] HTTP exception thrown: Instance f726f3f3-4731-4380-9163-b2273b629810 could not be found. Oct 04 18:47:39.493168 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-dc53da07-b523-4756-a881-0de0371f6c16 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Request method failure captured: Oct 04 18:47:39.493168 n-d-851028-13 devstack@n-api.service[123595]: request: GET /compute/v2.1/servers/f726f3f3-4731-4380-9163-b2273b629810 HTTP/1.1 Oct 04 18:47:39.493168 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 18:47:39.493168 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 18:47:39.493168 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 18:47:39.493168 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 0 Oct 04 18:47:39.493168 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 18:47:39.493168 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 18:47:39.493168 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 18:47:39.493168 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 18:47:39.493168 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPH6ImUsc0v5avJaXbAf95n6vmfztxEtTiW32SRLH_bOmBbny3fOGIWm6DaSHmvRnWhZ-84faOFvXqXs-7dDoMftV5mgOWVN0Q9OrVISe3irL7FfmyYZmGssWLEuXGLXQhTtdNOFN9115Lqu5biPYPUWU74K-2mRSRsiih09WbGDmZQI Oct 04 18:47:39.493168 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 18:47:39.493168 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 18:47:39.493168 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 18:47:39.493168 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 18:47:39.493168 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 18:47:39.493168 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 18:47:39.493168 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: eda6bd34bf5540ee95c8144f185eb22d Oct 04 18:47:39.493168 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1155401912 Oct 04 18:47:39.493168 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 18:47:39.493168 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 18:47:39.493168 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/eda6bd34bf5540ee95c8144f185eb22d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_eda6bd34bf5540ee95c8144f185eb22d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/eda6bd34bf5540ee95c8144f185eb22d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/eda6bd34bf5540ee95c8144f185eb22d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:47:39.493168 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1155401912 Oct 04 18:47:39.493168 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: eda6bd34bf5540ee95c8144f185eb22d Oct 04 18:47:39.493168 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1155401912 Oct 04 18:47:39.493168 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-ServerRescueNegativeTestJSON-1155401912-project Oct 04 18:47:39.493168 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 18:47:39.493168 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 18:47:39.493168 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: 96e7480de94c43909045ac1087e40cd8 Oct 04 18:47:39.493168 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1155401912-project Oct 04 18:47:39.493168 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 18:47:39.493168 n-d-851028-13 devstack@n-api.service[123595]: exception: Instance f726f3f3-4731-4380-9163-b2273b629810 could not be found. Oct 04 18:47:39.493168 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': 'f726f3f3-4731-4380-9163-b2273b629810'} Oct 04 18:47:39.493168 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:47:39.493168 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:47:39.493168 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:47:39.493168 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:47:39.493168 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:47:39.493168 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:47:39.493168 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:47:39.493168 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:47:39.493168 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:47:39.493168 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:47:39.493168 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f726f3f3-4731-4380-9163-b2273b629810 could not be found. Oct 04 18:47:39.493168 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:47:39.493168 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:47:39.493168 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:47:39.493168 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:47:39.493168 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:47:39.493168 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:47:39.493168 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:47:39.493168 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:47:39.493168 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:47:39.493168 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:47:39.493168 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:47:39.493168 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:47:39.493168 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:47:39.493168 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:47:39.493168 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:47:39.493168 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:47:39.493168 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f726f3f3-4731-4380-9163-b2273b629810 could not be found. Oct 04 18:47:39.493168 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:47:39.493168 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:47:39.502164 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:47:39.502164 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:47:39.502164 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:47:39.502164 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:47:39.502164 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:47:39.502164 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:47:39.502164 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f726f3f3-4731-4380-9163-b2273b629810 could not be found. Oct 04 18:47:39.502164 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:47:39.502164 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-dc53da07-b523-4756-a881-0de0371f6c16 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] Returning 404 to user: Instance f726f3f3-4731-4380-9163-b2273b629810 could not be found. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:47:39.502164 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-dc53da07-b523-4756-a881-0de0371f6c16 tempest-ServerRescueNegativeTestJSON-1155401912 tempest-ServerRescueNegativeTestJSON-1155401912-project] 10.222.0.43 "GET /compute/v2.1/servers/f726f3f3-4731-4380-9163-b2273b629810" status: 404 len: 111 microversion: 2.1 time: 0.128115 Oct 04 18:47:39.502164 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1821/3880] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:39 2022] GET /compute/v2.1/servers/f726f3f3-4731-4380-9163-b2273b629810 => generated 111 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:47:39.930591 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-8b1c1120-8c39-4bd7-8a12-ffb01b99dbae tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9971b5861f44c1a1da94eda0f8f02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f809b8ae704988961908bef0f3cb24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:39.944025 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-8b1c1120-8c39-4bd7-8a12-ffb01b99dbae tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] 10.222.0.43 "GET /compute/v2.1/servers/fd09cc9b-d9dd-4133-8665-eeb6d8f51df8" status: 200 len: 1381 microversion: 2.1 time: 0.501443 Oct 04 18:47:39.946902 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2060/3881] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:39 2022] GET /compute/v2.1/servers/fd09cc9b-d9dd-4133-8665-eeb6d8f51df8 => generated 1381 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:47:39.970844 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-cc058be9-3747-40fb-a61d-334f92c30829 tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] Calling method '.version_select at 0x7fb21edf8280>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:39.991975 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cc058be9-3747-40fb-a61d-334f92c30829 tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:39.996329 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cc058be9-3747-40fb-a61d-334f92c30829 tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:39.997032 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cc058be9-3747-40fb-a61d-334f92c30829 tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:40.021648 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-cc058be9-3747-40fb-a61d-334f92c30829 tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] 10.222.0.43 "GET /compute/v2.1/os-migrations" status: 200 len: 1569 microversion: 2.1 time: 0.054756 Oct 04 18:47:40.032430 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1822/3882] 10.222.0.43 () {58 vars in 1143 bytes} [Tue Oct 4 18:47:39 2022] GET /compute/v2.1/os-migrations => generated 1569 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:40.037477 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-4e6d7dc7-f269-487d-94fa-23237c1983bb tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:40.038216 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-4e6d7dc7-f269-487d-94fa-23237c1983bb tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] [instance: fd09cc9b-d9dd-4133-8665-eeb6d8f51df8] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:40.064504 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4e6d7dc7-f269-487d-94fa-23237c1983bb tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:40.071606 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4e6d7dc7-f269-487d-94fa-23237c1983bb tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:40.072325 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4e6d7dc7-f269-487d-94fa-23237c1983bb tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:40.075251 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4e6d7dc7-f269-487d-94fa-23237c1983bb tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:40.076382 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4e6d7dc7-f269-487d-94fa-23237c1983bb tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:40.088609 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4e6d7dc7-f269-487d-94fa-23237c1983bb tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:40.134307 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-ef61a978-3fa0-4db8-91b6-a520e26ff26b tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:40.135194 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-ef61a978-3fa0-4db8-91b6-a520e26ff26b tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] [instance: 78c4f56c-fc4d-403b-98aa-5ff2cdf1931c] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:40.151620 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ef61a978-3fa0-4db8-91b6-a520e26ff26b tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:40.152115 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ef61a978-3fa0-4db8-91b6-a520e26ff26b tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:40.155225 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ef61a978-3fa0-4db8-91b6-a520e26ff26b tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:40.157575 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ef61a978-3fa0-4db8-91b6-a520e26ff26b tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:40.161909 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ef61a978-3fa0-4db8-91b6-a520e26ff26b tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:40.162780 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ef61a978-3fa0-4db8-91b6-a520e26ff26b tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:40.168275 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:47:40.525503 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-4e6d7dc7-f269-487d-94fa-23237c1983bb tempest-LiveMigrationTest-1083014954 tempest-LiveMigrationTest-1083014954-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/fd09cc9b-d9dd-4133-8665-eeb6d8f51df8" status: 200 len: 1534 microversion: 2.1 time: 0.492430 Oct 04 18:47:40.526553 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2061/3883] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:40 2022] GET /compute/v2.1/servers/fd09cc9b-d9dd-4133-8665-eeb6d8f51df8 => generated 1534 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:40.532705 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-cbb9a529-bd8c-4395-aae0-39beaf08b5b9 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:40.533226 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-cbb9a529-bd8c-4395-aae0-39beaf08b5b9 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] [instance: 76d475ab-f41c-44df-8aaa-10242bdbfcde] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:40.560270 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cbb9a529-bd8c-4395-aae0-39beaf08b5b9 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:40.562341 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cbb9a529-bd8c-4395-aae0-39beaf08b5b9 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:40.562994 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cbb9a529-bd8c-4395-aae0-39beaf08b5b9 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:40.564301 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cbb9a529-bd8c-4395-aae0-39beaf08b5b9 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:40.565218 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cbb9a529-bd8c-4395-aae0-39beaf08b5b9 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:40.565916 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cbb9a529-bd8c-4395-aae0-39beaf08b5b9 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:40.693199 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.objects.instance [None req-cbb9a529-bd8c-4395-aae0-39beaf08b5b9 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lazy-loading 'services' on Instance uuid 76d475ab-f41c-44df-8aaa-10242bdbfcde {{(pid=123596) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:47:40.785592 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-cbb9a529-bd8c-4395-aae0-39beaf08b5b9 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] 10.222.0.43 "DELETE /compute/v2.1/servers/76d475ab-f41c-44df-8aaa-10242bdbfcde/os-volume_attachments/a2630be4-30c5-4e17-ac5c-fc387b663760" status: 202 len: 0 microversion: 2.1 time: 0.257627 Oct 04 18:47:40.790134 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2062/3884] 10.222.0.43 () {58 vars in 1416 bytes} [Tue Oct 4 18:47:40 2022] DELETE /compute/v2.1/servers/76d475ab-f41c-44df-8aaa-10242bdbfcde/os-volume_attachments/a2630be4-30c5-4e17-ac5c-fc387b663760 => generated 0 bytes in 263 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:47:40.824972 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-26c1cfea-3655-4bb3-ad91-8a7d9410569a tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:40.825990 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-26c1cfea-3655-4bb3-ad91-8a7d9410569a tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] [instance: fd09cc9b-d9dd-4133-8665-eeb6d8f51df8] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:40.857489 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-ef61a978-3fa0-4db8-91b6-a520e26ff26b tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcbf2b4b95743af9e6fa1be54554baa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab4da2b9b9f4c7a9c25b7edaab3027d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:40.862641 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-26c1cfea-3655-4bb3-ad91-8a7d9410569a tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:40.863843 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-26c1cfea-3655-4bb3-ad91-8a7d9410569a tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:40.866501 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-26c1cfea-3655-4bb3-ad91-8a7d9410569a tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:40.873801 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-ef61a978-3fa0-4db8-91b6-a520e26ff26b tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] 10.222.0.43 "GET /compute/v2.1/servers/78c4f56c-fc4d-403b-98aa-5ff2cdf1931c" status: 200 len: 1285 microversion: 2.1 time: 0.743460 Oct 04 18:47:40.879993 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-26c1cfea-3655-4bb3-ad91-8a7d9410569a tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:40.880979 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-26c1cfea-3655-4bb3-ad91-8a7d9410569a tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:40.882305 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-26c1cfea-3655-4bb3-ad91-8a7d9410569a tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:40.889744 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1823/3885] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:40 2022] GET /compute/v2.1/servers/78c4f56c-fc4d-403b-98aa-5ff2cdf1931c => generated 1285 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:47:40.957374 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-26c1cfea-3655-4bb3-ad91-8a7d9410569a tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] [instance: fd09cc9b-d9dd-4133-8665-eeb6d8f51df8] Going to try to terminate instance {{(pid=123596) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:47:41.108001 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-26c1cfea-3655-4bb3-ad91-8a7d9410569a tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] 10.222.0.43 "DELETE /compute/v2.1/servers/fd09cc9b-d9dd-4133-8665-eeb6d8f51df8" status: 204 len: 0 microversion: 2.1 time: 0.313998 Oct 04 18:47:41.108837 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2063/3886] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 18:47:40 2022] DELETE /compute/v2.1/servers/fd09cc9b-d9dd-4133-8665-eeb6d8f51df8 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:47:41.126563 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-23905b9d-870f-41f5-b8c6-3be0021150e4 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:41.128677 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-23905b9d-870f-41f5-b8c6-3be0021150e4 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] [instance: fd09cc9b-d9dd-4133-8665-eeb6d8f51df8] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:41.146607 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-23905b9d-870f-41f5-b8c6-3be0021150e4 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:41.151504 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-23905b9d-870f-41f5-b8c6-3be0021150e4 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:41.152507 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-23905b9d-870f-41f5-b8c6-3be0021150e4 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:41.157134 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-23905b9d-870f-41f5-b8c6-3be0021150e4 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:41.158991 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-23905b9d-870f-41f5-b8c6-3be0021150e4 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:41.162162 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-23905b9d-870f-41f5-b8c6-3be0021150e4 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:41.500141 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-23905b9d-870f-41f5-b8c6-3be0021150e4 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9971b5861f44c1a1da94eda0f8f02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f809b8ae704988961908bef0f3cb24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:41.516331 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-23905b9d-870f-41f5-b8c6-3be0021150e4 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] 10.222.0.43 "GET /compute/v2.1/servers/fd09cc9b-d9dd-4133-8665-eeb6d8f51df8" status: 200 len: 1387 microversion: 2.1 time: 0.401795 Oct 04 18:47:41.517538 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1824/3887] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:41 2022] GET /compute/v2.1/servers/fd09cc9b-d9dd-4133-8665-eeb6d8f51df8 => generated 1387 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:41.904504 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-a9c74f83-1f87-4efe-b88d-a52a42de8e0f tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:41.907483 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-a9c74f83-1f87-4efe-b88d-a52a42de8e0f tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] [instance: 78c4f56c-fc4d-403b-98aa-5ff2cdf1931c] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:41.928521 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a9c74f83-1f87-4efe-b88d-a52a42de8e0f tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:41.933342 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a9c74f83-1f87-4efe-b88d-a52a42de8e0f tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:41.936320 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a9c74f83-1f87-4efe-b88d-a52a42de8e0f tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:41.939045 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a9c74f83-1f87-4efe-b88d-a52a42de8e0f tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:41.939976 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a9c74f83-1f87-4efe-b88d-a52a42de8e0f tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:41.941901 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a9c74f83-1f87-4efe-b88d-a52a42de8e0f tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:42.165561 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-a9c74f83-1f87-4efe-b88d-a52a42de8e0f tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcbf2b4b95743af9e6fa1be54554baa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab4da2b9b9f4c7a9c25b7edaab3027d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:42.178974 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-a9c74f83-1f87-4efe-b88d-a52a42de8e0f tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] 10.222.0.43 "GET /compute/v2.1/servers/78c4f56c-fc4d-403b-98aa-5ff2cdf1931c" status: 200 len: 1283 microversion: 2.1 time: 0.282317 Oct 04 18:47:42.189191 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2064/3888] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:41 2022] GET /compute/v2.1/servers/78c4f56c-fc4d-403b-98aa-5ff2cdf1931c => generated 1283 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:42.542276 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-000252ce-8467-4cfb-b05a-5786890d66e5 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:42.544768 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-000252ce-8467-4cfb-b05a-5786890d66e5 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] [instance: fd09cc9b-d9dd-4133-8665-eeb6d8f51df8] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:42.560322 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-000252ce-8467-4cfb-b05a-5786890d66e5 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:42.563007 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-000252ce-8467-4cfb-b05a-5786890d66e5 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:42.566633 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-000252ce-8467-4cfb-b05a-5786890d66e5 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:42.569000 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-000252ce-8467-4cfb-b05a-5786890d66e5 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:42.572220 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-000252ce-8467-4cfb-b05a-5786890d66e5 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:42.572901 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-000252ce-8467-4cfb-b05a-5786890d66e5 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:43.024616 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-914da62e-3a70-4b0c-967d-22cdef023fb3 tempest-MultipleCreateNegativeTestJSON-663667772 tempest-MultipleCreateNegativeTestJSON-663667772-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1434900807", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:47:43.028731 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-914da62e-3a70-4b0c-967d-22cdef023fb3 tempest-MultipleCreateNegativeTestJSON-663667772 tempest-MultipleCreateNegativeTestJSON-663667772-project] HTTP exception thrown: min_count must be <= max_count Oct 04 18:47:43.045075 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-914da62e-3a70-4b0c-967d-22cdef023fb3 tempest-MultipleCreateNegativeTestJSON-663667772 tempest-MultipleCreateNegativeTestJSON-663667772-project] Request method failure captured: Oct 04 18:47:43.045075 n-d-851028-13 devstack@n-api.service[123596]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 18:47:43.045075 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:47:43.045075 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:47:43.045075 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:47:43.045075 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 184 Oct 04 18:47:43.045075 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:47:43.045075 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:47:43.045075 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:47:43.045075 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:47:43.045075 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPH_OBTcokmFGF3TnpjhoXHqhXqwLUmBw6y2Ffi5oJy9i1nY2nNE5tfMHbo_rEUakFzzemSoW3mPWtJqX3eOK3EMyBEj6egvR6rh8-PH_54GpMixWjoZR5B_gsmwUrYDNymSZPWuAZlyXGU3etse05qy21deT-bEQlbEq0fU9UThnjus Oct 04 18:47:43.045075 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:47:43.045075 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:47:43.045075 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:47:43.045075 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:47:43.045075 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:47:43.045075 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:47:43.045075 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: 92651d7a6ba243fba5d4f443f2ddbdc6 Oct 04 18:47:43.045075 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-663667772 Oct 04 18:47:43.045075 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 18:47:43.045075 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 18:47:43.045075 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/92651d7a6ba243fba5d4f443f2ddbdc6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_92651d7a6ba243fba5d4f443f2ddbdc6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/92651d7a6ba243fba5d4f443f2ddbdc6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/92651d7a6ba243fba5d4f443f2ddbdc6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:47:43.045075 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-663667772 Oct 04 18:47:43.045075 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: 92651d7a6ba243fba5d4f443f2ddbdc6 Oct 04 18:47:43.045075 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-663667772 Oct 04 18:47:43.045075 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-MultipleCreateNegativeTestJSON-663667772-project Oct 04 18:47:43.045075 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:47:43.045075 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:47:43.045075 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 9415c31ed64a4f5393ba0f6f03ff3790 Oct 04 18:47:43.045075 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-663667772-project Oct 04 18:47:43.045075 n-d-851028-13 devstack@n-api.service[123596]: Oct 04 18:47:43.045075 n-d-851028-13 devstack@n-api.service[123596]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1434900807", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452", "min_count": 3, "max_count": 2}} Oct 04 18:47:43.045075 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 18:47:43.045075 n-d-851028-13 devstack@n-api.service[123596]: exception: min_count must be <= max_count Oct 04 18:47:43.045075 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1434900807', 'imageRef': 'e8943ec5-4038-4d4b-b9b9-2415a79f5243', 'flavorRef': '452', 'min_count': 3, 'max_count': 2}}} Oct 04 18:47:43.045075 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:47:43.045075 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:47:43.045075 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:47:43.045075 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:47:43.045075 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:47:43.045075 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:47:43.045075 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:47:43.045075 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:47:43.045075 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:47:43.045075 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:47:43.045075 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:47:43.045075 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:47:43.045075 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:47:43.045075 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:47:43.045075 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 18:47:43.045075 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 726, in create Oct 04 18:47:43.045075 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 04 18:47:43.045075 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: min_count must be <= max_count Oct 04 18:47:43.045075 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:47:43.045075 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:47:43.045075 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:47:43.045075 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:47:43.045075 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:47:43.045075 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:47:43.045075 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:47:43.045075 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:47:43.045075 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: min_count must be <= max_count Oct 04 18:47:43.045075 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:47:43.053589 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-914da62e-3a70-4b0c-967d-22cdef023fb3 tempest-MultipleCreateNegativeTestJSON-663667772 tempest-MultipleCreateNegativeTestJSON-663667772-project] Returning 400 to user: min_count must be <= max_count {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:47:43.060757 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-914da62e-3a70-4b0c-967d-22cdef023fb3 tempest-MultipleCreateNegativeTestJSON-663667772 tempest-MultipleCreateNegativeTestJSON-663667772-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.362152 Oct 04 18:47:43.061711 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2065/3889] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 18:47:42 2022] POST /compute/v2.1/servers => generated 74 bytes in 364 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Oct 04 18:47:43.188816 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-993e7aef-a614-4b5a-84fa-e5d1d5f239b9 tempest-MultipleCreateNegativeTestJSON-663667772 tempest-MultipleCreateNegativeTestJSON-663667772-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-273728972", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452", "max_count": 0}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:47:43.221333 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-993e7aef-a614-4b5a-84fa-e5d1d5f239b9 tempest-MultipleCreateNegativeTestJSON-663667772 tempest-MultipleCreateNegativeTestJSON-663667772-project] Request method failure captured: Oct 04 18:47:43.221333 n-d-851028-13 devstack@n-api.service[123596]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 18:47:43.221333 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:47:43.221333 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:47:43.221333 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:47:43.221333 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 167 Oct 04 18:47:43.221333 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:47:43.221333 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:47:43.221333 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:47:43.221333 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:47:43.221333 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPH_OBTcokmFGF3TnpjhoXHqhXqwLUmBw6y2Ffi5oJy9i1nY2nNE5tfMHbo_rEUakFzzemSoW3mPWtJqX3eOK3EMyBEj6egvR6rh8-PH_54GpMixWjoZR5B_gsmwUrYDNymSZPWuAZlyXGU3etse05qy21deT-bEQlbEq0fU9UThnjus Oct 04 18:47:43.221333 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:47:43.221333 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:47:43.221333 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:47:43.221333 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:47:43.221333 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:47:43.221333 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:47:43.221333 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: 92651d7a6ba243fba5d4f443f2ddbdc6 Oct 04 18:47:43.221333 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-663667772 Oct 04 18:47:43.221333 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 18:47:43.221333 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 18:47:43.221333 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/92651d7a6ba243fba5d4f443f2ddbdc6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_92651d7a6ba243fba5d4f443f2ddbdc6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/92651d7a6ba243fba5d4f443f2ddbdc6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/92651d7a6ba243fba5d4f443f2ddbdc6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:47:43.221333 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-663667772 Oct 04 18:47:43.221333 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: 92651d7a6ba243fba5d4f443f2ddbdc6 Oct 04 18:47:43.221333 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-663667772 Oct 04 18:47:43.221333 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-MultipleCreateNegativeTestJSON-663667772-project Oct 04 18:47:43.221333 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:47:43.221333 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:47:43.221333 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 9415c31ed64a4f5393ba0f6f03ff3790 Oct 04 18:47:43.221333 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-663667772-project Oct 04 18:47:43.221333 n-d-851028-13 devstack@n-api.service[123596]: Oct 04 18:47:43.221333 n-d-851028-13 devstack@n-api.service[123596]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-273728972", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452", "max_count": 0}} Oct 04 18:47:43.221333 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 18:47:43.221333 n-d-851028-13 devstack@n-api.service[123596]: exception: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 04 18:47:43.221333 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-273728972', 'imageRef': 'e8943ec5-4038-4d4b-b9b9-2415a79f5243', 'flavorRef': '452', 'max_count': 0}}} Oct 04 18:47:43.221333 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:47:43.221333 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:47:43.221333 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:47:43.221333 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:47:43.221333 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:47:43.221333 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:47:43.221333 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 04 18:47:43.221333 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:47:43.221333 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['max_count']: Oct 04 18:47:43.221333 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 04 18:47:43.221333 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 04 18:47:43.221333 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 04 18:47:43.221333 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 04 18:47:43.221333 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:47:43.221333 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 04 18:47:43.221333 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi 0 Oct 04 18:47:43.221333 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:47:43.221333 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:47:43.221333 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:47:43.221333 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:47:43.221333 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:47:43.221333 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:47:43.221333 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:47:43.221333 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:47:43.221333 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:47:43.221333 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:47:43.221333 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:47:43.221333 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:47:43.221333 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 18:47:43.221333 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 18:47:43.226744 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:47:43.226744 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:47:43.226744 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:47:43.226744 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:47:43.226744 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 04 18:47:43.226744 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:47:43.226744 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:47:43.226744 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:47:43.226744 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:47:43.226744 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:47:43.226744 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:47:43.226744 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:47:43.226744 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:47:43.226744 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 04 18:47:43.226744 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:47:43.226744 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-993e7aef-a614-4b5a-84fa-e5d1d5f239b9 tempest-MultipleCreateNegativeTestJSON-663667772 tempest-MultipleCreateNegativeTestJSON-663667772-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:47:43.230010 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-993e7aef-a614-4b5a-84fa-e5d1d5f239b9 tempest-MultipleCreateNegativeTestJSON-663667772 tempest-MultipleCreateNegativeTestJSON-663667772-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.045850 Oct 04 18:47:43.230622 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2066/3890] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 18:47:43 2022] POST /compute/v2.1/servers => generated 130 bytes in 47 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 04 18:47:43.287111 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-47f18fe9-b3d7-459b-ac7d-84ba00590b24 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:43.288021 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-47f18fe9-b3d7-459b-ac7d-84ba00590b24 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] [instance: 78c4f56c-fc4d-403b-98aa-5ff2cdf1931c] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:43.303625 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-47f18fe9-b3d7-459b-ac7d-84ba00590b24 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:43.306734 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-47f18fe9-b3d7-459b-ac7d-84ba00590b24 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:43.307438 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-47f18fe9-b3d7-459b-ac7d-84ba00590b24 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:43.308719 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-47f18fe9-b3d7-459b-ac7d-84ba00590b24 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:43.309815 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-47f18fe9-b3d7-459b-ac7d-84ba00590b24 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:43.311808 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-47f18fe9-b3d7-459b-ac7d-84ba00590b24 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:43.545496 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-47f18fe9-b3d7-459b-ac7d-84ba00590b24 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcbf2b4b95743af9e6fa1be54554baa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab4da2b9b9f4c7a9c25b7edaab3027d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:43.565509 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-47f18fe9-b3d7-459b-ac7d-84ba00590b24 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] 10.222.0.43 "GET /compute/v2.1/servers/78c4f56c-fc4d-403b-98aa-5ff2cdf1931c" status: 200 len: 1283 microversion: 2.1 time: 0.310023 Oct 04 18:47:43.566017 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2067/3891] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:43 2022] GET /compute/v2.1/servers/78c4f56c-fc4d-403b-98aa-5ff2cdf1931c => generated 1283 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:43.587502 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-00c85553-5cea-45fa-b492-4ede903afe81 tempest-MultipleCreateNegativeTestJSON-663667772 tempest-MultipleCreateNegativeTestJSON-663667772-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-994990052", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452", "max_count": 2.5}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:47:43.598445 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-00c85553-5cea-45fa-b492-4ede903afe81 tempest-MultipleCreateNegativeTestJSON-663667772 tempest-MultipleCreateNegativeTestJSON-663667772-project] Request method failure captured: Oct 04 18:47:43.598445 n-d-851028-13 devstack@n-api.service[123596]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 18:47:43.598445 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:47:43.598445 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:47:43.598445 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:47:43.598445 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 169 Oct 04 18:47:43.598445 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:47:43.598445 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:47:43.598445 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:47:43.598445 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:47:43.598445 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPH_OBTcokmFGF3TnpjhoXHqhXqwLUmBw6y2Ffi5oJy9i1nY2nNE5tfMHbo_rEUakFzzemSoW3mPWtJqX3eOK3EMyBEj6egvR6rh8-PH_54GpMixWjoZR5B_gsmwUrYDNymSZPWuAZlyXGU3etse05qy21deT-bEQlbEq0fU9UThnjus Oct 04 18:47:43.598445 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:47:43.598445 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:47:43.598445 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:47:43.598445 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:47:43.598445 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:47:43.598445 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:47:43.598445 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: 92651d7a6ba243fba5d4f443f2ddbdc6 Oct 04 18:47:43.598445 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-663667772 Oct 04 18:47:43.598445 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 18:47:43.598445 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 18:47:43.598445 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/92651d7a6ba243fba5d4f443f2ddbdc6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_92651d7a6ba243fba5d4f443f2ddbdc6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/92651d7a6ba243fba5d4f443f2ddbdc6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/92651d7a6ba243fba5d4f443f2ddbdc6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:47:43.598445 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-663667772 Oct 04 18:47:43.598445 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: 92651d7a6ba243fba5d4f443f2ddbdc6 Oct 04 18:47:43.598445 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-663667772 Oct 04 18:47:43.598445 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-MultipleCreateNegativeTestJSON-663667772-project Oct 04 18:47:43.598445 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:47:43.598445 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:47:43.598445 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 9415c31ed64a4f5393ba0f6f03ff3790 Oct 04 18:47:43.598445 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-663667772-project Oct 04 18:47:43.598445 n-d-851028-13 devstack@n-api.service[123596]: Oct 04 18:47:43.598445 n-d-851028-13 devstack@n-api.service[123596]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-994990052", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452", "max_count": 2.5}} Oct 04 18:47:43.598445 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 18:47:43.598445 n-d-851028-13 devstack@n-api.service[123596]: exception: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 04 18:47:43.598445 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-994990052', 'imageRef': 'e8943ec5-4038-4d4b-b9b9-2415a79f5243', 'flavorRef': '452', 'max_count': 2.5}}} Oct 04 18:47:43.598445 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:47:43.598445 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:47:43.598445 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:47:43.598445 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:47:43.598445 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:47:43.598445 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:47:43.598445 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Oct 04 18:47:43.598445 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:47:43.598445 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['max_count']: Oct 04 18:47:43.598445 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 04 18:47:43.598445 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 04 18:47:43.598445 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 04 18:47:43.598445 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 04 18:47:43.598445 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:47:43.598445 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 04 18:47:43.598445 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi 2.5 Oct 04 18:47:43.598445 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:47:43.598445 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:47:43.598445 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:47:43.598445 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:47:43.598445 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:47:43.598445 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:47:43.598445 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:47:43.598445 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:47:43.598445 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:47:43.598445 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:47:43.598445 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:47:43.598445 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:47:43.598445 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 18:47:43.598445 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 18:47:43.604347 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:47:43.604347 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:47:43.604347 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:47:43.604347 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:47:43.604347 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 04 18:47:43.604347 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:47:43.604347 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:47:43.604347 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:47:43.604347 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:47:43.604347 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:47:43.604347 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:47:43.604347 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:47:43.604347 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:47:43.604347 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 04 18:47:43.604347 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:47:43.608951 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-00c85553-5cea-45fa-b492-4ede903afe81 tempest-MultipleCreateNegativeTestJSON-663667772 tempest-MultipleCreateNegativeTestJSON-663667772-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:47:43.612245 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-00c85553-5cea-45fa-b492-4ede903afe81 tempest-MultipleCreateNegativeTestJSON-663667772 tempest-MultipleCreateNegativeTestJSON-663667772-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.044761 Oct 04 18:47:43.614255 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2068/3892] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 18:47:43 2022] POST /compute/v2.1/servers => generated 139 bytes in 47 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:47:43.690826 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-ab9557d2-616d-4b4e-b316-6d5637add0c6 tempest-MultipleCreateNegativeTestJSON-663667772 tempest-MultipleCreateNegativeTestJSON-663667772-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1323052283", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452", "min_count": 0}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:47:43.695216 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-ab9557d2-616d-4b4e-b316-6d5637add0c6 tempest-MultipleCreateNegativeTestJSON-663667772 tempest-MultipleCreateNegativeTestJSON-663667772-project] Request method failure captured: Oct 04 18:47:43.695216 n-d-851028-13 devstack@n-api.service[123596]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 18:47:43.695216 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:47:43.695216 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:47:43.695216 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:47:43.695216 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 168 Oct 04 18:47:43.695216 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:47:43.695216 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:47:43.695216 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:47:43.695216 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:47:43.695216 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPH_OBTcokmFGF3TnpjhoXHqhXqwLUmBw6y2Ffi5oJy9i1nY2nNE5tfMHbo_rEUakFzzemSoW3mPWtJqX3eOK3EMyBEj6egvR6rh8-PH_54GpMixWjoZR5B_gsmwUrYDNymSZPWuAZlyXGU3etse05qy21deT-bEQlbEq0fU9UThnjus Oct 04 18:47:43.695216 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:47:43.695216 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:47:43.695216 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:47:43.695216 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:47:43.695216 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:47:43.695216 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:47:43.695216 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: 92651d7a6ba243fba5d4f443f2ddbdc6 Oct 04 18:47:43.695216 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-663667772 Oct 04 18:47:43.695216 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 18:47:43.695216 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 18:47:43.695216 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/92651d7a6ba243fba5d4f443f2ddbdc6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_92651d7a6ba243fba5d4f443f2ddbdc6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/92651d7a6ba243fba5d4f443f2ddbdc6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/92651d7a6ba243fba5d4f443f2ddbdc6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:47:43.695216 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-663667772 Oct 04 18:47:43.695216 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: 92651d7a6ba243fba5d4f443f2ddbdc6 Oct 04 18:47:43.695216 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-663667772 Oct 04 18:47:43.695216 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-MultipleCreateNegativeTestJSON-663667772-project Oct 04 18:47:43.695216 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:47:43.695216 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:47:43.695216 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 9415c31ed64a4f5393ba0f6f03ff3790 Oct 04 18:47:43.695216 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-663667772-project Oct 04 18:47:43.695216 n-d-851028-13 devstack@n-api.service[123596]: Oct 04 18:47:43.695216 n-d-851028-13 devstack@n-api.service[123596]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1323052283", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452", "min_count": 0}} Oct 04 18:47:43.695216 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 18:47:43.695216 n-d-851028-13 devstack@n-api.service[123596]: exception: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 04 18:47:43.695216 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1323052283', 'imageRef': 'e8943ec5-4038-4d4b-b9b9-2415a79f5243', 'flavorRef': '452', 'min_count': 0}}} Oct 04 18:47:43.695216 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:47:43.695216 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:47:43.695216 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:47:43.695216 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:47:43.695216 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:47:43.695216 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:47:43.695216 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 04 18:47:43.695216 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:47:43.695216 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['min_count']: Oct 04 18:47:43.695216 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 04 18:47:43.695216 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 04 18:47:43.695216 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 04 18:47:43.695216 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 04 18:47:43.695216 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:47:43.695216 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 04 18:47:43.695216 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi 0 Oct 04 18:47:43.695216 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:47:43.695216 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:47:43.695216 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:47:43.695216 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:47:43.695216 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:47:43.695216 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:47:43.695216 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:47:43.695216 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:47:43.695216 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:47:43.695216 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:47:43.695216 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:47:43.695216 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:47:43.695216 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 18:47:43.695216 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 18:47:43.700881 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:47:43.700881 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:47:43.700881 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:47:43.700881 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:47:43.700881 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 04 18:47:43.700881 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:47:43.700881 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:47:43.700881 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:47:43.700881 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:47:43.700881 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:47:43.700881 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:47:43.700881 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:47:43.700881 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:47:43.700881 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 04 18:47:43.700881 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:47:43.700881 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-ab9557d2-616d-4b4e-b316-6d5637add0c6 tempest-MultipleCreateNegativeTestJSON-663667772 tempest-MultipleCreateNegativeTestJSON-663667772-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:47:43.700881 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-ab9557d2-616d-4b4e-b316-6d5637add0c6 tempest-MultipleCreateNegativeTestJSON-663667772 tempest-MultipleCreateNegativeTestJSON-663667772-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.012564 Oct 04 18:47:43.709454 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2069/3893] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 18:47:43 2022] POST /compute/v2.1/servers => generated 130 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 04 18:47:43.803059 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-c24cd78b-3594-474a-8605-c0238c7b5e8d tempest-MultipleCreateNegativeTestJSON-663667772 tempest-MultipleCreateNegativeTestJSON-663667772-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-2103099063", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452", "min_count": 2.5}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:47:43.811353 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-c24cd78b-3594-474a-8605-c0238c7b5e8d tempest-MultipleCreateNegativeTestJSON-663667772 tempest-MultipleCreateNegativeTestJSON-663667772-project] Request method failure captured: Oct 04 18:47:43.811353 n-d-851028-13 devstack@n-api.service[123596]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 18:47:43.811353 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:47:43.811353 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:47:43.811353 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:47:43.811353 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 170 Oct 04 18:47:43.811353 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:47:43.811353 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:47:43.811353 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:47:43.811353 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:47:43.811353 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPH_OBTcokmFGF3TnpjhoXHqhXqwLUmBw6y2Ffi5oJy9i1nY2nNE5tfMHbo_rEUakFzzemSoW3mPWtJqX3eOK3EMyBEj6egvR6rh8-PH_54GpMixWjoZR5B_gsmwUrYDNymSZPWuAZlyXGU3etse05qy21deT-bEQlbEq0fU9UThnjus Oct 04 18:47:43.811353 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:47:43.811353 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:47:43.811353 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:47:43.811353 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:47:43.811353 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:47:43.811353 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:47:43.811353 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: 92651d7a6ba243fba5d4f443f2ddbdc6 Oct 04 18:47:43.811353 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-663667772 Oct 04 18:47:43.811353 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 18:47:43.811353 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 18:47:43.811353 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/92651d7a6ba243fba5d4f443f2ddbdc6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_92651d7a6ba243fba5d4f443f2ddbdc6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/92651d7a6ba243fba5d4f443f2ddbdc6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/92651d7a6ba243fba5d4f443f2ddbdc6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:47:43.811353 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-663667772 Oct 04 18:47:43.811353 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: 92651d7a6ba243fba5d4f443f2ddbdc6 Oct 04 18:47:43.811353 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-663667772 Oct 04 18:47:43.811353 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-MultipleCreateNegativeTestJSON-663667772-project Oct 04 18:47:43.811353 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:47:43.811353 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:47:43.811353 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 9415c31ed64a4f5393ba0f6f03ff3790 Oct 04 18:47:43.811353 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-663667772-project Oct 04 18:47:43.811353 n-d-851028-13 devstack@n-api.service[123596]: Oct 04 18:47:43.811353 n-d-851028-13 devstack@n-api.service[123596]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-2103099063", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452", "min_count": 2.5}} Oct 04 18:47:43.811353 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 18:47:43.811353 n-d-851028-13 devstack@n-api.service[123596]: exception: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 04 18:47:43.811353 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-2103099063', 'imageRef': 'e8943ec5-4038-4d4b-b9b9-2415a79f5243', 'flavorRef': '452', 'min_count': 2.5}}} Oct 04 18:47:43.811353 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:47:43.811353 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:47:43.811353 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:47:43.811353 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:47:43.811353 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:47:43.811353 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:47:43.811353 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Oct 04 18:47:43.811353 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:47:43.811353 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['min_count']: Oct 04 18:47:43.811353 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 04 18:47:43.811353 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 04 18:47:43.811353 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 04 18:47:43.811353 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 04 18:47:43.811353 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:47:43.811353 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 04 18:47:43.811353 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi 2.5 Oct 04 18:47:43.811353 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:47:43.811353 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:47:43.811353 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:47:43.811353 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:47:43.811353 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:47:43.811353 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:47:43.811353 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:47:43.811353 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:47:43.811353 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:47:43.811353 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:47:43.811353 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:47:43.811353 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:47:43.811353 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 18:47:43.811353 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 18:47:43.816180 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:47:43.816180 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:47:43.816180 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:47:43.816180 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:47:43.816180 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 04 18:47:43.816180 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:47:43.816180 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:47:43.816180 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:47:43.816180 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:47:43.816180 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:47:43.816180 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:47:43.816180 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:47:43.816180 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:47:43.816180 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 04 18:47:43.816180 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:47:43.819369 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-c24cd78b-3594-474a-8605-c0238c7b5e8d tempest-MultipleCreateNegativeTestJSON-663667772 tempest-MultipleCreateNegativeTestJSON-663667772-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:47:43.820805 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-c24cd78b-3594-474a-8605-c0238c7b5e8d tempest-MultipleCreateNegativeTestJSON-663667772 tempest-MultipleCreateNegativeTestJSON-663667772-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.024065 Oct 04 18:47:43.822028 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2070/3894] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 18:47:43 2022] POST /compute/v2.1/servers => generated 139 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 04 18:47:44.080606 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-000252ce-8467-4cfb-b05a-5786890d66e5 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9971b5861f44c1a1da94eda0f8f02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f809b8ae704988961908bef0f3cb24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:44.093497 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-000252ce-8467-4cfb-b05a-5786890d66e5 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] 10.222.0.43 "GET /compute/v2.1/servers/fd09cc9b-d9dd-4133-8665-eeb6d8f51df8" status: 200 len: 1387 microversion: 2.1 time: 1.556206 Oct 04 18:47:44.097964 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1825/3895] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:42 2022] GET /compute/v2.1/servers/fd09cc9b-d9dd-4133-8665-eeb6d8f51df8 => generated 1387 bytes in 1561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:44.595848 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-879efc66-5b16-472b-a395-5baa3c3ff8b5 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:44.597637 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-879efc66-5b16-472b-a395-5baa3c3ff8b5 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] [instance: 78c4f56c-fc4d-403b-98aa-5ff2cdf1931c] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:44.614410 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-879efc66-5b16-472b-a395-5baa3c3ff8b5 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:44.617370 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-879efc66-5b16-472b-a395-5baa3c3ff8b5 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:44.617957 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-879efc66-5b16-472b-a395-5baa3c3ff8b5 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:44.619519 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-879efc66-5b16-472b-a395-5baa3c3ff8b5 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:44.620326 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-879efc66-5b16-472b-a395-5baa3c3ff8b5 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:44.623937 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-879efc66-5b16-472b-a395-5baa3c3ff8b5 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:44.634426 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-77490b5a-6fb3-4112-b04f-080272cd4729 req-941921e5-5d43-4209-a2b5-000e80a8f637 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd09cc9b-d9dd-4133-8665-eeb6d8f51df8", "name": "network-vif-deleted", "tag": "538a7aa2-5b2b-4b33-a253-770b58f4066e"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:47:44.662803 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-77490b5a-6fb3-4112-b04f-080272cd4729 req-941921e5-5d43-4209-a2b5-000e80a8f637 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:44.664463 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-77490b5a-6fb3-4112-b04f-080272cd4729 req-941921e5-5d43-4209-a2b5-000e80a8f637 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:44.666058 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-77490b5a-6fb3-4112-b04f-080272cd4729 req-941921e5-5d43-4209-a2b5-000e80a8f637 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:44.714080 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-77490b5a-6fb3-4112-b04f-080272cd4729 req-941921e5-5d43-4209-a2b5-000e80a8f637 service nova] Creating event network-vif-deleted:538a7aa2-5b2b-4b33-a253-770b58f4066e for instance fd09cc9b-d9dd-4133-8665-eeb6d8f51df8 on n-h2-851028-13 Oct 04 18:47:44.734417 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-77490b5a-6fb3-4112-b04f-080272cd4729 req-941921e5-5d43-4209-a2b5-000e80a8f637 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105649 Oct 04 18:47:44.735565 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1826/3896] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:47:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Oct 04 18:47:45.108791 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-879efc66-5b16-472b-a395-5baa3c3ff8b5 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcbf2b4b95743af9e6fa1be54554baa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab4da2b9b9f4c7a9c25b7edaab3027d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:45.118301 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-879efc66-5b16-472b-a395-5baa3c3ff8b5 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] 10.222.0.43 "GET /compute/v2.1/servers/78c4f56c-fc4d-403b-98aa-5ff2cdf1931c" status: 200 len: 1325 microversion: 2.1 time: 0.528974 Oct 04 18:47:45.121437 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2071/3897] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:44 2022] GET /compute/v2.1/servers/78c4f56c-fc4d-403b-98aa-5ff2cdf1931c => generated 1325 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:45.126408 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-0c2570c3-4478-4147-9d79-90f143f1dcd0 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:45.127299 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-0c2570c3-4478-4147-9d79-90f143f1dcd0 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] [instance: fd09cc9b-d9dd-4133-8665-eeb6d8f51df8] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:45.137060 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0c2570c3-4478-4147-9d79-90f143f1dcd0 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:45.143923 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0c2570c3-4478-4147-9d79-90f143f1dcd0 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:45.144800 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0c2570c3-4478-4147-9d79-90f143f1dcd0 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:45.145856 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0c2570c3-4478-4147-9d79-90f143f1dcd0 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:45.146572 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0c2570c3-4478-4147-9d79-90f143f1dcd0 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:45.147232 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0c2570c3-4478-4147-9d79-90f143f1dcd0 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:45.300911 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-0c2570c3-4478-4147-9d79-90f143f1dcd0 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9971b5861f44c1a1da94eda0f8f02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f809b8ae704988961908bef0f3cb24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:45.315766 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-0c2570c3-4478-4147-9d79-90f143f1dcd0 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] 10.222.0.43 "GET /compute/v2.1/servers/fd09cc9b-d9dd-4133-8665-eeb6d8f51df8" status: 200 len: 1184 microversion: 2.1 time: 0.189010 Oct 04 18:47:45.317243 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1827/3898] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:45 2022] GET /compute/v2.1/servers/fd09cc9b-d9dd-4133-8665-eeb6d8f51df8 => generated 1184 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:47:46.158384 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-1ffe91b2-27ce-4c68-a01b-6e1a5c2431a3 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:46.163350 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-1ffe91b2-27ce-4c68-a01b-6e1a5c2431a3 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] [instance: 78c4f56c-fc4d-403b-98aa-5ff2cdf1931c] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:46.186856 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1ffe91b2-27ce-4c68-a01b-6e1a5c2431a3 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:46.187536 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1ffe91b2-27ce-4c68-a01b-6e1a5c2431a3 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:46.188117 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1ffe91b2-27ce-4c68-a01b-6e1a5c2431a3 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:46.191456 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1ffe91b2-27ce-4c68-a01b-6e1a5c2431a3 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:46.192213 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1ffe91b2-27ce-4c68-a01b-6e1a5c2431a3 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:46.193718 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1ffe91b2-27ce-4c68-a01b-6e1a5c2431a3 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:46.348803 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-253aca6e-600a-4751-82cd-ab1984156bb6 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:46.349999 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-253aca6e-600a-4751-82cd-ab1984156bb6 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] [instance: fd09cc9b-d9dd-4133-8665-eeb6d8f51df8] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:46.378926 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-253aca6e-600a-4751-82cd-ab1984156bb6 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:46.381659 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-253aca6e-600a-4751-82cd-ab1984156bb6 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:46.382894 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-253aca6e-600a-4751-82cd-ab1984156bb6 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:46.388234 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-253aca6e-600a-4751-82cd-ab1984156bb6 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:46.388831 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-253aca6e-600a-4751-82cd-ab1984156bb6 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:46.389488 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-253aca6e-600a-4751-82cd-ab1984156bb6 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:46.484793 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-1ffe91b2-27ce-4c68-a01b-6e1a5c2431a3 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcbf2b4b95743af9e6fa1be54554baa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab4da2b9b9f4c7a9c25b7edaab3027d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:46.493569 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-1ffe91b2-27ce-4c68-a01b-6e1a5c2431a3 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] 10.222.0.43 "GET /compute/v2.1/servers/78c4f56c-fc4d-403b-98aa-5ff2cdf1931c" status: 200 len: 1325 microversion: 2.1 time: 0.348228 Oct 04 18:47:46.494174 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2072/3899] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:46 2022] GET /compute/v2.1/servers/78c4f56c-fc4d-403b-98aa-5ff2cdf1931c => generated 1325 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:46.864083 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-253aca6e-600a-4751-82cd-ab1984156bb6 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9971b5861f44c1a1da94eda0f8f02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f809b8ae704988961908bef0f3cb24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:46.879711 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-253aca6e-600a-4751-82cd-ab1984156bb6 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] 10.222.0.43 "GET /compute/v2.1/servers/fd09cc9b-d9dd-4133-8665-eeb6d8f51df8" status: 200 len: 1184 microversion: 2.1 time: 0.538816 Oct 04 18:47:46.880317 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1828/3900] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:46 2022] GET /compute/v2.1/servers/fd09cc9b-d9dd-4133-8665-eeb6d8f51df8 => generated 1184 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:47.530628 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-a69f5b2d-4d77-4bd0-b478-fa542a1c38f9 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:47.531707 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-a69f5b2d-4d77-4bd0-b478-fa542a1c38f9 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] [instance: 78c4f56c-fc4d-403b-98aa-5ff2cdf1931c] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:47.580741 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a69f5b2d-4d77-4bd0-b478-fa542a1c38f9 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:47.581638 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a69f5b2d-4d77-4bd0-b478-fa542a1c38f9 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:47.582438 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a69f5b2d-4d77-4bd0-b478-fa542a1c38f9 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:47.583732 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a69f5b2d-4d77-4bd0-b478-fa542a1c38f9 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:47.601259 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a69f5b2d-4d77-4bd0-b478-fa542a1c38f9 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:47.602058 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a69f5b2d-4d77-4bd0-b478-fa542a1c38f9 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:47.909579 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-b785b794-a2f8-4b85-b353-43c6f1b81c50 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:47.912290 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-b785b794-a2f8-4b85-b353-43c6f1b81c50 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] [instance: fd09cc9b-d9dd-4133-8665-eeb6d8f51df8] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:47.914899 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=2 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:47:47.918980 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=8 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:47:47.953395 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b785b794-a2f8-4b85-b353-43c6f1b81c50 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:47.958932 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b785b794-a2f8-4b85-b353-43c6f1b81c50 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:47.962246 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b785b794-a2f8-4b85-b353-43c6f1b81c50 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:47.964170 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b785b794-a2f8-4b85-b353-43c6f1b81c50 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:47.964921 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b785b794-a2f8-4b85-b353-43c6f1b81c50 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:47.970354 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b785b794-a2f8-4b85-b353-43c6f1b81c50 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:48.266209 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-a69f5b2d-4d77-4bd0-b478-fa542a1c38f9 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcbf2b4b95743af9e6fa1be54554baa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab4da2b9b9f4c7a9c25b7edaab3027d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:48.279876 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-a69f5b2d-4d77-4bd0-b478-fa542a1c38f9 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] 10.222.0.43 "GET /compute/v2.1/servers/78c4f56c-fc4d-403b-98aa-5ff2cdf1931c" status: 200 len: 1325 microversion: 2.1 time: 0.759264 Oct 04 18:47:48.292183 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2073/3901] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:47 2022] GET /compute/v2.1/servers/78c4f56c-fc4d-403b-98aa-5ff2cdf1931c => generated 1325 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:48.650285 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-b785b794-a2f8-4b85-b353-43c6f1b81c50 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9971b5861f44c1a1da94eda0f8f02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f809b8ae704988961908bef0f3cb24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:48.668209 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-b785b794-a2f8-4b85-b353-43c6f1b81c50 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] 10.222.0.43 "GET /compute/v2.1/servers/fd09cc9b-d9dd-4133-8665-eeb6d8f51df8" status: 200 len: 1184 microversion: 2.1 time: 0.762140 Oct 04 18:47:48.673775 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1829/3902] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:47 2022] GET /compute/v2.1/servers/fd09cc9b-d9dd-4133-8665-eeb6d8f51df8 => generated 1184 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:49.320769 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-b32759f4-1a95-421a-855b-c674dda974df req-f0197534-4584-4640-a7b8-0541dca411aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "78c4f56c-fc4d-403b-98aa-5ff2cdf1931c", "tag": "66912c31-3599-47a9-8412-1c3084de5214"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:47:49.328481 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-39552870-2083-4ebc-bc96-1545654af2f1 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:49.329244 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-39552870-2083-4ebc-bc96-1545654af2f1 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] [instance: 78c4f56c-fc4d-403b-98aa-5ff2cdf1931c] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:49.368743 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-39552870-2083-4ebc-bc96-1545654af2f1 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:49.369289 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-39552870-2083-4ebc-bc96-1545654af2f1 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:49.369737 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-39552870-2083-4ebc-bc96-1545654af2f1 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:49.384409 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-39552870-2083-4ebc-bc96-1545654af2f1 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:49.385031 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-39552870-2083-4ebc-bc96-1545654af2f1 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:49.385541 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-39552870-2083-4ebc-bc96-1545654af2f1 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:49.392871 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-b32759f4-1a95-421a-855b-c674dda974df req-f0197534-4584-4640-a7b8-0541dca411aa service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:49.394496 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-b32759f4-1a95-421a-855b-c674dda974df req-f0197534-4584-4640-a7b8-0541dca411aa service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:49.394967 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-b32759f4-1a95-421a-855b-c674dda974df req-f0197534-4584-4640-a7b8-0541dca411aa service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:49.432213 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-b32759f4-1a95-421a-855b-c674dda974df req-f0197534-4584-4640-a7b8-0541dca411aa service nova] Creating event network-changed:66912c31-3599-47a9-8412-1c3084de5214 for instance 78c4f56c-fc4d-403b-98aa-5ff2cdf1931c on n-h2-851028-13 Oct 04 18:47:49.486747 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-b32759f4-1a95-421a-855b-c674dda974df req-f0197534-4584-4640-a7b8-0541dca411aa service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.171898 Oct 04 18:47:49.493222 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1830/3903] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:47:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:47:49.709467 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-30e5020f-3756-4fb1-8c18-329a4bac9184 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:49.710432 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-30e5020f-3756-4fb1-8c18-329a4bac9184 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] [instance: fd09cc9b-d9dd-4133-8665-eeb6d8f51df8] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:49.737637 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-30e5020f-3756-4fb1-8c18-329a4bac9184 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:49.738720 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-30e5020f-3756-4fb1-8c18-329a4bac9184 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:49.739185 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-30e5020f-3756-4fb1-8c18-329a4bac9184 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:49.739948 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-30e5020f-3756-4fb1-8c18-329a4bac9184 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:49.740413 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-30e5020f-3756-4fb1-8c18-329a4bac9184 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:49.740841 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-30e5020f-3756-4fb1-8c18-329a4bac9184 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:49.986874 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-30e5020f-3756-4fb1-8c18-329a4bac9184 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9971b5861f44c1a1da94eda0f8f02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f809b8ae704988961908bef0f3cb24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:49.998976 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-30e5020f-3756-4fb1-8c18-329a4bac9184 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] 10.222.0.43 "GET /compute/v2.1/servers/fd09cc9b-d9dd-4133-8665-eeb6d8f51df8" status: 200 len: 1184 microversion: 2.1 time: 0.304604 Oct 04 18:47:49.999590 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1831/3904] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:49 2022] GET /compute/v2.1/servers/fd09cc9b-d9dd-4133-8665-eeb6d8f51df8 => generated 1184 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:50.033977 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-39552870-2083-4ebc-bc96-1545654af2f1 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcbf2b4b95743af9e6fa1be54554baa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab4da2b9b9f4c7a9c25b7edaab3027d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:50.046396 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-39552870-2083-4ebc-bc96-1545654af2f1 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] 10.222.0.43 "GET /compute/v2.1/servers/78c4f56c-fc4d-403b-98aa-5ff2cdf1931c" status: 200 len: 1325 microversion: 2.1 time: 0.735812 Oct 04 18:47:50.058634 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2074/3905] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:49 2022] GET /compute/v2.1/servers/78c4f56c-fc4d-403b-98aa-5ff2cdf1931c => generated 1325 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:51.028477 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-cd2e343c-4fd1-43b5-8196-3a78e982b5a3 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:51.033355 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-cd2e343c-4fd1-43b5-8196-3a78e982b5a3 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] [instance: fd09cc9b-d9dd-4133-8665-eeb6d8f51df8] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:51.067481 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cd2e343c-4fd1-43b5-8196-3a78e982b5a3 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:51.070429 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cd2e343c-4fd1-43b5-8196-3a78e982b5a3 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:51.074357 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cd2e343c-4fd1-43b5-8196-3a78e982b5a3 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:51.085762 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cd2e343c-4fd1-43b5-8196-3a78e982b5a3 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:51.085762 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cd2e343c-4fd1-43b5-8196-3a78e982b5a3 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:51.085762 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cd2e343c-4fd1-43b5-8196-3a78e982b5a3 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:51.088861 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-7c87f8f2-8e99-4d83-b317-5a964ef09b14 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:51.090125 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-7c87f8f2-8e99-4d83-b317-5a964ef09b14 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] [instance: 78c4f56c-fc4d-403b-98aa-5ff2cdf1931c] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:51.106402 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7c87f8f2-8e99-4d83-b317-5a964ef09b14 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:51.107982 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7c87f8f2-8e99-4d83-b317-5a964ef09b14 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:51.112059 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7c87f8f2-8e99-4d83-b317-5a964ef09b14 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:51.114380 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7c87f8f2-8e99-4d83-b317-5a964ef09b14 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:51.115403 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7c87f8f2-8e99-4d83-b317-5a964ef09b14 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:51.119043 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7c87f8f2-8e99-4d83-b317-5a964ef09b14 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:51.258722 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-cd2e343c-4fd1-43b5-8196-3a78e982b5a3 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9971b5861f44c1a1da94eda0f8f02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f809b8ae704988961908bef0f3cb24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:51.273499 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-cd2e343c-4fd1-43b5-8196-3a78e982b5a3 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] 10.222.0.43 "GET /compute/v2.1/servers/fd09cc9b-d9dd-4133-8665-eeb6d8f51df8" status: 200 len: 1184 microversion: 2.1 time: 0.251967 Oct 04 18:47:51.292797 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1832/3906] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:51 2022] GET /compute/v2.1/servers/fd09cc9b-d9dd-4133-8665-eeb6d8f51df8 => generated 1184 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:51.304266 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-b156988c-fe42-49da-b3c1-54780719db11 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:47:51.319384 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b156988c-fe42-49da-b3c1-54780719db11 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:51.319888 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b156988c-fe42-49da-b3c1-54780719db11 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:51.320330 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b156988c-fe42-49da-b3c1-54780719db11 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:51.362102 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-b156988c-fe42-49da-b3c1-54780719db11 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] [instance: 76d475ab-f41c-44df-8aaa-10242bdbfcde] Going to try to stop instance {{(pid=123595) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 04 18:47:51.367840 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=100 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:47:51.449882 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-b156988c-fe42-49da-b3c1-54780719db11 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] 10.222.0.43 "POST /compute/v2.1/servers/76d475ab-f41c-44df-8aaa-10242bdbfcde/action" status: 202 len: 0 microversion: 2.1 time: 0.154406 Oct 04 18:47:51.450972 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1833/3907] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 18:47:51 2022] POST /compute/v2.1/servers/76d475ab-f41c-44df-8aaa-10242bdbfcde/action => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:47:51.718827 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-d27fc0e2-ae34-48c6-8cba-822f7486278d tempest-ComputeTenantNetworksTest-350359708 tempest-ComputeTenantNetworksTest-350359708-project] Calling method '.version_select at 0x7fb21eb5f160>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:51.972482 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-7c87f8f2-8e99-4d83-b317-5a964ef09b14 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcbf2b4b95743af9e6fa1be54554baa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab4da2b9b9f4c7a9c25b7edaab3027d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:51.989982 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-7c87f8f2-8e99-4d83-b317-5a964ef09b14 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] 10.222.0.43 "GET /compute/v2.1/servers/78c4f56c-fc4d-403b-98aa-5ff2cdf1931c" status: 200 len: 1325 microversion: 2.1 time: 0.914365 Oct 04 18:47:51.989982 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2075/3908] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:51 2022] GET /compute/v2.1/servers/78c4f56c-fc4d-403b-98aa-5ff2cdf1931c => generated 1325 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:51.995658 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-a4d22de3-6828-468d-9609-d9d0d547f1bc tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:51.996287 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-a4d22de3-6828-468d-9609-d9d0d547f1bc tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] [instance: 76d475ab-f41c-44df-8aaa-10242bdbfcde] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:52.006356 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a4d22de3-6828-468d-9609-d9d0d547f1bc tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:52.006868 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a4d22de3-6828-468d-9609-d9d0d547f1bc tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:52.007323 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a4d22de3-6828-468d-9609-d9d0d547f1bc tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:52.008197 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a4d22de3-6828-468d-9609-d9d0d547f1bc tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:52.008666 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a4d22de3-6828-468d-9609-d9d0d547f1bc tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:52.009136 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a4d22de3-6828-468d-9609-d9d0d547f1bc tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:52.556813 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-a4d22de3-6828-468d-9609-d9d0d547f1bc tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a116f2d9656548458264cc4fb1934c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff3c3dc76405401baf72fe00c5d50b56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:52.595069 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-a4d22de3-6828-468d-9609-d9d0d547f1bc tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] 10.222.0.43 "GET /compute/v2.1/servers/76d475ab-f41c-44df-8aaa-10242bdbfcde" status: 200 len: 1678 microversion: 2.1 time: 0.602046 Oct 04 18:47:52.596806 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2076/3909] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:51 2022] GET /compute/v2.1/servers/76d475ab-f41c-44df-8aaa-10242bdbfcde => generated 1678 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:52.607208 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-7a39ace7-7325-42d7-890e-3bef9162062a tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:52.613255 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-7a39ace7-7325-42d7-890e-3bef9162062a tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] [instance: fd09cc9b-d9dd-4133-8665-eeb6d8f51df8] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:52.630651 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7a39ace7-7325-42d7-890e-3bef9162062a tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:52.633818 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7a39ace7-7325-42d7-890e-3bef9162062a tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:52.634569 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7a39ace7-7325-42d7-890e-3bef9162062a tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:52.635765 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7a39ace7-7325-42d7-890e-3bef9162062a tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:52.637719 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7a39ace7-7325-42d7-890e-3bef9162062a tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:52.639338 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7a39ace7-7325-42d7-890e-3bef9162062a tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:52.744483 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-7a39ace7-7325-42d7-890e-3bef9162062a tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9971b5861f44c1a1da94eda0f8f02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f809b8ae704988961908bef0f3cb24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:52.755920 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-7a39ace7-7325-42d7-890e-3bef9162062a tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] 10.222.0.43 "GET /compute/v2.1/servers/fd09cc9b-d9dd-4133-8665-eeb6d8f51df8" status: 200 len: 1184 microversion: 2.1 time: 0.155929 Oct 04 18:47:52.772004 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2077/3910] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:52 2022] GET /compute/v2.1/servers/fd09cc9b-d9dd-4133-8665-eeb6d8f51df8 => generated 1184 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:53.008987 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-958dc6b9-0644-42af-af09-4f6f8503b359 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:53.009671 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-958dc6b9-0644-42af-af09-4f6f8503b359 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] [instance: 78c4f56c-fc4d-403b-98aa-5ff2cdf1931c] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:53.021776 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-958dc6b9-0644-42af-af09-4f6f8503b359 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:53.023820 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-958dc6b9-0644-42af-af09-4f6f8503b359 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:53.024908 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-958dc6b9-0644-42af-af09-4f6f8503b359 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:53.026167 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-958dc6b9-0644-42af-af09-4f6f8503b359 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:53.029685 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-958dc6b9-0644-42af-af09-4f6f8503b359 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:53.030171 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-958dc6b9-0644-42af-af09-4f6f8503b359 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:53.140226 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-d27fc0e2-ae34-48c6-8cba-822f7486278d tempest-ComputeTenantNetworksTest-350359708 tempest-ComputeTenantNetworksTest-350359708-project] 10.222.0.43 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 309 microversion: 2.1 time: 1.684526 Oct 04 18:47:53.140882 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1834/3911] 10.222.0.43 () {58 vars in 1158 bytes} [Tue Oct 4 18:47:51 2022] GET /compute/v2.1/os-tenant-networks => generated 309 bytes in 1689 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:47:53.152270 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-58f80c6b-3dc1-4f88-a269-f5300617ae99 tempest-ComputeTenantNetworksTest-350359708 tempest-ComputeTenantNetworksTest-350359708-project] Calling method '.version_select at 0x7fb21eb62a60>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:53.333848 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-958dc6b9-0644-42af-af09-4f6f8503b359 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcbf2b4b95743af9e6fa1be54554baa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab4da2b9b9f4c7a9c25b7edaab3027d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:53.347301 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-958dc6b9-0644-42af-af09-4f6f8503b359 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] 10.222.0.43 "GET /compute/v2.1/servers/78c4f56c-fc4d-403b-98aa-5ff2cdf1931c" status: 200 len: 1325 microversion: 2.1 time: 0.342167 Oct 04 18:47:53.349910 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2078/3912] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:53 2022] GET /compute/v2.1/servers/78c4f56c-fc4d-403b-98aa-5ff2cdf1931c => generated 1325 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:47:53.510978 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-58f80c6b-3dc1-4f88-a269-f5300617ae99 tempest-ComputeTenantNetworksTest-350359708 tempest-ComputeTenantNetworksTest-350359708-project] 10.222.0.43 "GET /compute/v2.1/os-tenant-networks/2cf09fe4-e995-440f-88b0-104169b5544f" status: 200 len: 140 microversion: 2.1 time: 0.362529 Oct 04 18:47:53.512023 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1835/3913] 10.222.0.43 () {58 vars in 1269 bytes} [Tue Oct 4 18:47:53 2022] GET /compute/v2.1/os-tenant-networks/2cf09fe4-e995-440f-88b0-104169b5544f => generated 140 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:47:53.653884 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-85078fa6-c4a9-44c3-ac11-fd8238234734 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:53.654678 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-85078fa6-c4a9-44c3-ac11-fd8238234734 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] [instance: 76d475ab-f41c-44df-8aaa-10242bdbfcde] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:53.674214 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-85078fa6-c4a9-44c3-ac11-fd8238234734 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:53.678346 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-85078fa6-c4a9-44c3-ac11-fd8238234734 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:53.680355 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-85078fa6-c4a9-44c3-ac11-fd8238234734 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:53.683617 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-85078fa6-c4a9-44c3-ac11-fd8238234734 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:53.684814 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-85078fa6-c4a9-44c3-ac11-fd8238234734 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:53.688964 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-85078fa6-c4a9-44c3-ac11-fd8238234734 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:53.784028 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-20da0a80-53e9-4c04-a927-076757b95030 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:53.784773 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-20da0a80-53e9-4c04-a927-076757b95030 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] [instance: fd09cc9b-d9dd-4133-8665-eeb6d8f51df8] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:53.806587 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-20da0a80-53e9-4c04-a927-076757b95030 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:53.807098 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-20da0a80-53e9-4c04-a927-076757b95030 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:53.807546 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-20da0a80-53e9-4c04-a927-076757b95030 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:53.808259 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-20da0a80-53e9-4c04-a927-076757b95030 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:53.808724 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-20da0a80-53e9-4c04-a927-076757b95030 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:53.812041 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-20da0a80-53e9-4c04-a927-076757b95030 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:53.936052 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-20da0a80-53e9-4c04-a927-076757b95030 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9971b5861f44c1a1da94eda0f8f02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f809b8ae704988961908bef0f3cb24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:53.949423 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-20da0a80-53e9-4c04-a927-076757b95030 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] 10.222.0.43 "GET /compute/v2.1/servers/fd09cc9b-d9dd-4133-8665-eeb6d8f51df8" status: 200 len: 1184 microversion: 2.1 time: 0.168246 Oct 04 18:47:53.966377 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1836/3914] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:53 2022] GET /compute/v2.1/servers/fd09cc9b-d9dd-4133-8665-eeb6d8f51df8 => generated 1184 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:54.184176 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-85078fa6-c4a9-44c3-ac11-fd8238234734 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a116f2d9656548458264cc4fb1934c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff3c3dc76405401baf72fe00c5d50b56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:54.201238 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-85078fa6-c4a9-44c3-ac11-fd8238234734 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] 10.222.0.43 "GET /compute/v2.1/servers/76d475ab-f41c-44df-8aaa-10242bdbfcde" status: 200 len: 1678 microversion: 2.1 time: 0.581977 Oct 04 18:47:54.225525 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2079/3915] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:53 2022] GET /compute/v2.1/servers/76d475ab-f41c-44df-8aaa-10242bdbfcde => generated 1678 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:54.375826 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-9c7bff4b-7922-47a9-ae66-a01058491a92 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:54.376817 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-9c7bff4b-7922-47a9-ae66-a01058491a92 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] [instance: 78c4f56c-fc4d-403b-98aa-5ff2cdf1931c] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:54.395883 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9c7bff4b-7922-47a9-ae66-a01058491a92 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:54.399718 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9c7bff4b-7922-47a9-ae66-a01058491a92 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:54.400626 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9c7bff4b-7922-47a9-ae66-a01058491a92 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:54.403178 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9c7bff4b-7922-47a9-ae66-a01058491a92 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:54.406153 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9c7bff4b-7922-47a9-ae66-a01058491a92 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:54.407855 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9c7bff4b-7922-47a9-ae66-a01058491a92 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:54.666338 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-85078fa6-c4a9-44c3-ac11-fd8238234734 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:54.667548 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-85078fa6-c4a9-44c3-ac11-fd8238234734 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] 10.222.0.43 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001540 Oct 04 18:47:54.667795 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2080/3916] 10.222.0.43 () {56 vars in 886 bytes} [Tue Oct 4 18:47:54 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (2 switches on core 0) Oct 04 18:47:54.974649 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-1c1ca3a5-2092-4184-b31e-3557d1bddd61 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:54.975292 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-1c1ca3a5-2092-4184-b31e-3557d1bddd61 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] [instance: fd09cc9b-d9dd-4133-8665-eeb6d8f51df8] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:54.992807 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1c1ca3a5-2092-4184-b31e-3557d1bddd61 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:54.994809 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1c1ca3a5-2092-4184-b31e-3557d1bddd61 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:54.998920 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1c1ca3a5-2092-4184-b31e-3557d1bddd61 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:55.001052 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1c1ca3a5-2092-4184-b31e-3557d1bddd61 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:55.001661 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1c1ca3a5-2092-4184-b31e-3557d1bddd61 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:55.002178 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1c1ca3a5-2092-4184-b31e-3557d1bddd61 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:55.060530 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:47:55.100451 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-9c7bff4b-7922-47a9-ae66-a01058491a92 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcbf2b4b95743af9e6fa1be54554baa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab4da2b9b9f4c7a9c25b7edaab3027d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:55.109902 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-9c7bff4b-7922-47a9-ae66-a01058491a92 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] 10.222.0.43 "GET /compute/v2.1/servers/78c4f56c-fc4d-403b-98aa-5ff2cdf1931c" status: 200 len: 1325 microversion: 2.1 time: 0.738986 Oct 04 18:47:55.112204 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1837/3917] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:54 2022] GET /compute/v2.1/servers/78c4f56c-fc4d-403b-98aa-5ff2cdf1931c => generated 1325 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:55.195599 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-1c1ca3a5-2092-4184-b31e-3557d1bddd61 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9971b5861f44c1a1da94eda0f8f02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f809b8ae704988961908bef0f3cb24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:55.212831 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-1c1ca3a5-2092-4184-b31e-3557d1bddd61 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] 10.222.0.43 "GET /compute/v2.1/servers/fd09cc9b-d9dd-4133-8665-eeb6d8f51df8" status: 200 len: 1184 microversion: 2.1 time: 0.241475 Oct 04 18:47:55.215060 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2081/3918] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:54 2022] GET /compute/v2.1/servers/fd09cc9b-d9dd-4133-8665-eeb6d8f51df8 => generated 1184 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:55.228858 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-78611e72-5dbb-469a-9ca2-f4ffd8212a1c tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:55.229759 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-78611e72-5dbb-469a-9ca2-f4ffd8212a1c tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] [instance: 76d475ab-f41c-44df-8aaa-10242bdbfcde] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:55.243635 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-78611e72-5dbb-469a-9ca2-f4ffd8212a1c tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:55.245662 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-78611e72-5dbb-469a-9ca2-f4ffd8212a1c tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:55.246584 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-78611e72-5dbb-469a-9ca2-f4ffd8212a1c tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:55.251749 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-78611e72-5dbb-469a-9ca2-f4ffd8212a1c tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:55.254809 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-78611e72-5dbb-469a-9ca2-f4ffd8212a1c tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:55.255443 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-78611e72-5dbb-469a-9ca2-f4ffd8212a1c tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:55.613840 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-78611e72-5dbb-469a-9ca2-f4ffd8212a1c tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a116f2d9656548458264cc4fb1934c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff3c3dc76405401baf72fe00c5d50b56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:55.625040 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-78611e72-5dbb-469a-9ca2-f4ffd8212a1c tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] 10.222.0.43 "GET /compute/v2.1/servers/76d475ab-f41c-44df-8aaa-10242bdbfcde" status: 200 len: 1678 microversion: 2.1 time: 0.400503 Oct 04 18:47:55.638193 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1838/3919] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:55 2022] GET /compute/v2.1/servers/76d475ab-f41c-44df-8aaa-10242bdbfcde => generated 1678 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:56.133758 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-9550c1d8-2267-4ea4-a520-004d9b7de3de tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:56.135133 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-9550c1d8-2267-4ea4-a520-004d9b7de3de tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] [instance: 78c4f56c-fc4d-403b-98aa-5ff2cdf1931c] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:56.157858 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9550c1d8-2267-4ea4-a520-004d9b7de3de tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:56.159822 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9550c1d8-2267-4ea4-a520-004d9b7de3de tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:56.164610 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9550c1d8-2267-4ea4-a520-004d9b7de3de tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:56.168696 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9550c1d8-2267-4ea4-a520-004d9b7de3de tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:56.169929 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9550c1d8-2267-4ea4-a520-004d9b7de3de tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:56.171833 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9550c1d8-2267-4ea4-a520-004d9b7de3de tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:56.242438 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-dbf316e7-e0af-47ba-a3ee-4f71b9963a7f tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:56.243290 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-dbf316e7-e0af-47ba-a3ee-4f71b9963a7f tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] [instance: fd09cc9b-d9dd-4133-8665-eeb6d8f51df8] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:56.260954 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dbf316e7-e0af-47ba-a3ee-4f71b9963a7f tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:56.263969 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dbf316e7-e0af-47ba-a3ee-4f71b9963a7f tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:56.264676 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dbf316e7-e0af-47ba-a3ee-4f71b9963a7f tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:56.267056 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dbf316e7-e0af-47ba-a3ee-4f71b9963a7f tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:56.269276 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dbf316e7-e0af-47ba-a3ee-4f71b9963a7f tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:56.279422 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dbf316e7-e0af-47ba-a3ee-4f71b9963a7f tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:56.440746 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-dbf316e7-e0af-47ba-a3ee-4f71b9963a7f tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9971b5861f44c1a1da94eda0f8f02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f809b8ae704988961908bef0f3cb24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:56.463105 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-dbf316e7-e0af-47ba-a3ee-4f71b9963a7f tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] 10.222.0.43 "GET /compute/v2.1/servers/fd09cc9b-d9dd-4133-8665-eeb6d8f51df8" status: 200 len: 1184 microversion: 2.1 time: 0.224993 Oct 04 18:47:56.464239 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1839/3920] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:56 2022] GET /compute/v2.1/servers/fd09cc9b-d9dd-4133-8665-eeb6d8f51df8 => generated 1184 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:56.626509 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-9550c1d8-2267-4ea4-a520-004d9b7de3de tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcbf2b4b95743af9e6fa1be54554baa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab4da2b9b9f4c7a9c25b7edaab3027d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:56.635993 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-9550c1d8-2267-4ea4-a520-004d9b7de3de tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] 10.222.0.43 "GET /compute/v2.1/servers/78c4f56c-fc4d-403b-98aa-5ff2cdf1931c" status: 200 len: 1325 microversion: 2.1 time: 0.506080 Oct 04 18:47:56.652170 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2082/3921] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:56 2022] GET /compute/v2.1/servers/78c4f56c-fc4d-403b-98aa-5ff2cdf1931c => generated 1325 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:56.663728 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-e98ca98a-acba-4364-95f3-1bd96b9caa9d tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:56.664457 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-e98ca98a-acba-4364-95f3-1bd96b9caa9d tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] [instance: 76d475ab-f41c-44df-8aaa-10242bdbfcde] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:56.681284 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e98ca98a-acba-4364-95f3-1bd96b9caa9d tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:56.685283 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e98ca98a-acba-4364-95f3-1bd96b9caa9d tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:56.686407 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e98ca98a-acba-4364-95f3-1bd96b9caa9d tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:56.687504 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e98ca98a-acba-4364-95f3-1bd96b9caa9d tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:56.693165 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e98ca98a-acba-4364-95f3-1bd96b9caa9d tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:56.694700 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e98ca98a-acba-4364-95f3-1bd96b9caa9d tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:57.007152 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-e98ca98a-acba-4364-95f3-1bd96b9caa9d tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a116f2d9656548458264cc4fb1934c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff3c3dc76405401baf72fe00c5d50b56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:57.020402 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-e98ca98a-acba-4364-95f3-1bd96b9caa9d tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] 10.222.0.43 "GET /compute/v2.1/servers/76d475ab-f41c-44df-8aaa-10242bdbfcde" status: 200 len: 1678 microversion: 2.1 time: 0.364873 Oct 04 18:47:57.021852 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1840/3922] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:56 2022] GET /compute/v2.1/servers/76d475ab-f41c-44df-8aaa-10242bdbfcde => generated 1678 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:57.329100 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-309dd89a-a999-47ae-a276-98bf0f8918d1 tempest-VolumesSnapshotsTestJSON-845312753 tempest-VolumesSnapshotsTestJSON-845312753-project] Action: 'create', calling method: .version_select at 0x7fb21ee000d0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1392442413"}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:47:57.493887 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-8c90467a-d7e4-4f1f-911d-210dfb92b40a tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:57.494511 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-8c90467a-d7e4-4f1f-911d-210dfb92b40a tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] [instance: fd09cc9b-d9dd-4133-8665-eeb6d8f51df8] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:57.509806 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8c90467a-d7e4-4f1f-911d-210dfb92b40a tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:57.521534 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8c90467a-d7e4-4f1f-911d-210dfb92b40a tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:57.522094 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8c90467a-d7e4-4f1f-911d-210dfb92b40a tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:57.522865 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8c90467a-d7e4-4f1f-911d-210dfb92b40a tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:57.533871 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8c90467a-d7e4-4f1f-911d-210dfb92b40a tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:57.534331 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8c90467a-d7e4-4f1f-911d-210dfb92b40a tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:57.675430 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-8c90467a-d7e4-4f1f-911d-210dfb92b40a tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9971b5861f44c1a1da94eda0f8f02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f809b8ae704988961908bef0f3cb24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:57.694653 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-8c90467a-d7e4-4f1f-911d-210dfb92b40a tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] 10.222.0.43 "GET /compute/v2.1/servers/fd09cc9b-d9dd-4133-8665-eeb6d8f51df8" status: 200 len: 1184 microversion: 2.1 time: 0.208289 Oct 04 18:47:57.697241 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1841/3923] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:57 2022] GET /compute/v2.1/servers/fd09cc9b-d9dd-4133-8665-eeb6d8f51df8 => generated 1184 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:57.937508 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-bf73ffce-73b5-4708-9614-109174116bf9 tempest-ExtensionsTest-8283472 tempest-ExtensionsTest-8283472-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:57.939650 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-bf73ffce-73b5-4708-9614-109174116bf9 tempest-ExtensionsTest-8283472 tempest-ExtensionsTest-8283472-project] 10.222.0.43 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.240865 Oct 04 18:47:57.940907 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1842/3924] 10.222.0.43 () {58 vars in 1170 bytes} [Tue Oct 4 18:47:57 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:47:57.950023 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-3a48a1a5-d7dc-4d66-bd4d-3c6dd6c73682 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:57.950904 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-3a48a1a5-d7dc-4d66-bd4d-3c6dd6c73682 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] [instance: 78c4f56c-fc4d-403b-98aa-5ff2cdf1931c] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:57.960730 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3a48a1a5-d7dc-4d66-bd4d-3c6dd6c73682 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:57.961499 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3a48a1a5-d7dc-4d66-bd4d-3c6dd6c73682 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:57.962292 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3a48a1a5-d7dc-4d66-bd4d-3c6dd6c73682 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:57.964237 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3a48a1a5-d7dc-4d66-bd4d-3c6dd6c73682 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:57.965033 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3a48a1a5-d7dc-4d66-bd4d-3c6dd6c73682 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:57.966533 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3a48a1a5-d7dc-4d66-bd4d-3c6dd6c73682 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:57.984313 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-309dd89a-a999-47ae-a276-98bf0f8918d1 tempest-VolumesSnapshotsTestJSON-845312753 tempest-VolumesSnapshotsTestJSON-845312753-project] 10.222.0.43 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 1.107678 Oct 04 18:47:57.984958 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2083/3925] 10.222.0.43 () {60 vars in 1155 bytes} [Tue Oct 4 18:47:56 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 1109 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Oct 04 18:47:57.990340 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-9f3c1df4-6c66-4057-9520-8bf1d308b045 req-71c0f5ad-4ff8-4939-9b3b-c0e2abeda36e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78c4f56c-fc4d-403b-98aa-5ff2cdf1931c", "name": "network-vif-plugged", "status": "completed", "tag": "66912c31-3599-47a9-8412-1c3084de5214"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:47:58.014692 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=2 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:47:58.036867 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-9f3c1df4-6c66-4057-9520-8bf1d308b045 req-71c0f5ad-4ff8-4939-9b3b-c0e2abeda36e service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:58.037489 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-9f3c1df4-6c66-4057-9520-8bf1d308b045 req-71c0f5ad-4ff8-4939-9b3b-c0e2abeda36e service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:58.037833 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-9f3c1df4-6c66-4057-9520-8bf1d308b045 req-71c0f5ad-4ff8-4939-9b3b-c0e2abeda36e service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:58.056690 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-9f3c1df4-6c66-4057-9520-8bf1d308b045 req-71c0f5ad-4ff8-4939-9b3b-c0e2abeda36e service nova] Creating event network-vif-plugged:66912c31-3599-47a9-8412-1c3084de5214 for instance 78c4f56c-fc4d-403b-98aa-5ff2cdf1931c on n-h2-851028-13 Oct 04 18:47:58.081584 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-9f3c1df4-6c66-4057-9520-8bf1d308b045 req-71c0f5ad-4ff8-4939-9b3b-c0e2abeda36e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095068 Oct 04 18:47:58.086210 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2084/3926] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:47:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:47:58.095920 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-b663a361-ecc7-427f-9c57-03dd9e0cbea1 tempest-ExtensionsTest-8283472 tempest-ExtensionsTest-8283472-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:58.099032 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-b663a361-ecc7-427f-9c57-03dd9e0cbea1 tempest-ExtensionsTest-8283472 tempest-ExtensionsTest-8283472-project] 10.222.0.43 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.011418 Oct 04 18:47:58.117773 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2085/3927] 10.222.0.43 () {58 vars in 1134 bytes} [Tue Oct 4 18:47:58 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:47:58.144053 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-30c71710-001a-442b-91c6-054512283270 tempest-VolumesSnapshotsTestJSON-845312753 tempest-VolumesSnapshotsTestJSON-845312753-project] Calling method '.version_select at 0x7fb227e411f0>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:58.278139 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-30c71710-001a-442b-91c6-054512283270 tempest-VolumesSnapshotsTestJSON-845312753 tempest-VolumesSnapshotsTestJSON-845312753-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/bad834ef-84d4-4642-8ea3-f2ee9d736da4" status: 200 len: 345 microversion: 2.1 time: 0.157386 Oct 04 18:47:58.279073 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2086/3928] 10.222.0.43 () {58 vars in 1245 bytes} [Tue Oct 4 18:47:58 2022] GET /compute/v2.1/os-volumes/bad834ef-84d4-4642-8ea3-f2ee9d736da4 => generated 345 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:47:58.291959 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-df0880aa-6e61-494a-ac23-b23e2a0bab7f tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:58.294287 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-df0880aa-6e61-494a-ac23-b23e2a0bab7f tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] [instance: 76d475ab-f41c-44df-8aaa-10242bdbfcde] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:58.315232 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-df0880aa-6e61-494a-ac23-b23e2a0bab7f tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:58.317644 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-df0880aa-6e61-494a-ac23-b23e2a0bab7f tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:58.318220 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-df0880aa-6e61-494a-ac23-b23e2a0bab7f tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:58.320124 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-df0880aa-6e61-494a-ac23-b23e2a0bab7f tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:58.321825 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-df0880aa-6e61-494a-ac23-b23e2a0bab7f tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:58.323957 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-3a48a1a5-d7dc-4d66-bd4d-3c6dd6c73682 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcbf2b4b95743af9e6fa1be54554baa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab4da2b9b9f4c7a9c25b7edaab3027d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:58.324728 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-df0880aa-6e61-494a-ac23-b23e2a0bab7f tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:58.333037 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-3a48a1a5-d7dc-4d66-bd4d-3c6dd6c73682 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] 10.222.0.43 "GET /compute/v2.1/servers/78c4f56c-fc4d-403b-98aa-5ff2cdf1931c" status: 200 len: 1325 microversion: 2.1 time: 0.389864 Oct 04 18:47:58.336971 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1843/3929] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:57 2022] GET /compute/v2.1/servers/78c4f56c-fc4d-403b-98aa-5ff2cdf1931c => generated 1325 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:58.592554 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-df0880aa-6e61-494a-ac23-b23e2a0bab7f tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a116f2d9656548458264cc4fb1934c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff3c3dc76405401baf72fe00c5d50b56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:58.606911 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-df0880aa-6e61-494a-ac23-b23e2a0bab7f tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] 10.222.0.43 "GET /compute/v2.1/servers/76d475ab-f41c-44df-8aaa-10242bdbfcde" status: 200 len: 1678 microversion: 2.1 time: 0.325347 Oct 04 18:47:58.608949 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2087/3930] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:58 2022] GET /compute/v2.1/servers/76d475ab-f41c-44df-8aaa-10242bdbfcde => generated 1678 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:58.722068 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-7d4e029c-74de-4618-ae1f-04a4f116000e tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:58.722849 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-7d4e029c-74de-4618-ae1f-04a4f116000e tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] [instance: fd09cc9b-d9dd-4133-8665-eeb6d8f51df8] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:58.737001 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7d4e029c-74de-4618-ae1f-04a4f116000e tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:58.737539 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7d4e029c-74de-4618-ae1f-04a4f116000e tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:58.737987 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7d4e029c-74de-4618-ae1f-04a4f116000e tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:58.739423 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7d4e029c-74de-4618-ae1f-04a4f116000e tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:58.740059 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7d4e029c-74de-4618-ae1f-04a4f116000e tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:58.740673 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7d4e029c-74de-4618-ae1f-04a4f116000e tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:58.854431 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-7d4e029c-74de-4618-ae1f-04a4f116000e tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9971b5861f44c1a1da94eda0f8f02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f809b8ae704988961908bef0f3cb24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:58.862700 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-7d4e029c-74de-4618-ae1f-04a4f116000e tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] 10.222.0.43 "GET /compute/v2.1/servers/fd09cc9b-d9dd-4133-8665-eeb6d8f51df8" status: 200 len: 1184 microversion: 2.1 time: 0.144628 Oct 04 18:47:58.867161 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1844/3931] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:58 2022] GET /compute/v2.1/servers/fd09cc9b-d9dd-4133-8665-eeb6d8f51df8 => generated 1184 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:59.293818 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f3a42f72-955d-4c9d-b1c5-0d08ddd26227 tempest-VolumesSnapshotsTestJSON-845312753 tempest-VolumesSnapshotsTestJSON-845312753-project] Calling method '.version_select at 0x7fb227e411f0>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:59.365620 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-efec0183-fb4f-4332-83a7-e991b836e136 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:59.366250 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-efec0183-fb4f-4332-83a7-e991b836e136 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] [instance: 78c4f56c-fc4d-403b-98aa-5ff2cdf1931c] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:59.371809 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-f3a42f72-955d-4c9d-b1c5-0d08ddd26227 tempest-VolumesSnapshotsTestJSON-845312753 tempest-VolumesSnapshotsTestJSON-845312753-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/bad834ef-84d4-4642-8ea3-f2ee9d736da4" status: 200 len: 345 microversion: 2.1 time: 0.082160 Oct 04 18:47:59.372406 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2088/3932] 10.222.0.43 () {58 vars in 1245 bytes} [Tue Oct 4 18:47:59 2022] GET /compute/v2.1/os-volumes/bad834ef-84d4-4642-8ea3-f2ee9d736da4 => generated 345 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:47:59.393008 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-efec0183-fb4f-4332-83a7-e991b836e136 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:59.405626 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-efec0183-fb4f-4332-83a7-e991b836e136 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:59.406292 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-efec0183-fb4f-4332-83a7-e991b836e136 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:59.407095 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-efec0183-fb4f-4332-83a7-e991b836e136 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:59.407580 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-efec0183-fb4f-4332-83a7-e991b836e136 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:59.408024 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-efec0183-fb4f-4332-83a7-e991b836e136 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:59.632778 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-3050d7c1-9b5d-4123-a31a-b28f611dd5a1 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:59.633603 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-3050d7c1-9b5d-4123-a31a-b28f611dd5a1 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] [instance: 76d475ab-f41c-44df-8aaa-10242bdbfcde] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:59.641135 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3050d7c1-9b5d-4123-a31a-b28f611dd5a1 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:59.649720 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3050d7c1-9b5d-4123-a31a-b28f611dd5a1 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:59.651136 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3050d7c1-9b5d-4123-a31a-b28f611dd5a1 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:59.652344 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3050d7c1-9b5d-4123-a31a-b28f611dd5a1 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:59.664648 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3050d7c1-9b5d-4123-a31a-b28f611dd5a1 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:59.665532 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3050d7c1-9b5d-4123-a31a-b28f611dd5a1 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:59.765541 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-efec0183-fb4f-4332-83a7-e991b836e136 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcbf2b4b95743af9e6fa1be54554baa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab4da2b9b9f4c7a9c25b7edaab3027d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:59.787147 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-efec0183-fb4f-4332-83a7-e991b836e136 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] 10.222.0.43 "GET /compute/v2.1/servers/78c4f56c-fc4d-403b-98aa-5ff2cdf1931c" status: 200 len: 1325 microversion: 2.1 time: 0.425301 Oct 04 18:47:59.807484 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1845/3933] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:59 2022] GET /compute/v2.1/servers/78c4f56c-fc4d-403b-98aa-5ff2cdf1931c => generated 1325 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:59.894843 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-2d936448-a1a8-4ae2-8ec5-73ead2bfa697 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:59.896072 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-2d936448-a1a8-4ae2-8ec5-73ead2bfa697 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] [instance: fd09cc9b-d9dd-4133-8665-eeb6d8f51df8] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:59.914442 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2d936448-a1a8-4ae2-8ec5-73ead2bfa697 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:59.917204 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2d936448-a1a8-4ae2-8ec5-73ead2bfa697 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:59.918435 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2d936448-a1a8-4ae2-8ec5-73ead2bfa697 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:59.920803 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2d936448-a1a8-4ae2-8ec5-73ead2bfa697 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:59.929725 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2d936448-a1a8-4ae2-8ec5-73ead2bfa697 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:59.942474 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2d936448-a1a8-4ae2-8ec5-73ead2bfa697 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:00.040136 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2d936448-a1a8-4ae2-8ec5-73ead2bfa697 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:00.061655 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2d936448-a1a8-4ae2-8ec5-73ead2bfa697 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:00.062728 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2d936448-a1a8-4ae2-8ec5-73ead2bfa697 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:00.064232 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.objects.instance [None req-2d936448-a1a8-4ae2-8ec5-73ead2bfa697 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lazy-loading 'fault' on Instance uuid fd09cc9b-d9dd-4133-8665-eeb6d8f51df8 {{(pid=123595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:48:00.073362 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-3050d7c1-9b5d-4123-a31a-b28f611dd5a1 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a116f2d9656548458264cc4fb1934c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff3c3dc76405401baf72fe00c5d50b56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:00.090435 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-3050d7c1-9b5d-4123-a31a-b28f611dd5a1 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] 10.222.0.43 "GET /compute/v2.1/servers/76d475ab-f41c-44df-8aaa-10242bdbfcde" status: 200 len: 1678 microversion: 2.1 time: 0.459275 Oct 04 18:48:00.091798 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2089/3934] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:59 2022] GET /compute/v2.1/servers/76d475ab-f41c-44df-8aaa-10242bdbfcde => generated 1678 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:48:00.318836 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-2d936448-a1a8-4ae2-8ec5-73ead2bfa697 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9971b5861f44c1a1da94eda0f8f02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f809b8ae704988961908bef0f3cb24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:00.327302 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-2d936448-a1a8-4ae2-8ec5-73ead2bfa697 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] 10.222.0.43 "GET /compute/v2.1/servers/fd09cc9b-d9dd-4133-8665-eeb6d8f51df8" status: 200 len: 1143 microversion: 2.1 time: 0.438339 Oct 04 18:48:00.331411 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1846/3935] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:59 2022] GET /compute/v2.1/servers/fd09cc9b-d9dd-4133-8665-eeb6d8f51df8 => generated 1143 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:00.389769 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-910913f0-aa17-4201-bcb8-498fc2881512 tempest-VolumesSnapshotsTestJSON-845312753 tempest-VolumesSnapshotsTestJSON-845312753-project] Calling method '.version_select at 0x7fb21ef4ddc0>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:00.479713 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-910913f0-aa17-4201-bcb8-498fc2881512 tempest-VolumesSnapshotsTestJSON-845312753 tempest-VolumesSnapshotsTestJSON-845312753-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/bad834ef-84d4-4642-8ea3-f2ee9d736da4" status: 200 len: 346 microversion: 2.1 time: 0.096017 Oct 04 18:48:00.480289 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2090/3936] 10.222.0.43 () {58 vars in 1245 bytes} [Tue Oct 4 18:48:00 2022] GET /compute/v2.1/os-volumes/bad834ef-84d4-4642-8ea3-f2ee9d736da4 => generated 346 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:48:00.495030 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-f8e39434-184c-439a-a97a-6086fe9fbf14 tempest-VolumesSnapshotsTestJSON-845312753 tempest-VolumesSnapshotsTestJSON-845312753-project] Action: 'create', calling method: .version_select at 0x7fb21eb62ee0>, body: {"snapshot": {"volume_id": "bad834ef-84d4-4642-8ea3-f2ee9d736da4", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1894515922"}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:48:00.804493 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-f8e39434-184c-439a-a97a-6086fe9fbf14 tempest-VolumesSnapshotsTestJSON-845312753 tempest-VolumesSnapshotsTestJSON-845312753-project] 10.222.0.43 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.313807 Oct 04 18:48:00.806331 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1847/3937] 10.222.0.43 () {60 vars in 1162 bytes} [Tue Oct 4 18:48:00 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:48:00.818544 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-d7019586-37e3-4274-9979-7823f737970b tempest-VolumesSnapshotsTestJSON-845312753 tempest-VolumesSnapshotsTestJSON-845312753-project] Calling method '.version_select at 0x7fb21ef97550>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:00.833599 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-87862e0f-bfeb-4827-b5f7-556b7dde3815 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:00.834558 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-87862e0f-bfeb-4827-b5f7-556b7dde3815 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] [instance: 78c4f56c-fc4d-403b-98aa-5ff2cdf1931c] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:00.864376 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-87862e0f-bfeb-4827-b5f7-556b7dde3815 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:00.865178 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-87862e0f-bfeb-4827-b5f7-556b7dde3815 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:00.868732 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-87862e0f-bfeb-4827-b5f7-556b7dde3815 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:00.869887 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-87862e0f-bfeb-4827-b5f7-556b7dde3815 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:00.870559 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-87862e0f-bfeb-4827-b5f7-556b7dde3815 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:00.871977 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-87862e0f-bfeb-4827-b5f7-556b7dde3815 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:00.981768 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-d7019586-37e3-4274-9979-7823f737970b tempest-VolumesSnapshotsTestJSON-845312753 tempest-VolumesSnapshotsTestJSON-845312753-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/6da11b16-1bf5-4f25-9f71-be2efd3b719a" status: 200 len: 287 microversion: 2.1 time: 0.167635 Oct 04 18:48:00.990037 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2091/3938] 10.222.0.43 () {58 vars in 1251 bytes} [Tue Oct 4 18:48:00 2022] GET /compute/v2.1/os-snapshots/6da11b16-1bf5-4f25-9f71-be2efd3b719a => generated 287 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:48:00.995262 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-af60a227-9123-4cee-a312-30e4d2c26fba tempest-VolumesSnapshotsTestJSON-845312753 tempest-VolumesSnapshotsTestJSON-845312753-project] Calling method '.version_select at 0x7fb21ef66ca0>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:01.103047 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-af60a227-9123-4cee-a312-30e4d2c26fba tempest-VolumesSnapshotsTestJSON-845312753 tempest-VolumesSnapshotsTestJSON-845312753-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.111672 Oct 04 18:48:01.103843 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2092/3939] 10.222.0.43 () {58 vars in 1140 bytes} [Tue Oct 4 18:48:00 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:48:01.120771 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-930720f9-0944-496d-849c-6da6fd105248 tempest-VolumesSnapshotsTestJSON-845312753 tempest-VolumesSnapshotsTestJSON-845312753-project] Calling method '.version_select at 0x7fb21ef4dc10>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:01.212772 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-930720f9-0944-496d-849c-6da6fd105248 tempest-VolumesSnapshotsTestJSON-845312753 tempest-VolumesSnapshotsTestJSON-845312753-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/6da11b16-1bf5-4f25-9f71-be2efd3b719a" status: 200 len: 287 microversion: 2.1 time: 0.099811 Oct 04 18:48:01.217521 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2093/3940] 10.222.0.43 () {58 vars in 1251 bytes} [Tue Oct 4 18:48:01 2022] GET /compute/v2.1/os-snapshots/6da11b16-1bf5-4f25-9f71-be2efd3b719a => generated 287 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:48:01.228856 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-62edcd15-f77b-496b-b7df-f0a29deab7fe tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:01.230151 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-62edcd15-f77b-496b-b7df-f0a29deab7fe tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] [instance: 76d475ab-f41c-44df-8aaa-10242bdbfcde] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:01.256899 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-62edcd15-f77b-496b-b7df-f0a29deab7fe tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:01.261408 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-62edcd15-f77b-496b-b7df-f0a29deab7fe tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:01.261590 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-87862e0f-bfeb-4827-b5f7-556b7dde3815 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcbf2b4b95743af9e6fa1be54554baa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab4da2b9b9f4c7a9c25b7edaab3027d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:01.263300 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-62edcd15-f77b-496b-b7df-f0a29deab7fe tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:01.264856 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-62edcd15-f77b-496b-b7df-f0a29deab7fe tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:01.268178 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-62edcd15-f77b-496b-b7df-f0a29deab7fe tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:01.268903 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-62edcd15-f77b-496b-b7df-f0a29deab7fe tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:01.274630 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-87862e0f-bfeb-4827-b5f7-556b7dde3815 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] 10.222.0.43 "GET /compute/v2.1/servers/78c4f56c-fc4d-403b-98aa-5ff2cdf1931c" status: 200 len: 1521 microversion: 2.1 time: 0.453625 Oct 04 18:48:01.275255 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1848/3941] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:00 2022] GET /compute/v2.1/servers/78c4f56c-fc4d-403b-98aa-5ff2cdf1931c => generated 1521 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:01.307623 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-3ca23fe7-762f-419a-86b6-e997ecf31e31 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:01.307910 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-3ca23fe7-762f-419a-86b6-e997ecf31e31 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] [instance: 78c4f56c-fc4d-403b-98aa-5ff2cdf1931c] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:01.327282 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3ca23fe7-762f-419a-86b6-e997ecf31e31 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:01.327793 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3ca23fe7-762f-419a-86b6-e997ecf31e31 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:01.328244 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3ca23fe7-762f-419a-86b6-e997ecf31e31 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:01.328969 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3ca23fe7-762f-419a-86b6-e997ecf31e31 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:01.329465 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3ca23fe7-762f-419a-86b6-e997ecf31e31 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:01.330037 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3ca23fe7-762f-419a-86b6-e997ecf31e31 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:01.407652 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-3ca23fe7-762f-419a-86b6-e997ecf31e31 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] [instance: 78c4f56c-fc4d-403b-98aa-5ff2cdf1931c] Going to try to terminate instance {{(pid=123595) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:48:01.609509 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-3ca23fe7-762f-419a-86b6-e997ecf31e31 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] 10.222.0.43 "DELETE /compute/v2.1/servers/78c4f56c-fc4d-403b-98aa-5ff2cdf1931c" status: 204 len: 0 microversion: 2.1 time: 0.304066 Oct 04 18:48:01.613509 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1849/3942] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 18:48:01 2022] DELETE /compute/v2.1/servers/78c4f56c-fc4d-403b-98aa-5ff2cdf1931c => generated 0 bytes in 311 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:48:01.637586 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-67bf2beb-d7d4-4d11-a67a-08d14c757439 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:01.647058 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-67bf2beb-d7d4-4d11-a67a-08d14c757439 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] [instance: fd09cc9b-d9dd-4133-8665-eeb6d8f51df8] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:01.662865 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-67bf2beb-d7d4-4d11-a67a-08d14c757439 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:01.670170 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-67bf2beb-d7d4-4d11-a67a-08d14c757439 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:01.670881 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-67bf2beb-d7d4-4d11-a67a-08d14c757439 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:01.674180 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-67bf2beb-d7d4-4d11-a67a-08d14c757439 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:01.675054 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-67bf2beb-d7d4-4d11-a67a-08d14c757439 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:01.675677 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-67bf2beb-d7d4-4d11-a67a-08d14c757439 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:01.718008 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-67bf2beb-d7d4-4d11-a67a-08d14c757439 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] HTTP exception thrown: Instance fd09cc9b-d9dd-4133-8665-eeb6d8f51df8 could not be found. Oct 04 18:48:01.720275 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-67bf2beb-d7d4-4d11-a67a-08d14c757439 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Request method failure captured: Oct 04 18:48:01.720275 n-d-851028-13 devstack@n-api.service[123595]: request: GET /compute/v2.1/servers/fd09cc9b-d9dd-4133-8665-eeb6d8f51df8 HTTP/1.1 Oct 04 18:48:01.720275 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 18:48:01.720275 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 18:48:01.720275 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 18:48:01.720275 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 0 Oct 04 18:48:01.720275 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 18:48:01.720275 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 18:48:01.720275 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 18:48:01.720275 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 18:48:01.720275 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPH5WfiuuzvwLfBUktf-ZCMkbBHVtZTa3UzIp4tiFNMgYxAob0smTpNakOq8JPayK-7uipsiwFbsX12cMEYFvHfKqEuVOWJOlGyZWc2uOBdTkom4-ol0MxoEGaK70M4Ortl7zkMQzxJe2OsoPDoarCsZKa2IfgHk_8qe1PRnEJpqoAEM Oct 04 18:48:01.720275 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 18:48:01.720275 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 18:48:01.720275 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 18:48:01.720275 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 18:48:01.720275 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 18:48:01.720275 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 18:48:01.720275 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: a9f809b8ae704988961908bef0f3cb24 Oct 04 18:48:01.720275 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-LiveMigrationTest-54439387 Oct 04 18:48:01.720275 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 18:48:01.720275 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 18:48:01.720275 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/a9f809b8ae704988961908bef0f3cb24"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_a9f809b8ae704988961908bef0f3cb24"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a9f809b8ae704988961908bef0f3cb24"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a9f809b8ae704988961908bef0f3cb24"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:48:01.720275 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-LiveMigrationTest-54439387 Oct 04 18:48:01.720275 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: a9f809b8ae704988961908bef0f3cb24 Oct 04 18:48:01.720275 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-LiveMigrationTest-54439387 Oct 04 18:48:01.720275 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-LiveMigrationTest-54439387-project Oct 04 18:48:01.720275 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 18:48:01.720275 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 18:48:01.720275 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: ae9971b5861f44c1a1da94eda0f8f02d Oct 04 18:48:01.720275 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-LiveMigrationTest-54439387-project Oct 04 18:48:01.720275 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 18:48:01.720275 n-d-851028-13 devstack@n-api.service[123595]: exception: Instance fd09cc9b-d9dd-4133-8665-eeb6d8f51df8 could not be found. Oct 04 18:48:01.720275 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': 'fd09cc9b-d9dd-4133-8665-eeb6d8f51df8'} Oct 04 18:48:01.720275 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:48:01.720275 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:48:01.720275 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:48:01.720275 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:48:01.720275 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:48:01.720275 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:48:01.720275 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:48:01.720275 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:48:01.720275 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:48:01.720275 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:48:01.720275 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd09cc9b-d9dd-4133-8665-eeb6d8f51df8 could not be found. Oct 04 18:48:01.720275 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:48:01.720275 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:48:01.720275 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:48:01.720275 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:48:01.720275 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:48:01.720275 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:48:01.720275 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:48:01.720275 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:48:01.720275 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:48:01.720275 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:48:01.720275 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:48:01.720275 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:48:01.720275 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:48:01.720275 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:48:01.720275 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:48:01.720275 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:48:01.720275 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd09cc9b-d9dd-4133-8665-eeb6d8f51df8 could not be found. Oct 04 18:48:01.720275 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:48:01.720275 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:48:01.720275 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:48:01.727103 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:48:01.727103 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:48:01.727103 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:48:01.727103 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:48:01.727103 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:48:01.727103 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd09cc9b-d9dd-4133-8665-eeb6d8f51df8 could not be found. Oct 04 18:48:01.727103 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:48:01.727103 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-67bf2beb-d7d4-4d11-a67a-08d14c757439 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Returning 404 to user: Instance fd09cc9b-d9dd-4133-8665-eeb6d8f51df8 could not be found. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:48:01.727103 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-67bf2beb-d7d4-4d11-a67a-08d14c757439 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] 10.222.0.43 "GET /compute/v2.1/servers/fd09cc9b-d9dd-4133-8665-eeb6d8f51df8" status: 404 len: 111 microversion: 2.1 time: 0.107372 Oct 04 18:48:01.727103 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1850/3943] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:01 2022] GET /compute/v2.1/servers/fd09cc9b-d9dd-4133-8665-eeb6d8f51df8 => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:48:01.730486 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-62edcd15-f77b-496b-b7df-f0a29deab7fe tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a116f2d9656548458264cc4fb1934c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff3c3dc76405401baf72fe00c5d50b56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:01.738250 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-e68834dc-c04b-4017-a8a3-3e26cac8ede3 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:01.741396 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-e68834dc-c04b-4017-a8a3-3e26cac8ede3 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] [instance: 78c4f56c-fc4d-403b-98aa-5ff2cdf1931c] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:01.742781 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-62edcd15-f77b-496b-b7df-f0a29deab7fe tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] 10.222.0.43 "GET /compute/v2.1/servers/76d475ab-f41c-44df-8aaa-10242bdbfcde" status: 200 len: 1678 microversion: 2.1 time: 0.523715 Oct 04 18:48:01.760530 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2094/3944] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:01 2022] GET /compute/v2.1/servers/76d475ab-f41c-44df-8aaa-10242bdbfcde => generated 1678 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:01.760886 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e68834dc-c04b-4017-a8a3-3e26cac8ede3 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:01.760886 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e68834dc-c04b-4017-a8a3-3e26cac8ede3 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:01.760886 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e68834dc-c04b-4017-a8a3-3e26cac8ede3 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:01.760886 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e68834dc-c04b-4017-a8a3-3e26cac8ede3 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:01.760886 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e68834dc-c04b-4017-a8a3-3e26cac8ede3 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:01.766297 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e68834dc-c04b-4017-a8a3-3e26cac8ede3 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:02.231814 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-2d057af9-8523-41cb-b8dd-05d43f9e1941 tempest-VolumesSnapshotsTestJSON-845312753 tempest-VolumesSnapshotsTestJSON-845312753-project] Calling method '.version_select at 0x7fb21ee000d0>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:02.324511 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-2d057af9-8523-41cb-b8dd-05d43f9e1941 tempest-VolumesSnapshotsTestJSON-845312753 tempest-VolumesSnapshotsTestJSON-845312753-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/6da11b16-1bf5-4f25-9f71-be2efd3b719a" status: 200 len: 287 microversion: 2.1 time: 0.097410 Oct 04 18:48:02.325131 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2095/3945] 10.222.0.43 () {58 vars in 1251 bytes} [Tue Oct 4 18:48:02 2022] GET /compute/v2.1/os-snapshots/6da11b16-1bf5-4f25-9f71-be2efd3b719a => generated 287 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:48:02.412979 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-e68834dc-c04b-4017-a8a3-3e26cac8ede3 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcbf2b4b95743af9e6fa1be54554baa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab4da2b9b9f4c7a9c25b7edaab3027d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:02.428867 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-e68834dc-c04b-4017-a8a3-3e26cac8ede3 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] 10.222.0.43 "GET /compute/v2.1/servers/78c4f56c-fc4d-403b-98aa-5ff2cdf1931c" status: 200 len: 1527 microversion: 2.1 time: 0.694361 Oct 04 18:48:02.430090 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1851/3946] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:01 2022] GET /compute/v2.1/servers/78c4f56c-fc4d-403b-98aa-5ff2cdf1931c => generated 1527 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:02.770702 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f7f8c7b9-316a-4a87-8acf-001cbfac7ccc tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:02.772105 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-f7f8c7b9-316a-4a87-8acf-001cbfac7ccc tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] [instance: 76d475ab-f41c-44df-8aaa-10242bdbfcde] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:02.798285 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f7f8c7b9-316a-4a87-8acf-001cbfac7ccc tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:02.800299 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f7f8c7b9-316a-4a87-8acf-001cbfac7ccc tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:02.801891 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f7f8c7b9-316a-4a87-8acf-001cbfac7ccc tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:02.806905 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f7f8c7b9-316a-4a87-8acf-001cbfac7ccc tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:02.808626 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f7f8c7b9-316a-4a87-8acf-001cbfac7ccc tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:02.811510 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f7f8c7b9-316a-4a87-8acf-001cbfac7ccc tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:03.340063 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-54be77ae-78f3-4cec-b561-f5411bc7cc1a tempest-VolumesSnapshotsTestJSON-845312753 tempest-VolumesSnapshotsTestJSON-845312753-project] Calling method '.version_select at 0x7fb21eb09b80>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:03.366171 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-f7f8c7b9-316a-4a87-8acf-001cbfac7ccc tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a116f2d9656548458264cc4fb1934c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff3c3dc76405401baf72fe00c5d50b56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:03.384081 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-f7f8c7b9-316a-4a87-8acf-001cbfac7ccc tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] 10.222.0.43 "GET /compute/v2.1/servers/76d475ab-f41c-44df-8aaa-10242bdbfcde" status: 200 len: 1678 microversion: 2.1 time: 0.620022 Oct 04 18:48:03.388764 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2096/3947] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:02 2022] GET /compute/v2.1/servers/76d475ab-f41c-44df-8aaa-10242bdbfcde => generated 1678 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:03.426212 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-54be77ae-78f3-4cec-b561-f5411bc7cc1a tempest-VolumesSnapshotsTestJSON-845312753 tempest-VolumesSnapshotsTestJSON-845312753-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/6da11b16-1bf5-4f25-9f71-be2efd3b719a" status: 200 len: 287 microversion: 2.1 time: 0.092573 Oct 04 18:48:03.427172 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1852/3948] 10.222.0.43 () {58 vars in 1251 bytes} [Tue Oct 4 18:48:03 2022] GET /compute/v2.1/os-snapshots/6da11b16-1bf5-4f25-9f71-be2efd3b719a => generated 287 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:48:03.457940 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-587babc4-93e6-4388-8195-5743fa829ce3 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:03.458898 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-587babc4-93e6-4388-8195-5743fa829ce3 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] [instance: 78c4f56c-fc4d-403b-98aa-5ff2cdf1931c] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:03.478453 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-587babc4-93e6-4388-8195-5743fa829ce3 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:03.482468 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-587babc4-93e6-4388-8195-5743fa829ce3 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:03.484340 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-587babc4-93e6-4388-8195-5743fa829ce3 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:03.487205 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-587babc4-93e6-4388-8195-5743fa829ce3 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:03.489464 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-587babc4-93e6-4388-8195-5743fa829ce3 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:03.490780 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-587babc4-93e6-4388-8195-5743fa829ce3 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:04.416359 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-192215e9-6593-4bcd-bddc-e5780b113cbd tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:04.417086 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-192215e9-6593-4bcd-bddc-e5780b113cbd tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] [instance: 76d475ab-f41c-44df-8aaa-10242bdbfcde] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:04.429805 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-192215e9-6593-4bcd-bddc-e5780b113cbd tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:04.431437 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-192215e9-6593-4bcd-bddc-e5780b113cbd tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:04.432068 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-192215e9-6593-4bcd-bddc-e5780b113cbd tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:04.433074 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-192215e9-6593-4bcd-bddc-e5780b113cbd tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:04.433761 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-192215e9-6593-4bcd-bddc-e5780b113cbd tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:04.434792 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-192215e9-6593-4bcd-bddc-e5780b113cbd tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:04.450039 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:48:04.609552 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-587babc4-93e6-4388-8195-5743fa829ce3 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcbf2b4b95743af9e6fa1be54554baa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab4da2b9b9f4c7a9c25b7edaab3027d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:04.646550 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-587babc4-93e6-4388-8195-5743fa829ce3 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] 10.222.0.43 "GET /compute/v2.1/servers/78c4f56c-fc4d-403b-98aa-5ff2cdf1931c" status: 200 len: 1527 microversion: 2.1 time: 1.189677 Oct 04 18:48:04.649083 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2097/3949] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:03 2022] GET /compute/v2.1/servers/78c4f56c-fc4d-403b-98aa-5ff2cdf1931c => generated 1527 bytes in 1197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:04.678772 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-baab2ebe-f457-45ae-b6fc-69ba4bf67c94 tempest-VolumesSnapshotsTestJSON-845312753 tempest-VolumesSnapshotsTestJSON-845312753-project] Calling method '.version_select at 0x7fb21edd9790>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:04.767086 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-baab2ebe-f457-45ae-b6fc-69ba4bf67c94 tempest-VolumesSnapshotsTestJSON-845312753 tempest-VolumesSnapshotsTestJSON-845312753-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/6da11b16-1bf5-4f25-9f71-be2efd3b719a" status: 200 len: 288 microversion: 2.1 time: 0.113773 Oct 04 18:48:04.771149 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2098/3950] 10.222.0.43 () {58 vars in 1251 bytes} [Tue Oct 4 18:48:04 2022] GET /compute/v2.1/os-snapshots/6da11b16-1bf5-4f25-9f71-be2efd3b719a => generated 288 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:48:04.788820 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-9d9b22ef-c1c7-4ddc-937c-5c9074b8f5b9 req-b727c633-4c6f-4b6f-83f0-b4fce6749c98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78c4f56c-fc4d-403b-98aa-5ff2cdf1931c", "name": "network-vif-deleted", "tag": "66912c31-3599-47a9-8412-1c3084de5214"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:48:04.802433 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-192215e9-6593-4bcd-bddc-e5780b113cbd tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a116f2d9656548458264cc4fb1934c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff3c3dc76405401baf72fe00c5d50b56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:04.817856 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-192215e9-6593-4bcd-bddc-e5780b113cbd tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] 10.222.0.43 "GET /compute/v2.1/servers/76d475ab-f41c-44df-8aaa-10242bdbfcde" status: 200 len: 1678 microversion: 2.1 time: 0.404728 Oct 04 18:48:04.822164 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1853/3951] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:04 2022] GET /compute/v2.1/servers/76d475ab-f41c-44df-8aaa-10242bdbfcde => generated 1678 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:04.827220 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-31a92f37-55cb-4bad-8aae-6fb0f91c42ae tempest-VolumesSnapshotsTestJSON-845312753 tempest-VolumesSnapshotsTestJSON-845312753-project] Calling method '.version_select at 0x7fb21eb7b1f0>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:04.843834 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-9d9b22ef-c1c7-4ddc-937c-5c9074b8f5b9 req-b727c633-4c6f-4b6f-83f0-b4fce6749c98 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:04.844634 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-9d9b22ef-c1c7-4ddc-937c-5c9074b8f5b9 req-b727c633-4c6f-4b6f-83f0-b4fce6749c98 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:04.845573 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-9d9b22ef-c1c7-4ddc-937c-5c9074b8f5b9 req-b727c633-4c6f-4b6f-83f0-b4fce6749c98 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:04.862468 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-9d9b22ef-c1c7-4ddc-937c-5c9074b8f5b9 req-b727c633-4c6f-4b6f-83f0-b4fce6749c98 service nova] Creating event network-vif-deleted:66912c31-3599-47a9-8412-1c3084de5214 for instance 78c4f56c-fc4d-403b-98aa-5ff2cdf1931c on n-h2-851028-13 Oct 04 18:48:04.868757 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-9d9b22ef-c1c7-4ddc-937c-5c9074b8f5b9 req-b727c633-4c6f-4b6f-83f0-b4fce6749c98 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094176 Oct 04 18:48:04.870072 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2099/3952] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:48:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:48:04.981717 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-31a92f37-55cb-4bad-8aae-6fb0f91c42ae tempest-VolumesSnapshotsTestJSON-845312753 tempest-VolumesSnapshotsTestJSON-845312753-project] 10.222.0.43 "DELETE /compute/v2.1/os-snapshots/6da11b16-1bf5-4f25-9f71-be2efd3b719a" status: 202 len: 0 microversion: 2.1 time: 0.153101 Oct 04 18:48:04.982661 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1854/3953] 10.222.0.43 () {58 vars in 1254 bytes} [Tue Oct 4 18:48:04 2022] DELETE /compute/v2.1/os-snapshots/6da11b16-1bf5-4f25-9f71-be2efd3b719a => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:48:04.997098 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-6afed36b-9c5a-4c00-ab94-80dcb0816587 tempest-VolumesSnapshotsTestJSON-845312753 tempest-VolumesSnapshotsTestJSON-845312753-project] Calling method '.version_select at 0x7fb21ee7ff70>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:05.071452 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-6afed36b-9c5a-4c00-ab94-80dcb0816587 tempest-VolumesSnapshotsTestJSON-845312753 tempest-VolumesSnapshotsTestJSON-845312753-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/6da11b16-1bf5-4f25-9f71-be2efd3b719a" status: 200 len: 287 microversion: 2.1 time: 0.083606 Oct 04 18:48:05.078269 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2100/3954] 10.222.0.43 () {58 vars in 1251 bytes} [Tue Oct 4 18:48:04 2022] GET /compute/v2.1/os-snapshots/6da11b16-1bf5-4f25-9f71-be2efd3b719a => generated 287 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:48:05.684604 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-d828b7fd-6d33-4967-b5e9-23266a8dee3c tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:05.686156 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-d828b7fd-6d33-4967-b5e9-23266a8dee3c tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] [instance: 78c4f56c-fc4d-403b-98aa-5ff2cdf1931c] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:05.707392 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d828b7fd-6d33-4967-b5e9-23266a8dee3c tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:05.708437 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d828b7fd-6d33-4967-b5e9-23266a8dee3c tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:05.709382 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d828b7fd-6d33-4967-b5e9-23266a8dee3c tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:05.711498 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d828b7fd-6d33-4967-b5e9-23266a8dee3c tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:05.712263 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d828b7fd-6d33-4967-b5e9-23266a8dee3c tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:05.713676 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d828b7fd-6d33-4967-b5e9-23266a8dee3c tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:05.732978 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-d828b7fd-6d33-4967-b5e9-23266a8dee3c tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] HTTP exception thrown: Instance 78c4f56c-fc4d-403b-98aa-5ff2cdf1931c could not be found. Oct 04 18:48:05.735469 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-d828b7fd-6d33-4967-b5e9-23266a8dee3c tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Request method failure captured: Oct 04 18:48:05.735469 n-d-851028-13 devstack@n-api.service[123595]: request: GET /compute/v2.1/servers/78c4f56c-fc4d-403b-98aa-5ff2cdf1931c HTTP/1.1 Oct 04 18:48:05.735469 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 18:48:05.735469 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 18:48:05.735469 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 18:48:05.735469 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 0 Oct 04 18:48:05.735469 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 18:48:05.735469 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 18:48:05.735469 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 18:48:05.735469 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 18:48:05.735469 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPH978iZmaQey9qRFmivrOEN9WI4gFjhDc3nSUPEBZXv1WUgd7GTFhNQGJ_Nm2KHTEzU5QZw7VgnyxDt5Dwy3JGK8gUnF9wIKq6iB3FX5CCTGK5JwEw-XtwnwemZOTSVwZU_4nc3l4c2itfEGLVIoX2yb6G-IjSzn-sL8697UlYQlcew Oct 04 18:48:05.735469 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 18:48:05.735469 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 18:48:05.735469 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 18:48:05.735469 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 18:48:05.735469 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 18:48:05.735469 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 18:48:05.735469 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: 8ab4da2b9b9f4c7a9c25b7edaab3027d Oct 04 18:48:05.735469 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2004915413 Oct 04 18:48:05.735469 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 18:48:05.735469 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 18:48:05.735469 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/8ab4da2b9b9f4c7a9c25b7edaab3027d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_8ab4da2b9b9f4c7a9c25b7edaab3027d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8ab4da2b9b9f4c7a9c25b7edaab3027d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8ab4da2b9b9f4c7a9c25b7edaab3027d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:48:05.735469 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2004915413 Oct 04 18:48:05.735469 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: 8ab4da2b9b9f4c7a9c25b7edaab3027d Oct 04 18:48:05.735469 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2004915413 Oct 04 18:48:05.735469 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-ImagesOneServerNegativeTestJSON-2004915413-project Oct 04 18:48:05.735469 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 18:48:05.735469 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 18:48:05.735469 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: cdcbf2b4b95743af9e6fa1be54554baa Oct 04 18:48:05.735469 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2004915413-project Oct 04 18:48:05.735469 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 18:48:05.735469 n-d-851028-13 devstack@n-api.service[123595]: exception: Instance 78c4f56c-fc4d-403b-98aa-5ff2cdf1931c could not be found. Oct 04 18:48:05.735469 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': '78c4f56c-fc4d-403b-98aa-5ff2cdf1931c'} Oct 04 18:48:05.735469 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:48:05.735469 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:48:05.735469 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:48:05.735469 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:48:05.735469 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:48:05.735469 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:48:05.735469 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:48:05.735469 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:48:05.735469 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:48:05.735469 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:48:05.735469 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 78c4f56c-fc4d-403b-98aa-5ff2cdf1931c could not be found. Oct 04 18:48:05.735469 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:48:05.735469 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:48:05.735469 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:48:05.735469 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:48:05.735469 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:48:05.735469 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:48:05.735469 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:48:05.735469 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:48:05.735469 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:48:05.735469 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:48:05.735469 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:48:05.735469 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:48:05.735469 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:48:05.735469 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:48:05.735469 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:48:05.735469 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:48:05.735469 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 78c4f56c-fc4d-403b-98aa-5ff2cdf1931c could not be found. Oct 04 18:48:05.735469 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:48:05.735469 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:48:05.740483 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:48:05.740483 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:48:05.740483 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:48:05.740483 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:48:05.740483 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:48:05.740483 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:48:05.740483 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 78c4f56c-fc4d-403b-98aa-5ff2cdf1931c could not be found. Oct 04 18:48:05.740483 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:48:05.740483 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-d828b7fd-6d33-4967-b5e9-23266a8dee3c tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Returning 404 to user: Instance 78c4f56c-fc4d-403b-98aa-5ff2cdf1931c could not be found. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:48:05.740483 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-d828b7fd-6d33-4967-b5e9-23266a8dee3c tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] 10.222.0.43 "GET /compute/v2.1/servers/78c4f56c-fc4d-403b-98aa-5ff2cdf1931c" status: 404 len: 111 microversion: 2.1 time: 0.064673 Oct 04 18:48:05.743882 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1855/3955] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:05 2022] GET /compute/v2.1/servers/78c4f56c-fc4d-403b-98aa-5ff2cdf1931c => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:48:05.751180 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-fb53bd55-c999-4114-abd2-2a9594cbb314 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Calling method '.version_select at 0x7fb21edfc280>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:05.808872 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-fb53bd55-c999-4114-abd2-2a9594cbb314 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] HTTP exception thrown: Image not found. Oct 04 18:48:05.811199 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-fb53bd55-c999-4114-abd2-2a9594cbb314 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Request method failure captured: Oct 04 18:48:05.811199 n-d-851028-13 devstack@n-api.service[123596]: request: DELETE /compute/v2.1/images/20e21a28-ef77-4800-96ae-20475aa9df31 HTTP/1.1 Oct 04 18:48:05.811199 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:48:05.811199 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:48:05.811199 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:48:05.811199 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 18:48:05.811199 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:48:05.811199 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:48:05.811199 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:48:05.811199 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:48:05.811199 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPH978iZmaQey9qRFmivrOEN9WI4gFjhDc3nSUPEBZXv1WUgd7GTFhNQGJ_Nm2KHTEzU5QZw7VgnyxDt5Dwy3JGK8gUnF9wIKq6iB3FX5CCTGK5JwEw-XtwnwemZOTSVwZU_4nc3l4c2itfEGLVIoX2yb6G-IjSzn-sL8697UlYQlcew Oct 04 18:48:05.811199 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:48:05.811199 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:48:05.811199 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:48:05.811199 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:48:05.811199 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:48:05.811199 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:48:05.811199 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: 8ab4da2b9b9f4c7a9c25b7edaab3027d Oct 04 18:48:05.811199 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2004915413 Oct 04 18:48:05.811199 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 18:48:05.811199 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 18:48:05.811199 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/8ab4da2b9b9f4c7a9c25b7edaab3027d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_8ab4da2b9b9f4c7a9c25b7edaab3027d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8ab4da2b9b9f4c7a9c25b7edaab3027d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8ab4da2b9b9f4c7a9c25b7edaab3027d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:48:05.811199 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2004915413 Oct 04 18:48:05.811199 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: 8ab4da2b9b9f4c7a9c25b7edaab3027d Oct 04 18:48:05.811199 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2004915413 Oct 04 18:48:05.811199 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-ImagesOneServerNegativeTestJSON-2004915413-project Oct 04 18:48:05.811199 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:48:05.811199 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:48:05.811199 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: cdcbf2b4b95743af9e6fa1be54554baa Oct 04 18:48:05.811199 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2004915413-project Oct 04 18:48:05.811199 n-d-851028-13 devstack@n-api.service[123596]: method: Oct 04 18:48:05.811199 n-d-851028-13 devstack@n-api.service[123596]: exception: Image not found. Oct 04 18:48:05.811199 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': '20e21a28-ef77-4800-96ae-20475aa9df31'} Oct 04 18:48:05.811199 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:48:05.811199 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:48:05.811199 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 04 18:48:05.811199 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 04 18:48:05.811199 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 18:48:05.811199 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 18:48:05.811199 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 18:48:05.811199 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 18:48:05.811199 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 04 18:48:05.811199 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 04 18:48:05.811199 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 04 18:48:05.811199 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 04 18:48:05.811199 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 18:48:05.811199 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 18:48:05.811199 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 18:48:05.811199 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 18:48:05.811199 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 20e21a28-ef77-4800-96ae-20475aa9df31 to delete Oct 04 18:48:05.811199 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:48:05.811199 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:48:05.811199 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:48:05.811199 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:48:05.811199 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 04 18:48:05.811199 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 04 18:48:05.811199 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 04 18:48:05.811199 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 04 18:48:05.811199 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 04 18:48:05.811199 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 04 18:48:05.811199 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 20e21a28-ef77-4800-96ae-20475aa9df31 could not be found. Oct 04 18:48:05.811199 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:48:05.811199 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:48:05.811199 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:48:05.817613 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:48:05.817613 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:48:05.817613 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:48:05.817613 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:48:05.817613 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:48:05.817613 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:48:05.817613 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:48:05.817613 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:48:05.817613 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:48:05.817613 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 04 18:48:05.817613 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 18:48:05.817613 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 18:48:05.817613 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:48:05.817613 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:48:05.817613 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:48:05.817613 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:48:05.817613 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:48:05.817613 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:48:05.817613 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:48:05.817613 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:48:05.817613 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 18:48:05.817613 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:48:05.817613 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-fb53bd55-c999-4114-abd2-2a9594cbb314 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Returning 404 to user: Image not found. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:48:05.817613 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-fb53bd55-c999-4114-abd2-2a9594cbb314 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] 10.222.0.43 "DELETE /compute/v2.1/images/20e21a28-ef77-4800-96ae-20475aa9df31" status: 404 len: 62 microversion: 2.1 time: 0.066228 Oct 04 18:48:05.817613 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2101/3956] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:05 2022] DELETE /compute/v2.1/images/20e21a28-ef77-4800-96ae-20475aa9df31 => generated 62 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:48:05.834950 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-15e89ca0-e35b-4753-ba67-fee49916513f tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:05.837784 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-15e89ca0-e35b-4753-ba67-fee49916513f tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] [instance: 5f6ad9ae-93d7-4774-aadf-b1fbbadc224c] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:05.851216 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f00e5ddb-d5af-43ce-b434-616b3ffbe2f7 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:05.851830 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-f00e5ddb-d5af-43ce-b434-616b3ffbe2f7 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] [instance: 76d475ab-f41c-44df-8aaa-10242bdbfcde] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:05.857031 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-15e89ca0-e35b-4753-ba67-fee49916513f tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:05.857789 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-15e89ca0-e35b-4753-ba67-fee49916513f tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:05.858470 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-15e89ca0-e35b-4753-ba67-fee49916513f tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:05.860349 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-15e89ca0-e35b-4753-ba67-fee49916513f tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:05.861622 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-15e89ca0-e35b-4753-ba67-fee49916513f tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:05.862333 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-15e89ca0-e35b-4753-ba67-fee49916513f tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:05.867149 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f00e5ddb-d5af-43ce-b434-616b3ffbe2f7 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:05.874234 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f00e5ddb-d5af-43ce-b434-616b3ffbe2f7 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:05.875121 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f00e5ddb-d5af-43ce-b434-616b3ffbe2f7 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:05.876105 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f00e5ddb-d5af-43ce-b434-616b3ffbe2f7 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:05.876925 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f00e5ddb-d5af-43ce-b434-616b3ffbe2f7 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:05.877639 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f00e5ddb-d5af-43ce-b434-616b3ffbe2f7 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:05.894219 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-15e89ca0-e35b-4753-ba67-fee49916513f tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] HTTP exception thrown: Instance 5f6ad9ae-93d7-4774-aadf-b1fbbadc224c could not be found. Oct 04 18:48:05.899335 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-15e89ca0-e35b-4753-ba67-fee49916513f tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Request method failure captured: Oct 04 18:48:05.899335 n-d-851028-13 devstack@n-api.service[123595]: request: DELETE /compute/v2.1/servers/5f6ad9ae-93d7-4774-aadf-b1fbbadc224c HTTP/1.1 Oct 04 18:48:05.899335 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 18:48:05.899335 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 18:48:05.899335 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 18:48:05.899335 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 0 Oct 04 18:48:05.899335 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 18:48:05.899335 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 18:48:05.899335 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 18:48:05.899335 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 18:48:05.899335 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPH978iZmaQey9qRFmivrOEN9WI4gFjhDc3nSUPEBZXv1WUgd7GTFhNQGJ_Nm2KHTEzU5QZw7VgnyxDt5Dwy3JGK8gUnF9wIKq6iB3FX5CCTGK5JwEw-XtwnwemZOTSVwZU_4nc3l4c2itfEGLVIoX2yb6G-IjSzn-sL8697UlYQlcew Oct 04 18:48:05.899335 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 18:48:05.899335 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 18:48:05.899335 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 18:48:05.899335 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 18:48:05.899335 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 18:48:05.899335 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 18:48:05.899335 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: 8ab4da2b9b9f4c7a9c25b7edaab3027d Oct 04 18:48:05.899335 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2004915413 Oct 04 18:48:05.899335 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 18:48:05.899335 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 18:48:05.899335 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/8ab4da2b9b9f4c7a9c25b7edaab3027d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_8ab4da2b9b9f4c7a9c25b7edaab3027d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8ab4da2b9b9f4c7a9c25b7edaab3027d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8ab4da2b9b9f4c7a9c25b7edaab3027d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:48:05.899335 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2004915413 Oct 04 18:48:05.899335 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: 8ab4da2b9b9f4c7a9c25b7edaab3027d Oct 04 18:48:05.899335 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2004915413 Oct 04 18:48:05.899335 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-ImagesOneServerNegativeTestJSON-2004915413-project Oct 04 18:48:05.899335 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 18:48:05.899335 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 18:48:05.899335 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: cdcbf2b4b95743af9e6fa1be54554baa Oct 04 18:48:05.899335 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2004915413-project Oct 04 18:48:05.899335 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 18:48:05.899335 n-d-851028-13 devstack@n-api.service[123595]: exception: Instance 5f6ad9ae-93d7-4774-aadf-b1fbbadc224c could not be found. Oct 04 18:48:05.899335 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': '5f6ad9ae-93d7-4774-aadf-b1fbbadc224c'} Oct 04 18:48:05.899335 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:48:05.899335 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:48:05.899335 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:48:05.899335 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:48:05.899335 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:48:05.899335 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:48:05.899335 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:48:05.899335 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:48:05.899335 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:48:05.899335 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:48:05.899335 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f6ad9ae-93d7-4774-aadf-b1fbbadc224c could not be found. Oct 04 18:48:05.899335 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:48:05.899335 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:48:05.899335 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:48:05.899335 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:48:05.899335 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:48:05.899335 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:48:05.899335 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:48:05.899335 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:48:05.899335 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:48:05.899335 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:48:05.899335 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:48:05.899335 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:48:05.899335 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:48:05.899335 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:48:05.899335 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:48:05.899335 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:48:05.899335 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:48:05.899335 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:48:05.905263 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f6ad9ae-93d7-4774-aadf-b1fbbadc224c could not be found. Oct 04 18:48:05.905263 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:48:05.905263 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:48:05.905263 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:48:05.905263 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:48:05.905263 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:48:05.905263 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:48:05.905263 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:48:05.905263 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:48:05.905263 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f6ad9ae-93d7-4774-aadf-b1fbbadc224c could not be found. Oct 04 18:48:05.905263 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:48:05.905263 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-15e89ca0-e35b-4753-ba67-fee49916513f tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Returning 404 to user: Instance 5f6ad9ae-93d7-4774-aadf-b1fbbadc224c could not be found. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:48:05.905263 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-15e89ca0-e35b-4753-ba67-fee49916513f tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] 10.222.0.43 "DELETE /compute/v2.1/servers/5f6ad9ae-93d7-4774-aadf-b1fbbadc224c" status: 404 len: 111 microversion: 2.1 time: 0.080038 Oct 04 18:48:05.908184 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1856/3957] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 18:48:05 2022] DELETE /compute/v2.1/servers/5f6ad9ae-93d7-4774-aadf-b1fbbadc224c => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:48:05.943545 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-525b2e80-2195-419e-8061-1333a7cecd5b tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:05.946583 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-525b2e80-2195-419e-8061-1333a7cecd5b tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] [instance: 5f6ad9ae-93d7-4774-aadf-b1fbbadc224c] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:05.985393 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-525b2e80-2195-419e-8061-1333a7cecd5b tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:05.988739 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-525b2e80-2195-419e-8061-1333a7cecd5b tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:05.989235 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-525b2e80-2195-419e-8061-1333a7cecd5b tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:05.991896 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-525b2e80-2195-419e-8061-1333a7cecd5b tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:05.992504 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-525b2e80-2195-419e-8061-1333a7cecd5b tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:05.994791 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-525b2e80-2195-419e-8061-1333a7cecd5b tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:06.049812 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-525b2e80-2195-419e-8061-1333a7cecd5b tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] HTTP exception thrown: Instance 5f6ad9ae-93d7-4774-aadf-b1fbbadc224c could not be found. Oct 04 18:48:06.053406 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-525b2e80-2195-419e-8061-1333a7cecd5b tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Request method failure captured: Oct 04 18:48:06.053406 n-d-851028-13 devstack@n-api.service[123595]: request: GET /compute/v2.1/servers/5f6ad9ae-93d7-4774-aadf-b1fbbadc224c HTTP/1.1 Oct 04 18:48:06.053406 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 18:48:06.053406 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 18:48:06.053406 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 18:48:06.053406 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 0 Oct 04 18:48:06.053406 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 18:48:06.053406 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 18:48:06.053406 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 18:48:06.053406 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 18:48:06.053406 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPH978iZmaQey9qRFmivrOEN9WI4gFjhDc3nSUPEBZXv1WUgd7GTFhNQGJ_Nm2KHTEzU5QZw7VgnyxDt5Dwy3JGK8gUnF9wIKq6iB3FX5CCTGK5JwEw-XtwnwemZOTSVwZU_4nc3l4c2itfEGLVIoX2yb6G-IjSzn-sL8697UlYQlcew Oct 04 18:48:06.053406 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 18:48:06.053406 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 18:48:06.053406 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 18:48:06.053406 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 18:48:06.053406 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 18:48:06.053406 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 18:48:06.053406 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: 8ab4da2b9b9f4c7a9c25b7edaab3027d Oct 04 18:48:06.053406 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2004915413 Oct 04 18:48:06.053406 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 18:48:06.053406 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 18:48:06.053406 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/8ab4da2b9b9f4c7a9c25b7edaab3027d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_8ab4da2b9b9f4c7a9c25b7edaab3027d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8ab4da2b9b9f4c7a9c25b7edaab3027d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8ab4da2b9b9f4c7a9c25b7edaab3027d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:48:06.053406 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2004915413 Oct 04 18:48:06.053406 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: 8ab4da2b9b9f4c7a9c25b7edaab3027d Oct 04 18:48:06.053406 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2004915413 Oct 04 18:48:06.053406 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-ImagesOneServerNegativeTestJSON-2004915413-project Oct 04 18:48:06.053406 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 18:48:06.053406 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 18:48:06.053406 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: cdcbf2b4b95743af9e6fa1be54554baa Oct 04 18:48:06.053406 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2004915413-project Oct 04 18:48:06.053406 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 18:48:06.053406 n-d-851028-13 devstack@n-api.service[123595]: exception: Instance 5f6ad9ae-93d7-4774-aadf-b1fbbadc224c could not be found. Oct 04 18:48:06.053406 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': '5f6ad9ae-93d7-4774-aadf-b1fbbadc224c'} Oct 04 18:48:06.053406 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:48:06.053406 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:48:06.053406 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:48:06.053406 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:48:06.053406 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:48:06.053406 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:48:06.053406 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:48:06.053406 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:48:06.053406 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:48:06.053406 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:48:06.053406 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f6ad9ae-93d7-4774-aadf-b1fbbadc224c could not be found. Oct 04 18:48:06.053406 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:48:06.053406 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:48:06.053406 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:48:06.053406 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:48:06.053406 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:48:06.053406 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:48:06.053406 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:48:06.053406 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:48:06.053406 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:48:06.053406 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:48:06.053406 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:48:06.053406 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:48:06.053406 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:48:06.053406 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:48:06.053406 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:48:06.053406 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:48:06.053406 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f6ad9ae-93d7-4774-aadf-b1fbbadc224c could not be found. Oct 04 18:48:06.053406 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:48:06.053406 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:48:06.058910 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:48:06.058910 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:48:06.058910 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:48:06.058910 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:48:06.058910 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:48:06.058910 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:48:06.058910 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f6ad9ae-93d7-4774-aadf-b1fbbadc224c could not be found. Oct 04 18:48:06.058910 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:48:06.058910 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-525b2e80-2195-419e-8061-1333a7cecd5b tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Returning 404 to user: Instance 5f6ad9ae-93d7-4774-aadf-b1fbbadc224c could not be found. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:48:06.072734 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-525b2e80-2195-419e-8061-1333a7cecd5b tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] 10.222.0.43 "GET /compute/v2.1/servers/5f6ad9ae-93d7-4774-aadf-b1fbbadc224c" status: 404 len: 111 microversion: 2.1 time: 0.143858 Oct 04 18:48:06.075283 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1857/3958] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:05 2022] GET /compute/v2.1/servers/5f6ad9ae-93d7-4774-aadf-b1fbbadc224c => generated 111 bytes in 166 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:48:06.101438 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-d55378fa-eff8-4c1d-a983-8b08df5346aa tempest-VolumesSnapshotsTestJSON-845312753 tempest-VolumesSnapshotsTestJSON-845312753-project] Calling method '.version_select at 0x7fb21eb7b5e0>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:06.221487 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-d55378fa-eff8-4c1d-a983-8b08df5346aa tempest-VolumesSnapshotsTestJSON-845312753 tempest-VolumesSnapshotsTestJSON-845312753-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/6da11b16-1bf5-4f25-9f71-be2efd3b719a" status: 200 len: 287 microversion: 2.1 time: 0.136684 Oct 04 18:48:06.222155 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1858/3959] 10.222.0.43 () {58 vars in 1251 bytes} [Tue Oct 4 18:48:06 2022] GET /compute/v2.1/os-snapshots/6da11b16-1bf5-4f25-9f71-be2efd3b719a => generated 287 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:48:06.233513 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-f1b859b2-5d50-4f7d-a7a6-406cf9c38341 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Calling method '.version_select at 0x7fb21eb7be50>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:06.295436 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-f1b859b2-5d50-4f7d-a7a6-406cf9c38341 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1858502817" status: 202 len: 0 microversion: 2.1 time: 0.071826 Oct 04 18:48:06.296087 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1859/3960] 10.222.0.43 () {58 vars in 1221 bytes} [Tue Oct 4 18:48:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1858502817 => generated 0 bytes in 73 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:48:06.467050 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-f00e5ddb-d5af-43ce-b434-616b3ffbe2f7 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a116f2d9656548458264cc4fb1934c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff3c3dc76405401baf72fe00c5d50b56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:06.478103 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-f00e5ddb-d5af-43ce-b434-616b3ffbe2f7 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] 10.222.0.43 "GET /compute/v2.1/servers/76d475ab-f41c-44df-8aaa-10242bdbfcde" status: 200 len: 1678 microversion: 2.1 time: 0.631488 Oct 04 18:48:06.479615 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2102/3961] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:05 2022] GET /compute/v2.1/servers/76d475ab-f41c-44df-8aaa-10242bdbfcde => generated 1678 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:48:07.238748 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-da0e587a-282d-425e-b60b-931ab4bed3ff tempest-VolumesSnapshotsTestJSON-845312753 tempest-VolumesSnapshotsTestJSON-845312753-project] Calling method '.version_select at 0x7fb21eb11f70>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:07.314828 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-da0e587a-282d-425e-b60b-931ab4bed3ff tempest-VolumesSnapshotsTestJSON-845312753 tempest-VolumesSnapshotsTestJSON-845312753-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/6da11b16-1bf5-4f25-9f71-be2efd3b719a" status: 200 len: 287 microversion: 2.1 time: 0.081461 Oct 04 18:48:07.315411 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1860/3962] 10.222.0.43 () {58 vars in 1251 bytes} [Tue Oct 4 18:48:07 2022] GET /compute/v2.1/os-snapshots/6da11b16-1bf5-4f25-9f71-be2efd3b719a => generated 287 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:48:07.504214 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-cd2685c9-8190-4017-b50b-fee1415eb3fb tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:07.505644 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-cd2685c9-8190-4017-b50b-fee1415eb3fb tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] [instance: 76d475ab-f41c-44df-8aaa-10242bdbfcde] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:07.526061 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cd2685c9-8190-4017-b50b-fee1415eb3fb tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:07.532859 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cd2685c9-8190-4017-b50b-fee1415eb3fb tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:07.533654 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cd2685c9-8190-4017-b50b-fee1415eb3fb tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:07.535150 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cd2685c9-8190-4017-b50b-fee1415eb3fb tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:07.535863 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cd2685c9-8190-4017-b50b-fee1415eb3fb tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:07.536697 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cd2685c9-8190-4017-b50b-fee1415eb3fb tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:07.901743 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-cd2685c9-8190-4017-b50b-fee1415eb3fb tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a116f2d9656548458264cc4fb1934c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff3c3dc76405401baf72fe00c5d50b56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:07.914611 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-cd2685c9-8190-4017-b50b-fee1415eb3fb tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] 10.222.0.43 "GET /compute/v2.1/servers/76d475ab-f41c-44df-8aaa-10242bdbfcde" status: 200 len: 1678 microversion: 2.1 time: 0.413892 Oct 04 18:48:07.915024 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2103/3963] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:07 2022] GET /compute/v2.1/servers/76d475ab-f41c-44df-8aaa-10242bdbfcde => generated 1678 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:08.333474 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-55cab814-ce3e-4608-860b-99b2f878d977 tempest-VolumesSnapshotsTestJSON-845312753 tempest-VolumesSnapshotsTestJSON-845312753-project] Calling method '.version_select at 0x7fb21edf89d0>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:08.389288 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-55cab814-ce3e-4608-860b-99b2f878d977 tempest-VolumesSnapshotsTestJSON-845312753 tempest-VolumesSnapshotsTestJSON-845312753-project] HTTP exception thrown: Snapshot 6da11b16-1bf5-4f25-9f71-be2efd3b719a could not be found. Oct 04 18:48:08.396055 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-55cab814-ce3e-4608-860b-99b2f878d977 tempest-VolumesSnapshotsTestJSON-845312753 tempest-VolumesSnapshotsTestJSON-845312753-project] Request method failure captured: Oct 04 18:48:08.396055 n-d-851028-13 devstack@n-api.service[123595]: request: GET /compute/v2.1/os-snapshots/6da11b16-1bf5-4f25-9f71-be2efd3b719a HTTP/1.1 Oct 04 18:48:08.396055 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 18:48:08.396055 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 18:48:08.396055 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 18:48:08.396055 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 0 Oct 04 18:48:08.396055 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 18:48:08.396055 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 18:48:08.396055 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 18:48:08.396055 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 18:48:08.396055 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPH_czZJtW49Pwo2OlxDYq6_8qrSzujJ71WFvOiKwxDerZORrgd4f_Tmh5V7p97tB_eZ0bhyUWdh2Pzl0BBm0yLECXTz3GaNtrElydhCrj03GQyL91dmwryWGNOTDZUGaE5cUAet6tpqG9zVaW__YRuxM7-VAD5jc88SaO9BR6W7SvWo Oct 04 18:48:08.396055 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 18:48:08.396055 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 18:48:08.396055 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 18:48:08.396055 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 18:48:08.396055 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 18:48:08.396055 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 18:48:08.396055 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: 8c9933bf5dd74746a9bf9fb9f345d738 Oct 04 18:48:08.396055 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-845312753 Oct 04 18:48:08.396055 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 18:48:08.396055 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 18:48:08.396055 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/8c9933bf5dd74746a9bf9fb9f345d738"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_8c9933bf5dd74746a9bf9fb9f345d738"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8c9933bf5dd74746a9bf9fb9f345d738"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8c9933bf5dd74746a9bf9fb9f345d738"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:48:08.396055 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-VolumesSnapshotsTestJSON-845312753 Oct 04 18:48:08.396055 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: 8c9933bf5dd74746a9bf9fb9f345d738 Oct 04 18:48:08.396055 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-845312753 Oct 04 18:48:08.396055 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-VolumesSnapshotsTestJSON-845312753-project Oct 04 18:48:08.396055 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 18:48:08.396055 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 18:48:08.396055 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: bd0bcce6187d497f9222ba87881fd4ab Oct 04 18:48:08.396055 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-VolumesSnapshotsTestJSON-845312753-project Oct 04 18:48:08.396055 n-d-851028-13 devstack@n-api.service[123595]: method: Oct 04 18:48:08.396055 n-d-851028-13 devstack@n-api.service[123595]: exception: Snapshot 6da11b16-1bf5-4f25-9f71-be2efd3b719a could not be found. Oct 04 18:48:08.396055 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': '6da11b16-1bf5-4f25-9f71-be2efd3b719a'} Oct 04 18:48:08.396055 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:48:08.396055 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:48:08.396055 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 04 18:48:08.396055 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 04 18:48:08.396055 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 04 18:48:08.396055 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 04 18:48:08.396055 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 04 18:48:08.396055 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 04 18:48:08.396055 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 18:48:08.396055 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 18:48:08.396055 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 18:48:08.396055 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 18:48:08.396055 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 18:48:08.396055 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 18:48:08.396055 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 18:48:08.396055 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 18:48:08.396055 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 6da11b16-1bf5-4f25-9f71-be2efd3b719a could not be found. (HTTP 404) (Request-ID: req-42737357-2198-4672-8ffe-ef882b65128a) Oct 04 18:48:08.396055 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:48:08.396055 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:48:08.396055 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:48:08.396055 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:48:08.396055 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Oct 04 18:48:08.396055 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Oct 04 18:48:08.396055 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 04 18:48:08.396055 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 04 18:48:08.396055 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Oct 04 18:48:08.396055 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Oct 04 18:48:08.396055 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 04 18:48:08.396055 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 04 18:48:08.403128 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 04 18:48:08.403128 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 04 18:48:08.403128 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 04 18:48:08.403128 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 04 18:48:08.403128 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 04 18:48:08.403128 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 04 18:48:08.403128 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 18:48:08.403128 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 18:48:08.403128 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 18:48:08.403128 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 18:48:08.403128 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 18:48:08.403128 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 18:48:08.403128 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 18:48:08.403128 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 18:48:08.403128 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 6da11b16-1bf5-4f25-9f71-be2efd3b719a could not be found. Oct 04 18:48:08.403128 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:48:08.403128 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:48:08.403128 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:48:08.403128 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:48:08.403128 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:48:08.403128 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:48:08.403128 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:48:08.403128 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:48:08.403128 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:48:08.403128 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:48:08.403128 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:48:08.403128 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:48:08.403128 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Oct 04 18:48:08.403128 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:48:08.403128 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 6da11b16-1bf5-4f25-9f71-be2efd3b719a could not be found. Oct 04 18:48:08.403128 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:48:08.403128 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:48:08.403128 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:48:08.403128 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:48:08.403128 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:48:08.403128 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:48:08.403128 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:48:08.403128 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:48:08.403128 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 6da11b16-1bf5-4f25-9f71-be2efd3b719a could not be found. Oct 04 18:48:08.403128 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:48:08.403128 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-55cab814-ce3e-4608-860b-99b2f878d977 tempest-VolumesSnapshotsTestJSON-845312753 tempest-VolumesSnapshotsTestJSON-845312753-project] Returning 404 to user: Snapshot 6da11b16-1bf5-4f25-9f71-be2efd3b719a could not be found. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:48:08.403128 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-55cab814-ce3e-4608-860b-99b2f878d977 tempest-VolumesSnapshotsTestJSON-845312753 tempest-VolumesSnapshotsTestJSON-845312753-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/6da11b16-1bf5-4f25-9f71-be2efd3b719a" status: 404 len: 111 microversion: 2.1 time: 0.072826 Oct 04 18:48:08.403128 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1861/3964] 10.222.0.43 () {58 vars in 1251 bytes} [Tue Oct 4 18:48:08 2022] GET /compute/v2.1/os-snapshots/6da11b16-1bf5-4f25-9f71-be2efd3b719a => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:48:08.411228 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-5cd037b3-e8e7-4f49-b01b-b71cb94bd7ef tempest-VolumesSnapshotsTestJSON-845312753 tempest-VolumesSnapshotsTestJSON-845312753-project] Calling method '.version_select at 0x7fb227e5d430>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:08.433529 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-f50efa13-d567-4a03-8aa2-82564269a3cf tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Calling method '.version_select at 0x7fb21edf81f0>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:08.487989 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-f50efa13-d567-4a03-8aa2-82564269a3cf tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] HTTP exception thrown: Image not found. Oct 04 18:48:08.489884 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-f50efa13-d567-4a03-8aa2-82564269a3cf tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Request method failure captured: Oct 04 18:48:08.489884 n-d-851028-13 devstack@n-api.service[123595]: request: DELETE /compute/v2.1/images/07e07d19-dc02-4998-b7ed-fc8c9ba099c1 HTTP/1.1 Oct 04 18:48:08.489884 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 18:48:08.489884 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 18:48:08.489884 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 18:48:08.489884 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 0 Oct 04 18:48:08.489884 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 18:48:08.489884 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 18:48:08.489884 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 18:48:08.489884 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 18:48:08.489884 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPH978iZmaQey9qRFmivrOEN9WI4gFjhDc3nSUPEBZXv1WUgd7GTFhNQGJ_Nm2KHTEzU5QZw7VgnyxDt5Dwy3JGK8gUnF9wIKq6iB3FX5CCTGK5JwEw-XtwnwemZOTSVwZU_4nc3l4c2itfEGLVIoX2yb6G-IjSzn-sL8697UlYQlcew Oct 04 18:48:08.489884 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 18:48:08.489884 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 18:48:08.489884 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 18:48:08.489884 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 18:48:08.489884 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 18:48:08.489884 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 18:48:08.489884 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: 8ab4da2b9b9f4c7a9c25b7edaab3027d Oct 04 18:48:08.489884 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2004915413 Oct 04 18:48:08.489884 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 18:48:08.489884 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 18:48:08.489884 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/8ab4da2b9b9f4c7a9c25b7edaab3027d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_8ab4da2b9b9f4c7a9c25b7edaab3027d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8ab4da2b9b9f4c7a9c25b7edaab3027d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8ab4da2b9b9f4c7a9c25b7edaab3027d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:48:08.489884 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2004915413 Oct 04 18:48:08.489884 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: 8ab4da2b9b9f4c7a9c25b7edaab3027d Oct 04 18:48:08.489884 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2004915413 Oct 04 18:48:08.489884 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-ImagesOneServerNegativeTestJSON-2004915413-project Oct 04 18:48:08.489884 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 18:48:08.489884 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 18:48:08.489884 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: cdcbf2b4b95743af9e6fa1be54554baa Oct 04 18:48:08.489884 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2004915413-project Oct 04 18:48:08.489884 n-d-851028-13 devstack@n-api.service[123595]: method: Oct 04 18:48:08.489884 n-d-851028-13 devstack@n-api.service[123595]: exception: Image not found. Oct 04 18:48:08.489884 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': '07e07d19-dc02-4998-b7ed-fc8c9ba099c1'} Oct 04 18:48:08.489884 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:48:08.489884 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:48:08.489884 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 04 18:48:08.489884 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 04 18:48:08.489884 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 18:48:08.489884 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 18:48:08.489884 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 18:48:08.489884 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 18:48:08.489884 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 04 18:48:08.489884 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 04 18:48:08.489884 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 04 18:48:08.489884 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 04 18:48:08.489884 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 18:48:08.489884 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 18:48:08.489884 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 18:48:08.489884 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 18:48:08.489884 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 07e07d19-dc02-4998-b7ed-fc8c9ba099c1 to delete Oct 04 18:48:08.489884 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:48:08.489884 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:48:08.489884 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:48:08.489884 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:48:08.489884 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 04 18:48:08.489884 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 04 18:48:08.489884 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 04 18:48:08.489884 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 04 18:48:08.489884 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 04 18:48:08.489884 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 04 18:48:08.489884 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 07e07d19-dc02-4998-b7ed-fc8c9ba099c1 could not be found. Oct 04 18:48:08.489884 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:48:08.489884 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:48:08.489884 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:48:08.495039 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:48:08.495039 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:48:08.495039 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:48:08.495039 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:48:08.495039 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:48:08.495039 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:48:08.495039 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:48:08.495039 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:48:08.495039 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:48:08.495039 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 04 18:48:08.495039 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 18:48:08.495039 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 18:48:08.495039 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:48:08.495039 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:48:08.495039 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:48:08.495039 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:48:08.495039 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:48:08.495039 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:48:08.495039 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:48:08.495039 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:48:08.495039 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 18:48:08.495039 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:48:08.495039 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-f50efa13-d567-4a03-8aa2-82564269a3cf tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Returning 404 to user: Image not found. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:48:08.495039 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-f50efa13-d567-4a03-8aa2-82564269a3cf tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] 10.222.0.43 "DELETE /compute/v2.1/images/07e07d19-dc02-4998-b7ed-fc8c9ba099c1" status: 404 len: 62 microversion: 2.1 time: 0.063179 Oct 04 18:48:08.495039 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1862/3965] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:08 2022] DELETE /compute/v2.1/images/07e07d19-dc02-4998-b7ed-fc8c9ba099c1 => generated 62 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 04 18:48:08.500325 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-d78d16ac-c0a6-4e4e-9c53-6288792981e0 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:08.500827 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-d78d16ac-c0a6-4e4e-9c53-6288792981e0 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] [instance: 9886f261-8e00-4908-8fd8-f6ce9c6fd5b4] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:08.518432 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-5cd037b3-e8e7-4f49-b01b-b71cb94bd7ef tempest-VolumesSnapshotsTestJSON-845312753 tempest-VolumesSnapshotsTestJSON-845312753-project] 10.222.0.43 "DELETE /compute/v2.1/os-volumes/bad834ef-84d4-4642-8ea3-f2ee9d736da4" status: 202 len: 0 microversion: 2.1 time: 0.115272 Oct 04 18:48:08.519152 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2104/3966] 10.222.0.43 () {58 vars in 1248 bytes} [Tue Oct 4 18:48:08 2022] DELETE /compute/v2.1/os-volumes/bad834ef-84d4-4642-8ea3-f2ee9d736da4 => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:48:08.520882 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:48:08.526863 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-5a7e71d3-f712-4bf5-8f09-cff1beb50798 tempest-VolumesSnapshotsTestJSON-845312753 tempest-VolumesSnapshotsTestJSON-845312753-project] Calling method '.version_select at 0x7fb21ee65f70>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:08.538746 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d78d16ac-c0a6-4e4e-9c53-6288792981e0 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:08.539333 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d78d16ac-c0a6-4e4e-9c53-6288792981e0 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:08.539781 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d78d16ac-c0a6-4e4e-9c53-6288792981e0 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:08.540497 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d78d16ac-c0a6-4e4e-9c53-6288792981e0 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:08.540951 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d78d16ac-c0a6-4e4e-9c53-6288792981e0 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:08.541419 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d78d16ac-c0a6-4e4e-9c53-6288792981e0 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:08.588115 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-d78d16ac-c0a6-4e4e-9c53-6288792981e0 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] HTTP exception thrown: Instance 9886f261-8e00-4908-8fd8-f6ce9c6fd5b4 could not be found. Oct 04 18:48:08.589916 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-d78d16ac-c0a6-4e4e-9c53-6288792981e0 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Request method failure captured: Oct 04 18:48:08.589916 n-d-851028-13 devstack@n-api.service[123595]: request: DELETE /compute/v2.1/servers/9886f261-8e00-4908-8fd8-f6ce9c6fd5b4 HTTP/1.1 Oct 04 18:48:08.589916 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 18:48:08.589916 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 18:48:08.589916 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 18:48:08.589916 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 0 Oct 04 18:48:08.589916 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 18:48:08.589916 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 18:48:08.589916 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 18:48:08.589916 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 18:48:08.589916 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPH978iZmaQey9qRFmivrOEN9WI4gFjhDc3nSUPEBZXv1WUgd7GTFhNQGJ_Nm2KHTEzU5QZw7VgnyxDt5Dwy3JGK8gUnF9wIKq6iB3FX5CCTGK5JwEw-XtwnwemZOTSVwZU_4nc3l4c2itfEGLVIoX2yb6G-IjSzn-sL8697UlYQlcew Oct 04 18:48:08.589916 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 18:48:08.589916 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 18:48:08.589916 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 18:48:08.589916 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 18:48:08.589916 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 18:48:08.589916 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 18:48:08.589916 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: 8ab4da2b9b9f4c7a9c25b7edaab3027d Oct 04 18:48:08.589916 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2004915413 Oct 04 18:48:08.589916 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 18:48:08.589916 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 18:48:08.589916 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/8ab4da2b9b9f4c7a9c25b7edaab3027d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_8ab4da2b9b9f4c7a9c25b7edaab3027d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8ab4da2b9b9f4c7a9c25b7edaab3027d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8ab4da2b9b9f4c7a9c25b7edaab3027d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:48:08.589916 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2004915413 Oct 04 18:48:08.589916 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: 8ab4da2b9b9f4c7a9c25b7edaab3027d Oct 04 18:48:08.589916 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2004915413 Oct 04 18:48:08.589916 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-ImagesOneServerNegativeTestJSON-2004915413-project Oct 04 18:48:08.589916 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 18:48:08.589916 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 18:48:08.589916 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: cdcbf2b4b95743af9e6fa1be54554baa Oct 04 18:48:08.589916 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2004915413-project Oct 04 18:48:08.589916 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 18:48:08.589916 n-d-851028-13 devstack@n-api.service[123595]: exception: Instance 9886f261-8e00-4908-8fd8-f6ce9c6fd5b4 could not be found. Oct 04 18:48:08.589916 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': '9886f261-8e00-4908-8fd8-f6ce9c6fd5b4'} Oct 04 18:48:08.589916 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:48:08.589916 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:48:08.589916 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:48:08.589916 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:48:08.589916 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:48:08.589916 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:48:08.589916 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:48:08.589916 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:48:08.589916 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:48:08.589916 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:48:08.589916 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9886f261-8e00-4908-8fd8-f6ce9c6fd5b4 could not be found. Oct 04 18:48:08.589916 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:48:08.589916 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:48:08.589916 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:48:08.589916 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:48:08.589916 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:48:08.589916 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:48:08.589916 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:48:08.589916 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:48:08.589916 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:48:08.589916 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:48:08.589916 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:48:08.589916 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:48:08.589916 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:48:08.589916 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:48:08.589916 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:48:08.589916 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:48:08.589916 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:48:08.589916 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:48:08.595082 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9886f261-8e00-4908-8fd8-f6ce9c6fd5b4 could not be found. Oct 04 18:48:08.595082 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:48:08.595082 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:48:08.595082 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:48:08.595082 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:48:08.595082 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:48:08.595082 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:48:08.595082 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:48:08.595082 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:48:08.595082 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9886f261-8e00-4908-8fd8-f6ce9c6fd5b4 could not be found. Oct 04 18:48:08.595082 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:48:08.595082 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-d78d16ac-c0a6-4e4e-9c53-6288792981e0 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Returning 404 to user: Instance 9886f261-8e00-4908-8fd8-f6ce9c6fd5b4 could not be found. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:48:08.595082 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-d78d16ac-c0a6-4e4e-9c53-6288792981e0 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] 10.222.0.43 "DELETE /compute/v2.1/servers/9886f261-8e00-4908-8fd8-f6ce9c6fd5b4" status: 404 len: 111 microversion: 2.1 time: 0.094812 Oct 04 18:48:08.595082 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1863/3967] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 18:48:08 2022] DELETE /compute/v2.1/servers/9886f261-8e00-4908-8fd8-f6ce9c6fd5b4 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:48:08.621851 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-f06a34bd-ab2e-4de7-9aec-97f3c8c73977 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:08.622988 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-f06a34bd-ab2e-4de7-9aec-97f3c8c73977 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] [instance: 9886f261-8e00-4908-8fd8-f6ce9c6fd5b4] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:08.649299 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f06a34bd-ab2e-4de7-9aec-97f3c8c73977 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:08.649709 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-5a7e71d3-f712-4bf5-8f09-cff1beb50798 tempest-VolumesSnapshotsTestJSON-845312753 tempest-VolumesSnapshotsTestJSON-845312753-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/bad834ef-84d4-4642-8ea3-f2ee9d736da4" status: 200 len: 345 microversion: 2.1 time: 0.126275 Oct 04 18:48:08.649857 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f06a34bd-ab2e-4de7-9aec-97f3c8c73977 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:08.650234 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f06a34bd-ab2e-4de7-9aec-97f3c8c73977 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:08.650914 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2105/3968] 10.222.0.43 () {58 vars in 1245 bytes} [Tue Oct 4 18:48:08 2022] GET /compute/v2.1/os-volumes/bad834ef-84d4-4642-8ea3-f2ee9d736da4 => generated 345 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:48:08.651038 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f06a34bd-ab2e-4de7-9aec-97f3c8c73977 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:08.651459 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f06a34bd-ab2e-4de7-9aec-97f3c8c73977 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:08.651999 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f06a34bd-ab2e-4de7-9aec-97f3c8c73977 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:08.656691 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-51bdefdb-c94b-44ac-8c6a-dd065d0b617c tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:08.660415 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-51bdefdb-c94b-44ac-8c6a-dd065d0b617c tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] [instance: 6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:08.682122 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-51bdefdb-c94b-44ac-8c6a-dd065d0b617c tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:08.683076 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-f06a34bd-ab2e-4de7-9aec-97f3c8c73977 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] HTTP exception thrown: Instance 9886f261-8e00-4908-8fd8-f6ce9c6fd5b4 could not be found. Oct 04 18:48:08.683850 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-51bdefdb-c94b-44ac-8c6a-dd065d0b617c tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:08.684232 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-f06a34bd-ab2e-4de7-9aec-97f3c8c73977 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Request method failure captured: Oct 04 18:48:08.684232 n-d-851028-13 devstack@n-api.service[123595]: request: GET /compute/v2.1/servers/9886f261-8e00-4908-8fd8-f6ce9c6fd5b4 HTTP/1.1 Oct 04 18:48:08.684232 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 18:48:08.684232 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 18:48:08.684232 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 18:48:08.684232 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 0 Oct 04 18:48:08.684232 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 18:48:08.684232 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 18:48:08.684232 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 18:48:08.684232 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 18:48:08.684232 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPH978iZmaQey9qRFmivrOEN9WI4gFjhDc3nSUPEBZXv1WUgd7GTFhNQGJ_Nm2KHTEzU5QZw7VgnyxDt5Dwy3JGK8gUnF9wIKq6iB3FX5CCTGK5JwEw-XtwnwemZOTSVwZU_4nc3l4c2itfEGLVIoX2yb6G-IjSzn-sL8697UlYQlcew Oct 04 18:48:08.684232 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 18:48:08.684232 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 18:48:08.684232 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 18:48:08.684232 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 18:48:08.684232 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 18:48:08.684232 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 18:48:08.684232 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: 8ab4da2b9b9f4c7a9c25b7edaab3027d Oct 04 18:48:08.684232 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2004915413 Oct 04 18:48:08.684232 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 18:48:08.684232 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 18:48:08.684232 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/8ab4da2b9b9f4c7a9c25b7edaab3027d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_8ab4da2b9b9f4c7a9c25b7edaab3027d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8ab4da2b9b9f4c7a9c25b7edaab3027d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8ab4da2b9b9f4c7a9c25b7edaab3027d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:48:08.684232 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2004915413 Oct 04 18:48:08.684232 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: 8ab4da2b9b9f4c7a9c25b7edaab3027d Oct 04 18:48:08.684232 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2004915413 Oct 04 18:48:08.684232 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-ImagesOneServerNegativeTestJSON-2004915413-project Oct 04 18:48:08.684232 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 18:48:08.684232 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 18:48:08.684232 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: cdcbf2b4b95743af9e6fa1be54554baa Oct 04 18:48:08.684232 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2004915413-project Oct 04 18:48:08.684232 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 18:48:08.684232 n-d-851028-13 devstack@n-api.service[123595]: exception: Instance 9886f261-8e00-4908-8fd8-f6ce9c6fd5b4 could not be found. Oct 04 18:48:08.684232 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': '9886f261-8e00-4908-8fd8-f6ce9c6fd5b4'} Oct 04 18:48:08.684232 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:48:08.684232 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:48:08.684232 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:48:08.684232 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:48:08.684232 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:48:08.684232 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:48:08.684232 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:48:08.684232 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:48:08.684232 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:48:08.684232 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:48:08.684232 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9886f261-8e00-4908-8fd8-f6ce9c6fd5b4 could not be found. Oct 04 18:48:08.684232 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:48:08.684232 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:48:08.684232 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:48:08.684232 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:48:08.684232 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:48:08.684232 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:48:08.684232 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:48:08.684232 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:48:08.684232 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:48:08.684232 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:48:08.684232 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:48:08.684232 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:48:08.684232 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:48:08.684232 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:48:08.684232 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:48:08.684232 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:48:08.684232 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9886f261-8e00-4908-8fd8-f6ce9c6fd5b4 could not be found. Oct 04 18:48:08.684232 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:48:08.684232 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:48:08.688645 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:48:08.688645 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:48:08.688645 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:48:08.688645 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:48:08.688645 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:48:08.688645 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:48:08.688645 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9886f261-8e00-4908-8fd8-f6ce9c6fd5b4 could not be found. Oct 04 18:48:08.688645 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:48:08.688645 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-f06a34bd-ab2e-4de7-9aec-97f3c8c73977 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] Returning 404 to user: Instance 9886f261-8e00-4908-8fd8-f6ce9c6fd5b4 could not be found. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:48:08.688645 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-f06a34bd-ab2e-4de7-9aec-97f3c8c73977 tempest-ImagesOneServerNegativeTestJSON-2004915413 tempest-ImagesOneServerNegativeTestJSON-2004915413-project] 10.222.0.43 "GET /compute/v2.1/servers/9886f261-8e00-4908-8fd8-f6ce9c6fd5b4" status: 404 len: 111 microversion: 2.1 time: 0.070488 Oct 04 18:48:08.691036 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-51bdefdb-c94b-44ac-8c6a-dd065d0b617c tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:08.692049 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-51bdefdb-c94b-44ac-8c6a-dd065d0b617c tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:08.692760 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-51bdefdb-c94b-44ac-8c6a-dd065d0b617c tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:08.693457 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-51bdefdb-c94b-44ac-8c6a-dd065d0b617c tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:08.701538 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1864/3969] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:08 2022] GET /compute/v2.1/servers/9886f261-8e00-4908-8fd8-f6ce9c6fd5b4 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:48:08.744606 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-51bdefdb-c94b-44ac-8c6a-dd065d0b617c tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] [instance: 6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75] Going to try to terminate instance {{(pid=123596) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:48:08.923501 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-51bdefdb-c94b-44ac-8c6a-dd065d0b617c tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] 10.222.0.43 "DELETE /compute/v2.1/servers/6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75" status: 204 len: 0 microversion: 2.1 time: 0.270432 Oct 04 18:48:08.924020 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2106/3970] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 18:48:08 2022] DELETE /compute/v2.1/servers/6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:48:08.933166 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-8ab78a14-b499-4653-8d11-bb6a2d0a3623 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:08.934108 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-8ab78a14-b499-4653-8d11-bb6a2d0a3623 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] [instance: 6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:08.945074 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-849e2045-dac7-4b82-989e-c129a0291062 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:08.946667 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-849e2045-dac7-4b82-989e-c129a0291062 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] [instance: 76d475ab-f41c-44df-8aaa-10242bdbfcde] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:08.948814 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8ab78a14-b499-4653-8d11-bb6a2d0a3623 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:08.952399 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8ab78a14-b499-4653-8d11-bb6a2d0a3623 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:08.953093 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8ab78a14-b499-4653-8d11-bb6a2d0a3623 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:08.966181 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8ab78a14-b499-4653-8d11-bb6a2d0a3623 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:08.970445 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8ab78a14-b499-4653-8d11-bb6a2d0a3623 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:08.972955 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-849e2045-dac7-4b82-989e-c129a0291062 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:08.973341 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8ab78a14-b499-4653-8d11-bb6a2d0a3623 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:08.985978 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-849e2045-dac7-4b82-989e-c129a0291062 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:08.986715 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-849e2045-dac7-4b82-989e-c129a0291062 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:08.989668 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-849e2045-dac7-4b82-989e-c129a0291062 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:08.990381 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-849e2045-dac7-4b82-989e-c129a0291062 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:08.991023 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-849e2045-dac7-4b82-989e-c129a0291062 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:09.318380 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-8ab78a14-b499-4653-8d11-bb6a2d0a3623 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9971b5861f44c1a1da94eda0f8f02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f809b8ae704988961908bef0f3cb24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:09.329680 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-8ab78a14-b499-4653-8d11-bb6a2d0a3623 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] 10.222.0.43 "GET /compute/v2.1/servers/6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75" status: 200 len: 1668 microversion: 2.1 time: 0.401425 Oct 04 18:48:09.332500 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1865/3971] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:08 2022] GET /compute/v2.1/servers/6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75 => generated 1668 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:09.509087 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-849e2045-dac7-4b82-989e-c129a0291062 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a116f2d9656548458264cc4fb1934c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff3c3dc76405401baf72fe00c5d50b56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:09.518272 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-849e2045-dac7-4b82-989e-c129a0291062 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] 10.222.0.43 "GET /compute/v2.1/servers/76d475ab-f41c-44df-8aaa-10242bdbfcde" status: 200 len: 1655 microversion: 2.1 time: 0.577394 Oct 04 18:48:09.530446 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2107/3972] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:08 2022] GET /compute/v2.1/servers/76d475ab-f41c-44df-8aaa-10242bdbfcde => generated 1655 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:09.545180 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-e4632903-5cac-4a37-bb8c-c0adc70970da tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:48:09.565682 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e4632903-5cac-4a37-bb8c-c0adc70970da tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:09.570610 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e4632903-5cac-4a37-bb8c-c0adc70970da tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:09.573818 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e4632903-5cac-4a37-bb8c-c0adc70970da tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:09.666287 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-04d0f7e7-0ace-40ad-be4b-e5e5f6fb4008 tempest-VolumesSnapshotsTestJSON-845312753 tempest-VolumesSnapshotsTestJSON-845312753-project] Calling method '.version_select at 0x7fb2246bc700>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:09.682433 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-e4632903-5cac-4a37-bb8c-c0adc70970da tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] [instance: 76d475ab-f41c-44df-8aaa-10242bdbfcde] Going to try to start instance {{(pid=123595) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 04 18:48:09.802500 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-e4632903-5cac-4a37-bb8c-c0adc70970da tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] 10.222.0.43 "POST /compute/v2.1/servers/76d475ab-f41c-44df-8aaa-10242bdbfcde/action" status: 202 len: 0 microversion: 2.1 time: 0.262726 Oct 04 18:48:09.803749 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1866/3973] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 18:48:09 2022] POST /compute/v2.1/servers/76d475ab-f41c-44df-8aaa-10242bdbfcde/action => generated 0 bytes in 265 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:48:09.817528 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-0b1141de-781c-452b-832c-80e215fbba7a tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:09.821412 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-0b1141de-781c-452b-832c-80e215fbba7a tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] [instance: 76d475ab-f41c-44df-8aaa-10242bdbfcde] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:09.836984 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0b1141de-781c-452b-832c-80e215fbba7a tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:09.837728 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0b1141de-781c-452b-832c-80e215fbba7a tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:09.839016 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0b1141de-781c-452b-832c-80e215fbba7a tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:09.840404 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0b1141de-781c-452b-832c-80e215fbba7a tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:09.841751 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-04d0f7e7-0ace-40ad-be4b-e5e5f6fb4008 tempest-VolumesSnapshotsTestJSON-845312753 tempest-VolumesSnapshotsTestJSON-845312753-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/bad834ef-84d4-4642-8ea3-f2ee9d736da4" status: 200 len: 345 microversion: 2.1 time: 0.179895 Oct 04 18:48:09.843274 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0b1141de-781c-452b-832c-80e215fbba7a tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:09.844799 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0b1141de-781c-452b-832c-80e215fbba7a tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:09.849610 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2108/3974] 10.222.0.43 () {58 vars in 1245 bytes} [Tue Oct 4 18:48:09 2022] GET /compute/v2.1/os-volumes/bad834ef-84d4-4642-8ea3-f2ee9d736da4 => generated 345 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:48:10.360201 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-1b6b377a-2a8d-4f7d-85ad-435c56c87a62 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:10.361764 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-1b6b377a-2a8d-4f7d-85ad-435c56c87a62 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] [instance: 6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:10.380266 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1b6b377a-2a8d-4f7d-85ad-435c56c87a62 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:10.380801 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1b6b377a-2a8d-4f7d-85ad-435c56c87a62 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:10.381288 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1b6b377a-2a8d-4f7d-85ad-435c56c87a62 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:10.387282 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1b6b377a-2a8d-4f7d-85ad-435c56c87a62 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:10.387282 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1b6b377a-2a8d-4f7d-85ad-435c56c87a62 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:10.387282 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1b6b377a-2a8d-4f7d-85ad-435c56c87a62 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:10.912622 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-0b1141de-781c-452b-832c-80e215fbba7a tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a116f2d9656548458264cc4fb1934c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff3c3dc76405401baf72fe00c5d50b56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:10.936623 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-0b1141de-781c-452b-832c-80e215fbba7a tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] 10.222.0.43 "GET /compute/v2.1/servers/76d475ab-f41c-44df-8aaa-10242bdbfcde" status: 200 len: 1664 microversion: 2.1 time: 1.126673 Oct 04 18:48:10.941203 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1867/3975] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:09 2022] GET /compute/v2.1/servers/76d475ab-f41c-44df-8aaa-10242bdbfcde => generated 1664 bytes in 1133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:10.947918 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-ead9977a-7c6b-458f-9481-6418753d6ca2 tempest-VolumesSnapshotsTestJSON-845312753 tempest-VolumesSnapshotsTestJSON-845312753-project] Calling method '.version_select at 0x7fb21eb4f9d0>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:11.004253 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-1b6b377a-2a8d-4f7d-85ad-435c56c87a62 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9971b5861f44c1a1da94eda0f8f02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f809b8ae704988961908bef0f3cb24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:11.026981 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-1b6b377a-2a8d-4f7d-85ad-435c56c87a62 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] 10.222.0.43 "GET /compute/v2.1/servers/6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75" status: 200 len: 1668 microversion: 2.1 time: 0.671950 Oct 04 18:48:11.029547 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2109/3976] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:10 2022] GET /compute/v2.1/servers/6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75 => generated 1668 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:48:11.052106 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-ead9977a-7c6b-458f-9481-6418753d6ca2 tempest-VolumesSnapshotsTestJSON-845312753 tempest-VolumesSnapshotsTestJSON-845312753-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/bad834ef-84d4-4642-8ea3-f2ee9d736da4" status: 200 len: 345 microversion: 2.1 time: 0.108585 Oct 04 18:48:11.054257 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1868/3977] 10.222.0.43 () {58 vars in 1245 bytes} [Tue Oct 4 18:48:10 2022] GET /compute/v2.1/os-volumes/bad834ef-84d4-4642-8ea3-f2ee9d736da4 => generated 345 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:48:11.513614 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-7d3f1ee7-1813-49c4-be64-1da55c87850d tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:11.514248 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-7d3f1ee7-1813-49c4-be64-1da55c87850d tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 82b86465-afb0-49ef-9932-1538010c1ae5] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:11.528884 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7d3f1ee7-1813-49c4-be64-1da55c87850d tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:11.529461 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7d3f1ee7-1813-49c4-be64-1da55c87850d tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:11.529919 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7d3f1ee7-1813-49c4-be64-1da55c87850d tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:11.530673 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7d3f1ee7-1813-49c4-be64-1da55c87850d tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:11.541547 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7d3f1ee7-1813-49c4-be64-1da55c87850d tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:11.542421 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7d3f1ee7-1813-49c4-be64-1da55c87850d tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:11.972395 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-1243892e-93ba-4912-b9db-43448af4f91f tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:11.973158 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-1243892e-93ba-4912-b9db-43448af4f91f tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] [instance: 76d475ab-f41c-44df-8aaa-10242bdbfcde] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:11.986083 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1243892e-93ba-4912-b9db-43448af4f91f tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:11.990356 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1243892e-93ba-4912-b9db-43448af4f91f tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:11.990950 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1243892e-93ba-4912-b9db-43448af4f91f tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:11.991799 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1243892e-93ba-4912-b9db-43448af4f91f tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:11.994955 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1243892e-93ba-4912-b9db-43448af4f91f tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:11.995687 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1243892e-93ba-4912-b9db-43448af4f91f tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:11.998443 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-7d3f1ee7-1813-49c4-be64-1da55c87850d tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:12.015746 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-7d3f1ee7-1813-49c4-be64-1da55c87850d tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5" status: 200 len: 1667 microversion: 2.1 time: 0.502090 Oct 04 18:48:12.016311 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2110/3978] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:11 2022] GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5 => generated 1667 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:12.087989 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-96e5cb22-b165-4c3f-a600-a78676c7de40 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:12.088621 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-96e5cb22-b165-4c3f-a600-a78676c7de40 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 82b86465-afb0-49ef-9932-1538010c1ae5] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:12.107211 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-96e5cb22-b165-4c3f-a600-a78676c7de40 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:12.108793 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-96e5cb22-b165-4c3f-a600-a78676c7de40 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:12.117759 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-96e5cb22-b165-4c3f-a600-a78676c7de40 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:12.118727 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-96e5cb22-b165-4c3f-a600-a78676c7de40 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:12.119746 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-96e5cb22-b165-4c3f-a600-a78676c7de40 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:12.120284 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-96e5cb22-b165-4c3f-a600-a78676c7de40 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:12.595133 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-96e5cb22-b165-4c3f-a600-a78676c7de40 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:12.605496 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-96e5cb22-b165-4c3f-a600-a78676c7de40 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5" status: 200 len: 1667 microversion: 2.1 time: 0.530878 Oct 04 18:48:12.606053 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2111/3979] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:12 2022] GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5 => generated 1667 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:12.616888 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f067857a-7a40-4fbe-b7a6-017fb2e81e90 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:12.618854 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-f067857a-7a40-4fbe-b7a6-017fb2e81e90 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] [instance: 6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:12.637229 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f067857a-7a40-4fbe-b7a6-017fb2e81e90 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:12.637667 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f067857a-7a40-4fbe-b7a6-017fb2e81e90 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:12.638556 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f067857a-7a40-4fbe-b7a6-017fb2e81e90 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:12.639776 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f067857a-7a40-4fbe-b7a6-017fb2e81e90 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:12.640247 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f067857a-7a40-4fbe-b7a6-017fb2e81e90 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:12.643061 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f067857a-7a40-4fbe-b7a6-017fb2e81e90 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:12.652168 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-1243892e-93ba-4912-b9db-43448af4f91f tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a116f2d9656548458264cc4fb1934c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff3c3dc76405401baf72fe00c5d50b56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:12.670869 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-1243892e-93ba-4912-b9db-43448af4f91f tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] 10.222.0.43 "GET /compute/v2.1/servers/76d475ab-f41c-44df-8aaa-10242bdbfcde" status: 200 len: 1664 microversion: 2.1 time: 0.695055 Oct 04 18:48:12.671548 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1869/3980] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:11 2022] GET /compute/v2.1/servers/76d475ab-f41c-44df-8aaa-10242bdbfcde => generated 1664 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:12.682436 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-321da1b2-80ff-434b-9396-08f3fe010f23 tempest-VolumesSnapshotsTestJSON-845312753 tempest-VolumesSnapshotsTestJSON-845312753-project] Calling method '.version_select at 0x7fb21edf8a60>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:12.767849 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-321da1b2-80ff-434b-9396-08f3fe010f23 tempest-VolumesSnapshotsTestJSON-845312753 tempest-VolumesSnapshotsTestJSON-845312753-project] HTTP exception thrown: Volume bad834ef-84d4-4642-8ea3-f2ee9d736da4 could not be found. Oct 04 18:48:12.770129 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-321da1b2-80ff-434b-9396-08f3fe010f23 tempest-VolumesSnapshotsTestJSON-845312753 tempest-VolumesSnapshotsTestJSON-845312753-project] Request method failure captured: Oct 04 18:48:12.770129 n-d-851028-13 devstack@n-api.service[123595]: request: GET /compute/v2.1/os-volumes/bad834ef-84d4-4642-8ea3-f2ee9d736da4 HTTP/1.1 Oct 04 18:48:12.770129 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 18:48:12.770129 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 18:48:12.770129 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 18:48:12.770129 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 0 Oct 04 18:48:12.770129 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 18:48:12.770129 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 18:48:12.770129 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 18:48:12.770129 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 18:48:12.770129 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPH_czZJtW49Pwo2OlxDYq6_8qrSzujJ71WFvOiKwxDerZORrgd4f_Tmh5V7p97tB_eZ0bhyUWdh2Pzl0BBm0yLECXTz3GaNtrElydhCrj03GQyL91dmwryWGNOTDZUGaE5cUAet6tpqG9zVaW__YRuxM7-VAD5jc88SaO9BR6W7SvWo Oct 04 18:48:12.770129 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 18:48:12.770129 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 18:48:12.770129 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 18:48:12.770129 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 18:48:12.770129 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 18:48:12.770129 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 18:48:12.770129 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: 8c9933bf5dd74746a9bf9fb9f345d738 Oct 04 18:48:12.770129 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-845312753 Oct 04 18:48:12.770129 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 18:48:12.770129 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 18:48:12.770129 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/8c9933bf5dd74746a9bf9fb9f345d738"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_8c9933bf5dd74746a9bf9fb9f345d738"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8c9933bf5dd74746a9bf9fb9f345d738"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8c9933bf5dd74746a9bf9fb9f345d738"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:48:12.770129 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-VolumesSnapshotsTestJSON-845312753 Oct 04 18:48:12.770129 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: 8c9933bf5dd74746a9bf9fb9f345d738 Oct 04 18:48:12.770129 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-845312753 Oct 04 18:48:12.770129 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-VolumesSnapshotsTestJSON-845312753-project Oct 04 18:48:12.770129 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 18:48:12.770129 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 18:48:12.770129 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: bd0bcce6187d497f9222ba87881fd4ab Oct 04 18:48:12.770129 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-VolumesSnapshotsTestJSON-845312753-project Oct 04 18:48:12.770129 n-d-851028-13 devstack@n-api.service[123595]: method: Oct 04 18:48:12.770129 n-d-851028-13 devstack@n-api.service[123595]: exception: Volume bad834ef-84d4-4642-8ea3-f2ee9d736da4 could not be found. Oct 04 18:48:12.770129 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': 'bad834ef-84d4-4642-8ea3-f2ee9d736da4'} Oct 04 18:48:12.770129 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:48:12.770129 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:48:12.770129 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 18:48:12.770129 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 18:48:12.770129 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 18:48:12.770129 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 18:48:12.770129 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 18:48:12.770129 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 18:48:12.770129 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 18:48:12.770129 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 18:48:12.770129 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 18:48:12.770129 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 18:48:12.770129 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 18:48:12.770129 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 18:48:12.770129 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 18:48:12.770129 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 18:48:12.770129 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume bad834ef-84d4-4642-8ea3-f2ee9d736da4 could not be found. (HTTP 404) (Request-ID: req-734a8c5d-c581-49ba-a5be-22f167307757) Oct 04 18:48:12.770129 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:48:12.770129 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:48:12.770129 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:48:12.770129 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:48:12.770129 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 04 18:48:12.770129 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 04 18:48:12.770129 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 04 18:48:12.770129 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 04 18:48:12.770129 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 04 18:48:12.770129 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 04 18:48:12.770129 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 04 18:48:12.770129 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 04 18:48:12.770129 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 18:48:12.776147 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 18:48:12.776147 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 18:48:12.776147 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 18:48:12.776147 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 18:48:12.776147 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 18:48:12.776147 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 18:48:12.776147 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 18:48:12.776147 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 18:48:12.776147 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 18:48:12.776147 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 18:48:12.776147 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 18:48:12.776147 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 18:48:12.776147 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 18:48:12.776147 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume bad834ef-84d4-4642-8ea3-f2ee9d736da4 could not be found. Oct 04 18:48:12.776147 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:48:12.776147 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:48:12.776147 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:48:12.776147 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:48:12.776147 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:48:12.776147 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:48:12.776147 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:48:12.776147 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:48:12.776147 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:48:12.776147 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:48:12.776147 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:48:12.776147 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:48:12.776147 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 04 18:48:12.776147 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:48:12.776147 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume bad834ef-84d4-4642-8ea3-f2ee9d736da4 could not be found. Oct 04 18:48:12.776147 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:48:12.776147 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:48:12.776147 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:48:12.776147 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:48:12.776147 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:48:12.776147 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:48:12.776147 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:48:12.776147 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:48:12.776147 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume bad834ef-84d4-4642-8ea3-f2ee9d736da4 could not be found. Oct 04 18:48:12.776147 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:48:12.782467 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-321da1b2-80ff-434b-9396-08f3fe010f23 tempest-VolumesSnapshotsTestJSON-845312753 tempest-VolumesSnapshotsTestJSON-845312753-project] Returning 404 to user: Volume bad834ef-84d4-4642-8ea3-f2ee9d736da4 could not be found. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:48:12.783175 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-321da1b2-80ff-434b-9396-08f3fe010f23 tempest-VolumesSnapshotsTestJSON-845312753 tempest-VolumesSnapshotsTestJSON-845312753-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/bad834ef-84d4-4642-8ea3-f2ee9d736da4" status: 404 len: 109 microversion: 2.1 time: 0.110463 Oct 04 18:48:12.784294 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1870/3981] 10.222.0.43 () {58 vars in 1245 bytes} [Tue Oct 4 18:48:12 2022] GET /compute/v2.1/os-volumes/bad834ef-84d4-4642-8ea3-f2ee9d736da4 => generated 109 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:48:12.794150 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-3deb581f-9717-4d0a-9989-682a978d146e tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:12.795069 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-3deb581f-9717-4d0a-9989-682a978d146e tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 82b86465-afb0-49ef-9932-1538010c1ae5] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:12.825728 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-f067857a-7a40-4fbe-b7a6-017fb2e81e90 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9971b5861f44c1a1da94eda0f8f02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f809b8ae704988961908bef0f3cb24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:12.836295 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3deb581f-9717-4d0a-9989-682a978d146e tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:12.836800 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3deb581f-9717-4d0a-9989-682a978d146e tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:12.837269 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3deb581f-9717-4d0a-9989-682a978d146e tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:12.842043 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:48:12.844579 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3deb581f-9717-4d0a-9989-682a978d146e tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:12.845080 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3deb581f-9717-4d0a-9989-682a978d146e tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:12.845551 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3deb581f-9717-4d0a-9989-682a978d146e tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:12.852201 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-f067857a-7a40-4fbe-b7a6-017fb2e81e90 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] 10.222.0.43 "GET /compute/v2.1/servers/6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75" status: 200 len: 1601 microversion: 2.1 time: 0.239046 Oct 04 18:48:12.856012 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2112/3982] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:12 2022] GET /compute/v2.1/servers/6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75 => generated 1601 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:12.887290 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-e70ff27c-eef5-4c12-985f-108c77cd8733 tempest-VolumesSnapshotsTestJSON-845312753 tempest-VolumesSnapshotsTestJSON-845312753-project] Calling method '.version_select at 0x7fb21ecfc790>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:12.950615 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-e70ff27c-eef5-4c12-985f-108c77cd8733 tempest-VolumesSnapshotsTestJSON-845312753 tempest-VolumesSnapshotsTestJSON-845312753-project] HTTP exception thrown: Volume bad834ef-84d4-4642-8ea3-f2ee9d736da4 could not be found. Oct 04 18:48:12.960455 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-e70ff27c-eef5-4c12-985f-108c77cd8733 tempest-VolumesSnapshotsTestJSON-845312753 tempest-VolumesSnapshotsTestJSON-845312753-project] Request method failure captured: Oct 04 18:48:12.960455 n-d-851028-13 devstack@n-api.service[123596]: request: DELETE /compute/v2.1/os-volumes/bad834ef-84d4-4642-8ea3-f2ee9d736da4 HTTP/1.1 Oct 04 18:48:12.960455 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:48:12.960455 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:48:12.960455 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:48:12.960455 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 18:48:12.960455 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:48:12.960455 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:48:12.960455 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:48:12.960455 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:48:12.960455 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPH_czZJtW49Pwo2OlxDYq6_8qrSzujJ71WFvOiKwxDerZORrgd4f_Tmh5V7p97tB_eZ0bhyUWdh2Pzl0BBm0yLECXTz3GaNtrElydhCrj03GQyL91dmwryWGNOTDZUGaE5cUAet6tpqG9zVaW__YRuxM7-VAD5jc88SaO9BR6W7SvWo Oct 04 18:48:12.960455 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:48:12.960455 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:48:12.960455 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:48:12.960455 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:48:12.960455 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:48:12.960455 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:48:12.960455 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: 8c9933bf5dd74746a9bf9fb9f345d738 Oct 04 18:48:12.960455 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-845312753 Oct 04 18:48:12.960455 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 18:48:12.960455 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 18:48:12.960455 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/8c9933bf5dd74746a9bf9fb9f345d738"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_8c9933bf5dd74746a9bf9fb9f345d738"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8c9933bf5dd74746a9bf9fb9f345d738"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8c9933bf5dd74746a9bf9fb9f345d738"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:48:12.960455 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-VolumesSnapshotsTestJSON-845312753 Oct 04 18:48:12.960455 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: 8c9933bf5dd74746a9bf9fb9f345d738 Oct 04 18:48:12.960455 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-845312753 Oct 04 18:48:12.960455 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-VolumesSnapshotsTestJSON-845312753-project Oct 04 18:48:12.960455 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:48:12.960455 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:48:12.960455 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: bd0bcce6187d497f9222ba87881fd4ab Oct 04 18:48:12.960455 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-VolumesSnapshotsTestJSON-845312753-project Oct 04 18:48:12.960455 n-d-851028-13 devstack@n-api.service[123596]: method: Oct 04 18:48:12.960455 n-d-851028-13 devstack@n-api.service[123596]: exception: Volume bad834ef-84d4-4642-8ea3-f2ee9d736da4 could not be found. Oct 04 18:48:12.960455 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': 'bad834ef-84d4-4642-8ea3-f2ee9d736da4'} Oct 04 18:48:12.960455 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:48:12.960455 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:48:12.960455 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 18:48:12.960455 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 18:48:12.960455 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 04 18:48:12.960455 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 04 18:48:12.960455 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 04 18:48:12.960455 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 04 18:48:12.960455 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 04 18:48:12.960455 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 04 18:48:12.960455 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 04 18:48:12.960455 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 04 18:48:12.960455 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 18:48:12.960455 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 18:48:12.960455 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 18:48:12.960455 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 18:48:12.960455 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume bad834ef-84d4-4642-8ea3-f2ee9d736da4 could not be found. (HTTP 404) (Request-ID: req-f8efba7e-d3db-435c-822c-a2b61a987eea) Oct 04 18:48:12.960455 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:48:12.960455 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:48:12.960455 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:48:12.960455 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:48:12.960455 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 04 18:48:12.960455 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 04 18:48:12.960455 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 04 18:48:12.960455 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 04 18:48:12.960455 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 04 18:48:12.960455 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 04 18:48:12.960455 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 04 18:48:12.960455 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 04 18:48:12.960455 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 18:48:12.967881 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 18:48:12.967881 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 04 18:48:12.967881 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 04 18:48:12.967881 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 04 18:48:12.967881 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 04 18:48:12.967881 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 04 18:48:12.967881 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 04 18:48:12.967881 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 04 18:48:12.967881 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 04 18:48:12.967881 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 18:48:12.967881 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 18:48:12.967881 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 18:48:12.967881 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 18:48:12.967881 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume bad834ef-84d4-4642-8ea3-f2ee9d736da4 could not be found. Oct 04 18:48:12.967881 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:48:12.967881 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:48:12.967881 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:48:12.967881 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:48:12.967881 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:48:12.967881 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:48:12.967881 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:48:12.967881 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:48:12.967881 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:48:12.967881 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:48:12.967881 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:48:12.967881 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:48:12.967881 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 04 18:48:12.967881 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:48:12.967881 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume bad834ef-84d4-4642-8ea3-f2ee9d736da4 could not be found. Oct 04 18:48:12.967881 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:48:12.967881 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:48:12.967881 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:48:12.967881 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:48:12.967881 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:48:12.967881 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:48:12.967881 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:48:12.967881 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:48:12.967881 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume bad834ef-84d4-4642-8ea3-f2ee9d736da4 could not be found. Oct 04 18:48:12.967881 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:48:12.967881 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-e70ff27c-eef5-4c12-985f-108c77cd8733 tempest-VolumesSnapshotsTestJSON-845312753 tempest-VolumesSnapshotsTestJSON-845312753-project] Returning 404 to user: Volume bad834ef-84d4-4642-8ea3-f2ee9d736da4 could not be found. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:48:12.967881 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-e70ff27c-eef5-4c12-985f-108c77cd8733 tempest-VolumesSnapshotsTestJSON-845312753 tempest-VolumesSnapshotsTestJSON-845312753-project] 10.222.0.43 "DELETE /compute/v2.1/os-volumes/bad834ef-84d4-4642-8ea3-f2ee9d736da4" status: 404 len: 109 microversion: 2.1 time: 0.086339 Oct 04 18:48:12.967881 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2113/3983] 10.222.0.43 () {58 vars in 1248 bytes} [Tue Oct 4 18:48:12 2022] DELETE /compute/v2.1/os-volumes/bad834ef-84d4-4642-8ea3-f2ee9d736da4 => generated 109 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:48:12.979167 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-c9a04c4d-ba4f-41f3-ae1a-e7392351ec45 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:12.983464 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-c9a04c4d-ba4f-41f3-ae1a-e7392351ec45 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] [instance: fa47906d-d394-46fe-9143-780bcd27a715] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:13.007533 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c9a04c4d-ba4f-41f3-ae1a-e7392351ec45 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:13.030566 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c9a04c4d-ba4f-41f3-ae1a-e7392351ec45 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:13.031146 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c9a04c4d-ba4f-41f3-ae1a-e7392351ec45 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:13.043451 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c9a04c4d-ba4f-41f3-ae1a-e7392351ec45 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:13.044456 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c9a04c4d-ba4f-41f3-ae1a-e7392351ec45 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:13.050724 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c9a04c4d-ba4f-41f3-ae1a-e7392351ec45 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:13.424686 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-3deb581f-9717-4d0a-9989-682a978d146e tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:13.438220 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-3deb581f-9717-4d0a-9989-682a978d146e tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5" status: 200 len: 1667 microversion: 2.1 time: 0.652402 Oct 04 18:48:13.438841 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1871/3984] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:12 2022] GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5 => generated 1667 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:13.450387 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-addf8d7a-fbf4-4969-896d-c207a048bc6b tempest-VolumesSnapshotsTestJSON-845312753 tempest-VolumesSnapshotsTestJSON-845312753-project] Calling method '.version_select at 0x7fb21eb09430>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:13.513032 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-addf8d7a-fbf4-4969-896d-c207a048bc6b tempest-VolumesSnapshotsTestJSON-845312753 tempest-VolumesSnapshotsTestJSON-845312753-project] HTTP exception thrown: Volume bad834ef-84d4-4642-8ea3-f2ee9d736da4 could not be found. Oct 04 18:48:13.515081 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-addf8d7a-fbf4-4969-896d-c207a048bc6b tempest-VolumesSnapshotsTestJSON-845312753 tempest-VolumesSnapshotsTestJSON-845312753-project] Request method failure captured: Oct 04 18:48:13.515081 n-d-851028-13 devstack@n-api.service[123595]: request: GET /compute/v2.1/os-volumes/bad834ef-84d4-4642-8ea3-f2ee9d736da4 HTTP/1.1 Oct 04 18:48:13.515081 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 18:48:13.515081 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 18:48:13.515081 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 18:48:13.515081 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 0 Oct 04 18:48:13.515081 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 18:48:13.515081 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 18:48:13.515081 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 18:48:13.515081 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 18:48:13.515081 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPH_czZJtW49Pwo2OlxDYq6_8qrSzujJ71WFvOiKwxDerZORrgd4f_Tmh5V7p97tB_eZ0bhyUWdh2Pzl0BBm0yLECXTz3GaNtrElydhCrj03GQyL91dmwryWGNOTDZUGaE5cUAet6tpqG9zVaW__YRuxM7-VAD5jc88SaO9BR6W7SvWo Oct 04 18:48:13.515081 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 18:48:13.515081 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 18:48:13.515081 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 18:48:13.515081 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 18:48:13.515081 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 18:48:13.515081 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 18:48:13.515081 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: 8c9933bf5dd74746a9bf9fb9f345d738 Oct 04 18:48:13.515081 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-845312753 Oct 04 18:48:13.515081 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 18:48:13.515081 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 18:48:13.515081 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/8c9933bf5dd74746a9bf9fb9f345d738"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_8c9933bf5dd74746a9bf9fb9f345d738"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8c9933bf5dd74746a9bf9fb9f345d738"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8c9933bf5dd74746a9bf9fb9f345d738"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:48:13.515081 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-VolumesSnapshotsTestJSON-845312753 Oct 04 18:48:13.515081 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: 8c9933bf5dd74746a9bf9fb9f345d738 Oct 04 18:48:13.515081 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-845312753 Oct 04 18:48:13.515081 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-VolumesSnapshotsTestJSON-845312753-project Oct 04 18:48:13.515081 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 18:48:13.515081 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 18:48:13.515081 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: bd0bcce6187d497f9222ba87881fd4ab Oct 04 18:48:13.515081 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-VolumesSnapshotsTestJSON-845312753-project Oct 04 18:48:13.515081 n-d-851028-13 devstack@n-api.service[123595]: method: Oct 04 18:48:13.515081 n-d-851028-13 devstack@n-api.service[123595]: exception: Volume bad834ef-84d4-4642-8ea3-f2ee9d736da4 could not be found. Oct 04 18:48:13.515081 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': 'bad834ef-84d4-4642-8ea3-f2ee9d736da4'} Oct 04 18:48:13.515081 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:48:13.515081 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:48:13.515081 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 18:48:13.515081 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 18:48:13.515081 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 18:48:13.515081 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 18:48:13.515081 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 18:48:13.515081 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 18:48:13.515081 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 18:48:13.515081 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 18:48:13.515081 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 18:48:13.515081 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 18:48:13.515081 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 18:48:13.515081 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 18:48:13.515081 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 18:48:13.515081 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 18:48:13.515081 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume bad834ef-84d4-4642-8ea3-f2ee9d736da4 could not be found. (HTTP 404) (Request-ID: req-4114a6ec-38b6-4924-8ddd-24ec0351ed5f) Oct 04 18:48:13.515081 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:48:13.515081 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:48:13.515081 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:48:13.515081 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:48:13.515081 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 04 18:48:13.515081 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 04 18:48:13.515081 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 04 18:48:13.515081 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 04 18:48:13.515081 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 04 18:48:13.515081 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 04 18:48:13.515081 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 04 18:48:13.515081 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 04 18:48:13.515081 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 18:48:13.521171 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 18:48:13.521171 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 18:48:13.521171 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 18:48:13.521171 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 18:48:13.521171 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 18:48:13.521171 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 18:48:13.521171 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 18:48:13.521171 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 18:48:13.521171 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 18:48:13.521171 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 18:48:13.521171 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 18:48:13.521171 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 18:48:13.521171 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 18:48:13.521171 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume bad834ef-84d4-4642-8ea3-f2ee9d736da4 could not be found. Oct 04 18:48:13.521171 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:48:13.521171 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:48:13.521171 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:48:13.521171 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:48:13.521171 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:48:13.521171 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:48:13.521171 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:48:13.521171 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:48:13.521171 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:48:13.521171 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:48:13.521171 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:48:13.521171 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:48:13.521171 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 04 18:48:13.521171 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:48:13.521171 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume bad834ef-84d4-4642-8ea3-f2ee9d736da4 could not be found. Oct 04 18:48:13.521171 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:48:13.521171 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:48:13.521171 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:48:13.521171 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:48:13.521171 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:48:13.521171 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:48:13.521171 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:48:13.521171 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:48:13.521171 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume bad834ef-84d4-4642-8ea3-f2ee9d736da4 could not be found. Oct 04 18:48:13.521171 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:48:13.521171 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-addf8d7a-fbf4-4969-896d-c207a048bc6b tempest-VolumesSnapshotsTestJSON-845312753 tempest-VolumesSnapshotsTestJSON-845312753-project] Returning 404 to user: Volume bad834ef-84d4-4642-8ea3-f2ee9d736da4 could not be found. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:48:13.521171 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-addf8d7a-fbf4-4969-896d-c207a048bc6b tempest-VolumesSnapshotsTestJSON-845312753 tempest-VolumesSnapshotsTestJSON-845312753-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/bad834ef-84d4-4642-8ea3-f2ee9d736da4" status: 404 len: 109 microversion: 2.1 time: 0.076777 Oct 04 18:48:13.521171 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1872/3985] 10.222.0.43 () {58 vars in 1245 bytes} [Tue Oct 4 18:48:13 2022] GET /compute/v2.1/os-volumes/bad834ef-84d4-4642-8ea3-f2ee9d736da4 => generated 109 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:48:13.526895 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-fbf6807d-57d9-4125-ae06-c83cf6b3f4de tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:13.527001 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-fbf6807d-57d9-4125-ae06-c83cf6b3f4de tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 82b86465-afb0-49ef-9932-1538010c1ae5] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:13.554165 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fbf6807d-57d9-4125-ae06-c83cf6b3f4de tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:13.554708 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fbf6807d-57d9-4125-ae06-c83cf6b3f4de tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:13.555170 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fbf6807d-57d9-4125-ae06-c83cf6b3f4de tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:13.562067 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fbf6807d-57d9-4125-ae06-c83cf6b3f4de tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:13.569373 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fbf6807d-57d9-4125-ae06-c83cf6b3f4de tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:13.570220 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fbf6807d-57d9-4125-ae06-c83cf6b3f4de tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:13.773341 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-c9a04c4d-ba4f-41f3-ae1a-e7392351ec45 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:13.791544 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-c9a04c4d-ba4f-41f3-ae1a-e7392351ec45 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:13.794445 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-c9a04c4d-ba4f-41f3-ae1a-e7392351ec45 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:13.797253 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-c9a04c4d-ba4f-41f3-ae1a-e7392351ec45 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] 10.222.0.43 "GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715" status: 200 len: 2945 microversion: 2.32 time: 0.829324 Oct 04 18:48:13.802018 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2114/3986] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:48:12 2022] GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715 => generated 2945 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:48:13.818275 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-ac48302e-4b47-4dd1-92cc-6369d97a44fb tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:13.819355 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-ac48302e-4b47-4dd1-92cc-6369d97a44fb tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] [instance: 76d475ab-f41c-44df-8aaa-10242bdbfcde] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:13.847666 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ac48302e-4b47-4dd1-92cc-6369d97a44fb tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:13.849925 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ac48302e-4b47-4dd1-92cc-6369d97a44fb tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:13.852227 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ac48302e-4b47-4dd1-92cc-6369d97a44fb tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:13.853428 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ac48302e-4b47-4dd1-92cc-6369d97a44fb tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:13.854233 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ac48302e-4b47-4dd1-92cc-6369d97a44fb tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:13.857555 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ac48302e-4b47-4dd1-92cc-6369d97a44fb tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:14.991154 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-ac48302e-4b47-4dd1-92cc-6369d97a44fb tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a116f2d9656548458264cc4fb1934c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff3c3dc76405401baf72fe00c5d50b56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:15.002546 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-ac48302e-4b47-4dd1-92cc-6369d97a44fb tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] 10.222.0.43 "GET /compute/v2.1/servers/76d475ab-f41c-44df-8aaa-10242bdbfcde" status: 200 len: 1668 microversion: 2.1 time: 1.198757 Oct 04 18:48:15.005426 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2115/3987] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:13 2022] GET /compute/v2.1/servers/76d475ab-f41c-44df-8aaa-10242bdbfcde => generated 1668 bytes in 1203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:15.021633 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-2759aa7f-99b2-4a37-9723-8cc780a70144 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:15.022535 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-2759aa7f-99b2-4a37-9723-8cc780a70144 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] [instance: fa47906d-d394-46fe-9143-780bcd27a715] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:15.035174 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2759aa7f-99b2-4a37-9723-8cc780a70144 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:15.036087 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2759aa7f-99b2-4a37-9723-8cc780a70144 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:15.036800 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2759aa7f-99b2-4a37-9723-8cc780a70144 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:15.037843 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2759aa7f-99b2-4a37-9723-8cc780a70144 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:15.039128 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2759aa7f-99b2-4a37-9723-8cc780a70144 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:15.042914 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2759aa7f-99b2-4a37-9723-8cc780a70144 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:15.158056 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-fbf6807d-57d9-4125-ae06-c83cf6b3f4de tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:15.170876 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-fbf6807d-57d9-4125-ae06-c83cf6b3f4de tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5" status: 200 len: 1667 microversion: 2.1 time: 1.652530 Oct 04 18:48:15.185201 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1873/3988] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:13 2022] GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5 => generated 1667 bytes in 1661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:15.185201 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-db9eec6a-2df1-4d46-b514-b8a4816d7b90 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:15.185201 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-db9eec6a-2df1-4d46-b514-b8a4816d7b90 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] [instance: 6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:15.208535 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-db9eec6a-2df1-4d46-b514-b8a4816d7b90 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:15.210212 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-db9eec6a-2df1-4d46-b514-b8a4816d7b90 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:15.210838 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-db9eec6a-2df1-4d46-b514-b8a4816d7b90 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:15.212397 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-db9eec6a-2df1-4d46-b514-b8a4816d7b90 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:15.217254 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-db9eec6a-2df1-4d46-b514-b8a4816d7b90 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:15.217944 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-db9eec6a-2df1-4d46-b514-b8a4816d7b90 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:15.324054 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-db9eec6a-2df1-4d46-b514-b8a4816d7b90 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:15.324894 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-db9eec6a-2df1-4d46-b514-b8a4816d7b90 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:15.325606 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-db9eec6a-2df1-4d46-b514-b8a4816d7b90 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:15.326416 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.objects.instance [None req-db9eec6a-2df1-4d46-b514-b8a4816d7b90 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lazy-loading 'fault' on Instance uuid 6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75 {{(pid=123595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:48:15.500242 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-2759aa7f-99b2-4a37-9723-8cc780a70144 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] 10.222.0.43 "GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715/os-interface" status: 200 len: 1832 microversion: 2.32 time: 0.493159 Oct 04 18:48:15.501173 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2116/3989] 10.222.0.43 () {60 vars in 1316 bytes} [Tue Oct 4 18:48:15 2022] GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715/os-interface => generated 1832 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:48:15.517199 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-20a31b14-39f8-4988-82f1-f53ce6083a0b req-51c27f26-d74e-48bd-8e5e-94dc3d2a98f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75", "name": "network-vif-deleted", "tag": "3b617c59-561d-4917-87cb-5c5ab7f63852"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:48:15.532077 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-db9eec6a-2df1-4d46-b514-b8a4816d7b90 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9971b5861f44c1a1da94eda0f8f02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f809b8ae704988961908bef0f3cb24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:15.542562 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-db9eec6a-2df1-4d46-b514-b8a4816d7b90 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] 10.222.0.43 "GET /compute/v2.1/servers/6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75" status: 200 len: 1325 microversion: 2.1 time: 0.361761 Oct 04 18:48:15.546918 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1874/3990] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:15 2022] GET /compute/v2.1/servers/6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75 => generated 1325 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:15.548596 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-20a31b14-39f8-4988-82f1-f53ce6083a0b req-51c27f26-d74e-48bd-8e5e-94dc3d2a98f5 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:15.549341 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-20a31b14-39f8-4988-82f1-f53ce6083a0b req-51c27f26-d74e-48bd-8e5e-94dc3d2a98f5 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:15.549988 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-20a31b14-39f8-4988-82f1-f53ce6083a0b req-51c27f26-d74e-48bd-8e5e-94dc3d2a98f5 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:15.558379 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-73151c00-c34c-4dc5-b9dd-4a65ec74e86d tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-194781565", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452", "networks": [{"uuid": "4c7a4f44-d147-4a8b-8217-07c763ce3b07"}]}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:48:15.609905 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-20a31b14-39f8-4988-82f1-f53ce6083a0b req-51c27f26-d74e-48bd-8e5e-94dc3d2a98f5 service nova] Creating event network-vif-deleted:3b617c59-561d-4917-87cb-5c5ab7f63852 for instance 6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75 on n-h2-851028-13 Oct 04 18:48:15.631529 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-20a31b14-39f8-4988-82f1-f53ce6083a0b req-51c27f26-d74e-48bd-8e5e-94dc3d2a98f5 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127317 Oct 04 18:48:15.636478 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2117/3991] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:48:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:48:15.680166 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.network.neutron [None req-73151c00-c34c-4dc5-b9dd-4a65ec74e86d tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] validate_networks() for [('4c7a4f44-d147-4a8b-8217-07c763ce3b07', None, None, None, None, None)] {{(pid=123595) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:48:16.588280 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-2d601dda-c8cc-4897-b4ae-20884b37afaf tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:16.593979 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-2d601dda-c8cc-4897-b4ae-20884b37afaf tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] [instance: 6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:16.632441 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2d601dda-c8cc-4897-b4ae-20884b37afaf tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:16.633588 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2d601dda-c8cc-4897-b4ae-20884b37afaf tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:16.635198 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2d601dda-c8cc-4897-b4ae-20884b37afaf tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:16.637701 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2d601dda-c8cc-4897-b4ae-20884b37afaf tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:16.645249 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2d601dda-c8cc-4897-b4ae-20884b37afaf tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:16.646064 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2d601dda-c8cc-4897-b4ae-20884b37afaf tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:16.701102 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-2d601dda-c8cc-4897-b4ae-20884b37afaf tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] HTTP exception thrown: Instance 6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75 could not be found. Oct 04 18:48:16.703405 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-2d601dda-c8cc-4897-b4ae-20884b37afaf tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Request method failure captured: Oct 04 18:48:16.703405 n-d-851028-13 devstack@n-api.service[123596]: request: GET /compute/v2.1/servers/6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75 HTTP/1.1 Oct 04 18:48:16.703405 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:48:16.703405 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:48:16.703405 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:48:16.703405 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 18:48:16.703405 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:48:16.703405 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:48:16.703405 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:48:16.703405 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:48:16.703405 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPH5WfiuuzvwLfBUktf-ZCMkbBHVtZTa3UzIp4tiFNMgYxAob0smTpNakOq8JPayK-7uipsiwFbsX12cMEYFvHfKqEuVOWJOlGyZWc2uOBdTkom4-ol0MxoEGaK70M4Ortl7zkMQzxJe2OsoPDoarCsZKa2IfgHk_8qe1PRnEJpqoAEM Oct 04 18:48:16.703405 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:48:16.703405 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:48:16.703405 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:48:16.703405 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:48:16.703405 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:48:16.703405 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:48:16.703405 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: a9f809b8ae704988961908bef0f3cb24 Oct 04 18:48:16.703405 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-LiveMigrationTest-54439387 Oct 04 18:48:16.703405 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 18:48:16.703405 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 18:48:16.703405 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/a9f809b8ae704988961908bef0f3cb24"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_a9f809b8ae704988961908bef0f3cb24"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a9f809b8ae704988961908bef0f3cb24"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a9f809b8ae704988961908bef0f3cb24"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:48:16.703405 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-LiveMigrationTest-54439387 Oct 04 18:48:16.703405 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: a9f809b8ae704988961908bef0f3cb24 Oct 04 18:48:16.703405 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-LiveMigrationTest-54439387 Oct 04 18:48:16.703405 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-LiveMigrationTest-54439387-project Oct 04 18:48:16.703405 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:48:16.703405 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:48:16.703405 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: ae9971b5861f44c1a1da94eda0f8f02d Oct 04 18:48:16.703405 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-LiveMigrationTest-54439387-project Oct 04 18:48:16.703405 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 18:48:16.703405 n-d-851028-13 devstack@n-api.service[123596]: exception: Instance 6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75 could not be found. Oct 04 18:48:16.703405 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': '6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75'} Oct 04 18:48:16.703405 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:48:16.703405 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:48:16.703405 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:48:16.703405 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:48:16.703405 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:48:16.703405 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:48:16.703405 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:48:16.703405 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:48:16.703405 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:48:16.703405 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:48:16.703405 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75 could not be found. Oct 04 18:48:16.703405 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:48:16.703405 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:48:16.703405 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:48:16.703405 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:48:16.703405 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:48:16.703405 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:48:16.703405 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:48:16.703405 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:48:16.703405 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:48:16.703405 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:48:16.703405 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:48:16.703405 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:48:16.703405 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:48:16.703405 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:48:16.703405 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:48:16.703405 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:48:16.703405 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75 could not be found. Oct 04 18:48:16.703405 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:48:16.703405 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:48:16.703405 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:48:16.707959 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:48:16.707959 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:48:16.707959 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:48:16.707959 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:48:16.707959 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:48:16.707959 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75 could not be found. Oct 04 18:48:16.707959 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:48:16.712501 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-2d601dda-c8cc-4897-b4ae-20884b37afaf tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Returning 404 to user: Instance 6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75 could not be found. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:48:16.714621 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-2d601dda-c8cc-4897-b4ae-20884b37afaf tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] 10.222.0.43 "GET /compute/v2.1/servers/6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75" status: 404 len: 111 microversion: 2.1 time: 0.138720 Oct 04 18:48:16.715165 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2118/3992] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:16 2022] GET /compute/v2.1/servers/6927b9b0-aa06-4d29-bb22-8ea3a4ca6f75 => generated 111 bytes in 146 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:48:16.735848 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-c0d908bf-9c41-479a-bc24-395e8fee2c33 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Calling method '.version_select at 0x7fb21ed4c430>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:16.785015 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-c0d908bf-9c41-479a-bc24-395e8fee2c33 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1772492792" status: 202 len: 0 microversion: 2.1 time: 0.063551 Oct 04 18:48:16.787389 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2119/3993] 10.222.0.43 () {58 vars in 1221 bytes} [Tue Oct 4 18:48:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1772492792 => generated 0 bytes in 68 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:48:17.137650 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-73151c00-c34c-4dc5-b9dd-4a65ec74e86d tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Flavor limits 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:48:17.138178 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-73151c00-c34c-4dc5-b9dd-4a65ec74e86d tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Image limits 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:48:17.139003 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-73151c00-c34c-4dc5-b9dd-4a65ec74e86d tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Flavor pref 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:48:17.139589 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-73151c00-c34c-4dc5-b9dd-4a65ec74e86d tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Image pref 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:48:17.140267 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-73151c00-c34c-4dc5-b9dd-4a65ec74e86d tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:48:17.151252 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-73151c00-c34c-4dc5-b9dd-4a65ec74e86d tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:17.151826 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-73151c00-c34c-4dc5-b9dd-4a65ec74e86d tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:17.152279 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-73151c00-c34c-4dc5-b9dd-4a65ec74e86d tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:17.153122 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-73151c00-c34c-4dc5-b9dd-4a65ec74e86d tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:17.153592 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-73151c00-c34c-4dc5-b9dd-4a65ec74e86d tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:17.154024 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-73151c00-c34c-4dc5-b9dd-4a65ec74e86d tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:17.179973 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-73151c00-c34c-4dc5-b9dd-4a65ec74e86d tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Getting quotas for project b928ae7385da4599bbe0ea701681b233. Resources: {'ram', 'cores', 'instances'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:48:17.191425 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-73151c00-c34c-4dc5-b9dd-4a65ec74e86d tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Getting quotas for user 93c36c0802f4473f96d0721caa50374a and project b928ae7385da4599bbe0ea701681b233. Resources: {'ram', 'cores', 'instances'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:48:17.208997 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-73151c00-c34c-4dc5-b9dd-4a65ec74e86d tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Going to run 1 instances... {{(pid=123595) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:48:17.213180 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-73151c00-c34c-4dc5-b9dd-4a65ec74e86d tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 4339f9b7-28e4-4ea7-9e0f-bd44a8365166] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e8943ec5-4038-4d4b-b9b9-2415a79f5243',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:48:17.277795 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-73151c00-c34c-4dc5-b9dd-4a65ec74e86d tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.728837 Oct 04 18:48:17.285675 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1875/3994] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 18:48:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 1731 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:48:17.290453 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-a33480e1-e90b-45d5-a4ac-b7100131bac8 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:17.291068 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-a33480e1-e90b-45d5-a4ac-b7100131bac8 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 4339f9b7-28e4-4ea7-9e0f-bd44a8365166] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:17.387697 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-a33480e1-e90b-45d5-a4ac-b7100131bac8 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:17.395735 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-a33480e1-e90b-45d5-a4ac-b7100131bac8 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/4339f9b7-28e4-4ea7-9e0f-bd44a8365166" status: 200 len: 1214 microversion: 2.1 time: 0.109297 Oct 04 18:48:17.398435 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2120/3995] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:17 2022] GET /compute/v2.1/servers/4339f9b7-28e4-4ea7-9e0f-bd44a8365166 => generated 1214 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:18.424993 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-bbe2d485-6f4b-4edb-afb3-316e01c70d05 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:18.425775 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-bbe2d485-6f4b-4edb-afb3-316e01c70d05 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 4339f9b7-28e4-4ea7-9e0f-bd44a8365166] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:18.453854 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bbe2d485-6f4b-4edb-afb3-316e01c70d05 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:18.455773 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bbe2d485-6f4b-4edb-afb3-316e01c70d05 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:18.456710 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bbe2d485-6f4b-4edb-afb3-316e01c70d05 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:18.457982 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bbe2d485-6f4b-4edb-afb3-316e01c70d05 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:18.459987 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bbe2d485-6f4b-4edb-afb3-316e01c70d05 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:18.463622 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bbe2d485-6f4b-4edb-afb3-316e01c70d05 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:18.764077 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-bbe2d485-6f4b-4edb-afb3-316e01c70d05 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:18.773018 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-bbe2d485-6f4b-4edb-afb3-316e01c70d05 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/4339f9b7-28e4-4ea7-9e0f-bd44a8365166" status: 200 len: 1210 microversion: 2.1 time: 0.353325 Oct 04 18:48:18.782674 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1876/3996] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:18 2022] GET /compute/v2.1/servers/4339f9b7-28e4-4ea7-9e0f-bd44a8365166 => generated 1210 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:19.813746 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-cf21f886-871d-4070-a308-88e587312198 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:19.814493 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-cf21f886-871d-4070-a308-88e587312198 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 4339f9b7-28e4-4ea7-9e0f-bd44a8365166] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:19.835545 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cf21f886-871d-4070-a308-88e587312198 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:19.836111 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cf21f886-871d-4070-a308-88e587312198 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:19.836562 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cf21f886-871d-4070-a308-88e587312198 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:19.837415 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cf21f886-871d-4070-a308-88e587312198 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:19.837947 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cf21f886-871d-4070-a308-88e587312198 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:19.838380 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cf21f886-871d-4070-a308-88e587312198 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:20.031733 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-cf21f886-871d-4070-a308-88e587312198 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:20.040854 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-cf21f886-871d-4070-a308-88e587312198 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/4339f9b7-28e4-4ea7-9e0f-bd44a8365166" status: 200 len: 1272 microversion: 2.1 time: 0.231565 Oct 04 18:48:20.044767 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2121/3997] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:19 2022] GET /compute/v2.1/servers/4339f9b7-28e4-4ea7-9e0f-bd44a8365166 => generated 1272 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:20.437729 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-c70240eb-9b92-4a0f-a590-d3e3e611fd93 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:20.439398 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-c70240eb-9b92-4a0f-a590-d3e3e611fd93 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] [instance: 2d229458-6857-4662-ad59-30770808e2a1] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:20.454843 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c70240eb-9b92-4a0f-a590-d3e3e611fd93 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:20.455628 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c70240eb-9b92-4a0f-a590-d3e3e611fd93 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:20.456804 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c70240eb-9b92-4a0f-a590-d3e3e611fd93 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:20.457857 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c70240eb-9b92-4a0f-a590-d3e3e611fd93 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:20.459956 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c70240eb-9b92-4a0f-a590-d3e3e611fd93 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:20.462231 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c70240eb-9b92-4a0f-a590-d3e3e611fd93 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:20.534670 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-c70240eb-9b92-4a0f-a590-d3e3e611fd93 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] [instance: 2d229458-6857-4662-ad59-30770808e2a1] Going to try to terminate instance {{(pid=123595) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:48:20.680787 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-c70240eb-9b92-4a0f-a590-d3e3e611fd93 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] 10.222.0.43 "DELETE /compute/v2.1/servers/2d229458-6857-4662-ad59-30770808e2a1" status: 204 len: 0 microversion: 2.1 time: 0.249125 Oct 04 18:48:20.682910 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1877/3998] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 18:48:20 2022] DELETE /compute/v2.1/servers/2d229458-6857-4662-ad59-30770808e2a1 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:48:20.693960 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-5c90231f-3ad5-4648-9c1e-b3bf822eee98 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:20.696577 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-5c90231f-3ad5-4648-9c1e-b3bf822eee98 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] [instance: 2d229458-6857-4662-ad59-30770808e2a1] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:20.704203 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5c90231f-3ad5-4648-9c1e-b3bf822eee98 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:20.705044 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5c90231f-3ad5-4648-9c1e-b3bf822eee98 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:20.705772 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5c90231f-3ad5-4648-9c1e-b3bf822eee98 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:20.707057 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5c90231f-3ad5-4648-9c1e-b3bf822eee98 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:20.707842 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5c90231f-3ad5-4648-9c1e-b3bf822eee98 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:20.708766 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5c90231f-3ad5-4648-9c1e-b3bf822eee98 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:21.072847 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-c9f5b829-e62c-48f2-936c-c238133c1f23 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:21.073775 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-c9f5b829-e62c-48f2-936c-c238133c1f23 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 4339f9b7-28e4-4ea7-9e0f-bd44a8365166] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:21.094158 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c9f5b829-e62c-48f2-936c-c238133c1f23 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:21.094662 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c9f5b829-e62c-48f2-936c-c238133c1f23 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:21.095104 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c9f5b829-e62c-48f2-936c-c238133c1f23 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:21.095819 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c9f5b829-e62c-48f2-936c-c238133c1f23 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:21.105542 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c9f5b829-e62c-48f2-936c-c238133c1f23 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:21.107329 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c9f5b829-e62c-48f2-936c-c238133c1f23 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:21.262080 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-c9f5b829-e62c-48f2-936c-c238133c1f23 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:21.273170 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-c9f5b829-e62c-48f2-936c-c238133c1f23 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/4339f9b7-28e4-4ea7-9e0f-bd44a8365166" status: 200 len: 1272 microversion: 2.1 time: 0.206068 Oct 04 18:48:21.275064 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1878/3999] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:21 2022] GET /compute/v2.1/servers/4339f9b7-28e4-4ea7-9e0f-bd44a8365166 => generated 1272 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:21.441316 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-5c90231f-3ad5-4648-9c1e-b3bf822eee98 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9971b5861f44c1a1da94eda0f8f02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f809b8ae704988961908bef0f3cb24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:21.475770 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-5c90231f-3ad5-4648-9c1e-b3bf822eee98 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] 10.222.0.43 "GET /compute/v2.1/servers/2d229458-6857-4662-ad59-30770808e2a1" status: 200 len: 1484 microversion: 2.1 time: 0.785702 Oct 04 18:48:21.496950 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2122/4000] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:20 2022] GET /compute/v2.1/servers/2d229458-6857-4662-ad59-30770808e2a1 => generated 1484 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:22.298728 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-466656ee-63d3-4978-9521-6fefd9405f49 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:22.299575 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-466656ee-63d3-4978-9521-6fefd9405f49 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 4339f9b7-28e4-4ea7-9e0f-bd44a8365166] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:22.322163 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-466656ee-63d3-4978-9521-6fefd9405f49 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:22.326417 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-466656ee-63d3-4978-9521-6fefd9405f49 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:22.327256 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-466656ee-63d3-4978-9521-6fefd9405f49 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:22.328176 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-466656ee-63d3-4978-9521-6fefd9405f49 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:22.328819 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-466656ee-63d3-4978-9521-6fefd9405f49 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:22.329476 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-466656ee-63d3-4978-9521-6fefd9405f49 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:22.503918 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-981bf9d7-1945-4250-b524-f49d66f7c858 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:22.504753 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-981bf9d7-1945-4250-b524-f49d66f7c858 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] [instance: 2d229458-6857-4662-ad59-30770808e2a1] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:22.519492 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-981bf9d7-1945-4250-b524-f49d66f7c858 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:22.521734 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-981bf9d7-1945-4250-b524-f49d66f7c858 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:22.522415 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-981bf9d7-1945-4250-b524-f49d66f7c858 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:22.523352 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-981bf9d7-1945-4250-b524-f49d66f7c858 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:22.525581 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-981bf9d7-1945-4250-b524-f49d66f7c858 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:22.526236 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-981bf9d7-1945-4250-b524-f49d66f7c858 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:22.707758 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-981bf9d7-1945-4250-b524-f49d66f7c858 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9971b5861f44c1a1da94eda0f8f02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f809b8ae704988961908bef0f3cb24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:22.723925 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-981bf9d7-1945-4250-b524-f49d66f7c858 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] 10.222.0.43 "GET /compute/v2.1/servers/2d229458-6857-4662-ad59-30770808e2a1" status: 200 len: 1442 microversion: 2.1 time: 0.224633 Oct 04 18:48:22.727581 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2123/4001] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:22 2022] GET /compute/v2.1/servers/2d229458-6857-4662-ad59-30770808e2a1 => generated 1442 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:48:22.913760 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-0b8d63e1-f9e1-4dfa-aafa-3ffa32ba366d req-675e428b-37de-4f9d-8ce0-c82bcb8d0065 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d229458-6857-4662-ad59-30770808e2a1", "name": "network-vif-deleted", "tag": "84b873b9-38f0-4a0b-975a-a315fbcad8ab"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:48:22.943690 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-0b8d63e1-f9e1-4dfa-aafa-3ffa32ba366d req-675e428b-37de-4f9d-8ce0-c82bcb8d0065 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:22.949676 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-0b8d63e1-f9e1-4dfa-aafa-3ffa32ba366d req-675e428b-37de-4f9d-8ce0-c82bcb8d0065 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:22.950598 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-0b8d63e1-f9e1-4dfa-aafa-3ffa32ba366d req-675e428b-37de-4f9d-8ce0-c82bcb8d0065 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:22.973155 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-0b8d63e1-f9e1-4dfa-aafa-3ffa32ba366d req-675e428b-37de-4f9d-8ce0-c82bcb8d0065 service nova] Creating event network-vif-deleted:84b873b9-38f0-4a0b-975a-a315fbcad8ab for instance 2d229458-6857-4662-ad59-30770808e2a1 on n-h2-851028-13 Oct 04 18:48:22.982481 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-0b8d63e1-f9e1-4dfa-aafa-3ffa32ba366d req-675e428b-37de-4f9d-8ce0-c82bcb8d0065 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074292 Oct 04 18:48:22.984992 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2124/4002] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:48:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:48:23.020638 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-466656ee-63d3-4978-9521-6fefd9405f49 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:23.027703 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:48:23.042181 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-466656ee-63d3-4978-9521-6fefd9405f49 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/4339f9b7-28e4-4ea7-9e0f-bd44a8365166" status: 200 len: 1314 microversion: 2.1 time: 0.746912 Oct 04 18:48:23.043288 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1879/4003] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:22 2022] GET /compute/v2.1/servers/4339f9b7-28e4-4ea7-9e0f-bd44a8365166 => generated 1314 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:23.753311 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-3998b200-31c2-4e37-ab72-3846e9c8ac37 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:23.754347 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-3998b200-31c2-4e37-ab72-3846e9c8ac37 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] [instance: 2d229458-6857-4662-ad59-30770808e2a1] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:23.762752 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3998b200-31c2-4e37-ab72-3846e9c8ac37 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:23.764663 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3998b200-31c2-4e37-ab72-3846e9c8ac37 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:23.765586 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3998b200-31c2-4e37-ab72-3846e9c8ac37 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:23.766996 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3998b200-31c2-4e37-ab72-3846e9c8ac37 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:23.767828 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3998b200-31c2-4e37-ab72-3846e9c8ac37 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:23.768810 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3998b200-31c2-4e37-ab72-3846e9c8ac37 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:23.814498 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-3998b200-31c2-4e37-ab72-3846e9c8ac37 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] HTTP exception thrown: Instance 2d229458-6857-4662-ad59-30770808e2a1 could not be found. Oct 04 18:48:23.832024 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-3998b200-31c2-4e37-ab72-3846e9c8ac37 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Request method failure captured: Oct 04 18:48:23.832024 n-d-851028-13 devstack@n-api.service[123596]: request: GET /compute/v2.1/servers/2d229458-6857-4662-ad59-30770808e2a1 HTTP/1.1 Oct 04 18:48:23.832024 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:48:23.832024 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:48:23.832024 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:48:23.832024 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 18:48:23.832024 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:48:23.832024 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:48:23.832024 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:48:23.832024 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:48:23.832024 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPH5WfiuuzvwLfBUktf-ZCMkbBHVtZTa3UzIp4tiFNMgYxAob0smTpNakOq8JPayK-7uipsiwFbsX12cMEYFvHfKqEuVOWJOlGyZWc2uOBdTkom4-ol0MxoEGaK70M4Ortl7zkMQzxJe2OsoPDoarCsZKa2IfgHk_8qe1PRnEJpqoAEM Oct 04 18:48:23.832024 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:48:23.832024 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:48:23.832024 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:48:23.832024 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:48:23.832024 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:48:23.832024 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:48:23.832024 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: a9f809b8ae704988961908bef0f3cb24 Oct 04 18:48:23.832024 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-LiveMigrationTest-54439387 Oct 04 18:48:23.832024 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 18:48:23.832024 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 18:48:23.832024 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/a9f809b8ae704988961908bef0f3cb24"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_a9f809b8ae704988961908bef0f3cb24"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a9f809b8ae704988961908bef0f3cb24"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a9f809b8ae704988961908bef0f3cb24"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:48:23.832024 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-LiveMigrationTest-54439387 Oct 04 18:48:23.832024 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: a9f809b8ae704988961908bef0f3cb24 Oct 04 18:48:23.832024 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-LiveMigrationTest-54439387 Oct 04 18:48:23.832024 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-LiveMigrationTest-54439387-project Oct 04 18:48:23.832024 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:48:23.832024 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:48:23.832024 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: ae9971b5861f44c1a1da94eda0f8f02d Oct 04 18:48:23.832024 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-LiveMigrationTest-54439387-project Oct 04 18:48:23.832024 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 18:48:23.832024 n-d-851028-13 devstack@n-api.service[123596]: exception: Instance 2d229458-6857-4662-ad59-30770808e2a1 could not be found. Oct 04 18:48:23.832024 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': '2d229458-6857-4662-ad59-30770808e2a1'} Oct 04 18:48:23.832024 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:48:23.832024 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:48:23.832024 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:48:23.832024 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:48:23.832024 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:48:23.832024 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:48:23.832024 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:48:23.832024 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:48:23.832024 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:48:23.832024 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:48:23.832024 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d229458-6857-4662-ad59-30770808e2a1 could not be found. Oct 04 18:48:23.832024 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:48:23.832024 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:48:23.832024 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:48:23.832024 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:48:23.832024 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:48:23.832024 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:48:23.832024 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:48:23.832024 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:48:23.832024 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:48:23.832024 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:48:23.832024 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:48:23.832024 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:48:23.832024 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:48:23.832024 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:48:23.832024 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:48:23.832024 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:48:23.832024 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d229458-6857-4662-ad59-30770808e2a1 could not be found. Oct 04 18:48:23.832024 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:48:23.832024 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:48:23.832024 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:48:23.838302 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:48:23.838302 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:48:23.838302 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:48:23.838302 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:48:23.838302 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:48:23.838302 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d229458-6857-4662-ad59-30770808e2a1 could not be found. Oct 04 18:48:23.838302 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:48:23.840026 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-3998b200-31c2-4e37-ab72-3846e9c8ac37 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Returning 404 to user: Instance 2d229458-6857-4662-ad59-30770808e2a1 could not be found. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:48:23.841154 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-3998b200-31c2-4e37-ab72-3846e9c8ac37 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] 10.222.0.43 "GET /compute/v2.1/servers/2d229458-6857-4662-ad59-30770808e2a1" status: 404 len: 111 microversion: 2.1 time: 0.095307 Oct 04 18:48:23.844550 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2125/4004] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:23 2022] GET /compute/v2.1/servers/2d229458-6857-4662-ad59-30770808e2a1 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:48:23.852474 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-1c624be5-bd5d-40e8-9f3c-8f09d9150140 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:23.853816 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-1c624be5-bd5d-40e8-9f3c-8f09d9150140 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] [instance: 3d03e642-62aa-4ed5-8427-a10c4bd9698e] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:23.868388 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1c624be5-bd5d-40e8-9f3c-8f09d9150140 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:23.869024 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1c624be5-bd5d-40e8-9f3c-8f09d9150140 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:23.869645 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1c624be5-bd5d-40e8-9f3c-8f09d9150140 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:23.870654 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1c624be5-bd5d-40e8-9f3c-8f09d9150140 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:23.871318 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1c624be5-bd5d-40e8-9f3c-8f09d9150140 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:23.871764 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1c624be5-bd5d-40e8-9f3c-8f09d9150140 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:23.904427 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-1c624be5-bd5d-40e8-9f3c-8f09d9150140 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] [instance: 3d03e642-62aa-4ed5-8427-a10c4bd9698e] Going to try to terminate instance {{(pid=123595) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:48:24.038843 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-1c624be5-bd5d-40e8-9f3c-8f09d9150140 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] 10.222.0.43 "DELETE /compute/v2.1/servers/3d03e642-62aa-4ed5-8427-a10c4bd9698e" status: 204 len: 0 microversion: 2.1 time: 0.189914 Oct 04 18:48:24.040187 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1880/4005] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 18:48:23 2022] DELETE /compute/v2.1/servers/3d03e642-62aa-4ed5-8427-a10c4bd9698e => generated 0 bytes in 193 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:48:24.053751 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-de9f1f26-3501-47be-b0c2-6722a98ee979 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:24.056440 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-de9f1f26-3501-47be-b0c2-6722a98ee979 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] [instance: 3d03e642-62aa-4ed5-8427-a10c4bd9698e] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:24.064798 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-de9f1f26-3501-47be-b0c2-6722a98ee979 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:24.065631 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-de9f1f26-3501-47be-b0c2-6722a98ee979 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:24.073352 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-4880e1a5-2910-45d4-a4f7-18f878418277 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:24.074561 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-4880e1a5-2910-45d4-a4f7-18f878418277 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 4339f9b7-28e4-4ea7-9e0f-bd44a8365166] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:24.074834 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-de9f1f26-3501-47be-b0c2-6722a98ee979 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:24.078752 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-de9f1f26-3501-47be-b0c2-6722a98ee979 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:24.079618 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-de9f1f26-3501-47be-b0c2-6722a98ee979 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:24.079947 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-de9f1f26-3501-47be-b0c2-6722a98ee979 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:24.088722 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4880e1a5-2910-45d4-a4f7-18f878418277 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:24.090248 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4880e1a5-2910-45d4-a4f7-18f878418277 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:24.090717 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4880e1a5-2910-45d4-a4f7-18f878418277 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:24.091457 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4880e1a5-2910-45d4-a4f7-18f878418277 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:24.096252 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4880e1a5-2910-45d4-a4f7-18f878418277 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:24.096920 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4880e1a5-2910-45d4-a4f7-18f878418277 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:24.470813 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-de9f1f26-3501-47be-b0c2-6722a98ee979 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9971b5861f44c1a1da94eda0f8f02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f809b8ae704988961908bef0f3cb24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:24.485137 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-de9f1f26-3501-47be-b0c2-6722a98ee979 tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] 10.222.0.43 "GET /compute/v2.1/servers/3d03e642-62aa-4ed5-8427-a10c4bd9698e" status: 200 len: 1499 microversion: 2.1 time: 0.439888 Oct 04 18:48:24.486866 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2126/4006] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:24 2022] GET /compute/v2.1/servers/3d03e642-62aa-4ed5-8427-a10c4bd9698e => generated 1499 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:24.753729 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-4880e1a5-2910-45d4-a4f7-18f878418277 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:24.765237 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-4880e1a5-2910-45d4-a4f7-18f878418277 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/4339f9b7-28e4-4ea7-9e0f-bd44a8365166" status: 200 len: 1314 microversion: 2.1 time: 0.697064 Oct 04 18:48:24.774017 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1881/4007] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:24 2022] GET /compute/v2.1/servers/4339f9b7-28e4-4ea7-9e0f-bd44a8365166 => generated 1314 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:48:24.779012 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-87f69d6f-4567-4831-9be5-8666f2866fdf req-977afab3-55a8-4075-9e7e-adbf1b6dd51a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4339f9b7-28e4-4ea7-9e0f-bd44a8365166", "tag": "4ec2a05f-d8b5-433a-8838-922f80ff479a"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:48:24.798501 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-87f69d6f-4567-4831-9be5-8666f2866fdf req-977afab3-55a8-4075-9e7e-adbf1b6dd51a service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:24.798657 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-87f69d6f-4567-4831-9be5-8666f2866fdf req-977afab3-55a8-4075-9e7e-adbf1b6dd51a service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:24.799239 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-87f69d6f-4567-4831-9be5-8666f2866fdf req-977afab3-55a8-4075-9e7e-adbf1b6dd51a service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:24.815200 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-87f69d6f-4567-4831-9be5-8666f2866fdf req-977afab3-55a8-4075-9e7e-adbf1b6dd51a service nova] Creating event network-changed:4ec2a05f-d8b5-433a-8838-922f80ff479a for instance 4339f9b7-28e4-4ea7-9e0f-bd44a8365166 on n-h1-851028-13 Oct 04 18:48:24.823600 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-87f69d6f-4567-4831-9be5-8666f2866fdf req-977afab3-55a8-4075-9e7e-adbf1b6dd51a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048002 Oct 04 18:48:24.824984 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1882/4008] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:48:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:48:24.986242 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-1900e94e-a15c-4520-aff2-64002495f89c tempest-KeyPairsV2TestJSON-770715028 tempest-KeyPairsV2TestJSON-770715028-project] Action: 'create', calling method: .version_select at 0x7fb21e8eb5e0>, body: {"keypair": {"name": "tempest-keypair-1253245194", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPEyPhhxEGn51zggolTpdlofUPNuZmW1xGRJvTcRjTy/9b7pftGtYPMg2erY7JIIFds5PEQKIHZsKk0OmC0SilKb2iT6ZFy33Q43BkD7iLjvrW8wepFyVpW3zpL8GblfkQ=="}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:48:25.023568 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-1900e94e-a15c-4520-aff2-64002495f89c tempest-KeyPairsV2TestJSON-770715028 tempest-KeyPairsV2TestJSON-770715028-project] Getting quotas for project a1a68865c48341c4a5f675f9c63849ff. Resources: {'key_pairs'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:48:25.033433 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-1900e94e-a15c-4520-aff2-64002495f89c tempest-KeyPairsV2TestJSON-770715028 tempest-KeyPairsV2TestJSON-770715028-project] Getting quotas for user 83198ab14c1340879badf687e5136b43 and project a1a68865c48341c4a5f675f9c63849ff. Resources: {'key_pairs'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:48:25.082873 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-1900e94e-a15c-4520-aff2-64002495f89c tempest-KeyPairsV2TestJSON-770715028 tempest-KeyPairsV2TestJSON-770715028-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.592076 Oct 04 18:48:25.083655 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2127/4009] 10.222.0.43 () {60 vars in 1159 bytes} [Tue Oct 4 18:48:24 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:48:25.101424 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-8e18e2eb-1c1c-4cc5-8d1d-511ea8aa9d5a tempest-KeyPairsV2TestJSON-770715028 tempest-KeyPairsV2TestJSON-770715028-project] Calling method '.version_select at 0x7fb21eb20f70>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:25.127737 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-8e18e2eb-1c1c-4cc5-8d1d-511ea8aa9d5a tempest-KeyPairsV2TestJSON-770715028 tempest-KeyPairsV2TestJSON-770715028-project] 10.222.0.43 "GET /compute/v2.1/os-keypairs/tempest-keypair-1253245194" status: 200 len: 498 microversion: 2.1 time: 0.027188 Oct 04 18:48:25.127737 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1883/4010] 10.222.0.43 () {58 vars in 1218 bytes} [Tue Oct 4 18:48:25 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1253245194 => generated 498 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:48:25.134384 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-da1f4ca2-b484-49e1-b6bc-15c7915616fa tempest-KeyPairsV2TestJSON-770715028 tempest-KeyPairsV2TestJSON-770715028-project] Calling method '.version_select at 0x7fb21ee14b80>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:25.171090 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-da1f4ca2-b484-49e1-b6bc-15c7915616fa tempest-KeyPairsV2TestJSON-770715028 tempest-KeyPairsV2TestJSON-770715028-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1253245194" status: 202 len: 0 microversion: 2.1 time: 0.041412 Oct 04 18:48:25.173669 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2128/4011] 10.222.0.43 () {58 vars in 1221 bytes} [Tue Oct 4 18:48:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1253245194 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:48:25.185422 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-aea16004-6326-4f02-97c1-1268578f7c69 tempest-KeyPairsV2TestJSON-770715028 tempest-KeyPairsV2TestJSON-770715028-project] Action: 'create', calling method: .version_select at 0x7fb21eb7b160>, body: {"keypair": {"name": "tempest-keypair-240907652", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIRYGhff/mQkM8PNdBoi85UW56/52PwO9Udxs9dpmGClEPvsQSZpUzRGkLqiL6+Tz9xDd03Alg/4HYfuynVot6epvF/CJvFv7Mql5w18mKmXW/6dEgnmIoSyl9RWbyOEZA=="}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:48:25.224371 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-aea16004-6326-4f02-97c1-1268578f7c69 tempest-KeyPairsV2TestJSON-770715028 tempest-KeyPairsV2TestJSON-770715028-project] Getting quotas for project a1a68865c48341c4a5f675f9c63849ff. Resources: {'key_pairs'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:48:25.232152 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-aea16004-6326-4f02-97c1-1268578f7c69 tempest-KeyPairsV2TestJSON-770715028 tempest-KeyPairsV2TestJSON-770715028-project] Getting quotas for user 83198ab14c1340879badf687e5136b43 and project a1a68865c48341c4a5f675f9c63849ff. Resources: {'key_pairs'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:48:25.285033 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-aea16004-6326-4f02-97c1-1268578f7c69 tempest-KeyPairsV2TestJSON-770715028 tempest-KeyPairsV2TestJSON-770715028-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.105133 Oct 04 18:48:25.286948 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1884/4012] 10.222.0.43 () {60 vars in 1159 bytes} [Tue Oct 4 18:48:25 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:48:25.299017 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-da0aa738-1a66-443c-8e38-5eb14ca68124 tempest-KeyPairsV2TestJSON-770715028 tempest-KeyPairsV2TestJSON-770715028-project] Calling method '.version_select at 0x7fb227df04c0>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:25.331169 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-da0aa738-1a66-443c-8e38-5eb14ca68124 tempest-KeyPairsV2TestJSON-770715028 tempest-KeyPairsV2TestJSON-770715028-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-240907652" status: 202 len: 0 microversion: 2.1 time: 0.036606 Oct 04 18:48:25.333091 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2129/4013] 10.222.0.43 () {58 vars in 1218 bytes} [Tue Oct 4 18:48:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-240907652 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:48:25.342842 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-57015d8f-f092-40e3-a84a-00cc55fdf546 tempest-KeyPairsV2TestJSON-770715028 tempest-KeyPairsV2TestJSON-770715028-project] Action: 'create', calling method: .version_select at 0x7fb21eace790>, body: {"keypair": {"name": "tempest-keypair-1639005948", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:48:25.379017 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-57015d8f-f092-40e3-a84a-00cc55fdf546 tempest-KeyPairsV2TestJSON-770715028 tempest-KeyPairsV2TestJSON-770715028-project] Getting quotas for project a1a68865c48341c4a5f675f9c63849ff. Resources: {'key_pairs'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:48:25.390368 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-57015d8f-f092-40e3-a84a-00cc55fdf546 tempest-KeyPairsV2TestJSON-770715028 tempest-KeyPairsV2TestJSON-770715028-project] Getting quotas for user 83198ab14c1340879badf687e5136b43 and project a1a68865c48341c4a5f675f9c63849ff. Resources: {'key_pairs'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:48:25.433345 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-57015d8f-f092-40e3-a84a-00cc55fdf546 tempest-KeyPairsV2TestJSON-770715028 tempest-KeyPairsV2TestJSON-770715028-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 574 microversion: 2.1 time: 0.094330 Oct 04 18:48:25.434232 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1885/4014] 10.222.0.43 () {60 vars in 1159 bytes} [Tue Oct 4 18:48:25 2022] POST /compute/v2.1/os-keypairs => generated 574 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:48:25.447639 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-bc7e13ec-008e-406c-b406-cf72f668eb44 tempest-KeyPairsV2TestJSON-770715028 tempest-KeyPairsV2TestJSON-770715028-project] Calling method '.version_select at 0x7fb21ec21e50>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:25.478524 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-bc7e13ec-008e-406c-b406-cf72f668eb44 tempest-KeyPairsV2TestJSON-770715028 tempest-KeyPairsV2TestJSON-770715028-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1639005948" status: 202 len: 0 microversion: 2.1 time: 0.035580 Oct 04 18:48:25.498956 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-c1ff75db-62cd-4eb1-b27f-7355076b9591 tempest-KeyPairsV2TestJSON-770715028 tempest-KeyPairsV2TestJSON-770715028-project] Action: 'create', calling method: .version_select at 0x7fb21edf84c0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1406362992", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCPObq/jUSi14RqS73PSw7yT6JCa++GaDqkdnINQn2ND2OM3VLEjLS3VhLUcG1TBKxrUFP86j2wXvOAXZt0ElK1SFxjcIGHRNYTTZgdu0qVfUh/Jv43/IBPUFuvYfntcbg=="}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:48:25.503595 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2130/4015] 10.222.0.43 () {58 vars in 1221 bytes} [Tue Oct 4 18:48:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1639005948 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:48:25.518793 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-99b0191f-f1ff-489b-a683-b9a70d823beb tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:25.524140 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-99b0191f-f1ff-489b-a683-b9a70d823beb tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] [instance: 3d03e642-62aa-4ed5-8427-a10c4bd9698e] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:25.558706 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-c1ff75db-62cd-4eb1-b27f-7355076b9591 tempest-KeyPairsV2TestJSON-770715028 tempest-KeyPairsV2TestJSON-770715028-project] Getting quotas for project a1a68865c48341c4a5f675f9c63849ff. Resources: {'key_pairs'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:48:25.562328 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-99b0191f-f1ff-489b-a683-b9a70d823beb tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:25.563164 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-99b0191f-f1ff-489b-a683-b9a70d823beb tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:25.563883 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-99b0191f-f1ff-489b-a683-b9a70d823beb tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:25.565337 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-99b0191f-f1ff-489b-a683-b9a70d823beb tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:25.566039 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-99b0191f-f1ff-489b-a683-b9a70d823beb tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:25.567736 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-99b0191f-f1ff-489b-a683-b9a70d823beb tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:25.576125 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-c1ff75db-62cd-4eb1-b27f-7355076b9591 tempest-KeyPairsV2TestJSON-770715028 tempest-KeyPairsV2TestJSON-770715028-project] Getting quotas for user 83198ab14c1340879badf687e5136b43 and project a1a68865c48341c4a5f675f9c63849ff. Resources: {'key_pairs'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:48:25.628273 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-c1ff75db-62cd-4eb1-b27f-7355076b9591 tempest-KeyPairsV2TestJSON-770715028 tempest-KeyPairsV2TestJSON-770715028-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.135073 Oct 04 18:48:25.628875 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1886/4016] 10.222.0.43 () {60 vars in 1159 bytes} [Tue Oct 4 18:48:25 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:48:25.641513 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-47ab28b4-00b2-4b9d-8d8a-c08b8c990875 req-fee43596-1e3d-47b4-9590-6d96b835a359 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d03e642-62aa-4ed5-8427-a10c4bd9698e", "name": "network-vif-deleted", "tag": "53dfc1e3-b31a-4aab-8977-3a9c6a1f79ae"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:48:25.653674 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:48:25.672579 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-47ab28b4-00b2-4b9d-8d8a-c08b8c990875 req-fee43596-1e3d-47b4-9590-6d96b835a359 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:25.673383 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-47ab28b4-00b2-4b9d-8d8a-c08b8c990875 req-fee43596-1e3d-47b4-9590-6d96b835a359 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:25.674422 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-47ab28b4-00b2-4b9d-8d8a-c08b8c990875 req-fee43596-1e3d-47b4-9590-6d96b835a359 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:25.687651 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-47ab28b4-00b2-4b9d-8d8a-c08b8c990875 req-fee43596-1e3d-47b4-9590-6d96b835a359 service nova] Creating event network-vif-deleted:53dfc1e3-b31a-4aab-8977-3a9c6a1f79ae for instance 3d03e642-62aa-4ed5-8427-a10c4bd9698e on n-h2-851028-13 Oct 04 18:48:25.691496 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-99b0191f-f1ff-489b-a683-b9a70d823beb tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9971b5861f44c1a1da94eda0f8f02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f809b8ae704988961908bef0f3cb24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:25.694871 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-47ab28b4-00b2-4b9d-8d8a-c08b8c990875 req-fee43596-1e3d-47b4-9590-6d96b835a359 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061833 Oct 04 18:48:25.695768 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1887/4017] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:48:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:48:25.703273 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-3dd6e264-a748-40c2-9c7f-3a8156c48a7d tempest-KeyPairsV2TestJSON-770715028 tempest-KeyPairsV2TestJSON-770715028-project] Action: 'create', calling method: .version_select at 0x7fb21eb095e0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-99238845", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBm9qPMBhj8UTaqAoQDAZMgYB2uDz1y8IscFg1rGPR9MZqhdC1I/c8lG1yy9ZyBSb2KdptqLpsvFtudDixwQ2fOolrs5CerabuhvfKibIqjELavqf5DwAFFF71E6blIchw=="}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:48:25.704514 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-99b0191f-f1ff-489b-a683-b9a70d823beb tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] 10.222.0.43 "GET /compute/v2.1/servers/3d03e642-62aa-4ed5-8427-a10c4bd9698e" status: 200 len: 1296 microversion: 2.1 time: 0.195976 Oct 04 18:48:25.705802 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2131/4018] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:25 2022] GET /compute/v2.1/servers/3d03e642-62aa-4ed5-8427-a10c4bd9698e => generated 1296 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:25.721013 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-3dd6e264-a748-40c2-9c7f-3a8156c48a7d tempest-KeyPairsV2TestJSON-770715028 tempest-KeyPairsV2TestJSON-770715028-project] Getting quotas for project a1a68865c48341c4a5f675f9c63849ff. Resources: {'key_pairs'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:48:25.728092 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-3dd6e264-a748-40c2-9c7f-3a8156c48a7d tempest-KeyPairsV2TestJSON-770715028 tempest-KeyPairsV2TestJSON-770715028-project] Getting quotas for user 83198ab14c1340879badf687e5136b43 and project a1a68865c48341c4a5f675f9c63849ff. Resources: {'key_pairs'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:48:25.775991 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-3dd6e264-a748-40c2-9c7f-3a8156c48a7d tempest-KeyPairsV2TestJSON-770715028 tempest-KeyPairsV2TestJSON-770715028-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.076555 Oct 04 18:48:25.778553 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1888/4019] 10.222.0.43 () {60 vars in 1159 bytes} [Tue Oct 4 18:48:25 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:48:25.791423 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-62fe4b1c-79ec-43a5-8c87-58e17fbb9ac9 tempest-KeyPairsV2TestJSON-770715028 tempest-KeyPairsV2TestJSON-770715028-project] Action: 'create', calling method: .version_select at 0x7fb21e8eb310>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-949996221", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMpAa7QgWZgSUZJgMnMHiPLAX76QOVvyBgLQRPwsnEg8yMwti4BCWzno0w88cezris9ggI4wixKZ+pFXR0mL/9uqk2LtadB8H5lieBBPMgJoQYQhKProydJJTOwiwGx6ng=="}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:48:25.799639 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-1bdea0e9-dbc7-4023-85e9-8f6ce1810d57 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:25.800527 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-1bdea0e9-dbc7-4023-85e9-8f6ce1810d57 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 4339f9b7-28e4-4ea7-9e0f-bd44a8365166] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:25.815014 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1bdea0e9-dbc7-4023-85e9-8f6ce1810d57 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:25.821870 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1bdea0e9-dbc7-4023-85e9-8f6ce1810d57 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:25.825911 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1bdea0e9-dbc7-4023-85e9-8f6ce1810d57 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:25.832133 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1bdea0e9-dbc7-4023-85e9-8f6ce1810d57 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:25.832970 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1bdea0e9-dbc7-4023-85e9-8f6ce1810d57 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:25.833606 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1bdea0e9-dbc7-4023-85e9-8f6ce1810d57 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:25.854252 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-62fe4b1c-79ec-43a5-8c87-58e17fbb9ac9 tempest-KeyPairsV2TestJSON-770715028 tempest-KeyPairsV2TestJSON-770715028-project] Getting quotas for project a1a68865c48341c4a5f675f9c63849ff. Resources: {'key_pairs'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:48:25.870772 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-62fe4b1c-79ec-43a5-8c87-58e17fbb9ac9 tempest-KeyPairsV2TestJSON-770715028 tempest-KeyPairsV2TestJSON-770715028-project] Getting quotas for user 83198ab14c1340879badf687e5136b43 and project a1a68865c48341c4a5f675f9c63849ff. Resources: {'key_pairs'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:48:25.908891 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:DELETE=4,nova_api:INSERT=1 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:48:25.938323 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-62fe4b1c-79ec-43a5-8c87-58e17fbb9ac9 tempest-KeyPairsV2TestJSON-770715028 tempest-KeyPairsV2TestJSON-770715028-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.150745 Oct 04 18:48:25.939920 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2132/4020] 10.222.0.43 () {60 vars in 1159 bytes} [Tue Oct 4 18:48:25 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:48:25.957526 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-d149d887-ec3d-4866-91ae-fdfcc5e96932 tempest-KeyPairsV2TestJSON-770715028 tempest-KeyPairsV2TestJSON-770715028-project] Calling method '.version_select at 0x7fb2246680d0>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:25.969418 n-d-851028-13 devstack@n-api.service[123596]: WARNING oslo_db.sqlalchemy.utils [None req-d149d887-ec3d-4866-91ae-fdfcc5e96932 tempest-KeyPairsV2TestJSON-770715028 tempest-KeyPairsV2TestJSON-770715028-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 04 18:48:25.990050 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-d149d887-ec3d-4866-91ae-fdfcc5e96932 tempest-KeyPairsV2TestJSON-770715028 tempest-KeyPairsV2TestJSON-770715028-project] 10.222.0.43 "GET /compute/v2.1/os-keypairs" status: 200 len: 1091 microversion: 2.1 time: 0.043871 Oct 04 18:48:25.998624 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2133/4021] 10.222.0.43 () {58 vars in 1137 bytes} [Tue Oct 4 18:48:25 2022] GET /compute/v2.1/os-keypairs => generated 1091 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:26.006738 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-bd07eb76-afd7-421a-b63b-62f47a834bc7 tempest-KeyPairsV2TestJSON-770715028 tempest-KeyPairsV2TestJSON-770715028-project] Calling method '.version_select at 0x7fb227e5d550>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:26.042761 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-bd07eb76-afd7-421a-b63b-62f47a834bc7 tempest-KeyPairsV2TestJSON-770715028 tempest-KeyPairsV2TestJSON-770715028-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-949996221" status: 202 len: 0 microversion: 2.1 time: 0.042579 Oct 04 18:48:26.043610 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2134/4022] 10.222.0.43 () {58 vars in 1275 bytes} [Tue Oct 4 18:48:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-949996221 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:48:26.058662 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-9831b4c9-b3ed-4af4-894c-bdac0d844d37 tempest-KeyPairsV2TestJSON-770715028 tempest-KeyPairsV2TestJSON-770715028-project] Calling method '.version_select at 0x7fb21ecfca60>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:26.088290 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-9831b4c9-b3ed-4af4-894c-bdac0d844d37 tempest-KeyPairsV2TestJSON-770715028 tempest-KeyPairsV2TestJSON-770715028-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-99238845" status: 202 len: 0 microversion: 2.1 time: 0.035187 Oct 04 18:48:26.088966 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2135/4023] 10.222.0.43 () {58 vars in 1272 bytes} [Tue Oct 4 18:48:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-99238845 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:48:26.101436 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-71168ef5-562e-460f-a2e0-a6690febf50e tempest-KeyPairsV2TestJSON-770715028 tempest-KeyPairsV2TestJSON-770715028-project] Calling method '.version_select at 0x7fb21f222430>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:26.148134 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-71168ef5-562e-460f-a2e0-a6690febf50e tempest-KeyPairsV2TestJSON-770715028 tempest-KeyPairsV2TestJSON-770715028-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1406362992" status: 202 len: 0 microversion: 2.1 time: 0.050420 Oct 04 18:48:26.149207 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2136/4024] 10.222.0.43 () {58 vars in 1278 bytes} [Tue Oct 4 18:48:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1406362992 => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:48:26.155877 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-1bdea0e9-dbc7-4023-85e9-8f6ce1810d57 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:26.177526 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-1bdea0e9-dbc7-4023-85e9-8f6ce1810d57 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/4339f9b7-28e4-4ea7-9e0f-bd44a8365166" status: 200 len: 1314 microversion: 2.1 time: 0.375227 Oct 04 18:48:26.177526 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1889/4025] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:25 2022] GET /compute/v2.1/servers/4339f9b7-28e4-4ea7-9e0f-bd44a8365166 => generated 1314 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:26.730898 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-38733995-a05a-4f90-a1b2-27c2dcc4a51d tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:26.732376 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-38733995-a05a-4f90-a1b2-27c2dcc4a51d tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] [instance: 3d03e642-62aa-4ed5-8427-a10c4bd9698e] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:26.744581 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-38733995-a05a-4f90-a1b2-27c2dcc4a51d tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:26.745473 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-38733995-a05a-4f90-a1b2-27c2dcc4a51d tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:26.748691 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-38733995-a05a-4f90-a1b2-27c2dcc4a51d tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:26.751562 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-38733995-a05a-4f90-a1b2-27c2dcc4a51d tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:26.752334 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-38733995-a05a-4f90-a1b2-27c2dcc4a51d tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:26.754982 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-38733995-a05a-4f90-a1b2-27c2dcc4a51d tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:26.796365 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-38733995-a05a-4f90-a1b2-27c2dcc4a51d tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] HTTP exception thrown: Instance 3d03e642-62aa-4ed5-8427-a10c4bd9698e could not be found. Oct 04 18:48:26.799987 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-38733995-a05a-4f90-a1b2-27c2dcc4a51d tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Request method failure captured: Oct 04 18:48:26.799987 n-d-851028-13 devstack@n-api.service[123596]: request: GET /compute/v2.1/servers/3d03e642-62aa-4ed5-8427-a10c4bd9698e HTTP/1.1 Oct 04 18:48:26.799987 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:48:26.799987 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:48:26.799987 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:48:26.799987 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 18:48:26.799987 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:48:26.799987 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:48:26.799987 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:48:26.799987 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:48:26.799987 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPH5WfiuuzvwLfBUktf-ZCMkbBHVtZTa3UzIp4tiFNMgYxAob0smTpNakOq8JPayK-7uipsiwFbsX12cMEYFvHfKqEuVOWJOlGyZWc2uOBdTkom4-ol0MxoEGaK70M4Ortl7zkMQzxJe2OsoPDoarCsZKa2IfgHk_8qe1PRnEJpqoAEM Oct 04 18:48:26.799987 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:48:26.799987 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:48:26.799987 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:48:26.799987 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:48:26.799987 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:48:26.799987 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:48:26.799987 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: a9f809b8ae704988961908bef0f3cb24 Oct 04 18:48:26.799987 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-LiveMigrationTest-54439387 Oct 04 18:48:26.799987 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 18:48:26.799987 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 18:48:26.799987 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/a9f809b8ae704988961908bef0f3cb24"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_a9f809b8ae704988961908bef0f3cb24"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a9f809b8ae704988961908bef0f3cb24"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a9f809b8ae704988961908bef0f3cb24"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:48:26.799987 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-LiveMigrationTest-54439387 Oct 04 18:48:26.799987 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: a9f809b8ae704988961908bef0f3cb24 Oct 04 18:48:26.799987 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-LiveMigrationTest-54439387 Oct 04 18:48:26.799987 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-LiveMigrationTest-54439387-project Oct 04 18:48:26.799987 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:48:26.799987 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:48:26.799987 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: ae9971b5861f44c1a1da94eda0f8f02d Oct 04 18:48:26.799987 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-LiveMigrationTest-54439387-project Oct 04 18:48:26.799987 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 18:48:26.799987 n-d-851028-13 devstack@n-api.service[123596]: exception: Instance 3d03e642-62aa-4ed5-8427-a10c4bd9698e could not be found. Oct 04 18:48:26.799987 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': '3d03e642-62aa-4ed5-8427-a10c4bd9698e'} Oct 04 18:48:26.799987 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:48:26.799987 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:48:26.799987 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:48:26.799987 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:48:26.799987 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:48:26.799987 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:48:26.799987 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:48:26.799987 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:48:26.799987 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:48:26.799987 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:48:26.799987 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d03e642-62aa-4ed5-8427-a10c4bd9698e could not be found. Oct 04 18:48:26.799987 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:48:26.799987 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:48:26.799987 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:48:26.799987 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:48:26.799987 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:48:26.799987 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:48:26.799987 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:48:26.799987 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:48:26.799987 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:48:26.799987 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:48:26.799987 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:48:26.799987 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:48:26.799987 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:48:26.799987 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:48:26.799987 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:48:26.799987 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:48:26.799987 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d03e642-62aa-4ed5-8427-a10c4bd9698e could not be found. Oct 04 18:48:26.799987 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:48:26.799987 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:48:26.799987 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:48:26.805495 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:48:26.805495 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:48:26.805495 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:48:26.805495 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:48:26.805495 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:48:26.805495 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d03e642-62aa-4ed5-8427-a10c4bd9698e could not be found. Oct 04 18:48:26.805495 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:48:26.808752 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-38733995-a05a-4f90-a1b2-27c2dcc4a51d tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] Returning 404 to user: Instance 3d03e642-62aa-4ed5-8427-a10c4bd9698e could not be found. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:48:26.810218 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-38733995-a05a-4f90-a1b2-27c2dcc4a51d tempest-LiveMigrationTest-54439387 tempest-LiveMigrationTest-54439387-project] 10.222.0.43 "GET /compute/v2.1/servers/3d03e642-62aa-4ed5-8427-a10c4bd9698e" status: 404 len: 111 microversion: 2.1 time: 0.085035 Oct 04 18:48:26.813517 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2137/4026] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:26 2022] GET /compute/v2.1/servers/3d03e642-62aa-4ed5-8427-a10c4bd9698e => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:48:27.202665 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-82d75231-77d2-48cb-b23c-319a6f58d4db tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:27.204575 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-82d75231-77d2-48cb-b23c-319a6f58d4db tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 4339f9b7-28e4-4ea7-9e0f-bd44a8365166] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:27.221938 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=2 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:48:27.225291 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-82d75231-77d2-48cb-b23c-319a6f58d4db tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:27.226101 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-82d75231-77d2-48cb-b23c-319a6f58d4db tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:27.226745 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-82d75231-77d2-48cb-b23c-319a6f58d4db tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:27.227469 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-82d75231-77d2-48cb-b23c-319a6f58d4db tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:27.227926 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-82d75231-77d2-48cb-b23c-319a6f58d4db tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:27.228407 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-82d75231-77d2-48cb-b23c-319a6f58d4db tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:27.673217 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-82d75231-77d2-48cb-b23c-319a6f58d4db tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:27.683930 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-82d75231-77d2-48cb-b23c-319a6f58d4db tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/4339f9b7-28e4-4ea7-9e0f-bd44a8365166" status: 200 len: 1314 microversion: 2.1 time: 0.488067 Oct 04 18:48:27.684515 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1890/4027] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:27 2022] GET /compute/v2.1/servers/4339f9b7-28e4-4ea7-9e0f-bd44a8365166 => generated 1314 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:28.708395 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-93e55dee-3ee1-462a-bb58-a18ad592a08f tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:28.709653 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-93e55dee-3ee1-462a-bb58-a18ad592a08f tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 4339f9b7-28e4-4ea7-9e0f-bd44a8365166] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:28.721829 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-93e55dee-3ee1-462a-bb58-a18ad592a08f tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:28.722292 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-93e55dee-3ee1-462a-bb58-a18ad592a08f tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:28.722730 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-93e55dee-3ee1-462a-bb58-a18ad592a08f tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:28.723425 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-93e55dee-3ee1-462a-bb58-a18ad592a08f tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:28.723880 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-93e55dee-3ee1-462a-bb58-a18ad592a08f tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:28.724310 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-93e55dee-3ee1-462a-bb58-a18ad592a08f tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:29.093206 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-93e55dee-3ee1-462a-bb58-a18ad592a08f tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:29.103014 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-93e55dee-3ee1-462a-bb58-a18ad592a08f tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/4339f9b7-28e4-4ea7-9e0f-bd44a8365166" status: 200 len: 1314 microversion: 2.1 time: 0.398350 Oct 04 18:48:29.107352 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2138/4028] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:28 2022] GET /compute/v2.1/servers/4339f9b7-28e4-4ea7-9e0f-bd44a8365166 => generated 1314 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:30.132321 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-5311553c-859c-4cbf-8d6b-03f86b1565f2 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:30.133631 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-5311553c-859c-4cbf-8d6b-03f86b1565f2 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 4339f9b7-28e4-4ea7-9e0f-bd44a8365166] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:30.146373 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5311553c-859c-4cbf-8d6b-03f86b1565f2 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:30.147488 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5311553c-859c-4cbf-8d6b-03f86b1565f2 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:30.148134 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5311553c-859c-4cbf-8d6b-03f86b1565f2 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:30.154655 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5311553c-859c-4cbf-8d6b-03f86b1565f2 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:30.155396 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5311553c-859c-4cbf-8d6b-03f86b1565f2 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:30.157222 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5311553c-859c-4cbf-8d6b-03f86b1565f2 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:30.568291 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-5311553c-859c-4cbf-8d6b-03f86b1565f2 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:30.582903 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-5311553c-859c-4cbf-8d6b-03f86b1565f2 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/4339f9b7-28e4-4ea7-9e0f-bd44a8365166" status: 200 len: 1314 microversion: 2.1 time: 0.449864 Oct 04 18:48:30.583616 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1891/4029] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:30 2022] GET /compute/v2.1/servers/4339f9b7-28e4-4ea7-9e0f-bd44a8365166 => generated 1314 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:31.630687 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-a69a0ea1-87ca-44ad-8840-2e3fd360da88 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:31.633343 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-a69a0ea1-87ca-44ad-8840-2e3fd360da88 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 4339f9b7-28e4-4ea7-9e0f-bd44a8365166] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:31.646990 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a69a0ea1-87ca-44ad-8840-2e3fd360da88 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:31.648217 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a69a0ea1-87ca-44ad-8840-2e3fd360da88 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:31.650393 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a69a0ea1-87ca-44ad-8840-2e3fd360da88 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:31.652094 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a69a0ea1-87ca-44ad-8840-2e3fd360da88 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:31.654226 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a69a0ea1-87ca-44ad-8840-2e3fd360da88 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:31.655508 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a69a0ea1-87ca-44ad-8840-2e3fd360da88 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:32.064599 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-a69a0ea1-87ca-44ad-8840-2e3fd360da88 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:32.075073 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-a69a0ea1-87ca-44ad-8840-2e3fd360da88 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/4339f9b7-28e4-4ea7-9e0f-bd44a8365166" status: 200 len: 1314 microversion: 2.1 time: 0.464280 Oct 04 18:48:32.077091 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2139/4030] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:31 2022] GET /compute/v2.1/servers/4339f9b7-28e4-4ea7-9e0f-bd44a8365166 => generated 1314 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:32.535081 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-6c15416f-20e7-41d3-af27-7baf7aef12e6 req-770a9242-6adc-4c20-8417-0fb74010fdfd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4339f9b7-28e4-4ea7-9e0f-bd44a8365166", "name": "network-vif-plugged", "status": "completed", "tag": "4ec2a05f-d8b5-433a-8838-922f80ff479a"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:48:32.556762 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-6c15416f-20e7-41d3-af27-7baf7aef12e6 req-770a9242-6adc-4c20-8417-0fb74010fdfd service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:32.557570 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-6c15416f-20e7-41d3-af27-7baf7aef12e6 req-770a9242-6adc-4c20-8417-0fb74010fdfd service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:32.557766 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-6c15416f-20e7-41d3-af27-7baf7aef12e6 req-770a9242-6adc-4c20-8417-0fb74010fdfd service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:32.598268 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-6c15416f-20e7-41d3-af27-7baf7aef12e6 req-770a9242-6adc-4c20-8417-0fb74010fdfd service nova] Creating event network-vif-plugged:4ec2a05f-d8b5-433a-8838-922f80ff479a for instance 4339f9b7-28e4-4ea7-9e0f-bd44a8365166 on n-h1-851028-13 Oct 04 18:48:32.609625 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-6c15416f-20e7-41d3-af27-7baf7aef12e6 req-770a9242-6adc-4c20-8417-0fb74010fdfd service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078492 Oct 04 18:48:32.613523 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1892/4031] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:48:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:48:33.101305 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f1d98da4-2792-4456-83ea-37fb0316f88b tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:33.102641 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-f1d98da4-2792-4456-83ea-37fb0316f88b tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 4339f9b7-28e4-4ea7-9e0f-bd44a8365166] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:33.112735 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f1d98da4-2792-4456-83ea-37fb0316f88b tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:33.114353 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f1d98da4-2792-4456-83ea-37fb0316f88b tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:33.118022 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f1d98da4-2792-4456-83ea-37fb0316f88b tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:33.120122 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f1d98da4-2792-4456-83ea-37fb0316f88b tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:33.121711 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f1d98da4-2792-4456-83ea-37fb0316f88b tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:33.122592 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f1d98da4-2792-4456-83ea-37fb0316f88b tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:33.498240 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-f1d98da4-2792-4456-83ea-37fb0316f88b tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:33.514268 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-f1d98da4-2792-4456-83ea-37fb0316f88b tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/4339f9b7-28e4-4ea7-9e0f-bd44a8365166" status: 200 len: 1314 microversion: 2.1 time: 0.416873 Oct 04 18:48:33.515148 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2140/4032] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:33 2022] GET /compute/v2.1/servers/4339f9b7-28e4-4ea7-9e0f-bd44a8365166 => generated 1314 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:34.544657 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-a0564c72-99ec-4984-afb6-fac6b43cc757 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:34.545551 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-a0564c72-99ec-4984-afb6-fac6b43cc757 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 4339f9b7-28e4-4ea7-9e0f-bd44a8365166] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:34.560486 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a0564c72-99ec-4984-afb6-fac6b43cc757 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:34.560995 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a0564c72-99ec-4984-afb6-fac6b43cc757 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:34.563055 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a0564c72-99ec-4984-afb6-fac6b43cc757 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:34.563841 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a0564c72-99ec-4984-afb6-fac6b43cc757 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:34.566972 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a0564c72-99ec-4984-afb6-fac6b43cc757 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:34.569082 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a0564c72-99ec-4984-afb6-fac6b43cc757 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:34.991540 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-a0564c72-99ec-4984-afb6-fac6b43cc757 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:35.002382 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-a0564c72-99ec-4984-afb6-fac6b43cc757 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/4339f9b7-28e4-4ea7-9e0f-bd44a8365166" status: 200 len: 1500 microversion: 2.1 time: 0.463294 Oct 04 18:48:35.006555 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1893/4033] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:34 2022] GET /compute/v2.1/servers/4339f9b7-28e4-4ea7-9e0f-bd44a8365166 => generated 1500 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:35.029440 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-e809b7a2-2e06-4629-ad54-4d56defd903c tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "default"}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:48:35.030685 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-e809b7a2-2e06-4629-ad54-4d56defd903c tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 4339f9b7-28e4-4ea7-9e0f-bd44a8365166] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:35.052220 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e809b7a2-2e06-4629-ad54-4d56defd903c tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:35.052982 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e809b7a2-2e06-4629-ad54-4d56defd903c tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:35.053656 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e809b7a2-2e06-4629-ad54-4d56defd903c tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:35.058244 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e809b7a2-2e06-4629-ad54-4d56defd903c tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:35.059010 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e809b7a2-2e06-4629-ad54-4d56defd903c tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:35.061509 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e809b7a2-2e06-4629-ad54-4d56defd903c tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:35.539817 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.network.security_group_api [None req-e809b7a2-2e06-4629-ad54-4d56defd903c tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Removing security group 7ac3d7aa-4f75-41bc-9536-3ace439fa591 from port 4ec2a05f-d8b5-433a-8838-922f80ff479a Oct 04 18:48:35.904718 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=10 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:48:37.588136 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-e809b7a2-2e06-4629-ad54-4d56defd903c tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "POST /compute/v2.1/servers/4339f9b7-28e4-4ea7-9e0f-bd44a8365166/action" status: 202 len: 0 microversion: 2.1 time: 2.562470 Oct 04 18:48:37.589234 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2141/4034] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 18:48:35 2022] POST /compute/v2.1/servers/4339f9b7-28e4-4ea7-9e0f-bd44a8365166/action => generated 0 bytes in 2565 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:48:37.597588 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-fdfda1b4-9399-4c0b-b28e-32236407bdd0 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:37.598218 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-fdfda1b4-9399-4c0b-b28e-32236407bdd0 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 4339f9b7-28e4-4ea7-9e0f-bd44a8365166] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:37.601256 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=22 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:48:37.609700 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-34631b8f-37a3-44b9-ba27-7fad23de2cd5 req-24a63007-99a9-46a7-8fc0-8d26779b1311 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4339f9b7-28e4-4ea7-9e0f-bd44a8365166", "tag": "4ec2a05f-d8b5-433a-8838-922f80ff479a"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:48:37.627198 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fdfda1b4-9399-4c0b-b28e-32236407bdd0 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:37.628341 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fdfda1b4-9399-4c0b-b28e-32236407bdd0 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:37.628778 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fdfda1b4-9399-4c0b-b28e-32236407bdd0 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:37.629529 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fdfda1b4-9399-4c0b-b28e-32236407bdd0 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:37.629995 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fdfda1b4-9399-4c0b-b28e-32236407bdd0 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:37.630491 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fdfda1b4-9399-4c0b-b28e-32236407bdd0 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:37.642195 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-34631b8f-37a3-44b9-ba27-7fad23de2cd5 req-24a63007-99a9-46a7-8fc0-8d26779b1311 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:37.644021 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-34631b8f-37a3-44b9-ba27-7fad23de2cd5 req-24a63007-99a9-46a7-8fc0-8d26779b1311 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:37.644874 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-34631b8f-37a3-44b9-ba27-7fad23de2cd5 req-24a63007-99a9-46a7-8fc0-8d26779b1311 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:37.669333 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-34631b8f-37a3-44b9-ba27-7fad23de2cd5 req-24a63007-99a9-46a7-8fc0-8d26779b1311 service nova] Creating event network-changed:4ec2a05f-d8b5-433a-8838-922f80ff479a for instance 4339f9b7-28e4-4ea7-9e0f-bd44a8365166 on n-h1-851028-13 Oct 04 18:48:37.691225 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-34631b8f-37a3-44b9-ba27-7fad23de2cd5 req-24a63007-99a9-46a7-8fc0-8d26779b1311 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082712 Oct 04 18:48:37.720379 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2142/4035] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:48:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:48:38.131127 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-fdfda1b4-9399-4c0b-b28e-32236407bdd0 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:38.147201 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-fdfda1b4-9399-4c0b-b28e-32236407bdd0 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/4339f9b7-28e4-4ea7-9e0f-bd44a8365166" status: 200 len: 1458 microversion: 2.1 time: 0.554022 Oct 04 18:48:38.150884 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1894/4036] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:37 2022] GET /compute/v2.1/servers/4339f9b7-28e4-4ea7-9e0f-bd44a8365166 => generated 1458 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:38.179097 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-5918294a-54fe-4875-bf4a-a0a19b4c6fce tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:38.179842 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-5918294a-54fe-4875-bf4a-a0a19b4c6fce tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 82b86465-afb0-49ef-9932-1538010c1ae5] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:38.195683 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5918294a-54fe-4875-bf4a-a0a19b4c6fce tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:38.197484 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5918294a-54fe-4875-bf4a-a0a19b4c6fce tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:38.199396 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5918294a-54fe-4875-bf4a-a0a19b4c6fce tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:38.214808 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5918294a-54fe-4875-bf4a-a0a19b4c6fce tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:38.215821 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5918294a-54fe-4875-bf4a-a0a19b4c6fce tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:38.217806 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5918294a-54fe-4875-bf4a-a0a19b4c6fce tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:38.980537 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-5918294a-54fe-4875-bf4a-a0a19b4c6fce tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:38.989225 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-5918294a-54fe-4875-bf4a-a0a19b4c6fce tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5" status: 200 len: 1667 microversion: 2.1 time: 0.816473 Oct 04 18:48:39.015949 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2143/4037] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:38 2022] GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5 => generated 1667 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:39.031356 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-ada089f0-ba9c-4dc5-aa3a-0357653032cf tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:39.032459 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-ada089f0-ba9c-4dc5-aa3a-0357653032cf tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 82b86465-afb0-49ef-9932-1538010c1ae5] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:39.042895 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ada089f0-ba9c-4dc5-aa3a-0357653032cf tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:39.043477 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ada089f0-ba9c-4dc5-aa3a-0357653032cf tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:39.044204 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ada089f0-ba9c-4dc5-aa3a-0357653032cf tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:39.045259 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ada089f0-ba9c-4dc5-aa3a-0357653032cf tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:39.045723 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ada089f0-ba9c-4dc5-aa3a-0357653032cf tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:39.046563 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ada089f0-ba9c-4dc5-aa3a-0357653032cf tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:39.389281 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-ada089f0-ba9c-4dc5-aa3a-0357653032cf tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:39.397297 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-ada089f0-ba9c-4dc5-aa3a-0357653032cf tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5" status: 200 len: 1667 microversion: 2.1 time: 0.372527 Oct 04 18:48:39.397890 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1895/4038] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:39 2022] GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5 => generated 1667 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:39.426484 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-255754b4-b9cc-443b-bdcc-3f028b629a3d tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:39.426904 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-255754b4-b9cc-443b-bdcc-3f028b629a3d tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 82b86465-afb0-49ef-9932-1538010c1ae5] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:39.444747 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-255754b4-b9cc-443b-bdcc-3f028b629a3d tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:39.445307 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-255754b4-b9cc-443b-bdcc-3f028b629a3d tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:39.445695 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-255754b4-b9cc-443b-bdcc-3f028b629a3d tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:39.446437 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-255754b4-b9cc-443b-bdcc-3f028b629a3d tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:39.446897 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-255754b4-b9cc-443b-bdcc-3f028b629a3d tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:39.447333 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-255754b4-b9cc-443b-bdcc-3f028b629a3d tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:39.983007 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-255754b4-b9cc-443b-bdcc-3f028b629a3d tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:40.001518 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-255754b4-b9cc-443b-bdcc-3f028b629a3d tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5" status: 200 len: 1667 microversion: 2.1 time: 0.575478 Oct 04 18:48:40.004302 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2144/4039] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:39 2022] GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5 => generated 1667 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:40.027034 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-a02ee2b7-e7d2-4a59-afe8-80aec1e9f752 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:40.027671 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-a02ee2b7-e7d2-4a59-afe8-80aec1e9f752 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 82b86465-afb0-49ef-9932-1538010c1ae5] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:40.033915 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a02ee2b7-e7d2-4a59-afe8-80aec1e9f752 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:40.034628 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a02ee2b7-e7d2-4a59-afe8-80aec1e9f752 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:40.034880 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a02ee2b7-e7d2-4a59-afe8-80aec1e9f752 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:40.035598 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a02ee2b7-e7d2-4a59-afe8-80aec1e9f752 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:40.036142 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a02ee2b7-e7d2-4a59-afe8-80aec1e9f752 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:40.036584 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a02ee2b7-e7d2-4a59-afe8-80aec1e9f752 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:40.482935 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-a02ee2b7-e7d2-4a59-afe8-80aec1e9f752 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:40.508878 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-a02ee2b7-e7d2-4a59-afe8-80aec1e9f752 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5" status: 200 len: 1667 microversion: 2.1 time: 0.485674 Oct 04 18:48:40.509614 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1896/4040] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:40 2022] GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5 => generated 1667 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:40.907585 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-689e6563-f093-4296-81cc-2b631ef4d8a6 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-2065928390", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452", "networks": [{"uuid": "4c7a4f44-d147-4a8b-8217-07c763ce3b07"}]}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:48:41.035653 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.network.neutron [None req-689e6563-f093-4296-81cc-2b631ef4d8a6 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] validate_networks() for [('4c7a4f44-d147-4a8b-8217-07c763ce3b07', None, None, None, None, None)] {{(pid=123596) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:48:42.352770 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-532a236c-1af3-4e82-aacb-8b6a208ddaef tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-1973396850", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452", "networks": [{"uuid": "4a1417e9-f3af-46cb-a463-32dd1c79c4e9"}]}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:48:42.455904 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.network.neutron [None req-532a236c-1af3-4e82-aacb-8b6a208ddaef tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] validate_networks() for [('4a1417e9-f3af-46cb-a463-32dd1c79c4e9', None, None, None, None, None)] {{(pid=123595) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:48:43.064256 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-689e6563-f093-4296-81cc-2b631ef4d8a6 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Flavor limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:48:43.064866 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-689e6563-f093-4296-81cc-2b631ef4d8a6 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Image limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:48:43.068055 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-689e6563-f093-4296-81cc-2b631ef4d8a6 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Flavor pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:48:43.068578 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-689e6563-f093-4296-81cc-2b631ef4d8a6 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Image pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:48:43.069014 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-689e6563-f093-4296-81cc-2b631ef4d8a6 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:48:43.087032 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-689e6563-f093-4296-81cc-2b631ef4d8a6 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:43.087454 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-689e6563-f093-4296-81cc-2b631ef4d8a6 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:43.087896 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-689e6563-f093-4296-81cc-2b631ef4d8a6 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:43.088859 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-689e6563-f093-4296-81cc-2b631ef4d8a6 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:43.089527 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-689e6563-f093-4296-81cc-2b631ef4d8a6 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:43.090115 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-689e6563-f093-4296-81cc-2b631ef4d8a6 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:43.122715 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=94 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:48:43.143699 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-689e6563-f093-4296-81cc-2b631ef4d8a6 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Getting quotas for project b928ae7385da4599bbe0ea701681b233. Resources: {'ram', 'cores', 'instances'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:48:43.155373 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-689e6563-f093-4296-81cc-2b631ef4d8a6 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Getting quotas for user 93c36c0802f4473f96d0721caa50374a and project b928ae7385da4599bbe0ea701681b233. Resources: {'ram', 'cores', 'instances'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:48:43.172661 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-689e6563-f093-4296-81cc-2b631ef4d8a6 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Going to run 1 instances... {{(pid=123596) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:48:43.176994 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-689e6563-f093-4296-81cc-2b631ef4d8a6 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 287c44c9-e70d-4492-b4b6-35bee8011596] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e8943ec5-4038-4d4b-b9b9-2415a79f5243',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123596) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:48:43.314475 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-689e6563-f093-4296-81cc-2b631ef4d8a6 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.411433 Oct 04 18:48:43.319161 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2145/4041] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 18:48:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 2417 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:48:43.335769 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-041bd34f-37df-467d-912a-a06825edbb5f tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:43.337795 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-041bd34f-37df-467d-912a-a06825edbb5f tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 287c44c9-e70d-4492-b4b6-35bee8011596] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:43.471485 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-532a236c-1af3-4e82-aacb-8b6a208ddaef tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Flavor limits 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:48:43.473054 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-532a236c-1af3-4e82-aacb-8b6a208ddaef tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Image limits 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:48:43.473936 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-532a236c-1af3-4e82-aacb-8b6a208ddaef tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Flavor pref 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:48:43.474449 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-532a236c-1af3-4e82-aacb-8b6a208ddaef tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Image pref 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:48:43.475232 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-532a236c-1af3-4e82-aacb-8b6a208ddaef tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:48:43.505520 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-532a236c-1af3-4e82-aacb-8b6a208ddaef tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:43.506330 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-532a236c-1af3-4e82-aacb-8b6a208ddaef tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:43.506792 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-532a236c-1af3-4e82-aacb-8b6a208ddaef tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:43.510184 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-532a236c-1af3-4e82-aacb-8b6a208ddaef tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:43.511874 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-532a236c-1af3-4e82-aacb-8b6a208ddaef tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:43.512346 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-532a236c-1af3-4e82-aacb-8b6a208ddaef tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:43.582504 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-041bd34f-37df-467d-912a-a06825edbb5f tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:43.587778 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-532a236c-1af3-4e82-aacb-8b6a208ddaef tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Getting quotas for project ed8f94cf1c974654a336645f453c9efc. Resources: {'ram', 'cores', 'instances'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:48:43.599189 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-532a236c-1af3-4e82-aacb-8b6a208ddaef tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Getting quotas for user 14707008940e4965ab7d1190094a71bb and project ed8f94cf1c974654a336645f453c9efc. Resources: {'ram', 'cores', 'instances'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:48:43.604210 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-041bd34f-37df-467d-912a-a06825edbb5f tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/287c44c9-e70d-4492-b4b6-35bee8011596" status: 200 len: 1215 microversion: 2.1 time: 0.278750 Oct 04 18:48:43.609827 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2146/4042] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:43 2022] GET /compute/v2.1/servers/287c44c9-e70d-4492-b4b6-35bee8011596 => generated 1215 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:43.655543 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-532a236c-1af3-4e82-aacb-8b6a208ddaef tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Going to run 1 instances... {{(pid=123595) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:48:43.667674 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-532a236c-1af3-4e82-aacb-8b6a208ddaef tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] [instance: a080cb57-9980-493d-9049-28a0c4c03bdf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e8943ec5-4038-4d4b-b9b9-2415a79f5243',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:48:43.811891 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-532a236c-1af3-4e82-aacb-8b6a208ddaef tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.689457 Oct 04 18:48:43.812587 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1897/4043] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 18:48:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 1691 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:48:43.834363 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-8fc90760-7fcb-4140-a124-9c8edecaa9cf tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:43.835533 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-8fc90760-7fcb-4140-a124-9c8edecaa9cf tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] [instance: a080cb57-9980-493d-9049-28a0c4c03bdf] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:44.007467 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-8fc90760-7fcb-4140-a124-9c8edecaa9cf tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14707008940e4965ab7d1190094a71bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8f94cf1c974654a336645f453c9efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:44.015414 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-8fc90760-7fcb-4140-a124-9c8edecaa9cf tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] 10.222.0.43 "GET /compute/v2.1/servers/a080cb57-9980-493d-9049-28a0c4c03bdf" status: 200 len: 1193 microversion: 2.1 time: 0.192486 Oct 04 18:48:44.019274 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2147/4044] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:43 2022] GET /compute/v2.1/servers/a080cb57-9980-493d-9049-28a0c4c03bdf => generated 1193 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:44.631256 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-08ef4fa9-afab-4bd1-a3a2-c19235ba2865 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:44.631884 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-08ef4fa9-afab-4bd1-a3a2-c19235ba2865 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 287c44c9-e70d-4492-b4b6-35bee8011596] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:44.662208 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-08ef4fa9-afab-4bd1-a3a2-c19235ba2865 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:44.662710 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-08ef4fa9-afab-4bd1-a3a2-c19235ba2865 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:44.669084 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-08ef4fa9-afab-4bd1-a3a2-c19235ba2865 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:44.669944 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-08ef4fa9-afab-4bd1-a3a2-c19235ba2865 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:44.670424 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-08ef4fa9-afab-4bd1-a3a2-c19235ba2865 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:44.676823 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-08ef4fa9-afab-4bd1-a3a2-c19235ba2865 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:44.937840 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-08ef4fa9-afab-4bd1-a3a2-c19235ba2865 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:44.951003 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-08ef4fa9-afab-4bd1-a3a2-c19235ba2865 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/287c44c9-e70d-4492-b4b6-35bee8011596" status: 200 len: 1211 microversion: 2.1 time: 0.326648 Oct 04 18:48:44.971577 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1898/4045] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:44 2022] GET /compute/v2.1/servers/287c44c9-e70d-4492-b4b6-35bee8011596 => generated 1211 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:45.046660 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-081832ff-1bc6-485a-b5b9-6f603bc58a13 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:45.047463 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-081832ff-1bc6-485a-b5b9-6f603bc58a13 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] [instance: a080cb57-9980-493d-9049-28a0c4c03bdf] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:45.076054 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-081832ff-1bc6-485a-b5b9-6f603bc58a13 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:45.076598 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-081832ff-1bc6-485a-b5b9-6f603bc58a13 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:45.077076 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-081832ff-1bc6-485a-b5b9-6f603bc58a13 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:45.088229 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-081832ff-1bc6-485a-b5b9-6f603bc58a13 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:45.102859 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-081832ff-1bc6-485a-b5b9-6f603bc58a13 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:45.103772 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-081832ff-1bc6-485a-b5b9-6f603bc58a13 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:45.279890 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-081832ff-1bc6-485a-b5b9-6f603bc58a13 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14707008940e4965ab7d1190094a71bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8f94cf1c974654a336645f453c9efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:45.294464 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-081832ff-1bc6-485a-b5b9-6f603bc58a13 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] 10.222.0.43 "GET /compute/v2.1/servers/a080cb57-9980-493d-9049-28a0c4c03bdf" status: 200 len: 1197 microversion: 2.1 time: 0.251132 Oct 04 18:48:45.295086 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2148/4046] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:45 2022] GET /compute/v2.1/servers/a080cb57-9980-493d-9049-28a0c4c03bdf => generated 1197 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:45.984360 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-aab400e7-340c-4399-9f8d-8d5003a17038 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:45.986693 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-aab400e7-340c-4399-9f8d-8d5003a17038 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 287c44c9-e70d-4492-b4b6-35bee8011596] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:46.002599 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-aab400e7-340c-4399-9f8d-8d5003a17038 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:46.003443 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-aab400e7-340c-4399-9f8d-8d5003a17038 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:46.006613 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-aab400e7-340c-4399-9f8d-8d5003a17038 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:46.010126 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-aab400e7-340c-4399-9f8d-8d5003a17038 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:46.011107 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-aab400e7-340c-4399-9f8d-8d5003a17038 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:46.012537 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-aab400e7-340c-4399-9f8d-8d5003a17038 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:46.316086 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-aab400e7-340c-4399-9f8d-8d5003a17038 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:46.324445 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-81a6e0cf-0a0d-48a5-b731-01b917cc3340 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:46.325525 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-81a6e0cf-0a0d-48a5-b731-01b917cc3340 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] [instance: a080cb57-9980-493d-9049-28a0c4c03bdf] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:46.327719 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-aab400e7-340c-4399-9f8d-8d5003a17038 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/287c44c9-e70d-4492-b4b6-35bee8011596" status: 200 len: 1273 microversion: 2.1 time: 0.352386 Oct 04 18:48:46.332041 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1899/4047] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:45 2022] GET /compute/v2.1/servers/287c44c9-e70d-4492-b4b6-35bee8011596 => generated 1273 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:46.356118 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-81a6e0cf-0a0d-48a5-b731-01b917cc3340 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:46.356118 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-81a6e0cf-0a0d-48a5-b731-01b917cc3340 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:46.356118 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-81a6e0cf-0a0d-48a5-b731-01b917cc3340 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:46.358367 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-81a6e0cf-0a0d-48a5-b731-01b917cc3340 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:46.358945 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-81a6e0cf-0a0d-48a5-b731-01b917cc3340 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:46.359450 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-81a6e0cf-0a0d-48a5-b731-01b917cc3340 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:46.512894 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-81a6e0cf-0a0d-48a5-b731-01b917cc3340 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14707008940e4965ab7d1190094a71bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8f94cf1c974654a336645f453c9efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:46.524356 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-81a6e0cf-0a0d-48a5-b731-01b917cc3340 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] 10.222.0.43 "GET /compute/v2.1/servers/a080cb57-9980-493d-9049-28a0c4c03bdf" status: 200 len: 1245 microversion: 2.1 time: 0.209284 Oct 04 18:48:46.541572 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2149/4048] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:46 2022] GET /compute/v2.1/servers/a080cb57-9980-493d-9049-28a0c4c03bdf => generated 1245 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:47.361376 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-dfa717f4-08c0-49e3-85c0-4dfe3a853935 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:47.362069 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-dfa717f4-08c0-49e3-85c0-4dfe3a853935 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 287c44c9-e70d-4492-b4b6-35bee8011596] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:47.372722 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dfa717f4-08c0-49e3-85c0-4dfe3a853935 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:47.373524 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dfa717f4-08c0-49e3-85c0-4dfe3a853935 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:47.373957 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dfa717f4-08c0-49e3-85c0-4dfe3a853935 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:47.374874 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dfa717f4-08c0-49e3-85c0-4dfe3a853935 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:47.375643 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dfa717f4-08c0-49e3-85c0-4dfe3a853935 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:47.376702 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dfa717f4-08c0-49e3-85c0-4dfe3a853935 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:47.539660 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-dfa717f4-08c0-49e3-85c0-4dfe3a853935 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:47.550225 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-dfa717f4-08c0-49e3-85c0-4dfe3a853935 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/287c44c9-e70d-4492-b4b6-35bee8011596" status: 200 len: 1273 microversion: 2.1 time: 0.194716 Oct 04 18:48:47.554250 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1900/4049] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:47 2022] GET /compute/v2.1/servers/287c44c9-e70d-4492-b4b6-35bee8011596 => generated 1273 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:47.554909 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-99c6a265-7c5a-4edc-b066-bc7d5c4f7424 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:47.556633 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-99c6a265-7c5a-4edc-b066-bc7d5c4f7424 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] [instance: a080cb57-9980-493d-9049-28a0c4c03bdf] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:47.569932 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-99c6a265-7c5a-4edc-b066-bc7d5c4f7424 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:47.570781 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-99c6a265-7c5a-4edc-b066-bc7d5c4f7424 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:47.571232 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-99c6a265-7c5a-4edc-b066-bc7d5c4f7424 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:47.571953 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-99c6a265-7c5a-4edc-b066-bc7d5c4f7424 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:47.573069 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-99c6a265-7c5a-4edc-b066-bc7d5c4f7424 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:47.573597 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-99c6a265-7c5a-4edc-b066-bc7d5c4f7424 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:47.694410 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-99c6a265-7c5a-4edc-b066-bc7d5c4f7424 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14707008940e4965ab7d1190094a71bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8f94cf1c974654a336645f453c9efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:47.705363 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-99c6a265-7c5a-4edc-b066-bc7d5c4f7424 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] 10.222.0.43 "GET /compute/v2.1/servers/a080cb57-9980-493d-9049-28a0c4c03bdf" status: 200 len: 1251 microversion: 2.1 time: 0.157354 Oct 04 18:48:47.706575 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2150/4050] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:47 2022] GET /compute/v2.1/servers/a080cb57-9980-493d-9049-28a0c4c03bdf => generated 1251 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:48:48.099358 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-9b4dd862-9128-4306-b2f5-baf00da36280 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:48.102776 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-9b4dd862-9128-4306-b2f5-baf00da36280 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] [instance: 76d475ab-f41c-44df-8aaa-10242bdbfcde] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:48.114574 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9b4dd862-9128-4306-b2f5-baf00da36280 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:48.118280 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9b4dd862-9128-4306-b2f5-baf00da36280 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:48.121025 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9b4dd862-9128-4306-b2f5-baf00da36280 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:48.122031 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9b4dd862-9128-4306-b2f5-baf00da36280 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:48.122692 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9b4dd862-9128-4306-b2f5-baf00da36280 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:48.123138 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9b4dd862-9128-4306-b2f5-baf00da36280 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:48.210533 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-9b4dd862-9128-4306-b2f5-baf00da36280 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] 10.222.0.43 "GET /compute/v2.1/servers/76d475ab-f41c-44df-8aaa-10242bdbfcde/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.115262 Oct 04 18:48:48.220563 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1901/4051] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Oct 4 18:48:48 2022] GET /compute/v2.1/servers/76d475ab-f41c-44df-8aaa-10242bdbfcde/os-volume_attachments => generated 25 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:48:48.354385 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-1cda8693-3313-4757-9b54-8eb4021d7053 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:48.354897 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-1cda8693-3313-4757-9b54-8eb4021d7053 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] [instance: 76d475ab-f41c-44df-8aaa-10242bdbfcde] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:48.378148 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1cda8693-3313-4757-9b54-8eb4021d7053 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:48.382411 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1cda8693-3313-4757-9b54-8eb4021d7053 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:48.383265 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1cda8693-3313-4757-9b54-8eb4021d7053 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:48.388511 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1cda8693-3313-4757-9b54-8eb4021d7053 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:48.389517 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1cda8693-3313-4757-9b54-8eb4021d7053 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:48.391691 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1cda8693-3313-4757-9b54-8eb4021d7053 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:48.503862 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-1cda8693-3313-4757-9b54-8eb4021d7053 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] [instance: 76d475ab-f41c-44df-8aaa-10242bdbfcde] Going to try to terminate instance {{(pid=123596) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:48:48.577653 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-c7a0cd3c-e8f1-4fdd-937e-6f37c44421ed tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:48.579062 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-c7a0cd3c-e8f1-4fdd-937e-6f37c44421ed tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 287c44c9-e70d-4492-b4b6-35bee8011596] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:48.590834 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c7a0cd3c-e8f1-4fdd-937e-6f37c44421ed tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:48.591711 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c7a0cd3c-e8f1-4fdd-937e-6f37c44421ed tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:48.594133 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c7a0cd3c-e8f1-4fdd-937e-6f37c44421ed tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:48.595724 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c7a0cd3c-e8f1-4fdd-937e-6f37c44421ed tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:48.597381 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c7a0cd3c-e8f1-4fdd-937e-6f37c44421ed tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:48.600000 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c7a0cd3c-e8f1-4fdd-937e-6f37c44421ed tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:48.655904 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:48:48.670926 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-1cda8693-3313-4757-9b54-8eb4021d7053 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] 10.222.0.43 "DELETE /compute/v2.1/servers/76d475ab-f41c-44df-8aaa-10242bdbfcde" status: 204 len: 0 microversion: 2.1 time: 0.322989 Oct 04 18:48:48.674032 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2151/4052] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 18:48:48 2022] DELETE /compute/v2.1/servers/76d475ab-f41c-44df-8aaa-10242bdbfcde => generated 0 bytes in 329 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:48:48.685219 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-8e41ec17-1029-471b-8ad4-40d3e0872d70 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:48.690514 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-8e41ec17-1029-471b-8ad4-40d3e0872d70 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] [instance: 76d475ab-f41c-44df-8aaa-10242bdbfcde] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:48.706080 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8e41ec17-1029-471b-8ad4-40d3e0872d70 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:48.706587 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8e41ec17-1029-471b-8ad4-40d3e0872d70 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:48.707034 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8e41ec17-1029-471b-8ad4-40d3e0872d70 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:48.707757 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8e41ec17-1029-471b-8ad4-40d3e0872d70 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:48.708217 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8e41ec17-1029-471b-8ad4-40d3e0872d70 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:48.708647 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8e41ec17-1029-471b-8ad4-40d3e0872d70 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:48.902443 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-8e41ec17-1029-471b-8ad4-40d3e0872d70 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a116f2d9656548458264cc4fb1934c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff3c3dc76405401baf72fe00c5d50b56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:48.919844 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-8e41ec17-1029-471b-8ad4-40d3e0872d70 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] 10.222.0.43 "GET /compute/v2.1/servers/76d475ab-f41c-44df-8aaa-10242bdbfcde" status: 200 len: 1674 microversion: 2.1 time: 0.239583 Oct 04 18:48:48.921885 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2152/4053] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:48 2022] GET /compute/v2.1/servers/76d475ab-f41c-44df-8aaa-10242bdbfcde => generated 1674 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:48:48.930254 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-220b14b0-7956-43fa-97c6-7484e66401da tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:48.933694 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-220b14b0-7956-43fa-97c6-7484e66401da tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] [instance: a080cb57-9980-493d-9049-28a0c4c03bdf] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:48.947484 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-220b14b0-7956-43fa-97c6-7484e66401da tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:48.955968 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-220b14b0-7956-43fa-97c6-7484e66401da tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:48.957478 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-220b14b0-7956-43fa-97c6-7484e66401da tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:48.958832 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-220b14b0-7956-43fa-97c6-7484e66401da tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:48.958943 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-220b14b0-7956-43fa-97c6-7484e66401da tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:48.959368 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-220b14b0-7956-43fa-97c6-7484e66401da tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:49.171992 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-c7a0cd3c-e8f1-4fdd-937e-6f37c44421ed tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:49.184485 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-c7a0cd3c-e8f1-4fdd-937e-6f37c44421ed tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/287c44c9-e70d-4492-b4b6-35bee8011596" status: 200 len: 1315 microversion: 2.1 time: 0.610915 Oct 04 18:48:49.188856 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1902/4054] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:48 2022] GET /compute/v2.1/servers/287c44c9-e70d-4492-b4b6-35bee8011596 => generated 1315 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:49.214260 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-220b14b0-7956-43fa-97c6-7484e66401da tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14707008940e4965ab7d1190094a71bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8f94cf1c974654a336645f453c9efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:49.235794 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-220b14b0-7956-43fa-97c6-7484e66401da tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] 10.222.0.43 "GET /compute/v2.1/servers/a080cb57-9980-493d-9049-28a0c4c03bdf" status: 200 len: 1293 microversion: 2.1 time: 0.311477 Oct 04 18:48:49.236900 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2153/4055] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:48 2022] GET /compute/v2.1/servers/a080cb57-9980-493d-9049-28a0c4c03bdf => generated 1293 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:49.895719 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-070aef1f-1f17-4ca9-9f84-03c8c7a269f5 req-0b8865ad-1c1c-4776-a823-40d0f1f0b3b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "287c44c9-e70d-4492-b4b6-35bee8011596", "tag": "37fe4acb-5d41-4bcb-9278-e11389be7c1d"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:48:49.910626 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-070aef1f-1f17-4ca9-9f84-03c8c7a269f5 req-0b8865ad-1c1c-4776-a823-40d0f1f0b3b3 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:49.911786 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-070aef1f-1f17-4ca9-9f84-03c8c7a269f5 req-0b8865ad-1c1c-4776-a823-40d0f1f0b3b3 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:49.913033 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-070aef1f-1f17-4ca9-9f84-03c8c7a269f5 req-0b8865ad-1c1c-4776-a823-40d0f1f0b3b3 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:49.937711 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-070aef1f-1f17-4ca9-9f84-03c8c7a269f5 req-0b8865ad-1c1c-4776-a823-40d0f1f0b3b3 service nova] Creating event network-changed:37fe4acb-5d41-4bcb-9278-e11389be7c1d for instance 287c44c9-e70d-4492-b4b6-35bee8011596 on n-h2-851028-13 Oct 04 18:48:49.945660 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-8a22f874-2047-40b9-88ed-608cfde89efe tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:49.947347 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-8a22f874-2047-40b9-88ed-608cfde89efe tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] [instance: 76d475ab-f41c-44df-8aaa-10242bdbfcde] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:49.948461 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-070aef1f-1f17-4ca9-9f84-03c8c7a269f5 req-0b8865ad-1c1c-4776-a823-40d0f1f0b3b3 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058197 Oct 04 18:48:49.951775 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1903/4056] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:48:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:48:49.964764 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8a22f874-2047-40b9-88ed-608cfde89efe tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:49.969093 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8a22f874-2047-40b9-88ed-608cfde89efe tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:49.969826 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8a22f874-2047-40b9-88ed-608cfde89efe tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:49.970747 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8a22f874-2047-40b9-88ed-608cfde89efe tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:49.971238 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8a22f874-2047-40b9-88ed-608cfde89efe tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:49.971872 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8a22f874-2047-40b9-88ed-608cfde89efe tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:50.159936 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-8a22f874-2047-40b9-88ed-608cfde89efe tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a116f2d9656548458264cc4fb1934c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff3c3dc76405401baf72fe00c5d50b56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:50.170911 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-8a22f874-2047-40b9-88ed-608cfde89efe tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] 10.222.0.43 "GET /compute/v2.1/servers/76d475ab-f41c-44df-8aaa-10242bdbfcde" status: 200 len: 1674 microversion: 2.1 time: 0.230732 Oct 04 18:48:50.172095 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2154/4057] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:49 2022] GET /compute/v2.1/servers/76d475ab-f41c-44df-8aaa-10242bdbfcde => generated 1674 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:50.213445 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-336058cf-a269-4a86-af35-673fb4695f31 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:50.214561 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-336058cf-a269-4a86-af35-673fb4695f31 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 287c44c9-e70d-4492-b4b6-35bee8011596] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:50.225051 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-336058cf-a269-4a86-af35-673fb4695f31 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:50.226982 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-336058cf-a269-4a86-af35-673fb4695f31 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:50.228113 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-336058cf-a269-4a86-af35-673fb4695f31 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:50.230042 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-336058cf-a269-4a86-af35-673fb4695f31 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:50.231336 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-336058cf-a269-4a86-af35-673fb4695f31 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:50.232131 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-336058cf-a269-4a86-af35-673fb4695f31 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:50.265700 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-4af9dbfa-581f-4797-ab3d-1ea477557430 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:50.266917 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-4af9dbfa-581f-4797-ab3d-1ea477557430 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] [instance: a080cb57-9980-493d-9049-28a0c4c03bdf] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:50.276863 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4af9dbfa-581f-4797-ab3d-1ea477557430 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:50.278357 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4af9dbfa-581f-4797-ab3d-1ea477557430 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:50.279019 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4af9dbfa-581f-4797-ab3d-1ea477557430 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:50.280270 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4af9dbfa-581f-4797-ab3d-1ea477557430 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:50.281362 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4af9dbfa-581f-4797-ab3d-1ea477557430 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:50.281936 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4af9dbfa-581f-4797-ab3d-1ea477557430 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:50.474169 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-4af9dbfa-581f-4797-ab3d-1ea477557430 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14707008940e4965ab7d1190094a71bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8f94cf1c974654a336645f453c9efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:50.490190 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-4af9dbfa-581f-4797-ab3d-1ea477557430 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] 10.222.0.43 "GET /compute/v2.1/servers/a080cb57-9980-493d-9049-28a0c4c03bdf" status: 200 len: 1293 microversion: 2.1 time: 0.233248 Oct 04 18:48:50.503948 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2155/4058] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:50 2022] GET /compute/v2.1/servers/a080cb57-9980-493d-9049-28a0c4c03bdf => generated 1293 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:48:50.587195 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-336058cf-a269-4a86-af35-673fb4695f31 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:50.597445 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-336058cf-a269-4a86-af35-673fb4695f31 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/287c44c9-e70d-4492-b4b6-35bee8011596" status: 200 len: 1315 microversion: 2.1 time: 0.389141 Oct 04 18:48:50.598421 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1904/4059] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:50 2022] GET /compute/v2.1/servers/287c44c9-e70d-4492-b4b6-35bee8011596 => generated 1315 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:48:51.197539 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-c0f3a765-2aef-4bdf-9f7b-a0bc6cfe5dba tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:51.198941 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-c0f3a765-2aef-4bdf-9f7b-a0bc6cfe5dba tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] [instance: 76d475ab-f41c-44df-8aaa-10242bdbfcde] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:51.210133 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c0f3a765-2aef-4bdf-9f7b-a0bc6cfe5dba tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:51.210639 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c0f3a765-2aef-4bdf-9f7b-a0bc6cfe5dba tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:51.212767 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c0f3a765-2aef-4bdf-9f7b-a0bc6cfe5dba tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:51.214493 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c0f3a765-2aef-4bdf-9f7b-a0bc6cfe5dba tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:51.214983 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c0f3a765-2aef-4bdf-9f7b-a0bc6cfe5dba tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:51.215781 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c0f3a765-2aef-4bdf-9f7b-a0bc6cfe5dba tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:51.433610 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-da29def1-f8e8-436f-976b-97e1f916ca96 tempest-QuotaClassesAdminTestJSON-1470361391 tempest-QuotaClassesAdminTestJSON-1470361391-project-admin] Calling method '.version_select at 0x7fb21ecfcf70>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:51.467644 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-da29def1-f8e8-436f-976b-97e1f916ca96 tempest-QuotaClassesAdminTestJSON-1470361391 tempest-QuotaClassesAdminTestJSON-1470361391-project-admin] 10.222.0.43 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.733658 Oct 04 18:48:51.470150 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2156/4060] 10.222.0.43 () {58 vars in 1185 bytes} [Tue Oct 4 18:48:50 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:48:51.485062 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-8fd6bd7d-534f-4dd1-8232-2ab2e8eb597b tempest-QuotaClassesAdminTestJSON-1470361391 tempest-QuotaClassesAdminTestJSON-1470361391-project-admin] Action: 'update', calling method: .version_select at 0x7fb21ecfc820>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:48:51.618928 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=7,nova_api:DELETE=3,nova_api:UPDATE=6 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:48:51.662903 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-c0f3a765-2aef-4bdf-9f7b-a0bc6cfe5dba tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a116f2d9656548458264cc4fb1934c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff3c3dc76405401baf72fe00c5d50b56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:51.680736 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-c0f3a765-2aef-4bdf-9f7b-a0bc6cfe5dba tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] 10.222.0.43 "GET /compute/v2.1/servers/76d475ab-f41c-44df-8aaa-10242bdbfcde" status: 200 len: 1674 microversion: 2.1 time: 0.488123 Oct 04 18:48:51.685252 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1905/4061] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:51 2022] GET /compute/v2.1/servers/76d475ab-f41c-44df-8aaa-10242bdbfcde => generated 1674 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:51.705900 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-63b40df2-cb08-47a4-baae-90ea6cd557bb tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:51.712088 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-63b40df2-cb08-47a4-baae-90ea6cd557bb tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] [instance: a080cb57-9980-493d-9049-28a0c4c03bdf] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:51.733041 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-63b40df2-cb08-47a4-baae-90ea6cd557bb tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:51.733584 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-63b40df2-cb08-47a4-baae-90ea6cd557bb tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:51.734033 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-63b40df2-cb08-47a4-baae-90ea6cd557bb tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:51.734761 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-63b40df2-cb08-47a4-baae-90ea6cd557bb tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:51.735219 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-63b40df2-cb08-47a4-baae-90ea6cd557bb tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:51.735649 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-63b40df2-cb08-47a4-baae-90ea6cd557bb tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:51.839585 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-8fd6bd7d-534f-4dd1-8232-2ab2e8eb597b tempest-QuotaClassesAdminTestJSON-1470361391 tempest-QuotaClassesAdminTestJSON-1470361391-project-admin] 10.222.0.43 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 0.360904 Oct 04 18:48:51.840199 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2157/4062] 10.222.0.43 () {60 vars in 1206 bytes} [Tue Oct 4 18:48:51 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:48:51.854399 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-2dc274f9-fd1a-47bd-902f-27ce0709e19a tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:51.858362 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-2dc274f9-fd1a-47bd-902f-27ce0709e19a tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 287c44c9-e70d-4492-b4b6-35bee8011596] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:51.877974 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2dc274f9-fd1a-47bd-902f-27ce0709e19a tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:51.881158 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2dc274f9-fd1a-47bd-902f-27ce0709e19a tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:51.881620 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2dc274f9-fd1a-47bd-902f-27ce0709e19a tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:51.883885 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2dc274f9-fd1a-47bd-902f-27ce0709e19a tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:51.886414 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2dc274f9-fd1a-47bd-902f-27ce0709e19a tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:51.887938 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2dc274f9-fd1a-47bd-902f-27ce0709e19a tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:52.292313 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-2dc274f9-fd1a-47bd-902f-27ce0709e19a tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:52.303798 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-2dc274f9-fd1a-47bd-902f-27ce0709e19a tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/287c44c9-e70d-4492-b4b6-35bee8011596" status: 200 len: 1315 microversion: 2.1 time: 0.460284 Oct 04 18:48:52.318623 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2158/4063] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:51 2022] GET /compute/v2.1/servers/287c44c9-e70d-4492-b4b6-35bee8011596 => generated 1315 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:52.327755 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-e14ba9a3-b2d2-4537-9bd1-740c79f27ae5 tempest-QuotaClassesAdminTestJSON-1470361391 tempest-QuotaClassesAdminTestJSON-1470361391-project-admin] Calling method '.version_select at 0x7fb21e889dc0>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:52.346362 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-e14ba9a3-b2d2-4537-9bd1-740c79f27ae5 tempest-QuotaClassesAdminTestJSON-1470361391 tempest-QuotaClassesAdminTestJSON-1470361391-project-admin] 10.222.0.43 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.026219 Oct 04 18:48:52.347446 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2159/4064] 10.222.0.43 () {58 vars in 1185 bytes} [Tue Oct 4 18:48:52 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:48:52.368170 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-aeb07c04-b44d-44b3-bfa0-730aba2d9420 req-b891e1c9-ce30-45ed-a209-a4aa62fcfaf5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76d475ab-f41c-44df-8aaa-10242bdbfcde", "name": "network-vif-deleted", "tag": "6e1cef82-3551-4e96-9dfa-49e00c5fb483"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:48:52.384101 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-aeb07c04-b44d-44b3-bfa0-730aba2d9420 req-b891e1c9-ce30-45ed-a209-a4aa62fcfaf5 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:52.385326 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-aeb07c04-b44d-44b3-bfa0-730aba2d9420 req-b891e1c9-ce30-45ed-a209-a4aa62fcfaf5 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:52.385980 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-aeb07c04-b44d-44b3-bfa0-730aba2d9420 req-b891e1c9-ce30-45ed-a209-a4aa62fcfaf5 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:52.408713 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-aeb07c04-b44d-44b3-bfa0-730aba2d9420 req-b891e1c9-ce30-45ed-a209-a4aa62fcfaf5 service nova] Creating event network-vif-deleted:6e1cef82-3551-4e96-9dfa-49e00c5fb483 for instance 76d475ab-f41c-44df-8aaa-10242bdbfcde on n-h2-851028-13 Oct 04 18:48:52.417824 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-aeb07c04-b44d-44b3-bfa0-730aba2d9420 req-b891e1c9-ce30-45ed-a209-a4aa62fcfaf5 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068413 Oct 04 18:48:52.419463 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2160/4065] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:48:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:48:52.424361 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-63b40df2-cb08-47a4-baae-90ea6cd557bb tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14707008940e4965ab7d1190094a71bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8f94cf1c974654a336645f453c9efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:52.439538 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-63b40df2-cb08-47a4-baae-90ea6cd557bb tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] 10.222.0.43 "GET /compute/v2.1/servers/a080cb57-9980-493d-9049-28a0c4c03bdf" status: 200 len: 1293 microversion: 2.1 time: 0.750233 Oct 04 18:48:52.441216 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1906/4066] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:51 2022] GET /compute/v2.1/servers/a080cb57-9980-493d-9049-28a0c4c03bdf => generated 1293 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:52.445726 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-6e36aaa3-561a-4ec6-9492-c9cea6506c19 tempest-QuotaClassesAdminTestJSON-1470361391 tempest-QuotaClassesAdminTestJSON-1470361391-project-admin] Action: 'update', calling method: .version_select at 0x7fb21e8439d0>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:48:52.643021 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-6e36aaa3-561a-4ec6-9492-c9cea6506c19 tempest-QuotaClassesAdminTestJSON-1470361391 tempest-QuotaClassesAdminTestJSON-1470361391-project-admin] 10.222.0.43 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 0.207607 Oct 04 18:48:52.647779 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2161/4067] 10.222.0.43 () {60 vars in 1206 bytes} [Tue Oct 4 18:48:52 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:48:52.706047 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-f20dd213-5306-438f-a152-de06dec0440f tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:52.707146 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-f20dd213-5306-438f-a152-de06dec0440f tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] [instance: 76d475ab-f41c-44df-8aaa-10242bdbfcde] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:52.720598 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f20dd213-5306-438f-a152-de06dec0440f tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:52.722600 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f20dd213-5306-438f-a152-de06dec0440f tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:52.723992 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f20dd213-5306-438f-a152-de06dec0440f tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:52.725580 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f20dd213-5306-438f-a152-de06dec0440f tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:52.726881 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f20dd213-5306-438f-a152-de06dec0440f tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:52.729535 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f20dd213-5306-438f-a152-de06dec0440f tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:52.813381 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f20dd213-5306-438f-a152-de06dec0440f tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:52.814791 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f20dd213-5306-438f-a152-de06dec0440f tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:52.817309 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f20dd213-5306-438f-a152-de06dec0440f tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:52.818137 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.objects.instance [None req-f20dd213-5306-438f-a152-de06dec0440f tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lazy-loading 'fault' on Instance uuid 76d475ab-f41c-44df-8aaa-10242bdbfcde {{(pid=123595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:48:52.844601 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-0e92266d-e474-4e35-a9e7-3877c226fa6b req-7fc45790-a2f8-48a7-8881-c9423c997d73 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a080cb57-9980-493d-9049-28a0c4c03bdf", "tag": "ec0d6727-24d2-48b2-86cd-84d410c68d03"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:48:52.863844 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-0e92266d-e474-4e35-a9e7-3877c226fa6b req-7fc45790-a2f8-48a7-8881-c9423c997d73 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:52.864669 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-0e92266d-e474-4e35-a9e7-3877c226fa6b req-7fc45790-a2f8-48a7-8881-c9423c997d73 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:52.865537 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-0e92266d-e474-4e35-a9e7-3877c226fa6b req-7fc45790-a2f8-48a7-8881-c9423c997d73 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:52.890553 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-f20dd213-5306-438f-a152-de06dec0440f tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a116f2d9656548458264cc4fb1934c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff3c3dc76405401baf72fe00c5d50b56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:52.904322 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-f20dd213-5306-438f-a152-de06dec0440f tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] 10.222.0.43 "GET /compute/v2.1/servers/76d475ab-f41c-44df-8aaa-10242bdbfcde" status: 200 len: 1328 microversion: 2.1 time: 0.200511 Oct 04 18:48:52.904937 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1907/4068] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:52 2022] GET /compute/v2.1/servers/76d475ab-f41c-44df-8aaa-10242bdbfcde => generated 1328 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:52.923030 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-0e92266d-e474-4e35-a9e7-3877c226fa6b req-7fc45790-a2f8-48a7-8881-c9423c997d73 service nova] Creating event network-changed:ec0d6727-24d2-48b2-86cd-84d410c68d03 for instance a080cb57-9980-493d-9049-28a0c4c03bdf on n-h2-851028-13 Oct 04 18:48:52.929578 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-0e92266d-e474-4e35-a9e7-3877c226fa6b req-7fc45790-a2f8-48a7-8881-c9423c997d73 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088817 Oct 04 18:48:52.930746 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2162/4069] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:48:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:48:53.332418 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-7083b5d0-7500-4c8f-b463-2ef8734cea00 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:53.333391 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-7083b5d0-7500-4c8f-b463-2ef8734cea00 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 287c44c9-e70d-4492-b4b6-35bee8011596] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:53.341145 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7083b5d0-7500-4c8f-b463-2ef8734cea00 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:53.341971 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7083b5d0-7500-4c8f-b463-2ef8734cea00 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:53.342615 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7083b5d0-7500-4c8f-b463-2ef8734cea00 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:53.343546 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7083b5d0-7500-4c8f-b463-2ef8734cea00 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:53.344206 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7083b5d0-7500-4c8f-b463-2ef8734cea00 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:53.344841 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7083b5d0-7500-4c8f-b463-2ef8734cea00 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:53.464588 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=2 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:48:53.469993 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-52d7ac7f-c5d2-458e-8d38-751026d33006 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:53.471024 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-52d7ac7f-c5d2-458e-8d38-751026d33006 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] [instance: a080cb57-9980-493d-9049-28a0c4c03bdf] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:53.488653 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-52d7ac7f-c5d2-458e-8d38-751026d33006 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:53.489171 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-52d7ac7f-c5d2-458e-8d38-751026d33006 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:53.489626 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-52d7ac7f-c5d2-458e-8d38-751026d33006 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:53.493221 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-52d7ac7f-c5d2-458e-8d38-751026d33006 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:53.495678 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-52d7ac7f-c5d2-458e-8d38-751026d33006 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:53.496345 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-52d7ac7f-c5d2-458e-8d38-751026d33006 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:53.543913 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=2 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:48:53.574057 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-7083b5d0-7500-4c8f-b463-2ef8734cea00 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:53.588186 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-7083b5d0-7500-4c8f-b463-2ef8734cea00 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/287c44c9-e70d-4492-b4b6-35bee8011596" status: 200 len: 1315 microversion: 2.1 time: 0.259839 Oct 04 18:48:53.598073 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1908/4070] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:53 2022] GET /compute/v2.1/servers/287c44c9-e70d-4492-b4b6-35bee8011596 => generated 1315 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:53.753201 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-52d7ac7f-c5d2-458e-8d38-751026d33006 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14707008940e4965ab7d1190094a71bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8f94cf1c974654a336645f453c9efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:53.764077 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-52d7ac7f-c5d2-458e-8d38-751026d33006 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] 10.222.0.43 "GET /compute/v2.1/servers/a080cb57-9980-493d-9049-28a0c4c03bdf" status: 200 len: 1293 microversion: 2.1 time: 0.301248 Oct 04 18:48:53.768056 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2163/4071] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:53 2022] GET /compute/v2.1/servers/a080cb57-9980-493d-9049-28a0c4c03bdf => generated 1293 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:53.928338 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-8ceef5fe-b00d-405e-b860-a2750d3abe6b tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:53.930614 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-8ceef5fe-b00d-405e-b860-a2750d3abe6b tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] [instance: 76d475ab-f41c-44df-8aaa-10242bdbfcde] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:53.932610 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=6 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:48:53.941974 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8ceef5fe-b00d-405e-b860-a2750d3abe6b tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:53.946479 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8ceef5fe-b00d-405e-b860-a2750d3abe6b tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:53.949920 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8ceef5fe-b00d-405e-b860-a2750d3abe6b tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:53.952748 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8ceef5fe-b00d-405e-b860-a2750d3abe6b tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:53.953286 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8ceef5fe-b00d-405e-b860-a2750d3abe6b tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:53.953818 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8ceef5fe-b00d-405e-b860-a2750d3abe6b tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:54.019668 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-8ceef5fe-b00d-405e-b860-a2750d3abe6b tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] HTTP exception thrown: Instance 76d475ab-f41c-44df-8aaa-10242bdbfcde could not be found. Oct 04 18:48:54.022984 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-8ceef5fe-b00d-405e-b860-a2750d3abe6b tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Request method failure captured: Oct 04 18:48:54.022984 n-d-851028-13 devstack@n-api.service[123595]: request: GET /compute/v2.1/servers/76d475ab-f41c-44df-8aaa-10242bdbfcde HTTP/1.1 Oct 04 18:48:54.022984 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 18:48:54.022984 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 18:48:54.022984 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 18:48:54.022984 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 0 Oct 04 18:48:54.022984 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 18:48:54.022984 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 18:48:54.022984 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 18:48:54.022984 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 18:48:54.022984 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPH8lkGy0nZwltj3uDmeGQrZQwg6iRmriNLJ5vdTxYDzuDEs4JzrRDRI_AZvLAjZh5V6GRRv2aL1Ucq2iBU4yNUHCglEfTAOxdnVxtvedAn0I6kngigKmNkAB_2-EZ56jXiOuDwiOsK_AD_cvM52BvcLg72IQH_PTBSCnO4tX8aOV0qA Oct 04 18:48:54.022984 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 18:48:54.022984 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 18:48:54.022984 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 18:48:54.022984 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 18:48:54.022984 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 18:48:54.022984 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 18:48:54.022984 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: ff3c3dc76405401baf72fe00c5d50b56 Oct 04 18:48:54.022984 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-AttachVolumeTestJSON-517546326 Oct 04 18:48:54.022984 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 18:48:54.022984 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 18:48:54.022984 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/ff3c3dc76405401baf72fe00c5d50b56"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_ff3c3dc76405401baf72fe00c5d50b56"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ff3c3dc76405401baf72fe00c5d50b56"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ff3c3dc76405401baf72fe00c5d50b56"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:48:54.022984 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-AttachVolumeTestJSON-517546326 Oct 04 18:48:54.022984 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: ff3c3dc76405401baf72fe00c5d50b56 Oct 04 18:48:54.022984 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-AttachVolumeTestJSON-517546326 Oct 04 18:48:54.022984 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-AttachVolumeTestJSON-517546326-project Oct 04 18:48:54.022984 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 18:48:54.022984 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 18:48:54.022984 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: a116f2d9656548458264cc4fb1934c18 Oct 04 18:48:54.022984 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-AttachVolumeTestJSON-517546326-project Oct 04 18:48:54.022984 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 18:48:54.022984 n-d-851028-13 devstack@n-api.service[123595]: exception: Instance 76d475ab-f41c-44df-8aaa-10242bdbfcde could not be found. Oct 04 18:48:54.022984 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': '76d475ab-f41c-44df-8aaa-10242bdbfcde'} Oct 04 18:48:54.022984 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:48:54.022984 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:48:54.022984 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:48:54.022984 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:48:54.022984 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:48:54.022984 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:48:54.022984 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:48:54.022984 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:48:54.022984 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:48:54.022984 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:48:54.022984 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 76d475ab-f41c-44df-8aaa-10242bdbfcde could not be found. Oct 04 18:48:54.022984 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:48:54.022984 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:48:54.022984 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:48:54.022984 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:48:54.022984 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:48:54.022984 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:48:54.022984 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:48:54.022984 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:48:54.022984 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:48:54.022984 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:48:54.022984 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:48:54.022984 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:48:54.022984 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:48:54.022984 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:48:54.022984 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:48:54.022984 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:48:54.022984 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 76d475ab-f41c-44df-8aaa-10242bdbfcde could not be found. Oct 04 18:48:54.022984 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:48:54.022984 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:48:54.022984 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:48:54.029207 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:48:54.029207 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:48:54.029207 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:48:54.029207 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:48:54.029207 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:48:54.029207 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 76d475ab-f41c-44df-8aaa-10242bdbfcde could not be found. Oct 04 18:48:54.029207 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:48:54.029207 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-8ceef5fe-b00d-405e-b860-a2750d3abe6b tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Returning 404 to user: Instance 76d475ab-f41c-44df-8aaa-10242bdbfcde could not be found. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:48:54.029207 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-8ceef5fe-b00d-405e-b860-a2750d3abe6b tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] 10.222.0.43 "GET /compute/v2.1/servers/76d475ab-f41c-44df-8aaa-10242bdbfcde" status: 404 len: 111 microversion: 2.1 time: 0.100500 Oct 04 18:48:54.031509 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1909/4072] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:53 2022] GET /compute/v2.1/servers/76d475ab-f41c-44df-8aaa-10242bdbfcde => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:48:54.037464 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-6485f35b-5530-4741-b17b-2655c0630e88 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Calling method '.version_select at 0x7fb21e889280>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:54.093351 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-6485f35b-5530-4741-b17b-2655c0630e88 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1847053334" status: 202 len: 0 microversion: 2.1 time: 0.061346 Oct 04 18:48:54.096443 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2164/4073] 10.222.0.43 () {58 vars in 1221 bytes} [Tue Oct 4 18:48:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1847053334 => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:48:54.620410 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-7ec2053d-bc78-458c-b7f2-d899522c29e9 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:54.621024 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-7ec2053d-bc78-458c-b7f2-d899522c29e9 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 287c44c9-e70d-4492-b4b6-35bee8011596] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:54.649384 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7ec2053d-bc78-458c-b7f2-d899522c29e9 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:54.655211 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7ec2053d-bc78-458c-b7f2-d899522c29e9 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:54.657446 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7ec2053d-bc78-458c-b7f2-d899522c29e9 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:54.666426 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7ec2053d-bc78-458c-b7f2-d899522c29e9 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:54.667085 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7ec2053d-bc78-458c-b7f2-d899522c29e9 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:54.667552 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7ec2053d-bc78-458c-b7f2-d899522c29e9 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:54.793766 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-8c80b97a-dc51-4d13-8155-5aeb8a99cd0c tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:54.795544 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-8c80b97a-dc51-4d13-8155-5aeb8a99cd0c tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] [instance: a080cb57-9980-493d-9049-28a0c4c03bdf] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:54.806484 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8c80b97a-dc51-4d13-8155-5aeb8a99cd0c tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:54.808348 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8c80b97a-dc51-4d13-8155-5aeb8a99cd0c tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:54.809438 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8c80b97a-dc51-4d13-8155-5aeb8a99cd0c tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:54.811224 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8c80b97a-dc51-4d13-8155-5aeb8a99cd0c tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:54.811999 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8c80b97a-dc51-4d13-8155-5aeb8a99cd0c tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:54.812784 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8c80b97a-dc51-4d13-8155-5aeb8a99cd0c tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:55.048565 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-8c80b97a-dc51-4d13-8155-5aeb8a99cd0c tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14707008940e4965ab7d1190094a71bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8f94cf1c974654a336645f453c9efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:55.061077 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-8c80b97a-dc51-4d13-8155-5aeb8a99cd0c tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] 10.222.0.43 "GET /compute/v2.1/servers/a080cb57-9980-493d-9049-28a0c4c03bdf" status: 200 len: 1293 microversion: 2.1 time: 0.274747 Oct 04 18:48:55.075597 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2165/4074] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:54 2022] GET /compute/v2.1/servers/a080cb57-9980-493d-9049-28a0c4c03bdf => generated 1293 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:48:55.200826 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-7ec2053d-bc78-458c-b7f2-d899522c29e9 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:55.237165 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-7ec2053d-bc78-458c-b7f2-d899522c29e9 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/287c44c9-e70d-4492-b4b6-35bee8011596" status: 200 len: 1315 microversion: 2.1 time: 0.616098 Oct 04 18:48:55.253822 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1910/4075] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:54 2022] GET /compute/v2.1/servers/287c44c9-e70d-4492-b4b6-35bee8011596 => generated 1315 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:55.847361 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-fb3d4a05-b78d-4b8f-b01a-935e8a0ba1c0 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Action: 'create', calling method: .version_select at 0x7fb21e8434c0>, body: {"keypair": {"name": "tempest-keypair-1836012412", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPRw4aKpC5hakj+ckFmVCAZsoCORXeLOK8wrDVfHNtzufin2HhJ5f87Ux2P/cty7MjiSddU4kwbvPLnqVc9WK6KdW3UfJ0wQPumWmx6N/pe2N8WFqYiJHHzCshJx3gK6tg=="}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:48:55.865908 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-fb3d4a05-b78d-4b8f-b01a-935e8a0ba1c0 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Getting quotas for project ff3c3dc76405401baf72fe00c5d50b56. Resources: {'key_pairs'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:48:55.874549 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-fb3d4a05-b78d-4b8f-b01a-935e8a0ba1c0 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Getting quotas for user a116f2d9656548458264cc4fb1934c18 and project ff3c3dc76405401baf72fe00c5d50b56. Resources: {'key_pairs'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:48:55.904096 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-fb3d4a05-b78d-4b8f-b01a-935e8a0ba1c0 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.062544 Oct 04 18:48:55.905206 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2166/4076] 10.222.0.43 () {60 vars in 1159 bytes} [Tue Oct 4 18:48:55 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:48:56.086863 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-d7d8d8e5-e614-4051-87a9-15128df5de21 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:56.087578 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-d7d8d8e5-e614-4051-87a9-15128df5de21 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] [instance: a080cb57-9980-493d-9049-28a0c4c03bdf] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:56.106066 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=4 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:48:56.116280 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d7d8d8e5-e614-4051-87a9-15128df5de21 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:56.119720 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d7d8d8e5-e614-4051-87a9-15128df5de21 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:56.119720 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d7d8d8e5-e614-4051-87a9-15128df5de21 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:56.121956 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d7d8d8e5-e614-4051-87a9-15128df5de21 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:56.122489 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d7d8d8e5-e614-4051-87a9-15128df5de21 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:56.122923 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d7d8d8e5-e614-4051-87a9-15128df5de21 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:56.280556 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-71ef3465-1f1b-43a3-93ab-160a49887bd3 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:56.281525 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-71ef3465-1f1b-43a3-93ab-160a49887bd3 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 287c44c9-e70d-4492-b4b6-35bee8011596] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:56.291445 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-71ef3465-1f1b-43a3-93ab-160a49887bd3 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:56.292890 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-71ef3465-1f1b-43a3-93ab-160a49887bd3 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:56.293741 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-71ef3465-1f1b-43a3-93ab-160a49887bd3 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:56.295111 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-71ef3465-1f1b-43a3-93ab-160a49887bd3 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:56.296625 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-71ef3465-1f1b-43a3-93ab-160a49887bd3 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:56.297464 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-71ef3465-1f1b-43a3-93ab-160a49887bd3 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:56.332041 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-d7d8d8e5-e614-4051-87a9-15128df5de21 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14707008940e4965ab7d1190094a71bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8f94cf1c974654a336645f453c9efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:56.339965 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-d7d8d8e5-e614-4051-87a9-15128df5de21 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] 10.222.0.43 "GET /compute/v2.1/servers/a080cb57-9980-493d-9049-28a0c4c03bdf" status: 200 len: 1293 microversion: 2.1 time: 0.257501 Oct 04 18:48:56.340554 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1911/4077] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:56 2022] GET /compute/v2.1/servers/a080cb57-9980-493d-9049-28a0c4c03bdf => generated 1293 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:56.506998 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-71ef3465-1f1b-43a3-93ab-160a49887bd3 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:56.521026 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-71ef3465-1f1b-43a3-93ab-160a49887bd3 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/287c44c9-e70d-4492-b4b6-35bee8011596" status: 200 len: 1315 microversion: 2.1 time: 0.246677 Oct 04 18:48:56.522073 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2167/4078] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:56 2022] GET /compute/v2.1/servers/287c44c9-e70d-4492-b4b6-35bee8011596 => generated 1315 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:57.365160 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-51e920a6-b5d7-4b88-941f-6caf63ce4492 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:57.365772 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-51e920a6-b5d7-4b88-941f-6caf63ce4492 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] [instance: a080cb57-9980-493d-9049-28a0c4c03bdf] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:57.381236 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-51e920a6-b5d7-4b88-941f-6caf63ce4492 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:57.381745 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-51e920a6-b5d7-4b88-941f-6caf63ce4492 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:57.382190 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-51e920a6-b5d7-4b88-941f-6caf63ce4492 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:57.383265 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-51e920a6-b5d7-4b88-941f-6caf63ce4492 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:57.384267 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-51e920a6-b5d7-4b88-941f-6caf63ce4492 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:57.384706 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-51e920a6-b5d7-4b88-941f-6caf63ce4492 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:57.546870 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-515fb3f6-4b72-4f6c-8420-0af7fb05d27a tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:57.548647 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-515fb3f6-4b72-4f6c-8420-0af7fb05d27a tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 287c44c9-e70d-4492-b4b6-35bee8011596] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:57.564228 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-515fb3f6-4b72-4f6c-8420-0af7fb05d27a tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:57.564945 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-515fb3f6-4b72-4f6c-8420-0af7fb05d27a tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:57.565509 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-515fb3f6-4b72-4f6c-8420-0af7fb05d27a tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:57.566308 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-515fb3f6-4b72-4f6c-8420-0af7fb05d27a tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:57.567410 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-515fb3f6-4b72-4f6c-8420-0af7fb05d27a tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:57.568087 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-515fb3f6-4b72-4f6c-8420-0af7fb05d27a tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:57.692822 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-51e920a6-b5d7-4b88-941f-6caf63ce4492 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14707008940e4965ab7d1190094a71bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8f94cf1c974654a336645f453c9efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:57.701573 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-51e920a6-b5d7-4b88-941f-6caf63ce4492 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] 10.222.0.43 "GET /compute/v2.1/servers/a080cb57-9980-493d-9049-28a0c4c03bdf" status: 200 len: 1293 microversion: 2.1 time: 0.340133 Oct 04 18:48:57.709413 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1912/4079] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:57 2022] GET /compute/v2.1/servers/a080cb57-9980-493d-9049-28a0c4c03bdf => generated 1293 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:57.715092 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-25ffd069-1670-4a25-b042-84bf0206b70b req-65ba6355-9717-4be3-a68d-3fc95abd4413 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "287c44c9-e70d-4492-b4b6-35bee8011596", "name": "network-vif-plugged", "status": "completed", "tag": "37fe4acb-5d41-4bcb-9278-e11389be7c1d"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:48:57.737550 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-25ffd069-1670-4a25-b042-84bf0206b70b req-65ba6355-9717-4be3-a68d-3fc95abd4413 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:57.741666 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-25ffd069-1670-4a25-b042-84bf0206b70b req-65ba6355-9717-4be3-a68d-3fc95abd4413 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:57.742194 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-25ffd069-1670-4a25-b042-84bf0206b70b req-65ba6355-9717-4be3-a68d-3fc95abd4413 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:57.771782 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-25ffd069-1670-4a25-b042-84bf0206b70b req-65ba6355-9717-4be3-a68d-3fc95abd4413 service nova] Creating event network-vif-plugged:37fe4acb-5d41-4bcb-9278-e11389be7c1d for instance 287c44c9-e70d-4492-b4b6-35bee8011596 on n-h2-851028-13 Oct 04 18:48:57.785200 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-25ffd069-1670-4a25-b042-84bf0206b70b req-65ba6355-9717-4be3-a68d-3fc95abd4413 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073946 Oct 04 18:48:57.786521 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1913/4080] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:48:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:48:57.924523 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-515fb3f6-4b72-4f6c-8420-0af7fb05d27a tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:57.933251 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-515fb3f6-4b72-4f6c-8420-0af7fb05d27a tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/287c44c9-e70d-4492-b4b6-35bee8011596" status: 200 len: 1315 microversion: 2.1 time: 0.392634 Oct 04 18:48:57.933853 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2168/4081] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:57 2022] GET /compute/v2.1/servers/287c44c9-e70d-4492-b4b6-35bee8011596 => generated 1315 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:48:58.523612 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-57e3d7dc-2c95-4828-98b1-1b5983282e36 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-231598372", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "24a7c972-666b-4964-a95c-3716199da34e"}], "security_groups": [{"name": "tempest-securitygroup--2140145489"}], "key_name": "tempest-keypair-1836012412", "user_data": "}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:48:58.688154 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.network.neutron [None req-57e3d7dc-2c95-4828-98b1-1b5983282e36 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] validate_networks() for [('24a7c972-666b-4964-a95c-3716199da34e', None, None, None, None, None)] {{(pid=123595) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:48:58.727169 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-787c1cdb-55ae-447b-976b-380c256c2ae3 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:58.728634 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-787c1cdb-55ae-447b-976b-380c256c2ae3 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] [instance: a080cb57-9980-493d-9049-28a0c4c03bdf] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:58.735616 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-787c1cdb-55ae-447b-976b-380c256c2ae3 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:58.736403 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-787c1cdb-55ae-447b-976b-380c256c2ae3 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:58.737033 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-787c1cdb-55ae-447b-976b-380c256c2ae3 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:58.737750 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-787c1cdb-55ae-447b-976b-380c256c2ae3 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:58.738543 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-787c1cdb-55ae-447b-976b-380c256c2ae3 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:58.739161 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-787c1cdb-55ae-447b-976b-380c256c2ae3 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:58.889823 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-787c1cdb-55ae-447b-976b-380c256c2ae3 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14707008940e4965ab7d1190094a71bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8f94cf1c974654a336645f453c9efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:58.900368 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-787c1cdb-55ae-447b-976b-380c256c2ae3 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] 10.222.0.43 "GET /compute/v2.1/servers/a080cb57-9980-493d-9049-28a0c4c03bdf" status: 200 len: 1293 microversion: 2.1 time: 0.176335 Oct 04 18:48:58.914842 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2169/4082] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:58 2022] GET /compute/v2.1/servers/a080cb57-9980-493d-9049-28a0c4c03bdf => generated 1293 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:48:58.965667 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-4513f5fa-7fed-4236-99ff-0b4472f44783 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:58.966721 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-4513f5fa-7fed-4236-99ff-0b4472f44783 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 287c44c9-e70d-4492-b4b6-35bee8011596] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:58.987557 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4513f5fa-7fed-4236-99ff-0b4472f44783 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:58.988448 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4513f5fa-7fed-4236-99ff-0b4472f44783 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:58.991757 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4513f5fa-7fed-4236-99ff-0b4472f44783 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:58.993080 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4513f5fa-7fed-4236-99ff-0b4472f44783 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:58.994006 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4513f5fa-7fed-4236-99ff-0b4472f44783 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:58.994795 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4513f5fa-7fed-4236-99ff-0b4472f44783 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:59.018457 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:48:59.325182 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-57e3d7dc-2c95-4828-98b1-1b5983282e36 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Flavor limits 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:48:59.326255 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-57e3d7dc-2c95-4828-98b1-1b5983282e36 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Image limits 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:48:59.327053 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-57e3d7dc-2c95-4828-98b1-1b5983282e36 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Flavor pref 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:48:59.327694 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-57e3d7dc-2c95-4828-98b1-1b5983282e36 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Image pref 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:48:59.328835 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-57e3d7dc-2c95-4828-98b1-1b5983282e36 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:48:59.329683 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-4513f5fa-7fed-4236-99ff-0b4472f44783 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:59.345355 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-4513f5fa-7fed-4236-99ff-0b4472f44783 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/287c44c9-e70d-4492-b4b6-35bee8011596" status: 200 len: 1315 microversion: 2.1 time: 0.388747 Oct 04 18:48:59.347190 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-57e3d7dc-2c95-4828-98b1-1b5983282e36 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:59.348168 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-57e3d7dc-2c95-4828-98b1-1b5983282e36 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:59.348811 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-57e3d7dc-2c95-4828-98b1-1b5983282e36 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:59.350358 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-57e3d7dc-2c95-4828-98b1-1b5983282e36 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:59.351020 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-57e3d7dc-2c95-4828-98b1-1b5983282e36 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:59.351633 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-57e3d7dc-2c95-4828-98b1-1b5983282e36 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:59.361669 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2170/4083] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:58 2022] GET /compute/v2.1/servers/287c44c9-e70d-4492-b4b6-35bee8011596 => generated 1315 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:59.381948 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-57e3d7dc-2c95-4828-98b1-1b5983282e36 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Getting quotas for project ff3c3dc76405401baf72fe00c5d50b56. Resources: {'ram', 'cores', 'instances'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:48:59.388428 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-57e3d7dc-2c95-4828-98b1-1b5983282e36 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Getting quotas for user a116f2d9656548458264cc4fb1934c18 and project ff3c3dc76405401baf72fe00c5d50b56. Resources: {'ram', 'cores', 'instances'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:48:59.409354 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-57e3d7dc-2c95-4828-98b1-1b5983282e36 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Going to run 1 instances... {{(pid=123595) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:48:59.411904 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-57e3d7dc-2c95-4828-98b1-1b5983282e36 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] [instance: f2269817-3e15-4cfe-8446-7eb0104f9800] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e8943ec5-4038-4d4b-b9b9-2415a79f5243',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:48:59.465390 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-57e3d7dc-2c95-4828-98b1-1b5983282e36 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.949564 Oct 04 18:48:59.466664 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1914/4084] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 18:48:58 2022] POST /compute/v2.1/servers => generated 402 bytes in 952 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 18:48:59.482554 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-ef0a0ec2-a80f-41ed-9a41-d60b70f39825 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:59.484299 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-ef0a0ec2-a80f-41ed-9a41-d60b70f39825 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] [instance: f2269817-3e15-4cfe-8446-7eb0104f9800] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:59.546061 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-ef0a0ec2-a80f-41ed-9a41-d60b70f39825 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a116f2d9656548458264cc4fb1934c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff3c3dc76405401baf72fe00c5d50b56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:59.555159 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-ef0a0ec2-a80f-41ed-9a41-d60b70f39825 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] 10.222.0.43 "GET /compute/v2.1/servers/f2269817-3e15-4cfe-8446-7eb0104f9800" status: 200 len: 1237 microversion: 2.1 time: 0.076055 Oct 04 18:48:59.556408 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2171/4085] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:59 2022] GET /compute/v2.1/servers/f2269817-3e15-4cfe-8446-7eb0104f9800 => generated 1237 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:59.816657 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-d7ad78f0-61a3-49ba-b9a6-a160bee9adbb req-f8360cad-61d6-48bb-9747-a4d6b402af23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a080cb57-9980-493d-9049-28a0c4c03bdf", "name": "network-vif-plugged", "status": "completed", "tag": "ec0d6727-24d2-48b2-86cd-84d410c68d03"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:48:59.841546 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-d7ad78f0-61a3-49ba-b9a6-a160bee9adbb req-f8360cad-61d6-48bb-9747-a4d6b402af23 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:59.842423 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-d7ad78f0-61a3-49ba-b9a6-a160bee9adbb req-f8360cad-61d6-48bb-9747-a4d6b402af23 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:59.843140 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-d7ad78f0-61a3-49ba-b9a6-a160bee9adbb req-f8360cad-61d6-48bb-9747-a4d6b402af23 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:59.858707 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-d7ad78f0-61a3-49ba-b9a6-a160bee9adbb req-f8360cad-61d6-48bb-9747-a4d6b402af23 service nova] Creating event network-vif-plugged:ec0d6727-24d2-48b2-86cd-84d410c68d03 for instance a080cb57-9980-493d-9049-28a0c4c03bdf on n-h2-851028-13 Oct 04 18:48:59.865085 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-d7ad78f0-61a3-49ba-b9a6-a160bee9adbb req-f8360cad-61d6-48bb-9747-a4d6b402af23 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062914 Oct 04 18:48:59.866238 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1915/4086] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:48:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:48:59.932480 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-54695455-03fa-4d44-bac9-e59bf8f039b0 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:59.934682 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-54695455-03fa-4d44-bac9-e59bf8f039b0 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] [instance: a080cb57-9980-493d-9049-28a0c4c03bdf] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:59.944360 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-54695455-03fa-4d44-bac9-e59bf8f039b0 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:59.944834 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-54695455-03fa-4d44-bac9-e59bf8f039b0 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:59.945550 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-54695455-03fa-4d44-bac9-e59bf8f039b0 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:59.998412 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-54695455-03fa-4d44-bac9-e59bf8f039b0 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:59.998412 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-54695455-03fa-4d44-bac9-e59bf8f039b0 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:59.998412 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-54695455-03fa-4d44-bac9-e59bf8f039b0 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:00.190488 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-54695455-03fa-4d44-bac9-e59bf8f039b0 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14707008940e4965ab7d1190094a71bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8f94cf1c974654a336645f453c9efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:00.201269 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-54695455-03fa-4d44-bac9-e59bf8f039b0 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] 10.222.0.43 "GET /compute/v2.1/servers/a080cb57-9980-493d-9049-28a0c4c03bdf" status: 200 len: 1293 microversion: 2.1 time: 0.278255 Oct 04 18:49:00.202545 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2172/4087] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:59 2022] GET /compute/v2.1/servers/a080cb57-9980-493d-9049-28a0c4c03bdf => generated 1293 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:00.387374 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-cdaf1161-7ba7-4eca-8115-826093e5be8a tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:00.388244 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-cdaf1161-7ba7-4eca-8115-826093e5be8a tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 287c44c9-e70d-4492-b4b6-35bee8011596] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:00.397220 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cdaf1161-7ba7-4eca-8115-826093e5be8a tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:00.397932 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cdaf1161-7ba7-4eca-8115-826093e5be8a tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:00.398505 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cdaf1161-7ba7-4eca-8115-826093e5be8a tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:00.399350 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cdaf1161-7ba7-4eca-8115-826093e5be8a tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:00.400231 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cdaf1161-7ba7-4eca-8115-826093e5be8a tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:00.400817 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cdaf1161-7ba7-4eca-8115-826093e5be8a tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:00.589403 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-cdaf1161-7ba7-4eca-8115-826093e5be8a tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:00.600281 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-cdaf1161-7ba7-4eca-8115-826093e5be8a tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/287c44c9-e70d-4492-b4b6-35bee8011596" status: 200 len: 1502 microversion: 2.1 time: 0.218807 Oct 04 18:49:00.602721 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1916/4088] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:00 2022] GET /compute/v2.1/servers/287c44c9-e70d-4492-b4b6-35bee8011596 => generated 1502 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:00.614255 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-eb81c44e-2790-464e-9415-4662a3adf611 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:00.614896 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-eb81c44e-2790-464e-9415-4662a3adf611 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] [instance: f2269817-3e15-4cfe-8446-7eb0104f9800] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:00.622651 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-eb81c44e-2790-464e-9415-4662a3adf611 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:00.623700 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-eb81c44e-2790-464e-9415-4662a3adf611 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:00.624150 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-eb81c44e-2790-464e-9415-4662a3adf611 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:00.624867 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-eb81c44e-2790-464e-9415-4662a3adf611 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:00.625361 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-eb81c44e-2790-464e-9415-4662a3adf611 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:00.625795 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-eb81c44e-2790-464e-9415-4662a3adf611 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:00.630071 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-3237d651-d220-43d5-bf23-e92401bf378b tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:49:00.630797 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-3237d651-d220-43d5-bf23-e92401bf378b tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 287c44c9-e70d-4492-b4b6-35bee8011596] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:00.640099 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3237d651-d220-43d5-bf23-e92401bf378b tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:00.640806 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3237d651-d220-43d5-bf23-e92401bf378b tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:00.641989 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3237d651-d220-43d5-bf23-e92401bf378b tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:00.642778 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3237d651-d220-43d5-bf23-e92401bf378b tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:00.643454 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3237d651-d220-43d5-bf23-e92401bf378b tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:00.644304 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3237d651-d220-43d5-bf23-e92401bf378b tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:00.719771 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-eb81c44e-2790-464e-9415-4662a3adf611 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a116f2d9656548458264cc4fb1934c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff3c3dc76405401baf72fe00c5d50b56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:00.729719 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-eb81c44e-2790-464e-9415-4662a3adf611 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] 10.222.0.43 "GET /compute/v2.1/servers/f2269817-3e15-4cfe-8446-7eb0104f9800" status: 200 len: 1289 microversion: 2.1 time: 0.119661 Oct 04 18:49:00.732178 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2173/4089] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:00 2022] GET /compute/v2.1/servers/f2269817-3e15-4cfe-8446-7eb0104f9800 => generated 1289 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:00.754184 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-3237d651-d220-43d5-bf23-e92401bf378b tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "POST /compute/v2.1/servers/287c44c9-e70d-4492-b4b6-35bee8011596/action" status: 202 len: 0 microversion: 2.1 time: 0.133147 Oct 04 18:49:00.755427 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1917/4090] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 18:49:00 2022] POST /compute/v2.1/servers/287c44c9-e70d-4492-b4b6-35bee8011596/action => generated 0 bytes in 135 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:49:00.763543 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f75c4c62-97ca-4bdd-8757-fb9da3cc6a24 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:00.764674 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-f75c4c62-97ca-4bdd-8757-fb9da3cc6a24 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 287c44c9-e70d-4492-b4b6-35bee8011596] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:00.768053 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=5,nova_api:UPDATE=19,nova_api:DELETE=1 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:49:00.773277 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f75c4c62-97ca-4bdd-8757-fb9da3cc6a24 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:00.774036 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f75c4c62-97ca-4bdd-8757-fb9da3cc6a24 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:00.774616 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f75c4c62-97ca-4bdd-8757-fb9da3cc6a24 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:00.776008 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f75c4c62-97ca-4bdd-8757-fb9da3cc6a24 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:00.776601 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f75c4c62-97ca-4bdd-8757-fb9da3cc6a24 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:00.777190 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f75c4c62-97ca-4bdd-8757-fb9da3cc6a24 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:00.973705 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-f75c4c62-97ca-4bdd-8757-fb9da3cc6a24 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:00.984756 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-f75c4c62-97ca-4bdd-8757-fb9da3cc6a24 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/287c44c9-e70d-4492-b4b6-35bee8011596" status: 200 len: 1507 microversion: 2.1 time: 0.223864 Oct 04 18:49:00.986243 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2174/4091] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:00 2022] GET /compute/v2.1/servers/287c44c9-e70d-4492-b4b6-35bee8011596 => generated 1507 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:01.227387 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-35400aba-a324-4452-b71c-5ebfb86cdc7b tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:01.229197 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-35400aba-a324-4452-b71c-5ebfb86cdc7b tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] [instance: a080cb57-9980-493d-9049-28a0c4c03bdf] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:01.243627 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-35400aba-a324-4452-b71c-5ebfb86cdc7b tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:01.246381 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-35400aba-a324-4452-b71c-5ebfb86cdc7b tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:01.246969 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-35400aba-a324-4452-b71c-5ebfb86cdc7b tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:01.248398 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-35400aba-a324-4452-b71c-5ebfb86cdc7b tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:01.251546 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-35400aba-a324-4452-b71c-5ebfb86cdc7b tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:01.252090 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-35400aba-a324-4452-b71c-5ebfb86cdc7b tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:01.397186 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-400efe1b-2e44-4b4b-becd-31b80bad49fd tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-1974892024", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452"}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:49:01.491016 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.network.neutron [None req-400efe1b-2e44-4b4b-becd-31b80bad49fd tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] validate_networks() for None {{(pid=123595) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:49:01.776149 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-400efe1b-2e44-4b4b-becd-31b80bad49fd tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] Flavor limits 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:49:01.776799 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-400efe1b-2e44-4b4b-becd-31b80bad49fd tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] Image limits 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:49:01.777673 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-400efe1b-2e44-4b4b-becd-31b80bad49fd tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] Flavor pref 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:49:01.778440 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-400efe1b-2e44-4b4b-becd-31b80bad49fd tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] Image pref 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:49:01.779303 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-400efe1b-2e44-4b4b-becd-31b80bad49fd tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:49:01.793259 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-400efe1b-2e44-4b4b-becd-31b80bad49fd tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:01.794012 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-400efe1b-2e44-4b4b-becd-31b80bad49fd tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:01.794802 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-400efe1b-2e44-4b4b-becd-31b80bad49fd tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:01.795989 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-400efe1b-2e44-4b4b-becd-31b80bad49fd tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:01.796599 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-400efe1b-2e44-4b4b-becd-31b80bad49fd tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:01.797217 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-400efe1b-2e44-4b4b-becd-31b80bad49fd tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:01.821598 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-400efe1b-2e44-4b4b-becd-31b80bad49fd tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] Getting quotas for project 45a659496a484115910b123ad9a57144. Resources: {'ram', 'cores', 'instances'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:49:01.832356 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-400efe1b-2e44-4b4b-becd-31b80bad49fd tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] Getting quotas for user e8b4654e49c9435ea151487362174118 and project 45a659496a484115910b123ad9a57144. Resources: {'ram', 'cores', 'instances'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:49:01.860443 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-400efe1b-2e44-4b4b-becd-31b80bad49fd tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] Going to run 1 instances... {{(pid=123595) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:49:01.864507 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-400efe1b-2e44-4b4b-becd-31b80bad49fd tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] [instance: 5dbc7ef7-31da-4c7c-a906-d5a84833f77e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e8943ec5-4038-4d4b-b9b9-2415a79f5243',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:49:01.864937 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-35400aba-a324-4452-b71c-5ebfb86cdc7b tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14707008940e4965ab7d1190094a71bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8f94cf1c974654a336645f453c9efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:01.872948 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-35400aba-a324-4452-b71c-5ebfb86cdc7b tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] 10.222.0.43 "GET /compute/v2.1/servers/a080cb57-9980-493d-9049-28a0c4c03bdf" status: 200 len: 1293 microversion: 2.1 time: 0.651899 Oct 04 18:49:01.873586 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2175/4092] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:01 2022] GET /compute/v2.1/servers/a080cb57-9980-493d-9049-28a0c4c03bdf => generated 1293 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:01.883112 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-1697fede-7109-4fe5-9b97-67dbfeb3dc7b tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:01.883939 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-1697fede-7109-4fe5-9b97-67dbfeb3dc7b tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] [instance: f2269817-3e15-4cfe-8446-7eb0104f9800] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:01.898274 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1697fede-7109-4fe5-9b97-67dbfeb3dc7b tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:01.902777 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1697fede-7109-4fe5-9b97-67dbfeb3dc7b tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:01.906911 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1697fede-7109-4fe5-9b97-67dbfeb3dc7b tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:01.907892 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1697fede-7109-4fe5-9b97-67dbfeb3dc7b tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:01.912185 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1697fede-7109-4fe5-9b97-67dbfeb3dc7b tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:01.912886 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1697fede-7109-4fe5-9b97-67dbfeb3dc7b tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:01.930321 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-400efe1b-2e44-4b4b-becd-31b80bad49fd tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.892503 Oct 04 18:49:01.938747 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1918/4093] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 18:49:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 902 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:49:01.943893 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-1d912bca-77c4-4083-a345-0ab13fc9d152 tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:01.944856 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-1d912bca-77c4-4083-a345-0ab13fc9d152 tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] [instance: 5dbc7ef7-31da-4c7c-a906-d5a84833f77e] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:02.031627 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-1697fede-7109-4fe5-9b97-67dbfeb3dc7b tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a116f2d9656548458264cc4fb1934c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff3c3dc76405401baf72fe00c5d50b56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:02.039866 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-1697fede-7109-4fe5-9b97-67dbfeb3dc7b tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] 10.222.0.43 "GET /compute/v2.1/servers/f2269817-3e15-4cfe-8446-7eb0104f9800" status: 200 len: 1295 microversion: 2.1 time: 0.160856 Oct 04 18:49:02.040509 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2176/4094] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:01 2022] GET /compute/v2.1/servers/f2269817-3e15-4cfe-8446-7eb0104f9800 => generated 1295 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:02.054691 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-ea325b9b-0041-4fec-8f05-1e67f800c20a tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:02.065105 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-ea325b9b-0041-4fec-8f05-1e67f800c20a tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 287c44c9-e70d-4492-b4b6-35bee8011596] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:02.068935 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-1d912bca-77c4-4083-a345-0ab13fc9d152 tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b4654e49c9435ea151487362174118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a659496a484115910b123ad9a57144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:02.072242 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ea325b9b-0041-4fec-8f05-1e67f800c20a tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:02.073184 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ea325b9b-0041-4fec-8f05-1e67f800c20a tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:02.074014 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ea325b9b-0041-4fec-8f05-1e67f800c20a tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:02.074991 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ea325b9b-0041-4fec-8f05-1e67f800c20a tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:02.075608 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ea325b9b-0041-4fec-8f05-1e67f800c20a tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:02.076220 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ea325b9b-0041-4fec-8f05-1e67f800c20a tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:02.080092 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-1d912bca-77c4-4083-a345-0ab13fc9d152 tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] 10.222.0.43 "GET /compute/v2.1/servers/5dbc7ef7-31da-4c7c-a906-d5a84833f77e" status: 200 len: 1223 microversion: 2.1 time: 0.139890 Oct 04 18:49:02.081625 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1919/4095] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:01 2022] GET /compute/v2.1/servers/5dbc7ef7-31da-4c7c-a906-d5a84833f77e => generated 1223 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:02.425976 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-ea325b9b-0041-4fec-8f05-1e67f800c20a tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:02.438391 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-ea325b9b-0041-4fec-8f05-1e67f800c20a tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/287c44c9-e70d-4492-b4b6-35bee8011596" status: 200 len: 1487 microversion: 2.1 time: 0.396656 Oct 04 18:49:02.439144 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2177/4096] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:02 2022] GET /compute/v2.1/servers/287c44c9-e70d-4492-b4b6-35bee8011596 => generated 1487 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:02.470512 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-5aff39fa-acd8-48c3-bd66-cda68cd537de tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:49:02.471264 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-5aff39fa-acd8-48c3-bd66-cda68cd537de tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 287c44c9-e70d-4492-b4b6-35bee8011596] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:02.481729 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5aff39fa-acd8-48c3-bd66-cda68cd537de tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:02.483198 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5aff39fa-acd8-48c3-bd66-cda68cd537de tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:02.487682 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5aff39fa-acd8-48c3-bd66-cda68cd537de tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:02.488890 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5aff39fa-acd8-48c3-bd66-cda68cd537de tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:02.489565 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5aff39fa-acd8-48c3-bd66-cda68cd537de tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:02.490400 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5aff39fa-acd8-48c3-bd66-cda68cd537de tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:02.532096 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.objects.instance [None req-5aff39fa-acd8-48c3-bd66-cda68cd537de tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lazy-loading 'flavor' on Instance uuid 287c44c9-e70d-4492-b4b6-35bee8011596 {{(pid=123595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:49:02.636653 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:49:02.847755 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-5aff39fa-acd8-48c3-bd66-cda68cd537de tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "POST /compute/v2.1/servers/287c44c9-e70d-4492-b4b6-35bee8011596/action" status: 202 len: 0 microversion: 2.1 time: 0.380650 Oct 04 18:49:02.848244 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1920/4097] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 18:49:02 2022] POST /compute/v2.1/servers/287c44c9-e70d-4492-b4b6-35bee8011596/action => generated 0 bytes in 382 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:49:02.860407 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f313a14d-4be8-498f-adde-808bae58f8d1 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:02.861668 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-f313a14d-4be8-498f-adde-808bae58f8d1 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 287c44c9-e70d-4492-b4b6-35bee8011596] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:02.874145 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f313a14d-4be8-498f-adde-808bae58f8d1 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:02.874409 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f313a14d-4be8-498f-adde-808bae58f8d1 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:02.875610 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f313a14d-4be8-498f-adde-808bae58f8d1 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:02.877064 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f313a14d-4be8-498f-adde-808bae58f8d1 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:02.877846 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f313a14d-4be8-498f-adde-808bae58f8d1 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:02.878768 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f313a14d-4be8-498f-adde-808bae58f8d1 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:02.901618 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-a8d10ff5-cf1a-411d-b376-a37e6226cedd tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:02.903491 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-a8d10ff5-cf1a-411d-b376-a37e6226cedd tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] [instance: a080cb57-9980-493d-9049-28a0c4c03bdf] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:02.924951 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a8d10ff5-cf1a-411d-b376-a37e6226cedd tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:02.932756 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a8d10ff5-cf1a-411d-b376-a37e6226cedd tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:02.934094 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a8d10ff5-cf1a-411d-b376-a37e6226cedd tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:02.935379 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a8d10ff5-cf1a-411d-b376-a37e6226cedd tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:02.938637 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a8d10ff5-cf1a-411d-b376-a37e6226cedd tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:02.939931 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a8d10ff5-cf1a-411d-b376-a37e6226cedd tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:03.259292 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-a8d10ff5-cf1a-411d-b376-a37e6226cedd tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14707008940e4965ab7d1190094a71bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8f94cf1c974654a336645f453c9efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:03.271782 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-a8d10ff5-cf1a-411d-b376-a37e6226cedd tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] 10.222.0.43 "GET /compute/v2.1/servers/a080cb57-9980-493d-9049-28a0c4c03bdf" status: 200 len: 1474 microversion: 2.1 time: 0.375734 Oct 04 18:49:03.285231 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1921/4098] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:02 2022] GET /compute/v2.1/servers/a080cb57-9980-493d-9049-28a0c4c03bdf => generated 1474 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:49:03.285231 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-2954dc05-e364-469d-9abe-b4073c5eeeb8 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:03.285231 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-2954dc05-e364-469d-9abe-b4073c5eeeb8 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] [instance: f2269817-3e15-4cfe-8446-7eb0104f9800] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:03.301139 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2954dc05-e364-469d-9abe-b4073c5eeeb8 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:03.301139 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2954dc05-e364-469d-9abe-b4073c5eeeb8 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:03.301139 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2954dc05-e364-469d-9abe-b4073c5eeeb8 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:03.301139 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2954dc05-e364-469d-9abe-b4073c5eeeb8 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:03.301139 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2954dc05-e364-469d-9abe-b4073c5eeeb8 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:03.301139 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2954dc05-e364-469d-9abe-b4073c5eeeb8 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:03.490546 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-f313a14d-4be8-498f-adde-808bae58f8d1 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:03.508734 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-f313a14d-4be8-498f-adde-808bae58f8d1 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/287c44c9-e70d-4492-b4b6-35bee8011596" status: 200 len: 1493 microversion: 2.1 time: 0.654264 Oct 04 18:49:03.522895 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2178/4099] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:02 2022] GET /compute/v2.1/servers/287c44c9-e70d-4492-b4b6-35bee8011596 => generated 1493 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:03.536281 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-170b9459-72ee-498f-b63c-c48e616695dc tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:03.536833 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-170b9459-72ee-498f-b63c-c48e616695dc tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] [instance: 5dbc7ef7-31da-4c7c-a906-d5a84833f77e] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:03.560872 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-170b9459-72ee-498f-b63c-c48e616695dc tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:03.561700 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-170b9459-72ee-498f-b63c-c48e616695dc tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:03.563768 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-170b9459-72ee-498f-b63c-c48e616695dc tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:03.565386 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-170b9459-72ee-498f-b63c-c48e616695dc tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:03.565881 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-170b9459-72ee-498f-b63c-c48e616695dc tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:03.566314 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-170b9459-72ee-498f-b63c-c48e616695dc tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:03.643782 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-2954dc05-e364-469d-9abe-b4073c5eeeb8 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a116f2d9656548458264cc4fb1934c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff3c3dc76405401baf72fe00c5d50b56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:03.657675 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-2954dc05-e364-469d-9abe-b4073c5eeeb8 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] 10.222.0.43 "GET /compute/v2.1/servers/f2269817-3e15-4cfe-8446-7eb0104f9800" status: 200 len: 1363 microversion: 2.1 time: 0.383157 Oct 04 18:49:03.658918 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1922/4100] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:03 2022] GET /compute/v2.1/servers/f2269817-3e15-4cfe-8446-7eb0104f9800 => generated 1363 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:03.664005 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-7e9b7284-40b2-4fcb-abf3-a33746c19232 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-84861343", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:49:03.701354 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-170b9459-72ee-498f-b63c-c48e616695dc tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b4654e49c9435ea151487362174118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a659496a484115910b123ad9a57144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:03.712302 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-170b9459-72ee-498f-b63c-c48e616695dc tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] 10.222.0.43 "GET /compute/v2.1/servers/5dbc7ef7-31da-4c7c-a906-d5a84833f77e" status: 200 len: 1275 microversion: 2.1 time: 0.182341 Oct 04 18:49:03.713191 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2179/4101] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:03 2022] GET /compute/v2.1/servers/5dbc7ef7-31da-4c7c-a906-d5a84833f77e => generated 1275 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:03.750450 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.network.neutron [None req-7e9b7284-40b2-4fcb-abf3-a33746c19232 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] validate_networks() for [('4a1417e9-f3af-46cb-a463-32dd1c79c4e9', None, None, None, None, None)] {{(pid=123595) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:49:04.536266 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-82d9f7fd-c02c-4ee5-b65c-7c37d2e97e3e tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:04.536805 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-82d9f7fd-c02c-4ee5-b65c-7c37d2e97e3e tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 287c44c9-e70d-4492-b4b6-35bee8011596] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:04.546638 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-82d9f7fd-c02c-4ee5-b65c-7c37d2e97e3e tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:04.548622 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-82d9f7fd-c02c-4ee5-b65c-7c37d2e97e3e tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:04.549844 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-82d9f7fd-c02c-4ee5-b65c-7c37d2e97e3e tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:04.551891 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-82d9f7fd-c02c-4ee5-b65c-7c37d2e97e3e tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:04.552374 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-82d9f7fd-c02c-4ee5-b65c-7c37d2e97e3e tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:04.555440 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-82d9f7fd-c02c-4ee5-b65c-7c37d2e97e3e tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:05.277816 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-82d9f7fd-c02c-4ee5-b65c-7c37d2e97e3e tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:05.286899 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-82d9f7fd-c02c-4ee5-b65c-7c37d2e97e3e tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/287c44c9-e70d-4492-b4b6-35bee8011596" status: 200 len: 1514 microversion: 2.1 time: 0.754905 Oct 04 18:49:05.287472 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2180/4102] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:04 2022] GET /compute/v2.1/servers/287c44c9-e70d-4492-b4b6-35bee8011596 => generated 1514 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:49:05.301183 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-c798e7eb-03fb-4560-8e45-db0dca07ec25 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:05.302709 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-c798e7eb-03fb-4560-8e45-db0dca07ec25 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] [instance: f2269817-3e15-4cfe-8446-7eb0104f9800] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:05.312683 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c798e7eb-03fb-4560-8e45-db0dca07ec25 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:05.313523 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c798e7eb-03fb-4560-8e45-db0dca07ec25 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:05.314124 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c798e7eb-03fb-4560-8e45-db0dca07ec25 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:05.315230 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c798e7eb-03fb-4560-8e45-db0dca07ec25 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:05.315892 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c798e7eb-03fb-4560-8e45-db0dca07ec25 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:05.316483 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c798e7eb-03fb-4560-8e45-db0dca07ec25 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:05.366484 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-7e9b7284-40b2-4fcb-abf3-a33746c19232 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Flavor limits 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:49:05.367517 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-7e9b7284-40b2-4fcb-abf3-a33746c19232 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Image limits 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:49:05.368678 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-7e9b7284-40b2-4fcb-abf3-a33746c19232 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Flavor pref 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:49:05.369379 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-7e9b7284-40b2-4fcb-abf3-a33746c19232 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Image pref 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:49:05.370078 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-7e9b7284-40b2-4fcb-abf3-a33746c19232 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:49:05.386277 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7e9b7284-40b2-4fcb-abf3-a33746c19232 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:05.390804 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7e9b7284-40b2-4fcb-abf3-a33746c19232 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:05.391518 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7e9b7284-40b2-4fcb-abf3-a33746c19232 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:05.392419 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7e9b7284-40b2-4fcb-abf3-a33746c19232 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:05.393459 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7e9b7284-40b2-4fcb-abf3-a33746c19232 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:05.395200 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7e9b7284-40b2-4fcb-abf3-a33746c19232 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:05.441052 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-7e9b7284-40b2-4fcb-abf3-a33746c19232 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Getting quotas for project ed8f94cf1c974654a336645f453c9efc. Resources: {'ram', 'cores', 'instances'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:49:05.474650 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-7e9b7284-40b2-4fcb-abf3-a33746c19232 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Getting quotas for user 14707008940e4965ab7d1190094a71bb and project ed8f94cf1c974654a336645f453c9efc. Resources: {'ram', 'cores', 'instances'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:49:05.535592 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-7e9b7284-40b2-4fcb-abf3-a33746c19232 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Going to run 1 instances... {{(pid=123595) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:49:05.541820 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-7e9b7284-40b2-4fcb-abf3-a33746c19232 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] [instance: a12764a5-8614-4f81-be9d-81a92f7aee04] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e8943ec5-4038-4d4b-b9b9-2415a79f5243',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:49:05.650423 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-7e9b7284-40b2-4fcb-abf3-a33746c19232 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.990181 Oct 04 18:49:05.652298 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1923/4103] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 18:49:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 1993 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:49:05.657266 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-4be4a1a8-5ccf-4c35-a013-a8392f32e2a5 tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:05.658061 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-4be4a1a8-5ccf-4c35-a013-a8392f32e2a5 tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] [instance: 5dbc7ef7-31da-4c7c-a906-d5a84833f77e] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:05.665598 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4be4a1a8-5ccf-4c35-a013-a8392f32e2a5 tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:05.666357 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4be4a1a8-5ccf-4c35-a013-a8392f32e2a5 tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:05.667206 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4be4a1a8-5ccf-4c35-a013-a8392f32e2a5 tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:05.668100 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4be4a1a8-5ccf-4c35-a013-a8392f32e2a5 tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:05.668717 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4be4a1a8-5ccf-4c35-a013-a8392f32e2a5 tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:05.669964 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4be4a1a8-5ccf-4c35-a013-a8392f32e2a5 tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:05.955940 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-4be4a1a8-5ccf-4c35-a013-a8392f32e2a5 tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b4654e49c9435ea151487362174118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a659496a484115910b123ad9a57144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:05.977079 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-4be4a1a8-5ccf-4c35-a013-a8392f32e2a5 tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] 10.222.0.43 "GET /compute/v2.1/servers/5dbc7ef7-31da-4c7c-a906-d5a84833f77e" status: 200 len: 1281 microversion: 2.1 time: 0.323116 Oct 04 18:49:05.996672 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1924/4104] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:05 2022] GET /compute/v2.1/servers/5dbc7ef7-31da-4c7c-a906-d5a84833f77e => generated 1281 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:06.017350 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-398d1917-1127-40e5-885b-569168862e06 req-a7ed8aa6-c4d2-474b-9584-3fcac2f8eee5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2269817-3e15-4cfe-8446-7eb0104f9800", "tag": "3669d9fe-db74-4da0-9fd7-a5c116b739a9"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:49:06.053937 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-398d1917-1127-40e5-885b-569168862e06 req-a7ed8aa6-c4d2-474b-9584-3fcac2f8eee5 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:06.054950 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-398d1917-1127-40e5-885b-569168862e06 req-a7ed8aa6-c4d2-474b-9584-3fcac2f8eee5 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:06.058412 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-c798e7eb-03fb-4560-8e45-db0dca07ec25 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a116f2d9656548458264cc4fb1934c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff3c3dc76405401baf72fe00c5d50b56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:06.067312 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-398d1917-1127-40e5-885b-569168862e06 req-a7ed8aa6-c4d2-474b-9584-3fcac2f8eee5 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:06.077206 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-c798e7eb-03fb-4560-8e45-db0dca07ec25 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] 10.222.0.43 "GET /compute/v2.1/servers/f2269817-3e15-4cfe-8446-7eb0104f9800" status: 200 len: 1363 microversion: 2.1 time: 0.784420 Oct 04 18:49:06.081303 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2181/4105] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:05 2022] GET /compute/v2.1/servers/f2269817-3e15-4cfe-8446-7eb0104f9800 => generated 1363 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:06.092158 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-398d1917-1127-40e5-885b-569168862e06 req-a7ed8aa6-c4d2-474b-9584-3fcac2f8eee5 service nova] Creating event network-changed:3669d9fe-db74-4da0-9fd7-a5c116b739a9 for instance f2269817-3e15-4cfe-8446-7eb0104f9800 on n-h1-851028-13 Oct 04 18:49:06.096662 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f71ce977-3f3a-48be-88e8-aec6fe914f64 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:06.101214 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-f71ce977-3f3a-48be-88e8-aec6fe914f64 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] [instance: a12764a5-8614-4f81-be9d-81a92f7aee04] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:06.106884 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-398d1917-1127-40e5-885b-569168862e06 req-a7ed8aa6-c4d2-474b-9584-3fcac2f8eee5 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106907 Oct 04 18:49:06.109940 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1925/4106] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:49:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:49:06.146031 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-f71ce977-3f3a-48be-88e8-aec6fe914f64 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] [instance: a12764a5-8614-4f81-be9d-81a92f7aee04] Going to try to terminate instance {{(pid=123596) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:49:06.240236 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=46,nova_cell0:UPDATE=7 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:49:06.316728 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-832605cb-3356-4ef9-89a7-5c94373533c5 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:06.317811 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-832605cb-3356-4ef9-89a7-5c94373533c5 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 287c44c9-e70d-4492-b4b6-35bee8011596] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:06.342947 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-832605cb-3356-4ef9-89a7-5c94373533c5 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:06.344929 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-832605cb-3356-4ef9-89a7-5c94373533c5 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:06.345849 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-832605cb-3356-4ef9-89a7-5c94373533c5 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:06.347106 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-832605cb-3356-4ef9-89a7-5c94373533c5 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:06.348356 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-832605cb-3356-4ef9-89a7-5c94373533c5 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:06.349248 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-832605cb-3356-4ef9-89a7-5c94373533c5 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:06.667092 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.compute.api [None req-f71ce977-3f3a-48be-88e8-aec6fe914f64 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] [instance: a12764a5-8614-4f81-be9d-81a92f7aee04] Instance Mapping does not exist while attempting local delete cleanup. Oct 04 18:49:06.668482 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-f71ce977-3f3a-48be-88e8-aec6fe914f64 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] 10.222.0.43 "DELETE /compute/v2.1/servers/a12764a5-8614-4f81-be9d-81a92f7aee04" status: 204 len: 0 microversion: 2.1 time: 0.585790 Oct 04 18:49:06.669329 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2182/4107] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 18:49:06 2022] DELETE /compute/v2.1/servers/a12764a5-8614-4f81-be9d-81a92f7aee04 => generated 0 bytes in 587 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:49:06.691177 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-7bb15633-78d3-4659-bba4-5487e42af40d tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:06.691827 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-7bb15633-78d3-4659-bba4-5487e42af40d tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] [instance: a12764a5-8614-4f81-be9d-81a92f7aee04] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:06.706312 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-7bb15633-78d3-4659-bba4-5487e42af40d tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] HTTP exception thrown: Instance a12764a5-8614-4f81-be9d-81a92f7aee04 could not be found. Oct 04 18:49:06.708348 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-7bb15633-78d3-4659-bba4-5487e42af40d tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Request method failure captured: Oct 04 18:49:06.708348 n-d-851028-13 devstack@n-api.service[123596]: request: GET /compute/v2.1/servers/a12764a5-8614-4f81-be9d-81a92f7aee04 HTTP/1.1 Oct 04 18:49:06.708348 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:49:06.708348 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:49:06.708348 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:49:06.708348 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 18:49:06.708348 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:49:06.708348 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:49:06.708348 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:49:06.708348 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:49:06.708348 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPIAJxznq_dqRpKBeHYz_tTt-BPe6PGX8bXmZXSSSBar-nAl3_7gjSqUW3yyr2J4Kw1m1-l6Y2izmzOt3P0Lv3UhhGPTaACGzV6RGiSkRczLrMXORtXSdyVIiZq3MCL7L2uQGd29MwUZa7-C3NoIEqHwDxvVJi_WWjtFyKnOFEp1-BZ0 Oct 04 18:49:06.708348 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:49:06.708348 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:49:06.708348 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:49:06.708348 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:49:06.708348 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:49:06.708348 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:49:06.708348 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: ed8f94cf1c974654a336645f453c9efc Oct 04 18:49:06.708348 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-ServersTestJSON-546754383 Oct 04 18:49:06.708348 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 18:49:06.708348 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 18:49:06.708348 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/ed8f94cf1c974654a336645f453c9efc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_ed8f94cf1c974654a336645f453c9efc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ed8f94cf1c974654a336645f453c9efc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ed8f94cf1c974654a336645f453c9efc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:49:06.708348 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-ServersTestJSON-546754383 Oct 04 18:49:06.708348 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: ed8f94cf1c974654a336645f453c9efc Oct 04 18:49:06.708348 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-ServersTestJSON-546754383 Oct 04 18:49:06.708348 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-ServersTestJSON-546754383-project Oct 04 18:49:06.708348 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:49:06.708348 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:49:06.708348 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 14707008940e4965ab7d1190094a71bb Oct 04 18:49:06.708348 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-ServersTestJSON-546754383-project Oct 04 18:49:06.708348 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 18:49:06.708348 n-d-851028-13 devstack@n-api.service[123596]: exception: Instance a12764a5-8614-4f81-be9d-81a92f7aee04 could not be found. Oct 04 18:49:06.708348 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': 'a12764a5-8614-4f81-be9d-81a92f7aee04'} Oct 04 18:49:06.708348 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:49:06.708348 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:49:06.708348 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:49:06.708348 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:49:06.708348 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:49:06.708348 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:49:06.708348 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 18:49:06.708348 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 18:49:06.708348 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a12764a5-8614-4f81-be9d-81a92f7aee04 could not be found. Oct 04 18:49:06.708348 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:49:06.708348 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:49:06.708348 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:49:06.708348 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:49:06.708348 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:49:06.708348 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:49:06.708348 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:49:06.708348 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:49:06.708348 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:49:06.708348 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:49:06.708348 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:49:06.708348 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:49:06.708348 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:49:06.708348 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:49:06.708348 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:49:06.708348 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:49:06.708348 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a12764a5-8614-4f81-be9d-81a92f7aee04 could not be found. Oct 04 18:49:06.708348 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:49:06.708348 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:49:06.708348 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:49:06.708348 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:49:06.708348 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:49:06.708348 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:49:06.711629 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:49:06.711629 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:49:06.711629 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a12764a5-8614-4f81-be9d-81a92f7aee04 could not be found. Oct 04 18:49:06.711629 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:49:06.713904 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-7bb15633-78d3-4659-bba4-5487e42af40d tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Returning 404 to user: Instance a12764a5-8614-4f81-be9d-81a92f7aee04 could not be found. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:49:06.715245 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-7bb15633-78d3-4659-bba4-5487e42af40d tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] 10.222.0.43 "GET /compute/v2.1/servers/a12764a5-8614-4f81-be9d-81a92f7aee04" status: 404 len: 111 microversion: 2.1 time: 0.041423 Oct 04 18:49:06.725164 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2183/4108] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:06 2022] GET /compute/v2.1/servers/a12764a5-8614-4f81-be9d-81a92f7aee04 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:49:06.737095 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-832605cb-3356-4ef9-89a7-5c94373533c5 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:06.750425 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-832605cb-3356-4ef9-89a7-5c94373533c5 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/287c44c9-e70d-4492-b4b6-35bee8011596" status: 200 len: 1509 microversion: 2.1 time: 0.438373 Oct 04 18:49:06.751023 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1926/4109] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:06 2022] GET /compute/v2.1/servers/287c44c9-e70d-4492-b4b6-35bee8011596 => generated 1509 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:49:07.003033 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-c4af6df6-b0a6-4a48-bbda-89fa41778972 tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:07.003912 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-c4af6df6-b0a6-4a48-bbda-89fa41778972 tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] [instance: 5dbc7ef7-31da-4c7c-a906-d5a84833f77e] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:07.029391 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c4af6df6-b0a6-4a48-bbda-89fa41778972 tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:07.030082 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c4af6df6-b0a6-4a48-bbda-89fa41778972 tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:07.032858 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c4af6df6-b0a6-4a48-bbda-89fa41778972 tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:07.034219 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c4af6df6-b0a6-4a48-bbda-89fa41778972 tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:07.039530 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c4af6df6-b0a6-4a48-bbda-89fa41778972 tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:07.042940 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c4af6df6-b0a6-4a48-bbda-89fa41778972 tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:07.106990 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-4188a4f0-1118-4257-bcee-c1085903fa40 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:07.107855 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-4188a4f0-1118-4257-bcee-c1085903fa40 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] [instance: f2269817-3e15-4cfe-8446-7eb0104f9800] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:07.122545 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4188a4f0-1118-4257-bcee-c1085903fa40 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:07.124347 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4188a4f0-1118-4257-bcee-c1085903fa40 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:07.125631 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4188a4f0-1118-4257-bcee-c1085903fa40 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:07.128657 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4188a4f0-1118-4257-bcee-c1085903fa40 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:07.132188 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4188a4f0-1118-4257-bcee-c1085903fa40 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:07.135570 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4188a4f0-1118-4257-bcee-c1085903fa40 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:07.564416 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-c4af6df6-b0a6-4a48-bbda-89fa41778972 tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b4654e49c9435ea151487362174118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a659496a484115910b123ad9a57144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:07.579019 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-c4af6df6-b0a6-4a48-bbda-89fa41778972 tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] 10.222.0.43 "GET /compute/v2.1/servers/5dbc7ef7-31da-4c7c-a906-d5a84833f77e" status: 200 len: 1323 microversion: 2.1 time: 0.580766 Oct 04 18:49:07.610997 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2184/4110] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:06 2022] GET /compute/v2.1/servers/5dbc7ef7-31da-4c7c-a906-d5a84833f77e => generated 1323 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:07.618956 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-d49e634c-ad5c-4cde-93ab-e28803c1607b tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-809865567", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "4a1417e9-f3af-46cb-a463-32dd1c79c4e9"}]}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:49:07.734604 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.network.neutron [None req-d49e634c-ad5c-4cde-93ab-e28803c1607b tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] validate_networks() for [('4a1417e9-f3af-46cb-a463-32dd1c79c4e9', None, None, None, None, None)] {{(pid=123596) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:49:07.886390 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-4188a4f0-1118-4257-bcee-c1085903fa40 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a116f2d9656548458264cc4fb1934c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff3c3dc76405401baf72fe00c5d50b56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:07.900189 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-4188a4f0-1118-4257-bcee-c1085903fa40 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] 10.222.0.43 "GET /compute/v2.1/servers/f2269817-3e15-4cfe-8446-7eb0104f9800" status: 200 len: 1363 microversion: 2.1 time: 0.802213 Oct 04 18:49:07.908985 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1927/4111] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:07 2022] GET /compute/v2.1/servers/f2269817-3e15-4cfe-8446-7eb0104f9800 => generated 1363 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:07.927171 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-603ccc80-30f8-4e2f-963a-7af51f96a00d req-b28ce0b5-5d62-495c-94e8-988689771ba3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "287c44c9-e70d-4492-b4b6-35bee8011596", "name": "network-vif-plugged", "status": "completed", "tag": "37fe4acb-5d41-4bcb-9278-e11389be7c1d"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:49:07.966433 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-603ccc80-30f8-4e2f-963a-7af51f96a00d req-b28ce0b5-5d62-495c-94e8-988689771ba3 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:07.967180 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-603ccc80-30f8-4e2f-963a-7af51f96a00d req-b28ce0b5-5d62-495c-94e8-988689771ba3 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:07.968392 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-603ccc80-30f8-4e2f-963a-7af51f96a00d req-b28ce0b5-5d62-495c-94e8-988689771ba3 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:07.996871 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-603ccc80-30f8-4e2f-963a-7af51f96a00d req-b28ce0b5-5d62-495c-94e8-988689771ba3 service nova] Creating event network-vif-plugged:37fe4acb-5d41-4bcb-9278-e11389be7c1d for instance 287c44c9-e70d-4492-b4b6-35bee8011596 on n-h2-851028-13 Oct 04 18:49:08.004265 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-603ccc80-30f8-4e2f-963a-7af51f96a00d req-b28ce0b5-5d62-495c-94e8-988689771ba3 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092688 Oct 04 18:49:08.005297 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1928/4112] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:49:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:49:08.025102 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-b9defe0a-2a6e-4679-aac7-c4eba3b0413f tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:08.026068 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-b9defe0a-2a6e-4679-aac7-c4eba3b0413f tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 287c44c9-e70d-4492-b4b6-35bee8011596] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:08.035462 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b9defe0a-2a6e-4679-aac7-c4eba3b0413f tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:08.036373 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b9defe0a-2a6e-4679-aac7-c4eba3b0413f tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:08.036970 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b9defe0a-2a6e-4679-aac7-c4eba3b0413f tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:08.038205 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b9defe0a-2a6e-4679-aac7-c4eba3b0413f tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:08.039063 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b9defe0a-2a6e-4679-aac7-c4eba3b0413f tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:08.039640 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b9defe0a-2a6e-4679-aac7-c4eba3b0413f tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:08.561143 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-b9defe0a-2a6e-4679-aac7-c4eba3b0413f tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:08.579713 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-b9defe0a-2a6e-4679-aac7-c4eba3b0413f tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/287c44c9-e70d-4492-b4b6-35bee8011596" status: 200 len: 1509 microversion: 2.1 time: 0.572985 Oct 04 18:49:08.582535 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1929/4113] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:08 2022] GET /compute/v2.1/servers/287c44c9-e70d-4492-b4b6-35bee8011596 => generated 1509 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:08.617913 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-df907d16-fbc6-4079-b230-e293924386d0 tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:08.622473 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-df907d16-fbc6-4079-b230-e293924386d0 tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] [instance: 5dbc7ef7-31da-4c7c-a906-d5a84833f77e] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:08.642742 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-df907d16-fbc6-4079-b230-e293924386d0 tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:08.643884 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-df907d16-fbc6-4079-b230-e293924386d0 tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:08.644979 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-df907d16-fbc6-4079-b230-e293924386d0 tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:08.646509 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-df907d16-fbc6-4079-b230-e293924386d0 tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:08.651607 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-df907d16-fbc6-4079-b230-e293924386d0 tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:08.654885 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-df907d16-fbc6-4079-b230-e293924386d0 tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:09.108174 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-d49e634c-ad5c-4cde-93ab-e28803c1607b tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Flavor limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:49:09.108714 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-d49e634c-ad5c-4cde-93ab-e28803c1607b tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Image limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:49:09.109341 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-d49e634c-ad5c-4cde-93ab-e28803c1607b tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Flavor pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:49:09.109863 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-d49e634c-ad5c-4cde-93ab-e28803c1607b tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Image pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:49:09.110505 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-d49e634c-ad5c-4cde-93ab-e28803c1607b tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:49:09.133815 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d49e634c-ad5c-4cde-93ab-e28803c1607b tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:09.139593 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d49e634c-ad5c-4cde-93ab-e28803c1607b tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:09.142512 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d49e634c-ad5c-4cde-93ab-e28803c1607b tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:09.144822 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-df907d16-fbc6-4079-b230-e293924386d0 tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b4654e49c9435ea151487362174118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a659496a484115910b123ad9a57144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:09.145923 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d49e634c-ad5c-4cde-93ab-e28803c1607b tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:09.149605 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d49e634c-ad5c-4cde-93ab-e28803c1607b tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:09.150189 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d49e634c-ad5c-4cde-93ab-e28803c1607b tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:09.156830 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-df907d16-fbc6-4079-b230-e293924386d0 tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] 10.222.0.43 "GET /compute/v2.1/servers/5dbc7ef7-31da-4c7c-a906-d5a84833f77e" status: 200 len: 1323 microversion: 2.1 time: 0.544518 Oct 04 18:49:09.173242 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1930/4114] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:08 2022] GET /compute/v2.1/servers/5dbc7ef7-31da-4c7c-a906-d5a84833f77e => generated 1323 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:49:09.180695 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-a72c019e-5399-492d-81bc-9598347c93e9 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:09.181362 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-a72c019e-5399-492d-81bc-9598347c93e9 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] [instance: f2269817-3e15-4cfe-8446-7eb0104f9800] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:09.209543 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-d49e634c-ad5c-4cde-93ab-e28803c1607b tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Getting quotas for project ed8f94cf1c974654a336645f453c9efc. Resources: {'ram', 'cores', 'instances'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:49:09.210314 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a72c019e-5399-492d-81bc-9598347c93e9 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:09.212557 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a72c019e-5399-492d-81bc-9598347c93e9 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:09.214086 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a72c019e-5399-492d-81bc-9598347c93e9 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:09.216612 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a72c019e-5399-492d-81bc-9598347c93e9 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:09.218708 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a72c019e-5399-492d-81bc-9598347c93e9 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:09.219458 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a72c019e-5399-492d-81bc-9598347c93e9 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:09.248076 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-d49e634c-ad5c-4cde-93ab-e28803c1607b tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Getting quotas for user 14707008940e4965ab7d1190094a71bb and project ed8f94cf1c974654a336645f453c9efc. Resources: {'ram', 'cores', 'instances'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:49:09.307052 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-d49e634c-ad5c-4cde-93ab-e28803c1607b tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Going to run 1 instances... {{(pid=123596) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:49:09.311973 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-d49e634c-ad5c-4cde-93ab-e28803c1607b tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] [instance: 1c1b1c42-bb4c-40e2-9248-7d746c1fb674] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e8943ec5-4038-4d4b-b9b9-2415a79f5243',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123596) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:49:09.459773 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-d49e634c-ad5c-4cde-93ab-e28803c1607b tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.845598 Oct 04 18:49:09.461524 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2185/4115] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 18:49:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 1850 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:49:09.492584 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-2b58687b-5d51-49fc-8fc3-577616b8f588 req-a60ab54a-8c6a-49b3-bcf4-5674515a39cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5dbc7ef7-31da-4c7c-a906-d5a84833f77e", "tag": "f0e60f44-6c1c-473c-941a-2d4d07700464"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:49:09.568022 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-2b58687b-5d51-49fc-8fc3-577616b8f588 req-a60ab54a-8c6a-49b3-bcf4-5674515a39cd service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:09.572974 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-2b58687b-5d51-49fc-8fc3-577616b8f588 req-a60ab54a-8c6a-49b3-bcf4-5674515a39cd service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:09.576438 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-2b58687b-5d51-49fc-8fc3-577616b8f588 req-a60ab54a-8c6a-49b3-bcf4-5674515a39cd service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:09.629270 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-2b58687b-5d51-49fc-8fc3-577616b8f588 req-a60ab54a-8c6a-49b3-bcf4-5674515a39cd service nova] Creating event network-changed:f0e60f44-6c1c-473c-941a-2d4d07700464 for instance 5dbc7ef7-31da-4c7c-a906-d5a84833f77e on n-h2-851028-13 Oct 04 18:49:09.642915 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-2b58687b-5d51-49fc-8fc3-577616b8f588 req-a60ab54a-8c6a-49b3-bcf4-5674515a39cd service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.168427 Oct 04 18:49:09.645149 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2186/4116] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:49:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:49:09.670890 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-8ab312cf-7620-4999-b6e4-70b8064bfc95 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:09.671749 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-8ab312cf-7620-4999-b6e4-70b8064bfc95 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] [instance: 1c1b1c42-bb4c-40e2-9248-7d746c1fb674] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:09.788838 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-8ab312cf-7620-4999-b6e4-70b8064bfc95 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14707008940e4965ab7d1190094a71bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8f94cf1c974654a336645f453c9efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:09.796753 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-8ab312cf-7620-4999-b6e4-70b8064bfc95 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] 10.222.0.43 "GET /compute/v2.1/servers/1c1b1c42-bb4c-40e2-9248-7d746c1fb674" status: 200 len: 1220 microversion: 2.1 time: 0.147649 Oct 04 18:49:09.797372 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2187/4117] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:09 2022] GET /compute/v2.1/servers/1c1b1c42-bb4c-40e2-9248-7d746c1fb674 => generated 1220 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:09.807771 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-09294650-3326-465e-a565-d6031b6229cc tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:09.808392 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-09294650-3326-465e-a565-d6031b6229cc tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 287c44c9-e70d-4492-b4b6-35bee8011596] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:09.850517 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-09294650-3326-465e-a565-d6031b6229cc tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:09.851227 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-09294650-3326-465e-a565-d6031b6229cc tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:09.853636 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-09294650-3326-465e-a565-d6031b6229cc tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:09.856063 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-09294650-3326-465e-a565-d6031b6229cc tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:09.859967 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-09294650-3326-465e-a565-d6031b6229cc tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:09.863173 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-09294650-3326-465e-a565-d6031b6229cc tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:10.269177 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-09294650-3326-465e-a565-d6031b6229cc tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:10.279592 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-09294650-3326-465e-a565-d6031b6229cc tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/287c44c9-e70d-4492-b4b6-35bee8011596" status: 200 len: 1509 microversion: 2.1 time: 0.476994 Oct 04 18:49:10.286338 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2188/4118] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:09 2022] GET /compute/v2.1/servers/287c44c9-e70d-4492-b4b6-35bee8011596 => generated 1509 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:10.302209 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-de625f5c-4787-46e5-8eba-e94c4f398a59 tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:10.302989 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-de625f5c-4787-46e5-8eba-e94c4f398a59 tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] [instance: 5dbc7ef7-31da-4c7c-a906-d5a84833f77e] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:10.315931 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-a72c019e-5399-492d-81bc-9598347c93e9 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a116f2d9656548458264cc4fb1934c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff3c3dc76405401baf72fe00c5d50b56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:10.323789 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-de625f5c-4787-46e5-8eba-e94c4f398a59 tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:10.324697 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-de625f5c-4787-46e5-8eba-e94c4f398a59 tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:10.325558 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-de625f5c-4787-46e5-8eba-e94c4f398a59 tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:10.326747 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-a72c019e-5399-492d-81bc-9598347c93e9 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] 10.222.0.43 "GET /compute/v2.1/servers/f2269817-3e15-4cfe-8446-7eb0104f9800" status: 200 len: 1363 microversion: 2.1 time: 1.165652 Oct 04 18:49:10.328831 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-de625f5c-4787-46e5-8eba-e94c4f398a59 tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:10.329619 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-de625f5c-4787-46e5-8eba-e94c4f398a59 tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:10.330131 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-de625f5c-4787-46e5-8eba-e94c4f398a59 tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:10.348290 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1931/4119] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:09 2022] GET /compute/v2.1/servers/f2269817-3e15-4cfe-8446-7eb0104f9800 => generated 1363 bytes in 1187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:10.699416 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-de625f5c-4787-46e5-8eba-e94c4f398a59 tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b4654e49c9435ea151487362174118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a659496a484115910b123ad9a57144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:10.716601 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-de625f5c-4787-46e5-8eba-e94c4f398a59 tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] 10.222.0.43 "GET /compute/v2.1/servers/5dbc7ef7-31da-4c7c-a906-d5a84833f77e" status: 200 len: 1323 microversion: 2.1 time: 0.428246 Oct 04 18:49:10.720267 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2189/4120] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:10 2022] GET /compute/v2.1/servers/5dbc7ef7-31da-4c7c-a906-d5a84833f77e => generated 1323 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:10.823213 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-d3bfeca3-deac-441f-99ae-dcb2b27d2af7 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:10.823841 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-d3bfeca3-deac-441f-99ae-dcb2b27d2af7 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] [instance: 1c1b1c42-bb4c-40e2-9248-7d746c1fb674] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:10.833195 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d3bfeca3-deac-441f-99ae-dcb2b27d2af7 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:10.833693 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d3bfeca3-deac-441f-99ae-dcb2b27d2af7 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:10.834157 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d3bfeca3-deac-441f-99ae-dcb2b27d2af7 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:10.834928 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d3bfeca3-deac-441f-99ae-dcb2b27d2af7 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:10.835396 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d3bfeca3-deac-441f-99ae-dcb2b27d2af7 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:10.835834 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d3bfeca3-deac-441f-99ae-dcb2b27d2af7 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:10.994620 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-d3bfeca3-deac-441f-99ae-dcb2b27d2af7 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14707008940e4965ab7d1190094a71bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8f94cf1c974654a336645f453c9efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:11.014826 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-d3bfeca3-deac-441f-99ae-dcb2b27d2af7 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] 10.222.0.43 "GET /compute/v2.1/servers/1c1b1c42-bb4c-40e2-9248-7d746c1fb674" status: 200 len: 1216 microversion: 2.1 time: 0.195322 Oct 04 18:49:11.025470 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1932/4121] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:10 2022] GET /compute/v2.1/servers/1c1b1c42-bb4c-40e2-9248-7d746c1fb674 => generated 1216 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:11.258891 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-f27bb7b7-3c3b-49a3-9c13-40a586c128ed req-aa1cf36b-03e7-4689-9116-faa5d61f9e0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2269817-3e15-4cfe-8446-7eb0104f9800", "name": "network-vif-plugged", "status": "completed", "tag": "3669d9fe-db74-4da0-9fd7-a5c116b739a9"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:49:11.301953 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-f27bb7b7-3c3b-49a3-9c13-40a586c128ed req-aa1cf36b-03e7-4689-9116-faa5d61f9e0e service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:11.304959 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-f27bb7b7-3c3b-49a3-9c13-40a586c128ed req-aa1cf36b-03e7-4689-9116-faa5d61f9e0e service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:11.309031 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-f27bb7b7-3c3b-49a3-9c13-40a586c128ed req-aa1cf36b-03e7-4689-9116-faa5d61f9e0e service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:11.313257 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-6b714bb4-7548-48d4-8870-6d2189237391 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:11.313951 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-6b714bb4-7548-48d4-8870-6d2189237391 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 287c44c9-e70d-4492-b4b6-35bee8011596] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:11.332834 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6b714bb4-7548-48d4-8870-6d2189237391 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:11.333400 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6b714bb4-7548-48d4-8870-6d2189237391 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:11.333793 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6b714bb4-7548-48d4-8870-6d2189237391 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:11.334516 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6b714bb4-7548-48d4-8870-6d2189237391 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:11.342818 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6b714bb4-7548-48d4-8870-6d2189237391 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:11.345086 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6b714bb4-7548-48d4-8870-6d2189237391 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:11.375375 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-f27bb7b7-3c3b-49a3-9c13-40a586c128ed req-aa1cf36b-03e7-4689-9116-faa5d61f9e0e service nova] Creating event network-vif-plugged:3669d9fe-db74-4da0-9fd7-a5c116b739a9 for instance f2269817-3e15-4cfe-8446-7eb0104f9800 on n-h1-851028-13 Oct 04 18:49:11.415065 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-f27bb7b7-3c3b-49a3-9c13-40a586c128ed req-aa1cf36b-03e7-4689-9116-faa5d61f9e0e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.170675 Oct 04 18:49:11.420824 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2190/4122] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:49:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:49:11.438948 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-776e56eb-d1e7-4422-973f-81f23d7711a4 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:11.441764 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-776e56eb-d1e7-4422-973f-81f23d7711a4 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] [instance: f2269817-3e15-4cfe-8446-7eb0104f9800] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:11.457659 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-776e56eb-d1e7-4422-973f-81f23d7711a4 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:11.458167 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-776e56eb-d1e7-4422-973f-81f23d7711a4 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:11.458614 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-776e56eb-d1e7-4422-973f-81f23d7711a4 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:11.459358 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-776e56eb-d1e7-4422-973f-81f23d7711a4 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:11.459816 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-776e56eb-d1e7-4422-973f-81f23d7711a4 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:11.460280 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-776e56eb-d1e7-4422-973f-81f23d7711a4 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:11.643200 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-6b714bb4-7548-48d4-8870-6d2189237391 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:11.660236 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-6b714bb4-7548-48d4-8870-6d2189237391 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/287c44c9-e70d-4492-b4b6-35bee8011596" status: 200 len: 1509 microversion: 2.1 time: 0.351815 Oct 04 18:49:11.661033 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1933/4123] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:11 2022] GET /compute/v2.1/servers/287c44c9-e70d-4492-b4b6-35bee8011596 => generated 1509 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:49:11.743873 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-5cbccaba-f8a2-424c-8395-7a92bfd62add tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:11.744781 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-5cbccaba-f8a2-424c-8395-7a92bfd62add tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] [instance: 5dbc7ef7-31da-4c7c-a906-d5a84833f77e] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:11.761702 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-776e56eb-d1e7-4422-973f-81f23d7711a4 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a116f2d9656548458264cc4fb1934c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff3c3dc76405401baf72fe00c5d50b56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:11.773336 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5cbccaba-f8a2-424c-8395-7a92bfd62add tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:11.776259 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5cbccaba-f8a2-424c-8395-7a92bfd62add tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:11.780624 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5cbccaba-f8a2-424c-8395-7a92bfd62add tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:11.781739 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5cbccaba-f8a2-424c-8395-7a92bfd62add tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:11.785336 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5cbccaba-f8a2-424c-8395-7a92bfd62add tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:11.790418 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5cbccaba-f8a2-424c-8395-7a92bfd62add tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:11.847894 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-776e56eb-d1e7-4422-973f-81f23d7711a4 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] 10.222.0.43 "GET /compute/v2.1/servers/f2269817-3e15-4cfe-8446-7eb0104f9800" status: 200 len: 1363 microversion: 2.1 time: 0.421013 Oct 04 18:49:11.848903 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2191/4124] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:11 2022] GET /compute/v2.1/servers/f2269817-3e15-4cfe-8446-7eb0104f9800 => generated 1363 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:12.039471 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-17616598-6606-408d-a637-a39515fdd47f tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:12.040947 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-17616598-6606-408d-a637-a39515fdd47f tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] [instance: 1c1b1c42-bb4c-40e2-9248-7d746c1fb674] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:12.051555 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-17616598-6606-408d-a637-a39515fdd47f tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:12.060931 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-17616598-6606-408d-a637-a39515fdd47f tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:12.061704 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-17616598-6606-408d-a637-a39515fdd47f tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:12.062780 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-17616598-6606-408d-a637-a39515fdd47f tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:12.063397 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-17616598-6606-408d-a637-a39515fdd47f tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:12.063932 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-17616598-6606-408d-a637-a39515fdd47f tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:12.288176 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-17616598-6606-408d-a637-a39515fdd47f tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14707008940e4965ab7d1190094a71bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8f94cf1c974654a336645f453c9efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:12.295684 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=100 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:49:12.311913 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-17616598-6606-408d-a637-a39515fdd47f tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] 10.222.0.43 "GET /compute/v2.1/servers/1c1b1c42-bb4c-40e2-9248-7d746c1fb674" status: 200 len: 1280 microversion: 2.1 time: 0.274360 Oct 04 18:49:12.312527 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2192/4125] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:12 2022] GET /compute/v2.1/servers/1c1b1c42-bb4c-40e2-9248-7d746c1fb674 => generated 1280 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:12.651142 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-5cbccaba-f8a2-424c-8395-7a92bfd62add tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b4654e49c9435ea151487362174118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a659496a484115910b123ad9a57144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:12.660477 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-5cbccaba-f8a2-424c-8395-7a92bfd62add tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] 10.222.0.43 "GET /compute/v2.1/servers/5dbc7ef7-31da-4c7c-a906-d5a84833f77e" status: 200 len: 1323 microversion: 2.1 time: 0.920868 Oct 04 18:49:12.681996 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1934/4126] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:11 2022] GET /compute/v2.1/servers/5dbc7ef7-31da-4c7c-a906-d5a84833f77e => generated 1323 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:12.692023 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-e3c0afe3-91eb-4727-a3d3-0019777cda59 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:12.692634 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-e3c0afe3-91eb-4727-a3d3-0019777cda59 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 287c44c9-e70d-4492-b4b6-35bee8011596] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:12.725648 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e3c0afe3-91eb-4727-a3d3-0019777cda59 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:12.728440 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e3c0afe3-91eb-4727-a3d3-0019777cda59 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:12.730982 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e3c0afe3-91eb-4727-a3d3-0019777cda59 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:12.731907 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e3c0afe3-91eb-4727-a3d3-0019777cda59 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:12.734162 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e3c0afe3-91eb-4727-a3d3-0019777cda59 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:12.735853 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e3c0afe3-91eb-4727-a3d3-0019777cda59 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:12.877046 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-3893219a-db2a-4fe8-9b0e-97d70b8d7f3b tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:12.878087 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-3893219a-db2a-4fe8-9b0e-97d70b8d7f3b tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] [instance: f2269817-3e15-4cfe-8446-7eb0104f9800] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:12.890573 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3893219a-db2a-4fe8-9b0e-97d70b8d7f3b tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:12.891891 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3893219a-db2a-4fe8-9b0e-97d70b8d7f3b tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:12.893713 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3893219a-db2a-4fe8-9b0e-97d70b8d7f3b tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:12.894669 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3893219a-db2a-4fe8-9b0e-97d70b8d7f3b tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:12.898328 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3893219a-db2a-4fe8-9b0e-97d70b8d7f3b tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:12.899059 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3893219a-db2a-4fe8-9b0e-97d70b8d7f3b tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:13.178457 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-e3c0afe3-91eb-4727-a3d3-0019777cda59 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:13.197937 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-e3c0afe3-91eb-4727-a3d3-0019777cda59 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/287c44c9-e70d-4492-b4b6-35bee8011596" status: 200 len: 1509 microversion: 2.1 time: 0.514705 Oct 04 18:49:13.198555 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2193/4127] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:12 2022] GET /compute/v2.1/servers/287c44c9-e70d-4492-b4b6-35bee8011596 => generated 1509 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:13.340774 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-887aaeb0-f3d5-4ba6-896d-48723f8c32c1 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:13.342808 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-887aaeb0-f3d5-4ba6-896d-48723f8c32c1 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] [instance: 1c1b1c42-bb4c-40e2-9248-7d746c1fb674] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:13.358214 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-887aaeb0-f3d5-4ba6-896d-48723f8c32c1 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:13.364557 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-887aaeb0-f3d5-4ba6-896d-48723f8c32c1 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:13.365276 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-887aaeb0-f3d5-4ba6-896d-48723f8c32c1 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:13.366183 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-887aaeb0-f3d5-4ba6-896d-48723f8c32c1 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:13.368905 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-887aaeb0-f3d5-4ba6-896d-48723f8c32c1 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:13.370622 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-887aaeb0-f3d5-4ba6-896d-48723f8c32c1 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:13.529317 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-887aaeb0-f3d5-4ba6-896d-48723f8c32c1 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14707008940e4965ab7d1190094a71bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8f94cf1c974654a336645f453c9efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:13.543167 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-887aaeb0-f3d5-4ba6-896d-48723f8c32c1 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] 10.222.0.43 "GET /compute/v2.1/servers/1c1b1c42-bb4c-40e2-9248-7d746c1fb674" status: 200 len: 1278 microversion: 2.1 time: 0.208291 Oct 04 18:49:13.543915 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2194/4128] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:13 2022] GET /compute/v2.1/servers/1c1b1c42-bb4c-40e2-9248-7d746c1fb674 => generated 1278 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:13.635005 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-3893219a-db2a-4fe8-9b0e-97d70b8d7f3b tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a116f2d9656548458264cc4fb1934c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff3c3dc76405401baf72fe00c5d50b56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:13.643865 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-3893219a-db2a-4fe8-9b0e-97d70b8d7f3b tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] 10.222.0.43 "GET /compute/v2.1/servers/f2269817-3e15-4cfe-8446-7eb0104f9800" status: 200 len: 1363 microversion: 2.1 time: 0.770567 Oct 04 18:49:13.649913 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1935/4129] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:12 2022] GET /compute/v2.1/servers/f2269817-3e15-4cfe-8446-7eb0104f9800 => generated 1363 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:13.695066 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-9c7ac281-19b9-4873-b4e4-1d3cc838dd60 tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:13.695978 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-9c7ac281-19b9-4873-b4e4-1d3cc838dd60 tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] [instance: 5dbc7ef7-31da-4c7c-a906-d5a84833f77e] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:13.713696 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9c7ac281-19b9-4873-b4e4-1d3cc838dd60 tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:13.717569 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9c7ac281-19b9-4873-b4e4-1d3cc838dd60 tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:13.723279 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9c7ac281-19b9-4873-b4e4-1d3cc838dd60 tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:13.728204 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9c7ac281-19b9-4873-b4e4-1d3cc838dd60 tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:13.728934 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9c7ac281-19b9-4873-b4e4-1d3cc838dd60 tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:13.730937 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9c7ac281-19b9-4873-b4e4-1d3cc838dd60 tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:14.068810 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-9c7ac281-19b9-4873-b4e4-1d3cc838dd60 tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b4654e49c9435ea151487362174118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a659496a484115910b123ad9a57144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:14.082264 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-9c7ac281-19b9-4873-b4e4-1d3cc838dd60 tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] 10.222.0.43 "GET /compute/v2.1/servers/5dbc7ef7-31da-4c7c-a906-d5a84833f77e" status: 200 len: 1323 microversion: 2.1 time: 0.392117 Oct 04 18:49:14.098223 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2195/4130] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:13 2022] GET /compute/v2.1/servers/5dbc7ef7-31da-4c7c-a906-d5a84833f77e => generated 1323 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:14.227926 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-248f4857-7bec-4ade-bf43-75faf57930f3 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:14.229188 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-248f4857-7bec-4ade-bf43-75faf57930f3 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 287c44c9-e70d-4492-b4b6-35bee8011596] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:14.249580 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-248f4857-7bec-4ade-bf43-75faf57930f3 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:14.250075 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-248f4857-7bec-4ade-bf43-75faf57930f3 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:14.262757 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-248f4857-7bec-4ade-bf43-75faf57930f3 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:14.266391 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-248f4857-7bec-4ade-bf43-75faf57930f3 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:14.277317 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-248f4857-7bec-4ade-bf43-75faf57930f3 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:14.278088 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-248f4857-7bec-4ade-bf43-75faf57930f3 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:14.569014 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f5892d2a-9f2b-4fda-b64e-e23e907222e6 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:14.570255 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-f5892d2a-9f2b-4fda-b64e-e23e907222e6 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] [instance: 1c1b1c42-bb4c-40e2-9248-7d746c1fb674] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:14.601778 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f5892d2a-9f2b-4fda-b64e-e23e907222e6 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:14.609040 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f5892d2a-9f2b-4fda-b64e-e23e907222e6 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:14.610633 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f5892d2a-9f2b-4fda-b64e-e23e907222e6 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:14.611545 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f5892d2a-9f2b-4fda-b64e-e23e907222e6 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:14.614700 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f5892d2a-9f2b-4fda-b64e-e23e907222e6 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:14.617692 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f5892d2a-9f2b-4fda-b64e-e23e907222e6 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:14.755222 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-248f4857-7bec-4ade-bf43-75faf57930f3 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:14.766388 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-248f4857-7bec-4ade-bf43-75faf57930f3 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/287c44c9-e70d-4492-b4b6-35bee8011596" status: 200 len: 1509 microversion: 2.1 time: 0.542176 Oct 04 18:49:14.775720 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1936/4131] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:14 2022] GET /compute/v2.1/servers/287c44c9-e70d-4492-b4b6-35bee8011596 => generated 1509 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:14.799483 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-3efe949a-44a1-4d9d-9a13-ef619fe3b6ed tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:14.800135 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-3efe949a-44a1-4d9d-9a13-ef619fe3b6ed tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] [instance: f2269817-3e15-4cfe-8446-7eb0104f9800] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:14.841927 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3efe949a-44a1-4d9d-9a13-ef619fe3b6ed tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:14.842687 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3efe949a-44a1-4d9d-9a13-ef619fe3b6ed tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:14.846827 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3efe949a-44a1-4d9d-9a13-ef619fe3b6ed tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:14.863350 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3efe949a-44a1-4d9d-9a13-ef619fe3b6ed tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:14.864311 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3efe949a-44a1-4d9d-9a13-ef619fe3b6ed tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:14.864922 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3efe949a-44a1-4d9d-9a13-ef619fe3b6ed tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:15.168505 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-f5892d2a-9f2b-4fda-b64e-e23e907222e6 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14707008940e4965ab7d1190094a71bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8f94cf1c974654a336645f453c9efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:15.186283 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-f5892d2a-9f2b-4fda-b64e-e23e907222e6 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] 10.222.0.43 "GET /compute/v2.1/servers/1c1b1c42-bb4c-40e2-9248-7d746c1fb674" status: 200 len: 1320 microversion: 2.1 time: 0.622332 Oct 04 18:49:15.188942 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2196/4132] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:14 2022] GET /compute/v2.1/servers/1c1b1c42-bb4c-40e2-9248-7d746c1fb674 => generated 1320 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:15.213044 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f838b7e8-93f4-4ed3-9905-748e0101a0f6 tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:15.213783 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-f838b7e8-93f4-4ed3-9905-748e0101a0f6 tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] [instance: 5dbc7ef7-31da-4c7c-a906-d5a84833f77e] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:15.229853 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f838b7e8-93f4-4ed3-9905-748e0101a0f6 tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:15.230356 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f838b7e8-93f4-4ed3-9905-748e0101a0f6 tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:15.230806 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f838b7e8-93f4-4ed3-9905-748e0101a0f6 tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:15.231518 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f838b7e8-93f4-4ed3-9905-748e0101a0f6 tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:15.234856 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f838b7e8-93f4-4ed3-9905-748e0101a0f6 tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:15.235317 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f838b7e8-93f4-4ed3-9905-748e0101a0f6 tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:15.416433 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=6 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:49:15.490048 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-3efe949a-44a1-4d9d-9a13-ef619fe3b6ed tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a116f2d9656548458264cc4fb1934c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff3c3dc76405401baf72fe00c5d50b56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:15.504531 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-3efe949a-44a1-4d9d-9a13-ef619fe3b6ed tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] 10.222.0.43 "GET /compute/v2.1/servers/f2269817-3e15-4cfe-8446-7eb0104f9800" status: 200 len: 1548 microversion: 2.1 time: 0.727645 Oct 04 18:49:15.521151 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1937/4133] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:14 2022] GET /compute/v2.1/servers/f2269817-3e15-4cfe-8446-7eb0104f9800 => generated 1548 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:15.536941 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-b41d2c42-1f0c-4144-ad20-8ff0c8705d0b tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:15.537858 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-b41d2c42-1f0c-4144-ad20-8ff0c8705d0b tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] [instance: f2269817-3e15-4cfe-8446-7eb0104f9800] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:15.561981 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=20 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:49:15.567371 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:49:15.573955 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b41d2c42-1f0c-4144-ad20-8ff0c8705d0b tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:15.577310 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b41d2c42-1f0c-4144-ad20-8ff0c8705d0b tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:15.577922 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b41d2c42-1f0c-4144-ad20-8ff0c8705d0b tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:15.582438 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b41d2c42-1f0c-4144-ad20-8ff0c8705d0b tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:15.583146 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b41d2c42-1f0c-4144-ad20-8ff0c8705d0b tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:15.586036 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b41d2c42-1f0c-4144-ad20-8ff0c8705d0b tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:16.045371 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-b41d2c42-1f0c-4144-ad20-8ff0c8705d0b tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] 10.222.0.43 "GET /compute/v2.1/servers/f2269817-3e15-4cfe-8446-7eb0104f9800/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.511974 Oct 04 18:49:16.046660 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1938/4134] 10.222.0.43 () {58 vars in 1275 bytes} [Tue Oct 4 18:49:15 2022] GET /compute/v2.1/servers/f2269817-3e15-4cfe-8446-7eb0104f9800/os-interface => generated 284 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:49:16.060490 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-33556b48-8080-41d7-8883-f83d328a613b tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:16.064410 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-33556b48-8080-41d7-8883-f83d328a613b tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 287c44c9-e70d-4492-b4b6-35bee8011596] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:16.090075 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-33556b48-8080-41d7-8883-f83d328a613b tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:16.093353 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-33556b48-8080-41d7-8883-f83d328a613b tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:16.095149 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-33556b48-8080-41d7-8883-f83d328a613b tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:16.101556 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-33556b48-8080-41d7-8883-f83d328a613b tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:16.106942 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-33556b48-8080-41d7-8883-f83d328a613b tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:16.110085 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-33556b48-8080-41d7-8883-f83d328a613b tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:16.500427 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-f838b7e8-93f4-4ed3-9905-748e0101a0f6 tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b4654e49c9435ea151487362174118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a659496a484115910b123ad9a57144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:16.534807 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-f838b7e8-93f4-4ed3-9905-748e0101a0f6 tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] 10.222.0.43 "GET /compute/v2.1/servers/5dbc7ef7-31da-4c7c-a906-d5a84833f77e" status: 200 len: 1323 microversion: 2.1 time: 1.331532 Oct 04 18:49:16.535714 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2197/4135] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:15 2022] GET /compute/v2.1/servers/5dbc7ef7-31da-4c7c-a906-d5a84833f77e => generated 1323 bytes in 1346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:16.566646 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-8a73a78f-e9a7-4605-9f95-c185c08ef6e1 req-bcbff62b-2e31-44be-a9f9-7547890f663a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5dbc7ef7-31da-4c7c-a906-d5a84833f77e", "name": "network-vif-plugged", "status": "completed", "tag": "f0e60f44-6c1c-473c-941a-2d4d07700464"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:49:16.584404 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-8a73a78f-e9a7-4605-9f95-c185c08ef6e1 req-bcbff62b-2e31-44be-a9f9-7547890f663a service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:16.584900 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-8a73a78f-e9a7-4605-9f95-c185c08ef6e1 req-bcbff62b-2e31-44be-a9f9-7547890f663a service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:16.585369 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-8a73a78f-e9a7-4605-9f95-c185c08ef6e1 req-bcbff62b-2e31-44be-a9f9-7547890f663a service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:16.644670 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-8a73a78f-e9a7-4605-9f95-c185c08ef6e1 req-bcbff62b-2e31-44be-a9f9-7547890f663a service nova] Creating event network-vif-plugged:f0e60f44-6c1c-473c-941a-2d4d07700464 for instance 5dbc7ef7-31da-4c7c-a906-d5a84833f77e on n-h2-851028-13 Oct 04 18:49:16.661530 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-8a73a78f-e9a7-4605-9f95-c185c08ef6e1 req-bcbff62b-2e31-44be-a9f9-7547890f663a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124302 Oct 04 18:49:16.663229 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2198/4136] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:49:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:49:16.688456 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f9563094-0749-4499-aa41-01c61b9dcc1d tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:16.689951 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-f9563094-0749-4499-aa41-01c61b9dcc1d tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] [instance: 1c1b1c42-bb4c-40e2-9248-7d746c1fb674] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:16.701952 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f9563094-0749-4499-aa41-01c61b9dcc1d tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:16.702690 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f9563094-0749-4499-aa41-01c61b9dcc1d tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:16.703461 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f9563094-0749-4499-aa41-01c61b9dcc1d tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:16.704949 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f9563094-0749-4499-aa41-01c61b9dcc1d tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:16.705668 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f9563094-0749-4499-aa41-01c61b9dcc1d tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:16.720450 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f9563094-0749-4499-aa41-01c61b9dcc1d tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:17.087648 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-f9563094-0749-4499-aa41-01c61b9dcc1d tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14707008940e4965ab7d1190094a71bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8f94cf1c974654a336645f453c9efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:17.109067 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-f9563094-0749-4499-aa41-01c61b9dcc1d tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] 10.222.0.43 "GET /compute/v2.1/servers/1c1b1c42-bb4c-40e2-9248-7d746c1fb674" status: 200 len: 1320 microversion: 2.1 time: 0.437066 Oct 04 18:49:17.113972 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2199/4137] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:16 2022] GET /compute/v2.1/servers/1c1b1c42-bb4c-40e2-9248-7d746c1fb674 => generated 1320 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:17.231525 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-33556b48-8080-41d7-8883-f83d328a613b tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:17.247320 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=100 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:49:17.258458 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-33556b48-8080-41d7-8883-f83d328a613b tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/287c44c9-e70d-4492-b4b6-35bee8011596" status: 200 len: 1509 microversion: 2.1 time: 1.209136 Oct 04 18:49:17.260263 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1939/4138] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:16 2022] GET /compute/v2.1/servers/287c44c9-e70d-4492-b4b6-35bee8011596 => generated 1509 bytes in 1213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:17.561722 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-7d7e6d48-fcf7-4a51-af3a-6bb3d511a075 tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:17.562202 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-7d7e6d48-fcf7-4a51-af3a-6bb3d511a075 tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] [instance: 5dbc7ef7-31da-4c7c-a906-d5a84833f77e] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:17.574705 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7d7e6d48-fcf7-4a51-af3a-6bb3d511a075 tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:17.575351 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7d7e6d48-fcf7-4a51-af3a-6bb3d511a075 tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:17.577336 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7d7e6d48-fcf7-4a51-af3a-6bb3d511a075 tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:17.578355 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7d7e6d48-fcf7-4a51-af3a-6bb3d511a075 tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:17.591365 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7d7e6d48-fcf7-4a51-af3a-6bb3d511a075 tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:17.596087 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7d7e6d48-fcf7-4a51-af3a-6bb3d511a075 tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:17.876720 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-7d7e6d48-fcf7-4a51-af3a-6bb3d511a075 tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b4654e49c9435ea151487362174118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a659496a484115910b123ad9a57144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:17.886614 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-7d7e6d48-fcf7-4a51-af3a-6bb3d511a075 tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] 10.222.0.43 "GET /compute/v2.1/servers/5dbc7ef7-31da-4c7c-a906-d5a84833f77e" status: 200 len: 1323 microversion: 2.1 time: 0.329180 Oct 04 18:49:17.905675 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2200/4139] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:17 2022] GET /compute/v2.1/servers/5dbc7ef7-31da-4c7c-a906-d5a84833f77e => generated 1323 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:18.142647 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-edc9ecdb-4cde-4361-aa9f-f9405c1fc908 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:18.143709 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-edc9ecdb-4cde-4361-aa9f-f9405c1fc908 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] [instance: 1c1b1c42-bb4c-40e2-9248-7d746c1fb674] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:18.159606 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-edc9ecdb-4cde-4361-aa9f-f9405c1fc908 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:18.160097 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-edc9ecdb-4cde-4361-aa9f-f9405c1fc908 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:18.162989 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-edc9ecdb-4cde-4361-aa9f-f9405c1fc908 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:18.164517 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-edc9ecdb-4cde-4361-aa9f-f9405c1fc908 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:18.168444 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-edc9ecdb-4cde-4361-aa9f-f9405c1fc908 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:18.169655 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-edc9ecdb-4cde-4361-aa9f-f9405c1fc908 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:18.252855 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-4f11bc6d-b5a8-446a-935b-867963853309 req-4e3d784a-a9d2-403f-846f-d596ef7cc4f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c1b1c42-bb4c-40e2-9248-7d746c1fb674", "tag": "aaaea0be-4533-4a87-b68d-3fc71cd5dc25"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:49:18.271893 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-4f11bc6d-b5a8-446a-935b-867963853309 req-4e3d784a-a9d2-403f-846f-d596ef7cc4f3 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:18.278469 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-4f11bc6d-b5a8-446a-935b-867963853309 req-4e3d784a-a9d2-403f-846f-d596ef7cc4f3 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:18.279236 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-4f11bc6d-b5a8-446a-935b-867963853309 req-4e3d784a-a9d2-403f-846f-d596ef7cc4f3 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:18.314273 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-4f11bc6d-b5a8-446a-935b-867963853309 req-4e3d784a-a9d2-403f-846f-d596ef7cc4f3 service nova] Creating event network-changed:aaaea0be-4533-4a87-b68d-3fc71cd5dc25 for instance 1c1b1c42-bb4c-40e2-9248-7d746c1fb674 on n-h1-851028-13 Oct 04 18:49:18.320500 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-4f11bc6d-b5a8-446a-935b-867963853309 req-4e3d784a-a9d2-403f-846f-d596ef7cc4f3 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071289 Oct 04 18:49:18.324477 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2201/4140] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:49:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:49:18.349666 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-2406d59b-2e77-40df-a316-d12ef8fbe7c4 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:18.350690 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-2406d59b-2e77-40df-a316-d12ef8fbe7c4 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 287c44c9-e70d-4492-b4b6-35bee8011596] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:18.361354 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2406d59b-2e77-40df-a316-d12ef8fbe7c4 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:18.362168 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2406d59b-2e77-40df-a316-d12ef8fbe7c4 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:18.363533 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2406d59b-2e77-40df-a316-d12ef8fbe7c4 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:18.364507 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2406d59b-2e77-40df-a316-d12ef8fbe7c4 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:18.365200 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2406d59b-2e77-40df-a316-d12ef8fbe7c4 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:18.365830 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2406d59b-2e77-40df-a316-d12ef8fbe7c4 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:18.690525 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-2406d59b-2e77-40df-a316-d12ef8fbe7c4 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:18.702487 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-2406d59b-2e77-40df-a316-d12ef8fbe7c4 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/287c44c9-e70d-4492-b4b6-35bee8011596" status: 200 len: 1509 microversion: 2.1 time: 0.371360 Oct 04 18:49:18.714351 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2202/4141] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:18 2022] GET /compute/v2.1/servers/287c44c9-e70d-4492-b4b6-35bee8011596 => generated 1509 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:18.772630 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-edc9ecdb-4cde-4361-aa9f-f9405c1fc908 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14707008940e4965ab7d1190094a71bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8f94cf1c974654a336645f453c9efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:18.785217 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-edc9ecdb-4cde-4361-aa9f-f9405c1fc908 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] 10.222.0.43 "GET /compute/v2.1/servers/1c1b1c42-bb4c-40e2-9248-7d746c1fb674" status: 200 len: 1320 microversion: 2.1 time: 0.648577 Oct 04 18:49:18.786548 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1940/4142] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:18 2022] GET /compute/v2.1/servers/1c1b1c42-bb4c-40e2-9248-7d746c1fb674 => generated 1320 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:18.934975 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-5ad2b56f-ca38-4e50-852d-7497dd5f5b08 tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:18.938535 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-5ad2b56f-ca38-4e50-852d-7497dd5f5b08 tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] [instance: 5dbc7ef7-31da-4c7c-a906-d5a84833f77e] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:18.958906 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5ad2b56f-ca38-4e50-852d-7497dd5f5b08 tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:18.960072 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5ad2b56f-ca38-4e50-852d-7497dd5f5b08 tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:18.961763 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5ad2b56f-ca38-4e50-852d-7497dd5f5b08 tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:18.963237 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5ad2b56f-ca38-4e50-852d-7497dd5f5b08 tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:18.965332 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5ad2b56f-ca38-4e50-852d-7497dd5f5b08 tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:18.975196 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5ad2b56f-ca38-4e50-852d-7497dd5f5b08 tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:19.178615 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=2 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:49:19.328330 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-5ad2b56f-ca38-4e50-852d-7497dd5f5b08 tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b4654e49c9435ea151487362174118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a659496a484115910b123ad9a57144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:19.345549 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-5ad2b56f-ca38-4e50-852d-7497dd5f5b08 tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] 10.222.0.43 "GET /compute/v2.1/servers/5dbc7ef7-31da-4c7c-a906-d5a84833f77e" status: 200 len: 1323 microversion: 2.1 time: 0.428190 Oct 04 18:49:19.347373 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2203/4143] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:18 2022] GET /compute/v2.1/servers/5dbc7ef7-31da-4c7c-a906-d5a84833f77e => generated 1323 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:19.731683 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-d7c41626-7f5b-4067-ab25-4b91438d8211 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:19.732480 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-d7c41626-7f5b-4067-ab25-4b91438d8211 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 287c44c9-e70d-4492-b4b6-35bee8011596] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:19.750725 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d7c41626-7f5b-4067-ab25-4b91438d8211 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:19.751527 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d7c41626-7f5b-4067-ab25-4b91438d8211 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:19.753520 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d7c41626-7f5b-4067-ab25-4b91438d8211 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:19.756781 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d7c41626-7f5b-4067-ab25-4b91438d8211 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:19.757939 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d7c41626-7f5b-4067-ab25-4b91438d8211 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:19.760996 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d7c41626-7f5b-4067-ab25-4b91438d8211 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:19.808133 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-106a6329-35e5-4bb1-9d64-1b2860e2e2d2 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:19.809460 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-106a6329-35e5-4bb1-9d64-1b2860e2e2d2 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] [instance: 1c1b1c42-bb4c-40e2-9248-7d746c1fb674] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:19.821750 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=9 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:49:19.829486 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-106a6329-35e5-4bb1-9d64-1b2860e2e2d2 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:19.834087 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-106a6329-35e5-4bb1-9d64-1b2860e2e2d2 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:19.835364 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-106a6329-35e5-4bb1-9d64-1b2860e2e2d2 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:19.839465 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-106a6329-35e5-4bb1-9d64-1b2860e2e2d2 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:19.849836 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-106a6329-35e5-4bb1-9d64-1b2860e2e2d2 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:19.850591 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-106a6329-35e5-4bb1-9d64-1b2860e2e2d2 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:20.167157 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-d7c41626-7f5b-4067-ab25-4b91438d8211 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:20.183977 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-d7c41626-7f5b-4067-ab25-4b91438d8211 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/287c44c9-e70d-4492-b4b6-35bee8011596" status: 200 len: 1509 microversion: 2.1 time: 0.456326 Oct 04 18:49:20.185167 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1941/4144] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:19 2022] GET /compute/v2.1/servers/287c44c9-e70d-4492-b4b6-35bee8011596 => generated 1509 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:20.209643 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-106a6329-35e5-4bb1-9d64-1b2860e2e2d2 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14707008940e4965ab7d1190094a71bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8f94cf1c974654a336645f453c9efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:20.224813 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-106a6329-35e5-4bb1-9d64-1b2860e2e2d2 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] 10.222.0.43 "GET /compute/v2.1/servers/1c1b1c42-bb4c-40e2-9248-7d746c1fb674" status: 200 len: 1320 microversion: 2.1 time: 0.415450 Oct 04 18:49:20.225395 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2204/4145] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:19 2022] GET /compute/v2.1/servers/1c1b1c42-bb4c-40e2-9248-7d746c1fb674 => generated 1320 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:49:20.376267 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-bdc9d43a-3442-47ce-a95b-d961dbf8ade9 tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:20.376803 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-bdc9d43a-3442-47ce-a95b-d961dbf8ade9 tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] [instance: 5dbc7ef7-31da-4c7c-a906-d5a84833f77e] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:20.379048 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-73e54710-1c9b-4ca0-863e-533a0244aa43 req-8c4748ce-6935-41f4-b874-1eefff6dacae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2269817-3e15-4cfe-8446-7eb0104f9800", "tag": "3669d9fe-db74-4da0-9fd7-a5c116b739a9"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:49:20.402075 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bdc9d43a-3442-47ce-a95b-d961dbf8ade9 tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:20.402586 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bdc9d43a-3442-47ce-a95b-d961dbf8ade9 tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:20.403041 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bdc9d43a-3442-47ce-a95b-d961dbf8ade9 tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:20.403748 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bdc9d43a-3442-47ce-a95b-d961dbf8ade9 tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:20.404210 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bdc9d43a-3442-47ce-a95b-d961dbf8ade9 tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:20.404630 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bdc9d43a-3442-47ce-a95b-d961dbf8ade9 tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:20.415647 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-73e54710-1c9b-4ca0-863e-533a0244aa43 req-8c4748ce-6935-41f4-b874-1eefff6dacae service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:20.415944 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-73e54710-1c9b-4ca0-863e-533a0244aa43 req-8c4748ce-6935-41f4-b874-1eefff6dacae service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:20.416408 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-73e54710-1c9b-4ca0-863e-533a0244aa43 req-8c4748ce-6935-41f4-b874-1eefff6dacae service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:20.448148 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-73e54710-1c9b-4ca0-863e-533a0244aa43 req-8c4748ce-6935-41f4-b874-1eefff6dacae service nova] Creating event network-changed:3669d9fe-db74-4da0-9fd7-a5c116b739a9 for instance f2269817-3e15-4cfe-8446-7eb0104f9800 on n-h1-851028-13 Oct 04 18:49:20.458321 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-73e54710-1c9b-4ca0-863e-533a0244aa43 req-8c4748ce-6935-41f4-b874-1eefff6dacae service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089863 Oct 04 18:49:20.464038 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1942/4146] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:49:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:49:20.696273 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-bdc9d43a-3442-47ce-a95b-d961dbf8ade9 tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b4654e49c9435ea151487362174118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a659496a484115910b123ad9a57144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:20.709828 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-bdc9d43a-3442-47ce-a95b-d961dbf8ade9 tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] 10.222.0.43 "GET /compute/v2.1/servers/5dbc7ef7-31da-4c7c-a906-d5a84833f77e" status: 200 len: 1473 microversion: 2.1 time: 0.338266 Oct 04 18:49:20.711158 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2205/4147] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:20 2022] GET /compute/v2.1/servers/5dbc7ef7-31da-4c7c-a906-d5a84833f77e => generated 1473 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:20.738132 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-3b747761-fa85-4382-a5ea-cce54750025f tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:20.740115 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-3b747761-fa85-4382-a5ea-cce54750025f tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] [instance: 5dbc7ef7-31da-4c7c-a906-d5a84833f77e] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:20.760015 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3b747761-fa85-4382-a5ea-cce54750025f tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:20.760887 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3b747761-fa85-4382-a5ea-cce54750025f tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:20.763506 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3b747761-fa85-4382-a5ea-cce54750025f tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:20.764484 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3b747761-fa85-4382-a5ea-cce54750025f tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:20.765688 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3b747761-fa85-4382-a5ea-cce54750025f tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:20.766431 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3b747761-fa85-4382-a5ea-cce54750025f tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:20.802437 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-3b747761-fa85-4382-a5ea-cce54750025f tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': 'e8b4654e49c9435ea151487362174118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a659496a484115910b123ad9a57144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:20.813356 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-3b747761-fa85-4382-a5ea-cce54750025f tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] Request method failure captured: Oct 04 18:49:20.813356 n-d-851028-13 devstack@n-api.service[123595]: request: GET /compute/v2.1/servers/5dbc7ef7-31da-4c7c-a906-d5a84833f77e/diagnostics HTTP/1.1 Oct 04 18:49:20.813356 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 18:49:20.813356 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 18:49:20.813356 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 18:49:20.813356 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 0 Oct 04 18:49:20.813356 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 18:49:20.813356 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 18:49:20.813356 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 18:49:20.813356 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 18:49:20.813356 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPIAaR29g1mry8llnEYLFN_Q4oVvvDUM1f5RatdhB27XYVY0NjB8Ic98N__cxsoDkEuLjj1-XEJmAMw4KkXQouZDq19J1bkpIUqceSAoN6Da8HZPVfNki7CDlcHBs5mctzng3YTTBC_Vs2u32x3_3jcfA54AiY-OGsE6lB-imS4yLCNQ Oct 04 18:49:20.813356 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 18:49:20.813356 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 18:49:20.813356 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 18:49:20.813356 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 18:49:20.813356 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 18:49:20.813356 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 18:49:20.813356 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: 45a659496a484115910b123ad9a57144 Oct 04 18:49:20.813356 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-1974226324 Oct 04 18:49:20.813356 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 18:49:20.813356 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 18:49:20.813356 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/45a659496a484115910b123ad9a57144"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_45a659496a484115910b123ad9a57144"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/45a659496a484115910b123ad9a57144"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/45a659496a484115910b123ad9a57144"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:49:20.813356 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-1974226324 Oct 04 18:49:20.813356 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: 45a659496a484115910b123ad9a57144 Oct 04 18:49:20.813356 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-1974226324 Oct 04 18:49:20.813356 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-ServerDiagnosticsNegativeTest-1974226324-project Oct 04 18:49:20.813356 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 18:49:20.813356 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 18:49:20.813356 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: e8b4654e49c9435ea151487362174118 Oct 04 18:49:20.813356 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-1974226324-project Oct 04 18:49:20.813356 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 18:49:20.813356 n-d-851028-13 devstack@n-api.service[123595]: exception: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 04 18:49:20.813356 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'server_id': '5dbc7ef7-31da-4c7c-a906-d5a84833f77e'} Oct 04 18:49:20.813356 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:49:20.813356 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:49:20.813356 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:49:20.813356 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:49:20.813356 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:49:20.813356 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:49:20.813356 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:49:20.813356 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:49:20.813356 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_diagnostics.py", line 38, in index Oct 04 18:49:20.813356 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi context.can(sd_policies.BASE_POLICY_NAME, Oct 04 18:49:20.813356 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 18:49:20.813356 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 18:49:20.813356 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 18:49:20.813356 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 18:49:20.813356 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:49:20.813356 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:49:20.813356 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:49:20.813356 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:49:20.813356 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 18:49:20.813356 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 18:49:20.813356 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 18:49:20.813356 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 18:49:20.813356 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 18:49:20.813356 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 18:49:20.813356 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 04 18:49:20.813356 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:49:20.813356 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:49:20.813356 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:49:20.813356 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:49:20.817737 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:49:20.817737 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:49:20.817737 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 18:49:20.817737 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 18:49:20.817737 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 04 18:49:20.817737 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:49:20.819222 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-3b747761-fa85-4382-a5ea-cce54750025f tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:49:20.820643 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-3b747761-fa85-4382-a5ea-cce54750025f tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] 10.222.0.43 "GET /compute/v2.1/servers/5dbc7ef7-31da-4c7c-a906-d5a84833f77e/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.087804 Oct 04 18:49:20.821809 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1943/4148] 10.222.0.43 () {58 vars in 1272 bytes} [Tue Oct 4 18:49:20 2022] GET /compute/v2.1/servers/5dbc7ef7-31da-4c7c-a906-d5a84833f77e/diagnostics => generated 117 bytes in 90 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:49:20.833335 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-0e978bc4-b7b1-423d-980e-20337ea20077 tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:20.833861 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-0e978bc4-b7b1-423d-980e-20337ea20077 tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] [instance: 5dbc7ef7-31da-4c7c-a906-d5a84833f77e] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:20.844734 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0e978bc4-b7b1-423d-980e-20337ea20077 tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:20.846220 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0e978bc4-b7b1-423d-980e-20337ea20077 tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:20.849939 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0e978bc4-b7b1-423d-980e-20337ea20077 tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:20.853274 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0e978bc4-b7b1-423d-980e-20337ea20077 tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:20.856537 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0e978bc4-b7b1-423d-980e-20337ea20077 tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:20.859916 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0e978bc4-b7b1-423d-980e-20337ea20077 tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:20.956930 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-0e978bc4-b7b1-423d-980e-20337ea20077 tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] [instance: 5dbc7ef7-31da-4c7c-a906-d5a84833f77e] Going to try to terminate instance {{(pid=123596) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:49:21.151882 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-0e978bc4-b7b1-423d-980e-20337ea20077 tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] 10.222.0.43 "DELETE /compute/v2.1/servers/5dbc7ef7-31da-4c7c-a906-d5a84833f77e" status: 204 len: 0 microversion: 2.1 time: 0.322826 Oct 04 18:49:21.152971 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2206/4149] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 18:49:20 2022] DELETE /compute/v2.1/servers/5dbc7ef7-31da-4c7c-a906-d5a84833f77e => generated 0 bytes in 325 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:49:21.162174 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-2700b365-5d7b-4c75-8c59-4d978e64ee26 tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:21.163031 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-2700b365-5d7b-4c75-8c59-4d978e64ee26 tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] [instance: 5dbc7ef7-31da-4c7c-a906-d5a84833f77e] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:21.194013 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2700b365-5d7b-4c75-8c59-4d978e64ee26 tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:21.205650 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2700b365-5d7b-4c75-8c59-4d978e64ee26 tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:21.212019 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-41c315d6-e317-4cd5-9df8-d54f294e5fb0 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:21.212187 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2700b365-5d7b-4c75-8c59-4d978e64ee26 tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:21.212921 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2700b365-5d7b-4c75-8c59-4d978e64ee26 tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:21.214156 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-41c315d6-e317-4cd5-9df8-d54f294e5fb0 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 287c44c9-e70d-4492-b4b6-35bee8011596] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:21.221046 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2700b365-5d7b-4c75-8c59-4d978e64ee26 tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:21.224993 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2700b365-5d7b-4c75-8c59-4d978e64ee26 tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:21.230119 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-41c315d6-e317-4cd5-9df8-d54f294e5fb0 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:21.231014 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-41c315d6-e317-4cd5-9df8-d54f294e5fb0 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:21.231727 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-41c315d6-e317-4cd5-9df8-d54f294e5fb0 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:21.232780 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-41c315d6-e317-4cd5-9df8-d54f294e5fb0 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:21.233687 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-41c315d6-e317-4cd5-9df8-d54f294e5fb0 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:21.235037 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-41c315d6-e317-4cd5-9df8-d54f294e5fb0 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:21.465768 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-41c315d6-e317-4cd5-9df8-d54f294e5fb0 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:21.477655 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-41c315d6-e317-4cd5-9df8-d54f294e5fb0 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/287c44c9-e70d-4492-b4b6-35bee8011596" status: 200 len: 1509 microversion: 2.1 time: 0.270228 Oct 04 18:49:21.479092 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2207/4150] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:21 2022] GET /compute/v2.1/servers/287c44c9-e70d-4492-b4b6-35bee8011596 => generated 1509 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:49:21.484706 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-d52e6766-e60c-442c-8240-f6deb0d2d609 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:21.485852 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-d52e6766-e60c-442c-8240-f6deb0d2d609 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] [instance: 1c1b1c42-bb4c-40e2-9248-7d746c1fb674] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:21.492805 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:49:21.495605 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d52e6766-e60c-442c-8240-f6deb0d2d609 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:21.496336 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d52e6766-e60c-442c-8240-f6deb0d2d609 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:21.497041 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d52e6766-e60c-442c-8240-f6deb0d2d609 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:21.498077 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d52e6766-e60c-442c-8240-f6deb0d2d609 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:21.498712 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d52e6766-e60c-442c-8240-f6deb0d2d609 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:21.500152 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d52e6766-e60c-442c-8240-f6deb0d2d609 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:21.758958 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-d52e6766-e60c-442c-8240-f6deb0d2d609 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14707008940e4965ab7d1190094a71bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8f94cf1c974654a336645f453c9efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:21.770943 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-d52e6766-e60c-442c-8240-f6deb0d2d609 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] 10.222.0.43 "GET /compute/v2.1/servers/1c1b1c42-bb4c-40e2-9248-7d746c1fb674" status: 200 len: 1320 microversion: 2.1 time: 0.290067 Oct 04 18:49:21.785549 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2208/4151] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:21 2022] GET /compute/v2.1/servers/1c1b1c42-bb4c-40e2-9248-7d746c1fb674 => generated 1320 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:22.017799 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-2700b365-5d7b-4c75-8c59-4d978e64ee26 tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b4654e49c9435ea151487362174118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a659496a484115910b123ad9a57144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:22.079829 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-2700b365-5d7b-4c75-8c59-4d978e64ee26 tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] 10.222.0.43 "GET /compute/v2.1/servers/5dbc7ef7-31da-4c7c-a906-d5a84833f77e" status: 200 len: 1479 microversion: 2.1 time: 0.921706 Oct 04 18:49:22.082444 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1944/4152] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:21 2022] GET /compute/v2.1/servers/5dbc7ef7-31da-4c7c-a906-d5a84833f77e => generated 1479 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:22.507095 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-ac99a230-e42d-4a7c-9fa0-1bf5d219aa6a tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:22.508459 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-ac99a230-e42d-4a7c-9fa0-1bf5d219aa6a tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 287c44c9-e70d-4492-b4b6-35bee8011596] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:22.543927 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ac99a230-e42d-4a7c-9fa0-1bf5d219aa6a tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:22.544302 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ac99a230-e42d-4a7c-9fa0-1bf5d219aa6a tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:22.550598 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ac99a230-e42d-4a7c-9fa0-1bf5d219aa6a tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:22.554008 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ac99a230-e42d-4a7c-9fa0-1bf5d219aa6a tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:22.555439 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ac99a230-e42d-4a7c-9fa0-1bf5d219aa6a tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:22.558569 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ac99a230-e42d-4a7c-9fa0-1bf5d219aa6a tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:22.578190 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:49:22.800396 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-f1097423-129c-4083-8f61-b0cd2181f9b8 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:22.802166 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-f1097423-129c-4083-8f61-b0cd2181f9b8 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] [instance: 1c1b1c42-bb4c-40e2-9248-7d746c1fb674] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:22.816503 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f1097423-129c-4083-8f61-b0cd2181f9b8 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:22.817513 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f1097423-129c-4083-8f61-b0cd2181f9b8 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:22.819600 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f1097423-129c-4083-8f61-b0cd2181f9b8 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:22.820777 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f1097423-129c-4083-8f61-b0cd2181f9b8 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:22.821746 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f1097423-129c-4083-8f61-b0cd2181f9b8 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:22.822397 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f1097423-129c-4083-8f61-b0cd2181f9b8 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:22.927725 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-ac99a230-e42d-4a7c-9fa0-1bf5d219aa6a tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:22.937145 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-ac99a230-e42d-4a7c-9fa0-1bf5d219aa6a tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/287c44c9-e70d-4492-b4b6-35bee8011596" status: 200 len: 1509 microversion: 2.1 time: 0.436948 Oct 04 18:49:22.940924 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2209/4153] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:22 2022] GET /compute/v2.1/servers/287c44c9-e70d-4492-b4b6-35bee8011596 => generated 1509 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:23.112279 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-b4447891-e3fb-4ecd-b501-f1838fc7902e tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:23.113444 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-b4447891-e3fb-4ecd-b501-f1838fc7902e tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] [instance: 5dbc7ef7-31da-4c7c-a906-d5a84833f77e] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:23.121053 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b4447891-e3fb-4ecd-b501-f1838fc7902e tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:23.122348 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b4447891-e3fb-4ecd-b501-f1838fc7902e tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:23.123325 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b4447891-e3fb-4ecd-b501-f1838fc7902e tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:23.124332 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b4447891-e3fb-4ecd-b501-f1838fc7902e tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:23.125803 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b4447891-e3fb-4ecd-b501-f1838fc7902e tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:23.126915 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b4447891-e3fb-4ecd-b501-f1838fc7902e tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:23.197791 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-f1097423-129c-4083-8f61-b0cd2181f9b8 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14707008940e4965ab7d1190094a71bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8f94cf1c974654a336645f453c9efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:23.211995 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-f1097423-129c-4083-8f61-b0cd2181f9b8 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] 10.222.0.43 "GET /compute/v2.1/servers/1c1b1c42-bb4c-40e2-9248-7d746c1fb674" status: 200 len: 1320 microversion: 2.1 time: 0.416740 Oct 04 18:49:23.215107 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1945/4154] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:22 2022] GET /compute/v2.1/servers/1c1b1c42-bb4c-40e2-9248-7d746c1fb674 => generated 1320 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:23.467508 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-b4447891-e3fb-4ecd-b501-f1838fc7902e tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b4654e49c9435ea151487362174118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a659496a484115910b123ad9a57144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:23.476485 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-b4447891-e3fb-4ecd-b501-f1838fc7902e tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] 10.222.0.43 "GET /compute/v2.1/servers/5dbc7ef7-31da-4c7c-a906-d5a84833f77e" status: 200 len: 1479 microversion: 2.1 time: 0.368710 Oct 04 18:49:23.497473 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2210/4155] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:23 2022] GET /compute/v2.1/servers/5dbc7ef7-31da-4c7c-a906-d5a84833f77e => generated 1479 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:23.871448 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-d02a9b1f-36bd-43cf-ac99-52bafbff7b0a req-f84046c2-fbfe-449d-9912-da6b1c8e38b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5dbc7ef7-31da-4c7c-a906-d5a84833f77e", "name": "network-vif-deleted", "tag": "f0e60f44-6c1c-473c-941a-2d4d07700464"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:49:23.889599 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-d02a9b1f-36bd-43cf-ac99-52bafbff7b0a req-f84046c2-fbfe-449d-9912-da6b1c8e38b2 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:23.890614 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-d02a9b1f-36bd-43cf-ac99-52bafbff7b0a req-f84046c2-fbfe-449d-9912-da6b1c8e38b2 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:23.891312 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-d02a9b1f-36bd-43cf-ac99-52bafbff7b0a req-f84046c2-fbfe-449d-9912-da6b1c8e38b2 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:23.908990 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-d02a9b1f-36bd-43cf-ac99-52bafbff7b0a req-f84046c2-fbfe-449d-9912-da6b1c8e38b2 service nova] Creating event network-vif-deleted:f0e60f44-6c1c-473c-941a-2d4d07700464 for instance 5dbc7ef7-31da-4c7c-a906-d5a84833f77e on n-h2-851028-13 Oct 04 18:49:23.938112 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-d02a9b1f-36bd-43cf-ac99-52bafbff7b0a req-f84046c2-fbfe-449d-9912-da6b1c8e38b2 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069557 Oct 04 18:49:23.942757 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1946/4156] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:49:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:49:23.967726 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-0c7623b7-d3c2-425f-a804-02a302cab36d tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:23.971371 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-0c7623b7-d3c2-425f-a804-02a302cab36d tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 287c44c9-e70d-4492-b4b6-35bee8011596] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:24.001289 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0c7623b7-d3c2-425f-a804-02a302cab36d tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:24.021175 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0c7623b7-d3c2-425f-a804-02a302cab36d tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:24.021753 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0c7623b7-d3c2-425f-a804-02a302cab36d tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:24.023019 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0c7623b7-d3c2-425f-a804-02a302cab36d tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:24.023507 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0c7623b7-d3c2-425f-a804-02a302cab36d tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:24.023946 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0c7623b7-d3c2-425f-a804-02a302cab36d tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:24.246861 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-7ae52185-1c07-4738-9b33-7c80b41c5fa1 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:24.247586 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-7ae52185-1c07-4738-9b33-7c80b41c5fa1 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] [instance: 1c1b1c42-bb4c-40e2-9248-7d746c1fb674] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:24.271207 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7ae52185-1c07-4738-9b33-7c80b41c5fa1 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:24.273389 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7ae52185-1c07-4738-9b33-7c80b41c5fa1 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:24.275098 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7ae52185-1c07-4738-9b33-7c80b41c5fa1 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:24.277280 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7ae52185-1c07-4738-9b33-7c80b41c5fa1 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:24.281499 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7ae52185-1c07-4738-9b33-7c80b41c5fa1 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:24.282412 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7ae52185-1c07-4738-9b33-7c80b41c5fa1 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:24.371999 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-0c7623b7-d3c2-425f-a804-02a302cab36d tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:24.380943 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-0c7623b7-d3c2-425f-a804-02a302cab36d tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/287c44c9-e70d-4492-b4b6-35bee8011596" status: 200 len: 1509 microversion: 2.1 time: 0.419060 Oct 04 18:49:24.382198 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2211/4157] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:23 2022] GET /compute/v2.1/servers/287c44c9-e70d-4492-b4b6-35bee8011596 => generated 1509 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:24.511232 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-7b5c8277-c269-41b9-9da9-b27c99219b99 tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:24.511860 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-7b5c8277-c269-41b9-9da9-b27c99219b99 tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] [instance: 5dbc7ef7-31da-4c7c-a906-d5a84833f77e] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:24.514024 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-7ae52185-1c07-4738-9b33-7c80b41c5fa1 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14707008940e4965ab7d1190094a71bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8f94cf1c974654a336645f453c9efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:24.525293 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-7ae52185-1c07-4738-9b33-7c80b41c5fa1 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] 10.222.0.43 "GET /compute/v2.1/servers/1c1b1c42-bb4c-40e2-9248-7d746c1fb674" status: 200 len: 1320 microversion: 2.1 time: 0.282865 Oct 04 18:49:24.537140 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7b5c8277-c269-41b9-9da9-b27c99219b99 tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:24.537140 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7b5c8277-c269-41b9-9da9-b27c99219b99 tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:24.537140 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7b5c8277-c269-41b9-9da9-b27c99219b99 tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:24.537140 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7b5c8277-c269-41b9-9da9-b27c99219b99 tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:24.537140 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7b5c8277-c269-41b9-9da9-b27c99219b99 tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:24.537140 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7b5c8277-c269-41b9-9da9-b27c99219b99 tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:24.541159 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1947/4158] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:24 2022] GET /compute/v2.1/servers/1c1b1c42-bb4c-40e2-9248-7d746c1fb674 => generated 1320 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:24.600038 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7b5c8277-c269-41b9-9da9-b27c99219b99 tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:24.600564 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7b5c8277-c269-41b9-9da9-b27c99219b99 tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:24.601004 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7b5c8277-c269-41b9-9da9-b27c99219b99 tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:24.611305 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.objects.instance [None req-7b5c8277-c269-41b9-9da9-b27c99219b99 tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] Lazy-loading 'fault' on Instance uuid 5dbc7ef7-31da-4c7c-a906-d5a84833f77e {{(pid=123596) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:49:24.700695 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-7b5c8277-c269-41b9-9da9-b27c99219b99 tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b4654e49c9435ea151487362174118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a659496a484115910b123ad9a57144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:24.709082 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-7b5c8277-c269-41b9-9da9-b27c99219b99 tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] 10.222.0.43 "GET /compute/v2.1/servers/5dbc7ef7-31da-4c7c-a906-d5a84833f77e" status: 200 len: 1313 microversion: 2.1 time: 0.202700 Oct 04 18:49:24.709691 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2212/4159] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:24 2022] GET /compute/v2.1/servers/5dbc7ef7-31da-4c7c-a906-d5a84833f77e => generated 1313 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:25.415546 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-a8797571-002c-46df-9af2-e3729fc76ea6 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:25.416172 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-a8797571-002c-46df-9af2-e3729fc76ea6 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 287c44c9-e70d-4492-b4b6-35bee8011596] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:25.438751 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a8797571-002c-46df-9af2-e3729fc76ea6 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:25.439865 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a8797571-002c-46df-9af2-e3729fc76ea6 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:25.440461 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a8797571-002c-46df-9af2-e3729fc76ea6 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:25.441437 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a8797571-002c-46df-9af2-e3729fc76ea6 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:25.442202 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a8797571-002c-46df-9af2-e3729fc76ea6 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:25.442787 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a8797571-002c-46df-9af2-e3729fc76ea6 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:25.551625 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-b8dcf6c2-e60c-4320-9e7b-024f8968e339 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:25.552253 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-b8dcf6c2-e60c-4320-9e7b-024f8968e339 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] [instance: 1c1b1c42-bb4c-40e2-9248-7d746c1fb674] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:25.573508 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b8dcf6c2-e60c-4320-9e7b-024f8968e339 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:25.576493 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b8dcf6c2-e60c-4320-9e7b-024f8968e339 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:25.577135 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b8dcf6c2-e60c-4320-9e7b-024f8968e339 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:25.583020 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b8dcf6c2-e60c-4320-9e7b-024f8968e339 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:25.583985 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b8dcf6c2-e60c-4320-9e7b-024f8968e339 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:25.586661 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b8dcf6c2-e60c-4320-9e7b-024f8968e339 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:25.829841 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-a8797571-002c-46df-9af2-e3729fc76ea6 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:25.839588 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-a8797571-002c-46df-9af2-e3729fc76ea6 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/287c44c9-e70d-4492-b4b6-35bee8011596" status: 200 len: 1509 microversion: 2.1 time: 0.433812 Oct 04 18:49:25.854100 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1948/4160] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:25 2022] GET /compute/v2.1/servers/287c44c9-e70d-4492-b4b6-35bee8011596 => generated 1509 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:25.862146 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-9b1885b0-7eb4-4034-b08c-1ce1f6726ff2 req-797fd93b-0502-4dea-a00e-c11e94d1f8eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c1b1c42-bb4c-40e2-9248-7d746c1fb674", "name": "network-vif-plugged", "status": "completed", "tag": "aaaea0be-4533-4a87-b68d-3fc71cd5dc25"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:49:25.877007 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-9b1885b0-7eb4-4034-b08c-1ce1f6726ff2 req-797fd93b-0502-4dea-a00e-c11e94d1f8eb service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:25.877935 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-9b1885b0-7eb4-4034-b08c-1ce1f6726ff2 req-797fd93b-0502-4dea-a00e-c11e94d1f8eb service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:25.878687 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-9b1885b0-7eb4-4034-b08c-1ce1f6726ff2 req-797fd93b-0502-4dea-a00e-c11e94d1f8eb service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:25.884342 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-b8dcf6c2-e60c-4320-9e7b-024f8968e339 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14707008940e4965ab7d1190094a71bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8f94cf1c974654a336645f453c9efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:25.892726 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-9b1885b0-7eb4-4034-b08c-1ce1f6726ff2 req-797fd93b-0502-4dea-a00e-c11e94d1f8eb service nova] Creating event network-vif-plugged:aaaea0be-4533-4a87-b68d-3fc71cd5dc25 for instance 1c1b1c42-bb4c-40e2-9248-7d746c1fb674 on n-h1-851028-13 Oct 04 18:49:25.896076 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-b8dcf6c2-e60c-4320-9e7b-024f8968e339 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] 10.222.0.43 "GET /compute/v2.1/servers/1c1b1c42-bb4c-40e2-9248-7d746c1fb674" status: 200 len: 1320 microversion: 2.1 time: 0.349651 Oct 04 18:49:25.897608 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2213/4161] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:25 2022] GET /compute/v2.1/servers/1c1b1c42-bb4c-40e2-9248-7d746c1fb674 => generated 1320 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:49:25.903507 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-56463bc2-29de-425b-8b73-d2350f00a929 tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:25.904472 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-56463bc2-29de-425b-8b73-d2350f00a929 tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] [instance: 5dbc7ef7-31da-4c7c-a906-d5a84833f77e] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:25.911195 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-9b1885b0-7eb4-4034-b08c-1ce1f6726ff2 req-797fd93b-0502-4dea-a00e-c11e94d1f8eb service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054166 Oct 04 18:49:25.916211 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-56463bc2-29de-425b-8b73-d2350f00a929 tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:25.917012 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1949/4162] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:49:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:49:25.917555 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-56463bc2-29de-425b-8b73-d2350f00a929 tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:25.918801 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-56463bc2-29de-425b-8b73-d2350f00a929 tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:25.920940 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-56463bc2-29de-425b-8b73-d2350f00a929 tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:25.923653 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-56463bc2-29de-425b-8b73-d2350f00a929 tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:25.924592 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-56463bc2-29de-425b-8b73-d2350f00a929 tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:25.946628 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-56463bc2-29de-425b-8b73-d2350f00a929 tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] HTTP exception thrown: Instance 5dbc7ef7-31da-4c7c-a906-d5a84833f77e could not be found. Oct 04 18:49:25.948669 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-56463bc2-29de-425b-8b73-d2350f00a929 tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] Request method failure captured: Oct 04 18:49:25.948669 n-d-851028-13 devstack@n-api.service[123596]: request: GET /compute/v2.1/servers/5dbc7ef7-31da-4c7c-a906-d5a84833f77e HTTP/1.1 Oct 04 18:49:25.948669 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:49:25.948669 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:49:25.948669 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:49:25.948669 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 18:49:25.948669 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:49:25.948669 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:49:25.948669 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:49:25.948669 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:49:25.948669 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPIAaR29g1mry8llnEYLFN_Q4oVvvDUM1f5RatdhB27XYVY0NjB8Ic98N__cxsoDkEuLjj1-XEJmAMw4KkXQouZDq19J1bkpIUqceSAoN6Da8HZPVfNki7CDlcHBs5mctzng3YTTBC_Vs2u32x3_3jcfA54AiY-OGsE6lB-imS4yLCNQ Oct 04 18:49:25.948669 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:49:25.948669 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:49:25.948669 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:49:25.948669 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:49:25.948669 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:49:25.948669 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:49:25.948669 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: 45a659496a484115910b123ad9a57144 Oct 04 18:49:25.948669 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-1974226324 Oct 04 18:49:25.948669 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 18:49:25.948669 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 18:49:25.948669 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/45a659496a484115910b123ad9a57144"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_45a659496a484115910b123ad9a57144"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/45a659496a484115910b123ad9a57144"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/45a659496a484115910b123ad9a57144"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:49:25.948669 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-1974226324 Oct 04 18:49:25.948669 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: 45a659496a484115910b123ad9a57144 Oct 04 18:49:25.948669 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-1974226324 Oct 04 18:49:25.948669 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-ServerDiagnosticsNegativeTest-1974226324-project Oct 04 18:49:25.948669 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:49:25.948669 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:49:25.948669 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: e8b4654e49c9435ea151487362174118 Oct 04 18:49:25.948669 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-1974226324-project Oct 04 18:49:25.948669 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 18:49:25.948669 n-d-851028-13 devstack@n-api.service[123596]: exception: Instance 5dbc7ef7-31da-4c7c-a906-d5a84833f77e could not be found. Oct 04 18:49:25.948669 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': '5dbc7ef7-31da-4c7c-a906-d5a84833f77e'} Oct 04 18:49:25.948669 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:49:25.948669 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:49:25.948669 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:49:25.948669 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:49:25.948669 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:49:25.948669 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:49:25.948669 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:49:25.948669 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:49:25.948669 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:49:25.948669 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:49:25.948669 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5dbc7ef7-31da-4c7c-a906-d5a84833f77e could not be found. Oct 04 18:49:25.948669 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:49:25.948669 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:49:25.948669 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:49:25.948669 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:49:25.948669 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:49:25.948669 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:49:25.948669 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:49:25.948669 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:49:25.948669 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:49:25.948669 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:49:25.948669 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:49:25.948669 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:49:25.948669 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:49:25.948669 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:49:25.948669 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:49:25.948669 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:49:25.948669 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5dbc7ef7-31da-4c7c-a906-d5a84833f77e could not be found. Oct 04 18:49:25.948669 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:49:25.948669 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:49:25.953037 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:49:25.953037 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:49:25.953037 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:49:25.953037 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:49:25.953037 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:49:25.953037 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:49:25.953037 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5dbc7ef7-31da-4c7c-a906-d5a84833f77e could not be found. Oct 04 18:49:25.953037 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:49:25.956084 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-56463bc2-29de-425b-8b73-d2350f00a929 tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] Returning 404 to user: Instance 5dbc7ef7-31da-4c7c-a906-d5a84833f77e could not be found. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:49:25.957210 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-56463bc2-29de-425b-8b73-d2350f00a929 tempest-ServerDiagnosticsNegativeTest-1974226324 tempest-ServerDiagnosticsNegativeTest-1974226324-project] 10.222.0.43 "GET /compute/v2.1/servers/5dbc7ef7-31da-4c7c-a906-d5a84833f77e" status: 404 len: 111 microversion: 2.1 time: 0.058154 Oct 04 18:49:25.958007 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2214/4163] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:25 2022] GET /compute/v2.1/servers/5dbc7ef7-31da-4c7c-a906-d5a84833f77e => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:49:26.877870 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-c6bf49c6-0ca5-4498-8dda-ce55768c0555 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:26.879097 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-c6bf49c6-0ca5-4498-8dda-ce55768c0555 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 287c44c9-e70d-4492-b4b6-35bee8011596] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:26.888941 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c6bf49c6-0ca5-4498-8dda-ce55768c0555 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:26.889477 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c6bf49c6-0ca5-4498-8dda-ce55768c0555 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:26.889929 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c6bf49c6-0ca5-4498-8dda-ce55768c0555 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:26.890642 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c6bf49c6-0ca5-4498-8dda-ce55768c0555 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:26.892718 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c6bf49c6-0ca5-4498-8dda-ce55768c0555 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:26.894888 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c6bf49c6-0ca5-4498-8dda-ce55768c0555 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:26.923304 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-9cd085ec-b9fe-41ed-81c3-ba9b3f8f2795 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:26.924539 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-9cd085ec-b9fe-41ed-81c3-ba9b3f8f2795 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] [instance: 1c1b1c42-bb4c-40e2-9248-7d746c1fb674] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:26.941318 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9cd085ec-b9fe-41ed-81c3-ba9b3f8f2795 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:26.955185 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9cd085ec-b9fe-41ed-81c3-ba9b3f8f2795 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:26.955735 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9cd085ec-b9fe-41ed-81c3-ba9b3f8f2795 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:26.956494 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9cd085ec-b9fe-41ed-81c3-ba9b3f8f2795 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:26.956975 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9cd085ec-b9fe-41ed-81c3-ba9b3f8f2795 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:26.957443 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9cd085ec-b9fe-41ed-81c3-ba9b3f8f2795 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:27.236729 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-c6bf49c6-0ca5-4498-8dda-ce55768c0555 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:27.252338 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-c6bf49c6-0ca5-4498-8dda-ce55768c0555 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/287c44c9-e70d-4492-b4b6-35bee8011596" status: 200 len: 1509 microversion: 2.1 time: 0.388761 Oct 04 18:49:27.265426 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1950/4164] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:26 2022] GET /compute/v2.1/servers/287c44c9-e70d-4492-b4b6-35bee8011596 => generated 1509 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:27.400114 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-9cd085ec-b9fe-41ed-81c3-ba9b3f8f2795 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14707008940e4965ab7d1190094a71bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8f94cf1c974654a336645f453c9efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:27.431148 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-9cd085ec-b9fe-41ed-81c3-ba9b3f8f2795 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] 10.222.0.43 "GET /compute/v2.1/servers/1c1b1c42-bb4c-40e2-9248-7d746c1fb674" status: 200 len: 1320 microversion: 2.1 time: 0.507154 Oct 04 18:49:27.431881 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2215/4165] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:26 2022] GET /compute/v2.1/servers/1c1b1c42-bb4c-40e2-9248-7d746c1fb674 => generated 1320 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:49:28.286603 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-afe8accc-9981-479d-8c7c-26a11c2b499c tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:28.287223 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-afe8accc-9981-479d-8c7c-26a11c2b499c tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 287c44c9-e70d-4492-b4b6-35bee8011596] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:28.301078 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-afe8accc-9981-479d-8c7c-26a11c2b499c tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:28.301840 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-afe8accc-9981-479d-8c7c-26a11c2b499c tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:28.302443 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-afe8accc-9981-479d-8c7c-26a11c2b499c tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:28.303317 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-afe8accc-9981-479d-8c7c-26a11c2b499c tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:28.303965 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-afe8accc-9981-479d-8c7c-26a11c2b499c tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:28.304609 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-afe8accc-9981-479d-8c7c-26a11c2b499c tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:28.455010 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-74e4d13e-a8b0-4f64-908f-e54e4b9edf06 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:28.455640 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-74e4d13e-a8b0-4f64-908f-e54e4b9edf06 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] [instance: 1c1b1c42-bb4c-40e2-9248-7d746c1fb674] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:28.470212 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-74e4d13e-a8b0-4f64-908f-e54e4b9edf06 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:28.470714 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-74e4d13e-a8b0-4f64-908f-e54e4b9edf06 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:28.471168 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-74e4d13e-a8b0-4f64-908f-e54e4b9edf06 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:28.471886 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-74e4d13e-a8b0-4f64-908f-e54e4b9edf06 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:28.472349 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-74e4d13e-a8b0-4f64-908f-e54e4b9edf06 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:28.472783 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-74e4d13e-a8b0-4f64-908f-e54e4b9edf06 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:28.673586 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-afe8accc-9981-479d-8c7c-26a11c2b499c tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:28.683484 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-afe8accc-9981-479d-8c7c-26a11c2b499c tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/287c44c9-e70d-4492-b4b6-35bee8011596" status: 200 len: 1509 microversion: 2.1 time: 0.400563 Oct 04 18:49:28.687669 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1951/4166] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:28 2022] GET /compute/v2.1/servers/287c44c9-e70d-4492-b4b6-35bee8011596 => generated 1509 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:28.779715 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-74e4d13e-a8b0-4f64-908f-e54e4b9edf06 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14707008940e4965ab7d1190094a71bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8f94cf1c974654a336645f453c9efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:28.791784 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-74e4d13e-a8b0-4f64-908f-e54e4b9edf06 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] 10.222.0.43 "GET /compute/v2.1/servers/1c1b1c42-bb4c-40e2-9248-7d746c1fb674" status: 200 len: 1501 microversion: 2.1 time: 0.340744 Oct 04 18:49:28.795358 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2216/4167] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:28 2022] GET /compute/v2.1/servers/1c1b1c42-bb4c-40e2-9248-7d746c1fb674 => generated 1501 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:49:28.822075 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-13fa33e0-5e54-4c03-a724-53fe9f450676 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:28.822859 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-13fa33e0-5e54-4c03-a724-53fe9f450676 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] [instance: 1c1b1c42-bb4c-40e2-9248-7d746c1fb674] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:28.831836 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-13fa33e0-5e54-4c03-a724-53fe9f450676 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:28.833860 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-13fa33e0-5e54-4c03-a724-53fe9f450676 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:28.834819 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-13fa33e0-5e54-4c03-a724-53fe9f450676 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:28.836112 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-13fa33e0-5e54-4c03-a724-53fe9f450676 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:28.849995 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-13fa33e0-5e54-4c03-a724-53fe9f450676 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:28.850599 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-13fa33e0-5e54-4c03-a724-53fe9f450676 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:29.711620 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-2d94edc9-40f0-455d-a22a-1a87f5342468 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:29.712243 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-2d94edc9-40f0-455d-a22a-1a87f5342468 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 287c44c9-e70d-4492-b4b6-35bee8011596] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:29.726758 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2d94edc9-40f0-455d-a22a-1a87f5342468 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:29.727455 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2d94edc9-40f0-455d-a22a-1a87f5342468 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:29.728108 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2d94edc9-40f0-455d-a22a-1a87f5342468 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:29.729005 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2d94edc9-40f0-455d-a22a-1a87f5342468 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:29.733203 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2d94edc9-40f0-455d-a22a-1a87f5342468 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:29.733854 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2d94edc9-40f0-455d-a22a-1a87f5342468 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:29.871156 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-13fa33e0-5e54-4c03-a724-53fe9f450676 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14707008940e4965ab7d1190094a71bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8f94cf1c974654a336645f453c9efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:29.883881 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-13fa33e0-5e54-4c03-a724-53fe9f450676 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] 10.222.0.43 "GET /compute/v2.1/servers/1c1b1c42-bb4c-40e2-9248-7d746c1fb674" status: 200 len: 1501 microversion: 2.1 time: 1.065677 Oct 04 18:49:29.884882 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1952/4168] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:28 2022] GET /compute/v2.1/servers/1c1b1c42-bb4c-40e2-9248-7d746c1fb674 => generated 1501 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:29.913708 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-0faa1df3-be35-4335-8fe3-87105f693ef6 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:29.914794 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-0faa1df3-be35-4335-8fe3-87105f693ef6 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] [instance: 1c1b1c42-bb4c-40e2-9248-7d746c1fb674] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:29.929200 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0faa1df3-be35-4335-8fe3-87105f693ef6 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:29.931006 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0faa1df3-be35-4335-8fe3-87105f693ef6 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:29.931733 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0faa1df3-be35-4335-8fe3-87105f693ef6 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:29.933574 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0faa1df3-be35-4335-8fe3-87105f693ef6 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:29.934426 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0faa1df3-be35-4335-8fe3-87105f693ef6 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:29.937399 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0faa1df3-be35-4335-8fe3-87105f693ef6 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:30.004490 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-2d94edc9-40f0-455d-a22a-1a87f5342468 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:30.013956 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-2d94edc9-40f0-455d-a22a-1a87f5342468 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/287c44c9-e70d-4492-b4b6-35bee8011596" status: 200 len: 1509 microversion: 2.1 time: 0.306243 Oct 04 18:49:30.017653 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2217/4169] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:29 2022] GET /compute/v2.1/servers/287c44c9-e70d-4492-b4b6-35bee8011596 => generated 1509 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:49:30.020437 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-0faa1df3-be35-4335-8fe3-87105f693ef6 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] [instance: 1c1b1c42-bb4c-40e2-9248-7d746c1fb674] Going to try to terminate instance {{(pid=123595) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:49:30.207217 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-0faa1df3-be35-4335-8fe3-87105f693ef6 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] 10.222.0.43 "DELETE /compute/v2.1/servers/1c1b1c42-bb4c-40e2-9248-7d746c1fb674" status: 204 len: 0 microversion: 2.1 time: 0.303028 Oct 04 18:49:30.208051 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1953/4170] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 18:49:29 2022] DELETE /compute/v2.1/servers/1c1b1c42-bb4c-40e2-9248-7d746c1fb674 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:49:30.221318 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-ebdcd065-362c-4044-87a6-6e3b7cadc90c tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:30.221318 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-ebdcd065-362c-4044-87a6-6e3b7cadc90c tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] [instance: 1c1b1c42-bb4c-40e2-9248-7d746c1fb674] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:30.229774 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ebdcd065-362c-4044-87a6-6e3b7cadc90c tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:30.230281 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ebdcd065-362c-4044-87a6-6e3b7cadc90c tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:30.230732 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ebdcd065-362c-4044-87a6-6e3b7cadc90c tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:30.231795 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ebdcd065-362c-4044-87a6-6e3b7cadc90c tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:30.232260 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ebdcd065-362c-4044-87a6-6e3b7cadc90c tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:30.232748 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ebdcd065-362c-4044-87a6-6e3b7cadc90c tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:30.424974 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-ebdcd065-362c-4044-87a6-6e3b7cadc90c tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14707008940e4965ab7d1190094a71bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8f94cf1c974654a336645f453c9efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:30.436538 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-ebdcd065-362c-4044-87a6-6e3b7cadc90c tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] 10.222.0.43 "GET /compute/v2.1/servers/1c1b1c42-bb4c-40e2-9248-7d746c1fb674" status: 200 len: 1507 microversion: 2.1 time: 0.223218 Oct 04 18:49:30.437462 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2218/4171] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:30 2022] GET /compute/v2.1/servers/1c1b1c42-bb4c-40e2-9248-7d746c1fb674 => generated 1507 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:49:31.040078 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-58a1fb58-30c8-42f3-8885-91244f3bdd33 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:31.041010 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-58a1fb58-30c8-42f3-8885-91244f3bdd33 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 287c44c9-e70d-4492-b4b6-35bee8011596] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:31.055314 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-58a1fb58-30c8-42f3-8885-91244f3bdd33 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:31.060482 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-58a1fb58-30c8-42f3-8885-91244f3bdd33 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:31.061465 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-58a1fb58-30c8-42f3-8885-91244f3bdd33 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:31.062450 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-58a1fb58-30c8-42f3-8885-91244f3bdd33 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:31.063111 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-58a1fb58-30c8-42f3-8885-91244f3bdd33 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:31.063734 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-58a1fb58-30c8-42f3-8885-91244f3bdd33 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:31.300243 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-58a1fb58-30c8-42f3-8885-91244f3bdd33 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:31.324355 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-58a1fb58-30c8-42f3-8885-91244f3bdd33 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/287c44c9-e70d-4492-b4b6-35bee8011596" status: 200 len: 1506 microversion: 2.1 time: 0.288465 Oct 04 18:49:31.344583 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1954/4172] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:31 2022] GET /compute/v2.1/servers/287c44c9-e70d-4492-b4b6-35bee8011596 => generated 1506 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:31.460626 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-5ee62146-7e4a-4d01-b2a5-9b6781b5f611 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:31.461445 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-5ee62146-7e4a-4d01-b2a5-9b6781b5f611 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] [instance: 1c1b1c42-bb4c-40e2-9248-7d746c1fb674] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:31.475425 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5ee62146-7e4a-4d01-b2a5-9b6781b5f611 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:31.477661 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5ee62146-7e4a-4d01-b2a5-9b6781b5f611 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:31.478611 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5ee62146-7e4a-4d01-b2a5-9b6781b5f611 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:31.480915 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5ee62146-7e4a-4d01-b2a5-9b6781b5f611 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:31.481603 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5ee62146-7e4a-4d01-b2a5-9b6781b5f611 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:31.483848 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5ee62146-7e4a-4d01-b2a5-9b6781b5f611 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:31.857371 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-5ee62146-7e4a-4d01-b2a5-9b6781b5f611 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14707008940e4965ab7d1190094a71bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8f94cf1c974654a336645f453c9efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:31.870593 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-5ee62146-7e4a-4d01-b2a5-9b6781b5f611 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] 10.222.0.43 "GET /compute/v2.1/servers/1c1b1c42-bb4c-40e2-9248-7d746c1fb674" status: 200 len: 1507 microversion: 2.1 time: 0.411814 Oct 04 18:49:31.886358 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2219/4173] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:31 2022] GET /compute/v2.1/servers/1c1b1c42-bb4c-40e2-9248-7d746c1fb674 => generated 1507 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:32.358745 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-c818770e-d510-4be1-8966-7c2490568226 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:32.360464 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-c818770e-d510-4be1-8966-7c2490568226 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 287c44c9-e70d-4492-b4b6-35bee8011596] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:32.370711 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c818770e-d510-4be1-8966-7c2490568226 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:32.371878 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c818770e-d510-4be1-8966-7c2490568226 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:32.372777 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c818770e-d510-4be1-8966-7c2490568226 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:32.374198 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c818770e-d510-4be1-8966-7c2490568226 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:32.375410 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c818770e-d510-4be1-8966-7c2490568226 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:32.376070 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c818770e-d510-4be1-8966-7c2490568226 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:32.680098 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-c818770e-d510-4be1-8966-7c2490568226 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:32.693055 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-c818770e-d510-4be1-8966-7c2490568226 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/287c44c9-e70d-4492-b4b6-35bee8011596" status: 200 len: 1506 microversion: 2.1 time: 0.339617 Oct 04 18:49:32.693711 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1955/4174] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:32 2022] GET /compute/v2.1/servers/287c44c9-e70d-4492-b4b6-35bee8011596 => generated 1506 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:32.899393 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-75ba46b2-3529-48d3-b620-5c5f2b5d08cd tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:32.900600 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-75ba46b2-3529-48d3-b620-5c5f2b5d08cd tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] [instance: 1c1b1c42-bb4c-40e2-9248-7d746c1fb674] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:32.925039 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-75ba46b2-3529-48d3-b620-5c5f2b5d08cd tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:32.928758 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-75ba46b2-3529-48d3-b620-5c5f2b5d08cd tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:32.936247 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-75ba46b2-3529-48d3-b620-5c5f2b5d08cd tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:32.937366 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-75ba46b2-3529-48d3-b620-5c5f2b5d08cd tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:32.938044 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-75ba46b2-3529-48d3-b620-5c5f2b5d08cd tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:32.938564 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-75ba46b2-3529-48d3-b620-5c5f2b5d08cd tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:32.974309 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-df329730-b7e8-432f-8114-d48a9883be1f req-4257dfcb-2422-40f0-8954-cc7be215bb01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c1b1c42-bb4c-40e2-9248-7d746c1fb674", "name": "network-vif-deleted", "tag": "aaaea0be-4533-4a87-b68d-3fc71cd5dc25"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:49:32.989324 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-df329730-b7e8-432f-8114-d48a9883be1f req-4257dfcb-2422-40f0-8954-cc7be215bb01 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:32.991000 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-df329730-b7e8-432f-8114-d48a9883be1f req-4257dfcb-2422-40f0-8954-cc7be215bb01 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:32.991717 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-df329730-b7e8-432f-8114-d48a9883be1f req-4257dfcb-2422-40f0-8954-cc7be215bb01 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:33.032411 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-df329730-b7e8-432f-8114-d48a9883be1f req-4257dfcb-2422-40f0-8954-cc7be215bb01 service nova] Creating event network-vif-deleted:aaaea0be-4533-4a87-b68d-3fc71cd5dc25 for instance 1c1b1c42-bb4c-40e2-9248-7d746c1fb674 on n-h1-851028-13 Oct 04 18:49:33.064336 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-df329730-b7e8-432f-8114-d48a9883be1f req-4257dfcb-2422-40f0-8954-cc7be215bb01 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095519 Oct 04 18:49:33.065521 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1956/4175] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:49:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:49:33.194065 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-75ba46b2-3529-48d3-b620-5c5f2b5d08cd tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14707008940e4965ab7d1190094a71bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8f94cf1c974654a336645f453c9efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:33.207326 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-75ba46b2-3529-48d3-b620-5c5f2b5d08cd tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] 10.222.0.43 "GET /compute/v2.1/servers/1c1b1c42-bb4c-40e2-9248-7d746c1fb674" status: 200 len: 1465 microversion: 2.1 time: 0.313246 Oct 04 18:49:33.208271 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2220/4176] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:32 2022] GET /compute/v2.1/servers/1c1b1c42-bb4c-40e2-9248-7d746c1fb674 => generated 1465 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:33.719298 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-c9924326-2915-4fb1-811e-922f5f408694 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:33.720055 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-c9924326-2915-4fb1-811e-922f5f408694 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 287c44c9-e70d-4492-b4b6-35bee8011596] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:33.730764 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c9924326-2915-4fb1-811e-922f5f408694 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:33.731249 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c9924326-2915-4fb1-811e-922f5f408694 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:33.731690 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c9924326-2915-4fb1-811e-922f5f408694 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:33.736166 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c9924326-2915-4fb1-811e-922f5f408694 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:33.736722 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c9924326-2915-4fb1-811e-922f5f408694 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:33.738416 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c9924326-2915-4fb1-811e-922f5f408694 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:34.005071 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-c9924326-2915-4fb1-811e-922f5f408694 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:34.029710 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:49:34.039391 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-c9924326-2915-4fb1-811e-922f5f408694 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/287c44c9-e70d-4492-b4b6-35bee8011596" status: 200 len: 1506 microversion: 2.1 time: 0.323291 Oct 04 18:49:34.042484 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1957/4177] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:33 2022] GET /compute/v2.1/servers/287c44c9-e70d-4492-b4b6-35bee8011596 => generated 1506 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:49:34.239457 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-dacfd8c8-498a-45b1-8f9e-377db79e81f8 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:34.240721 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-dacfd8c8-498a-45b1-8f9e-377db79e81f8 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] [instance: 1c1b1c42-bb4c-40e2-9248-7d746c1fb674] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:34.268833 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dacfd8c8-498a-45b1-8f9e-377db79e81f8 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:34.270972 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dacfd8c8-498a-45b1-8f9e-377db79e81f8 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:34.271469 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dacfd8c8-498a-45b1-8f9e-377db79e81f8 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:34.272185 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dacfd8c8-498a-45b1-8f9e-377db79e81f8 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:34.272710 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dacfd8c8-498a-45b1-8f9e-377db79e81f8 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:34.273170 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dacfd8c8-498a-45b1-8f9e-377db79e81f8 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:34.316958 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-dacfd8c8-498a-45b1-8f9e-377db79e81f8 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] HTTP exception thrown: Instance 1c1b1c42-bb4c-40e2-9248-7d746c1fb674 could not be found. Oct 04 18:49:34.319419 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-dacfd8c8-498a-45b1-8f9e-377db79e81f8 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Request method failure captured: Oct 04 18:49:34.319419 n-d-851028-13 devstack@n-api.service[123596]: request: GET /compute/v2.1/servers/1c1b1c42-bb4c-40e2-9248-7d746c1fb674 HTTP/1.1 Oct 04 18:49:34.319419 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:49:34.319419 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:49:34.319419 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:49:34.319419 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 18:49:34.319419 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:49:34.319419 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:49:34.319419 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:49:34.319419 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:49:34.319419 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPIAJxznq_dqRpKBeHYz_tTt-BPe6PGX8bXmZXSSSBar-nAl3_7gjSqUW3yyr2J4Kw1m1-l6Y2izmzOt3P0Lv3UhhGPTaACGzV6RGiSkRczLrMXORtXSdyVIiZq3MCL7L2uQGd29MwUZa7-C3NoIEqHwDxvVJi_WWjtFyKnOFEp1-BZ0 Oct 04 18:49:34.319419 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:49:34.319419 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:49:34.319419 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:49:34.319419 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:49:34.319419 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:49:34.319419 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:49:34.319419 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: ed8f94cf1c974654a336645f453c9efc Oct 04 18:49:34.319419 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-ServersTestJSON-546754383 Oct 04 18:49:34.319419 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 18:49:34.319419 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 18:49:34.319419 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/ed8f94cf1c974654a336645f453c9efc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_ed8f94cf1c974654a336645f453c9efc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ed8f94cf1c974654a336645f453c9efc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ed8f94cf1c974654a336645f453c9efc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:49:34.319419 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-ServersTestJSON-546754383 Oct 04 18:49:34.319419 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: ed8f94cf1c974654a336645f453c9efc Oct 04 18:49:34.319419 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-ServersTestJSON-546754383 Oct 04 18:49:34.319419 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-ServersTestJSON-546754383-project Oct 04 18:49:34.319419 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:49:34.319419 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:49:34.319419 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 14707008940e4965ab7d1190094a71bb Oct 04 18:49:34.319419 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-ServersTestJSON-546754383-project Oct 04 18:49:34.319419 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 18:49:34.319419 n-d-851028-13 devstack@n-api.service[123596]: exception: Instance 1c1b1c42-bb4c-40e2-9248-7d746c1fb674 could not be found. Oct 04 18:49:34.319419 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': '1c1b1c42-bb4c-40e2-9248-7d746c1fb674'} Oct 04 18:49:34.319419 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:49:34.319419 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:49:34.319419 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:49:34.319419 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:49:34.319419 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:49:34.319419 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:49:34.319419 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:49:34.319419 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:49:34.319419 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:49:34.319419 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:49:34.319419 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c1b1c42-bb4c-40e2-9248-7d746c1fb674 could not be found. Oct 04 18:49:34.319419 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:49:34.319419 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:49:34.319419 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:49:34.319419 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:49:34.319419 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:49:34.319419 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:49:34.319419 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:49:34.319419 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:49:34.319419 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:49:34.319419 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:49:34.319419 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:49:34.319419 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:49:34.319419 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:49:34.319419 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:49:34.319419 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:49:34.319419 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:49:34.319419 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c1b1c42-bb4c-40e2-9248-7d746c1fb674 could not be found. Oct 04 18:49:34.319419 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:49:34.319419 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:49:34.319419 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:49:34.319419 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:49:34.324762 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:49:34.324762 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:49:34.324762 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:49:34.324762 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:49:34.324762 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c1b1c42-bb4c-40e2-9248-7d746c1fb674 could not be found. Oct 04 18:49:34.324762 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:49:34.329489 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-dacfd8c8-498a-45b1-8f9e-377db79e81f8 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Returning 404 to user: Instance 1c1b1c42-bb4c-40e2-9248-7d746c1fb674 could not be found. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:49:34.329489 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-dacfd8c8-498a-45b1-8f9e-377db79e81f8 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] 10.222.0.43 "GET /compute/v2.1/servers/1c1b1c42-bb4c-40e2-9248-7d746c1fb674" status: 404 len: 111 microversion: 2.1 time: 0.099585 Oct 04 18:49:34.331169 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2221/4178] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:34 2022] GET /compute/v2.1/servers/1c1b1c42-bb4c-40e2-9248-7d746c1fb674 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:49:34.349065 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-b5083b78-098a-4bdb-a9e6-013fe493c217 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Action: 'create', calling method: .version_select at 0x7fb21eaacd30>, body: {"keypair": {"name": "tempest-key-1703616584", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDJdFEMq5lwdQrkdj26xZCFYAT/9D0ZFlR1sFkka86mlNYkV9/a6L6PL6/cs+po3tjFX+b2mf5kxzRFG871sJ+mUl4J/3furEcPhMfodxLa8infVbEbo7m9zBRI9RUNQZg=="}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:49:34.372458 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-b5083b78-098a-4bdb-a9e6-013fe493c217 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Getting quotas for project ed8f94cf1c974654a336645f453c9efc. Resources: {'key_pairs'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:49:34.380796 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-b5083b78-098a-4bdb-a9e6-013fe493c217 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Getting quotas for user 14707008940e4965ab7d1190094a71bb and project ed8f94cf1c974654a336645f453c9efc. Resources: {'key_pairs'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:49:34.414852 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-b5083b78-098a-4bdb-a9e6-013fe493c217 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 382 microversion: 2.1 time: 0.074605 Oct 04 18:49:34.415823 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1958/4179] 10.222.0.43 () {60 vars in 1159 bytes} [Tue Oct 4 18:49:34 2022] POST /compute/v2.1/os-keypairs => generated 382 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:49:34.430469 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-a229fc9e-5bce-4130-9387-ff50b16afd38 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Calling method '.version_select at 0x7fb21e8eb1f0>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:34.444618 n-d-851028-13 devstack@n-api.service[123596]: WARNING oslo_db.sqlalchemy.utils [None req-a229fc9e-5bce-4130-9387-ff50b16afd38 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 04 18:49:34.456096 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-a229fc9e-5bce-4130-9387-ff50b16afd38 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] 10.222.0.43 "GET /compute/v2.1/os-keypairs" status: 200 len: 351 microversion: 2.1 time: 0.032595 Oct 04 18:49:34.457746 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2222/4180] 10.222.0.43 () {58 vars in 1137 bytes} [Tue Oct 4 18:49:34 2022] GET /compute/v2.1/os-keypairs => generated 351 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:49:34.677551 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-b9b1623b-07ad-4680-ba81-a4c99c42fb73 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-377691459", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452", "key_name": "tempest-key-1703616584", "networks": [{"uuid": "4a1417e9-f3af-46cb-a463-32dd1c79c4e9"}]}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:49:34.758170 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.network.neutron [None req-b9b1623b-07ad-4680-ba81-a4c99c42fb73 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] validate_networks() for [('4a1417e9-f3af-46cb-a463-32dd1c79c4e9', None, None, None, None, None)] {{(pid=123595) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:49:35.069048 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-451f238e-62b7-461c-acd5-15c6b20f89ea tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:35.069697 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-451f238e-62b7-461c-acd5-15c6b20f89ea tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 287c44c9-e70d-4492-b4b6-35bee8011596] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:35.081630 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-451f238e-62b7-461c-acd5-15c6b20f89ea tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:35.085383 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-451f238e-62b7-461c-acd5-15c6b20f89ea tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:35.088055 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-451f238e-62b7-461c-acd5-15c6b20f89ea tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:35.089029 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-451f238e-62b7-461c-acd5-15c6b20f89ea tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:35.089697 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-451f238e-62b7-461c-acd5-15c6b20f89ea tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:35.091875 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-451f238e-62b7-461c-acd5-15c6b20f89ea tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:35.437530 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-451f238e-62b7-461c-acd5-15c6b20f89ea tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:35.448451 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-451f238e-62b7-461c-acd5-15c6b20f89ea tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/287c44c9-e70d-4492-b4b6-35bee8011596" status: 200 len: 1449 microversion: 2.1 time: 0.384013 Oct 04 18:49:35.452724 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2223/4181] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:35 2022] GET /compute/v2.1/servers/287c44c9-e70d-4492-b4b6-35bee8011596 => generated 1449 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:35.474209 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-b515aeba-9af5-42a6-bda9-b20c07cfe56d tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:35.474827 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-b515aeba-9af5-42a6-bda9-b20c07cfe56d tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 82b86465-afb0-49ef-9932-1538010c1ae5] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:35.486278 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b515aeba-9af5-42a6-bda9-b20c07cfe56d tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:35.491899 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b515aeba-9af5-42a6-bda9-b20c07cfe56d tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:35.492454 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b515aeba-9af5-42a6-bda9-b20c07cfe56d tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:35.493230 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b515aeba-9af5-42a6-bda9-b20c07cfe56d tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:35.494107 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b515aeba-9af5-42a6-bda9-b20c07cfe56d tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:35.494688 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b515aeba-9af5-42a6-bda9-b20c07cfe56d tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:35.571491 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-b9b1623b-07ad-4680-ba81-a4c99c42fb73 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Flavor limits 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:49:35.572568 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-b9b1623b-07ad-4680-ba81-a4c99c42fb73 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Image limits 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:49:35.573518 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-b9b1623b-07ad-4680-ba81-a4c99c42fb73 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Flavor pref 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:49:35.574379 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-b9b1623b-07ad-4680-ba81-a4c99c42fb73 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Image pref 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:49:35.575132 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-b9b1623b-07ad-4680-ba81-a4c99c42fb73 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:49:35.603600 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b9b1623b-07ad-4680-ba81-a4c99c42fb73 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:35.604349 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b9b1623b-07ad-4680-ba81-a4c99c42fb73 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:35.607385 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b9b1623b-07ad-4680-ba81-a4c99c42fb73 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:35.608549 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b9b1623b-07ad-4680-ba81-a4c99c42fb73 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:35.611035 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b9b1623b-07ad-4680-ba81-a4c99c42fb73 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:35.612206 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b9b1623b-07ad-4680-ba81-a4c99c42fb73 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:35.640561 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-b9b1623b-07ad-4680-ba81-a4c99c42fb73 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Getting quotas for project ed8f94cf1c974654a336645f453c9efc. Resources: {'ram', 'cores', 'instances'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:49:35.646838 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-b9b1623b-07ad-4680-ba81-a4c99c42fb73 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Getting quotas for user 14707008940e4965ab7d1190094a71bb and project ed8f94cf1c974654a336645f453c9efc. Resources: {'ram', 'cores', 'instances'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:49:35.662040 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-b9b1623b-07ad-4680-ba81-a4c99c42fb73 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Going to run 1 instances... {{(pid=123595) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:49:35.664565 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-b9b1623b-07ad-4680-ba81-a4c99c42fb73 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] [instance: 4275d1a7-42d6-4af5-be51-64fb1c4f6fad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e8943ec5-4038-4d4b-b9b9-2415a79f5243',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:49:35.722967 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-b9b1623b-07ad-4680-ba81-a4c99c42fb73 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.050848 Oct 04 18:49:35.724202 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1959/4182] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 18:49:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 1053 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 18:49:35.735314 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-1d0cc7dd-4557-457a-a364-0658c19fbd31 req-626be2c1-6a44-410d-ab71-52f8fe0b7ed8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "287c44c9-e70d-4492-b4b6-35bee8011596", "name": "network-vif-unplugged", "status": "completed", "tag": "37fe4acb-5d41-4bcb-9278-e11389be7c1d"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:49:35.749563 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-1d0cc7dd-4557-457a-a364-0658c19fbd31 req-626be2c1-6a44-410d-ab71-52f8fe0b7ed8 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:35.750357 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-1d0cc7dd-4557-457a-a364-0658c19fbd31 req-626be2c1-6a44-410d-ab71-52f8fe0b7ed8 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:35.750954 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-1d0cc7dd-4557-457a-a364-0658c19fbd31 req-626be2c1-6a44-410d-ab71-52f8fe0b7ed8 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:35.772784 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.compute.server_external_events [req-1d0cc7dd-4557-457a-a364-0658c19fbd31 req-626be2c1-6a44-410d-ab71-52f8fe0b7ed8 service nova] Unable to find a host for instance 287c44c9-e70d-4492-b4b6-35bee8011596. Dropping event network-vif-unplugged {{(pid=123595) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 04 18:49:35.774434 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-1d0cc7dd-4557-457a-a364-0658c19fbd31 req-626be2c1-6a44-410d-ab71-52f8fe0b7ed8 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.049125 Oct 04 18:49:35.776078 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1960/4183] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:49:35 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 51 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 04 18:49:35.781792 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-10901f74-0c90-4b59-9d86-4a9bd8d7ac6e tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:35.782602 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-10901f74-0c90-4b59-9d86-4a9bd8d7ac6e tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] [instance: 4275d1a7-42d6-4af5-be51-64fb1c4f6fad] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:35.848590 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-10901f74-0c90-4b59-9d86-4a9bd8d7ac6e tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14707008940e4965ab7d1190094a71bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8f94cf1c974654a336645f453c9efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:35.856429 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-10901f74-0c90-4b59-9d86-4a9bd8d7ac6e tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] 10.222.0.43 "GET /compute/v2.1/servers/4275d1a7-42d6-4af5-be51-64fb1c4f6fad" status: 200 len: 1228 microversion: 2.1 time: 0.079097 Oct 04 18:49:35.858358 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1961/4184] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:35 2022] GET /compute/v2.1/servers/4275d1a7-42d6-4af5-be51-64fb1c4f6fad => generated 1228 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:36.121369 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-b515aeba-9af5-42a6-bda9-b20c07cfe56d tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:36.131318 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-b515aeba-9af5-42a6-bda9-b20c07cfe56d tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5" status: 200 len: 1667 microversion: 2.1 time: 0.661831 Oct 04 18:49:36.133579 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2224/4185] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:35 2022] GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5 => generated 1667 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:36.169183 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-9a45dcdc-895c-4ecc-a562-13b91aa93b82 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:36.170198 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-9a45dcdc-895c-4ecc-a562-13b91aa93b82 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 82b86465-afb0-49ef-9932-1538010c1ae5] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:36.184342 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9a45dcdc-895c-4ecc-a562-13b91aa93b82 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:36.185641 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9a45dcdc-895c-4ecc-a562-13b91aa93b82 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:36.187199 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9a45dcdc-895c-4ecc-a562-13b91aa93b82 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:36.188265 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9a45dcdc-895c-4ecc-a562-13b91aa93b82 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:36.189095 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9a45dcdc-895c-4ecc-a562-13b91aa93b82 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:36.191208 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9a45dcdc-895c-4ecc-a562-13b91aa93b82 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:36.452667 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-9a45dcdc-895c-4ecc-a562-13b91aa93b82 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:36.462467 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-9a45dcdc-895c-4ecc-a562-13b91aa93b82 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5" status: 200 len: 1667 microversion: 2.1 time: 0.300607 Oct 04 18:49:36.474042 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1962/4186] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:36 2022] GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5 => generated 1667 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:36.485650 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-6648c30b-3b73-485e-ae9f-5a3e1efb6818 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:36.486169 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-6648c30b-3b73-485e-ae9f-5a3e1efb6818 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 82b86465-afb0-49ef-9932-1538010c1ae5] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:36.500700 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6648c30b-3b73-485e-ae9f-5a3e1efb6818 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:36.501610 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6648c30b-3b73-485e-ae9f-5a3e1efb6818 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:36.502391 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6648c30b-3b73-485e-ae9f-5a3e1efb6818 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:36.504128 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6648c30b-3b73-485e-ae9f-5a3e1efb6818 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:36.504740 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6648c30b-3b73-485e-ae9f-5a3e1efb6818 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:36.505361 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6648c30b-3b73-485e-ae9f-5a3e1efb6818 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:36.827813 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-6648c30b-3b73-485e-ae9f-5a3e1efb6818 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:36.841650 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-6648c30b-3b73-485e-ae9f-5a3e1efb6818 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5" status: 200 len: 1667 microversion: 2.1 time: 0.359552 Oct 04 18:49:36.842970 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2225/4187] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:36 2022] GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5 => generated 1667 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:36.864757 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-8b402876-15fa-414a-ab2c-a05f8b2a5119 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:36.865417 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-8b402876-15fa-414a-ab2c-a05f8b2a5119 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 82b86465-afb0-49ef-9932-1538010c1ae5] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:36.872735 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8b402876-15fa-414a-ab2c-a05f8b2a5119 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:36.873632 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8b402876-15fa-414a-ab2c-a05f8b2a5119 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:36.874239 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8b402876-15fa-414a-ab2c-a05f8b2a5119 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:36.875110 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8b402876-15fa-414a-ab2c-a05f8b2a5119 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:36.881398 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-e0cb87b6-457f-4995-8e28-38369c14702f tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:36.882245 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-e0cb87b6-457f-4995-8e28-38369c14702f tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] [instance: 4275d1a7-42d6-4af5-be51-64fb1c4f6fad] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:36.886299 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8b402876-15fa-414a-ab2c-a05f8b2a5119 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:36.888566 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8b402876-15fa-414a-ab2c-a05f8b2a5119 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:36.895837 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e0cb87b6-457f-4995-8e28-38369c14702f tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:36.896598 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e0cb87b6-457f-4995-8e28-38369c14702f tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:36.897245 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e0cb87b6-457f-4995-8e28-38369c14702f tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:36.898101 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e0cb87b6-457f-4995-8e28-38369c14702f tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:36.898715 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e0cb87b6-457f-4995-8e28-38369c14702f tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:36.901674 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e0cb87b6-457f-4995-8e28-38369c14702f tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:37.052903 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-e0cb87b6-457f-4995-8e28-38369c14702f tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14707008940e4965ab7d1190094a71bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8f94cf1c974654a336645f453c9efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:37.073484 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-e0cb87b6-457f-4995-8e28-38369c14702f tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] 10.222.0.43 "GET /compute/v2.1/servers/4275d1a7-42d6-4af5-be51-64fb1c4f6fad" status: 200 len: 1224 microversion: 2.1 time: 0.196557 Oct 04 18:49:37.089283 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2226/4188] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:36 2022] GET /compute/v2.1/servers/4275d1a7-42d6-4af5-be51-64fb1c4f6fad => generated 1224 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:49:37.133556 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-8b402876-15fa-414a-ab2c-a05f8b2a5119 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:37.144635 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-8b402876-15fa-414a-ab2c-a05f8b2a5119 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5" status: 200 len: 1667 microversion: 2.1 time: 0.284068 Oct 04 18:49:37.157965 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1963/4189] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:36 2022] GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5 => generated 1667 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:37.178931 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-c30717e2-eb18-4701-80c5-3cc4ad2330ee tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:49:37.199665 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c30717e2-eb18-4701-80c5-3cc4ad2330ee tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:37.200494 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c30717e2-eb18-4701-80c5-3cc4ad2330ee tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:37.201163 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c30717e2-eb18-4701-80c5-3cc4ad2330ee tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:37.238658 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-c30717e2-eb18-4701-80c5-3cc4ad2330ee tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 82b86465-afb0-49ef-9932-1538010c1ae5] Going to try to stop instance {{(pid=123596) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 04 18:49:37.291587 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=100 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:49:37.356889 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-c30717e2-eb18-4701-80c5-3cc4ad2330ee tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "POST /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5/action" status: 202 len: 0 microversion: 2.1 time: 0.174249 Oct 04 18:49:37.358815 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2227/4190] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 18:49:37 2022] POST /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5/action => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 18:49:37.369040 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-50539b67-c7a7-4dbb-bc31-3a36cf4e0cd5 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:37.370008 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-50539b67-c7a7-4dbb-bc31-3a36cf4e0cd5 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 82b86465-afb0-49ef-9932-1538010c1ae5] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:37.382817 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-50539b67-c7a7-4dbb-bc31-3a36cf4e0cd5 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:37.386113 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-50539b67-c7a7-4dbb-bc31-3a36cf4e0cd5 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:37.386877 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-50539b67-c7a7-4dbb-bc31-3a36cf4e0cd5 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:37.387885 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-50539b67-c7a7-4dbb-bc31-3a36cf4e0cd5 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:37.390445 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-50539b67-c7a7-4dbb-bc31-3a36cf4e0cd5 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:37.391024 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-50539b67-c7a7-4dbb-bc31-3a36cf4e0cd5 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:37.611642 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-50539b67-c7a7-4dbb-bc31-3a36cf4e0cd5 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:37.627574 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-50539b67-c7a7-4dbb-bc31-3a36cf4e0cd5 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5" status: 200 len: 1677 microversion: 2.1 time: 0.263190 Oct 04 18:49:37.628453 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1964/4191] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:37 2022] GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5 => generated 1677 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:38.102171 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-7f1b2cba-0d62-424e-ab44-7dc3be9728f0 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:38.102887 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-7f1b2cba-0d62-424e-ab44-7dc3be9728f0 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] [instance: 4275d1a7-42d6-4af5-be51-64fb1c4f6fad] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:38.111548 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7f1b2cba-0d62-424e-ab44-7dc3be9728f0 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:38.112792 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7f1b2cba-0d62-424e-ab44-7dc3be9728f0 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:38.113266 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7f1b2cba-0d62-424e-ab44-7dc3be9728f0 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:38.114145 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7f1b2cba-0d62-424e-ab44-7dc3be9728f0 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:38.115132 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7f1b2cba-0d62-424e-ab44-7dc3be9728f0 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:38.115574 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7f1b2cba-0d62-424e-ab44-7dc3be9728f0 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:38.316997 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-7f1b2cba-0d62-424e-ab44-7dc3be9728f0 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14707008940e4965ab7d1190094a71bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8f94cf1c974654a336645f453c9efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:38.331188 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-7f1b2cba-0d62-424e-ab44-7dc3be9728f0 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] 10.222.0.43 "GET /compute/v2.1/servers/4275d1a7-42d6-4af5-be51-64fb1c4f6fad" status: 200 len: 1288 microversion: 2.1 time: 0.235446 Oct 04 18:49:38.331783 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2228/4192] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:38 2022] GET /compute/v2.1/servers/4275d1a7-42d6-4af5-be51-64fb1c4f6fad => generated 1288 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:38.654097 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-c8e1a7df-cb54-4bad-92ba-df8528fa6170 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:38.656392 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-c8e1a7df-cb54-4bad-92ba-df8528fa6170 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 82b86465-afb0-49ef-9932-1538010c1ae5] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:38.671953 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c8e1a7df-cb54-4bad-92ba-df8528fa6170 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:38.673520 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c8e1a7df-cb54-4bad-92ba-df8528fa6170 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:38.675733 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c8e1a7df-cb54-4bad-92ba-df8528fa6170 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:38.681897 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c8e1a7df-cb54-4bad-92ba-df8528fa6170 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:38.682673 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c8e1a7df-cb54-4bad-92ba-df8528fa6170 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:38.683413 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c8e1a7df-cb54-4bad-92ba-df8528fa6170 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:39.084435 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-c8e1a7df-cb54-4bad-92ba-df8528fa6170 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:39.098249 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-c8e1a7df-cb54-4bad-92ba-df8528fa6170 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5" status: 200 len: 1677 microversion: 2.1 time: 0.443943 Oct 04 18:49:39.099299 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1965/4193] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:38 2022] GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5 => generated 1677 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:39.367413 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-c30eaf46-2586-41cf-9748-8ca7a29e3c3e tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:39.370690 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-c30eaf46-2586-41cf-9748-8ca7a29e3c3e tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] [instance: 4275d1a7-42d6-4af5-be51-64fb1c4f6fad] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:39.393195 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c30eaf46-2586-41cf-9748-8ca7a29e3c3e tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:39.396129 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c30eaf46-2586-41cf-9748-8ca7a29e3c3e tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:39.396642 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c30eaf46-2586-41cf-9748-8ca7a29e3c3e tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:39.399361 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c30eaf46-2586-41cf-9748-8ca7a29e3c3e tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:39.399909 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c30eaf46-2586-41cf-9748-8ca7a29e3c3e tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:39.401358 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c30eaf46-2586-41cf-9748-8ca7a29e3c3e tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:39.686379 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-c30eaf46-2586-41cf-9748-8ca7a29e3c3e tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14707008940e4965ab7d1190094a71bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8f94cf1c974654a336645f453c9efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:39.700371 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-c30eaf46-2586-41cf-9748-8ca7a29e3c3e tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] 10.222.0.43 "GET /compute/v2.1/servers/4275d1a7-42d6-4af5-be51-64fb1c4f6fad" status: 200 len: 1328 microversion: 2.1 time: 0.345300 Oct 04 18:49:39.703657 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2229/4194] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:39 2022] GET /compute/v2.1/servers/4275d1a7-42d6-4af5-be51-64fb1c4f6fad => generated 1328 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:40.126537 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-9c5d0af3-6d39-4a8f-b281-2f5af884babe tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:40.127160 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-9c5d0af3-6d39-4a8f-b281-2f5af884babe tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 82b86465-afb0-49ef-9932-1538010c1ae5] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:40.142135 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9c5d0af3-6d39-4a8f-b281-2f5af884babe tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:40.142413 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9c5d0af3-6d39-4a8f-b281-2f5af884babe tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:40.143014 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9c5d0af3-6d39-4a8f-b281-2f5af884babe tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:40.144399 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9c5d0af3-6d39-4a8f-b281-2f5af884babe tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:40.145404 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9c5d0af3-6d39-4a8f-b281-2f5af884babe tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:40.146026 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9c5d0af3-6d39-4a8f-b281-2f5af884babe tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:40.481937 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-9c5d0af3-6d39-4a8f-b281-2f5af884babe tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:40.491473 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-9c5d0af3-6d39-4a8f-b281-2f5af884babe tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5" status: 200 len: 1677 microversion: 2.1 time: 0.368752 Oct 04 18:49:40.493176 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1966/4195] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:40 2022] GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5 => generated 1677 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:40.728839 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-33590db5-a36d-4dcc-804d-24510aa08e55 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:40.729627 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-33590db5-a36d-4dcc-804d-24510aa08e55 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] [instance: 4275d1a7-42d6-4af5-be51-64fb1c4f6fad] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:40.741321 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-33590db5-a36d-4dcc-804d-24510aa08e55 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:40.741820 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-33590db5-a36d-4dcc-804d-24510aa08e55 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:40.743843 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-33590db5-a36d-4dcc-804d-24510aa08e55 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:40.746940 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-33590db5-a36d-4dcc-804d-24510aa08e55 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:40.749062 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-33590db5-a36d-4dcc-804d-24510aa08e55 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:40.749991 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-33590db5-a36d-4dcc-804d-24510aa08e55 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:41.129770 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-4873626a-1642-472f-9203-6eb1f312593b req-9e9ef79b-3c9c-4570-bb10-8e0654cf6227 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4275d1a7-42d6-4af5-be51-64fb1c4f6fad", "tag": "696bf01d-eea4-4590-8b5d-1b8e4b34d8e0"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:49:41.161429 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-4873626a-1642-472f-9203-6eb1f312593b req-9e9ef79b-3c9c-4570-bb10-8e0654cf6227 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:41.162237 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-4873626a-1642-472f-9203-6eb1f312593b req-9e9ef79b-3c9c-4570-bb10-8e0654cf6227 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:41.164152 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-33590db5-a36d-4dcc-804d-24510aa08e55 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14707008940e4965ab7d1190094a71bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8f94cf1c974654a336645f453c9efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:41.164343 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-4873626a-1642-472f-9203-6eb1f312593b req-9e9ef79b-3c9c-4570-bb10-8e0654cf6227 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:41.186832 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-33590db5-a36d-4dcc-804d-24510aa08e55 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] 10.222.0.43 "GET /compute/v2.1/servers/4275d1a7-42d6-4af5-be51-64fb1c4f6fad" status: 200 len: 1328 microversion: 2.1 time: 0.458038 Oct 04 18:49:41.203095 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2230/4196] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:40 2022] GET /compute/v2.1/servers/4275d1a7-42d6-4af5-be51-64fb1c4f6fad => generated 1328 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:41.205911 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-4873626a-1642-472f-9203-6eb1f312593b req-9e9ef79b-3c9c-4570-bb10-8e0654cf6227 service nova] Creating event network-changed:696bf01d-eea4-4590-8b5d-1b8e4b34d8e0 for instance 4275d1a7-42d6-4af5-be51-64fb1c4f6fad on n-h2-851028-13 Oct 04 18:49:41.225348 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-4873626a-1642-472f-9203-6eb1f312593b req-9e9ef79b-3c9c-4570-bb10-8e0654cf6227 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103351 Oct 04 18:49:41.231896 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1967/4197] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:49:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:49:41.522738 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-07c72e81-4964-410b-976b-cbd80b03ee8e tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:41.523368 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-07c72e81-4964-410b-976b-cbd80b03ee8e tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 82b86465-afb0-49ef-9932-1538010c1ae5] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:41.537457 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-07c72e81-4964-410b-976b-cbd80b03ee8e tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:41.542840 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-07c72e81-4964-410b-976b-cbd80b03ee8e tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:41.543326 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-07c72e81-4964-410b-976b-cbd80b03ee8e tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:41.544070 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-07c72e81-4964-410b-976b-cbd80b03ee8e tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:41.546713 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-07c72e81-4964-410b-976b-cbd80b03ee8e tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:41.547712 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-07c72e81-4964-410b-976b-cbd80b03ee8e tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:42.014017 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-07c72e81-4964-410b-976b-cbd80b03ee8e tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:42.049023 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-07c72e81-4964-410b-976b-cbd80b03ee8e tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5" status: 200 len: 1677 microversion: 2.1 time: 0.533973 Oct 04 18:49:42.056965 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2231/4198] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:41 2022] GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5 => generated 1677 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:42.232464 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-5e888080-7c9a-4312-aa52-a1b686261cce tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:42.238723 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-5e888080-7c9a-4312-aa52-a1b686261cce tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] [instance: 4275d1a7-42d6-4af5-be51-64fb1c4f6fad] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:42.285178 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5e888080-7c9a-4312-aa52-a1b686261cce tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:42.288450 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5e888080-7c9a-4312-aa52-a1b686261cce tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:42.290110 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5e888080-7c9a-4312-aa52-a1b686261cce tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:42.299770 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5e888080-7c9a-4312-aa52-a1b686261cce tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:42.302925 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5e888080-7c9a-4312-aa52-a1b686261cce tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:42.305560 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5e888080-7c9a-4312-aa52-a1b686261cce tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:42.609289 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-5e888080-7c9a-4312-aa52-a1b686261cce tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14707008940e4965ab7d1190094a71bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8f94cf1c974654a336645f453c9efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:42.626962 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-5e888080-7c9a-4312-aa52-a1b686261cce tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] 10.222.0.43 "GET /compute/v2.1/servers/4275d1a7-42d6-4af5-be51-64fb1c4f6fad" status: 200 len: 1328 microversion: 2.1 time: 0.406120 Oct 04 18:49:42.631449 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1968/4199] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:42 2022] GET /compute/v2.1/servers/4275d1a7-42d6-4af5-be51-64fb1c4f6fad => generated 1328 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:43.087288 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-7970b339-4e2f-4cfd-a0c4-168073c97312 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:43.090519 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-7970b339-4e2f-4cfd-a0c4-168073c97312 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 82b86465-afb0-49ef-9932-1538010c1ae5] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:43.103175 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7970b339-4e2f-4cfd-a0c4-168073c97312 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:43.103901 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7970b339-4e2f-4cfd-a0c4-168073c97312 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:43.104702 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7970b339-4e2f-4cfd-a0c4-168073c97312 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:43.105789 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7970b339-4e2f-4cfd-a0c4-168073c97312 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:43.106465 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7970b339-4e2f-4cfd-a0c4-168073c97312 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:43.107190 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7970b339-4e2f-4cfd-a0c4-168073c97312 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:43.588813 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-7970b339-4e2f-4cfd-a0c4-168073c97312 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:43.597556 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-7970b339-4e2f-4cfd-a0c4-168073c97312 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5" status: 200 len: 1677 microversion: 2.1 time: 0.515298 Oct 04 18:49:43.606636 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2232/4200] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:43 2022] GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5 => generated 1677 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:43.698540 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-e2e5a390-ef7c-43db-bb66-809d90ff16cc tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:43.699760 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-e2e5a390-ef7c-43db-bb66-809d90ff16cc tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] [instance: 4275d1a7-42d6-4af5-be51-64fb1c4f6fad] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:43.708867 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e2e5a390-ef7c-43db-bb66-809d90ff16cc tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:43.716491 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e2e5a390-ef7c-43db-bb66-809d90ff16cc tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:43.717515 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e2e5a390-ef7c-43db-bb66-809d90ff16cc tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:43.722355 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e2e5a390-ef7c-43db-bb66-809d90ff16cc tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:43.723161 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e2e5a390-ef7c-43db-bb66-809d90ff16cc tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:43.723772 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e2e5a390-ef7c-43db-bb66-809d90ff16cc tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:44.186728 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-e2e5a390-ef7c-43db-bb66-809d90ff16cc tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14707008940e4965ab7d1190094a71bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8f94cf1c974654a336645f453c9efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:44.196639 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-e2e5a390-ef7c-43db-bb66-809d90ff16cc tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] 10.222.0.43 "GET /compute/v2.1/servers/4275d1a7-42d6-4af5-be51-64fb1c4f6fad" status: 200 len: 1328 microversion: 2.1 time: 0.529721 Oct 04 18:49:44.197263 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1969/4201] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:43 2022] GET /compute/v2.1/servers/4275d1a7-42d6-4af5-be51-64fb1c4f6fad => generated 1328 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:44.626826 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-ff65ce89-5bcf-4d56-b945-5183669d7007 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:44.627448 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-ff65ce89-5bcf-4d56-b945-5183669d7007 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 82b86465-afb0-49ef-9932-1538010c1ae5] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:44.639773 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ff65ce89-5bcf-4d56-b945-5183669d7007 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:44.640583 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ff65ce89-5bcf-4d56-b945-5183669d7007 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:44.641044 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ff65ce89-5bcf-4d56-b945-5183669d7007 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:44.646455 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ff65ce89-5bcf-4d56-b945-5183669d7007 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:44.647341 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ff65ce89-5bcf-4d56-b945-5183669d7007 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:44.647839 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ff65ce89-5bcf-4d56-b945-5183669d7007 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:45.225609 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-1471480b-176b-42e4-9f7c-2aec235f20b1 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:45.228537 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-1471480b-176b-42e4-9f7c-2aec235f20b1 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] [instance: 4275d1a7-42d6-4af5-be51-64fb1c4f6fad] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:45.239367 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1471480b-176b-42e4-9f7c-2aec235f20b1 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:45.240158 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1471480b-176b-42e4-9f7c-2aec235f20b1 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:45.240752 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1471480b-176b-42e4-9f7c-2aec235f20b1 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:45.241769 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1471480b-176b-42e4-9f7c-2aec235f20b1 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:45.242619 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1471480b-176b-42e4-9f7c-2aec235f20b1 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:45.243411 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1471480b-176b-42e4-9f7c-2aec235f20b1 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:45.567396 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-ff65ce89-5bcf-4d56-b945-5183669d7007 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:45.571487 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-1471480b-176b-42e4-9f7c-2aec235f20b1 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14707008940e4965ab7d1190094a71bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8f94cf1c974654a336645f453c9efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:45.584192 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-1471480b-176b-42e4-9f7c-2aec235f20b1 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] 10.222.0.43 "GET /compute/v2.1/servers/4275d1a7-42d6-4af5-be51-64fb1c4f6fad" status: 200 len: 1328 microversion: 2.1 time: 0.363935 Oct 04 18:49:45.584956 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1970/4202] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:45 2022] GET /compute/v2.1/servers/4275d1a7-42d6-4af5-be51-64fb1c4f6fad => generated 1328 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:45.585805 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-ff65ce89-5bcf-4d56-b945-5183669d7007 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5" status: 200 len: 1677 microversion: 2.1 time: 0.962763 Oct 04 18:49:45.586572 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2233/4203] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:44 2022] GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5 => generated 1677 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:46.612520 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-40bf366e-d484-427b-8903-13309cb1420b tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:46.618296 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-89c25d04-d15a-4d87-afa5-ce33c82c62be tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:46.619454 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-89c25d04-d15a-4d87-afa5-ce33c82c62be tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] [instance: 4275d1a7-42d6-4af5-be51-64fb1c4f6fad] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:46.620348 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-40bf366e-d484-427b-8903-13309cb1420b tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 82b86465-afb0-49ef-9932-1538010c1ae5] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:46.626629 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=2 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:49:46.636400 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=12 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:49:46.646403 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:49:46.647758 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-89c25d04-d15a-4d87-afa5-ce33c82c62be tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:46.650175 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-89c25d04-d15a-4d87-afa5-ce33c82c62be tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:46.658813 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-89c25d04-d15a-4d87-afa5-ce33c82c62be tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:46.659753 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-89c25d04-d15a-4d87-afa5-ce33c82c62be tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:46.663414 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-89c25d04-d15a-4d87-afa5-ce33c82c62be tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:46.663861 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-89c25d04-d15a-4d87-afa5-ce33c82c62be tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:46.686708 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-40bf366e-d484-427b-8903-13309cb1420b tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:46.687247 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-40bf366e-d484-427b-8903-13309cb1420b tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:46.687656 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-40bf366e-d484-427b-8903-13309cb1420b tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:46.688378 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-40bf366e-d484-427b-8903-13309cb1420b tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:46.688841 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-40bf366e-d484-427b-8903-13309cb1420b tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:46.689297 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-40bf366e-d484-427b-8903-13309cb1420b tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:46.978668 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-40bf366e-d484-427b-8903-13309cb1420b tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:46.993145 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-40bf366e-d484-427b-8903-13309cb1420b tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5" status: 200 len: 1677 microversion: 2.1 time: 0.385982 Oct 04 18:49:47.006687 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1971/4204] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:46 2022] GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5 => generated 1677 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:47.155059 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-89c25d04-d15a-4d87-afa5-ce33c82c62be tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14707008940e4965ab7d1190094a71bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8f94cf1c974654a336645f453c9efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:47.170847 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-89c25d04-d15a-4d87-afa5-ce33c82c62be tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] 10.222.0.43 "GET /compute/v2.1/servers/4275d1a7-42d6-4af5-be51-64fb1c4f6fad" status: 200 len: 1328 microversion: 2.1 time: 0.556167 Oct 04 18:49:47.174654 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2234/4205] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:46 2022] GET /compute/v2.1/servers/4275d1a7-42d6-4af5-be51-64fb1c4f6fad => generated 1328 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:49:48.018833 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-c06a566c-255f-4ea1-ab73-c36f8999797d tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:48.019497 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-c06a566c-255f-4ea1-ab73-c36f8999797d tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 82b86465-afb0-49ef-9932-1538010c1ae5] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:48.038819 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c06a566c-255f-4ea1-ab73-c36f8999797d tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:48.038926 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c06a566c-255f-4ea1-ab73-c36f8999797d tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:48.039377 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c06a566c-255f-4ea1-ab73-c36f8999797d tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:48.040092 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c06a566c-255f-4ea1-ab73-c36f8999797d tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:48.040542 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c06a566c-255f-4ea1-ab73-c36f8999797d tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:48.041041 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c06a566c-255f-4ea1-ab73-c36f8999797d tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:48.202488 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-28fb18ee-c711-4700-bf1b-1207ffbb212d tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:48.203012 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-28fb18ee-c711-4700-bf1b-1207ffbb212d tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] [instance: 4275d1a7-42d6-4af5-be51-64fb1c4f6fad] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:48.226006 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-28fb18ee-c711-4700-bf1b-1207ffbb212d tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:48.226518 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-28fb18ee-c711-4700-bf1b-1207ffbb212d tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:48.226968 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-28fb18ee-c711-4700-bf1b-1207ffbb212d tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:48.227688 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-28fb18ee-c711-4700-bf1b-1207ffbb212d tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:48.228152 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-28fb18ee-c711-4700-bf1b-1207ffbb212d tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:48.228582 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-28fb18ee-c711-4700-bf1b-1207ffbb212d tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:48.415787 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-c06a566c-255f-4ea1-ab73-c36f8999797d tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:48.430643 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-c06a566c-255f-4ea1-ab73-c36f8999797d tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5" status: 200 len: 1654 microversion: 2.1 time: 0.410212 Oct 04 18:49:48.431313 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1972/4206] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:48 2022] GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5 => generated 1654 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:48.458948 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-49a8c8ba-fdec-4ac9-8d5e-b5ee86c4e5f6 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:49:48.481993 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-49a8c8ba-fdec-4ac9-8d5e-b5ee86c4e5f6 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:48.482505 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-49a8c8ba-fdec-4ac9-8d5e-b5ee86c4e5f6 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:48.487154 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-49a8c8ba-fdec-4ac9-8d5e-b5ee86c4e5f6 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:48.550837 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-49a8c8ba-fdec-4ac9-8d5e-b5ee86c4e5f6 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 82b86465-afb0-49ef-9932-1538010c1ae5] Going to try to start instance {{(pid=123595) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 04 18:49:48.670662 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-49a8c8ba-fdec-4ac9-8d5e-b5ee86c4e5f6 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "POST /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5/action" status: 202 len: 0 microversion: 2.1 time: 0.218494 Oct 04 18:49:48.698781 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1973/4207] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 18:49:48 2022] POST /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5/action => generated 0 bytes in 249 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 18:49:48.725082 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-0539926c-aad5-48b7-bd1b-e307dcd441d3 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:48.725857 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-0539926c-aad5-48b7-bd1b-e307dcd441d3 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 82b86465-afb0-49ef-9932-1538010c1ae5] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:48.745139 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0539926c-aad5-48b7-bd1b-e307dcd441d3 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:48.751825 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0539926c-aad5-48b7-bd1b-e307dcd441d3 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:48.752311 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0539926c-aad5-48b7-bd1b-e307dcd441d3 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:48.753074 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0539926c-aad5-48b7-bd1b-e307dcd441d3 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:48.767892 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0539926c-aad5-48b7-bd1b-e307dcd441d3 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:48.768830 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0539926c-aad5-48b7-bd1b-e307dcd441d3 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:48.943943 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-28fb18ee-c711-4700-bf1b-1207ffbb212d tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14707008940e4965ab7d1190094a71bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8f94cf1c974654a336645f453c9efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:48.957347 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-28fb18ee-c711-4700-bf1b-1207ffbb212d tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] 10.222.0.43 "GET /compute/v2.1/servers/4275d1a7-42d6-4af5-be51-64fb1c4f6fad" status: 200 len: 1328 microversion: 2.1 time: 0.759606 Oct 04 18:49:48.962571 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2235/4208] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:48 2022] GET /compute/v2.1/servers/4275d1a7-42d6-4af5-be51-64fb1c4f6fad => generated 1328 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:49:49.438871 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-0539926c-aad5-48b7-bd1b-e307dcd441d3 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:49.450486 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-0539926c-aad5-48b7-bd1b-e307dcd441d3 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5" status: 200 len: 1663 microversion: 2.1 time: 0.750205 Oct 04 18:49:49.454179 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1974/4209] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:48 2022] GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5 => generated 1663 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:49.717794 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-95921bc2-8848-40c2-982f-232f186a26a5 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:49.723757 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-95921bc2-8848-40c2-982f-232f186a26a5 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] [instance: f2269817-3e15-4cfe-8446-7eb0104f9800] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:49.754979 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-345c5d5e-c5fd-4c0b-96f0-a662d9cc48eb req-89db3dc3-41f4-4b2d-99ad-f77673868e5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4275d1a7-42d6-4af5-be51-64fb1c4f6fad", "name": "network-vif-plugged", "status": "completed", "tag": "696bf01d-eea4-4590-8b5d-1b8e4b34d8e0"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:49:49.762488 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-95921bc2-8848-40c2-982f-232f186a26a5 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:49.769510 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-95921bc2-8848-40c2-982f-232f186a26a5 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:49.772973 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-95921bc2-8848-40c2-982f-232f186a26a5 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:49.779828 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-95921bc2-8848-40c2-982f-232f186a26a5 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:49.783996 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-95921bc2-8848-40c2-982f-232f186a26a5 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:49.787666 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-95921bc2-8848-40c2-982f-232f186a26a5 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:49.792706 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-345c5d5e-c5fd-4c0b-96f0-a662d9cc48eb req-89db3dc3-41f4-4b2d-99ad-f77673868e5a service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:49.798404 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-345c5d5e-c5fd-4c0b-96f0-a662d9cc48eb req-89db3dc3-41f4-4b2d-99ad-f77673868e5a service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:49.799202 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-345c5d5e-c5fd-4c0b-96f0-a662d9cc48eb req-89db3dc3-41f4-4b2d-99ad-f77673868e5a service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:49.852803 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-345c5d5e-c5fd-4c0b-96f0-a662d9cc48eb req-89db3dc3-41f4-4b2d-99ad-f77673868e5a service nova] Creating event network-vif-plugged:696bf01d-eea4-4590-8b5d-1b8e4b34d8e0 for instance 4275d1a7-42d6-4af5-be51-64fb1c4f6fad on n-h2-851028-13 Oct 04 18:49:49.870757 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-345c5d5e-c5fd-4c0b-96f0-a662d9cc48eb req-89db3dc3-41f4-4b2d-99ad-f77673868e5a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120179 Oct 04 18:49:49.876732 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1975/4210] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:49:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:49:49.886602 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-95921bc2-8848-40c2-982f-232f186a26a5 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] 10.222.0.43 "GET /compute/v2.1/servers/f2269817-3e15-4cfe-8446-7eb0104f9800/ips" status: 200 len: 145 microversion: 2.1 time: 0.173565 Oct 04 18:49:49.903737 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2236/4211] 10.222.0.43 () {58 vars in 1248 bytes} [Tue Oct 4 18:49:49 2022] GET /compute/v2.1/servers/f2269817-3e15-4cfe-8446-7eb0104f9800/ips => generated 145 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:49:49.997571 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-18dbfd45-d0a1-4ca1-a3f2-8010097d8d5b tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:49.998534 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-18dbfd45-d0a1-4ca1-a3f2-8010097d8d5b tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] [instance: 4275d1a7-42d6-4af5-be51-64fb1c4f6fad] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:50.033297 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-18dbfd45-d0a1-4ca1-a3f2-8010097d8d5b tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:50.033983 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-18dbfd45-d0a1-4ca1-a3f2-8010097d8d5b tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:50.034620 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-18dbfd45-d0a1-4ca1-a3f2-8010097d8d5b tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:50.035370 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-18dbfd45-d0a1-4ca1-a3f2-8010097d8d5b tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:50.039268 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-18dbfd45-d0a1-4ca1-a3f2-8010097d8d5b tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:50.039916 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-18dbfd45-d0a1-4ca1-a3f2-8010097d8d5b tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:50.501065 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-74ca88fa-9408-4f29-ac26-8c0792f69e56 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:50.501728 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-74ca88fa-9408-4f29-ac26-8c0792f69e56 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 82b86465-afb0-49ef-9932-1538010c1ae5] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:50.515622 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-74ca88fa-9408-4f29-ac26-8c0792f69e56 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:50.519994 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-74ca88fa-9408-4f29-ac26-8c0792f69e56 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:50.520668 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-74ca88fa-9408-4f29-ac26-8c0792f69e56 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:50.522278 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-74ca88fa-9408-4f29-ac26-8c0792f69e56 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:50.531845 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-74ca88fa-9408-4f29-ac26-8c0792f69e56 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:50.532394 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-74ca88fa-9408-4f29-ac26-8c0792f69e56 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:51.158342 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-74ca88fa-9408-4f29-ac26-8c0792f69e56 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:51.167393 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-74ca88fa-9408-4f29-ac26-8c0792f69e56 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5" status: 200 len: 1663 microversion: 2.1 time: 0.689120 Oct 04 18:49:51.171982 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2237/4212] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:50 2022] GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5 => generated 1663 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:49:51.417870 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-18dbfd45-d0a1-4ca1-a3f2-8010097d8d5b tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14707008940e4965ab7d1190094a71bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8f94cf1c974654a336645f453c9efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:51.426659 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-18dbfd45-d0a1-4ca1-a3f2-8010097d8d5b tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] 10.222.0.43 "GET /compute/v2.1/servers/4275d1a7-42d6-4af5-be51-64fb1c4f6fad" status: 200 len: 1328 microversion: 2.1 time: 1.434140 Oct 04 18:49:51.430197 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1976/4213] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:49 2022] GET /compute/v2.1/servers/4275d1a7-42d6-4af5-be51-64fb1c4f6fad => generated 1328 bytes in 1445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:52.199061 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-2e8f9dbc-f8dc-436c-ad57-55cec9e4a585 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:52.200369 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-2e8f9dbc-f8dc-436c-ad57-55cec9e4a585 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 82b86465-afb0-49ef-9932-1538010c1ae5] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:52.203579 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_api:SELECT=61 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:49:52.213844 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2e8f9dbc-f8dc-436c-ad57-55cec9e4a585 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:52.228372 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2e8f9dbc-f8dc-436c-ad57-55cec9e4a585 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:52.242248 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2e8f9dbc-f8dc-436c-ad57-55cec9e4a585 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:52.244486 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2e8f9dbc-f8dc-436c-ad57-55cec9e4a585 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:52.246134 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2e8f9dbc-f8dc-436c-ad57-55cec9e4a585 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:52.247408 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2e8f9dbc-f8dc-436c-ad57-55cec9e4a585 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:52.453644 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-11254ff5-47c1-4ec8-a7fe-ff0f668ff494 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:52.454383 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-11254ff5-47c1-4ec8-a7fe-ff0f668ff494 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] [instance: 4275d1a7-42d6-4af5-be51-64fb1c4f6fad] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:52.490074 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-11254ff5-47c1-4ec8-a7fe-ff0f668ff494 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:52.497081 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-11254ff5-47c1-4ec8-a7fe-ff0f668ff494 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:52.498907 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-11254ff5-47c1-4ec8-a7fe-ff0f668ff494 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:52.501743 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-11254ff5-47c1-4ec8-a7fe-ff0f668ff494 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:52.504202 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-11254ff5-47c1-4ec8-a7fe-ff0f668ff494 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:52.506983 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-11254ff5-47c1-4ec8-a7fe-ff0f668ff494 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:52.934073 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-2e8f9dbc-f8dc-436c-ad57-55cec9e4a585 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:52.966615 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-2e8f9dbc-f8dc-436c-ad57-55cec9e4a585 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5" status: 200 len: 1663 microversion: 2.1 time: 0.763952 Oct 04 18:49:52.967303 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2238/4214] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:52 2022] GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5 => generated 1663 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:53.131350 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-11254ff5-47c1-4ec8-a7fe-ff0f668ff494 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14707008940e4965ab7d1190094a71bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8f94cf1c974654a336645f453c9efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:53.149858 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-11254ff5-47c1-4ec8-a7fe-ff0f668ff494 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] 10.222.0.43 "GET /compute/v2.1/servers/4275d1a7-42d6-4af5-be51-64fb1c4f6fad" status: 200 len: 1328 microversion: 2.1 time: 0.699188 Oct 04 18:49:53.156920 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1977/4215] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:52 2022] GET /compute/v2.1/servers/4275d1a7-42d6-4af5-be51-64fb1c4f6fad => generated 1328 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:54.000982 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-3a926d82-3d81-44d9-9d38-1573bacafc93 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:54.002369 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-3a926d82-3d81-44d9-9d38-1573bacafc93 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 82b86465-afb0-49ef-9932-1538010c1ae5] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:54.029994 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3a926d82-3d81-44d9-9d38-1573bacafc93 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:54.032056 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3a926d82-3d81-44d9-9d38-1573bacafc93 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:54.034457 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3a926d82-3d81-44d9-9d38-1573bacafc93 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:54.035264 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3a926d82-3d81-44d9-9d38-1573bacafc93 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:54.040539 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3a926d82-3d81-44d9-9d38-1573bacafc93 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:54.053067 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3a926d82-3d81-44d9-9d38-1573bacafc93 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:54.176311 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-b3822edd-7c4c-4789-a749-7ec6bdd2174c tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:54.178323 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-b3822edd-7c4c-4789-a749-7ec6bdd2174c tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] [instance: 4275d1a7-42d6-4af5-be51-64fb1c4f6fad] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:54.260030 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b3822edd-7c4c-4789-a749-7ec6bdd2174c tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:54.260536 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b3822edd-7c4c-4789-a749-7ec6bdd2174c tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:54.260988 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b3822edd-7c4c-4789-a749-7ec6bdd2174c tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:54.282361 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b3822edd-7c4c-4789-a749-7ec6bdd2174c tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:54.284341 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b3822edd-7c4c-4789-a749-7ec6bdd2174c tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:54.284800 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b3822edd-7c4c-4789-a749-7ec6bdd2174c tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:54.299744 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:49:54.628021 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-3a926d82-3d81-44d9-9d38-1573bacafc93 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:54.637134 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-3a926d82-3d81-44d9-9d38-1573bacafc93 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5" status: 200 len: 1667 microversion: 2.1 time: 0.645625 Oct 04 18:49:54.643968 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2239/4216] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:53 2022] GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5 => generated 1667 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:54.671672 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-e7461292-1fda-4189-9e3c-f18ac7169620 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:54.685438 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-e7461292-1fda-4189-9e3c-f18ac7169620 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 82b86465-afb0-49ef-9932-1538010c1ae5] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:54.702604 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e7461292-1fda-4189-9e3c-f18ac7169620 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:54.707924 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e7461292-1fda-4189-9e3c-f18ac7169620 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:54.708665 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e7461292-1fda-4189-9e3c-f18ac7169620 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:54.710515 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e7461292-1fda-4189-9e3c-f18ac7169620 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:54.712747 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e7461292-1fda-4189-9e3c-f18ac7169620 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:54.713409 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e7461292-1fda-4189-9e3c-f18ac7169620 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:55.061583 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-e7461292-1fda-4189-9e3c-f18ac7169620 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:55.074535 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-e7461292-1fda-4189-9e3c-f18ac7169620 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5" status: 200 len: 1667 microversion: 2.1 time: 0.406866 Oct 04 18:49:55.078772 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2240/4217] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:54 2022] GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5 => generated 1667 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:55.087030 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-d5d4bc1a-eccf-48f4-b4f2-1d4919e815d8 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1216c3e0-3a40-46ab-add2-29e8512ff6a3"}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:49:55.095165 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-d5d4bc1a-eccf-48f4-b4f2-1d4919e815d8 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] [instance: f2269817-3e15-4cfe-8446-7eb0104f9800] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:55.128810 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d5d4bc1a-eccf-48f4-b4f2-1d4919e815d8 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:55.134399 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d5d4bc1a-eccf-48f4-b4f2-1d4919e815d8 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:55.138290 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d5d4bc1a-eccf-48f4-b4f2-1d4919e815d8 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:55.139397 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d5d4bc1a-eccf-48f4-b4f2-1d4919e815d8 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:55.140227 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d5d4bc1a-eccf-48f4-b4f2-1d4919e815d8 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:55.143316 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d5d4bc1a-eccf-48f4-b4f2-1d4919e815d8 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:55.183036 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-b3822edd-7c4c-4789-a749-7ec6bdd2174c tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14707008940e4965ab7d1190094a71bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8f94cf1c974654a336645f453c9efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:55.204579 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-b3822edd-7c4c-4789-a749-7ec6bdd2174c tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] 10.222.0.43 "GET /compute/v2.1/servers/4275d1a7-42d6-4af5-be51-64fb1c4f6fad" status: 200 len: 1508 microversion: 2.1 time: 1.033240 Oct 04 18:49:55.219022 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1978/4218] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:54 2022] GET /compute/v2.1/servers/4275d1a7-42d6-4af5-be51-64fb1c4f6fad => generated 1508 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:55.243289 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-9efa8d3c-8ed3-4c01-a3b9-4df4cf60b9ba tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:55.244548 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-9efa8d3c-8ed3-4c01-a3b9-4df4cf60b9ba tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 82b86465-afb0-49ef-9932-1538010c1ae5] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:55.271162 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9efa8d3c-8ed3-4c01-a3b9-4df4cf60b9ba tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:55.272219 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9efa8d3c-8ed3-4c01-a3b9-4df4cf60b9ba tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:55.276675 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9efa8d3c-8ed3-4c01-a3b9-4df4cf60b9ba tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:55.277684 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9efa8d3c-8ed3-4c01-a3b9-4df4cf60b9ba tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:55.280616 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9efa8d3c-8ed3-4c01-a3b9-4df4cf60b9ba tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:55.283486 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9efa8d3c-8ed3-4c01-a3b9-4df4cf60b9ba tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:55.688677 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-9efa8d3c-8ed3-4c01-a3b9-4df4cf60b9ba tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:55.698309 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-9efa8d3c-8ed3-4c01-a3b9-4df4cf60b9ba tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5" status: 200 len: 1667 microversion: 2.1 time: 0.468447 Oct 04 18:49:55.698908 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1979/4219] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:55 2022] GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5 => generated 1667 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:55.712728 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-3e0bad66-83f1-4551-9ae7-8fc3f8105fd8 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:55.713923 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-3e0bad66-83f1-4551-9ae7-8fc3f8105fd8 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] [instance: 4275d1a7-42d6-4af5-be51-64fb1c4f6fad] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:55.731913 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3e0bad66-83f1-4551-9ae7-8fc3f8105fd8 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:55.736609 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3e0bad66-83f1-4551-9ae7-8fc3f8105fd8 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:55.741657 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3e0bad66-83f1-4551-9ae7-8fc3f8105fd8 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:55.742215 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-d5d4bc1a-eccf-48f4-b4f2-1d4919e815d8 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] 10.222.0.43 "POST /compute/v2.1/servers/f2269817-3e15-4cfe-8446-7eb0104f9800/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.660021 Oct 04 18:49:55.742949 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3e0bad66-83f1-4551-9ae7-8fc3f8105fd8 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:55.743359 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2241/4220] 10.222.0.43 () {60 vars in 1323 bytes} [Tue Oct 4 18:49:55 2022] POST /compute/v2.1/servers/f2269817-3e15-4cfe-8446-7eb0104f9800/os-volume_attachments => generated 194 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:49:55.765838 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-971da821-f30a-439c-8c2d-8db2d10ad06d tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:55.767696 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3e0bad66-83f1-4551-9ae7-8fc3f8105fd8 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:55.773870 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-971da821-f30a-439c-8c2d-8db2d10ad06d tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 82b86465-afb0-49ef-9932-1538010c1ae5] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:55.774627 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3e0bad66-83f1-4551-9ae7-8fc3f8105fd8 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:55.784411 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-971da821-f30a-439c-8c2d-8db2d10ad06d tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:55.785200 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-971da821-f30a-439c-8c2d-8db2d10ad06d tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:55.786879 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-971da821-f30a-439c-8c2d-8db2d10ad06d tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:55.791774 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-971da821-f30a-439c-8c2d-8db2d10ad06d tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:55.792945 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-971da821-f30a-439c-8c2d-8db2d10ad06d tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:55.793858 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-971da821-f30a-439c-8c2d-8db2d10ad06d tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:55.843924 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:49:56.196589 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-971da821-f30a-439c-8c2d-8db2d10ad06d tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:56.221190 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-971da821-f30a-439c-8c2d-8db2d10ad06d tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5" status: 200 len: 1667 microversion: 2.1 time: 0.476196 Oct 04 18:49:56.222353 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2242/4221] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:55 2022] GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5 => generated 1667 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:56.250692 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-ba242952-d647-460d-8fac-e61fd4b221f8 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:56.252006 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-ba242952-d647-460d-8fac-e61fd4b221f8 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 82b86465-afb0-49ef-9932-1538010c1ae5] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:56.268046 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ba242952-d647-460d-8fac-e61fd4b221f8 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:56.268555 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ba242952-d647-460d-8fac-e61fd4b221f8 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:56.273690 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ba242952-d647-460d-8fac-e61fd4b221f8 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:56.274624 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ba242952-d647-460d-8fac-e61fd4b221f8 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:56.275133 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ba242952-d647-460d-8fac-e61fd4b221f8 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:56.277616 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ba242952-d647-460d-8fac-e61fd4b221f8 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:56.292129 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-3e0bad66-83f1-4551-9ae7-8fc3f8105fd8 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14707008940e4965ab7d1190094a71bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8f94cf1c974654a336645f453c9efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:56.335646 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-3e0bad66-83f1-4551-9ae7-8fc3f8105fd8 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] 10.222.0.43 "GET /compute/v2.1/servers/4275d1a7-42d6-4af5-be51-64fb1c4f6fad" status: 200 len: 1508 microversion: 2.1 time: 0.625567 Oct 04 18:49:56.339689 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1980/4222] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:55 2022] GET /compute/v2.1/servers/4275d1a7-42d6-4af5-be51-64fb1c4f6fad => generated 1508 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:56.374466 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-8fab2bf9-ee4e-46a0-85d0-3e113f0c618b tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:56.374983 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-8fab2bf9-ee4e-46a0-85d0-3e113f0c618b tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] [instance: 4275d1a7-42d6-4af5-be51-64fb1c4f6fad] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:56.407680 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8fab2bf9-ee4e-46a0-85d0-3e113f0c618b tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:56.412415 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8fab2bf9-ee4e-46a0-85d0-3e113f0c618b tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:56.413195 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8fab2bf9-ee4e-46a0-85d0-3e113f0c618b tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:56.425172 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8fab2bf9-ee4e-46a0-85d0-3e113f0c618b tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:56.431083 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8fab2bf9-ee4e-46a0-85d0-3e113f0c618b tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:56.431757 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8fab2bf9-ee4e-46a0-85d0-3e113f0c618b tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:56.547970 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-8fab2bf9-ee4e-46a0-85d0-3e113f0c618b tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] [instance: 4275d1a7-42d6-4af5-be51-64fb1c4f6fad] Going to try to terminate instance {{(pid=123595) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:49:56.769000 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-8fab2bf9-ee4e-46a0-85d0-3e113f0c618b tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] 10.222.0.43 "DELETE /compute/v2.1/servers/4275d1a7-42d6-4af5-be51-64fb1c4f6fad" status: 204 len: 0 microversion: 2.1 time: 0.399118 Oct 04 18:49:56.774198 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1981/4223] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 18:49:56 2022] DELETE /compute/v2.1/servers/4275d1a7-42d6-4af5-be51-64fb1c4f6fad => generated 0 bytes in 401 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:49:56.788579 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-bdff4f32-b81c-44e6-a58c-50a044e07be6 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:56.789864 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-bdff4f32-b81c-44e6-a58c-50a044e07be6 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] [instance: 4275d1a7-42d6-4af5-be51-64fb1c4f6fad] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:56.807220 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-ba242952-d647-460d-8fac-e61fd4b221f8 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:56.816695 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-ba242952-d647-460d-8fac-e61fd4b221f8 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5" status: 200 len: 1667 microversion: 2.1 time: 0.570334 Oct 04 18:49:56.829282 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2243/4224] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:56 2022] GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5 => generated 1667 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:56.834895 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bdff4f32-b81c-44e6-a58c-50a044e07be6 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:56.835410 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bdff4f32-b81c-44e6-a58c-50a044e07be6 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:56.843573 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bdff4f32-b81c-44e6-a58c-50a044e07be6 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:56.844417 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bdff4f32-b81c-44e6-a58c-50a044e07be6 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:56.845020 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bdff4f32-b81c-44e6-a58c-50a044e07be6 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:56.845497 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bdff4f32-b81c-44e6-a58c-50a044e07be6 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:56.867968 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-6c7da8be-303e-4202-8964-45d35006e2ac tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:49:56.873750 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-6c7da8be-303e-4202-8964-45d35006e2ac tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 82b86465-afb0-49ef-9932-1538010c1ae5] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:56.897090 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6c7da8be-303e-4202-8964-45d35006e2ac tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:56.897635 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6c7da8be-303e-4202-8964-45d35006e2ac tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:56.898086 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6c7da8be-303e-4202-8964-45d35006e2ac tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:56.898807 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6c7da8be-303e-4202-8964-45d35006e2ac tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:56.899268 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6c7da8be-303e-4202-8964-45d35006e2ac tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:56.899706 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6c7da8be-303e-4202-8964-45d35006e2ac tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:56.988639 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.objects.instance [None req-6c7da8be-303e-4202-8964-45d35006e2ac tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lazy-loading 'flavor' on Instance uuid 82b86465-afb0-49ef-9932-1538010c1ae5 {{(pid=123596) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:49:57.186533 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-6c7da8be-303e-4202-8964-45d35006e2ac tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "POST /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5/action" status: 202 len: 0 microversion: 2.1 time: 0.326770 Oct 04 18:49:57.191729 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2244/4225] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 18:49:56 2022] POST /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5/action => generated 0 bytes in 332 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 18:49:57.202746 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-8a6aa42d-4819-4da5-82bd-84577bde8b46 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:57.204873 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-8a6aa42d-4819-4da5-82bd-84577bde8b46 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 82b86465-afb0-49ef-9932-1538010c1ae5] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:57.223257 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8a6aa42d-4819-4da5-82bd-84577bde8b46 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:57.225877 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8a6aa42d-4819-4da5-82bd-84577bde8b46 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:57.229049 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8a6aa42d-4819-4da5-82bd-84577bde8b46 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:57.230007 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8a6aa42d-4819-4da5-82bd-84577bde8b46 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:57.230624 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8a6aa42d-4819-4da5-82bd-84577bde8b46 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:57.231299 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8a6aa42d-4819-4da5-82bd-84577bde8b46 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:57.338495 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-bdff4f32-b81c-44e6-a58c-50a044e07be6 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14707008940e4965ab7d1190094a71bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8f94cf1c974654a336645f453c9efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:57.350806 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-bdff4f32-b81c-44e6-a58c-50a044e07be6 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] 10.222.0.43 "GET /compute/v2.1/servers/4275d1a7-42d6-4af5-be51-64fb1c4f6fad" status: 200 len: 1514 microversion: 2.1 time: 0.574821 Oct 04 18:49:57.365513 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1982/4226] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:56 2022] GET /compute/v2.1/servers/4275d1a7-42d6-4af5-be51-64fb1c4f6fad => generated 1514 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:57.536482 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-8a6aa42d-4819-4da5-82bd-84577bde8b46 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:57.547438 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-8a6aa42d-4819-4da5-82bd-84577bde8b46 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5" status: 200 len: 1675 microversion: 2.1 time: 0.352718 Oct 04 18:49:57.549056 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2245/4227] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:57 2022] GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5 => generated 1675 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:58.384149 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-cbd55603-8230-4beb-be74-ed557ecda178 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:58.384765 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-cbd55603-8230-4beb-be74-ed557ecda178 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] [instance: 4275d1a7-42d6-4af5-be51-64fb1c4f6fad] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:58.404432 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cbd55603-8230-4beb-be74-ed557ecda178 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:58.439366 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cbd55603-8230-4beb-be74-ed557ecda178 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:58.440007 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cbd55603-8230-4beb-be74-ed557ecda178 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.035s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:58.450799 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cbd55603-8230-4beb-be74-ed557ecda178 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:58.455423 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cbd55603-8230-4beb-be74-ed557ecda178 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:58.455975 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cbd55603-8230-4beb-be74-ed557ecda178 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:58.594561 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-0871d8a3-3d18-436e-9eec-b04e35edbf4b tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:58.595363 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-0871d8a3-3d18-436e-9eec-b04e35edbf4b tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 82b86465-afb0-49ef-9932-1538010c1ae5] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:58.679497 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0871d8a3-3d18-436e-9eec-b04e35edbf4b tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:58.680095 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0871d8a3-3d18-436e-9eec-b04e35edbf4b tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:58.690308 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0871d8a3-3d18-436e-9eec-b04e35edbf4b tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:58.697048 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0871d8a3-3d18-436e-9eec-b04e35edbf4b tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:58.697639 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0871d8a3-3d18-436e-9eec-b04e35edbf4b tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:58.709401 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0871d8a3-3d18-436e-9eec-b04e35edbf4b tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:59.182375 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-0871d8a3-3d18-436e-9eec-b04e35edbf4b tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:59.208285 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-0871d8a3-3d18-436e-9eec-b04e35edbf4b tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5" status: 200 len: 1658 microversion: 2.1 time: 0.629984 Oct 04 18:49:59.209570 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2246/4228] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:58 2022] GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5 => generated 1658 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:49:59.242844 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-fa1e293a-8125-414c-ae63-ab1541a490c2 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:49:59.244323 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-fa1e293a-8125-414c-ae63-ab1541a490c2 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 82b86465-afb0-49ef-9932-1538010c1ae5] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:59.270134 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fa1e293a-8125-414c-ae63-ab1541a490c2 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:59.271515 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fa1e293a-8125-414c-ae63-ab1541a490c2 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:59.273832 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fa1e293a-8125-414c-ae63-ab1541a490c2 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:59.274771 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fa1e293a-8125-414c-ae63-ab1541a490c2 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:59.285142 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fa1e293a-8125-414c-ae63-ab1541a490c2 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:59.297627 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fa1e293a-8125-414c-ae63-ab1541a490c2 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:59.595118 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-fa1e293a-8125-414c-ae63-ab1541a490c2 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "POST /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5/action" status: 202 len: 0 microversion: 2.1 time: 0.357262 Oct 04 18:49:59.616553 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2247/4229] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 18:49:59 2022] POST /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5/action => generated 0 bytes in 379 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:49:59.624821 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-6250c580-ca53-48f9-9672-37518a27164b tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:59.626067 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-6250c580-ca53-48f9-9672-37518a27164b tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 82b86465-afb0-49ef-9932-1538010c1ae5] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:59.634193 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6250c580-ca53-48f9-9672-37518a27164b tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:59.635248 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6250c580-ca53-48f9-9672-37518a27164b tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:59.636246 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6250c580-ca53-48f9-9672-37518a27164b tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:59.637295 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6250c580-ca53-48f9-9672-37518a27164b tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:59.637942 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6250c580-ca53-48f9-9672-37518a27164b tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:59.638576 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6250c580-ca53-48f9-9672-37518a27164b tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:00.121647 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-cbd55603-8230-4beb-be74-ed557ecda178 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14707008940e4965ab7d1190094a71bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8f94cf1c974654a336645f453c9efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:00.146040 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-cbd55603-8230-4beb-be74-ed557ecda178 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] 10.222.0.43 "GET /compute/v2.1/servers/4275d1a7-42d6-4af5-be51-64fb1c4f6fad" status: 200 len: 1514 microversion: 2.1 time: 1.767281 Oct 04 18:50:00.146650 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1983/4230] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:58 2022] GET /compute/v2.1/servers/4275d1a7-42d6-4af5-be51-64fb1c4f6fad => generated 1514 bytes in 1769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:00.450953 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-6250c580-ca53-48f9-9672-37518a27164b tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:00.467446 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-6250c580-ca53-48f9-9672-37518a27164b tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5" status: 200 len: 1664 microversion: 2.1 time: 0.842050 Oct 04 18:50:00.471106 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2248/4231] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:59 2022] GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5 => generated 1664 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:00.855991 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-eb4c6c49-e53a-4b2b-98d9-98b4469afe26 req-074f8f57-dece-4ccb-9436-6d1ef0203aa2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4275d1a7-42d6-4af5-be51-64fb1c4f6fad", "name": "network-vif-deleted", "tag": "696bf01d-eea4-4590-8b5d-1b8e4b34d8e0"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:50:00.883542 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-eb4c6c49-e53a-4b2b-98d9-98b4469afe26 req-074f8f57-dece-4ccb-9436-6d1ef0203aa2 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:00.885703 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-eb4c6c49-e53a-4b2b-98d9-98b4469afe26 req-074f8f57-dece-4ccb-9436-6d1ef0203aa2 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:00.887802 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-eb4c6c49-e53a-4b2b-98d9-98b4469afe26 req-074f8f57-dece-4ccb-9436-6d1ef0203aa2 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:00.932806 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-eb4c6c49-e53a-4b2b-98d9-98b4469afe26 req-074f8f57-dece-4ccb-9436-6d1ef0203aa2 service nova] Creating event network-vif-deleted:696bf01d-eea4-4590-8b5d-1b8e4b34d8e0 for instance 4275d1a7-42d6-4af5-be51-64fb1c4f6fad on n-h2-851028-13 Oct 04 18:50:00.971683 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-eb4c6c49-e53a-4b2b-98d9-98b4469afe26 req-074f8f57-dece-4ccb-9436-6d1ef0203aa2 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097497 Oct 04 18:50:00.972697 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1984/4232] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:50:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:50:01.182201 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-9f87e4bb-ac5c-4a4f-90b7-256ca94797dc tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:01.182825 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-9f87e4bb-ac5c-4a4f-90b7-256ca94797dc tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] [instance: 4275d1a7-42d6-4af5-be51-64fb1c4f6fad] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:01.217522 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9f87e4bb-ac5c-4a4f-90b7-256ca94797dc tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:01.218066 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9f87e4bb-ac5c-4a4f-90b7-256ca94797dc tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:01.220263 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9f87e4bb-ac5c-4a4f-90b7-256ca94797dc tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:01.233559 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9f87e4bb-ac5c-4a4f-90b7-256ca94797dc tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:01.234451 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9f87e4bb-ac5c-4a4f-90b7-256ca94797dc tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:01.235185 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9f87e4bb-ac5c-4a4f-90b7-256ca94797dc tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:01.418974 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9f87e4bb-ac5c-4a4f-90b7-256ca94797dc tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:01.421748 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9f87e4bb-ac5c-4a4f-90b7-256ca94797dc tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:01.422399 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9f87e4bb-ac5c-4a4f-90b7-256ca94797dc tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:01.424835 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.objects.instance [None req-9f87e4bb-ac5c-4a4f-90b7-256ca94797dc tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lazy-loading 'fault' on Instance uuid 4275d1a7-42d6-4af5-be51-64fb1c4f6fad {{(pid=123596) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:50:01.504166 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-00b87e9f-98bf-432e-b3ff-b0709e37453a tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:01.505559 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-00b87e9f-98bf-432e-b3ff-b0709e37453a tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 82b86465-afb0-49ef-9932-1538010c1ae5] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:01.520935 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-00b87e9f-98bf-432e-b3ff-b0709e37453a tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:01.526408 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-00b87e9f-98bf-432e-b3ff-b0709e37453a tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:01.527513 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-00b87e9f-98bf-432e-b3ff-b0709e37453a tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:01.529760 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-00b87e9f-98bf-432e-b3ff-b0709e37453a tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:01.532597 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-00b87e9f-98bf-432e-b3ff-b0709e37453a tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:01.533316 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-00b87e9f-98bf-432e-b3ff-b0709e37453a tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:01.690224 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-9f87e4bb-ac5c-4a4f-90b7-256ca94797dc tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14707008940e4965ab7d1190094a71bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8f94cf1c974654a336645f453c9efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:01.722956 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-9f87e4bb-ac5c-4a4f-90b7-256ca94797dc tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] 10.222.0.43 "GET /compute/v2.1/servers/4275d1a7-42d6-4af5-be51-64fb1c4f6fad" status: 200 len: 1318 microversion: 2.1 time: 0.544843 Oct 04 18:50:01.737066 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2249/4233] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:01 2022] GET /compute/v2.1/servers/4275d1a7-42d6-4af5-be51-64fb1c4f6fad => generated 1318 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:02.195803 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-00b87e9f-98bf-432e-b3ff-b0709e37453a tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:02.205596 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-00b87e9f-98bf-432e-b3ff-b0709e37453a tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5" status: 200 len: 1664 microversion: 2.1 time: 0.706872 Oct 04 18:50:02.206193 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1985/4234] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:01 2022] GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5 => generated 1664 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:50:02.761942 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-20b7af98-0116-446f-84dc-9bb2d57fb8e6 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:02.763977 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-20b7af98-0116-446f-84dc-9bb2d57fb8e6 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] [instance: 4275d1a7-42d6-4af5-be51-64fb1c4f6fad] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:02.808787 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-20b7af98-0116-446f-84dc-9bb2d57fb8e6 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:02.811126 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-20b7af98-0116-446f-84dc-9bb2d57fb8e6 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:02.811595 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-20b7af98-0116-446f-84dc-9bb2d57fb8e6 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:02.817797 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-20b7af98-0116-446f-84dc-9bb2d57fb8e6 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:02.818478 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-20b7af98-0116-446f-84dc-9bb2d57fb8e6 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:02.821465 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-20b7af98-0116-446f-84dc-9bb2d57fb8e6 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:02.866301 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-20b7af98-0116-446f-84dc-9bb2d57fb8e6 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] HTTP exception thrown: Instance 4275d1a7-42d6-4af5-be51-64fb1c4f6fad could not be found. Oct 04 18:50:02.886805 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-20b7af98-0116-446f-84dc-9bb2d57fb8e6 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Request method failure captured: Oct 04 18:50:02.886805 n-d-851028-13 devstack@n-api.service[123596]: request: GET /compute/v2.1/servers/4275d1a7-42d6-4af5-be51-64fb1c4f6fad HTTP/1.1 Oct 04 18:50:02.886805 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:50:02.886805 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:50:02.886805 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:50:02.886805 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 18:50:02.886805 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:50:02.886805 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:50:02.886805 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:50:02.886805 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:50:02.886805 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPIAJxznq_dqRpKBeHYz_tTt-BPe6PGX8bXmZXSSSBar-nAl3_7gjSqUW3yyr2J4Kw1m1-l6Y2izmzOt3P0Lv3UhhGPTaACGzV6RGiSkRczLrMXORtXSdyVIiZq3MCL7L2uQGd29MwUZa7-C3NoIEqHwDxvVJi_WWjtFyKnOFEp1-BZ0 Oct 04 18:50:02.886805 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:50:02.886805 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:50:02.886805 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:50:02.886805 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:50:02.886805 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:50:02.886805 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:50:02.886805 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: ed8f94cf1c974654a336645f453c9efc Oct 04 18:50:02.886805 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-ServersTestJSON-546754383 Oct 04 18:50:02.886805 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 18:50:02.886805 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 18:50:02.886805 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/ed8f94cf1c974654a336645f453c9efc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_ed8f94cf1c974654a336645f453c9efc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ed8f94cf1c974654a336645f453c9efc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ed8f94cf1c974654a336645f453c9efc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:50:02.886805 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-ServersTestJSON-546754383 Oct 04 18:50:02.886805 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: ed8f94cf1c974654a336645f453c9efc Oct 04 18:50:02.886805 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-ServersTestJSON-546754383 Oct 04 18:50:02.886805 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-ServersTestJSON-546754383-project Oct 04 18:50:02.886805 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:50:02.886805 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:50:02.886805 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 14707008940e4965ab7d1190094a71bb Oct 04 18:50:02.886805 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-ServersTestJSON-546754383-project Oct 04 18:50:02.886805 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 18:50:02.886805 n-d-851028-13 devstack@n-api.service[123596]: exception: Instance 4275d1a7-42d6-4af5-be51-64fb1c4f6fad could not be found. Oct 04 18:50:02.886805 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': '4275d1a7-42d6-4af5-be51-64fb1c4f6fad'} Oct 04 18:50:02.886805 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:50:02.886805 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:50:02.886805 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:50:02.886805 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:50:02.886805 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:50:02.886805 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:50:02.886805 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:50:02.886805 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:50:02.886805 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:50:02.886805 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:50:02.886805 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4275d1a7-42d6-4af5-be51-64fb1c4f6fad could not be found. Oct 04 18:50:02.886805 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:50:02.886805 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:50:02.886805 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:50:02.886805 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:50:02.886805 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:50:02.886805 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:50:02.886805 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:50:02.886805 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:50:02.886805 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:50:02.886805 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:50:02.886805 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:50:02.886805 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:50:02.886805 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:50:02.886805 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:50:02.886805 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:50:02.886805 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:50:02.886805 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4275d1a7-42d6-4af5-be51-64fb1c4f6fad could not be found. Oct 04 18:50:02.886805 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:50:02.886805 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:50:02.886805 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:50:02.886805 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:50:02.890709 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:50:02.890709 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:50:02.890709 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:50:02.890709 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:50:02.890709 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4275d1a7-42d6-4af5-be51-64fb1c4f6fad could not be found. Oct 04 18:50:02.890709 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:50:02.895617 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-20b7af98-0116-446f-84dc-9bb2d57fb8e6 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Returning 404 to user: Instance 4275d1a7-42d6-4af5-be51-64fb1c4f6fad could not be found. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:50:02.897151 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-20b7af98-0116-446f-84dc-9bb2d57fb8e6 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] 10.222.0.43 "GET /compute/v2.1/servers/4275d1a7-42d6-4af5-be51-64fb1c4f6fad" status: 404 len: 111 microversion: 2.1 time: 0.139524 Oct 04 18:50:02.910122 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2250/4235] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:02 2022] GET /compute/v2.1/servers/4275d1a7-42d6-4af5-be51-64fb1c4f6fad => generated 111 bytes in 153 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:50:02.912002 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-a6bfcf1c-1d87-4b88-9665-cef93e17b3d9 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Calling method '.version_select at 0x7fb21eaa0f70>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:02.972565 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-a6bfcf1c-1d87-4b88-9665-cef93e17b3d9 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-key-1703616584" status: 202 len: 0 microversion: 2.1 time: 0.068732 Oct 04 18:50:02.973806 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1986/4236] 10.222.0.43 () {58 vars in 1209 bytes} [Tue Oct 4 18:50:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-1703616584 => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:50:03.243381 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-7ff238c1-4aef-4d16-93ac-31fff68a38de tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:03.244021 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-7ff238c1-4aef-4d16-93ac-31fff68a38de tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 82b86465-afb0-49ef-9932-1538010c1ae5] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:03.263355 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7ff238c1-4aef-4d16-93ac-31fff68a38de tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:03.263896 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7ff238c1-4aef-4d16-93ac-31fff68a38de tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:03.264352 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7ff238c1-4aef-4d16-93ac-31fff68a38de tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:03.283045 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7ff238c1-4aef-4d16-93ac-31fff68a38de tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:03.285801 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7ff238c1-4aef-4d16-93ac-31fff68a38de tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:03.286203 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7ff238c1-4aef-4d16-93ac-31fff68a38de tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:03.452218 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-3fd41049-0c78-40e0-85bd-d159fa1dded1 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1190005884", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452", "networks": [{"uuid": "4a1417e9-f3af-46cb-a463-32dd1c79c4e9"}]}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:50:03.502833 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-7ff238c1-4aef-4d16-93ac-31fff68a38de tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:03.513912 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-7ff238c1-4aef-4d16-93ac-31fff68a38de tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5" status: 200 len: 1667 microversion: 2.1 time: 0.276597 Oct 04 18:50:03.514742 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2251/4237] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:03 2022] GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5 => generated 1667 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:03.538498 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-b4ef303a-1619-43b1-8e5e-169824859a25 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:03.539711 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-b4ef303a-1619-43b1-8e5e-169824859a25 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 82b86465-afb0-49ef-9932-1538010c1ae5] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:03.551657 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b4ef303a-1619-43b1-8e5e-169824859a25 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:03.552571 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b4ef303a-1619-43b1-8e5e-169824859a25 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:03.553773 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b4ef303a-1619-43b1-8e5e-169824859a25 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:03.555578 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b4ef303a-1619-43b1-8e5e-169824859a25 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:03.558802 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b4ef303a-1619-43b1-8e5e-169824859a25 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:03.559354 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b4ef303a-1619-43b1-8e5e-169824859a25 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:03.604447 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.network.neutron [None req-3fd41049-0c78-40e0-85bd-d159fa1dded1 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] validate_networks() for [('4a1417e9-f3af-46cb-a463-32dd1c79c4e9', None, None, None, None, None)] {{(pid=123595) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:50:03.814697 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-b4ef303a-1619-43b1-8e5e-169824859a25 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:03.829228 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-b4ef303a-1619-43b1-8e5e-169824859a25 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5" status: 200 len: 1667 microversion: 2.1 time: 0.294472 Oct 04 18:50:03.832169 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2252/4238] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:03 2022] GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5 => generated 1667 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:50:03.859609 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-0612ac48-6de5-4120-9901-64239a36273c tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:03.860322 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-0612ac48-6de5-4120-9901-64239a36273c tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 287c44c9-e70d-4492-b4b6-35bee8011596] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:03.868892 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0612ac48-6de5-4120-9901-64239a36273c tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:03.869793 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0612ac48-6de5-4120-9901-64239a36273c tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:03.870655 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0612ac48-6de5-4120-9901-64239a36273c tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:03.871640 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0612ac48-6de5-4120-9901-64239a36273c tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:03.872556 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0612ac48-6de5-4120-9901-64239a36273c tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:03.873259 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0612ac48-6de5-4120-9901-64239a36273c tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:03.909227 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-0612ac48-6de5-4120-9901-64239a36273c tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 287c44c9-e70d-4492-b4b6-35bee8011596] Going to try to terminate instance {{(pid=123596) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:50:03.921346 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.compute.api [None req-0612ac48-6de5-4120-9901-64239a36273c tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 287c44c9-e70d-4492-b4b6-35bee8011596] Working on deleting snapshot 248d13ac-32d6-46f7-bf3f-a4eadb0396fb from shelved instance... Oct 04 18:50:04.389250 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-3fd41049-0c78-40e0-85bd-d159fa1dded1 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Flavor limits 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:50:04.390319 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-3fd41049-0c78-40e0-85bd-d159fa1dded1 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Image limits 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:50:04.390964 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-3fd41049-0c78-40e0-85bd-d159fa1dded1 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Flavor pref 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:50:04.391715 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-3fd41049-0c78-40e0-85bd-d159fa1dded1 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Image pref 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:50:04.392415 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-3fd41049-0c78-40e0-85bd-d159fa1dded1 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:50:04.418480 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3fd41049-0c78-40e0-85bd-d159fa1dded1 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:04.425476 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3fd41049-0c78-40e0-85bd-d159fa1dded1 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:04.426148 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3fd41049-0c78-40e0-85bd-d159fa1dded1 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:04.428203 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3fd41049-0c78-40e0-85bd-d159fa1dded1 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:04.430387 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3fd41049-0c78-40e0-85bd-d159fa1dded1 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:04.432442 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3fd41049-0c78-40e0-85bd-d159fa1dded1 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:04.497584 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-3fd41049-0c78-40e0-85bd-d159fa1dded1 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Getting quotas for project ed8f94cf1c974654a336645f453c9efc. Resources: {'ram', 'cores', 'instances'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:50:04.508434 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-3fd41049-0c78-40e0-85bd-d159fa1dded1 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Getting quotas for user 14707008940e4965ab7d1190094a71bb and project ed8f94cf1c974654a336645f453c9efc. Resources: {'ram', 'cores', 'instances'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:50:04.540322 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-3fd41049-0c78-40e0-85bd-d159fa1dded1 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Going to run 1 instances... {{(pid=123595) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:50:04.543458 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-3fd41049-0c78-40e0-85bd-d159fa1dded1 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] [instance: af90e409-4121-4169-b06b-814350b000ec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e8943ec5-4038-4d4b-b9b9-2415a79f5243',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:50:04.631689 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-3fd41049-0c78-40e0-85bd-d159fa1dded1 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.184272 Oct 04 18:50:04.635921 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1987/4239] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 18:50:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 1189 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:50:04.649553 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-e6cd4d21-2eb6-45cf-b2c9-6e4dc7ffdea0 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:04.653629 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-e6cd4d21-2eb6-45cf-b2c9-6e4dc7ffdea0 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] [instance: af90e409-4121-4169-b06b-814350b000ec] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:04.796693 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-e6cd4d21-2eb6-45cf-b2c9-6e4dc7ffdea0 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14707008940e4965ab7d1190094a71bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8f94cf1c974654a336645f453c9efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:04.807541 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-e6cd4d21-2eb6-45cf-b2c9-6e4dc7ffdea0 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] 10.222.0.43 "GET /compute/v2.1/servers/af90e409-4121-4169-b06b-814350b000ec" status: 200 len: 1209 microversion: 2.1 time: 0.162577 Oct 04 18:50:04.823735 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1988/4240] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:04 2022] GET /compute/v2.1/servers/af90e409-4121-4169-b06b-814350b000ec => generated 1209 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:05.830334 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-52aa1ce1-a25e-43d2-9c2e-5ca3c512ae01 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:05.831259 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-52aa1ce1-a25e-43d2-9c2e-5ca3c512ae01 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] [instance: af90e409-4121-4169-b06b-814350b000ec] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:05.840761 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-52aa1ce1-a25e-43d2-9c2e-5ca3c512ae01 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:05.845892 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-52aa1ce1-a25e-43d2-9c2e-5ca3c512ae01 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:05.846663 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-52aa1ce1-a25e-43d2-9c2e-5ca3c512ae01 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:05.847650 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-52aa1ce1-a25e-43d2-9c2e-5ca3c512ae01 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:05.856370 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-52aa1ce1-a25e-43d2-9c2e-5ca3c512ae01 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:05.857328 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-52aa1ce1-a25e-43d2-9c2e-5ca3c512ae01 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:05.987238 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-52aa1ce1-a25e-43d2-9c2e-5ca3c512ae01 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14707008940e4965ab7d1190094a71bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8f94cf1c974654a336645f453c9efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:06.003146 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-0612ac48-6de5-4120-9901-64239a36273c tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 287c44c9-e70d-4492-b4b6-35bee8011596] Doing local delete in cell 66287c68-6a08-453f-953b-bd2446fe0d25(cell1) {{(pid=123596) _delete /opt/stack/nova/nova/compute/api.py:2546}} Oct 04 18:50:06.003877 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0612ac48-6de5-4120-9901-64239a36273c tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:06.004360 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0612ac48-6de5-4120-9901-64239a36273c tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:06.004798 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0612ac48-6de5-4120-9901-64239a36273c tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:06.005254 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.compute.api [None req-0612ac48-6de5-4120-9901-64239a36273c tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 287c44c9-e70d-4492-b4b6-35bee8011596] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Oct 04 18:50:06.014662 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.network.neutron [None req-0612ac48-6de5-4120-9901-64239a36273c tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 287c44c9-e70d-4492-b4b6-35bee8011596] deallocate_for_instance() {{(pid=123596) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Oct 04 18:50:06.018677 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-52aa1ce1-a25e-43d2-9c2e-5ca3c512ae01 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] 10.222.0.43 "GET /compute/v2.1/servers/af90e409-4121-4169-b06b-814350b000ec" status: 200 len: 1213 microversion: 2.1 time: 0.192160 Oct 04 18:50:06.030072 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1989/4241] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:05 2022] GET /compute/v2.1/servers/af90e409-4121-4169-b06b-814350b000ec => generated 1213 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:50:07.044806 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-7c990c9d-1c25-4ef3-a711-12f92137f163 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:07.046298 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-7c990c9d-1c25-4ef3-a711-12f92137f163 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] [instance: af90e409-4121-4169-b06b-814350b000ec] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:07.056966 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7c990c9d-1c25-4ef3-a711-12f92137f163 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:07.074020 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7c990c9d-1c25-4ef3-a711-12f92137f163 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:07.074734 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7c990c9d-1c25-4ef3-a711-12f92137f163 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:07.075652 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7c990c9d-1c25-4ef3-a711-12f92137f163 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:07.076273 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7c990c9d-1c25-4ef3-a711-12f92137f163 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:07.076863 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7c990c9d-1c25-4ef3-a711-12f92137f163 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:07.247499 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-7c990c9d-1c25-4ef3-a711-12f92137f163 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14707008940e4965ab7d1190094a71bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8f94cf1c974654a336645f453c9efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:07.343848 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-7c990c9d-1c25-4ef3-a711-12f92137f163 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] 10.222.0.43 "GET /compute/v2.1/servers/af90e409-4121-4169-b06b-814350b000ec" status: 200 len: 1279 microversion: 2.1 time: 0.304210 Oct 04 18:50:07.368114 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1990/4242] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:07 2022] GET /compute/v2.1/servers/af90e409-4121-4169-b06b-814350b000ec => generated 1279 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:50:08.244343 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.network.neutron [None req-0612ac48-6de5-4120-9901-64239a36273c tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 287c44c9-e70d-4492-b4b6-35bee8011596] Updating instance_info_cache with network_info: [] {{(pid=123596) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 04 18:50:08.316814 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-bdbcbb5f-0715-4475-86d3-2380200071de req-e5e44b20-7b2d-49ff-97b3-624e5d625c72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "287c44c9-e70d-4492-b4b6-35bee8011596", "name": "network-vif-deleted", "tag": "37fe4acb-5d41-4bcb-9278-e11389be7c1d"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:50:08.344940 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-bdbcbb5f-0715-4475-86d3-2380200071de req-e5e44b20-7b2d-49ff-97b3-624e5d625c72 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:08.352695 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-bdbcbb5f-0715-4475-86d3-2380200071de req-e5e44b20-7b2d-49ff-97b3-624e5d625c72 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:08.362725 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-bdbcbb5f-0715-4475-86d3-2380200071de req-e5e44b20-7b2d-49ff-97b3-624e5d625c72 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:08.416044 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.compute.server_external_events [req-bdbcbb5f-0715-4475-86d3-2380200071de req-e5e44b20-7b2d-49ff-97b3-624e5d625c72 service nova] Unable to find a host for instance 287c44c9-e70d-4492-b4b6-35bee8011596. Dropping event network-vif-deleted {{(pid=123595) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 04 18:50:08.425216 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-bdbcbb5f-0715-4475-86d3-2380200071de req-e5e44b20-7b2d-49ff-97b3-624e5d625c72 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.110764 Oct 04 18:50:08.433619 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1991/4243] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:50:08 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 122 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 04 18:50:08.452847 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-21793855-05dc-472f-8994-2bca3be1940b tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:08.454062 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=7,nova_cell1:INSERT=2,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:50:08.455613 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-21793855-05dc-472f-8994-2bca3be1940b tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] [instance: af90e409-4121-4169-b06b-814350b000ec] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:08.484754 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-21793855-05dc-472f-8994-2bca3be1940b tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:08.493916 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-21793855-05dc-472f-8994-2bca3be1940b tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:08.494742 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-21793855-05dc-472f-8994-2bca3be1940b tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:08.495875 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-21793855-05dc-472f-8994-2bca3be1940b tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:08.499016 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-21793855-05dc-472f-8994-2bca3be1940b tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:08.499720 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-21793855-05dc-472f-8994-2bca3be1940b tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:08.909992 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-0612ac48-6de5-4120-9901-64239a36273c tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "DELETE /compute/v2.1/servers/287c44c9-e70d-4492-b4b6-35bee8011596" status: 204 len: 0 microversion: 2.1 time: 5.055577 Oct 04 18:50:08.917714 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2253/4244] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 18:50:03 2022] DELETE /compute/v2.1/servers/287c44c9-e70d-4492-b4b6-35bee8011596 => generated 0 bytes in 5060 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 18:50:08.931877 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-e13de5b0-befe-4202-8689-8971c0cf2197 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:08.934308 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-e13de5b0-befe-4202-8689-8971c0cf2197 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 287c44c9-e70d-4492-b4b6-35bee8011596] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:08.952625 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e13de5b0-befe-4202-8689-8971c0cf2197 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:08.954788 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e13de5b0-befe-4202-8689-8971c0cf2197 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:08.955552 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e13de5b0-befe-4202-8689-8971c0cf2197 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:08.957490 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e13de5b0-befe-4202-8689-8971c0cf2197 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:08.961549 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e13de5b0-befe-4202-8689-8971c0cf2197 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:08.962927 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e13de5b0-befe-4202-8689-8971c0cf2197 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:09.006572 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-e13de5b0-befe-4202-8689-8971c0cf2197 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] HTTP exception thrown: Instance 287c44c9-e70d-4492-b4b6-35bee8011596 could not be found. Oct 04 18:50:09.012391 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-e13de5b0-befe-4202-8689-8971c0cf2197 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Request method failure captured: Oct 04 18:50:09.012391 n-d-851028-13 devstack@n-api.service[123596]: request: GET /compute/v2.1/servers/287c44c9-e70d-4492-b4b6-35bee8011596 HTTP/1.1 Oct 04 18:50:09.012391 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:50:09.012391 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:50:09.012391 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:50:09.012391 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 18:50:09.012391 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:50:09.012391 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:50:09.012391 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:50:09.012391 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:50:09.012391 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPH5Y8VwBda5zUzX7ascLTB3Qbosoo60vZOoFyoP9LMQR5mhyf58gwOhX5OQ1_45choDiQHF8u029lzYPJiPJTmy12iHuGw0ye25qipylbXQG76rB007_6q71vYweTO_w2ZGSDLwZR6h4S4zanUtwJXkJkZX2y1e-onEmHtUGHW_6bUQ Oct 04 18:50:09.012391 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:50:09.012391 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:50:09.012391 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:50:09.012391 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:50:09.012391 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:50:09.012391 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:50:09.012391 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: b928ae7385da4599bbe0ea701681b233 Oct 04 18:50:09.012391 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-ServerActionsTestJSON-1452535557 Oct 04 18:50:09.012391 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 18:50:09.012391 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 18:50:09.012391 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/b928ae7385da4599bbe0ea701681b233"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_b928ae7385da4599bbe0ea701681b233"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b928ae7385da4599bbe0ea701681b233"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b928ae7385da4599bbe0ea701681b233"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:50:09.012391 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-ServerActionsTestJSON-1452535557 Oct 04 18:50:09.012391 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: b928ae7385da4599bbe0ea701681b233 Oct 04 18:50:09.012391 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-ServerActionsTestJSON-1452535557 Oct 04 18:50:09.012391 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-ServerActionsTestJSON-1452535557-project Oct 04 18:50:09.012391 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:50:09.012391 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:50:09.012391 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 93c36c0802f4473f96d0721caa50374a Oct 04 18:50:09.012391 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-ServerActionsTestJSON-1452535557-project Oct 04 18:50:09.012391 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 18:50:09.012391 n-d-851028-13 devstack@n-api.service[123596]: exception: Instance 287c44c9-e70d-4492-b4b6-35bee8011596 could not be found. Oct 04 18:50:09.012391 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': '287c44c9-e70d-4492-b4b6-35bee8011596'} Oct 04 18:50:09.012391 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:50:09.012391 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:50:09.012391 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:50:09.012391 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:50:09.012391 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:50:09.012391 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:50:09.012391 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:50:09.012391 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:50:09.012391 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:50:09.012391 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:50:09.012391 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 287c44c9-e70d-4492-b4b6-35bee8011596 could not be found. Oct 04 18:50:09.012391 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:50:09.012391 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:50:09.012391 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:50:09.012391 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:50:09.012391 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:50:09.012391 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:50:09.012391 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:50:09.012391 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:50:09.012391 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:50:09.012391 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:50:09.012391 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:50:09.012391 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:50:09.012391 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:50:09.012391 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:50:09.012391 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:50:09.012391 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:50:09.012391 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 287c44c9-e70d-4492-b4b6-35bee8011596 could not be found. Oct 04 18:50:09.012391 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:50:09.012391 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:50:09.012391 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:50:09.015925 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:50:09.015925 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:50:09.015925 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:50:09.015925 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:50:09.015925 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:50:09.015925 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 287c44c9-e70d-4492-b4b6-35bee8011596 could not be found. Oct 04 18:50:09.015925 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:50:09.017945 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-e13de5b0-befe-4202-8689-8971c0cf2197 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Returning 404 to user: Instance 287c44c9-e70d-4492-b4b6-35bee8011596 could not be found. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:50:09.019604 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-e13de5b0-befe-4202-8689-8971c0cf2197 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/287c44c9-e70d-4492-b4b6-35bee8011596" status: 404 len: 111 microversion: 2.1 time: 0.100817 Oct 04 18:50:09.026838 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2254/4245] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:08 2022] GET /compute/v2.1/servers/287c44c9-e70d-4492-b4b6-35bee8011596 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:50:09.036393 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-0996cd11-ef97-43ce-bab8-f2ab480b52cc tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:09.036906 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-0996cd11-ef97-43ce-bab8-f2ab480b52cc tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 4339f9b7-28e4-4ea7-9e0f-bd44a8365166] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:09.057063 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0996cd11-ef97-43ce-bab8-f2ab480b52cc tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:09.057844 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0996cd11-ef97-43ce-bab8-f2ab480b52cc tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:09.058502 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0996cd11-ef97-43ce-bab8-f2ab480b52cc tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:09.062137 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0996cd11-ef97-43ce-bab8-f2ab480b52cc tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:09.062832 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0996cd11-ef97-43ce-bab8-f2ab480b52cc tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:09.068660 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0996cd11-ef97-43ce-bab8-f2ab480b52cc tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:09.126826 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-0996cd11-ef97-43ce-bab8-f2ab480b52cc tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 4339f9b7-28e4-4ea7-9e0f-bd44a8365166] Going to try to terminate instance {{(pid=123596) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:50:09.318563 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-0996cd11-ef97-43ce-bab8-f2ab480b52cc tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "DELETE /compute/v2.1/servers/4339f9b7-28e4-4ea7-9e0f-bd44a8365166" status: 204 len: 0 microversion: 2.1 time: 0.287264 Oct 04 18:50:09.320592 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2255/4246] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 18:50:09 2022] DELETE /compute/v2.1/servers/4339f9b7-28e4-4ea7-9e0f-bd44a8365166 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:50:09.334787 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-0457a3a4-5b1f-4a07-b54f-8af9971331b6 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:09.336760 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-0457a3a4-5b1f-4a07-b54f-8af9971331b6 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 4339f9b7-28e4-4ea7-9e0f-bd44a8365166] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:09.351013 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0457a3a4-5b1f-4a07-b54f-8af9971331b6 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:09.351524 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0457a3a4-5b1f-4a07-b54f-8af9971331b6 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:09.352443 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0457a3a4-5b1f-4a07-b54f-8af9971331b6 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:09.352711 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0457a3a4-5b1f-4a07-b54f-8af9971331b6 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:09.353350 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0457a3a4-5b1f-4a07-b54f-8af9971331b6 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:09.354656 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0457a3a4-5b1f-4a07-b54f-8af9971331b6 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:09.436580 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-21793855-05dc-472f-8994-2bca3be1940b tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14707008940e4965ab7d1190094a71bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8f94cf1c974654a336645f453c9efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:09.445328 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-21793855-05dc-472f-8994-2bca3be1940b tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] 10.222.0.43 "GET /compute/v2.1/servers/af90e409-4121-4169-b06b-814350b000ec" status: 200 len: 1309 microversion: 2.1 time: 1.007728 Oct 04 18:50:09.448830 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1992/4247] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:08 2022] GET /compute/v2.1/servers/af90e409-4121-4169-b06b-814350b000ec => generated 1309 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:09.568118 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-0457a3a4-5b1f-4a07-b54f-8af9971331b6 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:09.579032 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-0457a3a4-5b1f-4a07-b54f-8af9971331b6 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/4339f9b7-28e4-4ea7-9e0f-bd44a8365166" status: 200 len: 1464 microversion: 2.1 time: 0.249544 Oct 04 18:50:09.591316 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2256/4248] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:09 2022] GET /compute/v2.1/servers/4339f9b7-28e4-4ea7-9e0f-bd44a8365166 => generated 1464 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:10.479973 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-e722dbd4-71f1-443b-a9c3-56a58c9f62aa tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:10.481426 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-e722dbd4-71f1-443b-a9c3-56a58c9f62aa tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] [instance: af90e409-4121-4169-b06b-814350b000ec] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:10.497719 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e722dbd4-71f1-443b-a9c3-56a58c9f62aa tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:10.498583 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e722dbd4-71f1-443b-a9c3-56a58c9f62aa tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:10.499851 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e722dbd4-71f1-443b-a9c3-56a58c9f62aa tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:10.503235 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e722dbd4-71f1-443b-a9c3-56a58c9f62aa tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:10.505270 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e722dbd4-71f1-443b-a9c3-56a58c9f62aa tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:10.506204 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e722dbd4-71f1-443b-a9c3-56a58c9f62aa tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:10.614055 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-12522aa1-f4bf-4763-8193-6fb21fb06c31 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:10.615492 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-12522aa1-f4bf-4763-8193-6fb21fb06c31 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 4339f9b7-28e4-4ea7-9e0f-bd44a8365166] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:10.625558 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-12522aa1-f4bf-4763-8193-6fb21fb06c31 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:10.642951 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-12522aa1-f4bf-4763-8193-6fb21fb06c31 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:10.645014 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-12522aa1-f4bf-4763-8193-6fb21fb06c31 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:10.648156 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-12522aa1-f4bf-4763-8193-6fb21fb06c31 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:10.656024 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-12522aa1-f4bf-4763-8193-6fb21fb06c31 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:10.657577 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-12522aa1-f4bf-4763-8193-6fb21fb06c31 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:11.002297 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-e722dbd4-71f1-443b-a9c3-56a58c9f62aa tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14707008940e4965ab7d1190094a71bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8f94cf1c974654a336645f453c9efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:11.009976 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-12522aa1-f4bf-4763-8193-6fb21fb06c31 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:11.018764 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-e722dbd4-71f1-443b-a9c3-56a58c9f62aa tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] 10.222.0.43 "GET /compute/v2.1/servers/af90e409-4121-4169-b06b-814350b000ec" status: 200 len: 1309 microversion: 2.1 time: 0.546197 Oct 04 18:50:11.020470 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1993/4249] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:10 2022] GET /compute/v2.1/servers/af90e409-4121-4169-b06b-814350b000ec => generated 1309 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:11.047128 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-12522aa1-f4bf-4763-8193-6fb21fb06c31 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/4339f9b7-28e4-4ea7-9e0f-bd44a8365166" status: 200 len: 1464 microversion: 2.1 time: 0.437490 Oct 04 18:50:11.055016 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2257/4250] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:10 2022] GET /compute/v2.1/servers/4339f9b7-28e4-4ea7-9e0f-bd44a8365166 => generated 1464 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:11.058407 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-1f1d7d10-b6c0-4263-a6e6-b4de353e3387 req-aae46020-d439-4a4d-9ad2-ed4233522a4a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af90e409-4121-4169-b06b-814350b000ec", "tag": "826b73cb-0d12-468e-94a2-48e8b5979122"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:50:11.091136 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-1f1d7d10-b6c0-4263-a6e6-b4de353e3387 req-aae46020-d439-4a4d-9ad2-ed4233522a4a service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:11.092581 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-1f1d7d10-b6c0-4263-a6e6-b4de353e3387 req-aae46020-d439-4a4d-9ad2-ed4233522a4a service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:11.095784 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-1f1d7d10-b6c0-4263-a6e6-b4de353e3387 req-aae46020-d439-4a4d-9ad2-ed4233522a4a service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:11.113841 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-1f1d7d10-b6c0-4263-a6e6-b4de353e3387 req-aae46020-d439-4a4d-9ad2-ed4233522a4a service nova] Creating event network-changed:826b73cb-0d12-468e-94a2-48e8b5979122 for instance af90e409-4121-4169-b06b-814350b000ec on n-h2-851028-13 Oct 04 18:50:11.121380 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-1f1d7d10-b6c0-4263-a6e6-b4de353e3387 req-aae46020-d439-4a4d-9ad2-ed4233522a4a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097162 Oct 04 18:50:11.122744 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1994/4251] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:50:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:50:12.043367 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-95d1e440-442d-4547-b011-21906ea43d66 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:12.044775 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-95d1e440-442d-4547-b011-21906ea43d66 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] [instance: af90e409-4121-4169-b06b-814350b000ec] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:12.053148 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-95d1e440-442d-4547-b011-21906ea43d66 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:12.056579 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-95d1e440-442d-4547-b011-21906ea43d66 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:12.057256 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-95d1e440-442d-4547-b011-21906ea43d66 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:12.058190 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-95d1e440-442d-4547-b011-21906ea43d66 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:12.058811 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-95d1e440-442d-4547-b011-21906ea43d66 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:12.059501 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-95d1e440-442d-4547-b011-21906ea43d66 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:12.084534 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-27cf0873-97a0-45dd-b3c5-c418ed3898a5 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:12.091508 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-27cf0873-97a0-45dd-b3c5-c418ed3898a5 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 4339f9b7-28e4-4ea7-9e0f-bd44a8365166] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:12.119761 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-27cf0873-97a0-45dd-b3c5-c418ed3898a5 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:12.121707 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-27cf0873-97a0-45dd-b3c5-c418ed3898a5 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:12.126468 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-27cf0873-97a0-45dd-b3c5-c418ed3898a5 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:12.127736 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-27cf0873-97a0-45dd-b3c5-c418ed3898a5 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:12.129457 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-27cf0873-97a0-45dd-b3c5-c418ed3898a5 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:12.131815 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-27cf0873-97a0-45dd-b3c5-c418ed3898a5 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:12.302901 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-27cf0873-97a0-45dd-b3c5-c418ed3898a5 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:12.328316 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-27cf0873-97a0-45dd-b3c5-c418ed3898a5 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/4339f9b7-28e4-4ea7-9e0f-bd44a8365166" status: 200 len: 1464 microversion: 2.1 time: 0.251026 Oct 04 18:50:12.328926 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1995/4252] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:12 2022] GET /compute/v2.1/servers/4339f9b7-28e4-4ea7-9e0f-bd44a8365166 => generated 1464 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:12.581300 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-95d1e440-442d-4547-b011-21906ea43d66 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14707008940e4965ab7d1190094a71bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8f94cf1c974654a336645f453c9efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:12.596349 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-95d1e440-442d-4547-b011-21906ea43d66 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] 10.222.0.43 "GET /compute/v2.1/servers/af90e409-4121-4169-b06b-814350b000ec" status: 200 len: 1309 microversion: 2.1 time: 0.557134 Oct 04 18:50:12.598360 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2258/4253] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:12 2022] GET /compute/v2.1/servers/af90e409-4121-4169-b06b-814350b000ec => generated 1309 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:13.180109 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-888d8b2e-9c24-4f97-957e-b69cf98e06ea req-9c83a95b-5c40-40b2-a350-65f7847ea8c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4339f9b7-28e4-4ea7-9e0f-bd44a8365166", "name": "network-vif-deleted", "tag": "4ec2a05f-d8b5-433a-8838-922f80ff479a"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:50:13.216654 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-888d8b2e-9c24-4f97-957e-b69cf98e06ea req-9c83a95b-5c40-40b2-a350-65f7847ea8c7 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:13.217156 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-888d8b2e-9c24-4f97-957e-b69cf98e06ea req-9c83a95b-5c40-40b2-a350-65f7847ea8c7 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:13.218029 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-888d8b2e-9c24-4f97-957e-b69cf98e06ea req-9c83a95b-5c40-40b2-a350-65f7847ea8c7 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:13.250155 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-888d8b2e-9c24-4f97-957e-b69cf98e06ea req-9c83a95b-5c40-40b2-a350-65f7847ea8c7 service nova] Creating event network-vif-deleted:4ec2a05f-d8b5-433a-8838-922f80ff479a for instance 4339f9b7-28e4-4ea7-9e0f-bd44a8365166 on n-h1-851028-13 Oct 04 18:50:13.262768 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-888d8b2e-9c24-4f97-957e-b69cf98e06ea req-9c83a95b-5c40-40b2-a350-65f7847ea8c7 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087363 Oct 04 18:50:13.267553 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1996/4254] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:50:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:50:13.353968 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-772776e9-87d5-4fa2-8beb-0fa14ea2ebd3 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:13.354762 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-772776e9-87d5-4fa2-8beb-0fa14ea2ebd3 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 4339f9b7-28e4-4ea7-9e0f-bd44a8365166] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:13.397451 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-772776e9-87d5-4fa2-8beb-0fa14ea2ebd3 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:13.397960 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-772776e9-87d5-4fa2-8beb-0fa14ea2ebd3 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:13.402396 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-772776e9-87d5-4fa2-8beb-0fa14ea2ebd3 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:13.403179 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-772776e9-87d5-4fa2-8beb-0fa14ea2ebd3 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:13.403673 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-772776e9-87d5-4fa2-8beb-0fa14ea2ebd3 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:13.404097 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-772776e9-87d5-4fa2-8beb-0fa14ea2ebd3 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:13.483198 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-772776e9-87d5-4fa2-8beb-0fa14ea2ebd3 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:13.483939 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-772776e9-87d5-4fa2-8beb-0fa14ea2ebd3 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:13.487428 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-772776e9-87d5-4fa2-8beb-0fa14ea2ebd3 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:13.488173 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.objects.instance [None req-772776e9-87d5-4fa2-8beb-0fa14ea2ebd3 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lazy-loading 'fault' on Instance uuid 4339f9b7-28e4-4ea7-9e0f-bd44a8365166 {{(pid=123596) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:50:13.630684 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-a19c7cba-18eb-403b-885f-98d30a4487db tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:13.631627 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-a19c7cba-18eb-403b-885f-98d30a4487db tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] [instance: af90e409-4121-4169-b06b-814350b000ec] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:13.662816 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a19c7cba-18eb-403b-885f-98d30a4487db tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:13.663336 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a19c7cba-18eb-403b-885f-98d30a4487db tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:13.663784 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a19c7cba-18eb-403b-885f-98d30a4487db tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:13.664507 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a19c7cba-18eb-403b-885f-98d30a4487db tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:13.666631 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a19c7cba-18eb-403b-885f-98d30a4487db tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:13.667917 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a19c7cba-18eb-403b-885f-98d30a4487db tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:13.773293 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-772776e9-87d5-4fa2-8beb-0fa14ea2ebd3 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:13.831719 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-772776e9-87d5-4fa2-8beb-0fa14ea2ebd3 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/4339f9b7-28e4-4ea7-9e0f-bd44a8365166" status: 200 len: 1304 microversion: 2.1 time: 0.472521 Oct 04 18:50:13.849584 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2259/4255] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:13 2022] GET /compute/v2.1/servers/4339f9b7-28e4-4ea7-9e0f-bd44a8365166 => generated 1304 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:14.406182 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-a19c7cba-18eb-403b-885f-98d30a4487db tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14707008940e4965ab7d1190094a71bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8f94cf1c974654a336645f453c9efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:14.423428 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-a19c7cba-18eb-403b-885f-98d30a4487db tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] 10.222.0.43 "GET /compute/v2.1/servers/af90e409-4121-4169-b06b-814350b000ec" status: 200 len: 1309 microversion: 2.1 time: 0.796308 Oct 04 18:50:14.425227 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1997/4256] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:13 2022] GET /compute/v2.1/servers/af90e409-4121-4169-b06b-814350b000ec => generated 1309 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:50:14.860771 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-68d91143-e01f-47e3-a780-74241bc7fa06 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:14.862097 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-68d91143-e01f-47e3-a780-74241bc7fa06 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 4339f9b7-28e4-4ea7-9e0f-bd44a8365166] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:14.878451 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-68d91143-e01f-47e3-a780-74241bc7fa06 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:14.883823 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-68d91143-e01f-47e3-a780-74241bc7fa06 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:14.885769 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-68d91143-e01f-47e3-a780-74241bc7fa06 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:14.888433 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-68d91143-e01f-47e3-a780-74241bc7fa06 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:14.891266 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-68d91143-e01f-47e3-a780-74241bc7fa06 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:14.893820 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-68d91143-e01f-47e3-a780-74241bc7fa06 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:14.959977 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-68d91143-e01f-47e3-a780-74241bc7fa06 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] HTTP exception thrown: Instance 4339f9b7-28e4-4ea7-9e0f-bd44a8365166 could not be found. Oct 04 18:50:14.968118 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-68d91143-e01f-47e3-a780-74241bc7fa06 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Request method failure captured: Oct 04 18:50:14.968118 n-d-851028-13 devstack@n-api.service[123596]: request: GET /compute/v2.1/servers/4339f9b7-28e4-4ea7-9e0f-bd44a8365166 HTTP/1.1 Oct 04 18:50:14.968118 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:50:14.968118 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:50:14.968118 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:50:14.968118 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 18:50:14.968118 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:50:14.968118 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:50:14.968118 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:50:14.968118 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:50:14.968118 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPH5Y8VwBda5zUzX7ascLTB3Qbosoo60vZOoFyoP9LMQR5mhyf58gwOhX5OQ1_45choDiQHF8u029lzYPJiPJTmy12iHuGw0ye25qipylbXQG76rB007_6q71vYweTO_w2ZGSDLwZR6h4S4zanUtwJXkJkZX2y1e-onEmHtUGHW_6bUQ Oct 04 18:50:14.968118 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:50:14.968118 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:50:14.968118 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:50:14.968118 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:50:14.968118 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:50:14.968118 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:50:14.968118 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: b928ae7385da4599bbe0ea701681b233 Oct 04 18:50:14.968118 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-ServerActionsTestJSON-1452535557 Oct 04 18:50:14.968118 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 18:50:14.968118 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 18:50:14.968118 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/b928ae7385da4599bbe0ea701681b233"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_b928ae7385da4599bbe0ea701681b233"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b928ae7385da4599bbe0ea701681b233"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b928ae7385da4599bbe0ea701681b233"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:50:14.968118 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-ServerActionsTestJSON-1452535557 Oct 04 18:50:14.968118 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: b928ae7385da4599bbe0ea701681b233 Oct 04 18:50:14.968118 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-ServerActionsTestJSON-1452535557 Oct 04 18:50:14.968118 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-ServerActionsTestJSON-1452535557-project Oct 04 18:50:14.968118 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:50:14.968118 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:50:14.968118 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 93c36c0802f4473f96d0721caa50374a Oct 04 18:50:14.968118 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-ServerActionsTestJSON-1452535557-project Oct 04 18:50:14.968118 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 18:50:14.968118 n-d-851028-13 devstack@n-api.service[123596]: exception: Instance 4339f9b7-28e4-4ea7-9e0f-bd44a8365166 could not be found. Oct 04 18:50:14.968118 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': '4339f9b7-28e4-4ea7-9e0f-bd44a8365166'} Oct 04 18:50:14.968118 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:50:14.968118 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:50:14.968118 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:50:14.968118 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:50:14.968118 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:50:14.968118 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:50:14.968118 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:50:14.968118 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:50:14.968118 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:50:14.968118 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:50:14.968118 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4339f9b7-28e4-4ea7-9e0f-bd44a8365166 could not be found. Oct 04 18:50:14.968118 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:50:14.968118 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:50:14.968118 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:50:14.968118 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:50:14.968118 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:50:14.968118 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:50:14.968118 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:50:14.968118 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:50:14.968118 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:50:14.968118 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:50:14.968118 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:50:14.968118 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:50:14.968118 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:50:14.968118 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:50:14.968118 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:50:14.968118 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:50:14.968118 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4339f9b7-28e4-4ea7-9e0f-bd44a8365166 could not be found. Oct 04 18:50:14.968118 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:50:14.968118 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:50:14.968118 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:50:14.971946 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:50:14.971946 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:50:14.971946 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:50:14.971946 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:50:14.971946 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:50:14.971946 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4339f9b7-28e4-4ea7-9e0f-bd44a8365166 could not be found. Oct 04 18:50:14.971946 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:50:14.975631 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-68d91143-e01f-47e3-a780-74241bc7fa06 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Returning 404 to user: Instance 4339f9b7-28e4-4ea7-9e0f-bd44a8365166 could not be found. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:50:14.976831 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-68d91143-e01f-47e3-a780-74241bc7fa06 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/4339f9b7-28e4-4ea7-9e0f-bd44a8365166" status: 404 len: 111 microversion: 2.1 time: 0.120812 Oct 04 18:50:14.977816 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2260/4257] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:14 2022] GET /compute/v2.1/servers/4339f9b7-28e4-4ea7-9e0f-bd44a8365166 => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:50:14.988232 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-7d3217b9-de7c-437e-bed1-fc4ee3dd581a tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:14.989033 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-7d3217b9-de7c-437e-bed1-fc4ee3dd581a tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: bb651218-4475-4df2-b470-56e737801e3b] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:14.991247 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=2 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:50:14.992591 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=8 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:50:15.000531 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7d3217b9-de7c-437e-bed1-fc4ee3dd581a tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:15.001395 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7d3217b9-de7c-437e-bed1-fc4ee3dd581a tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:15.001981 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7d3217b9-de7c-437e-bed1-fc4ee3dd581a tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:15.002884 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7d3217b9-de7c-437e-bed1-fc4ee3dd581a tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:15.003483 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7d3217b9-de7c-437e-bed1-fc4ee3dd581a tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:15.004060 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7d3217b9-de7c-437e-bed1-fc4ee3dd581a tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:15.026172 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:50:15.035863 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-7d3217b9-de7c-437e-bed1-fc4ee3dd581a tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: bb651218-4475-4df2-b470-56e737801e3b] Going to try to terminate instance {{(pid=123595) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:50:15.218068 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-7d3217b9-de7c-437e-bed1-fc4ee3dd581a tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "DELETE /compute/v2.1/servers/bb651218-4475-4df2-b470-56e737801e3b" status: 204 len: 0 microversion: 2.1 time: 0.235480 Oct 04 18:50:15.229679 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1998/4258] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 18:50:14 2022] DELETE /compute/v2.1/servers/bb651218-4475-4df2-b470-56e737801e3b => generated 0 bytes in 244 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:50:15.235981 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-35d0e22c-b441-495d-818b-cfbe3ebdb2af tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:15.236689 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-35d0e22c-b441-495d-818b-cfbe3ebdb2af tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: bb651218-4475-4df2-b470-56e737801e3b] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:15.250565 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-35d0e22c-b441-495d-818b-cfbe3ebdb2af tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:15.251074 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-35d0e22c-b441-495d-818b-cfbe3ebdb2af tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:15.251513 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-35d0e22c-b441-495d-818b-cfbe3ebdb2af tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:15.256063 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-35d0e22c-b441-495d-818b-cfbe3ebdb2af tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:15.256643 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-35d0e22c-b441-495d-818b-cfbe3ebdb2af tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:15.257046 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-35d0e22c-b441-495d-818b-cfbe3ebdb2af tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:15.451443 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-5805c2b8-fa03-43d7-b90a-a5a5d2a3d950 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:15.452469 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-5805c2b8-fa03-43d7-b90a-a5a5d2a3d950 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] [instance: af90e409-4121-4169-b06b-814350b000ec] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:15.481303 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5805c2b8-fa03-43d7-b90a-a5a5d2a3d950 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:15.483236 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5805c2b8-fa03-43d7-b90a-a5a5d2a3d950 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:15.484714 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5805c2b8-fa03-43d7-b90a-a5a5d2a3d950 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:15.487985 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5805c2b8-fa03-43d7-b90a-a5a5d2a3d950 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:15.492075 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5805c2b8-fa03-43d7-b90a-a5a5d2a3d950 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:15.493716 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5805c2b8-fa03-43d7-b90a-a5a5d2a3d950 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:15.859336 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-35d0e22c-b441-495d-818b-cfbe3ebdb2af tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:15.872353 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-35d0e22c-b441-495d-818b-cfbe3ebdb2af tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/bb651218-4475-4df2-b470-56e737801e3b" status: 200 len: 1508 microversion: 2.1 time: 0.640099 Oct 04 18:50:15.874953 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2261/4259] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:15 2022] GET /compute/v2.1/servers/bb651218-4475-4df2-b470-56e737801e3b => generated 1508 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:15.912732 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-5805c2b8-fa03-43d7-b90a-a5a5d2a3d950 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14707008940e4965ab7d1190094a71bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8f94cf1c974654a336645f453c9efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:15.923056 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-ce96d506-6a12-41ff-9564-db7e7331142b tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:15.924806 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-5805c2b8-fa03-43d7-b90a-a5a5d2a3d950 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] 10.222.0.43 "GET /compute/v2.1/servers/af90e409-4121-4169-b06b-814350b000ec" status: 200 len: 1309 microversion: 2.1 time: 0.479990 Oct 04 18:50:15.926565 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-ce96d506-6a12-41ff-9564-db7e7331142b tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] [instance: f2269817-3e15-4cfe-8446-7eb0104f9800] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:15.927002 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 1999/4260] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:15 2022] GET /compute/v2.1/servers/af90e409-4121-4169-b06b-814350b000ec => generated 1309 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:50:15.946946 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ce96d506-6a12-41ff-9564-db7e7331142b tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:15.949559 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ce96d506-6a12-41ff-9564-db7e7331142b tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:15.950445 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ce96d506-6a12-41ff-9564-db7e7331142b tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:15.951358 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ce96d506-6a12-41ff-9564-db7e7331142b tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:15.951812 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ce96d506-6a12-41ff-9564-db7e7331142b tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:15.957464 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ce96d506-6a12-41ff-9564-db7e7331142b tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:16.055198 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-ce96d506-6a12-41ff-9564-db7e7331142b tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] 10.222.0.43 "GET /compute/v2.1/servers/f2269817-3e15-4cfe-8446-7eb0104f9800/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.136178 Oct 04 18:50:16.058364 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2262/4261] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Oct 4 18:50:15 2022] GET /compute/v2.1/servers/f2269817-3e15-4cfe-8446-7eb0104f9800/os-volume_attachments => generated 197 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:50:16.071825 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-23705b98-b730-4f1b-9ed0-a5c711ed38b5 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:16.073122 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-23705b98-b730-4f1b-9ed0-a5c711ed38b5 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] [instance: f2269817-3e15-4cfe-8446-7eb0104f9800] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:16.082871 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-23705b98-b730-4f1b-9ed0-a5c711ed38b5 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:16.086787 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-23705b98-b730-4f1b-9ed0-a5c711ed38b5 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:16.088741 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-23705b98-b730-4f1b-9ed0-a5c711ed38b5 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:16.089821 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-23705b98-b730-4f1b-9ed0-a5c711ed38b5 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:16.090926 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-23705b98-b730-4f1b-9ed0-a5c711ed38b5 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:16.092889 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-23705b98-b730-4f1b-9ed0-a5c711ed38b5 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:16.170744 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-23705b98-b730-4f1b-9ed0-a5c711ed38b5 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] 10.222.0.43 "GET /compute/v2.1/servers/f2269817-3e15-4cfe-8446-7eb0104f9800/os-volume_attachments/1216c3e0-3a40-46ab-add2-29e8512ff6a3" status: 200 len: 194 microversion: 2.1 time: 0.104294 Oct 04 18:50:16.174372 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2000/4262] 10.222.0.43 () {58 vars in 1413 bytes} [Tue Oct 4 18:50:16 2022] GET /compute/v2.1/servers/f2269817-3e15-4cfe-8446-7eb0104f9800/os-volume_attachments/1216c3e0-3a40-46ab-add2-29e8512ff6a3 => generated 194 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:50:16.899322 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-344c0a13-d624-4f12-832a-991eee0f8f6d tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:16.900913 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-344c0a13-d624-4f12-832a-991eee0f8f6d tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: bb651218-4475-4df2-b470-56e737801e3b] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:16.912982 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-344c0a13-d624-4f12-832a-991eee0f8f6d tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:16.914924 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-344c0a13-d624-4f12-832a-991eee0f8f6d tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:16.917991 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-344c0a13-d624-4f12-832a-991eee0f8f6d tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:16.919598 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-344c0a13-d624-4f12-832a-991eee0f8f6d tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:16.921407 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-344c0a13-d624-4f12-832a-991eee0f8f6d tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:16.922608 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-344c0a13-d624-4f12-832a-991eee0f8f6d tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:16.954443 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-5d0a947e-dc65-4920-8629-16791d387a27 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:16.955378 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-5d0a947e-dc65-4920-8629-16791d387a27 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] [instance: af90e409-4121-4169-b06b-814350b000ec] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:16.959761 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:50:16.984379 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5d0a947e-dc65-4920-8629-16791d387a27 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:16.986763 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5d0a947e-dc65-4920-8629-16791d387a27 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:16.987512 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5d0a947e-dc65-4920-8629-16791d387a27 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:16.992616 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5d0a947e-dc65-4920-8629-16791d387a27 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:16.998824 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5d0a947e-dc65-4920-8629-16791d387a27 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:17.005744 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5d0a947e-dc65-4920-8629-16791d387a27 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:17.626478 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-5d0a947e-dc65-4920-8629-16791d387a27 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14707008940e4965ab7d1190094a71bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8f94cf1c974654a336645f453c9efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:17.637665 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-5d0a947e-dc65-4920-8629-16791d387a27 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] 10.222.0.43 "GET /compute/v2.1/servers/af90e409-4121-4169-b06b-814350b000ec" status: 200 len: 1309 microversion: 2.1 time: 0.685008 Oct 04 18:50:17.643784 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2001/4263] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:16 2022] GET /compute/v2.1/servers/af90e409-4121-4169-b06b-814350b000ec => generated 1309 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:17.789807 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-344c0a13-d624-4f12-832a-991eee0f8f6d tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:17.799382 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-344c0a13-d624-4f12-832a-991eee0f8f6d tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/bb651218-4475-4df2-b470-56e737801e3b" status: 200 len: 1508 microversion: 2.1 time: 0.904400 Oct 04 18:50:17.810012 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2263/4264] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:16 2022] GET /compute/v2.1/servers/bb651218-4475-4df2-b470-56e737801e3b => generated 1508 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:17.887162 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-efcbe4bf-de47-4c1d-921e-4afeeca71259 req-f01d4f23-d23c-4f99-ab67-d2c6ab81353e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af90e409-4121-4169-b06b-814350b000ec", "name": "network-vif-plugged", "status": "completed", "tag": "826b73cb-0d12-468e-94a2-48e8b5979122"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:50:17.919260 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-efcbe4bf-de47-4c1d-921e-4afeeca71259 req-f01d4f23-d23c-4f99-ab67-d2c6ab81353e service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:17.923315 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-efcbe4bf-de47-4c1d-921e-4afeeca71259 req-f01d4f23-d23c-4f99-ab67-d2c6ab81353e service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:17.923913 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-efcbe4bf-de47-4c1d-921e-4afeeca71259 req-f01d4f23-d23c-4f99-ab67-d2c6ab81353e service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:17.960606 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-efcbe4bf-de47-4c1d-921e-4afeeca71259 req-f01d4f23-d23c-4f99-ab67-d2c6ab81353e service nova] Creating event network-vif-plugged:826b73cb-0d12-468e-94a2-48e8b5979122 for instance af90e409-4121-4169-b06b-814350b000ec on n-h2-851028-13 Oct 04 18:50:17.972193 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-efcbe4bf-de47-4c1d-921e-4afeeca71259 req-f01d4f23-d23c-4f99-ab67-d2c6ab81353e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089784 Oct 04 18:50:17.976906 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2002/4265] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:50:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:50:18.671221 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-7f3ae142-e56e-457b-9356-7c59e104afb1 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:18.672481 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-7f3ae142-e56e-457b-9356-7c59e104afb1 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] [instance: af90e409-4121-4169-b06b-814350b000ec] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:18.682029 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7f3ae142-e56e-457b-9356-7c59e104afb1 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:18.682913 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7f3ae142-e56e-457b-9356-7c59e104afb1 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:18.683593 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7f3ae142-e56e-457b-9356-7c59e104afb1 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:18.684696 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7f3ae142-e56e-457b-9356-7c59e104afb1 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:18.685536 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7f3ae142-e56e-457b-9356-7c59e104afb1 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:18.686219 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7f3ae142-e56e-457b-9356-7c59e104afb1 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:18.834960 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-7a08fb6a-9f0c-470a-8459-dc4010e4ee80 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:18.836402 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-7a08fb6a-9f0c-470a-8459-dc4010e4ee80 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: bb651218-4475-4df2-b470-56e737801e3b] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:18.867035 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7a08fb6a-9f0c-470a-8459-dc4010e4ee80 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:18.876937 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7a08fb6a-9f0c-470a-8459-dc4010e4ee80 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:18.878917 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7a08fb6a-9f0c-470a-8459-dc4010e4ee80 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:18.892292 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7a08fb6a-9f0c-470a-8459-dc4010e4ee80 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:18.896984 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7a08fb6a-9f0c-470a-8459-dc4010e4ee80 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:18.897754 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7a08fb6a-9f0c-470a-8459-dc4010e4ee80 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:19.075019 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-7a08fb6a-9f0c-470a-8459-dc4010e4ee80 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:19.114243 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-7a08fb6a-9f0c-470a-8459-dc4010e4ee80 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/bb651218-4475-4df2-b470-56e737801e3b" status: 200 len: 1466 microversion: 2.1 time: 0.283814 Oct 04 18:50:19.114853 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2003/4266] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:18 2022] GET /compute/v2.1/servers/bb651218-4475-4df2-b470-56e737801e3b => generated 1466 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:19.151453 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-402bb08c-e666-492a-a08f-d35a9419593b req-8e51677f-b1ec-489d-b5c4-e04a169e3512 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb651218-4475-4df2-b470-56e737801e3b", "name": "network-vif-deleted", "tag": "73a0c9e9-44f1-433f-b0e2-be2bd37c67e0"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:50:19.184289 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-402bb08c-e666-492a-a08f-d35a9419593b req-8e51677f-b1ec-489d-b5c4-e04a169e3512 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:19.186818 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-402bb08c-e666-492a-a08f-d35a9419593b req-8e51677f-b1ec-489d-b5c4-e04a169e3512 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:19.189644 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-402bb08c-e666-492a-a08f-d35a9419593b req-8e51677f-b1ec-489d-b5c4-e04a169e3512 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:19.230951 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-402bb08c-e666-492a-a08f-d35a9419593b req-8e51677f-b1ec-489d-b5c4-e04a169e3512 service nova] Creating event network-vif-deleted:73a0c9e9-44f1-433f-b0e2-be2bd37c67e0 for instance bb651218-4475-4df2-b470-56e737801e3b on n-h1-851028-13 Oct 04 18:50:19.249424 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-402bb08c-e666-492a-a08f-d35a9419593b req-8e51677f-b1ec-489d-b5c4-e04a169e3512 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113061 Oct 04 18:50:19.251245 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2004/4267] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:50:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:50:19.337235 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-7f3ae142-e56e-457b-9356-7c59e104afb1 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14707008940e4965ab7d1190094a71bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8f94cf1c974654a336645f453c9efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:19.345701 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-7f3ae142-e56e-457b-9356-7c59e104afb1 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] 10.222.0.43 "GET /compute/v2.1/servers/af90e409-4121-4169-b06b-814350b000ec" status: 200 len: 1309 microversion: 2.1 time: 0.680467 Oct 04 18:50:19.369814 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2264/4268] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:18 2022] GET /compute/v2.1/servers/af90e409-4121-4169-b06b-814350b000ec => generated 1309 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:20.077849 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-3e272a4c-360d-48d2-a5e0-f6424f3f1ec2 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "59c478b3-c3f0-4dfe-9626-329d4282afc6"}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:50:20.081710 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-3e272a4c-360d-48d2-a5e0-f6424f3f1ec2 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] [instance: f2269817-3e15-4cfe-8446-7eb0104f9800] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:20.090199 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3e272a4c-360d-48d2-a5e0-f6424f3f1ec2 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:20.091033 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3e272a4c-360d-48d2-a5e0-f6424f3f1ec2 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:20.091952 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3e272a4c-360d-48d2-a5e0-f6424f3f1ec2 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:20.093066 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3e272a4c-360d-48d2-a5e0-f6424f3f1ec2 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:20.094142 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3e272a4c-360d-48d2-a5e0-f6424f3f1ec2 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:20.094890 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3e272a4c-360d-48d2-a5e0-f6424f3f1ec2 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:20.144329 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-d66c5cd0-8509-4191-ae9b-e0b83488d708 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:20.145125 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-d66c5cd0-8509-4191-ae9b-e0b83488d708 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: bb651218-4475-4df2-b470-56e737801e3b] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:20.172666 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d66c5cd0-8509-4191-ae9b-e0b83488d708 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:20.174114 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d66c5cd0-8509-4191-ae9b-e0b83488d708 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:20.178636 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d66c5cd0-8509-4191-ae9b-e0b83488d708 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:20.180757 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d66c5cd0-8509-4191-ae9b-e0b83488d708 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:20.183671 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d66c5cd0-8509-4191-ae9b-e0b83488d708 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:20.185616 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d66c5cd0-8509-4191-ae9b-e0b83488d708 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:20.247360 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-d66c5cd0-8509-4191-ae9b-e0b83488d708 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] HTTP exception thrown: Instance bb651218-4475-4df2-b470-56e737801e3b could not be found. Oct 04 18:50:20.248905 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-d66c5cd0-8509-4191-ae9b-e0b83488d708 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Request method failure captured: Oct 04 18:50:20.248905 n-d-851028-13 devstack@n-api.service[123596]: request: GET /compute/v2.1/servers/bb651218-4475-4df2-b470-56e737801e3b HTTP/1.1 Oct 04 18:50:20.248905 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:50:20.248905 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:50:20.248905 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:50:20.248905 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 18:50:20.248905 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:50:20.248905 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:50:20.248905 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:50:20.248905 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:50:20.248905 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPH5Y8VwBda5zUzX7ascLTB3Qbosoo60vZOoFyoP9LMQR5mhyf58gwOhX5OQ1_45choDiQHF8u029lzYPJiPJTmy12iHuGw0ye25qipylbXQG76rB007_6q71vYweTO_w2ZGSDLwZR6h4S4zanUtwJXkJkZX2y1e-onEmHtUGHW_6bUQ Oct 04 18:50:20.248905 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:50:20.248905 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:50:20.248905 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:50:20.248905 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:50:20.248905 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:50:20.248905 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:50:20.248905 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: b928ae7385da4599bbe0ea701681b233 Oct 04 18:50:20.248905 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-ServerActionsTestJSON-1452535557 Oct 04 18:50:20.248905 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 18:50:20.248905 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 18:50:20.248905 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/b928ae7385da4599bbe0ea701681b233"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_b928ae7385da4599bbe0ea701681b233"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b928ae7385da4599bbe0ea701681b233"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b928ae7385da4599bbe0ea701681b233"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:50:20.248905 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-ServerActionsTestJSON-1452535557 Oct 04 18:50:20.248905 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: b928ae7385da4599bbe0ea701681b233 Oct 04 18:50:20.248905 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-ServerActionsTestJSON-1452535557 Oct 04 18:50:20.248905 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-ServerActionsTestJSON-1452535557-project Oct 04 18:50:20.248905 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:50:20.248905 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:50:20.248905 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 93c36c0802f4473f96d0721caa50374a Oct 04 18:50:20.248905 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-ServerActionsTestJSON-1452535557-project Oct 04 18:50:20.248905 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 18:50:20.248905 n-d-851028-13 devstack@n-api.service[123596]: exception: Instance bb651218-4475-4df2-b470-56e737801e3b could not be found. Oct 04 18:50:20.248905 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': 'bb651218-4475-4df2-b470-56e737801e3b'} Oct 04 18:50:20.248905 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:50:20.248905 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:50:20.248905 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:50:20.248905 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:50:20.248905 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:50:20.248905 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:50:20.248905 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:50:20.248905 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:50:20.248905 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:50:20.248905 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:50:20.248905 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb651218-4475-4df2-b470-56e737801e3b could not be found. Oct 04 18:50:20.248905 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:50:20.248905 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:50:20.248905 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:50:20.248905 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:50:20.248905 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:50:20.248905 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:50:20.248905 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:50:20.248905 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:50:20.248905 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:50:20.248905 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:50:20.248905 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:50:20.248905 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:50:20.248905 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:50:20.248905 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:50:20.248905 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:50:20.248905 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:50:20.248905 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb651218-4475-4df2-b470-56e737801e3b could not be found. Oct 04 18:50:20.248905 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:50:20.248905 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:50:20.248905 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:50:20.252892 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:50:20.252892 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:50:20.252892 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:50:20.252892 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:50:20.252892 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:50:20.252892 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb651218-4475-4df2-b470-56e737801e3b could not be found. Oct 04 18:50:20.252892 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:50:20.254646 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-d66c5cd0-8509-4191-ae9b-e0b83488d708 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Returning 404 to user: Instance bb651218-4475-4df2-b470-56e737801e3b could not be found. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:50:20.256557 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-d66c5cd0-8509-4191-ae9b-e0b83488d708 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/bb651218-4475-4df2-b470-56e737801e3b" status: 404 len: 111 microversion: 2.1 time: 0.117524 Oct 04 18:50:20.257660 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2265/4269] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:20 2022] GET /compute/v2.1/servers/bb651218-4475-4df2-b470-56e737801e3b => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:50:20.287951 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-688ccf20-2b6e-4a3f-8be9-6bc393181b44 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:20.289700 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-688ccf20-2b6e-4a3f-8be9-6bc393181b44 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: d5e2bc9f-76da-4028-9b48-d00a8ae20d33] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:20.308059 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-688ccf20-2b6e-4a3f-8be9-6bc393181b44 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:20.309661 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-688ccf20-2b6e-4a3f-8be9-6bc393181b44 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:20.310359 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-688ccf20-2b6e-4a3f-8be9-6bc393181b44 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:20.312217 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-688ccf20-2b6e-4a3f-8be9-6bc393181b44 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:20.314272 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-688ccf20-2b6e-4a3f-8be9-6bc393181b44 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:20.315975 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-688ccf20-2b6e-4a3f-8be9-6bc393181b44 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:20.354866 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-688ccf20-2b6e-4a3f-8be9-6bc393181b44 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: d5e2bc9f-76da-4028-9b48-d00a8ae20d33] Going to try to terminate instance {{(pid=123596) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:50:20.380645 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=13,nova_cell1:DELETE=2,nova_cell1:INSERT=1 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:50:20.487932 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-688ccf20-2b6e-4a3f-8be9-6bc393181b44 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "DELETE /compute/v2.1/servers/d5e2bc9f-76da-4028-9b48-d00a8ae20d33" status: 204 len: 0 microversion: 2.1 time: 0.223710 Oct 04 18:50:20.488776 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2266/4270] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 18:50:20 2022] DELETE /compute/v2.1/servers/d5e2bc9f-76da-4028-9b48-d00a8ae20d33 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:50:20.499476 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f78d157e-8a8f-4e10-9364-c2c2e01b5223 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:20.500465 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-f78d157e-8a8f-4e10-9364-c2c2e01b5223 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] [instance: af90e409-4121-4169-b06b-814350b000ec] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:20.508935 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f78d157e-8a8f-4e10-9364-c2c2e01b5223 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:20.509717 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f78d157e-8a8f-4e10-9364-c2c2e01b5223 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:20.510456 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f78d157e-8a8f-4e10-9364-c2c2e01b5223 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:20.511407 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f78d157e-8a8f-4e10-9364-c2c2e01b5223 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:20.512265 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f78d157e-8a8f-4e10-9364-c2c2e01b5223 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:20.513218 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f78d157e-8a8f-4e10-9364-c2c2e01b5223 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:20.991877 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-f78d157e-8a8f-4e10-9364-c2c2e01b5223 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14707008940e4965ab7d1190094a71bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8f94cf1c974654a336645f453c9efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:21.002326 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-f78d157e-8a8f-4e10-9364-c2c2e01b5223 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] 10.222.0.43 "GET /compute/v2.1/servers/af90e409-4121-4169-b06b-814350b000ec" status: 200 len: 1489 microversion: 2.1 time: 0.511743 Oct 04 18:50:21.014143 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2267/4271] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:20 2022] GET /compute/v2.1/servers/af90e409-4121-4169-b06b-814350b000ec => generated 1489 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:21.023383 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-8124379f-cbb0-4a65-9f11-4b8a2cdc4f5a tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:21.024214 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-8124379f-cbb0-4a65-9f11-4b8a2cdc4f5a tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: d5e2bc9f-76da-4028-9b48-d00a8ae20d33] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:21.044378 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8124379f-cbb0-4a65-9f11-4b8a2cdc4f5a tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:21.061684 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8124379f-cbb0-4a65-9f11-4b8a2cdc4f5a tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:21.063427 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8124379f-cbb0-4a65-9f11-4b8a2cdc4f5a tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:21.064599 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8124379f-cbb0-4a65-9f11-4b8a2cdc4f5a tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:21.065088 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-3e272a4c-360d-48d2-a5e0-f6424f3f1ec2 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] 10.222.0.43 "POST /compute/v2.1/servers/f2269817-3e15-4cfe-8446-7eb0104f9800/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.991906 Oct 04 18:50:21.066221 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2005/4272] 10.222.0.43 () {60 vars in 1323 bytes} [Tue Oct 4 18:50:20 2022] POST /compute/v2.1/servers/f2269817-3e15-4cfe-8446-7eb0104f9800/os-volume_attachments => generated 194 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:50:21.077291 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8124379f-cbb0-4a65-9f11-4b8a2cdc4f5a tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:21.077794 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8124379f-cbb0-4a65-9f11-4b8a2cdc4f5a tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:21.265679 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-c110363b-255e-4345-aef5-ea5b4fbae707 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1190005884", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452", "networks": [{"uuid": "4a1417e9-f3af-46cb-a463-32dd1c79c4e9"}]}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:50:21.395692 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.network.neutron [None req-c110363b-255e-4345-aef5-ea5b4fbae707 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] validate_networks() for [('4a1417e9-f3af-46cb-a463-32dd1c79c4e9', None, None, None, None, None)] {{(pid=123595) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:50:21.510359 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-8124379f-cbb0-4a65-9f11-4b8a2cdc4f5a tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:21.523984 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-8124379f-cbb0-4a65-9f11-4b8a2cdc4f5a tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/d5e2bc9f-76da-4028-9b48-d00a8ae20d33" status: 200 len: 1494 microversion: 2.1 time: 0.506363 Oct 04 18:50:21.525885 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2268/4273] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:21 2022] GET /compute/v2.1/servers/d5e2bc9f-76da-4028-9b48-d00a8ae20d33 => generated 1494 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:22.285581 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-22691ee2-b08b-4dd9-9cf8-96b2e53dd5b0 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:22.286184 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-22691ee2-b08b-4dd9-9cf8-96b2e53dd5b0 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] [instance: fa47906d-d394-46fe-9143-780bcd27a715] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:22.288651 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=3 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:50:22.314974 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-22691ee2-b08b-4dd9-9cf8-96b2e53dd5b0 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:22.317011 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-22691ee2-b08b-4dd9-9cf8-96b2e53dd5b0 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:22.317559 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-22691ee2-b08b-4dd9-9cf8-96b2e53dd5b0 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:22.323548 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-22691ee2-b08b-4dd9-9cf8-96b2e53dd5b0 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:22.325084 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-22691ee2-b08b-4dd9-9cf8-96b2e53dd5b0 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:22.326043 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-22691ee2-b08b-4dd9-9cf8-96b2e53dd5b0 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:22.446295 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-22691ee2-b08b-4dd9-9cf8-96b2e53dd5b0 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] [instance: fa47906d-d394-46fe-9143-780bcd27a715] Going to try to terminate instance {{(pid=123596) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:50:22.674938 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-22691ee2-b08b-4dd9-9cf8-96b2e53dd5b0 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] 10.222.0.43 "DELETE /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715" status: 204 len: 0 microversion: 2.32 time: 0.933569 Oct 04 18:50:22.676682 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2269/4274] 10.222.0.43 () {60 vars in 1280 bytes} [Tue Oct 4 18:50:21 2022] DELETE /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715 => generated 0 bytes in 936 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 18:50:22.685438 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-6c56d6db-4ad4-4bd7-8846-e4f9f2d3fa5e tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:22.692349 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-6c56d6db-4ad4-4bd7-8846-e4f9f2d3fa5e tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: d5e2bc9f-76da-4028-9b48-d00a8ae20d33] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:22.711173 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6c56d6db-4ad4-4bd7-8846-e4f9f2d3fa5e tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:22.711978 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6c56d6db-4ad4-4bd7-8846-e4f9f2d3fa5e tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:22.712638 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6c56d6db-4ad4-4bd7-8846-e4f9f2d3fa5e tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:22.713671 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6c56d6db-4ad4-4bd7-8846-e4f9f2d3fa5e tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:22.714962 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6c56d6db-4ad4-4bd7-8846-e4f9f2d3fa5e tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:22.720311 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6c56d6db-4ad4-4bd7-8846-e4f9f2d3fa5e tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:23.045965 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-6c56d6db-4ad4-4bd7-8846-e4f9f2d3fa5e tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:23.060602 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-6c56d6db-4ad4-4bd7-8846-e4f9f2d3fa5e tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/d5e2bc9f-76da-4028-9b48-d00a8ae20d33" status: 200 len: 1494 microversion: 2.1 time: 0.381990 Oct 04 18:50:23.061621 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2270/4275] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:22 2022] GET /compute/v2.1/servers/d5e2bc9f-76da-4028-9b48-d00a8ae20d33 => generated 1494 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:23.074397 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-cbe42e70-7831-42a6-b839-b513f7a7038e tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:23.082176 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-cbe42e70-7831-42a6-b839-b513f7a7038e tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] [instance: fa47906d-d394-46fe-9143-780bcd27a715] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:23.102876 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cbe42e70-7831-42a6-b839-b513f7a7038e tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:23.105803 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cbe42e70-7831-42a6-b839-b513f7a7038e tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:23.106617 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cbe42e70-7831-42a6-b839-b513f7a7038e tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:23.114250 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cbe42e70-7831-42a6-b839-b513f7a7038e tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:23.115149 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cbe42e70-7831-42a6-b839-b513f7a7038e tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:23.115835 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cbe42e70-7831-42a6-b839-b513f7a7038e tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:23.650182 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-c110363b-255e-4345-aef5-ea5b4fbae707 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Flavor limits 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:50:23.652549 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-c110363b-255e-4345-aef5-ea5b4fbae707 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Image limits 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:50:23.653249 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-c110363b-255e-4345-aef5-ea5b4fbae707 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Flavor pref 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:50:23.654731 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-c110363b-255e-4345-aef5-ea5b4fbae707 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Image pref 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:50:23.655356 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-c110363b-255e-4345-aef5-ea5b4fbae707 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:50:23.670335 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c110363b-255e-4345-aef5-ea5b4fbae707 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:23.672102 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c110363b-255e-4345-aef5-ea5b4fbae707 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:23.673213 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c110363b-255e-4345-aef5-ea5b4fbae707 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:23.674292 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c110363b-255e-4345-aef5-ea5b4fbae707 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:23.675396 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c110363b-255e-4345-aef5-ea5b4fbae707 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:23.675994 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c110363b-255e-4345-aef5-ea5b4fbae707 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:23.729813 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-c110363b-255e-4345-aef5-ea5b4fbae707 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Getting quotas for project ed8f94cf1c974654a336645f453c9efc. Resources: {'ram', 'cores', 'instances'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:50:23.763191 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-c110363b-255e-4345-aef5-ea5b4fbae707 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Getting quotas for user 14707008940e4965ab7d1190094a71bb and project ed8f94cf1c974654a336645f453c9efc. Resources: {'ram', 'cores', 'instances'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:50:23.805716 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-c110363b-255e-4345-aef5-ea5b4fbae707 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Going to run 1 instances... {{(pid=123595) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:50:23.812487 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-c110363b-255e-4345-aef5-ea5b4fbae707 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] [instance: d802635f-8f77-4488-84e0-a973e3244525] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e8943ec5-4038-4d4b-b9b9-2415a79f5243',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:50:23.891140 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-c110363b-255e-4345-aef5-ea5b4fbae707 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.631396 Oct 04 18:50:23.897762 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2006/4276] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 18:50:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 2633 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:50:23.907746 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-9739d77e-254e-4189-b62a-5f4d42436543 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:23.908527 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-9739d77e-254e-4189-b62a-5f4d42436543 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] [instance: d802635f-8f77-4488-84e0-a973e3244525] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:24.103947 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-9739d77e-254e-4189-b62a-5f4d42436543 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14707008940e4965ab7d1190094a71bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8f94cf1c974654a336645f453c9efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:24.120497 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-9739d77e-254e-4189-b62a-5f4d42436543 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] 10.222.0.43 "GET /compute/v2.1/servers/d802635f-8f77-4488-84e0-a973e3244525" status: 200 len: 1209 microversion: 2.1 time: 0.216997 Oct 04 18:50:24.122256 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2007/4277] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:23 2022] GET /compute/v2.1/servers/d802635f-8f77-4488-84e0-a973e3244525 => generated 1209 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:24.135196 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-2f0f92ab-af49-4a37-8a6c-365fd674d15b req-5ec02b51-5be5-440a-8d09-3a1772571a2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5e2bc9f-76da-4028-9b48-d00a8ae20d33", "name": "network-vif-deleted", "tag": "1ee9e9af-2dc0-4bc8-96bb-0b3bdf80570b"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:50:24.153857 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-2f0f92ab-af49-4a37-8a6c-365fd674d15b req-5ec02b51-5be5-440a-8d09-3a1772571a2a service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:24.154548 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-2f0f92ab-af49-4a37-8a6c-365fd674d15b req-5ec02b51-5be5-440a-8d09-3a1772571a2a service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:24.155145 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-2f0f92ab-af49-4a37-8a6c-365fd674d15b req-5ec02b51-5be5-440a-8d09-3a1772571a2a service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:24.169404 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-2f0f92ab-af49-4a37-8a6c-365fd674d15b req-5ec02b51-5be5-440a-8d09-3a1772571a2a service nova] Creating event network-vif-deleted:1ee9e9af-2dc0-4bc8-96bb-0b3bdf80570b for instance d5e2bc9f-76da-4028-9b48-d00a8ae20d33 on n-h1-851028-13 Oct 04 18:50:24.176153 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-2f0f92ab-af49-4a37-8a6c-365fd674d15b req-5ec02b51-5be5-440a-8d09-3a1772571a2a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050499 Oct 04 18:50:24.181253 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2008/4278] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:50:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:50:24.188972 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-68695056-1698-4fb2-9c9c-91d996c1a1b5 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:24.189918 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-68695056-1698-4fb2-9c9c-91d996c1a1b5 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: d5e2bc9f-76da-4028-9b48-d00a8ae20d33] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:24.199030 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-68695056-1698-4fb2-9c9c-91d996c1a1b5 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:24.200572 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-68695056-1698-4fb2-9c9c-91d996c1a1b5 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:24.201411 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-68695056-1698-4fb2-9c9c-91d996c1a1b5 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:24.202583 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-68695056-1698-4fb2-9c9c-91d996c1a1b5 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:24.203057 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-68695056-1698-4fb2-9c9c-91d996c1a1b5 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:24.203714 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-68695056-1698-4fb2-9c9c-91d996c1a1b5 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:24.371019 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-68695056-1698-4fb2-9c9c-91d996c1a1b5 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:24.381575 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-68695056-1698-4fb2-9c9c-91d996c1a1b5 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/d5e2bc9f-76da-4028-9b48-d00a8ae20d33" status: 200 len: 1452 microversion: 2.1 time: 0.198476 Oct 04 18:50:24.393769 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2009/4279] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:24 2022] GET /compute/v2.1/servers/d5e2bc9f-76da-4028-9b48-d00a8ae20d33 => generated 1452 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:24.534027 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-cbe42e70-7831-42a6-b839-b513f7a7038e tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:24.545400 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-cbe42e70-7831-42a6-b839-b513f7a7038e tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:24.548743 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-cbe42e70-7831-42a6-b839-b513f7a7038e tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:24.551476 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-cbe42e70-7831-42a6-b839-b513f7a7038e tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] 10.222.0.43 "GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715" status: 200 len: 2951 microversion: 2.32 time: 1.488086 Oct 04 18:50:24.570398 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2271/4280] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:50:23 2022] GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715 => generated 2951 bytes in 1507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:50:25.145422 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-cf73b106-fede-43a5-8fb9-0d6c6639fb91 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:25.146147 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-cf73b106-fede-43a5-8fb9-0d6c6639fb91 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] [instance: d802635f-8f77-4488-84e0-a973e3244525] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:25.175697 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cf73b106-fede-43a5-8fb9-0d6c6639fb91 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:25.177909 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cf73b106-fede-43a5-8fb9-0d6c6639fb91 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:25.178127 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cf73b106-fede-43a5-8fb9-0d6c6639fb91 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:25.179293 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cf73b106-fede-43a5-8fb9-0d6c6639fb91 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:25.184065 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cf73b106-fede-43a5-8fb9-0d6c6639fb91 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:25.184781 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cf73b106-fede-43a5-8fb9-0d6c6639fb91 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:25.363442 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-cf73b106-fede-43a5-8fb9-0d6c6639fb91 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14707008940e4965ab7d1190094a71bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8f94cf1c974654a336645f453c9efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:25.373584 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-cf73b106-fede-43a5-8fb9-0d6c6639fb91 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] 10.222.0.43 "GET /compute/v2.1/servers/d802635f-8f77-4488-84e0-a973e3244525" status: 200 len: 1205 microversion: 2.1 time: 0.232447 Oct 04 18:50:25.375484 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2010/4281] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:25 2022] GET /compute/v2.1/servers/d802635f-8f77-4488-84e0-a973e3244525 => generated 1205 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:25.406669 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-48a262b5-ee20-4ce9-9972-a06345dba043 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:25.407314 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-48a262b5-ee20-4ce9-9972-a06345dba043 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: d5e2bc9f-76da-4028-9b48-d00a8ae20d33] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:25.420102 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-48a262b5-ee20-4ce9-9972-a06345dba043 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:25.420633 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-48a262b5-ee20-4ce9-9972-a06345dba043 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:25.421080 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-48a262b5-ee20-4ce9-9972-a06345dba043 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:25.421818 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-48a262b5-ee20-4ce9-9972-a06345dba043 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:25.422281 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-48a262b5-ee20-4ce9-9972-a06345dba043 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:25.422719 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-48a262b5-ee20-4ce9-9972-a06345dba043 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:25.498614 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-48a262b5-ee20-4ce9-9972-a06345dba043 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:25.499155 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-48a262b5-ee20-4ce9-9972-a06345dba043 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:25.499642 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-48a262b5-ee20-4ce9-9972-a06345dba043 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:25.500109 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.objects.instance [None req-48a262b5-ee20-4ce9-9972-a06345dba043 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lazy-loading 'fault' on Instance uuid d5e2bc9f-76da-4028-9b48-d00a8ae20d33 {{(pid=123596) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:50:25.591880 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-1e1290eb-6e03-493d-8cb5-d668600033ea tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:25.592782 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-1e1290eb-6e03-493d-8cb5-d668600033ea tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] [instance: fa47906d-d394-46fe-9143-780bcd27a715] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:25.602557 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1e1290eb-6e03-493d-8cb5-d668600033ea tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:25.619509 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1e1290eb-6e03-493d-8cb5-d668600033ea tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:25.621831 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1e1290eb-6e03-493d-8cb5-d668600033ea tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:25.623036 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1e1290eb-6e03-493d-8cb5-d668600033ea tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:25.623672 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1e1290eb-6e03-493d-8cb5-d668600033ea tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:25.625655 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1e1290eb-6e03-493d-8cb5-d668600033ea tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:25.824464 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-48a262b5-ee20-4ce9-9972-a06345dba043 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:25.832919 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-48a262b5-ee20-4ce9-9972-a06345dba043 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/d5e2bc9f-76da-4028-9b48-d00a8ae20d33" status: 200 len: 1305 microversion: 2.1 time: 0.430365 Oct 04 18:50:25.841372 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2272/4282] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:25 2022] GET /compute/v2.1/servers/d5e2bc9f-76da-4028-9b48-d00a8ae20d33 => generated 1305 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:26.403191 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-87e8e02f-d156-4882-a8d7-84cf9da6c010 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:26.403804 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-87e8e02f-d156-4882-a8d7-84cf9da6c010 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] [instance: d802635f-8f77-4488-84e0-a973e3244525] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:26.443588 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-87e8e02f-d156-4882-a8d7-84cf9da6c010 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:26.444096 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-87e8e02f-d156-4882-a8d7-84cf9da6c010 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:26.444545 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-87e8e02f-d156-4882-a8d7-84cf9da6c010 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:26.445293 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-87e8e02f-d156-4882-a8d7-84cf9da6c010 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:26.445754 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-87e8e02f-d156-4882-a8d7-84cf9da6c010 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:26.449860 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-87e8e02f-d156-4882-a8d7-84cf9da6c010 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:26.583502 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-87e8e02f-d156-4882-a8d7-84cf9da6c010 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14707008940e4965ab7d1190094a71bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8f94cf1c974654a336645f453c9efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:26.592498 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-87e8e02f-d156-4882-a8d7-84cf9da6c010 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] 10.222.0.43 "GET /compute/v2.1/servers/d802635f-8f77-4488-84e0-a973e3244525" status: 200 len: 1261 microversion: 2.1 time: 0.193139 Oct 04 18:50:26.593158 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2273/4283] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:26 2022] GET /compute/v2.1/servers/d802635f-8f77-4488-84e0-a973e3244525 => generated 1261 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:50:26.698786 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-1e1290eb-6e03-493d-8cb5-d668600033ea tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:26.710428 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-1e1290eb-6e03-493d-8cb5-d668600033ea tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:26.716774 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-1e1290eb-6e03-493d-8cb5-d668600033ea tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:26.720239 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-1e1290eb-6e03-493d-8cb5-d668600033ea tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] 10.222.0.43 "GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715" status: 200 len: 2951 microversion: 2.32 time: 1.133063 Oct 04 18:50:26.723985 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2011/4284] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:50:25 2022] GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715 => generated 2951 bytes in 1137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:50:26.861490 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-c55212dc-ef28-4b76-860b-463c3e19f9ef tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:26.862733 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-c55212dc-ef28-4b76-860b-463c3e19f9ef tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: d5e2bc9f-76da-4028-9b48-d00a8ae20d33] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:26.874142 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c55212dc-ef28-4b76-860b-463c3e19f9ef tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:26.876694 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c55212dc-ef28-4b76-860b-463c3e19f9ef tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:26.881989 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c55212dc-ef28-4b76-860b-463c3e19f9ef tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:26.889376 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c55212dc-ef28-4b76-860b-463c3e19f9ef tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:26.890118 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c55212dc-ef28-4b76-860b-463c3e19f9ef tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:26.894891 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c55212dc-ef28-4b76-860b-463c3e19f9ef tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:26.945406 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-c55212dc-ef28-4b76-860b-463c3e19f9ef tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] HTTP exception thrown: Instance d5e2bc9f-76da-4028-9b48-d00a8ae20d33 could not be found. Oct 04 18:50:26.947323 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-c55212dc-ef28-4b76-860b-463c3e19f9ef tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Request method failure captured: Oct 04 18:50:26.947323 n-d-851028-13 devstack@n-api.service[123596]: request: GET /compute/v2.1/servers/d5e2bc9f-76da-4028-9b48-d00a8ae20d33 HTTP/1.1 Oct 04 18:50:26.947323 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:50:26.947323 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:50:26.947323 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:50:26.947323 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 18:50:26.947323 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:50:26.947323 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:50:26.947323 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:50:26.947323 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:50:26.947323 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPH5Y8VwBda5zUzX7ascLTB3Qbosoo60vZOoFyoP9LMQR5mhyf58gwOhX5OQ1_45choDiQHF8u029lzYPJiPJTmy12iHuGw0ye25qipylbXQG76rB007_6q71vYweTO_w2ZGSDLwZR6h4S4zanUtwJXkJkZX2y1e-onEmHtUGHW_6bUQ Oct 04 18:50:26.947323 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:50:26.947323 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:50:26.947323 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:50:26.947323 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:50:26.947323 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:50:26.947323 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:50:26.947323 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: b928ae7385da4599bbe0ea701681b233 Oct 04 18:50:26.947323 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-ServerActionsTestJSON-1452535557 Oct 04 18:50:26.947323 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 18:50:26.947323 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 18:50:26.947323 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/b928ae7385da4599bbe0ea701681b233"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_b928ae7385da4599bbe0ea701681b233"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b928ae7385da4599bbe0ea701681b233"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b928ae7385da4599bbe0ea701681b233"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:50:26.947323 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-ServerActionsTestJSON-1452535557 Oct 04 18:50:26.947323 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: b928ae7385da4599bbe0ea701681b233 Oct 04 18:50:26.947323 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-ServerActionsTestJSON-1452535557 Oct 04 18:50:26.947323 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-ServerActionsTestJSON-1452535557-project Oct 04 18:50:26.947323 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:50:26.947323 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:50:26.947323 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 93c36c0802f4473f96d0721caa50374a Oct 04 18:50:26.947323 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-ServerActionsTestJSON-1452535557-project Oct 04 18:50:26.947323 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 18:50:26.947323 n-d-851028-13 devstack@n-api.service[123596]: exception: Instance d5e2bc9f-76da-4028-9b48-d00a8ae20d33 could not be found. Oct 04 18:50:26.947323 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': 'd5e2bc9f-76da-4028-9b48-d00a8ae20d33'} Oct 04 18:50:26.947323 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:50:26.947323 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:50:26.947323 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:50:26.947323 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:50:26.947323 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:50:26.947323 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:50:26.947323 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:50:26.947323 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:50:26.947323 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:50:26.947323 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:50:26.947323 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5e2bc9f-76da-4028-9b48-d00a8ae20d33 could not be found. Oct 04 18:50:26.947323 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:50:26.947323 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:50:26.947323 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:50:26.947323 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:50:26.947323 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:50:26.947323 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:50:26.947323 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:50:26.947323 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:50:26.947323 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:50:26.947323 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:50:26.947323 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:50:26.947323 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:50:26.947323 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:50:26.947323 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:50:26.947323 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:50:26.947323 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:50:26.947323 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5e2bc9f-76da-4028-9b48-d00a8ae20d33 could not be found. Oct 04 18:50:26.947323 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:50:26.947323 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:50:26.947323 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:50:26.951272 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:50:26.951272 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:50:26.951272 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:50:26.951272 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:50:26.951272 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:50:26.951272 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5e2bc9f-76da-4028-9b48-d00a8ae20d33 could not be found. Oct 04 18:50:26.951272 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:50:26.951272 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-c55212dc-ef28-4b76-860b-463c3e19f9ef tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Returning 404 to user: Instance d5e2bc9f-76da-4028-9b48-d00a8ae20d33 could not be found. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:50:26.951272 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-c55212dc-ef28-4b76-860b-463c3e19f9ef tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/d5e2bc9f-76da-4028-9b48-d00a8ae20d33" status: 404 len: 111 microversion: 2.1 time: 0.091200 Oct 04 18:50:26.951272 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2274/4285] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:26 2022] GET /compute/v2.1/servers/d5e2bc9f-76da-4028-9b48-d00a8ae20d33 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:50:26.958426 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-3431f108-ed71-4822-96b8-8c343b105d90 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:26.958981 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-3431f108-ed71-4822-96b8-8c343b105d90 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 82b86465-afb0-49ef-9932-1538010c1ae5] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:26.969024 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3431f108-ed71-4822-96b8-8c343b105d90 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:26.983633 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3431f108-ed71-4822-96b8-8c343b105d90 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:26.984138 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3431f108-ed71-4822-96b8-8c343b105d90 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:26.984906 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3431f108-ed71-4822-96b8-8c343b105d90 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:26.985444 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3431f108-ed71-4822-96b8-8c343b105d90 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:26.985887 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3431f108-ed71-4822-96b8-8c343b105d90 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:27.041133 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-3431f108-ed71-4822-96b8-8c343b105d90 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 82b86465-afb0-49ef-9932-1538010c1ae5] Going to try to terminate instance {{(pid=123595) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:50:27.285892 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-3431f108-ed71-4822-96b8-8c343b105d90 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "DELETE /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5" status: 204 len: 0 microversion: 2.1 time: 0.331788 Oct 04 18:50:27.287770 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2012/4286] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 18:50:26 2022] DELETE /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:50:27.296483 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-ecd92d97-e829-4b47-9ec4-3cc22a9044c2 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:27.297354 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-ecd92d97-e829-4b47-9ec4-3cc22a9044c2 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 82b86465-afb0-49ef-9932-1538010c1ae5] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:27.306752 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ecd92d97-e829-4b47-9ec4-3cc22a9044c2 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:27.317927 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ecd92d97-e829-4b47-9ec4-3cc22a9044c2 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:27.319012 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ecd92d97-e829-4b47-9ec4-3cc22a9044c2 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:27.319971 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ecd92d97-e829-4b47-9ec4-3cc22a9044c2 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:27.320543 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ecd92d97-e829-4b47-9ec4-3cc22a9044c2 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:27.321234 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ecd92d97-e829-4b47-9ec4-3cc22a9044c2 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:27.618655 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-3910dc92-8bf4-4810-a9ae-856da710013f tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:27.619450 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-3910dc92-8bf4-4810-a9ae-856da710013f tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] [instance: d802635f-8f77-4488-84e0-a973e3244525] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:27.634818 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3910dc92-8bf4-4810-a9ae-856da710013f tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:27.640789 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3910dc92-8bf4-4810-a9ae-856da710013f tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:27.643608 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3910dc92-8bf4-4810-a9ae-856da710013f tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:27.646767 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3910dc92-8bf4-4810-a9ae-856da710013f tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:27.649816 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3910dc92-8bf4-4810-a9ae-856da710013f tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:27.651685 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3910dc92-8bf4-4810-a9ae-856da710013f tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:27.822632 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-ecd92d97-e829-4b47-9ec4-3cc22a9044c2 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:27.848877 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-ecd92d97-e829-4b47-9ec4-3cc22a9044c2 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5" status: 200 len: 1673 microversion: 2.1 time: 0.557069 Oct 04 18:50:27.858136 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2275/4287] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:27 2022] GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5 => generated 1673 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:27.867416 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-c3c86c71-3ee2-4b8d-8585-cf35b52d1a1c tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:27.872566 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-c3c86c71-3ee2-4b8d-8585-cf35b52d1a1c tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] [instance: fa47906d-d394-46fe-9143-780bcd27a715] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:27.898376 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c3c86c71-3ee2-4b8d-8585-cf35b52d1a1c tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:27.902746 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c3c86c71-3ee2-4b8d-8585-cf35b52d1a1c tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:27.904378 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c3c86c71-3ee2-4b8d-8585-cf35b52d1a1c tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:27.907288 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c3c86c71-3ee2-4b8d-8585-cf35b52d1a1c tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:27.910936 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c3c86c71-3ee2-4b8d-8585-cf35b52d1a1c tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:27.912512 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c3c86c71-3ee2-4b8d-8585-cf35b52d1a1c tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:28.124281 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-3910dc92-8bf4-4810-a9ae-856da710013f tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14707008940e4965ab7d1190094a71bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8f94cf1c974654a336645f453c9efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:28.138347 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-3910dc92-8bf4-4810-a9ae-856da710013f tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] 10.222.0.43 "GET /compute/v2.1/servers/d802635f-8f77-4488-84e0-a973e3244525" status: 200 len: 1267 microversion: 2.1 time: 0.525620 Oct 04 18:50:28.144318 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2013/4288] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:27 2022] GET /compute/v2.1/servers/d802635f-8f77-4488-84e0-a973e3244525 => generated 1267 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:28.165687 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-776f7396-4ade-4247-b121-c9477381f73d req-42a436a5-ee29-45ae-bda6-75d22ddda6e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa47906d-d394-46fe-9143-780bcd27a715", "name": "network-vif-unplugged", "status": "completed", "tag": "501fb3c2-8b52-4abe-9556-64d2ee5b20db"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:50:28.202178 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-776f7396-4ade-4247-b121-c9477381f73d req-42a436a5-ee29-45ae-bda6-75d22ddda6e9 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:28.204201 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-776f7396-4ade-4247-b121-c9477381f73d req-42a436a5-ee29-45ae-bda6-75d22ddda6e9 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:28.206042 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-776f7396-4ade-4247-b121-c9477381f73d req-42a436a5-ee29-45ae-bda6-75d22ddda6e9 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:28.250528 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:50:28.257947 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-776f7396-4ade-4247-b121-c9477381f73d req-42a436a5-ee29-45ae-bda6-75d22ddda6e9 service nova] Creating event network-vif-unplugged:501fb3c2-8b52-4abe-9556-64d2ee5b20db for instance fa47906d-d394-46fe-9143-780bcd27a715 on n-h1-851028-13 Oct 04 18:50:28.272324 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-776f7396-4ade-4247-b121-c9477381f73d req-42a436a5-ee29-45ae-bda6-75d22ddda6e9 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.126643 Oct 04 18:50:28.275515 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2014/4289] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:50:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:50:28.760941 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-c3c86c71-3ee2-4b8d-8585-cf35b52d1a1c tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:28.783685 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-c3c86c71-3ee2-4b8d-8585-cf35b52d1a1c tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:28.793931 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-c3c86c71-3ee2-4b8d-8585-cf35b52d1a1c tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:28.795752 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-c3c86c71-3ee2-4b8d-8585-cf35b52d1a1c tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] 10.222.0.43 "GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715" status: 200 len: 2930 microversion: 2.32 time: 0.935430 Oct 04 18:50:28.796876 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2276/4290] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:50:27 2022] GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715 => generated 2930 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:50:28.880219 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-7c930c89-4166-4c2d-84de-830ac6bb2dbc tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:28.881099 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-7c930c89-4166-4c2d-84de-830ac6bb2dbc tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 82b86465-afb0-49ef-9932-1538010c1ae5] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:28.910912 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7c930c89-4166-4c2d-84de-830ac6bb2dbc tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:28.914989 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7c930c89-4166-4c2d-84de-830ac6bb2dbc tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:28.915554 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7c930c89-4166-4c2d-84de-830ac6bb2dbc tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:28.916860 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7c930c89-4166-4c2d-84de-830ac6bb2dbc tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:28.926460 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7c930c89-4166-4c2d-84de-830ac6bb2dbc tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:28.927058 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7c930c89-4166-4c2d-84de-830ac6bb2dbc tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:29.166517 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-3a0282b3-7570-4d4e-a769-31e74dc4e6d7 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:29.167725 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-3a0282b3-7570-4d4e-a769-31e74dc4e6d7 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] [instance: d802635f-8f77-4488-84e0-a973e3244525] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:29.179697 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3a0282b3-7570-4d4e-a769-31e74dc4e6d7 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:29.180379 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3a0282b3-7570-4d4e-a769-31e74dc4e6d7 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:29.182978 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3a0282b3-7570-4d4e-a769-31e74dc4e6d7 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:29.184193 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3a0282b3-7570-4d4e-a769-31e74dc4e6d7 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:29.188596 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3a0282b3-7570-4d4e-a769-31e74dc4e6d7 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:29.189896 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3a0282b3-7570-4d4e-a769-31e74dc4e6d7 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:29.556393 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-7c930c89-4166-4c2d-84de-830ac6bb2dbc tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:29.569341 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-7c930c89-4166-4c2d-84de-830ac6bb2dbc tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5" status: 200 len: 1673 microversion: 2.1 time: 0.693960 Oct 04 18:50:29.592346 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2015/4291] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:28 2022] GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5 => generated 1673 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:29.714571 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-3a0282b3-7570-4d4e-a769-31e74dc4e6d7 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14707008940e4965ab7d1190094a71bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8f94cf1c974654a336645f453c9efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:29.723165 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-3a0282b3-7570-4d4e-a769-31e74dc4e6d7 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] 10.222.0.43 "GET /compute/v2.1/servers/d802635f-8f77-4488-84e0-a973e3244525" status: 200 len: 1309 microversion: 2.1 time: 0.560512 Oct 04 18:50:29.727544 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2277/4292] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:29 2022] GET /compute/v2.1/servers/d802635f-8f77-4488-84e0-a973e3244525 => generated 1309 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:29.829147 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-de8685f6-e2cc-4e75-9b86-aac3dd10bf3b tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:29.829770 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-de8685f6-e2cc-4e75-9b86-aac3dd10bf3b tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] [instance: fa47906d-d394-46fe-9143-780bcd27a715] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:29.847324 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-de8685f6-e2cc-4e75-9b86-aac3dd10bf3b tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:29.847836 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-de8685f6-e2cc-4e75-9b86-aac3dd10bf3b tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:29.848282 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-de8685f6-e2cc-4e75-9b86-aac3dd10bf3b tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:29.849012 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-de8685f6-e2cc-4e75-9b86-aac3dd10bf3b tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:29.849573 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-de8685f6-e2cc-4e75-9b86-aac3dd10bf3b tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:29.850012 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-de8685f6-e2cc-4e75-9b86-aac3dd10bf3b tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:30.399251 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-f6cb6627-aabf-4f04-808c-c23102a25cdb req-0bb06541-68f4-4946-a41d-dffe278ff770 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa47906d-d394-46fe-9143-780bcd27a715", "name": "network-vif-unplugged", "status": "completed", "tag": "c894730c-7cbc-41ef-a7b9-c9eb574e1489"}, {"server_uuid": "fa47906d-d394-46fe-9143-780bcd27a715", "name": "network-vif-unplugged", "status": "completed", "tag": "4dedaa7a-5245-4fee-80eb-d2092ad95c1e"}, {"server_uuid": "fa47906d-d394-46fe-9143-780bcd27a715", "name": "network-vif-unplugged", "status": "completed", "tag": "076a121c-741e-46ac-a9c1-c4bae9e304a4"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:50:30.422112 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-f6cb6627-aabf-4f04-808c-c23102a25cdb req-0bb06541-68f4-4946-a41d-dffe278ff770 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:30.428413 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-f6cb6627-aabf-4f04-808c-c23102a25cdb req-0bb06541-68f4-4946-a41d-dffe278ff770 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:30.429245 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-f6cb6627-aabf-4f04-808c-c23102a25cdb req-0bb06541-68f4-4946-a41d-dffe278ff770 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:30.480843 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-f6cb6627-aabf-4f04-808c-c23102a25cdb req-0bb06541-68f4-4946-a41d-dffe278ff770 service nova] Creating event network-vif-unplugged:c894730c-7cbc-41ef-a7b9-c9eb574e1489 for instance fa47906d-d394-46fe-9143-780bcd27a715 on n-h1-851028-13 Oct 04 18:50:30.481524 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-f6cb6627-aabf-4f04-808c-c23102a25cdb req-0bb06541-68f4-4946-a41d-dffe278ff770 service nova] Creating event network-vif-unplugged:4dedaa7a-5245-4fee-80eb-d2092ad95c1e for instance fa47906d-d394-46fe-9143-780bcd27a715 on n-h1-851028-13 Oct 04 18:50:30.489590 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-f6cb6627-aabf-4f04-808c-c23102a25cdb req-0bb06541-68f4-4946-a41d-dffe278ff770 service nova] Creating event network-vif-unplugged:076a121c-741e-46ac-a9c1-c4bae9e304a4 for instance fa47906d-d394-46fe-9143-780bcd27a715 on n-h1-851028-13 Oct 04 18:50:30.510669 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-f6cb6627-aabf-4f04-808c-c23102a25cdb req-0bb06541-68f4-4946-a41d-dffe278ff770 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 531 microversion: 2.1 time: 0.115327 Oct 04 18:50:30.526833 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2278/4293] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:50:30 2022] POST /compute/v2.1/os-server-external-events => generated 531 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:50:30.598791 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-53054feb-815c-4807-b2aa-e2c17791df0e tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:30.599629 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-53054feb-815c-4807-b2aa-e2c17791df0e tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 82b86465-afb0-49ef-9932-1538010c1ae5] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:30.617851 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-53054feb-815c-4807-b2aa-e2c17791df0e tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:30.618552 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-53054feb-815c-4807-b2aa-e2c17791df0e tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:30.619113 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-53054feb-815c-4807-b2aa-e2c17791df0e tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:30.623025 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-53054feb-815c-4807-b2aa-e2c17791df0e tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:30.623988 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-53054feb-815c-4807-b2aa-e2c17791df0e tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:30.626029 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-53054feb-815c-4807-b2aa-e2c17791df0e tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:31.003508 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-53054feb-815c-4807-b2aa-e2c17791df0e tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:31.022014 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-53054feb-815c-4807-b2aa-e2c17791df0e tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5" status: 200 len: 1673 microversion: 2.1 time: 0.428107 Oct 04 18:50:31.023502 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2279/4294] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:30 2022] GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5 => generated 1673 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:31.031370 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-3513767b-8ccb-4f33-a7da-fe8e359205b5 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:31.032286 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-3513767b-8ccb-4f33-a7da-fe8e359205b5 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] [instance: d802635f-8f77-4488-84e0-a973e3244525] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:31.058301 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3513767b-8ccb-4f33-a7da-fe8e359205b5 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:31.058878 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3513767b-8ccb-4f33-a7da-fe8e359205b5 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:31.059326 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3513767b-8ccb-4f33-a7da-fe8e359205b5 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:31.060033 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3513767b-8ccb-4f33-a7da-fe8e359205b5 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:31.060484 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3513767b-8ccb-4f33-a7da-fe8e359205b5 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:31.060910 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3513767b-8ccb-4f33-a7da-fe8e359205b5 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:31.333737 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-de8685f6-e2cc-4e75-9b86-aac3dd10bf3b tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:31.351827 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-de8685f6-e2cc-4e75-9b86-aac3dd10bf3b tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:31.353457 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-de8685f6-e2cc-4e75-9b86-aac3dd10bf3b tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:31.354804 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-de8685f6-e2cc-4e75-9b86-aac3dd10bf3b tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] 10.222.0.43 "GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715" status: 200 len: 2909 microversion: 2.32 time: 1.530390 Oct 04 18:50:31.355396 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2016/4295] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:50:29 2022] GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715 => generated 2909 bytes in 1532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:50:31.709400 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-72e3fe90-2c5f-43a4-bfca-6368ffe1422a tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Action: 'create', calling method: .version_select at 0x7fb21eab30d0>, body: {"keypair": {"name": "tempest-keypair-291546891", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFfk+LlNG5nkEXV8f4HwoSSCdOCSNfrKJWjJT/9Z0WEL9RlWX7WhaPdOBEasvKiaOUo0wv7Vxyxwmr+XAV2gOcgEQ9hZIosBz1xU2MI+vT6xRUMRfPKj99oAq1tnTevvhw=="}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:50:31.751569 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-72e3fe90-2c5f-43a4-bfca-6368ffe1422a tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Getting quotas for project b40894812ff042979932773f36a70e0d. Resources: {'key_pairs'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:50:31.758144 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-72e3fe90-2c5f-43a4-bfca-6368ffe1422a tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Getting quotas for user 4d4b6ab960cd4f909975c9bb14d50480 and project b40894812ff042979932773f36a70e0d. Resources: {'key_pairs'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:50:31.820914 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-72e3fe90-2c5f-43a4-bfca-6368ffe1422a tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.464057 Oct 04 18:50:31.827525 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2017/4296] 10.222.0.43 () {60 vars in 1159 bytes} [Tue Oct 4 18:50:31 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:50:31.832617 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-175099af-33ab-4d46-8474-dd9a476a7e46 req-12a35e39-a8dc-4d71-aa5d-29df273d3a00 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d802635f-8f77-4488-84e0-a973e3244525", "tag": "09899abf-7896-41ad-b6d3-6f2bcf313ca6"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:50:31.854377 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-175099af-33ab-4d46-8474-dd9a476a7e46 req-12a35e39-a8dc-4d71-aa5d-29df273d3a00 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:31.857089 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-175099af-33ab-4d46-8474-dd9a476a7e46 req-12a35e39-a8dc-4d71-aa5d-29df273d3a00 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:31.858508 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-175099af-33ab-4d46-8474-dd9a476a7e46 req-12a35e39-a8dc-4d71-aa5d-29df273d3a00 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:31.881267 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-175099af-33ab-4d46-8474-dd9a476a7e46 req-12a35e39-a8dc-4d71-aa5d-29df273d3a00 service nova] Creating event network-changed:09899abf-7896-41ad-b6d3-6f2bcf313ca6 for instance d802635f-8f77-4488-84e0-a973e3244525 on n-h1-851028-13 Oct 04 18:50:31.896748 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-175099af-33ab-4d46-8474-dd9a476a7e46 req-12a35e39-a8dc-4d71-aa5d-29df273d3a00 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073442 Oct 04 18:50:31.897592 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2018/4297] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:50:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:50:31.931404 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-3513767b-8ccb-4f33-a7da-fe8e359205b5 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14707008940e4965ab7d1190094a71bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8f94cf1c974654a336645f453c9efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:31.947926 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-3513767b-8ccb-4f33-a7da-fe8e359205b5 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] 10.222.0.43 "GET /compute/v2.1/servers/d802635f-8f77-4488-84e0-a973e3244525" status: 200 len: 1309 microversion: 2.1 time: 0.921089 Oct 04 18:50:31.953158 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2280/4298] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:31 2022] GET /compute/v2.1/servers/d802635f-8f77-4488-84e0-a973e3244525 => generated 1309 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:32.079053 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-8bf7d93b-42de-423d-8fef-756bbade5c64 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:32.079772 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-8bf7d93b-42de-423d-8fef-756bbade5c64 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 82b86465-afb0-49ef-9932-1538010c1ae5] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:32.093630 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8bf7d93b-42de-423d-8fef-756bbade5c64 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:32.105041 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8bf7d93b-42de-423d-8fef-756bbade5c64 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:32.106463 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8bf7d93b-42de-423d-8fef-756bbade5c64 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:32.108401 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8bf7d93b-42de-423d-8fef-756bbade5c64 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:32.110954 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8bf7d93b-42de-423d-8fef-756bbade5c64 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:32.111444 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8bf7d93b-42de-423d-8fef-756bbade5c64 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:32.388518 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-a6288a5e-7c2e-4b4b-90cd-e085633d117a tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:32.389342 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-a6288a5e-7c2e-4b4b-90cd-e085633d117a tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] [instance: fa47906d-d394-46fe-9143-780bcd27a715] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:32.410131 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a6288a5e-7c2e-4b4b-90cd-e085633d117a tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:32.410656 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a6288a5e-7c2e-4b4b-90cd-e085633d117a tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:32.411109 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a6288a5e-7c2e-4b4b-90cd-e085633d117a tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:32.411864 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a6288a5e-7c2e-4b4b-90cd-e085633d117a tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:32.412280 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a6288a5e-7c2e-4b4b-90cd-e085633d117a tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:32.412710 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a6288a5e-7c2e-4b4b-90cd-e085633d117a tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:32.472319 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:50:32.776866 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-8bf7d93b-42de-423d-8fef-756bbade5c64 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:32.786414 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-8bf7d93b-42de-423d-8fef-756bbade5c64 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5" status: 200 len: 1606 microversion: 2.1 time: 0.731661 Oct 04 18:50:32.787582 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2019/4299] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:32 2022] GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5 => generated 1606 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:32.792877 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-0b8fff09-2076-45ce-ae9f-5b07cb53da0e req-35490c2e-c678-4467-9baa-38b21974f8f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa47906d-d394-46fe-9143-780bcd27a715", "name": "network-vif-unplugged", "status": "completed", "tag": "f2b979d5-599c-4c02-8f73-2a3d8e34cd17"}, {"server_uuid": "fa47906d-d394-46fe-9143-780bcd27a715", "name": "network-vif-unplugged", "status": "completed", "tag": "11c4d4a8-fea9-4b92-8ccb-46013ebd8b06"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:50:32.809704 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-0b8fff09-2076-45ce-ae9f-5b07cb53da0e req-35490c2e-c678-4467-9baa-38b21974f8f5 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:32.810447 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-0b8fff09-2076-45ce-ae9f-5b07cb53da0e req-35490c2e-c678-4467-9baa-38b21974f8f5 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:32.811056 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-0b8fff09-2076-45ce-ae9f-5b07cb53da0e req-35490c2e-c678-4467-9baa-38b21974f8f5 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:32.843793 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-0b8fff09-2076-45ce-ae9f-5b07cb53da0e req-35490c2e-c678-4467-9baa-38b21974f8f5 service nova] Creating event network-vif-unplugged:f2b979d5-599c-4c02-8f73-2a3d8e34cd17 for instance fa47906d-d394-46fe-9143-780bcd27a715 on n-h1-851028-13 Oct 04 18:50:32.844589 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-0b8fff09-2076-45ce-ae9f-5b07cb53da0e req-35490c2e-c678-4467-9baa-38b21974f8f5 service nova] Creating event network-vif-unplugged:11c4d4a8-fea9-4b92-8ccb-46013ebd8b06 for instance fa47906d-d394-46fe-9143-780bcd27a715 on n-h1-851028-13 Oct 04 18:50:32.858977 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-0b8fff09-2076-45ce-ae9f-5b07cb53da0e req-35490c2e-c678-4467-9baa-38b21974f8f5 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 358 microversion: 2.1 time: 0.069987 Oct 04 18:50:32.859825 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2020/4300] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:50:32 2022] POST /compute/v2.1/os-server-external-events => generated 358 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:50:32.859966 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-a6288a5e-7c2e-4b4b-90cd-e085633d117a tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:32.883482 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-a6288a5e-7c2e-4b4b-90cd-e085633d117a tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:32.885270 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-a6288a5e-7c2e-4b4b-90cd-e085633d117a tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:32.886567 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-a6288a5e-7c2e-4b4b-90cd-e085633d117a tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] 10.222.0.43 "GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715" status: 200 len: 2863 microversion: 2.32 time: 0.504143 Oct 04 18:50:32.888169 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2281/4301] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:50:32 2022] GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715 => generated 2863 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:50:32.982037 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-30d1f3bd-7d4c-4f6d-996f-c5800dd6be75 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:32.982764 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-30d1f3bd-7d4c-4f6d-996f-c5800dd6be75 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] [instance: d802635f-8f77-4488-84e0-a973e3244525] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:32.989184 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-30d1f3bd-7d4c-4f6d-996f-c5800dd6be75 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:32.989684 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-30d1f3bd-7d4c-4f6d-996f-c5800dd6be75 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:32.990128 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-30d1f3bd-7d4c-4f6d-996f-c5800dd6be75 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:32.990837 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-30d1f3bd-7d4c-4f6d-996f-c5800dd6be75 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:32.998346 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-30d1f3bd-7d4c-4f6d-996f-c5800dd6be75 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:32.999149 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-30d1f3bd-7d4c-4f6d-996f-c5800dd6be75 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:33.032121 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-80028258-bf47-4e80-b4d3-b16791ce4fa0 req-4ab8f550-dda9-4587-899e-ff4f757d313b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa47906d-d394-46fe-9143-780bcd27a715", "name": "network-vif-deleted", "tag": "076a121c-741e-46ac-a9c1-c4bae9e304a4"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:50:33.053306 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-80028258-bf47-4e80-b4d3-b16791ce4fa0 req-4ab8f550-dda9-4587-899e-ff4f757d313b service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:33.053852 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-80028258-bf47-4e80-b4d3-b16791ce4fa0 req-4ab8f550-dda9-4587-899e-ff4f757d313b service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:33.054300 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-80028258-bf47-4e80-b4d3-b16791ce4fa0 req-4ab8f550-dda9-4587-899e-ff4f757d313b service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:33.091952 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-80028258-bf47-4e80-b4d3-b16791ce4fa0 req-4ab8f550-dda9-4587-899e-ff4f757d313b service nova] Creating event network-vif-deleted:076a121c-741e-46ac-a9c1-c4bae9e304a4 for instance fa47906d-d394-46fe-9143-780bcd27a715 on n-h1-851028-13 Oct 04 18:50:33.098311 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-80028258-bf47-4e80-b4d3-b16791ce4fa0 req-4ab8f550-dda9-4587-899e-ff4f757d313b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069514 Oct 04 18:50:33.099512 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2282/4302] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:50:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:50:33.384863 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-30d1f3bd-7d4c-4f6d-996f-c5800dd6be75 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14707008940e4965ab7d1190094a71bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8f94cf1c974654a336645f453c9efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:33.396609 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-30d1f3bd-7d4c-4f6d-996f-c5800dd6be75 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] 10.222.0.43 "GET /compute/v2.1/servers/d802635f-8f77-4488-84e0-a973e3244525" status: 200 len: 1309 microversion: 2.1 time: 0.421263 Oct 04 18:50:33.397679 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2021/4303] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:32 2022] GET /compute/v2.1/servers/d802635f-8f77-4488-84e0-a973e3244525 => generated 1309 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:33.817293 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-94b3b9e0-8ce0-4576-bac4-f0f8e761a61b tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:33.818202 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-94b3b9e0-8ce0-4576-bac4-f0f8e761a61b tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 82b86465-afb0-49ef-9932-1538010c1ae5] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:33.834948 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-94b3b9e0-8ce0-4576-bac4-f0f8e761a61b tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:33.835866 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-94b3b9e0-8ce0-4576-bac4-f0f8e761a61b tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:33.838016 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-94b3b9e0-8ce0-4576-bac4-f0f8e761a61b tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:33.840243 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-94b3b9e0-8ce0-4576-bac4-f0f8e761a61b tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:33.841973 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-94b3b9e0-8ce0-4576-bac4-f0f8e761a61b tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:33.843586 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-94b3b9e0-8ce0-4576-bac4-f0f8e761a61b tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:33.917752 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-cae8d96e-9c9a-4965-a6f8-0cfbea0548eb tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:33.920285 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-cae8d96e-9c9a-4965-a6f8-0cfbea0548eb tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] [instance: fa47906d-d394-46fe-9143-780bcd27a715] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:33.923437 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=2 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:50:33.930084 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-94b3b9e0-8ce0-4576-bac4-f0f8e761a61b tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:33.933375 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-94b3b9e0-8ce0-4576-bac4-f0f8e761a61b tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:33.935569 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-94b3b9e0-8ce0-4576-bac4-f0f8e761a61b tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:33.936213 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.objects.instance [None req-94b3b9e0-8ce0-4576-bac4-f0f8e761a61b tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lazy-loading 'fault' on Instance uuid 82b86465-afb0-49ef-9932-1538010c1ae5 {{(pid=123596) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:50:33.958350 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cae8d96e-9c9a-4965-a6f8-0cfbea0548eb tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:33.959100 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cae8d96e-9c9a-4965-a6f8-0cfbea0548eb tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:33.961953 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cae8d96e-9c9a-4965-a6f8-0cfbea0548eb tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:33.963864 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cae8d96e-9c9a-4965-a6f8-0cfbea0548eb tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:33.964585 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cae8d96e-9c9a-4965-a6f8-0cfbea0548eb tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:33.966685 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cae8d96e-9c9a-4965-a6f8-0cfbea0548eb tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:34.090253 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-94b3b9e0-8ce0-4576-bac4-f0f8e761a61b tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c36c0802f4473f96d0721caa50374a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b928ae7385da4599bbe0ea701681b233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:34.104703 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-94b3b9e0-8ce0-4576-bac4-f0f8e761a61b tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5" status: 200 len: 1327 microversion: 2.1 time: 0.293371 Oct 04 18:50:34.106317 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2283/4304] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:33 2022] GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5 => generated 1327 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:34.423442 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-e523378b-f4cf-4d8c-a695-40b45bea4297 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:34.424136 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-e523378b-f4cf-4d8c-a695-40b45bea4297 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] [instance: d802635f-8f77-4488-84e0-a973e3244525] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:34.436509 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e523378b-f4cf-4d8c-a695-40b45bea4297 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:34.437621 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e523378b-f4cf-4d8c-a695-40b45bea4297 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:34.439701 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e523378b-f4cf-4d8c-a695-40b45bea4297 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:34.441532 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e523378b-f4cf-4d8c-a695-40b45bea4297 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:34.443473 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e523378b-f4cf-4d8c-a695-40b45bea4297 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:34.445480 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e523378b-f4cf-4d8c-a695-40b45bea4297 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:34.733072 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-e523378b-f4cf-4d8c-a695-40b45bea4297 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14707008940e4965ab7d1190094a71bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8f94cf1c974654a336645f453c9efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:34.742226 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-e523378b-f4cf-4d8c-a695-40b45bea4297 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] 10.222.0.43 "GET /compute/v2.1/servers/d802635f-8f77-4488-84e0-a973e3244525" status: 200 len: 1309 microversion: 2.1 time: 0.325706 Oct 04 18:50:34.757177 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2284/4305] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:34 2022] GET /compute/v2.1/servers/d802635f-8f77-4488-84e0-a973e3244525 => generated 1309 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:50:35.130054 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-cae8d96e-9c9a-4965-a6f8-0cfbea0548eb tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:35.133096 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-615acada-f5ad-405a-8955-3fd475ed1d6f tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:35.133752 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-615acada-f5ad-405a-8955-3fd475ed1d6f tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] [instance: 82b86465-afb0-49ef-9932-1538010c1ae5] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:35.147576 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-615acada-f5ad-405a-8955-3fd475ed1d6f tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:35.148019 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-cae8d96e-9c9a-4965-a6f8-0cfbea0548eb tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:35.151728 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-615acada-f5ad-405a-8955-3fd475ed1d6f tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:35.152271 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-615acada-f5ad-405a-8955-3fd475ed1d6f tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:35.152862 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-cae8d96e-9c9a-4965-a6f8-0cfbea0548eb tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:35.153082 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-615acada-f5ad-405a-8955-3fd475ed1d6f tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:35.153921 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-615acada-f5ad-405a-8955-3fd475ed1d6f tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:35.154373 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-615acada-f5ad-405a-8955-3fd475ed1d6f tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:35.155557 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-cae8d96e-9c9a-4965-a6f8-0cfbea0548eb tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] 10.222.0.43 "GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715" status: 200 len: 2749 microversion: 2.32 time: 1.242721 Oct 04 18:50:35.160273 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2022/4306] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:50:33 2022] GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715 => generated 2749 bytes in 1249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:50:35.192421 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-b452e232-3add-4060-9e25-478f0508f4c9 req-090add70-4070-48dc-b8e7-ea437ba9d509 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82b86465-afb0-49ef-9932-1538010c1ae5", "name": "network-vif-deleted", "tag": "7e7a43a5-3a15-49a6-b50e-0ac0ac9faa8d"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:50:35.210493 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-b452e232-3add-4060-9e25-478f0508f4c9 req-090add70-4070-48dc-b8e7-ea437ba9d509 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:35.215584 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-b452e232-3add-4060-9e25-478f0508f4c9 req-090add70-4070-48dc-b8e7-ea437ba9d509 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:35.217093 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-b452e232-3add-4060-9e25-478f0508f4c9 req-090add70-4070-48dc-b8e7-ea437ba9d509 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:35.217434 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-615acada-f5ad-405a-8955-3fd475ed1d6f tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] HTTP exception thrown: Instance 82b86465-afb0-49ef-9932-1538010c1ae5 could not be found. Oct 04 18:50:35.219376 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-615acada-f5ad-405a-8955-3fd475ed1d6f tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Request method failure captured: Oct 04 18:50:35.219376 n-d-851028-13 devstack@n-api.service[123596]: request: GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5 HTTP/1.1 Oct 04 18:50:35.219376 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:50:35.219376 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:50:35.219376 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:50:35.219376 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 18:50:35.219376 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:50:35.219376 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:50:35.219376 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:50:35.219376 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:50:35.219376 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPH5Y8VwBda5zUzX7ascLTB3Qbosoo60vZOoFyoP9LMQR5mhyf58gwOhX5OQ1_45choDiQHF8u029lzYPJiPJTmy12iHuGw0ye25qipylbXQG76rB007_6q71vYweTO_w2ZGSDLwZR6h4S4zanUtwJXkJkZX2y1e-onEmHtUGHW_6bUQ Oct 04 18:50:35.219376 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:50:35.219376 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:50:35.219376 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:50:35.219376 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:50:35.219376 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:50:35.219376 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:50:35.219376 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: b928ae7385da4599bbe0ea701681b233 Oct 04 18:50:35.219376 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-ServerActionsTestJSON-1452535557 Oct 04 18:50:35.219376 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 18:50:35.219376 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 18:50:35.219376 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/b928ae7385da4599bbe0ea701681b233"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_b928ae7385da4599bbe0ea701681b233"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b928ae7385da4599bbe0ea701681b233"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b928ae7385da4599bbe0ea701681b233"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:50:35.219376 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-ServerActionsTestJSON-1452535557 Oct 04 18:50:35.219376 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: b928ae7385da4599bbe0ea701681b233 Oct 04 18:50:35.219376 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-ServerActionsTestJSON-1452535557 Oct 04 18:50:35.219376 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-ServerActionsTestJSON-1452535557-project Oct 04 18:50:35.219376 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:50:35.219376 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:50:35.219376 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 93c36c0802f4473f96d0721caa50374a Oct 04 18:50:35.219376 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-ServerActionsTestJSON-1452535557-project Oct 04 18:50:35.219376 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 18:50:35.219376 n-d-851028-13 devstack@n-api.service[123596]: exception: Instance 82b86465-afb0-49ef-9932-1538010c1ae5 could not be found. Oct 04 18:50:35.219376 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': '82b86465-afb0-49ef-9932-1538010c1ae5'} Oct 04 18:50:35.219376 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:50:35.219376 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:50:35.219376 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:50:35.219376 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:50:35.219376 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:50:35.219376 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:50:35.219376 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:50:35.219376 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:50:35.219376 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:50:35.219376 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:50:35.219376 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 82b86465-afb0-49ef-9932-1538010c1ae5 could not be found. Oct 04 18:50:35.219376 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:50:35.219376 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:50:35.219376 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:50:35.219376 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:50:35.219376 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:50:35.219376 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:50:35.219376 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:50:35.219376 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:50:35.219376 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:50:35.219376 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:50:35.219376 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:50:35.219376 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:50:35.219376 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:50:35.219376 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:50:35.219376 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:50:35.219376 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:50:35.219376 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 82b86465-afb0-49ef-9932-1538010c1ae5 could not be found. Oct 04 18:50:35.219376 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:50:35.219376 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:50:35.219376 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:50:35.224100 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:50:35.224100 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:50:35.224100 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:50:35.224100 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:50:35.224100 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:50:35.224100 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 82b86465-afb0-49ef-9932-1538010c1ae5 could not be found. Oct 04 18:50:35.224100 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:50:35.227524 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-615acada-f5ad-405a-8955-3fd475ed1d6f tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Returning 404 to user: Instance 82b86465-afb0-49ef-9932-1538010c1ae5 could not be found. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:50:35.229832 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-615acada-f5ad-405a-8955-3fd475ed1d6f tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5" status: 404 len: 111 microversion: 2.1 time: 0.100896 Oct 04 18:50:35.236739 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2285/4307] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:35 2022] GET /compute/v2.1/servers/82b86465-afb0-49ef-9932-1538010c1ae5 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:50:35.242131 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-e858cf19-dcc2-49dc-a851-3fa730f3c1c2 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] Calling method '.version_select at 0x7fb21e7a24c0>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:35.247764 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-b452e232-3add-4060-9e25-478f0508f4c9 req-090add70-4070-48dc-b8e7-ea437ba9d509 service nova] Creating event network-vif-deleted:7e7a43a5-3a15-49a6-b50e-0ac0ac9faa8d for instance 82b86465-afb0-49ef-9932-1538010c1ae5 on n-h2-851028-13 Oct 04 18:50:35.259501 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-b452e232-3add-4060-9e25-478f0508f4c9 req-090add70-4070-48dc-b8e7-ea437ba9d509 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069607 Oct 04 18:50:35.261084 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2023/4308] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:50:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:50:35.284021 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-e858cf19-dcc2-49dc-a851-3fa730f3c1c2 tempest-ServerActionsTestJSON-1452535557 tempest-ServerActionsTestJSON-1452535557-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1249556403" status: 202 len: 0 microversion: 2.1 time: 0.045649 Oct 04 18:50:35.286034 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2286/4309] 10.222.0.43 () {58 vars in 1221 bytes} [Tue Oct 4 18:50:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1249556403 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:50:35.774112 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-c525c05f-ece6-4935-be4d-753d82dc6773 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:35.775201 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-c525c05f-ece6-4935-be4d-753d82dc6773 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] [instance: d802635f-8f77-4488-84e0-a973e3244525] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:35.782913 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c525c05f-ece6-4935-be4d-753d82dc6773 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:35.787263 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c525c05f-ece6-4935-be4d-753d82dc6773 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:35.788076 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c525c05f-ece6-4935-be4d-753d82dc6773 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:35.789228 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c525c05f-ece6-4935-be4d-753d82dc6773 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:35.789930 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c525c05f-ece6-4935-be4d-753d82dc6773 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:35.790597 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c525c05f-ece6-4935-be4d-753d82dc6773 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:36.189527 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-ff01e5fc-17eb-4a24-b884-cd57b0f7d6de tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:36.190314 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-ff01e5fc-17eb-4a24-b884-cd57b0f7d6de tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] [instance: fa47906d-d394-46fe-9143-780bcd27a715] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:36.210087 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ff01e5fc-17eb-4a24-b884-cd57b0f7d6de tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:36.213262 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ff01e5fc-17eb-4a24-b884-cd57b0f7d6de tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:36.214338 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ff01e5fc-17eb-4a24-b884-cd57b0f7d6de tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:36.219483 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ff01e5fc-17eb-4a24-b884-cd57b0f7d6de tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:36.221613 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ff01e5fc-17eb-4a24-b884-cd57b0f7d6de tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:36.222599 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ff01e5fc-17eb-4a24-b884-cd57b0f7d6de tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:36.605424 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-ff01e5fc-17eb-4a24-b884-cd57b0f7d6de tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:36.647753 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-ff01e5fc-17eb-4a24-b884-cd57b0f7d6de tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:36.649526 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-ff01e5fc-17eb-4a24-b884-cd57b0f7d6de tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:36.657345 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-ff01e5fc-17eb-4a24-b884-cd57b0f7d6de tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] 10.222.0.43 "GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715" status: 200 len: 2703 microversion: 2.32 time: 0.466836 Oct 04 18:50:36.657345 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2287/4310] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:50:36 2022] GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715 => generated 2703 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:50:36.659560 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-3f0c926e-a8ef-4513-ba58-69c5e78b1db7 req-657aea17-c7f6-4abb-9cb8-c2b00307f546 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d802635f-8f77-4488-84e0-a973e3244525", "name": "network-vif-plugged", "status": "completed", "tag": "09899abf-7896-41ad-b6d3-6f2bcf313ca6"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:50:36.672769 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-3f0c926e-a8ef-4513-ba58-69c5e78b1db7 req-657aea17-c7f6-4abb-9cb8-c2b00307f546 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:36.673475 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-3f0c926e-a8ef-4513-ba58-69c5e78b1db7 req-657aea17-c7f6-4abb-9cb8-c2b00307f546 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:36.674067 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-3f0c926e-a8ef-4513-ba58-69c5e78b1db7 req-657aea17-c7f6-4abb-9cb8-c2b00307f546 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:36.684022 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-c525c05f-ece6-4935-be4d-753d82dc6773 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14707008940e4965ab7d1190094a71bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8f94cf1c974654a336645f453c9efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:36.688999 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-3f0c926e-a8ef-4513-ba58-69c5e78b1db7 req-657aea17-c7f6-4abb-9cb8-c2b00307f546 service nova] Creating event network-vif-plugged:09899abf-7896-41ad-b6d3-6f2bcf313ca6 for instance d802635f-8f77-4488-84e0-a973e3244525 on n-h1-851028-13 Oct 04 18:50:36.694578 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-3f0c926e-a8ef-4513-ba58-69c5e78b1db7 req-657aea17-c7f6-4abb-9cb8-c2b00307f546 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038498 Oct 04 18:50:36.695551 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2288/4311] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:50:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:50:36.708141 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-c525c05f-ece6-4935-be4d-753d82dc6773 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] 10.222.0.43 "GET /compute/v2.1/servers/d802635f-8f77-4488-84e0-a973e3244525" status: 200 len: 1309 microversion: 2.1 time: 0.936023 Oct 04 18:50:36.711291 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2024/4312] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:35 2022] GET /compute/v2.1/servers/d802635f-8f77-4488-84e0-a973e3244525 => generated 1309 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:36.857545 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-c3d342bf-023e-4975-9a65-b093d6e15bbc tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-1838908269", "imageRef": "e84fef1b-6147-44e1-aca1-e90a6c32d9e3", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "e5e4c912-3880-4455-8cdb-5c08f7fd2f88"}], "security_groups": [{"name": "tempest-securitygroup--212327448"}], "key_name": "tempest-keypair-291546891", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:50:37.091966 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.network.neutron [None req-c3d342bf-023e-4975-9a65-b093d6e15bbc tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] validate_networks() for [('e5e4c912-3880-4455-8cdb-5c08f7fd2f88', None, None, None, None, None)] {{(pid=123596) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:50:37.347674 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-948c1ac1-784e-484c-9640-b0653ff22fbc req-8250b07d-667f-4c80-a906-71d86920ca6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa47906d-d394-46fe-9143-780bcd27a715", "name": "network-vif-deleted", "tag": "c894730c-7cbc-41ef-a7b9-c9eb574e1489"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:50:37.366933 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-948c1ac1-784e-484c-9640-b0653ff22fbc req-8250b07d-667f-4c80-a906-71d86920ca6e service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:37.368954 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-948c1ac1-784e-484c-9640-b0653ff22fbc req-8250b07d-667f-4c80-a906-71d86920ca6e service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:37.369867 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-948c1ac1-784e-484c-9640-b0653ff22fbc req-8250b07d-667f-4c80-a906-71d86920ca6e service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:37.399665 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-948c1ac1-784e-484c-9640-b0653ff22fbc req-8250b07d-667f-4c80-a906-71d86920ca6e service nova] Creating event network-vif-deleted:c894730c-7cbc-41ef-a7b9-c9eb574e1489 for instance fa47906d-d394-46fe-9143-780bcd27a715 on n-h1-851028-13 Oct 04 18:50:37.419809 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-948c1ac1-784e-484c-9640-b0653ff22fbc req-8250b07d-667f-4c80-a906-71d86920ca6e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077253 Oct 04 18:50:37.421250 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2025/4313] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:50:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:50:37.686847 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-d721a1f0-653d-40db-afc4-e0d796c0b312 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:37.688268 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-d721a1f0-653d-40db-afc4-e0d796c0b312 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] [instance: fa47906d-d394-46fe-9143-780bcd27a715] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:37.702074 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d721a1f0-653d-40db-afc4-e0d796c0b312 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:37.709239 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d721a1f0-653d-40db-afc4-e0d796c0b312 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:37.709853 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d721a1f0-653d-40db-afc4-e0d796c0b312 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:37.713395 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d721a1f0-653d-40db-afc4-e0d796c0b312 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:37.713395 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d721a1f0-653d-40db-afc4-e0d796c0b312 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:37.713694 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d721a1f0-653d-40db-afc4-e0d796c0b312 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:37.864455 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-c3d342bf-023e-4975-9a65-b093d6e15bbc tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Flavor limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:50:37.864909 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-c3d342bf-023e-4975-9a65-b093d6e15bbc tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Image limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:50:37.865403 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-c3d342bf-023e-4975-9a65-b093d6e15bbc tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Flavor pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:50:37.865819 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-c3d342bf-023e-4975-9a65-b093d6e15bbc tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Image pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:50:37.866239 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-c3d342bf-023e-4975-9a65-b093d6e15bbc tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:50:37.877811 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c3d342bf-023e-4975-9a65-b093d6e15bbc tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:37.878538 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c3d342bf-023e-4975-9a65-b093d6e15bbc tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:37.879136 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c3d342bf-023e-4975-9a65-b093d6e15bbc tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:37.880157 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c3d342bf-023e-4975-9a65-b093d6e15bbc tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:37.881089 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c3d342bf-023e-4975-9a65-b093d6e15bbc tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:37.881785 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c3d342bf-023e-4975-9a65-b093d6e15bbc tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:37.920807 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-c3d342bf-023e-4975-9a65-b093d6e15bbc tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Getting quotas for project b40894812ff042979932773f36a70e0d. Resources: {'ram', 'cores', 'instances'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:50:37.930649 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-c3d342bf-023e-4975-9a65-b093d6e15bbc tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Getting quotas for user 4d4b6ab960cd4f909975c9bb14d50480 and project b40894812ff042979932773f36a70e0d. Resources: {'ram', 'cores', 'instances'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:50:37.952487 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-c3d342bf-023e-4975-9a65-b093d6e15bbc tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Going to run 1 instances... {{(pid=123596) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:50:37.955470 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-c3d342bf-023e-4975-9a65-b093d6e15bbc tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] [instance: 8fc3c2f5-e86b-4bf0-a124-750ea71e52ad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e84fef1b-6147-44e1-aca1-e90a6c32d9e3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123596) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:50:38.031201 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-c3d342bf-023e-4975-9a65-b093d6e15bbc tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.179204 Oct 04 18:50:38.032486 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2289/4314] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 18:50:36 2022] POST /compute/v2.1/servers => generated 405 bytes in 1181 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:50:38.038663 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-0ef80bf8-a15d-42d2-97b5-c2cfc3e2a41a tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:38.039647 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-0ef80bf8-a15d-42d2-97b5-c2cfc3e2a41a tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] [instance: d802635f-8f77-4488-84e0-a973e3244525] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:38.068891 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0ef80bf8-a15d-42d2-97b5-c2cfc3e2a41a tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:38.069953 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0ef80bf8-a15d-42d2-97b5-c2cfc3e2a41a tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:38.070703 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0ef80bf8-a15d-42d2-97b5-c2cfc3e2a41a tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:38.071799 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0ef80bf8-a15d-42d2-97b5-c2cfc3e2a41a tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:38.072976 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0ef80bf8-a15d-42d2-97b5-c2cfc3e2a41a tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:38.073530 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0ef80bf8-a15d-42d2-97b5-c2cfc3e2a41a tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:38.462517 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-0ef80bf8-a15d-42d2-97b5-c2cfc3e2a41a tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14707008940e4965ab7d1190094a71bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8f94cf1c974654a336645f453c9efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:38.474262 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-0ef80bf8-a15d-42d2-97b5-c2cfc3e2a41a tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] 10.222.0.43 "GET /compute/v2.1/servers/d802635f-8f77-4488-84e0-a973e3244525" status: 200 len: 1309 microversion: 2.1 time: 0.437104 Oct 04 18:50:38.475122 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2290/4315] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:38 2022] GET /compute/v2.1/servers/d802635f-8f77-4488-84e0-a973e3244525 => generated 1309 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:38.485298 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-c680372c-5106-454d-b19c-332dd06cb52e tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:38.486251 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-c680372c-5106-454d-b19c-332dd06cb52e tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] [instance: 8fc3c2f5-e86b-4bf0-a124-750ea71e52ad] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:38.563497 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-d721a1f0-653d-40db-afc4-e0d796c0b312 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:38.595824 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-d721a1f0-653d-40db-afc4-e0d796c0b312 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:38.601595 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-d721a1f0-653d-40db-afc4-e0d796c0b312 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:38.611849 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-d721a1f0-653d-40db-afc4-e0d796c0b312 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] 10.222.0.43 "GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715" status: 200 len: 2657 microversion: 2.32 time: 0.929890 Oct 04 18:50:38.613191 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2026/4316] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:50:37 2022] GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715 => generated 2657 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:50:38.670928 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-c680372c-5106-454d-b19c-332dd06cb52e tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4b6ab960cd4f909975c9bb14d50480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40894812ff042979932773f36a70e0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:38.690674 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-c680372c-5106-454d-b19c-332dd06cb52e tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] 10.222.0.43 "GET /compute/v2.1/servers/8fc3c2f5-e86b-4bf0-a124-750ea71e52ad" status: 200 len: 1245 microversion: 2.1 time: 0.214204 Oct 04 18:50:38.691274 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2291/4317] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:38 2022] GET /compute/v2.1/servers/8fc3c2f5-e86b-4bf0-a124-750ea71e52ad => generated 1245 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:39.030601 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-10be8d41-04d2-489a-88c6-8e07b2772452 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1397885614 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1397885614-project-admin] Calling method '.version_select at 0x7fb21eb20f70>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:39.032348 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-10be8d41-04d2-489a-88c6-8e07b2772452 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1397885614 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1397885614-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:39.032811 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-10be8d41-04d2-489a-88c6-8e07b2772452 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1397885614 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1397885614-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:39.033290 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-10be8d41-04d2-489a-88c6-8e07b2772452 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1397885614 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1397885614-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:39.052354 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-10be8d41-04d2-489a-88c6-8e07b2772452 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1397885614 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1397885614-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:39.053963 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-10be8d41-04d2-489a-88c6-8e07b2772452 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1397885614 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1397885614-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:39.056495 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-10be8d41-04d2-489a-88c6-8e07b2772452 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1397885614 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1397885614-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:39.072127 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-10be8d41-04d2-489a-88c6-8e07b2772452 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1397885614 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1397885614-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:39.074457 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-10be8d41-04d2-489a-88c6-8e07b2772452 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1397885614 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1397885614-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:39.075184 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-10be8d41-04d2-489a-88c6-8e07b2772452 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1397885614 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1397885614-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:39.085193 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-10be8d41-04d2-489a-88c6-8e07b2772452 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1397885614 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1397885614-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.470282 Oct 04 18:50:39.086766 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2027/4318] 10.222.0.43 () {58 vars in 1146 bytes} [Tue Oct 4 18:50:38 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:50:39.505668 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-e065f49c-f990-4148-a13d-8f18b7892a14 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:39.508216 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-e065f49c-f990-4148-a13d-8f18b7892a14 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] [instance: d802635f-8f77-4488-84e0-a973e3244525] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:39.560819 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e065f49c-f990-4148-a13d-8f18b7892a14 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:39.563049 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e065f49c-f990-4148-a13d-8f18b7892a14 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:39.564244 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e065f49c-f990-4148-a13d-8f18b7892a14 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:39.565878 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e065f49c-f990-4148-a13d-8f18b7892a14 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:39.566681 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e065f49c-f990-4148-a13d-8f18b7892a14 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:39.567341 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e065f49c-f990-4148-a13d-8f18b7892a14 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:39.643139 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-627ed7b8-2215-44b5-93cd-918432fcc680 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:39.643904 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-627ed7b8-2215-44b5-93cd-918432fcc680 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] [instance: fa47906d-d394-46fe-9143-780bcd27a715] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:39.666816 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-627ed7b8-2215-44b5-93cd-918432fcc680 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:39.667335 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-627ed7b8-2215-44b5-93cd-918432fcc680 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:39.667894 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-627ed7b8-2215-44b5-93cd-918432fcc680 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:39.668619 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-627ed7b8-2215-44b5-93cd-918432fcc680 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:39.669941 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-627ed7b8-2215-44b5-93cd-918432fcc680 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:39.670382 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-627ed7b8-2215-44b5-93cd-918432fcc680 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:40.183760 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-627ed7b8-2215-44b5-93cd-918432fcc680 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:40.198573 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-627ed7b8-2215-44b5-93cd-918432fcc680 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:40.200520 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-627ed7b8-2215-44b5-93cd-918432fcc680 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:40.205864 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-627ed7b8-2215-44b5-93cd-918432fcc680 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] 10.222.0.43 "GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715" status: 200 len: 2497 microversion: 2.32 time: 0.566618 Oct 04 18:50:40.207434 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2028/4319] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:50:39 2022] GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715 => generated 2497 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:50:40.219303 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-da09532b-8d5c-43a8-9f2c-f2f8ca8c9c77 tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:40.224370 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-da09532b-8d5c-43a8-9f2c-f2f8ca8c9c77 tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] [instance: 8fc3c2f5-e86b-4bf0-a124-750ea71e52ad] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:40.235108 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-da09532b-8d5c-43a8-9f2c-f2f8ca8c9c77 tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:40.236160 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-da09532b-8d5c-43a8-9f2c-f2f8ca8c9c77 tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:40.236766 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-da09532b-8d5c-43a8-9f2c-f2f8ca8c9c77 tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:40.238457 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-da09532b-8d5c-43a8-9f2c-f2f8ca8c9c77 tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:40.239614 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-da09532b-8d5c-43a8-9f2c-f2f8ca8c9c77 tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:40.240054 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-da09532b-8d5c-43a8-9f2c-f2f8ca8c9c77 tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:40.548348 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-e065f49c-f990-4148-a13d-8f18b7892a14 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14707008940e4965ab7d1190094a71bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8f94cf1c974654a336645f453c9efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:40.565887 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-e065f49c-f990-4148-a13d-8f18b7892a14 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] 10.222.0.43 "GET /compute/v2.1/servers/d802635f-8f77-4488-84e0-a973e3244525" status: 200 len: 1490 microversion: 2.1 time: 1.067022 Oct 04 18:50:40.566492 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2292/4320] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:39 2022] GET /compute/v2.1/servers/d802635f-8f77-4488-84e0-a973e3244525 => generated 1490 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:40.571096 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-5e554222-7536-42d6-ba0b-197862acd16e req-013a110a-bea3-46ac-9315-1da991885c25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa47906d-d394-46fe-9143-780bcd27a715", "name": "network-vif-deleted", "tag": "f2b979d5-599c-4c02-8f73-2a3d8e34cd17"}, {"server_uuid": "fa47906d-d394-46fe-9143-780bcd27a715", "name": "network-vif-deleted", "tag": "11c4d4a8-fea9-4b92-8ccb-46013ebd8b06"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:50:40.592131 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-5e554222-7536-42d6-ba0b-197862acd16e req-013a110a-bea3-46ac-9315-1da991885c25 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:40.593157 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-5e554222-7536-42d6-ba0b-197862acd16e req-013a110a-bea3-46ac-9315-1da991885c25 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:40.593157 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-5e554222-7536-42d6-ba0b-197862acd16e req-013a110a-bea3-46ac-9315-1da991885c25 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:40.615131 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-5e554222-7536-42d6-ba0b-197862acd16e req-013a110a-bea3-46ac-9315-1da991885c25 service nova] Creating event network-vif-deleted:f2b979d5-599c-4c02-8f73-2a3d8e34cd17 for instance fa47906d-d394-46fe-9143-780bcd27a715 on n-h1-851028-13 Oct 04 18:50:40.616017 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-5e554222-7536-42d6-ba0b-197862acd16e req-013a110a-bea3-46ac-9315-1da991885c25 service nova] Creating event network-vif-deleted:11c4d4a8-fea9-4b92-8ccb-46013ebd8b06 for instance fa47906d-d394-46fe-9143-780bcd27a715 on n-h1-851028-13 Oct 04 18:50:40.623822 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-5e554222-7536-42d6-ba0b-197862acd16e req-013a110a-bea3-46ac-9315-1da991885c25 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.055474 Oct 04 18:50:40.624997 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2293/4321] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:50:40 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:50:40.631681 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-516b2124-2d8b-44c6-b00b-4bb10ccc0167 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:40.632781 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-516b2124-2d8b-44c6-b00b-4bb10ccc0167 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] [instance: af90e409-4121-4169-b06b-814350b000ec] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:40.640643 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-516b2124-2d8b-44c6-b00b-4bb10ccc0167 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:40.641682 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-516b2124-2d8b-44c6-b00b-4bb10ccc0167 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:40.642342 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-516b2124-2d8b-44c6-b00b-4bb10ccc0167 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:40.643274 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-516b2124-2d8b-44c6-b00b-4bb10ccc0167 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:40.643944 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-516b2124-2d8b-44c6-b00b-4bb10ccc0167 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:40.644637 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-516b2124-2d8b-44c6-b00b-4bb10ccc0167 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:41.002541 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-da09532b-8d5c-43a8-9f2c-f2f8ca8c9c77 tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4b6ab960cd4f909975c9bb14d50480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40894812ff042979932773f36a70e0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:41.021402 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-da09532b-8d5c-43a8-9f2c-f2f8ca8c9c77 tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] 10.222.0.43 "GET /compute/v2.1/servers/8fc3c2f5-e86b-4bf0-a124-750ea71e52ad" status: 200 len: 1315 microversion: 2.1 time: 0.812634 Oct 04 18:50:41.024519 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2029/4322] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:40 2022] GET /compute/v2.1/servers/8fc3c2f5-e86b-4bf0-a124-750ea71e52ad => generated 1315 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:41.186816 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-516b2124-2d8b-44c6-b00b-4bb10ccc0167 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14707008940e4965ab7d1190094a71bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8f94cf1c974654a336645f453c9efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:41.203488 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-516b2124-2d8b-44c6-b00b-4bb10ccc0167 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] 10.222.0.43 "GET /compute/v2.1/servers/af90e409-4121-4169-b06b-814350b000ec" status: 200 len: 1489 microversion: 2.1 time: 0.575991 Oct 04 18:50:41.208240 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2294/4323] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:40 2022] GET /compute/v2.1/servers/af90e409-4121-4169-b06b-814350b000ec => generated 1489 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:41.228292 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-20c19cd1-e4c0-4b2b-b63c-f905dac32f3c tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:41.229556 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-20c19cd1-e4c0-4b2b-b63c-f905dac32f3c tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] [instance: d802635f-8f77-4488-84e0-a973e3244525] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:41.243452 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-a09d89f1-aba0-4171-9a2b-fff0d26a9c85 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:41.244627 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-a09d89f1-aba0-4171-9a2b-fff0d26a9c85 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] [instance: fa47906d-d394-46fe-9143-780bcd27a715] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:41.247318 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-20c19cd1-e4c0-4b2b-b63c-f905dac32f3c tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:41.254225 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-20c19cd1-e4c0-4b2b-b63c-f905dac32f3c tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:41.254860 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-20c19cd1-e4c0-4b2b-b63c-f905dac32f3c tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:41.270670 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-20c19cd1-e4c0-4b2b-b63c-f905dac32f3c tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:41.271240 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a09d89f1-aba0-4171-9a2b-fff0d26a9c85 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:41.274345 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-20c19cd1-e4c0-4b2b-b63c-f905dac32f3c tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:41.275026 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-20c19cd1-e4c0-4b2b-b63c-f905dac32f3c tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:41.280443 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a09d89f1-aba0-4171-9a2b-fff0d26a9c85 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:41.280954 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a09d89f1-aba0-4171-9a2b-fff0d26a9c85 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:41.281755 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a09d89f1-aba0-4171-9a2b-fff0d26a9c85 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:41.282237 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a09d89f1-aba0-4171-9a2b-fff0d26a9c85 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:41.282683 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a09d89f1-aba0-4171-9a2b-fff0d26a9c85 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:41.441785 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-a09d89f1-aba0-4171-9a2b-fff0d26a9c85 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:41.455068 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-a09d89f1-aba0-4171-9a2b-fff0d26a9c85 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:41.456534 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-a09d89f1-aba0-4171-9a2b-fff0d26a9c85 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:41.460032 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-a09d89f1-aba0-4171-9a2b-fff0d26a9c85 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] 10.222.0.43 "GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715" status: 200 len: 2159 microversion: 2.32 time: 0.221978 Oct 04 18:50:41.462981 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2295/4324] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:50:41 2022] GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715 => generated 2159 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:50:41.781447 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=12 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:50:42.054196 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-0c7d45da-a6d4-4f95-b25b-42bce6749ca6 tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:42.055250 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-0c7d45da-a6d4-4f95-b25b-42bce6749ca6 tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] [instance: 8fc3c2f5-e86b-4bf0-a124-750ea71e52ad] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:42.079841 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0c7d45da-a6d4-4f95-b25b-42bce6749ca6 tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:42.083779 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0c7d45da-a6d4-4f95-b25b-42bce6749ca6 tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:42.094806 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0c7d45da-a6d4-4f95-b25b-42bce6749ca6 tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:42.095778 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0c7d45da-a6d4-4f95-b25b-42bce6749ca6 tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:42.096278 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0c7d45da-a6d4-4f95-b25b-42bce6749ca6 tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:42.099654 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0c7d45da-a6d4-4f95-b25b-42bce6749ca6 tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:42.311841 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-0c7d45da-a6d4-4f95-b25b-42bce6749ca6 tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4b6ab960cd4f909975c9bb14d50480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40894812ff042979932773f36a70e0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:42.346397 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-0c7d45da-a6d4-4f95-b25b-42bce6749ca6 tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] 10.222.0.43 "GET /compute/v2.1/servers/8fc3c2f5-e86b-4bf0-a124-750ea71e52ad" status: 200 len: 1303 microversion: 2.1 time: 0.299565 Oct 04 18:50:42.350606 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2296/4325] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:42 2022] GET /compute/v2.1/servers/8fc3c2f5-e86b-4bf0-a124-750ea71e52ad => generated 1303 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:42.493643 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-a501e9e1-2921-4e2a-9048-ed1b39ade611 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:42.494401 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-a501e9e1-2921-4e2a-9048-ed1b39ade611 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] [instance: fa47906d-d394-46fe-9143-780bcd27a715] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:42.519132 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a501e9e1-2921-4e2a-9048-ed1b39ade611 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:42.519722 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a501e9e1-2921-4e2a-9048-ed1b39ade611 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:42.520172 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a501e9e1-2921-4e2a-9048-ed1b39ade611 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:42.520895 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a501e9e1-2921-4e2a-9048-ed1b39ade611 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:42.524514 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a501e9e1-2921-4e2a-9048-ed1b39ade611 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:42.525096 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a501e9e1-2921-4e2a-9048-ed1b39ade611 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:42.609811 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-20c19cd1-e4c0-4b2b-b63c-f905dac32f3c tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14707008940e4965ab7d1190094a71bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8f94cf1c974654a336645f453c9efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:42.619132 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-20c19cd1-e4c0-4b2b-b63c-f905dac32f3c tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] 10.222.0.43 "GET /compute/v2.1/servers/d802635f-8f77-4488-84e0-a973e3244525" status: 200 len: 1490 microversion: 2.1 time: 1.395212 Oct 04 18:50:42.625230 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2030/4326] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:41 2022] GET /compute/v2.1/servers/d802635f-8f77-4488-84e0-a973e3244525 => generated 1490 bytes in 1402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:42.663281 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-a9fa47fc-c57b-436b-ad08-ad6c6fbbad2a tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:42.664330 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-a9fa47fc-c57b-436b-ad08-ad6c6fbbad2a tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] [instance: d802635f-8f77-4488-84e0-a973e3244525] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:42.675677 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a9fa47fc-c57b-436b-ad08-ad6c6fbbad2a tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:42.683106 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a9fa47fc-c57b-436b-ad08-ad6c6fbbad2a tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:42.683921 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a9fa47fc-c57b-436b-ad08-ad6c6fbbad2a tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:42.687650 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a9fa47fc-c57b-436b-ad08-ad6c6fbbad2a tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:42.688385 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a9fa47fc-c57b-436b-ad08-ad6c6fbbad2a tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:42.689042 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a9fa47fc-c57b-436b-ad08-ad6c6fbbad2a tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:42.745311 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-a9fa47fc-c57b-436b-ad08-ad6c6fbbad2a tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] [instance: d802635f-8f77-4488-84e0-a973e3244525] Going to try to terminate instance {{(pid=123595) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:50:42.839236 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-a501e9e1-2921-4e2a-9048-ed1b39ade611 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:42.870760 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-a501e9e1-2921-4e2a-9048-ed1b39ade611 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:42.872249 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-a501e9e1-2921-4e2a-9048-ed1b39ade611 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:42.874189 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-a501e9e1-2921-4e2a-9048-ed1b39ade611 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] 10.222.0.43 "GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715" status: 200 len: 2159 microversion: 2.32 time: 0.384922 Oct 04 18:50:42.882900 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2297/4327] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:50:42 2022] GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715 => generated 2159 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:50:42.971778 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:UPDATE=2 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:50:42.990808 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-a9fa47fc-c57b-436b-ad08-ad6c6fbbad2a tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] 10.222.0.43 "DELETE /compute/v2.1/servers/d802635f-8f77-4488-84e0-a973e3244525" status: 204 len: 0 microversion: 2.1 time: 0.331141 Oct 04 18:50:43.003687 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2031/4328] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 18:50:42 2022] DELETE /compute/v2.1/servers/d802635f-8f77-4488-84e0-a973e3244525 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:50:43.012964 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-19e95a0a-b43d-446a-8eb6-91291c961e88 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:43.015550 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-19e95a0a-b43d-446a-8eb6-91291c961e88 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] [instance: d802635f-8f77-4488-84e0-a973e3244525] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:43.047239 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-19e95a0a-b43d-446a-8eb6-91291c961e88 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:43.048281 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-19e95a0a-b43d-446a-8eb6-91291c961e88 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:43.053317 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-19e95a0a-b43d-446a-8eb6-91291c961e88 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:43.056352 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-19e95a0a-b43d-446a-8eb6-91291c961e88 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:43.057536 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-19e95a0a-b43d-446a-8eb6-91291c961e88 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:43.060564 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-19e95a0a-b43d-446a-8eb6-91291c961e88 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:43.374913 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-a15055d3-5123-436b-af5d-45780ce3e1f5 tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:43.375738 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-a15055d3-5123-436b-af5d-45780ce3e1f5 tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] [instance: 8fc3c2f5-e86b-4bf0-a124-750ea71e52ad] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:43.391061 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a15055d3-5123-436b-af5d-45780ce3e1f5 tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:43.394563 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a15055d3-5123-436b-af5d-45780ce3e1f5 tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:43.395297 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a15055d3-5123-436b-af5d-45780ce3e1f5 tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:43.406186 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a15055d3-5123-436b-af5d-45780ce3e1f5 tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:43.410093 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a15055d3-5123-436b-af5d-45780ce3e1f5 tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:43.410925 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a15055d3-5123-436b-af5d-45780ce3e1f5 tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:43.826599 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-19e95a0a-b43d-446a-8eb6-91291c961e88 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14707008940e4965ab7d1190094a71bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8f94cf1c974654a336645f453c9efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:43.836784 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-19e95a0a-b43d-446a-8eb6-91291c961e88 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] 10.222.0.43 "GET /compute/v2.1/servers/d802635f-8f77-4488-84e0-a973e3244525" status: 200 len: 1496 microversion: 2.1 time: 0.828566 Oct 04 18:50:43.839363 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2298/4329] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:43 2022] GET /compute/v2.1/servers/d802635f-8f77-4488-84e0-a973e3244525 => generated 1496 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:43.858418 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-45a2bb68-5edf-47fc-b67a-3ad8f483f3a1 req-ef5348ae-7dfd-4aaf-a1a0-4cb77ad58be3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa47906d-d394-46fe-9143-780bcd27a715", "name": "network-vif-deleted", "tag": "4dedaa7a-5245-4fee-80eb-d2092ad95c1e"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:50:43.911203 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-45a2bb68-5edf-47fc-b67a-3ad8f483f3a1 req-ef5348ae-7dfd-4aaf-a1a0-4cb77ad58be3 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:43.911691 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-45a2bb68-5edf-47fc-b67a-3ad8f483f3a1 req-ef5348ae-7dfd-4aaf-a1a0-4cb77ad58be3 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:43.912126 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-45a2bb68-5edf-47fc-b67a-3ad8f483f3a1 req-ef5348ae-7dfd-4aaf-a1a0-4cb77ad58be3 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:43.976803 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-45a2bb68-5edf-47fc-b67a-3ad8f483f3a1 req-ef5348ae-7dfd-4aaf-a1a0-4cb77ad58be3 service nova] Creating event network-vif-deleted:4dedaa7a-5245-4fee-80eb-d2092ad95c1e for instance fa47906d-d394-46fe-9143-780bcd27a715 on n-h1-851028-13 Oct 04 18:50:44.012865 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-45a2bb68-5edf-47fc-b67a-3ad8f483f3a1 req-ef5348ae-7dfd-4aaf-a1a0-4cb77ad58be3 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.166843 Oct 04 18:50:44.029925 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2299/4330] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:50:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:50:44.070882 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-0266a19c-c33a-4000-b4a2-c246c9b92d5e tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:44.078274 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-0266a19c-c33a-4000-b4a2-c246c9b92d5e tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] [instance: fa47906d-d394-46fe-9143-780bcd27a715] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:44.145970 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0266a19c-c33a-4000-b4a2-c246c9b92d5e tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:44.146694 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0266a19c-c33a-4000-b4a2-c246c9b92d5e tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:44.147134 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0266a19c-c33a-4000-b4a2-c246c9b92d5e tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:44.149735 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0266a19c-c33a-4000-b4a2-c246c9b92d5e tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:44.158781 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0266a19c-c33a-4000-b4a2-c246c9b92d5e tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:44.169590 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0266a19c-c33a-4000-b4a2-c246c9b92d5e tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:44.509950 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-0266a19c-c33a-4000-b4a2-c246c9b92d5e tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:44.539476 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-0266a19c-c33a-4000-b4a2-c246c9b92d5e tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:44.548963 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-0266a19c-c33a-4000-b4a2-c246c9b92d5e tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:44.556243 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-0266a19c-c33a-4000-b4a2-c246c9b92d5e tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] 10.222.0.43 "GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715" status: 200 len: 1604 microversion: 2.32 time: 0.523032 Oct 04 18:50:44.562545 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2300/4331] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:50:44 2022] GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715 => generated 1604 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:50:44.863850 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-72151d4c-b1d7-43e7-b412-40b6544305d6 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:44.865016 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-72151d4c-b1d7-43e7-b412-40b6544305d6 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] [instance: d802635f-8f77-4488-84e0-a973e3244525] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:44.883998 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-72151d4c-b1d7-43e7-b412-40b6544305d6 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:44.887272 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-72151d4c-b1d7-43e7-b412-40b6544305d6 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:44.890449 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-72151d4c-b1d7-43e7-b412-40b6544305d6 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:44.895448 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-72151d4c-b1d7-43e7-b412-40b6544305d6 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:44.896638 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-72151d4c-b1d7-43e7-b412-40b6544305d6 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:44.899116 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-72151d4c-b1d7-43e7-b412-40b6544305d6 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:45.144837 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-a15055d3-5123-436b-af5d-45780ce3e1f5 tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4b6ab960cd4f909975c9bb14d50480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40894812ff042979932773f36a70e0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:45.154191 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-a15055d3-5123-436b-af5d-45780ce3e1f5 tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] 10.222.0.43 "GET /compute/v2.1/servers/8fc3c2f5-e86b-4bf0-a124-750ea71e52ad" status: 200 len: 1370 microversion: 2.1 time: 1.784270 Oct 04 18:50:45.177431 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2032/4332] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:43 2022] GET /compute/v2.1/servers/8fc3c2f5-e86b-4bf0-a124-750ea71e52ad => generated 1370 bytes in 1808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:45.596744 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-64ca5058-8822-47e5-8244-7909dd566ef4 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:45.597851 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-64ca5058-8822-47e5-8244-7909dd566ef4 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] [instance: fa47906d-d394-46fe-9143-780bcd27a715] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:45.629211 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-64ca5058-8822-47e5-8244-7909dd566ef4 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:45.634285 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-64ca5058-8822-47e5-8244-7909dd566ef4 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:45.638723 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-64ca5058-8822-47e5-8244-7909dd566ef4 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:45.639824 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-64ca5058-8822-47e5-8244-7909dd566ef4 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:45.641705 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-64ca5058-8822-47e5-8244-7909dd566ef4 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:45.647039 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-64ca5058-8822-47e5-8244-7909dd566ef4 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:45.728457 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:50:45.802159 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-72151d4c-b1d7-43e7-b412-40b6544305d6 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14707008940e4965ab7d1190094a71bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8f94cf1c974654a336645f453c9efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:45.814670 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-72151d4c-b1d7-43e7-b412-40b6544305d6 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] 10.222.0.43 "GET /compute/v2.1/servers/d802635f-8f77-4488-84e0-a973e3244525" status: 200 len: 1496 microversion: 2.1 time: 0.954864 Oct 04 18:50:45.826302 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2301/4333] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:44 2022] GET /compute/v2.1/servers/d802635f-8f77-4488-84e0-a973e3244525 => generated 1496 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:46.070060 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-64ca5058-8822-47e5-8244-7909dd566ef4 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:46.094865 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-64ca5058-8822-47e5-8244-7909dd566ef4 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:46.102642 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-64ca5058-8822-47e5-8244-7909dd566ef4 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:46.106875 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-64ca5058-8822-47e5-8244-7909dd566ef4 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] 10.222.0.43 "GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715" status: 200 len: 1604 microversion: 2.32 time: 0.520635 Oct 04 18:50:46.126762 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2033/4334] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:50:45 2022] GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715 => generated 1604 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:50:46.197628 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-3c4ed285-1f6b-4d69-ab04-66719fd7ad13 tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:46.198623 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-3c4ed285-1f6b-4d69-ab04-66719fd7ad13 tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] [instance: 8fc3c2f5-e86b-4bf0-a124-750ea71e52ad] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:46.226757 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3c4ed285-1f6b-4d69-ab04-66719fd7ad13 tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:46.229929 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3c4ed285-1f6b-4d69-ab04-66719fd7ad13 tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:46.230685 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3c4ed285-1f6b-4d69-ab04-66719fd7ad13 tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:46.234192 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3c4ed285-1f6b-4d69-ab04-66719fd7ad13 tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:46.234932 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3c4ed285-1f6b-4d69-ab04-66719fd7ad13 tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:46.235595 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3c4ed285-1f6b-4d69-ab04-66719fd7ad13 tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:46.374636 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-dcb1065f-c004-4b1e-b69e-bf92072cf68c tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:46.377814 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-dcb1065f-c004-4b1e-b69e-bf92072cf68c tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] [instance: f2269817-3e15-4cfe-8446-7eb0104f9800] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:46.418458 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dcb1065f-c004-4b1e-b69e-bf92072cf68c tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:46.421202 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dcb1065f-c004-4b1e-b69e-bf92072cf68c tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:46.425773 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dcb1065f-c004-4b1e-b69e-bf92072cf68c tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:46.434720 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dcb1065f-c004-4b1e-b69e-bf92072cf68c tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:46.438755 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dcb1065f-c004-4b1e-b69e-bf92072cf68c tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:46.439500 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dcb1065f-c004-4b1e-b69e-bf92072cf68c tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:46.531141 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-dcb1065f-c004-4b1e-b69e-bf92072cf68c tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] 10.222.0.43 "GET /compute/v2.1/servers/f2269817-3e15-4cfe-8446-7eb0104f9800/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.161297 Oct 04 18:50:46.534885 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2034/4335] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Oct 4 18:50:46 2022] GET /compute/v2.1/servers/f2269817-3e15-4cfe-8446-7eb0104f9800/os-volume_attachments => generated 371 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:50:46.853226 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-0c0fcd00-a542-4a75-900c-97044e103d14 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:46.854127 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-0c0fcd00-a542-4a75-900c-97044e103d14 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] [instance: d802635f-8f77-4488-84e0-a973e3244525] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:46.872632 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0c0fcd00-a542-4a75-900c-97044e103d14 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:46.881984 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0c0fcd00-a542-4a75-900c-97044e103d14 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:46.882718 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0c0fcd00-a542-4a75-900c-97044e103d14 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:46.884122 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0c0fcd00-a542-4a75-900c-97044e103d14 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:46.884783 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0c0fcd00-a542-4a75-900c-97044e103d14 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:46.885262 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0c0fcd00-a542-4a75-900c-97044e103d14 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:47.108276 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-3c4ed285-1f6b-4d69-ab04-66719fd7ad13 tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4b6ab960cd4f909975c9bb14d50480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40894812ff042979932773f36a70e0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:47.121591 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-3c4ed285-1f6b-4d69-ab04-66719fd7ad13 tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] 10.222.0.43 "GET /compute/v2.1/servers/8fc3c2f5-e86b-4bf0-a124-750ea71e52ad" status: 200 len: 1370 microversion: 2.1 time: 0.929384 Oct 04 18:50:47.131294 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2302/4336] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:46 2022] GET /compute/v2.1/servers/8fc3c2f5-e86b-4bf0-a124-750ea71e52ad => generated 1370 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:47.137695 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-754db351-fdfe-4eb5-a8c3-b76bb8f9de2c tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:47.150239 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-754db351-fdfe-4eb5-a8c3-b76bb8f9de2c tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] [instance: f2269817-3e15-4cfe-8446-7eb0104f9800] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:47.174984 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-754db351-fdfe-4eb5-a8c3-b76bb8f9de2c tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:47.175499 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-754db351-fdfe-4eb5-a8c3-b76bb8f9de2c tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:47.175995 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-754db351-fdfe-4eb5-a8c3-b76bb8f9de2c tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:47.176724 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-754db351-fdfe-4eb5-a8c3-b76bb8f9de2c tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:47.177216 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-754db351-fdfe-4eb5-a8c3-b76bb8f9de2c tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:47.177654 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-754db351-fdfe-4eb5-a8c3-b76bb8f9de2c tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:47.253276 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=100 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:50:47.276970 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-754db351-fdfe-4eb5-a8c3-b76bb8f9de2c tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] 10.222.0.43 "GET /compute/v2.1/servers/f2269817-3e15-4cfe-8446-7eb0104f9800/os-volume_attachments/1216c3e0-3a40-46ab-add2-29e8512ff6a3" status: 200 len: 194 microversion: 2.1 time: 0.144015 Oct 04 18:50:47.286590 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2303/4337] 10.222.0.43 () {58 vars in 1413 bytes} [Tue Oct 4 18:50:47 2022] GET /compute/v2.1/servers/f2269817-3e15-4cfe-8446-7eb0104f9800/os-volume_attachments/1216c3e0-3a40-46ab-add2-29e8512ff6a3 => generated 194 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:50:47.295188 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-a60fe713-8d3e-4643-ace1-d3e38984b14e tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:47.302898 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-a60fe713-8d3e-4643-ace1-d3e38984b14e tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] [instance: fa47906d-d394-46fe-9143-780bcd27a715] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:47.305021 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:50:47.323252 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a60fe713-8d3e-4643-ace1-d3e38984b14e tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:47.324061 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a60fe713-8d3e-4643-ace1-d3e38984b14e tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:47.324675 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a60fe713-8d3e-4643-ace1-d3e38984b14e tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:47.325581 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a60fe713-8d3e-4643-ace1-d3e38984b14e tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:47.326199 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a60fe713-8d3e-4643-ace1-d3e38984b14e tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:47.326872 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a60fe713-8d3e-4643-ace1-d3e38984b14e tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:47.590163 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-a60fe713-8d3e-4643-ace1-d3e38984b14e tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:47.607032 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-a60fe713-8d3e-4643-ace1-d3e38984b14e tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:47.621803 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-a60fe713-8d3e-4643-ace1-d3e38984b14e tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:47.626601 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-a60fe713-8d3e-4643-ace1-d3e38984b14e tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] 10.222.0.43 "GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715" status: 200 len: 1604 microversion: 2.32 time: 0.338329 Oct 04 18:50:47.632001 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2304/4338] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:50:47 2022] GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715 => generated 1604 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:50:47.659005 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-085c3229-b46f-464a-ad15-4ff8f45c1bdb tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:47.661959 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-085c3229-b46f-464a-ad15-4ff8f45c1bdb tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] [instance: f2269817-3e15-4cfe-8446-7eb0104f9800] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:47.687443 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-085c3229-b46f-464a-ad15-4ff8f45c1bdb tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:47.693354 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-085c3229-b46f-464a-ad15-4ff8f45c1bdb tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:47.709903 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-085c3229-b46f-464a-ad15-4ff8f45c1bdb tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:47.711108 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-085c3229-b46f-464a-ad15-4ff8f45c1bdb tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:47.712003 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-085c3229-b46f-464a-ad15-4ff8f45c1bdb tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:47.712662 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-085c3229-b46f-464a-ad15-4ff8f45c1bdb tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:47.895197 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=2 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:50:47.956749 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-0c0fcd00-a542-4a75-900c-97044e103d14 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14707008940e4965ab7d1190094a71bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8f94cf1c974654a336645f453c9efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:47.978071 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.objects.instance [None req-085c3229-b46f-464a-ad15-4ff8f45c1bdb tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lazy-loading 'services' on Instance uuid f2269817-3e15-4cfe-8446-7eb0104f9800 {{(pid=123596) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:50:47.981808 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-0c0fcd00-a542-4a75-900c-97044e103d14 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] 10.222.0.43 "GET /compute/v2.1/servers/d802635f-8f77-4488-84e0-a973e3244525" status: 200 len: 1496 microversion: 2.1 time: 1.131269 Oct 04 18:50:47.987215 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2035/4339] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:46 2022] GET /compute/v2.1/servers/d802635f-8f77-4488-84e0-a973e3244525 => generated 1496 bytes in 1140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:48.001903 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-93d2b16a-7223-4622-8c6d-7a4d7f40504a req-45b99bac-7479-4766-b1dc-8ac088cb5058 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8fc3c2f5-e86b-4bf0-a124-750ea71e52ad", "tag": "bba2bab2-98c7-4a75-ba9c-9c2578699fcc"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:50:48.038384 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-93d2b16a-7223-4622-8c6d-7a4d7f40504a req-45b99bac-7479-4766-b1dc-8ac088cb5058 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:48.040508 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-93d2b16a-7223-4622-8c6d-7a4d7f40504a req-45b99bac-7479-4766-b1dc-8ac088cb5058 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:48.042816 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-93d2b16a-7223-4622-8c6d-7a4d7f40504a req-45b99bac-7479-4766-b1dc-8ac088cb5058 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:48.064254 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-93d2b16a-7223-4622-8c6d-7a4d7f40504a req-45b99bac-7479-4766-b1dc-8ac088cb5058 service nova] Creating event network-changed:bba2bab2-98c7-4a75-ba9c-9c2578699fcc for instance 8fc3c2f5-e86b-4bf0-a124-750ea71e52ad on n-h2-851028-13 Oct 04 18:50:48.071111 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-93d2b16a-7223-4622-8c6d-7a4d7f40504a req-45b99bac-7479-4766-b1dc-8ac088cb5058 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080832 Oct 04 18:50:48.072675 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2036/4340] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:50:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:50:48.110128 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-931872de-f07f-48e8-b84a-43952dfd8b7e req-2edbcc87-459c-4147-9786-7d74b7041e84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d802635f-8f77-4488-84e0-a973e3244525", "name": "network-vif-unplugged", "status": "completed", "tag": "09899abf-7896-41ad-b6d3-6f2bcf313ca6"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:50:48.129301 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-931872de-f07f-48e8-b84a-43952dfd8b7e req-2edbcc87-459c-4147-9786-7d74b7041e84 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:48.130021 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-931872de-f07f-48e8-b84a-43952dfd8b7e req-2edbcc87-459c-4147-9786-7d74b7041e84 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:48.130651 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-931872de-f07f-48e8-b84a-43952dfd8b7e req-2edbcc87-459c-4147-9786-7d74b7041e84 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:48.144589 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-931872de-f07f-48e8-b84a-43952dfd8b7e req-2edbcc87-459c-4147-9786-7d74b7041e84 service nova] Creating event network-vif-unplugged:09899abf-7896-41ad-b6d3-6f2bcf313ca6 for instance d802635f-8f77-4488-84e0-a973e3244525 on n-h1-851028-13 Oct 04 18:50:48.151173 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-085c3229-b46f-464a-ad15-4ff8f45c1bdb tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] 10.222.0.43 "DELETE /compute/v2.1/servers/f2269817-3e15-4cfe-8446-7eb0104f9800/os-volume_attachments/1216c3e0-3a40-46ab-add2-29e8512ff6a3" status: 202 len: 0 microversion: 2.1 time: 0.516984 Oct 04 18:50:48.151908 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2305/4341] 10.222.0.43 () {58 vars in 1416 bytes} [Tue Oct 4 18:50:47 2022] DELETE /compute/v2.1/servers/f2269817-3e15-4cfe-8446-7eb0104f9800/os-volume_attachments/1216c3e0-3a40-46ab-add2-29e8512ff6a3 => generated 0 bytes in 519 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:50:48.163616 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-931872de-f07f-48e8-b84a-43952dfd8b7e req-2edbcc87-459c-4147-9786-7d74b7041e84 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.059953 Oct 04 18:50:48.169132 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2037/4342] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:50:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:50:48.179468 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-6092ffff-5be0-409f-92a6-8e0a06df5478 tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:48.181359 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-6092ffff-5be0-409f-92a6-8e0a06df5478 tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] [instance: 8fc3c2f5-e86b-4bf0-a124-750ea71e52ad] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:48.196964 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6092ffff-5be0-409f-92a6-8e0a06df5478 tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:48.197842 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6092ffff-5be0-409f-92a6-8e0a06df5478 tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:48.199189 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6092ffff-5be0-409f-92a6-8e0a06df5478 tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:48.201028 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6092ffff-5be0-409f-92a6-8e0a06df5478 tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:48.203593 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6092ffff-5be0-409f-92a6-8e0a06df5478 tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:48.204968 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6092ffff-5be0-409f-92a6-8e0a06df5478 tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:48.665809 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-52a2e2b4-d3af-4e63-9a63-10a1507fcac7 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:48.667100 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-52a2e2b4-d3af-4e63-9a63-10a1507fcac7 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] [instance: fa47906d-d394-46fe-9143-780bcd27a715] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:48.679543 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=8 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:50:48.683567 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-52a2e2b4-d3af-4e63-9a63-10a1507fcac7 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:48.690327 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-52a2e2b4-d3af-4e63-9a63-10a1507fcac7 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:48.694218 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-52a2e2b4-d3af-4e63-9a63-10a1507fcac7 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:48.696436 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-52a2e2b4-d3af-4e63-9a63-10a1507fcac7 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:48.700103 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-52a2e2b4-d3af-4e63-9a63-10a1507fcac7 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:48.701477 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-52a2e2b4-d3af-4e63-9a63-10a1507fcac7 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:48.949538 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-6092ffff-5be0-409f-92a6-8e0a06df5478 tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4b6ab960cd4f909975c9bb14d50480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40894812ff042979932773f36a70e0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:48.955772 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-52a2e2b4-d3af-4e63-9a63-10a1507fcac7 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:48.968912 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-6092ffff-5be0-409f-92a6-8e0a06df5478 tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] 10.222.0.43 "GET /compute/v2.1/servers/8fc3c2f5-e86b-4bf0-a124-750ea71e52ad" status: 200 len: 1370 microversion: 2.1 time: 0.809747 Oct 04 18:50:48.980263 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-52a2e2b4-d3af-4e63-9a63-10a1507fcac7 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:48.984948 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2306/4343] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:48 2022] GET /compute/v2.1/servers/8fc3c2f5-e86b-4bf0-a124-750ea71e52ad => generated 1370 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:48.988713 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-52a2e2b4-d3af-4e63-9a63-10a1507fcac7 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:48.992230 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-52a2e2b4-d3af-4e63-9a63-10a1507fcac7 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] 10.222.0.43 "GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715" status: 200 len: 1604 microversion: 2.32 time: 0.333602 Oct 04 18:50:48.994773 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2038/4344] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:50:48 2022] GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715 => generated 1604 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:50:49.013332 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-5b05eb43-eebf-4b62-9ea6-fb369781cd0c tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:49.014256 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-5b05eb43-eebf-4b62-9ea6-fb369781cd0c tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] [instance: d802635f-8f77-4488-84e0-a973e3244525] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:49.031386 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5b05eb43-eebf-4b62-9ea6-fb369781cd0c tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:49.036636 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5b05eb43-eebf-4b62-9ea6-fb369781cd0c tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:49.038880 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5b05eb43-eebf-4b62-9ea6-fb369781cd0c tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:49.051478 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5b05eb43-eebf-4b62-9ea6-fb369781cd0c tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:49.052843 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5b05eb43-eebf-4b62-9ea6-fb369781cd0c tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:49.053505 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5b05eb43-eebf-4b62-9ea6-fb369781cd0c tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:49.277808 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-5b05eb43-eebf-4b62-9ea6-fb369781cd0c tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14707008940e4965ab7d1190094a71bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8f94cf1c974654a336645f453c9efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:49.301768 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-5b05eb43-eebf-4b62-9ea6-fb369781cd0c tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] 10.222.0.43 "GET /compute/v2.1/servers/d802635f-8f77-4488-84e0-a973e3244525" status: 200 len: 1454 microversion: 2.1 time: 0.293375 Oct 04 18:50:49.302485 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2307/4345] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:49 2022] GET /compute/v2.1/servers/d802635f-8f77-4488-84e0-a973e3244525 => generated 1454 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:49.999408 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-87801a0c-4eb7-4d7e-8829-2420b628c98e tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:50.001035 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-87801a0c-4eb7-4d7e-8829-2420b628c98e tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] [instance: 8fc3c2f5-e86b-4bf0-a124-750ea71e52ad] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:50.023788 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-b62b8df5-2f1a-4489-88ba-f4f821503ade tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:50.024424 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-b62b8df5-2f1a-4489-88ba-f4f821503ade tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] [instance: fa47906d-d394-46fe-9143-780bcd27a715] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:50.033069 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-87801a0c-4eb7-4d7e-8829-2420b628c98e tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:50.040180 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b62b8df5-2f1a-4489-88ba-f4f821503ade tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:50.040672 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b62b8df5-2f1a-4489-88ba-f4f821503ade tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:50.041143 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b62b8df5-2f1a-4489-88ba-f4f821503ade tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:50.047705 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-87801a0c-4eb7-4d7e-8829-2420b628c98e tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:50.049083 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-87801a0c-4eb7-4d7e-8829-2420b628c98e tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:50.059340 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b62b8df5-2f1a-4489-88ba-f4f821503ade tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:50.065309 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b62b8df5-2f1a-4489-88ba-f4f821503ade tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:50.067760 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b62b8df5-2f1a-4489-88ba-f4f821503ade tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:50.074725 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-87801a0c-4eb7-4d7e-8829-2420b628c98e tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:50.077516 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-87801a0c-4eb7-4d7e-8829-2420b628c98e tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:50.081126 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-87801a0c-4eb7-4d7e-8829-2420b628c98e tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:50.347463 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-b62b8df5-2f1a-4489-88ba-f4f821503ade tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:50.361573 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-b62b8df5-2f1a-4489-88ba-f4f821503ade tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:50.370179 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-b62b8df5-2f1a-4489-88ba-f4f821503ade tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:50.371827 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-b62b8df5-2f1a-4489-88ba-f4f821503ade tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] 10.222.0.43 "GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715" status: 200 len: 1604 microversion: 2.32 time: 0.352278 Oct 04 18:50:50.393829 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2308/4346] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:50:50 2022] GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715 => generated 1604 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:50:50.406114 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-8d559402-9fd2-4daf-b8dc-e4cbe0b1f555 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:50.408220 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-8d559402-9fd2-4daf-b8dc-e4cbe0b1f555 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] [instance: d802635f-8f77-4488-84e0-a973e3244525] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:50.424815 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8d559402-9fd2-4daf-b8dc-e4cbe0b1f555 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:50.425533 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8d559402-9fd2-4daf-b8dc-e4cbe0b1f555 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:50.426914 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8d559402-9fd2-4daf-b8dc-e4cbe0b1f555 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:50.430560 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8d559402-9fd2-4daf-b8dc-e4cbe0b1f555 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:50.431753 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8d559402-9fd2-4daf-b8dc-e4cbe0b1f555 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:50.433711 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8d559402-9fd2-4daf-b8dc-e4cbe0b1f555 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:50.521737 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8d559402-9fd2-4daf-b8dc-e4cbe0b1f555 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:50.526604 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8d559402-9fd2-4daf-b8dc-e4cbe0b1f555 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:50.527367 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8d559402-9fd2-4daf-b8dc-e4cbe0b1f555 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:50.529068 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.objects.instance [None req-8d559402-9fd2-4daf-b8dc-e4cbe0b1f555 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lazy-loading 'fault' on Instance uuid d802635f-8f77-4488-84e0-a973e3244525 {{(pid=123596) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:50:50.786742 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-8d559402-9fd2-4daf-b8dc-e4cbe0b1f555 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14707008940e4965ab7d1190094a71bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8f94cf1c974654a336645f453c9efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:50.803474 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-8d559402-9fd2-4daf-b8dc-e4cbe0b1f555 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] 10.222.0.43 "GET /compute/v2.1/servers/d802635f-8f77-4488-84e0-a973e3244525" status: 200 len: 1299 microversion: 2.1 time: 0.404502 Oct 04 18:50:50.804320 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2309/4347] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:50 2022] GET /compute/v2.1/servers/d802635f-8f77-4488-84e0-a973e3244525 => generated 1299 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:50.896503 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-c11e1ea6-5c22-4904-89b7-971f60cf6fc2 req-1fec0150-4be0-4ab9-863d-90f081790c45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d802635f-8f77-4488-84e0-a973e3244525", "name": "network-vif-deleted", "tag": "09899abf-7896-41ad-b6d3-6f2bcf313ca6"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:50:50.918566 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-c11e1ea6-5c22-4904-89b7-971f60cf6fc2 req-1fec0150-4be0-4ab9-863d-90f081790c45 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:50.922541 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-c11e1ea6-5c22-4904-89b7-971f60cf6fc2 req-1fec0150-4be0-4ab9-863d-90f081790c45 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:50.923443 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-c11e1ea6-5c22-4904-89b7-971f60cf6fc2 req-1fec0150-4be0-4ab9-863d-90f081790c45 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:50.947696 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-c11e1ea6-5c22-4904-89b7-971f60cf6fc2 req-1fec0150-4be0-4ab9-863d-90f081790c45 service nova] Creating event network-vif-deleted:09899abf-7896-41ad-b6d3-6f2bcf313ca6 for instance d802635f-8f77-4488-84e0-a973e3244525 on n-h1-851028-13 Oct 04 18:50:50.961624 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-c11e1ea6-5c22-4904-89b7-971f60cf6fc2 req-1fec0150-4be0-4ab9-863d-90f081790c45 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069392 Oct 04 18:50:50.962972 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2310/4348] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:50:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:50:51.093889 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-87801a0c-4eb7-4d7e-8829-2420b628c98e tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4b6ab960cd4f909975c9bb14d50480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40894812ff042979932773f36a70e0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:51.102428 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-87801a0c-4eb7-4d7e-8829-2420b628c98e tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] 10.222.0.43 "GET /compute/v2.1/servers/8fc3c2f5-e86b-4bf0-a124-750ea71e52ad" status: 200 len: 1370 microversion: 2.1 time: 1.107246 Oct 04 18:50:51.103017 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2039/4349] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:49 2022] GET /compute/v2.1/servers/8fc3c2f5-e86b-4bf0-a124-750ea71e52ad => generated 1370 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:51.415324 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-51d9886b-04e7-404d-9d84-7feaf39f995d tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:51.416948 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-51d9886b-04e7-404d-9d84-7feaf39f995d tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] [instance: fa47906d-d394-46fe-9143-780bcd27a715] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:51.440074 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-51d9886b-04e7-404d-9d84-7feaf39f995d tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:51.444103 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-51d9886b-04e7-404d-9d84-7feaf39f995d tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:51.444788 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-51d9886b-04e7-404d-9d84-7feaf39f995d tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:51.447056 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-51d9886b-04e7-404d-9d84-7feaf39f995d tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:51.448361 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-51d9886b-04e7-404d-9d84-7feaf39f995d tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:51.449780 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-51d9886b-04e7-404d-9d84-7feaf39f995d tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:51.665747 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-51d9886b-04e7-404d-9d84-7feaf39f995d tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:51.683629 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-51d9886b-04e7-404d-9d84-7feaf39f995d tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:51.685504 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-51d9886b-04e7-404d-9d84-7feaf39f995d tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:51.687361 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-51d9886b-04e7-404d-9d84-7feaf39f995d tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] 10.222.0.43 "GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715" status: 200 len: 1604 microversion: 2.32 time: 0.282503 Oct 04 18:50:51.697909 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2311/4350] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:50:51 2022] GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715 => generated 1604 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:50:51.830246 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-ddad1f1c-5c4d-4b11-bfda-9d412e3ce2da tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:51.831494 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-ddad1f1c-5c4d-4b11-bfda-9d412e3ce2da tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] [instance: d802635f-8f77-4488-84e0-a973e3244525] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:51.851211 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ddad1f1c-5c4d-4b11-bfda-9d412e3ce2da tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:51.851727 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ddad1f1c-5c4d-4b11-bfda-9d412e3ce2da tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:51.852762 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ddad1f1c-5c4d-4b11-bfda-9d412e3ce2da tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:51.855009 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ddad1f1c-5c4d-4b11-bfda-9d412e3ce2da tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:51.857694 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ddad1f1c-5c4d-4b11-bfda-9d412e3ce2da tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:51.859841 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ddad1f1c-5c4d-4b11-bfda-9d412e3ce2da tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:51.898548 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-ddad1f1c-5c4d-4b11-bfda-9d412e3ce2da tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] HTTP exception thrown: Instance d802635f-8f77-4488-84e0-a973e3244525 could not be found. Oct 04 18:50:51.902238 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-ddad1f1c-5c4d-4b11-bfda-9d412e3ce2da tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Request method failure captured: Oct 04 18:50:51.902238 n-d-851028-13 devstack@n-api.service[123595]: request: GET /compute/v2.1/servers/d802635f-8f77-4488-84e0-a973e3244525 HTTP/1.1 Oct 04 18:50:51.902238 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 18:50:51.902238 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 18:50:51.902238 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 18:50:51.902238 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 0 Oct 04 18:50:51.902238 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 18:50:51.902238 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 18:50:51.902238 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 18:50:51.902238 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 18:50:51.902238 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPIAJxznq_dqRpKBeHYz_tTt-BPe6PGX8bXmZXSSSBar-nAl3_7gjSqUW3yyr2J4Kw1m1-l6Y2izmzOt3P0Lv3UhhGPTaACGzV6RGiSkRczLrMXORtXSdyVIiZq3MCL7L2uQGd29MwUZa7-C3NoIEqHwDxvVJi_WWjtFyKnOFEp1-BZ0 Oct 04 18:50:51.902238 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 18:50:51.902238 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 18:50:51.902238 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 18:50:51.902238 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 18:50:51.902238 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 18:50:51.902238 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 18:50:51.902238 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: ed8f94cf1c974654a336645f453c9efc Oct 04 18:50:51.902238 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-ServersTestJSON-546754383 Oct 04 18:50:51.902238 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 18:50:51.902238 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 18:50:51.902238 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/ed8f94cf1c974654a336645f453c9efc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_ed8f94cf1c974654a336645f453c9efc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ed8f94cf1c974654a336645f453c9efc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ed8f94cf1c974654a336645f453c9efc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:50:51.902238 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-ServersTestJSON-546754383 Oct 04 18:50:51.902238 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: ed8f94cf1c974654a336645f453c9efc Oct 04 18:50:51.902238 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-ServersTestJSON-546754383 Oct 04 18:50:51.902238 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-ServersTestJSON-546754383-project Oct 04 18:50:51.902238 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 18:50:51.902238 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 18:50:51.902238 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: 14707008940e4965ab7d1190094a71bb Oct 04 18:50:51.902238 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-ServersTestJSON-546754383-project Oct 04 18:50:51.902238 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 18:50:51.902238 n-d-851028-13 devstack@n-api.service[123595]: exception: Instance d802635f-8f77-4488-84e0-a973e3244525 could not be found. Oct 04 18:50:51.902238 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': 'd802635f-8f77-4488-84e0-a973e3244525'} Oct 04 18:50:51.902238 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:50:51.902238 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:50:51.902238 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:50:51.902238 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:50:51.902238 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:50:51.902238 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:50:51.902238 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:50:51.902238 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:50:51.902238 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:50:51.902238 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:50:51.902238 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d802635f-8f77-4488-84e0-a973e3244525 could not be found. Oct 04 18:50:51.902238 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:50:51.902238 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:50:51.902238 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:50:51.902238 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:50:51.902238 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:50:51.902238 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:50:51.902238 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:50:51.902238 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:50:51.902238 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:50:51.902238 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:50:51.902238 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:50:51.902238 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:50:51.902238 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:50:51.902238 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:50:51.902238 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:50:51.902238 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:50:51.902238 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d802635f-8f77-4488-84e0-a973e3244525 could not be found. Oct 04 18:50:51.902238 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:50:51.902238 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:50:51.902238 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:50:51.902238 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:50:51.907009 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:50:51.907009 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:50:51.907009 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:50:51.907009 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:50:51.907009 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d802635f-8f77-4488-84e0-a973e3244525 could not be found. Oct 04 18:50:51.907009 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:50:51.909936 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-ddad1f1c-5c4d-4b11-bfda-9d412e3ce2da tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Returning 404 to user: Instance d802635f-8f77-4488-84e0-a973e3244525 could not be found. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:50:51.915295 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-ddad1f1c-5c4d-4b11-bfda-9d412e3ce2da tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] 10.222.0.43 "GET /compute/v2.1/servers/d802635f-8f77-4488-84e0-a973e3244525" status: 404 len: 111 microversion: 2.1 time: 0.090856 Oct 04 18:50:51.916473 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2040/4351] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:51 2022] GET /compute/v2.1/servers/d802635f-8f77-4488-84e0-a973e3244525 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:50:51.927981 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-46bc48d9-2e7a-4495-bd08-491aae6ea427 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:51.929891 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-46bc48d9-2e7a-4495-bd08-491aae6ea427 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] [instance: af90e409-4121-4169-b06b-814350b000ec] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:51.968691 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-46bc48d9-2e7a-4495-bd08-491aae6ea427 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:51.969335 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-46bc48d9-2e7a-4495-bd08-491aae6ea427 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:51.971390 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-46bc48d9-2e7a-4495-bd08-491aae6ea427 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:51.973635 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-46bc48d9-2e7a-4495-bd08-491aae6ea427 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:51.974131 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-46bc48d9-2e7a-4495-bd08-491aae6ea427 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:51.974785 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-46bc48d9-2e7a-4495-bd08-491aae6ea427 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:52.023012 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-46bc48d9-2e7a-4495-bd08-491aae6ea427 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] [instance: af90e409-4121-4169-b06b-814350b000ec] Going to try to terminate instance {{(pid=123596) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:50:52.128822 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-7669de96-0b81-48cb-bc3e-9e4aec36822a tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:52.131064 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-7669de96-0b81-48cb-bc3e-9e4aec36822a tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] [instance: 8fc3c2f5-e86b-4bf0-a124-750ea71e52ad] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:52.145971 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7669de96-0b81-48cb-bc3e-9e4aec36822a tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:52.146813 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7669de96-0b81-48cb-bc3e-9e4aec36822a tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:52.147486 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7669de96-0b81-48cb-bc3e-9e4aec36822a tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:52.148402 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7669de96-0b81-48cb-bc3e-9e4aec36822a tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:52.149585 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7669de96-0b81-48cb-bc3e-9e4aec36822a tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:52.150258 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7669de96-0b81-48cb-bc3e-9e4aec36822a tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:52.185634 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-46bc48d9-2e7a-4495-bd08-491aae6ea427 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] 10.222.0.43 "DELETE /compute/v2.1/servers/af90e409-4121-4169-b06b-814350b000ec" status: 204 len: 0 microversion: 2.1 time: 0.262418 Oct 04 18:50:52.186322 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2312/4352] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 18:50:51 2022] DELETE /compute/v2.1/servers/af90e409-4121-4169-b06b-814350b000ec => generated 0 bytes in 264 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:50:52.195937 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-a501424e-e497-47f2-8b78-694f7de5947e tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:52.196735 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-a501424e-e497-47f2-8b78-694f7de5947e tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] [instance: af90e409-4121-4169-b06b-814350b000ec] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:52.212336 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a501424e-e497-47f2-8b78-694f7de5947e tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:52.212829 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a501424e-e497-47f2-8b78-694f7de5947e tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:52.213302 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a501424e-e497-47f2-8b78-694f7de5947e tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:52.214016 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a501424e-e497-47f2-8b78-694f7de5947e tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:52.214470 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a501424e-e497-47f2-8b78-694f7de5947e tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:52.214896 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a501424e-e497-47f2-8b78-694f7de5947e tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:52.527561 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-7669de96-0b81-48cb-bc3e-9e4aec36822a tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4b6ab960cd4f909975c9bb14d50480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40894812ff042979932773f36a70e0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:52.540611 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-7669de96-0b81-48cb-bc3e-9e4aec36822a tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] 10.222.0.43 "GET /compute/v2.1/servers/8fc3c2f5-e86b-4bf0-a124-750ea71e52ad" status: 200 len: 1370 microversion: 2.1 time: 0.419027 Oct 04 18:50:52.542032 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2041/4353] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:52 2022] GET /compute/v2.1/servers/8fc3c2f5-e86b-4bf0-a124-750ea71e52ad => generated 1370 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:52.742696 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-fa5e58f9-d717-4477-8e0c-516e995af940 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:52.743324 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-fa5e58f9-d717-4477-8e0c-516e995af940 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] [instance: fa47906d-d394-46fe-9143-780bcd27a715] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:52.754000 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fa5e58f9-d717-4477-8e0c-516e995af940 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:52.754490 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fa5e58f9-d717-4477-8e0c-516e995af940 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:52.754932 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fa5e58f9-d717-4477-8e0c-516e995af940 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:52.755639 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fa5e58f9-d717-4477-8e0c-516e995af940 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:52.756092 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fa5e58f9-d717-4477-8e0c-516e995af940 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:52.756519 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fa5e58f9-d717-4477-8e0c-516e995af940 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:52.763913 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-a501424e-e497-47f2-8b78-694f7de5947e tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14707008940e4965ab7d1190094a71bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8f94cf1c974654a336645f453c9efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:52.782986 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-a501424e-e497-47f2-8b78-694f7de5947e tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] 10.222.0.43 "GET /compute/v2.1/servers/af90e409-4121-4169-b06b-814350b000ec" status: 200 len: 1495 microversion: 2.1 time: 0.591395 Oct 04 18:50:52.806763 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2313/4354] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:52 2022] GET /compute/v2.1/servers/af90e409-4121-4169-b06b-814350b000ec => generated 1495 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:50:52.855114 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-fa5e58f9-d717-4477-8e0c-516e995af940 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:52.865732 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-fa5e58f9-d717-4477-8e0c-516e995af940 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:52.867490 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-fa5e58f9-d717-4477-8e0c-516e995af940 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:52.868868 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-fa5e58f9-d717-4477-8e0c-516e995af940 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] 10.222.0.43 "GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715" status: 200 len: 1604 microversion: 2.32 time: 0.144288 Oct 04 18:50:52.869623 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2042/4355] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:50:52 2022] GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715 => generated 1604 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:50:53.570207 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-782acf62-bfbe-4e15-baca-a3fb5f27eee6 tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:53.571122 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-782acf62-bfbe-4e15-baca-a3fb5f27eee6 tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] [instance: 8fc3c2f5-e86b-4bf0-a124-750ea71e52ad] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:53.603496 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-782acf62-bfbe-4e15-baca-a3fb5f27eee6 tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:53.612152 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-782acf62-bfbe-4e15-baca-a3fb5f27eee6 tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:53.612916 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-782acf62-bfbe-4e15-baca-a3fb5f27eee6 tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:53.619635 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-782acf62-bfbe-4e15-baca-a3fb5f27eee6 tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:53.627049 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-782acf62-bfbe-4e15-baca-a3fb5f27eee6 tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:53.628220 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-782acf62-bfbe-4e15-baca-a3fb5f27eee6 tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:53.811236 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-782acf62-bfbe-4e15-baca-a3fb5f27eee6 tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4b6ab960cd4f909975c9bb14d50480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40894812ff042979932773f36a70e0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:53.816866 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-b068bd78-0743-4943-a377-1a53ff615c57 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:53.817565 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-b068bd78-0743-4943-a377-1a53ff615c57 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] [instance: af90e409-4121-4169-b06b-814350b000ec] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:53.823011 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-782acf62-bfbe-4e15-baca-a3fb5f27eee6 tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] 10.222.0.43 "GET /compute/v2.1/servers/8fc3c2f5-e86b-4bf0-a124-750ea71e52ad" status: 200 len: 1370 microversion: 2.1 time: 0.259788 Oct 04 18:50:53.842354 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2314/4356] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:53 2022] GET /compute/v2.1/servers/8fc3c2f5-e86b-4bf0-a124-750ea71e52ad => generated 1370 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:53.846639 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b068bd78-0743-4943-a377-1a53ff615c57 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:53.847142 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b068bd78-0743-4943-a377-1a53ff615c57 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:53.847585 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b068bd78-0743-4943-a377-1a53ff615c57 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:53.854946 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b068bd78-0743-4943-a377-1a53ff615c57 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:53.855877 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b068bd78-0743-4943-a377-1a53ff615c57 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:53.856539 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b068bd78-0743-4943-a377-1a53ff615c57 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:53.909507 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-404c2f6c-fa74-4951-8deb-7226fbf88928 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:53.910126 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-404c2f6c-fa74-4951-8deb-7226fbf88928 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] [instance: fa47906d-d394-46fe-9143-780bcd27a715] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:53.930321 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-404c2f6c-fa74-4951-8deb-7226fbf88928 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:53.930830 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-404c2f6c-fa74-4951-8deb-7226fbf88928 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:53.931283 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-404c2f6c-fa74-4951-8deb-7226fbf88928 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:53.931991 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-404c2f6c-fa74-4951-8deb-7226fbf88928 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:53.936443 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-404c2f6c-fa74-4951-8deb-7226fbf88928 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:53.939846 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-404c2f6c-fa74-4951-8deb-7226fbf88928 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:54.188982 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-404c2f6c-fa74-4951-8deb-7226fbf88928 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:54.206226 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-404c2f6c-fa74-4951-8deb-7226fbf88928 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:54.207656 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-404c2f6c-fa74-4951-8deb-7226fbf88928 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:54.208872 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-404c2f6c-fa74-4951-8deb-7226fbf88928 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] 10.222.0.43 "GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715" status: 200 len: 1604 microversion: 2.32 time: 0.312661 Oct 04 18:50:54.235546 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2315/4357] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:50:53 2022] GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715 => generated 1604 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:50:54.755145 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-b068bd78-0743-4943-a377-1a53ff615c57 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14707008940e4965ab7d1190094a71bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8f94cf1c974654a336645f453c9efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:54.768961 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-b068bd78-0743-4943-a377-1a53ff615c57 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] 10.222.0.43 "GET /compute/v2.1/servers/af90e409-4121-4169-b06b-814350b000ec" status: 200 len: 1495 microversion: 2.1 time: 0.956365 Oct 04 18:50:54.773290 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2043/4358] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:53 2022] GET /compute/v2.1/servers/af90e409-4121-4169-b06b-814350b000ec => generated 1495 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:50:54.849219 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-216e5ce0-1ea6-4ab1-a8f0-ed48c3d1899e tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:54.849838 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-216e5ce0-1ea6-4ab1-a8f0-ed48c3d1899e tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] [instance: 8fc3c2f5-e86b-4bf0-a124-750ea71e52ad] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:54.884956 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-216e5ce0-1ea6-4ab1-a8f0-ed48c3d1899e tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:54.887736 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-216e5ce0-1ea6-4ab1-a8f0-ed48c3d1899e tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:54.895472 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-216e5ce0-1ea6-4ab1-a8f0-ed48c3d1899e tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:54.897415 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-216e5ce0-1ea6-4ab1-a8f0-ed48c3d1899e tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:54.901403 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-216e5ce0-1ea6-4ab1-a8f0-ed48c3d1899e tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:54.903653 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-216e5ce0-1ea6-4ab1-a8f0-ed48c3d1899e tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:55.237486 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-adae34b8-38b1-44db-80bc-0188d3095625 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:55.238792 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-adae34b8-38b1-44db-80bc-0188d3095625 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] [instance: fa47906d-d394-46fe-9143-780bcd27a715] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:55.287706 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-adae34b8-38b1-44db-80bc-0188d3095625 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:55.289425 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-adae34b8-38b1-44db-80bc-0188d3095625 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.030s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:55.291322 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-adae34b8-38b1-44db-80bc-0188d3095625 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:55.293057 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-adae34b8-38b1-44db-80bc-0188d3095625 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:55.294400 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-adae34b8-38b1-44db-80bc-0188d3095625 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:55.295465 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-adae34b8-38b1-44db-80bc-0188d3095625 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:55.478825 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-adae34b8-38b1-44db-80bc-0188d3095625 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:55.498818 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-adae34b8-38b1-44db-80bc-0188d3095625 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:55.500937 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-adae34b8-38b1-44db-80bc-0188d3095625 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:55.506393 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-adae34b8-38b1-44db-80bc-0188d3095625 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] 10.222.0.43 "GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715" status: 200 len: 1604 microversion: 2.32 time: 0.273398 Oct 04 18:50:55.508191 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2044/4359] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:50:55 2022] GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715 => generated 1604 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:50:55.767488 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-216e5ce0-1ea6-4ab1-a8f0-ed48c3d1899e tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4b6ab960cd4f909975c9bb14d50480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40894812ff042979932773f36a70e0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:55.786510 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-0fdc8b6f-94e3-46a6-8aff-179236c7edc1 req-10abecc7-b40b-472a-b393-36349eb14125 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af90e409-4121-4169-b06b-814350b000ec", "name": "network-vif-deleted", "tag": "826b73cb-0d12-468e-94a2-48e8b5979122"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:50:55.788527 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-216e5ce0-1ea6-4ab1-a8f0-ed48c3d1899e tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] 10.222.0.43 "GET /compute/v2.1/servers/8fc3c2f5-e86b-4bf0-a124-750ea71e52ad" status: 200 len: 1370 microversion: 2.1 time: 0.943308 Oct 04 18:50:55.790021 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2316/4360] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:54 2022] GET /compute/v2.1/servers/8fc3c2f5-e86b-4bf0-a124-750ea71e52ad => generated 1370 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:55.802646 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-bed7abe5-8b8e-468b-bdd0-794a49083ecc tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:55.803486 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-bed7abe5-8b8e-468b-bdd0-794a49083ecc tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] [instance: af90e409-4121-4169-b06b-814350b000ec] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:55.819973 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bed7abe5-8b8e-468b-bdd0-794a49083ecc tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:55.820695 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bed7abe5-8b8e-468b-bdd0-794a49083ecc tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:55.821329 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bed7abe5-8b8e-468b-bdd0-794a49083ecc tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:55.822203 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bed7abe5-8b8e-468b-bdd0-794a49083ecc tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:55.822923 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bed7abe5-8b8e-468b-bdd0-794a49083ecc tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:55.823992 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bed7abe5-8b8e-468b-bdd0-794a49083ecc tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:55.826004 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-0fdc8b6f-94e3-46a6-8aff-179236c7edc1 req-10abecc7-b40b-472a-b393-36349eb14125 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:55.829459 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-0fdc8b6f-94e3-46a6-8aff-179236c7edc1 req-10abecc7-b40b-472a-b393-36349eb14125 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:55.830340 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-0fdc8b6f-94e3-46a6-8aff-179236c7edc1 req-10abecc7-b40b-472a-b393-36349eb14125 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:55.864259 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-0fdc8b6f-94e3-46a6-8aff-179236c7edc1 req-10abecc7-b40b-472a-b393-36349eb14125 service nova] Creating event network-vif-deleted:826b73cb-0d12-468e-94a2-48e8b5979122 for instance af90e409-4121-4169-b06b-814350b000ec on n-h2-851028-13 Oct 04 18:50:55.876383 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-0fdc8b6f-94e3-46a6-8aff-179236c7edc1 req-10abecc7-b40b-472a-b393-36349eb14125 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093730 Oct 04 18:50:55.877270 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2045/4361] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:50:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:50:55.997673 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-bed7abe5-8b8e-468b-bdd0-794a49083ecc tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14707008940e4965ab7d1190094a71bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8f94cf1c974654a336645f453c9efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:56.007304 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-bed7abe5-8b8e-468b-bdd0-794a49083ecc tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] 10.222.0.43 "GET /compute/v2.1/servers/af90e409-4121-4169-b06b-814350b000ec" status: 200 len: 1294 microversion: 2.1 time: 0.211443 Oct 04 18:50:56.008187 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2317/4362] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:55 2022] GET /compute/v2.1/servers/af90e409-4121-4169-b06b-814350b000ec => generated 1294 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:56.542084 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-9c810616-9af6-4c10-9860-27d33b18170e tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:56.542970 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-9c810616-9af6-4c10-9860-27d33b18170e tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] [instance: fa47906d-d394-46fe-9143-780bcd27a715] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:56.559882 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9c810616-9af6-4c10-9860-27d33b18170e tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:56.560687 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9c810616-9af6-4c10-9860-27d33b18170e tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:56.561343 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9c810616-9af6-4c10-9860-27d33b18170e tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:56.562858 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9c810616-9af6-4c10-9860-27d33b18170e tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:56.563660 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9c810616-9af6-4c10-9860-27d33b18170e tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:56.564312 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9c810616-9af6-4c10-9860-27d33b18170e tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:56.730784 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-9c810616-9af6-4c10-9860-27d33b18170e tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:56.755458 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-9c810616-9af6-4c10-9860-27d33b18170e tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:56.760643 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-9c810616-9af6-4c10-9860-27d33b18170e tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:56.763437 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-9c810616-9af6-4c10-9860-27d33b18170e tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] 10.222.0.43 "GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715" status: 200 len: 1604 microversion: 2.32 time: 0.229893 Oct 04 18:50:56.778822 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2046/4363] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:50:56 2022] GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715 => generated 1604 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:50:56.812253 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-ace3ec65-11a0-42f6-83dc-df813b231a02 tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:56.814262 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-ace3ec65-11a0-42f6-83dc-df813b231a02 tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] [instance: 8fc3c2f5-e86b-4bf0-a124-750ea71e52ad] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:56.828726 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ace3ec65-11a0-42f6-83dc-df813b231a02 tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:56.830219 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ace3ec65-11a0-42f6-83dc-df813b231a02 tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:56.834051 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ace3ec65-11a0-42f6-83dc-df813b231a02 tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:56.836126 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ace3ec65-11a0-42f6-83dc-df813b231a02 tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:56.839760 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ace3ec65-11a0-42f6-83dc-df813b231a02 tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:56.840985 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ace3ec65-11a0-42f6-83dc-df813b231a02 tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:56.895385 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:50:57.044472 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-4432cd0e-baf1-4f2a-a03d-09f3a7c98747 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:57.058248 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-4432cd0e-baf1-4f2a-a03d-09f3a7c98747 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] [instance: af90e409-4121-4169-b06b-814350b000ec] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:57.071633 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4432cd0e-baf1-4f2a-a03d-09f3a7c98747 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:57.072460 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4432cd0e-baf1-4f2a-a03d-09f3a7c98747 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:57.073368 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4432cd0e-baf1-4f2a-a03d-09f3a7c98747 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:57.074428 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4432cd0e-baf1-4f2a-a03d-09f3a7c98747 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:57.075662 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4432cd0e-baf1-4f2a-a03d-09f3a7c98747 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:57.076296 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4432cd0e-baf1-4f2a-a03d-09f3a7c98747 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:57.112900 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4432cd0e-baf1-4f2a-a03d-09f3a7c98747 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:57.113396 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4432cd0e-baf1-4f2a-a03d-09f3a7c98747 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:57.113942 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4432cd0e-baf1-4f2a-a03d-09f3a7c98747 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:57.114789 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.objects.instance [None req-4432cd0e-baf1-4f2a-a03d-09f3a7c98747 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lazy-loading 'fault' on Instance uuid af90e409-4121-4169-b06b-814350b000ec {{(pid=123595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:50:57.204306 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-4432cd0e-baf1-4f2a-a03d-09f3a7c98747 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14707008940e4965ab7d1190094a71bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8f94cf1c974654a336645f453c9efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:57.216944 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-4432cd0e-baf1-4f2a-a03d-09f3a7c98747 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] 10.222.0.43 "GET /compute/v2.1/servers/af90e409-4121-4169-b06b-814350b000ec" status: 200 len: 1299 microversion: 2.1 time: 0.184643 Oct 04 18:50:57.233142 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2047/4364] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:57 2022] GET /compute/v2.1/servers/af90e409-4121-4169-b06b-814350b000ec => generated 1299 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:57.307107 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-ace3ec65-11a0-42f6-83dc-df813b231a02 tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4b6ab960cd4f909975c9bb14d50480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40894812ff042979932773f36a70e0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:57.315680 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-ace3ec65-11a0-42f6-83dc-df813b231a02 tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] 10.222.0.43 "GET /compute/v2.1/servers/8fc3c2f5-e86b-4bf0-a124-750ea71e52ad" status: 200 len: 1370 microversion: 2.1 time: 0.508157 Oct 04 18:50:57.316583 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2318/4365] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:56 2022] GET /compute/v2.1/servers/8fc3c2f5-e86b-4bf0-a124-750ea71e52ad => generated 1370 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:57.792310 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-ccdda0ab-f552-49d8-839a-c3d1f0581916 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:57.792929 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-ccdda0ab-f552-49d8-839a-c3d1f0581916 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] [instance: fa47906d-d394-46fe-9143-780bcd27a715] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:57.801787 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ccdda0ab-f552-49d8-839a-c3d1f0581916 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:57.802521 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ccdda0ab-f552-49d8-839a-c3d1f0581916 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:57.803124 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ccdda0ab-f552-49d8-839a-c3d1f0581916 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:57.807129 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ccdda0ab-f552-49d8-839a-c3d1f0581916 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:57.807786 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ccdda0ab-f552-49d8-839a-c3d1f0581916 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:57.808434 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ccdda0ab-f552-49d8-839a-c3d1f0581916 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:58.053020 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-ccdda0ab-f552-49d8-839a-c3d1f0581916 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:58.063048 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-ccdda0ab-f552-49d8-839a-c3d1f0581916 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:58.075121 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-ccdda0ab-f552-49d8-839a-c3d1f0581916 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:58.076651 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-ccdda0ab-f552-49d8-839a-c3d1f0581916 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] 10.222.0.43 "GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715" status: 200 len: 1604 microversion: 2.32 time: 0.288434 Oct 04 18:50:58.077737 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2048/4366] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:50:57 2022] GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715 => generated 1604 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:50:58.243962 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-4f74c763-580a-4caf-ac15-19fdf41acefc tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:58.244584 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-4f74c763-580a-4caf-ac15-19fdf41acefc tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] [instance: af90e409-4121-4169-b06b-814350b000ec] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:58.263790 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4f74c763-580a-4caf-ac15-19fdf41acefc tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:58.264567 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4f74c763-580a-4caf-ac15-19fdf41acefc tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:58.265341 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4f74c763-580a-4caf-ac15-19fdf41acefc tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:58.266855 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4f74c763-580a-4caf-ac15-19fdf41acefc tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:58.267472 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4f74c763-580a-4caf-ac15-19fdf41acefc tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:58.268120 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4f74c763-580a-4caf-ac15-19fdf41acefc tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:58.290646 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-4f74c763-580a-4caf-ac15-19fdf41acefc tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] HTTP exception thrown: Instance af90e409-4121-4169-b06b-814350b000ec could not be found. Oct 04 18:50:58.296225 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-4f74c763-580a-4caf-ac15-19fdf41acefc tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Request method failure captured: Oct 04 18:50:58.296225 n-d-851028-13 devstack@n-api.service[123596]: request: GET /compute/v2.1/servers/af90e409-4121-4169-b06b-814350b000ec HTTP/1.1 Oct 04 18:50:58.296225 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:50:58.296225 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:50:58.296225 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:50:58.296225 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 18:50:58.296225 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:50:58.296225 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:50:58.296225 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:50:58.296225 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:50:58.296225 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPIAJxznq_dqRpKBeHYz_tTt-BPe6PGX8bXmZXSSSBar-nAl3_7gjSqUW3yyr2J4Kw1m1-l6Y2izmzOt3P0Lv3UhhGPTaACGzV6RGiSkRczLrMXORtXSdyVIiZq3MCL7L2uQGd29MwUZa7-C3NoIEqHwDxvVJi_WWjtFyKnOFEp1-BZ0 Oct 04 18:50:58.296225 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:50:58.296225 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:50:58.296225 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:50:58.296225 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:50:58.296225 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:50:58.296225 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:50:58.296225 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: ed8f94cf1c974654a336645f453c9efc Oct 04 18:50:58.296225 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-ServersTestJSON-546754383 Oct 04 18:50:58.296225 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 18:50:58.296225 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 18:50:58.296225 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/ed8f94cf1c974654a336645f453c9efc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_ed8f94cf1c974654a336645f453c9efc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ed8f94cf1c974654a336645f453c9efc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ed8f94cf1c974654a336645f453c9efc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:50:58.296225 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-ServersTestJSON-546754383 Oct 04 18:50:58.296225 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: ed8f94cf1c974654a336645f453c9efc Oct 04 18:50:58.296225 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-ServersTestJSON-546754383 Oct 04 18:50:58.296225 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-ServersTestJSON-546754383-project Oct 04 18:50:58.296225 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:50:58.296225 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:50:58.296225 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 14707008940e4965ab7d1190094a71bb Oct 04 18:50:58.296225 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-ServersTestJSON-546754383-project Oct 04 18:50:58.296225 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 18:50:58.296225 n-d-851028-13 devstack@n-api.service[123596]: exception: Instance af90e409-4121-4169-b06b-814350b000ec could not be found. Oct 04 18:50:58.296225 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': 'af90e409-4121-4169-b06b-814350b000ec'} Oct 04 18:50:58.296225 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:50:58.296225 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:50:58.296225 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:50:58.296225 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:50:58.296225 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:50:58.296225 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:50:58.296225 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:50:58.296225 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:50:58.296225 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:50:58.296225 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:50:58.296225 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af90e409-4121-4169-b06b-814350b000ec could not be found. Oct 04 18:50:58.296225 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:50:58.296225 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:50:58.296225 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:50:58.296225 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:50:58.296225 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:50:58.296225 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:50:58.296225 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:50:58.296225 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:50:58.296225 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:50:58.296225 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:50:58.296225 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:50:58.296225 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:50:58.296225 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:50:58.296225 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:50:58.296225 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:50:58.296225 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:50:58.296225 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af90e409-4121-4169-b06b-814350b000ec could not be found. Oct 04 18:50:58.296225 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:50:58.296225 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:50:58.296225 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:50:58.296225 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:50:58.302361 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:50:58.302361 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:50:58.302361 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:50:58.302361 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:50:58.302361 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af90e409-4121-4169-b06b-814350b000ec could not be found. Oct 04 18:50:58.302361 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:50:58.302361 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-4f74c763-580a-4caf-ac15-19fdf41acefc tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Returning 404 to user: Instance af90e409-4121-4169-b06b-814350b000ec could not be found. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:50:58.305913 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-4f74c763-580a-4caf-ac15-19fdf41acefc tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] 10.222.0.43 "GET /compute/v2.1/servers/af90e409-4121-4169-b06b-814350b000ec" status: 404 len: 111 microversion: 2.1 time: 0.065399 Oct 04 18:50:58.308533 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2319/4367] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:58 2022] GET /compute/v2.1/servers/af90e409-4121-4169-b06b-814350b000ec => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:50:58.339750 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-46a2192b-0598-4ab0-bb01-570ba27f64bf tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:58.340786 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-46a2192b-0598-4ab0-bb01-570ba27f64bf tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] [instance: 8fc3c2f5-e86b-4bf0-a124-750ea71e52ad] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:58.354976 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-46a2192b-0598-4ab0-bb01-570ba27f64bf tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:58.355870 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-46a2192b-0598-4ab0-bb01-570ba27f64bf tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:58.357773 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-46a2192b-0598-4ab0-bb01-570ba27f64bf tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:58.358837 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-46a2192b-0598-4ab0-bb01-570ba27f64bf tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:58.359592 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-46a2192b-0598-4ab0-bb01-570ba27f64bf tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:58.364429 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-46a2192b-0598-4ab0-bb01-570ba27f64bf tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:58.662391 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-9bb41f01-05ed-44ac-8955-b974cafa2559 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-429700629", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452", "networks": [{"uuid": "4a1417e9-f3af-46cb-a463-32dd1c79c4e9"}]}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:50:58.715173 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-46a2192b-0598-4ab0-bb01-570ba27f64bf tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4b6ab960cd4f909975c9bb14d50480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40894812ff042979932773f36a70e0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:58.724137 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-46a2192b-0598-4ab0-bb01-570ba27f64bf tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] 10.222.0.43 "GET /compute/v2.1/servers/8fc3c2f5-e86b-4bf0-a124-750ea71e52ad" status: 200 len: 1370 microversion: 2.1 time: 0.388413 Oct 04 18:50:58.725217 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2049/4368] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:58 2022] GET /compute/v2.1/servers/8fc3c2f5-e86b-4bf0-a124-750ea71e52ad => generated 1370 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:58.804618 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.network.neutron [None req-9bb41f01-05ed-44ac-8955-b974cafa2559 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] validate_networks() for [('4a1417e9-f3af-46cb-a463-32dd1c79c4e9', None, None, None, None, None)] {{(pid=123596) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:50:58.998620 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-64af322f-d5f1-4991-a4a1-664f9afd4b8e tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:58.999785 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-64af322f-d5f1-4991-a4a1-664f9afd4b8e tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] [instance: f2269817-3e15-4cfe-8446-7eb0104f9800] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:59.023968 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-64af322f-d5f1-4991-a4a1-664f9afd4b8e tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:59.025350 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-64af322f-d5f1-4991-a4a1-664f9afd4b8e tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:59.027403 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-64af322f-d5f1-4991-a4a1-664f9afd4b8e tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:59.030021 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-64af322f-d5f1-4991-a4a1-664f9afd4b8e tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:59.032388 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-64af322f-d5f1-4991-a4a1-664f9afd4b8e tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:59.033003 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-64af322f-d5f1-4991-a4a1-664f9afd4b8e tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:59.102607 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-64af322f-d5f1-4991-a4a1-664f9afd4b8e tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] 10.222.0.43 "GET /compute/v2.1/servers/f2269817-3e15-4cfe-8446-7eb0104f9800/os-volume_attachments/59c478b3-c3f0-4dfe-9626-329d4282afc6" status: 200 len: 194 microversion: 2.1 time: 0.117369 Oct 04 18:50:59.104036 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2050/4369] 10.222.0.43 () {58 vars in 1413 bytes} [Tue Oct 4 18:50:58 2022] GET /compute/v2.1/servers/f2269817-3e15-4cfe-8446-7eb0104f9800/os-volume_attachments/59c478b3-c3f0-4dfe-9626-329d4282afc6 => generated 194 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:50:59.110772 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-1ffb355b-c66e-4edc-a9d7-bdc0a2d347a6 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:59.113447 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-1ffb355b-c66e-4edc-a9d7-bdc0a2d347a6 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] [instance: fa47906d-d394-46fe-9143-780bcd27a715] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:59.120009 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1ffb355b-c66e-4edc-a9d7-bdc0a2d347a6 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:59.120746 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1ffb355b-c66e-4edc-a9d7-bdc0a2d347a6 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:59.123907 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1ffb355b-c66e-4edc-a9d7-bdc0a2d347a6 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:59.124861 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1ffb355b-c66e-4edc-a9d7-bdc0a2d347a6 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:59.127259 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1ffb355b-c66e-4edc-a9d7-bdc0a2d347a6 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:59.130296 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1ffb355b-c66e-4edc-a9d7-bdc0a2d347a6 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:59.262838 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-1ffb355b-c66e-4edc-a9d7-bdc0a2d347a6 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:59.277331 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-1ffb355b-c66e-4edc-a9d7-bdc0a2d347a6 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:59.279255 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-1ffb355b-c66e-4edc-a9d7-bdc0a2d347a6 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:59.282228 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-1ffb355b-c66e-4edc-a9d7-bdc0a2d347a6 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] 10.222.0.43 "GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715" status: 200 len: 1604 microversion: 2.32 time: 0.175750 Oct 04 18:50:59.294076 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2051/4370] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:50:59 2022] GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715 => generated 1604 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:50:59.307244 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-69b5aa15-9185-4f79-9d82-3510d6e4a741 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:59.307958 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-69b5aa15-9185-4f79-9d82-3510d6e4a741 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] [instance: f2269817-3e15-4cfe-8446-7eb0104f9800] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:59.318883 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-69b5aa15-9185-4f79-9d82-3510d6e4a741 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:59.319604 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-69b5aa15-9185-4f79-9d82-3510d6e4a741 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:59.321524 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-69b5aa15-9185-4f79-9d82-3510d6e4a741 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:59.322550 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-69b5aa15-9185-4f79-9d82-3510d6e4a741 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:59.325037 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-69b5aa15-9185-4f79-9d82-3510d6e4a741 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:59.325757 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-69b5aa15-9185-4f79-9d82-3510d6e4a741 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:59.370741 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=100 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:50:59.466883 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.objects.instance [None req-69b5aa15-9185-4f79-9d82-3510d6e4a741 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lazy-loading 'services' on Instance uuid f2269817-3e15-4cfe-8446-7eb0104f9800 {{(pid=123595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:50:59.578838 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-69b5aa15-9185-4f79-9d82-3510d6e4a741 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] 10.222.0.43 "DELETE /compute/v2.1/servers/f2269817-3e15-4cfe-8446-7eb0104f9800/os-volume_attachments/59c478b3-c3f0-4dfe-9626-329d4282afc6" status: 202 len: 0 microversion: 2.1 time: 0.282858 Oct 04 18:50:59.592283 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2052/4371] 10.222.0.43 () {58 vars in 1416 bytes} [Tue Oct 4 18:50:59 2022] DELETE /compute/v2.1/servers/f2269817-3e15-4cfe-8446-7eb0104f9800/os-volume_attachments/59c478b3-c3f0-4dfe-9626-329d4282afc6 => generated 0 bytes in 297 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:50:59.761184 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-dfb059c7-7761-4746-955d-f3df2b1784fa tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:59.762777 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-dfb059c7-7761-4746-955d-f3df2b1784fa tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] [instance: 8fc3c2f5-e86b-4bf0-a124-750ea71e52ad] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:59.774703 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dfb059c7-7761-4746-955d-f3df2b1784fa tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:59.777564 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dfb059c7-7761-4746-955d-f3df2b1784fa tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:59.778051 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dfb059c7-7761-4746-955d-f3df2b1784fa tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:59.778975 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dfb059c7-7761-4746-955d-f3df2b1784fa tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:59.780076 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dfb059c7-7761-4746-955d-f3df2b1784fa tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:59.780524 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dfb059c7-7761-4746-955d-f3df2b1784fa tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:59.787115 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-9bb41f01-05ed-44ac-8955-b974cafa2559 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Flavor limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:50:59.788113 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-9bb41f01-05ed-44ac-8955-b974cafa2559 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Image limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:50:59.788750 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-9bb41f01-05ed-44ac-8955-b974cafa2559 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Flavor pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:50:59.789583 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-9bb41f01-05ed-44ac-8955-b974cafa2559 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Image pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:50:59.790159 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-9bb41f01-05ed-44ac-8955-b974cafa2559 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:50:59.811575 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9bb41f01-05ed-44ac-8955-b974cafa2559 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:59.812246 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9bb41f01-05ed-44ac-8955-b974cafa2559 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:59.813289 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9bb41f01-05ed-44ac-8955-b974cafa2559 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:59.814216 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9bb41f01-05ed-44ac-8955-b974cafa2559 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:59.814829 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9bb41f01-05ed-44ac-8955-b974cafa2559 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:59.815691 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9bb41f01-05ed-44ac-8955-b974cafa2559 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:59.862894 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-9bb41f01-05ed-44ac-8955-b974cafa2559 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Getting quotas for project ed8f94cf1c974654a336645f453c9efc. Resources: {'ram', 'cores', 'instances'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:50:59.875492 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-9bb41f01-05ed-44ac-8955-b974cafa2559 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Getting quotas for user 14707008940e4965ab7d1190094a71bb and project ed8f94cf1c974654a336645f453c9efc. Resources: {'ram', 'cores', 'instances'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:50:59.905096 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-9bb41f01-05ed-44ac-8955-b974cafa2559 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Going to run 1 instances... {{(pid=123596) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:50:59.909283 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-9bb41f01-05ed-44ac-8955-b974cafa2559 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] [instance: 379687e5-a142-4246-be27-d5df590c2cc8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e8943ec5-4038-4d4b-b9b9-2415a79f5243',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123596) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:51:00.008610 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-9bb41f01-05ed-44ac-8955-b974cafa2559 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.349966 Oct 04 18:51:00.009200 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2320/4372] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 18:50:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 1351 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:51:00.021620 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-e3105e77-1b03-44bf-b83e-f33fd54b1414 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:00.032972 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-e3105e77-1b03-44bf-b83e-f33fd54b1414 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] [instance: 379687e5-a142-4246-be27-d5df590c2cc8] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:00.176994 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-e3105e77-1b03-44bf-b83e-f33fd54b1414 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14707008940e4965ab7d1190094a71bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8f94cf1c974654a336645f453c9efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:00.186825 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-e3105e77-1b03-44bf-b83e-f33fd54b1414 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] 10.222.0.43 "GET /compute/v2.1/servers/379687e5-a142-4246-be27-d5df590c2cc8" status: 200 len: 1208 microversion: 2.1 time: 0.167592 Oct 04 18:51:00.189623 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2321/4373] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:00 2022] GET /compute/v2.1/servers/379687e5-a142-4246-be27-d5df590c2cc8 => generated 1208 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:00.324496 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-2be2aafe-364c-4578-a098-7cd61085f0f0 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:00.325397 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-2be2aafe-364c-4578-a098-7cd61085f0f0 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] [instance: fa47906d-d394-46fe-9143-780bcd27a715] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:00.342954 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2be2aafe-364c-4578-a098-7cd61085f0f0 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:00.343459 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2be2aafe-364c-4578-a098-7cd61085f0f0 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:00.343975 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2be2aafe-364c-4578-a098-7cd61085f0f0 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:00.344699 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2be2aafe-364c-4578-a098-7cd61085f0f0 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:00.355970 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2be2aafe-364c-4578-a098-7cd61085f0f0 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:00.356634 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2be2aafe-364c-4578-a098-7cd61085f0f0 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:00.602213 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-2be2aafe-364c-4578-a098-7cd61085f0f0 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:00.616157 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-2be2aafe-364c-4578-a098-7cd61085f0f0 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:00.618122 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-2be2aafe-364c-4578-a098-7cd61085f0f0 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:00.620149 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-2be2aafe-364c-4578-a098-7cd61085f0f0 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] 10.222.0.43 "GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715" status: 200 len: 1604 microversion: 2.32 time: 0.299683 Oct 04 18:51:00.621348 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2322/4374] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:51:00 2022] GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715 => generated 1604 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:51:01.097047 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-dfb059c7-7761-4746-955d-f3df2b1784fa tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4b6ab960cd4f909975c9bb14d50480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40894812ff042979932773f36a70e0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:01.113227 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-dfb059c7-7761-4746-955d-f3df2b1784fa tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] 10.222.0.43 "GET /compute/v2.1/servers/8fc3c2f5-e86b-4bf0-a124-750ea71e52ad" status: 200 len: 1370 microversion: 2.1 time: 1.360994 Oct 04 18:51:01.116956 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2053/4375] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:59 2022] GET /compute/v2.1/servers/8fc3c2f5-e86b-4bf0-a124-750ea71e52ad => generated 1370 bytes in 1370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:01.216362 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-0a0aaa98-ed81-43b6-8dd6-50b03c70ceaf tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:01.217355 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-0a0aaa98-ed81-43b6-8dd6-50b03c70ceaf tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] [instance: 379687e5-a142-4246-be27-d5df590c2cc8] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:01.232439 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0a0aaa98-ed81-43b6-8dd6-50b03c70ceaf tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:01.234157 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0a0aaa98-ed81-43b6-8dd6-50b03c70ceaf tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:01.237542 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0a0aaa98-ed81-43b6-8dd6-50b03c70ceaf tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:01.239516 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0a0aaa98-ed81-43b6-8dd6-50b03c70ceaf tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:01.239998 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0a0aaa98-ed81-43b6-8dd6-50b03c70ceaf tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:01.240469 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0a0aaa98-ed81-43b6-8dd6-50b03c70ceaf tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:01.409653 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-0a0aaa98-ed81-43b6-8dd6-50b03c70ceaf tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14707008940e4965ab7d1190094a71bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8f94cf1c974654a336645f453c9efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:01.418094 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-0a0aaa98-ed81-43b6-8dd6-50b03c70ceaf tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] 10.222.0.43 "GET /compute/v2.1/servers/379687e5-a142-4246-be27-d5df590c2cc8" status: 200 len: 1260 microversion: 2.1 time: 0.205719 Oct 04 18:51:01.418707 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2323/4376] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:01 2022] GET /compute/v2.1/servers/379687e5-a142-4246-be27-d5df590c2cc8 => generated 1260 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:01.653360 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-2fb14ce6-a246-4598-b1f2-ca0ccf6223f0 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:01.653997 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-2fb14ce6-a246-4598-b1f2-ca0ccf6223f0 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] [instance: fa47906d-d394-46fe-9143-780bcd27a715] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:01.670184 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2fb14ce6-a246-4598-b1f2-ca0ccf6223f0 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:01.670723 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2fb14ce6-a246-4598-b1f2-ca0ccf6223f0 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:01.671190 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2fb14ce6-a246-4598-b1f2-ca0ccf6223f0 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:01.671948 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2fb14ce6-a246-4598-b1f2-ca0ccf6223f0 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:01.672950 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2fb14ce6-a246-4598-b1f2-ca0ccf6223f0 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:01.673422 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2fb14ce6-a246-4598-b1f2-ca0ccf6223f0 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:01.943049 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-b50ab696-4a8e-437f-88d7-054635e597d4 req-bca68cf1-b4a5-4fca-8ba0-55784cbfcc91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8fc3c2f5-e86b-4bf0-a124-750ea71e52ad", "name": "network-vif-plugged", "status": "completed", "tag": "bba2bab2-98c7-4a75-ba9c-9c2578699fcc"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:51:01.967007 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-b50ab696-4a8e-437f-88d7-054635e597d4 req-bca68cf1-b4a5-4fca-8ba0-55784cbfcc91 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:01.967786 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-b50ab696-4a8e-437f-88d7-054635e597d4 req-bca68cf1-b4a5-4fca-8ba0-55784cbfcc91 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:01.968370 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-b50ab696-4a8e-437f-88d7-054635e597d4 req-bca68cf1-b4a5-4fca-8ba0-55784cbfcc91 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:01.995158 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-b50ab696-4a8e-437f-88d7-054635e597d4 req-bca68cf1-b4a5-4fca-8ba0-55784cbfcc91 service nova] Creating event network-vif-plugged:bba2bab2-98c7-4a75-ba9c-9c2578699fcc for instance 8fc3c2f5-e86b-4bf0-a124-750ea71e52ad on n-h2-851028-13 Oct 04 18:51:02.012838 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-b50ab696-4a8e-437f-88d7-054635e597d4 req-bca68cf1-b4a5-4fca-8ba0-55784cbfcc91 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072667 Oct 04 18:51:02.014331 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2324/4377] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:51:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:51:02.043937 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-2fb14ce6-a246-4598-b1f2-ca0ccf6223f0 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:02.064415 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-2fb14ce6-a246-4598-b1f2-ca0ccf6223f0 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:02.068345 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-2fb14ce6-a246-4598-b1f2-ca0ccf6223f0 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:02.073323 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-2fb14ce6-a246-4598-b1f2-ca0ccf6223f0 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] 10.222.0.43 "GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715" status: 200 len: 1604 microversion: 2.32 time: 0.427406 Oct 04 18:51:02.078874 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2054/4378] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:51:01 2022] GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715 => generated 1604 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:51:02.138535 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-72f1f836-1ca1-4f71-a74f-0d1e7b6b3013 tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:02.139238 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-72f1f836-1ca1-4f71-a74f-0d1e7b6b3013 tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] [instance: 8fc3c2f5-e86b-4bf0-a124-750ea71e52ad] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:02.148325 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-72f1f836-1ca1-4f71-a74f-0d1e7b6b3013 tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:02.148813 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-72f1f836-1ca1-4f71-a74f-0d1e7b6b3013 tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:02.155672 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-72f1f836-1ca1-4f71-a74f-0d1e7b6b3013 tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:02.157379 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-72f1f836-1ca1-4f71-a74f-0d1e7b6b3013 tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:02.157861 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-72f1f836-1ca1-4f71-a74f-0d1e7b6b3013 tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:02.158321 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-72f1f836-1ca1-4f71-a74f-0d1e7b6b3013 tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:02.445177 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-77c2157e-a484-41d1-b16d-f217d7603267 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:02.445797 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-77c2157e-a484-41d1-b16d-f217d7603267 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] [instance: 379687e5-a142-4246-be27-d5df590c2cc8] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:02.453399 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-72f1f836-1ca1-4f71-a74f-0d1e7b6b3013 tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4b6ab960cd4f909975c9bb14d50480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40894812ff042979932773f36a70e0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:02.456944 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-77c2157e-a484-41d1-b16d-f217d7603267 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:02.457500 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-77c2157e-a484-41d1-b16d-f217d7603267 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:02.457952 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-77c2157e-a484-41d1-b16d-f217d7603267 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:02.458669 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-77c2157e-a484-41d1-b16d-f217d7603267 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:02.459124 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-77c2157e-a484-41d1-b16d-f217d7603267 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:02.459549 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-77c2157e-a484-41d1-b16d-f217d7603267 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:02.462656 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-72f1f836-1ca1-4f71-a74f-0d1e7b6b3013 tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] 10.222.0.43 "GET /compute/v2.1/servers/8fc3c2f5-e86b-4bf0-a124-750ea71e52ad" status: 200 len: 1370 microversion: 2.1 time: 0.328320 Oct 04 18:51:02.469256 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2325/4379] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:02 2022] GET /compute/v2.1/servers/8fc3c2f5-e86b-4bf0-a124-750ea71e52ad => generated 1370 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:02.651289 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-77c2157e-a484-41d1-b16d-f217d7603267 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14707008940e4965ab7d1190094a71bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8f94cf1c974654a336645f453c9efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:02.665814 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-77c2157e-a484-41d1-b16d-f217d7603267 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] 10.222.0.43 "GET /compute/v2.1/servers/379687e5-a142-4246-be27-d5df590c2cc8" status: 200 len: 1266 microversion: 2.1 time: 0.224380 Oct 04 18:51:02.666408 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2055/4380] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:02 2022] GET /compute/v2.1/servers/379687e5-a142-4246-be27-d5df590c2cc8 => generated 1266 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:03.108006 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-307b116a-d6cd-4efe-ae0c-c956940b5a88 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:03.108628 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-307b116a-d6cd-4efe-ae0c-c956940b5a88 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] [instance: fa47906d-d394-46fe-9143-780bcd27a715] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:03.121800 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-307b116a-d6cd-4efe-ae0c-c956940b5a88 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:03.124829 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-307b116a-d6cd-4efe-ae0c-c956940b5a88 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:03.125348 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-307b116a-d6cd-4efe-ae0c-c956940b5a88 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:03.128726 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-307b116a-d6cd-4efe-ae0c-c956940b5a88 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:03.129229 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-307b116a-d6cd-4efe-ae0c-c956940b5a88 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:03.129669 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-307b116a-d6cd-4efe-ae0c-c956940b5a88 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:03.248617 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-307b116a-d6cd-4efe-ae0c-c956940b5a88 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:03.265003 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-307b116a-d6cd-4efe-ae0c-c956940b5a88 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:03.267323 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-307b116a-d6cd-4efe-ae0c-c956940b5a88 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:03.272804 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-307b116a-d6cd-4efe-ae0c-c956940b5a88 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] 10.222.0.43 "GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715" status: 200 len: 1604 microversion: 2.32 time: 0.170141 Oct 04 18:51:03.273796 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2326/4381] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:51:03 2022] GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715 => generated 1604 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:51:03.491779 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-ecc70d95-0e45-4e50-a36b-29534b690388 tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:03.492407 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-ecc70d95-0e45-4e50-a36b-29534b690388 tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] [instance: 8fc3c2f5-e86b-4bf0-a124-750ea71e52ad] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:03.506083 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ecc70d95-0e45-4e50-a36b-29534b690388 tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:03.506586 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ecc70d95-0e45-4e50-a36b-29534b690388 tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:03.507044 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ecc70d95-0e45-4e50-a36b-29534b690388 tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:03.507765 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ecc70d95-0e45-4e50-a36b-29534b690388 tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:03.508233 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ecc70d95-0e45-4e50-a36b-29534b690388 tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:03.508674 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ecc70d95-0e45-4e50-a36b-29534b690388 tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:03.712607 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-44707d5a-da5a-45cd-8dc0-eb5a932e143a tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:03.714173 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-44707d5a-da5a-45cd-8dc0-eb5a932e143a tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] [instance: 379687e5-a142-4246-be27-d5df590c2cc8] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:03.725437 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-44707d5a-da5a-45cd-8dc0-eb5a932e143a tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:03.729375 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-44707d5a-da5a-45cd-8dc0-eb5a932e143a tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:03.730279 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-44707d5a-da5a-45cd-8dc0-eb5a932e143a tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:03.731193 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-44707d5a-da5a-45cd-8dc0-eb5a932e143a tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:03.731957 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-44707d5a-da5a-45cd-8dc0-eb5a932e143a tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:03.732549 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-44707d5a-da5a-45cd-8dc0-eb5a932e143a tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:04.031925 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-44707d5a-da5a-45cd-8dc0-eb5a932e143a tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14707008940e4965ab7d1190094a71bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8f94cf1c974654a336645f453c9efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:04.044952 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-44707d5a-da5a-45cd-8dc0-eb5a932e143a tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] 10.222.0.43 "GET /compute/v2.1/servers/379687e5-a142-4246-be27-d5df590c2cc8" status: 200 len: 1266 microversion: 2.1 time: 0.342584 Oct 04 18:51:04.046068 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2327/4382] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:03 2022] GET /compute/v2.1/servers/379687e5-a142-4246-be27-d5df590c2cc8 => generated 1266 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:04.238178 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-ecc70d95-0e45-4e50-a36b-29534b690388 tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4b6ab960cd4f909975c9bb14d50480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40894812ff042979932773f36a70e0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:04.251554 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-ecc70d95-0e45-4e50-a36b-29534b690388 tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] 10.222.0.43 "GET /compute/v2.1/servers/8fc3c2f5-e86b-4bf0-a124-750ea71e52ad" status: 200 len: 1370 microversion: 2.1 time: 0.761626 Oct 04 18:51:04.253525 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2056/4383] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:03 2022] GET /compute/v2.1/servers/8fc3c2f5-e86b-4bf0-a124-750ea71e52ad => generated 1370 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:04.299850 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-872f6131-03b8-4be6-b940-05df7c72f962 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:04.300565 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-872f6131-03b8-4be6-b940-05df7c72f962 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] [instance: fa47906d-d394-46fe-9143-780bcd27a715] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:04.307933 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-872f6131-03b8-4be6-b940-05df7c72f962 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:04.310778 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-872f6131-03b8-4be6-b940-05df7c72f962 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:04.313319 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-872f6131-03b8-4be6-b940-05df7c72f962 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:04.316460 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-872f6131-03b8-4be6-b940-05df7c72f962 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:04.329953 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-872f6131-03b8-4be6-b940-05df7c72f962 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:04.330718 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-872f6131-03b8-4be6-b940-05df7c72f962 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:04.435916 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-872f6131-03b8-4be6-b940-05df7c72f962 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:04.458168 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-872f6131-03b8-4be6-b940-05df7c72f962 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:04.460013 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-872f6131-03b8-4be6-b940-05df7c72f962 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:04.465783 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-872f6131-03b8-4be6-b940-05df7c72f962 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] 10.222.0.43 "GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715" status: 200 len: 1604 microversion: 2.32 time: 0.166234 Oct 04 18:51:04.467622 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2328/4384] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:51:04 2022] GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715 => generated 1604 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:51:05.085477 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-3d46d257-50bf-45c8-b94c-ccff1518d788 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:05.086157 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-3d46d257-50bf-45c8-b94c-ccff1518d788 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] [instance: 379687e5-a142-4246-be27-d5df590c2cc8] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:05.100460 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3d46d257-50bf-45c8-b94c-ccff1518d788 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:05.119808 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3d46d257-50bf-45c8-b94c-ccff1518d788 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:05.120797 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3d46d257-50bf-45c8-b94c-ccff1518d788 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:05.122093 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3d46d257-50bf-45c8-b94c-ccff1518d788 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:05.122744 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3d46d257-50bf-45c8-b94c-ccff1518d788 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:05.123345 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3d46d257-50bf-45c8-b94c-ccff1518d788 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:05.275776 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-19a46de4-72b6-48b3-997e-6ae219764316 tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:05.276396 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-19a46de4-72b6-48b3-997e-6ae219764316 tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] [instance: 8fc3c2f5-e86b-4bf0-a124-750ea71e52ad] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:05.292918 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-19a46de4-72b6-48b3-997e-6ae219764316 tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:05.293378 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-19a46de4-72b6-48b3-997e-6ae219764316 tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:05.293816 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-19a46de4-72b6-48b3-997e-6ae219764316 tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:05.294530 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-19a46de4-72b6-48b3-997e-6ae219764316 tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:05.295917 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-19a46de4-72b6-48b3-997e-6ae219764316 tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:05.296367 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-19a46de4-72b6-48b3-997e-6ae219764316 tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:05.686697 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-19a46de4-72b6-48b3-997e-6ae219764316 tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4b6ab960cd4f909975c9bb14d50480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40894812ff042979932773f36a70e0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:05.699021 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-19a46de4-72b6-48b3-997e-6ae219764316 tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] 10.222.0.43 "GET /compute/v2.1/servers/8fc3c2f5-e86b-4bf0-a124-750ea71e52ad" status: 200 len: 1557 microversion: 2.1 time: 0.427009 Oct 04 18:51:05.701743 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2329/4385] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:05 2022] GET /compute/v2.1/servers/8fc3c2f5-e86b-4bf0-a124-750ea71e52ad => generated 1557 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:51:05.725303 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-a41327f4-c49c-4480-a3d7-f251fd5f8992 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:05.725936 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-a41327f4-c49c-4480-a3d7-f251fd5f8992 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] [instance: fa47906d-d394-46fe-9143-780bcd27a715] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:05.733168 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a41327f4-c49c-4480-a3d7-f251fd5f8992 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:05.734346 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a41327f4-c49c-4480-a3d7-f251fd5f8992 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:05.735048 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a41327f4-c49c-4480-a3d7-f251fd5f8992 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:05.736611 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a41327f4-c49c-4480-a3d7-f251fd5f8992 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:05.737385 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a41327f4-c49c-4480-a3d7-f251fd5f8992 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:05.737969 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a41327f4-c49c-4480-a3d7-f251fd5f8992 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:06.326449 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-3d46d257-50bf-45c8-b94c-ccff1518d788 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14707008940e4965ab7d1190094a71bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8f94cf1c974654a336645f453c9efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:06.334970 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-3d46d257-50bf-45c8-b94c-ccff1518d788 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] 10.222.0.43 "GET /compute/v2.1/servers/379687e5-a142-4246-be27-d5df590c2cc8" status: 200 len: 1308 microversion: 2.1 time: 1.262494 Oct 04 18:51:06.335565 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2057/4386] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:05 2022] GET /compute/v2.1/servers/379687e5-a142-4246-be27-d5df590c2cc8 => generated 1308 bytes in 1264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:06.342580 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-a41327f4-c49c-4480-a3d7-f251fd5f8992 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:06.356721 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-a41327f4-c49c-4480-a3d7-f251fd5f8992 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:06.356957 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-8e705c24-ab78-4301-b10d-f0eafd700e6b tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:06.357534 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-8e705c24-ab78-4301-b10d-f0eafd700e6b tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] [instance: 8fc3c2f5-e86b-4bf0-a124-750ea71e52ad] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:06.363615 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-a41327f4-c49c-4480-a3d7-f251fd5f8992 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:06.365011 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-a41327f4-c49c-4480-a3d7-f251fd5f8992 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] 10.222.0.43 "GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715" status: 200 len: 1604 microversion: 2.32 time: 0.650262 Oct 04 18:51:06.368971 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2330/4387] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:51:05 2022] GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715 => generated 1604 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:51:06.374238 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8e705c24-ab78-4301-b10d-f0eafd700e6b tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:06.374938 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8e705c24-ab78-4301-b10d-f0eafd700e6b tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:06.375566 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8e705c24-ab78-4301-b10d-f0eafd700e6b tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:06.377011 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8e705c24-ab78-4301-b10d-f0eafd700e6b tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:06.377673 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8e705c24-ab78-4301-b10d-f0eafd700e6b tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:06.378279 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8e705c24-ab78-4301-b10d-f0eafd700e6b tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:06.520872 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-8e705c24-ab78-4301-b10d-f0eafd700e6b tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] 10.222.0.43 "GET /compute/v2.1/servers/8fc3c2f5-e86b-4bf0-a124-750ea71e52ad/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.171368 Oct 04 18:51:06.522517 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2058/4388] 10.222.0.43 () {58 vars in 1275 bytes} [Tue Oct 4 18:51:06 2022] GET /compute/v2.1/servers/8fc3c2f5-e86b-4bf0-a124-750ea71e52ad/os-interface => generated 285 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:51:07.364373 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-30b65edc-cef1-4c0f-98b6-6e53af8f9733 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:07.368811 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-30b65edc-cef1-4c0f-98b6-6e53af8f9733 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] [instance: 379687e5-a142-4246-be27-d5df590c2cc8] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:07.385585 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-30b65edc-cef1-4c0f-98b6-6e53af8f9733 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:07.387107 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-30b65edc-cef1-4c0f-98b6-6e53af8f9733 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:07.388354 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-30b65edc-cef1-4c0f-98b6-6e53af8f9733 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:07.390332 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-30b65edc-cef1-4c0f-98b6-6e53af8f9733 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:07.391551 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-30b65edc-cef1-4c0f-98b6-6e53af8f9733 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:07.392723 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-30b65edc-cef1-4c0f-98b6-6e53af8f9733 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:07.403471 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-11037892-9df0-4763-ab24-963882783852 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:07.405619 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-11037892-9df0-4763-ab24-963882783852 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] [instance: fa47906d-d394-46fe-9143-780bcd27a715] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:07.413964 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-11037892-9df0-4763-ab24-963882783852 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:07.414727 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-11037892-9df0-4763-ab24-963882783852 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:07.415334 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-11037892-9df0-4763-ab24-963882783852 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:07.416612 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-11037892-9df0-4763-ab24-963882783852 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:07.417547 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-11037892-9df0-4763-ab24-963882783852 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:07.418206 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-11037892-9df0-4763-ab24-963882783852 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:07.592363 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-11037892-9df0-4763-ab24-963882783852 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:07.608101 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-11037892-9df0-4763-ab24-963882783852 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:07.609701 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-11037892-9df0-4763-ab24-963882783852 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:07.613545 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-11037892-9df0-4763-ab24-963882783852 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] 10.222.0.43 "GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715" status: 200 len: 1604 microversion: 2.32 time: 0.214746 Oct 04 18:51:07.617823 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2059/4389] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:51:07 2022] GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715 => generated 1604 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:51:07.655173 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-30b65edc-cef1-4c0f-98b6-6e53af8f9733 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14707008940e4965ab7d1190094a71bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8f94cf1c974654a336645f453c9efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:07.664544 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-30b65edc-cef1-4c0f-98b6-6e53af8f9733 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] 10.222.0.43 "GET /compute/v2.1/servers/379687e5-a142-4246-be27-d5df590c2cc8" status: 200 len: 1308 microversion: 2.1 time: 0.307091 Oct 04 18:51:07.669077 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2331/4390] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:07 2022] GET /compute/v2.1/servers/379687e5-a142-4246-be27-d5df590c2cc8 => generated 1308 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:08.037455 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-c478298c-4c57-4ef1-bf9d-3c8b67fa47f5 req-a4633291-b0ba-417f-8065-e4b5538f6f3c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "379687e5-a142-4246-be27-d5df590c2cc8", "tag": "28f1b173-5077-430a-a20e-4c37d7becbfa"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:51:08.050918 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-c478298c-4c57-4ef1-bf9d-3c8b67fa47f5 req-a4633291-b0ba-417f-8065-e4b5538f6f3c service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:08.051969 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-c478298c-4c57-4ef1-bf9d-3c8b67fa47f5 req-a4633291-b0ba-417f-8065-e4b5538f6f3c service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:08.052576 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-c478298c-4c57-4ef1-bf9d-3c8b67fa47f5 req-a4633291-b0ba-417f-8065-e4b5538f6f3c service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:08.070125 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-c478298c-4c57-4ef1-bf9d-3c8b67fa47f5 req-a4633291-b0ba-417f-8065-e4b5538f6f3c service nova] Creating event network-changed:28f1b173-5077-430a-a20e-4c37d7becbfa for instance 379687e5-a142-4246-be27-d5df590c2cc8 on n-h1-851028-13 Oct 04 18:51:08.078093 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-c478298c-4c57-4ef1-bf9d-3c8b67fa47f5 req-a4633291-b0ba-417f-8065-e4b5538f6f3c service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047121 Oct 04 18:51:08.079482 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2060/4391] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:51:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:51:08.649034 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-de17ea18-0c3a-4bdf-8dfc-7be0f7ae0e81 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:08.650287 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-de17ea18-0c3a-4bdf-8dfc-7be0f7ae0e81 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] [instance: fa47906d-d394-46fe-9143-780bcd27a715] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:08.659501 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-de17ea18-0c3a-4bdf-8dfc-7be0f7ae0e81 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:08.660259 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-de17ea18-0c3a-4bdf-8dfc-7be0f7ae0e81 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:08.660865 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-de17ea18-0c3a-4bdf-8dfc-7be0f7ae0e81 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:08.661790 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-de17ea18-0c3a-4bdf-8dfc-7be0f7ae0e81 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:08.662575 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-de17ea18-0c3a-4bdf-8dfc-7be0f7ae0e81 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:08.663357 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-de17ea18-0c3a-4bdf-8dfc-7be0f7ae0e81 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:08.704337 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-3a21c49b-1852-47cd-a804-00e44120992b tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:08.705916 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-3a21c49b-1852-47cd-a804-00e44120992b tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] [instance: 379687e5-a142-4246-be27-d5df590c2cc8] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:08.719190 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3a21c49b-1852-47cd-a804-00e44120992b tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:08.722281 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3a21c49b-1852-47cd-a804-00e44120992b tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:08.722993 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3a21c49b-1852-47cd-a804-00e44120992b tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:08.723804 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3a21c49b-1852-47cd-a804-00e44120992b tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:08.724479 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3a21c49b-1852-47cd-a804-00e44120992b tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:08.725721 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3a21c49b-1852-47cd-a804-00e44120992b tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:08.825414 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-de17ea18-0c3a-4bdf-8dfc-7be0f7ae0e81 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:08.854499 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-de17ea18-0c3a-4bdf-8dfc-7be0f7ae0e81 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:08.859778 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-de17ea18-0c3a-4bdf-8dfc-7be0f7ae0e81 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:08.862212 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-de17ea18-0c3a-4bdf-8dfc-7be0f7ae0e81 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] 10.222.0.43 "GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715" status: 200 len: 1604 microversion: 2.32 time: 0.216990 Oct 04 18:51:08.863368 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2332/4392] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:51:08 2022] GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715 => generated 1604 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:51:09.757491 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-3a21c49b-1852-47cd-a804-00e44120992b tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14707008940e4965ab7d1190094a71bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8f94cf1c974654a336645f453c9efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:09.782862 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-3a21c49b-1852-47cd-a804-00e44120992b tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] 10.222.0.43 "GET /compute/v2.1/servers/379687e5-a142-4246-be27-d5df590c2cc8" status: 200 len: 1308 microversion: 2.1 time: 1.082450 Oct 04 18:51:09.800322 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2061/4393] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:08 2022] GET /compute/v2.1/servers/379687e5-a142-4246-be27-d5df590c2cc8 => generated 1308 bytes in 1102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:09.895588 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-04e778f4-a1e2-4de2-96d9-c873f75e218e tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:09.896788 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-04e778f4-a1e2-4de2-96d9-c873f75e218e tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] [instance: fa47906d-d394-46fe-9143-780bcd27a715] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:09.908205 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=2 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:51:09.952016 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-04e778f4-a1e2-4de2-96d9-c873f75e218e tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:09.954359 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-04e778f4-a1e2-4de2-96d9-c873f75e218e tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:09.955582 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-04e778f4-a1e2-4de2-96d9-c873f75e218e tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:09.957878 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-04e778f4-a1e2-4de2-96d9-c873f75e218e tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:09.959199 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-04e778f4-a1e2-4de2-96d9-c873f75e218e tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:09.960365 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-04e778f4-a1e2-4de2-96d9-c873f75e218e tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:10.118160 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-04e778f4-a1e2-4de2-96d9-c873f75e218e tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:10.133957 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-04e778f4-a1e2-4de2-96d9-c873f75e218e tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:10.142784 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-04e778f4-a1e2-4de2-96d9-c873f75e218e tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:10.150080 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-04e778f4-a1e2-4de2-96d9-c873f75e218e tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] 10.222.0.43 "GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715" status: 200 len: 1604 microversion: 2.32 time: 0.254620 Oct 04 18:51:10.162424 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2333/4394] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:51:09 2022] GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715 => generated 1604 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:51:10.338648 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=8 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:51:10.346039 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-0e1dc4a0-326e-4434-8281-3fb58806b098 req-dba6d37d-7ad7-4c41-8cd0-a811c93e143f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8fc3c2f5-e86b-4bf0-a124-750ea71e52ad", "tag": "bba2bab2-98c7-4a75-ba9c-9c2578699fcc"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:51:10.375849 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-0e1dc4a0-326e-4434-8281-3fb58806b098 req-dba6d37d-7ad7-4c41-8cd0-a811c93e143f service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:10.379521 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-0e1dc4a0-326e-4434-8281-3fb58806b098 req-dba6d37d-7ad7-4c41-8cd0-a811c93e143f service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:10.380085 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-0e1dc4a0-326e-4434-8281-3fb58806b098 req-dba6d37d-7ad7-4c41-8cd0-a811c93e143f service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:10.413884 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-0e1dc4a0-326e-4434-8281-3fb58806b098 req-dba6d37d-7ad7-4c41-8cd0-a811c93e143f service nova] Creating event network-changed:bba2bab2-98c7-4a75-ba9c-9c2578699fcc for instance 8fc3c2f5-e86b-4bf0-a124-750ea71e52ad on n-h2-851028-13 Oct 04 18:51:10.428195 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-0e1dc4a0-326e-4434-8281-3fb58806b098 req-dba6d37d-7ad7-4c41-8cd0-a811c93e143f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086154 Oct 04 18:51:10.428859 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2334/4395] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:51:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Oct 04 18:51:10.576349 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-eae8d96a-30a4-4932-acd5-30f562f1ce99 tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-2106471423", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452", "networks": [{"uuid": "446ae950-9eec-4d7a-a387-f6a4ad38d6c8"}]}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:51:10.663309 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.network.neutron [None req-eae8d96a-30a4-4932-acd5-30f562f1ce99 tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] validate_networks() for [('446ae950-9eec-4d7a-a387-f6a4ad38d6c8', None, None, None, None, None)] {{(pid=123595) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:51:10.813494 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-cabbbf09-977b-4b81-834e-6852467b0171 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:10.816218 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-cabbbf09-977b-4b81-834e-6852467b0171 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] [instance: 379687e5-a142-4246-be27-d5df590c2cc8] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:10.828362 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cabbbf09-977b-4b81-834e-6852467b0171 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:10.835448 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cabbbf09-977b-4b81-834e-6852467b0171 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:10.841553 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cabbbf09-977b-4b81-834e-6852467b0171 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:10.842955 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cabbbf09-977b-4b81-834e-6852467b0171 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:10.843436 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cabbbf09-977b-4b81-834e-6852467b0171 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:10.844028 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cabbbf09-977b-4b81-834e-6852467b0171 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:11.708008 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-cabbbf09-977b-4b81-834e-6852467b0171 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14707008940e4965ab7d1190094a71bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8f94cf1c974654a336645f453c9efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:11.717565 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-cabbbf09-977b-4b81-834e-6852467b0171 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] 10.222.0.43 "GET /compute/v2.1/servers/379687e5-a142-4246-be27-d5df590c2cc8" status: 200 len: 1308 microversion: 2.1 time: 0.908490 Oct 04 18:51:11.718370 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2335/4396] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:10 2022] GET /compute/v2.1/servers/379687e5-a142-4246-be27-d5df590c2cc8 => generated 1308 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:11.739361 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-c142c0e1-b6aa-42f2-87d5-7fae429948e3 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:11.746288 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-c142c0e1-b6aa-42f2-87d5-7fae429948e3 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] [instance: fa47906d-d394-46fe-9143-780bcd27a715] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:11.760786 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c142c0e1-b6aa-42f2-87d5-7fae429948e3 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:11.762136 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c142c0e1-b6aa-42f2-87d5-7fae429948e3 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:11.762796 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c142c0e1-b6aa-42f2-87d5-7fae429948e3 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:11.766834 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c142c0e1-b6aa-42f2-87d5-7fae429948e3 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:11.767492 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c142c0e1-b6aa-42f2-87d5-7fae429948e3 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:11.768064 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c142c0e1-b6aa-42f2-87d5-7fae429948e3 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:11.988834 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-c142c0e1-b6aa-42f2-87d5-7fae429948e3 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:12.002670 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-c142c0e1-b6aa-42f2-87d5-7fae429948e3 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:12.004113 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-c142c0e1-b6aa-42f2-87d5-7fae429948e3 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:12.009499 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-c142c0e1-b6aa-42f2-87d5-7fae429948e3 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] 10.222.0.43 "GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715" status: 200 len: 1604 microversion: 2.32 time: 0.277811 Oct 04 18:51:12.029099 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2336/4397] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:51:11 2022] GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715 => generated 1604 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:51:12.202275 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-fed35314-2d0c-4821-90f1-3e93d730fbd6 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:12.207451 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-fed35314-2d0c-4821-90f1-3e93d730fbd6 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] [instance: f2269817-3e15-4cfe-8446-7eb0104f9800] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:12.222387 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fed35314-2d0c-4821-90f1-3e93d730fbd6 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:12.228184 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fed35314-2d0c-4821-90f1-3e93d730fbd6 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:12.228925 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fed35314-2d0c-4821-90f1-3e93d730fbd6 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:12.229736 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fed35314-2d0c-4821-90f1-3e93d730fbd6 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:12.230213 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fed35314-2d0c-4821-90f1-3e93d730fbd6 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:12.232975 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fed35314-2d0c-4821-90f1-3e93d730fbd6 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:12.282451 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-fed35314-2d0c-4821-90f1-3e93d730fbd6 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] 10.222.0.43 "GET /compute/v2.1/servers/f2269817-3e15-4cfe-8446-7eb0104f9800/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.083898 Oct 04 18:51:12.289437 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2337/4398] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Oct 4 18:51:12 2022] GET /compute/v2.1/servers/f2269817-3e15-4cfe-8446-7eb0104f9800/os-volume_attachments => generated 25 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 04 18:51:12.488812 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-ba121de2-78a2-4de5-a40e-6a99026c7303 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:12.491127 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-ba121de2-78a2-4de5-a40e-6a99026c7303 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] [instance: f2269817-3e15-4cfe-8446-7eb0104f9800] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:12.507155 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ba121de2-78a2-4de5-a40e-6a99026c7303 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:12.517761 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ba121de2-78a2-4de5-a40e-6a99026c7303 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:12.518326 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ba121de2-78a2-4de5-a40e-6a99026c7303 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:12.519127 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ba121de2-78a2-4de5-a40e-6a99026c7303 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:12.519618 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ba121de2-78a2-4de5-a40e-6a99026c7303 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:12.520070 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ba121de2-78a2-4de5-a40e-6a99026c7303 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:12.575895 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=100 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:51:12.585756 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-ba121de2-78a2-4de5-a40e-6a99026c7303 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] 10.222.0.43 "GET /compute/v2.1/servers/f2269817-3e15-4cfe-8446-7eb0104f9800/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.101728 Oct 04 18:51:12.586357 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2338/4399] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Oct 4 18:51:12 2022] GET /compute/v2.1/servers/f2269817-3e15-4cfe-8446-7eb0104f9800/os-volume_attachments => generated 25 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 04 18:51:12.698930 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-9e90465f-92ac-4f88-af03-8b13837c26a0 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:12.699696 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-9e90465f-92ac-4f88-af03-8b13837c26a0 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] [instance: f2269817-3e15-4cfe-8446-7eb0104f9800] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:12.707902 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9e90465f-92ac-4f88-af03-8b13837c26a0 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:12.710546 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9e90465f-92ac-4f88-af03-8b13837c26a0 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:12.725606 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9e90465f-92ac-4f88-af03-8b13837c26a0 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:12.726737 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9e90465f-92ac-4f88-af03-8b13837c26a0 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:12.727422 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9e90465f-92ac-4f88-af03-8b13837c26a0 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:12.728029 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9e90465f-92ac-4f88-af03-8b13837c26a0 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:12.782043 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-9e90465f-92ac-4f88-af03-8b13837c26a0 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] [instance: f2269817-3e15-4cfe-8446-7eb0104f9800] Going to try to terminate instance {{(pid=123596) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:51:12.916916 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:51:12.937948 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-9e90465f-92ac-4f88-af03-8b13837c26a0 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] 10.222.0.43 "DELETE /compute/v2.1/servers/f2269817-3e15-4cfe-8446-7eb0104f9800" status: 204 len: 0 microversion: 2.1 time: 0.243482 Oct 04 18:51:12.940354 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2339/4400] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 18:51:12 2022] DELETE /compute/v2.1/servers/f2269817-3e15-4cfe-8446-7eb0104f9800 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:51:12.952770 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-91a5923c-8553-4069-b8ac-afe5cf818c41 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:12.953582 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-91a5923c-8553-4069-b8ac-afe5cf818c41 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] [instance: 379687e5-a142-4246-be27-d5df590c2cc8] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:12.961604 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-91a5923c-8553-4069-b8ac-afe5cf818c41 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:12.962546 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-91a5923c-8553-4069-b8ac-afe5cf818c41 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:12.962546 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-91a5923c-8553-4069-b8ac-afe5cf818c41 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:12.963240 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-91a5923c-8553-4069-b8ac-afe5cf818c41 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:12.963697 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-91a5923c-8553-4069-b8ac-afe5cf818c41 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:12.964356 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-91a5923c-8553-4069-b8ac-afe5cf818c41 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:13.141898 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-eae8d96a-30a4-4932-acd5-30f562f1ce99 tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] Flavor limits 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:51:13.142538 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-eae8d96a-30a4-4932-acd5-30f562f1ce99 tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] Image limits 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:51:13.143001 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-eae8d96a-30a4-4932-acd5-30f562f1ce99 tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] Flavor pref 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:51:13.143426 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-eae8d96a-30a4-4932-acd5-30f562f1ce99 tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] Image pref 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:51:13.144291 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-eae8d96a-30a4-4932-acd5-30f562f1ce99 tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:51:13.170930 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-eae8d96a-30a4-4932-acd5-30f562f1ce99 tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:13.177025 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-eae8d96a-30a4-4932-acd5-30f562f1ce99 tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:13.177647 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-eae8d96a-30a4-4932-acd5-30f562f1ce99 tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:13.178499 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-eae8d96a-30a4-4932-acd5-30f562f1ce99 tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:13.178985 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-eae8d96a-30a4-4932-acd5-30f562f1ce99 tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:13.179416 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-eae8d96a-30a4-4932-acd5-30f562f1ce99 tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:13.232148 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-eae8d96a-30a4-4932-acd5-30f562f1ce99 tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] Getting quotas for project 08ee9e55650e4802bb32951c126fce8b. Resources: {'ram', 'cores', 'instances'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:51:13.239448 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-eae8d96a-30a4-4932-acd5-30f562f1ce99 tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] Getting quotas for user 9039839957e6449c94e9b54b2097d6d9 and project 08ee9e55650e4802bb32951c126fce8b. Resources: {'ram', 'cores', 'instances'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:51:13.276997 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-eae8d96a-30a4-4932-acd5-30f562f1ce99 tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] Going to run 1 instances... {{(pid=123595) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:51:13.282053 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-eae8d96a-30a4-4932-acd5-30f562f1ce99 tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] [instance: 5662b4d6-b524-45e0-abea-4803634bf4ea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e8943ec5-4038-4d4b-b9b9-2415a79f5243',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:51:13.332639 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-91a5923c-8553-4069-b8ac-afe5cf818c41 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14707008940e4965ab7d1190094a71bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8f94cf1c974654a336645f453c9efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:13.341698 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-91a5923c-8553-4069-b8ac-afe5cf818c41 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] 10.222.0.43 "GET /compute/v2.1/servers/379687e5-a142-4246-be27-d5df590c2cc8" status: 200 len: 1308 microversion: 2.1 time: 0.398696 Oct 04 18:51:13.350038 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2340/4401] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:12 2022] GET /compute/v2.1/servers/379687e5-a142-4246-be27-d5df590c2cc8 => generated 1308 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:13.357507 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-bbdb10d8-adf4-4715-8469-cf72beb6e446 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:13.358407 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-bbdb10d8-adf4-4715-8469-cf72beb6e446 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] [instance: f2269817-3e15-4cfe-8446-7eb0104f9800] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:13.367916 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-eae8d96a-30a4-4932-acd5-30f562f1ce99 tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.099410 Oct 04 18:51:13.369274 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2062/4402] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 18:51:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 3101 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:51:13.376154 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-986e591f-a5ae-40cc-a952-f0eca53270ee tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:13.376813 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bbdb10d8-adf4-4715-8469-cf72beb6e446 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:13.377318 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-986e591f-a5ae-40cc-a952-f0eca53270ee tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] [instance: fa47906d-d394-46fe-9143-780bcd27a715] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:13.377539 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bbdb10d8-adf4-4715-8469-cf72beb6e446 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:13.377971 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bbdb10d8-adf4-4715-8469-cf72beb6e446 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:13.378807 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bbdb10d8-adf4-4715-8469-cf72beb6e446 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:13.379434 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bbdb10d8-adf4-4715-8469-cf72beb6e446 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:13.379890 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bbdb10d8-adf4-4715-8469-cf72beb6e446 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:13.386513 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-986e591f-a5ae-40cc-a952-f0eca53270ee tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:13.387598 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-986e591f-a5ae-40cc-a952-f0eca53270ee tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:13.388286 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-986e591f-a5ae-40cc-a952-f0eca53270ee tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:13.389267 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-986e591f-a5ae-40cc-a952-f0eca53270ee tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:13.389927 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-986e591f-a5ae-40cc-a952-f0eca53270ee tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:13.390595 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-986e591f-a5ae-40cc-a952-f0eca53270ee tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:13.482822 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-986e591f-a5ae-40cc-a952-f0eca53270ee tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:13.494992 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-986e591f-a5ae-40cc-a952-f0eca53270ee tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:13.496861 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-986e591f-a5ae-40cc-a952-f0eca53270ee tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:13.498598 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-986e591f-a5ae-40cc-a952-f0eca53270ee tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] 10.222.0.43 "GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715" status: 200 len: 1604 microversion: 2.32 time: 0.128162 Oct 04 18:51:13.499324 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2063/4403] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:51:13 2022] GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715 => generated 1604 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:51:13.504257 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-0ffe9a3d-1d3d-4cfb-a974-d85764b7d773 tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:13.505248 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-0ffe9a3d-1d3d-4cfb-a974-d85764b7d773 tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] [instance: 5662b4d6-b524-45e0-abea-4803634bf4ea] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:13.653500 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-0ffe9a3d-1d3d-4cfb-a974-d85764b7d773 tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9039839957e6449c94e9b54b2097d6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08ee9e55650e4802bb32951c126fce8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:13.668811 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-0ffe9a3d-1d3d-4cfb-a974-d85764b7d773 tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] 10.222.0.43 "GET /compute/v2.1/servers/5662b4d6-b524-45e0-abea-4803634bf4ea" status: 200 len: 1216 microversion: 2.1 time: 0.168079 Oct 04 18:51:13.669610 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2064/4404] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:13 2022] GET /compute/v2.1/servers/5662b4d6-b524-45e0-abea-4803634bf4ea => generated 1216 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:14.137378 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-bbdb10d8-adf4-4715-8469-cf72beb6e446 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a116f2d9656548458264cc4fb1934c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff3c3dc76405401baf72fe00c5d50b56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:14.151123 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-bbdb10d8-adf4-4715-8469-cf72beb6e446 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] 10.222.0.43 "GET /compute/v2.1/servers/f2269817-3e15-4cfe-8446-7eb0104f9800" status: 200 len: 1673 microversion: 2.1 time: 0.799711 Oct 04 18:51:14.152188 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2341/4405] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:13 2022] GET /compute/v2.1/servers/f2269817-3e15-4cfe-8446-7eb0104f9800 => generated 1673 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:14.379778 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-cfc8bc14-a8bd-432a-9f8c-0d80b0bad826 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:14.380547 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-cfc8bc14-a8bd-432a-9f8c-0d80b0bad826 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] [instance: 379687e5-a142-4246-be27-d5df590c2cc8] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:14.402463 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=3 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:51:14.410923 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cfc8bc14-a8bd-432a-9f8c-0d80b0bad826 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:14.411502 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cfc8bc14-a8bd-432a-9f8c-0d80b0bad826 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:14.417743 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cfc8bc14-a8bd-432a-9f8c-0d80b0bad826 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:14.419084 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cfc8bc14-a8bd-432a-9f8c-0d80b0bad826 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:14.421042 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cfc8bc14-a8bd-432a-9f8c-0d80b0bad826 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:14.421521 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cfc8bc14-a8bd-432a-9f8c-0d80b0bad826 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:14.527867 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-e4457f03-b3e4-47b5-85be-5151351572f1 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:14.528924 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-e4457f03-b3e4-47b5-85be-5151351572f1 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] [instance: fa47906d-d394-46fe-9143-780bcd27a715] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:14.561360 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e4457f03-b3e4-47b5-85be-5151351572f1 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:14.563442 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e4457f03-b3e4-47b5-85be-5151351572f1 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:14.565620 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e4457f03-b3e4-47b5-85be-5151351572f1 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:14.573069 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e4457f03-b3e4-47b5-85be-5151351572f1 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:14.573830 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e4457f03-b3e4-47b5-85be-5151351572f1 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:14.584399 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e4457f03-b3e4-47b5-85be-5151351572f1 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:14.827205 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-cfc8bc14-a8bd-432a-9f8c-0d80b0bad826 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14707008940e4965ab7d1190094a71bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8f94cf1c974654a336645f453c9efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:14.841943 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-cfc8bc14-a8bd-432a-9f8c-0d80b0bad826 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] 10.222.0.43 "GET /compute/v2.1/servers/379687e5-a142-4246-be27-d5df590c2cc8" status: 200 len: 1308 microversion: 2.1 time: 0.468124 Oct 04 18:51:14.846899 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-e4457f03-b3e4-47b5-85be-5151351572f1 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:14.859983 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2065/4406] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:14 2022] GET /compute/v2.1/servers/379687e5-a142-4246-be27-d5df590c2cc8 => generated 1308 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:14.866307 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-e4457f03-b3e4-47b5-85be-5151351572f1 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:14.871815 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-e4457f03-b3e4-47b5-85be-5151351572f1 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:14.873121 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-11724b7b-2729-4de7-93fa-6449d649d814 req-4421e737-a233-47fc-80ae-7c80990058f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "379687e5-a142-4246-be27-d5df590c2cc8", "name": "network-vif-plugged", "status": "completed", "tag": "28f1b173-5077-430a-a20e-4c37d7becbfa"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:51:14.875521 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-e4457f03-b3e4-47b5-85be-5151351572f1 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] 10.222.0.43 "GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715" status: 200 len: 1604 microversion: 2.32 time: 0.353498 Oct 04 18:51:14.895982 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2342/4407] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:51:14 2022] GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715 => generated 1604 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:51:14.915090 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-749495c9-cb90-4ccb-8ea2-471f20d52443 tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:14.932436 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-749495c9-cb90-4ccb-8ea2-471f20d52443 tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] [instance: 5662b4d6-b524-45e0-abea-4803634bf4ea] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:14.938431 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-11724b7b-2729-4de7-93fa-6449d649d814 req-4421e737-a233-47fc-80ae-7c80990058f3 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:14.947461 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-11724b7b-2729-4de7-93fa-6449d649d814 req-4421e737-a233-47fc-80ae-7c80990058f3 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:14.948319 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-11724b7b-2729-4de7-93fa-6449d649d814 req-4421e737-a233-47fc-80ae-7c80990058f3 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:14.956742 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-749495c9-cb90-4ccb-8ea2-471f20d52443 tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:14.959091 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-749495c9-cb90-4ccb-8ea2-471f20d52443 tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:14.961303 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-749495c9-cb90-4ccb-8ea2-471f20d52443 tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:14.965038 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-749495c9-cb90-4ccb-8ea2-471f20d52443 tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:14.966336 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-749495c9-cb90-4ccb-8ea2-471f20d52443 tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:14.973420 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-749495c9-cb90-4ccb-8ea2-471f20d52443 tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:14.977138 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-11724b7b-2729-4de7-93fa-6449d649d814 req-4421e737-a233-47fc-80ae-7c80990058f3 service nova] Creating event network-vif-plugged:28f1b173-5077-430a-a20e-4c37d7becbfa for instance 379687e5-a142-4246-be27-d5df590c2cc8 on n-h1-851028-13 Oct 04 18:51:14.992109 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-11724b7b-2729-4de7-93fa-6449d649d814 req-4421e737-a233-47fc-80ae-7c80990058f3 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130682 Oct 04 18:51:14.998006 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2066/4408] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:51:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:51:15.121825 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-749495c9-cb90-4ccb-8ea2-471f20d52443 tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9039839957e6449c94e9b54b2097d6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08ee9e55650e4802bb32951c126fce8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:15.139036 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-749495c9-cb90-4ccb-8ea2-471f20d52443 tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] 10.222.0.43 "GET /compute/v2.1/servers/5662b4d6-b524-45e0-abea-4803634bf4ea" status: 200 len: 1268 microversion: 2.1 time: 0.241668 Oct 04 18:51:15.153645 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2343/4409] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:14 2022] GET /compute/v2.1/servers/5662b4d6-b524-45e0-abea-4803634bf4ea => generated 1268 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:15.181051 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-b63ee3b4-3687-47d9-9998-e494aec34c1e tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:15.181552 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-b63ee3b4-3687-47d9-9998-e494aec34c1e tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] [instance: f2269817-3e15-4cfe-8446-7eb0104f9800] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:15.209340 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b63ee3b4-3687-47d9-9998-e494aec34c1e tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:15.212107 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b63ee3b4-3687-47d9-9998-e494aec34c1e tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:15.212509 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b63ee3b4-3687-47d9-9998-e494aec34c1e tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:15.213304 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b63ee3b4-3687-47d9-9998-e494aec34c1e tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:15.218614 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b63ee3b4-3687-47d9-9998-e494aec34c1e tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:15.219156 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b63ee3b4-3687-47d9-9998-e494aec34c1e tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:15.884037 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-8c8056d3-2840-441c-ab64-a5d9e95c7e3c tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:15.885279 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-8c8056d3-2840-441c-ab64-a5d9e95c7e3c tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] [instance: 379687e5-a142-4246-be27-d5df590c2cc8] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:15.894170 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8c8056d3-2840-441c-ab64-a5d9e95c7e3c tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:15.895169 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8c8056d3-2840-441c-ab64-a5d9e95c7e3c tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:15.895946 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8c8056d3-2840-441c-ab64-a5d9e95c7e3c tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:15.896860 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8c8056d3-2840-441c-ab64-a5d9e95c7e3c tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:15.897600 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8c8056d3-2840-441c-ab64-a5d9e95c7e3c tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:15.898191 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8c8056d3-2840-441c-ab64-a5d9e95c7e3c tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:16.113405 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-8c8056d3-2840-441c-ab64-a5d9e95c7e3c tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14707008940e4965ab7d1190094a71bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8f94cf1c974654a336645f453c9efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:16.124373 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-8c8056d3-2840-441c-ab64-a5d9e95c7e3c tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] 10.222.0.43 "GET /compute/v2.1/servers/379687e5-a142-4246-be27-d5df590c2cc8" status: 200 len: 1308 microversion: 2.1 time: 0.244181 Oct 04 18:51:16.125550 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2344/4410] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:15 2022] GET /compute/v2.1/servers/379687e5-a142-4246-be27-d5df590c2cc8 => generated 1308 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:51:16.150440 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-c301260a-b334-4043-a961-9d2218051be6 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:16.151055 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-c301260a-b334-4043-a961-9d2218051be6 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] [instance: fa47906d-d394-46fe-9143-780bcd27a715] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:16.162926 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c301260a-b334-4043-a961-9d2218051be6 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:16.163628 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c301260a-b334-4043-a961-9d2218051be6 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:16.164967 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c301260a-b334-4043-a961-9d2218051be6 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:16.170219 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c301260a-b334-4043-a961-9d2218051be6 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:16.170954 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c301260a-b334-4043-a961-9d2218051be6 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:16.171547 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c301260a-b334-4043-a961-9d2218051be6 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:16.416173 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-c301260a-b334-4043-a961-9d2218051be6 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:16.442081 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-c301260a-b334-4043-a961-9d2218051be6 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:16.443899 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-c301260a-b334-4043-a961-9d2218051be6 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:16.447119 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-c301260a-b334-4043-a961-9d2218051be6 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] 10.222.0.43 "GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715" status: 200 len: 1604 microversion: 2.32 time: 0.301001 Oct 04 18:51:16.466052 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2345/4411] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:51:16 2022] GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715 => generated 1604 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:51:16.476306 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-878daf89-28ad-4f20-b456-a054f57c91df tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:16.477176 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-878daf89-28ad-4f20-b456-a054f57c91df tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] [instance: 5662b4d6-b524-45e0-abea-4803634bf4ea] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:16.494703 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-878daf89-28ad-4f20-b456-a054f57c91df tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:16.495406 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-878daf89-28ad-4f20-b456-a054f57c91df tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:16.496022 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-878daf89-28ad-4f20-b456-a054f57c91df tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:16.496915 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-878daf89-28ad-4f20-b456-a054f57c91df tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:16.497649 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-878daf89-28ad-4f20-b456-a054f57c91df tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:16.498398 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-878daf89-28ad-4f20-b456-a054f57c91df tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:16.620604 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-878daf89-28ad-4f20-b456-a054f57c91df tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9039839957e6449c94e9b54b2097d6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08ee9e55650e4802bb32951c126fce8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:16.633145 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-878daf89-28ad-4f20-b456-a054f57c91df tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] 10.222.0.43 "GET /compute/v2.1/servers/5662b4d6-b524-45e0-abea-4803634bf4ea" status: 200 len: 1274 microversion: 2.1 time: 0.165785 Oct 04 18:51:16.639136 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2346/4412] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:16 2022] GET /compute/v2.1/servers/5662b4d6-b524-45e0-abea-4803634bf4ea => generated 1274 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:17.118588 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-b63ee3b4-3687-47d9-9998-e494aec34c1e tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a116f2d9656548458264cc4fb1934c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff3c3dc76405401baf72fe00c5d50b56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:17.127979 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-b63ee3b4-3687-47d9-9998-e494aec34c1e tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] 10.222.0.43 "GET /compute/v2.1/servers/f2269817-3e15-4cfe-8446-7eb0104f9800" status: 200 len: 1673 microversion: 2.1 time: 1.952038 Oct 04 18:51:17.133222 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2067/4413] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:15 2022] GET /compute/v2.1/servers/f2269817-3e15-4cfe-8446-7eb0104f9800 => generated 1673 bytes in 1957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:17.149525 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-143ac274-16f2-40bb-b113-ef6e9b7de599 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:17.150759 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-143ac274-16f2-40bb-b113-ef6e9b7de599 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] [instance: 379687e5-a142-4246-be27-d5df590c2cc8] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:17.164205 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-143ac274-16f2-40bb-b113-ef6e9b7de599 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:17.164959 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-143ac274-16f2-40bb-b113-ef6e9b7de599 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:17.165587 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-143ac274-16f2-40bb-b113-ef6e9b7de599 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:17.168395 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-143ac274-16f2-40bb-b113-ef6e9b7de599 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:17.169137 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-143ac274-16f2-40bb-b113-ef6e9b7de599 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:17.169875 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-143ac274-16f2-40bb-b113-ef6e9b7de599 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:17.463738 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-143ac274-16f2-40bb-b113-ef6e9b7de599 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14707008940e4965ab7d1190094a71bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8f94cf1c974654a336645f453c9efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:17.555165 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-2e6583a9-b3e5-45ef-a5f2-5c254ab0beaa tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:17.555165 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-2e6583a9-b3e5-45ef-a5f2-5c254ab0beaa tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] [instance: fa47906d-d394-46fe-9143-780bcd27a715] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:17.555875 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-143ac274-16f2-40bb-b113-ef6e9b7de599 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] 10.222.0.43 "GET /compute/v2.1/servers/379687e5-a142-4246-be27-d5df590c2cc8" status: 200 len: 1488 microversion: 2.1 time: 0.342592 Oct 04 18:51:17.556068 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2e6583a9-b3e5-45ef-a5f2-5c254ab0beaa tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:17.556068 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2e6583a9-b3e5-45ef-a5f2-5c254ab0beaa tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:17.556342 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2347/4414] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:17 2022] GET /compute/v2.1/servers/379687e5-a142-4246-be27-d5df590c2cc8 => generated 1488 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:17.556532 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2e6583a9-b3e5-45ef-a5f2-5c254ab0beaa tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:17.556635 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-651258e0-5e8d-4c5d-b89a-cdc36f054d56 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:51:17.556635 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-651258e0-5e8d-4c5d-b89a-cdc36f054d56 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] [instance: 379687e5-a142-4246-be27-d5df590c2cc8] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:17.556813 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2e6583a9-b3e5-45ef-a5f2-5c254ab0beaa tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:17.556813 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2e6583a9-b3e5-45ef-a5f2-5c254ab0beaa tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:17.556813 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2e6583a9-b3e5-45ef-a5f2-5c254ab0beaa tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:17.557043 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-651258e0-5e8d-4c5d-b89a-cdc36f054d56 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:17.557043 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-651258e0-5e8d-4c5d-b89a-cdc36f054d56 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:17.560743 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-651258e0-5e8d-4c5d-b89a-cdc36f054d56 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:17.562322 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-651258e0-5e8d-4c5d-b89a-cdc36f054d56 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:17.563186 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-651258e0-5e8d-4c5d-b89a-cdc36f054d56 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:17.563719 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-651258e0-5e8d-4c5d-b89a-cdc36f054d56 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:17.748212 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-651258e0-5e8d-4c5d-b89a-cdc36f054d56 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] 10.222.0.43 "PUT /compute/v2.1/servers/379687e5-a142-4246-be27-d5df590c2cc8" status: 200 len: 1083 microversion: 2.1 time: 0.233740 Oct 04 18:51:17.785592 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2348/4415] 10.222.0.43 () {60 vars in 1256 bytes} [Tue Oct 4 18:51:17 2022] PUT /compute/v2.1/servers/379687e5-a142-4246-be27-d5df590c2cc8 => generated 1083 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:51:17.785592 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-789d63bf-114b-4845-a8fd-31dcd0a95d5f tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:17.786702 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-789d63bf-114b-4845-a8fd-31dcd0a95d5f tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] [instance: 5662b4d6-b524-45e0-abea-4803634bf4ea] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:17.806850 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-789d63bf-114b-4845-a8fd-31dcd0a95d5f tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:17.807281 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-789d63bf-114b-4845-a8fd-31dcd0a95d5f tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:17.807727 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-789d63bf-114b-4845-a8fd-31dcd0a95d5f tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:17.808444 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-789d63bf-114b-4845-a8fd-31dcd0a95d5f tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:17.815073 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-789d63bf-114b-4845-a8fd-31dcd0a95d5f tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:17.815472 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-789d63bf-114b-4845-a8fd-31dcd0a95d5f tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:17.836442 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-2e6583a9-b3e5-45ef-a5f2-5c254ab0beaa tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:17.854143 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-2e6583a9-b3e5-45ef-a5f2-5c254ab0beaa tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:17.860333 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-2e6583a9-b3e5-45ef-a5f2-5c254ab0beaa tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:17.879307 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-2e6583a9-b3e5-45ef-a5f2-5c254ab0beaa tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] 10.222.0.43 "GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715" status: 200 len: 1604 microversion: 2.32 time: 0.401161 Oct 04 18:51:17.882895 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2068/4416] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:51:17 2022] GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715 => generated 1604 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:51:17.896500 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-8dcdf3a2-43f0-4454-bcdd-32e65243894f tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:17.897176 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-8dcdf3a2-43f0-4454-bcdd-32e65243894f tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] [instance: 379687e5-a142-4246-be27-d5df590c2cc8] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:17.914540 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8dcdf3a2-43f0-4454-bcdd-32e65243894f tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:17.922839 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8dcdf3a2-43f0-4454-bcdd-32e65243894f tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:17.924843 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8dcdf3a2-43f0-4454-bcdd-32e65243894f tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:17.925658 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8dcdf3a2-43f0-4454-bcdd-32e65243894f tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:17.926138 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8dcdf3a2-43f0-4454-bcdd-32e65243894f tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:17.926573 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8dcdf3a2-43f0-4454-bcdd-32e65243894f tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:18.157606 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-789d63bf-114b-4845-a8fd-31dcd0a95d5f tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9039839957e6449c94e9b54b2097d6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08ee9e55650e4802bb32951c126fce8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:18.168056 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-789d63bf-114b-4845-a8fd-31dcd0a95d5f tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] 10.222.0.43 "GET /compute/v2.1/servers/5662b4d6-b524-45e0-abea-4803634bf4ea" status: 200 len: 1274 microversion: 2.1 time: 0.387042 Oct 04 18:51:18.181992 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2349/4417] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:17 2022] GET /compute/v2.1/servers/5662b4d6-b524-45e0-abea-4803634bf4ea => generated 1274 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:18.190885 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-0b943e92-5431-45a9-b8cf-1c8af3f16d52 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:18.192317 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-0b943e92-5431-45a9-b8cf-1c8af3f16d52 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] [instance: f2269817-3e15-4cfe-8446-7eb0104f9800] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:18.198737 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0b943e92-5431-45a9-b8cf-1c8af3f16d52 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:18.199556 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0b943e92-5431-45a9-b8cf-1c8af3f16d52 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:18.200233 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0b943e92-5431-45a9-b8cf-1c8af3f16d52 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:18.201201 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0b943e92-5431-45a9-b8cf-1c8af3f16d52 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:18.202331 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0b943e92-5431-45a9-b8cf-1c8af3f16d52 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:18.202989 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0b943e92-5431-45a9-b8cf-1c8af3f16d52 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:18.501592 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-0b943e92-5431-45a9-b8cf-1c8af3f16d52 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a116f2d9656548458264cc4fb1934c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff3c3dc76405401baf72fe00c5d50b56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:18.513766 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-0b943e92-5431-45a9-b8cf-1c8af3f16d52 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] 10.222.0.43 "GET /compute/v2.1/servers/f2269817-3e15-4cfe-8446-7eb0104f9800" status: 200 len: 1605 microversion: 2.1 time: 0.330275 Oct 04 18:51:18.521815 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2350/4418] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:18 2022] GET /compute/v2.1/servers/f2269817-3e15-4cfe-8446-7eb0104f9800 => generated 1605 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:18.689359 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-01a55727-08e4-41fa-83fc-6f258d761627 req-1a16b0ac-dd36-457a-93ca-4a16e57ccb1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2269817-3e15-4cfe-8446-7eb0104f9800", "name": "network-vif-deleted", "tag": "3669d9fe-db74-4da0-9fd7-a5c116b739a9"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:51:18.714292 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-8dcdf3a2-43f0-4454-bcdd-32e65243894f tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14707008940e4965ab7d1190094a71bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8f94cf1c974654a336645f453c9efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:18.723666 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-8dcdf3a2-43f0-4454-bcdd-32e65243894f tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] 10.222.0.43 "GET /compute/v2.1/servers/379687e5-a142-4246-be27-d5df590c2cc8" status: 200 len: 1509 microversion: 2.1 time: 0.838312 Oct 04 18:51:18.724716 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2069/4419] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:17 2022] GET /compute/v2.1/servers/379687e5-a142-4246-be27-d5df590c2cc8 => generated 1509 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:18.725376 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-01a55727-08e4-41fa-83fc-6f258d761627 req-1a16b0ac-dd36-457a-93ca-4a16e57ccb1b service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:18.727974 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-01a55727-08e4-41fa-83fc-6f258d761627 req-1a16b0ac-dd36-457a-93ca-4a16e57ccb1b service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:18.728455 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-01a55727-08e4-41fa-83fc-6f258d761627 req-1a16b0ac-dd36-457a-93ca-4a16e57ccb1b service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:18.748011 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-6d30f7eb-1241-4c49-8ca9-f946b2e06b0b tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:18.755413 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-6d30f7eb-1241-4c49-8ca9-f946b2e06b0b tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] [instance: 379687e5-a142-4246-be27-d5df590c2cc8] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:18.783682 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-01a55727-08e4-41fa-83fc-6f258d761627 req-1a16b0ac-dd36-457a-93ca-4a16e57ccb1b service nova] Creating event network-vif-deleted:3669d9fe-db74-4da0-9fd7-a5c116b739a9 for instance f2269817-3e15-4cfe-8446-7eb0104f9800 on n-h1-851028-13 Oct 04 18:51:18.786128 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6d30f7eb-1241-4c49-8ca9-f946b2e06b0b tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:18.786935 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6d30f7eb-1241-4c49-8ca9-f946b2e06b0b tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:18.787395 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6d30f7eb-1241-4c49-8ca9-f946b2e06b0b tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:18.790041 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6d30f7eb-1241-4c49-8ca9-f946b2e06b0b tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:18.790532 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6d30f7eb-1241-4c49-8ca9-f946b2e06b0b tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:18.790968 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6d30f7eb-1241-4c49-8ca9-f946b2e06b0b tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:18.800373 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-01a55727-08e4-41fa-83fc-6f258d761627 req-1a16b0ac-dd36-457a-93ca-4a16e57ccb1b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114103 Oct 04 18:51:18.805255 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2351/4420] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:51:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:51:18.912438 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-5204a564-e848-4781-8af9-bea57f7a59af tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:18.913178 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-5204a564-e848-4781-8af9-bea57f7a59af tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] [instance: fa47906d-d394-46fe-9143-780bcd27a715] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:18.926491 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5204a564-e848-4781-8af9-bea57f7a59af tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:18.926986 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5204a564-e848-4781-8af9-bea57f7a59af tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:18.927425 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5204a564-e848-4781-8af9-bea57f7a59af tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:18.938342 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5204a564-e848-4781-8af9-bea57f7a59af tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:18.939130 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5204a564-e848-4781-8af9-bea57f7a59af tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:18.940360 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5204a564-e848-4781-8af9-bea57f7a59af tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:19.058958 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-5204a564-e848-4781-8af9-bea57f7a59af tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:19.069652 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-5204a564-e848-4781-8af9-bea57f7a59af tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:19.078306 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-5204a564-e848-4781-8af9-bea57f7a59af tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:19.079572 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-5204a564-e848-4781-8af9-bea57f7a59af tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] 10.222.0.43 "GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715" status: 200 len: 1604 microversion: 2.32 time: 0.171525 Oct 04 18:51:19.086397 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2352/4421] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:51:18 2022] GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715 => generated 1604 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:51:19.196707 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-4dd0a378-266e-478f-8c86-9cd1a1318cb0 tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:19.199116 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-4dd0a378-266e-478f-8c86-9cd1a1318cb0 tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] [instance: 5662b4d6-b524-45e0-abea-4803634bf4ea] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:19.219574 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4dd0a378-266e-478f-8c86-9cd1a1318cb0 tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:19.220282 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4dd0a378-266e-478f-8c86-9cd1a1318cb0 tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:19.229424 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4dd0a378-266e-478f-8c86-9cd1a1318cb0 tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:19.231014 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4dd0a378-266e-478f-8c86-9cd1a1318cb0 tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:19.232212 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4dd0a378-266e-478f-8c86-9cd1a1318cb0 tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:19.233655 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4dd0a378-266e-478f-8c86-9cd1a1318cb0 tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:19.394528 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-4dd0a378-266e-478f-8c86-9cd1a1318cb0 tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9039839957e6449c94e9b54b2097d6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08ee9e55650e4802bb32951c126fce8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:19.397427 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:51:19.415463 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-4dd0a378-266e-478f-8c86-9cd1a1318cb0 tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] 10.222.0.43 "GET /compute/v2.1/servers/5662b4d6-b524-45e0-abea-4803634bf4ea" status: 200 len: 1274 microversion: 2.1 time: 0.224659 Oct 04 18:51:19.416062 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2353/4422] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:19 2022] GET /compute/v2.1/servers/5662b4d6-b524-45e0-abea-4803634bf4ea => generated 1274 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:51:19.551450 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-18145cef-5f3e-4779-a84e-6103543ab97d tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:19.552557 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-18145cef-5f3e-4779-a84e-6103543ab97d tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] [instance: f2269817-3e15-4cfe-8446-7eb0104f9800] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:19.565073 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-18145cef-5f3e-4779-a84e-6103543ab97d tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:19.565727 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-18145cef-5f3e-4779-a84e-6103543ab97d tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:19.566426 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-18145cef-5f3e-4779-a84e-6103543ab97d tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:19.567224 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-18145cef-5f3e-4779-a84e-6103543ab97d tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:19.570563 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-18145cef-5f3e-4779-a84e-6103543ab97d tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:19.573374 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-18145cef-5f3e-4779-a84e-6103543ab97d tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:19.616398 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-6d30f7eb-1241-4c49-8ca9-f946b2e06b0b tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14707008940e4965ab7d1190094a71bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8f94cf1c974654a336645f453c9efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:19.627986 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-6d30f7eb-1241-4c49-8ca9-f946b2e06b0b tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] 10.222.0.43 "GET /compute/v2.1/servers/379687e5-a142-4246-be27-d5df590c2cc8" status: 200 len: 1509 microversion: 2.1 time: 0.884240 Oct 04 18:51:19.631665 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2070/4423] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:18 2022] GET /compute/v2.1/servers/379687e5-a142-4246-be27-d5df590c2cc8 => generated 1509 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:19.670902 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-d7f47a50-99b6-4f2b-9610-c865aaeb1fe7 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:19.671667 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-d7f47a50-99b6-4f2b-9610-c865aaeb1fe7 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] [instance: 379687e5-a142-4246-be27-d5df590c2cc8] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:19.681343 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-18145cef-5f3e-4779-a84e-6103543ab97d tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:19.682213 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-18145cef-5f3e-4779-a84e-6103543ab97d tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:19.682707 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d7f47a50-99b6-4f2b-9610-c865aaeb1fe7 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:19.682884 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-18145cef-5f3e-4779-a84e-6103543ab97d tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:19.683060 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d7f47a50-99b6-4f2b-9610-c865aaeb1fe7 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:19.683298 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.objects.instance [None req-18145cef-5f3e-4779-a84e-6103543ab97d tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lazy-loading 'fault' on Instance uuid f2269817-3e15-4cfe-8446-7eb0104f9800 {{(pid=123596) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:51:19.683563 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d7f47a50-99b6-4f2b-9610-c865aaeb1fe7 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:19.684212 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d7f47a50-99b6-4f2b-9610-c865aaeb1fe7 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:19.684704 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d7f47a50-99b6-4f2b-9610-c865aaeb1fe7 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:19.685087 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d7f47a50-99b6-4f2b-9610-c865aaeb1fe7 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:19.763931 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-d7f47a50-99b6-4f2b-9610-c865aaeb1fe7 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] [instance: 379687e5-a142-4246-be27-d5df590c2cc8] Going to try to terminate instance {{(pid=123595) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:51:19.774775 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:51:20.016265 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-d7f47a50-99b6-4f2b-9610-c865aaeb1fe7 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] 10.222.0.43 "DELETE /compute/v2.1/servers/379687e5-a142-4246-be27-d5df590c2cc8" status: 204 len: 0 microversion: 2.1 time: 0.346223 Oct 04 18:51:20.021944 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2071/4424] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 18:51:19 2022] DELETE /compute/v2.1/servers/379687e5-a142-4246-be27-d5df590c2cc8 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:51:20.040328 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-ef67d30b-14ff-4d13-a133-36cf42b7929f tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:20.043173 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-ef67d30b-14ff-4d13-a133-36cf42b7929f tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] [instance: 379687e5-a142-4246-be27-d5df590c2cc8] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:20.060669 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ef67d30b-14ff-4d13-a133-36cf42b7929f tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:20.061537 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ef67d30b-14ff-4d13-a133-36cf42b7929f tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:20.090679 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ef67d30b-14ff-4d13-a133-36cf42b7929f tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:20.092963 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ef67d30b-14ff-4d13-a133-36cf42b7929f tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:20.093561 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ef67d30b-14ff-4d13-a133-36cf42b7929f tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:20.094676 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ef67d30b-14ff-4d13-a133-36cf42b7929f tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:20.315047 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-18145cef-5f3e-4779-a84e-6103543ab97d tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a116f2d9656548458264cc4fb1934c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff3c3dc76405401baf72fe00c5d50b56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:20.329091 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-18145cef-5f3e-4779-a84e-6103543ab97d tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] 10.222.0.43 "GET /compute/v2.1/servers/f2269817-3e15-4cfe-8446-7eb0104f9800" status: 200 len: 1327 microversion: 2.1 time: 0.781622 Oct 04 18:51:20.332818 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2354/4425] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:19 2022] GET /compute/v2.1/servers/f2269817-3e15-4cfe-8446-7eb0104f9800 => generated 1327 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:20.359157 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-8e77e051-7578-434d-a918-1664c5f34f13 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:20.359781 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-8e77e051-7578-434d-a918-1664c5f34f13 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] [instance: fa47906d-d394-46fe-9143-780bcd27a715] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:20.372998 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8e77e051-7578-434d-a918-1664c5f34f13 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:20.374016 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8e77e051-7578-434d-a918-1664c5f34f13 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:20.374718 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8e77e051-7578-434d-a918-1664c5f34f13 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:20.376869 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8e77e051-7578-434d-a918-1664c5f34f13 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:20.378861 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8e77e051-7578-434d-a918-1664c5f34f13 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:20.380885 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8e77e051-7578-434d-a918-1664c5f34f13 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:20.536574 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-8e77e051-7578-434d-a918-1664c5f34f13 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:20.569693 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-8e77e051-7578-434d-a918-1664c5f34f13 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:20.571144 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-8e77e051-7578-434d-a918-1664c5f34f13 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:20.572621 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-8e77e051-7578-434d-a918-1664c5f34f13 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] 10.222.0.43 "GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715" status: 200 len: 1604 microversion: 2.32 time: 0.224704 Oct 04 18:51:20.586413 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2355/4426] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:51:20 2022] GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715 => generated 1604 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:51:20.608842 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-18530a3d-bd45-4dda-9558-67b98ee48d96 tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:20.610459 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-18530a3d-bd45-4dda-9558-67b98ee48d96 tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] [instance: 5662b4d6-b524-45e0-abea-4803634bf4ea] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:20.619092 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-18530a3d-bd45-4dda-9558-67b98ee48d96 tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:20.619800 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-18530a3d-bd45-4dda-9558-67b98ee48d96 tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:20.620405 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-18530a3d-bd45-4dda-9558-67b98ee48d96 tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:20.621618 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-18530a3d-bd45-4dda-9558-67b98ee48d96 tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:20.623692 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-18530a3d-bd45-4dda-9558-67b98ee48d96 tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:20.624463 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-18530a3d-bd45-4dda-9558-67b98ee48d96 tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:20.948357 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-18530a3d-bd45-4dda-9558-67b98ee48d96 tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9039839957e6449c94e9b54b2097d6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08ee9e55650e4802bb32951c126fce8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:20.963166 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-18530a3d-bd45-4dda-9558-67b98ee48d96 tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] 10.222.0.43 "GET /compute/v2.1/servers/5662b4d6-b524-45e0-abea-4803634bf4ea" status: 200 len: 1316 microversion: 2.1 time: 0.375157 Oct 04 18:51:20.964164 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2356/4427] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:20 2022] GET /compute/v2.1/servers/5662b4d6-b524-45e0-abea-4803634bf4ea => generated 1316 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:21.360672 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-8fd78e1d-5ca3-48dc-b5ec-7304c26b12eb tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:21.367856 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-8fd78e1d-5ca3-48dc-b5ec-7304c26b12eb tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] [instance: f2269817-3e15-4cfe-8446-7eb0104f9800] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:21.376544 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-ef67d30b-14ff-4d13-a133-36cf42b7929f tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14707008940e4965ab7d1190094a71bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8f94cf1c974654a336645f453c9efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:21.388104 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-ef67d30b-14ff-4d13-a133-36cf42b7929f tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] 10.222.0.43 "GET /compute/v2.1/servers/379687e5-a142-4246-be27-d5df590c2cc8" status: 200 len: 1515 microversion: 2.1 time: 1.362468 Oct 04 18:51:21.388716 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2072/4428] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:20 2022] GET /compute/v2.1/servers/379687e5-a142-4246-be27-d5df590c2cc8 => generated 1515 bytes in 1366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:21.430036 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8fd78e1d-5ca3-48dc-b5ec-7304c26b12eb tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:21.431482 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8fd78e1d-5ca3-48dc-b5ec-7304c26b12eb tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.042s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:21.432168 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8fd78e1d-5ca3-48dc-b5ec-7304c26b12eb tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:21.433679 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8fd78e1d-5ca3-48dc-b5ec-7304c26b12eb tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:21.435557 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8fd78e1d-5ca3-48dc-b5ec-7304c26b12eb tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:21.436417 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8fd78e1d-5ca3-48dc-b5ec-7304c26b12eb tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:21.475445 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-8fd78e1d-5ca3-48dc-b5ec-7304c26b12eb tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] HTTP exception thrown: Instance f2269817-3e15-4cfe-8446-7eb0104f9800 could not be found. Oct 04 18:51:21.493187 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-8fd78e1d-5ca3-48dc-b5ec-7304c26b12eb tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Request method failure captured: Oct 04 18:51:21.493187 n-d-851028-13 devstack@n-api.service[123596]: request: GET /compute/v2.1/servers/f2269817-3e15-4cfe-8446-7eb0104f9800 HTTP/1.1 Oct 04 18:51:21.493187 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:51:21.493187 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:51:21.493187 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:51:21.493187 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 18:51:21.493187 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:51:21.493187 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:51:21.493187 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:51:21.493187 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:51:21.493187 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPH8lkGy0nZwltj3uDmeGQrZQwg6iRmriNLJ5vdTxYDzuDEs4JzrRDRI_AZvLAjZh5V6GRRv2aL1Ucq2iBU4yNUHCglEfTAOxdnVxtvedAn0I6kngigKmNkAB_2-EZ56jXiOuDwiOsK_AD_cvM52BvcLg72IQH_PTBSCnO4tX8aOV0qA Oct 04 18:51:21.493187 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:51:21.493187 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:51:21.493187 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:51:21.493187 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:51:21.493187 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:51:21.493187 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:51:21.493187 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: ff3c3dc76405401baf72fe00c5d50b56 Oct 04 18:51:21.493187 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-AttachVolumeTestJSON-517546326 Oct 04 18:51:21.493187 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 18:51:21.493187 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 18:51:21.493187 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/ff3c3dc76405401baf72fe00c5d50b56"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_ff3c3dc76405401baf72fe00c5d50b56"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ff3c3dc76405401baf72fe00c5d50b56"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ff3c3dc76405401baf72fe00c5d50b56"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:51:21.493187 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-AttachVolumeTestJSON-517546326 Oct 04 18:51:21.493187 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: ff3c3dc76405401baf72fe00c5d50b56 Oct 04 18:51:21.493187 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-AttachVolumeTestJSON-517546326 Oct 04 18:51:21.493187 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-AttachVolumeTestJSON-517546326-project Oct 04 18:51:21.493187 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:51:21.493187 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:51:21.493187 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: a116f2d9656548458264cc4fb1934c18 Oct 04 18:51:21.493187 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-AttachVolumeTestJSON-517546326-project Oct 04 18:51:21.493187 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 18:51:21.493187 n-d-851028-13 devstack@n-api.service[123596]: exception: Instance f2269817-3e15-4cfe-8446-7eb0104f9800 could not be found. Oct 04 18:51:21.493187 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': 'f2269817-3e15-4cfe-8446-7eb0104f9800'} Oct 04 18:51:21.493187 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:51:21.493187 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:51:21.493187 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:51:21.493187 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:51:21.493187 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:51:21.493187 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:51:21.493187 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:51:21.493187 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:51:21.493187 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:51:21.493187 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:51:21.493187 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2269817-3e15-4cfe-8446-7eb0104f9800 could not be found. Oct 04 18:51:21.493187 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:51:21.493187 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:51:21.493187 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:51:21.493187 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:51:21.493187 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:51:21.493187 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:51:21.493187 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:51:21.493187 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:51:21.493187 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:51:21.493187 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:51:21.493187 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:51:21.493187 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:51:21.493187 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:51:21.493187 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:51:21.493187 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:51:21.493187 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:51:21.493187 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2269817-3e15-4cfe-8446-7eb0104f9800 could not be found. Oct 04 18:51:21.493187 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:51:21.493187 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:51:21.493187 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:51:21.498405 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:51:21.498405 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:51:21.498405 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:51:21.498405 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:51:21.498405 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:51:21.498405 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2269817-3e15-4cfe-8446-7eb0104f9800 could not be found. Oct 04 18:51:21.498405 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:51:21.498405 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-8fd78e1d-5ca3-48dc-b5ec-7304c26b12eb tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Returning 404 to user: Instance f2269817-3e15-4cfe-8446-7eb0104f9800 could not be found. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:51:21.504573 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-8fd78e1d-5ca3-48dc-b5ec-7304c26b12eb tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] 10.222.0.43 "GET /compute/v2.1/servers/f2269817-3e15-4cfe-8446-7eb0104f9800" status: 404 len: 111 microversion: 2.1 time: 0.146084 Oct 04 18:51:21.507561 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2357/4429] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:21 2022] GET /compute/v2.1/servers/f2269817-3e15-4cfe-8446-7eb0104f9800 => generated 111 bytes in 153 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:51:21.520701 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-807faf9b-c5ce-4c80-bd26-f5a12313c9a2 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Calling method '.version_select at 0x7fb21ee17280>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:21.544816 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-807faf9b-c5ce-4c80-bd26-f5a12313c9a2 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1836012412" status: 202 len: 0 microversion: 2.1 time: 0.034530 Oct 04 18:51:21.548806 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2073/4430] 10.222.0.43 () {58 vars in 1221 bytes} [Tue Oct 4 18:51:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1836012412 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:51:21.604596 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-865768ef-d620-4bab-b8cb-210a1e913b56 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:21.606606 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-865768ef-d620-4bab-b8cb-210a1e913b56 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] [instance: fa47906d-d394-46fe-9143-780bcd27a715] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:21.613465 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-865768ef-d620-4bab-b8cb-210a1e913b56 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:21.614372 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-865768ef-d620-4bab-b8cb-210a1e913b56 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:21.615058 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-865768ef-d620-4bab-b8cb-210a1e913b56 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:21.617123 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-865768ef-d620-4bab-b8cb-210a1e913b56 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:21.618415 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-865768ef-d620-4bab-b8cb-210a1e913b56 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:21.619534 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-865768ef-d620-4bab-b8cb-210a1e913b56 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:21.749728 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-865768ef-d620-4bab-b8cb-210a1e913b56 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:21.764962 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-865768ef-d620-4bab-b8cb-210a1e913b56 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:21.779012 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-865768ef-d620-4bab-b8cb-210a1e913b56 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:21.781056 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-865768ef-d620-4bab-b8cb-210a1e913b56 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] 10.222.0.43 "GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715" status: 200 len: 1604 microversion: 2.32 time: 0.181189 Oct 04 18:51:21.781863 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2358/4431] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:51:21 2022] GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715 => generated 1604 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:51:21.986997 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-162af55f-dcb7-4391-9124-51813fe13ac5 tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:21.988079 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-162af55f-dcb7-4391-9124-51813fe13ac5 tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] [instance: 5662b4d6-b524-45e0-abea-4803634bf4ea] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:21.996854 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-162af55f-dcb7-4391-9124-51813fe13ac5 tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:21.997385 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-162af55f-dcb7-4391-9124-51813fe13ac5 tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:22.002103 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-162af55f-dcb7-4391-9124-51813fe13ac5 tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:22.006667 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-162af55f-dcb7-4391-9124-51813fe13ac5 tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:22.007160 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-162af55f-dcb7-4391-9124-51813fe13ac5 tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:22.012342 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-162af55f-dcb7-4391-9124-51813fe13ac5 tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:22.416945 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-e077aa0b-0f99-4cc8-84d2-8c4904f862c4 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:22.418339 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-e077aa0b-0f99-4cc8-84d2-8c4904f862c4 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] [instance: 379687e5-a142-4246-be27-d5df590c2cc8] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:22.430480 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e077aa0b-0f99-4cc8-84d2-8c4904f862c4 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:22.434050 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e077aa0b-0f99-4cc8-84d2-8c4904f862c4 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:22.434355 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e077aa0b-0f99-4cc8-84d2-8c4904f862c4 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:22.435128 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e077aa0b-0f99-4cc8-84d2-8c4904f862c4 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:22.435598 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e077aa0b-0f99-4cc8-84d2-8c4904f862c4 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:22.436034 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e077aa0b-0f99-4cc8-84d2-8c4904f862c4 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:22.512247 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-162af55f-dcb7-4391-9124-51813fe13ac5 tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9039839957e6449c94e9b54b2097d6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08ee9e55650e4802bb32951c126fce8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:22.542608 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-162af55f-dcb7-4391-9124-51813fe13ac5 tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] 10.222.0.43 "GET /compute/v2.1/servers/5662b4d6-b524-45e0-abea-4803634bf4ea" status: 200 len: 1316 microversion: 2.1 time: 0.540250 Oct 04 18:51:22.557160 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2074/4432] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:21 2022] GET /compute/v2.1/servers/5662b4d6-b524-45e0-abea-4803634bf4ea => generated 1316 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:22.814153 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-5d7404c0-7395-4e4b-bc57-ca28755209fd tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:22.815214 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-5d7404c0-7395-4e4b-bc57-ca28755209fd tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] [instance: fa47906d-d394-46fe-9143-780bcd27a715] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:22.829646 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5d7404c0-7395-4e4b-bc57-ca28755209fd tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:22.830456 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5d7404c0-7395-4e4b-bc57-ca28755209fd tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:22.831397 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5d7404c0-7395-4e4b-bc57-ca28755209fd tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:22.833559 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5d7404c0-7395-4e4b-bc57-ca28755209fd tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:22.834380 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5d7404c0-7395-4e4b-bc57-ca28755209fd tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:22.834944 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5d7404c0-7395-4e4b-bc57-ca28755209fd tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:23.020858 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-5d7404c0-7395-4e4b-bc57-ca28755209fd tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:23.073902 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-5d7404c0-7395-4e4b-bc57-ca28755209fd tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:23.082507 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-5d7404c0-7395-4e4b-bc57-ca28755209fd tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:23.092384 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-e077aa0b-0f99-4cc8-84d2-8c4904f862c4 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14707008940e4965ab7d1190094a71bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8f94cf1c974654a336645f453c9efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:23.106110 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-5d7404c0-7395-4e4b-bc57-ca28755209fd tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] 10.222.0.43 "GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715" status: 200 len: 1604 microversion: 2.32 time: 0.279058 Oct 04 18:51:23.106765 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2075/4433] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:51:22 2022] GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715 => generated 1604 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:51:23.112843 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-e077aa0b-0f99-4cc8-84d2-8c4904f862c4 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] 10.222.0.43 "GET /compute/v2.1/servers/379687e5-a142-4246-be27-d5df590c2cc8" status: 200 len: 1515 microversion: 2.1 time: 0.697386 Oct 04 18:51:23.113907 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2359/4434] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:22 2022] GET /compute/v2.1/servers/379687e5-a142-4246-be27-d5df590c2cc8 => generated 1515 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:23.535836 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-59039d6e-f24d-4b7e-afbf-0e1fc58fece8 req-819af017-c852-4e98-b6d3-cd0d09de8b05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "379687e5-a142-4246-be27-d5df590c2cc8", "name": "network-vif-deleted", "tag": "28f1b173-5077-430a-a20e-4c37d7becbfa"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:51:23.541268 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=2 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:51:23.570569 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-59039d6e-f24d-4b7e-afbf-0e1fc58fece8 req-819af017-c852-4e98-b6d3-cd0d09de8b05 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:23.570923 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-59039d6e-f24d-4b7e-afbf-0e1fc58fece8 req-819af017-c852-4e98-b6d3-cd0d09de8b05 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:23.571371 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-59039d6e-f24d-4b7e-afbf-0e1fc58fece8 req-819af017-c852-4e98-b6d3-cd0d09de8b05 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:23.574656 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-83646f05-41b1-43df-8696-67e32f07296f tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:23.575404 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-83646f05-41b1-43df-8696-67e32f07296f tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] [instance: 5662b4d6-b524-45e0-abea-4803634bf4ea] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:23.589567 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-83646f05-41b1-43df-8696-67e32f07296f tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:23.590081 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-83646f05-41b1-43df-8696-67e32f07296f tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:23.590542 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-83646f05-41b1-43df-8696-67e32f07296f tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:23.591379 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-83646f05-41b1-43df-8696-67e32f07296f tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:23.592019 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-83646f05-41b1-43df-8696-67e32f07296f tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:23.592583 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-83646f05-41b1-43df-8696-67e32f07296f tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:23.608125 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-59039d6e-f24d-4b7e-afbf-0e1fc58fece8 req-819af017-c852-4e98-b6d3-cd0d09de8b05 service nova] Creating event network-vif-deleted:28f1b173-5077-430a-a20e-4c37d7becbfa for instance 379687e5-a142-4246-be27-d5df590c2cc8 on n-h1-851028-13 Oct 04 18:51:23.622789 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-59039d6e-f24d-4b7e-afbf-0e1fc58fece8 req-819af017-c852-4e98-b6d3-cd0d09de8b05 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090573 Oct 04 18:51:23.628472 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2076/4435] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:51:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:51:24.087287 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-83646f05-41b1-43df-8696-67e32f07296f tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9039839957e6449c94e9b54b2097d6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08ee9e55650e4802bb32951c126fce8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:24.099200 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-83646f05-41b1-43df-8696-67e32f07296f tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] 10.222.0.43 "GET /compute/v2.1/servers/5662b4d6-b524-45e0-abea-4803634bf4ea" status: 200 len: 1316 microversion: 2.1 time: 0.532948 Oct 04 18:51:24.101872 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2360/4436] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:23 2022] GET /compute/v2.1/servers/5662b4d6-b524-45e0-abea-4803634bf4ea => generated 1316 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:24.138310 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=8 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:51:24.155346 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-c20ee778-d475-4775-9f36-6ca11ace221b tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:24.160150 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-c20ee778-d475-4775-9f36-6ca11ace221b tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] [instance: fa47906d-d394-46fe-9143-780bcd27a715] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:24.163213 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-250de83d-310f-486f-9e23-50163efe152f tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:24.183020 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-250de83d-310f-486f-9e23-50163efe152f tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] [instance: 379687e5-a142-4246-be27-d5df590c2cc8] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:24.203877 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-250de83d-310f-486f-9e23-50163efe152f tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:24.204211 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c20ee778-d475-4775-9f36-6ca11ace221b tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:24.204812 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c20ee778-d475-4775-9f36-6ca11ace221b tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:24.205443 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-250de83d-310f-486f-9e23-50163efe152f tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:24.206594 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c20ee778-d475-4775-9f36-6ca11ace221b tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:24.207608 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c20ee778-d475-4775-9f36-6ca11ace221b tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:24.208051 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-250de83d-310f-486f-9e23-50163efe152f tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:24.209002 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-250de83d-310f-486f-9e23-50163efe152f tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:24.209852 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c20ee778-d475-4775-9f36-6ca11ace221b tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:24.210625 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-250de83d-310f-486f-9e23-50163efe152f tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:24.211323 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c20ee778-d475-4775-9f36-6ca11ace221b tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:24.212002 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-250de83d-310f-486f-9e23-50163efe152f tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:24.247081 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-250de83d-310f-486f-9e23-50163efe152f tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] HTTP exception thrown: Instance 379687e5-a142-4246-be27-d5df590c2cc8 could not be found. Oct 04 18:51:24.248941 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-250de83d-310f-486f-9e23-50163efe152f tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Request method failure captured: Oct 04 18:51:24.248941 n-d-851028-13 devstack@n-api.service[123596]: request: GET /compute/v2.1/servers/379687e5-a142-4246-be27-d5df590c2cc8 HTTP/1.1 Oct 04 18:51:24.248941 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:51:24.248941 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:51:24.248941 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:51:24.248941 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 18:51:24.248941 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:51:24.248941 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:51:24.248941 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:51:24.248941 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:51:24.248941 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPIAJxznq_dqRpKBeHYz_tTt-BPe6PGX8bXmZXSSSBar-nAl3_7gjSqUW3yyr2J4Kw1m1-l6Y2izmzOt3P0Lv3UhhGPTaACGzV6RGiSkRczLrMXORtXSdyVIiZq3MCL7L2uQGd29MwUZa7-C3NoIEqHwDxvVJi_WWjtFyKnOFEp1-BZ0 Oct 04 18:51:24.248941 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:51:24.248941 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:51:24.248941 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:51:24.248941 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:51:24.248941 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:51:24.248941 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:51:24.248941 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: ed8f94cf1c974654a336645f453c9efc Oct 04 18:51:24.248941 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-ServersTestJSON-546754383 Oct 04 18:51:24.248941 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 18:51:24.248941 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 18:51:24.248941 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/ed8f94cf1c974654a336645f453c9efc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_ed8f94cf1c974654a336645f453c9efc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ed8f94cf1c974654a336645f453c9efc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ed8f94cf1c974654a336645f453c9efc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:51:24.248941 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-ServersTestJSON-546754383 Oct 04 18:51:24.248941 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: ed8f94cf1c974654a336645f453c9efc Oct 04 18:51:24.248941 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-ServersTestJSON-546754383 Oct 04 18:51:24.248941 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-ServersTestJSON-546754383-project Oct 04 18:51:24.248941 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:51:24.248941 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:51:24.248941 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 14707008940e4965ab7d1190094a71bb Oct 04 18:51:24.248941 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-ServersTestJSON-546754383-project Oct 04 18:51:24.248941 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 18:51:24.248941 n-d-851028-13 devstack@n-api.service[123596]: exception: Instance 379687e5-a142-4246-be27-d5df590c2cc8 could not be found. Oct 04 18:51:24.248941 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': '379687e5-a142-4246-be27-d5df590c2cc8'} Oct 04 18:51:24.248941 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:51:24.248941 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:51:24.248941 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:51:24.248941 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:51:24.248941 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:51:24.248941 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:51:24.248941 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:51:24.248941 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:51:24.248941 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:51:24.248941 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:51:24.248941 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 379687e5-a142-4246-be27-d5df590c2cc8 could not be found. Oct 04 18:51:24.248941 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:51:24.248941 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:51:24.248941 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:51:24.248941 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:51:24.248941 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:51:24.248941 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:51:24.248941 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:51:24.248941 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:51:24.248941 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:51:24.248941 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:51:24.248941 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:51:24.248941 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:51:24.248941 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:51:24.248941 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:51:24.248941 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:51:24.248941 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:51:24.248941 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 379687e5-a142-4246-be27-d5df590c2cc8 could not be found. Oct 04 18:51:24.248941 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:51:24.248941 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:51:24.248941 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:51:24.248941 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:51:24.253921 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:51:24.253921 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:51:24.253921 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:51:24.253921 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:51:24.253921 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 379687e5-a142-4246-be27-d5df590c2cc8 could not be found. Oct 04 18:51:24.253921 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:51:24.253921 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-250de83d-310f-486f-9e23-50163efe152f tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Returning 404 to user: Instance 379687e5-a142-4246-be27-d5df590c2cc8 could not be found. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:51:24.253921 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-250de83d-310f-486f-9e23-50163efe152f tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] 10.222.0.43 "GET /compute/v2.1/servers/379687e5-a142-4246-be27-d5df590c2cc8" status: 404 len: 111 microversion: 2.1 time: 0.098903 Oct 04 18:51:24.253921 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2361/4437] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:24 2022] GET /compute/v2.1/servers/379687e5-a142-4246-be27-d5df590c2cc8 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:51:24.407134 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-8ea02fbe-2f81-4bd1-9064-158caba067dd tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-719798787", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452", "networks": [{"uuid": "4a1417e9-f3af-46cb-a463-32dd1c79c4e9"}]}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:51:24.416423 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-c20ee778-d475-4775-9f36-6ca11ace221b tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:24.426585 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-c20ee778-d475-4775-9f36-6ca11ace221b tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:24.428002 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-c20ee778-d475-4775-9f36-6ca11ace221b tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:24.429257 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-c20ee778-d475-4775-9f36-6ca11ace221b tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] 10.222.0.43 "GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715" status: 200 len: 1604 microversion: 2.32 time: 0.296405 Oct 04 18:51:24.429844 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2077/4438] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:51:24 2022] GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715 => generated 1604 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:51:24.500720 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.network.neutron [None req-8ea02fbe-2f81-4bd1-9064-158caba067dd tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] validate_networks() for [('4a1417e9-f3af-46cb-a463-32dd1c79c4e9', None, None, None, None, None)] {{(pid=123596) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:51:25.078434 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-8ea02fbe-2f81-4bd1-9064-158caba067dd tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Flavor limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:51:25.078987 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-8ea02fbe-2f81-4bd1-9064-158caba067dd tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Image limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:51:25.079339 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-8ea02fbe-2f81-4bd1-9064-158caba067dd tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Flavor pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:51:25.079758 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-8ea02fbe-2f81-4bd1-9064-158caba067dd tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Image pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:51:25.080176 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-8ea02fbe-2f81-4bd1-9064-158caba067dd tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:51:25.104987 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8ea02fbe-2f81-4bd1-9064-158caba067dd tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:25.105897 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8ea02fbe-2f81-4bd1-9064-158caba067dd tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:25.106593 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8ea02fbe-2f81-4bd1-9064-158caba067dd tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:25.110834 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8ea02fbe-2f81-4bd1-9064-158caba067dd tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:25.111574 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8ea02fbe-2f81-4bd1-9064-158caba067dd tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:25.112616 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8ea02fbe-2f81-4bd1-9064-158caba067dd tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:25.142299 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-e7c44293-e165-4187-ab1b-f2ef2c905d73 tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:25.143026 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-e7c44293-e165-4187-ab1b-f2ef2c905d73 tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] [instance: 5662b4d6-b524-45e0-abea-4803634bf4ea] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:25.162341 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e7c44293-e165-4187-ab1b-f2ef2c905d73 tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:25.163191 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e7c44293-e165-4187-ab1b-f2ef2c905d73 tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:25.163590 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e7c44293-e165-4187-ab1b-f2ef2c905d73 tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:25.164136 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e7c44293-e165-4187-ab1b-f2ef2c905d73 tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:25.164458 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e7c44293-e165-4187-ab1b-f2ef2c905d73 tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:25.164902 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e7c44293-e165-4187-ab1b-f2ef2c905d73 tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:25.188574 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-8ea02fbe-2f81-4bd1-9064-158caba067dd tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Getting quotas for project ed8f94cf1c974654a336645f453c9efc. Resources: {'ram', 'cores', 'instances'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:51:25.201566 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-8ea02fbe-2f81-4bd1-9064-158caba067dd tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Getting quotas for user 14707008940e4965ab7d1190094a71bb and project ed8f94cf1c974654a336645f453c9efc. Resources: {'ram', 'cores', 'instances'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:51:25.226388 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-8ea02fbe-2f81-4bd1-9064-158caba067dd tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Going to run 1 instances... {{(pid=123596) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:51:25.230090 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-8ea02fbe-2f81-4bd1-9064-158caba067dd tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] [instance: 59d7c8f0-8b36-45e7-bef6-ae97d40d231f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e8943ec5-4038-4d4b-b9b9-2415a79f5243',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123596) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:51:25.290533 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-8ea02fbe-2f81-4bd1-9064-158caba067dd tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.888105 Oct 04 18:51:25.291916 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2362/4439] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 18:51:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 890 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:51:25.304449 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-e5fc4bdb-10a6-4175-8fdd-d528158c0fe5 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:25.305413 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-e5fc4bdb-10a6-4175-8fdd-d528158c0fe5 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] [instance: 59d7c8f0-8b36-45e7-bef6-ae97d40d231f] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:25.513719 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-e5fc4bdb-10a6-4175-8fdd-d528158c0fe5 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14707008940e4965ab7d1190094a71bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8f94cf1c974654a336645f453c9efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:25.548845 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-e5fc4bdb-10a6-4175-8fdd-d528158c0fe5 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] 10.222.0.43 "GET /compute/v2.1/servers/59d7c8f0-8b36-45e7-bef6-ae97d40d231f" status: 200 len: 1208 microversion: 2.1 time: 0.249189 Oct 04 18:51:25.550791 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2363/4440] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:25 2022] GET /compute/v2.1/servers/59d7c8f0-8b36-45e7-bef6-ae97d40d231f => generated 1208 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:51:25.556023 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-a6730838-0b45-4984-9b3e-f159ab8a4413 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:25.556817 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-a6730838-0b45-4984-9b3e-f159ab8a4413 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] [instance: fa47906d-d394-46fe-9143-780bcd27a715] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:25.578251 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a6730838-0b45-4984-9b3e-f159ab8a4413 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:25.582206 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a6730838-0b45-4984-9b3e-f159ab8a4413 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:25.584122 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a6730838-0b45-4984-9b3e-f159ab8a4413 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:25.585074 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a6730838-0b45-4984-9b3e-f159ab8a4413 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:25.585854 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a6730838-0b45-4984-9b3e-f159ab8a4413 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:25.586448 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a6730838-0b45-4984-9b3e-f159ab8a4413 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:25.695171 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-a6730838-0b45-4984-9b3e-f159ab8a4413 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:25.710419 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-a6730838-0b45-4984-9b3e-f159ab8a4413 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:25.713689 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-a6730838-0b45-4984-9b3e-f159ab8a4413 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:25.715590 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-a6730838-0b45-4984-9b3e-f159ab8a4413 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] 10.222.0.43 "GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715" status: 200 len: 1604 microversion: 2.32 time: 0.163352 Oct 04 18:51:25.716871 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2364/4441] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:51:25 2022] GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715 => generated 1604 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:51:25.852091 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-0a6d5f74-9b4b-426c-abc6-76cdb2e51538 req-c95c4149-e9e8-48e7-8847-5716ce8fc069 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5662b4d6-b524-45e0-abea-4803634bf4ea", "tag": "25e08f7f-1e4f-4d30-96ab-d120abf94c43"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:51:25.886995 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-0a6d5f74-9b4b-426c-abc6-76cdb2e51538 req-c95c4149-e9e8-48e7-8847-5716ce8fc069 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:25.887497 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-0a6d5f74-9b4b-426c-abc6-76cdb2e51538 req-c95c4149-e9e8-48e7-8847-5716ce8fc069 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:25.887999 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-0a6d5f74-9b4b-426c-abc6-76cdb2e51538 req-c95c4149-e9e8-48e7-8847-5716ce8fc069 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:25.890056 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-e7c44293-e165-4187-ab1b-f2ef2c905d73 tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9039839957e6449c94e9b54b2097d6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08ee9e55650e4802bb32951c126fce8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:25.914576 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-0a6d5f74-9b4b-426c-abc6-76cdb2e51538 req-c95c4149-e9e8-48e7-8847-5716ce8fc069 service nova] Creating event network-changed:25e08f7f-1e4f-4d30-96ab-d120abf94c43 for instance 5662b4d6-b524-45e0-abea-4803634bf4ea on n-h2-851028-13 Oct 04 18:51:25.921647 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-e7c44293-e165-4187-ab1b-f2ef2c905d73 tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] 10.222.0.43 "GET /compute/v2.1/servers/5662b4d6-b524-45e0-abea-4803634bf4ea" status: 200 len: 1316 microversion: 2.1 time: 0.783481 Oct 04 18:51:25.935397 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2078/4442] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:25 2022] GET /compute/v2.1/servers/5662b4d6-b524-45e0-abea-4803634bf4ea => generated 1316 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:51:25.957953 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-0a6d5f74-9b4b-426c-abc6-76cdb2e51538 req-c95c4149-e9e8-48e7-8847-5716ce8fc069 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109956 Oct 04 18:51:25.961894 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2365/4443] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:51:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:51:26.571813 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-a12f6c38-8be2-4d12-a9b8-9e970dd7ae11 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:26.573465 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-a12f6c38-8be2-4d12-a9b8-9e970dd7ae11 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] [instance: 59d7c8f0-8b36-45e7-bef6-ae97d40d231f] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:26.585029 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a12f6c38-8be2-4d12-a9b8-9e970dd7ae11 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:26.585939 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a12f6c38-8be2-4d12-a9b8-9e970dd7ae11 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:26.604874 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a12f6c38-8be2-4d12-a9b8-9e970dd7ae11 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:26.611004 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a12f6c38-8be2-4d12-a9b8-9e970dd7ae11 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:26.620651 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a12f6c38-8be2-4d12-a9b8-9e970dd7ae11 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:26.624001 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a12f6c38-8be2-4d12-a9b8-9e970dd7ae11 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:26.749010 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-2cf45ca7-ada3-471a-9683-f905728d4ee5 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:26.757846 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-2cf45ca7-ada3-471a-9683-f905728d4ee5 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] [instance: fa47906d-d394-46fe-9143-780bcd27a715] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:26.771273 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2cf45ca7-ada3-471a-9683-f905728d4ee5 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:26.775442 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2cf45ca7-ada3-471a-9683-f905728d4ee5 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:26.776257 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2cf45ca7-ada3-471a-9683-f905728d4ee5 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:26.777464 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2cf45ca7-ada3-471a-9683-f905728d4ee5 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:26.778171 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2cf45ca7-ada3-471a-9683-f905728d4ee5 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:26.778847 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2cf45ca7-ada3-471a-9683-f905728d4ee5 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:26.904817 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-2cf45ca7-ada3-471a-9683-f905728d4ee5 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:26.925880 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-2cf45ca7-ada3-471a-9683-f905728d4ee5 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:26.931589 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-2cf45ca7-ada3-471a-9683-f905728d4ee5 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:26.932928 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-2cf45ca7-ada3-471a-9683-f905728d4ee5 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] 10.222.0.43 "GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715" status: 200 len: 1604 microversion: 2.32 time: 0.189378 Oct 04 18:51:26.950246 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2366/4444] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:51:26 2022] GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715 => generated 1604 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:51:26.959444 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-a121520c-65b7-4bea-b683-f2f07183c7c0 tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:26.960953 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-a121520c-65b7-4bea-b683-f2f07183c7c0 tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] [instance: 5662b4d6-b524-45e0-abea-4803634bf4ea] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:26.967593 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a121520c-65b7-4bea-b683-f2f07183c7c0 tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:26.968001 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a121520c-65b7-4bea-b683-f2f07183c7c0 tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:26.968441 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a121520c-65b7-4bea-b683-f2f07183c7c0 tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:26.969173 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a121520c-65b7-4bea-b683-f2f07183c7c0 tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:26.969715 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a121520c-65b7-4bea-b683-f2f07183c7c0 tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:26.970927 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a121520c-65b7-4bea-b683-f2f07183c7c0 tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:27.248854 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-a121520c-65b7-4bea-b683-f2f07183c7c0 tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9039839957e6449c94e9b54b2097d6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08ee9e55650e4802bb32951c126fce8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:27.262291 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-a121520c-65b7-4bea-b683-f2f07183c7c0 tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] 10.222.0.43 "GET /compute/v2.1/servers/5662b4d6-b524-45e0-abea-4803634bf4ea" status: 200 len: 1316 microversion: 2.1 time: 0.310409 Oct 04 18:51:27.280341 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2367/4445] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:26 2022] GET /compute/v2.1/servers/5662b4d6-b524-45e0-abea-4803634bf4ea => generated 1316 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:27.297518 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-a12f6c38-8be2-4d12-a9b8-9e970dd7ae11 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14707008940e4965ab7d1190094a71bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8f94cf1c974654a336645f453c9efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:27.311681 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-a12f6c38-8be2-4d12-a9b8-9e970dd7ae11 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] 10.222.0.43 "GET /compute/v2.1/servers/59d7c8f0-8b36-45e7-bef6-ae97d40d231f" status: 200 len: 1204 microversion: 2.1 time: 0.743577 Oct 04 18:51:27.313609 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2079/4446] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:26 2022] GET /compute/v2.1/servers/59d7c8f0-8b36-45e7-bef6-ae97d40d231f => generated 1204 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:27.980275 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-553fe9f4-1050-4d47-9197-3e8809856c44 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:27.981924 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-553fe9f4-1050-4d47-9197-3e8809856c44 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] [instance: fa47906d-d394-46fe-9143-780bcd27a715] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:28.023894 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-553fe9f4-1050-4d47-9197-3e8809856c44 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:28.033972 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-553fe9f4-1050-4d47-9197-3e8809856c44 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:28.037870 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-553fe9f4-1050-4d47-9197-3e8809856c44 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:28.044022 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-553fe9f4-1050-4d47-9197-3e8809856c44 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:28.045706 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-553fe9f4-1050-4d47-9197-3e8809856c44 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:28.047456 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-553fe9f4-1050-4d47-9197-3e8809856c44 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:28.301775 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-553fe9f4-1050-4d47-9197-3e8809856c44 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:28.306774 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-bd7a4ee8-c2ec-4a2f-bc19-70d7757e7705 tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:28.309757 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-bd7a4ee8-c2ec-4a2f-bc19-70d7757e7705 tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] [instance: 5662b4d6-b524-45e0-abea-4803634bf4ea] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:28.314241 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-553fe9f4-1050-4d47-9197-3e8809856c44 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:28.324058 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-553fe9f4-1050-4d47-9197-3e8809856c44 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:28.328908 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-553fe9f4-1050-4d47-9197-3e8809856c44 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] 10.222.0.43 "GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715" status: 200 len: 1604 microversion: 2.32 time: 0.355513 Oct 04 18:51:28.341179 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bd7a4ee8-c2ec-4a2f-bc19-70d7757e7705 tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:28.344904 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bd7a4ee8-c2ec-4a2f-bc19-70d7757e7705 tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:28.348993 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bd7a4ee8-c2ec-4a2f-bc19-70d7757e7705 tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:28.350030 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bd7a4ee8-c2ec-4a2f-bc19-70d7757e7705 tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:28.350716 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bd7a4ee8-c2ec-4a2f-bc19-70d7757e7705 tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:28.351436 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bd7a4ee8-c2ec-4a2f-bc19-70d7757e7705 tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:28.368609 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2368/4447] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:51:27 2022] GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715 => generated 1604 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:51:28.373616 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-0e3381b4-3ae4-4126-96f7-8c6afadbc717 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:28.374235 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-0e3381b4-3ae4-4126-96f7-8c6afadbc717 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] [instance: 59d7c8f0-8b36-45e7-bef6-ae97d40d231f] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:28.408000 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0e3381b4-3ae4-4126-96f7-8c6afadbc717 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:28.408504 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0e3381b4-3ae4-4126-96f7-8c6afadbc717 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:28.408951 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0e3381b4-3ae4-4126-96f7-8c6afadbc717 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:28.409823 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0e3381b4-3ae4-4126-96f7-8c6afadbc717 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:28.410315 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0e3381b4-3ae4-4126-96f7-8c6afadbc717 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:28.410728 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0e3381b4-3ae4-4126-96f7-8c6afadbc717 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:28.644780 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-0e3381b4-3ae4-4126-96f7-8c6afadbc717 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14707008940e4965ab7d1190094a71bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8f94cf1c974654a336645f453c9efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:28.665687 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-0e3381b4-3ae4-4126-96f7-8c6afadbc717 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] 10.222.0.43 "GET /compute/v2.1/servers/59d7c8f0-8b36-45e7-bef6-ae97d40d231f" status: 200 len: 1266 microversion: 2.1 time: 0.295788 Oct 04 18:51:28.670948 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2369/4448] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:28 2022] GET /compute/v2.1/servers/59d7c8f0-8b36-45e7-bef6-ae97d40d231f => generated 1266 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:28.884953 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-bd7a4ee8-c2ec-4a2f-bc19-70d7757e7705 tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9039839957e6449c94e9b54b2097d6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08ee9e55650e4802bb32951c126fce8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:28.894782 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-bd7a4ee8-c2ec-4a2f-bc19-70d7757e7705 tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] 10.222.0.43 "GET /compute/v2.1/servers/5662b4d6-b524-45e0-abea-4803634bf4ea" status: 200 len: 1316 microversion: 2.1 time: 0.609031 Oct 04 18:51:28.905283 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2080/4449] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:28 2022] GET /compute/v2.1/servers/5662b4d6-b524-45e0-abea-4803634bf4ea => generated 1316 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:29.363838 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-284bc2d9-95ff-4f7e-b2a6-4ea5f3cafbe6 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:29.365217 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-284bc2d9-95ff-4f7e-b2a6-4ea5f3cafbe6 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] [instance: fa47906d-d394-46fe-9143-780bcd27a715] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:29.377892 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-284bc2d9-95ff-4f7e-b2a6-4ea5f3cafbe6 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:29.381216 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-284bc2d9-95ff-4f7e-b2a6-4ea5f3cafbe6 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:29.382735 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-284bc2d9-95ff-4f7e-b2a6-4ea5f3cafbe6 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:29.386328 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-284bc2d9-95ff-4f7e-b2a6-4ea5f3cafbe6 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:29.387063 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-284bc2d9-95ff-4f7e-b2a6-4ea5f3cafbe6 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:29.387737 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-284bc2d9-95ff-4f7e-b2a6-4ea5f3cafbe6 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:29.449267 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-284bc2d9-95ff-4f7e-b2a6-4ea5f3cafbe6 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:29.449851 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-284bc2d9-95ff-4f7e-b2a6-4ea5f3cafbe6 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:29.450373 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-284bc2d9-95ff-4f7e-b2a6-4ea5f3cafbe6 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:29.450910 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.objects.instance [None req-284bc2d9-95ff-4f7e-b2a6-4ea5f3cafbe6 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lazy-loading 'fault' on Instance uuid fa47906d-d394-46fe-9143-780bcd27a715 {{(pid=123596) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:51:29.619736 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-284bc2d9-95ff-4f7e-b2a6-4ea5f3cafbe6 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:29.634443 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-284bc2d9-95ff-4f7e-b2a6-4ea5f3cafbe6 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:29.647114 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-284bc2d9-95ff-4f7e-b2a6-4ea5f3cafbe6 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0de7f497fae40aa885875065db35656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ecf69d8220477bb3006361f7a67825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:29.648382 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-284bc2d9-95ff-4f7e-b2a6-4ea5f3cafbe6 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] 10.222.0.43 "GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715" status: 200 len: 1609 microversion: 2.32 time: 0.292317 Oct 04 18:51:29.665494 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2370/4450] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:51:29 2022] GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715 => generated 1609 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:51:29.698251 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-b06f6b51-ddd9-47a2-b8ef-bb28b68a3b45 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:29.699563 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-b06f6b51-ddd9-47a2-b8ef-bb28b68a3b45 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] [instance: 59d7c8f0-8b36-45e7-bef6-ae97d40d231f] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:29.712698 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b06f6b51-ddd9-47a2-b8ef-bb28b68a3b45 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:29.713409 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b06f6b51-ddd9-47a2-b8ef-bb28b68a3b45 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:29.717354 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b06f6b51-ddd9-47a2-b8ef-bb28b68a3b45 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:29.718284 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b06f6b51-ddd9-47a2-b8ef-bb28b68a3b45 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:29.718909 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b06f6b51-ddd9-47a2-b8ef-bb28b68a3b45 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:29.719640 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b06f6b51-ddd9-47a2-b8ef-bb28b68a3b45 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:29.919124 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-2bb7fb0f-6a4d-44a3-b01d-329f43f58389 tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:29.919751 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-2bb7fb0f-6a4d-44a3-b01d-329f43f58389 tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] [instance: 5662b4d6-b524-45e0-abea-4803634bf4ea] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:29.932244 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2bb7fb0f-6a4d-44a3-b01d-329f43f58389 tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:29.935761 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2bb7fb0f-6a4d-44a3-b01d-329f43f58389 tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:29.936525 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2bb7fb0f-6a4d-44a3-b01d-329f43f58389 tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:29.937433 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2bb7fb0f-6a4d-44a3-b01d-329f43f58389 tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:29.941410 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2bb7fb0f-6a4d-44a3-b01d-329f43f58389 tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:29.942081 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2bb7fb0f-6a4d-44a3-b01d-329f43f58389 tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:30.040029 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-b06f6b51-ddd9-47a2-b8ef-bb28b68a3b45 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14707008940e4965ab7d1190094a71bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8f94cf1c974654a336645f453c9efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:30.063525 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-b06f6b51-ddd9-47a2-b8ef-bb28b68a3b45 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] 10.222.0.43 "GET /compute/v2.1/servers/59d7c8f0-8b36-45e7-bef6-ae97d40d231f" status: 200 len: 1266 microversion: 2.1 time: 0.369004 Oct 04 18:51:30.064883 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2081/4451] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:29 2022] GET /compute/v2.1/servers/59d7c8f0-8b36-45e7-bef6-ae97d40d231f => generated 1266 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:30.681671 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-853414e7-39bf-46f3-8b8c-10b403876079 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:30.682664 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-853414e7-39bf-46f3-8b8c-10b403876079 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] [instance: fa47906d-d394-46fe-9143-780bcd27a715] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:30.695513 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-2bb7fb0f-6a4d-44a3-b01d-329f43f58389 tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9039839957e6449c94e9b54b2097d6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08ee9e55650e4802bb32951c126fce8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:30.699065 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-853414e7-39bf-46f3-8b8c-10b403876079 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:30.699514 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-853414e7-39bf-46f3-8b8c-10b403876079 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:30.702983 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-853414e7-39bf-46f3-8b8c-10b403876079 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:30.704925 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-2bb7fb0f-6a4d-44a3-b01d-329f43f58389 tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] 10.222.0.43 "GET /compute/v2.1/servers/5662b4d6-b524-45e0-abea-4803634bf4ea" status: 200 len: 1316 microversion: 2.1 time: 0.789963 Oct 04 18:51:30.705778 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2371/4452] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:29 2022] GET /compute/v2.1/servers/5662b4d6-b524-45e0-abea-4803634bf4ea => generated 1316 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:30.708524 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-853414e7-39bf-46f3-8b8c-10b403876079 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:30.709018 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-853414e7-39bf-46f3-8b8c-10b403876079 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:30.709499 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-853414e7-39bf-46f3-8b8c-10b403876079 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:30.817405 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-853414e7-39bf-46f3-8b8c-10b403876079 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] HTTP exception thrown: Instance fa47906d-d394-46fe-9143-780bcd27a715 could not be found. Oct 04 18:51:30.819737 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-853414e7-39bf-46f3-8b8c-10b403876079 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Request method failure captured: Oct 04 18:51:30.819737 n-d-851028-13 devstack@n-api.service[123595]: request: GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715 HTTP/1.1 Oct 04 18:51:30.819737 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 18:51:30.819737 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 18:51:30.819737 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 18:51:30.819737 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 0 Oct 04 18:51:30.819737 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 18:51:30.819737 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 18:51:30.819737 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 18:51:30.819737 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 18:51:30.819737 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPH8NWVKEfrrX5SPJc3qTADgQnuhmEeKt3nRSTivLmcX_1rJ7sWD89vofM56bQc5QLhRgAQaumq4Ugrzk12CMCNugRMuczvfyJb-xdOi8x887qB_Hc_CwQXDH-MOJSbSaiKxsjArYsso5rqrTQPK2K7D2kDjIq43_WpRWruAQ4fM1lEc Oct 04 18:51:30.819737 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 18:51:30.819737 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 18:51:30.819737 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 18:51:30.819737 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 18:51:30.819737 n-d-851028-13 devstack@n-api.service[123595]: X-Openstack-Nova-Api-Version: 2.32 Oct 04 18:51:30.819737 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 18:51:30.819737 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 18:51:30.819737 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: 98ecf69d8220477bb3006361f7a67825 Oct 04 18:51:30.819737 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-TaggedBootDevicesTest-1281917818 Oct 04 18:51:30.819737 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 18:51:30.819737 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 18:51:30.819737 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/98ecf69d8220477bb3006361f7a67825"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_98ecf69d8220477bb3006361f7a67825"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/98ecf69d8220477bb3006361f7a67825"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/98ecf69d8220477bb3006361f7a67825"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:51:30.819737 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-TaggedBootDevicesTest-1281917818 Oct 04 18:51:30.819737 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: 98ecf69d8220477bb3006361f7a67825 Oct 04 18:51:30.819737 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1281917818 Oct 04 18:51:30.819737 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-TaggedBootDevicesTest-1281917818-project Oct 04 18:51:30.819737 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 18:51:30.819737 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 18:51:30.819737 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: a0de7f497fae40aa885875065db35656 Oct 04 18:51:30.819737 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-TaggedBootDevicesTest-1281917818-project Oct 04 18:51:30.819737 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 18:51:30.819737 n-d-851028-13 devstack@n-api.service[123595]: exception: Instance fa47906d-d394-46fe-9143-780bcd27a715 could not be found. Oct 04 18:51:30.819737 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': 'fa47906d-d394-46fe-9143-780bcd27a715'} Oct 04 18:51:30.819737 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:51:30.819737 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:51:30.819737 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:51:30.819737 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:51:30.819737 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:51:30.819737 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:51:30.819737 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:51:30.819737 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:51:30.819737 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:51:30.819737 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:51:30.819737 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa47906d-d394-46fe-9143-780bcd27a715 could not be found. Oct 04 18:51:30.819737 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:51:30.819737 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:51:30.819737 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:51:30.819737 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:51:30.819737 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:51:30.819737 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:51:30.819737 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:51:30.819737 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:51:30.819737 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:51:30.819737 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:51:30.819737 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:51:30.819737 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:51:30.819737 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:51:30.819737 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:51:30.819737 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:51:30.819737 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:51:30.819737 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa47906d-d394-46fe-9143-780bcd27a715 could not be found. Oct 04 18:51:30.819737 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:51:30.819737 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:51:30.824826 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:51:30.824826 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:51:30.824826 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:51:30.824826 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:51:30.824826 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:51:30.824826 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:51:30.824826 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa47906d-d394-46fe-9143-780bcd27a715 could not be found. Oct 04 18:51:30.824826 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:51:30.833591 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-853414e7-39bf-46f3-8b8c-10b403876079 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Returning 404 to user: Instance fa47906d-d394-46fe-9143-780bcd27a715 could not be found. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:51:30.837270 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-853414e7-39bf-46f3-8b8c-10b403876079 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] 10.222.0.43 "GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715" status: 404 len: 111 microversion: 2.32 time: 0.160066 Oct 04 18:51:30.846831 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2082/4453] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:51:30 2022] GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715 => generated 111 bytes in 170 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 04 18:51:30.848578 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-86f50d42-f02a-42fa-b40a-27ecfe68cc75 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Calling method '.version_select at 0x7fb21ec21310>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:30.892422 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-86f50d42-f02a-42fa-b40a-27ecfe68cc75 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1444947530" status: 204 len: 0 microversion: 2.32 time: 0.049522 Oct 04 18:51:30.895588 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2372/4454] 10.222.0.43 () {60 vars in 1262 bytes} [Tue Oct 4 18:51:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1444947530 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 18:51:31.089924 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-3350c6a8-088c-4e86-881e-618b801a3cda tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:31.090637 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-3350c6a8-088c-4e86-881e-618b801a3cda tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] [instance: 59d7c8f0-8b36-45e7-bef6-ae97d40d231f] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:31.108089 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3350c6a8-088c-4e86-881e-618b801a3cda tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:31.108596 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3350c6a8-088c-4e86-881e-618b801a3cda tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:31.114629 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3350c6a8-088c-4e86-881e-618b801a3cda tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:31.115622 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3350c6a8-088c-4e86-881e-618b801a3cda tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:31.116296 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3350c6a8-088c-4e86-881e-618b801a3cda tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:31.116745 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3350c6a8-088c-4e86-881e-618b801a3cda tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:31.475431 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-3350c6a8-088c-4e86-881e-618b801a3cda tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14707008940e4965ab7d1190094a71bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8f94cf1c974654a336645f453c9efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:31.491491 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-3350c6a8-088c-4e86-881e-618b801a3cda tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] 10.222.0.43 "GET /compute/v2.1/servers/59d7c8f0-8b36-45e7-bef6-ae97d40d231f" status: 200 len: 1308 microversion: 2.1 time: 0.406860 Oct 04 18:51:31.492110 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2083/4455] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:31 2022] GET /compute/v2.1/servers/59d7c8f0-8b36-45e7-bef6-ae97d40d231f => generated 1308 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:31.737472 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-e7c4aeee-1a8f-4862-bbb8-3998a1bf16da tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:31.739874 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-e7c4aeee-1a8f-4862-bbb8-3998a1bf16da tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] [instance: 5662b4d6-b524-45e0-abea-4803634bf4ea] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:31.774775 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e7c4aeee-1a8f-4862-bbb8-3998a1bf16da tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:31.775432 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e7c4aeee-1a8f-4862-bbb8-3998a1bf16da tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:31.776090 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e7c4aeee-1a8f-4862-bbb8-3998a1bf16da tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:31.777031 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e7c4aeee-1a8f-4862-bbb8-3998a1bf16da tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:31.777747 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e7c4aeee-1a8f-4862-bbb8-3998a1bf16da tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:31.778425 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e7c4aeee-1a8f-4862-bbb8-3998a1bf16da tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:32.521575 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-fa496e72-0923-4372-b442-cff84a4c2973 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:32.522745 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-fa496e72-0923-4372-b442-cff84a4c2973 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] [instance: 59d7c8f0-8b36-45e7-bef6-ae97d40d231f] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:32.532918 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fa496e72-0923-4372-b442-cff84a4c2973 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:32.533439 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fa496e72-0923-4372-b442-cff84a4c2973 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:32.537227 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fa496e72-0923-4372-b442-cff84a4c2973 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:32.538434 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fa496e72-0923-4372-b442-cff84a4c2973 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:32.540410 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fa496e72-0923-4372-b442-cff84a4c2973 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:32.542492 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fa496e72-0923-4372-b442-cff84a4c2973 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:32.610992 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-e7c4aeee-1a8f-4862-bbb8-3998a1bf16da tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9039839957e6449c94e9b54b2097d6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08ee9e55650e4802bb32951c126fce8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:32.665021 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-e7c4aeee-1a8f-4862-bbb8-3998a1bf16da tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] 10.222.0.43 "GET /compute/v2.1/servers/5662b4d6-b524-45e0-abea-4803634bf4ea" status: 200 len: 1316 microversion: 2.1 time: 0.932914 Oct 04 18:51:32.683912 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2373/4456] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:31 2022] GET /compute/v2.1/servers/5662b4d6-b524-45e0-abea-4803634bf4ea => generated 1316 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:33.041911 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-93ec5306-1f2e-486b-8493-2ef9c49e87b1 req-f22421e7-a24e-4156-a4b4-1dc5bac8a3e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59d7c8f0-8b36-45e7-bef6-ae97d40d231f", "tag": "db6546c5-c59c-4c1e-b900-1a00fb333499"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:51:33.060084 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-93ec5306-1f2e-486b-8493-2ef9c49e87b1 req-f22421e7-a24e-4156-a4b4-1dc5bac8a3e6 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:33.060654 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-93ec5306-1f2e-486b-8493-2ef9c49e87b1 req-f22421e7-a24e-4156-a4b4-1dc5bac8a3e6 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:33.061215 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-93ec5306-1f2e-486b-8493-2ef9c49e87b1 req-f22421e7-a24e-4156-a4b4-1dc5bac8a3e6 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:33.078836 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-93ec5306-1f2e-486b-8493-2ef9c49e87b1 req-f22421e7-a24e-4156-a4b4-1dc5bac8a3e6 service nova] Creating event network-changed:db6546c5-c59c-4c1e-b900-1a00fb333499 for instance 59d7c8f0-8b36-45e7-bef6-ae97d40d231f on n-h1-851028-13 Oct 04 18:51:33.086962 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-93ec5306-1f2e-486b-8493-2ef9c49e87b1 req-f22421e7-a24e-4156-a4b4-1dc5bac8a3e6 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051509 Oct 04 18:51:33.087998 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2374/4457] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:51:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:51:33.236658 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-fa496e72-0923-4372-b442-cff84a4c2973 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14707008940e4965ab7d1190094a71bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8f94cf1c974654a336645f453c9efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:33.245159 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-fa496e72-0923-4372-b442-cff84a4c2973 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] 10.222.0.43 "GET /compute/v2.1/servers/59d7c8f0-8b36-45e7-bef6-ae97d40d231f" status: 200 len: 1308 microversion: 2.1 time: 0.728253 Oct 04 18:51:33.250652 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2084/4458] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:32 2022] GET /compute/v2.1/servers/59d7c8f0-8b36-45e7-bef6-ae97d40d231f => generated 1308 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:33.701441 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-dec37162-4363-4a4f-8275-d004b1ce2cca tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:33.702418 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-dec37162-4363-4a4f-8275-d004b1ce2cca tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] [instance: 5662b4d6-b524-45e0-abea-4803634bf4ea] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:33.718482 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dec37162-4363-4a4f-8275-d004b1ce2cca tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:33.718930 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dec37162-4363-4a4f-8275-d004b1ce2cca tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:33.719380 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dec37162-4363-4a4f-8275-d004b1ce2cca tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:33.720097 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dec37162-4363-4a4f-8275-d004b1ce2cca tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:33.727525 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dec37162-4363-4a4f-8275-d004b1ce2cca tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:33.733406 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dec37162-4363-4a4f-8275-d004b1ce2cca tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:33.783026 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=100 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:51:34.276385 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-ca4481f0-f489-4bbd-97db-51b22ec59190 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:34.277936 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-ca4481f0-f489-4bbd-97db-51b22ec59190 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] [instance: 59d7c8f0-8b36-45e7-bef6-ae97d40d231f] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:34.295783 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ca4481f0-f489-4bbd-97db-51b22ec59190 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:34.296163 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ca4481f0-f489-4bbd-97db-51b22ec59190 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:34.296998 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ca4481f0-f489-4bbd-97db-51b22ec59190 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:34.298670 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ca4481f0-f489-4bbd-97db-51b22ec59190 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:34.299522 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ca4481f0-f489-4bbd-97db-51b22ec59190 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:34.300193 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ca4481f0-f489-4bbd-97db-51b22ec59190 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:34.388686 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-dec37162-4363-4a4f-8275-d004b1ce2cca tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9039839957e6449c94e9b54b2097d6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08ee9e55650e4802bb32951c126fce8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:34.402282 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-dec37162-4363-4a4f-8275-d004b1ce2cca tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] 10.222.0.43 "GET /compute/v2.1/servers/5662b4d6-b524-45e0-abea-4803634bf4ea" status: 200 len: 1316 microversion: 2.1 time: 0.706635 Oct 04 18:51:34.406084 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2375/4459] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:33 2022] GET /compute/v2.1/servers/5662b4d6-b524-45e0-abea-4803634bf4ea => generated 1316 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:34.419922 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-d1e875f5-1bfb-42f2-9b8c-e2462e6b7ea6 req-61e3dcc8-8cd8-496c-8383-343d5a7874d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5662b4d6-b524-45e0-abea-4803634bf4ea", "name": "network-vif-plugged", "status": "completed", "tag": "25e08f7f-1e4f-4d30-96ab-d120abf94c43"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:51:34.444111 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-d1e875f5-1bfb-42f2-9b8c-e2462e6b7ea6 req-61e3dcc8-8cd8-496c-8383-343d5a7874d7 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:34.444636 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-d1e875f5-1bfb-42f2-9b8c-e2462e6b7ea6 req-61e3dcc8-8cd8-496c-8383-343d5a7874d7 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:34.445642 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-d1e875f5-1bfb-42f2-9b8c-e2462e6b7ea6 req-61e3dcc8-8cd8-496c-8383-343d5a7874d7 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:34.465008 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-d1e875f5-1bfb-42f2-9b8c-e2462e6b7ea6 req-61e3dcc8-8cd8-496c-8383-343d5a7874d7 service nova] Creating event network-vif-plugged:25e08f7f-1e4f-4d30-96ab-d120abf94c43 for instance 5662b4d6-b524-45e0-abea-4803634bf4ea on n-h2-851028-13 Oct 04 18:51:34.472045 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-d1e875f5-1bfb-42f2-9b8c-e2462e6b7ea6 req-61e3dcc8-8cd8-496c-8383-343d5a7874d7 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064181 Oct 04 18:51:34.473599 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2376/4460] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:51:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:51:34.540281 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-ca4481f0-f489-4bbd-97db-51b22ec59190 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14707008940e4965ab7d1190094a71bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8f94cf1c974654a336645f453c9efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:34.568039 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-ca4481f0-f489-4bbd-97db-51b22ec59190 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] 10.222.0.43 "GET /compute/v2.1/servers/59d7c8f0-8b36-45e7-bef6-ae97d40d231f" status: 200 len: 1308 microversion: 2.1 time: 0.301222 Oct 04 18:51:34.569275 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2085/4461] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:34 2022] GET /compute/v2.1/servers/59d7c8f0-8b36-45e7-bef6-ae97d40d231f => generated 1308 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:35.430097 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-0bc9f7ed-a594-4fa5-bf8d-6ed5a68c256f tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:35.430972 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-0bc9f7ed-a594-4fa5-bf8d-6ed5a68c256f tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] [instance: 5662b4d6-b524-45e0-abea-4803634bf4ea] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:35.437659 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=2 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:51:35.455189 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0bc9f7ed-a594-4fa5-bf8d-6ed5a68c256f tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:35.458247 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0bc9f7ed-a594-4fa5-bf8d-6ed5a68c256f tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:35.462237 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0bc9f7ed-a594-4fa5-bf8d-6ed5a68c256f tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:35.463394 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0bc9f7ed-a594-4fa5-bf8d-6ed5a68c256f tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:35.465335 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0bc9f7ed-a594-4fa5-bf8d-6ed5a68c256f tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:35.465970 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0bc9f7ed-a594-4fa5-bf8d-6ed5a68c256f tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:35.537433 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=8 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:51:35.592405 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-19233d60-860e-439b-a054-e0e91722c4df tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:35.593908 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-19233d60-860e-439b-a054-e0e91722c4df tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] [instance: 59d7c8f0-8b36-45e7-bef6-ae97d40d231f] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:35.627063 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-19233d60-860e-439b-a054-e0e91722c4df tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:35.627819 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-19233d60-860e-439b-a054-e0e91722c4df tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:35.629145 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-19233d60-860e-439b-a054-e0e91722c4df tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:35.632794 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-19233d60-860e-439b-a054-e0e91722c4df tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:35.635138 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-19233d60-860e-439b-a054-e0e91722c4df tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:35.637183 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-19233d60-860e-439b-a054-e0e91722c4df tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:36.215768 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-0bc9f7ed-a594-4fa5-bf8d-6ed5a68c256f tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9039839957e6449c94e9b54b2097d6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08ee9e55650e4802bb32951c126fce8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:36.234191 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-0bc9f7ed-a594-4fa5-bf8d-6ed5a68c256f tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] 10.222.0.43 "GET /compute/v2.1/servers/5662b4d6-b524-45e0-abea-4803634bf4ea" status: 200 len: 1316 microversion: 2.1 time: 0.808804 Oct 04 18:51:36.240266 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2377/4462] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:35 2022] GET /compute/v2.1/servers/5662b4d6-b524-45e0-abea-4803634bf4ea => generated 1316 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:37.263615 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-c96fd495-6e62-4981-a863-6756d629f923 tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:37.265026 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-c96fd495-6e62-4981-a863-6756d629f923 tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] [instance: 5662b4d6-b524-45e0-abea-4803634bf4ea] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:37.278032 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:51:37.282279 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c96fd495-6e62-4981-a863-6756d629f923 tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:37.283101 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c96fd495-6e62-4981-a863-6756d629f923 tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:37.287139 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c96fd495-6e62-4981-a863-6756d629f923 tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:37.289026 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c96fd495-6e62-4981-a863-6756d629f923 tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:37.291281 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c96fd495-6e62-4981-a863-6756d629f923 tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:37.294855 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c96fd495-6e62-4981-a863-6756d629f923 tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:37.591514 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-19233d60-860e-439b-a054-e0e91722c4df tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14707008940e4965ab7d1190094a71bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8f94cf1c974654a336645f453c9efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:37.604294 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-19233d60-860e-439b-a054-e0e91722c4df tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] 10.222.0.43 "GET /compute/v2.1/servers/59d7c8f0-8b36-45e7-bef6-ae97d40d231f" status: 200 len: 1308 microversion: 2.1 time: 2.016236 Oct 04 18:51:37.607830 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2086/4463] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:35 2022] GET /compute/v2.1/servers/59d7c8f0-8b36-45e7-bef6-ae97d40d231f => generated 1308 bytes in 2020 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:38.414967 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-c96fd495-6e62-4981-a863-6756d629f923 tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9039839957e6449c94e9b54b2097d6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08ee9e55650e4802bb32951c126fce8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:38.431349 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-c96fd495-6e62-4981-a863-6756d629f923 tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] 10.222.0.43 "GET /compute/v2.1/servers/5662b4d6-b524-45e0-abea-4803634bf4ea" status: 200 len: 1504 microversion: 2.1 time: 1.172183 Oct 04 18:51:38.435816 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2378/4464] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:37 2022] GET /compute/v2.1/servers/5662b4d6-b524-45e0-abea-4803634bf4ea => generated 1504 bytes in 1177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:38.464121 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-a44f9478-9edc-40ef-a884-ce9b60d664fa tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:38.464805 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-a44f9478-9edc-40ef-a884-ce9b60d664fa tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] [instance: 5662b4d6-b524-45e0-abea-4803634bf4ea] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:38.483657 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a44f9478-9edc-40ef-a884-ce9b60d664fa tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:38.492678 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a44f9478-9edc-40ef-a884-ce9b60d664fa tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:38.493192 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a44f9478-9edc-40ef-a884-ce9b60d664fa tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:38.493955 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a44f9478-9edc-40ef-a884-ce9b60d664fa tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:38.494702 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a44f9478-9edc-40ef-a884-ce9b60d664fa tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:38.494821 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a44f9478-9edc-40ef-a884-ce9b60d664fa tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:38.636763 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-081c8870-76c8-4599-85e6-38713ff3eb45 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:38.637467 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-081c8870-76c8-4599-85e6-38713ff3eb45 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] [instance: 59d7c8f0-8b36-45e7-bef6-ae97d40d231f] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:38.683116 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-081c8870-76c8-4599-85e6-38713ff3eb45 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:38.684843 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-081c8870-76c8-4599-85e6-38713ff3eb45 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:38.689305 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-081c8870-76c8-4599-85e6-38713ff3eb45 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:38.693551 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-081c8870-76c8-4599-85e6-38713ff3eb45 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:38.694062 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-081c8870-76c8-4599-85e6-38713ff3eb45 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:38.694510 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-081c8870-76c8-4599-85e6-38713ff3eb45 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:38.852428 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=2,nova_cell1:INSERT=5 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:51:38.882043 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-a44f9478-9edc-40ef-a884-ce9b60d664fa tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] 10.222.0.43 "DELETE /compute/v2.1/servers/5662b4d6-b524-45e0-abea-4803634bf4ea/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.415681 Oct 04 18:51:38.884922 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2087/4465] 10.222.0.43 () {58 vars in 1296 bytes} [Tue Oct 4 18:51:38 2022] DELETE /compute/v2.1/servers/5662b4d6-b524-45e0-abea-4803634bf4ea/os-server-password => generated 0 bytes in 426 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:51:38.894419 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-ce45c00e-49e7-4357-874d-8532891616ea tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:38.898404 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-ce45c00e-49e7-4357-874d-8532891616ea tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] [instance: 5662b4d6-b524-45e0-abea-4803634bf4ea] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:38.920951 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ce45c00e-49e7-4357-874d-8532891616ea tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:38.922529 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ce45c00e-49e7-4357-874d-8532891616ea tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:38.925194 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ce45c00e-49e7-4357-874d-8532891616ea tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:38.927509 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ce45c00e-49e7-4357-874d-8532891616ea tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:38.928400 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ce45c00e-49e7-4357-874d-8532891616ea tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:38.932684 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ce45c00e-49e7-4357-874d-8532891616ea tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:38.977593 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-ce45c00e-49e7-4357-874d-8532891616ea tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] 10.222.0.43 "GET /compute/v2.1/servers/5662b4d6-b524-45e0-abea-4803634bf4ea/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.087083 Oct 04 18:51:38.984435 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2088/4466] 10.222.0.43 () {58 vars in 1293 bytes} [Tue Oct 4 18:51:38 2022] GET /compute/v2.1/servers/5662b4d6-b524-45e0-abea-4803634bf4ea/os-server-password => generated 16 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:51:38.990747 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-01ffca31-0f2c-4d15-9602-840019c66132 tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:38.991492 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-01ffca31-0f2c-4d15-9602-840019c66132 tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] [instance: 5662b4d6-b524-45e0-abea-4803634bf4ea] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:38.998272 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-01ffca31-0f2c-4d15-9602-840019c66132 tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:38.998856 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-01ffca31-0f2c-4d15-9602-840019c66132 tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:38.999561 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-01ffca31-0f2c-4d15-9602-840019c66132 tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:39.000720 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-01ffca31-0f2c-4d15-9602-840019c66132 tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:39.001286 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-01ffca31-0f2c-4d15-9602-840019c66132 tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:39.001943 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-01ffca31-0f2c-4d15-9602-840019c66132 tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:39.056548 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-01ffca31-0f2c-4d15-9602-840019c66132 tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] [instance: 5662b4d6-b524-45e0-abea-4803634bf4ea] Going to try to terminate instance {{(pid=123595) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:51:39.229274 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-01ffca31-0f2c-4d15-9602-840019c66132 tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] 10.222.0.43 "DELETE /compute/v2.1/servers/5662b4d6-b524-45e0-abea-4803634bf4ea" status: 204 len: 0 microversion: 2.1 time: 0.238976 Oct 04 18:51:39.231510 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2089/4467] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 18:51:38 2022] DELETE /compute/v2.1/servers/5662b4d6-b524-45e0-abea-4803634bf4ea => generated 0 bytes in 246 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:51:39.266569 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-11fb76cb-9cee-492c-a8be-1e20b9ae4235 tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:39.271872 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-11fb76cb-9cee-492c-a8be-1e20b9ae4235 tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] [instance: 5662b4d6-b524-45e0-abea-4803634bf4ea] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:39.294311 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-11fb76cb-9cee-492c-a8be-1e20b9ae4235 tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:39.294814 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-11fb76cb-9cee-492c-a8be-1e20b9ae4235 tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:39.295262 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-11fb76cb-9cee-492c-a8be-1e20b9ae4235 tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:39.295987 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-11fb76cb-9cee-492c-a8be-1e20b9ae4235 tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:39.296446 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-11fb76cb-9cee-492c-a8be-1e20b9ae4235 tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:39.296880 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-11fb76cb-9cee-492c-a8be-1e20b9ae4235 tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:39.447996 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-081c8870-76c8-4599-85e6-38713ff3eb45 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14707008940e4965ab7d1190094a71bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8f94cf1c974654a336645f453c9efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:39.468447 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-081c8870-76c8-4599-85e6-38713ff3eb45 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] 10.222.0.43 "GET /compute/v2.1/servers/59d7c8f0-8b36-45e7-bef6-ae97d40d231f" status: 200 len: 1308 microversion: 2.1 time: 0.836617 Oct 04 18:51:39.486066 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2379/4468] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:38 2022] GET /compute/v2.1/servers/59d7c8f0-8b36-45e7-bef6-ae97d40d231f => generated 1308 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:51:39.566091 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-4002ba1a-7f25-44ce-ad42-ed417aabad4e req-43b58df4-969d-4000-bf0e-41880ae494a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59d7c8f0-8b36-45e7-bef6-ae97d40d231f", "name": "network-vif-plugged", "status": "completed", "tag": "db6546c5-c59c-4c1e-b900-1a00fb333499"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:51:39.591933 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-4002ba1a-7f25-44ce-ad42-ed417aabad4e req-43b58df4-969d-4000-bf0e-41880ae494a6 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:39.592705 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-4002ba1a-7f25-44ce-ad42-ed417aabad4e req-43b58df4-969d-4000-bf0e-41880ae494a6 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:39.595952 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-4002ba1a-7f25-44ce-ad42-ed417aabad4e req-43b58df4-969d-4000-bf0e-41880ae494a6 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:39.633713 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-4002ba1a-7f25-44ce-ad42-ed417aabad4e req-43b58df4-969d-4000-bf0e-41880ae494a6 service nova] Creating event network-vif-plugged:db6546c5-c59c-4c1e-b900-1a00fb333499 for instance 59d7c8f0-8b36-45e7-bef6-ae97d40d231f on n-h1-851028-13 Oct 04 18:51:39.668002 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-4002ba1a-7f25-44ce-ad42-ed417aabad4e req-43b58df4-969d-4000-bf0e-41880ae494a6 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091930 Oct 04 18:51:39.681943 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2380/4469] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:51:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:51:40.105673 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-11fb76cb-9cee-492c-a8be-1e20b9ae4235 tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9039839957e6449c94e9b54b2097d6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08ee9e55650e4802bb32951c126fce8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:40.122955 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-11fb76cb-9cee-492c-a8be-1e20b9ae4235 tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] 10.222.0.43 "GET /compute/v2.1/servers/5662b4d6-b524-45e0-abea-4803634bf4ea" status: 200 len: 1510 microversion: 2.1 time: 0.887064 Oct 04 18:51:40.123725 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2090/4470] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:39 2022] GET /compute/v2.1/servers/5662b4d6-b524-45e0-abea-4803634bf4ea => generated 1510 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:40.515829 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-b4d88c36-2775-47c4-8dd9-fe099dae524d tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:40.516541 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-b4d88c36-2775-47c4-8dd9-fe099dae524d tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] [instance: 59d7c8f0-8b36-45e7-bef6-ae97d40d231f] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:40.549233 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b4d88c36-2775-47c4-8dd9-fe099dae524d tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:40.549766 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b4d88c36-2775-47c4-8dd9-fe099dae524d tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:40.555759 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b4d88c36-2775-47c4-8dd9-fe099dae524d tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:40.556496 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b4d88c36-2775-47c4-8dd9-fe099dae524d tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:40.557174 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b4d88c36-2775-47c4-8dd9-fe099dae524d tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:40.563145 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b4d88c36-2775-47c4-8dd9-fe099dae524d tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:41.026312 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-5982bd95-94b9-4115-aba2-973889467e25 tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "28d740af-3120-446c-9f68-d973cb9a5e67"}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:51:41.031559 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-5982bd95-94b9-4115-aba2-973889467e25 tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] [instance: 8fc3c2f5-e86b-4bf0-a124-750ea71e52ad] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:41.041094 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5982bd95-94b9-4115-aba2-973889467e25 tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:41.041717 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5982bd95-94b9-4115-aba2-973889467e25 tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:41.042222 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5982bd95-94b9-4115-aba2-973889467e25 tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:41.043095 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5982bd95-94b9-4115-aba2-973889467e25 tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:41.043559 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5982bd95-94b9-4115-aba2-973889467e25 tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:41.044026 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5982bd95-94b9-4115-aba2-973889467e25 tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:41.547687 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-5982bd95-94b9-4115-aba2-973889467e25 tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] 10.222.0.43 "POST /compute/v2.1/servers/8fc3c2f5-e86b-4bf0-a124-750ea71e52ad/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.525694 Oct 04 18:51:41.554549 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2091/4471] 10.222.0.43 () {60 vars in 1323 bytes} [Tue Oct 4 18:51:41 2022] POST /compute/v2.1/servers/8fc3c2f5-e86b-4bf0-a124-750ea71e52ad/os-volume_attachments => generated 194 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:51:41.580833 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-be28df13-3c67-4da2-a00a-ea6e37c015ab tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:41.581779 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-be28df13-3c67-4da2-a00a-ea6e37c015ab tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] [instance: 5662b4d6-b524-45e0-abea-4803634bf4ea] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:41.627041 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-be28df13-3c67-4da2-a00a-ea6e37c015ab tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:41.630216 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-be28df13-3c67-4da2-a00a-ea6e37c015ab tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:41.634435 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-be28df13-3c67-4da2-a00a-ea6e37c015ab tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:41.635355 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-be28df13-3c67-4da2-a00a-ea6e37c015ab tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:41.636953 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-be28df13-3c67-4da2-a00a-ea6e37c015ab tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:41.639995 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-be28df13-3c67-4da2-a00a-ea6e37c015ab tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:42.010558 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-b4d88c36-2775-47c4-8dd9-fe099dae524d tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14707008940e4965ab7d1190094a71bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8f94cf1c974654a336645f453c9efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:42.022772 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-b4d88c36-2775-47c4-8dd9-fe099dae524d tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] 10.222.0.43 "GET /compute/v2.1/servers/59d7c8f0-8b36-45e7-bef6-ae97d40d231f" status: 200 len: 1308 microversion: 2.1 time: 1.511244 Oct 04 18:51:42.025538 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2381/4472] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:40 2022] GET /compute/v2.1/servers/59d7c8f0-8b36-45e7-bef6-ae97d40d231f => generated 1308 bytes in 1515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:42.069377 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-7841e0e2-0f29-4002-8a7c-499706bb15c4 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:42.070171 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-7841e0e2-0f29-4002-8a7c-499706bb15c4 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] [instance: f2269817-3e15-4cfe-8446-7eb0104f9800] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:42.078738 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7841e0e2-0f29-4002-8a7c-499706bb15c4 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:42.082834 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7841e0e2-0f29-4002-8a7c-499706bb15c4 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:42.084066 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7841e0e2-0f29-4002-8a7c-499706bb15c4 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:42.086218 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7841e0e2-0f29-4002-8a7c-499706bb15c4 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:42.088953 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7841e0e2-0f29-4002-8a7c-499706bb15c4 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:42.090946 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7841e0e2-0f29-4002-8a7c-499706bb15c4 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:42.133709 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-7841e0e2-0f29-4002-8a7c-499706bb15c4 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] HTTP exception thrown: Instance f2269817-3e15-4cfe-8446-7eb0104f9800 could not be found. Oct 04 18:51:42.136884 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-7841e0e2-0f29-4002-8a7c-499706bb15c4 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Request method failure captured: Oct 04 18:51:42.136884 n-d-851028-13 devstack@n-api.service[123596]: request: DELETE /compute/v2.1/servers/f2269817-3e15-4cfe-8446-7eb0104f9800 HTTP/1.1 Oct 04 18:51:42.136884 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:51:42.136884 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:51:42.136884 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:51:42.136884 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 18:51:42.136884 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:51:42.136884 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:51:42.136884 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:51:42.136884 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:51:42.136884 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPH8lkGy0nZwltj3uDmeGQrZQwg6iRmriNLJ5vdTxYDzuDEs4JzrRDRI_AZvLAjZh5V6GRRv2aL1Ucq2iBU4yNUHCglEfTAOxdnVxtvedAn0I6kngigKmNkAB_2-EZ56jXiOuDwiOsK_AD_cvM52BvcLg72IQH_PTBSCnO4tX8aOV0qA Oct 04 18:51:42.136884 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:51:42.136884 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:51:42.136884 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:51:42.136884 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:51:42.136884 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:51:42.136884 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:51:42.136884 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: ff3c3dc76405401baf72fe00c5d50b56 Oct 04 18:51:42.136884 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-AttachVolumeTestJSON-517546326 Oct 04 18:51:42.136884 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 18:51:42.136884 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 18:51:42.136884 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/ff3c3dc76405401baf72fe00c5d50b56"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_ff3c3dc76405401baf72fe00c5d50b56"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ff3c3dc76405401baf72fe00c5d50b56"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ff3c3dc76405401baf72fe00c5d50b56"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:51:42.136884 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-AttachVolumeTestJSON-517546326 Oct 04 18:51:42.136884 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: ff3c3dc76405401baf72fe00c5d50b56 Oct 04 18:51:42.136884 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-AttachVolumeTestJSON-517546326 Oct 04 18:51:42.136884 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-AttachVolumeTestJSON-517546326-project Oct 04 18:51:42.136884 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:51:42.136884 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:51:42.136884 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: a116f2d9656548458264cc4fb1934c18 Oct 04 18:51:42.136884 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-AttachVolumeTestJSON-517546326-project Oct 04 18:51:42.136884 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 18:51:42.136884 n-d-851028-13 devstack@n-api.service[123596]: exception: Instance f2269817-3e15-4cfe-8446-7eb0104f9800 could not be found. Oct 04 18:51:42.136884 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': 'f2269817-3e15-4cfe-8446-7eb0104f9800'} Oct 04 18:51:42.136884 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:51:42.136884 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:51:42.136884 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:51:42.136884 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:51:42.136884 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:51:42.136884 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:51:42.136884 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:51:42.136884 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:51:42.136884 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:51:42.136884 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:51:42.136884 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2269817-3e15-4cfe-8446-7eb0104f9800 could not be found. Oct 04 18:51:42.136884 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:51:42.136884 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:51:42.136884 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:51:42.136884 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:51:42.136884 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:51:42.136884 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:51:42.136884 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:51:42.136884 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:51:42.136884 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:51:42.136884 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:51:42.136884 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:51:42.136884 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:51:42.136884 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:51:42.136884 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:51:42.136884 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:51:42.136884 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:51:42.136884 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:51:42.136884 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:51:42.140639 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2269817-3e15-4cfe-8446-7eb0104f9800 could not be found. Oct 04 18:51:42.140639 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:51:42.140639 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:51:42.140639 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:51:42.140639 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:51:42.140639 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:51:42.140639 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:51:42.140639 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:51:42.140639 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:51:42.140639 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2269817-3e15-4cfe-8446-7eb0104f9800 could not be found. Oct 04 18:51:42.140639 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:51:42.145778 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-7841e0e2-0f29-4002-8a7c-499706bb15c4 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Returning 404 to user: Instance f2269817-3e15-4cfe-8446-7eb0104f9800 could not be found. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:51:42.146952 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-7841e0e2-0f29-4002-8a7c-499706bb15c4 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] 10.222.0.43 "DELETE /compute/v2.1/servers/f2269817-3e15-4cfe-8446-7eb0104f9800" status: 404 len: 111 microversion: 2.1 time: 0.083196 Oct 04 18:51:42.147751 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2382/4473] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 18:51:42 2022] DELETE /compute/v2.1/servers/f2269817-3e15-4cfe-8446-7eb0104f9800 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:51:42.157388 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-9691f7bd-4883-421d-a9c3-05f2c2985e38 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:42.161631 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-9691f7bd-4883-421d-a9c3-05f2c2985e38 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] [instance: f2269817-3e15-4cfe-8446-7eb0104f9800] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:42.178493 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9691f7bd-4883-421d-a9c3-05f2c2985e38 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:42.179375 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9691f7bd-4883-421d-a9c3-05f2c2985e38 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:42.180034 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9691f7bd-4883-421d-a9c3-05f2c2985e38 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:42.180987 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9691f7bd-4883-421d-a9c3-05f2c2985e38 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:42.182649 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9691f7bd-4883-421d-a9c3-05f2c2985e38 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:42.185264 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9691f7bd-4883-421d-a9c3-05f2c2985e38 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:42.238585 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-9691f7bd-4883-421d-a9c3-05f2c2985e38 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] HTTP exception thrown: Instance f2269817-3e15-4cfe-8446-7eb0104f9800 could not be found. Oct 04 18:51:42.240629 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-9691f7bd-4883-421d-a9c3-05f2c2985e38 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Request method failure captured: Oct 04 18:51:42.240629 n-d-851028-13 devstack@n-api.service[123596]: request: GET /compute/v2.1/servers/f2269817-3e15-4cfe-8446-7eb0104f9800 HTTP/1.1 Oct 04 18:51:42.240629 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:51:42.240629 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:51:42.240629 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:51:42.240629 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 18:51:42.240629 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:51:42.240629 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:51:42.240629 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:51:42.240629 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:51:42.240629 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPH8lkGy0nZwltj3uDmeGQrZQwg6iRmriNLJ5vdTxYDzuDEs4JzrRDRI_AZvLAjZh5V6GRRv2aL1Ucq2iBU4yNUHCglEfTAOxdnVxtvedAn0I6kngigKmNkAB_2-EZ56jXiOuDwiOsK_AD_cvM52BvcLg72IQH_PTBSCnO4tX8aOV0qA Oct 04 18:51:42.240629 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:51:42.240629 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:51:42.240629 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:51:42.240629 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:51:42.240629 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:51:42.240629 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:51:42.240629 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: ff3c3dc76405401baf72fe00c5d50b56 Oct 04 18:51:42.240629 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-AttachVolumeTestJSON-517546326 Oct 04 18:51:42.240629 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 18:51:42.240629 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 18:51:42.240629 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/ff3c3dc76405401baf72fe00c5d50b56"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_ff3c3dc76405401baf72fe00c5d50b56"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ff3c3dc76405401baf72fe00c5d50b56"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ff3c3dc76405401baf72fe00c5d50b56"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:51:42.240629 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-AttachVolumeTestJSON-517546326 Oct 04 18:51:42.240629 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: ff3c3dc76405401baf72fe00c5d50b56 Oct 04 18:51:42.240629 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-AttachVolumeTestJSON-517546326 Oct 04 18:51:42.240629 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-AttachVolumeTestJSON-517546326-project Oct 04 18:51:42.240629 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:51:42.240629 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:51:42.240629 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: a116f2d9656548458264cc4fb1934c18 Oct 04 18:51:42.240629 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-AttachVolumeTestJSON-517546326-project Oct 04 18:51:42.240629 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 18:51:42.240629 n-d-851028-13 devstack@n-api.service[123596]: exception: Instance f2269817-3e15-4cfe-8446-7eb0104f9800 could not be found. Oct 04 18:51:42.240629 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': 'f2269817-3e15-4cfe-8446-7eb0104f9800'} Oct 04 18:51:42.240629 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:51:42.240629 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:51:42.240629 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:51:42.240629 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:51:42.240629 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:51:42.240629 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:51:42.240629 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:51:42.240629 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:51:42.240629 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:51:42.240629 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:51:42.240629 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2269817-3e15-4cfe-8446-7eb0104f9800 could not be found. Oct 04 18:51:42.240629 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:51:42.240629 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:51:42.240629 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:51:42.240629 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:51:42.240629 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:51:42.240629 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:51:42.240629 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:51:42.240629 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:51:42.240629 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:51:42.240629 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:51:42.240629 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:51:42.240629 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:51:42.240629 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:51:42.240629 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:51:42.240629 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:51:42.240629 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:51:42.240629 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2269817-3e15-4cfe-8446-7eb0104f9800 could not be found. Oct 04 18:51:42.240629 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:51:42.240629 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:51:42.240629 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:51:42.246473 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:51:42.246473 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:51:42.246473 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:51:42.246473 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:51:42.246473 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:51:42.246473 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2269817-3e15-4cfe-8446-7eb0104f9800 could not be found. Oct 04 18:51:42.246473 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:51:42.255461 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-9691f7bd-4883-421d-a9c3-05f2c2985e38 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Returning 404 to user: Instance f2269817-3e15-4cfe-8446-7eb0104f9800 could not be found. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:51:42.256940 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-9691f7bd-4883-421d-a9c3-05f2c2985e38 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] 10.222.0.43 "GET /compute/v2.1/servers/f2269817-3e15-4cfe-8446-7eb0104f9800" status: 404 len: 111 microversion: 2.1 time: 0.103425 Oct 04 18:51:42.257792 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2383/4474] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:42 2022] GET /compute/v2.1/servers/f2269817-3e15-4cfe-8446-7eb0104f9800 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:51:42.295646 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-be28df13-3c67-4da2-a00a-ea6e37c015ab tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9039839957e6449c94e9b54b2097d6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08ee9e55650e4802bb32951c126fce8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:42.306889 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-be28df13-3c67-4da2-a00a-ea6e37c015ab tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] 10.222.0.43 "GET /compute/v2.1/servers/5662b4d6-b524-45e0-abea-4803634bf4ea" status: 200 len: 1510 microversion: 2.1 time: 0.752428 Oct 04 18:51:42.313177 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2092/4475] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:41 2022] GET /compute/v2.1/servers/5662b4d6-b524-45e0-abea-4803634bf4ea => generated 1510 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:42.671782 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-66b1f5db-b88c-426f-806f-a19140ba9ab0 req-753d8721-6d0d-46c0-b17d-55a59f2f2b1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5662b4d6-b524-45e0-abea-4803634bf4ea", "name": "network-vif-deleted", "tag": "25e08f7f-1e4f-4d30-96ab-d120abf94c43"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:51:42.689430 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-66b1f5db-b88c-426f-806f-a19140ba9ab0 req-753d8721-6d0d-46c0-b17d-55a59f2f2b1e service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:42.692288 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-66b1f5db-b88c-426f-806f-a19140ba9ab0 req-753d8721-6d0d-46c0-b17d-55a59f2f2b1e service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:42.692783 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-66b1f5db-b88c-426f-806f-a19140ba9ab0 req-753d8721-6d0d-46c0-b17d-55a59f2f2b1e service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:42.720442 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-66b1f5db-b88c-426f-806f-a19140ba9ab0 req-753d8721-6d0d-46c0-b17d-55a59f2f2b1e service nova] Creating event network-vif-deleted:25e08f7f-1e4f-4d30-96ab-d120abf94c43 for instance 5662b4d6-b524-45e0-abea-4803634bf4ea on n-h2-851028-13 Oct 04 18:51:42.769519 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-66b1f5db-b88c-426f-806f-a19140ba9ab0 req-753d8721-6d0d-46c0-b17d-55a59f2f2b1e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082620 Oct 04 18:51:42.769519 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2384/4476] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:51:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:51:43.064152 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-a5833cd0-46ab-4d45-803c-1595b762c9fa tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:43.065404 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-a5833cd0-46ab-4d45-803c-1595b762c9fa tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] [instance: 59d7c8f0-8b36-45e7-bef6-ae97d40d231f] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:43.073478 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a5833cd0-46ab-4d45-803c-1595b762c9fa tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:43.074532 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a5833cd0-46ab-4d45-803c-1595b762c9fa tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:43.075145 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a5833cd0-46ab-4d45-803c-1595b762c9fa tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:43.076032 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a5833cd0-46ab-4d45-803c-1595b762c9fa tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:43.077894 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a5833cd0-46ab-4d45-803c-1595b762c9fa tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:43.078906 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a5833cd0-46ab-4d45-803c-1595b762c9fa tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:43.339992 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-450ed63e-a3aa-4cd6-af18-017272964aa9 tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:43.340624 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-450ed63e-a3aa-4cd6-af18-017272964aa9 tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] [instance: 5662b4d6-b524-45e0-abea-4803634bf4ea] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:43.351036 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-450ed63e-a3aa-4cd6-af18-017272964aa9 tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:43.372462 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-450ed63e-a3aa-4cd6-af18-017272964aa9 tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:43.374727 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-450ed63e-a3aa-4cd6-af18-017272964aa9 tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:43.375586 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-450ed63e-a3aa-4cd6-af18-017272964aa9 tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:43.376083 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-450ed63e-a3aa-4cd6-af18-017272964aa9 tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:43.376533 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-450ed63e-a3aa-4cd6-af18-017272964aa9 tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:43.489208 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-450ed63e-a3aa-4cd6-af18-017272964aa9 tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:43.491445 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-450ed63e-a3aa-4cd6-af18-017272964aa9 tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:43.492556 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-450ed63e-a3aa-4cd6-af18-017272964aa9 tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:43.493991 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.objects.instance [None req-450ed63e-a3aa-4cd6-af18-017272964aa9 tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] Lazy-loading 'fault' on Instance uuid 5662b4d6-b524-45e0-abea-4803634bf4ea {{(pid=123596) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:51:43.731609 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-450ed63e-a3aa-4cd6-af18-017272964aa9 tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9039839957e6449c94e9b54b2097d6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08ee9e55650e4802bb32951c126fce8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:43.740277 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-450ed63e-a3aa-4cd6-af18-017272964aa9 tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] 10.222.0.43 "GET /compute/v2.1/servers/5662b4d6-b524-45e0-abea-4803634bf4ea" status: 200 len: 1306 microversion: 2.1 time: 0.405529 Oct 04 18:51:43.747044 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2385/4477] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:43 2022] GET /compute/v2.1/servers/5662b4d6-b524-45e0-abea-4803634bf4ea => generated 1306 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:43.798468 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-a5833cd0-46ab-4d45-803c-1595b762c9fa tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14707008940e4965ab7d1190094a71bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8f94cf1c974654a336645f453c9efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:43.808736 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-a5833cd0-46ab-4d45-803c-1595b762c9fa tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] 10.222.0.43 "GET /compute/v2.1/servers/59d7c8f0-8b36-45e7-bef6-ae97d40d231f" status: 200 len: 1489 microversion: 2.1 time: 0.758578 Oct 04 18:51:43.822593 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2093/4478] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:43 2022] GET /compute/v2.1/servers/59d7c8f0-8b36-45e7-bef6-ae97d40d231f => generated 1489 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:43.841090 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-1873093e-2f21-4ec7-a12b-5e37a80404ca tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-836117425"}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:51:43.844256 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-1873093e-2f21-4ec7-a12b-5e37a80404ca tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] [instance: 59d7c8f0-8b36-45e7-bef6-ae97d40d231f] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:43.859387 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1873093e-2f21-4ec7-a12b-5e37a80404ca tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:43.860094 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1873093e-2f21-4ec7-a12b-5e37a80404ca tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:43.860718 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1873093e-2f21-4ec7-a12b-5e37a80404ca tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:43.861906 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1873093e-2f21-4ec7-a12b-5e37a80404ca tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:43.865239 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1873093e-2f21-4ec7-a12b-5e37a80404ca tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:43.865882 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1873093e-2f21-4ec7-a12b-5e37a80404ca tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:44.019110 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-1873093e-2f21-4ec7-a12b-5e37a80404ca tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] 10.222.0.43 "PUT /compute/v2.1/servers/59d7c8f0-8b36-45e7-bef6-ae97d40d231f" status: 200 len: 1074 microversion: 2.1 time: 0.180678 Oct 04 18:51:44.039114 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-9ddd931b-898b-4a2f-9ddb-00e660b01715 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:44.039955 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-9ddd931b-898b-4a2f-9ddb-00e660b01715 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] [instance: 59d7c8f0-8b36-45e7-bef6-ae97d40d231f] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:44.062268 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2386/4479] 10.222.0.43 () {60 vars in 1256 bytes} [Tue Oct 4 18:51:43 2022] PUT /compute/v2.1/servers/59d7c8f0-8b36-45e7-bef6-ae97d40d231f => generated 1074 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:44.065296 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9ddd931b-898b-4a2f-9ddb-00e660b01715 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:44.066366 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9ddd931b-898b-4a2f-9ddb-00e660b01715 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:44.067239 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9ddd931b-898b-4a2f-9ddb-00e660b01715 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:44.068199 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9ddd931b-898b-4a2f-9ddb-00e660b01715 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:44.068829 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9ddd931b-898b-4a2f-9ddb-00e660b01715 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:44.069469 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9ddd931b-898b-4a2f-9ddb-00e660b01715 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:44.351440 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-13d671d8-ccd7-47e1-be47-fd49d29a0cbe tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:44.352075 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-13d671d8-ccd7-47e1-be47-fd49d29a0cbe tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] [instance: fa47906d-d394-46fe-9143-780bcd27a715] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:44.363264 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-13d671d8-ccd7-47e1-be47-fd49d29a0cbe tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:44.363797 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-13d671d8-ccd7-47e1-be47-fd49d29a0cbe tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:44.365047 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-13d671d8-ccd7-47e1-be47-fd49d29a0cbe tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:44.365047 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-13d671d8-ccd7-47e1-be47-fd49d29a0cbe tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:44.365481 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-13d671d8-ccd7-47e1-be47-fd49d29a0cbe tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:44.369975 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-13d671d8-ccd7-47e1-be47-fd49d29a0cbe tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:44.377671 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-9ddd931b-898b-4a2f-9ddb-00e660b01715 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14707008940e4965ab7d1190094a71bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8f94cf1c974654a336645f453c9efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:44.392124 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-9ddd931b-898b-4a2f-9ddb-00e660b01715 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] 10.222.0.43 "GET /compute/v2.1/servers/59d7c8f0-8b36-45e7-bef6-ae97d40d231f" status: 200 len: 1500 microversion: 2.1 time: 0.357247 Oct 04 18:51:44.393068 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2094/4480] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:44 2022] GET /compute/v2.1/servers/59d7c8f0-8b36-45e7-bef6-ae97d40d231f => generated 1500 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:44.407642 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-13d671d8-ccd7-47e1-be47-fd49d29a0cbe tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] HTTP exception thrown: Instance fa47906d-d394-46fe-9143-780bcd27a715 could not be found. Oct 04 18:51:44.411895 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-13d671d8-ccd7-47e1-be47-fd49d29a0cbe tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Request method failure captured: Oct 04 18:51:44.411895 n-d-851028-13 devstack@n-api.service[123596]: request: DELETE /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715 HTTP/1.1 Oct 04 18:51:44.411895 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:51:44.411895 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:51:44.411895 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:51:44.411895 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 18:51:44.411895 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:51:44.411895 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:51:44.411895 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:51:44.411895 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:51:44.411895 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPH8NWVKEfrrX5SPJc3qTADgQnuhmEeKt3nRSTivLmcX_1rJ7sWD89vofM56bQc5QLhRgAQaumq4Ugrzk12CMCNugRMuczvfyJb-xdOi8x887qB_Hc_CwQXDH-MOJSbSaiKxsjArYsso5rqrTQPK2K7D2kDjIq43_WpRWruAQ4fM1lEc Oct 04 18:51:44.411895 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:51:44.411895 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:51:44.411895 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:51:44.411895 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:51:44.411895 n-d-851028-13 devstack@n-api.service[123596]: X-Openstack-Nova-Api-Version: 2.32 Oct 04 18:51:44.411895 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:51:44.411895 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:51:44.411895 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: 98ecf69d8220477bb3006361f7a67825 Oct 04 18:51:44.411895 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-TaggedBootDevicesTest-1281917818 Oct 04 18:51:44.411895 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 18:51:44.411895 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 18:51:44.411895 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/98ecf69d8220477bb3006361f7a67825"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_98ecf69d8220477bb3006361f7a67825"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/98ecf69d8220477bb3006361f7a67825"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/98ecf69d8220477bb3006361f7a67825"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:51:44.411895 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-TaggedBootDevicesTest-1281917818 Oct 04 18:51:44.411895 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: 98ecf69d8220477bb3006361f7a67825 Oct 04 18:51:44.411895 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1281917818 Oct 04 18:51:44.411895 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-TaggedBootDevicesTest-1281917818-project Oct 04 18:51:44.411895 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:51:44.411895 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:51:44.411895 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: a0de7f497fae40aa885875065db35656 Oct 04 18:51:44.411895 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-TaggedBootDevicesTest-1281917818-project Oct 04 18:51:44.411895 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 18:51:44.411895 n-d-851028-13 devstack@n-api.service[123596]: exception: Instance fa47906d-d394-46fe-9143-780bcd27a715 could not be found. Oct 04 18:51:44.411895 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': 'fa47906d-d394-46fe-9143-780bcd27a715'} Oct 04 18:51:44.411895 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:51:44.411895 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:51:44.411895 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:51:44.411895 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:51:44.411895 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:51:44.411895 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:51:44.411895 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:51:44.411895 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:51:44.411895 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:51:44.411895 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:51:44.411895 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa47906d-d394-46fe-9143-780bcd27a715 could not be found. Oct 04 18:51:44.411895 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:51:44.411895 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:51:44.411895 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:51:44.411895 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:51:44.411895 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:51:44.411895 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:51:44.411895 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:51:44.411895 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:51:44.411895 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:51:44.411895 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:51:44.411895 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:51:44.411895 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:51:44.411895 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:51:44.411895 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:51:44.411895 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:51:44.411895 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:51:44.411895 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:51:44.411895 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:51:44.415790 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa47906d-d394-46fe-9143-780bcd27a715 could not be found. Oct 04 18:51:44.415790 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:51:44.415790 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:51:44.415790 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:51:44.415790 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:51:44.415790 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:51:44.415790 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:51:44.415790 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:51:44.415790 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:51:44.415790 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa47906d-d394-46fe-9143-780bcd27a715 could not be found. Oct 04 18:51:44.415790 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:51:44.418592 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-7e978821-b8e7-492f-b769-48c09534a408 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:44.419214 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-7e978821-b8e7-492f-b769-48c09534a408 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] [instance: 59d7c8f0-8b36-45e7-bef6-ae97d40d231f] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:44.419789 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-13d671d8-ccd7-47e1-be47-fd49d29a0cbe tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Returning 404 to user: Instance fa47906d-d394-46fe-9143-780bcd27a715 could not be found. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:51:44.420901 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-13d671d8-ccd7-47e1-be47-fd49d29a0cbe tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] 10.222.0.43 "DELETE /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715" status: 404 len: 111 microversion: 2.32 time: 0.074567 Oct 04 18:51:44.421970 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2387/4481] 10.222.0.43 () {60 vars in 1280 bytes} [Tue Oct 4 18:51:44 2022] DELETE /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:51:44.434535 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f972b61d-de0b-4932-85d6-66e25b0c43e4 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:44.435524 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7e978821-b8e7-492f-b769-48c09534a408 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:44.436248 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7e978821-b8e7-492f-b769-48c09534a408 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:44.436402 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-f972b61d-de0b-4932-85d6-66e25b0c43e4 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] [instance: fa47906d-d394-46fe-9143-780bcd27a715] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:44.439614 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7e978821-b8e7-492f-b769-48c09534a408 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:44.441194 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7e978821-b8e7-492f-b769-48c09534a408 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:44.443169 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7e978821-b8e7-492f-b769-48c09534a408 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:44.446187 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7e978821-b8e7-492f-b769-48c09534a408 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:44.448714 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f972b61d-de0b-4932-85d6-66e25b0c43e4 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:44.451258 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f972b61d-de0b-4932-85d6-66e25b0c43e4 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:44.453624 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f972b61d-de0b-4932-85d6-66e25b0c43e4 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:44.454517 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f972b61d-de0b-4932-85d6-66e25b0c43e4 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:44.463675 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f972b61d-de0b-4932-85d6-66e25b0c43e4 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:44.464296 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f972b61d-de0b-4932-85d6-66e25b0c43e4 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:44.494396 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-f972b61d-de0b-4932-85d6-66e25b0c43e4 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] HTTP exception thrown: Instance fa47906d-d394-46fe-9143-780bcd27a715 could not be found. Oct 04 18:51:44.496346 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f972b61d-de0b-4932-85d6-66e25b0c43e4 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Request method failure captured: Oct 04 18:51:44.496346 n-d-851028-13 devstack@n-api.service[123596]: request: GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715 HTTP/1.1 Oct 04 18:51:44.496346 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:51:44.496346 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:51:44.496346 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:51:44.496346 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 18:51:44.496346 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:51:44.496346 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:51:44.496346 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:51:44.496346 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:51:44.496346 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPH8NWVKEfrrX5SPJc3qTADgQnuhmEeKt3nRSTivLmcX_1rJ7sWD89vofM56bQc5QLhRgAQaumq4Ugrzk12CMCNugRMuczvfyJb-xdOi8x887qB_Hc_CwQXDH-MOJSbSaiKxsjArYsso5rqrTQPK2K7D2kDjIq43_WpRWruAQ4fM1lEc Oct 04 18:51:44.496346 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:51:44.496346 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:51:44.496346 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:51:44.496346 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:51:44.496346 n-d-851028-13 devstack@n-api.service[123596]: X-Openstack-Nova-Api-Version: 2.32 Oct 04 18:51:44.496346 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:51:44.496346 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:51:44.496346 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: 98ecf69d8220477bb3006361f7a67825 Oct 04 18:51:44.496346 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-TaggedBootDevicesTest-1281917818 Oct 04 18:51:44.496346 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 18:51:44.496346 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 18:51:44.496346 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/98ecf69d8220477bb3006361f7a67825"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_98ecf69d8220477bb3006361f7a67825"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/98ecf69d8220477bb3006361f7a67825"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/98ecf69d8220477bb3006361f7a67825"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:51:44.496346 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-TaggedBootDevicesTest-1281917818 Oct 04 18:51:44.496346 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: 98ecf69d8220477bb3006361f7a67825 Oct 04 18:51:44.496346 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1281917818 Oct 04 18:51:44.496346 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-TaggedBootDevicesTest-1281917818-project Oct 04 18:51:44.496346 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:51:44.496346 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:51:44.496346 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: a0de7f497fae40aa885875065db35656 Oct 04 18:51:44.496346 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-TaggedBootDevicesTest-1281917818-project Oct 04 18:51:44.496346 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 18:51:44.496346 n-d-851028-13 devstack@n-api.service[123596]: exception: Instance fa47906d-d394-46fe-9143-780bcd27a715 could not be found. Oct 04 18:51:44.496346 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': 'fa47906d-d394-46fe-9143-780bcd27a715'} Oct 04 18:51:44.496346 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:51:44.496346 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:51:44.496346 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:51:44.496346 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:51:44.496346 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:51:44.496346 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:51:44.496346 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:51:44.496346 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:51:44.496346 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:51:44.496346 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:51:44.496346 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa47906d-d394-46fe-9143-780bcd27a715 could not be found. Oct 04 18:51:44.496346 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:51:44.496346 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:51:44.496346 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:51:44.496346 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:51:44.496346 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:51:44.496346 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:51:44.496346 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:51:44.496346 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:51:44.496346 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:51:44.496346 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:51:44.496346 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:51:44.496346 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:51:44.496346 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:51:44.496346 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:51:44.496346 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:51:44.496346 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:51:44.496346 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa47906d-d394-46fe-9143-780bcd27a715 could not be found. Oct 04 18:51:44.496346 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:51:44.496346 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:51:44.500847 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:51:44.500847 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:51:44.500847 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:51:44.500847 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:51:44.500847 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:51:44.500847 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:51:44.500847 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa47906d-d394-46fe-9143-780bcd27a715 could not be found. Oct 04 18:51:44.500847 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:51:44.505300 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f972b61d-de0b-4932-85d6-66e25b0c43e4 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] Returning 404 to user: Instance fa47906d-d394-46fe-9143-780bcd27a715 could not be found. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:51:44.506341 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-f972b61d-de0b-4932-85d6-66e25b0c43e4 tempest-TaggedBootDevicesTest-1281917818 tempest-TaggedBootDevicesTest-1281917818-project] 10.222.0.43 "GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715" status: 404 len: 111 microversion: 2.32 time: 0.078247 Oct 04 18:51:44.507311 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2388/4482] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:51:44 2022] GET /compute/v2.1/servers/fa47906d-d394-46fe-9143-780bcd27a715 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:51:44.779743 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-c7f39fb0-cef2-482c-932c-b30c41d946f6 tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:44.780460 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-c7f39fb0-cef2-482c-932c-b30c41d946f6 tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] [instance: 5662b4d6-b524-45e0-abea-4803634bf4ea] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:44.797439 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c7f39fb0-cef2-482c-932c-b30c41d946f6 tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:44.798067 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c7f39fb0-cef2-482c-932c-b30c41d946f6 tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:44.798788 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c7f39fb0-cef2-482c-932c-b30c41d946f6 tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:44.799733 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c7f39fb0-cef2-482c-932c-b30c41d946f6 tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:44.800404 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c7f39fb0-cef2-482c-932c-b30c41d946f6 tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:44.801054 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c7f39fb0-cef2-482c-932c-b30c41d946f6 tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:44.841231 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-c7f39fb0-cef2-482c-932c-b30c41d946f6 tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] HTTP exception thrown: Instance 5662b4d6-b524-45e0-abea-4803634bf4ea could not be found. Oct 04 18:51:44.843051 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-c7f39fb0-cef2-482c-932c-b30c41d946f6 tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] Request method failure captured: Oct 04 18:51:44.843051 n-d-851028-13 devstack@n-api.service[123596]: request: GET /compute/v2.1/servers/5662b4d6-b524-45e0-abea-4803634bf4ea HTTP/1.1 Oct 04 18:51:44.843051 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:51:44.843051 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:51:44.843051 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:51:44.843051 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 18:51:44.843051 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:51:44.843051 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:51:44.843051 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:51:44.843051 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:51:44.843051 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPICewRDJNu-dko9XvGBBifNpyXoqfXYjlbyaCOkOCiKMlmplgL2EvR0fAItv_MC1Aekl_DYVsxkH1KyypKiZOcFORzWuFJazHN28P0oq8v1HwPn3XUShWUspUocBinNsoZkx3VXMN2mVVxGFuFjR0BhsAPW3gXq1XedlL5xK3afuWUA Oct 04 18:51:44.843051 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:51:44.843051 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:51:44.843051 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:51:44.843051 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:51:44.843051 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:51:44.843051 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:51:44.843051 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: 08ee9e55650e4802bb32951c126fce8b Oct 04 18:51:44.843051 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-ServerPasswordTestJSON-1990857185 Oct 04 18:51:44.843051 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 18:51:44.843051 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 18:51:44.843051 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/08ee9e55650e4802bb32951c126fce8b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_08ee9e55650e4802bb32951c126fce8b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/08ee9e55650e4802bb32951c126fce8b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/08ee9e55650e4802bb32951c126fce8b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:51:44.843051 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-ServerPasswordTestJSON-1990857185 Oct 04 18:51:44.843051 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: 08ee9e55650e4802bb32951c126fce8b Oct 04 18:51:44.843051 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-ServerPasswordTestJSON-1990857185 Oct 04 18:51:44.843051 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-ServerPasswordTestJSON-1990857185-project Oct 04 18:51:44.843051 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:51:44.843051 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:51:44.843051 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 9039839957e6449c94e9b54b2097d6d9 Oct 04 18:51:44.843051 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-ServerPasswordTestJSON-1990857185-project Oct 04 18:51:44.843051 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 18:51:44.843051 n-d-851028-13 devstack@n-api.service[123596]: exception: Instance 5662b4d6-b524-45e0-abea-4803634bf4ea could not be found. Oct 04 18:51:44.843051 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': '5662b4d6-b524-45e0-abea-4803634bf4ea'} Oct 04 18:51:44.843051 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:51:44.843051 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:51:44.843051 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:51:44.843051 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:51:44.843051 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:51:44.843051 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:51:44.843051 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:51:44.843051 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:51:44.843051 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:51:44.843051 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:51:44.843051 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5662b4d6-b524-45e0-abea-4803634bf4ea could not be found. Oct 04 18:51:44.843051 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:51:44.843051 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:51:44.843051 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:51:44.843051 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:51:44.843051 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:51:44.843051 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:51:44.843051 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:51:44.843051 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:51:44.843051 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:51:44.843051 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:51:44.843051 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:51:44.843051 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:51:44.843051 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:51:44.843051 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:51:44.843051 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:51:44.843051 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:51:44.843051 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5662b4d6-b524-45e0-abea-4803634bf4ea could not be found. Oct 04 18:51:44.843051 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:51:44.843051 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:51:44.843051 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:51:44.847684 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:51:44.847684 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:51:44.847684 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:51:44.847684 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:51:44.847684 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:51:44.847684 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5662b4d6-b524-45e0-abea-4803634bf4ea could not be found. Oct 04 18:51:44.847684 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:51:44.852080 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-c7f39fb0-cef2-482c-932c-b30c41d946f6 tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] Returning 404 to user: Instance 5662b4d6-b524-45e0-abea-4803634bf4ea could not be found. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:51:44.853230 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-c7f39fb0-cef2-482c-932c-b30c41d946f6 tempest-ServerPasswordTestJSON-1990857185 tempest-ServerPasswordTestJSON-1990857185-project] 10.222.0.43 "GET /compute/v2.1/servers/5662b4d6-b524-45e0-abea-4803634bf4ea" status: 404 len: 111 microversion: 2.1 time: 0.080513 Oct 04 18:51:44.854342 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2389/4483] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:44 2022] GET /compute/v2.1/servers/5662b4d6-b524-45e0-abea-4803634bf4ea => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:51:44.928495 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-7e978821-b8e7-492f-b769-48c09534a408 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14707008940e4965ab7d1190094a71bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8f94cf1c974654a336645f453c9efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:44.963203 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-7e978821-b8e7-492f-b769-48c09534a408 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] 10.222.0.43 "GET /compute/v2.1/servers/59d7c8f0-8b36-45e7-bef6-ae97d40d231f" status: 200 len: 1500 microversion: 2.1 time: 0.551302 Oct 04 18:51:44.970808 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2095/4484] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:44 2022] GET /compute/v2.1/servers/59d7c8f0-8b36-45e7-bef6-ae97d40d231f => generated 1500 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:45.008113 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-5640aa09-fde0-40d0-99c5-53e103ee40f4 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:51:45.024327 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5640aa09-fde0-40d0-99c5-53e103ee40f4 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:45.024841 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5640aa09-fde0-40d0-99c5-53e103ee40f4 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:45.032674 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5640aa09-fde0-40d0-99c5-53e103ee40f4 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:45.066395 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-5640aa09-fde0-40d0-99c5-53e103ee40f4 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] [instance: 59d7c8f0-8b36-45e7-bef6-ae97d40d231f] Going to try to stop instance {{(pid=123596) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 04 18:51:45.162700 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-5640aa09-fde0-40d0-99c5-53e103ee40f4 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] 10.222.0.43 "POST /compute/v2.1/servers/59d7c8f0-8b36-45e7-bef6-ae97d40d231f/action" status: 202 len: 0 microversion: 2.1 time: 0.159844 Oct 04 18:51:45.167163 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2390/4485] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 18:51:44 2022] POST /compute/v2.1/servers/59d7c8f0-8b36-45e7-bef6-ae97d40d231f/action => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:51:45.174411 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-7e77682d-d823-4783-978e-996886568ce0 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:45.176247 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-7e77682d-d823-4783-978e-996886568ce0 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] [instance: 59d7c8f0-8b36-45e7-bef6-ae97d40d231f] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:45.184708 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:51:45.196430 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7e77682d-d823-4783-978e-996886568ce0 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:45.196938 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7e77682d-d823-4783-978e-996886568ce0 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:45.197433 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7e77682d-d823-4783-978e-996886568ce0 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:45.198107 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7e77682d-d823-4783-978e-996886568ce0 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:45.198655 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7e77682d-d823-4783-978e-996886568ce0 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:45.198996 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7e77682d-d823-4783-978e-996886568ce0 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:45.621235 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-7e77682d-d823-4783-978e-996886568ce0 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14707008940e4965ab7d1190094a71bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8f94cf1c974654a336645f453c9efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:45.629968 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-7e77682d-d823-4783-978e-996886568ce0 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] 10.222.0.43 "GET /compute/v2.1/servers/59d7c8f0-8b36-45e7-bef6-ae97d40d231f" status: 200 len: 1510 microversion: 2.1 time: 0.459605 Oct 04 18:51:45.647217 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2096/4486] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:45 2022] GET /compute/v2.1/servers/59d7c8f0-8b36-45e7-bef6-ae97d40d231f => generated 1510 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:46.658790 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-a7f42df9-4ff7-4447-ae2d-8b422da95e30 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:46.659592 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-a7f42df9-4ff7-4447-ae2d-8b422da95e30 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] [instance: 59d7c8f0-8b36-45e7-bef6-ae97d40d231f] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:46.686286 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a7f42df9-4ff7-4447-ae2d-8b422da95e30 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:46.686989 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a7f42df9-4ff7-4447-ae2d-8b422da95e30 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:46.687744 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a7f42df9-4ff7-4447-ae2d-8b422da95e30 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:46.688902 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a7f42df9-4ff7-4447-ae2d-8b422da95e30 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:46.691906 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a7f42df9-4ff7-4447-ae2d-8b422da95e30 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:46.694638 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a7f42df9-4ff7-4447-ae2d-8b422da95e30 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:47.161675 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-a7f42df9-4ff7-4447-ae2d-8b422da95e30 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14707008940e4965ab7d1190094a71bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8f94cf1c974654a336645f453c9efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:47.174414 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-a7f42df9-4ff7-4447-ae2d-8b422da95e30 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] 10.222.0.43 "GET /compute/v2.1/servers/59d7c8f0-8b36-45e7-bef6-ae97d40d231f" status: 200 len: 1510 microversion: 2.1 time: 0.521247 Oct 04 18:51:47.174946 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2391/4487] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:46 2022] GET /compute/v2.1/servers/59d7c8f0-8b36-45e7-bef6-ae97d40d231f => generated 1510 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:48.200829 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-d8d2b1d6-bca7-4aa4-b970-c0a4e3110406 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:48.202654 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-d8d2b1d6-bca7-4aa4-b970-c0a4e3110406 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] [instance: 59d7c8f0-8b36-45e7-bef6-ae97d40d231f] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:48.212997 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d8d2b1d6-bca7-4aa4-b970-c0a4e3110406 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:48.214395 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d8d2b1d6-bca7-4aa4-b970-c0a4e3110406 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:48.216944 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d8d2b1d6-bca7-4aa4-b970-c0a4e3110406 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:48.218342 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d8d2b1d6-bca7-4aa4-b970-c0a4e3110406 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:48.220447 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d8d2b1d6-bca7-4aa4-b970-c0a4e3110406 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:48.221348 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d8d2b1d6-bca7-4aa4-b970-c0a4e3110406 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:48.457726 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-d8d2b1d6-bca7-4aa4-b970-c0a4e3110406 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14707008940e4965ab7d1190094a71bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8f94cf1c974654a336645f453c9efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:48.471061 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-d8d2b1d6-bca7-4aa4-b970-c0a4e3110406 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] 10.222.0.43 "GET /compute/v2.1/servers/59d7c8f0-8b36-45e7-bef6-ae97d40d231f" status: 200 len: 1510 microversion: 2.1 time: 0.275843 Oct 04 18:51:48.482305 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2097/4488] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:48 2022] GET /compute/v2.1/servers/59d7c8f0-8b36-45e7-bef6-ae97d40d231f => generated 1510 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:49.497988 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f0a84f18-01ab-44b4-8cf4-44ee33d8e291 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:49.499369 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-f0a84f18-01ab-44b4-8cf4-44ee33d8e291 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] [instance: 59d7c8f0-8b36-45e7-bef6-ae97d40d231f] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:49.545900 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f0a84f18-01ab-44b4-8cf4-44ee33d8e291 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:49.553854 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f0a84f18-01ab-44b4-8cf4-44ee33d8e291 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:49.554798 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f0a84f18-01ab-44b4-8cf4-44ee33d8e291 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:49.556809 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f0a84f18-01ab-44b4-8cf4-44ee33d8e291 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:49.558349 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f0a84f18-01ab-44b4-8cf4-44ee33d8e291 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:49.559041 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f0a84f18-01ab-44b4-8cf4-44ee33d8e291 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:50.003361 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-f0a84f18-01ab-44b4-8cf4-44ee33d8e291 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14707008940e4965ab7d1190094a71bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8f94cf1c974654a336645f453c9efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:50.043420 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-f0a84f18-01ab-44b4-8cf4-44ee33d8e291 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] 10.222.0.43 "GET /compute/v2.1/servers/59d7c8f0-8b36-45e7-bef6-ae97d40d231f" status: 200 len: 1510 microversion: 2.1 time: 0.550431 Oct 04 18:51:50.048417 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2392/4489] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:49 2022] GET /compute/v2.1/servers/59d7c8f0-8b36-45e7-bef6-ae97d40d231f => generated 1510 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:51.073661 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-2a67a27a-96cc-434f-8bee-ef0afe9e832b tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:51.077540 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-2a67a27a-96cc-434f-8bee-ef0afe9e832b tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] [instance: 59d7c8f0-8b36-45e7-bef6-ae97d40d231f] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:51.098349 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2a67a27a-96cc-434f-8bee-ef0afe9e832b tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:51.099155 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2a67a27a-96cc-434f-8bee-ef0afe9e832b tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:51.101962 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2a67a27a-96cc-434f-8bee-ef0afe9e832b tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:51.102792 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2a67a27a-96cc-434f-8bee-ef0afe9e832b tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:51.103330 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2a67a27a-96cc-434f-8bee-ef0afe9e832b tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:51.103841 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2a67a27a-96cc-434f-8bee-ef0afe9e832b tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:51.699233 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-2a67a27a-96cc-434f-8bee-ef0afe9e832b tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14707008940e4965ab7d1190094a71bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8f94cf1c974654a336645f453c9efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:51.719015 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-2a67a27a-96cc-434f-8bee-ef0afe9e832b tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] 10.222.0.43 "GET /compute/v2.1/servers/59d7c8f0-8b36-45e7-bef6-ae97d40d231f" status: 200 len: 1510 microversion: 2.1 time: 0.648419 Oct 04 18:51:51.740201 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2098/4490] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:51 2022] GET /compute/v2.1/servers/59d7c8f0-8b36-45e7-bef6-ae97d40d231f => generated 1510 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:52.748575 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-321f0082-a87f-4b8e-ab2f-5440a2a94432 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:52.749620 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-321f0082-a87f-4b8e-ab2f-5440a2a94432 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] [instance: 59d7c8f0-8b36-45e7-bef6-ae97d40d231f] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:52.762410 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-321f0082-a87f-4b8e-ab2f-5440a2a94432 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:52.764699 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-321f0082-a87f-4b8e-ab2f-5440a2a94432 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:52.766652 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-321f0082-a87f-4b8e-ab2f-5440a2a94432 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:52.768934 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-321f0082-a87f-4b8e-ab2f-5440a2a94432 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:52.771036 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-321f0082-a87f-4b8e-ab2f-5440a2a94432 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:52.772825 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-321f0082-a87f-4b8e-ab2f-5440a2a94432 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:53.378154 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-321f0082-a87f-4b8e-ab2f-5440a2a94432 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14707008940e4965ab7d1190094a71bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8f94cf1c974654a336645f453c9efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:53.396279 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-321f0082-a87f-4b8e-ab2f-5440a2a94432 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] 10.222.0.43 "GET /compute/v2.1/servers/59d7c8f0-8b36-45e7-bef6-ae97d40d231f" status: 200 len: 1510 microversion: 2.1 time: 0.651798 Oct 04 18:51:53.411979 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2393/4491] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:52 2022] GET /compute/v2.1/servers/59d7c8f0-8b36-45e7-bef6-ae97d40d231f => generated 1510 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:54.424175 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-b2524fd9-4f22-469b-8338-3d97c5571866 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:54.425627 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-b2524fd9-4f22-469b-8338-3d97c5571866 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] [instance: 59d7c8f0-8b36-45e7-bef6-ae97d40d231f] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:54.450279 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b2524fd9-4f22-469b-8338-3d97c5571866 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:54.452464 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b2524fd9-4f22-469b-8338-3d97c5571866 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:54.454000 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b2524fd9-4f22-469b-8338-3d97c5571866 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:54.461442 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b2524fd9-4f22-469b-8338-3d97c5571866 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:54.467753 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b2524fd9-4f22-469b-8338-3d97c5571866 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:54.468450 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b2524fd9-4f22-469b-8338-3d97c5571866 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:55.289701 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-b2524fd9-4f22-469b-8338-3d97c5571866 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14707008940e4965ab7d1190094a71bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8f94cf1c974654a336645f453c9efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:55.311427 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-b2524fd9-4f22-469b-8338-3d97c5571866 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] 10.222.0.43 "GET /compute/v2.1/servers/59d7c8f0-8b36-45e7-bef6-ae97d40d231f" status: 200 len: 1510 microversion: 2.1 time: 0.895184 Oct 04 18:51:55.332136 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2099/4492] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:54 2022] GET /compute/v2.1/servers/59d7c8f0-8b36-45e7-bef6-ae97d40d231f => generated 1510 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:56.352996 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-30b60334-8617-45fc-a507-8f8bc02dbbbb tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:56.354403 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-30b60334-8617-45fc-a507-8f8bc02dbbbb tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] [instance: 59d7c8f0-8b36-45e7-bef6-ae97d40d231f] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:56.376540 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-30b60334-8617-45fc-a507-8f8bc02dbbbb tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:56.377043 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-30b60334-8617-45fc-a507-8f8bc02dbbbb tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:56.377520 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-30b60334-8617-45fc-a507-8f8bc02dbbbb tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:56.378247 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-30b60334-8617-45fc-a507-8f8bc02dbbbb tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:56.378781 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-30b60334-8617-45fc-a507-8f8bc02dbbbb tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:56.379230 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-30b60334-8617-45fc-a507-8f8bc02dbbbb tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:57.037834 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-30b60334-8617-45fc-a507-8f8bc02dbbbb tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14707008940e4965ab7d1190094a71bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8f94cf1c974654a336645f453c9efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:57.046798 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-30b60334-8617-45fc-a507-8f8bc02dbbbb tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] 10.222.0.43 "GET /compute/v2.1/servers/59d7c8f0-8b36-45e7-bef6-ae97d40d231f" status: 200 len: 1510 microversion: 2.1 time: 0.699618 Oct 04 18:51:57.051420 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2394/4493] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:56 2022] GET /compute/v2.1/servers/59d7c8f0-8b36-45e7-bef6-ae97d40d231f => generated 1510 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:57.490042 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-91f51728-a25e-4d4f-9fa4-1791f6e037ae tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:57.491271 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-91f51728-a25e-4d4f-9fa4-1791f6e037ae tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] [instance: 76d475ab-f41c-44df-8aaa-10242bdbfcde] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:57.512316 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-91f51728-a25e-4d4f-9fa4-1791f6e037ae tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:57.513857 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-91f51728-a25e-4d4f-9fa4-1791f6e037ae tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:57.514735 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-91f51728-a25e-4d4f-9fa4-1791f6e037ae tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:57.515644 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-91f51728-a25e-4d4f-9fa4-1791f6e037ae tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:57.519305 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-91f51728-a25e-4d4f-9fa4-1791f6e037ae tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:57.520009 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-91f51728-a25e-4d4f-9fa4-1791f6e037ae tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:57.560920 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-91f51728-a25e-4d4f-9fa4-1791f6e037ae tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] HTTP exception thrown: Instance 76d475ab-f41c-44df-8aaa-10242bdbfcde could not be found. Oct 04 18:51:57.567811 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-91f51728-a25e-4d4f-9fa4-1791f6e037ae tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Request method failure captured: Oct 04 18:51:57.567811 n-d-851028-13 devstack@n-api.service[123595]: request: DELETE /compute/v2.1/servers/76d475ab-f41c-44df-8aaa-10242bdbfcde HTTP/1.1 Oct 04 18:51:57.567811 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 18:51:57.567811 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 18:51:57.567811 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 18:51:57.567811 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 0 Oct 04 18:51:57.567811 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 18:51:57.567811 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 18:51:57.567811 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 18:51:57.567811 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 18:51:57.567811 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPH8lkGy0nZwltj3uDmeGQrZQwg6iRmriNLJ5vdTxYDzuDEs4JzrRDRI_AZvLAjZh5V6GRRv2aL1Ucq2iBU4yNUHCglEfTAOxdnVxtvedAn0I6kngigKmNkAB_2-EZ56jXiOuDwiOsK_AD_cvM52BvcLg72IQH_PTBSCnO4tX8aOV0qA Oct 04 18:51:57.567811 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 18:51:57.567811 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 18:51:57.567811 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 18:51:57.567811 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 18:51:57.567811 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 18:51:57.567811 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 18:51:57.567811 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: ff3c3dc76405401baf72fe00c5d50b56 Oct 04 18:51:57.567811 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-AttachVolumeTestJSON-517546326 Oct 04 18:51:57.567811 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 18:51:57.567811 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 18:51:57.567811 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/ff3c3dc76405401baf72fe00c5d50b56"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_ff3c3dc76405401baf72fe00c5d50b56"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ff3c3dc76405401baf72fe00c5d50b56"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ff3c3dc76405401baf72fe00c5d50b56"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:51:57.567811 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-AttachVolumeTestJSON-517546326 Oct 04 18:51:57.567811 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: ff3c3dc76405401baf72fe00c5d50b56 Oct 04 18:51:57.567811 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-AttachVolumeTestJSON-517546326 Oct 04 18:51:57.567811 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-AttachVolumeTestJSON-517546326-project Oct 04 18:51:57.567811 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 18:51:57.567811 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 18:51:57.567811 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: a116f2d9656548458264cc4fb1934c18 Oct 04 18:51:57.567811 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-AttachVolumeTestJSON-517546326-project Oct 04 18:51:57.567811 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 18:51:57.567811 n-d-851028-13 devstack@n-api.service[123595]: exception: Instance 76d475ab-f41c-44df-8aaa-10242bdbfcde could not be found. Oct 04 18:51:57.567811 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': '76d475ab-f41c-44df-8aaa-10242bdbfcde'} Oct 04 18:51:57.567811 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:51:57.567811 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:51:57.567811 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:51:57.567811 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:51:57.567811 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:51:57.567811 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:51:57.567811 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:51:57.567811 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:51:57.567811 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:51:57.567811 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:51:57.567811 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 76d475ab-f41c-44df-8aaa-10242bdbfcde could not be found. Oct 04 18:51:57.567811 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:51:57.567811 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:51:57.567811 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:51:57.567811 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:51:57.567811 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:51:57.567811 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:51:57.567811 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:51:57.567811 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:51:57.567811 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:51:57.567811 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:51:57.567811 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:51:57.567811 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:51:57.567811 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:51:57.567811 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:51:57.567811 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:51:57.567811 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:51:57.567811 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:51:57.567811 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:51:57.572429 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 76d475ab-f41c-44df-8aaa-10242bdbfcde could not be found. Oct 04 18:51:57.572429 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:51:57.572429 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:51:57.572429 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:51:57.572429 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:51:57.572429 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:51:57.572429 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:51:57.572429 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:51:57.572429 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:51:57.572429 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 76d475ab-f41c-44df-8aaa-10242bdbfcde could not be found. Oct 04 18:51:57.572429 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:51:57.577678 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-91f51728-a25e-4d4f-9fa4-1791f6e037ae tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Returning 404 to user: Instance 76d475ab-f41c-44df-8aaa-10242bdbfcde could not be found. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:51:57.579025 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-91f51728-a25e-4d4f-9fa4-1791f6e037ae tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] 10.222.0.43 "DELETE /compute/v2.1/servers/76d475ab-f41c-44df-8aaa-10242bdbfcde" status: 404 len: 111 microversion: 2.1 time: 0.093498 Oct 04 18:51:57.589997 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2100/4494] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 18:51:57 2022] DELETE /compute/v2.1/servers/76d475ab-f41c-44df-8aaa-10242bdbfcde => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:51:57.592387 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-bf86ece6-3019-4aa3-8055-e2632390b019 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:57.593095 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-bf86ece6-3019-4aa3-8055-e2632390b019 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] [instance: 76d475ab-f41c-44df-8aaa-10242bdbfcde] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:57.607781 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bf86ece6-3019-4aa3-8055-e2632390b019 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:57.613125 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bf86ece6-3019-4aa3-8055-e2632390b019 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:57.618489 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bf86ece6-3019-4aa3-8055-e2632390b019 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:57.620542 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bf86ece6-3019-4aa3-8055-e2632390b019 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:57.623878 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bf86ece6-3019-4aa3-8055-e2632390b019 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:57.632101 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bf86ece6-3019-4aa3-8055-e2632390b019 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:57.644305 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:51:57.720202 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-bf86ece6-3019-4aa3-8055-e2632390b019 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] HTTP exception thrown: Instance 76d475ab-f41c-44df-8aaa-10242bdbfcde could not be found. Oct 04 18:51:57.727273 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-bf86ece6-3019-4aa3-8055-e2632390b019 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Request method failure captured: Oct 04 18:51:57.727273 n-d-851028-13 devstack@n-api.service[123596]: request: GET /compute/v2.1/servers/76d475ab-f41c-44df-8aaa-10242bdbfcde HTTP/1.1 Oct 04 18:51:57.727273 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:51:57.727273 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:51:57.727273 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:51:57.727273 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 18:51:57.727273 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:51:57.727273 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:51:57.727273 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:51:57.727273 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:51:57.727273 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPH8lkGy0nZwltj3uDmeGQrZQwg6iRmriNLJ5vdTxYDzuDEs4JzrRDRI_AZvLAjZh5V6GRRv2aL1Ucq2iBU4yNUHCglEfTAOxdnVxtvedAn0I6kngigKmNkAB_2-EZ56jXiOuDwiOsK_AD_cvM52BvcLg72IQH_PTBSCnO4tX8aOV0qA Oct 04 18:51:57.727273 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:51:57.727273 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:51:57.727273 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:51:57.727273 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:51:57.727273 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:51:57.727273 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:51:57.727273 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: ff3c3dc76405401baf72fe00c5d50b56 Oct 04 18:51:57.727273 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-AttachVolumeTestJSON-517546326 Oct 04 18:51:57.727273 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 18:51:57.727273 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 18:51:57.727273 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/ff3c3dc76405401baf72fe00c5d50b56"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_ff3c3dc76405401baf72fe00c5d50b56"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ff3c3dc76405401baf72fe00c5d50b56"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ff3c3dc76405401baf72fe00c5d50b56"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:51:57.727273 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-AttachVolumeTestJSON-517546326 Oct 04 18:51:57.727273 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: ff3c3dc76405401baf72fe00c5d50b56 Oct 04 18:51:57.727273 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-AttachVolumeTestJSON-517546326 Oct 04 18:51:57.727273 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-AttachVolumeTestJSON-517546326-project Oct 04 18:51:57.727273 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:51:57.727273 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:51:57.727273 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: a116f2d9656548458264cc4fb1934c18 Oct 04 18:51:57.727273 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-AttachVolumeTestJSON-517546326-project Oct 04 18:51:57.727273 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 18:51:57.727273 n-d-851028-13 devstack@n-api.service[123596]: exception: Instance 76d475ab-f41c-44df-8aaa-10242bdbfcde could not be found. Oct 04 18:51:57.727273 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': '76d475ab-f41c-44df-8aaa-10242bdbfcde'} Oct 04 18:51:57.727273 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:51:57.727273 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:51:57.727273 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:51:57.727273 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:51:57.727273 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:51:57.727273 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:51:57.727273 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:51:57.727273 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:51:57.727273 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:51:57.727273 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:51:57.727273 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 76d475ab-f41c-44df-8aaa-10242bdbfcde could not be found. Oct 04 18:51:57.727273 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:51:57.727273 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:51:57.727273 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:51:57.727273 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:51:57.727273 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:51:57.727273 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:51:57.727273 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:51:57.727273 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:51:57.727273 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:51:57.727273 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:51:57.727273 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:51:57.727273 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:51:57.727273 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:51:57.727273 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:51:57.727273 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:51:57.727273 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:51:57.727273 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 76d475ab-f41c-44df-8aaa-10242bdbfcde could not be found. Oct 04 18:51:57.727273 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:51:57.727273 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:51:57.727273 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:51:57.731955 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:51:57.731955 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:51:57.731955 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:51:57.731955 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:51:57.731955 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:51:57.731955 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 76d475ab-f41c-44df-8aaa-10242bdbfcde could not be found. Oct 04 18:51:57.731955 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:51:57.731955 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-bf86ece6-3019-4aa3-8055-e2632390b019 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] Returning 404 to user: Instance 76d475ab-f41c-44df-8aaa-10242bdbfcde could not be found. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:51:57.733497 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-bf86ece6-3019-4aa3-8055-e2632390b019 tempest-AttachVolumeTestJSON-517546326 tempest-AttachVolumeTestJSON-517546326-project] 10.222.0.43 "GET /compute/v2.1/servers/76d475ab-f41c-44df-8aaa-10242bdbfcde" status: 404 len: 111 microversion: 2.1 time: 0.145534 Oct 04 18:51:57.737340 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2395/4495] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:57 2022] GET /compute/v2.1/servers/76d475ab-f41c-44df-8aaa-10242bdbfcde => generated 111 bytes in 151 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:51:58.078401 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-a353567e-01d0-456a-98b3-c02ba4244ef2 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:58.079275 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-a353567e-01d0-456a-98b3-c02ba4244ef2 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] [instance: 59d7c8f0-8b36-45e7-bef6-ae97d40d231f] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:58.099664 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a353567e-01d0-456a-98b3-c02ba4244ef2 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:58.103454 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a353567e-01d0-456a-98b3-c02ba4244ef2 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:58.104168 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a353567e-01d0-456a-98b3-c02ba4244ef2 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:58.108998 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a353567e-01d0-456a-98b3-c02ba4244ef2 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:58.110176 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a353567e-01d0-456a-98b3-c02ba4244ef2 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:58.113084 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a353567e-01d0-456a-98b3-c02ba4244ef2 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:59.436518 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-a353567e-01d0-456a-98b3-c02ba4244ef2 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14707008940e4965ab7d1190094a71bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8f94cf1c974654a336645f453c9efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:59.446593 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-a353567e-01d0-456a-98b3-c02ba4244ef2 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] 10.222.0.43 "GET /compute/v2.1/servers/59d7c8f0-8b36-45e7-bef6-ae97d40d231f" status: 200 len: 1510 microversion: 2.1 time: 1.372749 Oct 04 18:51:59.454885 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2101/4496] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:58 2022] GET /compute/v2.1/servers/59d7c8f0-8b36-45e7-bef6-ae97d40d231f => generated 1510 bytes in 1380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:52:00.478102 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-d7e9176c-30a2-4f6b-ad61-f652d28d448b tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:00.478644 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-d7e9176c-30a2-4f6b-ad61-f652d28d448b tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] [instance: 59d7c8f0-8b36-45e7-bef6-ae97d40d231f] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:00.502572 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d7e9176c-30a2-4f6b-ad61-f652d28d448b tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:00.508894 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d7e9176c-30a2-4f6b-ad61-f652d28d448b tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:00.509684 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d7e9176c-30a2-4f6b-ad61-f652d28d448b tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:00.512827 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d7e9176c-30a2-4f6b-ad61-f652d28d448b tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:00.513565 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d7e9176c-30a2-4f6b-ad61-f652d28d448b tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:00.514179 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d7e9176c-30a2-4f6b-ad61-f652d28d448b tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:01.291426 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-d7e9176c-30a2-4f6b-ad61-f652d28d448b tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14707008940e4965ab7d1190094a71bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8f94cf1c974654a336645f453c9efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:01.315430 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-d7e9176c-30a2-4f6b-ad61-f652d28d448b tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] 10.222.0.43 "GET /compute/v2.1/servers/59d7c8f0-8b36-45e7-bef6-ae97d40d231f" status: 200 len: 1510 microversion: 2.1 time: 0.842042 Oct 04 18:52:01.316120 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2396/4497] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:00 2022] GET /compute/v2.1/servers/59d7c8f0-8b36-45e7-bef6-ae97d40d231f => generated 1510 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:52:02.339584 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-6f43f0cb-9af7-43bf-bc01-b930c5e9616e tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:02.341099 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-6f43f0cb-9af7-43bf-bc01-b930c5e9616e tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] [instance: 59d7c8f0-8b36-45e7-bef6-ae97d40d231f] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:02.356827 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6f43f0cb-9af7-43bf-bc01-b930c5e9616e tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:02.361563 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6f43f0cb-9af7-43bf-bc01-b930c5e9616e tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:02.362616 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6f43f0cb-9af7-43bf-bc01-b930c5e9616e tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:02.363616 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6f43f0cb-9af7-43bf-bc01-b930c5e9616e tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:02.375201 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6f43f0cb-9af7-43bf-bc01-b930c5e9616e tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:02.375954 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6f43f0cb-9af7-43bf-bc01-b930c5e9616e tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:02.434319 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:52:03.059380 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-6f43f0cb-9af7-43bf-bc01-b930c5e9616e tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14707008940e4965ab7d1190094a71bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8f94cf1c974654a336645f453c9efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:03.078942 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-6f43f0cb-9af7-43bf-bc01-b930c5e9616e tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] 10.222.0.43 "GET /compute/v2.1/servers/59d7c8f0-8b36-45e7-bef6-ae97d40d231f" status: 200 len: 1510 microversion: 2.1 time: 0.743260 Oct 04 18:52:03.090058 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2102/4498] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:02 2022] GET /compute/v2.1/servers/59d7c8f0-8b36-45e7-bef6-ae97d40d231f => generated 1510 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:52:04.107775 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-4fda1e3f-b0e6-4503-a0c4-90b90364ff74 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:04.108508 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-4fda1e3f-b0e6-4503-a0c4-90b90364ff74 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] [instance: 59d7c8f0-8b36-45e7-bef6-ae97d40d231f] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:04.123083 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4fda1e3f-b0e6-4503-a0c4-90b90364ff74 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:04.131506 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4fda1e3f-b0e6-4503-a0c4-90b90364ff74 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:04.132075 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4fda1e3f-b0e6-4503-a0c4-90b90364ff74 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:04.133930 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4fda1e3f-b0e6-4503-a0c4-90b90364ff74 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:04.134856 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4fda1e3f-b0e6-4503-a0c4-90b90364ff74 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:04.140672 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4fda1e3f-b0e6-4503-a0c4-90b90364ff74 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:05.001087 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-4fda1e3f-b0e6-4503-a0c4-90b90364ff74 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14707008940e4965ab7d1190094a71bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8f94cf1c974654a336645f453c9efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:05.013982 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-4fda1e3f-b0e6-4503-a0c4-90b90364ff74 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] 10.222.0.43 "GET /compute/v2.1/servers/59d7c8f0-8b36-45e7-bef6-ae97d40d231f" status: 200 len: 1510 microversion: 2.1 time: 0.910178 Oct 04 18:52:05.017759 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2397/4499] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:04 2022] GET /compute/v2.1/servers/59d7c8f0-8b36-45e7-bef6-ae97d40d231f => generated 1510 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:52:06.041886 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-56cba0ed-ef8a-4f30-bcd2-ba3e7874db76 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:06.043285 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-56cba0ed-ef8a-4f30-bcd2-ba3e7874db76 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] [instance: 59d7c8f0-8b36-45e7-bef6-ae97d40d231f] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:06.066305 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-56cba0ed-ef8a-4f30-bcd2-ba3e7874db76 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:06.070099 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-56cba0ed-ef8a-4f30-bcd2-ba3e7874db76 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:06.072944 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-56cba0ed-ef8a-4f30-bcd2-ba3e7874db76 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:06.074601 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-56cba0ed-ef8a-4f30-bcd2-ba3e7874db76 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:06.077407 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-56cba0ed-ef8a-4f30-bcd2-ba3e7874db76 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:06.082874 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-56cba0ed-ef8a-4f30-bcd2-ba3e7874db76 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:06.676348 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-56cba0ed-ef8a-4f30-bcd2-ba3e7874db76 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14707008940e4965ab7d1190094a71bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8f94cf1c974654a336645f453c9efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:06.688559 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-56cba0ed-ef8a-4f30-bcd2-ba3e7874db76 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] 10.222.0.43 "GET /compute/v2.1/servers/59d7c8f0-8b36-45e7-bef6-ae97d40d231f" status: 200 len: 1510 microversion: 2.1 time: 0.649137 Oct 04 18:52:06.702086 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2103/4500] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:06 2022] GET /compute/v2.1/servers/59d7c8f0-8b36-45e7-bef6-ae97d40d231f => generated 1510 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:52:07.300605 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-80157fbc-a7de-49c7-aafe-3104c752be06 tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:07.304699 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-80157fbc-a7de-49c7-aafe-3104c752be06 tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] [instance: 8fc3c2f5-e86b-4bf0-a124-750ea71e52ad] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:07.325715 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-80157fbc-a7de-49c7-aafe-3104c752be06 tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:07.327029 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-80157fbc-a7de-49c7-aafe-3104c752be06 tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:07.329083 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-80157fbc-a7de-49c7-aafe-3104c752be06 tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:07.332870 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-80157fbc-a7de-49c7-aafe-3104c752be06 tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:07.334152 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-80157fbc-a7de-49c7-aafe-3104c752be06 tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:07.336141 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-80157fbc-a7de-49c7-aafe-3104c752be06 tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:07.442816 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-80157fbc-a7de-49c7-aafe-3104c752be06 tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] 10.222.0.43 "GET /compute/v2.1/servers/8fc3c2f5-e86b-4bf0-a124-750ea71e52ad/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.141711 Oct 04 18:52:07.443533 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2398/4501] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Oct 4 18:52:07 2022] GET /compute/v2.1/servers/8fc3c2f5-e86b-4bf0-a124-750ea71e52ad/os-volume_attachments => generated 197 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:52:07.455701 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-51c5e7cf-d4dc-4dad-b6a5-9b4528b0140e tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:07.456312 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-51c5e7cf-d4dc-4dad-b6a5-9b4528b0140e tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] [instance: 8fc3c2f5-e86b-4bf0-a124-750ea71e52ad] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:07.471454 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-51c5e7cf-d4dc-4dad-b6a5-9b4528b0140e tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:07.472344 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-51c5e7cf-d4dc-4dad-b6a5-9b4528b0140e tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:07.473003 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-51c5e7cf-d4dc-4dad-b6a5-9b4528b0140e tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:07.473986 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-51c5e7cf-d4dc-4dad-b6a5-9b4528b0140e tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:07.474659 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-51c5e7cf-d4dc-4dad-b6a5-9b4528b0140e tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:07.477813 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-51c5e7cf-d4dc-4dad-b6a5-9b4528b0140e tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:07.722034 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-8cb601ac-2b77-40a4-87ae-ccc690b1c6e0 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:07.722986 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-8cb601ac-2b77-40a4-87ae-ccc690b1c6e0 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] [instance: 59d7c8f0-8b36-45e7-bef6-ae97d40d231f] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:07.732678 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_api:SELECT=44 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:52:07.739967 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8cb601ac-2b77-40a4-87ae-ccc690b1c6e0 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:07.741738 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8cb601ac-2b77-40a4-87ae-ccc690b1c6e0 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:07.742768 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8cb601ac-2b77-40a4-87ae-ccc690b1c6e0 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:07.747108 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8cb601ac-2b77-40a4-87ae-ccc690b1c6e0 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:07.748047 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8cb601ac-2b77-40a4-87ae-ccc690b1c6e0 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:07.748783 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8cb601ac-2b77-40a4-87ae-ccc690b1c6e0 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:07.787464 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.objects.instance [None req-51c5e7cf-d4dc-4dad-b6a5-9b4528b0140e tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Lazy-loading 'services' on Instance uuid 8fc3c2f5-e86b-4bf0-a124-750ea71e52ad {{(pid=123595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:52:08.013399 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-51c5e7cf-d4dc-4dad-b6a5-9b4528b0140e tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] 10.222.0.43 "DELETE /compute/v2.1/servers/8fc3c2f5-e86b-4bf0-a124-750ea71e52ad/os-volume_attachments/28d740af-3120-446c-9f68-d973cb9a5e67" status: 202 len: 0 microversion: 2.1 time: 0.561544 Oct 04 18:52:08.026343 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2104/4502] 10.222.0.43 () {58 vars in 1416 bytes} [Tue Oct 4 18:52:07 2022] DELETE /compute/v2.1/servers/8fc3c2f5-e86b-4bf0-a124-750ea71e52ad/os-volume_attachments/28d740af-3120-446c-9f68-d973cb9a5e67 => generated 0 bytes in 575 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:52:08.855999 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-8cb601ac-2b77-40a4-87ae-ccc690b1c6e0 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14707008940e4965ab7d1190094a71bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8f94cf1c974654a336645f453c9efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:08.866586 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-8cb601ac-2b77-40a4-87ae-ccc690b1c6e0 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] 10.222.0.43 "GET /compute/v2.1/servers/59d7c8f0-8b36-45e7-bef6-ae97d40d231f" status: 200 len: 1510 microversion: 2.1 time: 1.152260 Oct 04 18:52:08.873280 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2399/4503] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:07 2022] GET /compute/v2.1/servers/59d7c8f0-8b36-45e7-bef6-ae97d40d231f => generated 1510 bytes in 1159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:52:09.898580 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-a9057d18-bc84-4ebe-b3b1-4207222554d2 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:09.900010 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-a9057d18-bc84-4ebe-b3b1-4207222554d2 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] [instance: 59d7c8f0-8b36-45e7-bef6-ae97d40d231f] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:09.920570 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a9057d18-bc84-4ebe-b3b1-4207222554d2 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:09.921320 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a9057d18-bc84-4ebe-b3b1-4207222554d2 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:09.922235 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a9057d18-bc84-4ebe-b3b1-4207222554d2 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:09.925571 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a9057d18-bc84-4ebe-b3b1-4207222554d2 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:09.926491 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a9057d18-bc84-4ebe-b3b1-4207222554d2 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:09.927106 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a9057d18-bc84-4ebe-b3b1-4207222554d2 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:10.567328 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-a9057d18-bc84-4ebe-b3b1-4207222554d2 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14707008940e4965ab7d1190094a71bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8f94cf1c974654a336645f453c9efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:10.583775 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-a9057d18-bc84-4ebe-b3b1-4207222554d2 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] 10.222.0.43 "GET /compute/v2.1/servers/59d7c8f0-8b36-45e7-bef6-ae97d40d231f" status: 200 len: 1510 microversion: 2.1 time: 0.687750 Oct 04 18:52:10.586563 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2105/4504] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:09 2022] GET /compute/v2.1/servers/59d7c8f0-8b36-45e7-bef6-ae97d40d231f => generated 1510 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:52:11.612834 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-fcb974b5-8e2f-4a1f-a3e1-9c4c8b50ccf7 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:11.613556 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-fcb974b5-8e2f-4a1f-a3e1-9c4c8b50ccf7 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] [instance: 59d7c8f0-8b36-45e7-bef6-ae97d40d231f] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:11.625699 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-bbcc0801-730d-4c80-aa68-8127d86f0883 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1730498586", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:52:11.638652 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fcb974b5-8e2f-4a1f-a3e1-9c4c8b50ccf7 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:11.639081 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fcb974b5-8e2f-4a1f-a3e1-9c4c8b50ccf7 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:11.639525 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fcb974b5-8e2f-4a1f-a3e1-9c4c8b50ccf7 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:11.640252 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fcb974b5-8e2f-4a1f-a3e1-9c4c8b50ccf7 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:11.645555 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fcb974b5-8e2f-4a1f-a3e1-9c4c8b50ccf7 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:11.647035 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fcb974b5-8e2f-4a1f-a3e1-9c4c8b50ccf7 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:11.735622 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.network.neutron [None req-bbcc0801-730d-4c80-aa68-8127d86f0883 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] validate_networks() for [('5e962dd3-d3e1-44dd-bd45-86de32c6b5ca', None, None, None, None, None)] {{(pid=123596) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:52:12.010176 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-fcb974b5-8e2f-4a1f-a3e1-9c4c8b50ccf7 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14707008940e4965ab7d1190094a71bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8f94cf1c974654a336645f453c9efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:12.023311 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-fcb974b5-8e2f-4a1f-a3e1-9c4c8b50ccf7 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] 10.222.0.43 "GET /compute/v2.1/servers/59d7c8f0-8b36-45e7-bef6-ae97d40d231f" status: 200 len: 1487 microversion: 2.1 time: 0.418928 Oct 04 18:52:12.024097 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2106/4505] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:11 2022] GET /compute/v2.1/servers/59d7c8f0-8b36-45e7-bef6-ae97d40d231f => generated 1487 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:52:12.052918 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-fd949e7c-994e-495c-8ea5-a62d75f31db5 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-508728335"}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:52:12.056344 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-fd949e7c-994e-495c-8ea5-a62d75f31db5 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] [instance: 59d7c8f0-8b36-45e7-bef6-ae97d40d231f] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:12.070190 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fd949e7c-994e-495c-8ea5-a62d75f31db5 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:12.070695 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fd949e7c-994e-495c-8ea5-a62d75f31db5 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:12.073392 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fd949e7c-994e-495c-8ea5-a62d75f31db5 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:12.074154 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fd949e7c-994e-495c-8ea5-a62d75f31db5 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:12.076549 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fd949e7c-994e-495c-8ea5-a62d75f31db5 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:12.077667 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fd949e7c-994e-495c-8ea5-a62d75f31db5 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:12.216941 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-fd949e7c-994e-495c-8ea5-a62d75f31db5 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] 10.222.0.43 "PUT /compute/v2.1/servers/59d7c8f0-8b36-45e7-bef6-ae97d40d231f" status: 200 len: 1060 microversion: 2.1 time: 0.174001 Oct 04 18:52:12.220311 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2107/4506] 10.222.0.43 () {60 vars in 1256 bytes} [Tue Oct 4 18:52:12 2022] PUT /compute/v2.1/servers/59d7c8f0-8b36-45e7-bef6-ae97d40d231f => generated 1060 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:52:12.239634 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-a4441fd7-6bd4-46da-970c-62e72bb7f64a tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:12.240652 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-a4441fd7-6bd4-46da-970c-62e72bb7f64a tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] [instance: 59d7c8f0-8b36-45e7-bef6-ae97d40d231f] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:12.253690 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a4441fd7-6bd4-46da-970c-62e72bb7f64a tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:12.254204 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a4441fd7-6bd4-46da-970c-62e72bb7f64a tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:12.256152 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a4441fd7-6bd4-46da-970c-62e72bb7f64a tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:12.259388 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a4441fd7-6bd4-46da-970c-62e72bb7f64a tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:12.260001 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a4441fd7-6bd4-46da-970c-62e72bb7f64a tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:12.260450 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a4441fd7-6bd4-46da-970c-62e72bb7f64a tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:12.589978 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-a4441fd7-6bd4-46da-970c-62e72bb7f64a tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14707008940e4965ab7d1190094a71bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8f94cf1c974654a336645f453c9efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:12.599443 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-a4441fd7-6bd4-46da-970c-62e72bb7f64a tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] 10.222.0.43 "GET /compute/v2.1/servers/59d7c8f0-8b36-45e7-bef6-ae97d40d231f" status: 200 len: 1487 microversion: 2.1 time: 0.364453 Oct 04 18:52:12.602359 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2108/4507] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:12 2022] GET /compute/v2.1/servers/59d7c8f0-8b36-45e7-bef6-ae97d40d231f => generated 1487 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:52:12.630668 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-f8b6dab9-d4aa-4461-952f-fb17deb3b93e tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:12.631299 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-f8b6dab9-d4aa-4461-952f-fb17deb3b93e tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] [instance: 59d7c8f0-8b36-45e7-bef6-ae97d40d231f] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:12.643824 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f8b6dab9-d4aa-4461-952f-fb17deb3b93e tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:12.644305 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f8b6dab9-d4aa-4461-952f-fb17deb3b93e tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:12.648322 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f8b6dab9-d4aa-4461-952f-fb17deb3b93e tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:12.649351 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f8b6dab9-d4aa-4461-952f-fb17deb3b93e tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:12.650760 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f8b6dab9-d4aa-4461-952f-fb17deb3b93e tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:12.652094 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f8b6dab9-d4aa-4461-952f-fb17deb3b93e tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:12.947509 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-f8b6dab9-d4aa-4461-952f-fb17deb3b93e tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14707008940e4965ab7d1190094a71bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8f94cf1c974654a336645f453c9efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:12.964688 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-f8b6dab9-d4aa-4461-952f-fb17deb3b93e tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] 10.222.0.43 "GET /compute/v2.1/servers/59d7c8f0-8b36-45e7-bef6-ae97d40d231f" status: 200 len: 1487 microversion: 2.1 time: 0.337962 Oct 04 18:52:12.965763 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2109/4508] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:12 2022] GET /compute/v2.1/servers/59d7c8f0-8b36-45e7-bef6-ae97d40d231f => generated 1487 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:52:12.994135 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-03881e5f-7593-4ff7-961c-c499493a2332 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:12.995185 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-03881e5f-7593-4ff7-961c-c499493a2332 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] [instance: 59d7c8f0-8b36-45e7-bef6-ae97d40d231f] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:13.003505 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-03881e5f-7593-4ff7-961c-c499493a2332 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:13.004609 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-03881e5f-7593-4ff7-961c-c499493a2332 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:13.006332 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-03881e5f-7593-4ff7-961c-c499493a2332 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:13.008076 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-03881e5f-7593-4ff7-961c-c499493a2332 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:13.008858 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-03881e5f-7593-4ff7-961c-c499493a2332 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:13.009809 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-03881e5f-7593-4ff7-961c-c499493a2332 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:13.102077 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-03881e5f-7593-4ff7-961c-c499493a2332 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] [instance: 59d7c8f0-8b36-45e7-bef6-ae97d40d231f] Going to try to terminate instance {{(pid=123595) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:52:13.336233 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-03881e5f-7593-4ff7-961c-c499493a2332 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] 10.222.0.43 "DELETE /compute/v2.1/servers/59d7c8f0-8b36-45e7-bef6-ae97d40d231f" status: 204 len: 0 microversion: 2.1 time: 0.347648 Oct 04 18:52:13.341607 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2110/4509] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 18:52:12 2022] DELETE /compute/v2.1/servers/59d7c8f0-8b36-45e7-bef6-ae97d40d231f => generated 0 bytes in 354 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 18:52:13.351381 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-3465946b-3297-4062-ba40-e11976f7e2cc tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:13.355042 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-3465946b-3297-4062-ba40-e11976f7e2cc tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] [instance: 59d7c8f0-8b36-45e7-bef6-ae97d40d231f] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:13.378454 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3465946b-3297-4062-ba40-e11976f7e2cc tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:13.380129 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3465946b-3297-4062-ba40-e11976f7e2cc tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:13.381241 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3465946b-3297-4062-ba40-e11976f7e2cc tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:13.385926 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3465946b-3297-4062-ba40-e11976f7e2cc tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:13.388600 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3465946b-3297-4062-ba40-e11976f7e2cc tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:13.389561 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3465946b-3297-4062-ba40-e11976f7e2cc tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:13.795369 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-3465946b-3297-4062-ba40-e11976f7e2cc tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14707008940e4965ab7d1190094a71bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8f94cf1c974654a336645f453c9efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:13.811081 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-3465946b-3297-4062-ba40-e11976f7e2cc tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] 10.222.0.43 "GET /compute/v2.1/servers/59d7c8f0-8b36-45e7-bef6-ae97d40d231f" status: 200 len: 1493 microversion: 2.1 time: 0.464872 Oct 04 18:52:13.825525 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2111/4510] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:13 2022] GET /compute/v2.1/servers/59d7c8f0-8b36-45e7-bef6-ae97d40d231f => generated 1493 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:52:14.838919 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-73bf9202-52f5-49b7-8f28-23001d892f2d tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:14.847036 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-73bf9202-52f5-49b7-8f28-23001d892f2d tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] [instance: 59d7c8f0-8b36-45e7-bef6-ae97d40d231f] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:14.867250 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-73bf9202-52f5-49b7-8f28-23001d892f2d tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:14.868155 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-73bf9202-52f5-49b7-8f28-23001d892f2d tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:14.868969 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-73bf9202-52f5-49b7-8f28-23001d892f2d tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:14.869919 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-73bf9202-52f5-49b7-8f28-23001d892f2d tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:14.874529 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-73bf9202-52f5-49b7-8f28-23001d892f2d tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:14.875209 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-73bf9202-52f5-49b7-8f28-23001d892f2d tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:15.743747 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-bbcc0801-730d-4c80-aa68-8127d86f0883 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Flavor limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:52:15.745891 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-bbcc0801-730d-4c80-aa68-8127d86f0883 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Image limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:52:15.750871 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-bbcc0801-730d-4c80-aa68-8127d86f0883 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Flavor pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:52:15.751720 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-bbcc0801-730d-4c80-aa68-8127d86f0883 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Image pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:52:15.752947 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-bbcc0801-730d-4c80-aa68-8127d86f0883 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:52:15.776080 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bbcc0801-730d-4c80-aa68-8127d86f0883 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:15.777166 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bbcc0801-730d-4c80-aa68-8127d86f0883 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:15.779436 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bbcc0801-730d-4c80-aa68-8127d86f0883 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:15.781252 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bbcc0801-730d-4c80-aa68-8127d86f0883 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:15.783640 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bbcc0801-730d-4c80-aa68-8127d86f0883 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:15.784677 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bbcc0801-730d-4c80-aa68-8127d86f0883 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:15.852295 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-bbcc0801-730d-4c80-aa68-8127d86f0883 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Getting quotas for project beaa0e0951d549ecafdc1f15417d831e. Resources: {'ram', 'cores', 'instances'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:52:15.863575 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-bbcc0801-730d-4c80-aa68-8127d86f0883 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Getting quotas for user ba9b75d37d8b4f49b49af5808e0c3c69 and project beaa0e0951d549ecafdc1f15417d831e. Resources: {'ram', 'cores', 'instances'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:52:15.895396 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-bbcc0801-730d-4c80-aa68-8127d86f0883 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Going to run 1 instances... {{(pid=123596) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:52:15.898391 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-bbcc0801-730d-4c80-aa68-8127d86f0883 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] [instance: 1b1ea635-1a53-4c84-9b4b-3a9c48567fdb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e8943ec5-4038-4d4b-b9b9-2415a79f5243',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123596) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:52:16.039453 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-bbcc0801-730d-4c80-aa68-8127d86f0883 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.711230 Oct 04 18:52:16.041171 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2400/4511] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 18:52:11 2022] POST /compute/v2.1/servers => generated 383 bytes in 4715 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:52:16.059214 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-b7510c03-19fd-45d2-b42c-6e61730460a6 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:16.062460 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-b7510c03-19fd-45d2-b42c-6e61730460a6 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] [instance: 1b1ea635-1a53-4c84-9b4b-3a9c48567fdb] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:16.450891 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-b7510c03-19fd-45d2-b42c-6e61730460a6 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9b75d37d8b4f49b49af5808e0c3c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beaa0e0951d549ecafdc1f15417d831e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:16.460374 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-b7510c03-19fd-45d2-b42c-6e61730460a6 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] 10.222.0.43 "GET /compute/v2.1/servers/1b1ea635-1a53-4c84-9b4b-3a9c48567fdb" status: 200 len: 1214 microversion: 2.1 time: 0.412101 Oct 04 18:52:16.462640 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2401/4512] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:16 2022] GET /compute/v2.1/servers/1b1ea635-1a53-4c84-9b4b-3a9c48567fdb => generated 1214 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:52:16.719241 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-73bf9202-52f5-49b7-8f28-23001d892f2d tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14707008940e4965ab7d1190094a71bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8f94cf1c974654a336645f453c9efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:16.755022 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-73bf9202-52f5-49b7-8f28-23001d892f2d tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] 10.222.0.43 "GET /compute/v2.1/servers/59d7c8f0-8b36-45e7-bef6-ae97d40d231f" status: 200 len: 1493 microversion: 2.1 time: 1.920709 Oct 04 18:52:16.770316 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2112/4513] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:14 2022] GET /compute/v2.1/servers/59d7c8f0-8b36-45e7-bef6-ae97d40d231f => generated 1493 bytes in 1931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:52:17.491931 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-76d6588b-1e46-4e48-8b4a-6aca19ebb044 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:17.492564 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-76d6588b-1e46-4e48-8b4a-6aca19ebb044 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] [instance: 1b1ea635-1a53-4c84-9b4b-3a9c48567fdb] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:17.510904 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-76d6588b-1e46-4e48-8b4a-6aca19ebb044 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:17.511410 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-76d6588b-1e46-4e48-8b4a-6aca19ebb044 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:17.511862 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-76d6588b-1e46-4e48-8b4a-6aca19ebb044 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:17.512587 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-76d6588b-1e46-4e48-8b4a-6aca19ebb044 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:17.513052 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-76d6588b-1e46-4e48-8b4a-6aca19ebb044 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:17.527504 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-76d6588b-1e46-4e48-8b4a-6aca19ebb044 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:17.689921 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-76d6588b-1e46-4e48-8b4a-6aca19ebb044 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9b75d37d8b4f49b49af5808e0c3c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beaa0e0951d549ecafdc1f15417d831e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:17.699409 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-76d6588b-1e46-4e48-8b4a-6aca19ebb044 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] 10.222.0.43 "GET /compute/v2.1/servers/1b1ea635-1a53-4c84-9b4b-3a9c48567fdb" status: 200 len: 1218 microversion: 2.1 time: 0.211864 Oct 04 18:52:17.722483 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2402/4514] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:17 2022] GET /compute/v2.1/servers/1b1ea635-1a53-4c84-9b4b-3a9c48567fdb => generated 1218 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:52:17.783670 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-f91ffa0b-d38a-4013-be66-6c013c02af60 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:17.784298 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-f91ffa0b-d38a-4013-be66-6c013c02af60 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] [instance: 59d7c8f0-8b36-45e7-bef6-ae97d40d231f] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:17.795244 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:52:17.821941 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f91ffa0b-d38a-4013-be66-6c013c02af60 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:17.822456 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f91ffa0b-d38a-4013-be66-6c013c02af60 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:17.822905 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f91ffa0b-d38a-4013-be66-6c013c02af60 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:17.824129 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f91ffa0b-d38a-4013-be66-6c013c02af60 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:17.825479 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f91ffa0b-d38a-4013-be66-6c013c02af60 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:17.826108 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f91ffa0b-d38a-4013-be66-6c013c02af60 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:18.731503 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-1f8d870f-1edb-4091-87bd-90466fe6adcd tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:18.732318 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-1f8d870f-1edb-4091-87bd-90466fe6adcd tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] [instance: 1b1ea635-1a53-4c84-9b4b-3a9c48567fdb] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:18.753536 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1f8d870f-1edb-4091-87bd-90466fe6adcd tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:18.760140 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1f8d870f-1edb-4091-87bd-90466fe6adcd tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:18.760684 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1f8d870f-1edb-4091-87bd-90466fe6adcd tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:18.761649 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1f8d870f-1edb-4091-87bd-90466fe6adcd tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:18.762126 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1f8d870f-1edb-4091-87bd-90466fe6adcd tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:18.762583 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1f8d870f-1edb-4091-87bd-90466fe6adcd tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:18.843095 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-f91ffa0b-d38a-4013-be66-6c013c02af60 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14707008940e4965ab7d1190094a71bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8f94cf1c974654a336645f453c9efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:18.853640 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-f91ffa0b-d38a-4013-be66-6c013c02af60 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] 10.222.0.43 "GET /compute/v2.1/servers/59d7c8f0-8b36-45e7-bef6-ae97d40d231f" status: 200 len: 1451 microversion: 2.1 time: 1.073972 Oct 04 18:52:18.854579 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2113/4515] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:17 2022] GET /compute/v2.1/servers/59d7c8f0-8b36-45e7-bef6-ae97d40d231f => generated 1451 bytes in 1076 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:52:18.939294 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-1f8d870f-1edb-4091-87bd-90466fe6adcd tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9b75d37d8b4f49b49af5808e0c3c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beaa0e0951d549ecafdc1f15417d831e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:18.970940 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-1f8d870f-1edb-4091-87bd-90466fe6adcd tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] 10.222.0.43 "GET /compute/v2.1/servers/1b1ea635-1a53-4c84-9b4b-3a9c48567fdb" status: 200 len: 1272 microversion: 2.1 time: 0.243553 Oct 04 18:52:18.974997 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2403/4516] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:18 2022] GET /compute/v2.1/servers/1b1ea635-1a53-4c84-9b4b-3a9c48567fdb => generated 1272 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:52:19.815319 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-c5380e65-b1d3-4980-bc6b-b39bf9977216 req-4ea0c765-fba9-40bf-aeeb-d38fb6f1730a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59d7c8f0-8b36-45e7-bef6-ae97d40d231f", "name": "network-vif-deleted", "tag": "db6546c5-c59c-4c1e-b900-1a00fb333499"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:52:19.871711 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-c5380e65-b1d3-4980-bc6b-b39bf9977216 req-4ea0c765-fba9-40bf-aeeb-d38fb6f1730a service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:19.888305 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-16731b4d-c75e-40f3-87d7-b6b89ae7ac69 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:19.890260 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-c5380e65-b1d3-4980-bc6b-b39bf9977216 req-4ea0c765-fba9-40bf-aeeb-d38fb6f1730a service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:19.891517 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-c5380e65-b1d3-4980-bc6b-b39bf9977216 req-4ea0c765-fba9-40bf-aeeb-d38fb6f1730a service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:19.893134 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-16731b4d-c75e-40f3-87d7-b6b89ae7ac69 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] [instance: 59d7c8f0-8b36-45e7-bef6-ae97d40d231f] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:19.925565 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-16731b4d-c75e-40f3-87d7-b6b89ae7ac69 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:19.929953 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-16731b4d-c75e-40f3-87d7-b6b89ae7ac69 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:19.930845 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-16731b4d-c75e-40f3-87d7-b6b89ae7ac69 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:19.931735 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-16731b4d-c75e-40f3-87d7-b6b89ae7ac69 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:19.932722 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-16731b4d-c75e-40f3-87d7-b6b89ae7ac69 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:19.934519 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-16731b4d-c75e-40f3-87d7-b6b89ae7ac69 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:19.956041 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-c5380e65-b1d3-4980-bc6b-b39bf9977216 req-4ea0c765-fba9-40bf-aeeb-d38fb6f1730a service nova] Creating event network-vif-deleted:db6546c5-c59c-4c1e-b900-1a00fb333499 for instance 59d7c8f0-8b36-45e7-bef6-ae97d40d231f on n-h1-851028-13 Oct 04 18:52:19.968319 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-c5380e65-b1d3-4980-bc6b-b39bf9977216 req-4ea0c765-fba9-40bf-aeeb-d38fb6f1730a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.413295 Oct 04 18:52:19.970372 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2114/4517] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:52:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:52:20.006597 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-db0c6973-59d8-4e0e-aea0-5cd34fa8554b tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:20.008318 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-db0c6973-59d8-4e0e-aea0-5cd34fa8554b tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] [instance: 1b1ea635-1a53-4c84-9b4b-3a9c48567fdb] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:20.024571 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-16731b4d-c75e-40f3-87d7-b6b89ae7ac69 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:20.025084 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-16731b4d-c75e-40f3-87d7-b6b89ae7ac69 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:20.025680 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-16731b4d-c75e-40f3-87d7-b6b89ae7ac69 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:20.026145 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.objects.instance [None req-16731b4d-c75e-40f3-87d7-b6b89ae7ac69 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lazy-loading 'fault' on Instance uuid 59d7c8f0-8b36-45e7-bef6-ae97d40d231f {{(pid=123596) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:52:20.030961 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-db0c6973-59d8-4e0e-aea0-5cd34fa8554b tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:20.034649 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-db0c6973-59d8-4e0e-aea0-5cd34fa8554b tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:20.036647 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-db0c6973-59d8-4e0e-aea0-5cd34fa8554b tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:20.037700 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-db0c6973-59d8-4e0e-aea0-5cd34fa8554b tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:20.046000 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-db0c6973-59d8-4e0e-aea0-5cd34fa8554b tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:20.065742 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-db0c6973-59d8-4e0e-aea0-5cd34fa8554b tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:20.280146 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-16731b4d-c75e-40f3-87d7-b6b89ae7ac69 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14707008940e4965ab7d1190094a71bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8f94cf1c974654a336645f453c9efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:20.293713 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-16731b4d-c75e-40f3-87d7-b6b89ae7ac69 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] 10.222.0.43 "GET /compute/v2.1/servers/59d7c8f0-8b36-45e7-bef6-ae97d40d231f" status: 200 len: 1309 microversion: 2.1 time: 0.416479 Oct 04 18:52:20.330004 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2404/4518] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:19 2022] GET /compute/v2.1/servers/59d7c8f0-8b36-45e7-bef6-ae97d40d231f => generated 1309 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:52:20.548802 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-db0c6973-59d8-4e0e-aea0-5cd34fa8554b tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9b75d37d8b4f49b49af5808e0c3c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beaa0e0951d549ecafdc1f15417d831e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:20.556946 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-2017f25e-a104-48c1-b614-e16342edf90c tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:20.560126 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-2017f25e-a104-48c1-b614-e16342edf90c tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] [instance: 8fc3c2f5-e86b-4bf0-a124-750ea71e52ad] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:20.564621 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-db0c6973-59d8-4e0e-aea0-5cd34fa8554b tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] 10.222.0.43 "GET /compute/v2.1/servers/1b1ea635-1a53-4c84-9b4b-3a9c48567fdb" status: 200 len: 1272 microversion: 2.1 time: 0.564583 Oct 04 18:52:20.566733 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2115/4519] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:19 2022] GET /compute/v2.1/servers/1b1ea635-1a53-4c84-9b4b-3a9c48567fdb => generated 1272 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:52:20.582026 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2017f25e-a104-48c1-b614-e16342edf90c tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:20.598021 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2017f25e-a104-48c1-b614-e16342edf90c tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:20.601483 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2017f25e-a104-48c1-b614-e16342edf90c tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:20.602427 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2017f25e-a104-48c1-b614-e16342edf90c tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:20.602925 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2017f25e-a104-48c1-b614-e16342edf90c tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:20.603347 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2017f25e-a104-48c1-b614-e16342edf90c tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:20.703594 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-2017f25e-a104-48c1-b614-e16342edf90c tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] 10.222.0.43 "GET /compute/v2.1/servers/8fc3c2f5-e86b-4bf0-a124-750ea71e52ad/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.151510 Oct 04 18:52:20.710460 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2405/4520] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Oct 4 18:52:20 2022] GET /compute/v2.1/servers/8fc3c2f5-e86b-4bf0-a124-750ea71e52ad/os-volume_attachments => generated 25 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 04 18:52:20.822584 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-ebc585f6-a2cd-4555-bcaf-9df72c118ba6 tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:20.825957 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-ebc585f6-a2cd-4555-bcaf-9df72c118ba6 tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] [instance: 8fc3c2f5-e86b-4bf0-a124-750ea71e52ad] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:20.846244 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ebc585f6-a2cd-4555-bcaf-9df72c118ba6 tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:20.846755 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ebc585f6-a2cd-4555-bcaf-9df72c118ba6 tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:20.847208 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ebc585f6-a2cd-4555-bcaf-9df72c118ba6 tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:20.853319 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ebc585f6-a2cd-4555-bcaf-9df72c118ba6 tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:20.855117 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ebc585f6-a2cd-4555-bcaf-9df72c118ba6 tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:20.857945 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ebc585f6-a2cd-4555-bcaf-9df72c118ba6 tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:20.942973 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:52:20.949941 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-ebc585f6-a2cd-4555-bcaf-9df72c118ba6 tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] 10.222.0.43 "GET /compute/v2.1/servers/8fc3c2f5-e86b-4bf0-a124-750ea71e52ad/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.129528 Oct 04 18:52:20.950973 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2116/4521] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Oct 4 18:52:20 2022] GET /compute/v2.1/servers/8fc3c2f5-e86b-4bf0-a124-750ea71e52ad/os-volume_attachments => generated 25 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:52:21.123267 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-13dd247a-c371-4528-a02a-f720eac7be9a tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:21.124417 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-13dd247a-c371-4528-a02a-f720eac7be9a tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] [instance: 8fc3c2f5-e86b-4bf0-a124-750ea71e52ad] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:21.135288 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-13dd247a-c371-4528-a02a-f720eac7be9a tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:21.135963 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-13dd247a-c371-4528-a02a-f720eac7be9a tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:21.136761 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-13dd247a-c371-4528-a02a-f720eac7be9a tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:21.138278 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-13dd247a-c371-4528-a02a-f720eac7be9a tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:21.139262 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-13dd247a-c371-4528-a02a-f720eac7be9a tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:21.139999 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-13dd247a-c371-4528-a02a-f720eac7be9a tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:21.217012 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-13dd247a-c371-4528-a02a-f720eac7be9a tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] [instance: 8fc3c2f5-e86b-4bf0-a124-750ea71e52ad] Going to try to terminate instance {{(pid=123596) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:52:21.333926 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-b7ea04d4-af93-4bcb-b854-0b455f4c121a tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:21.334974 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-b7ea04d4-af93-4bcb-b854-0b455f4c121a tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] [instance: 59d7c8f0-8b36-45e7-bef6-ae97d40d231f] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:21.348450 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b7ea04d4-af93-4bcb-b854-0b455f4c121a tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:21.355433 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b7ea04d4-af93-4bcb-b854-0b455f4c121a tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:21.356155 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b7ea04d4-af93-4bcb-b854-0b455f4c121a tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:21.357068 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b7ea04d4-af93-4bcb-b854-0b455f4c121a tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:21.357709 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b7ea04d4-af93-4bcb-b854-0b455f4c121a tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:21.358307 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b7ea04d4-af93-4bcb-b854-0b455f4c121a tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:21.390069 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-b7ea04d4-af93-4bcb-b854-0b455f4c121a tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] HTTP exception thrown: Instance 59d7c8f0-8b36-45e7-bef6-ae97d40d231f could not be found. Oct 04 18:52:21.399363 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-b7ea04d4-af93-4bcb-b854-0b455f4c121a tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Request method failure captured: Oct 04 18:52:21.399363 n-d-851028-13 devstack@n-api.service[123595]: request: GET /compute/v2.1/servers/59d7c8f0-8b36-45e7-bef6-ae97d40d231f HTTP/1.1 Oct 04 18:52:21.399363 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 18:52:21.399363 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 18:52:21.399363 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 18:52:21.399363 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 0 Oct 04 18:52:21.399363 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 18:52:21.399363 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 18:52:21.399363 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 18:52:21.399363 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 18:52:21.399363 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPIAJxznq_dqRpKBeHYz_tTt-BPe6PGX8bXmZXSSSBar-nAl3_7gjSqUW3yyr2J4Kw1m1-l6Y2izmzOt3P0Lv3UhhGPTaACGzV6RGiSkRczLrMXORtXSdyVIiZq3MCL7L2uQGd29MwUZa7-C3NoIEqHwDxvVJi_WWjtFyKnOFEp1-BZ0 Oct 04 18:52:21.399363 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 18:52:21.399363 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 18:52:21.399363 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 18:52:21.399363 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 18:52:21.399363 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 18:52:21.399363 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 18:52:21.399363 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: ed8f94cf1c974654a336645f453c9efc Oct 04 18:52:21.399363 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-ServersTestJSON-546754383 Oct 04 18:52:21.399363 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 18:52:21.399363 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 18:52:21.399363 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/ed8f94cf1c974654a336645f453c9efc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_ed8f94cf1c974654a336645f453c9efc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ed8f94cf1c974654a336645f453c9efc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ed8f94cf1c974654a336645f453c9efc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:52:21.399363 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-ServersTestJSON-546754383 Oct 04 18:52:21.399363 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: ed8f94cf1c974654a336645f453c9efc Oct 04 18:52:21.399363 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-ServersTestJSON-546754383 Oct 04 18:52:21.399363 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-ServersTestJSON-546754383-project Oct 04 18:52:21.399363 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 18:52:21.399363 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 18:52:21.399363 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: 14707008940e4965ab7d1190094a71bb Oct 04 18:52:21.399363 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-ServersTestJSON-546754383-project Oct 04 18:52:21.399363 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 18:52:21.399363 n-d-851028-13 devstack@n-api.service[123595]: exception: Instance 59d7c8f0-8b36-45e7-bef6-ae97d40d231f could not be found. Oct 04 18:52:21.399363 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': '59d7c8f0-8b36-45e7-bef6-ae97d40d231f'} Oct 04 18:52:21.399363 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:52:21.399363 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:52:21.399363 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:52:21.399363 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:52:21.399363 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:52:21.399363 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:52:21.399363 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:52:21.399363 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:52:21.399363 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:52:21.399363 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:52:21.399363 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 59d7c8f0-8b36-45e7-bef6-ae97d40d231f could not be found. Oct 04 18:52:21.399363 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:52:21.399363 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:52:21.399363 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:52:21.399363 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:52:21.399363 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:52:21.399363 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:52:21.399363 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:52:21.399363 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:52:21.399363 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:52:21.399363 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:52:21.399363 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:52:21.399363 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:52:21.399363 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:52:21.399363 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:52:21.399363 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:52:21.399363 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:52:21.399363 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 59d7c8f0-8b36-45e7-bef6-ae97d40d231f could not be found. Oct 04 18:52:21.399363 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:52:21.399363 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:52:21.399363 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:52:21.399363 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:52:21.404048 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:52:21.404048 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:52:21.404048 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:52:21.404048 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:52:21.404048 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 59d7c8f0-8b36-45e7-bef6-ae97d40d231f could not be found. Oct 04 18:52:21.404048 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:52:21.413995 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-b7ea04d4-af93-4bcb-b854-0b455f4c121a tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Returning 404 to user: Instance 59d7c8f0-8b36-45e7-bef6-ae97d40d231f could not be found. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:52:21.415644 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-b7ea04d4-af93-4bcb-b854-0b455f4c121a tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] 10.222.0.43 "GET /compute/v2.1/servers/59d7c8f0-8b36-45e7-bef6-ae97d40d231f" status: 404 len: 111 microversion: 2.1 time: 0.085362 Oct 04 18:52:21.417917 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2117/4522] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:21 2022] GET /compute/v2.1/servers/59d7c8f0-8b36-45e7-bef6-ae97d40d231f => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:52:21.426483 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-13dd247a-c371-4528-a02a-f720eac7be9a tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] 10.222.0.43 "DELETE /compute/v2.1/servers/8fc3c2f5-e86b-4bf0-a124-750ea71e52ad" status: 204 len: 0 microversion: 2.1 time: 0.305419 Oct 04 18:52:21.427465 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2406/4523] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 18:52:21 2022] DELETE /compute/v2.1/servers/8fc3c2f5-e86b-4bf0-a124-750ea71e52ad => generated 0 bytes in 310 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 18:52:21.436870 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-8937f8bd-57bf-41bc-950e-ccce3f55fe61 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:21.437506 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-8937f8bd-57bf-41bc-950e-ccce3f55fe61 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] [instance: 59d7c8f0-8b36-45e7-bef6-ae97d40d231f] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:21.438791 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-fab8265a-f418-434f-94b5-5a5c53db54dd tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:21.439981 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-fab8265a-f418-434f-94b5-5a5c53db54dd tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] [instance: 8fc3c2f5-e86b-4bf0-a124-750ea71e52ad] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:21.451895 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8937f8bd-57bf-41bc-950e-ccce3f55fe61 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:21.452408 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8937f8bd-57bf-41bc-950e-ccce3f55fe61 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:21.452854 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8937f8bd-57bf-41bc-950e-ccce3f55fe61 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:21.457817 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8937f8bd-57bf-41bc-950e-ccce3f55fe61 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:21.458322 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8937f8bd-57bf-41bc-950e-ccce3f55fe61 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:21.458993 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8937f8bd-57bf-41bc-950e-ccce3f55fe61 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:21.469005 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fab8265a-f418-434f-94b5-5a5c53db54dd tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:21.478532 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fab8265a-f418-434f-94b5-5a5c53db54dd tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:21.484683 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fab8265a-f418-434f-94b5-5a5c53db54dd tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:21.485730 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fab8265a-f418-434f-94b5-5a5c53db54dd tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:21.486494 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fab8265a-f418-434f-94b5-5a5c53db54dd tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:21.487657 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fab8265a-f418-434f-94b5-5a5c53db54dd tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:21.501588 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-8937f8bd-57bf-41bc-950e-ccce3f55fe61 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] HTTP exception thrown: Instance 59d7c8f0-8b36-45e7-bef6-ae97d40d231f could not be found. Oct 04 18:52:21.503316 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-8937f8bd-57bf-41bc-950e-ccce3f55fe61 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Request method failure captured: Oct 04 18:52:21.503316 n-d-851028-13 devstack@n-api.service[123596]: request: DELETE /compute/v2.1/servers/59d7c8f0-8b36-45e7-bef6-ae97d40d231f HTTP/1.1 Oct 04 18:52:21.503316 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:52:21.503316 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:52:21.503316 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:52:21.503316 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 18:52:21.503316 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:52:21.503316 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:52:21.503316 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:52:21.503316 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:52:21.503316 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPIAJxznq_dqRpKBeHYz_tTt-BPe6PGX8bXmZXSSSBar-nAl3_7gjSqUW3yyr2J4Kw1m1-l6Y2izmzOt3P0Lv3UhhGPTaACGzV6RGiSkRczLrMXORtXSdyVIiZq3MCL7L2uQGd29MwUZa7-C3NoIEqHwDxvVJi_WWjtFyKnOFEp1-BZ0 Oct 04 18:52:21.503316 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:52:21.503316 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:52:21.503316 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:52:21.503316 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:52:21.503316 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:52:21.503316 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:52:21.503316 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: ed8f94cf1c974654a336645f453c9efc Oct 04 18:52:21.503316 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-ServersTestJSON-546754383 Oct 04 18:52:21.503316 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 18:52:21.503316 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 18:52:21.503316 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/ed8f94cf1c974654a336645f453c9efc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_ed8f94cf1c974654a336645f453c9efc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ed8f94cf1c974654a336645f453c9efc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ed8f94cf1c974654a336645f453c9efc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:52:21.503316 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-ServersTestJSON-546754383 Oct 04 18:52:21.503316 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: ed8f94cf1c974654a336645f453c9efc Oct 04 18:52:21.503316 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-ServersTestJSON-546754383 Oct 04 18:52:21.503316 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-ServersTestJSON-546754383-project Oct 04 18:52:21.503316 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:52:21.503316 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:52:21.503316 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 14707008940e4965ab7d1190094a71bb Oct 04 18:52:21.503316 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-ServersTestJSON-546754383-project Oct 04 18:52:21.503316 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 18:52:21.503316 n-d-851028-13 devstack@n-api.service[123596]: exception: Instance 59d7c8f0-8b36-45e7-bef6-ae97d40d231f could not be found. Oct 04 18:52:21.503316 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': '59d7c8f0-8b36-45e7-bef6-ae97d40d231f'} Oct 04 18:52:21.503316 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:52:21.503316 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:52:21.503316 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:52:21.503316 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:52:21.503316 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:52:21.503316 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:52:21.503316 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:52:21.503316 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:52:21.503316 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:52:21.503316 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:52:21.503316 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 59d7c8f0-8b36-45e7-bef6-ae97d40d231f could not be found. Oct 04 18:52:21.503316 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:52:21.503316 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:52:21.503316 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:52:21.503316 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:52:21.503316 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:52:21.503316 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:52:21.503316 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:52:21.503316 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:52:21.503316 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:52:21.503316 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:52:21.503316 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:52:21.503316 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:52:21.503316 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:52:21.503316 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:52:21.503316 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:52:21.503316 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:52:21.503316 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:52:21.503316 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:52:21.503316 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 59d7c8f0-8b36-45e7-bef6-ae97d40d231f could not be found. Oct 04 18:52:21.511375 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:52:21.511375 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:52:21.511375 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:52:21.511375 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:52:21.511375 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:52:21.511375 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:52:21.511375 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:52:21.511375 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:52:21.511375 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 59d7c8f0-8b36-45e7-bef6-ae97d40d231f could not be found. Oct 04 18:52:21.511375 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:52:21.511375 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-8937f8bd-57bf-41bc-950e-ccce3f55fe61 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Returning 404 to user: Instance 59d7c8f0-8b36-45e7-bef6-ae97d40d231f could not be found. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:52:21.511375 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-8937f8bd-57bf-41bc-950e-ccce3f55fe61 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] 10.222.0.43 "DELETE /compute/v2.1/servers/59d7c8f0-8b36-45e7-bef6-ae97d40d231f" status: 404 len: 111 microversion: 2.1 time: 0.072330 Oct 04 18:52:21.511375 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2407/4524] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 18:52:21 2022] DELETE /compute/v2.1/servers/59d7c8f0-8b36-45e7-bef6-ae97d40d231f => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:52:21.513912 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f98b522b-5cf2-4c72-a02b-8f3731812c95 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:21.517918 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-f98b522b-5cf2-4c72-a02b-8f3731812c95 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] [instance: 59d7c8f0-8b36-45e7-bef6-ae97d40d231f] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:21.529415 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f98b522b-5cf2-4c72-a02b-8f3731812c95 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:21.530125 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f98b522b-5cf2-4c72-a02b-8f3731812c95 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:21.530725 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f98b522b-5cf2-4c72-a02b-8f3731812c95 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:21.532188 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f98b522b-5cf2-4c72-a02b-8f3731812c95 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:21.534321 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f98b522b-5cf2-4c72-a02b-8f3731812c95 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:21.535979 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f98b522b-5cf2-4c72-a02b-8f3731812c95 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:21.560240 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-f98b522b-5cf2-4c72-a02b-8f3731812c95 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] HTTP exception thrown: Instance 59d7c8f0-8b36-45e7-bef6-ae97d40d231f could not be found. Oct 04 18:52:21.562345 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f98b522b-5cf2-4c72-a02b-8f3731812c95 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Request method failure captured: Oct 04 18:52:21.562345 n-d-851028-13 devstack@n-api.service[123596]: request: GET /compute/v2.1/servers/59d7c8f0-8b36-45e7-bef6-ae97d40d231f HTTP/1.1 Oct 04 18:52:21.562345 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:52:21.562345 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:52:21.562345 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:52:21.562345 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 18:52:21.562345 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:52:21.562345 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:52:21.562345 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:52:21.562345 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:52:21.562345 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPIAJxznq_dqRpKBeHYz_tTt-BPe6PGX8bXmZXSSSBar-nAl3_7gjSqUW3yyr2J4Kw1m1-l6Y2izmzOt3P0Lv3UhhGPTaACGzV6RGiSkRczLrMXORtXSdyVIiZq3MCL7L2uQGd29MwUZa7-C3NoIEqHwDxvVJi_WWjtFyKnOFEp1-BZ0 Oct 04 18:52:21.562345 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:52:21.562345 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:52:21.562345 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:52:21.562345 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:52:21.562345 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:52:21.562345 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:52:21.562345 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: ed8f94cf1c974654a336645f453c9efc Oct 04 18:52:21.562345 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-ServersTestJSON-546754383 Oct 04 18:52:21.562345 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 18:52:21.562345 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 18:52:21.562345 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/ed8f94cf1c974654a336645f453c9efc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_ed8f94cf1c974654a336645f453c9efc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ed8f94cf1c974654a336645f453c9efc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ed8f94cf1c974654a336645f453c9efc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:52:21.562345 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-ServersTestJSON-546754383 Oct 04 18:52:21.562345 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: ed8f94cf1c974654a336645f453c9efc Oct 04 18:52:21.562345 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-ServersTestJSON-546754383 Oct 04 18:52:21.562345 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-ServersTestJSON-546754383-project Oct 04 18:52:21.562345 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:52:21.562345 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:52:21.562345 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 14707008940e4965ab7d1190094a71bb Oct 04 18:52:21.562345 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-ServersTestJSON-546754383-project Oct 04 18:52:21.562345 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 18:52:21.562345 n-d-851028-13 devstack@n-api.service[123596]: exception: Instance 59d7c8f0-8b36-45e7-bef6-ae97d40d231f could not be found. Oct 04 18:52:21.562345 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': '59d7c8f0-8b36-45e7-bef6-ae97d40d231f'} Oct 04 18:52:21.562345 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:52:21.562345 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:52:21.562345 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:52:21.562345 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:52:21.562345 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:52:21.562345 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:52:21.562345 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:52:21.562345 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:52:21.562345 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:52:21.562345 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:52:21.562345 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 59d7c8f0-8b36-45e7-bef6-ae97d40d231f could not be found. Oct 04 18:52:21.562345 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:52:21.562345 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:52:21.562345 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:52:21.562345 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:52:21.562345 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:52:21.562345 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:52:21.562345 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:52:21.562345 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:52:21.562345 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:52:21.562345 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:52:21.562345 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:52:21.562345 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:52:21.562345 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:52:21.562345 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:52:21.562345 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:52:21.562345 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:52:21.562345 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 59d7c8f0-8b36-45e7-bef6-ae97d40d231f could not be found. Oct 04 18:52:21.562345 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:52:21.562345 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:52:21.562345 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:52:21.562345 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:52:21.566827 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:52:21.566827 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:52:21.566827 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:52:21.566827 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:52:21.566827 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 59d7c8f0-8b36-45e7-bef6-ae97d40d231f could not be found. Oct 04 18:52:21.566827 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:52:21.569700 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f98b522b-5cf2-4c72-a02b-8f3731812c95 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Returning 404 to user: Instance 59d7c8f0-8b36-45e7-bef6-ae97d40d231f could not be found. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:52:21.570828 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-f98b522b-5cf2-4c72-a02b-8f3731812c95 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] 10.222.0.43 "GET /compute/v2.1/servers/59d7c8f0-8b36-45e7-bef6-ae97d40d231f" status: 404 len: 111 microversion: 2.1 time: 0.060861 Oct 04 18:52:21.574797 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2408/4525] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:21 2022] GET /compute/v2.1/servers/59d7c8f0-8b36-45e7-bef6-ae97d40d231f => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:52:21.580586 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-32c2a24f-b3d3-4f7e-8557-b3335e8455ce tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:21.581728 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-32c2a24f-b3d3-4f7e-8557-b3335e8455ce tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] [instance: 379687e5-a142-4246-be27-d5df590c2cc8] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:21.592591 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-32c2a24f-b3d3-4f7e-8557-b3335e8455ce tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:21.593396 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-32c2a24f-b3d3-4f7e-8557-b3335e8455ce tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:21.594010 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-32c2a24f-b3d3-4f7e-8557-b3335e8455ce tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:21.595576 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-32c2a24f-b3d3-4f7e-8557-b3335e8455ce tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:21.606647 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-32c2a24f-b3d3-4f7e-8557-b3335e8455ce tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:21.614035 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-32c2a24f-b3d3-4f7e-8557-b3335e8455ce tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:21.639046 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-32c2a24f-b3d3-4f7e-8557-b3335e8455ce tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] HTTP exception thrown: Instance 379687e5-a142-4246-be27-d5df590c2cc8 could not be found. Oct 04 18:52:21.642569 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-32c2a24f-b3d3-4f7e-8557-b3335e8455ce tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Request method failure captured: Oct 04 18:52:21.642569 n-d-851028-13 devstack@n-api.service[123596]: request: DELETE /compute/v2.1/servers/379687e5-a142-4246-be27-d5df590c2cc8 HTTP/1.1 Oct 04 18:52:21.642569 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:52:21.642569 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:52:21.642569 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:52:21.642569 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 18:52:21.642569 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:52:21.642569 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:52:21.642569 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:52:21.642569 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:52:21.642569 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPIAJxznq_dqRpKBeHYz_tTt-BPe6PGX8bXmZXSSSBar-nAl3_7gjSqUW3yyr2J4Kw1m1-l6Y2izmzOt3P0Lv3UhhGPTaACGzV6RGiSkRczLrMXORtXSdyVIiZq3MCL7L2uQGd29MwUZa7-C3NoIEqHwDxvVJi_WWjtFyKnOFEp1-BZ0 Oct 04 18:52:21.642569 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:52:21.642569 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:52:21.642569 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:52:21.642569 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:52:21.642569 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:52:21.642569 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:52:21.642569 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: ed8f94cf1c974654a336645f453c9efc Oct 04 18:52:21.642569 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-ServersTestJSON-546754383 Oct 04 18:52:21.642569 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 18:52:21.642569 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 18:52:21.642569 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/ed8f94cf1c974654a336645f453c9efc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_ed8f94cf1c974654a336645f453c9efc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ed8f94cf1c974654a336645f453c9efc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ed8f94cf1c974654a336645f453c9efc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:52:21.642569 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-ServersTestJSON-546754383 Oct 04 18:52:21.642569 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: ed8f94cf1c974654a336645f453c9efc Oct 04 18:52:21.642569 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-ServersTestJSON-546754383 Oct 04 18:52:21.642569 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-ServersTestJSON-546754383-project Oct 04 18:52:21.642569 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:52:21.642569 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:52:21.642569 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 14707008940e4965ab7d1190094a71bb Oct 04 18:52:21.642569 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-ServersTestJSON-546754383-project Oct 04 18:52:21.642569 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 18:52:21.642569 n-d-851028-13 devstack@n-api.service[123596]: exception: Instance 379687e5-a142-4246-be27-d5df590c2cc8 could not be found. Oct 04 18:52:21.642569 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': '379687e5-a142-4246-be27-d5df590c2cc8'} Oct 04 18:52:21.642569 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:52:21.642569 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:52:21.642569 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:52:21.642569 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:52:21.642569 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:52:21.642569 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:52:21.642569 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:52:21.642569 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:52:21.642569 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:52:21.642569 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:52:21.642569 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 379687e5-a142-4246-be27-d5df590c2cc8 could not be found. Oct 04 18:52:21.642569 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:52:21.642569 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:52:21.642569 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:52:21.642569 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:52:21.642569 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:52:21.642569 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:52:21.642569 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:52:21.642569 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:52:21.642569 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:52:21.642569 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:52:21.642569 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:52:21.642569 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:52:21.642569 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:52:21.642569 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:52:21.642569 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:52:21.642569 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:52:21.642569 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:52:21.642569 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:52:21.642569 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 379687e5-a142-4246-be27-d5df590c2cc8 could not be found. Oct 04 18:52:21.647076 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:52:21.647076 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:52:21.647076 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:52:21.647076 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:52:21.647076 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:52:21.647076 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:52:21.647076 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:52:21.647076 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:52:21.647076 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 379687e5-a142-4246-be27-d5df590c2cc8 could not be found. Oct 04 18:52:21.647076 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:52:21.649506 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-32c2a24f-b3d3-4f7e-8557-b3335e8455ce tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Returning 404 to user: Instance 379687e5-a142-4246-be27-d5df590c2cc8 could not be found. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:52:21.650838 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-32c2a24f-b3d3-4f7e-8557-b3335e8455ce tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] 10.222.0.43 "DELETE /compute/v2.1/servers/379687e5-a142-4246-be27-d5df590c2cc8" status: 404 len: 111 microversion: 2.1 time: 0.074569 Oct 04 18:52:21.651967 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2409/4526] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 18:52:21 2022] DELETE /compute/v2.1/servers/379687e5-a142-4246-be27-d5df590c2cc8 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:52:21.660468 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-2c253210-ef73-43e0-9155-29a58ac906d3 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:21.661846 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-2c253210-ef73-43e0-9155-29a58ac906d3 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] [instance: 1b1ea635-1a53-4c84-9b4b-3a9c48567fdb] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:21.670555 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2c253210-ef73-43e0-9155-29a58ac906d3 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:21.672445 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2c253210-ef73-43e0-9155-29a58ac906d3 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:21.673096 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2c253210-ef73-43e0-9155-29a58ac906d3 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:21.674658 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2c253210-ef73-43e0-9155-29a58ac906d3 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:21.675317 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2c253210-ef73-43e0-9155-29a58ac906d3 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:21.678291 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2c253210-ef73-43e0-9155-29a58ac906d3 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:21.777215 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-2c253210-ef73-43e0-9155-29a58ac906d3 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9b75d37d8b4f49b49af5808e0c3c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beaa0e0951d549ecafdc1f15417d831e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:21.789719 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-2c253210-ef73-43e0-9155-29a58ac906d3 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] 10.222.0.43 "GET /compute/v2.1/servers/1b1ea635-1a53-4c84-9b4b-3a9c48567fdb" status: 200 len: 1272 microversion: 2.1 time: 0.133135 Oct 04 18:52:21.802368 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2410/4527] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:21 2022] GET /compute/v2.1/servers/1b1ea635-1a53-4c84-9b4b-3a9c48567fdb => generated 1272 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:52:21.813759 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-29c7c13a-2e8c-431f-a2fb-d30184278c9b tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:21.814388 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-29c7c13a-2e8c-431f-a2fb-d30184278c9b tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] [instance: 379687e5-a142-4246-be27-d5df590c2cc8] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:21.821646 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-29c7c13a-2e8c-431f-a2fb-d30184278c9b tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:21.822162 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-29c7c13a-2e8c-431f-a2fb-d30184278c9b tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:21.822630 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-29c7c13a-2e8c-431f-a2fb-d30184278c9b tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:21.823345 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-29c7c13a-2e8c-431f-a2fb-d30184278c9b tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:21.823807 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-29c7c13a-2e8c-431f-a2fb-d30184278c9b tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:21.825334 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-29c7c13a-2e8c-431f-a2fb-d30184278c9b tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:21.860067 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-29c7c13a-2e8c-431f-a2fb-d30184278c9b tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] HTTP exception thrown: Instance 379687e5-a142-4246-be27-d5df590c2cc8 could not be found. Oct 04 18:52:21.864248 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-29c7c13a-2e8c-431f-a2fb-d30184278c9b tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Request method failure captured: Oct 04 18:52:21.864248 n-d-851028-13 devstack@n-api.service[123596]: request: GET /compute/v2.1/servers/379687e5-a142-4246-be27-d5df590c2cc8 HTTP/1.1 Oct 04 18:52:21.864248 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:52:21.864248 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:52:21.864248 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:52:21.864248 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 18:52:21.864248 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:52:21.864248 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:52:21.864248 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:52:21.864248 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:52:21.864248 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPIAJxznq_dqRpKBeHYz_tTt-BPe6PGX8bXmZXSSSBar-nAl3_7gjSqUW3yyr2J4Kw1m1-l6Y2izmzOt3P0Lv3UhhGPTaACGzV6RGiSkRczLrMXORtXSdyVIiZq3MCL7L2uQGd29MwUZa7-C3NoIEqHwDxvVJi_WWjtFyKnOFEp1-BZ0 Oct 04 18:52:21.864248 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:52:21.864248 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:52:21.864248 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:52:21.864248 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:52:21.864248 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:52:21.864248 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:52:21.864248 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: ed8f94cf1c974654a336645f453c9efc Oct 04 18:52:21.864248 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-ServersTestJSON-546754383 Oct 04 18:52:21.864248 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 18:52:21.864248 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 18:52:21.864248 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/ed8f94cf1c974654a336645f453c9efc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_ed8f94cf1c974654a336645f453c9efc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ed8f94cf1c974654a336645f453c9efc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ed8f94cf1c974654a336645f453c9efc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:52:21.864248 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-ServersTestJSON-546754383 Oct 04 18:52:21.864248 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: ed8f94cf1c974654a336645f453c9efc Oct 04 18:52:21.864248 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-ServersTestJSON-546754383 Oct 04 18:52:21.864248 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-ServersTestJSON-546754383-project Oct 04 18:52:21.864248 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:52:21.864248 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:52:21.864248 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 14707008940e4965ab7d1190094a71bb Oct 04 18:52:21.864248 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-ServersTestJSON-546754383-project Oct 04 18:52:21.864248 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 18:52:21.864248 n-d-851028-13 devstack@n-api.service[123596]: exception: Instance 379687e5-a142-4246-be27-d5df590c2cc8 could not be found. Oct 04 18:52:21.864248 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': '379687e5-a142-4246-be27-d5df590c2cc8'} Oct 04 18:52:21.864248 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:52:21.864248 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:52:21.864248 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:52:21.864248 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:52:21.864248 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:52:21.864248 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:52:21.864248 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:52:21.864248 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:52:21.864248 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:52:21.864248 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:52:21.864248 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 379687e5-a142-4246-be27-d5df590c2cc8 could not be found. Oct 04 18:52:21.864248 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:52:21.864248 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:52:21.864248 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:52:21.864248 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:52:21.864248 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:52:21.864248 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:52:21.864248 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:52:21.864248 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:52:21.864248 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:52:21.864248 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:52:21.864248 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:52:21.864248 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:52:21.864248 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:52:21.864248 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:52:21.864248 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:52:21.864248 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:52:21.864248 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 379687e5-a142-4246-be27-d5df590c2cc8 could not be found. Oct 04 18:52:21.864248 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:52:21.864248 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:52:21.864248 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:52:21.864248 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:52:21.871397 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:52:21.871397 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:52:21.871397 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:52:21.871397 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:52:21.871397 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 379687e5-a142-4246-be27-d5df590c2cc8 could not be found. Oct 04 18:52:21.871397 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:52:21.873740 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-29c7c13a-2e8c-431f-a2fb-d30184278c9b tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Returning 404 to user: Instance 379687e5-a142-4246-be27-d5df590c2cc8 could not be found. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:52:21.874974 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-29c7c13a-2e8c-431f-a2fb-d30184278c9b tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] 10.222.0.43 "GET /compute/v2.1/servers/379687e5-a142-4246-be27-d5df590c2cc8" status: 404 len: 111 microversion: 2.1 time: 0.071499 Oct 04 18:52:21.875776 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2411/4528] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:21 2022] GET /compute/v2.1/servers/379687e5-a142-4246-be27-d5df590c2cc8 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:52:21.885210 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-e3653425-4a00-4a8a-ba90-da9c7fbedc7e tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:21.886114 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-e3653425-4a00-4a8a-ba90-da9c7fbedc7e tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] [instance: d802635f-8f77-4488-84e0-a973e3244525] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:21.893491 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e3653425-4a00-4a8a-ba90-da9c7fbedc7e tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:21.894447 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e3653425-4a00-4a8a-ba90-da9c7fbedc7e tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:21.895092 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e3653425-4a00-4a8a-ba90-da9c7fbedc7e tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:21.896019 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e3653425-4a00-4a8a-ba90-da9c7fbedc7e tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:21.896828 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e3653425-4a00-4a8a-ba90-da9c7fbedc7e tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:21.897486 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e3653425-4a00-4a8a-ba90-da9c7fbedc7e tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:21.916778 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-e3653425-4a00-4a8a-ba90-da9c7fbedc7e tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] HTTP exception thrown: Instance d802635f-8f77-4488-84e0-a973e3244525 could not be found. Oct 04 18:52:21.930878 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-e3653425-4a00-4a8a-ba90-da9c7fbedc7e tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Request method failure captured: Oct 04 18:52:21.930878 n-d-851028-13 devstack@n-api.service[123596]: request: DELETE /compute/v2.1/servers/d802635f-8f77-4488-84e0-a973e3244525 HTTP/1.1 Oct 04 18:52:21.930878 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:52:21.930878 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:52:21.930878 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:52:21.930878 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 18:52:21.930878 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:52:21.930878 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:52:21.930878 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:52:21.930878 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:52:21.930878 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPIAJxznq_dqRpKBeHYz_tTt-BPe6PGX8bXmZXSSSBar-nAl3_7gjSqUW3yyr2J4Kw1m1-l6Y2izmzOt3P0Lv3UhhGPTaACGzV6RGiSkRczLrMXORtXSdyVIiZq3MCL7L2uQGd29MwUZa7-C3NoIEqHwDxvVJi_WWjtFyKnOFEp1-BZ0 Oct 04 18:52:21.930878 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:52:21.930878 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:52:21.930878 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:52:21.930878 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:52:21.930878 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:52:21.930878 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:52:21.930878 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: ed8f94cf1c974654a336645f453c9efc Oct 04 18:52:21.930878 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-ServersTestJSON-546754383 Oct 04 18:52:21.930878 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 18:52:21.930878 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 18:52:21.930878 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/ed8f94cf1c974654a336645f453c9efc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_ed8f94cf1c974654a336645f453c9efc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ed8f94cf1c974654a336645f453c9efc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ed8f94cf1c974654a336645f453c9efc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:52:21.930878 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-ServersTestJSON-546754383 Oct 04 18:52:21.930878 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: ed8f94cf1c974654a336645f453c9efc Oct 04 18:52:21.930878 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-ServersTestJSON-546754383 Oct 04 18:52:21.930878 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-ServersTestJSON-546754383-project Oct 04 18:52:21.930878 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:52:21.930878 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:52:21.930878 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 14707008940e4965ab7d1190094a71bb Oct 04 18:52:21.930878 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-ServersTestJSON-546754383-project Oct 04 18:52:21.930878 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 18:52:21.930878 n-d-851028-13 devstack@n-api.service[123596]: exception: Instance d802635f-8f77-4488-84e0-a973e3244525 could not be found. Oct 04 18:52:21.930878 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': 'd802635f-8f77-4488-84e0-a973e3244525'} Oct 04 18:52:21.930878 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:52:21.930878 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:52:21.930878 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:52:21.930878 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:52:21.930878 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:52:21.930878 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:52:21.930878 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:52:21.930878 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:52:21.930878 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:52:21.930878 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:52:21.930878 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d802635f-8f77-4488-84e0-a973e3244525 could not be found. Oct 04 18:52:21.930878 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:52:21.930878 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:52:21.930878 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:52:21.930878 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:52:21.930878 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:52:21.930878 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:52:21.930878 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:52:21.930878 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:52:21.930878 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:52:21.930878 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:52:21.930878 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:52:21.930878 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:52:21.930878 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:52:21.930878 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:52:21.930878 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:52:21.930878 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:52:21.930878 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:52:21.930878 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:52:21.930878 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d802635f-8f77-4488-84e0-a973e3244525 could not be found. Oct 04 18:52:21.938002 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:52:21.938002 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:52:21.938002 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:52:21.938002 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:52:21.938002 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:52:21.938002 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:52:21.938002 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:52:21.938002 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:52:21.938002 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d802635f-8f77-4488-84e0-a973e3244525 could not be found. Oct 04 18:52:21.938002 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:52:21.940561 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-e3653425-4a00-4a8a-ba90-da9c7fbedc7e tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Returning 404 to user: Instance d802635f-8f77-4488-84e0-a973e3244525 could not be found. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:52:21.941730 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-e3653425-4a00-4a8a-ba90-da9c7fbedc7e tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] 10.222.0.43 "DELETE /compute/v2.1/servers/d802635f-8f77-4488-84e0-a973e3244525" status: 404 len: 111 microversion: 2.1 time: 0.061214 Oct 04 18:52:21.946211 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2412/4529] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 18:52:21 2022] DELETE /compute/v2.1/servers/d802635f-8f77-4488-84e0-a973e3244525 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:52:21.951518 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f2046a47-0897-40c4-9a1d-d63249b7c9aa tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:21.953046 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-f2046a47-0897-40c4-9a1d-d63249b7c9aa tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] [instance: d802635f-8f77-4488-84e0-a973e3244525] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:21.961265 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f2046a47-0897-40c4-9a1d-d63249b7c9aa tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:21.962099 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f2046a47-0897-40c4-9a1d-d63249b7c9aa tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:21.963048 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f2046a47-0897-40c4-9a1d-d63249b7c9aa tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:21.964053 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f2046a47-0897-40c4-9a1d-d63249b7c9aa tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:21.964914 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f2046a47-0897-40c4-9a1d-d63249b7c9aa tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:21.966690 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f2046a47-0897-40c4-9a1d-d63249b7c9aa tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:21.994016 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-f2046a47-0897-40c4-9a1d-d63249b7c9aa tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] HTTP exception thrown: Instance d802635f-8f77-4488-84e0-a973e3244525 could not be found. Oct 04 18:52:21.995602 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f2046a47-0897-40c4-9a1d-d63249b7c9aa tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Request method failure captured: Oct 04 18:52:21.995602 n-d-851028-13 devstack@n-api.service[123596]: request: GET /compute/v2.1/servers/d802635f-8f77-4488-84e0-a973e3244525 HTTP/1.1 Oct 04 18:52:21.995602 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:52:21.995602 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:52:21.995602 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:52:21.995602 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 18:52:21.995602 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:52:21.995602 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:52:21.995602 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:52:21.995602 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:52:21.995602 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPIAJxznq_dqRpKBeHYz_tTt-BPe6PGX8bXmZXSSSBar-nAl3_7gjSqUW3yyr2J4Kw1m1-l6Y2izmzOt3P0Lv3UhhGPTaACGzV6RGiSkRczLrMXORtXSdyVIiZq3MCL7L2uQGd29MwUZa7-C3NoIEqHwDxvVJi_WWjtFyKnOFEp1-BZ0 Oct 04 18:52:21.995602 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:52:21.995602 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:52:21.995602 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:52:21.995602 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:52:21.995602 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:52:21.995602 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:52:21.995602 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: ed8f94cf1c974654a336645f453c9efc Oct 04 18:52:21.995602 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-ServersTestJSON-546754383 Oct 04 18:52:21.995602 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 18:52:21.995602 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 18:52:21.995602 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/ed8f94cf1c974654a336645f453c9efc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_ed8f94cf1c974654a336645f453c9efc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ed8f94cf1c974654a336645f453c9efc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ed8f94cf1c974654a336645f453c9efc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:52:21.995602 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-ServersTestJSON-546754383 Oct 04 18:52:21.995602 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: ed8f94cf1c974654a336645f453c9efc Oct 04 18:52:21.995602 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-ServersTestJSON-546754383 Oct 04 18:52:21.995602 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-ServersTestJSON-546754383-project Oct 04 18:52:21.995602 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:52:21.995602 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:52:21.995602 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 14707008940e4965ab7d1190094a71bb Oct 04 18:52:21.995602 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-ServersTestJSON-546754383-project Oct 04 18:52:21.995602 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 18:52:21.995602 n-d-851028-13 devstack@n-api.service[123596]: exception: Instance d802635f-8f77-4488-84e0-a973e3244525 could not be found. Oct 04 18:52:21.995602 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': 'd802635f-8f77-4488-84e0-a973e3244525'} Oct 04 18:52:21.995602 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:52:21.995602 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:52:21.995602 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:52:21.995602 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:52:21.995602 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:52:21.995602 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:52:21.995602 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:52:21.995602 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:52:21.995602 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:52:21.995602 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:52:21.995602 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d802635f-8f77-4488-84e0-a973e3244525 could not be found. Oct 04 18:52:21.995602 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:52:21.995602 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:52:21.995602 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:52:21.995602 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:52:21.995602 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:52:21.995602 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:52:21.995602 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:52:21.995602 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:52:21.995602 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:52:21.995602 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:52:21.995602 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:52:21.995602 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:52:21.995602 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:52:21.995602 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:52:21.995602 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:52:21.995602 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:52:21.995602 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d802635f-8f77-4488-84e0-a973e3244525 could not be found. Oct 04 18:52:21.995602 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:52:21.995602 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:52:21.995602 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:52:21.995602 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:52:22.001708 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:52:22.001708 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:52:22.001708 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:52:22.001708 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:52:22.001708 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d802635f-8f77-4488-84e0-a973e3244525 could not be found. Oct 04 18:52:22.001708 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:52:22.001708 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f2046a47-0897-40c4-9a1d-d63249b7c9aa tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Returning 404 to user: Instance d802635f-8f77-4488-84e0-a973e3244525 could not be found. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:52:22.001708 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-f2046a47-0897-40c4-9a1d-d63249b7c9aa tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] 10.222.0.43 "GET /compute/v2.1/servers/d802635f-8f77-4488-84e0-a973e3244525" status: 404 len: 111 microversion: 2.1 time: 0.049661 Oct 04 18:52:22.001708 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2413/4530] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:21 2022] GET /compute/v2.1/servers/d802635f-8f77-4488-84e0-a973e3244525 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:52:22.008786 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-4855538f-db23-4985-915e-948eedb93e5b tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:22.009316 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-4855538f-db23-4985-915e-948eedb93e5b tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] [instance: af90e409-4121-4169-b06b-814350b000ec] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:22.018419 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4855538f-db23-4985-915e-948eedb93e5b tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:22.021692 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4855538f-db23-4985-915e-948eedb93e5b tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:22.022327 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4855538f-db23-4985-915e-948eedb93e5b tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:22.023628 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4855538f-db23-4985-915e-948eedb93e5b tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:22.024237 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4855538f-db23-4985-915e-948eedb93e5b tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:22.024797 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4855538f-db23-4985-915e-948eedb93e5b tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:22.043885 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-4855538f-db23-4985-915e-948eedb93e5b tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] HTTP exception thrown: Instance af90e409-4121-4169-b06b-814350b000ec could not be found. Oct 04 18:52:22.045995 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-4855538f-db23-4985-915e-948eedb93e5b tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Request method failure captured: Oct 04 18:52:22.045995 n-d-851028-13 devstack@n-api.service[123596]: request: DELETE /compute/v2.1/servers/af90e409-4121-4169-b06b-814350b000ec HTTP/1.1 Oct 04 18:52:22.045995 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:52:22.045995 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:52:22.045995 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:52:22.045995 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 18:52:22.045995 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:52:22.045995 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:52:22.045995 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:52:22.045995 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:52:22.045995 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPIAJxznq_dqRpKBeHYz_tTt-BPe6PGX8bXmZXSSSBar-nAl3_7gjSqUW3yyr2J4Kw1m1-l6Y2izmzOt3P0Lv3UhhGPTaACGzV6RGiSkRczLrMXORtXSdyVIiZq3MCL7L2uQGd29MwUZa7-C3NoIEqHwDxvVJi_WWjtFyKnOFEp1-BZ0 Oct 04 18:52:22.045995 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:52:22.045995 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:52:22.045995 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:52:22.045995 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:52:22.045995 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:52:22.045995 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:52:22.045995 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: ed8f94cf1c974654a336645f453c9efc Oct 04 18:52:22.045995 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-ServersTestJSON-546754383 Oct 04 18:52:22.045995 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 18:52:22.045995 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 18:52:22.045995 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/ed8f94cf1c974654a336645f453c9efc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_ed8f94cf1c974654a336645f453c9efc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ed8f94cf1c974654a336645f453c9efc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ed8f94cf1c974654a336645f453c9efc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:52:22.045995 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-ServersTestJSON-546754383 Oct 04 18:52:22.045995 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: ed8f94cf1c974654a336645f453c9efc Oct 04 18:52:22.045995 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-ServersTestJSON-546754383 Oct 04 18:52:22.045995 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-ServersTestJSON-546754383-project Oct 04 18:52:22.045995 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:52:22.045995 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:52:22.045995 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 14707008940e4965ab7d1190094a71bb Oct 04 18:52:22.045995 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-ServersTestJSON-546754383-project Oct 04 18:52:22.045995 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 18:52:22.045995 n-d-851028-13 devstack@n-api.service[123596]: exception: Instance af90e409-4121-4169-b06b-814350b000ec could not be found. Oct 04 18:52:22.045995 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': 'af90e409-4121-4169-b06b-814350b000ec'} Oct 04 18:52:22.045995 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:52:22.045995 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:52:22.045995 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:52:22.045995 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:52:22.045995 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:52:22.045995 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:52:22.045995 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:52:22.045995 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:52:22.045995 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:52:22.045995 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:52:22.045995 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af90e409-4121-4169-b06b-814350b000ec could not be found. Oct 04 18:52:22.045995 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:52:22.045995 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:52:22.045995 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:52:22.045995 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:52:22.045995 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:52:22.045995 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:52:22.045995 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:52:22.045995 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:52:22.045995 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:52:22.045995 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:52:22.045995 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:52:22.045995 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:52:22.045995 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:52:22.045995 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:52:22.045995 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:52:22.045995 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:52:22.045995 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:52:22.045995 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:52:22.045995 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af90e409-4121-4169-b06b-814350b000ec could not be found. Oct 04 18:52:22.049756 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:52:22.049756 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:52:22.049756 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:52:22.049756 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:52:22.049756 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:52:22.049756 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:52:22.049756 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:52:22.049756 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:52:22.049756 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af90e409-4121-4169-b06b-814350b000ec could not be found. Oct 04 18:52:22.049756 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:52:22.050993 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-fab8265a-f418-434f-94b5-5a5c53db54dd tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4b6ab960cd4f909975c9bb14d50480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40894812ff042979932773f36a70e0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:22.056528 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-4855538f-db23-4985-915e-948eedb93e5b tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Returning 404 to user: Instance af90e409-4121-4169-b06b-814350b000ec could not be found. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:52:22.057716 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-4855538f-db23-4985-915e-948eedb93e5b tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] 10.222.0.43 "DELETE /compute/v2.1/servers/af90e409-4121-4169-b06b-814350b000ec" status: 404 len: 111 microversion: 2.1 time: 0.053459 Oct 04 18:52:22.058546 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2414/4531] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 18:52:22 2022] DELETE /compute/v2.1/servers/af90e409-4121-4169-b06b-814350b000ec => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:52:22.060386 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-fab8265a-f418-434f-94b5-5a5c53db54dd tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] 10.222.0.43 "GET /compute/v2.1/servers/8fc3c2f5-e86b-4bf0-a124-750ea71e52ad" status: 200 len: 1681 microversion: 2.1 time: 0.628389 Oct 04 18:52:22.060976 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2118/4532] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:21 2022] GET /compute/v2.1/servers/8fc3c2f5-e86b-4bf0-a124-750ea71e52ad => generated 1681 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:52:22.083199 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-0f9d769d-86ee-41ee-acf6-aa2fccb318c6 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:22.083829 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-0f9d769d-86ee-41ee-acf6-aa2fccb318c6 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] [instance: af90e409-4121-4169-b06b-814350b000ec] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:22.091149 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0f9d769d-86ee-41ee-acf6-aa2fccb318c6 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:22.091665 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0f9d769d-86ee-41ee-acf6-aa2fccb318c6 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:22.092114 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0f9d769d-86ee-41ee-acf6-aa2fccb318c6 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:22.092841 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0f9d769d-86ee-41ee-acf6-aa2fccb318c6 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:22.093344 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0f9d769d-86ee-41ee-acf6-aa2fccb318c6 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:22.093786 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0f9d769d-86ee-41ee-acf6-aa2fccb318c6 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:22.115112 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-0f9d769d-86ee-41ee-acf6-aa2fccb318c6 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] HTTP exception thrown: Instance af90e409-4121-4169-b06b-814350b000ec could not be found. Oct 04 18:52:22.119248 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-0f9d769d-86ee-41ee-acf6-aa2fccb318c6 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Request method failure captured: Oct 04 18:52:22.119248 n-d-851028-13 devstack@n-api.service[123596]: request: GET /compute/v2.1/servers/af90e409-4121-4169-b06b-814350b000ec HTTP/1.1 Oct 04 18:52:22.119248 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:52:22.119248 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:52:22.119248 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:52:22.119248 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 18:52:22.119248 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:52:22.119248 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:52:22.119248 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:52:22.119248 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:52:22.119248 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPIAJxznq_dqRpKBeHYz_tTt-BPe6PGX8bXmZXSSSBar-nAl3_7gjSqUW3yyr2J4Kw1m1-l6Y2izmzOt3P0Lv3UhhGPTaACGzV6RGiSkRczLrMXORtXSdyVIiZq3MCL7L2uQGd29MwUZa7-C3NoIEqHwDxvVJi_WWjtFyKnOFEp1-BZ0 Oct 04 18:52:22.119248 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:52:22.119248 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:52:22.119248 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:52:22.119248 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:52:22.119248 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:52:22.119248 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:52:22.119248 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: ed8f94cf1c974654a336645f453c9efc Oct 04 18:52:22.119248 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-ServersTestJSON-546754383 Oct 04 18:52:22.119248 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 18:52:22.119248 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 18:52:22.119248 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/ed8f94cf1c974654a336645f453c9efc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_ed8f94cf1c974654a336645f453c9efc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ed8f94cf1c974654a336645f453c9efc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ed8f94cf1c974654a336645f453c9efc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:52:22.119248 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-ServersTestJSON-546754383 Oct 04 18:52:22.119248 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: ed8f94cf1c974654a336645f453c9efc Oct 04 18:52:22.119248 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-ServersTestJSON-546754383 Oct 04 18:52:22.119248 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-ServersTestJSON-546754383-project Oct 04 18:52:22.119248 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:52:22.119248 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:52:22.119248 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 14707008940e4965ab7d1190094a71bb Oct 04 18:52:22.119248 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-ServersTestJSON-546754383-project Oct 04 18:52:22.119248 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 18:52:22.119248 n-d-851028-13 devstack@n-api.service[123596]: exception: Instance af90e409-4121-4169-b06b-814350b000ec could not be found. Oct 04 18:52:22.119248 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': 'af90e409-4121-4169-b06b-814350b000ec'} Oct 04 18:52:22.119248 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:52:22.119248 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:52:22.119248 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:52:22.119248 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:52:22.119248 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:52:22.119248 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:52:22.119248 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:52:22.119248 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:52:22.119248 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:52:22.119248 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:52:22.119248 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af90e409-4121-4169-b06b-814350b000ec could not be found. Oct 04 18:52:22.119248 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:52:22.119248 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:52:22.119248 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:52:22.119248 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:52:22.119248 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:52:22.119248 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:52:22.119248 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:52:22.119248 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:52:22.119248 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:52:22.119248 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:52:22.119248 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:52:22.119248 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:52:22.119248 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:52:22.119248 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:52:22.119248 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:52:22.119248 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:52:22.119248 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af90e409-4121-4169-b06b-814350b000ec could not be found. Oct 04 18:52:22.119248 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:52:22.119248 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:52:22.119248 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:52:22.119248 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:52:22.124568 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:52:22.124568 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:52:22.124568 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:52:22.124568 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:52:22.124568 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af90e409-4121-4169-b06b-814350b000ec could not be found. Oct 04 18:52:22.124568 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:52:22.125758 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-0f9d769d-86ee-41ee-acf6-aa2fccb318c6 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Returning 404 to user: Instance af90e409-4121-4169-b06b-814350b000ec could not be found. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:52:22.126818 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-0f9d769d-86ee-41ee-acf6-aa2fccb318c6 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] 10.222.0.43 "GET /compute/v2.1/servers/af90e409-4121-4169-b06b-814350b000ec" status: 404 len: 111 microversion: 2.1 time: 0.048704 Oct 04 18:52:22.134651 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2415/4533] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:22 2022] GET /compute/v2.1/servers/af90e409-4121-4169-b06b-814350b000ec => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:52:22.136907 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-5534a97f-1c13-4759-ba2f-a8e72ddc1b90 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:22.138396 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-5534a97f-1c13-4759-ba2f-a8e72ddc1b90 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] [instance: 4275d1a7-42d6-4af5-be51-64fb1c4f6fad] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:22.147100 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5534a97f-1c13-4759-ba2f-a8e72ddc1b90 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:22.147793 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5534a97f-1c13-4759-ba2f-a8e72ddc1b90 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:22.148422 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5534a97f-1c13-4759-ba2f-a8e72ddc1b90 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:22.149370 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5534a97f-1c13-4759-ba2f-a8e72ddc1b90 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:22.149989 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5534a97f-1c13-4759-ba2f-a8e72ddc1b90 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:22.150423 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5534a97f-1c13-4759-ba2f-a8e72ddc1b90 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:22.170823 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-5534a97f-1c13-4759-ba2f-a8e72ddc1b90 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] HTTP exception thrown: Instance 4275d1a7-42d6-4af5-be51-64fb1c4f6fad could not be found. Oct 04 18:52:22.173311 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-5534a97f-1c13-4759-ba2f-a8e72ddc1b90 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Request method failure captured: Oct 04 18:52:22.173311 n-d-851028-13 devstack@n-api.service[123595]: request: DELETE /compute/v2.1/servers/4275d1a7-42d6-4af5-be51-64fb1c4f6fad HTTP/1.1 Oct 04 18:52:22.173311 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 18:52:22.173311 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 18:52:22.173311 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 18:52:22.173311 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 0 Oct 04 18:52:22.173311 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 18:52:22.173311 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 18:52:22.173311 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 18:52:22.173311 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 18:52:22.173311 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPIAJxznq_dqRpKBeHYz_tTt-BPe6PGX8bXmZXSSSBar-nAl3_7gjSqUW3yyr2J4Kw1m1-l6Y2izmzOt3P0Lv3UhhGPTaACGzV6RGiSkRczLrMXORtXSdyVIiZq3MCL7L2uQGd29MwUZa7-C3NoIEqHwDxvVJi_WWjtFyKnOFEp1-BZ0 Oct 04 18:52:22.173311 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 18:52:22.173311 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 18:52:22.173311 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 18:52:22.173311 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 18:52:22.173311 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 18:52:22.173311 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 18:52:22.173311 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: ed8f94cf1c974654a336645f453c9efc Oct 04 18:52:22.173311 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-ServersTestJSON-546754383 Oct 04 18:52:22.173311 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 18:52:22.173311 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 18:52:22.173311 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/ed8f94cf1c974654a336645f453c9efc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_ed8f94cf1c974654a336645f453c9efc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ed8f94cf1c974654a336645f453c9efc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ed8f94cf1c974654a336645f453c9efc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:52:22.173311 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-ServersTestJSON-546754383 Oct 04 18:52:22.173311 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: ed8f94cf1c974654a336645f453c9efc Oct 04 18:52:22.173311 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-ServersTestJSON-546754383 Oct 04 18:52:22.173311 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-ServersTestJSON-546754383-project Oct 04 18:52:22.173311 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 18:52:22.173311 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 18:52:22.173311 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: 14707008940e4965ab7d1190094a71bb Oct 04 18:52:22.173311 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-ServersTestJSON-546754383-project Oct 04 18:52:22.173311 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 18:52:22.173311 n-d-851028-13 devstack@n-api.service[123595]: exception: Instance 4275d1a7-42d6-4af5-be51-64fb1c4f6fad could not be found. Oct 04 18:52:22.173311 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': '4275d1a7-42d6-4af5-be51-64fb1c4f6fad'} Oct 04 18:52:22.173311 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:52:22.173311 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:52:22.173311 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:52:22.173311 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:52:22.173311 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:52:22.173311 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:52:22.173311 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:52:22.173311 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:52:22.173311 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:52:22.173311 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:52:22.173311 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4275d1a7-42d6-4af5-be51-64fb1c4f6fad could not be found. Oct 04 18:52:22.173311 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:52:22.173311 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:52:22.173311 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:52:22.173311 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:52:22.173311 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:52:22.173311 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:52:22.173311 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:52:22.173311 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:52:22.173311 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:52:22.173311 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:52:22.173311 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:52:22.173311 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:52:22.173311 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:52:22.173311 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:52:22.173311 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:52:22.173311 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:52:22.173311 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:52:22.173311 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:52:22.173311 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4275d1a7-42d6-4af5-be51-64fb1c4f6fad could not be found. Oct 04 18:52:22.178030 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:52:22.178030 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:52:22.178030 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:52:22.178030 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:52:22.178030 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:52:22.178030 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:52:22.178030 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:52:22.178030 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:52:22.178030 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4275d1a7-42d6-4af5-be51-64fb1c4f6fad could not be found. Oct 04 18:52:22.178030 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:52:22.180185 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-5534a97f-1c13-4759-ba2f-a8e72ddc1b90 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Returning 404 to user: Instance 4275d1a7-42d6-4af5-be51-64fb1c4f6fad could not be found. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:52:22.182166 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-5534a97f-1c13-4759-ba2f-a8e72ddc1b90 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] 10.222.0.43 "DELETE /compute/v2.1/servers/4275d1a7-42d6-4af5-be51-64fb1c4f6fad" status: 404 len: 111 microversion: 2.1 time: 0.049378 Oct 04 18:52:22.182938 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2119/4534] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 18:52:22 2022] DELETE /compute/v2.1/servers/4275d1a7-42d6-4af5-be51-64fb1c4f6fad => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:52:22.191207 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-bca6d43a-c548-4569-afcb-09f2f10743c1 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:22.192051 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-bca6d43a-c548-4569-afcb-09f2f10743c1 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] [instance: 4275d1a7-42d6-4af5-be51-64fb1c4f6fad] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:22.200175 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bca6d43a-c548-4569-afcb-09f2f10743c1 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:22.200886 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bca6d43a-c548-4569-afcb-09f2f10743c1 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:22.201509 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bca6d43a-c548-4569-afcb-09f2f10743c1 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:22.202471 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bca6d43a-c548-4569-afcb-09f2f10743c1 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:22.203082 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bca6d43a-c548-4569-afcb-09f2f10743c1 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:22.203678 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bca6d43a-c548-4569-afcb-09f2f10743c1 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:22.225054 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-bca6d43a-c548-4569-afcb-09f2f10743c1 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] HTTP exception thrown: Instance 4275d1a7-42d6-4af5-be51-64fb1c4f6fad could not be found. Oct 04 18:52:22.227303 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-bca6d43a-c548-4569-afcb-09f2f10743c1 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Request method failure captured: Oct 04 18:52:22.227303 n-d-851028-13 devstack@n-api.service[123596]: request: GET /compute/v2.1/servers/4275d1a7-42d6-4af5-be51-64fb1c4f6fad HTTP/1.1 Oct 04 18:52:22.227303 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:52:22.227303 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:52:22.227303 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:52:22.227303 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 18:52:22.227303 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:52:22.227303 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:52:22.227303 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:52:22.227303 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:52:22.227303 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPIAJxznq_dqRpKBeHYz_tTt-BPe6PGX8bXmZXSSSBar-nAl3_7gjSqUW3yyr2J4Kw1m1-l6Y2izmzOt3P0Lv3UhhGPTaACGzV6RGiSkRczLrMXORtXSdyVIiZq3MCL7L2uQGd29MwUZa7-C3NoIEqHwDxvVJi_WWjtFyKnOFEp1-BZ0 Oct 04 18:52:22.227303 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:52:22.227303 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:52:22.227303 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:52:22.227303 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:52:22.227303 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:52:22.227303 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:52:22.227303 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: ed8f94cf1c974654a336645f453c9efc Oct 04 18:52:22.227303 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-ServersTestJSON-546754383 Oct 04 18:52:22.227303 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 18:52:22.227303 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 18:52:22.227303 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/ed8f94cf1c974654a336645f453c9efc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_ed8f94cf1c974654a336645f453c9efc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ed8f94cf1c974654a336645f453c9efc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ed8f94cf1c974654a336645f453c9efc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:52:22.227303 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-ServersTestJSON-546754383 Oct 04 18:52:22.227303 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: ed8f94cf1c974654a336645f453c9efc Oct 04 18:52:22.227303 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-ServersTestJSON-546754383 Oct 04 18:52:22.227303 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-ServersTestJSON-546754383-project Oct 04 18:52:22.227303 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:52:22.227303 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:52:22.227303 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 14707008940e4965ab7d1190094a71bb Oct 04 18:52:22.227303 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-ServersTestJSON-546754383-project Oct 04 18:52:22.227303 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 18:52:22.227303 n-d-851028-13 devstack@n-api.service[123596]: exception: Instance 4275d1a7-42d6-4af5-be51-64fb1c4f6fad could not be found. Oct 04 18:52:22.227303 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': '4275d1a7-42d6-4af5-be51-64fb1c4f6fad'} Oct 04 18:52:22.227303 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:52:22.227303 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:52:22.227303 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:52:22.227303 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:52:22.227303 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:52:22.227303 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:52:22.227303 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:52:22.227303 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:52:22.227303 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:52:22.227303 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:52:22.227303 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4275d1a7-42d6-4af5-be51-64fb1c4f6fad could not be found. Oct 04 18:52:22.227303 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:52:22.227303 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:52:22.227303 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:52:22.227303 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:52:22.227303 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:52:22.227303 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:52:22.227303 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:52:22.227303 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:52:22.227303 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:52:22.227303 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:52:22.227303 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:52:22.227303 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:52:22.227303 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:52:22.227303 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:52:22.227303 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:52:22.227303 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:52:22.227303 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4275d1a7-42d6-4af5-be51-64fb1c4f6fad could not be found. Oct 04 18:52:22.227303 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:52:22.227303 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:52:22.227303 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:52:22.227303 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:52:22.233454 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:52:22.233454 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:52:22.233454 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:52:22.233454 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:52:22.233454 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4275d1a7-42d6-4af5-be51-64fb1c4f6fad could not be found. Oct 04 18:52:22.233454 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:52:22.233454 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-bca6d43a-c548-4569-afcb-09f2f10743c1 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Returning 404 to user: Instance 4275d1a7-42d6-4af5-be51-64fb1c4f6fad could not be found. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:52:22.233454 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-bca6d43a-c548-4569-afcb-09f2f10743c1 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] 10.222.0.43 "GET /compute/v2.1/servers/4275d1a7-42d6-4af5-be51-64fb1c4f6fad" status: 404 len: 111 microversion: 2.1 time: 0.041591 Oct 04 18:52:22.237685 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-719c3f68-8642-4337-a391-9e04747c9b0d tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:22.238187 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-719c3f68-8642-4337-a391-9e04747c9b0d tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] [instance: 1c1b1c42-bb4c-40e2-9248-7d746c1fb674] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:22.242721 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2416/4535] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:22 2022] GET /compute/v2.1/servers/4275d1a7-42d6-4af5-be51-64fb1c4f6fad => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:52:22.245682 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-719c3f68-8642-4337-a391-9e04747c9b0d tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:22.246180 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-719c3f68-8642-4337-a391-9e04747c9b0d tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:22.246624 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-719c3f68-8642-4337-a391-9e04747c9b0d tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:22.247328 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-719c3f68-8642-4337-a391-9e04747c9b0d tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:22.247936 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-719c3f68-8642-4337-a391-9e04747c9b0d tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:22.248370 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-719c3f68-8642-4337-a391-9e04747c9b0d tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:22.266881 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-719c3f68-8642-4337-a391-9e04747c9b0d tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] HTTP exception thrown: Instance 1c1b1c42-bb4c-40e2-9248-7d746c1fb674 could not be found. Oct 04 18:52:22.268475 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-719c3f68-8642-4337-a391-9e04747c9b0d tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Request method failure captured: Oct 04 18:52:22.268475 n-d-851028-13 devstack@n-api.service[123595]: request: DELETE /compute/v2.1/servers/1c1b1c42-bb4c-40e2-9248-7d746c1fb674 HTTP/1.1 Oct 04 18:52:22.268475 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 18:52:22.268475 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 18:52:22.268475 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 18:52:22.268475 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 0 Oct 04 18:52:22.268475 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 18:52:22.268475 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 18:52:22.268475 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 18:52:22.268475 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 18:52:22.268475 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPIAJxznq_dqRpKBeHYz_tTt-BPe6PGX8bXmZXSSSBar-nAl3_7gjSqUW3yyr2J4Kw1m1-l6Y2izmzOt3P0Lv3UhhGPTaACGzV6RGiSkRczLrMXORtXSdyVIiZq3MCL7L2uQGd29MwUZa7-C3NoIEqHwDxvVJi_WWjtFyKnOFEp1-BZ0 Oct 04 18:52:22.268475 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 18:52:22.268475 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 18:52:22.268475 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 18:52:22.268475 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 18:52:22.268475 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 18:52:22.268475 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 18:52:22.268475 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: ed8f94cf1c974654a336645f453c9efc Oct 04 18:52:22.268475 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-ServersTestJSON-546754383 Oct 04 18:52:22.268475 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 18:52:22.268475 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 18:52:22.268475 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/ed8f94cf1c974654a336645f453c9efc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_ed8f94cf1c974654a336645f453c9efc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ed8f94cf1c974654a336645f453c9efc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ed8f94cf1c974654a336645f453c9efc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:52:22.268475 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-ServersTestJSON-546754383 Oct 04 18:52:22.268475 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: ed8f94cf1c974654a336645f453c9efc Oct 04 18:52:22.268475 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-ServersTestJSON-546754383 Oct 04 18:52:22.268475 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-ServersTestJSON-546754383-project Oct 04 18:52:22.268475 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 18:52:22.268475 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 18:52:22.268475 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: 14707008940e4965ab7d1190094a71bb Oct 04 18:52:22.268475 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-ServersTestJSON-546754383-project Oct 04 18:52:22.268475 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 18:52:22.268475 n-d-851028-13 devstack@n-api.service[123595]: exception: Instance 1c1b1c42-bb4c-40e2-9248-7d746c1fb674 could not be found. Oct 04 18:52:22.268475 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': '1c1b1c42-bb4c-40e2-9248-7d746c1fb674'} Oct 04 18:52:22.268475 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:52:22.268475 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:52:22.268475 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:52:22.268475 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:52:22.268475 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:52:22.268475 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:52:22.268475 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:52:22.268475 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:52:22.268475 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:52:22.268475 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:52:22.268475 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c1b1c42-bb4c-40e2-9248-7d746c1fb674 could not be found. Oct 04 18:52:22.268475 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:52:22.268475 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:52:22.268475 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:52:22.268475 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:52:22.268475 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:52:22.268475 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:52:22.268475 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:52:22.268475 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:52:22.268475 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:52:22.268475 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:52:22.268475 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:52:22.268475 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:52:22.268475 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:52:22.268475 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:52:22.268475 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:52:22.268475 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:52:22.268475 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:52:22.268475 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:52:22.268475 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c1b1c42-bb4c-40e2-9248-7d746c1fb674 could not be found. Oct 04 18:52:22.274002 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:52:22.274002 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:52:22.274002 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:52:22.274002 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:52:22.274002 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:52:22.274002 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:52:22.274002 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:52:22.274002 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:52:22.274002 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c1b1c42-bb4c-40e2-9248-7d746c1fb674 could not be found. Oct 04 18:52:22.274002 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:52:22.274002 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-719c3f68-8642-4337-a391-9e04747c9b0d tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Returning 404 to user: Instance 1c1b1c42-bb4c-40e2-9248-7d746c1fb674 could not be found. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:52:22.274002 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-719c3f68-8642-4337-a391-9e04747c9b0d tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] 10.222.0.43 "DELETE /compute/v2.1/servers/1c1b1c42-bb4c-40e2-9248-7d746c1fb674" status: 404 len: 111 microversion: 2.1 time: 0.036445 Oct 04 18:52:22.274913 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2120/4536] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 18:52:22 2022] DELETE /compute/v2.1/servers/1c1b1c42-bb4c-40e2-9248-7d746c1fb674 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:52:22.279785 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-e8f757c0-153b-42ff-aa00-557ff093d09f tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:22.280497 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-e8f757c0-153b-42ff-aa00-557ff093d09f tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] [instance: 1c1b1c42-bb4c-40e2-9248-7d746c1fb674] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:22.286689 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e8f757c0-153b-42ff-aa00-557ff093d09f tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:22.287273 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e8f757c0-153b-42ff-aa00-557ff093d09f tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:22.287786 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e8f757c0-153b-42ff-aa00-557ff093d09f tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:22.288585 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e8f757c0-153b-42ff-aa00-557ff093d09f tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:22.289128 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e8f757c0-153b-42ff-aa00-557ff093d09f tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:22.289631 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e8f757c0-153b-42ff-aa00-557ff093d09f tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:22.303752 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-e8f757c0-153b-42ff-aa00-557ff093d09f tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] HTTP exception thrown: Instance 1c1b1c42-bb4c-40e2-9248-7d746c1fb674 could not be found. Oct 04 18:52:22.306188 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-e8f757c0-153b-42ff-aa00-557ff093d09f tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Request method failure captured: Oct 04 18:52:22.306188 n-d-851028-13 devstack@n-api.service[123596]: request: GET /compute/v2.1/servers/1c1b1c42-bb4c-40e2-9248-7d746c1fb674 HTTP/1.1 Oct 04 18:52:22.306188 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:52:22.306188 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:52:22.306188 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:52:22.306188 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 18:52:22.306188 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:52:22.306188 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:52:22.306188 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:52:22.306188 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:52:22.306188 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPIAJxznq_dqRpKBeHYz_tTt-BPe6PGX8bXmZXSSSBar-nAl3_7gjSqUW3yyr2J4Kw1m1-l6Y2izmzOt3P0Lv3UhhGPTaACGzV6RGiSkRczLrMXORtXSdyVIiZq3MCL7L2uQGd29MwUZa7-C3NoIEqHwDxvVJi_WWjtFyKnOFEp1-BZ0 Oct 04 18:52:22.306188 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:52:22.306188 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:52:22.306188 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:52:22.306188 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:52:22.306188 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:52:22.306188 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:52:22.306188 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: ed8f94cf1c974654a336645f453c9efc Oct 04 18:52:22.306188 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-ServersTestJSON-546754383 Oct 04 18:52:22.306188 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 18:52:22.306188 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 18:52:22.306188 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/ed8f94cf1c974654a336645f453c9efc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_ed8f94cf1c974654a336645f453c9efc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ed8f94cf1c974654a336645f453c9efc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ed8f94cf1c974654a336645f453c9efc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:52:22.306188 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-ServersTestJSON-546754383 Oct 04 18:52:22.306188 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: ed8f94cf1c974654a336645f453c9efc Oct 04 18:52:22.306188 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-ServersTestJSON-546754383 Oct 04 18:52:22.306188 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-ServersTestJSON-546754383-project Oct 04 18:52:22.306188 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:52:22.306188 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:52:22.306188 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 14707008940e4965ab7d1190094a71bb Oct 04 18:52:22.306188 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-ServersTestJSON-546754383-project Oct 04 18:52:22.306188 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 18:52:22.306188 n-d-851028-13 devstack@n-api.service[123596]: exception: Instance 1c1b1c42-bb4c-40e2-9248-7d746c1fb674 could not be found. Oct 04 18:52:22.306188 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': '1c1b1c42-bb4c-40e2-9248-7d746c1fb674'} Oct 04 18:52:22.306188 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:52:22.306188 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:52:22.306188 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:52:22.306188 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:52:22.306188 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:52:22.306188 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:52:22.306188 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:52:22.306188 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:52:22.306188 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:52:22.306188 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:52:22.306188 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c1b1c42-bb4c-40e2-9248-7d746c1fb674 could not be found. Oct 04 18:52:22.306188 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:52:22.306188 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:52:22.306188 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:52:22.306188 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:52:22.306188 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:52:22.306188 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:52:22.306188 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:52:22.306188 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:52:22.306188 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:52:22.306188 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:52:22.306188 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:52:22.306188 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:52:22.306188 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:52:22.306188 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:52:22.306188 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:52:22.306188 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:52:22.306188 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c1b1c42-bb4c-40e2-9248-7d746c1fb674 could not be found. Oct 04 18:52:22.306188 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:52:22.306188 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:52:22.306188 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:52:22.306188 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:52:22.310958 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:52:22.310958 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:52:22.310958 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:52:22.310958 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:52:22.310958 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c1b1c42-bb4c-40e2-9248-7d746c1fb674 could not be found. Oct 04 18:52:22.310958 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:52:22.310958 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-e8f757c0-153b-42ff-aa00-557ff093d09f tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Returning 404 to user: Instance 1c1b1c42-bb4c-40e2-9248-7d746c1fb674 could not be found. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:52:22.310958 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-e8f757c0-153b-42ff-aa00-557ff093d09f tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] 10.222.0.43 "GET /compute/v2.1/servers/1c1b1c42-bb4c-40e2-9248-7d746c1fb674" status: 404 len: 111 microversion: 2.1 time: 0.033886 Oct 04 18:52:22.313305 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2417/4537] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:22 2022] GET /compute/v2.1/servers/1c1b1c42-bb4c-40e2-9248-7d746c1fb674 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:52:22.321665 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-d68261e9-98fd-43a2-92e3-f3fe2dada06d tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:22.322173 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-d68261e9-98fd-43a2-92e3-f3fe2dada06d tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] [instance: a12764a5-8614-4f81-be9d-81a92f7aee04] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:22.330685 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-d68261e9-98fd-43a2-92e3-f3fe2dada06d tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] HTTP exception thrown: Instance a12764a5-8614-4f81-be9d-81a92f7aee04 could not be found. Oct 04 18:52:22.332868 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-d68261e9-98fd-43a2-92e3-f3fe2dada06d tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Request method failure captured: Oct 04 18:52:22.332868 n-d-851028-13 devstack@n-api.service[123595]: request: DELETE /compute/v2.1/servers/a12764a5-8614-4f81-be9d-81a92f7aee04 HTTP/1.1 Oct 04 18:52:22.332868 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 18:52:22.332868 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 18:52:22.332868 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 18:52:22.332868 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 0 Oct 04 18:52:22.332868 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 18:52:22.332868 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 18:52:22.332868 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 18:52:22.332868 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 18:52:22.332868 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPIAJxznq_dqRpKBeHYz_tTt-BPe6PGX8bXmZXSSSBar-nAl3_7gjSqUW3yyr2J4Kw1m1-l6Y2izmzOt3P0Lv3UhhGPTaACGzV6RGiSkRczLrMXORtXSdyVIiZq3MCL7L2uQGd29MwUZa7-C3NoIEqHwDxvVJi_WWjtFyKnOFEp1-BZ0 Oct 04 18:52:22.332868 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 18:52:22.332868 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 18:52:22.332868 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 18:52:22.332868 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 18:52:22.332868 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 18:52:22.332868 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 18:52:22.332868 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: ed8f94cf1c974654a336645f453c9efc Oct 04 18:52:22.332868 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-ServersTestJSON-546754383 Oct 04 18:52:22.332868 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 18:52:22.332868 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 18:52:22.332868 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/ed8f94cf1c974654a336645f453c9efc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_ed8f94cf1c974654a336645f453c9efc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ed8f94cf1c974654a336645f453c9efc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ed8f94cf1c974654a336645f453c9efc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:52:22.332868 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-ServersTestJSON-546754383 Oct 04 18:52:22.332868 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: ed8f94cf1c974654a336645f453c9efc Oct 04 18:52:22.332868 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-ServersTestJSON-546754383 Oct 04 18:52:22.332868 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-ServersTestJSON-546754383-project Oct 04 18:52:22.332868 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 18:52:22.332868 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 18:52:22.332868 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: 14707008940e4965ab7d1190094a71bb Oct 04 18:52:22.332868 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-ServersTestJSON-546754383-project Oct 04 18:52:22.332868 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 18:52:22.332868 n-d-851028-13 devstack@n-api.service[123595]: exception: Instance a12764a5-8614-4f81-be9d-81a92f7aee04 could not be found. Oct 04 18:52:22.332868 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': 'a12764a5-8614-4f81-be9d-81a92f7aee04'} Oct 04 18:52:22.332868 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:52:22.332868 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:52:22.332868 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:52:22.332868 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:52:22.332868 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:52:22.332868 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:52:22.332868 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 18:52:22.332868 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 18:52:22.332868 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a12764a5-8614-4f81-be9d-81a92f7aee04 could not be found. Oct 04 18:52:22.332868 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:52:22.332868 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:52:22.332868 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:52:22.332868 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:52:22.332868 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:52:22.332868 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:52:22.332868 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:52:22.332868 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:52:22.332868 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:52:22.332868 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:52:22.332868 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:52:22.332868 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:52:22.332868 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:52:22.332868 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:52:22.332868 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:52:22.332868 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:52:22.332868 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:52:22.332868 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:52:22.332868 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a12764a5-8614-4f81-be9d-81a92f7aee04 could not be found. Oct 04 18:52:22.332868 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:52:22.332868 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:52:22.332868 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:52:22.337477 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:52:22.337477 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:52:22.337477 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:52:22.337477 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:52:22.337477 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:52:22.337477 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a12764a5-8614-4f81-be9d-81a92f7aee04 could not be found. Oct 04 18:52:22.337477 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:52:22.337477 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-d68261e9-98fd-43a2-92e3-f3fe2dada06d tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Returning 404 to user: Instance a12764a5-8614-4f81-be9d-81a92f7aee04 could not be found. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:52:22.337477 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-d68261e9-98fd-43a2-92e3-f3fe2dada06d tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] 10.222.0.43 "DELETE /compute/v2.1/servers/a12764a5-8614-4f81-be9d-81a92f7aee04" status: 404 len: 111 microversion: 2.1 time: 0.016999 Oct 04 18:52:22.340920 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2121/4538] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 18:52:22 2022] DELETE /compute/v2.1/servers/a12764a5-8614-4f81-be9d-81a92f7aee04 => generated 111 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:52:22.345125 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-473eaacb-0ebc-4a09-8680-9d1a02883709 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:22.345824 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-473eaacb-0ebc-4a09-8680-9d1a02883709 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] [instance: a12764a5-8614-4f81-be9d-81a92f7aee04] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:22.353384 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-473eaacb-0ebc-4a09-8680-9d1a02883709 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] HTTP exception thrown: Instance a12764a5-8614-4f81-be9d-81a92f7aee04 could not be found. Oct 04 18:52:22.355550 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-473eaacb-0ebc-4a09-8680-9d1a02883709 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Request method failure captured: Oct 04 18:52:22.355550 n-d-851028-13 devstack@n-api.service[123596]: request: GET /compute/v2.1/servers/a12764a5-8614-4f81-be9d-81a92f7aee04 HTTP/1.1 Oct 04 18:52:22.355550 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:52:22.355550 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:52:22.355550 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:52:22.355550 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 18:52:22.355550 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:52:22.355550 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:52:22.355550 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:52:22.355550 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:52:22.355550 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPIAJxznq_dqRpKBeHYz_tTt-BPe6PGX8bXmZXSSSBar-nAl3_7gjSqUW3yyr2J4Kw1m1-l6Y2izmzOt3P0Lv3UhhGPTaACGzV6RGiSkRczLrMXORtXSdyVIiZq3MCL7L2uQGd29MwUZa7-C3NoIEqHwDxvVJi_WWjtFyKnOFEp1-BZ0 Oct 04 18:52:22.355550 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:52:22.355550 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:52:22.355550 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:52:22.355550 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:52:22.355550 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:52:22.355550 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:52:22.355550 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: ed8f94cf1c974654a336645f453c9efc Oct 04 18:52:22.355550 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-ServersTestJSON-546754383 Oct 04 18:52:22.355550 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 18:52:22.355550 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 18:52:22.355550 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/ed8f94cf1c974654a336645f453c9efc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_ed8f94cf1c974654a336645f453c9efc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ed8f94cf1c974654a336645f453c9efc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ed8f94cf1c974654a336645f453c9efc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:52:22.355550 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-ServersTestJSON-546754383 Oct 04 18:52:22.355550 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: ed8f94cf1c974654a336645f453c9efc Oct 04 18:52:22.355550 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-ServersTestJSON-546754383 Oct 04 18:52:22.355550 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-ServersTestJSON-546754383-project Oct 04 18:52:22.355550 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:52:22.355550 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:52:22.355550 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 14707008940e4965ab7d1190094a71bb Oct 04 18:52:22.355550 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-ServersTestJSON-546754383-project Oct 04 18:52:22.355550 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 18:52:22.355550 n-d-851028-13 devstack@n-api.service[123596]: exception: Instance a12764a5-8614-4f81-be9d-81a92f7aee04 could not be found. Oct 04 18:52:22.355550 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': 'a12764a5-8614-4f81-be9d-81a92f7aee04'} Oct 04 18:52:22.355550 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:52:22.355550 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:52:22.355550 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:52:22.355550 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:52:22.355550 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:52:22.355550 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:52:22.355550 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 18:52:22.355550 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 18:52:22.355550 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a12764a5-8614-4f81-be9d-81a92f7aee04 could not be found. Oct 04 18:52:22.355550 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:52:22.355550 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:52:22.355550 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:52:22.355550 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:52:22.355550 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:52:22.355550 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:52:22.355550 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:52:22.355550 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:52:22.355550 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:52:22.355550 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:52:22.355550 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:52:22.355550 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:52:22.355550 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:52:22.355550 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:52:22.355550 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:52:22.355550 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:52:22.355550 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a12764a5-8614-4f81-be9d-81a92f7aee04 could not be found. Oct 04 18:52:22.355550 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:52:22.355550 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:52:22.355550 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:52:22.355550 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:52:22.355550 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:52:22.355550 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:52:22.360769 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:52:22.360769 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:52:22.360769 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a12764a5-8614-4f81-be9d-81a92f7aee04 could not be found. Oct 04 18:52:22.360769 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:52:22.362497 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-473eaacb-0ebc-4a09-8680-9d1a02883709 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Returning 404 to user: Instance a12764a5-8614-4f81-be9d-81a92f7aee04 could not be found. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:52:22.363513 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-473eaacb-0ebc-4a09-8680-9d1a02883709 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] 10.222.0.43 "GET /compute/v2.1/servers/a12764a5-8614-4f81-be9d-81a92f7aee04" status: 404 len: 111 microversion: 2.1 time: 0.022899 Oct 04 18:52:22.364710 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2418/4539] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:22 2022] GET /compute/v2.1/servers/a12764a5-8614-4f81-be9d-81a92f7aee04 => generated 111 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:52:22.373945 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-836749db-b56a-41ed-806d-567f260c7bb6 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:22.374460 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-836749db-b56a-41ed-806d-567f260c7bb6 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] [instance: a080cb57-9980-493d-9049-28a0c4c03bdf] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:22.382167 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-836749db-b56a-41ed-806d-567f260c7bb6 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:22.383080 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-836749db-b56a-41ed-806d-567f260c7bb6 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:22.383714 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-836749db-b56a-41ed-806d-567f260c7bb6 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:22.384857 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-836749db-b56a-41ed-806d-567f260c7bb6 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:22.385706 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-836749db-b56a-41ed-806d-567f260c7bb6 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:22.386717 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-836749db-b56a-41ed-806d-567f260c7bb6 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:22.420961 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-836749db-b56a-41ed-806d-567f260c7bb6 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] [instance: a080cb57-9980-493d-9049-28a0c4c03bdf] Going to try to terminate instance {{(pid=123595) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:52:22.515859 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-836749db-b56a-41ed-806d-567f260c7bb6 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] 10.222.0.43 "DELETE /compute/v2.1/servers/a080cb57-9980-493d-9049-28a0c4c03bdf" status: 204 len: 0 microversion: 2.1 time: 0.145398 Oct 04 18:52:22.516680 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2122/4540] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 18:52:22 2022] DELETE /compute/v2.1/servers/a080cb57-9980-493d-9049-28a0c4c03bdf => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 18:52:22.532435 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-5c7ad68c-22b0-4ab0-a751-b33a106bc551 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:22.533504 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-5c7ad68c-22b0-4ab0-a751-b33a106bc551 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] [instance: a080cb57-9980-493d-9049-28a0c4c03bdf] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:22.542347 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5c7ad68c-22b0-4ab0-a751-b33a106bc551 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:22.543195 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5c7ad68c-22b0-4ab0-a751-b33a106bc551 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:22.543748 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5c7ad68c-22b0-4ab0-a751-b33a106bc551 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:22.544590 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5c7ad68c-22b0-4ab0-a751-b33a106bc551 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:22.545177 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5c7ad68c-22b0-4ab0-a751-b33a106bc551 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:22.545699 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5c7ad68c-22b0-4ab0-a751-b33a106bc551 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:22.791276 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-5c7ad68c-22b0-4ab0-a751-b33a106bc551 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14707008940e4965ab7d1190094a71bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8f94cf1c974654a336645f453c9efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:22.795217 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:52:22.800964 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-5c7ad68c-22b0-4ab0-a751-b33a106bc551 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] 10.222.0.43 "GET /compute/v2.1/servers/a080cb57-9980-493d-9049-28a0c4c03bdf" status: 200 len: 1480 microversion: 2.1 time: 0.273454 Oct 04 18:52:22.812432 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2419/4541] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:22 2022] GET /compute/v2.1/servers/a080cb57-9980-493d-9049-28a0c4c03bdf => generated 1480 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:52:22.826640 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-00e1611c-425e-4212-8d74-1c089d319c9c tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:22.827895 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-00e1611c-425e-4212-8d74-1c089d319c9c tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] [instance: 1b1ea635-1a53-4c84-9b4b-3a9c48567fdb] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:22.846673 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-00e1611c-425e-4212-8d74-1c089d319c9c tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:22.847900 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-00e1611c-425e-4212-8d74-1c089d319c9c tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:22.848770 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-00e1611c-425e-4212-8d74-1c089d319c9c tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:22.849617 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-00e1611c-425e-4212-8d74-1c089d319c9c tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:22.850331 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-00e1611c-425e-4212-8d74-1c089d319c9c tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:22.850995 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-00e1611c-425e-4212-8d74-1c089d319c9c tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:23.086524 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-efa27311-4a3b-42b7-b017-f492b5a9908b tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:23.087454 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-efa27311-4a3b-42b7-b017-f492b5a9908b tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] [instance: 8fc3c2f5-e86b-4bf0-a124-750ea71e52ad] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:23.110070 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-efa27311-4a3b-42b7-b017-f492b5a9908b tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:23.111167 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-efa27311-4a3b-42b7-b017-f492b5a9908b tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:23.111777 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-efa27311-4a3b-42b7-b017-f492b5a9908b tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:23.113073 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-efa27311-4a3b-42b7-b017-f492b5a9908b tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:23.113748 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-efa27311-4a3b-42b7-b017-f492b5a9908b tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:23.114347 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-efa27311-4a3b-42b7-b017-f492b5a9908b tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:23.375750 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-efa27311-4a3b-42b7-b017-f492b5a9908b tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4b6ab960cd4f909975c9bb14d50480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40894812ff042979932773f36a70e0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:23.385696 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-efa27311-4a3b-42b7-b017-f492b5a9908b tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] 10.222.0.43 "GET /compute/v2.1/servers/8fc3c2f5-e86b-4bf0-a124-750ea71e52ad" status: 200 len: 1681 microversion: 2.1 time: 0.305118 Oct 04 18:52:23.387159 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2420/4542] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:23 2022] GET /compute/v2.1/servers/8fc3c2f5-e86b-4bf0-a124-750ea71e52ad => generated 1681 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:52:23.405066 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-00e1611c-425e-4212-8d74-1c089d319c9c tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9b75d37d8b4f49b49af5808e0c3c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beaa0e0951d549ecafdc1f15417d831e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:23.420156 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-00e1611c-425e-4212-8d74-1c089d319c9c tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] 10.222.0.43 "GET /compute/v2.1/servers/1b1ea635-1a53-4c84-9b4b-3a9c48567fdb" status: 200 len: 1314 microversion: 2.1 time: 0.597763 Oct 04 18:52:23.423434 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2123/4543] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:22 2022] GET /compute/v2.1/servers/1b1ea635-1a53-4c84-9b4b-3a9c48567fdb => generated 1314 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:52:23.840043 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-5cb0d983-85d2-4c4c-9a9c-27f737fc19d8 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:23.840767 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-5cb0d983-85d2-4c4c-9a9c-27f737fc19d8 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] [instance: a080cb57-9980-493d-9049-28a0c4c03bdf] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:23.849772 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5cb0d983-85d2-4c4c-9a9c-27f737fc19d8 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:23.850553 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5cb0d983-85d2-4c4c-9a9c-27f737fc19d8 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:23.851160 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5cb0d983-85d2-4c4c-9a9c-27f737fc19d8 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:23.852524 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5cb0d983-85d2-4c4c-9a9c-27f737fc19d8 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:23.853091 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5cb0d983-85d2-4c4c-9a9c-27f737fc19d8 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:23.853642 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5cb0d983-85d2-4c4c-9a9c-27f737fc19d8 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:24.039944 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-5cb0d983-85d2-4c4c-9a9c-27f737fc19d8 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14707008940e4965ab7d1190094a71bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8f94cf1c974654a336645f453c9efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:24.067077 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-5cb0d983-85d2-4c4c-9a9c-27f737fc19d8 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] 10.222.0.43 "GET /compute/v2.1/servers/a080cb57-9980-493d-9049-28a0c4c03bdf" status: 200 len: 1480 microversion: 2.1 time: 0.230874 Oct 04 18:52:24.070711 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2421/4544] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:23 2022] GET /compute/v2.1/servers/a080cb57-9980-493d-9049-28a0c4c03bdf => generated 1480 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:52:24.416505 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-02c62c41-1ff9-49e3-b549-2782acb87eb1 tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:24.417311 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-02c62c41-1ff9-49e3-b549-2782acb87eb1 tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] [instance: 8fc3c2f5-e86b-4bf0-a124-750ea71e52ad] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:24.431193 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-02c62c41-1ff9-49e3-b549-2782acb87eb1 tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:24.431959 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-02c62c41-1ff9-49e3-b549-2782acb87eb1 tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:24.432408 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-02c62c41-1ff9-49e3-b549-2782acb87eb1 tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:24.433157 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-02c62c41-1ff9-49e3-b549-2782acb87eb1 tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:24.433619 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-02c62c41-1ff9-49e3-b549-2782acb87eb1 tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:24.434050 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-02c62c41-1ff9-49e3-b549-2782acb87eb1 tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:24.450831 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-5a941c6b-6c99-4b77-8888-e12c191e2f11 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:24.451463 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-5a941c6b-6c99-4b77-8888-e12c191e2f11 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] [instance: 1b1ea635-1a53-4c84-9b4b-3a9c48567fdb] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:24.471337 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5a941c6b-6c99-4b77-8888-e12c191e2f11 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:24.471842 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5a941c6b-6c99-4b77-8888-e12c191e2f11 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:24.477571 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5a941c6b-6c99-4b77-8888-e12c191e2f11 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:24.480578 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5a941c6b-6c99-4b77-8888-e12c191e2f11 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:24.481160 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5a941c6b-6c99-4b77-8888-e12c191e2f11 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:24.481600 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5a941c6b-6c99-4b77-8888-e12c191e2f11 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:25.053395 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-5a941c6b-6c99-4b77-8888-e12c191e2f11 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9b75d37d8b4f49b49af5808e0c3c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beaa0e0951d549ecafdc1f15417d831e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:25.065156 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-5a941c6b-6c99-4b77-8888-e12c191e2f11 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] 10.222.0.43 "GET /compute/v2.1/servers/1b1ea635-1a53-4c84-9b4b-3a9c48567fdb" status: 200 len: 1314 microversion: 2.1 time: 0.619805 Oct 04 18:52:25.066025 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2422/4545] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:24 2022] GET /compute/v2.1/servers/1b1ea635-1a53-4c84-9b4b-3a9c48567fdb => generated 1314 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:52:25.095493 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-30725789-3cad-4c76-bd34-34cc309eb016 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:25.096368 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-30725789-3cad-4c76-bd34-34cc309eb016 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] [instance: a080cb57-9980-493d-9049-28a0c4c03bdf] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:25.108384 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-30725789-3cad-4c76-bd34-34cc309eb016 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:25.109357 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-30725789-3cad-4c76-bd34-34cc309eb016 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:25.109963 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-30725789-3cad-4c76-bd34-34cc309eb016 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:25.110868 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-30725789-3cad-4c76-bd34-34cc309eb016 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:25.111497 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-30725789-3cad-4c76-bd34-34cc309eb016 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:25.112348 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-30725789-3cad-4c76-bd34-34cc309eb016 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:25.314138 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-02c62c41-1ff9-49e3-b549-2782acb87eb1 tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4b6ab960cd4f909975c9bb14d50480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40894812ff042979932773f36a70e0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:25.339047 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-02c62c41-1ff9-49e3-b549-2782acb87eb1 tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] 10.222.0.43 "GET /compute/v2.1/servers/8fc3c2f5-e86b-4bf0-a124-750ea71e52ad" status: 200 len: 1681 microversion: 2.1 time: 0.923633 Oct 04 18:52:25.342349 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2124/4546] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:24 2022] GET /compute/v2.1/servers/8fc3c2f5-e86b-4bf0-a124-750ea71e52ad => generated 1681 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:52:25.611977 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-30725789-3cad-4c76-bd34-34cc309eb016 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14707008940e4965ab7d1190094a71bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8f94cf1c974654a336645f453c9efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:25.623698 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-30725789-3cad-4c76-bd34-34cc309eb016 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] 10.222.0.43 "GET /compute/v2.1/servers/a080cb57-9980-493d-9049-28a0c4c03bdf" status: 200 len: 1480 microversion: 2.1 time: 0.532023 Oct 04 18:52:25.634817 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2423/4547] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:25 2022] GET /compute/v2.1/servers/a080cb57-9980-493d-9049-28a0c4c03bdf => generated 1480 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:52:26.095732 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-9b4a8f88-b03d-4667-837e-21cac33b0c64 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:26.097104 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-9b4a8f88-b03d-4667-837e-21cac33b0c64 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] [instance: 1b1ea635-1a53-4c84-9b4b-3a9c48567fdb] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:26.112445 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9b4a8f88-b03d-4667-837e-21cac33b0c64 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:26.114586 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9b4a8f88-b03d-4667-837e-21cac33b0c64 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:26.116503 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9b4a8f88-b03d-4667-837e-21cac33b0c64 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:26.118184 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9b4a8f88-b03d-4667-837e-21cac33b0c64 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:26.123507 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9b4a8f88-b03d-4667-837e-21cac33b0c64 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:26.124850 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9b4a8f88-b03d-4667-837e-21cac33b0c64 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:26.369362 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-d6a09d37-ce9c-4130-ae22-72813b5a4e68 tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:26.370198 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-d6a09d37-ce9c-4130-ae22-72813b5a4e68 tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] [instance: 8fc3c2f5-e86b-4bf0-a124-750ea71e52ad] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:26.372358 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=2 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:52:26.398878 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d6a09d37-ce9c-4130-ae22-72813b5a4e68 tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:26.399387 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d6a09d37-ce9c-4130-ae22-72813b5a4e68 tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:26.400017 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d6a09d37-ce9c-4130-ae22-72813b5a4e68 tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:26.402261 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d6a09d37-ce9c-4130-ae22-72813b5a4e68 tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:26.402905 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d6a09d37-ce9c-4130-ae22-72813b5a4e68 tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:26.404077 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d6a09d37-ce9c-4130-ae22-72813b5a4e68 tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:26.461014 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=8 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:52:27.171104 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-d6a09d37-ce9c-4130-ae22-72813b5a4e68 tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4b6ab960cd4f909975c9bb14d50480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40894812ff042979932773f36a70e0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:27.193229 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-d6a09d37-ce9c-4130-ae22-72813b5a4e68 tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] 10.222.0.43 "GET /compute/v2.1/servers/8fc3c2f5-e86b-4bf0-a124-750ea71e52ad" status: 200 len: 1681 microversion: 2.1 time: 0.828640 Oct 04 18:52:27.194302 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2424/4548] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:26 2022] GET /compute/v2.1/servers/8fc3c2f5-e86b-4bf0-a124-750ea71e52ad => generated 1681 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:52:27.363714 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-f13a217e-1a9b-4328-9ff7-59622fbdbf1e req-c66f049b-8a37-49cd-b695-116f357c0080 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a080cb57-9980-493d-9049-28a0c4c03bdf", "name": "network-vif-deleted", "tag": "ec0d6727-24d2-48b2-86cd-84d410c68d03"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:52:27.389754 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-f13a217e-1a9b-4328-9ff7-59622fbdbf1e req-c66f049b-8a37-49cd-b695-116f357c0080 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:27.390288 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-f13a217e-1a9b-4328-9ff7-59622fbdbf1e req-c66f049b-8a37-49cd-b695-116f357c0080 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:27.395687 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-f13a217e-1a9b-4328-9ff7-59622fbdbf1e req-c66f049b-8a37-49cd-b695-116f357c0080 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:27.442327 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-f13a217e-1a9b-4328-9ff7-59622fbdbf1e req-c66f049b-8a37-49cd-b695-116f357c0080 service nova] Creating event network-vif-deleted:ec0d6727-24d2-48b2-86cd-84d410c68d03 for instance a080cb57-9980-493d-9049-28a0c4c03bdf on n-h2-851028-13 Oct 04 18:52:27.458667 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-f13a217e-1a9b-4328-9ff7-59622fbdbf1e req-c66f049b-8a37-49cd-b695-116f357c0080 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.262735 Oct 04 18:52:27.459291 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2425/4549] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:52:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:52:27.469354 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-fab3c7c2-28bb-4795-9a39-9c57d5d77a76 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:27.470068 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-fab3c7c2-28bb-4795-9a39-9c57d5d77a76 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] [instance: a080cb57-9980-493d-9049-28a0c4c03bdf] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:27.488424 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fab3c7c2-28bb-4795-9a39-9c57d5d77a76 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:27.495819 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fab3c7c2-28bb-4795-9a39-9c57d5d77a76 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:27.496521 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fab3c7c2-28bb-4795-9a39-9c57d5d77a76 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:27.497609 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fab3c7c2-28bb-4795-9a39-9c57d5d77a76 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:27.498263 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fab3c7c2-28bb-4795-9a39-9c57d5d77a76 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:27.498900 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fab3c7c2-28bb-4795-9a39-9c57d5d77a76 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:27.599120 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-9b4a8f88-b03d-4667-837e-21cac33b0c64 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9b75d37d8b4f49b49af5808e0c3c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beaa0e0951d549ecafdc1f15417d831e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:27.621815 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-9b4a8f88-b03d-4667-837e-21cac33b0c64 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] 10.222.0.43 "GET /compute/v2.1/servers/1b1ea635-1a53-4c84-9b4b-3a9c48567fdb" status: 200 len: 1314 microversion: 2.1 time: 1.528528 Oct 04 18:52:27.622461 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2125/4550] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:26 2022] GET /compute/v2.1/servers/1b1ea635-1a53-4c84-9b4b-3a9c48567fdb => generated 1314 bytes in 1535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:52:27.627292 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fab3c7c2-28bb-4795-9a39-9c57d5d77a76 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:27.628116 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fab3c7c2-28bb-4795-9a39-9c57d5d77a76 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:27.628890 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fab3c7c2-28bb-4795-9a39-9c57d5d77a76 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:27.630821 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.objects.instance [None req-fab3c7c2-28bb-4795-9a39-9c57d5d77a76 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lazy-loading 'fault' on Instance uuid a080cb57-9980-493d-9049-28a0c4c03bdf {{(pid=123596) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:52:27.774525 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-fab3c7c2-28bb-4795-9a39-9c57d5d77a76 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14707008940e4965ab7d1190094a71bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8f94cf1c974654a336645f453c9efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:27.807092 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-fab3c7c2-28bb-4795-9a39-9c57d5d77a76 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] 10.222.0.43 "GET /compute/v2.1/servers/a080cb57-9980-493d-9049-28a0c4c03bdf" status: 200 len: 1283 microversion: 2.1 time: 0.343590 Oct 04 18:52:27.808913 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2426/4551] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:27 2022] GET /compute/v2.1/servers/a080cb57-9980-493d-9049-28a0c4c03bdf => generated 1283 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:52:28.221499 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-88feed81-8ea0-4b6c-99ac-2778c643928c tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:28.222425 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-88feed81-8ea0-4b6c-99ac-2778c643928c tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] [instance: 8fc3c2f5-e86b-4bf0-a124-750ea71e52ad] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:28.230482 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-88feed81-8ea0-4b6c-99ac-2778c643928c tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:28.231225 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-88feed81-8ea0-4b6c-99ac-2778c643928c tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:28.231852 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-88feed81-8ea0-4b6c-99ac-2778c643928c tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:28.232736 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-88feed81-8ea0-4b6c-99ac-2778c643928c tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:28.234283 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-88feed81-8ea0-4b6c-99ac-2778c643928c tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:28.234913 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-88feed81-8ea0-4b6c-99ac-2778c643928c tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:28.657492 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-a44517e7-444e-45a2-aeca-ff4aae074c26 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:28.659322 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-a44517e7-444e-45a2-aeca-ff4aae074c26 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] [instance: 1b1ea635-1a53-4c84-9b4b-3a9c48567fdb] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:28.667721 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a44517e7-444e-45a2-aeca-ff4aae074c26 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:28.668494 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a44517e7-444e-45a2-aeca-ff4aae074c26 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:28.669080 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a44517e7-444e-45a2-aeca-ff4aae074c26 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:28.670017 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a44517e7-444e-45a2-aeca-ff4aae074c26 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:28.670625 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a44517e7-444e-45a2-aeca-ff4aae074c26 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:28.671208 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a44517e7-444e-45a2-aeca-ff4aae074c26 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:29.170416 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-a44517e7-444e-45a2-aeca-ff4aae074c26 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9b75d37d8b4f49b49af5808e0c3c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beaa0e0951d549ecafdc1f15417d831e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:29.186193 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-a44517e7-444e-45a2-aeca-ff4aae074c26 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] 10.222.0.43 "GET /compute/v2.1/servers/1b1ea635-1a53-4c84-9b4b-3a9c48567fdb" status: 200 len: 1314 microversion: 2.1 time: 0.543346 Oct 04 18:52:29.187259 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2427/4552] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:28 2022] GET /compute/v2.1/servers/1b1ea635-1a53-4c84-9b4b-3a9c48567fdb => generated 1314 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:52:29.193048 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f0bdec48-1f4e-4f08-9624-338a659650a3 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:29.197931 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-f0bdec48-1f4e-4f08-9624-338a659650a3 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] [instance: a080cb57-9980-493d-9049-28a0c4c03bdf] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:29.211824 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f0bdec48-1f4e-4f08-9624-338a659650a3 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:29.218447 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f0bdec48-1f4e-4f08-9624-338a659650a3 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:29.219264 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f0bdec48-1f4e-4f08-9624-338a659650a3 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:29.220262 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f0bdec48-1f4e-4f08-9624-338a659650a3 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:29.220989 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f0bdec48-1f4e-4f08-9624-338a659650a3 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:29.221688 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f0bdec48-1f4e-4f08-9624-338a659650a3 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:29.266012 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-f0bdec48-1f4e-4f08-9624-338a659650a3 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] HTTP exception thrown: Instance a080cb57-9980-493d-9049-28a0c4c03bdf could not be found. Oct 04 18:52:29.267853 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f0bdec48-1f4e-4f08-9624-338a659650a3 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Request method failure captured: Oct 04 18:52:29.267853 n-d-851028-13 devstack@n-api.service[123596]: request: GET /compute/v2.1/servers/a080cb57-9980-493d-9049-28a0c4c03bdf HTTP/1.1 Oct 04 18:52:29.267853 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:52:29.267853 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:52:29.267853 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:52:29.267853 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 18:52:29.267853 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:52:29.267853 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:52:29.267853 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:52:29.267853 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:52:29.267853 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPIAJxznq_dqRpKBeHYz_tTt-BPe6PGX8bXmZXSSSBar-nAl3_7gjSqUW3yyr2J4Kw1m1-l6Y2izmzOt3P0Lv3UhhGPTaACGzV6RGiSkRczLrMXORtXSdyVIiZq3MCL7L2uQGd29MwUZa7-C3NoIEqHwDxvVJi_WWjtFyKnOFEp1-BZ0 Oct 04 18:52:29.267853 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:52:29.267853 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:52:29.267853 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:52:29.267853 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:52:29.267853 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:52:29.267853 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:52:29.267853 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: ed8f94cf1c974654a336645f453c9efc Oct 04 18:52:29.267853 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-ServersTestJSON-546754383 Oct 04 18:52:29.267853 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 18:52:29.267853 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 18:52:29.267853 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/ed8f94cf1c974654a336645f453c9efc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_ed8f94cf1c974654a336645f453c9efc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ed8f94cf1c974654a336645f453c9efc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ed8f94cf1c974654a336645f453c9efc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:52:29.267853 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-ServersTestJSON-546754383 Oct 04 18:52:29.267853 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: ed8f94cf1c974654a336645f453c9efc Oct 04 18:52:29.267853 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-ServersTestJSON-546754383 Oct 04 18:52:29.267853 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-ServersTestJSON-546754383-project Oct 04 18:52:29.267853 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:52:29.267853 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:52:29.267853 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 14707008940e4965ab7d1190094a71bb Oct 04 18:52:29.267853 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-ServersTestJSON-546754383-project Oct 04 18:52:29.267853 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 18:52:29.267853 n-d-851028-13 devstack@n-api.service[123596]: exception: Instance a080cb57-9980-493d-9049-28a0c4c03bdf could not be found. Oct 04 18:52:29.267853 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': 'a080cb57-9980-493d-9049-28a0c4c03bdf'} Oct 04 18:52:29.267853 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:52:29.267853 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:52:29.267853 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:52:29.267853 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:52:29.267853 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:52:29.267853 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:52:29.267853 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:52:29.267853 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:52:29.267853 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:52:29.267853 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:52:29.267853 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a080cb57-9980-493d-9049-28a0c4c03bdf could not be found. Oct 04 18:52:29.267853 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:52:29.267853 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:52:29.267853 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:52:29.267853 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:52:29.267853 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:52:29.267853 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:52:29.267853 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:52:29.267853 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:52:29.267853 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:52:29.267853 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:52:29.267853 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:52:29.267853 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:52:29.267853 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:52:29.267853 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:52:29.267853 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:52:29.267853 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:52:29.267853 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a080cb57-9980-493d-9049-28a0c4c03bdf could not be found. Oct 04 18:52:29.267853 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:52:29.267853 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:52:29.267853 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:52:29.267853 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:52:29.273275 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:52:29.273275 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:52:29.273275 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:52:29.273275 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:52:29.273275 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a080cb57-9980-493d-9049-28a0c4c03bdf could not be found. Oct 04 18:52:29.273275 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:52:29.273275 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f0bdec48-1f4e-4f08-9624-338a659650a3 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] Returning 404 to user: Instance a080cb57-9980-493d-9049-28a0c4c03bdf could not be found. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:52:29.275017 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-f0bdec48-1f4e-4f08-9624-338a659650a3 tempest-ServersTestJSON-546754383 tempest-ServersTestJSON-546754383-project] 10.222.0.43 "GET /compute/v2.1/servers/a080cb57-9980-493d-9049-28a0c4c03bdf" status: 404 len: 111 microversion: 2.1 time: 0.086468 Oct 04 18:52:29.282493 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2428/4553] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:29 2022] GET /compute/v2.1/servers/a080cb57-9980-493d-9049-28a0c4c03bdf => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:52:29.522312 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-88feed81-8ea0-4b6c-99ac-2778c643928c tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4b6ab960cd4f909975c9bb14d50480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40894812ff042979932773f36a70e0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:29.541769 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-88feed81-8ea0-4b6c-99ac-2778c643928c tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] 10.222.0.43 "GET /compute/v2.1/servers/8fc3c2f5-e86b-4bf0-a124-750ea71e52ad" status: 200 len: 1681 microversion: 2.1 time: 1.324122 Oct 04 18:52:29.548333 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2126/4554] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:28 2022] GET /compute/v2.1/servers/8fc3c2f5-e86b-4bf0-a124-750ea71e52ad => generated 1681 bytes in 1332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:52:29.787161 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-13e6716a-7d8c-4ae3-8563-c918a79ab7f4 req-08ceff43-11e3-4464-9175-d165640d0806 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b1ea635-1a53-4c84-9b4b-3a9c48567fdb", "tag": "bf5f857e-8ea1-4ca6-995e-ca7fa92e10fa"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:52:29.814155 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-13e6716a-7d8c-4ae3-8563-c918a79ab7f4 req-08ceff43-11e3-4464-9175-d165640d0806 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:29.814916 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-13e6716a-7d8c-4ae3-8563-c918a79ab7f4 req-08ceff43-11e3-4464-9175-d165640d0806 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:29.815554 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-13e6716a-7d8c-4ae3-8563-c918a79ab7f4 req-08ceff43-11e3-4464-9175-d165640d0806 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:29.833518 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-13e6716a-7d8c-4ae3-8563-c918a79ab7f4 req-08ceff43-11e3-4464-9175-d165640d0806 service nova] Creating event network-changed:bf5f857e-8ea1-4ca6-995e-ca7fa92e10fa for instance 1b1ea635-1a53-4c84-9b4b-3a9c48567fdb on n-h2-851028-13 Oct 04 18:52:29.840262 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-13e6716a-7d8c-4ae3-8563-c918a79ab7f4 req-08ceff43-11e3-4464-9175-d165640d0806 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088192 Oct 04 18:52:29.841382 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2429/4555] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:52:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:52:30.214844 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-6e42652d-6b50-469b-9f82-bc230cc803aa tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:30.215994 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-6e42652d-6b50-469b-9f82-bc230cc803aa tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] [instance: 1b1ea635-1a53-4c84-9b4b-3a9c48567fdb] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:30.224003 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6e42652d-6b50-469b-9f82-bc230cc803aa tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:30.224927 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6e42652d-6b50-469b-9f82-bc230cc803aa tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:30.233367 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6e42652d-6b50-469b-9f82-bc230cc803aa tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:30.234741 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6e42652d-6b50-469b-9f82-bc230cc803aa tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:30.235708 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6e42652d-6b50-469b-9f82-bc230cc803aa tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:30.236342 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6e42652d-6b50-469b-9f82-bc230cc803aa tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:30.580512 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-05704043-c70e-4a93-9811-8b3bb34ca32d tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:30.581258 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-05704043-c70e-4a93-9811-8b3bb34ca32d tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] [instance: 8fc3c2f5-e86b-4bf0-a124-750ea71e52ad] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:30.596021 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-05704043-c70e-4a93-9811-8b3bb34ca32d tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:30.596740 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-05704043-c70e-4a93-9811-8b3bb34ca32d tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:30.597384 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-05704043-c70e-4a93-9811-8b3bb34ca32d tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:30.599163 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-05704043-c70e-4a93-9811-8b3bb34ca32d tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:30.601147 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-05704043-c70e-4a93-9811-8b3bb34ca32d tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:30.602478 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-05704043-c70e-4a93-9811-8b3bb34ca32d tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:30.778328 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-05704043-c70e-4a93-9811-8b3bb34ca32d tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4b6ab960cd4f909975c9bb14d50480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40894812ff042979932773f36a70e0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:30.818721 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-05704043-c70e-4a93-9811-8b3bb34ca32d tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] 10.222.0.43 "GET /compute/v2.1/servers/8fc3c2f5-e86b-4bf0-a124-750ea71e52ad" status: 200 len: 1614 microversion: 2.1 time: 0.241989 Oct 04 18:52:30.851105 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2430/4556] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:30 2022] GET /compute/v2.1/servers/8fc3c2f5-e86b-4bf0-a124-750ea71e52ad => generated 1614 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:52:31.139294 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-6e42652d-6b50-469b-9f82-bc230cc803aa tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9b75d37d8b4f49b49af5808e0c3c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beaa0e0951d549ecafdc1f15417d831e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:31.159959 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-6e42652d-6b50-469b-9f82-bc230cc803aa tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] 10.222.0.43 "GET /compute/v2.1/servers/1b1ea635-1a53-4c84-9b4b-3a9c48567fdb" status: 200 len: 1314 microversion: 2.1 time: 0.950064 Oct 04 18:52:31.169518 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2127/4557] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:30 2022] GET /compute/v2.1/servers/1b1ea635-1a53-4c84-9b4b-3a9c48567fdb => generated 1314 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:52:31.857183 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-91b2c02f-d872-4448-8044-1cd741ac87ee tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:31.858056 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-91b2c02f-d872-4448-8044-1cd741ac87ee tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] [instance: 8fc3c2f5-e86b-4bf0-a124-750ea71e52ad] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:31.875896 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-91b2c02f-d872-4448-8044-1cd741ac87ee tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:31.881026 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-91b2c02f-d872-4448-8044-1cd741ac87ee tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:31.881655 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-91b2c02f-d872-4448-8044-1cd741ac87ee tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:31.882731 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-91b2c02f-d872-4448-8044-1cd741ac87ee tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:31.883604 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-91b2c02f-d872-4448-8044-1cd741ac87ee tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:31.891258 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-91b2c02f-d872-4448-8044-1cd741ac87ee tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:31.914934 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-bc0595f4-b60f-4f6a-9890-09c6ac0c2194 req-5c3a371c-e340-41d6-b770-34d1e0472ab9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8fc3c2f5-e86b-4bf0-a124-750ea71e52ad", "name": "network-vif-deleted", "tag": "bba2bab2-98c7-4a75-ba9c-9c2578699fcc"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:52:31.939213 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-bc0595f4-b60f-4f6a-9890-09c6ac0c2194 req-5c3a371c-e340-41d6-b770-34d1e0472ab9 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:31.942960 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-bc0595f4-b60f-4f6a-9890-09c6ac0c2194 req-5c3a371c-e340-41d6-b770-34d1e0472ab9 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:31.943917 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-bc0595f4-b60f-4f6a-9890-09c6ac0c2194 req-5c3a371c-e340-41d6-b770-34d1e0472ab9 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:31.969772 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-91b2c02f-d872-4448-8044-1cd741ac87ee tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:31.975223 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-91b2c02f-d872-4448-8044-1cd741ac87ee tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:31.975844 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-91b2c02f-d872-4448-8044-1cd741ac87ee tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:31.976432 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.objects.instance [None req-91b2c02f-d872-4448-8044-1cd741ac87ee tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Lazy-loading 'fault' on Instance uuid 8fc3c2f5-e86b-4bf0-a124-750ea71e52ad {{(pid=123596) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:52:31.987559 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-bc0595f4-b60f-4f6a-9890-09c6ac0c2194 req-5c3a371c-e340-41d6-b770-34d1e0472ab9 service nova] Creating event network-vif-deleted:bba2bab2-98c7-4a75-ba9c-9c2578699fcc for instance 8fc3c2f5-e86b-4bf0-a124-750ea71e52ad on n-h2-851028-13 Oct 04 18:52:32.000243 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-bc0595f4-b60f-4f6a-9890-09c6ac0c2194 req-5c3a371c-e340-41d6-b770-34d1e0472ab9 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089619 Oct 04 18:52:32.004023 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2128/4558] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:52:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:52:32.147264 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-91b2c02f-d872-4448-8044-1cd741ac87ee tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4b6ab960cd4f909975c9bb14d50480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40894812ff042979932773f36a70e0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:32.168825 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-91b2c02f-d872-4448-8044-1cd741ac87ee tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] 10.222.0.43 "GET /compute/v2.1/servers/8fc3c2f5-e86b-4bf0-a124-750ea71e52ad" status: 200 len: 1331 microversion: 2.1 time: 0.319555 Oct 04 18:52:32.169751 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2431/4559] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:31 2022] GET /compute/v2.1/servers/8fc3c2f5-e86b-4bf0-a124-750ea71e52ad => generated 1331 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:52:32.192954 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-0957210c-b657-47e1-ae83-fb8a55c80b8c tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:32.194942 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-0957210c-b657-47e1-ae83-fb8a55c80b8c tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] [instance: 1b1ea635-1a53-4c84-9b4b-3a9c48567fdb] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:32.210524 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0957210c-b657-47e1-ae83-fb8a55c80b8c tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:32.226456 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0957210c-b657-47e1-ae83-fb8a55c80b8c tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:32.231702 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0957210c-b657-47e1-ae83-fb8a55c80b8c tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:32.233562 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0957210c-b657-47e1-ae83-fb8a55c80b8c tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:32.234210 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0957210c-b657-47e1-ae83-fb8a55c80b8c tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:32.234837 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0957210c-b657-47e1-ae83-fb8a55c80b8c tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:32.954400 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-0957210c-b657-47e1-ae83-fb8a55c80b8c tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9b75d37d8b4f49b49af5808e0c3c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beaa0e0951d549ecafdc1f15417d831e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:32.971354 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-0957210c-b657-47e1-ae83-fb8a55c80b8c tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] 10.222.0.43 "GET /compute/v2.1/servers/1b1ea635-1a53-4c84-9b4b-3a9c48567fdb" status: 200 len: 1314 microversion: 2.1 time: 0.783840 Oct 04 18:52:32.993751 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2129/4560] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:32 2022] GET /compute/v2.1/servers/1b1ea635-1a53-4c84-9b4b-3a9c48567fdb => generated 1314 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:52:33.199226 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-8218958d-93c5-4b2c-acfd-a478b02df08f tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:33.200692 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-8218958d-93c5-4b2c-acfd-a478b02df08f tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] [instance: 8fc3c2f5-e86b-4bf0-a124-750ea71e52ad] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:33.217562 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8218958d-93c5-4b2c-acfd-a478b02df08f tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:33.219087 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8218958d-93c5-4b2c-acfd-a478b02df08f tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:33.223354 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8218958d-93c5-4b2c-acfd-a478b02df08f tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:33.225188 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8218958d-93c5-4b2c-acfd-a478b02df08f tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:33.225991 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8218958d-93c5-4b2c-acfd-a478b02df08f tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:33.238631 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8218958d-93c5-4b2c-acfd-a478b02df08f tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:33.283232 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-8218958d-93c5-4b2c-acfd-a478b02df08f tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] HTTP exception thrown: Instance 8fc3c2f5-e86b-4bf0-a124-750ea71e52ad could not be found. Oct 04 18:52:33.296115 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-8218958d-93c5-4b2c-acfd-a478b02df08f tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Request method failure captured: Oct 04 18:52:33.296115 n-d-851028-13 devstack@n-api.service[123596]: request: GET /compute/v2.1/servers/8fc3c2f5-e86b-4bf0-a124-750ea71e52ad HTTP/1.1 Oct 04 18:52:33.296115 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:52:33.296115 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:52:33.296115 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:52:33.296115 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 18:52:33.296115 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:52:33.296115 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:52:33.296115 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:52:33.296115 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:52:33.296115 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPIBCy-6aTKeg28_RdoN4k3mRR3oaWOAyCm_ykEsvzJS2Wk4TKiqKrttlQcFqR7WwiNqZVIb9oGVXYmKZhmhntV_ghSmxllxBghRdxm8nVQPuAEy6MmPubstivWYmY6IoPkLNlBU2pw4G2dBkwY7gas7PNdHOvoP-IS-J67eDYko6tYM Oct 04 18:52:33.296115 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:52:33.296115 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:52:33.296115 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:52:33.296115 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:52:33.296115 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:52:33.296115 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:52:33.296115 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: b40894812ff042979932773f36a70e0d Oct 04 18:52:33.296115 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-201122150 Oct 04 18:52:33.296115 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 18:52:33.296115 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 18:52:33.296115 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/b40894812ff042979932773f36a70e0d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_b40894812ff042979932773f36a70e0d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b40894812ff042979932773f36a70e0d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b40894812ff042979932773f36a70e0d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:52:33.296115 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-201122150 Oct 04 18:52:33.296115 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: b40894812ff042979932773f36a70e0d Oct 04 18:52:33.296115 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-201122150 Oct 04 18:52:33.296115 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-AttachSCSIVolumeTestJSON-201122150-project Oct 04 18:52:33.296115 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:52:33.296115 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:52:33.296115 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 4d4b6ab960cd4f909975c9bb14d50480 Oct 04 18:52:33.296115 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-201122150-project Oct 04 18:52:33.296115 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 18:52:33.296115 n-d-851028-13 devstack@n-api.service[123596]: exception: Instance 8fc3c2f5-e86b-4bf0-a124-750ea71e52ad could not be found. Oct 04 18:52:33.296115 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': '8fc3c2f5-e86b-4bf0-a124-750ea71e52ad'} Oct 04 18:52:33.296115 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:52:33.296115 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:52:33.296115 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:52:33.296115 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:52:33.296115 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:52:33.296115 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:52:33.296115 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:52:33.296115 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:52:33.296115 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:52:33.296115 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:52:33.296115 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8fc3c2f5-e86b-4bf0-a124-750ea71e52ad could not be found. Oct 04 18:52:33.296115 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:52:33.296115 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:52:33.296115 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:52:33.296115 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:52:33.296115 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:52:33.296115 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:52:33.296115 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:52:33.296115 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:52:33.296115 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:52:33.296115 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:52:33.296115 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:52:33.296115 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:52:33.296115 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:52:33.296115 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:52:33.296115 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:52:33.296115 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:52:33.296115 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8fc3c2f5-e86b-4bf0-a124-750ea71e52ad could not be found. Oct 04 18:52:33.296115 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:52:33.296115 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:52:33.296115 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:52:33.301170 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:52:33.301170 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:52:33.301170 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:52:33.301170 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:52:33.301170 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:52:33.301170 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8fc3c2f5-e86b-4bf0-a124-750ea71e52ad could not be found. Oct 04 18:52:33.301170 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:52:33.301780 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-8218958d-93c5-4b2c-acfd-a478b02df08f tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Returning 404 to user: Instance 8fc3c2f5-e86b-4bf0-a124-750ea71e52ad could not be found. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:52:33.303001 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-8218958d-93c5-4b2c-acfd-a478b02df08f tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] 10.222.0.43 "GET /compute/v2.1/servers/8fc3c2f5-e86b-4bf0-a124-750ea71e52ad" status: 404 len: 111 microversion: 2.1 time: 0.109107 Oct 04 18:52:33.306083 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2432/4561] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:33 2022] GET /compute/v2.1/servers/8fc3c2f5-e86b-4bf0-a124-750ea71e52ad => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:52:33.315989 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-cad6f974-82a9-4076-8191-53c8c237a94f tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Calling method '.version_select at 0x7fb21fd0a160>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:33.411486 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-cad6f974-82a9-4076-8191-53c8c237a94f tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-291546891" status: 202 len: 0 microversion: 2.1 time: 0.100865 Oct 04 18:52:33.412698 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2130/4562] 10.222.0.43 () {58 vars in 1218 bytes} [Tue Oct 4 18:52:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-291546891 => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:52:34.000167 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-c801760f-fab3-4d18-ae03-0becf40d1a5b tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:34.001685 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-c801760f-fab3-4d18-ae03-0becf40d1a5b tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] [instance: 1b1ea635-1a53-4c84-9b4b-3a9c48567fdb] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:34.015683 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c801760f-fab3-4d18-ae03-0becf40d1a5b tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:34.016483 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c801760f-fab3-4d18-ae03-0becf40d1a5b tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:34.017134 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c801760f-fab3-4d18-ae03-0becf40d1a5b tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:34.018028 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c801760f-fab3-4d18-ae03-0becf40d1a5b tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:34.020303 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c801760f-fab3-4d18-ae03-0becf40d1a5b tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:34.021913 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c801760f-fab3-4d18-ae03-0becf40d1a5b tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:35.086562 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-c801760f-fab3-4d18-ae03-0becf40d1a5b tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9b75d37d8b4f49b49af5808e0c3c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beaa0e0951d549ecafdc1f15417d831e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:35.097925 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-c801760f-fab3-4d18-ae03-0becf40d1a5b tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] 10.222.0.43 "GET /compute/v2.1/servers/1b1ea635-1a53-4c84-9b4b-3a9c48567fdb" status: 200 len: 1314 microversion: 2.1 time: 1.101660 Oct 04 18:52:35.098774 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2433/4563] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:33 2022] GET /compute/v2.1/servers/1b1ea635-1a53-4c84-9b4b-3a9c48567fdb => generated 1314 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:52:36.130587 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-de522adf-c5b2-46ce-b604-beaf34abe3b7 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:36.131416 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-de522adf-c5b2-46ce-b604-beaf34abe3b7 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] [instance: 1b1ea635-1a53-4c84-9b4b-3a9c48567fdb] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:36.157801 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-de522adf-c5b2-46ce-b604-beaf34abe3b7 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:36.158590 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-de522adf-c5b2-46ce-b604-beaf34abe3b7 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:36.159458 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-de522adf-c5b2-46ce-b604-beaf34abe3b7 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:36.160673 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-de522adf-c5b2-46ce-b604-beaf34abe3b7 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:36.162466 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-de522adf-c5b2-46ce-b604-beaf34abe3b7 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:36.163543 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-de522adf-c5b2-46ce-b604-beaf34abe3b7 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:37.193543 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-de522adf-c5b2-46ce-b604-beaf34abe3b7 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9b75d37d8b4f49b49af5808e0c3c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beaa0e0951d549ecafdc1f15417d831e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:37.260868 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-de522adf-c5b2-46ce-b604-beaf34abe3b7 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] 10.222.0.43 "GET /compute/v2.1/servers/1b1ea635-1a53-4c84-9b4b-3a9c48567fdb" status: 200 len: 1314 microversion: 2.1 time: 1.134035 Oct 04 18:52:37.262681 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2131/4564] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:36 2022] GET /compute/v2.1/servers/1b1ea635-1a53-4c84-9b4b-3a9c48567fdb => generated 1314 bytes in 1140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:52:38.285649 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-65167484-de0e-4b61-95bf-befb738f09a0 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:38.286439 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-65167484-de0e-4b61-95bf-befb738f09a0 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] [instance: 1b1ea635-1a53-4c84-9b4b-3a9c48567fdb] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:38.300886 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:52:38.306531 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-65167484-de0e-4b61-95bf-befb738f09a0 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:38.309398 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-65167484-de0e-4b61-95bf-befb738f09a0 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:38.309888 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-65167484-de0e-4b61-95bf-befb738f09a0 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:38.310658 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-65167484-de0e-4b61-95bf-befb738f09a0 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:38.311134 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-65167484-de0e-4b61-95bf-befb738f09a0 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:38.314970 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-65167484-de0e-4b61-95bf-befb738f09a0 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:39.583746 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-65167484-de0e-4b61-95bf-befb738f09a0 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9b75d37d8b4f49b49af5808e0c3c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beaa0e0951d549ecafdc1f15417d831e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:39.623226 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-65167484-de0e-4b61-95bf-befb738f09a0 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] 10.222.0.43 "GET /compute/v2.1/servers/1b1ea635-1a53-4c84-9b4b-3a9c48567fdb" status: 200 len: 1314 microversion: 2.1 time: 1.329697 Oct 04 18:52:39.626685 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2434/4565] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:38 2022] GET /compute/v2.1/servers/1b1ea635-1a53-4c84-9b4b-3a9c48567fdb => generated 1314 bytes in 1347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:52:40.528619 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-e6511ec8-e1a2-41ef-ae54-c59f0124e795 req-929294e7-dd16-4318-829b-2b88a225ff54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b1ea635-1a53-4c84-9b4b-3a9c48567fdb", "name": "network-vif-plugged", "status": "completed", "tag": "bf5f857e-8ea1-4ca6-995e-ca7fa92e10fa"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:52:40.582507 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-e6511ec8-e1a2-41ef-ae54-c59f0124e795 req-929294e7-dd16-4318-829b-2b88a225ff54 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:40.604446 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-e6511ec8-e1a2-41ef-ae54-c59f0124e795 req-929294e7-dd16-4318-829b-2b88a225ff54 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:40.605097 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-e6511ec8-e1a2-41ef-ae54-c59f0124e795 req-929294e7-dd16-4318-829b-2b88a225ff54 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:40.630812 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-e6511ec8-e1a2-41ef-ae54-c59f0124e795 req-929294e7-dd16-4318-829b-2b88a225ff54 service nova] Creating event network-vif-plugged:bf5f857e-8ea1-4ca6-995e-ca7fa92e10fa for instance 1b1ea635-1a53-4c84-9b4b-3a9c48567fdb on n-h2-851028-13 Oct 04 18:52:40.642060 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-e6511ec8-e1a2-41ef-ae54-c59f0124e795 req-929294e7-dd16-4318-829b-2b88a225ff54 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.299608 Oct 04 18:52:40.648476 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2132/4566] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:52:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:52:40.664266 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-80518b61-03e3-4145-8949-097983a20557 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:40.667782 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-80518b61-03e3-4145-8949-097983a20557 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] [instance: 1b1ea635-1a53-4c84-9b4b-3a9c48567fdb] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:40.688572 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-80518b61-03e3-4145-8949-097983a20557 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:40.694850 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-80518b61-03e3-4145-8949-097983a20557 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:40.695784 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-80518b61-03e3-4145-8949-097983a20557 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:40.700307 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-80518b61-03e3-4145-8949-097983a20557 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:40.753434 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-80518b61-03e3-4145-8949-097983a20557 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:40.756025 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-80518b61-03e3-4145-8949-097983a20557 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.050s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:41.143002 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-80518b61-03e3-4145-8949-097983a20557 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9b75d37d8b4f49b49af5808e0c3c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beaa0e0951d549ecafdc1f15417d831e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:41.154627 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-80518b61-03e3-4145-8949-097983a20557 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] 10.222.0.43 "GET /compute/v2.1/servers/1b1ea635-1a53-4c84-9b4b-3a9c48567fdb" status: 200 len: 1314 microversion: 2.1 time: 0.498345 Oct 04 18:52:41.160266 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2435/4567] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:40 2022] GET /compute/v2.1/servers/1b1ea635-1a53-4c84-9b4b-3a9c48567fdb => generated 1314 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:52:42.184707 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-183bd19e-bb19-4c9f-83a3-f76ac9f933ee tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:42.185446 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-183bd19e-bb19-4c9f-83a3-f76ac9f933ee tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] [instance: 1b1ea635-1a53-4c84-9b4b-3a9c48567fdb] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:42.198760 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-183bd19e-bb19-4c9f-83a3-f76ac9f933ee tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:42.199495 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-183bd19e-bb19-4c9f-83a3-f76ac9f933ee tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:42.200110 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-183bd19e-bb19-4c9f-83a3-f76ac9f933ee tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:42.201969 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-183bd19e-bb19-4c9f-83a3-f76ac9f933ee tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:42.204205 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-183bd19e-bb19-4c9f-83a3-f76ac9f933ee tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:42.207353 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-183bd19e-bb19-4c9f-83a3-f76ac9f933ee tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:43.559903 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-183bd19e-bb19-4c9f-83a3-f76ac9f933ee tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9b75d37d8b4f49b49af5808e0c3c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beaa0e0951d549ecafdc1f15417d831e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:43.578231 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-183bd19e-bb19-4c9f-83a3-f76ac9f933ee tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] 10.222.0.43 "GET /compute/v2.1/servers/1b1ea635-1a53-4c84-9b4b-3a9c48567fdb" status: 200 len: 1314 microversion: 2.1 time: 1.397924 Oct 04 18:52:43.579215 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2133/4568] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:42 2022] GET /compute/v2.1/servers/1b1ea635-1a53-4c84-9b4b-3a9c48567fdb => generated 1314 bytes in 1400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:52:43.603634 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-7f483bcb-4e85-448f-8a29-5db6d4df8b77 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Action: 'create', calling method: .version_select at 0x7fb21ed4c0d0>, body: {"keypair": {"name": "tempest-keypair-67012356", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPXFVZ3mYIH8Qn1bdGuIJ29e49LQttf9JDvwbCISggY6/LQU/LTeHpEp4JNVJX6rn45YfUZ2px8/VPOSXrt7QQhrwKwPmAF4/nf+9i2mRsI95GxEjrGgo8tyWzGEHsctRg=="}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:52:43.639324 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-7f483bcb-4e85-448f-8a29-5db6d4df8b77 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Getting quotas for project 6c91c7e7358048ffaaee7f51ad61b515. Resources: {'key_pairs'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:52:43.684287 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-7f483bcb-4e85-448f-8a29-5db6d4df8b77 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Getting quotas for user 486c22456b1e47ae843ae41f8dfb2632 and project 6c91c7e7358048ffaaee7f51ad61b515. Resources: {'key_pairs'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:52:43.803620 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-7f483bcb-4e85-448f-8a29-5db6d4df8b77 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.337000 Oct 04 18:52:43.817480 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2436/4569] 10.222.0.43 () {60 vars in 1159 bytes} [Tue Oct 4 18:52:43 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:52:44.605268 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-d6d3b7da-3f3a-4e49-964a-b80db4b5a62c tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:44.607158 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-d6d3b7da-3f3a-4e49-964a-b80db4b5a62c tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] [instance: 1b1ea635-1a53-4c84-9b4b-3a9c48567fdb] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:44.619564 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d6d3b7da-3f3a-4e49-964a-b80db4b5a62c tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:44.623316 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d6d3b7da-3f3a-4e49-964a-b80db4b5a62c tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:44.623956 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d6d3b7da-3f3a-4e49-964a-b80db4b5a62c tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:44.624844 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d6d3b7da-3f3a-4e49-964a-b80db4b5a62c tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:44.627375 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d6d3b7da-3f3a-4e49-964a-b80db4b5a62c tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:44.627981 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d6d3b7da-3f3a-4e49-964a-b80db4b5a62c tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:45.957909 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-d6d3b7da-3f3a-4e49-964a-b80db4b5a62c tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9b75d37d8b4f49b49af5808e0c3c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beaa0e0951d549ecafdc1f15417d831e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:45.970268 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-d6d3b7da-3f3a-4e49-964a-b80db4b5a62c tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] 10.222.0.43 "GET /compute/v2.1/servers/1b1ea635-1a53-4c84-9b4b-3a9c48567fdb" status: 200 len: 1501 microversion: 2.1 time: 1.370152 Oct 04 18:52:45.971274 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2134/4570] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:44 2022] GET /compute/v2.1/servers/1b1ea635-1a53-4c84-9b4b-3a9c48567fdb => generated 1501 bytes in 1372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:52:46.007824 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-747e80a6-1337-4188-8d6a-29c44e549ae2 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:52:46.011568 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-747e80a6-1337-4188-8d6a-29c44e549ae2 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] [instance: 1b1ea635-1a53-4c84-9b4b-3a9c48567fdb] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:46.053396 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-747e80a6-1337-4188-8d6a-29c44e549ae2 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:46.053927 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-747e80a6-1337-4188-8d6a-29c44e549ae2 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:46.054392 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-747e80a6-1337-4188-8d6a-29c44e549ae2 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:46.062785 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-747e80a6-1337-4188-8d6a-29c44e549ae2 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:46.067336 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-747e80a6-1337-4188-8d6a-29c44e549ae2 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:46.067748 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-747e80a6-1337-4188-8d6a-29c44e549ae2 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:46.137288 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.objects.instance [None req-747e80a6-1337-4188-8d6a-29c44e549ae2 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lazy-loading 'flavor' on Instance uuid 1b1ea635-1a53-4c84-9b4b-3a9c48567fdb {{(pid=123596) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:52:46.283469 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:52:46.345467 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-747e80a6-1337-4188-8d6a-29c44e549ae2 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] 10.222.0.43 "POST /compute/v2.1/servers/1b1ea635-1a53-4c84-9b4b-3a9c48567fdb/action" status: 200 len: 32 microversion: 2.1 time: 0.343716 Oct 04 18:52:46.346791 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2437/4571] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 18:52:45 2022] POST /compute/v2.1/servers/1b1ea635-1a53-4c84-9b4b-3a9c48567fdb/action => generated 32 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 04 18:52:46.357423 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-a55f5821-af83-4c89-8839-689dda2b9015 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:46.358063 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-a55f5821-af83-4c89-8839-689dda2b9015 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] [instance: 1b1ea635-1a53-4c84-9b4b-3a9c48567fdb] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:46.378368 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a55f5821-af83-4c89-8839-689dda2b9015 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:46.381866 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a55f5821-af83-4c89-8839-689dda2b9015 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:46.386602 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a55f5821-af83-4c89-8839-689dda2b9015 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:46.387952 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a55f5821-af83-4c89-8839-689dda2b9015 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:46.388598 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a55f5821-af83-4c89-8839-689dda2b9015 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:46.391197 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a55f5821-af83-4c89-8839-689dda2b9015 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:46.757312 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-093cf60f-17d0-4e9f-a846-355596d8d6ed tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:46.758130 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-093cf60f-17d0-4e9f-a846-355596d8d6ed tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] [instance: 8fc3c2f5-e86b-4bf0-a124-750ea71e52ad] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:46.772238 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-093cf60f-17d0-4e9f-a846-355596d8d6ed tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:46.775027 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-093cf60f-17d0-4e9f-a846-355596d8d6ed tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:46.780535 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-093cf60f-17d0-4e9f-a846-355596d8d6ed tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:46.787230 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-093cf60f-17d0-4e9f-a846-355596d8d6ed tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:46.788538 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-093cf60f-17d0-4e9f-a846-355596d8d6ed tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:46.791370 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-093cf60f-17d0-4e9f-a846-355596d8d6ed tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:46.835874 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-093cf60f-17d0-4e9f-a846-355596d8d6ed tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] HTTP exception thrown: Instance 8fc3c2f5-e86b-4bf0-a124-750ea71e52ad could not be found. Oct 04 18:52:46.841301 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-093cf60f-17d0-4e9f-a846-355596d8d6ed tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Request method failure captured: Oct 04 18:52:46.841301 n-d-851028-13 devstack@n-api.service[123596]: request: DELETE /compute/v2.1/servers/8fc3c2f5-e86b-4bf0-a124-750ea71e52ad HTTP/1.1 Oct 04 18:52:46.841301 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:52:46.841301 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:52:46.841301 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:52:46.841301 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 18:52:46.841301 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:52:46.841301 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:52:46.841301 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:52:46.841301 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:52:46.841301 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPIBCy-6aTKeg28_RdoN4k3mRR3oaWOAyCm_ykEsvzJS2Wk4TKiqKrttlQcFqR7WwiNqZVIb9oGVXYmKZhmhntV_ghSmxllxBghRdxm8nVQPuAEy6MmPubstivWYmY6IoPkLNlBU2pw4G2dBkwY7gas7PNdHOvoP-IS-J67eDYko6tYM Oct 04 18:52:46.841301 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:52:46.841301 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:52:46.841301 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:52:46.841301 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:52:46.841301 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:52:46.841301 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:52:46.841301 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: b40894812ff042979932773f36a70e0d Oct 04 18:52:46.841301 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-201122150 Oct 04 18:52:46.841301 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 18:52:46.841301 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 18:52:46.841301 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/b40894812ff042979932773f36a70e0d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_b40894812ff042979932773f36a70e0d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b40894812ff042979932773f36a70e0d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b40894812ff042979932773f36a70e0d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:52:46.841301 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-201122150 Oct 04 18:52:46.841301 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: b40894812ff042979932773f36a70e0d Oct 04 18:52:46.841301 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-201122150 Oct 04 18:52:46.841301 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-AttachSCSIVolumeTestJSON-201122150-project Oct 04 18:52:46.841301 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:52:46.841301 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:52:46.841301 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 4d4b6ab960cd4f909975c9bb14d50480 Oct 04 18:52:46.841301 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-201122150-project Oct 04 18:52:46.841301 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 18:52:46.841301 n-d-851028-13 devstack@n-api.service[123596]: exception: Instance 8fc3c2f5-e86b-4bf0-a124-750ea71e52ad could not be found. Oct 04 18:52:46.841301 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': '8fc3c2f5-e86b-4bf0-a124-750ea71e52ad'} Oct 04 18:52:46.841301 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:52:46.841301 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:52:46.841301 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:52:46.841301 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:52:46.841301 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:52:46.841301 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:52:46.841301 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:52:46.841301 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:52:46.841301 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:52:46.841301 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:52:46.841301 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8fc3c2f5-e86b-4bf0-a124-750ea71e52ad could not be found. Oct 04 18:52:46.841301 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:52:46.841301 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:52:46.841301 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:52:46.841301 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:52:46.841301 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:52:46.841301 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:52:46.841301 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:52:46.841301 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:52:46.841301 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:52:46.841301 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:52:46.841301 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:52:46.841301 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:52:46.841301 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:52:46.841301 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:52:46.841301 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:52:46.841301 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:52:46.841301 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:52:46.841301 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:52:46.846197 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8fc3c2f5-e86b-4bf0-a124-750ea71e52ad could not be found. Oct 04 18:52:46.846197 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:52:46.846197 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:52:46.846197 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:52:46.846197 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:52:46.846197 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:52:46.846197 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:52:46.846197 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:52:46.846197 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:52:46.846197 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8fc3c2f5-e86b-4bf0-a124-750ea71e52ad could not be found. Oct 04 18:52:46.846197 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:52:46.847023 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-093cf60f-17d0-4e9f-a846-355596d8d6ed tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Returning 404 to user: Instance 8fc3c2f5-e86b-4bf0-a124-750ea71e52ad could not be found. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:52:46.852141 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-093cf60f-17d0-4e9f-a846-355596d8d6ed tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] 10.222.0.43 "DELETE /compute/v2.1/servers/8fc3c2f5-e86b-4bf0-a124-750ea71e52ad" status: 404 len: 111 microversion: 2.1 time: 0.099943 Oct 04 18:52:46.853525 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2438/4572] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 18:52:46 2022] DELETE /compute/v2.1/servers/8fc3c2f5-e86b-4bf0-a124-750ea71e52ad => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:52:46.865959 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-35481b76-675d-4c4e-b55b-6b55411f44aa tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:46.866988 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-35481b76-675d-4c4e-b55b-6b55411f44aa tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] [instance: 8fc3c2f5-e86b-4bf0-a124-750ea71e52ad] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:46.874435 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-35481b76-675d-4c4e-b55b-6b55411f44aa tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:46.875286 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-35481b76-675d-4c4e-b55b-6b55411f44aa tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:46.876030 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-35481b76-675d-4c4e-b55b-6b55411f44aa tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:46.877014 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-35481b76-675d-4c4e-b55b-6b55411f44aa tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:46.877738 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-35481b76-675d-4c4e-b55b-6b55411f44aa tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:46.878411 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-35481b76-675d-4c4e-b55b-6b55411f44aa tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:46.894953 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-35481b76-675d-4c4e-b55b-6b55411f44aa tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] HTTP exception thrown: Instance 8fc3c2f5-e86b-4bf0-a124-750ea71e52ad could not be found. Oct 04 18:52:46.897543 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-35481b76-675d-4c4e-b55b-6b55411f44aa tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Request method failure captured: Oct 04 18:52:46.897543 n-d-851028-13 devstack@n-api.service[123596]: request: GET /compute/v2.1/servers/8fc3c2f5-e86b-4bf0-a124-750ea71e52ad HTTP/1.1 Oct 04 18:52:46.897543 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:52:46.897543 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:52:46.897543 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:52:46.897543 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 18:52:46.897543 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:52:46.897543 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:52:46.897543 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:52:46.897543 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:52:46.897543 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPIBCy-6aTKeg28_RdoN4k3mRR3oaWOAyCm_ykEsvzJS2Wk4TKiqKrttlQcFqR7WwiNqZVIb9oGVXYmKZhmhntV_ghSmxllxBghRdxm8nVQPuAEy6MmPubstivWYmY6IoPkLNlBU2pw4G2dBkwY7gas7PNdHOvoP-IS-J67eDYko6tYM Oct 04 18:52:46.897543 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:52:46.897543 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:52:46.897543 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:52:46.897543 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:52:46.897543 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:52:46.897543 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:52:46.897543 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: b40894812ff042979932773f36a70e0d Oct 04 18:52:46.897543 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-201122150 Oct 04 18:52:46.897543 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 18:52:46.897543 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 18:52:46.897543 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/b40894812ff042979932773f36a70e0d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_b40894812ff042979932773f36a70e0d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b40894812ff042979932773f36a70e0d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b40894812ff042979932773f36a70e0d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:52:46.897543 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-201122150 Oct 04 18:52:46.897543 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: b40894812ff042979932773f36a70e0d Oct 04 18:52:46.897543 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-201122150 Oct 04 18:52:46.897543 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-AttachSCSIVolumeTestJSON-201122150-project Oct 04 18:52:46.897543 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:52:46.897543 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:52:46.897543 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 4d4b6ab960cd4f909975c9bb14d50480 Oct 04 18:52:46.897543 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-201122150-project Oct 04 18:52:46.897543 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 18:52:46.897543 n-d-851028-13 devstack@n-api.service[123596]: exception: Instance 8fc3c2f5-e86b-4bf0-a124-750ea71e52ad could not be found. Oct 04 18:52:46.897543 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': '8fc3c2f5-e86b-4bf0-a124-750ea71e52ad'} Oct 04 18:52:46.897543 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:52:46.897543 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:52:46.897543 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:52:46.897543 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:52:46.897543 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:52:46.897543 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:52:46.897543 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:52:46.897543 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:52:46.897543 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:52:46.897543 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:52:46.897543 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8fc3c2f5-e86b-4bf0-a124-750ea71e52ad could not be found. Oct 04 18:52:46.897543 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:52:46.897543 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:52:46.897543 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:52:46.897543 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:52:46.897543 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:52:46.897543 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:52:46.897543 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:52:46.897543 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:52:46.897543 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:52:46.897543 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:52:46.897543 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:52:46.897543 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:52:46.897543 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:52:46.897543 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:52:46.897543 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:52:46.897543 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:52:46.897543 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8fc3c2f5-e86b-4bf0-a124-750ea71e52ad could not be found. Oct 04 18:52:46.897543 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:52:46.897543 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:52:46.897543 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:52:46.901610 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:52:46.901610 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:52:46.901610 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:52:46.901610 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:52:46.901610 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:52:46.901610 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8fc3c2f5-e86b-4bf0-a124-750ea71e52ad could not be found. Oct 04 18:52:46.901610 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:52:46.905453 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-35481b76-675d-4c4e-b55b-6b55411f44aa tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] Returning 404 to user: Instance 8fc3c2f5-e86b-4bf0-a124-750ea71e52ad could not be found. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:52:46.906626 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-35481b76-675d-4c4e-b55b-6b55411f44aa tempest-AttachSCSIVolumeTestJSON-201122150 tempest-AttachSCSIVolumeTestJSON-201122150-project] 10.222.0.43 "GET /compute/v2.1/servers/8fc3c2f5-e86b-4bf0-a124-750ea71e52ad" status: 404 len: 111 microversion: 2.1 time: 0.049088 Oct 04 18:52:46.907828 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2439/4573] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:46 2022] GET /compute/v2.1/servers/8fc3c2f5-e86b-4bf0-a124-750ea71e52ad => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:52:47.531609 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-a55f5821-af83-4c89-8839-689dda2b9015 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9b75d37d8b4f49b49af5808e0c3c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beaa0e0951d549ecafdc1f15417d831e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:47.545997 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-a55f5821-af83-4c89-8839-689dda2b9015 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] 10.222.0.43 "GET /compute/v2.1/servers/1b1ea635-1a53-4c84-9b4b-3a9c48567fdb" status: 200 len: 1507 microversion: 2.1 time: 1.193261 Oct 04 18:52:47.551939 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2135/4574] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:46 2022] GET /compute/v2.1/servers/1b1ea635-1a53-4c84-9b4b-3a9c48567fdb => generated 1507 bytes in 1200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:52:48.572104 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-08c80328-7d45-4197-aa7e-84fa23a41ebd tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:48.573155 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-08c80328-7d45-4197-aa7e-84fa23a41ebd tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] [instance: 1b1ea635-1a53-4c84-9b4b-3a9c48567fdb] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:48.592275 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-08c80328-7d45-4197-aa7e-84fa23a41ebd tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:48.593906 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-08c80328-7d45-4197-aa7e-84fa23a41ebd tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:48.594479 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-08c80328-7d45-4197-aa7e-84fa23a41ebd tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:48.597722 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-08c80328-7d45-4197-aa7e-84fa23a41ebd tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:48.600487 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-08c80328-7d45-4197-aa7e-84fa23a41ebd tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:48.604009 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-08c80328-7d45-4197-aa7e-84fa23a41ebd tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:49.768893 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-08c80328-7d45-4197-aa7e-84fa23a41ebd tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9b75d37d8b4f49b49af5808e0c3c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beaa0e0951d549ecafdc1f15417d831e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:49.786837 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-08c80328-7d45-4197-aa7e-84fa23a41ebd tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] 10.222.0.43 "GET /compute/v2.1/servers/1b1ea635-1a53-4c84-9b4b-3a9c48567fdb" status: 200 len: 1507 microversion: 2.1 time: 1.217886 Oct 04 18:52:49.791097 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2440/4575] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:48 2022] GET /compute/v2.1/servers/1b1ea635-1a53-4c84-9b4b-3a9c48567fdb => generated 1507 bytes in 1223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:52:50.816267 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-7ddf0c36-f200-4609-921a-69a16ba74443 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:50.817057 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-7ddf0c36-f200-4609-921a-69a16ba74443 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] [instance: 1b1ea635-1a53-4c84-9b4b-3a9c48567fdb] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:50.821994 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:52:50.849519 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7ddf0c36-f200-4609-921a-69a16ba74443 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:50.850031 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7ddf0c36-f200-4609-921a-69a16ba74443 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:50.855449 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7ddf0c36-f200-4609-921a-69a16ba74443 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:50.856460 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7ddf0c36-f200-4609-921a-69a16ba74443 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:50.856959 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7ddf0c36-f200-4609-921a-69a16ba74443 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:50.862835 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7ddf0c36-f200-4609-921a-69a16ba74443 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:50.890001 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-74a02f2e-1148-41ce-8ea9-65250660b63f tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1962960617", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3f21e827-5829-48b0-82ff-093e57296b22"}], "security_groups": [{"name": "tempest-securitygroup--738304225"}], "key_name": "tempest-keypair-67012356", "user_data": "}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:52:51.168281 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.network.neutron [None req-74a02f2e-1148-41ce-8ea9-65250660b63f tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] validate_networks() for [('3f21e827-5829-48b0-82ff-093e57296b22', None, None, None, None, None)] {{(pid=123596) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:52:51.494925 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-7ddf0c36-f200-4609-921a-69a16ba74443 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9b75d37d8b4f49b49af5808e0c3c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beaa0e0951d549ecafdc1f15417d831e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:51.497165 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:52:51.511351 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-7ddf0c36-f200-4609-921a-69a16ba74443 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] 10.222.0.43 "GET /compute/v2.1/servers/1b1ea635-1a53-4c84-9b4b-3a9c48567fdb" status: 200 len: 1507 microversion: 2.1 time: 0.700620 Oct 04 18:52:51.533642 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2136/4576] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:50 2022] GET /compute/v2.1/servers/1b1ea635-1a53-4c84-9b4b-3a9c48567fdb => generated 1507 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:52:52.539486 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-e27b173e-4214-4782-b460-f996488327d7 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:52.540091 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-e27b173e-4214-4782-b460-f996488327d7 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] [instance: 1b1ea635-1a53-4c84-9b4b-3a9c48567fdb] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:52.550273 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e27b173e-4214-4782-b460-f996488327d7 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:52.550767 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e27b173e-4214-4782-b460-f996488327d7 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:52.551212 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e27b173e-4214-4782-b460-f996488327d7 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:52.551931 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e27b173e-4214-4782-b460-f996488327d7 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:52.552392 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e27b173e-4214-4782-b460-f996488327d7 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:52.552826 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e27b173e-4214-4782-b460-f996488327d7 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:53.117951 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-74a02f2e-1148-41ce-8ea9-65250660b63f tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Flavor limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:52:53.119451 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-74a02f2e-1148-41ce-8ea9-65250660b63f tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Image limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:52:53.119953 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-74a02f2e-1148-41ce-8ea9-65250660b63f tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Flavor pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:52:53.122059 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-74a02f2e-1148-41ce-8ea9-65250660b63f tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Image pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:52:53.122670 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-74a02f2e-1148-41ce-8ea9-65250660b63f tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:52:53.163297 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-74a02f2e-1148-41ce-8ea9-65250660b63f tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:53.164115 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-74a02f2e-1148-41ce-8ea9-65250660b63f tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:53.164874 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-74a02f2e-1148-41ce-8ea9-65250660b63f tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:53.167945 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-74a02f2e-1148-41ce-8ea9-65250660b63f tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:53.168595 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-74a02f2e-1148-41ce-8ea9-65250660b63f tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:53.169231 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-74a02f2e-1148-41ce-8ea9-65250660b63f tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:53.228223 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-74a02f2e-1148-41ce-8ea9-65250660b63f tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Getting quotas for project 6c91c7e7358048ffaaee7f51ad61b515. Resources: {'ram', 'cores', 'instances'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:52:53.251704 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-74a02f2e-1148-41ce-8ea9-65250660b63f tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Getting quotas for user 486c22456b1e47ae843ae41f8dfb2632 and project 6c91c7e7358048ffaaee7f51ad61b515. Resources: {'ram', 'cores', 'instances'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:52:53.288521 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-74a02f2e-1148-41ce-8ea9-65250660b63f tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Going to run 1 instances... {{(pid=123596) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:52:53.293396 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-74a02f2e-1148-41ce-8ea9-65250660b63f tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] [instance: bc5eda7f-851f-44d8-af95-5e721dd6d52b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e8943ec5-4038-4d4b-b9b9-2415a79f5243',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123596) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:52:53.355016 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-e27b173e-4214-4782-b460-f996488327d7 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9b75d37d8b4f49b49af5808e0c3c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beaa0e0951d549ecafdc1f15417d831e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:53.368203 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-e27b173e-4214-4782-b460-f996488327d7 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] 10.222.0.43 "GET /compute/v2.1/servers/1b1ea635-1a53-4c84-9b4b-3a9c48567fdb" status: 200 len: 1507 microversion: 2.1 time: 0.833401 Oct 04 18:52:53.374960 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2137/4577] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:52 2022] GET /compute/v2.1/servers/1b1ea635-1a53-4c84-9b4b-3a9c48567fdb => generated 1507 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:52:53.375247 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-74a02f2e-1148-41ce-8ea9-65250660b63f tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.490399 Oct 04 18:52:53.376459 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2441/4578] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 18:52:50 2022] POST /compute/v2.1/servers => generated 401 bytes in 2493 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:52:53.388436 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-1a53b28e-780b-48bd-965f-b947999ee827 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:53.392412 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-1a53b28e-780b-48bd-965f-b947999ee827 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] [instance: bc5eda7f-851f-44d8-af95-5e721dd6d52b] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:54.397932 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-ea4acb39-396c-4bdc-9997-8eda1cec23cf tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:54.398647 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-ea4acb39-396c-4bdc-9997-8eda1cec23cf tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] [instance: 1b1ea635-1a53-4c84-9b4b-3a9c48567fdb] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:54.426743 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ea4acb39-396c-4bdc-9997-8eda1cec23cf tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:54.427730 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ea4acb39-396c-4bdc-9997-8eda1cec23cf tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:54.428403 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ea4acb39-396c-4bdc-9997-8eda1cec23cf tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:54.430014 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ea4acb39-396c-4bdc-9997-8eda1cec23cf tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:54.432702 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ea4acb39-396c-4bdc-9997-8eda1cec23cf tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:54.433168 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ea4acb39-396c-4bdc-9997-8eda1cec23cf tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:54.886580 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-1a53b28e-780b-48bd-965f-b947999ee827 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '486c22456b1e47ae843ae41f8dfb2632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c91c7e7358048ffaaee7f51ad61b515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:54.913959 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-1a53b28e-780b-48bd-965f-b947999ee827 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] 10.222.0.43 "GET /compute/v2.1/servers/bc5eda7f-851f-44d8-af95-5e721dd6d52b" status: 200 len: 1240 microversion: 2.1 time: 1.530179 Oct 04 18:52:54.934524 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2138/4579] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:53 2022] GET /compute/v2.1/servers/bc5eda7f-851f-44d8-af95-5e721dd6d52b => generated 1240 bytes in 1551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:52:55.022946 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-ea4acb39-396c-4bdc-9997-8eda1cec23cf tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9b75d37d8b4f49b49af5808e0c3c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beaa0e0951d549ecafdc1f15417d831e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:55.034972 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-ea4acb39-396c-4bdc-9997-8eda1cec23cf tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] 10.222.0.43 "GET /compute/v2.1/servers/1b1ea635-1a53-4c84-9b4b-3a9c48567fdb" status: 200 len: 1507 microversion: 2.1 time: 0.642187 Oct 04 18:52:55.046158 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2442/4580] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:54 2022] GET /compute/v2.1/servers/1b1ea635-1a53-4c84-9b4b-3a9c48567fdb => generated 1507 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:52:55.966822 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-4c616dfc-0802-4510-acc9-6c6dbc3d3371 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:55.967478 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-4c616dfc-0802-4510-acc9-6c6dbc3d3371 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] [instance: bc5eda7f-851f-44d8-af95-5e721dd6d52b] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:55.987966 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4c616dfc-0802-4510-acc9-6c6dbc3d3371 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:55.988834 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4c616dfc-0802-4510-acc9-6c6dbc3d3371 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:55.989018 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4c616dfc-0802-4510-acc9-6c6dbc3d3371 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:55.990224 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4c616dfc-0802-4510-acc9-6c6dbc3d3371 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:55.990856 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4c616dfc-0802-4510-acc9-6c6dbc3d3371 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:55.991502 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4c616dfc-0802-4510-acc9-6c6dbc3d3371 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:56.076062 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-eedce133-9a33-4cee-baaa-82f51906a3e4 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:56.077518 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-eedce133-9a33-4cee-baaa-82f51906a3e4 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] [instance: 1b1ea635-1a53-4c84-9b4b-3a9c48567fdb] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:56.090723 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-eedce133-9a33-4cee-baaa-82f51906a3e4 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:56.094373 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-eedce133-9a33-4cee-baaa-82f51906a3e4 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:56.099625 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-eedce133-9a33-4cee-baaa-82f51906a3e4 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:56.100718 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-eedce133-9a33-4cee-baaa-82f51906a3e4 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:56.101381 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-eedce133-9a33-4cee-baaa-82f51906a3e4 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:56.101987 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-eedce133-9a33-4cee-baaa-82f51906a3e4 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:56.175229 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-4c616dfc-0802-4510-acc9-6c6dbc3d3371 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '486c22456b1e47ae843ae41f8dfb2632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c91c7e7358048ffaaee7f51ad61b515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:56.184098 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-4c616dfc-0802-4510-acc9-6c6dbc3d3371 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] 10.222.0.43 "GET /compute/v2.1/servers/bc5eda7f-851f-44d8-af95-5e721dd6d52b" status: 200 len: 1298 microversion: 2.1 time: 0.222782 Oct 04 18:52:56.188997 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2139/4581] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:55 2022] GET /compute/v2.1/servers/bc5eda7f-851f-44d8-af95-5e721dd6d52b => generated 1298 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:52:57.210764 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-e2b715bf-38fe-40c3-ae90-809284cda534 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:57.211790 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-e2b715bf-38fe-40c3-ae90-809284cda534 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] [instance: bc5eda7f-851f-44d8-af95-5e721dd6d52b] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:57.231687 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e2b715bf-38fe-40c3-ae90-809284cda534 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:57.233363 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e2b715bf-38fe-40c3-ae90-809284cda534 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:57.233853 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e2b715bf-38fe-40c3-ae90-809284cda534 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:57.234621 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e2b715bf-38fe-40c3-ae90-809284cda534 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:57.235096 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e2b715bf-38fe-40c3-ae90-809284cda534 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:57.235536 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e2b715bf-38fe-40c3-ae90-809284cda534 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:57.516169 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-eedce133-9a33-4cee-baaa-82f51906a3e4 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9b75d37d8b4f49b49af5808e0c3c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beaa0e0951d549ecafdc1f15417d831e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:57.531624 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-eedce133-9a33-4cee-baaa-82f51906a3e4 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] 10.222.0.43 "GET /compute/v2.1/servers/1b1ea635-1a53-4c84-9b4b-3a9c48567fdb" status: 200 len: 1507 microversion: 2.1 time: 1.460438 Oct 04 18:52:57.533728 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2443/4582] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:56 2022] GET /compute/v2.1/servers/1b1ea635-1a53-4c84-9b4b-3a9c48567fdb => generated 1507 bytes in 1463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:52:58.053927 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-e2b715bf-38fe-40c3-ae90-809284cda534 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '486c22456b1e47ae843ae41f8dfb2632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c91c7e7358048ffaaee7f51ad61b515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:58.074376 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-e2b715bf-38fe-40c3-ae90-809284cda534 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] 10.222.0.43 "GET /compute/v2.1/servers/bc5eda7f-851f-44d8-af95-5e721dd6d52b" status: 200 len: 1365 microversion: 2.1 time: 0.869850 Oct 04 18:52:58.083227 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2140/4583] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:57 2022] GET /compute/v2.1/servers/bc5eda7f-851f-44d8-af95-5e721dd6d52b => generated 1365 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:52:58.565551 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-ecbddf12-1a08-489e-bff7-82fc62fc32fb tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:58.566748 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-ecbddf12-1a08-489e-bff7-82fc62fc32fb tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] [instance: 1b1ea635-1a53-4c84-9b4b-3a9c48567fdb] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:58.583024 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ecbddf12-1a08-489e-bff7-82fc62fc32fb tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:58.584719 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ecbddf12-1a08-489e-bff7-82fc62fc32fb tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:58.585401 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ecbddf12-1a08-489e-bff7-82fc62fc32fb tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:58.586298 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ecbddf12-1a08-489e-bff7-82fc62fc32fb tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:58.586920 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ecbddf12-1a08-489e-bff7-82fc62fc32fb tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:58.588790 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ecbddf12-1a08-489e-bff7-82fc62fc32fb tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:59.001816 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-ecbddf12-1a08-489e-bff7-82fc62fc32fb tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9b75d37d8b4f49b49af5808e0c3c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beaa0e0951d549ecafdc1f15417d831e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:59.016150 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-ecbddf12-1a08-489e-bff7-82fc62fc32fb tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] 10.222.0.43 "GET /compute/v2.1/servers/1b1ea635-1a53-4c84-9b4b-3a9c48567fdb" status: 200 len: 1507 microversion: 2.1 time: 0.457292 Oct 04 18:52:59.021618 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2444/4584] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:58 2022] GET /compute/v2.1/servers/1b1ea635-1a53-4c84-9b4b-3a9c48567fdb => generated 1507 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:52:59.102526 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-b22ae2de-e1a0-4c65-8dd4-b655af028a09 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:59.104696 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-b22ae2de-e1a0-4c65-8dd4-b655af028a09 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] [instance: bc5eda7f-851f-44d8-af95-5e721dd6d52b] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:59.114433 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b22ae2de-e1a0-4c65-8dd4-b655af028a09 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:59.115919 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b22ae2de-e1a0-4c65-8dd4-b655af028a09 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:59.116839 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b22ae2de-e1a0-4c65-8dd4-b655af028a09 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:59.117863 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b22ae2de-e1a0-4c65-8dd4-b655af028a09 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:59.118481 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b22ae2de-e1a0-4c65-8dd4-b655af028a09 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:59.119627 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b22ae2de-e1a0-4c65-8dd4-b655af028a09 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:00.051085 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-0a271a79-58e3-4839-9b99-daf0824d1694 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:00.053358 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-0a271a79-58e3-4839-9b99-daf0824d1694 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] [instance: 1b1ea635-1a53-4c84-9b4b-3a9c48567fdb] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:00.072918 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0a271a79-58e3-4839-9b99-daf0824d1694 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:00.073457 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0a271a79-58e3-4839-9b99-daf0824d1694 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:00.073907 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0a271a79-58e3-4839-9b99-daf0824d1694 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:00.074899 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0a271a79-58e3-4839-9b99-daf0824d1694 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:00.075080 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0a271a79-58e3-4839-9b99-daf0824d1694 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:00.075712 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0a271a79-58e3-4839-9b99-daf0824d1694 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:00.601225 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-0a271a79-58e3-4839-9b99-daf0824d1694 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9b75d37d8b4f49b49af5808e0c3c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beaa0e0951d549ecafdc1f15417d831e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:00.615727 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-0a271a79-58e3-4839-9b99-daf0824d1694 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] 10.222.0.43 "GET /compute/v2.1/servers/1b1ea635-1a53-4c84-9b4b-3a9c48567fdb" status: 200 len: 1507 microversion: 2.1 time: 0.570755 Oct 04 18:53:00.617378 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2445/4585] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:00 2022] GET /compute/v2.1/servers/1b1ea635-1a53-4c84-9b4b-3a9c48567fdb => generated 1507 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:00.700057 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-b22ae2de-e1a0-4c65-8dd4-b655af028a09 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '486c22456b1e47ae843ae41f8dfb2632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c91c7e7358048ffaaee7f51ad61b515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:00.726691 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-b22ae2de-e1a0-4c65-8dd4-b655af028a09 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] 10.222.0.43 "GET /compute/v2.1/servers/bc5eda7f-851f-44d8-af95-5e721dd6d52b" status: 200 len: 1365 microversion: 2.1 time: 1.630321 Oct 04 18:53:00.727326 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2141/4586] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:59 2022] GET /compute/v2.1/servers/bc5eda7f-851f-44d8-af95-5e721dd6d52b => generated 1365 bytes in 1632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:01.644934 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-b236cad3-20c2-4550-b0e4-fc5444479f1a tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:01.645837 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-b236cad3-20c2-4550-b0e4-fc5444479f1a tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] [instance: 1b1ea635-1a53-4c84-9b4b-3a9c48567fdb] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:01.664968 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b236cad3-20c2-4550-b0e4-fc5444479f1a tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:01.672386 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b236cad3-20c2-4550-b0e4-fc5444479f1a tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:01.673199 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b236cad3-20c2-4550-b0e4-fc5444479f1a tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:01.676773 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b236cad3-20c2-4550-b0e4-fc5444479f1a tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:01.677391 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b236cad3-20c2-4550-b0e4-fc5444479f1a tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:01.677855 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b236cad3-20c2-4550-b0e4-fc5444479f1a tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:01.750746 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-c3297c10-b623-4677-aa9b-3546093f8f84 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:01.751567 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-c3297c10-b623-4677-aa9b-3546093f8f84 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] [instance: bc5eda7f-851f-44d8-af95-5e721dd6d52b] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:01.767052 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c3297c10-b623-4677-aa9b-3546093f8f84 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:01.769514 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c3297c10-b623-4677-aa9b-3546093f8f84 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:01.771002 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c3297c10-b623-4677-aa9b-3546093f8f84 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:01.774201 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c3297c10-b623-4677-aa9b-3546093f8f84 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:01.774947 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c3297c10-b623-4677-aa9b-3546093f8f84 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:01.776512 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c3297c10-b623-4677-aa9b-3546093f8f84 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:01.953533 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-b236cad3-20c2-4550-b0e4-fc5444479f1a tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9b75d37d8b4f49b49af5808e0c3c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beaa0e0951d549ecafdc1f15417d831e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:01.982349 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-b236cad3-20c2-4550-b0e4-fc5444479f1a tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] 10.222.0.43 "GET /compute/v2.1/servers/1b1ea635-1a53-4c84-9b4b-3a9c48567fdb" status: 200 len: 1507 microversion: 2.1 time: 0.341946 Oct 04 18:53:02.000945 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2446/4587] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:01 2022] GET /compute/v2.1/servers/1b1ea635-1a53-4c84-9b4b-3a9c48567fdb => generated 1507 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:02.854569 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-c3297c10-b623-4677-aa9b-3546093f8f84 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '486c22456b1e47ae843ae41f8dfb2632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c91c7e7358048ffaaee7f51ad61b515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:02.866932 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-c3297c10-b623-4677-aa9b-3546093f8f84 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] 10.222.0.43 "GET /compute/v2.1/servers/bc5eda7f-851f-44d8-af95-5e721dd6d52b" status: 200 len: 1365 microversion: 2.1 time: 1.121298 Oct 04 18:53:02.869840 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2142/4588] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:01 2022] GET /compute/v2.1/servers/bc5eda7f-851f-44d8-af95-5e721dd6d52b => generated 1365 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:53:03.014193 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-a1d1d60d-550e-4c53-982a-def814127c98 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:03.016036 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-a1d1d60d-550e-4c53-982a-def814127c98 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] [instance: 1b1ea635-1a53-4c84-9b4b-3a9c48567fdb] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:03.027902 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a1d1d60d-550e-4c53-982a-def814127c98 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:03.031040 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a1d1d60d-550e-4c53-982a-def814127c98 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:03.033717 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a1d1d60d-550e-4c53-982a-def814127c98 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:03.034788 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a1d1d60d-550e-4c53-982a-def814127c98 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:03.035720 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a1d1d60d-550e-4c53-982a-def814127c98 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:03.038164 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a1d1d60d-550e-4c53-982a-def814127c98 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:03.203878 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=2 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:53:03.275040 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=10 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:53:03.725735 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-a1d1d60d-550e-4c53-982a-def814127c98 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9b75d37d8b4f49b49af5808e0c3c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beaa0e0951d549ecafdc1f15417d831e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:03.735329 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-a1d1d60d-550e-4c53-982a-def814127c98 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] 10.222.0.43 "GET /compute/v2.1/servers/1b1ea635-1a53-4c84-9b4b-3a9c48567fdb" status: 200 len: 1507 microversion: 2.1 time: 0.725235 Oct 04 18:53:03.735934 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2447/4589] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:03 2022] GET /compute/v2.1/servers/1b1ea635-1a53-4c84-9b4b-3a9c48567fdb => generated 1507 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:03.894306 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-2c744dba-dc77-44cb-bad8-42e8efdd5461 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:03.895582 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-2c744dba-dc77-44cb-bad8-42e8efdd5461 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] [instance: bc5eda7f-851f-44d8-af95-5e721dd6d52b] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:03.906534 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2c744dba-dc77-44cb-bad8-42e8efdd5461 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:03.921539 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2c744dba-dc77-44cb-bad8-42e8efdd5461 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:03.924789 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2c744dba-dc77-44cb-bad8-42e8efdd5461 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:03.925921 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2c744dba-dc77-44cb-bad8-42e8efdd5461 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:03.928401 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2c744dba-dc77-44cb-bad8-42e8efdd5461 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:03.929018 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2c744dba-dc77-44cb-bad8-42e8efdd5461 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:04.022128 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-c7cbf22c-20ca-4383-9dda-6fa92472b844 req-8d482b7a-bc9b-4931-beae-976b46ea46b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc5eda7f-851f-44d8-af95-5e721dd6d52b", "tag": "81db9f36-4048-40e2-a99b-a532729ebc0a"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:53:04.068423 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-c7cbf22c-20ca-4383-9dda-6fa92472b844 req-8d482b7a-bc9b-4931-beae-976b46ea46b1 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:04.068855 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-c7cbf22c-20ca-4383-9dda-6fa92472b844 req-8d482b7a-bc9b-4931-beae-976b46ea46b1 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:04.069322 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-c7cbf22c-20ca-4383-9dda-6fa92472b844 req-8d482b7a-bc9b-4931-beae-976b46ea46b1 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:04.111435 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-c7cbf22c-20ca-4383-9dda-6fa92472b844 req-8d482b7a-bc9b-4931-beae-976b46ea46b1 service nova] Creating event network-changed:81db9f36-4048-40e2-a99b-a532729ebc0a for instance bc5eda7f-851f-44d8-af95-5e721dd6d52b on n-h1-851028-13 Oct 04 18:53:04.122913 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-c7cbf22c-20ca-4383-9dda-6fa92472b844 req-8d482b7a-bc9b-4931-beae-976b46ea46b1 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105104 Oct 04 18:53:04.127851 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2448/4590] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:53:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:53:04.633760 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-2c744dba-dc77-44cb-bad8-42e8efdd5461 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '486c22456b1e47ae843ae41f8dfb2632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c91c7e7358048ffaaee7f51ad61b515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:04.642792 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-2c744dba-dc77-44cb-bad8-42e8efdd5461 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] 10.222.0.43 "GET /compute/v2.1/servers/bc5eda7f-851f-44d8-af95-5e721dd6d52b" status: 200 len: 1365 microversion: 2.1 time: 0.753634 Oct 04 18:53:04.647322 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2143/4591] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:03 2022] GET /compute/v2.1/servers/bc5eda7f-851f-44d8-af95-5e721dd6d52b => generated 1365 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:04.775814 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-b067cb36-6325-4539-8e84-5b8af754625e tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:04.776835 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-b067cb36-6325-4539-8e84-5b8af754625e tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] [instance: 1b1ea635-1a53-4c84-9b4b-3a9c48567fdb] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:04.787415 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b067cb36-6325-4539-8e84-5b8af754625e tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:04.790463 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b067cb36-6325-4539-8e84-5b8af754625e tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:04.792317 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b067cb36-6325-4539-8e84-5b8af754625e tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:04.794874 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b067cb36-6325-4539-8e84-5b8af754625e tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:04.798366 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b067cb36-6325-4539-8e84-5b8af754625e tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:04.798647 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b067cb36-6325-4539-8e84-5b8af754625e tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:05.672002 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-94fc3bba-b985-4209-9fd8-3ea3a509d8ba tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:05.672626 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-94fc3bba-b985-4209-9fd8-3ea3a509d8ba tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] [instance: bc5eda7f-851f-44d8-af95-5e721dd6d52b] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:05.676426 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=2 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:53:05.689978 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-94fc3bba-b985-4209-9fd8-3ea3a509d8ba tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:05.690744 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-94fc3bba-b985-4209-9fd8-3ea3a509d8ba tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:05.691386 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-94fc3bba-b985-4209-9fd8-3ea3a509d8ba tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:05.692277 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-94fc3bba-b985-4209-9fd8-3ea3a509d8ba tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:05.692908 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-94fc3bba-b985-4209-9fd8-3ea3a509d8ba tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:05.694981 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-94fc3bba-b985-4209-9fd8-3ea3a509d8ba tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:05.948908 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-b067cb36-6325-4539-8e84-5b8af754625e tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9b75d37d8b4f49b49af5808e0c3c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beaa0e0951d549ecafdc1f15417d831e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:05.971796 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-b067cb36-6325-4539-8e84-5b8af754625e tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] 10.222.0.43 "GET /compute/v2.1/servers/1b1ea635-1a53-4c84-9b4b-3a9c48567fdb" status: 200 len: 1507 microversion: 2.1 time: 1.204799 Oct 04 18:53:05.972984 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2449/4592] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:04 2022] GET /compute/v2.1/servers/1b1ea635-1a53-4c84-9b4b-3a9c48567fdb => generated 1507 bytes in 1213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:06.116990 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-94fc3bba-b985-4209-9fd8-3ea3a509d8ba tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '486c22456b1e47ae843ae41f8dfb2632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c91c7e7358048ffaaee7f51ad61b515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:06.130056 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-94fc3bba-b985-4209-9fd8-3ea3a509d8ba tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] 10.222.0.43 "GET /compute/v2.1/servers/bc5eda7f-851f-44d8-af95-5e721dd6d52b" status: 200 len: 1365 microversion: 2.1 time: 0.461902 Oct 04 18:53:06.133195 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2144/4593] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:05 2022] GET /compute/v2.1/servers/bc5eda7f-851f-44d8-af95-5e721dd6d52b => generated 1365 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:53:06.997422 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-18c208eb-3275-4ffb-a06e-e965e41f3014 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:06.998603 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-18c208eb-3275-4ffb-a06e-e965e41f3014 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] [instance: 1b1ea635-1a53-4c84-9b4b-3a9c48567fdb] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:07.014461 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-18c208eb-3275-4ffb-a06e-e965e41f3014 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:07.015193 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-18c208eb-3275-4ffb-a06e-e965e41f3014 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:07.015835 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-18c208eb-3275-4ffb-a06e-e965e41f3014 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:07.016708 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-18c208eb-3275-4ffb-a06e-e965e41f3014 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:07.017350 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-18c208eb-3275-4ffb-a06e-e965e41f3014 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:07.017935 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-18c208eb-3275-4ffb-a06e-e965e41f3014 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:07.157890 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-dc211151-10a3-44e0-a1bb-85f028f6dc8f tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:07.158509 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-dc211151-10a3-44e0-a1bb-85f028f6dc8f tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] [instance: bc5eda7f-851f-44d8-af95-5e721dd6d52b] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:07.175092 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dc211151-10a3-44e0-a1bb-85f028f6dc8f tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:07.175555 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dc211151-10a3-44e0-a1bb-85f028f6dc8f tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:07.181848 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dc211151-10a3-44e0-a1bb-85f028f6dc8f tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:07.182849 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dc211151-10a3-44e0-a1bb-85f028f6dc8f tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:07.183333 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dc211151-10a3-44e0-a1bb-85f028f6dc8f tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:07.183772 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dc211151-10a3-44e0-a1bb-85f028f6dc8f tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:08.092345 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-18c208eb-3275-4ffb-a06e-e965e41f3014 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9b75d37d8b4f49b49af5808e0c3c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beaa0e0951d549ecafdc1f15417d831e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:08.107634 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-18c208eb-3275-4ffb-a06e-e965e41f3014 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] 10.222.0.43 "GET /compute/v2.1/servers/1b1ea635-1a53-4c84-9b4b-3a9c48567fdb" status: 200 len: 1487 microversion: 2.1 time: 1.115275 Oct 04 18:53:08.112903 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2450/4594] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:06 2022] GET /compute/v2.1/servers/1b1ea635-1a53-4c84-9b4b-3a9c48567fdb => generated 1487 bytes in 1122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:08.395582 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-7280d68f-f26e-47be-9d9f-e712925a9203 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-326108305", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:53:08.417599 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=4 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:53:08.527369 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.network.neutron [None req-7280d68f-f26e-47be-9d9f-e712925a9203 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] validate_networks() for [('5e962dd3-d3e1-44dd-bd45-86de32c6b5ca', None, None, None, None, None)] {{(pid=123596) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:53:09.217787 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-dc211151-10a3-44e0-a1bb-85f028f6dc8f tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '486c22456b1e47ae843ae41f8dfb2632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c91c7e7358048ffaaee7f51ad61b515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:09.226345 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-dc211151-10a3-44e0-a1bb-85f028f6dc8f tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] 10.222.0.43 "GET /compute/v2.1/servers/bc5eda7f-851f-44d8-af95-5e721dd6d52b" status: 200 len: 1365 microversion: 2.1 time: 2.072824 Oct 04 18:53:09.238560 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2145/4595] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:07 2022] GET /compute/v2.1/servers/bc5eda7f-851f-44d8-af95-5e721dd6d52b => generated 1365 bytes in 2086 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:53:10.267372 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-cce20804-b111-4549-a00f-50f59478176f tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:10.268215 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-cce20804-b111-4549-a00f-50f59478176f tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] [instance: bc5eda7f-851f-44d8-af95-5e721dd6d52b] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:10.285428 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cce20804-b111-4549-a00f-50f59478176f tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:10.285971 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cce20804-b111-4549-a00f-50f59478176f tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:10.286422 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cce20804-b111-4549-a00f-50f59478176f tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:10.289951 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cce20804-b111-4549-a00f-50f59478176f tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:10.290443 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cce20804-b111-4549-a00f-50f59478176f tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:10.290892 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cce20804-b111-4549-a00f-50f59478176f tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:10.741860 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-cce20804-b111-4549-a00f-50f59478176f tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '486c22456b1e47ae843ae41f8dfb2632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c91c7e7358048ffaaee7f51ad61b515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:10.762396 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-cce20804-b111-4549-a00f-50f59478176f tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] 10.222.0.43 "GET /compute/v2.1/servers/bc5eda7f-851f-44d8-af95-5e721dd6d52b" status: 200 len: 1365 microversion: 2.1 time: 0.499917 Oct 04 18:53:10.763000 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2146/4596] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:10 2022] GET /compute/v2.1/servers/bc5eda7f-851f-44d8-af95-5e721dd6d52b => generated 1365 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:53:11.787124 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-92e47cc1-fcbd-4813-b7e9-4b961b3a60b0 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:11.787891 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-92e47cc1-fcbd-4813-b7e9-4b961b3a60b0 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] [instance: bc5eda7f-851f-44d8-af95-5e721dd6d52b] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:11.801963 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-92e47cc1-fcbd-4813-b7e9-4b961b3a60b0 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:11.802486 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-92e47cc1-fcbd-4813-b7e9-4b961b3a60b0 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:11.805155 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-92e47cc1-fcbd-4813-b7e9-4b961b3a60b0 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:11.805990 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-92e47cc1-fcbd-4813-b7e9-4b961b3a60b0 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:11.806415 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-92e47cc1-fcbd-4813-b7e9-4b961b3a60b0 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:11.809030 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-92e47cc1-fcbd-4813-b7e9-4b961b3a60b0 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:12.240210 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-7280d68f-f26e-47be-9d9f-e712925a9203 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Flavor limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:53:12.241901 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-7280d68f-f26e-47be-9d9f-e712925a9203 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Image limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:53:12.242308 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-7280d68f-f26e-47be-9d9f-e712925a9203 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Flavor pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:53:12.242729 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-7280d68f-f26e-47be-9d9f-e712925a9203 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Image pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:53:12.243153 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-7280d68f-f26e-47be-9d9f-e712925a9203 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:53:12.272846 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7280d68f-f26e-47be-9d9f-e712925a9203 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:12.273391 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7280d68f-f26e-47be-9d9f-e712925a9203 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:12.273848 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7280d68f-f26e-47be-9d9f-e712925a9203 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:12.283150 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7280d68f-f26e-47be-9d9f-e712925a9203 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:12.284171 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-92e47cc1-fcbd-4813-b7e9-4b961b3a60b0 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '486c22456b1e47ae843ae41f8dfb2632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c91c7e7358048ffaaee7f51ad61b515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:12.286908 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7280d68f-f26e-47be-9d9f-e712925a9203 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:12.288164 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7280d68f-f26e-47be-9d9f-e712925a9203 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:12.310157 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-92e47cc1-fcbd-4813-b7e9-4b961b3a60b0 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] 10.222.0.43 "GET /compute/v2.1/servers/bc5eda7f-851f-44d8-af95-5e721dd6d52b" status: 200 len: 1365 microversion: 2.1 time: 0.527093 Oct 04 18:53:12.325754 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2147/4597] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:11 2022] GET /compute/v2.1/servers/bc5eda7f-851f-44d8-af95-5e721dd6d52b => generated 1365 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:12.341828 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-8578ddd0-b79d-42cb-bbf6-a624ed50cb34 req-a92ce5e5-bda5-4373-92ce-968abfc27a48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc5eda7f-851f-44d8-af95-5e721dd6d52b", "name": "network-vif-plugged", "status": "completed", "tag": "81db9f36-4048-40e2-a99b-a532729ebc0a"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:53:12.374348 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-7280d68f-f26e-47be-9d9f-e712925a9203 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Getting quotas for project beaa0e0951d549ecafdc1f15417d831e. Resources: {'ram', 'cores', 'instances'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:53:12.377515 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-8578ddd0-b79d-42cb-bbf6-a624ed50cb34 req-a92ce5e5-bda5-4373-92ce-968abfc27a48 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:12.378147 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-8578ddd0-b79d-42cb-bbf6-a624ed50cb34 req-a92ce5e5-bda5-4373-92ce-968abfc27a48 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:12.378610 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-8578ddd0-b79d-42cb-bbf6-a624ed50cb34 req-a92ce5e5-bda5-4373-92ce-968abfc27a48 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:12.380764 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-7280d68f-f26e-47be-9d9f-e712925a9203 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Getting quotas for user ba9b75d37d8b4f49b49af5808e0c3c69 and project beaa0e0951d549ecafdc1f15417d831e. Resources: {'ram', 'cores', 'instances'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:53:12.417043 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-8578ddd0-b79d-42cb-bbf6-a624ed50cb34 req-a92ce5e5-bda5-4373-92ce-968abfc27a48 service nova] Creating event network-vif-plugged:81db9f36-4048-40e2-a99b-a532729ebc0a for instance bc5eda7f-851f-44d8-af95-5e721dd6d52b on n-h1-851028-13 Oct 04 18:53:12.418429 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-7280d68f-f26e-47be-9d9f-e712925a9203 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Going to run 1 instances... {{(pid=123596) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:53:12.420950 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-7280d68f-f26e-47be-9d9f-e712925a9203 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] [instance: a902c989-c015-4faf-848b-82cd682fa33f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e8943ec5-4038-4d4b-b9b9-2415a79f5243',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123596) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:53:12.440068 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-8578ddd0-b79d-42cb-bbf6-a624ed50cb34 req-a92ce5e5-bda5-4373-92ce-968abfc27a48 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112611 Oct 04 18:53:12.453707 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2148/4598] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:53:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:53:12.625184 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-7280d68f-f26e-47be-9d9f-e712925a9203 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.235312 Oct 04 18:53:12.638288 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2451/4599] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 18:53:08 2022] POST /compute/v2.1/servers => generated 383 bytes in 4249 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 18:53:12.660812 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-00405fac-873f-42ad-8fb7-4c68640ec178 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:12.666252 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-00405fac-873f-42ad-8fb7-4c68640ec178 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] [instance: a902c989-c015-4faf-848b-82cd682fa33f] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:12.957643 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-00405fac-873f-42ad-8fb7-4c68640ec178 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9b75d37d8b4f49b49af5808e0c3c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beaa0e0951d549ecafdc1f15417d831e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:12.965814 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-00405fac-873f-42ad-8fb7-4c68640ec178 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] 10.222.0.43 "GET /compute/v2.1/servers/a902c989-c015-4faf-848b-82cd682fa33f" status: 200 len: 1213 microversion: 2.1 time: 0.319411 Oct 04 18:53:12.973481 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2149/4600] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:12 2022] GET /compute/v2.1/servers/a902c989-c015-4faf-848b-82cd682fa33f => generated 1213 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:13.350565 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f3696eef-4b16-43d5-b464-f9bcad718710 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:13.351996 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-f3696eef-4b16-43d5-b464-f9bcad718710 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] [instance: bc5eda7f-851f-44d8-af95-5e721dd6d52b] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:13.415426 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f3696eef-4b16-43d5-b464-f9bcad718710 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:13.416076 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f3696eef-4b16-43d5-b464-f9bcad718710 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:13.416575 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f3696eef-4b16-43d5-b464-f9bcad718710 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:13.425779 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f3696eef-4b16-43d5-b464-f9bcad718710 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:13.426289 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f3696eef-4b16-43d5-b464-f9bcad718710 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:13.426742 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f3696eef-4b16-43d5-b464-f9bcad718710 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:13.802319 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-ed52bb2d-e249-4ad0-b2fb-b177f35e2fd3 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-839034514", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452", "networks": [{"uuid": "66b6832b-a1b2-4da9-addc-63f223a4cc5a"}]}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:53:13.926847 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.network.neutron [None req-ed52bb2d-e249-4ad0-b2fb-b177f35e2fd3 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] validate_networks() for [('66b6832b-a1b2-4da9-addc-63f223a4cc5a', None, None, None, None, None)] {{(pid=123595) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:53:15.066830 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-f3696eef-4b16-43d5-b464-f9bcad718710 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '486c22456b1e47ae843ae41f8dfb2632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c91c7e7358048ffaaee7f51ad61b515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:15.089329 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-f3696eef-4b16-43d5-b464-f9bcad718710 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] 10.222.0.43 "GET /compute/v2.1/servers/bc5eda7f-851f-44d8-af95-5e721dd6d52b" status: 200 len: 1365 microversion: 2.1 time: 1.737165 Oct 04 18:53:15.095262 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2452/4601] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:13 2022] GET /compute/v2.1/servers/bc5eda7f-851f-44d8-af95-5e721dd6d52b => generated 1365 bytes in 1750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:15.107530 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-d1add95e-801c-4b47-86ab-4d8925f9113d tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:15.108747 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-d1add95e-801c-4b47-86ab-4d8925f9113d tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] [instance: a902c989-c015-4faf-848b-82cd682fa33f] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:15.119239 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d1add95e-801c-4b47-86ab-4d8925f9113d tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:15.121613 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d1add95e-801c-4b47-86ab-4d8925f9113d tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:15.122263 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d1add95e-801c-4b47-86ab-4d8925f9113d tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:15.125910 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d1add95e-801c-4b47-86ab-4d8925f9113d tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:15.126619 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d1add95e-801c-4b47-86ab-4d8925f9113d tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:15.129711 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d1add95e-801c-4b47-86ab-4d8925f9113d tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:15.292750 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-d1add95e-801c-4b47-86ab-4d8925f9113d tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9b75d37d8b4f49b49af5808e0c3c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beaa0e0951d549ecafdc1f15417d831e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:15.309421 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-d1add95e-801c-4b47-86ab-4d8925f9113d tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] 10.222.0.43 "GET /compute/v2.1/servers/a902c989-c015-4faf-848b-82cd682fa33f" status: 200 len: 1265 microversion: 2.1 time: 0.212208 Oct 04 18:53:15.310907 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2453/4602] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:15 2022] GET /compute/v2.1/servers/a902c989-c015-4faf-848b-82cd682fa33f => generated 1265 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:16.120594 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-9806dbc0-e21e-4fa4-afe1-d3418eecb509 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:16.122192 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-9806dbc0-e21e-4fa4-afe1-d3418eecb509 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] [instance: bc5eda7f-851f-44d8-af95-5e721dd6d52b] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:16.158228 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9806dbc0-e21e-4fa4-afe1-d3418eecb509 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:16.174334 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9806dbc0-e21e-4fa4-afe1-d3418eecb509 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:16.175965 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9806dbc0-e21e-4fa4-afe1-d3418eecb509 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:16.177842 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9806dbc0-e21e-4fa4-afe1-d3418eecb509 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:16.179465 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9806dbc0-e21e-4fa4-afe1-d3418eecb509 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:16.180150 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9806dbc0-e21e-4fa4-afe1-d3418eecb509 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:16.961024 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-9806dbc0-e21e-4fa4-afe1-d3418eecb509 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '486c22456b1e47ae843ae41f8dfb2632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c91c7e7358048ffaaee7f51ad61b515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:16.967464 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=83,nova_cell1:INSERT=1 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:53:16.993242 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-9806dbc0-e21e-4fa4-afe1-d3418eecb509 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] 10.222.0.43 "GET /compute/v2.1/servers/bc5eda7f-851f-44d8-af95-5e721dd6d52b" status: 200 len: 1555 microversion: 2.1 time: 0.876912 Oct 04 18:53:16.997900 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2454/4603] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:16 2022] GET /compute/v2.1/servers/bc5eda7f-851f-44d8-af95-5e721dd6d52b => generated 1555 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:17.011971 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-ed52bb2d-e249-4ad0-b2fb-b177f35e2fd3 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Flavor limits 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:53:17.012633 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-ed52bb2d-e249-4ad0-b2fb-b177f35e2fd3 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Image limits 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:53:17.013024 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-ed52bb2d-e249-4ad0-b2fb-b177f35e2fd3 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Flavor pref 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:53:17.013677 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-ed52bb2d-e249-4ad0-b2fb-b177f35e2fd3 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Image pref 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:53:17.015556 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-ed52bb2d-e249-4ad0-b2fb-b177f35e2fd3 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:53:17.036995 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ed52bb2d-e249-4ad0-b2fb-b177f35e2fd3 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:17.038351 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ed52bb2d-e249-4ad0-b2fb-b177f35e2fd3 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:17.039489 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ed52bb2d-e249-4ad0-b2fb-b177f35e2fd3 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:17.041326 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ed52bb2d-e249-4ad0-b2fb-b177f35e2fd3 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:17.042514 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ed52bb2d-e249-4ad0-b2fb-b177f35e2fd3 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:17.044588 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ed52bb2d-e249-4ad0-b2fb-b177f35e2fd3 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:17.052104 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-cd9db7c2-022b-44a3-867a-a01b799d33ba tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:17.058370 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-cd9db7c2-022b-44a3-867a-a01b799d33ba tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] [instance: a902c989-c015-4faf-848b-82cd682fa33f] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:17.080446 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cd9db7c2-022b-44a3-867a-a01b799d33ba tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:17.081200 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cd9db7c2-022b-44a3-867a-a01b799d33ba tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:17.082070 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cd9db7c2-022b-44a3-867a-a01b799d33ba tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:17.083686 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cd9db7c2-022b-44a3-867a-a01b799d33ba tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:17.084632 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cd9db7c2-022b-44a3-867a-a01b799d33ba tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:17.085459 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cd9db7c2-022b-44a3-867a-a01b799d33ba tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:17.096577 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-ed52bb2d-e249-4ad0-b2fb-b177f35e2fd3 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Getting quotas for project 1607b30b9f324abaa88aa29e04ef3ec4. Resources: {'ram', 'cores', 'instances'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:53:17.116134 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-ed52bb2d-e249-4ad0-b2fb-b177f35e2fd3 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Getting quotas for user 6f63f1ac147543dab34a28a22eb5936c and project 1607b30b9f324abaa88aa29e04ef3ec4. Resources: {'ram', 'cores', 'instances'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:53:17.143739 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-ed52bb2d-e249-4ad0-b2fb-b177f35e2fd3 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Going to run 1 instances... {{(pid=123595) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:53:17.147099 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-ed52bb2d-e249-4ad0-b2fb-b177f35e2fd3 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 01e250ab-d9aa-4708-ae36-10c53a411a40] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e8943ec5-4038-4d4b-b9b9-2415a79f5243',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:53:17.251043 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-ed52bb2d-e249-4ad0-b2fb-b177f35e2fd3 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.752541 Oct 04 18:53:17.252398 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2150/4604] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 18:53:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 3755 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:53:17.266874 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-9c9269ac-16b4-4f2f-8ad7-172e8863a7b8 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:17.279420 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-9c9269ac-16b4-4f2f-8ad7-172e8863a7b8 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] [instance: bc5eda7f-851f-44d8-af95-5e721dd6d52b] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:17.288062 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9c9269ac-16b4-4f2f-8ad7-172e8863a7b8 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:17.289489 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9c9269ac-16b4-4f2f-8ad7-172e8863a7b8 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:17.291196 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9c9269ac-16b4-4f2f-8ad7-172e8863a7b8 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:17.296025 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9c9269ac-16b4-4f2f-8ad7-172e8863a7b8 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:17.297738 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9c9269ac-16b4-4f2f-8ad7-172e8863a7b8 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:17.300047 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9c9269ac-16b4-4f2f-8ad7-172e8863a7b8 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:17.772066 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-cd9db7c2-022b-44a3-867a-a01b799d33ba tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9b75d37d8b4f49b49af5808e0c3c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beaa0e0951d549ecafdc1f15417d831e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:17.786440 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-cd9db7c2-022b-44a3-867a-a01b799d33ba tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] 10.222.0.43 "GET /compute/v2.1/servers/a902c989-c015-4faf-848b-82cd682fa33f" status: 200 len: 1271 microversion: 2.1 time: 0.760414 Oct 04 18:53:17.810182 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2455/4605] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:16 2022] GET /compute/v2.1/servers/a902c989-c015-4faf-848b-82cd682fa33f => generated 1271 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:17.844268 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-0d7f0893-80bc-4bc4-bdef-af7ae4ed33f8 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:17.846189 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-0d7f0893-80bc-4bc4-bdef-af7ae4ed33f8 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 01e250ab-d9aa-4708-ae36-10c53a411a40] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:18.341049 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-0d7f0893-80bc-4bc4-bdef-af7ae4ed33f8 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f63f1ac147543dab34a28a22eb5936c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1607b30b9f324abaa88aa29e04ef3ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:18.355351 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-0d7f0893-80bc-4bc4-bdef-af7ae4ed33f8 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40" status: 200 len: 1216 microversion: 2.1 time: 0.543537 Oct 04 18:53:18.365263 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2456/4606] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:17 2022] GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40 => generated 1216 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:18.535157 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-9c9269ac-16b4-4f2f-8ad7-172e8863a7b8 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] 10.222.0.43 "GET /compute/v2.1/servers/bc5eda7f-851f-44d8-af95-5e721dd6d52b/os-interface" status: 200 len: 284 microversion: 2.1 time: 1.279489 Oct 04 18:53:18.536626 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2151/4607] 10.222.0.43 () {58 vars in 1275 bytes} [Tue Oct 4 18:53:17 2022] GET /compute/v2.1/servers/bc5eda7f-851f-44d8-af95-5e721dd6d52b/os-interface => generated 284 bytes in 1283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:53:18.819998 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-8a4463d9-13f3-4390-95cb-5ed80e265576 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:18.822784 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-8a4463d9-13f3-4390-95cb-5ed80e265576 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] [instance: a902c989-c015-4faf-848b-82cd682fa33f] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:18.846895 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8a4463d9-13f3-4390-95cb-5ed80e265576 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:18.848987 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8a4463d9-13f3-4390-95cb-5ed80e265576 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:18.849880 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8a4463d9-13f3-4390-95cb-5ed80e265576 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:18.855314 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8a4463d9-13f3-4390-95cb-5ed80e265576 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:18.893760 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8a4463d9-13f3-4390-95cb-5ed80e265576 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.038s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:18.899440 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8a4463d9-13f3-4390-95cb-5ed80e265576 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:19.391433 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-47cdafab-2d9a-4d91-be12-ae82db9dfec1 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:19.392507 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-47cdafab-2d9a-4d91-be12-ae82db9dfec1 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 01e250ab-d9aa-4708-ae36-10c53a411a40] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:19.406817 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-47cdafab-2d9a-4d91-be12-ae82db9dfec1 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:19.408897 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-47cdafab-2d9a-4d91-be12-ae82db9dfec1 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:19.412456 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-47cdafab-2d9a-4d91-be12-ae82db9dfec1 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:19.413639 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-47cdafab-2d9a-4d91-be12-ae82db9dfec1 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:19.414423 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-47cdafab-2d9a-4d91-be12-ae82db9dfec1 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:19.415419 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-47cdafab-2d9a-4d91-be12-ae82db9dfec1 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:19.976273 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-47cdafab-2d9a-4d91-be12-ae82db9dfec1 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f63f1ac147543dab34a28a22eb5936c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1607b30b9f324abaa88aa29e04ef3ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:19.994277 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-47cdafab-2d9a-4d91-be12-ae82db9dfec1 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40" status: 200 len: 1268 microversion: 2.1 time: 0.605377 Oct 04 18:53:19.997981 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2152/4608] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:19 2022] GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40 => generated 1268 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:53:20.358795 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-8a4463d9-13f3-4390-95cb-5ed80e265576 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9b75d37d8b4f49b49af5808e0c3c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beaa0e0951d549ecafdc1f15417d831e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:20.370914 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-8a4463d9-13f3-4390-95cb-5ed80e265576 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] 10.222.0.43 "GET /compute/v2.1/servers/a902c989-c015-4faf-848b-82cd682fa33f" status: 200 len: 1313 microversion: 2.1 time: 1.560521 Oct 04 18:53:20.373643 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2457/4609] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:18 2022] GET /compute/v2.1/servers/a902c989-c015-4faf-848b-82cd682fa33f => generated 1313 bytes in 1564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:21.026791 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-c3430bb5-148e-4c75-9f06-05137959df68 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:21.028208 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-c3430bb5-148e-4c75-9f06-05137959df68 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 01e250ab-d9aa-4708-ae36-10c53a411a40] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:21.032778 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:53:21.041652 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c3430bb5-148e-4c75-9f06-05137959df68 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:21.049404 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c3430bb5-148e-4c75-9f06-05137959df68 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:21.050182 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c3430bb5-148e-4c75-9f06-05137959df68 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:21.051808 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c3430bb5-148e-4c75-9f06-05137959df68 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:21.053078 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c3430bb5-148e-4c75-9f06-05137959df68 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:21.065428 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c3430bb5-148e-4c75-9f06-05137959df68 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:21.347098 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-c3430bb5-148e-4c75-9f06-05137959df68 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f63f1ac147543dab34a28a22eb5936c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1607b30b9f324abaa88aa29e04ef3ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:21.358359 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-c3430bb5-148e-4c75-9f06-05137959df68 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40" status: 200 len: 1274 microversion: 2.1 time: 0.336108 Oct 04 18:53:21.359907 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2153/4610] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:21 2022] GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40 => generated 1274 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:21.398480 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-dc320f9e-231e-4238-9c1e-41433f3a67f2 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:21.399096 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-dc320f9e-231e-4238-9c1e-41433f3a67f2 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] [instance: a902c989-c015-4faf-848b-82cd682fa33f] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:21.422263 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dc320f9e-231e-4238-9c1e-41433f3a67f2 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:21.423296 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dc320f9e-231e-4238-9c1e-41433f3a67f2 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:21.424567 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dc320f9e-231e-4238-9c1e-41433f3a67f2 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:21.427826 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dc320f9e-231e-4238-9c1e-41433f3a67f2 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:21.428623 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dc320f9e-231e-4238-9c1e-41433f3a67f2 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:21.429319 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dc320f9e-231e-4238-9c1e-41433f3a67f2 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:22.243730 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-dc320f9e-231e-4238-9c1e-41433f3a67f2 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9b75d37d8b4f49b49af5808e0c3c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beaa0e0951d549ecafdc1f15417d831e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:22.253556 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-dc320f9e-231e-4238-9c1e-41433f3a67f2 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] 10.222.0.43 "GET /compute/v2.1/servers/a902c989-c015-4faf-848b-82cd682fa33f" status: 200 len: 1313 microversion: 2.1 time: 0.859071 Oct 04 18:53:22.269531 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2458/4611] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:21 2022] GET /compute/v2.1/servers/a902c989-c015-4faf-848b-82cd682fa33f => generated 1313 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:22.383999 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-09f385ef-6325-45bb-a927-b5b92359061a tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:22.385360 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-09f385ef-6325-45bb-a927-b5b92359061a tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 01e250ab-d9aa-4708-ae36-10c53a411a40] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:22.403143 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-09f385ef-6325-45bb-a927-b5b92359061a tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:22.403939 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-09f385ef-6325-45bb-a927-b5b92359061a tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:22.404620 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-09f385ef-6325-45bb-a927-b5b92359061a tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:22.405640 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-09f385ef-6325-45bb-a927-b5b92359061a tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:22.411882 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-09f385ef-6325-45bb-a927-b5b92359061a tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:22.412462 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-09f385ef-6325-45bb-a927-b5b92359061a tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:23.152689 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-09f385ef-6325-45bb-a927-b5b92359061a tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f63f1ac147543dab34a28a22eb5936c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1607b30b9f324abaa88aa29e04ef3ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:23.155700 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=86 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:53:23.169902 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-09f385ef-6325-45bb-a927-b5b92359061a tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40" status: 200 len: 1274 microversion: 2.1 time: 0.790790 Oct 04 18:53:23.176334 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2154/4612] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:22 2022] GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40 => generated 1274 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:23.285553 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-ec8f9224-03d6-41fc-b38d-9049ff1dd850 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:23.286439 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-ec8f9224-03d6-41fc-b38d-9049ff1dd850 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] [instance: a902c989-c015-4faf-848b-82cd682fa33f] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:23.289464 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=2 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:53:23.315834 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ec8f9224-03d6-41fc-b38d-9049ff1dd850 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:23.316426 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ec8f9224-03d6-41fc-b38d-9049ff1dd850 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:23.316890 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ec8f9224-03d6-41fc-b38d-9049ff1dd850 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:23.317677 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ec8f9224-03d6-41fc-b38d-9049ff1dd850 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:23.334368 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ec8f9224-03d6-41fc-b38d-9049ff1dd850 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:23.337651 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ec8f9224-03d6-41fc-b38d-9049ff1dd850 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:23.380397 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-87d9c57f-9c0b-4d57-a6b2-59320f0bf8d8 req-cc73daeb-33d1-4f12-9755-1de248f9d55f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc5eda7f-851f-44d8-af95-5e721dd6d52b", "tag": "81db9f36-4048-40e2-a99b-a532729ebc0a"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:53:23.412647 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-87d9c57f-9c0b-4d57-a6b2-59320f0bf8d8 req-cc73daeb-33d1-4f12-9755-1de248f9d55f service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:23.422861 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-87d9c57f-9c0b-4d57-a6b2-59320f0bf8d8 req-cc73daeb-33d1-4f12-9755-1de248f9d55f service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:23.423967 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-87d9c57f-9c0b-4d57-a6b2-59320f0bf8d8 req-cc73daeb-33d1-4f12-9755-1de248f9d55f service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:23.484684 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-87d9c57f-9c0b-4d57-a6b2-59320f0bf8d8 req-cc73daeb-33d1-4f12-9755-1de248f9d55f service nova] Creating event network-changed:81db9f36-4048-40e2-a99b-a532729ebc0a for instance bc5eda7f-851f-44d8-af95-5e721dd6d52b on n-h1-851028-13 Oct 04 18:53:23.503407 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-87d9c57f-9c0b-4d57-a6b2-59320f0bf8d8 req-cc73daeb-33d1-4f12-9755-1de248f9d55f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.125534 Oct 04 18:53:23.505438 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2155/4613] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:53:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:53:24.196970 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-36d5ae51-d4d5-4e8c-ac5e-98e8efe71823 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:24.198066 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-36d5ae51-d4d5-4e8c-ac5e-98e8efe71823 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 01e250ab-d9aa-4708-ae36-10c53a411a40] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:24.205237 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-36d5ae51-d4d5-4e8c-ac5e-98e8efe71823 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:24.206381 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-36d5ae51-d4d5-4e8c-ac5e-98e8efe71823 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:24.207052 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-36d5ae51-d4d5-4e8c-ac5e-98e8efe71823 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:24.207991 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-36d5ae51-d4d5-4e8c-ac5e-98e8efe71823 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:24.208677 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-36d5ae51-d4d5-4e8c-ac5e-98e8efe71823 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:24.209370 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-36d5ae51-d4d5-4e8c-ac5e-98e8efe71823 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:24.209736 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-ec8f9224-03d6-41fc-b38d-9049ff1dd850 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9b75d37d8b4f49b49af5808e0c3c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beaa0e0951d549ecafdc1f15417d831e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:24.227180 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-ec8f9224-03d6-41fc-b38d-9049ff1dd850 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] 10.222.0.43 "GET /compute/v2.1/servers/a902c989-c015-4faf-848b-82cd682fa33f" status: 200 len: 1313 microversion: 2.1 time: 0.939816 Oct 04 18:53:24.229188 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2459/4614] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:23 2022] GET /compute/v2.1/servers/a902c989-c015-4faf-848b-82cd682fa33f => generated 1313 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:24.630284 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-36d5ae51-d4d5-4e8c-ac5e-98e8efe71823 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f63f1ac147543dab34a28a22eb5936c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1607b30b9f324abaa88aa29e04ef3ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:24.645661 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-36d5ae51-d4d5-4e8c-ac5e-98e8efe71823 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40" status: 200 len: 1274 microversion: 2.1 time: 0.452626 Oct 04 18:53:24.669313 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2156/4615] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:24 2022] GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40 => generated 1274 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:53:24.926710 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-72259224-5923-4792-8a52-e5a75d597d4a req-23f8a30c-e226-48ce-b147-34b805f61173 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a902c989-c015-4faf-848b-82cd682fa33f", "tag": "10859e33-5c25-41b2-b965-e0a7b88aaa75"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:53:24.949851 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-72259224-5923-4792-8a52-e5a75d597d4a req-23f8a30c-e226-48ce-b147-34b805f61173 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:24.950142 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-72259224-5923-4792-8a52-e5a75d597d4a req-23f8a30c-e226-48ce-b147-34b805f61173 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:24.950665 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-72259224-5923-4792-8a52-e5a75d597d4a req-23f8a30c-e226-48ce-b147-34b805f61173 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:24.984095 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-72259224-5923-4792-8a52-e5a75d597d4a req-23f8a30c-e226-48ce-b147-34b805f61173 service nova] Creating event network-changed:10859e33-5c25-41b2-b965-e0a7b88aaa75 for instance a902c989-c015-4faf-848b-82cd682fa33f on n-h1-851028-13 Oct 04 18:53:25.002142 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-72259224-5923-4792-8a52-e5a75d597d4a req-23f8a30c-e226-48ce-b147-34b805f61173 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074038 Oct 04 18:53:25.003088 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2460/4616] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:53:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:53:25.254588 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-514517ae-55c2-4799-a628-0c846b72ad95 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:25.255487 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-514517ae-55c2-4799-a628-0c846b72ad95 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] [instance: a902c989-c015-4faf-848b-82cd682fa33f] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:25.272168 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-514517ae-55c2-4799-a628-0c846b72ad95 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:25.274056 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-514517ae-55c2-4799-a628-0c846b72ad95 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:25.277856 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-514517ae-55c2-4799-a628-0c846b72ad95 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:25.278891 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-514517ae-55c2-4799-a628-0c846b72ad95 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:25.300793 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-514517ae-55c2-4799-a628-0c846b72ad95 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:25.301454 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-514517ae-55c2-4799-a628-0c846b72ad95 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:25.670583 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-d3c45afe-3607-4013-8bcb-1e1fd4f0522e tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:25.671314 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-d3c45afe-3607-4013-8bcb-1e1fd4f0522e tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 01e250ab-d9aa-4708-ae36-10c53a411a40] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:25.696565 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d3c45afe-3607-4013-8bcb-1e1fd4f0522e tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:25.697100 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d3c45afe-3607-4013-8bcb-1e1fd4f0522e tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:25.697601 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d3c45afe-3607-4013-8bcb-1e1fd4f0522e tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:25.698937 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d3c45afe-3607-4013-8bcb-1e1fd4f0522e tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:25.701922 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d3c45afe-3607-4013-8bcb-1e1fd4f0522e tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:25.702566 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d3c45afe-3607-4013-8bcb-1e1fd4f0522e tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:26.506117 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-514517ae-55c2-4799-a628-0c846b72ad95 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9b75d37d8b4f49b49af5808e0c3c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beaa0e0951d549ecafdc1f15417d831e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:26.526206 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-514517ae-55c2-4799-a628-0c846b72ad95 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] 10.222.0.43 "GET /compute/v2.1/servers/a902c989-c015-4faf-848b-82cd682fa33f" status: 200 len: 1313 microversion: 2.1 time: 1.269790 Oct 04 18:53:26.537190 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2157/4617] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:25 2022] GET /compute/v2.1/servers/a902c989-c015-4faf-848b-82cd682fa33f => generated 1313 bytes in 1278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:26.877687 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-d3c45afe-3607-4013-8bcb-1e1fd4f0522e tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f63f1ac147543dab34a28a22eb5936c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1607b30b9f324abaa88aa29e04ef3ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:26.895417 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-d3c45afe-3607-4013-8bcb-1e1fd4f0522e tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40" status: 200 len: 1316 microversion: 2.1 time: 1.229866 Oct 04 18:53:26.898929 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2461/4618] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:25 2022] GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40 => generated 1316 bytes in 1234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:27.558747 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-4ed5dd9b-b15b-4168-aed1-779d67db3dd5 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:27.559689 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-4ed5dd9b-b15b-4168-aed1-779d67db3dd5 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] [instance: a902c989-c015-4faf-848b-82cd682fa33f] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:27.567497 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=2 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:53:27.569336 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=8 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:53:27.574335 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4ed5dd9b-b15b-4168-aed1-779d67db3dd5 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:27.575200 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4ed5dd9b-b15b-4168-aed1-779d67db3dd5 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:27.575942 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4ed5dd9b-b15b-4168-aed1-779d67db3dd5 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:27.577722 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4ed5dd9b-b15b-4168-aed1-779d67db3dd5 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:27.578441 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4ed5dd9b-b15b-4168-aed1-779d67db3dd5 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:27.579329 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4ed5dd9b-b15b-4168-aed1-779d67db3dd5 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:27.930116 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-2d8fcf9c-f7da-4738-b54e-6cf03ffc944d tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:27.930892 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-2d8fcf9c-f7da-4738-b54e-6cf03ffc944d tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 01e250ab-d9aa-4708-ae36-10c53a411a40] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:27.965256 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2d8fcf9c-f7da-4738-b54e-6cf03ffc944d tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:27.965891 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2d8fcf9c-f7da-4738-b54e-6cf03ffc944d tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:27.966969 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2d8fcf9c-f7da-4738-b54e-6cf03ffc944d tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:27.968433 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2d8fcf9c-f7da-4738-b54e-6cf03ffc944d tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:27.969023 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2d8fcf9c-f7da-4738-b54e-6cf03ffc944d tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:27.969597 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2d8fcf9c-f7da-4738-b54e-6cf03ffc944d tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:28.355359 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=8 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:53:28.733506 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-4ed5dd9b-b15b-4168-aed1-779d67db3dd5 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9b75d37d8b4f49b49af5808e0c3c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beaa0e0951d549ecafdc1f15417d831e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:28.749932 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-4ed5dd9b-b15b-4168-aed1-779d67db3dd5 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] 10.222.0.43 "GET /compute/v2.1/servers/a902c989-c015-4faf-848b-82cd682fa33f" status: 200 len: 1313 microversion: 2.1 time: 1.198322 Oct 04 18:53:28.752863 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2158/4619] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:27 2022] GET /compute/v2.1/servers/a902c989-c015-4faf-848b-82cd682fa33f => generated 1313 bytes in 1202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:28.911816 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-2d8fcf9c-f7da-4738-b54e-6cf03ffc944d tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f63f1ac147543dab34a28a22eb5936c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1607b30b9f324abaa88aa29e04ef3ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:28.920328 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-2d8fcf9c-f7da-4738-b54e-6cf03ffc944d tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40" status: 200 len: 1316 microversion: 2.1 time: 0.995191 Oct 04 18:53:28.940723 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2462/4620] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:27 2022] GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40 => generated 1316 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:29.779101 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-9e4ac419-5ae0-4b4a-999c-5dfdf320433b tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:29.780035 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-9e4ac419-5ae0-4b4a-999c-5dfdf320433b tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] [instance: a902c989-c015-4faf-848b-82cd682fa33f] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:29.806090 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-d14df4b7-eb01-476f-b38d-f2f2aae2c7bc req-3c2cf5ab-1474-405b-ae6d-fc82db0cf7f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01e250ab-d9aa-4708-ae36-10c53a411a40", "tag": "70d1b09a-03d8-41b4-9a82-fc7d75a3624a"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:53:29.813886 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9e4ac419-5ae0-4b4a-999c-5dfdf320433b tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:29.820793 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9e4ac419-5ae0-4b4a-999c-5dfdf320433b tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:29.821401 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9e4ac419-5ae0-4b4a-999c-5dfdf320433b tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:29.822138 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9e4ac419-5ae0-4b4a-999c-5dfdf320433b tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:29.822643 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9e4ac419-5ae0-4b4a-999c-5dfdf320433b tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:29.823089 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9e4ac419-5ae0-4b4a-999c-5dfdf320433b tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:29.846891 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-d14df4b7-eb01-476f-b38d-f2f2aae2c7bc req-3c2cf5ab-1474-405b-ae6d-fc82db0cf7f7 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:29.847403 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-d14df4b7-eb01-476f-b38d-f2f2aae2c7bc req-3c2cf5ab-1474-405b-ae6d-fc82db0cf7f7 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:29.847850 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-d14df4b7-eb01-476f-b38d-f2f2aae2c7bc req-3c2cf5ab-1474-405b-ae6d-fc82db0cf7f7 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:29.895993 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-d14df4b7-eb01-476f-b38d-f2f2aae2c7bc req-3c2cf5ab-1474-405b-ae6d-fc82db0cf7f7 service nova] Creating event network-changed:70d1b09a-03d8-41b4-9a82-fc7d75a3624a for instance 01e250ab-d9aa-4708-ae36-10c53a411a40 on n-h2-851028-13 Oct 04 18:53:29.916138 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-d14df4b7-eb01-476f-b38d-f2f2aae2c7bc req-3c2cf5ab-1474-405b-ae6d-fc82db0cf7f7 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114476 Oct 04 18:53:29.916767 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2463/4621] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:53:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:53:29.949357 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-8298dcd5-ae49-4906-8b30-d70f72f4b746 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:29.950244 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-8298dcd5-ae49-4906-8b30-d70f72f4b746 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 01e250ab-d9aa-4708-ae36-10c53a411a40] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:29.960151 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8298dcd5-ae49-4906-8b30-d70f72f4b746 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:29.960896 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8298dcd5-ae49-4906-8b30-d70f72f4b746 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:29.961372 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8298dcd5-ae49-4906-8b30-d70f72f4b746 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:29.962113 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8298dcd5-ae49-4906-8b30-d70f72f4b746 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:29.962566 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8298dcd5-ae49-4906-8b30-d70f72f4b746 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:29.963696 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8298dcd5-ae49-4906-8b30-d70f72f4b746 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:30.371660 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-8298dcd5-ae49-4906-8b30-d70f72f4b746 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f63f1ac147543dab34a28a22eb5936c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1607b30b9f324abaa88aa29e04ef3ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:30.380375 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-8298dcd5-ae49-4906-8b30-d70f72f4b746 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40" status: 200 len: 1316 microversion: 2.1 time: 0.436190 Oct 04 18:53:30.380970 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2464/4622] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:29 2022] GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40 => generated 1316 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:53:30.678530 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-9e4ac419-5ae0-4b4a-999c-5dfdf320433b tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9b75d37d8b4f49b49af5808e0c3c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beaa0e0951d549ecafdc1f15417d831e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:30.692456 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-9e4ac419-5ae0-4b4a-999c-5dfdf320433b tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] 10.222.0.43 "GET /compute/v2.1/servers/a902c989-c015-4faf-848b-82cd682fa33f" status: 200 len: 1313 microversion: 2.1 time: 0.918127 Oct 04 18:53:30.693463 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2159/4623] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:29 2022] GET /compute/v2.1/servers/a902c989-c015-4faf-848b-82cd682fa33f => generated 1313 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:31.407706 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-fdc0e803-b692-4c1c-95cc-1cfcaf1f14e8 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:31.408340 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-fdc0e803-b692-4c1c-95cc-1cfcaf1f14e8 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 01e250ab-d9aa-4708-ae36-10c53a411a40] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:31.425408 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fdc0e803-b692-4c1c-95cc-1cfcaf1f14e8 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:31.430216 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fdc0e803-b692-4c1c-95cc-1cfcaf1f14e8 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:31.433742 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fdc0e803-b692-4c1c-95cc-1cfcaf1f14e8 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:31.439872 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fdc0e803-b692-4c1c-95cc-1cfcaf1f14e8 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:31.441566 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fdc0e803-b692-4c1c-95cc-1cfcaf1f14e8 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:31.443806 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fdc0e803-b692-4c1c-95cc-1cfcaf1f14e8 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:31.682456 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-bf74b37d-75d4-4c4f-b83e-1b794a3654f4 req-7a17f368-c2d6-4696-9a3d-298032a9c2a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a902c989-c015-4faf-848b-82cd682fa33f", "name": "network-vif-plugged", "status": "completed", "tag": "10859e33-5c25-41b2-b965-e0a7b88aaa75"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:53:31.707447 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-bf74b37d-75d4-4c4f-b83e-1b794a3654f4 req-7a17f368-c2d6-4696-9a3d-298032a9c2a6 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:31.707829 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-bf74b37d-75d4-4c4f-b83e-1b794a3654f4 req-7a17f368-c2d6-4696-9a3d-298032a9c2a6 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:31.708457 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-bf74b37d-75d4-4c4f-b83e-1b794a3654f4 req-7a17f368-c2d6-4696-9a3d-298032a9c2a6 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:31.754652 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-bf74b37d-75d4-4c4f-b83e-1b794a3654f4 req-7a17f368-c2d6-4696-9a3d-298032a9c2a6 service nova] Creating event network-vif-plugged:10859e33-5c25-41b2-b965-e0a7b88aaa75 for instance a902c989-c015-4faf-848b-82cd682fa33f on n-h1-851028-13 Oct 04 18:53:31.765894 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-bf74b37d-75d4-4c4f-b83e-1b794a3654f4 req-7a17f368-c2d6-4696-9a3d-298032a9c2a6 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087170 Oct 04 18:53:31.770535 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2160/4624] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:53:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:53:31.780937 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-8de0c3da-0839-495f-81fe-62a621be1ec9 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:31.783367 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-8de0c3da-0839-495f-81fe-62a621be1ec9 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] [instance: a902c989-c015-4faf-848b-82cd682fa33f] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:31.819980 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8de0c3da-0839-495f-81fe-62a621be1ec9 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:31.820785 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8de0c3da-0839-495f-81fe-62a621be1ec9 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:31.821862 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8de0c3da-0839-495f-81fe-62a621be1ec9 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:31.823522 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8de0c3da-0839-495f-81fe-62a621be1ec9 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:31.830973 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8de0c3da-0839-495f-81fe-62a621be1ec9 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:31.836025 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8de0c3da-0839-495f-81fe-62a621be1ec9 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:32.248306 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-8de0c3da-0839-495f-81fe-62a621be1ec9 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9b75d37d8b4f49b49af5808e0c3c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beaa0e0951d549ecafdc1f15417d831e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:32.257088 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-8de0c3da-0839-495f-81fe-62a621be1ec9 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] 10.222.0.43 "GET /compute/v2.1/servers/a902c989-c015-4faf-848b-82cd682fa33f" status: 200 len: 1313 microversion: 2.1 time: 0.484957 Oct 04 18:53:32.264968 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2161/4625] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:31 2022] GET /compute/v2.1/servers/a902c989-c015-4faf-848b-82cd682fa33f => generated 1313 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:32.658778 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-fdc0e803-b692-4c1c-95cc-1cfcaf1f14e8 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f63f1ac147543dab34a28a22eb5936c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1607b30b9f324abaa88aa29e04ef3ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:32.680315 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-fdc0e803-b692-4c1c-95cc-1cfcaf1f14e8 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40" status: 200 len: 1316 microversion: 2.1 time: 1.277213 Oct 04 18:53:32.681174 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2465/4626] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:31 2022] GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40 => generated 1316 bytes in 1279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:33.282732 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-42e54a50-3dc8-4a8f-92f7-da374a7ebbda tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:33.283968 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-42e54a50-3dc8-4a8f-92f7-da374a7ebbda tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] [instance: a902c989-c015-4faf-848b-82cd682fa33f] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:33.299760 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-42e54a50-3dc8-4a8f-92f7-da374a7ebbda tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:33.300649 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-42e54a50-3dc8-4a8f-92f7-da374a7ebbda tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:33.302558 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-42e54a50-3dc8-4a8f-92f7-da374a7ebbda tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:33.304158 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-42e54a50-3dc8-4a8f-92f7-da374a7ebbda tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:33.305951 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-42e54a50-3dc8-4a8f-92f7-da374a7ebbda tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:33.317550 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-42e54a50-3dc8-4a8f-92f7-da374a7ebbda tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:33.705914 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-4a0fd0a6-c6cd-4808-a52b-0d84dd571400 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:33.707302 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-4a0fd0a6-c6cd-4808-a52b-0d84dd571400 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 01e250ab-d9aa-4708-ae36-10c53a411a40] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:33.724125 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4a0fd0a6-c6cd-4808-a52b-0d84dd571400 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:33.724945 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4a0fd0a6-c6cd-4808-a52b-0d84dd571400 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:33.725635 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4a0fd0a6-c6cd-4808-a52b-0d84dd571400 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:33.726579 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4a0fd0a6-c6cd-4808-a52b-0d84dd571400 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:33.727273 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4a0fd0a6-c6cd-4808-a52b-0d84dd571400 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:33.727942 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4a0fd0a6-c6cd-4808-a52b-0d84dd571400 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:33.788234 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-42e54a50-3dc8-4a8f-92f7-da374a7ebbda tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9b75d37d8b4f49b49af5808e0c3c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beaa0e0951d549ecafdc1f15417d831e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:33.796403 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-42e54a50-3dc8-4a8f-92f7-da374a7ebbda tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] 10.222.0.43 "GET /compute/v2.1/servers/a902c989-c015-4faf-848b-82cd682fa33f" status: 200 len: 1313 microversion: 2.1 time: 0.517616 Oct 04 18:53:33.799648 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2162/4627] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:33 2022] GET /compute/v2.1/servers/a902c989-c015-4faf-848b-82cd682fa33f => generated 1313 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:34.442798 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-4a0fd0a6-c6cd-4808-a52b-0d84dd571400 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f63f1ac147543dab34a28a22eb5936c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1607b30b9f324abaa88aa29e04ef3ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:34.450920 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-4a0fd0a6-c6cd-4808-a52b-0d84dd571400 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40" status: 200 len: 1316 microversion: 2.1 time: 0.750114 Oct 04 18:53:34.466136 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2466/4628] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:33 2022] GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40 => generated 1316 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:34.825513 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-79fb42c1-dd5f-4d5d-8469-82aaa0cbb6ba tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:34.826131 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-79fb42c1-dd5f-4d5d-8469-82aaa0cbb6ba tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] [instance: a902c989-c015-4faf-848b-82cd682fa33f] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:34.844864 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-79fb42c1-dd5f-4d5d-8469-82aaa0cbb6ba tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:34.845400 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-79fb42c1-dd5f-4d5d-8469-82aaa0cbb6ba tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:34.845843 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-79fb42c1-dd5f-4d5d-8469-82aaa0cbb6ba tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:34.846762 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-79fb42c1-dd5f-4d5d-8469-82aaa0cbb6ba tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:34.847384 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-79fb42c1-dd5f-4d5d-8469-82aaa0cbb6ba tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:34.847998 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-79fb42c1-dd5f-4d5d-8469-82aaa0cbb6ba tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:35.473887 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-208ac880-b444-438c-8ed2-c0017acc6797 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:35.474520 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-208ac880-b444-438c-8ed2-c0017acc6797 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 01e250ab-d9aa-4708-ae36-10c53a411a40] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:35.495524 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-208ac880-b444-438c-8ed2-c0017acc6797 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:35.501789 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-208ac880-b444-438c-8ed2-c0017acc6797 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:35.502206 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-208ac880-b444-438c-8ed2-c0017acc6797 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:35.503129 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-208ac880-b444-438c-8ed2-c0017acc6797 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:35.503444 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-208ac880-b444-438c-8ed2-c0017acc6797 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:35.514450 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-208ac880-b444-438c-8ed2-c0017acc6797 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:35.597198 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-79fb42c1-dd5f-4d5d-8469-82aaa0cbb6ba tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9b75d37d8b4f49b49af5808e0c3c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beaa0e0951d549ecafdc1f15417d831e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:35.605248 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-79fb42c1-dd5f-4d5d-8469-82aaa0cbb6ba tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] 10.222.0.43 "GET /compute/v2.1/servers/a902c989-c015-4faf-848b-82cd682fa33f" status: 200 len: 1499 microversion: 2.1 time: 0.783573 Oct 04 18:53:35.609928 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2163/4629] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:34 2022] GET /compute/v2.1/servers/a902c989-c015-4faf-848b-82cd682fa33f => generated 1499 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:35.637676 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-51137e97-90d7-4fb5-8c3f-0867d8a4247a tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:53:35.644984 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-51137e97-90d7-4fb5-8c3f-0867d8a4247a tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] [instance: a902c989-c015-4faf-848b-82cd682fa33f] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:35.666714 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-51137e97-90d7-4fb5-8c3f-0867d8a4247a tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:35.667233 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-51137e97-90d7-4fb5-8c3f-0867d8a4247a tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:35.667710 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-51137e97-90d7-4fb5-8c3f-0867d8a4247a tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:35.668440 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-51137e97-90d7-4fb5-8c3f-0867d8a4247a tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:35.668895 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-51137e97-90d7-4fb5-8c3f-0867d8a4247a tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:35.669433 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-51137e97-90d7-4fb5-8c3f-0867d8a4247a tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:35.751558 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.objects.instance [None req-51137e97-90d7-4fb5-8c3f-0867d8a4247a tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lazy-loading 'flavor' on Instance uuid a902c989-c015-4faf-848b-82cd682fa33f {{(pid=123595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:53:35.955654 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-51137e97-90d7-4fb5-8c3f-0867d8a4247a tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] 10.222.0.43 "POST /compute/v2.1/servers/a902c989-c015-4faf-848b-82cd682fa33f/action" status: 200 len: 32 microversion: 2.1 time: 0.324222 Oct 04 18:53:35.962284 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2164/4630] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 18:53:35 2022] POST /compute/v2.1/servers/a902c989-c015-4faf-848b-82cd682fa33f/action => generated 32 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 04 18:53:35.968123 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-26941a57-50e3-4b93-b540-d95006468427 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:35.968921 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-26941a57-50e3-4b93-b540-d95006468427 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] [instance: a902c989-c015-4faf-848b-82cd682fa33f] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:35.982743 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-26941a57-50e3-4b93-b540-d95006468427 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:35.983556 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-26941a57-50e3-4b93-b540-d95006468427 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:35.984155 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-26941a57-50e3-4b93-b540-d95006468427 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:35.995958 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-26941a57-50e3-4b93-b540-d95006468427 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:36.002442 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-26941a57-50e3-4b93-b540-d95006468427 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:36.003436 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-26941a57-50e3-4b93-b540-d95006468427 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:36.269366 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-208ac880-b444-438c-8ed2-c0017acc6797 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f63f1ac147543dab34a28a22eb5936c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1607b30b9f324abaa88aa29e04ef3ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:36.303576 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-208ac880-b444-438c-8ed2-c0017acc6797 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40" status: 200 len: 1316 microversion: 2.1 time: 0.833590 Oct 04 18:53:36.319272 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2467/4631] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:35 2022] GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40 => generated 1316 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:53:36.684247 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-26941a57-50e3-4b93-b540-d95006468427 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9b75d37d8b4f49b49af5808e0c3c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beaa0e0951d549ecafdc1f15417d831e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:36.693211 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-26941a57-50e3-4b93-b540-d95006468427 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] 10.222.0.43 "GET /compute/v2.1/servers/a902c989-c015-4faf-848b-82cd682fa33f" status: 200 len: 1505 microversion: 2.1 time: 0.730899 Oct 04 18:53:36.706259 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2165/4632] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:35 2022] GET /compute/v2.1/servers/a902c989-c015-4faf-848b-82cd682fa33f => generated 1505 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:37.326844 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-1aa6c29c-bcb8-448e-af66-02aaba37fdf8 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:37.327457 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-1aa6c29c-bcb8-448e-af66-02aaba37fdf8 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 01e250ab-d9aa-4708-ae36-10c53a411a40] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:37.343036 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1aa6c29c-bcb8-448e-af66-02aaba37fdf8 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:37.344300 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1aa6c29c-bcb8-448e-af66-02aaba37fdf8 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:37.345336 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1aa6c29c-bcb8-448e-af66-02aaba37fdf8 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:37.346751 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1aa6c29c-bcb8-448e-af66-02aaba37fdf8 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:37.349830 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1aa6c29c-bcb8-448e-af66-02aaba37fdf8 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:37.351714 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1aa6c29c-bcb8-448e-af66-02aaba37fdf8 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:37.732365 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-2f172908-abeb-4014-8c16-03f087dd9da7 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:37.733163 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-2f172908-abeb-4014-8c16-03f087dd9da7 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] [instance: a902c989-c015-4faf-848b-82cd682fa33f] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:37.742833 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2f172908-abeb-4014-8c16-03f087dd9da7 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:37.743923 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2f172908-abeb-4014-8c16-03f087dd9da7 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:37.744598 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2f172908-abeb-4014-8c16-03f087dd9da7 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:37.745539 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2f172908-abeb-4014-8c16-03f087dd9da7 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:37.746425 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2f172908-abeb-4014-8c16-03f087dd9da7 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:37.747078 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2f172908-abeb-4014-8c16-03f087dd9da7 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:38.124894 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-2f172908-abeb-4014-8c16-03f087dd9da7 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9b75d37d8b4f49b49af5808e0c3c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beaa0e0951d549ecafdc1f15417d831e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:38.139436 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-2f172908-abeb-4014-8c16-03f087dd9da7 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] 10.222.0.43 "GET /compute/v2.1/servers/a902c989-c015-4faf-848b-82cd682fa33f" status: 200 len: 1505 microversion: 2.1 time: 0.409240 Oct 04 18:53:38.140102 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2166/4633] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:37 2022] GET /compute/v2.1/servers/a902c989-c015-4faf-848b-82cd682fa33f => generated 1505 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:53:38.927693 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-1aa6c29c-bcb8-448e-af66-02aaba37fdf8 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f63f1ac147543dab34a28a22eb5936c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1607b30b9f324abaa88aa29e04ef3ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:38.969384 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-1aa6c29c-bcb8-448e-af66-02aaba37fdf8 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40" status: 200 len: 1316 microversion: 2.1 time: 1.644330 Oct 04 18:53:38.972393 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2468/4634] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:37 2022] GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40 => generated 1316 bytes in 1650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:39.167154 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-0d6e4690-cc8b-4727-8afd-c3cc1574a4b6 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:39.167796 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-0d6e4690-cc8b-4727-8afd-c3cc1574a4b6 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] [instance: a902c989-c015-4faf-848b-82cd682fa33f] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:39.181284 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0d6e4690-cc8b-4727-8afd-c3cc1574a4b6 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:39.181973 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0d6e4690-cc8b-4727-8afd-c3cc1574a4b6 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:39.189170 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0d6e4690-cc8b-4727-8afd-c3cc1574a4b6 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:39.190280 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0d6e4690-cc8b-4727-8afd-c3cc1574a4b6 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:39.191243 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0d6e4690-cc8b-4727-8afd-c3cc1574a4b6 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:39.191821 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0d6e4690-cc8b-4727-8afd-c3cc1574a4b6 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:39.562625 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-0d6e4690-cc8b-4727-8afd-c3cc1574a4b6 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9b75d37d8b4f49b49af5808e0c3c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beaa0e0951d549ecafdc1f15417d831e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:39.617979 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-0d6e4690-cc8b-4727-8afd-c3cc1574a4b6 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] 10.222.0.43 "GET /compute/v2.1/servers/a902c989-c015-4faf-848b-82cd682fa33f" status: 200 len: 1505 microversion: 2.1 time: 0.444775 Oct 04 18:53:39.629640 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2167/4635] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:39 2022] GET /compute/v2.1/servers/a902c989-c015-4faf-848b-82cd682fa33f => generated 1505 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:39.999538 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-0d29c5a3-8626-42b0-8162-4f49b3a3bfe8 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:40.001575 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-0d29c5a3-8626-42b0-8162-4f49b3a3bfe8 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 01e250ab-d9aa-4708-ae36-10c53a411a40] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:40.017006 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:53:40.022704 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0d29c5a3-8626-42b0-8162-4f49b3a3bfe8 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:40.023790 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0d29c5a3-8626-42b0-8162-4f49b3a3bfe8 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:40.026497 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0d29c5a3-8626-42b0-8162-4f49b3a3bfe8 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:40.027568 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0d29c5a3-8626-42b0-8162-4f49b3a3bfe8 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:40.029806 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0d29c5a3-8626-42b0-8162-4f49b3a3bfe8 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:40.031118 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0d29c5a3-8626-42b0-8162-4f49b3a3bfe8 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:40.643747 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-24e35720-a42a-49f7-b72d-f9b17c8f8de6 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:40.644933 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-24e35720-a42a-49f7-b72d-f9b17c8f8de6 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] [instance: a902c989-c015-4faf-848b-82cd682fa33f] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:40.662730 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-24e35720-a42a-49f7-b72d-f9b17c8f8de6 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:40.663496 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-24e35720-a42a-49f7-b72d-f9b17c8f8de6 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:40.668556 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-24e35720-a42a-49f7-b72d-f9b17c8f8de6 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:40.669657 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-24e35720-a42a-49f7-b72d-f9b17c8f8de6 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:40.672442 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-24e35720-a42a-49f7-b72d-f9b17c8f8de6 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:40.673087 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-24e35720-a42a-49f7-b72d-f9b17c8f8de6 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:41.520709 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-24e35720-a42a-49f7-b72d-f9b17c8f8de6 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9b75d37d8b4f49b49af5808e0c3c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beaa0e0951d549ecafdc1f15417d831e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:41.530876 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-24e35720-a42a-49f7-b72d-f9b17c8f8de6 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] 10.222.0.43 "GET /compute/v2.1/servers/a902c989-c015-4faf-848b-82cd682fa33f" status: 200 len: 1505 microversion: 2.1 time: 0.891134 Oct 04 18:53:41.543546 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2168/4636] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:40 2022] GET /compute/v2.1/servers/a902c989-c015-4faf-848b-82cd682fa33f => generated 1505 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:41.566591 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-bbe992e8-2f5e-4219-9e1e-4379cf9a239e req-64df31cf-a560-4785-8851-b89e309e74a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01e250ab-d9aa-4708-ae36-10c53a411a40", "name": "network-vif-plugged", "status": "completed", "tag": "70d1b09a-03d8-41b4-9a82-fc7d75a3624a"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:53:41.620520 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-bbe992e8-2f5e-4219-9e1e-4379cf9a239e req-64df31cf-a560-4785-8851-b89e309e74a5 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:41.623733 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-bbe992e8-2f5e-4219-9e1e-4379cf9a239e req-64df31cf-a560-4785-8851-b89e309e74a5 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:41.625070 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-bbe992e8-2f5e-4219-9e1e-4379cf9a239e req-64df31cf-a560-4785-8851-b89e309e74a5 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:41.665770 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-bbe992e8-2f5e-4219-9e1e-4379cf9a239e req-64df31cf-a560-4785-8851-b89e309e74a5 service nova] Creating event network-vif-plugged:70d1b09a-03d8-41b4-9a82-fc7d75a3624a for instance 01e250ab-d9aa-4708-ae36-10c53a411a40 on n-h2-851028-13 Oct 04 18:53:41.685147 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-bbe992e8-2f5e-4219-9e1e-4379cf9a239e req-64df31cf-a560-4785-8851-b89e309e74a5 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.139856 Oct 04 18:53:41.704811 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2169/4637] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:53:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:53:42.141564 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-0d29c5a3-8626-42b0-8162-4f49b3a3bfe8 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f63f1ac147543dab34a28a22eb5936c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1607b30b9f324abaa88aa29e04ef3ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:42.150226 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-0d29c5a3-8626-42b0-8162-4f49b3a3bfe8 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40" status: 200 len: 1316 microversion: 2.1 time: 2.158515 Oct 04 18:53:42.154216 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2469/4638] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:39 2022] GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40 => generated 1316 bytes in 2163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:42.560384 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-77b354dc-883d-4b8a-a5ea-a96417790923 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:42.561407 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-77b354dc-883d-4b8a-a5ea-a96417790923 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] [instance: a902c989-c015-4faf-848b-82cd682fa33f] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:42.579787 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-77b354dc-883d-4b8a-a5ea-a96417790923 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:42.589216 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-77b354dc-883d-4b8a-a5ea-a96417790923 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:42.594034 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-77b354dc-883d-4b8a-a5ea-a96417790923 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:42.595290 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-77b354dc-883d-4b8a-a5ea-a96417790923 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:42.595971 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-77b354dc-883d-4b8a-a5ea-a96417790923 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:42.596600 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-77b354dc-883d-4b8a-a5ea-a96417790923 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:43.193100 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-ffb79107-a579-40bd-91ff-2b80d2972153 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:43.193911 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-ffb79107-a579-40bd-91ff-2b80d2972153 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 01e250ab-d9aa-4708-ae36-10c53a411a40] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:43.216506 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ffb79107-a579-40bd-91ff-2b80d2972153 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:43.217008 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ffb79107-a579-40bd-91ff-2b80d2972153 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:43.220057 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ffb79107-a579-40bd-91ff-2b80d2972153 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:43.222557 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ffb79107-a579-40bd-91ff-2b80d2972153 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:43.224670 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ffb79107-a579-40bd-91ff-2b80d2972153 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:43.225309 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ffb79107-a579-40bd-91ff-2b80d2972153 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:44.004898 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-ffb79107-a579-40bd-91ff-2b80d2972153 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f63f1ac147543dab34a28a22eb5936c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1607b30b9f324abaa88aa29e04ef3ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:44.031404 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-ffb79107-a579-40bd-91ff-2b80d2972153 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40" status: 200 len: 1316 microversion: 2.1 time: 0.852246 Oct 04 18:53:44.051683 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2470/4639] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:43 2022] GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40 => generated 1316 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:44.312278 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-77b354dc-883d-4b8a-a5ea-a96417790923 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9b75d37d8b4f49b49af5808e0c3c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beaa0e0951d549ecafdc1f15417d831e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:44.346027 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-77b354dc-883d-4b8a-a5ea-a96417790923 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] 10.222.0.43 "GET /compute/v2.1/servers/a902c989-c015-4faf-848b-82cd682fa33f" status: 200 len: 1505 microversion: 2.1 time: 1.784498 Oct 04 18:53:44.346757 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2170/4640] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:42 2022] GET /compute/v2.1/servers/a902c989-c015-4faf-848b-82cd682fa33f => generated 1505 bytes in 1793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:45.062742 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-563014cc-086e-4c07-bf05-d2522b7dabfe tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:45.064078 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-563014cc-086e-4c07-bf05-d2522b7dabfe tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 01e250ab-d9aa-4708-ae36-10c53a411a40] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:45.081388 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-563014cc-086e-4c07-bf05-d2522b7dabfe tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:45.115158 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-563014cc-086e-4c07-bf05-d2522b7dabfe tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.031s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:45.117409 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-563014cc-086e-4c07-bf05-d2522b7dabfe tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:45.121911 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-563014cc-086e-4c07-bf05-d2522b7dabfe tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:45.124908 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-563014cc-086e-4c07-bf05-d2522b7dabfe tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:45.125853 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-563014cc-086e-4c07-bf05-d2522b7dabfe tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:45.374216 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-c166b480-a61c-4d6b-9f39-bfcf78fff52a tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:45.375315 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-c166b480-a61c-4d6b-9f39-bfcf78fff52a tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] [instance: a902c989-c015-4faf-848b-82cd682fa33f] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:45.391278 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c166b480-a61c-4d6b-9f39-bfcf78fff52a tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:45.392575 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c166b480-a61c-4d6b-9f39-bfcf78fff52a tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:45.393287 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c166b480-a61c-4d6b-9f39-bfcf78fff52a tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:45.403264 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c166b480-a61c-4d6b-9f39-bfcf78fff52a tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:45.405452 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c166b480-a61c-4d6b-9f39-bfcf78fff52a tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:45.406155 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c166b480-a61c-4d6b-9f39-bfcf78fff52a tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:45.458404 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:53:45.702941 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-563014cc-086e-4c07-bf05-d2522b7dabfe tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f63f1ac147543dab34a28a22eb5936c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1607b30b9f324abaa88aa29e04ef3ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:45.714542 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-563014cc-086e-4c07-bf05-d2522b7dabfe tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40" status: 200 len: 1505 microversion: 2.1 time: 0.656754 Oct 04 18:53:45.728432 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2471/4641] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:45 2022] GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40 => generated 1505 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:45.948802 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-942c9b47-4e84-49c1-9734-6c3790a2bce5 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-36849430", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452", "networks": [{"uuid": "66b6832b-a1b2-4da9-addc-63f223a4cc5a"}]}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:53:46.099617 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.network.neutron [None req-942c9b47-4e84-49c1-9734-6c3790a2bce5 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] validate_networks() for [('66b6832b-a1b2-4da9-addc-63f223a4cc5a', None, None, None, None, None)] {{(pid=123596) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:53:46.280238 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-c166b480-a61c-4d6b-9f39-bfcf78fff52a tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9b75d37d8b4f49b49af5808e0c3c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beaa0e0951d549ecafdc1f15417d831e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:46.289191 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-c166b480-a61c-4d6b-9f39-bfcf78fff52a tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] 10.222.0.43 "GET /compute/v2.1/servers/a902c989-c015-4faf-848b-82cd682fa33f" status: 200 len: 1505 microversion: 2.1 time: 0.922709 Oct 04 18:53:46.293734 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2171/4642] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:45 2022] GET /compute/v2.1/servers/a902c989-c015-4faf-848b-82cd682fa33f => generated 1505 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:47.126061 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-3fed3457-ddfc-4a7a-8b02-9d027128f92c tempest-FloatingIPDetailsTestJSON-1784753732 tempest-FloatingIPDetailsTestJSON-1784753732-project] Action: 'create', calling method: .version_select at 0x7fb21fc5e9d0>, body: {"pool": null} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:53:48.669685 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-942c9b47-4e84-49c1-9734-6c3790a2bce5 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Flavor limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:53:48.670152 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-942c9b47-4e84-49c1-9734-6c3790a2bce5 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Image limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:53:48.670876 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-942c9b47-4e84-49c1-9734-6c3790a2bce5 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Flavor pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:53:48.671700 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-942c9b47-4e84-49c1-9734-6c3790a2bce5 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Image pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:53:48.674538 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-942c9b47-4e84-49c1-9734-6c3790a2bce5 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:53:48.692075 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-942c9b47-4e84-49c1-9734-6c3790a2bce5 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:48.692786 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-942c9b47-4e84-49c1-9734-6c3790a2bce5 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:48.694984 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-942c9b47-4e84-49c1-9734-6c3790a2bce5 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:48.696430 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-942c9b47-4e84-49c1-9734-6c3790a2bce5 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:48.698115 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-942c9b47-4e84-49c1-9734-6c3790a2bce5 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:48.700724 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-942c9b47-4e84-49c1-9734-6c3790a2bce5 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:48.724395 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=90 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:53:48.753852 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-942c9b47-4e84-49c1-9734-6c3790a2bce5 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Getting quotas for project 1607b30b9f324abaa88aa29e04ef3ec4. Resources: {'ram', 'cores', 'instances'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:53:48.764191 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-942c9b47-4e84-49c1-9734-6c3790a2bce5 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Getting quotas for user 6f63f1ac147543dab34a28a22eb5936c and project 1607b30b9f324abaa88aa29e04ef3ec4. Resources: {'ram', 'cores', 'instances'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:53:48.780904 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-942c9b47-4e84-49c1-9734-6c3790a2bce5 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Going to run 1 instances... {{(pid=123596) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:53:48.784266 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-942c9b47-4e84-49c1-9734-6c3790a2bce5 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 2a0f8968-daa5-4998-9e3e-4f94d6471b1f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e8943ec5-4038-4d4b-b9b9-2415a79f5243',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123596) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:53:48.918269 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-942c9b47-4e84-49c1-9734-6c3790a2bce5 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.974664 Oct 04 18:53:48.919896 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2472/4643] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 18:53:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 2977 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 18:53:48.941531 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-dec0984b-08e3-4134-b493-84c45dfc1d1c tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:48.946354 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-dec0984b-08e3-4134-b493-84c45dfc1d1c tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] [instance: a902c989-c015-4faf-848b-82cd682fa33f] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:48.992311 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dec0984b-08e3-4134-b493-84c45dfc1d1c tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:48.992311 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dec0984b-08e3-4134-b493-84c45dfc1d1c tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:48.992311 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dec0984b-08e3-4134-b493-84c45dfc1d1c tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:48.992311 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dec0984b-08e3-4134-b493-84c45dfc1d1c tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:49.004727 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dec0984b-08e3-4134-b493-84c45dfc1d1c tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:49.005676 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dec0984b-08e3-4134-b493-84c45dfc1d1c tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:50.136092 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-dec0984b-08e3-4134-b493-84c45dfc1d1c tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9b75d37d8b4f49b49af5808e0c3c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beaa0e0951d549ecafdc1f15417d831e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:50.151249 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-dec0984b-08e3-4134-b493-84c45dfc1d1c tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] 10.222.0.43 "GET /compute/v2.1/servers/a902c989-c015-4faf-848b-82cd682fa33f" status: 200 len: 1505 microversion: 2.1 time: 1.225398 Oct 04 18:53:50.158647 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2473/4644] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:48 2022] GET /compute/v2.1/servers/a902c989-c015-4faf-848b-82cd682fa33f => generated 1505 bytes in 1231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:50.187479 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-4b61eef4-c04d-442f-8273-cb1c4620cde0 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:50.188098 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-4b61eef4-c04d-442f-8273-cb1c4620cde0 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 2a0f8968-daa5-4998-9e3e-4f94d6471b1f] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:50.251491 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4b61eef4-c04d-442f-8273-cb1c4620cde0 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:50.252902 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4b61eef4-c04d-442f-8273-cb1c4620cde0 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:50.254072 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4b61eef4-c04d-442f-8273-cb1c4620cde0 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:50.255323 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4b61eef4-c04d-442f-8273-cb1c4620cde0 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:50.256879 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4b61eef4-c04d-442f-8273-cb1c4620cde0 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:50.259239 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4b61eef4-c04d-442f-8273-cb1c4620cde0 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:50.686958 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-4b61eef4-c04d-442f-8273-cb1c4620cde0 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f63f1ac147543dab34a28a22eb5936c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1607b30b9f324abaa88aa29e04ef3ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:50.718044 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-4b61eef4-c04d-442f-8273-cb1c4620cde0 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "GET /compute/v2.1/servers/2a0f8968-daa5-4998-9e3e-4f94d6471b1f" status: 200 len: 1219 microversion: 2.1 time: 0.563564 Oct 04 18:53:50.719068 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2474/4645] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:50 2022] GET /compute/v2.1/servers/2a0f8968-daa5-4998-9e3e-4f94d6471b1f => generated 1219 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:50.833041 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-3fed3457-ddfc-4a7a-8b02-9d027128f92c tempest-FloatingIPDetailsTestJSON-1784753732 tempest-FloatingIPDetailsTestJSON-1784753732-project] 10.222.0.43 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.040391 Oct 04 18:53:50.847852 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2172/4646] 10.222.0.43 () {60 vars in 1170 bytes} [Tue Oct 4 18:53:46 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4056 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:53:50.849373 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-6c6a648e-dd95-4860-be18-8b569b678d2e tempest-FloatingIPDetailsTestJSON-1784753732 tempest-FloatingIPDetailsTestJSON-1784753732-project] Action: 'create', calling method: .version_select at 0x7fb21ecfcd30>, body: {"pool": null} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:53:51.175843 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-a9f56804-f40e-414d-8eee-f064576f6035 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:51.176464 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-a9f56804-f40e-414d-8eee-f064576f6035 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] [instance: a902c989-c015-4faf-848b-82cd682fa33f] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:51.194398 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_api:SELECT=38 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:53:51.204663 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a9f56804-f40e-414d-8eee-f064576f6035 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:51.205382 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a9f56804-f40e-414d-8eee-f064576f6035 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:51.205979 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a9f56804-f40e-414d-8eee-f064576f6035 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:51.206872 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a9f56804-f40e-414d-8eee-f064576f6035 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:51.207483 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a9f56804-f40e-414d-8eee-f064576f6035 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:51.208087 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a9f56804-f40e-414d-8eee-f064576f6035 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:51.590721 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-a9f56804-f40e-414d-8eee-f064576f6035 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9b75d37d8b4f49b49af5808e0c3c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beaa0e0951d549ecafdc1f15417d831e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:51.604413 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-a9f56804-f40e-414d-8eee-f064576f6035 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] 10.222.0.43 "GET /compute/v2.1/servers/a902c989-c015-4faf-848b-82cd682fa33f" status: 200 len: 1505 microversion: 2.1 time: 0.432381 Oct 04 18:53:51.607751 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2173/4647] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:51 2022] GET /compute/v2.1/servers/a902c989-c015-4faf-848b-82cd682fa33f => generated 1505 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:51.745860 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-6deaa340-7ed2-440e-8bb1-a62e3324b5b5 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:51.746716 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-6deaa340-7ed2-440e-8bb1-a62e3324b5b5 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 2a0f8968-daa5-4998-9e3e-4f94d6471b1f] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:51.757373 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6deaa340-7ed2-440e-8bb1-a62e3324b5b5 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:51.757869 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6deaa340-7ed2-440e-8bb1-a62e3324b5b5 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:51.762007 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6deaa340-7ed2-440e-8bb1-a62e3324b5b5 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:51.762966 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6deaa340-7ed2-440e-8bb1-a62e3324b5b5 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:51.763653 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6deaa340-7ed2-440e-8bb1-a62e3324b5b5 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:51.765255 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6deaa340-7ed2-440e-8bb1-a62e3324b5b5 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:51.928707 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-6deaa340-7ed2-440e-8bb1-a62e3324b5b5 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f63f1ac147543dab34a28a22eb5936c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1607b30b9f324abaa88aa29e04ef3ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:51.940971 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-6deaa340-7ed2-440e-8bb1-a62e3324b5b5 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "GET /compute/v2.1/servers/2a0f8968-daa5-4998-9e3e-4f94d6471b1f" status: 200 len: 1273 microversion: 2.1 time: 0.200911 Oct 04 18:53:51.945202 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2174/4648] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:51 2022] GET /compute/v2.1/servers/2a0f8968-daa5-4998-9e3e-4f94d6471b1f => generated 1273 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:53:52.632661 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-fd788a20-e601-44de-8492-29e645e3f79e tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:52.633792 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-fd788a20-e601-44de-8492-29e645e3f79e tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] [instance: a902c989-c015-4faf-848b-82cd682fa33f] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:52.645835 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fd788a20-e601-44de-8492-29e645e3f79e tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:52.652102 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fd788a20-e601-44de-8492-29e645e3f79e tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:52.653654 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fd788a20-e601-44de-8492-29e645e3f79e tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:52.656135 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fd788a20-e601-44de-8492-29e645e3f79e tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:52.656834 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fd788a20-e601-44de-8492-29e645e3f79e tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:52.658774 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fd788a20-e601-44de-8492-29e645e3f79e tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:53.381901 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-fd788a20-e601-44de-8492-29e645e3f79e tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9b75d37d8b4f49b49af5808e0c3c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beaa0e0951d549ecafdc1f15417d831e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:53.390581 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-fd788a20-e601-44de-8492-29e645e3f79e tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] 10.222.0.43 "GET /compute/v2.1/servers/a902c989-c015-4faf-848b-82cd682fa33f" status: 200 len: 1505 microversion: 2.1 time: 0.762521 Oct 04 18:53:53.393999 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2175/4649] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:52 2022] GET /compute/v2.1/servers/a902c989-c015-4faf-848b-82cd682fa33f => generated 1505 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:53.406554 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-84f4fa4a-d6a7-4590-b112-583331a34e03 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:53.414910 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-84f4fa4a-d6a7-4590-b112-583331a34e03 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 2a0f8968-daa5-4998-9e3e-4f94d6471b1f] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:53.441440 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-84f4fa4a-d6a7-4590-b112-583331a34e03 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:53.442344 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-84f4fa4a-d6a7-4590-b112-583331a34e03 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:53.442900 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-84f4fa4a-d6a7-4590-b112-583331a34e03 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:53.443740 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-84f4fa4a-d6a7-4590-b112-583331a34e03 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:53.444322 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-84f4fa4a-d6a7-4590-b112-583331a34e03 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:53.444861 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-84f4fa4a-d6a7-4590-b112-583331a34e03 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:53.957862 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-84f4fa4a-d6a7-4590-b112-583331a34e03 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f63f1ac147543dab34a28a22eb5936c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1607b30b9f324abaa88aa29e04ef3ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:53.987545 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-84f4fa4a-d6a7-4590-b112-583331a34e03 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "GET /compute/v2.1/servers/2a0f8968-daa5-4998-9e3e-4f94d6471b1f" status: 200 len: 1315 microversion: 2.1 time: 0.587793 Oct 04 18:53:53.990988 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2176/4650] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:53 2022] GET /compute/v2.1/servers/2a0f8968-daa5-4998-9e3e-4f94d6471b1f => generated 1315 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:54.421075 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-0d773952-31b2-4c64-afc8-9230acf5ce18 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:54.424267 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-0d773952-31b2-4c64-afc8-9230acf5ce18 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] [instance: a902c989-c015-4faf-848b-82cd682fa33f] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:54.450977 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0d773952-31b2-4c64-afc8-9230acf5ce18 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:54.451744 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0d773952-31b2-4c64-afc8-9230acf5ce18 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:54.452541 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0d773952-31b2-4c64-afc8-9230acf5ce18 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:54.453689 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0d773952-31b2-4c64-afc8-9230acf5ce18 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:54.455043 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0d773952-31b2-4c64-afc8-9230acf5ce18 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:54.455664 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0d773952-31b2-4c64-afc8-9230acf5ce18 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:55.255853 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-6c6a648e-dd95-4860-be18-8b569b678d2e tempest-FloatingIPDetailsTestJSON-1784753732 tempest-FloatingIPDetailsTestJSON-1784753732-project] 10.222.0.43 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 4.412121 Oct 04 18:53:55.264018 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2475/4651] 10.222.0.43 () {60 vars in 1170 bytes} [Tue Oct 4 18:53:50 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 4416 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:53:55.282289 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-330aaa1a-e3e4-4534-97ac-a7cbb1d6452a tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:55.286287 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-330aaa1a-e3e4-4534-97ac-a7cbb1d6452a tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 2a0f8968-daa5-4998-9e3e-4f94d6471b1f] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:55.316944 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-330aaa1a-e3e4-4534-97ac-a7cbb1d6452a tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:55.318158 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-330aaa1a-e3e4-4534-97ac-a7cbb1d6452a tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:55.319376 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-330aaa1a-e3e4-4534-97ac-a7cbb1d6452a tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:55.320971 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-330aaa1a-e3e4-4534-97ac-a7cbb1d6452a tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:55.329068 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-330aaa1a-e3e4-4534-97ac-a7cbb1d6452a tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:55.332927 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-330aaa1a-e3e4-4534-97ac-a7cbb1d6452a tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:55.734770 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-0d773952-31b2-4c64-afc8-9230acf5ce18 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9b75d37d8b4f49b49af5808e0c3c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beaa0e0951d549ecafdc1f15417d831e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:55.746794 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-0d773952-31b2-4c64-afc8-9230acf5ce18 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] 10.222.0.43 "GET /compute/v2.1/servers/a902c989-c015-4faf-848b-82cd682fa33f" status: 200 len: 1505 microversion: 2.1 time: 1.331659 Oct 04 18:53:55.749439 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2177/4652] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:54 2022] GET /compute/v2.1/servers/a902c989-c015-4faf-848b-82cd682fa33f => generated 1505 bytes in 1334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:55.754799 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-1daab45f-8783-4a6d-b857-00c633bb1f6a tempest-FloatingIPDetailsTestJSON-1784753732 tempest-FloatingIPDetailsTestJSON-1784753732-project] Action: 'create', calling method: .version_select at 0x7fb21f785790>, body: {"pool": null} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:53:55.937187 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-330aaa1a-e3e4-4534-97ac-a7cbb1d6452a tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f63f1ac147543dab34a28a22eb5936c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1607b30b9f324abaa88aa29e04ef3ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:55.957678 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-330aaa1a-e3e4-4534-97ac-a7cbb1d6452a tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "GET /compute/v2.1/servers/2a0f8968-daa5-4998-9e3e-4f94d6471b1f" status: 200 len: 1315 microversion: 2.1 time: 0.695019 Oct 04 18:53:55.958670 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2476/4653] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:55 2022] GET /compute/v2.1/servers/2a0f8968-daa5-4998-9e3e-4f94d6471b1f => generated 1315 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:56.041272 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-983f9fb6-b8bf-4b5a-8335-c14e66ba20d4 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:56.042995 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-983f9fb6-b8bf-4b5a-8335-c14e66ba20d4 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] [instance: bc5eda7f-851f-44d8-af95-5e721dd6d52b] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:56.074431 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-983f9fb6-b8bf-4b5a-8335-c14e66ba20d4 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:56.075525 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-983f9fb6-b8bf-4b5a-8335-c14e66ba20d4 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:56.076151 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-983f9fb6-b8bf-4b5a-8335-c14e66ba20d4 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:56.076905 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-983f9fb6-b8bf-4b5a-8335-c14e66ba20d4 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:56.077403 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-983f9fb6-b8bf-4b5a-8335-c14e66ba20d4 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:56.082171 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-983f9fb6-b8bf-4b5a-8335-c14e66ba20d4 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:56.147512 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-983f9fb6-b8bf-4b5a-8335-c14e66ba20d4 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] 10.222.0.43 "GET /compute/v2.1/servers/bc5eda7f-851f-44d8-af95-5e721dd6d52b/ips" status: 200 len: 150 microversion: 2.1 time: 0.114073 Oct 04 18:53:56.158042 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2477/4654] 10.222.0.43 () {58 vars in 1248 bytes} [Tue Oct 4 18:53:56 2022] GET /compute/v2.1/servers/bc5eda7f-851f-44d8-af95-5e721dd6d52b/ips => generated 150 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:53:56.775736 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-2c93f93c-5391-4b90-b604-d5a3e18676f6 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:56.776384 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-2c93f93c-5391-4b90-b604-d5a3e18676f6 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] [instance: a902c989-c015-4faf-848b-82cd682fa33f] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:56.811707 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2c93f93c-5391-4b90-b604-d5a3e18676f6 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:56.813976 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2c93f93c-5391-4b90-b604-d5a3e18676f6 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:56.820868 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2c93f93c-5391-4b90-b604-d5a3e18676f6 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:56.822249 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2c93f93c-5391-4b90-b604-d5a3e18676f6 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:56.825709 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2c93f93c-5391-4b90-b604-d5a3e18676f6 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:56.827336 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2c93f93c-5391-4b90-b604-d5a3e18676f6 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:57.335683 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-2c93f93c-5391-4b90-b604-d5a3e18676f6 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9b75d37d8b4f49b49af5808e0c3c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beaa0e0951d549ecafdc1f15417d831e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:57.345246 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-2c93f93c-5391-4b90-b604-d5a3e18676f6 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] 10.222.0.43 "GET /compute/v2.1/servers/a902c989-c015-4faf-848b-82cd682fa33f" status: 200 len: 1505 microversion: 2.1 time: 0.575358 Oct 04 18:53:57.346538 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2478/4655] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:56 2022] GET /compute/v2.1/servers/a902c989-c015-4faf-848b-82cd682fa33f => generated 1505 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:57.365297 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-0cf51840-6025-4f1e-b3b6-058f50f28e89 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:57.368402 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-0cf51840-6025-4f1e-b3b6-058f50f28e89 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 2a0f8968-daa5-4998-9e3e-4f94d6471b1f] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:57.392801 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0cf51840-6025-4f1e-b3b6-058f50f28e89 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:57.394454 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0cf51840-6025-4f1e-b3b6-058f50f28e89 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:57.395924 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0cf51840-6025-4f1e-b3b6-058f50f28e89 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:57.397975 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0cf51840-6025-4f1e-b3b6-058f50f28e89 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:57.400211 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0cf51840-6025-4f1e-b3b6-058f50f28e89 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:57.404136 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0cf51840-6025-4f1e-b3b6-058f50f28e89 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:57.708665 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-0cf51840-6025-4f1e-b3b6-058f50f28e89 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f63f1ac147543dab34a28a22eb5936c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1607b30b9f324abaa88aa29e04ef3ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:57.719414 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-0cf51840-6025-4f1e-b3b6-058f50f28e89 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "GET /compute/v2.1/servers/2a0f8968-daa5-4998-9e3e-4f94d6471b1f" status: 200 len: 1315 microversion: 2.1 time: 0.370698 Oct 04 18:53:57.720237 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2479/4656] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:57 2022] GET /compute/v2.1/servers/2a0f8968-daa5-4998-9e3e-4f94d6471b1f => generated 1315 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:58.003250 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-caf15d59-0cfb-4f5b-b665-b9f6d655a1f2 req-89f5ac10-1361-450c-b6e4-629fecf42074 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a0f8968-daa5-4998-9e3e-4f94d6471b1f", "tag": "458f0db5-c725-4a1d-a45b-c106a109dfde"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:53:58.029086 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-caf15d59-0cfb-4f5b-b665-b9f6d655a1f2 req-89f5ac10-1361-450c-b6e4-629fecf42074 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:58.029614 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-caf15d59-0cfb-4f5b-b665-b9f6d655a1f2 req-89f5ac10-1361-450c-b6e4-629fecf42074 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:58.030059 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-caf15d59-0cfb-4f5b-b665-b9f6d655a1f2 req-89f5ac10-1361-450c-b6e4-629fecf42074 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:58.057694 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-caf15d59-0cfb-4f5b-b665-b9f6d655a1f2 req-89f5ac10-1361-450c-b6e4-629fecf42074 service nova] Creating event network-changed:458f0db5-c725-4a1d-a45b-c106a109dfde for instance 2a0f8968-daa5-4998-9e3e-4f94d6471b1f on n-h1-851028-13 Oct 04 18:53:58.070434 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-caf15d59-0cfb-4f5b-b665-b9f6d655a1f2 req-89f5ac10-1361-450c-b6e4-629fecf42074 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070117 Oct 04 18:53:58.071065 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2480/4657] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:53:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:53:58.373614 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-b68b2ece-28a7-48d3-bd4e-1d0726a03646 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:58.388647 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-b68b2ece-28a7-48d3-bd4e-1d0726a03646 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] [instance: a902c989-c015-4faf-848b-82cd682fa33f] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:58.424789 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b68b2ece-28a7-48d3-bd4e-1d0726a03646 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:58.428846 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b68b2ece-28a7-48d3-bd4e-1d0726a03646 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:58.433210 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b68b2ece-28a7-48d3-bd4e-1d0726a03646 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:58.439029 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b68b2ece-28a7-48d3-bd4e-1d0726a03646 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:58.443724 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b68b2ece-28a7-48d3-bd4e-1d0726a03646 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:58.446798 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b68b2ece-28a7-48d3-bd4e-1d0726a03646 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:58.724315 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=2 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:53:58.775003 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=6 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:53:59.321067 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-b68b2ece-28a7-48d3-bd4e-1d0726a03646 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9b75d37d8b4f49b49af5808e0c3c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beaa0e0951d549ecafdc1f15417d831e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:59.355148 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-b68b2ece-28a7-48d3-bd4e-1d0726a03646 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] 10.222.0.43 "GET /compute/v2.1/servers/a902c989-c015-4faf-848b-82cd682fa33f" status: 200 len: 1505 microversion: 2.1 time: 0.989696 Oct 04 18:53:59.369136 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2481/4658] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:58 2022] GET /compute/v2.1/servers/a902c989-c015-4faf-848b-82cd682fa33f => generated 1505 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:59.373633 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-d0615ce9-a5b9-4781-8896-f72e39923958 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:59.381898 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-d0615ce9-a5b9-4781-8896-f72e39923958 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 2a0f8968-daa5-4998-9e3e-4f94d6471b1f] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:59.402289 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d0615ce9-a5b9-4781-8896-f72e39923958 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:59.403269 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d0615ce9-a5b9-4781-8896-f72e39923958 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:59.404057 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d0615ce9-a5b9-4781-8896-f72e39923958 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:59.408049 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d0615ce9-a5b9-4781-8896-f72e39923958 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:59.414539 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d0615ce9-a5b9-4781-8896-f72e39923958 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:59.415550 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d0615ce9-a5b9-4781-8896-f72e39923958 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:00.294942 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-d0615ce9-a5b9-4781-8896-f72e39923958 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f63f1ac147543dab34a28a22eb5936c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1607b30b9f324abaa88aa29e04ef3ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:00.326241 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-d0615ce9-a5b9-4781-8896-f72e39923958 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "GET /compute/v2.1/servers/2a0f8968-daa5-4998-9e3e-4f94d6471b1f" status: 200 len: 1315 microversion: 2.1 time: 0.968003 Oct 04 18:54:00.329889 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2482/4659] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:59 2022] GET /compute/v2.1/servers/2a0f8968-daa5-4998-9e3e-4f94d6471b1f => generated 1315 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:00.339810 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-12a18b2a-4b46-4339-9e10-2e6688385433 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b58125c2-399b-4901-ab14-2b7cf4f8fae7"}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:54:00.344584 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-12a18b2a-4b46-4339-9e10-2e6688385433 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] [instance: bc5eda7f-851f-44d8-af95-5e721dd6d52b] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:00.366728 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-12a18b2a-4b46-4339-9e10-2e6688385433 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:00.367511 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-12a18b2a-4b46-4339-9e10-2e6688385433 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:00.369455 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-12a18b2a-4b46-4339-9e10-2e6688385433 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:00.370621 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-12a18b2a-4b46-4339-9e10-2e6688385433 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:00.371101 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-12a18b2a-4b46-4339-9e10-2e6688385433 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:00.371572 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-12a18b2a-4b46-4339-9e10-2e6688385433 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:01.014081 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-1daab45f-8783-4a6d-b857-00c633bb1f6a tempest-FloatingIPDetailsTestJSON-1784753732 tempest-FloatingIPDetailsTestJSON-1784753732-project] 10.222.0.43 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 5.262139 Oct 04 18:54:01.019167 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2178/4660] 10.222.0.43 () {60 vars in 1170 bytes} [Tue Oct 4 18:53:55 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 5269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:54:01.024715 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-267fd981-c891-48db-8fe1-5a3b9ecc0ee4 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:01.033591 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-267fd981-c891-48db-8fe1-5a3b9ecc0ee4 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] [instance: a902c989-c015-4faf-848b-82cd682fa33f] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:01.057735 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-12a18b2a-4b46-4339-9e10-2e6688385433 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] 10.222.0.43 "POST /compute/v2.1/servers/bc5eda7f-851f-44d8-af95-5e721dd6d52b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.722708 Oct 04 18:54:01.058786 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2483/4661] 10.222.0.43 () {60 vars in 1323 bytes} [Tue Oct 4 18:54:00 2022] POST /compute/v2.1/servers/bc5eda7f-851f-44d8-af95-5e721dd6d52b/os-volume_attachments => generated 194 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:54:01.059686 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-267fd981-c891-48db-8fe1-5a3b9ecc0ee4 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:01.062221 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-267fd981-c891-48db-8fe1-5a3b9ecc0ee4 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:01.062692 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-267fd981-c891-48db-8fe1-5a3b9ecc0ee4 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:01.063457 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-267fd981-c891-48db-8fe1-5a3b9ecc0ee4 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:01.063928 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-267fd981-c891-48db-8fe1-5a3b9ecc0ee4 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:01.064507 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-267fd981-c891-48db-8fe1-5a3b9ecc0ee4 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:01.069897 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-1e946d29-c860-4fd2-95d0-2aeddc87fb42 tempest-FloatingIPDetailsTestJSON-1784753732 tempest-FloatingIPDetailsTestJSON-1784753732-project] Action: 'create', calling method: .version_select at 0x7fb227e02e50>, body: {"pool": null} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:54:01.296552 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-267fd981-c891-48db-8fe1-5a3b9ecc0ee4 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9b75d37d8b4f49b49af5808e0c3c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beaa0e0951d549ecafdc1f15417d831e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:01.307765 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-267fd981-c891-48db-8fe1-5a3b9ecc0ee4 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] 10.222.0.43 "GET /compute/v2.1/servers/a902c989-c015-4faf-848b-82cd682fa33f" status: 200 len: 1505 microversion: 2.1 time: 0.287275 Oct 04 18:54:01.308357 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2179/4662] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:01 2022] GET /compute/v2.1/servers/a902c989-c015-4faf-848b-82cd682fa33f => generated 1505 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:01.351561 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-626c4be8-c151-4de2-a1bf-511eae33d73e tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:01.353997 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-626c4be8-c151-4de2-a1bf-511eae33d73e tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 2a0f8968-daa5-4998-9e3e-4f94d6471b1f] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:01.365347 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-626c4be8-c151-4de2-a1bf-511eae33d73e tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:01.371077 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-626c4be8-c151-4de2-a1bf-511eae33d73e tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:01.372517 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-626c4be8-c151-4de2-a1bf-511eae33d73e tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:01.373414 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-626c4be8-c151-4de2-a1bf-511eae33d73e tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:01.374226 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-626c4be8-c151-4de2-a1bf-511eae33d73e tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:01.374839 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-626c4be8-c151-4de2-a1bf-511eae33d73e tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:02.086797 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-626c4be8-c151-4de2-a1bf-511eae33d73e tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f63f1ac147543dab34a28a22eb5936c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1607b30b9f324abaa88aa29e04ef3ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:02.100295 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-626c4be8-c151-4de2-a1bf-511eae33d73e tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "GET /compute/v2.1/servers/2a0f8968-daa5-4998-9e3e-4f94d6471b1f" status: 200 len: 1315 microversion: 2.1 time: 0.752532 Oct 04 18:54:02.125348 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2180/4663] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:01 2022] GET /compute/v2.1/servers/2a0f8968-daa5-4998-9e3e-4f94d6471b1f => generated 1315 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:02.340586 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-f303b22a-a5c5-48ea-8a43-36e5c51e3993 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:02.341577 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-f303b22a-a5c5-48ea-8a43-36e5c51e3993 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] [instance: a902c989-c015-4faf-848b-82cd682fa33f] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:02.350827 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f303b22a-a5c5-48ea-8a43-36e5c51e3993 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:02.352069 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f303b22a-a5c5-48ea-8a43-36e5c51e3993 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:02.352910 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f303b22a-a5c5-48ea-8a43-36e5c51e3993 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:02.353882 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f303b22a-a5c5-48ea-8a43-36e5c51e3993 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:02.354797 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f303b22a-a5c5-48ea-8a43-36e5c51e3993 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:02.355417 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f303b22a-a5c5-48ea-8a43-36e5c51e3993 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:02.948765 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-f303b22a-a5c5-48ea-8a43-36e5c51e3993 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9b75d37d8b4f49b49af5808e0c3c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beaa0e0951d549ecafdc1f15417d831e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:02.964762 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-f303b22a-a5c5-48ea-8a43-36e5c51e3993 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] 10.222.0.43 "GET /compute/v2.1/servers/a902c989-c015-4faf-848b-82cd682fa33f" status: 200 len: 1505 microversion: 2.1 time: 0.631057 Oct 04 18:54:03.016680 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2181/4664] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:02 2022] GET /compute/v2.1/servers/a902c989-c015-4faf-848b-82cd682fa33f => generated 1505 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:03.139428 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-5100e225-bf2f-4484-9ff6-d3da3b82a5e8 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:03.143960 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-5100e225-bf2f-4484-9ff6-d3da3b82a5e8 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 2a0f8968-daa5-4998-9e3e-4f94d6471b1f] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:03.167549 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5100e225-bf2f-4484-9ff6-d3da3b82a5e8 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:03.169859 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5100e225-bf2f-4484-9ff6-d3da3b82a5e8 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:03.171760 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5100e225-bf2f-4484-9ff6-d3da3b82a5e8 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:03.173628 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5100e225-bf2f-4484-9ff6-d3da3b82a5e8 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:03.177605 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5100e225-bf2f-4484-9ff6-d3da3b82a5e8 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:03.181661 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5100e225-bf2f-4484-9ff6-d3da3b82a5e8 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:03.629193 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-5100e225-bf2f-4484-9ff6-d3da3b82a5e8 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f63f1ac147543dab34a28a22eb5936c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1607b30b9f324abaa88aa29e04ef3ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:03.651192 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-5100e225-bf2f-4484-9ff6-d3da3b82a5e8 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "GET /compute/v2.1/servers/2a0f8968-daa5-4998-9e3e-4f94d6471b1f" status: 200 len: 1315 microversion: 2.1 time: 0.507388 Oct 04 18:54:03.652611 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2182/4665] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:03 2022] GET /compute/v2.1/servers/2a0f8968-daa5-4998-9e3e-4f94d6471b1f => generated 1315 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:03.995791 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-a256ed8e-9b89-4872-a7ea-eabea28d1472 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:03.996796 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-a256ed8e-9b89-4872-a7ea-eabea28d1472 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] [instance: a902c989-c015-4faf-848b-82cd682fa33f] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:04.017648 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a256ed8e-9b89-4872-a7ea-eabea28d1472 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:04.024945 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a256ed8e-9b89-4872-a7ea-eabea28d1472 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:04.025751 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a256ed8e-9b89-4872-a7ea-eabea28d1472 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:04.027608 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a256ed8e-9b89-4872-a7ea-eabea28d1472 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:04.030683 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a256ed8e-9b89-4872-a7ea-eabea28d1472 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:04.032449 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a256ed8e-9b89-4872-a7ea-eabea28d1472 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:05.665490 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-a256ed8e-9b89-4872-a7ea-eabea28d1472 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9b75d37d8b4f49b49af5808e0c3c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beaa0e0951d549ecafdc1f15417d831e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:05.675796 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-a256ed8e-9b89-4872-a7ea-eabea28d1472 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] 10.222.0.43 "GET /compute/v2.1/servers/a902c989-c015-4faf-848b-82cd682fa33f" status: 200 len: 1505 microversion: 2.1 time: 1.685785 Oct 04 18:54:05.680254 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2183/4666] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:03 2022] GET /compute/v2.1/servers/a902c989-c015-4faf-848b-82cd682fa33f => generated 1505 bytes in 1691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:54:05.690692 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-87afa819-c577-432d-ba3f-b39db6bf80a5 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:05.691540 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-87afa819-c577-432d-ba3f-b39db6bf80a5 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 2a0f8968-daa5-4998-9e3e-4f94d6471b1f] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:05.710410 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-87afa819-c577-432d-ba3f-b39db6bf80a5 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:05.711243 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-87afa819-c577-432d-ba3f-b39db6bf80a5 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:05.711859 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-87afa819-c577-432d-ba3f-b39db6bf80a5 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:05.712756 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-87afa819-c577-432d-ba3f-b39db6bf80a5 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:05.713412 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-87afa819-c577-432d-ba3f-b39db6bf80a5 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:05.713999 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-87afa819-c577-432d-ba3f-b39db6bf80a5 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:05.925272 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-87afa819-c577-432d-ba3f-b39db6bf80a5 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f63f1ac147543dab34a28a22eb5936c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1607b30b9f324abaa88aa29e04ef3ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:05.933651 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-87afa819-c577-432d-ba3f-b39db6bf80a5 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "GET /compute/v2.1/servers/2a0f8968-daa5-4998-9e3e-4f94d6471b1f" status: 200 len: 1315 microversion: 2.1 time: 0.252189 Oct 04 18:54:05.935842 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2184/4667] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:05 2022] GET /compute/v2.1/servers/2a0f8968-daa5-4998-9e3e-4f94d6471b1f => generated 1315 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:06.221478 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-1e946d29-c860-4fd2-95d0-2aeddc87fb42 tempest-FloatingIPDetailsTestJSON-1784753732 tempest-FloatingIPDetailsTestJSON-1784753732-project] 10.222.0.43 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 5.158813 Oct 04 18:54:06.221478 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2484/4668] 10.222.0.43 () {60 vars in 1170 bytes} [Tue Oct 4 18:54:01 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 5161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:54:06.242806 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-c366eeac-9ec0-4516-9ae7-f93b7ec174c3 tempest-FloatingIPDetailsTestJSON-1784753732 tempest-FloatingIPDetailsTestJSON-1784753732-project] Calling method '.version_select at 0x7fb21f06a8b0>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:06.706440 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-9274b965-a6e6-4c10-8160-bde436540bf4 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:06.707322 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-9274b965-a6e6-4c10-8160-bde436540bf4 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] [instance: a902c989-c015-4faf-848b-82cd682fa33f] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:06.719547 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9274b965-a6e6-4c10-8160-bde436540bf4 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:06.721760 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9274b965-a6e6-4c10-8160-bde436540bf4 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:06.722318 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9274b965-a6e6-4c10-8160-bde436540bf4 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:06.724289 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9274b965-a6e6-4c10-8160-bde436540bf4 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:06.728546 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9274b965-a6e6-4c10-8160-bde436540bf4 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:06.730034 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9274b965-a6e6-4c10-8160-bde436540bf4 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:06.832900 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-c366eeac-9ec0-4516-9ae7-f93b7ec174c3 tempest-FloatingIPDetailsTestJSON-1784753732 tempest-FloatingIPDetailsTestJSON-1784753732-project] 10.222.0.43 "GET /compute/v2.1/os-floating-ips/332ffe06-05f2-4fce-a8ff-1963cb27eba1" status: 200 len: 142 microversion: 2.1 time: 0.601138 Oct 04 18:54:06.833894 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2185/4669] 10.222.0.43 () {58 vars in 1260 bytes} [Tue Oct 4 18:54:06 2022] GET /compute/v2.1/os-floating-ips/332ffe06-05f2-4fce-a8ff-1963cb27eba1 => generated 142 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:54:06.847419 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-af9817be-f478-4b45-8830-5b430b93eeb9 tempest-FloatingIPDetailsTestJSON-1784753732 tempest-FloatingIPDetailsTestJSON-1784753732-project] Calling method '.version_select at 0x7fb21fbee790>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:07.658325 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-9274b965-a6e6-4c10-8160-bde436540bf4 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9b75d37d8b4f49b49af5808e0c3c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beaa0e0951d549ecafdc1f15417d831e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:07.674324 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-9274b965-a6e6-4c10-8160-bde436540bf4 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] 10.222.0.43 "GET /compute/v2.1/servers/a902c989-c015-4faf-848b-82cd682fa33f" status: 200 len: 1485 microversion: 2.1 time: 0.974301 Oct 04 18:54:07.675250 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2485/4670] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:06 2022] GET /compute/v2.1/servers/a902c989-c015-4faf-848b-82cd682fa33f => generated 1485 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:07.686240 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-0bf421e9-444c-4ae1-92f6-51b3ea3e799a tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:07.686869 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-0bf421e9-444c-4ae1-92f6-51b3ea3e799a tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 2a0f8968-daa5-4998-9e3e-4f94d6471b1f] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:07.709539 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0bf421e9-444c-4ae1-92f6-51b3ea3e799a tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:07.710572 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0bf421e9-444c-4ae1-92f6-51b3ea3e799a tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:07.711209 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0bf421e9-444c-4ae1-92f6-51b3ea3e799a tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:07.712136 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0bf421e9-444c-4ae1-92f6-51b3ea3e799a tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:07.712756 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0bf421e9-444c-4ae1-92f6-51b3ea3e799a tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:07.713397 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0bf421e9-444c-4ae1-92f6-51b3ea3e799a tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:08.378332 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-af9817be-f478-4b45-8830-5b430b93eeb9 tempest-FloatingIPDetailsTestJSON-1784753732 tempest-FloatingIPDetailsTestJSON-1784753732-project] 10.222.0.43 "DELETE /compute/v2.1/os-floating-ips/332ffe06-05f2-4fce-a8ff-1963cb27eba1" status: 202 len: 0 microversion: 2.1 time: 1.535214 Oct 04 18:54:08.384332 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2186/4671] 10.222.0.43 () {58 vars in 1263 bytes} [Tue Oct 4 18:54:06 2022] DELETE /compute/v2.1/os-floating-ips/332ffe06-05f2-4fce-a8ff-1963cb27eba1 => generated 0 bytes in 1542 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:54:08.389878 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-7ff7f3bd-8011-4734-9094-d3e41883be7c tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:54:08.390429 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-7ff7f3bd-8011-4734-9094-d3e41883be7c tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] [instance: a902c989-c015-4faf-848b-82cd682fa33f] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:08.405846 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7ff7f3bd-8011-4734-9094-d3e41883be7c tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:08.406343 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7ff7f3bd-8011-4734-9094-d3e41883be7c tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:08.406787 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7ff7f3bd-8011-4734-9094-d3e41883be7c tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:08.407494 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7ff7f3bd-8011-4734-9094-d3e41883be7c tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:08.413878 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7ff7f3bd-8011-4734-9094-d3e41883be7c tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:08.414940 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7ff7f3bd-8011-4734-9094-d3e41883be7c tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:08.511670 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-0bf421e9-444c-4ae1-92f6-51b3ea3e799a tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f63f1ac147543dab34a28a22eb5936c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1607b30b9f324abaa88aa29e04ef3ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:08.529093 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-0bf421e9-444c-4ae1-92f6-51b3ea3e799a tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "GET /compute/v2.1/servers/2a0f8968-daa5-4998-9e3e-4f94d6471b1f" status: 200 len: 1315 microversion: 2.1 time: 0.851091 Oct 04 18:54:08.532901 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2486/4672] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:07 2022] GET /compute/v2.1/servers/2a0f8968-daa5-4998-9e3e-4f94d6471b1f => generated 1315 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:08.546415 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-68c69ac8-b382-42af-be21-e483ce3aac33 tempest-FloatingIPDetailsTestJSON-1784753732 tempest-FloatingIPDetailsTestJSON-1784753732-project] Calling method '.version_select at 0x7fb227e82700>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:08.569847 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-7ff7f3bd-8011-4734-9094-d3e41883be7c tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] 10.222.0.43 "POST /compute/v2.1/servers/a902c989-c015-4faf-848b-82cd682fa33f/action" status: 202 len: 0 microversion: 2.1 time: 0.182760 Oct 04 18:54:08.571170 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2187/4673] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 18:54:08 2022] POST /compute/v2.1/servers/a902c989-c015-4faf-848b-82cd682fa33f/action => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:54:08.594568 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-6883fec8-ed78-4bff-a51e-6d57102ff0c1 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:08.605617 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-6883fec8-ed78-4bff-a51e-6d57102ff0c1 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] [instance: a902c989-c015-4faf-848b-82cd682fa33f] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:08.644774 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6883fec8-ed78-4bff-a51e-6d57102ff0c1 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:08.659289 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6883fec8-ed78-4bff-a51e-6d57102ff0c1 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.028s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:08.660746 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6883fec8-ed78-4bff-a51e-6d57102ff0c1 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:08.666290 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6883fec8-ed78-4bff-a51e-6d57102ff0c1 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:08.667898 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6883fec8-ed78-4bff-a51e-6d57102ff0c1 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:08.668641 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6883fec8-ed78-4bff-a51e-6d57102ff0c1 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:09.306246 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-6883fec8-ed78-4bff-a51e-6d57102ff0c1 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9b75d37d8b4f49b49af5808e0c3c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beaa0e0951d549ecafdc1f15417d831e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:09.314956 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-6883fec8-ed78-4bff-a51e-6d57102ff0c1 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] 10.222.0.43 "GET /compute/v2.1/servers/a902c989-c015-4faf-848b-82cd682fa33f" status: 200 len: 1493 microversion: 2.1 time: 0.731026 Oct 04 18:54:09.319319 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2188/4674] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:08 2022] GET /compute/v2.1/servers/a902c989-c015-4faf-848b-82cd682fa33f => generated 1493 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:09.556651 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-77612aa6-8d56-4417-a83c-38a45e345c83 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:09.558106 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-77612aa6-8d56-4417-a83c-38a45e345c83 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 2a0f8968-daa5-4998-9e3e-4f94d6471b1f] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:09.567772 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-77612aa6-8d56-4417-a83c-38a45e345c83 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:09.576635 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-77612aa6-8d56-4417-a83c-38a45e345c83 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:09.578544 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-77612aa6-8d56-4417-a83c-38a45e345c83 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:09.580156 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-77612aa6-8d56-4417-a83c-38a45e345c83 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:09.585881 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-77612aa6-8d56-4417-a83c-38a45e345c83 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:09.586596 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-77612aa6-8d56-4417-a83c-38a45e345c83 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:10.110245 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-77612aa6-8d56-4417-a83c-38a45e345c83 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f63f1ac147543dab34a28a22eb5936c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1607b30b9f324abaa88aa29e04ef3ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:10.119330 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-77612aa6-8d56-4417-a83c-38a45e345c83 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "GET /compute/v2.1/servers/2a0f8968-daa5-4998-9e3e-4f94d6471b1f" status: 200 len: 1315 microversion: 2.1 time: 0.566691 Oct 04 18:54:10.124213 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2189/4675] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:09 2022] GET /compute/v2.1/servers/2a0f8968-daa5-4998-9e3e-4f94d6471b1f => generated 1315 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:54:10.135082 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-d8c4d009-4067-4d6b-8288-bf05887c52ea req-222a94a3-1bd4-4a31-845a-0b1a031db45d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a0f8968-daa5-4998-9e3e-4f94d6471b1f", "name": "network-vif-plugged", "status": "completed", "tag": "458f0db5-c725-4a1d-a45b-c106a109dfde"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:54:10.160153 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-d8c4d009-4067-4d6b-8288-bf05887c52ea req-222a94a3-1bd4-4a31-845a-0b1a031db45d service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:10.160891 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-d8c4d009-4067-4d6b-8288-bf05887c52ea req-222a94a3-1bd4-4a31-845a-0b1a031db45d service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:10.161552 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-d8c4d009-4067-4d6b-8288-bf05887c52ea req-222a94a3-1bd4-4a31-845a-0b1a031db45d service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:10.205028 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-d8c4d009-4067-4d6b-8288-bf05887c52ea req-222a94a3-1bd4-4a31-845a-0b1a031db45d service nova] Creating event network-vif-plugged:458f0db5-c725-4a1d-a45b-c106a109dfde for instance 2a0f8968-daa5-4998-9e3e-4f94d6471b1f on n-h1-851028-13 Oct 04 18:54:10.221539 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-d8c4d009-4067-4d6b-8288-bf05887c52ea req-222a94a3-1bd4-4a31-845a-0b1a031db45d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095414 Oct 04 18:54:10.226292 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2190/4676] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:54:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:54:10.347889 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-a296ed43-42fa-41e1-80e4-d257145998f4 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:10.349339 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-a296ed43-42fa-41e1-80e4-d257145998f4 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] [instance: a902c989-c015-4faf-848b-82cd682fa33f] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:10.360983 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a296ed43-42fa-41e1-80e4-d257145998f4 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:10.378235 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a296ed43-42fa-41e1-80e4-d257145998f4 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:10.379854 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a296ed43-42fa-41e1-80e4-d257145998f4 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:10.380854 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a296ed43-42fa-41e1-80e4-d257145998f4 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:10.381624 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a296ed43-42fa-41e1-80e4-d257145998f4 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:10.382275 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a296ed43-42fa-41e1-80e4-d257145998f4 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:10.501899 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-68c69ac8-b382-42af-be21-e483ce3aac33 tempest-FloatingIPDetailsTestJSON-1784753732 tempest-FloatingIPDetailsTestJSON-1784753732-project] 10.222.0.43 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 1.965107 Oct 04 18:54:10.502939 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2487/4677] 10.222.0.43 () {58 vars in 1164 bytes} [Tue Oct 4 18:54:08 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 1969 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:54:10.518395 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-03843e19-04aa-4346-aeab-eb353f3b5f35 tempest-FloatingIPDetailsTestJSON-1784753732 tempest-FloatingIPDetailsTestJSON-1784753732-project] Calling method '.version_select at 0x7fb21edefb80>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:10.829038 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-a296ed43-42fa-41e1-80e4-d257145998f4 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9b75d37d8b4f49b49af5808e0c3c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beaa0e0951d549ecafdc1f15417d831e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:10.835901 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:54:10.838341 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-a296ed43-42fa-41e1-80e4-d257145998f4 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] 10.222.0.43 "GET /compute/v2.1/servers/a902c989-c015-4faf-848b-82cd682fa33f" status: 200 len: 1493 microversion: 2.1 time: 0.495280 Oct 04 18:54:10.855146 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2191/4678] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:10 2022] GET /compute/v2.1/servers/a902c989-c015-4faf-848b-82cd682fa33f => generated 1493 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:11.150035 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-39e2d27b-9f75-42b5-97f6-f2046865244a tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:11.150664 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-39e2d27b-9f75-42b5-97f6-f2046865244a tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 2a0f8968-daa5-4998-9e3e-4f94d6471b1f] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:11.168194 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-39e2d27b-9f75-42b5-97f6-f2046865244a tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:11.168757 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-39e2d27b-9f75-42b5-97f6-f2046865244a tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:11.169608 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-39e2d27b-9f75-42b5-97f6-f2046865244a tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:11.170579 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-39e2d27b-9f75-42b5-97f6-f2046865244a tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:11.171882 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-39e2d27b-9f75-42b5-97f6-f2046865244a tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:11.172488 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-39e2d27b-9f75-42b5-97f6-f2046865244a tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:11.212452 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-03843e19-04aa-4346-aeab-eb353f3b5f35 tempest-FloatingIPDetailsTestJSON-1784753732 tempest-FloatingIPDetailsTestJSON-1784753732-project] 10.222.0.43 "GET /compute/v2.1/os-floating-ips" status: 200 len: 398 microversion: 2.1 time: 0.701070 Oct 04 18:54:11.214516 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2488/4679] 10.222.0.43 () {58 vars in 1149 bytes} [Tue Oct 4 18:54:10 2022] GET /compute/v2.1/os-floating-ips => generated 398 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:54:11.241467 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-5b599dd7-134b-47ce-b306-a840891e6684 tempest-FloatingIPDetailsTestJSON-1784753732 tempest-FloatingIPDetailsTestJSON-1784753732-project] Calling method '.version_select at 0x7fb21edef310>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:11.667148 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-39e2d27b-9f75-42b5-97f6-f2046865244a tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f63f1ac147543dab34a28a22eb5936c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1607b30b9f324abaa88aa29e04ef3ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:11.676983 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-39e2d27b-9f75-42b5-97f6-f2046865244a tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "GET /compute/v2.1/servers/2a0f8968-daa5-4998-9e3e-4f94d6471b1f" status: 200 len: 1315 microversion: 2.1 time: 0.530605 Oct 04 18:54:11.682676 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2192/4680] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:11 2022] GET /compute/v2.1/servers/2a0f8968-daa5-4998-9e3e-4f94d6471b1f => generated 1315 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:54:11.866019 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-c7755d4f-b9c4-461d-bffb-2d78c5378e56 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:11.867286 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-c7755d4f-b9c4-461d-bffb-2d78c5378e56 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] [instance: a902c989-c015-4faf-848b-82cd682fa33f] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:11.885751 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c7755d4f-b9c4-461d-bffb-2d78c5378e56 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:11.892287 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c7755d4f-b9c4-461d-bffb-2d78c5378e56 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:11.894947 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c7755d4f-b9c4-461d-bffb-2d78c5378e56 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:11.895920 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c7755d4f-b9c4-461d-bffb-2d78c5378e56 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:11.900337 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c7755d4f-b9c4-461d-bffb-2d78c5378e56 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:11.906559 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c7755d4f-b9c4-461d-bffb-2d78c5378e56 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:13.035188 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-c7755d4f-b9c4-461d-bffb-2d78c5378e56 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9b75d37d8b4f49b49af5808e0c3c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beaa0e0951d549ecafdc1f15417d831e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:13.049578 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-c7755d4f-b9c4-461d-bffb-2d78c5378e56 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] 10.222.0.43 "GET /compute/v2.1/servers/a902c989-c015-4faf-848b-82cd682fa33f" status: 200 len: 1499 microversion: 2.1 time: 1.187951 Oct 04 18:54:13.050984 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2193/4681] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:11 2022] GET /compute/v2.1/servers/a902c989-c015-4faf-848b-82cd682fa33f => generated 1499 bytes in 1191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:54:13.058558 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-8005be7f-2b05-4980-98d2-6bf96ef5ab1e tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:13.061871 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-8005be7f-2b05-4980-98d2-6bf96ef5ab1e tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 2a0f8968-daa5-4998-9e3e-4f94d6471b1f] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:13.087608 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8005be7f-2b05-4980-98d2-6bf96ef5ab1e tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:13.092889 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8005be7f-2b05-4980-98d2-6bf96ef5ab1e tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:13.096040 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8005be7f-2b05-4980-98d2-6bf96ef5ab1e tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:13.097321 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8005be7f-2b05-4980-98d2-6bf96ef5ab1e tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:13.101884 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8005be7f-2b05-4980-98d2-6bf96ef5ab1e tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:13.104585 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8005be7f-2b05-4980-98d2-6bf96ef5ab1e tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:13.488998 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-8005be7f-2b05-4980-98d2-6bf96ef5ab1e tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f63f1ac147543dab34a28a22eb5936c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1607b30b9f324abaa88aa29e04ef3ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:13.498208 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-8005be7f-2b05-4980-98d2-6bf96ef5ab1e tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "GET /compute/v2.1/servers/2a0f8968-daa5-4998-9e3e-4f94d6471b1f" status: 200 len: 1504 microversion: 2.1 time: 0.445930 Oct 04 18:54:13.502855 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2194/4682] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:13 2022] GET /compute/v2.1/servers/2a0f8968-daa5-4998-9e3e-4f94d6471b1f => generated 1504 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:13.511804 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-9e3de14a-6dd8-484d-81dd-214613a87561 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:13.515773 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-9e3de14a-6dd8-484d-81dd-214613a87561 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] [instance: a902c989-c015-4faf-848b-82cd682fa33f] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:13.525312 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9e3de14a-6dd8-484d-81dd-214613a87561 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:13.526118 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9e3de14a-6dd8-484d-81dd-214613a87561 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:13.526794 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9e3de14a-6dd8-484d-81dd-214613a87561 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:13.528263 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9e3de14a-6dd8-484d-81dd-214613a87561 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:13.529775 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9e3de14a-6dd8-484d-81dd-214613a87561 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:13.530770 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9e3de14a-6dd8-484d-81dd-214613a87561 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:13.599574 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-9e3de14a-6dd8-484d-81dd-214613a87561 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] [instance: a902c989-c015-4faf-848b-82cd682fa33f] Going to try to terminate instance {{(pid=123595) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:54:13.824507 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-9e3de14a-6dd8-484d-81dd-214613a87561 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] 10.222.0.43 "DELETE /compute/v2.1/servers/a902c989-c015-4faf-848b-82cd682fa33f" status: 204 len: 0 microversion: 2.1 time: 0.318197 Oct 04 18:54:13.829651 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2195/4683] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 18:54:13 2022] DELETE /compute/v2.1/servers/a902c989-c015-4faf-848b-82cd682fa33f => generated 0 bytes in 326 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:54:13.854452 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-bbfb995f-933f-4ec8-ba4b-67be1d00e73f tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:13.857508 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-bbfb995f-933f-4ec8-ba4b-67be1d00e73f tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 2a0f8968-daa5-4998-9e3e-4f94d6471b1f] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:13.870772 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bbfb995f-933f-4ec8-ba4b-67be1d00e73f tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:13.871755 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bbfb995f-933f-4ec8-ba4b-67be1d00e73f tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:13.872967 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bbfb995f-933f-4ec8-ba4b-67be1d00e73f tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:13.873948 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bbfb995f-933f-4ec8-ba4b-67be1d00e73f tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:13.875724 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bbfb995f-933f-4ec8-ba4b-67be1d00e73f tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:13.876743 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bbfb995f-933f-4ec8-ba4b-67be1d00e73f tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:13.963324 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-bbfb995f-933f-4ec8-ba4b-67be1d00e73f tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 2a0f8968-daa5-4998-9e3e-4f94d6471b1f] Going to try to terminate instance {{(pid=123595) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:54:14.151422 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-bbfb995f-933f-4ec8-ba4b-67be1d00e73f tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "DELETE /compute/v2.1/servers/2a0f8968-daa5-4998-9e3e-4f94d6471b1f" status: 204 len: 0 microversion: 2.1 time: 0.319663 Oct 04 18:54:14.155377 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2196/4684] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 18:54:13 2022] DELETE /compute/v2.1/servers/2a0f8968-daa5-4998-9e3e-4f94d6471b1f => generated 0 bytes in 322 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:54:14.162600 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-0e7ecdf8-9acd-4067-8e20-03d92607044f tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:14.163347 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-0e7ecdf8-9acd-4067-8e20-03d92607044f tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] [instance: a902c989-c015-4faf-848b-82cd682fa33f] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:14.177861 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-5b599dd7-134b-47ce-b306-a840891e6684 tempest-FloatingIPDetailsTestJSON-1784753732 tempest-FloatingIPDetailsTestJSON-1784753732-project] 10.222.0.43 "DELETE /compute/v2.1/os-floating-ips/6f61a8c5-5cf7-499a-ae3c-22156c87080d" status: 202 len: 0 microversion: 2.1 time: 2.949176 Oct 04 18:54:14.182980 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2489/4685] 10.222.0.43 () {58 vars in 1263 bytes} [Tue Oct 4 18:54:11 2022] DELETE /compute/v2.1/os-floating-ips/6f61a8c5-5cf7-499a-ae3c-22156c87080d => generated 0 bytes in 2955 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:54:14.189587 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-c594fc1d-7442-41cf-b20b-af5d20d50608 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:14.191913 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-c594fc1d-7442-41cf-b20b-af5d20d50608 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 2a0f8968-daa5-4998-9e3e-4f94d6471b1f] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:14.193499 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0e7ecdf8-9acd-4067-8e20-03d92607044f tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:14.195653 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:54:14.201908 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0e7ecdf8-9acd-4067-8e20-03d92607044f tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:14.203243 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0e7ecdf8-9acd-4067-8e20-03d92607044f tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:14.204175 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0e7ecdf8-9acd-4067-8e20-03d92607044f tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:14.206461 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0e7ecdf8-9acd-4067-8e20-03d92607044f tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:14.207071 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0e7ecdf8-9acd-4067-8e20-03d92607044f tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:14.228838 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c594fc1d-7442-41cf-b20b-af5d20d50608 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:14.229511 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c594fc1d-7442-41cf-b20b-af5d20d50608 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:14.229945 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c594fc1d-7442-41cf-b20b-af5d20d50608 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:14.231707 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c594fc1d-7442-41cf-b20b-af5d20d50608 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:14.232179 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c594fc1d-7442-41cf-b20b-af5d20d50608 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:14.232619 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c594fc1d-7442-41cf-b20b-af5d20d50608 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:14.547999 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-0e7ecdf8-9acd-4067-8e20-03d92607044f tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9b75d37d8b4f49b49af5808e0c3c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beaa0e0951d549ecafdc1f15417d831e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:14.556608 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-0e7ecdf8-9acd-4067-8e20-03d92607044f tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] 10.222.0.43 "GET /compute/v2.1/servers/a902c989-c015-4faf-848b-82cd682fa33f" status: 200 len: 1505 microversion: 2.1 time: 0.399818 Oct 04 18:54:14.559519 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2197/4686] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:14 2022] GET /compute/v2.1/servers/a902c989-c015-4faf-848b-82cd682fa33f => generated 1505 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:14.566088 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-981fed36-c8f7-46b4-b9b2-ee9b1ac0af7d tempest-FloatingIPDetailsTestJSON-1784753732 tempest-FloatingIPDetailsTestJSON-1784753732-project] Calling method '.version_select at 0x7fb21fc4f5e0>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:14.754538 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-c594fc1d-7442-41cf-b20b-af5d20d50608 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f63f1ac147543dab34a28a22eb5936c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1607b30b9f324abaa88aa29e04ef3ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:14.779929 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-c594fc1d-7442-41cf-b20b-af5d20d50608 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "GET /compute/v2.1/servers/2a0f8968-daa5-4998-9e3e-4f94d6471b1f" status: 200 len: 1510 microversion: 2.1 time: 0.595590 Oct 04 18:54:14.784003 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2490/4687] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:14 2022] GET /compute/v2.1/servers/2a0f8968-daa5-4998-9e3e-4f94d6471b1f => generated 1510 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:15.589870 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f9739b56-3359-4ae7-b464-145a0f94cd6d tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:15.592277 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-f9739b56-3359-4ae7-b464-145a0f94cd6d tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] [instance: a902c989-c015-4faf-848b-82cd682fa33f] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:15.609864 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f9739b56-3359-4ae7-b464-145a0f94cd6d tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:15.625609 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f9739b56-3359-4ae7-b464-145a0f94cd6d tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:15.626344 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f9739b56-3359-4ae7-b464-145a0f94cd6d tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:15.627414 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f9739b56-3359-4ae7-b464-145a0f94cd6d tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:15.638081 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f9739b56-3359-4ae7-b464-145a0f94cd6d tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:15.638881 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f9739b56-3359-4ae7-b464-145a0f94cd6d tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:16.000935 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-f9739b56-3359-4ae7-b464-145a0f94cd6d tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9b75d37d8b4f49b49af5808e0c3c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beaa0e0951d549ecafdc1f15417d831e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:16.036300 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-f9739b56-3359-4ae7-b464-145a0f94cd6d tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] 10.222.0.43 "GET /compute/v2.1/servers/a902c989-c015-4faf-848b-82cd682fa33f" status: 200 len: 1505 microversion: 2.1 time: 0.440051 Oct 04 18:54:16.051922 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2491/4688] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:15 2022] GET /compute/v2.1/servers/a902c989-c015-4faf-848b-82cd682fa33f => generated 1505 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:16.060579 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-6d3f392b-9655-4c72-97d3-3925f966fa37 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:16.067751 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-6d3f392b-9655-4c72-97d3-3925f966fa37 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 2a0f8968-daa5-4998-9e3e-4f94d6471b1f] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:16.091324 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6d3f392b-9655-4c72-97d3-3925f966fa37 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:16.091829 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6d3f392b-9655-4c72-97d3-3925f966fa37 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:16.092274 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6d3f392b-9655-4c72-97d3-3925f966fa37 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:16.117388 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6d3f392b-9655-4c72-97d3-3925f966fa37 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:16.118041 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6d3f392b-9655-4c72-97d3-3925f966fa37 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:16.118506 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6d3f392b-9655-4c72-97d3-3925f966fa37 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:17.099314 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-981fed36-c8f7-46b4-b9b2-ee9b1ac0af7d tempest-FloatingIPDetailsTestJSON-1784753732 tempest-FloatingIPDetailsTestJSON-1784753732-project] 10.222.0.43 "DELETE /compute/v2.1/os-floating-ips/44fc730a-1818-4f24-bb1c-570bf8e0ba94" status: 202 len: 0 microversion: 2.1 time: 2.536791 Oct 04 18:54:17.099916 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2198/4689] 10.222.0.43 () {58 vars in 1263 bytes} [Tue Oct 4 18:54:14 2022] DELETE /compute/v2.1/os-floating-ips/44fc730a-1818-4f24-bb1c-570bf8e0ba94 => generated 0 bytes in 2538 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:54:17.107932 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-e68b0f5b-9364-4570-b8be-8ba4ec4ab62a tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:17.110010 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-e68b0f5b-9364-4570-b8be-8ba4ec4ab62a tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] [instance: a902c989-c015-4faf-848b-82cd682fa33f] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:17.133294 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e68b0f5b-9364-4570-b8be-8ba4ec4ab62a tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:17.134080 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e68b0f5b-9364-4570-b8be-8ba4ec4ab62a tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:17.136748 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e68b0f5b-9364-4570-b8be-8ba4ec4ab62a tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:17.137703 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e68b0f5b-9364-4570-b8be-8ba4ec4ab62a tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:17.138382 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e68b0f5b-9364-4570-b8be-8ba4ec4ab62a tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:17.139431 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e68b0f5b-9364-4570-b8be-8ba4ec4ab62a tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:17.419787 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-6d3f392b-9655-4c72-97d3-3925f966fa37 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f63f1ac147543dab34a28a22eb5936c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1607b30b9f324abaa88aa29e04ef3ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:17.440012 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-6d3f392b-9655-4c72-97d3-3925f966fa37 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "GET /compute/v2.1/servers/2a0f8968-daa5-4998-9e3e-4f94d6471b1f" status: 200 len: 1510 microversion: 2.1 time: 1.386571 Oct 04 18:54:17.440937 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2492/4690] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:16 2022] GET /compute/v2.1/servers/2a0f8968-daa5-4998-9e3e-4f94d6471b1f => generated 1510 bytes in 1388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:17.453097 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-478bf24d-fed7-4fab-bb1e-52ed62352adf tempest-FloatingIPDetailsTestJSON-1784753732 tempest-FloatingIPDetailsTestJSON-1784753732-project] Calling method '.version_select at 0x7fb21f222ee0>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:17.607230 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-e68b0f5b-9364-4570-b8be-8ba4ec4ab62a tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9b75d37d8b4f49b49af5808e0c3c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beaa0e0951d549ecafdc1f15417d831e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:17.625739 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-e68b0f5b-9364-4570-b8be-8ba4ec4ab62a tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] 10.222.0.43 "GET /compute/v2.1/servers/a902c989-c015-4faf-848b-82cd682fa33f" status: 200 len: 1505 microversion: 2.1 time: 0.519873 Oct 04 18:54:17.626695 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2199/4691] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:17 2022] GET /compute/v2.1/servers/a902c989-c015-4faf-848b-82cd682fa33f => generated 1505 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:18.471366 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-18b96a86-00eb-46bf-833a-ae8159b288a4 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:18.472078 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-18b96a86-00eb-46bf-833a-ae8159b288a4 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 2a0f8968-daa5-4998-9e3e-4f94d6471b1f] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:18.493639 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-18b96a86-00eb-46bf-833a-ae8159b288a4 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:18.494284 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-18b96a86-00eb-46bf-833a-ae8159b288a4 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:18.494752 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-18b96a86-00eb-46bf-833a-ae8159b288a4 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:18.495512 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-18b96a86-00eb-46bf-833a-ae8159b288a4 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:18.498638 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-18b96a86-00eb-46bf-833a-ae8159b288a4 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:18.499296 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-18b96a86-00eb-46bf-833a-ae8159b288a4 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:20.059133 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-18b96a86-00eb-46bf-833a-ae8159b288a4 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f63f1ac147543dab34a28a22eb5936c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1607b30b9f324abaa88aa29e04ef3ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:20.073344 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-18b96a86-00eb-46bf-833a-ae8159b288a4 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "GET /compute/v2.1/servers/2a0f8968-daa5-4998-9e3e-4f94d6471b1f" status: 200 len: 1510 microversion: 2.1 time: 1.605522 Oct 04 18:54:20.076800 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2200/4692] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:18 2022] GET /compute/v2.1/servers/2a0f8968-daa5-4998-9e3e-4f94d6471b1f => generated 1510 bytes in 1614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:54:20.088657 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-78689068-32d4-4ced-89b8-6a1d36744f39 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:20.090431 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-78689068-32d4-4ced-89b8-6a1d36744f39 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] [instance: a902c989-c015-4faf-848b-82cd682fa33f] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:20.108083 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-78689068-32d4-4ced-89b8-6a1d36744f39 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:20.108885 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-78689068-32d4-4ced-89b8-6a1d36744f39 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:20.109547 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-78689068-32d4-4ced-89b8-6a1d36744f39 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:20.110849 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-78689068-32d4-4ced-89b8-6a1d36744f39 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:20.111715 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-78689068-32d4-4ced-89b8-6a1d36744f39 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:20.112340 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-78689068-32d4-4ced-89b8-6a1d36744f39 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:20.300362 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-478bf24d-fed7-4fab-bb1e-52ed62352adf tempest-FloatingIPDetailsTestJSON-1784753732 tempest-FloatingIPDetailsTestJSON-1784753732-project] 10.222.0.43 "DELETE /compute/v2.1/os-floating-ips/a962be96-f38c-4ae2-b9cf-c84c323c7914" status: 202 len: 0 microversion: 2.1 time: 2.858038 Oct 04 18:54:20.302180 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2493/4693] 10.222.0.43 () {58 vars in 1263 bytes} [Tue Oct 4 18:54:17 2022] DELETE /compute/v2.1/os-floating-ips/a962be96-f38c-4ae2-b9cf-c84c323c7914 => generated 0 bytes in 2861 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:54:20.324789 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-1e3cc65a-d79f-4360-b758-c3f39276d5eb req-244d2512-40a1-4269-98bf-cb5d0809763c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a902c989-c015-4faf-848b-82cd682fa33f", "name": "network-vif-deleted", "tag": "10859e33-5c25-41b2-b965-e0a7b88aaa75"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:54:20.360887 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-1e3cc65a-d79f-4360-b758-c3f39276d5eb req-244d2512-40a1-4269-98bf-cb5d0809763c service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:20.363574 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-1e3cc65a-d79f-4360-b758-c3f39276d5eb req-244d2512-40a1-4269-98bf-cb5d0809763c service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:20.365508 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-1e3cc65a-d79f-4360-b758-c3f39276d5eb req-244d2512-40a1-4269-98bf-cb5d0809763c service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:20.379622 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:54:20.419267 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-1e3cc65a-d79f-4360-b758-c3f39276d5eb req-244d2512-40a1-4269-98bf-cb5d0809763c service nova] Creating event network-vif-deleted:10859e33-5c25-41b2-b965-e0a7b88aaa75 for instance a902c989-c015-4faf-848b-82cd682fa33f on n-h1-851028-13 Oct 04 18:54:20.438853 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-1e3cc65a-d79f-4360-b758-c3f39276d5eb req-244d2512-40a1-4269-98bf-cb5d0809763c service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119696 Oct 04 18:54:20.442508 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2494/4694] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:54:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:54:20.701668 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-78689068-32d4-4ced-89b8-6a1d36744f39 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9b75d37d8b4f49b49af5808e0c3c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beaa0e0951d549ecafdc1f15417d831e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:20.711539 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-78689068-32d4-4ced-89b8-6a1d36744f39 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] 10.222.0.43 "GET /compute/v2.1/servers/a902c989-c015-4faf-848b-82cd682fa33f" status: 200 len: 1463 microversion: 2.1 time: 0.633314 Oct 04 18:54:20.722015 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2201/4695] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:20 2022] GET /compute/v2.1/servers/a902c989-c015-4faf-848b-82cd682fa33f => generated 1463 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:21.104509 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-8da82631-a0be-4209-afc4-1b4290b26c1c tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:21.105387 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-8da82631-a0be-4209-afc4-1b4290b26c1c tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 2a0f8968-daa5-4998-9e3e-4f94d6471b1f] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:21.126374 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8da82631-a0be-4209-afc4-1b4290b26c1c tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:21.129345 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8da82631-a0be-4209-afc4-1b4290b26c1c tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:21.132268 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8da82631-a0be-4209-afc4-1b4290b26c1c tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:21.134755 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8da82631-a0be-4209-afc4-1b4290b26c1c tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:21.135437 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8da82631-a0be-4209-afc4-1b4290b26c1c tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:21.135966 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8da82631-a0be-4209-afc4-1b4290b26c1c tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:21.744596 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-bbb257c6-623a-47f6-bdd6-6c30b7c732f8 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:21.746105 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-bbb257c6-623a-47f6-bdd6-6c30b7c732f8 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] [instance: a902c989-c015-4faf-848b-82cd682fa33f] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:21.756506 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=2 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:54:21.759362 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bbb257c6-623a-47f6-bdd6-6c30b7c732f8 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:21.760304 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bbb257c6-623a-47f6-bdd6-6c30b7c732f8 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:21.761945 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bbb257c6-623a-47f6-bdd6-6c30b7c732f8 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:21.762906 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bbb257c6-623a-47f6-bdd6-6c30b7c732f8 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:21.764114 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bbb257c6-623a-47f6-bdd6-6c30b7c732f8 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:21.764712 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bbb257c6-623a-47f6-bdd6-6c30b7c732f8 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:21.829796 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-8da82631-a0be-4209-afc4-1b4290b26c1c tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f63f1ac147543dab34a28a22eb5936c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1607b30b9f324abaa88aa29e04ef3ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:21.837930 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-8da82631-a0be-4209-afc4-1b4290b26c1c tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "GET /compute/v2.1/servers/2a0f8968-daa5-4998-9e3e-4f94d6471b1f" status: 200 len: 1510 microversion: 2.1 time: 0.742972 Oct 04 18:54:21.849661 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-bbb257c6-623a-47f6-bdd6-6c30b7c732f8 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] HTTP exception thrown: Instance a902c989-c015-4faf-848b-82cd682fa33f could not be found. Oct 04 18:54:21.849786 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2495/4696] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:21 2022] GET /compute/v2.1/servers/2a0f8968-daa5-4998-9e3e-4f94d6471b1f => generated 1510 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:21.849884 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-bbb257c6-623a-47f6-bdd6-6c30b7c732f8 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Request method failure captured: Oct 04 18:54:21.849884 n-d-851028-13 devstack@n-api.service[123595]: request: GET /compute/v2.1/servers/a902c989-c015-4faf-848b-82cd682fa33f HTTP/1.1 Oct 04 18:54:21.849884 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 18:54:21.849884 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 18:54:21.849884 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 18:54:21.849884 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 0 Oct 04 18:54:21.849884 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 18:54:21.849884 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 18:54:21.849884 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 18:54:21.849884 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 18:54:21.849884 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPIDbCpNUBTj4Uigj2gQUlS_kKtHtoWGUfkQwR7gi0Q_I2eCi6ylkspuX2oD3wyiCIPgUdAaYTW6wC5-_t0eWjEFismFM8dQwtAxFTcmNqQc7aTaL9mYiKREA70Dj7MU2310cCR0oH9qPA-8jwfQQcm_HMTsgDNHUxfdW2CXfroivMFg Oct 04 18:54:21.849884 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 18:54:21.849884 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 18:54:21.849884 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 18:54:21.849884 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 18:54:21.849884 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 18:54:21.849884 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 18:54:21.849884 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: beaa0e0951d549ecafdc1f15417d831e Oct 04 18:54:21.849884 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-ServerRescueTestJSON-3395509 Oct 04 18:54:21.849884 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 18:54:21.849884 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 18:54:21.849884 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/beaa0e0951d549ecafdc1f15417d831e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_beaa0e0951d549ecafdc1f15417d831e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/beaa0e0951d549ecafdc1f15417d831e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/beaa0e0951d549ecafdc1f15417d831e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:54:21.849884 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-ServerRescueTestJSON-3395509 Oct 04 18:54:21.849884 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: beaa0e0951d549ecafdc1f15417d831e Oct 04 18:54:21.849884 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-ServerRescueTestJSON-3395509 Oct 04 18:54:21.849884 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-ServerRescueTestJSON-3395509-project Oct 04 18:54:21.849884 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 18:54:21.849884 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 18:54:21.849884 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: ba9b75d37d8b4f49b49af5808e0c3c69 Oct 04 18:54:21.849884 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-ServerRescueTestJSON-3395509-project Oct 04 18:54:21.849884 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 18:54:21.849884 n-d-851028-13 devstack@n-api.service[123595]: exception: Instance a902c989-c015-4faf-848b-82cd682fa33f could not be found. Oct 04 18:54:21.849884 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': 'a902c989-c015-4faf-848b-82cd682fa33f'} Oct 04 18:54:21.849884 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:54:21.849884 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:54:21.849884 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:54:21.849884 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:54:21.849884 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:54:21.849884 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:54:21.849884 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:54:21.849884 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:54:21.849884 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:54:21.849884 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:54:21.849884 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a902c989-c015-4faf-848b-82cd682fa33f could not be found. Oct 04 18:54:21.849884 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:54:21.849884 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:54:21.849884 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:54:21.849884 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:54:21.849884 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:54:21.849884 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:54:21.849884 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:54:21.849884 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:54:21.849884 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:54:21.849884 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:54:21.849884 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:54:21.849884 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:54:21.849884 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:54:21.849884 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:54:21.849884 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:54:21.849884 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:54:21.849884 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a902c989-c015-4faf-848b-82cd682fa33f could not be found. Oct 04 18:54:21.849884 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:54:21.849884 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:54:21.849884 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:54:21.854934 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:54:21.854934 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:54:21.854934 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:54:21.854934 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:54:21.854934 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:54:21.854934 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a902c989-c015-4faf-848b-82cd682fa33f could not be found. Oct 04 18:54:21.854934 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:54:21.854934 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-bbb257c6-623a-47f6-bdd6-6c30b7c732f8 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Returning 404 to user: Instance a902c989-c015-4faf-848b-82cd682fa33f could not be found. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:54:21.854934 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-bbb257c6-623a-47f6-bdd6-6c30b7c732f8 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] 10.222.0.43 "GET /compute/v2.1/servers/a902c989-c015-4faf-848b-82cd682fa33f" status: 404 len: 111 microversion: 2.1 time: 0.114392 Oct 04 18:54:21.854934 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2202/4697] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:21 2022] GET /compute/v2.1/servers/a902c989-c015-4faf-848b-82cd682fa33f => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:54:21.864080 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-ce73d15d-7ee7-4772-bf0c-fa1825744710 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:21.864608 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-ce73d15d-7ee7-4772-bf0c-fa1825744710 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] [instance: 1b1ea635-1a53-4c84-9b4b-3a9c48567fdb] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:21.870756 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ce73d15d-7ee7-4772-bf0c-fa1825744710 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:21.876766 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ce73d15d-7ee7-4772-bf0c-fa1825744710 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:21.877259 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ce73d15d-7ee7-4772-bf0c-fa1825744710 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:21.878004 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ce73d15d-7ee7-4772-bf0c-fa1825744710 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:21.878461 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ce73d15d-7ee7-4772-bf0c-fa1825744710 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:21.878898 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ce73d15d-7ee7-4772-bf0c-fa1825744710 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:21.939641 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-ce73d15d-7ee7-4772-bf0c-fa1825744710 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] [instance: 1b1ea635-1a53-4c84-9b4b-3a9c48567fdb] Going to try to terminate instance {{(pid=123596) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:54:22.071939 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-ce73d15d-7ee7-4772-bf0c-fa1825744710 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] 10.222.0.43 "DELETE /compute/v2.1/servers/1b1ea635-1a53-4c84-9b4b-3a9c48567fdb" status: 204 len: 0 microversion: 2.1 time: 0.211451 Oct 04 18:54:22.073699 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2496/4698] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 18:54:21 2022] DELETE /compute/v2.1/servers/1b1ea635-1a53-4c84-9b4b-3a9c48567fdb => generated 0 bytes in 216 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:54:22.090554 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-62dd93b2-fe2b-472e-aa71-7c7d796ad038 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:22.091789 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-62dd93b2-fe2b-472e-aa71-7c7d796ad038 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] [instance: 1b1ea635-1a53-4c84-9b4b-3a9c48567fdb] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:22.104018 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-62dd93b2-fe2b-472e-aa71-7c7d796ad038 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:22.104896 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-62dd93b2-fe2b-472e-aa71-7c7d796ad038 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:22.108349 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-62dd93b2-fe2b-472e-aa71-7c7d796ad038 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:22.109366 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-62dd93b2-fe2b-472e-aa71-7c7d796ad038 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:22.110014 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-62dd93b2-fe2b-472e-aa71-7c7d796ad038 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:22.110454 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-62dd93b2-fe2b-472e-aa71-7c7d796ad038 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:22.302532 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-01e17144-0f6e-4e9e-9d4c-74ddae42f97b req-9a82449d-6b08-4bfc-8201-92b68f374964 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a0f8968-daa5-4998-9e3e-4f94d6471b1f", "name": "network-vif-deleted", "tag": "458f0db5-c725-4a1d-a45b-c106a109dfde"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:54:22.334096 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-01e17144-0f6e-4e9e-9d4c-74ddae42f97b req-9a82449d-6b08-4bfc-8201-92b68f374964 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:22.336260 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-01e17144-0f6e-4e9e-9d4c-74ddae42f97b req-9a82449d-6b08-4bfc-8201-92b68f374964 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:22.337189 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-01e17144-0f6e-4e9e-9d4c-74ddae42f97b req-9a82449d-6b08-4bfc-8201-92b68f374964 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:22.357331 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-01e17144-0f6e-4e9e-9d4c-74ddae42f97b req-9a82449d-6b08-4bfc-8201-92b68f374964 service nova] Creating event network-vif-deleted:458f0db5-c725-4a1d-a45b-c106a109dfde for instance 2a0f8968-daa5-4998-9e3e-4f94d6471b1f on n-h1-851028-13 Oct 04 18:54:22.363900 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-01e17144-0f6e-4e9e-9d4c-74ddae42f97b req-9a82449d-6b08-4bfc-8201-92b68f374964 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068182 Oct 04 18:54:22.365158 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2497/4699] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:54:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:54:22.624316 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-62dd93b2-fe2b-472e-aa71-7c7d796ad038 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9b75d37d8b4f49b49af5808e0c3c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beaa0e0951d549ecafdc1f15417d831e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:22.637020 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-62dd93b2-fe2b-472e-aa71-7c7d796ad038 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] 10.222.0.43 "GET /compute/v2.1/servers/1b1ea635-1a53-4c84-9b4b-3a9c48567fdb" status: 200 len: 1493 microversion: 2.1 time: 0.556930 Oct 04 18:54:22.637814 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2203/4700] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:22 2022] GET /compute/v2.1/servers/1b1ea635-1a53-4c84-9b4b-3a9c48567fdb => generated 1493 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:22.868513 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-c22960ce-003a-4f7e-a06b-78462c285879 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:22.869882 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-c22960ce-003a-4f7e-a06b-78462c285879 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 2a0f8968-daa5-4998-9e3e-4f94d6471b1f] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:22.878129 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c22960ce-003a-4f7e-a06b-78462c285879 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:22.879249 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c22960ce-003a-4f7e-a06b-78462c285879 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:22.879892 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c22960ce-003a-4f7e-a06b-78462c285879 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:22.880805 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c22960ce-003a-4f7e-a06b-78462c285879 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:22.881491 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c22960ce-003a-4f7e-a06b-78462c285879 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:22.882100 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c22960ce-003a-4f7e-a06b-78462c285879 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:22.921640 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c22960ce-003a-4f7e-a06b-78462c285879 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:22.922548 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c22960ce-003a-4f7e-a06b-78462c285879 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:22.924007 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c22960ce-003a-4f7e-a06b-78462c285879 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:22.924893 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.objects.instance [None req-c22960ce-003a-4f7e-a06b-78462c285879 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lazy-loading 'fault' on Instance uuid 2a0f8968-daa5-4998-9e3e-4f94d6471b1f {{(pid=123596) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:54:23.158993 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-c22960ce-003a-4f7e-a06b-78462c285879 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f63f1ac147543dab34a28a22eb5936c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1607b30b9f324abaa88aa29e04ef3ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:23.171617 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-c22960ce-003a-4f7e-a06b-78462c285879 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "GET /compute/v2.1/servers/2a0f8968-daa5-4998-9e3e-4f94d6471b1f" status: 200 len: 1305 microversion: 2.1 time: 0.307508 Oct 04 18:54:23.190466 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2498/4701] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:22 2022] GET /compute/v2.1/servers/2a0f8968-daa5-4998-9e3e-4f94d6471b1f => generated 1305 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:23.682640 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-b6a9084b-3dab-468a-bab9-4b26bf0698f6 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:23.686332 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-b6a9084b-3dab-468a-bab9-4b26bf0698f6 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] [instance: 1b1ea635-1a53-4c84-9b4b-3a9c48567fdb] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:23.704155 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b6a9084b-3dab-468a-bab9-4b26bf0698f6 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:23.704921 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b6a9084b-3dab-468a-bab9-4b26bf0698f6 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:23.705609 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b6a9084b-3dab-468a-bab9-4b26bf0698f6 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:23.706584 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b6a9084b-3dab-468a-bab9-4b26bf0698f6 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:23.707250 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b6a9084b-3dab-468a-bab9-4b26bf0698f6 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:23.707889 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b6a9084b-3dab-468a-bab9-4b26bf0698f6 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:24.004304 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-b6a9084b-3dab-468a-bab9-4b26bf0698f6 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9b75d37d8b4f49b49af5808e0c3c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beaa0e0951d549ecafdc1f15417d831e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:24.019434 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-b6a9084b-3dab-468a-bab9-4b26bf0698f6 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] 10.222.0.43 "GET /compute/v2.1/servers/1b1ea635-1a53-4c84-9b4b-3a9c48567fdb" status: 200 len: 1493 microversion: 2.1 time: 0.359458 Oct 04 18:54:24.021879 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2204/4702] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:23 2022] GET /compute/v2.1/servers/1b1ea635-1a53-4c84-9b4b-3a9c48567fdb => generated 1493 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:24.199091 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-0a6d3014-7ffc-49f1-8e9b-9d50b412b988 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:24.200174 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-0a6d3014-7ffc-49f1-8e9b-9d50b412b988 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 2a0f8968-daa5-4998-9e3e-4f94d6471b1f] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:24.225402 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0a6d3014-7ffc-49f1-8e9b-9d50b412b988 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:24.225974 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0a6d3014-7ffc-49f1-8e9b-9d50b412b988 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:24.226441 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0a6d3014-7ffc-49f1-8e9b-9d50b412b988 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:24.231390 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0a6d3014-7ffc-49f1-8e9b-9d50b412b988 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:24.232551 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0a6d3014-7ffc-49f1-8e9b-9d50b412b988 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:24.235423 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0a6d3014-7ffc-49f1-8e9b-9d50b412b988 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:24.273136 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-0a6d3014-7ffc-49f1-8e9b-9d50b412b988 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] HTTP exception thrown: Instance 2a0f8968-daa5-4998-9e3e-4f94d6471b1f could not be found. Oct 04 18:54:24.280550 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-0a6d3014-7ffc-49f1-8e9b-9d50b412b988 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Request method failure captured: Oct 04 18:54:24.280550 n-d-851028-13 devstack@n-api.service[123596]: request: GET /compute/v2.1/servers/2a0f8968-daa5-4998-9e3e-4f94d6471b1f HTTP/1.1 Oct 04 18:54:24.280550 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:54:24.280550 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:54:24.280550 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:54:24.280550 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 18:54:24.280550 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:54:24.280550 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:54:24.280550 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:54:24.280550 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:54:24.280550 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPIEZsAoFcr6P1AMHBWUo8LvryOn1l2-LYSKr4xgLCvHblWFuAiGVlStWcljkgzOc7-ldx7qv3C-2jYmQ32_Zk5yP28dI64Re9CsyHCLmsYfyJdD0-2_kU92lHK36Fs8oXqXU2FijNX-X4IYqe4GjOQDN7LB9zCeEIcrxQ2LRJFOwbQY Oct 04 18:54:24.280550 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:54:24.280550 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:54:24.280550 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:54:24.280550 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:54:24.280550 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:54:24.280550 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:54:24.280550 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: 1607b30b9f324abaa88aa29e04ef3ec4 Oct 04 18:54:24.280550 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-ServersNegativeTestJSON-708693932 Oct 04 18:54:24.280550 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 18:54:24.280550 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 18:54:24.280550 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/1607b30b9f324abaa88aa29e04ef3ec4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_1607b30b9f324abaa88aa29e04ef3ec4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1607b30b9f324abaa88aa29e04ef3ec4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1607b30b9f324abaa88aa29e04ef3ec4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:54:24.280550 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-ServersNegativeTestJSON-708693932 Oct 04 18:54:24.280550 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: 1607b30b9f324abaa88aa29e04ef3ec4 Oct 04 18:54:24.280550 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-ServersNegativeTestJSON-708693932 Oct 04 18:54:24.280550 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-ServersNegativeTestJSON-708693932-project Oct 04 18:54:24.280550 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:54:24.280550 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:54:24.280550 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 6f63f1ac147543dab34a28a22eb5936c Oct 04 18:54:24.280550 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-ServersNegativeTestJSON-708693932-project Oct 04 18:54:24.280550 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 18:54:24.280550 n-d-851028-13 devstack@n-api.service[123596]: exception: Instance 2a0f8968-daa5-4998-9e3e-4f94d6471b1f could not be found. Oct 04 18:54:24.280550 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': '2a0f8968-daa5-4998-9e3e-4f94d6471b1f'} Oct 04 18:54:24.280550 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:54:24.280550 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:54:24.280550 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:54:24.280550 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:54:24.280550 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:54:24.280550 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:54:24.280550 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:54:24.280550 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:54:24.280550 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:54:24.280550 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:54:24.280550 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a0f8968-daa5-4998-9e3e-4f94d6471b1f could not be found. Oct 04 18:54:24.280550 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:54:24.280550 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:54:24.280550 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:54:24.280550 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:54:24.280550 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:54:24.280550 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:54:24.280550 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:54:24.280550 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:54:24.280550 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:54:24.280550 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:54:24.280550 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:54:24.280550 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:54:24.280550 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:54:24.280550 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:54:24.280550 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:54:24.280550 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:54:24.280550 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a0f8968-daa5-4998-9e3e-4f94d6471b1f could not be found. Oct 04 18:54:24.280550 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:54:24.280550 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:54:24.280550 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:54:24.284790 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:54:24.284790 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:54:24.284790 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:54:24.284790 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:54:24.284790 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:54:24.284790 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a0f8968-daa5-4998-9e3e-4f94d6471b1f could not be found. Oct 04 18:54:24.284790 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:54:24.290952 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-0a6d3014-7ffc-49f1-8e9b-9d50b412b988 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Returning 404 to user: Instance 2a0f8968-daa5-4998-9e3e-4f94d6471b1f could not be found. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:54:24.293947 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-0a6d3014-7ffc-49f1-8e9b-9d50b412b988 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "GET /compute/v2.1/servers/2a0f8968-daa5-4998-9e3e-4f94d6471b1f" status: 404 len: 111 microversion: 2.1 time: 0.099289 Oct 04 18:54:24.294363 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-33f0855c-6841-4dd4-9905-83a4fd8a8851 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Action: 'create', calling method: .version_select at 0x7fb21f7f8280>, body: {"keypair": {"name": "tempest-keypair-124740521", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKSj6mmiOkwb+rn5SpnbytKBEJSqeNgr9esmDTzYuEBNvn7GMYY6dkpP8o19iMgynTBP8Bu7brLpnsw+0pdvpFijrutK1VFL1E/O4GBNVwzgsjzdIebY9ieU0ls58Bc3Ig=="}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:54:24.302454 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2499/4703] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:24 2022] GET /compute/v2.1/servers/2a0f8968-daa5-4998-9e3e-4f94d6471b1f => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:54:24.318690 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-e7956daa-7bdd-4f88-a00e-ad1a8713a30f tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:24.320115 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-e7956daa-7bdd-4f88-a00e-ad1a8713a30f tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 01e250ab-d9aa-4708-ae36-10c53a411a40] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:24.335452 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e7956daa-7bdd-4f88-a00e-ad1a8713a30f tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:24.336255 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e7956daa-7bdd-4f88-a00e-ad1a8713a30f tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:24.336924 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e7956daa-7bdd-4f88-a00e-ad1a8713a30f tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:24.337831 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e7956daa-7bdd-4f88-a00e-ad1a8713a30f tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:24.338147 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-33f0855c-6841-4dd4-9905-83a4fd8a8851 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Getting quotas for project 6c91c7e7358048ffaaee7f51ad61b515. Resources: {'key_pairs'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:54:24.338665 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e7956daa-7bdd-4f88-a00e-ad1a8713a30f tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:24.340144 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e7956daa-7bdd-4f88-a00e-ad1a8713a30f tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:24.360199 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-33f0855c-6841-4dd4-9905-83a4fd8a8851 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Getting quotas for user 486c22456b1e47ae843ae41f8dfb2632 and project 6c91c7e7358048ffaaee7f51ad61b515. Resources: {'key_pairs'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:54:24.438059 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-33f0855c-6841-4dd4-9905-83a4fd8a8851 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.148758 Oct 04 18:54:24.439989 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2205/4704] 10.222.0.43 () {60 vars in 1159 bytes} [Tue Oct 4 18:54:24 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:54:25.047853 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-6de80545-b164-4901-8067-a557f4839e00 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:25.048477 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-6de80545-b164-4901-8067-a557f4839e00 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] [instance: 1b1ea635-1a53-4c84-9b4b-3a9c48567fdb] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:25.071202 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6de80545-b164-4901-8067-a557f4839e00 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:25.072396 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6de80545-b164-4901-8067-a557f4839e00 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:25.072849 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6de80545-b164-4901-8067-a557f4839e00 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:25.073612 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6de80545-b164-4901-8067-a557f4839e00 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:25.074073 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6de80545-b164-4901-8067-a557f4839e00 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:25.074514 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6de80545-b164-4901-8067-a557f4839e00 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:25.206346 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-e7956daa-7bdd-4f88-a00e-ad1a8713a30f tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f63f1ac147543dab34a28a22eb5936c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1607b30b9f324abaa88aa29e04ef3ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:25.215621 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-e7956daa-7bdd-4f88-a00e-ad1a8713a30f tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40" status: 200 len: 1505 microversion: 2.1 time: 0.912012 Oct 04 18:54:25.220935 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2500/4705] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:24 2022] GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40 => generated 1505 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:25.623959 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-59ba6cb2-1a0e-4911-a0a9-c455bea0b1be tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452", "networks": [{"uuid": "66b6832b-a1b2-4da9-addc-63f223a4cc5a"}]}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:54:25.634972 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-59ba6cb2-1a0e-4911-a0a9-c455bea0b1be tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Request method failure captured: Oct 04 18:54:25.634972 n-d-851028-13 devstack@n-api.service[123596]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 18:54:25.634972 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:54:25.634972 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:54:25.634972 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:54:25.634972 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 163 Oct 04 18:54:25.634972 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:54:25.634972 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:54:25.634972 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:54:25.634972 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:54:25.634972 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPIEZsAoFcr6P1AMHBWUo8LvryOn1l2-LYSKr4xgLCvHblWFuAiGVlStWcljkgzOc7-ldx7qv3C-2jYmQ32_Zk5yP28dI64Re9CsyHCLmsYfyJdD0-2_kU92lHK36Fs8oXqXU2FijNX-X4IYqe4GjOQDN7LB9zCeEIcrxQ2LRJFOwbQY Oct 04 18:54:25.634972 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:54:25.634972 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:54:25.634972 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:54:25.634972 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:54:25.634972 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:54:25.634972 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:54:25.634972 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: 1607b30b9f324abaa88aa29e04ef3ec4 Oct 04 18:54:25.634972 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-ServersNegativeTestJSON-708693932 Oct 04 18:54:25.634972 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 18:54:25.634972 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 18:54:25.634972 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/1607b30b9f324abaa88aa29e04ef3ec4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_1607b30b9f324abaa88aa29e04ef3ec4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1607b30b9f324abaa88aa29e04ef3ec4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1607b30b9f324abaa88aa29e04ef3ec4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:54:25.634972 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-ServersNegativeTestJSON-708693932 Oct 04 18:54:25.634972 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: 1607b30b9f324abaa88aa29e04ef3ec4 Oct 04 18:54:25.634972 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-ServersNegativeTestJSON-708693932 Oct 04 18:54:25.634972 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-ServersNegativeTestJSON-708693932-project Oct 04 18:54:25.634972 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:54:25.634972 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:54:25.634972 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 6f63f1ac147543dab34a28a22eb5936c Oct 04 18:54:25.634972 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-ServersNegativeTestJSON-708693932-project Oct 04 18:54:25.634972 n-d-851028-13 devstack@n-api.service[123596]: Oct 04 18:54:25.634972 n-d-851028-13 devstack@n-api.service[123596]: {"server": {"name": 12345, "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452", "networks": [{"uuid": "66b6832b-a1b2-4da9-addc-63f223a4cc5a"}]}} Oct 04 18:54:25.634972 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 18:54:25.634972 n-d-851028-13 devstack@n-api.service[123596]: exception: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 04 18:54:25.634972 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'body': {'server': {'name': 12345, 'imageRef': 'e8943ec5-4038-4d4b-b9b9-2415a79f5243', 'flavorRef': '452', 'networks': [{'uuid': '66b6832b-a1b2-4da9-addc-63f223a4cc5a'}]}}} Oct 04 18:54:25.634972 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:54:25.634972 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:54:25.634972 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:54:25.634972 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:54:25.634972 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:54:25.634972 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:54:25.634972 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 12345 is not of type 'string' Oct 04 18:54:25.634972 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:54:25.634972 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['name']: Oct 04 18:54:25.634972 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 04 18:54:25.634972 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:54:25.634972 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 04 18:54:25.634972 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi 12345 Oct 04 18:54:25.634972 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:54:25.634972 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:54:25.634972 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:54:25.634972 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:54:25.634972 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:54:25.634972 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:54:25.634972 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:54:25.634972 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:54:25.634972 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:54:25.634972 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:54:25.634972 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:54:25.634972 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:54:25.634972 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 18:54:25.634972 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 18:54:25.634972 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:54:25.634972 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:54:25.634972 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:54:25.640117 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:54:25.640117 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 04 18:54:25.640117 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:54:25.640117 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:54:25.640117 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:54:25.640117 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:54:25.640117 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:54:25.640117 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:54:25.640117 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:54:25.640117 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:54:25.640117 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 04 18:54:25.640117 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:54:25.643098 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-59ba6cb2-1a0e-4911-a0a9-c455bea0b1be tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:54:25.644206 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-59ba6cb2-1a0e-4911-a0a9-c455bea0b1be tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.025434 Oct 04 18:54:25.645022 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2501/4706] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 18:54:25 2022] POST /compute/v2.1/servers => generated 127 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 04 18:54:25.662150 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-c3d4ce9f-8fe6-4ece-af84-479b5c2ada4e tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:25.665168 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-c3d4ce9f-8fe6-4ece-af84-479b5c2ada4e tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 01e250ab-d9aa-4708-ae36-10c53a411a40] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:25.674429 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c3d4ce9f-8fe6-4ece-af84-479b5c2ada4e tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:25.676445 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c3d4ce9f-8fe6-4ece-af84-479b5c2ada4e tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:25.677254 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c3d4ce9f-8fe6-4ece-af84-479b5c2ada4e tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:25.678274 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c3d4ce9f-8fe6-4ece-af84-479b5c2ada4e tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:25.678998 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c3d4ce9f-8fe6-4ece-af84-479b5c2ada4e tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:25.679701 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c3d4ce9f-8fe6-4ece-af84-479b5c2ada4e tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:25.929231 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-c3d4ce9f-8fe6-4ece-af84-479b5c2ada4e tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f63f1ac147543dab34a28a22eb5936c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1607b30b9f324abaa88aa29e04ef3ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:25.942901 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-c3d4ce9f-8fe6-4ece-af84-479b5c2ada4e tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40" status: 200 len: 1505 microversion: 2.1 time: 0.293247 Oct 04 18:54:25.961193 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2502/4707] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:25 2022] GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40 => generated 1505 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:25.974368 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-6eb51b8b-4159-48dd-b1b9-208259f2793d tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:25.975427 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-6eb51b8b-4159-48dd-b1b9-208259f2793d tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 01e250ab-d9aa-4708-ae36-10c53a411a40] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:25.987231 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6eb51b8b-4159-48dd-b1b9-208259f2793d tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:25.987831 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6eb51b8b-4159-48dd-b1b9-208259f2793d tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:25.988278 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6eb51b8b-4159-48dd-b1b9-208259f2793d tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:25.989562 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6eb51b8b-4159-48dd-b1b9-208259f2793d tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:25.990449 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6eb51b8b-4159-48dd-b1b9-208259f2793d tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:25.992193 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6eb51b8b-4159-48dd-b1b9-208259f2793d tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:26.001533 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-6de80545-b164-4901-8067-a557f4839e00 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9b75d37d8b4f49b49af5808e0c3c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beaa0e0951d549ecafdc1f15417d831e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:26.017597 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-6de80545-b164-4901-8067-a557f4839e00 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] 10.222.0.43 "GET /compute/v2.1/servers/1b1ea635-1a53-4c84-9b4b-3a9c48567fdb" status: 200 len: 1493 microversion: 2.1 time: 0.974890 Oct 04 18:54:26.021882 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2206/4708] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:25 2022] GET /compute/v2.1/servers/1b1ea635-1a53-4c84-9b4b-3a9c48567fdb => generated 1493 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:54:26.236262 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-6eb51b8b-4159-48dd-b1b9-208259f2793d tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f63f1ac147543dab34a28a22eb5936c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1607b30b9f324abaa88aa29e04ef3ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:26.248144 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-6eb51b8b-4159-48dd-b1b9-208259f2793d tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40" status: 200 len: 1505 microversion: 2.1 time: 0.282319 Oct 04 18:54:26.249382 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2503/4709] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:25 2022] GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40 => generated 1505 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:54:26.975525 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-c0952305-442c-4e38-9e69-756ddb4035d0 req-0642e157-a5e4-424b-8b61-b7ceb1021326 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b1ea635-1a53-4c84-9b4b-3a9c48567fdb", "name": "network-vif-deleted", "tag": "bf5f857e-8ea1-4ca6-995e-ca7fa92e10fa"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:54:27.018981 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-c0952305-442c-4e38-9e69-756ddb4035d0 req-0642e157-a5e4-424b-8b61-b7ceb1021326 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:27.021058 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-c0952305-442c-4e38-9e69-756ddb4035d0 req-0642e157-a5e4-424b-8b61-b7ceb1021326 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:27.023418 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-c0952305-442c-4e38-9e69-756ddb4035d0 req-0642e157-a5e4-424b-8b61-b7ceb1021326 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:27.045587 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-b0c2cdf4-a2f1-41f4-b48d-87120e71ee74 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:27.046758 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-b0c2cdf4-a2f1-41f4-b48d-87120e71ee74 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] [instance: 1b1ea635-1a53-4c84-9b4b-3a9c48567fdb] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:27.067167 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b0c2cdf4-a2f1-41f4-b48d-87120e71ee74 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:27.068407 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b0c2cdf4-a2f1-41f4-b48d-87120e71ee74 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:27.071136 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b0c2cdf4-a2f1-41f4-b48d-87120e71ee74 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:27.072855 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b0c2cdf4-a2f1-41f4-b48d-87120e71ee74 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:27.075875 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b0c2cdf4-a2f1-41f4-b48d-87120e71ee74 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:27.077648 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b0c2cdf4-a2f1-41f4-b48d-87120e71ee74 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:27.078411 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-c0952305-442c-4e38-9e69-756ddb4035d0 req-0642e157-a5e4-424b-8b61-b7ceb1021326 service nova] Creating event network-vif-deleted:bf5f857e-8ea1-4ca6-995e-ca7fa92e10fa for instance 1b1ea635-1a53-4c84-9b4b-3a9c48567fdb on n-h2-851028-13 Oct 04 18:54:27.097022 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-c0952305-442c-4e38-9e69-756ddb4035d0 req-0642e157-a5e4-424b-8b61-b7ceb1021326 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134102 Oct 04 18:54:27.098091 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2207/4710] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:54:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:54:27.232601 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-b0c2cdf4-a2f1-41f4-b48d-87120e71ee74 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9b75d37d8b4f49b49af5808e0c3c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beaa0e0951d549ecafdc1f15417d831e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:27.242478 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-b0c2cdf4-a2f1-41f4-b48d-87120e71ee74 tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] 10.222.0.43 "GET /compute/v2.1/servers/1b1ea635-1a53-4c84-9b4b-3a9c48567fdb" status: 200 len: 1285 microversion: 2.1 time: 0.201351 Oct 04 18:54:27.247441 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2504/4711] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:27 2022] GET /compute/v2.1/servers/1b1ea635-1a53-4c84-9b4b-3a9c48567fdb => generated 1285 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:54:28.273325 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-74e1ab93-0e14-4e79-bd05-e4bb9a49276c tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:28.274587 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-74e1ab93-0e14-4e79-bd05-e4bb9a49276c tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] [instance: 1b1ea635-1a53-4c84-9b4b-3a9c48567fdb] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:28.289306 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-74e1ab93-0e14-4e79-bd05-e4bb9a49276c tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:28.290825 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-74e1ab93-0e14-4e79-bd05-e4bb9a49276c tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:28.293262 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-74e1ab93-0e14-4e79-bd05-e4bb9a49276c tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:28.294874 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-74e1ab93-0e14-4e79-bd05-e4bb9a49276c tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:28.296150 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-74e1ab93-0e14-4e79-bd05-e4bb9a49276c tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:28.297808 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-74e1ab93-0e14-4e79-bd05-e4bb9a49276c tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:28.333236 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-74e1ab93-0e14-4e79-bd05-e4bb9a49276c tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] HTTP exception thrown: Instance 1b1ea635-1a53-4c84-9b4b-3a9c48567fdb could not be found. Oct 04 18:54:28.337011 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-74e1ab93-0e14-4e79-bd05-e4bb9a49276c tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Request method failure captured: Oct 04 18:54:28.337011 n-d-851028-13 devstack@n-api.service[123595]: request: GET /compute/v2.1/servers/1b1ea635-1a53-4c84-9b4b-3a9c48567fdb HTTP/1.1 Oct 04 18:54:28.337011 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 18:54:28.337011 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 18:54:28.337011 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 18:54:28.337011 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 0 Oct 04 18:54:28.337011 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 18:54:28.337011 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 18:54:28.337011 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 18:54:28.337011 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 18:54:28.337011 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPIDbCpNUBTj4Uigj2gQUlS_kKtHtoWGUfkQwR7gi0Q_I2eCi6ylkspuX2oD3wyiCIPgUdAaYTW6wC5-_t0eWjEFismFM8dQwtAxFTcmNqQc7aTaL9mYiKREA70Dj7MU2310cCR0oH9qPA-8jwfQQcm_HMTsgDNHUxfdW2CXfroivMFg Oct 04 18:54:28.337011 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 18:54:28.337011 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 18:54:28.337011 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 18:54:28.337011 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 18:54:28.337011 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 18:54:28.337011 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 18:54:28.337011 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: beaa0e0951d549ecafdc1f15417d831e Oct 04 18:54:28.337011 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-ServerRescueTestJSON-3395509 Oct 04 18:54:28.337011 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 18:54:28.337011 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 18:54:28.337011 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/beaa0e0951d549ecafdc1f15417d831e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_beaa0e0951d549ecafdc1f15417d831e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/beaa0e0951d549ecafdc1f15417d831e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/beaa0e0951d549ecafdc1f15417d831e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:54:28.337011 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-ServerRescueTestJSON-3395509 Oct 04 18:54:28.337011 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: beaa0e0951d549ecafdc1f15417d831e Oct 04 18:54:28.337011 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-ServerRescueTestJSON-3395509 Oct 04 18:54:28.337011 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-ServerRescueTestJSON-3395509-project Oct 04 18:54:28.337011 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 18:54:28.337011 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 18:54:28.337011 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: ba9b75d37d8b4f49b49af5808e0c3c69 Oct 04 18:54:28.337011 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-ServerRescueTestJSON-3395509-project Oct 04 18:54:28.337011 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 18:54:28.337011 n-d-851028-13 devstack@n-api.service[123595]: exception: Instance 1b1ea635-1a53-4c84-9b4b-3a9c48567fdb could not be found. Oct 04 18:54:28.337011 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': '1b1ea635-1a53-4c84-9b4b-3a9c48567fdb'} Oct 04 18:54:28.337011 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:54:28.337011 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:54:28.337011 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:54:28.337011 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:54:28.337011 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:54:28.337011 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:54:28.337011 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:54:28.337011 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:54:28.337011 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:54:28.337011 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:54:28.337011 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b1ea635-1a53-4c84-9b4b-3a9c48567fdb could not be found. Oct 04 18:54:28.337011 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:54:28.337011 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:54:28.337011 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:54:28.337011 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:54:28.337011 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:54:28.337011 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:54:28.337011 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:54:28.337011 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:54:28.337011 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:54:28.337011 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:54:28.337011 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:54:28.337011 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:54:28.337011 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:54:28.337011 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:54:28.337011 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:54:28.337011 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:54:28.337011 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b1ea635-1a53-4c84-9b4b-3a9c48567fdb could not be found. Oct 04 18:54:28.337011 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:54:28.337011 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:54:28.337011 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:54:28.341441 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:54:28.341441 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:54:28.341441 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:54:28.341441 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:54:28.341441 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:54:28.341441 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b1ea635-1a53-4c84-9b4b-3a9c48567fdb could not be found. Oct 04 18:54:28.341441 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:54:28.347199 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-74e1ab93-0e14-4e79-bd05-e4bb9a49276c tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] Returning 404 to user: Instance 1b1ea635-1a53-4c84-9b4b-3a9c48567fdb could not be found. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:54:28.348563 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-74e1ab93-0e14-4e79-bd05-e4bb9a49276c tempest-ServerRescueTestJSON-3395509 tempest-ServerRescueTestJSON-3395509-project] 10.222.0.43 "GET /compute/v2.1/servers/1b1ea635-1a53-4c84-9b4b-3a9c48567fdb" status: 404 len: 111 microversion: 2.1 time: 0.080118 Oct 04 18:54:28.351972 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2208/4712] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:28 2022] GET /compute/v2.1/servers/1b1ea635-1a53-4c84-9b4b-3a9c48567fdb => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:54:29.446700 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-2fa894f5-f871-4a8a-857f-be12427ffc89 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1132390415", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "fdbd2e5d-09c4-4426-ba14-5b07a2c68285", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "66b6832b-a1b2-4da9-addc-63f223a4cc5a"}]}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:54:29.540897 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-2fa894f5-f871-4a8a-857f-be12427ffc89 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] HTTP exception thrown: Block Device fdbd2e5d-09c4-4426-ba14-5b07a2c68285 is not bootable. Oct 04 18:54:29.548389 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-2fa894f5-f871-4a8a-857f-be12427ffc89 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Request method failure captured: Oct 04 18:54:29.548389 n-d-851028-13 devstack@n-api.service[123596]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 18:54:29.548389 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:54:29.548389 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:54:29.548389 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:54:29.548389 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 358 Oct 04 18:54:29.548389 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:54:29.548389 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:54:29.548389 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:54:29.548389 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:54:29.548389 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPIEZsAoFcr6P1AMHBWUo8LvryOn1l2-LYSKr4xgLCvHblWFuAiGVlStWcljkgzOc7-ldx7qv3C-2jYmQ32_Zk5yP28dI64Re9CsyHCLmsYfyJdD0-2_kU92lHK36Fs8oXqXU2FijNX-X4IYqe4GjOQDN7LB9zCeEIcrxQ2LRJFOwbQY Oct 04 18:54:29.548389 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:54:29.548389 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:54:29.548389 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:54:29.548389 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:54:29.548389 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:54:29.548389 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:54:29.548389 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: 1607b30b9f324abaa88aa29e04ef3ec4 Oct 04 18:54:29.548389 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-ServersNegativeTestJSON-708693932 Oct 04 18:54:29.548389 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 18:54:29.548389 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 18:54:29.548389 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/1607b30b9f324abaa88aa29e04ef3ec4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_1607b30b9f324abaa88aa29e04ef3ec4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1607b30b9f324abaa88aa29e04ef3ec4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1607b30b9f324abaa88aa29e04ef3ec4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:54:29.548389 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-ServersNegativeTestJSON-708693932 Oct 04 18:54:29.548389 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: 1607b30b9f324abaa88aa29e04ef3ec4 Oct 04 18:54:29.548389 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-ServersNegativeTestJSON-708693932 Oct 04 18:54:29.548389 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-ServersNegativeTestJSON-708693932-project Oct 04 18:54:29.548389 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:54:29.548389 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:54:29.548389 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 6f63f1ac147543dab34a28a22eb5936c Oct 04 18:54:29.548389 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-ServersNegativeTestJSON-708693932-project Oct 04 18:54:29.548389 n-d-851028-13 devstack@n-api.service[123596]: Oct 04 18:54:29.548389 n-d-851028-13 devstack@n-api.service[123596]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1132390415", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "fdbd2e5d-09c4-4426-ba14-5b07a2c68285", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "66b6832b-a1b2-4da9-addc-63f223a4cc5a"}]}} Oct 04 18:54:29.548389 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 18:54:29.548389 n-d-851028-13 devstack@n-api.service[123596]: exception: Block Device fdbd2e5d-09c4-4426-ba14-5b07a2c68285 is not bootable. Oct 04 18:54:29.548389 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1132390415', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': 'fdbd2e5d-09c4-4426-ba14-5b07a2c68285'}], 'networks': [{'uuid': '66b6832b-a1b2-4da9-addc-63f223a4cc5a'}]}}} Oct 04 18:54:29.548389 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:54:29.548389 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:54:29.548389 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 18:54:29.548389 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 18:54:29.548389 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 18:54:29.548389 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 18:54:29.548389 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1672, in _create_instance Oct 04 18:54:29.548389 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Oct 04 18:54:29.548389 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 664, in get_bdm_image_metadata Oct 04 18:54:29.548389 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Oct 04 18:54:29.548389 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device fdbd2e5d-09c4-4426-ba14-5b07a2c68285 is not bootable. Oct 04 18:54:29.548389 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:54:29.548389 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:54:29.548389 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:54:29.548389 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:54:29.548389 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:54:29.548389 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:54:29.548389 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:54:29.548389 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:54:29.548389 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:54:29.548389 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:54:29.548389 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:54:29.548389 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:54:29.548389 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:54:29.555351 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:54:29.555351 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:54:29.555351 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:54:29.555351 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 18:54:29.555351 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 04 18:54:29.555351 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 04 18:54:29.555351 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device fdbd2e5d-09c4-4426-ba14-5b07a2c68285 is not bootable. Oct 04 18:54:29.555351 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:54:29.555351 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:54:29.555351 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:54:29.555351 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:54:29.555351 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:54:29.555351 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:54:29.555351 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:54:29.555351 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:54:29.555351 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device fdbd2e5d-09c4-4426-ba14-5b07a2c68285 is not bootable. Oct 04 18:54:29.555351 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:54:29.562727 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-2fa894f5-f871-4a8a-857f-be12427ffc89 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Returning 400 to user: Block Device fdbd2e5d-09c4-4426-ba14-5b07a2c68285 is not bootable. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:54:29.563636 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-2fa894f5-f871-4a8a-857f-be12427ffc89 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.126509 Oct 04 18:54:29.564241 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2505/4713] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 18:54:29 2022] POST /compute/v2.1/servers => generated 110 bytes in 128 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:54:29.574257 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-b75597d0-a526-4978-9422-3dc84e471bb3 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:29.574937 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-b75597d0-a526-4978-9422-3dc84e471bb3 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 01e250ab-d9aa-4708-ae36-10c53a411a40] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:29.583293 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b75597d0-a526-4978-9422-3dc84e471bb3 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:29.583793 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b75597d0-a526-4978-9422-3dc84e471bb3 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:29.584282 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b75597d0-a526-4978-9422-3dc84e471bb3 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:29.585004 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b75597d0-a526-4978-9422-3dc84e471bb3 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:29.585488 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b75597d0-a526-4978-9422-3dc84e471bb3 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:29.585920 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b75597d0-a526-4978-9422-3dc84e471bb3 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:29.612901 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:54:30.269923 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-b75597d0-a526-4978-9422-3dc84e471bb3 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f63f1ac147543dab34a28a22eb5936c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1607b30b9f324abaa88aa29e04ef3ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:30.283544 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-b75597d0-a526-4978-9422-3dc84e471bb3 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40" status: 200 len: 1505 microversion: 2.1 time: 0.713532 Oct 04 18:54:30.286150 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2209/4714] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:29 2022] GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40 => generated 1505 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:30.309022 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-6a1ee6f2-2eca-441f-8627-b1a00d4bee42 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:30.310037 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-6a1ee6f2-2eca-441f-8627-b1a00d4bee42 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 01e250ab-d9aa-4708-ae36-10c53a411a40] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:30.322171 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6a1ee6f2-2eca-441f-8627-b1a00d4bee42 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:30.322817 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6a1ee6f2-2eca-441f-8627-b1a00d4bee42 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:30.324228 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6a1ee6f2-2eca-441f-8627-b1a00d4bee42 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:30.325209 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6a1ee6f2-2eca-441f-8627-b1a00d4bee42 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:30.328921 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6a1ee6f2-2eca-441f-8627-b1a00d4bee42 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:30.329617 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6a1ee6f2-2eca-441f-8627-b1a00d4bee42 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:31.021323 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-6a1ee6f2-2eca-441f-8627-b1a00d4bee42 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f63f1ac147543dab34a28a22eb5936c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1607b30b9f324abaa88aa29e04ef3ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:31.031253 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-6a1ee6f2-2eca-441f-8627-b1a00d4bee42 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40" status: 200 len: 1505 microversion: 2.1 time: 0.726708 Oct 04 18:54:31.050594 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2506/4715] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:30 2022] GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40 => generated 1505 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:33.011603 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-c983401d-9deb-4cc1-b8df-7f427a36a2de tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-980970662", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3f21e827-5829-48b0-82ff-093e57296b22"}], "security_groups": [{"name": "tempest-securitygroup--589264012"}], "key_name": "tempest-keypair-124740521", "user_data": "}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:54:33.325601 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.network.neutron [None req-c983401d-9deb-4cc1-b8df-7f427a36a2de tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] validate_networks() for [('3f21e827-5829-48b0-82ff-093e57296b22', None, None, None, None, None)] {{(pid=123595) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:54:33.731349 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-5ca1d260-0647-40e6-ac41-08fe616d2cb1 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1327112333", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "destination_type": "local"}, {"source_type": "volume", "uuid": "f6776ad9-2c96-40f2-a392-03908a79a42c", "destination_type": "invalid"}], "networks": [{"uuid": "66b6832b-a1b2-4da9-addc-63f223a4cc5a"}]}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:54:33.740249 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-5ca1d260-0647-40e6-ac41-08fe616d2cb1 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Request method failure captured: Oct 04 18:54:33.740249 n-d-851028-13 devstack@n-api.service[123596]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 18:54:33.740249 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:54:33.740249 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:54:33.740249 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:54:33.740249 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 495 Oct 04 18:54:33.740249 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:54:33.740249 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:54:33.740249 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:54:33.740249 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:54:33.740249 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPIEZsAoFcr6P1AMHBWUo8LvryOn1l2-LYSKr4xgLCvHblWFuAiGVlStWcljkgzOc7-ldx7qv3C-2jYmQ32_Zk5yP28dI64Re9CsyHCLmsYfyJdD0-2_kU92lHK36Fs8oXqXU2FijNX-X4IYqe4GjOQDN7LB9zCeEIcrxQ2LRJFOwbQY Oct 04 18:54:33.740249 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:54:33.740249 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:54:33.740249 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:54:33.740249 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:54:33.740249 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:54:33.740249 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:54:33.740249 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: 1607b30b9f324abaa88aa29e04ef3ec4 Oct 04 18:54:33.740249 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-ServersNegativeTestJSON-708693932 Oct 04 18:54:33.740249 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 18:54:33.740249 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 18:54:33.740249 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/1607b30b9f324abaa88aa29e04ef3ec4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_1607b30b9f324abaa88aa29e04ef3ec4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1607b30b9f324abaa88aa29e04ef3ec4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1607b30b9f324abaa88aa29e04ef3ec4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:54:33.740249 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-ServersNegativeTestJSON-708693932 Oct 04 18:54:33.740249 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: 1607b30b9f324abaa88aa29e04ef3ec4 Oct 04 18:54:33.740249 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-ServersNegativeTestJSON-708693932 Oct 04 18:54:33.740249 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-ServersNegativeTestJSON-708693932-project Oct 04 18:54:33.740249 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:54:33.740249 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:54:33.740249 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 6f63f1ac147543dab34a28a22eb5936c Oct 04 18:54:33.740249 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-ServersNegativeTestJSON-708693932-project Oct 04 18:54:33.740249 n-d-851028-13 devstack@n-api.service[123596]: Oct 04 18:54:33.740249 n-d-851028-13 devstack@n-api.service[123596]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1327112333", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "destination_type": "local"}, {"source_type": "volume", "uuid": "f6776ad9-2c96-40f2-a392-03908a79a42c", "destination_type": "invalid"}], "networks": [{"uuid": "66b6832b-a1b2-4da9-addc-63f223a4cc5a"}]}} Oct 04 18:54:33.740249 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 18:54:33.740249 n-d-851028-13 devstack@n-api.service[123596]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 04 18:54:33.740249 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1327112333', 'imageRef': 'e8943ec5-4038-4d4b-b9b9-2415a79f5243', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': 'e8943ec5-4038-4d4b-b9b9-2415a79f5243', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': 'f6776ad9-2c96-40f2-a392-03908a79a42c', 'destination_type': 'invalid'}], 'networks': [{'uuid': '66b6832b-a1b2-4da9-addc-63f223a4cc5a'}]}}} Oct 04 18:54:33.740249 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:54:33.740249 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:54:33.740249 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:54:33.740249 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:54:33.740249 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:54:33.740249 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:54:33.740249 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Oct 04 18:54:33.740249 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:54:33.740249 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Oct 04 18:54:33.740249 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Oct 04 18:54:33.740249 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:54:33.740249 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Oct 04 18:54:33.740249 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi 'invalid' Oct 04 18:54:33.740249 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:54:33.740249 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:54:33.740249 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:54:33.740249 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:54:33.740249 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:54:33.740249 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:54:33.740249 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:54:33.740249 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:54:33.740249 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:54:33.740249 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:54:33.744632 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:54:33.744632 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:54:33.744632 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 18:54:33.744632 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 18:54:33.744632 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:54:33.744632 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:54:33.744632 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:54:33.744632 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:54:33.744632 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 04 18:54:33.744632 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:54:33.744632 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:54:33.744632 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:54:33.744632 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:54:33.744632 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:54:33.744632 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:54:33.744632 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:54:33.744632 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:54:33.744632 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 04 18:54:33.744632 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:54:33.744632 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-5ca1d260-0647-40e6-ac41-08fe616d2cb1 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:54:33.746170 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-5ca1d260-0647-40e6-ac41-08fe616d2cb1 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.017832 Oct 04 18:54:33.751276 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2507/4716] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 18:54:33 2022] POST /compute/v2.1/servers => generated 155 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:54:33.771045 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-7b34d931-ee3e-4776-891f-2fac4a987154 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:33.773585 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-7b34d931-ee3e-4776-891f-2fac4a987154 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 01e250ab-d9aa-4708-ae36-10c53a411a40] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:33.797002 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7b34d931-ee3e-4776-891f-2fac4a987154 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:33.797928 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7b34d931-ee3e-4776-891f-2fac4a987154 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:33.798637 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7b34d931-ee3e-4776-891f-2fac4a987154 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:33.799631 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7b34d931-ee3e-4776-891f-2fac4a987154 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:33.800312 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7b34d931-ee3e-4776-891f-2fac4a987154 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:33.800948 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7b34d931-ee3e-4776-891f-2fac4a987154 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:34.382279 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=4 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:54:34.786340 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-7b34d931-ee3e-4776-891f-2fac4a987154 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f63f1ac147543dab34a28a22eb5936c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1607b30b9f324abaa88aa29e04ef3ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:34.797642 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-7b34d931-ee3e-4776-891f-2fac4a987154 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40" status: 200 len: 1505 microversion: 2.1 time: 1.045642 Oct 04 18:54:34.799744 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2508/4717] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:33 2022] GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40 => generated 1505 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:34.833022 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-2c10a612-e689-40ec-abe1-2c323388e4f7 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:34.835668 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-2c10a612-e689-40ec-abe1-2c323388e4f7 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 01e250ab-d9aa-4708-ae36-10c53a411a40] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:34.847018 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2c10a612-e689-40ec-abe1-2c323388e4f7 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:34.849564 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2c10a612-e689-40ec-abe1-2c323388e4f7 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:34.851828 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2c10a612-e689-40ec-abe1-2c323388e4f7 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:34.852840 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2c10a612-e689-40ec-abe1-2c323388e4f7 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:34.855691 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2c10a612-e689-40ec-abe1-2c323388e4f7 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:34.856211 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2c10a612-e689-40ec-abe1-2c323388e4f7 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:36.039050 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-c983401d-9deb-4cc1-b8df-7f427a36a2de tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Flavor limits 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:54:36.040719 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-c983401d-9deb-4cc1-b8df-7f427a36a2de tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Image limits 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:54:36.048538 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-c983401d-9deb-4cc1-b8df-7f427a36a2de tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Flavor pref 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:54:36.049470 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-c983401d-9deb-4cc1-b8df-7f427a36a2de tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Image pref 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:54:36.050079 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-c983401d-9deb-4cc1-b8df-7f427a36a2de tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:54:36.085384 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c983401d-9deb-4cc1-b8df-7f427a36a2de tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:36.085893 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c983401d-9deb-4cc1-b8df-7f427a36a2de tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:36.093408 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c983401d-9deb-4cc1-b8df-7f427a36a2de tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:36.094382 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c983401d-9deb-4cc1-b8df-7f427a36a2de tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:36.094879 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c983401d-9deb-4cc1-b8df-7f427a36a2de tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:36.097756 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c983401d-9deb-4cc1-b8df-7f427a36a2de tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:36.158220 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-c983401d-9deb-4cc1-b8df-7f427a36a2de tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Getting quotas for project 6c91c7e7358048ffaaee7f51ad61b515. Resources: {'ram', 'cores', 'instances'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:54:36.173375 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-c983401d-9deb-4cc1-b8df-7f427a36a2de tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Getting quotas for user 486c22456b1e47ae843ae41f8dfb2632 and project 6c91c7e7358048ffaaee7f51ad61b515. Resources: {'ram', 'cores', 'instances'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:54:36.215743 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-c983401d-9deb-4cc1-b8df-7f427a36a2de tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Going to run 1 instances... {{(pid=123595) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:54:36.223745 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-c983401d-9deb-4cc1-b8df-7f427a36a2de tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] [instance: 523fce83-2292-42b0-9b99-c9ac2c48e544] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e8943ec5-4038-4d4b-b9b9-2415a79f5243',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:54:36.344657 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-c983401d-9deb-4cc1-b8df-7f427a36a2de tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 3.341867 Oct 04 18:54:36.346092 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2210/4718] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 18:54:33 2022] POST /compute/v2.1/servers => generated 401 bytes in 3344 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:54:36.360197 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-9d74ab8c-f347-4836-b866-d960aa8f70f8 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:36.361824 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-9d74ab8c-f347-4836-b866-d960aa8f70f8 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] [instance: 523fce83-2292-42b0-9b99-c9ac2c48e544] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:36.578719 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-9d74ab8c-f347-4836-b866-d960aa8f70f8 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '486c22456b1e47ae843ae41f8dfb2632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c91c7e7358048ffaaee7f51ad61b515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:36.588948 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-9d74ab8c-f347-4836-b866-d960aa8f70f8 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] 10.222.0.43 "GET /compute/v2.1/servers/523fce83-2292-42b0-9b99-c9ac2c48e544" status: 200 len: 1240 microversion: 2.1 time: 0.235065 Oct 04 18:54:36.592716 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2211/4719] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:36 2022] GET /compute/v2.1/servers/523fce83-2292-42b0-9b99-c9ac2c48e544 => generated 1240 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:36.707350 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-2c10a612-e689-40ec-abe1-2c323388e4f7 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f63f1ac147543dab34a28a22eb5936c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1607b30b9f324abaa88aa29e04ef3ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:36.763379 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-2c10a612-e689-40ec-abe1-2c323388e4f7 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40" status: 200 len: 1505 microversion: 2.1 time: 1.915827 Oct 04 18:54:36.766648 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2509/4720] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:34 2022] GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40 => generated 1505 bytes in 1943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:37.081537 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-2fa59b0a-573e-4f8a-b49d-8fbab768d9fa tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1287258160", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "66b6832b-a1b2-4da9-addc-63f223a4cc5a"}]}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:54:37.095295 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-2fa59b0a-573e-4f8a-b49d-8fbab768d9fa tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Request method failure captured: Oct 04 18:54:37.095295 n-d-851028-13 devstack@n-api.service[123595]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 18:54:37.095295 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 18:54:37.095295 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 18:54:37.095295 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 18:54:37.095295 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 492 Oct 04 18:54:37.095295 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 18:54:37.095295 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 18:54:37.095295 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 18:54:37.095295 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 18:54:37.095295 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPIEZsAoFcr6P1AMHBWUo8LvryOn1l2-LYSKr4xgLCvHblWFuAiGVlStWcljkgzOc7-ldx7qv3C-2jYmQ32_Zk5yP28dI64Re9CsyHCLmsYfyJdD0-2_kU92lHK36Fs8oXqXU2FijNX-X4IYqe4GjOQDN7LB9zCeEIcrxQ2LRJFOwbQY Oct 04 18:54:37.095295 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 18:54:37.095295 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 18:54:37.095295 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 18:54:37.095295 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 18:54:37.095295 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 18:54:37.095295 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 18:54:37.095295 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: 1607b30b9f324abaa88aa29e04ef3ec4 Oct 04 18:54:37.095295 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-ServersNegativeTestJSON-708693932 Oct 04 18:54:37.095295 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 18:54:37.095295 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 18:54:37.095295 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/1607b30b9f324abaa88aa29e04ef3ec4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_1607b30b9f324abaa88aa29e04ef3ec4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1607b30b9f324abaa88aa29e04ef3ec4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1607b30b9f324abaa88aa29e04ef3ec4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:54:37.095295 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-ServersNegativeTestJSON-708693932 Oct 04 18:54:37.095295 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: 1607b30b9f324abaa88aa29e04ef3ec4 Oct 04 18:54:37.095295 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-ServersNegativeTestJSON-708693932 Oct 04 18:54:37.095295 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-ServersNegativeTestJSON-708693932-project Oct 04 18:54:37.095295 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 18:54:37.095295 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 18:54:37.095295 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: 6f63f1ac147543dab34a28a22eb5936c Oct 04 18:54:37.095295 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-ServersNegativeTestJSON-708693932-project Oct 04 18:54:37.095295 n-d-851028-13 devstack@n-api.service[123595]: Oct 04 18:54:37.095295 n-d-851028-13 devstack@n-api.service[123595]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1287258160", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "66b6832b-a1b2-4da9-addc-63f223a4cc5a"}]}} Oct 04 18:54:37.095295 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 18:54:37.095295 n-d-851028-13 devstack@n-api.service[123595]: exception: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 04 18:54:37.095295 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1287258160', 'imageRef': 'e8943ec5-4038-4d4b-b9b9-2415a79f5243', 'flavorRef': '452', 'metadata': {'a': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}, 'networks': [{'uuid': '66b6832b-a1b2-4da9-addc-63f223a4cc5a'}]}}} Oct 04 18:54:37.095295 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:54:37.095295 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:54:37.095295 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:54:37.095295 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:54:37.095295 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:54:37.095295 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:54:37.095295 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 04 18:54:37.095295 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:54:37.095295 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['metadata']['patternProperties']['^[a-zA-Z0-9-_:. ]{1,255}$']: Oct 04 18:54:37.095295 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi {'maxLength': 255, 'type': 'string'} Oct 04 18:54:37.095295 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:54:37.095295 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi On instance['server']['metadata']: Oct 04 18:54:37.099149 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' Oct 04 18:54:37.099149 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:54:37.099149 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:54:37.099149 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:54:37.099149 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:54:37.099149 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:54:37.099149 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:54:37.099149 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:54:37.099149 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:54:37.099149 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:54:37.099149 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:54:37.099149 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:54:37.099149 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:54:37.099149 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 18:54:37.099149 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 18:54:37.099149 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:54:37.099149 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:54:37.099149 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:54:37.099149 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:54:37.099149 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 04 18:54:37.099149 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:54:37.099149 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:54:37.099149 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:54:37.099149 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:54:37.099149 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:54:37.099149 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:54:37.099149 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:54:37.099149 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:54:37.099149 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 04 18:54:37.099149 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:54:37.108384 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-2fa59b0a-573e-4f8a-b49d-8fbab768d9fa tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:54:37.111700 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-2fa59b0a-573e-4f8a-b49d-8fbab768d9fa tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.032822 Oct 04 18:54:37.113475 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2212/4721] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 18:54:37 2022] POST /compute/v2.1/servers => generated 624 bytes in 37 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:54:37.129485 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-58a3c63c-e89f-406e-83c9-e80318194ab8 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:37.130280 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-58a3c63c-e89f-406e-83c9-e80318194ab8 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 01e250ab-d9aa-4708-ae36-10c53a411a40] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:37.186325 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-58a3c63c-e89f-406e-83c9-e80318194ab8 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:37.194861 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-58a3c63c-e89f-406e-83c9-e80318194ab8 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:37.198570 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-58a3c63c-e89f-406e-83c9-e80318194ab8 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:37.199677 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-58a3c63c-e89f-406e-83c9-e80318194ab8 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:37.200331 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-58a3c63c-e89f-406e-83c9-e80318194ab8 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:37.201906 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-58a3c63c-e89f-406e-83c9-e80318194ab8 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:37.621327 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-73cecfe5-5608-419e-99d1-37c09d40e94b tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:37.621946 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-73cecfe5-5608-419e-99d1-37c09d40e94b tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] [instance: 523fce83-2292-42b0-9b99-c9ac2c48e544] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:37.866015 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-73cecfe5-5608-419e-99d1-37c09d40e94b tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '486c22456b1e47ae843ae41f8dfb2632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c91c7e7358048ffaaee7f51ad61b515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:37.879735 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-73cecfe5-5608-419e-99d1-37c09d40e94b tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] 10.222.0.43 "GET /compute/v2.1/servers/523fce83-2292-42b0-9b99-c9ac2c48e544" status: 200 len: 1240 microversion: 2.1 time: 0.259391 Oct 04 18:54:37.880846 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2213/4722] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:37 2022] GET /compute/v2.1/servers/523fce83-2292-42b0-9b99-c9ac2c48e544 => generated 1240 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:38.648747 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-58a3c63c-e89f-406e-83c9-e80318194ab8 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f63f1ac147543dab34a28a22eb5936c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1607b30b9f324abaa88aa29e04ef3ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:38.668974 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-58a3c63c-e89f-406e-83c9-e80318194ab8 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40" status: 200 len: 1505 microversion: 2.1 time: 1.549551 Oct 04 18:54:38.692247 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2510/4723] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:37 2022] GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40 => generated 1505 bytes in 1576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:38.709857 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-e67cf153-940f-49b9-8ab6-f088852d0eb1 tempest-ImagesDeleteNegativeTestJSON-46222705 tempest-ImagesDeleteNegativeTestJSON-46222705-project] 10.222.0.43 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.324711 Oct 04 18:54:38.716239 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2214/4724] 10.222.0.43 () {58 vars in 1128 bytes} [Tue Oct 4 18:54:38 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Oct 04 18:54:38.726263 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-4f9dae4a-7c6b-4037-bbb1-3f5d1da393af tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:38.729423 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-4f9dae4a-7c6b-4037-bbb1-3f5d1da393af tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 01e250ab-d9aa-4708-ae36-10c53a411a40] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:38.729927 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-3e373ffa-760d-4cb2-bcec-de2c8b73b075 tempest-ImagesDeleteNegativeTestJSON-46222705 tempest-ImagesDeleteNegativeTestJSON-46222705-project] Calling method '.version_select at 0x7fb21fb7a160>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:38.756225 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4f9dae4a-7c6b-4037-bbb1-3f5d1da393af tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:38.760076 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4f9dae4a-7c6b-4037-bbb1-3f5d1da393af tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:38.760536 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4f9dae4a-7c6b-4037-bbb1-3f5d1da393af tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:38.762896 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4f9dae4a-7c6b-4037-bbb1-3f5d1da393af tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:38.766748 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4f9dae4a-7c6b-4037-bbb1-3f5d1da393af tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:38.767305 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4f9dae4a-7c6b-4037-bbb1-3f5d1da393af tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:38.807959 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-3e373ffa-760d-4cb2-bcec-de2c8b73b075 tempest-ImagesDeleteNegativeTestJSON-46222705 tempest-ImagesDeleteNegativeTestJSON-46222705-project] HTTP exception thrown: Image not found. Oct 04 18:54:38.809974 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-3e373ffa-760d-4cb2-bcec-de2c8b73b075 tempest-ImagesDeleteNegativeTestJSON-46222705 tempest-ImagesDeleteNegativeTestJSON-46222705-project] Request method failure captured: Oct 04 18:54:38.809974 n-d-851028-13 devstack@n-api.service[123595]: request: DELETE /compute/v2.1/images/-1 HTTP/1.1 Oct 04 18:54:38.809974 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 18:54:38.809974 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 18:54:38.809974 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 18:54:38.809974 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 0 Oct 04 18:54:38.809974 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 18:54:38.809974 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 18:54:38.809974 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 18:54:38.809974 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 18:54:38.809974 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPIFuNJueKBkDB0T76C-a_mX3-uCKWc0vSxip4z46mH6fPux4nG-q0Ix9ht76eIOhlxNg2PAWlpE2hANE3pQ93_o0cgGdOzBK4ekwxRQ5YcX89JpZM1VA8oqTocT1MH0o0_Q_s-uOLtB_vgBCTsJ7VkKOGJHhVoji9bJEf4tbSuuXgK8 Oct 04 18:54:38.809974 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 18:54:38.809974 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 18:54:38.809974 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 18:54:38.809974 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 18:54:38.809974 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 18:54:38.809974 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 18:54:38.809974 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: d13ac9cf8bd54feeab24e9a75eaa977c Oct 04 18:54:38.809974 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-46222705 Oct 04 18:54:38.809974 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 18:54:38.809974 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 18:54:38.809974 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/d13ac9cf8bd54feeab24e9a75eaa977c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_d13ac9cf8bd54feeab24e9a75eaa977c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d13ac9cf8bd54feeab24e9a75eaa977c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d13ac9cf8bd54feeab24e9a75eaa977c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:54:38.809974 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-46222705 Oct 04 18:54:38.809974 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: d13ac9cf8bd54feeab24e9a75eaa977c Oct 04 18:54:38.809974 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-46222705 Oct 04 18:54:38.809974 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-ImagesDeleteNegativeTestJSON-46222705-project Oct 04 18:54:38.809974 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 18:54:38.809974 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 18:54:38.809974 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: 55eb798a04924fc4a1ccf07503f19fbb Oct 04 18:54:38.809974 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-46222705-project Oct 04 18:54:38.809974 n-d-851028-13 devstack@n-api.service[123595]: method: Oct 04 18:54:38.809974 n-d-851028-13 devstack@n-api.service[123595]: exception: Image not found. Oct 04 18:54:38.809974 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': '-1'} Oct 04 18:54:38.809974 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:54:38.809974 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:54:38.809974 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 04 18:54:38.809974 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 04 18:54:38.809974 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 18:54:38.809974 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 18:54:38.809974 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 18:54:38.809974 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 18:54:38.809974 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 04 18:54:38.809974 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 04 18:54:38.809974 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 04 18:54:38.809974 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 04 18:54:38.809974 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 18:54:38.809974 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 18:54:38.809974 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 18:54:38.809974 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 18:54:38.809974 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image -1 to delete Oct 04 18:54:38.809974 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:54:38.809974 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:54:38.809974 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:54:38.809974 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:54:38.809974 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 04 18:54:38.809974 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 04 18:54:38.809974 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 04 18:54:38.809974 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 04 18:54:38.809974 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 04 18:54:38.809974 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 04 18:54:38.809974 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image -1 could not be found. Oct 04 18:54:38.809974 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:54:38.809974 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:54:38.809974 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:54:38.809974 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:54:38.815730 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:54:38.815730 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:54:38.815730 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:54:38.815730 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:54:38.815730 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:54:38.815730 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:54:38.815730 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:54:38.815730 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:54:38.815730 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 04 18:54:38.815730 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 18:54:38.815730 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 18:54:38.815730 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:54:38.815730 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:54:38.815730 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:54:38.815730 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:54:38.815730 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:54:38.815730 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:54:38.815730 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:54:38.815730 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:54:38.815730 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 18:54:38.815730 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:54:38.815730 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-3e373ffa-760d-4cb2-bcec-de2c8b73b075 tempest-ImagesDeleteNegativeTestJSON-46222705 tempest-ImagesDeleteNegativeTestJSON-46222705-project] Returning 404 to user: Image not found. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:54:38.815730 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-3e373ffa-760d-4cb2-bcec-de2c8b73b075 tempest-ImagesDeleteNegativeTestJSON-46222705 tempest-ImagesDeleteNegativeTestJSON-46222705-project] 10.222.0.43 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.090358 Oct 04 18:54:38.815730 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2215/4725] 10.222.0.43 () {58 vars in 1134 bytes} [Tue Oct 4 18:54:38 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 04 18:54:38.824189 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-2d7ad5dd-fe94-411f-9246-e0590fbae6a6 tempest-ImagesDeleteNegativeTestJSON-46222705 tempest-ImagesDeleteNegativeTestJSON-46222705-project] Calling method '.version_select at 0x7fb21eb2ad30>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:38.862565 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-2d7ad5dd-fe94-411f-9246-e0590fbae6a6 tempest-ImagesDeleteNegativeTestJSON-46222705 tempest-ImagesDeleteNegativeTestJSON-46222705-project] HTTP exception thrown: Image not found. Oct 04 18:54:38.865404 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-2d7ad5dd-fe94-411f-9246-e0590fbae6a6 tempest-ImagesDeleteNegativeTestJSON-46222705 tempest-ImagesDeleteNegativeTestJSON-46222705-project] Request method failure captured: Oct 04 18:54:38.865404 n-d-851028-13 devstack@n-api.service[123595]: request: DELETE /compute/v2.1/images/a4f53afb-e8f5-420e-9000-9cac9f4dfffj HTTP/1.1 Oct 04 18:54:38.865404 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 18:54:38.865404 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 18:54:38.865404 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 18:54:38.865404 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 0 Oct 04 18:54:38.865404 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 18:54:38.865404 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 18:54:38.865404 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 18:54:38.865404 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 18:54:38.865404 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPIFuNJueKBkDB0T76C-a_mX3-uCKWc0vSxip4z46mH6fPux4nG-q0Ix9ht76eIOhlxNg2PAWlpE2hANE3pQ93_o0cgGdOzBK4ekwxRQ5YcX89JpZM1VA8oqTocT1MH0o0_Q_s-uOLtB_vgBCTsJ7VkKOGJHhVoji9bJEf4tbSuuXgK8 Oct 04 18:54:38.865404 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 18:54:38.865404 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 18:54:38.865404 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 18:54:38.865404 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 18:54:38.865404 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 18:54:38.865404 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 18:54:38.865404 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: d13ac9cf8bd54feeab24e9a75eaa977c Oct 04 18:54:38.865404 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-46222705 Oct 04 18:54:38.865404 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 18:54:38.865404 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 18:54:38.865404 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/d13ac9cf8bd54feeab24e9a75eaa977c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_d13ac9cf8bd54feeab24e9a75eaa977c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d13ac9cf8bd54feeab24e9a75eaa977c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d13ac9cf8bd54feeab24e9a75eaa977c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:54:38.865404 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-46222705 Oct 04 18:54:38.865404 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: d13ac9cf8bd54feeab24e9a75eaa977c Oct 04 18:54:38.865404 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-46222705 Oct 04 18:54:38.865404 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-ImagesDeleteNegativeTestJSON-46222705-project Oct 04 18:54:38.865404 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 18:54:38.865404 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 18:54:38.865404 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: 55eb798a04924fc4a1ccf07503f19fbb Oct 04 18:54:38.865404 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-46222705-project Oct 04 18:54:38.865404 n-d-851028-13 devstack@n-api.service[123595]: method: Oct 04 18:54:38.865404 n-d-851028-13 devstack@n-api.service[123595]: exception: Image not found. Oct 04 18:54:38.865404 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': 'a4f53afb-e8f5-420e-9000-9cac9f4dfffj'} Oct 04 18:54:38.865404 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:54:38.865404 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:54:38.865404 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 04 18:54:38.865404 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 04 18:54:38.865404 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 18:54:38.865404 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 18:54:38.865404 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 18:54:38.865404 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 18:54:38.865404 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 04 18:54:38.865404 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 04 18:54:38.865404 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 04 18:54:38.865404 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 04 18:54:38.865404 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 18:54:38.865404 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 18:54:38.865404 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 18:54:38.865404 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 18:54:38.865404 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image a4f53afb-e8f5-420e-9000-9cac9f4dfffj to delete Oct 04 18:54:38.865404 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:54:38.865404 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:54:38.865404 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:54:38.865404 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:54:38.865404 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 04 18:54:38.865404 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 04 18:54:38.865404 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 04 18:54:38.865404 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 04 18:54:38.865404 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 04 18:54:38.865404 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 04 18:54:38.865404 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image a4f53afb-e8f5-420e-9000-9cac9f4dfffj could not be found. Oct 04 18:54:38.865404 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:54:38.865404 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:54:38.865404 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:54:38.871669 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:54:38.871669 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:54:38.871669 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:54:38.871669 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:54:38.871669 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:54:38.871669 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:54:38.871669 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:54:38.871669 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:54:38.871669 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:54:38.871669 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 04 18:54:38.871669 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 18:54:38.871669 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 18:54:38.871669 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:54:38.871669 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:54:38.871669 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:54:38.871669 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:54:38.871669 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:54:38.871669 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:54:38.871669 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:54:38.871669 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:54:38.871669 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 18:54:38.871669 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:54:38.871669 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-2d7ad5dd-fe94-411f-9246-e0590fbae6a6 tempest-ImagesDeleteNegativeTestJSON-46222705 tempest-ImagesDeleteNegativeTestJSON-46222705-project] Returning 404 to user: Image not found. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:54:38.871669 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-2d7ad5dd-fe94-411f-9246-e0590fbae6a6 tempest-ImagesDeleteNegativeTestJSON-46222705 tempest-ImagesDeleteNegativeTestJSON-46222705-project] 10.222.0.43 "DELETE /compute/v2.1/images/a4f53afb-e8f5-420e-9000-9cac9f4dfffj" status: 404 len: 62 microversion: 2.1 time: 0.049822 Oct 04 18:54:38.871669 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2216/4726] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:38 2022] DELETE /compute/v2.1/images/a4f53afb-e8f5-420e-9000-9cac9f4dfffj => generated 62 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 04 18:54:38.883530 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-36a9badf-a41b-4edf-8feb-903f0ed22850 tempest-ImagesDeleteNegativeTestJSON-46222705 tempest-ImagesDeleteNegativeTestJSON-46222705-project] Calling method '.version_select at 0x7fb21ed16c10>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:38.911339 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-36a9badf-a41b-4edf-8feb-903f0ed22850 tempest-ImagesDeleteNegativeTestJSON-46222705 tempest-ImagesDeleteNegativeTestJSON-46222705-project] HTTP exception thrown: Image not found. Oct 04 18:54:38.913252 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-36a9badf-a41b-4edf-8feb-903f0ed22850 tempest-ImagesDeleteNegativeTestJSON-46222705 tempest-ImagesDeleteNegativeTestJSON-46222705-project] Request method failure captured: Oct 04 18:54:38.913252 n-d-851028-13 devstack@n-api.service[123595]: request: DELETE /compute/v2.1/images/b369c39d-59dd-46dd-a4e1-a4605a6fd6e61 HTTP/1.1 Oct 04 18:54:38.913252 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 18:54:38.913252 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 18:54:38.913252 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 18:54:38.913252 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 0 Oct 04 18:54:38.913252 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 18:54:38.913252 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 18:54:38.913252 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 18:54:38.913252 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 18:54:38.913252 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPIFuNJueKBkDB0T76C-a_mX3-uCKWc0vSxip4z46mH6fPux4nG-q0Ix9ht76eIOhlxNg2PAWlpE2hANE3pQ93_o0cgGdOzBK4ekwxRQ5YcX89JpZM1VA8oqTocT1MH0o0_Q_s-uOLtB_vgBCTsJ7VkKOGJHhVoji9bJEf4tbSuuXgK8 Oct 04 18:54:38.913252 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 18:54:38.913252 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 18:54:38.913252 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 18:54:38.913252 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 18:54:38.913252 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 18:54:38.913252 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 18:54:38.913252 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: d13ac9cf8bd54feeab24e9a75eaa977c Oct 04 18:54:38.913252 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-46222705 Oct 04 18:54:38.913252 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 18:54:38.913252 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 18:54:38.913252 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/d13ac9cf8bd54feeab24e9a75eaa977c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_d13ac9cf8bd54feeab24e9a75eaa977c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d13ac9cf8bd54feeab24e9a75eaa977c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d13ac9cf8bd54feeab24e9a75eaa977c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:54:38.913252 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-46222705 Oct 04 18:54:38.913252 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: d13ac9cf8bd54feeab24e9a75eaa977c Oct 04 18:54:38.913252 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-46222705 Oct 04 18:54:38.913252 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-ImagesDeleteNegativeTestJSON-46222705-project Oct 04 18:54:38.913252 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 18:54:38.913252 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 18:54:38.913252 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: 55eb798a04924fc4a1ccf07503f19fbb Oct 04 18:54:38.913252 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-46222705-project Oct 04 18:54:38.913252 n-d-851028-13 devstack@n-api.service[123595]: method: Oct 04 18:54:38.913252 n-d-851028-13 devstack@n-api.service[123595]: exception: Image not found. Oct 04 18:54:38.913252 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': 'b369c39d-59dd-46dd-a4e1-a4605a6fd6e61'} Oct 04 18:54:38.913252 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:54:38.913252 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:54:38.913252 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 04 18:54:38.913252 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 04 18:54:38.913252 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 18:54:38.913252 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 18:54:38.913252 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 18:54:38.913252 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 18:54:38.913252 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 04 18:54:38.913252 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 04 18:54:38.913252 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 04 18:54:38.913252 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 04 18:54:38.913252 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 18:54:38.913252 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 18:54:38.913252 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 18:54:38.913252 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 18:54:38.913252 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image b369c39d-59dd-46dd-a4e1-a4605a6fd6e61 to delete Oct 04 18:54:38.913252 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:54:38.913252 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:54:38.913252 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:54:38.913252 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:54:38.913252 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 04 18:54:38.913252 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 04 18:54:38.913252 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 04 18:54:38.913252 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 04 18:54:38.913252 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 04 18:54:38.913252 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 04 18:54:38.913252 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image b369c39d-59dd-46dd-a4e1-a4605a6fd6e61 could not be found. Oct 04 18:54:38.913252 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:54:38.913252 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:54:38.913252 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:54:38.918171 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:54:38.918171 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:54:38.918171 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:54:38.918171 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:54:38.918171 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:54:38.918171 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:54:38.918171 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:54:38.918171 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:54:38.918171 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:54:38.918171 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 04 18:54:38.918171 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 18:54:38.918171 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 18:54:38.918171 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:54:38.918171 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:54:38.918171 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:54:38.918171 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:54:38.918171 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:54:38.918171 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:54:38.918171 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:54:38.918171 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:54:38.918171 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 18:54:38.918171 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:54:38.919790 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-36a9badf-a41b-4edf-8feb-903f0ed22850 tempest-ImagesDeleteNegativeTestJSON-46222705 tempest-ImagesDeleteNegativeTestJSON-46222705-project] Returning 404 to user: Image not found. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:54:38.921002 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-36a9badf-a41b-4edf-8feb-903f0ed22850 tempest-ImagesDeleteNegativeTestJSON-46222705 tempest-ImagesDeleteNegativeTestJSON-46222705-project] 10.222.0.43 "DELETE /compute/v2.1/images/b369c39d-59dd-46dd-a4e1-a4605a6fd6e61" status: 404 len: 62 microversion: 2.1 time: 0.043718 Oct 04 18:54:38.922252 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2217/4727] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 18:54:38 2022] DELETE /compute/v2.1/images/b369c39d-59dd-46dd-a4e1-a4605a6fd6e61 => generated 62 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:54:38.931657 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-274ecf47-5574-4ac9-8743-2df733dca7b5 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:38.932489 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-274ecf47-5574-4ac9-8743-2df733dca7b5 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] [instance: 523fce83-2292-42b0-9b99-c9ac2c48e544] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:38.941072 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-274ecf47-5574-4ac9-8743-2df733dca7b5 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:38.941855 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-274ecf47-5574-4ac9-8743-2df733dca7b5 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:38.942422 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-274ecf47-5574-4ac9-8743-2df733dca7b5 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:38.943547 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-274ecf47-5574-4ac9-8743-2df733dca7b5 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:38.944255 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-274ecf47-5574-4ac9-8743-2df733dca7b5 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:38.944944 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-274ecf47-5574-4ac9-8743-2df733dca7b5 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:39.269641 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-4f9dae4a-7c6b-4037-bbb1-3f5d1da393af tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f63f1ac147543dab34a28a22eb5936c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1607b30b9f324abaa88aa29e04ef3ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:39.278587 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-274ecf47-5574-4ac9-8743-2df733dca7b5 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '486c22456b1e47ae843ae41f8dfb2632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c91c7e7358048ffaaee7f51ad61b515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:39.286127 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-4f9dae4a-7c6b-4037-bbb1-3f5d1da393af tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40" status: 200 len: 1505 microversion: 2.1 time: 0.590807 Oct 04 18:54:39.286866 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2511/4728] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:38 2022] GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40 => generated 1505 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:39.302492 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-49ba9078-8017-4d55-93d2-46bf5c8e1ce3 tempest-ImagesDeleteNegativeTestJSON-46222705 tempest-ImagesDeleteNegativeTestJSON-46222705-project] Calling method '.version_select at 0x7fb227de2550>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:39.320439 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-274ecf47-5574-4ac9-8743-2df733dca7b5 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] 10.222.0.43 "GET /compute/v2.1/servers/523fce83-2292-42b0-9b99-c9ac2c48e544" status: 200 len: 1300 microversion: 2.1 time: 0.393089 Oct 04 18:54:39.323601 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2218/4729] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:38 2022] GET /compute/v2.1/servers/523fce83-2292-42b0-9b99-c9ac2c48e544 => generated 1300 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:39.373926 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-49ba9078-8017-4d55-93d2-46bf5c8e1ce3 tempest-ImagesDeleteNegativeTestJSON-46222705 tempest-ImagesDeleteNegativeTestJSON-46222705-project] HTTP exception thrown: Image not found. Oct 04 18:54:39.379743 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-49ba9078-8017-4d55-93d2-46bf5c8e1ce3 tempest-ImagesDeleteNegativeTestJSON-46222705 tempest-ImagesDeleteNegativeTestJSON-46222705-project] Request method failure captured: Oct 04 18:54:39.379743 n-d-851028-13 devstack@n-api.service[123596]: request: DELETE /compute/v2.1/images/tempest-invalid-553294027 HTTP/1.1 Oct 04 18:54:39.379743 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:54:39.379743 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:54:39.379743 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:54:39.379743 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 18:54:39.379743 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:54:39.379743 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:54:39.379743 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:54:39.379743 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:54:39.379743 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPIFuNJueKBkDB0T76C-a_mX3-uCKWc0vSxip4z46mH6fPux4nG-q0Ix9ht76eIOhlxNg2PAWlpE2hANE3pQ93_o0cgGdOzBK4ekwxRQ5YcX89JpZM1VA8oqTocT1MH0o0_Q_s-uOLtB_vgBCTsJ7VkKOGJHhVoji9bJEf4tbSuuXgK8 Oct 04 18:54:39.379743 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:54:39.379743 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:54:39.379743 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:54:39.379743 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:54:39.379743 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:54:39.379743 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:54:39.379743 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: d13ac9cf8bd54feeab24e9a75eaa977c Oct 04 18:54:39.379743 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-46222705 Oct 04 18:54:39.379743 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 18:54:39.379743 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 18:54:39.379743 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/d13ac9cf8bd54feeab24e9a75eaa977c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_d13ac9cf8bd54feeab24e9a75eaa977c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d13ac9cf8bd54feeab24e9a75eaa977c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d13ac9cf8bd54feeab24e9a75eaa977c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:54:39.379743 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-46222705 Oct 04 18:54:39.379743 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: d13ac9cf8bd54feeab24e9a75eaa977c Oct 04 18:54:39.379743 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-46222705 Oct 04 18:54:39.379743 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-ImagesDeleteNegativeTestJSON-46222705-project Oct 04 18:54:39.379743 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:54:39.379743 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:54:39.379743 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 55eb798a04924fc4a1ccf07503f19fbb Oct 04 18:54:39.379743 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-46222705-project Oct 04 18:54:39.379743 n-d-851028-13 devstack@n-api.service[123596]: method: Oct 04 18:54:39.379743 n-d-851028-13 devstack@n-api.service[123596]: exception: Image not found. Oct 04 18:54:39.379743 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': 'tempest-invalid-553294027'} Oct 04 18:54:39.379743 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:54:39.379743 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:54:39.379743 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 04 18:54:39.379743 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 04 18:54:39.379743 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 18:54:39.379743 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 18:54:39.379743 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 18:54:39.379743 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 18:54:39.379743 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 04 18:54:39.379743 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 04 18:54:39.379743 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 04 18:54:39.379743 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 04 18:54:39.379743 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 18:54:39.379743 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 18:54:39.379743 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 18:54:39.379743 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 18:54:39.379743 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image tempest-invalid-553294027 to delete Oct 04 18:54:39.379743 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:54:39.379743 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:54:39.379743 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:54:39.379743 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:54:39.379743 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 04 18:54:39.379743 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 04 18:54:39.379743 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 04 18:54:39.379743 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 04 18:54:39.379743 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 04 18:54:39.379743 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 04 18:54:39.379743 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image tempest-invalid-553294027 could not be found. Oct 04 18:54:39.379743 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:54:39.379743 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:54:39.379743 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:54:39.379743 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:54:39.383805 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:54:39.383805 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:54:39.383805 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:54:39.383805 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:54:39.383805 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:54:39.383805 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:54:39.383805 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:54:39.383805 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:54:39.383805 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 04 18:54:39.383805 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 18:54:39.383805 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 18:54:39.383805 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:54:39.383805 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:54:39.383805 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:54:39.383805 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:54:39.383805 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:54:39.383805 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:54:39.383805 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:54:39.383805 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:54:39.383805 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 18:54:39.383805 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:54:39.390994 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-49ba9078-8017-4d55-93d2-46bf5c8e1ce3 tempest-ImagesDeleteNegativeTestJSON-46222705 tempest-ImagesDeleteNegativeTestJSON-46222705-project] Returning 404 to user: Image not found. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:54:39.392137 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-49ba9078-8017-4d55-93d2-46bf5c8e1ce3 tempest-ImagesDeleteNegativeTestJSON-46222705 tempest-ImagesDeleteNegativeTestJSON-46222705-project] 10.222.0.43 "DELETE /compute/v2.1/images/tempest-invalid-553294027" status: 404 len: 62 microversion: 2.1 time: 0.104348 Oct 04 18:54:39.394670 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2512/4730] 10.222.0.43 () {58 vars in 1203 bytes} [Tue Oct 4 18:54:39 2022] DELETE /compute/v2.1/images/tempest-invalid-553294027 => generated 62 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:54:39.407573 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-2f303148-bee0-4150-8916-8bbbfa8de4b2 tempest-ImagesDeleteNegativeTestJSON-46222705 tempest-ImagesDeleteNegativeTestJSON-46222705-project] Calling method '.version_select at 0x7fb21ecd81f0>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:39.459058 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-2f303148-bee0-4150-8916-8bbbfa8de4b2 tempest-ImagesDeleteNegativeTestJSON-46222705 tempest-ImagesDeleteNegativeTestJSON-46222705-project] HTTP exception thrown: Image not found. Oct 04 18:54:39.461211 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-2f303148-bee0-4150-8916-8bbbfa8de4b2 tempest-ImagesDeleteNegativeTestJSON-46222705 tempest-ImagesDeleteNegativeTestJSON-46222705-project] Request method failure captured: Oct 04 18:54:39.461211 n-d-851028-13 devstack@n-api.service[123595]: request: DELETE /compute/v2.1/images/3431f0f1-6aaf-4bf3-82a9-de13315b4ad9 HTTP/1.1 Oct 04 18:54:39.461211 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 18:54:39.461211 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 18:54:39.461211 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 18:54:39.461211 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 0 Oct 04 18:54:39.461211 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 18:54:39.461211 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 18:54:39.461211 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 18:54:39.461211 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 18:54:39.461211 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPIFuNJueKBkDB0T76C-a_mX3-uCKWc0vSxip4z46mH6fPux4nG-q0Ix9ht76eIOhlxNg2PAWlpE2hANE3pQ93_o0cgGdOzBK4ekwxRQ5YcX89JpZM1VA8oqTocT1MH0o0_Q_s-uOLtB_vgBCTsJ7VkKOGJHhVoji9bJEf4tbSuuXgK8 Oct 04 18:54:39.461211 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 18:54:39.461211 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 18:54:39.461211 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 18:54:39.461211 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 18:54:39.461211 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 18:54:39.461211 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 18:54:39.461211 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: d13ac9cf8bd54feeab24e9a75eaa977c Oct 04 18:54:39.461211 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-46222705 Oct 04 18:54:39.461211 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 18:54:39.461211 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 18:54:39.461211 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/d13ac9cf8bd54feeab24e9a75eaa977c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_d13ac9cf8bd54feeab24e9a75eaa977c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d13ac9cf8bd54feeab24e9a75eaa977c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d13ac9cf8bd54feeab24e9a75eaa977c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:54:39.461211 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-46222705 Oct 04 18:54:39.461211 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: d13ac9cf8bd54feeab24e9a75eaa977c Oct 04 18:54:39.461211 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-46222705 Oct 04 18:54:39.461211 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-ImagesDeleteNegativeTestJSON-46222705-project Oct 04 18:54:39.461211 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 18:54:39.461211 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 18:54:39.461211 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: 55eb798a04924fc4a1ccf07503f19fbb Oct 04 18:54:39.461211 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-46222705-project Oct 04 18:54:39.461211 n-d-851028-13 devstack@n-api.service[123595]: method: Oct 04 18:54:39.461211 n-d-851028-13 devstack@n-api.service[123595]: exception: Image not found. Oct 04 18:54:39.461211 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': '3431f0f1-6aaf-4bf3-82a9-de13315b4ad9'} Oct 04 18:54:39.461211 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:54:39.461211 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:54:39.461211 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 04 18:54:39.461211 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 04 18:54:39.461211 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 18:54:39.461211 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 18:54:39.461211 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 18:54:39.461211 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 18:54:39.461211 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 04 18:54:39.461211 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 04 18:54:39.461211 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 04 18:54:39.461211 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 04 18:54:39.461211 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 18:54:39.461211 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 18:54:39.461211 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 18:54:39.461211 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 18:54:39.461211 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 3431f0f1-6aaf-4bf3-82a9-de13315b4ad9 to delete Oct 04 18:54:39.461211 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:54:39.461211 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:54:39.461211 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:54:39.461211 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:54:39.461211 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 04 18:54:39.461211 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 04 18:54:39.461211 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 04 18:54:39.461211 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 04 18:54:39.461211 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 04 18:54:39.461211 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 04 18:54:39.461211 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 3431f0f1-6aaf-4bf3-82a9-de13315b4ad9 could not be found. Oct 04 18:54:39.461211 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:54:39.461211 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:54:39.461211 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:54:39.465319 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:54:39.465319 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:54:39.465319 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:54:39.465319 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:54:39.465319 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:54:39.465319 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:54:39.465319 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:54:39.465319 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:54:39.465319 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:54:39.465319 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 04 18:54:39.465319 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 18:54:39.465319 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 18:54:39.465319 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:54:39.465319 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:54:39.465319 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:54:39.465319 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:54:39.465319 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:54:39.465319 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:54:39.465319 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:54:39.465319 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:54:39.465319 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 18:54:39.465319 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:54:39.465319 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-2f303148-bee0-4150-8916-8bbbfa8de4b2 tempest-ImagesDeleteNegativeTestJSON-46222705 tempest-ImagesDeleteNegativeTestJSON-46222705-project] Returning 404 to user: Image not found. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:54:39.465319 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-2f303148-bee0-4150-8916-8bbbfa8de4b2 tempest-ImagesDeleteNegativeTestJSON-46222705 tempest-ImagesDeleteNegativeTestJSON-46222705-project] 10.222.0.43 "DELETE /compute/v2.1/images/3431f0f1-6aaf-4bf3-82a9-de13315b4ad9" status: 404 len: 62 microversion: 2.1 time: 0.061616 Oct 04 18:54:39.469956 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2219/4731] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:39 2022] DELETE /compute/v2.1/images/3431f0f1-6aaf-4bf3-82a9-de13315b4ad9 => generated 62 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 04 18:54:39.595405 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-d3c6dd4c-27a7-4f97-8ed1-892a00335d81 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452", "networks": [{"uuid": "66b6832b-a1b2-4da9-addc-63f223a4cc5a"}]}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:54:39.608438 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-d3c6dd4c-27a7-4f97-8ed1-892a00335d81 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Request method failure captured: Oct 04 18:54:39.608438 n-d-851028-13 devstack@n-api.service[123596]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 18:54:39.608438 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:54:39.608438 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:54:39.608438 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:54:39.608438 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 416 Oct 04 18:54:39.608438 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:54:39.608438 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:54:39.608438 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:54:39.608438 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:54:39.608438 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPIEZsAoFcr6P1AMHBWUo8LvryOn1l2-LYSKr4xgLCvHblWFuAiGVlStWcljkgzOc7-ldx7qv3C-2jYmQ32_Zk5yP28dI64Re9CsyHCLmsYfyJdD0-2_kU92lHK36Fs8oXqXU2FijNX-X4IYqe4GjOQDN7LB9zCeEIcrxQ2LRJFOwbQY Oct 04 18:54:39.608438 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:54:39.608438 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:54:39.608438 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:54:39.608438 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:54:39.608438 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:54:39.608438 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:54:39.608438 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: 1607b30b9f324abaa88aa29e04ef3ec4 Oct 04 18:54:39.608438 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-ServersNegativeTestJSON-708693932 Oct 04 18:54:39.608438 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 18:54:39.608438 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 18:54:39.608438 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/1607b30b9f324abaa88aa29e04ef3ec4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_1607b30b9f324abaa88aa29e04ef3ec4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1607b30b9f324abaa88aa29e04ef3ec4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1607b30b9f324abaa88aa29e04ef3ec4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:54:39.608438 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-ServersNegativeTestJSON-708693932 Oct 04 18:54:39.608438 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: 1607b30b9f324abaa88aa29e04ef3ec4 Oct 04 18:54:39.608438 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-ServersNegativeTestJSON-708693932 Oct 04 18:54:39.608438 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-ServersNegativeTestJSON-708693932-project Oct 04 18:54:39.608438 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:54:39.608438 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:54:39.608438 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 6f63f1ac147543dab34a28a22eb5936c Oct 04 18:54:39.608438 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-ServersNegativeTestJSON-708693932-project Oct 04 18:54:39.608438 n-d-851028-13 devstack@n-api.service[123596]: Oct 04 18:54:39.608438 n-d-851028-13 devstack@n-api.service[123596]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452", "networks": [{"uuid": "66b6832b-a1b2-4da9-addc-63f223a4cc5a"}]}} Oct 04 18:54:39.608438 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 18:54:39.608438 n-d-851028-13 devstack@n-api.service[123596]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 04 18:54:39.608438 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'imageRef': 'e8943ec5-4038-4d4b-b9b9-2415a79f5243', 'flavorRef': '452', 'networks': [{'uuid': '66b6832b-a1b2-4da9-addc-63f223a4cc5a'}]}}} Oct 04 18:54:39.608438 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:54:39.608438 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:54:39.608438 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:54:39.608438 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:54:39.608438 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:54:39.608438 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:54:39.608438 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 04 18:54:39.608438 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:54:39.608438 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Oct 04 18:54:39.608438 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 04 18:54:39.608438 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:54:39.608438 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 04 18:54:39.608438 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 04 18:54:39.608438 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:54:39.608438 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:54:39.612491 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:54:39.612491 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:54:39.612491 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:54:39.612491 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:54:39.612491 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:54:39.612491 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:54:39.612491 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:54:39.612491 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:54:39.612491 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:54:39.612491 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:54:39.612491 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 18:54:39.612491 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 18:54:39.612491 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:54:39.612491 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:54:39.612491 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:54:39.612491 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:54:39.612491 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 04 18:54:39.612491 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:54:39.612491 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:54:39.612491 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:54:39.612491 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:54:39.612491 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:54:39.612491 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:54:39.612491 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:54:39.612491 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:54:39.612491 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 04 18:54:39.612491 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:54:39.615031 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-d3c6dd4c-27a7-4f97-8ed1-892a00335d81 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:54:39.617558 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-d3c6dd4c-27a7-4f97-8ed1-892a00335d81 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.026056 Oct 04 18:54:39.620630 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2513/4732] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 18:54:39 2022] POST /compute/v2.1/servers => generated 619 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:54:39.632298 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-5829a01a-7434-478c-ad37-a13c5db27e99 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:39.633065 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-5829a01a-7434-478c-ad37-a13c5db27e99 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 01e250ab-d9aa-4708-ae36-10c53a411a40] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:39.667232 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5829a01a-7434-478c-ad37-a13c5db27e99 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:39.667755 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5829a01a-7434-478c-ad37-a13c5db27e99 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:39.668201 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5829a01a-7434-478c-ad37-a13c5db27e99 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:39.679272 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5829a01a-7434-478c-ad37-a13c5db27e99 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:39.679896 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5829a01a-7434-478c-ad37-a13c5db27e99 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:39.680358 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5829a01a-7434-478c-ad37-a13c5db27e99 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:40.354334 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-4d93e559-7963-4dba-9e7f-a4ee82daf849 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:40.355856 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-4d93e559-7963-4dba-9e7f-a4ee82daf849 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] [instance: 523fce83-2292-42b0-9b99-c9ac2c48e544] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:40.372362 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4d93e559-7963-4dba-9e7f-a4ee82daf849 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:40.373605 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4d93e559-7963-4dba-9e7f-a4ee82daf849 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:40.374441 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4d93e559-7963-4dba-9e7f-a4ee82daf849 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:40.376378 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4d93e559-7963-4dba-9e7f-a4ee82daf849 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:40.377765 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4d93e559-7963-4dba-9e7f-a4ee82daf849 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:40.380441 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4d93e559-7963-4dba-9e7f-a4ee82daf849 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:40.554091 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-4d93e559-7963-4dba-9e7f-a4ee82daf849 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '486c22456b1e47ae843ae41f8dfb2632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c91c7e7358048ffaaee7f51ad61b515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:40.573490 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-4d93e559-7963-4dba-9e7f-a4ee82daf849 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] 10.222.0.43 "GET /compute/v2.1/servers/523fce83-2292-42b0-9b99-c9ac2c48e544" status: 200 len: 1298 microversion: 2.1 time: 0.223007 Oct 04 18:54:40.576275 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2514/4733] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:40 2022] GET /compute/v2.1/servers/523fce83-2292-42b0-9b99-c9ac2c48e544 => generated 1298 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:40.858887 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-5829a01a-7434-478c-ad37-a13c5db27e99 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f63f1ac147543dab34a28a22eb5936c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1607b30b9f324abaa88aa29e04ef3ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:40.874077 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-5829a01a-7434-478c-ad37-a13c5db27e99 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40" status: 200 len: 1505 microversion: 2.1 time: 1.246397 Oct 04 18:54:40.895464 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2220/4734] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:39 2022] GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40 => generated 1505 bytes in 1269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:40.907199 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-512f0335-dcb5-4049-a9c7-d3b370065471 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:40.907840 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-512f0335-dcb5-4049-a9c7-d3b370065471 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 01e250ab-d9aa-4708-ae36-10c53a411a40] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:40.918267 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-512f0335-dcb5-4049-a9c7-d3b370065471 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:40.924140 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-512f0335-dcb5-4049-a9c7-d3b370065471 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:40.924650 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-512f0335-dcb5-4049-a9c7-d3b370065471 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:40.925537 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-512f0335-dcb5-4049-a9c7-d3b370065471 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:40.926211 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-512f0335-dcb5-4049-a9c7-d3b370065471 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:40.927074 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-512f0335-dcb5-4049-a9c7-d3b370065471 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:41.563979 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-512f0335-dcb5-4049-a9c7-d3b370065471 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f63f1ac147543dab34a28a22eb5936c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1607b30b9f324abaa88aa29e04ef3ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:41.575952 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:54:41.583243 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-512f0335-dcb5-4049-a9c7-d3b370065471 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40" status: 200 len: 1505 microversion: 2.1 time: 0.683079 Oct 04 18:54:41.586041 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2515/4735] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:40 2022] GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40 => generated 1505 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:41.615213 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-90384391-e4b8-456e-9406-c93247965854 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:41.616232 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-90384391-e4b8-456e-9406-c93247965854 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] [instance: 523fce83-2292-42b0-9b99-c9ac2c48e544] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:41.641174 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-90384391-e4b8-456e-9406-c93247965854 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:41.641922 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-90384391-e4b8-456e-9406-c93247965854 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:41.642391 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-90384391-e4b8-456e-9406-c93247965854 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:41.643855 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-90384391-e4b8-456e-9406-c93247965854 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:41.644325 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-90384391-e4b8-456e-9406-c93247965854 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:41.646106 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-90384391-e4b8-456e-9406-c93247965854 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:41.888495 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-62043378-8ac9-4545-8e1b-d0d9e8b6ea92 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-785112618", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": -1, "networks": [{"uuid": "66b6832b-a1b2-4da9-addc-63f223a4cc5a"}]}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:54:41.893875 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-90384391-e4b8-456e-9406-c93247965854 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '486c22456b1e47ae843ae41f8dfb2632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c91c7e7358048ffaaee7f51ad61b515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:41.915168 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-90384391-e4b8-456e-9406-c93247965854 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] 10.222.0.43 "GET /compute/v2.1/servers/523fce83-2292-42b0-9b99-c9ac2c48e544" status: 200 len: 1298 microversion: 2.1 time: 0.301887 Oct 04 18:54:41.918379 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2221/4736] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:41 2022] GET /compute/v2.1/servers/523fce83-2292-42b0-9b99-c9ac2c48e544 => generated 1298 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:41.935478 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-62043378-8ac9-4545-8e1b-d0d9e8b6ea92 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] HTTP exception thrown: Flavor -1 could not be found. Oct 04 18:54:41.947600 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-62043378-8ac9-4545-8e1b-d0d9e8b6ea92 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Request method failure captured: Oct 04 18:54:41.947600 n-d-851028-13 devstack@n-api.service[123596]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 18:54:41.947600 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:54:41.947600 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:54:41.947600 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:54:41.947600 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 205 Oct 04 18:54:41.947600 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:54:41.947600 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:54:41.947600 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:54:41.947600 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:54:41.947600 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPIEZsAoFcr6P1AMHBWUo8LvryOn1l2-LYSKr4xgLCvHblWFuAiGVlStWcljkgzOc7-ldx7qv3C-2jYmQ32_Zk5yP28dI64Re9CsyHCLmsYfyJdD0-2_kU92lHK36Fs8oXqXU2FijNX-X4IYqe4GjOQDN7LB9zCeEIcrxQ2LRJFOwbQY Oct 04 18:54:41.947600 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:54:41.947600 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:54:41.947600 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:54:41.947600 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:54:41.947600 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:54:41.947600 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:54:41.947600 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: 1607b30b9f324abaa88aa29e04ef3ec4 Oct 04 18:54:41.947600 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-ServersNegativeTestJSON-708693932 Oct 04 18:54:41.947600 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 18:54:41.947600 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 18:54:41.947600 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/1607b30b9f324abaa88aa29e04ef3ec4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_1607b30b9f324abaa88aa29e04ef3ec4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1607b30b9f324abaa88aa29e04ef3ec4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1607b30b9f324abaa88aa29e04ef3ec4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:54:41.947600 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-ServersNegativeTestJSON-708693932 Oct 04 18:54:41.947600 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: 1607b30b9f324abaa88aa29e04ef3ec4 Oct 04 18:54:41.947600 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-ServersNegativeTestJSON-708693932 Oct 04 18:54:41.947600 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-ServersNegativeTestJSON-708693932-project Oct 04 18:54:41.947600 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:54:41.947600 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:54:41.947600 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 6f63f1ac147543dab34a28a22eb5936c Oct 04 18:54:41.947600 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-ServersNegativeTestJSON-708693932-project Oct 04 18:54:41.947600 n-d-851028-13 devstack@n-api.service[123596]: Oct 04 18:54:41.947600 n-d-851028-13 devstack@n-api.service[123596]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-785112618", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": -1, "networks": [{"uuid": "66b6832b-a1b2-4da9-addc-63f223a4cc5a"}]}} Oct 04 18:54:41.947600 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 18:54:41.947600 n-d-851028-13 devstack@n-api.service[123596]: exception: Flavor -1 could not be found. Oct 04 18:54:41.947600 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-785112618', 'imageRef': 'e8943ec5-4038-4d4b-b9b9-2415a79f5243', 'flavorRef': -1, 'networks': [{'uuid': '66b6832b-a1b2-4da9-addc-63f223a4cc5a'}]}}} Oct 04 18:54:41.947600 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:54:41.947600 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:54:41.947600 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Oct 04 18:54:41.947600 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Oct 04 18:54:41.947600 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 04 18:54:41.947600 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 04 18:54:41.947600 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 18:54:41.947600 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 18:54:41.947600 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 04 18:54:41.947600 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 04 18:54:41.947600 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 04 18:54:41.947600 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:54:41.947600 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 04 18:54:41.947600 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 04 18:54:41.947600 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor -1 could not be found. Oct 04 18:54:41.947600 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:54:41.947600 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:54:41.947600 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:54:41.947600 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:54:41.947600 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:54:41.947600 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:54:41.947600 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:54:41.947600 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:54:41.947600 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:54:41.947600 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:54:41.947600 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:54:41.947600 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:54:41.953426 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:54:41.953426 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:54:41.953426 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:54:41.953426 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:54:41.953426 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 18:54:41.953426 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 04 18:54:41.953426 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 04 18:54:41.953426 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor -1 could not be found. Oct 04 18:54:41.953426 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:54:41.953426 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:54:41.953426 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:54:41.953426 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:54:41.953426 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:54:41.953426 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:54:41.953426 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:54:41.953426 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:54:41.953426 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor -1 could not be found. Oct 04 18:54:41.953426 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:54:41.959151 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-62043378-8ac9-4545-8e1b-d0d9e8b6ea92 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:54:41.960051 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-62043378-8ac9-4545-8e1b-d0d9e8b6ea92 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.076272 Oct 04 18:54:41.960833 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2516/4737] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 18:54:41 2022] POST /compute/v2.1/servers => generated 73 bytes in 77 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Oct 04 18:54:41.970297 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-59da3752-1ed3-46a0-b423-002e097972e6 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:41.971083 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-59da3752-1ed3-46a0-b423-002e097972e6 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 01e250ab-d9aa-4708-ae36-10c53a411a40] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:41.998432 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-59da3752-1ed3-46a0-b423-002e097972e6 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:41.999449 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-59da3752-1ed3-46a0-b423-002e097972e6 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:42.000165 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-59da3752-1ed3-46a0-b423-002e097972e6 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:42.001956 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-59da3752-1ed3-46a0-b423-002e097972e6 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:42.006354 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-59da3752-1ed3-46a0-b423-002e097972e6 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:42.007130 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-59da3752-1ed3-46a0-b423-002e097972e6 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:42.573989 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-59da3752-1ed3-46a0-b423-002e097972e6 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f63f1ac147543dab34a28a22eb5936c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1607b30b9f324abaa88aa29e04ef3ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:42.584166 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-59da3752-1ed3-46a0-b423-002e097972e6 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40" status: 200 len: 1505 microversion: 2.1 time: 0.618618 Oct 04 18:54:42.590222 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2222/4738] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:41 2022] GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40 => generated 1505 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:42.616846 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-2134b4db-0125-4dd7-9107-9ae023bee68f tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:42.624294 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-2134b4db-0125-4dd7-9107-9ae023bee68f tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 01e250ab-d9aa-4708-ae36-10c53a411a40] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:42.635135 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2134b4db-0125-4dd7-9107-9ae023bee68f tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:42.635899 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2134b4db-0125-4dd7-9107-9ae023bee68f tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:42.636977 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2134b4db-0125-4dd7-9107-9ae023bee68f tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:42.638385 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2134b4db-0125-4dd7-9107-9ae023bee68f tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:42.639628 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2134b4db-0125-4dd7-9107-9ae023bee68f tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:42.640436 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2134b4db-0125-4dd7-9107-9ae023bee68f tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:42.945201 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-f55ac1c8-5e42-44a7-8df3-70470fd54b73 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:42.945826 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-f55ac1c8-5e42-44a7-8df3-70470fd54b73 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] [instance: 523fce83-2292-42b0-9b99-c9ac2c48e544] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:42.961377 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f55ac1c8-5e42-44a7-8df3-70470fd54b73 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:42.962244 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f55ac1c8-5e42-44a7-8df3-70470fd54b73 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:42.962879 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f55ac1c8-5e42-44a7-8df3-70470fd54b73 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:42.963773 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f55ac1c8-5e42-44a7-8df3-70470fd54b73 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:42.964402 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f55ac1c8-5e42-44a7-8df3-70470fd54b73 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:42.965019 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f55ac1c8-5e42-44a7-8df3-70470fd54b73 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:43.067772 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-2134b4db-0125-4dd7-9107-9ae023bee68f tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f63f1ac147543dab34a28a22eb5936c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1607b30b9f324abaa88aa29e04ef3ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:43.077579 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-2134b4db-0125-4dd7-9107-9ae023bee68f tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40" status: 200 len: 1505 microversion: 2.1 time: 0.468511 Oct 04 18:54:43.094187 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2517/4739] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:42 2022] GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40 => generated 1505 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:43.369908 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-a559d807-cbfe-45fe-8d00-e302df35dc72 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-109761049", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "66b6832b-a1b2-4da9-addc-63f223a4cc5a"}]}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:54:43.380057 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-a559d807-cbfe-45fe-8d00-e302df35dc72 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Request method failure captured: Oct 04 18:54:43.380057 n-d-851028-13 devstack@n-api.service[123596]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 18:54:43.380057 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:54:43.380057 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:54:43.380057 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:54:43.380057 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 172 Oct 04 18:54:43.380057 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:54:43.380057 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:54:43.380057 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:54:43.380057 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:54:43.380057 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPIEZsAoFcr6P1AMHBWUo8LvryOn1l2-LYSKr4xgLCvHblWFuAiGVlStWcljkgzOc7-ldx7qv3C-2jYmQ32_Zk5yP28dI64Re9CsyHCLmsYfyJdD0-2_kU92lHK36Fs8oXqXU2FijNX-X4IYqe4GjOQDN7LB9zCeEIcrxQ2LRJFOwbQY Oct 04 18:54:43.380057 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:54:43.380057 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:54:43.380057 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:54:43.380057 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:54:43.380057 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:54:43.380057 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:54:43.380057 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: 1607b30b9f324abaa88aa29e04ef3ec4 Oct 04 18:54:43.380057 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-ServersNegativeTestJSON-708693932 Oct 04 18:54:43.380057 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 18:54:43.380057 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 18:54:43.380057 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/1607b30b9f324abaa88aa29e04ef3ec4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_1607b30b9f324abaa88aa29e04ef3ec4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1607b30b9f324abaa88aa29e04ef3ec4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1607b30b9f324abaa88aa29e04ef3ec4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:54:43.380057 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-ServersNegativeTestJSON-708693932 Oct 04 18:54:43.380057 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: 1607b30b9f324abaa88aa29e04ef3ec4 Oct 04 18:54:43.380057 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-ServersNegativeTestJSON-708693932 Oct 04 18:54:43.380057 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-ServersNegativeTestJSON-708693932-project Oct 04 18:54:43.380057 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:54:43.380057 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:54:43.380057 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 6f63f1ac147543dab34a28a22eb5936c Oct 04 18:54:43.380057 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-ServersNegativeTestJSON-708693932-project Oct 04 18:54:43.380057 n-d-851028-13 devstack@n-api.service[123596]: Oct 04 18:54:43.380057 n-d-851028-13 devstack@n-api.service[123596]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-109761049", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "66b6832b-a1b2-4da9-addc-63f223a4cc5a"}]}} Oct 04 18:54:43.380057 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 18:54:43.380057 n-d-851028-13 devstack@n-api.service[123596]: exception: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 04 18:54:43.380057 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-109761049', 'imageRef': -1, 'flavorRef': '452', 'networks': [{'uuid': '66b6832b-a1b2-4da9-addc-63f223a4cc5a'}]}}} Oct 04 18:54:43.380057 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:54:43.380057 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:54:43.380057 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:54:43.380057 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:54:43.380057 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:54:43.380057 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:54:43.380057 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: -1 is not valid under any of the given schemas Oct 04 18:54:43.380057 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:54:43.380057 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['server']['properties']['imageRef']: Oct 04 18:54:43.380057 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'uuid', 'type': 'string'}, Oct 04 18:54:43.380057 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi {'maxLength': 0, 'type': 'string'}]} Oct 04 18:54:43.380057 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:54:43.380057 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 04 18:54:43.380057 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi -1 Oct 04 18:54:43.380057 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:54:43.380057 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:54:43.380057 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:54:43.380057 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:54:43.380057 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:54:43.380057 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:54:43.380057 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:54:43.380057 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:54:43.380057 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:54:43.380057 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:54:43.380057 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:54:43.380057 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:54:43.380057 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 18:54:43.380057 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 18:54:43.380057 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:54:43.380057 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:54:43.385202 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:54:43.385202 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:54:43.385202 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 04 18:54:43.385202 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:54:43.385202 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:54:43.385202 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:54:43.385202 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:54:43.385202 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:54:43.385202 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:54:43.385202 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:54:43.385202 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:54:43.385202 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 04 18:54:43.385202 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:54:43.387181 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-a559d807-cbfe-45fe-8d00-e302df35dc72 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:54:43.395246 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-a559d807-cbfe-45fe-8d00-e302df35dc72 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.029245 Oct 04 18:54:43.397271 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2518/4740] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 18:54:43 2022] POST /compute/v2.1/servers => generated 145 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:54:43.419648 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-826996f3-499b-45f0-84c5-2ee85b9b8e44 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:43.422193 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-826996f3-499b-45f0-84c5-2ee85b9b8e44 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 01e250ab-d9aa-4708-ae36-10c53a411a40] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:43.431531 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-826996f3-499b-45f0-84c5-2ee85b9b8e44 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:43.452805 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-826996f3-499b-45f0-84c5-2ee85b9b8e44 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:43.453874 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-826996f3-499b-45f0-84c5-2ee85b9b8e44 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:43.454876 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-826996f3-499b-45f0-84c5-2ee85b9b8e44 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:43.456181 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-826996f3-499b-45f0-84c5-2ee85b9b8e44 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:43.458191 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-826996f3-499b-45f0-84c5-2ee85b9b8e44 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:43.778196 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-f55ac1c8-5e42-44a7-8df3-70470fd54b73 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '486c22456b1e47ae843ae41f8dfb2632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c91c7e7358048ffaaee7f51ad61b515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:43.808245 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-f55ac1c8-5e42-44a7-8df3-70470fd54b73 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] 10.222.0.43 "GET /compute/v2.1/servers/523fce83-2292-42b0-9b99-c9ac2c48e544" status: 200 len: 1298 microversion: 2.1 time: 0.864161 Oct 04 18:54:43.808893 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2223/4741] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:42 2022] GET /compute/v2.1/servers/523fce83-2292-42b0-9b99-c9ac2c48e544 => generated 1298 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:44.223823 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-826996f3-499b-45f0-84c5-2ee85b9b8e44 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f63f1ac147543dab34a28a22eb5936c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1607b30b9f324abaa88aa29e04ef3ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:44.237499 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-826996f3-499b-45f0-84c5-2ee85b9b8e44 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40" status: 200 len: 1505 microversion: 2.1 time: 0.834786 Oct 04 18:54:44.238657 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2519/4742] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:43 2022] GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40 => generated 1505 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:44.271271 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-d4c9f1f8-8d56-4959-ad48-7b52aecb96e6 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:44.271970 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-d4c9f1f8-8d56-4959-ad48-7b52aecb96e6 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 01e250ab-d9aa-4708-ae36-10c53a411a40] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:44.295520 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d4c9f1f8-8d56-4959-ad48-7b52aecb96e6 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:44.296088 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d4c9f1f8-8d56-4959-ad48-7b52aecb96e6 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:44.298885 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d4c9f1f8-8d56-4959-ad48-7b52aecb96e6 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:44.301205 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d4c9f1f8-8d56-4959-ad48-7b52aecb96e6 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:44.303218 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d4c9f1f8-8d56-4959-ad48-7b52aecb96e6 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:44.305531 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d4c9f1f8-8d56-4959-ad48-7b52aecb96e6 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:44.841161 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-54d1833b-d363-4d80-9cc7-8098e0f970c9 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:44.848317 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-54d1833b-d363-4d80-9cc7-8098e0f970c9 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] [instance: 523fce83-2292-42b0-9b99-c9ac2c48e544] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:44.853076 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:54:44.872817 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-54d1833b-d363-4d80-9cc7-8098e0f970c9 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:44.876444 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-54d1833b-d363-4d80-9cc7-8098e0f970c9 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:44.877080 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-54d1833b-d363-4d80-9cc7-8098e0f970c9 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:44.879490 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-54d1833b-d363-4d80-9cc7-8098e0f970c9 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:44.880372 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-54d1833b-d363-4d80-9cc7-8098e0f970c9 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:44.882275 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-54d1833b-d363-4d80-9cc7-8098e0f970c9 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:45.803568 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-54d1833b-d363-4d80-9cc7-8098e0f970c9 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '486c22456b1e47ae843ae41f8dfb2632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c91c7e7358048ffaaee7f51ad61b515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:45.820363 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-54d1833b-d363-4d80-9cc7-8098e0f970c9 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] 10.222.0.43 "GET /compute/v2.1/servers/523fce83-2292-42b0-9b99-c9ac2c48e544" status: 200 len: 1365 microversion: 2.1 time: 0.992021 Oct 04 18:54:45.839852 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2520/4743] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:44 2022] GET /compute/v2.1/servers/523fce83-2292-42b0-9b99-c9ac2c48e544 => generated 1365 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:45.895727 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-c58e7e26-a009-4668-9663-66426ad8edb4 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Action: 'create', calling method: .version_select at 0x7fb21f222dc0>, body: {"keypair": {"name": "tempest-keypair-1958839162", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA/cjapNfucKuBuqhKzxtv5He3UCWgoPiHv8jM66yvRNwov33rJoRDIK1KTmJT+exApDO1NKLJ1sFI1ztoGSBzu5wKM4j8sTqUoRTXIF4CCv0RNo+sDmJkOmdMKndzgsWA=="}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:54:45.958471 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-c58e7e26-a009-4668-9663-66426ad8edb4 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Getting quotas for project fea78afe01b240f79c3bb2cfc773e502. Resources: {'key_pairs'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:54:45.978220 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-c58e7e26-a009-4668-9663-66426ad8edb4 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Getting quotas for user 1dd8fa69e56d47bba065c558ad1f08e4 and project fea78afe01b240f79c3bb2cfc773e502. Resources: {'key_pairs'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:54:46.090636 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-c58e7e26-a009-4668-9663-66426ad8edb4 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.42 time: 0.198696 Oct 04 18:54:46.100927 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2521/4744] 10.222.0.43 () {62 vars in 1200 bytes} [Tue Oct 4 18:54:45 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 209 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 04 18:54:46.126881 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=2 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:54:46.325224 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-d4c9f1f8-8d56-4959-ad48-7b52aecb96e6 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f63f1ac147543dab34a28a22eb5936c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1607b30b9f324abaa88aa29e04ef3ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:46.345683 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-d4c9f1f8-8d56-4959-ad48-7b52aecb96e6 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40" status: 200 len: 1505 microversion: 2.1 time: 2.083991 Oct 04 18:54:46.347165 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2224/4745] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:44 2022] GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40 => generated 1505 bytes in 2086 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:46.796159 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-8c2de448-42f4-4f24-932d-4e1be1f9dbea tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1298076386", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:54:46.810057 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-8c2de448-42f4-4f24-932d-4e1be1f9dbea tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 04 18:54:46.816967 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-8c2de448-42f4-4f24-932d-4e1be1f9dbea tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Request method failure captured: Oct 04 18:54:46.816967 n-d-851028-13 devstack@n-api.service[123596]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 18:54:46.816967 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:54:46.816967 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:54:46.816967 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:54:46.816967 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 216 Oct 04 18:54:46.816967 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:54:46.816967 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:54:46.816967 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:54:46.816967 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:54:46.816967 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPIEZsAoFcr6P1AMHBWUo8LvryOn1l2-LYSKr4xgLCvHblWFuAiGVlStWcljkgzOc7-ldx7qv3C-2jYmQ32_Zk5yP28dI64Re9CsyHCLmsYfyJdD0-2_kU92lHK36Fs8oXqXU2FijNX-X4IYqe4GjOQDN7LB9zCeEIcrxQ2LRJFOwbQY Oct 04 18:54:46.816967 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:54:46.816967 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:54:46.816967 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:54:46.816967 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:54:46.816967 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:54:46.816967 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:54:46.816967 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: 1607b30b9f324abaa88aa29e04ef3ec4 Oct 04 18:54:46.816967 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-ServersNegativeTestJSON-708693932 Oct 04 18:54:46.816967 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 18:54:46.816967 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 18:54:46.816967 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/1607b30b9f324abaa88aa29e04ef3ec4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_1607b30b9f324abaa88aa29e04ef3ec4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1607b30b9f324abaa88aa29e04ef3ec4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1607b30b9f324abaa88aa29e04ef3ec4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:54:46.816967 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-ServersNegativeTestJSON-708693932 Oct 04 18:54:46.816967 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: 1607b30b9f324abaa88aa29e04ef3ec4 Oct 04 18:54:46.816967 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-ServersNegativeTestJSON-708693932 Oct 04 18:54:46.816967 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-ServersNegativeTestJSON-708693932-project Oct 04 18:54:46.816967 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:54:46.816967 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:54:46.816967 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 6f63f1ac147543dab34a28a22eb5936c Oct 04 18:54:46.816967 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-ServersNegativeTestJSON-708693932-project Oct 04 18:54:46.816967 n-d-851028-13 devstack@n-api.service[123596]: Oct 04 18:54:46.816967 n-d-851028-13 devstack@n-api.service[123596]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1298076386", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} Oct 04 18:54:46.816967 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 18:54:46.816967 n-d-851028-13 devstack@n-api.service[123596]: exception: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 04 18:54:46.816967 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1298076386', 'imageRef': 'e8943ec5-4038-4d4b-b9b9-2415a79f5243', 'flavorRef': '452', 'networks': [{'fixed_ip': '10.0.1.1', 'uuid': 'a-b-c-d-e-f-g-h-i-j'}]}}} Oct 04 18:54:46.816967 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:54:46.816967 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:54:46.816967 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:54:46.816967 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:54:46.816967 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:54:46.816967 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:54:46.816967 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:54:46.816967 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:54:46.816967 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:54:46.816967 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:54:46.816967 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:54:46.816967 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:54:46.816967 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:54:46.816967 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:54:46.816967 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 18:54:46.816967 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 773, in create Oct 04 18:54:46.816967 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi self._process_networks_for_create( Oct 04 18:54:46.816967 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 547, in _process_networks_for_create Oct 04 18:54:46.816967 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi requested_networks = self._get_requested_networks( Oct 04 18:54:46.816967 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 447, in _get_requested_networks Oct 04 18:54:46.816967 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi self._validate_network_id( Oct 04 18:54:46.816967 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 396, in _validate_network_id Oct 04 18:54:46.816967 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 04 18:54:46.816967 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 04 18:54:46.816967 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:54:46.816967 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:54:46.816967 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:54:46.823914 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:54:46.823914 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:54:46.823914 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:54:46.823914 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:54:46.823914 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:54:46.823914 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 04 18:54:46.823914 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:54:46.823914 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-8c2de448-42f4-4f24-932d-4e1be1f9dbea tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:54:46.823914 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-8c2de448-42f4-4f24-932d-4e1be1f9dbea tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.027170 Oct 04 18:54:46.823914 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2522/4746] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 18:54:46 2022] POST /compute/v2.1/servers => generated 123 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:54:46.830346 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-29b00f65-6590-48e0-ad90-053dc6223bcc tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:46.831322 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-29b00f65-6590-48e0-ad90-053dc6223bcc tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 01e250ab-d9aa-4708-ae36-10c53a411a40] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:46.854371 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-29b00f65-6590-48e0-ad90-053dc6223bcc tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:46.854900 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-29b00f65-6590-48e0-ad90-053dc6223bcc tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:46.855355 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-29b00f65-6590-48e0-ad90-053dc6223bcc tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:46.856109 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-29b00f65-6590-48e0-ad90-053dc6223bcc tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:46.856553 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-29b00f65-6590-48e0-ad90-053dc6223bcc tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:46.856981 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-29b00f65-6590-48e0-ad90-053dc6223bcc tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:46.863750 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-ec827b38-a110-40c0-ba2b-29d7d7a23431 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:46.867789 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-ec827b38-a110-40c0-ba2b-29d7d7a23431 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] [instance: 523fce83-2292-42b0-9b99-c9ac2c48e544] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:46.901128 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ec827b38-a110-40c0-ba2b-29d7d7a23431 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:46.903289 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ec827b38-a110-40c0-ba2b-29d7d7a23431 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:46.904633 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ec827b38-a110-40c0-ba2b-29d7d7a23431 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:46.906170 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ec827b38-a110-40c0-ba2b-29d7d7a23431 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:46.911364 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ec827b38-a110-40c0-ba2b-29d7d7a23431 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:46.914128 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ec827b38-a110-40c0-ba2b-29d7d7a23431 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:47.424528 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-ec827b38-a110-40c0-ba2b-29d7d7a23431 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '486c22456b1e47ae843ae41f8dfb2632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c91c7e7358048ffaaee7f51ad61b515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:47.440567 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-ec827b38-a110-40c0-ba2b-29d7d7a23431 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] 10.222.0.43 "GET /compute/v2.1/servers/523fce83-2292-42b0-9b99-c9ac2c48e544" status: 200 len: 1365 microversion: 2.1 time: 0.595470 Oct 04 18:54:47.441345 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2523/4747] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:46 2022] GET /compute/v2.1/servers/523fce83-2292-42b0-9b99-c9ac2c48e544 => generated 1365 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:47.875420 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=10 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:54:48.037341 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-29b00f65-6590-48e0-ad90-053dc6223bcc tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f63f1ac147543dab34a28a22eb5936c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1607b30b9f324abaa88aa29e04ef3ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:48.063403 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-29b00f65-6590-48e0-ad90-053dc6223bcc tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40" status: 200 len: 1505 microversion: 2.1 time: 1.236510 Oct 04 18:54:48.066202 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2225/4748] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:46 2022] GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40 => generated 1505 bytes in 1240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:48.087681 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-283b8132-799c-4145-abec-b01543a03fcf tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:48.088321 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-283b8132-799c-4145-abec-b01543a03fcf tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 01e250ab-d9aa-4708-ae36-10c53a411a40] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:48.104168 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-283b8132-799c-4145-abec-b01543a03fcf tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:48.104678 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-283b8132-799c-4145-abec-b01543a03fcf tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:48.105141 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-283b8132-799c-4145-abec-b01543a03fcf tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:48.105871 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-283b8132-799c-4145-abec-b01543a03fcf tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:48.109476 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-283b8132-799c-4145-abec-b01543a03fcf tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:48.110336 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-283b8132-799c-4145-abec-b01543a03fcf tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:48.398415 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-283b8132-799c-4145-abec-b01543a03fcf tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f63f1ac147543dab34a28a22eb5936c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1607b30b9f324abaa88aa29e04ef3ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:48.408709 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-283b8132-799c-4145-abec-b01543a03fcf tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40" status: 200 len: 1505 microversion: 2.1 time: 0.324868 Oct 04 18:54:48.409152 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2524/4749] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:48 2022] GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40 => generated 1505 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:48.476796 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-dddf636c-23b1-4ca4-aef7-a80884ced704 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:48.479748 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-dddf636c-23b1-4ca4-aef7-a80884ced704 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] [instance: 523fce83-2292-42b0-9b99-c9ac2c48e544] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:48.490536 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dddf636c-23b1-4ca4-aef7-a80884ced704 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:48.491420 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dddf636c-23b1-4ca4-aef7-a80884ced704 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:48.492225 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dddf636c-23b1-4ca4-aef7-a80884ced704 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:48.493304 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dddf636c-23b1-4ca4-aef7-a80884ced704 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:48.494224 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dddf636c-23b1-4ca4-aef7-a80884ced704 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:48.495396 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dddf636c-23b1-4ca4-aef7-a80884ced704 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:48.656742 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-abf129df-b434-495d-b445-1e8fed7f0b13 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1599491339", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452", "key_name": "tempest-key-841327336", "networks": [{"uuid": "66b6832b-a1b2-4da9-addc-63f223a4cc5a"}]}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:54:48.802372 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.network.neutron [None req-abf129df-b434-495d-b445-1e8fed7f0b13 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] validate_networks() for [('66b6832b-a1b2-4da9-addc-63f223a4cc5a', None, None, None, None, None)] {{(pid=123596) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:54:49.583797 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-dddf636c-23b1-4ca4-aef7-a80884ced704 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '486c22456b1e47ae843ae41f8dfb2632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c91c7e7358048ffaaee7f51ad61b515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:49.598111 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-dddf636c-23b1-4ca4-aef7-a80884ced704 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] 10.222.0.43 "GET /compute/v2.1/servers/523fce83-2292-42b0-9b99-c9ac2c48e544" status: 200 len: 1365 microversion: 2.1 time: 1.131980 Oct 04 18:54:49.598763 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2226/4750] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:48 2022] GET /compute/v2.1/servers/523fce83-2292-42b0-9b99-c9ac2c48e544 => generated 1365 bytes in 1135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:49.656741 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-abf129df-b434-495d-b445-1e8fed7f0b13 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] HTTP exception thrown: Invalid key_name provided. Oct 04 18:54:49.659670 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-abf129df-b434-495d-b445-1e8fed7f0b13 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Request method failure captured: Oct 04 18:54:49.659670 n-d-851028-13 devstack@n-api.service[123596]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 18:54:49.659670 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:54:49.659670 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:54:49.659670 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:54:49.659670 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 246 Oct 04 18:54:49.659670 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:54:49.659670 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:54:49.659670 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:54:49.659670 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:54:49.659670 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPIEZsAoFcr6P1AMHBWUo8LvryOn1l2-LYSKr4xgLCvHblWFuAiGVlStWcljkgzOc7-ldx7qv3C-2jYmQ32_Zk5yP28dI64Re9CsyHCLmsYfyJdD0-2_kU92lHK36Fs8oXqXU2FijNX-X4IYqe4GjOQDN7LB9zCeEIcrxQ2LRJFOwbQY Oct 04 18:54:49.659670 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:54:49.659670 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:54:49.659670 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:54:49.659670 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:54:49.659670 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:54:49.659670 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:54:49.659670 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: 1607b30b9f324abaa88aa29e04ef3ec4 Oct 04 18:54:49.659670 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-ServersNegativeTestJSON-708693932 Oct 04 18:54:49.659670 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 18:54:49.659670 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 18:54:49.659670 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/1607b30b9f324abaa88aa29e04ef3ec4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_1607b30b9f324abaa88aa29e04ef3ec4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1607b30b9f324abaa88aa29e04ef3ec4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1607b30b9f324abaa88aa29e04ef3ec4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:54:49.659670 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-ServersNegativeTestJSON-708693932 Oct 04 18:54:49.659670 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: 1607b30b9f324abaa88aa29e04ef3ec4 Oct 04 18:54:49.659670 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-ServersNegativeTestJSON-708693932 Oct 04 18:54:49.659670 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-ServersNegativeTestJSON-708693932-project Oct 04 18:54:49.659670 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:54:49.659670 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:54:49.659670 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 6f63f1ac147543dab34a28a22eb5936c Oct 04 18:54:49.659670 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-ServersNegativeTestJSON-708693932-project Oct 04 18:54:49.659670 n-d-851028-13 devstack@n-api.service[123596]: Oct 04 18:54:49.659670 n-d-851028-13 devstack@n-api.service[123596]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1599491339", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452", "key_name": "tempest-key-841327336", "networks": [{"uuid": "66b6832b-a1b2-4da9-addc-63f223a4cc5a"}]}} Oct 04 18:54:49.659670 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 18:54:49.659670 n-d-851028-13 devstack@n-api.service[123596]: exception: Invalid key_name provided. Oct 04 18:54:49.659670 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1599491339', 'imageRef': 'e8943ec5-4038-4d4b-b9b9-2415a79f5243', 'flavorRef': '452', 'key_name': 'tempest-key-841327336', 'networks': [{'uuid': '66b6832b-a1b2-4da9-addc-63f223a4cc5a'}]}}} Oct 04 18:54:49.659670 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:54:49.659670 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:54:49.659670 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 18:54:49.659670 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 18:54:49.659670 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 18:54:49.659670 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 18:54:49.659670 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 18:54:49.659670 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 18:54:49.659670 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1089, in _validate_and_build_base_options Oct 04 18:54:49.659670 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi key_pair = objects.KeyPair.get_by_name(context, Oct 04 18:54:49.659670 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 18:54:49.659670 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 18:54:49.659670 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Oct 04 18:54:49.659670 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Oct 04 18:54:49.659670 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Oct 04 18:54:49.659670 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Oct 04 18:54:49.659670 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 18:54:49.659670 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 18:54:49.659670 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Oct 04 18:54:49.659670 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Oct 04 18:54:49.659670 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-key-841327336 not found for user 6f63f1ac147543dab34a28a22eb5936c Oct 04 18:54:49.659670 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:54:49.659670 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:54:49.659670 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:54:49.659670 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:54:49.659670 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:54:49.664381 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:54:49.664381 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:54:49.664381 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:54:49.664381 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:54:49.664381 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:54:49.664381 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:54:49.664381 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:54:49.664381 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:54:49.664381 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:54:49.664381 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:54:49.664381 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:54:49.664381 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 18:54:49.664381 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 807, in create Oct 04 18:54:49.664381 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 04 18:54:49.664381 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid key_name provided. Oct 04 18:54:49.664381 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:54:49.664381 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:54:49.664381 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:54:49.664381 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:54:49.664381 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:54:49.664381 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:54:49.664381 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:54:49.664381 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:54:49.664381 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid key_name provided. Oct 04 18:54:49.664381 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:54:49.679697 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-abf129df-b434-495d-b445-1e8fed7f0b13 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Returning 400 to user: Invalid key_name provided. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:54:49.682844 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-abf129df-b434-495d-b445-1e8fed7f0b13 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 1.032597 Oct 04 18:54:49.687273 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2525/4751] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 18:54:48 2022] POST /compute/v2.1/servers => generated 70 bytes in 1038 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 04 18:54:49.695295 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-975a60ff-8811-4ef0-a0d0-e9e04031d8ac tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:49.695912 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-975a60ff-8811-4ef0-a0d0-e9e04031d8ac tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 01e250ab-d9aa-4708-ae36-10c53a411a40] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:49.706447 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-975a60ff-8811-4ef0-a0d0-e9e04031d8ac tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:49.706793 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-975a60ff-8811-4ef0-a0d0-e9e04031d8ac tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:49.707243 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-975a60ff-8811-4ef0-a0d0-e9e04031d8ac tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:49.707957 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-975a60ff-8811-4ef0-a0d0-e9e04031d8ac tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:49.708413 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-975a60ff-8811-4ef0-a0d0-e9e04031d8ac tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:49.721709 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-975a60ff-8811-4ef0-a0d0-e9e04031d8ac tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:50.435655 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-975a60ff-8811-4ef0-a0d0-e9e04031d8ac tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f63f1ac147543dab34a28a22eb5936c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1607b30b9f324abaa88aa29e04ef3ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:50.468794 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-975a60ff-8811-4ef0-a0d0-e9e04031d8ac tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40" status: 200 len: 1505 microversion: 2.1 time: 0.775162 Oct 04 18:54:50.471737 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2227/4752] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:49 2022] GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40 => generated 1505 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:50.498084 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-59bee90a-da1d-4e41-95b4-ee7e619e328e tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1363058201", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "7ac10c98-281e-4adf-90c4-852ccb68ccd7"}, {"port": "b55a672a-c052-4f13-8fbc-232381ea2bbb", "tag": "port-1"}, {"port": "d6932e78-3478-434a-96dd-d933c1b1b369", "tag": "port-2"}, {"uuid": "ae7df3c4-4fdc-4493-bc4c-bb917d6f5a27", "tag": "net-1"}, {"uuid": "ae7df3c4-4fdc-4493-bc4c-bb917d6f5a27"}, {"uuid": "87cfbc06-acb5-4178-9ee4-7f5e768626b6", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "87cfbc06-acb5-4178-9ee4-7f5e768626b6", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "77696b08-499a-45c4-809c-9302d17059a1", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "ec56adde-983c-4a56-af08-c055172f6f3a", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "892584e5-94f9-4e6d-ae75-84ce468abe4f", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--254873052"}], "key_name": "tempest-keypair-1958839162", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:54:50.505750 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-9ba4e817-6001-4dd2-97b3-3a3290cd720e tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:50.506940 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-9ba4e817-6001-4dd2-97b3-3a3290cd720e tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 01e250ab-d9aa-4708-ae36-10c53a411a40] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:50.534040 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9ba4e817-6001-4dd2-97b3-3a3290cd720e tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:50.535855 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9ba4e817-6001-4dd2-97b3-3a3290cd720e tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:50.536589 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9ba4e817-6001-4dd2-97b3-3a3290cd720e tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:50.537608 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9ba4e817-6001-4dd2-97b3-3a3290cd720e tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:50.538313 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9ba4e817-6001-4dd2-97b3-3a3290cd720e tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:50.538994 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9ba4e817-6001-4dd2-97b3-3a3290cd720e tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:50.831743 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.network.neutron [None req-59bee90a-da1d-4e41-95b4-ee7e619e328e tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] validate_networks() for [('7ac10c98-281e-4adf-90c4-852ccb68ccd7', None, None, None, None, None), (None, None, 'b55a672a-c052-4f13-8fbc-232381ea2bbb', None, None, None), (None, None, 'd6932e78-3478-434a-96dd-d933c1b1b369', None, None, None), ('ae7df3c4-4fdc-4493-bc4c-bb917d6f5a27', None, None, None, None, None), ('ae7df3c4-4fdc-4493-bc4c-bb917d6f5a27', None, None, None, None, None), ('87cfbc06-acb5-4178-9ee4-7f5e768626b6', '10.2.2.100', None, None, None, None), ('87cfbc06-acb5-4178-9ee4-7f5e768626b6', '10.2.2.200', None, None, None, None)] {{(pid=123596) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:54:51.294662 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-9ba4e817-6001-4dd2-97b3-3a3290cd720e tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f63f1ac147543dab34a28a22eb5936c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1607b30b9f324abaa88aa29e04ef3ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:51.309208 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-9ba4e817-6001-4dd2-97b3-3a3290cd720e tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40" status: 200 len: 1505 microversion: 2.1 time: 0.802925 Oct 04 18:54:51.315114 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2228/4753] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:50 2022] GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40 => generated 1505 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:54:51.335247 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-3d0975ed-59ba-4acf-810e-199019a3bca9 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:51.336092 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-3d0975ed-59ba-4acf-810e-199019a3bca9 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] [instance: 523fce83-2292-42b0-9b99-c9ac2c48e544] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:51.362808 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3d0975ed-59ba-4acf-810e-199019a3bca9 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:51.376126 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3d0975ed-59ba-4acf-810e-199019a3bca9 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:51.376766 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3d0975ed-59ba-4acf-810e-199019a3bca9 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:51.377707 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3d0975ed-59ba-4acf-810e-199019a3bca9 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:51.378333 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3d0975ed-59ba-4acf-810e-199019a3bca9 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:51.378927 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3d0975ed-59ba-4acf-810e-199019a3bca9 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:52.611878 n-d-851028-13 devstack@n-api.service[123596]: Exception ignored in: . at 0x7fb21efbbc10> Oct 04 18:54:52.611878 n-d-851028-13 devstack@n-api.service[123596]: Traceback (most recent call last): Oct 04 18:54:52.611878 n-d-851028-13 devstack@n-api.service[123596]: File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/pool/base.py", line 488, in Oct 04 18:54:52.620181 n-d-851028-13 devstack@n-api.service[123596]: and _finalize_fairy(None, rec, pool, ref, echo, True), Oct 04 18:54:52.620181 n-d-851028-13 devstack@n-api.service[123596]: File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/pool/base.py", line 774, in _finalize_fairy Oct 04 18:54:52.621257 n-d-851028-13 devstack@n-api.service[123596]: connection_record.checkin() Oct 04 18:54:52.621257 n-d-851028-13 devstack@n-api.service[123596]: File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/pool/base.py", line 521, in checkin Oct 04 18:54:52.621563 n-d-851028-13 devstack@n-api.service[123596]: pool.dispatch.checkin(connection, self) Oct 04 18:54:52.621752 n-d-851028-13 devstack@n-api.service[123596]: File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/event/attr.py", line 343, in __call__ Oct 04 18:54:52.631638 n-d-851028-13 devstack@n-api.service[123596]: fn(*args, **kw) Oct 04 18:54:52.631832 n-d-851028-13 devstack@n-api.service[123596]: File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py", line 51, in _thread_yield Oct 04 18:54:52.641386 n-d-851028-13 devstack@n-api.service[123596]: time.sleep(0) Oct 04 18:54:52.642194 n-d-851028-13 devstack@n-api.service[123596]: File "/usr/local/lib/python3.8/dist-packages/eventlet/greenthread.py", line 33, in sleep Oct 04 18:54:52.644854 n-d-851028-13 devstack@n-api.service[123596]: assert hub.greenlet is not current, 'do not call blocking functions from the mainloop' Oct 04 18:54:52.645034 n-d-851028-13 devstack@n-api.service[123596]: AssertionError: do not call blocking functions from the mainloop Oct 04 18:54:52.757036 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-3d0975ed-59ba-4acf-810e-199019a3bca9 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '486c22456b1e47ae843ae41f8dfb2632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c91c7e7358048ffaaee7f51ad61b515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:52.766490 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-3d0975ed-59ba-4acf-810e-199019a3bca9 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] 10.222.0.43 "GET /compute/v2.1/servers/523fce83-2292-42b0-9b99-c9ac2c48e544" status: 200 len: 1365 microversion: 2.1 time: 1.439752 Oct 04 18:54:52.787451 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2229/4754] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:51 2022] GET /compute/v2.1/servers/523fce83-2292-42b0-9b99-c9ac2c48e544 => generated 1365 bytes in 1461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:52.800716 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-22b4a483-6313-473b-8e3d-3089c7b97d8d tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-866410879", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "66b6832b-a1b2-4da9-addc-63f223a4cc5a"}]}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:54:52.854316 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=4 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:54:53.285923 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.network.security_group_api [None req-22b4a483-6313-473b-8e3d-3089c7b97d8d tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Neutron security group does_not_exist not found {{(pid=123595) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} Oct 04 18:54:53.289665 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-22b4a483-6313-473b-8e3d-3089c7b97d8d tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' Oct 04 18:54:53.304517 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-22b4a483-6313-473b-8e3d-3089c7b97d8d tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Request method failure captured: Oct 04 18:54:53.304517 n-d-851028-13 devstack@n-api.service[123595]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 18:54:53.304517 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 18:54:53.304517 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 18:54:53.304517 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 18:54:53.304517 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 257 Oct 04 18:54:53.304517 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 18:54:53.304517 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 18:54:53.304517 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 18:54:53.304517 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 18:54:53.304517 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPIEZsAoFcr6P1AMHBWUo8LvryOn1l2-LYSKr4xgLCvHblWFuAiGVlStWcljkgzOc7-ldx7qv3C-2jYmQ32_Zk5yP28dI64Re9CsyHCLmsYfyJdD0-2_kU92lHK36Fs8oXqXU2FijNX-X4IYqe4GjOQDN7LB9zCeEIcrxQ2LRJFOwbQY Oct 04 18:54:53.304517 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 18:54:53.304517 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 18:54:53.304517 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 18:54:53.304517 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 18:54:53.304517 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 18:54:53.304517 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 18:54:53.304517 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: 1607b30b9f324abaa88aa29e04ef3ec4 Oct 04 18:54:53.304517 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-ServersNegativeTestJSON-708693932 Oct 04 18:54:53.304517 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 18:54:53.304517 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 18:54:53.304517 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/1607b30b9f324abaa88aa29e04ef3ec4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_1607b30b9f324abaa88aa29e04ef3ec4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1607b30b9f324abaa88aa29e04ef3ec4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1607b30b9f324abaa88aa29e04ef3ec4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:54:53.304517 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-ServersNegativeTestJSON-708693932 Oct 04 18:54:53.304517 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: 1607b30b9f324abaa88aa29e04ef3ec4 Oct 04 18:54:53.304517 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-ServersNegativeTestJSON-708693932 Oct 04 18:54:53.304517 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-ServersNegativeTestJSON-708693932-project Oct 04 18:54:53.304517 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 18:54:53.304517 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 18:54:53.304517 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: 6f63f1ac147543dab34a28a22eb5936c Oct 04 18:54:53.304517 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-ServersNegativeTestJSON-708693932-project Oct 04 18:54:53.304517 n-d-851028-13 devstack@n-api.service[123595]: Oct 04 18:54:53.304517 n-d-851028-13 devstack@n-api.service[123595]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-866410879", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "66b6832b-a1b2-4da9-addc-63f223a4cc5a"}]}} Oct 04 18:54:53.304517 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 18:54:53.304517 n-d-851028-13 devstack@n-api.service[123595]: exception: Unable to find security_group with name or id 'does_not_exist' Oct 04 18:54:53.304517 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-866410879', 'imageRef': 'e8943ec5-4038-4d4b-b9b9-2415a79f5243', 'flavorRef': '452', 'security_groups': [{'name': 'does_not_exist'}], 'networks': [{'uuid': '66b6832b-a1b2-4da9-addc-63f223a4cc5a'}]}}} Oct 04 18:54:53.304517 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:54:53.304517 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:54:53.304517 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 476, in find_resource Oct 04 18:54:53.304517 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return self.find_resource_by_id(resource, name_or_id, Oct 04 18:54:53.304517 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:54:53.304517 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:54:53.304517 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 440, in find_resource_by_id Oct 04 18:54:53.304517 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Oct 04 18:54:53.304517 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with id 'does_not_exist' Oct 04 18:54:53.304517 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:54:53.304517 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:54:53.304517 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:54:53.304517 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:54:53.304517 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 480, in find_resource Oct 04 18:54:53.304517 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return self._find_resource_by_name( Oct 04 18:54:53.304517 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:54:53.304517 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:54:53.304517 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 469, in _find_resource_by_name Oct 04 18:54:53.304517 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Oct 04 18:54:53.304517 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name 'does_not_exist' Oct 04 18:54:53.304517 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:54:53.304517 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:54:53.304517 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:54:53.304517 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:54:53.304517 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 68, in validate_name Oct 04 18:54:53.304517 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return neutronv20.find_resourceid_by_name_or_id( Oct 04 18:54:53.309933 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 56, in find_resourceid_by_name_or_id Oct 04 18:54:53.309933 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return find_resource_by_name_or_id(client, resource, name_or_id, Oct 04 18:54:53.309933 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 49, in find_resource_by_name_or_id Oct 04 18:54:53.309933 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return client.find_resource(resource, name_or_id, project_id, Oct 04 18:54:53.309933 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:54:53.309933 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:54:53.309933 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 488, in find_resource Oct 04 18:54:53.309933 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound( Oct 04 18:54:53.309933 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name or id 'does_not_exist' Oct 04 18:54:53.309933 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:54:53.309933 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:54:53.309933 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:54:53.309933 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:54:53.309933 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 18:54:53.309933 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 18:54:53.309933 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 18:54:53.309933 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 18:54:53.309933 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 18:54:53.309933 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 18:54:53.309933 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1074, in _validate_and_build_base_options Oct 04 18:54:53.309933 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi security_groups = self._check_requested_secgroups( Oct 04 18:54:53.309933 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 521, in _check_requested_secgroups Oct 04 18:54:53.309933 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi secgroup_uuid = security_group_api.validate_name(context, secgroup) Oct 04 18:54:53.309933 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 75, in validate_name Oct 04 18:54:53.309933 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 18:54:53.309933 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Unable to find security_group with name or id 'does_not_exist' Oct 04 18:54:53.309933 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:54:53.309933 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:54:53.309933 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:54:53.309933 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:54:53.309933 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:54:53.309933 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:54:53.309933 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:54:53.309933 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:54:53.309933 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:54:53.309933 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:54:53.309933 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:54:53.309933 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:54:53.309933 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:54:53.309933 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:54:53.309933 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:54:53.309933 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:54:53.309933 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 18:54:53.309933 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 04 18:54:53.309933 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 04 18:54:53.309933 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Unable to find security_group with name or id 'does_not_exist' Oct 04 18:54:53.309933 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:54:53.309933 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:54:53.309933 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:54:53.309933 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:54:53.309933 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:54:53.309933 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:54:53.309933 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:54:53.309933 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:54:53.309933 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unable to find security_group with name or id 'does_not_exist' Oct 04 18:54:53.309933 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:54:53.315106 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-22b4a483-6313-473b-8e3d-3089c7b97d8d tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:54:53.317348 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-22b4a483-6313-473b-8e3d-3089c7b97d8d tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 0.523445 Oct 04 18:54:53.320806 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2230/4755] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 18:54:52 2022] POST /compute/v2.1/servers => generated 106 bytes in 533 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:54:53.330888 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-3c7822ac-3928-4acb-9051-95297a825acb req-b9f7bc51-ff01-429d-86ef-8b2daecbf61e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "523fce83-2292-42b0-9b99-c9ac2c48e544", "tag": "1a8e604e-bf22-40c8-b5c0-f1df67aebd3a"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:54:53.356818 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-3c7822ac-3928-4acb-9051-95297a825acb req-b9f7bc51-ff01-429d-86ef-8b2daecbf61e service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:53.360002 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-3c7822ac-3928-4acb-9051-95297a825acb req-b9f7bc51-ff01-429d-86ef-8b2daecbf61e service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:53.360576 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-3c7822ac-3928-4acb-9051-95297a825acb req-b9f7bc51-ff01-429d-86ef-8b2daecbf61e service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:53.404662 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-3c7822ac-3928-4acb-9051-95297a825acb req-b9f7bc51-ff01-429d-86ef-8b2daecbf61e service nova] Creating event network-changed:1a8e604e-bf22-40c8-b5c0-f1df67aebd3a for instance 523fce83-2292-42b0-9b99-c9ac2c48e544 on n-h1-851028-13 Oct 04 18:54:53.413565 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-3c7822ac-3928-4acb-9051-95297a825acb req-b9f7bc51-ff01-429d-86ef-8b2daecbf61e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090845 Oct 04 18:54:53.414907 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2231/4756] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:54:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:54:53.421203 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-05505691-6603-4154-a9b3-f3c66e4e8742 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:53.422272 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-05505691-6603-4154-a9b3-f3c66e4e8742 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 01e250ab-d9aa-4708-ae36-10c53a411a40] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:53.429495 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-05505691-6603-4154-a9b3-f3c66e4e8742 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:53.430236 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-05505691-6603-4154-a9b3-f3c66e4e8742 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:53.430834 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-05505691-6603-4154-a9b3-f3c66e4e8742 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:53.432074 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-05505691-6603-4154-a9b3-f3c66e4e8742 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:53.432694 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-05505691-6603-4154-a9b3-f3c66e4e8742 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:53.433719 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-05505691-6603-4154-a9b3-f3c66e4e8742 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:54.135019 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-05505691-6603-4154-a9b3-f3c66e4e8742 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f63f1ac147543dab34a28a22eb5936c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1607b30b9f324abaa88aa29e04ef3ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:54.144602 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-05505691-6603-4154-a9b3-f3c66e4e8742 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40" status: 200 len: 1505 microversion: 2.1 time: 0.728097 Oct 04 18:54:54.150608 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2232/4757] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:53 2022] GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40 => generated 1505 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:54.161412 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-8ee0e533-a022-4990-9eaf-c3720223500d tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:54.162049 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-8ee0e533-a022-4990-9eaf-c3720223500d tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] [instance: 523fce83-2292-42b0-9b99-c9ac2c48e544] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:54.219663 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8ee0e533-a022-4990-9eaf-c3720223500d tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:54.220430 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8ee0e533-a022-4990-9eaf-c3720223500d tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:54.221661 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8ee0e533-a022-4990-9eaf-c3720223500d tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:54.222574 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8ee0e533-a022-4990-9eaf-c3720223500d tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:54.225049 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8ee0e533-a022-4990-9eaf-c3720223500d tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:54.226861 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8ee0e533-a022-4990-9eaf-c3720223500d tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:55.982651 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-8ee0e533-a022-4990-9eaf-c3720223500d tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '486c22456b1e47ae843ae41f8dfb2632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c91c7e7358048ffaaee7f51ad61b515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:55.991723 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-8ee0e533-a022-4990-9eaf-c3720223500d tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] 10.222.0.43 "GET /compute/v2.1/servers/523fce83-2292-42b0-9b99-c9ac2c48e544" status: 200 len: 1365 microversion: 2.1 time: 1.839931 Oct 04 18:54:56.009494 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2233/4758] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:54 2022] GET /compute/v2.1/servers/523fce83-2292-42b0-9b99-c9ac2c48e544 => generated 1365 bytes in 1858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:56.012605 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=4 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:54:56.028024 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-45ba6db0-3ac5-4c46-adb1-3edb56de250c tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:56.029195 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-45ba6db0-3ac5-4c46-adb1-3edb56de250c tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 01e250ab-d9aa-4708-ae36-10c53a411a40] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:56.048432 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-45ba6db0-3ac5-4c46-adb1-3edb56de250c tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:56.048846 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-45ba6db0-3ac5-4c46-adb1-3edb56de250c tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:56.049414 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-45ba6db0-3ac5-4c46-adb1-3edb56de250c tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:56.050314 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-45ba6db0-3ac5-4c46-adb1-3edb56de250c tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:56.050485 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-45ba6db0-3ac5-4c46-adb1-3edb56de250c tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:56.054471 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-45ba6db0-3ac5-4c46-adb1-3edb56de250c tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:56.774892 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-45ba6db0-3ac5-4c46-adb1-3edb56de250c tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f63f1ac147543dab34a28a22eb5936c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1607b30b9f324abaa88aa29e04ef3ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:56.786056 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-45ba6db0-3ac5-4c46-adb1-3edb56de250c tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40" status: 200 len: 1505 microversion: 2.1 time: 0.775410 Oct 04 18:54:56.789626 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2234/4759] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:56 2022] GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40 => generated 1505 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:56.818388 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-c6e1b11d-44da-44d3-9713-0fec0463e78a tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:56.818894 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-c6e1b11d-44da-44d3-9713-0fec0463e78a tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 34e2395a-015a-4e7a-83c0-6d481b836be2] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:56.829572 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-c6e1b11d-44da-44d3-9713-0fec0463e78a tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] HTTP exception thrown: Instance 34e2395a-015a-4e7a-83c0-6d481b836be2 could not be found. Oct 04 18:54:56.831272 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-c6e1b11d-44da-44d3-9713-0fec0463e78a tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Request method failure captured: Oct 04 18:54:56.831272 n-d-851028-13 devstack@n-api.service[123595]: request: DELETE /compute/v2.1/servers/34e2395a-015a-4e7a-83c0-6d481b836be2 HTTP/1.1 Oct 04 18:54:56.831272 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 18:54:56.831272 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 18:54:56.831272 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 18:54:56.831272 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 0 Oct 04 18:54:56.831272 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 18:54:56.831272 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 18:54:56.831272 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 18:54:56.831272 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 18:54:56.831272 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPIEZsAoFcr6P1AMHBWUo8LvryOn1l2-LYSKr4xgLCvHblWFuAiGVlStWcljkgzOc7-ldx7qv3C-2jYmQ32_Zk5yP28dI64Re9CsyHCLmsYfyJdD0-2_kU92lHK36Fs8oXqXU2FijNX-X4IYqe4GjOQDN7LB9zCeEIcrxQ2LRJFOwbQY Oct 04 18:54:56.831272 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 18:54:56.831272 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 18:54:56.831272 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 18:54:56.831272 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 18:54:56.831272 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 18:54:56.831272 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 18:54:56.831272 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: 1607b30b9f324abaa88aa29e04ef3ec4 Oct 04 18:54:56.831272 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-ServersNegativeTestJSON-708693932 Oct 04 18:54:56.831272 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 18:54:56.831272 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 18:54:56.831272 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/1607b30b9f324abaa88aa29e04ef3ec4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_1607b30b9f324abaa88aa29e04ef3ec4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1607b30b9f324abaa88aa29e04ef3ec4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1607b30b9f324abaa88aa29e04ef3ec4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:54:56.831272 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-ServersNegativeTestJSON-708693932 Oct 04 18:54:56.831272 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: 1607b30b9f324abaa88aa29e04ef3ec4 Oct 04 18:54:56.831272 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-ServersNegativeTestJSON-708693932 Oct 04 18:54:56.831272 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-ServersNegativeTestJSON-708693932-project Oct 04 18:54:56.831272 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 18:54:56.831272 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 18:54:56.831272 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: 6f63f1ac147543dab34a28a22eb5936c Oct 04 18:54:56.831272 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-ServersNegativeTestJSON-708693932-project Oct 04 18:54:56.831272 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 18:54:56.831272 n-d-851028-13 devstack@n-api.service[123595]: exception: Instance 34e2395a-015a-4e7a-83c0-6d481b836be2 could not be found. Oct 04 18:54:56.831272 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': '34e2395a-015a-4e7a-83c0-6d481b836be2'} Oct 04 18:54:56.831272 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:54:56.831272 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:54:56.831272 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:54:56.831272 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:54:56.831272 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:54:56.831272 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:54:56.831272 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 18:54:56.831272 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 18:54:56.831272 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 34e2395a-015a-4e7a-83c0-6d481b836be2 could not be found. Oct 04 18:54:56.831272 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:54:56.831272 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:54:56.831272 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:54:56.831272 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:54:56.831272 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:54:56.831272 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:54:56.831272 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:54:56.831272 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:54:56.831272 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:54:56.831272 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:54:56.831272 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:54:56.831272 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:54:56.831272 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:54:56.831272 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:54:56.831272 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:54:56.831272 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:54:56.831272 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:54:56.831272 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:54:56.831272 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 34e2395a-015a-4e7a-83c0-6d481b836be2 could not be found. Oct 04 18:54:56.831272 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:54:56.831272 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:54:56.835851 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:54:56.835851 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:54:56.835851 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:54:56.835851 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:54:56.835851 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:54:56.835851 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:54:56.835851 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 34e2395a-015a-4e7a-83c0-6d481b836be2 could not be found. Oct 04 18:54:56.835851 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:54:56.835851 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-c6e1b11d-44da-44d3-9713-0fec0463e78a tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Returning 404 to user: Instance 34e2395a-015a-4e7a-83c0-6d481b836be2 could not be found. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:54:56.837447 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-c6e1b11d-44da-44d3-9713-0fec0463e78a tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "DELETE /compute/v2.1/servers/34e2395a-015a-4e7a-83c0-6d481b836be2" status: 404 len: 111 microversion: 2.1 time: 0.023526 Oct 04 18:54:56.838543 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2235/4760] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 18:54:56 2022] DELETE /compute/v2.1/servers/34e2395a-015a-4e7a-83c0-6d481b836be2 => generated 111 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:54:56.846439 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-59bee90a-da1d-4e41-95b4-ee7e619e328e tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Flavor limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:54:56.846883 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-59bee90a-da1d-4e41-95b4-ee7e619e328e tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Image limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:54:56.847368 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-59bee90a-da1d-4e41-95b4-ee7e619e328e tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Flavor pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:54:56.847786 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-59bee90a-da1d-4e41-95b4-ee7e619e328e tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Image pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:54:56.848210 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-59bee90a-da1d-4e41-95b4-ee7e619e328e tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:54:56.856042 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-5f696fcb-135b-4dc2-b012-e1285b864d07 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:56.857349 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-5f696fcb-135b-4dc2-b012-e1285b864d07 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 01e250ab-d9aa-4708-ae36-10c53a411a40] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:56.872383 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5f696fcb-135b-4dc2-b012-e1285b864d07 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:56.874278 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5f696fcb-135b-4dc2-b012-e1285b864d07 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:56.874482 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-59bee90a-da1d-4e41-95b4-ee7e619e328e tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:56.875049 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-59bee90a-da1d-4e41-95b4-ee7e619e328e tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:56.875502 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-59bee90a-da1d-4e41-95b4-ee7e619e328e tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:56.876111 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5f696fcb-135b-4dc2-b012-e1285b864d07 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:56.878229 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-59bee90a-da1d-4e41-95b4-ee7e619e328e tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:56.879465 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5f696fcb-135b-4dc2-b012-e1285b864d07 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:56.881269 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5f696fcb-135b-4dc2-b012-e1285b864d07 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:56.881767 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5f696fcb-135b-4dc2-b012-e1285b864d07 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:56.883965 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-59bee90a-da1d-4e41-95b4-ee7e619e328e tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:56.884892 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-59bee90a-da1d-4e41-95b4-ee7e619e328e tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:56.979895 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-59bee90a-da1d-4e41-95b4-ee7e619e328e tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Getting quotas for project fea78afe01b240f79c3bb2cfc773e502. Resources: {'ram', 'cores', 'instances'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:54:57.010683 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-59bee90a-da1d-4e41-95b4-ee7e619e328e tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Getting quotas for user 1dd8fa69e56d47bba065c558ad1f08e4 and project fea78afe01b240f79c3bb2cfc773e502. Resources: {'ram', 'cores', 'instances'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:54:57.345429 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-59bee90a-da1d-4e41-95b4-ee7e619e328e tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Going to run 1 instances... {{(pid=123596) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:54:57.350128 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-59bee90a-da1d-4e41-95b4-ee7e619e328e tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] [instance: 02a066b4-243b-4fe3-afcf-30f3e9511d1b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='77696b08-499a-45c4-809c-9302d17059a1',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='ec56adde-983c-4a56-af08-c055172f6f3a',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='892584e5-94f9-4e6d-ae75-84ce468abe4f',volume_size=None,volume_type=None)] {{(pid=123596) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:54:57.397915 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-5f696fcb-135b-4dc2-b012-e1285b864d07 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f63f1ac147543dab34a28a22eb5936c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1607b30b9f324abaa88aa29e04ef3ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:57.414511 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-5f696fcb-135b-4dc2-b012-e1285b864d07 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40" status: 200 len: 1505 microversion: 2.1 time: 0.569943 Oct 04 18:54:57.415450 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2236/4761] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:56 2022] GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40 => generated 1505 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:57.424710 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-ca3dc9ed-7606-44e4-9ea5-018310153518 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:57.428573 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-ca3dc9ed-7606-44e4-9ea5-018310153518 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] [instance: 523fce83-2292-42b0-9b99-c9ac2c48e544] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:57.446184 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ca3dc9ed-7606-44e4-9ea5-018310153518 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:57.448968 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ca3dc9ed-7606-44e4-9ea5-018310153518 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:57.449775 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ca3dc9ed-7606-44e4-9ea5-018310153518 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:57.459539 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ca3dc9ed-7606-44e4-9ea5-018310153518 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:57.462403 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ca3dc9ed-7606-44e4-9ea5-018310153518 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:57.465671 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ca3dc9ed-7606-44e4-9ea5-018310153518 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:57.503925 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=100 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:54:58.155961 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-59bee90a-da1d-4e41-95b4-ee7e619e328e tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.42 time: 7.663857 Oct 04 18:54:58.159677 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2526/4762] 10.222.0.43 () {62 vars in 1189 bytes} [Tue Oct 4 18:54:50 2022] POST /compute/v2.1/servers => generated 405 bytes in 7669 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 04 18:54:58.172643 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-31e301ee-39a3-4a71-bc7c-1d7a3104a17b tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:58.174926 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-31e301ee-39a3-4a71-bc7c-1d7a3104a17b tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 01e250ab-d9aa-4708-ae36-10c53a411a40] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:58.198553 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-31e301ee-39a3-4a71-bc7c-1d7a3104a17b tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:58.202855 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-31e301ee-39a3-4a71-bc7c-1d7a3104a17b tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:58.204753 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-31e301ee-39a3-4a71-bc7c-1d7a3104a17b tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:58.209184 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-31e301ee-39a3-4a71-bc7c-1d7a3104a17b tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:58.213512 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-31e301ee-39a3-4a71-bc7c-1d7a3104a17b tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:58.215414 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-31e301ee-39a3-4a71-bc7c-1d7a3104a17b tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:58.258589 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-ca3dc9ed-7606-44e4-9ea5-018310153518 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '486c22456b1e47ae843ae41f8dfb2632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c91c7e7358048ffaaee7f51ad61b515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:58.287191 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-ca3dc9ed-7606-44e4-9ea5-018310153518 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] 10.222.0.43 "GET /compute/v2.1/servers/523fce83-2292-42b0-9b99-c9ac2c48e544" status: 200 len: 1365 microversion: 2.1 time: 0.869960 Oct 04 18:54:58.287820 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2237/4763] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:57 2022] GET /compute/v2.1/servers/523fce83-2292-42b0-9b99-c9ac2c48e544 => generated 1365 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:58.314744 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-ec91c8ae-a49f-43c6-969f-04de987c0a16 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:58.315373 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-ec91c8ae-a49f-43c6-969f-04de987c0a16 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] [instance: 02a066b4-243b-4fe3-afcf-30f3e9511d1b] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:58.544616 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-ec91c8ae-a49f-43c6-969f-04de987c0a16 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:58.560649 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-ec91c8ae-a49f-43c6-969f-04de987c0a16 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:58.564923 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-ec91c8ae-a49f-43c6-969f-04de987c0a16 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:58.568488 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-ec91c8ae-a49f-43c6-969f-04de987c0a16 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] 10.222.0.43 "GET /compute/v2.1/servers/02a066b4-243b-4fe3-afcf-30f3e9511d1b" status: 200 len: 1286 microversion: 2.42 time: 0.274406 Oct 04 18:54:58.572399 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2238/4764] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:54:58 2022] GET /compute/v2.1/servers/02a066b4-243b-4fe3-afcf-30f3e9511d1b => generated 1286 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:54:58.589631 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-529f9fc2-09cb-4c43-9dd1-8b6b6fe56a15 req-aec6f1c3-94fc-4cb2-a000-829703fd7887 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "523fce83-2292-42b0-9b99-c9ac2c48e544", "name": "network-vif-plugged", "status": "completed", "tag": "1a8e604e-bf22-40c8-b5c0-f1df67aebd3a"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:54:58.627872 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-529f9fc2-09cb-4c43-9dd1-8b6b6fe56a15 req-aec6f1c3-94fc-4cb2-a000-829703fd7887 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:58.630281 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-529f9fc2-09cb-4c43-9dd1-8b6b6fe56a15 req-aec6f1c3-94fc-4cb2-a000-829703fd7887 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:58.630942 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-529f9fc2-09cb-4c43-9dd1-8b6b6fe56a15 req-aec6f1c3-94fc-4cb2-a000-829703fd7887 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:58.658702 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-529f9fc2-09cb-4c43-9dd1-8b6b6fe56a15 req-aec6f1c3-94fc-4cb2-a000-829703fd7887 service nova] Creating event network-vif-plugged:1a8e604e-bf22-40c8-b5c0-f1df67aebd3a for instance 523fce83-2292-42b0-9b99-c9ac2c48e544 on n-h1-851028-13 Oct 04 18:54:58.675676 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-529f9fc2-09cb-4c43-9dd1-8b6b6fe56a15 req-aec6f1c3-94fc-4cb2-a000-829703fd7887 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100183 Oct 04 18:54:58.677038 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2239/4765] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:54:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:54:59.190040 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-31e301ee-39a3-4a71-bc7c-1d7a3104a17b tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f63f1ac147543dab34a28a22eb5936c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1607b30b9f324abaa88aa29e04ef3ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:59.198066 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-31e301ee-39a3-4a71-bc7c-1d7a3104a17b tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40" status: 200 len: 1505 microversion: 2.1 time: 1.036721 Oct 04 18:54:59.198897 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2527/4766] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:58 2022] GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40 => generated 1505 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:59.221622 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-68604c64-8e02-4d30-867a-79e26d07d877 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:59.222433 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-68604c64-8e02-4d30-867a-79e26d07d877 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Failed to fetch instance by id 9223372036854775808 {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 04 18:54:59.223178 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-68604c64-8e02-4d30-867a-79e26d07d877 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. Oct 04 18:54:59.225099 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-68604c64-8e02-4d30-867a-79e26d07d877 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Request method failure captured: Oct 04 18:54:59.225099 n-d-851028-13 devstack@n-api.service[123595]: request: DELETE /compute/v2.1/servers/9223372036854775808 HTTP/1.1 Oct 04 18:54:59.225099 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 18:54:59.225099 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 18:54:59.225099 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 18:54:59.225099 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 0 Oct 04 18:54:59.225099 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 18:54:59.225099 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 18:54:59.225099 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 18:54:59.225099 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 18:54:59.225099 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPIEZsAoFcr6P1AMHBWUo8LvryOn1l2-LYSKr4xgLCvHblWFuAiGVlStWcljkgzOc7-ldx7qv3C-2jYmQ32_Zk5yP28dI64Re9CsyHCLmsYfyJdD0-2_kU92lHK36Fs8oXqXU2FijNX-X4IYqe4GjOQDN7LB9zCeEIcrxQ2LRJFOwbQY Oct 04 18:54:59.225099 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 18:54:59.225099 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 18:54:59.225099 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 18:54:59.225099 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 18:54:59.225099 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 18:54:59.225099 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 18:54:59.225099 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: 1607b30b9f324abaa88aa29e04ef3ec4 Oct 04 18:54:59.225099 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-ServersNegativeTestJSON-708693932 Oct 04 18:54:59.225099 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 18:54:59.225099 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 18:54:59.225099 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/1607b30b9f324abaa88aa29e04ef3ec4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_1607b30b9f324abaa88aa29e04ef3ec4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1607b30b9f324abaa88aa29e04ef3ec4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1607b30b9f324abaa88aa29e04ef3ec4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:54:59.225099 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-ServersNegativeTestJSON-708693932 Oct 04 18:54:59.225099 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: 1607b30b9f324abaa88aa29e04ef3ec4 Oct 04 18:54:59.225099 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-ServersNegativeTestJSON-708693932 Oct 04 18:54:59.225099 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-ServersNegativeTestJSON-708693932-project Oct 04 18:54:59.225099 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 18:54:59.225099 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 18:54:59.225099 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: 6f63f1ac147543dab34a28a22eb5936c Oct 04 18:54:59.225099 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-ServersNegativeTestJSON-708693932-project Oct 04 18:54:59.225099 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 18:54:59.225099 n-d-851028-13 devstack@n-api.service[123595]: exception: Instance 9223372036854775808 could not be found. Oct 04 18:54:59.225099 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': '9223372036854775808'} Oct 04 18:54:59.225099 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:54:59.225099 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:54:59.225099 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:54:59.225099 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:54:59.225099 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 04 18:54:59.225099 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 04 18:54:59.225099 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9223372036854775808 could not be found. Oct 04 18:54:59.225099 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:54:59.225099 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:54:59.225099 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:54:59.225099 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:54:59.225099 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:54:59.225099 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:54:59.225099 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:54:59.225099 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:54:59.225099 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:54:59.225099 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:54:59.225099 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:54:59.225099 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:54:59.225099 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:54:59.225099 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:54:59.225099 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:54:59.225099 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:54:59.225099 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:54:59.225099 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:54:59.225099 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9223372036854775808 could not be found. Oct 04 18:54:59.225099 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:54:59.225099 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:54:59.225099 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:54:59.225099 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:54:59.225099 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:54:59.230388 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:54:59.230388 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:54:59.230388 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:54:59.230388 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9223372036854775808 could not be found. Oct 04 18:54:59.230388 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:54:59.230388 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-68604c64-8e02-4d30-867a-79e26d07d877 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:54:59.231119 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-68604c64-8e02-4d30-867a-79e26d07d877 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.013333 Oct 04 18:54:59.235532 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2240/4767] 10.222.0.43 () {58 vars in 1188 bytes} [Tue Oct 4 18:54:59 2022] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:54:59.247459 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-620d6773-3141-4676-a0ca-4d052723b012 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:59.248112 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-620d6773-3141-4676-a0ca-4d052723b012 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 01e250ab-d9aa-4708-ae36-10c53a411a40] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:59.265565 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-620d6773-3141-4676-a0ca-4d052723b012 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:59.266112 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-620d6773-3141-4676-a0ca-4d052723b012 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:59.266568 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-620d6773-3141-4676-a0ca-4d052723b012 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:59.267295 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-620d6773-3141-4676-a0ca-4d052723b012 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:59.267762 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-620d6773-3141-4676-a0ca-4d052723b012 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:59.268200 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-620d6773-3141-4676-a0ca-4d052723b012 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:59.319642 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-9cb2436f-dc33-40e6-bded-4b27a6a39fc7 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:59.321363 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-9cb2436f-dc33-40e6-bded-4b27a6a39fc7 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] [instance: 523fce83-2292-42b0-9b99-c9ac2c48e544] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:59.342301 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9cb2436f-dc33-40e6-bded-4b27a6a39fc7 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:59.346167 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9cb2436f-dc33-40e6-bded-4b27a6a39fc7 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:59.346637 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9cb2436f-dc33-40e6-bded-4b27a6a39fc7 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:59.351457 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9cb2436f-dc33-40e6-bded-4b27a6a39fc7 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:59.351994 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9cb2436f-dc33-40e6-bded-4b27a6a39fc7 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:59.353525 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9cb2436f-dc33-40e6-bded-4b27a6a39fc7 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:59.724004 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-620d6773-3141-4676-a0ca-4d052723b012 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f63f1ac147543dab34a28a22eb5936c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1607b30b9f324abaa88aa29e04ef3ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:59.750263 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-620d6773-3141-4676-a0ca-4d052723b012 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40" status: 200 len: 1505 microversion: 2.1 time: 0.496832 Oct 04 18:54:59.761600 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2528/4768] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:59 2022] GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40 => generated 1505 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:54:59.785986 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-e1d12c43-281d-4894-a26a-6d683dc11818 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:59.787821 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-e1d12c43-281d-4894-a26a-6d683dc11818 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] [instance: 02a066b4-243b-4fe3-afcf-30f3e9511d1b] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:59.934261 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-e1d12c43-281d-4894-a26a-6d683dc11818 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:59.951478 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-e1d12c43-281d-4894-a26a-6d683dc11818 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:59.953527 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-e1d12c43-281d-4894-a26a-6d683dc11818 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:59.957364 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-e1d12c43-281d-4894-a26a-6d683dc11818 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] 10.222.0.43 "GET /compute/v2.1/servers/02a066b4-243b-4fe3-afcf-30f3e9511d1b" status: 200 len: 1286 microversion: 2.42 time: 0.194187 Oct 04 18:54:59.959502 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2529/4769] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:54:59 2022] GET /compute/v2.1/servers/02a066b4-243b-4fe3-afcf-30f3e9511d1b => generated 1286 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:54:59.977474 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-cb502427-6623-4011-adc5-f620fecee9ef tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:59.978978 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-cb502427-6623-4011-adc5-f620fecee9ef tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 01e250ab-d9aa-4708-ae36-10c53a411a40] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:00.005458 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cb502427-6623-4011-adc5-f620fecee9ef tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:00.006937 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cb502427-6623-4011-adc5-f620fecee9ef tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:00.010029 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cb502427-6623-4011-adc5-f620fecee9ef tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:00.011239 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cb502427-6623-4011-adc5-f620fecee9ef tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:00.012865 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cb502427-6623-4011-adc5-f620fecee9ef tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:00.014528 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cb502427-6623-4011-adc5-f620fecee9ef tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:00.234457 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-9cb2436f-dc33-40e6-bded-4b27a6a39fc7 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '486c22456b1e47ae843ae41f8dfb2632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c91c7e7358048ffaaee7f51ad61b515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:00.243096 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-9cb2436f-dc33-40e6-bded-4b27a6a39fc7 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] 10.222.0.43 "GET /compute/v2.1/servers/523fce83-2292-42b0-9b99-c9ac2c48e544" status: 200 len: 1365 microversion: 2.1 time: 0.930631 Oct 04 18:55:00.248619 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2241/4770] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:59 2022] GET /compute/v2.1/servers/523fce83-2292-42b0-9b99-c9ac2c48e544 => generated 1365 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:55:00.337381 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-cb502427-6623-4011-adc5-f620fecee9ef tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f63f1ac147543dab34a28a22eb5936c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1607b30b9f324abaa88aa29e04ef3ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:00.352256 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-cb502427-6623-4011-adc5-f620fecee9ef tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40" status: 200 len: 1505 microversion: 2.1 time: 0.388874 Oct 04 18:55:00.353641 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2530/4771] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:59 2022] GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40 => generated 1505 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:55:00.381729 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-2cebb4e6-58f5-4322-82b0-b26a360ec68c tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:00.382353 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-2cebb4e6-58f5-4322-82b0-b26a360ec68c tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Failed to fetch instance by id -1 {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 04 18:55:00.382883 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-2cebb4e6-58f5-4322-82b0-b26a360ec68c tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] HTTP exception thrown: Instance -1 could not be found. Oct 04 18:55:00.385296 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-2cebb4e6-58f5-4322-82b0-b26a360ec68c tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Request method failure captured: Oct 04 18:55:00.385296 n-d-851028-13 devstack@n-api.service[123595]: request: DELETE /compute/v2.1/servers/-1 HTTP/1.1 Oct 04 18:55:00.385296 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 18:55:00.385296 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 18:55:00.385296 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 18:55:00.385296 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 0 Oct 04 18:55:00.385296 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 18:55:00.385296 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 18:55:00.385296 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 18:55:00.385296 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 18:55:00.385296 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPIEZsAoFcr6P1AMHBWUo8LvryOn1l2-LYSKr4xgLCvHblWFuAiGVlStWcljkgzOc7-ldx7qv3C-2jYmQ32_Zk5yP28dI64Re9CsyHCLmsYfyJdD0-2_kU92lHK36Fs8oXqXU2FijNX-X4IYqe4GjOQDN7LB9zCeEIcrxQ2LRJFOwbQY Oct 04 18:55:00.385296 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 18:55:00.385296 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 18:55:00.385296 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 18:55:00.385296 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 18:55:00.385296 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 18:55:00.385296 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 18:55:00.385296 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: 1607b30b9f324abaa88aa29e04ef3ec4 Oct 04 18:55:00.385296 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-ServersNegativeTestJSON-708693932 Oct 04 18:55:00.385296 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 18:55:00.385296 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 18:55:00.385296 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/1607b30b9f324abaa88aa29e04ef3ec4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_1607b30b9f324abaa88aa29e04ef3ec4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1607b30b9f324abaa88aa29e04ef3ec4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1607b30b9f324abaa88aa29e04ef3ec4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:55:00.385296 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-ServersNegativeTestJSON-708693932 Oct 04 18:55:00.385296 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: 1607b30b9f324abaa88aa29e04ef3ec4 Oct 04 18:55:00.385296 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-ServersNegativeTestJSON-708693932 Oct 04 18:55:00.385296 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-ServersNegativeTestJSON-708693932-project Oct 04 18:55:00.385296 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 18:55:00.385296 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 18:55:00.385296 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: 6f63f1ac147543dab34a28a22eb5936c Oct 04 18:55:00.385296 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-ServersNegativeTestJSON-708693932-project Oct 04 18:55:00.385296 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 18:55:00.385296 n-d-851028-13 devstack@n-api.service[123595]: exception: Instance -1 could not be found. Oct 04 18:55:00.385296 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': '-1'} Oct 04 18:55:00.385296 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:55:00.385296 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:55:00.385296 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:55:00.385296 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:55:00.385296 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 04 18:55:00.385296 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 04 18:55:00.385296 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance -1 could not be found. Oct 04 18:55:00.385296 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:55:00.385296 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:55:00.385296 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:55:00.385296 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:55:00.385296 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:55:00.385296 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:55:00.385296 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:55:00.385296 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:55:00.385296 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:55:00.385296 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:55:00.385296 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:55:00.385296 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:55:00.385296 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:55:00.385296 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:55:00.385296 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:55:00.385296 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:55:00.385296 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:55:00.385296 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:55:00.385296 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance -1 could not be found. Oct 04 18:55:00.385296 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:55:00.385296 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:55:00.385296 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:55:00.385296 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:55:00.385296 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:55:00.385296 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:55:00.391209 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:55:00.391209 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:55:00.391209 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance -1 could not be found. Oct 04 18:55:00.391209 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:55:00.391209 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-2cebb4e6-58f5-4322-82b0-b26a360ec68c tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Returning 404 to user: Instance -1 could not be found. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:55:00.391209 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-2cebb4e6-58f5-4322-82b0-b26a360ec68c tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.013532 Oct 04 18:55:00.394904 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2242/4772] 10.222.0.43 () {58 vars in 1137 bytes} [Tue Oct 4 18:55:00 2022] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:55:00.399918 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f0f0d77f-fcfe-447e-93e9-464de85ac2af tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:00.401230 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-f0f0d77f-fcfe-447e-93e9-464de85ac2af tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 01e250ab-d9aa-4708-ae36-10c53a411a40] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:00.409523 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f0f0d77f-fcfe-447e-93e9-464de85ac2af tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:00.410387 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f0f0d77f-fcfe-447e-93e9-464de85ac2af tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:00.411039 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f0f0d77f-fcfe-447e-93e9-464de85ac2af tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:00.411982 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f0f0d77f-fcfe-447e-93e9-464de85ac2af tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:00.414170 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f0f0d77f-fcfe-447e-93e9-464de85ac2af tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:00.414560 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f0f0d77f-fcfe-447e-93e9-464de85ac2af tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:01.002197 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-b1d27740-bbef-4234-a932-04be0a04aec4 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:01.003731 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-b1d27740-bbef-4234-a932-04be0a04aec4 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] [instance: 02a066b4-243b-4fe3-afcf-30f3e9511d1b] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:01.040068 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b1d27740-bbef-4234-a932-04be0a04aec4 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:01.045293 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b1d27740-bbef-4234-a932-04be0a04aec4 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:01.046979 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b1d27740-bbef-4234-a932-04be0a04aec4 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:01.048300 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b1d27740-bbef-4234-a932-04be0a04aec4 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:01.055367 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b1d27740-bbef-4234-a932-04be0a04aec4 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:01.056320 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b1d27740-bbef-4234-a932-04be0a04aec4 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:01.547858 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-b1d27740-bbef-4234-a932-04be0a04aec4 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:01.585413 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-b1d27740-bbef-4234-a932-04be0a04aec4 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:01.590783 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-b1d27740-bbef-4234-a932-04be0a04aec4 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:01.596519 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-b1d27740-bbef-4234-a932-04be0a04aec4 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] 10.222.0.43 "GET /compute/v2.1/servers/02a066b4-243b-4fe3-afcf-30f3e9511d1b" status: 200 len: 1584 microversion: 2.42 time: 0.609835 Oct 04 18:55:01.601719 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2243/4773] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:55:00 2022] GET /compute/v2.1/servers/02a066b4-243b-4fe3-afcf-30f3e9511d1b => generated 1584 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:55:01.613351 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-90610b1b-f6b4-4bf7-a061-4eb718fe99e0 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:01.616205 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-90610b1b-f6b4-4bf7-a061-4eb718fe99e0 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] [instance: 523fce83-2292-42b0-9b99-c9ac2c48e544] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:01.634964 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-90610b1b-f6b4-4bf7-a061-4eb718fe99e0 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:01.635745 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-90610b1b-f6b4-4bf7-a061-4eb718fe99e0 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:01.636370 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-90610b1b-f6b4-4bf7-a061-4eb718fe99e0 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:01.639003 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-90610b1b-f6b4-4bf7-a061-4eb718fe99e0 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:01.639839 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-90610b1b-f6b4-4bf7-a061-4eb718fe99e0 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:01.640468 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-90610b1b-f6b4-4bf7-a061-4eb718fe99e0 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:01.690329 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-f0f0d77f-fcfe-447e-93e9-464de85ac2af tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f63f1ac147543dab34a28a22eb5936c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1607b30b9f324abaa88aa29e04ef3ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:01.705541 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-f0f0d77f-fcfe-447e-93e9-464de85ac2af tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40" status: 200 len: 1505 microversion: 2.1 time: 1.311898 Oct 04 18:55:01.711199 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2531/4774] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:00 2022] GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40 => generated 1505 bytes in 1318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:55:01.735639 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-e72464f6-06cc-44ef-b8b2-f6f5d5f880d5 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:01.736978 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-e72464f6-06cc-44ef-b8b2-f6f5d5f880d5 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 01e250ab-d9aa-4708-ae36-10c53a411a40] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:01.756623 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e72464f6-06cc-44ef-b8b2-f6f5d5f880d5 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:01.757545 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e72464f6-06cc-44ef-b8b2-f6f5d5f880d5 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:01.758009 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e72464f6-06cc-44ef-b8b2-f6f5d5f880d5 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:01.758753 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e72464f6-06cc-44ef-b8b2-f6f5d5f880d5 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:01.759484 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e72464f6-06cc-44ef-b8b2-f6f5d5f880d5 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:01.761813 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e72464f6-06cc-44ef-b8b2-f6f5d5f880d5 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:02.660998 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-e72464f6-06cc-44ef-b8b2-f6f5d5f880d5 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f63f1ac147543dab34a28a22eb5936c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1607b30b9f324abaa88aa29e04ef3ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:02.672531 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-e72464f6-06cc-44ef-b8b2-f6f5d5f880d5 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40" status: 200 len: 1505 microversion: 2.1 time: 0.938948 Oct 04 18:55:02.673198 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2532/4775] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:01 2022] GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40 => generated 1505 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:55:02.683985 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-b3b3fc1d-c793-473a-92bf-b063c266d6c3 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:02.684870 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-b3b3fc1d-c793-473a-92bf-b063c266d6c3 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] [instance: 02a066b4-243b-4fe3-afcf-30f3e9511d1b] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:02.694121 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-90610b1b-f6b4-4bf7-a061-4eb718fe99e0 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '486c22456b1e47ae843ae41f8dfb2632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c91c7e7358048ffaaee7f51ad61b515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:02.714163 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-90610b1b-f6b4-4bf7-a061-4eb718fe99e0 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] 10.222.0.43 "GET /compute/v2.1/servers/523fce83-2292-42b0-9b99-c9ac2c48e544" status: 200 len: 1555 microversion: 2.1 time: 1.104700 Oct 04 18:55:02.716988 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2244/4776] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:01 2022] GET /compute/v2.1/servers/523fce83-2292-42b0-9b99-c9ac2c48e544 => generated 1555 bytes in 1114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:55:02.728622 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b3b3fc1d-c793-473a-92bf-b063c266d6c3 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:02.729757 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b3b3fc1d-c793-473a-92bf-b063c266d6c3 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:02.730363 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b3b3fc1d-c793-473a-92bf-b063c266d6c3 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:02.732631 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b3b3fc1d-c793-473a-92bf-b063c266d6c3 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:02.734497 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-87b4e050-2c39-40e3-bcc2-632d3cf723fb tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:55:02.735165 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b3b3fc1d-c793-473a-92bf-b063c266d6c3 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:02.735771 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b3b3fc1d-c793-473a-92bf-b063c266d6c3 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:02.739581 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-87b4e050-2c39-40e3-bcc2-632d3cf723fb tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 28ba9740-d6ce-48d1-a130-5bce304f39e4] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:02.759710 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-87b4e050-2c39-40e3-bcc2-632d3cf723fb tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] HTTP exception thrown: Instance 28ba9740-d6ce-48d1-a130-5bce304f39e4 could not be found. Oct 04 18:55:02.773150 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-87b4e050-2c39-40e3-bcc2-632d3cf723fb tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Request method failure captured: Oct 04 18:55:02.773150 n-d-851028-13 devstack@n-api.service[123595]: request: POST /compute/v2.1/servers/28ba9740-d6ce-48d1-a130-5bce304f39e4/action HTTP/1.1 Oct 04 18:55:02.773150 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 18:55:02.773150 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 18:55:02.773150 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 18:55:02.773150 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 19 Oct 04 18:55:02.773150 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 18:55:02.773150 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 18:55:02.773150 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 18:55:02.773150 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 18:55:02.773150 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPIEZsAoFcr6P1AMHBWUo8LvryOn1l2-LYSKr4xgLCvHblWFuAiGVlStWcljkgzOc7-ldx7qv3C-2jYmQ32_Zk5yP28dI64Re9CsyHCLmsYfyJdD0-2_kU92lHK36Fs8oXqXU2FijNX-X4IYqe4GjOQDN7LB9zCeEIcrxQ2LRJFOwbQY Oct 04 18:55:02.773150 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 18:55:02.773150 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 18:55:02.773150 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 18:55:02.773150 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 18:55:02.773150 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 18:55:02.773150 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 18:55:02.773150 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: 1607b30b9f324abaa88aa29e04ef3ec4 Oct 04 18:55:02.773150 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-ServersNegativeTestJSON-708693932 Oct 04 18:55:02.773150 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 18:55:02.773150 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 18:55:02.773150 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/1607b30b9f324abaa88aa29e04ef3ec4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_1607b30b9f324abaa88aa29e04ef3ec4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1607b30b9f324abaa88aa29e04ef3ec4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1607b30b9f324abaa88aa29e04ef3ec4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:55:02.773150 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-ServersNegativeTestJSON-708693932 Oct 04 18:55:02.773150 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: 1607b30b9f324abaa88aa29e04ef3ec4 Oct 04 18:55:02.773150 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-ServersNegativeTestJSON-708693932 Oct 04 18:55:02.773150 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-ServersNegativeTestJSON-708693932-project Oct 04 18:55:02.773150 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 18:55:02.773150 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 18:55:02.773150 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: 6f63f1ac147543dab34a28a22eb5936c Oct 04 18:55:02.773150 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-ServersNegativeTestJSON-708693932-project Oct 04 18:55:02.773150 n-d-851028-13 devstack@n-api.service[123595]: Oct 04 18:55:02.773150 n-d-851028-13 devstack@n-api.service[123595]: {"forceDelete": {}} Oct 04 18:55:02.773150 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 18:55:02.773150 n-d-851028-13 devstack@n-api.service[123595]: exception: Instance 28ba9740-d6ce-48d1-a130-5bce304f39e4 could not be found. Oct 04 18:55:02.773150 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': '28ba9740-d6ce-48d1-a130-5bce304f39e4', 'body': {'forceDelete': {}}} Oct 04 18:55:02.773150 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:55:02.773150 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:55:02.773150 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:55:02.773150 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:55:02.773150 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:55:02.773150 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:55:02.773150 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 18:55:02.773150 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 18:55:02.773150 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 28ba9740-d6ce-48d1-a130-5bce304f39e4 could not be found. Oct 04 18:55:02.773150 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:55:02.773150 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:55:02.773150 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:55:02.773150 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:55:02.773150 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:55:02.773150 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:55:02.773150 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:55:02.773150 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:55:02.773150 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:55:02.773150 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:55:02.773150 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 55, in _force_delete Oct 04 18:55:02.773150 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 04 18:55:02.773150 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:55:02.773150 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:55:02.773150 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 28ba9740-d6ce-48d1-a130-5bce304f39e4 could not be found. Oct 04 18:55:02.773150 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:55:02.773150 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:55:02.773150 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:55:02.773150 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:55:02.773150 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:55:02.773150 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:55:02.777369 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:55:02.777369 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:55:02.777369 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 28ba9740-d6ce-48d1-a130-5bce304f39e4 could not be found. Oct 04 18:55:02.777369 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:55:02.781238 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-87b4e050-2c39-40e3-bcc2-632d3cf723fb tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Returning 404 to user: Instance 28ba9740-d6ce-48d1-a130-5bce304f39e4 could not be found. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:55:02.782347 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-87b4e050-2c39-40e3-bcc2-632d3cf723fb tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "POST /compute/v2.1/servers/28ba9740-d6ce-48d1-a130-5bce304f39e4/action" status: 404 len: 111 microversion: 2.1 time: 0.063628 Oct 04 18:55:02.783541 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2245/4777] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 18:55:02 2022] POST /compute/v2.1/servers/28ba9740-d6ce-48d1-a130-5bce304f39e4/action => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:55:02.791764 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-24993f7a-7d70-46b5-9684-925a92597f52 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:02.792603 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-24993f7a-7d70-46b5-9684-925a92597f52 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] [instance: 523fce83-2292-42b0-9b99-c9ac2c48e544] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:02.808880 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-24993f7a-7d70-46b5-9684-925a92597f52 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:02.811618 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-24993f7a-7d70-46b5-9684-925a92597f52 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:02.812710 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-24993f7a-7d70-46b5-9684-925a92597f52 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:02.815719 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-24993f7a-7d70-46b5-9684-925a92597f52 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:02.816445 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-24993f7a-7d70-46b5-9684-925a92597f52 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:02.817139 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-24993f7a-7d70-46b5-9684-925a92597f52 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:03.091060 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-b3b3fc1d-c793-473a-92bf-b063c266d6c3 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:03.106998 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-b3b3fc1d-c793-473a-92bf-b063c266d6c3 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:03.107421 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-24993f7a-7d70-46b5-9684-925a92597f52 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] 10.222.0.43 "GET /compute/v2.1/servers/523fce83-2292-42b0-9b99-c9ac2c48e544/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.322599 Oct 04 18:55:03.108014 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2246/4778] 10.222.0.43 () {58 vars in 1275 bytes} [Tue Oct 4 18:55:02 2022] GET /compute/v2.1/servers/523fce83-2292-42b0-9b99-c9ac2c48e544/os-interface => generated 284 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:55:03.113812 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-99871f82-0d23-4ff2-8609-ab64a9bf760c tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:03.117061 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-b3b3fc1d-c793-473a-92bf-b063c266d6c3 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:03.122701 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-99871f82-0d23-4ff2-8609-ab64a9bf760c tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 01e250ab-d9aa-4708-ae36-10c53a411a40] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:03.122846 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-b3b3fc1d-c793-473a-92bf-b063c266d6c3 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] 10.222.0.43 "GET /compute/v2.1/servers/02a066b4-243b-4fe3-afcf-30f3e9511d1b" status: 200 len: 1594 microversion: 2.42 time: 0.448163 Oct 04 18:55:03.123671 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2533/4779] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:55:02 2022] GET /compute/v2.1/servers/02a066b4-243b-4fe3-afcf-30f3e9511d1b => generated 1594 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:55:03.167776 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-99871f82-0d23-4ff2-8609-ab64a9bf760c tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:03.168198 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-99871f82-0d23-4ff2-8609-ab64a9bf760c tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:03.168644 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-99871f82-0d23-4ff2-8609-ab64a9bf760c tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:03.169386 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-99871f82-0d23-4ff2-8609-ab64a9bf760c tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:03.169841 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-99871f82-0d23-4ff2-8609-ab64a9bf760c tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:03.170268 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-99871f82-0d23-4ff2-8609-ab64a9bf760c tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:04.157800 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-80d55053-c676-404b-95a6-5745e74964cb tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:04.158428 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-80d55053-c676-404b-95a6-5745e74964cb tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] [instance: 02a066b4-243b-4fe3-afcf-30f3e9511d1b] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:04.182601 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-80d55053-c676-404b-95a6-5745e74964cb tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:04.186074 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-80d55053-c676-404b-95a6-5745e74964cb tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:04.191376 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-80d55053-c676-404b-95a6-5745e74964cb tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:04.192369 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-80d55053-c676-404b-95a6-5745e74964cb tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:04.193985 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-80d55053-c676-404b-95a6-5745e74964cb tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:04.197275 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-80d55053-c676-404b-95a6-5745e74964cb tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:04.510417 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-80d55053-c676-404b-95a6-5745e74964cb tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:04.564451 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-80d55053-c676-404b-95a6-5745e74964cb tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:04.574731 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-80d55053-c676-404b-95a6-5745e74964cb tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:04.578040 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-80d55053-c676-404b-95a6-5745e74964cb tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] 10.222.0.43 "GET /compute/v2.1/servers/02a066b4-243b-4fe3-afcf-30f3e9511d1b" status: 200 len: 1594 microversion: 2.42 time: 0.425551 Oct 04 18:55:04.585653 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2534/4780] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:55:04 2022] GET /compute/v2.1/servers/02a066b4-243b-4fe3-afcf-30f3e9511d1b => generated 1594 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:55:04.804530 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-99871f82-0d23-4ff2-8609-ab64a9bf760c tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f63f1ac147543dab34a28a22eb5936c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1607b30b9f324abaa88aa29e04ef3ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:04.813824 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-99871f82-0d23-4ff2-8609-ab64a9bf760c tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40" status: 200 len: 1505 microversion: 2.1 time: 1.703522 Oct 04 18:55:04.814407 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2247/4781] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:03 2022] GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40 => generated 1505 bytes in 1705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:55:04.840983 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-3f8ee43f-21f8-4ee9-8d72-feae9052d9c8 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:04.841674 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-3f8ee43f-21f8-4ee9-8d72-feae9052d9c8 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 01e250ab-d9aa-4708-ae36-10c53a411a40] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:04.876568 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3f8ee43f-21f8-4ee9-8d72-feae9052d9c8 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:04.880973 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3f8ee43f-21f8-4ee9-8d72-feae9052d9c8 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:04.882861 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3f8ee43f-21f8-4ee9-8d72-feae9052d9c8 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:04.886224 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3f8ee43f-21f8-4ee9-8d72-feae9052d9c8 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:04.891017 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3f8ee43f-21f8-4ee9-8d72-feae9052d9c8 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:04.893907 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3f8ee43f-21f8-4ee9-8d72-feae9052d9c8 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:05.632734 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-a18525c3-202a-432f-b6c3-209ed3af79a9 tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Action: 'create', calling method: .version_select at 0x7fb21ecc1820>, body: {"keypair": {"name": "tempest-keypair-834340097", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPsjAh/gLtRriODVDv9i8Avr4h0bmf5xYnf35JReJ6023hb/klIKK7yEPx6kGXsCtf8xszEo1Vc4P0ViJz+Zx9AnlV3OvPou9zGuwlxcHW6upr/K3kfXDGoEXanOK4Ijag=="}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:55:05.669914 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-a18525c3-202a-432f-b6c3-209ed3af79a9 tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Getting quotas for project b74c55e15cfd4f2c9ce67c9aa91c1b5d. Resources: {'key_pairs'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:55:05.698851 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-a18525c3-202a-432f-b6c3-209ed3af79a9 tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Getting quotas for user b16d1e957e30423e9b06c6150e5c4a16 and project b74c55e15cfd4f2c9ce67c9aa91c1b5d. Resources: {'key_pairs'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:55:05.748960 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-3f8ee43f-21f8-4ee9-8d72-feae9052d9c8 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f63f1ac147543dab34a28a22eb5936c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1607b30b9f324abaa88aa29e04ef3ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:05.770904 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-3f8ee43f-21f8-4ee9-8d72-feae9052d9c8 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40" status: 200 len: 1505 microversion: 2.1 time: 0.935184 Oct 04 18:55:05.784717 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2535/4782] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:04 2022] GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40 => generated 1505 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:55:05.786732 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f84d460e-4944-450e-8fd1-6b94b9fe9e4d tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:05.787551 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-f84d460e-4944-450e-8fd1-6b94b9fe9e4d tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] [instance: 02a066b4-243b-4fe3-afcf-30f3e9511d1b] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:05.800793 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-a18525c3-202a-432f-b6c3-209ed3af79a9 tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.827049 Oct 04 18:55:05.801948 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2248/4783] 10.222.0.43 () {60 vars in 1159 bytes} [Tue Oct 4 18:55:04 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:55:05.807174 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f84d460e-4944-450e-8fd1-6b94b9fe9e4d tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:05.814379 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-f5f63094-4e12-4024-acbe-a1f68f918938 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:55:05.818175 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f84d460e-4944-450e-8fd1-6b94b9fe9e4d tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:05.820585 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f84d460e-4944-450e-8fd1-6b94b9fe9e4d tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:05.820751 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-f5f63094-4e12-4024-acbe-a1f68f918938 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 97420520-0d79-4db7-bc86-e5933443418d] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:05.823561 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f84d460e-4944-450e-8fd1-6b94b9fe9e4d tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:05.825511 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f84d460e-4944-450e-8fd1-6b94b9fe9e4d tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:05.826196 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f84d460e-4944-450e-8fd1-6b94b9fe9e4d tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:05.840974 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-f5f63094-4e12-4024-acbe-a1f68f918938 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] HTTP exception thrown: Instance 97420520-0d79-4db7-bc86-e5933443418d could not be found. Oct 04 18:55:05.853454 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-f5f63094-4e12-4024-acbe-a1f68f918938 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Request method failure captured: Oct 04 18:55:05.853454 n-d-851028-13 devstack@n-api.service[123595]: request: POST /compute/v2.1/servers/97420520-0d79-4db7-bc86-e5933443418d/action HTTP/1.1 Oct 04 18:55:05.853454 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 18:55:05.853454 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 18:55:05.853454 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 18:55:05.853454 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 39 Oct 04 18:55:05.853454 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 18:55:05.853454 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 18:55:05.853454 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 18:55:05.853454 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 18:55:05.853454 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPIEZsAoFcr6P1AMHBWUo8LvryOn1l2-LYSKr4xgLCvHblWFuAiGVlStWcljkgzOc7-ldx7qv3C-2jYmQ32_Zk5yP28dI64Re9CsyHCLmsYfyJdD0-2_kU92lHK36Fs8oXqXU2FijNX-X4IYqe4GjOQDN7LB9zCeEIcrxQ2LRJFOwbQY Oct 04 18:55:05.853454 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 18:55:05.853454 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 18:55:05.853454 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 18:55:05.853454 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 18:55:05.853454 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 18:55:05.853454 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 18:55:05.853454 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: 1607b30b9f324abaa88aa29e04ef3ec4 Oct 04 18:55:05.853454 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-ServersNegativeTestJSON-708693932 Oct 04 18:55:05.853454 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 18:55:05.853454 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 18:55:05.853454 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/1607b30b9f324abaa88aa29e04ef3ec4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_1607b30b9f324abaa88aa29e04ef3ec4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1607b30b9f324abaa88aa29e04ef3ec4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1607b30b9f324abaa88aa29e04ef3ec4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:55:05.853454 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-ServersNegativeTestJSON-708693932 Oct 04 18:55:05.853454 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: 1607b30b9f324abaa88aa29e04ef3ec4 Oct 04 18:55:05.853454 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-ServersNegativeTestJSON-708693932 Oct 04 18:55:05.853454 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-ServersNegativeTestJSON-708693932-project Oct 04 18:55:05.853454 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 18:55:05.853454 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 18:55:05.853454 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: 6f63f1ac147543dab34a28a22eb5936c Oct 04 18:55:05.853454 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-ServersNegativeTestJSON-708693932-project Oct 04 18:55:05.853454 n-d-851028-13 devstack@n-api.service[123595]: Oct 04 18:55:05.853454 n-d-851028-13 devstack@n-api.service[123595]: {"os-getConsoleOutput": {"length": 10}} Oct 04 18:55:05.853454 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 18:55:05.853454 n-d-851028-13 devstack@n-api.service[123595]: exception: Instance 97420520-0d79-4db7-bc86-e5933443418d could not be found. Oct 04 18:55:05.853454 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': '97420520-0d79-4db7-bc86-e5933443418d', 'body': {'os-getConsoleOutput': {'length': 10}}} Oct 04 18:55:05.853454 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:55:05.853454 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:55:05.853454 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:55:05.853454 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:55:05.853454 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:55:05.853454 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:55:05.853454 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 18:55:05.853454 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 18:55:05.853454 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97420520-0d79-4db7-bc86-e5933443418d could not be found. Oct 04 18:55:05.853454 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:55:05.853454 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:55:05.853454 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:55:05.853454 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:55:05.853454 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:55:05.853454 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:55:05.853454 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:55:05.853454 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:55:05.853454 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:55:05.853454 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:55:05.853454 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:55:05.853454 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:55:05.853454 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/console_output.py", line 41, in get_console_output Oct 04 18:55:05.853454 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 04 18:55:05.853454 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:55:05.853454 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:55:05.853454 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97420520-0d79-4db7-bc86-e5933443418d could not be found. Oct 04 18:55:05.853454 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:55:05.853454 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:55:05.853454 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:55:05.853454 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:55:05.859138 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:55:05.859138 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:55:05.859138 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:55:05.859138 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:55:05.859138 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97420520-0d79-4db7-bc86-e5933443418d could not be found. Oct 04 18:55:05.859138 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:55:05.859138 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-f5f63094-4e12-4024-acbe-a1f68f918938 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Returning 404 to user: Instance 97420520-0d79-4db7-bc86-e5933443418d could not be found. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:55:05.860448 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-f5f63094-4e12-4024-acbe-a1f68f918938 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "POST /compute/v2.1/servers/97420520-0d79-4db7-bc86-e5933443418d/action" status: 404 len: 111 microversion: 2.1 time: 0.057310 Oct 04 18:55:05.861431 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2249/4784] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 18:55:05 2022] POST /compute/v2.1/servers/97420520-0d79-4db7-bc86-e5933443418d/action => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:55:05.878786 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-88bae12e-f97a-4f0a-9726-858b03417b56 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:05.881518 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-88bae12e-f97a-4f0a-9726-858b03417b56 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 01e250ab-d9aa-4708-ae36-10c53a411a40] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:05.901463 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-88bae12e-f97a-4f0a-9726-858b03417b56 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:05.920122 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-88bae12e-f97a-4f0a-9726-858b03417b56 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:05.920807 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-88bae12e-f97a-4f0a-9726-858b03417b56 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:05.921720 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-88bae12e-f97a-4f0a-9726-858b03417b56 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:05.922313 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-88bae12e-f97a-4f0a-9726-858b03417b56 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:05.922850 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-88bae12e-f97a-4f0a-9726-858b03417b56 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:06.533323 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-f84d460e-4944-450e-8fd1-6b94b9fe9e4d tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:06.565359 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-f84d460e-4944-450e-8fd1-6b94b9fe9e4d tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:06.591820 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-f84d460e-4944-450e-8fd1-6b94b9fe9e4d tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:06.595958 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-f84d460e-4944-450e-8fd1-6b94b9fe9e4d tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] 10.222.0.43 "GET /compute/v2.1/servers/02a066b4-243b-4fe3-afcf-30f3e9511d1b" status: 200 len: 1661 microversion: 2.42 time: 0.823022 Oct 04 18:55:06.614535 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2536/4785] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:55:05 2022] GET /compute/v2.1/servers/02a066b4-243b-4fe3-afcf-30f3e9511d1b => generated 1661 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:55:07.495176 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-88bae12e-f97a-4f0a-9726-858b03417b56 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f63f1ac147543dab34a28a22eb5936c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1607b30b9f324abaa88aa29e04ef3ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:07.509515 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-88bae12e-f97a-4f0a-9726-858b03417b56 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40" status: 200 len: 1505 microversion: 2.1 time: 1.643211 Oct 04 18:55:07.510115 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2250/4786] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:05 2022] GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40 => generated 1505 bytes in 1644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:55:07.540273 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-94351577-9f5d-45ad-bf4f-47cfd71fef11 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:07.546335 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-94351577-9f5d-45ad-bf4f-47cfd71fef11 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 01e250ab-d9aa-4708-ae36-10c53a411a40] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:07.548700 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=2 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:55:07.563398 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-94351577-9f5d-45ad-bf4f-47cfd71fef11 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:07.568667 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-94351577-9f5d-45ad-bf4f-47cfd71fef11 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:07.570350 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-94351577-9f5d-45ad-bf4f-47cfd71fef11 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:07.572658 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-94351577-9f5d-45ad-bf4f-47cfd71fef11 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:07.576015 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-94351577-9f5d-45ad-bf4f-47cfd71fef11 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:07.577177 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-94351577-9f5d-45ad-bf4f-47cfd71fef11 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:07.627576 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-00dd2110-5509-4b53-a9d6-f6824c7d5fdf tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:07.628186 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-00dd2110-5509-4b53-a9d6-f6824c7d5fdf tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] [instance: 02a066b4-243b-4fe3-afcf-30f3e9511d1b] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:07.643934 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-00dd2110-5509-4b53-a9d6-f6824c7d5fdf tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:07.644805 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-00dd2110-5509-4b53-a9d6-f6824c7d5fdf tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:07.646091 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-00dd2110-5509-4b53-a9d6-f6824c7d5fdf tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:07.649296 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-00dd2110-5509-4b53-a9d6-f6824c7d5fdf tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:07.651362 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-00dd2110-5509-4b53-a9d6-f6824c7d5fdf tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:07.651865 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-00dd2110-5509-4b53-a9d6-f6824c7d5fdf tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:08.320210 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-00dd2110-5509-4b53-a9d6-f6824c7d5fdf tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:08.341320 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-00dd2110-5509-4b53-a9d6-f6824c7d5fdf tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:08.344648 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-00dd2110-5509-4b53-a9d6-f6824c7d5fdf tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:08.347665 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-00dd2110-5509-4b53-a9d6-f6824c7d5fdf tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] 10.222.0.43 "GET /compute/v2.1/servers/02a066b4-243b-4fe3-afcf-30f3e9511d1b" status: 200 len: 1661 microversion: 2.42 time: 0.724842 Oct 04 18:55:08.351029 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2251/4787] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:55:07 2022] GET /compute/v2.1/servers/02a066b4-243b-4fe3-afcf-30f3e9511d1b => generated 1661 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:55:08.465817 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-94351577-9f5d-45ad-bf4f-47cfd71fef11 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f63f1ac147543dab34a28a22eb5936c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1607b30b9f324abaa88aa29e04ef3ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:08.488822 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-94351577-9f5d-45ad-bf4f-47cfd71fef11 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40" status: 200 len: 1505 microversion: 2.1 time: 0.947711 Oct 04 18:55:08.491287 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2537/4788] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:07 2022] GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40 => generated 1505 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:55:08.520675 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-a1f439b0-2abf-48ec-ab49-f43b73c5a1a6 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:08.521485 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-a1f439b0-2abf-48ec-ab49-f43b73c5a1a6 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 13e5a3bc-83c2-4db3-9dc0-c6c94bc0236d] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:08.546110 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-a1f439b0-2abf-48ec-ab49-f43b73c5a1a6 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] HTTP exception thrown: Instance 13e5a3bc-83c2-4db3-9dc0-c6c94bc0236d could not be found. Oct 04 18:55:08.549422 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-a1f439b0-2abf-48ec-ab49-f43b73c5a1a6 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Request method failure captured: Oct 04 18:55:08.549422 n-d-851028-13 devstack@n-api.service[123595]: request: GET /compute/v2.1/servers/13e5a3bc-83c2-4db3-9dc0-c6c94bc0236d HTTP/1.1 Oct 04 18:55:08.549422 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 18:55:08.549422 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 18:55:08.549422 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 18:55:08.549422 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 0 Oct 04 18:55:08.549422 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 18:55:08.549422 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 18:55:08.549422 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 18:55:08.549422 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 18:55:08.549422 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPIEZsAoFcr6P1AMHBWUo8LvryOn1l2-LYSKr4xgLCvHblWFuAiGVlStWcljkgzOc7-ldx7qv3C-2jYmQ32_Zk5yP28dI64Re9CsyHCLmsYfyJdD0-2_kU92lHK36Fs8oXqXU2FijNX-X4IYqe4GjOQDN7LB9zCeEIcrxQ2LRJFOwbQY Oct 04 18:55:08.549422 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 18:55:08.549422 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 18:55:08.549422 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 18:55:08.549422 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 18:55:08.549422 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 18:55:08.549422 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 18:55:08.549422 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: 1607b30b9f324abaa88aa29e04ef3ec4 Oct 04 18:55:08.549422 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-ServersNegativeTestJSON-708693932 Oct 04 18:55:08.549422 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 18:55:08.549422 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 18:55:08.549422 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/1607b30b9f324abaa88aa29e04ef3ec4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_1607b30b9f324abaa88aa29e04ef3ec4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1607b30b9f324abaa88aa29e04ef3ec4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1607b30b9f324abaa88aa29e04ef3ec4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:55:08.549422 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-ServersNegativeTestJSON-708693932 Oct 04 18:55:08.549422 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: 1607b30b9f324abaa88aa29e04ef3ec4 Oct 04 18:55:08.549422 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-ServersNegativeTestJSON-708693932 Oct 04 18:55:08.549422 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-ServersNegativeTestJSON-708693932-project Oct 04 18:55:08.549422 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 18:55:08.549422 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 18:55:08.549422 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: 6f63f1ac147543dab34a28a22eb5936c Oct 04 18:55:08.549422 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-ServersNegativeTestJSON-708693932-project Oct 04 18:55:08.549422 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 18:55:08.549422 n-d-851028-13 devstack@n-api.service[123595]: exception: Instance 13e5a3bc-83c2-4db3-9dc0-c6c94bc0236d could not be found. Oct 04 18:55:08.549422 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': '13e5a3bc-83c2-4db3-9dc0-c6c94bc0236d'} Oct 04 18:55:08.549422 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:55:08.549422 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:55:08.549422 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:55:08.549422 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:55:08.549422 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:55:08.549422 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:55:08.549422 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 18:55:08.549422 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 18:55:08.549422 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13e5a3bc-83c2-4db3-9dc0-c6c94bc0236d could not be found. Oct 04 18:55:08.549422 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:55:08.549422 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:55:08.549422 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:55:08.549422 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:55:08.549422 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:55:08.549422 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:55:08.549422 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:55:08.549422 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:55:08.549422 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:55:08.549422 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:55:08.549422 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:55:08.549422 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:55:08.549422 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:55:08.549422 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:55:08.549422 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:55:08.549422 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:55:08.549422 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13e5a3bc-83c2-4db3-9dc0-c6c94bc0236d could not be found. Oct 04 18:55:08.549422 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:55:08.549422 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:55:08.549422 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:55:08.549422 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:55:08.549422 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:55:08.553840 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:55:08.553840 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:55:08.553840 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:55:08.553840 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13e5a3bc-83c2-4db3-9dc0-c6c94bc0236d could not be found. Oct 04 18:55:08.553840 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:55:08.559513 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-a1f439b0-2abf-48ec-ab49-f43b73c5a1a6 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Returning 404 to user: Instance 13e5a3bc-83c2-4db3-9dc0-c6c94bc0236d could not be found. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:55:08.561367 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-a1f439b0-2abf-48ec-ab49-f43b73c5a1a6 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "GET /compute/v2.1/servers/13e5a3bc-83c2-4db3-9dc0-c6c94bc0236d" status: 404 len: 111 microversion: 2.1 time: 0.046382 Oct 04 18:55:08.569917 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2252/4789] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:08 2022] GET /compute/v2.1/servers/13e5a3bc-83c2-4db3-9dc0-c6c94bc0236d => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:55:08.571341 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-9890a2d1-e93e-4bc2-88e4-cc1437cce984 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:08.572178 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-9890a2d1-e93e-4bc2-88e4-cc1437cce984 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 01e250ab-d9aa-4708-ae36-10c53a411a40] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:08.594184 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9890a2d1-e93e-4bc2-88e4-cc1437cce984 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:08.598223 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9890a2d1-e93e-4bc2-88e4-cc1437cce984 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:08.598808 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9890a2d1-e93e-4bc2-88e4-cc1437cce984 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:08.599805 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9890a2d1-e93e-4bc2-88e4-cc1437cce984 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:08.600109 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9890a2d1-e93e-4bc2-88e4-cc1437cce984 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:08.600557 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9890a2d1-e93e-4bc2-88e4-cc1437cce984 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:09.382377 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-03c61684-0408-4e85-86b3-7ae66dedcf32 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:09.383263 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-03c61684-0408-4e85-86b3-7ae66dedcf32 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] [instance: 02a066b4-243b-4fe3-afcf-30f3e9511d1b] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:09.409593 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-03c61684-0408-4e85-86b3-7ae66dedcf32 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:09.411296 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-03c61684-0408-4e85-86b3-7ae66dedcf32 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:09.413442 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-03c61684-0408-4e85-86b3-7ae66dedcf32 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:09.414412 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-03c61684-0408-4e85-86b3-7ae66dedcf32 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:09.417741 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-03c61684-0408-4e85-86b3-7ae66dedcf32 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:09.418426 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-03c61684-0408-4e85-86b3-7ae66dedcf32 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:09.896483 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-9890a2d1-e93e-4bc2-88e4-cc1437cce984 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f63f1ac147543dab34a28a22eb5936c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1607b30b9f324abaa88aa29e04ef3ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:09.921665 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-9890a2d1-e93e-4bc2-88e4-cc1437cce984 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40" status: 200 len: 1505 microversion: 2.1 time: 1.352563 Oct 04 18:55:09.922311 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2538/4790] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:08 2022] GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40 => generated 1505 bytes in 1356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:55:09.958086 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-6765c6ca-5ea3-4921-a56d-1412b40662fc tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:09.958831 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-6765c6ca-5ea3-4921-a56d-1412b40662fc tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 01e250ab-d9aa-4708-ae36-10c53a411a40] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:09.969399 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=8 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:55:09.973274 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6765c6ca-5ea3-4921-a56d-1412b40662fc tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:09.973799 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6765c6ca-5ea3-4921-a56d-1412b40662fc tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:09.974255 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6765c6ca-5ea3-4921-a56d-1412b40662fc tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:09.977212 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6765c6ca-5ea3-4921-a56d-1412b40662fc tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:09.977709 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6765c6ca-5ea3-4921-a56d-1412b40662fc tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:09.978292 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6765c6ca-5ea3-4921-a56d-1412b40662fc tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:09.994576 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=100 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:55:10.644452 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-03c61684-0408-4e85-86b3-7ae66dedcf32 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:10.671871 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-03c61684-0408-4e85-86b3-7ae66dedcf32 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:10.682650 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-03c61684-0408-4e85-86b3-7ae66dedcf32 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:10.687670 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-03c61684-0408-4e85-86b3-7ae66dedcf32 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] 10.222.0.43 "GET /compute/v2.1/servers/02a066b4-243b-4fe3-afcf-30f3e9511d1b" status: 200 len: 1661 microversion: 2.42 time: 1.308657 Oct 04 18:55:10.692370 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2253/4791] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:55:09 2022] GET /compute/v2.1/servers/02a066b4-243b-4fe3-afcf-30f3e9511d1b => generated 1661 bytes in 1314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:55:10.717618 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-277528e6-4083-4314-bb60-8f464a8cb9cf req-1b9fcd3e-7008-4507-9887-5d5ee91c5d86 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "523fce83-2292-42b0-9b99-c9ac2c48e544", "tag": "1a8e604e-bf22-40c8-b5c0-f1df67aebd3a"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:55:10.747890 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-277528e6-4083-4314-bb60-8f464a8cb9cf req-1b9fcd3e-7008-4507-9887-5d5ee91c5d86 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:10.752496 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-277528e6-4083-4314-bb60-8f464a8cb9cf req-1b9fcd3e-7008-4507-9887-5d5ee91c5d86 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:10.769795 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-277528e6-4083-4314-bb60-8f464a8cb9cf req-1b9fcd3e-7008-4507-9887-5d5ee91c5d86 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:10.829288 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-277528e6-4083-4314-bb60-8f464a8cb9cf req-1b9fcd3e-7008-4507-9887-5d5ee91c5d86 service nova] Creating event network-changed:1a8e604e-bf22-40c8-b5c0-f1df67aebd3a for instance 523fce83-2292-42b0-9b99-c9ac2c48e544 on n-h1-851028-13 Oct 04 18:55:10.844373 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-277528e6-4083-4314-bb60-8f464a8cb9cf req-1b9fcd3e-7008-4507-9887-5d5ee91c5d86 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.149644 Oct 04 18:55:10.845666 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2254/4792] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:55:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:55:11.524134 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-6765c6ca-5ea3-4921-a56d-1412b40662fc tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f63f1ac147543dab34a28a22eb5936c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1607b30b9f324abaa88aa29e04ef3ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:11.538281 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-6765c6ca-5ea3-4921-a56d-1412b40662fc tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40" status: 200 len: 1505 microversion: 2.1 time: 1.586657 Oct 04 18:55:11.539170 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2539/4793] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:09 2022] GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40 => generated 1505 bytes in 1588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:55:11.814160 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-50409949-bc6a-44ba-97f0-459945404d66 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:11.815686 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-50409949-bc6a-44ba-97f0-459945404d66 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] [instance: 02a066b4-243b-4fe3-afcf-30f3e9511d1b] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:11.835032 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-50409949-bc6a-44ba-97f0-459945404d66 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:11.835819 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-50409949-bc6a-44ba-97f0-459945404d66 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:11.837690 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-50409949-bc6a-44ba-97f0-459945404d66 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:11.838757 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-50409949-bc6a-44ba-97f0-459945404d66 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:11.841789 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-50409949-bc6a-44ba-97f0-459945404d66 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:11.842543 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-50409949-bc6a-44ba-97f0-459945404d66 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:11.896243 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-691a828a-bd00-490e-87a8-a56399d74430 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-45478631", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "66b6832b-a1b2-4da9-addc-63f223a4cc5a"}]}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:55:11.924792 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-691a828a-bd00-490e-87a8-a56399d74430 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Request method failure captured: Oct 04 18:55:11.924792 n-d-851028-13 devstack@n-api.service[123596]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 18:55:11.924792 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:55:11.924792 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:55:11.924792 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:55:11.924792 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 236 Oct 04 18:55:11.924792 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:55:11.924792 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:55:11.924792 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:55:11.924792 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:55:11.924792 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPIEZsAoFcr6P1AMHBWUo8LvryOn1l2-LYSKr4xgLCvHblWFuAiGVlStWcljkgzOc7-ldx7qv3C-2jYmQ32_Zk5yP28dI64Re9CsyHCLmsYfyJdD0-2_kU92lHK36Fs8oXqXU2FijNX-X4IYqe4GjOQDN7LB9zCeEIcrxQ2LRJFOwbQY Oct 04 18:55:11.924792 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:55:11.924792 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:55:11.924792 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:55:11.924792 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:55:11.924792 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:55:11.924792 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:55:11.924792 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: 1607b30b9f324abaa88aa29e04ef3ec4 Oct 04 18:55:11.924792 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-ServersNegativeTestJSON-708693932 Oct 04 18:55:11.924792 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 18:55:11.924792 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 18:55:11.924792 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/1607b30b9f324abaa88aa29e04ef3ec4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_1607b30b9f324abaa88aa29e04ef3ec4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1607b30b9f324abaa88aa29e04ef3ec4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1607b30b9f324abaa88aa29e04ef3ec4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:55:11.924792 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-ServersNegativeTestJSON-708693932 Oct 04 18:55:11.924792 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: 1607b30b9f324abaa88aa29e04ef3ec4 Oct 04 18:55:11.924792 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-ServersNegativeTestJSON-708693932 Oct 04 18:55:11.924792 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-ServersNegativeTestJSON-708693932-project Oct 04 18:55:11.924792 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:55:11.924792 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:55:11.924792 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 6f63f1ac147543dab34a28a22eb5936c Oct 04 18:55:11.924792 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-ServersNegativeTestJSON-708693932-project Oct 04 18:55:11.924792 n-d-851028-13 devstack@n-api.service[123596]: Oct 04 18:55:11.924792 n-d-851028-13 devstack@n-api.service[123596]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-45478631", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "66b6832b-a1b2-4da9-addc-63f223a4cc5a"}]}} Oct 04 18:55:11.924792 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 18:55:11.924792 n-d-851028-13 devstack@n-api.service[123596]: exception: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 04 18:55:11.924792 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-45478631', 'imageRef': 'e8943ec5-4038-4d4b-b9b9-2415a79f5243', 'flavorRef': '452', 'accessIPv4': '1.1.1.1.1.1', 'networks': [{'uuid': '66b6832b-a1b2-4da9-addc-63f223a4cc5a'}]}}} Oct 04 18:55:11.924792 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:55:11.924792 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:55:11.924792 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 04 18:55:11.924792 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 04 18:55:11.924792 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 253, in is_ipv4 Oct 04 18:55:11.924792 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return bool(ipaddress.IPv4Address(instance)) Oct 04 18:55:11.924792 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1257, in __init__ Oct 04 18:55:11.924792 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Oct 04 18:55:11.924792 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1144, in _ip_int_from_string Oct 04 18:55:11.924792 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise AddressValueError("Expected 4 octets in %r" % ip_str) Oct 04 18:55:11.924792 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: Expected 4 octets in '1.1.1.1.1.1' Oct 04 18:55:11.924792 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:55:11.924792 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 04 18:55:11.924792 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:55:11.924792 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:55:11.924792 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:55:11.924792 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:55:11.924792 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:55:11.924792 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:55:11.924792 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '1.1.1.1.1.1' is not a 'ipv4' Oct 04 18:55:11.924792 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:55:11.924792 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv4']: Oct 04 18:55:11.924792 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi {'format': 'ipv4', 'type': 'string'} Oct 04 18:55:11.924792 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:55:11.924792 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 04 18:55:11.924792 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi '1.1.1.1.1.1' Oct 04 18:55:11.924792 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:55:11.924792 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:55:11.924792 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:55:11.924792 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:55:11.929929 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:55:11.929929 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:55:11.929929 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:55:11.929929 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:55:11.929929 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:55:11.929929 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:55:11.929929 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:55:11.929929 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:55:11.929929 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 18:55:11.929929 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 18:55:11.929929 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:55:11.929929 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:55:11.929929 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:55:11.929929 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:55:11.929929 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 04 18:55:11.929929 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:55:11.929929 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:55:11.929929 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:55:11.929929 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:55:11.929929 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:55:11.929929 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:55:11.929929 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:55:11.929929 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:55:11.929929 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 04 18:55:11.929929 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:55:11.932839 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-691a828a-bd00-490e-87a8-a56399d74430 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:55:11.935093 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-691a828a-bd00-490e-87a8-a56399d74430 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.042336 Oct 04 18:55:11.938164 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2540/4794] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 18:55:11 2022] POST /compute/v2.1/servers => generated 139 bytes in 47 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 04 18:55:11.947053 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-1da2e8bf-b153-44cd-b2b7-e921d493c5a4 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:11.956437 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-1da2e8bf-b153-44cd-b2b7-e921d493c5a4 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 01e250ab-d9aa-4708-ae36-10c53a411a40] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:11.977542 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1da2e8bf-b153-44cd-b2b7-e921d493c5a4 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:11.978052 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1da2e8bf-b153-44cd-b2b7-e921d493c5a4 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:11.978552 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1da2e8bf-b153-44cd-b2b7-e921d493c5a4 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:11.979610 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1da2e8bf-b153-44cd-b2b7-e921d493c5a4 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:11.980394 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1da2e8bf-b153-44cd-b2b7-e921d493c5a4 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:11.981057 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1da2e8bf-b153-44cd-b2b7-e921d493c5a4 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:12.603584 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-50409949-bc6a-44ba-97f0-459945404d66 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:12.631659 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-50409949-bc6a-44ba-97f0-459945404d66 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:12.633525 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-50409949-bc6a-44ba-97f0-459945404d66 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:12.642511 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-50409949-bc6a-44ba-97f0-459945404d66 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] 10.222.0.43 "GET /compute/v2.1/servers/02a066b4-243b-4fe3-afcf-30f3e9511d1b" status: 200 len: 1707 microversion: 2.42 time: 0.831088 Oct 04 18:55:12.647768 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2255/4795] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:55:11 2022] GET /compute/v2.1/servers/02a066b4-243b-4fe3-afcf-30f3e9511d1b => generated 1707 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:55:12.838423 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-1da2e8bf-b153-44cd-b2b7-e921d493c5a4 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f63f1ac147543dab34a28a22eb5936c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1607b30b9f324abaa88aa29e04ef3ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:12.859092 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-1da2e8bf-b153-44cd-b2b7-e921d493c5a4 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40" status: 200 len: 1505 microversion: 2.1 time: 0.916684 Oct 04 18:55:12.859720 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2541/4796] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:11 2022] GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40 => generated 1505 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:55:12.888839 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-6976433e-91f8-4af2-86bc-2247fd22c4c3 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:12.890739 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-6976433e-91f8-4af2-86bc-2247fd22c4c3 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 01e250ab-d9aa-4708-ae36-10c53a411a40] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:12.908113 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6976433e-91f8-4af2-86bc-2247fd22c4c3 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:12.910360 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6976433e-91f8-4af2-86bc-2247fd22c4c3 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:12.911327 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6976433e-91f8-4af2-86bc-2247fd22c4c3 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:12.912306 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6976433e-91f8-4af2-86bc-2247fd22c4c3 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:12.914027 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6976433e-91f8-4af2-86bc-2247fd22c4c3 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:12.916291 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6976433e-91f8-4af2-86bc-2247fd22c4c3 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:13.584793 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-6976433e-91f8-4af2-86bc-2247fd22c4c3 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f63f1ac147543dab34a28a22eb5936c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1607b30b9f324abaa88aa29e04ef3ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:13.622546 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-6976433e-91f8-4af2-86bc-2247fd22c4c3 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40" status: 200 len: 1505 microversion: 2.1 time: 0.737056 Oct 04 18:55:13.626512 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2256/4797] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:12 2022] GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40 => generated 1505 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:55:13.674224 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-ff0c71a8-1403-45d8-9b73-7997005b69e1 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:13.676459 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-6b84578b-82b4-4c8d-b6e2-4cd505e8a639 tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-932017845", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "13dadf36-8750-4763-bd69-bb51f3bddde7"}], "security_groups": [{"name": "tempest-securitygroup--1881213916"}], "key_name": "tempest-keypair-834340097", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:55:13.677635 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-ff0c71a8-1403-45d8-9b73-7997005b69e1 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] [instance: 02a066b4-243b-4fe3-afcf-30f3e9511d1b] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:13.712548 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ff0c71a8-1403-45d8-9b73-7997005b69e1 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:13.718869 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ff0c71a8-1403-45d8-9b73-7997005b69e1 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:13.719839 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ff0c71a8-1403-45d8-9b73-7997005b69e1 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:13.721455 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ff0c71a8-1403-45d8-9b73-7997005b69e1 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:13.722510 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ff0c71a8-1403-45d8-9b73-7997005b69e1 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:13.723272 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ff0c71a8-1403-45d8-9b73-7997005b69e1 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:14.032630 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.network.neutron [None req-6b84578b-82b4-4c8d-b6e2-4cd505e8a639 tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] validate_networks() for [('13dadf36-8750-4763-bd69-bb51f3bddde7', None, None, None, None, None)] {{(pid=123596) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:55:14.919848 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-ff0c71a8-1403-45d8-9b73-7997005b69e1 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:14.935101 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-ff0c71a8-1403-45d8-9b73-7997005b69e1 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:14.940649 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-ff0c71a8-1403-45d8-9b73-7997005b69e1 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:14.944671 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-ff0c71a8-1403-45d8-9b73-7997005b69e1 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] 10.222.0.43 "GET /compute/v2.1/servers/02a066b4-243b-4fe3-afcf-30f3e9511d1b" status: 200 len: 1707 microversion: 2.42 time: 1.275981 Oct 04 18:55:14.946766 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2257/4798] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:55:13 2022] GET /compute/v2.1/servers/02a066b4-243b-4fe3-afcf-30f3e9511d1b => generated 1707 bytes in 1279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:55:14.956559 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-7cf8d874-c2d2-44b5-9209-7c76991c41cc tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1203216832", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "66b6832b-a1b2-4da9-addc-63f223a4cc5a"}]}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:55:14.973876 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-7cf8d874-c2d2-44b5-9209-7c76991c41cc tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Request method failure captured: Oct 04 18:55:14.973876 n-d-851028-13 devstack@n-api.service[123595]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 18:55:14.973876 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 18:55:14.973876 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 18:55:14.973876 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 18:55:14.973876 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 235 Oct 04 18:55:14.973876 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 18:55:14.973876 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 18:55:14.973876 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 18:55:14.973876 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 18:55:14.973876 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPIEZsAoFcr6P1AMHBWUo8LvryOn1l2-LYSKr4xgLCvHblWFuAiGVlStWcljkgzOc7-ldx7qv3C-2jYmQ32_Zk5yP28dI64Re9CsyHCLmsYfyJdD0-2_kU92lHK36Fs8oXqXU2FijNX-X4IYqe4GjOQDN7LB9zCeEIcrxQ2LRJFOwbQY Oct 04 18:55:14.973876 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 18:55:14.973876 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 18:55:14.973876 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 18:55:14.973876 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 18:55:14.973876 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 18:55:14.973876 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 18:55:14.973876 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: 1607b30b9f324abaa88aa29e04ef3ec4 Oct 04 18:55:14.973876 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-ServersNegativeTestJSON-708693932 Oct 04 18:55:14.973876 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 18:55:14.973876 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 18:55:14.973876 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/1607b30b9f324abaa88aa29e04ef3ec4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_1607b30b9f324abaa88aa29e04ef3ec4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1607b30b9f324abaa88aa29e04ef3ec4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1607b30b9f324abaa88aa29e04ef3ec4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:55:14.973876 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-ServersNegativeTestJSON-708693932 Oct 04 18:55:14.973876 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: 1607b30b9f324abaa88aa29e04ef3ec4 Oct 04 18:55:14.973876 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-ServersNegativeTestJSON-708693932 Oct 04 18:55:14.973876 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-ServersNegativeTestJSON-708693932-project Oct 04 18:55:14.973876 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 18:55:14.973876 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 18:55:14.973876 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: 6f63f1ac147543dab34a28a22eb5936c Oct 04 18:55:14.973876 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-ServersNegativeTestJSON-708693932-project Oct 04 18:55:14.973876 n-d-851028-13 devstack@n-api.service[123595]: Oct 04 18:55:14.973876 n-d-851028-13 devstack@n-api.service[123595]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1203216832", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "66b6832b-a1b2-4da9-addc-63f223a4cc5a"}]}} Oct 04 18:55:14.973876 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 18:55:14.973876 n-d-851028-13 devstack@n-api.service[123595]: exception: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 04 18:55:14.973876 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1203216832', 'imageRef': 'e8943ec5-4038-4d4b-b9b9-2415a79f5243', 'flavorRef': '452', 'accessIPv6': 'notvalid', 'networks': [{'uuid': '66b6832b-a1b2-4da9-addc-63f223a4cc5a'}]}}} Oct 04 18:55:14.973876 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:55:14.973876 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:55:14.973876 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 04 18:55:14.973876 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 04 18:55:14.973876 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 260, in is_ipv6 Oct 04 18:55:14.973876 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi address = ipaddress.IPv6Address(instance) Oct 04 18:55:14.973876 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1844, in __init__ Oct 04 18:55:14.973876 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Oct 04 18:55:14.973876 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1581, in _ip_int_from_string Oct 04 18:55:14.973876 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise AddressValueError(msg) Oct 04 18:55:14.973876 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: At least 3 parts expected in 'notvalid' Oct 04 18:55:14.973876 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:55:14.973876 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 04 18:55:14.973876 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:55:14.973876 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:55:14.973876 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:55:14.973876 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:55:14.973876 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:55:14.973876 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:55:14.973876 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'notvalid' is not a 'ipv6' Oct 04 18:55:14.973876 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:55:14.973876 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv6']: Oct 04 18:55:14.973876 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi {'format': 'ipv6', 'type': 'string'} Oct 04 18:55:14.973876 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:55:14.973876 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 04 18:55:14.973876 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi 'notvalid' Oct 04 18:55:14.973876 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:55:14.973876 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:55:14.973876 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:55:14.973876 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:55:14.980670 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:55:14.980670 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:55:14.980670 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:55:14.980670 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:55:14.980670 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:55:14.980670 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:55:14.980670 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:55:14.980670 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:55:14.980670 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 18:55:14.980670 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 18:55:14.980670 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:55:14.980670 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:55:14.980670 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:55:14.980670 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:55:14.980670 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 04 18:55:14.980670 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:55:14.980670 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:55:14.980670 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:55:14.980670 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:55:14.980670 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:55:14.980670 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:55:14.980670 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:55:14.980670 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:55:14.980670 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 04 18:55:14.980670 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:55:14.986547 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-7cf8d874-c2d2-44b5-9209-7c76991c41cc tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:55:14.990383 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-7cf8d874-c2d2-44b5-9209-7c76991c41cc tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.041269 Oct 04 18:55:14.991219 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2258/4799] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 18:55:14 2022] POST /compute/v2.1/servers => generated 133 bytes in 44 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:55:15.008461 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-87e05780-3acd-4d51-8f29-bf12c3279741 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:15.014824 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-87e05780-3acd-4d51-8f29-bf12c3279741 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 01e250ab-d9aa-4708-ae36-10c53a411a40] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:15.036180 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-87e05780-3acd-4d51-8f29-bf12c3279741 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:15.037037 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-87e05780-3acd-4d51-8f29-bf12c3279741 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:15.037704 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-87e05780-3acd-4d51-8f29-bf12c3279741 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:15.038620 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-87e05780-3acd-4d51-8f29-bf12c3279741 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:15.039282 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-87e05780-3acd-4d51-8f29-bf12c3279741 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:15.039911 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-87e05780-3acd-4d51-8f29-bf12c3279741 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:15.307299 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=4 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:55:15.319978 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-6b84578b-82b4-4c8d-b6e2-4cd505e8a639 tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Getting quotas for project b74c55e15cfd4f2c9ce67c9aa91c1b5d. Resources: dict_keys(['metadata_items']) {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:55:15.337251 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-6b84578b-82b4-4c8d-b6e2-4cd505e8a639 tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Getting quotas for user b16d1e957e30423e9b06c6150e5c4a16 and project b74c55e15cfd4f2c9ce67c9aa91c1b5d. Resources: dict_keys(['metadata_items']) {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:55:15.372342 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-6b84578b-82b4-4c8d-b6e2-4cd505e8a639 tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Flavor limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:55:15.373063 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-6b84578b-82b4-4c8d-b6e2-4cd505e8a639 tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Image limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:55:15.373734 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-6b84578b-82b4-4c8d-b6e2-4cd505e8a639 tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Flavor pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:55:15.380368 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-6b84578b-82b4-4c8d-b6e2-4cd505e8a639 tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Image pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:55:15.381188 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-6b84578b-82b4-4c8d-b6e2-4cd505e8a639 tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:55:15.398786 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6b84578b-82b4-4c8d-b6e2-4cd505e8a639 tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:15.399690 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6b84578b-82b4-4c8d-b6e2-4cd505e8a639 tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:15.400334 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6b84578b-82b4-4c8d-b6e2-4cd505e8a639 tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:15.402432 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6b84578b-82b4-4c8d-b6e2-4cd505e8a639 tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:15.403590 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6b84578b-82b4-4c8d-b6e2-4cd505e8a639 tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:15.405286 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6b84578b-82b4-4c8d-b6e2-4cd505e8a639 tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:15.457859 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-6b84578b-82b4-4c8d-b6e2-4cd505e8a639 tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Getting quotas for project b74c55e15cfd4f2c9ce67c9aa91c1b5d. Resources: {'ram', 'cores', 'instances'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:55:15.471154 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-6b84578b-82b4-4c8d-b6e2-4cd505e8a639 tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Getting quotas for user b16d1e957e30423e9b06c6150e5c4a16 and project b74c55e15cfd4f2c9ce67c9aa91c1b5d. Resources: {'ram', 'cores', 'instances'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:55:15.509693 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-6b84578b-82b4-4c8d-b6e2-4cd505e8a639 tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Going to run 1 instances... {{(pid=123596) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:55:15.512079 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-6b84578b-82b4-4c8d-b6e2-4cd505e8a639 tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] [instance: e20fa332-f87b-47b3-a30c-52716e5e7a45] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e8943ec5-4038-4d4b-b9b9-2415a79f5243',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123596) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:55:15.630373 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-6b84578b-82b4-4c8d-b6e2-4cd505e8a639 tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 1.975835 Oct 04 18:55:15.650104 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2542/4800] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 18:55:13 2022] POST /compute/v2.1/servers => generated 407 bytes in 1979 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:55:15.657229 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-6b9ebce3-66a1-4ad3-add2-e1349cbd315a tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:15.657809 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-6b9ebce3-66a1-4ad3-add2-e1349cbd315a tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] [instance: e20fa332-f87b-47b3-a30c-52716e5e7a45] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:15.737980 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=6 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:55:15.816445 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-6b9ebce3-66a1-4ad3-add2-e1349cbd315a tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16d1e957e30423e9b06c6150e5c4a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74c55e15cfd4f2c9ce67c9aa91c1b5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:15.827256 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-6b9ebce3-66a1-4ad3-add2-e1349cbd315a tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] 10.222.0.43 "GET /compute/v2.1/servers/e20fa332-f87b-47b3-a30c-52716e5e7a45" status: 200 len: 1268 microversion: 2.1 time: 0.172945 Oct 04 18:55:15.829241 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2543/4801] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:15 2022] GET /compute/v2.1/servers/e20fa332-f87b-47b3-a30c-52716e5e7a45 => generated 1268 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:55:15.976052 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-8fc7d065-0de6-4a03-94d8-dd5c1ea3d8d5 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:15.979968 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-8fc7d065-0de6-4a03-94d8-dd5c1ea3d8d5 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] [instance: 02a066b4-243b-4fe3-afcf-30f3e9511d1b] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:15.995590 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8fc7d065-0de6-4a03-94d8-dd5c1ea3d8d5 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:15.996549 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8fc7d065-0de6-4a03-94d8-dd5c1ea3d8d5 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:15.997885 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8fc7d065-0de6-4a03-94d8-dd5c1ea3d8d5 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:16.001669 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8fc7d065-0de6-4a03-94d8-dd5c1ea3d8d5 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:16.003506 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8fc7d065-0de6-4a03-94d8-dd5c1ea3d8d5 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:16.004263 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8fc7d065-0de6-4a03-94d8-dd5c1ea3d8d5 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:16.116891 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-87e05780-3acd-4d51-8f29-bf12c3279741 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f63f1ac147543dab34a28a22eb5936c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1607b30b9f324abaa88aa29e04ef3ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:16.142268 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-87e05780-3acd-4d51-8f29-bf12c3279741 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40" status: 200 len: 1505 microversion: 2.1 time: 1.144901 Oct 04 18:55:16.161516 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2259/4802] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:14 2022] GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40 => generated 1505 bytes in 1165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:55:16.180434 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-f05db353-3f1c-4a46-b26f-48a7d05483cb tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:16.186500 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-f05db353-3f1c-4a46-b26f-48a7d05483cb tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 01e250ab-d9aa-4708-ae36-10c53a411a40] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:16.205254 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f05db353-3f1c-4a46-b26f-48a7d05483cb tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:16.221219 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f05db353-3f1c-4a46-b26f-48a7d05483cb tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:16.222268 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f05db353-3f1c-4a46-b26f-48a7d05483cb tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:16.223427 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f05db353-3f1c-4a46-b26f-48a7d05483cb tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:16.224141 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f05db353-3f1c-4a46-b26f-48a7d05483cb tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:16.225014 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f05db353-3f1c-4a46-b26f-48a7d05483cb tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:16.333580 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-8fc7d065-0de6-4a03-94d8-dd5c1ea3d8d5 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:16.350419 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-8fc7d065-0de6-4a03-94d8-dd5c1ea3d8d5 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:16.353779 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-8fc7d065-0de6-4a03-94d8-dd5c1ea3d8d5 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:16.356308 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-8fc7d065-0de6-4a03-94d8-dd5c1ea3d8d5 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] 10.222.0.43 "GET /compute/v2.1/servers/02a066b4-243b-4fe3-afcf-30f3e9511d1b" status: 200 len: 1753 microversion: 2.42 time: 0.384198 Oct 04 18:55:16.359235 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2544/4803] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:55:15 2022] GET /compute/v2.1/servers/02a066b4-243b-4fe3-afcf-30f3e9511d1b => generated 1753 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:55:16.855941 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-3dc15c81-1728-4463-9a7d-cdf4ccb7a803 tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:16.856568 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-3dc15c81-1728-4463-9a7d-cdf4ccb7a803 tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] [instance: e20fa332-f87b-47b3-a30c-52716e5e7a45] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:16.871598 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3dc15c81-1728-4463-9a7d-cdf4ccb7a803 tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:16.872106 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3dc15c81-1728-4463-9a7d-cdf4ccb7a803 tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:16.872559 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3dc15c81-1728-4463-9a7d-cdf4ccb7a803 tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:16.873332 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3dc15c81-1728-4463-9a7d-cdf4ccb7a803 tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:16.873875 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3dc15c81-1728-4463-9a7d-cdf4ccb7a803 tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:16.874393 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3dc15c81-1728-4463-9a7d-cdf4ccb7a803 tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:17.203723 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-3dc15c81-1728-4463-9a7d-cdf4ccb7a803 tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16d1e957e30423e9b06c6150e5c4a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74c55e15cfd4f2c9ce67c9aa91c1b5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:17.238434 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-3dc15c81-1728-4463-9a7d-cdf4ccb7a803 tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] 10.222.0.43 "GET /compute/v2.1/servers/e20fa332-f87b-47b3-a30c-52716e5e7a45" status: 200 len: 1272 microversion: 2.1 time: 0.383895 Oct 04 18:55:17.247744 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2545/4804] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:16 2022] GET /compute/v2.1/servers/e20fa332-f87b-47b3-a30c-52716e5e7a45 => generated 1272 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:55:17.391394 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-dc7ddf23-e9c7-4ecb-be31-2eeea56d8866 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:17.392862 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-dc7ddf23-e9c7-4ecb-be31-2eeea56d8866 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] [instance: 02a066b4-243b-4fe3-afcf-30f3e9511d1b] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:17.431154 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dc7ddf23-e9c7-4ecb-be31-2eeea56d8866 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:17.434649 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dc7ddf23-e9c7-4ecb-be31-2eeea56d8866 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:17.437014 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dc7ddf23-e9c7-4ecb-be31-2eeea56d8866 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:17.438098 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dc7ddf23-e9c7-4ecb-be31-2eeea56d8866 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:17.440210 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dc7ddf23-e9c7-4ecb-be31-2eeea56d8866 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:17.440838 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dc7ddf23-e9c7-4ecb-be31-2eeea56d8866 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:17.852528 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-dc7ddf23-e9c7-4ecb-be31-2eeea56d8866 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:17.882155 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-dc7ddf23-e9c7-4ecb-be31-2eeea56d8866 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:17.888703 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-dc7ddf23-e9c7-4ecb-be31-2eeea56d8866 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:17.891285 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-dc7ddf23-e9c7-4ecb-be31-2eeea56d8866 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] 10.222.0.43 "GET /compute/v2.1/servers/02a066b4-243b-4fe3-afcf-30f3e9511d1b" status: 200 len: 1753 microversion: 2.42 time: 0.505962 Oct 04 18:55:17.897035 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2546/4805] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:55:17 2022] GET /compute/v2.1/servers/02a066b4-243b-4fe3-afcf-30f3e9511d1b => generated 1753 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:55:18.264503 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-507bf3b6-f4b6-4bce-b44c-6c4aa5395a4f tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:18.265867 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-507bf3b6-f4b6-4bce-b44c-6c4aa5395a4f tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] [instance: e20fa332-f87b-47b3-a30c-52716e5e7a45] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:18.284925 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-507bf3b6-f4b6-4bce-b44c-6c4aa5395a4f tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:18.285474 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-507bf3b6-f4b6-4bce-b44c-6c4aa5395a4f tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:18.292289 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-507bf3b6-f4b6-4bce-b44c-6c4aa5395a4f tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:18.293088 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-507bf3b6-f4b6-4bce-b44c-6c4aa5395a4f tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:18.293605 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-507bf3b6-f4b6-4bce-b44c-6c4aa5395a4f tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:18.297228 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-507bf3b6-f4b6-4bce-b44c-6c4aa5395a4f tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:18.445589 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-507bf3b6-f4b6-4bce-b44c-6c4aa5395a4f tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16d1e957e30423e9b06c6150e5c4a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74c55e15cfd4f2c9ce67c9aa91c1b5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:18.460975 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-507bf3b6-f4b6-4bce-b44c-6c4aa5395a4f tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] 10.222.0.43 "GET /compute/v2.1/servers/e20fa332-f87b-47b3-a30c-52716e5e7a45" status: 200 len: 1326 microversion: 2.1 time: 0.199772 Oct 04 18:55:18.463784 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2547/4806] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:18 2022] GET /compute/v2.1/servers/e20fa332-f87b-47b3-a30c-52716e5e7a45 => generated 1326 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:55:18.727498 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-f05db353-3f1c-4a46-b26f-48a7d05483cb tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f63f1ac147543dab34a28a22eb5936c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1607b30b9f324abaa88aa29e04ef3ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:18.741735 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-f05db353-3f1c-4a46-b26f-48a7d05483cb tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40" status: 200 len: 1505 microversion: 2.1 time: 2.563357 Oct 04 18:55:18.741735 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2260/4807] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:16 2022] GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40 => generated 1505 bytes in 2565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:55:18.768286 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-b76c22f2-fcfa-4967-bf3d-1e45e1624549 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:55:18.769081 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-b76c22f2-fcfa-4967-bf3d-1e45e1624549 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 6bcb9623-3d20-4632-826b-6253a09db175] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:18.783175 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-b76c22f2-fcfa-4967-bf3d-1e45e1624549 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] HTTP exception thrown: Instance 6bcb9623-3d20-4632-826b-6253a09db175 could not be found. Oct 04 18:55:18.791388 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-b76c22f2-fcfa-4967-bf3d-1e45e1624549 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Request method failure captured: Oct 04 18:55:18.791388 n-d-851028-13 devstack@n-api.service[123596]: request: POST /compute/v2.1/servers/6bcb9623-3d20-4632-826b-6253a09db175/action HTTP/1.1 Oct 04 18:55:18.791388 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:55:18.791388 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:55:18.791388 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:55:18.791388 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 13 Oct 04 18:55:18.791388 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:55:18.791388 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:55:18.791388 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:55:18.791388 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:55:18.791388 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPIEZsAoFcr6P1AMHBWUo8LvryOn1l2-LYSKr4xgLCvHblWFuAiGVlStWcljkgzOc7-ldx7qv3C-2jYmQ32_Zk5yP28dI64Re9CsyHCLmsYfyJdD0-2_kU92lHK36Fs8oXqXU2FijNX-X4IYqe4GjOQDN7LB9zCeEIcrxQ2LRJFOwbQY Oct 04 18:55:18.791388 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:55:18.791388 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:55:18.791388 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:55:18.791388 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:55:18.791388 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:55:18.791388 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:55:18.791388 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: 1607b30b9f324abaa88aa29e04ef3ec4 Oct 04 18:55:18.791388 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-ServersNegativeTestJSON-708693932 Oct 04 18:55:18.791388 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 18:55:18.791388 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 18:55:18.791388 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/1607b30b9f324abaa88aa29e04ef3ec4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_1607b30b9f324abaa88aa29e04ef3ec4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1607b30b9f324abaa88aa29e04ef3ec4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1607b30b9f324abaa88aa29e04ef3ec4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:55:18.791388 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-ServersNegativeTestJSON-708693932 Oct 04 18:55:18.791388 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: 1607b30b9f324abaa88aa29e04ef3ec4 Oct 04 18:55:18.791388 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-ServersNegativeTestJSON-708693932 Oct 04 18:55:18.791388 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-ServersNegativeTestJSON-708693932-project Oct 04 18:55:18.791388 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:55:18.791388 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:55:18.791388 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 6f63f1ac147543dab34a28a22eb5936c Oct 04 18:55:18.791388 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-ServersNegativeTestJSON-708693932-project Oct 04 18:55:18.791388 n-d-851028-13 devstack@n-api.service[123596]: Oct 04 18:55:18.791388 n-d-851028-13 devstack@n-api.service[123596]: {"pause": {}} Oct 04 18:55:18.791388 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 18:55:18.791388 n-d-851028-13 devstack@n-api.service[123596]: exception: Instance 6bcb9623-3d20-4632-826b-6253a09db175 could not be found. Oct 04 18:55:18.791388 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': '6bcb9623-3d20-4632-826b-6253a09db175', 'body': {'pause': {}}} Oct 04 18:55:18.791388 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:55:18.791388 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:55:18.791388 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:55:18.791388 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:55:18.791388 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:55:18.791388 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:55:18.791388 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 18:55:18.791388 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 18:55:18.791388 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6bcb9623-3d20-4632-826b-6253a09db175 could not be found. Oct 04 18:55:18.791388 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:55:18.791388 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:55:18.791388 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:55:18.791388 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:55:18.791388 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:55:18.791388 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:55:18.791388 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:55:18.791388 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:55:18.791388 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:55:18.791388 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:55:18.791388 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 36, in _pause Oct 04 18:55:18.791388 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Oct 04 18:55:18.791388 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:55:18.791388 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:55:18.791388 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6bcb9623-3d20-4632-826b-6253a09db175 could not be found. Oct 04 18:55:18.791388 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:55:18.791388 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:55:18.791388 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:55:18.791388 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:55:18.791388 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:55:18.791388 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:55:18.796745 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:55:18.796745 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:55:18.796745 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6bcb9623-3d20-4632-826b-6253a09db175 could not be found. Oct 04 18:55:18.796745 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:55:18.796745 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-b76c22f2-fcfa-4967-bf3d-1e45e1624549 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Returning 404 to user: Instance 6bcb9623-3d20-4632-826b-6253a09db175 could not be found. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:55:18.796745 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-b76c22f2-fcfa-4967-bf3d-1e45e1624549 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "POST /compute/v2.1/servers/6bcb9623-3d20-4632-826b-6253a09db175/action" status: 404 len: 111 microversion: 2.1 time: 0.030320 Oct 04 18:55:18.796745 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2548/4808] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 18:55:18 2022] POST /compute/v2.1/servers/6bcb9623-3d20-4632-826b-6253a09db175/action => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:55:18.806719 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-d33a12bc-cf30-49e9-b438-a027130b0724 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:18.807671 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-d33a12bc-cf30-49e9-b438-a027130b0724 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 01e250ab-d9aa-4708-ae36-10c53a411a40] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:18.824697 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d33a12bc-cf30-49e9-b438-a027130b0724 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:18.825203 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d33a12bc-cf30-49e9-b438-a027130b0724 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:18.825666 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d33a12bc-cf30-49e9-b438-a027130b0724 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:18.826477 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d33a12bc-cf30-49e9-b438-a027130b0724 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:18.826944 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d33a12bc-cf30-49e9-b438-a027130b0724 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:18.827484 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d33a12bc-cf30-49e9-b438-a027130b0724 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:18.927912 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-e7beba68-8512-433f-94f7-d8d383ed76ed tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:18.928953 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-e7beba68-8512-433f-94f7-d8d383ed76ed tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] [instance: 02a066b4-243b-4fe3-afcf-30f3e9511d1b] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:18.938571 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e7beba68-8512-433f-94f7-d8d383ed76ed tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:18.939446 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e7beba68-8512-433f-94f7-d8d383ed76ed tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:18.940201 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e7beba68-8512-433f-94f7-d8d383ed76ed tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:18.941146 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e7beba68-8512-433f-94f7-d8d383ed76ed tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:18.941930 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e7beba68-8512-433f-94f7-d8d383ed76ed tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:18.942527 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e7beba68-8512-433f-94f7-d8d383ed76ed tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:19.527420 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-e7beba68-8512-433f-94f7-d8d383ed76ed tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:19.540765 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-e7beba68-8512-433f-94f7-d8d383ed76ed tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:19.547441 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-e7beba68-8512-433f-94f7-d8d383ed76ed tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:19.551299 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-e7beba68-8512-433f-94f7-d8d383ed76ed tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] 10.222.0.43 "GET /compute/v2.1/servers/02a066b4-243b-4fe3-afcf-30f3e9511d1b" status: 200 len: 1799 microversion: 2.42 time: 0.626182 Oct 04 18:55:19.553822 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2549/4809] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:55:18 2022] GET /compute/v2.1/servers/02a066b4-243b-4fe3-afcf-30f3e9511d1b => generated 1799 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:55:19.565748 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-2c91d03c-792f-45c3-a058-ee5c9fc140b5 tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:19.567832 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-2c91d03c-792f-45c3-a058-ee5c9fc140b5 tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] [instance: e20fa332-f87b-47b3-a30c-52716e5e7a45] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:19.586564 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2c91d03c-792f-45c3-a058-ee5c9fc140b5 tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:19.587107 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2c91d03c-792f-45c3-a058-ee5c9fc140b5 tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:19.590428 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2c91d03c-792f-45c3-a058-ee5c9fc140b5 tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:19.591226 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2c91d03c-792f-45c3-a058-ee5c9fc140b5 tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:19.591704 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2c91d03c-792f-45c3-a058-ee5c9fc140b5 tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:19.598636 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2c91d03c-792f-45c3-a058-ee5c9fc140b5 tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:19.845011 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-2c91d03c-792f-45c3-a058-ee5c9fc140b5 tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16d1e957e30423e9b06c6150e5c4a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74c55e15cfd4f2c9ce67c9aa91c1b5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:19.860794 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-2c91d03c-792f-45c3-a058-ee5c9fc140b5 tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] 10.222.0.43 "GET /compute/v2.1/servers/e20fa332-f87b-47b3-a30c-52716e5e7a45" status: 200 len: 1326 microversion: 2.1 time: 0.301150 Oct 04 18:55:19.864747 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2550/4810] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:19 2022] GET /compute/v2.1/servers/e20fa332-f87b-47b3-a30c-52716e5e7a45 => generated 1326 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:55:19.951015 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-d33a12bc-cf30-49e9-b438-a027130b0724 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f63f1ac147543dab34a28a22eb5936c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1607b30b9f324abaa88aa29e04ef3ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:19.969791 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-d33a12bc-cf30-49e9-b438-a027130b0724 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40" status: 200 len: 1505 microversion: 2.1 time: 1.166146 Oct 04 18:55:19.987720 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2261/4811] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:18 2022] GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40 => generated 1505 bytes in 1188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:55:20.001703 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-d0164b25-8cf8-4fd6-85ec-9c72f2640b49 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:20.003508 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-d0164b25-8cf8-4fd6-85ec-9c72f2640b49 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 01e250ab-d9aa-4708-ae36-10c53a411a40] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:20.025719 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d0164b25-8cf8-4fd6-85ec-9c72f2640b49 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:20.029072 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d0164b25-8cf8-4fd6-85ec-9c72f2640b49 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:20.030373 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d0164b25-8cf8-4fd6-85ec-9c72f2640b49 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:20.033815 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d0164b25-8cf8-4fd6-85ec-9c72f2640b49 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:20.037865 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d0164b25-8cf8-4fd6-85ec-9c72f2640b49 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:20.043458 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d0164b25-8cf8-4fd6-85ec-9c72f2640b49 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:20.550012 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-d0164b25-8cf8-4fd6-85ec-9c72f2640b49 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f63f1ac147543dab34a28a22eb5936c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1607b30b9f324abaa88aa29e04ef3ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:20.561917 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-d0164b25-8cf8-4fd6-85ec-9c72f2640b49 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40" status: 200 len: 1505 microversion: 2.1 time: 0.564850 Oct 04 18:55:20.567114 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2551/4812] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:19 2022] GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40 => generated 1505 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:55:20.588628 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-29a38a1c-5e92-495e-be9d-8fd86779cac8 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:20.589586 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-29a38a1c-5e92-495e-be9d-8fd86779cac8 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] [instance: 02a066b4-243b-4fe3-afcf-30f3e9511d1b] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:20.614358 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-29a38a1c-5e92-495e-be9d-8fd86779cac8 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:20.624346 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-bdff1f82-a376-42a0-a362-ba976b797773 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:55:20.626847 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-29a38a1c-5e92-495e-be9d-8fd86779cac8 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:20.627144 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-bdff1f82-a376-42a0-a362-ba976b797773 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 01e250ab-d9aa-4708-ae36-10c53a411a40] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:20.632172 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-29a38a1c-5e92-495e-be9d-8fd86779cac8 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:20.635341 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-29a38a1c-5e92-495e-be9d-8fd86779cac8 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:20.638584 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-29a38a1c-5e92-495e-be9d-8fd86779cac8 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:20.642131 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-29a38a1c-5e92-495e-be9d-8fd86779cac8 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:20.661998 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bdff1f82-a376-42a0-a362-ba976b797773 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:20.667867 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bdff1f82-a376-42a0-a362-ba976b797773 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:20.668372 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bdff1f82-a376-42a0-a362-ba976b797773 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:20.677872 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bdff1f82-a376-42a0-a362-ba976b797773 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:20.678385 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bdff1f82-a376-42a0-a362-ba976b797773 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:20.678842 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bdff1f82-a376-42a0-a362-ba976b797773 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:20.895091 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-bdff1f82-a376-42a0-a362-ba976b797773 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "POST /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40/action" status: 202 len: 0 microversion: 2.1 time: 0.273859 Oct 04 18:55:20.898920 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2552/4813] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 18:55:20 2022] POST /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40/action => generated 0 bytes in 277 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:55:20.911735 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-b750f4bf-a805-4de8-850c-04f554b05f66 tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:20.915554 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-b750f4bf-a805-4de8-850c-04f554b05f66 tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] [instance: e20fa332-f87b-47b3-a30c-52716e5e7a45] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:20.937440 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b750f4bf-a805-4de8-850c-04f554b05f66 tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:20.938218 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b750f4bf-a805-4de8-850c-04f554b05f66 tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:20.940948 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b750f4bf-a805-4de8-850c-04f554b05f66 tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:20.941937 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b750f4bf-a805-4de8-850c-04f554b05f66 tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:20.942599 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b750f4bf-a805-4de8-850c-04f554b05f66 tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:20.946403 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b750f4bf-a805-4de8-850c-04f554b05f66 tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:21.387559 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-b750f4bf-a805-4de8-850c-04f554b05f66 tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16d1e957e30423e9b06c6150e5c4a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74c55e15cfd4f2c9ce67c9aa91c1b5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:21.406283 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-b750f4bf-a805-4de8-850c-04f554b05f66 tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] 10.222.0.43 "GET /compute/v2.1/servers/e20fa332-f87b-47b3-a30c-52716e5e7a45" status: 200 len: 1326 microversion: 2.1 time: 0.501372 Oct 04 18:55:21.409334 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2553/4814] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:20 2022] GET /compute/v2.1/servers/e20fa332-f87b-47b3-a30c-52716e5e7a45 => generated 1326 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:55:21.444539 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-fbfd5823-9498-49b5-bfb5-ca97f429ede1 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:21.446335 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-fbfd5823-9498-49b5-bfb5-ca97f429ede1 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 01e250ab-d9aa-4708-ae36-10c53a411a40] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:21.474187 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fbfd5823-9498-49b5-bfb5-ca97f429ede1 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:21.474930 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fbfd5823-9498-49b5-bfb5-ca97f429ede1 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:21.481534 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fbfd5823-9498-49b5-bfb5-ca97f429ede1 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:21.482545 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fbfd5823-9498-49b5-bfb5-ca97f429ede1 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:21.482668 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fbfd5823-9498-49b5-bfb5-ca97f429ede1 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:21.483094 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fbfd5823-9498-49b5-bfb5-ca97f429ede1 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:21.583151 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-29a38a1c-5e92-495e-be9d-8fd86779cac8 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:21.603451 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-29a38a1c-5e92-495e-be9d-8fd86779cac8 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:21.608935 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-29a38a1c-5e92-495e-be9d-8fd86779cac8 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:21.613779 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-29a38a1c-5e92-495e-be9d-8fd86779cac8 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] 10.222.0.43 "GET /compute/v2.1/servers/02a066b4-243b-4fe3-afcf-30f3e9511d1b" status: 200 len: 1799 microversion: 2.42 time: 1.028262 Oct 04 18:55:21.616102 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2262/4815] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:55:20 2022] GET /compute/v2.1/servers/02a066b4-243b-4fe3-afcf-30f3e9511d1b => generated 1799 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:55:22.440702 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-6c31a2f9-1f35-4ae1-af41-30eac86a84cf tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:22.441912 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-6c31a2f9-1f35-4ae1-af41-30eac86a84cf tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] [instance: e20fa332-f87b-47b3-a30c-52716e5e7a45] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:22.456694 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6c31a2f9-1f35-4ae1-af41-30eac86a84cf tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:22.459394 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6c31a2f9-1f35-4ae1-af41-30eac86a84cf tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:22.462002 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6c31a2f9-1f35-4ae1-af41-30eac86a84cf tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:22.464918 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6c31a2f9-1f35-4ae1-af41-30eac86a84cf tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:22.465827 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6c31a2f9-1f35-4ae1-af41-30eac86a84cf tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:22.471535 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6c31a2f9-1f35-4ae1-af41-30eac86a84cf tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:22.519540 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=100 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:55:22.673817 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-fbfd5823-9498-49b5-bfb5-ca97f429ede1 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f63f1ac147543dab34a28a22eb5936c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1607b30b9f324abaa88aa29e04ef3ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:22.692904 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-fbfd5823-9498-49b5-bfb5-ca97f429ede1 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40" status: 200 len: 1490 microversion: 2.1 time: 1.278412 Oct 04 18:55:22.695403 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2554/4816] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:21 2022] GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40 => generated 1490 bytes in 1285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:55:22.714110 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-6a4b2175-b1aa-4d3c-bfff-11de31d2828a tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:22.722193 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-6a4b2175-b1aa-4d3c-bfff-11de31d2828a tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] [instance: 02a066b4-243b-4fe3-afcf-30f3e9511d1b] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:22.741022 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6a4b2175-b1aa-4d3c-bfff-11de31d2828a tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:22.741968 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6a4b2175-b1aa-4d3c-bfff-11de31d2828a tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:22.742941 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6a4b2175-b1aa-4d3c-bfff-11de31d2828a tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:22.744600 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6a4b2175-b1aa-4d3c-bfff-11de31d2828a tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:22.747317 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6a4b2175-b1aa-4d3c-bfff-11de31d2828a tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:22.748027 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6a4b2175-b1aa-4d3c-bfff-11de31d2828a tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:23.308325 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-6c31a2f9-1f35-4ae1-af41-30eac86a84cf tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16d1e957e30423e9b06c6150e5c4a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74c55e15cfd4f2c9ce67c9aa91c1b5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:23.318345 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-6c31a2f9-1f35-4ae1-af41-30eac86a84cf tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] 10.222.0.43 "GET /compute/v2.1/servers/e20fa332-f87b-47b3-a30c-52716e5e7a45" status: 200 len: 1326 microversion: 2.1 time: 0.883227 Oct 04 18:55:23.325895 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2263/4817] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:22 2022] GET /compute/v2.1/servers/e20fa332-f87b-47b3-a30c-52716e5e7a45 => generated 1326 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:55:23.342486 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-be763b71-7618-434f-b986-392f5211354f tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:55:23.343878 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-be763b71-7618-434f-b986-392f5211354f tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 01e250ab-d9aa-4708-ae36-10c53a411a40] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:23.345830 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=1 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:55:23.374351 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-be763b71-7618-434f-b986-392f5211354f tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:23.374894 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-be763b71-7618-434f-b986-392f5211354f tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:23.375609 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-be763b71-7618-434f-b986-392f5211354f tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:23.376341 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-be763b71-7618-434f-b986-392f5211354f tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:23.376802 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-be763b71-7618-434f-b986-392f5211354f tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:23.377268 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-be763b71-7618-434f-b986-392f5211354f tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:23.426800 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-be763b71-7618-434f-b986-392f5211354f tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] HTTP exception thrown: Cannot 'pause' instance 01e250ab-d9aa-4708-ae36-10c53a411a40 while it is in vm_state paused Oct 04 18:55:23.428598 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-be763b71-7618-434f-b986-392f5211354f tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Request method failure captured: Oct 04 18:55:23.428598 n-d-851028-13 devstack@n-api.service[123595]: request: POST /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40/action HTTP/1.1 Oct 04 18:55:23.428598 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 18:55:23.428598 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 18:55:23.428598 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 18:55:23.428598 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 13 Oct 04 18:55:23.428598 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 18:55:23.428598 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 18:55:23.428598 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 18:55:23.428598 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 18:55:23.428598 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPIEZsAoFcr6P1AMHBWUo8LvryOn1l2-LYSKr4xgLCvHblWFuAiGVlStWcljkgzOc7-ldx7qv3C-2jYmQ32_Zk5yP28dI64Re9CsyHCLmsYfyJdD0-2_kU92lHK36Fs8oXqXU2FijNX-X4IYqe4GjOQDN7LB9zCeEIcrxQ2LRJFOwbQY Oct 04 18:55:23.428598 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 18:55:23.428598 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 18:55:23.428598 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 18:55:23.428598 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 18:55:23.428598 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 18:55:23.428598 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 18:55:23.428598 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: 1607b30b9f324abaa88aa29e04ef3ec4 Oct 04 18:55:23.428598 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-ServersNegativeTestJSON-708693932 Oct 04 18:55:23.428598 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 18:55:23.428598 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 18:55:23.428598 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/1607b30b9f324abaa88aa29e04ef3ec4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_1607b30b9f324abaa88aa29e04ef3ec4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1607b30b9f324abaa88aa29e04ef3ec4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1607b30b9f324abaa88aa29e04ef3ec4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:55:23.428598 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-ServersNegativeTestJSON-708693932 Oct 04 18:55:23.428598 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: 1607b30b9f324abaa88aa29e04ef3ec4 Oct 04 18:55:23.428598 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-ServersNegativeTestJSON-708693932 Oct 04 18:55:23.428598 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-ServersNegativeTestJSON-708693932-project Oct 04 18:55:23.428598 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 18:55:23.428598 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 18:55:23.428598 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: 6f63f1ac147543dab34a28a22eb5936c Oct 04 18:55:23.428598 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-ServersNegativeTestJSON-708693932-project Oct 04 18:55:23.428598 n-d-851028-13 devstack@n-api.service[123595]: Oct 04 18:55:23.428598 n-d-851028-13 devstack@n-api.service[123595]: {"pause": {}} Oct 04 18:55:23.428598 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 18:55:23.428598 n-d-851028-13 devstack@n-api.service[123595]: exception: Cannot 'pause' instance 01e250ab-d9aa-4708-ae36-10c53a411a40 while it is in vm_state paused Oct 04 18:55:23.428598 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': '01e250ab-d9aa-4708-ae36-10c53a411a40', 'body': {'pause': {}}} Oct 04 18:55:23.428598 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:55:23.428598 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:55:23.428598 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 41, in _pause Oct 04 18:55:23.428598 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi self.compute_api.pause(ctxt, server) Oct 04 18:55:23.428598 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 18:55:23.428598 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 18:55:23.428598 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 04 18:55:23.428598 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 04 18:55:23.428598 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 01e250ab-d9aa-4708-ae36-10c53a411a40 in vm_state paused. Cannot pause while the instance is in this state. Oct 04 18:55:23.428598 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:55:23.428598 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:55:23.428598 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:55:23.428598 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:55:23.428598 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:55:23.428598 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:55:23.428598 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:55:23.428598 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:55:23.428598 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:55:23.428598 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:55:23.428598 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 45, in _pause Oct 04 18:55:23.428598 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 04 18:55:23.428598 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 04 18:55:23.428598 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 04 18:55:23.428598 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'pause' instance 01e250ab-d9aa-4708-ae36-10c53a411a40 while it is in vm_state paused Oct 04 18:55:23.428598 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:55:23.428598 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:55:23.428598 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:55:23.428598 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:55:23.428598 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:55:23.433848 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:55:23.433848 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:55:23.433848 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:55:23.433848 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'pause' instance 01e250ab-d9aa-4708-ae36-10c53a411a40 while it is in vm_state paused Oct 04 18:55:23.433848 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:55:23.433848 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-be763b71-7618-434f-b986-392f5211354f tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Returning 409 to user: Cannot 'pause' instance 01e250ab-d9aa-4708-ae36-10c53a411a40 while it is in vm_state paused {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:55:23.433848 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-be763b71-7618-434f-b986-392f5211354f tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "POST /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40/action" status: 409 len: 143 microversion: 2.1 time: 0.102784 Oct 04 18:55:23.433848 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2264/4818] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 18:55:23 2022] POST /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40/action => generated 143 bytes in 104 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:55:23.444921 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-6950a02a-74e9-41a0-9ba9-65e231ab67f8 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:55:23.449587 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-6950a02a-74e9-41a0-9ba9-65e231ab67f8 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 01e250ab-d9aa-4708-ae36-10c53a411a40] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:23.472103 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6950a02a-74e9-41a0-9ba9-65e231ab67f8 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:23.472743 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6950a02a-74e9-41a0-9ba9-65e231ab67f8 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:23.473214 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6950a02a-74e9-41a0-9ba9-65e231ab67f8 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:23.473942 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6950a02a-74e9-41a0-9ba9-65e231ab67f8 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:23.474404 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6950a02a-74e9-41a0-9ba9-65e231ab67f8 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:23.474837 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6950a02a-74e9-41a0-9ba9-65e231ab67f8 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:23.515385 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-6a4b2175-b1aa-4d3c-bfff-11de31d2828a tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:23.526581 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-6a4b2175-b1aa-4d3c-bfff-11de31d2828a tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:23.535368 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-6a4b2175-b1aa-4d3c-bfff-11de31d2828a tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:23.538669 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-6a4b2175-b1aa-4d3c-bfff-11de31d2828a tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] 10.222.0.43 "GET /compute/v2.1/servers/02a066b4-243b-4fe3-afcf-30f3e9511d1b" status: 200 len: 1799 microversion: 2.42 time: 0.841055 Oct 04 18:55:23.553810 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2555/4819] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:55:22 2022] GET /compute/v2.1/servers/02a066b4-243b-4fe3-afcf-30f3e9511d1b => generated 1799 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:55:23.616771 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-6950a02a-74e9-41a0-9ba9-65e231ab67f8 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "POST /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40/action" status: 202 len: 0 microversion: 2.1 time: 0.166548 Oct 04 18:55:23.626395 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2265/4820] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 18:55:23 2022] POST /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40/action => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:55:23.637727 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-462ac2d3-77eb-460e-921a-ecd72b7c37bf tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:23.640098 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-462ac2d3-77eb-460e-921a-ecd72b7c37bf tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 01e250ab-d9aa-4708-ae36-10c53a411a40] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:23.657166 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-462ac2d3-77eb-460e-921a-ecd72b7c37bf tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:23.657911 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-462ac2d3-77eb-460e-921a-ecd72b7c37bf tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:23.658589 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-462ac2d3-77eb-460e-921a-ecd72b7c37bf tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:23.659513 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-462ac2d3-77eb-460e-921a-ecd72b7c37bf tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:23.660343 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-462ac2d3-77eb-460e-921a-ecd72b7c37bf tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:23.661051 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-462ac2d3-77eb-460e-921a-ecd72b7c37bf tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:24.353500 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-aa36b5d7-021a-47d8-a912-4598ebe642e7 tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:24.354875 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-aa36b5d7-021a-47d8-a912-4598ebe642e7 tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] [instance: e20fa332-f87b-47b3-a30c-52716e5e7a45] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:24.377081 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-aa36b5d7-021a-47d8-a912-4598ebe642e7 tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:24.378523 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-aa36b5d7-021a-47d8-a912-4598ebe642e7 tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:24.378523 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-aa36b5d7-021a-47d8-a912-4598ebe642e7 tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:24.378850 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-aa36b5d7-021a-47d8-a912-4598ebe642e7 tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:24.381930 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-aa36b5d7-021a-47d8-a912-4598ebe642e7 tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:24.382849 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-aa36b5d7-021a-47d8-a912-4598ebe642e7 tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:24.596619 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-462ac2d3-77eb-460e-921a-ecd72b7c37bf tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f63f1ac147543dab34a28a22eb5936c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1607b30b9f324abaa88aa29e04ef3ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:24.639712 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-462ac2d3-77eb-460e-921a-ecd72b7c37bf tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40" status: 200 len: 1497 microversion: 2.1 time: 1.010633 Oct 04 18:55:24.642268 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2556/4821] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:23 2022] GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40 => generated 1497 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:55:24.664897 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-58437968-81aa-48b8-ad91-21812620776a tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:24.670045 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-58437968-81aa-48b8-ad91-21812620776a tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] [instance: 02a066b4-243b-4fe3-afcf-30f3e9511d1b] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:24.699207 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-58437968-81aa-48b8-ad91-21812620776a tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:24.701663 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-58437968-81aa-48b8-ad91-21812620776a tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:24.703652 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-58437968-81aa-48b8-ad91-21812620776a tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:24.709343 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-58437968-81aa-48b8-ad91-21812620776a tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:24.712280 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-58437968-81aa-48b8-ad91-21812620776a tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:24.712891 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-58437968-81aa-48b8-ad91-21812620776a tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:25.120574 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-aa36b5d7-021a-47d8-a912-4598ebe642e7 tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16d1e957e30423e9b06c6150e5c4a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74c55e15cfd4f2c9ce67c9aa91c1b5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:25.144206 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-aa36b5d7-021a-47d8-a912-4598ebe642e7 tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] 10.222.0.43 "GET /compute/v2.1/servers/e20fa332-f87b-47b3-a30c-52716e5e7a45" status: 200 len: 1394 microversion: 2.1 time: 0.792719 Oct 04 18:55:25.146819 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2266/4822] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:24 2022] GET /compute/v2.1/servers/e20fa332-f87b-47b3-a30c-52716e5e7a45 => generated 1394 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:55:25.262883 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-58437968-81aa-48b8-ad91-21812620776a tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:25.276896 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-58437968-81aa-48b8-ad91-21812620776a tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:25.278773 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-58437968-81aa-48b8-ad91-21812620776a tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:25.281073 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-58437968-81aa-48b8-ad91-21812620776a tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] 10.222.0.43 "GET /compute/v2.1/servers/02a066b4-243b-4fe3-afcf-30f3e9511d1b" status: 200 len: 1845 microversion: 2.42 time: 0.636757 Oct 04 18:55:25.282416 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2557/4823] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:55:24 2022] GET /compute/v2.1/servers/02a066b4-243b-4fe3-afcf-30f3e9511d1b => generated 1845 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:55:25.667809 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-9032b3ce-0866-46bd-a65a-bad579beb182 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:25.668454 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-9032b3ce-0866-46bd-a65a-bad579beb182 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 01e250ab-d9aa-4708-ae36-10c53a411a40] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:25.679919 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9032b3ce-0866-46bd-a65a-bad579beb182 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:25.683749 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9032b3ce-0866-46bd-a65a-bad579beb182 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:25.684403 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9032b3ce-0866-46bd-a65a-bad579beb182 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:25.685460 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9032b3ce-0866-46bd-a65a-bad579beb182 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:25.688607 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9032b3ce-0866-46bd-a65a-bad579beb182 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:25.689499 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9032b3ce-0866-46bd-a65a-bad579beb182 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:26.172291 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-c6d6ead2-96a8-451b-954f-e87b98f22526 tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:26.174813 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-c6d6ead2-96a8-451b-954f-e87b98f22526 tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] [instance: e20fa332-f87b-47b3-a30c-52716e5e7a45] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:26.178955 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=2 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:55:26.182638 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=12 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:55:26.232546 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c6d6ead2-96a8-451b-954f-e87b98f22526 tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:26.236821 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c6d6ead2-96a8-451b-954f-e87b98f22526 tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:26.237635 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c6d6ead2-96a8-451b-954f-e87b98f22526 tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:26.244131 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c6d6ead2-96a8-451b-954f-e87b98f22526 tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:26.246025 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c6d6ead2-96a8-451b-954f-e87b98f22526 tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:26.250171 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c6d6ead2-96a8-451b-954f-e87b98f22526 tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:26.284150 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:55:26.481912 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-9032b3ce-0866-46bd-a65a-bad579beb182 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f63f1ac147543dab34a28a22eb5936c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1607b30b9f324abaa88aa29e04ef3ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:26.502028 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-9032b3ce-0866-46bd-a65a-bad579beb182 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40" status: 200 len: 1505 microversion: 2.1 time: 0.839854 Oct 04 18:55:26.508617 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2267/4824] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:25 2022] GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40 => generated 1505 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:55:26.538890 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-03e578d7-f6ea-4e78-a548-42052856f224 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:26.540443 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-03e578d7-f6ea-4e78-a548-42052856f224 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] [instance: 02a066b4-243b-4fe3-afcf-30f3e9511d1b] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:26.574990 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-03e578d7-f6ea-4e78-a548-42052856f224 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:26.579621 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-03e578d7-f6ea-4e78-a548-42052856f224 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:26.580807 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-03e578d7-f6ea-4e78-a548-42052856f224 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:26.585423 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-03e578d7-f6ea-4e78-a548-42052856f224 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:26.588341 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-03e578d7-f6ea-4e78-a548-42052856f224 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:26.589466 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-03e578d7-f6ea-4e78-a548-42052856f224 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:27.912637 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-c6d6ead2-96a8-451b-954f-e87b98f22526 tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16d1e957e30423e9b06c6150e5c4a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74c55e15cfd4f2c9ce67c9aa91c1b5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:27.923014 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-c6d6ead2-96a8-451b-954f-e87b98f22526 tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] 10.222.0.43 "GET /compute/v2.1/servers/e20fa332-f87b-47b3-a30c-52716e5e7a45" status: 200 len: 1394 microversion: 2.1 time: 1.756767 Oct 04 18:55:27.934919 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2558/4825] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:26 2022] GET /compute/v2.1/servers/e20fa332-f87b-47b3-a30c-52716e5e7a45 => generated 1394 bytes in 1770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:55:27.949161 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-007a5586-19d1-4d84-9faa-0e582d2d435f tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:27.950229 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-007a5586-19d1-4d84-9faa-0e582d2d435f tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 01e250ab-d9aa-4708-ae36-10c53a411a40] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:27.960724 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-007a5586-19d1-4d84-9faa-0e582d2d435f tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:27.966079 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-007a5586-19d1-4d84-9faa-0e582d2d435f tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:27.967499 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-007a5586-19d1-4d84-9faa-0e582d2d435f tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:27.973746 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-03e578d7-f6ea-4e78-a548-42052856f224 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:27.975185 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-007a5586-19d1-4d84-9faa-0e582d2d435f tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:27.976404 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-007a5586-19d1-4d84-9faa-0e582d2d435f tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:27.977269 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-007a5586-19d1-4d84-9faa-0e582d2d435f tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:27.990370 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-03e578d7-f6ea-4e78-a548-42052856f224 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:27.996478 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-03e578d7-f6ea-4e78-a548-42052856f224 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:27.997786 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-03e578d7-f6ea-4e78-a548-42052856f224 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] 10.222.0.43 "GET /compute/v2.1/servers/02a066b4-243b-4fe3-afcf-30f3e9511d1b" status: 200 len: 1845 microversion: 2.42 time: 1.487426 Oct 04 18:55:28.021572 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2268/4826] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:55:26 2022] GET /compute/v2.1/servers/02a066b4-243b-4fe3-afcf-30f3e9511d1b => generated 1845 bytes in 1512 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:55:28.028711 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-17293632-f236-4c4c-938e-1a496534b247 req-9c7ce164-2a90-45d4-a1a7-042019f26dcf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e20fa332-f87b-47b3-a30c-52716e5e7a45", "tag": "f6bf9217-ac91-415b-a39c-6ee42946133e"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:55:28.078467 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-17293632-f236-4c4c-938e-1a496534b247 req-9c7ce164-2a90-45d4-a1a7-042019f26dcf service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:28.078981 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-17293632-f236-4c4c-938e-1a496534b247 req-9c7ce164-2a90-45d4-a1a7-042019f26dcf service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:28.079436 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-17293632-f236-4c4c-938e-1a496534b247 req-9c7ce164-2a90-45d4-a1a7-042019f26dcf service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:28.155509 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-17293632-f236-4c4c-938e-1a496534b247 req-9c7ce164-2a90-45d4-a1a7-042019f26dcf service nova] Creating event network-changed:f6bf9217-ac91-415b-a39c-6ee42946133e for instance e20fa332-f87b-47b3-a30c-52716e5e7a45 on n-h1-851028-13 Oct 04 18:55:28.178360 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-17293632-f236-4c4c-938e-1a496534b247 req-9c7ce164-2a90-45d4-a1a7-042019f26dcf service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.152115 Oct 04 18:55:28.181059 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2269/4827] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:55:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:55:28.909756 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-007a5586-19d1-4d84-9faa-0e582d2d435f tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f63f1ac147543dab34a28a22eb5936c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1607b30b9f324abaa88aa29e04ef3ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:28.917753 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-007a5586-19d1-4d84-9faa-0e582d2d435f tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40" status: 200 len: 1505 microversion: 2.1 time: 0.976779 Oct 04 18:55:28.944192 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2559/4828] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:27 2022] GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40 => generated 1505 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:55:28.951316 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-640ccfde-4bb1-481f-931b-06a4b6d5f617 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:55:28.955692 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-640ccfde-4bb1-481f-931b-06a4b6d5f617 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 2a0f8968-daa5-4998-9e3e-4f94d6471b1f] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:28.964671 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-02781c9d-6a56-4ae5-9285-ef8b011f3bc5 tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:28.965069 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-640ccfde-4bb1-481f-931b-06a4b6d5f617 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:28.965862 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-640ccfde-4bb1-481f-931b-06a4b6d5f617 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:28.966780 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-640ccfde-4bb1-481f-931b-06a4b6d5f617 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:28.967098 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-02781c9d-6a56-4ae5-9285-ef8b011f3bc5 tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] [instance: e20fa332-f87b-47b3-a30c-52716e5e7a45] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:28.971034 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-640ccfde-4bb1-481f-931b-06a4b6d5f617 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:28.972165 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-640ccfde-4bb1-481f-931b-06a4b6d5f617 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:28.973500 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-640ccfde-4bb1-481f-931b-06a4b6d5f617 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:28.987239 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-02781c9d-6a56-4ae5-9285-ef8b011f3bc5 tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:28.993373 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-02781c9d-6a56-4ae5-9285-ef8b011f3bc5 tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:28.994113 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-02781c9d-6a56-4ae5-9285-ef8b011f3bc5 tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:28.995093 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-02781c9d-6a56-4ae5-9285-ef8b011f3bc5 tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:28.995726 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-02781c9d-6a56-4ae5-9285-ef8b011f3bc5 tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:28.996341 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-02781c9d-6a56-4ae5-9285-ef8b011f3bc5 tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:28.998601 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-640ccfde-4bb1-481f-931b-06a4b6d5f617 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] HTTP exception thrown: Instance 2a0f8968-daa5-4998-9e3e-4f94d6471b1f could not be found. Oct 04 18:55:29.001423 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-640ccfde-4bb1-481f-931b-06a4b6d5f617 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Request method failure captured: Oct 04 18:55:29.001423 n-d-851028-13 devstack@n-api.service[123595]: request: POST /compute/v2.1/servers/2a0f8968-daa5-4998-9e3e-4f94d6471b1f/action HTTP/1.1 Oct 04 18:55:29.001423 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 18:55:29.001423 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 18:55:29.001423 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 18:55:29.001423 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 28 Oct 04 18:55:29.001423 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 18:55:29.001423 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 18:55:29.001423 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 18:55:29.001423 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 18:55:29.001423 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPIEZsAoFcr6P1AMHBWUo8LvryOn1l2-LYSKr4xgLCvHblWFuAiGVlStWcljkgzOc7-ldx7qv3C-2jYmQ32_Zk5yP28dI64Re9CsyHCLmsYfyJdD0-2_kU92lHK36Fs8oXqXU2FijNX-X4IYqe4GjOQDN7LB9zCeEIcrxQ2LRJFOwbQY Oct 04 18:55:29.001423 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 18:55:29.001423 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 18:55:29.001423 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 18:55:29.001423 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 18:55:29.001423 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 18:55:29.001423 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 18:55:29.001423 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: 1607b30b9f324abaa88aa29e04ef3ec4 Oct 04 18:55:29.001423 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-ServersNegativeTestJSON-708693932 Oct 04 18:55:29.001423 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 18:55:29.001423 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 18:55:29.001423 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/1607b30b9f324abaa88aa29e04ef3ec4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_1607b30b9f324abaa88aa29e04ef3ec4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1607b30b9f324abaa88aa29e04ef3ec4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1607b30b9f324abaa88aa29e04ef3ec4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:55:29.001423 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-ServersNegativeTestJSON-708693932 Oct 04 18:55:29.001423 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: 1607b30b9f324abaa88aa29e04ef3ec4 Oct 04 18:55:29.001423 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-ServersNegativeTestJSON-708693932 Oct 04 18:55:29.001423 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-ServersNegativeTestJSON-708693932-project Oct 04 18:55:29.001423 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 18:55:29.001423 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 18:55:29.001423 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: 6f63f1ac147543dab34a28a22eb5936c Oct 04 18:55:29.001423 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-ServersNegativeTestJSON-708693932-project Oct 04 18:55:29.001423 n-d-851028-13 devstack@n-api.service[123595]: Oct 04 18:55:29.001423 n-d-851028-13 devstack@n-api.service[123595]: {"reboot": {"type": "SOFT"}} Oct 04 18:55:29.001423 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 18:55:29.001423 n-d-851028-13 devstack@n-api.service[123595]: exception: Instance 2a0f8968-daa5-4998-9e3e-4f94d6471b1f could not be found. Oct 04 18:55:29.001423 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': '2a0f8968-daa5-4998-9e3e-4f94d6471b1f', 'body': {'reboot': {'type': 'SOFT'}}} Oct 04 18:55:29.001423 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:55:29.001423 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:55:29.001423 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:55:29.001423 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:55:29.001423 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:55:29.001423 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:55:29.001423 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:55:29.001423 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:55:29.001423 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:55:29.001423 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:55:29.001423 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a0f8968-daa5-4998-9e3e-4f94d6471b1f could not be found. Oct 04 18:55:29.001423 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:55:29.001423 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:55:29.001423 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:55:29.001423 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:55:29.001423 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:55:29.001423 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:55:29.001423 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:55:29.001423 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:55:29.001423 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:55:29.001423 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:55:29.001423 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:55:29.001423 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:55:29.001423 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Oct 04 18:55:29.001423 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 04 18:55:29.001423 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:55:29.001423 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:55:29.001423 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:55:29.001423 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:55:29.010089 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a0f8968-daa5-4998-9e3e-4f94d6471b1f could not be found. Oct 04 18:55:29.010089 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:55:29.010089 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:55:29.010089 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:55:29.010089 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:55:29.010089 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:55:29.010089 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:55:29.010089 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:55:29.010089 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:55:29.010089 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a0f8968-daa5-4998-9e3e-4f94d6471b1f could not be found. Oct 04 18:55:29.010089 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:55:29.013957 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-640ccfde-4bb1-481f-931b-06a4b6d5f617 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Returning 404 to user: Instance 2a0f8968-daa5-4998-9e3e-4f94d6471b1f could not be found. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:55:29.018058 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-640ccfde-4bb1-481f-931b-06a4b6d5f617 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "POST /compute/v2.1/servers/2a0f8968-daa5-4998-9e3e-4f94d6471b1f/action" status: 404 len: 111 microversion: 2.1 time: 0.071088 Oct 04 18:55:29.019596 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2270/4829] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 18:55:28 2022] POST /compute/v2.1/servers/2a0f8968-daa5-4998-9e3e-4f94d6471b1f/action => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:55:29.028573 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-81998c38-8114-421c-85b6-13da41515bef tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:29.029667 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-81998c38-8114-421c-85b6-13da41515bef tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] [instance: 02a066b4-243b-4fe3-afcf-30f3e9511d1b] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:29.040186 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-81998c38-8114-421c-85b6-13da41515bef tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:29.041564 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-81998c38-8114-421c-85b6-13da41515bef tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:29.043750 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-81998c38-8114-421c-85b6-13da41515bef tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:29.045076 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-81998c38-8114-421c-85b6-13da41515bef tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:29.045898 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-81998c38-8114-421c-85b6-13da41515bef tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:29.046757 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-81998c38-8114-421c-85b6-13da41515bef tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:29.731341 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-02781c9d-6a56-4ae5-9285-ef8b011f3bc5 tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16d1e957e30423e9b06c6150e5c4a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74c55e15cfd4f2c9ce67c9aa91c1b5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:29.762033 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-02781c9d-6a56-4ae5-9285-ef8b011f3bc5 tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] 10.222.0.43 "GET /compute/v2.1/servers/e20fa332-f87b-47b3-a30c-52716e5e7a45" status: 200 len: 1394 microversion: 2.1 time: 0.801783 Oct 04 18:55:29.764028 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2560/4830] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:28 2022] GET /compute/v2.1/servers/e20fa332-f87b-47b3-a30c-52716e5e7a45 => generated 1394 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:55:29.795533 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-c13de0ce-60a9-4b7e-9244-4a9180ca8e4b tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:29.802209 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-c13de0ce-60a9-4b7e-9244-4a9180ca8e4b tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 01e250ab-d9aa-4708-ae36-10c53a411a40] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:29.823520 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c13de0ce-60a9-4b7e-9244-4a9180ca8e4b tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:29.826280 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c13de0ce-60a9-4b7e-9244-4a9180ca8e4b tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:29.826976 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c13de0ce-60a9-4b7e-9244-4a9180ca8e4b tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:29.832610 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c13de0ce-60a9-4b7e-9244-4a9180ca8e4b tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:29.834451 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c13de0ce-60a9-4b7e-9244-4a9180ca8e4b tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:29.836210 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c13de0ce-60a9-4b7e-9244-4a9180ca8e4b tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:29.939814 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-81998c38-8114-421c-85b6-13da41515bef tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:29.951139 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-81998c38-8114-421c-85b6-13da41515bef tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:29.956802 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-81998c38-8114-421c-85b6-13da41515bef tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:29.967855 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-81998c38-8114-421c-85b6-13da41515bef tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] 10.222.0.43 "GET /compute/v2.1/servers/02a066b4-243b-4fe3-afcf-30f3e9511d1b" status: 200 len: 1845 microversion: 2.42 time: 0.943526 Oct 04 18:55:29.969659 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2271/4831] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:55:29 2022] GET /compute/v2.1/servers/02a066b4-243b-4fe3-afcf-30f3e9511d1b => generated 1845 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:55:30.245040 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-c13de0ce-60a9-4b7e-9244-4a9180ca8e4b tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f63f1ac147543dab34a28a22eb5936c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1607b30b9f324abaa88aa29e04ef3ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:30.253848 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-c13de0ce-60a9-4b7e-9244-4a9180ca8e4b tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40" status: 200 len: 1505 microversion: 2.1 time: 0.471241 Oct 04 18:55:30.257781 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2561/4832] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:29 2022] GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40 => generated 1505 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:55:30.269387 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-9fd895f7-1d22-4068-9127-b77887d9cab3 req-82065fa6-8478-4bd3-a229-120868cc4376 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02a066b4-243b-4fe3-afcf-30f3e9511d1b", "tag": "928f2e8e-6be4-46f2-be79-95a832f7c34d"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:55:30.283284 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-cbfe79ec-f59e-4cc7-98ce-0096ce108b00 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:30.283909 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-cbfe79ec-f59e-4cc7-98ce-0096ce108b00 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 01e250ab-d9aa-4708-ae36-10c53a411a40] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:30.290514 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cbfe79ec-f59e-4cc7-98ce-0096ce108b00 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:30.291311 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cbfe79ec-f59e-4cc7-98ce-0096ce108b00 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:30.291929 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cbfe79ec-f59e-4cc7-98ce-0096ce108b00 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:30.292831 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cbfe79ec-f59e-4cc7-98ce-0096ce108b00 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:30.293680 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cbfe79ec-f59e-4cc7-98ce-0096ce108b00 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:30.294281 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cbfe79ec-f59e-4cc7-98ce-0096ce108b00 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:30.307853 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-9fd895f7-1d22-4068-9127-b77887d9cab3 req-82065fa6-8478-4bd3-a229-120868cc4376 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:30.309514 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-9fd895f7-1d22-4068-9127-b77887d9cab3 req-82065fa6-8478-4bd3-a229-120868cc4376 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:30.310011 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-9fd895f7-1d22-4068-9127-b77887d9cab3 req-82065fa6-8478-4bd3-a229-120868cc4376 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:30.347960 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-9fd895f7-1d22-4068-9127-b77887d9cab3 req-82065fa6-8478-4bd3-a229-120868cc4376 service nova] Creating event network-changed:928f2e8e-6be4-46f2-be79-95a832f7c34d for instance 02a066b4-243b-4fe3-afcf-30f3e9511d1b on n-h2-851028-13 Oct 04 18:55:30.362263 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-9fd895f7-1d22-4068-9127-b77887d9cab3 req-82065fa6-8478-4bd3-a229-120868cc4376 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093618 Oct 04 18:55:30.366357 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2272/4833] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:55:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:55:30.799846 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-fe2491d8-5c99-4f27-9865-975d940cbd55 tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:30.800871 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-fe2491d8-5c99-4f27-9865-975d940cbd55 tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] [instance: e20fa332-f87b-47b3-a30c-52716e5e7a45] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:30.817212 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fe2491d8-5c99-4f27-9865-975d940cbd55 tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:30.818566 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fe2491d8-5c99-4f27-9865-975d940cbd55 tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:30.820806 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fe2491d8-5c99-4f27-9865-975d940cbd55 tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:30.823227 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fe2491d8-5c99-4f27-9865-975d940cbd55 tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:30.825689 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fe2491d8-5c99-4f27-9865-975d940cbd55 tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:30.826362 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fe2491d8-5c99-4f27-9865-975d940cbd55 tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:31.092055 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-cbfe79ec-f59e-4cc7-98ce-0096ce108b00 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f63f1ac147543dab34a28a22eb5936c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1607b30b9f324abaa88aa29e04ef3ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:31.103924 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-cbfe79ec-f59e-4cc7-98ce-0096ce108b00 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40" status: 200 len: 1505 microversion: 2.1 time: 0.824688 Oct 04 18:55:31.105852 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2562/4834] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:30 2022] GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40 => generated 1505 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:55:31.114076 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-6f5caf60-da55-4305-adbc-81cafb2a7a9c tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:31.115873 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-6f5caf60-da55-4305-adbc-81cafb2a7a9c tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] [instance: 02a066b4-243b-4fe3-afcf-30f3e9511d1b] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:31.130722 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6f5caf60-da55-4305-adbc-81cafb2a7a9c tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:31.131521 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6f5caf60-da55-4305-adbc-81cafb2a7a9c tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:31.132883 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6f5caf60-da55-4305-adbc-81cafb2a7a9c tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:31.134437 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6f5caf60-da55-4305-adbc-81cafb2a7a9c tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:31.135069 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6f5caf60-da55-4305-adbc-81cafb2a7a9c tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:31.136140 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6f5caf60-da55-4305-adbc-81cafb2a7a9c tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:31.606096 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-6f5caf60-da55-4305-adbc-81cafb2a7a9c tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:31.617797 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-6f5caf60-da55-4305-adbc-81cafb2a7a9c tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:31.619836 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-6f5caf60-da55-4305-adbc-81cafb2a7a9c tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:31.621680 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-6f5caf60-da55-4305-adbc-81cafb2a7a9c tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] 10.222.0.43 "GET /compute/v2.1/servers/02a066b4-243b-4fe3-afcf-30f3e9511d1b" status: 200 len: 1866 microversion: 2.42 time: 0.514072 Oct 04 18:55:31.622656 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2563/4835] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:55:31 2022] GET /compute/v2.1/servers/02a066b4-243b-4fe3-afcf-30f3e9511d1b => generated 1866 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:55:31.627958 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-85118000-7a7d-41e8-bacf-6c5253f320f4 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:55:31.630931 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-85118000-7a7d-41e8-bacf-6c5253f320f4 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 604c77f0-ca30-47ae-bb5a-6bd350bcc119] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:31.643909 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-85118000-7a7d-41e8-bacf-6c5253f320f4 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] HTTP exception thrown: Instance 604c77f0-ca30-47ae-bb5a-6bd350bcc119 could not be found. Oct 04 18:55:31.647364 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-85118000-7a7d-41e8-bacf-6c5253f320f4 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Request method failure captured: Oct 04 18:55:31.647364 n-d-851028-13 devstack@n-api.service[123596]: request: POST /compute/v2.1/servers/604c77f0-ca30-47ae-bb5a-6bd350bcc119/action HTTP/1.1 Oct 04 18:55:31.647364 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:55:31.647364 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:55:31.647364 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:55:31.647364 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 28 Oct 04 18:55:31.647364 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:55:31.647364 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:55:31.647364 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:55:31.647364 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:55:31.647364 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPIEZsAoFcr6P1AMHBWUo8LvryOn1l2-LYSKr4xgLCvHblWFuAiGVlStWcljkgzOc7-ldx7qv3C-2jYmQ32_Zk5yP28dI64Re9CsyHCLmsYfyJdD0-2_kU92lHK36Fs8oXqXU2FijNX-X4IYqe4GjOQDN7LB9zCeEIcrxQ2LRJFOwbQY Oct 04 18:55:31.647364 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:55:31.647364 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:55:31.647364 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:55:31.647364 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:55:31.647364 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:55:31.647364 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:55:31.647364 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: 1607b30b9f324abaa88aa29e04ef3ec4 Oct 04 18:55:31.647364 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-ServersNegativeTestJSON-708693932 Oct 04 18:55:31.647364 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 18:55:31.647364 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 18:55:31.647364 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/1607b30b9f324abaa88aa29e04ef3ec4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_1607b30b9f324abaa88aa29e04ef3ec4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1607b30b9f324abaa88aa29e04ef3ec4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1607b30b9f324abaa88aa29e04ef3ec4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:55:31.647364 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-ServersNegativeTestJSON-708693932 Oct 04 18:55:31.647364 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: 1607b30b9f324abaa88aa29e04ef3ec4 Oct 04 18:55:31.647364 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-ServersNegativeTestJSON-708693932 Oct 04 18:55:31.647364 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-ServersNegativeTestJSON-708693932-project Oct 04 18:55:31.647364 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:55:31.647364 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:55:31.647364 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 6f63f1ac147543dab34a28a22eb5936c Oct 04 18:55:31.647364 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-ServersNegativeTestJSON-708693932-project Oct 04 18:55:31.647364 n-d-851028-13 devstack@n-api.service[123596]: Oct 04 18:55:31.647364 n-d-851028-13 devstack@n-api.service[123596]: {"reboot": {"type": "SOFT"}} Oct 04 18:55:31.647364 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 18:55:31.647364 n-d-851028-13 devstack@n-api.service[123596]: exception: Instance 604c77f0-ca30-47ae-bb5a-6bd350bcc119 could not be found. Oct 04 18:55:31.647364 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': '604c77f0-ca30-47ae-bb5a-6bd350bcc119', 'body': {'reboot': {'type': 'SOFT'}}} Oct 04 18:55:31.647364 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:55:31.647364 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:55:31.647364 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:55:31.647364 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:55:31.647364 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:55:31.647364 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:55:31.647364 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 18:55:31.647364 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 18:55:31.647364 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 604c77f0-ca30-47ae-bb5a-6bd350bcc119 could not be found. Oct 04 18:55:31.647364 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:55:31.647364 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:55:31.647364 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:55:31.647364 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:55:31.647364 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:55:31.647364 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:55:31.647364 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:55:31.647364 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:55:31.647364 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:55:31.647364 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:55:31.647364 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:55:31.647364 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:55:31.647364 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Oct 04 18:55:31.647364 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 04 18:55:31.647364 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:55:31.647364 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:55:31.647364 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:55:31.647364 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:55:31.647364 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 604c77f0-ca30-47ae-bb5a-6bd350bcc119 could not be found. Oct 04 18:55:31.647364 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:55:31.652464 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:55:31.652464 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:55:31.652464 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:55:31.652464 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:55:31.652464 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:55:31.652464 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:55:31.652464 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:55:31.652464 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 604c77f0-ca30-47ae-bb5a-6bd350bcc119 could not be found. Oct 04 18:55:31.652464 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:55:31.655049 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-85118000-7a7d-41e8-bacf-6c5253f320f4 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Returning 404 to user: Instance 604c77f0-ca30-47ae-bb5a-6bd350bcc119 could not be found. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:55:31.656730 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-85118000-7a7d-41e8-bacf-6c5253f320f4 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "POST /compute/v2.1/servers/604c77f0-ca30-47ae-bb5a-6bd350bcc119/action" status: 404 len: 111 microversion: 2.1 time: 0.032366 Oct 04 18:55:31.657926 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2564/4836] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 18:55:31 2022] POST /compute/v2.1/servers/604c77f0-ca30-47ae-bb5a-6bd350bcc119/action => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:55:31.667406 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-39624363-10a0-4c80-8441-583345de29e5 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:31.668878 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-39624363-10a0-4c80-8441-583345de29e5 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 01e250ab-d9aa-4708-ae36-10c53a411a40] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:31.682452 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-39624363-10a0-4c80-8441-583345de29e5 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:31.683552 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-39624363-10a0-4c80-8441-583345de29e5 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:31.684210 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-39624363-10a0-4c80-8441-583345de29e5 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:31.685331 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-39624363-10a0-4c80-8441-583345de29e5 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:31.686001 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-39624363-10a0-4c80-8441-583345de29e5 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:31.686901 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-39624363-10a0-4c80-8441-583345de29e5 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:31.800452 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-fe2491d8-5c99-4f27-9865-975d940cbd55 tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16d1e957e30423e9b06c6150e5c4a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74c55e15cfd4f2c9ce67c9aa91c1b5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:31.811761 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-fe2491d8-5c99-4f27-9865-975d940cbd55 tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] 10.222.0.43 "GET /compute/v2.1/servers/e20fa332-f87b-47b3-a30c-52716e5e7a45" status: 200 len: 1394 microversion: 2.1 time: 1.023187 Oct 04 18:55:31.813584 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2273/4837] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:30 2022] GET /compute/v2.1/servers/e20fa332-f87b-47b3-a30c-52716e5e7a45 => generated 1394 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:55:32.333601 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-39624363-10a0-4c80-8441-583345de29e5 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f63f1ac147543dab34a28a22eb5936c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1607b30b9f324abaa88aa29e04ef3ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:32.344032 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-39624363-10a0-4c80-8441-583345de29e5 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40" status: 200 len: 1505 microversion: 2.1 time: 0.681330 Oct 04 18:55:32.345529 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2565/4838] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:31 2022] GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40 => generated 1505 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:55:32.376125 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-d655803a-e821-4e7c-9032-82d64015f4a9 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:32.376944 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-d655803a-e821-4e7c-9032-82d64015f4a9 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 01e250ab-d9aa-4708-ae36-10c53a411a40] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:32.383895 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d655803a-e821-4e7c-9032-82d64015f4a9 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:32.384863 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d655803a-e821-4e7c-9032-82d64015f4a9 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:32.385589 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d655803a-e821-4e7c-9032-82d64015f4a9 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:32.386576 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d655803a-e821-4e7c-9032-82d64015f4a9 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:32.387274 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d655803a-e821-4e7c-9032-82d64015f4a9 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:32.387956 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d655803a-e821-4e7c-9032-82d64015f4a9 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:32.652658 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-66e94595-c9e7-4124-93e4-738613fabe0a tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:32.653394 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-66e94595-c9e7-4124-93e4-738613fabe0a tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] [instance: 02a066b4-243b-4fe3-afcf-30f3e9511d1b] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:32.673402 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-66e94595-c9e7-4124-93e4-738613fabe0a tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:32.675536 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-66e94595-c9e7-4124-93e4-738613fabe0a tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:32.678639 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-66e94595-c9e7-4124-93e4-738613fabe0a tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:32.679583 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-66e94595-c9e7-4124-93e4-738613fabe0a tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:32.681532 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-66e94595-c9e7-4124-93e4-738613fabe0a tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:32.683526 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-66e94595-c9e7-4124-93e4-738613fabe0a tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:32.920269 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-d655803a-e821-4e7c-9032-82d64015f4a9 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f63f1ac147543dab34a28a22eb5936c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1607b30b9f324abaa88aa29e04ef3ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:32.942575 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-d655803a-e821-4e7c-9032-82d64015f4a9 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40" status: 200 len: 1505 microversion: 2.1 time: 0.572140 Oct 04 18:55:32.943610 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2274/4839] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:32 2022] GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40 => generated 1505 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:55:32.956516 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-a1937997-549a-4254-ba41-c04cef05b7db tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:32.958498 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-a1937997-549a-4254-ba41-c04cef05b7db tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] [instance: e20fa332-f87b-47b3-a30c-52716e5e7a45] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:32.976785 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a1937997-549a-4254-ba41-c04cef05b7db tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:32.977326 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a1937997-549a-4254-ba41-c04cef05b7db tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:32.977783 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a1937997-549a-4254-ba41-c04cef05b7db tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:32.978472 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a1937997-549a-4254-ba41-c04cef05b7db tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:32.983910 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a1937997-549a-4254-ba41-c04cef05b7db tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:32.984668 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a1937997-549a-4254-ba41-c04cef05b7db tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:33.253291 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-66e94595-c9e7-4124-93e4-738613fabe0a tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:33.263193 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-66e94595-c9e7-4124-93e4-738613fabe0a tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:33.265942 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-66e94595-c9e7-4124-93e4-738613fabe0a tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:33.267355 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-66e94595-c9e7-4124-93e4-738613fabe0a tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] 10.222.0.43 "GET /compute/v2.1/servers/02a066b4-243b-4fe3-afcf-30f3e9511d1b" status: 200 len: 1854 microversion: 2.42 time: 0.621998 Oct 04 18:55:33.268466 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2566/4840] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:55:32 2022] GET /compute/v2.1/servers/02a066b4-243b-4fe3-afcf-30f3e9511d1b => generated 1854 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:55:33.273728 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-126cfd55-0c51-4e0d-bf94-03c13d7a2086 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243"}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:55:33.277200 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-126cfd55-0c51-4e0d-bf94-03c13d7a2086 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 2a0f8968-daa5-4998-9e3e-4f94d6471b1f] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:33.285407 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-126cfd55-0c51-4e0d-bf94-03c13d7a2086 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:33.286192 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-126cfd55-0c51-4e0d-bf94-03c13d7a2086 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:33.287271 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-126cfd55-0c51-4e0d-bf94-03c13d7a2086 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:33.288176 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-126cfd55-0c51-4e0d-bf94-03c13d7a2086 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:33.288814 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-126cfd55-0c51-4e0d-bf94-03c13d7a2086 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:33.289448 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-126cfd55-0c51-4e0d-bf94-03c13d7a2086 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:33.306200 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-126cfd55-0c51-4e0d-bf94-03c13d7a2086 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] HTTP exception thrown: Instance 2a0f8968-daa5-4998-9e3e-4f94d6471b1f could not be found. Oct 04 18:55:33.308381 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-126cfd55-0c51-4e0d-bf94-03c13d7a2086 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Request method failure captured: Oct 04 18:55:33.308381 n-d-851028-13 devstack@n-api.service[123596]: request: POST /compute/v2.1/servers/2a0f8968-daa5-4998-9e3e-4f94d6471b1f/action HTTP/1.1 Oct 04 18:55:33.308381 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:55:33.308381 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:55:33.308381 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:55:33.308381 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 65 Oct 04 18:55:33.308381 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:55:33.308381 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:55:33.308381 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:55:33.308381 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:55:33.308381 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPIEZsAoFcr6P1AMHBWUo8LvryOn1l2-LYSKr4xgLCvHblWFuAiGVlStWcljkgzOc7-ldx7qv3C-2jYmQ32_Zk5yP28dI64Re9CsyHCLmsYfyJdD0-2_kU92lHK36Fs8oXqXU2FijNX-X4IYqe4GjOQDN7LB9zCeEIcrxQ2LRJFOwbQY Oct 04 18:55:33.308381 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:55:33.308381 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:55:33.308381 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:55:33.308381 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:55:33.308381 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:55:33.308381 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:55:33.308381 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: 1607b30b9f324abaa88aa29e04ef3ec4 Oct 04 18:55:33.308381 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-ServersNegativeTestJSON-708693932 Oct 04 18:55:33.308381 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 18:55:33.308381 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 18:55:33.308381 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/1607b30b9f324abaa88aa29e04ef3ec4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_1607b30b9f324abaa88aa29e04ef3ec4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1607b30b9f324abaa88aa29e04ef3ec4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1607b30b9f324abaa88aa29e04ef3ec4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:55:33.308381 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-ServersNegativeTestJSON-708693932 Oct 04 18:55:33.308381 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: 1607b30b9f324abaa88aa29e04ef3ec4 Oct 04 18:55:33.308381 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-ServersNegativeTestJSON-708693932 Oct 04 18:55:33.308381 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-ServersNegativeTestJSON-708693932-project Oct 04 18:55:33.308381 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:55:33.308381 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:55:33.308381 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 6f63f1ac147543dab34a28a22eb5936c Oct 04 18:55:33.308381 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-ServersNegativeTestJSON-708693932-project Oct 04 18:55:33.308381 n-d-851028-13 devstack@n-api.service[123596]: Oct 04 18:55:33.308381 n-d-851028-13 devstack@n-api.service[123596]: {"rebuild": {"imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243"}} Oct 04 18:55:33.308381 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 18:55:33.308381 n-d-851028-13 devstack@n-api.service[123596]: exception: Instance 2a0f8968-daa5-4998-9e3e-4f94d6471b1f could not be found. Oct 04 18:55:33.308381 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': '2a0f8968-daa5-4998-9e3e-4f94d6471b1f', 'body': {'rebuild': {'imageRef': 'e8943ec5-4038-4d4b-b9b9-2415a79f5243'}}} Oct 04 18:55:33.308381 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:55:33.308381 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:55:33.308381 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:55:33.308381 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:55:33.308381 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:55:33.308381 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:55:33.308381 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:55:33.308381 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:55:33.308381 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:55:33.308381 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:55:33.308381 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a0f8968-daa5-4998-9e3e-4f94d6471b1f could not be found. Oct 04 18:55:33.308381 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:55:33.308381 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:55:33.308381 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:55:33.308381 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:55:33.308381 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:55:33.308381 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:55:33.308381 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:55:33.308381 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:55:33.308381 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:55:33.308381 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:55:33.308381 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:55:33.308381 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:55:33.308381 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:55:33.308381 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:55:33.308381 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:55:33.308381 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:55:33.308381 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 04 18:55:33.308381 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Oct 04 18:55:33.312947 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 04 18:55:33.312947 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:55:33.312947 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:55:33.312947 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:55:33.312947 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:55:33.312947 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a0f8968-daa5-4998-9e3e-4f94d6471b1f could not be found. Oct 04 18:55:33.312947 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:55:33.312947 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:55:33.312947 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:55:33.312947 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:55:33.312947 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:55:33.312947 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:55:33.312947 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:55:33.312947 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:55:33.312947 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a0f8968-daa5-4998-9e3e-4f94d6471b1f could not be found. Oct 04 18:55:33.312947 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:55:33.316178 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-126cfd55-0c51-4e0d-bf94-03c13d7a2086 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Returning 404 to user: Instance 2a0f8968-daa5-4998-9e3e-4f94d6471b1f could not be found. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:55:33.317334 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-126cfd55-0c51-4e0d-bf94-03c13d7a2086 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "POST /compute/v2.1/servers/2a0f8968-daa5-4998-9e3e-4f94d6471b1f/action" status: 404 len: 111 microversion: 2.1 time: 0.047610 Oct 04 18:55:33.318158 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2567/4841] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 18:55:33 2022] POST /compute/v2.1/servers/2a0f8968-daa5-4998-9e3e-4f94d6471b1f/action => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:55:33.323663 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-98eadd04-6841-417d-8782-d8e0436526f0 req-3cb26c33-086b-4023-9201-94250dc99be7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02a066b4-243b-4fe3-afcf-30f3e9511d1b", "tag": "b55a672a-c052-4f13-8fbc-232381ea2bbb"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:55:33.336303 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-98eadd04-6841-417d-8782-d8e0436526f0 req-3cb26c33-086b-4023-9201-94250dc99be7 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:33.337220 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-98eadd04-6841-417d-8782-d8e0436526f0 req-3cb26c33-086b-4023-9201-94250dc99be7 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:33.337901 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-98eadd04-6841-417d-8782-d8e0436526f0 req-3cb26c33-086b-4023-9201-94250dc99be7 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:33.352263 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-98eadd04-6841-417d-8782-d8e0436526f0 req-3cb26c33-086b-4023-9201-94250dc99be7 service nova] Creating event network-changed:b55a672a-c052-4f13-8fbc-232381ea2bbb for instance 02a066b4-243b-4fe3-afcf-30f3e9511d1b on n-h2-851028-13 Oct 04 18:55:33.358237 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-98eadd04-6841-417d-8782-d8e0436526f0 req-3cb26c33-086b-4023-9201-94250dc99be7 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038502 Oct 04 18:55:33.359239 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2568/4842] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:55:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:55:33.365708 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-43a4a92b-db3b-4120-b83a-3b65c40dda38 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:33.366663 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-43a4a92b-db3b-4120-b83a-3b65c40dda38 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 01e250ab-d9aa-4708-ae36-10c53a411a40] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:33.374143 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-43a4a92b-db3b-4120-b83a-3b65c40dda38 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:33.375043 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-43a4a92b-db3b-4120-b83a-3b65c40dda38 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:33.375710 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-43a4a92b-db3b-4120-b83a-3b65c40dda38 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:33.377245 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-43a4a92b-db3b-4120-b83a-3b65c40dda38 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:33.377932 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-43a4a92b-db3b-4120-b83a-3b65c40dda38 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:33.378606 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-43a4a92b-db3b-4120-b83a-3b65c40dda38 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:33.600684 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-a1937997-549a-4254-ba41-c04cef05b7db tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16d1e957e30423e9b06c6150e5c4a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74c55e15cfd4f2c9ce67c9aa91c1b5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:33.612830 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-a1937997-549a-4254-ba41-c04cef05b7db tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] 10.222.0.43 "GET /compute/v2.1/servers/e20fa332-f87b-47b3-a30c-52716e5e7a45" status: 200 len: 1394 microversion: 2.1 time: 0.665286 Oct 04 18:55:33.614050 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2275/4843] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:32 2022] GET /compute/v2.1/servers/e20fa332-f87b-47b3-a30c-52716e5e7a45 => generated 1394 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:55:33.840523 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-43a4a92b-db3b-4120-b83a-3b65c40dda38 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f63f1ac147543dab34a28a22eb5936c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1607b30b9f324abaa88aa29e04ef3ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:33.857532 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-43a4a92b-db3b-4120-b83a-3b65c40dda38 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40" status: 200 len: 1505 microversion: 2.1 time: 0.496635 Oct 04 18:55:33.858562 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2569/4844] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:33 2022] GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40 => generated 1505 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:55:33.883982 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-48b51a36-080c-4ef8-b47a-d49b51db8c49 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:33.884879 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-48b51a36-080c-4ef8-b47a-d49b51db8c49 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 01e250ab-d9aa-4708-ae36-10c53a411a40] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:33.891831 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-48b51a36-080c-4ef8-b47a-d49b51db8c49 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:33.892590 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-48b51a36-080c-4ef8-b47a-d49b51db8c49 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:33.893265 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-48b51a36-080c-4ef8-b47a-d49b51db8c49 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:33.894377 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-48b51a36-080c-4ef8-b47a-d49b51db8c49 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:33.895517 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-48b51a36-080c-4ef8-b47a-d49b51db8c49 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:33.896116 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-48b51a36-080c-4ef8-b47a-d49b51db8c49 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:34.287742 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-413b79b0-e764-4f4f-a842-9915d5d0efde req-086073aa-84f1-443e-8af1-a99da3849ec9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e20fa332-f87b-47b3-a30c-52716e5e7a45", "name": "network-vif-plugged", "status": "completed", "tag": "f6bf9217-ac91-415b-a39c-6ee42946133e"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:55:34.313317 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-413b79b0-e764-4f4f-a842-9915d5d0efde req-086073aa-84f1-443e-8af1-a99da3849ec9 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:34.313856 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-413b79b0-e764-4f4f-a842-9915d5d0efde req-086073aa-84f1-443e-8af1-a99da3849ec9 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:34.314363 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-413b79b0-e764-4f4f-a842-9915d5d0efde req-086073aa-84f1-443e-8af1-a99da3849ec9 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:34.346024 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-413b79b0-e764-4f4f-a842-9915d5d0efde req-086073aa-84f1-443e-8af1-a99da3849ec9 service nova] Creating event network-vif-plugged:f6bf9217-ac91-415b-a39c-6ee42946133e for instance e20fa332-f87b-47b3-a30c-52716e5e7a45 on n-h1-851028-13 Oct 04 18:55:34.365206 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-413b79b0-e764-4f4f-a842-9915d5d0efde req-086073aa-84f1-443e-8af1-a99da3849ec9 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078406 Oct 04 18:55:34.366106 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2570/4845] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:55:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:55:34.384072 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-4336606a-43f5-429f-ac4c-000df17117a2 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:34.385058 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-4336606a-43f5-429f-ac4c-000df17117a2 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] [instance: 02a066b4-243b-4fe3-afcf-30f3e9511d1b] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:34.392749 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4336606a-43f5-429f-ac4c-000df17117a2 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:34.393657 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4336606a-43f5-429f-ac4c-000df17117a2 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:34.394338 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4336606a-43f5-429f-ac4c-000df17117a2 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:34.395330 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4336606a-43f5-429f-ac4c-000df17117a2 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:34.396187 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4336606a-43f5-429f-ac4c-000df17117a2 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:34.396901 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4336606a-43f5-429f-ac4c-000df17117a2 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:34.595244 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-48b51a36-080c-4ef8-b47a-d49b51db8c49 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f63f1ac147543dab34a28a22eb5936c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1607b30b9f324abaa88aa29e04ef3ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:34.604175 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-48b51a36-080c-4ef8-b47a-d49b51db8c49 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40" status: 200 len: 1505 microversion: 2.1 time: 0.723976 Oct 04 18:55:34.604775 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2276/4846] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:33 2022] GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40 => generated 1505 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:55:34.627614 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-d8d8c33c-2228-4284-abe7-bfbb0ac30955 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243"}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:55:34.630916 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-d8d8c33c-2228-4284-abe7-bfbb0ac30955 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 847a1e8a-f44e-4804-b704-4d1406cac8dc] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:34.637459 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-d8d8c33c-2228-4284-abe7-bfbb0ac30955 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] HTTP exception thrown: Instance 847a1e8a-f44e-4804-b704-4d1406cac8dc could not be found. Oct 04 18:55:34.639459 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-d8d8c33c-2228-4284-abe7-bfbb0ac30955 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Request method failure captured: Oct 04 18:55:34.639459 n-d-851028-13 devstack@n-api.service[123595]: request: POST /compute/v2.1/servers/847a1e8a-f44e-4804-b704-4d1406cac8dc/action HTTP/1.1 Oct 04 18:55:34.639459 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 18:55:34.639459 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 18:55:34.639459 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 18:55:34.639459 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 65 Oct 04 18:55:34.639459 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 18:55:34.639459 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 18:55:34.639459 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 18:55:34.639459 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 18:55:34.639459 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPIEZsAoFcr6P1AMHBWUo8LvryOn1l2-LYSKr4xgLCvHblWFuAiGVlStWcljkgzOc7-ldx7qv3C-2jYmQ32_Zk5yP28dI64Re9CsyHCLmsYfyJdD0-2_kU92lHK36Fs8oXqXU2FijNX-X4IYqe4GjOQDN7LB9zCeEIcrxQ2LRJFOwbQY Oct 04 18:55:34.639459 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 18:55:34.639459 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 18:55:34.639459 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 18:55:34.639459 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 18:55:34.639459 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 18:55:34.639459 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 18:55:34.639459 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: 1607b30b9f324abaa88aa29e04ef3ec4 Oct 04 18:55:34.639459 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-ServersNegativeTestJSON-708693932 Oct 04 18:55:34.639459 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 18:55:34.639459 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 18:55:34.639459 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/1607b30b9f324abaa88aa29e04ef3ec4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_1607b30b9f324abaa88aa29e04ef3ec4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1607b30b9f324abaa88aa29e04ef3ec4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1607b30b9f324abaa88aa29e04ef3ec4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:55:34.639459 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-ServersNegativeTestJSON-708693932 Oct 04 18:55:34.639459 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: 1607b30b9f324abaa88aa29e04ef3ec4 Oct 04 18:55:34.639459 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-ServersNegativeTestJSON-708693932 Oct 04 18:55:34.639459 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-ServersNegativeTestJSON-708693932-project Oct 04 18:55:34.639459 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 18:55:34.639459 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 18:55:34.639459 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: 6f63f1ac147543dab34a28a22eb5936c Oct 04 18:55:34.639459 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-ServersNegativeTestJSON-708693932-project Oct 04 18:55:34.639459 n-d-851028-13 devstack@n-api.service[123595]: Oct 04 18:55:34.639459 n-d-851028-13 devstack@n-api.service[123595]: {"rebuild": {"imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243"}} Oct 04 18:55:34.639459 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 18:55:34.639459 n-d-851028-13 devstack@n-api.service[123595]: exception: Instance 847a1e8a-f44e-4804-b704-4d1406cac8dc could not be found. Oct 04 18:55:34.639459 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': '847a1e8a-f44e-4804-b704-4d1406cac8dc', 'body': {'rebuild': {'imageRef': 'e8943ec5-4038-4d4b-b9b9-2415a79f5243'}}} Oct 04 18:55:34.639459 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:55:34.639459 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:55:34.639459 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:55:34.639459 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:55:34.639459 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:55:34.639459 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:55:34.639459 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 18:55:34.639459 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 18:55:34.639459 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 847a1e8a-f44e-4804-b704-4d1406cac8dc could not be found. Oct 04 18:55:34.639459 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:55:34.639459 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:55:34.639459 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:55:34.639459 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:55:34.639459 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:55:34.639459 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:55:34.639459 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:55:34.639459 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:55:34.639459 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:55:34.639459 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:55:34.639459 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:55:34.639459 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:55:34.639459 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:55:34.639459 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:55:34.639459 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:55:34.639459 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:55:34.639459 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 04 18:55:34.639459 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Oct 04 18:55:34.639459 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 04 18:55:34.639459 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:55:34.644951 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:55:34.644951 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:55:34.644951 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:55:34.644951 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 847a1e8a-f44e-4804-b704-4d1406cac8dc could not be found. Oct 04 18:55:34.644951 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:55:34.644951 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:55:34.644951 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:55:34.644951 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:55:34.644951 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:55:34.644951 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:55:34.644951 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:55:34.644951 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:55:34.644951 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 847a1e8a-f44e-4804-b704-4d1406cac8dc could not be found. Oct 04 18:55:34.644951 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:55:34.647719 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-d8d8c33c-2228-4284-abe7-bfbb0ac30955 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Returning 404 to user: Instance 847a1e8a-f44e-4804-b704-4d1406cac8dc could not be found. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:55:34.648809 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-d8d8c33c-2228-4284-abe7-bfbb0ac30955 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "POST /compute/v2.1/servers/847a1e8a-f44e-4804-b704-4d1406cac8dc/action" status: 404 len: 111 microversion: 2.1 time: 0.026196 Oct 04 18:55:34.653139 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2277/4847] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 18:55:34 2022] POST /compute/v2.1/servers/847a1e8a-f44e-4804-b704-4d1406cac8dc/action => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:55:34.658459 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-fe5faf0b-594a-4abc-bba2-ef22ccdf0d2c tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:34.659309 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-fe5faf0b-594a-4abc-bba2-ef22ccdf0d2c tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] [instance: e20fa332-f87b-47b3-a30c-52716e5e7a45] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:34.667469 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fe5faf0b-594a-4abc-bba2-ef22ccdf0d2c tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:34.668279 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fe5faf0b-594a-4abc-bba2-ef22ccdf0d2c tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:34.668888 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fe5faf0b-594a-4abc-bba2-ef22ccdf0d2c tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:34.669811 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fe5faf0b-594a-4abc-bba2-ef22ccdf0d2c tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:34.670435 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fe5faf0b-594a-4abc-bba2-ef22ccdf0d2c tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:34.671023 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fe5faf0b-594a-4abc-bba2-ef22ccdf0d2c tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:34.911909 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-fe5faf0b-594a-4abc-bba2-ef22ccdf0d2c tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16d1e957e30423e9b06c6150e5c4a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74c55e15cfd4f2c9ce67c9aa91c1b5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:34.949100 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-fe5faf0b-594a-4abc-bba2-ef22ccdf0d2c tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] 10.222.0.43 "GET /compute/v2.1/servers/e20fa332-f87b-47b3-a30c-52716e5e7a45" status: 200 len: 1394 microversion: 2.1 time: 0.294297 Oct 04 18:55:34.950615 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2278/4848] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:34 2022] GET /compute/v2.1/servers/e20fa332-f87b-47b3-a30c-52716e5e7a45 => generated 1394 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:55:34.958782 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-353dcaf6-6545-4f9a-a735-bb8be96953ad tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:34.959658 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-353dcaf6-6545-4f9a-a735-bb8be96953ad tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 01e250ab-d9aa-4708-ae36-10c53a411a40] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:34.967391 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-353dcaf6-6545-4f9a-a735-bb8be96953ad tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:34.968001 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-353dcaf6-6545-4f9a-a735-bb8be96953ad tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:34.969259 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-353dcaf6-6545-4f9a-a735-bb8be96953ad tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:34.970876 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-353dcaf6-6545-4f9a-a735-bb8be96953ad tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:34.971456 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-353dcaf6-6545-4f9a-a735-bb8be96953ad tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:34.971999 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-353dcaf6-6545-4f9a-a735-bb8be96953ad tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:35.361161 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-353dcaf6-6545-4f9a-a735-bb8be96953ad tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f63f1ac147543dab34a28a22eb5936c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1607b30b9f324abaa88aa29e04ef3ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:35.370635 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-4336606a-43f5-429f-ac4c-000df17117a2 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:35.389043 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-4336606a-43f5-429f-ac4c-000df17117a2 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:35.392350 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-4336606a-43f5-429f-ac4c-000df17117a2 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:35.396768 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-4336606a-43f5-429f-ac4c-000df17117a2 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] 10.222.0.43 "GET /compute/v2.1/servers/02a066b4-243b-4fe3-afcf-30f3e9511d1b" status: 200 len: 1875 microversion: 2.42 time: 1.029025 Oct 04 18:55:35.399383 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2571/4849] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:55:34 2022] GET /compute/v2.1/servers/02a066b4-243b-4fe3-afcf-30f3e9511d1b => generated 1875 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:55:35.412900 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-353dcaf6-6545-4f9a-a735-bb8be96953ad tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40" status: 200 len: 1505 microversion: 2.1 time: 0.457109 Oct 04 18:55:35.436983 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-8386432a-a2e3-4f3f-a579-3465a389cd9b req-b2cd1945-2d95-45ca-a40d-c69dab3b3ef8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02a066b4-243b-4fe3-afcf-30f3e9511d1b", "tag": "d6932e78-3478-434a-96dd-d933c1b1b369"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:55:35.438591 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2279/4850] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:34 2022] GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40 => generated 1505 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:55:35.484838 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-f618d2a2-9332-434c-997c-94acbb32c065 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:35.485658 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-f618d2a2-9332-434c-997c-94acbb32c065 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 01e250ab-d9aa-4708-ae36-10c53a411a40] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:35.487166 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-8386432a-a2e3-4f3f-a579-3465a389cd9b req-b2cd1945-2d95-45ca-a40d-c69dab3b3ef8 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:35.494042 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-8386432a-a2e3-4f3f-a579-3465a389cd9b req-b2cd1945-2d95-45ca-a40d-c69dab3b3ef8 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:35.495521 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f618d2a2-9332-434c-997c-94acbb32c065 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:35.498245 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-8386432a-a2e3-4f3f-a579-3465a389cd9b req-b2cd1945-2d95-45ca-a40d-c69dab3b3ef8 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:35.498487 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f618d2a2-9332-434c-997c-94acbb32c065 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:35.498731 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f618d2a2-9332-434c-997c-94acbb32c065 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:35.502137 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f618d2a2-9332-434c-997c-94acbb32c065 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:35.507055 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f618d2a2-9332-434c-997c-94acbb32c065 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:35.511842 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f618d2a2-9332-434c-997c-94acbb32c065 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:35.538198 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-8386432a-a2e3-4f3f-a579-3465a389cd9b req-b2cd1945-2d95-45ca-a40d-c69dab3b3ef8 service nova] Creating event network-changed:d6932e78-3478-434a-96dd-d933c1b1b369 for instance 02a066b4-243b-4fe3-afcf-30f3e9511d1b on n-h2-851028-13 Oct 04 18:55:35.547468 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-8386432a-a2e3-4f3f-a579-3465a389cd9b req-b2cd1945-2d95-45ca-a40d-c69dab3b3ef8 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.136264 Oct 04 18:55:35.569662 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2572/4851] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:55:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:55:35.983512 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-a11aa578-7e89-4a13-a629-681a26886cfe tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:35.985230 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-a11aa578-7e89-4a13-a629-681a26886cfe tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] [instance: e20fa332-f87b-47b3-a30c-52716e5e7a45] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:35.997831 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a11aa578-7e89-4a13-a629-681a26886cfe tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:36.001547 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a11aa578-7e89-4a13-a629-681a26886cfe tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:36.002225 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a11aa578-7e89-4a13-a629-681a26886cfe tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:36.003325 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a11aa578-7e89-4a13-a629-681a26886cfe tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:36.016854 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a11aa578-7e89-4a13-a629-681a26886cfe tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:36.017780 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a11aa578-7e89-4a13-a629-681a26886cfe tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:36.463884 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-f618d2a2-9332-434c-997c-94acbb32c065 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f63f1ac147543dab34a28a22eb5936c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1607b30b9f324abaa88aa29e04ef3ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:36.494609 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-f618d2a2-9332-434c-997c-94acbb32c065 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40" status: 200 len: 1505 microversion: 2.1 time: 1.014302 Oct 04 18:55:36.495575 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2280/4852] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:35 2022] GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40 => generated 1505 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:55:36.513409 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-4c57b0ef-cd3f-4b1e-9efb-d029a9a19b47 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:36.526738 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-4c57b0ef-cd3f-4b1e-9efb-d029a9a19b47 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] [instance: 523fce83-2292-42b0-9b99-c9ac2c48e544] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:36.552375 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4c57b0ef-cd3f-4b1e-9efb-d029a9a19b47 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:36.556197 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4c57b0ef-cd3f-4b1e-9efb-d029a9a19b47 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:36.559405 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4c57b0ef-cd3f-4b1e-9efb-d029a9a19b47 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:36.562023 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4c57b0ef-cd3f-4b1e-9efb-d029a9a19b47 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:36.563434 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4c57b0ef-cd3f-4b1e-9efb-d029a9a19b47 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:36.564206 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4c57b0ef-cd3f-4b1e-9efb-d029a9a19b47 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:36.574479 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-a11aa578-7e89-4a13-a629-681a26886cfe tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16d1e957e30423e9b06c6150e5c4a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74c55e15cfd4f2c9ce67c9aa91c1b5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:36.590182 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-a11aa578-7e89-4a13-a629-681a26886cfe tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] 10.222.0.43 "GET /compute/v2.1/servers/e20fa332-f87b-47b3-a30c-52716e5e7a45" status: 200 len: 1394 microversion: 2.1 time: 0.617031 Oct 04 18:55:36.598101 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2573/4853] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:35 2022] GET /compute/v2.1/servers/e20fa332-f87b-47b3-a30c-52716e5e7a45 => generated 1394 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:55:36.614357 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-3dfc71e6-504b-4c95-ae0a-fa45b9e41216 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:36.615237 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-3dfc71e6-504b-4c95-ae0a-fa45b9e41216 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] [instance: 02a066b4-243b-4fe3-afcf-30f3e9511d1b] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:36.628102 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3dfc71e6-504b-4c95-ae0a-fa45b9e41216 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:36.629255 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3dfc71e6-504b-4c95-ae0a-fa45b9e41216 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:36.631314 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3dfc71e6-504b-4c95-ae0a-fa45b9e41216 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:36.633700 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3dfc71e6-504b-4c95-ae0a-fa45b9e41216 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:36.635514 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3dfc71e6-504b-4c95-ae0a-fa45b9e41216 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:36.636850 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3dfc71e6-504b-4c95-ae0a-fa45b9e41216 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:36.649098 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-4c57b0ef-cd3f-4b1e-9efb-d029a9a19b47 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] 10.222.0.43 "GET /compute/v2.1/servers/523fce83-2292-42b0-9b99-c9ac2c48e544/ips" status: 200 len: 150 microversion: 2.1 time: 0.152163 Oct 04 18:55:36.650096 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2281/4854] 10.222.0.43 () {58 vars in 1248 bytes} [Tue Oct 4 18:55:36 2022] GET /compute/v2.1/servers/523fce83-2292-42b0-9b99-c9ac2c48e544/ips => generated 150 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:55:36.660212 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-20d2cd49-f5b3-4e66-8cc4-eb8d41992e60 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:55:36.661343 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-20d2cd49-f5b3-4e66-8cc4-eb8d41992e60 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: bb1269d5-89b3-4c45-ab8d-cf31f27fe01b] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:36.685816 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-20d2cd49-f5b3-4e66-8cc4-eb8d41992e60 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] HTTP exception thrown: Instance bb1269d5-89b3-4c45-ab8d-cf31f27fe01b could not be found. Oct 04 18:55:36.688291 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-20d2cd49-f5b3-4e66-8cc4-eb8d41992e60 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Request method failure captured: Oct 04 18:55:36.688291 n-d-851028-13 devstack@n-api.service[123595]: request: POST /compute/v2.1/servers/bb1269d5-89b3-4c45-ab8d-cf31f27fe01b/action HTTP/1.1 Oct 04 18:55:36.688291 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 18:55:36.688291 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 18:55:36.688291 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 18:55:36.688291 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 15 Oct 04 18:55:36.688291 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 18:55:36.688291 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 18:55:36.688291 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 18:55:36.688291 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 18:55:36.688291 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPIEZsAoFcr6P1AMHBWUo8LvryOn1l2-LYSKr4xgLCvHblWFuAiGVlStWcljkgzOc7-ldx7qv3C-2jYmQ32_Zk5yP28dI64Re9CsyHCLmsYfyJdD0-2_kU92lHK36Fs8oXqXU2FijNX-X4IYqe4GjOQDN7LB9zCeEIcrxQ2LRJFOwbQY Oct 04 18:55:36.688291 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 18:55:36.688291 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 18:55:36.688291 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 18:55:36.688291 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 18:55:36.688291 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 18:55:36.688291 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 18:55:36.688291 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: 1607b30b9f324abaa88aa29e04ef3ec4 Oct 04 18:55:36.688291 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-ServersNegativeTestJSON-708693932 Oct 04 18:55:36.688291 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 18:55:36.688291 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 18:55:36.688291 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/1607b30b9f324abaa88aa29e04ef3ec4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_1607b30b9f324abaa88aa29e04ef3ec4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1607b30b9f324abaa88aa29e04ef3ec4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1607b30b9f324abaa88aa29e04ef3ec4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:55:36.688291 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-ServersNegativeTestJSON-708693932 Oct 04 18:55:36.688291 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: 1607b30b9f324abaa88aa29e04ef3ec4 Oct 04 18:55:36.688291 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-ServersNegativeTestJSON-708693932 Oct 04 18:55:36.688291 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-ServersNegativeTestJSON-708693932-project Oct 04 18:55:36.688291 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 18:55:36.688291 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 18:55:36.688291 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: 6f63f1ac147543dab34a28a22eb5936c Oct 04 18:55:36.688291 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-ServersNegativeTestJSON-708693932-project Oct 04 18:55:36.688291 n-d-851028-13 devstack@n-api.service[123595]: Oct 04 18:55:36.688291 n-d-851028-13 devstack@n-api.service[123595]: {"restore": {}} Oct 04 18:55:36.688291 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 18:55:36.688291 n-d-851028-13 devstack@n-api.service[123595]: exception: Instance bb1269d5-89b3-4c45-ab8d-cf31f27fe01b could not be found. Oct 04 18:55:36.688291 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': 'bb1269d5-89b3-4c45-ab8d-cf31f27fe01b', 'body': {'restore': {}}} Oct 04 18:55:36.688291 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:55:36.688291 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:55:36.688291 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:55:36.688291 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:55:36.688291 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:55:36.688291 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:55:36.688291 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 18:55:36.688291 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 18:55:36.688291 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb1269d5-89b3-4c45-ab8d-cf31f27fe01b could not be found. Oct 04 18:55:36.688291 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:55:36.688291 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:55:36.688291 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:55:36.688291 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:55:36.688291 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:55:36.688291 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:55:36.688291 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:55:36.688291 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:55:36.688291 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:55:36.688291 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:55:36.688291 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 38, in _restore Oct 04 18:55:36.688291 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 04 18:55:36.688291 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:55:36.688291 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:55:36.688291 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb1269d5-89b3-4c45-ab8d-cf31f27fe01b could not be found. Oct 04 18:55:36.688291 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:55:36.688291 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:55:36.688291 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:55:36.688291 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:55:36.688291 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:55:36.688291 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:55:36.693161 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:55:36.693161 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:55:36.693161 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb1269d5-89b3-4c45-ab8d-cf31f27fe01b could not be found. Oct 04 18:55:36.693161 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:55:36.697241 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-20d2cd49-f5b3-4e66-8cc4-eb8d41992e60 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Returning 404 to user: Instance bb1269d5-89b3-4c45-ab8d-cf31f27fe01b could not be found. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:55:36.698803 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-20d2cd49-f5b3-4e66-8cc4-eb8d41992e60 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "POST /compute/v2.1/servers/bb1269d5-89b3-4c45-ab8d-cf31f27fe01b/action" status: 404 len: 111 microversion: 2.1 time: 0.047352 Oct 04 18:55:36.699947 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2282/4855] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 18:55:36 2022] POST /compute/v2.1/servers/bb1269d5-89b3-4c45-ab8d-cf31f27fe01b/action => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:55:36.710794 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-74591305-7a93-49b7-9c3b-8334fa360754 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b58125c2-399b-4901-ab14-2b7cf4f8fae7"}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:55:36.722405 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-74591305-7a93-49b7-9c3b-8334fa360754 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] [instance: 523fce83-2292-42b0-9b99-c9ac2c48e544] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:36.734763 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-74591305-7a93-49b7-9c3b-8334fa360754 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:36.738126 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-74591305-7a93-49b7-9c3b-8334fa360754 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:36.738949 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-74591305-7a93-49b7-9c3b-8334fa360754 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:36.740233 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-74591305-7a93-49b7-9c3b-8334fa360754 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:36.741033 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-74591305-7a93-49b7-9c3b-8334fa360754 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:36.741840 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-74591305-7a93-49b7-9c3b-8334fa360754 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:36.874617 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:55:36.881299 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-74591305-7a93-49b7-9c3b-8334fa360754 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] HTTP exception thrown: Invalid volume: volume b58125c2-399b-4901-ab14-2b7cf4f8fae7 is already attached to instances: bc5eda7f-851f-44d8-af95-5e721dd6d52b Oct 04 18:55:36.883371 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-74591305-7a93-49b7-9c3b-8334fa360754 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Request method failure captured: Oct 04 18:55:36.883371 n-d-851028-13 devstack@n-api.service[123595]: request: POST /compute/v2.1/servers/523fce83-2292-42b0-9b99-c9ac2c48e544/os-volume_attachments HTTP/1.1 Oct 04 18:55:36.883371 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 18:55:36.883371 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 18:55:36.883371 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 18:55:36.883371 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 74 Oct 04 18:55:36.883371 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 18:55:36.883371 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 18:55:36.883371 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 18:55:36.883371 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 18:55:36.883371 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPID78vmCI9IDPSneDizdTNDV6DvHA8Yu-0Hk2AdriQTEcsN9glvSb6qnq0IhhwuZEnTcyOqvR3DmN0AjQb3MXy0KeUN-iyujvPMDrfVKCEbIzKf9nHEoBLFpzOTLVQVrEHVpIwmUAw_LxUeBUjShHQb88Tzo0W7pmPF365n3rwKGYEI Oct 04 18:55:36.883371 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 18:55:36.883371 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 18:55:36.883371 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 18:55:36.883371 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 18:55:36.883371 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 18:55:36.883371 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 18:55:36.883371 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: 6c91c7e7358048ffaaee7f51ad61b515 Oct 04 18:55:36.883371 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-AttachVolumeNegativeTest-2048626205 Oct 04 18:55:36.883371 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 18:55:36.883371 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 18:55:36.883371 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/6c91c7e7358048ffaaee7f51ad61b515"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_6c91c7e7358048ffaaee7f51ad61b515"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/6c91c7e7358048ffaaee7f51ad61b515"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/6c91c7e7358048ffaaee7f51ad61b515"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:55:36.883371 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-AttachVolumeNegativeTest-2048626205 Oct 04 18:55:36.883371 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: 6c91c7e7358048ffaaee7f51ad61b515 Oct 04 18:55:36.883371 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2048626205 Oct 04 18:55:36.883371 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-AttachVolumeNegativeTest-2048626205-project Oct 04 18:55:36.883371 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 18:55:36.883371 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 18:55:36.883371 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: 486c22456b1e47ae843ae41f8dfb2632 Oct 04 18:55:36.883371 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-AttachVolumeNegativeTest-2048626205-project Oct 04 18:55:36.883371 n-d-851028-13 devstack@n-api.service[123595]: Oct 04 18:55:36.883371 n-d-851028-13 devstack@n-api.service[123595]: {"volumeAttachment": {"volumeId": "b58125c2-399b-4901-ab14-2b7cf4f8fae7"}} Oct 04 18:55:36.883371 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 18:55:36.883371 n-d-851028-13 devstack@n-api.service[123595]: exception: Invalid volume: volume b58125c2-399b-4901-ab14-2b7cf4f8fae7 is already attached to instances: bc5eda7f-851f-44d8-af95-5e721dd6d52b Oct 04 18:55:36.883371 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'server_id': '523fce83-2292-42b0-9b99-c9ac2c48e544', 'body': {'volumeAttachment': {'volumeId': 'b58125c2-399b-4901-ab14-2b7cf4f8fae7'}}} Oct 04 18:55:36.883371 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:55:36.883371 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:55:36.883371 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 04 18:55:36.883371 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 04 18:55:36.883371 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 18:55:36.883371 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 18:55:36.883371 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 04 18:55:36.883371 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 18:55:36.883371 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 04 18:55:36.883371 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 04 18:55:36.883371 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 04 18:55:36.883371 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 04 18:55:36.883371 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume b58125c2-399b-4901-ab14-2b7cf4f8fae7 is already attached to instances: bc5eda7f-851f-44d8-af95-5e721dd6d52b Oct 04 18:55:36.883371 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:55:36.883371 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:55:36.883371 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:55:36.883371 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:55:36.883371 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:55:36.883371 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:55:36.883371 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:55:36.883371 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:55:36.883371 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:55:36.883371 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:55:36.883371 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:55:36.883371 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:55:36.883371 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:55:36.883371 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:55:36.888836 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:55:36.888836 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:55:36.888836 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 04 18:55:36.888836 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 04 18:55:36.888836 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume b58125c2-399b-4901-ab14-2b7cf4f8fae7 is already attached to instances: bc5eda7f-851f-44d8-af95-5e721dd6d52b Oct 04 18:55:36.888836 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:55:36.888836 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:55:36.888836 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:55:36.888836 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:55:36.888836 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:55:36.888836 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:55:36.888836 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:55:36.888836 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:55:36.888836 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume b58125c2-399b-4901-ab14-2b7cf4f8fae7 is already attached to instances: bc5eda7f-851f-44d8-af95-5e721dd6d52b Oct 04 18:55:36.888836 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:55:36.895399 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-74591305-7a93-49b7-9c3b-8334fa360754 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Returning 400 to user: Invalid volume: volume b58125c2-399b-4901-ab14-2b7cf4f8fae7 is already attached to instances: bc5eda7f-851f-44d8-af95-5e721dd6d52b {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:55:36.900922 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-74591305-7a93-49b7-9c3b-8334fa360754 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] 10.222.0.43 "POST /compute/v2.1/servers/523fce83-2292-42b0-9b99-c9ac2c48e544/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.195814 Oct 04 18:55:36.902766 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2283/4856] 10.222.0.43 () {60 vars in 1323 bytes} [Tue Oct 4 18:55:36 2022] POST /compute/v2.1/servers/523fce83-2292-42b0-9b99-c9ac2c48e544/os-volume_attachments => generated 174 bytes in 202 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:55:36.909644 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-2d85d20d-6b37-4968-8918-424b41847bdc tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:36.910277 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-2d85d20d-6b37-4968-8918-424b41847bdc tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 01e250ab-d9aa-4708-ae36-10c53a411a40] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:36.927799 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2d85d20d-6b37-4968-8918-424b41847bdc tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:36.928312 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2d85d20d-6b37-4968-8918-424b41847bdc tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:36.928787 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2d85d20d-6b37-4968-8918-424b41847bdc tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:36.929548 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2d85d20d-6b37-4968-8918-424b41847bdc tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:36.930020 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2d85d20d-6b37-4968-8918-424b41847bdc tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:36.930455 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2d85d20d-6b37-4968-8918-424b41847bdc tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:37.145291 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-3dfc71e6-504b-4c95-ae0a-fa45b9e41216 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:37.166267 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-3dfc71e6-504b-4c95-ae0a-fa45b9e41216 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:37.173310 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-3dfc71e6-504b-4c95-ae0a-fa45b9e41216 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:37.175442 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-3dfc71e6-504b-4c95-ae0a-fa45b9e41216 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] 10.222.0.43 "GET /compute/v2.1/servers/02a066b4-243b-4fe3-afcf-30f3e9511d1b" status: 200 len: 1875 microversion: 2.42 time: 0.576111 Oct 04 18:55:37.176678 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2574/4857] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:55:36 2022] GET /compute/v2.1/servers/02a066b4-243b-4fe3-afcf-30f3e9511d1b => generated 1875 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:55:37.183254 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-8de959ce-20e2-4e13-a47f-dc19e7a2d31c tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:37.184006 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-8de959ce-20e2-4e13-a47f-dc19e7a2d31c tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] [instance: 523fce83-2292-42b0-9b99-c9ac2c48e544] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:37.225068 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8de959ce-20e2-4e13-a47f-dc19e7a2d31c tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:37.225863 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8de959ce-20e2-4e13-a47f-dc19e7a2d31c tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.033s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:37.227425 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8de959ce-20e2-4e13-a47f-dc19e7a2d31c tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:37.233527 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8de959ce-20e2-4e13-a47f-dc19e7a2d31c tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:37.234643 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8de959ce-20e2-4e13-a47f-dc19e7a2d31c tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:37.235383 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8de959ce-20e2-4e13-a47f-dc19e7a2d31c tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:37.289491 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-8de959ce-20e2-4e13-a47f-dc19e7a2d31c tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] [instance: 523fce83-2292-42b0-9b99-c9ac2c48e544] Going to try to terminate instance {{(pid=123596) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:55:37.441961 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-8de959ce-20e2-4e13-a47f-dc19e7a2d31c tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] 10.222.0.43 "DELETE /compute/v2.1/servers/523fce83-2292-42b0-9b99-c9ac2c48e544" status: 204 len: 0 microversion: 2.1 time: 0.257088 Oct 04 18:55:37.447315 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2575/4858] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 18:55:37 2022] DELETE /compute/v2.1/servers/523fce83-2292-42b0-9b99-c9ac2c48e544 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:55:37.468356 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-0b87b886-e682-4836-8c72-95a0e8e5654e tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:37.469920 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-0b87b886-e682-4836-8c72-95a0e8e5654e tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] [instance: 523fce83-2292-42b0-9b99-c9ac2c48e544] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:37.478844 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0b87b886-e682-4836-8c72-95a0e8e5654e tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:37.480409 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0b87b886-e682-4836-8c72-95a0e8e5654e tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:37.481160 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0b87b886-e682-4836-8c72-95a0e8e5654e tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:37.482192 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0b87b886-e682-4836-8c72-95a0e8e5654e tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:37.482862 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0b87b886-e682-4836-8c72-95a0e8e5654e tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:37.483495 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0b87b886-e682-4836-8c72-95a0e8e5654e tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:37.611927 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-2d85d20d-6b37-4968-8918-424b41847bdc tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f63f1ac147543dab34a28a22eb5936c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1607b30b9f324abaa88aa29e04ef3ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:37.621207 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-2d85d20d-6b37-4968-8918-424b41847bdc tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40" status: 200 len: 1505 microversion: 2.1 time: 0.717253 Oct 04 18:55:37.626365 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2284/4859] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:36 2022] GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40 => generated 1505 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:55:37.643817 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-73f2a9b7-dd50-4abc-9261-54edfc3c5558 tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:37.644868 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-73f2a9b7-dd50-4abc-9261-54edfc3c5558 tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] [instance: e20fa332-f87b-47b3-a30c-52716e5e7a45] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:37.661621 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-73f2a9b7-dd50-4abc-9261-54edfc3c5558 tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:37.662130 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-73f2a9b7-dd50-4abc-9261-54edfc3c5558 tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:37.662768 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-73f2a9b7-dd50-4abc-9261-54edfc3c5558 tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:37.663903 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-73f2a9b7-dd50-4abc-9261-54edfc3c5558 tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:37.664382 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-73f2a9b7-dd50-4abc-9261-54edfc3c5558 tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:37.665187 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-73f2a9b7-dd50-4abc-9261-54edfc3c5558 tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:37.989563 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-73f2a9b7-dd50-4abc-9261-54edfc3c5558 tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16d1e957e30423e9b06c6150e5c4a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74c55e15cfd4f2c9ce67c9aa91c1b5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:38.002856 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-73f2a9b7-dd50-4abc-9261-54edfc3c5558 tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] 10.222.0.43 "GET /compute/v2.1/servers/e20fa332-f87b-47b3-a30c-52716e5e7a45" status: 200 len: 1574 microversion: 2.1 time: 0.375048 Oct 04 18:55:38.008802 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2285/4860] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:37 2022] GET /compute/v2.1/servers/e20fa332-f87b-47b3-a30c-52716e5e7a45 => generated 1574 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:55:38.019698 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-79150428-35e3-4a5b-aec1-fc434ee50abb tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:38.021862 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-79150428-35e3-4a5b-aec1-fc434ee50abb tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 01e250ab-d9aa-4708-ae36-10c53a411a40] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:38.045515 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-79150428-35e3-4a5b-aec1-fc434ee50abb tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:38.046578 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-79150428-35e3-4a5b-aec1-fc434ee50abb tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:38.051582 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-79150428-35e3-4a5b-aec1-fc434ee50abb tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:38.052647 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-79150428-35e3-4a5b-aec1-fc434ee50abb tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:38.053334 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-79150428-35e3-4a5b-aec1-fc434ee50abb tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:38.056389 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-79150428-35e3-4a5b-aec1-fc434ee50abb tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:38.229216 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-0b87b886-e682-4836-8c72-95a0e8e5654e tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '486c22456b1e47ae843ae41f8dfb2632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c91c7e7358048ffaaee7f51ad61b515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:38.239700 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-0b87b886-e682-4836-8c72-95a0e8e5654e tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] 10.222.0.43 "GET /compute/v2.1/servers/523fce83-2292-42b0-9b99-c9ac2c48e544" status: 200 len: 1680 microversion: 2.1 time: 0.790597 Oct 04 18:55:38.240946 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2576/4861] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:37 2022] GET /compute/v2.1/servers/523fce83-2292-42b0-9b99-c9ac2c48e544 => generated 1680 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:55:38.246537 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-ec90112c-cb40-4c0c-b6fb-6f5b1f098b66 tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:38.247367 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-ec90112c-cb40-4c0c-b6fb-6f5b1f098b66 tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] [instance: e20fa332-f87b-47b3-a30c-52716e5e7a45] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:38.256099 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ec90112c-cb40-4c0c-b6fb-6f5b1f098b66 tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:38.256991 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ec90112c-cb40-4c0c-b6fb-6f5b1f098b66 tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:38.257771 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ec90112c-cb40-4c0c-b6fb-6f5b1f098b66 tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:38.258802 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ec90112c-cb40-4c0c-b6fb-6f5b1f098b66 tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:38.259646 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ec90112c-cb40-4c0c-b6fb-6f5b1f098b66 tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:38.260449 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ec90112c-cb40-4c0c-b6fb-6f5b1f098b66 tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:38.268530 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:55:38.490540 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-ec90112c-cb40-4c0c-b6fb-6f5b1f098b66 tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] 10.222.0.43 "GET /compute/v2.1/servers/e20fa332-f87b-47b3-a30c-52716e5e7a45/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.248154 Oct 04 18:55:38.491419 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2577/4862] 10.222.0.43 () {58 vars in 1275 bytes} [Tue Oct 4 18:55:38 2022] GET /compute/v2.1/servers/e20fa332-f87b-47b3-a30c-52716e5e7a45/os-interface => generated 284 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:55:38.496404 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-43b7ff3d-985d-457f-8fd8-e8e3c101783d req-230449f5-c660-42c9-a79d-21c5275dba34 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02a066b4-243b-4fe3-afcf-30f3e9511d1b", "tag": "84007727-69fd-496d-bff6-b9696c470012"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:55:38.513680 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:55:38.514475 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-79150428-35e3-4a5b-aec1-fc434ee50abb tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f63f1ac147543dab34a28a22eb5936c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1607b30b9f324abaa88aa29e04ef3ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:38.518631 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-43b7ff3d-985d-457f-8fd8-e8e3c101783d req-230449f5-c660-42c9-a79d-21c5275dba34 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:38.521773 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-43b7ff3d-985d-457f-8fd8-e8e3c101783d req-230449f5-c660-42c9-a79d-21c5275dba34 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:38.522235 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-43b7ff3d-985d-457f-8fd8-e8e3c101783d req-230449f5-c660-42c9-a79d-21c5275dba34 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:38.528065 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-79150428-35e3-4a5b-aec1-fc434ee50abb tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40" status: 200 len: 1505 microversion: 2.1 time: 0.516446 Oct 04 18:55:38.533685 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2286/4863] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:38 2022] GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40 => generated 1505 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:55:38.545057 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-fb653d95-2af6-4b8e-9a05-2dad3dbfa167 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:38.549083 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-fb653d95-2af6-4b8e-9a05-2dad3dbfa167 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] [instance: 02a066b4-243b-4fe3-afcf-30f3e9511d1b] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:38.563525 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fb653d95-2af6-4b8e-9a05-2dad3dbfa167 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:38.564023 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fb653d95-2af6-4b8e-9a05-2dad3dbfa167 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:38.564471 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fb653d95-2af6-4b8e-9a05-2dad3dbfa167 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:38.565216 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fb653d95-2af6-4b8e-9a05-2dad3dbfa167 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:38.565684 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fb653d95-2af6-4b8e-9a05-2dad3dbfa167 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:38.566122 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fb653d95-2af6-4b8e-9a05-2dad3dbfa167 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:38.577303 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-43b7ff3d-985d-457f-8fd8-e8e3c101783d req-230449f5-c660-42c9-a79d-21c5275dba34 service nova] Creating event network-changed:84007727-69fd-496d-bff6-b9696c470012 for instance 02a066b4-243b-4fe3-afcf-30f3e9511d1b on n-h2-851028-13 Oct 04 18:55:38.583218 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-43b7ff3d-985d-457f-8fd8-e8e3c101783d req-230449f5-c660-42c9-a79d-21c5275dba34 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090414 Oct 04 18:55:38.590935 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2578/4864] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:55:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:55:38.610259 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-eb95d697-c9d8-4bb2-aa19-6b0870876176 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:55:38.611124 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-eb95d697-c9d8-4bb2-aa19-6b0870876176 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 01e250ab-d9aa-4708-ae36-10c53a411a40] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:38.621310 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-eb95d697-c9d8-4bb2-aa19-6b0870876176 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:38.622112 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-eb95d697-c9d8-4bb2-aa19-6b0870876176 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:38.622715 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-eb95d697-c9d8-4bb2-aa19-6b0870876176 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:38.623785 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-eb95d697-c9d8-4bb2-aa19-6b0870876176 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:38.624425 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-eb95d697-c9d8-4bb2-aa19-6b0870876176 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:38.625338 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-eb95d697-c9d8-4bb2-aa19-6b0870876176 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:38.660774 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-eb95d697-c9d8-4bb2-aa19-6b0870876176 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] HTTP exception thrown: Cannot 'restore' instance 01e250ab-d9aa-4708-ae36-10c53a411a40 while it is in vm_state active Oct 04 18:55:38.663186 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-eb95d697-c9d8-4bb2-aa19-6b0870876176 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Request method failure captured: Oct 04 18:55:38.663186 n-d-851028-13 devstack@n-api.service[123596]: request: POST /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40/action HTTP/1.1 Oct 04 18:55:38.663186 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:55:38.663186 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:55:38.663186 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:55:38.663186 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 15 Oct 04 18:55:38.663186 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:55:38.663186 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:55:38.663186 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:55:38.663186 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:55:38.663186 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPIEZsAoFcr6P1AMHBWUo8LvryOn1l2-LYSKr4xgLCvHblWFuAiGVlStWcljkgzOc7-ldx7qv3C-2jYmQ32_Zk5yP28dI64Re9CsyHCLmsYfyJdD0-2_kU92lHK36Fs8oXqXU2FijNX-X4IYqe4GjOQDN7LB9zCeEIcrxQ2LRJFOwbQY Oct 04 18:55:38.663186 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:55:38.663186 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:55:38.663186 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:55:38.663186 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:55:38.663186 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:55:38.663186 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:55:38.663186 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: 1607b30b9f324abaa88aa29e04ef3ec4 Oct 04 18:55:38.663186 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-ServersNegativeTestJSON-708693932 Oct 04 18:55:38.663186 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 18:55:38.663186 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 18:55:38.663186 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/1607b30b9f324abaa88aa29e04ef3ec4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_1607b30b9f324abaa88aa29e04ef3ec4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1607b30b9f324abaa88aa29e04ef3ec4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1607b30b9f324abaa88aa29e04ef3ec4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:55:38.663186 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-ServersNegativeTestJSON-708693932 Oct 04 18:55:38.663186 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: 1607b30b9f324abaa88aa29e04ef3ec4 Oct 04 18:55:38.663186 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-ServersNegativeTestJSON-708693932 Oct 04 18:55:38.663186 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-ServersNegativeTestJSON-708693932-project Oct 04 18:55:38.663186 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:55:38.663186 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:55:38.663186 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 6f63f1ac147543dab34a28a22eb5936c Oct 04 18:55:38.663186 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-ServersNegativeTestJSON-708693932-project Oct 04 18:55:38.663186 n-d-851028-13 devstack@n-api.service[123596]: Oct 04 18:55:38.663186 n-d-851028-13 devstack@n-api.service[123596]: {"restore": {}} Oct 04 18:55:38.663186 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 18:55:38.663186 n-d-851028-13 devstack@n-api.service[123596]: exception: Cannot 'restore' instance 01e250ab-d9aa-4708-ae36-10c53a411a40 while it is in vm_state active Oct 04 18:55:38.663186 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': '01e250ab-d9aa-4708-ae36-10c53a411a40', 'body': {'restore': {}}} Oct 04 18:55:38.663186 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:55:38.663186 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:55:38.663186 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 42, in _restore Oct 04 18:55:38.663186 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi self.compute_api.restore(context, instance) Oct 04 18:55:38.663186 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 18:55:38.663186 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 18:55:38.663186 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 04 18:55:38.663186 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 04 18:55:38.663186 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 01e250ab-d9aa-4708-ae36-10c53a411a40 in vm_state active. Cannot restore while the instance is in this state. Oct 04 18:55:38.663186 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:55:38.663186 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:55:38.663186 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:55:38.663186 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:55:38.663186 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:55:38.663186 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:55:38.663186 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:55:38.663186 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:55:38.663186 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:55:38.663186 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:55:38.663186 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 46, in _restore Oct 04 18:55:38.663186 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 04 18:55:38.663186 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 04 18:55:38.663186 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 04 18:55:38.663186 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'restore' instance 01e250ab-d9aa-4708-ae36-10c53a411a40 while it is in vm_state active Oct 04 18:55:38.663186 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:55:38.663186 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:55:38.663186 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:55:38.663186 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:55:38.663186 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:55:38.667846 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:55:38.667846 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:55:38.667846 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:55:38.667846 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'restore' instance 01e250ab-d9aa-4708-ae36-10c53a411a40 while it is in vm_state active Oct 04 18:55:38.667846 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:55:38.670737 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-eb95d697-c9d8-4bb2-aa19-6b0870876176 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Returning 409 to user: Cannot 'restore' instance 01e250ab-d9aa-4708-ae36-10c53a411a40 while it is in vm_state active {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:55:38.671873 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-eb95d697-c9d8-4bb2-aa19-6b0870876176 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "POST /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40/action" status: 409 len: 145 microversion: 2.1 time: 0.067990 Oct 04 18:55:38.672702 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2579/4865] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 18:55:38 2022] POST /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40/action => generated 145 bytes in 81 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:55:38.684314 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-a4ad1947-052e-4910-9732-c47cade05bd1 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:38.685390 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-a4ad1947-052e-4910-9732-c47cade05bd1 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 01e250ab-d9aa-4708-ae36-10c53a411a40] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:38.694016 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a4ad1947-052e-4910-9732-c47cade05bd1 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:38.694763 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a4ad1947-052e-4910-9732-c47cade05bd1 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:38.695472 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a4ad1947-052e-4910-9732-c47cade05bd1 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:38.696539 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a4ad1947-052e-4910-9732-c47cade05bd1 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:38.697187 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a4ad1947-052e-4910-9732-c47cade05bd1 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:38.697780 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a4ad1947-052e-4910-9732-c47cade05bd1 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:39.250655 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-fb653d95-2af6-4b8e-9a05-2dad3dbfa167 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:39.274693 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-fb653d95-2af6-4b8e-9a05-2dad3dbfa167 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:39.277299 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-fb653d95-2af6-4b8e-9a05-2dad3dbfa167 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:39.282541 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-fb653d95-2af6-4b8e-9a05-2dad3dbfa167 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] 10.222.0.43 "GET /compute/v2.1/servers/02a066b4-243b-4fe3-afcf-30f3e9511d1b" status: 200 len: 1875 microversion: 2.42 time: 0.746893 Oct 04 18:55:39.285841 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2287/4866] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:55:38 2022] GET /compute/v2.1/servers/02a066b4-243b-4fe3-afcf-30f3e9511d1b => generated 1875 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:55:39.295433 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-dc3cfff3-320f-4932-a5cb-2984e3319f18 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:39.301805 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-dc3cfff3-320f-4932-a5cb-2984e3319f18 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] [instance: 523fce83-2292-42b0-9b99-c9ac2c48e544] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:39.312720 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dc3cfff3-320f-4932-a5cb-2984e3319f18 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:39.314199 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dc3cfff3-320f-4932-a5cb-2984e3319f18 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:39.316422 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dc3cfff3-320f-4932-a5cb-2984e3319f18 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:39.318088 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dc3cfff3-320f-4932-a5cb-2984e3319f18 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:39.321791 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dc3cfff3-320f-4932-a5cb-2984e3319f18 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:39.331716 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dc3cfff3-320f-4932-a5cb-2984e3319f18 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:39.473476 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-a4ad1947-052e-4910-9732-c47cade05bd1 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f63f1ac147543dab34a28a22eb5936c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1607b30b9f324abaa88aa29e04ef3ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:39.483287 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-a4ad1947-052e-4910-9732-c47cade05bd1 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40" status: 200 len: 1505 microversion: 2.1 time: 0.804977 Oct 04 18:55:39.483884 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2580/4867] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:38 2022] GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40 => generated 1505 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:55:39.511229 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-77fd8109-23a2-403b-bc8a-18b83bac4580 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:39.512144 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-77fd8109-23a2-403b-bc8a-18b83bac4580 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 01e250ab-d9aa-4708-ae36-10c53a411a40] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:39.519232 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-77fd8109-23a2-403b-bc8a-18b83bac4580 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:39.520029 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-77fd8109-23a2-403b-bc8a-18b83bac4580 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:39.520722 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-77fd8109-23a2-403b-bc8a-18b83bac4580 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:39.521684 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-77fd8109-23a2-403b-bc8a-18b83bac4580 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:39.533308 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-77fd8109-23a2-403b-bc8a-18b83bac4580 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:39.534183 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-77fd8109-23a2-403b-bc8a-18b83bac4580 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:40.044193 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-77fd8109-23a2-403b-bc8a-18b83bac4580 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f63f1ac147543dab34a28a22eb5936c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1607b30b9f324abaa88aa29e04ef3ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:40.045454 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-dc3cfff3-320f-4932-a5cb-2984e3319f18 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '486c22456b1e47ae843ae41f8dfb2632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c91c7e7358048ffaaee7f51ad61b515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:40.061893 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-77fd8109-23a2-403b-bc8a-18b83bac4580 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40" status: 200 len: 1505 microversion: 2.1 time: 0.554691 Oct 04 18:55:40.063425 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2581/4868] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:39 2022] GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40 => generated 1505 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:55:40.087244 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-688dbe45-c63e-4793-9d28-e65ecff97c17 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:55:40.087514 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-dc3cfff3-320f-4932-a5cb-2984e3319f18 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] 10.222.0.43 "GET /compute/v2.1/servers/523fce83-2292-42b0-9b99-c9ac2c48e544" status: 200 len: 1680 microversion: 2.1 time: 0.799290 Oct 04 18:55:40.088422 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-688dbe45-c63e-4793-9d28-e65ecff97c17 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 83c11dc9-814d-420d-b3f6-25501fb8ffdb] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:40.088715 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2288/4869] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:39 2022] GET /compute/v2.1/servers/523fce83-2292-42b0-9b99-c9ac2c48e544 => generated 1680 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:55:40.104681 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-688dbe45-c63e-4793-9d28-e65ecff97c17 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] HTTP exception thrown: Instance 83c11dc9-814d-420d-b3f6-25501fb8ffdb could not be found. Oct 04 18:55:40.115111 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-688dbe45-c63e-4793-9d28-e65ecff97c17 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Request method failure captured: Oct 04 18:55:40.115111 n-d-851028-13 devstack@n-api.service[123596]: request: POST /compute/v2.1/servers/83c11dc9-814d-420d-b3f6-25501fb8ffdb/action HTTP/1.1 Oct 04 18:55:40.115111 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:55:40.115111 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:55:40.115111 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:55:40.115111 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 14 Oct 04 18:55:40.115111 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:55:40.115111 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:55:40.115111 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:55:40.115111 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:55:40.115111 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPIEZsAoFcr6P1AMHBWUo8LvryOn1l2-LYSKr4xgLCvHblWFuAiGVlStWcljkgzOc7-ldx7qv3C-2jYmQ32_Zk5yP28dI64Re9CsyHCLmsYfyJdD0-2_kU92lHK36Fs8oXqXU2FijNX-X4IYqe4GjOQDN7LB9zCeEIcrxQ2LRJFOwbQY Oct 04 18:55:40.115111 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:55:40.115111 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:55:40.115111 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:55:40.115111 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:55:40.115111 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:55:40.115111 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:55:40.115111 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: 1607b30b9f324abaa88aa29e04ef3ec4 Oct 04 18:55:40.115111 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-ServersNegativeTestJSON-708693932 Oct 04 18:55:40.115111 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 18:55:40.115111 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 18:55:40.115111 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/1607b30b9f324abaa88aa29e04ef3ec4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_1607b30b9f324abaa88aa29e04ef3ec4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1607b30b9f324abaa88aa29e04ef3ec4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1607b30b9f324abaa88aa29e04ef3ec4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:55:40.115111 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-ServersNegativeTestJSON-708693932 Oct 04 18:55:40.115111 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: 1607b30b9f324abaa88aa29e04ef3ec4 Oct 04 18:55:40.115111 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-ServersNegativeTestJSON-708693932 Oct 04 18:55:40.115111 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-ServersNegativeTestJSON-708693932-project Oct 04 18:55:40.115111 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:55:40.115111 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:55:40.115111 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 6f63f1ac147543dab34a28a22eb5936c Oct 04 18:55:40.115111 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-ServersNegativeTestJSON-708693932-project Oct 04 18:55:40.115111 n-d-851028-13 devstack@n-api.service[123596]: Oct 04 18:55:40.115111 n-d-851028-13 devstack@n-api.service[123596]: {"resume": {}} Oct 04 18:55:40.115111 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 18:55:40.115111 n-d-851028-13 devstack@n-api.service[123596]: exception: Instance 83c11dc9-814d-420d-b3f6-25501fb8ffdb could not be found. Oct 04 18:55:40.115111 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': '83c11dc9-814d-420d-b3f6-25501fb8ffdb', 'body': {'resume': {}}} Oct 04 18:55:40.115111 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:55:40.115111 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:55:40.115111 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:55:40.115111 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:55:40.115111 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:55:40.115111 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:55:40.115111 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 18:55:40.115111 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 18:55:40.115111 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 83c11dc9-814d-420d-b3f6-25501fb8ffdb could not be found. Oct 04 18:55:40.115111 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:55:40.115111 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:55:40.115111 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:55:40.115111 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:55:40.115111 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:55:40.115111 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:55:40.115111 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:55:40.115111 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:55:40.115111 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:55:40.115111 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:55:40.115111 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 55, in _resume Oct 04 18:55:40.115111 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Oct 04 18:55:40.115111 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:55:40.115111 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:55:40.115111 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 83c11dc9-814d-420d-b3f6-25501fb8ffdb could not be found. Oct 04 18:55:40.115111 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:55:40.115111 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:55:40.115111 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:55:40.115111 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:55:40.115111 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:55:40.115111 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:55:40.121097 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:55:40.121097 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:55:40.121097 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 83c11dc9-814d-420d-b3f6-25501fb8ffdb could not be found. Oct 04 18:55:40.121097 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:55:40.121097 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-688dbe45-c63e-4793-9d28-e65ecff97c17 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Returning 404 to user: Instance 83c11dc9-814d-420d-b3f6-25501fb8ffdb could not be found. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:55:40.121702 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-688dbe45-c63e-4793-9d28-e65ecff97c17 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "POST /compute/v2.1/servers/83c11dc9-814d-420d-b3f6-25501fb8ffdb/action" status: 404 len: 111 microversion: 2.1 time: 0.036242 Oct 04 18:55:40.122666 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2582/4870] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 18:55:40 2022] POST /compute/v2.1/servers/83c11dc9-814d-420d-b3f6-25501fb8ffdb/action => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:55:40.132251 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-a27e174a-caea-4247-a78b-943cf897f282 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:40.133096 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-a27e174a-caea-4247-a78b-943cf897f282 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 01e250ab-d9aa-4708-ae36-10c53a411a40] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:40.167910 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a27e174a-caea-4247-a78b-943cf897f282 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:40.171056 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a27e174a-caea-4247-a78b-943cf897f282 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:40.172371 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a27e174a-caea-4247-a78b-943cf897f282 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:40.173243 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a27e174a-caea-4247-a78b-943cf897f282 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:40.175260 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a27e174a-caea-4247-a78b-943cf897f282 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:40.175783 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a27e174a-caea-4247-a78b-943cf897f282 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:40.320383 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-586669c6-6f4e-4a06-8aad-7b9159e3d96a tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:40.321978 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-586669c6-6f4e-4a06-8aad-7b9159e3d96a tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] [instance: 02a066b4-243b-4fe3-afcf-30f3e9511d1b] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:40.341386 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-586669c6-6f4e-4a06-8aad-7b9159e3d96a tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:40.342274 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-586669c6-6f4e-4a06-8aad-7b9159e3d96a tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:40.342965 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-586669c6-6f4e-4a06-8aad-7b9159e3d96a tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:40.344320 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-586669c6-6f4e-4a06-8aad-7b9159e3d96a tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:40.345341 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-586669c6-6f4e-4a06-8aad-7b9159e3d96a tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:40.346028 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-586669c6-6f4e-4a06-8aad-7b9159e3d96a tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:41.075983 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-a27e174a-caea-4247-a78b-943cf897f282 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f63f1ac147543dab34a28a22eb5936c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1607b30b9f324abaa88aa29e04ef3ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:41.084366 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-a27e174a-caea-4247-a78b-943cf897f282 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40" status: 200 len: 1505 microversion: 2.1 time: 0.956374 Oct 04 18:55:41.085644 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2289/4871] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:40 2022] GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40 => generated 1505 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:55:41.115330 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-fe6a753a-19af-4e27-8fc2-4a1684b62f0e tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:41.116286 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-fe6a753a-19af-4e27-8fc2-4a1684b62f0e tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] [instance: 523fce83-2292-42b0-9b99-c9ac2c48e544] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:41.127578 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fe6a753a-19af-4e27-8fc2-4a1684b62f0e tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:41.128214 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fe6a753a-19af-4e27-8fc2-4a1684b62f0e tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:41.128806 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fe6a753a-19af-4e27-8fc2-4a1684b62f0e tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:41.131795 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fe6a753a-19af-4e27-8fc2-4a1684b62f0e tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:41.142968 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fe6a753a-19af-4e27-8fc2-4a1684b62f0e tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:41.143284 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fe6a753a-19af-4e27-8fc2-4a1684b62f0e tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:41.173577 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-586669c6-6f4e-4a06-8aad-7b9159e3d96a tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:41.190832 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-586669c6-6f4e-4a06-8aad-7b9159e3d96a tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:41.193084 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-586669c6-6f4e-4a06-8aad-7b9159e3d96a tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:41.194553 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-586669c6-6f4e-4a06-8aad-7b9159e3d96a tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] 10.222.0.43 "GET /compute/v2.1/servers/02a066b4-243b-4fe3-afcf-30f3e9511d1b" status: 200 len: 1875 microversion: 2.42 time: 0.883475 Oct 04 18:55:41.196214 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2583/4872] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:55:40 2022] GET /compute/v2.1/servers/02a066b4-243b-4fe3-afcf-30f3e9511d1b => generated 1875 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:55:41.203291 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-2ac19668-9609-440f-a4cb-d8abc647d290 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:41.204260 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-2ac19668-9609-440f-a4cb-d8abc647d290 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 01e250ab-d9aa-4708-ae36-10c53a411a40] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:41.214944 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2ac19668-9609-440f-a4cb-d8abc647d290 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:41.216077 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2ac19668-9609-440f-a4cb-d8abc647d290 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:41.217469 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2ac19668-9609-440f-a4cb-d8abc647d290 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:41.219714 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2ac19668-9609-440f-a4cb-d8abc647d290 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:41.221371 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2ac19668-9609-440f-a4cb-d8abc647d290 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:41.222261 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2ac19668-9609-440f-a4cb-d8abc647d290 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:41.598938 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-2ac19668-9609-440f-a4cb-d8abc647d290 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f63f1ac147543dab34a28a22eb5936c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1607b30b9f324abaa88aa29e04ef3ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:41.624121 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-2ac19668-9609-440f-a4cb-d8abc647d290 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40" status: 200 len: 1505 microversion: 2.1 time: 0.426584 Oct 04 18:55:41.631102 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2584/4873] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:41 2022] GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40 => generated 1505 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:55:41.655211 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-ee00c33f-73a7-4f5a-a9f7-d3e79ab26738 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:55:41.657901 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-ee00c33f-73a7-4f5a-a9f7-d3e79ab26738 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 01e250ab-d9aa-4708-ae36-10c53a411a40] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:41.675218 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ee00c33f-73a7-4f5a-a9f7-d3e79ab26738 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:41.682207 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ee00c33f-73a7-4f5a-a9f7-d3e79ab26738 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:41.683076 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ee00c33f-73a7-4f5a-a9f7-d3e79ab26738 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:41.684331 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ee00c33f-73a7-4f5a-a9f7-d3e79ab26738 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:41.686180 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ee00c33f-73a7-4f5a-a9f7-d3e79ab26738 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:41.689935 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ee00c33f-73a7-4f5a-a9f7-d3e79ab26738 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:41.729195 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-fe6a753a-19af-4e27-8fc2-4a1684b62f0e tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '486c22456b1e47ae843ae41f8dfb2632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c91c7e7358048ffaaee7f51ad61b515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:41.742024 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-fe6a753a-19af-4e27-8fc2-4a1684b62f0e tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] 10.222.0.43 "GET /compute/v2.1/servers/523fce83-2292-42b0-9b99-c9ac2c48e544" status: 200 len: 1680 microversion: 2.1 time: 0.632168 Oct 04 18:55:41.742973 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2290/4874] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:41 2022] GET /compute/v2.1/servers/523fce83-2292-42b0-9b99-c9ac2c48e544 => generated 1680 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:55:41.754661 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-ee00c33f-73a7-4f5a-a9f7-d3e79ab26738 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] HTTP exception thrown: Cannot 'resume' instance 01e250ab-d9aa-4708-ae36-10c53a411a40 while it is in vm_state active Oct 04 18:55:41.756482 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-ee00c33f-73a7-4f5a-a9f7-d3e79ab26738 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Request method failure captured: Oct 04 18:55:41.756482 n-d-851028-13 devstack@n-api.service[123596]: request: POST /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40/action HTTP/1.1 Oct 04 18:55:41.756482 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:55:41.756482 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:55:41.756482 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:55:41.756482 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 14 Oct 04 18:55:41.756482 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:55:41.756482 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:55:41.756482 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:55:41.756482 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:55:41.756482 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPIEZsAoFcr6P1AMHBWUo8LvryOn1l2-LYSKr4xgLCvHblWFuAiGVlStWcljkgzOc7-ldx7qv3C-2jYmQ32_Zk5yP28dI64Re9CsyHCLmsYfyJdD0-2_kU92lHK36Fs8oXqXU2FijNX-X4IYqe4GjOQDN7LB9zCeEIcrxQ2LRJFOwbQY Oct 04 18:55:41.756482 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:55:41.756482 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:55:41.756482 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:55:41.756482 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:55:41.756482 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:55:41.756482 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:55:41.756482 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: 1607b30b9f324abaa88aa29e04ef3ec4 Oct 04 18:55:41.756482 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-ServersNegativeTestJSON-708693932 Oct 04 18:55:41.756482 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 18:55:41.756482 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 18:55:41.756482 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/1607b30b9f324abaa88aa29e04ef3ec4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_1607b30b9f324abaa88aa29e04ef3ec4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1607b30b9f324abaa88aa29e04ef3ec4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1607b30b9f324abaa88aa29e04ef3ec4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:55:41.756482 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-ServersNegativeTestJSON-708693932 Oct 04 18:55:41.756482 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: 1607b30b9f324abaa88aa29e04ef3ec4 Oct 04 18:55:41.756482 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-ServersNegativeTestJSON-708693932 Oct 04 18:55:41.756482 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-ServersNegativeTestJSON-708693932-project Oct 04 18:55:41.756482 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:55:41.756482 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:55:41.756482 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 6f63f1ac147543dab34a28a22eb5936c Oct 04 18:55:41.756482 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-ServersNegativeTestJSON-708693932-project Oct 04 18:55:41.756482 n-d-851028-13 devstack@n-api.service[123596]: Oct 04 18:55:41.756482 n-d-851028-13 devstack@n-api.service[123596]: {"resume": {}} Oct 04 18:55:41.756482 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 18:55:41.756482 n-d-851028-13 devstack@n-api.service[123596]: exception: Cannot 'resume' instance 01e250ab-d9aa-4708-ae36-10c53a411a40 while it is in vm_state active Oct 04 18:55:41.756482 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': '01e250ab-d9aa-4708-ae36-10c53a411a40', 'body': {'resume': {}}} Oct 04 18:55:41.756482 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:55:41.756482 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:55:41.756482 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 59, in _resume Oct 04 18:55:41.756482 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi self.compute_api.resume(context, server) Oct 04 18:55:41.756482 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 18:55:41.756482 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 18:55:41.756482 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 04 18:55:41.756482 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 18:55:41.756482 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 04 18:55:41.756482 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 04 18:55:41.756482 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 01e250ab-d9aa-4708-ae36-10c53a411a40 in vm_state active. Cannot resume while the instance is in this state. Oct 04 18:55:41.756482 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:55:41.756482 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:55:41.756482 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:55:41.756482 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:55:41.756482 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:55:41.756482 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:55:41.756482 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:55:41.756482 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:55:41.756482 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:55:41.756482 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:55:41.756482 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 63, in _resume Oct 04 18:55:41.756482 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 04 18:55:41.756482 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 04 18:55:41.756482 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 04 18:55:41.756482 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'resume' instance 01e250ab-d9aa-4708-ae36-10c53a411a40 while it is in vm_state active Oct 04 18:55:41.756482 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:55:41.756482 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:55:41.756482 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:55:41.762069 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:55:41.762069 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:55:41.762069 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:55:41.762069 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:55:41.762069 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:55:41.762069 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'resume' instance 01e250ab-d9aa-4708-ae36-10c53a411a40 while it is in vm_state active Oct 04 18:55:41.762069 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:55:41.764652 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-ee00c33f-73a7-4f5a-a9f7-d3e79ab26738 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Returning 409 to user: Cannot 'resume' instance 01e250ab-d9aa-4708-ae36-10c53a411a40 while it is in vm_state active {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:55:41.766031 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-ee00c33f-73a7-4f5a-a9f7-d3e79ab26738 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "POST /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40/action" status: 409 len: 144 microversion: 2.1 time: 0.117055 Oct 04 18:55:41.766886 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2585/4875] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 18:55:41 2022] POST /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40/action => generated 144 bytes in 118 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:55:41.775727 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-6b97c0d2-9dda-4bd8-bbd7-1b2e7a62dd4a tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:41.776357 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-6b97c0d2-9dda-4bd8-bbd7-1b2e7a62dd4a tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 01e250ab-d9aa-4708-ae36-10c53a411a40] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:41.785064 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6b97c0d2-9dda-4bd8-bbd7-1b2e7a62dd4a tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:41.787841 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6b97c0d2-9dda-4bd8-bbd7-1b2e7a62dd4a tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:41.788479 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6b97c0d2-9dda-4bd8-bbd7-1b2e7a62dd4a tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:41.790595 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6b97c0d2-9dda-4bd8-bbd7-1b2e7a62dd4a tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:41.792552 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6b97c0d2-9dda-4bd8-bbd7-1b2e7a62dd4a tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:41.793209 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6b97c0d2-9dda-4bd8-bbd7-1b2e7a62dd4a tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:41.865942 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-5a994f0f-2954-4aca-9f6e-47f985843cd4 tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:41.866583 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-5a994f0f-2954-4aca-9f6e-47f985843cd4 tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] [instance: e20fa332-f87b-47b3-a30c-52716e5e7a45] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:41.875984 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5a994f0f-2954-4aca-9f6e-47f985843cd4 tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:41.876735 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5a994f0f-2954-4aca-9f6e-47f985843cd4 tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:41.877937 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5a994f0f-2954-4aca-9f6e-47f985843cd4 tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:41.879080 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5a994f0f-2954-4aca-9f6e-47f985843cd4 tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:41.879735 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5a994f0f-2954-4aca-9f6e-47f985843cd4 tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:41.880340 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5a994f0f-2954-4aca-9f6e-47f985843cd4 tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:42.584249 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-5a994f0f-2954-4aca-9f6e-47f985843cd4 tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16d1e957e30423e9b06c6150e5c4a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74c55e15cfd4f2c9ce67c9aa91c1b5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:42.596566 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-5a994f0f-2954-4aca-9f6e-47f985843cd4 tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] 10.222.0.43 "GET /compute/v2.1/servers/e20fa332-f87b-47b3-a30c-52716e5e7a45" status: 200 len: 1574 microversion: 2.1 time: 0.737254 Oct 04 18:55:42.624150 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2586/4876] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:41 2022] GET /compute/v2.1/servers/e20fa332-f87b-47b3-a30c-52716e5e7a45 => generated 1574 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:55:42.630229 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-f9d7af14-c09d-4778-ac3b-57764b1f2934 req-5d99a01e-7823-41fd-a3a5-caa240832b79 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e20fa332-f87b-47b3-a30c-52716e5e7a45", "tag": "f6bf9217-ac91-415b-a39c-6ee42946133e"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:55:42.665987 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-f9d7af14-c09d-4778-ac3b-57764b1f2934 req-5d99a01e-7823-41fd-a3a5-caa240832b79 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:42.666746 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-f9d7af14-c09d-4778-ac3b-57764b1f2934 req-5d99a01e-7823-41fd-a3a5-caa240832b79 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:42.667370 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-f9d7af14-c09d-4778-ac3b-57764b1f2934 req-5d99a01e-7823-41fd-a3a5-caa240832b79 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:42.706105 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-6b97c0d2-9dda-4bd8-bbd7-1b2e7a62dd4a tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f63f1ac147543dab34a28a22eb5936c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1607b30b9f324abaa88aa29e04ef3ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:42.717688 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-6b97c0d2-9dda-4bd8-bbd7-1b2e7a62dd4a tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40" status: 200 len: 1505 microversion: 2.1 time: 0.946096 Oct 04 18:55:42.728802 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-f9d7af14-c09d-4778-ac3b-57764b1f2934 req-5d99a01e-7823-41fd-a3a5-caa240832b79 service nova] Creating event network-changed:f6bf9217-ac91-415b-a39c-6ee42946133e for instance e20fa332-f87b-47b3-a30c-52716e5e7a45 on n-h1-851028-13 Oct 04 18:55:42.738747 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-f9d7af14-c09d-4778-ac3b-57764b1f2934 req-5d99a01e-7823-41fd-a3a5-caa240832b79 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112680 Oct 04 18:55:42.742130 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2587/4877] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:55:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:55:42.742842 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2291/4878] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:41 2022] GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40 => generated 1505 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:55:42.759399 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-b0488c8e-ff08-4fd7-ab57-a5f31462003d req-c2ec9b5f-668e-49b2-ae0e-ccda8a7b0366 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02a066b4-243b-4fe3-afcf-30f3e9511d1b", "tag": "41843c67-3f42-40b6-baf0-f90a5f358228"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:55:42.773374 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-7bb85374-8321-49e2-82c3-f01ce916b086 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:42.774121 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-7bb85374-8321-49e2-82c3-f01ce916b086 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] [instance: 02a066b4-243b-4fe3-afcf-30f3e9511d1b] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:42.790217 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-b0488c8e-ff08-4fd7-ab57-a5f31462003d req-c2ec9b5f-668e-49b2-ae0e-ccda8a7b0366 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:42.791104 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-b0488c8e-ff08-4fd7-ab57-a5f31462003d req-c2ec9b5f-668e-49b2-ae0e-ccda8a7b0366 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:42.791737 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-b0488c8e-ff08-4fd7-ab57-a5f31462003d req-c2ec9b5f-668e-49b2-ae0e-ccda8a7b0366 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:42.803762 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7bb85374-8321-49e2-82c3-f01ce916b086 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:42.804277 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7bb85374-8321-49e2-82c3-f01ce916b086 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:42.804730 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7bb85374-8321-49e2-82c3-f01ce916b086 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:42.814889 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7bb85374-8321-49e2-82c3-f01ce916b086 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:42.818252 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7bb85374-8321-49e2-82c3-f01ce916b086 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:42.818839 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7bb85374-8321-49e2-82c3-f01ce916b086 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:42.832266 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-b0488c8e-ff08-4fd7-ab57-a5f31462003d req-c2ec9b5f-668e-49b2-ae0e-ccda8a7b0366 service nova] Creating event network-changed:41843c67-3f42-40b6-baf0-f90a5f358228 for instance 02a066b4-243b-4fe3-afcf-30f3e9511d1b on n-h2-851028-13 Oct 04 18:55:42.854649 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-b0488c8e-ff08-4fd7-ab57-a5f31462003d req-c2ec9b5f-668e-49b2-ae0e-ccda8a7b0366 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109970 Oct 04 18:55:42.856585 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2292/4879] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:55:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:55:42.872137 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-6a76f237-52b0-45e9-afd4-6013c9801998 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:42.875958 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-6a76f237-52b0-45e9-afd4-6013c9801998 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 01e250ab-d9aa-4708-ae36-10c53a411a40] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:42.887223 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6a76f237-52b0-45e9-afd4-6013c9801998 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:42.888160 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6a76f237-52b0-45e9-afd4-6013c9801998 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:42.889091 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6a76f237-52b0-45e9-afd4-6013c9801998 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:42.890370 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6a76f237-52b0-45e9-afd4-6013c9801998 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:42.892286 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6a76f237-52b0-45e9-afd4-6013c9801998 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:42.893090 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6a76f237-52b0-45e9-afd4-6013c9801998 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:43.520855 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-7bb85374-8321-49e2-82c3-f01ce916b086 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:43.539770 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-7bb85374-8321-49e2-82c3-f01ce916b086 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:43.541587 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-7bb85374-8321-49e2-82c3-f01ce916b086 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:43.550539 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-7bb85374-8321-49e2-82c3-f01ce916b086 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] 10.222.0.43 "GET /compute/v2.1/servers/02a066b4-243b-4fe3-afcf-30f3e9511d1b" status: 200 len: 1875 microversion: 2.42 time: 0.805430 Oct 04 18:55:43.569553 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2588/4880] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:55:42 2022] GET /compute/v2.1/servers/02a066b4-243b-4fe3-afcf-30f3e9511d1b => generated 1875 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:55:43.586523 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-95706e07-07ce-4e37-9f86-8819a8204768 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:43.594317 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-95706e07-07ce-4e37-9f86-8819a8204768 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] [instance: 523fce83-2292-42b0-9b99-c9ac2c48e544] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:43.605845 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-95706e07-07ce-4e37-9f86-8819a8204768 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:43.614062 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-95706e07-07ce-4e37-9f86-8819a8204768 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:43.616716 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-95706e07-07ce-4e37-9f86-8819a8204768 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:43.621563 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-95706e07-07ce-4e37-9f86-8819a8204768 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:43.624858 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-95706e07-07ce-4e37-9f86-8819a8204768 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:43.626812 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-95706e07-07ce-4e37-9f86-8819a8204768 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:43.972569 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-95706e07-07ce-4e37-9f86-8819a8204768 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '486c22456b1e47ae843ae41f8dfb2632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c91c7e7358048ffaaee7f51ad61b515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:43.983337 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-95706e07-07ce-4e37-9f86-8819a8204768 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] 10.222.0.43 "GET /compute/v2.1/servers/523fce83-2292-42b0-9b99-c9ac2c48e544" status: 200 len: 1613 microversion: 2.1 time: 0.412291 Oct 04 18:55:43.988150 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2589/4881] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:43 2022] GET /compute/v2.1/servers/523fce83-2292-42b0-9b99-c9ac2c48e544 => generated 1613 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:55:44.525651 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-6a76f237-52b0-45e9-afd4-6013c9801998 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f63f1ac147543dab34a28a22eb5936c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1607b30b9f324abaa88aa29e04ef3ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:44.539216 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-6a76f237-52b0-45e9-afd4-6013c9801998 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40" status: 200 len: 1505 microversion: 2.1 time: 1.681160 Oct 04 18:55:44.539835 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2293/4882] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:42 2022] GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40 => generated 1505 bytes in 1683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:55:44.586855 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-9db5fd99-3ddb-42fa-a184-f3fabfca66d2 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:44.588445 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-9db5fd99-3ddb-42fa-a184-f3fabfca66d2 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] [instance: 02a066b4-243b-4fe3-afcf-30f3e9511d1b] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:44.602652 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9db5fd99-3ddb-42fa-a184-f3fabfca66d2 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:44.604359 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9db5fd99-3ddb-42fa-a184-f3fabfca66d2 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:44.604864 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9db5fd99-3ddb-42fa-a184-f3fabfca66d2 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:44.606906 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9db5fd99-3ddb-42fa-a184-f3fabfca66d2 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:44.608350 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9db5fd99-3ddb-42fa-a184-f3fabfca66d2 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:44.610283 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9db5fd99-3ddb-42fa-a184-f3fabfca66d2 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:44.819874 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-9c49880b-bc52-42b7-93b0-ca7e60ea8c1e tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452", "networks": [{"uuid": "66b6832b-a1b2-4da9-addc-63f223a4cc5a"}]}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:55:44.824486 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-9c49880b-bc52-42b7-93b0-ca7e60ea8c1e tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Request method failure captured: Oct 04 18:55:44.824486 n-d-851028-13 devstack@n-api.service[123595]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 18:55:44.824486 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 18:55:44.824486 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 18:55:44.824486 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 18:55:44.824486 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 160 Oct 04 18:55:44.824486 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 18:55:44.824486 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 18:55:44.824486 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 18:55:44.824486 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 18:55:44.824486 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPIEZsAoFcr6P1AMHBWUo8LvryOn1l2-LYSKr4xgLCvHblWFuAiGVlStWcljkgzOc7-ldx7qv3C-2jYmQ32_Zk5yP28dI64Re9CsyHCLmsYfyJdD0-2_kU92lHK36Fs8oXqXU2FijNX-X4IYqe4GjOQDN7LB9zCeEIcrxQ2LRJFOwbQY Oct 04 18:55:44.824486 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 18:55:44.824486 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 18:55:44.824486 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 18:55:44.824486 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 18:55:44.824486 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 18:55:44.824486 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 18:55:44.824486 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: 1607b30b9f324abaa88aa29e04ef3ec4 Oct 04 18:55:44.824486 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-ServersNegativeTestJSON-708693932 Oct 04 18:55:44.824486 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 18:55:44.824486 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 18:55:44.824486 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/1607b30b9f324abaa88aa29e04ef3ec4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_1607b30b9f324abaa88aa29e04ef3ec4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1607b30b9f324abaa88aa29e04ef3ec4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1607b30b9f324abaa88aa29e04ef3ec4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:55:44.824486 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-ServersNegativeTestJSON-708693932 Oct 04 18:55:44.824486 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: 1607b30b9f324abaa88aa29e04ef3ec4 Oct 04 18:55:44.824486 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-ServersNegativeTestJSON-708693932 Oct 04 18:55:44.824486 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-ServersNegativeTestJSON-708693932-project Oct 04 18:55:44.824486 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 18:55:44.824486 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 18:55:44.824486 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: 6f63f1ac147543dab34a28a22eb5936c Oct 04 18:55:44.824486 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-ServersNegativeTestJSON-708693932-project Oct 04 18:55:44.824486 n-d-851028-13 devstack@n-api.service[123595]: Oct 04 18:55:44.824486 n-d-851028-13 devstack@n-api.service[123595]: {"server": {"name": "", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452", "networks": [{"uuid": "66b6832b-a1b2-4da9-addc-63f223a4cc5a"}]}} Oct 04 18:55:44.824486 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 18:55:44.824486 n-d-851028-13 devstack@n-api.service[123595]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 04 18:55:44.824486 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'body': {'server': {'name': '', 'imageRef': 'e8943ec5-4038-4d4b-b9b9-2415a79f5243', 'flavorRef': '452', 'networks': [{'uuid': '66b6832b-a1b2-4da9-addc-63f223a4cc5a'}]}}} Oct 04 18:55:44.824486 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:55:44.824486 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:55:44.824486 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:55:44.824486 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:55:44.824486 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:55:44.824486 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:55:44.824486 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 04 18:55:44.824486 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:55:44.824486 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Oct 04 18:55:44.824486 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 04 18:55:44.824486 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:55:44.824486 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 04 18:55:44.824486 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi '' Oct 04 18:55:44.824486 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:55:44.824486 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:55:44.824486 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:55:44.824486 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:55:44.824486 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:55:44.824486 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:55:44.824486 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:55:44.824486 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:55:44.824486 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:55:44.824486 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:55:44.824486 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:55:44.824486 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:55:44.824486 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 18:55:44.824486 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 18:55:44.824486 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:55:44.824486 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:55:44.824486 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:55:44.830341 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:55:44.830341 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 04 18:55:44.830341 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:55:44.830341 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:55:44.830341 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:55:44.830341 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:55:44.830341 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:55:44.830341 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:55:44.830341 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:55:44.830341 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:55:44.830341 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 04 18:55:44.830341 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:55:44.835464 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-9c49880b-bc52-42b7-93b0-ca7e60ea8c1e tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:55:44.836540 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-9c49880b-bc52-42b7-93b0-ca7e60ea8c1e tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.021662 Oct 04 18:55:44.838194 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2294/4883] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 18:55:44 2022] POST /compute/v2.1/servers => generated 108 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:55:44.857568 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-f6effd40-d334-4a4b-93bc-6e646afc9e5a tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:44.860224 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-f6effd40-d334-4a4b-93bc-6e646afc9e5a tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 01e250ab-d9aa-4708-ae36-10c53a411a40] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:44.878152 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f6effd40-d334-4a4b-93bc-6e646afc9e5a tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:44.881214 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f6effd40-d334-4a4b-93bc-6e646afc9e5a tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:44.882193 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f6effd40-d334-4a4b-93bc-6e646afc9e5a tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:44.884531 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f6effd40-d334-4a4b-93bc-6e646afc9e5a tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:44.887264 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f6effd40-d334-4a4b-93bc-6e646afc9e5a tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:44.888121 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f6effd40-d334-4a4b-93bc-6e646afc9e5a tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:45.188512 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-9db5fd99-3ddb-42fa-a184-f3fabfca66d2 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:45.207498 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-9db5fd99-3ddb-42fa-a184-f3fabfca66d2 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:45.214804 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-9db5fd99-3ddb-42fa-a184-f3fabfca66d2 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:45.220622 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-9db5fd99-3ddb-42fa-a184-f3fabfca66d2 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] 10.222.0.43 "GET /compute/v2.1/servers/02a066b4-243b-4fe3-afcf-30f3e9511d1b" status: 200 len: 1875 microversion: 2.42 time: 0.635304 Oct 04 18:55:45.222097 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2590/4884] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:55:44 2022] GET /compute/v2.1/servers/02a066b4-243b-4fe3-afcf-30f3e9511d1b => generated 1875 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:55:45.232421 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-637f2c5a-5a55-4c29-a8e5-b3a644c534d8 req-c219c857-078b-45c7-946f-bf028667a6f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "523fce83-2292-42b0-9b99-c9ac2c48e544", "name": "network-vif-deleted", "tag": "1a8e604e-bf22-40c8-b5c0-f1df67aebd3a"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:55:45.255375 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-637f2c5a-5a55-4c29-a8e5-b3a644c534d8 req-c219c857-078b-45c7-946f-bf028667a6f0 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:45.260083 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-637f2c5a-5a55-4c29-a8e5-b3a644c534d8 req-c219c857-078b-45c7-946f-bf028667a6f0 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:45.260973 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-637f2c5a-5a55-4c29-a8e5-b3a644c534d8 req-c219c857-078b-45c7-946f-bf028667a6f0 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:45.302354 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-637f2c5a-5a55-4c29-a8e5-b3a644c534d8 req-c219c857-078b-45c7-946f-bf028667a6f0 service nova] Creating event network-vif-deleted:1a8e604e-bf22-40c8-b5c0-f1df67aebd3a for instance 523fce83-2292-42b0-9b99-c9ac2c48e544 on n-h1-851028-13 Oct 04 18:55:45.317631 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-637f2c5a-5a55-4c29-a8e5-b3a644c534d8 req-c219c857-078b-45c7-946f-bf028667a6f0 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092237 Oct 04 18:55:45.320035 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2591/4885] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:55:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:55:45.334561 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-7041f7b5-91d6-4995-9053-a38cc7c591a2 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:45.335300 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-7041f7b5-91d6-4995-9053-a38cc7c591a2 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] [instance: 523fce83-2292-42b0-9b99-c9ac2c48e544] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:45.350674 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7041f7b5-91d6-4995-9053-a38cc7c591a2 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:45.360331 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7041f7b5-91d6-4995-9053-a38cc7c591a2 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:45.361405 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7041f7b5-91d6-4995-9053-a38cc7c591a2 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:45.362293 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7041f7b5-91d6-4995-9053-a38cc7c591a2 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:45.365920 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7041f7b5-91d6-4995-9053-a38cc7c591a2 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:45.366608 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7041f7b5-91d6-4995-9053-a38cc7c591a2 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:45.413775 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-7041f7b5-91d6-4995-9053-a38cc7c591a2 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] HTTP exception thrown: Instance 523fce83-2292-42b0-9b99-c9ac2c48e544 could not be found. Oct 04 18:55:45.418781 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-7041f7b5-91d6-4995-9053-a38cc7c591a2 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Request method failure captured: Oct 04 18:55:45.418781 n-d-851028-13 devstack@n-api.service[123596]: request: GET /compute/v2.1/servers/523fce83-2292-42b0-9b99-c9ac2c48e544 HTTP/1.1 Oct 04 18:55:45.418781 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:55:45.418781 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:55:45.418781 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:55:45.418781 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 18:55:45.418781 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:55:45.418781 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:55:45.418781 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:55:45.418781 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:55:45.418781 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPID78vmCI9IDPSneDizdTNDV6DvHA8Yu-0Hk2AdriQTEcsN9glvSb6qnq0IhhwuZEnTcyOqvR3DmN0AjQb3MXy0KeUN-iyujvPMDrfVKCEbIzKf9nHEoBLFpzOTLVQVrEHVpIwmUAw_LxUeBUjShHQb88Tzo0W7pmPF365n3rwKGYEI Oct 04 18:55:45.418781 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:55:45.418781 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:55:45.418781 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:55:45.418781 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:55:45.418781 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:55:45.418781 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:55:45.418781 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: 6c91c7e7358048ffaaee7f51ad61b515 Oct 04 18:55:45.418781 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-AttachVolumeNegativeTest-2048626205 Oct 04 18:55:45.418781 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 18:55:45.418781 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 18:55:45.418781 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/6c91c7e7358048ffaaee7f51ad61b515"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_6c91c7e7358048ffaaee7f51ad61b515"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/6c91c7e7358048ffaaee7f51ad61b515"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/6c91c7e7358048ffaaee7f51ad61b515"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:55:45.418781 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-AttachVolumeNegativeTest-2048626205 Oct 04 18:55:45.418781 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: 6c91c7e7358048ffaaee7f51ad61b515 Oct 04 18:55:45.418781 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2048626205 Oct 04 18:55:45.418781 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-AttachVolumeNegativeTest-2048626205-project Oct 04 18:55:45.418781 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:55:45.418781 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:55:45.418781 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 486c22456b1e47ae843ae41f8dfb2632 Oct 04 18:55:45.418781 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-AttachVolumeNegativeTest-2048626205-project Oct 04 18:55:45.418781 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 18:55:45.418781 n-d-851028-13 devstack@n-api.service[123596]: exception: Instance 523fce83-2292-42b0-9b99-c9ac2c48e544 could not be found. Oct 04 18:55:45.418781 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': '523fce83-2292-42b0-9b99-c9ac2c48e544'} Oct 04 18:55:45.418781 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:55:45.418781 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:55:45.418781 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:55:45.418781 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:55:45.418781 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:55:45.418781 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:55:45.418781 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:55:45.418781 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:55:45.418781 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:55:45.418781 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:55:45.418781 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 523fce83-2292-42b0-9b99-c9ac2c48e544 could not be found. Oct 04 18:55:45.418781 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:55:45.418781 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:55:45.418781 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:55:45.418781 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:55:45.418781 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:55:45.418781 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:55:45.418781 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:55:45.418781 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:55:45.418781 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:55:45.418781 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:55:45.418781 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:55:45.418781 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:55:45.418781 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:55:45.418781 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:55:45.418781 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:55:45.418781 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:55:45.418781 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 523fce83-2292-42b0-9b99-c9ac2c48e544 could not be found. Oct 04 18:55:45.418781 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:55:45.418781 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:55:45.418781 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:55:45.424327 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:55:45.424327 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:55:45.424327 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:55:45.424327 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:55:45.424327 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:55:45.424327 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 523fce83-2292-42b0-9b99-c9ac2c48e544 could not be found. Oct 04 18:55:45.424327 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:55:45.429081 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-7041f7b5-91d6-4995-9053-a38cc7c591a2 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Returning 404 to user: Instance 523fce83-2292-42b0-9b99-c9ac2c48e544 could not be found. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:55:45.429081 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-7041f7b5-91d6-4995-9053-a38cc7c591a2 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] 10.222.0.43 "GET /compute/v2.1/servers/523fce83-2292-42b0-9b99-c9ac2c48e544" status: 404 len: 111 microversion: 2.1 time: 0.107101 Oct 04 18:55:45.433997 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2592/4886] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:45 2022] GET /compute/v2.1/servers/523fce83-2292-42b0-9b99-c9ac2c48e544 => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:55:45.448070 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-02c2ec64-de73-4877-a24c-a82690a43e7e tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1008258013", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452", "networks": [{"uuid": "3ed21dbf-04d5-4319-be25-7d1b6c6f5080"}]}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:55:45.574933 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.network.neutron [None req-02c2ec64-de73-4877-a24c-a82690a43e7e tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] validate_networks() for [('3ed21dbf-04d5-4319-be25-7d1b6c6f5080', None, None, None, None, None)] {{(pid=123596) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:55:45.811143 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-f6effd40-d334-4a4b-93bc-6e646afc9e5a tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f63f1ac147543dab34a28a22eb5936c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1607b30b9f324abaa88aa29e04ef3ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:45.855954 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-f6effd40-d334-4a4b-93bc-6e646afc9e5a tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40" status: 200 len: 1505 microversion: 2.1 time: 1.007015 Oct 04 18:55:45.858070 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2295/4887] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:44 2022] GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40 => generated 1505 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:55:45.867942 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-25366365-5392-4381-b0df-ef3678033856 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Calling method '.version_select at 0x7fb21fc31790>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:45.952383 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-25366365-5392-4381-b0df-ef3678033856 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-124740521" status: 202 len: 0 microversion: 2.1 time: 0.092198 Oct 04 18:55:45.954517 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2296/4888] 10.222.0.43 () {58 vars in 1218 bytes} [Tue Oct 4 18:55:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-124740521 => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:55:45.967153 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-83db424b-2e17-4c53-8841-8229075ac0e9 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:45.980642 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-83db424b-2e17-4c53-8841-8229075ac0e9 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 01e250ab-d9aa-4708-ae36-10c53a411a40] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:45.994722 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-83db424b-2e17-4c53-8841-8229075ac0e9 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:45.995559 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-83db424b-2e17-4c53-8841-8229075ac0e9 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:45.996183 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-83db424b-2e17-4c53-8841-8229075ac0e9 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:46.001991 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-83db424b-2e17-4c53-8841-8229075ac0e9 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:46.002679 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-83db424b-2e17-4c53-8841-8229075ac0e9 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:46.003980 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-83db424b-2e17-4c53-8841-8229075ac0e9 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:46.755796 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-02c2ec64-de73-4877-a24c-a82690a43e7e tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Flavor limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:55:46.756342 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-02c2ec64-de73-4877-a24c-a82690a43e7e tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Image limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:55:46.756846 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-02c2ec64-de73-4877-a24c-a82690a43e7e tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Flavor pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:55:46.757346 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-02c2ec64-de73-4877-a24c-a82690a43e7e tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Image pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:55:46.757934 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-02c2ec64-de73-4877-a24c-a82690a43e7e tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:55:46.775101 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-02c2ec64-de73-4877-a24c-a82690a43e7e tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:46.775823 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-02c2ec64-de73-4877-a24c-a82690a43e7e tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:46.776455 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-02c2ec64-de73-4877-a24c-a82690a43e7e tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:46.777866 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-02c2ec64-de73-4877-a24c-a82690a43e7e tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:46.781710 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-02c2ec64-de73-4877-a24c-a82690a43e7e tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:46.782373 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-02c2ec64-de73-4877-a24c-a82690a43e7e tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:46.826542 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-02c2ec64-de73-4877-a24c-a82690a43e7e tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Getting quotas for project 0c1e7be678b94918a8c9436a3a25eb67. Resources: {'ram', 'cores', 'instances'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:55:46.837273 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-02c2ec64-de73-4877-a24c-a82690a43e7e tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Getting quotas for user a9480713a3884233bd28a7986e9a5baf and project 0c1e7be678b94918a8c9436a3a25eb67. Resources: {'ram', 'cores', 'instances'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:55:46.851935 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-02c2ec64-de73-4877-a24c-a82690a43e7e tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Going to run 1 instances... {{(pid=123596) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:55:46.855263 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-02c2ec64-de73-4877-a24c-a82690a43e7e tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] [instance: f16f7c94-16bc-469b-8b4a-427494496547] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e8943ec5-4038-4d4b-b9b9-2415a79f5243',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123596) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:55:46.881687 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-83db424b-2e17-4c53-8841-8229075ac0e9 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f63f1ac147543dab34a28a22eb5936c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1607b30b9f324abaa88aa29e04ef3ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:46.893516 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-83db424b-2e17-4c53-8841-8229075ac0e9 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40" status: 200 len: 1505 microversion: 2.1 time: 0.937437 Oct 04 18:55:46.901272 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2297/4889] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:45 2022] GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40 => generated 1505 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:55:46.907250 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-a38f5ddd-e72a-419d-88a9-7c7a867c29a0 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:46.924169 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-a38f5ddd-e72a-419d-88a9-7c7a867c29a0 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] [instance: 02a066b4-243b-4fe3-afcf-30f3e9511d1b] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:46.931937 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a38f5ddd-e72a-419d-88a9-7c7a867c29a0 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:46.932873 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a38f5ddd-e72a-419d-88a9-7c7a867c29a0 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:46.933594 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a38f5ddd-e72a-419d-88a9-7c7a867c29a0 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:46.934611 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a38f5ddd-e72a-419d-88a9-7c7a867c29a0 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:46.936960 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-02c2ec64-de73-4877-a24c-a82690a43e7e tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.501508 Oct 04 18:55:46.938416 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a38f5ddd-e72a-419d-88a9-7c7a867c29a0 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:46.938907 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2593/4890] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 18:55:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 1504 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:55:46.939321 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a38f5ddd-e72a-419d-88a9-7c7a867c29a0 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:46.950144 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-81cbf714-f592-4f95-83a2-cee29b248637 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:55:46.955558 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-81cbf714-f592-4f95-83a2-cee29b248637 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: c557a8ce-dd88-4a72-9601-f13456fad846] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:46.972376 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-81cbf714-f592-4f95-83a2-cee29b248637 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] HTTP exception thrown: Instance c557a8ce-dd88-4a72-9601-f13456fad846 could not be found. Oct 04 18:55:46.976359 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-81cbf714-f592-4f95-83a2-cee29b248637 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Request method failure captured: Oct 04 18:55:46.976359 n-d-851028-13 devstack@n-api.service[123596]: request: POST /compute/v2.1/servers/c557a8ce-dd88-4a72-9601-f13456fad846/action HTTP/1.1 Oct 04 18:55:46.976359 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:55:46.976359 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:55:46.976359 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:55:46.976359 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 14 Oct 04 18:55:46.976359 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:55:46.976359 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:55:46.976359 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:55:46.976359 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:55:46.976359 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPIEZsAoFcr6P1AMHBWUo8LvryOn1l2-LYSKr4xgLCvHblWFuAiGVlStWcljkgzOc7-ldx7qv3C-2jYmQ32_Zk5yP28dI64Re9CsyHCLmsYfyJdD0-2_kU92lHK36Fs8oXqXU2FijNX-X4IYqe4GjOQDN7LB9zCeEIcrxQ2LRJFOwbQY Oct 04 18:55:46.976359 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:55:46.976359 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:55:46.976359 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:55:46.976359 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:55:46.976359 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:55:46.976359 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:55:46.976359 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: 1607b30b9f324abaa88aa29e04ef3ec4 Oct 04 18:55:46.976359 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-ServersNegativeTestJSON-708693932 Oct 04 18:55:46.976359 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 18:55:46.976359 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 18:55:46.976359 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/1607b30b9f324abaa88aa29e04ef3ec4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_1607b30b9f324abaa88aa29e04ef3ec4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1607b30b9f324abaa88aa29e04ef3ec4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1607b30b9f324abaa88aa29e04ef3ec4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:55:46.976359 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-ServersNegativeTestJSON-708693932 Oct 04 18:55:46.976359 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: 1607b30b9f324abaa88aa29e04ef3ec4 Oct 04 18:55:46.976359 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-ServersNegativeTestJSON-708693932 Oct 04 18:55:46.976359 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-ServersNegativeTestJSON-708693932-project Oct 04 18:55:46.976359 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:55:46.976359 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:55:46.976359 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 6f63f1ac147543dab34a28a22eb5936c Oct 04 18:55:46.976359 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-ServersNegativeTestJSON-708693932-project Oct 04 18:55:46.976359 n-d-851028-13 devstack@n-api.service[123596]: Oct 04 18:55:46.976359 n-d-851028-13 devstack@n-api.service[123596]: {"shelve": {}} Oct 04 18:55:46.976359 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 18:55:46.976359 n-d-851028-13 devstack@n-api.service[123596]: exception: Instance c557a8ce-dd88-4a72-9601-f13456fad846 could not be found. Oct 04 18:55:46.976359 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': 'c557a8ce-dd88-4a72-9601-f13456fad846', 'body': {'shelve': {}}} Oct 04 18:55:46.976359 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:55:46.976359 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:55:46.976359 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:55:46.976359 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:55:46.976359 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:55:46.976359 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:55:46.976359 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 18:55:46.976359 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 18:55:46.976359 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c557a8ce-dd88-4a72-9601-f13456fad846 could not be found. Oct 04 18:55:46.976359 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:55:46.976359 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:55:46.976359 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:55:46.976359 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:55:46.976359 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:55:46.976359 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:55:46.976359 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:55:46.976359 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:55:46.976359 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:55:46.976359 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:55:46.976359 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 44, in _shelve Oct 04 18:55:46.976359 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 04 18:55:46.976359 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:55:46.976359 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:55:46.976359 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c557a8ce-dd88-4a72-9601-f13456fad846 could not be found. Oct 04 18:55:46.976359 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:55:46.976359 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:55:46.976359 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:55:46.976359 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:55:46.976359 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:55:46.976359 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:55:46.982545 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:55:46.982545 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:55:46.982545 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c557a8ce-dd88-4a72-9601-f13456fad846 could not be found. Oct 04 18:55:46.982545 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:55:46.987746 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-81cbf714-f592-4f95-83a2-cee29b248637 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Returning 404 to user: Instance c557a8ce-dd88-4a72-9601-f13456fad846 could not be found. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:55:46.990546 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-81cbf714-f592-4f95-83a2-cee29b248637 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "POST /compute/v2.1/servers/c557a8ce-dd88-4a72-9601-f13456fad846/action" status: 404 len: 111 microversion: 2.1 time: 0.048783 Oct 04 18:55:46.992035 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2594/4891] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 18:55:46 2022] POST /compute/v2.1/servers/c557a8ce-dd88-4a72-9601-f13456fad846/action => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:55:46.999432 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-804131f2-7ac9-49c8-af6c-8b1fe56001c7 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:47.000725 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-804131f2-7ac9-49c8-af6c-8b1fe56001c7 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] [instance: f16f7c94-16bc-469b-8b4a-427494496547] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:47.311994 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-804131f2-7ac9-49c8-af6c-8b1fe56001c7 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9480713a3884233bd28a7986e9a5baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1e7be678b94918a8c9436a3a25eb67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:47.329919 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-804131f2-7ac9-49c8-af6c-8b1fe56001c7 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] 10.222.0.43 "GET /compute/v2.1/servers/f16f7c94-16bc-469b-8b4a-427494496547" status: 200 len: 1214 microversion: 2.1 time: 0.336494 Oct 04 18:55:47.330526 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2595/4892] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:46 2022] GET /compute/v2.1/servers/f16f7c94-16bc-469b-8b4a-427494496547 => generated 1214 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:55:47.335435 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-2853e11c-d8e7-45e9-a67e-043c12cc8d1b tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:47.336056 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-2853e11c-d8e7-45e9-a67e-043c12cc8d1b tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 01e250ab-d9aa-4708-ae36-10c53a411a40] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:47.352849 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2853e11c-d8e7-45e9-a67e-043c12cc8d1b tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:47.353469 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2853e11c-d8e7-45e9-a67e-043c12cc8d1b tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:47.356836 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2853e11c-d8e7-45e9-a67e-043c12cc8d1b tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:47.356836 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2853e11c-d8e7-45e9-a67e-043c12cc8d1b tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:47.356836 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2853e11c-d8e7-45e9-a67e-043c12cc8d1b tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:47.357190 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2853e11c-d8e7-45e9-a67e-043c12cc8d1b tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:47.702421 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-a38f5ddd-e72a-419d-88a9-7c7a867c29a0 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:47.732497 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-a38f5ddd-e72a-419d-88a9-7c7a867c29a0 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:47.741399 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-a38f5ddd-e72a-419d-88a9-7c7a867c29a0 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:47.746142 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-a38f5ddd-e72a-419d-88a9-7c7a867c29a0 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] 10.222.0.43 "GET /compute/v2.1/servers/02a066b4-243b-4fe3-afcf-30f3e9511d1b" status: 200 len: 1875 microversion: 2.42 time: 0.842280 Oct 04 18:55:47.749094 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2298/4893] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:55:46 2022] GET /compute/v2.1/servers/02a066b4-243b-4fe3-afcf-30f3e9511d1b => generated 1875 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:55:47.757315 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-a8ec6ff8-a116-44eb-a14f-081b874605dd req-48fb9d49-8baf-44e8-92d1-bc63860210d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02a066b4-243b-4fe3-afcf-30f3e9511d1b", "tag": "d761be9f-2b1b-4049-b17f-6cf13693728c"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:55:47.774805 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-a8ec6ff8-a116-44eb-a14f-081b874605dd req-48fb9d49-8baf-44e8-92d1-bc63860210d7 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:47.775559 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-a8ec6ff8-a116-44eb-a14f-081b874605dd req-48fb9d49-8baf-44e8-92d1-bc63860210d7 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:47.776334 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-a8ec6ff8-a116-44eb-a14f-081b874605dd req-48fb9d49-8baf-44e8-92d1-bc63860210d7 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:47.795009 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-a8ec6ff8-a116-44eb-a14f-081b874605dd req-48fb9d49-8baf-44e8-92d1-bc63860210d7 service nova] Creating event network-changed:d761be9f-2b1b-4049-b17f-6cf13693728c for instance 02a066b4-243b-4fe3-afcf-30f3e9511d1b on n-h2-851028-13 Oct 04 18:55:47.807614 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-a8ec6ff8-a116-44eb-a14f-081b874605dd req-48fb9d49-8baf-44e8-92d1-bc63860210d7 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053824 Oct 04 18:55:47.810652 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2299/4894] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:55:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:55:48.289807 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-2853e11c-d8e7-45e9-a67e-043c12cc8d1b tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f63f1ac147543dab34a28a22eb5936c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1607b30b9f324abaa88aa29e04ef3ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:48.313257 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-2853e11c-d8e7-45e9-a67e-043c12cc8d1b tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40" status: 200 len: 1505 microversion: 2.1 time: 0.980742 Oct 04 18:55:48.337533 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2596/4895] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:47 2022] GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40 => generated 1505 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:55:48.356221 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-920b7942-fed8-4527-9b09-06c3b85147bf tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:48.357455 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-2a7ef648-8fc0-4218-a339-6f347c16aee8 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:48.357854 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-920b7942-fed8-4527-9b09-06c3b85147bf tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 01e250ab-d9aa-4708-ae36-10c53a411a40] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:48.358077 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-2a7ef648-8fc0-4218-a339-6f347c16aee8 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] [instance: f16f7c94-16bc-469b-8b4a-427494496547] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:48.373019 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-920b7942-fed8-4527-9b09-06c3b85147bf tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:48.377631 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2a7ef648-8fc0-4218-a339-6f347c16aee8 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:48.378256 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-920b7942-fed8-4527-9b09-06c3b85147bf tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:48.378647 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2a7ef648-8fc0-4218-a339-6f347c16aee8 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:48.378933 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-920b7942-fed8-4527-9b09-06c3b85147bf tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:48.379460 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2a7ef648-8fc0-4218-a339-6f347c16aee8 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:48.380363 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2a7ef648-8fc0-4218-a339-6f347c16aee8 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:48.381013 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2a7ef648-8fc0-4218-a339-6f347c16aee8 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:48.381602 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-920b7942-fed8-4527-9b09-06c3b85147bf tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:48.381812 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2a7ef648-8fc0-4218-a339-6f347c16aee8 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:48.382300 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-920b7942-fed8-4527-9b09-06c3b85147bf tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:48.384199 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-920b7942-fed8-4527-9b09-06c3b85147bf tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:48.854437 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-2a7ef648-8fc0-4218-a339-6f347c16aee8 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9480713a3884233bd28a7986e9a5baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1e7be678b94918a8c9436a3a25eb67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:48.870572 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-2a7ef648-8fc0-4218-a339-6f347c16aee8 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] 10.222.0.43 "GET /compute/v2.1/servers/f16f7c94-16bc-469b-8b4a-427494496547" status: 200 len: 1266 microversion: 2.1 time: 0.516904 Oct 04 18:55:48.876959 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2597/4896] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:48 2022] GET /compute/v2.1/servers/f16f7c94-16bc-469b-8b4a-427494496547 => generated 1266 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:55:48.901885 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-60783ea1-24ef-4cc8-ba80-8d93884c9bd1 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:48.912715 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-60783ea1-24ef-4cc8-ba80-8d93884c9bd1 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] [instance: 02a066b4-243b-4fe3-afcf-30f3e9511d1b] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:48.931370 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-60783ea1-24ef-4cc8-ba80-8d93884c9bd1 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:48.932423 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-60783ea1-24ef-4cc8-ba80-8d93884c9bd1 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:48.933333 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-60783ea1-24ef-4cc8-ba80-8d93884c9bd1 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:48.935100 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-60783ea1-24ef-4cc8-ba80-8d93884c9bd1 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:48.935981 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-60783ea1-24ef-4cc8-ba80-8d93884c9bd1 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:48.936757 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-60783ea1-24ef-4cc8-ba80-8d93884c9bd1 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:48.980357 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-920b7942-fed8-4527-9b09-06c3b85147bf tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f63f1ac147543dab34a28a22eb5936c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1607b30b9f324abaa88aa29e04ef3ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:48.998074 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-920b7942-fed8-4527-9b09-06c3b85147bf tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40" status: 200 len: 1505 microversion: 2.1 time: 0.649463 Oct 04 18:55:48.998666 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2300/4897] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:48 2022] GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40 => generated 1505 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:55:49.033790 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-38baf416-62ce-4560-a77c-9b841415039c tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:55:49.035176 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-38baf416-62ce-4560-a77c-9b841415039c tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 01e250ab-d9aa-4708-ae36-10c53a411a40] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:49.050151 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-38baf416-62ce-4560-a77c-9b841415039c tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:49.051565 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-38baf416-62ce-4560-a77c-9b841415039c tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:49.052614 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-38baf416-62ce-4560-a77c-9b841415039c tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:49.057166 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-38baf416-62ce-4560-a77c-9b841415039c tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:49.061586 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-38baf416-62ce-4560-a77c-9b841415039c tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:49.066492 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-38baf416-62ce-4560-a77c-9b841415039c tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:49.122625 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.objects.instance [None req-38baf416-62ce-4560-a77c-9b841415039c tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lazy-loading 'flavor' on Instance uuid 01e250ab-d9aa-4708-ae36-10c53a411a40 {{(pid=123595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:55:49.273144 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:55:49.493611 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-38baf416-62ce-4560-a77c-9b841415039c tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "POST /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40/action" status: 202 len: 0 microversion: 2.1 time: 0.465082 Oct 04 18:55:49.497744 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2301/4898] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 18:55:49 2022] POST /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40/action => generated 0 bytes in 470 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:55:49.511675 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-0131b6e1-ee3e-4be4-977a-c68749bb3db5 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:49.521379 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-0131b6e1-ee3e-4be4-977a-c68749bb3db5 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 01e250ab-d9aa-4708-ae36-10c53a411a40] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:49.536462 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0131b6e1-ee3e-4be4-977a-c68749bb3db5 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:49.537324 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0131b6e1-ee3e-4be4-977a-c68749bb3db5 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:49.538007 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0131b6e1-ee3e-4be4-977a-c68749bb3db5 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:49.539114 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0131b6e1-ee3e-4be4-977a-c68749bb3db5 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:49.539903 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0131b6e1-ee3e-4be4-977a-c68749bb3db5 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:49.540576 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0131b6e1-ee3e-4be4-977a-c68749bb3db5 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:49.724773 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-60783ea1-24ef-4cc8-ba80-8d93884c9bd1 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:49.735073 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-60783ea1-24ef-4cc8-ba80-8d93884c9bd1 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:49.743819 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-60783ea1-24ef-4cc8-ba80-8d93884c9bd1 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:49.745376 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-60783ea1-24ef-4cc8-ba80-8d93884c9bd1 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] 10.222.0.43 "GET /compute/v2.1/servers/02a066b4-243b-4fe3-afcf-30f3e9511d1b" status: 200 len: 1875 microversion: 2.42 time: 0.866840 Oct 04 18:55:49.748226 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2598/4899] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:55:48 2022] GET /compute/v2.1/servers/02a066b4-243b-4fe3-afcf-30f3e9511d1b => generated 1875 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:55:49.762317 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-b4bfc1d4-92ad-4b42-a5f6-7deb614cf935 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:49.762825 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-b4bfc1d4-92ad-4b42-a5f6-7deb614cf935 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] [instance: bc5eda7f-851f-44d8-af95-5e721dd6d52b] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:49.779057 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b4bfc1d4-92ad-4b42-a5f6-7deb614cf935 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:49.779574 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b4bfc1d4-92ad-4b42-a5f6-7deb614cf935 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:49.780022 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b4bfc1d4-92ad-4b42-a5f6-7deb614cf935 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:49.780749 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b4bfc1d4-92ad-4b42-a5f6-7deb614cf935 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:49.781305 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b4bfc1d4-92ad-4b42-a5f6-7deb614cf935 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:49.781744 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b4bfc1d4-92ad-4b42-a5f6-7deb614cf935 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:49.993786 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.objects.instance [None req-b4bfc1d4-92ad-4b42-a5f6-7deb614cf935 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lazy-loading 'services' on Instance uuid bc5eda7f-851f-44d8-af95-5e721dd6d52b {{(pid=123596) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:55:50.122166 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-b4bfc1d4-92ad-4b42-a5f6-7deb614cf935 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] 10.222.0.43 "DELETE /compute/v2.1/servers/bc5eda7f-851f-44d8-af95-5e721dd6d52b/os-volume_attachments/b58125c2-399b-4901-ab14-2b7cf4f8fae7" status: 202 len: 0 microversion: 2.1 time: 0.373011 Oct 04 18:55:50.123884 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2599/4900] 10.222.0.43 () {58 vars in 1416 bytes} [Tue Oct 4 18:55:49 2022] DELETE /compute/v2.1/servers/bc5eda7f-851f-44d8-af95-5e721dd6d52b/os-volume_attachments/b58125c2-399b-4901-ab14-2b7cf4f8fae7 => generated 0 bytes in 375 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:55:50.130587 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-058e78b6-55e0-4904-af83-639a36a72af7 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:50.131721 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-058e78b6-55e0-4904-af83-639a36a72af7 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] [instance: f16f7c94-16bc-469b-8b4a-427494496547] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:50.139824 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-058e78b6-55e0-4904-af83-639a36a72af7 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:50.140781 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-058e78b6-55e0-4904-af83-639a36a72af7 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:50.141615 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-058e78b6-55e0-4904-af83-639a36a72af7 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:50.142743 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-058e78b6-55e0-4904-af83-639a36a72af7 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:50.143429 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-058e78b6-55e0-4904-af83-639a36a72af7 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:50.144603 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-058e78b6-55e0-4904-af83-639a36a72af7 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:50.192616 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:55:50.202599 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-0131b6e1-ee3e-4be4-977a-c68749bb3db5 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f63f1ac147543dab34a28a22eb5936c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1607b30b9f324abaa88aa29e04ef3ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:50.213418 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-0131b6e1-ee3e-4be4-977a-c68749bb3db5 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40" status: 200 len: 1511 microversion: 2.1 time: 0.714323 Oct 04 18:55:50.222850 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2302/4901] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:49 2022] GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40 => generated 1511 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:55:50.228910 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-c65fd987-8965-4718-ac42-de81c388e6bc tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:50.238492 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-c65fd987-8965-4718-ac42-de81c388e6bc tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] [instance: bc5eda7f-851f-44d8-af95-5e721dd6d52b] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:50.260772 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c65fd987-8965-4718-ac42-de81c388e6bc tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:50.263400 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c65fd987-8965-4718-ac42-de81c388e6bc tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:50.264101 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c65fd987-8965-4718-ac42-de81c388e6bc tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:50.270160 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c65fd987-8965-4718-ac42-de81c388e6bc tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:50.272571 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c65fd987-8965-4718-ac42-de81c388e6bc tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:50.273367 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c65fd987-8965-4718-ac42-de81c388e6bc tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:50.328847 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-c65fd987-8965-4718-ac42-de81c388e6bc tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] 10.222.0.43 "GET /compute/v2.1/servers/bc5eda7f-851f-44d8-af95-5e721dd6d52b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.103146 Oct 04 18:55:50.329990 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2303/4902] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Oct 4 18:55:50 2022] GET /compute/v2.1/servers/bc5eda7f-851f-44d8-af95-5e721dd6d52b/os-volume_attachments => generated 197 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:55:50.399687 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-058e78b6-55e0-4904-af83-639a36a72af7 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9480713a3884233bd28a7986e9a5baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1e7be678b94918a8c9436a3a25eb67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:50.408485 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-058e78b6-55e0-4904-af83-639a36a72af7 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] 10.222.0.43 "GET /compute/v2.1/servers/f16f7c94-16bc-469b-8b4a-427494496547" status: 200 len: 1272 microversion: 2.1 time: 0.283080 Oct 04 18:55:50.409139 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2600/4903] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:50 2022] GET /compute/v2.1/servers/f16f7c94-16bc-469b-8b4a-427494496547 => generated 1272 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:55:50.551365 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-76a2f86b-f373-4d90-afb5-b95a58759312 req-85f660e9-d9a0-4621-a025-74ced2606c74 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02a066b4-243b-4fe3-afcf-30f3e9511d1b", "tag": "86859dd2-218b-4ce7-b642-388a568f9811"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:55:50.563727 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-76a2f86b-f373-4d90-afb5-b95a58759312 req-85f660e9-d9a0-4621-a025-74ced2606c74 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:50.564601 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-76a2f86b-f373-4d90-afb5-b95a58759312 req-85f660e9-d9a0-4621-a025-74ced2606c74 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:50.565222 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-76a2f86b-f373-4d90-afb5-b95a58759312 req-85f660e9-d9a0-4621-a025-74ced2606c74 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:50.577794 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-76a2f86b-f373-4d90-afb5-b95a58759312 req-85f660e9-d9a0-4621-a025-74ced2606c74 service nova] Creating event network-changed:86859dd2-218b-4ce7-b642-388a568f9811 for instance 02a066b4-243b-4fe3-afcf-30f3e9511d1b on n-h2-851028-13 Oct 04 18:55:50.583626 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-76a2f86b-f373-4d90-afb5-b95a58759312 req-85f660e9-d9a0-4621-a025-74ced2606c74 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036265 Oct 04 18:55:50.584919 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2304/4904] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:55:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:55:50.782668 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-7e217b5d-328f-421d-89e3-4d6093f0dfd7 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:50.783537 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-7e217b5d-328f-421d-89e3-4d6093f0dfd7 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] [instance: 02a066b4-243b-4fe3-afcf-30f3e9511d1b] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:50.795956 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7e217b5d-328f-421d-89e3-4d6093f0dfd7 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:50.798002 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7e217b5d-328f-421d-89e3-4d6093f0dfd7 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:50.799782 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7e217b5d-328f-421d-89e3-4d6093f0dfd7 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:50.800786 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7e217b5d-328f-421d-89e3-4d6093f0dfd7 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:50.802320 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7e217b5d-328f-421d-89e3-4d6093f0dfd7 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:50.803970 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7e217b5d-328f-421d-89e3-4d6093f0dfd7 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:51.238142 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-7e217b5d-328f-421d-89e3-4d6093f0dfd7 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:51.249666 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-fa8d9d45-0b75-417f-b258-84d5cc2e333e tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:51.251059 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-fa8d9d45-0b75-417f-b258-84d5cc2e333e tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 01e250ab-d9aa-4708-ae36-10c53a411a40] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:51.269887 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fa8d9d45-0b75-417f-b258-84d5cc2e333e tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:51.270946 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fa8d9d45-0b75-417f-b258-84d5cc2e333e tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:51.271811 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fa8d9d45-0b75-417f-b258-84d5cc2e333e tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:51.272846 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fa8d9d45-0b75-417f-b258-84d5cc2e333e tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:51.273598 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fa8d9d45-0b75-417f-b258-84d5cc2e333e tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:51.274479 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fa8d9d45-0b75-417f-b258-84d5cc2e333e tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:51.274630 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-7e217b5d-328f-421d-89e3-4d6093f0dfd7 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:51.294868 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-7e217b5d-328f-421d-89e3-4d6093f0dfd7 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:51.302867 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-7e217b5d-328f-421d-89e3-4d6093f0dfd7 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] 10.222.0.43 "GET /compute/v2.1/servers/02a066b4-243b-4fe3-afcf-30f3e9511d1b" status: 200 len: 1875 microversion: 2.42 time: 0.526514 Oct 04 18:55:51.303874 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2601/4905] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:55:50 2022] GET /compute/v2.1/servers/02a066b4-243b-4fe3-afcf-30f3e9511d1b => generated 1875 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:55:51.342027 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-33c6936b-3d74-43ab-9805-c53b49bf381a tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:51.361030 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-33c6936b-3d74-43ab-9805-c53b49bf381a tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] [instance: bc5eda7f-851f-44d8-af95-5e721dd6d52b] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:51.385317 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-33c6936b-3d74-43ab-9805-c53b49bf381a tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:51.388583 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-33c6936b-3d74-43ab-9805-c53b49bf381a tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:51.392395 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-33c6936b-3d74-43ab-9805-c53b49bf381a tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:51.395032 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-33c6936b-3d74-43ab-9805-c53b49bf381a tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:51.396437 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-33c6936b-3d74-43ab-9805-c53b49bf381a tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:51.400568 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-33c6936b-3d74-43ab-9805-c53b49bf381a tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:51.500241 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-33c6936b-3d74-43ab-9805-c53b49bf381a tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] 10.222.0.43 "GET /compute/v2.1/servers/bc5eda7f-851f-44d8-af95-5e721dd6d52b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.162107 Oct 04 18:55:51.502010 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2602/4906] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Oct 4 18:55:51 2022] GET /compute/v2.1/servers/bc5eda7f-851f-44d8-af95-5e721dd6d52b/os-volume_attachments => generated 197 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:55:51.512319 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-6d2782c6-b83c-4e32-86b5-e1ecd0e6adf0 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:51.512948 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-6d2782c6-b83c-4e32-86b5-e1ecd0e6adf0 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] [instance: f16f7c94-16bc-469b-8b4a-427494496547] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:51.533275 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6d2782c6-b83c-4e32-86b5-e1ecd0e6adf0 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:51.533779 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6d2782c6-b83c-4e32-86b5-e1ecd0e6adf0 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:51.534234 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6d2782c6-b83c-4e32-86b5-e1ecd0e6adf0 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:51.534947 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6d2782c6-b83c-4e32-86b5-e1ecd0e6adf0 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:51.535627 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6d2782c6-b83c-4e32-86b5-e1ecd0e6adf0 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:51.536242 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6d2782c6-b83c-4e32-86b5-e1ecd0e6adf0 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:51.753784 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-fa8d9d45-0b75-417f-b258-84d5cc2e333e tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f63f1ac147543dab34a28a22eb5936c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1607b30b9f324abaa88aa29e04ef3ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:51.763779 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-fa8d9d45-0b75-417f-b258-84d5cc2e333e tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40" status: 200 len: 1511 microversion: 2.1 time: 0.518393 Oct 04 18:55:51.764387 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2305/4907] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:51 2022] GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40 => generated 1511 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:55:52.081736 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-6d2782c6-b83c-4e32-86b5-e1ecd0e6adf0 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9480713a3884233bd28a7986e9a5baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1e7be678b94918a8c9436a3a25eb67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:52.090975 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-6d2782c6-b83c-4e32-86b5-e1ecd0e6adf0 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] 10.222.0.43 "GET /compute/v2.1/servers/f16f7c94-16bc-469b-8b4a-427494496547" status: 200 len: 1314 microversion: 2.1 time: 0.587587 Oct 04 18:55:52.095223 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2603/4908] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:51 2022] GET /compute/v2.1/servers/f16f7c94-16bc-469b-8b4a-427494496547 => generated 1314 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:55:52.335236 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-555d7ff8-154b-4776-beb9-87a6fd097f5a tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:52.335895 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-555d7ff8-154b-4776-beb9-87a6fd097f5a tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] [instance: 02a066b4-243b-4fe3-afcf-30f3e9511d1b] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:52.355107 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-555d7ff8-154b-4776-beb9-87a6fd097f5a tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:52.355630 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-555d7ff8-154b-4776-beb9-87a6fd097f5a tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:52.356293 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-555d7ff8-154b-4776-beb9-87a6fd097f5a tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:52.357072 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-555d7ff8-154b-4776-beb9-87a6fd097f5a tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:52.357553 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-555d7ff8-154b-4776-beb9-87a6fd097f5a tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:52.358000 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-555d7ff8-154b-4776-beb9-87a6fd097f5a tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:52.519205 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-e2fb366d-d85c-47a7-a84c-7bee8f8e425b tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:52.524482 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-e2fb366d-d85c-47a7-a84c-7bee8f8e425b tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] [instance: bc5eda7f-851f-44d8-af95-5e721dd6d52b] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:52.535414 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e2fb366d-d85c-47a7-a84c-7bee8f8e425b tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:52.549318 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e2fb366d-d85c-47a7-a84c-7bee8f8e425b tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:52.550359 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e2fb366d-d85c-47a7-a84c-7bee8f8e425b tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:52.552662 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e2fb366d-d85c-47a7-a84c-7bee8f8e425b tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:52.554074 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e2fb366d-d85c-47a7-a84c-7bee8f8e425b tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:52.554749 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e2fb366d-d85c-47a7-a84c-7bee8f8e425b tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:52.636918 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-e2fb366d-d85c-47a7-a84c-7bee8f8e425b tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] 10.222.0.43 "GET /compute/v2.1/servers/bc5eda7f-851f-44d8-af95-5e721dd6d52b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.126795 Oct 04 18:55:52.648114 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2604/4909] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Oct 4 18:55:52 2022] GET /compute/v2.1/servers/bc5eda7f-851f-44d8-af95-5e721dd6d52b/os-volume_attachments => generated 197 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:55:52.795859 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-133dce01-0c7c-4bd1-82f0-9b3d188ea37f tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:52.797147 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-133dce01-0c7c-4bd1-82f0-9b3d188ea37f tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 01e250ab-d9aa-4708-ae36-10c53a411a40] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:52.807917 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-133dce01-0c7c-4bd1-82f0-9b3d188ea37f tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:52.811126 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-133dce01-0c7c-4bd1-82f0-9b3d188ea37f tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:52.811963 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-133dce01-0c7c-4bd1-82f0-9b3d188ea37f tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:52.814155 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-133dce01-0c7c-4bd1-82f0-9b3d188ea37f tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:52.814641 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-133dce01-0c7c-4bd1-82f0-9b3d188ea37f tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:52.815082 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-133dce01-0c7c-4bd1-82f0-9b3d188ea37f tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:52.892945 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-555d7ff8-154b-4776-beb9-87a6fd097f5a tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:52.912751 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-555d7ff8-154b-4776-beb9-87a6fd097f5a tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:52.915112 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-555d7ff8-154b-4776-beb9-87a6fd097f5a tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:52.919665 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-555d7ff8-154b-4776-beb9-87a6fd097f5a tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] 10.222.0.43 "GET /compute/v2.1/servers/02a066b4-243b-4fe3-afcf-30f3e9511d1b" status: 200 len: 1875 microversion: 2.42 time: 0.593822 Oct 04 18:55:52.920994 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2306/4910] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:55:52 2022] GET /compute/v2.1/servers/02a066b4-243b-4fe3-afcf-30f3e9511d1b => generated 1875 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:55:53.131209 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-64f6b093-6b80-43dc-8a9d-15a9ed36e1cc tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:53.132673 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-64f6b093-6b80-43dc-8a9d-15a9ed36e1cc tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] [instance: f16f7c94-16bc-469b-8b4a-427494496547] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:53.153787 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-64f6b093-6b80-43dc-8a9d-15a9ed36e1cc tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:53.154290 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-64f6b093-6b80-43dc-8a9d-15a9ed36e1cc tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:53.154731 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-64f6b093-6b80-43dc-8a9d-15a9ed36e1cc tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:53.155731 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-64f6b093-6b80-43dc-8a9d-15a9ed36e1cc tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:53.156782 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-64f6b093-6b80-43dc-8a9d-15a9ed36e1cc tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:53.166341 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-64f6b093-6b80-43dc-8a9d-15a9ed36e1cc tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:53.273637 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-133dce01-0c7c-4bd1-82f0-9b3d188ea37f tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f63f1ac147543dab34a28a22eb5936c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1607b30b9f324abaa88aa29e04ef3ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:53.298332 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-133dce01-0c7c-4bd1-82f0-9b3d188ea37f tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40" status: 200 len: 1511 microversion: 2.1 time: 0.506207 Oct 04 18:55:53.299234 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2605/4911] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:52 2022] GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40 => generated 1511 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:55:53.514037 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-64f6b093-6b80-43dc-8a9d-15a9ed36e1cc tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9480713a3884233bd28a7986e9a5baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1e7be678b94918a8c9436a3a25eb67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:53.522696 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-64f6b093-6b80-43dc-8a9d-15a9ed36e1cc tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] 10.222.0.43 "GET /compute/v2.1/servers/f16f7c94-16bc-469b-8b4a-427494496547" status: 200 len: 1314 microversion: 2.1 time: 0.404284 Oct 04 18:55:53.538449 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2307/4912] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:53 2022] GET /compute/v2.1/servers/f16f7c94-16bc-469b-8b4a-427494496547 => generated 1314 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:55:53.659854 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-9c6f4662-b914-42f4-b1d7-fea3db9c7028 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:53.662768 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-9c6f4662-b914-42f4-b1d7-fea3db9c7028 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] [instance: bc5eda7f-851f-44d8-af95-5e721dd6d52b] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:53.675310 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9c6f4662-b914-42f4-b1d7-fea3db9c7028 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:53.675838 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9c6f4662-b914-42f4-b1d7-fea3db9c7028 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:53.676292 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9c6f4662-b914-42f4-b1d7-fea3db9c7028 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:53.677040 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9c6f4662-b914-42f4-b1d7-fea3db9c7028 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:53.677871 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9c6f4662-b914-42f4-b1d7-fea3db9c7028 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:53.677996 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9c6f4662-b914-42f4-b1d7-fea3db9c7028 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:53.754107 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-9c6f4662-b914-42f4-b1d7-fea3db9c7028 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] 10.222.0.43 "GET /compute/v2.1/servers/bc5eda7f-851f-44d8-af95-5e721dd6d52b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.097144 Oct 04 18:55:53.755468 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2606/4913] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Oct 4 18:55:53 2022] GET /compute/v2.1/servers/bc5eda7f-851f-44d8-af95-5e721dd6d52b/os-volume_attachments => generated 197 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:55:53.951132 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-d2df5cbf-5216-410c-a4da-bfb388a53800 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:53.952397 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-d2df5cbf-5216-410c-a4da-bfb388a53800 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] [instance: 02a066b4-243b-4fe3-afcf-30f3e9511d1b] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:53.956054 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_api:SELECT=87,nova_api:DELETE=1 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:55:53.979553 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d2df5cbf-5216-410c-a4da-bfb388a53800 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:53.980720 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d2df5cbf-5216-410c-a4da-bfb388a53800 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:53.981496 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d2df5cbf-5216-410c-a4da-bfb388a53800 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:53.982511 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d2df5cbf-5216-410c-a4da-bfb388a53800 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:53.983539 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d2df5cbf-5216-410c-a4da-bfb388a53800 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:53.984922 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d2df5cbf-5216-410c-a4da-bfb388a53800 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:54.325712 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-420bdf1d-22c0-4baf-8dd9-f69d67446be8 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:54.328493 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-420bdf1d-22c0-4baf-8dd9-f69d67446be8 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 01e250ab-d9aa-4708-ae36-10c53a411a40] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:54.337132 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-420bdf1d-22c0-4baf-8dd9-f69d67446be8 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:54.337947 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-420bdf1d-22c0-4baf-8dd9-f69d67446be8 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:54.338572 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-420bdf1d-22c0-4baf-8dd9-f69d67446be8 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:54.339538 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-420bdf1d-22c0-4baf-8dd9-f69d67446be8 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:54.340177 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-420bdf1d-22c0-4baf-8dd9-f69d67446be8 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:54.340788 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-420bdf1d-22c0-4baf-8dd9-f69d67446be8 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:54.407870 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-d2df5cbf-5216-410c-a4da-bfb388a53800 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:54.418387 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-d2df5cbf-5216-410c-a4da-bfb388a53800 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:54.420152 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-d2df5cbf-5216-410c-a4da-bfb388a53800 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:54.422197 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-d2df5cbf-5216-410c-a4da-bfb388a53800 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] 10.222.0.43 "GET /compute/v2.1/servers/02a066b4-243b-4fe3-afcf-30f3e9511d1b" status: 200 len: 1875 microversion: 2.42 time: 0.474425 Oct 04 18:55:54.422827 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2308/4914] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:55:53 2022] GET /compute/v2.1/servers/02a066b4-243b-4fe3-afcf-30f3e9511d1b => generated 1875 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:55:54.550155 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-58643419-4f93-491a-9a9e-24402c6c784f tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:54.551247 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-58643419-4f93-491a-9a9e-24402c6c784f tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] [instance: f16f7c94-16bc-469b-8b4a-427494496547] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:54.560594 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-58643419-4f93-491a-9a9e-24402c6c784f tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:54.561448 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-58643419-4f93-491a-9a9e-24402c6c784f tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:54.562141 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-58643419-4f93-491a-9a9e-24402c6c784f tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:54.563723 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-58643419-4f93-491a-9a9e-24402c6c784f tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:54.564462 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-58643419-4f93-491a-9a9e-24402c6c784f tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:54.565268 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-58643419-4f93-491a-9a9e-24402c6c784f tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:54.753730 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-420bdf1d-22c0-4baf-8dd9-f69d67446be8 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f63f1ac147543dab34a28a22eb5936c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1607b30b9f324abaa88aa29e04ef3ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:54.763691 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-420bdf1d-22c0-4baf-8dd9-f69d67446be8 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40" status: 200 len: 1511 microversion: 2.1 time: 0.442214 Oct 04 18:55:54.768207 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2607/4915] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:54 2022] GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40 => generated 1511 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:55:54.782064 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-9822c561-32da-4700-b110-f96c289d2950 req-9f435d02-320f-4195-aa60-65215c828e20 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f16f7c94-16bc-469b-8b4a-427494496547", "tag": "d7aad276-429f-46fa-b403-435dda37c7c6"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:55:54.800854 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-9822c561-32da-4700-b110-f96c289d2950 req-9f435d02-320f-4195-aa60-65215c828e20 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:54.803416 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-9822c561-32da-4700-b110-f96c289d2950 req-9f435d02-320f-4195-aa60-65215c828e20 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:54.804108 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-9822c561-32da-4700-b110-f96c289d2950 req-9f435d02-320f-4195-aa60-65215c828e20 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:54.844452 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-9822c561-32da-4700-b110-f96c289d2950 req-9f435d02-320f-4195-aa60-65215c828e20 service nova] Creating event network-changed:d7aad276-429f-46fa-b403-435dda37c7c6 for instance f16f7c94-16bc-469b-8b4a-427494496547 on n-h2-851028-13 Oct 04 18:55:54.861416 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-9822c561-32da-4700-b110-f96c289d2950 req-9f435d02-320f-4195-aa60-65215c828e20 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090545 Oct 04 18:55:54.862649 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2608/4916] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:55:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:55:54.868090 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-28611078-f07a-4659-828b-a894c3e770a9 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:54.870828 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-28611078-f07a-4659-828b-a894c3e770a9 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] [instance: bc5eda7f-851f-44d8-af95-5e721dd6d52b] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:54.878109 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-28611078-f07a-4659-828b-a894c3e770a9 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:54.879954 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-28611078-f07a-4659-828b-a894c3e770a9 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:54.880834 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-28611078-f07a-4659-828b-a894c3e770a9 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:54.884964 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-28611078-f07a-4659-828b-a894c3e770a9 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:54.886033 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-28611078-f07a-4659-828b-a894c3e770a9 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:54.886704 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-28611078-f07a-4659-828b-a894c3e770a9 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:54.922623 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-58643419-4f93-491a-9a9e-24402c6c784f tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9480713a3884233bd28a7986e9a5baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1e7be678b94918a8c9436a3a25eb67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:54.935620 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-28611078-f07a-4659-828b-a894c3e770a9 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] 10.222.0.43 "GET /compute/v2.1/servers/bc5eda7f-851f-44d8-af95-5e721dd6d52b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.071531 Oct 04 18:55:54.936007 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-58643419-4f93-491a-9a9e-24402c6c784f tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] 10.222.0.43 "GET /compute/v2.1/servers/f16f7c94-16bc-469b-8b4a-427494496547" status: 200 len: 1314 microversion: 2.1 time: 0.392800 Oct 04 18:55:54.937203 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2609/4917] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Oct 4 18:55:54 2022] GET /compute/v2.1/servers/bc5eda7f-851f-44d8-af95-5e721dd6d52b/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:55:54.938525 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2309/4918] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:54 2022] GET /compute/v2.1/servers/f16f7c94-16bc-469b-8b4a-427494496547 => generated 1314 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:55:55.447919 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f558b9af-a9e3-4f06-9848-f0934d5be529 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:55.448542 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-f558b9af-a9e3-4f06-9848-f0934d5be529 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] [instance: 02a066b4-243b-4fe3-afcf-30f3e9511d1b] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:55.455701 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f558b9af-a9e3-4f06-9848-f0934d5be529 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:55.456197 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f558b9af-a9e3-4f06-9848-f0934d5be529 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:55.456629 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f558b9af-a9e3-4f06-9848-f0934d5be529 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:55.457541 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f558b9af-a9e3-4f06-9848-f0934d5be529 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:55.458159 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f558b9af-a9e3-4f06-9848-f0934d5be529 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:55.458760 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f558b9af-a9e3-4f06-9848-f0934d5be529 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:55.719076 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-f558b9af-a9e3-4f06-9848-f0934d5be529 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:55.741769 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-f558b9af-a9e3-4f06-9848-f0934d5be529 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:55.744111 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-f558b9af-a9e3-4f06-9848-f0934d5be529 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:55.747711 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-f558b9af-a9e3-4f06-9848-f0934d5be529 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] 10.222.0.43 "GET /compute/v2.1/servers/02a066b4-243b-4fe3-afcf-30f3e9511d1b" status: 200 len: 1875 microversion: 2.42 time: 0.303689 Oct 04 18:55:55.750572 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2610/4919] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:55:55 2022] GET /compute/v2.1/servers/02a066b4-243b-4fe3-afcf-30f3e9511d1b => generated 1875 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:55:55.794005 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-04324c02-744e-4d89-b518-21266bea8ce8 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:55.794684 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-04324c02-744e-4d89-b518-21266bea8ce8 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 01e250ab-d9aa-4708-ae36-10c53a411a40] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:55.804640 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-04324c02-744e-4d89-b518-21266bea8ce8 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:55.805364 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-04324c02-744e-4d89-b518-21266bea8ce8 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:55.806068 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-04324c02-744e-4d89-b518-21266bea8ce8 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:55.807136 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-04324c02-744e-4d89-b518-21266bea8ce8 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:55.807814 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-04324c02-744e-4d89-b518-21266bea8ce8 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:55.808259 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-04324c02-744e-4d89-b518-21266bea8ce8 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:55.947970 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-3884ae48-5039-45dc-9c0e-3b647ead0ea8 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:55.950429 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-3884ae48-5039-45dc-9c0e-3b647ead0ea8 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] [instance: bc5eda7f-851f-44d8-af95-5e721dd6d52b] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:55.967567 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3884ae48-5039-45dc-9c0e-3b647ead0ea8 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:55.968013 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3884ae48-5039-45dc-9c0e-3b647ead0ea8 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:55.969596 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3884ae48-5039-45dc-9c0e-3b647ead0ea8 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:55.970341 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3884ae48-5039-45dc-9c0e-3b647ead0ea8 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:55.970811 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3884ae48-5039-45dc-9c0e-3b647ead0ea8 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:55.971251 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3884ae48-5039-45dc-9c0e-3b647ead0ea8 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:56.050880 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-3884ae48-5039-45dc-9c0e-3b647ead0ea8 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] 10.222.0.43 "GET /compute/v2.1/servers/bc5eda7f-851f-44d8-af95-5e721dd6d52b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.106716 Oct 04 18:55:56.055788 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2611/4920] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Oct 4 18:55:55 2022] GET /compute/v2.1/servers/bc5eda7f-851f-44d8-af95-5e721dd6d52b/os-volume_attachments => generated 197 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:55:56.060910 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-272b8e17-bb66-4ff1-8d5e-7017fe656e4a tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:56.069744 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-272b8e17-bb66-4ff1-8d5e-7017fe656e4a tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] [instance: f16f7c94-16bc-469b-8b4a-427494496547] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:56.082506 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-272b8e17-bb66-4ff1-8d5e-7017fe656e4a tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:56.084233 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-272b8e17-bb66-4ff1-8d5e-7017fe656e4a tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:56.086208 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-272b8e17-bb66-4ff1-8d5e-7017fe656e4a tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:56.087169 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-272b8e17-bb66-4ff1-8d5e-7017fe656e4a tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:56.106086 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-272b8e17-bb66-4ff1-8d5e-7017fe656e4a tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:56.106793 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-272b8e17-bb66-4ff1-8d5e-7017fe656e4a tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:56.405896 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-272b8e17-bb66-4ff1-8d5e-7017fe656e4a tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9480713a3884233bd28a7986e9a5baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1e7be678b94918a8c9436a3a25eb67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:56.420962 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-272b8e17-bb66-4ff1-8d5e-7017fe656e4a tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] 10.222.0.43 "GET /compute/v2.1/servers/f16f7c94-16bc-469b-8b4a-427494496547" status: 200 len: 1314 microversion: 2.1 time: 0.363692 Oct 04 18:55:56.422218 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2612/4921] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:56 2022] GET /compute/v2.1/servers/f16f7c94-16bc-469b-8b4a-427494496547 => generated 1314 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:55:56.464492 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-04324c02-744e-4d89-b518-21266bea8ce8 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f63f1ac147543dab34a28a22eb5936c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1607b30b9f324abaa88aa29e04ef3ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:56.476728 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-04324c02-744e-4d89-b518-21266bea8ce8 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40" status: 200 len: 1511 microversion: 2.1 time: 0.687152 Oct 04 18:55:56.477849 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2310/4922] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:55 2022] GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40 => generated 1511 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:55:56.778140 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-9ad2237a-0d6d-45dd-899e-6d405b7c919d tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:56.778864 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-9ad2237a-0d6d-45dd-899e-6d405b7c919d tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] [instance: 02a066b4-243b-4fe3-afcf-30f3e9511d1b] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:56.789269 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9ad2237a-0d6d-45dd-899e-6d405b7c919d tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:56.790803 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9ad2237a-0d6d-45dd-899e-6d405b7c919d tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:56.790803 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9ad2237a-0d6d-45dd-899e-6d405b7c919d tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:56.801773 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9ad2237a-0d6d-45dd-899e-6d405b7c919d tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:56.802554 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9ad2237a-0d6d-45dd-899e-6d405b7c919d tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:56.803118 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9ad2237a-0d6d-45dd-899e-6d405b7c919d tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:56.808339 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=2 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:55:57.068104 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-b2449d2c-aedf-47ef-95ac-fcff52bce300 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:57.070921 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-b2449d2c-aedf-47ef-95ac-fcff52bce300 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] [instance: bc5eda7f-851f-44d8-af95-5e721dd6d52b] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:57.083729 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b2449d2c-aedf-47ef-95ac-fcff52bce300 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:57.084923 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b2449d2c-aedf-47ef-95ac-fcff52bce300 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:57.085735 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b2449d2c-aedf-47ef-95ac-fcff52bce300 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:57.087447 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b2449d2c-aedf-47ef-95ac-fcff52bce300 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:57.088220 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b2449d2c-aedf-47ef-95ac-fcff52bce300 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:57.088922 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b2449d2c-aedf-47ef-95ac-fcff52bce300 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:57.131899 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-b2449d2c-aedf-47ef-95ac-fcff52bce300 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] 10.222.0.43 "GET /compute/v2.1/servers/bc5eda7f-851f-44d8-af95-5e721dd6d52b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.067831 Oct 04 18:55:57.132997 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2311/4923] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Oct 4 18:55:57 2022] GET /compute/v2.1/servers/bc5eda7f-851f-44d8-af95-5e721dd6d52b/os-volume_attachments => generated 25 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:55:57.216402 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-bb1ba0b2-75e3-47a3-a5cb-2187af75b1c5 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:57.217641 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-bb1ba0b2-75e3-47a3-a5cb-2187af75b1c5 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] [instance: bc5eda7f-851f-44d8-af95-5e721dd6d52b] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:57.228332 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bb1ba0b2-75e3-47a3-a5cb-2187af75b1c5 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:57.229750 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bb1ba0b2-75e3-47a3-a5cb-2187af75b1c5 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:57.230334 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bb1ba0b2-75e3-47a3-a5cb-2187af75b1c5 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:57.231342 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bb1ba0b2-75e3-47a3-a5cb-2187af75b1c5 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:57.232232 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bb1ba0b2-75e3-47a3-a5cb-2187af75b1c5 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:57.232768 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bb1ba0b2-75e3-47a3-a5cb-2187af75b1c5 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:57.267854 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-bb1ba0b2-75e3-47a3-a5cb-2187af75b1c5 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] [instance: bc5eda7f-851f-44d8-af95-5e721dd6d52b] Going to try to terminate instance {{(pid=123595) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:55:57.316782 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=8 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:55:57.359560 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-9ad2237a-0d6d-45dd-899e-6d405b7c919d tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:57.364237 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-bb1ba0b2-75e3-47a3-a5cb-2187af75b1c5 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] 10.222.0.43 "DELETE /compute/v2.1/servers/bc5eda7f-851f-44d8-af95-5e721dd6d52b" status: 204 len: 0 microversion: 2.1 time: 0.153524 Oct 04 18:55:57.365286 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2312/4924] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 18:55:57 2022] DELETE /compute/v2.1/servers/bc5eda7f-851f-44d8-af95-5e721dd6d52b => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:55:57.376060 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-38eb1c24-d4d1-4cc5-8452-3a843f304191 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:57.377773 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-38eb1c24-d4d1-4cc5-8452-3a843f304191 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] [instance: bc5eda7f-851f-44d8-af95-5e721dd6d52b] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:57.384645 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-9ad2237a-0d6d-45dd-899e-6d405b7c919d tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:57.385178 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-38eb1c24-d4d1-4cc5-8452-3a843f304191 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:57.385769 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-38eb1c24-d4d1-4cc5-8452-3a843f304191 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:57.386310 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-38eb1c24-d4d1-4cc5-8452-3a843f304191 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:57.387193 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-38eb1c24-d4d1-4cc5-8452-3a843f304191 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:57.387713 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-9ad2237a-0d6d-45dd-899e-6d405b7c919d tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:57.388122 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-38eb1c24-d4d1-4cc5-8452-3a843f304191 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:57.388822 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-38eb1c24-d4d1-4cc5-8452-3a843f304191 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:57.391327 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-9ad2237a-0d6d-45dd-899e-6d405b7c919d tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] 10.222.0.43 "GET /compute/v2.1/servers/02a066b4-243b-4fe3-afcf-30f3e9511d1b" status: 200 len: 1875 microversion: 2.42 time: 0.615794 Oct 04 18:55:57.392520 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2613/4925] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:55:56 2022] GET /compute/v2.1/servers/02a066b4-243b-4fe3-afcf-30f3e9511d1b => generated 1875 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:55:57.446662 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-42482120-17fb-4b0d-b408-345fe8fc1d4a tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:57.447474 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-42482120-17fb-4b0d-b408-345fe8fc1d4a tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] [instance: f16f7c94-16bc-469b-8b4a-427494496547] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:57.454415 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-42482120-17fb-4b0d-b408-345fe8fc1d4a tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:57.455090 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-42482120-17fb-4b0d-b408-345fe8fc1d4a tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:57.455591 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-42482120-17fb-4b0d-b408-345fe8fc1d4a tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:57.456534 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-42482120-17fb-4b0d-b408-345fe8fc1d4a tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:57.457064 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-42482120-17fb-4b0d-b408-345fe8fc1d4a tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:57.457585 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-42482120-17fb-4b0d-b408-345fe8fc1d4a tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:57.710391 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-42482120-17fb-4b0d-b408-345fe8fc1d4a tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9480713a3884233bd28a7986e9a5baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1e7be678b94918a8c9436a3a25eb67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:57.723494 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-42482120-17fb-4b0d-b408-345fe8fc1d4a tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] 10.222.0.43 "GET /compute/v2.1/servers/f16f7c94-16bc-469b-8b4a-427494496547" status: 200 len: 1314 microversion: 2.1 time: 0.280149 Oct 04 18:55:57.725067 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2614/4926] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:57 2022] GET /compute/v2.1/servers/f16f7c94-16bc-469b-8b4a-427494496547 => generated 1314 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:55:57.736318 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-973d332b-9bae-46c0-a75a-58e510f5d483 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:57.736953 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-973d332b-9bae-46c0-a75a-58e510f5d483 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 01e250ab-d9aa-4708-ae36-10c53a411a40] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:57.758430 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-973d332b-9bae-46c0-a75a-58e510f5d483 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:57.759076 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-973d332b-9bae-46c0-a75a-58e510f5d483 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:57.759583 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-973d332b-9bae-46c0-a75a-58e510f5d483 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:57.760376 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-973d332b-9bae-46c0-a75a-58e510f5d483 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:57.760901 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-973d332b-9bae-46c0-a75a-58e510f5d483 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:57.761426 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-973d332b-9bae-46c0-a75a-58e510f5d483 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:58.019436 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-973d332b-9bae-46c0-a75a-58e510f5d483 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f63f1ac147543dab34a28a22eb5936c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1607b30b9f324abaa88aa29e04ef3ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:58.027527 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-973d332b-9bae-46c0-a75a-58e510f5d483 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40" status: 200 len: 1511 microversion: 2.1 time: 0.300566 Oct 04 18:55:58.044527 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2615/4927] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:57 2022] GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40 => generated 1511 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:55:58.173055 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-38eb1c24-d4d1-4cc5-8452-3a843f304191 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '486c22456b1e47ae843ae41f8dfb2632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c91c7e7358048ffaaee7f51ad61b515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:58.184159 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-38eb1c24-d4d1-4cc5-8452-3a843f304191 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] 10.222.0.43 "GET /compute/v2.1/servers/bc5eda7f-851f-44d8-af95-5e721dd6d52b" status: 200 len: 1680 microversion: 2.1 time: 0.813723 Oct 04 18:55:58.189362 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2313/4928] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:57 2022] GET /compute/v2.1/servers/bc5eda7f-851f-44d8-af95-5e721dd6d52b => generated 1680 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:55:58.420372 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-d304c42d-433e-4fce-896e-8133b048fee5 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:58.422003 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-d304c42d-433e-4fce-896e-8133b048fee5 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] [instance: 02a066b4-243b-4fe3-afcf-30f3e9511d1b] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:58.431033 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d304c42d-433e-4fce-896e-8133b048fee5 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:58.431652 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d304c42d-433e-4fce-896e-8133b048fee5 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:58.432271 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d304c42d-433e-4fce-896e-8133b048fee5 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:58.433699 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d304c42d-433e-4fce-896e-8133b048fee5 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:58.434488 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d304c42d-433e-4fce-896e-8133b048fee5 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:58.435401 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d304c42d-433e-4fce-896e-8133b048fee5 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:58.762977 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-87ce6b74-7911-404e-bff6-2c0b7ec54a38 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:58.763886 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-87ce6b74-7911-404e-bff6-2c0b7ec54a38 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] [instance: f16f7c94-16bc-469b-8b4a-427494496547] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:58.775167 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-87ce6b74-7911-404e-bff6-2c0b7ec54a38 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:58.776527 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-87ce6b74-7911-404e-bff6-2c0b7ec54a38 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:58.777257 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-87ce6b74-7911-404e-bff6-2c0b7ec54a38 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:58.778203 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-87ce6b74-7911-404e-bff6-2c0b7ec54a38 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:58.784523 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-87ce6b74-7911-404e-bff6-2c0b7ec54a38 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:58.785497 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-87ce6b74-7911-404e-bff6-2c0b7ec54a38 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:58.810971 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-d304c42d-433e-4fce-896e-8133b048fee5 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:58.824214 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-d304c42d-433e-4fce-896e-8133b048fee5 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:58.844004 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-d304c42d-433e-4fce-896e-8133b048fee5 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:58.845615 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-d304c42d-433e-4fce-896e-8133b048fee5 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] 10.222.0.43 "GET /compute/v2.1/servers/02a066b4-243b-4fe3-afcf-30f3e9511d1b" status: 200 len: 1875 microversion: 2.42 time: 0.430427 Oct 04 18:55:58.846704 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2616/4929] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:55:58 2022] GET /compute/v2.1/servers/02a066b4-243b-4fe3-afcf-30f3e9511d1b => generated 1875 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:55:59.059466 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f60c1361-36a3-41f6-95c0-97e4a5d35d7d tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:59.061783 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-f60c1361-36a3-41f6-95c0-97e4a5d35d7d tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 01e250ab-d9aa-4708-ae36-10c53a411a40] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:59.075527 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f60c1361-36a3-41f6-95c0-97e4a5d35d7d tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:59.076323 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f60c1361-36a3-41f6-95c0-97e4a5d35d7d tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:59.076994 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f60c1361-36a3-41f6-95c0-97e4a5d35d7d tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:59.079671 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f60c1361-36a3-41f6-95c0-97e4a5d35d7d tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:59.080154 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f60c1361-36a3-41f6-95c0-97e4a5d35d7d tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:59.080597 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f60c1361-36a3-41f6-95c0-97e4a5d35d7d tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:59.244860 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-87ce6b74-7911-404e-bff6-2c0b7ec54a38 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9480713a3884233bd28a7986e9a5baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1e7be678b94918a8c9436a3a25eb67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:59.255329 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-87ce6b74-7911-404e-bff6-2c0b7ec54a38 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] 10.222.0.43 "GET /compute/v2.1/servers/f16f7c94-16bc-469b-8b4a-427494496547" status: 200 len: 1314 microversion: 2.1 time: 0.498385 Oct 04 18:55:59.256463 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2314/4930] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:58 2022] GET /compute/v2.1/servers/f16f7c94-16bc-469b-8b4a-427494496547 => generated 1314 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:55:59.263024 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-42ecbebf-0c19-436d-abc9-976a7f5f2b16 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:59.263647 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-42ecbebf-0c19-436d-abc9-976a7f5f2b16 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] [instance: bc5eda7f-851f-44d8-af95-5e721dd6d52b] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:59.270764 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-42ecbebf-0c19-436d-abc9-976a7f5f2b16 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:59.271520 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-42ecbebf-0c19-436d-abc9-976a7f5f2b16 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:59.271972 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-42ecbebf-0c19-436d-abc9-976a7f5f2b16 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:59.272685 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-42ecbebf-0c19-436d-abc9-976a7f5f2b16 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:59.273171 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-42ecbebf-0c19-436d-abc9-976a7f5f2b16 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:59.273608 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-42ecbebf-0c19-436d-abc9-976a7f5f2b16 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:59.396024 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-f60c1361-36a3-41f6-95c0-97e4a5d35d7d tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f63f1ac147543dab34a28a22eb5936c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1607b30b9f324abaa88aa29e04ef3ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:59.398877 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=100 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:55:59.421345 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-f60c1361-36a3-41f6-95c0-97e4a5d35d7d tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40" status: 200 len: 1511 microversion: 2.1 time: 0.366469 Oct 04 18:55:59.422057 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2617/4931] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:59 2022] GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40 => generated 1511 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:55:59.778647 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-42ecbebf-0c19-436d-abc9-976a7f5f2b16 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '486c22456b1e47ae843ae41f8dfb2632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c91c7e7358048ffaaee7f51ad61b515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:59.794312 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-42ecbebf-0c19-436d-abc9-976a7f5f2b16 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] 10.222.0.43 "GET /compute/v2.1/servers/bc5eda7f-851f-44d8-af95-5e721dd6d52b" status: 200 len: 1680 microversion: 2.1 time: 0.531450 Oct 04 18:55:59.795341 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2315/4932] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:59 2022] GET /compute/v2.1/servers/bc5eda7f-851f-44d8-af95-5e721dd6d52b => generated 1680 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:55:59.875040 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-2ad4b0b9-a164-4410-ab5f-fe49a6011667 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:59.876779 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-2ad4b0b9-a164-4410-ab5f-fe49a6011667 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] [instance: 02a066b4-243b-4fe3-afcf-30f3e9511d1b] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:59.907988 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2ad4b0b9-a164-4410-ab5f-fe49a6011667 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:59.907988 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2ad4b0b9-a164-4410-ab5f-fe49a6011667 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:59.907988 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2ad4b0b9-a164-4410-ab5f-fe49a6011667 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:59.907988 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2ad4b0b9-a164-4410-ab5f-fe49a6011667 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:59.907988 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2ad4b0b9-a164-4410-ab5f-fe49a6011667 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:59.907988 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2ad4b0b9-a164-4410-ab5f-fe49a6011667 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:00.283912 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-7a1f9f09-6842-4cb2-ade8-031b69ecb69d tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:00.285233 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-7a1f9f09-6842-4cb2-ade8-031b69ecb69d tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] [instance: f16f7c94-16bc-469b-8b4a-427494496547] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:00.300529 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7a1f9f09-6842-4cb2-ade8-031b69ecb69d tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:00.302042 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7a1f9f09-6842-4cb2-ade8-031b69ecb69d tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:00.304768 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7a1f9f09-6842-4cb2-ade8-031b69ecb69d tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:00.305698 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7a1f9f09-6842-4cb2-ade8-031b69ecb69d tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:00.307687 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7a1f9f09-6842-4cb2-ade8-031b69ecb69d tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:00.308211 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7a1f9f09-6842-4cb2-ade8-031b69ecb69d tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:00.532061 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-2ad4b0b9-a164-4410-ab5f-fe49a6011667 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:00.558184 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-2ad4b0b9-a164-4410-ab5f-fe49a6011667 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:00.564743 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-2ad4b0b9-a164-4410-ab5f-fe49a6011667 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:00.571207 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-2ad4b0b9-a164-4410-ab5f-fe49a6011667 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] 10.222.0.43 "GET /compute/v2.1/servers/02a066b4-243b-4fe3-afcf-30f3e9511d1b" status: 200 len: 1875 microversion: 2.42 time: 0.697413 Oct 04 18:56:00.571207 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2618/4933] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:55:59 2022] GET /compute/v2.1/servers/02a066b4-243b-4fe3-afcf-30f3e9511d1b => generated 1875 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:56:00.595882 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-25eaafdc-dad4-48ee-86fc-ad55cab9389b tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:00.597567 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-25eaafdc-dad4-48ee-86fc-ad55cab9389b tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 01e250ab-d9aa-4708-ae36-10c53a411a40] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:00.625443 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-25eaafdc-dad4-48ee-86fc-ad55cab9389b tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:00.626028 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-25eaafdc-dad4-48ee-86fc-ad55cab9389b tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:00.628847 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-25eaafdc-dad4-48ee-86fc-ad55cab9389b tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:00.632007 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-25eaafdc-dad4-48ee-86fc-ad55cab9389b tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:00.633425 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-25eaafdc-dad4-48ee-86fc-ad55cab9389b tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:00.635451 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-25eaafdc-dad4-48ee-86fc-ad55cab9389b tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:00.716669 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-7a1f9f09-6842-4cb2-ade8-031b69ecb69d tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9480713a3884233bd28a7986e9a5baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1e7be678b94918a8c9436a3a25eb67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:00.734441 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-7a1f9f09-6842-4cb2-ade8-031b69ecb69d tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] 10.222.0.43 "GET /compute/v2.1/servers/f16f7c94-16bc-469b-8b4a-427494496547" status: 200 len: 1314 microversion: 2.1 time: 0.455574 Oct 04 18:56:00.735093 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2316/4934] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:00 2022] GET /compute/v2.1/servers/f16f7c94-16bc-469b-8b4a-427494496547 => generated 1314 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:56:00.829152 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-856c592d-3812-4641-af53-2177b9c1afa7 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:00.831358 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-856c592d-3812-4641-af53-2177b9c1afa7 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] [instance: bc5eda7f-851f-44d8-af95-5e721dd6d52b] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:00.853060 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-856c592d-3812-4641-af53-2177b9c1afa7 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:00.854987 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-856c592d-3812-4641-af53-2177b9c1afa7 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:00.856329 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-856c592d-3812-4641-af53-2177b9c1afa7 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:00.859930 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-856c592d-3812-4641-af53-2177b9c1afa7 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:00.861363 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-856c592d-3812-4641-af53-2177b9c1afa7 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:00.862297 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-856c592d-3812-4641-af53-2177b9c1afa7 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:00.918327 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:56:01.080153 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-25eaafdc-dad4-48ee-86fc-ad55cab9389b tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f63f1ac147543dab34a28a22eb5936c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1607b30b9f324abaa88aa29e04ef3ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:01.093200 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-25eaafdc-dad4-48ee-86fc-ad55cab9389b tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40" status: 200 len: 1532 microversion: 2.1 time: 0.522546 Oct 04 18:56:01.094103 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2619/4935] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:00 2022] GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40 => generated 1532 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:56:01.107047 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-856c592d-3812-4641-af53-2177b9c1afa7 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '486c22456b1e47ae843ae41f8dfb2632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c91c7e7358048ffaaee7f51ad61b515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:01.131043 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-856c592d-3812-4641-af53-2177b9c1afa7 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] 10.222.0.43 "GET /compute/v2.1/servers/bc5eda7f-851f-44d8-af95-5e721dd6d52b" status: 200 len: 1613 microversion: 2.1 time: 0.310038 Oct 04 18:56:01.137781 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2317/4936] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:00 2022] GET /compute/v2.1/servers/bc5eda7f-851f-44d8-af95-5e721dd6d52b => generated 1613 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:56:01.602453 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-9d0f41eb-c309-4542-aba2-28475f5a419a tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:01.603094 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-9d0f41eb-c309-4542-aba2-28475f5a419a tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] [instance: 02a066b4-243b-4fe3-afcf-30f3e9511d1b] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:01.605370 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:56:01.625678 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9d0f41eb-c309-4542-aba2-28475f5a419a tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:01.627081 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9d0f41eb-c309-4542-aba2-28475f5a419a tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:01.627539 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9d0f41eb-c309-4542-aba2-28475f5a419a tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:01.628271 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9d0f41eb-c309-4542-aba2-28475f5a419a tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:01.631036 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9d0f41eb-c309-4542-aba2-28475f5a419a tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:01.631501 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9d0f41eb-c309-4542-aba2-28475f5a419a tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:01.761564 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-c8030b8f-438e-41a9-82bc-f596d8a02e66 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:01.762363 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-c8030b8f-438e-41a9-82bc-f596d8a02e66 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] [instance: f16f7c94-16bc-469b-8b4a-427494496547] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:01.779944 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c8030b8f-438e-41a9-82bc-f596d8a02e66 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:01.780713 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c8030b8f-438e-41a9-82bc-f596d8a02e66 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:01.781171 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c8030b8f-438e-41a9-82bc-f596d8a02e66 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:01.782085 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c8030b8f-438e-41a9-82bc-f596d8a02e66 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:01.782705 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c8030b8f-438e-41a9-82bc-f596d8a02e66 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:01.783138 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c8030b8f-438e-41a9-82bc-f596d8a02e66 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:02.161502 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-9d0f41eb-c309-4542-aba2-28475f5a419a tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:02.199379 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-9d0f41eb-c309-4542-aba2-28475f5a419a tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:02.200990 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-9d0f41eb-c309-4542-aba2-28475f5a419a tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:02.220571 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-9d0f41eb-c309-4542-aba2-28475f5a419a tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] 10.222.0.43 "GET /compute/v2.1/servers/02a066b4-243b-4fe3-afcf-30f3e9511d1b" status: 200 len: 1875 microversion: 2.42 time: 0.618075 Oct 04 18:56:02.227822 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2620/4937] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:56:01 2022] GET /compute/v2.1/servers/02a066b4-243b-4fe3-afcf-30f3e9511d1b => generated 1875 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:56:02.238882 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-8733767e-7071-445c-9cdb-cb406e683003 req-fa61b1bb-2e9b-4b43-a537-b87b8e96af1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f16f7c94-16bc-469b-8b4a-427494496547", "name": "network-vif-plugged", "status": "completed", "tag": "d7aad276-429f-46fa-b403-435dda37c7c6"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:56:02.265983 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-8733767e-7071-445c-9cdb-cb406e683003 req-fa61b1bb-2e9b-4b43-a537-b87b8e96af1c service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:02.276653 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-8733767e-7071-445c-9cdb-cb406e683003 req-fa61b1bb-2e9b-4b43-a537-b87b8e96af1c service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:02.277831 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-8733767e-7071-445c-9cdb-cb406e683003 req-fa61b1bb-2e9b-4b43-a537-b87b8e96af1c service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:02.303163 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-8733767e-7071-445c-9cdb-cb406e683003 req-fa61b1bb-2e9b-4b43-a537-b87b8e96af1c service nova] Creating event network-vif-plugged:d7aad276-429f-46fa-b403-435dda37c7c6 for instance f16f7c94-16bc-469b-8b4a-427494496547 on n-h2-851028-13 Oct 04 18:56:02.313350 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-8733767e-7071-445c-9cdb-cb406e683003 req-fa61b1bb-2e9b-4b43-a537-b87b8e96af1c service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083860 Oct 04 18:56:02.314599 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2621/4938] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:56:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:56:02.322955 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-de9454b9-f903-4468-82f8-91ce0946dcd3 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:02.332912 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-de9454b9-f903-4468-82f8-91ce0946dcd3 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 01e250ab-d9aa-4708-ae36-10c53a411a40] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:02.362806 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-de9454b9-f903-4468-82f8-91ce0946dcd3 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:02.373940 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-de9454b9-f903-4468-82f8-91ce0946dcd3 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:02.374773 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-de9454b9-f903-4468-82f8-91ce0946dcd3 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:02.377196 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-de9454b9-f903-4468-82f8-91ce0946dcd3 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:02.378263 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-de9454b9-f903-4468-82f8-91ce0946dcd3 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:02.378901 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-de9454b9-f903-4468-82f8-91ce0946dcd3 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:02.755170 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-de9454b9-f903-4468-82f8-91ce0946dcd3 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f63f1ac147543dab34a28a22eb5936c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1607b30b9f324abaa88aa29e04ef3ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:02.778753 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-de9454b9-f903-4468-82f8-91ce0946dcd3 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40" status: 200 len: 1527 microversion: 2.1 time: 0.459990 Oct 04 18:56:02.779734 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2622/4939] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:02 2022] GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40 => generated 1527 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:56:02.842740 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-6db3a007-bf65-4be0-8f93-c9b0be158ab7 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:02.844396 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-6db3a007-bf65-4be0-8f93-c9b0be158ab7 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] [instance: bc5eda7f-851f-44d8-af95-5e721dd6d52b] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:02.879360 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6db3a007-bf65-4be0-8f93-c9b0be158ab7 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:02.883869 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6db3a007-bf65-4be0-8f93-c9b0be158ab7 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:02.885355 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6db3a007-bf65-4be0-8f93-c9b0be158ab7 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:02.886763 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6db3a007-bf65-4be0-8f93-c9b0be158ab7 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:02.892619 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6db3a007-bf65-4be0-8f93-c9b0be158ab7 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:02.893818 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6db3a007-bf65-4be0-8f93-c9b0be158ab7 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:03.048958 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6db3a007-bf65-4be0-8f93-c9b0be158ab7 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:03.054214 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6db3a007-bf65-4be0-8f93-c9b0be158ab7 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:03.056609 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6db3a007-bf65-4be0-8f93-c9b0be158ab7 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:03.072284 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.objects.instance [None req-6db3a007-bf65-4be0-8f93-c9b0be158ab7 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lazy-loading 'fault' on Instance uuid bc5eda7f-851f-44d8-af95-5e721dd6d52b {{(pid=123596) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:56:03.270746 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-6db3a007-bf65-4be0-8f93-c9b0be158ab7 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '486c22456b1e47ae843ae41f8dfb2632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c91c7e7358048ffaaee7f51ad61b515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:03.286727 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-6db3a007-bf65-4be0-8f93-c9b0be158ab7 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] 10.222.0.43 "GET /compute/v2.1/servers/bc5eda7f-851f-44d8-af95-5e721dd6d52b" status: 200 len: 1330 microversion: 2.1 time: 0.462867 Oct 04 18:56:03.288535 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-c8030b8f-438e-41a9-82bc-f596d8a02e66 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9480713a3884233bd28a7986e9a5baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1e7be678b94918a8c9436a3a25eb67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:03.304186 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2623/4940] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:02 2022] GET /compute/v2.1/servers/bc5eda7f-851f-44d8-af95-5e721dd6d52b => generated 1330 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:56:03.305395 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-c8030b8f-438e-41a9-82bc-f596d8a02e66 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] 10.222.0.43 "GET /compute/v2.1/servers/f16f7c94-16bc-469b-8b4a-427494496547" status: 200 len: 1314 microversion: 2.1 time: 1.547619 Oct 04 18:56:03.324786 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-089e298b-e225-409f-983f-2ba81f47cacf req-c9e59df7-f11b-4701-94d4-03f8160051f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc5eda7f-851f-44d8-af95-5e721dd6d52b", "name": "network-vif-deleted", "tag": "81db9f36-4048-40e2-a99b-a532729ebc0a"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:56:03.329276 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2318/4941] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:01 2022] GET /compute/v2.1/servers/f16f7c94-16bc-469b-8b4a-427494496547 => generated 1314 bytes in 1572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:56:03.350043 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-17403807-393b-42ab-98d1-8c9346582623 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:03.350950 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-17403807-393b-42ab-98d1-8c9346582623 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] [instance: 02a066b4-243b-4fe3-afcf-30f3e9511d1b] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:03.365080 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-089e298b-e225-409f-983f-2ba81f47cacf req-c9e59df7-f11b-4701-94d4-03f8160051f8 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:03.367974 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-17403807-393b-42ab-98d1-8c9346582623 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:03.368474 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-17403807-393b-42ab-98d1-8c9346582623 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:03.368923 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-17403807-393b-42ab-98d1-8c9346582623 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:03.369675 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-17403807-393b-42ab-98d1-8c9346582623 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:03.370136 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-17403807-393b-42ab-98d1-8c9346582623 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:03.370642 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-17403807-393b-42ab-98d1-8c9346582623 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:03.371145 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-089e298b-e225-409f-983f-2ba81f47cacf req-c9e59df7-f11b-4701-94d4-03f8160051f8 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:03.373575 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-089e298b-e225-409f-983f-2ba81f47cacf req-c9e59df7-f11b-4701-94d4-03f8160051f8 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:03.409893 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-089e298b-e225-409f-983f-2ba81f47cacf req-c9e59df7-f11b-4701-94d4-03f8160051f8 service nova] Creating event network-vif-deleted:81db9f36-4048-40e2-a99b-a532729ebc0a for instance bc5eda7f-851f-44d8-af95-5e721dd6d52b on n-h1-851028-13 Oct 04 18:56:03.418547 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-089e298b-e225-409f-983f-2ba81f47cacf req-c9e59df7-f11b-4701-94d4-03f8160051f8 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112491 Oct 04 18:56:03.419872 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2624/4942] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:56:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:56:03.810890 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-5243b5c5-8cab-4e24-9366-6696bd7d7e81 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:03.812254 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-5243b5c5-8cab-4e24-9366-6696bd7d7e81 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 01e250ab-d9aa-4708-ae36-10c53a411a40] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:03.825671 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5243b5c5-8cab-4e24-9366-6696bd7d7e81 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:03.826282 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5243b5c5-8cab-4e24-9366-6696bd7d7e81 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:03.826836 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5243b5c5-8cab-4e24-9366-6696bd7d7e81 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:03.831804 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5243b5c5-8cab-4e24-9366-6696bd7d7e81 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:03.832442 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5243b5c5-8cab-4e24-9366-6696bd7d7e81 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:03.832992 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5243b5c5-8cab-4e24-9366-6696bd7d7e81 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:03.925308 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-17403807-393b-42ab-98d1-8c9346582623 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:03.970982 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-17403807-393b-42ab-98d1-8c9346582623 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:03.972727 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-17403807-393b-42ab-98d1-8c9346582623 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:03.976567 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-17403807-393b-42ab-98d1-8c9346582623 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] 10.222.0.43 "GET /compute/v2.1/servers/02a066b4-243b-4fe3-afcf-30f3e9511d1b" status: 200 len: 1875 microversion: 2.42 time: 0.645699 Oct 04 18:56:03.993703 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2319/4943] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:56:03 2022] GET /compute/v2.1/servers/02a066b4-243b-4fe3-afcf-30f3e9511d1b => generated 1875 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:56:04.140992 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-5243b5c5-8cab-4e24-9366-6696bd7d7e81 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f63f1ac147543dab34a28a22eb5936c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1607b30b9f324abaa88aa29e04ef3ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:04.160976 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-5243b5c5-8cab-4e24-9366-6696bd7d7e81 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40" status: 200 len: 1527 microversion: 2.1 time: 0.354405 Oct 04 18:56:04.162940 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2625/4944] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:03 2022] GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40 => generated 1527 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:56:04.336246 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-d714664d-58cf-4db7-9778-bd33f5613abb tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:04.336858 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-d714664d-58cf-4db7-9778-bd33f5613abb tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] [instance: f16f7c94-16bc-469b-8b4a-427494496547] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:04.340062 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-d027525c-32e9-42a2-a18a-7536588316da tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:04.345251 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-d027525c-32e9-42a2-a18a-7536588316da tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] [instance: bc5eda7f-851f-44d8-af95-5e721dd6d52b] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:04.354756 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d714664d-58cf-4db7-9778-bd33f5613abb tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:04.356805 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d027525c-32e9-42a2-a18a-7536588316da tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:04.357834 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d714664d-58cf-4db7-9778-bd33f5613abb tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:04.358453 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d714664d-58cf-4db7-9778-bd33f5613abb tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:04.359384 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d714664d-58cf-4db7-9778-bd33f5613abb tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:04.360070 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d027525c-32e9-42a2-a18a-7536588316da tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:04.360751 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d714664d-58cf-4db7-9778-bd33f5613abb tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:04.361956 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d027525c-32e9-42a2-a18a-7536588316da tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:04.362612 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d714664d-58cf-4db7-9778-bd33f5613abb tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:04.366649 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d027525c-32e9-42a2-a18a-7536588316da tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:04.367421 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d027525c-32e9-42a2-a18a-7536588316da tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:04.368324 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d027525c-32e9-42a2-a18a-7536588316da tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:04.408727 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-d027525c-32e9-42a2-a18a-7536588316da tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] HTTP exception thrown: Instance bc5eda7f-851f-44d8-af95-5e721dd6d52b could not be found. Oct 04 18:56:04.411014 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-d027525c-32e9-42a2-a18a-7536588316da tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Request method failure captured: Oct 04 18:56:04.411014 n-d-851028-13 devstack@n-api.service[123595]: request: GET /compute/v2.1/servers/bc5eda7f-851f-44d8-af95-5e721dd6d52b HTTP/1.1 Oct 04 18:56:04.411014 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 18:56:04.411014 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 18:56:04.411014 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 18:56:04.411014 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 0 Oct 04 18:56:04.411014 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 18:56:04.411014 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 18:56:04.411014 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 18:56:04.411014 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 18:56:04.411014 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPID78vmCI9IDPSneDizdTNDV6DvHA8Yu-0Hk2AdriQTEcsN9glvSb6qnq0IhhwuZEnTcyOqvR3DmN0AjQb3MXy0KeUN-iyujvPMDrfVKCEbIzKf9nHEoBLFpzOTLVQVrEHVpIwmUAw_LxUeBUjShHQb88Tzo0W7pmPF365n3rwKGYEI Oct 04 18:56:04.411014 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 18:56:04.411014 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 18:56:04.411014 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 18:56:04.411014 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 18:56:04.411014 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 18:56:04.411014 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 18:56:04.411014 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: 6c91c7e7358048ffaaee7f51ad61b515 Oct 04 18:56:04.411014 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-AttachVolumeNegativeTest-2048626205 Oct 04 18:56:04.411014 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 18:56:04.411014 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 18:56:04.411014 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/6c91c7e7358048ffaaee7f51ad61b515"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_6c91c7e7358048ffaaee7f51ad61b515"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/6c91c7e7358048ffaaee7f51ad61b515"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/6c91c7e7358048ffaaee7f51ad61b515"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:56:04.411014 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-AttachVolumeNegativeTest-2048626205 Oct 04 18:56:04.411014 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: 6c91c7e7358048ffaaee7f51ad61b515 Oct 04 18:56:04.411014 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2048626205 Oct 04 18:56:04.411014 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-AttachVolumeNegativeTest-2048626205-project Oct 04 18:56:04.411014 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 18:56:04.411014 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 18:56:04.411014 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: 486c22456b1e47ae843ae41f8dfb2632 Oct 04 18:56:04.411014 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-AttachVolumeNegativeTest-2048626205-project Oct 04 18:56:04.411014 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 18:56:04.411014 n-d-851028-13 devstack@n-api.service[123595]: exception: Instance bc5eda7f-851f-44d8-af95-5e721dd6d52b could not be found. Oct 04 18:56:04.411014 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': 'bc5eda7f-851f-44d8-af95-5e721dd6d52b'} Oct 04 18:56:04.411014 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:56:04.411014 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:56:04.411014 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:56:04.411014 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:56:04.411014 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:56:04.411014 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:56:04.411014 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:56:04.411014 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:56:04.411014 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:56:04.411014 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:56:04.411014 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bc5eda7f-851f-44d8-af95-5e721dd6d52b could not be found. Oct 04 18:56:04.411014 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:56:04.411014 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:56:04.411014 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:56:04.411014 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:56:04.411014 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:56:04.411014 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:56:04.411014 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:56:04.411014 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:56:04.411014 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:56:04.411014 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:56:04.411014 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:56:04.411014 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:56:04.411014 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:56:04.411014 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:56:04.411014 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:56:04.411014 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:56:04.411014 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bc5eda7f-851f-44d8-af95-5e721dd6d52b could not be found. Oct 04 18:56:04.411014 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:56:04.411014 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:56:04.411014 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:56:04.416230 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:56:04.416230 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:56:04.416230 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:56:04.416230 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:56:04.416230 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:56:04.416230 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bc5eda7f-851f-44d8-af95-5e721dd6d52b could not be found. Oct 04 18:56:04.416230 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:56:04.419389 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-d027525c-32e9-42a2-a18a-7536588316da tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Returning 404 to user: Instance bc5eda7f-851f-44d8-af95-5e721dd6d52b could not be found. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:56:04.421774 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-d027525c-32e9-42a2-a18a-7536588316da tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] 10.222.0.43 "GET /compute/v2.1/servers/bc5eda7f-851f-44d8-af95-5e721dd6d52b" status: 404 len: 111 microversion: 2.1 time: 0.092353 Oct 04 18:56:04.425908 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2320/4945] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:04 2022] GET /compute/v2.1/servers/bc5eda7f-851f-44d8-af95-5e721dd6d52b => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:56:04.439100 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-6bc49a22-c6c1-439d-8dee-5bf662820eb7 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Calling method '.version_select at 0x7fb21ea6aaf0>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:04.481480 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-6bc49a22-c6c1-439d-8dee-5bf662820eb7 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-67012356" status: 202 len: 0 microversion: 2.1 time: 0.051062 Oct 04 18:56:04.482837 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2321/4946] 10.222.0.43 () {58 vars in 1215 bytes} [Tue Oct 4 18:56:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-67012356 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:56:04.961420 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-d714664d-58cf-4db7-9778-bd33f5613abb tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9480713a3884233bd28a7986e9a5baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1e7be678b94918a8c9436a3a25eb67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:04.976909 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-d714664d-58cf-4db7-9778-bd33f5613abb tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] 10.222.0.43 "GET /compute/v2.1/servers/f16f7c94-16bc-469b-8b4a-427494496547" status: 200 len: 1314 microversion: 2.1 time: 0.644426 Oct 04 18:56:04.978088 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2626/4947] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:04 2022] GET /compute/v2.1/servers/f16f7c94-16bc-469b-8b4a-427494496547 => generated 1314 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:56:05.016019 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-9b2b60db-c8ba-4d2d-ac62-00ff7b345e6c tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:05.021496 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-9b2b60db-c8ba-4d2d-ac62-00ff7b345e6c tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] [instance: 02a066b4-243b-4fe3-afcf-30f3e9511d1b] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:05.032392 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9b2b60db-c8ba-4d2d-ac62-00ff7b345e6c tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:05.033055 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9b2b60db-c8ba-4d2d-ac62-00ff7b345e6c tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:05.043157 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9b2b60db-c8ba-4d2d-ac62-00ff7b345e6c tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:05.044463 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9b2b60db-c8ba-4d2d-ac62-00ff7b345e6c tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:05.046631 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9b2b60db-c8ba-4d2d-ac62-00ff7b345e6c tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:05.047790 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9b2b60db-c8ba-4d2d-ac62-00ff7b345e6c tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:05.195562 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-e98fc5f5-5fcb-46bc-9f4a-1028f0297948 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:05.196667 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-e98fc5f5-5fcb-46bc-9f4a-1028f0297948 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 01e250ab-d9aa-4708-ae36-10c53a411a40] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:05.222054 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e98fc5f5-5fcb-46bc-9f4a-1028f0297948 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:05.224218 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e98fc5f5-5fcb-46bc-9f4a-1028f0297948 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:05.225382 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e98fc5f5-5fcb-46bc-9f4a-1028f0297948 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:05.227532 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e98fc5f5-5fcb-46bc-9f4a-1028f0297948 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:05.229355 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e98fc5f5-5fcb-46bc-9f4a-1028f0297948 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:05.229988 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e98fc5f5-5fcb-46bc-9f4a-1028f0297948 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:05.791832 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-e98fc5f5-5fcb-46bc-9f4a-1028f0297948 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f63f1ac147543dab34a28a22eb5936c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1607b30b9f324abaa88aa29e04ef3ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:05.798433 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-9b2b60db-c8ba-4d2d-ac62-00ff7b345e6c tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:05.813169 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-e98fc5f5-5fcb-46bc-9f4a-1028f0297948 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40" status: 200 len: 1527 microversion: 2.1 time: 0.624363 Oct 04 18:56:05.816638 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2627/4948] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:05 2022] GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40 => generated 1527 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:56:05.826377 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-9b2b60db-c8ba-4d2d-ac62-00ff7b345e6c tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:05.827892 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-9b2b60db-c8ba-4d2d-ac62-00ff7b345e6c tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:05.829118 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-9b2b60db-c8ba-4d2d-ac62-00ff7b345e6c tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] 10.222.0.43 "GET /compute/v2.1/servers/02a066b4-243b-4fe3-afcf-30f3e9511d1b" status: 200 len: 1875 microversion: 2.42 time: 0.826131 Oct 04 18:56:05.850850 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2322/4949] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:56:05 2022] GET /compute/v2.1/servers/02a066b4-243b-4fe3-afcf-30f3e9511d1b => generated 1875 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:56:06.003460 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-d7b122eb-8397-41b2-a662-7021488a167e tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:06.004281 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-d7b122eb-8397-41b2-a662-7021488a167e tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] [instance: f16f7c94-16bc-469b-8b4a-427494496547] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:06.021477 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d7b122eb-8397-41b2-a662-7021488a167e tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:06.022062 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d7b122eb-8397-41b2-a662-7021488a167e tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:06.022609 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d7b122eb-8397-41b2-a662-7021488a167e tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:06.024283 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d7b122eb-8397-41b2-a662-7021488a167e tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:06.025017 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d7b122eb-8397-41b2-a662-7021488a167e tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:06.029056 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d7b122eb-8397-41b2-a662-7021488a167e tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:06.553986 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-4fdb7a7e-93dd-45da-83a6-1875ae291d9f req-03bda750-cf9c-4da2-86be-f84552ce3ad2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01e250ab-d9aa-4708-ae36-10c53a411a40", "name": "network-vif-plugged", "status": "completed", "tag": "70d1b09a-03d8-41b4-9a82-fc7d75a3624a"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:56:06.578205 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-4fdb7a7e-93dd-45da-83a6-1875ae291d9f req-03bda750-cf9c-4da2-86be-f84552ce3ad2 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:06.581053 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-4fdb7a7e-93dd-45da-83a6-1875ae291d9f req-03bda750-cf9c-4da2-86be-f84552ce3ad2 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:06.581541 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-4fdb7a7e-93dd-45da-83a6-1875ae291d9f req-03bda750-cf9c-4da2-86be-f84552ce3ad2 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:06.613526 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-4fdb7a7e-93dd-45da-83a6-1875ae291d9f req-03bda750-cf9c-4da2-86be-f84552ce3ad2 service nova] Creating event network-vif-plugged:70d1b09a-03d8-41b4-9a82-fc7d75a3624a for instance 01e250ab-d9aa-4708-ae36-10c53a411a40 on n-h2-851028-13 Oct 04 18:56:06.627442 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-4fdb7a7e-93dd-45da-83a6-1875ae291d9f req-03bda750-cf9c-4da2-86be-f84552ce3ad2 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077391 Oct 04 18:56:06.633386 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2323/4950] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:56:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:56:06.846451 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-6c53e249-c845-4f9e-a187-d1c6723cc4f8 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:06.848088 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-6c53e249-c845-4f9e-a187-d1c6723cc4f8 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 01e250ab-d9aa-4708-ae36-10c53a411a40] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:06.869498 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6c53e249-c845-4f9e-a187-d1c6723cc4f8 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:06.882495 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6c53e249-c845-4f9e-a187-d1c6723cc4f8 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:06.883195 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6c53e249-c845-4f9e-a187-d1c6723cc4f8 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:06.892085 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6c53e249-c845-4f9e-a187-d1c6723cc4f8 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:06.893458 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6c53e249-c845-4f9e-a187-d1c6723cc4f8 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:06.893904 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-d7b122eb-8397-41b2-a662-7021488a167e tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9480713a3884233bd28a7986e9a5baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1e7be678b94918a8c9436a3a25eb67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:06.894464 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6c53e249-c845-4f9e-a187-d1c6723cc4f8 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:06.931497 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-d7b122eb-8397-41b2-a662-7021488a167e tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] 10.222.0.43 "GET /compute/v2.1/servers/f16f7c94-16bc-469b-8b4a-427494496547" status: 200 len: 1498 microversion: 2.1 time: 0.932831 Oct 04 18:56:06.932140 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2628/4951] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:05 2022] GET /compute/v2.1/servers/f16f7c94-16bc-469b-8b4a-427494496547 => generated 1498 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:56:06.970099 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-89d53d24-d6a5-4b7a-83fb-61c53bf26961 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:06.970733 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-89d53d24-d6a5-4b7a-83fb-61c53bf26961 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] [instance: 02a066b4-243b-4fe3-afcf-30f3e9511d1b] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:06.988276 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-89d53d24-d6a5-4b7a-83fb-61c53bf26961 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:06.989053 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-89d53d24-d6a5-4b7a-83fb-61c53bf26961 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:06.989810 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-89d53d24-d6a5-4b7a-83fb-61c53bf26961 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:07.010608 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-89d53d24-d6a5-4b7a-83fb-61c53bf26961 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:07.013324 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-89d53d24-d6a5-4b7a-83fb-61c53bf26961 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:07.013820 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-89d53d24-d6a5-4b7a-83fb-61c53bf26961 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:07.291497 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-6c53e249-c845-4f9e-a187-d1c6723cc4f8 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f63f1ac147543dab34a28a22eb5936c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1607b30b9f324abaa88aa29e04ef3ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:07.304055 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-6c53e249-c845-4f9e-a187-d1c6723cc4f8 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40" status: 200 len: 1527 microversion: 2.1 time: 0.463699 Oct 04 18:56:07.313162 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2324/4952] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:06 2022] GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40 => generated 1527 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:56:07.317992 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-8ae2e80d-8e4d-4621-bbc3-168d3ca2d6cd tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Action: 'create', calling method: .version_select at 0x7fb21eaf4820>, body: {"keypair": {"name": "tempest-keypair-1496845502", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFWNWoC+PdlN76oXikFwS/w3M5gRJftSn5ZBMa4/LoC9vl8V31+XHlsSNA0IodFKcLzAJ1r2sTNQomSPhE5uY8JbmjW5a+TijF+zqpUyPxhop366MyJ1OUlWn37SUY16JQ=="}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:56:07.376538 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-8ae2e80d-8e4d-4621-bbc3-168d3ca2d6cd tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Getting quotas for project 6c91c7e7358048ffaaee7f51ad61b515. Resources: {'key_pairs'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:56:07.392006 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-8ae2e80d-8e4d-4621-bbc3-168d3ca2d6cd tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Getting quotas for user 486c22456b1e47ae843ae41f8dfb2632 and project 6c91c7e7358048ffaaee7f51ad61b515. Resources: {'key_pairs'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:56:07.477119 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-8ae2e80d-8e4d-4621-bbc3-168d3ca2d6cd tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.162941 Oct 04 18:56:07.477743 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2325/4953] 10.222.0.43 () {60 vars in 1159 bytes} [Tue Oct 4 18:56:07 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:56:07.721151 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-89d53d24-d6a5-4b7a-83fb-61c53bf26961 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:07.748624 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-89d53d24-d6a5-4b7a-83fb-61c53bf26961 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:07.751081 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-89d53d24-d6a5-4b7a-83fb-61c53bf26961 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:07.756871 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-89d53d24-d6a5-4b7a-83fb-61c53bf26961 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] 10.222.0.43 "GET /compute/v2.1/servers/02a066b4-243b-4fe3-afcf-30f3e9511d1b" status: 200 len: 1875 microversion: 2.42 time: 0.801619 Oct 04 18:56:07.763303 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2629/4954] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:56:06 2022] GET /compute/v2.1/servers/02a066b4-243b-4fe3-afcf-30f3e9511d1b => generated 1875 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:56:07.836336 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-87bd6078-414b-45fd-8a3c-91258a3271e1 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:07.836849 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-87bd6078-414b-45fd-8a3c-91258a3271e1 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] [instance: f16f7c94-16bc-469b-8b4a-427494496547] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:07.845745 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-87bd6078-414b-45fd-8a3c-91258a3271e1 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:07.846539 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-87bd6078-414b-45fd-8a3c-91258a3271e1 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:07.849620 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-87bd6078-414b-45fd-8a3c-91258a3271e1 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:07.851668 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-87bd6078-414b-45fd-8a3c-91258a3271e1 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:07.852646 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-87bd6078-414b-45fd-8a3c-91258a3271e1 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:07.853335 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-87bd6078-414b-45fd-8a3c-91258a3271e1 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:07.905313 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-87bd6078-414b-45fd-8a3c-91258a3271e1 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] [instance: f16f7c94-16bc-469b-8b4a-427494496547] Going to try to terminate instance {{(pid=123595) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:56:08.087453 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-87bd6078-414b-45fd-8a3c-91258a3271e1 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] 10.222.0.43 "DELETE /compute/v2.1/servers/f16f7c94-16bc-469b-8b4a-427494496547" status: 204 len: 0 microversion: 2.1 time: 0.257220 Oct 04 18:56:08.093350 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2326/4955] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 18:56:07 2022] DELETE /compute/v2.1/servers/f16f7c94-16bc-469b-8b4a-427494496547 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:56:08.098381 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-13b87b16-cb9f-4feb-8aa6-24315ce54117 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:08.099067 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-13b87b16-cb9f-4feb-8aa6-24315ce54117 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] [instance: f16f7c94-16bc-469b-8b4a-427494496547] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:08.109161 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-13b87b16-cb9f-4feb-8aa6-24315ce54117 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:08.109665 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-13b87b16-cb9f-4feb-8aa6-24315ce54117 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:08.114250 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-13b87b16-cb9f-4feb-8aa6-24315ce54117 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:08.114960 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-13b87b16-cb9f-4feb-8aa6-24315ce54117 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:08.115481 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-13b87b16-cb9f-4feb-8aa6-24315ce54117 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:08.116038 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-13b87b16-cb9f-4feb-8aa6-24315ce54117 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:08.332542 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-9a3d62b2-59b0-4b37-8b51-ddd61d8617df tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:08.333859 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-9a3d62b2-59b0-4b37-8b51-ddd61d8617df tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 01e250ab-d9aa-4708-ae36-10c53a411a40] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:08.344671 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9a3d62b2-59b0-4b37-8b51-ddd61d8617df tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:08.346636 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9a3d62b2-59b0-4b37-8b51-ddd61d8617df tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:08.348800 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9a3d62b2-59b0-4b37-8b51-ddd61d8617df tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:08.351621 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9a3d62b2-59b0-4b37-8b51-ddd61d8617df tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:08.352666 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9a3d62b2-59b0-4b37-8b51-ddd61d8617df tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:08.354291 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9a3d62b2-59b0-4b37-8b51-ddd61d8617df tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:08.747774 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-9a3d62b2-59b0-4b37-8b51-ddd61d8617df tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f63f1ac147543dab34a28a22eb5936c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1607b30b9f324abaa88aa29e04ef3ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:08.756780 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-9a3d62b2-59b0-4b37-8b51-ddd61d8617df tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40" status: 200 len: 1527 microversion: 2.1 time: 0.429361 Oct 04 18:56:08.772764 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-13b87b16-cb9f-4feb-8aa6-24315ce54117 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9480713a3884233bd28a7986e9a5baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1e7be678b94918a8c9436a3a25eb67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:08.773209 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2327/4956] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:08 2022] GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40 => generated 1527 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:56:08.791420 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-13b87b16-cb9f-4feb-8aa6-24315ce54117 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] 10.222.0.43 "GET /compute/v2.1/servers/f16f7c94-16bc-469b-8b4a-427494496547" status: 200 len: 1504 microversion: 2.1 time: 0.696985 Oct 04 18:56:08.793288 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-0a5c782c-8fe6-4377-b9fa-1f559d00ca29 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:08.793951 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-0a5c782c-8fe6-4377-b9fa-1f559d00ca29 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] [instance: 02a066b4-243b-4fe3-afcf-30f3e9511d1b] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:08.798665 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2630/4957] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:08 2022] GET /compute/v2.1/servers/f16f7c94-16bc-469b-8b4a-427494496547 => generated 1504 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:56:08.826717 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0a5c782c-8fe6-4377-b9fa-1f559d00ca29 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:08.831839 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0a5c782c-8fe6-4377-b9fa-1f559d00ca29 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:08.833471 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0a5c782c-8fe6-4377-b9fa-1f559d00ca29 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:08.836436 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0a5c782c-8fe6-4377-b9fa-1f559d00ca29 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:08.838009 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0a5c782c-8fe6-4377-b9fa-1f559d00ca29 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:08.838761 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0a5c782c-8fe6-4377-b9fa-1f559d00ca29 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:09.290016 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-0a5c782c-8fe6-4377-b9fa-1f559d00ca29 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:09.304948 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-0a5c782c-8fe6-4377-b9fa-1f559d00ca29 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:09.310926 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-0a5c782c-8fe6-4377-b9fa-1f559d00ca29 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:09.317544 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-0a5c782c-8fe6-4377-b9fa-1f559d00ca29 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] 10.222.0.43 "GET /compute/v2.1/servers/02a066b4-243b-4fe3-afcf-30f3e9511d1b" status: 200 len: 1875 microversion: 2.42 time: 0.525000 Oct 04 18:56:09.335326 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2328/4958] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:56:08 2022] GET /compute/v2.1/servers/02a066b4-243b-4fe3-afcf-30f3e9511d1b => generated 1875 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:56:09.790980 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-98bb7712-7914-436d-8e91-5ebb614722cf tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:09.791861 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-98bb7712-7914-436d-8e91-5ebb614722cf tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 01e250ab-d9aa-4708-ae36-10c53a411a40] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:09.807681 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-98bb7712-7914-436d-8e91-5ebb614722cf tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:09.808199 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-98bb7712-7914-436d-8e91-5ebb614722cf tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:09.809085 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-98bb7712-7914-436d-8e91-5ebb614722cf tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:09.813421 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-98bb7712-7914-436d-8e91-5ebb614722cf tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:09.817397 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-98bb7712-7914-436d-8e91-5ebb614722cf tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:09.818253 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-98bb7712-7914-436d-8e91-5ebb614722cf tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:09.824389 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-25c567b6-9c08-4f86-be10-e62504eed405 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:09.825305 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-25c567b6-9c08-4f86-be10-e62504eed405 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] [instance: f16f7c94-16bc-469b-8b4a-427494496547] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:09.844583 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-25c567b6-9c08-4f86-be10-e62504eed405 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:09.845077 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-25c567b6-9c08-4f86-be10-e62504eed405 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:09.849820 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-25c567b6-9c08-4f86-be10-e62504eed405 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:09.850593 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-25c567b6-9c08-4f86-be10-e62504eed405 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:09.853487 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-25c567b6-9c08-4f86-be10-e62504eed405 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:09.853951 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-25c567b6-9c08-4f86-be10-e62504eed405 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:10.374923 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-25c567b6-9c08-4f86-be10-e62504eed405 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9480713a3884233bd28a7986e9a5baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1e7be678b94918a8c9436a3a25eb67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:10.386525 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-25c567b6-9c08-4f86-be10-e62504eed405 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] 10.222.0.43 "GET /compute/v2.1/servers/f16f7c94-16bc-469b-8b4a-427494496547" status: 200 len: 1504 microversion: 2.1 time: 0.566255 Oct 04 18:56:10.401614 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2329/4959] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:09 2022] GET /compute/v2.1/servers/f16f7c94-16bc-469b-8b4a-427494496547 => generated 1504 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:56:10.409147 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-3dd2b23f-fe88-44c9-9348-3460dd97911e tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:10.410176 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-3dd2b23f-fe88-44c9-9348-3460dd97911e tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] [instance: 02a066b4-243b-4fe3-afcf-30f3e9511d1b] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:10.423007 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3dd2b23f-fe88-44c9-9348-3460dd97911e tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:10.428857 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3dd2b23f-fe88-44c9-9348-3460dd97911e tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:10.429775 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3dd2b23f-fe88-44c9-9348-3460dd97911e tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:10.430810 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3dd2b23f-fe88-44c9-9348-3460dd97911e tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:10.431446 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3dd2b23f-fe88-44c9-9348-3460dd97911e tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:10.432080 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3dd2b23f-fe88-44c9-9348-3460dd97911e tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:10.440812 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-98bb7712-7914-436d-8e91-5ebb614722cf tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f63f1ac147543dab34a28a22eb5936c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1607b30b9f324abaa88aa29e04ef3ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:10.455459 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-98bb7712-7914-436d-8e91-5ebb614722cf tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40" status: 200 len: 1527 microversion: 2.1 time: 0.671265 Oct 04 18:56:10.457969 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2631/4960] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:09 2022] GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40 => generated 1527 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:56:10.924458 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-3dd2b23f-fe88-44c9-9348-3460dd97911e tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:10.945593 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-3dd2b23f-fe88-44c9-9348-3460dd97911e tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:10.950121 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-3dd2b23f-fe88-44c9-9348-3460dd97911e tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:10.959686 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-3dd2b23f-fe88-44c9-9348-3460dd97911e tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] 10.222.0.43 "GET /compute/v2.1/servers/02a066b4-243b-4fe3-afcf-30f3e9511d1b" status: 200 len: 1875 microversion: 2.42 time: 0.552681 Oct 04 18:56:10.973359 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2330/4961] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:56:10 2022] GET /compute/v2.1/servers/02a066b4-243b-4fe3-afcf-30f3e9511d1b => generated 1875 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:56:11.292599 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-c3eae041-1c81-4aad-96c5-3f0b634e8eb4 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1151362256", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3f21e827-5829-48b0-82ff-093e57296b22"}], "security_groups": [{"name": "tempest-securitygroup--196369119"}], "key_name": "tempest-keypair-1496845502", "user_data": "}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:56:11.417047 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-85e7d5fe-5b30-463e-8d51-cdd5ffcedd32 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:11.417702 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-85e7d5fe-5b30-463e-8d51-cdd5ffcedd32 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] [instance: f16f7c94-16bc-469b-8b4a-427494496547] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:11.433461 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-85e7d5fe-5b30-463e-8d51-cdd5ffcedd32 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:11.433962 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-85e7d5fe-5b30-463e-8d51-cdd5ffcedd32 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:11.434402 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-85e7d5fe-5b30-463e-8d51-cdd5ffcedd32 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:11.435116 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-85e7d5fe-5b30-463e-8d51-cdd5ffcedd32 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:11.435570 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-85e7d5fe-5b30-463e-8d51-cdd5ffcedd32 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:11.436000 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-85e7d5fe-5b30-463e-8d51-cdd5ffcedd32 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:11.572078 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.network.neutron [None req-c3eae041-1c81-4aad-96c5-3f0b634e8eb4 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] validate_networks() for [('3f21e827-5829-48b0-82ff-093e57296b22', None, None, None, None, None)] {{(pid=123596) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:56:12.042310 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-85e7d5fe-5b30-463e-8d51-cdd5ffcedd32 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9480713a3884233bd28a7986e9a5baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1e7be678b94918a8c9436a3a25eb67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:12.054551 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-85e7d5fe-5b30-463e-8d51-cdd5ffcedd32 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] 10.222.0.43 "GET /compute/v2.1/servers/f16f7c94-16bc-469b-8b4a-427494496547" status: 200 len: 1504 microversion: 2.1 time: 0.642863 Oct 04 18:56:12.056281 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2331/4962] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:11 2022] GET /compute/v2.1/servers/f16f7c94-16bc-469b-8b4a-427494496547 => generated 1504 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:56:12.063597 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-f912cebd-2228-416e-bbba-cdba7fd93efe tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:12.069282 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-f912cebd-2228-416e-bbba-cdba7fd93efe tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b16d1e957e30423e9b06c6150e5c4a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74c55e15cfd4f2c9ce67c9aa91c1b5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:12.070489 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-f912cebd-2228-416e-bbba-cdba7fd93efe tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Searching by: {'deleted': False, 'project_id': 'b74c55e15cfd4f2c9ce67c9aa91c1b5d'} {{(pid=123595) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:56:12.076940 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f912cebd-2228-416e-bbba-cdba7fd93efe tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:12.078384 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f912cebd-2228-416e-bbba-cdba7fd93efe tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:12.079042 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f912cebd-2228-416e-bbba-cdba7fd93efe tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:12.080118 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f912cebd-2228-416e-bbba-cdba7fd93efe tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:12.080805 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f912cebd-2228-416e-bbba-cdba7fd93efe tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:12.081529 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f912cebd-2228-416e-bbba-cdba7fd93efe tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:12.143923 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.multi_cell_list [None req-f912cebd-2228-416e-bbba-cdba7fd93efe tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=123595) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 18:56:12.239816 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-f912cebd-2228-416e-bbba-cdba7fd93efe tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] 10.222.0.43 "GET /compute/v2.1/servers" status: 200 len: 333 microversion: 2.1 time: 0.179097 Oct 04 18:56:12.245187 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2332/4963] 10.222.0.43 () {58 vars in 1125 bytes} [Tue Oct 4 18:56:12 2022] GET /compute/v2.1/servers => generated 333 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:56:12.258844 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-1196ac7f-5509-4be1-acd8-22a00c236052 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:12.261030 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-1196ac7f-5509-4be1-acd8-22a00c236052 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 01e250ab-d9aa-4708-ae36-10c53a411a40] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:12.274391 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1196ac7f-5509-4be1-acd8-22a00c236052 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:12.285946 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1196ac7f-5509-4be1-acd8-22a00c236052 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:12.286693 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1196ac7f-5509-4be1-acd8-22a00c236052 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:12.287649 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1196ac7f-5509-4be1-acd8-22a00c236052 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:12.288290 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1196ac7f-5509-4be1-acd8-22a00c236052 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:12.288908 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1196ac7f-5509-4be1-acd8-22a00c236052 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:12.512157 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-1196ac7f-5509-4be1-acd8-22a00c236052 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f63f1ac147543dab34a28a22eb5936c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1607b30b9f324abaa88aa29e04ef3ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:12.527656 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-1196ac7f-5509-4be1-acd8-22a00c236052 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40" status: 200 len: 1527 microversion: 2.1 time: 0.284812 Oct 04 18:56:12.529025 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2333/4964] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:12 2022] GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40 => generated 1527 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:56:12.536410 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-7c6a928f-ca4e-478e-a68e-716eb1e1ce1f tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:12.537490 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-7c6a928f-ca4e-478e-a68e-716eb1e1ce1f tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] [instance: 02a066b4-243b-4fe3-afcf-30f3e9511d1b] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:12.544284 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7c6a928f-ca4e-478e-a68e-716eb1e1ce1f tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:12.545278 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7c6a928f-ca4e-478e-a68e-716eb1e1ce1f tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:12.546009 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7c6a928f-ca4e-478e-a68e-716eb1e1ce1f tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:12.546941 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7c6a928f-ca4e-478e-a68e-716eb1e1ce1f tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:12.547600 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7c6a928f-ca4e-478e-a68e-716eb1e1ce1f tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:12.548224 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7c6a928f-ca4e-478e-a68e-716eb1e1ce1f tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:12.882691 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-7c6a928f-ca4e-478e-a68e-716eb1e1ce1f tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:12.899493 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-7c6a928f-ca4e-478e-a68e-716eb1e1ce1f tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:12.901403 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-7c6a928f-ca4e-478e-a68e-716eb1e1ce1f tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:12.902914 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-7c6a928f-ca4e-478e-a68e-716eb1e1ce1f tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] 10.222.0.43 "GET /compute/v2.1/servers/02a066b4-243b-4fe3-afcf-30f3e9511d1b" status: 200 len: 1875 microversion: 2.42 time: 0.370706 Oct 04 18:56:12.904110 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2334/4965] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:56:12 2022] GET /compute/v2.1/servers/02a066b4-243b-4fe3-afcf-30f3e9511d1b => generated 1875 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:56:12.928457 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-97b43430-ad8d-463d-bff3-2ba4b7db817f req-38d87fa7-22e1-4684-85cd-be4a1887b3cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f16f7c94-16bc-469b-8b4a-427494496547", "name": "network-vif-deleted", "tag": "d7aad276-429f-46fa-b403-435dda37c7c6"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:56:12.947569 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-97b43430-ad8d-463d-bff3-2ba4b7db817f req-38d87fa7-22e1-4684-85cd-be4a1887b3cf service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:12.960620 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-97b43430-ad8d-463d-bff3-2ba4b7db817f req-38d87fa7-22e1-4684-85cd-be4a1887b3cf service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:12.961455 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-97b43430-ad8d-463d-bff3-2ba4b7db817f req-38d87fa7-22e1-4684-85cd-be4a1887b3cf service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:12.981137 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-97b43430-ad8d-463d-bff3-2ba4b7db817f req-38d87fa7-22e1-4684-85cd-be4a1887b3cf service nova] Creating event network-vif-deleted:d7aad276-429f-46fa-b403-435dda37c7c6 for instance f16f7c94-16bc-469b-8b4a-427494496547 on n-h2-851028-13 Oct 04 18:56:12.999831 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-97b43430-ad8d-463d-bff3-2ba4b7db817f req-38d87fa7-22e1-4684-85cd-be4a1887b3cf service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093096 Oct 04 18:56:13.001771 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2335/4966] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:56:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:56:13.014097 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-be8dbff1-4a46-4209-99d6-8a3186c62b65 tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:13.041331 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-be8dbff1-4a46-4209-99d6-8a3186c62b65 tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b16d1e957e30423e9b06c6150e5c4a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74c55e15cfd4f2c9ce67c9aa91c1b5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:13.042784 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-be8dbff1-4a46-4209-99d6-8a3186c62b65 tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Searching by: {'deleted': False, 'project_id': 'b74c55e15cfd4f2c9ce67c9aa91c1b5d'} {{(pid=123595) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:56:13.050826 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-be8dbff1-4a46-4209-99d6-8a3186c62b65 tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:13.051609 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-be8dbff1-4a46-4209-99d6-8a3186c62b65 tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:13.052238 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-be8dbff1-4a46-4209-99d6-8a3186c62b65 tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:13.054307 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-be8dbff1-4a46-4209-99d6-8a3186c62b65 tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:13.055402 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-be8dbff1-4a46-4209-99d6-8a3186c62b65 tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:13.057673 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-be8dbff1-4a46-4209-99d6-8a3186c62b65 tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:13.111285 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:56:13.115881 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.multi_cell_list [None req-be8dbff1-4a46-4209-99d6-8a3186c62b65 tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=123595) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 18:56:13.167908 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-be8dbff1-4a46-4209-99d6-8a3186c62b65 tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16d1e957e30423e9b06c6150e5c4a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74c55e15cfd4f2c9ce67c9aa91c1b5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:13.190116 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-be8dbff1-4a46-4209-99d6-8a3186c62b65 tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:13.191230 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-be8dbff1-4a46-4209-99d6-8a3186c62b65 tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:13.191939 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-be8dbff1-4a46-4209-99d6-8a3186c62b65 tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:13.414480 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-be8dbff1-4a46-4209-99d6-8a3186c62b65 tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] 10.222.0.43 "GET /compute/v2.1/servers/detail" status: 200 len: 1695 microversion: 2.1 time: 0.410698 Oct 04 18:56:13.415932 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2336/4967] 10.222.0.43 () {58 vars in 1146 bytes} [Tue Oct 4 18:56:13 2022] GET /compute/v2.1/servers/detail => generated 1695 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:56:13.430068 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-166d33d5-4dda-4881-a10f-5cb38b611d8a tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:13.436727 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-166d33d5-4dda-4881-a10f-5cb38b611d8a tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] [instance: f16f7c94-16bc-469b-8b4a-427494496547] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:13.449557 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-166d33d5-4dda-4881-a10f-5cb38b611d8a tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:13.450854 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-166d33d5-4dda-4881-a10f-5cb38b611d8a tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:13.451541 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-166d33d5-4dda-4881-a10f-5cb38b611d8a tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:13.453864 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-166d33d5-4dda-4881-a10f-5cb38b611d8a tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:13.454632 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-166d33d5-4dda-4881-a10f-5cb38b611d8a tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:13.455894 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-166d33d5-4dda-4881-a10f-5cb38b611d8a tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:13.493284 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-166d33d5-4dda-4881-a10f-5cb38b611d8a tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] HTTP exception thrown: Instance f16f7c94-16bc-469b-8b4a-427494496547 could not be found. Oct 04 18:56:13.495646 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-166d33d5-4dda-4881-a10f-5cb38b611d8a tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Request method failure captured: Oct 04 18:56:13.495646 n-d-851028-13 devstack@n-api.service[123595]: request: GET /compute/v2.1/servers/f16f7c94-16bc-469b-8b4a-427494496547 HTTP/1.1 Oct 04 18:56:13.495646 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 18:56:13.495646 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 18:56:13.495646 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 18:56:13.495646 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 0 Oct 04 18:56:13.495646 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 18:56:13.495646 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 18:56:13.495646 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 18:56:13.495646 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 18:56:13.495646 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPIGt-yvZxl0GTwXnRB6p81XDksSOraToXvUWED8fBxd8Npb6p_ctqZTx68NMnIRuYCZW6jWfDXEOStXphbp4I1OB7535N2AjO52YQ1Or9ozd3ufG2r2WPnwBKsG8dqbvWgjEazKp1P4wYbFiNtwOmrkimsMepBHm_n9aspVUsKLEUyQ Oct 04 18:56:13.495646 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 18:56:13.495646 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 18:56:13.495646 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 18:56:13.495646 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 18:56:13.495646 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 18:56:13.495646 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 18:56:13.495646 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: 0c1e7be678b94918a8c9436a3a25eb67 Oct 04 18:56:13.495646 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-VolumesActionsTest-1905739150 Oct 04 18:56:13.495646 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 18:56:13.495646 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 18:56:13.495646 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/0c1e7be678b94918a8c9436a3a25eb67"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_0c1e7be678b94918a8c9436a3a25eb67"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0c1e7be678b94918a8c9436a3a25eb67"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0c1e7be678b94918a8c9436a3a25eb67"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:56:13.495646 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-VolumesActionsTest-1905739150 Oct 04 18:56:13.495646 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: 0c1e7be678b94918a8c9436a3a25eb67 Oct 04 18:56:13.495646 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-VolumesActionsTest-1905739150 Oct 04 18:56:13.495646 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-VolumesActionsTest-1905739150-project Oct 04 18:56:13.495646 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 18:56:13.495646 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 18:56:13.495646 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: a9480713a3884233bd28a7986e9a5baf Oct 04 18:56:13.495646 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-VolumesActionsTest-1905739150-project Oct 04 18:56:13.495646 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 18:56:13.495646 n-d-851028-13 devstack@n-api.service[123595]: exception: Instance f16f7c94-16bc-469b-8b4a-427494496547 could not be found. Oct 04 18:56:13.495646 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': 'f16f7c94-16bc-469b-8b4a-427494496547'} Oct 04 18:56:13.495646 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:56:13.495646 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:56:13.495646 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:56:13.495646 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:56:13.495646 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:56:13.495646 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:56:13.495646 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:56:13.495646 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:56:13.495646 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:56:13.495646 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:56:13.495646 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f16f7c94-16bc-469b-8b4a-427494496547 could not be found. Oct 04 18:56:13.495646 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:56:13.495646 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:56:13.495646 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:56:13.495646 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:56:13.495646 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:56:13.495646 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:56:13.495646 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:56:13.495646 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:56:13.495646 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:56:13.495646 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:56:13.495646 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:56:13.495646 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:56:13.495646 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:56:13.495646 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:56:13.495646 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:56:13.495646 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:56:13.495646 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f16f7c94-16bc-469b-8b4a-427494496547 could not be found. Oct 04 18:56:13.495646 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:56:13.495646 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:56:13.495646 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:56:13.502036 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:56:13.502036 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:56:13.502036 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:56:13.502036 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:56:13.502036 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:56:13.502036 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f16f7c94-16bc-469b-8b4a-427494496547 could not be found. Oct 04 18:56:13.502036 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:56:13.507894 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-166d33d5-4dda-4881-a10f-5cb38b611d8a tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Returning 404 to user: Instance f16f7c94-16bc-469b-8b4a-427494496547 could not be found. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:56:13.514461 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-166d33d5-4dda-4881-a10f-5cb38b611d8a tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] 10.222.0.43 "GET /compute/v2.1/servers/f16f7c94-16bc-469b-8b4a-427494496547" status: 404 len: 111 microversion: 2.1 time: 0.091829 Oct 04 18:56:13.536415 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2337/4968] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:13 2022] GET /compute/v2.1/servers/f16f7c94-16bc-469b-8b4a-427494496547 => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:56:13.569882 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-8df65662-6a60-41a7-8073-455fc45b6481 tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:13.642035 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-8df65662-6a60-41a7-8073-455fc45b6481 tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] 10.222.0.43 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.104255 Oct 04 18:56:13.646297 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2338/4969] 10.222.0.43 () {58 vars in 1137 bytes} [Tue Oct 4 18:56:13 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:56:13.667025 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-1bde46db-7f05-4e5a-9101-40758d6468a9 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:13.674907 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-1bde46db-7f05-4e5a-9101-40758d6468a9 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 01e250ab-d9aa-4708-ae36-10c53a411a40] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:13.684992 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-c3eae041-1c81-4aad-96c5-3f0b634e8eb4 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Flavor limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:56:13.687080 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1bde46db-7f05-4e5a-9101-40758d6468a9 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:13.687557 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-c3eae041-1c81-4aad-96c5-3f0b634e8eb4 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Image limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:56:13.687986 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1bde46db-7f05-4e5a-9101-40758d6468a9 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:13.688277 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-c3eae041-1c81-4aad-96c5-3f0b634e8eb4 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Flavor pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:56:13.688786 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1bde46db-7f05-4e5a-9101-40758d6468a9 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:13.688923 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-c3eae041-1c81-4aad-96c5-3f0b634e8eb4 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Image pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:56:13.689651 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-c3eae041-1c81-4aad-96c5-3f0b634e8eb4 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:56:13.690018 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1bde46db-7f05-4e5a-9101-40758d6468a9 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:13.690934 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1bde46db-7f05-4e5a-9101-40758d6468a9 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:13.691540 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1bde46db-7f05-4e5a-9101-40758d6468a9 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:13.743342 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c3eae041-1c81-4aad-96c5-3f0b634e8eb4 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:13.744694 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c3eae041-1c81-4aad-96c5-3f0b634e8eb4 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:13.746123 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c3eae041-1c81-4aad-96c5-3f0b634e8eb4 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:13.753729 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c3eae041-1c81-4aad-96c5-3f0b634e8eb4 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:13.755071 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c3eae041-1c81-4aad-96c5-3f0b634e8eb4 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:13.757746 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c3eae041-1c81-4aad-96c5-3f0b634e8eb4 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:13.825279 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-c3eae041-1c81-4aad-96c5-3f0b634e8eb4 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Getting quotas for project 6c91c7e7358048ffaaee7f51ad61b515. Resources: {'ram', 'cores', 'instances'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:56:13.838152 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-c3eae041-1c81-4aad-96c5-3f0b634e8eb4 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Getting quotas for user 486c22456b1e47ae843ae41f8dfb2632 and project 6c91c7e7358048ffaaee7f51ad61b515. Resources: {'ram', 'cores', 'instances'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:56:13.877601 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-c3eae041-1c81-4aad-96c5-3f0b634e8eb4 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Going to run 1 instances... {{(pid=123596) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:56:13.888087 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-c3eae041-1c81-4aad-96c5-3f0b634e8eb4 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] [instance: a45d1b74-2d81-4e11-b837-fe77dc63f689] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e8943ec5-4038-4d4b-b9b9-2415a79f5243',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123596) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:56:14.036170 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-c3eae041-1c81-4aad-96c5-3f0b634e8eb4 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.747827 Oct 04 18:56:14.041876 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2632/4970] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 18:56:11 2022] POST /compute/v2.1/servers => generated 401 bytes in 2753 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:56:14.054822 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-79912e26-494c-42fa-acfe-09ee8961cd4b tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:14.055836 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-79912e26-494c-42fa-acfe-09ee8961cd4b tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] [instance: 02a066b4-243b-4fe3-afcf-30f3e9511d1b] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:14.079703 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-79912e26-494c-42fa-acfe-09ee8961cd4b tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:14.082246 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-79912e26-494c-42fa-acfe-09ee8961cd4b tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:14.083509 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-79912e26-494c-42fa-acfe-09ee8961cd4b tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:14.086126 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-79912e26-494c-42fa-acfe-09ee8961cd4b tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:14.088908 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-79912e26-494c-42fa-acfe-09ee8961cd4b tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:14.089563 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-79912e26-494c-42fa-acfe-09ee8961cd4b tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:14.467244 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-1bde46db-7f05-4e5a-9101-40758d6468a9 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f63f1ac147543dab34a28a22eb5936c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1607b30b9f324abaa88aa29e04ef3ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:14.481530 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-1bde46db-7f05-4e5a-9101-40758d6468a9 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40" status: 200 len: 1527 microversion: 2.1 time: 0.831195 Oct 04 18:56:14.486205 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2339/4971] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:13 2022] GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40 => generated 1527 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:56:14.495363 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-aa705c56-c71e-4cc7-9bdc-7bec3c8c885c tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-88462406", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452", "networks": [{"uuid": "3ed21dbf-04d5-4319-be25-7d1b6c6f5080"}]}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:56:14.607160 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.network.neutron [None req-aa705c56-c71e-4cc7-9bdc-7bec3c8c885c tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] validate_networks() for [('3ed21dbf-04d5-4319-be25-7d1b6c6f5080', None, None, None, None, None)] {{(pid=123595) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:56:15.171503 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-79912e26-494c-42fa-acfe-09ee8961cd4b tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:15.199798 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-79912e26-494c-42fa-acfe-09ee8961cd4b tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:15.203273 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-79912e26-494c-42fa-acfe-09ee8961cd4b tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:15.210382 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-79912e26-494c-42fa-acfe-09ee8961cd4b tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] 10.222.0.43 "GET /compute/v2.1/servers/02a066b4-243b-4fe3-afcf-30f3e9511d1b" status: 200 len: 1875 microversion: 2.42 time: 1.165950 Oct 04 18:56:15.210564 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2633/4972] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:56:14 2022] GET /compute/v2.1/servers/02a066b4-243b-4fe3-afcf-30f3e9511d1b => generated 1875 bytes in 1167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:56:15.222316 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-0134c1a5-1ad2-4d7a-8085-f5c88df1a945 tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:15.223907 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-0134c1a5-1ad2-4d7a-8085-f5c88df1a945 tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] [instance: e20fa332-f87b-47b3-a30c-52716e5e7a45] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:15.244642 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0134c1a5-1ad2-4d7a-8085-f5c88df1a945 tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:15.247311 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0134c1a5-1ad2-4d7a-8085-f5c88df1a945 tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:15.249873 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0134c1a5-1ad2-4d7a-8085-f5c88df1a945 tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:15.250778 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0134c1a5-1ad2-4d7a-8085-f5c88df1a945 tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:15.251621 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0134c1a5-1ad2-4d7a-8085-f5c88df1a945 tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:15.252174 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0134c1a5-1ad2-4d7a-8085-f5c88df1a945 tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:15.298800 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-0134c1a5-1ad2-4d7a-8085-f5c88df1a945 tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] [instance: e20fa332-f87b-47b3-a30c-52716e5e7a45] Going to try to terminate instance {{(pid=123596) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:56:15.429924 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:56:15.568670 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-0134c1a5-1ad2-4d7a-8085-f5c88df1a945 tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] 10.222.0.43 "DELETE /compute/v2.1/servers/e20fa332-f87b-47b3-a30c-52716e5e7a45" status: 204 len: 0 microversion: 2.1 time: 0.354992 Oct 04 18:56:15.576134 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2634/4973] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 18:56:15 2022] DELETE /compute/v2.1/servers/e20fa332-f87b-47b3-a30c-52716e5e7a45 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:56:15.596901 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-6c56062b-354d-4191-b0a3-5ae4b91ddb11 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:15.598119 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-6c56062b-354d-4191-b0a3-5ae4b91ddb11 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] [instance: a45d1b74-2d81-4e11-b837-fe77dc63f689] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:15.606042 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6c56062b-354d-4191-b0a3-5ae4b91ddb11 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:15.607010 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6c56062b-354d-4191-b0a3-5ae4b91ddb11 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:15.607707 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6c56062b-354d-4191-b0a3-5ae4b91ddb11 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:15.609452 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6c56062b-354d-4191-b0a3-5ae4b91ddb11 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:15.610170 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6c56062b-354d-4191-b0a3-5ae4b91ddb11 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:15.615578 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6c56062b-354d-4191-b0a3-5ae4b91ddb11 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:15.895440 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-6c56062b-354d-4191-b0a3-5ae4b91ddb11 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '486c22456b1e47ae843ae41f8dfb2632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c91c7e7358048ffaaee7f51ad61b515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:15.915914 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-6c56062b-354d-4191-b0a3-5ae4b91ddb11 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] 10.222.0.43 "GET /compute/v2.1/servers/a45d1b74-2d81-4e11-b837-fe77dc63f689" status: 200 len: 1294 microversion: 2.1 time: 0.337483 Oct 04 18:56:15.918026 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2635/4974] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:15 2022] GET /compute/v2.1/servers/a45d1b74-2d81-4e11-b837-fe77dc63f689 => generated 1294 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:56:15.925713 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-26c0f875-7531-4b7a-8ade-4238b111d62b tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:15.927785 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-26c0f875-7531-4b7a-8ade-4238b111d62b tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 01e250ab-d9aa-4708-ae36-10c53a411a40] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:15.948906 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-26c0f875-7531-4b7a-8ade-4238b111d62b tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:15.954013 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-26c0f875-7531-4b7a-8ade-4238b111d62b tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:15.955326 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-26c0f875-7531-4b7a-8ade-4238b111d62b tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:15.960279 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-26c0f875-7531-4b7a-8ade-4238b111d62b tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:15.961362 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-26c0f875-7531-4b7a-8ade-4238b111d62b tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:15.964822 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-26c0f875-7531-4b7a-8ade-4238b111d62b tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:16.250229 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-aa705c56-c71e-4cc7-9bdc-7bec3c8c885c tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Flavor limits 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:56:16.251656 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-aa705c56-c71e-4cc7-9bdc-7bec3c8c885c tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Image limits 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:56:16.252373 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-aa705c56-c71e-4cc7-9bdc-7bec3c8c885c tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Flavor pref 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:56:16.253330 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-aa705c56-c71e-4cc7-9bdc-7bec3c8c885c tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Image pref 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:56:16.254000 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-aa705c56-c71e-4cc7-9bdc-7bec3c8c885c tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:56:16.273616 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-aa705c56-c71e-4cc7-9bdc-7bec3c8c885c tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:16.274209 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-aa705c56-c71e-4cc7-9bdc-7bec3c8c885c tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:16.274891 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-aa705c56-c71e-4cc7-9bdc-7bec3c8c885c tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:16.275809 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-aa705c56-c71e-4cc7-9bdc-7bec3c8c885c tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:16.282265 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-aa705c56-c71e-4cc7-9bdc-7bec3c8c885c tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:16.282768 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-aa705c56-c71e-4cc7-9bdc-7bec3c8c885c tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:16.327064 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-aa705c56-c71e-4cc7-9bdc-7bec3c8c885c tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Getting quotas for project 0c1e7be678b94918a8c9436a3a25eb67. Resources: {'ram', 'cores', 'instances'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:56:16.342015 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-aa705c56-c71e-4cc7-9bdc-7bec3c8c885c tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Getting quotas for user a9480713a3884233bd28a7986e9a5baf and project 0c1e7be678b94918a8c9436a3a25eb67. Resources: {'ram', 'cores', 'instances'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:56:16.359133 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:56:16.375788 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-aa705c56-c71e-4cc7-9bdc-7bec3c8c885c tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Going to run 1 instances... {{(pid=123595) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:56:16.394674 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-aa705c56-c71e-4cc7-9bdc-7bec3c8c885c tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] [instance: a19e214d-9bda-46c8-92dd-e2457b82508f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e8943ec5-4038-4d4b-b9b9-2415a79f5243',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:56:16.503533 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-aa705c56-c71e-4cc7-9bdc-7bec3c8c885c tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.016005 Oct 04 18:56:16.504531 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2340/4975] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 18:56:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 2017 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:56:16.510713 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-b8cc2590-188a-4781-892c-3be6da425254 tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:16.511369 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-b8cc2590-188a-4781-892c-3be6da425254 tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] [instance: e20fa332-f87b-47b3-a30c-52716e5e7a45] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:16.548247 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b8cc2590-188a-4781-892c-3be6da425254 tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:16.548737 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b8cc2590-188a-4781-892c-3be6da425254 tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:16.553348 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b8cc2590-188a-4781-892c-3be6da425254 tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:16.554230 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b8cc2590-188a-4781-892c-3be6da425254 tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:16.554695 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b8cc2590-188a-4781-892c-3be6da425254 tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:16.555136 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b8cc2590-188a-4781-892c-3be6da425254 tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:16.637585 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-26c0f875-7531-4b7a-8ade-4238b111d62b tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f63f1ac147543dab34a28a22eb5936c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1607b30b9f324abaa88aa29e04ef3ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:16.647824 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-26c0f875-7531-4b7a-8ade-4238b111d62b tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40" status: 200 len: 1527 microversion: 2.1 time: 0.728294 Oct 04 18:56:16.665808 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2636/4976] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:15 2022] GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40 => generated 1527 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:56:16.679869 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-6e9e39e0-f226-4650-8366-d7f284812cec tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:16.683490 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-6e9e39e0-f226-4650-8366-d7f284812cec tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] [instance: 02a066b4-243b-4fe3-afcf-30f3e9511d1b] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:16.699046 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6e9e39e0-f226-4650-8366-d7f284812cec tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:16.701589 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6e9e39e0-f226-4650-8366-d7f284812cec tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:16.703111 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6e9e39e0-f226-4650-8366-d7f284812cec tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:16.705460 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6e9e39e0-f226-4650-8366-d7f284812cec tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:16.706217 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6e9e39e0-f226-4650-8366-d7f284812cec tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:16.709441 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6e9e39e0-f226-4650-8366-d7f284812cec tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:18.007448 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-6e9e39e0-f226-4650-8366-d7f284812cec tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:18.024754 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-6e9e39e0-f226-4650-8366-d7f284812cec tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:18.026801 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-6e9e39e0-f226-4650-8366-d7f284812cec tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:18.029960 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-6e9e39e0-f226-4650-8366-d7f284812cec tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] 10.222.0.43 "GET /compute/v2.1/servers/02a066b4-243b-4fe3-afcf-30f3e9511d1b" status: 200 len: 1875 microversion: 2.42 time: 1.361918 Oct 04 18:56:18.037204 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2637/4977] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:56:16 2022] GET /compute/v2.1/servers/02a066b4-243b-4fe3-afcf-30f3e9511d1b => generated 1875 bytes in 1368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:56:18.048185 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-bad0732e-becd-4746-b0ab-ae57fa4decc1 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:18.049562 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-bad0732e-becd-4746-b0ab-ae57fa4decc1 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] [instance: a19e214d-9bda-46c8-92dd-e2457b82508f] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:18.065568 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bad0732e-becd-4746-b0ab-ae57fa4decc1 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:18.068853 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bad0732e-becd-4746-b0ab-ae57fa4decc1 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:18.071363 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bad0732e-becd-4746-b0ab-ae57fa4decc1 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:18.072223 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bad0732e-becd-4746-b0ab-ae57fa4decc1 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:18.072705 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bad0732e-becd-4746-b0ab-ae57fa4decc1 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:18.078534 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bad0732e-becd-4746-b0ab-ae57fa4decc1 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:18.261067 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-bad0732e-becd-4746-b0ab-ae57fa4decc1 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9480713a3884233bd28a7986e9a5baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1e7be678b94918a8c9436a3a25eb67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:18.273310 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-bad0732e-becd-4746-b0ab-ae57fa4decc1 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] 10.222.0.43 "GET /compute/v2.1/servers/a19e214d-9bda-46c8-92dd-e2457b82508f" status: 200 len: 1208 microversion: 2.1 time: 0.233325 Oct 04 18:56:18.275928 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2638/4978] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:18 2022] GET /compute/v2.1/servers/a19e214d-9bda-46c8-92dd-e2457b82508f => generated 1208 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:56:18.288885 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-572c9b4e-e42b-491a-ab88-ab1fbbe279dd tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:18.289968 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-572c9b4e-e42b-491a-ab88-ab1fbbe279dd tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] [instance: a45d1b74-2d81-4e11-b837-fe77dc63f689] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:18.309777 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-572c9b4e-e42b-491a-ab88-ab1fbbe279dd tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:18.312268 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-572c9b4e-e42b-491a-ab88-ab1fbbe279dd tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:18.312977 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-572c9b4e-e42b-491a-ab88-ab1fbbe279dd tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:18.314851 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-572c9b4e-e42b-491a-ab88-ab1fbbe279dd tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:18.316923 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-572c9b4e-e42b-491a-ab88-ab1fbbe279dd tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:18.318124 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-572c9b4e-e42b-491a-ab88-ab1fbbe279dd tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:18.602228 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-572c9b4e-e42b-491a-ab88-ab1fbbe279dd tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '486c22456b1e47ae843ae41f8dfb2632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c91c7e7358048ffaaee7f51ad61b515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:18.613976 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-572c9b4e-e42b-491a-ab88-ab1fbbe279dd tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] 10.222.0.43 "GET /compute/v2.1/servers/a45d1b74-2d81-4e11-b837-fe77dc63f689" status: 200 len: 1300 microversion: 2.1 time: 0.336716 Oct 04 18:56:18.617100 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-b8cc2590-188a-4781-892c-3be6da425254 tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16d1e957e30423e9b06c6150e5c4a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74c55e15cfd4f2c9ce67c9aa91c1b5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:18.627206 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-b8cc2590-188a-4781-892c-3be6da425254 tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] 10.222.0.43 "GET /compute/v2.1/servers/e20fa332-f87b-47b3-a30c-52716e5e7a45" status: 200 len: 1698 microversion: 2.1 time: 2.121350 Oct 04 18:56:18.634964 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2341/4979] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:16 2022] GET /compute/v2.1/servers/e20fa332-f87b-47b3-a30c-52716e5e7a45 => generated 1698 bytes in 2130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:56:18.646704 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2639/4980] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:18 2022] GET /compute/v2.1/servers/a45d1b74-2d81-4e11-b837-fe77dc63f689 => generated 1300 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:56:18.649933 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-ae57d9d7-9973-4f5b-9de2-615d2cd61874 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:18.650749 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-ae57d9d7-9973-4f5b-9de2-615d2cd61874 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 01e250ab-d9aa-4708-ae36-10c53a411a40] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:18.668958 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ae57d9d7-9973-4f5b-9de2-615d2cd61874 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:18.676628 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ae57d9d7-9973-4f5b-9de2-615d2cd61874 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:18.677439 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ae57d9d7-9973-4f5b-9de2-615d2cd61874 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:18.678382 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ae57d9d7-9973-4f5b-9de2-615d2cd61874 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:18.679967 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ae57d9d7-9973-4f5b-9de2-615d2cd61874 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:18.680599 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ae57d9d7-9973-4f5b-9de2-615d2cd61874 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:19.062713 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-6894c64a-de4f-44ef-a761-d2b23ed7c5d4 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:19.062713 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-6894c64a-de4f-44ef-a761-d2b23ed7c5d4 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] [instance: 02a066b4-243b-4fe3-afcf-30f3e9511d1b] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:19.107019 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6894c64a-de4f-44ef-a761-d2b23ed7c5d4 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:19.107750 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6894c64a-de4f-44ef-a761-d2b23ed7c5d4 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:19.109793 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6894c64a-de4f-44ef-a761-d2b23ed7c5d4 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:19.111671 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6894c64a-de4f-44ef-a761-d2b23ed7c5d4 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:19.116386 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6894c64a-de4f-44ef-a761-d2b23ed7c5d4 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:19.118785 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6894c64a-de4f-44ef-a761-d2b23ed7c5d4 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:19.362756 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-ae57d9d7-9973-4f5b-9de2-615d2cd61874 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f63f1ac147543dab34a28a22eb5936c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1607b30b9f324abaa88aa29e04ef3ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:19.386552 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-ae57d9d7-9973-4f5b-9de2-615d2cd61874 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40" status: 200 len: 1527 microversion: 2.1 time: 0.750054 Oct 04 18:56:19.401558 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2342/4981] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:18 2022] GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40 => generated 1527 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:56:19.401558 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-157150ad-dde6-4f75-9235-e3866acef514 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:19.401558 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-157150ad-dde6-4f75-9235-e3866acef514 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] [instance: a19e214d-9bda-46c8-92dd-e2457b82508f] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:19.415702 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-157150ad-dde6-4f75-9235-e3866acef514 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:19.422408 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-157150ad-dde6-4f75-9235-e3866acef514 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:19.423217 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-157150ad-dde6-4f75-9235-e3866acef514 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:19.430600 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-157150ad-dde6-4f75-9235-e3866acef514 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:19.431109 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-157150ad-dde6-4f75-9235-e3866acef514 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:19.431565 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-157150ad-dde6-4f75-9235-e3866acef514 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:19.715045 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-157150ad-dde6-4f75-9235-e3866acef514 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9480713a3884233bd28a7986e9a5baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1e7be678b94918a8c9436a3a25eb67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:19.731397 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-157150ad-dde6-4f75-9235-e3866acef514 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] 10.222.0.43 "GET /compute/v2.1/servers/a19e214d-9bda-46c8-92dd-e2457b82508f" status: 200 len: 1282 microversion: 2.1 time: 0.339827 Oct 04 18:56:19.735288 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2343/4982] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:19 2022] GET /compute/v2.1/servers/a19e214d-9bda-46c8-92dd-e2457b82508f => generated 1282 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:56:19.745868 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-06b755dc-9274-4634-af9e-ba53e848a84f tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:19.746840 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-06b755dc-9274-4634-af9e-ba53e848a84f tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] [instance: a45d1b74-2d81-4e11-b837-fe77dc63f689] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:19.783006 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-06b755dc-9274-4634-af9e-ba53e848a84f tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:19.785958 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-06b755dc-9274-4634-af9e-ba53e848a84f tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:19.790954 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-06b755dc-9274-4634-af9e-ba53e848a84f tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:19.792494 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-06b755dc-9274-4634-af9e-ba53e848a84f tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:19.793263 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-06b755dc-9274-4634-af9e-ba53e848a84f tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:19.793878 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-06b755dc-9274-4634-af9e-ba53e848a84f tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:20.354744 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-06b755dc-9274-4634-af9e-ba53e848a84f tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '486c22456b1e47ae843ae41f8dfb2632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c91c7e7358048ffaaee7f51ad61b515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:20.377841 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-06b755dc-9274-4634-af9e-ba53e848a84f tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] 10.222.0.43 "GET /compute/v2.1/servers/a45d1b74-2d81-4e11-b837-fe77dc63f689" status: 200 len: 1300 microversion: 2.1 time: 0.641130 Oct 04 18:56:20.380211 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2344/4983] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:19 2022] GET /compute/v2.1/servers/a45d1b74-2d81-4e11-b837-fe77dc63f689 => generated 1300 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:56:20.390896 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-c75031be-9029-4772-96a9-8ceebb89dd33 tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:20.393857 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-c75031be-9029-4772-96a9-8ceebb89dd33 tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] [instance: e20fa332-f87b-47b3-a30c-52716e5e7a45] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:20.404606 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c75031be-9029-4772-96a9-8ceebb89dd33 tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:20.410788 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c75031be-9029-4772-96a9-8ceebb89dd33 tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:20.412347 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c75031be-9029-4772-96a9-8ceebb89dd33 tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:20.413733 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c75031be-9029-4772-96a9-8ceebb89dd33 tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:20.423001 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c75031be-9029-4772-96a9-8ceebb89dd33 tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:20.423650 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c75031be-9029-4772-96a9-8ceebb89dd33 tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:21.002896 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-c75031be-9029-4772-96a9-8ceebb89dd33 tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16d1e957e30423e9b06c6150e5c4a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74c55e15cfd4f2c9ce67c9aa91c1b5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:21.015130 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-c75031be-9029-4772-96a9-8ceebb89dd33 tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] 10.222.0.43 "GET /compute/v2.1/servers/e20fa332-f87b-47b3-a30c-52716e5e7a45" status: 200 len: 1698 microversion: 2.1 time: 0.632411 Oct 04 18:56:21.027350 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2345/4984] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:20 2022] GET /compute/v2.1/servers/e20fa332-f87b-47b3-a30c-52716e5e7a45 => generated 1698 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:56:21.053673 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-ed676a66-7783-4e51-a9a2-05f8fc20130d tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:21.065512 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-ed676a66-7783-4e51-a9a2-05f8fc20130d tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 01e250ab-d9aa-4708-ae36-10c53a411a40] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:21.089854 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ed676a66-7783-4e51-a9a2-05f8fc20130d tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:21.093919 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ed676a66-7783-4e51-a9a2-05f8fc20130d tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:21.094401 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ed676a66-7783-4e51-a9a2-05f8fc20130d tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:21.095150 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ed676a66-7783-4e51-a9a2-05f8fc20130d tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:21.095825 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ed676a66-7783-4e51-a9a2-05f8fc20130d tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:21.096277 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ed676a66-7783-4e51-a9a2-05f8fc20130d tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:21.282636 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-6894c64a-de4f-44ef-a761-d2b23ed7c5d4 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:21.296941 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-6894c64a-de4f-44ef-a761-d2b23ed7c5d4 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:21.315878 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-6894c64a-de4f-44ef-a761-d2b23ed7c5d4 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:21.317431 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-6894c64a-de4f-44ef-a761-d2b23ed7c5d4 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] 10.222.0.43 "GET /compute/v2.1/servers/02a066b4-243b-4fe3-afcf-30f3e9511d1b" status: 200 len: 1875 microversion: 2.42 time: 2.262486 Oct 04 18:56:21.319926 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2640/4985] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:56:19 2022] GET /compute/v2.1/servers/02a066b4-243b-4fe3-afcf-30f3e9511d1b => generated 1875 bytes in 2265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:56:21.324969 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-89408042-1ab6-4444-9ae7-98d15daa7de4 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:21.332715 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-89408042-1ab6-4444-9ae7-98d15daa7de4 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] [instance: a19e214d-9bda-46c8-92dd-e2457b82508f] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:21.366120 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-89408042-1ab6-4444-9ae7-98d15daa7de4 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:21.368928 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-89408042-1ab6-4444-9ae7-98d15daa7de4 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:21.372443 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-89408042-1ab6-4444-9ae7-98d15daa7de4 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:21.378050 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-89408042-1ab6-4444-9ae7-98d15daa7de4 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:21.378890 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-89408042-1ab6-4444-9ae7-98d15daa7de4 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:21.379552 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-89408042-1ab6-4444-9ae7-98d15daa7de4 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:21.728463 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-89408042-1ab6-4444-9ae7-98d15daa7de4 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9480713a3884233bd28a7986e9a5baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1e7be678b94918a8c9436a3a25eb67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:21.736908 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-89408042-1ab6-4444-9ae7-98d15daa7de4 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] 10.222.0.43 "GET /compute/v2.1/servers/a19e214d-9bda-46c8-92dd-e2457b82508f" status: 200 len: 1270 microversion: 2.1 time: 0.415672 Oct 04 18:56:21.737565 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2641/4986] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:21 2022] GET /compute/v2.1/servers/a19e214d-9bda-46c8-92dd-e2457b82508f => generated 1270 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:56:21.745097 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-2ec57b3b-4c4f-4933-999b-432bb1aa491d req-56c515db-e4a3-4e19-8b95-11e581451e7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e20fa332-f87b-47b3-a30c-52716e5e7a45", "name": "network-vif-unplugged", "status": "completed", "tag": "f6bf9217-ac91-415b-a39c-6ee42946133e"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:56:21.781297 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-2ec57b3b-4c4f-4933-999b-432bb1aa491d req-56c515db-e4a3-4e19-8b95-11e581451e7c service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:21.784441 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-2ec57b3b-4c4f-4933-999b-432bb1aa491d req-56c515db-e4a3-4e19-8b95-11e581451e7c service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:21.785014 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-2ec57b3b-4c4f-4933-999b-432bb1aa491d req-56c515db-e4a3-4e19-8b95-11e581451e7c service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:21.822557 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-2ec57b3b-4c4f-4933-999b-432bb1aa491d req-56c515db-e4a3-4e19-8b95-11e581451e7c service nova] Creating event network-vif-unplugged:f6bf9217-ac91-415b-a39c-6ee42946133e for instance e20fa332-f87b-47b3-a30c-52716e5e7a45 on n-h1-851028-13 Oct 04 18:56:21.832046 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-2ec57b3b-4c4f-4933-999b-432bb1aa491d req-56c515db-e4a3-4e19-8b95-11e581451e7c service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.093248 Oct 04 18:56:21.834509 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2642/4987] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:56:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:56:21.852881 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-de8b4c10-3c3d-40d4-8468-ae44ab62847f tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:21.855469 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-de8b4c10-3c3d-40d4-8468-ae44ab62847f tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] [instance: a45d1b74-2d81-4e11-b837-fe77dc63f689] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:21.875043 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-de8b4c10-3c3d-40d4-8468-ae44ab62847f tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:21.875903 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-de8b4c10-3c3d-40d4-8468-ae44ab62847f tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:21.877564 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-de8b4c10-3c3d-40d4-8468-ae44ab62847f tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:21.879339 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-de8b4c10-3c3d-40d4-8468-ae44ab62847f tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:21.882292 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-de8b4c10-3c3d-40d4-8468-ae44ab62847f tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:21.883197 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-de8b4c10-3c3d-40d4-8468-ae44ab62847f tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:22.108572 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-ed676a66-7783-4e51-a9a2-05f8fc20130d tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f63f1ac147543dab34a28a22eb5936c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1607b30b9f324abaa88aa29e04ef3ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:22.110418 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-de8b4c10-3c3d-40d4-8468-ae44ab62847f tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '486c22456b1e47ae843ae41f8dfb2632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c91c7e7358048ffaaee7f51ad61b515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:22.119283 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-de8b4c10-3c3d-40d4-8468-ae44ab62847f tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] 10.222.0.43 "GET /compute/v2.1/servers/a45d1b74-2d81-4e11-b837-fe77dc63f689" status: 200 len: 1300 microversion: 2.1 time: 0.281372 Oct 04 18:56:22.119827 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-ed676a66-7783-4e51-a9a2-05f8fc20130d tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40" status: 200 len: 1527 microversion: 2.1 time: 1.083058 Oct 04 18:56:22.139123 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2346/4988] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:21 2022] GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40 => generated 1527 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:56:22.144894 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-6eaafdf7-c77d-441a-ab19-8c4ff43bcddf tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:22.145709 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2643/4989] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:21 2022] GET /compute/v2.1/servers/a45d1b74-2d81-4e11-b837-fe77dc63f689 => generated 1300 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:56:22.150573 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-6eaafdf7-c77d-441a-ab19-8c4ff43bcddf tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] [instance: e20fa332-f87b-47b3-a30c-52716e5e7a45] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:22.173482 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6eaafdf7-c77d-441a-ab19-8c4ff43bcddf tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:22.176838 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6eaafdf7-c77d-441a-ab19-8c4ff43bcddf tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:22.179891 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6eaafdf7-c77d-441a-ab19-8c4ff43bcddf tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:22.180908 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6eaafdf7-c77d-441a-ab19-8c4ff43bcddf tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:22.184275 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6eaafdf7-c77d-441a-ab19-8c4ff43bcddf tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:22.188137 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6eaafdf7-c77d-441a-ab19-8c4ff43bcddf tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:22.349391 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-268d6dc4-545c-4e4f-850f-1a5fd4b6496d tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:22.350779 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-268d6dc4-545c-4e4f-850f-1a5fd4b6496d tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] [instance: 02a066b4-243b-4fe3-afcf-30f3e9511d1b] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:22.358569 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-268d6dc4-545c-4e4f-850f-1a5fd4b6496d tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:22.377520 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-268d6dc4-545c-4e4f-850f-1a5fd4b6496d tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:22.378358 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-268d6dc4-545c-4e4f-850f-1a5fd4b6496d tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:22.379320 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-268d6dc4-545c-4e4f-850f-1a5fd4b6496d tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:22.379990 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-268d6dc4-545c-4e4f-850f-1a5fd4b6496d tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:22.380625 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-268d6dc4-545c-4e4f-850f-1a5fd4b6496d tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:22.474638 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-6eaafdf7-c77d-441a-ab19-8c4ff43bcddf tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16d1e957e30423e9b06c6150e5c4a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74c55e15cfd4f2c9ce67c9aa91c1b5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:22.487730 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-6eaafdf7-c77d-441a-ab19-8c4ff43bcddf tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] 10.222.0.43 "GET /compute/v2.1/servers/e20fa332-f87b-47b3-a30c-52716e5e7a45" status: 200 len: 1630 microversion: 2.1 time: 0.346041 Oct 04 18:56:22.507443 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2347/4990] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:22 2022] GET /compute/v2.1/servers/e20fa332-f87b-47b3-a30c-52716e5e7a45 => generated 1630 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:56:22.767005 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-2e01b824-68c8-4635-b033-a9b84f48c44e tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:22.772310 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-2e01b824-68c8-4635-b033-a9b84f48c44e tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] [instance: a19e214d-9bda-46c8-92dd-e2457b82508f] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:22.831915 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2e01b824-68c8-4635-b033-a9b84f48c44e tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:22.833813 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2e01b824-68c8-4635-b033-a9b84f48c44e tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:22.834494 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2e01b824-68c8-4635-b033-a9b84f48c44e tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:22.838789 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2e01b824-68c8-4635-b033-a9b84f48c44e tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:22.839509 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2e01b824-68c8-4635-b033-a9b84f48c44e tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:22.840198 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2e01b824-68c8-4635-b033-a9b84f48c44e tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:22.997749 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-268d6dc4-545c-4e4f-850f-1a5fd4b6496d tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:23.011824 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-268d6dc4-545c-4e4f-850f-1a5fd4b6496d tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:23.020841 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-268d6dc4-545c-4e4f-850f-1a5fd4b6496d tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:23.024257 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-268d6dc4-545c-4e4f-850f-1a5fd4b6496d tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] 10.222.0.43 "GET /compute/v2.1/servers/02a066b4-243b-4fe3-afcf-30f3e9511d1b" status: 200 len: 1875 microversion: 2.42 time: 0.678843 Oct 04 18:56:23.037468 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2644/4991] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:56:22 2022] GET /compute/v2.1/servers/02a066b4-243b-4fe3-afcf-30f3e9511d1b => generated 1875 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:56:23.147121 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f3535dc9-481d-4d71-b168-22f27e3b216e tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:23.148163 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-f3535dc9-481d-4d71-b168-22f27e3b216e tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 01e250ab-d9aa-4708-ae36-10c53a411a40] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:23.161506 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f3535dc9-481d-4d71-b168-22f27e3b216e tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:23.165625 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f3535dc9-481d-4d71-b168-22f27e3b216e tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:23.167064 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f3535dc9-481d-4d71-b168-22f27e3b216e tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:23.169757 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f3535dc9-481d-4d71-b168-22f27e3b216e tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:23.173093 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f3535dc9-481d-4d71-b168-22f27e3b216e tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:23.174011 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f3535dc9-481d-4d71-b168-22f27e3b216e tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:23.789586 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=2 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:56:23.861928 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=6 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:56:23.896533 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-f3535dc9-481d-4d71-b168-22f27e3b216e tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f63f1ac147543dab34a28a22eb5936c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1607b30b9f324abaa88aa29e04ef3ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:23.906202 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-f3535dc9-481d-4d71-b168-22f27e3b216e tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40" status: 200 len: 1527 microversion: 2.1 time: 0.764332 Oct 04 18:56:23.910466 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2645/4992] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:23 2022] GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40 => generated 1527 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:56:23.925695 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-178f7534-dd28-4019-8e57-fad8deb73e17 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:23.926330 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-178f7534-dd28-4019-8e57-fad8deb73e17 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] [instance: a45d1b74-2d81-4e11-b837-fe77dc63f689] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:23.949998 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-178f7534-dd28-4019-8e57-fad8deb73e17 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:23.950649 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-178f7534-dd28-4019-8e57-fad8deb73e17 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:23.951100 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-178f7534-dd28-4019-8e57-fad8deb73e17 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:23.952389 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-178f7534-dd28-4019-8e57-fad8deb73e17 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:23.952848 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-178f7534-dd28-4019-8e57-fad8deb73e17 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:23.958707 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-178f7534-dd28-4019-8e57-fad8deb73e17 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:24.484121 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-2e01b824-68c8-4635-b033-a9b84f48c44e tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9480713a3884233bd28a7986e9a5baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1e7be678b94918a8c9436a3a25eb67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:24.516061 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-2e01b824-68c8-4635-b033-a9b84f48c44e tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] 10.222.0.43 "GET /compute/v2.1/servers/a19e214d-9bda-46c8-92dd-e2457b82508f" status: 200 len: 1312 microversion: 2.1 time: 1.754750 Oct 04 18:56:24.520726 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2348/4993] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:22 2022] GET /compute/v2.1/servers/a19e214d-9bda-46c8-92dd-e2457b82508f => generated 1312 bytes in 1761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:56:24.526107 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-e71ab5a4-e3d4-4fd6-bbe8-7df97b090b87 tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:24.533367 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-e71ab5a4-e3d4-4fd6-bbe8-7df97b090b87 tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] [instance: e20fa332-f87b-47b3-a30c-52716e5e7a45] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:24.552259 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e71ab5a4-e3d4-4fd6-bbe8-7df97b090b87 tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:24.562002 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e71ab5a4-e3d4-4fd6-bbe8-7df97b090b87 tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:24.562890 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e71ab5a4-e3d4-4fd6-bbe8-7df97b090b87 tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:24.563954 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e71ab5a4-e3d4-4fd6-bbe8-7df97b090b87 tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:24.566163 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e71ab5a4-e3d4-4fd6-bbe8-7df97b090b87 tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:24.570978 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e71ab5a4-e3d4-4fd6-bbe8-7df97b090b87 tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:24.958985 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-e71ab5a4-e3d4-4fd6-bbe8-7df97b090b87 tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16d1e957e30423e9b06c6150e5c4a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74c55e15cfd4f2c9ce67c9aa91c1b5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:24.968513 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-e71ab5a4-e3d4-4fd6-bbe8-7df97b090b87 tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] 10.222.0.43 "GET /compute/v2.1/servers/e20fa332-f87b-47b3-a30c-52716e5e7a45" status: 200 len: 1353 microversion: 2.1 time: 0.446089 Oct 04 18:56:24.976616 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2349/4994] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:24 2022] GET /compute/v2.1/servers/e20fa332-f87b-47b3-a30c-52716e5e7a45 => generated 1353 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:56:24.994485 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-4793ff99-c170-4ee4-b59c-9fe310cf929d tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:25.006091 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-4793ff99-c170-4ee4-b59c-9fe310cf929d tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] [instance: 02a066b4-243b-4fe3-afcf-30f3e9511d1b] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:25.032912 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4793ff99-c170-4ee4-b59c-9fe310cf929d tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:25.033852 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4793ff99-c170-4ee4-b59c-9fe310cf929d tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:25.034624 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4793ff99-c170-4ee4-b59c-9fe310cf929d tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:25.035748 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4793ff99-c170-4ee4-b59c-9fe310cf929d tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:25.036511 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4793ff99-c170-4ee4-b59c-9fe310cf929d tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:25.037155 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4793ff99-c170-4ee4-b59c-9fe310cf929d tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:25.652403 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-178f7534-dd28-4019-8e57-fad8deb73e17 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '486c22456b1e47ae843ae41f8dfb2632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c91c7e7358048ffaaee7f51ad61b515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:25.663669 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-178f7534-dd28-4019-8e57-fad8deb73e17 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] 10.222.0.43 "GET /compute/v2.1/servers/a45d1b74-2d81-4e11-b837-fe77dc63f689" status: 200 len: 1367 microversion: 2.1 time: 1.750000 Oct 04 18:56:25.664276 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2646/4995] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:23 2022] GET /compute/v2.1/servers/a45d1b74-2d81-4e11-b837-fe77dc63f689 => generated 1367 bytes in 1753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:56:25.693658 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-51d6d2be-b62a-4183-a009-cff6162de634 req-8b6d337a-f30d-4d81-bfb3-38ead31bdccf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e20fa332-f87b-47b3-a30c-52716e5e7a45", "name": "network-vif-deleted", "tag": "f6bf9217-ac91-415b-a39c-6ee42946133e"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:56:25.735738 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-51d6d2be-b62a-4183-a009-cff6162de634 req-8b6d337a-f30d-4d81-bfb3-38ead31bdccf service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:25.736704 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-51d6d2be-b62a-4183-a009-cff6162de634 req-8b6d337a-f30d-4d81-bfb3-38ead31bdccf service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:25.737783 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-51d6d2be-b62a-4183-a009-cff6162de634 req-8b6d337a-f30d-4d81-bfb3-38ead31bdccf service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:25.773861 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-51d6d2be-b62a-4183-a009-cff6162de634 req-8b6d337a-f30d-4d81-bfb3-38ead31bdccf service nova] Creating event network-vif-deleted:f6bf9217-ac91-415b-a39c-6ee42946133e for instance e20fa332-f87b-47b3-a30c-52716e5e7a45 on n-h1-851028-13 Oct 04 18:56:25.791158 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-51d6d2be-b62a-4183-a009-cff6162de634 req-8b6d337a-f30d-4d81-bfb3-38ead31bdccf service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124154 Oct 04 18:56:25.794617 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2647/4996] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:56:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:56:25.808643 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-3b3d0c48-bfc4-477b-9b30-ee8c31574d2e tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:25.812728 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-3b3d0c48-bfc4-477b-9b30-ee8c31574d2e tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 01e250ab-d9aa-4708-ae36-10c53a411a40] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:25.853024 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3b3d0c48-bfc4-477b-9b30-ee8c31574d2e tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:25.853625 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3b3d0c48-bfc4-477b-9b30-ee8c31574d2e tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:25.854964 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3b3d0c48-bfc4-477b-9b30-ee8c31574d2e tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:25.855725 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3b3d0c48-bfc4-477b-9b30-ee8c31574d2e tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:25.857068 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3b3d0c48-bfc4-477b-9b30-ee8c31574d2e tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:25.858051 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3b3d0c48-bfc4-477b-9b30-ee8c31574d2e tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:26.049927 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-4793ff99-c170-4ee4-b59c-9fe310cf929d tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:26.073642 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-4793ff99-c170-4ee4-b59c-9fe310cf929d tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:26.077176 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-4793ff99-c170-4ee4-b59c-9fe310cf929d tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:26.084366 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-4793ff99-c170-4ee4-b59c-9fe310cf929d tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] 10.222.0.43 "GET /compute/v2.1/servers/02a066b4-243b-4fe3-afcf-30f3e9511d1b" status: 200 len: 1875 microversion: 2.42 time: 1.100802 Oct 04 18:56:26.087434 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2350/4997] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:56:24 2022] GET /compute/v2.1/servers/02a066b4-243b-4fe3-afcf-30f3e9511d1b => generated 1875 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:56:26.102086 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-0de678fa-732e-4934-87cc-17fc80e697f2 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:26.103321 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-0de678fa-732e-4934-87cc-17fc80e697f2 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] [instance: a19e214d-9bda-46c8-92dd-e2457b82508f] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:26.133060 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0de678fa-732e-4934-87cc-17fc80e697f2 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:26.137151 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0de678fa-732e-4934-87cc-17fc80e697f2 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:26.137977 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0de678fa-732e-4934-87cc-17fc80e697f2 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:26.139108 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0de678fa-732e-4934-87cc-17fc80e697f2 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:26.139782 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0de678fa-732e-4934-87cc-17fc80e697f2 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:26.143907 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0de678fa-732e-4934-87cc-17fc80e697f2 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:26.283436 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-3b3d0c48-bfc4-477b-9b30-ee8c31574d2e tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f63f1ac147543dab34a28a22eb5936c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1607b30b9f324abaa88aa29e04ef3ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:26.298643 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-3b3d0c48-bfc4-477b-9b30-ee8c31574d2e tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40" status: 200 len: 1527 microversion: 2.1 time: 0.501083 Oct 04 18:56:26.299771 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2648/4998] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:25 2022] GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40 => generated 1527 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:56:26.301213 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=6 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:56:26.305188 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-89f4437a-5b7a-4716-ac0c-d3a72f0dd8f4 tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:26.308557 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-89f4437a-5b7a-4716-ac0c-d3a72f0dd8f4 tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] [instance: e20fa332-f87b-47b3-a30c-52716e5e7a45] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:26.334393 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-89f4437a-5b7a-4716-ac0c-d3a72f0dd8f4 tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:26.335415 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-89f4437a-5b7a-4716-ac0c-d3a72f0dd8f4 tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:26.337670 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-89f4437a-5b7a-4716-ac0c-d3a72f0dd8f4 tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:26.339947 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-89f4437a-5b7a-4716-ac0c-d3a72f0dd8f4 tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:26.340600 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-89f4437a-5b7a-4716-ac0c-d3a72f0dd8f4 tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:26.349816 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-89f4437a-5b7a-4716-ac0c-d3a72f0dd8f4 tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:26.358312 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=12 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:56:26.382939 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-89f4437a-5b7a-4716-ac0c-d3a72f0dd8f4 tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] HTTP exception thrown: Instance e20fa332-f87b-47b3-a30c-52716e5e7a45 could not be found. Oct 04 18:56:26.384947 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-89f4437a-5b7a-4716-ac0c-d3a72f0dd8f4 tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Request method failure captured: Oct 04 18:56:26.384947 n-d-851028-13 devstack@n-api.service[123596]: request: GET /compute/v2.1/servers/e20fa332-f87b-47b3-a30c-52716e5e7a45 HTTP/1.1 Oct 04 18:56:26.384947 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:56:26.384947 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:56:26.384947 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:56:26.384947 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 18:56:26.384947 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:56:26.384947 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:56:26.384947 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:56:26.384947 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:56:26.384947 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPIGI9jT8ShMIEx1qHEA7IUOHX6rw0dND1AuEdZJ87t66wNYOHKKu3yqiwED3rQqfITl2vWrf9HbwraLenFjYuZl24hLCYra-6FmGFoo33mjKnswWEvqpNnlJX4BVMULjrAqwjV5ta9g6oCtQWx2-sSBQmUzwbhwerh2oxyUBtJTWUvY Oct 04 18:56:26.384947 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:56:26.384947 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:56:26.384947 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:56:26.384947 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:56:26.384947 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:56:26.384947 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:56:26.384947 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: b74c55e15cfd4f2c9ce67c9aa91c1b5d Oct 04 18:56:26.384947 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-ServersTestJSON-132944718 Oct 04 18:56:26.384947 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 18:56:26.384947 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 18:56:26.384947 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/b74c55e15cfd4f2c9ce67c9aa91c1b5d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_b74c55e15cfd4f2c9ce67c9aa91c1b5d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b74c55e15cfd4f2c9ce67c9aa91c1b5d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b74c55e15cfd4f2c9ce67c9aa91c1b5d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:56:26.384947 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-ServersTestJSON-132944718 Oct 04 18:56:26.384947 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: b74c55e15cfd4f2c9ce67c9aa91c1b5d Oct 04 18:56:26.384947 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-ServersTestJSON-132944718 Oct 04 18:56:26.384947 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-ServersTestJSON-132944718-project Oct 04 18:56:26.384947 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:56:26.384947 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:56:26.384947 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: b16d1e957e30423e9b06c6150e5c4a16 Oct 04 18:56:26.384947 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-ServersTestJSON-132944718-project Oct 04 18:56:26.384947 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 18:56:26.384947 n-d-851028-13 devstack@n-api.service[123596]: exception: Instance e20fa332-f87b-47b3-a30c-52716e5e7a45 could not be found. Oct 04 18:56:26.384947 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': 'e20fa332-f87b-47b3-a30c-52716e5e7a45'} Oct 04 18:56:26.384947 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:56:26.384947 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:56:26.384947 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:56:26.384947 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:56:26.384947 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:56:26.384947 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:56:26.384947 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:56:26.384947 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:56:26.384947 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:56:26.384947 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:56:26.384947 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e20fa332-f87b-47b3-a30c-52716e5e7a45 could not be found. Oct 04 18:56:26.384947 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:56:26.384947 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:56:26.384947 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:56:26.384947 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:56:26.384947 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:56:26.384947 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:56:26.384947 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:56:26.384947 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:56:26.384947 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:56:26.384947 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:56:26.384947 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:56:26.384947 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:56:26.384947 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:56:26.384947 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:56:26.384947 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:56:26.384947 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:56:26.384947 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e20fa332-f87b-47b3-a30c-52716e5e7a45 could not be found. Oct 04 18:56:26.384947 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:56:26.384947 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:56:26.384947 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:56:26.384947 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:56:26.390419 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:56:26.390419 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:56:26.390419 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:56:26.390419 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:56:26.390419 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e20fa332-f87b-47b3-a30c-52716e5e7a45 could not be found. Oct 04 18:56:26.390419 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:56:26.393874 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-89f4437a-5b7a-4716-ac0c-d3a72f0dd8f4 tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Returning 404 to user: Instance e20fa332-f87b-47b3-a30c-52716e5e7a45 could not be found. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:56:26.395144 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-89f4437a-5b7a-4716-ac0c-d3a72f0dd8f4 tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] 10.222.0.43 "GET /compute/v2.1/servers/e20fa332-f87b-47b3-a30c-52716e5e7a45" status: 404 len: 111 microversion: 2.1 time: 0.094102 Oct 04 18:56:26.396675 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2649/4999] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:26 2022] GET /compute/v2.1/servers/e20fa332-f87b-47b3-a30c-52716e5e7a45 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:56:26.408089 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-220be706-d979-411a-b707-9277add60c0c tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] Calling method '.version_select at 0x7fb21eb1c9d0>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:26.468077 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-220be706-d979-411a-b707-9277add60c0c tempest-ServersTestJSON-132944718 tempest-ServersTestJSON-132944718-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-834340097" status: 202 len: 0 microversion: 2.1 time: 0.066802 Oct 04 18:56:26.469424 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2650/5000] 10.222.0.43 () {58 vars in 1218 bytes} [Tue Oct 4 18:56:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-834340097 => generated 0 bytes in 69 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:56:26.688365 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-7213b3d3-6e4b-4315-906d-bda7b31c44e4 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:26.689926 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-7213b3d3-6e4b-4315-906d-bda7b31c44e4 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] [instance: a45d1b74-2d81-4e11-b837-fe77dc63f689] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:26.702092 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7213b3d3-6e4b-4315-906d-bda7b31c44e4 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:26.705795 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7213b3d3-6e4b-4315-906d-bda7b31c44e4 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:26.706536 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7213b3d3-6e4b-4315-906d-bda7b31c44e4 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:26.707553 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7213b3d3-6e4b-4315-906d-bda7b31c44e4 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:26.716157 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7213b3d3-6e4b-4315-906d-bda7b31c44e4 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:26.730565 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7213b3d3-6e4b-4315-906d-bda7b31c44e4 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:27.139978 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-0de678fa-732e-4934-87cc-17fc80e697f2 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9480713a3884233bd28a7986e9a5baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1e7be678b94918a8c9436a3a25eb67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:27.152707 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-0de678fa-732e-4934-87cc-17fc80e697f2 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] 10.222.0.43 "GET /compute/v2.1/servers/a19e214d-9bda-46c8-92dd-e2457b82508f" status: 200 len: 1312 microversion: 2.1 time: 1.063757 Oct 04 18:56:27.174466 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2351/5001] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:26 2022] GET /compute/v2.1/servers/a19e214d-9bda-46c8-92dd-e2457b82508f => generated 1312 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:56:27.187730 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-c03d8c33-5022-4666-aa20-daafe30c2d7e tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:27.190213 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-c03d8c33-5022-4666-aa20-daafe30c2d7e tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] [instance: 02a066b4-243b-4fe3-afcf-30f3e9511d1b] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:27.207318 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c03d8c33-5022-4666-aa20-daafe30c2d7e tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:27.208175 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c03d8c33-5022-4666-aa20-daafe30c2d7e tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:27.208824 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c03d8c33-5022-4666-aa20-daafe30c2d7e tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:27.210212 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c03d8c33-5022-4666-aa20-daafe30c2d7e tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:27.212120 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c03d8c33-5022-4666-aa20-daafe30c2d7e tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:27.212515 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-7213b3d3-6e4b-4315-906d-bda7b31c44e4 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '486c22456b1e47ae843ae41f8dfb2632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c91c7e7358048ffaaee7f51ad61b515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:27.213466 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c03d8c33-5022-4666-aa20-daafe30c2d7e tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:27.226283 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-7213b3d3-6e4b-4315-906d-bda7b31c44e4 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] 10.222.0.43 "GET /compute/v2.1/servers/a45d1b74-2d81-4e11-b837-fe77dc63f689" status: 200 len: 1367 microversion: 2.1 time: 0.542208 Oct 04 18:56:27.229736 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2651/5002] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:26 2022] GET /compute/v2.1/servers/a45d1b74-2d81-4e11-b837-fe77dc63f689 => generated 1367 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:56:27.326090 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-36f43eb2-8d48-47c8-9015-a53fbb99355d tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:27.327500 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-36f43eb2-8d48-47c8-9015-a53fbb99355d tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 01e250ab-d9aa-4708-ae36-10c53a411a40] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:27.347026 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-36f43eb2-8d48-47c8-9015-a53fbb99355d tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:27.355363 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-36f43eb2-8d48-47c8-9015-a53fbb99355d tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:27.358734 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-36f43eb2-8d48-47c8-9015-a53fbb99355d tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:27.359548 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-36f43eb2-8d48-47c8-9015-a53fbb99355d tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:27.363110 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-36f43eb2-8d48-47c8-9015-a53fbb99355d tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:27.363587 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-36f43eb2-8d48-47c8-9015-a53fbb99355d tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:27.870239 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-36f43eb2-8d48-47c8-9015-a53fbb99355d tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f63f1ac147543dab34a28a22eb5936c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1607b30b9f324abaa88aa29e04ef3ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:27.883173 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-36f43eb2-8d48-47c8-9015-a53fbb99355d tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40" status: 200 len: 1527 microversion: 2.1 time: 0.562939 Oct 04 18:56:27.883686 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2652/5003] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:27 2022] GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40 => generated 1527 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:56:27.892543 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-06faa504-a730-47c4-83dc-3142457c4266 req-320f3fbc-d456-45d5-a3ff-8fe9c121ef4b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a19e214d-9bda-46c8-92dd-e2457b82508f", "tag": "070e3f62-9f08-4f5e-8667-35d8698aaf1c"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:56:27.926275 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-06faa504-a730-47c4-83dc-3142457c4266 req-320f3fbc-d456-45d5-a3ff-8fe9c121ef4b service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:27.926776 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-06faa504-a730-47c4-83dc-3142457c4266 req-320f3fbc-d456-45d5-a3ff-8fe9c121ef4b service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:27.927224 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-06faa504-a730-47c4-83dc-3142457c4266 req-320f3fbc-d456-45d5-a3ff-8fe9c121ef4b service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:27.969188 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-06faa504-a730-47c4-83dc-3142457c4266 req-320f3fbc-d456-45d5-a3ff-8fe9c121ef4b service nova] Creating event network-changed:070e3f62-9f08-4f5e-8667-35d8698aaf1c for instance a19e214d-9bda-46c8-92dd-e2457b82508f on n-h2-851028-13 Oct 04 18:56:27.995468 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-06faa504-a730-47c4-83dc-3142457c4266 req-320f3fbc-d456-45d5-a3ff-8fe9c121ef4b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110340 Oct 04 18:56:27.997503 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2653/5004] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:56:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:56:28.167266 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-c03d8c33-5022-4666-aa20-daafe30c2d7e tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:28.180852 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-bbf8d6ae-1f12-402f-911e-07bcfb16ac98 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:28.181606 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-bbf8d6ae-1f12-402f-911e-07bcfb16ac98 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] [instance: a19e214d-9bda-46c8-92dd-e2457b82508f] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:28.196460 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-c03d8c33-5022-4666-aa20-daafe30c2d7e tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:28.198097 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-c03d8c33-5022-4666-aa20-daafe30c2d7e tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:28.202963 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bbf8d6ae-1f12-402f-911e-07bcfb16ac98 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:28.208638 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bbf8d6ae-1f12-402f-911e-07bcfb16ac98 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:28.209355 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bbf8d6ae-1f12-402f-911e-07bcfb16ac98 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:28.212073 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-c03d8c33-5022-4666-aa20-daafe30c2d7e tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] 10.222.0.43 "GET /compute/v2.1/servers/02a066b4-243b-4fe3-afcf-30f3e9511d1b" status: 200 len: 1875 microversion: 2.42 time: 1.036086 Oct 04 18:56:28.212683 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2352/5005] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:56:27 2022] GET /compute/v2.1/servers/02a066b4-243b-4fe3-afcf-30f3e9511d1b => generated 1875 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:56:28.213013 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bbf8d6ae-1f12-402f-911e-07bcfb16ac98 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:28.213683 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bbf8d6ae-1f12-402f-911e-07bcfb16ac98 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:28.217518 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bbf8d6ae-1f12-402f-911e-07bcfb16ac98 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:28.258017 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-22f2ff4b-8b83-4953-bf49-1e6c5c65457f tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:28.265219 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-22f2ff4b-8b83-4953-bf49-1e6c5c65457f tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] [instance: a45d1b74-2d81-4e11-b837-fe77dc63f689] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:28.305532 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-22f2ff4b-8b83-4953-bf49-1e6c5c65457f tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:28.316146 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-22f2ff4b-8b83-4953-bf49-1e6c5c65457f tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:28.317004 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-22f2ff4b-8b83-4953-bf49-1e6c5c65457f tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:28.322129 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-22f2ff4b-8b83-4953-bf49-1e6c5c65457f tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:28.327462 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-22f2ff4b-8b83-4953-bf49-1e6c5c65457f tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:28.336507 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-22f2ff4b-8b83-4953-bf49-1e6c5c65457f tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:28.675042 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-bbf8d6ae-1f12-402f-911e-07bcfb16ac98 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9480713a3884233bd28a7986e9a5baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1e7be678b94918a8c9436a3a25eb67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:28.678187 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:56:28.700421 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-bbf8d6ae-1f12-402f-911e-07bcfb16ac98 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] 10.222.0.43 "GET /compute/v2.1/servers/a19e214d-9bda-46c8-92dd-e2457b82508f" status: 200 len: 1312 microversion: 2.1 time: 0.524250 Oct 04 18:56:28.705220 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2654/5006] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:28 2022] GET /compute/v2.1/servers/a19e214d-9bda-46c8-92dd-e2457b82508f => generated 1312 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:56:28.723046 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-df0ea2e1-8c03-4519-a93e-e0d7d2147208 req-69bc753d-8b70-4a7b-a414-c33b408d5cab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02a066b4-243b-4fe3-afcf-30f3e9511d1b", "name": "network-vif-plugged", "status": "completed", "tag": "41843c67-3f42-40b6-baf0-f90a5f358228"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:56:28.744763 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-df0ea2e1-8c03-4519-a93e-e0d7d2147208 req-69bc753d-8b70-4a7b-a414-c33b408d5cab service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:28.745783 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-df0ea2e1-8c03-4519-a93e-e0d7d2147208 req-69bc753d-8b70-4a7b-a414-c33b408d5cab service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:28.746431 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-df0ea2e1-8c03-4519-a93e-e0d7d2147208 req-69bc753d-8b70-4a7b-a414-c33b408d5cab service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:28.768278 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-df0ea2e1-8c03-4519-a93e-e0d7d2147208 req-69bc753d-8b70-4a7b-a414-c33b408d5cab service nova] Creating event network-vif-plugged:41843c67-3f42-40b6-baf0-f90a5f358228 for instance 02a066b4-243b-4fe3-afcf-30f3e9511d1b on n-h2-851028-13 Oct 04 18:56:28.791062 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-df0ea2e1-8c03-4519-a93e-e0d7d2147208 req-69bc753d-8b70-4a7b-a414-c33b408d5cab service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077377 Oct 04 18:56:28.792353 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2655/5007] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:56:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:56:28.910026 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-6854c1ce-250e-45df-add8-84531f79d864 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:28.915813 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-6854c1ce-250e-45df-add8-84531f79d864 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 01e250ab-d9aa-4708-ae36-10c53a411a40] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:28.930727 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6854c1ce-250e-45df-add8-84531f79d864 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:28.933219 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6854c1ce-250e-45df-add8-84531f79d864 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:28.933993 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6854c1ce-250e-45df-add8-84531f79d864 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:28.937430 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6854c1ce-250e-45df-add8-84531f79d864 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:28.938395 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6854c1ce-250e-45df-add8-84531f79d864 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:28.940487 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6854c1ce-250e-45df-add8-84531f79d864 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:29.430032 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-22f2ff4b-8b83-4953-bf49-1e6c5c65457f tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '486c22456b1e47ae843ae41f8dfb2632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c91c7e7358048ffaaee7f51ad61b515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:29.441921 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-22f2ff4b-8b83-4953-bf49-1e6c5c65457f tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] 10.222.0.43 "GET /compute/v2.1/servers/a45d1b74-2d81-4e11-b837-fe77dc63f689" status: 200 len: 1367 microversion: 2.1 time: 1.191720 Oct 04 18:56:29.457146 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2353/5008] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:28 2022] GET /compute/v2.1/servers/a45d1b74-2d81-4e11-b837-fe77dc63f689 => generated 1367 bytes in 1195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:56:29.457146 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-982efef9-287b-4439-9095-184896bf04b4 req-6737e204-8253-49a2-b750-ba7b9d25200d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a45d1b74-2d81-4e11-b837-fe77dc63f689", "tag": "b3e1d52d-3e3e-43c8-9f57-f601d774fbfe"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:56:29.486677 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-982efef9-287b-4439-9095-184896bf04b4 req-6737e204-8253-49a2-b750-ba7b9d25200d service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:29.487561 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-982efef9-287b-4439-9095-184896bf04b4 req-6737e204-8253-49a2-b750-ba7b9d25200d service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:29.488304 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-982efef9-287b-4439-9095-184896bf04b4 req-6737e204-8253-49a2-b750-ba7b9d25200d service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:29.527190 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-982efef9-287b-4439-9095-184896bf04b4 req-6737e204-8253-49a2-b750-ba7b9d25200d service nova] Creating event network-changed:b3e1d52d-3e3e-43c8-9f57-f601d774fbfe for instance a45d1b74-2d81-4e11-b837-fe77dc63f689 on n-h1-851028-13 Oct 04 18:56:29.546532 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-982efef9-287b-4439-9095-184896bf04b4 req-6737e204-8253-49a2-b750-ba7b9d25200d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098245 Oct 04 18:56:29.550150 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2354/5009] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:56:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:56:29.571610 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-94768483-f0f3-4379-8afb-23c0808e3e38 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:29.575449 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-94768483-f0f3-4379-8afb-23c0808e3e38 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] [instance: 02a066b4-243b-4fe3-afcf-30f3e9511d1b] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:29.618832 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-94768483-f0f3-4379-8afb-23c0808e3e38 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:29.621101 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-94768483-f0f3-4379-8afb-23c0808e3e38 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:29.624960 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-94768483-f0f3-4379-8afb-23c0808e3e38 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:29.626144 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-94768483-f0f3-4379-8afb-23c0808e3e38 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:29.627455 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-94768483-f0f3-4379-8afb-23c0808e3e38 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:29.631554 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-94768483-f0f3-4379-8afb-23c0808e3e38 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:29.646794 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=100 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:56:30.353568 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-6854c1ce-250e-45df-add8-84531f79d864 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f63f1ac147543dab34a28a22eb5936c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1607b30b9f324abaa88aa29e04ef3ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:30.367968 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-6854c1ce-250e-45df-add8-84531f79d864 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40" status: 200 len: 1527 microversion: 2.1 time: 1.461173 Oct 04 18:56:30.374010 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2656/5010] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:28 2022] GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40 => generated 1527 bytes in 1470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:56:30.409971 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-0db6adae-9579-4253-b455-52e03d596d1b tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:30.411043 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-0db6adae-9579-4253-b455-52e03d596d1b tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] [instance: a19e214d-9bda-46c8-92dd-e2457b82508f] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:30.418634 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:56:30.429707 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0db6adae-9579-4253-b455-52e03d596d1b tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:30.431165 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0db6adae-9579-4253-b455-52e03d596d1b tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:30.432927 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0db6adae-9579-4253-b455-52e03d596d1b tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:30.434864 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0db6adae-9579-4253-b455-52e03d596d1b tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:30.436225 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0db6adae-9579-4253-b455-52e03d596d1b tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:30.438566 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0db6adae-9579-4253-b455-52e03d596d1b tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:30.653452 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-94768483-f0f3-4379-8afb-23c0808e3e38 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:30.673996 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-94768483-f0f3-4379-8afb-23c0808e3e38 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:30.684700 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-94768483-f0f3-4379-8afb-23c0808e3e38 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:30.688763 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-94768483-f0f3-4379-8afb-23c0808e3e38 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] 10.222.0.43 "GET /compute/v2.1/servers/02a066b4-243b-4fe3-afcf-30f3e9511d1b" status: 200 len: 1875 microversion: 2.42 time: 1.136334 Oct 04 18:56:30.695832 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2355/5011] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:56:29 2022] GET /compute/v2.1/servers/02a066b4-243b-4fe3-afcf-30f3e9511d1b => generated 1875 bytes in 1144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:56:30.707971 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-427f9ab2-3fb4-4df9-a069-a41bd8f8e9c3 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:30.708619 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-427f9ab2-3fb4-4df9-a069-a41bd8f8e9c3 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] [instance: a45d1b74-2d81-4e11-b837-fe77dc63f689] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:30.749767 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-427f9ab2-3fb4-4df9-a069-a41bd8f8e9c3 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:30.754267 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-427f9ab2-3fb4-4df9-a069-a41bd8f8e9c3 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:30.755389 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-427f9ab2-3fb4-4df9-a069-a41bd8f8e9c3 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:30.764462 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-427f9ab2-3fb4-4df9-a069-a41bd8f8e9c3 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:30.771200 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-427f9ab2-3fb4-4df9-a069-a41bd8f8e9c3 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:30.772631 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-427f9ab2-3fb4-4df9-a069-a41bd8f8e9c3 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:30.793609 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-0db6adae-9579-4253-b455-52e03d596d1b tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9480713a3884233bd28a7986e9a5baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1e7be678b94918a8c9436a3a25eb67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:30.807411 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-0db6adae-9579-4253-b455-52e03d596d1b tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] 10.222.0.43 "GET /compute/v2.1/servers/a19e214d-9bda-46c8-92dd-e2457b82508f" status: 200 len: 1312 microversion: 2.1 time: 0.429822 Oct 04 18:56:30.812462 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2657/5012] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:30 2022] GET /compute/v2.1/servers/a19e214d-9bda-46c8-92dd-e2457b82508f => generated 1312 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:56:30.867401 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-0fc41465-754e-4eab-a467-14bae22302eb req-8be708b1-b7f9-4ca0-8400-027b367c8c26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02a066b4-243b-4fe3-afcf-30f3e9511d1b", "name": "network-vif-plugged", "status": "completed", "tag": "84007727-69fd-496d-bff6-b9696c470012"}, {"server_uuid": "02a066b4-243b-4fe3-afcf-30f3e9511d1b", "name": "network-vif-plugged", "status": "completed", "tag": "928f2e8e-6be4-46f2-be79-95a832f7c34d"}, {"server_uuid": "02a066b4-243b-4fe3-afcf-30f3e9511d1b", "name": "network-vif-plugged", "status": "completed", "tag": "b55a672a-c052-4f13-8fbc-232381ea2bbb"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:56:30.889426 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-0fc41465-754e-4eab-a467-14bae22302eb req-8be708b1-b7f9-4ca0-8400-027b367c8c26 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:30.889981 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-0fc41465-754e-4eab-a467-14bae22302eb req-8be708b1-b7f9-4ca0-8400-027b367c8c26 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:30.890422 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-0fc41465-754e-4eab-a467-14bae22302eb req-8be708b1-b7f9-4ca0-8400-027b367c8c26 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:30.940599 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-0fc41465-754e-4eab-a467-14bae22302eb req-8be708b1-b7f9-4ca0-8400-027b367c8c26 service nova] Creating event network-vif-plugged:84007727-69fd-496d-bff6-b9696c470012 for instance 02a066b4-243b-4fe3-afcf-30f3e9511d1b on n-h2-851028-13 Oct 04 18:56:30.949630 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-0fc41465-754e-4eab-a467-14bae22302eb req-8be708b1-b7f9-4ca0-8400-027b367c8c26 service nova] Creating event network-vif-plugged:928f2e8e-6be4-46f2-be79-95a832f7c34d for instance 02a066b4-243b-4fe3-afcf-30f3e9511d1b on n-h2-851028-13 Oct 04 18:56:30.954618 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-0fc41465-754e-4eab-a467-14bae22302eb req-8be708b1-b7f9-4ca0-8400-027b367c8c26 service nova] Creating event network-vif-plugged:b55a672a-c052-4f13-8fbc-232381ea2bbb for instance 02a066b4-243b-4fe3-afcf-30f3e9511d1b on n-h2-851028-13 Oct 04 18:56:30.963521 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-0fc41465-754e-4eab-a467-14bae22302eb req-8be708b1-b7f9-4ca0-8400-027b367c8c26 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.102054 Oct 04 18:56:30.969509 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2658/5013] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:56:30 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:56:31.275423 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-427f9ab2-3fb4-4df9-a069-a41bd8f8e9c3 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '486c22456b1e47ae843ae41f8dfb2632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c91c7e7358048ffaaee7f51ad61b515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:31.294962 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-427f9ab2-3fb4-4df9-a069-a41bd8f8e9c3 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] 10.222.0.43 "GET /compute/v2.1/servers/a45d1b74-2d81-4e11-b837-fe77dc63f689" status: 200 len: 1367 microversion: 2.1 time: 0.594069 Oct 04 18:56:31.298525 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2356/5014] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:30 2022] GET /compute/v2.1/servers/a45d1b74-2d81-4e11-b837-fe77dc63f689 => generated 1367 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:56:31.404234 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-72a6138f-ddcc-4679-a040-5ec44a7829c5 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:31.405653 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-72a6138f-ddcc-4679-a040-5ec44a7829c5 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 01e250ab-d9aa-4708-ae36-10c53a411a40] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:31.422931 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-72a6138f-ddcc-4679-a040-5ec44a7829c5 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:31.423584 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-72a6138f-ddcc-4679-a040-5ec44a7829c5 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:31.424046 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-72a6138f-ddcc-4679-a040-5ec44a7829c5 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:31.424787 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-72a6138f-ddcc-4679-a040-5ec44a7829c5 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:31.425275 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-72a6138f-ddcc-4679-a040-5ec44a7829c5 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:31.425816 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-72a6138f-ddcc-4679-a040-5ec44a7829c5 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:31.724184 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-f6bee734-53ae-4613-a6f3-de8c6cdafa53 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:31.724961 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-f6bee734-53ae-4613-a6f3-de8c6cdafa53 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] [instance: 02a066b4-243b-4fe3-afcf-30f3e9511d1b] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:31.736907 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f6bee734-53ae-4613-a6f3-de8c6cdafa53 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:31.738409 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f6bee734-53ae-4613-a6f3-de8c6cdafa53 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:31.739154 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f6bee734-53ae-4613-a6f3-de8c6cdafa53 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:31.740672 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f6bee734-53ae-4613-a6f3-de8c6cdafa53 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:31.745903 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f6bee734-53ae-4613-a6f3-de8c6cdafa53 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:31.747968 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f6bee734-53ae-4613-a6f3-de8c6cdafa53 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:31.779191 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-72a6138f-ddcc-4679-a040-5ec44a7829c5 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f63f1ac147543dab34a28a22eb5936c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1607b30b9f324abaa88aa29e04ef3ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:31.790290 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-72a6138f-ddcc-4679-a040-5ec44a7829c5 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40" status: 200 len: 1509 microversion: 2.1 time: 0.394227 Oct 04 18:56:31.794189 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2659/5015] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:31 2022] GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40 => generated 1509 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:56:31.840621 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-709802d9-473c-484e-a62f-7ef75d4435cb tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:31.841769 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-709802d9-473c-484e-a62f-7ef75d4435cb tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] [instance: a19e214d-9bda-46c8-92dd-e2457b82508f] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:31.855325 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-709802d9-473c-484e-a62f-7ef75d4435cb tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:31.859303 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-709802d9-473c-484e-a62f-7ef75d4435cb tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:31.860435 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-709802d9-473c-484e-a62f-7ef75d4435cb tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:31.862817 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-709802d9-473c-484e-a62f-7ef75d4435cb tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:31.863503 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-709802d9-473c-484e-a62f-7ef75d4435cb tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:31.864538 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-709802d9-473c-484e-a62f-7ef75d4435cb tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:32.367548 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-709802d9-473c-484e-a62f-7ef75d4435cb tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9480713a3884233bd28a7986e9a5baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1e7be678b94918a8c9436a3a25eb67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:32.377824 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-709802d9-473c-484e-a62f-7ef75d4435cb tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] 10.222.0.43 "GET /compute/v2.1/servers/a19e214d-9bda-46c8-92dd-e2457b82508f" status: 200 len: 1312 microversion: 2.1 time: 0.541762 Oct 04 18:56:32.378435 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2660/5016] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:31 2022] GET /compute/v2.1/servers/a19e214d-9bda-46c8-92dd-e2457b82508f => generated 1312 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:56:32.390983 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-58a4e3e5-8f5d-4666-a8b5-750805d2c443 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:32.392110 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-58a4e3e5-8f5d-4666-a8b5-750805d2c443 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] [instance: a45d1b74-2d81-4e11-b837-fe77dc63f689] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:32.411874 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-58a4e3e5-8f5d-4666-a8b5-750805d2c443 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:32.413083 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-58a4e3e5-8f5d-4666-a8b5-750805d2c443 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:32.414031 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-58a4e3e5-8f5d-4666-a8b5-750805d2c443 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:32.416199 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-58a4e3e5-8f5d-4666-a8b5-750805d2c443 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:32.418428 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-58a4e3e5-8f5d-4666-a8b5-750805d2c443 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:32.419052 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-58a4e3e5-8f5d-4666-a8b5-750805d2c443 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:32.668869 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-f6bee734-53ae-4613-a6f3-de8c6cdafa53 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:32.689821 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-f6bee734-53ae-4613-a6f3-de8c6cdafa53 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:32.691419 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-f6bee734-53ae-4613-a6f3-de8c6cdafa53 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:32.692625 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-f6bee734-53ae-4613-a6f3-de8c6cdafa53 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] 10.222.0.43 "GET /compute/v2.1/servers/02a066b4-243b-4fe3-afcf-30f3e9511d1b" status: 200 len: 1875 microversion: 2.42 time: 0.972720 Oct 04 18:56:32.699852 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2357/5017] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:56:31 2022] GET /compute/v2.1/servers/02a066b4-243b-4fe3-afcf-30f3e9511d1b => generated 1875 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:56:32.821091 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-10bce758-9f9c-41ff-b258-b4825a50e7c2 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:32.822640 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-10bce758-9f9c-41ff-b258-b4825a50e7c2 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 01e250ab-d9aa-4708-ae36-10c53a411a40] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:32.840550 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-10bce758-9f9c-41ff-b258-b4825a50e7c2 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:32.841523 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-10bce758-9f9c-41ff-b258-b4825a50e7c2 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:32.842183 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-10bce758-9f9c-41ff-b258-b4825a50e7c2 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:32.843933 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-10bce758-9f9c-41ff-b258-b4825a50e7c2 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:32.846866 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-10bce758-9f9c-41ff-b258-b4825a50e7c2 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:32.847559 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-10bce758-9f9c-41ff-b258-b4825a50e7c2 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:33.246994 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-58a4e3e5-8f5d-4666-a8b5-750805d2c443 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '486c22456b1e47ae843ae41f8dfb2632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c91c7e7358048ffaaee7f51ad61b515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:33.262058 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-58a4e3e5-8f5d-4666-a8b5-750805d2c443 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] 10.222.0.43 "GET /compute/v2.1/servers/a45d1b74-2d81-4e11-b837-fe77dc63f689" status: 200 len: 1367 microversion: 2.1 time: 0.874997 Oct 04 18:56:33.265430 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2661/5018] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:32 2022] GET /compute/v2.1/servers/a45d1b74-2d81-4e11-b837-fe77dc63f689 => generated 1367 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:56:33.273929 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-ecbe4c45-cd8a-4283-bb11-c7147b4a7a91 req-d10e3e07-7f3e-4b3d-8b01-767faa65d669 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02a066b4-243b-4fe3-afcf-30f3e9511d1b", "name": "network-vif-plugged", "status": "completed", "tag": "86859dd2-218b-4ce7-b642-388a568f9811"}, {"server_uuid": "02a066b4-243b-4fe3-afcf-30f3e9511d1b", "name": "network-vif-plugged", "status": "completed", "tag": "d6932e78-3478-434a-96dd-d933c1b1b369"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:56:33.299992 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-ecbe4c45-cd8a-4283-bb11-c7147b4a7a91 req-d10e3e07-7f3e-4b3d-8b01-767faa65d669 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:33.301303 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-ecbe4c45-cd8a-4283-bb11-c7147b4a7a91 req-d10e3e07-7f3e-4b3d-8b01-767faa65d669 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:33.301979 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-ecbe4c45-cd8a-4283-bb11-c7147b4a7a91 req-d10e3e07-7f3e-4b3d-8b01-767faa65d669 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:33.336671 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-ecbe4c45-cd8a-4283-bb11-c7147b4a7a91 req-d10e3e07-7f3e-4b3d-8b01-767faa65d669 service nova] Creating event network-vif-plugged:86859dd2-218b-4ce7-b642-388a568f9811 for instance 02a066b4-243b-4fe3-afcf-30f3e9511d1b on n-h2-851028-13 Oct 04 18:56:33.346698 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-ecbe4c45-cd8a-4283-bb11-c7147b4a7a91 req-d10e3e07-7f3e-4b3d-8b01-767faa65d669 service nova] Creating event network-vif-plugged:d6932e78-3478-434a-96dd-d933c1b1b369 for instance 02a066b4-243b-4fe3-afcf-30f3e9511d1b on n-h2-851028-13 Oct 04 18:56:33.368075 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-ecbe4c45-cd8a-4283-bb11-c7147b4a7a91 req-d10e3e07-7f3e-4b3d-8b01-767faa65d669 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.091122 Oct 04 18:56:33.389547 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2662/5019] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:56:33 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:56:33.416367 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-ee7ad21d-6d85-47ea-ab1e-78e55a007290 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:33.418587 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-ee7ad21d-6d85-47ea-ab1e-78e55a007290 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] [instance: a19e214d-9bda-46c8-92dd-e2457b82508f] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:33.433140 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ee7ad21d-6d85-47ea-ab1e-78e55a007290 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:33.434020 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ee7ad21d-6d85-47ea-ab1e-78e55a007290 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:33.454482 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ee7ad21d-6d85-47ea-ab1e-78e55a007290 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:33.455673 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ee7ad21d-6d85-47ea-ab1e-78e55a007290 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:33.456397 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ee7ad21d-6d85-47ea-ab1e-78e55a007290 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:33.457073 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ee7ad21d-6d85-47ea-ab1e-78e55a007290 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:33.481644 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-10bce758-9f9c-41ff-b258-b4825a50e7c2 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f63f1ac147543dab34a28a22eb5936c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1607b30b9f324abaa88aa29e04ef3ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:33.490502 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-10bce758-9f9c-41ff-b258-b4825a50e7c2 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40" status: 200 len: 1509 microversion: 2.1 time: 0.675004 Oct 04 18:56:33.496278 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2358/5020] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:32 2022] GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40 => generated 1509 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:56:33.722323 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-02a6ac1e-86cf-42a2-aa31-c51f51ed4788 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:33.722944 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-02a6ac1e-86cf-42a2-aa31-c51f51ed4788 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] [instance: 02a066b4-243b-4fe3-afcf-30f3e9511d1b] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:33.737088 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-02a6ac1e-86cf-42a2-aa31-c51f51ed4788 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:33.741645 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-02a6ac1e-86cf-42a2-aa31-c51f51ed4788 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:33.743173 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-02a6ac1e-86cf-42a2-aa31-c51f51ed4788 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:33.744993 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-02a6ac1e-86cf-42a2-aa31-c51f51ed4788 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:33.745699 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-02a6ac1e-86cf-42a2-aa31-c51f51ed4788 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:33.746331 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-02a6ac1e-86cf-42a2-aa31-c51f51ed4788 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:33.905343 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-ee7ad21d-6d85-47ea-ab1e-78e55a007290 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9480713a3884233bd28a7986e9a5baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1e7be678b94918a8c9436a3a25eb67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:33.920438 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-ee7ad21d-6d85-47ea-ab1e-78e55a007290 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] 10.222.0.43 "GET /compute/v2.1/servers/a19e214d-9bda-46c8-92dd-e2457b82508f" status: 200 len: 1312 microversion: 2.1 time: 0.512496 Oct 04 18:56:33.922194 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2663/5021] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:33 2022] GET /compute/v2.1/servers/a19e214d-9bda-46c8-92dd-e2457b82508f => generated 1312 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:56:34.293078 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-13cded91-c286-475c-bb63-9a01d05a6be9 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:34.294557 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-13cded91-c286-475c-bb63-9a01d05a6be9 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] [instance: a45d1b74-2d81-4e11-b837-fe77dc63f689] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:34.313143 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-13cded91-c286-475c-bb63-9a01d05a6be9 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:34.315933 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-13cded91-c286-475c-bb63-9a01d05a6be9 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:34.318055 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-13cded91-c286-475c-bb63-9a01d05a6be9 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:34.321853 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-13cded91-c286-475c-bb63-9a01d05a6be9 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:34.323737 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-13cded91-c286-475c-bb63-9a01d05a6be9 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:34.330211 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-13cded91-c286-475c-bb63-9a01d05a6be9 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:34.473613 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-02a6ac1e-86cf-42a2-aa31-c51f51ed4788 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:34.510598 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-02a6ac1e-86cf-42a2-aa31-c51f51ed4788 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:34.512078 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-02a6ac1e-86cf-42a2-aa31-c51f51ed4788 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:34.540880 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-02a6ac1e-86cf-42a2-aa31-c51f51ed4788 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] 10.222.0.43 "GET /compute/v2.1/servers/02a066b4-243b-4fe3-afcf-30f3e9511d1b" status: 200 len: 1875 microversion: 2.42 time: 0.797405 Oct 04 18:56:34.543833 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2359/5022] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:56:33 2022] GET /compute/v2.1/servers/02a066b4-243b-4fe3-afcf-30f3e9511d1b => generated 1875 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:56:34.562537 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-8730c6bf-c838-4aab-85ed-f7aba1a1f9d0 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:34.563521 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-8730c6bf-c838-4aab-85ed-f7aba1a1f9d0 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 01e250ab-d9aa-4708-ae36-10c53a411a40] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:34.572527 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8730c6bf-c838-4aab-85ed-f7aba1a1f9d0 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:34.573350 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8730c6bf-c838-4aab-85ed-f7aba1a1f9d0 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:34.573977 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8730c6bf-c838-4aab-85ed-f7aba1a1f9d0 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:34.574916 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8730c6bf-c838-4aab-85ed-f7aba1a1f9d0 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:34.575597 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8730c6bf-c838-4aab-85ed-f7aba1a1f9d0 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:34.576863 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8730c6bf-c838-4aab-85ed-f7aba1a1f9d0 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:34.873548 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-13cded91-c286-475c-bb63-9a01d05a6be9 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '486c22456b1e47ae843ae41f8dfb2632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c91c7e7358048ffaaee7f51ad61b515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:34.886968 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-13cded91-c286-475c-bb63-9a01d05a6be9 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] 10.222.0.43 "GET /compute/v2.1/servers/a45d1b74-2d81-4e11-b837-fe77dc63f689" status: 200 len: 1367 microversion: 2.1 time: 0.599642 Oct 04 18:56:34.908800 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2664/5023] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:34 2022] GET /compute/v2.1/servers/a45d1b74-2d81-4e11-b837-fe77dc63f689 => generated 1367 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:56:34.944580 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-5157236a-29a9-4442-ba35-70ccd738b761 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:34.945521 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-5157236a-29a9-4442-ba35-70ccd738b761 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] [instance: a19e214d-9bda-46c8-92dd-e2457b82508f] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:34.962337 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5157236a-29a9-4442-ba35-70ccd738b761 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:34.963244 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5157236a-29a9-4442-ba35-70ccd738b761 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:34.963935 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5157236a-29a9-4442-ba35-70ccd738b761 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:34.964764 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5157236a-29a9-4442-ba35-70ccd738b761 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:34.965393 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5157236a-29a9-4442-ba35-70ccd738b761 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:34.965978 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5157236a-29a9-4442-ba35-70ccd738b761 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:35.351921 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-8730c6bf-c838-4aab-85ed-f7aba1a1f9d0 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f63f1ac147543dab34a28a22eb5936c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1607b30b9f324abaa88aa29e04ef3ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:35.360465 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-8730c6bf-c838-4aab-85ed-f7aba1a1f9d0 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40" status: 200 len: 1509 microversion: 2.1 time: 0.815096 Oct 04 18:56:35.378455 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2360/5024] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:34 2022] GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40 => generated 1509 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:56:35.424860 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-7cfdea40-51bc-4bc6-8764-14d4aa670cd5 req-06f686b3-3ba9-4bcc-9e15-83db9eefa8eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02a066b4-243b-4fe3-afcf-30f3e9511d1b", "name": "network-vif-plugged", "status": "completed", "tag": "d761be9f-2b1b-4049-b17f-6cf13693728c"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:56:35.445617 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-7cfdea40-51bc-4bc6-8764-14d4aa670cd5 req-06f686b3-3ba9-4bcc-9e15-83db9eefa8eb service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:35.448455 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-7cfdea40-51bc-4bc6-8764-14d4aa670cd5 req-06f686b3-3ba9-4bcc-9e15-83db9eefa8eb service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:35.449636 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-7cfdea40-51bc-4bc6-8764-14d4aa670cd5 req-06f686b3-3ba9-4bcc-9e15-83db9eefa8eb service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:35.479676 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-7cfdea40-51bc-4bc6-8764-14d4aa670cd5 req-06f686b3-3ba9-4bcc-9e15-83db9eefa8eb service nova] Creating event network-vif-plugged:d761be9f-2b1b-4049-b17f-6cf13693728c for instance 02a066b4-243b-4fe3-afcf-30f3e9511d1b on n-h2-851028-13 Oct 04 18:56:35.495426 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-7cfdea40-51bc-4bc6-8764-14d4aa670cd5 req-06f686b3-3ba9-4bcc-9e15-83db9eefa8eb service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074271 Oct 04 18:56:35.511133 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2361/5025] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:56:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:56:35.574529 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-a480c232-31ef-4202-a9b0-57f2ac014fc4 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:35.575518 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-a480c232-31ef-4202-a9b0-57f2ac014fc4 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] [instance: 02a066b4-243b-4fe3-afcf-30f3e9511d1b] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:35.595191 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a480c232-31ef-4202-a9b0-57f2ac014fc4 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:35.600123 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a480c232-31ef-4202-a9b0-57f2ac014fc4 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:35.600808 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a480c232-31ef-4202-a9b0-57f2ac014fc4 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:35.601802 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a480c232-31ef-4202-a9b0-57f2ac014fc4 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:35.604958 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a480c232-31ef-4202-a9b0-57f2ac014fc4 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:35.605641 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a480c232-31ef-4202-a9b0-57f2ac014fc4 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:35.615286 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-5157236a-29a9-4442-ba35-70ccd738b761 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9480713a3884233bd28a7986e9a5baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1e7be678b94918a8c9436a3a25eb67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:35.630694 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-5157236a-29a9-4442-ba35-70ccd738b761 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] 10.222.0.43 "GET /compute/v2.1/servers/a19e214d-9bda-46c8-92dd-e2457b82508f" status: 200 len: 1312 microversion: 2.1 time: 0.690577 Oct 04 18:56:35.646383 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2665/5026] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:34 2022] GET /compute/v2.1/servers/a19e214d-9bda-46c8-92dd-e2457b82508f => generated 1312 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:56:35.916692 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-6474732e-0b58-469f-9539-93fd8f5262b5 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:35.918063 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-6474732e-0b58-469f-9539-93fd8f5262b5 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] [instance: a45d1b74-2d81-4e11-b837-fe77dc63f689] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:35.932373 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6474732e-0b58-469f-9539-93fd8f5262b5 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:35.933088 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6474732e-0b58-469f-9539-93fd8f5262b5 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:35.933719 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6474732e-0b58-469f-9539-93fd8f5262b5 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:35.934675 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6474732e-0b58-469f-9539-93fd8f5262b5 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:35.935870 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6474732e-0b58-469f-9539-93fd8f5262b5 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:35.936473 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6474732e-0b58-469f-9539-93fd8f5262b5 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:36.611710 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-a480c232-31ef-4202-a9b0-57f2ac014fc4 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:36.628905 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-a480c232-31ef-4202-a9b0-57f2ac014fc4 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:36.634949 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-a480c232-31ef-4202-a9b0-57f2ac014fc4 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:36.643716 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-a480c232-31ef-4202-a9b0-57f2ac014fc4 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] 10.222.0.43 "GET /compute/v2.1/servers/02a066b4-243b-4fe3-afcf-30f3e9511d1b" status: 200 len: 1875 microversion: 2.42 time: 1.073043 Oct 04 18:56:36.646860 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2362/5027] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:56:35 2022] GET /compute/v2.1/servers/02a066b4-243b-4fe3-afcf-30f3e9511d1b => generated 1875 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:56:36.656892 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-a0d6379a-8c18-4f87-9267-94bcc066e88d tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:36.657954 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-a0d6379a-8c18-4f87-9267-94bcc066e88d tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 01e250ab-d9aa-4708-ae36-10c53a411a40] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:36.682159 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a0d6379a-8c18-4f87-9267-94bcc066e88d tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:36.684583 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a0d6379a-8c18-4f87-9267-94bcc066e88d tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:36.687875 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a0d6379a-8c18-4f87-9267-94bcc066e88d tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:36.690311 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a0d6379a-8c18-4f87-9267-94bcc066e88d tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:36.692867 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a0d6379a-8c18-4f87-9267-94bcc066e88d tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:36.695158 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a0d6379a-8c18-4f87-9267-94bcc066e88d tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:36.949314 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-6474732e-0b58-469f-9539-93fd8f5262b5 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '486c22456b1e47ae843ae41f8dfb2632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c91c7e7358048ffaaee7f51ad61b515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:36.961765 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-6474732e-0b58-469f-9539-93fd8f5262b5 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] 10.222.0.43 "GET /compute/v2.1/servers/a45d1b74-2d81-4e11-b837-fe77dc63f689" status: 200 len: 1367 microversion: 2.1 time: 1.047254 Oct 04 18:56:36.965066 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2666/5028] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:35 2022] GET /compute/v2.1/servers/a45d1b74-2d81-4e11-b837-fe77dc63f689 => generated 1367 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:56:36.987120 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-57984a6d-2701-42f7-bd93-2322b820ceaf tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:36.988183 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-57984a6d-2701-42f7-bd93-2322b820ceaf tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] [instance: a19e214d-9bda-46c8-92dd-e2457b82508f] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:37.004399 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-57984a6d-2701-42f7-bd93-2322b820ceaf tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:37.006161 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-57984a6d-2701-42f7-bd93-2322b820ceaf tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:37.008811 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-57984a6d-2701-42f7-bd93-2322b820ceaf tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:37.012957 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-57984a6d-2701-42f7-bd93-2322b820ceaf tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:37.013639 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-57984a6d-2701-42f7-bd93-2322b820ceaf tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:37.014394 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-57984a6d-2701-42f7-bd93-2322b820ceaf tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:37.323954 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-57984a6d-2701-42f7-bd93-2322b820ceaf tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9480713a3884233bd28a7986e9a5baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1e7be678b94918a8c9436a3a25eb67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:37.332765 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-57984a6d-2701-42f7-bd93-2322b820ceaf tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] 10.222.0.43 "GET /compute/v2.1/servers/a19e214d-9bda-46c8-92dd-e2457b82508f" status: 200 len: 1312 microversion: 2.1 time: 0.363339 Oct 04 18:56:37.334747 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2667/5029] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:36 2022] GET /compute/v2.1/servers/a19e214d-9bda-46c8-92dd-e2457b82508f => generated 1312 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:56:37.352628 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-a0d6379a-8c18-4f87-9267-94bcc066e88d tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f63f1ac147543dab34a28a22eb5936c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1607b30b9f324abaa88aa29e04ef3ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:37.373130 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-a0d6379a-8c18-4f87-9267-94bcc066e88d tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40" status: 200 len: 1512 microversion: 2.1 time: 0.724127 Oct 04 18:56:37.395173 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2363/5030] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:36 2022] GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40 => generated 1512 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:56:37.400400 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-7300f406-8150-49e9-9af4-e1eb6020d4ad tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:37.401034 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-7300f406-8150-49e9-9af4-e1eb6020d4ad tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 01e250ab-d9aa-4708-ae36-10c53a411a40] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:37.422982 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7300f406-8150-49e9-9af4-e1eb6020d4ad tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:37.423818 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7300f406-8150-49e9-9af4-e1eb6020d4ad tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:37.424994 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7300f406-8150-49e9-9af4-e1eb6020d4ad tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:37.426133 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7300f406-8150-49e9-9af4-e1eb6020d4ad tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:37.426597 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7300f406-8150-49e9-9af4-e1eb6020d4ad tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:37.428211 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7300f406-8150-49e9-9af4-e1eb6020d4ad tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:37.538925 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-54d273cc-4357-4a8c-8724-5ef8205f1601 req-13b715e7-9958-4fef-a0d6-bfa79438347f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a19e214d-9bda-46c8-92dd-e2457b82508f", "name": "network-vif-plugged", "status": "completed", "tag": "070e3f62-9f08-4f5e-8667-35d8698aaf1c"}, {"server_uuid": "01e250ab-d9aa-4708-ae36-10c53a411a40", "name": "network-vif-unplugged", "status": "completed", "tag": "70d1b09a-03d8-41b4-9a82-fc7d75a3624a"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:56:37.579619 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-54d273cc-4357-4a8c-8724-5ef8205f1601 req-13b715e7-9958-4fef-a0d6-bfa79438347f service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:37.580121 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-54d273cc-4357-4a8c-8724-5ef8205f1601 req-13b715e7-9958-4fef-a0d6-bfa79438347f service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:37.580561 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-54d273cc-4357-4a8c-8724-5ef8205f1601 req-13b715e7-9958-4fef-a0d6-bfa79438347f service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:37.638117 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-54d273cc-4357-4a8c-8724-5ef8205f1601 req-13b715e7-9958-4fef-a0d6-bfa79438347f service nova] Creating event network-vif-plugged:070e3f62-9f08-4f5e-8667-35d8698aaf1c for instance a19e214d-9bda-46c8-92dd-e2457b82508f on n-h2-851028-13 Oct 04 18:56:37.658776 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.compute.server_external_events [req-54d273cc-4357-4a8c-8724-5ef8205f1601 req-13b715e7-9958-4fef-a0d6-bfa79438347f service nova] Unable to find a host for instance 01e250ab-d9aa-4708-ae36-10c53a411a40. Dropping event network-vif-unplugged {{(pid=123595) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 04 18:56:37.681076 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-54d273cc-4357-4a8c-8724-5ef8205f1601 req-13b715e7-9958-4fef-a0d6-bfa79438347f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 207 len: 353 microversion: 2.1 time: 0.144488 Oct 04 18:56:37.689686 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2364/5031] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:56:37 2022] POST /compute/v2.1/os-server-external-events => generated 353 bytes in 156 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 04 18:56:37.727198 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-5a74e6fa-ca79-4419-9140-05c1ec16b21e tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:37.738694 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-5a74e6fa-ca79-4419-9140-05c1ec16b21e tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] [instance: 02a066b4-243b-4fe3-afcf-30f3e9511d1b] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:37.781541 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5a74e6fa-ca79-4419-9140-05c1ec16b21e tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:37.782717 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5a74e6fa-ca79-4419-9140-05c1ec16b21e tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:37.783182 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5a74e6fa-ca79-4419-9140-05c1ec16b21e tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:37.783935 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5a74e6fa-ca79-4419-9140-05c1ec16b21e tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:37.789903 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5a74e6fa-ca79-4419-9140-05c1ec16b21e tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:37.791849 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5a74e6fa-ca79-4419-9140-05c1ec16b21e tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:38.237492 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-7300f406-8150-49e9-9af4-e1eb6020d4ad tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f63f1ac147543dab34a28a22eb5936c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1607b30b9f324abaa88aa29e04ef3ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:38.248143 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-7300f406-8150-49e9-9af4-e1eb6020d4ad tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40" status: 200 len: 1452 microversion: 2.1 time: 0.851245 Oct 04 18:56:38.249479 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2668/5032] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:37 2022] GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40 => generated 1452 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:56:38.255952 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-b1022bd0-05b7-44de-893f-ff32ee8f445e tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:38.256874 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-b1022bd0-05b7-44de-893f-ff32ee8f445e tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] [instance: a45d1b74-2d81-4e11-b837-fe77dc63f689] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:38.267094 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b1022bd0-05b7-44de-893f-ff32ee8f445e tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:38.268872 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b1022bd0-05b7-44de-893f-ff32ee8f445e tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:38.270252 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b1022bd0-05b7-44de-893f-ff32ee8f445e tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:38.272099 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b1022bd0-05b7-44de-893f-ff32ee8f445e tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:38.273363 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b1022bd0-05b7-44de-893f-ff32ee8f445e tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:38.274033 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b1022bd0-05b7-44de-893f-ff32ee8f445e tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:38.542294 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-b1022bd0-05b7-44de-893f-ff32ee8f445e tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '486c22456b1e47ae843ae41f8dfb2632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c91c7e7358048ffaaee7f51ad61b515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:38.558104 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-b1022bd0-05b7-44de-893f-ff32ee8f445e tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] 10.222.0.43 "GET /compute/v2.1/servers/a45d1b74-2d81-4e11-b837-fe77dc63f689" status: 200 len: 1367 microversion: 2.1 time: 0.307283 Oct 04 18:56:38.564056 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2669/5033] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:38 2022] GET /compute/v2.1/servers/a45d1b74-2d81-4e11-b837-fe77dc63f689 => generated 1367 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:56:38.578294 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-86884164-4b8b-4281-b13e-b32e7f9353e4 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:38.581225 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-5a74e6fa-ca79-4419-9140-05c1ec16b21e tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:38.582144 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-86884164-4b8b-4281-b13e-b32e7f9353e4 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] [instance: a19e214d-9bda-46c8-92dd-e2457b82508f] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:38.599654 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-86884164-4b8b-4281-b13e-b32e7f9353e4 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:38.611177 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-5a74e6fa-ca79-4419-9140-05c1ec16b21e tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:38.614835 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-86884164-4b8b-4281-b13e-b32e7f9353e4 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:38.619199 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-5a74e6fa-ca79-4419-9140-05c1ec16b21e tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:38.619404 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-86884164-4b8b-4281-b13e-b32e7f9353e4 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:38.620892 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-86884164-4b8b-4281-b13e-b32e7f9353e4 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:38.622464 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-86884164-4b8b-4281-b13e-b32e7f9353e4 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:38.626248 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-5a74e6fa-ca79-4419-9140-05c1ec16b21e tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] 10.222.0.43 "GET /compute/v2.1/servers/02a066b4-243b-4fe3-afcf-30f3e9511d1b" status: 200 len: 1875 microversion: 2.42 time: 0.932932 Oct 04 18:56:38.626471 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-86884164-4b8b-4281-b13e-b32e7f9353e4 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:38.629216 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2365/5034] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:56:37 2022] GET /compute/v2.1/servers/02a066b4-243b-4fe3-afcf-30f3e9511d1b => generated 1875 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:56:38.665448 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-d2d49e82-4de6-4fe1-9491-46b54c0a0508 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:56:38.666721 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-d2d49e82-4de6-4fe1-9491-46b54c0a0508 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 01e250ab-d9aa-4708-ae36-10c53a411a40] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:38.698509 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d2d49e82-4de6-4fe1-9491-46b54c0a0508 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:38.699788 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d2d49e82-4de6-4fe1-9491-46b54c0a0508 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:38.700386 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d2d49e82-4de6-4fe1-9491-46b54c0a0508 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:38.702483 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d2d49e82-4de6-4fe1-9491-46b54c0a0508 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:38.707770 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d2d49e82-4de6-4fe1-9491-46b54c0a0508 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:38.708994 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d2d49e82-4de6-4fe1-9491-46b54c0a0508 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:38.796370 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.objects.instance [None req-d2d49e82-4de6-4fe1-9491-46b54c0a0508 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lazy-loading 'flavor' on Instance uuid 01e250ab-d9aa-4708-ae36-10c53a411a40 {{(pid=123595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:56:38.858738 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-d2d49e82-4de6-4fe1-9491-46b54c0a0508 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] HTTP exception thrown: Cannot 'shelve' instance 01e250ab-d9aa-4708-ae36-10c53a411a40 while it is in vm_state shelved_offloaded Oct 04 18:56:38.860720 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-d2d49e82-4de6-4fe1-9491-46b54c0a0508 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Request method failure captured: Oct 04 18:56:38.860720 n-d-851028-13 devstack@n-api.service[123595]: request: POST /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40/action HTTP/1.1 Oct 04 18:56:38.860720 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 18:56:38.860720 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 18:56:38.860720 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 18:56:38.860720 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 14 Oct 04 18:56:38.860720 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 18:56:38.860720 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 18:56:38.860720 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 18:56:38.860720 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 18:56:38.860720 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPIEZsAoFcr6P1AMHBWUo8LvryOn1l2-LYSKr4xgLCvHblWFuAiGVlStWcljkgzOc7-ldx7qv3C-2jYmQ32_Zk5yP28dI64Re9CsyHCLmsYfyJdD0-2_kU92lHK36Fs8oXqXU2FijNX-X4IYqe4GjOQDN7LB9zCeEIcrxQ2LRJFOwbQY Oct 04 18:56:38.860720 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 18:56:38.860720 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 18:56:38.860720 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 18:56:38.860720 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 18:56:38.860720 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 18:56:38.860720 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 18:56:38.860720 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: 1607b30b9f324abaa88aa29e04ef3ec4 Oct 04 18:56:38.860720 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-ServersNegativeTestJSON-708693932 Oct 04 18:56:38.860720 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 18:56:38.860720 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 18:56:38.860720 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/1607b30b9f324abaa88aa29e04ef3ec4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_1607b30b9f324abaa88aa29e04ef3ec4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1607b30b9f324abaa88aa29e04ef3ec4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1607b30b9f324abaa88aa29e04ef3ec4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:56:38.860720 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-ServersNegativeTestJSON-708693932 Oct 04 18:56:38.860720 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: 1607b30b9f324abaa88aa29e04ef3ec4 Oct 04 18:56:38.860720 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-ServersNegativeTestJSON-708693932 Oct 04 18:56:38.860720 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-ServersNegativeTestJSON-708693932-project Oct 04 18:56:38.860720 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 18:56:38.860720 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 18:56:38.860720 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: 6f63f1ac147543dab34a28a22eb5936c Oct 04 18:56:38.860720 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-ServersNegativeTestJSON-708693932-project Oct 04 18:56:38.860720 n-d-851028-13 devstack@n-api.service[123595]: Oct 04 18:56:38.860720 n-d-851028-13 devstack@n-api.service[123595]: {"shelve": {}} Oct 04 18:56:38.860720 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 18:56:38.860720 n-d-851028-13 devstack@n-api.service[123595]: exception: Cannot 'shelve' instance 01e250ab-d9aa-4708-ae36-10c53a411a40 while it is in vm_state shelved_offloaded Oct 04 18:56:38.860720 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': '01e250ab-d9aa-4708-ae36-10c53a411a40', 'body': {'shelve': {}}} Oct 04 18:56:38.860720 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:56:38.860720 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:56:38.860720 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 49, in _shelve Oct 04 18:56:38.860720 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi self.compute_api.shelve(context, instance) Oct 04 18:56:38.860720 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 04 18:56:38.860720 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 04 18:56:38.860720 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 04 18:56:38.860720 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 18:56:38.860720 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 04 18:56:38.860720 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 04 18:56:38.860720 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 18:56:38.860720 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 18:56:38.860720 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 04 18:56:38.860720 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 04 18:56:38.860720 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 01e250ab-d9aa-4708-ae36-10c53a411a40 in vm_state shelved_offloaded. Cannot shelve while the instance is in this state. Oct 04 18:56:38.860720 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:56:38.860720 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:56:38.860720 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:56:38.860720 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:56:38.860720 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:56:38.860720 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:56:38.860720 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:56:38.860720 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:56:38.860720 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:56:38.860720 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:56:38.860720 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 56, in _shelve Oct 04 18:56:38.860720 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 04 18:56:38.860720 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 04 18:56:38.860720 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 04 18:56:38.866564 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'shelve' instance 01e250ab-d9aa-4708-ae36-10c53a411a40 while it is in vm_state shelved_offloaded Oct 04 18:56:38.866564 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:56:38.866564 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:56:38.866564 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:56:38.866564 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:56:38.866564 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:56:38.866564 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:56:38.866564 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:56:38.866564 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:56:38.866564 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'shelve' instance 01e250ab-d9aa-4708-ae36-10c53a411a40 while it is in vm_state shelved_offloaded Oct 04 18:56:38.866564 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:56:38.866564 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-d2d49e82-4de6-4fe1-9491-46b54c0a0508 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Returning 409 to user: Cannot 'shelve' instance 01e250ab-d9aa-4708-ae36-10c53a411a40 while it is in vm_state shelved_offloaded {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:56:38.876758 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-d2d49e82-4de6-4fe1-9491-46b54c0a0508 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "POST /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40/action" status: 409 len: 155 microversion: 2.1 time: 0.244773 Oct 04 18:56:38.877336 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2366/5035] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 18:56:38 2022] POST /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40/action => generated 155 bytes in 247 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:56:38.889436 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-e94d9c5c-e92c-44d4-a249-257eaa5c89de tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:56:38.890034 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-e94d9c5c-e92c-44d4-a249-257eaa5c89de tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 01e250ab-d9aa-4708-ae36-10c53a411a40] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:38.905987 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e94d9c5c-e92c-44d4-a249-257eaa5c89de tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:38.906492 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e94d9c5c-e92c-44d4-a249-257eaa5c89de tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:38.906933 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e94d9c5c-e92c-44d4-a249-257eaa5c89de tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:38.907647 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e94d9c5c-e92c-44d4-a249-257eaa5c89de tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:38.908104 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e94d9c5c-e92c-44d4-a249-257eaa5c89de tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:38.908540 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e94d9c5c-e92c-44d4-a249-257eaa5c89de tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:39.001554 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-e94d9c5c-e92c-44d4-a249-257eaa5c89de tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 01e250ab-d9aa-4708-ae36-10c53a411a40] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=123595) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 04 18:56:39.036703 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-86884164-4b8b-4281-b13e-b32e7f9353e4 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9480713a3884233bd28a7986e9a5baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1e7be678b94918a8c9436a3a25eb67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:39.049515 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-86884164-4b8b-4281-b13e-b32e7f9353e4 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] 10.222.0.43 "GET /compute/v2.1/servers/a19e214d-9bda-46c8-92dd-e2457b82508f" status: 200 len: 1312 microversion: 2.1 time: 0.481825 Oct 04 18:56:39.052787 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2670/5036] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:38 2022] GET /compute/v2.1/servers/a19e214d-9bda-46c8-92dd-e2457b82508f => generated 1312 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:56:39.224507 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-e94d9c5c-e92c-44d4-a249-257eaa5c89de tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "POST /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40/action" status: 202 len: 0 microversion: 2.1 time: 0.342487 Oct 04 18:56:39.227100 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2367/5037] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 18:56:38 2022] POST /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40/action => generated 0 bytes in 346 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:56:39.240598 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-e1eccd7f-0720-4b0a-8cf7-d91b65acc609 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:39.243014 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-e1eccd7f-0720-4b0a-8cf7-d91b65acc609 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 01e250ab-d9aa-4708-ae36-10c53a411a40] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:39.260651 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e1eccd7f-0720-4b0a-8cf7-d91b65acc609 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:39.261790 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e1eccd7f-0720-4b0a-8cf7-d91b65acc609 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:39.262484 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e1eccd7f-0720-4b0a-8cf7-d91b65acc609 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:39.263651 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e1eccd7f-0720-4b0a-8cf7-d91b65acc609 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:39.266577 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e1eccd7f-0720-4b0a-8cf7-d91b65acc609 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:39.267498 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e1eccd7f-0720-4b0a-8cf7-d91b65acc609 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:39.584753 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-8074aeec-d0fb-4cdc-a223-e1bb80678371 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:39.586966 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-8074aeec-d0fb-4cdc-a223-e1bb80678371 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] [instance: a45d1b74-2d81-4e11-b837-fe77dc63f689] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:39.602198 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8074aeec-d0fb-4cdc-a223-e1bb80678371 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:39.617728 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8074aeec-d0fb-4cdc-a223-e1bb80678371 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:39.619626 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8074aeec-d0fb-4cdc-a223-e1bb80678371 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:39.624401 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8074aeec-d0fb-4cdc-a223-e1bb80678371 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:39.627764 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8074aeec-d0fb-4cdc-a223-e1bb80678371 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:39.628518 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8074aeec-d0fb-4cdc-a223-e1bb80678371 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:39.763082 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-e1eccd7f-0720-4b0a-8cf7-d91b65acc609 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f63f1ac147543dab34a28a22eb5936c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1607b30b9f324abaa88aa29e04ef3ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:39.831008 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-e1eccd7f-0720-4b0a-8cf7-d91b65acc609 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40" status: 200 len: 1460 microversion: 2.1 time: 0.598172 Oct 04 18:56:39.844671 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2671/5038] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:39 2022] GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40 => generated 1460 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:56:39.865817 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-db1fa870-9761-4375-9c94-197e40d7edc9 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:39.866998 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-db1fa870-9761-4375-9c94-197e40d7edc9 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] [instance: 02a066b4-243b-4fe3-afcf-30f3e9511d1b] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:39.884276 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-db1fa870-9761-4375-9c94-197e40d7edc9 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:39.885295 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-db1fa870-9761-4375-9c94-197e40d7edc9 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:39.885983 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-db1fa870-9761-4375-9c94-197e40d7edc9 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:39.887647 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-db1fa870-9761-4375-9c94-197e40d7edc9 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:39.888128 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-db1fa870-9761-4375-9c94-197e40d7edc9 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:39.889428 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-db1fa870-9761-4375-9c94-197e40d7edc9 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:40.249202 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-8074aeec-d0fb-4cdc-a223-e1bb80678371 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '486c22456b1e47ae843ae41f8dfb2632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c91c7e7358048ffaaee7f51ad61b515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:40.265513 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-8074aeec-d0fb-4cdc-a223-e1bb80678371 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] 10.222.0.43 "GET /compute/v2.1/servers/a45d1b74-2d81-4e11-b837-fe77dc63f689" status: 200 len: 1367 microversion: 2.1 time: 0.682879 Oct 04 18:56:40.280873 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2368/5039] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:39 2022] GET /compute/v2.1/servers/a45d1b74-2d81-4e11-b837-fe77dc63f689 => generated 1367 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:56:40.293809 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-36c4c0f0-9ee1-4ae1-8b25-6f46ca96d4ca req-0708a182-fa45-4141-914a-61e4a0c186c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a45d1b74-2d81-4e11-b837-fe77dc63f689", "name": "network-vif-plugged", "status": "completed", "tag": "b3e1d52d-3e3e-43c8-9f57-f601d774fbfe"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:56:40.317579 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-36c4c0f0-9ee1-4ae1-8b25-6f46ca96d4ca req-0708a182-fa45-4141-914a-61e4a0c186c0 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:40.318073 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-36c4c0f0-9ee1-4ae1-8b25-6f46ca96d4ca req-0708a182-fa45-4141-914a-61e4a0c186c0 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:40.318514 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-36c4c0f0-9ee1-4ae1-8b25-6f46ca96d4ca req-0708a182-fa45-4141-914a-61e4a0c186c0 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:40.342855 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-36c4c0f0-9ee1-4ae1-8b25-6f46ca96d4ca req-0708a182-fa45-4141-914a-61e4a0c186c0 service nova] Creating event network-vif-plugged:b3e1d52d-3e3e-43c8-9f57-f601d774fbfe for instance a45d1b74-2d81-4e11-b837-fe77dc63f689 on n-h1-851028-13 Oct 04 18:56:40.363053 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-36c4c0f0-9ee1-4ae1-8b25-6f46ca96d4ca req-0708a182-fa45-4141-914a-61e4a0c186c0 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079760 Oct 04 18:56:40.364345 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2369/5040] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:56:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:56:40.385536 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-5ce08777-6f64-4c99-b2d6-55de34894710 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:40.392496 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-5ce08777-6f64-4c99-b2d6-55de34894710 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] [instance: a19e214d-9bda-46c8-92dd-e2457b82508f] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:40.415982 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5ce08777-6f64-4c99-b2d6-55de34894710 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:40.419872 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5ce08777-6f64-4c99-b2d6-55de34894710 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:40.424866 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5ce08777-6f64-4c99-b2d6-55de34894710 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:40.426139 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5ce08777-6f64-4c99-b2d6-55de34894710 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:40.426842 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5ce08777-6f64-4c99-b2d6-55de34894710 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:40.427622 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5ce08777-6f64-4c99-b2d6-55de34894710 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:40.782556 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-db1fa870-9761-4375-9c94-197e40d7edc9 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:40.802932 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-db1fa870-9761-4375-9c94-197e40d7edc9 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:40.804429 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-db1fa870-9761-4375-9c94-197e40d7edc9 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:40.811224 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-db1fa870-9761-4375-9c94-197e40d7edc9 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] 10.222.0.43 "GET /compute/v2.1/servers/02a066b4-243b-4fe3-afcf-30f3e9511d1b" status: 200 len: 2832 microversion: 2.42 time: 0.960109 Oct 04 18:56:40.812978 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2672/5041] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:56:39 2022] GET /compute/v2.1/servers/02a066b4-243b-4fe3-afcf-30f3e9511d1b => generated 2832 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:56:40.841904 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-41de358b-2f27-4cfd-94f9-2ba9d5f1ee86 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:40.842695 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-41de358b-2f27-4cfd-94f9-2ba9d5f1ee86 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] [instance: 02a066b4-243b-4fe3-afcf-30f3e9511d1b] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:40.850367 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-41de358b-2f27-4cfd-94f9-2ba9d5f1ee86 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:40.851145 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-41de358b-2f27-4cfd-94f9-2ba9d5f1ee86 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:40.851848 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-41de358b-2f27-4cfd-94f9-2ba9d5f1ee86 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:40.853647 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-41de358b-2f27-4cfd-94f9-2ba9d5f1ee86 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:40.854830 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-41de358b-2f27-4cfd-94f9-2ba9d5f1ee86 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:40.855470 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-41de358b-2f27-4cfd-94f9-2ba9d5f1ee86 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:40.882808 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=100 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:56:41.252052 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-5ce08777-6f64-4c99-b2d6-55de34894710 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9480713a3884233bd28a7986e9a5baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1e7be678b94918a8c9436a3a25eb67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:41.264578 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-5ce08777-6f64-4c99-b2d6-55de34894710 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] 10.222.0.43 "GET /compute/v2.1/servers/a19e214d-9bda-46c8-92dd-e2457b82508f" status: 200 len: 1497 microversion: 2.1 time: 0.898736 Oct 04 18:56:41.267281 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-41de358b-2f27-4cfd-94f9-2ba9d5f1ee86 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] 10.222.0.43 "GET /compute/v2.1/servers/02a066b4-243b-4fe3-afcf-30f3e9511d1b/os-interface" status: 200 len: 1831 microversion: 2.42 time: 0.429463 Oct 04 18:56:41.267922 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2370/5042] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:40 2022] GET /compute/v2.1/servers/a19e214d-9bda-46c8-92dd-e2457b82508f => generated 1497 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:56:41.277924 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2673/5043] 10.222.0.43 () {60 vars in 1316 bytes} [Tue Oct 4 18:56:40 2022] GET /compute/v2.1/servers/02a066b4-243b-4fe3-afcf-30f3e9511d1b/os-interface => generated 1831 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:56:41.284462 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-c0415f56-a0fd-472e-935b-5cb3a9b2e1cc tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:41.285243 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-c0415f56-a0fd-472e-935b-5cb3a9b2e1cc tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 01e250ab-d9aa-4708-ae36-10c53a411a40] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:41.290604 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-10a517f7-5de4-41ee-aec5-66253dfab4c0 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:41.291326 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-10a517f7-5de4-41ee-aec5-66253dfab4c0 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] [instance: a45d1b74-2d81-4e11-b837-fe77dc63f689] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:41.300276 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c0415f56-a0fd-472e-935b-5cb3a9b2e1cc tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:41.306367 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-10a517f7-5de4-41ee-aec5-66253dfab4c0 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:41.309327 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-10a517f7-5de4-41ee-aec5-66253dfab4c0 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:41.310833 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c0415f56-a0fd-472e-935b-5cb3a9b2e1cc tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:41.311549 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-10a517f7-5de4-41ee-aec5-66253dfab4c0 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:41.312018 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c0415f56-a0fd-472e-935b-5cb3a9b2e1cc tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:41.315054 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-10a517f7-5de4-41ee-aec5-66253dfab4c0 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:41.316731 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-10a517f7-5de4-41ee-aec5-66253dfab4c0 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:41.317778 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c0415f56-a0fd-472e-935b-5cb3a9b2e1cc tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:41.319211 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-10a517f7-5de4-41ee-aec5-66253dfab4c0 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:41.319353 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c0415f56-a0fd-472e-935b-5cb3a9b2e1cc tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:41.319353 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c0415f56-a0fd-472e-935b-5cb3a9b2e1cc tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:41.960723 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-c0415f56-a0fd-472e-935b-5cb3a9b2e1cc tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f63f1ac147543dab34a28a22eb5936c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1607b30b9f324abaa88aa29e04ef3ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:41.980295 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-c0415f56-a0fd-472e-935b-5cb3a9b2e1cc tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40" status: 200 len: 1460 microversion: 2.1 time: 0.701976 Oct 04 18:56:41.997643 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2371/5044] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:41 2022] GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40 => generated 1460 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:56:42.491869 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-c71f7a49-c751-402a-bebb-08a290455716 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:42.495471 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-c71f7a49-c751-402a-bebb-08a290455716 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] [instance: a19e214d-9bda-46c8-92dd-e2457b82508f] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:42.520480 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c71f7a49-c751-402a-bebb-08a290455716 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:42.522951 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c71f7a49-c751-402a-bebb-08a290455716 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:42.527216 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c71f7a49-c751-402a-bebb-08a290455716 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:42.528233 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c71f7a49-c751-402a-bebb-08a290455716 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:42.529567 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c71f7a49-c751-402a-bebb-08a290455716 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:42.540150 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c71f7a49-c751-402a-bebb-08a290455716 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:42.634076 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-c71f7a49-c751-402a-bebb-08a290455716 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] [instance: a19e214d-9bda-46c8-92dd-e2457b82508f] Going to try to terminate instance {{(pid=123595) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:56:42.641599 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:56:42.914656 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-c71f7a49-c751-402a-bebb-08a290455716 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] 10.222.0.43 "DELETE /compute/v2.1/servers/a19e214d-9bda-46c8-92dd-e2457b82508f" status: 204 len: 0 microversion: 2.1 time: 0.427306 Oct 04 18:56:42.921751 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2372/5045] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 18:56:42 2022] DELETE /compute/v2.1/servers/a19e214d-9bda-46c8-92dd-e2457b82508f => generated 0 bytes in 431 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:56:42.940887 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-eb682a8d-f5bf-4c16-83e3-0c6c8965fa42 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:42.945522 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-eb682a8d-f5bf-4c16-83e3-0c6c8965fa42 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] [instance: a19e214d-9bda-46c8-92dd-e2457b82508f] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:42.972970 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-eb682a8d-f5bf-4c16-83e3-0c6c8965fa42 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:42.973500 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-eb682a8d-f5bf-4c16-83e3-0c6c8965fa42 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:42.973946 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-eb682a8d-f5bf-4c16-83e3-0c6c8965fa42 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:42.974661 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-eb682a8d-f5bf-4c16-83e3-0c6c8965fa42 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:42.975117 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-eb682a8d-f5bf-4c16-83e3-0c6c8965fa42 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:42.975546 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-eb682a8d-f5bf-4c16-83e3-0c6c8965fa42 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:43.121621 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-10a517f7-5de4-41ee-aec5-66253dfab4c0 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '486c22456b1e47ae843ae41f8dfb2632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c91c7e7358048ffaaee7f51ad61b515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:43.145783 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-10a517f7-5de4-41ee-aec5-66253dfab4c0 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] 10.222.0.43 "GET /compute/v2.1/servers/a45d1b74-2d81-4e11-b837-fe77dc63f689" status: 200 len: 1367 microversion: 2.1 time: 1.860183 Oct 04 18:56:43.168234 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2674/5046] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:41 2022] GET /compute/v2.1/servers/a45d1b74-2d81-4e11-b837-fe77dc63f689 => generated 1367 bytes in 1869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:56:43.173019 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-d9c3f380-42a8-4ddf-a7f5-d186802dbbbd tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:43.173019 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-d9c3f380-42a8-4ddf-a7f5-d186802dbbbd tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 01e250ab-d9aa-4708-ae36-10c53a411a40] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:43.195996 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d9c3f380-42a8-4ddf-a7f5-d186802dbbbd tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:43.198818 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d9c3f380-42a8-4ddf-a7f5-d186802dbbbd tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:43.204154 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d9c3f380-42a8-4ddf-a7f5-d186802dbbbd tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:43.205540 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d9c3f380-42a8-4ddf-a7f5-d186802dbbbd tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:43.207338 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d9c3f380-42a8-4ddf-a7f5-d186802dbbbd tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:43.208510 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d9c3f380-42a8-4ddf-a7f5-d186802dbbbd tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:43.710262 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-d9c3f380-42a8-4ddf-a7f5-d186802dbbbd tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f63f1ac147543dab34a28a22eb5936c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1607b30b9f324abaa88aa29e04ef3ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:43.737140 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-d9c3f380-42a8-4ddf-a7f5-d186802dbbbd tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40" status: 200 len: 1460 microversion: 2.1 time: 0.571289 Oct 04 18:56:43.745265 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2675/5047] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:43 2022] GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40 => generated 1460 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:56:43.765669 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-eb682a8d-f5bf-4c16-83e3-0c6c8965fa42 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9480713a3884233bd28a7986e9a5baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1e7be678b94918a8c9436a3a25eb67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:43.823819 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-eb682a8d-f5bf-4c16-83e3-0c6c8965fa42 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] 10.222.0.43 "GET /compute/v2.1/servers/a19e214d-9bda-46c8-92dd-e2457b82508f" status: 200 len: 1503 microversion: 2.1 time: 0.900404 Oct 04 18:56:43.835931 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2373/5048] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:42 2022] GET /compute/v2.1/servers/a19e214d-9bda-46c8-92dd-e2457b82508f => generated 1503 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:56:44.188697 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-3daf8439-a940-48de-ad93-4ccf7074f7c1 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:44.189345 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-3daf8439-a940-48de-ad93-4ccf7074f7c1 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] [instance: a45d1b74-2d81-4e11-b837-fe77dc63f689] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:44.226905 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3daf8439-a940-48de-ad93-4ccf7074f7c1 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:44.229975 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3daf8439-a940-48de-ad93-4ccf7074f7c1 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:44.233283 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3daf8439-a940-48de-ad93-4ccf7074f7c1 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:44.237745 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3daf8439-a940-48de-ad93-4ccf7074f7c1 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:44.251835 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3daf8439-a940-48de-ad93-4ccf7074f7c1 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:44.252304 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3daf8439-a940-48de-ad93-4ccf7074f7c1 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:44.774046 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-405153ee-a2d9-46d7-b710-81c954ee5d19 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:44.774804 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-405153ee-a2d9-46d7-b710-81c954ee5d19 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 01e250ab-d9aa-4708-ae36-10c53a411a40] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:44.790043 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-405153ee-a2d9-46d7-b710-81c954ee5d19 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:44.790550 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-405153ee-a2d9-46d7-b710-81c954ee5d19 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:44.792642 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-405153ee-a2d9-46d7-b710-81c954ee5d19 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:44.793473 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-405153ee-a2d9-46d7-b710-81c954ee5d19 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:44.793945 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-405153ee-a2d9-46d7-b710-81c954ee5d19 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:44.800236 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-405153ee-a2d9-46d7-b710-81c954ee5d19 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:45.403190 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-3daf8439-a940-48de-ad93-4ccf7074f7c1 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '486c22456b1e47ae843ae41f8dfb2632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c91c7e7358048ffaaee7f51ad61b515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:45.415221 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-3daf8439-a940-48de-ad93-4ccf7074f7c1 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] 10.222.0.43 "GET /compute/v2.1/servers/a45d1b74-2d81-4e11-b837-fe77dc63f689" status: 200 len: 1558 microversion: 2.1 time: 1.232623 Oct 04 18:56:45.417611 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2676/5049] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:44 2022] GET /compute/v2.1/servers/a45d1b74-2d81-4e11-b837-fe77dc63f689 => generated 1558 bytes in 1236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:56:45.453089 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-a55ee1c9-536e-4309-856a-f471132010ba tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:45.457661 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-a55ee1c9-536e-4309-856a-f471132010ba tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] [instance: a19e214d-9bda-46c8-92dd-e2457b82508f] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:45.491792 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a55ee1c9-536e-4309-856a-f471132010ba tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:45.495496 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a55ee1c9-536e-4309-856a-f471132010ba tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:45.499082 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a55ee1c9-536e-4309-856a-f471132010ba tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:45.501748 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a55ee1c9-536e-4309-856a-f471132010ba tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:45.502437 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a55ee1c9-536e-4309-856a-f471132010ba tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:45.508152 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a55ee1c9-536e-4309-856a-f471132010ba tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:46.150977 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-a55ee1c9-536e-4309-856a-f471132010ba tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9480713a3884233bd28a7986e9a5baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1e7be678b94918a8c9436a3a25eb67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:46.165096 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-a55ee1c9-536e-4309-856a-f471132010ba tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] 10.222.0.43 "GET /compute/v2.1/servers/a19e214d-9bda-46c8-92dd-e2457b82508f" status: 200 len: 1503 microversion: 2.1 time: 0.723706 Oct 04 18:56:46.166101 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2677/5050] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:45 2022] GET /compute/v2.1/servers/a19e214d-9bda-46c8-92dd-e2457b82508f => generated 1503 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:56:46.175898 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-6890b077-20d9-4e09-967d-dfa702515840 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:46.178097 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-6890b077-20d9-4e09-967d-dfa702515840 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] [instance: a45d1b74-2d81-4e11-b837-fe77dc63f689] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:46.190385 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6890b077-20d9-4e09-967d-dfa702515840 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:46.197806 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6890b077-20d9-4e09-967d-dfa702515840 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:46.198523 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6890b077-20d9-4e09-967d-dfa702515840 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:46.199456 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6890b077-20d9-4e09-967d-dfa702515840 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:46.200094 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6890b077-20d9-4e09-967d-dfa702515840 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:46.200830 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6890b077-20d9-4e09-967d-dfa702515840 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:46.577174 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-6890b077-20d9-4e09-967d-dfa702515840 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] 10.222.0.43 "GET /compute/v2.1/servers/a45d1b74-2d81-4e11-b837-fe77dc63f689/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.409716 Oct 04 18:56:46.585189 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2678/5051] 10.222.0.43 () {58 vars in 1275 bytes} [Tue Oct 4 18:56:46 2022] GET /compute/v2.1/servers/a45d1b74-2d81-4e11-b837-fe77dc63f689/os-interface => generated 285 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:56:47.052589 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-405153ee-a2d9-46d7-b710-81c954ee5d19 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f63f1ac147543dab34a28a22eb5936c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1607b30b9f324abaa88aa29e04ef3ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:47.073187 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-405153ee-a2d9-46d7-b710-81c954ee5d19 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40" status: 200 len: 1518 microversion: 2.1 time: 2.304541 Oct 04 18:56:47.076265 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2374/5052] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:44 2022] GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40 => generated 1518 bytes in 2307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:56:47.193075 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-98e245bf-8101-4714-9e41-d2476b39155f req-8cc89cb0-4748-465d-8247-e133fd91a18f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02a066b4-243b-4fe3-afcf-30f3e9511d1b", "tag": "928f2e8e-6be4-46f2-be79-95a832f7c34d"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:56:47.193528 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-ee32c2a5-1a37-42b7-9624-393604ac32aa tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:47.194161 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-ee32c2a5-1a37-42b7-9624-393604ac32aa tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] [instance: a19e214d-9bda-46c8-92dd-e2457b82508f] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:47.196220 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:56:47.207219 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ee32c2a5-1a37-42b7-9624-393604ac32aa tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:47.207717 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ee32c2a5-1a37-42b7-9624-393604ac32aa tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:47.208293 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ee32c2a5-1a37-42b7-9624-393604ac32aa tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:47.208870 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ee32c2a5-1a37-42b7-9624-393604ac32aa tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:47.209359 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ee32c2a5-1a37-42b7-9624-393604ac32aa tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:47.209790 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ee32c2a5-1a37-42b7-9624-393604ac32aa tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:47.221982 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-98e245bf-8101-4714-9e41-d2476b39155f req-8cc89cb0-4748-465d-8247-e133fd91a18f service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:47.222732 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-98e245bf-8101-4714-9e41-d2476b39155f req-8cc89cb0-4748-465d-8247-e133fd91a18f service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:47.223289 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-98e245bf-8101-4714-9e41-d2476b39155f req-8cc89cb0-4748-465d-8247-e133fd91a18f service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:47.249988 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-98e245bf-8101-4714-9e41-d2476b39155f req-8cc89cb0-4748-465d-8247-e133fd91a18f service nova] Creating event network-changed:928f2e8e-6be4-46f2-be79-95a832f7c34d for instance 02a066b4-243b-4fe3-afcf-30f3e9511d1b on n-h2-851028-13 Oct 04 18:56:47.262387 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-98e245bf-8101-4714-9e41-d2476b39155f req-8cc89cb0-4748-465d-8247-e133fd91a18f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078654 Oct 04 18:56:47.269954 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2679/5053] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:56:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:56:47.915586 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-ee32c2a5-1a37-42b7-9624-393604ac32aa tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9480713a3884233bd28a7986e9a5baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1e7be678b94918a8c9436a3a25eb67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:47.940203 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-ee32c2a5-1a37-42b7-9624-393604ac32aa tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] 10.222.0.43 "GET /compute/v2.1/servers/a19e214d-9bda-46c8-92dd-e2457b82508f" status: 200 len: 1503 microversion: 2.1 time: 0.750985 Oct 04 18:56:47.960364 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2375/5054] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:47 2022] GET /compute/v2.1/servers/a19e214d-9bda-46c8-92dd-e2457b82508f => generated 1503 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:56:48.103292 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-1fcd18de-3a8c-4cbf-84f7-f228d2b6886e tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:48.104120 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-1fcd18de-3a8c-4cbf-84f7-f228d2b6886e tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 01e250ab-d9aa-4708-ae36-10c53a411a40] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:48.120832 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1fcd18de-3a8c-4cbf-84f7-f228d2b6886e tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:48.121617 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1fcd18de-3a8c-4cbf-84f7-f228d2b6886e tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:48.122184 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1fcd18de-3a8c-4cbf-84f7-f228d2b6886e tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:48.123583 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1fcd18de-3a8c-4cbf-84f7-f228d2b6886e tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:48.141847 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1fcd18de-3a8c-4cbf-84f7-f228d2b6886e tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:48.142463 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1fcd18de-3a8c-4cbf-84f7-f228d2b6886e tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:48.355224 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-ec62c050-10e2-4d61-adba-41b9312902d3 req-ae6f3d42-cfe7-4086-8545-468326a93086 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a19e214d-9bda-46c8-92dd-e2457b82508f", "name": "network-vif-deleted", "tag": "070e3f62-9f08-4f5e-8667-35d8698aaf1c"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:56:48.391871 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-ec62c050-10e2-4d61-adba-41b9312902d3 req-ae6f3d42-cfe7-4086-8545-468326a93086 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:48.395067 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-ec62c050-10e2-4d61-adba-41b9312902d3 req-ae6f3d42-cfe7-4086-8545-468326a93086 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:48.395666 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-ec62c050-10e2-4d61-adba-41b9312902d3 req-ae6f3d42-cfe7-4086-8545-468326a93086 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:48.413785 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-ec62c050-10e2-4d61-adba-41b9312902d3 req-ae6f3d42-cfe7-4086-8545-468326a93086 service nova] Creating event network-vif-deleted:070e3f62-9f08-4f5e-8667-35d8698aaf1c for instance a19e214d-9bda-46c8-92dd-e2457b82508f on n-h2-851028-13 Oct 04 18:56:48.419964 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-ec62c050-10e2-4d61-adba-41b9312902d3 req-ae6f3d42-cfe7-4086-8545-468326a93086 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076515 Oct 04 18:56:48.421015 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2376/5055] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:56:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:56:48.970069 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-dbcd9d3d-20bd-4f07-a129-a7a8bd9cc095 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:48.970719 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-dbcd9d3d-20bd-4f07-a129-a7a8bd9cc095 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] [instance: a19e214d-9bda-46c8-92dd-e2457b82508f] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:49.002358 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dbcd9d3d-20bd-4f07-a129-a7a8bd9cc095 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:49.002894 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dbcd9d3d-20bd-4f07-a129-a7a8bd9cc095 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:49.003305 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dbcd9d3d-20bd-4f07-a129-a7a8bd9cc095 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:49.009819 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dbcd9d3d-20bd-4f07-a129-a7a8bd9cc095 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:49.010321 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dbcd9d3d-20bd-4f07-a129-a7a8bd9cc095 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:49.010809 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dbcd9d3d-20bd-4f07-a129-a7a8bd9cc095 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:49.122685 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dbcd9d3d-20bd-4f07-a129-a7a8bd9cc095 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:49.125444 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dbcd9d3d-20bd-4f07-a129-a7a8bd9cc095 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:49.126339 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dbcd9d3d-20bd-4f07-a129-a7a8bd9cc095 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:49.128551 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.objects.instance [None req-dbcd9d3d-20bd-4f07-a129-a7a8bd9cc095 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Lazy-loading 'fault' on Instance uuid a19e214d-9bda-46c8-92dd-e2457b82508f {{(pid=123595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:56:49.300135 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-dbcd9d3d-20bd-4f07-a129-a7a8bd9cc095 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9480713a3884233bd28a7986e9a5baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1e7be678b94918a8c9436a3a25eb67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:49.313043 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-dbcd9d3d-20bd-4f07-a129-a7a8bd9cc095 tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] 10.222.0.43 "GET /compute/v2.1/servers/a19e214d-9bda-46c8-92dd-e2457b82508f" status: 200 len: 1302 microversion: 2.1 time: 0.351649 Oct 04 18:56:49.314134 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2377/5056] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:48 2022] GET /compute/v2.1/servers/a19e214d-9bda-46c8-92dd-e2457b82508f => generated 1302 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:56:49.344957 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-1fcd18de-3a8c-4cbf-84f7-f228d2b6886e tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f63f1ac147543dab34a28a22eb5936c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1607b30b9f324abaa88aa29e04ef3ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:49.359030 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-1fcd18de-3a8c-4cbf-84f7-f228d2b6886e tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40" status: 200 len: 1518 microversion: 2.1 time: 1.260448 Oct 04 18:56:49.360861 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2680/5057] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:48 2022] GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40 => generated 1518 bytes in 1263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:56:50.255154 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-87f9e4bc-fcf0-41de-8524-1b93387f7861 req-47ecaff3-fb46-4c03-b4dc-3482492971d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a45d1b74-2d81-4e11-b837-fe77dc63f689", "tag": "b3e1d52d-3e3e-43c8-9f57-f601d774fbfe"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:56:50.280824 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-87f9e4bc-fcf0-41de-8524-1b93387f7861 req-47ecaff3-fb46-4c03-b4dc-3482492971d7 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:50.286323 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-87f9e4bc-fcf0-41de-8524-1b93387f7861 req-47ecaff3-fb46-4c03-b4dc-3482492971d7 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:50.286865 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-87f9e4bc-fcf0-41de-8524-1b93387f7861 req-47ecaff3-fb46-4c03-b4dc-3482492971d7 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:50.340836 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-0cc5d6bc-c937-423c-a005-071cdc0eef5e tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:50.342841 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-0cc5d6bc-c937-423c-a005-071cdc0eef5e tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] [instance: a19e214d-9bda-46c8-92dd-e2457b82508f] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:50.351431 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-87f9e4bc-fcf0-41de-8524-1b93387f7861 req-47ecaff3-fb46-4c03-b4dc-3482492971d7 service nova] Creating event network-changed:b3e1d52d-3e3e-43c8-9f57-f601d774fbfe for instance a45d1b74-2d81-4e11-b837-fe77dc63f689 on n-h1-851028-13 Oct 04 18:56:50.357395 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0cc5d6bc-c937-423c-a005-071cdc0eef5e tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:50.357930 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0cc5d6bc-c937-423c-a005-071cdc0eef5e tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:50.358325 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0cc5d6bc-c937-423c-a005-071cdc0eef5e tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:50.359786 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0cc5d6bc-c937-423c-a005-071cdc0eef5e tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:50.360256 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0cc5d6bc-c937-423c-a005-071cdc0eef5e tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:50.361159 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0cc5d6bc-c937-423c-a005-071cdc0eef5e tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:50.362745 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-87f9e4bc-fcf0-41de-8524-1b93387f7861 req-47ecaff3-fb46-4c03-b4dc-3482492971d7 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112415 Oct 04 18:56:50.366379 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2378/5058] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:56:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:56:50.384648 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-0cc5d6bc-c937-423c-a005-071cdc0eef5e tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] HTTP exception thrown: Instance a19e214d-9bda-46c8-92dd-e2457b82508f could not be found. Oct 04 18:56:50.390349 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-70e640b9-a691-4588-b783-abd788cc64ba tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:50.391143 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-70e640b9-a691-4588-b783-abd788cc64ba tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 01e250ab-d9aa-4708-ae36-10c53a411a40] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:50.393950 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-0cc5d6bc-c937-423c-a005-071cdc0eef5e tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Request method failure captured: Oct 04 18:56:50.393950 n-d-851028-13 devstack@n-api.service[123596]: request: GET /compute/v2.1/servers/a19e214d-9bda-46c8-92dd-e2457b82508f HTTP/1.1 Oct 04 18:56:50.393950 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:56:50.393950 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:56:50.393950 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:56:50.393950 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 18:56:50.393950 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:56:50.393950 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:56:50.393950 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:56:50.393950 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:56:50.393950 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPIGt-yvZxl0GTwXnRB6p81XDksSOraToXvUWED8fBxd8Npb6p_ctqZTx68NMnIRuYCZW6jWfDXEOStXphbp4I1OB7535N2AjO52YQ1Or9ozd3ufG2r2WPnwBKsG8dqbvWgjEazKp1P4wYbFiNtwOmrkimsMepBHm_n9aspVUsKLEUyQ Oct 04 18:56:50.393950 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:56:50.393950 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:56:50.393950 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:56:50.393950 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:56:50.393950 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:56:50.393950 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:56:50.393950 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: 0c1e7be678b94918a8c9436a3a25eb67 Oct 04 18:56:50.393950 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-VolumesActionsTest-1905739150 Oct 04 18:56:50.393950 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 18:56:50.393950 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 18:56:50.393950 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/0c1e7be678b94918a8c9436a3a25eb67"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_0c1e7be678b94918a8c9436a3a25eb67"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0c1e7be678b94918a8c9436a3a25eb67"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0c1e7be678b94918a8c9436a3a25eb67"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:56:50.393950 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-VolumesActionsTest-1905739150 Oct 04 18:56:50.393950 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: 0c1e7be678b94918a8c9436a3a25eb67 Oct 04 18:56:50.393950 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-VolumesActionsTest-1905739150 Oct 04 18:56:50.393950 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-VolumesActionsTest-1905739150-project Oct 04 18:56:50.393950 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:56:50.393950 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:56:50.393950 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: a9480713a3884233bd28a7986e9a5baf Oct 04 18:56:50.393950 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-VolumesActionsTest-1905739150-project Oct 04 18:56:50.393950 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 18:56:50.393950 n-d-851028-13 devstack@n-api.service[123596]: exception: Instance a19e214d-9bda-46c8-92dd-e2457b82508f could not be found. Oct 04 18:56:50.393950 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': 'a19e214d-9bda-46c8-92dd-e2457b82508f'} Oct 04 18:56:50.393950 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:56:50.393950 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:56:50.393950 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:56:50.393950 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:56:50.393950 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:56:50.393950 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:56:50.393950 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:56:50.393950 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:56:50.393950 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:56:50.393950 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:56:50.393950 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a19e214d-9bda-46c8-92dd-e2457b82508f could not be found. Oct 04 18:56:50.393950 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:56:50.393950 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:56:50.393950 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:56:50.393950 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:56:50.393950 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:56:50.393950 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:56:50.393950 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:56:50.393950 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:56:50.393950 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:56:50.393950 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:56:50.393950 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:56:50.393950 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:56:50.393950 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:56:50.393950 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:56:50.393950 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:56:50.393950 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:56:50.393950 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a19e214d-9bda-46c8-92dd-e2457b82508f could not be found. Oct 04 18:56:50.393950 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:56:50.393950 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:56:50.393950 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:56:50.398917 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:56:50.398917 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:56:50.398917 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:56:50.398917 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:56:50.398917 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:56:50.398917 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a19e214d-9bda-46c8-92dd-e2457b82508f could not be found. Oct 04 18:56:50.398917 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:56:50.399471 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-70e640b9-a691-4588-b783-abd788cc64ba tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:50.399471 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-70e640b9-a691-4588-b783-abd788cc64ba tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:50.399915 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-70e640b9-a691-4588-b783-abd788cc64ba tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:50.401983 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-0cc5d6bc-c937-423c-a005-071cdc0eef5e tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] Returning 404 to user: Instance a19e214d-9bda-46c8-92dd-e2457b82508f could not be found. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:56:50.402880 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-0cc5d6bc-c937-423c-a005-071cdc0eef5e tempest-VolumesActionsTest-1905739150 tempest-VolumesActionsTest-1905739150-project] 10.222.0.43 "GET /compute/v2.1/servers/a19e214d-9bda-46c8-92dd-e2457b82508f" status: 404 len: 111 microversion: 2.1 time: 0.066899 Oct 04 18:56:50.406086 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-70e640b9-a691-4588-b783-abd788cc64ba tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:50.406251 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2681/5059] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:50 2022] GET /compute/v2.1/servers/a19e214d-9bda-46c8-92dd-e2457b82508f => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:56:50.407141 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-70e640b9-a691-4588-b783-abd788cc64ba tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:50.407413 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-70e640b9-a691-4588-b783-abd788cc64ba tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:51.067971 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-08d14739-bdf1-4fd7-a18f-9f0015230501 req-acd5e4bb-7355-4af1-b00d-81965410828e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01e250ab-d9aa-4708-ae36-10c53a411a40", "tag": "70d1b09a-03d8-41b4-9a82-fc7d75a3624a"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:56:51.092977 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-08d14739-bdf1-4fd7-a18f-9f0015230501 req-acd5e4bb-7355-4af1-b00d-81965410828e service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:51.093834 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-08d14739-bdf1-4fd7-a18f-9f0015230501 req-acd5e4bb-7355-4af1-b00d-81965410828e service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:51.094451 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-08d14739-bdf1-4fd7-a18f-9f0015230501 req-acd5e4bb-7355-4af1-b00d-81965410828e service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:51.139117 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-08d14739-bdf1-4fd7-a18f-9f0015230501 req-acd5e4bb-7355-4af1-b00d-81965410828e service nova] Creating event network-changed:70d1b09a-03d8-41b4-9a82-fc7d75a3624a for instance 01e250ab-d9aa-4708-ae36-10c53a411a40 on n-h1-851028-13 Oct 04 18:56:51.160913 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-08d14739-bdf1-4fd7-a18f-9f0015230501 req-acd5e4bb-7355-4af1-b00d-81965410828e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126367 Oct 04 18:56:51.167094 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2682/5060] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:56:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:56:51.754975 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-70e640b9-a691-4588-b783-abd788cc64ba tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f63f1ac147543dab34a28a22eb5936c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1607b30b9f324abaa88aa29e04ef3ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:51.779507 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-70e640b9-a691-4588-b783-abd788cc64ba tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40" status: 200 len: 1518 microversion: 2.1 time: 1.390485 Oct 04 18:56:51.781071 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2379/5061] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:50 2022] GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40 => generated 1518 bytes in 1396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:56:52.808650 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-3eb3709a-8950-425e-a40c-d22e94e2a868 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:52.810158 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-3eb3709a-8950-425e-a40c-d22e94e2a868 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 01e250ab-d9aa-4708-ae36-10c53a411a40] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:52.843800 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3eb3709a-8950-425e-a40c-d22e94e2a868 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:52.844314 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3eb3709a-8950-425e-a40c-d22e94e2a868 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:52.844769 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3eb3709a-8950-425e-a40c-d22e94e2a868 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:52.845525 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3eb3709a-8950-425e-a40c-d22e94e2a868 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:52.845993 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3eb3709a-8950-425e-a40c-d22e94e2a868 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:52.846428 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3eb3709a-8950-425e-a40c-d22e94e2a868 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:53.265703 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-3eb3709a-8950-425e-a40c-d22e94e2a868 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f63f1ac147543dab34a28a22eb5936c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1607b30b9f324abaa88aa29e04ef3ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:53.275841 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-3eb3709a-8950-425e-a40c-d22e94e2a868 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40" status: 200 len: 1518 microversion: 2.1 time: 0.472711 Oct 04 18:56:53.289751 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2683/5062] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:52 2022] GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40 => generated 1518 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:56:54.300146 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-64aa891f-cb13-4aa3-85f7-1eb3775dfbe3 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:54.303310 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-64aa891f-cb13-4aa3-85f7-1eb3775dfbe3 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 01e250ab-d9aa-4708-ae36-10c53a411a40] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:54.319408 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-64aa891f-cb13-4aa3-85f7-1eb3775dfbe3 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:54.320653 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-64aa891f-cb13-4aa3-85f7-1eb3775dfbe3 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:54.321343 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-64aa891f-cb13-4aa3-85f7-1eb3775dfbe3 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:54.322230 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-64aa891f-cb13-4aa3-85f7-1eb3775dfbe3 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:54.322860 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-64aa891f-cb13-4aa3-85f7-1eb3775dfbe3 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:54.323502 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-64aa891f-cb13-4aa3-85f7-1eb3775dfbe3 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:55.306679 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-64aa891f-cb13-4aa3-85f7-1eb3775dfbe3 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f63f1ac147543dab34a28a22eb5936c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1607b30b9f324abaa88aa29e04ef3ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:55.333156 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-64aa891f-cb13-4aa3-85f7-1eb3775dfbe3 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40" status: 200 len: 1518 microversion: 2.1 time: 1.036763 Oct 04 18:56:55.349219 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2380/5063] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:54 2022] GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40 => generated 1518 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:56:56.362367 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-75c8c998-bb78-40a1-b60d-e44c4b6e6880 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:56.363396 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-75c8c998-bb78-40a1-b60d-e44c4b6e6880 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 01e250ab-d9aa-4708-ae36-10c53a411a40] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:56.395064 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-75c8c998-bb78-40a1-b60d-e44c4b6e6880 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:56.396190 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-75c8c998-bb78-40a1-b60d-e44c4b6e6880 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:56.398618 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-75c8c998-bb78-40a1-b60d-e44c4b6e6880 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:56.406315 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-75c8c998-bb78-40a1-b60d-e44c4b6e6880 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:56.407630 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-75c8c998-bb78-40a1-b60d-e44c4b6e6880 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:56.409625 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-75c8c998-bb78-40a1-b60d-e44c4b6e6880 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:56.986922 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-75c8c998-bb78-40a1-b60d-e44c4b6e6880 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f63f1ac147543dab34a28a22eb5936c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1607b30b9f324abaa88aa29e04ef3ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:56.997964 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-75c8c998-bb78-40a1-b60d-e44c4b6e6880 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40" status: 200 len: 1518 microversion: 2.1 time: 0.640778 Oct 04 18:56:57.007810 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2684/5064] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:56 2022] GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40 => generated 1518 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:56:58.024832 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-186ef173-07ec-415f-b184-d90496518cd9 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:58.026320 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-186ef173-07ec-415f-b184-d90496518cd9 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 01e250ab-d9aa-4708-ae36-10c53a411a40] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:58.037481 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-186ef173-07ec-415f-b184-d90496518cd9 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:58.042371 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-186ef173-07ec-415f-b184-d90496518cd9 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:58.043142 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-186ef173-07ec-415f-b184-d90496518cd9 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:58.044831 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-186ef173-07ec-415f-b184-d90496518cd9 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:58.045318 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-186ef173-07ec-415f-b184-d90496518cd9 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:58.053855 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-186ef173-07ec-415f-b184-d90496518cd9 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:59.768641 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-186ef173-07ec-415f-b184-d90496518cd9 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f63f1ac147543dab34a28a22eb5936c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1607b30b9f324abaa88aa29e04ef3ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:59.792376 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-186ef173-07ec-415f-b184-d90496518cd9 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40" status: 200 len: 1518 microversion: 2.1 time: 1.771953 Oct 04 18:56:59.795845 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2381/5065] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:58 2022] GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40 => generated 1518 bytes in 1776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:57:00.822267 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-6a9e4754-f05b-4ad6-9d99-773441576515 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:57:00.823051 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-6a9e4754-f05b-4ad6-9d99-773441576515 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 01e250ab-d9aa-4708-ae36-10c53a411a40] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:57:00.845591 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_api:SELECT=56 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:57:00.855136 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6a9e4754-f05b-4ad6-9d99-773441576515 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:00.855998 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6a9e4754-f05b-4ad6-9d99-773441576515 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:00.856724 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6a9e4754-f05b-4ad6-9d99-773441576515 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:00.857899 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6a9e4754-f05b-4ad6-9d99-773441576515 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:00.858599 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6a9e4754-f05b-4ad6-9d99-773441576515 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:00.859258 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6a9e4754-f05b-4ad6-9d99-773441576515 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:01.331939 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-6a9e4754-f05b-4ad6-9d99-773441576515 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f63f1ac147543dab34a28a22eb5936c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1607b30b9f324abaa88aa29e04ef3ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:57:01.344442 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-6a9e4754-f05b-4ad6-9d99-773441576515 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40" status: 200 len: 1518 microversion: 2.1 time: 0.526124 Oct 04 18:57:01.347215 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2685/5066] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:57:00 2022] GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40 => generated 1518 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:57:02.376075 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-7e86f3e3-a9ff-4063-b13c-89d0f4c2ea0f tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:57:02.377490 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-7e86f3e3-a9ff-4063-b13c-89d0f4c2ea0f tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 01e250ab-d9aa-4708-ae36-10c53a411a40] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:57:02.406541 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7e86f3e3-a9ff-4063-b13c-89d0f4c2ea0f tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:02.407684 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7e86f3e3-a9ff-4063-b13c-89d0f4c2ea0f tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:02.408390 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7e86f3e3-a9ff-4063-b13c-89d0f4c2ea0f tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:02.409441 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7e86f3e3-a9ff-4063-b13c-89d0f4c2ea0f tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:02.412617 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7e86f3e3-a9ff-4063-b13c-89d0f4c2ea0f tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:02.413579 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7e86f3e3-a9ff-4063-b13c-89d0f4c2ea0f tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:04.039502 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-7e86f3e3-a9ff-4063-b13c-89d0f4c2ea0f tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f63f1ac147543dab34a28a22eb5936c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1607b30b9f324abaa88aa29e04ef3ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:57:04.077847 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-7e86f3e3-a9ff-4063-b13c-89d0f4c2ea0f tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40" status: 200 len: 1518 microversion: 2.1 time: 1.705069 Oct 04 18:57:04.082427 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2382/5067] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:57:02 2022] GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40 => generated 1518 bytes in 1711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:57:05.106883 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-14964e11-ba33-4cb9-bb25-f48e2ec340d8 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:57:05.107751 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-14964e11-ba33-4cb9-bb25-f48e2ec340d8 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 01e250ab-d9aa-4708-ae36-10c53a411a40] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:57:05.122676 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-14964e11-ba33-4cb9-bb25-f48e2ec340d8 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:05.124537 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-14964e11-ba33-4cb9-bb25-f48e2ec340d8 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:05.128769 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-14964e11-ba33-4cb9-bb25-f48e2ec340d8 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:05.131879 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-14964e11-ba33-4cb9-bb25-f48e2ec340d8 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:05.133510 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-14964e11-ba33-4cb9-bb25-f48e2ec340d8 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:05.134686 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-14964e11-ba33-4cb9-bb25-f48e2ec340d8 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:05.687974 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-14964e11-ba33-4cb9-bb25-f48e2ec340d8 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f63f1ac147543dab34a28a22eb5936c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1607b30b9f324abaa88aa29e04ef3ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:57:05.708949 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-14964e11-ba33-4cb9-bb25-f48e2ec340d8 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40" status: 200 len: 1518 microversion: 2.1 time: 0.604780 Oct 04 18:57:05.711693 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2686/5068] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:57:05 2022] GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40 => generated 1518 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:57:06.740127 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-bef59e75-392c-41c2-9473-90c647c5767b tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:57:06.741252 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-bef59e75-392c-41c2-9473-90c647c5767b tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 01e250ab-d9aa-4708-ae36-10c53a411a40] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:57:06.769829 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bef59e75-392c-41c2-9473-90c647c5767b tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:06.772136 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bef59e75-392c-41c2-9473-90c647c5767b tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:06.775176 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bef59e75-392c-41c2-9473-90c647c5767b tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:06.780399 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bef59e75-392c-41c2-9473-90c647c5767b tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:06.781800 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bef59e75-392c-41c2-9473-90c647c5767b tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:06.794258 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bef59e75-392c-41c2-9473-90c647c5767b tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:07.453230 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-bef59e75-392c-41c2-9473-90c647c5767b tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f63f1ac147543dab34a28a22eb5936c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1607b30b9f324abaa88aa29e04ef3ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:57:07.468885 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-bef59e75-392c-41c2-9473-90c647c5767b tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40" status: 200 len: 1518 microversion: 2.1 time: 0.734623 Oct 04 18:57:07.472998 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2383/5069] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:57:06 2022] GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40 => generated 1518 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:57:08.501542 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-5a445ec0-e24d-4a8d-9fd3-f344ff74cd4d tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:57:08.503656 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-5a445ec0-e24d-4a8d-9fd3-f344ff74cd4d tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 01e250ab-d9aa-4708-ae36-10c53a411a40] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:57:08.529255 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5a445ec0-e24d-4a8d-9fd3-f344ff74cd4d tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:08.536128 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5a445ec0-e24d-4a8d-9fd3-f344ff74cd4d tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:08.537487 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5a445ec0-e24d-4a8d-9fd3-f344ff74cd4d tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:08.541876 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5a445ec0-e24d-4a8d-9fd3-f344ff74cd4d tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:08.545717 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5a445ec0-e24d-4a8d-9fd3-f344ff74cd4d tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:08.546635 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5a445ec0-e24d-4a8d-9fd3-f344ff74cd4d tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:09.620845 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-5a445ec0-e24d-4a8d-9fd3-f344ff74cd4d tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f63f1ac147543dab34a28a22eb5936c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1607b30b9f324abaa88aa29e04ef3ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:57:09.656864 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-5a445ec0-e24d-4a8d-9fd3-f344ff74cd4d tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40" status: 200 len: 1518 microversion: 2.1 time: 1.164909 Oct 04 18:57:09.665543 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2687/5070] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:57:08 2022] GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40 => generated 1518 bytes in 1175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:57:10.689633 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-98aaba83-014c-4730-9a45-3dc363166846 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:57:10.690466 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-98aaba83-014c-4730-9a45-3dc363166846 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 01e250ab-d9aa-4708-ae36-10c53a411a40] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:57:10.707487 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-98aaba83-014c-4730-9a45-3dc363166846 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:10.709572 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-98aaba83-014c-4730-9a45-3dc363166846 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:10.713128 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-98aaba83-014c-4730-9a45-3dc363166846 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:10.714186 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-98aaba83-014c-4730-9a45-3dc363166846 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:10.716788 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-98aaba83-014c-4730-9a45-3dc363166846 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:10.720835 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-98aaba83-014c-4730-9a45-3dc363166846 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:11.173823 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-98aaba83-014c-4730-9a45-3dc363166846 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f63f1ac147543dab34a28a22eb5936c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1607b30b9f324abaa88aa29e04ef3ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:57:11.187684 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-98aaba83-014c-4730-9a45-3dc363166846 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40" status: 200 len: 1518 microversion: 2.1 time: 0.501914 Oct 04 18:57:11.191385 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2384/5071] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:57:10 2022] GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40 => generated 1518 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:57:12.224879 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-dcac2db2-fdb8-48d6-a2e0-eb32a3ac20df tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:57:12.227636 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-dcac2db2-fdb8-48d6-a2e0-eb32a3ac20df tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 01e250ab-d9aa-4708-ae36-10c53a411a40] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:57:12.260175 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dcac2db2-fdb8-48d6-a2e0-eb32a3ac20df tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:12.268536 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dcac2db2-fdb8-48d6-a2e0-eb32a3ac20df tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:12.271528 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dcac2db2-fdb8-48d6-a2e0-eb32a3ac20df tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:12.273981 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dcac2db2-fdb8-48d6-a2e0-eb32a3ac20df tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:12.274605 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dcac2db2-fdb8-48d6-a2e0-eb32a3ac20df tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:12.278628 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dcac2db2-fdb8-48d6-a2e0-eb32a3ac20df tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:12.299029 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=72 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:57:12.375119 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-26e50ae6-feed-40a3-9af7-a66bcd6158cf tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-1183509047", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452", "networks": [{"uuid": "6d15d1ea-c254-46dd-a02f-21ffbf116d2e"}, {"uuid": "a64b09bd-ccb9-479f-83cc-acab547510b4"}, {"uuid": "6d15d1ea-c254-46dd-a02f-21ffbf116d2e"}]}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:57:12.745778 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-dcac2db2-fdb8-48d6-a2e0-eb32a3ac20df tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f63f1ac147543dab34a28a22eb5936c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1607b30b9f324abaa88aa29e04ef3ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:57:12.761847 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-dcac2db2-fdb8-48d6-a2e0-eb32a3ac20df tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40" status: 200 len: 1518 microversion: 2.1 time: 0.543826 Oct 04 18:57:12.783075 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2688/5072] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:57:12 2022] GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40 => generated 1518 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:57:13.840189 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-44cc4374-52f8-42e9-a554-0f43d2be24d5 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:57:13.842898 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-44cc4374-52f8-42e9-a554-0f43d2be24d5 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 01e250ab-d9aa-4708-ae36-10c53a411a40] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:57:13.869681 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-44cc4374-52f8-42e9-a554-0f43d2be24d5 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:13.872878 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-44cc4374-52f8-42e9-a554-0f43d2be24d5 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:13.877533 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-44cc4374-52f8-42e9-a554-0f43d2be24d5 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:13.878624 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-44cc4374-52f8-42e9-a554-0f43d2be24d5 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:13.879271 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-44cc4374-52f8-42e9-a554-0f43d2be24d5 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:13.879886 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-44cc4374-52f8-42e9-a554-0f43d2be24d5 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:14.455531 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-44cc4374-52f8-42e9-a554-0f43d2be24d5 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f63f1ac147543dab34a28a22eb5936c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1607b30b9f324abaa88aa29e04ef3ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:57:14.515538 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-44cc4374-52f8-42e9-a554-0f43d2be24d5 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40" status: 200 len: 1518 microversion: 2.1 time: 0.723594 Oct 04 18:57:14.527782 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2689/5073] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:57:13 2022] GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40 => generated 1518 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:57:15.544890 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-17c3b6cb-36c3-49c9-8402-f4e05fe88279 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:57:15.545989 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-17c3b6cb-36c3-49c9-8402-f4e05fe88279 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 01e250ab-d9aa-4708-ae36-10c53a411a40] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:57:15.591935 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-17c3b6cb-36c3-49c9-8402-f4e05fe88279 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:15.592438 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-17c3b6cb-36c3-49c9-8402-f4e05fe88279 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:15.592879 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-17c3b6cb-36c3-49c9-8402-f4e05fe88279 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:15.617860 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-17c3b6cb-36c3-49c9-8402-f4e05fe88279 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:15.637841 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-17c3b6cb-36c3-49c9-8402-f4e05fe88279 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:15.638479 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-17c3b6cb-36c3-49c9-8402-f4e05fe88279 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:16.356896 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-17c3b6cb-36c3-49c9-8402-f4e05fe88279 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f63f1ac147543dab34a28a22eb5936c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1607b30b9f324abaa88aa29e04ef3ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:57:16.370111 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-17c3b6cb-36c3-49c9-8402-f4e05fe88279 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40" status: 200 len: 1518 microversion: 2.1 time: 0.825190 Oct 04 18:57:16.374742 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2690/5074] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:57:15 2022] GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40 => generated 1518 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:57:17.396002 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-0af5c4c3-da66-4da4-b7ac-5c182ba8fb2f tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:57:17.396679 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-0af5c4c3-da66-4da4-b7ac-5c182ba8fb2f tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 01e250ab-d9aa-4708-ae36-10c53a411a40] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:57:17.408286 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0af5c4c3-da66-4da4-b7ac-5c182ba8fb2f tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:17.408783 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0af5c4c3-da66-4da4-b7ac-5c182ba8fb2f tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:17.409255 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0af5c4c3-da66-4da4-b7ac-5c182ba8fb2f tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:17.409975 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0af5c4c3-da66-4da4-b7ac-5c182ba8fb2f tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:17.410434 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0af5c4c3-da66-4da4-b7ac-5c182ba8fb2f tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:17.410864 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0af5c4c3-da66-4da4-b7ac-5c182ba8fb2f tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:18.161369 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-0af5c4c3-da66-4da4-b7ac-5c182ba8fb2f tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f63f1ac147543dab34a28a22eb5936c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1607b30b9f324abaa88aa29e04ef3ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:57:18.169896 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-0af5c4c3-da66-4da4-b7ac-5c182ba8fb2f tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40" status: 200 len: 1518 microversion: 2.1 time: 0.777839 Oct 04 18:57:18.176285 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2691/5075] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:57:17 2022] GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40 => generated 1518 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:57:19.199690 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-a2924e88-fc38-44dd-aef3-c076829e9e33 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:57:19.201858 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-a2924e88-fc38-44dd-aef3-c076829e9e33 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 01e250ab-d9aa-4708-ae36-10c53a411a40] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:57:19.216202 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a2924e88-fc38-44dd-aef3-c076829e9e33 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:19.226947 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a2924e88-fc38-44dd-aef3-c076829e9e33 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:19.243339 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a2924e88-fc38-44dd-aef3-c076829e9e33 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:19.247945 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a2924e88-fc38-44dd-aef3-c076829e9e33 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:19.252921 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a2924e88-fc38-44dd-aef3-c076829e9e33 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:19.255966 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a2924e88-fc38-44dd-aef3-c076829e9e33 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:21.005300 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-a2924e88-fc38-44dd-aef3-c076829e9e33 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f63f1ac147543dab34a28a22eb5936c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1607b30b9f324abaa88aa29e04ef3ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:57:21.016643 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-a2924e88-fc38-44dd-aef3-c076829e9e33 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40" status: 200 len: 1518 microversion: 2.1 time: 1.821751 Oct 04 18:57:21.024803 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2692/5076] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:57:19 2022] GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40 => generated 1518 bytes in 1831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:57:21.179063 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:57:22.051887 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-0b7fe4ab-863c-4b67-bd05-4cc7d89e9801 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:57:22.053070 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-0b7fe4ab-863c-4b67-bd05-4cc7d89e9801 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 01e250ab-d9aa-4708-ae36-10c53a411a40] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:57:22.074653 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0b7fe4ab-863c-4b67-bd05-4cc7d89e9801 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:22.080041 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0b7fe4ab-863c-4b67-bd05-4cc7d89e9801 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:22.084345 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0b7fe4ab-863c-4b67-bd05-4cc7d89e9801 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:22.088101 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0b7fe4ab-863c-4b67-bd05-4cc7d89e9801 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:22.093399 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0b7fe4ab-863c-4b67-bd05-4cc7d89e9801 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:22.094112 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0b7fe4ab-863c-4b67-bd05-4cc7d89e9801 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:22.426180 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_api:SELECT=23 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:57:23.172514 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-0b7fe4ab-863c-4b67-bd05-4cc7d89e9801 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f63f1ac147543dab34a28a22eb5936c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1607b30b9f324abaa88aa29e04ef3ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:57:23.186950 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-0b7fe4ab-863c-4b67-bd05-4cc7d89e9801 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40" status: 200 len: 1518 microversion: 2.1 time: 1.139838 Oct 04 18:57:23.187583 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2693/5077] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:57:22 2022] GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40 => generated 1518 bytes in 1141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:57:23.237162 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-0fa836e8-ede3-4e15-b0b3-f5336348c860 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:57:23.239627 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-0fa836e8-ede3-4e15-b0b3-f5336348c860 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] [instance: a45d1b74-2d81-4e11-b837-fe77dc63f689] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:57:23.269810 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0fa836e8-ede3-4e15-b0b3-f5336348c860 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:23.274946 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0fa836e8-ede3-4e15-b0b3-f5336348c860 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:23.275751 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0fa836e8-ede3-4e15-b0b3-f5336348c860 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:23.276792 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0fa836e8-ede3-4e15-b0b3-f5336348c860 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:23.277572 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0fa836e8-ede3-4e15-b0b3-f5336348c860 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:23.280465 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0fa836e8-ede3-4e15-b0b3-f5336348c860 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:23.398617 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-0fa836e8-ede3-4e15-b0b3-f5336348c860 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] 10.222.0.43 "GET /compute/v2.1/servers/a45d1b74-2d81-4e11-b837-fe77dc63f689/ips" status: 200 len: 150 microversion: 2.1 time: 0.195634 Oct 04 18:57:23.401450 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2694/5078] 10.222.0.43 () {58 vars in 1248 bytes} [Tue Oct 4 18:57:23 2022] GET /compute/v2.1/servers/a45d1b74-2d81-4e11-b837-fe77dc63f689/ips => generated 150 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:57:24.215020 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-4058d52f-5d0d-4460-a416-2ec6b0ecf600 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:57:24.215769 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-4058d52f-5d0d-4460-a416-2ec6b0ecf600 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 01e250ab-d9aa-4708-ae36-10c53a411a40] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:57:24.231070 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4058d52f-5d0d-4460-a416-2ec6b0ecf600 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:24.238724 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4058d52f-5d0d-4460-a416-2ec6b0ecf600 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:24.239962 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4058d52f-5d0d-4460-a416-2ec6b0ecf600 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:24.241249 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4058d52f-5d0d-4460-a416-2ec6b0ecf600 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:24.242284 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4058d52f-5d0d-4460-a416-2ec6b0ecf600 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:24.243157 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4058d52f-5d0d-4460-a416-2ec6b0ecf600 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:24.755218 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-4058d52f-5d0d-4460-a416-2ec6b0ecf600 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f63f1ac147543dab34a28a22eb5936c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1607b30b9f324abaa88aa29e04ef3ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:57:24.763847 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-4058d52f-5d0d-4460-a416-2ec6b0ecf600 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40" status: 200 len: 1518 microversion: 2.1 time: 0.554839 Oct 04 18:57:24.778170 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2695/5079] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:57:24 2022] GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40 => generated 1518 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:57:25.794900 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-6fcfa0d1-6719-4166-9d7f-b11c3bbebdfb tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:57:25.796262 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-6fcfa0d1-6719-4166-9d7f-b11c3bbebdfb tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 01e250ab-d9aa-4708-ae36-10c53a411a40] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:57:25.812181 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6fcfa0d1-6719-4166-9d7f-b11c3bbebdfb tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:25.816566 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6fcfa0d1-6719-4166-9d7f-b11c3bbebdfb tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:25.818388 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6fcfa0d1-6719-4166-9d7f-b11c3bbebdfb tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:25.821658 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6fcfa0d1-6719-4166-9d7f-b11c3bbebdfb tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:25.823274 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6fcfa0d1-6719-4166-9d7f-b11c3bbebdfb tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:25.827128 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6fcfa0d1-6719-4166-9d7f-b11c3bbebdfb tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:26.721216 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-6fcfa0d1-6719-4166-9d7f-b11c3bbebdfb tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f63f1ac147543dab34a28a22eb5936c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1607b30b9f324abaa88aa29e04ef3ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:57:26.741566 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-6fcfa0d1-6719-4166-9d7f-b11c3bbebdfb tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40" status: 200 len: 1518 microversion: 2.1 time: 0.946709 Oct 04 18:57:26.744121 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2696/5080] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:57:25 2022] GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40 => generated 1518 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:57:27.769812 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-dd021eba-2d21-4a5b-bfca-6b6b9db91565 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:57:27.772250 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-dd021eba-2d21-4a5b-bfca-6b6b9db91565 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 01e250ab-d9aa-4708-ae36-10c53a411a40] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:57:27.787530 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dd021eba-2d21-4a5b-bfca-6b6b9db91565 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:27.791099 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dd021eba-2d21-4a5b-bfca-6b6b9db91565 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:27.794773 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dd021eba-2d21-4a5b-bfca-6b6b9db91565 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:27.795689 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dd021eba-2d21-4a5b-bfca-6b6b9db91565 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:27.817909 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dd021eba-2d21-4a5b-bfca-6b6b9db91565 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:27.818649 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dd021eba-2d21-4a5b-bfca-6b6b9db91565 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:28.526786 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-dd021eba-2d21-4a5b-bfca-6b6b9db91565 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f63f1ac147543dab34a28a22eb5936c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1607b30b9f324abaa88aa29e04ef3ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:57:28.548441 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-dd021eba-2d21-4a5b-bfca-6b6b9db91565 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40" status: 200 len: 1518 microversion: 2.1 time: 0.781453 Oct 04 18:57:28.570444 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2697/5081] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:57:27 2022] GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40 => generated 1518 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:57:28.583557 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-728a6878-1720-43b7-8689-d69e04bd38da tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f51eedbf-cd57-46f3-8ee9-010b63718608"}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:57:28.588327 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-728a6878-1720-43b7-8689-d69e04bd38da tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] [instance: a45d1b74-2d81-4e11-b837-fe77dc63f689] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:57:28.611804 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-728a6878-1720-43b7-8689-d69e04bd38da tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:28.613735 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-728a6878-1720-43b7-8689-d69e04bd38da tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:28.614415 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-728a6878-1720-43b7-8689-d69e04bd38da tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:28.617438 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-728a6878-1720-43b7-8689-d69e04bd38da tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:28.623129 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-728a6878-1720-43b7-8689-d69e04bd38da tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:28.623997 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-728a6878-1720-43b7-8689-d69e04bd38da tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:29.040067 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.network.neutron [None req-26e50ae6-feed-40a3-9af7-a66bcd6158cf tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] validate_networks() for [('6d15d1ea-c254-46dd-a02f-21ffbf116d2e', None, None, None, None, None), ('a64b09bd-ccb9-479f-83cc-acab547510b4', None, None, None, None, None), ('6d15d1ea-c254-46dd-a02f-21ffbf116d2e', None, None, None, None, None)] {{(pid=123595) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:57:29.227288 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-728a6878-1720-43b7-8689-d69e04bd38da tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] 10.222.0.43 "POST /compute/v2.1/servers/a45d1b74-2d81-4e11-b837-fe77dc63f689/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.654842 Oct 04 18:57:29.228636 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2698/5082] 10.222.0.43 () {60 vars in 1323 bytes} [Tue Oct 4 18:57:28 2022] POST /compute/v2.1/servers/a45d1b74-2d81-4e11-b837-fe77dc63f689/os-volume_attachments => generated 194 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:57:29.577256 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-adbccc08-29ba-40fa-9c57-6bc1db9c57ec tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:57:29.578212 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-adbccc08-29ba-40fa-9c57-6bc1db9c57ec tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 01e250ab-d9aa-4708-ae36-10c53a411a40] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:57:29.597820 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-adbccc08-29ba-40fa-9c57-6bc1db9c57ec tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:29.598625 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-adbccc08-29ba-40fa-9c57-6bc1db9c57ec tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:29.599368 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-adbccc08-29ba-40fa-9c57-6bc1db9c57ec tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:29.600299 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-adbccc08-29ba-40fa-9c57-6bc1db9c57ec tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:29.600946 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-adbccc08-29ba-40fa-9c57-6bc1db9c57ec tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:29.601578 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-adbccc08-29ba-40fa-9c57-6bc1db9c57ec tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:30.084416 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-adbccc08-29ba-40fa-9c57-6bc1db9c57ec tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f63f1ac147543dab34a28a22eb5936c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1607b30b9f324abaa88aa29e04ef3ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:57:30.108663 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-adbccc08-29ba-40fa-9c57-6bc1db9c57ec tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40" status: 200 len: 1518 microversion: 2.1 time: 0.532676 Oct 04 18:57:30.116053 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2699/5083] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:57:29 2022] GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40 => generated 1518 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:57:30.148457 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-38e19084-75d2-4197-8cde-fce2ea099b19 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:57:30.165332 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-38e19084-75d2-4197-8cde-fce2ea099b19 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] [instance: 02a066b4-243b-4fe3-afcf-30f3e9511d1b] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:57:30.198341 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-38e19084-75d2-4197-8cde-fce2ea099b19 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:30.215935 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-38e19084-75d2-4197-8cde-fce2ea099b19 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:30.219790 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-38e19084-75d2-4197-8cde-fce2ea099b19 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:30.222972 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-38e19084-75d2-4197-8cde-fce2ea099b19 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:30.228130 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-38e19084-75d2-4197-8cde-fce2ea099b19 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:30.228803 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-38e19084-75d2-4197-8cde-fce2ea099b19 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:30.837377 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-38e19084-75d2-4197-8cde-fce2ea099b19 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:57:30.851346 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-38e19084-75d2-4197-8cde-fce2ea099b19 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:57:30.853503 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-38e19084-75d2-4197-8cde-fce2ea099b19 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:57:30.855083 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-38e19084-75d2-4197-8cde-fce2ea099b19 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] 10.222.0.43 "GET /compute/v2.1/servers/02a066b4-243b-4fe3-afcf-30f3e9511d1b" status: 200 len: 2951 microversion: 2.42 time: 0.737797 Oct 04 18:57:30.887071 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2700/5084] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:57:30 2022] GET /compute/v2.1/servers/02a066b4-243b-4fe3-afcf-30f3e9511d1b => generated 2951 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:57:30.897249 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-eed0b0fa-509c-48ae-a351-967089284829 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:57:30.900643 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-eed0b0fa-509c-48ae-a351-967089284829 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] [instance: 02a066b4-243b-4fe3-afcf-30f3e9511d1b] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:57:30.940338 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-eed0b0fa-509c-48ae-a351-967089284829 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:30.942404 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-eed0b0fa-509c-48ae-a351-967089284829 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:30.945756 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-eed0b0fa-509c-48ae-a351-967089284829 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:30.946804 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-eed0b0fa-509c-48ae-a351-967089284829 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:30.950491 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-eed0b0fa-509c-48ae-a351-967089284829 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:30.951277 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-eed0b0fa-509c-48ae-a351-967089284829 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:31.486905 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-eed0b0fa-509c-48ae-a351-967089284829 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] 10.222.0.43 "GET /compute/v2.1/servers/02a066b4-243b-4fe3-afcf-30f3e9511d1b/os-interface" status: 200 len: 1831 microversion: 2.42 time: 0.597726 Oct 04 18:57:31.487709 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2701/5085] 10.222.0.43 () {60 vars in 1316 bytes} [Tue Oct 4 18:57:30 2022] GET /compute/v2.1/servers/02a066b4-243b-4fe3-afcf-30f3e9511d1b/os-interface => generated 1831 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:57:31.504397 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-671917fc-b1f5-4d97-bf80-b596dca16a5f tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:57:31.505426 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-671917fc-b1f5-4d97-bf80-b596dca16a5f tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 01e250ab-d9aa-4708-ae36-10c53a411a40] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:57:31.512241 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_api:SELECT=34 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:57:31.514131 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-671917fc-b1f5-4d97-bf80-b596dca16a5f tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:31.515102 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-671917fc-b1f5-4d97-bf80-b596dca16a5f tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:31.522546 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-671917fc-b1f5-4d97-bf80-b596dca16a5f tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:31.529337 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-671917fc-b1f5-4d97-bf80-b596dca16a5f tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:31.533693 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-671917fc-b1f5-4d97-bf80-b596dca16a5f tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:31.534661 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-671917fc-b1f5-4d97-bf80-b596dca16a5f tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:32.140740 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-671917fc-b1f5-4d97-bf80-b596dca16a5f tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f63f1ac147543dab34a28a22eb5936c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1607b30b9f324abaa88aa29e04ef3ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:57:32.166919 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-671917fc-b1f5-4d97-bf80-b596dca16a5f tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40" status: 200 len: 1518 microversion: 2.1 time: 0.667692 Oct 04 18:57:32.167419 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2702/5086] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:57:31 2022] GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40 => generated 1518 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:57:33.112526 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-26e50ae6-feed-40a3-9af7-a66bcd6158cf tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Flavor limits 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:57:33.113150 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-26e50ae6-feed-40a3-9af7-a66bcd6158cf tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Image limits 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:57:33.113524 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-26e50ae6-feed-40a3-9af7-a66bcd6158cf tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Flavor pref 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:57:33.113937 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-26e50ae6-feed-40a3-9af7-a66bcd6158cf tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Image pref 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:57:33.114353 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-26e50ae6-feed-40a3-9af7-a66bcd6158cf tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:57:33.137597 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-26e50ae6-feed-40a3-9af7-a66bcd6158cf tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:33.138097 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-26e50ae6-feed-40a3-9af7-a66bcd6158cf tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:33.138529 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-26e50ae6-feed-40a3-9af7-a66bcd6158cf tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:33.139264 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-26e50ae6-feed-40a3-9af7-a66bcd6158cf tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:33.139730 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-26e50ae6-feed-40a3-9af7-a66bcd6158cf tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:33.140196 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-26e50ae6-feed-40a3-9af7-a66bcd6158cf tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:33.214715 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-378c5ffe-51e2-40f8-abdc-caf91caa528b tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:57:33.215990 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-378c5ffe-51e2-40f8-abdc-caf91caa528b tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 01e250ab-d9aa-4708-ae36-10c53a411a40] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:57:33.253433 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-26e50ae6-feed-40a3-9af7-a66bcd6158cf tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Getting quotas for project a9330711915a4b7f9d0f3559f0f19083. Resources: {'ram', 'cores', 'instances'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:57:33.263879 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-378c5ffe-51e2-40f8-abdc-caf91caa528b tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:33.267323 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-378c5ffe-51e2-40f8-abdc-caf91caa528b tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:33.269754 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-26e50ae6-feed-40a3-9af7-a66bcd6158cf tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Getting quotas for user da3b918706c14020910d5d0e97d96656 and project a9330711915a4b7f9d0f3559f0f19083. Resources: {'ram', 'cores', 'instances'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:57:33.270244 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-378c5ffe-51e2-40f8-abdc-caf91caa528b tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:33.275266 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-378c5ffe-51e2-40f8-abdc-caf91caa528b tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:33.286616 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-378c5ffe-51e2-40f8-abdc-caf91caa528b tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:33.294225 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-378c5ffe-51e2-40f8-abdc-caf91caa528b tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:33.318493 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-26e50ae6-feed-40a3-9af7-a66bcd6158cf tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Going to run 1 instances... {{(pid=123595) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:57:33.328276 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-26e50ae6-feed-40a3-9af7-a66bcd6158cf tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] [instance: f51ca9f8-1cc6-4972-882e-34937122d5e4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e8943ec5-4038-4d4b-b9b9-2415a79f5243',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:57:33.463551 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-26e50ae6-feed-40a3-9af7-a66bcd6158cf tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 21.093269 Oct 04 18:57:33.477021 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2385/5087] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 18:57:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 21106 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 18:57:33.488610 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-abcd0514-5d04-4d43-aaa1-6038ffd0ded2 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:57:33.510224 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-abcd0514-5d04-4d43-aaa1-6038ffd0ded2 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] [instance: f51ca9f8-1cc6-4972-882e-34937122d5e4] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:57:33.642317 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-abcd0514-5d04-4d43-aaa1-6038ffd0ded2 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da3b918706c14020910d5d0e97d96656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9330711915a4b7f9d0f3559f0f19083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:57:33.650676 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-abcd0514-5d04-4d43-aaa1-6038ffd0ded2 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] 10.222.0.43 "GET /compute/v2.1/servers/f51ca9f8-1cc6-4972-882e-34937122d5e4" status: 200 len: 1213 microversion: 2.1 time: 0.172114 Oct 04 18:57:33.661471 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2386/5088] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:57:33 2022] GET /compute/v2.1/servers/f51ca9f8-1cc6-4972-882e-34937122d5e4 => generated 1213 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:57:34.688785 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-a4482e6a-54ba-49e8-b424-4b0198e36347 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:57:34.690677 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-a4482e6a-54ba-49e8-b424-4b0198e36347 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] [instance: f51ca9f8-1cc6-4972-882e-34937122d5e4] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:57:34.886247 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-a4482e6a-54ba-49e8-b424-4b0198e36347 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da3b918706c14020910d5d0e97d96656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9330711915a4b7f9d0f3559f0f19083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:57:34.899944 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-a4482e6a-54ba-49e8-b424-4b0198e36347 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] 10.222.0.43 "GET /compute/v2.1/servers/f51ca9f8-1cc6-4972-882e-34937122d5e4" status: 200 len: 1213 microversion: 2.1 time: 0.210919 Oct 04 18:57:34.904028 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2387/5089] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:57:34 2022] GET /compute/v2.1/servers/f51ca9f8-1cc6-4972-882e-34937122d5e4 => generated 1213 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:57:34.951593 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-378c5ffe-51e2-40f8-abdc-caf91caa528b tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f63f1ac147543dab34a28a22eb5936c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1607b30b9f324abaa88aa29e04ef3ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:57:34.969745 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-378c5ffe-51e2-40f8-abdc-caf91caa528b tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40" status: 200 len: 1518 microversion: 2.1 time: 1.774722 Oct 04 18:57:34.973583 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2703/5090] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:57:33 2022] GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40 => generated 1518 bytes in 1782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:57:35.928096 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-ba9c51d1-9fb2-4e0f-b9df-7634ed2240c9 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:57:35.929374 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-ba9c51d1-9fb2-4e0f-b9df-7634ed2240c9 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] [instance: f51ca9f8-1cc6-4972-882e-34937122d5e4] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:57:35.948038 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ba9c51d1-9fb2-4e0f-b9df-7634ed2240c9 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:35.950210 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ba9c51d1-9fb2-4e0f-b9df-7634ed2240c9 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:35.955112 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ba9c51d1-9fb2-4e0f-b9df-7634ed2240c9 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:35.959546 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ba9c51d1-9fb2-4e0f-b9df-7634ed2240c9 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:35.965392 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ba9c51d1-9fb2-4e0f-b9df-7634ed2240c9 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:35.966075 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ba9c51d1-9fb2-4e0f-b9df-7634ed2240c9 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:36.001863 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-a5d7b619-3275-43d7-9f35-e90fc8c3884e tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:57:36.003077 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-a5d7b619-3275-43d7-9f35-e90fc8c3884e tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 01e250ab-d9aa-4708-ae36-10c53a411a40] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:57:36.024334 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a5d7b619-3275-43d7-9f35-e90fc8c3884e tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:36.024334 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a5d7b619-3275-43d7-9f35-e90fc8c3884e tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:36.024598 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a5d7b619-3275-43d7-9f35-e90fc8c3884e tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:36.025193 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a5d7b619-3275-43d7-9f35-e90fc8c3884e tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:36.025653 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a5d7b619-3275-43d7-9f35-e90fc8c3884e tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:36.026078 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a5d7b619-3275-43d7-9f35-e90fc8c3884e tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:36.138420 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:57:36.251220 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-ba9c51d1-9fb2-4e0f-b9df-7634ed2240c9 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da3b918706c14020910d5d0e97d96656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9330711915a4b7f9d0f3559f0f19083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:57:36.259217 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-ba9c51d1-9fb2-4e0f-b9df-7634ed2240c9 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] 10.222.0.43 "GET /compute/v2.1/servers/f51ca9f8-1cc6-4972-882e-34937122d5e4" status: 200 len: 1265 microversion: 2.1 time: 0.335082 Oct 04 18:57:36.269989 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2388/5091] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:57:35 2022] GET /compute/v2.1/servers/f51ca9f8-1cc6-4972-882e-34937122d5e4 => generated 1265 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:57:36.524656 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-a5d7b619-3275-43d7-9f35-e90fc8c3884e tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f63f1ac147543dab34a28a22eb5936c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1607b30b9f324abaa88aa29e04ef3ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:57:36.540779 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-a5d7b619-3275-43d7-9f35-e90fc8c3884e tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40" status: 200 len: 1518 microversion: 2.1 time: 0.542911 Oct 04 18:57:36.548513 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2704/5092] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:57:35 2022] GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40 => generated 1518 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:57:37.296459 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-8e1833b3-0029-4628-a657-3465674016dc tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:57:37.297235 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-8e1833b3-0029-4628-a657-3465674016dc tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] [instance: f51ca9f8-1cc6-4972-882e-34937122d5e4] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:57:37.310912 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8e1833b3-0029-4628-a657-3465674016dc tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:37.311792 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8e1833b3-0029-4628-a657-3465674016dc tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:37.312464 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8e1833b3-0029-4628-a657-3465674016dc tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:37.313705 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8e1833b3-0029-4628-a657-3465674016dc tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:37.315953 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8e1833b3-0029-4628-a657-3465674016dc tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:37.316638 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8e1833b3-0029-4628-a657-3465674016dc tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:37.567024 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-97baa9a0-31de-43e6-85ef-8926986522d4 req-b5808793-d7f0-4f1f-aac0-c3a74fca2bc7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01e250ab-d9aa-4708-ae36-10c53a411a40", "name": "network-vif-plugged", "status": "completed", "tag": "70d1b09a-03d8-41b4-9a82-fc7d75a3624a"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:57:37.593174 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-97baa9a0-31de-43e6-85ef-8926986522d4 req-b5808793-d7f0-4f1f-aac0-c3a74fca2bc7 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:37.593670 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-97baa9a0-31de-43e6-85ef-8926986522d4 req-b5808793-d7f0-4f1f-aac0-c3a74fca2bc7 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:37.594122 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-97baa9a0-31de-43e6-85ef-8926986522d4 req-b5808793-d7f0-4f1f-aac0-c3a74fca2bc7 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:37.642248 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-97baa9a0-31de-43e6-85ef-8926986522d4 req-b5808793-d7f0-4f1f-aac0-c3a74fca2bc7 service nova] Creating event network-vif-plugged:70d1b09a-03d8-41b4-9a82-fc7d75a3624a for instance 01e250ab-d9aa-4708-ae36-10c53a411a40 on n-h1-851028-13 Oct 04 18:57:37.652686 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-97baa9a0-31de-43e6-85ef-8926986522d4 req-b5808793-d7f0-4f1f-aac0-c3a74fca2bc7 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094477 Oct 04 18:57:37.657439 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2705/5093] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:57:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:57:37.718766 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-2c1544f1-0029-46de-a6f7-a132aa3722d5 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:57:37.727669 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-2c1544f1-0029-46de-a6f7-a132aa3722d5 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 01e250ab-d9aa-4708-ae36-10c53a411a40] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:57:37.761740 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2c1544f1-0029-46de-a6f7-a132aa3722d5 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:37.762276 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2c1544f1-0029-46de-a6f7-a132aa3722d5 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:37.762811 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2c1544f1-0029-46de-a6f7-a132aa3722d5 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:37.763461 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2c1544f1-0029-46de-a6f7-a132aa3722d5 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:37.763932 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2c1544f1-0029-46de-a6f7-a132aa3722d5 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:37.764357 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2c1544f1-0029-46de-a6f7-a132aa3722d5 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:37.786355 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-8e1833b3-0029-4628-a657-3465674016dc tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da3b918706c14020910d5d0e97d96656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9330711915a4b7f9d0f3559f0f19083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:57:37.816368 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-8e1833b3-0029-4628-a657-3465674016dc tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] 10.222.0.43 "GET /compute/v2.1/servers/f51ca9f8-1cc6-4972-882e-34937122d5e4" status: 200 len: 1271 microversion: 2.1 time: 0.506006 Oct 04 18:57:37.822454 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2389/5094] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:57:37 2022] GET /compute/v2.1/servers/f51ca9f8-1cc6-4972-882e-34937122d5e4 => generated 1271 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:57:38.619170 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-2c1544f1-0029-46de-a6f7-a132aa3722d5 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f63f1ac147543dab34a28a22eb5936c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1607b30b9f324abaa88aa29e04ef3ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:57:38.636795 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-2c1544f1-0029-46de-a6f7-a132aa3722d5 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40" status: 200 len: 1518 microversion: 2.1 time: 0.976430 Oct 04 18:57:38.637807 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2706/5095] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:57:37 2022] GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40 => generated 1518 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:57:38.847237 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-4478d741-e533-470c-96c0-b06f09b89075 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:57:38.848306 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-4478d741-e533-470c-96c0-b06f09b89075 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] [instance: f51ca9f8-1cc6-4972-882e-34937122d5e4] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:57:38.860672 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4478d741-e533-470c-96c0-b06f09b89075 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:38.862122 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4478d741-e533-470c-96c0-b06f09b89075 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:38.862892 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4478d741-e533-470c-96c0-b06f09b89075 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:38.865344 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4478d741-e533-470c-96c0-b06f09b89075 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:38.868183 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4478d741-e533-470c-96c0-b06f09b89075 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:38.869713 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4478d741-e533-470c-96c0-b06f09b89075 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:39.029155 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-4478d741-e533-470c-96c0-b06f09b89075 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da3b918706c14020910d5d0e97d96656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9330711915a4b7f9d0f3559f0f19083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:57:39.077232 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-4478d741-e533-470c-96c0-b06f09b89075 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] 10.222.0.43 "GET /compute/v2.1/servers/f51ca9f8-1cc6-4972-882e-34937122d5e4" status: 200 len: 1271 microversion: 2.1 time: 0.234404 Oct 04 18:57:39.079390 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2390/5096] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:57:38 2022] GET /compute/v2.1/servers/f51ca9f8-1cc6-4972-882e-34937122d5e4 => generated 1271 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:57:39.670312 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-39de2e36-d57e-4709-9f78-5c794335b59b tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:57:39.671289 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-39de2e36-d57e-4709-9f78-5c794335b59b tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 01e250ab-d9aa-4708-ae36-10c53a411a40] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:57:39.701138 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-39de2e36-d57e-4709-9f78-5c794335b59b tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:39.703146 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-39de2e36-d57e-4709-9f78-5c794335b59b tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:39.703827 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-39de2e36-d57e-4709-9f78-5c794335b59b tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:39.705775 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-39de2e36-d57e-4709-9f78-5c794335b59b tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:39.707417 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-39de2e36-d57e-4709-9f78-5c794335b59b tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:39.710182 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-39de2e36-d57e-4709-9f78-5c794335b59b tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:40.104120 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-5a91d72c-3181-4c23-a66a-57d2315cd480 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:57:40.105428 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-5a91d72c-3181-4c23-a66a-57d2315cd480 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] [instance: f51ca9f8-1cc6-4972-882e-34937122d5e4] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:57:40.116449 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5a91d72c-3181-4c23-a66a-57d2315cd480 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:40.119425 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5a91d72c-3181-4c23-a66a-57d2315cd480 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:40.121659 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5a91d72c-3181-4c23-a66a-57d2315cd480 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:40.122602 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5a91d72c-3181-4c23-a66a-57d2315cd480 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:40.123127 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-39de2e36-d57e-4709-9f78-5c794335b59b tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f63f1ac147543dab34a28a22eb5936c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1607b30b9f324abaa88aa29e04ef3ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:57:40.124771 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5a91d72c-3181-4c23-a66a-57d2315cd480 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:40.126327 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5a91d72c-3181-4c23-a66a-57d2315cd480 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:40.155999 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-39de2e36-d57e-4709-9f78-5c794335b59b tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40" status: 200 len: 1518 microversion: 2.1 time: 0.495484 Oct 04 18:57:40.166935 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2707/5097] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:57:39 2022] GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40 => generated 1518 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:57:41.198397 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-8594477d-4f84-4261-8ed2-693018e9ab57 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:57:41.205552 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-8594477d-4f84-4261-8ed2-693018e9ab57 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 01e250ab-d9aa-4708-ae36-10c53a411a40] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:57:41.206494 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-5a91d72c-3181-4c23-a66a-57d2315cd480 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da3b918706c14020910d5d0e97d96656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9330711915a4b7f9d0f3559f0f19083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:57:41.217375 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-5a91d72c-3181-4c23-a66a-57d2315cd480 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] 10.222.0.43 "GET /compute/v2.1/servers/f51ca9f8-1cc6-4972-882e-34937122d5e4" status: 200 len: 1313 microversion: 2.1 time: 1.115764 Oct 04 18:57:41.232970 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2391/5098] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:57:40 2022] GET /compute/v2.1/servers/f51ca9f8-1cc6-4972-882e-34937122d5e4 => generated 1313 bytes in 1120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:57:41.233255 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8594477d-4f84-4261-8ed2-693018e9ab57 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:41.246563 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8594477d-4f84-4261-8ed2-693018e9ab57 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:41.247196 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8594477d-4f84-4261-8ed2-693018e9ab57 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:41.247839 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8594477d-4f84-4261-8ed2-693018e9ab57 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:41.248415 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8594477d-4f84-4261-8ed2-693018e9ab57 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:41.248861 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8594477d-4f84-4261-8ed2-693018e9ab57 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:41.694795 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-8594477d-4f84-4261-8ed2-693018e9ab57 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f63f1ac147543dab34a28a22eb5936c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1607b30b9f324abaa88aa29e04ef3ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:57:41.717802 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-8594477d-4f84-4261-8ed2-693018e9ab57 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40" status: 200 len: 1518 microversion: 2.1 time: 0.521401 Oct 04 18:57:41.718462 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2708/5099] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:57:41 2022] GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40 => generated 1518 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:57:42.240253 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-72ac4bb5-94c9-4ff2-99c8-b309216785da tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:57:42.240813 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-72ac4bb5-94c9-4ff2-99c8-b309216785da tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] [instance: f51ca9f8-1cc6-4972-882e-34937122d5e4] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:57:42.250369 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-72ac4bb5-94c9-4ff2-99c8-b309216785da tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:42.253570 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-72ac4bb5-94c9-4ff2-99c8-b309216785da tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:42.254034 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-72ac4bb5-94c9-4ff2-99c8-b309216785da tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:42.256809 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-72ac4bb5-94c9-4ff2-99c8-b309216785da tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:42.257478 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-72ac4bb5-94c9-4ff2-99c8-b309216785da tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:42.257931 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-72ac4bb5-94c9-4ff2-99c8-b309216785da tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:42.749897 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-c799e8e1-e0b4-49d1-8409-a8d4628b8a4d tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:57:42.750497 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-c799e8e1-e0b4-49d1-8409-a8d4628b8a4d tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 01e250ab-d9aa-4708-ae36-10c53a411a40] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:57:42.773204 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c799e8e1-e0b4-49d1-8409-a8d4628b8a4d tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:42.774900 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c799e8e1-e0b4-49d1-8409-a8d4628b8a4d tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:42.775585 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c799e8e1-e0b4-49d1-8409-a8d4628b8a4d tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:42.777446 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c799e8e1-e0b4-49d1-8409-a8d4628b8a4d tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:42.785965 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c799e8e1-e0b4-49d1-8409-a8d4628b8a4d tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:42.786745 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c799e8e1-e0b4-49d1-8409-a8d4628b8a4d tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:43.138815 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-c799e8e1-e0b4-49d1-8409-a8d4628b8a4d tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f63f1ac147543dab34a28a22eb5936c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1607b30b9f324abaa88aa29e04ef3ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:57:43.157442 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-c799e8e1-e0b4-49d1-8409-a8d4628b8a4d tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40" status: 200 len: 1505 microversion: 2.1 time: 0.407617 Oct 04 18:57:43.171526 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2709/5100] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:57:42 2022] GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40 => generated 1505 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:57:43.188911 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-38869a8b-1694-46f9-b476-da342d872eae tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:57:43.190832 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-38869a8b-1694-46f9-b476-da342d872eae tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 01e250ab-d9aa-4708-ae36-10c53a411a40] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:57:43.208319 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-38869a8b-1694-46f9-b476-da342d872eae tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:43.210308 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-38869a8b-1694-46f9-b476-da342d872eae tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:43.213771 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-38869a8b-1694-46f9-b476-da342d872eae tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:43.215382 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-38869a8b-1694-46f9-b476-da342d872eae tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:43.218024 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-38869a8b-1694-46f9-b476-da342d872eae tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:43.220210 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-38869a8b-1694-46f9-b476-da342d872eae tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:43.232948 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=2 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:57:43.298728 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-72ac4bb5-94c9-4ff2-99c8-b309216785da tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da3b918706c14020910d5d0e97d96656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9330711915a4b7f9d0f3559f0f19083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:57:43.318011 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-72ac4bb5-94c9-4ff2-99c8-b309216785da tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] 10.222.0.43 "GET /compute/v2.1/servers/f51ca9f8-1cc6-4972-882e-34937122d5e4" status: 200 len: 1334 microversion: 2.1 time: 1.081511 Oct 04 18:57:43.329027 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2392/5101] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:57:42 2022] GET /compute/v2.1/servers/f51ca9f8-1cc6-4972-882e-34937122d5e4 => generated 1334 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:57:43.600077 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-38869a8b-1694-46f9-b476-da342d872eae tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f63f1ac147543dab34a28a22eb5936c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1607b30b9f324abaa88aa29e04ef3ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:57:43.614896 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-38869a8b-1694-46f9-b476-da342d872eae tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40" status: 200 len: 1505 microversion: 2.1 time: 0.434546 Oct 04 18:57:43.616661 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2710/5102] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:57:43 2022] GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40 => generated 1505 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:57:43.678918 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-a6f42369-2120-48e9-995e-0e1b51db4e5c tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:57:43.689552 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-a6f42369-2120-48e9-995e-0e1b51db4e5c tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 01e250ab-d9aa-4708-ae36-10c53a411a40] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:57:43.711192 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a6f42369-2120-48e9-995e-0e1b51db4e5c tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:43.711854 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a6f42369-2120-48e9-995e-0e1b51db4e5c tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:43.712309 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a6f42369-2120-48e9-995e-0e1b51db4e5c tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:43.713181 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a6f42369-2120-48e9-995e-0e1b51db4e5c tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:43.713832 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a6f42369-2120-48e9-995e-0e1b51db4e5c tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:43.714470 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a6f42369-2120-48e9-995e-0e1b51db4e5c tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:44.344377 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-03663044-b034-401e-8b04-dbb5bbe4eeaa tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:57:44.345172 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-03663044-b034-401e-8b04-dbb5bbe4eeaa tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] [instance: f51ca9f8-1cc6-4972-882e-34937122d5e4] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:57:44.365268 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-03663044-b034-401e-8b04-dbb5bbe4eeaa tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:44.373236 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-03663044-b034-401e-8b04-dbb5bbe4eeaa tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:44.376511 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-03663044-b034-401e-8b04-dbb5bbe4eeaa tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:44.384681 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-03663044-b034-401e-8b04-dbb5bbe4eeaa tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:44.388491 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-03663044-b034-401e-8b04-dbb5bbe4eeaa tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:44.393577 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-03663044-b034-401e-8b04-dbb5bbe4eeaa tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:44.826727 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-03663044-b034-401e-8b04-dbb5bbe4eeaa tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da3b918706c14020910d5d0e97d96656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9330711915a4b7f9d0f3559f0f19083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:57:44.849351 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-03663044-b034-401e-8b04-dbb5bbe4eeaa tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] 10.222.0.43 "GET /compute/v2.1/servers/f51ca9f8-1cc6-4972-882e-34937122d5e4" status: 200 len: 1334 microversion: 2.1 time: 0.509181 Oct 04 18:57:44.852444 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2711/5103] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:57:44 2022] GET /compute/v2.1/servers/f51ca9f8-1cc6-4972-882e-34937122d5e4 => generated 1334 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:57:44.895496 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=10 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:57:45.119380 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-a6f42369-2120-48e9-995e-0e1b51db4e5c tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f63f1ac147543dab34a28a22eb5936c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1607b30b9f324abaa88aa29e04ef3ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:57:45.130568 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-a6f42369-2120-48e9-995e-0e1b51db4e5c tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40" status: 200 len: 1505 microversion: 2.1 time: 1.456076 Oct 04 18:57:45.131167 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2393/5104] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:57:43 2022] GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40 => generated 1505 bytes in 1457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:57:45.159343 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-81f723b2-fd97-44af-adeb-27d8f609db9f tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:57:45.181008 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-81f723b2-fd97-44af-adeb-27d8f609db9f tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] HTTP exception thrown: Instance 0a369c67-6902-4bc1-a72a-0246c8ba84b8 has no mapping to a cell. Oct 04 18:57:45.195779 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-81f723b2-fd97-44af-adeb-27d8f609db9f tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Request method failure captured: Oct 04 18:57:45.195779 n-d-851028-13 devstack@n-api.service[123596]: request: POST /compute/v2.1/servers/0a369c67-6902-4bc1-a72a-0246c8ba84b8/action HTTP/1.1 Oct 04 18:57:45.195779 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:57:45.195779 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:57:45.195779 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:57:45.195779 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 15 Oct 04 18:57:45.195779 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:57:45.195779 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:57:45.195779 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:57:45.195779 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:57:45.195779 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPIEZsAoFcr6P1AMHBWUo8LvryOn1l2-LYSKr4xgLCvHblWFuAiGVlStWcljkgzOc7-ldx7qv3C-2jYmQ32_Zk5yP28dI64Re9CsyHCLmsYfyJdD0-2_kU92lHK36Fs8oXqXU2FijNX-X4IYqe4GjOQDN7LB9zCeEIcrxQ2LRJFOwbQY Oct 04 18:57:45.195779 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:57:45.195779 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:57:45.195779 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:57:45.195779 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:57:45.195779 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:57:45.195779 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:57:45.195779 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: 1607b30b9f324abaa88aa29e04ef3ec4 Oct 04 18:57:45.195779 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-ServersNegativeTestJSON-708693932 Oct 04 18:57:45.195779 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 18:57:45.195779 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 18:57:45.195779 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/1607b30b9f324abaa88aa29e04ef3ec4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_1607b30b9f324abaa88aa29e04ef3ec4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1607b30b9f324abaa88aa29e04ef3ec4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1607b30b9f324abaa88aa29e04ef3ec4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:57:45.195779 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-ServersNegativeTestJSON-708693932 Oct 04 18:57:45.195779 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: 1607b30b9f324abaa88aa29e04ef3ec4 Oct 04 18:57:45.195779 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-ServersNegativeTestJSON-708693932 Oct 04 18:57:45.195779 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-ServersNegativeTestJSON-708693932-project Oct 04 18:57:45.195779 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:57:45.195779 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:57:45.195779 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 6f63f1ac147543dab34a28a22eb5936c Oct 04 18:57:45.195779 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-ServersNegativeTestJSON-708693932-project Oct 04 18:57:45.195779 n-d-851028-13 devstack@n-api.service[123596]: Oct 04 18:57:45.195779 n-d-851028-13 devstack@n-api.service[123596]: {"os-stop": {}} Oct 04 18:57:45.195779 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 18:57:45.195779 n-d-851028-13 devstack@n-api.service[123596]: exception: Instance 0a369c67-6902-4bc1-a72a-0246c8ba84b8 has no mapping to a cell. Oct 04 18:57:45.195779 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': '0a369c67-6902-4bc1-a72a-0246c8ba84b8', 'body': {'os-stop': {}}} Oct 04 18:57:45.195779 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:57:45.195779 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:57:45.195779 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1411, in _get_instance Oct 04 18:57:45.195779 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi mapping = objects.InstanceMapping.get_by_instance_uuid( Oct 04 18:57:45.195779 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 18:57:45.195779 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 18:57:45.195779 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 112, in get_by_instance_uuid Oct 04 18:57:45.195779 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_instance_uuid_from_db(context, instance_uuid) Oct 04 18:57:45.195779 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 18:57:45.195779 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 18:57:45.195779 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 106, in _get_by_instance_uuid_from_db Oct 04 18:57:45.195779 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.InstanceMappingNotFound(uuid=instance_uuid) Oct 04 18:57:45.195779 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceMappingNotFound: Instance 0a369c67-6902-4bc1-a72a-0246c8ba84b8 has no mapping to a cell. Oct 04 18:57:45.195779 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:57:45.195779 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:57:45.195779 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:57:45.195779 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:57:45.195779 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:57:45.195779 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:57:45.195779 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:57:45.195779 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:57:45.195779 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:57:45.195779 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:57:45.195779 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1444, in _stop_server Oct 04 18:57:45.195779 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, id) Oct 04 18:57:45.195779 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1418, in _get_instance Oct 04 18:57:45.195779 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:57:45.195779 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a369c67-6902-4bc1-a72a-0246c8ba84b8 has no mapping to a cell. Oct 04 18:57:45.203186 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:57:45.203186 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:57:45.203186 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:57:45.203186 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:57:45.203186 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:57:45.203186 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:57:45.203186 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:57:45.203186 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:57:45.203186 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a369c67-6902-4bc1-a72a-0246c8ba84b8 has no mapping to a cell. Oct 04 18:57:45.203186 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:57:45.206275 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-81f723b2-fd97-44af-adeb-27d8f609db9f tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Returning 404 to user: Instance 0a369c67-6902-4bc1-a72a-0246c8ba84b8 has no mapping to a cell. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:57:45.207578 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-81f723b2-fd97-44af-adeb-27d8f609db9f tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "POST /compute/v2.1/servers/0a369c67-6902-4bc1-a72a-0246c8ba84b8/action" status: 404 len: 117 microversion: 2.1 time: 0.053643 Oct 04 18:57:45.212239 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2712/5105] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 18:57:45 2022] POST /compute/v2.1/servers/0a369c67-6902-4bc1-a72a-0246c8ba84b8/action => generated 117 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:57:45.218181 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-38e8355c-1ef5-4233-b38e-2271f7cde9db tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:57:45.218820 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-38e8355c-1ef5-4233-b38e-2271f7cde9db tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 01e250ab-d9aa-4708-ae36-10c53a411a40] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:57:45.232753 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-38e8355c-1ef5-4233-b38e-2271f7cde9db tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:45.233296 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-38e8355c-1ef5-4233-b38e-2271f7cde9db tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:45.244797 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-38e8355c-1ef5-4233-b38e-2271f7cde9db tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:45.245749 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-38e8355c-1ef5-4233-b38e-2271f7cde9db tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:45.246278 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-38e8355c-1ef5-4233-b38e-2271f7cde9db tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:45.246705 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-38e8355c-1ef5-4233-b38e-2271f7cde9db tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:45.878491 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-8c7c132a-cc4a-4ea7-8b7b-e6c61231b9d6 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:57:45.880123 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-8c7c132a-cc4a-4ea7-8b7b-e6c61231b9d6 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] [instance: f51ca9f8-1cc6-4972-882e-34937122d5e4] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:57:45.934744 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8c7c132a-cc4a-4ea7-8b7b-e6c61231b9d6 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:45.959284 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8c7c132a-cc4a-4ea7-8b7b-e6c61231b9d6 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:45.966363 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8c7c132a-cc4a-4ea7-8b7b-e6c61231b9d6 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:45.967139 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8c7c132a-cc4a-4ea7-8b7b-e6c61231b9d6 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:45.967619 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8c7c132a-cc4a-4ea7-8b7b-e6c61231b9d6 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:45.968046 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8c7c132a-cc4a-4ea7-8b7b-e6c61231b9d6 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:46.549236 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-8c7c132a-cc4a-4ea7-8b7b-e6c61231b9d6 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da3b918706c14020910d5d0e97d96656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9330711915a4b7f9d0f3559f0f19083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:57:46.564480 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-38e8355c-1ef5-4233-b38e-2271f7cde9db tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f63f1ac147543dab34a28a22eb5936c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1607b30b9f324abaa88aa29e04ef3ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:57:46.568173 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-8c7c132a-cc4a-4ea7-8b7b-e6c61231b9d6 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] 10.222.0.43 "GET /compute/v2.1/servers/f51ca9f8-1cc6-4972-882e-34937122d5e4" status: 200 len: 1355 microversion: 2.1 time: 0.694636 Oct 04 18:57:46.569103 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2713/5106] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:57:45 2022] GET /compute/v2.1/servers/f51ca9f8-1cc6-4972-882e-34937122d5e4 => generated 1355 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:57:46.579959 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-38e8355c-1ef5-4233-b38e-2271f7cde9db tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40" status: 200 len: 1505 microversion: 2.1 time: 1.366222 Oct 04 18:57:46.587079 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2394/5107] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:57:45 2022] GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40 => generated 1505 bytes in 1374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:57:46.611415 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-7dc673ad-a9b5-463f-9136-ccef0c9c679f tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:57:46.612121 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-7dc673ad-a9b5-463f-9136-ccef0c9c679f tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 01e250ab-d9aa-4708-ae36-10c53a411a40] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:57:46.646182 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7dc673ad-a9b5-463f-9136-ccef0c9c679f tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:46.647000 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7dc673ad-a9b5-463f-9136-ccef0c9c679f tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:46.647861 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7dc673ad-a9b5-463f-9136-ccef0c9c679f tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:46.650641 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7dc673ad-a9b5-463f-9136-ccef0c9c679f tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:46.651175 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7dc673ad-a9b5-463f-9136-ccef0c9c679f tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:46.651783 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7dc673ad-a9b5-463f-9136-ccef0c9c679f tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:47.119263 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-7dc673ad-a9b5-463f-9136-ccef0c9c679f tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f63f1ac147543dab34a28a22eb5936c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1607b30b9f324abaa88aa29e04ef3ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:57:47.131407 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-7dc673ad-a9b5-463f-9136-ccef0c9c679f tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40" status: 200 len: 1505 microversion: 2.1 time: 0.524395 Oct 04 18:57:47.137380 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2714/5108] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:57:46 2022] GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40 => generated 1505 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:57:47.160713 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-da107879-4db9-4f24-b5dd-2144fecd0ddf tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:57:47.161205 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-da107879-4db9-4f24-b5dd-2144fecd0ddf tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 4f1a5efa-7287-49e1-8ec2-9c41485e8bec] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:57:47.167569 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-da107879-4db9-4f24-b5dd-2144fecd0ddf tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] HTTP exception thrown: Instance 4f1a5efa-7287-49e1-8ec2-9c41485e8bec could not be found. Oct 04 18:57:47.169138 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-da107879-4db9-4f24-b5dd-2144fecd0ddf tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Request method failure captured: Oct 04 18:57:47.169138 n-d-851028-13 devstack@n-api.service[123595]: request: POST /compute/v2.1/servers/4f1a5efa-7287-49e1-8ec2-9c41485e8bec/action HTTP/1.1 Oct 04 18:57:47.169138 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 18:57:47.169138 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 18:57:47.169138 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 18:57:47.169138 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 15 Oct 04 18:57:47.169138 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 18:57:47.169138 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 18:57:47.169138 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 18:57:47.169138 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 18:57:47.169138 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPIEZsAoFcr6P1AMHBWUo8LvryOn1l2-LYSKr4xgLCvHblWFuAiGVlStWcljkgzOc7-ldx7qv3C-2jYmQ32_Zk5yP28dI64Re9CsyHCLmsYfyJdD0-2_kU92lHK36Fs8oXqXU2FijNX-X4IYqe4GjOQDN7LB9zCeEIcrxQ2LRJFOwbQY Oct 04 18:57:47.169138 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 18:57:47.169138 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 18:57:47.169138 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 18:57:47.169138 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 18:57:47.169138 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 18:57:47.169138 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 18:57:47.169138 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: 1607b30b9f324abaa88aa29e04ef3ec4 Oct 04 18:57:47.169138 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-ServersNegativeTestJSON-708693932 Oct 04 18:57:47.169138 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 18:57:47.169138 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 18:57:47.169138 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/1607b30b9f324abaa88aa29e04ef3ec4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_1607b30b9f324abaa88aa29e04ef3ec4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1607b30b9f324abaa88aa29e04ef3ec4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1607b30b9f324abaa88aa29e04ef3ec4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:57:47.169138 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-ServersNegativeTestJSON-708693932 Oct 04 18:57:47.169138 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: 1607b30b9f324abaa88aa29e04ef3ec4 Oct 04 18:57:47.169138 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-ServersNegativeTestJSON-708693932 Oct 04 18:57:47.169138 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-ServersNegativeTestJSON-708693932-project Oct 04 18:57:47.169138 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 18:57:47.169138 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 18:57:47.169138 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: 6f63f1ac147543dab34a28a22eb5936c Oct 04 18:57:47.169138 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-ServersNegativeTestJSON-708693932-project Oct 04 18:57:47.169138 n-d-851028-13 devstack@n-api.service[123595]: Oct 04 18:57:47.169138 n-d-851028-13 devstack@n-api.service[123595]: {"suspend": {}} Oct 04 18:57:47.169138 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 18:57:47.169138 n-d-851028-13 devstack@n-api.service[123595]: exception: Instance 4f1a5efa-7287-49e1-8ec2-9c41485e8bec could not be found. Oct 04 18:57:47.169138 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': '4f1a5efa-7287-49e1-8ec2-9c41485e8bec', 'body': {'suspend': {}}} Oct 04 18:57:47.169138 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:57:47.169138 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:57:47.169138 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:57:47.169138 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:57:47.169138 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:57:47.169138 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:57:47.169138 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 18:57:47.169138 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 18:57:47.169138 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f1a5efa-7287-49e1-8ec2-9c41485e8bec could not be found. Oct 04 18:57:47.169138 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:57:47.169138 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:57:47.169138 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:57:47.169138 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:57:47.169138 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:57:47.169138 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:57:47.169138 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:57:47.169138 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:57:47.169138 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:57:47.169138 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:57:47.169138 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 35, in _suspend Oct 04 18:57:47.169138 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Oct 04 18:57:47.169138 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:57:47.169138 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:57:47.169138 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f1a5efa-7287-49e1-8ec2-9c41485e8bec could not be found. Oct 04 18:57:47.169138 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:57:47.169138 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:57:47.169138 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:57:47.169138 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:57:47.169138 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:57:47.169138 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:57:47.174503 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:57:47.174503 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:57:47.174503 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f1a5efa-7287-49e1-8ec2-9c41485e8bec could not be found. Oct 04 18:57:47.174503 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:57:47.174503 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-da107879-4db9-4f24-b5dd-2144fecd0ddf tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Returning 404 to user: Instance 4f1a5efa-7287-49e1-8ec2-9c41485e8bec could not be found. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:57:47.185656 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-da107879-4db9-4f24-b5dd-2144fecd0ddf tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "POST /compute/v2.1/servers/4f1a5efa-7287-49e1-8ec2-9c41485e8bec/action" status: 404 len: 111 microversion: 2.1 time: 0.026303 Oct 04 18:57:47.186299 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2395/5109] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 18:57:47 2022] POST /compute/v2.1/servers/4f1a5efa-7287-49e1-8ec2-9c41485e8bec/action => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:57:47.196763 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-b1585a4d-a7ba-441b-ad4d-66c9860b0f50 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:57:47.197654 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-b1585a4d-a7ba-441b-ad4d-66c9860b0f50 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 01e250ab-d9aa-4708-ae36-10c53a411a40] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:57:47.213661 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b1585a4d-a7ba-441b-ad4d-66c9860b0f50 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:47.214535 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b1585a4d-a7ba-441b-ad4d-66c9860b0f50 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:47.215207 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b1585a4d-a7ba-441b-ad4d-66c9860b0f50 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:47.216124 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b1585a4d-a7ba-441b-ad4d-66c9860b0f50 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:47.216759 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b1585a4d-a7ba-441b-ad4d-66c9860b0f50 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:47.220847 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b1585a4d-a7ba-441b-ad4d-66c9860b0f50 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:47.519592 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-b1585a4d-a7ba-441b-ad4d-66c9860b0f50 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f63f1ac147543dab34a28a22eb5936c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1607b30b9f324abaa88aa29e04ef3ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:57:47.544810 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-b1585a4d-a7ba-441b-ad4d-66c9860b0f50 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40" status: 200 len: 1505 microversion: 2.1 time: 0.352525 Oct 04 18:57:47.547152 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2715/5110] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:57:47 2022] GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40 => generated 1505 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:57:47.579020 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-4d82bd7b-f0b8-4262-bf75-064cd8d045c6 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:57:47.579958 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-4d82bd7b-f0b8-4262-bf75-064cd8d045c6 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 01e250ab-d9aa-4708-ae36-10c53a411a40] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:57:47.596215 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-0654e733-2b1d-49ac-b9e8-681304782e79 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:57:47.596432 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4d82bd7b-f0b8-4262-bf75-064cd8d045c6 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:47.596729 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4d82bd7b-f0b8-4262-bf75-064cd8d045c6 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:47.597693 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-0654e733-2b1d-49ac-b9e8-681304782e79 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] [instance: f51ca9f8-1cc6-4972-882e-34937122d5e4] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:57:47.601735 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4d82bd7b-f0b8-4262-bf75-064cd8d045c6 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:47.603052 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4d82bd7b-f0b8-4262-bf75-064cd8d045c6 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:47.604087 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4d82bd7b-f0b8-4262-bf75-064cd8d045c6 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:47.605299 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4d82bd7b-f0b8-4262-bf75-064cd8d045c6 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:47.607780 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0654e733-2b1d-49ac-b9e8-681304782e79 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:47.608909 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0654e733-2b1d-49ac-b9e8-681304782e79 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:47.610908 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0654e733-2b1d-49ac-b9e8-681304782e79 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:47.611949 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0654e733-2b1d-49ac-b9e8-681304782e79 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:47.613847 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0654e733-2b1d-49ac-b9e8-681304782e79 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:47.615106 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0654e733-2b1d-49ac-b9e8-681304782e79 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:48.357233 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-0654e733-2b1d-49ac-b9e8-681304782e79 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da3b918706c14020910d5d0e97d96656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9330711915a4b7f9d0f3559f0f19083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:57:48.370005 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-0654e733-2b1d-49ac-b9e8-681304782e79 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] 10.222.0.43 "GET /compute/v2.1/servers/f51ca9f8-1cc6-4972-882e-34937122d5e4" status: 200 len: 1355 microversion: 2.1 time: 0.775230 Oct 04 18:57:48.371906 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2716/5111] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:57:47 2022] GET /compute/v2.1/servers/f51ca9f8-1cc6-4972-882e-34937122d5e4 => generated 1355 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:57:48.450765 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-4d82bd7b-f0b8-4262-bf75-064cd8d045c6 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f63f1ac147543dab34a28a22eb5936c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1607b30b9f324abaa88aa29e04ef3ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:57:48.463828 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-4d82bd7b-f0b8-4262-bf75-064cd8d045c6 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40" status: 200 len: 1505 microversion: 2.1 time: 0.890929 Oct 04 18:57:48.474341 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2396/5112] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:57:47 2022] GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40 => generated 1505 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:57:48.493315 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-a9911d3a-d330-47af-b023-739d259ce81b tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:57:48.494152 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-a9911d3a-d330-47af-b023-739d259ce81b tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 01e250ab-d9aa-4708-ae36-10c53a411a40] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:57:48.503418 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a9911d3a-d330-47af-b023-739d259ce81b tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:48.504125 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a9911d3a-d330-47af-b023-739d259ce81b tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:48.504614 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a9911d3a-d330-47af-b023-739d259ce81b tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:48.505626 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a9911d3a-d330-47af-b023-739d259ce81b tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:48.506299 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a9911d3a-d330-47af-b023-739d259ce81b tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:48.507074 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a9911d3a-d330-47af-b023-739d259ce81b tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:48.541697 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.objects.instance [None req-a9911d3a-d330-47af-b023-739d259ce81b tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lazy-loading 'flavor' on Instance uuid 01e250ab-d9aa-4708-ae36-10c53a411a40 {{(pid=123596) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:57:48.677141 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-a9911d3a-d330-47af-b023-739d259ce81b tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "POST /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40/action" status: 202 len: 0 microversion: 2.1 time: 0.188366 Oct 04 18:57:48.682182 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2717/5113] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 18:57:48 2022] POST /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40/action => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:57:48.688462 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f6f9d885-f0da-4b7b-a963-cfbf99a4ad26 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:57:48.689493 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-f6f9d885-f0da-4b7b-a963-cfbf99a4ad26 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 01e250ab-d9aa-4708-ae36-10c53a411a40] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:57:48.707786 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f6f9d885-f0da-4b7b-a963-cfbf99a4ad26 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:48.708990 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f6f9d885-f0da-4b7b-a963-cfbf99a4ad26 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:48.709952 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f6f9d885-f0da-4b7b-a963-cfbf99a4ad26 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:48.710918 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f6f9d885-f0da-4b7b-a963-cfbf99a4ad26 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:48.711585 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f6f9d885-f0da-4b7b-a963-cfbf99a4ad26 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:48.712227 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f6f9d885-f0da-4b7b-a963-cfbf99a4ad26 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:48.897608 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-888e8437-dbb6-47b2-9fce-90f21438b349 req-e2643a97-2014-4397-b0d2-3ecd1f49fed4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f51ca9f8-1cc6-4972-882e-34937122d5e4", "tag": "48f1dcfd-b029-4491-b22d-2a62a2891c97"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:57:48.916201 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-888e8437-dbb6-47b2-9fce-90f21438b349 req-e2643a97-2014-4397-b0d2-3ecd1f49fed4 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:48.918141 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-888e8437-dbb6-47b2-9fce-90f21438b349 req-e2643a97-2014-4397-b0d2-3ecd1f49fed4 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:48.918757 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-888e8437-dbb6-47b2-9fce-90f21438b349 req-e2643a97-2014-4397-b0d2-3ecd1f49fed4 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:48.932886 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-888e8437-dbb6-47b2-9fce-90f21438b349 req-e2643a97-2014-4397-b0d2-3ecd1f49fed4 service nova] Creating event network-changed:48f1dcfd-b029-4491-b22d-2a62a2891c97 for instance f51ca9f8-1cc6-4972-882e-34937122d5e4 on n-h1-851028-13 Oct 04 18:57:48.939297 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-888e8437-dbb6-47b2-9fce-90f21438b349 req-e2643a97-2014-4397-b0d2-3ecd1f49fed4 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.389664 Oct 04 18:57:48.940606 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2397/5114] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:57:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:57:49.220446 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-f6f9d885-f0da-4b7b-a963-cfbf99a4ad26 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f63f1ac147543dab34a28a22eb5936c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1607b30b9f324abaa88aa29e04ef3ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:57:49.251597 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-f6f9d885-f0da-4b7b-a963-cfbf99a4ad26 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40" status: 200 len: 1513 microversion: 2.1 time: 0.567660 Oct 04 18:57:49.256317 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2718/5115] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:57:48 2022] GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40 => generated 1513 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:57:49.396168 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-fe2c1009-5d74-4277-9e0f-ab1dab4a375f tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:57:49.396969 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-fe2c1009-5d74-4277-9e0f-ab1dab4a375f tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] [instance: f51ca9f8-1cc6-4972-882e-34937122d5e4] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:57:49.408291 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fe2c1009-5d74-4277-9e0f-ab1dab4a375f tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:49.408991 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fe2c1009-5d74-4277-9e0f-ab1dab4a375f tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:49.409626 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fe2c1009-5d74-4277-9e0f-ab1dab4a375f tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:49.410506 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fe2c1009-5d74-4277-9e0f-ab1dab4a375f tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:49.410962 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fe2c1009-5d74-4277-9e0f-ab1dab4a375f tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:49.411823 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fe2c1009-5d74-4277-9e0f-ab1dab4a375f tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:50.283391 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-c9e0c921-417c-41c4-8d5d-9f76bca361e7 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:57:50.284043 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-c9e0c921-417c-41c4-8d5d-9f76bca361e7 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 01e250ab-d9aa-4708-ae36-10c53a411a40] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:57:50.300383 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c9e0c921-417c-41c4-8d5d-9f76bca361e7 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:50.303602 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c9e0c921-417c-41c4-8d5d-9f76bca361e7 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:50.305503 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c9e0c921-417c-41c4-8d5d-9f76bca361e7 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:50.306731 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c9e0c921-417c-41c4-8d5d-9f76bca361e7 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:50.308680 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c9e0c921-417c-41c4-8d5d-9f76bca361e7 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:50.310525 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c9e0c921-417c-41c4-8d5d-9f76bca361e7 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:50.951564 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-fe2c1009-5d74-4277-9e0f-ab1dab4a375f tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da3b918706c14020910d5d0e97d96656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9330711915a4b7f9d0f3559f0f19083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:57:51.009746 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-fe2c1009-5d74-4277-9e0f-ab1dab4a375f tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] 10.222.0.43 "GET /compute/v2.1/servers/f51ca9f8-1cc6-4972-882e-34937122d5e4" status: 200 len: 1355 microversion: 2.1 time: 1.618573 Oct 04 18:57:51.016557 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2398/5116] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:57:49 2022] GET /compute/v2.1/servers/f51ca9f8-1cc6-4972-882e-34937122d5e4 => generated 1355 bytes in 1626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:57:51.054475 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-c9e0c921-417c-41c4-8d5d-9f76bca361e7 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f63f1ac147543dab34a28a22eb5936c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1607b30b9f324abaa88aa29e04ef3ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:57:51.069708 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-5bdae422-d324-4d96-a90f-c146283492d6 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f51eedbf-cd57-46f3-8ee9-010b63718608"}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:57:51.077792 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-c9e0c921-417c-41c4-8d5d-9f76bca361e7 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40" status: 200 len: 1496 microversion: 2.1 time: 0.797095 Oct 04 18:57:51.079600 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2719/5117] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:57:50 2022] GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40 => generated 1496 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:57:51.085509 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-5bdae422-d324-4d96-a90f-c146283492d6 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] [instance: a45d1b74-2d81-4e11-b837-fe77dc63f689] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:57:51.109352 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5bdae422-d324-4d96-a90f-c146283492d6 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:51.111155 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-1b9b47d8-9da8-49cd-a48d-4bf599d76636 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:57:51.111915 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-1b9b47d8-9da8-49cd-a48d-4bf599d76636 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 01e250ab-d9aa-4708-ae36-10c53a411a40] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:57:51.119323 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1b9b47d8-9da8-49cd-a48d-4bf599d76636 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:51.121046 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5bdae422-d324-4d96-a90f-c146283492d6 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:51.121692 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5bdae422-d324-4d96-a90f-c146283492d6 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:51.127872 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1b9b47d8-9da8-49cd-a48d-4bf599d76636 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:51.129815 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5bdae422-d324-4d96-a90f-c146283492d6 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:51.130369 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5bdae422-d324-4d96-a90f-c146283492d6 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:51.130796 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1b9b47d8-9da8-49cd-a48d-4bf599d76636 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:51.130934 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5bdae422-d324-4d96-a90f-c146283492d6 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:51.132003 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1b9b47d8-9da8-49cd-a48d-4bf599d76636 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:51.136644 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1b9b47d8-9da8-49cd-a48d-4bf599d76636 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:51.137191 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1b9b47d8-9da8-49cd-a48d-4bf599d76636 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:51.206328 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.objects.instance [None req-1b9b47d8-9da8-49cd-a48d-4bf599d76636 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lazy-loading 'flavor' on Instance uuid 01e250ab-d9aa-4708-ae36-10c53a411a40 {{(pid=123596) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:57:51.234031 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:57:51.259246 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-1b9b47d8-9da8-49cd-a48d-4bf599d76636 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] HTTP exception thrown: Cannot 'suspend' instance 01e250ab-d9aa-4708-ae36-10c53a411a40 while it is in vm_state suspended Oct 04 18:57:51.272301 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-1b9b47d8-9da8-49cd-a48d-4bf599d76636 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Request method failure captured: Oct 04 18:57:51.272301 n-d-851028-13 devstack@n-api.service[123596]: request: POST /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40/action HTTP/1.1 Oct 04 18:57:51.272301 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:57:51.272301 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:57:51.272301 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:57:51.272301 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 15 Oct 04 18:57:51.272301 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:57:51.272301 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:57:51.272301 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:57:51.272301 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:57:51.272301 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPIEZsAoFcr6P1AMHBWUo8LvryOn1l2-LYSKr4xgLCvHblWFuAiGVlStWcljkgzOc7-ldx7qv3C-2jYmQ32_Zk5yP28dI64Re9CsyHCLmsYfyJdD0-2_kU92lHK36Fs8oXqXU2FijNX-X4IYqe4GjOQDN7LB9zCeEIcrxQ2LRJFOwbQY Oct 04 18:57:51.272301 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:57:51.272301 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:57:51.272301 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:57:51.272301 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:57:51.272301 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:57:51.272301 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:57:51.272301 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: 1607b30b9f324abaa88aa29e04ef3ec4 Oct 04 18:57:51.272301 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-ServersNegativeTestJSON-708693932 Oct 04 18:57:51.272301 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 18:57:51.272301 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 18:57:51.272301 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/1607b30b9f324abaa88aa29e04ef3ec4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_1607b30b9f324abaa88aa29e04ef3ec4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1607b30b9f324abaa88aa29e04ef3ec4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1607b30b9f324abaa88aa29e04ef3ec4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:57:51.272301 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-ServersNegativeTestJSON-708693932 Oct 04 18:57:51.272301 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: 1607b30b9f324abaa88aa29e04ef3ec4 Oct 04 18:57:51.272301 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-ServersNegativeTestJSON-708693932 Oct 04 18:57:51.272301 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-ServersNegativeTestJSON-708693932-project Oct 04 18:57:51.272301 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:57:51.272301 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:57:51.272301 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 6f63f1ac147543dab34a28a22eb5936c Oct 04 18:57:51.272301 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-ServersNegativeTestJSON-708693932-project Oct 04 18:57:51.272301 n-d-851028-13 devstack@n-api.service[123596]: Oct 04 18:57:51.272301 n-d-851028-13 devstack@n-api.service[123596]: {"suspend": {}} Oct 04 18:57:51.272301 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 18:57:51.272301 n-d-851028-13 devstack@n-api.service[123596]: exception: Cannot 'suspend' instance 01e250ab-d9aa-4708-ae36-10c53a411a40 while it is in vm_state suspended Oct 04 18:57:51.272301 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': '01e250ab-d9aa-4708-ae36-10c53a411a40', 'body': {'suspend': {}}} Oct 04 18:57:51.272301 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:57:51.272301 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:57:51.272301 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 40, in _suspend Oct 04 18:57:51.272301 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi self.compute_api.suspend(context, server) Oct 04 18:57:51.272301 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 04 18:57:51.272301 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 04 18:57:51.272301 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 04 18:57:51.272301 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 18:57:51.272301 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 04 18:57:51.272301 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 04 18:57:51.272301 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 04 18:57:51.272301 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 18:57:51.272301 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 18:57:51.272301 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 18:57:51.272301 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 04 18:57:51.272301 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 04 18:57:51.272301 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 01e250ab-d9aa-4708-ae36-10c53a411a40 in vm_state suspended. Cannot suspend while the instance is in this state. Oct 04 18:57:51.272301 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:57:51.272301 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:57:51.272301 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:57:51.272301 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:57:51.272301 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:57:51.272301 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:57:51.272301 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:57:51.272301 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:57:51.272301 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:57:51.272301 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:57:51.272301 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 44, in _suspend Oct 04 18:57:51.272301 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 04 18:57:51.276631 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 04 18:57:51.276631 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 04 18:57:51.276631 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'suspend' instance 01e250ab-d9aa-4708-ae36-10c53a411a40 while it is in vm_state suspended Oct 04 18:57:51.276631 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:57:51.276631 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:57:51.276631 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:57:51.276631 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:57:51.276631 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:57:51.276631 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:57:51.276631 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:57:51.276631 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:57:51.276631 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'suspend' instance 01e250ab-d9aa-4708-ae36-10c53a411a40 while it is in vm_state suspended Oct 04 18:57:51.276631 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:57:51.285289 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-1b9b47d8-9da8-49cd-a48d-4bf599d76636 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Returning 409 to user: Cannot 'suspend' instance 01e250ab-d9aa-4708-ae36-10c53a411a40 while it is in vm_state suspended {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:57:51.288536 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-1b9b47d8-9da8-49cd-a48d-4bf599d76636 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "POST /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40/action" status: 409 len: 148 microversion: 2.1 time: 0.181250 Oct 04 18:57:51.294039 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2720/5118] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 18:57:51 2022] POST /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40/action => generated 148 bytes in 187 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:57:51.308755 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-e8028017-6ffe-415c-9139-7166acb1b104 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:57:51.311592 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-e8028017-6ffe-415c-9139-7166acb1b104 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 01e250ab-d9aa-4708-ae36-10c53a411a40] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:57:51.347674 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e8028017-6ffe-415c-9139-7166acb1b104 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:51.349186 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e8028017-6ffe-415c-9139-7166acb1b104 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:51.350271 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e8028017-6ffe-415c-9139-7166acb1b104 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:51.351543 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e8028017-6ffe-415c-9139-7166acb1b104 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:51.354238 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e8028017-6ffe-415c-9139-7166acb1b104 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:51.358237 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e8028017-6ffe-415c-9139-7166acb1b104 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:51.416906 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-5bdae422-d324-4d96-a90f-c146283492d6 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] HTTP exception thrown: Invalid volume: volume f51eedbf-cd57-46f3-8ee9-010b63718608 is already attached to instances: a45d1b74-2d81-4e11-b837-fe77dc63f689 Oct 04 18:57:51.420065 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-5bdae422-d324-4d96-a90f-c146283492d6 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Request method failure captured: Oct 04 18:57:51.420065 n-d-851028-13 devstack@n-api.service[123595]: request: POST /compute/v2.1/servers/a45d1b74-2d81-4e11-b837-fe77dc63f689/os-volume_attachments HTTP/1.1 Oct 04 18:57:51.420065 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 18:57:51.420065 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 18:57:51.420065 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 18:57:51.420065 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 74 Oct 04 18:57:51.420065 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 18:57:51.420065 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 18:57:51.420065 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 18:57:51.420065 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 18:57:51.420065 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPID78vmCI9IDPSneDizdTNDV6DvHA8Yu-0Hk2AdriQTEcsN9glvSb6qnq0IhhwuZEnTcyOqvR3DmN0AjQb3MXy0KeUN-iyujvPMDrfVKCEbIzKf9nHEoBLFpzOTLVQVrEHVpIwmUAw_LxUeBUjShHQb88Tzo0W7pmPF365n3rwKGYEI Oct 04 18:57:51.420065 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 18:57:51.420065 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 18:57:51.420065 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 18:57:51.420065 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 18:57:51.420065 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 18:57:51.420065 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 18:57:51.420065 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: 6c91c7e7358048ffaaee7f51ad61b515 Oct 04 18:57:51.420065 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-AttachVolumeNegativeTest-2048626205 Oct 04 18:57:51.420065 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 18:57:51.420065 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 18:57:51.420065 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/6c91c7e7358048ffaaee7f51ad61b515"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_6c91c7e7358048ffaaee7f51ad61b515"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/6c91c7e7358048ffaaee7f51ad61b515"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/6c91c7e7358048ffaaee7f51ad61b515"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:57:51.420065 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-AttachVolumeNegativeTest-2048626205 Oct 04 18:57:51.420065 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: 6c91c7e7358048ffaaee7f51ad61b515 Oct 04 18:57:51.420065 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2048626205 Oct 04 18:57:51.420065 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-AttachVolumeNegativeTest-2048626205-project Oct 04 18:57:51.420065 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 18:57:51.420065 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 18:57:51.420065 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: 486c22456b1e47ae843ae41f8dfb2632 Oct 04 18:57:51.420065 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-AttachVolumeNegativeTest-2048626205-project Oct 04 18:57:51.420065 n-d-851028-13 devstack@n-api.service[123595]: Oct 04 18:57:51.420065 n-d-851028-13 devstack@n-api.service[123595]: {"volumeAttachment": {"volumeId": "f51eedbf-cd57-46f3-8ee9-010b63718608"}} Oct 04 18:57:51.420065 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 18:57:51.420065 n-d-851028-13 devstack@n-api.service[123595]: exception: Invalid volume: volume f51eedbf-cd57-46f3-8ee9-010b63718608 is already attached to instances: a45d1b74-2d81-4e11-b837-fe77dc63f689 Oct 04 18:57:51.420065 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'server_id': 'a45d1b74-2d81-4e11-b837-fe77dc63f689', 'body': {'volumeAttachment': {'volumeId': 'f51eedbf-cd57-46f3-8ee9-010b63718608'}}} Oct 04 18:57:51.420065 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:57:51.420065 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:57:51.420065 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 04 18:57:51.420065 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 04 18:57:51.420065 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 18:57:51.420065 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 18:57:51.420065 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 04 18:57:51.420065 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 18:57:51.420065 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 04 18:57:51.420065 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 04 18:57:51.420065 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 04 18:57:51.420065 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 04 18:57:51.420065 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume f51eedbf-cd57-46f3-8ee9-010b63718608 is already attached to instances: a45d1b74-2d81-4e11-b837-fe77dc63f689 Oct 04 18:57:51.420065 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:57:51.420065 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:57:51.420065 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:57:51.420065 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:57:51.420065 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:57:51.420065 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:57:51.420065 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:57:51.420065 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:57:51.420065 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:57:51.420065 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:57:51.420065 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:57:51.420065 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:57:51.420065 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:57:51.420065 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:57:51.423855 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:57:51.423855 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:57:51.423855 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 04 18:57:51.423855 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 04 18:57:51.423855 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume f51eedbf-cd57-46f3-8ee9-010b63718608 is already attached to instances: a45d1b74-2d81-4e11-b837-fe77dc63f689 Oct 04 18:57:51.423855 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:57:51.423855 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:57:51.423855 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:57:51.423855 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:57:51.423855 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:57:51.423855 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:57:51.423855 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:57:51.423855 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:57:51.423855 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume f51eedbf-cd57-46f3-8ee9-010b63718608 is already attached to instances: a45d1b74-2d81-4e11-b837-fe77dc63f689 Oct 04 18:57:51.423855 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:57:51.426806 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-5bdae422-d324-4d96-a90f-c146283492d6 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Returning 400 to user: Invalid volume: volume f51eedbf-cd57-46f3-8ee9-010b63718608 is already attached to instances: a45d1b74-2d81-4e11-b837-fe77dc63f689 {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:57:51.434058 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-5bdae422-d324-4d96-a90f-c146283492d6 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] 10.222.0.43 "POST /compute/v2.1/servers/a45d1b74-2d81-4e11-b837-fe77dc63f689/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.393960 Oct 04 18:57:51.438418 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2399/5119] 10.222.0.43 () {60 vars in 1323 bytes} [Tue Oct 4 18:57:51 2022] POST /compute/v2.1/servers/a45d1b74-2d81-4e11-b837-fe77dc63f689/os-volume_attachments => generated 174 bytes in 403 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:57:51.454656 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-b8e2123a-a887-4ec3-a3ec-bc45eadff4c5 req-22c25489-5d3f-4e55-8f1d-eabecbd19646 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f51ca9f8-1cc6-4972-882e-34937122d5e4", "tag": "1186a04d-7d24-44cb-8f63-e45471612dbb"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:57:51.499155 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-b8e2123a-a887-4ec3-a3ec-bc45eadff4c5 req-22c25489-5d3f-4e55-8f1d-eabecbd19646 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:51.501065 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-b8e2123a-a887-4ec3-a3ec-bc45eadff4c5 req-22c25489-5d3f-4e55-8f1d-eabecbd19646 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:51.502780 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-b8e2123a-a887-4ec3-a3ec-bc45eadff4c5 req-22c25489-5d3f-4e55-8f1d-eabecbd19646 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:51.564492 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-b8e2123a-a887-4ec3-a3ec-bc45eadff4c5 req-22c25489-5d3f-4e55-8f1d-eabecbd19646 service nova] Creating event network-changed:1186a04d-7d24-44cb-8f63-e45471612dbb for instance f51ca9f8-1cc6-4972-882e-34937122d5e4 on n-h1-851028-13 Oct 04 18:57:51.574009 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-b8e2123a-a887-4ec3-a3ec-bc45eadff4c5 req-22c25489-5d3f-4e55-8f1d-eabecbd19646 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.132525 Oct 04 18:57:51.576973 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2400/5120] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:57:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:57:51.637810 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-e8028017-6ffe-415c-9139-7166acb1b104 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "POST /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40/action" status: 202 len: 0 microversion: 2.1 time: 0.335872 Oct 04 18:57:51.640768 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2721/5121] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 18:57:51 2022] POST /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40/action => generated 0 bytes in 342 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:57:51.666450 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-c5eccc14-cdab-40c1-bc98-66d0ea55be60 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:57:51.671025 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-c5eccc14-cdab-40c1-bc98-66d0ea55be60 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] [instance: a45d1b74-2d81-4e11-b837-fe77dc63f689] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:57:51.684280 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-7f2d31a2-f852-48d7-ae03-79e3e8865b4c tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:57:51.685725 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-7f2d31a2-f852-48d7-ae03-79e3e8865b4c tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 01e250ab-d9aa-4708-ae36-10c53a411a40] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:57:51.692710 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7f2d31a2-f852-48d7-ae03-79e3e8865b4c tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:51.701297 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7f2d31a2-f852-48d7-ae03-79e3e8865b4c tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:51.701297 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7f2d31a2-f852-48d7-ae03-79e3e8865b4c tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:51.701297 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7f2d31a2-f852-48d7-ae03-79e3e8865b4c tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:51.701297 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7f2d31a2-f852-48d7-ae03-79e3e8865b4c tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:51.701297 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7f2d31a2-f852-48d7-ae03-79e3e8865b4c tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:51.701913 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c5eccc14-cdab-40c1-bc98-66d0ea55be60 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:51.701913 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c5eccc14-cdab-40c1-bc98-66d0ea55be60 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:51.701913 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c5eccc14-cdab-40c1-bc98-66d0ea55be60 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:51.709857 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c5eccc14-cdab-40c1-bc98-66d0ea55be60 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:51.711275 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c5eccc14-cdab-40c1-bc98-66d0ea55be60 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:51.714915 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c5eccc14-cdab-40c1-bc98-66d0ea55be60 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:51.943481 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.objects.instance [None req-c5eccc14-cdab-40c1-bc98-66d0ea55be60 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lazy-loading 'services' on Instance uuid a45d1b74-2d81-4e11-b837-fe77dc63f689 {{(pid=123595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:57:52.121004 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-c5eccc14-cdab-40c1-bc98-66d0ea55be60 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] 10.222.0.43 "DELETE /compute/v2.1/servers/a45d1b74-2d81-4e11-b837-fe77dc63f689/os-volume_attachments/f51eedbf-cd57-46f3-8ee9-010b63718608" status: 202 len: 0 microversion: 2.1 time: 0.461649 Oct 04 18:57:52.123284 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2401/5122] 10.222.0.43 () {58 vars in 1416 bytes} [Tue Oct 4 18:57:51 2022] DELETE /compute/v2.1/servers/a45d1b74-2d81-4e11-b837-fe77dc63f689/os-volume_attachments/f51eedbf-cd57-46f3-8ee9-010b63718608 => generated 0 bytes in 469 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 18:57:52.134714 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-2868a518-e80c-4936-a639-747d0472efeb tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:57:52.136136 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-2868a518-e80c-4936-a639-747d0472efeb tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] [instance: f51ca9f8-1cc6-4972-882e-34937122d5e4] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:57:52.148823 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2868a518-e80c-4936-a639-747d0472efeb tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:52.149450 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2868a518-e80c-4936-a639-747d0472efeb tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:52.149909 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2868a518-e80c-4936-a639-747d0472efeb tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:52.150702 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2868a518-e80c-4936-a639-747d0472efeb tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:52.151272 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2868a518-e80c-4936-a639-747d0472efeb tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:52.175447 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2868a518-e80c-4936-a639-747d0472efeb tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:52.503131 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-7f2d31a2-f852-48d7-ae03-79e3e8865b4c tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f63f1ac147543dab34a28a22eb5936c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1607b30b9f324abaa88aa29e04ef3ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:57:52.523854 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-7f2d31a2-f852-48d7-ae03-79e3e8865b4c tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40" status: 200 len: 1502 microversion: 2.1 time: 0.857202 Oct 04 18:57:52.524952 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2722/5123] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:57:51 2022] GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40 => generated 1502 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:57:52.535154 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-4d2833ec-e760-4407-b51d-4d53517e2895 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:57:52.538751 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-4d2833ec-e760-4407-b51d-4d53517e2895 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] [instance: a45d1b74-2d81-4e11-b837-fe77dc63f689] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:57:52.554752 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4d2833ec-e760-4407-b51d-4d53517e2895 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:52.556462 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4d2833ec-e760-4407-b51d-4d53517e2895 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:52.561487 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4d2833ec-e760-4407-b51d-4d53517e2895 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:52.562472 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4d2833ec-e760-4407-b51d-4d53517e2895 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:52.563096 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4d2833ec-e760-4407-b51d-4d53517e2895 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:52.563674 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4d2833ec-e760-4407-b51d-4d53517e2895 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:52.657629 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-4d2833ec-e760-4407-b51d-4d53517e2895 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] 10.222.0.43 "GET /compute/v2.1/servers/a45d1b74-2d81-4e11-b837-fe77dc63f689/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.128306 Oct 04 18:57:52.658370 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2723/5124] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Oct 4 18:57:52 2022] GET /compute/v2.1/servers/a45d1b74-2d81-4e11-b837-fe77dc63f689/os-volume_attachments => generated 197 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:57:52.764159 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-2868a518-e80c-4936-a639-747d0472efeb tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da3b918706c14020910d5d0e97d96656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9330711915a4b7f9d0f3559f0f19083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:57:52.776212 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-2868a518-e80c-4936-a639-747d0472efeb tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] 10.222.0.43 "GET /compute/v2.1/servers/f51ca9f8-1cc6-4972-882e-34937122d5e4" status: 200 len: 1355 microversion: 2.1 time: 0.651151 Oct 04 18:57:52.776848 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2402/5125] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:57:52 2022] GET /compute/v2.1/servers/f51ca9f8-1cc6-4972-882e-34937122d5e4 => generated 1355 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:57:53.558049 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-5ac69736-0a10-4ffb-97af-06a0e0ce0363 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:57:53.558705 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-5ac69736-0a10-4ffb-97af-06a0e0ce0363 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 01e250ab-d9aa-4708-ae36-10c53a411a40] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:57:53.576793 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5ac69736-0a10-4ffb-97af-06a0e0ce0363 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:53.577539 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5ac69736-0a10-4ffb-97af-06a0e0ce0363 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:53.578130 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5ac69736-0a10-4ffb-97af-06a0e0ce0363 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:53.581250 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5ac69736-0a10-4ffb-97af-06a0e0ce0363 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:53.582013 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5ac69736-0a10-4ffb-97af-06a0e0ce0363 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:53.582999 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5ac69736-0a10-4ffb-97af-06a0e0ce0363 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:53.672218 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-84f4c961-aaf5-4625-8d09-3afe0e1fe33e tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:57:53.675235 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-84f4c961-aaf5-4625-8d09-3afe0e1fe33e tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] [instance: a45d1b74-2d81-4e11-b837-fe77dc63f689] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:57:53.697856 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-84f4c961-aaf5-4625-8d09-3afe0e1fe33e tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:53.700329 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-84f4c961-aaf5-4625-8d09-3afe0e1fe33e tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:53.702582 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-84f4c961-aaf5-4625-8d09-3afe0e1fe33e tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:53.711013 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-84f4c961-aaf5-4625-8d09-3afe0e1fe33e tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:53.713213 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-84f4c961-aaf5-4625-8d09-3afe0e1fe33e tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:53.715966 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-84f4c961-aaf5-4625-8d09-3afe0e1fe33e tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:53.833262 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-84f4c961-aaf5-4625-8d09-3afe0e1fe33e tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] 10.222.0.43 "GET /compute/v2.1/servers/a45d1b74-2d81-4e11-b837-fe77dc63f689/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.155836 Oct 04 18:57:53.834722 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2403/5126] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Oct 4 18:57:53 2022] GET /compute/v2.1/servers/a45d1b74-2d81-4e11-b837-fe77dc63f689/os-volume_attachments => generated 197 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:57:53.842740 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-deebc69f-cd11-4cd3-ad66-7be1b0bc32f4 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:57:53.843688 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-deebc69f-cd11-4cd3-ad66-7be1b0bc32f4 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] [instance: f51ca9f8-1cc6-4972-882e-34937122d5e4] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:57:53.858901 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-deebc69f-cd11-4cd3-ad66-7be1b0bc32f4 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:53.860978 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-deebc69f-cd11-4cd3-ad66-7be1b0bc32f4 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:53.861678 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-deebc69f-cd11-4cd3-ad66-7be1b0bc32f4 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:53.862656 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-deebc69f-cd11-4cd3-ad66-7be1b0bc32f4 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:53.869461 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-deebc69f-cd11-4cd3-ad66-7be1b0bc32f4 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:53.870307 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-deebc69f-cd11-4cd3-ad66-7be1b0bc32f4 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:53.941457 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-5ac69736-0a10-4ffb-97af-06a0e0ce0363 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f63f1ac147543dab34a28a22eb5936c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1607b30b9f324abaa88aa29e04ef3ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:57:53.953535 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-5ac69736-0a10-4ffb-97af-06a0e0ce0363 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40" status: 200 len: 1502 microversion: 2.1 time: 0.402560 Oct 04 18:57:53.955784 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2724/5127] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:57:53 2022] GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40 => generated 1502 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:57:53.966477 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-3f600e78-216e-494e-b987-1cba2ffa96da req-09a78600-5997-49fe-b63a-b0acdf6b9ea3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f51ca9f8-1cc6-4972-882e-34937122d5e4", "tag": "242eef97-7324-4879-9d7a-cda5914dde92"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:57:54.017395 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-3f600e78-216e-494e-b987-1cba2ffa96da req-09a78600-5997-49fe-b63a-b0acdf6b9ea3 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:54.017998 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-3f600e78-216e-494e-b987-1cba2ffa96da req-09a78600-5997-49fe-b63a-b0acdf6b9ea3 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:54.018470 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-3f600e78-216e-494e-b987-1cba2ffa96da req-09a78600-5997-49fe-b63a-b0acdf6b9ea3 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:54.049714 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-3f600e78-216e-494e-b987-1cba2ffa96da req-09a78600-5997-49fe-b63a-b0acdf6b9ea3 service nova] Creating event network-changed:242eef97-7324-4879-9d7a-cda5914dde92 for instance f51ca9f8-1cc6-4972-882e-34937122d5e4 on n-h1-851028-13 Oct 04 18:57:54.062474 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-3f600e78-216e-494e-b987-1cba2ffa96da req-09a78600-5997-49fe-b63a-b0acdf6b9ea3 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104114 Oct 04 18:57:54.064575 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2725/5128] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:57:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:57:54.724353 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-deebc69f-cd11-4cd3-ad66-7be1b0bc32f4 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da3b918706c14020910d5d0e97d96656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9330711915a4b7f9d0f3559f0f19083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:57:54.755928 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-deebc69f-cd11-4cd3-ad66-7be1b0bc32f4 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] 10.222.0.43 "GET /compute/v2.1/servers/f51ca9f8-1cc6-4972-882e-34937122d5e4" status: 200 len: 1355 microversion: 2.1 time: 0.919407 Oct 04 18:57:54.756959 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2404/5129] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:57:53 2022] GET /compute/v2.1/servers/f51ca9f8-1cc6-4972-882e-34937122d5e4 => generated 1355 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:57:54.849819 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-ad95a0ec-2ba2-4b8e-b491-0d407eaa4c40 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:57:54.852334 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-ad95a0ec-2ba2-4b8e-b491-0d407eaa4c40 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] [instance: a45d1b74-2d81-4e11-b837-fe77dc63f689] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:57:54.869634 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ad95a0ec-2ba2-4b8e-b491-0d407eaa4c40 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:54.870614 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ad95a0ec-2ba2-4b8e-b491-0d407eaa4c40 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:54.872170 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ad95a0ec-2ba2-4b8e-b491-0d407eaa4c40 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:54.875898 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ad95a0ec-2ba2-4b8e-b491-0d407eaa4c40 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:54.876859 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ad95a0ec-2ba2-4b8e-b491-0d407eaa4c40 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:54.878241 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ad95a0ec-2ba2-4b8e-b491-0d407eaa4c40 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:54.961808 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-ad95a0ec-2ba2-4b8e-b491-0d407eaa4c40 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] 10.222.0.43 "GET /compute/v2.1/servers/a45d1b74-2d81-4e11-b837-fe77dc63f689/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.118784 Oct 04 18:57:54.965803 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2726/5130] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Oct 4 18:57:54 2022] GET /compute/v2.1/servers/a45d1b74-2d81-4e11-b837-fe77dc63f689/os-volume_attachments => generated 197 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:57:54.980503 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-fe594956-ca9c-481f-97a0-f84501157735 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:57:54.984115 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-fe594956-ca9c-481f-97a0-f84501157735 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 01e250ab-d9aa-4708-ae36-10c53a411a40] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:57:55.011395 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fe594956-ca9c-481f-97a0-f84501157735 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:55.011935 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fe594956-ca9c-481f-97a0-f84501157735 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:55.012393 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fe594956-ca9c-481f-97a0-f84501157735 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:55.017543 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fe594956-ca9c-481f-97a0-f84501157735 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:55.018454 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fe594956-ca9c-481f-97a0-f84501157735 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:55.019072 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fe594956-ca9c-481f-97a0-f84501157735 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:55.657216 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-fe594956-ca9c-481f-97a0-f84501157735 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f63f1ac147543dab34a28a22eb5936c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1607b30b9f324abaa88aa29e04ef3ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:57:55.664017 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:57:55.681659 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-fe594956-ca9c-481f-97a0-f84501157735 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40" status: 200 len: 1505 microversion: 2.1 time: 0.708744 Oct 04 18:57:55.686371 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2405/5131] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:57:54 2022] GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40 => generated 1505 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:57:55.709591 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-d791867b-ee9f-4a6f-8d8d-49c056091ffd tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:57:55.710214 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-d791867b-ee9f-4a6f-8d8d-49c056091ffd tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 01e250ab-d9aa-4708-ae36-10c53a411a40] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:57:55.717503 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d791867b-ee9f-4a6f-8d8d-49c056091ffd tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:55.718010 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d791867b-ee9f-4a6f-8d8d-49c056091ffd tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:55.718458 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d791867b-ee9f-4a6f-8d8d-49c056091ffd tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:55.719176 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d791867b-ee9f-4a6f-8d8d-49c056091ffd tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:55.719637 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d791867b-ee9f-4a6f-8d8d-49c056091ffd tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:55.720068 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d791867b-ee9f-4a6f-8d8d-49c056091ffd tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:55.804698 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-e965efbd-1415-456b-94f5-7064817f8c0c tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:57:55.805357 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-e965efbd-1415-456b-94f5-7064817f8c0c tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] [instance: f51ca9f8-1cc6-4972-882e-34937122d5e4] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:57:55.815494 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e965efbd-1415-456b-94f5-7064817f8c0c tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:55.816225 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e965efbd-1415-456b-94f5-7064817f8c0c tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:55.816818 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e965efbd-1415-456b-94f5-7064817f8c0c tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:55.817709 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e965efbd-1415-456b-94f5-7064817f8c0c tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:55.818318 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e965efbd-1415-456b-94f5-7064817f8c0c tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:55.818900 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e965efbd-1415-456b-94f5-7064817f8c0c tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:56.113241 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-d791867b-ee9f-4a6f-8d8d-49c056091ffd tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f63f1ac147543dab34a28a22eb5936c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1607b30b9f324abaa88aa29e04ef3ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:57:56.129758 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-d791867b-ee9f-4a6f-8d8d-49c056091ffd tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40" status: 200 len: 1505 microversion: 2.1 time: 0.422511 Oct 04 18:57:56.135906 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2727/5132] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:57:55 2022] GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40 => generated 1505 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:57:56.148986 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-d434c0f0-2db0-46a1-98fb-43ebd7475bfe tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:57:56.156890 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-d434c0f0-2db0-46a1-98fb-43ebd7475bfe tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] [instance: a45d1b74-2d81-4e11-b837-fe77dc63f689] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:57:56.173009 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d434c0f0-2db0-46a1-98fb-43ebd7475bfe tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:56.173873 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d434c0f0-2db0-46a1-98fb-43ebd7475bfe tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:56.176791 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d434c0f0-2db0-46a1-98fb-43ebd7475bfe tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:56.179694 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d434c0f0-2db0-46a1-98fb-43ebd7475bfe tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:56.180930 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d434c0f0-2db0-46a1-98fb-43ebd7475bfe tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:56.183236 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d434c0f0-2db0-46a1-98fb-43ebd7475bfe tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:56.239401 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-d434c0f0-2db0-46a1-98fb-43ebd7475bfe tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] 10.222.0.43 "GET /compute/v2.1/servers/a45d1b74-2d81-4e11-b837-fe77dc63f689/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.100181 Oct 04 18:57:56.245622 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2728/5133] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Oct 4 18:57:56 2022] GET /compute/v2.1/servers/a45d1b74-2d81-4e11-b837-fe77dc63f689/os-volume_attachments => generated 197 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:57:56.251834 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-87d330ca-6e3d-43a3-bbbf-d5dc59aff37e tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:57:56.252847 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-87d330ca-6e3d-43a3-bbbf-d5dc59aff37e tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 565c1c13-19dd-451c-9750-58bb197dae88] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:57:56.260077 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-87d330ca-6e3d-43a3-bbbf-d5dc59aff37e tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] HTTP exception thrown: Instance 565c1c13-19dd-451c-9750-58bb197dae88 could not be found. Oct 04 18:57:56.262587 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-87d330ca-6e3d-43a3-bbbf-d5dc59aff37e tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Request method failure captured: Oct 04 18:57:56.262587 n-d-851028-13 devstack@n-api.service[123596]: request: POST /compute/v2.1/servers/565c1c13-19dd-451c-9750-58bb197dae88/action HTTP/1.1 Oct 04 18:57:56.262587 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:57:56.262587 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:57:56.262587 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:57:56.262587 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 15 Oct 04 18:57:56.262587 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:57:56.262587 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:57:56.262587 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:57:56.262587 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:57:56.262587 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPIEZsAoFcr6P1AMHBWUo8LvryOn1l2-LYSKr4xgLCvHblWFuAiGVlStWcljkgzOc7-ldx7qv3C-2jYmQ32_Zk5yP28dI64Re9CsyHCLmsYfyJdD0-2_kU92lHK36Fs8oXqXU2FijNX-X4IYqe4GjOQDN7LB9zCeEIcrxQ2LRJFOwbQY Oct 04 18:57:56.262587 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:57:56.262587 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:57:56.262587 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:57:56.262587 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:57:56.262587 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:57:56.262587 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:57:56.262587 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: 1607b30b9f324abaa88aa29e04ef3ec4 Oct 04 18:57:56.262587 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-ServersNegativeTestJSON-708693932 Oct 04 18:57:56.262587 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 18:57:56.262587 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 18:57:56.262587 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/1607b30b9f324abaa88aa29e04ef3ec4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_1607b30b9f324abaa88aa29e04ef3ec4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1607b30b9f324abaa88aa29e04ef3ec4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1607b30b9f324abaa88aa29e04ef3ec4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:57:56.262587 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-ServersNegativeTestJSON-708693932 Oct 04 18:57:56.262587 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: 1607b30b9f324abaa88aa29e04ef3ec4 Oct 04 18:57:56.262587 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-ServersNegativeTestJSON-708693932 Oct 04 18:57:56.262587 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-ServersNegativeTestJSON-708693932-project Oct 04 18:57:56.262587 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:57:56.262587 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:57:56.262587 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 6f63f1ac147543dab34a28a22eb5936c Oct 04 18:57:56.262587 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-ServersNegativeTestJSON-708693932-project Oct 04 18:57:56.262587 n-d-851028-13 devstack@n-api.service[123596]: Oct 04 18:57:56.262587 n-d-851028-13 devstack@n-api.service[123596]: {"unpause": {}} Oct 04 18:57:56.262587 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 18:57:56.262587 n-d-851028-13 devstack@n-api.service[123596]: exception: Instance 565c1c13-19dd-451c-9750-58bb197dae88 could not be found. Oct 04 18:57:56.262587 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': '565c1c13-19dd-451c-9750-58bb197dae88', 'body': {'unpause': {}}} Oct 04 18:57:56.262587 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:57:56.262587 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:57:56.262587 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:57:56.262587 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:57:56.262587 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:57:56.262587 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:57:56.262587 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 18:57:56.262587 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 18:57:56.262587 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 565c1c13-19dd-451c-9750-58bb197dae88 could not be found. Oct 04 18:57:56.262587 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:57:56.262587 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:57:56.262587 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:57:56.262587 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:57:56.262587 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:57:56.262587 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:57:56.262587 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:57:56.262587 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:57:56.262587 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:57:56.262587 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:57:56.262587 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 58, in _unpause Oct 04 18:57:56.262587 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Oct 04 18:57:56.262587 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:57:56.262587 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:57:56.262587 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 565c1c13-19dd-451c-9750-58bb197dae88 could not be found. Oct 04 18:57:56.262587 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:57:56.262587 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:57:56.262587 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:57:56.262587 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:57:56.262587 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:57:56.262587 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:57:56.265825 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:57:56.265825 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:57:56.265825 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 565c1c13-19dd-451c-9750-58bb197dae88 could not be found. Oct 04 18:57:56.265825 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:57:56.267765 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-87d330ca-6e3d-43a3-bbbf-d5dc59aff37e tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Returning 404 to user: Instance 565c1c13-19dd-451c-9750-58bb197dae88 could not be found. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:57:56.268870 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-87d330ca-6e3d-43a3-bbbf-d5dc59aff37e tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "POST /compute/v2.1/servers/565c1c13-19dd-451c-9750-58bb197dae88/action" status: 404 len: 111 microversion: 2.1 time: 0.021835 Oct 04 18:57:56.269792 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2729/5134] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 18:57:56 2022] POST /compute/v2.1/servers/565c1c13-19dd-451c-9750-58bb197dae88/action => generated 111 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:57:56.299224 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-373d18f0-081a-4b50-bd54-cd709a0cc8ec tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:57:56.299871 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-373d18f0-081a-4b50-bd54-cd709a0cc8ec tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 01e250ab-d9aa-4708-ae36-10c53a411a40] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:57:56.322798 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-373d18f0-081a-4b50-bd54-cd709a0cc8ec tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:56.326786 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-373d18f0-081a-4b50-bd54-cd709a0cc8ec tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:56.329996 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-373d18f0-081a-4b50-bd54-cd709a0cc8ec tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:56.332590 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-373d18f0-081a-4b50-bd54-cd709a0cc8ec tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:56.335000 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-373d18f0-081a-4b50-bd54-cd709a0cc8ec tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:56.336176 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-373d18f0-081a-4b50-bd54-cd709a0cc8ec tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:56.739729 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-373d18f0-081a-4b50-bd54-cd709a0cc8ec tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f63f1ac147543dab34a28a22eb5936c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1607b30b9f324abaa88aa29e04ef3ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:57:56.786026 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-373d18f0-081a-4b50-bd54-cd709a0cc8ec tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40" status: 200 len: 1505 microversion: 2.1 time: 0.500375 Oct 04 18:57:56.792429 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2730/5135] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:57:56 2022] GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40 => generated 1505 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:57:56.813149 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-335e3be8-c5ea-41a7-b7ab-11c746d0ae0c tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:57:56.813849 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-335e3be8-c5ea-41a7-b7ab-11c746d0ae0c tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 01e250ab-d9aa-4708-ae36-10c53a411a40] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:57:56.845792 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-335e3be8-c5ea-41a7-b7ab-11c746d0ae0c tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:56.847441 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-335e3be8-c5ea-41a7-b7ab-11c746d0ae0c tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:56.848276 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-335e3be8-c5ea-41a7-b7ab-11c746d0ae0c tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:56.849368 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-335e3be8-c5ea-41a7-b7ab-11c746d0ae0c tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:56.850078 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-335e3be8-c5ea-41a7-b7ab-11c746d0ae0c tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:56.850724 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-335e3be8-c5ea-41a7-b7ab-11c746d0ae0c tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:56.975310 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-e965efbd-1415-456b-94f5-7064817f8c0c tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da3b918706c14020910d5d0e97d96656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9330711915a4b7f9d0f3559f0f19083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:57:57.013509 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-e965efbd-1415-456b-94f5-7064817f8c0c tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] 10.222.0.43 "GET /compute/v2.1/servers/f51ca9f8-1cc6-4972-882e-34937122d5e4" status: 200 len: 1355 microversion: 2.1 time: 1.215096 Oct 04 18:57:57.023562 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2406/5136] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:57:55 2022] GET /compute/v2.1/servers/f51ca9f8-1cc6-4972-882e-34937122d5e4 => generated 1355 bytes in 1226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:57:57.254269 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-3a0334ad-c6e2-4bb1-aac4-b3fe3cf9fba3 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:57:57.256777 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-3a0334ad-c6e2-4bb1-aac4-b3fe3cf9fba3 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] [instance: a45d1b74-2d81-4e11-b837-fe77dc63f689] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:57:57.271993 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3a0334ad-c6e2-4bb1-aac4-b3fe3cf9fba3 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:57.272962 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3a0334ad-c6e2-4bb1-aac4-b3fe3cf9fba3 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:57.274723 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3a0334ad-c6e2-4bb1-aac4-b3fe3cf9fba3 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:57.275631 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3a0334ad-c6e2-4bb1-aac4-b3fe3cf9fba3 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:57.277963 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3a0334ad-c6e2-4bb1-aac4-b3fe3cf9fba3 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:57.278578 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3a0334ad-c6e2-4bb1-aac4-b3fe3cf9fba3 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:57.321016 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-335e3be8-c5ea-41a7-b7ab-11c746d0ae0c tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f63f1ac147543dab34a28a22eb5936c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1607b30b9f324abaa88aa29e04ef3ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:57:57.330560 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-335e3be8-c5ea-41a7-b7ab-11c746d0ae0c tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40" status: 200 len: 1505 microversion: 2.1 time: 0.524927 Oct 04 18:57:57.333683 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2731/5137] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:57:56 2022] GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40 => generated 1505 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:57:57.361320 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-89483f28-3eab-488f-8561-d6e1150b8da6 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:57:57.361479 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-3a0334ad-c6e2-4bb1-aac4-b3fe3cf9fba3 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] 10.222.0.43 "GET /compute/v2.1/servers/a45d1b74-2d81-4e11-b837-fe77dc63f689/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.112410 Oct 04 18:57:57.361892 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2407/5138] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Oct 4 18:57:57 2022] GET /compute/v2.1/servers/a45d1b74-2d81-4e11-b837-fe77dc63f689/os-volume_attachments => generated 197 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:57:57.366743 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-89483f28-3eab-488f-8561-d6e1150b8da6 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 01e250ab-d9aa-4708-ae36-10c53a411a40] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:57:57.380659 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-89483f28-3eab-488f-8561-d6e1150b8da6 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:57.381384 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-89483f28-3eab-488f-8561-d6e1150b8da6 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:57.382157 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-89483f28-3eab-488f-8561-d6e1150b8da6 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:57.387227 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-89483f28-3eab-488f-8561-d6e1150b8da6 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:57.388063 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-89483f28-3eab-488f-8561-d6e1150b8da6 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:57.388722 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-89483f28-3eab-488f-8561-d6e1150b8da6 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:57.472529 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-89483f28-3eab-488f-8561-d6e1150b8da6 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] HTTP exception thrown: Cannot 'unpause' instance 01e250ab-d9aa-4708-ae36-10c53a411a40 while it is in vm_state active Oct 04 18:57:57.480655 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-89483f28-3eab-488f-8561-d6e1150b8da6 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Request method failure captured: Oct 04 18:57:57.480655 n-d-851028-13 devstack@n-api.service[123596]: request: POST /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40/action HTTP/1.1 Oct 04 18:57:57.480655 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:57:57.480655 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:57:57.480655 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:57:57.480655 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 15 Oct 04 18:57:57.480655 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:57:57.480655 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:57:57.480655 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:57:57.480655 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:57:57.480655 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPIEZsAoFcr6P1AMHBWUo8LvryOn1l2-LYSKr4xgLCvHblWFuAiGVlStWcljkgzOc7-ldx7qv3C-2jYmQ32_Zk5yP28dI64Re9CsyHCLmsYfyJdD0-2_kU92lHK36Fs8oXqXU2FijNX-X4IYqe4GjOQDN7LB9zCeEIcrxQ2LRJFOwbQY Oct 04 18:57:57.480655 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:57:57.480655 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:57:57.480655 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:57:57.480655 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:57:57.480655 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:57:57.480655 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:57:57.480655 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: 1607b30b9f324abaa88aa29e04ef3ec4 Oct 04 18:57:57.480655 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-ServersNegativeTestJSON-708693932 Oct 04 18:57:57.480655 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 18:57:57.480655 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 18:57:57.480655 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/1607b30b9f324abaa88aa29e04ef3ec4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_1607b30b9f324abaa88aa29e04ef3ec4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1607b30b9f324abaa88aa29e04ef3ec4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1607b30b9f324abaa88aa29e04ef3ec4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:57:57.480655 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-ServersNegativeTestJSON-708693932 Oct 04 18:57:57.480655 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: 1607b30b9f324abaa88aa29e04ef3ec4 Oct 04 18:57:57.480655 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-ServersNegativeTestJSON-708693932 Oct 04 18:57:57.480655 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-ServersNegativeTestJSON-708693932-project Oct 04 18:57:57.480655 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:57:57.480655 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:57:57.480655 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 6f63f1ac147543dab34a28a22eb5936c Oct 04 18:57:57.480655 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-ServersNegativeTestJSON-708693932-project Oct 04 18:57:57.480655 n-d-851028-13 devstack@n-api.service[123596]: Oct 04 18:57:57.480655 n-d-851028-13 devstack@n-api.service[123596]: {"unpause": {}} Oct 04 18:57:57.480655 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 18:57:57.480655 n-d-851028-13 devstack@n-api.service[123596]: exception: Cannot 'unpause' instance 01e250ab-d9aa-4708-ae36-10c53a411a40 while it is in vm_state active Oct 04 18:57:57.480655 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': '01e250ab-d9aa-4708-ae36-10c53a411a40', 'body': {'unpause': {}}} Oct 04 18:57:57.480655 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:57:57.480655 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:57:57.480655 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 62, in _unpause Oct 04 18:57:57.480655 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi self.compute_api.unpause(ctxt, server) Oct 04 18:57:57.480655 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 18:57:57.480655 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 18:57:57.480655 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 04 18:57:57.480655 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 04 18:57:57.480655 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 01e250ab-d9aa-4708-ae36-10c53a411a40 in vm_state active. Cannot unpause while the instance is in this state. Oct 04 18:57:57.480655 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:57:57.480655 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:57:57.480655 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:57:57.480655 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:57:57.480655 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:57:57.480655 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:57:57.480655 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:57:57.480655 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:57:57.480655 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:57:57.480655 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:57:57.480655 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 66, in _unpause Oct 04 18:57:57.480655 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 04 18:57:57.480655 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 04 18:57:57.480655 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 04 18:57:57.480655 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unpause' instance 01e250ab-d9aa-4708-ae36-10c53a411a40 while it is in vm_state active Oct 04 18:57:57.480655 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:57:57.480655 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:57:57.480655 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:57:57.480655 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:57:57.480655 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:57:57.483800 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:57:57.483800 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:57:57.483800 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:57:57.483800 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unpause' instance 01e250ab-d9aa-4708-ae36-10c53a411a40 while it is in vm_state active Oct 04 18:57:57.483800 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:57:57.490860 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-89483f28-3eab-488f-8561-d6e1150b8da6 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Returning 409 to user: Cannot 'unpause' instance 01e250ab-d9aa-4708-ae36-10c53a411a40 while it is in vm_state active {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:57:57.493238 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-89483f28-3eab-488f-8561-d6e1150b8da6 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "POST /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40/action" status: 409 len: 145 microversion: 2.1 time: 0.136293 Oct 04 18:57:57.499982 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2732/5139] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 18:57:57 2022] POST /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40/action => generated 145 bytes in 143 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:57:57.504964 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-430a3a5e-780d-4549-9cf7-1636e4721ae8 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:57:57.505660 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-430a3a5e-780d-4549-9cf7-1636e4721ae8 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 01e250ab-d9aa-4708-ae36-10c53a411a40] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:57:57.518907 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-430a3a5e-780d-4549-9cf7-1636e4721ae8 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:57.519509 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-430a3a5e-780d-4549-9cf7-1636e4721ae8 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:57.520004 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-430a3a5e-780d-4549-9cf7-1636e4721ae8 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:57.521227 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-430a3a5e-780d-4549-9cf7-1636e4721ae8 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:57.523326 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-430a3a5e-780d-4549-9cf7-1636e4721ae8 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:57.523819 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-430a3a5e-780d-4549-9cf7-1636e4721ae8 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:58.025484 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-430a3a5e-780d-4549-9cf7-1636e4721ae8 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f63f1ac147543dab34a28a22eb5936c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1607b30b9f324abaa88aa29e04ef3ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:57:58.047375 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-2c81f63d-9952-4868-8da6-272f49ac1783 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:57:58.048241 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-2c81f63d-9952-4868-8da6-272f49ac1783 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] [instance: f51ca9f8-1cc6-4972-882e-34937122d5e4] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:57:58.061352 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-430a3a5e-780d-4549-9cf7-1636e4721ae8 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40" status: 200 len: 1505 microversion: 2.1 time: 0.546191 Oct 04 18:57:58.064496 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2408/5140] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:57:57 2022] GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40 => generated 1505 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:57:58.078763 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2c81f63d-9952-4868-8da6-272f49ac1783 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:58.079281 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2c81f63d-9952-4868-8da6-272f49ac1783 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:58.079758 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2c81f63d-9952-4868-8da6-272f49ac1783 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:58.086365 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2c81f63d-9952-4868-8da6-272f49ac1783 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:58.087643 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2c81f63d-9952-4868-8da6-272f49ac1783 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:58.088284 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2c81f63d-9952-4868-8da6-272f49ac1783 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:58.092646 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-2fd86056-8959-4d4a-9046-937261874e92 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:57:58.095299 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-2fd86056-8959-4d4a-9046-937261874e92 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 01e250ab-d9aa-4708-ae36-10c53a411a40] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:57:58.114789 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2fd86056-8959-4d4a-9046-937261874e92 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:58.117613 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2fd86056-8959-4d4a-9046-937261874e92 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:58.121498 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2fd86056-8959-4d4a-9046-937261874e92 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:58.122531 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2fd86056-8959-4d4a-9046-937261874e92 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:58.126336 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2fd86056-8959-4d4a-9046-937261874e92 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:58.128520 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2fd86056-8959-4d4a-9046-937261874e92 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:58.624667 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-2c81f63d-9952-4868-8da6-272f49ac1783 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da3b918706c14020910d5d0e97d96656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9330711915a4b7f9d0f3559f0f19083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:57:58.641255 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-2c81f63d-9952-4868-8da6-272f49ac1783 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] 10.222.0.43 "GET /compute/v2.1/servers/f51ca9f8-1cc6-4972-882e-34937122d5e4" status: 200 len: 1355 microversion: 2.1 time: 0.597902 Oct 04 18:57:58.642395 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2733/5141] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:57:58 2022] GET /compute/v2.1/servers/f51ca9f8-1cc6-4972-882e-34937122d5e4 => generated 1355 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:57:58.664089 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-353c2fd5-77f4-4b24-bbaf-4388d0704a96 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:57:58.666409 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-353c2fd5-77f4-4b24-bbaf-4388d0704a96 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] [instance: a45d1b74-2d81-4e11-b837-fe77dc63f689] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:57:58.682316 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-353c2fd5-77f4-4b24-bbaf-4388d0704a96 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:58.683642 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-353c2fd5-77f4-4b24-bbaf-4388d0704a96 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:58.684276 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-353c2fd5-77f4-4b24-bbaf-4388d0704a96 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:58.688064 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-353c2fd5-77f4-4b24-bbaf-4388d0704a96 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:58.688730 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-353c2fd5-77f4-4b24-bbaf-4388d0704a96 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:58.689352 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-353c2fd5-77f4-4b24-bbaf-4388d0704a96 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:58.786153 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-353c2fd5-77f4-4b24-bbaf-4388d0704a96 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] 10.222.0.43 "GET /compute/v2.1/servers/a45d1b74-2d81-4e11-b837-fe77dc63f689/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.136248 Oct 04 18:57:58.787159 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2734/5142] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Oct 4 18:57:58 2022] GET /compute/v2.1/servers/a45d1b74-2d81-4e11-b837-fe77dc63f689/os-volume_attachments => generated 197 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:57:58.880626 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-2fd86056-8959-4d4a-9046-937261874e92 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f63f1ac147543dab34a28a22eb5936c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1607b30b9f324abaa88aa29e04ef3ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:57:58.898246 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-2fd86056-8959-4d4a-9046-937261874e92 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40" status: 200 len: 1505 microversion: 2.1 time: 0.809074 Oct 04 18:57:58.900197 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2409/5143] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:57:58 2022] GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40 => generated 1505 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:57:58.922720 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-446fe63a-6281-4a6c-98c4-90ff766ea4f2 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:57:58.923556 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-446fe63a-6281-4a6c-98c4-90ff766ea4f2 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 419255f9-3bdc-43c1-83a3-db2294d4047e] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:57:58.933939 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-446fe63a-6281-4a6c-98c4-90ff766ea4f2 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] HTTP exception thrown: Instance 419255f9-3bdc-43c1-83a3-db2294d4047e could not be found. Oct 04 18:57:58.940544 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-446fe63a-6281-4a6c-98c4-90ff766ea4f2 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Request method failure captured: Oct 04 18:57:58.940544 n-d-851028-13 devstack@n-api.service[123596]: request: POST /compute/v2.1/servers/419255f9-3bdc-43c1-83a3-db2294d4047e/action HTTP/1.1 Oct 04 18:57:58.940544 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:57:58.940544 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:57:58.940544 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:57:58.940544 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 18 Oct 04 18:57:58.940544 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:57:58.940544 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:57:58.940544 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:57:58.940544 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:57:58.940544 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPIEZsAoFcr6P1AMHBWUo8LvryOn1l2-LYSKr4xgLCvHblWFuAiGVlStWcljkgzOc7-ldx7qv3C-2jYmQ32_Zk5yP28dI64Re9CsyHCLmsYfyJdD0-2_kU92lHK36Fs8oXqXU2FijNX-X4IYqe4GjOQDN7LB9zCeEIcrxQ2LRJFOwbQY Oct 04 18:57:58.940544 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:57:58.940544 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:57:58.940544 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:57:58.940544 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:57:58.940544 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:57:58.940544 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:57:58.940544 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: 1607b30b9f324abaa88aa29e04ef3ec4 Oct 04 18:57:58.940544 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-ServersNegativeTestJSON-708693932 Oct 04 18:57:58.940544 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 18:57:58.940544 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 18:57:58.940544 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/1607b30b9f324abaa88aa29e04ef3ec4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_1607b30b9f324abaa88aa29e04ef3ec4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1607b30b9f324abaa88aa29e04ef3ec4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1607b30b9f324abaa88aa29e04ef3ec4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:57:58.940544 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-ServersNegativeTestJSON-708693932 Oct 04 18:57:58.940544 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: 1607b30b9f324abaa88aa29e04ef3ec4 Oct 04 18:57:58.940544 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-ServersNegativeTestJSON-708693932 Oct 04 18:57:58.940544 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-ServersNegativeTestJSON-708693932-project Oct 04 18:57:58.940544 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:57:58.940544 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:57:58.940544 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 6f63f1ac147543dab34a28a22eb5936c Oct 04 18:57:58.940544 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-ServersNegativeTestJSON-708693932-project Oct 04 18:57:58.940544 n-d-851028-13 devstack@n-api.service[123596]: Oct 04 18:57:58.940544 n-d-851028-13 devstack@n-api.service[123596]: {"unshelve": null} Oct 04 18:57:58.940544 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 18:57:58.940544 n-d-851028-13 devstack@n-api.service[123596]: exception: Instance 419255f9-3bdc-43c1-83a3-db2294d4047e could not be found. Oct 04 18:57:58.940544 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': '419255f9-3bdc-43c1-83a3-db2294d4047e', 'body': {'unshelve': None}} Oct 04 18:57:58.940544 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:57:58.940544 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:57:58.940544 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:57:58.940544 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:57:58.940544 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:57:58.940544 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:57:58.940544 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 18:57:58.940544 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 18:57:58.940544 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 419255f9-3bdc-43c1-83a3-db2294d4047e could not be found. Oct 04 18:57:58.940544 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:57:58.940544 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:57:58.940544 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:57:58.940544 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:57:58.940544 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:57:58.940544 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:57:58.940544 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:57:58.940544 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:57:58.940544 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:57:58.940544 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:57:58.940544 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:57:58.940544 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:57:58.940544 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:57:58.940544 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:57:58.940544 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 102, in _unshelve Oct 04 18:57:58.940544 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 04 18:57:58.940544 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:57:58.940544 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:57:58.940544 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 419255f9-3bdc-43c1-83a3-db2294d4047e could not be found. Oct 04 18:57:58.940544 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:57:58.940544 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:57:58.943698 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:57:58.943698 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:57:58.943698 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:57:58.943698 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:57:58.943698 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:57:58.943698 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:57:58.943698 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 419255f9-3bdc-43c1-83a3-db2294d4047e could not be found. Oct 04 18:57:58.943698 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:57:58.946180 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-446fe63a-6281-4a6c-98c4-90ff766ea4f2 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Returning 404 to user: Instance 419255f9-3bdc-43c1-83a3-db2294d4047e could not be found. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:57:58.949604 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-446fe63a-6281-4a6c-98c4-90ff766ea4f2 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "POST /compute/v2.1/servers/419255f9-3bdc-43c1-83a3-db2294d4047e/action" status: 404 len: 111 microversion: 2.1 time: 0.031346 Oct 04 18:57:58.950422 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2735/5144] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 18:57:58 2022] POST /compute/v2.1/servers/419255f9-3bdc-43c1-83a3-db2294d4047e/action => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:57:58.959025 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-1626eeaa-947a-4149-96fe-ad939979f78d tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:57:58.959977 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-1626eeaa-947a-4149-96fe-ad939979f78d tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 01e250ab-d9aa-4708-ae36-10c53a411a40] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:57:58.968612 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1626eeaa-947a-4149-96fe-ad939979f78d tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:58.971884 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1626eeaa-947a-4149-96fe-ad939979f78d tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:58.972594 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1626eeaa-947a-4149-96fe-ad939979f78d tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:58.973573 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1626eeaa-947a-4149-96fe-ad939979f78d tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:58.977874 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1626eeaa-947a-4149-96fe-ad939979f78d tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:58.978589 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1626eeaa-947a-4149-96fe-ad939979f78d tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:59.491702 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-1626eeaa-947a-4149-96fe-ad939979f78d tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f63f1ac147543dab34a28a22eb5936c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1607b30b9f324abaa88aa29e04ef3ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:57:59.506928 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-1626eeaa-947a-4149-96fe-ad939979f78d tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40" status: 200 len: 1505 microversion: 2.1 time: 0.552008 Oct 04 18:57:59.511941 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2410/5145] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:57:58 2022] GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40 => generated 1505 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:57:59.540799 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-5dcd1980-e026-4a25-a822-5a7de07267a1 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:57:59.542951 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-5dcd1980-e026-4a25-a822-5a7de07267a1 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 01e250ab-d9aa-4708-ae36-10c53a411a40] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:57:59.559150 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5dcd1980-e026-4a25-a822-5a7de07267a1 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:59.565069 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5dcd1980-e026-4a25-a822-5a7de07267a1 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:59.565887 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5dcd1980-e026-4a25-a822-5a7de07267a1 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:59.567135 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5dcd1980-e026-4a25-a822-5a7de07267a1 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:59.567870 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5dcd1980-e026-4a25-a822-5a7de07267a1 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:59.568446 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5dcd1980-e026-4a25-a822-5a7de07267a1 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:59.666707 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-59265aea-8530-40f9-8d50-2b65c9269baa tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:57:59.668190 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-59265aea-8530-40f9-8d50-2b65c9269baa tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] [instance: f51ca9f8-1cc6-4972-882e-34937122d5e4] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:57:59.678178 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-59265aea-8530-40f9-8d50-2b65c9269baa tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:59.681754 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-59265aea-8530-40f9-8d50-2b65c9269baa tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:59.682362 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-59265aea-8530-40f9-8d50-2b65c9269baa tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:59.683808 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-59265aea-8530-40f9-8d50-2b65c9269baa tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:59.694073 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-59265aea-8530-40f9-8d50-2b65c9269baa tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:59.695010 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-59265aea-8530-40f9-8d50-2b65c9269baa tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:00.195075 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-5dcd1980-e026-4a25-a822-5a7de07267a1 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f63f1ac147543dab34a28a22eb5936c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1607b30b9f324abaa88aa29e04ef3ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:58:00.215875 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-5dcd1980-e026-4a25-a822-5a7de07267a1 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40" status: 200 len: 1505 microversion: 2.1 time: 0.680103 Oct 04 18:58:00.217430 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2736/5146] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:57:59 2022] GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40 => generated 1505 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:58:00.228683 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-259864f7-22af-4a3d-b571-39fbe2d94c43 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:58:00.237339 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-259864f7-22af-4a3d-b571-39fbe2d94c43 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] [instance: a45d1b74-2d81-4e11-b837-fe77dc63f689] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:58:00.266521 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-259864f7-22af-4a3d-b571-39fbe2d94c43 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:00.273917 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-259864f7-22af-4a3d-b571-39fbe2d94c43 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:00.281330 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-259864f7-22af-4a3d-b571-39fbe2d94c43 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:00.283761 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-259864f7-22af-4a3d-b571-39fbe2d94c43 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:00.286771 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-259864f7-22af-4a3d-b571-39fbe2d94c43 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:00.291660 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-259864f7-22af-4a3d-b571-39fbe2d94c43 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:00.361376 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-259864f7-22af-4a3d-b571-39fbe2d94c43 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] 10.222.0.43 "GET /compute/v2.1/servers/a45d1b74-2d81-4e11-b837-fe77dc63f689/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.142372 Oct 04 18:58:00.366137 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2737/5147] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Oct 4 18:58:00 2022] GET /compute/v2.1/servers/a45d1b74-2d81-4e11-b837-fe77dc63f689/os-volume_attachments => generated 197 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:58:00.382861 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-e94ea700-95b3-473a-af3e-95b834ac1788 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:58:00.384071 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-e94ea700-95b3-473a-af3e-95b834ac1788 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 01e250ab-d9aa-4708-ae36-10c53a411a40] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:58:00.406787 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e94ea700-95b3-473a-af3e-95b834ac1788 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:00.407635 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e94ea700-95b3-473a-af3e-95b834ac1788 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:00.408234 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e94ea700-95b3-473a-af3e-95b834ac1788 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:00.409165 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e94ea700-95b3-473a-af3e-95b834ac1788 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:00.409796 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e94ea700-95b3-473a-af3e-95b834ac1788 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:00.410380 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e94ea700-95b3-473a-af3e-95b834ac1788 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:00.500892 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-e94ea700-95b3-473a-af3e-95b834ac1788 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] HTTP exception thrown: Cannot 'unshelve' instance 01e250ab-d9aa-4708-ae36-10c53a411a40 while it is in vm_state active Oct 04 18:58:00.502895 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-e94ea700-95b3-473a-af3e-95b834ac1788 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Request method failure captured: Oct 04 18:58:00.502895 n-d-851028-13 devstack@n-api.service[123596]: request: POST /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40/action HTTP/1.1 Oct 04 18:58:00.502895 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:58:00.502895 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:58:00.502895 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:58:00.502895 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 18 Oct 04 18:58:00.502895 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:58:00.502895 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:58:00.502895 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:58:00.502895 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:58:00.502895 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPIEZsAoFcr6P1AMHBWUo8LvryOn1l2-LYSKr4xgLCvHblWFuAiGVlStWcljkgzOc7-ldx7qv3C-2jYmQ32_Zk5yP28dI64Re9CsyHCLmsYfyJdD0-2_kU92lHK36Fs8oXqXU2FijNX-X4IYqe4GjOQDN7LB9zCeEIcrxQ2LRJFOwbQY Oct 04 18:58:00.502895 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:58:00.502895 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:58:00.502895 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:58:00.502895 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:58:00.502895 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:58:00.502895 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:58:00.502895 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: 1607b30b9f324abaa88aa29e04ef3ec4 Oct 04 18:58:00.502895 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-ServersNegativeTestJSON-708693932 Oct 04 18:58:00.502895 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 18:58:00.502895 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 18:58:00.502895 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/1607b30b9f324abaa88aa29e04ef3ec4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_1607b30b9f324abaa88aa29e04ef3ec4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1607b30b9f324abaa88aa29e04ef3ec4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1607b30b9f324abaa88aa29e04ef3ec4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:58:00.502895 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-ServersNegativeTestJSON-708693932 Oct 04 18:58:00.502895 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: 1607b30b9f324abaa88aa29e04ef3ec4 Oct 04 18:58:00.502895 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-ServersNegativeTestJSON-708693932 Oct 04 18:58:00.502895 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-ServersNegativeTestJSON-708693932-project Oct 04 18:58:00.502895 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:58:00.502895 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:58:00.502895 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 6f63f1ac147543dab34a28a22eb5936c Oct 04 18:58:00.502895 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-ServersNegativeTestJSON-708693932-project Oct 04 18:58:00.502895 n-d-851028-13 devstack@n-api.service[123596]: Oct 04 18:58:00.502895 n-d-851028-13 devstack@n-api.service[123596]: {"unshelve": null} Oct 04 18:58:00.502895 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 18:58:00.502895 n-d-851028-13 devstack@n-api.service[123596]: exception: Cannot 'unshelve' instance 01e250ab-d9aa-4708-ae36-10c53a411a40 while it is in vm_state active Oct 04 18:58:00.502895 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': '01e250ab-d9aa-4708-ae36-10c53a411a40', 'body': {'unshelve': None}} Oct 04 18:58:00.502895 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:58:00.502895 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:58:00.502895 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 124, in _unshelve Oct 04 18:58:00.502895 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi self.compute_api.unshelve( Oct 04 18:58:00.502895 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 04 18:58:00.502895 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 18:58:00.502895 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 18:58:00.502895 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 18:58:00.502895 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 04 18:58:00.502895 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 04 18:58:00.502895 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 01e250ab-d9aa-4708-ae36-10c53a411a40 in vm_state active. Cannot unshelve while the instance is in this state. Oct 04 18:58:00.502895 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:58:00.502895 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:58:00.502895 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:58:00.502895 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:58:00.502895 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:58:00.502895 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:58:00.502895 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:58:00.502895 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:58:00.502895 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:58:00.502895 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:58:00.502895 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:58:00.502895 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:58:00.502895 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:58:00.502895 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:58:00.502895 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 137, in _unshelve Oct 04 18:58:00.502895 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Oct 04 18:58:00.502895 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 04 18:58:00.502895 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 04 18:58:00.506857 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unshelve' instance 01e250ab-d9aa-4708-ae36-10c53a411a40 while it is in vm_state active Oct 04 18:58:00.506857 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:58:00.506857 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:58:00.506857 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:58:00.506857 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:58:00.506857 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:58:00.506857 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:58:00.506857 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:58:00.506857 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:58:00.506857 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unshelve' instance 01e250ab-d9aa-4708-ae36-10c53a411a40 while it is in vm_state active Oct 04 18:58:00.506857 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:58:00.508724 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-e94ea700-95b3-473a-af3e-95b834ac1788 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Returning 409 to user: Cannot 'unshelve' instance 01e250ab-d9aa-4708-ae36-10c53a411a40 while it is in vm_state active {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:58:00.510514 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-e94ea700-95b3-473a-af3e-95b834ac1788 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "POST /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40/action" status: 409 len: 146 microversion: 2.1 time: 0.142713 Oct 04 18:58:00.511864 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2738/5148] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 18:58:00 2022] POST /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40/action => generated 146 bytes in 145 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:58:00.521917 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-51b06906-6bf8-47fc-94f2-47ea840818c9 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:58:00.522725 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-51b06906-6bf8-47fc-94f2-47ea840818c9 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 01e250ab-d9aa-4708-ae36-10c53a411a40] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:58:00.535161 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-51b06906-6bf8-47fc-94f2-47ea840818c9 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:00.538552 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-51b06906-6bf8-47fc-94f2-47ea840818c9 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:00.540491 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-51b06906-6bf8-47fc-94f2-47ea840818c9 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:00.541447 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-51b06906-6bf8-47fc-94f2-47ea840818c9 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:00.543373 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-51b06906-6bf8-47fc-94f2-47ea840818c9 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:00.545784 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-51b06906-6bf8-47fc-94f2-47ea840818c9 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:00.690969 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-59265aea-8530-40f9-8d50-2b65c9269baa tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da3b918706c14020910d5d0e97d96656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9330711915a4b7f9d0f3559f0f19083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:58:00.704118 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-59265aea-8530-40f9-8d50-2b65c9269baa tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] 10.222.0.43 "GET /compute/v2.1/servers/f51ca9f8-1cc6-4972-882e-34937122d5e4" status: 200 len: 1355 microversion: 2.1 time: 1.042125 Oct 04 18:58:00.705945 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2411/5149] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:57:59 2022] GET /compute/v2.1/servers/f51ca9f8-1cc6-4972-882e-34937122d5e4 => generated 1355 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:58:01.082912 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-51b06906-6bf8-47fc-94f2-47ea840818c9 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f63f1ac147543dab34a28a22eb5936c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1607b30b9f324abaa88aa29e04ef3ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:58:01.104024 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:58:01.109837 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-51b06906-6bf8-47fc-94f2-47ea840818c9 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40" status: 200 len: 1505 microversion: 2.1 time: 0.593607 Oct 04 18:58:01.112631 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2739/5150] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:58:00 2022] GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40 => generated 1505 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:58:01.140067 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-78376630-d85d-42fd-b64d-d3daaabad01e tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:58:01.140853 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-78376630-d85d-42fd-b64d-d3daaabad01e tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 01e250ab-d9aa-4708-ae36-10c53a411a40] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:58:01.169553 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-78376630-d85d-42fd-b64d-d3daaabad01e tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:01.171524 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-78376630-d85d-42fd-b64d-d3daaabad01e tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:01.172090 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-78376630-d85d-42fd-b64d-d3daaabad01e tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:01.172848 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-78376630-d85d-42fd-b64d-d3daaabad01e tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:01.173343 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-78376630-d85d-42fd-b64d-d3daaabad01e tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:01.175022 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-78376630-d85d-42fd-b64d-d3daaabad01e tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:01.405214 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-e85125cd-a4b6-4a14-bd66-24d426f0b867 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:58:01.420314 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-e85125cd-a4b6-4a14-bd66-24d426f0b867 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] [instance: a45d1b74-2d81-4e11-b837-fe77dc63f689] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:58:01.450522 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e85125cd-a4b6-4a14-bd66-24d426f0b867 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:01.451221 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e85125cd-a4b6-4a14-bd66-24d426f0b867 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:01.452059 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e85125cd-a4b6-4a14-bd66-24d426f0b867 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:01.453137 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e85125cd-a4b6-4a14-bd66-24d426f0b867 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:01.453786 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e85125cd-a4b6-4a14-bd66-24d426f0b867 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:01.455310 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e85125cd-a4b6-4a14-bd66-24d426f0b867 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:01.509894 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-e85125cd-a4b6-4a14-bd66-24d426f0b867 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] 10.222.0.43 "GET /compute/v2.1/servers/a45d1b74-2d81-4e11-b837-fe77dc63f689/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.135638 Oct 04 18:58:01.511200 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2740/5151] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Oct 4 18:58:01 2022] GET /compute/v2.1/servers/a45d1b74-2d81-4e11-b837-fe77dc63f689/os-volume_attachments => generated 25 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:58:01.643451 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-fd956810-3982-4f23-9903-925d2c4a6988 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:58:01.644290 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-fd956810-3982-4f23-9903-925d2c4a6988 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] [instance: a45d1b74-2d81-4e11-b837-fe77dc63f689] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:58:01.649762 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_api:SELECT=78 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:58:01.665134 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fd956810-3982-4f23-9903-925d2c4a6988 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:01.665812 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fd956810-3982-4f23-9903-925d2c4a6988 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:01.667604 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fd956810-3982-4f23-9903-925d2c4a6988 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:01.675734 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fd956810-3982-4f23-9903-925d2c4a6988 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:01.676338 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fd956810-3982-4f23-9903-925d2c4a6988 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:01.676890 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fd956810-3982-4f23-9903-925d2c4a6988 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:01.732817 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-fd956810-3982-4f23-9903-925d2c4a6988 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] [instance: a45d1b74-2d81-4e11-b837-fe77dc63f689] Going to try to terminate instance {{(pid=123596) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:58:01.883639 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-fd956810-3982-4f23-9903-925d2c4a6988 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] 10.222.0.43 "DELETE /compute/v2.1/servers/a45d1b74-2d81-4e11-b837-fe77dc63f689" status: 204 len: 0 microversion: 2.1 time: 0.243804 Oct 04 18:58:01.884794 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2741/5152] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 18:58:01 2022] DELETE /compute/v2.1/servers/a45d1b74-2d81-4e11-b837-fe77dc63f689 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 18:58:01.897028 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-b72026e5-a690-4b85-ba91-74cc767f26ab tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:58:01.899281 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-b72026e5-a690-4b85-ba91-74cc767f26ab tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] [instance: f51ca9f8-1cc6-4972-882e-34937122d5e4] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:58:01.915619 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b72026e5-a690-4b85-ba91-74cc767f26ab tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:01.917544 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b72026e5-a690-4b85-ba91-74cc767f26ab tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:01.918273 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b72026e5-a690-4b85-ba91-74cc767f26ab tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:01.920837 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b72026e5-a690-4b85-ba91-74cc767f26ab tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:01.922914 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b72026e5-a690-4b85-ba91-74cc767f26ab tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:01.923640 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b72026e5-a690-4b85-ba91-74cc767f26ab tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:02.269515 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-b72026e5-a690-4b85-ba91-74cc767f26ab tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da3b918706c14020910d5d0e97d96656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9330711915a4b7f9d0f3559f0f19083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:58:02.286097 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-b72026e5-a690-4b85-ba91-74cc767f26ab tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] 10.222.0.43 "GET /compute/v2.1/servers/f51ca9f8-1cc6-4972-882e-34937122d5e4" status: 200 len: 1355 microversion: 2.1 time: 0.398732 Oct 04 18:58:02.288219 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2742/5153] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:58:01 2022] GET /compute/v2.1/servers/f51ca9f8-1cc6-4972-882e-34937122d5e4 => generated 1355 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:58:02.294636 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-0c18cac9-f3f3-476d-8ad4-9c90c8046445 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:58:02.296002 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-0c18cac9-f3f3-476d-8ad4-9c90c8046445 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] [instance: a45d1b74-2d81-4e11-b837-fe77dc63f689] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:58:02.329780 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0c18cac9-f3f3-476d-8ad4-9c90c8046445 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:02.330284 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0c18cac9-f3f3-476d-8ad4-9c90c8046445 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:02.334800 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0c18cac9-f3f3-476d-8ad4-9c90c8046445 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:02.335738 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0c18cac9-f3f3-476d-8ad4-9c90c8046445 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:02.341601 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0c18cac9-f3f3-476d-8ad4-9c90c8046445 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:02.342107 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0c18cac9-f3f3-476d-8ad4-9c90c8046445 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:02.492048 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-78376630-d85d-42fd-b64d-d3daaabad01e tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f63f1ac147543dab34a28a22eb5936c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1607b30b9f324abaa88aa29e04ef3ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:58:02.513354 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-78376630-d85d-42fd-b64d-d3daaabad01e tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40" status: 200 len: 1505 microversion: 2.1 time: 1.375411 Oct 04 18:58:02.514795 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2412/5154] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:58:01 2022] GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40 => generated 1505 bytes in 1381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:58:02.546827 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-1858dd37-85b5-4e59-9ae6-a1f6ce19776d tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1993631138_updated"}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:58:02.550309 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-1858dd37-85b5-4e59-9ae6-a1f6ce19776d tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: edb9a594-df16-40ba-a224-04750cd7cc43] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:58:02.560011 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=3 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:58:02.562010 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-1858dd37-85b5-4e59-9ae6-a1f6ce19776d tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] HTTP exception thrown: Instance edb9a594-df16-40ba-a224-04750cd7cc43 could not be found. Oct 04 18:58:02.566046 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-1858dd37-85b5-4e59-9ae6-a1f6ce19776d tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Request method failure captured: Oct 04 18:58:02.566046 n-d-851028-13 devstack@n-api.service[123595]: request: PUT /compute/v2.1/servers/edb9a594-df16-40ba-a224-04750cd7cc43 HTTP/1.1 Oct 04 18:58:02.566046 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 18:58:02.566046 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 18:58:02.566046 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 18:58:02.566046 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 81 Oct 04 18:58:02.566046 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 18:58:02.566046 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 18:58:02.566046 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 18:58:02.566046 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 18:58:02.566046 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPIEZsAoFcr6P1AMHBWUo8LvryOn1l2-LYSKr4xgLCvHblWFuAiGVlStWcljkgzOc7-ldx7qv3C-2jYmQ32_Zk5yP28dI64Re9CsyHCLmsYfyJdD0-2_kU92lHK36Fs8oXqXU2FijNX-X4IYqe4GjOQDN7LB9zCeEIcrxQ2LRJFOwbQY Oct 04 18:58:02.566046 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 18:58:02.566046 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 18:58:02.566046 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 18:58:02.566046 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 18:58:02.566046 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 18:58:02.566046 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 18:58:02.566046 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: 1607b30b9f324abaa88aa29e04ef3ec4 Oct 04 18:58:02.566046 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-ServersNegativeTestJSON-708693932 Oct 04 18:58:02.566046 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 18:58:02.566046 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 18:58:02.566046 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/1607b30b9f324abaa88aa29e04ef3ec4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_1607b30b9f324abaa88aa29e04ef3ec4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1607b30b9f324abaa88aa29e04ef3ec4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1607b30b9f324abaa88aa29e04ef3ec4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:58:02.566046 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-ServersNegativeTestJSON-708693932 Oct 04 18:58:02.566046 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: 1607b30b9f324abaa88aa29e04ef3ec4 Oct 04 18:58:02.566046 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-ServersNegativeTestJSON-708693932 Oct 04 18:58:02.566046 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-ServersNegativeTestJSON-708693932-project Oct 04 18:58:02.566046 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 18:58:02.566046 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 18:58:02.566046 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: 6f63f1ac147543dab34a28a22eb5936c Oct 04 18:58:02.566046 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-ServersNegativeTestJSON-708693932-project Oct 04 18:58:02.566046 n-d-851028-13 devstack@n-api.service[123595]: Oct 04 18:58:02.566046 n-d-851028-13 devstack@n-api.service[123595]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1993631138_updated"}} Oct 04 18:58:02.566046 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 18:58:02.566046 n-d-851028-13 devstack@n-api.service[123595]: exception: Instance edb9a594-df16-40ba-a224-04750cd7cc43 could not be found. Oct 04 18:58:02.566046 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': 'edb9a594-df16-40ba-a224-04750cd7cc43', 'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1993631138_updated'}}} Oct 04 18:58:02.566046 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:58:02.566046 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:58:02.566046 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:58:02.566046 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:58:02.566046 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:58:02.566046 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:58:02.566046 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 18:58:02.566046 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 18:58:02.566046 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance edb9a594-df16-40ba-a224-04750cd7cc43 could not be found. Oct 04 18:58:02.566046 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:58:02.566046 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:58:02.566046 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:58:02.566046 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:58:02.566046 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:58:02.566046 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:58:02.566046 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:58:02.566046 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:58:02.566046 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:58:02.566046 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:58:02.566046 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:58:02.566046 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:58:02.566046 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:58:02.566046 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:58:02.566046 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:58:02.566046 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:58:02.566046 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 04 18:58:02.566046 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Oct 04 18:58:02.566046 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Oct 04 18:58:02.566046 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:58:02.569295 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:58:02.569295 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:58:02.569295 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:58:02.569295 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance edb9a594-df16-40ba-a224-04750cd7cc43 could not be found. Oct 04 18:58:02.569295 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:58:02.569295 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:58:02.569295 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:58:02.569295 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:58:02.569295 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:58:02.569295 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:58:02.569295 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:58:02.569295 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:58:02.569295 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance edb9a594-df16-40ba-a224-04750cd7cc43 could not be found. Oct 04 18:58:02.569295 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:58:02.572962 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-1858dd37-85b5-4e59-9ae6-a1f6ce19776d tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Returning 404 to user: Instance edb9a594-df16-40ba-a224-04750cd7cc43 could not be found. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:58:02.575347 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-1858dd37-85b5-4e59-9ae6-a1f6ce19776d tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "PUT /compute/v2.1/servers/edb9a594-df16-40ba-a224-04750cd7cc43" status: 404 len: 111 microversion: 2.1 time: 0.036386 Oct 04 18:58:02.576217 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2413/5155] 10.222.0.43 () {60 vars in 1256 bytes} [Tue Oct 4 18:58:02 2022] PUT /compute/v2.1/servers/edb9a594-df16-40ba-a224-04750cd7cc43 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:58:02.589748 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-bd796a0f-6769-48e2-a52f-73061669c172 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:58:02.590711 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-bd796a0f-6769-48e2-a52f-73061669c172 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 01e250ab-d9aa-4708-ae36-10c53a411a40] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:58:02.609338 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bd796a0f-6769-48e2-a52f-73061669c172 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:02.610701 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bd796a0f-6769-48e2-a52f-73061669c172 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:02.611960 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bd796a0f-6769-48e2-a52f-73061669c172 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:02.612933 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bd796a0f-6769-48e2-a52f-73061669c172 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:02.613677 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bd796a0f-6769-48e2-a52f-73061669c172 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:02.616430 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bd796a0f-6769-48e2-a52f-73061669c172 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:02.667961 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-0c18cac9-f3f3-476d-8ad4-9c90c8046445 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '486c22456b1e47ae843ae41f8dfb2632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c91c7e7358048ffaaee7f51ad61b515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:58:02.684519 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-0c18cac9-f3f3-476d-8ad4-9c90c8046445 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] 10.222.0.43 "GET /compute/v2.1/servers/a45d1b74-2d81-4e11-b837-fe77dc63f689" status: 200 len: 1682 microversion: 2.1 time: 0.391392 Oct 04 18:58:02.707499 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2743/5156] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:58:02 2022] GET /compute/v2.1/servers/a45d1b74-2d81-4e11-b837-fe77dc63f689 => generated 1682 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:58:03.118366 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-bd796a0f-6769-48e2-a52f-73061669c172 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f63f1ac147543dab34a28a22eb5936c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1607b30b9f324abaa88aa29e04ef3ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:58:03.145369 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-bd796a0f-6769-48e2-a52f-73061669c172 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40" status: 200 len: 1505 microversion: 2.1 time: 0.558024 Oct 04 18:58:03.148377 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2414/5157] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:58:02 2022] GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40 => generated 1505 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:58:03.176338 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-bcdb36e2-e8fc-4648-bca8-b8fc6da3f760 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:58:03.177445 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-bcdb36e2-e8fc-4648-bca8-b8fc6da3f760 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 01e250ab-d9aa-4708-ae36-10c53a411a40] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:58:03.195743 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bcdb36e2-e8fc-4648-bca8-b8fc6da3f760 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:03.196737 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bcdb36e2-e8fc-4648-bca8-b8fc6da3f760 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:03.199656 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bcdb36e2-e8fc-4648-bca8-b8fc6da3f760 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:03.201063 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bcdb36e2-e8fc-4648-bca8-b8fc6da3f760 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:03.202937 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bcdb36e2-e8fc-4648-bca8-b8fc6da3f760 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:03.204705 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bcdb36e2-e8fc-4648-bca8-b8fc6da3f760 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:03.316399 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-b3161f06-35b0-4298-bf67-19f74e09610d tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:58:03.318204 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-b3161f06-35b0-4298-bf67-19f74e09610d tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] [instance: f51ca9f8-1cc6-4972-882e-34937122d5e4] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:58:03.359120 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b3161f06-35b0-4298-bf67-19f74e09610d tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:03.360064 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b3161f06-35b0-4298-bf67-19f74e09610d tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:03.362860 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b3161f06-35b0-4298-bf67-19f74e09610d tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:03.365830 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b3161f06-35b0-4298-bf67-19f74e09610d tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:03.367232 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b3161f06-35b0-4298-bf67-19f74e09610d tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:03.368915 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b3161f06-35b0-4298-bf67-19f74e09610d tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:03.691870 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-bcdb36e2-e8fc-4648-bca8-b8fc6da3f760 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f63f1ac147543dab34a28a22eb5936c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1607b30b9f324abaa88aa29e04ef3ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:58:03.711301 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-bcdb36e2-e8fc-4648-bca8-b8fc6da3f760 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40" status: 200 len: 1505 microversion: 2.1 time: 0.535377 Oct 04 18:58:03.730137 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2744/5158] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:58:03 2022] GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40 => generated 1505 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:58:03.749352 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-98d6d0e2-5ad2-4252-9c86-b23558e10eab tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:58:03.751287 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-98d6d0e2-5ad2-4252-9c86-b23558e10eab tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] [instance: a45d1b74-2d81-4e11-b837-fe77dc63f689] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:58:03.759864 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-98d6d0e2-5ad2-4252-9c86-b23558e10eab tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:03.765428 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-98d6d0e2-5ad2-4252-9c86-b23558e10eab tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:03.766081 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-98d6d0e2-5ad2-4252-9c86-b23558e10eab tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:03.767007 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-98d6d0e2-5ad2-4252-9c86-b23558e10eab tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:03.767656 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-98d6d0e2-5ad2-4252-9c86-b23558e10eab tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:03.771894 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-98d6d0e2-5ad2-4252-9c86-b23558e10eab tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:03.936423 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-b3161f06-35b0-4298-bf67-19f74e09610d tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da3b918706c14020910d5d0e97d96656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9330711915a4b7f9d0f3559f0f19083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:58:03.948707 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-b3161f06-35b0-4298-bf67-19f74e09610d tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] 10.222.0.43 "GET /compute/v2.1/servers/f51ca9f8-1cc6-4972-882e-34937122d5e4" status: 200 len: 1355 microversion: 2.1 time: 0.639243 Oct 04 18:58:03.953790 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2415/5159] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:58:03 2022] GET /compute/v2.1/servers/f51ca9f8-1cc6-4972-882e-34937122d5e4 => generated 1355 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:58:03.976989 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-5b01ddc6-73b5-4ee5-bb51-09d9074bc71c tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Action: 'update', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:58:03.989266 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-5b01ddc6-73b5-4ee5-bb51-09d9074bc71c tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Request method failure captured: Oct 04 18:58:03.989266 n-d-851028-13 devstack@n-api.service[123595]: request: PUT /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40 HTTP/1.1 Oct 04 18:58:03.989266 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 18:58:03.989266 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 18:58:03.989266 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 18:58:03.989266 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 280 Oct 04 18:58:03.989266 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 18:58:03.989266 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 18:58:03.989266 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 18:58:03.989266 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 18:58:03.989266 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPIEZsAoFcr6P1AMHBWUo8LvryOn1l2-LYSKr4xgLCvHblWFuAiGVlStWcljkgzOc7-ldx7qv3C-2jYmQ32_Zk5yP28dI64Re9CsyHCLmsYfyJdD0-2_kU92lHK36Fs8oXqXU2FijNX-X4IYqe4GjOQDN7LB9zCeEIcrxQ2LRJFOwbQY Oct 04 18:58:03.989266 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 18:58:03.989266 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 18:58:03.989266 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 18:58:03.989266 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 18:58:03.989266 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 18:58:03.989266 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 18:58:03.989266 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: 1607b30b9f324abaa88aa29e04ef3ec4 Oct 04 18:58:03.989266 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-ServersNegativeTestJSON-708693932 Oct 04 18:58:03.989266 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 18:58:03.989266 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 18:58:03.989266 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/1607b30b9f324abaa88aa29e04ef3ec4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_1607b30b9f324abaa88aa29e04ef3ec4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1607b30b9f324abaa88aa29e04ef3ec4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1607b30b9f324abaa88aa29e04ef3ec4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:58:03.989266 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-ServersNegativeTestJSON-708693932 Oct 04 18:58:03.989266 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: 1607b30b9f324abaa88aa29e04ef3ec4 Oct 04 18:58:03.989266 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-ServersNegativeTestJSON-708693932 Oct 04 18:58:03.989266 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-ServersNegativeTestJSON-708693932-project Oct 04 18:58:03.989266 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 18:58:03.989266 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 18:58:03.989266 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: 6f63f1ac147543dab34a28a22eb5936c Oct 04 18:58:03.989266 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-ServersNegativeTestJSON-708693932-project Oct 04 18:58:03.989266 n-d-851028-13 devstack@n-api.service[123595]: Oct 04 18:58:03.989266 n-d-851028-13 devstack@n-api.service[123595]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 04 18:58:03.989266 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 18:58:03.989266 n-d-851028-13 devstack@n-api.service[123595]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 04 18:58:03.989266 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': '01e250ab-d9aa-4708-ae36-10c53a411a40', 'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 04 18:58:03.989266 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:58:03.989266 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:58:03.989266 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:58:03.989266 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:58:03.989266 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:58:03.989266 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:58:03.989266 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 04 18:58:03.989266 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:58:03.989266 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Oct 04 18:58:03.989266 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 04 18:58:03.989266 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:58:03.989266 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 04 18:58:03.989266 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 04 18:58:03.989266 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:58:03.989266 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:58:03.989266 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:58:03.989266 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:58:03.992443 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:58:03.992443 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:58:03.992443 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:58:03.992443 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:58:03.992443 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:58:03.992443 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:58:03.992443 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:58:03.992443 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:58:03.992443 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 18:58:03.992443 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 18:58:03.992443 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:58:03.992443 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:58:03.992443 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:58:03.992443 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:58:03.992443 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 04 18:58:03.992443 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:58:03.992443 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:58:03.992443 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:58:03.992443 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:58:03.992443 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:58:03.992443 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:58:03.992443 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:58:03.992443 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:58:03.992443 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 04 18:58:03.992443 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:58:03.992443 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-5b01ddc6-73b5-4ee5-bb51-09d9074bc71c tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:58:03.992443 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-5b01ddc6-73b5-4ee5-bb51-09d9074bc71c tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "PUT /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40" status: 400 len: 619 microversion: 2.1 time: 0.031452 Oct 04 18:58:03.998256 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2416/5160] 10.222.0.43 () {60 vars in 1257 bytes} [Tue Oct 4 18:58:03 2022] PUT /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40 => generated 619 bytes in 42 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:58:04.018702 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-013fc373-eedf-466f-8397-c0ed2d922e64 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:58:04.019570 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-013fc373-eedf-466f-8397-c0ed2d922e64 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 01e250ab-d9aa-4708-ae36-10c53a411a40] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:58:04.052588 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-013fc373-eedf-466f-8397-c0ed2d922e64 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:04.053169 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-013fc373-eedf-466f-8397-c0ed2d922e64 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:04.064826 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-013fc373-eedf-466f-8397-c0ed2d922e64 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:04.065827 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-013fc373-eedf-466f-8397-c0ed2d922e64 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:04.066330 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-013fc373-eedf-466f-8397-c0ed2d922e64 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:04.066787 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-013fc373-eedf-466f-8397-c0ed2d922e64 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:04.564375 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-98d6d0e2-5ad2-4252-9c86-b23558e10eab tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '486c22456b1e47ae843ae41f8dfb2632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c91c7e7358048ffaaee7f51ad61b515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:58:04.583237 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-98d6d0e2-5ad2-4252-9c86-b23558e10eab tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] 10.222.0.43 "GET /compute/v2.1/servers/a45d1b74-2d81-4e11-b837-fe77dc63f689" status: 200 len: 1682 microversion: 2.1 time: 0.846261 Oct 04 18:58:04.598603 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2745/5161] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:58:03 2022] GET /compute/v2.1/servers/a45d1b74-2d81-4e11-b837-fe77dc63f689 => generated 1682 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:58:04.916716 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-013fc373-eedf-466f-8397-c0ed2d922e64 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f63f1ac147543dab34a28a22eb5936c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1607b30b9f324abaa88aa29e04ef3ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:58:04.931059 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-013fc373-eedf-466f-8397-c0ed2d922e64 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40" status: 200 len: 1505 microversion: 2.1 time: 0.930367 Oct 04 18:58:04.931630 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2417/5162] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:58:03 2022] GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40 => generated 1505 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:58:04.970379 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-80a29109-69e4-4cb9-86fb-39d6833175ba tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:58:04.975969 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-80a29109-69e4-4cb9-86fb-39d6833175ba tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 01e250ab-d9aa-4708-ae36-10c53a411a40] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:58:04.978146 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-4977c07b-b8d9-43d2-922f-40560db37db3 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:58:04.979478 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-4977c07b-b8d9-43d2-922f-40560db37db3 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] [instance: f51ca9f8-1cc6-4972-882e-34937122d5e4] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:58:04.993264 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-80a29109-69e4-4cb9-86fb-39d6833175ba tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:04.993809 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-80a29109-69e4-4cb9-86fb-39d6833175ba tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:04.994262 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-80a29109-69e4-4cb9-86fb-39d6833175ba tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:04.995198 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-80a29109-69e4-4cb9-86fb-39d6833175ba tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:04.995626 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-80a29109-69e4-4cb9-86fb-39d6833175ba tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:04.996070 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-80a29109-69e4-4cb9-86fb-39d6833175ba tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:04.996417 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4977c07b-b8d9-43d2-922f-40560db37db3 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:04.997305 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4977c07b-b8d9-43d2-922f-40560db37db3 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:04.997909 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4977c07b-b8d9-43d2-922f-40560db37db3 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:05.003988 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4977c07b-b8d9-43d2-922f-40560db37db3 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:05.004490 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4977c07b-b8d9-43d2-922f-40560db37db3 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:05.004936 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4977c07b-b8d9-43d2-922f-40560db37db3 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:05.781704 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-4977c07b-b8d9-43d2-922f-40560db37db3 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da3b918706c14020910d5d0e97d96656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9330711915a4b7f9d0f3559f0f19083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:58:05.814838 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-4977c07b-b8d9-43d2-922f-40560db37db3 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] 10.222.0.43 "GET /compute/v2.1/servers/f51ca9f8-1cc6-4972-882e-34937122d5e4" status: 200 len: 1355 microversion: 2.1 time: 0.836352 Oct 04 18:58:05.815927 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2418/5163] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:58:04 2022] GET /compute/v2.1/servers/f51ca9f8-1cc6-4972-882e-34937122d5e4 => generated 1355 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:58:05.835714 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-f24ae5f7-abe3-4216-ba30-1c350bd64456 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:58:05.837845 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-f24ae5f7-abe3-4216-ba30-1c350bd64456 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] [instance: a45d1b74-2d81-4e11-b837-fe77dc63f689] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:58:05.874869 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f24ae5f7-abe3-4216-ba30-1c350bd64456 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:05.874869 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f24ae5f7-abe3-4216-ba30-1c350bd64456 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:05.875242 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f24ae5f7-abe3-4216-ba30-1c350bd64456 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:05.883877 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f24ae5f7-abe3-4216-ba30-1c350bd64456 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:05.888863 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f24ae5f7-abe3-4216-ba30-1c350bd64456 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:05.892320 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f24ae5f7-abe3-4216-ba30-1c350bd64456 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:06.142941 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-f24ae5f7-abe3-4216-ba30-1c350bd64456 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '486c22456b1e47ae843ae41f8dfb2632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c91c7e7358048ffaaee7f51ad61b515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:58:06.153737 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-f24ae5f7-abe3-4216-ba30-1c350bd64456 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] 10.222.0.43 "GET /compute/v2.1/servers/a45d1b74-2d81-4e11-b837-fe77dc63f689" status: 200 len: 1615 microversion: 2.1 time: 0.335822 Oct 04 18:58:06.161909 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2419/5164] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:58:05 2022] GET /compute/v2.1/servers/a45d1b74-2d81-4e11-b837-fe77dc63f689 => generated 1615 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:58:06.570624 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-50aee3f2-bd96-4366-936e-e1907b915514 req-fe8ac07e-8d14-4cdf-af59-36cbdb4f1167 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a45d1b74-2d81-4e11-b837-fe77dc63f689", "name": "network-vif-deleted", "tag": "b3e1d52d-3e3e-43c8-9f57-f601d774fbfe"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:58:06.585172 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-50aee3f2-bd96-4366-936e-e1907b915514 req-fe8ac07e-8d14-4cdf-af59-36cbdb4f1167 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:06.586730 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-50aee3f2-bd96-4366-936e-e1907b915514 req-fe8ac07e-8d14-4cdf-af59-36cbdb4f1167 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:06.602637 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-50aee3f2-bd96-4366-936e-e1907b915514 req-fe8ac07e-8d14-4cdf-af59-36cbdb4f1167 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:06.636883 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-50aee3f2-bd96-4366-936e-e1907b915514 req-fe8ac07e-8d14-4cdf-af59-36cbdb4f1167 service nova] Creating event network-vif-deleted:b3e1d52d-3e3e-43c8-9f57-f601d774fbfe for instance a45d1b74-2d81-4e11-b837-fe77dc63f689 on n-h1-851028-13 Oct 04 18:58:06.651989 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-50aee3f2-bd96-4366-936e-e1907b915514 req-fe8ac07e-8d14-4cdf-af59-36cbdb4f1167 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084620 Oct 04 18:58:06.661996 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2420/5165] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:58:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:58:06.809995 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-80a29109-69e4-4cb9-86fb-39d6833175ba tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f63f1ac147543dab34a28a22eb5936c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1607b30b9f324abaa88aa29e04ef3ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:58:06.822712 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-80a29109-69e4-4cb9-86fb-39d6833175ba tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40" status: 200 len: 1505 microversion: 2.1 time: 1.859071 Oct 04 18:58:06.823643 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2746/5166] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:58:04 2022] GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40 => generated 1505 bytes in 1862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:58:06.843702 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-10fd6f0a-2df8-42a8-b67f-7d697a4d5223 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:58:06.844415 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-10fd6f0a-2df8-42a8-b67f-7d697a4d5223 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] [instance: f51ca9f8-1cc6-4972-882e-34937122d5e4] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:58:06.870827 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-10fd6f0a-2df8-42a8-b67f-7d697a4d5223 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:06.873211 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f2e1d0ee-c382-4fc0-b5a3-238816c165b7 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Action: 'update', calling method: >, body: {"server": {"name": ""}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:58:06.874466 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-10fd6f0a-2df8-42a8-b67f-7d697a4d5223 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:06.874823 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-10fd6f0a-2df8-42a8-b67f-7d697a4d5223 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:06.875895 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-10fd6f0a-2df8-42a8-b67f-7d697a4d5223 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:06.876484 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-10fd6f0a-2df8-42a8-b67f-7d697a4d5223 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:06.876949 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-10fd6f0a-2df8-42a8-b67f-7d697a4d5223 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:06.889380 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f2e1d0ee-c382-4fc0-b5a3-238816c165b7 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Request method failure captured: Oct 04 18:58:06.889380 n-d-851028-13 devstack@n-api.service[123596]: request: PUT /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40 HTTP/1.1 Oct 04 18:58:06.889380 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:58:06.889380 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:58:06.889380 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:58:06.889380 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 24 Oct 04 18:58:06.889380 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:58:06.889380 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:58:06.889380 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:58:06.889380 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:58:06.889380 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPIEZsAoFcr6P1AMHBWUo8LvryOn1l2-LYSKr4xgLCvHblWFuAiGVlStWcljkgzOc7-ldx7qv3C-2jYmQ32_Zk5yP28dI64Re9CsyHCLmsYfyJdD0-2_kU92lHK36Fs8oXqXU2FijNX-X4IYqe4GjOQDN7LB9zCeEIcrxQ2LRJFOwbQY Oct 04 18:58:06.889380 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:58:06.889380 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:58:06.889380 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:58:06.889380 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:58:06.889380 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:58:06.889380 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:58:06.889380 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: 1607b30b9f324abaa88aa29e04ef3ec4 Oct 04 18:58:06.889380 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-ServersNegativeTestJSON-708693932 Oct 04 18:58:06.889380 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 18:58:06.889380 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 18:58:06.889380 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/1607b30b9f324abaa88aa29e04ef3ec4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_1607b30b9f324abaa88aa29e04ef3ec4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1607b30b9f324abaa88aa29e04ef3ec4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1607b30b9f324abaa88aa29e04ef3ec4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:58:06.889380 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-ServersNegativeTestJSON-708693932 Oct 04 18:58:06.889380 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: 1607b30b9f324abaa88aa29e04ef3ec4 Oct 04 18:58:06.889380 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-ServersNegativeTestJSON-708693932 Oct 04 18:58:06.889380 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-ServersNegativeTestJSON-708693932-project Oct 04 18:58:06.889380 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:58:06.889380 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:58:06.889380 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 6f63f1ac147543dab34a28a22eb5936c Oct 04 18:58:06.889380 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-ServersNegativeTestJSON-708693932-project Oct 04 18:58:06.889380 n-d-851028-13 devstack@n-api.service[123596]: Oct 04 18:58:06.889380 n-d-851028-13 devstack@n-api.service[123596]: {"server": {"name": ""}} Oct 04 18:58:06.889380 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 18:58:06.889380 n-d-851028-13 devstack@n-api.service[123596]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 04 18:58:06.889380 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': '01e250ab-d9aa-4708-ae36-10c53a411a40', 'body': {'server': {'name': ''}}} Oct 04 18:58:06.889380 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:58:06.889380 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:58:06.889380 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:58:06.889380 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:58:06.889380 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:58:06.889380 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:58:06.889380 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 04 18:58:06.889380 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:58:06.889380 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Oct 04 18:58:06.889380 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 04 18:58:06.889380 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:58:06.889380 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 04 18:58:06.889380 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi '' Oct 04 18:58:06.889380 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:58:06.889380 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:58:06.889380 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:58:06.889380 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:58:06.889380 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:58:06.889380 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:58:06.889380 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:58:06.889380 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:58:06.889380 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:58:06.889380 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:58:06.889380 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:58:06.889380 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:58:06.889380 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 18:58:06.889380 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 18:58:06.889380 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:58:06.889380 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:58:06.889380 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:58:06.889380 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:58:06.889380 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 04 18:58:06.893637 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:58:06.893637 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:58:06.893637 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:58:06.893637 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:58:06.893637 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:58:06.893637 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:58:06.893637 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:58:06.893637 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:58:06.893637 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 04 18:58:06.893637 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:58:06.899376 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f2e1d0ee-c382-4fc0-b5a3-238816c165b7 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:58:06.908746 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-f2e1d0ee-c382-4fc0-b5a3-238816c165b7 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "PUT /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40" status: 400 len: 108 microversion: 2.1 time: 0.056508 Oct 04 18:58:06.914087 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2747/5167] 10.222.0.43 () {60 vars in 1256 bytes} [Tue Oct 4 18:58:06 2022] PUT /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40 => generated 108 bytes in 66 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:58:06.923293 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-1900bfa6-18cf-4d8c-9555-d4ce6969a504 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:58:06.934770 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-1900bfa6-18cf-4d8c-9555-d4ce6969a504 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 01e250ab-d9aa-4708-ae36-10c53a411a40] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:58:06.976909 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1900bfa6-18cf-4d8c-9555-d4ce6969a504 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:06.984253 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1900bfa6-18cf-4d8c-9555-d4ce6969a504 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:06.984743 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1900bfa6-18cf-4d8c-9555-d4ce6969a504 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:06.985534 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1900bfa6-18cf-4d8c-9555-d4ce6969a504 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:06.986004 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1900bfa6-18cf-4d8c-9555-d4ce6969a504 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:06.992590 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1900bfa6-18cf-4d8c-9555-d4ce6969a504 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:07.312483 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-10fd6f0a-2df8-42a8-b67f-7d697a4d5223 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da3b918706c14020910d5d0e97d96656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9330711915a4b7f9d0f3559f0f19083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:58:07.322285 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-10fd6f0a-2df8-42a8-b67f-7d697a4d5223 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] 10.222.0.43 "GET /compute/v2.1/servers/f51ca9f8-1cc6-4972-882e-34937122d5e4" status: 200 len: 1355 microversion: 2.1 time: 0.484975 Oct 04 18:58:07.323055 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2421/5168] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:58:06 2022] GET /compute/v2.1/servers/f51ca9f8-1cc6-4972-882e-34937122d5e4 => generated 1355 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:58:07.345683 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-048ae2b3-7dc8-4024-8d32-65b8e4d4d32f tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:58:07.348487 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-048ae2b3-7dc8-4024-8d32-65b8e4d4d32f tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] [instance: a45d1b74-2d81-4e11-b837-fe77dc63f689] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:58:07.367773 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-048ae2b3-7dc8-4024-8d32-65b8e4d4d32f tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:07.368281 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-048ae2b3-7dc8-4024-8d32-65b8e4d4d32f tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:07.368737 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-048ae2b3-7dc8-4024-8d32-65b8e4d4d32f tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:07.369507 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-048ae2b3-7dc8-4024-8d32-65b8e4d4d32f tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:07.375509 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-048ae2b3-7dc8-4024-8d32-65b8e4d4d32f tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:07.376209 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-048ae2b3-7dc8-4024-8d32-65b8e4d4d32f tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:07.467756 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-048ae2b3-7dc8-4024-8d32-65b8e4d4d32f tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:07.470717 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-048ae2b3-7dc8-4024-8d32-65b8e4d4d32f tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:07.471348 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-048ae2b3-7dc8-4024-8d32-65b8e4d4d32f tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:07.472332 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.objects.instance [None req-048ae2b3-7dc8-4024-8d32-65b8e4d4d32f tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lazy-loading 'fault' on Instance uuid a45d1b74-2d81-4e11-b837-fe77dc63f689 {{(pid=123595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:58:07.595131 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-048ae2b3-7dc8-4024-8d32-65b8e4d4d32f tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '486c22456b1e47ae843ae41f8dfb2632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c91c7e7358048ffaaee7f51ad61b515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:58:07.608972 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-048ae2b3-7dc8-4024-8d32-65b8e4d4d32f tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] 10.222.0.43 "GET /compute/v2.1/servers/a45d1b74-2d81-4e11-b837-fe77dc63f689" status: 200 len: 1332 microversion: 2.1 time: 0.281855 Oct 04 18:58:07.609859 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2422/5169] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:58:07 2022] GET /compute/v2.1/servers/a45d1b74-2d81-4e11-b837-fe77dc63f689 => generated 1332 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:58:08.043552 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-1900bfa6-18cf-4d8c-9555-d4ce6969a504 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f63f1ac147543dab34a28a22eb5936c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1607b30b9f324abaa88aa29e04ef3ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:58:08.059480 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-1900bfa6-18cf-4d8c-9555-d4ce6969a504 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40" status: 200 len: 1505 microversion: 2.1 time: 1.140562 Oct 04 18:58:08.060080 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2748/5170] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:58:06 2022] GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40 => generated 1505 bytes in 1142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:58:08.348812 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-d19df412-1e94-4d8a-a441-170bf0b80b39 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:58:08.350035 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-d19df412-1e94-4d8a-a441-170bf0b80b39 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] [instance: f51ca9f8-1cc6-4972-882e-34937122d5e4] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:58:08.378966 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d19df412-1e94-4d8a-a441-170bf0b80b39 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:08.379390 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d19df412-1e94-4d8a-a441-170bf0b80b39 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:08.379937 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d19df412-1e94-4d8a-a441-170bf0b80b39 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:08.380987 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d19df412-1e94-4d8a-a441-170bf0b80b39 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:08.381655 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d19df412-1e94-4d8a-a441-170bf0b80b39 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:08.382264 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d19df412-1e94-4d8a-a441-170bf0b80b39 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:08.644168 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-7e0eedcf-fcb2-4299-8be2-2095a24fffd0 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:58:08.645003 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-7e0eedcf-fcb2-4299-8be2-2095a24fffd0 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] [instance: a45d1b74-2d81-4e11-b837-fe77dc63f689] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:58:08.669599 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7e0eedcf-fcb2-4299-8be2-2095a24fffd0 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:08.670148 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7e0eedcf-fcb2-4299-8be2-2095a24fffd0 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:08.677917 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7e0eedcf-fcb2-4299-8be2-2095a24fffd0 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:08.679099 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7e0eedcf-fcb2-4299-8be2-2095a24fffd0 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:08.679775 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7e0eedcf-fcb2-4299-8be2-2095a24fffd0 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:08.680372 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7e0eedcf-fcb2-4299-8be2-2095a24fffd0 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:08.724396 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-7e0eedcf-fcb2-4299-8be2-2095a24fffd0 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] HTTP exception thrown: Instance a45d1b74-2d81-4e11-b837-fe77dc63f689 could not be found. Oct 04 18:58:08.726398 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-7e0eedcf-fcb2-4299-8be2-2095a24fffd0 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Request method failure captured: Oct 04 18:58:08.726398 n-d-851028-13 devstack@n-api.service[123596]: request: GET /compute/v2.1/servers/a45d1b74-2d81-4e11-b837-fe77dc63f689 HTTP/1.1 Oct 04 18:58:08.726398 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:58:08.726398 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:58:08.726398 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:58:08.726398 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 18:58:08.726398 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:58:08.726398 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:58:08.726398 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:58:08.726398 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:58:08.726398 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPID78vmCI9IDPSneDizdTNDV6DvHA8Yu-0Hk2AdriQTEcsN9glvSb6qnq0IhhwuZEnTcyOqvR3DmN0AjQb3MXy0KeUN-iyujvPMDrfVKCEbIzKf9nHEoBLFpzOTLVQVrEHVpIwmUAw_LxUeBUjShHQb88Tzo0W7pmPF365n3rwKGYEI Oct 04 18:58:08.726398 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:58:08.726398 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:58:08.726398 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:58:08.726398 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:58:08.726398 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:58:08.726398 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:58:08.726398 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: 6c91c7e7358048ffaaee7f51ad61b515 Oct 04 18:58:08.726398 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-AttachVolumeNegativeTest-2048626205 Oct 04 18:58:08.726398 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 18:58:08.726398 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 18:58:08.726398 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/6c91c7e7358048ffaaee7f51ad61b515"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_6c91c7e7358048ffaaee7f51ad61b515"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/6c91c7e7358048ffaaee7f51ad61b515"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/6c91c7e7358048ffaaee7f51ad61b515"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:58:08.726398 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-AttachVolumeNegativeTest-2048626205 Oct 04 18:58:08.726398 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: 6c91c7e7358048ffaaee7f51ad61b515 Oct 04 18:58:08.726398 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2048626205 Oct 04 18:58:08.726398 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-AttachVolumeNegativeTest-2048626205-project Oct 04 18:58:08.726398 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:58:08.726398 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:58:08.726398 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 486c22456b1e47ae843ae41f8dfb2632 Oct 04 18:58:08.726398 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-AttachVolumeNegativeTest-2048626205-project Oct 04 18:58:08.726398 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 18:58:08.726398 n-d-851028-13 devstack@n-api.service[123596]: exception: Instance a45d1b74-2d81-4e11-b837-fe77dc63f689 could not be found. Oct 04 18:58:08.726398 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': 'a45d1b74-2d81-4e11-b837-fe77dc63f689'} Oct 04 18:58:08.726398 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:58:08.726398 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:58:08.726398 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:58:08.726398 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:58:08.726398 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:58:08.726398 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:58:08.726398 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:58:08.726398 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:58:08.726398 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:58:08.726398 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:58:08.726398 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a45d1b74-2d81-4e11-b837-fe77dc63f689 could not be found. Oct 04 18:58:08.726398 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:58:08.726398 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:58:08.726398 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:58:08.726398 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:58:08.726398 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:58:08.726398 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:58:08.726398 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:58:08.726398 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:58:08.726398 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:58:08.726398 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:58:08.726398 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:58:08.726398 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:58:08.726398 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:58:08.726398 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:58:08.726398 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:58:08.726398 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:58:08.726398 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a45d1b74-2d81-4e11-b837-fe77dc63f689 could not be found. Oct 04 18:58:08.726398 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:58:08.726398 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:58:08.726398 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:58:08.731470 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:58:08.731470 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:58:08.731470 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:58:08.731470 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:58:08.731470 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:58:08.731470 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a45d1b74-2d81-4e11-b837-fe77dc63f689 could not be found. Oct 04 18:58:08.731470 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:58:08.732659 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-7e0eedcf-fcb2-4299-8be2-2095a24fffd0 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Returning 404 to user: Instance a45d1b74-2d81-4e11-b837-fe77dc63f689 could not be found. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:58:08.733711 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-7e0eedcf-fcb2-4299-8be2-2095a24fffd0 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] 10.222.0.43 "GET /compute/v2.1/servers/a45d1b74-2d81-4e11-b837-fe77dc63f689" status: 404 len: 111 microversion: 2.1 time: 0.095386 Oct 04 18:58:08.737896 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2749/5171] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:58:08 2022] GET /compute/v2.1/servers/a45d1b74-2d81-4e11-b837-fe77dc63f689 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:58:08.764270 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-c88bd7e7-9427-4cb9-9ea4-48ae223409a5 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Calling method '.version_select at 0x7fb21e8e4700>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:58:08.814884 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-c88bd7e7-9427-4cb9-9ea4-48ae223409a5 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1496845502" status: 202 len: 0 microversion: 2.1 time: 0.069835 Oct 04 18:58:08.818935 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2750/5172] 10.222.0.43 () {58 vars in 1221 bytes} [Tue Oct 4 18:58:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1496845502 => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:58:09.297156 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-d19df412-1e94-4d8a-a441-170bf0b80b39 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da3b918706c14020910d5d0e97d96656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9330711915a4b7f9d0f3559f0f19083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:58:09.310140 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-d19df412-1e94-4d8a-a441-170bf0b80b39 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] 10.222.0.43 "GET /compute/v2.1/servers/f51ca9f8-1cc6-4972-882e-34937122d5e4" status: 200 len: 1355 microversion: 2.1 time: 0.965405 Oct 04 18:58:09.311072 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2423/5173] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:58:08 2022] GET /compute/v2.1/servers/f51ca9f8-1cc6-4972-882e-34937122d5e4 => generated 1355 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:58:10.334053 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-5677d0df-a922-4139-80d2-2072f20d13a3 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:58:10.334927 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-5677d0df-a922-4139-80d2-2072f20d13a3 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] [instance: f51ca9f8-1cc6-4972-882e-34937122d5e4] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:58:10.360230 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5677d0df-a922-4139-80d2-2072f20d13a3 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:10.361504 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5677d0df-a922-4139-80d2-2072f20d13a3 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:10.362025 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5677d0df-a922-4139-80d2-2072f20d13a3 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:10.362812 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5677d0df-a922-4139-80d2-2072f20d13a3 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:10.363289 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5677d0df-a922-4139-80d2-2072f20d13a3 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:10.370875 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5677d0df-a922-4139-80d2-2072f20d13a3 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:10.883088 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-5677d0df-a922-4139-80d2-2072f20d13a3 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da3b918706c14020910d5d0e97d96656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9330711915a4b7f9d0f3559f0f19083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:58:10.898389 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-5677d0df-a922-4139-80d2-2072f20d13a3 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] 10.222.0.43 "GET /compute/v2.1/servers/f51ca9f8-1cc6-4972-882e-34937122d5e4" status: 200 len: 1355 microversion: 2.1 time: 0.568357 Oct 04 18:58:10.901292 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2751/5174] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:58:10 2022] GET /compute/v2.1/servers/f51ca9f8-1cc6-4972-882e-34937122d5e4 => generated 1355 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:58:11.484904 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-ad0e8668-9a53-4499-a2b1-1b4bc2f6588a req-f01d45cc-5085-4db2-9f54-887f12d145be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f51ca9f8-1cc6-4972-882e-34937122d5e4", "name": "network-vif-plugged", "status": "completed", "tag": "1186a04d-7d24-44cb-8f63-e45471612dbb"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:58:11.531178 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-ad0e8668-9a53-4499-a2b1-1b4bc2f6588a req-f01d45cc-5085-4db2-9f54-887f12d145be service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:11.532102 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-ad0e8668-9a53-4499-a2b1-1b4bc2f6588a req-f01d45cc-5085-4db2-9f54-887f12d145be service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:11.532986 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-ad0e8668-9a53-4499-a2b1-1b4bc2f6588a req-f01d45cc-5085-4db2-9f54-887f12d145be service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:11.551640 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-ad0e8668-9a53-4499-a2b1-1b4bc2f6588a req-f01d45cc-5085-4db2-9f54-887f12d145be service nova] Creating event network-vif-plugged:1186a04d-7d24-44cb-8f63-e45471612dbb for instance f51ca9f8-1cc6-4972-882e-34937122d5e4 on n-h1-851028-13 Oct 04 18:58:11.561863 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-ad0e8668-9a53-4499-a2b1-1b4bc2f6588a req-f01d45cc-5085-4db2-9f54-887f12d145be service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.350666 Oct 04 18:58:11.564260 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2424/5175] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:58:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:58:11.924357 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-aad647a5-86e0-4704-8f5b-9114a3cd5ad9 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:58:11.924986 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-aad647a5-86e0-4704-8f5b-9114a3cd5ad9 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] [instance: f51ca9f8-1cc6-4972-882e-34937122d5e4] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:58:11.939382 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-aad647a5-86e0-4704-8f5b-9114a3cd5ad9 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:11.939886 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-aad647a5-86e0-4704-8f5b-9114a3cd5ad9 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:11.940323 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-aad647a5-86e0-4704-8f5b-9114a3cd5ad9 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:11.947086 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-aad647a5-86e0-4704-8f5b-9114a3cd5ad9 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:11.948999 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-aad647a5-86e0-4704-8f5b-9114a3cd5ad9 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:11.951236 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-aad647a5-86e0-4704-8f5b-9114a3cd5ad9 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:12.347392 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-aad647a5-86e0-4704-8f5b-9114a3cd5ad9 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da3b918706c14020910d5d0e97d96656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9330711915a4b7f9d0f3559f0f19083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:58:12.361409 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-aad647a5-86e0-4704-8f5b-9114a3cd5ad9 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] 10.222.0.43 "GET /compute/v2.1/servers/f51ca9f8-1cc6-4972-882e-34937122d5e4" status: 200 len: 1355 microversion: 2.1 time: 0.441482 Oct 04 18:58:12.378148 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2752/5176] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:58:11 2022] GET /compute/v2.1/servers/f51ca9f8-1cc6-4972-882e-34937122d5e4 => generated 1355 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:58:13.394192 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-d2f030aa-0aed-4b5d-b551-8e497f060d50 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:58:13.395729 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-d2f030aa-0aed-4b5d-b551-8e497f060d50 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] [instance: f51ca9f8-1cc6-4972-882e-34937122d5e4] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:58:13.409143 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d2f030aa-0aed-4b5d-b551-8e497f060d50 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:13.417376 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d2f030aa-0aed-4b5d-b551-8e497f060d50 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:13.418188 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d2f030aa-0aed-4b5d-b551-8e497f060d50 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:13.419152 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d2f030aa-0aed-4b5d-b551-8e497f060d50 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:13.419818 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d2f030aa-0aed-4b5d-b551-8e497f060d50 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:13.420455 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d2f030aa-0aed-4b5d-b551-8e497f060d50 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:13.477981 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=100 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:58:13.597133 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-1976d9ab-8ff0-428e-9279-f7894883b316 req-84c3c5e3-7eea-4792-83f1-77d0beb0f019 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f51ca9f8-1cc6-4972-882e-34937122d5e4", "name": "network-vif-plugged", "status": "completed", "tag": "242eef97-7324-4879-9d7a-cda5914dde92"}, {"server_uuid": "f51ca9f8-1cc6-4972-882e-34937122d5e4", "name": "network-vif-plugged", "status": "completed", "tag": "48f1dcfd-b029-4491-b22d-2a62a2891c97"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:58:13.618005 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-1976d9ab-8ff0-428e-9279-f7894883b316 req-84c3c5e3-7eea-4792-83f1-77d0beb0f019 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:13.621422 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-1976d9ab-8ff0-428e-9279-f7894883b316 req-84c3c5e3-7eea-4792-83f1-77d0beb0f019 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:13.629761 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-1976d9ab-8ff0-428e-9279-f7894883b316 req-84c3c5e3-7eea-4792-83f1-77d0beb0f019 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:13.649868 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-1976d9ab-8ff0-428e-9279-f7894883b316 req-84c3c5e3-7eea-4792-83f1-77d0beb0f019 service nova] Creating event network-vif-plugged:242eef97-7324-4879-9d7a-cda5914dde92 for instance f51ca9f8-1cc6-4972-882e-34937122d5e4 on n-h1-851028-13 Oct 04 18:58:13.653851 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-1976d9ab-8ff0-428e-9279-f7894883b316 req-84c3c5e3-7eea-4792-83f1-77d0beb0f019 service nova] Creating event network-vif-plugged:48f1dcfd-b029-4491-b22d-2a62a2891c97 for instance f51ca9f8-1cc6-4972-882e-34937122d5e4 on n-h1-851028-13 Oct 04 18:58:13.673242 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-1976d9ab-8ff0-428e-9279-f7894883b316 req-84c3c5e3-7eea-4792-83f1-77d0beb0f019 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.085077 Oct 04 18:58:13.679803 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2753/5177] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:58:13 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:58:13.701836 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-604d4f7f-7a38-433b-a6e1-736b5cd6fc64 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Action: 'create', calling method: .version_select at 0x7fb21ea078b0>, body: {"keypair": {"name": "tempest-keypair-1445986333", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPt2NkHzp9OaejtqjbbOAE67iY7zXr9PMJOUyLv4fuijdWBq3kqlWHIvYX1AnU97cbsvPaSZ5Edyatt6xnmUbqCcMe56++ZgKLhag5lipoafCHar30U4yk1iFnAeZFHBLA=="}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:58:13.764727 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-604d4f7f-7a38-433b-a6e1-736b5cd6fc64 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Getting quotas for project 6c91c7e7358048ffaaee7f51ad61b515. Resources: {'key_pairs'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:58:13.792874 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-604d4f7f-7a38-433b-a6e1-736b5cd6fc64 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Getting quotas for user 486c22456b1e47ae843ae41f8dfb2632 and project 6c91c7e7358048ffaaee7f51ad61b515. Resources: {'key_pairs'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:58:13.871277 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-604d4f7f-7a38-433b-a6e1-736b5cd6fc64 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.189715 Oct 04 18:58:13.871988 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2754/5178] 10.222.0.43 () {60 vars in 1159 bytes} [Tue Oct 4 18:58:13 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:58:14.150124 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f7847b13-05d2-43d4-be76-607ebb03c8d6 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Action: 'create', calling method: .version_select at 0x7fb21e7730d0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-273614183", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKdrMDSdYgF8AKE29vMcbRazR+MeU22GMNqBnum5dryN/yR5LQRajDigzu2Ok9er43pWCVw7WSKXEGZU6ppyRdOfEpE4Mly/yBYzkmJheuWs8zuXWetbVbHOhsYwD7YRMw=="}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:58:14.209452 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-f7847b13-05d2-43d4-be76-607ebb03c8d6 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Getting quotas for project 27a4c327763b4440a9dc456cfbb31f88. Resources: {'key_pairs'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:58:14.236971 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-f7847b13-05d2-43d4-be76-607ebb03c8d6 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Getting quotas for user fc1bb492fb294837b1e55d58bbfa3d0b and project 27a4c327763b4440a9dc456cfbb31f88. Resources: {'key_pairs'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:58:14.339685 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-f7847b13-05d2-43d4-be76-607ebb03c8d6 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.193570 Oct 04 18:58:14.340694 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2755/5179] 10.222.0.43 () {60 vars in 1159 bytes} [Tue Oct 4 18:58:14 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:58:14.373216 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-d2f030aa-0aed-4b5d-b551-8e497f060d50 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da3b918706c14020910d5d0e97d96656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9330711915a4b7f9d0f3559f0f19083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:58:14.383573 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-d2f030aa-0aed-4b5d-b551-8e497f060d50 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] 10.222.0.43 "GET /compute/v2.1/servers/f51ca9f8-1cc6-4972-882e-34937122d5e4" status: 200 len: 1355 microversion: 2.1 time: 0.996142 Oct 04 18:58:14.392397 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2425/5180] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:58:13 2022] GET /compute/v2.1/servers/f51ca9f8-1cc6-4972-882e-34937122d5e4 => generated 1355 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:58:15.414811 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-8212444a-4fdf-4767-8297-222e65e80b48 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:58:15.415616 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-8212444a-4fdf-4767-8297-222e65e80b48 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] [instance: f51ca9f8-1cc6-4972-882e-34937122d5e4] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:58:15.433648 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8212444a-4fdf-4767-8297-222e65e80b48 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:15.434382 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8212444a-4fdf-4767-8297-222e65e80b48 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:15.434993 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8212444a-4fdf-4767-8297-222e65e80b48 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:15.435889 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8212444a-4fdf-4767-8297-222e65e80b48 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:15.436510 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8212444a-4fdf-4767-8297-222e65e80b48 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:15.437159 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8212444a-4fdf-4767-8297-222e65e80b48 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:15.974896 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-8212444a-4fdf-4767-8297-222e65e80b48 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da3b918706c14020910d5d0e97d96656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9330711915a4b7f9d0f3559f0f19083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:58:15.986709 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-8212444a-4fdf-4767-8297-222e65e80b48 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] 10.222.0.43 "GET /compute/v2.1/servers/f51ca9f8-1cc6-4972-882e-34937122d5e4" status: 200 len: 1355 microversion: 2.1 time: 0.575869 Oct 04 18:58:15.987437 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2756/5181] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:58:15 2022] GET /compute/v2.1/servers/f51ca9f8-1cc6-4972-882e-34937122d5e4 => generated 1355 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:58:17.011016 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-9e5d817b-9380-41eb-8ac3-47414e3e587f tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:58:17.012561 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-9e5d817b-9380-41eb-8ac3-47414e3e587f tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] [instance: f51ca9f8-1cc6-4972-882e-34937122d5e4] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:58:17.027227 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9e5d817b-9380-41eb-8ac3-47414e3e587f tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:17.033558 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9e5d817b-9380-41eb-8ac3-47414e3e587f tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:17.036179 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9e5d817b-9380-41eb-8ac3-47414e3e587f tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:17.037314 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9e5d817b-9380-41eb-8ac3-47414e3e587f tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:17.038025 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9e5d817b-9380-41eb-8ac3-47414e3e587f tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:17.041853 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9e5d817b-9380-41eb-8ac3-47414e3e587f tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:17.475330 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-9e5d817b-9380-41eb-8ac3-47414e3e587f tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da3b918706c14020910d5d0e97d96656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9330711915a4b7f9d0f3559f0f19083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:58:17.499781 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-9e5d817b-9380-41eb-8ac3-47414e3e587f tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] 10.222.0.43 "GET /compute/v2.1/servers/f51ca9f8-1cc6-4972-882e-34937122d5e4" status: 200 len: 1806 microversion: 2.1 time: 0.491524 Oct 04 18:58:17.502266 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2426/5182] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:58:17 2022] GET /compute/v2.1/servers/f51ca9f8-1cc6-4972-882e-34937122d5e4 => generated 1806 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:58:17.531763 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-099b8fff-a177-4c70-9c65-581041632085 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:58:17.532296 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-099b8fff-a177-4c70-9c65-581041632085 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] [instance: f51ca9f8-1cc6-4972-882e-34937122d5e4] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:58:17.542202 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-099b8fff-a177-4c70-9c65-581041632085 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:17.542687 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-099b8fff-a177-4c70-9c65-581041632085 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:17.549944 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-099b8fff-a177-4c70-9c65-581041632085 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:17.550968 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-099b8fff-a177-4c70-9c65-581041632085 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:17.551597 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-099b8fff-a177-4c70-9c65-581041632085 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:17.552177 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-099b8fff-a177-4c70-9c65-581041632085 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:17.608680 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-099b8fff-a177-4c70-9c65-581041632085 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] 10.222.0.43 "GET /compute/v2.1/servers/f51ca9f8-1cc6-4972-882e-34937122d5e4/ips" status: 200 len: 219 microversion: 2.1 time: 0.081131 Oct 04 18:58:17.626884 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2757/5183] 10.222.0.43 () {58 vars in 1248 bytes} [Tue Oct 4 18:58:17 2022] GET /compute/v2.1/servers/f51ca9f8-1cc6-4972-882e-34937122d5e4/ips => generated 219 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:58:17.641138 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-5674a9f7-1556-49ac-a3f5-ceb05c484942 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:58:17.641940 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-5674a9f7-1556-49ac-a3f5-ceb05c484942 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] [instance: f51ca9f8-1cc6-4972-882e-34937122d5e4] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:58:17.659352 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5674a9f7-1556-49ac-a3f5-ceb05c484942 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:17.662071 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5674a9f7-1556-49ac-a3f5-ceb05c484942 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:17.662586 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5674a9f7-1556-49ac-a3f5-ceb05c484942 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:17.665732 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5674a9f7-1556-49ac-a3f5-ceb05c484942 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:17.666797 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5674a9f7-1556-49ac-a3f5-ceb05c484942 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:17.667263 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5674a9f7-1556-49ac-a3f5-ceb05c484942 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:17.735132 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-5674a9f7-1556-49ac-a3f5-ceb05c484942 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] [instance: f51ca9f8-1cc6-4972-882e-34937122d5e4] Going to try to terminate instance {{(pid=123595) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:58:17.912174 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-5674a9f7-1556-49ac-a3f5-ceb05c484942 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] 10.222.0.43 "DELETE /compute/v2.1/servers/f51ca9f8-1cc6-4972-882e-34937122d5e4" status: 204 len: 0 microversion: 2.1 time: 0.278058 Oct 04 18:58:17.914400 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2427/5184] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 18:58:17 2022] DELETE /compute/v2.1/servers/f51ca9f8-1cc6-4972-882e-34937122d5e4 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:58:17.948606 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-ce184317-b3c6-40fb-803e-cd52a5cac9dd tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:58:17.951957 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-ce184317-b3c6-40fb-803e-cd52a5cac9dd tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] [instance: f51ca9f8-1cc6-4972-882e-34937122d5e4] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:58:18.032078 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ce184317-b3c6-40fb-803e-cd52a5cac9dd tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:18.040394 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ce184317-b3c6-40fb-803e-cd52a5cac9dd tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:18.043840 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ce184317-b3c6-40fb-803e-cd52a5cac9dd tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:18.054641 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ce184317-b3c6-40fb-803e-cd52a5cac9dd tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:18.060821 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ce184317-b3c6-40fb-803e-cd52a5cac9dd tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:18.064581 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ce184317-b3c6-40fb-803e-cd52a5cac9dd tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:18.278708 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-059b85b4-8a0e-4d2b-ae43-5c90020acf6a tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1239637255", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452", "networks": [{"uuid": "91df923a-c834-4048-99c7-635628b98344"}], "key_name": "tempest-TestNetworkBasicOps-273614183", "security_groups": [{"name": "tempest-secgroup-smoke-821826684"}]}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:58:18.587101 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.network.neutron [None req-059b85b4-8a0e-4d2b-ae43-5c90020acf6a tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] validate_networks() for [('91df923a-c834-4048-99c7-635628b98344', None, None, None, None, None)] {{(pid=123595) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:58:19.199109 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-ce184317-b3c6-40fb-803e-cd52a5cac9dd tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da3b918706c14020910d5d0e97d96656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9330711915a4b7f9d0f3559f0f19083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:58:19.228600 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-ce184317-b3c6-40fb-803e-cd52a5cac9dd tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] 10.222.0.43 "GET /compute/v2.1/servers/f51ca9f8-1cc6-4972-882e-34937122d5e4" status: 200 len: 1812 microversion: 2.1 time: 1.298856 Oct 04 18:58:19.243853 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2758/5185] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:58:17 2022] GET /compute/v2.1/servers/f51ca9f8-1cc6-4972-882e-34937122d5e4 => generated 1812 bytes in 1323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:58:19.282446 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-eda17da5-d267-468e-8330-056e70a3fbda tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:58:19.283688 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-eda17da5-d267-468e-8330-056e70a3fbda tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 2a0f8968-daa5-4998-9e3e-4f94d6471b1f] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:58:19.317275 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-eda17da5-d267-468e-8330-056e70a3fbda tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:19.318477 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-eda17da5-d267-468e-8330-056e70a3fbda tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:19.319718 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-eda17da5-d267-468e-8330-056e70a3fbda tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:19.321227 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-eda17da5-d267-468e-8330-056e70a3fbda tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:19.322249 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-eda17da5-d267-468e-8330-056e70a3fbda tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:19.323280 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-eda17da5-d267-468e-8330-056e70a3fbda tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:19.377557 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-eda17da5-d267-468e-8330-056e70a3fbda tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] HTTP exception thrown: Instance 2a0f8968-daa5-4998-9e3e-4f94d6471b1f could not be found. Oct 04 18:58:19.387766 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-eda17da5-d267-468e-8330-056e70a3fbda tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Request method failure captured: Oct 04 18:58:19.387766 n-d-851028-13 devstack@n-api.service[123596]: request: DELETE /compute/v2.1/servers/2a0f8968-daa5-4998-9e3e-4f94d6471b1f HTTP/1.1 Oct 04 18:58:19.387766 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:58:19.387766 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:58:19.387766 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:58:19.387766 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 18:58:19.387766 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:58:19.387766 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:58:19.387766 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:58:19.387766 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:58:19.387766 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPIEZsAoFcr6P1AMHBWUo8LvryOn1l2-LYSKr4xgLCvHblWFuAiGVlStWcljkgzOc7-ldx7qv3C-2jYmQ32_Zk5yP28dI64Re9CsyHCLmsYfyJdD0-2_kU92lHK36Fs8oXqXU2FijNX-X4IYqe4GjOQDN7LB9zCeEIcrxQ2LRJFOwbQY Oct 04 18:58:19.387766 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:58:19.387766 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:58:19.387766 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:58:19.387766 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:58:19.387766 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:58:19.387766 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:58:19.387766 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: 1607b30b9f324abaa88aa29e04ef3ec4 Oct 04 18:58:19.387766 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-ServersNegativeTestJSON-708693932 Oct 04 18:58:19.387766 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 18:58:19.387766 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 18:58:19.387766 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/1607b30b9f324abaa88aa29e04ef3ec4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_1607b30b9f324abaa88aa29e04ef3ec4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1607b30b9f324abaa88aa29e04ef3ec4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1607b30b9f324abaa88aa29e04ef3ec4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:58:19.387766 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-ServersNegativeTestJSON-708693932 Oct 04 18:58:19.387766 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: 1607b30b9f324abaa88aa29e04ef3ec4 Oct 04 18:58:19.387766 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-ServersNegativeTestJSON-708693932 Oct 04 18:58:19.387766 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-ServersNegativeTestJSON-708693932-project Oct 04 18:58:19.387766 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:58:19.387766 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:58:19.387766 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 6f63f1ac147543dab34a28a22eb5936c Oct 04 18:58:19.387766 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-ServersNegativeTestJSON-708693932-project Oct 04 18:58:19.387766 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 18:58:19.387766 n-d-851028-13 devstack@n-api.service[123596]: exception: Instance 2a0f8968-daa5-4998-9e3e-4f94d6471b1f could not be found. Oct 04 18:58:19.387766 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': '2a0f8968-daa5-4998-9e3e-4f94d6471b1f'} Oct 04 18:58:19.387766 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:58:19.387766 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:58:19.387766 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:58:19.387766 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:58:19.387766 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:58:19.387766 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:58:19.387766 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:58:19.387766 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:58:19.387766 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:58:19.387766 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:58:19.387766 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a0f8968-daa5-4998-9e3e-4f94d6471b1f could not be found. Oct 04 18:58:19.387766 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:58:19.387766 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:58:19.387766 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:58:19.387766 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:58:19.387766 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:58:19.387766 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:58:19.387766 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:58:19.387766 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:58:19.387766 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:58:19.387766 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:58:19.387766 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:58:19.387766 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:58:19.387766 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:58:19.387766 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:58:19.387766 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:58:19.387766 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:58:19.387766 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:58:19.387766 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:58:19.396118 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a0f8968-daa5-4998-9e3e-4f94d6471b1f could not be found. Oct 04 18:58:19.396118 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:58:19.396118 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:58:19.396118 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:58:19.396118 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:58:19.396118 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:58:19.396118 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:58:19.396118 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:58:19.396118 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:58:19.396118 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a0f8968-daa5-4998-9e3e-4f94d6471b1f could not be found. Oct 04 18:58:19.396118 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:58:19.406866 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-eda17da5-d267-468e-8330-056e70a3fbda tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Returning 404 to user: Instance 2a0f8968-daa5-4998-9e3e-4f94d6471b1f could not be found. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:58:19.411878 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-eda17da5-d267-468e-8330-056e70a3fbda tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "DELETE /compute/v2.1/servers/2a0f8968-daa5-4998-9e3e-4f94d6471b1f" status: 404 len: 111 microversion: 2.1 time: 0.151872 Oct 04 18:58:19.416077 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2759/5186] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 18:58:19 2022] DELETE /compute/v2.1/servers/2a0f8968-daa5-4998-9e3e-4f94d6471b1f => generated 111 bytes in 158 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:58:19.434793 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-bb37bbbf-acb2-4fe6-b3cc-611b909729f4 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:58:19.435766 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-bb37bbbf-acb2-4fe6-b3cc-611b909729f4 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 2a0f8968-daa5-4998-9e3e-4f94d6471b1f] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:58:19.464803 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bb37bbbf-acb2-4fe6-b3cc-611b909729f4 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:19.465661 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bb37bbbf-acb2-4fe6-b3cc-611b909729f4 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:19.466397 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bb37bbbf-acb2-4fe6-b3cc-611b909729f4 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:19.467602 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bb37bbbf-acb2-4fe6-b3cc-611b909729f4 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:19.468390 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bb37bbbf-acb2-4fe6-b3cc-611b909729f4 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:19.469148 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bb37bbbf-acb2-4fe6-b3cc-611b909729f4 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:19.524622 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-bb37bbbf-acb2-4fe6-b3cc-611b909729f4 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] HTTP exception thrown: Instance 2a0f8968-daa5-4998-9e3e-4f94d6471b1f could not be found. Oct 04 18:58:19.536903 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-bb37bbbf-acb2-4fe6-b3cc-611b909729f4 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Request method failure captured: Oct 04 18:58:19.536903 n-d-851028-13 devstack@n-api.service[123596]: request: GET /compute/v2.1/servers/2a0f8968-daa5-4998-9e3e-4f94d6471b1f HTTP/1.1 Oct 04 18:58:19.536903 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:58:19.536903 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:58:19.536903 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:58:19.536903 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 18:58:19.536903 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:58:19.536903 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:58:19.536903 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:58:19.536903 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:58:19.536903 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPIEZsAoFcr6P1AMHBWUo8LvryOn1l2-LYSKr4xgLCvHblWFuAiGVlStWcljkgzOc7-ldx7qv3C-2jYmQ32_Zk5yP28dI64Re9CsyHCLmsYfyJdD0-2_kU92lHK36Fs8oXqXU2FijNX-X4IYqe4GjOQDN7LB9zCeEIcrxQ2LRJFOwbQY Oct 04 18:58:19.536903 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:58:19.536903 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:58:19.536903 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:58:19.536903 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:58:19.536903 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:58:19.536903 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:58:19.536903 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: 1607b30b9f324abaa88aa29e04ef3ec4 Oct 04 18:58:19.536903 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-ServersNegativeTestJSON-708693932 Oct 04 18:58:19.536903 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 18:58:19.536903 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 18:58:19.536903 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/1607b30b9f324abaa88aa29e04ef3ec4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_1607b30b9f324abaa88aa29e04ef3ec4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1607b30b9f324abaa88aa29e04ef3ec4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1607b30b9f324abaa88aa29e04ef3ec4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:58:19.536903 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-ServersNegativeTestJSON-708693932 Oct 04 18:58:19.536903 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: 1607b30b9f324abaa88aa29e04ef3ec4 Oct 04 18:58:19.536903 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-ServersNegativeTestJSON-708693932 Oct 04 18:58:19.536903 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-ServersNegativeTestJSON-708693932-project Oct 04 18:58:19.536903 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:58:19.536903 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:58:19.536903 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 6f63f1ac147543dab34a28a22eb5936c Oct 04 18:58:19.536903 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-ServersNegativeTestJSON-708693932-project Oct 04 18:58:19.536903 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 18:58:19.536903 n-d-851028-13 devstack@n-api.service[123596]: exception: Instance 2a0f8968-daa5-4998-9e3e-4f94d6471b1f could not be found. Oct 04 18:58:19.536903 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': '2a0f8968-daa5-4998-9e3e-4f94d6471b1f'} Oct 04 18:58:19.536903 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:58:19.536903 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:58:19.536903 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:58:19.536903 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:58:19.536903 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:58:19.536903 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:58:19.536903 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:58:19.536903 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:58:19.536903 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:58:19.536903 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:58:19.536903 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a0f8968-daa5-4998-9e3e-4f94d6471b1f could not be found. Oct 04 18:58:19.536903 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:58:19.536903 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:58:19.536903 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:58:19.536903 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:58:19.536903 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:58:19.536903 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:58:19.536903 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:58:19.536903 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:58:19.536903 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:58:19.536903 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:58:19.536903 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:58:19.536903 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:58:19.536903 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:58:19.536903 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:58:19.536903 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:58:19.536903 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:58:19.536903 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a0f8968-daa5-4998-9e3e-4f94d6471b1f could not be found. Oct 04 18:58:19.536903 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:58:19.536903 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:58:19.536903 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:58:19.540249 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:58:19.540249 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:58:19.540249 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:58:19.540249 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:58:19.540249 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:58:19.540249 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a0f8968-daa5-4998-9e3e-4f94d6471b1f could not be found. Oct 04 18:58:19.540249 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:58:19.540249 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-bb37bbbf-acb2-4fe6-b3cc-611b909729f4 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Returning 404 to user: Instance 2a0f8968-daa5-4998-9e3e-4f94d6471b1f could not be found. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:58:19.545042 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-bb37bbbf-acb2-4fe6-b3cc-611b909729f4 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "GET /compute/v2.1/servers/2a0f8968-daa5-4998-9e3e-4f94d6471b1f" status: 404 len: 111 microversion: 2.1 time: 0.122320 Oct 04 18:58:19.546050 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2760/5187] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:58:19 2022] GET /compute/v2.1/servers/2a0f8968-daa5-4998-9e3e-4f94d6471b1f => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:58:19.565575 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-8e7baa7e-6cde-47fd-8a9c-0ec40dec4e77 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:58:19.566383 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-8e7baa7e-6cde-47fd-8a9c-0ec40dec4e77 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 01e250ab-d9aa-4708-ae36-10c53a411a40] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:58:19.593262 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8e7baa7e-6cde-47fd-8a9c-0ec40dec4e77 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:19.594047 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8e7baa7e-6cde-47fd-8a9c-0ec40dec4e77 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:19.594941 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8e7baa7e-6cde-47fd-8a9c-0ec40dec4e77 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:19.596556 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8e7baa7e-6cde-47fd-8a9c-0ec40dec4e77 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:19.624752 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8e7baa7e-6cde-47fd-8a9c-0ec40dec4e77 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:19.625399 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8e7baa7e-6cde-47fd-8a9c-0ec40dec4e77 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:19.690220 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-8e7baa7e-6cde-47fd-8a9c-0ec40dec4e77 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 01e250ab-d9aa-4708-ae36-10c53a411a40] Going to try to terminate instance {{(pid=123596) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:58:19.693498 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:58:19.703735 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-059b85b4-8a0e-4d2b-ae43-5c90020acf6a tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Flavor limits 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:58:19.704597 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-059b85b4-8a0e-4d2b-ae43-5c90020acf6a tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Image limits 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:58:19.705301 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-059b85b4-8a0e-4d2b-ae43-5c90020acf6a tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Flavor pref 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:58:19.705894 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-059b85b4-8a0e-4d2b-ae43-5c90020acf6a tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Image pref 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:58:19.706477 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-059b85b4-8a0e-4d2b-ae43-5c90020acf6a tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:58:19.721629 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-059b85b4-8a0e-4d2b-ae43-5c90020acf6a tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:19.722226 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-059b85b4-8a0e-4d2b-ae43-5c90020acf6a tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:19.722782 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-059b85b4-8a0e-4d2b-ae43-5c90020acf6a tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:19.723599 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-059b85b4-8a0e-4d2b-ae43-5c90020acf6a tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:19.724143 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-059b85b4-8a0e-4d2b-ae43-5c90020acf6a tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:19.724818 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-059b85b4-8a0e-4d2b-ae43-5c90020acf6a tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:19.777898 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-059b85b4-8a0e-4d2b-ae43-5c90020acf6a tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Getting quotas for project 27a4c327763b4440a9dc456cfbb31f88. Resources: {'ram', 'cores', 'instances'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:58:19.793797 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-059b85b4-8a0e-4d2b-ae43-5c90020acf6a tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Getting quotas for user fc1bb492fb294837b1e55d58bbfa3d0b and project 27a4c327763b4440a9dc456cfbb31f88. Resources: {'ram', 'cores', 'instances'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:58:19.824661 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-059b85b4-8a0e-4d2b-ae43-5c90020acf6a tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Going to run 1 instances... {{(pid=123595) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:58:19.831142 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-059b85b4-8a0e-4d2b-ae43-5c90020acf6a tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] [instance: adaf9f7d-b52e-445b-9755-18300a401904] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e8943ec5-4038-4d4b-b9b9-2415a79f5243',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:58:19.906487 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-8e7baa7e-6cde-47fd-8a9c-0ec40dec4e77 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "DELETE /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40" status: 204 len: 0 microversion: 2.1 time: 0.347554 Oct 04 18:58:19.907295 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2761/5188] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 18:58:19 2022] DELETE /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:58:19.918150 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-7d13159b-2460-41ce-8871-64a1cf088081 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:58:19.919244 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-7d13159b-2460-41ce-8871-64a1cf088081 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 01e250ab-d9aa-4708-ae36-10c53a411a40] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:58:19.927025 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7d13159b-2460-41ce-8871-64a1cf088081 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:19.928082 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7d13159b-2460-41ce-8871-64a1cf088081 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:19.930289 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7d13159b-2460-41ce-8871-64a1cf088081 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:19.933818 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7d13159b-2460-41ce-8871-64a1cf088081 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:19.934732 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7d13159b-2460-41ce-8871-64a1cf088081 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:19.935372 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7d13159b-2460-41ce-8871-64a1cf088081 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:19.964445 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-059b85b4-8a0e-4d2b-ae43-5c90020acf6a tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.701230 Oct 04 18:58:19.967789 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2428/5189] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 18:58:18 2022] POST /compute/v2.1/servers => generated 405 bytes in 1706 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:58:19.981217 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-ed53595d-ccec-42db-af0a-3aa24d8d62c2 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:58:19.985288 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-ed53595d-ccec-42db-af0a-3aa24d8d62c2 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] [instance: adaf9f7d-b52e-445b-9755-18300a401904] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:58:20.218524 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-ed53595d-ccec-42db-af0a-3aa24d8d62c2 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1bb492fb294837b1e55d58bbfa3d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a4c327763b4440a9dc456cfbb31f88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:58:20.229728 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-ed53595d-ccec-42db-af0a-3aa24d8d62c2 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] 10.222.0.43 "GET /compute/v2.1/servers/adaf9f7d-b52e-445b-9755-18300a401904" status: 200 len: 1248 microversion: 2.1 time: 0.256245 Oct 04 18:58:20.241537 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2429/5190] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:58:19 2022] GET /compute/v2.1/servers/adaf9f7d-b52e-445b-9755-18300a401904 => generated 1248 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:58:20.279176 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-f9ef8b08-b05a-4a6e-8c40-cd4d791fd17f tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:58:20.279950 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-f9ef8b08-b05a-4a6e-8c40-cd4d791fd17f tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] [instance: f51ca9f8-1cc6-4972-882e-34937122d5e4] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:58:20.295030 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f9ef8b08-b05a-4a6e-8c40-cd4d791fd17f tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:20.296443 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f9ef8b08-b05a-4a6e-8c40-cd4d791fd17f tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:20.298951 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f9ef8b08-b05a-4a6e-8c40-cd4d791fd17f tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:20.299952 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f9ef8b08-b05a-4a6e-8c40-cd4d791fd17f tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:20.302230 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f9ef8b08-b05a-4a6e-8c40-cd4d791fd17f tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:20.302939 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f9ef8b08-b05a-4a6e-8c40-cd4d791fd17f tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:20.667599 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-f9ef8b08-b05a-4a6e-8c40-cd4d791fd17f tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da3b918706c14020910d5d0e97d96656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9330711915a4b7f9d0f3559f0f19083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:58:20.682383 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-f9ef8b08-b05a-4a6e-8c40-cd4d791fd17f tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] 10.222.0.43 "GET /compute/v2.1/servers/f51ca9f8-1cc6-4972-882e-34937122d5e4" status: 200 len: 1812 microversion: 2.1 time: 0.407804 Oct 04 18:58:20.702788 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2430/5191] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:58:20 2022] GET /compute/v2.1/servers/f51ca9f8-1cc6-4972-882e-34937122d5e4 => generated 1812 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:58:20.734845 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-7d13159b-2460-41ce-8871-64a1cf088081 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f63f1ac147543dab34a28a22eb5936c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1607b30b9f324abaa88aa29e04ef3ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:58:20.755975 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-7d13159b-2460-41ce-8871-64a1cf088081 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40" status: 200 len: 1511 microversion: 2.1 time: 0.842920 Oct 04 18:58:20.765033 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2762/5192] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:58:19 2022] GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40 => generated 1511 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:58:21.001437 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-61761244-5d0c-4931-a516-873f994f58e7 req-e1a01df4-43a2-40c5-97e5-d56e5b547984 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f51ca9f8-1cc6-4972-882e-34937122d5e4", "name": "network-vif-deleted", "tag": "242eef97-7324-4879-9d7a-cda5914dde92"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:58:21.018300 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-61761244-5d0c-4931-a516-873f994f58e7 req-e1a01df4-43a2-40c5-97e5-d56e5b547984 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:21.019001 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-61761244-5d0c-4931-a516-873f994f58e7 req-e1a01df4-43a2-40c5-97e5-d56e5b547984 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:21.019590 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-61761244-5d0c-4931-a516-873f994f58e7 req-e1a01df4-43a2-40c5-97e5-d56e5b547984 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:21.049304 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-61761244-5d0c-4931-a516-873f994f58e7 req-e1a01df4-43a2-40c5-97e5-d56e5b547984 service nova] Creating event network-vif-deleted:242eef97-7324-4879-9d7a-cda5914dde92 for instance f51ca9f8-1cc6-4972-882e-34937122d5e4 on n-h1-851028-13 Oct 04 18:58:21.061930 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-61761244-5d0c-4931-a516-873f994f58e7 req-e1a01df4-43a2-40c5-97e5-d56e5b547984 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064555 Oct 04 18:58:21.062956 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2431/5193] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:58:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:58:21.256212 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-0afdbb2e-4ddb-4f24-b423-526adb12d377 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:58:21.256835 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-0afdbb2e-4ddb-4f24-b423-526adb12d377 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] [instance: adaf9f7d-b52e-445b-9755-18300a401904] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:58:21.274931 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0afdbb2e-4ddb-4f24-b423-526adb12d377 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:21.275466 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0afdbb2e-4ddb-4f24-b423-526adb12d377 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:21.276448 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0afdbb2e-4ddb-4f24-b423-526adb12d377 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:21.277233 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0afdbb2e-4ddb-4f24-b423-526adb12d377 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:21.277698 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0afdbb2e-4ddb-4f24-b423-526adb12d377 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:21.278137 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0afdbb2e-4ddb-4f24-b423-526adb12d377 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:21.419561 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-0afdbb2e-4ddb-4f24-b423-526adb12d377 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1bb492fb294837b1e55d58bbfa3d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a4c327763b4440a9dc456cfbb31f88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:58:21.440510 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-0afdbb2e-4ddb-4f24-b423-526adb12d377 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] 10.222.0.43 "GET /compute/v2.1/servers/adaf9f7d-b52e-445b-9755-18300a401904" status: 200 len: 1300 microversion: 2.1 time: 0.188196 Oct 04 18:58:21.442264 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2763/5194] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:58:21 2022] GET /compute/v2.1/servers/adaf9f7d-b52e-445b-9755-18300a401904 => generated 1300 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:58:21.710842 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-fb0704dc-9aee-4666-bf59-c272c1d32492 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:58:21.712489 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-fb0704dc-9aee-4666-bf59-c272c1d32492 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] [instance: f51ca9f8-1cc6-4972-882e-34937122d5e4] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:58:21.724231 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fb0704dc-9aee-4666-bf59-c272c1d32492 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:21.725202 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fb0704dc-9aee-4666-bf59-c272c1d32492 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:21.726082 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fb0704dc-9aee-4666-bf59-c272c1d32492 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:21.727685 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fb0704dc-9aee-4666-bf59-c272c1d32492 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:21.729437 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fb0704dc-9aee-4666-bf59-c272c1d32492 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:21.730401 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fb0704dc-9aee-4666-bf59-c272c1d32492 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:21.812406 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-924e7a75-cffe-42a3-b436-5f9c41f74610 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:58:21.814885 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-924e7a75-cffe-42a3-b436-5f9c41f74610 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 01e250ab-d9aa-4708-ae36-10c53a411a40] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:58:21.823625 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-924e7a75-cffe-42a3-b436-5f9c41f74610 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:21.824817 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-924e7a75-cffe-42a3-b436-5f9c41f74610 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:21.825743 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-924e7a75-cffe-42a3-b436-5f9c41f74610 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:21.826784 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-924e7a75-cffe-42a3-b436-5f9c41f74610 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:21.827640 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-924e7a75-cffe-42a3-b436-5f9c41f74610 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:21.828630 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-924e7a75-cffe-42a3-b436-5f9c41f74610 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:22.425039 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-fb0704dc-9aee-4666-bf59-c272c1d32492 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da3b918706c14020910d5d0e97d96656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9330711915a4b7f9d0f3559f0f19083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:58:22.441491 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-fb0704dc-9aee-4666-bf59-c272c1d32492 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] 10.222.0.43 "GET /compute/v2.1/servers/f51ca9f8-1cc6-4972-882e-34937122d5e4" status: 200 len: 1677 microversion: 2.1 time: 0.737088 Oct 04 18:58:22.445516 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2432/5195] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:58:21 2022] GET /compute/v2.1/servers/f51ca9f8-1cc6-4972-882e-34937122d5e4 => generated 1677 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:58:22.469731 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-d85cbeca-aa0f-4947-96fe-c74c5a1c9aea tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:58:22.470835 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-d85cbeca-aa0f-4947-96fe-c74c5a1c9aea tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] [instance: adaf9f7d-b52e-445b-9755-18300a401904] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:58:22.481682 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d85cbeca-aa0f-4947-96fe-c74c5a1c9aea tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:22.483518 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d85cbeca-aa0f-4947-96fe-c74c5a1c9aea tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:22.484086 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d85cbeca-aa0f-4947-96fe-c74c5a1c9aea tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:22.484916 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d85cbeca-aa0f-4947-96fe-c74c5a1c9aea tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:22.486584 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d85cbeca-aa0f-4947-96fe-c74c5a1c9aea tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:22.494234 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d85cbeca-aa0f-4947-96fe-c74c5a1c9aea tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:22.497928 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-924e7a75-cffe-42a3-b436-5f9c41f74610 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f63f1ac147543dab34a28a22eb5936c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1607b30b9f324abaa88aa29e04ef3ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:58:22.506568 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-924e7a75-cffe-42a3-b436-5f9c41f74610 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40" status: 200 len: 1511 microversion: 2.1 time: 0.699310 Oct 04 18:58:22.508568 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2764/5196] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:58:21 2022] GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40 => generated 1511 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:58:22.794694 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-d85cbeca-aa0f-4947-96fe-c74c5a1c9aea tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1bb492fb294837b1e55d58bbfa3d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a4c327763b4440a9dc456cfbb31f88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:58:22.807785 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-d85cbeca-aa0f-4947-96fe-c74c5a1c9aea tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] 10.222.0.43 "GET /compute/v2.1/servers/adaf9f7d-b52e-445b-9755-18300a401904" status: 200 len: 1306 microversion: 2.1 time: 0.342327 Oct 04 18:58:22.809743 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2433/5197] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:58:22 2022] GET /compute/v2.1/servers/adaf9f7d-b52e-445b-9755-18300a401904 => generated 1306 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:58:23.098546 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-3925c717-a6db-44d4-b31f-e75409c8ac48 req-29ca6538-d489-48f7-aa58-f5f58d11a3bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f51ca9f8-1cc6-4972-882e-34937122d5e4", "name": "network-vif-deleted", "tag": "1186a04d-7d24-44cb-8f63-e45471612dbb"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:58:23.111774 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-3925c717-a6db-44d4-b31f-e75409c8ac48 req-29ca6538-d489-48f7-aa58-f5f58d11a3bb service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:23.112445 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-3925c717-a6db-44d4-b31f-e75409c8ac48 req-29ca6538-d489-48f7-aa58-f5f58d11a3bb service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:23.113051 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-3925c717-a6db-44d4-b31f-e75409c8ac48 req-29ca6538-d489-48f7-aa58-f5f58d11a3bb service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:23.142419 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-3925c717-a6db-44d4-b31f-e75409c8ac48 req-29ca6538-d489-48f7-aa58-f5f58d11a3bb service nova] Creating event network-vif-deleted:1186a04d-7d24-44cb-8f63-e45471612dbb for instance f51ca9f8-1cc6-4972-882e-34937122d5e4 on n-h1-851028-13 Oct 04 18:58:23.153542 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-3925c717-a6db-44d4-b31f-e75409c8ac48 req-29ca6538-d489-48f7-aa58-f5f58d11a3bb service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058619 Oct 04 18:58:23.154169 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2765/5198] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:58:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:58:23.471796 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-2d630263-0a5f-444d-975d-10e22f25bd84 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:58:23.472537 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-2d630263-0a5f-444d-975d-10e22f25bd84 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] [instance: f51ca9f8-1cc6-4972-882e-34937122d5e4] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:58:23.487082 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2d630263-0a5f-444d-975d-10e22f25bd84 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:23.487577 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2d630263-0a5f-444d-975d-10e22f25bd84 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:23.491462 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2d630263-0a5f-444d-975d-10e22f25bd84 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:23.493422 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2d630263-0a5f-444d-975d-10e22f25bd84 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:23.493938 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2d630263-0a5f-444d-975d-10e22f25bd84 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:23.495208 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2d630263-0a5f-444d-975d-10e22f25bd84 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:23.636693 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-237a54d9-036f-47e4-8b04-152622d4cbfa tempest-VolumesActionsTest-1651127016 tempest-VolumesActionsTest-1651127016-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1563247616", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452", "networks": [{"uuid": "5512cffa-8fde-4f6b-8e6d-807debff6ce2"}]}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:58:23.736071 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.network.neutron [None req-237a54d9-036f-47e4-8b04-152622d4cbfa tempest-VolumesActionsTest-1651127016 tempest-VolumesActionsTest-1651127016-project] validate_networks() for [('5512cffa-8fde-4f6b-8e6d-807debff6ce2', None, None, None, None, None)] {{(pid=123595) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:58:24.272201 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-2d630263-0a5f-444d-975d-10e22f25bd84 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da3b918706c14020910d5d0e97d96656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9330711915a4b7f9d0f3559f0f19083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:58:24.274767 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=8 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:58:24.298135 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-2d630263-0a5f-444d-975d-10e22f25bd84 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] 10.222.0.43 "GET /compute/v2.1/servers/f51ca9f8-1cc6-4972-882e-34937122d5e4" status: 200 len: 1497 microversion: 2.1 time: 0.831681 Oct 04 18:58:24.299185 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2766/5199] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:58:23 2022] GET /compute/v2.1/servers/f51ca9f8-1cc6-4972-882e-34937122d5e4 => generated 1497 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:58:24.304226 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-69ff81e6-dbaf-4b7e-a648-e48b6966dc32 req-2b94dc4b-7a1e-46b6-aca5-a8c1e435b25d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f51ca9f8-1cc6-4972-882e-34937122d5e4", "name": "network-vif-unplugged", "status": "completed", "tag": "48f1dcfd-b029-4491-b22d-2a62a2891c97"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:58:24.331613 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-69ff81e6-dbaf-4b7e-a648-e48b6966dc32 req-2b94dc4b-7a1e-46b6-aca5-a8c1e435b25d service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:24.332328 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-69ff81e6-dbaf-4b7e-a648-e48b6966dc32 req-2b94dc4b-7a1e-46b6-aca5-a8c1e435b25d service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:24.332943 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-69ff81e6-dbaf-4b7e-a648-e48b6966dc32 req-2b94dc4b-7a1e-46b6-aca5-a8c1e435b25d service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:24.355099 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-69ff81e6-dbaf-4b7e-a648-e48b6966dc32 req-2b94dc4b-7a1e-46b6-aca5-a8c1e435b25d service nova] Creating event network-vif-unplugged:48f1dcfd-b029-4491-b22d-2a62a2891c97 for instance f51ca9f8-1cc6-4972-882e-34937122d5e4 on n-h1-851028-13 Oct 04 18:58:24.372379 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-69ff81e6-dbaf-4b7e-a648-e48b6966dc32 req-2b94dc4b-7a1e-46b6-aca5-a8c1e435b25d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.071550 Oct 04 18:58:24.374169 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2767/5200] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:58:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:58:24.384581 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-20a6dddf-231b-40f2-9120-f90d4799c3ea tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:58:24.386173 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-20a6dddf-231b-40f2-9120-f90d4799c3ea tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 01e250ab-d9aa-4708-ae36-10c53a411a40] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:58:24.395706 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-20a6dddf-231b-40f2-9120-f90d4799c3ea tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:24.399575 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-20a6dddf-231b-40f2-9120-f90d4799c3ea tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:24.401195 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-20a6dddf-231b-40f2-9120-f90d4799c3ea tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:24.402377 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-20a6dddf-231b-40f2-9120-f90d4799c3ea tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:24.403062 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-20a6dddf-231b-40f2-9120-f90d4799c3ea tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:24.403689 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-20a6dddf-231b-40f2-9120-f90d4799c3ea tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:24.470177 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-20a6dddf-231b-40f2-9120-f90d4799c3ea tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:24.472115 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-20a6dddf-231b-40f2-9120-f90d4799c3ea tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:24.472586 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-20a6dddf-231b-40f2-9120-f90d4799c3ea tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:24.475773 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.objects.instance [None req-20a6dddf-231b-40f2-9120-f90d4799c3ea tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lazy-loading 'fault' on Instance uuid 01e250ab-d9aa-4708-ae36-10c53a411a40 {{(pid=123596) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:58:24.617806 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-20a6dddf-231b-40f2-9120-f90d4799c3ea tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f63f1ac147543dab34a28a22eb5936c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1607b30b9f324abaa88aa29e04ef3ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:58:24.643173 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-20a6dddf-231b-40f2-9120-f90d4799c3ea tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40" status: 200 len: 1306 microversion: 2.1 time: 0.263490 Oct 04 18:58:24.652018 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2768/5201] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:58:24 2022] GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40 => generated 1306 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:58:24.678618 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-7f2eb777-5697-4eb6-842a-648ea3e000ef tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:58:24.679448 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-7f2eb777-5697-4eb6-842a-648ea3e000ef tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] [instance: adaf9f7d-b52e-445b-9755-18300a401904] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:58:24.689240 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7f2eb777-5697-4eb6-842a-648ea3e000ef tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:24.690145 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7f2eb777-5697-4eb6-842a-648ea3e000ef tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:24.691460 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7f2eb777-5697-4eb6-842a-648ea3e000ef tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:24.693760 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7f2eb777-5697-4eb6-842a-648ea3e000ef tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:24.694514 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7f2eb777-5697-4eb6-842a-648ea3e000ef tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:24.695312 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7f2eb777-5697-4eb6-842a-648ea3e000ef tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:24.820478 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-7f2eb777-5697-4eb6-842a-648ea3e000ef tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1bb492fb294837b1e55d58bbfa3d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a4c327763b4440a9dc456cfbb31f88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:58:24.834815 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-7f2eb777-5697-4eb6-842a-648ea3e000ef tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] 10.222.0.43 "GET /compute/v2.1/servers/adaf9f7d-b52e-445b-9755-18300a401904" status: 200 len: 1306 microversion: 2.1 time: 0.181477 Oct 04 18:58:24.837391 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2769/5202] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:58:24 2022] GET /compute/v2.1/servers/adaf9f7d-b52e-445b-9755-18300a401904 => generated 1306 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:58:25.183341 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-237a54d9-036f-47e4-8b04-152622d4cbfa tempest-VolumesActionsTest-1651127016 tempest-VolumesActionsTest-1651127016-project] Flavor limits 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:58:25.184034 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-237a54d9-036f-47e4-8b04-152622d4cbfa tempest-VolumesActionsTest-1651127016 tempest-VolumesActionsTest-1651127016-project] Image limits 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:58:25.184842 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-237a54d9-036f-47e4-8b04-152622d4cbfa tempest-VolumesActionsTest-1651127016 tempest-VolumesActionsTest-1651127016-project] Flavor pref 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:58:25.185553 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-237a54d9-036f-47e4-8b04-152622d4cbfa tempest-VolumesActionsTest-1651127016 tempest-VolumesActionsTest-1651127016-project] Image pref 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:58:25.186117 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-237a54d9-036f-47e4-8b04-152622d4cbfa tempest-VolumesActionsTest-1651127016 tempest-VolumesActionsTest-1651127016-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:58:25.215471 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-237a54d9-036f-47e4-8b04-152622d4cbfa tempest-VolumesActionsTest-1651127016 tempest-VolumesActionsTest-1651127016-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:25.216127 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-237a54d9-036f-47e4-8b04-152622d4cbfa tempest-VolumesActionsTest-1651127016 tempest-VolumesActionsTest-1651127016-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:25.216681 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-237a54d9-036f-47e4-8b04-152622d4cbfa tempest-VolumesActionsTest-1651127016 tempest-VolumesActionsTest-1651127016-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:25.218365 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-237a54d9-036f-47e4-8b04-152622d4cbfa tempest-VolumesActionsTest-1651127016 tempest-VolumesActionsTest-1651127016-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:25.219512 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-237a54d9-036f-47e4-8b04-152622d4cbfa tempest-VolumesActionsTest-1651127016 tempest-VolumesActionsTest-1651127016-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:25.221841 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-237a54d9-036f-47e4-8b04-152622d4cbfa tempest-VolumesActionsTest-1651127016 tempest-VolumesActionsTest-1651127016-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:25.257885 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-9be9a051-1f33-435a-9e36-24664136d878 req-ceca57a6-51cf-4a1e-a2e1-7c61a79f12fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01e250ab-d9aa-4708-ae36-10c53a411a40", "name": "network-vif-deleted", "tag": "70d1b09a-03d8-41b4-9a82-fc7d75a3624a"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:58:25.264426 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-237a54d9-036f-47e4-8b04-152622d4cbfa tempest-VolumesActionsTest-1651127016 tempest-VolumesActionsTest-1651127016-project] Getting quotas for project 84c84797a89d498e88f49e87e39fc13a. Resources: {'ram', 'cores', 'instances'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:58:25.277510 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-237a54d9-036f-47e4-8b04-152622d4cbfa tempest-VolumesActionsTest-1651127016 tempest-VolumesActionsTest-1651127016-project] Getting quotas for user f9ee399f54e845c58502a36cfca64497 and project 84c84797a89d498e88f49e87e39fc13a. Resources: {'ram', 'cores', 'instances'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:58:25.279861 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-9be9a051-1f33-435a-9e36-24664136d878 req-ceca57a6-51cf-4a1e-a2e1-7c61a79f12fc service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:25.281175 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-9be9a051-1f33-435a-9e36-24664136d878 req-ceca57a6-51cf-4a1e-a2e1-7c61a79f12fc service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:25.281806 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-9be9a051-1f33-435a-9e36-24664136d878 req-ceca57a6-51cf-4a1e-a2e1-7c61a79f12fc service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:25.305089 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-9be9a051-1f33-435a-9e36-24664136d878 req-ceca57a6-51cf-4a1e-a2e1-7c61a79f12fc service nova] Creating event network-vif-deleted:70d1b09a-03d8-41b4-9a82-fc7d75a3624a for instance 01e250ab-d9aa-4708-ae36-10c53a411a40 on n-h1-851028-13 Oct 04 18:58:25.308123 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-237a54d9-036f-47e4-8b04-152622d4cbfa tempest-VolumesActionsTest-1651127016 tempest-VolumesActionsTest-1651127016-project] Going to run 1 instances... {{(pid=123595) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:58:25.314556 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-237a54d9-036f-47e4-8b04-152622d4cbfa tempest-VolumesActionsTest-1651127016 tempest-VolumesActionsTest-1651127016-project] [instance: 43b9ca6e-0970-42c8-b494-4970fcc786d1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e8943ec5-4038-4d4b-b9b9-2415a79f5243',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:58:25.315237 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-9be9a051-1f33-435a-9e36-24664136d878 req-ceca57a6-51cf-4a1e-a2e1-7c61a79f12fc service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.476024 Oct 04 18:58:25.317739 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2770/5203] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:58:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:58:25.343261 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-11f368ad-d5d9-4aac-b5d4-53b14991a76c tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1372515382", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3f21e827-5829-48b0-82ff-093e57296b22"}], "security_groups": [{"name": "tempest-securitygroup--862872724"}], "key_name": "tempest-keypair-1445986333", "user_data": "}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:58:25.418427 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-237a54d9-036f-47e4-8b04-152622d4cbfa tempest-VolumesActionsTest-1651127016 tempest-VolumesActionsTest-1651127016-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.144781 Oct 04 18:58:25.430117 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2434/5204] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 18:58:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 2156 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:58:25.446068 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-9216961c-b67f-45ee-8ea2-fb26a4b82a89 req-8494824b-6d50-48e8-ab14-a8acd211d3a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f51ca9f8-1cc6-4972-882e-34937122d5e4", "name": "network-vif-deleted", "tag": "48f1dcfd-b029-4491-b22d-2a62a2891c97"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:58:25.457936 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-9216961c-b67f-45ee-8ea2-fb26a4b82a89 req-8494824b-6d50-48e8-ab14-a8acd211d3a1 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:25.458748 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-9216961c-b67f-45ee-8ea2-fb26a4b82a89 req-8494824b-6d50-48e8-ab14-a8acd211d3a1 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:25.459538 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-9216961c-b67f-45ee-8ea2-fb26a4b82a89 req-8494824b-6d50-48e8-ab14-a8acd211d3a1 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:25.474536 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-9216961c-b67f-45ee-8ea2-fb26a4b82a89 req-8494824b-6d50-48e8-ab14-a8acd211d3a1 service nova] Creating event network-vif-deleted:48f1dcfd-b029-4491-b22d-2a62a2891c97 for instance f51ca9f8-1cc6-4972-882e-34937122d5e4 on n-h1-851028-13 Oct 04 18:58:25.480683 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-9216961c-b67f-45ee-8ea2-fb26a4b82a89 req-8494824b-6d50-48e8-ab14-a8acd211d3a1 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045965 Oct 04 18:58:25.481669 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2435/5205] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:58:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:58:25.487236 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-cb0c7d3c-2118-4dc8-8ceb-7469b54577fa tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:58:25.488319 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-cb0c7d3c-2118-4dc8-8ceb-7469b54577fa tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] [instance: f51ca9f8-1cc6-4972-882e-34937122d5e4] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:58:25.497102 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cb0c7d3c-2118-4dc8-8ceb-7469b54577fa tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:25.498161 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cb0c7d3c-2118-4dc8-8ceb-7469b54577fa tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:25.499089 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cb0c7d3c-2118-4dc8-8ceb-7469b54577fa tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:25.501274 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cb0c7d3c-2118-4dc8-8ceb-7469b54577fa tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:25.502025 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cb0c7d3c-2118-4dc8-8ceb-7469b54577fa tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:25.502745 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cb0c7d3c-2118-4dc8-8ceb-7469b54577fa tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:25.592524 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cb0c7d3c-2118-4dc8-8ceb-7469b54577fa tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:25.594382 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cb0c7d3c-2118-4dc8-8ceb-7469b54577fa tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:25.595252 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cb0c7d3c-2118-4dc8-8ceb-7469b54577fa tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:25.596452 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.objects.instance [None req-cb0c7d3c-2118-4dc8-8ceb-7469b54577fa tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lazy-loading 'fault' on Instance uuid f51ca9f8-1cc6-4972-882e-34937122d5e4 {{(pid=123595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:58:25.719360 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.network.neutron [None req-11f368ad-d5d9-4aac-b5d4-53b14991a76c tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] validate_networks() for [('3f21e827-5829-48b0-82ff-093e57296b22', None, None, None, None, None)] {{(pid=123596) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:58:25.763508 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-cb0c7d3c-2118-4dc8-8ceb-7469b54577fa tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da3b918706c14020910d5d0e97d96656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9330711915a4b7f9d0f3559f0f19083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:58:25.774702 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-cb0c7d3c-2118-4dc8-8ceb-7469b54577fa tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] 10.222.0.43 "GET /compute/v2.1/servers/f51ca9f8-1cc6-4972-882e-34937122d5e4" status: 200 len: 1303 microversion: 2.1 time: 0.291559 Oct 04 18:58:25.793134 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2436/5206] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:58:25 2022] GET /compute/v2.1/servers/f51ca9f8-1cc6-4972-882e-34937122d5e4 => generated 1303 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:58:25.808337 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-38934e5c-30fe-4b08-b383-802a5ebbcd9b tempest-VolumesActionsTest-1651127016 tempest-VolumesActionsTest-1651127016-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:58:25.809561 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-38934e5c-30fe-4b08-b383-802a5ebbcd9b tempest-VolumesActionsTest-1651127016 tempest-VolumesActionsTest-1651127016-project] [instance: 43b9ca6e-0970-42c8-b494-4970fcc786d1] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:58:26.165828 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-38934e5c-30fe-4b08-b383-802a5ebbcd9b tempest-VolumesActionsTest-1651127016 tempest-VolumesActionsTest-1651127016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ee399f54e845c58502a36cfca64497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c84797a89d498e88f49e87e39fc13a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:58:26.173286 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-38934e5c-30fe-4b08-b383-802a5ebbcd9b tempest-VolumesActionsTest-1651127016 tempest-VolumesActionsTest-1651127016-project] 10.222.0.43 "GET /compute/v2.1/servers/43b9ca6e-0970-42c8-b494-4970fcc786d1" status: 200 len: 1214 microversion: 2.1 time: 0.389427 Oct 04 18:58:26.191649 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2437/5207] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:58:25 2022] GET /compute/v2.1/servers/43b9ca6e-0970-42c8-b494-4970fcc786d1 => generated 1214 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:58:26.203600 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-b891dd47-c5e5-4520-a780-a1c0037d9a25 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:58:26.204441 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-b891dd47-c5e5-4520-a780-a1c0037d9a25 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] [instance: 01e250ab-d9aa-4708-ae36-10c53a411a40] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:58:26.221526 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b891dd47-c5e5-4520-a780-a1c0037d9a25 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:26.225054 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b891dd47-c5e5-4520-a780-a1c0037d9a25 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:26.226376 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b891dd47-c5e5-4520-a780-a1c0037d9a25 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:26.227138 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b891dd47-c5e5-4520-a780-a1c0037d9a25 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:26.227700 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b891dd47-c5e5-4520-a780-a1c0037d9a25 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:26.228039 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b891dd47-c5e5-4520-a780-a1c0037d9a25 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:26.262409 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-b891dd47-c5e5-4520-a780-a1c0037d9a25 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] HTTP exception thrown: Instance 01e250ab-d9aa-4708-ae36-10c53a411a40 could not be found. Oct 04 18:58:26.264133 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-b891dd47-c5e5-4520-a780-a1c0037d9a25 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Request method failure captured: Oct 04 18:58:26.264133 n-d-851028-13 devstack@n-api.service[123595]: request: GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40 HTTP/1.1 Oct 04 18:58:26.264133 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 18:58:26.264133 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 18:58:26.264133 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 18:58:26.264133 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 0 Oct 04 18:58:26.264133 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 18:58:26.264133 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 18:58:26.264133 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 18:58:26.264133 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 18:58:26.264133 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPIEZsAoFcr6P1AMHBWUo8LvryOn1l2-LYSKr4xgLCvHblWFuAiGVlStWcljkgzOc7-ldx7qv3C-2jYmQ32_Zk5yP28dI64Re9CsyHCLmsYfyJdD0-2_kU92lHK36Fs8oXqXU2FijNX-X4IYqe4GjOQDN7LB9zCeEIcrxQ2LRJFOwbQY Oct 04 18:58:26.264133 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 18:58:26.264133 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 18:58:26.264133 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 18:58:26.264133 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 18:58:26.264133 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 18:58:26.264133 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 18:58:26.264133 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: 1607b30b9f324abaa88aa29e04ef3ec4 Oct 04 18:58:26.264133 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-ServersNegativeTestJSON-708693932 Oct 04 18:58:26.264133 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 18:58:26.264133 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 18:58:26.264133 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/1607b30b9f324abaa88aa29e04ef3ec4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_1607b30b9f324abaa88aa29e04ef3ec4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1607b30b9f324abaa88aa29e04ef3ec4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1607b30b9f324abaa88aa29e04ef3ec4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:58:26.264133 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-ServersNegativeTestJSON-708693932 Oct 04 18:58:26.264133 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: 1607b30b9f324abaa88aa29e04ef3ec4 Oct 04 18:58:26.264133 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-ServersNegativeTestJSON-708693932 Oct 04 18:58:26.264133 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-ServersNegativeTestJSON-708693932-project Oct 04 18:58:26.264133 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 18:58:26.264133 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 18:58:26.264133 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: 6f63f1ac147543dab34a28a22eb5936c Oct 04 18:58:26.264133 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-ServersNegativeTestJSON-708693932-project Oct 04 18:58:26.264133 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 18:58:26.264133 n-d-851028-13 devstack@n-api.service[123595]: exception: Instance 01e250ab-d9aa-4708-ae36-10c53a411a40 could not be found. Oct 04 18:58:26.264133 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': '01e250ab-d9aa-4708-ae36-10c53a411a40'} Oct 04 18:58:26.264133 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:58:26.264133 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:58:26.264133 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:58:26.264133 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:58:26.264133 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:58:26.264133 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:58:26.264133 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:58:26.264133 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:58:26.264133 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:58:26.264133 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:58:26.264133 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01e250ab-d9aa-4708-ae36-10c53a411a40 could not be found. Oct 04 18:58:26.264133 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:58:26.264133 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:58:26.264133 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:58:26.264133 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:58:26.264133 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:58:26.264133 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:58:26.264133 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:58:26.264133 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:58:26.264133 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:58:26.264133 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:58:26.264133 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:58:26.264133 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:58:26.264133 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:58:26.264133 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:58:26.264133 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:58:26.264133 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:58:26.264133 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01e250ab-d9aa-4708-ae36-10c53a411a40 could not be found. Oct 04 18:58:26.264133 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:58:26.264133 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:58:26.264133 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:58:26.267593 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:58:26.267593 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:58:26.267593 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:58:26.267593 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:58:26.267593 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:58:26.267593 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01e250ab-d9aa-4708-ae36-10c53a411a40 could not be found. Oct 04 18:58:26.267593 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:58:26.267593 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-b891dd47-c5e5-4520-a780-a1c0037d9a25 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] Returning 404 to user: Instance 01e250ab-d9aa-4708-ae36-10c53a411a40 could not be found. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:58:26.271771 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-b891dd47-c5e5-4520-a780-a1c0037d9a25 tempest-ServersNegativeTestJSON-708693932 tempest-ServersNegativeTestJSON-708693932-project] 10.222.0.43 "GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40" status: 404 len: 111 microversion: 2.1 time: 0.078362 Oct 04 18:58:26.273147 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2438/5208] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:58:26 2022] GET /compute/v2.1/servers/01e250ab-d9aa-4708-ae36-10c53a411a40 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:58:26.279096 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-0c14887c-51f3-4211-b503-6d1f53d55106 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:58:26.280046 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-0c14887c-51f3-4211-b503-6d1f53d55106 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] [instance: adaf9f7d-b52e-445b-9755-18300a401904] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:58:26.286614 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0c14887c-51f3-4211-b503-6d1f53d55106 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:26.287327 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0c14887c-51f3-4211-b503-6d1f53d55106 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:26.287951 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0c14887c-51f3-4211-b503-6d1f53d55106 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:26.288860 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0c14887c-51f3-4211-b503-6d1f53d55106 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:26.289683 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0c14887c-51f3-4211-b503-6d1f53d55106 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:26.290453 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0c14887c-51f3-4211-b503-6d1f53d55106 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:26.937653 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-11f368ad-d5d9-4aac-b5d4-53b14991a76c tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Flavor limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:58:26.938108 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-11f368ad-d5d9-4aac-b5d4-53b14991a76c tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Image limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:58:26.938482 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-11f368ad-d5d9-4aac-b5d4-53b14991a76c tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Flavor pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:58:26.938908 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-11f368ad-d5d9-4aac-b5d4-53b14991a76c tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Image pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:58:26.939364 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-11f368ad-d5d9-4aac-b5d4-53b14991a76c tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:58:26.960796 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-11f368ad-d5d9-4aac-b5d4-53b14991a76c tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:26.962522 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-11f368ad-d5d9-4aac-b5d4-53b14991a76c tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:26.965762 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-11f368ad-d5d9-4aac-b5d4-53b14991a76c tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:26.966793 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-11f368ad-d5d9-4aac-b5d4-53b14991a76c tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:26.968012 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-11f368ad-d5d9-4aac-b5d4-53b14991a76c tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:26.968675 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-11f368ad-d5d9-4aac-b5d4-53b14991a76c tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:27.010510 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=2 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:58:27.022507 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-11f368ad-d5d9-4aac-b5d4-53b14991a76c tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Getting quotas for project 6c91c7e7358048ffaaee7f51ad61b515. Resources: {'ram', 'cores', 'instances'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:58:27.032548 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-11f368ad-d5d9-4aac-b5d4-53b14991a76c tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Getting quotas for user 486c22456b1e47ae843ae41f8dfb2632 and project 6c91c7e7358048ffaaee7f51ad61b515. Resources: {'ram', 'cores', 'instances'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:58:27.056431 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-11f368ad-d5d9-4aac-b5d4-53b14991a76c tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Going to run 1 instances... {{(pid=123596) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:58:27.060908 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-11f368ad-d5d9-4aac-b5d4-53b14991a76c tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] [instance: 0ab8644c-b040-46c1-913b-46d595bde978] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e8943ec5-4038-4d4b-b9b9-2415a79f5243',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123596) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:58:27.243457 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-0c14887c-51f3-4211-b503-6d1f53d55106 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1bb492fb294837b1e55d58bbfa3d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a4c327763b4440a9dc456cfbb31f88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:58:27.260417 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-11f368ad-d5d9-4aac-b5d4-53b14991a76c tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.939796 Oct 04 18:58:27.266577 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2771/5209] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 18:58:25 2022] POST /compute/v2.1/servers => generated 401 bytes in 1948 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:58:27.276881 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-ac8478f4-8516-417c-bb79-cb820028d5b5 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:58:27.278727 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-ac8478f4-8516-417c-bb79-cb820028d5b5 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] [instance: f51ca9f8-1cc6-4972-882e-34937122d5e4] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:58:27.283044 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-0c14887c-51f3-4211-b503-6d1f53d55106 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] 10.222.0.43 "GET /compute/v2.1/servers/adaf9f7d-b52e-445b-9755-18300a401904" status: 200 len: 1373 microversion: 2.1 time: 1.008213 Oct 04 18:58:27.283665 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2439/5210] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:58:26 2022] GET /compute/v2.1/servers/adaf9f7d-b52e-445b-9755-18300a401904 => generated 1373 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:58:27.309026 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ac8478f4-8516-417c-bb79-cb820028d5b5 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:27.309832 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ac8478f4-8516-417c-bb79-cb820028d5b5 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:27.310510 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ac8478f4-8516-417c-bb79-cb820028d5b5 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:27.312711 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ac8478f4-8516-417c-bb79-cb820028d5b5 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:27.313422 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ac8478f4-8516-417c-bb79-cb820028d5b5 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:27.316421 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ac8478f4-8516-417c-bb79-cb820028d5b5 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:27.323553 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-d2f0f71e-9f89-4cf3-8eed-c5bcc378f691 tempest-VolumesActionsTest-1651127016 tempest-VolumesActionsTest-1651127016-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:58:27.324538 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-d2f0f71e-9f89-4cf3-8eed-c5bcc378f691 tempest-VolumesActionsTest-1651127016 tempest-VolumesActionsTest-1651127016-project] [instance: 43b9ca6e-0970-42c8-b494-4970fcc786d1] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:58:27.334760 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d2f0f71e-9f89-4cf3-8eed-c5bcc378f691 tempest-VolumesActionsTest-1651127016 tempest-VolumesActionsTest-1651127016-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:27.337028 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d2f0f71e-9f89-4cf3-8eed-c5bcc378f691 tempest-VolumesActionsTest-1651127016 tempest-VolumesActionsTest-1651127016-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:27.340302 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d2f0f71e-9f89-4cf3-8eed-c5bcc378f691 tempest-VolumesActionsTest-1651127016 tempest-VolumesActionsTest-1651127016-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:27.342014 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d2f0f71e-9f89-4cf3-8eed-c5bcc378f691 tempest-VolumesActionsTest-1651127016 tempest-VolumesActionsTest-1651127016-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:27.343022 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d2f0f71e-9f89-4cf3-8eed-c5bcc378f691 tempest-VolumesActionsTest-1651127016 tempest-VolumesActionsTest-1651127016-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:27.343663 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d2f0f71e-9f89-4cf3-8eed-c5bcc378f691 tempest-VolumesActionsTest-1651127016 tempest-VolumesActionsTest-1651127016-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:27.347944 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-ac8478f4-8516-417c-bb79-cb820028d5b5 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] HTTP exception thrown: Instance f51ca9f8-1cc6-4972-882e-34937122d5e4 could not be found. Oct 04 18:58:27.351427 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-ac8478f4-8516-417c-bb79-cb820028d5b5 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Request method failure captured: Oct 04 18:58:27.351427 n-d-851028-13 devstack@n-api.service[123596]: request: GET /compute/v2.1/servers/f51ca9f8-1cc6-4972-882e-34937122d5e4 HTTP/1.1 Oct 04 18:58:27.351427 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:58:27.351427 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:58:27.351427 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:58:27.351427 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 18:58:27.351427 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:58:27.351427 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:58:27.351427 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:58:27.351427 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:58:27.351427 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPIICP1PtS01HownqWweSgla4CcRPtCgAdUBaEdEc6vx8Ncus8eLhH3dUpUsQR0zHlOYk7gtTA9aUBKdVN35F_FIxu9OfoM4v3Fp57WQY2oesEAUq1sgUUAtkajJI3A6Mo7YDom3zBbqxWNa-Zc3eKb0_xGvtwa-4t27lLZncqqwgnro Oct 04 18:58:27.351427 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:58:27.351427 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:58:27.351427 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:58:27.351427 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:58:27.351427 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:58:27.351427 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:58:27.351427 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: a9330711915a4b7f9d0f3559f0f19083 Oct 04 18:58:27.351427 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-ServersTestMultiNic-2007496041 Oct 04 18:58:27.351427 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 18:58:27.351427 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 18:58:27.351427 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/a9330711915a4b7f9d0f3559f0f19083"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_a9330711915a4b7f9d0f3559f0f19083"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a9330711915a4b7f9d0f3559f0f19083"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a9330711915a4b7f9d0f3559f0f19083"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:58:27.351427 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-ServersTestMultiNic-2007496041 Oct 04 18:58:27.351427 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: a9330711915a4b7f9d0f3559f0f19083 Oct 04 18:58:27.351427 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-ServersTestMultiNic-2007496041 Oct 04 18:58:27.351427 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-ServersTestMultiNic-2007496041-project Oct 04 18:58:27.351427 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:58:27.351427 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:58:27.351427 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: da3b918706c14020910d5d0e97d96656 Oct 04 18:58:27.351427 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-ServersTestMultiNic-2007496041-project Oct 04 18:58:27.351427 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 18:58:27.351427 n-d-851028-13 devstack@n-api.service[123596]: exception: Instance f51ca9f8-1cc6-4972-882e-34937122d5e4 could not be found. Oct 04 18:58:27.351427 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': 'f51ca9f8-1cc6-4972-882e-34937122d5e4'} Oct 04 18:58:27.351427 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:58:27.351427 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:58:27.351427 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:58:27.351427 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:58:27.351427 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:58:27.351427 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:58:27.351427 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:58:27.351427 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:58:27.351427 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:58:27.351427 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:58:27.351427 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f51ca9f8-1cc6-4972-882e-34937122d5e4 could not be found. Oct 04 18:58:27.351427 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:58:27.351427 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:58:27.351427 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:58:27.351427 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:58:27.351427 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:58:27.351427 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:58:27.351427 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:58:27.351427 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:58:27.351427 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:58:27.351427 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:58:27.351427 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:58:27.351427 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:58:27.351427 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:58:27.351427 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:58:27.351427 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:58:27.351427 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:58:27.351427 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f51ca9f8-1cc6-4972-882e-34937122d5e4 could not be found. Oct 04 18:58:27.351427 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:58:27.351427 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:58:27.351427 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:58:27.356459 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:58:27.356459 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:58:27.356459 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:58:27.356459 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:58:27.356459 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:58:27.356459 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f51ca9f8-1cc6-4972-882e-34937122d5e4 could not be found. Oct 04 18:58:27.356459 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:58:27.361735 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-ac8478f4-8516-417c-bb79-cb820028d5b5 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Returning 404 to user: Instance f51ca9f8-1cc6-4972-882e-34937122d5e4 could not be found. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:58:27.362815 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-ac8478f4-8516-417c-bb79-cb820028d5b5 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] 10.222.0.43 "GET /compute/v2.1/servers/f51ca9f8-1cc6-4972-882e-34937122d5e4" status: 404 len: 111 microversion: 2.1 time: 0.094051 Oct 04 18:58:27.363907 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2772/5211] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:58:27 2022] GET /compute/v2.1/servers/f51ca9f8-1cc6-4972-882e-34937122d5e4 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:58:27.379127 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-3887c0e0-d8cc-4e40-b25e-c57d9fed60f8 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:58:27.382262 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-3887c0e0-d8cc-4e40-b25e-c57d9fed60f8 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] [instance: 0ab8644c-b040-46c1-913b-46d595bde978] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:58:27.685259 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-3887c0e0-d8cc-4e40-b25e-c57d9fed60f8 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '486c22456b1e47ae843ae41f8dfb2632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c91c7e7358048ffaaee7f51ad61b515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:58:27.704836 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-3887c0e0-d8cc-4e40-b25e-c57d9fed60f8 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] 10.222.0.43 "GET /compute/v2.1/servers/0ab8644c-b040-46c1-913b-46d595bde978" status: 200 len: 1242 microversion: 2.1 time: 0.339300 Oct 04 18:58:27.725656 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2773/5212] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:58:27 2022] GET /compute/v2.1/servers/0ab8644c-b040-46c1-913b-46d595bde978 => generated 1242 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:58:27.759863 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-d2f0f71e-9f89-4cf3-8eed-c5bcc378f691 tempest-VolumesActionsTest-1651127016 tempest-VolumesActionsTest-1651127016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ee399f54e845c58502a36cfca64497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c84797a89d498e88f49e87e39fc13a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:58:27.776687 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-d2f0f71e-9f89-4cf3-8eed-c5bcc378f691 tempest-VolumesActionsTest-1651127016 tempest-VolumesActionsTest-1651127016-project] 10.222.0.43 "GET /compute/v2.1/servers/43b9ca6e-0970-42c8-b494-4970fcc786d1" status: 200 len: 1266 microversion: 2.1 time: 0.476358 Oct 04 18:58:27.777910 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2440/5213] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:58:27 2022] GET /compute/v2.1/servers/43b9ca6e-0970-42c8-b494-4970fcc786d1 => generated 1266 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:58:28.310131 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-384f7834-6e60-4528-abcf-f2065cc62437 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:58:28.311531 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-384f7834-6e60-4528-abcf-f2065cc62437 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] [instance: adaf9f7d-b52e-445b-9755-18300a401904] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:58:28.332710 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-384f7834-6e60-4528-abcf-f2065cc62437 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:28.335480 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-384f7834-6e60-4528-abcf-f2065cc62437 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:28.336093 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-384f7834-6e60-4528-abcf-f2065cc62437 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:28.339314 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-384f7834-6e60-4528-abcf-f2065cc62437 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:28.340436 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-384f7834-6e60-4528-abcf-f2065cc62437 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:28.341061 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-384f7834-6e60-4528-abcf-f2065cc62437 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:28.740216 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-41c36364-764d-46ce-a63c-fc6817852a8b tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:58:28.741045 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-41c36364-764d-46ce-a63c-fc6817852a8b tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] [instance: 0ab8644c-b040-46c1-913b-46d595bde978] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:58:28.754663 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-41c36364-764d-46ce-a63c-fc6817852a8b tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:28.758553 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-41c36364-764d-46ce-a63c-fc6817852a8b tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:28.759283 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-41c36364-764d-46ce-a63c-fc6817852a8b tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:28.762023 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-41c36364-764d-46ce-a63c-fc6817852a8b tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:28.763754 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-41c36364-764d-46ce-a63c-fc6817852a8b tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:28.765590 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-41c36364-764d-46ce-a63c-fc6817852a8b tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:28.927658 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-41c36364-764d-46ce-a63c-fc6817852a8b tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '486c22456b1e47ae843ae41f8dfb2632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c91c7e7358048ffaaee7f51ad61b515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:58:28.943522 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-41c36364-764d-46ce-a63c-fc6817852a8b tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] 10.222.0.43 "GET /compute/v2.1/servers/0ab8644c-b040-46c1-913b-46d595bde978" status: 200 len: 1294 microversion: 2.1 time: 0.207407 Oct 04 18:58:28.946983 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2441/5214] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:58:28 2022] GET /compute/v2.1/servers/0ab8644c-b040-46c1-913b-46d595bde978 => generated 1294 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:58:28.958578 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-ae29ba5b-dcb3-41f3-b0a9-e8f26a206aad tempest-VolumesActionsTest-1651127016 tempest-VolumesActionsTest-1651127016-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:58:28.961791 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-ae29ba5b-dcb3-41f3-b0a9-e8f26a206aad tempest-VolumesActionsTest-1651127016 tempest-VolumesActionsTest-1651127016-project] [instance: 43b9ca6e-0970-42c8-b494-4970fcc786d1] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:58:28.966773 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:58:28.978444 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ae29ba5b-dcb3-41f3-b0a9-e8f26a206aad tempest-VolumesActionsTest-1651127016 tempest-VolumesActionsTest-1651127016-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:28.980017 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ae29ba5b-dcb3-41f3-b0a9-e8f26a206aad tempest-VolumesActionsTest-1651127016 tempest-VolumesActionsTest-1651127016-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:28.980671 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ae29ba5b-dcb3-41f3-b0a9-e8f26a206aad tempest-VolumesActionsTest-1651127016 tempest-VolumesActionsTest-1651127016-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:28.981637 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ae29ba5b-dcb3-41f3-b0a9-e8f26a206aad tempest-VolumesActionsTest-1651127016 tempest-VolumesActionsTest-1651127016-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:28.982267 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ae29ba5b-dcb3-41f3-b0a9-e8f26a206aad tempest-VolumesActionsTest-1651127016 tempest-VolumesActionsTest-1651127016-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:28.982853 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ae29ba5b-dcb3-41f3-b0a9-e8f26a206aad tempest-VolumesActionsTest-1651127016 tempest-VolumesActionsTest-1651127016-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:29.388938 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-ae29ba5b-dcb3-41f3-b0a9-e8f26a206aad tempest-VolumesActionsTest-1651127016 tempest-VolumesActionsTest-1651127016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ee399f54e845c58502a36cfca64497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c84797a89d498e88f49e87e39fc13a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:58:29.401760 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-ae29ba5b-dcb3-41f3-b0a9-e8f26a206aad tempest-VolumesActionsTest-1651127016 tempest-VolumesActionsTest-1651127016-project] 10.222.0.43 "GET /compute/v2.1/servers/43b9ca6e-0970-42c8-b494-4970fcc786d1" status: 200 len: 1272 microversion: 2.1 time: 0.450246 Oct 04 18:58:29.404049 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2442/5215] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:58:28 2022] GET /compute/v2.1/servers/43b9ca6e-0970-42c8-b494-4970fcc786d1 => generated 1272 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:58:29.415277 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-47dc05c4-f625-437a-90cf-58d6ba90bbaa req-3a6e4a48-3804-4b6c-aa56-07a1b9a3edfc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "adaf9f7d-b52e-445b-9755-18300a401904", "tag": "29dcc234-5990-4abd-b879-e25806c5fbe7"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:58:29.440038 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-47dc05c4-f625-437a-90cf-58d6ba90bbaa req-3a6e4a48-3804-4b6c-aa56-07a1b9a3edfc service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:29.441799 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-47dc05c4-f625-437a-90cf-58d6ba90bbaa req-3a6e4a48-3804-4b6c-aa56-07a1b9a3edfc service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:29.442610 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-47dc05c4-f625-437a-90cf-58d6ba90bbaa req-3a6e4a48-3804-4b6c-aa56-07a1b9a3edfc service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:29.464202 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-47dc05c4-f625-437a-90cf-58d6ba90bbaa req-3a6e4a48-3804-4b6c-aa56-07a1b9a3edfc service nova] Creating event network-changed:29dcc234-5990-4abd-b879-e25806c5fbe7 for instance adaf9f7d-b52e-445b-9755-18300a401904 on n-h2-851028-13 Oct 04 18:58:29.470602 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-47dc05c4-f625-437a-90cf-58d6ba90bbaa req-3a6e4a48-3804-4b6c-aa56-07a1b9a3edfc service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063981 Oct 04 18:58:29.483406 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2443/5216] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:58:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:58:29.522742 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-384f7834-6e60-4528-abcf-f2065cc62437 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1bb492fb294837b1e55d58bbfa3d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a4c327763b4440a9dc456cfbb31f88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:58:29.532061 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-384f7834-6e60-4528-abcf-f2065cc62437 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] 10.222.0.43 "GET /compute/v2.1/servers/adaf9f7d-b52e-445b-9755-18300a401904" status: 200 len: 1373 microversion: 2.1 time: 1.228179 Oct 04 18:58:29.555161 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2774/5217] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:58:28 2022] GET /compute/v2.1/servers/adaf9f7d-b52e-445b-9755-18300a401904 => generated 1373 bytes in 1252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:58:29.969358 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-df78fa3a-8b56-415e-92d2-1e2e8bd28d5c tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:58:29.970674 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-df78fa3a-8b56-415e-92d2-1e2e8bd28d5c tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] [instance: 0ab8644c-b040-46c1-913b-46d595bde978] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:58:29.982700 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-df78fa3a-8b56-415e-92d2-1e2e8bd28d5c tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:29.993456 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-df78fa3a-8b56-415e-92d2-1e2e8bd28d5c tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:29.994041 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-df78fa3a-8b56-415e-92d2-1e2e8bd28d5c tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:29.994834 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-df78fa3a-8b56-415e-92d2-1e2e8bd28d5c tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:29.995309 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-df78fa3a-8b56-415e-92d2-1e2e8bd28d5c tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:29.995933 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-df78fa3a-8b56-415e-92d2-1e2e8bd28d5c tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:30.430710 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-cfc64f9d-9881-4ba4-aaab-aea13252c4cb tempest-VolumesActionsTest-1651127016 tempest-VolumesActionsTest-1651127016-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:58:30.431965 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-cfc64f9d-9881-4ba4-aaab-aea13252c4cb tempest-VolumesActionsTest-1651127016 tempest-VolumesActionsTest-1651127016-project] [instance: 43b9ca6e-0970-42c8-b494-4970fcc786d1] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:58:30.449907 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cfc64f9d-9881-4ba4-aaab-aea13252c4cb tempest-VolumesActionsTest-1651127016 tempest-VolumesActionsTest-1651127016-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:30.450868 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cfc64f9d-9881-4ba4-aaab-aea13252c4cb tempest-VolumesActionsTest-1651127016 tempest-VolumesActionsTest-1651127016-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:30.451782 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cfc64f9d-9881-4ba4-aaab-aea13252c4cb tempest-VolumesActionsTest-1651127016 tempest-VolumesActionsTest-1651127016-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:30.453262 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cfc64f9d-9881-4ba4-aaab-aea13252c4cb tempest-VolumesActionsTest-1651127016 tempest-VolumesActionsTest-1651127016-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:30.454001 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cfc64f9d-9881-4ba4-aaab-aea13252c4cb tempest-VolumesActionsTest-1651127016 tempest-VolumesActionsTest-1651127016-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:30.454606 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cfc64f9d-9881-4ba4-aaab-aea13252c4cb tempest-VolumesActionsTest-1651127016 tempest-VolumesActionsTest-1651127016-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:30.613430 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-cfc64f9d-9881-4ba4-aaab-aea13252c4cb tempest-VolumesActionsTest-1651127016 tempest-VolumesActionsTest-1651127016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ee399f54e845c58502a36cfca64497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c84797a89d498e88f49e87e39fc13a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:58:30.626820 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-cfc64f9d-9881-4ba4-aaab-aea13252c4cb tempest-VolumesActionsTest-1651127016 tempest-VolumesActionsTest-1651127016-project] 10.222.0.43 "GET /compute/v2.1/servers/43b9ca6e-0970-42c8-b494-4970fcc786d1" status: 200 len: 1272 microversion: 2.1 time: 0.200138 Oct 04 18:58:30.627813 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2775/5218] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:58:30 2022] GET /compute/v2.1/servers/43b9ca6e-0970-42c8-b494-4970fcc786d1 => generated 1272 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:58:30.635686 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-8f241152-0cbb-4f87-8e6c-870803932fd5 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:58:30.636545 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-8f241152-0cbb-4f87-8e6c-870803932fd5 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] [instance: adaf9f7d-b52e-445b-9755-18300a401904] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:58:30.648643 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8f241152-0cbb-4f87-8e6c-870803932fd5 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:30.649186 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8f241152-0cbb-4f87-8e6c-870803932fd5 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:30.649705 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8f241152-0cbb-4f87-8e6c-870803932fd5 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:30.655715 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8f241152-0cbb-4f87-8e6c-870803932fd5 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:30.656467 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8f241152-0cbb-4f87-8e6c-870803932fd5 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:30.657336 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8f241152-0cbb-4f87-8e6c-870803932fd5 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:30.744680 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-df78fa3a-8b56-415e-92d2-1e2e8bd28d5c tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '486c22456b1e47ae843ae41f8dfb2632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c91c7e7358048ffaaee7f51ad61b515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:58:30.752830 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-df78fa3a-8b56-415e-92d2-1e2e8bd28d5c tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] 10.222.0.43 "GET /compute/v2.1/servers/0ab8644c-b040-46c1-913b-46d595bde978" status: 200 len: 1300 microversion: 2.1 time: 0.788069 Oct 04 18:58:30.769591 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2444/5219] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:58:29 2022] GET /compute/v2.1/servers/0ab8644c-b040-46c1-913b-46d595bde978 => generated 1300 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:58:31.149592 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-8f241152-0cbb-4f87-8e6c-870803932fd5 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1bb492fb294837b1e55d58bbfa3d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a4c327763b4440a9dc456cfbb31f88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:58:31.158744 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-8f241152-0cbb-4f87-8e6c-870803932fd5 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] 10.222.0.43 "GET /compute/v2.1/servers/adaf9f7d-b52e-445b-9755-18300a401904" status: 200 len: 1373 microversion: 2.1 time: 0.529770 Oct 04 18:58:31.159347 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2776/5220] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:58:30 2022] GET /compute/v2.1/servers/adaf9f7d-b52e-445b-9755-18300a401904 => generated 1373 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:58:31.651418 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-4c437f68-3a92-4776-8fae-891d3b411782 tempest-VolumesActionsTest-1651127016 tempest-VolumesActionsTest-1651127016-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:58:31.652710 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-4c437f68-3a92-4776-8fae-891d3b411782 tempest-VolumesActionsTest-1651127016 tempest-VolumesActionsTest-1651127016-project] [instance: 43b9ca6e-0970-42c8-b494-4970fcc786d1] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:58:31.665605 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4c437f68-3a92-4776-8fae-891d3b411782 tempest-VolumesActionsTest-1651127016 tempest-VolumesActionsTest-1651127016-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:31.678579 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4c437f68-3a92-4776-8fae-891d3b411782 tempest-VolumesActionsTest-1651127016 tempest-VolumesActionsTest-1651127016-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:31.679677 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4c437f68-3a92-4776-8fae-891d3b411782 tempest-VolumesActionsTest-1651127016 tempest-VolumesActionsTest-1651127016-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:31.680692 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4c437f68-3a92-4776-8fae-891d3b411782 tempest-VolumesActionsTest-1651127016 tempest-VolumesActionsTest-1651127016-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:31.682120 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4c437f68-3a92-4776-8fae-891d3b411782 tempest-VolumesActionsTest-1651127016 tempest-VolumesActionsTest-1651127016-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:31.682810 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4c437f68-3a92-4776-8fae-891d3b411782 tempest-VolumesActionsTest-1651127016 tempest-VolumesActionsTest-1651127016-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:31.786058 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-3252f756-b4f8-4b86-885b-75f1b9c905e9 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:58:31.790795 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-3252f756-b4f8-4b86-885b-75f1b9c905e9 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] [instance: 0ab8644c-b040-46c1-913b-46d595bde978] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:58:31.820642 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3252f756-b4f8-4b86-885b-75f1b9c905e9 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:31.821948 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3252f756-b4f8-4b86-885b-75f1b9c905e9 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:31.823252 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3252f756-b4f8-4b86-885b-75f1b9c905e9 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:31.824156 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3252f756-b4f8-4b86-885b-75f1b9c905e9 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:31.824894 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3252f756-b4f8-4b86-885b-75f1b9c905e9 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:31.825519 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3252f756-b4f8-4b86-885b-75f1b9c905e9 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:32.508585 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-4c437f68-3a92-4776-8fae-891d3b411782 tempest-VolumesActionsTest-1651127016 tempest-VolumesActionsTest-1651127016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ee399f54e845c58502a36cfca64497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c84797a89d498e88f49e87e39fc13a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:58:32.525612 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-4c437f68-3a92-4776-8fae-891d3b411782 tempest-VolumesActionsTest-1651127016 tempest-VolumesActionsTest-1651127016-project] 10.222.0.43 "GET /compute/v2.1/servers/43b9ca6e-0970-42c8-b494-4970fcc786d1" status: 200 len: 1314 microversion: 2.1 time: 0.878360 Oct 04 18:58:32.527091 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2445/5221] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:58:31 2022] GET /compute/v2.1/servers/43b9ca6e-0970-42c8-b494-4970fcc786d1 => generated 1314 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:58:32.534512 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-479f204e-8062-47f4-828e-35b72379a0c7 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:58:32.536639 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-479f204e-8062-47f4-828e-35b72379a0c7 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] [instance: adaf9f7d-b52e-445b-9755-18300a401904] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:58:32.546559 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-479f204e-8062-47f4-828e-35b72379a0c7 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:32.547957 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-479f204e-8062-47f4-828e-35b72379a0c7 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:32.550120 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-479f204e-8062-47f4-828e-35b72379a0c7 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:32.552599 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-479f204e-8062-47f4-828e-35b72379a0c7 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:32.554572 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-479f204e-8062-47f4-828e-35b72379a0c7 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:32.555675 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-479f204e-8062-47f4-828e-35b72379a0c7 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:32.570394 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:58:32.718534 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-3252f756-b4f8-4b86-885b-75f1b9c905e9 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '486c22456b1e47ae843ae41f8dfb2632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c91c7e7358048ffaaee7f51ad61b515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:58:32.732036 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-3252f756-b4f8-4b86-885b-75f1b9c905e9 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] 10.222.0.43 "GET /compute/v2.1/servers/0ab8644c-b040-46c1-913b-46d595bde978" status: 200 len: 1367 microversion: 2.1 time: 0.959432 Oct 04 18:58:32.733333 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2777/5222] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:58:31 2022] GET /compute/v2.1/servers/0ab8644c-b040-46c1-913b-46d595bde978 => generated 1367 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:58:33.053248 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-479f204e-8062-47f4-828e-35b72379a0c7 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1bb492fb294837b1e55d58bbfa3d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a4c327763b4440a9dc456cfbb31f88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:58:33.076238 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-479f204e-8062-47f4-828e-35b72379a0c7 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] 10.222.0.43 "GET /compute/v2.1/servers/adaf9f7d-b52e-445b-9755-18300a401904" status: 200 len: 1373 microversion: 2.1 time: 0.545919 Oct 04 18:58:33.080508 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2446/5223] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:58:32 2022] GET /compute/v2.1/servers/adaf9f7d-b52e-445b-9755-18300a401904 => generated 1373 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:58:33.556031 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-fd444a31-5ea1-4c7d-8e1f-38c0e957938c tempest-VolumesActionsTest-1651127016 tempest-VolumesActionsTest-1651127016-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:58:33.557422 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-fd444a31-5ea1-4c7d-8e1f-38c0e957938c tempest-VolumesActionsTest-1651127016 tempest-VolumesActionsTest-1651127016-project] [instance: 43b9ca6e-0970-42c8-b494-4970fcc786d1] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:58:33.584769 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fd444a31-5ea1-4c7d-8e1f-38c0e957938c tempest-VolumesActionsTest-1651127016 tempest-VolumesActionsTest-1651127016-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:33.585631 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fd444a31-5ea1-4c7d-8e1f-38c0e957938c tempest-VolumesActionsTest-1651127016 tempest-VolumesActionsTest-1651127016-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:33.586253 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fd444a31-5ea1-4c7d-8e1f-38c0e957938c tempest-VolumesActionsTest-1651127016 tempest-VolumesActionsTest-1651127016-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:33.587152 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fd444a31-5ea1-4c7d-8e1f-38c0e957938c tempest-VolumesActionsTest-1651127016 tempest-VolumesActionsTest-1651127016-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:33.587818 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fd444a31-5ea1-4c7d-8e1f-38c0e957938c tempest-VolumesActionsTest-1651127016 tempest-VolumesActionsTest-1651127016-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:33.588425 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fd444a31-5ea1-4c7d-8e1f-38c0e957938c tempest-VolumesActionsTest-1651127016 tempest-VolumesActionsTest-1651127016-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:33.762618 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-59caaf07-34bd-417c-910a-2d3f93b54ab8 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:58:33.763345 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-59caaf07-34bd-417c-910a-2d3f93b54ab8 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] [instance: 0ab8644c-b040-46c1-913b-46d595bde978] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:58:33.777423 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-59caaf07-34bd-417c-910a-2d3f93b54ab8 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:33.778207 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-59caaf07-34bd-417c-910a-2d3f93b54ab8 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:33.778671 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-59caaf07-34bd-417c-910a-2d3f93b54ab8 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:33.779418 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-59caaf07-34bd-417c-910a-2d3f93b54ab8 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:33.779879 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-59caaf07-34bd-417c-910a-2d3f93b54ab8 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:33.783843 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-59caaf07-34bd-417c-910a-2d3f93b54ab8 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:33.884552 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-fd444a31-5ea1-4c7d-8e1f-38c0e957938c tempest-VolumesActionsTest-1651127016 tempest-VolumesActionsTest-1651127016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ee399f54e845c58502a36cfca64497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c84797a89d498e88f49e87e39fc13a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:58:33.917458 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-fd444a31-5ea1-4c7d-8e1f-38c0e957938c tempest-VolumesActionsTest-1651127016 tempest-VolumesActionsTest-1651127016-project] 10.222.0.43 "GET /compute/v2.1/servers/43b9ca6e-0970-42c8-b494-4970fcc786d1" status: 200 len: 1314 microversion: 2.1 time: 0.361923 Oct 04 18:58:33.932852 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2778/5224] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:58:33 2022] GET /compute/v2.1/servers/43b9ca6e-0970-42c8-b494-4970fcc786d1 => generated 1314 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:58:33.933769 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-1e815c8a-b24c-4f9b-a281-49cf633fac23 req-06dac798-5a76-4dee-9da1-891c20917100 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43b9ca6e-0970-42c8-b494-4970fcc786d1", "tag": "a07e609a-e53b-4093-8ae9-63bae2162134"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:58:33.957058 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-1e815c8a-b24c-4f9b-a281-49cf633fac23 req-06dac798-5a76-4dee-9da1-891c20917100 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:33.958430 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-1e815c8a-b24c-4f9b-a281-49cf633fac23 req-06dac798-5a76-4dee-9da1-891c20917100 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:33.959266 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-1e815c8a-b24c-4f9b-a281-49cf633fac23 req-06dac798-5a76-4dee-9da1-891c20917100 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:33.975435 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-1e815c8a-b24c-4f9b-a281-49cf633fac23 req-06dac798-5a76-4dee-9da1-891c20917100 service nova] Creating event network-changed:a07e609a-e53b-4093-8ae9-63bae2162134 for instance 43b9ca6e-0970-42c8-b494-4970fcc786d1 on n-h1-851028-13 Oct 04 18:58:33.983398 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-1e815c8a-b24c-4f9b-a281-49cf633fac23 req-06dac798-5a76-4dee-9da1-891c20917100 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061607 Oct 04 18:58:33.984842 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2779/5225] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:58:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:58:34.112051 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f0e569d3-675e-46e1-8510-34352aa3fcbe tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:58:34.113667 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-f0e569d3-675e-46e1-8510-34352aa3fcbe tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] [instance: adaf9f7d-b52e-445b-9755-18300a401904] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:58:34.128580 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f0e569d3-675e-46e1-8510-34352aa3fcbe tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:34.129282 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f0e569d3-675e-46e1-8510-34352aa3fcbe tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:34.129853 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f0e569d3-675e-46e1-8510-34352aa3fcbe tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:34.130727 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f0e569d3-675e-46e1-8510-34352aa3fcbe tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:34.134880 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f0e569d3-675e-46e1-8510-34352aa3fcbe tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:34.135586 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f0e569d3-675e-46e1-8510-34352aa3fcbe tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:34.307637 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-59caaf07-34bd-417c-910a-2d3f93b54ab8 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '486c22456b1e47ae843ae41f8dfb2632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c91c7e7358048ffaaee7f51ad61b515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:58:34.323048 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-59caaf07-34bd-417c-910a-2d3f93b54ab8 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] 10.222.0.43 "GET /compute/v2.1/servers/0ab8644c-b040-46c1-913b-46d595bde978" status: 200 len: 1367 microversion: 2.1 time: 0.563821 Oct 04 18:58:34.323647 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2447/5226] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:58:33 2022] GET /compute/v2.1/servers/0ab8644c-b040-46c1-913b-46d595bde978 => generated 1367 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:58:34.832135 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-f0e569d3-675e-46e1-8510-34352aa3fcbe tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1bb492fb294837b1e55d58bbfa3d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a4c327763b4440a9dc456cfbb31f88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:58:34.865136 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-f0e569d3-675e-46e1-8510-34352aa3fcbe tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] 10.222.0.43 "GET /compute/v2.1/servers/adaf9f7d-b52e-445b-9755-18300a401904" status: 200 len: 1373 microversion: 2.1 time: 0.747592 Oct 04 18:58:34.892509 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2780/5227] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:58:34 2022] GET /compute/v2.1/servers/adaf9f7d-b52e-445b-9755-18300a401904 => generated 1373 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:58:34.948033 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-413e5361-2eda-402e-99f4-e21b48013682 tempest-VolumesActionsTest-1651127016 tempest-VolumesActionsTest-1651127016-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:58:34.950731 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-413e5361-2eda-402e-99f4-e21b48013682 tempest-VolumesActionsTest-1651127016 tempest-VolumesActionsTest-1651127016-project] [instance: 43b9ca6e-0970-42c8-b494-4970fcc786d1] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:58:34.968656 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-413e5361-2eda-402e-99f4-e21b48013682 tempest-VolumesActionsTest-1651127016 tempest-VolumesActionsTest-1651127016-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:34.975295 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-413e5361-2eda-402e-99f4-e21b48013682 tempest-VolumesActionsTest-1651127016 tempest-VolumesActionsTest-1651127016-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:34.976998 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-413e5361-2eda-402e-99f4-e21b48013682 tempest-VolumesActionsTest-1651127016 tempest-VolumesActionsTest-1651127016-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:34.981207 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-413e5361-2eda-402e-99f4-e21b48013682 tempest-VolumesActionsTest-1651127016 tempest-VolumesActionsTest-1651127016-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:34.982072 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-413e5361-2eda-402e-99f4-e21b48013682 tempest-VolumesActionsTest-1651127016 tempest-VolumesActionsTest-1651127016-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:34.982802 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-413e5361-2eda-402e-99f4-e21b48013682 tempest-VolumesActionsTest-1651127016 tempest-VolumesActionsTest-1651127016-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:35.241595 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=4 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:58:35.346829 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-5202c087-9984-4bcb-a5f2-32bb8920969d tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:58:35.347455 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-5202c087-9984-4bcb-a5f2-32bb8920969d tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] [instance: 0ab8644c-b040-46c1-913b-46d595bde978] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:58:35.358246 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5202c087-9984-4bcb-a5f2-32bb8920969d tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:35.358759 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5202c087-9984-4bcb-a5f2-32bb8920969d tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:35.359210 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5202c087-9984-4bcb-a5f2-32bb8920969d tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:35.359942 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5202c087-9984-4bcb-a5f2-32bb8920969d tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:35.360405 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5202c087-9984-4bcb-a5f2-32bb8920969d tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:35.360835 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5202c087-9984-4bcb-a5f2-32bb8920969d tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:35.401355 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:58:35.684353 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-413e5361-2eda-402e-99f4-e21b48013682 tempest-VolumesActionsTest-1651127016 tempest-VolumesActionsTest-1651127016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ee399f54e845c58502a36cfca64497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c84797a89d498e88f49e87e39fc13a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:58:35.705457 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-413e5361-2eda-402e-99f4-e21b48013682 tempest-VolumesActionsTest-1651127016 tempest-VolumesActionsTest-1651127016-project] 10.222.0.43 "GET /compute/v2.1/servers/43b9ca6e-0970-42c8-b494-4970fcc786d1" status: 200 len: 1314 microversion: 2.1 time: 0.763694 Oct 04 18:58:35.706852 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2448/5228] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:58:34 2022] GET /compute/v2.1/servers/43b9ca6e-0970-42c8-b494-4970fcc786d1 => generated 1314 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:58:35.809096 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-5202c087-9984-4bcb-a5f2-32bb8920969d tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '486c22456b1e47ae843ae41f8dfb2632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c91c7e7358048ffaaee7f51ad61b515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:58:35.821754 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-5202c087-9984-4bcb-a5f2-32bb8920969d tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] 10.222.0.43 "GET /compute/v2.1/servers/0ab8644c-b040-46c1-913b-46d595bde978" status: 200 len: 1367 microversion: 2.1 time: 0.478499 Oct 04 18:58:35.836378 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2781/5229] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:58:35 2022] GET /compute/v2.1/servers/0ab8644c-b040-46c1-913b-46d595bde978 => generated 1367 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:58:35.897265 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-981de2b3-3540-4a3b-9e57-45ea1dadac1e tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:58:35.897730 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-981de2b3-3540-4a3b-9e57-45ea1dadac1e tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] [instance: adaf9f7d-b52e-445b-9755-18300a401904] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:58:35.908519 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-981de2b3-3540-4a3b-9e57-45ea1dadac1e tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:35.911278 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-981de2b3-3540-4a3b-9e57-45ea1dadac1e tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:35.911909 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-981de2b3-3540-4a3b-9e57-45ea1dadac1e tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:35.912652 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-981de2b3-3540-4a3b-9e57-45ea1dadac1e tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:35.913155 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-981de2b3-3540-4a3b-9e57-45ea1dadac1e tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:35.915898 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-981de2b3-3540-4a3b-9e57-45ea1dadac1e tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:35.938410 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-784e2585-35ef-47fd-901a-01b94712d527 req-6f8c1a22-bf77-49c8-9acc-1955bcfdfeba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ab8644c-b040-46c1-913b-46d595bde978", "tag": "df4f4067-3e5a-4eeb-bc60-5f98df84527a"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:58:35.962493 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-784e2585-35ef-47fd-901a-01b94712d527 req-6f8c1a22-bf77-49c8-9acc-1955bcfdfeba service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:35.966940 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-784e2585-35ef-47fd-901a-01b94712d527 req-6f8c1a22-bf77-49c8-9acc-1955bcfdfeba service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:35.967437 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-784e2585-35ef-47fd-901a-01b94712d527 req-6f8c1a22-bf77-49c8-9acc-1955bcfdfeba service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:36.003374 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-784e2585-35ef-47fd-901a-01b94712d527 req-6f8c1a22-bf77-49c8-9acc-1955bcfdfeba service nova] Creating event network-changed:df4f4067-3e5a-4eeb-bc60-5f98df84527a for instance 0ab8644c-b040-46c1-913b-46d595bde978 on n-h1-851028-13 Oct 04 18:58:36.009432 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-784e2585-35ef-47fd-901a-01b94712d527 req-6f8c1a22-bf77-49c8-9acc-1955bcfdfeba service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079655 Oct 04 18:58:36.018680 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2782/5230] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:58:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:58:36.172910 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=16 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:58:36.482173 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-981de2b3-3540-4a3b-9e57-45ea1dadac1e tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1bb492fb294837b1e55d58bbfa3d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a4c327763b4440a9dc456cfbb31f88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:58:36.514685 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-981de2b3-3540-4a3b-9e57-45ea1dadac1e tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] 10.222.0.43 "GET /compute/v2.1/servers/adaf9f7d-b52e-445b-9755-18300a401904" status: 200 len: 1373 microversion: 2.1 time: 0.621856 Oct 04 18:58:36.516495 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2449/5231] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:58:35 2022] GET /compute/v2.1/servers/adaf9f7d-b52e-445b-9755-18300a401904 => generated 1373 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:58:36.736307 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-e16bd18b-354f-4a40-a2ac-8137a749c3ab tempest-VolumesActionsTest-1651127016 tempest-VolumesActionsTest-1651127016-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:58:36.737019 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-e16bd18b-354f-4a40-a2ac-8137a749c3ab tempest-VolumesActionsTest-1651127016 tempest-VolumesActionsTest-1651127016-project] [instance: 43b9ca6e-0970-42c8-b494-4970fcc786d1] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:58:36.751967 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e16bd18b-354f-4a40-a2ac-8137a749c3ab tempest-VolumesActionsTest-1651127016 tempest-VolumesActionsTest-1651127016-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:36.752460 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e16bd18b-354f-4a40-a2ac-8137a749c3ab tempest-VolumesActionsTest-1651127016 tempest-VolumesActionsTest-1651127016-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:36.752895 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e16bd18b-354f-4a40-a2ac-8137a749c3ab tempest-VolumesActionsTest-1651127016 tempest-VolumesActionsTest-1651127016-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:36.753791 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e16bd18b-354f-4a40-a2ac-8137a749c3ab tempest-VolumesActionsTest-1651127016 tempest-VolumesActionsTest-1651127016-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:36.756069 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e16bd18b-354f-4a40-a2ac-8137a749c3ab tempest-VolumesActionsTest-1651127016 tempest-VolumesActionsTest-1651127016-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:36.756702 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e16bd18b-354f-4a40-a2ac-8137a749c3ab tempest-VolumesActionsTest-1651127016 tempest-VolumesActionsTest-1651127016-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:36.849245 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-7b13c5c4-aa43-4c2b-bd16-2586888cac26 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:58:36.849854 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-7b13c5c4-aa43-4c2b-bd16-2586888cac26 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] [instance: 0ab8644c-b040-46c1-913b-46d595bde978] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:58:36.864599 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7b13c5c4-aa43-4c2b-bd16-2586888cac26 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:36.865201 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7b13c5c4-aa43-4c2b-bd16-2586888cac26 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:36.867482 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7b13c5c4-aa43-4c2b-bd16-2586888cac26 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:36.868659 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7b13c5c4-aa43-4c2b-bd16-2586888cac26 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:36.871212 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7b13c5c4-aa43-4c2b-bd16-2586888cac26 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:36.874332 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7b13c5c4-aa43-4c2b-bd16-2586888cac26 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:37.000014 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=2 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:58:37.549288 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-7b13c5c4-aa43-4c2b-bd16-2586888cac26 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '486c22456b1e47ae843ae41f8dfb2632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c91c7e7358048ffaaee7f51ad61b515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:58:37.557930 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-7b13c5c4-aa43-4c2b-bd16-2586888cac26 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] 10.222.0.43 "GET /compute/v2.1/servers/0ab8644c-b040-46c1-913b-46d595bde978" status: 200 len: 1367 microversion: 2.1 time: 0.713699 Oct 04 18:58:37.558526 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2450/5232] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:58:36 2022] GET /compute/v2.1/servers/0ab8644c-b040-46c1-913b-46d595bde978 => generated 1367 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:58:37.571517 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-5d552c93-d57e-489a-89b8-e6ce9422fe7a req-e3e94cbf-40e9-4125-95f4-b86826e35f27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "adaf9f7d-b52e-445b-9755-18300a401904", "name": "network-vif-plugged", "status": "completed", "tag": "29dcc234-5990-4abd-b879-e25806c5fbe7"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:58:37.596081 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-5d552c93-d57e-489a-89b8-e6ce9422fe7a req-e3e94cbf-40e9-4125-95f4-b86826e35f27 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:37.599592 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-5d552c93-d57e-489a-89b8-e6ce9422fe7a req-e3e94cbf-40e9-4125-95f4-b86826e35f27 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:37.601098 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-5d552c93-d57e-489a-89b8-e6ce9422fe7a req-e3e94cbf-40e9-4125-95f4-b86826e35f27 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:37.638307 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-5d552c93-d57e-489a-89b8-e6ce9422fe7a req-e3e94cbf-40e9-4125-95f4-b86826e35f27 service nova] Creating event network-vif-plugged:29dcc234-5990-4abd-b879-e25806c5fbe7 for instance adaf9f7d-b52e-445b-9755-18300a401904 on n-h2-851028-13 Oct 04 18:58:37.650741 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-5d552c93-d57e-489a-89b8-e6ce9422fe7a req-e3e94cbf-40e9-4125-95f4-b86826e35f27 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084504 Oct 04 18:58:37.654805 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2451/5233] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:58:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:58:37.670202 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-75d5b619-2d0c-4a2f-a632-95d19fe61417 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:58:37.673142 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-75d5b619-2d0c-4a2f-a632-95d19fe61417 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] [instance: adaf9f7d-b52e-445b-9755-18300a401904] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:58:37.696057 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=8 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:58:37.704576 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-75d5b619-2d0c-4a2f-a632-95d19fe61417 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:37.705086 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-75d5b619-2d0c-4a2f-a632-95d19fe61417 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:37.710475 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-75d5b619-2d0c-4a2f-a632-95d19fe61417 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:37.711249 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-75d5b619-2d0c-4a2f-a632-95d19fe61417 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:37.711728 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-75d5b619-2d0c-4a2f-a632-95d19fe61417 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:37.712168 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-75d5b619-2d0c-4a2f-a632-95d19fe61417 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:37.814850 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-e16bd18b-354f-4a40-a2ac-8137a749c3ab tempest-VolumesActionsTest-1651127016 tempest-VolumesActionsTest-1651127016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ee399f54e845c58502a36cfca64497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c84797a89d498e88f49e87e39fc13a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:58:37.825143 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-e16bd18b-354f-4a40-a2ac-8137a749c3ab tempest-VolumesActionsTest-1651127016 tempest-VolumesActionsTest-1651127016-project] 10.222.0.43 "GET /compute/v2.1/servers/43b9ca6e-0970-42c8-b494-4970fcc786d1" status: 200 len: 1314 microversion: 2.1 time: 1.094108 Oct 04 18:58:37.826770 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2783/5234] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:58:36 2022] GET /compute/v2.1/servers/43b9ca6e-0970-42c8-b494-4970fcc786d1 => generated 1314 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:58:38.362419 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-75d5b619-2d0c-4a2f-a632-95d19fe61417 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1bb492fb294837b1e55d58bbfa3d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a4c327763b4440a9dc456cfbb31f88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:58:38.374066 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-75d5b619-2d0c-4a2f-a632-95d19fe61417 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] 10.222.0.43 "GET /compute/v2.1/servers/adaf9f7d-b52e-445b-9755-18300a401904" status: 200 len: 1373 microversion: 2.1 time: 0.717340 Oct 04 18:58:38.375597 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2452/5235] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:58:37 2022] GET /compute/v2.1/servers/adaf9f7d-b52e-445b-9755-18300a401904 => generated 1373 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:58:38.583616 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-3da48942-5598-4702-9aee-a588ccd6fbc6 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:58:38.584228 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-3da48942-5598-4702-9aee-a588ccd6fbc6 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] [instance: 0ab8644c-b040-46c1-913b-46d595bde978] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:58:38.594061 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3da48942-5598-4702-9aee-a588ccd6fbc6 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:38.597076 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3da48942-5598-4702-9aee-a588ccd6fbc6 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:38.597762 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3da48942-5598-4702-9aee-a588ccd6fbc6 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:38.598688 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3da48942-5598-4702-9aee-a588ccd6fbc6 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:38.601606 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3da48942-5598-4702-9aee-a588ccd6fbc6 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:38.602259 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3da48942-5598-4702-9aee-a588ccd6fbc6 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:38.853196 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-61d4e021-acff-403b-bdc6-c68b54ddc674 tempest-VolumesActionsTest-1651127016 tempest-VolumesActionsTest-1651127016-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:58:38.854051 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-61d4e021-acff-403b-bdc6-c68b54ddc674 tempest-VolumesActionsTest-1651127016 tempest-VolumesActionsTest-1651127016-project] [instance: 43b9ca6e-0970-42c8-b494-4970fcc786d1] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:58:38.862909 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-61d4e021-acff-403b-bdc6-c68b54ddc674 tempest-VolumesActionsTest-1651127016 tempest-VolumesActionsTest-1651127016-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:38.863402 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-61d4e021-acff-403b-bdc6-c68b54ddc674 tempest-VolumesActionsTest-1651127016 tempest-VolumesActionsTest-1651127016-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:38.863838 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-61d4e021-acff-403b-bdc6-c68b54ddc674 tempest-VolumesActionsTest-1651127016 tempest-VolumesActionsTest-1651127016-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:38.870275 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-61d4e021-acff-403b-bdc6-c68b54ddc674 tempest-VolumesActionsTest-1651127016 tempest-VolumesActionsTest-1651127016-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:38.870922 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-61d4e021-acff-403b-bdc6-c68b54ddc674 tempest-VolumesActionsTest-1651127016 tempest-VolumesActionsTest-1651127016-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:38.871384 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-61d4e021-acff-403b-bdc6-c68b54ddc674 tempest-VolumesActionsTest-1651127016 tempest-VolumesActionsTest-1651127016-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:39.100002 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-3da48942-5598-4702-9aee-a588ccd6fbc6 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '486c22456b1e47ae843ae41f8dfb2632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c91c7e7358048ffaaee7f51ad61b515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:58:39.109322 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-3da48942-5598-4702-9aee-a588ccd6fbc6 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] 10.222.0.43 "GET /compute/v2.1/servers/0ab8644c-b040-46c1-913b-46d595bde978" status: 200 len: 1367 microversion: 2.1 time: 0.530258 Oct 04 18:58:39.110002 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2784/5236] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:58:38 2022] GET /compute/v2.1/servers/0ab8644c-b040-46c1-913b-46d595bde978 => generated 1367 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:58:39.206668 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-61d4e021-acff-403b-bdc6-c68b54ddc674 tempest-VolumesActionsTest-1651127016 tempest-VolumesActionsTest-1651127016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ee399f54e845c58502a36cfca64497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c84797a89d498e88f49e87e39fc13a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:58:39.220568 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-61d4e021-acff-403b-bdc6-c68b54ddc674 tempest-VolumesActionsTest-1651127016 tempest-VolumesActionsTest-1651127016-project] 10.222.0.43 "GET /compute/v2.1/servers/43b9ca6e-0970-42c8-b494-4970fcc786d1" status: 200 len: 1314 microversion: 2.1 time: 0.373874 Oct 04 18:58:39.234814 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2453/5237] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:58:38 2022] GET /compute/v2.1/servers/43b9ca6e-0970-42c8-b494-4970fcc786d1 => generated 1314 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:58:39.405906 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-0abcce91-39ef-41d4-9a31-424220465ac3 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:58:39.406867 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-0abcce91-39ef-41d4-9a31-424220465ac3 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] [instance: adaf9f7d-b52e-445b-9755-18300a401904] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:58:39.421624 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0abcce91-39ef-41d4-9a31-424220465ac3 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:39.424161 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0abcce91-39ef-41d4-9a31-424220465ac3 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:39.426043 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0abcce91-39ef-41d4-9a31-424220465ac3 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:39.428236 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0abcce91-39ef-41d4-9a31-424220465ac3 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:39.430945 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0abcce91-39ef-41d4-9a31-424220465ac3 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:39.432356 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0abcce91-39ef-41d4-9a31-424220465ac3 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:39.781461 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-0abcce91-39ef-41d4-9a31-424220465ac3 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1bb492fb294837b1e55d58bbfa3d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a4c327763b4440a9dc456cfbb31f88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:58:39.794122 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-0abcce91-39ef-41d4-9a31-424220465ac3 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] 10.222.0.43 "GET /compute/v2.1/servers/adaf9f7d-b52e-445b-9755-18300a401904" status: 200 len: 1545 microversion: 2.1 time: 0.392274 Oct 04 18:58:39.797911 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2785/5238] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:58:39 2022] GET /compute/v2.1/servers/adaf9f7d-b52e-445b-9755-18300a401904 => generated 1545 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:58:39.829924 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-1c2f718d-10af-4e3b-8d23-5b0eaab5c3a8 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:58:39.834796 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-1c2f718d-10af-4e3b-8d23-5b0eaab5c3a8 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] [instance: adaf9f7d-b52e-445b-9755-18300a401904] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:58:39.860374 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1c2f718d-10af-4e3b-8d23-5b0eaab5c3a8 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:39.861659 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1c2f718d-10af-4e3b-8d23-5b0eaab5c3a8 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:39.862350 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1c2f718d-10af-4e3b-8d23-5b0eaab5c3a8 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:39.866192 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1c2f718d-10af-4e3b-8d23-5b0eaab5c3a8 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:39.870295 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1c2f718d-10af-4e3b-8d23-5b0eaab5c3a8 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:39.871361 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1c2f718d-10af-4e3b-8d23-5b0eaab5c3a8 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:39.929704 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-a9437041-46c2-400a-a1a9-44c8c76ac560 req-29bc8b0d-d461-4ac2-8be2-ce55fa8253f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43b9ca6e-0970-42c8-b494-4970fcc786d1", "name": "network-vif-plugged", "status": "completed", "tag": "a07e609a-e53b-4093-8ae9-63bae2162134"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:58:39.969588 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-a9437041-46c2-400a-a1a9-44c8c76ac560 req-29bc8b0d-d461-4ac2-8be2-ce55fa8253f4 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:39.973521 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-a9437041-46c2-400a-a1a9-44c8c76ac560 req-29bc8b0d-d461-4ac2-8be2-ce55fa8253f4 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:39.977968 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-a9437041-46c2-400a-a1a9-44c8c76ac560 req-29bc8b0d-d461-4ac2-8be2-ce55fa8253f4 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:40.032746 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-a9437041-46c2-400a-a1a9-44c8c76ac560 req-29bc8b0d-d461-4ac2-8be2-ce55fa8253f4 service nova] Creating event network-vif-plugged:a07e609a-e53b-4093-8ae9-63bae2162134 for instance 43b9ca6e-0970-42c8-b494-4970fcc786d1 on n-h1-851028-13 Oct 04 18:58:40.070984 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-a9437041-46c2-400a-a1a9-44c8c76ac560 req-29bc8b0d-d461-4ac2-8be2-ce55fa8253f4 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129101 Oct 04 18:58:40.074198 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2786/5239] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:58:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:58:40.138547 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-a0640851-0ef8-406b-bf91-37fd7827a5da tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:58:40.139320 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-a0640851-0ef8-406b-bf91-37fd7827a5da tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] [instance: 0ab8644c-b040-46c1-913b-46d595bde978] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:58:40.150747 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a0640851-0ef8-406b-bf91-37fd7827a5da tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:40.150919 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a0640851-0ef8-406b-bf91-37fd7827a5da tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:40.151361 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a0640851-0ef8-406b-bf91-37fd7827a5da tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:40.152298 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a0640851-0ef8-406b-bf91-37fd7827a5da tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:40.152712 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a0640851-0ef8-406b-bf91-37fd7827a5da tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:40.153180 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a0640851-0ef8-406b-bf91-37fd7827a5da tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:40.550511 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-a0640851-0ef8-406b-bf91-37fd7827a5da tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '486c22456b1e47ae843ae41f8dfb2632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c91c7e7358048ffaaee7f51ad61b515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:58:40.576788 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-a0640851-0ef8-406b-bf91-37fd7827a5da tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] 10.222.0.43 "GET /compute/v2.1/servers/0ab8644c-b040-46c1-913b-46d595bde978" status: 200 len: 1367 microversion: 2.1 time: 0.443211 Oct 04 18:58:40.591451 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2787/5240] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:58:40 2022] GET /compute/v2.1/servers/0ab8644c-b040-46c1-913b-46d595bde978 => generated 1367 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:58:40.607709 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-e80522a1-f743-42b0-8e2f-9179992228e3 tempest-VolumesActionsTest-1651127016 tempest-VolumesActionsTest-1651127016-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:58:40.611423 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-e80522a1-f743-42b0-8e2f-9179992228e3 tempest-VolumesActionsTest-1651127016 tempest-VolumesActionsTest-1651127016-project] [instance: 43b9ca6e-0970-42c8-b494-4970fcc786d1] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:58:40.623737 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e80522a1-f743-42b0-8e2f-9179992228e3 tempest-VolumesActionsTest-1651127016 tempest-VolumesActionsTest-1651127016-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:40.626854 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e80522a1-f743-42b0-8e2f-9179992228e3 tempest-VolumesActionsTest-1651127016 tempest-VolumesActionsTest-1651127016-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:40.628067 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e80522a1-f743-42b0-8e2f-9179992228e3 tempest-VolumesActionsTest-1651127016 tempest-VolumesActionsTest-1651127016-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:40.631378 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e80522a1-f743-42b0-8e2f-9179992228e3 tempest-VolumesActionsTest-1651127016 tempest-VolumesActionsTest-1651127016-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:40.635081 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e80522a1-f743-42b0-8e2f-9179992228e3 tempest-VolumesActionsTest-1651127016 tempest-VolumesActionsTest-1651127016-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:40.642043 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e80522a1-f743-42b0-8e2f-9179992228e3 tempest-VolumesActionsTest-1651127016 tempest-VolumesActionsTest-1651127016-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:40.700460 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-1c2f718d-10af-4e3b-8d23-5b0eaab5c3a8 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1bb492fb294837b1e55d58bbfa3d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a4c327763b4440a9dc456cfbb31f88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:58:40.709306 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-1c2f718d-10af-4e3b-8d23-5b0eaab5c3a8 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] 10.222.0.43 "GET /compute/v2.1/servers/adaf9f7d-b52e-445b-9755-18300a401904" status: 200 len: 1545 microversion: 2.1 time: 0.891650 Oct 04 18:58:40.714345 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2454/5241] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:58:39 2022] GET /compute/v2.1/servers/adaf9f7d-b52e-445b-9755-18300a401904 => generated 1545 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:58:40.831372 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-ba77740b-c75e-4897-bf9f-260cdb8b1e19 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-1840262496", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452", "networks": [{"uuid": "ab5db632-d365-4d8b-8699-fa1e5099b18d"}, {"uuid": "f52bd1cb-8c09-4c7d-b027-b6b4080be839"}]}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:58:40.947550 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.network.neutron [None req-ba77740b-c75e-4897-bf9f-260cdb8b1e19 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] validate_networks() for [('ab5db632-d365-4d8b-8699-fa1e5099b18d', None, None, None, None, None), ('f52bd1cb-8c09-4c7d-b027-b6b4080be839', None, None, None, None, None)] {{(pid=123595) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:58:41.546939 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-e80522a1-f743-42b0-8e2f-9179992228e3 tempest-VolumesActionsTest-1651127016 tempest-VolumesActionsTest-1651127016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ee399f54e845c58502a36cfca64497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c84797a89d498e88f49e87e39fc13a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:58:41.555994 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-e80522a1-f743-42b0-8e2f-9179992228e3 tempest-VolumesActionsTest-1651127016 tempest-VolumesActionsTest-1651127016-project] 10.222.0.43 "GET /compute/v2.1/servers/43b9ca6e-0970-42c8-b494-4970fcc786d1" status: 200 len: 1314 microversion: 2.1 time: 0.962064 Oct 04 18:58:41.565343 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2788/5242] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:58:40 2022] GET /compute/v2.1/servers/43b9ca6e-0970-42c8-b494-4970fcc786d1 => generated 1314 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:58:41.608975 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-4562ad92-49ee-49a3-96de-f11419af8d9f tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:58:41.610440 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-4562ad92-49ee-49a3-96de-f11419af8d9f tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] [instance: 0ab8644c-b040-46c1-913b-46d595bde978] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:58:41.620727 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4562ad92-49ee-49a3-96de-f11419af8d9f tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:41.621864 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4562ad92-49ee-49a3-96de-f11419af8d9f tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:41.622544 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4562ad92-49ee-49a3-96de-f11419af8d9f tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:41.623469 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4562ad92-49ee-49a3-96de-f11419af8d9f tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:41.624537 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4562ad92-49ee-49a3-96de-f11419af8d9f tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:41.625135 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4562ad92-49ee-49a3-96de-f11419af8d9f tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:42.100911 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-4562ad92-49ee-49a3-96de-f11419af8d9f tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '486c22456b1e47ae843ae41f8dfb2632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c91c7e7358048ffaaee7f51ad61b515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:58:42.114658 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-4562ad92-49ee-49a3-96de-f11419af8d9f tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] 10.222.0.43 "GET /compute/v2.1/servers/0ab8644c-b040-46c1-913b-46d595bde978" status: 200 len: 1367 microversion: 2.1 time: 0.511318 Oct 04 18:58:42.136946 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2789/5243] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:58:41 2022] GET /compute/v2.1/servers/0ab8644c-b040-46c1-913b-46d595bde978 => generated 1367 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:58:42.590119 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-eac38e2a-c0a8-45bb-87bf-9a438a6fda83 tempest-VolumesActionsTest-1651127016 tempest-VolumesActionsTest-1651127016-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:58:42.590809 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-eac38e2a-c0a8-45bb-87bf-9a438a6fda83 tempest-VolumesActionsTest-1651127016 tempest-VolumesActionsTest-1651127016-project] [instance: 43b9ca6e-0970-42c8-b494-4970fcc786d1] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:58:42.610170 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-eac38e2a-c0a8-45bb-87bf-9a438a6fda83 tempest-VolumesActionsTest-1651127016 tempest-VolumesActionsTest-1651127016-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:42.611010 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-eac38e2a-c0a8-45bb-87bf-9a438a6fda83 tempest-VolumesActionsTest-1651127016 tempest-VolumesActionsTest-1651127016-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:42.621787 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-eac38e2a-c0a8-45bb-87bf-9a438a6fda83 tempest-VolumesActionsTest-1651127016 tempest-VolumesActionsTest-1651127016-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:42.622797 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-eac38e2a-c0a8-45bb-87bf-9a438a6fda83 tempest-VolumesActionsTest-1651127016 tempest-VolumesActionsTest-1651127016-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:42.626102 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-eac38e2a-c0a8-45bb-87bf-9a438a6fda83 tempest-VolumesActionsTest-1651127016 tempest-VolumesActionsTest-1651127016-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:42.632001 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-eac38e2a-c0a8-45bb-87bf-9a438a6fda83 tempest-VolumesActionsTest-1651127016 tempest-VolumesActionsTest-1651127016-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:42.763368 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-ba77740b-c75e-4897-bf9f-260cdb8b1e19 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Flavor limits 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:58:42.764144 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-ba77740b-c75e-4897-bf9f-260cdb8b1e19 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Image limits 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:58:42.764698 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-ba77740b-c75e-4897-bf9f-260cdb8b1e19 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Flavor pref 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:58:42.766068 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-ba77740b-c75e-4897-bf9f-260cdb8b1e19 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Image pref 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:58:42.766557 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-ba77740b-c75e-4897-bf9f-260cdb8b1e19 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:58:42.791443 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ba77740b-c75e-4897-bf9f-260cdb8b1e19 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:42.792050 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ba77740b-c75e-4897-bf9f-260cdb8b1e19 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:42.792668 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ba77740b-c75e-4897-bf9f-260cdb8b1e19 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:42.793855 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ba77740b-c75e-4897-bf9f-260cdb8b1e19 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:42.794336 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ba77740b-c75e-4897-bf9f-260cdb8b1e19 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:42.794781 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ba77740b-c75e-4897-bf9f-260cdb8b1e19 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:42.858324 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-ba77740b-c75e-4897-bf9f-260cdb8b1e19 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Getting quotas for project a9330711915a4b7f9d0f3559f0f19083. Resources: {'ram', 'cores', 'instances'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:58:42.883292 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-ba77740b-c75e-4897-bf9f-260cdb8b1e19 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Getting quotas for user da3b918706c14020910d5d0e97d96656 and project a9330711915a4b7f9d0f3559f0f19083. Resources: {'ram', 'cores', 'instances'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:58:42.923881 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-ba77740b-c75e-4897-bf9f-260cdb8b1e19 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Going to run 1 instances... {{(pid=123595) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:58:42.934719 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-ba77740b-c75e-4897-bf9f-260cdb8b1e19 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] [instance: 4cd7faab-c92d-4ab9-bd27-14823533edd3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e8943ec5-4038-4d4b-b9b9-2415a79f5243',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:58:43.020348 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-ba77740b-c75e-4897-bf9f-260cdb8b1e19 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.193090 Oct 04 18:58:43.021908 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2455/5244] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 18:58:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 2195 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 18:58:43.050986 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-0d378aca-ca4c-4081-9cca-48f60c385af8 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:58:43.054777 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-0d378aca-ca4c-4081-9cca-48f60c385af8 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] [instance: 4cd7faab-c92d-4ab9-bd27-14823533edd3] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:58:43.081048 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-eac38e2a-c0a8-45bb-87bf-9a438a6fda83 tempest-VolumesActionsTest-1651127016 tempest-VolumesActionsTest-1651127016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ee399f54e845c58502a36cfca64497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c84797a89d498e88f49e87e39fc13a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:58:43.106879 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-eac38e2a-c0a8-45bb-87bf-9a438a6fda83 tempest-VolumesActionsTest-1651127016 tempest-VolumesActionsTest-1651127016-project] 10.222.0.43 "GET /compute/v2.1/servers/43b9ca6e-0970-42c8-b494-4970fcc786d1" status: 200 len: 1498 microversion: 2.1 time: 0.523136 Oct 04 18:58:43.107469 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2790/5245] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:58:42 2022] GET /compute/v2.1/servers/43b9ca6e-0970-42c8-b494-4970fcc786d1 => generated 1498 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:58:43.142306 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-956e98bd-d435-4736-a8cc-e9922054646e tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:58:43.143864 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-956e98bd-d435-4736-a8cc-e9922054646e tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] [instance: 0ab8644c-b040-46c1-913b-46d595bde978] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:58:43.163070 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-956e98bd-d435-4736-a8cc-e9922054646e tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:43.163963 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-956e98bd-d435-4736-a8cc-e9922054646e tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:43.164613 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-956e98bd-d435-4736-a8cc-e9922054646e tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:43.165597 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-956e98bd-d435-4736-a8cc-e9922054646e tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:43.166292 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-956e98bd-d435-4736-a8cc-e9922054646e tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:43.166926 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-956e98bd-d435-4736-a8cc-e9922054646e tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:43.181973 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-0d378aca-ca4c-4081-9cca-48f60c385af8 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da3b918706c14020910d5d0e97d96656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9330711915a4b7f9d0f3559f0f19083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:58:43.195527 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-0d378aca-ca4c-4081-9cca-48f60c385af8 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] 10.222.0.43 "GET /compute/v2.1/servers/4cd7faab-c92d-4ab9-bd27-14823533edd3" status: 200 len: 1213 microversion: 2.1 time: 0.157593 Oct 04 18:58:43.196553 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2456/5246] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:58:43 2022] GET /compute/v2.1/servers/4cd7faab-c92d-4ab9-bd27-14823533edd3 => generated 1213 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:58:43.859499 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-956e98bd-d435-4736-a8cc-e9922054646e tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '486c22456b1e47ae843ae41f8dfb2632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c91c7e7358048ffaaee7f51ad61b515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:58:43.875640 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-956e98bd-d435-4736-a8cc-e9922054646e tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] 10.222.0.43 "GET /compute/v2.1/servers/0ab8644c-b040-46c1-913b-46d595bde978" status: 200 len: 1367 microversion: 2.1 time: 0.738833 Oct 04 18:58:43.890311 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2791/5247] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:58:43 2022] GET /compute/v2.1/servers/0ab8644c-b040-46c1-913b-46d595bde978 => generated 1367 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:58:44.254873 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-e16dd52e-fb4e-40d8-89dc-2078ef4629a6 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:58:44.259636 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-e16dd52e-fb4e-40d8-89dc-2078ef4629a6 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] [instance: 4cd7faab-c92d-4ab9-bd27-14823533edd3] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:58:44.279751 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e16dd52e-fb4e-40d8-89dc-2078ef4629a6 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:44.281997 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e16dd52e-fb4e-40d8-89dc-2078ef4629a6 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:44.286227 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e16dd52e-fb4e-40d8-89dc-2078ef4629a6 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:44.287440 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e16dd52e-fb4e-40d8-89dc-2078ef4629a6 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:44.289839 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e16dd52e-fb4e-40d8-89dc-2078ef4629a6 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:44.290544 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e16dd52e-fb4e-40d8-89dc-2078ef4629a6 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:44.437803 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-e16dd52e-fb4e-40d8-89dc-2078ef4629a6 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da3b918706c14020910d5d0e97d96656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9330711915a4b7f9d0f3559f0f19083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:58:44.470399 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-e16dd52e-fb4e-40d8-89dc-2078ef4629a6 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] 10.222.0.43 "GET /compute/v2.1/servers/4cd7faab-c92d-4ab9-bd27-14823533edd3" status: 200 len: 1209 microversion: 2.1 time: 0.248912 Oct 04 18:58:44.471767 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2457/5248] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:58:44 2022] GET /compute/v2.1/servers/4cd7faab-c92d-4ab9-bd27-14823533edd3 => generated 1209 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:58:44.908793 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-0e272a8b-8804-4f1e-8340-fe9f0d74ce07 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:58:44.909932 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-0e272a8b-8804-4f1e-8340-fe9f0d74ce07 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] [instance: 0ab8644c-b040-46c1-913b-46d595bde978] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:58:44.926583 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0e272a8b-8804-4f1e-8340-fe9f0d74ce07 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:44.927125 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0e272a8b-8804-4f1e-8340-fe9f0d74ce07 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:44.927586 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0e272a8b-8804-4f1e-8340-fe9f0d74ce07 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:44.928331 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0e272a8b-8804-4f1e-8340-fe9f0d74ce07 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:44.933150 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0e272a8b-8804-4f1e-8340-fe9f0d74ce07 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:44.933670 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0e272a8b-8804-4f1e-8340-fe9f0d74ce07 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:45.496935 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-c4162f43-5964-44d1-be17-8fe35f24c8b3 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:58:45.497732 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-c4162f43-5964-44d1-be17-8fe35f24c8b3 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] [instance: 4cd7faab-c92d-4ab9-bd27-14823533edd3] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:58:45.536688 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c4162f43-5964-44d1-be17-8fe35f24c8b3 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:45.537388 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c4162f43-5964-44d1-be17-8fe35f24c8b3 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:45.538131 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c4162f43-5964-44d1-be17-8fe35f24c8b3 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:45.539321 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c4162f43-5964-44d1-be17-8fe35f24c8b3 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:45.540016 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c4162f43-5964-44d1-be17-8fe35f24c8b3 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:45.543897 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c4162f43-5964-44d1-be17-8fe35f24c8b3 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:45.938290 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-0e272a8b-8804-4f1e-8340-fe9f0d74ce07 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '486c22456b1e47ae843ae41f8dfb2632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c91c7e7358048ffaaee7f51ad61b515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:58:45.951722 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-0e272a8b-8804-4f1e-8340-fe9f0d74ce07 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] 10.222.0.43 "GET /compute/v2.1/servers/0ab8644c-b040-46c1-913b-46d595bde978" status: 200 len: 1367 microversion: 2.1 time: 1.051290 Oct 04 18:58:45.956592 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2792/5249] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:58:44 2022] GET /compute/v2.1/servers/0ab8644c-b040-46c1-913b-46d595bde978 => generated 1367 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:58:45.968630 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-d091a830-3de4-42ef-9087-1c073bbf5e53 req-e78b4c3d-39a7-420a-9557-e69faa74378f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ab8644c-b040-46c1-913b-46d595bde978", "name": "network-vif-plugged", "status": "completed", "tag": "df4f4067-3e5a-4eeb-bc60-5f98df84527a"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:58:46.003980 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-d091a830-3de4-42ef-9087-1c073bbf5e53 req-e78b4c3d-39a7-420a-9557-e69faa74378f service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:46.005330 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-d091a830-3de4-42ef-9087-1c073bbf5e53 req-e78b4c3d-39a7-420a-9557-e69faa74378f service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:46.006070 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-d091a830-3de4-42ef-9087-1c073bbf5e53 req-e78b4c3d-39a7-420a-9557-e69faa74378f service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:46.022820 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-c4162f43-5964-44d1-be17-8fe35f24c8b3 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da3b918706c14020910d5d0e97d96656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9330711915a4b7f9d0f3559f0f19083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:58:46.025941 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-d091a830-3de4-42ef-9087-1c073bbf5e53 req-e78b4c3d-39a7-420a-9557-e69faa74378f service nova] Creating event network-vif-plugged:df4f4067-3e5a-4eeb-bc60-5f98df84527a for instance 0ab8644c-b040-46c1-913b-46d595bde978 on n-h1-851028-13 Oct 04 18:58:46.033192 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-d091a830-3de4-42ef-9087-1c073bbf5e53 req-e78b4c3d-39a7-420a-9557-e69faa74378f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074290 Oct 04 18:58:46.034162 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2793/5250] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:58:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:58:46.043665 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-c4162f43-5964-44d1-be17-8fe35f24c8b3 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] 10.222.0.43 "GET /compute/v2.1/servers/4cd7faab-c92d-4ab9-bd27-14823533edd3" status: 200 len: 1271 microversion: 2.1 time: 0.551072 Oct 04 18:58:46.061151 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2458/5251] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:58:45 2022] GET /compute/v2.1/servers/4cd7faab-c92d-4ab9-bd27-14823533edd3 => generated 1271 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:58:46.983251 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-7faf147d-75d5-4ff7-a8f3-8dba4190194e tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:58:46.984595 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-7faf147d-75d5-4ff7-a8f3-8dba4190194e tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] [instance: 0ab8644c-b040-46c1-913b-46d595bde978] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:58:47.007648 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7faf147d-75d5-4ff7-a8f3-8dba4190194e tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:47.008152 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7faf147d-75d5-4ff7-a8f3-8dba4190194e tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:47.008590 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7faf147d-75d5-4ff7-a8f3-8dba4190194e tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:47.013235 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7faf147d-75d5-4ff7-a8f3-8dba4190194e tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:47.013564 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7faf147d-75d5-4ff7-a8f3-8dba4190194e tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:47.014013 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7faf147d-75d5-4ff7-a8f3-8dba4190194e tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:47.077415 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-70d447f9-86d4-4752-a4fa-e048fcd9b4d1 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:58:47.078717 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-70d447f9-86d4-4752-a4fa-e048fcd9b4d1 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] [instance: 4cd7faab-c92d-4ab9-bd27-14823533edd3] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:58:47.090143 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-70d447f9-86d4-4752-a4fa-e048fcd9b4d1 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:47.091063 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-70d447f9-86d4-4752-a4fa-e048fcd9b4d1 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:47.091668 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-70d447f9-86d4-4752-a4fa-e048fcd9b4d1 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:47.092537 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-70d447f9-86d4-4752-a4fa-e048fcd9b4d1 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:47.097509 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-70d447f9-86d4-4752-a4fa-e048fcd9b4d1 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:47.098250 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-70d447f9-86d4-4752-a4fa-e048fcd9b4d1 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:47.319651 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-70d447f9-86d4-4752-a4fa-e048fcd9b4d1 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da3b918706c14020910d5d0e97d96656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9330711915a4b7f9d0f3559f0f19083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:58:47.335012 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-70d447f9-86d4-4752-a4fa-e048fcd9b4d1 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] 10.222.0.43 "GET /compute/v2.1/servers/4cd7faab-c92d-4ab9-bd27-14823533edd3" status: 200 len: 1271 microversion: 2.1 time: 0.262367 Oct 04 18:58:47.336586 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2459/5252] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:58:47 2022] GET /compute/v2.1/servers/4cd7faab-c92d-4ab9-bd27-14823533edd3 => generated 1271 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:58:47.765669 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-7faf147d-75d5-4ff7-a8f3-8dba4190194e tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '486c22456b1e47ae843ae41f8dfb2632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c91c7e7358048ffaaee7f51ad61b515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:58:47.776827 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-7faf147d-75d5-4ff7-a8f3-8dba4190194e tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] 10.222.0.43 "GET /compute/v2.1/servers/0ab8644c-b040-46c1-913b-46d595bde978" status: 200 len: 1367 microversion: 2.1 time: 0.800037 Oct 04 18:58:47.781958 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2794/5253] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:58:46 2022] GET /compute/v2.1/servers/0ab8644c-b040-46c1-913b-46d595bde978 => generated 1367 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:58:47.840547 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-a1a69e93-99f8-4c3c-bf90-156d9a749fc1 tempest-VolumesActionsTest-1651127016 tempest-VolumesActionsTest-1651127016-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:58:47.841625 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-a1a69e93-99f8-4c3c-bf90-156d9a749fc1 tempest-VolumesActionsTest-1651127016 tempest-VolumesActionsTest-1651127016-project] [instance: 43b9ca6e-0970-42c8-b494-4970fcc786d1] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:58:47.850612 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a1a69e93-99f8-4c3c-bf90-156d9a749fc1 tempest-VolumesActionsTest-1651127016 tempest-VolumesActionsTest-1651127016-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:47.854204 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a1a69e93-99f8-4c3c-bf90-156d9a749fc1 tempest-VolumesActionsTest-1651127016 tempest-VolumesActionsTest-1651127016-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:47.856505 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a1a69e93-99f8-4c3c-bf90-156d9a749fc1 tempest-VolumesActionsTest-1651127016 tempest-VolumesActionsTest-1651127016-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:47.857575 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a1a69e93-99f8-4c3c-bf90-156d9a749fc1 tempest-VolumesActionsTest-1651127016 tempest-VolumesActionsTest-1651127016-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:47.859654 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a1a69e93-99f8-4c3c-bf90-156d9a749fc1 tempest-VolumesActionsTest-1651127016 tempest-VolumesActionsTest-1651127016-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:47.860283 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a1a69e93-99f8-4c3c-bf90-156d9a749fc1 tempest-VolumesActionsTest-1651127016 tempest-VolumesActionsTest-1651127016-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:47.882959 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-77912785-72ec-40c8-889a-cbc5e13ae69a req-f46b5114-e6fd-47e6-a147-1ef5cde3e461 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "adaf9f7d-b52e-445b-9755-18300a401904", "tag": "29dcc234-5990-4abd-b879-e25806c5fbe7"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:58:47.916895 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-77912785-72ec-40c8-889a-cbc5e13ae69a req-f46b5114-e6fd-47e6-a147-1ef5cde3e461 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:47.918000 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-77912785-72ec-40c8-889a-cbc5e13ae69a req-f46b5114-e6fd-47e6-a147-1ef5cde3e461 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:47.918713 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-77912785-72ec-40c8-889a-cbc5e13ae69a req-f46b5114-e6fd-47e6-a147-1ef5cde3e461 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:47.926114 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-a1a69e93-99f8-4c3c-bf90-156d9a749fc1 tempest-VolumesActionsTest-1651127016 tempest-VolumesActionsTest-1651127016-project] [instance: 43b9ca6e-0970-42c8-b494-4970fcc786d1] Going to try to terminate instance {{(pid=123595) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:58:47.943500 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-77912785-72ec-40c8-889a-cbc5e13ae69a req-f46b5114-e6fd-47e6-a147-1ef5cde3e461 service nova] Creating event network-changed:29dcc234-5990-4abd-b879-e25806c5fbe7 for instance adaf9f7d-b52e-445b-9755-18300a401904 on n-h2-851028-13 Oct 04 18:58:47.965747 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-77912785-72ec-40c8-889a-cbc5e13ae69a req-f46b5114-e6fd-47e6-a147-1ef5cde3e461 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085112 Oct 04 18:58:47.967772 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2795/5254] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:58:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:58:48.084910 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-a1a69e93-99f8-4c3c-bf90-156d9a749fc1 tempest-VolumesActionsTest-1651127016 tempest-VolumesActionsTest-1651127016-project] 10.222.0.43 "DELETE /compute/v2.1/servers/43b9ca6e-0970-42c8-b494-4970fcc786d1" status: 204 len: 0 microversion: 2.1 time: 0.247929 Oct 04 18:58:48.087034 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2460/5255] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 18:58:47 2022] DELETE /compute/v2.1/servers/43b9ca6e-0970-42c8-b494-4970fcc786d1 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:58:48.099540 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-73f9166e-e470-466d-bd07-0b8928e9d96e tempest-VolumesActionsTest-1651127016 tempest-VolumesActionsTest-1651127016-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:58:48.100926 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-73f9166e-e470-466d-bd07-0b8928e9d96e tempest-VolumesActionsTest-1651127016 tempest-VolumesActionsTest-1651127016-project] [instance: 43b9ca6e-0970-42c8-b494-4970fcc786d1] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:58:48.110169 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-73f9166e-e470-466d-bd07-0b8928e9d96e tempest-VolumesActionsTest-1651127016 tempest-VolumesActionsTest-1651127016-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:48.112286 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-73f9166e-e470-466d-bd07-0b8928e9d96e tempest-VolumesActionsTest-1651127016 tempest-VolumesActionsTest-1651127016-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:48.112972 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-73f9166e-e470-466d-bd07-0b8928e9d96e tempest-VolumesActionsTest-1651127016 tempest-VolumesActionsTest-1651127016-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:48.114566 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-73f9166e-e470-466d-bd07-0b8928e9d96e tempest-VolumesActionsTest-1651127016 tempest-VolumesActionsTest-1651127016-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:48.118459 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-73f9166e-e470-466d-bd07-0b8928e9d96e tempest-VolumesActionsTest-1651127016 tempest-VolumesActionsTest-1651127016-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:48.120031 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-73f9166e-e470-466d-bd07-0b8928e9d96e tempest-VolumesActionsTest-1651127016 tempest-VolumesActionsTest-1651127016-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:48.359790 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-2232286a-2e26-4a7c-a21a-93d3aeee725c tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:58:48.360512 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-2232286a-2e26-4a7c-a21a-93d3aeee725c tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] [instance: 4cd7faab-c92d-4ab9-bd27-14823533edd3] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:58:48.373168 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2232286a-2e26-4a7c-a21a-93d3aeee725c tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:48.373680 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2232286a-2e26-4a7c-a21a-93d3aeee725c tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:48.384965 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2232286a-2e26-4a7c-a21a-93d3aeee725c tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:48.386173 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2232286a-2e26-4a7c-a21a-93d3aeee725c tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:48.390949 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2232286a-2e26-4a7c-a21a-93d3aeee725c tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:48.391659 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2232286a-2e26-4a7c-a21a-93d3aeee725c tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:48.816738 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-73f9166e-e470-466d-bd07-0b8928e9d96e tempest-VolumesActionsTest-1651127016 tempest-VolumesActionsTest-1651127016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ee399f54e845c58502a36cfca64497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c84797a89d498e88f49e87e39fc13a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:58:48.833578 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-73f9166e-e470-466d-bd07-0b8928e9d96e tempest-VolumesActionsTest-1651127016 tempest-VolumesActionsTest-1651127016-project] 10.222.0.43 "GET /compute/v2.1/servers/43b9ca6e-0970-42c8-b494-4970fcc786d1" status: 200 len: 1504 microversion: 2.1 time: 0.741677 Oct 04 18:58:48.835831 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2796/5256] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:58:48 2022] GET /compute/v2.1/servers/43b9ca6e-0970-42c8-b494-4970fcc786d1 => generated 1504 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:58:48.849908 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-46c46187-5186-4f0e-9c2e-428e7232da04 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:58:48.849908 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-46c46187-5186-4f0e-9c2e-428e7232da04 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] [instance: 0ab8644c-b040-46c1-913b-46d595bde978] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:58:48.866650 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-46c46187-5186-4f0e-9c2e-428e7232da04 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:48.867610 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-46c46187-5186-4f0e-9c2e-428e7232da04 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:48.868209 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-46c46187-5186-4f0e-9c2e-428e7232da04 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:48.869690 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-46c46187-5186-4f0e-9c2e-428e7232da04 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:48.870308 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-46c46187-5186-4f0e-9c2e-428e7232da04 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:48.875181 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-46c46187-5186-4f0e-9c2e-428e7232da04 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:48.938765 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-2232286a-2e26-4a7c-a21a-93d3aeee725c tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da3b918706c14020910d5d0e97d96656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9330711915a4b7f9d0f3559f0f19083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:58:48.951019 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-2232286a-2e26-4a7c-a21a-93d3aeee725c tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] 10.222.0.43 "GET /compute/v2.1/servers/4cd7faab-c92d-4ab9-bd27-14823533edd3" status: 200 len: 1313 microversion: 2.1 time: 0.595656 Oct 04 18:58:48.952975 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2461/5257] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:58:48 2022] GET /compute/v2.1/servers/4cd7faab-c92d-4ab9-bd27-14823533edd3 => generated 1313 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:58:49.389287 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-46c46187-5186-4f0e-9c2e-428e7232da04 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '486c22456b1e47ae843ae41f8dfb2632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c91c7e7358048ffaaee7f51ad61b515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:58:49.405914 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-46c46187-5186-4f0e-9c2e-428e7232da04 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] 10.222.0.43 "GET /compute/v2.1/servers/0ab8644c-b040-46c1-913b-46d595bde978" status: 200 len: 1557 microversion: 2.1 time: 0.566784 Oct 04 18:58:49.406752 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2797/5258] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:58:48 2022] GET /compute/v2.1/servers/0ab8644c-b040-46c1-913b-46d595bde978 => generated 1557 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:58:49.435271 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-be6c736a-60b0-4e54-a883-2d5a37a6d328 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:58:49.436316 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-be6c736a-60b0-4e54-a883-2d5a37a6d328 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] [instance: 0ab8644c-b040-46c1-913b-46d595bde978] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:58:49.444887 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-be6c736a-60b0-4e54-a883-2d5a37a6d328 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:49.449695 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-be6c736a-60b0-4e54-a883-2d5a37a6d328 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:49.450676 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-be6c736a-60b0-4e54-a883-2d5a37a6d328 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:49.451695 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-be6c736a-60b0-4e54-a883-2d5a37a6d328 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:49.452481 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-be6c736a-60b0-4e54-a883-2d5a37a6d328 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:49.453097 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-be6c736a-60b0-4e54-a883-2d5a37a6d328 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:49.655210 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-be6c736a-60b0-4e54-a883-2d5a37a6d328 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] 10.222.0.43 "GET /compute/v2.1/servers/0ab8644c-b040-46c1-913b-46d595bde978/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.223388 Oct 04 18:58:49.656797 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2462/5259] 10.222.0.43 () {58 vars in 1275 bytes} [Tue Oct 4 18:58:49 2022] GET /compute/v2.1/servers/0ab8644c-b040-46c1-913b-46d595bde978/os-interface => generated 284 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:58:49.862278 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-02434c65-43fb-4c54-9854-412d62f18a9a tempest-VolumesActionsTest-1651127016 tempest-VolumesActionsTest-1651127016-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:58:49.862897 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-02434c65-43fb-4c54-9854-412d62f18a9a tempest-VolumesActionsTest-1651127016 tempest-VolumesActionsTest-1651127016-project] [instance: 43b9ca6e-0970-42c8-b494-4970fcc786d1] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:58:49.872845 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-02434c65-43fb-4c54-9854-412d62f18a9a tempest-VolumesActionsTest-1651127016 tempest-VolumesActionsTest-1651127016-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:49.873591 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-02434c65-43fb-4c54-9854-412d62f18a9a tempest-VolumesActionsTest-1651127016 tempest-VolumesActionsTest-1651127016-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:49.877824 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-02434c65-43fb-4c54-9854-412d62f18a9a tempest-VolumesActionsTest-1651127016 tempest-VolumesActionsTest-1651127016-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:49.878861 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-02434c65-43fb-4c54-9854-412d62f18a9a tempest-VolumesActionsTest-1651127016 tempest-VolumesActionsTest-1651127016-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:49.879539 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-02434c65-43fb-4c54-9854-412d62f18a9a tempest-VolumesActionsTest-1651127016 tempest-VolumesActionsTest-1651127016-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:49.880455 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-02434c65-43fb-4c54-9854-412d62f18a9a tempest-VolumesActionsTest-1651127016 tempest-VolumesActionsTest-1651127016-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:49.976717 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-56f16e79-b7d2-4564-854b-2714de865091 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:58:49.977577 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-56f16e79-b7d2-4564-854b-2714de865091 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] [instance: 4cd7faab-c92d-4ab9-bd27-14823533edd3] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:58:49.995064 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-56f16e79-b7d2-4564-854b-2714de865091 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:49.995561 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-56f16e79-b7d2-4564-854b-2714de865091 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:49.996283 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-56f16e79-b7d2-4564-854b-2714de865091 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:50.001226 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-56f16e79-b7d2-4564-854b-2714de865091 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:50.001969 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-56f16e79-b7d2-4564-854b-2714de865091 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:50.002602 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-56f16e79-b7d2-4564-854b-2714de865091 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:50.400801 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-02434c65-43fb-4c54-9854-412d62f18a9a tempest-VolumesActionsTest-1651127016 tempest-VolumesActionsTest-1651127016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ee399f54e845c58502a36cfca64497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c84797a89d498e88f49e87e39fc13a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:58:50.413805 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-02434c65-43fb-4c54-9854-412d62f18a9a tempest-VolumesActionsTest-1651127016 tempest-VolumesActionsTest-1651127016-project] 10.222.0.43 "GET /compute/v2.1/servers/43b9ca6e-0970-42c8-b494-4970fcc786d1" status: 200 len: 1504 microversion: 2.1 time: 0.554955 Oct 04 18:58:50.434079 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2798/5260] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:58:49 2022] GET /compute/v2.1/servers/43b9ca6e-0970-42c8-b494-4970fcc786d1 => generated 1504 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:58:50.544594 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-56f16e79-b7d2-4564-854b-2714de865091 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da3b918706c14020910d5d0e97d96656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9330711915a4b7f9d0f3559f0f19083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:58:50.549046 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:58:50.555038 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-56f16e79-b7d2-4564-854b-2714de865091 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] 10.222.0.43 "GET /compute/v2.1/servers/4cd7faab-c92d-4ab9-bd27-14823533edd3" status: 200 len: 1313 microversion: 2.1 time: 0.582198 Oct 04 18:58:50.556004 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2463/5261] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:58:49 2022] GET /compute/v2.1/servers/4cd7faab-c92d-4ab9-bd27-14823533edd3 => generated 1313 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:58:51.464364 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f51d8f00-ea61-4908-a27a-6d97f8f59ba9 tempest-VolumesActionsTest-1651127016 tempest-VolumesActionsTest-1651127016-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:58:51.467321 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-f51d8f00-ea61-4908-a27a-6d97f8f59ba9 tempest-VolumesActionsTest-1651127016 tempest-VolumesActionsTest-1651127016-project] [instance: 43b9ca6e-0970-42c8-b494-4970fcc786d1] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:58:51.477567 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f51d8f00-ea61-4908-a27a-6d97f8f59ba9 tempest-VolumesActionsTest-1651127016 tempest-VolumesActionsTest-1651127016-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:51.478778 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f51d8f00-ea61-4908-a27a-6d97f8f59ba9 tempest-VolumesActionsTest-1651127016 tempest-VolumesActionsTest-1651127016-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:51.479393 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f51d8f00-ea61-4908-a27a-6d97f8f59ba9 tempest-VolumesActionsTest-1651127016 tempest-VolumesActionsTest-1651127016-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:51.480937 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f51d8f00-ea61-4908-a27a-6d97f8f59ba9 tempest-VolumesActionsTest-1651127016 tempest-VolumesActionsTest-1651127016-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:51.481679 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f51d8f00-ea61-4908-a27a-6d97f8f59ba9 tempest-VolumesActionsTest-1651127016 tempest-VolumesActionsTest-1651127016-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:51.482383 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f51d8f00-ea61-4908-a27a-6d97f8f59ba9 tempest-VolumesActionsTest-1651127016 tempest-VolumesActionsTest-1651127016-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:51.584454 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-4d2749a2-e6e4-442b-9896-29d7020698dd tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:58:51.586595 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-4d2749a2-e6e4-442b-9896-29d7020698dd tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] [instance: 4cd7faab-c92d-4ab9-bd27-14823533edd3] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:58:51.632739 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4d2749a2-e6e4-442b-9896-29d7020698dd tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:51.633514 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4d2749a2-e6e4-442b-9896-29d7020698dd tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:51.634173 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4d2749a2-e6e4-442b-9896-29d7020698dd tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:51.635812 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4d2749a2-e6e4-442b-9896-29d7020698dd tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:51.636443 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4d2749a2-e6e4-442b-9896-29d7020698dd tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:51.637593 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4d2749a2-e6e4-442b-9896-29d7020698dd tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:51.752318 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-f51d8f00-ea61-4908-a27a-6d97f8f59ba9 tempest-VolumesActionsTest-1651127016 tempest-VolumesActionsTest-1651127016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ee399f54e845c58502a36cfca64497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c84797a89d498e88f49e87e39fc13a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:58:51.781471 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-f51d8f00-ea61-4908-a27a-6d97f8f59ba9 tempest-VolumesActionsTest-1651127016 tempest-VolumesActionsTest-1651127016-project] 10.222.0.43 "GET /compute/v2.1/servers/43b9ca6e-0970-42c8-b494-4970fcc786d1" status: 200 len: 1504 microversion: 2.1 time: 0.335335 Oct 04 18:58:51.782382 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2799/5262] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:58:51 2022] GET /compute/v2.1/servers/43b9ca6e-0970-42c8-b494-4970fcc786d1 => generated 1504 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:58:52.209378 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-7d64313f-4f52-4b05-9e97-6884dc286b3a req-b184e389-9658-4d6a-aed2-48497e4f2a80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43b9ca6e-0970-42c8-b494-4970fcc786d1", "name": "network-vif-deleted", "tag": "a07e609a-e53b-4093-8ae9-63bae2162134"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:58:52.231734 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-7d64313f-4f52-4b05-9e97-6884dc286b3a req-b184e389-9658-4d6a-aed2-48497e4f2a80 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:52.232315 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-7d64313f-4f52-4b05-9e97-6884dc286b3a req-b184e389-9658-4d6a-aed2-48497e4f2a80 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:52.232876 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-7d64313f-4f52-4b05-9e97-6884dc286b3a req-b184e389-9658-4d6a-aed2-48497e4f2a80 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:52.257625 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-7d64313f-4f52-4b05-9e97-6884dc286b3a req-b184e389-9658-4d6a-aed2-48497e4f2a80 service nova] Creating event network-vif-deleted:a07e609a-e53b-4093-8ae9-63bae2162134 for instance 43b9ca6e-0970-42c8-b494-4970fcc786d1 on n-h1-851028-13 Oct 04 18:58:52.271607 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-7d64313f-4f52-4b05-9e97-6884dc286b3a req-b184e389-9658-4d6a-aed2-48497e4f2a80 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065972 Oct 04 18:58:52.272261 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2800/5263] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:58:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:58:52.439412 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-4d2749a2-e6e4-442b-9896-29d7020698dd tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da3b918706c14020910d5d0e97d96656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9330711915a4b7f9d0f3559f0f19083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:58:52.450884 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-4d2749a2-e6e4-442b-9896-29d7020698dd tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] 10.222.0.43 "GET /compute/v2.1/servers/4cd7faab-c92d-4ab9-bd27-14823533edd3" status: 200 len: 1334 microversion: 2.1 time: 0.874945 Oct 04 18:58:52.455415 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2464/5264] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:58:51 2022] GET /compute/v2.1/servers/4cd7faab-c92d-4ab9-bd27-14823533edd3 => generated 1334 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:58:52.808815 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-77a94d48-0770-4b10-9ef9-f56d32077b03 tempest-VolumesActionsTest-1651127016 tempest-VolumesActionsTest-1651127016-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:58:52.809689 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-77a94d48-0770-4b10-9ef9-f56d32077b03 tempest-VolumesActionsTest-1651127016 tempest-VolumesActionsTest-1651127016-project] [instance: 43b9ca6e-0970-42c8-b494-4970fcc786d1] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:58:52.830408 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-77a94d48-0770-4b10-9ef9-f56d32077b03 tempest-VolumesActionsTest-1651127016 tempest-VolumesActionsTest-1651127016-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:52.833976 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-77a94d48-0770-4b10-9ef9-f56d32077b03 tempest-VolumesActionsTest-1651127016 tempest-VolumesActionsTest-1651127016-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:52.834750 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-77a94d48-0770-4b10-9ef9-f56d32077b03 tempest-VolumesActionsTest-1651127016 tempest-VolumesActionsTest-1651127016-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:52.835715 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-77a94d48-0770-4b10-9ef9-f56d32077b03 tempest-VolumesActionsTest-1651127016 tempest-VolumesActionsTest-1651127016-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:52.840174 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-77a94d48-0770-4b10-9ef9-f56d32077b03 tempest-VolumesActionsTest-1651127016 tempest-VolumesActionsTest-1651127016-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:52.841284 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-77a94d48-0770-4b10-9ef9-f56d32077b03 tempest-VolumesActionsTest-1651127016 tempest-VolumesActionsTest-1651127016-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:52.868007 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=100 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:58:52.923611 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-77a94d48-0770-4b10-9ef9-f56d32077b03 tempest-VolumesActionsTest-1651127016 tempest-VolumesActionsTest-1651127016-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:52.924698 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-77a94d48-0770-4b10-9ef9-f56d32077b03 tempest-VolumesActionsTest-1651127016 tempest-VolumesActionsTest-1651127016-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:52.925431 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-77a94d48-0770-4b10-9ef9-f56d32077b03 tempest-VolumesActionsTest-1651127016 tempest-VolumesActionsTest-1651127016-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:52.926106 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.objects.instance [None req-77a94d48-0770-4b10-9ef9-f56d32077b03 tempest-VolumesActionsTest-1651127016 tempest-VolumesActionsTest-1651127016-project] Lazy-loading 'fault' on Instance uuid 43b9ca6e-0970-42c8-b494-4970fcc786d1 {{(pid=123596) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:58:53.001474 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-77a94d48-0770-4b10-9ef9-f56d32077b03 tempest-VolumesActionsTest-1651127016 tempest-VolumesActionsTest-1651127016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ee399f54e845c58502a36cfca64497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c84797a89d498e88f49e87e39fc13a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:58:53.022837 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-77a94d48-0770-4b10-9ef9-f56d32077b03 tempest-VolumesActionsTest-1651127016 tempest-VolumesActionsTest-1651127016-project] 10.222.0.43 "GET /compute/v2.1/servers/43b9ca6e-0970-42c8-b494-4970fcc786d1" status: 200 len: 1304 microversion: 2.1 time: 0.217099 Oct 04 18:58:53.059556 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2801/5265] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:58:52 2022] GET /compute/v2.1/servers/43b9ca6e-0970-42c8-b494-4970fcc786d1 => generated 1304 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:58:53.479427 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-1f18c8dc-2769-418c-9284-8af212bf279c tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:58:53.480983 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-1f18c8dc-2769-418c-9284-8af212bf279c tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] [instance: 4cd7faab-c92d-4ab9-bd27-14823533edd3] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:58:53.484108 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=2 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:58:53.487289 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=8 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:58:53.503806 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1f18c8dc-2769-418c-9284-8af212bf279c tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:53.505415 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1f18c8dc-2769-418c-9284-8af212bf279c tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:53.508651 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1f18c8dc-2769-418c-9284-8af212bf279c tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:53.509637 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1f18c8dc-2769-418c-9284-8af212bf279c tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:53.510261 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1f18c8dc-2769-418c-9284-8af212bf279c tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:53.511957 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1f18c8dc-2769-418c-9284-8af212bf279c tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:54.057351 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-5b0f2131-3874-4052-9621-441d5b707cb7 tempest-VolumesActionsTest-1651127016 tempest-VolumesActionsTest-1651127016-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:58:54.060319 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-5b0f2131-3874-4052-9621-441d5b707cb7 tempest-VolumesActionsTest-1651127016 tempest-VolumesActionsTest-1651127016-project] [instance: 43b9ca6e-0970-42c8-b494-4970fcc786d1] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:58:54.070264 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5b0f2131-3874-4052-9621-441d5b707cb7 tempest-VolumesActionsTest-1651127016 tempest-VolumesActionsTest-1651127016-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:54.078179 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5b0f2131-3874-4052-9621-441d5b707cb7 tempest-VolumesActionsTest-1651127016 tempest-VolumesActionsTest-1651127016-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:54.079920 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5b0f2131-3874-4052-9621-441d5b707cb7 tempest-VolumesActionsTest-1651127016 tempest-VolumesActionsTest-1651127016-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:54.080915 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5b0f2131-3874-4052-9621-441d5b707cb7 tempest-VolumesActionsTest-1651127016 tempest-VolumesActionsTest-1651127016-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:54.081628 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5b0f2131-3874-4052-9621-441d5b707cb7 tempest-VolumesActionsTest-1651127016 tempest-VolumesActionsTest-1651127016-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:54.082321 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5b0f2131-3874-4052-9621-441d5b707cb7 tempest-VolumesActionsTest-1651127016 tempest-VolumesActionsTest-1651127016-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:54.129520 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-5b0f2131-3874-4052-9621-441d5b707cb7 tempest-VolumesActionsTest-1651127016 tempest-VolumesActionsTest-1651127016-project] HTTP exception thrown: Instance 43b9ca6e-0970-42c8-b494-4970fcc786d1 could not be found. Oct 04 18:58:54.143806 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-5b0f2131-3874-4052-9621-441d5b707cb7 tempest-VolumesActionsTest-1651127016 tempest-VolumesActionsTest-1651127016-project] Request method failure captured: Oct 04 18:58:54.143806 n-d-851028-13 devstack@n-api.service[123596]: request: GET /compute/v2.1/servers/43b9ca6e-0970-42c8-b494-4970fcc786d1 HTTP/1.1 Oct 04 18:58:54.143806 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:58:54.143806 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:58:54.143806 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:58:54.143806 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 18:58:54.143806 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:58:54.143806 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:58:54.143806 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:58:54.143806 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:58:54.143806 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPIJKXSw2J-hz82D6lJ_UA53giPuUUu59ijLNJQuS8R-acz7eXu59LBI-3HvJxck-6VPpO1P75RaHuBV02I5YqMUU1Usb1R6dUOzz6OW1PkVHQx_HroKMY1F7vGFi-PB3KJFv6RFzOZ84r3r88V6shkq8EAeuusqQr97gGNgqBGY7B1Q Oct 04 18:58:54.143806 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:58:54.143806 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:58:54.143806 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:58:54.143806 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:58:54.143806 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:58:54.143806 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:58:54.143806 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: 84c84797a89d498e88f49e87e39fc13a Oct 04 18:58:54.143806 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-VolumesActionsTest-1651127016 Oct 04 18:58:54.143806 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 18:58:54.143806 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 18:58:54.143806 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/84c84797a89d498e88f49e87e39fc13a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_84c84797a89d498e88f49e87e39fc13a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/84c84797a89d498e88f49e87e39fc13a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/84c84797a89d498e88f49e87e39fc13a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:58:54.143806 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-VolumesActionsTest-1651127016 Oct 04 18:58:54.143806 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: 84c84797a89d498e88f49e87e39fc13a Oct 04 18:58:54.143806 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-VolumesActionsTest-1651127016 Oct 04 18:58:54.143806 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-VolumesActionsTest-1651127016-project Oct 04 18:58:54.143806 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:58:54.143806 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:58:54.143806 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: f9ee399f54e845c58502a36cfca64497 Oct 04 18:58:54.143806 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-VolumesActionsTest-1651127016-project Oct 04 18:58:54.143806 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 18:58:54.143806 n-d-851028-13 devstack@n-api.service[123596]: exception: Instance 43b9ca6e-0970-42c8-b494-4970fcc786d1 could not be found. Oct 04 18:58:54.143806 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': '43b9ca6e-0970-42c8-b494-4970fcc786d1'} Oct 04 18:58:54.143806 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:58:54.143806 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:58:54.143806 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:58:54.143806 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:58:54.143806 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:58:54.143806 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:58:54.143806 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:58:54.143806 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:58:54.143806 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:58:54.143806 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:58:54.143806 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43b9ca6e-0970-42c8-b494-4970fcc786d1 could not be found. Oct 04 18:58:54.143806 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:58:54.143806 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:58:54.143806 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:58:54.143806 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:58:54.143806 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:58:54.143806 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:58:54.143806 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:58:54.143806 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:58:54.143806 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:58:54.143806 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:58:54.143806 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:58:54.143806 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:58:54.143806 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:58:54.143806 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:58:54.143806 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:58:54.143806 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:58:54.143806 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43b9ca6e-0970-42c8-b494-4970fcc786d1 could not be found. Oct 04 18:58:54.143806 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:58:54.143806 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:58:54.143806 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:58:54.148177 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:58:54.148177 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:58:54.148177 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:58:54.148177 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:58:54.148177 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:58:54.148177 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43b9ca6e-0970-42c8-b494-4970fcc786d1 could not be found. Oct 04 18:58:54.148177 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:58:54.151578 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-5b0f2131-3874-4052-9621-441d5b707cb7 tempest-VolumesActionsTest-1651127016 tempest-VolumesActionsTest-1651127016-project] Returning 404 to user: Instance 43b9ca6e-0970-42c8-b494-4970fcc786d1 could not be found. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:58:54.154527 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-5b0f2131-3874-4052-9621-441d5b707cb7 tempest-VolumesActionsTest-1651127016 tempest-VolumesActionsTest-1651127016-project] 10.222.0.43 "GET /compute/v2.1/servers/43b9ca6e-0970-42c8-b494-4970fcc786d1" status: 404 len: 111 microversion: 2.1 time: 0.106855 Oct 04 18:58:54.163583 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2802/5266] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:58:54 2022] GET /compute/v2.1/servers/43b9ca6e-0970-42c8-b494-4970fcc786d1 => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:58:54.227046 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-1f18c8dc-2769-418c-9284-8af212bf279c tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da3b918706c14020910d5d0e97d96656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9330711915a4b7f9d0f3559f0f19083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:58:54.251849 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-1f18c8dc-2769-418c-9284-8af212bf279c tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] 10.222.0.43 "GET /compute/v2.1/servers/4cd7faab-c92d-4ab9-bd27-14823533edd3" status: 200 len: 1334 microversion: 2.1 time: 0.776259 Oct 04 18:58:54.256329 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2465/5267] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:58:53 2022] GET /compute/v2.1/servers/4cd7faab-c92d-4ab9-bd27-14823533edd3 => generated 1334 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:58:54.352683 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-0a81ae2f-0335-40c8-94ac-ec47cbb860e7 req-76dbca94-da2b-4dad-b8ff-c6fc7ad691a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ab8644c-b040-46c1-913b-46d595bde978", "tag": "df4f4067-3e5a-4eeb-bc60-5f98df84527a"}, {"name": "network-changed", "server_uuid": "4cd7faab-c92d-4ab9-bd27-14823533edd3", "tag": "403a6711-a4fc-47f2-9de5-c07c56303ea5"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:58:54.371703 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-0a81ae2f-0335-40c8-94ac-ec47cbb860e7 req-76dbca94-da2b-4dad-b8ff-c6fc7ad691a6 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:54.372576 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-0a81ae2f-0335-40c8-94ac-ec47cbb860e7 req-76dbca94-da2b-4dad-b8ff-c6fc7ad691a6 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:54.373410 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-0a81ae2f-0335-40c8-94ac-ec47cbb860e7 req-76dbca94-da2b-4dad-b8ff-c6fc7ad691a6 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:54.407914 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-0a81ae2f-0335-40c8-94ac-ec47cbb860e7 req-76dbca94-da2b-4dad-b8ff-c6fc7ad691a6 service nova] Creating event network-changed:df4f4067-3e5a-4eeb-bc60-5f98df84527a for instance 0ab8644c-b040-46c1-913b-46d595bde978 on n-h1-851028-13 Oct 04 18:58:54.426444 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-0a81ae2f-0335-40c8-94ac-ec47cbb860e7 req-76dbca94-da2b-4dad-b8ff-c6fc7ad691a6 service nova] Creating event network-changed:403a6711-a4fc-47f2-9de5-c07c56303ea5 for instance 4cd7faab-c92d-4ab9-bd27-14823533edd3 on n-h2-851028-13 Oct 04 18:58:54.458907 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-0a81ae2f-0335-40c8-94ac-ec47cbb860e7 req-76dbca94-da2b-4dad-b8ff-c6fc7ad691a6 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.111458 Oct 04 18:58:54.460804 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2803/5268] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:58:54 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:58:55.282817 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-a8aeb96d-96bc-4266-a771-3b0b48952fe0 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:58:55.283612 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-a8aeb96d-96bc-4266-a771-3b0b48952fe0 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] [instance: 4cd7faab-c92d-4ab9-bd27-14823533edd3] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:58:55.296069 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a8aeb96d-96bc-4266-a771-3b0b48952fe0 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:55.296921 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a8aeb96d-96bc-4266-a771-3b0b48952fe0 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:55.297721 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a8aeb96d-96bc-4266-a771-3b0b48952fe0 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:55.298775 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a8aeb96d-96bc-4266-a771-3b0b48952fe0 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:55.299490 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a8aeb96d-96bc-4266-a771-3b0b48952fe0 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:55.300148 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a8aeb96d-96bc-4266-a771-3b0b48952fe0 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:56.162604 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-0a81ae2f-0335-40c8-94ac-ec47cbb860e7 req-76dbca94-da2b-4dad-b8ff-c6fc7ad691a6 service nova] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:58:56.163660 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-0a81ae2f-0335-40c8-94ac-ec47cbb860e7 req-76dbca94-da2b-4dad-b8ff-c6fc7ad691a6 service nova] 10.222.0.43 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001565 Oct 04 18:58:56.163998 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2804/5269] 10.222.0.43 () {56 vars in 886 bytes} [Tue Oct 4 18:58:56 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (2 switches on core 0) Oct 04 18:58:56.275669 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-a8aeb96d-96bc-4266-a771-3b0b48952fe0 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da3b918706c14020910d5d0e97d96656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9330711915a4b7f9d0f3559f0f19083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:58:56.291283 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-a8aeb96d-96bc-4266-a771-3b0b48952fe0 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] 10.222.0.43 "GET /compute/v2.1/servers/4cd7faab-c92d-4ab9-bd27-14823533edd3" status: 200 len: 1334 microversion: 2.1 time: 1.009962 Oct 04 18:58:56.319946 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2466/5270] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:58:55 2022] GET /compute/v2.1/servers/4cd7faab-c92d-4ab9-bd27-14823533edd3 => generated 1334 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:58:57.069837 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-c65b8674-7825-4717-869c-a404e8d9fb71 req-6c96f220-9a4d-4aa7-9692-df7b27429b8f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4cd7faab-c92d-4ab9-bd27-14823533edd3", "tag": "7e23a479-2d37-4f4d-8d3c-26b60cbf94cd"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:58:57.086454 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-c65b8674-7825-4717-869c-a404e8d9fb71 req-6c96f220-9a4d-4aa7-9692-df7b27429b8f service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:57.092671 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-c65b8674-7825-4717-869c-a404e8d9fb71 req-6c96f220-9a4d-4aa7-9692-df7b27429b8f service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:57.093402 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-c65b8674-7825-4717-869c-a404e8d9fb71 req-6c96f220-9a4d-4aa7-9692-df7b27429b8f service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:57.128022 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-c65b8674-7825-4717-869c-a404e8d9fb71 req-6c96f220-9a4d-4aa7-9692-df7b27429b8f service nova] Creating event network-changed:7e23a479-2d37-4f4d-8d3c-26b60cbf94cd for instance 4cd7faab-c92d-4ab9-bd27-14823533edd3 on n-h2-851028-13 Oct 04 18:58:57.139566 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-c65b8674-7825-4717-869c-a404e8d9fb71 req-6c96f220-9a4d-4aa7-9692-df7b27429b8f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074032 Oct 04 18:58:57.143882 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2805/5271] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:58:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:58:57.325976 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-5109399c-5289-436c-bf02-a6383c2315f7 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:58:57.326595 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-5109399c-5289-436c-bf02-a6383c2315f7 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] [instance: 4cd7faab-c92d-4ab9-bd27-14823533edd3] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:58:57.336813 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5109399c-5289-436c-bf02-a6383c2315f7 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:57.340835 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5109399c-5289-436c-bf02-a6383c2315f7 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:57.342793 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5109399c-5289-436c-bf02-a6383c2315f7 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:57.343731 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5109399c-5289-436c-bf02-a6383c2315f7 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:57.353900 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5109399c-5289-436c-bf02-a6383c2315f7 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:57.354699 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5109399c-5289-436c-bf02-a6383c2315f7 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:57.851662 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-5109399c-5289-436c-bf02-a6383c2315f7 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da3b918706c14020910d5d0e97d96656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9330711915a4b7f9d0f3559f0f19083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:58:57.869366 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-5109399c-5289-436c-bf02-a6383c2315f7 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] 10.222.0.43 "GET /compute/v2.1/servers/4cd7faab-c92d-4ab9-bd27-14823533edd3" status: 200 len: 1334 microversion: 2.1 time: 0.547734 Oct 04 18:58:57.870658 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2467/5272] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:58:57 2022] GET /compute/v2.1/servers/4cd7faab-c92d-4ab9-bd27-14823533edd3 => generated 1334 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:58:58.903569 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-5d2e0503-ab96-4d00-a6e8-f2411a3b99bd tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:58:58.905006 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-5d2e0503-ab96-4d00-a6e8-f2411a3b99bd tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] [instance: 4cd7faab-c92d-4ab9-bd27-14823533edd3] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:58:58.908215 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=3 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:58:58.917400 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5d2e0503-ab96-4d00-a6e8-f2411a3b99bd tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:58.918303 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5d2e0503-ab96-4d00-a6e8-f2411a3b99bd tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:58.918987 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5d2e0503-ab96-4d00-a6e8-f2411a3b99bd tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:58.919934 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5d2e0503-ab96-4d00-a6e8-f2411a3b99bd tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:58.920611 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5d2e0503-ab96-4d00-a6e8-f2411a3b99bd tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:58.921594 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5d2e0503-ab96-4d00-a6e8-f2411a3b99bd tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:59.312106 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-5d2e0503-ab96-4d00-a6e8-f2411a3b99bd tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da3b918706c14020910d5d0e97d96656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9330711915a4b7f9d0f3559f0f19083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:58:59.341062 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-5d2e0503-ab96-4d00-a6e8-f2411a3b99bd tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] 10.222.0.43 "GET /compute/v2.1/servers/4cd7faab-c92d-4ab9-bd27-14823533edd3" status: 200 len: 1334 microversion: 2.1 time: 0.451837 Oct 04 18:58:59.342004 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2806/5273] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:58:58 2022] GET /compute/v2.1/servers/4cd7faab-c92d-4ab9-bd27-14823533edd3 => generated 1334 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:59:00.371012 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-c3c7497f-c2e9-4104-a407-e24c5e9d2bd6 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:59:00.372335 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-c3c7497f-c2e9-4104-a407-e24c5e9d2bd6 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] [instance: 4cd7faab-c92d-4ab9-bd27-14823533edd3] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:00.408216 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:59:00.418125 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c3c7497f-c2e9-4104-a407-e24c5e9d2bd6 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:00.422200 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c3c7497f-c2e9-4104-a407-e24c5e9d2bd6 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:00.423308 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c3c7497f-c2e9-4104-a407-e24c5e9d2bd6 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:00.424084 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c3c7497f-c2e9-4104-a407-e24c5e9d2bd6 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:00.424564 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c3c7497f-c2e9-4104-a407-e24c5e9d2bd6 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:00.425009 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c3c7497f-c2e9-4104-a407-e24c5e9d2bd6 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:01.479571 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-c3c7497f-c2e9-4104-a407-e24c5e9d2bd6 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da3b918706c14020910d5d0e97d96656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9330711915a4b7f9d0f3559f0f19083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:01.489055 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-c3c7497f-c2e9-4104-a407-e24c5e9d2bd6 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] 10.222.0.43 "GET /compute/v2.1/servers/4cd7faab-c92d-4ab9-bd27-14823533edd3" status: 200 len: 1334 microversion: 2.1 time: 1.123579 Oct 04 18:59:01.490457 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2468/5274] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:59:00 2022] GET /compute/v2.1/servers/4cd7faab-c92d-4ab9-bd27-14823533edd3 => generated 1334 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:59:02.513183 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-560d600d-a466-4a8e-a4d5-43e801657959 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:59:02.513799 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-560d600d-a466-4a8e-a4d5-43e801657959 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] [instance: 4cd7faab-c92d-4ab9-bd27-14823533edd3] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:02.521027 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-560d600d-a466-4a8e-a4d5-43e801657959 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:02.521819 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-560d600d-a466-4a8e-a4d5-43e801657959 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:02.522393 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-560d600d-a466-4a8e-a4d5-43e801657959 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:02.523005 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-560d600d-a466-4a8e-a4d5-43e801657959 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:02.523466 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-560d600d-a466-4a8e-a4d5-43e801657959 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:02.523900 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-560d600d-a466-4a8e-a4d5-43e801657959 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:02.711771 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-560d600d-a466-4a8e-a4d5-43e801657959 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da3b918706c14020910d5d0e97d96656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9330711915a4b7f9d0f3559f0f19083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:02.720975 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-560d600d-a466-4a8e-a4d5-43e801657959 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] 10.222.0.43 "GET /compute/v2.1/servers/4cd7faab-c92d-4ab9-bd27-14823533edd3" status: 200 len: 1334 microversion: 2.1 time: 0.211846 Oct 04 18:59:02.722542 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2807/5275] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:59:02 2022] GET /compute/v2.1/servers/4cd7faab-c92d-4ab9-bd27-14823533edd3 => generated 1334 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:59:02.963495 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-ee8c8eb4-053a-465c-93fe-daff82f0e282 tempest-QuotasTestJSON-784760247 tempest-QuotasTestJSON-784760247-project] Calling method '.version_select at 0x7fb21e985af0>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:59:03.022641 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-ee8c8eb4-053a-465c-93fe-daff82f0e282 tempest-QuotasTestJSON-784760247 tempest-QuotasTestJSON-784760247-project] 10.222.0.43 "GET /compute/v2.1/os-quota-sets/38c2891e4c114bad9fcc05e0fd308400/defaults" status: 200 len: 371 microversion: 2.1 time: 0.201616 Oct 04 18:59:03.023225 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2469/5276] 10.222.0.43 () {58 vars in 1269 bytes} [Tue Oct 4 18:59:02 2022] GET /compute/v2.1/os-quota-sets/38c2891e4c114bad9fcc05e0fd308400/defaults => generated 371 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:59:03.035299 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-e0bf284d-39f7-4ba3-8e13-17071ea244d2 tempest-QuotasTestJSON-784760247 tempest-QuotasTestJSON-784760247-project] Calling method '.version_select at 0x7fb21e773940>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:59:03.139878 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-e0bf284d-39f7-4ba3-8e13-17071ea244d2 tempest-QuotasTestJSON-784760247 tempest-QuotasTestJSON-784760247-project] 10.222.0.43 "GET /compute/v2.1/os-quota-sets/38c2891e4c114bad9fcc05e0fd308400" status: 200 len: 371 microversion: 2.1 time: 0.108254 Oct 04 18:59:03.147896 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2808/5277] 10.222.0.43 () {58 vars in 1242 bytes} [Tue Oct 4 18:59:03 2022] GET /compute/v2.1/os-quota-sets/38c2891e4c114bad9fcc05e0fd308400 => generated 371 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:59:03.154284 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-ef8abc21-65ed-4393-90c6-0b04edfa7a7c tempest-QuotasTestJSON-784760247 tempest-QuotasTestJSON-784760247-project] Calling method '.version_select at 0x7fb21e9ee940>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:59:03.214412 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-ef8abc21-65ed-4393-90c6-0b04edfa7a7c tempest-QuotasTestJSON-784760247 tempest-QuotasTestJSON-784760247-project] 10.222.0.43 "GET /compute/v2.1/os-quota-sets/38c2891e4c114bad9fcc05e0fd308400/defaults" status: 200 len: 371 microversion: 2.1 time: 0.063967 Oct 04 18:59:03.214987 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2470/5278] 10.222.0.43 () {58 vars in 1269 bytes} [Tue Oct 4 18:59:03 2022] GET /compute/v2.1/os-quota-sets/38c2891e4c114bad9fcc05e0fd308400/defaults => generated 371 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:59:03.230504 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-0c365b63-2a28-4728-8355-463f3e683f70 tempest-QuotasTestJSON-784760247 tempest-QuotasTestJSON-784760247-project] Calling method '.version_select at 0x7fb21e735dc0>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:59:03.307012 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-0c365b63-2a28-4728-8355-463f3e683f70 tempest-QuotasTestJSON-784760247 tempest-QuotasTestJSON-784760247-project] 10.222.0.43 "GET /compute/v2.1/os-quota-sets/38c2891e4c114bad9fcc05e0fd308400" status: 200 len: 371 microversion: 2.1 time: 0.080941 Oct 04 18:59:03.307871 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2809/5279] 10.222.0.43 () {58 vars in 1242 bytes} [Tue Oct 4 18:59:03 2022] GET /compute/v2.1/os-quota-sets/38c2891e4c114bad9fcc05e0fd308400 => generated 371 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:59:03.323072 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-3c006f65-b907-4271-b916-63a90f91c901 tempest-QuotasTestJSON-784760247 tempest-QuotasTestJSON-784760247-project] Calling method '.version_select at 0x7fb21e9eeaf0>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:59:03.426897 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-3c006f65-b907-4271-b916-63a90f91c901 tempest-QuotasTestJSON-784760247 tempest-QuotasTestJSON-784760247-project] 10.222.0.43 "GET /compute/v2.1/os-quota-sets/38c2891e4c114bad9fcc05e0fd308400?user_id=f0237ce5f3f44600abcb3c517fb21e88" status: 200 len: 371 microversion: 2.1 time: 0.110632 Oct 04 18:59:03.427498 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2471/5280] 10.222.0.43 () {58 vars in 1323 bytes} [Tue Oct 4 18:59:03 2022] GET /compute/v2.1/os-quota-sets/38c2891e4c114bad9fcc05e0fd308400?user_id=f0237ce5f3f44600abcb3c517fb21e88 => generated 371 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:59:03.744819 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-2db5ef2b-90e5-4bb4-a57b-83e6e83361ee tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:59:03.745489 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-2db5ef2b-90e5-4bb4-a57b-83e6e83361ee tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] [instance: 4cd7faab-c92d-4ab9-bd27-14823533edd3] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:03.764819 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2db5ef2b-90e5-4bb4-a57b-83e6e83361ee tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:03.768511 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2db5ef2b-90e5-4bb4-a57b-83e6e83361ee tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:03.770277 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2db5ef2b-90e5-4bb4-a57b-83e6e83361ee tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:03.771042 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2db5ef2b-90e5-4bb4-a57b-83e6e83361ee tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:03.771519 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2db5ef2b-90e5-4bb4-a57b-83e6e83361ee tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:03.771979 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2db5ef2b-90e5-4bb4-a57b-83e6e83361ee tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:04.148740 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-2db5ef2b-90e5-4bb4-a57b-83e6e83361ee tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da3b918706c14020910d5d0e97d96656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9330711915a4b7f9d0f3559f0f19083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:04.159169 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-2db5ef2b-90e5-4bb4-a57b-83e6e83361ee tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] 10.222.0.43 "GET /compute/v2.1/servers/4cd7faab-c92d-4ab9-bd27-14823533edd3" status: 200 len: 1334 microversion: 2.1 time: 0.419038 Oct 04 18:59:04.159997 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2810/5281] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:59:03 2022] GET /compute/v2.1/servers/4cd7faab-c92d-4ab9-bd27-14823533edd3 => generated 1334 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:59:05.188210 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-be1e7d34-9e00-428b-9646-21232a396c82 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:59:05.190762 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-be1e7d34-9e00-428b-9646-21232a396c82 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] [instance: 4cd7faab-c92d-4ab9-bd27-14823533edd3] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:05.212923 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-be1e7d34-9e00-428b-9646-21232a396c82 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:05.213561 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-be1e7d34-9e00-428b-9646-21232a396c82 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:05.214111 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-be1e7d34-9e00-428b-9646-21232a396c82 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:05.215525 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-be1e7d34-9e00-428b-9646-21232a396c82 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:05.219736 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-be1e7d34-9e00-428b-9646-21232a396c82 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:05.219736 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-be1e7d34-9e00-428b-9646-21232a396c82 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:05.435211 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-a1c3dec5-1fb9-4a88-ab8b-5c785b2b6f0b tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:59:05.438561 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-a1c3dec5-1fb9-4a88-ab8b-5c785b2b6f0b tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] [instance: adaf9f7d-b52e-445b-9755-18300a401904] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:05.454624 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a1c3dec5-1fb9-4a88-ab8b-5c785b2b6f0b tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:05.455290 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a1c3dec5-1fb9-4a88-ab8b-5c785b2b6f0b tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:05.455755 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a1c3dec5-1fb9-4a88-ab8b-5c785b2b6f0b tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:05.456486 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a1c3dec5-1fb9-4a88-ab8b-5c785b2b6f0b tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:05.456975 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a1c3dec5-1fb9-4a88-ab8b-5c785b2b6f0b tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:05.457409 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a1c3dec5-1fb9-4a88-ab8b-5c785b2b6f0b tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:05.539783 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-a1c3dec5-1fb9-4a88-ab8b-5c785b2b6f0b tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] 10.222.0.43 "POST /compute/v2.1/servers/adaf9f7d-b52e-445b-9755-18300a401904/action" status: 200 len: 24573 microversion: 2.1 time: 0.107409 Oct 04 18:59:05.548170 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2811/5282] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 18:59:05 2022] POST /compute/v2.1/servers/adaf9f7d-b52e-445b-9755-18300a401904/action => generated 24573 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 18:59:05.742561 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-be1e7d34-9e00-428b-9646-21232a396c82 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da3b918706c14020910d5d0e97d96656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9330711915a4b7f9d0f3559f0f19083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:05.754937 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-be1e7d34-9e00-428b-9646-21232a396c82 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] 10.222.0.43 "GET /compute/v2.1/servers/4cd7faab-c92d-4ab9-bd27-14823533edd3" status: 200 len: 1334 microversion: 2.1 time: 0.569039 Oct 04 18:59:05.755634 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2472/5283] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:59:05 2022] GET /compute/v2.1/servers/4cd7faab-c92d-4ab9-bd27-14823533edd3 => generated 1334 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:59:06.426106 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-b6add977-fa8c-485d-8739-354b820c29dc req-cf62c91a-c365-43ff-a005-1f51a034772b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4cd7faab-c92d-4ab9-bd27-14823533edd3", "name": "network-vif-plugged", "status": "completed", "tag": "7e23a479-2d37-4f4d-8d3c-26b60cbf94cd"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:59:06.446113 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-b6add977-fa8c-485d-8739-354b820c29dc req-cf62c91a-c365-43ff-a005-1f51a034772b service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:06.448030 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-b6add977-fa8c-485d-8739-354b820c29dc req-cf62c91a-c365-43ff-a005-1f51a034772b service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:06.448685 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-b6add977-fa8c-485d-8739-354b820c29dc req-cf62c91a-c365-43ff-a005-1f51a034772b service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:06.466614 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-b6add977-fa8c-485d-8739-354b820c29dc req-cf62c91a-c365-43ff-a005-1f51a034772b service nova] Creating event network-vif-plugged:7e23a479-2d37-4f4d-8d3c-26b60cbf94cd for instance 4cd7faab-c92d-4ab9-bd27-14823533edd3 on n-h2-851028-13 Oct 04 18:59:06.473173 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-b6add977-fa8c-485d-8739-354b820c29dc req-cf62c91a-c365-43ff-a005-1f51a034772b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053555 Oct 04 18:59:06.474407 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2812/5284] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:59:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:59:06.782352 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-9ed584d3-9376-453b-a9ed-cc0e735000a1 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:59:06.784062 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-9ed584d3-9376-453b-a9ed-cc0e735000a1 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] [instance: 4cd7faab-c92d-4ab9-bd27-14823533edd3] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:06.810156 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9ed584d3-9376-453b-a9ed-cc0e735000a1 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:06.813290 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9ed584d3-9376-453b-a9ed-cc0e735000a1 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:06.815375 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9ed584d3-9376-453b-a9ed-cc0e735000a1 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:06.819013 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9ed584d3-9376-453b-a9ed-cc0e735000a1 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:06.819704 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9ed584d3-9376-453b-a9ed-cc0e735000a1 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:06.820203 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9ed584d3-9376-453b-a9ed-cc0e735000a1 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:07.144915 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-9ed584d3-9376-453b-a9ed-cc0e735000a1 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da3b918706c14020910d5d0e97d96656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9330711915a4b7f9d0f3559f0f19083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:07.160347 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-9ed584d3-9376-453b-a9ed-cc0e735000a1 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] 10.222.0.43 "GET /compute/v2.1/servers/4cd7faab-c92d-4ab9-bd27-14823533edd3" status: 200 len: 1334 microversion: 2.1 time: 0.384475 Oct 04 18:59:07.160953 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2473/5285] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:59:06 2022] GET /compute/v2.1/servers/4cd7faab-c92d-4ab9-bd27-14823533edd3 => generated 1334 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:59:08.186450 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-d05d9eb4-ccd8-4b74-bd07-891bcd28d6df tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:59:08.187323 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-d05d9eb4-ccd8-4b74-bd07-891bcd28d6df tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] [instance: 4cd7faab-c92d-4ab9-bd27-14823533edd3] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:08.197661 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d05d9eb4-ccd8-4b74-bd07-891bcd28d6df tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:08.201775 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d05d9eb4-ccd8-4b74-bd07-891bcd28d6df tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:08.204572 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d05d9eb4-ccd8-4b74-bd07-891bcd28d6df tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:08.209783 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d05d9eb4-ccd8-4b74-bd07-891bcd28d6df tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:08.212550 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d05d9eb4-ccd8-4b74-bd07-891bcd28d6df tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:08.215215 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d05d9eb4-ccd8-4b74-bd07-891bcd28d6df tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:08.498696 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-d05d9eb4-ccd8-4b74-bd07-891bcd28d6df tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da3b918706c14020910d5d0e97d96656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9330711915a4b7f9d0f3559f0f19083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:08.507929 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-aede55b9-507d-42a3-91ed-7768e643a0e9 req-4b8cb50b-3e57-44ed-b8d3-90157b9c3c2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4cd7faab-c92d-4ab9-bd27-14823533edd3", "name": "network-vif-plugged", "status": "completed", "tag": "403a6711-a4fc-47f2-9de5-c07c56303ea5"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:59:08.511138 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-d05d9eb4-ccd8-4b74-bd07-891bcd28d6df tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] 10.222.0.43 "GET /compute/v2.1/servers/4cd7faab-c92d-4ab9-bd27-14823533edd3" status: 200 len: 1334 microversion: 2.1 time: 0.331322 Oct 04 18:59:08.528904 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2813/5286] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:59:08 2022] GET /compute/v2.1/servers/4cd7faab-c92d-4ab9-bd27-14823533edd3 => generated 1334 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:59:08.534239 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-aede55b9-507d-42a3-91ed-7768e643a0e9 req-4b8cb50b-3e57-44ed-b8d3-90157b9c3c2a service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:08.534730 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-aede55b9-507d-42a3-91ed-7768e643a0e9 req-4b8cb50b-3e57-44ed-b8d3-90157b9c3c2a service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:08.535804 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-aede55b9-507d-42a3-91ed-7768e643a0e9 req-4b8cb50b-3e57-44ed-b8d3-90157b9c3c2a service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:08.562554 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-aede55b9-507d-42a3-91ed-7768e643a0e9 req-4b8cb50b-3e57-44ed-b8d3-90157b9c3c2a service nova] Creating event network-vif-plugged:403a6711-a4fc-47f2-9de5-c07c56303ea5 for instance 4cd7faab-c92d-4ab9-bd27-14823533edd3 on n-h2-851028-13 Oct 04 18:59:08.577308 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-aede55b9-507d-42a3-91ed-7768e643a0e9 req-4b8cb50b-3e57-44ed-b8d3-90157b9c3c2a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073614 Oct 04 18:59:08.578166 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2474/5287] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:59:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:59:09.535565 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-78157796-363f-40eb-99e1-28cf1c98f2a0 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:59:09.536811 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-78157796-363f-40eb-99e1-28cf1c98f2a0 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] [instance: 4cd7faab-c92d-4ab9-bd27-14823533edd3] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:09.546436 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-78157796-363f-40eb-99e1-28cf1c98f2a0 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:09.547624 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-78157796-363f-40eb-99e1-28cf1c98f2a0 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:09.548230 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-78157796-363f-40eb-99e1-28cf1c98f2a0 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:09.549102 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-78157796-363f-40eb-99e1-28cf1c98f2a0 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:09.549738 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-78157796-363f-40eb-99e1-28cf1c98f2a0 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:09.550332 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-78157796-363f-40eb-99e1-28cf1c98f2a0 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:09.773833 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-78157796-363f-40eb-99e1-28cf1c98f2a0 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da3b918706c14020910d5d0e97d96656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9330711915a4b7f9d0f3559f0f19083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:09.786372 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-78157796-363f-40eb-99e1-28cf1c98f2a0 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] 10.222.0.43 "GET /compute/v2.1/servers/4cd7faab-c92d-4ab9-bd27-14823533edd3" status: 200 len: 1334 microversion: 2.1 time: 0.255875 Oct 04 18:59:09.788605 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2814/5288] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:59:09 2022] GET /compute/v2.1/servers/4cd7faab-c92d-4ab9-bd27-14823533edd3 => generated 1334 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:59:10.818899 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-b3f74bf9-3cfb-4079-be47-75c87c59703c tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:59:10.819704 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-b3f74bf9-3cfb-4079-be47-75c87c59703c tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] [instance: 4cd7faab-c92d-4ab9-bd27-14823533edd3] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:10.828595 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b3f74bf9-3cfb-4079-be47-75c87c59703c tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:10.829428 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b3f74bf9-3cfb-4079-be47-75c87c59703c tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:10.830023 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b3f74bf9-3cfb-4079-be47-75c87c59703c tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:10.830914 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b3f74bf9-3cfb-4079-be47-75c87c59703c tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:10.831552 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b3f74bf9-3cfb-4079-be47-75c87c59703c tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:10.832155 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b3f74bf9-3cfb-4079-be47-75c87c59703c tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:11.127264 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-b3f74bf9-3cfb-4079-be47-75c87c59703c tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da3b918706c14020910d5d0e97d96656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9330711915a4b7f9d0f3559f0f19083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:11.141620 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-b3f74bf9-3cfb-4079-be47-75c87c59703c tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] 10.222.0.43 "GET /compute/v2.1/servers/4cd7faab-c92d-4ab9-bd27-14823533edd3" status: 200 len: 1668 microversion: 2.1 time: 0.329967 Oct 04 18:59:11.160872 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2475/5289] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:59:10 2022] GET /compute/v2.1/servers/4cd7faab-c92d-4ab9-bd27-14823533edd3 => generated 1668 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:59:11.168044 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-0e8c3e13-9786-4466-9d98-515d9ac6475d tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:59:11.168673 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-0e8c3e13-9786-4466-9d98-515d9ac6475d tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] [instance: 4cd7faab-c92d-4ab9-bd27-14823533edd3] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:11.193913 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0e8c3e13-9786-4466-9d98-515d9ac6475d tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:11.197754 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0e8c3e13-9786-4466-9d98-515d9ac6475d tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:11.198777 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0e8c3e13-9786-4466-9d98-515d9ac6475d tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:11.199352 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0e8c3e13-9786-4466-9d98-515d9ac6475d tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:11.199926 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0e8c3e13-9786-4466-9d98-515d9ac6475d tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:11.200839 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0e8c3e13-9786-4466-9d98-515d9ac6475d tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:11.244177 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-0e8c3e13-9786-4466-9d98-515d9ac6475d tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] 10.222.0.43 "GET /compute/v2.1/servers/4cd7faab-c92d-4ab9-bd27-14823533edd3/ips" status: 200 len: 178 microversion: 2.1 time: 0.081813 Oct 04 18:59:11.245550 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2815/5290] 10.222.0.43 () {58 vars in 1248 bytes} [Tue Oct 4 18:59:11 2022] GET /compute/v2.1/servers/4cd7faab-c92d-4ab9-bd27-14823533edd3/ips => generated 178 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:59:11.263563 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-f73fd563-b6ee-4ccc-9dad-3429400c18b4 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:59:11.264102 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-f73fd563-b6ee-4ccc-9dad-3429400c18b4 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] [instance: 4cd7faab-c92d-4ab9-bd27-14823533edd3] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:11.275513 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f73fd563-b6ee-4ccc-9dad-3429400c18b4 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:11.276530 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f73fd563-b6ee-4ccc-9dad-3429400c18b4 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:11.276868 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f73fd563-b6ee-4ccc-9dad-3429400c18b4 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:11.282450 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f73fd563-b6ee-4ccc-9dad-3429400c18b4 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:11.283341 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f73fd563-b6ee-4ccc-9dad-3429400c18b4 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:11.283810 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f73fd563-b6ee-4ccc-9dad-3429400c18b4 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:11.362799 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-f73fd563-b6ee-4ccc-9dad-3429400c18b4 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] [instance: 4cd7faab-c92d-4ab9-bd27-14823533edd3] Going to try to terminate instance {{(pid=123595) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:59:11.521402 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-f73fd563-b6ee-4ccc-9dad-3429400c18b4 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] 10.222.0.43 "DELETE /compute/v2.1/servers/4cd7faab-c92d-4ab9-bd27-14823533edd3" status: 204 len: 0 microversion: 2.1 time: 0.263711 Oct 04 18:59:11.522748 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2476/5291] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 18:59:11 2022] DELETE /compute/v2.1/servers/4cd7faab-c92d-4ab9-bd27-14823533edd3 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:59:11.532546 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-df4d24eb-2777-48e3-a649-cd5c4de3d9fa tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:59:11.533295 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-df4d24eb-2777-48e3-a649-cd5c4de3d9fa tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] [instance: 4cd7faab-c92d-4ab9-bd27-14823533edd3] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:11.544547 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-df4d24eb-2777-48e3-a649-cd5c4de3d9fa tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:11.545622 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-df4d24eb-2777-48e3-a649-cd5c4de3d9fa tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:11.546150 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-df4d24eb-2777-48e3-a649-cd5c4de3d9fa tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:11.547016 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-df4d24eb-2777-48e3-a649-cd5c4de3d9fa tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:11.547686 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-df4d24eb-2777-48e3-a649-cd5c4de3d9fa tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:11.548340 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-df4d24eb-2777-48e3-a649-cd5c4de3d9fa tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:11.784686 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-df4d24eb-2777-48e3-a649-cd5c4de3d9fa tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da3b918706c14020910d5d0e97d96656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9330711915a4b7f9d0f3559f0f19083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:11.799883 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-df4d24eb-2777-48e3-a649-cd5c4de3d9fa tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] 10.222.0.43 "GET /compute/v2.1/servers/4cd7faab-c92d-4ab9-bd27-14823533edd3" status: 200 len: 1674 microversion: 2.1 time: 0.271161 Oct 04 18:59:11.811362 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2816/5292] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:59:11 2022] GET /compute/v2.1/servers/4cd7faab-c92d-4ab9-bd27-14823533edd3 => generated 1674 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:59:12.835711 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-2646a676-83be-4991-83f1-d0bf436e2335 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:59:12.837917 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-2646a676-83be-4991-83f1-d0bf436e2335 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] [instance: 4cd7faab-c92d-4ab9-bd27-14823533edd3] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:12.851594 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2646a676-83be-4991-83f1-d0bf436e2335 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:12.852653 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2646a676-83be-4991-83f1-d0bf436e2335 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:12.853946 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2646a676-83be-4991-83f1-d0bf436e2335 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:12.855051 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2646a676-83be-4991-83f1-d0bf436e2335 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:12.855821 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2646a676-83be-4991-83f1-d0bf436e2335 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:12.856561 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2646a676-83be-4991-83f1-d0bf436e2335 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:13.168656 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-2646a676-83be-4991-83f1-d0bf436e2335 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da3b918706c14020910d5d0e97d96656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9330711915a4b7f9d0f3559f0f19083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:13.186483 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-2646a676-83be-4991-83f1-d0bf436e2335 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] 10.222.0.43 "GET /compute/v2.1/servers/4cd7faab-c92d-4ab9-bd27-14823533edd3" status: 200 len: 1674 microversion: 2.1 time: 0.361531 Oct 04 18:59:13.189428 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2477/5293] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:59:12 2022] GET /compute/v2.1/servers/4cd7faab-c92d-4ab9-bd27-14823533edd3 => generated 1674 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:59:14.042314 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-74652ab1-a03e-44ae-83d5-012c11635009 req-69d876b2-874d-43d3-9cbc-30befcf6a7d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4cd7faab-c92d-4ab9-bd27-14823533edd3", "name": "network-vif-deleted", "tag": "7e23a479-2d37-4f4d-8d3c-26b60cbf94cd"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:59:14.068014 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=4 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:59:14.077097 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-74652ab1-a03e-44ae-83d5-012c11635009 req-69d876b2-874d-43d3-9cbc-30befcf6a7d2 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:14.077622 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-74652ab1-a03e-44ae-83d5-012c11635009 req-69d876b2-874d-43d3-9cbc-30befcf6a7d2 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:14.078064 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-74652ab1-a03e-44ae-83d5-012c11635009 req-69d876b2-874d-43d3-9cbc-30befcf6a7d2 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:14.112177 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-74652ab1-a03e-44ae-83d5-012c11635009 req-69d876b2-874d-43d3-9cbc-30befcf6a7d2 service nova] Creating event network-vif-deleted:7e23a479-2d37-4f4d-8d3c-26b60cbf94cd for instance 4cd7faab-c92d-4ab9-bd27-14823533edd3 on n-h2-851028-13 Oct 04 18:59:14.125661 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-74652ab1-a03e-44ae-83d5-012c11635009 req-69d876b2-874d-43d3-9cbc-30befcf6a7d2 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090018 Oct 04 18:59:14.129771 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2817/5294] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:59:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:59:14.212956 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-b11fc0ef-847e-42a6-af16-351dfff58051 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:59:14.213664 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-b11fc0ef-847e-42a6-af16-351dfff58051 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] [instance: 4cd7faab-c92d-4ab9-bd27-14823533edd3] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:14.215699 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=4 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:59:14.230253 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b11fc0ef-847e-42a6-af16-351dfff58051 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:14.237553 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b11fc0ef-847e-42a6-af16-351dfff58051 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:14.238112 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b11fc0ef-847e-42a6-af16-351dfff58051 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:14.239048 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b11fc0ef-847e-42a6-af16-351dfff58051 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:14.239536 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b11fc0ef-847e-42a6-af16-351dfff58051 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:14.239971 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b11fc0ef-847e-42a6-af16-351dfff58051 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:14.868931 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-b11fc0ef-847e-42a6-af16-351dfff58051 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da3b918706c14020910d5d0e97d96656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9330711915a4b7f9d0f3559f0f19083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:14.891885 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-b11fc0ef-847e-42a6-af16-351dfff58051 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] 10.222.0.43 "GET /compute/v2.1/servers/4cd7faab-c92d-4ab9-bd27-14823533edd3" status: 200 len: 1494 microversion: 2.1 time: 0.682320 Oct 04 18:59:14.897053 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2478/5295] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:59:14 2022] GET /compute/v2.1/servers/4cd7faab-c92d-4ab9-bd27-14823533edd3 => generated 1494 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:59:15.938282 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-23ccff4e-7543-45fb-9c90-a8a7dfe11c44 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:59:15.939089 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-23ccff4e-7543-45fb-9c90-a8a7dfe11c44 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] [instance: 4cd7faab-c92d-4ab9-bd27-14823533edd3] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:15.952311 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-23ccff4e-7543-45fb-9c90-a8a7dfe11c44 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:15.952818 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-23ccff4e-7543-45fb-9c90-a8a7dfe11c44 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:15.953286 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-23ccff4e-7543-45fb-9c90-a8a7dfe11c44 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:15.954190 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-23ccff4e-7543-45fb-9c90-a8a7dfe11c44 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:15.955029 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-23ccff4e-7543-45fb-9c90-a8a7dfe11c44 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:15.955606 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-23ccff4e-7543-45fb-9c90-a8a7dfe11c44 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:15.988275 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-23ccff4e-7543-45fb-9c90-a8a7dfe11c44 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] HTTP exception thrown: Instance 4cd7faab-c92d-4ab9-bd27-14823533edd3 could not be found. Oct 04 18:59:15.990107 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-23ccff4e-7543-45fb-9c90-a8a7dfe11c44 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Request method failure captured: Oct 04 18:59:15.990107 n-d-851028-13 devstack@n-api.service[123596]: request: GET /compute/v2.1/servers/4cd7faab-c92d-4ab9-bd27-14823533edd3 HTTP/1.1 Oct 04 18:59:15.990107 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:59:15.990107 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:59:15.990107 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:59:15.990107 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 18:59:15.990107 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:59:15.990107 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:59:15.990107 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:59:15.990107 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:59:15.990107 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPIICP1PtS01HownqWweSgla4CcRPtCgAdUBaEdEc6vx8Ncus8eLhH3dUpUsQR0zHlOYk7gtTA9aUBKdVN35F_FIxu9OfoM4v3Fp57WQY2oesEAUq1sgUUAtkajJI3A6Mo7YDom3zBbqxWNa-Zc3eKb0_xGvtwa-4t27lLZncqqwgnro Oct 04 18:59:15.990107 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:59:15.990107 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:59:15.990107 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:59:15.990107 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:59:15.990107 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:59:15.990107 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:59:15.990107 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: a9330711915a4b7f9d0f3559f0f19083 Oct 04 18:59:15.990107 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-ServersTestMultiNic-2007496041 Oct 04 18:59:15.990107 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 18:59:15.990107 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 18:59:15.990107 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/a9330711915a4b7f9d0f3559f0f19083"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_a9330711915a4b7f9d0f3559f0f19083"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a9330711915a4b7f9d0f3559f0f19083"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a9330711915a4b7f9d0f3559f0f19083"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:59:15.990107 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-ServersTestMultiNic-2007496041 Oct 04 18:59:15.990107 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: a9330711915a4b7f9d0f3559f0f19083 Oct 04 18:59:15.990107 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-ServersTestMultiNic-2007496041 Oct 04 18:59:15.990107 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-ServersTestMultiNic-2007496041-project Oct 04 18:59:15.990107 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:59:15.990107 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:59:15.990107 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: da3b918706c14020910d5d0e97d96656 Oct 04 18:59:15.990107 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-ServersTestMultiNic-2007496041-project Oct 04 18:59:15.990107 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 18:59:15.990107 n-d-851028-13 devstack@n-api.service[123596]: exception: Instance 4cd7faab-c92d-4ab9-bd27-14823533edd3 could not be found. Oct 04 18:59:15.990107 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': '4cd7faab-c92d-4ab9-bd27-14823533edd3'} Oct 04 18:59:15.990107 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:59:15.990107 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:59:15.990107 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:59:15.990107 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:59:15.990107 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:59:15.990107 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:59:15.990107 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:59:15.990107 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:59:15.990107 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:59:15.990107 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:59:15.990107 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4cd7faab-c92d-4ab9-bd27-14823533edd3 could not be found. Oct 04 18:59:15.990107 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:59:15.990107 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:59:15.990107 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:59:15.990107 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:59:15.990107 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:59:15.990107 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:59:15.990107 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:59:15.990107 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:59:15.990107 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:59:15.990107 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:59:15.990107 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:59:15.990107 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:59:15.990107 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:59:15.990107 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:59:15.990107 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:59:15.990107 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:59:15.990107 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4cd7faab-c92d-4ab9-bd27-14823533edd3 could not be found. Oct 04 18:59:15.990107 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:59:15.990107 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:59:15.990107 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:59:15.995200 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:59:15.995200 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:59:15.995200 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:59:15.995200 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:59:15.995200 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:59:15.995200 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4cd7faab-c92d-4ab9-bd27-14823533edd3 could not be found. Oct 04 18:59:15.995200 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:59:15.995200 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-23ccff4e-7543-45fb-9c90-a8a7dfe11c44 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Returning 404 to user: Instance 4cd7faab-c92d-4ab9-bd27-14823533edd3 could not be found. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:59:15.995200 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-23ccff4e-7543-45fb-9c90-a8a7dfe11c44 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] 10.222.0.43 "GET /compute/v2.1/servers/4cd7faab-c92d-4ab9-bd27-14823533edd3" status: 404 len: 111 microversion: 2.1 time: 0.072204 Oct 04 18:59:15.995200 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2818/5296] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:59:15 2022] GET /compute/v2.1/servers/4cd7faab-c92d-4ab9-bd27-14823533edd3 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:59:16.182384 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-5e806f4a-5960-45c8-8a76-ba0e588f9933 req-2962ff49-7f17-4f5e-8b69-5af2eadf57bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4cd7faab-c92d-4ab9-bd27-14823533edd3", "name": "network-vif-deleted", "tag": "403a6711-a4fc-47f2-9de5-c07c56303ea5"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:59:16.219083 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-5e806f4a-5960-45c8-8a76-ba0e588f9933 req-2962ff49-7f17-4f5e-8b69-5af2eadf57bb service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:16.220115 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-5e806f4a-5960-45c8-8a76-ba0e588f9933 req-2962ff49-7f17-4f5e-8b69-5af2eadf57bb service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:16.220751 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-5e806f4a-5960-45c8-8a76-ba0e588f9933 req-2962ff49-7f17-4f5e-8b69-5af2eadf57bb service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:16.272128 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-5e806f4a-5960-45c8-8a76-ba0e588f9933 req-2962ff49-7f17-4f5e-8b69-5af2eadf57bb service nova] Creating event network-vif-deleted:403a6711-a4fc-47f2-9de5-c07c56303ea5 for instance 4cd7faab-c92d-4ab9-bd27-14823533edd3 on n-h2-851028-13 Oct 04 18:59:16.286323 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-5e806f4a-5960-45c8-8a76-ba0e588f9933 req-2962ff49-7f17-4f5e-8b69-5af2eadf57bb service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117705 Oct 04 18:59:16.286961 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2479/5297] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:59:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:59:21.942809 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-458d1cc3-494c-4aca-859b-ae0079decf2f tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:59:21.943392 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-458d1cc3-494c-4aca-859b-ae0079decf2f tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] [instance: 4cd7faab-c92d-4ab9-bd27-14823533edd3] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:21.962455 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-458d1cc3-494c-4aca-859b-ae0079decf2f tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:21.965911 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-458d1cc3-494c-4aca-859b-ae0079decf2f tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:21.966467 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-458d1cc3-494c-4aca-859b-ae0079decf2f tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:21.967231 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-458d1cc3-494c-4aca-859b-ae0079decf2f tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:21.968375 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-458d1cc3-494c-4aca-859b-ae0079decf2f tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:21.968995 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-458d1cc3-494c-4aca-859b-ae0079decf2f tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:21.998802 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-458d1cc3-494c-4aca-859b-ae0079decf2f tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] HTTP exception thrown: Instance 4cd7faab-c92d-4ab9-bd27-14823533edd3 could not be found. Oct 04 18:59:22.000236 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-458d1cc3-494c-4aca-859b-ae0079decf2f tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Request method failure captured: Oct 04 18:59:22.000236 n-d-851028-13 devstack@n-api.service[123596]: request: DELETE /compute/v2.1/servers/4cd7faab-c92d-4ab9-bd27-14823533edd3 HTTP/1.1 Oct 04 18:59:22.000236 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:59:22.000236 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:59:22.000236 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:59:22.000236 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 18:59:22.000236 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:59:22.000236 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:59:22.000236 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:59:22.000236 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:59:22.000236 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPIICP1PtS01HownqWweSgla4CcRPtCgAdUBaEdEc6vx8Ncus8eLhH3dUpUsQR0zHlOYk7gtTA9aUBKdVN35F_FIxu9OfoM4v3Fp57WQY2oesEAUq1sgUUAtkajJI3A6Mo7YDom3zBbqxWNa-Zc3eKb0_xGvtwa-4t27lLZncqqwgnro Oct 04 18:59:22.000236 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:59:22.000236 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:59:22.000236 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:59:22.000236 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:59:22.000236 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:59:22.000236 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:59:22.000236 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: a9330711915a4b7f9d0f3559f0f19083 Oct 04 18:59:22.000236 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-ServersTestMultiNic-2007496041 Oct 04 18:59:22.000236 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 18:59:22.000236 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 18:59:22.000236 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/a9330711915a4b7f9d0f3559f0f19083"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_a9330711915a4b7f9d0f3559f0f19083"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a9330711915a4b7f9d0f3559f0f19083"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a9330711915a4b7f9d0f3559f0f19083"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:59:22.000236 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-ServersTestMultiNic-2007496041 Oct 04 18:59:22.000236 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: a9330711915a4b7f9d0f3559f0f19083 Oct 04 18:59:22.000236 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-ServersTestMultiNic-2007496041 Oct 04 18:59:22.000236 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-ServersTestMultiNic-2007496041-project Oct 04 18:59:22.000236 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:59:22.000236 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:59:22.000236 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: da3b918706c14020910d5d0e97d96656 Oct 04 18:59:22.000236 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-ServersTestMultiNic-2007496041-project Oct 04 18:59:22.000236 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 18:59:22.000236 n-d-851028-13 devstack@n-api.service[123596]: exception: Instance 4cd7faab-c92d-4ab9-bd27-14823533edd3 could not be found. Oct 04 18:59:22.000236 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': '4cd7faab-c92d-4ab9-bd27-14823533edd3'} Oct 04 18:59:22.000236 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:59:22.000236 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:59:22.000236 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:59:22.000236 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:59:22.000236 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:59:22.000236 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:59:22.000236 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:59:22.000236 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:59:22.000236 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:59:22.000236 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:59:22.000236 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4cd7faab-c92d-4ab9-bd27-14823533edd3 could not be found. Oct 04 18:59:22.000236 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:59:22.000236 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:59:22.000236 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:59:22.000236 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:59:22.000236 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:59:22.000236 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:59:22.000236 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:59:22.000236 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:59:22.000236 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:59:22.000236 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:59:22.000236 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:59:22.000236 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:59:22.000236 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:59:22.000236 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:59:22.000236 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:59:22.000236 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:59:22.000236 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:59:22.000236 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:59:22.004069 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4cd7faab-c92d-4ab9-bd27-14823533edd3 could not be found. Oct 04 18:59:22.004069 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:59:22.004069 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:59:22.004069 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:59:22.004069 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:59:22.004069 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:59:22.004069 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:59:22.004069 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:59:22.004069 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:59:22.004069 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4cd7faab-c92d-4ab9-bd27-14823533edd3 could not be found. Oct 04 18:59:22.004069 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:59:22.013913 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-458d1cc3-494c-4aca-859b-ae0079decf2f tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Returning 404 to user: Instance 4cd7faab-c92d-4ab9-bd27-14823533edd3 could not be found. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:59:22.013913 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-458d1cc3-494c-4aca-859b-ae0079decf2f tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] 10.222.0.43 "DELETE /compute/v2.1/servers/4cd7faab-c92d-4ab9-bd27-14823533edd3" status: 404 len: 111 microversion: 2.1 time: 0.074403 Oct 04 18:59:22.018204 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2819/5298] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 18:59:21 2022] DELETE /compute/v2.1/servers/4cd7faab-c92d-4ab9-bd27-14823533edd3 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:59:22.024559 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-344e5dd0-9b99-4de0-82e1-2598561cbfec tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:59:22.026103 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-344e5dd0-9b99-4de0-82e1-2598561cbfec tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] [instance: 4cd7faab-c92d-4ab9-bd27-14823533edd3] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:22.037479 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-344e5dd0-9b99-4de0-82e1-2598561cbfec tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:22.038357 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-344e5dd0-9b99-4de0-82e1-2598561cbfec tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:22.041688 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-344e5dd0-9b99-4de0-82e1-2598561cbfec tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:22.042757 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-344e5dd0-9b99-4de0-82e1-2598561cbfec tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:22.043460 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-344e5dd0-9b99-4de0-82e1-2598561cbfec tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:22.044163 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-344e5dd0-9b99-4de0-82e1-2598561cbfec tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:22.066976 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:59:22.077079 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-344e5dd0-9b99-4de0-82e1-2598561cbfec tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] HTTP exception thrown: Instance 4cd7faab-c92d-4ab9-bd27-14823533edd3 could not be found. Oct 04 18:59:22.079669 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-344e5dd0-9b99-4de0-82e1-2598561cbfec tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Request method failure captured: Oct 04 18:59:22.079669 n-d-851028-13 devstack@n-api.service[123595]: request: GET /compute/v2.1/servers/4cd7faab-c92d-4ab9-bd27-14823533edd3 HTTP/1.1 Oct 04 18:59:22.079669 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 18:59:22.079669 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 18:59:22.079669 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 18:59:22.079669 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 0 Oct 04 18:59:22.079669 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 18:59:22.079669 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 18:59:22.079669 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 18:59:22.079669 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 18:59:22.079669 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPIICP1PtS01HownqWweSgla4CcRPtCgAdUBaEdEc6vx8Ncus8eLhH3dUpUsQR0zHlOYk7gtTA9aUBKdVN35F_FIxu9OfoM4v3Fp57WQY2oesEAUq1sgUUAtkajJI3A6Mo7YDom3zBbqxWNa-Zc3eKb0_xGvtwa-4t27lLZncqqwgnro Oct 04 18:59:22.079669 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 18:59:22.079669 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 18:59:22.079669 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 18:59:22.079669 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 18:59:22.079669 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 18:59:22.079669 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 18:59:22.079669 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: a9330711915a4b7f9d0f3559f0f19083 Oct 04 18:59:22.079669 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-ServersTestMultiNic-2007496041 Oct 04 18:59:22.079669 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 18:59:22.079669 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 18:59:22.079669 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/a9330711915a4b7f9d0f3559f0f19083"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_a9330711915a4b7f9d0f3559f0f19083"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a9330711915a4b7f9d0f3559f0f19083"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a9330711915a4b7f9d0f3559f0f19083"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:59:22.079669 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-ServersTestMultiNic-2007496041 Oct 04 18:59:22.079669 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: a9330711915a4b7f9d0f3559f0f19083 Oct 04 18:59:22.079669 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-ServersTestMultiNic-2007496041 Oct 04 18:59:22.079669 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-ServersTestMultiNic-2007496041-project Oct 04 18:59:22.079669 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 18:59:22.079669 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 18:59:22.079669 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: da3b918706c14020910d5d0e97d96656 Oct 04 18:59:22.079669 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-ServersTestMultiNic-2007496041-project Oct 04 18:59:22.079669 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 18:59:22.079669 n-d-851028-13 devstack@n-api.service[123595]: exception: Instance 4cd7faab-c92d-4ab9-bd27-14823533edd3 could not be found. Oct 04 18:59:22.079669 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': '4cd7faab-c92d-4ab9-bd27-14823533edd3'} Oct 04 18:59:22.079669 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:59:22.079669 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:59:22.079669 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:59:22.079669 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:59:22.079669 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:59:22.079669 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:59:22.079669 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:59:22.079669 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:59:22.079669 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:59:22.079669 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:59:22.079669 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4cd7faab-c92d-4ab9-bd27-14823533edd3 could not be found. Oct 04 18:59:22.079669 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:59:22.079669 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:59:22.079669 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:59:22.079669 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:59:22.079669 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:59:22.079669 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:59:22.079669 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:59:22.079669 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:59:22.079669 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:59:22.079669 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:59:22.079669 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:59:22.079669 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:59:22.079669 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:59:22.079669 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:59:22.079669 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:59:22.079669 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:59:22.079669 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4cd7faab-c92d-4ab9-bd27-14823533edd3 could not be found. Oct 04 18:59:22.079669 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:59:22.079669 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:59:22.079669 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:59:22.083403 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:59:22.083403 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:59:22.083403 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:59:22.083403 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:59:22.083403 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:59:22.083403 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4cd7faab-c92d-4ab9-bd27-14823533edd3 could not be found. Oct 04 18:59:22.083403 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:59:22.085938 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-344e5dd0-9b99-4de0-82e1-2598561cbfec tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Returning 404 to user: Instance 4cd7faab-c92d-4ab9-bd27-14823533edd3 could not be found. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:59:22.087252 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-344e5dd0-9b99-4de0-82e1-2598561cbfec tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] 10.222.0.43 "GET /compute/v2.1/servers/4cd7faab-c92d-4ab9-bd27-14823533edd3" status: 404 len: 111 microversion: 2.1 time: 0.067902 Oct 04 18:59:22.088404 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2480/5299] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:59:22 2022] GET /compute/v2.1/servers/4cd7faab-c92d-4ab9-bd27-14823533edd3 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:59:22.097565 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-4194f206-2852-40e8-8fe0-6ac74cb538ad tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:59:22.098078 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-4194f206-2852-40e8-8fe0-6ac74cb538ad tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] [instance: f51ca9f8-1cc6-4972-882e-34937122d5e4] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:22.108504 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4194f206-2852-40e8-8fe0-6ac74cb538ad tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:22.109014 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4194f206-2852-40e8-8fe0-6ac74cb538ad tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:22.109482 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4194f206-2852-40e8-8fe0-6ac74cb538ad tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:22.110196 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4194f206-2852-40e8-8fe0-6ac74cb538ad tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:22.110654 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4194f206-2852-40e8-8fe0-6ac74cb538ad tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:22.111135 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4194f206-2852-40e8-8fe0-6ac74cb538ad tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:22.141352 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-4194f206-2852-40e8-8fe0-6ac74cb538ad tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] HTTP exception thrown: Instance f51ca9f8-1cc6-4972-882e-34937122d5e4 could not be found. Oct 04 18:59:22.154137 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-4194f206-2852-40e8-8fe0-6ac74cb538ad tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Request method failure captured: Oct 04 18:59:22.154137 n-d-851028-13 devstack@n-api.service[123596]: request: DELETE /compute/v2.1/servers/f51ca9f8-1cc6-4972-882e-34937122d5e4 HTTP/1.1 Oct 04 18:59:22.154137 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 18:59:22.154137 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 18:59:22.154137 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 18:59:22.154137 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 18:59:22.154137 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 18:59:22.154137 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 18:59:22.154137 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 18:59:22.154137 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 18:59:22.154137 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPIICP1PtS01HownqWweSgla4CcRPtCgAdUBaEdEc6vx8Ncus8eLhH3dUpUsQR0zHlOYk7gtTA9aUBKdVN35F_FIxu9OfoM4v3Fp57WQY2oesEAUq1sgUUAtkajJI3A6Mo7YDom3zBbqxWNa-Zc3eKb0_xGvtwa-4t27lLZncqqwgnro Oct 04 18:59:22.154137 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 18:59:22.154137 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 18:59:22.154137 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 18:59:22.154137 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 18:59:22.154137 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 18:59:22.154137 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 18:59:22.154137 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: a9330711915a4b7f9d0f3559f0f19083 Oct 04 18:59:22.154137 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-ServersTestMultiNic-2007496041 Oct 04 18:59:22.154137 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 18:59:22.154137 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 18:59:22.154137 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/a9330711915a4b7f9d0f3559f0f19083"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_a9330711915a4b7f9d0f3559f0f19083"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a9330711915a4b7f9d0f3559f0f19083"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a9330711915a4b7f9d0f3559f0f19083"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:59:22.154137 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-ServersTestMultiNic-2007496041 Oct 04 18:59:22.154137 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: a9330711915a4b7f9d0f3559f0f19083 Oct 04 18:59:22.154137 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-ServersTestMultiNic-2007496041 Oct 04 18:59:22.154137 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-ServersTestMultiNic-2007496041-project Oct 04 18:59:22.154137 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 18:59:22.154137 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 18:59:22.154137 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: da3b918706c14020910d5d0e97d96656 Oct 04 18:59:22.154137 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-ServersTestMultiNic-2007496041-project Oct 04 18:59:22.154137 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 18:59:22.154137 n-d-851028-13 devstack@n-api.service[123596]: exception: Instance f51ca9f8-1cc6-4972-882e-34937122d5e4 could not be found. Oct 04 18:59:22.154137 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': 'f51ca9f8-1cc6-4972-882e-34937122d5e4'} Oct 04 18:59:22.154137 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:59:22.154137 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:59:22.154137 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:59:22.154137 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:59:22.154137 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:59:22.154137 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:59:22.154137 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:59:22.154137 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:59:22.154137 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:59:22.154137 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:59:22.154137 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f51ca9f8-1cc6-4972-882e-34937122d5e4 could not be found. Oct 04 18:59:22.154137 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:59:22.154137 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:59:22.154137 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:59:22.154137 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:59:22.154137 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:59:22.154137 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:59:22.154137 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:59:22.154137 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:59:22.154137 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:59:22.154137 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:59:22.154137 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:59:22.154137 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:59:22.154137 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:59:22.154137 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:59:22.154137 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:59:22.154137 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:59:22.154137 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:59:22.154137 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:59:22.159832 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f51ca9f8-1cc6-4972-882e-34937122d5e4 could not be found. Oct 04 18:59:22.159832 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:59:22.159832 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:59:22.159832 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:59:22.159832 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:59:22.159832 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:59:22.159832 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:59:22.159832 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:59:22.159832 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:59:22.159832 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f51ca9f8-1cc6-4972-882e-34937122d5e4 could not be found. Oct 04 18:59:22.159832 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 18:59:22.166266 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-4194f206-2852-40e8-8fe0-6ac74cb538ad tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Returning 404 to user: Instance f51ca9f8-1cc6-4972-882e-34937122d5e4 could not be found. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:59:22.168253 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-4194f206-2852-40e8-8fe0-6ac74cb538ad tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] 10.222.0.43 "DELETE /compute/v2.1/servers/f51ca9f8-1cc6-4972-882e-34937122d5e4" status: 404 len: 111 microversion: 2.1 time: 0.075003 Oct 04 18:59:22.177019 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2820/5300] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 18:59:22 2022] DELETE /compute/v2.1/servers/f51ca9f8-1cc6-4972-882e-34937122d5e4 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:59:22.184167 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-df7f38b2-385a-4807-98d6-220ab6445aa8 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:59:22.185181 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-df7f38b2-385a-4807-98d6-220ab6445aa8 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] [instance: f51ca9f8-1cc6-4972-882e-34937122d5e4] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:22.197330 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-df7f38b2-385a-4807-98d6-220ab6445aa8 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:22.197850 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-df7f38b2-385a-4807-98d6-220ab6445aa8 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:22.200009 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-df7f38b2-385a-4807-98d6-220ab6445aa8 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:22.205175 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-df7f38b2-385a-4807-98d6-220ab6445aa8 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:22.206003 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-df7f38b2-385a-4807-98d6-220ab6445aa8 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:22.207145 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-df7f38b2-385a-4807-98d6-220ab6445aa8 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:22.232789 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-df7f38b2-385a-4807-98d6-220ab6445aa8 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] HTTP exception thrown: Instance f51ca9f8-1cc6-4972-882e-34937122d5e4 could not be found. Oct 04 18:59:22.235779 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-df7f38b2-385a-4807-98d6-220ab6445aa8 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Request method failure captured: Oct 04 18:59:22.235779 n-d-851028-13 devstack@n-api.service[123595]: request: GET /compute/v2.1/servers/f51ca9f8-1cc6-4972-882e-34937122d5e4 HTTP/1.1 Oct 04 18:59:22.235779 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 18:59:22.235779 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 18:59:22.235779 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 18:59:22.235779 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 0 Oct 04 18:59:22.235779 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 18:59:22.235779 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 18:59:22.235779 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 18:59:22.235779 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 18:59:22.235779 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPIICP1PtS01HownqWweSgla4CcRPtCgAdUBaEdEc6vx8Ncus8eLhH3dUpUsQR0zHlOYk7gtTA9aUBKdVN35F_FIxu9OfoM4v3Fp57WQY2oesEAUq1sgUUAtkajJI3A6Mo7YDom3zBbqxWNa-Zc3eKb0_xGvtwa-4t27lLZncqqwgnro Oct 04 18:59:22.235779 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 18:59:22.235779 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 18:59:22.235779 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 18:59:22.235779 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 18:59:22.235779 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 18:59:22.235779 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 18:59:22.235779 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: a9330711915a4b7f9d0f3559f0f19083 Oct 04 18:59:22.235779 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-ServersTestMultiNic-2007496041 Oct 04 18:59:22.235779 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 18:59:22.235779 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 18:59:22.235779 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/a9330711915a4b7f9d0f3559f0f19083"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_a9330711915a4b7f9d0f3559f0f19083"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a9330711915a4b7f9d0f3559f0f19083"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a9330711915a4b7f9d0f3559f0f19083"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 18:59:22.235779 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-ServersTestMultiNic-2007496041 Oct 04 18:59:22.235779 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: a9330711915a4b7f9d0f3559f0f19083 Oct 04 18:59:22.235779 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-ServersTestMultiNic-2007496041 Oct 04 18:59:22.235779 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-ServersTestMultiNic-2007496041-project Oct 04 18:59:22.235779 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 18:59:22.235779 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 18:59:22.235779 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: da3b918706c14020910d5d0e97d96656 Oct 04 18:59:22.235779 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-ServersTestMultiNic-2007496041-project Oct 04 18:59:22.235779 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 18:59:22.235779 n-d-851028-13 devstack@n-api.service[123595]: exception: Instance f51ca9f8-1cc6-4972-882e-34937122d5e4 could not be found. Oct 04 18:59:22.235779 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': 'f51ca9f8-1cc6-4972-882e-34937122d5e4'} Oct 04 18:59:22.235779 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:59:22.235779 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:59:22.235779 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:59:22.235779 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:59:22.235779 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:59:22.235779 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:59:22.235779 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:59:22.235779 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:59:22.235779 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:59:22.235779 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:59:22.235779 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f51ca9f8-1cc6-4972-882e-34937122d5e4 could not be found. Oct 04 18:59:22.235779 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:59:22.235779 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:59:22.235779 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:59:22.235779 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:59:22.235779 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:59:22.235779 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:59:22.235779 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:59:22.235779 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:59:22.235779 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:59:22.235779 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:59:22.235779 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:59:22.235779 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:59:22.235779 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:59:22.235779 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:59:22.235779 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:59:22.235779 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:59:22.235779 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f51ca9f8-1cc6-4972-882e-34937122d5e4 could not be found. Oct 04 18:59:22.235779 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:59:22.235779 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:59:22.235779 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:59:22.241395 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:59:22.241395 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:59:22.241395 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:59:22.241395 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:59:22.241395 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:59:22.241395 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f51ca9f8-1cc6-4972-882e-34937122d5e4 could not be found. Oct 04 18:59:22.241395 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 18:59:22.256861 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-df7f38b2-385a-4807-98d6-220ab6445aa8 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] Returning 404 to user: Instance f51ca9f8-1cc6-4972-882e-34937122d5e4 could not be found. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:59:22.259574 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-df7f38b2-385a-4807-98d6-220ab6445aa8 tempest-ServersTestMultiNic-2007496041 tempest-ServersTestMultiNic-2007496041-project] 10.222.0.43 "GET /compute/v2.1/servers/f51ca9f8-1cc6-4972-882e-34937122d5e4" status: 404 len: 111 microversion: 2.1 time: 0.080370 Oct 04 18:59:22.265480 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2481/5301] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:59:22 2022] GET /compute/v2.1/servers/f51ca9f8-1cc6-4972-882e-34937122d5e4 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:59:22.329457 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-1541195c-7475-48dc-9ef3-5b483f589887 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Action: 'create', calling method: .version_select at 0x7fb21f146b80>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1893152624", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAdmQ84dXw15oWF8j/2Tn1Hnf8zYZoyvstMYKnsD9bZfpK7UpDBGXie932e9oz5rWsi89Gjlla8zlsT2HkOCkzBwNs/6+MpVKVpw8sRlVRe5GodkXwqV5zrJSAgk5wEPhQ=="}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:59:22.369905 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-1541195c-7475-48dc-9ef3-5b483f589887 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Getting quotas for project 27a4c327763b4440a9dc456cfbb31f88. Resources: {'key_pairs'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:59:22.379026 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-1541195c-7475-48dc-9ef3-5b483f589887 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Getting quotas for user fc1bb492fb294837b1e55d58bbfa3d0b and project 27a4c327763b4440a9dc456cfbb31f88. Resources: {'key_pairs'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:59:22.444908 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-1541195c-7475-48dc-9ef3-5b483f589887 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.119931 Oct 04 18:59:22.446192 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2821/5302] 10.222.0.43 () {60 vars in 1159 bytes} [Tue Oct 4 18:59:22 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:59:25.436712 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-6ba82e0c-6a4f-4b50-8c06-9a0802ebf9a4 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1709652993", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452", "networks": [{"uuid": "774e8681-933c-4cbc-a3a3-da5b9fb962b6"}], "key_name": "tempest-TestNetworkBasicOps-1893152624", "security_groups": [{"name": "tempest-secgroup-smoke-204939088"}]}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:59:25.862635 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-877f08ec-3d0c-4144-a99b-b706ed6a760f tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:59:25.863426 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-877f08ec-3d0c-4144-a99b-b706ed6a760f tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] [instance: 0ab8644c-b040-46c1-913b-46d595bde978] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:25.885041 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-877f08ec-3d0c-4144-a99b-b706ed6a760f tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:25.889730 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-877f08ec-3d0c-4144-a99b-b706ed6a760f tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:25.890482 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-877f08ec-3d0c-4144-a99b-b706ed6a760f tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:25.891443 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-877f08ec-3d0c-4144-a99b-b706ed6a760f tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:25.892457 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-877f08ec-3d0c-4144-a99b-b706ed6a760f tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:25.905849 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-877f08ec-3d0c-4144-a99b-b706ed6a760f tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:25.943996 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=66 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:59:25.964063 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-877f08ec-3d0c-4144-a99b-b706ed6a760f tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] 10.222.0.43 "GET /compute/v2.1/servers/0ab8644c-b040-46c1-913b-46d595bde978/ips" status: 200 len: 150 microversion: 2.1 time: 0.113274 Oct 04 18:59:25.974978 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2822/5303] 10.222.0.43 () {58 vars in 1248 bytes} [Tue Oct 4 18:59:25 2022] GET /compute/v2.1/servers/0ab8644c-b040-46c1-913b-46d595bde978/ips => generated 150 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:59:25.978032 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.network.neutron [None req-6ba82e0c-6a4f-4b50-8c06-9a0802ebf9a4 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] validate_networks() for [('774e8681-933c-4cbc-a3a3-da5b9fb962b6', None, None, None, None, None)] {{(pid=123595) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:59:27.273226 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-6ba82e0c-6a4f-4b50-8c06-9a0802ebf9a4 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Flavor limits 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:59:27.273830 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-6ba82e0c-6a4f-4b50-8c06-9a0802ebf9a4 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Image limits 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:59:27.274969 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-6ba82e0c-6a4f-4b50-8c06-9a0802ebf9a4 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Flavor pref 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:59:27.275627 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-6ba82e0c-6a4f-4b50-8c06-9a0802ebf9a4 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Image pref 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:59:27.276537 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-6ba82e0c-6a4f-4b50-8c06-9a0802ebf9a4 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:59:27.298642 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6ba82e0c-6a4f-4b50-8c06-9a0802ebf9a4 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:27.299536 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6ba82e0c-6a4f-4b50-8c06-9a0802ebf9a4 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:27.300182 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6ba82e0c-6a4f-4b50-8c06-9a0802ebf9a4 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:27.301198 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6ba82e0c-6a4f-4b50-8c06-9a0802ebf9a4 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:27.301872 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6ba82e0c-6a4f-4b50-8c06-9a0802ebf9a4 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:27.302521 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6ba82e0c-6a4f-4b50-8c06-9a0802ebf9a4 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:27.348730 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-6ba82e0c-6a4f-4b50-8c06-9a0802ebf9a4 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Getting quotas for project 27a4c327763b4440a9dc456cfbb31f88. Resources: {'ram', 'cores', 'instances'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:59:27.378559 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-6ba82e0c-6a4f-4b50-8c06-9a0802ebf9a4 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Getting quotas for user fc1bb492fb294837b1e55d58bbfa3d0b and project 27a4c327763b4440a9dc456cfbb31f88. Resources: {'ram', 'cores', 'instances'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:59:27.413958 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-6ba82e0c-6a4f-4b50-8c06-9a0802ebf9a4 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Going to run 1 instances... {{(pid=123595) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:59:27.416957 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-6ba82e0c-6a4f-4b50-8c06-9a0802ebf9a4 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] [instance: f2d96060-bc2d-461c-9705-67a3845451ef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e8943ec5-4038-4d4b-b9b9-2415a79f5243',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:59:27.542366 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-6ba82e0c-6a4f-4b50-8c06-9a0802ebf9a4 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.110878 Oct 04 18:59:27.544097 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2482/5304] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 18:59:25 2022] POST /compute/v2.1/servers => generated 405 bytes in 2113 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:59:27.559899 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-483d8970-7c25-405a-83c3-f428673b91e8 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:59:27.561041 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-483d8970-7c25-405a-83c3-f428673b91e8 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] [instance: f2d96060-bc2d-461c-9705-67a3845451ef] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:27.714959 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-483d8970-7c25-405a-83c3-f428673b91e8 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1bb492fb294837b1e55d58bbfa3d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a4c327763b4440a9dc456cfbb31f88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:27.724743 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-483d8970-7c25-405a-83c3-f428673b91e8 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] 10.222.0.43 "GET /compute/v2.1/servers/f2d96060-bc2d-461c-9705-67a3845451ef" status: 200 len: 1249 microversion: 2.1 time: 0.172237 Oct 04 18:59:27.728688 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2823/5305] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:59:27 2022] GET /compute/v2.1/servers/f2d96060-bc2d-461c-9705-67a3845451ef => generated 1249 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:59:28.757954 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-7446d579-52fd-4e26-92b2-70453b6c0d6d tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:59:28.758876 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-7446d579-52fd-4e26-92b2-70453b6c0d6d tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] [instance: f2d96060-bc2d-461c-9705-67a3845451ef] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:28.770047 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7446d579-52fd-4e26-92b2-70453b6c0d6d tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:28.775737 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7446d579-52fd-4e26-92b2-70453b6c0d6d tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:28.776425 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7446d579-52fd-4e26-92b2-70453b6c0d6d tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:28.777307 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7446d579-52fd-4e26-92b2-70453b6c0d6d tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:28.777882 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7446d579-52fd-4e26-92b2-70453b6c0d6d tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:28.778427 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7446d579-52fd-4e26-92b2-70453b6c0d6d tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:28.931430 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-89ee4107-c4e9-4046-9da1-f34b856cc14e tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0c9ceaa4-a365-49c2-a353-a12dd66249d8"}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:59:28.933893 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-89ee4107-c4e9-4046-9da1-f34b856cc14e tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] [instance: 0ab8644c-b040-46c1-913b-46d595bde978] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:28.950158 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-89ee4107-c4e9-4046-9da1-f34b856cc14e tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:28.950840 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-89ee4107-c4e9-4046-9da1-f34b856cc14e tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:28.951394 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-89ee4107-c4e9-4046-9da1-f34b856cc14e tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:28.952308 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-89ee4107-c4e9-4046-9da1-f34b856cc14e tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:28.952892 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-89ee4107-c4e9-4046-9da1-f34b856cc14e tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:28.954806 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-89ee4107-c4e9-4046-9da1-f34b856cc14e tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:29.039462 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-7446d579-52fd-4e26-92b2-70453b6c0d6d tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1bb492fb294837b1e55d58bbfa3d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a4c327763b4440a9dc456cfbb31f88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:29.070279 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-7446d579-52fd-4e26-92b2-70453b6c0d6d tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] 10.222.0.43 "GET /compute/v2.1/servers/f2d96060-bc2d-461c-9705-67a3845451ef" status: 200 len: 1245 microversion: 2.1 time: 0.318626 Oct 04 18:59:29.083803 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2483/5306] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:59:28 2022] GET /compute/v2.1/servers/f2d96060-bc2d-461c-9705-67a3845451ef => generated 1245 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:59:29.449747 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-89ee4107-c4e9-4046-9da1-f34b856cc14e tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] 10.222.0.43 "POST /compute/v2.1/servers/0ab8644c-b040-46c1-913b-46d595bde978/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.523144 Oct 04 18:59:29.452432 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2824/5307] 10.222.0.43 () {60 vars in 1323 bytes} [Tue Oct 4 18:59:28 2022] POST /compute/v2.1/servers/0ab8644c-b040-46c1-913b-46d595bde978/os-volume_attachments => generated 194 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:59:30.106545 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-0e77b4bc-798a-4a66-9346-2f75375e6338 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:59:30.107204 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-0e77b4bc-798a-4a66-9346-2f75375e6338 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] [instance: f2d96060-bc2d-461c-9705-67a3845451ef] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:30.117444 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0e77b4bc-798a-4a66-9346-2f75375e6338 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:30.121159 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0e77b4bc-798a-4a66-9346-2f75375e6338 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:30.121937 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0e77b4bc-798a-4a66-9346-2f75375e6338 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:30.135998 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0e77b4bc-798a-4a66-9346-2f75375e6338 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:30.149894 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0e77b4bc-798a-4a66-9346-2f75375e6338 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:30.150382 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0e77b4bc-798a-4a66-9346-2f75375e6338 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:30.489383 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-0e77b4bc-798a-4a66-9346-2f75375e6338 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1bb492fb294837b1e55d58bbfa3d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a4c327763b4440a9dc456cfbb31f88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:30.502951 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-0e77b4bc-798a-4a66-9346-2f75375e6338 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] 10.222.0.43 "GET /compute/v2.1/servers/f2d96060-bc2d-461c-9705-67a3845451ef" status: 200 len: 1309 microversion: 2.1 time: 0.400465 Oct 04 18:59:30.514078 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2484/5308] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:59:30 2022] GET /compute/v2.1/servers/f2d96060-bc2d-461c-9705-67a3845451ef => generated 1309 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:59:31.542720 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-b7ddd987-f582-445d-8dbd-cd88f6ae8e8b tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:59:31.543825 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-b7ddd987-f582-445d-8dbd-cd88f6ae8e8b tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] [instance: f2d96060-bc2d-461c-9705-67a3845451ef] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:31.560108 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=1 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:59:31.564730 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b7ddd987-f582-445d-8dbd-cd88f6ae8e8b tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:31.565168 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b7ddd987-f582-445d-8dbd-cd88f6ae8e8b tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:31.567681 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b7ddd987-f582-445d-8dbd-cd88f6ae8e8b tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:31.569164 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b7ddd987-f582-445d-8dbd-cd88f6ae8e8b tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:31.572336 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b7ddd987-f582-445d-8dbd-cd88f6ae8e8b tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:31.572975 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b7ddd987-f582-445d-8dbd-cd88f6ae8e8b tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:31.739270 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-b7ddd987-f582-445d-8dbd-cd88f6ae8e8b tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1bb492fb294837b1e55d58bbfa3d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a4c327763b4440a9dc456cfbb31f88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:31.750262 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-b7ddd987-f582-445d-8dbd-cd88f6ae8e8b tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] 10.222.0.43 "GET /compute/v2.1/servers/f2d96060-bc2d-461c-9705-67a3845451ef" status: 200 len: 1307 microversion: 2.1 time: 0.213723 Oct 04 18:59:31.767133 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2825/5309] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:59:31 2022] GET /compute/v2.1/servers/f2d96060-bc2d-461c-9705-67a3845451ef => generated 1307 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:59:32.791589 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-27620930-7c28-4f0d-8115-e05c8daa5fbe tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:59:32.794649 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-27620930-7c28-4f0d-8115-e05c8daa5fbe tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] [instance: f2d96060-bc2d-461c-9705-67a3845451ef] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:32.813957 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:59:32.829916 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-27620930-7c28-4f0d-8115-e05c8daa5fbe tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:32.830624 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-27620930-7c28-4f0d-8115-e05c8daa5fbe tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:32.831122 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-27620930-7c28-4f0d-8115-e05c8daa5fbe tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:32.832081 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-27620930-7c28-4f0d-8115-e05c8daa5fbe tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:32.832567 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-27620930-7c28-4f0d-8115-e05c8daa5fbe tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:32.832996 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-27620930-7c28-4f0d-8115-e05c8daa5fbe tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:33.561305 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-27620930-7c28-4f0d-8115-e05c8daa5fbe tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1bb492fb294837b1e55d58bbfa3d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a4c327763b4440a9dc456cfbb31f88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:33.570510 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-27620930-7c28-4f0d-8115-e05c8daa5fbe tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] 10.222.0.43 "GET /compute/v2.1/servers/f2d96060-bc2d-461c-9705-67a3845451ef" status: 200 len: 1374 microversion: 2.1 time: 0.793952 Oct 04 18:59:33.574264 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2485/5310] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:59:32 2022] GET /compute/v2.1/servers/f2d96060-bc2d-461c-9705-67a3845451ef => generated 1374 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:59:34.605854 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-c8a09c82-476a-4325-91f7-9cc44ca42865 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:59:34.607047 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-c8a09c82-476a-4325-91f7-9cc44ca42865 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] [instance: f2d96060-bc2d-461c-9705-67a3845451ef] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:34.619981 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c8a09c82-476a-4325-91f7-9cc44ca42865 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:34.620755 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c8a09c82-476a-4325-91f7-9cc44ca42865 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:34.621597 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c8a09c82-476a-4325-91f7-9cc44ca42865 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:34.622921 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c8a09c82-476a-4325-91f7-9cc44ca42865 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:34.623663 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c8a09c82-476a-4325-91f7-9cc44ca42865 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:34.624474 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c8a09c82-476a-4325-91f7-9cc44ca42865 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:34.986156 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-c8a09c82-476a-4325-91f7-9cc44ca42865 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1bb492fb294837b1e55d58bbfa3d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a4c327763b4440a9dc456cfbb31f88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:35.002615 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-c8a09c82-476a-4325-91f7-9cc44ca42865 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] 10.222.0.43 "GET /compute/v2.1/servers/f2d96060-bc2d-461c-9705-67a3845451ef" status: 200 len: 1374 microversion: 2.1 time: 0.402833 Oct 04 18:59:35.004190 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2826/5311] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:59:34 2022] GET /compute/v2.1/servers/f2d96060-bc2d-461c-9705-67a3845451ef => generated 1374 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:59:35.592058 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-a2465d1f-96d2-459a-892f-9c792b0f6b21 req-7c5ac798-e951-4e2b-b984-f518b8cf7b07 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2d96060-bc2d-461c-9705-67a3845451ef", "tag": "8bd347ce-362c-4fbe-9877-d6c2c942865a"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:59:35.615241 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-a2465d1f-96d2-459a-892f-9c792b0f6b21 req-7c5ac798-e951-4e2b-b984-f518b8cf7b07 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:35.616022 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-a2465d1f-96d2-459a-892f-9c792b0f6b21 req-7c5ac798-e951-4e2b-b984-f518b8cf7b07 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:35.616681 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-a2465d1f-96d2-459a-892f-9c792b0f6b21 req-7c5ac798-e951-4e2b-b984-f518b8cf7b07 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:35.640921 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-a2465d1f-96d2-459a-892f-9c792b0f6b21 req-7c5ac798-e951-4e2b-b984-f518b8cf7b07 service nova] Creating event network-changed:8bd347ce-362c-4fbe-9877-d6c2c942865a for instance f2d96060-bc2d-461c-9705-67a3845451ef on n-h1-851028-13 Oct 04 18:59:35.654283 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-a2465d1f-96d2-459a-892f-9c792b0f6b21 req-7c5ac798-e951-4e2b-b984-f518b8cf7b07 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073184 Oct 04 18:59:35.655644 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2486/5312] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:59:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:59:36.036957 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-7c54879d-c4d0-4ee8-abbd-cb8b11292fa1 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:59:36.038181 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-7c54879d-c4d0-4ee8-abbd-cb8b11292fa1 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] [instance: f2d96060-bc2d-461c-9705-67a3845451ef] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:36.055954 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7c54879d-c4d0-4ee8-abbd-cb8b11292fa1 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:36.059491 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7c54879d-c4d0-4ee8-abbd-cb8b11292fa1 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:36.061607 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7c54879d-c4d0-4ee8-abbd-cb8b11292fa1 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:36.064894 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7c54879d-c4d0-4ee8-abbd-cb8b11292fa1 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:36.067504 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7c54879d-c4d0-4ee8-abbd-cb8b11292fa1 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:36.069202 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7c54879d-c4d0-4ee8-abbd-cb8b11292fa1 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:36.662407 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-7c54879d-c4d0-4ee8-abbd-cb8b11292fa1 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1bb492fb294837b1e55d58bbfa3d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a4c327763b4440a9dc456cfbb31f88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:36.677774 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-7c54879d-c4d0-4ee8-abbd-cb8b11292fa1 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] 10.222.0.43 "GET /compute/v2.1/servers/f2d96060-bc2d-461c-9705-67a3845451ef" status: 200 len: 1374 microversion: 2.1 time: 0.645633 Oct 04 18:59:36.678869 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2827/5313] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:59:36 2022] GET /compute/v2.1/servers/f2d96060-bc2d-461c-9705-67a3845451ef => generated 1374 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:59:37.365673 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=2 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:59:37.398641 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=6 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:59:37.710844 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-2c94669d-a6cb-433e-bbef-ef838a7fb288 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:59:37.711665 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-2c94669d-a6cb-433e-bbef-ef838a7fb288 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] [instance: f2d96060-bc2d-461c-9705-67a3845451ef] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:37.722221 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2c94669d-a6cb-433e-bbef-ef838a7fb288 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:37.728290 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2c94669d-a6cb-433e-bbef-ef838a7fb288 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:37.730844 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2c94669d-a6cb-433e-bbef-ef838a7fb288 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:37.731971 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2c94669d-a6cb-433e-bbef-ef838a7fb288 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:37.734026 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2c94669d-a6cb-433e-bbef-ef838a7fb288 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:37.736516 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2c94669d-a6cb-433e-bbef-ef838a7fb288 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:37.738722 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=6 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:59:37.775309 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-00810ae7-00fe-4441-a021-8f2604739dba tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:59:37.776106 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-00810ae7-00fe-4441-a021-8f2604739dba tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] [instance: 02a066b4-243b-4fe3-afcf-30f3e9511d1b] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:37.793492 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-00810ae7-00fe-4441-a021-8f2604739dba tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:37.793995 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-00810ae7-00fe-4441-a021-8f2604739dba tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:37.796729 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-00810ae7-00fe-4441-a021-8f2604739dba tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:37.797549 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-00810ae7-00fe-4441-a021-8f2604739dba tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:37.798028 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-00810ae7-00fe-4441-a021-8f2604739dba tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:37.801075 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-00810ae7-00fe-4441-a021-8f2604739dba tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:37.855024 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-00810ae7-00fe-4441-a021-8f2604739dba tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] [instance: 02a066b4-243b-4fe3-afcf-30f3e9511d1b] Going to try to terminate instance {{(pid=123595) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:59:38.004151 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-00810ae7-00fe-4441-a021-8f2604739dba tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] 10.222.0.43 "DELETE /compute/v2.1/servers/02a066b4-243b-4fe3-afcf-30f3e9511d1b" status: 204 len: 0 microversion: 2.42 time: 0.644238 Oct 04 18:59:38.006773 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2487/5314] 10.222.0.43 () {60 vars in 1280 bytes} [Tue Oct 4 18:59:37 2022] DELETE /compute/v2.1/servers/02a066b4-243b-4fe3-afcf-30f3e9511d1b => generated 0 bytes in 648 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 18:59:38.025374 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-8d70caeb-0b6b-4dbb-b120-ced8c389391b tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:59:38.026808 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-8d70caeb-0b6b-4dbb-b120-ced8c389391b tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] [instance: 02a066b4-243b-4fe3-afcf-30f3e9511d1b] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:38.038138 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8d70caeb-0b6b-4dbb-b120-ced8c389391b tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:38.040209 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8d70caeb-0b6b-4dbb-b120-ced8c389391b tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:38.051895 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8d70caeb-0b6b-4dbb-b120-ced8c389391b tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:38.054348 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8d70caeb-0b6b-4dbb-b120-ced8c389391b tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:38.055112 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8d70caeb-0b6b-4dbb-b120-ced8c389391b tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:38.056565 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8d70caeb-0b6b-4dbb-b120-ced8c389391b tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:38.248437 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-2c94669d-a6cb-433e-bbef-ef838a7fb288 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1bb492fb294837b1e55d58bbfa3d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a4c327763b4440a9dc456cfbb31f88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:38.265694 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-2c94669d-a6cb-433e-bbef-ef838a7fb288 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] 10.222.0.43 "GET /compute/v2.1/servers/f2d96060-bc2d-461c-9705-67a3845451ef" status: 200 len: 1374 microversion: 2.1 time: 0.559613 Oct 04 18:59:38.266953 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2828/5315] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:59:37 2022] GET /compute/v2.1/servers/f2d96060-bc2d-461c-9705-67a3845451ef => generated 1374 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:59:38.595546 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-8d70caeb-0b6b-4dbb-b120-ced8c389391b tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:38.654947 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-8d70caeb-0b6b-4dbb-b120-ced8c389391b tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:38.656496 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-8d70caeb-0b6b-4dbb-b120-ced8c389391b tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:38.659344 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-8d70caeb-0b6b-4dbb-b120-ced8c389391b tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] 10.222.0.43 "GET /compute/v2.1/servers/02a066b4-243b-4fe3-afcf-30f3e9511d1b" status: 200 len: 2957 microversion: 2.42 time: 0.647621 Oct 04 18:59:38.660060 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2488/5316] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:59:38 2022] GET /compute/v2.1/servers/02a066b4-243b-4fe3-afcf-30f3e9511d1b => generated 2957 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:59:39.296218 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-3bd6e692-aa73-4779-89a8-71885145e02d tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:59:39.298052 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-3bd6e692-aa73-4779-89a8-71885145e02d tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] [instance: f2d96060-bc2d-461c-9705-67a3845451ef] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:39.314433 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3bd6e692-aa73-4779-89a8-71885145e02d tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:39.315122 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3bd6e692-aa73-4779-89a8-71885145e02d tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:39.315754 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3bd6e692-aa73-4779-89a8-71885145e02d tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:39.317290 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3bd6e692-aa73-4779-89a8-71885145e02d tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:39.318268 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3bd6e692-aa73-4779-89a8-71885145e02d tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:39.318870 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3bd6e692-aa73-4779-89a8-71885145e02d tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:39.705661 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-42473718-2b6b-49c8-bdb5-39acc02bb49f tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:59:39.705661 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-42473718-2b6b-49c8-bdb5-39acc02bb49f tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] [instance: 02a066b4-243b-4fe3-afcf-30f3e9511d1b] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:39.737176 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-42473718-2b6b-49c8-bdb5-39acc02bb49f tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:39.741478 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-42473718-2b6b-49c8-bdb5-39acc02bb49f tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:39.742058 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-42473718-2b6b-49c8-bdb5-39acc02bb49f tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:39.743995 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-42473718-2b6b-49c8-bdb5-39acc02bb49f tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:39.745525 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-42473718-2b6b-49c8-bdb5-39acc02bb49f tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:39.746060 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-42473718-2b6b-49c8-bdb5-39acc02bb49f tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:39.771168 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-3bd6e692-aa73-4779-89a8-71885145e02d tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1bb492fb294837b1e55d58bbfa3d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a4c327763b4440a9dc456cfbb31f88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:39.789205 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-3bd6e692-aa73-4779-89a8-71885145e02d tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] 10.222.0.43 "GET /compute/v2.1/servers/f2d96060-bc2d-461c-9705-67a3845451ef" status: 200 len: 1374 microversion: 2.1 time: 0.497955 Oct 04 18:59:39.790751 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2829/5317] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:59:39 2022] GET /compute/v2.1/servers/f2d96060-bc2d-461c-9705-67a3845451ef => generated 1374 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:59:40.196517 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-42473718-2b6b-49c8-bdb5-39acc02bb49f tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:40.208215 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-42473718-2b6b-49c8-bdb5-39acc02bb49f tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:40.210073 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-42473718-2b6b-49c8-bdb5-39acc02bb49f tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:40.211439 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-42473718-2b6b-49c8-bdb5-39acc02bb49f tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] 10.222.0.43 "GET /compute/v2.1/servers/02a066b4-243b-4fe3-afcf-30f3e9511d1b" status: 200 len: 2957 microversion: 2.42 time: 0.517884 Oct 04 18:59:40.226153 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2489/5318] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:59:39 2022] GET /compute/v2.1/servers/02a066b4-243b-4fe3-afcf-30f3e9511d1b => generated 2957 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:59:40.818194 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-4d99779c-64f9-4709-a87d-f460fd0d4da0 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:59:40.819362 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-4d99779c-64f9-4709-a87d-f460fd0d4da0 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] [instance: f2d96060-bc2d-461c-9705-67a3845451ef] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:40.830025 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4d99779c-64f9-4709-a87d-f460fd0d4da0 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:40.835517 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4d99779c-64f9-4709-a87d-f460fd0d4da0 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:40.836113 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4d99779c-64f9-4709-a87d-f460fd0d4da0 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:40.837175 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4d99779c-64f9-4709-a87d-f460fd0d4da0 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:40.837757 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4d99779c-64f9-4709-a87d-f460fd0d4da0 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:40.838929 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4d99779c-64f9-4709-a87d-f460fd0d4da0 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:41.241960 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-e4276431-82c4-4da8-8b74-68a2ef16fa63 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:59:41.243333 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-e4276431-82c4-4da8-8b74-68a2ef16fa63 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] [instance: 02a066b4-243b-4fe3-afcf-30f3e9511d1b] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:41.255210 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e4276431-82c4-4da8-8b74-68a2ef16fa63 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:41.259018 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e4276431-82c4-4da8-8b74-68a2ef16fa63 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:41.259762 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e4276431-82c4-4da8-8b74-68a2ef16fa63 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:41.262478 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e4276431-82c4-4da8-8b74-68a2ef16fa63 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:41.265221 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e4276431-82c4-4da8-8b74-68a2ef16fa63 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:41.265920 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e4276431-82c4-4da8-8b74-68a2ef16fa63 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:41.390714 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-4d99779c-64f9-4709-a87d-f460fd0d4da0 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1bb492fb294837b1e55d58bbfa3d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a4c327763b4440a9dc456cfbb31f88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:41.403021 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-4d99779c-64f9-4709-a87d-f460fd0d4da0 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] 10.222.0.43 "GET /compute/v2.1/servers/f2d96060-bc2d-461c-9705-67a3845451ef" status: 200 len: 1374 microversion: 2.1 time: 0.588716 Oct 04 18:59:41.403644 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2830/5319] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:59:40 2022] GET /compute/v2.1/servers/f2d96060-bc2d-461c-9705-67a3845451ef => generated 1374 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:59:41.723629 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-e4276431-82c4-4da8-8b74-68a2ef16fa63 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:41.759018 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-e4276431-82c4-4da8-8b74-68a2ef16fa63 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:41.764704 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-e4276431-82c4-4da8-8b74-68a2ef16fa63 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:41.766822 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-e4276431-82c4-4da8-8b74-68a2ef16fa63 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] 10.222.0.43 "GET /compute/v2.1/servers/02a066b4-243b-4fe3-afcf-30f3e9511d1b" status: 200 len: 2957 microversion: 2.42 time: 0.530831 Oct 04 18:59:41.771016 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2490/5320] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:59:41 2022] GET /compute/v2.1/servers/02a066b4-243b-4fe3-afcf-30f3e9511d1b => generated 2957 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:59:42.431703 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-60dffc1e-d55f-4b50-adbc-20e0b436cebb tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:59:42.432974 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-60dffc1e-d55f-4b50-adbc-20e0b436cebb tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] [instance: f2d96060-bc2d-461c-9705-67a3845451ef] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:42.439512 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-60dffc1e-d55f-4b50-adbc-20e0b436cebb tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:42.440012 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-60dffc1e-d55f-4b50-adbc-20e0b436cebb tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:42.440462 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-60dffc1e-d55f-4b50-adbc-20e0b436cebb tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:42.441188 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-60dffc1e-d55f-4b50-adbc-20e0b436cebb tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:42.441646 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-60dffc1e-d55f-4b50-adbc-20e0b436cebb tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:42.442076 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-60dffc1e-d55f-4b50-adbc-20e0b436cebb tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:42.783180 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-60dffc1e-d55f-4b50-adbc-20e0b436cebb tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1bb492fb294837b1e55d58bbfa3d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a4c327763b4440a9dc456cfbb31f88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:42.797404 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-60dffc1e-d55f-4b50-adbc-20e0b436cebb tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] 10.222.0.43 "GET /compute/v2.1/servers/f2d96060-bc2d-461c-9705-67a3845451ef" status: 200 len: 1374 microversion: 2.1 time: 0.369909 Oct 04 18:59:42.804093 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-56260d47-74f8-4a1a-a084-1588498498af tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:59:42.805976 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-56260d47-74f8-4a1a-a084-1588498498af tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] [instance: 02a066b4-243b-4fe3-afcf-30f3e9511d1b] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:42.812374 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2831/5321] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:59:42 2022] GET /compute/v2.1/servers/f2d96060-bc2d-461c-9705-67a3845451ef => generated 1374 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:59:42.832979 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-56260d47-74f8-4a1a-a084-1588498498af tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:42.833632 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-56260d47-74f8-4a1a-a084-1588498498af tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:42.834233 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-56260d47-74f8-4a1a-a084-1588498498af tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:42.835118 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-56260d47-74f8-4a1a-a084-1588498498af tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:42.835763 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-56260d47-74f8-4a1a-a084-1588498498af tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:42.836290 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-56260d47-74f8-4a1a-a084-1588498498af tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:42.943899 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-1f986309-3ace-4dd9-a423-4ed2ff2f8c86 tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-885357617", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452"}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:59:43.041943 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.network.neutron [None req-1f986309-3ace-4dd9-a423-4ed2ff2f8c86 tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] validate_networks() for None {{(pid=123596) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:59:43.391440 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-56260d47-74f8-4a1a-a084-1588498498af tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:43.407977 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-56260d47-74f8-4a1a-a084-1588498498af tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:43.409586 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-56260d47-74f8-4a1a-a084-1588498498af tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:43.410848 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-56260d47-74f8-4a1a-a084-1588498498af tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] 10.222.0.43 "GET /compute/v2.1/servers/02a066b4-243b-4fe3-afcf-30f3e9511d1b" status: 200 len: 2936 microversion: 2.42 time: 0.610598 Oct 04 18:59:43.417463 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2491/5322] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:59:42 2022] GET /compute/v2.1/servers/02a066b4-243b-4fe3-afcf-30f3e9511d1b => generated 2936 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:59:43.821597 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-564842dc-b85b-4e14-b7cb-7a5adbfa3b65 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:59:43.822929 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-564842dc-b85b-4e14-b7cb-7a5adbfa3b65 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] [instance: f2d96060-bc2d-461c-9705-67a3845451ef] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:43.834571 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-564842dc-b85b-4e14-b7cb-7a5adbfa3b65 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:43.836005 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-564842dc-b85b-4e14-b7cb-7a5adbfa3b65 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:43.836653 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-564842dc-b85b-4e14-b7cb-7a5adbfa3b65 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:43.838330 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-564842dc-b85b-4e14-b7cb-7a5adbfa3b65 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:43.839020 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-564842dc-b85b-4e14-b7cb-7a5adbfa3b65 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:43.839768 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-564842dc-b85b-4e14-b7cb-7a5adbfa3b65 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:44.273088 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-1f986309-3ace-4dd9-a423-4ed2ff2f8c86 tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] Flavor limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:59:44.275267 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-1f986309-3ace-4dd9-a423-4ed2ff2f8c86 tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] Image limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:59:44.275949 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-1f986309-3ace-4dd9-a423-4ed2ff2f8c86 tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] Flavor pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:59:44.276940 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-1f986309-3ace-4dd9-a423-4ed2ff2f8c86 tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] Image pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:59:44.277554 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-1f986309-3ace-4dd9-a423-4ed2ff2f8c86 tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:59:44.301188 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1f986309-3ace-4dd9-a423-4ed2ff2f8c86 tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:44.309578 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1f986309-3ace-4dd9-a423-4ed2ff2f8c86 tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:44.310038 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1f986309-3ace-4dd9-a423-4ed2ff2f8c86 tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:44.315717 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1f986309-3ace-4dd9-a423-4ed2ff2f8c86 tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:44.316693 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1f986309-3ace-4dd9-a423-4ed2ff2f8c86 tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:44.317362 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1f986309-3ace-4dd9-a423-4ed2ff2f8c86 tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:44.357746 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-1f986309-3ace-4dd9-a423-4ed2ff2f8c86 tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] Getting quotas for project c0cfa6c678df4550bdf1b627efb0c46a. Resources: {'ram', 'cores', 'instances'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:59:44.363769 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-1f986309-3ace-4dd9-a423-4ed2ff2f8c86 tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] Getting quotas for user 9a63b38b57a347f282318730997e90ab and project c0cfa6c678df4550bdf1b627efb0c46a. Resources: {'ram', 'cores', 'instances'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:59:44.380297 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-1f986309-3ace-4dd9-a423-4ed2ff2f8c86 tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] Going to run 1 instances... {{(pid=123596) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:59:44.383552 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-1f986309-3ace-4dd9-a423-4ed2ff2f8c86 tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] [instance: 21c5a32f-69a7-4836-8c9f-399b415c2c21] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e8943ec5-4038-4d4b-b9b9-2415a79f5243',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123596) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:59:44.466997 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-1f986309-3ace-4dd9-a423-4ed2ff2f8c86 tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.528435 Oct 04 18:59:44.474854 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2832/5323] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 18:59:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 1537 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 18:59:44.483770 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-78c41cce-7578-41ab-ab22-a3b1c429118a req-a25a7e81-5cde-4743-a488-e593a43946ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2d96060-bc2d-461c-9705-67a3845451ef", "name": "network-vif-plugged", "status": "completed", "tag": "8bd347ce-362c-4fbe-9877-d6c2c942865a"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:59:44.498440 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-78c41cce-7578-41ab-ab22-a3b1c429118a req-a25a7e81-5cde-4743-a488-e593a43946ab service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:44.499470 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-78c41cce-7578-41ab-ab22-a3b1c429118a req-a25a7e81-5cde-4743-a488-e593a43946ab service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:44.500402 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-78c41cce-7578-41ab-ab22-a3b1c429118a req-a25a7e81-5cde-4743-a488-e593a43946ab service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:44.514224 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-78c41cce-7578-41ab-ab22-a3b1c429118a req-a25a7e81-5cde-4743-a488-e593a43946ab service nova] Creating event network-vif-plugged:8bd347ce-362c-4fbe-9877-d6c2c942865a for instance f2d96060-bc2d-461c-9705-67a3845451ef on n-h1-851028-13 Oct 04 18:59:44.520026 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-78c41cce-7578-41ab-ab22-a3b1c429118a req-a25a7e81-5cde-4743-a488-e593a43946ab service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043574 Oct 04 18:59:44.521353 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2833/5324] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:59:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:59:44.527020 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-cc1b14d4-eb9e-4e12-aa3f-d3b426342489 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:59:44.528687 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-cc1b14d4-eb9e-4e12-aa3f-d3b426342489 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] [instance: 02a066b4-243b-4fe3-afcf-30f3e9511d1b] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:44.535832 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cc1b14d4-eb9e-4e12-aa3f-d3b426342489 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:44.536861 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cc1b14d4-eb9e-4e12-aa3f-d3b426342489 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:44.537595 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cc1b14d4-eb9e-4e12-aa3f-d3b426342489 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:44.539199 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cc1b14d4-eb9e-4e12-aa3f-d3b426342489 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:44.540349 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cc1b14d4-eb9e-4e12-aa3f-d3b426342489 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:44.540920 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cc1b14d4-eb9e-4e12-aa3f-d3b426342489 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:44.888383 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-cc1b14d4-eb9e-4e12-aa3f-d3b426342489 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:44.918762 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-cc1b14d4-eb9e-4e12-aa3f-d3b426342489 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:44.921212 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-cc1b14d4-eb9e-4e12-aa3f-d3b426342489 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:44.922870 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-cc1b14d4-eb9e-4e12-aa3f-d3b426342489 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] 10.222.0.43 "GET /compute/v2.1/servers/02a066b4-243b-4fe3-afcf-30f3e9511d1b" status: 200 len: 2915 microversion: 2.42 time: 0.400251 Oct 04 18:59:44.923921 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2834/5325] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:59:44 2022] GET /compute/v2.1/servers/02a066b4-243b-4fe3-afcf-30f3e9511d1b => generated 2915 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:59:44.928660 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-1d251bfc-42f3-4feb-9d74-d50e0058633d tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:59:44.929530 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-1d251bfc-42f3-4feb-9d74-d50e0058633d tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] [instance: 21c5a32f-69a7-4836-8c9f-399b415c2c21] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:44.988811 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-564842dc-b85b-4e14-b7cb-7a5adbfa3b65 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1bb492fb294837b1e55d58bbfa3d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a4c327763b4440a9dc456cfbb31f88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:45.002971 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-564842dc-b85b-4e14-b7cb-7a5adbfa3b65 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] 10.222.0.43 "GET /compute/v2.1/servers/f2d96060-bc2d-461c-9705-67a3845451ef" status: 200 len: 1374 microversion: 2.1 time: 1.184510 Oct 04 18:59:45.005964 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2492/5326] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:59:43 2022] GET /compute/v2.1/servers/f2d96060-bc2d-461c-9705-67a3845451ef => generated 1374 bytes in 1189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:59:45.019744 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-49c5c8e6-0a56-405f-afaa-1d082295051e tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:59:45.020567 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-49c5c8e6-0a56-405f-afaa-1d082295051e tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] [instance: 0ab8644c-b040-46c1-913b-46d595bde978] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:45.034466 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-49c5c8e6-0a56-405f-afaa-1d082295051e tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:45.035829 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-49c5c8e6-0a56-405f-afaa-1d082295051e tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:45.036595 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-49c5c8e6-0a56-405f-afaa-1d082295051e tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:45.037555 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-49c5c8e6-0a56-405f-afaa-1d082295051e tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:45.038329 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-49c5c8e6-0a56-405f-afaa-1d082295051e tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:45.039314 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-49c5c8e6-0a56-405f-afaa-1d082295051e tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:45.095772 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-1d251bfc-42f3-4feb-9d74-d50e0058633d tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a63b38b57a347f282318730997e90ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0cfa6c678df4550bdf1b627efb0c46a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:45.127014 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-1d251bfc-42f3-4feb-9d74-d50e0058633d tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] 10.222.0.43 "GET /compute/v2.1/servers/21c5a32f-69a7-4836-8c9f-399b415c2c21" status: 200 len: 1213 microversion: 2.1 time: 0.201156 Oct 04 18:59:45.135737 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2835/5327] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:59:44 2022] GET /compute/v2.1/servers/21c5a32f-69a7-4836-8c9f-399b415c2c21 => generated 1213 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:59:45.326855 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.objects.instance [None req-49c5c8e6-0a56-405f-afaa-1d082295051e tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lazy-loading 'services' on Instance uuid 0ab8644c-b040-46c1-913b-46d595bde978 {{(pid=123595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:59:45.513307 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-49c5c8e6-0a56-405f-afaa-1d082295051e tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] 10.222.0.43 "DELETE /compute/v2.1/servers/0ab8644c-b040-46c1-913b-46d595bde978/os-volume_attachments/0c9ceaa4-a365-49c2-a353-a12dd66249d8" status: 202 len: 0 microversion: 2.1 time: 0.504048 Oct 04 18:59:45.528933 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-d96441bf-fa56-4e79-ad5f-d7b34e9ab4a8 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:59:45.533501 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2493/5328] 10.222.0.43 () {58 vars in 1416 bytes} [Tue Oct 4 18:59:45 2022] DELETE /compute/v2.1/servers/0ab8644c-b040-46c1-913b-46d595bde978/os-volume_attachments/0c9ceaa4-a365-49c2-a353-a12dd66249d8 => generated 0 bytes in 526 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:59:45.533673 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-d96441bf-fa56-4e79-ad5f-d7b34e9ab4a8 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] [instance: 0ab8644c-b040-46c1-913b-46d595bde978] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:45.552347 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d96441bf-fa56-4e79-ad5f-d7b34e9ab4a8 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:45.554258 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d96441bf-fa56-4e79-ad5f-d7b34e9ab4a8 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:45.556227 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d96441bf-fa56-4e79-ad5f-d7b34e9ab4a8 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:45.558761 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d96441bf-fa56-4e79-ad5f-d7b34e9ab4a8 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:45.559489 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d96441bf-fa56-4e79-ad5f-d7b34e9ab4a8 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:45.560236 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d96441bf-fa56-4e79-ad5f-d7b34e9ab4a8 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:45.607239 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-d96441bf-fa56-4e79-ad5f-d7b34e9ab4a8 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] 10.222.0.43 "GET /compute/v2.1/servers/0ab8644c-b040-46c1-913b-46d595bde978/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.083576 Oct 04 18:59:45.607934 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2836/5329] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Oct 4 18:59:45 2022] GET /compute/v2.1/servers/0ab8644c-b040-46c1-913b-46d595bde978/os-volume_attachments => generated 197 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:59:45.960582 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-1c1f95a5-a8f7-4636-8982-5a4b97bed113 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:59:45.962253 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-1c1f95a5-a8f7-4636-8982-5a4b97bed113 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] [instance: 02a066b4-243b-4fe3-afcf-30f3e9511d1b] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:45.983085 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1c1f95a5-a8f7-4636-8982-5a4b97bed113 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:45.983585 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1c1f95a5-a8f7-4636-8982-5a4b97bed113 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:45.984027 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1c1f95a5-a8f7-4636-8982-5a4b97bed113 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:45.984730 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1c1f95a5-a8f7-4636-8982-5a4b97bed113 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:45.987946 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1c1f95a5-a8f7-4636-8982-5a4b97bed113 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:45.988386 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1c1f95a5-a8f7-4636-8982-5a4b97bed113 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:46.030860 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-689c80df-4541-4107-8c52-a7540c4d761b tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:59:46.031494 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-689c80df-4541-4107-8c52-a7540c4d761b tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] [instance: f2d96060-bc2d-461c-9705-67a3845451ef] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:46.041470 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-689c80df-4541-4107-8c52-a7540c4d761b tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:46.052164 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-689c80df-4541-4107-8c52-a7540c4d761b tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:46.052830 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-689c80df-4541-4107-8c52-a7540c4d761b tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:46.053769 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-689c80df-4541-4107-8c52-a7540c4d761b tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:46.054866 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-689c80df-4541-4107-8c52-a7540c4d761b tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:46.076334 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-689c80df-4541-4107-8c52-a7540c4d761b tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:46.592938 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-689c80df-4541-4107-8c52-a7540c4d761b tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1bb492fb294837b1e55d58bbfa3d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a4c327763b4440a9dc456cfbb31f88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:46.608014 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-689c80df-4541-4107-8c52-a7540c4d761b tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] 10.222.0.43 "GET /compute/v2.1/servers/f2d96060-bc2d-461c-9705-67a3845451ef" status: 200 len: 1374 microversion: 2.1 time: 0.581297 Oct 04 18:59:46.614881 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2837/5330] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:59:46 2022] GET /compute/v2.1/servers/f2d96060-bc2d-461c-9705-67a3845451ef => generated 1374 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:59:46.631723 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-def14e72-5ec0-4b9a-a782-0aeec0afa695 tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:59:46.633030 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-def14e72-5ec0-4b9a-a782-0aeec0afa695 tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] [instance: 21c5a32f-69a7-4836-8c9f-399b415c2c21] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:46.654108 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-def14e72-5ec0-4b9a-a782-0aeec0afa695 tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:46.655355 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-def14e72-5ec0-4b9a-a782-0aeec0afa695 tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:46.656077 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-def14e72-5ec0-4b9a-a782-0aeec0afa695 tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:46.659514 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-def14e72-5ec0-4b9a-a782-0aeec0afa695 tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:46.660991 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-def14e72-5ec0-4b9a-a782-0aeec0afa695 tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:46.661861 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-def14e72-5ec0-4b9a-a782-0aeec0afa695 tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:46.859065 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-def14e72-5ec0-4b9a-a782-0aeec0afa695 tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a63b38b57a347f282318730997e90ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0cfa6c678df4550bdf1b627efb0c46a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:46.878089 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-def14e72-5ec0-4b9a-a782-0aeec0afa695 tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] 10.222.0.43 "GET /compute/v2.1/servers/21c5a32f-69a7-4836-8c9f-399b415c2c21" status: 200 len: 1273 microversion: 2.1 time: 0.258664 Oct 04 18:59:46.881644 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2838/5331] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:59:46 2022] GET /compute/v2.1/servers/21c5a32f-69a7-4836-8c9f-399b415c2c21 => generated 1273 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:59:46.884505 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-1c1f95a5-a8f7-4636-8982-5a4b97bed113 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:46.895861 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-3906e5bd-1a92-4ebb-a65e-c3a8d3afd848 req-af1588ed-c3dd-4c15-928c-061707cae9cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02a066b4-243b-4fe3-afcf-30f3e9511d1b", "name": "network-vif-deleted", "tag": "86859dd2-218b-4ce7-b642-388a568f9811"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:59:46.904395 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-1c1f95a5-a8f7-4636-8982-5a4b97bed113 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:46.919210 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-1c1f95a5-a8f7-4636-8982-5a4b97bed113 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:46.920928 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-1c1f95a5-a8f7-4636-8982-5a4b97bed113 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] 10.222.0.43 "GET /compute/v2.1/servers/02a066b4-243b-4fe3-afcf-30f3e9511d1b" status: 200 len: 2869 microversion: 2.42 time: 0.968715 Oct 04 18:59:46.925941 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2494/5332] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:59:45 2022] GET /compute/v2.1/servers/02a066b4-243b-4fe3-afcf-30f3e9511d1b => generated 2869 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:59:46.941587 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-3906e5bd-1a92-4ebb-a65e-c3a8d3afd848 req-af1588ed-c3dd-4c15-928c-061707cae9cc service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:46.943789 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-3906e5bd-1a92-4ebb-a65e-c3a8d3afd848 req-af1588ed-c3dd-4c15-928c-061707cae9cc service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:46.944475 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-006f1340-f8d3-4076-8eb7-5c68b40056b8 req-6aace1f3-0e74-439d-b5ca-a3fe4f7ba796 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02a066b4-243b-4fe3-afcf-30f3e9511d1b", "name": "network-vif-unplugged", "status": "completed", "tag": "41843c67-3f42-40b6-baf0-f90a5f358228"}, {"server_uuid": "02a066b4-243b-4fe3-afcf-30f3e9511d1b", "name": "network-vif-unplugged", "status": "completed", "tag": "84007727-69fd-496d-bff6-b9696c470012"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:59:46.945322 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-3906e5bd-1a92-4ebb-a65e-c3a8d3afd848 req-af1588ed-c3dd-4c15-928c-061707cae9cc service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:46.991532 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-006f1340-f8d3-4076-8eb7-5c68b40056b8 req-6aace1f3-0e74-439d-b5ca-a3fe4f7ba796 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:46.997474 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-3906e5bd-1a92-4ebb-a65e-c3a8d3afd848 req-af1588ed-c3dd-4c15-928c-061707cae9cc service nova] Creating event network-vif-deleted:86859dd2-218b-4ce7-b642-388a568f9811 for instance 02a066b4-243b-4fe3-afcf-30f3e9511d1b on n-h2-851028-13 Oct 04 18:59:46.999370 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-006f1340-f8d3-4076-8eb7-5c68b40056b8 req-6aace1f3-0e74-439d-b5ca-a3fe4f7ba796 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:47.000361 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-006f1340-f8d3-4076-8eb7-5c68b40056b8 req-6aace1f3-0e74-439d-b5ca-a3fe4f7ba796 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:47.014850 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-3906e5bd-1a92-4ebb-a65e-c3a8d3afd848 req-af1588ed-c3dd-4c15-928c-061707cae9cc service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130625 Oct 04 18:59:47.015484 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2839/5333] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:59:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:59:47.034788 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-dd938a3f-c31f-4382-9ad3-ba143b7b6249 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:59:47.035024 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-006f1340-f8d3-4076-8eb7-5c68b40056b8 req-6aace1f3-0e74-439d-b5ca-a3fe4f7ba796 service nova] Creating event network-vif-unplugged:41843c67-3f42-40b6-baf0-f90a5f358228 for instance 02a066b4-243b-4fe3-afcf-30f3e9511d1b on n-h2-851028-13 Oct 04 18:59:47.035428 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-006f1340-f8d3-4076-8eb7-5c68b40056b8 req-6aace1f3-0e74-439d-b5ca-a3fe4f7ba796 service nova] Creating event network-vif-unplugged:84007727-69fd-496d-bff6-b9696c470012 for instance 02a066b4-243b-4fe3-afcf-30f3e9511d1b on n-h2-851028-13 Oct 04 18:59:47.045872 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-dd938a3f-c31f-4382-9ad3-ba143b7b6249 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] [instance: 0ab8644c-b040-46c1-913b-46d595bde978] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:47.047883 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-006f1340-f8d3-4076-8eb7-5c68b40056b8 req-6aace1f3-0e74-439d-b5ca-a3fe4f7ba796 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 358 microversion: 2.1 time: 0.119763 Oct 04 18:59:47.053442 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2495/5334] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:59:46 2022] POST /compute/v2.1/os-server-external-events => generated 358 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:59:47.077010 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dd938a3f-c31f-4382-9ad3-ba143b7b6249 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:47.088743 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dd938a3f-c31f-4382-9ad3-ba143b7b6249 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:47.089689 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dd938a3f-c31f-4382-9ad3-ba143b7b6249 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:47.105183 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dd938a3f-c31f-4382-9ad3-ba143b7b6249 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:47.116282 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dd938a3f-c31f-4382-9ad3-ba143b7b6249 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:47.118829 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dd938a3f-c31f-4382-9ad3-ba143b7b6249 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:47.241129 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-dd938a3f-c31f-4382-9ad3-ba143b7b6249 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] 10.222.0.43 "GET /compute/v2.1/servers/0ab8644c-b040-46c1-913b-46d595bde978/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.216833 Oct 04 18:59:47.249730 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2840/5335] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Oct 4 18:59:47 2022] GET /compute/v2.1/servers/0ab8644c-b040-46c1-913b-46d595bde978/os-volume_attachments => generated 197 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:59:47.642339 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-07a7a361-94d3-42a7-9f21-077b2d2863ae tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:59:47.643402 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-07a7a361-94d3-42a7-9f21-077b2d2863ae tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] [instance: f2d96060-bc2d-461c-9705-67a3845451ef] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:47.664175 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-07a7a361-94d3-42a7-9f21-077b2d2863ae tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:47.670383 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-07a7a361-94d3-42a7-9f21-077b2d2863ae tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:47.671083 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-07a7a361-94d3-42a7-9f21-077b2d2863ae tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:47.671865 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-07a7a361-94d3-42a7-9f21-077b2d2863ae tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:47.672345 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-07a7a361-94d3-42a7-9f21-077b2d2863ae tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:47.675107 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-07a7a361-94d3-42a7-9f21-077b2d2863ae tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:47.907814 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-1a99570c-5d3c-4057-a980-a0c1f13b4d09 tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:59:47.908563 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-1a99570c-5d3c-4057-a980-a0c1f13b4d09 tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] [instance: 21c5a32f-69a7-4836-8c9f-399b415c2c21] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:47.917094 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1a99570c-5d3c-4057-a980-a0c1f13b4d09 tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:47.922263 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1a99570c-5d3c-4057-a980-a0c1f13b4d09 tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:47.923977 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1a99570c-5d3c-4057-a980-a0c1f13b4d09 tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:47.926145 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1a99570c-5d3c-4057-a980-a0c1f13b4d09 tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:47.928583 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1a99570c-5d3c-4057-a980-a0c1f13b4d09 tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:47.929387 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1a99570c-5d3c-4057-a980-a0c1f13b4d09 tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:48.158866 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-1a99570c-5d3c-4057-a980-a0c1f13b4d09 tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a63b38b57a347f282318730997e90ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0cfa6c678df4550bdf1b627efb0c46a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:48.163730 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:59:48.194365 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-1a99570c-5d3c-4057-a980-a0c1f13b4d09 tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] 10.222.0.43 "GET /compute/v2.1/servers/21c5a32f-69a7-4836-8c9f-399b415c2c21" status: 200 len: 1271 microversion: 2.1 time: 0.292800 Oct 04 18:59:48.195172 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2841/5336] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:59:47 2022] GET /compute/v2.1/servers/21c5a32f-69a7-4836-8c9f-399b415c2c21 => generated 1271 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:59:48.209530 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-d5543945-3377-4595-b5b3-84cb6ce905b4 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:59:48.211072 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-d5543945-3377-4595-b5b3-84cb6ce905b4 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] [instance: 02a066b4-243b-4fe3-afcf-30f3e9511d1b] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:48.224498 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d5543945-3377-4595-b5b3-84cb6ce905b4 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:48.225335 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d5543945-3377-4595-b5b3-84cb6ce905b4 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:48.228194 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d5543945-3377-4595-b5b3-84cb6ce905b4 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:48.231667 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d5543945-3377-4595-b5b3-84cb6ce905b4 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:48.233233 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d5543945-3377-4595-b5b3-84cb6ce905b4 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:48.233747 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d5543945-3377-4595-b5b3-84cb6ce905b4 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:48.409499 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-07a7a361-94d3-42a7-9f21-077b2d2863ae tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1bb492fb294837b1e55d58bbfa3d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a4c327763b4440a9dc456cfbb31f88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:48.428422 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-07a7a361-94d3-42a7-9f21-077b2d2863ae tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] 10.222.0.43 "GET /compute/v2.1/servers/f2d96060-bc2d-461c-9705-67a3845451ef" status: 200 len: 1546 microversion: 2.1 time: 0.791688 Oct 04 18:59:48.432023 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2496/5337] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:59:47 2022] GET /compute/v2.1/servers/f2d96060-bc2d-461c-9705-67a3845451ef => generated 1546 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:59:48.441838 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-41b03531-001b-42fe-88b2-9f2c88ac4f44 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:59:48.444315 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-41b03531-001b-42fe-88b2-9f2c88ac4f44 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] [instance: 0ab8644c-b040-46c1-913b-46d595bde978] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:48.453038 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-41b03531-001b-42fe-88b2-9f2c88ac4f44 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:48.453983 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-41b03531-001b-42fe-88b2-9f2c88ac4f44 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:48.454693 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-41b03531-001b-42fe-88b2-9f2c88ac4f44 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:48.455621 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-41b03531-001b-42fe-88b2-9f2c88ac4f44 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:48.456385 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-41b03531-001b-42fe-88b2-9f2c88ac4f44 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:48.456990 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-41b03531-001b-42fe-88b2-9f2c88ac4f44 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:48.484822 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:59:48.504010 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-41b03531-001b-42fe-88b2-9f2c88ac4f44 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] 10.222.0.43 "GET /compute/v2.1/servers/0ab8644c-b040-46c1-913b-46d595bde978/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.070843 Oct 04 18:59:48.505620 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2497/5338] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Oct 4 18:59:48 2022] GET /compute/v2.1/servers/0ab8644c-b040-46c1-913b-46d595bde978/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:59:48.524706 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-3aa68889-9630-4fa6-8d42-9269480f7b63 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:59:48.525410 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-3aa68889-9630-4fa6-8d42-9269480f7b63 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] [instance: f2d96060-bc2d-461c-9705-67a3845451ef] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:48.543186 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3aa68889-9630-4fa6-8d42-9269480f7b63 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:48.543755 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3aa68889-9630-4fa6-8d42-9269480f7b63 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:48.544124 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3aa68889-9630-4fa6-8d42-9269480f7b63 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:48.544848 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3aa68889-9630-4fa6-8d42-9269480f7b63 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:48.545346 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3aa68889-9630-4fa6-8d42-9269480f7b63 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:48.545779 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3aa68889-9630-4fa6-8d42-9269480f7b63 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:48.825896 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-d5543945-3377-4595-b5b3-84cb6ce905b4 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:48.842424 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-d5543945-3377-4595-b5b3-84cb6ce905b4 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:48.858572 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-d5543945-3377-4595-b5b3-84cb6ce905b4 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:48.860367 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-d5543945-3377-4595-b5b3-84cb6ce905b4 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] 10.222.0.43 "GET /compute/v2.1/servers/02a066b4-243b-4fe3-afcf-30f3e9511d1b" status: 200 len: 2709 microversion: 2.42 time: 0.662823 Oct 04 18:59:48.862117 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2842/5339] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:59:48 2022] GET /compute/v2.1/servers/02a066b4-243b-4fe3-afcf-30f3e9511d1b => generated 2709 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:59:49.086700 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-96bb30a7-c5a1-44bd-8ade-b5ab6c74a612 req-410724ab-fe68-4293-b7e7-2eda722ecebf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02a066b4-243b-4fe3-afcf-30f3e9511d1b", "name": "network-vif-deleted", "tag": "d761be9f-2b1b-4049-b17f-6cf13693728c"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:59:49.110257 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-3aa68889-9630-4fa6-8d42-9269480f7b63 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1bb492fb294837b1e55d58bbfa3d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a4c327763b4440a9dc456cfbb31f88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:49.117025 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-96bb30a7-c5a1-44bd-8ade-b5ab6c74a612 req-410724ab-fe68-4293-b7e7-2eda722ecebf service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:49.118177 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-96bb30a7-c5a1-44bd-8ade-b5ab6c74a612 req-410724ab-fe68-4293-b7e7-2eda722ecebf service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:49.118669 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-96bb30a7-c5a1-44bd-8ade-b5ab6c74a612 req-410724ab-fe68-4293-b7e7-2eda722ecebf service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:49.120029 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-3aa68889-9630-4fa6-8d42-9269480f7b63 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] 10.222.0.43 "GET /compute/v2.1/servers/f2d96060-bc2d-461c-9705-67a3845451ef" status: 200 len: 1546 microversion: 2.1 time: 0.613329 Oct 04 18:59:49.127700 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2498/5340] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:59:48 2022] GET /compute/v2.1/servers/f2d96060-bc2d-461c-9705-67a3845451ef => generated 1546 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:59:49.138637 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-96bb30a7-c5a1-44bd-8ade-b5ab6c74a612 req-410724ab-fe68-4293-b7e7-2eda722ecebf service nova] Creating event network-vif-deleted:d761be9f-2b1b-4049-b17f-6cf13693728c for instance 02a066b4-243b-4fe3-afcf-30f3e9511d1b on n-h2-851028-13 Oct 04 18:59:49.155632 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-96bb30a7-c5a1-44bd-8ade-b5ab6c74a612 req-410724ab-fe68-4293-b7e7-2eda722ecebf service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074186 Oct 04 18:59:49.156561 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2843/5341] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:59:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:59:49.232606 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-64f2eb4b-4937-4d37-948b-521464cfb7b8 tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:59:49.233461 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-64f2eb4b-4937-4d37-948b-521464cfb7b8 tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] [instance: 21c5a32f-69a7-4836-8c9f-399b415c2c21] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:49.245277 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-64f2eb4b-4937-4d37-948b-521464cfb7b8 tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:49.247768 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-64f2eb4b-4937-4d37-948b-521464cfb7b8 tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:49.248580 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-64f2eb4b-4937-4d37-948b-521464cfb7b8 tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:49.251126 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-64f2eb4b-4937-4d37-948b-521464cfb7b8 tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:49.255439 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-64f2eb4b-4937-4d37-948b-521464cfb7b8 tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:49.256061 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-64f2eb4b-4937-4d37-948b-521464cfb7b8 tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:49.314261 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-2108b049-a08d-44dd-8b69-e9ded32e04bb req-75d88299-d47c-4bcb-b91d-a8eb8432ad77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02a066b4-243b-4fe3-afcf-30f3e9511d1b", "name": "network-vif-unplugged", "status": "completed", "tag": "928f2e8e-6be4-46f2-be79-95a832f7c34d"}, {"server_uuid": "02a066b4-243b-4fe3-afcf-30f3e9511d1b", "name": "network-vif-unplugged", "status": "completed", "tag": "d761be9f-2b1b-4049-b17f-6cf13693728c"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:59:49.339418 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-2108b049-a08d-44dd-8b69-e9ded32e04bb req-75d88299-d47c-4bcb-b91d-a8eb8432ad77 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:49.340335 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-2108b049-a08d-44dd-8b69-e9ded32e04bb req-75d88299-d47c-4bcb-b91d-a8eb8432ad77 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:49.340950 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-2108b049-a08d-44dd-8b69-e9ded32e04bb req-75d88299-d47c-4bcb-b91d-a8eb8432ad77 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:49.366518 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-2108b049-a08d-44dd-8b69-e9ded32e04bb req-75d88299-d47c-4bcb-b91d-a8eb8432ad77 service nova] Creating event network-vif-unplugged:928f2e8e-6be4-46f2-be79-95a832f7c34d for instance 02a066b4-243b-4fe3-afcf-30f3e9511d1b on n-h2-851028-13 Oct 04 18:59:49.367395 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-2108b049-a08d-44dd-8b69-e9ded32e04bb req-75d88299-d47c-4bcb-b91d-a8eb8432ad77 service nova] Creating event network-vif-unplugged:d761be9f-2b1b-4049-b17f-6cf13693728c for instance 02a066b4-243b-4fe3-afcf-30f3e9511d1b on n-h2-851028-13 Oct 04 18:59:49.389430 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-2108b049-a08d-44dd-8b69-e9ded32e04bb req-75d88299-d47c-4bcb-b91d-a8eb8432ad77 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 358 microversion: 2.1 time: 0.080977 Oct 04 18:59:49.391123 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2844/5342] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:59:49 2022] POST /compute/v2.1/os-server-external-events => generated 358 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:59:49.469497 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-64f2eb4b-4937-4d37-948b-521464cfb7b8 tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a63b38b57a347f282318730997e90ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0cfa6c678df4550bdf1b627efb0c46a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:49.484728 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-64f2eb4b-4937-4d37-948b-521464cfb7b8 tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] 10.222.0.43 "GET /compute/v2.1/servers/21c5a32f-69a7-4836-8c9f-399b415c2c21" status: 200 len: 1271 microversion: 2.1 time: 0.258827 Oct 04 18:59:49.490958 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2499/5343] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:59:49 2022] GET /compute/v2.1/servers/21c5a32f-69a7-4836-8c9f-399b415c2c21 => generated 1271 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:59:49.518075 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-1f42042d-e566-44b5-9f49-62f6a9fb5bf1 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:59:49.522091 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-1f42042d-e566-44b5-9f49-62f6a9fb5bf1 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] [instance: 0ab8644c-b040-46c1-913b-46d595bde978] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:49.536912 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1f42042d-e566-44b5-9f49-62f6a9fb5bf1 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:49.537513 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1f42042d-e566-44b5-9f49-62f6a9fb5bf1 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:49.537972 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1f42042d-e566-44b5-9f49-62f6a9fb5bf1 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:49.538702 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1f42042d-e566-44b5-9f49-62f6a9fb5bf1 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:49.543466 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1f42042d-e566-44b5-9f49-62f6a9fb5bf1 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:49.544175 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1f42042d-e566-44b5-9f49-62f6a9fb5bf1 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:49.609081 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-1f42042d-e566-44b5-9f49-62f6a9fb5bf1 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] 10.222.0.43 "GET /compute/v2.1/servers/0ab8644c-b040-46c1-913b-46d595bde978/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.095324 Oct 04 18:59:49.611078 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2845/5344] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Oct 4 18:59:49 2022] GET /compute/v2.1/servers/0ab8644c-b040-46c1-913b-46d595bde978/os-volume_attachments => generated 197 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:59:49.898289 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-783de6bb-bea5-4829-b7f8-3a6e8cd7f3e3 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:59:49.899002 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-783de6bb-bea5-4829-b7f8-3a6e8cd7f3e3 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] [instance: 02a066b4-243b-4fe3-afcf-30f3e9511d1b] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:49.910981 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-783de6bb-bea5-4829-b7f8-3a6e8cd7f3e3 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:49.926971 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-783de6bb-bea5-4829-b7f8-3a6e8cd7f3e3 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:49.929064 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-783de6bb-bea5-4829-b7f8-3a6e8cd7f3e3 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:49.930129 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-783de6bb-bea5-4829-b7f8-3a6e8cd7f3e3 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:49.930404 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-783de6bb-bea5-4829-b7f8-3a6e8cd7f3e3 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:49.930847 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-783de6bb-bea5-4829-b7f8-3a6e8cd7f3e3 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:50.454870 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-783de6bb-bea5-4829-b7f8-3a6e8cd7f3e3 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:50.471361 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-783de6bb-bea5-4829-b7f8-3a6e8cd7f3e3 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:50.474938 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-783de6bb-bea5-4829-b7f8-3a6e8cd7f3e3 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:50.476530 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-783de6bb-bea5-4829-b7f8-3a6e8cd7f3e3 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] 10.222.0.43 "GET /compute/v2.1/servers/02a066b4-243b-4fe3-afcf-30f3e9511d1b" status: 200 len: 2553 microversion: 2.42 time: 0.583312 Oct 04 18:59:50.501969 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2500/5345] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:59:49 2022] GET /compute/v2.1/servers/02a066b4-243b-4fe3-afcf-30f3e9511d1b => generated 2553 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:59:50.512611 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-a95a0e96-c5af-464a-ab4f-984e79975e00 tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:59:50.513721 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-a95a0e96-c5af-464a-ab4f-984e79975e00 tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] [instance: 21c5a32f-69a7-4836-8c9f-399b415c2c21] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:50.534134 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a95a0e96-c5af-464a-ab4f-984e79975e00 tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:50.535018 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a95a0e96-c5af-464a-ab4f-984e79975e00 tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:50.535714 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a95a0e96-c5af-464a-ab4f-984e79975e00 tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:50.536692 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a95a0e96-c5af-464a-ab4f-984e79975e00 tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:50.537397 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a95a0e96-c5af-464a-ab4f-984e79975e00 tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:50.538067 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a95a0e96-c5af-464a-ab4f-984e79975e00 tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:50.545914 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-cdfe45f3-6740-4e5a-96b2-8349023c32ba tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1449448613", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452", "networks": [{"uuid": "dcd99798-7080-4c74-b648-36288a298add"}]}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:59:50.646511 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.network.neutron [None req-cdfe45f3-6740-4e5a-96b2-8349023c32ba tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] validate_networks() for [('dcd99798-7080-4c74-b648-36288a298add', None, None, None, None, None)] {{(pid=123596) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:59:50.877628 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-a95a0e96-c5af-464a-ab4f-984e79975e00 tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a63b38b57a347f282318730997e90ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0cfa6c678df4550bdf1b627efb0c46a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:50.886880 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-a95a0e96-c5af-464a-ab4f-984e79975e00 tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] 10.222.0.43 "GET /compute/v2.1/servers/21c5a32f-69a7-4836-8c9f-399b415c2c21" status: 200 len: 1313 microversion: 2.1 time: 0.378170 Oct 04 18:59:50.887475 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2501/5346] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:59:50 2022] GET /compute/v2.1/servers/21c5a32f-69a7-4836-8c9f-399b415c2c21 => generated 1313 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:59:50.898168 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-9fd82992-61f6-4e99-91e4-647ade16f184 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:59:50.900481 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-9fd82992-61f6-4e99-91e4-647ade16f184 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] [instance: 0ab8644c-b040-46c1-913b-46d595bde978] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:50.924796 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9fd82992-61f6-4e99-91e4-647ade16f184 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:50.932915 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9fd82992-61f6-4e99-91e4-647ade16f184 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:50.933524 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9fd82992-61f6-4e99-91e4-647ade16f184 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:50.934292 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9fd82992-61f6-4e99-91e4-647ade16f184 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:50.934772 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9fd82992-61f6-4e99-91e4-647ade16f184 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:50.935204 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9fd82992-61f6-4e99-91e4-647ade16f184 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:50.999744 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-9fd82992-61f6-4e99-91e4-647ade16f184 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] 10.222.0.43 "GET /compute/v2.1/servers/0ab8644c-b040-46c1-913b-46d595bde978/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.111135 Oct 04 18:59:51.000532 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2502/5347] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Oct 4 18:59:50 2022] GET /compute/v2.1/servers/0ab8644c-b040-46c1-913b-46d595bde978/os-volume_attachments => generated 197 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:59:51.518684 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-78c7104b-6e08-4a1c-8ac6-006d969084ae tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:59:51.519896 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-78c7104b-6e08-4a1c-8ac6-006d969084ae tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] [instance: 02a066b4-243b-4fe3-afcf-30f3e9511d1b] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:51.536168 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-78c7104b-6e08-4a1c-8ac6-006d969084ae tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:51.536979 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-78c7104b-6e08-4a1c-8ac6-006d969084ae tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:51.538624 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-78c7104b-6e08-4a1c-8ac6-006d969084ae tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:51.540105 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-78c7104b-6e08-4a1c-8ac6-006d969084ae tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:51.543246 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-78c7104b-6e08-4a1c-8ac6-006d969084ae tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:51.545350 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-78c7104b-6e08-4a1c-8ac6-006d969084ae tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:52.356509 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-cdfe45f3-6740-4e5a-96b2-8349023c32ba tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Flavor limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:59:52.358188 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-cdfe45f3-6740-4e5a-96b2-8349023c32ba tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Image limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:59:52.358989 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-cdfe45f3-6740-4e5a-96b2-8349023c32ba tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Flavor pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:59:52.359723 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-cdfe45f3-6740-4e5a-96b2-8349023c32ba tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Image pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:59:52.361025 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-cdfe45f3-6740-4e5a-96b2-8349023c32ba tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:59:52.395802 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cdfe45f3-6740-4e5a-96b2-8349023c32ba tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:52.402291 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cdfe45f3-6740-4e5a-96b2-8349023c32ba tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:52.402816 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cdfe45f3-6740-4e5a-96b2-8349023c32ba tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:52.404053 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cdfe45f3-6740-4e5a-96b2-8349023c32ba tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:52.404703 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cdfe45f3-6740-4e5a-96b2-8349023c32ba tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:52.405336 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cdfe45f3-6740-4e5a-96b2-8349023c32ba tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:52.420454 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-78c7104b-6e08-4a1c-8ac6-006d969084ae tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:52.430457 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-78c7104b-6e08-4a1c-8ac6-006d969084ae tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:52.440433 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-78c7104b-6e08-4a1c-8ac6-006d969084ae tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:52.442009 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-78c7104b-6e08-4a1c-8ac6-006d969084ae tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] 10.222.0.43 "GET /compute/v2.1/servers/02a066b4-243b-4fe3-afcf-30f3e9511d1b" status: 200 len: 2507 microversion: 2.42 time: 0.930411 Oct 04 18:59:52.442587 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2503/5348] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:59:51 2022] GET /compute/v2.1/servers/02a066b4-243b-4fe3-afcf-30f3e9511d1b => generated 2507 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:59:52.453054 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-571f0cd8-a1df-401f-96de-ebae46cd19e6 tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:59:52.457923 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-571f0cd8-a1df-401f-96de-ebae46cd19e6 tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] [instance: 21c5a32f-69a7-4836-8c9f-399b415c2c21] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:52.466765 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-571f0cd8-a1df-401f-96de-ebae46cd19e6 tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:52.467242 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-cdfe45f3-6740-4e5a-96b2-8349023c32ba tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Getting quotas for project a6a711601b7a439caf395233de1febff. Resources: {'ram', 'cores', 'instances'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:59:52.469922 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-571f0cd8-a1df-401f-96de-ebae46cd19e6 tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:52.470533 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-571f0cd8-a1df-401f-96de-ebae46cd19e6 tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:52.472615 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-571f0cd8-a1df-401f-96de-ebae46cd19e6 tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:52.473717 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-571f0cd8-a1df-401f-96de-ebae46cd19e6 tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:52.478124 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-571f0cd8-a1df-401f-96de-ebae46cd19e6 tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:52.496103 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-cdfe45f3-6740-4e5a-96b2-8349023c32ba tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Getting quotas for user c997bc60473b43fd9fcf0c65111c44c0 and project a6a711601b7a439caf395233de1febff. Resources: {'ram', 'cores', 'instances'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:59:52.522875 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-cdfe45f3-6740-4e5a-96b2-8349023c32ba tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Going to run 1 instances... {{(pid=123596) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:59:52.526395 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-cdfe45f3-6740-4e5a-96b2-8349023c32ba tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: 37f52fe0-438c-41f3-9142-8c171e80385d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e8943ec5-4038-4d4b-b9b9-2415a79f5243',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123596) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:59:52.633246 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-cdfe45f3-6740-4e5a-96b2-8349023c32ba tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.393019 Oct 04 18:59:52.635853 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2846/5349] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 18:59:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 2396 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 18:59:52.642080 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-3c78ee2e-0787-4c45-9886-160d786d0c9c tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:59:52.647040 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-3c78ee2e-0787-4c45-9886-160d786d0c9c tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] [instance: 0ab8644c-b040-46c1-913b-46d595bde978] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:52.686145 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3c78ee2e-0787-4c45-9886-160d786d0c9c tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:52.688357 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3c78ee2e-0787-4c45-9886-160d786d0c9c tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:52.690476 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3c78ee2e-0787-4c45-9886-160d786d0c9c tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:52.691450 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3c78ee2e-0787-4c45-9886-160d786d0c9c tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:52.696607 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3c78ee2e-0787-4c45-9886-160d786d0c9c tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:52.697468 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3c78ee2e-0787-4c45-9886-160d786d0c9c tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:52.789844 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-3c78ee2e-0787-4c45-9886-160d786d0c9c tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] 10.222.0.43 "GET /compute/v2.1/servers/0ab8644c-b040-46c1-913b-46d595bde978/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.151699 Oct 04 18:59:52.790508 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2847/5350] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Oct 4 18:59:52 2022] GET /compute/v2.1/servers/0ab8644c-b040-46c1-913b-46d595bde978/os-volume_attachments => generated 197 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:59:52.819014 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-9a7d2c37-f309-467e-ba67-df63ec471f3f req-50f896a2-57ca-4daa-b1c3-2d6c1a1ef63c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21c5a32f-69a7-4836-8c9f-399b415c2c21", "tag": "0360c0a2-78bd-4dc0-bef2-e2d42ab6b1b4"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:59:52.863840 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-9a7d2c37-f309-467e-ba67-df63ec471f3f req-50f896a2-57ca-4daa-b1c3-2d6c1a1ef63c service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:52.864344 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-9a7d2c37-f309-467e-ba67-df63ec471f3f req-50f896a2-57ca-4daa-b1c3-2d6c1a1ef63c service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:52.864789 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-9a7d2c37-f309-467e-ba67-df63ec471f3f req-50f896a2-57ca-4daa-b1c3-2d6c1a1ef63c service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:52.888445 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-9a7d2c37-f309-467e-ba67-df63ec471f3f req-50f896a2-57ca-4daa-b1c3-2d6c1a1ef63c service nova] Creating event network-changed:0360c0a2-78bd-4dc0-bef2-e2d42ab6b1b4 for instance 21c5a32f-69a7-4836-8c9f-399b415c2c21 on n-h2-851028-13 Oct 04 18:59:52.894661 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-9a7d2c37-f309-467e-ba67-df63ec471f3f req-50f896a2-57ca-4daa-b1c3-2d6c1a1ef63c service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102901 Oct 04 18:59:52.895878 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2848/5351] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:59:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:59:52.902481 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-c039ad53-1142-4a52-8c57-aa8e30f5b5de tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:59:52.903198 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-c039ad53-1142-4a52-8c57-aa8e30f5b5de tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: 37f52fe0-438c-41f3-9142-8c171e80385d] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:53.088712 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-c039ad53-1142-4a52-8c57-aa8e30f5b5de tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c997bc60473b43fd9fcf0c65111c44c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a711601b7a439caf395233de1febff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:53.103529 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-c039ad53-1142-4a52-8c57-aa8e30f5b5de tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "GET /compute/v2.1/servers/37f52fe0-438c-41f3-9142-8c171e80385d" status: 200 len: 1215 microversion: 2.1 time: 0.204694 Oct 04 18:59:53.117196 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2849/5352] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:59:52 2022] GET /compute/v2.1/servers/37f52fe0-438c-41f3-9142-8c171e80385d => generated 1215 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:59:53.212821 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-a7e945e9-8bc3-4616-9f95-f1401c824ee1 req-76f00938-f690-4644-bbd3-0765a70a904c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02a066b4-243b-4fe3-afcf-30f3e9511d1b", "name": "network-vif-deleted", "tag": "928f2e8e-6be4-46f2-be79-95a832f7c34d"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:59:53.245141 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-a7e945e9-8bc3-4616-9f95-f1401c824ee1 req-76f00938-f690-4644-bbd3-0765a70a904c service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:53.249735 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-a7e945e9-8bc3-4616-9f95-f1401c824ee1 req-76f00938-f690-4644-bbd3-0765a70a904c service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:53.250220 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-a7e945e9-8bc3-4616-9f95-f1401c824ee1 req-76f00938-f690-4644-bbd3-0765a70a904c service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:53.289307 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-a7e945e9-8bc3-4616-9f95-f1401c824ee1 req-76f00938-f690-4644-bbd3-0765a70a904c service nova] Creating event network-vif-deleted:928f2e8e-6be4-46f2-be79-95a832f7c34d for instance 02a066b4-243b-4fe3-afcf-30f3e9511d1b on n-h2-851028-13 Oct 04 18:59:53.295872 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-a7e945e9-8bc3-4616-9f95-f1401c824ee1 req-76f00938-f690-4644-bbd3-0765a70a904c service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087257 Oct 04 18:59:53.304484 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-571f0cd8-a1df-401f-96de-ebae46cd19e6 tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a63b38b57a347f282318730997e90ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0cfa6c678df4550bdf1b627efb0c46a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:53.312567 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2850/5353] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:59:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:59:53.315454 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-571f0cd8-a1df-401f-96de-ebae46cd19e6 tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] 10.222.0.43 "GET /compute/v2.1/servers/21c5a32f-69a7-4836-8c9f-399b415c2c21" status: 200 len: 1313 microversion: 2.1 time: 0.868924 Oct 04 18:59:53.318010 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2504/5354] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:59:52 2022] GET /compute/v2.1/servers/21c5a32f-69a7-4836-8c9f-399b415c2c21 => generated 1313 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:59:53.474921 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-e58b6db7-db48-418c-9fbd-37ec085268c2 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:59:53.475682 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-e58b6db7-db48-418c-9fbd-37ec085268c2 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] [instance: 02a066b4-243b-4fe3-afcf-30f3e9511d1b] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:53.486751 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e58b6db7-db48-418c-9fbd-37ec085268c2 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:53.487276 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e58b6db7-db48-418c-9fbd-37ec085268c2 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:53.487728 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e58b6db7-db48-418c-9fbd-37ec085268c2 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:53.488466 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e58b6db7-db48-418c-9fbd-37ec085268c2 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:53.488929 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e58b6db7-db48-418c-9fbd-37ec085268c2 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:53.505630 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e58b6db7-db48-418c-9fbd-37ec085268c2 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:53.803344 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-3749f5be-53bc-43eb-b4cc-5394da55e491 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:59:53.806488 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-3749f5be-53bc-43eb-b4cc-5394da55e491 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] [instance: 0ab8644c-b040-46c1-913b-46d595bde978] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:53.821434 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3749f5be-53bc-43eb-b4cc-5394da55e491 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:53.824141 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3749f5be-53bc-43eb-b4cc-5394da55e491 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:53.824620 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3749f5be-53bc-43eb-b4cc-5394da55e491 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:53.825418 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3749f5be-53bc-43eb-b4cc-5394da55e491 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:53.827945 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3749f5be-53bc-43eb-b4cc-5394da55e491 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:53.828782 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3749f5be-53bc-43eb-b4cc-5394da55e491 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:53.971343 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-3749f5be-53bc-43eb-b4cc-5394da55e491 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] 10.222.0.43 "GET /compute/v2.1/servers/0ab8644c-b040-46c1-913b-46d595bde978/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.172464 Oct 04 18:59:53.976046 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2505/5355] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Oct 4 18:59:53 2022] GET /compute/v2.1/servers/0ab8644c-b040-46c1-913b-46d595bde978/os-volume_attachments => generated 197 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:59:54.017419 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-e58b6db7-db48-418c-9fbd-37ec085268c2 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:54.051935 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-e58b6db7-db48-418c-9fbd-37ec085268c2 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:54.060741 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-e58b6db7-db48-418c-9fbd-37ec085268c2 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:54.069355 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-e58b6db7-db48-418c-9fbd-37ec085268c2 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] 10.222.0.43 "GET /compute/v2.1/servers/02a066b4-243b-4fe3-afcf-30f3e9511d1b" status: 200 len: 2215 microversion: 2.42 time: 0.597185 Oct 04 18:59:54.081224 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2851/5356] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:59:53 2022] GET /compute/v2.1/servers/02a066b4-243b-4fe3-afcf-30f3e9511d1b => generated 2215 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:59:54.145394 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-1ef2d2a7-ab58-4b01-b64c-cbd4a29f94b4 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:59:54.146382 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-1ef2d2a7-ab58-4b01-b64c-cbd4a29f94b4 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: 37f52fe0-438c-41f3-9142-8c171e80385d] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:54.170036 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1ef2d2a7-ab58-4b01-b64c-cbd4a29f94b4 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:54.173224 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1ef2d2a7-ab58-4b01-b64c-cbd4a29f94b4 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:54.174540 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1ef2d2a7-ab58-4b01-b64c-cbd4a29f94b4 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:54.176163 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1ef2d2a7-ab58-4b01-b64c-cbd4a29f94b4 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:54.178817 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1ef2d2a7-ab58-4b01-b64c-cbd4a29f94b4 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:54.179767 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1ef2d2a7-ab58-4b01-b64c-cbd4a29f94b4 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:54.342800 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-3fbd10d0-bd77-4cdd-922f-50987bd24963 tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:59:54.344815 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-3fbd10d0-bd77-4cdd-922f-50987bd24963 tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] [instance: 21c5a32f-69a7-4836-8c9f-399b415c2c21] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:54.361613 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3fbd10d0-bd77-4cdd-922f-50987bd24963 tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:54.362194 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3fbd10d0-bd77-4cdd-922f-50987bd24963 tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:54.363306 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3fbd10d0-bd77-4cdd-922f-50987bd24963 tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:54.364085 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3fbd10d0-bd77-4cdd-922f-50987bd24963 tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:54.365845 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3fbd10d0-bd77-4cdd-922f-50987bd24963 tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:54.367900 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3fbd10d0-bd77-4cdd-922f-50987bd24963 tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:54.405065 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-1ef2d2a7-ab58-4b01-b64c-cbd4a29f94b4 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c997bc60473b43fd9fcf0c65111c44c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a711601b7a439caf395233de1febff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:54.417860 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-1ef2d2a7-ab58-4b01-b64c-cbd4a29f94b4 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "GET /compute/v2.1/servers/37f52fe0-438c-41f3-9142-8c171e80385d" status: 200 len: 1267 microversion: 2.1 time: 0.286795 Oct 04 18:59:54.424942 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2506/5357] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:59:54 2022] GET /compute/v2.1/servers/37f52fe0-438c-41f3-9142-8c171e80385d => generated 1267 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:59:54.974954 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-3fbd10d0-bd77-4cdd-922f-50987bd24963 tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a63b38b57a347f282318730997e90ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0cfa6c678df4550bdf1b627efb0c46a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:54.988815 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-9cfd6aeb-dc42-48d6-9b08-bd27725dd4e3 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:59:54.991184 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-9cfd6aeb-dc42-48d6-9b08-bd27725dd4e3 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] [instance: 0ab8644c-b040-46c1-913b-46d595bde978] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:55.006032 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-3fbd10d0-bd77-4cdd-922f-50987bd24963 tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] 10.222.0.43 "GET /compute/v2.1/servers/21c5a32f-69a7-4836-8c9f-399b415c2c21" status: 200 len: 1313 microversion: 2.1 time: 0.667860 Oct 04 18:59:55.013623 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9cfd6aeb-dc42-48d6-9b08-bd27725dd4e3 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:55.014129 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9cfd6aeb-dc42-48d6-9b08-bd27725dd4e3 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:55.014576 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9cfd6aeb-dc42-48d6-9b08-bd27725dd4e3 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:55.015298 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9cfd6aeb-dc42-48d6-9b08-bd27725dd4e3 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:55.015758 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9cfd6aeb-dc42-48d6-9b08-bd27725dd4e3 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:55.016189 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9cfd6aeb-dc42-48d6-9b08-bd27725dd4e3 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:55.018205 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2852/5358] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:59:54 2022] GET /compute/v2.1/servers/21c5a32f-69a7-4836-8c9f-399b415c2c21 => generated 1313 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:59:55.103949 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-3ea37307-6c05-4765-bdd4-7e495ef34171 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:59:55.105093 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-3ea37307-6c05-4765-bdd4-7e495ef34171 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] [instance: 02a066b4-243b-4fe3-afcf-30f3e9511d1b] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:55.116585 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-9cfd6aeb-dc42-48d6-9b08-bd27725dd4e3 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] 10.222.0.43 "GET /compute/v2.1/servers/0ab8644c-b040-46c1-913b-46d595bde978/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.131946 Oct 04 18:59:55.118097 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2507/5359] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Oct 4 18:59:54 2022] GET /compute/v2.1/servers/0ab8644c-b040-46c1-913b-46d595bde978/os-volume_attachments => generated 197 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:59:55.127020 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3ea37307-6c05-4765-bdd4-7e495ef34171 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:55.131765 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3ea37307-6c05-4765-bdd4-7e495ef34171 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:55.137856 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3ea37307-6c05-4765-bdd4-7e495ef34171 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:55.143788 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3ea37307-6c05-4765-bdd4-7e495ef34171 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:55.148503 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3ea37307-6c05-4765-bdd4-7e495ef34171 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:55.150564 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3ea37307-6c05-4765-bdd4-7e495ef34171 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:55.450990 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-cb34dd57-6f5c-476c-bf29-65095a8b5ec7 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:59:55.452212 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-cb34dd57-6f5c-476c-bf29-65095a8b5ec7 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: 37f52fe0-438c-41f3-9142-8c171e80385d] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:55.462778 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cb34dd57-6f5c-476c-bf29-65095a8b5ec7 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:55.465996 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cb34dd57-6f5c-476c-bf29-65095a8b5ec7 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:55.466460 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cb34dd57-6f5c-476c-bf29-65095a8b5ec7 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:55.467203 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cb34dd57-6f5c-476c-bf29-65095a8b5ec7 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:55.470766 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cb34dd57-6f5c-476c-bf29-65095a8b5ec7 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:55.471422 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cb34dd57-6f5c-476c-bf29-65095a8b5ec7 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:55.673578 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-cb34dd57-6f5c-476c-bf29-65095a8b5ec7 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c997bc60473b43fd9fcf0c65111c44c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a711601b7a439caf395233de1febff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:55.689924 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-cb34dd57-6f5c-476c-bf29-65095a8b5ec7 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "GET /compute/v2.1/servers/37f52fe0-438c-41f3-9142-8c171e80385d" status: 200 len: 1273 microversion: 2.1 time: 0.242892 Oct 04 18:59:55.690539 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2508/5360] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:59:55 2022] GET /compute/v2.1/servers/37f52fe0-438c-41f3-9142-8c171e80385d => generated 1273 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:59:55.705459 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-53d0d8d8-bafd-4540-9ca3-b126165ebeb9 req-a8cfbc66-f7c4-419f-8409-ee0481f27fa6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02a066b4-243b-4fe3-afcf-30f3e9511d1b", "name": "network-vif-deleted", "tag": "41843c67-3f42-40b6-baf0-f90a5f358228"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:59:55.728490 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-53d0d8d8-bafd-4540-9ca3-b126165ebeb9 req-a8cfbc66-f7c4-419f-8409-ee0481f27fa6 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:55.730468 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-53d0d8d8-bafd-4540-9ca3-b126165ebeb9 req-a8cfbc66-f7c4-419f-8409-ee0481f27fa6 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:55.734174 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-53d0d8d8-bafd-4540-9ca3-b126165ebeb9 req-a8cfbc66-f7c4-419f-8409-ee0481f27fa6 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:55.770499 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-53d0d8d8-bafd-4540-9ca3-b126165ebeb9 req-a8cfbc66-f7c4-419f-8409-ee0481f27fa6 service nova] Creating event network-vif-deleted:41843c67-3f42-40b6-baf0-f90a5f358228 for instance 02a066b4-243b-4fe3-afcf-30f3e9511d1b on n-h2-851028-13 Oct 04 18:59:55.782998 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-53d0d8d8-bafd-4540-9ca3-b126165ebeb9 req-a8cfbc66-f7c4-419f-8409-ee0481f27fa6 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088160 Oct 04 18:59:55.788455 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2509/5361] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:59:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:59:55.818355 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-3ea37307-6c05-4765-bdd4-7e495ef34171 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:55.833126 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-3ea37307-6c05-4765-bdd4-7e495ef34171 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:55.838810 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-3ea37307-6c05-4765-bdd4-7e495ef34171 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:55.843519 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-3ea37307-6c05-4765-bdd4-7e495ef34171 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] 10.222.0.43 "GET /compute/v2.1/servers/02a066b4-243b-4fe3-afcf-30f3e9511d1b" status: 200 len: 2169 microversion: 2.42 time: 0.740728 Oct 04 18:59:55.863953 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2853/5362] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:59:55 2022] GET /compute/v2.1/servers/02a066b4-243b-4fe3-afcf-30f3e9511d1b => generated 2169 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:59:56.048187 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-86aeb83b-bdae-4cf2-b208-92eab2cb7648 tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:59:56.049283 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-86aeb83b-bdae-4cf2-b208-92eab2cb7648 tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] [instance: 21c5a32f-69a7-4836-8c9f-399b415c2c21] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:56.059290 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-86aeb83b-bdae-4cf2-b208-92eab2cb7648 tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:56.060283 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-86aeb83b-bdae-4cf2-b208-92eab2cb7648 tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:56.063334 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-86aeb83b-bdae-4cf2-b208-92eab2cb7648 tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:56.064407 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-86aeb83b-bdae-4cf2-b208-92eab2cb7648 tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:56.065140 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-86aeb83b-bdae-4cf2-b208-92eab2cb7648 tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:56.068257 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-86aeb83b-bdae-4cf2-b208-92eab2cb7648 tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:56.130857 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-7e01dbb5-2d63-49fc-990f-161c491d4c27 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:59:56.133404 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-7e01dbb5-2d63-49fc-990f-161c491d4c27 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] [instance: 0ab8644c-b040-46c1-913b-46d595bde978] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:56.143353 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7e01dbb5-2d63-49fc-990f-161c491d4c27 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:56.144726 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7e01dbb5-2d63-49fc-990f-161c491d4c27 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:56.145562 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7e01dbb5-2d63-49fc-990f-161c491d4c27 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:56.146954 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7e01dbb5-2d63-49fc-990f-161c491d4c27 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:56.147808 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7e01dbb5-2d63-49fc-990f-161c491d4c27 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:56.149497 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7e01dbb5-2d63-49fc-990f-161c491d4c27 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:56.198487 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-7e01dbb5-2d63-49fc-990f-161c491d4c27 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] 10.222.0.43 "GET /compute/v2.1/servers/0ab8644c-b040-46c1-913b-46d595bde978/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.071604 Oct 04 18:59:56.199789 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2854/5363] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Oct 4 18:59:56 2022] GET /compute/v2.1/servers/0ab8644c-b040-46c1-913b-46d595bde978/os-volume_attachments => generated 25 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 04 18:59:56.292087 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-9517eab1-9eef-479a-aa64-927190d0717a tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:59:56.293070 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-9517eab1-9eef-479a-aa64-927190d0717a tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] [instance: 0ab8644c-b040-46c1-913b-46d595bde978] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:56.302008 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9517eab1-9eef-479a-aa64-927190d0717a tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:56.302935 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9517eab1-9eef-479a-aa64-927190d0717a tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:56.303592 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9517eab1-9eef-479a-aa64-927190d0717a tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:56.304654 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9517eab1-9eef-479a-aa64-927190d0717a tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:56.306940 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9517eab1-9eef-479a-aa64-927190d0717a tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:56.308152 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9517eab1-9eef-479a-aa64-927190d0717a tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:56.364307 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-9517eab1-9eef-479a-aa64-927190d0717a tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] [instance: 0ab8644c-b040-46c1-913b-46d595bde978] Going to try to terminate instance {{(pid=123596) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:59:56.524637 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-9517eab1-9eef-479a-aa64-927190d0717a tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] 10.222.0.43 "DELETE /compute/v2.1/servers/0ab8644c-b040-46c1-913b-46d595bde978" status: 204 len: 0 microversion: 2.1 time: 0.238654 Oct 04 18:59:56.529590 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2855/5364] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 18:59:56 2022] DELETE /compute/v2.1/servers/0ab8644c-b040-46c1-913b-46d595bde978 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:59:56.542900 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-6d2e2fc4-af67-42c2-b332-6fea5f3057ed tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:59:56.544015 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-6d2e2fc4-af67-42c2-b332-6fea5f3057ed tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] [instance: 0ab8644c-b040-46c1-913b-46d595bde978] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:56.553525 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:59:56.556932 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6d2e2fc4-af67-42c2-b332-6fea5f3057ed tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:56.557982 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6d2e2fc4-af67-42c2-b332-6fea5f3057ed tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:56.558600 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6d2e2fc4-af67-42c2-b332-6fea5f3057ed tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:56.559567 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6d2e2fc4-af67-42c2-b332-6fea5f3057ed tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:56.560314 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6d2e2fc4-af67-42c2-b332-6fea5f3057ed tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:56.560940 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6d2e2fc4-af67-42c2-b332-6fea5f3057ed tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:57.055428 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-86aeb83b-bdae-4cf2-b208-92eab2cb7648 tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a63b38b57a347f282318730997e90ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0cfa6c678df4550bdf1b627efb0c46a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:57.068701 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-86aeb83b-bdae-4cf2-b208-92eab2cb7648 tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] 10.222.0.43 "GET /compute/v2.1/servers/21c5a32f-69a7-4836-8c9f-399b415c2c21" status: 200 len: 1313 microversion: 2.1 time: 1.036969 Oct 04 18:59:57.072611 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2510/5365] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:59:56 2022] GET /compute/v2.1/servers/21c5a32f-69a7-4836-8c9f-399b415c2c21 => generated 1313 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:59:57.080515 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-13739fce-e87d-4403-b582-083c940d7d6a tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:59:57.082746 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-13739fce-e87d-4403-b582-083c940d7d6a tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: 37f52fe0-438c-41f3-9142-8c171e80385d] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:57.094764 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-13739fce-e87d-4403-b582-083c940d7d6a tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:57.096354 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-13739fce-e87d-4403-b582-083c940d7d6a tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:57.098817 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-13739fce-e87d-4403-b582-083c940d7d6a tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:57.100109 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-13739fce-e87d-4403-b582-083c940d7d6a tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:57.101186 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-13739fce-e87d-4403-b582-083c940d7d6a tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:57.104222 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-13739fce-e87d-4403-b582-083c940d7d6a tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:57.154358 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-6d2e2fc4-af67-42c2-b332-6fea5f3057ed tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '486c22456b1e47ae843ae41f8dfb2632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c91c7e7358048ffaaee7f51ad61b515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:57.162831 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-6d2e2fc4-af67-42c2-b332-6fea5f3057ed tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] 10.222.0.43 "GET /compute/v2.1/servers/0ab8644c-b040-46c1-913b-46d595bde978" status: 200 len: 1682 microversion: 2.1 time: 0.628186 Oct 04 18:59:57.178825 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2856/5366] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:59:56 2022] GET /compute/v2.1/servers/0ab8644c-b040-46c1-913b-46d595bde978 => generated 1682 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:59:57.187056 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-c9a49c2d-a8c2-4769-beda-22d5ee3f235e tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:59:57.187947 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-c9a49c2d-a8c2-4769-beda-22d5ee3f235e tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] [instance: 02a066b4-243b-4fe3-afcf-30f3e9511d1b] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:57.194847 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c9a49c2d-a8c2-4769-beda-22d5ee3f235e tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:57.196896 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c9a49c2d-a8c2-4769-beda-22d5ee3f235e tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:57.197666 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c9a49c2d-a8c2-4769-beda-22d5ee3f235e tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:57.198603 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c9a49c2d-a8c2-4769-beda-22d5ee3f235e tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:57.199216 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c9a49c2d-a8c2-4769-beda-22d5ee3f235e tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:57.199807 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c9a49c2d-a8c2-4769-beda-22d5ee3f235e tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:57.277009 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-c9a49c2d-a8c2-4769-beda-22d5ee3f235e tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:57.293091 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-c9a49c2d-a8c2-4769-beda-22d5ee3f235e tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:57.295826 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-c9a49c2d-a8c2-4769-beda-22d5ee3f235e tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:57.299170 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-c9a49c2d-a8c2-4769-beda-22d5ee3f235e tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] 10.222.0.43 "GET /compute/v2.1/servers/02a066b4-243b-4fe3-afcf-30f3e9511d1b" status: 200 len: 1988 microversion: 2.42 time: 0.118425 Oct 04 18:59:57.300469 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2857/5367] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:59:57 2022] GET /compute/v2.1/servers/02a066b4-243b-4fe3-afcf-30f3e9511d1b => generated 1988 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:59:57.344128 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-13739fce-e87d-4403-b582-083c940d7d6a tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c997bc60473b43fd9fcf0c65111c44c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a711601b7a439caf395233de1febff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:57.352522 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-13739fce-e87d-4403-b582-083c940d7d6a tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "GET /compute/v2.1/servers/37f52fe0-438c-41f3-9142-8c171e80385d" status: 200 len: 1273 microversion: 2.1 time: 0.277898 Oct 04 18:59:57.353436 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2511/5368] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:59:57 2022] GET /compute/v2.1/servers/37f52fe0-438c-41f3-9142-8c171e80385d => generated 1273 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:59:57.886032 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-35561b17-af94-4294-b556-f1ded9e18a6b req-e74998dd-cc46-440b-9411-aecbb0cd14d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02a066b4-243b-4fe3-afcf-30f3e9511d1b", "name": "network-vif-deleted", "tag": "84007727-69fd-496d-bff6-b9696c470012"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:59:57.907675 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-35561b17-af94-4294-b556-f1ded9e18a6b req-e74998dd-cc46-440b-9411-aecbb0cd14d9 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:57.909846 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-35561b17-af94-4294-b556-f1ded9e18a6b req-e74998dd-cc46-440b-9411-aecbb0cd14d9 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:57.910535 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-35561b17-af94-4294-b556-f1ded9e18a6b req-e74998dd-cc46-440b-9411-aecbb0cd14d9 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:57.929547 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-35561b17-af94-4294-b556-f1ded9e18a6b req-e74998dd-cc46-440b-9411-aecbb0cd14d9 service nova] Creating event network-vif-deleted:84007727-69fd-496d-bff6-b9696c470012 for instance 02a066b4-243b-4fe3-afcf-30f3e9511d1b on n-h2-851028-13 Oct 04 18:59:57.949532 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-35561b17-af94-4294-b556-f1ded9e18a6b req-e74998dd-cc46-440b-9411-aecbb0cd14d9 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066782 Oct 04 18:59:57.950748 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2858/5369] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 18:59:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:59:58.097605 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-7582d454-6c33-4e61-95cb-163284b6fc9f tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:59:58.098960 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-7582d454-6c33-4e61-95cb-163284b6fc9f tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] [instance: 21c5a32f-69a7-4836-8c9f-399b415c2c21] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:58.113101 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7582d454-6c33-4e61-95cb-163284b6fc9f tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:58.113736 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7582d454-6c33-4e61-95cb-163284b6fc9f tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:58.115503 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7582d454-6c33-4e61-95cb-163284b6fc9f tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:58.117531 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7582d454-6c33-4e61-95cb-163284b6fc9f tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:58.118114 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7582d454-6c33-4e61-95cb-163284b6fc9f tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:58.119335 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7582d454-6c33-4e61-95cb-163284b6fc9f tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:58.197169 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-51dcec85-db77-422c-ac56-4db8256be8ff tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:59:58.199368 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-51dcec85-db77-422c-ac56-4db8256be8ff tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] [instance: 0ab8644c-b040-46c1-913b-46d595bde978] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:58.215474 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-51dcec85-db77-422c-ac56-4db8256be8ff tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:58.217315 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-51dcec85-db77-422c-ac56-4db8256be8ff tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:58.218142 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-51dcec85-db77-422c-ac56-4db8256be8ff tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:58.219221 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-51dcec85-db77-422c-ac56-4db8256be8ff tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:58.220225 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-51dcec85-db77-422c-ac56-4db8256be8ff tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:58.221609 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-51dcec85-db77-422c-ac56-4db8256be8ff tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:58.582041 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-51dcec85-db77-422c-ac56-4db8256be8ff tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '486c22456b1e47ae843ae41f8dfb2632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c91c7e7358048ffaaee7f51ad61b515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:58.611975 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-51dcec85-db77-422c-ac56-4db8256be8ff tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] 10.222.0.43 "GET /compute/v2.1/servers/0ab8644c-b040-46c1-913b-46d595bde978" status: 200 len: 1682 microversion: 2.1 time: 0.422397 Oct 04 18:59:58.614443 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2859/5370] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:59:58 2022] GET /compute/v2.1/servers/0ab8644c-b040-46c1-913b-46d595bde978 => generated 1682 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:59:58.636454 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-623ca4ec-079f-4024-8493-f67181ce479f tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:59:58.640695 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-623ca4ec-079f-4024-8493-f67181ce479f tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] [instance: 02a066b4-243b-4fe3-afcf-30f3e9511d1b] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:58.657699 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-623ca4ec-079f-4024-8493-f67181ce479f tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:58.660077 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-623ca4ec-079f-4024-8493-f67181ce479f tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:58.660901 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-623ca4ec-079f-4024-8493-f67181ce479f tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:58.662367 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-623ca4ec-079f-4024-8493-f67181ce479f tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:58.663096 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-623ca4ec-079f-4024-8493-f67181ce479f tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:58.663700 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-623ca4ec-079f-4024-8493-f67181ce479f tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:58.686103 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-7582d454-6c33-4e61-95cb-163284b6fc9f tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a63b38b57a347f282318730997e90ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0cfa6c678df4550bdf1b627efb0c46a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:58.700606 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-7582d454-6c33-4e61-95cb-163284b6fc9f tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] 10.222.0.43 "GET /compute/v2.1/servers/21c5a32f-69a7-4836-8c9f-399b415c2c21" status: 200 len: 1313 microversion: 2.1 time: 0.605935 Oct 04 18:59:58.702521 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2512/5371] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:59:58 2022] GET /compute/v2.1/servers/21c5a32f-69a7-4836-8c9f-399b415c2c21 => generated 1313 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:59:58.709058 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-9662949c-f014-4dfd-9207-df701b08b1c6 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:59:58.716214 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-9662949c-f014-4dfd-9207-df701b08b1c6 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: 37f52fe0-438c-41f3-9142-8c171e80385d] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:58.729339 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9662949c-f014-4dfd-9207-df701b08b1c6 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:58.730153 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9662949c-f014-4dfd-9207-df701b08b1c6 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:58.730600 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9662949c-f014-4dfd-9207-df701b08b1c6 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:58.731450 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9662949c-f014-4dfd-9207-df701b08b1c6 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:58.732058 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9662949c-f014-4dfd-9207-df701b08b1c6 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:58.732794 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9662949c-f014-4dfd-9207-df701b08b1c6 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:58.799549 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-623ca4ec-079f-4024-8493-f67181ce479f tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:58.822593 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-623ca4ec-079f-4024-8493-f67181ce479f tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:58.824061 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-623ca4ec-079f-4024-8493-f67181ce479f tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:58.825340 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-623ca4ec-079f-4024-8493-f67181ce479f tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] 10.222.0.43 "GET /compute/v2.1/servers/02a066b4-243b-4fe3-afcf-30f3e9511d1b" status: 200 len: 1605 microversion: 2.42 time: 0.209520 Oct 04 18:59:58.826248 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2860/5372] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:59:58 2022] GET /compute/v2.1/servers/02a066b4-243b-4fe3-afcf-30f3e9511d1b => generated 1605 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:59:59.342241 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-9662949c-f014-4dfd-9207-df701b08b1c6 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c997bc60473b43fd9fcf0c65111c44c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a711601b7a439caf395233de1febff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:59.360535 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-9662949c-f014-4dfd-9207-df701b08b1c6 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "GET /compute/v2.1/servers/37f52fe0-438c-41f3-9142-8c171e80385d" status: 200 len: 1315 microversion: 2.1 time: 0.651449 Oct 04 18:59:59.364709 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2513/5373] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:59:58 2022] GET /compute/v2.1/servers/37f52fe0-438c-41f3-9142-8c171e80385d => generated 1315 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:59:59.648071 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-2d1fc6a9-9e83-47a8-aefa-cbee442036c1 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:59:59.649142 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-2d1fc6a9-9e83-47a8-aefa-cbee442036c1 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] [instance: 0ab8644c-b040-46c1-913b-46d595bde978] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:59.669092 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2d1fc6a9-9e83-47a8-aefa-cbee442036c1 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:59.669643 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2d1fc6a9-9e83-47a8-aefa-cbee442036c1 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:59.679068 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2d1fc6a9-9e83-47a8-aefa-cbee442036c1 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:59.685539 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2d1fc6a9-9e83-47a8-aefa-cbee442036c1 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:59.686258 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2d1fc6a9-9e83-47a8-aefa-cbee442036c1 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:59.687406 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2d1fc6a9-9e83-47a8-aefa-cbee442036c1 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:59.726682 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-fc767816-c328-48c5-9671-c02faca889b1 tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:59:59.728233 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-fc767816-c328-48c5-9671-c02faca889b1 tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] [instance: 21c5a32f-69a7-4836-8c9f-399b415c2c21] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:59.747704 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fc767816-c328-48c5-9671-c02faca889b1 tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:59.749141 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fc767816-c328-48c5-9671-c02faca889b1 tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:59.752467 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fc767816-c328-48c5-9671-c02faca889b1 tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:59.755778 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fc767816-c328-48c5-9671-c02faca889b1 tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:59.758296 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fc767816-c328-48c5-9671-c02faca889b1 tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:59.760039 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fc767816-c328-48c5-9671-c02faca889b1 tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:59.920223 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-2d1fc6a9-9e83-47a8-aefa-cbee442036c1 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '486c22456b1e47ae843ae41f8dfb2632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c91c7e7358048ffaaee7f51ad61b515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:59.925558 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:59:59.949529 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-2d1fc6a9-9e83-47a8-aefa-cbee442036c1 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] 10.222.0.43 "GET /compute/v2.1/servers/0ab8644c-b040-46c1-913b-46d595bde978" status: 200 len: 1615 microversion: 2.1 time: 0.312599 Oct 04 18:59:59.955404 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2861/5374] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:59:59 2022] GET /compute/v2.1/servers/0ab8644c-b040-46c1-913b-46d595bde978 => generated 1615 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:59:59.977027 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-681c542a-b505-473e-a0da-b953361f06b1 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:59:59.984320 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-681c542a-b505-473e-a0da-b953361f06b1 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] [instance: 02a066b4-243b-4fe3-afcf-30f3e9511d1b] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:59.996055 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-681c542a-b505-473e-a0da-b953361f06b1 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:59.996573 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-681c542a-b505-473e-a0da-b953361f06b1 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:59.997020 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-681c542a-b505-473e-a0da-b953361f06b1 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:59.997911 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-681c542a-b505-473e-a0da-b953361f06b1 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:59.998914 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-681c542a-b505-473e-a0da-b953361f06b1 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:59.999619 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-681c542a-b505-473e-a0da-b953361f06b1 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:00.313845 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-681c542a-b505-473e-a0da-b953361f06b1 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:00.338405 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-681c542a-b505-473e-a0da-b953361f06b1 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:00.343784 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-681c542a-b505-473e-a0da-b953361f06b1 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:00.346582 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-fc767816-c328-48c5-9671-c02faca889b1 tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a63b38b57a347f282318730997e90ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0cfa6c678df4550bdf1b627efb0c46a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:00.348199 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-681c542a-b505-473e-a0da-b953361f06b1 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] 10.222.0.43 "GET /compute/v2.1/servers/02a066b4-243b-4fe3-afcf-30f3e9511d1b" status: 200 len: 1605 microversion: 2.42 time: 0.387586 Oct 04 19:00:00.361709 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2862/5375] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 18:59:59 2022] GET /compute/v2.1/servers/02a066b4-243b-4fe3-afcf-30f3e9511d1b => generated 1605 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:00:00.373284 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-0a4e758f-180f-4403-9423-021e286d4b07 req-34700fd0-4e09-439f-a5de-63067c25eabd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21c5a32f-69a7-4836-8c9f-399b415c2c21", "name": "network-vif-plugged", "status": "completed", "tag": "0360c0a2-78bd-4dc0-bef2-e2d42ab6b1b4"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:00:00.381950 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-fc767816-c328-48c5-9671-c02faca889b1 tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] 10.222.0.43 "GET /compute/v2.1/servers/21c5a32f-69a7-4836-8c9f-399b415c2c21" status: 200 len: 1313 microversion: 2.1 time: 0.657049 Oct 04 19:00:00.385681 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2514/5376] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 18:59:59 2022] GET /compute/v2.1/servers/21c5a32f-69a7-4836-8c9f-399b415c2c21 => generated 1313 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:00:00.396855 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-4e46ed90-7104-4aa9-b91c-27ac23651db1 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:00.399563 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-4e46ed90-7104-4aa9-b91c-27ac23651db1 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: 37f52fe0-438c-41f3-9142-8c171e80385d] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:00.414008 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4e46ed90-7104-4aa9-b91c-27ac23651db1 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:00.414889 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4e46ed90-7104-4aa9-b91c-27ac23651db1 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:00.416010 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4e46ed90-7104-4aa9-b91c-27ac23651db1 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:00.420873 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4e46ed90-7104-4aa9-b91c-27ac23651db1 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:00.421759 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4e46ed90-7104-4aa9-b91c-27ac23651db1 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:00.422444 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4e46ed90-7104-4aa9-b91c-27ac23651db1 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:00.426242 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=100 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:00:00.462192 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-0a4e758f-180f-4403-9423-021e286d4b07 req-34700fd0-4e09-439f-a5de-63067c25eabd service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:00.462705 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-0a4e758f-180f-4403-9423-021e286d4b07 req-34700fd0-4e09-439f-a5de-63067c25eabd service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:00.468475 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-0a4e758f-180f-4403-9423-021e286d4b07 req-34700fd0-4e09-439f-a5de-63067c25eabd service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:00.514128 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-0a4e758f-180f-4403-9423-021e286d4b07 req-34700fd0-4e09-439f-a5de-63067c25eabd service nova] Creating event network-vif-plugged:0360c0a2-78bd-4dc0-bef2-e2d42ab6b1b4 for instance 21c5a32f-69a7-4836-8c9f-399b415c2c21 on n-h2-851028-13 Oct 04 19:00:00.525964 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-0a4e758f-180f-4403-9423-021e286d4b07 req-34700fd0-4e09-439f-a5de-63067c25eabd service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.168296 Oct 04 19:00:00.527307 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2863/5377] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:00:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:00:00.612565 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-46f2ee66-0d7a-43d0-bd5a-e08ffbb35ebb req-a2b6503c-2e3b-41f1-98e5-0fe9e2069a7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ab8644c-b040-46c1-913b-46d595bde978", "name": "network-vif-deleted", "tag": "df4f4067-3e5a-4eeb-bc60-5f98df84527a"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:00:00.640083 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-46f2ee66-0d7a-43d0-bd5a-e08ffbb35ebb req-a2b6503c-2e3b-41f1-98e5-0fe9e2069a7e service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:00.645501 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-46f2ee66-0d7a-43d0-bd5a-e08ffbb35ebb req-a2b6503c-2e3b-41f1-98e5-0fe9e2069a7e service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:00.646774 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-46f2ee66-0d7a-43d0-bd5a-e08ffbb35ebb req-a2b6503c-2e3b-41f1-98e5-0fe9e2069a7e service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:00.679291 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-46f2ee66-0d7a-43d0-bd5a-e08ffbb35ebb req-a2b6503c-2e3b-41f1-98e5-0fe9e2069a7e service nova] Creating event network-vif-deleted:df4f4067-3e5a-4eeb-bc60-5f98df84527a for instance 0ab8644c-b040-46c1-913b-46d595bde978 on n-h1-851028-13 Oct 04 19:00:00.693507 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-46f2ee66-0d7a-43d0-bd5a-e08ffbb35ebb req-a2b6503c-2e3b-41f1-98e5-0fe9e2069a7e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087709 Oct 04 19:00:00.694836 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2864/5378] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:00:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:00:00.861485 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-4e46ed90-7104-4aa9-b91c-27ac23651db1 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c997bc60473b43fd9fcf0c65111c44c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a711601b7a439caf395233de1febff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:00.878354 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-4e46ed90-7104-4aa9-b91c-27ac23651db1 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "GET /compute/v2.1/servers/37f52fe0-438c-41f3-9142-8c171e80385d" status: 200 len: 1315 microversion: 2.1 time: 0.484393 Oct 04 19:00:00.879896 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2515/5379] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:00:00 2022] GET /compute/v2.1/servers/37f52fe0-438c-41f3-9142-8c171e80385d => generated 1315 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:00:00.987405 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-71492828-680a-4059-b488-f3b48020a458 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:00.988561 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-71492828-680a-4059-b488-f3b48020a458 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] [instance: 0ab8644c-b040-46c1-913b-46d595bde978] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:01.005681 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-71492828-680a-4059-b488-f3b48020a458 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:01.006200 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-71492828-680a-4059-b488-f3b48020a458 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:01.006723 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-71492828-680a-4059-b488-f3b48020a458 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:01.009318 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-71492828-680a-4059-b488-f3b48020a458 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:01.009804 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-71492828-680a-4059-b488-f3b48020a458 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:01.010575 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-71492828-680a-4059-b488-f3b48020a458 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:01.063327 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-71492828-680a-4059-b488-f3b48020a458 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:01.064417 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-71492828-680a-4059-b488-f3b48020a458 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:01.065389 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-71492828-680a-4059-b488-f3b48020a458 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:01.066156 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.objects.instance [None req-71492828-680a-4059-b488-f3b48020a458 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lazy-loading 'fault' on Instance uuid 0ab8644c-b040-46c1-913b-46d595bde978 {{(pid=123596) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 19:00:01.142285 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-71492828-680a-4059-b488-f3b48020a458 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '486c22456b1e47ae843ae41f8dfb2632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c91c7e7358048ffaaee7f51ad61b515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:01.146533 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-79ce9ec3-e7be-45ca-a3e0-edf5894b47c2 req-55082144-a52b-4204-85e8-a3fb14026629 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37f52fe0-438c-41f3-9142-8c171e80385d", "tag": "87b2efb4-1d0c-4d0e-8dcd-63fb77b93fb8"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:00:01.155159 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-71492828-680a-4059-b488-f3b48020a458 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] 10.222.0.43 "GET /compute/v2.1/servers/0ab8644c-b040-46c1-913b-46d595bde978" status: 200 len: 1332 microversion: 2.1 time: 0.174634 Oct 04 19:00:01.175462 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-79ce9ec3-e7be-45ca-a3e0-edf5894b47c2 req-55082144-a52b-4204-85e8-a3fb14026629 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:01.178762 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-79ce9ec3-e7be-45ca-a3e0-edf5894b47c2 req-55082144-a52b-4204-85e8-a3fb14026629 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:01.182418 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2865/5380] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:00:00 2022] GET /compute/v2.1/servers/0ab8644c-b040-46c1-913b-46d595bde978 => generated 1332 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:00:01.185278 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-79ce9ec3-e7be-45ca-a3e0-edf5894b47c2 req-55082144-a52b-4204-85e8-a3fb14026629 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:01.245616 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-79ce9ec3-e7be-45ca-a3e0-edf5894b47c2 req-55082144-a52b-4204-85e8-a3fb14026629 service nova] Creating event network-changed:87b2efb4-1d0c-4d0e-8dcd-63fb77b93fb8 for instance 37f52fe0-438c-41f3-9142-8c171e80385d on n-h1-851028-13 Oct 04 19:00:01.268539 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-79ce9ec3-e7be-45ca-a3e0-edf5894b47c2 req-55082144-a52b-4204-85e8-a3fb14026629 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124445 Oct 04 19:00:01.272885 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2516/5381] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:00:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:00:01.385481 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-df531823-94f5-4c15-97ee-d5868d21f6dd tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:01.386575 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-df531823-94f5-4c15-97ee-d5868d21f6dd tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] [instance: 02a066b4-243b-4fe3-afcf-30f3e9511d1b] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:01.416535 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-df531823-94f5-4c15-97ee-d5868d21f6dd tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:01.417390 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-df531823-94f5-4c15-97ee-d5868d21f6dd tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:01.418061 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-88c21a42-9b1d-4f54-a3ac-49f692ac811a tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:01.418749 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-df531823-94f5-4c15-97ee-d5868d21f6dd tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:01.419302 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-df531823-94f5-4c15-97ee-d5868d21f6dd tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:01.420087 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-df531823-94f5-4c15-97ee-d5868d21f6dd tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:01.422840 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-88c21a42-9b1d-4f54-a3ac-49f692ac811a tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] [instance: 21c5a32f-69a7-4836-8c9f-399b415c2c21] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:01.428338 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-df531823-94f5-4c15-97ee-d5868d21f6dd tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:01.449327 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-88c21a42-9b1d-4f54-a3ac-49f692ac811a tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:01.450719 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-88c21a42-9b1d-4f54-a3ac-49f692ac811a tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:01.455948 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-88c21a42-9b1d-4f54-a3ac-49f692ac811a tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:01.457786 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-88c21a42-9b1d-4f54-a3ac-49f692ac811a tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:01.458853 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-88c21a42-9b1d-4f54-a3ac-49f692ac811a tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:01.460837 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-88c21a42-9b1d-4f54-a3ac-49f692ac811a tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:01.755731 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-df531823-94f5-4c15-97ee-d5868d21f6dd tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:01.779069 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-df531823-94f5-4c15-97ee-d5868d21f6dd tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:01.782767 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-df531823-94f5-4c15-97ee-d5868d21f6dd tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:01.787455 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-df531823-94f5-4c15-97ee-d5868d21f6dd tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] 10.222.0.43 "GET /compute/v2.1/servers/02a066b4-243b-4fe3-afcf-30f3e9511d1b" status: 200 len: 1605 microversion: 2.42 time: 0.412245 Oct 04 19:00:01.808327 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2866/5382] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:00:01 2022] GET /compute/v2.1/servers/02a066b4-243b-4fe3-afcf-30f3e9511d1b => generated 1605 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:00:01.905778 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-34309e7a-6f9c-4a62-8ab0-8547488ed6d4 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:01.906768 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-34309e7a-6f9c-4a62-8ab0-8547488ed6d4 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: 37f52fe0-438c-41f3-9142-8c171e80385d] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:01.922377 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-34309e7a-6f9c-4a62-8ab0-8547488ed6d4 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:01.923848 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-34309e7a-6f9c-4a62-8ab0-8547488ed6d4 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:01.925101 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-34309e7a-6f9c-4a62-8ab0-8547488ed6d4 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:01.927330 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-34309e7a-6f9c-4a62-8ab0-8547488ed6d4 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:01.931781 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-34309e7a-6f9c-4a62-8ab0-8547488ed6d4 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:01.934088 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-34309e7a-6f9c-4a62-8ab0-8547488ed6d4 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:02.432822 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=4 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:00:02.693429 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-34309e7a-6f9c-4a62-8ab0-8547488ed6d4 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c997bc60473b43fd9fcf0c65111c44c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a711601b7a439caf395233de1febff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:02.704474 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-34309e7a-6f9c-4a62-8ab0-8547488ed6d4 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "GET /compute/v2.1/servers/37f52fe0-438c-41f3-9142-8c171e80385d" status: 200 len: 1315 microversion: 2.1 time: 0.803201 Oct 04 19:00:02.705368 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2867/5383] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:00:01 2022] GET /compute/v2.1/servers/37f52fe0-438c-41f3-9142-8c171e80385d => generated 1315 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:00:02.712002 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-fc32edac-ec28-4af4-b480-2b7e1a7a212b tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:02.713088 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-fc32edac-ec28-4af4-b480-2b7e1a7a212b tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] [instance: 0ab8644c-b040-46c1-913b-46d595bde978] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:02.721591 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fc32edac-ec28-4af4-b480-2b7e1a7a212b tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:02.722379 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fc32edac-ec28-4af4-b480-2b7e1a7a212b tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:02.723152 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fc32edac-ec28-4af4-b480-2b7e1a7a212b tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:02.724082 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fc32edac-ec28-4af4-b480-2b7e1a7a212b tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:02.724723 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fc32edac-ec28-4af4-b480-2b7e1a7a212b tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:02.725371 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fc32edac-ec28-4af4-b480-2b7e1a7a212b tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:02.747598 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-fc32edac-ec28-4af4-b480-2b7e1a7a212b tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] HTTP exception thrown: Instance 0ab8644c-b040-46c1-913b-46d595bde978 could not be found. Oct 04 19:00:02.751342 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-fc32edac-ec28-4af4-b480-2b7e1a7a212b tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Request method failure captured: Oct 04 19:00:02.751342 n-d-851028-13 devstack@n-api.service[123596]: request: GET /compute/v2.1/servers/0ab8644c-b040-46c1-913b-46d595bde978 HTTP/1.1 Oct 04 19:00:02.751342 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 19:00:02.751342 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 19:00:02.751342 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 19:00:02.751342 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 19:00:02.751342 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 19:00:02.751342 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 19:00:02.751342 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 19:00:02.751342 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 19:00:02.751342 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPID78vmCI9IDPSneDizdTNDV6DvHA8Yu-0Hk2AdriQTEcsN9glvSb6qnq0IhhwuZEnTcyOqvR3DmN0AjQb3MXy0KeUN-iyujvPMDrfVKCEbIzKf9nHEoBLFpzOTLVQVrEHVpIwmUAw_LxUeBUjShHQb88Tzo0W7pmPF365n3rwKGYEI Oct 04 19:00:02.751342 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 19:00:02.751342 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 19:00:02.751342 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 19:00:02.751342 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 19:00:02.751342 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 19:00:02.751342 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 19:00:02.751342 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: 6c91c7e7358048ffaaee7f51ad61b515 Oct 04 19:00:02.751342 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-AttachVolumeNegativeTest-2048626205 Oct 04 19:00:02.751342 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 19:00:02.751342 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 19:00:02.751342 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/6c91c7e7358048ffaaee7f51ad61b515"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_6c91c7e7358048ffaaee7f51ad61b515"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/6c91c7e7358048ffaaee7f51ad61b515"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/6c91c7e7358048ffaaee7f51ad61b515"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 19:00:02.751342 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-AttachVolumeNegativeTest-2048626205 Oct 04 19:00:02.751342 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: 6c91c7e7358048ffaaee7f51ad61b515 Oct 04 19:00:02.751342 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2048626205 Oct 04 19:00:02.751342 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-AttachVolumeNegativeTest-2048626205-project Oct 04 19:00:02.751342 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 19:00:02.751342 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 19:00:02.751342 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 486c22456b1e47ae843ae41f8dfb2632 Oct 04 19:00:02.751342 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-AttachVolumeNegativeTest-2048626205-project Oct 04 19:00:02.751342 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 19:00:02.751342 n-d-851028-13 devstack@n-api.service[123596]: exception: Instance 0ab8644c-b040-46c1-913b-46d595bde978 could not be found. Oct 04 19:00:02.751342 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': '0ab8644c-b040-46c1-913b-46d595bde978'} Oct 04 19:00:02.751342 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:00:02.751342 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:00:02.751342 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:00:02.751342 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:00:02.751342 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:00:02.751342 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:00:02.751342 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:00:02.751342 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:00:02.751342 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:00:02.751342 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:00:02.751342 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ab8644c-b040-46c1-913b-46d595bde978 could not be found. Oct 04 19:00:02.751342 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:00:02.751342 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:00:02.751342 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:00:02.751342 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:00:02.751342 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:00:02.751342 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:00:02.751342 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:00:02.751342 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:00:02.751342 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:00:02.751342 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:00:02.751342 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:00:02.751342 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:00:02.751342 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:00:02.751342 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:00:02.751342 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:00:02.751342 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:00:02.751342 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ab8644c-b040-46c1-913b-46d595bde978 could not be found. Oct 04 19:00:02.751342 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:00:02.751342 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:00:02.751342 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:00:02.756730 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:00:02.756730 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:00:02.756730 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:00:02.756730 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:00:02.756730 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:00:02.756730 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ab8644c-b040-46c1-913b-46d595bde978 could not be found. Oct 04 19:00:02.756730 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:00:02.756730 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-fc32edac-ec28-4af4-b480-2b7e1a7a212b tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Returning 404 to user: Instance 0ab8644c-b040-46c1-913b-46d595bde978 could not be found. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:00:02.756730 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-fc32edac-ec28-4af4-b480-2b7e1a7a212b tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] 10.222.0.43 "GET /compute/v2.1/servers/0ab8644c-b040-46c1-913b-46d595bde978" status: 404 len: 111 microversion: 2.1 time: 0.046544 Oct 04 19:00:02.756730 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2868/5384] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:00:02 2022] GET /compute/v2.1/servers/0ab8644c-b040-46c1-913b-46d595bde978 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:00:02.764354 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-309c3d70-957a-449c-a846-a054a61f436e tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Calling method '.version_select at 0x7fb21e735670>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:02.798204 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-309c3d70-957a-449c-a846-a054a61f436e tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1445986333" status: 202 len: 0 microversion: 2.1 time: 0.038699 Oct 04 19:00:02.800877 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-88c21a42-9b1d-4f54-a3ac-49f692ac811a tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a63b38b57a347f282318730997e90ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0cfa6c678df4550bdf1b627efb0c46a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:02.802833 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2869/5385] 10.222.0.43 () {58 vars in 1221 bytes} [Tue Oct 4 19:00:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1445986333 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:00:02.811202 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-88c21a42-9b1d-4f54-a3ac-49f692ac811a tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] 10.222.0.43 "GET /compute/v2.1/servers/21c5a32f-69a7-4836-8c9f-399b415c2c21" status: 200 len: 1313 microversion: 2.1 time: 1.402142 Oct 04 19:00:02.812808 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2517/5386] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:00:01 2022] GET /compute/v2.1/servers/21c5a32f-69a7-4836-8c9f-399b415c2c21 => generated 1313 bytes in 1405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:00:02.842514 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-25d874e4-bd2d-4866-a2b4-e69510f6dee5 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:02.843521 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-25d874e4-bd2d-4866-a2b4-e69510f6dee5 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] [instance: 02a066b4-243b-4fe3-afcf-30f3e9511d1b] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:02.853202 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-25d874e4-bd2d-4866-a2b4-e69510f6dee5 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:02.855382 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-25d874e4-bd2d-4866-a2b4-e69510f6dee5 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:02.856098 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-25d874e4-bd2d-4866-a2b4-e69510f6dee5 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:02.857081 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-25d874e4-bd2d-4866-a2b4-e69510f6dee5 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:02.857960 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-25d874e4-bd2d-4866-a2b4-e69510f6dee5 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:02.858726 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-25d874e4-bd2d-4866-a2b4-e69510f6dee5 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:03.018315 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-25d874e4-bd2d-4866-a2b4-e69510f6dee5 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:03.041645 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-25d874e4-bd2d-4866-a2b4-e69510f6dee5 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:03.044687 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-25d874e4-bd2d-4866-a2b4-e69510f6dee5 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:03.047491 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-25d874e4-bd2d-4866-a2b4-e69510f6dee5 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] 10.222.0.43 "GET /compute/v2.1/servers/02a066b4-243b-4fe3-afcf-30f3e9511d1b" status: 200 len: 1605 microversion: 2.42 time: 0.221587 Oct 04 19:00:03.066055 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2870/5387] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:00:02 2022] GET /compute/v2.1/servers/02a066b4-243b-4fe3-afcf-30f3e9511d1b => generated 1605 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:00:03.743487 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-58874a31-40d0-48e8-a109-48e3962c8771 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:03.744245 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-58874a31-40d0-48e8-a109-48e3962c8771 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: 37f52fe0-438c-41f3-9142-8c171e80385d] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:03.747543 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=1 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:00:03.757887 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-58874a31-40d0-48e8-a109-48e3962c8771 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:03.758974 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-58874a31-40d0-48e8-a109-48e3962c8771 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:03.759687 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-58874a31-40d0-48e8-a109-48e3962c8771 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:03.761151 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-58874a31-40d0-48e8-a109-48e3962c8771 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:03.761720 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-58874a31-40d0-48e8-a109-48e3962c8771 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:03.762235 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-58874a31-40d0-48e8-a109-48e3962c8771 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:03.835869 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-ff91a2fa-50fb-423b-9ae1-918e7db2dd0a tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:03.843446 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-ff91a2fa-50fb-423b-9ae1-918e7db2dd0a tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] [instance: 21c5a32f-69a7-4836-8c9f-399b415c2c21] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:03.847217 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=16 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:00:03.854433 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ff91a2fa-50fb-423b-9ae1-918e7db2dd0a tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:03.854928 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ff91a2fa-50fb-423b-9ae1-918e7db2dd0a tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:03.855395 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ff91a2fa-50fb-423b-9ae1-918e7db2dd0a tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:03.856078 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ff91a2fa-50fb-423b-9ae1-918e7db2dd0a tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:03.856534 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ff91a2fa-50fb-423b-9ae1-918e7db2dd0a tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:03.856957 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ff91a2fa-50fb-423b-9ae1-918e7db2dd0a tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:04.135352 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-58874a31-40d0-48e8-a109-48e3962c8771 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c997bc60473b43fd9fcf0c65111c44c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a711601b7a439caf395233de1febff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:04.147280 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-58874a31-40d0-48e8-a109-48e3962c8771 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "GET /compute/v2.1/servers/37f52fe0-438c-41f3-9142-8c171e80385d" status: 200 len: 1315 microversion: 2.1 time: 0.407802 Oct 04 19:00:04.147886 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2518/5388] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:00:03 2022] GET /compute/v2.1/servers/37f52fe0-438c-41f3-9142-8c171e80385d => generated 1315 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:00:04.160273 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-b910db73-dafe-49f7-b060-7e0e4517fc77 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:04.161343 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-b910db73-dafe-49f7-b060-7e0e4517fc77 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] [instance: 02a066b4-243b-4fe3-afcf-30f3e9511d1b] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:04.175624 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b910db73-dafe-49f7-b060-7e0e4517fc77 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:04.176497 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b910db73-dafe-49f7-b060-7e0e4517fc77 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:04.176945 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b910db73-dafe-49f7-b060-7e0e4517fc77 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:04.178898 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b910db73-dafe-49f7-b060-7e0e4517fc77 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:04.181830 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b910db73-dafe-49f7-b060-7e0e4517fc77 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:04.182475 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b910db73-dafe-49f7-b060-7e0e4517fc77 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:04.273043 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-ff91a2fa-50fb-423b-9ae1-918e7db2dd0a tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a63b38b57a347f282318730997e90ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0cfa6c678df4550bdf1b627efb0c46a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:04.290118 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-ff91a2fa-50fb-423b-9ae1-918e7db2dd0a tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] 10.222.0.43 "GET /compute/v2.1/servers/21c5a32f-69a7-4836-8c9f-399b415c2c21" status: 200 len: 1462 microversion: 2.1 time: 0.457920 Oct 04 19:00:04.314379 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2871/5389] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:00:03 2022] GET /compute/v2.1/servers/21c5a32f-69a7-4836-8c9f-399b415c2c21 => generated 1462 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:00:04.322150 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-dd99e522-4b86-4caf-bdba-0fa485467232 tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "eccc69d1-a3a1-4ee2-8218-370d73ba61f6", "device": "/dev/sdb"}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:00:04.325287 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-dd99e522-4b86-4caf-bdba-0fa485467232 tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] [instance: 21c5a32f-69a7-4836-8c9f-399b415c2c21] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:04.334203 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dd99e522-4b86-4caf-bdba-0fa485467232 tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:04.335152 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dd99e522-4b86-4caf-bdba-0fa485467232 tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:04.335812 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dd99e522-4b86-4caf-bdba-0fa485467232 tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:04.336900 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dd99e522-4b86-4caf-bdba-0fa485467232 tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:04.337638 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dd99e522-4b86-4caf-bdba-0fa485467232 tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:04.338283 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dd99e522-4b86-4caf-bdba-0fa485467232 tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:04.363819 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-b910db73-dafe-49f7-b060-7e0e4517fc77 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:04.379469 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-b910db73-dafe-49f7-b060-7e0e4517fc77 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:04.384399 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-b910db73-dafe-49f7-b060-7e0e4517fc77 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:04.390844 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-b910db73-dafe-49f7-b060-7e0e4517fc77 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] 10.222.0.43 "GET /compute/v2.1/servers/02a066b4-243b-4fe3-afcf-30f3e9511d1b" status: 200 len: 1605 microversion: 2.42 time: 0.236691 Oct 04 19:00:04.392866 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2519/5390] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:00:04 2022] GET /compute/v2.1/servers/02a066b4-243b-4fe3-afcf-30f3e9511d1b => generated 1605 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:00:04.729314 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-dd99e522-4b86-4caf-bdba-0fa485467232 tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] 10.222.0.43 "POST /compute/v2.1/servers/21c5a32f-69a7-4836-8c9f-399b415c2c21/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.412449 Oct 04 19:00:04.731392 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2872/5391] 10.222.0.43 () {60 vars in 1323 bytes} [Tue Oct 4 19:00:04 2022] POST /compute/v2.1/servers/21c5a32f-69a7-4836-8c9f-399b415c2c21/os-volume_attachments => generated 194 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:00:05.174787 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-2b763761-4c64-4488-b605-629b03a26c7f tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:05.175429 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-2b763761-4c64-4488-b605-629b03a26c7f tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: 37f52fe0-438c-41f3-9142-8c171e80385d] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:05.194580 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2b763761-4c64-4488-b605-629b03a26c7f tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:05.195147 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2b763761-4c64-4488-b605-629b03a26c7f tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:05.196173 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2b763761-4c64-4488-b605-629b03a26c7f tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:05.196932 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2b763761-4c64-4488-b605-629b03a26c7f tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:05.200469 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2b763761-4c64-4488-b605-629b03a26c7f tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:05.200936 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2b763761-4c64-4488-b605-629b03a26c7f tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:05.428037 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-dde74c2c-0f03-4731-802b-d5be23b1d8d8 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:05.428750 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-dde74c2c-0f03-4731-802b-d5be23b1d8d8 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] [instance: 02a066b4-243b-4fe3-afcf-30f3e9511d1b] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:05.459988 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dde74c2c-0f03-4731-802b-d5be23b1d8d8 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:05.460504 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dde74c2c-0f03-4731-802b-d5be23b1d8d8 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:05.461354 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dde74c2c-0f03-4731-802b-d5be23b1d8d8 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:05.466171 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dde74c2c-0f03-4731-802b-d5be23b1d8d8 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:05.466912 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dde74c2c-0f03-4731-802b-d5be23b1d8d8 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:05.467370 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dde74c2c-0f03-4731-802b-d5be23b1d8d8 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:05.501897 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-2b763761-4c64-4488-b605-629b03a26c7f tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c997bc60473b43fd9fcf0c65111c44c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a711601b7a439caf395233de1febff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:05.516780 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-2b763761-4c64-4488-b605-629b03a26c7f tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "GET /compute/v2.1/servers/37f52fe0-438c-41f3-9142-8c171e80385d" status: 200 len: 1315 microversion: 2.1 time: 0.345972 Oct 04 19:00:05.519482 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2520/5392] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:00:05 2022] GET /compute/v2.1/servers/37f52fe0-438c-41f3-9142-8c171e80385d => generated 1315 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:00:05.668476 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-dde74c2c-0f03-4731-802b-d5be23b1d8d8 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:05.679102 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-dde74c2c-0f03-4731-802b-d5be23b1d8d8 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:05.710703 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-dde74c2c-0f03-4731-802b-d5be23b1d8d8 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:05.716282 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-dde74c2c-0f03-4731-802b-d5be23b1d8d8 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] 10.222.0.43 "GET /compute/v2.1/servers/02a066b4-243b-4fe3-afcf-30f3e9511d1b" status: 200 len: 1605 microversion: 2.42 time: 0.288955 Oct 04 19:00:05.723627 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2873/5393] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:00:05 2022] GET /compute/v2.1/servers/02a066b4-243b-4fe3-afcf-30f3e9511d1b => generated 1605 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 19:00:06.553033 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-a1ee8175-c55d-4181-9176-bd0107784c53 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:06.554516 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-a1ee8175-c55d-4181-9176-bd0107784c53 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: 37f52fe0-438c-41f3-9142-8c171e80385d] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:06.571256 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a1ee8175-c55d-4181-9176-bd0107784c53 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:06.572448 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a1ee8175-c55d-4181-9176-bd0107784c53 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:06.572934 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a1ee8175-c55d-4181-9176-bd0107784c53 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:06.574239 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a1ee8175-c55d-4181-9176-bd0107784c53 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:06.574741 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a1ee8175-c55d-4181-9176-bd0107784c53 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:06.575232 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a1ee8175-c55d-4181-9176-bd0107784c53 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:06.761977 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-2e49c141-58ce-4177-ab33-8deb6bd17e43 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:06.764153 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-2e49c141-58ce-4177-ab33-8deb6bd17e43 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] [instance: 02a066b4-243b-4fe3-afcf-30f3e9511d1b] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:06.794124 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2e49c141-58ce-4177-ab33-8deb6bd17e43 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:06.794842 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2e49c141-58ce-4177-ab33-8deb6bd17e43 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:06.795393 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2e49c141-58ce-4177-ab33-8deb6bd17e43 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:06.796312 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2e49c141-58ce-4177-ab33-8deb6bd17e43 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:06.797076 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2e49c141-58ce-4177-ab33-8deb6bd17e43 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:06.797621 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2e49c141-58ce-4177-ab33-8deb6bd17e43 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:06.870298 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-a1ee8175-c55d-4181-9176-bd0107784c53 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c997bc60473b43fd9fcf0c65111c44c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a711601b7a439caf395233de1febff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:06.879751 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-a1ee8175-c55d-4181-9176-bd0107784c53 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "GET /compute/v2.1/servers/37f52fe0-438c-41f3-9142-8c171e80385d" status: 200 len: 1315 microversion: 2.1 time: 0.334976 Oct 04 19:00:06.894263 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2521/5394] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:00:06 2022] GET /compute/v2.1/servers/37f52fe0-438c-41f3-9142-8c171e80385d => generated 1315 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:00:06.970383 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-2e49c141-58ce-4177-ab33-8deb6bd17e43 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:06.985900 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-2e49c141-58ce-4177-ab33-8deb6bd17e43 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:06.990885 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-2e49c141-58ce-4177-ab33-8deb6bd17e43 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:06.992725 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-2e49c141-58ce-4177-ab33-8deb6bd17e43 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] 10.222.0.43 "GET /compute/v2.1/servers/02a066b4-243b-4fe3-afcf-30f3e9511d1b" status: 200 len: 1605 microversion: 2.42 time: 0.236418 Oct 04 19:00:06.994454 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2874/5395] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:00:06 2022] GET /compute/v2.1/servers/02a066b4-243b-4fe3-afcf-30f3e9511d1b => generated 1605 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:00:07.933076 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-7789e017-3509-4c22-bc6b-5250bbd6fde5 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:07.934463 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-7789e017-3509-4c22-bc6b-5250bbd6fde5 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: 37f52fe0-438c-41f3-9142-8c171e80385d] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:07.965926 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7789e017-3509-4c22-bc6b-5250bbd6fde5 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:07.967985 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7789e017-3509-4c22-bc6b-5250bbd6fde5 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:07.968845 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7789e017-3509-4c22-bc6b-5250bbd6fde5 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:07.972862 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7789e017-3509-4c22-bc6b-5250bbd6fde5 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:07.976503 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7789e017-3509-4c22-bc6b-5250bbd6fde5 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:07.978023 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7789e017-3509-4c22-bc6b-5250bbd6fde5 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:08.022127 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-4536a38a-4abe-4f82-aa27-edd4767e16ba tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:08.022782 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-4536a38a-4abe-4f82-aa27-edd4767e16ba tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] [instance: 02a066b4-243b-4fe3-afcf-30f3e9511d1b] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:08.038861 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4536a38a-4abe-4f82-aa27-edd4767e16ba tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:08.040509 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4536a38a-4abe-4f82-aa27-edd4767e16ba tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:08.080217 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4536a38a-4abe-4f82-aa27-edd4767e16ba tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.038s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:08.086699 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4536a38a-4abe-4f82-aa27-edd4767e16ba tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:08.088388 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4536a38a-4abe-4f82-aa27-edd4767e16ba tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:08.089626 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4536a38a-4abe-4f82-aa27-edd4767e16ba tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:08.316701 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-4536a38a-4abe-4f82-aa27-edd4767e16ba tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:08.332664 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-4536a38a-4abe-4f82-aa27-edd4767e16ba tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:08.338464 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-4536a38a-4abe-4f82-aa27-edd4767e16ba tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:08.339880 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-4536a38a-4abe-4f82-aa27-edd4767e16ba tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] 10.222.0.43 "GET /compute/v2.1/servers/02a066b4-243b-4fe3-afcf-30f3e9511d1b" status: 200 len: 1605 microversion: 2.42 time: 0.321917 Oct 04 19:00:08.363000 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2875/5396] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:00:08 2022] GET /compute/v2.1/servers/02a066b4-243b-4fe3-afcf-30f3e9511d1b => generated 1605 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 19:00:08.369785 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-7789e017-3509-4c22-bc6b-5250bbd6fde5 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c997bc60473b43fd9fcf0c65111c44c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a711601b7a439caf395233de1febff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:08.378142 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-7789e017-3509-4c22-bc6b-5250bbd6fde5 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "GET /compute/v2.1/servers/37f52fe0-438c-41f3-9142-8c171e80385d" status: 200 len: 1315 microversion: 2.1 time: 0.455536 Oct 04 19:00:08.378949 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2522/5397] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:00:07 2022] GET /compute/v2.1/servers/37f52fe0-438c-41f3-9142-8c171e80385d => generated 1315 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:00:09.371611 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-7a466316-0613-4912-856f-c8aa67fad935 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:09.372297 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-7a466316-0613-4912-856f-c8aa67fad935 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] [instance: 02a066b4-243b-4fe3-afcf-30f3e9511d1b] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:09.394776 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7a466316-0613-4912-856f-c8aa67fad935 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:09.395864 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7a466316-0613-4912-856f-c8aa67fad935 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:09.396763 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7a466316-0613-4912-856f-c8aa67fad935 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:09.397763 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7a466316-0613-4912-856f-c8aa67fad935 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:09.398677 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7a466316-0613-4912-856f-c8aa67fad935 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:09.399757 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7a466316-0613-4912-856f-c8aa67fad935 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:09.406091 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-3f3f37eb-73c3-46f4-86ce-20fe1c558580 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:09.406736 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-3f3f37eb-73c3-46f4-86ce-20fe1c558580 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: 37f52fe0-438c-41f3-9142-8c171e80385d] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:09.426934 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3f3f37eb-73c3-46f4-86ce-20fe1c558580 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:09.427671 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3f3f37eb-73c3-46f4-86ce-20fe1c558580 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:09.428264 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3f3f37eb-73c3-46f4-86ce-20fe1c558580 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:09.429202 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3f3f37eb-73c3-46f4-86ce-20fe1c558580 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:09.429877 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3f3f37eb-73c3-46f4-86ce-20fe1c558580 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:09.430980 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3f3f37eb-73c3-46f4-86ce-20fe1c558580 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:09.751862 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-7a466316-0613-4912-856f-c8aa67fad935 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:09.768495 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-7a466316-0613-4912-856f-c8aa67fad935 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:09.786551 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-7a466316-0613-4912-856f-c8aa67fad935 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:09.796622 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-7a466316-0613-4912-856f-c8aa67fad935 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] 10.222.0.43 "GET /compute/v2.1/servers/02a066b4-243b-4fe3-afcf-30f3e9511d1b" status: 200 len: 1605 microversion: 2.42 time: 0.423376 Oct 04 19:00:09.803203 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2876/5398] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:00:09 2022] GET /compute/v2.1/servers/02a066b4-243b-4fe3-afcf-30f3e9511d1b => generated 1605 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 19:00:09.822988 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-2d2f8d69-b0d4-4475-9b43-3bdf4d8555fc req-9e54ffe5-4a40-418f-991c-1674b129fbee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37f52fe0-438c-41f3-9142-8c171e80385d", "name": "network-vif-plugged", "status": "completed", "tag": "87b2efb4-1d0c-4d0e-8dcd-63fb77b93fb8"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:00:09.863990 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-2d2f8d69-b0d4-4475-9b43-3bdf4d8555fc req-9e54ffe5-4a40-418f-991c-1674b129fbee service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:09.864795 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-2d2f8d69-b0d4-4475-9b43-3bdf4d8555fc req-9e54ffe5-4a40-418f-991c-1674b129fbee service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:09.866589 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-2d2f8d69-b0d4-4475-9b43-3bdf4d8555fc req-9e54ffe5-4a40-418f-991c-1674b129fbee service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:09.902373 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-2d2f8d69-b0d4-4475-9b43-3bdf4d8555fc req-9e54ffe5-4a40-418f-991c-1674b129fbee service nova] Creating event network-vif-plugged:87b2efb4-1d0c-4d0e-8dcd-63fb77b93fb8 for instance 37f52fe0-438c-41f3-9142-8c171e80385d on n-h1-851028-13 Oct 04 19:00:09.916106 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-2d2f8d69-b0d4-4475-9b43-3bdf4d8555fc req-9e54ffe5-4a40-418f-991c-1674b129fbee service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111394 Oct 04 19:00:09.922908 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2877/5399] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:00:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:00:10.242039 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-3f3f37eb-73c3-46f4-86ce-20fe1c558580 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c997bc60473b43fd9fcf0c65111c44c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a711601b7a439caf395233de1febff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:10.256119 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-3f3f37eb-73c3-46f4-86ce-20fe1c558580 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "GET /compute/v2.1/servers/37f52fe0-438c-41f3-9142-8c171e80385d" status: 200 len: 1315 microversion: 2.1 time: 0.854658 Oct 04 19:00:10.257550 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2523/5400] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:00:09 2022] GET /compute/v2.1/servers/37f52fe0-438c-41f3-9142-8c171e80385d => generated 1315 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:00:10.826217 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-98b9f331-2b39-4947-a872-76d256ce1a89 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:10.828093 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-98b9f331-2b39-4947-a872-76d256ce1a89 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] [instance: 02a066b4-243b-4fe3-afcf-30f3e9511d1b] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:10.836571 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-98b9f331-2b39-4947-a872-76d256ce1a89 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:10.837476 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-98b9f331-2b39-4947-a872-76d256ce1a89 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:10.838176 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-98b9f331-2b39-4947-a872-76d256ce1a89 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:10.839224 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-98b9f331-2b39-4947-a872-76d256ce1a89 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:10.840016 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-98b9f331-2b39-4947-a872-76d256ce1a89 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:10.840622 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-98b9f331-2b39-4947-a872-76d256ce1a89 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:10.991449 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-98b9f331-2b39-4947-a872-76d256ce1a89 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:11.003889 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-98b9f331-2b39-4947-a872-76d256ce1a89 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:11.012331 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-98b9f331-2b39-4947-a872-76d256ce1a89 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:11.015654 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-98b9f331-2b39-4947-a872-76d256ce1a89 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] 10.222.0.43 "GET /compute/v2.1/servers/02a066b4-243b-4fe3-afcf-30f3e9511d1b" status: 200 len: 1605 microversion: 2.42 time: 0.194832 Oct 04 19:00:11.017825 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2878/5401] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:00:10 2022] GET /compute/v2.1/servers/02a066b4-243b-4fe3-afcf-30f3e9511d1b => generated 1605 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:00:11.284592 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-7470715b-180c-468b-8b58-2148dfe1cd62 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:11.285447 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-7470715b-180c-468b-8b58-2148dfe1cd62 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: 37f52fe0-438c-41f3-9142-8c171e80385d] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:11.302020 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7470715b-180c-468b-8b58-2148dfe1cd62 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:11.302535 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7470715b-180c-468b-8b58-2148dfe1cd62 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:11.303249 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7470715b-180c-468b-8b58-2148dfe1cd62 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:11.306007 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7470715b-180c-468b-8b58-2148dfe1cd62 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:11.306501 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7470715b-180c-468b-8b58-2148dfe1cd62 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:11.307026 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7470715b-180c-468b-8b58-2148dfe1cd62 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:11.558890 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-7470715b-180c-468b-8b58-2148dfe1cd62 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c997bc60473b43fd9fcf0c65111c44c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a711601b7a439caf395233de1febff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:11.571322 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-7470715b-180c-468b-8b58-2148dfe1cd62 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "GET /compute/v2.1/servers/37f52fe0-438c-41f3-9142-8c171e80385d" status: 200 len: 1315 microversion: 2.1 time: 0.291058 Oct 04 19:00:11.587465 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2524/5402] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:00:11 2022] GET /compute/v2.1/servers/37f52fe0-438c-41f3-9142-8c171e80385d => generated 1315 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:00:12.055717 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-81d74c8b-15da-464e-8f22-aa60fe31ae34 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:12.057081 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-81d74c8b-15da-464e-8f22-aa60fe31ae34 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] [instance: 02a066b4-243b-4fe3-afcf-30f3e9511d1b] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:12.070108 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-81d74c8b-15da-464e-8f22-aa60fe31ae34 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:12.071003 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-81d74c8b-15da-464e-8f22-aa60fe31ae34 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:12.071734 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-81d74c8b-15da-464e-8f22-aa60fe31ae34 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:12.074694 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-81d74c8b-15da-464e-8f22-aa60fe31ae34 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:12.077711 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-81d74c8b-15da-464e-8f22-aa60fe31ae34 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:12.078181 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-81d74c8b-15da-464e-8f22-aa60fe31ae34 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:12.221300 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-81d74c8b-15da-464e-8f22-aa60fe31ae34 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:12.235117 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-81d74c8b-15da-464e-8f22-aa60fe31ae34 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:12.237093 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-81d74c8b-15da-464e-8f22-aa60fe31ae34 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:12.238962 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-81d74c8b-15da-464e-8f22-aa60fe31ae34 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] 10.222.0.43 "GET /compute/v2.1/servers/02a066b4-243b-4fe3-afcf-30f3e9511d1b" status: 200 len: 1605 microversion: 2.42 time: 0.195928 Oct 04 19:00:12.256588 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2879/5403] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:00:12 2022] GET /compute/v2.1/servers/02a066b4-243b-4fe3-afcf-30f3e9511d1b => generated 1605 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:00:12.514579 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-b082ca06-b2b7-4e9c-925c-f6adbfd1efaf tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:12.517203 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-b082ca06-b2b7-4e9c-925c-f6adbfd1efaf tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] [instance: 0ab8644c-b040-46c1-913b-46d595bde978] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:12.546514 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b082ca06-b2b7-4e9c-925c-f6adbfd1efaf tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:12.550844 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b082ca06-b2b7-4e9c-925c-f6adbfd1efaf tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:12.555987 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b082ca06-b2b7-4e9c-925c-f6adbfd1efaf tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:12.558746 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b082ca06-b2b7-4e9c-925c-f6adbfd1efaf tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:12.561845 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b082ca06-b2b7-4e9c-925c-f6adbfd1efaf tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:12.564659 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b082ca06-b2b7-4e9c-925c-f6adbfd1efaf tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:12.597908 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-857a7881-0765-490c-8fa7-3a3bcf62d34f tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:12.598841 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-857a7881-0765-490c-8fa7-3a3bcf62d34f tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: 37f52fe0-438c-41f3-9142-8c171e80385d] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:12.622871 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-b082ca06-b2b7-4e9c-925c-f6adbfd1efaf tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] HTTP exception thrown: Instance 0ab8644c-b040-46c1-913b-46d595bde978 could not be found. Oct 04 19:00:12.626199 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-857a7881-0765-490c-8fa7-3a3bcf62d34f tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:12.626967 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-857a7881-0765-490c-8fa7-3a3bcf62d34f tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:12.627839 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-857a7881-0765-490c-8fa7-3a3bcf62d34f tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:12.630720 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-857a7881-0765-490c-8fa7-3a3bcf62d34f tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:12.632372 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-857a7881-0765-490c-8fa7-3a3bcf62d34f tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:12.633931 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-857a7881-0765-490c-8fa7-3a3bcf62d34f tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:12.634513 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-b082ca06-b2b7-4e9c-925c-f6adbfd1efaf tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Request method failure captured: Oct 04 19:00:12.634513 n-d-851028-13 devstack@n-api.service[123595]: request: DELETE /compute/v2.1/servers/0ab8644c-b040-46c1-913b-46d595bde978 HTTP/1.1 Oct 04 19:00:12.634513 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 19:00:12.634513 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 19:00:12.634513 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 19:00:12.634513 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 0 Oct 04 19:00:12.634513 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 19:00:12.634513 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 19:00:12.634513 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 19:00:12.634513 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 19:00:12.634513 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPID78vmCI9IDPSneDizdTNDV6DvHA8Yu-0Hk2AdriQTEcsN9glvSb6qnq0IhhwuZEnTcyOqvR3DmN0AjQb3MXy0KeUN-iyujvPMDrfVKCEbIzKf9nHEoBLFpzOTLVQVrEHVpIwmUAw_LxUeBUjShHQb88Tzo0W7pmPF365n3rwKGYEI Oct 04 19:00:12.634513 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 19:00:12.634513 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 19:00:12.634513 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 19:00:12.634513 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 19:00:12.634513 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 19:00:12.634513 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 19:00:12.634513 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: 6c91c7e7358048ffaaee7f51ad61b515 Oct 04 19:00:12.634513 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-AttachVolumeNegativeTest-2048626205 Oct 04 19:00:12.634513 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 19:00:12.634513 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 19:00:12.634513 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/6c91c7e7358048ffaaee7f51ad61b515"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_6c91c7e7358048ffaaee7f51ad61b515"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/6c91c7e7358048ffaaee7f51ad61b515"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/6c91c7e7358048ffaaee7f51ad61b515"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 19:00:12.634513 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-AttachVolumeNegativeTest-2048626205 Oct 04 19:00:12.634513 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: 6c91c7e7358048ffaaee7f51ad61b515 Oct 04 19:00:12.634513 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2048626205 Oct 04 19:00:12.634513 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-AttachVolumeNegativeTest-2048626205-project Oct 04 19:00:12.634513 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 19:00:12.634513 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 19:00:12.634513 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: 486c22456b1e47ae843ae41f8dfb2632 Oct 04 19:00:12.634513 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-AttachVolumeNegativeTest-2048626205-project Oct 04 19:00:12.634513 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 19:00:12.634513 n-d-851028-13 devstack@n-api.service[123595]: exception: Instance 0ab8644c-b040-46c1-913b-46d595bde978 could not be found. Oct 04 19:00:12.634513 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': '0ab8644c-b040-46c1-913b-46d595bde978'} Oct 04 19:00:12.634513 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:00:12.634513 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:00:12.634513 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:00:12.634513 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:00:12.634513 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:00:12.634513 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:00:12.634513 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:00:12.634513 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:00:12.634513 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:00:12.634513 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:00:12.634513 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ab8644c-b040-46c1-913b-46d595bde978 could not be found. Oct 04 19:00:12.634513 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:00:12.634513 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:00:12.634513 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:00:12.634513 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:00:12.634513 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:00:12.634513 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:00:12.634513 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:00:12.634513 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:00:12.634513 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:00:12.634513 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:00:12.634513 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 19:00:12.634513 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 19:00:12.634513 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 19:00:12.634513 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 19:00:12.634513 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:00:12.634513 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:00:12.634513 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:00:12.634513 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:00:12.638743 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ab8644c-b040-46c1-913b-46d595bde978 could not be found. Oct 04 19:00:12.638743 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:00:12.638743 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:00:12.638743 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:00:12.638743 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:00:12.638743 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:00:12.638743 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:00:12.638743 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:00:12.638743 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:00:12.638743 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ab8644c-b040-46c1-913b-46d595bde978 could not be found. Oct 04 19:00:12.638743 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:00:12.638743 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-b082ca06-b2b7-4e9c-925c-f6adbfd1efaf tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Returning 404 to user: Instance 0ab8644c-b040-46c1-913b-46d595bde978 could not be found. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:00:12.638743 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-b082ca06-b2b7-4e9c-925c-f6adbfd1efaf tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] 10.222.0.43 "DELETE /compute/v2.1/servers/0ab8644c-b040-46c1-913b-46d595bde978" status: 404 len: 111 microversion: 2.1 time: 0.134052 Oct 04 19:00:12.638743 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2525/5404] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 19:00:12 2022] DELETE /compute/v2.1/servers/0ab8644c-b040-46c1-913b-46d595bde978 => generated 111 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:00:12.671728 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-c1a50683-6b56-45b8-8a16-eb9fd82e4c4f tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:12.673060 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-c1a50683-6b56-45b8-8a16-eb9fd82e4c4f tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] [instance: 0ab8644c-b040-46c1-913b-46d595bde978] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:12.684362 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:00:12.691672 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c1a50683-6b56-45b8-8a16-eb9fd82e4c4f tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:12.692610 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c1a50683-6b56-45b8-8a16-eb9fd82e4c4f tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:12.693382 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c1a50683-6b56-45b8-8a16-eb9fd82e4c4f tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:12.697937 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c1a50683-6b56-45b8-8a16-eb9fd82e4c4f tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:12.700355 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c1a50683-6b56-45b8-8a16-eb9fd82e4c4f tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:12.701151 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c1a50683-6b56-45b8-8a16-eb9fd82e4c4f tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:12.746446 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-c1a50683-6b56-45b8-8a16-eb9fd82e4c4f tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] HTTP exception thrown: Instance 0ab8644c-b040-46c1-913b-46d595bde978 could not be found. Oct 04 19:00:12.753168 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-c1a50683-6b56-45b8-8a16-eb9fd82e4c4f tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Request method failure captured: Oct 04 19:00:12.753168 n-d-851028-13 devstack@n-api.service[123595]: request: GET /compute/v2.1/servers/0ab8644c-b040-46c1-913b-46d595bde978 HTTP/1.1 Oct 04 19:00:12.753168 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 19:00:12.753168 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 19:00:12.753168 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 19:00:12.753168 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 0 Oct 04 19:00:12.753168 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 19:00:12.753168 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 19:00:12.753168 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 19:00:12.753168 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 19:00:12.753168 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPID78vmCI9IDPSneDizdTNDV6DvHA8Yu-0Hk2AdriQTEcsN9glvSb6qnq0IhhwuZEnTcyOqvR3DmN0AjQb3MXy0KeUN-iyujvPMDrfVKCEbIzKf9nHEoBLFpzOTLVQVrEHVpIwmUAw_LxUeBUjShHQb88Tzo0W7pmPF365n3rwKGYEI Oct 04 19:00:12.753168 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 19:00:12.753168 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 19:00:12.753168 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 19:00:12.753168 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 19:00:12.753168 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 19:00:12.753168 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 19:00:12.753168 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: 6c91c7e7358048ffaaee7f51ad61b515 Oct 04 19:00:12.753168 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-AttachVolumeNegativeTest-2048626205 Oct 04 19:00:12.753168 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 19:00:12.753168 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 19:00:12.753168 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/6c91c7e7358048ffaaee7f51ad61b515"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_6c91c7e7358048ffaaee7f51ad61b515"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/6c91c7e7358048ffaaee7f51ad61b515"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/6c91c7e7358048ffaaee7f51ad61b515"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 19:00:12.753168 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-AttachVolumeNegativeTest-2048626205 Oct 04 19:00:12.753168 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: 6c91c7e7358048ffaaee7f51ad61b515 Oct 04 19:00:12.753168 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2048626205 Oct 04 19:00:12.753168 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-AttachVolumeNegativeTest-2048626205-project Oct 04 19:00:12.753168 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 19:00:12.753168 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 19:00:12.753168 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: 486c22456b1e47ae843ae41f8dfb2632 Oct 04 19:00:12.753168 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-AttachVolumeNegativeTest-2048626205-project Oct 04 19:00:12.753168 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 19:00:12.753168 n-d-851028-13 devstack@n-api.service[123595]: exception: Instance 0ab8644c-b040-46c1-913b-46d595bde978 could not be found. Oct 04 19:00:12.753168 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': '0ab8644c-b040-46c1-913b-46d595bde978'} Oct 04 19:00:12.753168 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:00:12.753168 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:00:12.753168 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:00:12.753168 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:00:12.753168 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:00:12.753168 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:00:12.753168 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:00:12.753168 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:00:12.753168 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:00:12.753168 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:00:12.753168 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ab8644c-b040-46c1-913b-46d595bde978 could not be found. Oct 04 19:00:12.753168 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:00:12.753168 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:00:12.753168 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:00:12.753168 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:00:12.753168 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:00:12.753168 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:00:12.753168 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:00:12.753168 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:00:12.753168 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:00:12.753168 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:00:12.753168 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:00:12.753168 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:00:12.753168 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:00:12.753168 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:00:12.753168 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:00:12.753168 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:00:12.753168 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ab8644c-b040-46c1-913b-46d595bde978 could not be found. Oct 04 19:00:12.753168 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:00:12.753168 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:00:12.753168 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:00:12.760370 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:00:12.760370 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:00:12.760370 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:00:12.760370 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:00:12.760370 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:00:12.760370 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ab8644c-b040-46c1-913b-46d595bde978 could not be found. Oct 04 19:00:12.760370 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:00:12.760370 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-c1a50683-6b56-45b8-8a16-eb9fd82e4c4f tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Returning 404 to user: Instance 0ab8644c-b040-46c1-913b-46d595bde978 could not be found. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:00:12.762786 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-c1a50683-6b56-45b8-8a16-eb9fd82e4c4f tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] 10.222.0.43 "GET /compute/v2.1/servers/0ab8644c-b040-46c1-913b-46d595bde978" status: 404 len: 111 microversion: 2.1 time: 0.107594 Oct 04 19:00:12.763166 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2526/5405] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:00:12 2022] GET /compute/v2.1/servers/0ab8644c-b040-46c1-913b-46d595bde978 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:00:12.904645 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-857a7881-0765-490c-8fa7-3a3bcf62d34f tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c997bc60473b43fd9fcf0c65111c44c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a711601b7a439caf395233de1febff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:12.916042 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-857a7881-0765-490c-8fa7-3a3bcf62d34f tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "GET /compute/v2.1/servers/37f52fe0-438c-41f3-9142-8c171e80385d" status: 200 len: 1501 microversion: 2.1 time: 0.322670 Oct 04 19:00:12.920167 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2880/5406] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:00:12 2022] GET /compute/v2.1/servers/37f52fe0-438c-41f3-9142-8c171e80385d => generated 1501 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:00:12.944386 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-d6e47d9a-d909-439b-8555-a9383026e1b1 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:12.945228 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-d6e47d9a-d909-439b-8555-a9383026e1b1 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: 37f52fe0-438c-41f3-9142-8c171e80385d] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:12.954548 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d6e47d9a-d909-439b-8555-a9383026e1b1 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:12.956870 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d6e47d9a-d909-439b-8555-a9383026e1b1 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:12.959119 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d6e47d9a-d909-439b-8555-a9383026e1b1 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:12.960661 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d6e47d9a-d909-439b-8555-a9383026e1b1 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:12.967231 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d6e47d9a-d909-439b-8555-a9383026e1b1 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:12.968603 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d6e47d9a-d909-439b-8555-a9383026e1b1 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:13.021806 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-d6e47d9a-d909-439b-8555-a9383026e1b1 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: 37f52fe0-438c-41f3-9142-8c171e80385d] Going to try to terminate instance {{(pid=123595) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 19:00:13.146504 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-d6e47d9a-d909-439b-8555-a9383026e1b1 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "DELETE /compute/v2.1/servers/37f52fe0-438c-41f3-9142-8c171e80385d" status: 204 len: 0 microversion: 2.1 time: 0.207333 Oct 04 19:00:13.147615 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2527/5407] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 19:00:12 2022] DELETE /compute/v2.1/servers/37f52fe0-438c-41f3-9142-8c171e80385d => generated 0 bytes in 210 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:00:13.156591 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-5a74a824-7efe-4d2e-bf6a-353368ff2173 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:13.157986 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-5a74a824-7efe-4d2e-bf6a-353368ff2173 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: 37f52fe0-438c-41f3-9142-8c171e80385d] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:13.167826 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5a74a824-7efe-4d2e-bf6a-353368ff2173 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:13.168817 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5a74a824-7efe-4d2e-bf6a-353368ff2173 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:13.169534 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5a74a824-7efe-4d2e-bf6a-353368ff2173 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:13.170435 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5a74a824-7efe-4d2e-bf6a-353368ff2173 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:13.171081 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5a74a824-7efe-4d2e-bf6a-353368ff2173 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:13.171940 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5a74a824-7efe-4d2e-bf6a-353368ff2173 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:13.268342 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-e017cb1b-604a-4cc6-ace3-4534ddb40782 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:13.269335 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-e017cb1b-604a-4cc6-ace3-4534ddb40782 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] [instance: 02a066b4-243b-4fe3-afcf-30f3e9511d1b] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:13.281149 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e017cb1b-604a-4cc6-ace3-4534ddb40782 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:13.281824 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e017cb1b-604a-4cc6-ace3-4534ddb40782 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:13.282359 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e017cb1b-604a-4cc6-ace3-4534ddb40782 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:13.287587 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e017cb1b-604a-4cc6-ace3-4534ddb40782 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:13.288256 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e017cb1b-604a-4cc6-ace3-4534ddb40782 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:13.288884 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e017cb1b-604a-4cc6-ace3-4534ddb40782 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:13.392897 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-5a74a824-7efe-4d2e-bf6a-353368ff2173 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c997bc60473b43fd9fcf0c65111c44c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a711601b7a439caf395233de1febff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:13.398649 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-e017cb1b-604a-4cc6-ace3-4534ddb40782 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:13.408384 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-5a74a824-7efe-4d2e-bf6a-353368ff2173 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "GET /compute/v2.1/servers/37f52fe0-438c-41f3-9142-8c171e80385d" status: 200 len: 1507 microversion: 2.1 time: 0.256585 Oct 04 19:00:13.408996 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2881/5408] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:00:13 2022] GET /compute/v2.1/servers/37f52fe0-438c-41f3-9142-8c171e80385d => generated 1507 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:00:13.409721 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-e017cb1b-604a-4cc6-ace3-4534ddb40782 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:13.411772 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-e017cb1b-604a-4cc6-ace3-4534ddb40782 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:13.413355 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-e017cb1b-604a-4cc6-ace3-4534ddb40782 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] 10.222.0.43 "GET /compute/v2.1/servers/02a066b4-243b-4fe3-afcf-30f3e9511d1b" status: 200 len: 1605 microversion: 2.42 time: 0.150936 Oct 04 19:00:13.427331 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2528/5409] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:00:13 2022] GET /compute/v2.1/servers/02a066b4-243b-4fe3-afcf-30f3e9511d1b => generated 1605 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 19:00:14.433474 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-4164b922-6b08-449c-a89b-d00dc6e62926 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:14.435620 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-4164b922-6b08-449c-a89b-d00dc6e62926 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: 37f52fe0-438c-41f3-9142-8c171e80385d] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:14.440494 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-306d8ef5-f76e-4c3b-8e6b-91b52bb3aec3 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:14.441134 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-306d8ef5-f76e-4c3b-8e6b-91b52bb3aec3 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] [instance: 02a066b4-243b-4fe3-afcf-30f3e9511d1b] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:14.446047 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4164b922-6b08-449c-a89b-d00dc6e62926 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:14.446762 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4164b922-6b08-449c-a89b-d00dc6e62926 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:14.447368 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4164b922-6b08-449c-a89b-d00dc6e62926 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:14.449545 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4164b922-6b08-449c-a89b-d00dc6e62926 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:14.450183 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4164b922-6b08-449c-a89b-d00dc6e62926 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:14.450816 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4164b922-6b08-449c-a89b-d00dc6e62926 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:14.460675 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-306d8ef5-f76e-4c3b-8e6b-91b52bb3aec3 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:14.462199 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-306d8ef5-f76e-4c3b-8e6b-91b52bb3aec3 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:14.462811 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-306d8ef5-f76e-4c3b-8e6b-91b52bb3aec3 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:14.463699 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-306d8ef5-f76e-4c3b-8e6b-91b52bb3aec3 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:14.464352 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-306d8ef5-f76e-4c3b-8e6b-91b52bb3aec3 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:14.464939 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-306d8ef5-f76e-4c3b-8e6b-91b52bb3aec3 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:14.575071 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-306d8ef5-f76e-4c3b-8e6b-91b52bb3aec3 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:14.588222 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-306d8ef5-f76e-4c3b-8e6b-91b52bb3aec3 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:14.590170 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-306d8ef5-f76e-4c3b-8e6b-91b52bb3aec3 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:14.592159 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-306d8ef5-f76e-4c3b-8e6b-91b52bb3aec3 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] 10.222.0.43 "GET /compute/v2.1/servers/02a066b4-243b-4fe3-afcf-30f3e9511d1b" status: 200 len: 1605 microversion: 2.42 time: 0.155475 Oct 04 19:00:14.593568 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2529/5410] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:00:14 2022] GET /compute/v2.1/servers/02a066b4-243b-4fe3-afcf-30f3e9511d1b => generated 1605 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:00:14.762945 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-4164b922-6b08-449c-a89b-d00dc6e62926 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c997bc60473b43fd9fcf0c65111c44c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a711601b7a439caf395233de1febff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:14.774132 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-4164b922-6b08-449c-a89b-d00dc6e62926 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "GET /compute/v2.1/servers/37f52fe0-438c-41f3-9142-8c171e80385d" status: 200 len: 1507 microversion: 2.1 time: 0.346959 Oct 04 19:00:14.775366 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2882/5411] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:00:14 2022] GET /compute/v2.1/servers/37f52fe0-438c-41f3-9142-8c171e80385d => generated 1507 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:00:15.621261 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-d753507d-18b5-47a6-8d7d-651567b940e3 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:15.622595 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-d753507d-18b5-47a6-8d7d-651567b940e3 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] [instance: 02a066b4-243b-4fe3-afcf-30f3e9511d1b] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:15.629557 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d753507d-18b5-47a6-8d7d-651567b940e3 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:15.630435 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d753507d-18b5-47a6-8d7d-651567b940e3 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:15.631090 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d753507d-18b5-47a6-8d7d-651567b940e3 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:15.632054 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d753507d-18b5-47a6-8d7d-651567b940e3 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:15.632741 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d753507d-18b5-47a6-8d7d-651567b940e3 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:15.633953 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d753507d-18b5-47a6-8d7d-651567b940e3 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:15.756804 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-d753507d-18b5-47a6-8d7d-651567b940e3 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:15.774201 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-d753507d-18b5-47a6-8d7d-651567b940e3 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:15.778346 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-d753507d-18b5-47a6-8d7d-651567b940e3 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:15.780893 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-d753507d-18b5-47a6-8d7d-651567b940e3 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] 10.222.0.43 "GET /compute/v2.1/servers/02a066b4-243b-4fe3-afcf-30f3e9511d1b" status: 200 len: 1605 microversion: 2.42 time: 0.165145 Oct 04 19:00:15.785216 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2530/5412] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:00:15 2022] GET /compute/v2.1/servers/02a066b4-243b-4fe3-afcf-30f3e9511d1b => generated 1605 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:00:15.808054 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-8c430ae6-962b-491a-b6e3-1e8bd87cf3bc tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:15.808683 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-8c430ae6-962b-491a-b6e3-1e8bd87cf3bc tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: 37f52fe0-438c-41f3-9142-8c171e80385d] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:15.815957 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8c430ae6-962b-491a-b6e3-1e8bd87cf3bc tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:15.816700 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8c430ae6-962b-491a-b6e3-1e8bd87cf3bc tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:15.817591 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8c430ae6-962b-491a-b6e3-1e8bd87cf3bc tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:15.818473 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8c430ae6-962b-491a-b6e3-1e8bd87cf3bc tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:15.819097 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8c430ae6-962b-491a-b6e3-1e8bd87cf3bc tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:15.819940 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8c430ae6-962b-491a-b6e3-1e8bd87cf3bc tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:16.206416 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-8c430ae6-962b-491a-b6e3-1e8bd87cf3bc tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c997bc60473b43fd9fcf0c65111c44c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a711601b7a439caf395233de1febff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:16.220342 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-8c430ae6-962b-491a-b6e3-1e8bd87cf3bc tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "GET /compute/v2.1/servers/37f52fe0-438c-41f3-9142-8c171e80385d" status: 200 len: 1507 microversion: 2.1 time: 0.417679 Oct 04 19:00:16.224154 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2883/5413] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:00:15 2022] GET /compute/v2.1/servers/37f52fe0-438c-41f3-9142-8c171e80385d => generated 1507 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:00:16.754545 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-1612cc76-8e1f-4452-b999-9e32056edc81 req-21e26ad1-ca59-4917-b21a-58a54106fad3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37f52fe0-438c-41f3-9142-8c171e80385d", "name": "network-vif-deleted", "tag": "87b2efb4-1d0c-4d0e-8dcd-63fb77b93fb8"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:00:16.788361 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-1612cc76-8e1f-4452-b999-9e32056edc81 req-21e26ad1-ca59-4917-b21a-58a54106fad3 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:16.788894 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-1612cc76-8e1f-4452-b999-9e32056edc81 req-21e26ad1-ca59-4917-b21a-58a54106fad3 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:16.790110 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-1612cc76-8e1f-4452-b999-9e32056edc81 req-21e26ad1-ca59-4917-b21a-58a54106fad3 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:16.810157 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-c0114e55-2748-4259-a71b-0b8688ec3de5 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:16.811478 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-c0114e55-2748-4259-a71b-0b8688ec3de5 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] [instance: 02a066b4-243b-4fe3-afcf-30f3e9511d1b] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:16.826363 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-1612cc76-8e1f-4452-b999-9e32056edc81 req-21e26ad1-ca59-4917-b21a-58a54106fad3 service nova] Creating event network-vif-deleted:87b2efb4-1d0c-4d0e-8dcd-63fb77b93fb8 for instance 37f52fe0-438c-41f3-9142-8c171e80385d on n-h1-851028-13 Oct 04 19:00:16.835725 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c0114e55-2748-4259-a71b-0b8688ec3de5 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:16.838412 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c0114e55-2748-4259-a71b-0b8688ec3de5 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:16.841951 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c0114e55-2748-4259-a71b-0b8688ec3de5 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:16.844177 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c0114e55-2748-4259-a71b-0b8688ec3de5 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:16.847003 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c0114e55-2748-4259-a71b-0b8688ec3de5 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:16.847994 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-1612cc76-8e1f-4452-b999-9e32056edc81 req-21e26ad1-ca59-4917-b21a-58a54106fad3 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097378 Oct 04 19:00:16.853400 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c0114e55-2748-4259-a71b-0b8688ec3de5 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:16.859905 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2531/5414] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:00:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:00:17.026317 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-c0114e55-2748-4259-a71b-0b8688ec3de5 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:17.042435 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-c0114e55-2748-4259-a71b-0b8688ec3de5 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:17.048439 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-c0114e55-2748-4259-a71b-0b8688ec3de5 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:17.058411 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-c0114e55-2748-4259-a71b-0b8688ec3de5 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] 10.222.0.43 "GET /compute/v2.1/servers/02a066b4-243b-4fe3-afcf-30f3e9511d1b" status: 200 len: 1605 microversion: 2.42 time: 0.245139 Oct 04 19:00:17.068398 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2884/5415] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:00:16 2022] GET /compute/v2.1/servers/02a066b4-243b-4fe3-afcf-30f3e9511d1b => generated 1605 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 19:00:17.256269 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-7a3dcb12-512b-4f73-819b-785a19adbda2 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:17.257055 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-7a3dcb12-512b-4f73-819b-785a19adbda2 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: 37f52fe0-438c-41f3-9142-8c171e80385d] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:17.313079 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-679ea0d4-eea9-43fc-88f6-94c1ccb90577 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:17.313935 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-679ea0d4-eea9-43fc-88f6-94c1ccb90577 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] [instance: f2d96060-bc2d-461c-9705-67a3845451ef] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:17.328096 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7a3dcb12-512b-4f73-819b-785a19adbda2 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:17.338233 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7a3dcb12-512b-4f73-819b-785a19adbda2 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:17.342891 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7a3dcb12-512b-4f73-819b-785a19adbda2 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:17.345490 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-679ea0d4-eea9-43fc-88f6-94c1ccb90577 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:17.346982 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7a3dcb12-512b-4f73-819b-785a19adbda2 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:17.349511 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-679ea0d4-eea9-43fc-88f6-94c1ccb90577 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:17.350644 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-679ea0d4-eea9-43fc-88f6-94c1ccb90577 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:17.352602 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7a3dcb12-512b-4f73-819b-785a19adbda2 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:17.353632 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7a3dcb12-512b-4f73-819b-785a19adbda2 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:17.354438 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-679ea0d4-eea9-43fc-88f6-94c1ccb90577 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:17.359056 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-679ea0d4-eea9-43fc-88f6-94c1ccb90577 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:17.361651 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-679ea0d4-eea9-43fc-88f6-94c1ccb90577 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:17.444287 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-679ea0d4-eea9-43fc-88f6-94c1ccb90577 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] [instance: f2d96060-bc2d-461c-9705-67a3845451ef] Going to try to terminate instance {{(pid=123596) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 19:00:17.468411 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7a3dcb12-512b-4f73-819b-785a19adbda2 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:17.469133 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7a3dcb12-512b-4f73-819b-785a19adbda2 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:17.469837 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7a3dcb12-512b-4f73-819b-785a19adbda2 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:17.470737 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.objects.instance [None req-7a3dcb12-512b-4f73-819b-785a19adbda2 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lazy-loading 'fault' on Instance uuid 37f52fe0-438c-41f3-9142-8c171e80385d {{(pid=123595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 19:00:17.473268 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:00:17.585595 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-7a3dcb12-512b-4f73-819b-785a19adbda2 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c997bc60473b43fd9fcf0c65111c44c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a711601b7a439caf395233de1febff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:17.598375 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-7a3dcb12-512b-4f73-819b-785a19adbda2 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "GET /compute/v2.1/servers/37f52fe0-438c-41f3-9142-8c171e80385d" status: 200 len: 1305 microversion: 2.1 time: 0.347079 Oct 04 19:00:17.601993 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2532/5416] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:00:17 2022] GET /compute/v2.1/servers/37f52fe0-438c-41f3-9142-8c171e80385d => generated 1305 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:00:17.661899 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-679ea0d4-eea9-43fc-88f6-94c1ccb90577 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] 10.222.0.43 "DELETE /compute/v2.1/servers/f2d96060-bc2d-461c-9705-67a3845451ef" status: 204 len: 0 microversion: 2.1 time: 0.358262 Oct 04 19:00:17.666095 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2885/5417] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 19:00:17 2022] DELETE /compute/v2.1/servers/f2d96060-bc2d-461c-9705-67a3845451ef => generated 0 bytes in 360 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:00:17.672070 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-6c88dbfd-4aa3-4985-8eab-4f86c014ab26 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:17.673333 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-6c88dbfd-4aa3-4985-8eab-4f86c014ab26 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] [instance: f2d96060-bc2d-461c-9705-67a3845451ef] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:17.685373 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6c88dbfd-4aa3-4985-8eab-4f86c014ab26 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:17.686204 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6c88dbfd-4aa3-4985-8eab-4f86c014ab26 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:17.686856 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6c88dbfd-4aa3-4985-8eab-4f86c014ab26 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:17.688335 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6c88dbfd-4aa3-4985-8eab-4f86c014ab26 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:17.688995 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6c88dbfd-4aa3-4985-8eab-4f86c014ab26 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:17.689477 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6c88dbfd-4aa3-4985-8eab-4f86c014ab26 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:17.937229 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-6c88dbfd-4aa3-4985-8eab-4f86c014ab26 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1bb492fb294837b1e55d58bbfa3d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a4c327763b4440a9dc456cfbb31f88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:17.948222 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-6c88dbfd-4aa3-4985-8eab-4f86c014ab26 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] 10.222.0.43 "GET /compute/v2.1/servers/f2d96060-bc2d-461c-9705-67a3845451ef" status: 200 len: 1552 microversion: 2.1 time: 0.280567 Oct 04 19:00:17.949671 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2533/5418] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:00:17 2022] GET /compute/v2.1/servers/f2d96060-bc2d-461c-9705-67a3845451ef => generated 1552 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:00:18.088882 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-a7a2238e-4e40-4022-92fc-7b57d3cc5618 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:18.089638 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-a7a2238e-4e40-4022-92fc-7b57d3cc5618 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] [instance: 02a066b4-243b-4fe3-afcf-30f3e9511d1b] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:18.102989 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a7a2238e-4e40-4022-92fc-7b57d3cc5618 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:18.106346 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a7a2238e-4e40-4022-92fc-7b57d3cc5618 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:18.106993 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a7a2238e-4e40-4022-92fc-7b57d3cc5618 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:18.112256 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a7a2238e-4e40-4022-92fc-7b57d3cc5618 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:18.113170 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a7a2238e-4e40-4022-92fc-7b57d3cc5618 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:18.113820 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a7a2238e-4e40-4022-92fc-7b57d3cc5618 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:18.257080 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-a7a2238e-4e40-4022-92fc-7b57d3cc5618 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:18.275767 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-a7a2238e-4e40-4022-92fc-7b57d3cc5618 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:18.282347 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-a7a2238e-4e40-4022-92fc-7b57d3cc5618 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:18.290425 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-a7a2238e-4e40-4022-92fc-7b57d3cc5618 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] 10.222.0.43 "GET /compute/v2.1/servers/02a066b4-243b-4fe3-afcf-30f3e9511d1b" status: 200 len: 1605 microversion: 2.42 time: 0.205486 Oct 04 19:00:18.291195 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2886/5419] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:00:18 2022] GET /compute/v2.1/servers/02a066b4-243b-4fe3-afcf-30f3e9511d1b => generated 1605 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:00:18.630000 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-aadeaafa-3303-4b90-b9d6-6136686c0ea6 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:18.631242 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-aadeaafa-3303-4b90-b9d6-6136686c0ea6 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: 37f52fe0-438c-41f3-9142-8c171e80385d] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:18.647637 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-aadeaafa-3303-4b90-b9d6-6136686c0ea6 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:18.651961 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-aadeaafa-3303-4b90-b9d6-6136686c0ea6 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:18.652465 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-aadeaafa-3303-4b90-b9d6-6136686c0ea6 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:18.653589 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-aadeaafa-3303-4b90-b9d6-6136686c0ea6 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:18.655296 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-aadeaafa-3303-4b90-b9d6-6136686c0ea6 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:18.657034 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-aadeaafa-3303-4b90-b9d6-6136686c0ea6 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:18.697937 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-aadeaafa-3303-4b90-b9d6-6136686c0ea6 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] HTTP exception thrown: Instance 37f52fe0-438c-41f3-9142-8c171e80385d could not be found. Oct 04 19:00:18.703025 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-aadeaafa-3303-4b90-b9d6-6136686c0ea6 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Request method failure captured: Oct 04 19:00:18.703025 n-d-851028-13 devstack@n-api.service[123595]: request: GET /compute/v2.1/servers/37f52fe0-438c-41f3-9142-8c171e80385d HTTP/1.1 Oct 04 19:00:18.703025 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 19:00:18.703025 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 19:00:18.703025 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 19:00:18.703025 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 0 Oct 04 19:00:18.703025 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 19:00:18.703025 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 19:00:18.703025 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 19:00:18.703025 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 19:00:18.703025 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPIKl7r6ZFtp0u4zXtNLGIhqHo70GyUJnklFY8mLM6SAvqzMqMYlk7FNNMFRu1dxhVJoaHCY-KymtUU7SbzcnaY3gmI4NmuaRKJjk_WfnM3eNlWdo1XIjmy2xIfTxketrHpoedtH-76PD0N1ebOmJq-sWqhFc1j62MJ2QKuwEgYmouJ4 Oct 04 19:00:18.703025 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 19:00:18.703025 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 19:00:18.703025 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 19:00:18.703025 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 19:00:18.703025 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 19:00:18.703025 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 19:00:18.703025 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: a6a711601b7a439caf395233de1febff Oct 04 19:00:18.703025 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-DeleteServersTestJSON-591734195 Oct 04 19:00:18.703025 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 19:00:18.703025 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 19:00:18.703025 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/a6a711601b7a439caf395233de1febff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_a6a711601b7a439caf395233de1febff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a6a711601b7a439caf395233de1febff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a6a711601b7a439caf395233de1febff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 19:00:18.703025 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-DeleteServersTestJSON-591734195 Oct 04 19:00:18.703025 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: a6a711601b7a439caf395233de1febff Oct 04 19:00:18.703025 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-DeleteServersTestJSON-591734195 Oct 04 19:00:18.703025 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-DeleteServersTestJSON-591734195-project Oct 04 19:00:18.703025 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 19:00:18.703025 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 19:00:18.703025 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: c997bc60473b43fd9fcf0c65111c44c0 Oct 04 19:00:18.703025 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-DeleteServersTestJSON-591734195-project Oct 04 19:00:18.703025 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 19:00:18.703025 n-d-851028-13 devstack@n-api.service[123595]: exception: Instance 37f52fe0-438c-41f3-9142-8c171e80385d could not be found. Oct 04 19:00:18.703025 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': '37f52fe0-438c-41f3-9142-8c171e80385d'} Oct 04 19:00:18.703025 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:00:18.703025 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:00:18.703025 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:00:18.703025 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:00:18.703025 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:00:18.703025 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:00:18.703025 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:00:18.703025 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:00:18.703025 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:00:18.703025 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:00:18.703025 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37f52fe0-438c-41f3-9142-8c171e80385d could not be found. Oct 04 19:00:18.703025 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:00:18.703025 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:00:18.703025 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:00:18.703025 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:00:18.703025 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:00:18.703025 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:00:18.703025 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:00:18.703025 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:00:18.703025 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:00:18.703025 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:00:18.703025 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:00:18.703025 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:00:18.703025 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:00:18.703025 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:00:18.703025 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:00:18.703025 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:00:18.703025 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37f52fe0-438c-41f3-9142-8c171e80385d could not be found. Oct 04 19:00:18.703025 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:00:18.703025 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:00:18.703025 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:00:18.706731 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:00:18.706731 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:00:18.706731 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:00:18.706731 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:00:18.706731 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:00:18.706731 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37f52fe0-438c-41f3-9142-8c171e80385d could not be found. Oct 04 19:00:18.706731 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:00:18.711989 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-aadeaafa-3303-4b90-b9d6-6136686c0ea6 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Returning 404 to user: Instance 37f52fe0-438c-41f3-9142-8c171e80385d could not be found. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:00:18.713411 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-aadeaafa-3303-4b90-b9d6-6136686c0ea6 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "GET /compute/v2.1/servers/37f52fe0-438c-41f3-9142-8c171e80385d" status: 404 len: 111 microversion: 2.1 time: 0.090876 Oct 04 19:00:18.737647 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2534/5420] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:00:18 2022] GET /compute/v2.1/servers/37f52fe0-438c-41f3-9142-8c171e80385d => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:00:18.919677 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-417f4a81-b4a3-468f-9fd4-182ae880feca tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1957175101", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452", "networks": [{"uuid": "dcd99798-7080-4c74-b648-36288a298add"}]}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:00:18.973038 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-50bb746a-c21b-46e3-b01f-15383d5c5d9d tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:18.973815 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-50bb746a-c21b-46e3-b01f-15383d5c5d9d tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] [instance: f2d96060-bc2d-461c-9705-67a3845451ef] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:18.988970 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-50bb746a-c21b-46e3-b01f-15383d5c5d9d tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:18.992624 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-50bb746a-c21b-46e3-b01f-15383d5c5d9d tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:18.993533 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-50bb746a-c21b-46e3-b01f-15383d5c5d9d tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:18.994433 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-50bb746a-c21b-46e3-b01f-15383d5c5d9d tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:18.994995 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-50bb746a-c21b-46e3-b01f-15383d5c5d9d tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:18.998433 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-50bb746a-c21b-46e3-b01f-15383d5c5d9d tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:19.032424 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.network.neutron [None req-417f4a81-b4a3-468f-9fd4-182ae880feca tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] validate_networks() for [('dcd99798-7080-4c74-b648-36288a298add', None, None, None, None, None)] {{(pid=123596) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 19:00:19.456276 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-50bb746a-c21b-46e3-b01f-15383d5c5d9d tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1bb492fb294837b1e55d58bbfa3d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a4c327763b4440a9dc456cfbb31f88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:19.470922 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-50bb746a-c21b-46e3-b01f-15383d5c5d9d tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] 10.222.0.43 "GET /compute/v2.1/servers/f2d96060-bc2d-461c-9705-67a3845451ef" status: 200 len: 1552 microversion: 2.1 time: 0.500376 Oct 04 19:00:19.475009 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2535/5421] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:00:18 2022] GET /compute/v2.1/servers/f2d96060-bc2d-461c-9705-67a3845451ef => generated 1552 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:00:19.494913 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-c4adef24-958e-4f11-b020-c08fd99c90bf tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:19.495599 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-c4adef24-958e-4f11-b020-c08fd99c90bf tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] [instance: 02a066b4-243b-4fe3-afcf-30f3e9511d1b] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:19.511943 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c4adef24-958e-4f11-b020-c08fd99c90bf tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:19.512459 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c4adef24-958e-4f11-b020-c08fd99c90bf tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:19.518116 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c4adef24-958e-4f11-b020-c08fd99c90bf tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:19.519405 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c4adef24-958e-4f11-b020-c08fd99c90bf tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:19.520053 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c4adef24-958e-4f11-b020-c08fd99c90bf tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:19.520689 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c4adef24-958e-4f11-b020-c08fd99c90bf tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:19.787457 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-c4adef24-958e-4f11-b020-c08fd99c90bf tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:19.800793 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-c4adef24-958e-4f11-b020-c08fd99c90bf tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:19.811362 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-c4adef24-958e-4f11-b020-c08fd99c90bf tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:19.812781 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-c4adef24-958e-4f11-b020-c08fd99c90bf tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] 10.222.0.43 "GET /compute/v2.1/servers/02a066b4-243b-4fe3-afcf-30f3e9511d1b" status: 200 len: 1605 microversion: 2.42 time: 0.334466 Oct 04 19:00:19.832952 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2536/5422] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:00:19 2022] GET /compute/v2.1/servers/02a066b4-243b-4fe3-afcf-30f3e9511d1b => generated 1605 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:00:20.420121 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-a8ab0302-b9ee-466f-9b0a-171ed9f04500 req-9b1a50cd-0935-457f-8f2f-f0febffe03d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2d96060-bc2d-461c-9705-67a3845451ef", "name": "network-vif-deleted", "tag": "8bd347ce-362c-4fbe-9877-d6c2c942865a"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:00:20.431629 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-a8ab0302-b9ee-466f-9b0a-171ed9f04500 req-9b1a50cd-0935-457f-8f2f-f0febffe03d8 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:20.432411 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-a8ab0302-b9ee-466f-9b0a-171ed9f04500 req-9b1a50cd-0935-457f-8f2f-f0febffe03d8 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:20.433031 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-a8ab0302-b9ee-466f-9b0a-171ed9f04500 req-9b1a50cd-0935-457f-8f2f-f0febffe03d8 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:20.446888 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-a8ab0302-b9ee-466f-9b0a-171ed9f04500 req-9b1a50cd-0935-457f-8f2f-f0febffe03d8 service nova] Creating event network-vif-deleted:8bd347ce-362c-4fbe-9877-d6c2c942865a for instance f2d96060-bc2d-461c-9705-67a3845451ef on n-h1-851028-13 Oct 04 19:00:20.452188 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-a8ab0302-b9ee-466f-9b0a-171ed9f04500 req-9b1a50cd-0935-457f-8f2f-f0febffe03d8 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036187 Oct 04 19:00:20.453386 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2537/5423] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:00:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:00:20.504414 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-e546c7f4-afdf-4029-8d2f-d3b4c640d815 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:20.505335 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-417f4a81-b4a3-468f-9fd4-182ae880feca tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Flavor limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:00:20.505813 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-417f4a81-b4a3-468f-9fd4-182ae880feca tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Image limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:00:20.506054 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-e546c7f4-afdf-4029-8d2f-d3b4c640d815 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] [instance: f2d96060-bc2d-461c-9705-67a3845451ef] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:20.506231 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-417f4a81-b4a3-468f-9fd4-182ae880feca tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Flavor pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:00:20.506649 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-417f4a81-b4a3-468f-9fd4-182ae880feca tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Image pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:00:20.507067 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-417f4a81-b4a3-468f-9fd4-182ae880feca tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:00:20.517347 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e546c7f4-afdf-4029-8d2f-d3b4c640d815 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:20.523184 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-417f4a81-b4a3-468f-9fd4-182ae880feca tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:20.523723 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-417f4a81-b4a3-468f-9fd4-182ae880feca tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:20.524174 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-417f4a81-b4a3-468f-9fd4-182ae880feca tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:20.524841 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e546c7f4-afdf-4029-8d2f-d3b4c640d815 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:20.524955 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-417f4a81-b4a3-468f-9fd4-182ae880feca tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:20.525410 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-417f4a81-b4a3-468f-9fd4-182ae880feca tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:20.525847 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-417f4a81-b4a3-468f-9fd4-182ae880feca tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:20.526077 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e546c7f4-afdf-4029-8d2f-d3b4c640d815 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:20.527320 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e546c7f4-afdf-4029-8d2f-d3b4c640d815 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:20.528018 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e546c7f4-afdf-4029-8d2f-d3b4c640d815 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:20.528729 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e546c7f4-afdf-4029-8d2f-d3b4c640d815 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:20.577861 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-417f4a81-b4a3-468f-9fd4-182ae880feca tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Getting quotas for project a6a711601b7a439caf395233de1febff. Resources: {'ram', 'cores', 'instances'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:00:20.588468 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-417f4a81-b4a3-468f-9fd4-182ae880feca tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Getting quotas for user c997bc60473b43fd9fcf0c65111c44c0 and project a6a711601b7a439caf395233de1febff. Resources: {'ram', 'cores', 'instances'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:00:20.634655 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-417f4a81-b4a3-468f-9fd4-182ae880feca tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Going to run 1 instances... {{(pid=123596) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 19:00:20.639286 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-417f4a81-b4a3-468f-9fd4-182ae880feca tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: ff2c3740-6c13-4727-bd7f-ef56bba605de] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e8943ec5-4038-4d4b-b9b9-2415a79f5243',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123596) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 19:00:20.696531 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-e546c7f4-afdf-4029-8d2f-d3b4c640d815 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1bb492fb294837b1e55d58bbfa3d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a4c327763b4440a9dc456cfbb31f88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:20.706938 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-e546c7f4-afdf-4029-8d2f-d3b4c640d815 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] 10.222.0.43 "GET /compute/v2.1/servers/f2d96060-bc2d-461c-9705-67a3845451ef" status: 200 len: 1334 microversion: 2.1 time: 0.206042 Oct 04 19:00:20.710104 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2538/5424] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:00:20 2022] GET /compute/v2.1/servers/f2d96060-bc2d-461c-9705-67a3845451ef => generated 1334 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:00:20.734915 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-417f4a81-b4a3-468f-9fd4-182ae880feca tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.815025 Oct 04 19:00:20.736884 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2887/5425] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 19:00:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 1822 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 19:00:20.749530 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-4790e1af-fc52-43af-b7c0-c3039ce70c81 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:20.750556 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-4790e1af-fc52-43af-b7c0-c3039ce70c81 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: ff2c3740-6c13-4727-bd7f-ef56bba605de] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:20.847974 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-6ad10d96-b826-423d-adaa-31d744d246e7 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:20.849068 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-6ad10d96-b826-423d-adaa-31d744d246e7 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] [instance: 02a066b4-243b-4fe3-afcf-30f3e9511d1b] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:20.862237 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6ad10d96-b826-423d-adaa-31d744d246e7 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:20.863094 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6ad10d96-b826-423d-adaa-31d744d246e7 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:20.865048 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6ad10d96-b826-423d-adaa-31d744d246e7 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:20.866187 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6ad10d96-b826-423d-adaa-31d744d246e7 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:20.871926 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6ad10d96-b826-423d-adaa-31d744d246e7 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:20.872473 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6ad10d96-b826-423d-adaa-31d744d246e7 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:20.882858 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-4790e1af-fc52-43af-b7c0-c3039ce70c81 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c997bc60473b43fd9fcf0c65111c44c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a711601b7a439caf395233de1febff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:20.891170 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-4790e1af-fc52-43af-b7c0-c3039ce70c81 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "GET /compute/v2.1/servers/ff2c3740-6c13-4727-bd7f-ef56bba605de" status: 200 len: 1215 microversion: 2.1 time: 0.147101 Oct 04 19:00:20.897471 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2539/5426] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:00:20 2022] GET /compute/v2.1/servers/ff2c3740-6c13-4727-bd7f-ef56bba605de => generated 1215 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:00:21.097670 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-6ad10d96-b826-423d-adaa-31d744d246e7 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:21.116054 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-6ad10d96-b826-423d-adaa-31d744d246e7 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:21.126575 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-6ad10d96-b826-423d-adaa-31d744d246e7 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:21.131345 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-6ad10d96-b826-423d-adaa-31d744d246e7 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] 10.222.0.43 "GET /compute/v2.1/servers/02a066b4-243b-4fe3-afcf-30f3e9511d1b" status: 200 len: 1605 microversion: 2.42 time: 0.289400 Oct 04 19:00:21.134676 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2888/5427] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:00:20 2022] GET /compute/v2.1/servers/02a066b4-243b-4fe3-afcf-30f3e9511d1b => generated 1605 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 19:00:21.732820 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-5ff140eb-50a8-483a-b69f-f6cc69e65166 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:21.733650 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-5ff140eb-50a8-483a-b69f-f6cc69e65166 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] [instance: f2d96060-bc2d-461c-9705-67a3845451ef] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:21.743466 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5ff140eb-50a8-483a-b69f-f6cc69e65166 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:21.744201 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5ff140eb-50a8-483a-b69f-f6cc69e65166 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:21.744798 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5ff140eb-50a8-483a-b69f-f6cc69e65166 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:21.745755 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5ff140eb-50a8-483a-b69f-f6cc69e65166 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:21.746428 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5ff140eb-50a8-483a-b69f-f6cc69e65166 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:21.747065 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5ff140eb-50a8-483a-b69f-f6cc69e65166 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:21.762427 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-5ff140eb-50a8-483a-b69f-f6cc69e65166 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] HTTP exception thrown: Instance f2d96060-bc2d-461c-9705-67a3845451ef could not be found. Oct 04 19:00:21.764548 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-5ff140eb-50a8-483a-b69f-f6cc69e65166 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Request method failure captured: Oct 04 19:00:21.764548 n-d-851028-13 devstack@n-api.service[123595]: request: GET /compute/v2.1/servers/f2d96060-bc2d-461c-9705-67a3845451ef HTTP/1.1 Oct 04 19:00:21.764548 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 19:00:21.764548 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 19:00:21.764548 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 19:00:21.764548 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 0 Oct 04 19:00:21.764548 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 19:00:21.764548 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 19:00:21.764548 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 19:00:21.764548 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 19:00:21.764548 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPIIujzmbgnhbc79xmoqoHExspbgyH12GGkwkRMlz6Wk1fwNFn1e6GlOs3pSFHAbQBe7hSB4EwCSM1NbNoxM7YtIIvHYBABrrnKeiKHqo9RoOUqrLXsLMa-nwtPKL2I2nbSSkYfxI442WQXq8gqCf1KQPC_Nn5MfwtOvZw4RzsYhjvuo Oct 04 19:00:21.764548 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 19:00:21.764548 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 19:00:21.764548 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 19:00:21.764548 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 19:00:21.764548 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 19:00:21.764548 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 19:00:21.764548 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: 27a4c327763b4440a9dc456cfbb31f88 Oct 04 19:00:21.764548 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-TestNetworkBasicOps-1970804167 Oct 04 19:00:21.764548 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 19:00:21.764548 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 19:00:21.764548 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/27a4c327763b4440a9dc456cfbb31f88"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_27a4c327763b4440a9dc456cfbb31f88"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/27a4c327763b4440a9dc456cfbb31f88"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/27a4c327763b4440a9dc456cfbb31f88"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 19:00:21.764548 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-TestNetworkBasicOps-1970804167 Oct 04 19:00:21.764548 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: 27a4c327763b4440a9dc456cfbb31f88 Oct 04 19:00:21.764548 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-TestNetworkBasicOps-1970804167 Oct 04 19:00:21.764548 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-TestNetworkBasicOps-1970804167-project Oct 04 19:00:21.764548 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 19:00:21.764548 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 19:00:21.764548 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: fc1bb492fb294837b1e55d58bbfa3d0b Oct 04 19:00:21.764548 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-TestNetworkBasicOps-1970804167-project Oct 04 19:00:21.764548 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 19:00:21.764548 n-d-851028-13 devstack@n-api.service[123595]: exception: Instance f2d96060-bc2d-461c-9705-67a3845451ef could not be found. Oct 04 19:00:21.764548 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': 'f2d96060-bc2d-461c-9705-67a3845451ef'} Oct 04 19:00:21.764548 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:00:21.764548 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:00:21.764548 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:00:21.764548 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:00:21.764548 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:00:21.764548 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:00:21.764548 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:00:21.764548 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:00:21.764548 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:00:21.764548 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:00:21.764548 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2d96060-bc2d-461c-9705-67a3845451ef could not be found. Oct 04 19:00:21.764548 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:00:21.764548 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:00:21.764548 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:00:21.764548 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:00:21.764548 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:00:21.764548 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:00:21.764548 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:00:21.764548 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:00:21.764548 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:00:21.764548 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:00:21.764548 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:00:21.764548 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:00:21.764548 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:00:21.764548 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:00:21.764548 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:00:21.764548 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:00:21.764548 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2d96060-bc2d-461c-9705-67a3845451ef could not be found. Oct 04 19:00:21.764548 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:00:21.764548 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:00:21.764548 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:00:21.768870 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:00:21.768870 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:00:21.768870 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:00:21.768870 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:00:21.768870 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:00:21.768870 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2d96060-bc2d-461c-9705-67a3845451ef could not be found. Oct 04 19:00:21.768870 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:00:21.770969 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-5ff140eb-50a8-483a-b69f-f6cc69e65166 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Returning 404 to user: Instance f2d96060-bc2d-461c-9705-67a3845451ef could not be found. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:00:21.772113 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-5ff140eb-50a8-483a-b69f-f6cc69e65166 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] 10.222.0.43 "GET /compute/v2.1/servers/f2d96060-bc2d-461c-9705-67a3845451ef" status: 404 len: 111 microversion: 2.1 time: 0.043499 Oct 04 19:00:21.773958 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2540/5428] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:00:21 2022] GET /compute/v2.1/servers/f2d96060-bc2d-461c-9705-67a3845451ef => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:00:21.919406 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-9bf3c8a1-a668-46bb-a812-059f89ecfa57 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:21.920202 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-9bf3c8a1-a668-46bb-a812-059f89ecfa57 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: ff2c3740-6c13-4727-bd7f-ef56bba605de] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:21.931784 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9bf3c8a1-a668-46bb-a812-059f89ecfa57 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:21.932295 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9bf3c8a1-a668-46bb-a812-059f89ecfa57 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:21.932746 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9bf3c8a1-a668-46bb-a812-059f89ecfa57 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:21.933514 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9bf3c8a1-a668-46bb-a812-059f89ecfa57 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:21.938115 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9bf3c8a1-a668-46bb-a812-059f89ecfa57 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:21.939789 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9bf3c8a1-a668-46bb-a812-059f89ecfa57 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:22.095427 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-66ddda77-6539-45d4-8a7e-1c2928d8275e tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Calling method '.version_select at 0x7fb21eaf40d0>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:22.146938 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-66ddda77-6539-45d4-8a7e-1c2928d8275e tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1893152624" status: 202 len: 0 microversion: 2.1 time: 0.058744 Oct 04 19:00:22.148127 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2541/5429] 10.222.0.43 () {58 vars in 1257 bytes} [Tue Oct 4 19:00:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1893152624 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:00:22.165401 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-5e1c628a-aac1-495e-9c55-434abef8aa42 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:22.166438 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-5e1c628a-aac1-495e-9c55-434abef8aa42 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] [instance: 02a066b4-243b-4fe3-afcf-30f3e9511d1b] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:22.194837 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5e1c628a-aac1-495e-9c55-434abef8aa42 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:22.195762 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5e1c628a-aac1-495e-9c55-434abef8aa42 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:22.196534 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5e1c628a-aac1-495e-9c55-434abef8aa42 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:22.198058 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5e1c628a-aac1-495e-9c55-434abef8aa42 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:22.198703 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5e1c628a-aac1-495e-9c55-434abef8aa42 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:22.199547 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5e1c628a-aac1-495e-9c55-434abef8aa42 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:22.298287 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-9bf3c8a1-a668-46bb-a812-059f89ecfa57 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c997bc60473b43fd9fcf0c65111c44c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a711601b7a439caf395233de1febff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:22.339058 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-9bf3c8a1-a668-46bb-a812-059f89ecfa57 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "GET /compute/v2.1/servers/ff2c3740-6c13-4727-bd7f-ef56bba605de" status: 200 len: 1211 microversion: 2.1 time: 0.424015 Oct 04 19:00:22.356380 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2889/5430] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:00:21 2022] GET /compute/v2.1/servers/ff2c3740-6c13-4727-bd7f-ef56bba605de => generated 1211 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:00:22.604124 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-5e1c628a-aac1-495e-9c55-434abef8aa42 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:22.623776 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-5e1c628a-aac1-495e-9c55-434abef8aa42 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:22.633650 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-5e1c628a-aac1-495e-9c55-434abef8aa42 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dd8fa69e56d47bba065c558ad1f08e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea78afe01b240f79c3bb2cfc773e502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:22.642585 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-5e1c628a-aac1-495e-9c55-434abef8aa42 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] 10.222.0.43 "GET /compute/v2.1/servers/02a066b4-243b-4fe3-afcf-30f3e9511d1b" status: 200 len: 1605 microversion: 2.42 time: 0.481384 Oct 04 19:00:22.646215 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2542/5431] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:00:22 2022] GET /compute/v2.1/servers/02a066b4-243b-4fe3-afcf-30f3e9511d1b => generated 1605 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:00:23.383622 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f0e87c84-776d-46bf-81e1-79f4df71e976 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:23.384083 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-f0e87c84-776d-46bf-81e1-79f4df71e976 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: ff2c3740-6c13-4727-bd7f-ef56bba605de] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:23.398660 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f0e87c84-776d-46bf-81e1-79f4df71e976 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:23.399440 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f0e87c84-776d-46bf-81e1-79f4df71e976 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:23.404011 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f0e87c84-776d-46bf-81e1-79f4df71e976 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:23.405038 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f0e87c84-776d-46bf-81e1-79f4df71e976 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:23.405730 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f0e87c84-776d-46bf-81e1-79f4df71e976 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:23.406333 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f0e87c84-776d-46bf-81e1-79f4df71e976 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:23.627875 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-f0e87c84-776d-46bf-81e1-79f4df71e976 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c997bc60473b43fd9fcf0c65111c44c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a711601b7a439caf395233de1febff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:23.642946 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-f0e87c84-776d-46bf-81e1-79f4df71e976 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "GET /compute/v2.1/servers/ff2c3740-6c13-4727-bd7f-ef56bba605de" status: 200 len: 1273 microversion: 2.1 time: 0.265037 Oct 04 19:00:23.644212 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2890/5432] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:00:23 2022] GET /compute/v2.1/servers/ff2c3740-6c13-4727-bd7f-ef56bba605de => generated 1273 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:00:23.673576 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-a7fcb7dc-a4b3-4e4a-964d-e7fe5af328b8 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:23.674463 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-a7fcb7dc-a4b3-4e4a-964d-e7fe5af328b8 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] [instance: 02a066b4-243b-4fe3-afcf-30f3e9511d1b] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:23.686585 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a7fcb7dc-a4b3-4e4a-964d-e7fe5af328b8 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:23.687102 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a7fcb7dc-a4b3-4e4a-964d-e7fe5af328b8 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:23.687696 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a7fcb7dc-a4b3-4e4a-964d-e7fe5af328b8 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:23.689090 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a7fcb7dc-a4b3-4e4a-964d-e7fe5af328b8 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:23.689672 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a7fcb7dc-a4b3-4e4a-964d-e7fe5af328b8 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:23.690434 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a7fcb7dc-a4b3-4e4a-964d-e7fe5af328b8 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:23.714013 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-a7fcb7dc-a4b3-4e4a-964d-e7fe5af328b8 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] HTTP exception thrown: Instance 02a066b4-243b-4fe3-afcf-30f3e9511d1b could not be found. Oct 04 19:00:23.716558 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-a7fcb7dc-a4b3-4e4a-964d-e7fe5af328b8 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Request method failure captured: Oct 04 19:00:23.716558 n-d-851028-13 devstack@n-api.service[123595]: request: GET /compute/v2.1/servers/02a066b4-243b-4fe3-afcf-30f3e9511d1b HTTP/1.1 Oct 04 19:00:23.716558 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 19:00:23.716558 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 19:00:23.716558 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 19:00:23.716558 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 0 Oct 04 19:00:23.716558 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 19:00:23.716558 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 19:00:23.716558 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 19:00:23.716558 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 19:00:23.716558 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPIEcbXre-ESQJuRd1aLC5T8gllbmFFTCKdeDOiN6Go5aADI7uQuyX8Zy7CC0S36SP-9lrSX-3k09K1pWQcaYnDOJITbdROnLVSmkqBbc1L2vH4xbRgEegyayj35MKI4pwTZChPGmhVwxX9Zcph6FeLg3D7--ys-z5maAtsuw2rREOyc Oct 04 19:00:23.716558 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 19:00:23.716558 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 19:00:23.716558 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 19:00:23.716558 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 19:00:23.716558 n-d-851028-13 devstack@n-api.service[123595]: X-Openstack-Nova-Api-Version: 2.42 Oct 04 19:00:23.716558 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 19:00:23.716558 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 19:00:23.716558 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: fea78afe01b240f79c3bb2cfc773e502 Oct 04 19:00:23.716558 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-463974423 Oct 04 19:00:23.716558 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 19:00:23.716558 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 19:00:23.716558 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/fea78afe01b240f79c3bb2cfc773e502"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_fea78afe01b240f79c3bb2cfc773e502"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/fea78afe01b240f79c3bb2cfc773e502"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/fea78afe01b240f79c3bb2cfc773e502"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 19:00:23.716558 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-TaggedBootDevicesTest_v242-463974423 Oct 04 19:00:23.716558 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: fea78afe01b240f79c3bb2cfc773e502 Oct 04 19:00:23.716558 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-463974423 Oct 04 19:00:23.716558 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-TaggedBootDevicesTest_v242-463974423-project Oct 04 19:00:23.716558 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 19:00:23.716558 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 19:00:23.716558 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: 1dd8fa69e56d47bba065c558ad1f08e4 Oct 04 19:00:23.716558 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-TaggedBootDevicesTest_v242-463974423-project Oct 04 19:00:23.716558 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 19:00:23.716558 n-d-851028-13 devstack@n-api.service[123595]: exception: Instance 02a066b4-243b-4fe3-afcf-30f3e9511d1b could not be found. Oct 04 19:00:23.716558 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': '02a066b4-243b-4fe3-afcf-30f3e9511d1b'} Oct 04 19:00:23.716558 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:00:23.716558 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:00:23.716558 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:00:23.716558 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:00:23.716558 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:00:23.716558 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:00:23.716558 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:00:23.716558 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:00:23.716558 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:00:23.716558 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:00:23.716558 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02a066b4-243b-4fe3-afcf-30f3e9511d1b could not be found. Oct 04 19:00:23.716558 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:00:23.716558 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:00:23.716558 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:00:23.716558 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:00:23.716558 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:00:23.716558 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:00:23.716558 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:00:23.716558 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:00:23.716558 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:00:23.716558 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:00:23.716558 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:00:23.716558 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:00:23.716558 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:00:23.716558 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:00:23.716558 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:00:23.716558 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:00:23.716558 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02a066b4-243b-4fe3-afcf-30f3e9511d1b could not be found. Oct 04 19:00:23.716558 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:00:23.716558 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:00:23.720686 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:00:23.720686 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:00:23.720686 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:00:23.720686 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:00:23.720686 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:00:23.720686 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:00:23.720686 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02a066b4-243b-4fe3-afcf-30f3e9511d1b could not be found. Oct 04 19:00:23.720686 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:00:23.724563 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-a7fcb7dc-a4b3-4e4a-964d-e7fe5af328b8 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Returning 404 to user: Instance 02a066b4-243b-4fe3-afcf-30f3e9511d1b could not be found. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:00:23.726076 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-a7fcb7dc-a4b3-4e4a-964d-e7fe5af328b8 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] 10.222.0.43 "GET /compute/v2.1/servers/02a066b4-243b-4fe3-afcf-30f3e9511d1b" status: 404 len: 111 microversion: 2.42 time: 0.057238 Oct 04 19:00:23.728254 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2543/5433] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:00:23 2022] GET /compute/v2.1/servers/02a066b4-243b-4fe3-afcf-30f3e9511d1b => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 19:00:23.737881 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f8594985-c7d3-46df-a844-84d9ccee136d tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Calling method '.version_select at 0x7fb21e934dc0>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:23.777120 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-f8594985-c7d3-46df-a844-84d9ccee136d tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1958839162" status: 204 len: 0 microversion: 2.42 time: 0.042952 Oct 04 19:00:23.778777 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2891/5434] 10.222.0.43 () {60 vars in 1262 bytes} [Tue Oct 4 19:00:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1958839162 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 19:00:24.674569 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-ee515907-5157-4b7b-8b60-f08d834e0cf1 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:24.675407 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-ee515907-5157-4b7b-8b60-f08d834e0cf1 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: ff2c3740-6c13-4727-bd7f-ef56bba605de] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:24.689717 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ee515907-5157-4b7b-8b60-f08d834e0cf1 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:24.690228 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ee515907-5157-4b7b-8b60-f08d834e0cf1 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:24.690678 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ee515907-5157-4b7b-8b60-f08d834e0cf1 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:24.691535 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ee515907-5157-4b7b-8b60-f08d834e0cf1 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:24.692000 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ee515907-5157-4b7b-8b60-f08d834e0cf1 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:24.692441 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ee515907-5157-4b7b-8b60-f08d834e0cf1 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:24.886009 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-ee515907-5157-4b7b-8b60-f08d834e0cf1 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c997bc60473b43fd9fcf0c65111c44c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a711601b7a439caf395233de1febff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:24.907002 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-ee515907-5157-4b7b-8b60-f08d834e0cf1 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "GET /compute/v2.1/servers/ff2c3740-6c13-4727-bd7f-ef56bba605de" status: 200 len: 1273 microversion: 2.1 time: 0.235624 Oct 04 19:00:24.907703 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2544/5435] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:00:24 2022] GET /compute/v2.1/servers/ff2c3740-6c13-4727-bd7f-ef56bba605de => generated 1273 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:00:25.935464 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-0c908539-95ed-463e-87c9-e69b42125ae9 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:25.936006 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-0c908539-95ed-463e-87c9-e69b42125ae9 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: ff2c3740-6c13-4727-bd7f-ef56bba605de] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:25.953281 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0c908539-95ed-463e-87c9-e69b42125ae9 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:25.954143 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0c908539-95ed-463e-87c9-e69b42125ae9 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:25.954933 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0c908539-95ed-463e-87c9-e69b42125ae9 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:25.955887 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0c908539-95ed-463e-87c9-e69b42125ae9 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:25.956535 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0c908539-95ed-463e-87c9-e69b42125ae9 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:25.957163 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0c908539-95ed-463e-87c9-e69b42125ae9 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:26.406957 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-0c908539-95ed-463e-87c9-e69b42125ae9 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c997bc60473b43fd9fcf0c65111c44c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a711601b7a439caf395233de1febff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:26.422312 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-0c908539-95ed-463e-87c9-e69b42125ae9 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "GET /compute/v2.1/servers/ff2c3740-6c13-4727-bd7f-ef56bba605de" status: 200 len: 1315 microversion: 2.1 time: 0.491569 Oct 04 19:00:26.425234 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2892/5436] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:00:25 2022] GET /compute/v2.1/servers/ff2c3740-6c13-4727-bd7f-ef56bba605de => generated 1315 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:00:27.451818 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-bf6b341c-5366-4dcc-beac-3d3fd668586e tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:27.452849 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-bf6b341c-5366-4dcc-beac-3d3fd668586e tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: ff2c3740-6c13-4727-bd7f-ef56bba605de] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:27.465963 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bf6b341c-5366-4dcc-beac-3d3fd668586e tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:27.469730 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bf6b341c-5366-4dcc-beac-3d3fd668586e tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:27.470336 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bf6b341c-5366-4dcc-beac-3d3fd668586e tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:27.471217 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bf6b341c-5366-4dcc-beac-3d3fd668586e tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:27.472046 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bf6b341c-5366-4dcc-beac-3d3fd668586e tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:27.482027 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bf6b341c-5366-4dcc-beac-3d3fd668586e tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:28.355965 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-bf6b341c-5366-4dcc-beac-3d3fd668586e tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c997bc60473b43fd9fcf0c65111c44c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a711601b7a439caf395233de1febff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:28.370923 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-bf6b341c-5366-4dcc-beac-3d3fd668586e tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "GET /compute/v2.1/servers/ff2c3740-6c13-4727-bd7f-ef56bba605de" status: 200 len: 1315 microversion: 2.1 time: 0.923173 Oct 04 19:00:28.371775 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2545/5437] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:00:27 2022] GET /compute/v2.1/servers/ff2c3740-6c13-4727-bd7f-ef56bba605de => generated 1315 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:00:29.399300 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-e7ce9fb6-0f9f-4de3-8d5e-69cb9e90171b req-b71325a4-c1a4-422b-97dd-030ae004321e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff2c3740-6c13-4727-bd7f-ef56bba605de", "tag": "e3885cb7-f6d8-4169-b00f-05ba7abb030d"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:00:29.404861 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-dd662acd-769d-4eaa-a001-dac41cb1569c tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:29.412390 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-dd662acd-769d-4eaa-a001-dac41cb1569c tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: ff2c3740-6c13-4727-bd7f-ef56bba605de] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:29.416811 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=2,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:00:29.432068 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dd662acd-769d-4eaa-a001-dac41cb1569c tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:29.432579 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dd662acd-769d-4eaa-a001-dac41cb1569c tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:29.433030 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dd662acd-769d-4eaa-a001-dac41cb1569c tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:29.442909 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-e7ce9fb6-0f9f-4de3-8d5e-69cb9e90171b req-b71325a4-c1a4-422b-97dd-030ae004321e service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:29.443407 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-e7ce9fb6-0f9f-4de3-8d5e-69cb9e90171b req-b71325a4-c1a4-422b-97dd-030ae004321e service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:29.443851 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-e7ce9fb6-0f9f-4de3-8d5e-69cb9e90171b req-b71325a4-c1a4-422b-97dd-030ae004321e service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:29.449493 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dd662acd-769d-4eaa-a001-dac41cb1569c tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:29.450014 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dd662acd-769d-4eaa-a001-dac41cb1569c tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:29.450466 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dd662acd-769d-4eaa-a001-dac41cb1569c tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:29.520343 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-e7ce9fb6-0f9f-4de3-8d5e-69cb9e90171b req-b71325a4-c1a4-422b-97dd-030ae004321e service nova] Creating event network-changed:e3885cb7-f6d8-4169-b00f-05ba7abb030d for instance ff2c3740-6c13-4727-bd7f-ef56bba605de on n-h1-851028-13 Oct 04 19:00:29.556477 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-e7ce9fb6-0f9f-4de3-8d5e-69cb9e90171b req-b71325a4-c1a4-422b-97dd-030ae004321e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.156612 Oct 04 19:00:29.557714 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2546/5438] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:00:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:00:30.271935 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-e4c4ac40-d82b-42a9-be9e-93b1a4a836c0 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:30.272927 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-e4c4ac40-d82b-42a9-be9e-93b1a4a836c0 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] [instance: a45d1b74-2d81-4e11-b837-fe77dc63f689] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:30.286446 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e4c4ac40-d82b-42a9-be9e-93b1a4a836c0 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:30.294673 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e4c4ac40-d82b-42a9-be9e-93b1a4a836c0 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:30.295910 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e4c4ac40-d82b-42a9-be9e-93b1a4a836c0 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:30.296263 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-dd662acd-769d-4eaa-a001-dac41cb1569c tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c997bc60473b43fd9fcf0c65111c44c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a711601b7a439caf395233de1febff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:30.298020 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e4c4ac40-d82b-42a9-be9e-93b1a4a836c0 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:30.300046 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e4c4ac40-d82b-42a9-be9e-93b1a4a836c0 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:30.300579 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e4c4ac40-d82b-42a9-be9e-93b1a4a836c0 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:30.356828 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-dd662acd-769d-4eaa-a001-dac41cb1569c tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "GET /compute/v2.1/servers/ff2c3740-6c13-4727-bd7f-ef56bba605de" status: 200 len: 1315 microversion: 2.1 time: 0.948933 Oct 04 19:00:30.385840 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-e4c4ac40-d82b-42a9-be9e-93b1a4a836c0 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] HTTP exception thrown: Instance a45d1b74-2d81-4e11-b837-fe77dc63f689 could not be found. Oct 04 19:00:30.387574 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2893/5439] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:00:29 2022] GET /compute/v2.1/servers/ff2c3740-6c13-4727-bd7f-ef56bba605de => generated 1315 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:00:30.393924 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-e4c4ac40-d82b-42a9-be9e-93b1a4a836c0 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Request method failure captured: Oct 04 19:00:30.393924 n-d-851028-13 devstack@n-api.service[123595]: request: DELETE /compute/v2.1/servers/a45d1b74-2d81-4e11-b837-fe77dc63f689 HTTP/1.1 Oct 04 19:00:30.393924 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 19:00:30.393924 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 19:00:30.393924 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 19:00:30.393924 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 0 Oct 04 19:00:30.393924 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 19:00:30.393924 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 19:00:30.393924 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 19:00:30.393924 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 19:00:30.393924 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPID78vmCI9IDPSneDizdTNDV6DvHA8Yu-0Hk2AdriQTEcsN9glvSb6qnq0IhhwuZEnTcyOqvR3DmN0AjQb3MXy0KeUN-iyujvPMDrfVKCEbIzKf9nHEoBLFpzOTLVQVrEHVpIwmUAw_LxUeBUjShHQb88Tzo0W7pmPF365n3rwKGYEI Oct 04 19:00:30.393924 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 19:00:30.393924 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 19:00:30.393924 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 19:00:30.393924 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 19:00:30.393924 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 19:00:30.393924 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 19:00:30.393924 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: 6c91c7e7358048ffaaee7f51ad61b515 Oct 04 19:00:30.393924 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-AttachVolumeNegativeTest-2048626205 Oct 04 19:00:30.393924 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 19:00:30.393924 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 19:00:30.393924 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/6c91c7e7358048ffaaee7f51ad61b515"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_6c91c7e7358048ffaaee7f51ad61b515"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/6c91c7e7358048ffaaee7f51ad61b515"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/6c91c7e7358048ffaaee7f51ad61b515"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 19:00:30.393924 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-AttachVolumeNegativeTest-2048626205 Oct 04 19:00:30.393924 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: 6c91c7e7358048ffaaee7f51ad61b515 Oct 04 19:00:30.393924 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2048626205 Oct 04 19:00:30.393924 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-AttachVolumeNegativeTest-2048626205-project Oct 04 19:00:30.393924 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 19:00:30.393924 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 19:00:30.393924 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: 486c22456b1e47ae843ae41f8dfb2632 Oct 04 19:00:30.393924 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-AttachVolumeNegativeTest-2048626205-project Oct 04 19:00:30.393924 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 19:00:30.393924 n-d-851028-13 devstack@n-api.service[123595]: exception: Instance a45d1b74-2d81-4e11-b837-fe77dc63f689 could not be found. Oct 04 19:00:30.393924 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': 'a45d1b74-2d81-4e11-b837-fe77dc63f689'} Oct 04 19:00:30.393924 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:00:30.393924 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:00:30.393924 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:00:30.393924 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:00:30.393924 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:00:30.393924 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:00:30.393924 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:00:30.393924 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:00:30.393924 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:00:30.393924 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:00:30.393924 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a45d1b74-2d81-4e11-b837-fe77dc63f689 could not be found. Oct 04 19:00:30.393924 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:00:30.393924 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:00:30.393924 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:00:30.393924 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:00:30.393924 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:00:30.393924 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:00:30.393924 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:00:30.393924 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:00:30.393924 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:00:30.393924 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:00:30.393924 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 19:00:30.393924 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 19:00:30.393924 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 19:00:30.393924 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 19:00:30.393924 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:00:30.393924 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:00:30.393924 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:00:30.393924 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:00:30.398267 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a45d1b74-2d81-4e11-b837-fe77dc63f689 could not be found. Oct 04 19:00:30.398267 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:00:30.398267 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:00:30.398267 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:00:30.398267 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:00:30.398267 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:00:30.398267 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:00:30.398267 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:00:30.398267 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:00:30.398267 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a45d1b74-2d81-4e11-b837-fe77dc63f689 could not be found. Oct 04 19:00:30.398267 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:00:30.398267 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-e4c4ac40-d82b-42a9-be9e-93b1a4a836c0 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Returning 404 to user: Instance a45d1b74-2d81-4e11-b837-fe77dc63f689 could not be found. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:00:30.398267 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-e4c4ac40-d82b-42a9-be9e-93b1a4a836c0 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] 10.222.0.43 "DELETE /compute/v2.1/servers/a45d1b74-2d81-4e11-b837-fe77dc63f689" status: 404 len: 111 microversion: 2.1 time: 0.130419 Oct 04 19:00:30.404126 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-3019840b-e317-43da-a922-82a601eb629d tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:30.404744 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-3019840b-e317-43da-a922-82a601eb629d tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] [instance: a45d1b74-2d81-4e11-b837-fe77dc63f689] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:30.407492 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2547/5440] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 19:00:30 2022] DELETE /compute/v2.1/servers/a45d1b74-2d81-4e11-b837-fe77dc63f689 => generated 111 bytes in 144 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:00:30.425362 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3019840b-e317-43da-a922-82a601eb629d tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:30.426438 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3019840b-e317-43da-a922-82a601eb629d tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:30.427242 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3019840b-e317-43da-a922-82a601eb629d tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:30.434135 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3019840b-e317-43da-a922-82a601eb629d tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:30.434886 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3019840b-e317-43da-a922-82a601eb629d tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:30.435524 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3019840b-e317-43da-a922-82a601eb629d tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:30.462776 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-3019840b-e317-43da-a922-82a601eb629d tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] HTTP exception thrown: Instance a45d1b74-2d81-4e11-b837-fe77dc63f689 could not be found. Oct 04 19:00:30.471134 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-3019840b-e317-43da-a922-82a601eb629d tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Request method failure captured: Oct 04 19:00:30.471134 n-d-851028-13 devstack@n-api.service[123596]: request: GET /compute/v2.1/servers/a45d1b74-2d81-4e11-b837-fe77dc63f689 HTTP/1.1 Oct 04 19:00:30.471134 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 19:00:30.471134 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 19:00:30.471134 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 19:00:30.471134 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 19:00:30.471134 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 19:00:30.471134 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 19:00:30.471134 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 19:00:30.471134 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 19:00:30.471134 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPID78vmCI9IDPSneDizdTNDV6DvHA8Yu-0Hk2AdriQTEcsN9glvSb6qnq0IhhwuZEnTcyOqvR3DmN0AjQb3MXy0KeUN-iyujvPMDrfVKCEbIzKf9nHEoBLFpzOTLVQVrEHVpIwmUAw_LxUeBUjShHQb88Tzo0W7pmPF365n3rwKGYEI Oct 04 19:00:30.471134 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 19:00:30.471134 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 19:00:30.471134 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 19:00:30.471134 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 19:00:30.471134 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 19:00:30.471134 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 19:00:30.471134 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: 6c91c7e7358048ffaaee7f51ad61b515 Oct 04 19:00:30.471134 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-AttachVolumeNegativeTest-2048626205 Oct 04 19:00:30.471134 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 19:00:30.471134 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 19:00:30.471134 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/6c91c7e7358048ffaaee7f51ad61b515"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_6c91c7e7358048ffaaee7f51ad61b515"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/6c91c7e7358048ffaaee7f51ad61b515"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/6c91c7e7358048ffaaee7f51ad61b515"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 19:00:30.471134 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-AttachVolumeNegativeTest-2048626205 Oct 04 19:00:30.471134 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: 6c91c7e7358048ffaaee7f51ad61b515 Oct 04 19:00:30.471134 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2048626205 Oct 04 19:00:30.471134 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-AttachVolumeNegativeTest-2048626205-project Oct 04 19:00:30.471134 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 19:00:30.471134 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 19:00:30.471134 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 486c22456b1e47ae843ae41f8dfb2632 Oct 04 19:00:30.471134 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-AttachVolumeNegativeTest-2048626205-project Oct 04 19:00:30.471134 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 19:00:30.471134 n-d-851028-13 devstack@n-api.service[123596]: exception: Instance a45d1b74-2d81-4e11-b837-fe77dc63f689 could not be found. Oct 04 19:00:30.471134 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': 'a45d1b74-2d81-4e11-b837-fe77dc63f689'} Oct 04 19:00:30.471134 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:00:30.471134 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:00:30.471134 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:00:30.471134 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:00:30.471134 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:00:30.471134 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:00:30.471134 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:00:30.471134 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:00:30.471134 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:00:30.471134 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:00:30.471134 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a45d1b74-2d81-4e11-b837-fe77dc63f689 could not be found. Oct 04 19:00:30.471134 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:00:30.471134 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:00:30.471134 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:00:30.471134 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:00:30.471134 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:00:30.471134 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:00:30.471134 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:00:30.471134 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:00:30.471134 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:00:30.471134 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:00:30.471134 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:00:30.471134 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:00:30.471134 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:00:30.471134 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:00:30.471134 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:00:30.471134 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:00:30.471134 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a45d1b74-2d81-4e11-b837-fe77dc63f689 could not be found. Oct 04 19:00:30.471134 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:00:30.471134 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:00:30.471134 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:00:30.479728 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:00:30.479728 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:00:30.479728 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:00:30.479728 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:00:30.479728 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:00:30.479728 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a45d1b74-2d81-4e11-b837-fe77dc63f689 could not be found. Oct 04 19:00:30.479728 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:00:30.480160 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-3019840b-e317-43da-a922-82a601eb629d tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Returning 404 to user: Instance a45d1b74-2d81-4e11-b837-fe77dc63f689 could not be found. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:00:30.481143 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-3019840b-e317-43da-a922-82a601eb629d tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] 10.222.0.43 "GET /compute/v2.1/servers/a45d1b74-2d81-4e11-b837-fe77dc63f689" status: 404 len: 111 microversion: 2.1 time: 0.080603 Oct 04 19:00:30.485616 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2894/5441] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:00:30 2022] GET /compute/v2.1/servers/a45d1b74-2d81-4e11-b837-fe77dc63f689 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:00:30.491376 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-473c7a08-545c-4b2e-8821-702245277abc tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:30.491899 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-473c7a08-545c-4b2e-8821-702245277abc tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] [instance: 523fce83-2292-42b0-9b99-c9ac2c48e544] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:30.513328 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-473c7a08-545c-4b2e-8821-702245277abc tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:30.513840 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-473c7a08-545c-4b2e-8821-702245277abc tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:30.514308 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-473c7a08-545c-4b2e-8821-702245277abc tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:30.515426 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-473c7a08-545c-4b2e-8821-702245277abc tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:30.515911 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-473c7a08-545c-4b2e-8821-702245277abc tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:30.517086 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-473c7a08-545c-4b2e-8821-702245277abc tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:30.558404 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-473c7a08-545c-4b2e-8821-702245277abc tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] HTTP exception thrown: Instance 523fce83-2292-42b0-9b99-c9ac2c48e544 could not be found. Oct 04 19:00:30.562187 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-473c7a08-545c-4b2e-8821-702245277abc tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Request method failure captured: Oct 04 19:00:30.562187 n-d-851028-13 devstack@n-api.service[123595]: request: DELETE /compute/v2.1/servers/523fce83-2292-42b0-9b99-c9ac2c48e544 HTTP/1.1 Oct 04 19:00:30.562187 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 19:00:30.562187 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 19:00:30.562187 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 19:00:30.562187 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 0 Oct 04 19:00:30.562187 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 19:00:30.562187 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 19:00:30.562187 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 19:00:30.562187 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 19:00:30.562187 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPID78vmCI9IDPSneDizdTNDV6DvHA8Yu-0Hk2AdriQTEcsN9glvSb6qnq0IhhwuZEnTcyOqvR3DmN0AjQb3MXy0KeUN-iyujvPMDrfVKCEbIzKf9nHEoBLFpzOTLVQVrEHVpIwmUAw_LxUeBUjShHQb88Tzo0W7pmPF365n3rwKGYEI Oct 04 19:00:30.562187 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 19:00:30.562187 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 19:00:30.562187 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 19:00:30.562187 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 19:00:30.562187 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 19:00:30.562187 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 19:00:30.562187 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: 6c91c7e7358048ffaaee7f51ad61b515 Oct 04 19:00:30.562187 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-AttachVolumeNegativeTest-2048626205 Oct 04 19:00:30.562187 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 19:00:30.562187 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 19:00:30.562187 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/6c91c7e7358048ffaaee7f51ad61b515"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_6c91c7e7358048ffaaee7f51ad61b515"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/6c91c7e7358048ffaaee7f51ad61b515"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/6c91c7e7358048ffaaee7f51ad61b515"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 19:00:30.562187 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-AttachVolumeNegativeTest-2048626205 Oct 04 19:00:30.562187 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: 6c91c7e7358048ffaaee7f51ad61b515 Oct 04 19:00:30.562187 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2048626205 Oct 04 19:00:30.562187 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-AttachVolumeNegativeTest-2048626205-project Oct 04 19:00:30.562187 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 19:00:30.562187 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 19:00:30.562187 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: 486c22456b1e47ae843ae41f8dfb2632 Oct 04 19:00:30.562187 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-AttachVolumeNegativeTest-2048626205-project Oct 04 19:00:30.562187 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 19:00:30.562187 n-d-851028-13 devstack@n-api.service[123595]: exception: Instance 523fce83-2292-42b0-9b99-c9ac2c48e544 could not be found. Oct 04 19:00:30.562187 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': '523fce83-2292-42b0-9b99-c9ac2c48e544'} Oct 04 19:00:30.562187 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:00:30.562187 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:00:30.562187 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:00:30.562187 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:00:30.562187 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:00:30.562187 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:00:30.562187 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:00:30.562187 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:00:30.562187 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:00:30.562187 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:00:30.562187 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 523fce83-2292-42b0-9b99-c9ac2c48e544 could not be found. Oct 04 19:00:30.562187 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:00:30.562187 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:00:30.562187 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:00:30.562187 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:00:30.562187 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:00:30.562187 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:00:30.562187 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:00:30.562187 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:00:30.562187 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:00:30.562187 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:00:30.562187 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 19:00:30.562187 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 19:00:30.562187 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 19:00:30.562187 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 19:00:30.562187 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:00:30.562187 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:00:30.562187 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:00:30.562187 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:00:30.566072 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 523fce83-2292-42b0-9b99-c9ac2c48e544 could not be found. Oct 04 19:00:30.566072 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:00:30.566072 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:00:30.566072 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:00:30.566072 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:00:30.566072 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:00:30.566072 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:00:30.566072 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:00:30.566072 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:00:30.566072 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 523fce83-2292-42b0-9b99-c9ac2c48e544 could not be found. Oct 04 19:00:30.566072 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:00:30.566072 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-473c7a08-545c-4b2e-8821-702245277abc tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Returning 404 to user: Instance 523fce83-2292-42b0-9b99-c9ac2c48e544 could not be found. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:00:30.570298 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-473c7a08-545c-4b2e-8821-702245277abc tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] 10.222.0.43 "DELETE /compute/v2.1/servers/523fce83-2292-42b0-9b99-c9ac2c48e544" status: 404 len: 111 microversion: 2.1 time: 0.077873 Oct 04 19:00:30.570643 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2548/5442] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 19:00:30 2022] DELETE /compute/v2.1/servers/523fce83-2292-42b0-9b99-c9ac2c48e544 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:00:30.578918 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-5ead7e4a-2eb5-4987-bd52-c50a26456e36 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:30.579556 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-5ead7e4a-2eb5-4987-bd52-c50a26456e36 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] [instance: 523fce83-2292-42b0-9b99-c9ac2c48e544] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:30.582543 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=2 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:00:30.586847 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5ead7e4a-2eb5-4987-bd52-c50a26456e36 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:30.587341 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5ead7e4a-2eb5-4987-bd52-c50a26456e36 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:30.587789 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5ead7e4a-2eb5-4987-bd52-c50a26456e36 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:30.588580 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5ead7e4a-2eb5-4987-bd52-c50a26456e36 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:30.589040 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5ead7e4a-2eb5-4987-bd52-c50a26456e36 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:30.589522 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5ead7e4a-2eb5-4987-bd52-c50a26456e36 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:30.614533 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=6 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:00:30.618894 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-5ead7e4a-2eb5-4987-bd52-c50a26456e36 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] HTTP exception thrown: Instance 523fce83-2292-42b0-9b99-c9ac2c48e544 could not be found. Oct 04 19:00:30.620477 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-5ead7e4a-2eb5-4987-bd52-c50a26456e36 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Request method failure captured: Oct 04 19:00:30.620477 n-d-851028-13 devstack@n-api.service[123596]: request: GET /compute/v2.1/servers/523fce83-2292-42b0-9b99-c9ac2c48e544 HTTP/1.1 Oct 04 19:00:30.620477 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 19:00:30.620477 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 19:00:30.620477 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 19:00:30.620477 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 19:00:30.620477 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 19:00:30.620477 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 19:00:30.620477 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 19:00:30.620477 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 19:00:30.620477 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPID78vmCI9IDPSneDizdTNDV6DvHA8Yu-0Hk2AdriQTEcsN9glvSb6qnq0IhhwuZEnTcyOqvR3DmN0AjQb3MXy0KeUN-iyujvPMDrfVKCEbIzKf9nHEoBLFpzOTLVQVrEHVpIwmUAw_LxUeBUjShHQb88Tzo0W7pmPF365n3rwKGYEI Oct 04 19:00:30.620477 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 19:00:30.620477 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 19:00:30.620477 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 19:00:30.620477 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 19:00:30.620477 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 19:00:30.620477 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 19:00:30.620477 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: 6c91c7e7358048ffaaee7f51ad61b515 Oct 04 19:00:30.620477 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-AttachVolumeNegativeTest-2048626205 Oct 04 19:00:30.620477 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 19:00:30.620477 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 19:00:30.620477 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/6c91c7e7358048ffaaee7f51ad61b515"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_6c91c7e7358048ffaaee7f51ad61b515"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/6c91c7e7358048ffaaee7f51ad61b515"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/6c91c7e7358048ffaaee7f51ad61b515"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 19:00:30.620477 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-AttachVolumeNegativeTest-2048626205 Oct 04 19:00:30.620477 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: 6c91c7e7358048ffaaee7f51ad61b515 Oct 04 19:00:30.620477 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2048626205 Oct 04 19:00:30.620477 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-AttachVolumeNegativeTest-2048626205-project Oct 04 19:00:30.620477 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 19:00:30.620477 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 19:00:30.620477 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 486c22456b1e47ae843ae41f8dfb2632 Oct 04 19:00:30.620477 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-AttachVolumeNegativeTest-2048626205-project Oct 04 19:00:30.620477 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 19:00:30.620477 n-d-851028-13 devstack@n-api.service[123596]: exception: Instance 523fce83-2292-42b0-9b99-c9ac2c48e544 could not be found. Oct 04 19:00:30.620477 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': '523fce83-2292-42b0-9b99-c9ac2c48e544'} Oct 04 19:00:30.620477 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:00:30.620477 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:00:30.620477 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:00:30.620477 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:00:30.620477 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:00:30.620477 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:00:30.620477 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:00:30.620477 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:00:30.620477 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:00:30.620477 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:00:30.620477 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 523fce83-2292-42b0-9b99-c9ac2c48e544 could not be found. Oct 04 19:00:30.620477 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:00:30.620477 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:00:30.620477 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:00:30.620477 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:00:30.620477 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:00:30.620477 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:00:30.620477 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:00:30.620477 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:00:30.620477 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:00:30.620477 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:00:30.620477 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:00:30.620477 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:00:30.620477 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:00:30.620477 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:00:30.620477 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:00:30.620477 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:00:30.620477 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 523fce83-2292-42b0-9b99-c9ac2c48e544 could not be found. Oct 04 19:00:30.620477 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:00:30.620477 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:00:30.620477 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:00:30.628732 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:00:30.628732 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:00:30.628732 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:00:30.628732 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:00:30.628732 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:00:30.628732 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 523fce83-2292-42b0-9b99-c9ac2c48e544 could not be found. Oct 04 19:00:30.628732 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:00:30.628732 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-5ead7e4a-2eb5-4987-bd52-c50a26456e36 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Returning 404 to user: Instance 523fce83-2292-42b0-9b99-c9ac2c48e544 could not be found. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:00:30.628732 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-5ead7e4a-2eb5-4987-bd52-c50a26456e36 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] 10.222.0.43 "GET /compute/v2.1/servers/523fce83-2292-42b0-9b99-c9ac2c48e544" status: 404 len: 111 microversion: 2.1 time: 0.046982 Oct 04 19:00:30.628732 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2895/5443] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:00:30 2022] GET /compute/v2.1/servers/523fce83-2292-42b0-9b99-c9ac2c48e544 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:00:30.640186 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-78cdf788-1ded-4338-b702-2f67376393c1 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:30.640717 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-78cdf788-1ded-4338-b702-2f67376393c1 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] [instance: adaf9f7d-b52e-445b-9755-18300a401904] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:30.651296 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-78cdf788-1ded-4338-b702-2f67376393c1 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:30.651807 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-78cdf788-1ded-4338-b702-2f67376393c1 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:30.652257 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-78cdf788-1ded-4338-b702-2f67376393c1 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:30.654898 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-78cdf788-1ded-4338-b702-2f67376393c1 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:30.655452 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-78cdf788-1ded-4338-b702-2f67376393c1 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:30.655907 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-78cdf788-1ded-4338-b702-2f67376393c1 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:30.715167 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-78cdf788-1ded-4338-b702-2f67376393c1 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] [instance: adaf9f7d-b52e-445b-9755-18300a401904] Going to try to terminate instance {{(pid=123595) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 19:00:30.907586 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=2 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:00:30.931484 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-78cdf788-1ded-4338-b702-2f67376393c1 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] 10.222.0.43 "DELETE /compute/v2.1/servers/adaf9f7d-b52e-445b-9755-18300a401904" status: 204 len: 0 microversion: 2.1 time: 0.293951 Oct 04 19:00:30.936858 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2549/5444] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 19:00:30 2022] DELETE /compute/v2.1/servers/adaf9f7d-b52e-445b-9755-18300a401904 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:00:30.941770 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-59c937f9-6e50-4883-be20-0e7acddcd9ab tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:30.942653 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-59c937f9-6e50-4883-be20-0e7acddcd9ab tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] [instance: adaf9f7d-b52e-445b-9755-18300a401904] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:30.955478 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-59c937f9-6e50-4883-be20-0e7acddcd9ab tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:30.959190 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-59c937f9-6e50-4883-be20-0e7acddcd9ab tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:30.960351 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-59c937f9-6e50-4883-be20-0e7acddcd9ab tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:30.969502 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-59c937f9-6e50-4883-be20-0e7acddcd9ab tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:30.970120 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-59c937f9-6e50-4883-be20-0e7acddcd9ab tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:30.970586 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-59c937f9-6e50-4883-be20-0e7acddcd9ab tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:31.401879 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-edae4427-b620-4a31-a1a3-fbeb6315fd5f tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:31.403012 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-edae4427-b620-4a31-a1a3-fbeb6315fd5f tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: ff2c3740-6c13-4727-bd7f-ef56bba605de] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:31.417333 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-edae4427-b620-4a31-a1a3-fbeb6315fd5f tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:31.421803 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-edae4427-b620-4a31-a1a3-fbeb6315fd5f tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:31.422461 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-edae4427-b620-4a31-a1a3-fbeb6315fd5f tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:31.423403 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-edae4427-b620-4a31-a1a3-fbeb6315fd5f tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:31.424028 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-edae4427-b620-4a31-a1a3-fbeb6315fd5f tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:31.424639 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-edae4427-b620-4a31-a1a3-fbeb6315fd5f tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:31.978366 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-59c937f9-6e50-4883-be20-0e7acddcd9ab tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1bb492fb294837b1e55d58bbfa3d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a4c327763b4440a9dc456cfbb31f88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:31.987005 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-59c937f9-6e50-4883-be20-0e7acddcd9ab tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] 10.222.0.43 "GET /compute/v2.1/servers/adaf9f7d-b52e-445b-9755-18300a401904" status: 200 len: 1669 microversion: 2.1 time: 1.049638 Oct 04 19:00:31.989793 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2896/5445] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:00:30 2022] GET /compute/v2.1/servers/adaf9f7d-b52e-445b-9755-18300a401904 => generated 1669 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:00:31.997378 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-60ab30ca-ee7b-4adc-b153-702ee53d6f06 req-5acc26b9-79e6-4ba2-88c4-46bda56437a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "adaf9f7d-b52e-445b-9755-18300a401904", "tag": "29dcc234-5990-4abd-b879-e25806c5fbe7"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:00:32.034400 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-60ab30ca-ee7b-4adc-b153-702ee53d6f06 req-5acc26b9-79e6-4ba2-88c4-46bda56437a7 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:32.037314 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-60ab30ca-ee7b-4adc-b153-702ee53d6f06 req-5acc26b9-79e6-4ba2-88c4-46bda56437a7 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:32.037964 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-60ab30ca-ee7b-4adc-b153-702ee53d6f06 req-5acc26b9-79e6-4ba2-88c4-46bda56437a7 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:32.076917 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-60ab30ca-ee7b-4adc-b153-702ee53d6f06 req-5acc26b9-79e6-4ba2-88c4-46bda56437a7 service nova] Creating event network-changed:29dcc234-5990-4abd-b879-e25806c5fbe7 for instance adaf9f7d-b52e-445b-9755-18300a401904 on n-h2-851028-13 Oct 04 19:00:32.098213 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-60ab30ca-ee7b-4adc-b153-702ee53d6f06 req-5acc26b9-79e6-4ba2-88c4-46bda56437a7 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106161 Oct 04 19:00:32.103136 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2897/5446] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:00:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:00:32.266235 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-edae4427-b620-4a31-a1a3-fbeb6315fd5f tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c997bc60473b43fd9fcf0c65111c44c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a711601b7a439caf395233de1febff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:32.276883 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-edae4427-b620-4a31-a1a3-fbeb6315fd5f tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "GET /compute/v2.1/servers/ff2c3740-6c13-4727-bd7f-ef56bba605de" status: 200 len: 1315 microversion: 2.1 time: 0.880605 Oct 04 19:00:32.278098 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2550/5447] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:00:31 2022] GET /compute/v2.1/servers/ff2c3740-6c13-4727-bd7f-ef56bba605de => generated 1315 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:00:33.015560 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f52c8ad0-3305-4aba-82aa-241f7083a222 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:33.016886 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-f52c8ad0-3305-4aba-82aa-241f7083a222 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] [instance: adaf9f7d-b52e-445b-9755-18300a401904] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:33.027293 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f52c8ad0-3305-4aba-82aa-241f7083a222 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:33.027788 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f52c8ad0-3305-4aba-82aa-241f7083a222 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:33.034692 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f52c8ad0-3305-4aba-82aa-241f7083a222 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:33.037316 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f52c8ad0-3305-4aba-82aa-241f7083a222 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:33.037987 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f52c8ad0-3305-4aba-82aa-241f7083a222 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:33.038683 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f52c8ad0-3305-4aba-82aa-241f7083a222 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:33.294783 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-f52c8ad0-3305-4aba-82aa-241f7083a222 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1bb492fb294837b1e55d58bbfa3d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a4c327763b4440a9dc456cfbb31f88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:33.299909 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-1cf42454-7b95-4585-9da5-99c15fd50776 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:33.300539 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-1cf42454-7b95-4585-9da5-99c15fd50776 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: ff2c3740-6c13-4727-bd7f-ef56bba605de] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:33.306525 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-f52c8ad0-3305-4aba-82aa-241f7083a222 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] 10.222.0.43 "GET /compute/v2.1/servers/adaf9f7d-b52e-445b-9755-18300a401904" status: 200 len: 1602 microversion: 2.1 time: 0.295133 Oct 04 19:00:33.309744 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2898/5448] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:00:33 2022] GET /compute/v2.1/servers/adaf9f7d-b52e-445b-9755-18300a401904 => generated 1602 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:00:33.311484 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1cf42454-7b95-4585-9da5-99c15fd50776 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:33.312022 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1cf42454-7b95-4585-9da5-99c15fd50776 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:33.312434 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1cf42454-7b95-4585-9da5-99c15fd50776 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:33.313199 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1cf42454-7b95-4585-9da5-99c15fd50776 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:33.313663 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1cf42454-7b95-4585-9da5-99c15fd50776 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:33.314105 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1cf42454-7b95-4585-9da5-99c15fd50776 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:33.480472 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-c1415d27-b8d4-4524-a1e1-c48a7f57ec65 req-693e8653-23a7-42c2-a876-79e56f0f89cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "adaf9f7d-b52e-445b-9755-18300a401904", "name": "network-vif-deleted", "tag": "29dcc234-5990-4abd-b879-e25806c5fbe7"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:00:33.513769 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-c1415d27-b8d4-4524-a1e1-c48a7f57ec65 req-693e8653-23a7-42c2-a876-79e56f0f89cb service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:33.515930 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-c1415d27-b8d4-4524-a1e1-c48a7f57ec65 req-693e8653-23a7-42c2-a876-79e56f0f89cb service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:33.516404 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-c1415d27-b8d4-4524-a1e1-c48a7f57ec65 req-693e8653-23a7-42c2-a876-79e56f0f89cb service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:33.546438 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:00:33.555555 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-c1415d27-b8d4-4524-a1e1-c48a7f57ec65 req-693e8653-23a7-42c2-a876-79e56f0f89cb service nova] Creating event network-vif-deleted:29dcc234-5990-4abd-b879-e25806c5fbe7 for instance adaf9f7d-b52e-445b-9755-18300a401904 on n-h2-851028-13 Oct 04 19:00:33.569705 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-c1415d27-b8d4-4524-a1e1-c48a7f57ec65 req-693e8653-23a7-42c2-a876-79e56f0f89cb service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095741 Oct 04 19:00:33.570688 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2899/5449] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:00:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:00:34.052843 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-1cf42454-7b95-4585-9da5-99c15fd50776 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c997bc60473b43fd9fcf0c65111c44c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a711601b7a439caf395233de1febff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:34.077923 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-1cf42454-7b95-4585-9da5-99c15fd50776 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "GET /compute/v2.1/servers/ff2c3740-6c13-4727-bd7f-ef56bba605de" status: 200 len: 1315 microversion: 2.1 time: 0.781877 Oct 04 19:00:34.079107 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2551/5450] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:00:33 2022] GET /compute/v2.1/servers/ff2c3740-6c13-4727-bd7f-ef56bba605de => generated 1315 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:00:34.337525 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-c3ba8f13-1e01-4f67-9a9a-634bd8a525f5 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:34.339367 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-c3ba8f13-1e01-4f67-9a9a-634bd8a525f5 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] [instance: adaf9f7d-b52e-445b-9755-18300a401904] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:34.360193 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c3ba8f13-1e01-4f67-9a9a-634bd8a525f5 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:34.361577 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c3ba8f13-1e01-4f67-9a9a-634bd8a525f5 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:34.362572 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c3ba8f13-1e01-4f67-9a9a-634bd8a525f5 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:34.363819 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c3ba8f13-1e01-4f67-9a9a-634bd8a525f5 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:34.364790 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c3ba8f13-1e01-4f67-9a9a-634bd8a525f5 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:34.365582 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c3ba8f13-1e01-4f67-9a9a-634bd8a525f5 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:34.388467 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-c3ba8f13-1e01-4f67-9a9a-634bd8a525f5 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] HTTP exception thrown: Instance adaf9f7d-b52e-445b-9755-18300a401904 could not be found. Oct 04 19:00:34.392140 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-c3ba8f13-1e01-4f67-9a9a-634bd8a525f5 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Request method failure captured: Oct 04 19:00:34.392140 n-d-851028-13 devstack@n-api.service[123596]: request: GET /compute/v2.1/servers/adaf9f7d-b52e-445b-9755-18300a401904 HTTP/1.1 Oct 04 19:00:34.392140 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 19:00:34.392140 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 19:00:34.392140 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 19:00:34.392140 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 19:00:34.392140 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 19:00:34.392140 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 19:00:34.392140 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 19:00:34.392140 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 19:00:34.392140 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPIIujzmbgnhbc79xmoqoHExspbgyH12GGkwkRMlz6Wk1fwNFn1e6GlOs3pSFHAbQBe7hSB4EwCSM1NbNoxM7YtIIvHYBABrrnKeiKHqo9RoOUqrLXsLMa-nwtPKL2I2nbSSkYfxI442WQXq8gqCf1KQPC_Nn5MfwtOvZw4RzsYhjvuo Oct 04 19:00:34.392140 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 19:00:34.392140 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 19:00:34.392140 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 19:00:34.392140 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 19:00:34.392140 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 19:00:34.392140 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 19:00:34.392140 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: 27a4c327763b4440a9dc456cfbb31f88 Oct 04 19:00:34.392140 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-TestNetworkBasicOps-1970804167 Oct 04 19:00:34.392140 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 19:00:34.392140 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 19:00:34.392140 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/27a4c327763b4440a9dc456cfbb31f88"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_27a4c327763b4440a9dc456cfbb31f88"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/27a4c327763b4440a9dc456cfbb31f88"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/27a4c327763b4440a9dc456cfbb31f88"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 19:00:34.392140 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-TestNetworkBasicOps-1970804167 Oct 04 19:00:34.392140 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: 27a4c327763b4440a9dc456cfbb31f88 Oct 04 19:00:34.392140 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-TestNetworkBasicOps-1970804167 Oct 04 19:00:34.392140 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-TestNetworkBasicOps-1970804167-project Oct 04 19:00:34.392140 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 19:00:34.392140 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 19:00:34.392140 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: fc1bb492fb294837b1e55d58bbfa3d0b Oct 04 19:00:34.392140 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-TestNetworkBasicOps-1970804167-project Oct 04 19:00:34.392140 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 19:00:34.392140 n-d-851028-13 devstack@n-api.service[123596]: exception: Instance adaf9f7d-b52e-445b-9755-18300a401904 could not be found. Oct 04 19:00:34.392140 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': 'adaf9f7d-b52e-445b-9755-18300a401904'} Oct 04 19:00:34.392140 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:00:34.392140 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:00:34.392140 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:00:34.392140 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:00:34.392140 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:00:34.392140 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:00:34.392140 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:00:34.392140 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:00:34.392140 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:00:34.392140 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:00:34.392140 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance adaf9f7d-b52e-445b-9755-18300a401904 could not be found. Oct 04 19:00:34.392140 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:00:34.392140 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:00:34.392140 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:00:34.392140 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:00:34.392140 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:00:34.392140 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:00:34.392140 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:00:34.392140 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:00:34.392140 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:00:34.392140 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:00:34.392140 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:00:34.392140 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:00:34.392140 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:00:34.392140 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:00:34.392140 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:00:34.392140 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:00:34.392140 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance adaf9f7d-b52e-445b-9755-18300a401904 could not be found. Oct 04 19:00:34.392140 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:00:34.392140 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:00:34.392140 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:00:34.396431 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:00:34.396431 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:00:34.396431 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:00:34.396431 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:00:34.396431 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:00:34.396431 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance adaf9f7d-b52e-445b-9755-18300a401904 could not be found. Oct 04 19:00:34.396431 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:00:34.399819 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-c3ba8f13-1e01-4f67-9a9a-634bd8a525f5 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Returning 404 to user: Instance adaf9f7d-b52e-445b-9755-18300a401904 could not be found. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:00:34.400964 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-c3ba8f13-1e01-4f67-9a9a-634bd8a525f5 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] 10.222.0.43 "GET /compute/v2.1/servers/adaf9f7d-b52e-445b-9755-18300a401904" status: 404 len: 111 microversion: 2.1 time: 0.072683 Oct 04 19:00:34.402503 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2900/5451] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:00:34 2022] GET /compute/v2.1/servers/adaf9f7d-b52e-445b-9755-18300a401904 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:00:35.108674 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-4090d45c-f9cd-443c-b2d3-1a28a235a44b tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:35.109446 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-4090d45c-f9cd-443c-b2d3-1a28a235a44b tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: ff2c3740-6c13-4727-bd7f-ef56bba605de] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:35.112111 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:00:35.125583 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4090d45c-f9cd-443c-b2d3-1a28a235a44b tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:35.126098 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4090d45c-f9cd-443c-b2d3-1a28a235a44b tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:35.126564 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4090d45c-f9cd-443c-b2d3-1a28a235a44b tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:35.127329 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4090d45c-f9cd-443c-b2d3-1a28a235a44b tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:35.128072 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4090d45c-f9cd-443c-b2d3-1a28a235a44b tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:35.128513 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4090d45c-f9cd-443c-b2d3-1a28a235a44b tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:35.534599 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-9776409f-246e-4e9a-a6d3-5d2eb3ec0ca3 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Calling method '.version_select at 0x7fb21e6f3160>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:35.614465 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-9776409f-246e-4e9a-a6d3-5d2eb3ec0ca3 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-273614183" status: 202 len: 0 microversion: 2.1 time: 0.085589 Oct 04 19:00:35.617378 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2901/5452] 10.222.0.43 () {58 vars in 1254 bytes} [Tue Oct 4 19:00:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-273614183 => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 19:00:35.696441 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-4090d45c-f9cd-443c-b2d3-1a28a235a44b tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c997bc60473b43fd9fcf0c65111c44c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a711601b7a439caf395233de1febff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:35.705749 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-4090d45c-f9cd-443c-b2d3-1a28a235a44b tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "GET /compute/v2.1/servers/ff2c3740-6c13-4727-bd7f-ef56bba605de" status: 200 len: 1315 microversion: 2.1 time: 0.600738 Oct 04 19:00:35.725482 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2552/5453] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:00:35 2022] GET /compute/v2.1/servers/ff2c3740-6c13-4727-bd7f-ef56bba605de => generated 1315 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:00:36.732929 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-25cbb447-bc55-4590-9018-8fdf2fef8598 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:36.734392 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-25cbb447-bc55-4590-9018-8fdf2fef8598 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: ff2c3740-6c13-4727-bd7f-ef56bba605de] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:36.750538 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-25cbb447-bc55-4590-9018-8fdf2fef8598 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:36.752296 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-25cbb447-bc55-4590-9018-8fdf2fef8598 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:36.754486 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-25cbb447-bc55-4590-9018-8fdf2fef8598 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:36.755565 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-25cbb447-bc55-4590-9018-8fdf2fef8598 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:36.758624 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-25cbb447-bc55-4590-9018-8fdf2fef8598 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:36.759361 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-25cbb447-bc55-4590-9018-8fdf2fef8598 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:37.396163 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-25cbb447-bc55-4590-9018-8fdf2fef8598 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c997bc60473b43fd9fcf0c65111c44c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a711601b7a439caf395233de1febff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:37.404970 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-25cbb447-bc55-4590-9018-8fdf2fef8598 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "GET /compute/v2.1/servers/ff2c3740-6c13-4727-bd7f-ef56bba605de" status: 200 len: 1315 microversion: 2.1 time: 0.676457 Oct 04 19:00:37.426580 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2902/5454] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:00:36 2022] GET /compute/v2.1/servers/ff2c3740-6c13-4727-bd7f-ef56bba605de => generated 1315 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:00:37.479299 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-5e9b61c5-9e7f-4e1d-a4b5-dc6d9c060580 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:37.479861 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-5e9b61c5-9e7f-4e1d-a4b5-dc6d9c060580 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] [instance: bc5eda7f-851f-44d8-af95-5e721dd6d52b] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:37.489810 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5e9b61c5-9e7f-4e1d-a4b5-dc6d9c060580 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:37.490309 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5e9b61c5-9e7f-4e1d-a4b5-dc6d9c060580 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:37.490760 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5e9b61c5-9e7f-4e1d-a4b5-dc6d9c060580 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:37.491486 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5e9b61c5-9e7f-4e1d-a4b5-dc6d9c060580 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:37.496245 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5e9b61c5-9e7f-4e1d-a4b5-dc6d9c060580 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:37.501729 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5e9b61c5-9e7f-4e1d-a4b5-dc6d9c060580 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:37.532209 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-5e9b61c5-9e7f-4e1d-a4b5-dc6d9c060580 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] HTTP exception thrown: Instance bc5eda7f-851f-44d8-af95-5e721dd6d52b could not be found. Oct 04 19:00:37.536137 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-5e9b61c5-9e7f-4e1d-a4b5-dc6d9c060580 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Request method failure captured: Oct 04 19:00:37.536137 n-d-851028-13 devstack@n-api.service[123595]: request: DELETE /compute/v2.1/servers/bc5eda7f-851f-44d8-af95-5e721dd6d52b HTTP/1.1 Oct 04 19:00:37.536137 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 19:00:37.536137 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 19:00:37.536137 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 19:00:37.536137 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 0 Oct 04 19:00:37.536137 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 19:00:37.536137 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 19:00:37.536137 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 19:00:37.536137 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 19:00:37.536137 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPID78vmCI9IDPSneDizdTNDV6DvHA8Yu-0Hk2AdriQTEcsN9glvSb6qnq0IhhwuZEnTcyOqvR3DmN0AjQb3MXy0KeUN-iyujvPMDrfVKCEbIzKf9nHEoBLFpzOTLVQVrEHVpIwmUAw_LxUeBUjShHQb88Tzo0W7pmPF365n3rwKGYEI Oct 04 19:00:37.536137 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 19:00:37.536137 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 19:00:37.536137 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 19:00:37.536137 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 19:00:37.536137 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 19:00:37.536137 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 19:00:37.536137 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: 6c91c7e7358048ffaaee7f51ad61b515 Oct 04 19:00:37.536137 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-AttachVolumeNegativeTest-2048626205 Oct 04 19:00:37.536137 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 19:00:37.536137 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 19:00:37.536137 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/6c91c7e7358048ffaaee7f51ad61b515"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_6c91c7e7358048ffaaee7f51ad61b515"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/6c91c7e7358048ffaaee7f51ad61b515"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/6c91c7e7358048ffaaee7f51ad61b515"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 19:00:37.536137 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-AttachVolumeNegativeTest-2048626205 Oct 04 19:00:37.536137 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: 6c91c7e7358048ffaaee7f51ad61b515 Oct 04 19:00:37.536137 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2048626205 Oct 04 19:00:37.536137 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-AttachVolumeNegativeTest-2048626205-project Oct 04 19:00:37.536137 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 19:00:37.536137 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 19:00:37.536137 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: 486c22456b1e47ae843ae41f8dfb2632 Oct 04 19:00:37.536137 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-AttachVolumeNegativeTest-2048626205-project Oct 04 19:00:37.536137 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 19:00:37.536137 n-d-851028-13 devstack@n-api.service[123595]: exception: Instance bc5eda7f-851f-44d8-af95-5e721dd6d52b could not be found. Oct 04 19:00:37.536137 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': 'bc5eda7f-851f-44d8-af95-5e721dd6d52b'} Oct 04 19:00:37.536137 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:00:37.536137 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:00:37.536137 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:00:37.536137 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:00:37.536137 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:00:37.536137 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:00:37.536137 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:00:37.536137 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:00:37.536137 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:00:37.536137 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:00:37.536137 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bc5eda7f-851f-44d8-af95-5e721dd6d52b could not be found. Oct 04 19:00:37.536137 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:00:37.536137 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:00:37.536137 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:00:37.536137 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:00:37.536137 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:00:37.536137 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:00:37.536137 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:00:37.536137 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:00:37.536137 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:00:37.536137 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:00:37.536137 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 19:00:37.536137 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 19:00:37.536137 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 19:00:37.536137 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 19:00:37.536137 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:00:37.536137 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:00:37.536137 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:00:37.536137 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:00:37.540050 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bc5eda7f-851f-44d8-af95-5e721dd6d52b could not be found. Oct 04 19:00:37.540050 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:00:37.540050 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:00:37.540050 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:00:37.540050 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:00:37.540050 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:00:37.540050 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:00:37.540050 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:00:37.540050 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:00:37.540050 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bc5eda7f-851f-44d8-af95-5e721dd6d52b could not be found. Oct 04 19:00:37.540050 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:00:37.541567 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-5e9b61c5-9e7f-4e1d-a4b5-dc6d9c060580 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Returning 404 to user: Instance bc5eda7f-851f-44d8-af95-5e721dd6d52b could not be found. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:00:37.542559 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-5e9b61c5-9e7f-4e1d-a4b5-dc6d9c060580 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] 10.222.0.43 "DELETE /compute/v2.1/servers/bc5eda7f-851f-44d8-af95-5e721dd6d52b" status: 404 len: 111 microversion: 2.1 time: 0.068029 Oct 04 19:00:37.543567 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2553/5455] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 19:00:37 2022] DELETE /compute/v2.1/servers/bc5eda7f-851f-44d8-af95-5e721dd6d52b => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:00:37.552007 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-e6df35cb-7c1a-4d98-baae-a93ea08e2987 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:37.552794 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-e6df35cb-7c1a-4d98-baae-a93ea08e2987 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] [instance: bc5eda7f-851f-44d8-af95-5e721dd6d52b] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:37.568697 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e6df35cb-7c1a-4d98-baae-a93ea08e2987 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:37.569354 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e6df35cb-7c1a-4d98-baae-a93ea08e2987 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:37.570950 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e6df35cb-7c1a-4d98-baae-a93ea08e2987 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:37.578719 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e6df35cb-7c1a-4d98-baae-a93ea08e2987 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:37.580600 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e6df35cb-7c1a-4d98-baae-a93ea08e2987 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:37.581340 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e6df35cb-7c1a-4d98-baae-a93ea08e2987 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:37.598239 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-e6df35cb-7c1a-4d98-baae-a93ea08e2987 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] HTTP exception thrown: Instance bc5eda7f-851f-44d8-af95-5e721dd6d52b could not be found. Oct 04 19:00:37.600200 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-e6df35cb-7c1a-4d98-baae-a93ea08e2987 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Request method failure captured: Oct 04 19:00:37.600200 n-d-851028-13 devstack@n-api.service[123596]: request: GET /compute/v2.1/servers/bc5eda7f-851f-44d8-af95-5e721dd6d52b HTTP/1.1 Oct 04 19:00:37.600200 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 19:00:37.600200 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 19:00:37.600200 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 19:00:37.600200 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 19:00:37.600200 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 19:00:37.600200 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 19:00:37.600200 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 19:00:37.600200 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 19:00:37.600200 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPID78vmCI9IDPSneDizdTNDV6DvHA8Yu-0Hk2AdriQTEcsN9glvSb6qnq0IhhwuZEnTcyOqvR3DmN0AjQb3MXy0KeUN-iyujvPMDrfVKCEbIzKf9nHEoBLFpzOTLVQVrEHVpIwmUAw_LxUeBUjShHQb88Tzo0W7pmPF365n3rwKGYEI Oct 04 19:00:37.600200 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 19:00:37.600200 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 19:00:37.600200 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 19:00:37.600200 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 19:00:37.600200 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 19:00:37.600200 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 19:00:37.600200 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: 6c91c7e7358048ffaaee7f51ad61b515 Oct 04 19:00:37.600200 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-AttachVolumeNegativeTest-2048626205 Oct 04 19:00:37.600200 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 19:00:37.600200 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 19:00:37.600200 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/6c91c7e7358048ffaaee7f51ad61b515"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_6c91c7e7358048ffaaee7f51ad61b515"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/6c91c7e7358048ffaaee7f51ad61b515"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/6c91c7e7358048ffaaee7f51ad61b515"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 19:00:37.600200 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-AttachVolumeNegativeTest-2048626205 Oct 04 19:00:37.600200 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: 6c91c7e7358048ffaaee7f51ad61b515 Oct 04 19:00:37.600200 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2048626205 Oct 04 19:00:37.600200 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-AttachVolumeNegativeTest-2048626205-project Oct 04 19:00:37.600200 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 19:00:37.600200 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 19:00:37.600200 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 486c22456b1e47ae843ae41f8dfb2632 Oct 04 19:00:37.600200 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-AttachVolumeNegativeTest-2048626205-project Oct 04 19:00:37.600200 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 19:00:37.600200 n-d-851028-13 devstack@n-api.service[123596]: exception: Instance bc5eda7f-851f-44d8-af95-5e721dd6d52b could not be found. Oct 04 19:00:37.600200 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': 'bc5eda7f-851f-44d8-af95-5e721dd6d52b'} Oct 04 19:00:37.600200 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:00:37.600200 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:00:37.600200 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:00:37.600200 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:00:37.600200 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:00:37.600200 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:00:37.600200 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:00:37.600200 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:00:37.600200 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:00:37.600200 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:00:37.600200 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bc5eda7f-851f-44d8-af95-5e721dd6d52b could not be found. Oct 04 19:00:37.600200 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:00:37.600200 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:00:37.600200 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:00:37.600200 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:00:37.600200 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:00:37.600200 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:00:37.600200 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:00:37.600200 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:00:37.600200 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:00:37.600200 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:00:37.600200 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:00:37.600200 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:00:37.600200 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:00:37.600200 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:00:37.600200 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:00:37.600200 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:00:37.600200 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bc5eda7f-851f-44d8-af95-5e721dd6d52b could not be found. Oct 04 19:00:37.600200 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:00:37.600200 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:00:37.600200 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:00:37.604647 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:00:37.604647 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:00:37.604647 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:00:37.604647 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:00:37.604647 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:00:37.604647 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bc5eda7f-851f-44d8-af95-5e721dd6d52b could not be found. Oct 04 19:00:37.604647 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:00:37.607928 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-e6df35cb-7c1a-4d98-baae-a93ea08e2987 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] Returning 404 to user: Instance bc5eda7f-851f-44d8-af95-5e721dd6d52b could not be found. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:00:37.609295 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-e6df35cb-7c1a-4d98-baae-a93ea08e2987 tempest-AttachVolumeNegativeTest-2048626205 tempest-AttachVolumeNegativeTest-2048626205-project] 10.222.0.43 "GET /compute/v2.1/servers/bc5eda7f-851f-44d8-af95-5e721dd6d52b" status: 404 len: 111 microversion: 2.1 time: 0.061504 Oct 04 19:00:37.610391 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2903/5456] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:00:37 2022] GET /compute/v2.1/servers/bc5eda7f-851f-44d8-af95-5e721dd6d52b => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:00:38.441688 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-d69af39a-6e80-4157-8c19-de5c4fe5fe99 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:38.442648 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-d69af39a-6e80-4157-8c19-de5c4fe5fe99 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: ff2c3740-6c13-4727-bd7f-ef56bba605de] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:38.454520 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d69af39a-6e80-4157-8c19-de5c4fe5fe99 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:38.459191 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d69af39a-6e80-4157-8c19-de5c4fe5fe99 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:38.461792 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d69af39a-6e80-4157-8c19-de5c4fe5fe99 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:38.462828 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d69af39a-6e80-4157-8c19-de5c4fe5fe99 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:38.469807 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d69af39a-6e80-4157-8c19-de5c4fe5fe99 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:38.470692 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d69af39a-6e80-4157-8c19-de5c4fe5fe99 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:38.868608 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-d69af39a-6e80-4157-8c19-de5c4fe5fe99 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c997bc60473b43fd9fcf0c65111c44c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a711601b7a439caf395233de1febff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:38.871523 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:00:38.883484 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-d69af39a-6e80-4157-8c19-de5c4fe5fe99 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "GET /compute/v2.1/servers/ff2c3740-6c13-4727-bd7f-ef56bba605de" status: 200 len: 1315 microversion: 2.1 time: 0.447239 Oct 04 19:00:38.885651 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2554/5457] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:00:38 2022] GET /compute/v2.1/servers/ff2c3740-6c13-4727-bd7f-ef56bba605de => generated 1315 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:00:39.259127 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-cd4ef6fb-8225-4d2d-b684-6161375c5e30 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:39.259633 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-cd4ef6fb-8225-4d2d-b684-6161375c5e30 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] [instance: 02a066b4-243b-4fe3-afcf-30f3e9511d1b] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:39.271682 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cd4ef6fb-8225-4d2d-b684-6161375c5e30 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:39.272192 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cd4ef6fb-8225-4d2d-b684-6161375c5e30 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:39.275074 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cd4ef6fb-8225-4d2d-b684-6161375c5e30 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:39.278596 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cd4ef6fb-8225-4d2d-b684-6161375c5e30 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:39.279105 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cd4ef6fb-8225-4d2d-b684-6161375c5e30 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:39.279538 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cd4ef6fb-8225-4d2d-b684-6161375c5e30 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:39.308726 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-cd4ef6fb-8225-4d2d-b684-6161375c5e30 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] HTTP exception thrown: Instance 02a066b4-243b-4fe3-afcf-30f3e9511d1b could not be found. Oct 04 19:00:39.310358 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-cd4ef6fb-8225-4d2d-b684-6161375c5e30 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Request method failure captured: Oct 04 19:00:39.310358 n-d-851028-13 devstack@n-api.service[123596]: request: DELETE /compute/v2.1/servers/02a066b4-243b-4fe3-afcf-30f3e9511d1b HTTP/1.1 Oct 04 19:00:39.310358 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 19:00:39.310358 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 19:00:39.310358 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 19:00:39.310358 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 19:00:39.310358 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 19:00:39.310358 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 19:00:39.310358 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 19:00:39.310358 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 19:00:39.310358 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPIEcbXre-ESQJuRd1aLC5T8gllbmFFTCKdeDOiN6Go5aADI7uQuyX8Zy7CC0S36SP-9lrSX-3k09K1pWQcaYnDOJITbdROnLVSmkqBbc1L2vH4xbRgEegyayj35MKI4pwTZChPGmhVwxX9Zcph6FeLg3D7--ys-z5maAtsuw2rREOyc Oct 04 19:00:39.310358 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 19:00:39.310358 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 19:00:39.310358 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 19:00:39.310358 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 19:00:39.310358 n-d-851028-13 devstack@n-api.service[123596]: X-Openstack-Nova-Api-Version: 2.42 Oct 04 19:00:39.310358 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 19:00:39.310358 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 19:00:39.310358 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: fea78afe01b240f79c3bb2cfc773e502 Oct 04 19:00:39.310358 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-463974423 Oct 04 19:00:39.310358 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 19:00:39.310358 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 19:00:39.310358 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/fea78afe01b240f79c3bb2cfc773e502"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_fea78afe01b240f79c3bb2cfc773e502"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/fea78afe01b240f79c3bb2cfc773e502"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/fea78afe01b240f79c3bb2cfc773e502"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 19:00:39.310358 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-TaggedBootDevicesTest_v242-463974423 Oct 04 19:00:39.310358 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: fea78afe01b240f79c3bb2cfc773e502 Oct 04 19:00:39.310358 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-463974423 Oct 04 19:00:39.310358 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-TaggedBootDevicesTest_v242-463974423-project Oct 04 19:00:39.310358 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 19:00:39.310358 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 19:00:39.310358 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 1dd8fa69e56d47bba065c558ad1f08e4 Oct 04 19:00:39.310358 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-TaggedBootDevicesTest_v242-463974423-project Oct 04 19:00:39.310358 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 19:00:39.310358 n-d-851028-13 devstack@n-api.service[123596]: exception: Instance 02a066b4-243b-4fe3-afcf-30f3e9511d1b could not be found. Oct 04 19:00:39.310358 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': '02a066b4-243b-4fe3-afcf-30f3e9511d1b'} Oct 04 19:00:39.310358 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:00:39.310358 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:00:39.310358 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:00:39.310358 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:00:39.310358 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:00:39.310358 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:00:39.310358 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:00:39.310358 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:00:39.310358 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:00:39.310358 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:00:39.310358 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02a066b4-243b-4fe3-afcf-30f3e9511d1b could not be found. Oct 04 19:00:39.310358 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:00:39.310358 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:00:39.310358 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:00:39.310358 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:00:39.310358 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:00:39.310358 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:00:39.310358 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:00:39.310358 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:00:39.310358 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:00:39.310358 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:00:39.310358 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 19:00:39.310358 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 19:00:39.310358 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 19:00:39.310358 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 19:00:39.310358 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:00:39.310358 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:00:39.310358 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:00:39.310358 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:00:39.316182 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02a066b4-243b-4fe3-afcf-30f3e9511d1b could not be found. Oct 04 19:00:39.316182 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:00:39.316182 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:00:39.316182 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:00:39.316182 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:00:39.316182 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:00:39.316182 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:00:39.316182 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:00:39.316182 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:00:39.316182 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02a066b4-243b-4fe3-afcf-30f3e9511d1b could not be found. Oct 04 19:00:39.316182 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:00:39.316182 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-cd4ef6fb-8225-4d2d-b684-6161375c5e30 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Returning 404 to user: Instance 02a066b4-243b-4fe3-afcf-30f3e9511d1b could not be found. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:00:39.316182 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-cd4ef6fb-8225-4d2d-b684-6161375c5e30 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] 10.222.0.43 "DELETE /compute/v2.1/servers/02a066b4-243b-4fe3-afcf-30f3e9511d1b" status: 404 len: 111 microversion: 2.42 time: 0.060094 Oct 04 19:00:39.322187 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-3e4677f3-eb15-4a20-87a7-e035fa26c410 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:39.322931 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-3e4677f3-eb15-4a20-87a7-e035fa26c410 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] [instance: 02a066b4-243b-4fe3-afcf-30f3e9511d1b] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:39.326685 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2904/5458] 10.222.0.43 () {60 vars in 1280 bytes} [Tue Oct 4 19:00:39 2022] DELETE /compute/v2.1/servers/02a066b4-243b-4fe3-afcf-30f3e9511d1b => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 19:00:39.331038 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3e4677f3-eb15-4a20-87a7-e035fa26c410 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:39.331542 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3e4677f3-eb15-4a20-87a7-e035fa26c410 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:39.332174 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3e4677f3-eb15-4a20-87a7-e035fa26c410 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:39.333061 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3e4677f3-eb15-4a20-87a7-e035fa26c410 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:39.333719 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3e4677f3-eb15-4a20-87a7-e035fa26c410 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:39.334346 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3e4677f3-eb15-4a20-87a7-e035fa26c410 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:39.357583 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-3e4677f3-eb15-4a20-87a7-e035fa26c410 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] HTTP exception thrown: Instance 02a066b4-243b-4fe3-afcf-30f3e9511d1b could not be found. Oct 04 19:00:39.359335 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-3e4677f3-eb15-4a20-87a7-e035fa26c410 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Request method failure captured: Oct 04 19:00:39.359335 n-d-851028-13 devstack@n-api.service[123595]: request: GET /compute/v2.1/servers/02a066b4-243b-4fe3-afcf-30f3e9511d1b HTTP/1.1 Oct 04 19:00:39.359335 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 19:00:39.359335 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 19:00:39.359335 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 19:00:39.359335 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 0 Oct 04 19:00:39.359335 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 19:00:39.359335 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 19:00:39.359335 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 19:00:39.359335 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 19:00:39.359335 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPIEcbXre-ESQJuRd1aLC5T8gllbmFFTCKdeDOiN6Go5aADI7uQuyX8Zy7CC0S36SP-9lrSX-3k09K1pWQcaYnDOJITbdROnLVSmkqBbc1L2vH4xbRgEegyayj35MKI4pwTZChPGmhVwxX9Zcph6FeLg3D7--ys-z5maAtsuw2rREOyc Oct 04 19:00:39.359335 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 19:00:39.359335 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 19:00:39.359335 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 19:00:39.359335 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 19:00:39.359335 n-d-851028-13 devstack@n-api.service[123595]: X-Openstack-Nova-Api-Version: 2.42 Oct 04 19:00:39.359335 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 19:00:39.359335 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 19:00:39.359335 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: fea78afe01b240f79c3bb2cfc773e502 Oct 04 19:00:39.359335 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-463974423 Oct 04 19:00:39.359335 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 19:00:39.359335 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 19:00:39.359335 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/fea78afe01b240f79c3bb2cfc773e502"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_fea78afe01b240f79c3bb2cfc773e502"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/fea78afe01b240f79c3bb2cfc773e502"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/fea78afe01b240f79c3bb2cfc773e502"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 19:00:39.359335 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-TaggedBootDevicesTest_v242-463974423 Oct 04 19:00:39.359335 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: fea78afe01b240f79c3bb2cfc773e502 Oct 04 19:00:39.359335 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-463974423 Oct 04 19:00:39.359335 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-TaggedBootDevicesTest_v242-463974423-project Oct 04 19:00:39.359335 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 19:00:39.359335 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 19:00:39.359335 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: 1dd8fa69e56d47bba065c558ad1f08e4 Oct 04 19:00:39.359335 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-TaggedBootDevicesTest_v242-463974423-project Oct 04 19:00:39.359335 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 19:00:39.359335 n-d-851028-13 devstack@n-api.service[123595]: exception: Instance 02a066b4-243b-4fe3-afcf-30f3e9511d1b could not be found. Oct 04 19:00:39.359335 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': '02a066b4-243b-4fe3-afcf-30f3e9511d1b'} Oct 04 19:00:39.359335 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:00:39.359335 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:00:39.359335 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:00:39.359335 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:00:39.359335 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:00:39.359335 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:00:39.359335 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:00:39.359335 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:00:39.359335 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:00:39.359335 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:00:39.359335 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02a066b4-243b-4fe3-afcf-30f3e9511d1b could not be found. Oct 04 19:00:39.359335 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:00:39.359335 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:00:39.359335 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:00:39.359335 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:00:39.359335 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:00:39.359335 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:00:39.359335 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:00:39.359335 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:00:39.359335 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:00:39.359335 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:00:39.359335 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:00:39.359335 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:00:39.359335 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:00:39.359335 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:00:39.359335 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:00:39.359335 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:00:39.359335 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02a066b4-243b-4fe3-afcf-30f3e9511d1b could not be found. Oct 04 19:00:39.359335 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:00:39.359335 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:00:39.364008 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:00:39.364008 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:00:39.364008 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:00:39.364008 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:00:39.364008 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:00:39.364008 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:00:39.364008 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02a066b4-243b-4fe3-afcf-30f3e9511d1b could not be found. Oct 04 19:00:39.364008 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:00:39.364008 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-3e4677f3-eb15-4a20-87a7-e035fa26c410 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] Returning 404 to user: Instance 02a066b4-243b-4fe3-afcf-30f3e9511d1b could not be found. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:00:39.364008 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-3e4677f3-eb15-4a20-87a7-e035fa26c410 tempest-TaggedBootDevicesTest_v242-463974423 tempest-TaggedBootDevicesTest_v242-463974423-project] 10.222.0.43 "GET /compute/v2.1/servers/02a066b4-243b-4fe3-afcf-30f3e9511d1b" status: 404 len: 111 microversion: 2.42 time: 0.043540 Oct 04 19:00:39.378868 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2555/5459] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:00:39 2022] GET /compute/v2.1/servers/02a066b4-243b-4fe3-afcf-30f3e9511d1b => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 19:00:39.907703 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-d191eda0-87ca-4ba9-8ce8-f7f788834a80 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:39.909431 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-d191eda0-87ca-4ba9-8ce8-f7f788834a80 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: ff2c3740-6c13-4727-bd7f-ef56bba605de] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:39.920666 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d191eda0-87ca-4ba9-8ce8-f7f788834a80 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:39.921819 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d191eda0-87ca-4ba9-8ce8-f7f788834a80 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:39.923746 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d191eda0-87ca-4ba9-8ce8-f7f788834a80 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:39.924825 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d191eda0-87ca-4ba9-8ce8-f7f788834a80 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:39.930673 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d191eda0-87ca-4ba9-8ce8-f7f788834a80 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:39.931907 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d191eda0-87ca-4ba9-8ce8-f7f788834a80 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:40.162594 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-a595f983-4162-4372-b53a-ff2343f8a269 req-1654c22c-1227-49cc-b8af-fe3893434a41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff2c3740-6c13-4727-bd7f-ef56bba605de", "name": "network-vif-plugged", "status": "completed", "tag": "e3885cb7-f6d8-4169-b00f-05ba7abb030d"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:00:40.186839 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-a595f983-4162-4372-b53a-ff2343f8a269 req-1654c22c-1227-49cc-b8af-fe3893434a41 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:40.188866 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-a595f983-4162-4372-b53a-ff2343f8a269 req-1654c22c-1227-49cc-b8af-fe3893434a41 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:40.189623 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-a595f983-4162-4372-b53a-ff2343f8a269 req-1654c22c-1227-49cc-b8af-fe3893434a41 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:40.237176 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-a595f983-4162-4372-b53a-ff2343f8a269 req-1654c22c-1227-49cc-b8af-fe3893434a41 service nova] Creating event network-vif-plugged:e3885cb7-f6d8-4169-b00f-05ba7abb030d for instance ff2c3740-6c13-4727-bd7f-ef56bba605de on n-h1-851028-13 Oct 04 19:00:40.261721 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-a595f983-4162-4372-b53a-ff2343f8a269 req-1654c22c-1227-49cc-b8af-fe3893434a41 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103915 Oct 04 19:00:40.262356 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2556/5460] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:00:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:00:40.611968 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-d191eda0-87ca-4ba9-8ce8-f7f788834a80 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c997bc60473b43fd9fcf0c65111c44c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a711601b7a439caf395233de1febff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:40.633389 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-d191eda0-87ca-4ba9-8ce8-f7f788834a80 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "GET /compute/v2.1/servers/ff2c3740-6c13-4727-bd7f-ef56bba605de" status: 200 len: 1315 microversion: 2.1 time: 0.727392 Oct 04 19:00:40.655699 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2905/5461] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:00:39 2022] GET /compute/v2.1/servers/ff2c3740-6c13-4727-bd7f-ef56bba605de => generated 1315 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:00:41.663272 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-2f8ec79c-8021-42dd-bd99-ae0c707b1f00 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:41.664423 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-2f8ec79c-8021-42dd-bd99-ae0c707b1f00 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: ff2c3740-6c13-4727-bd7f-ef56bba605de] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:41.685171 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2f8ec79c-8021-42dd-bd99-ae0c707b1f00 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:41.688195 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2f8ec79c-8021-42dd-bd99-ae0c707b1f00 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:41.688967 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2f8ec79c-8021-42dd-bd99-ae0c707b1f00 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:41.689963 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2f8ec79c-8021-42dd-bd99-ae0c707b1f00 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:41.692699 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2f8ec79c-8021-42dd-bd99-ae0c707b1f00 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:41.693175 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2f8ec79c-8021-42dd-bd99-ae0c707b1f00 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:42.082478 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-2f8ec79c-8021-42dd-bd99-ae0c707b1f00 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c997bc60473b43fd9fcf0c65111c44c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a711601b7a439caf395233de1febff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:42.099157 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-2f8ec79c-8021-42dd-bd99-ae0c707b1f00 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "GET /compute/v2.1/servers/ff2c3740-6c13-4727-bd7f-ef56bba605de" status: 200 len: 1315 microversion: 2.1 time: 0.441767 Oct 04 19:00:42.110460 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2557/5462] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:00:41 2022] GET /compute/v2.1/servers/ff2c3740-6c13-4727-bd7f-ef56bba605de => generated 1315 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:00:43.137423 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-3d8c0281-caf5-40bc-b404-c3338d1c5573 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:43.158556 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-3d8c0281-caf5-40bc-b404-c3338d1c5573 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: ff2c3740-6c13-4727-bd7f-ef56bba605de] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:43.247208 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3d8c0281-caf5-40bc-b404-c3338d1c5573 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:43.273220 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3d8c0281-caf5-40bc-b404-c3338d1c5573 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:43.275872 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3d8c0281-caf5-40bc-b404-c3338d1c5573 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:43.281416 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3d8c0281-caf5-40bc-b404-c3338d1c5573 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:43.285734 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3d8c0281-caf5-40bc-b404-c3338d1c5573 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:43.287227 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3d8c0281-caf5-40bc-b404-c3338d1c5573 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:44.373627 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-3d8c0281-caf5-40bc-b404-c3338d1c5573 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c997bc60473b43fd9fcf0c65111c44c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a711601b7a439caf395233de1febff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:44.403252 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-3d8c0281-caf5-40bc-b404-c3338d1c5573 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "GET /compute/v2.1/servers/ff2c3740-6c13-4727-bd7f-ef56bba605de" status: 200 len: 1501 microversion: 2.1 time: 1.276755 Oct 04 19:00:44.405833 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2906/5463] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:00:43 2022] GET /compute/v2.1/servers/ff2c3740-6c13-4727-bd7f-ef56bba605de => generated 1501 bytes in 1287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:00:49.040972 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-ab80a43b-3186-4f1f-95cf-46ea5e12b7fe tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e2ca8e49-83d7-4d06-9b0a-204c3cb6b39d"}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:00:49.043226 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-ab80a43b-3186-4f1f-95cf-46ea5e12b7fe tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: ff2c3740-6c13-4727-bd7f-ef56bba605de] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:49.069695 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ab80a43b-3186-4f1f-95cf-46ea5e12b7fe tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:49.070661 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ab80a43b-3186-4f1f-95cf-46ea5e12b7fe tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:49.071404 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ab80a43b-3186-4f1f-95cf-46ea5e12b7fe tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:49.072413 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ab80a43b-3186-4f1f-95cf-46ea5e12b7fe tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:49.073186 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ab80a43b-3186-4f1f-95cf-46ea5e12b7fe tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:49.073879 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ab80a43b-3186-4f1f-95cf-46ea5e12b7fe tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:49.608663 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-ab80a43b-3186-4f1f-95cf-46ea5e12b7fe tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "POST /compute/v2.1/servers/ff2c3740-6c13-4727-bd7f-ef56bba605de/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.572796 Oct 04 19:00:49.632812 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2558/5464] 10.222.0.43 () {60 vars in 1323 bytes} [Tue Oct 4 19:00:49 2022] POST /compute/v2.1/servers/ff2c3740-6c13-4727-bd7f-ef56bba605de/os-volume_attachments => generated 194 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:00:58.671443 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_api:SELECT=28,nova_api:DELETE=1 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:00:58.672238 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=25 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:00:59.524245 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-6f53d880-7103-4a5b-9247-6d9260e8335a tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Action: 'create', calling method: .version_select at 0x7fb21e6d0040>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1557681271", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK78qpxj3NIzhED4Hptbgbb5vaYMyHhX7OGVCyzZKEvqtxsX7NO/rfTdiJRVudy/T610sI3mHvQdkCM7ecErrwCoGcMIKyM2YVrStw4HIozLItUuyliObcTp/CGjn/VO0w=="}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:00:59.580345 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-6f53d880-7103-4a5b-9247-6d9260e8335a tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Getting quotas for project c0c25f1d17e94c74868357744e692487. Resources: {'key_pairs'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:00:59.594941 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-6f53d880-7103-4a5b-9247-6d9260e8335a tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Getting quotas for user bf87794979e844349d6ec6c6650565f7 and project c0c25f1d17e94c74868357744e692487. Resources: {'key_pairs'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:00:59.654022 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-6f53d880-7103-4a5b-9247-6d9260e8335a tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.989432 Oct 04 19:00:59.658683 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2907/5465] 10.222.0.43 () {60 vars in 1159 bytes} [Tue Oct 4 19:00:58 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:01:02.966557 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-a2026e23-2ab2-4002-acb3-914e98f18440 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Action: 'create', calling method: .version_select at 0x7fb21ecb14c0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-426162738", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBLShrDsvv/tvTlIy3yAdf6GXMCK+pzXdsRSVBj3rWsgfPrr+Hm+l/Y9nYgaLF2LxSEDhkqmLvTzI9PTjk4WloPiZ8nPdGQYMGk41xTCvnqVvT70v6wYSTviPCOKMZxHbQ=="}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:01:02.978136 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_api:SELECT=13 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:01:02.978860 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:01:02.999236 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-a2026e23-2ab2-4002-acb3-914e98f18440 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Getting quotas for project 27a4c327763b4440a9dc456cfbb31f88. Resources: {'key_pairs'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:01:03.007741 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-a2026e23-2ab2-4002-acb3-914e98f18440 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Getting quotas for user fc1bb492fb294837b1e55d58bbfa3d0b and project 27a4c327763b4440a9dc456cfbb31f88. Resources: {'key_pairs'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:01:03.048075 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-a2026e23-2ab2-4002-acb3-914e98f18440 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.088028 Oct 04 19:01:03.049294 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2559/5466] 10.222.0.43 () {60 vars in 1159 bytes} [Tue Oct 4 19:01:02 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:01:06.379373 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-d899234f-e97a-4b96-9d9a-c7ae5908fe1c tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1322075393", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452", "networks": [{"uuid": "fb51499d-28f8-409a-b0e3-d6ad265254d5"}], "key_name": "tempest-TestNetworkBasicOps-426162738", "security_groups": [{"name": "tempest-secgroup-smoke-694576848"}]}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:01:06.662968 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.network.neutron [None req-d899234f-e97a-4b96-9d9a-c7ae5908fe1c tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] validate_networks() for [('fb51499d-28f8-409a-b0e3-d6ad265254d5', None, None, None, None, None)] {{(pid=123596) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 19:01:08.294960 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-d899234f-e97a-4b96-9d9a-c7ae5908fe1c tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Flavor limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:01:08.296166 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-d899234f-e97a-4b96-9d9a-c7ae5908fe1c tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Image limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:01:08.297709 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-d899234f-e97a-4b96-9d9a-c7ae5908fe1c tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Flavor pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:01:08.298623 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-d899234f-e97a-4b96-9d9a-c7ae5908fe1c tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Image pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:01:08.299284 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-d899234f-e97a-4b96-9d9a-c7ae5908fe1c tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:01:08.357007 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d899234f-e97a-4b96-9d9a-c7ae5908fe1c tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:08.358365 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d899234f-e97a-4b96-9d9a-c7ae5908fe1c tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:08.359598 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d899234f-e97a-4b96-9d9a-c7ae5908fe1c tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:08.360997 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d899234f-e97a-4b96-9d9a-c7ae5908fe1c tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:08.361550 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d899234f-e97a-4b96-9d9a-c7ae5908fe1c tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:08.362098 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d899234f-e97a-4b96-9d9a-c7ae5908fe1c tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:08.395322 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-d899234f-e97a-4b96-9d9a-c7ae5908fe1c tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Getting quotas for project 27a4c327763b4440a9dc456cfbb31f88. Resources: {'ram', 'cores', 'instances'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:01:08.402756 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-d899234f-e97a-4b96-9d9a-c7ae5908fe1c tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Getting quotas for user fc1bb492fb294837b1e55d58bbfa3d0b and project 27a4c327763b4440a9dc456cfbb31f88. Resources: {'ram', 'cores', 'instances'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:01:08.422309 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-d899234f-e97a-4b96-9d9a-c7ae5908fe1c tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Going to run 1 instances... {{(pid=123596) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 19:01:08.425241 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-d899234f-e97a-4b96-9d9a-c7ae5908fe1c tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] [instance: 03c66e0a-0383-46dc-b2af-0158ae3eacbf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e8943ec5-4038-4d4b-b9b9-2415a79f5243',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123596) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 19:01:08.512034 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-d899234f-e97a-4b96-9d9a-c7ae5908fe1c tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.143881 Oct 04 19:01:08.517581 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2908/5467] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 19:01:06 2022] POST /compute/v2.1/servers => generated 405 bytes in 2150 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 19:01:08.534043 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-652d3629-563a-45c7-879e-7a019482738d tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:08.540048 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-652d3629-563a-45c7-879e-7a019482738d tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] [instance: 03c66e0a-0383-46dc-b2af-0158ae3eacbf] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:08.658462 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-652d3629-563a-45c7-879e-7a019482738d tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1bb492fb294837b1e55d58bbfa3d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a4c327763b4440a9dc456cfbb31f88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:08.672416 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-652d3629-563a-45c7-879e-7a019482738d tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] 10.222.0.43 "GET /compute/v2.1/servers/03c66e0a-0383-46dc-b2af-0158ae3eacbf" status: 200 len: 1248 microversion: 2.1 time: 0.147562 Oct 04 19:01:08.675931 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2560/5468] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:01:08 2022] GET /compute/v2.1/servers/03c66e0a-0383-46dc-b2af-0158ae3eacbf => generated 1248 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:01:09.704127 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-09d8f28c-9a1c-40c0-b743-3409a2d0991d tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:09.704806 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-09d8f28c-9a1c-40c0-b743-3409a2d0991d tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] [instance: 03c66e0a-0383-46dc-b2af-0158ae3eacbf] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:09.730557 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-09d8f28c-9a1c-40c0-b743-3409a2d0991d tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:09.731185 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-09d8f28c-9a1c-40c0-b743-3409a2d0991d tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:09.731651 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-09d8f28c-9a1c-40c0-b743-3409a2d0991d tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:09.732414 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-09d8f28c-9a1c-40c0-b743-3409a2d0991d tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:09.733176 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-09d8f28c-9a1c-40c0-b743-3409a2d0991d tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:09.733634 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-09d8f28c-9a1c-40c0-b743-3409a2d0991d tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:09.926129 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-09d8f28c-9a1c-40c0-b743-3409a2d0991d tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1bb492fb294837b1e55d58bbfa3d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a4c327763b4440a9dc456cfbb31f88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:09.960377 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-09d8f28c-9a1c-40c0-b743-3409a2d0991d tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] 10.222.0.43 "GET /compute/v2.1/servers/03c66e0a-0383-46dc-b2af-0158ae3eacbf" status: 200 len: 1244 microversion: 2.1 time: 0.261658 Oct 04 19:01:09.964843 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2909/5469] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:01:09 2022] GET /compute/v2.1/servers/03c66e0a-0383-46dc-b2af-0158ae3eacbf => generated 1244 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:01:10.990302 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-8a1d665b-a102-4d91-b592-b941b3cc8da8 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:10.991167 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-8a1d665b-a102-4d91-b592-b941b3cc8da8 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] [instance: 03c66e0a-0383-46dc-b2af-0158ae3eacbf] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:11.011244 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8a1d665b-a102-4d91-b592-b941b3cc8da8 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:11.011773 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8a1d665b-a102-4d91-b592-b941b3cc8da8 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:11.016190 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8a1d665b-a102-4d91-b592-b941b3cc8da8 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:11.016923 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8a1d665b-a102-4d91-b592-b941b3cc8da8 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:11.017645 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8a1d665b-a102-4d91-b592-b941b3cc8da8 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:11.021879 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8a1d665b-a102-4d91-b592-b941b3cc8da8 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:11.328468 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-8a1d665b-a102-4d91-b592-b941b3cc8da8 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1bb492fb294837b1e55d58bbfa3d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a4c327763b4440a9dc456cfbb31f88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:11.337320 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-8a1d665b-a102-4d91-b592-b941b3cc8da8 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] 10.222.0.43 "GET /compute/v2.1/servers/03c66e0a-0383-46dc-b2af-0158ae3eacbf" status: 200 len: 1306 microversion: 2.1 time: 0.352506 Oct 04 19:01:11.341078 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2561/5470] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:01:10 2022] GET /compute/v2.1/servers/03c66e0a-0383-46dc-b2af-0158ae3eacbf => generated 1306 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:01:12.368495 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-eb2c0a16-223c-48b4-8f4c-3445414fc59e tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:12.370340 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-eb2c0a16-223c-48b4-8f4c-3445414fc59e tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] [instance: 03c66e0a-0383-46dc-b2af-0158ae3eacbf] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:12.400464 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-eb2c0a16-223c-48b4-8f4c-3445414fc59e tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:12.401731 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-eb2c0a16-223c-48b4-8f4c-3445414fc59e tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:12.402973 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-eb2c0a16-223c-48b4-8f4c-3445414fc59e tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:12.409987 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-eb2c0a16-223c-48b4-8f4c-3445414fc59e tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:12.411525 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-eb2c0a16-223c-48b4-8f4c-3445414fc59e tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:12.412162 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-eb2c0a16-223c-48b4-8f4c-3445414fc59e tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:13.074651 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-eb2c0a16-223c-48b4-8f4c-3445414fc59e tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1bb492fb294837b1e55d58bbfa3d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a4c327763b4440a9dc456cfbb31f88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:13.086090 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-eb2c0a16-223c-48b4-8f4c-3445414fc59e tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] 10.222.0.43 "GET /compute/v2.1/servers/03c66e0a-0383-46dc-b2af-0158ae3eacbf" status: 200 len: 1306 microversion: 2.1 time: 0.721699 Oct 04 19:01:13.089100 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2910/5471] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:01:12 2022] GET /compute/v2.1/servers/03c66e0a-0383-46dc-b2af-0158ae3eacbf => generated 1306 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:01:14.114246 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-768c3f52-69ee-4d0a-8f52-173b47f4be5e tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:14.115154 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-768c3f52-69ee-4d0a-8f52-173b47f4be5e tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] [instance: 03c66e0a-0383-46dc-b2af-0158ae3eacbf] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:14.128966 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-768c3f52-69ee-4d0a-8f52-173b47f4be5e tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:14.130135 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-768c3f52-69ee-4d0a-8f52-173b47f4be5e tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:14.131019 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-768c3f52-69ee-4d0a-8f52-173b47f4be5e tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:14.132324 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-768c3f52-69ee-4d0a-8f52-173b47f4be5e tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:14.133055 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-768c3f52-69ee-4d0a-8f52-173b47f4be5e tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:14.133767 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-768c3f52-69ee-4d0a-8f52-173b47f4be5e tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:14.982514 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-768c3f52-69ee-4d0a-8f52-173b47f4be5e tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1bb492fb294837b1e55d58bbfa3d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a4c327763b4440a9dc456cfbb31f88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:15.008651 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-768c3f52-69ee-4d0a-8f52-173b47f4be5e tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] 10.222.0.43 "GET /compute/v2.1/servers/03c66e0a-0383-46dc-b2af-0158ae3eacbf" status: 200 len: 1373 microversion: 2.1 time: 0.899257 Oct 04 19:01:15.009600 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2562/5472] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:01:14 2022] GET /compute/v2.1/servers/03c66e0a-0383-46dc-b2af-0158ae3eacbf => generated 1373 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:01:15.136664 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-4d772ea9-e162-4a01-acc1-39d9f4df7047 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:15.137341 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-4d772ea9-e162-4a01-acc1-39d9f4df7047 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: ff2c3740-6c13-4727-bd7f-ef56bba605de] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:15.146932 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4d772ea9-e162-4a01-acc1-39d9f4df7047 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:15.147435 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4d772ea9-e162-4a01-acc1-39d9f4df7047 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:15.147920 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4d772ea9-e162-4a01-acc1-39d9f4df7047 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:15.148640 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4d772ea9-e162-4a01-acc1-39d9f4df7047 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:15.149100 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4d772ea9-e162-4a01-acc1-39d9f4df7047 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:15.169057 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4d772ea9-e162-4a01-acc1-39d9f4df7047 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:15.234195 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-4d772ea9-e162-4a01-acc1-39d9f4df7047 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: ff2c3740-6c13-4727-bd7f-ef56bba605de] Going to try to terminate instance {{(pid=123596) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 19:01:15.556767 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-4d772ea9-e162-4a01-acc1-39d9f4df7047 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "DELETE /compute/v2.1/servers/ff2c3740-6c13-4727-bd7f-ef56bba605de" status: 204 len: 0 microversion: 2.1 time: 0.424448 Oct 04 19:01:15.557572 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2911/5473] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 19:01:15 2022] DELETE /compute/v2.1/servers/ff2c3740-6c13-4727-bd7f-ef56bba605de => generated 0 bytes in 426 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:01:15.566911 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-0625ccb1-1944-41c4-9495-66164c0fdb1f tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:15.567689 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-0625ccb1-1944-41c4-9495-66164c0fdb1f tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: ff2c3740-6c13-4727-bd7f-ef56bba605de] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:15.580299 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0625ccb1-1944-41c4-9495-66164c0fdb1f tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:15.580804 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0625ccb1-1944-41c4-9495-66164c0fdb1f tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:15.584895 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0625ccb1-1944-41c4-9495-66164c0fdb1f tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:15.590937 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0625ccb1-1944-41c4-9495-66164c0fdb1f tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:15.591662 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0625ccb1-1944-41c4-9495-66164c0fdb1f tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:15.592295 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0625ccb1-1944-41c4-9495-66164c0fdb1f tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:16.037734 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-5ee78698-4060-4292-a0ed-e83f6a2f9aee tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:16.039321 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-5ee78698-4060-4292-a0ed-e83f6a2f9aee tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] [instance: 03c66e0a-0383-46dc-b2af-0158ae3eacbf] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:16.056662 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5ee78698-4060-4292-a0ed-e83f6a2f9aee tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:16.059308 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5ee78698-4060-4292-a0ed-e83f6a2f9aee tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:16.061888 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5ee78698-4060-4292-a0ed-e83f6a2f9aee tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:16.063917 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5ee78698-4060-4292-a0ed-e83f6a2f9aee tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:16.066114 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5ee78698-4060-4292-a0ed-e83f6a2f9aee tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:16.066797 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5ee78698-4060-4292-a0ed-e83f6a2f9aee tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:16.338498 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-0625ccb1-1944-41c4-9495-66164c0fdb1f tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c997bc60473b43fd9fcf0c65111c44c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a711601b7a439caf395233de1febff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:16.353690 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-0625ccb1-1944-41c4-9495-66164c0fdb1f tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "GET /compute/v2.1/servers/ff2c3740-6c13-4727-bd7f-ef56bba605de" status: 200 len: 1553 microversion: 2.1 time: 0.788877 Oct 04 19:01:16.356934 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2563/5474] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:01:15 2022] GET /compute/v2.1/servers/ff2c3740-6c13-4727-bd7f-ef56bba605de => generated 1553 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:01:16.689838 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-5ee78698-4060-4292-a0ed-e83f6a2f9aee tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1bb492fb294837b1e55d58bbfa3d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a4c327763b4440a9dc456cfbb31f88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:16.700017 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-5ee78698-4060-4292-a0ed-e83f6a2f9aee tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] 10.222.0.43 "GET /compute/v2.1/servers/03c66e0a-0383-46dc-b2af-0158ae3eacbf" status: 200 len: 1373 microversion: 2.1 time: 0.668544 Oct 04 19:01:16.717444 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2912/5475] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:01:16 2022] GET /compute/v2.1/servers/03c66e0a-0383-46dc-b2af-0158ae3eacbf => generated 1373 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:01:17.027235 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-c38121fc-802f-48f8-8fd6-6c3aa741f575 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-940428373", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452", "networks": [{"uuid": "ad11fafe-fb1d-464e-9c79-92764cfb7015"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1557681271", "security_groups": [{"name": "tempest-secgroup-smoke-1548189234"}]}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:01:17.385103 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-4b2d8497-2411-40a5-90f3-100458f94daa tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:17.385926 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-4b2d8497-2411-40a5-90f3-100458f94daa tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: ff2c3740-6c13-4727-bd7f-ef56bba605de] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:17.401557 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4b2d8497-2411-40a5-90f3-100458f94daa tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:17.402084 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4b2d8497-2411-40a5-90f3-100458f94daa tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:17.402539 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4b2d8497-2411-40a5-90f3-100458f94daa tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:17.406384 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4b2d8497-2411-40a5-90f3-100458f94daa tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:17.406809 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4b2d8497-2411-40a5-90f3-100458f94daa tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:17.409895 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4b2d8497-2411-40a5-90f3-100458f94daa tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:17.844635 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-4b2d8497-2411-40a5-90f3-100458f94daa tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c997bc60473b43fd9fcf0c65111c44c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a711601b7a439caf395233de1febff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:17.856756 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-4b2d8497-2411-40a5-90f3-100458f94daa tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "GET /compute/v2.1/servers/ff2c3740-6c13-4727-bd7f-ef56bba605de" status: 200 len: 1553 microversion: 2.1 time: 0.480065 Oct 04 19:01:17.860915 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2913/5476] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:01:17 2022] GET /compute/v2.1/servers/ff2c3740-6c13-4727-bd7f-ef56bba605de => generated 1553 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:01:17.866076 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-42021438-5354-4993-9721-0660eb2b2b4f tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:17.875322 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-42021438-5354-4993-9721-0660eb2b2b4f tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] [instance: 03c66e0a-0383-46dc-b2af-0158ae3eacbf] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:17.888551 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-42021438-5354-4993-9721-0660eb2b2b4f tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:17.889148 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-42021438-5354-4993-9721-0660eb2b2b4f tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:17.893172 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-42021438-5354-4993-9721-0660eb2b2b4f tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:17.894025 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-42021438-5354-4993-9721-0660eb2b2b4f tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:17.894575 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-42021438-5354-4993-9721-0660eb2b2b4f tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:17.895083 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-42021438-5354-4993-9721-0660eb2b2b4f tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:17.959954 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.network.neutron [None req-c38121fc-802f-48f8-8fd6-6c3aa741f575 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] validate_networks() for [('ad11fafe-fb1d-464e-9c79-92764cfb7015', None, None, None, None, None)] {{(pid=123595) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 19:01:18.432320 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=2 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:01:18.435232 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=10 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:01:18.671860 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=6 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:01:19.282328 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-42021438-5354-4993-9721-0660eb2b2b4f tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1bb492fb294837b1e55d58bbfa3d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a4c327763b4440a9dc456cfbb31f88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:19.303346 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-42021438-5354-4993-9721-0660eb2b2b4f tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] 10.222.0.43 "GET /compute/v2.1/servers/03c66e0a-0383-46dc-b2af-0158ae3eacbf" status: 200 len: 1373 microversion: 2.1 time: 1.435905 Oct 04 19:01:19.304903 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2914/5477] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:01:17 2022] GET /compute/v2.1/servers/03c66e0a-0383-46dc-b2af-0158ae3eacbf => generated 1373 bytes in 1443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:01:19.314811 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-ef71b808-e0d5-49cd-a9eb-40bbe66ec67c tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:19.316065 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-ef71b808-e0d5-49cd-a9eb-40bbe66ec67c tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: ff2c3740-6c13-4727-bd7f-ef56bba605de] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:19.342387 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ef71b808-e0d5-49cd-a9eb-40bbe66ec67c tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:19.343661 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ef71b808-e0d5-49cd-a9eb-40bbe66ec67c tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:19.345589 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ef71b808-e0d5-49cd-a9eb-40bbe66ec67c tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:19.346902 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ef71b808-e0d5-49cd-a9eb-40bbe66ec67c tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:19.349405 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ef71b808-e0d5-49cd-a9eb-40bbe66ec67c tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:19.351582 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ef71b808-e0d5-49cd-a9eb-40bbe66ec67c tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:19.665197 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-ef71b808-e0d5-49cd-a9eb-40bbe66ec67c tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c997bc60473b43fd9fcf0c65111c44c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a711601b7a439caf395233de1febff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:19.688010 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-ef71b808-e0d5-49cd-a9eb-40bbe66ec67c tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "GET /compute/v2.1/servers/ff2c3740-6c13-4727-bd7f-ef56bba605de" status: 200 len: 1553 microversion: 2.1 time: 0.377476 Oct 04 19:01:19.693822 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2915/5478] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:01:19 2022] GET /compute/v2.1/servers/ff2c3740-6c13-4727-bd7f-ef56bba605de => generated 1553 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:01:19.700361 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-88bd3b66-7e25-4885-b514-9cfcb8d9c186 req-b6dd791e-8762-4068-abe4-70e932471e7a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03c66e0a-0383-46dc-b2af-0158ae3eacbf", "tag": "7fc80ed0-682f-4c8a-859e-2ef4cbc1e353"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:01:19.727796 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-88bd3b66-7e25-4885-b514-9cfcb8d9c186 req-b6dd791e-8762-4068-abe4-70e932471e7a service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:19.732506 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-88bd3b66-7e25-4885-b514-9cfcb8d9c186 req-b6dd791e-8762-4068-abe4-70e932471e7a service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:19.734014 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-88bd3b66-7e25-4885-b514-9cfcb8d9c186 req-b6dd791e-8762-4068-abe4-70e932471e7a service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:19.771535 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-88bd3b66-7e25-4885-b514-9cfcb8d9c186 req-b6dd791e-8762-4068-abe4-70e932471e7a service nova] Creating event network-changed:7fc80ed0-682f-4c8a-859e-2ef4cbc1e353 for instance 03c66e0a-0383-46dc-b2af-0158ae3eacbf on n-h2-851028-13 Oct 04 19:01:19.777485 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-88bd3b66-7e25-4885-b514-9cfcb8d9c186 req-b6dd791e-8762-4068-abe4-70e932471e7a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082228 Oct 04 19:01:19.778775 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2916/5479] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:01:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:01:20.327857 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-d20d23d8-2055-42da-85d8-e2a25d8f9d3b tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:20.330487 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-d20d23d8-2055-42da-85d8-e2a25d8f9d3b tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] [instance: 03c66e0a-0383-46dc-b2af-0158ae3eacbf] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:20.347551 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d20d23d8-2055-42da-85d8-e2a25d8f9d3b tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:20.348257 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d20d23d8-2055-42da-85d8-e2a25d8f9d3b tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:20.359889 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d20d23d8-2055-42da-85d8-e2a25d8f9d3b tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:20.359889 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d20d23d8-2055-42da-85d8-e2a25d8f9d3b tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:20.359889 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d20d23d8-2055-42da-85d8-e2a25d8f9d3b tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:20.360278 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d20d23d8-2055-42da-85d8-e2a25d8f9d3b tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:20.588935 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-c38121fc-802f-48f8-8fd6-6c3aa741f575 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Flavor limits 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:01:20.589935 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-c38121fc-802f-48f8-8fd6-6c3aa741f575 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Image limits 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:01:20.599724 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-c38121fc-802f-48f8-8fd6-6c3aa741f575 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Flavor pref 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:01:20.600186 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-c38121fc-802f-48f8-8fd6-6c3aa741f575 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Image pref 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:01:20.600623 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-c38121fc-802f-48f8-8fd6-6c3aa741f575 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:01:20.637837 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c38121fc-802f-48f8-8fd6-6c3aa741f575 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:20.644691 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c38121fc-802f-48f8-8fd6-6c3aa741f575 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:20.645609 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c38121fc-802f-48f8-8fd6-6c3aa741f575 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:20.646805 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c38121fc-802f-48f8-8fd6-6c3aa741f575 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:20.647441 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c38121fc-802f-48f8-8fd6-6c3aa741f575 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:20.648616 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c38121fc-802f-48f8-8fd6-6c3aa741f575 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:20.717966 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-c38121fc-802f-48f8-8fd6-6c3aa741f575 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Getting quotas for project c0c25f1d17e94c74868357744e692487. Resources: {'ram', 'cores', 'instances'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:01:20.733946 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-c38121fc-802f-48f8-8fd6-6c3aa741f575 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Getting quotas for user bf87794979e844349d6ec6c6650565f7 and project c0c25f1d17e94c74868357744e692487. Resources: {'ram', 'cores', 'instances'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:01:20.767557 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-c38121fc-802f-48f8-8fd6-6c3aa741f575 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Going to run 1 instances... {{(pid=123595) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 19:01:20.776347 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-c38121fc-802f-48f8-8fd6-6c3aa741f575 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] [instance: 32f44032-85ec-43eb-b714-748a7f4f0b5b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e8943ec5-4038-4d4b-b9b9-2415a79f5243',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 19:01:20.882129 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-c38121fc-802f-48f8-8fd6-6c3aa741f575 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 3.865587 Oct 04 19:01:20.885276 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2564/5480] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 19:01:17 2022] POST /compute/v2.1/servers => generated 406 bytes in 3869 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 19:01:20.893803 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-fe4b6e56-fdfe-43bc-9681-6c24f23c364a tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:20.898446 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-fe4b6e56-fdfe-43bc-9681-6c24f23c364a tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: ff2c3740-6c13-4727-bd7f-ef56bba605de] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:20.917361 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fe4b6e56-fdfe-43bc-9681-6c24f23c364a tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:20.918051 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fe4b6e56-fdfe-43bc-9681-6c24f23c364a tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:20.918663 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fe4b6e56-fdfe-43bc-9681-6c24f23c364a tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:20.920522 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fe4b6e56-fdfe-43bc-9681-6c24f23c364a tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:20.921755 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fe4b6e56-fdfe-43bc-9681-6c24f23c364a tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:20.925001 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fe4b6e56-fdfe-43bc-9681-6c24f23c364a tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:21.046531 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-fe4b6e56-fdfe-43bc-9681-6c24f23c364a tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c997bc60473b43fd9fcf0c65111c44c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a711601b7a439caf395233de1febff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:21.056510 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-fe4b6e56-fdfe-43bc-9681-6c24f23c364a tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "GET /compute/v2.1/servers/ff2c3740-6c13-4727-bd7f-ef56bba605de" status: 200 len: 1346 microversion: 2.1 time: 0.166654 Oct 04 19:01:21.059601 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2565/5481] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:01:20 2022] GET /compute/v2.1/servers/ff2c3740-6c13-4727-bd7f-ef56bba605de => generated 1346 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:01:21.074801 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-5c2ccf26-1b69-408a-95bf-43ffc2aab447 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:21.075674 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-5c2ccf26-1b69-408a-95bf-43ffc2aab447 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] [instance: 32f44032-85ec-43eb-b714-748a7f4f0b5b] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:21.216876 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-5c2ccf26-1b69-408a-95bf-43ffc2aab447 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf87794979e844349d6ec6c6650565f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c25f1d17e94c74868357744e692487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:21.230947 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-5c2ccf26-1b69-408a-95bf-43ffc2aab447 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] 10.222.0.43 "GET /compute/v2.1/servers/32f44032-85ec-43eb-b714-748a7f4f0b5b" status: 200 len: 1266 microversion: 2.1 time: 0.155093 Oct 04 19:01:21.231769 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2566/5482] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:01:21 2022] GET /compute/v2.1/servers/32f44032-85ec-43eb-b714-748a7f4f0b5b => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:01:21.420836 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-d20d23d8-2055-42da-85d8-e2a25d8f9d3b tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1bb492fb294837b1e55d58bbfa3d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a4c327763b4440a9dc456cfbb31f88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:21.432263 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-d20d23d8-2055-42da-85d8-e2a25d8f9d3b tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] 10.222.0.43 "GET /compute/v2.1/servers/03c66e0a-0383-46dc-b2af-0158ae3eacbf" status: 200 len: 1373 microversion: 2.1 time: 1.107546 Oct 04 19:01:21.433942 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2917/5483] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:01:20 2022] GET /compute/v2.1/servers/03c66e0a-0383-46dc-b2af-0158ae3eacbf => generated 1373 bytes in 1111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:01:21.856814 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-8aaf0ebf-e656-4920-9246-703cd8538c05 req-54fd4fc0-b5a0-4be8-a371-9e4b178e49c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff2c3740-6c13-4727-bd7f-ef56bba605de", "name": "network-vif-deleted", "tag": "e3885cb7-f6d8-4169-b00f-05ba7abb030d"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:01:21.885769 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-8aaf0ebf-e656-4920-9246-703cd8538c05 req-54fd4fc0-b5a0-4be8-a371-9e4b178e49c1 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:21.888741 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-8aaf0ebf-e656-4920-9246-703cd8538c05 req-54fd4fc0-b5a0-4be8-a371-9e4b178e49c1 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:21.889434 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-8aaf0ebf-e656-4920-9246-703cd8538c05 req-54fd4fc0-b5a0-4be8-a371-9e4b178e49c1 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:21.959393 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-8aaf0ebf-e656-4920-9246-703cd8538c05 req-54fd4fc0-b5a0-4be8-a371-9e4b178e49c1 service nova] Creating event network-vif-deleted:e3885cb7-f6d8-4169-b00f-05ba7abb030d for instance ff2c3740-6c13-4727-bd7f-ef56bba605de on n-h1-851028-13 Oct 04 19:01:21.975211 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-8aaf0ebf-e656-4920-9246-703cd8538c05 req-54fd4fc0-b5a0-4be8-a371-9e4b178e49c1 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120750 Oct 04 19:01:21.976452 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2567/5484] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:01:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:01:22.086911 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-60bc54ce-b5ce-48f0-9cf6-2245c3c74e36 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:22.087607 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-60bc54ce-b5ce-48f0-9cf6-2245c3c74e36 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: ff2c3740-6c13-4727-bd7f-ef56bba605de] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:22.122287 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-60bc54ce-b5ce-48f0-9cf6-2245c3c74e36 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:22.129316 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-60bc54ce-b5ce-48f0-9cf6-2245c3c74e36 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:22.129940 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-60bc54ce-b5ce-48f0-9cf6-2245c3c74e36 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:22.143082 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-60bc54ce-b5ce-48f0-9cf6-2245c3c74e36 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:22.146879 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-60bc54ce-b5ce-48f0-9cf6-2245c3c74e36 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:22.147347 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-60bc54ce-b5ce-48f0-9cf6-2245c3c74e36 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:22.258522 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-2817fce0-c25d-452d-8a1e-e1f816a76c99 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:22.259373 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-2817fce0-c25d-452d-8a1e-e1f816a76c99 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] [instance: 32f44032-85ec-43eb-b714-748a7f4f0b5b] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:22.285469 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2817fce0-c25d-452d-8a1e-e1f816a76c99 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:22.286068 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2817fce0-c25d-452d-8a1e-e1f816a76c99 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:22.286541 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2817fce0-c25d-452d-8a1e-e1f816a76c99 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:22.290383 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2817fce0-c25d-452d-8a1e-e1f816a76c99 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:22.291918 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2817fce0-c25d-452d-8a1e-e1f816a76c99 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:22.319115 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2817fce0-c25d-452d-8a1e-e1f816a76c99 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:22.495492 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-60bc54ce-b5ce-48f0-9cf6-2245c3c74e36 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c997bc60473b43fd9fcf0c65111c44c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a711601b7a439caf395233de1febff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:22.513650 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-60bc54ce-b5ce-48f0-9cf6-2245c3c74e36 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "GET /compute/v2.1/servers/ff2c3740-6c13-4727-bd7f-ef56bba605de" status: 200 len: 1346 microversion: 2.1 time: 0.430468 Oct 04 19:01:22.516704 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2918/5485] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:01:22 2022] GET /compute/v2.1/servers/ff2c3740-6c13-4727-bd7f-ef56bba605de => generated 1346 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:01:22.556714 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-bf175b2e-6ce8-4654-88e9-d2535628d5de tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:22.560724 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-bf175b2e-6ce8-4654-88e9-d2535628d5de tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] [instance: 03c66e0a-0383-46dc-b2af-0158ae3eacbf] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:22.587208 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bf175b2e-6ce8-4654-88e9-d2535628d5de tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:22.597416 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bf175b2e-6ce8-4654-88e9-d2535628d5de tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:22.603619 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bf175b2e-6ce8-4654-88e9-d2535628d5de tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:22.607430 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bf175b2e-6ce8-4654-88e9-d2535628d5de tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:22.611769 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bf175b2e-6ce8-4654-88e9-d2535628d5de tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:22.614481 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bf175b2e-6ce8-4654-88e9-d2535628d5de tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:22.669202 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-2817fce0-c25d-452d-8a1e-e1f816a76c99 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf87794979e844349d6ec6c6650565f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c25f1d17e94c74868357744e692487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:22.681443 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-2817fce0-c25d-452d-8a1e-e1f816a76c99 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] 10.222.0.43 "GET /compute/v2.1/servers/32f44032-85ec-43eb-b714-748a7f4f0b5b" status: 200 len: 1270 microversion: 2.1 time: 0.428952 Oct 04 19:01:22.684732 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2568/5486] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:01:22 2022] GET /compute/v2.1/servers/32f44032-85ec-43eb-b714-748a7f4f0b5b => generated 1270 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:01:23.263501 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-bf175b2e-6ce8-4654-88e9-d2535628d5de tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1bb492fb294837b1e55d58bbfa3d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a4c327763b4440a9dc456cfbb31f88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:23.273318 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-bf175b2e-6ce8-4654-88e9-d2535628d5de tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] 10.222.0.43 "GET /compute/v2.1/servers/03c66e0a-0383-46dc-b2af-0158ae3eacbf" status: 200 len: 1373 microversion: 2.1 time: 0.754498 Oct 04 19:01:23.279430 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2919/5487] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:01:22 2022] GET /compute/v2.1/servers/03c66e0a-0383-46dc-b2af-0158ae3eacbf => generated 1373 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:01:23.542529 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-df6d0270-51e7-4ac2-846d-958c33a37cb5 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:23.543144 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-df6d0270-51e7-4ac2-846d-958c33a37cb5 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: ff2c3740-6c13-4727-bd7f-ef56bba605de] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:23.555198 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-df6d0270-51e7-4ac2-846d-958c33a37cb5 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:23.558129 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-df6d0270-51e7-4ac2-846d-958c33a37cb5 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:23.572426 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-df6d0270-51e7-4ac2-846d-958c33a37cb5 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:23.575845 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-df6d0270-51e7-4ac2-846d-958c33a37cb5 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:23.582875 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-df6d0270-51e7-4ac2-846d-958c33a37cb5 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:23.583511 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-df6d0270-51e7-4ac2-846d-958c33a37cb5 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:23.707532 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-dbb56a5b-bbcf-4338-be13-aa2e85cd2527 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:23.708150 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-dbb56a5b-bbcf-4338-be13-aa2e85cd2527 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] [instance: 32f44032-85ec-43eb-b714-748a7f4f0b5b] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:23.724422 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dbb56a5b-bbcf-4338-be13-aa2e85cd2527 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:23.724951 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dbb56a5b-bbcf-4338-be13-aa2e85cd2527 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:23.733747 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dbb56a5b-bbcf-4338-be13-aa2e85cd2527 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:23.734825 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dbb56a5b-bbcf-4338-be13-aa2e85cd2527 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:23.735489 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dbb56a5b-bbcf-4338-be13-aa2e85cd2527 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:23.737935 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dbb56a5b-bbcf-4338-be13-aa2e85cd2527 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:24.079826 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-dbb56a5b-bbcf-4338-be13-aa2e85cd2527 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf87794979e844349d6ec6c6650565f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c25f1d17e94c74868357744e692487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:24.101992 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-dbb56a5b-bbcf-4338-be13-aa2e85cd2527 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] 10.222.0.43 "GET /compute/v2.1/servers/32f44032-85ec-43eb-b714-748a7f4f0b5b" status: 200 len: 1324 microversion: 2.1 time: 0.399004 Oct 04 19:01:24.108174 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2920/5488] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:01:23 2022] GET /compute/v2.1/servers/32f44032-85ec-43eb-b714-748a7f4f0b5b => generated 1324 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:01:24.201426 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-df6d0270-51e7-4ac2-846d-958c33a37cb5 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c997bc60473b43fd9fcf0c65111c44c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a711601b7a439caf395233de1febff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:24.212223 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-df6d0270-51e7-4ac2-846d-958c33a37cb5 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "GET /compute/v2.1/servers/ff2c3740-6c13-4727-bd7f-ef56bba605de" status: 200 len: 1346 microversion: 2.1 time: 0.674096 Oct 04 19:01:24.225952 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2569/5489] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:01:23 2022] GET /compute/v2.1/servers/ff2c3740-6c13-4727-bd7f-ef56bba605de => generated 1346 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:01:24.306972 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-c63f841f-f23d-4f77-80c2-1b6986a6c74f tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:24.307939 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-c63f841f-f23d-4f77-80c2-1b6986a6c74f tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] [instance: 03c66e0a-0383-46dc-b2af-0158ae3eacbf] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:24.323458 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c63f841f-f23d-4f77-80c2-1b6986a6c74f tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:24.324276 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c63f841f-f23d-4f77-80c2-1b6986a6c74f tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:24.324950 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c63f841f-f23d-4f77-80c2-1b6986a6c74f tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:24.325943 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c63f841f-f23d-4f77-80c2-1b6986a6c74f tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:24.326653 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c63f841f-f23d-4f77-80c2-1b6986a6c74f tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:24.335438 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c63f841f-f23d-4f77-80c2-1b6986a6c74f tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:24.782318 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-c63f841f-f23d-4f77-80c2-1b6986a6c74f tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1bb492fb294837b1e55d58bbfa3d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a4c327763b4440a9dc456cfbb31f88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:24.792232 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-c63f841f-f23d-4f77-80c2-1b6986a6c74f tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] 10.222.0.43 "GET /compute/v2.1/servers/03c66e0a-0383-46dc-b2af-0158ae3eacbf" status: 200 len: 1373 microversion: 2.1 time: 0.489894 Oct 04 19:01:24.794325 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2921/5490] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:01:24 2022] GET /compute/v2.1/servers/03c66e0a-0383-46dc-b2af-0158ae3eacbf => generated 1373 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:01:25.132415 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-a2ac5fc5-e84c-4bed-ad02-3b8771e496e6 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:25.133050 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-a2ac5fc5-e84c-4bed-ad02-3b8771e496e6 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] [instance: 32f44032-85ec-43eb-b714-748a7f4f0b5b] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:25.155857 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a2ac5fc5-e84c-4bed-ad02-3b8771e496e6 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:25.156628 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a2ac5fc5-e84c-4bed-ad02-3b8771e496e6 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:25.158796 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a2ac5fc5-e84c-4bed-ad02-3b8771e496e6 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:25.159673 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a2ac5fc5-e84c-4bed-ad02-3b8771e496e6 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:25.162449 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a2ac5fc5-e84c-4bed-ad02-3b8771e496e6 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:25.165467 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a2ac5fc5-e84c-4bed-ad02-3b8771e496e6 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:25.248599 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-eaa66d34-ada9-49ed-80df-5bda360a4b97 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:25.249601 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-eaa66d34-ada9-49ed-80df-5bda360a4b97 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: ff2c3740-6c13-4727-bd7f-ef56bba605de] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:25.268410 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-eaa66d34-ada9-49ed-80df-5bda360a4b97 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:25.276061 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-eaa66d34-ada9-49ed-80df-5bda360a4b97 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:25.276653 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-eaa66d34-ada9-49ed-80df-5bda360a4b97 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:25.283712 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-eaa66d34-ada9-49ed-80df-5bda360a4b97 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:25.285403 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-eaa66d34-ada9-49ed-80df-5bda360a4b97 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:25.285882 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-eaa66d34-ada9-49ed-80df-5bda360a4b97 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:25.407269 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-a2ac5fc5-e84c-4bed-ad02-3b8771e496e6 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf87794979e844349d6ec6c6650565f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c25f1d17e94c74868357744e692487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:25.422449 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-a2ac5fc5-e84c-4bed-ad02-3b8771e496e6 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] 10.222.0.43 "GET /compute/v2.1/servers/32f44032-85ec-43eb-b714-748a7f4f0b5b" status: 200 len: 1324 microversion: 2.1 time: 0.290756 Oct 04 19:01:25.424268 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2570/5491] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:01:25 2022] GET /compute/v2.1/servers/32f44032-85ec-43eb-b714-748a7f4f0b5b => generated 1324 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:01:25.500436 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-eaa66d34-ada9-49ed-80df-5bda360a4b97 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c997bc60473b43fd9fcf0c65111c44c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a711601b7a439caf395233de1febff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:25.519118 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-eaa66d34-ada9-49ed-80df-5bda360a4b97 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "GET /compute/v2.1/servers/ff2c3740-6c13-4727-bd7f-ef56bba605de" status: 200 len: 1346 microversion: 2.1 time: 0.269210 Oct 04 19:01:25.523354 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2922/5492] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:01:25 2022] GET /compute/v2.1/servers/ff2c3740-6c13-4727-bd7f-ef56bba605de => generated 1346 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:01:25.819986 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-521529bb-c922-4f9c-b6e6-ac379271ceba tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:25.820989 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-521529bb-c922-4f9c-b6e6-ac379271ceba tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] [instance: 03c66e0a-0383-46dc-b2af-0158ae3eacbf] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:25.834586 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-521529bb-c922-4f9c-b6e6-ac379271ceba tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:25.835543 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-521529bb-c922-4f9c-b6e6-ac379271ceba tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:25.836214 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-521529bb-c922-4f9c-b6e6-ac379271ceba tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:25.837803 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-521529bb-c922-4f9c-b6e6-ac379271ceba tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:25.838425 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-521529bb-c922-4f9c-b6e6-ac379271ceba tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:25.840804 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-521529bb-c922-4f9c-b6e6-ac379271ceba tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:26.232209 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-521529bb-c922-4f9c-b6e6-ac379271ceba tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1bb492fb294837b1e55d58bbfa3d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a4c327763b4440a9dc456cfbb31f88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:26.246022 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-521529bb-c922-4f9c-b6e6-ac379271ceba tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] 10.222.0.43 "GET /compute/v2.1/servers/03c66e0a-0383-46dc-b2af-0158ae3eacbf" status: 200 len: 1373 microversion: 2.1 time: 0.429943 Oct 04 19:01:26.254390 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2571/5493] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:01:25 2022] GET /compute/v2.1/servers/03c66e0a-0383-46dc-b2af-0158ae3eacbf => generated 1373 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:01:26.392733 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-197fe09e-aa41-406e-9e31-8974f5c49eca req-1b77f9a6-0d93-41f2-9a5e-381b54e0b2ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03c66e0a-0383-46dc-b2af-0158ae3eacbf", "name": "network-vif-plugged", "status": "completed", "tag": "7fc80ed0-682f-4c8a-859e-2ef4cbc1e353"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:01:26.441926 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-197fe09e-aa41-406e-9e31-8974f5c49eca req-1b77f9a6-0d93-41f2-9a5e-381b54e0b2ce service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:26.442438 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-197fe09e-aa41-406e-9e31-8974f5c49eca req-1b77f9a6-0d93-41f2-9a5e-381b54e0b2ce service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:26.442892 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-197fe09e-aa41-406e-9e31-8974f5c49eca req-1b77f9a6-0d93-41f2-9a5e-381b54e0b2ce service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:26.450157 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-9e55bdcb-b6e2-4a57-9b38-9bb027f97354 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:26.450804 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-9e55bdcb-b6e2-4a57-9b38-9bb027f97354 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] [instance: 32f44032-85ec-43eb-b714-748a7f4f0b5b] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:26.487978 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9e55bdcb-b6e2-4a57-9b38-9bb027f97354 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:26.488486 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9e55bdcb-b6e2-4a57-9b38-9bb027f97354 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:26.488940 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9e55bdcb-b6e2-4a57-9b38-9bb027f97354 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:26.495507 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9e55bdcb-b6e2-4a57-9b38-9bb027f97354 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:26.503991 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9e55bdcb-b6e2-4a57-9b38-9bb027f97354 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:26.504683 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9e55bdcb-b6e2-4a57-9b38-9bb027f97354 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:26.509137 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-197fe09e-aa41-406e-9e31-8974f5c49eca req-1b77f9a6-0d93-41f2-9a5e-381b54e0b2ce service nova] Creating event network-vif-plugged:7fc80ed0-682f-4c8a-859e-2ef4cbc1e353 for instance 03c66e0a-0383-46dc-b2af-0158ae3eacbf on n-h2-851028-13 Oct 04 19:01:26.531087 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-197fe09e-aa41-406e-9e31-8974f5c49eca req-1b77f9a6-0d93-41f2-9a5e-381b54e0b2ce service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.140862 Oct 04 19:01:26.535616 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2923/5494] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:01:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:01:26.550844 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f9e67200-07da-4302-bd53-927ad76a7600 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:26.551577 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-f9e67200-07da-4302-bd53-927ad76a7600 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: ff2c3740-6c13-4727-bd7f-ef56bba605de] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:26.583586 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f9e67200-07da-4302-bd53-927ad76a7600 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:26.584111 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f9e67200-07da-4302-bd53-927ad76a7600 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:26.584565 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f9e67200-07da-4302-bd53-927ad76a7600 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:26.588313 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f9e67200-07da-4302-bd53-927ad76a7600 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:26.590405 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f9e67200-07da-4302-bd53-927ad76a7600 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:26.591690 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f9e67200-07da-4302-bd53-927ad76a7600 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:27.436482 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-f9e67200-07da-4302-bd53-927ad76a7600 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c997bc60473b43fd9fcf0c65111c44c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a711601b7a439caf395233de1febff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:27.448213 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:01:27.455348 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-f9e67200-07da-4302-bd53-927ad76a7600 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "GET /compute/v2.1/servers/ff2c3740-6c13-4727-bd7f-ef56bba605de" status: 200 len: 1346 microversion: 2.1 time: 0.908718 Oct 04 19:01:27.463519 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2924/5495] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:01:26 2022] GET /compute/v2.1/servers/ff2c3740-6c13-4727-bd7f-ef56bba605de => generated 1346 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:01:27.501388 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-4857fd83-0e4b-4985-a3b1-7bba884215e3 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:27.504633 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-4857fd83-0e4b-4985-a3b1-7bba884215e3 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] [instance: 03c66e0a-0383-46dc-b2af-0158ae3eacbf] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:27.513193 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-9e55bdcb-b6e2-4a57-9b38-9bb027f97354 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf87794979e844349d6ec6c6650565f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c25f1d17e94c74868357744e692487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:27.523005 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-9e55bdcb-b6e2-4a57-9b38-9bb027f97354 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] 10.222.0.43 "GET /compute/v2.1/servers/32f44032-85ec-43eb-b714-748a7f4f0b5b" status: 200 len: 1392 microversion: 2.1 time: 1.076860 Oct 04 19:01:27.525387 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4857fd83-0e4b-4985-a3b1-7bba884215e3 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:27.525921 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2572/5496] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:01:26 2022] GET /compute/v2.1/servers/32f44032-85ec-43eb-b714-748a7f4f0b5b => generated 1392 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:01:27.537372 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4857fd83-0e4b-4985-a3b1-7bba884215e3 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:27.537372 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4857fd83-0e4b-4985-a3b1-7bba884215e3 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:27.537372 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4857fd83-0e4b-4985-a3b1-7bba884215e3 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:27.537372 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4857fd83-0e4b-4985-a3b1-7bba884215e3 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:27.537372 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4857fd83-0e4b-4985-a3b1-7bba884215e3 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:27.839149 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-4857fd83-0e4b-4985-a3b1-7bba884215e3 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1bb492fb294837b1e55d58bbfa3d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a4c327763b4440a9dc456cfbb31f88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:27.850167 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-4857fd83-0e4b-4985-a3b1-7bba884215e3 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] 10.222.0.43 "GET /compute/v2.1/servers/03c66e0a-0383-46dc-b2af-0158ae3eacbf" status: 200 len: 1373 microversion: 2.1 time: 0.368212 Oct 04 19:01:27.854653 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2925/5497] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:01:27 2022] GET /compute/v2.1/servers/03c66e0a-0383-46dc-b2af-0158ae3eacbf => generated 1373 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:01:28.494612 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-44dd9112-958f-4652-bbc2-59bbb7b07279 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:28.495306 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-44dd9112-958f-4652-bbc2-59bbb7b07279 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: ff2c3740-6c13-4727-bd7f-ef56bba605de] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:28.508516 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-44dd9112-958f-4652-bbc2-59bbb7b07279 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:28.532130 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-44dd9112-958f-4652-bbc2-59bbb7b07279 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:28.534511 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-44dd9112-958f-4652-bbc2-59bbb7b07279 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:28.540204 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-44dd9112-958f-4652-bbc2-59bbb7b07279 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:28.544139 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-44dd9112-958f-4652-bbc2-59bbb7b07279 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:28.547261 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-44dd9112-958f-4652-bbc2-59bbb7b07279 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:28.555544 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-ca27d637-7227-4c94-a258-5b67cec3dc9a tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:28.556352 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-ca27d637-7227-4c94-a258-5b67cec3dc9a tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] [instance: 32f44032-85ec-43eb-b714-748a7f4f0b5b] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:28.579018 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ca27d637-7227-4c94-a258-5b67cec3dc9a tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:28.582240 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ca27d637-7227-4c94-a258-5b67cec3dc9a tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:28.583747 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ca27d637-7227-4c94-a258-5b67cec3dc9a tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:28.586294 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ca27d637-7227-4c94-a258-5b67cec3dc9a tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:28.587059 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ca27d637-7227-4c94-a258-5b67cec3dc9a tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:28.589129 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ca27d637-7227-4c94-a258-5b67cec3dc9a tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:29.029578 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-ca27d637-7227-4c94-a258-5b67cec3dc9a tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf87794979e844349d6ec6c6650565f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c25f1d17e94c74868357744e692487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:29.085672 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-ca27d637-7227-4c94-a258-5b67cec3dc9a tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] 10.222.0.43 "GET /compute/v2.1/servers/32f44032-85ec-43eb-b714-748a7f4f0b5b" status: 200 len: 1392 microversion: 2.1 time: 0.536242 Oct 04 19:01:29.089214 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2926/5498] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:01:28 2022] GET /compute/v2.1/servers/32f44032-85ec-43eb-b714-748a7f4f0b5b => generated 1392 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:01:29.101574 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-e12e6d30-90dd-42f5-b861-b7043caa0773 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:29.103840 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-e12e6d30-90dd-42f5-b861-b7043caa0773 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] [instance: 03c66e0a-0383-46dc-b2af-0158ae3eacbf] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:29.108430 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:01:29.121177 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e12e6d30-90dd-42f5-b861-b7043caa0773 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:29.122549 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e12e6d30-90dd-42f5-b861-b7043caa0773 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:29.123823 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e12e6d30-90dd-42f5-b861-b7043caa0773 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:29.125737 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e12e6d30-90dd-42f5-b861-b7043caa0773 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:29.127191 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e12e6d30-90dd-42f5-b861-b7043caa0773 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:29.129680 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e12e6d30-90dd-42f5-b861-b7043caa0773 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:29.292587 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-44dd9112-958f-4652-bbc2-59bbb7b07279 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c997bc60473b43fd9fcf0c65111c44c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a711601b7a439caf395233de1febff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:29.314992 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-44dd9112-958f-4652-bbc2-59bbb7b07279 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "GET /compute/v2.1/servers/ff2c3740-6c13-4727-bd7f-ef56bba605de" status: 200 len: 1346 microversion: 2.1 time: 0.822295 Oct 04 19:01:29.316193 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2573/5499] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:01:28 2022] GET /compute/v2.1/servers/ff2c3740-6c13-4727-bd7f-ef56bba605de => generated 1346 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:01:29.582810 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-e12e6d30-90dd-42f5-b861-b7043caa0773 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1bb492fb294837b1e55d58bbfa3d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a4c327763b4440a9dc456cfbb31f88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:29.594395 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-e12e6d30-90dd-42f5-b861-b7043caa0773 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] 10.222.0.43 "GET /compute/v2.1/servers/03c66e0a-0383-46dc-b2af-0158ae3eacbf" status: 200 len: 1545 microversion: 2.1 time: 0.503396 Oct 04 19:01:29.594952 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2927/5500] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:01:29 2022] GET /compute/v2.1/servers/03c66e0a-0383-46dc-b2af-0158ae3eacbf => generated 1545 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:01:29.624968 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-ca7794e0-0d8f-4967-a80f-4d4f38a403d2 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:29.626397 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-ca7794e0-0d8f-4967-a80f-4d4f38a403d2 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] [instance: 03c66e0a-0383-46dc-b2af-0158ae3eacbf] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:29.655146 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ca7794e0-0d8f-4967-a80f-4d4f38a403d2 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:29.655711 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ca7794e0-0d8f-4967-a80f-4d4f38a403d2 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:29.657381 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ca7794e0-0d8f-4967-a80f-4d4f38a403d2 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:29.659766 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ca7794e0-0d8f-4967-a80f-4d4f38a403d2 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:29.664697 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ca7794e0-0d8f-4967-a80f-4d4f38a403d2 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:29.665274 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ca7794e0-0d8f-4967-a80f-4d4f38a403d2 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:29.789049 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-d7988770-d7f5-43f2-8956-bc4632ba16a5 req-d4ec3193-b3d3-40e8-8427-f7ed4e4e66e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32f44032-85ec-43eb-b714-748a7f4f0b5b", "tag": "d12de55b-02be-4f93-aca2-a6044af93e38"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:01:29.813350 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-d7988770-d7f5-43f2-8956-bc4632ba16a5 req-d4ec3193-b3d3-40e8-8427-f7ed4e4e66e0 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:29.813857 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-d7988770-d7f5-43f2-8956-bc4632ba16a5 req-d4ec3193-b3d3-40e8-8427-f7ed4e4e66e0 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:29.814424 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-d7988770-d7f5-43f2-8956-bc4632ba16a5 req-d4ec3193-b3d3-40e8-8427-f7ed4e4e66e0 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:29.843449 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-d7988770-d7f5-43f2-8956-bc4632ba16a5 req-d4ec3193-b3d3-40e8-8427-f7ed4e4e66e0 service nova] Creating event network-changed:d12de55b-02be-4f93-aca2-a6044af93e38 for instance 32f44032-85ec-43eb-b714-748a7f4f0b5b on n-h1-851028-13 Oct 04 19:01:29.857333 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-d7988770-d7f5-43f2-8956-bc4632ba16a5 req-d4ec3193-b3d3-40e8-8427-f7ed4e4e66e0 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074530 Oct 04 19:01:29.860790 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2928/5501] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:01:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:01:30.115839 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-92cf2bab-9de0-4494-accf-bad269e7c5ca tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:30.116640 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-92cf2bab-9de0-4494-accf-bad269e7c5ca tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] [instance: 32f44032-85ec-43eb-b714-748a7f4f0b5b] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:30.143844 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-92cf2bab-9de0-4494-accf-bad269e7c5ca tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:30.145059 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-92cf2bab-9de0-4494-accf-bad269e7c5ca tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:30.147128 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-92cf2bab-9de0-4494-accf-bad269e7c5ca tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:30.152566 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-92cf2bab-9de0-4494-accf-bad269e7c5ca tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:30.153096 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-92cf2bab-9de0-4494-accf-bad269e7c5ca tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:30.153573 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-92cf2bab-9de0-4494-accf-bad269e7c5ca tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:30.288005 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-ca7794e0-0d8f-4967-a80f-4d4f38a403d2 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1bb492fb294837b1e55d58bbfa3d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a4c327763b4440a9dc456cfbb31f88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:30.315879 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-ca7794e0-0d8f-4967-a80f-4d4f38a403d2 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] 10.222.0.43 "GET /compute/v2.1/servers/03c66e0a-0383-46dc-b2af-0158ae3eacbf" status: 200 len: 1545 microversion: 2.1 time: 0.697914 Oct 04 19:01:30.318935 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2574/5502] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:01:29 2022] GET /compute/v2.1/servers/03c66e0a-0383-46dc-b2af-0158ae3eacbf => generated 1545 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:01:30.344691 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-808b831f-235a-4e40-b789-c840c86c5eab tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:30.351596 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-808b831f-235a-4e40-b789-c840c86c5eab tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: ff2c3740-6c13-4727-bd7f-ef56bba605de] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:30.371531 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-808b831f-235a-4e40-b789-c840c86c5eab tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:30.374659 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-808b831f-235a-4e40-b789-c840c86c5eab tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:30.376874 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-808b831f-235a-4e40-b789-c840c86c5eab tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:30.381237 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-808b831f-235a-4e40-b789-c840c86c5eab tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:30.382185 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-808b831f-235a-4e40-b789-c840c86c5eab tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:30.389231 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-808b831f-235a-4e40-b789-c840c86c5eab tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:30.675487 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=2 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:01:30.787812 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-808b831f-235a-4e40-b789-c840c86c5eab tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c997bc60473b43fd9fcf0c65111c44c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a711601b7a439caf395233de1febff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:30.802473 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-808b831f-235a-4e40-b789-c840c86c5eab tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "GET /compute/v2.1/servers/ff2c3740-6c13-4727-bd7f-ef56bba605de" status: 200 len: 1346 microversion: 2.1 time: 0.466519 Oct 04 19:01:30.806878 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2575/5503] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:01:30 2022] GET /compute/v2.1/servers/ff2c3740-6c13-4727-bd7f-ef56bba605de => generated 1346 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:01:31.158033 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-92cf2bab-9de0-4494-accf-bad269e7c5ca tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf87794979e844349d6ec6c6650565f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c25f1d17e94c74868357744e692487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:31.178448 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-92cf2bab-9de0-4494-accf-bad269e7c5ca tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] 10.222.0.43 "GET /compute/v2.1/servers/32f44032-85ec-43eb-b714-748a7f4f0b5b" status: 200 len: 1392 microversion: 2.1 time: 1.067395 Oct 04 19:01:31.179287 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2929/5504] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:01:30 2022] GET /compute/v2.1/servers/32f44032-85ec-43eb-b714-748a7f4f0b5b => generated 1392 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:01:31.834650 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-ae83a41c-dcb2-4e74-9789-700589dd6f81 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:31.840355 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-ae83a41c-dcb2-4e74-9789-700589dd6f81 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: ff2c3740-6c13-4727-bd7f-ef56bba605de] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:31.849262 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=8 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:01:31.868369 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ae83a41c-dcb2-4e74-9789-700589dd6f81 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:31.868921 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ae83a41c-dcb2-4e74-9789-700589dd6f81 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:31.869416 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ae83a41c-dcb2-4e74-9789-700589dd6f81 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:31.870168 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ae83a41c-dcb2-4e74-9789-700589dd6f81 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:31.886902 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ae83a41c-dcb2-4e74-9789-700589dd6f81 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:31.887493 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ae83a41c-dcb2-4e74-9789-700589dd6f81 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:31.974405 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ae83a41c-dcb2-4e74-9789-700589dd6f81 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:31.985436 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ae83a41c-dcb2-4e74-9789-700589dd6f81 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:31.986266 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ae83a41c-dcb2-4e74-9789-700589dd6f81 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:31.986905 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.objects.instance [None req-ae83a41c-dcb2-4e74-9789-700589dd6f81 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lazy-loading 'fault' on Instance uuid ff2c3740-6c13-4727-bd7f-ef56bba605de {{(pid=123595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 19:01:32.205390 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-09ffa4ed-af38-4d4d-8ee0-edba57209163 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:32.208053 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-09ffa4ed-af38-4d4d-8ee0-edba57209163 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] [instance: 32f44032-85ec-43eb-b714-748a7f4f0b5b] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:32.232808 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-09ffa4ed-af38-4d4d-8ee0-edba57209163 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:32.236537 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-09ffa4ed-af38-4d4d-8ee0-edba57209163 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:32.237567 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-09ffa4ed-af38-4d4d-8ee0-edba57209163 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:32.242404 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-09ffa4ed-af38-4d4d-8ee0-edba57209163 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:32.243060 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-09ffa4ed-af38-4d4d-8ee0-edba57209163 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:32.246015 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-09ffa4ed-af38-4d4d-8ee0-edba57209163 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:32.304459 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-ae83a41c-dcb2-4e74-9789-700589dd6f81 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c997bc60473b43fd9fcf0c65111c44c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a711601b7a439caf395233de1febff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:32.315098 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-ae83a41c-dcb2-4e74-9789-700589dd6f81 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "GET /compute/v2.1/servers/ff2c3740-6c13-4727-bd7f-ef56bba605de" status: 200 len: 1305 microversion: 2.1 time: 0.489851 Oct 04 19:01:32.341277 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2576/5505] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:01:31 2022] GET /compute/v2.1/servers/ff2c3740-6c13-4727-bd7f-ef56bba605de => generated 1305 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:01:32.685092 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-09ffa4ed-af38-4d4d-8ee0-edba57209163 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf87794979e844349d6ec6c6650565f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c25f1d17e94c74868357744e692487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:32.696043 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-09ffa4ed-af38-4d4d-8ee0-edba57209163 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] 10.222.0.43 "GET /compute/v2.1/servers/32f44032-85ec-43eb-b714-748a7f4f0b5b" status: 200 len: 1392 microversion: 2.1 time: 0.497807 Oct 04 19:01:32.696970 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2930/5506] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:01:32 2022] GET /compute/v2.1/servers/32f44032-85ec-43eb-b714-748a7f4f0b5b => generated 1392 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:01:33.358695 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-2155b4ad-842c-499b-a1fb-1b69530f2118 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:33.359932 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-2155b4ad-842c-499b-a1fb-1b69530f2118 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: ff2c3740-6c13-4727-bd7f-ef56bba605de] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:33.370335 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=4 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:01:33.371926 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2155b4ad-842c-499b-a1fb-1b69530f2118 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:33.372489 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2155b4ad-842c-499b-a1fb-1b69530f2118 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:33.373142 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2155b4ad-842c-499b-a1fb-1b69530f2118 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:33.374006 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2155b4ad-842c-499b-a1fb-1b69530f2118 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:33.374489 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2155b4ad-842c-499b-a1fb-1b69530f2118 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:33.374938 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2155b4ad-842c-499b-a1fb-1b69530f2118 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:33.388950 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=85 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:01:33.439077 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-2155b4ad-842c-499b-a1fb-1b69530f2118 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] HTTP exception thrown: Instance ff2c3740-6c13-4727-bd7f-ef56bba605de could not be found. Oct 04 19:01:33.441681 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-2155b4ad-842c-499b-a1fb-1b69530f2118 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Request method failure captured: Oct 04 19:01:33.441681 n-d-851028-13 devstack@n-api.service[123595]: request: GET /compute/v2.1/servers/ff2c3740-6c13-4727-bd7f-ef56bba605de HTTP/1.1 Oct 04 19:01:33.441681 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 19:01:33.441681 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 19:01:33.441681 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 19:01:33.441681 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 0 Oct 04 19:01:33.441681 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 19:01:33.441681 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 19:01:33.441681 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 19:01:33.441681 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 19:01:33.441681 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPIKl7r6ZFtp0u4zXtNLGIhqHo70GyUJnklFY8mLM6SAvqzMqMYlk7FNNMFRu1dxhVJoaHCY-KymtUU7SbzcnaY3gmI4NmuaRKJjk_WfnM3eNlWdo1XIjmy2xIfTxketrHpoedtH-76PD0N1ebOmJq-sWqhFc1j62MJ2QKuwEgYmouJ4 Oct 04 19:01:33.441681 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 19:01:33.441681 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 19:01:33.441681 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 19:01:33.441681 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 19:01:33.441681 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 19:01:33.441681 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 19:01:33.441681 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: a6a711601b7a439caf395233de1febff Oct 04 19:01:33.441681 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-DeleteServersTestJSON-591734195 Oct 04 19:01:33.441681 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 19:01:33.441681 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 19:01:33.441681 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/a6a711601b7a439caf395233de1febff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_a6a711601b7a439caf395233de1febff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a6a711601b7a439caf395233de1febff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a6a711601b7a439caf395233de1febff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 19:01:33.441681 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-DeleteServersTestJSON-591734195 Oct 04 19:01:33.441681 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: a6a711601b7a439caf395233de1febff Oct 04 19:01:33.441681 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-DeleteServersTestJSON-591734195 Oct 04 19:01:33.441681 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-DeleteServersTestJSON-591734195-project Oct 04 19:01:33.441681 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 19:01:33.441681 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 19:01:33.441681 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: c997bc60473b43fd9fcf0c65111c44c0 Oct 04 19:01:33.441681 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-DeleteServersTestJSON-591734195-project Oct 04 19:01:33.441681 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 19:01:33.441681 n-d-851028-13 devstack@n-api.service[123595]: exception: Instance ff2c3740-6c13-4727-bd7f-ef56bba605de could not be found. Oct 04 19:01:33.441681 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': 'ff2c3740-6c13-4727-bd7f-ef56bba605de'} Oct 04 19:01:33.441681 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:01:33.441681 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:01:33.441681 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:01:33.441681 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:01:33.441681 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:01:33.441681 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:01:33.441681 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:01:33.441681 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:01:33.441681 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:01:33.441681 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:01:33.441681 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff2c3740-6c13-4727-bd7f-ef56bba605de could not be found. Oct 04 19:01:33.441681 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:01:33.441681 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:01:33.441681 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:01:33.441681 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:01:33.441681 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:01:33.441681 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:01:33.441681 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:01:33.441681 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:01:33.441681 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:01:33.441681 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:01:33.441681 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:01:33.441681 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:01:33.441681 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:01:33.441681 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:01:33.441681 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:01:33.441681 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:01:33.441681 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff2c3740-6c13-4727-bd7f-ef56bba605de could not be found. Oct 04 19:01:33.441681 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:01:33.441681 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:01:33.441681 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:01:33.446619 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:01:33.446619 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:01:33.446619 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:01:33.446619 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:01:33.446619 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:01:33.446619 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff2c3740-6c13-4727-bd7f-ef56bba605de could not be found. Oct 04 19:01:33.446619 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:01:33.446619 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-2155b4ad-842c-499b-a1fb-1b69530f2118 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Returning 404 to user: Instance ff2c3740-6c13-4727-bd7f-ef56bba605de could not be found. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:01:33.448141 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-2155b4ad-842c-499b-a1fb-1b69530f2118 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "GET /compute/v2.1/servers/ff2c3740-6c13-4727-bd7f-ef56bba605de" status: 404 len: 111 microversion: 2.1 time: 0.094792 Oct 04 19:01:33.448939 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2577/5507] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:01:33 2022] GET /compute/v2.1/servers/ff2c3740-6c13-4727-bd7f-ef56bba605de => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 19:01:33.658571 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-bb486ddd-fd5a-4de9-ae14-6675e04a53d5 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:33.665871 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-bb486ddd-fd5a-4de9-ae14-6675e04a53d5 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: ff2c3740-6c13-4727-bd7f-ef56bba605de] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:33.683502 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bb486ddd-fd5a-4de9-ae14-6675e04a53d5 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:33.686853 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bb486ddd-fd5a-4de9-ae14-6675e04a53d5 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:33.687486 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bb486ddd-fd5a-4de9-ae14-6675e04a53d5 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:33.688325 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bb486ddd-fd5a-4de9-ae14-6675e04a53d5 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:33.689227 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bb486ddd-fd5a-4de9-ae14-6675e04a53d5 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:33.690257 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bb486ddd-fd5a-4de9-ae14-6675e04a53d5 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:33.717657 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-bb486ddd-fd5a-4de9-ae14-6675e04a53d5 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] HTTP exception thrown: Instance ff2c3740-6c13-4727-bd7f-ef56bba605de could not be found. Oct 04 19:01:33.725325 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-bb486ddd-fd5a-4de9-ae14-6675e04a53d5 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Request method failure captured: Oct 04 19:01:33.725325 n-d-851028-13 devstack@n-api.service[123596]: request: GET /compute/v2.1/servers/ff2c3740-6c13-4727-bd7f-ef56bba605de/os-volume_attachments HTTP/1.1 Oct 04 19:01:33.725325 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 19:01:33.725325 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 19:01:33.725325 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 19:01:33.725325 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 19:01:33.725325 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 19:01:33.725325 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 19:01:33.725325 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 19:01:33.725325 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 19:01:33.725325 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPIKl7r6ZFtp0u4zXtNLGIhqHo70GyUJnklFY8mLM6SAvqzMqMYlk7FNNMFRu1dxhVJoaHCY-KymtUU7SbzcnaY3gmI4NmuaRKJjk_WfnM3eNlWdo1XIjmy2xIfTxketrHpoedtH-76PD0N1ebOmJq-sWqhFc1j62MJ2QKuwEgYmouJ4 Oct 04 19:01:33.725325 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 19:01:33.725325 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 19:01:33.725325 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 19:01:33.725325 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 19:01:33.725325 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 19:01:33.725325 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 19:01:33.725325 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: a6a711601b7a439caf395233de1febff Oct 04 19:01:33.725325 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-DeleteServersTestJSON-591734195 Oct 04 19:01:33.725325 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 19:01:33.725325 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 19:01:33.725325 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/a6a711601b7a439caf395233de1febff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_a6a711601b7a439caf395233de1febff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a6a711601b7a439caf395233de1febff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a6a711601b7a439caf395233de1febff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 19:01:33.725325 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-DeleteServersTestJSON-591734195 Oct 04 19:01:33.725325 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: a6a711601b7a439caf395233de1febff Oct 04 19:01:33.725325 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-DeleteServersTestJSON-591734195 Oct 04 19:01:33.725325 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-DeleteServersTestJSON-591734195-project Oct 04 19:01:33.725325 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 19:01:33.725325 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 19:01:33.725325 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: c997bc60473b43fd9fcf0c65111c44c0 Oct 04 19:01:33.725325 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-DeleteServersTestJSON-591734195-project Oct 04 19:01:33.725325 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 19:01:33.725325 n-d-851028-13 devstack@n-api.service[123596]: exception: Instance ff2c3740-6c13-4727-bd7f-ef56bba605de could not be found. Oct 04 19:01:33.725325 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'server_id': 'ff2c3740-6c13-4727-bd7f-ef56bba605de'} Oct 04 19:01:33.725325 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:01:33.725325 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:01:33.725325 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:01:33.725325 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:01:33.725325 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:01:33.725325 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:01:33.725325 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:01:33.725325 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:01:33.725325 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:01:33.725325 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:01:33.725325 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff2c3740-6c13-4727-bd7f-ef56bba605de could not be found. Oct 04 19:01:33.725325 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:01:33.725325 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:01:33.725325 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:01:33.725325 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:01:33.725325 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:01:33.725325 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:01:33.725325 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:01:33.725325 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:01:33.725325 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:01:33.725325 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:01:33.725325 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 19:01:33.725325 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 19:01:33.725325 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 19:01:33.725325 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 19:01:33.725325 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 04 19:01:33.725325 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 04 19:01:33.725325 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:01:33.725325 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:01:33.729330 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff2c3740-6c13-4727-bd7f-ef56bba605de could not be found. Oct 04 19:01:33.729330 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:01:33.729330 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:01:33.729330 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:01:33.729330 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:01:33.729330 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:01:33.729330 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:01:33.729330 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:01:33.729330 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:01:33.729330 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff2c3740-6c13-4727-bd7f-ef56bba605de could not be found. Oct 04 19:01:33.729330 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:01:33.729330 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-bb486ddd-fd5a-4de9-ae14-6675e04a53d5 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Returning 404 to user: Instance ff2c3740-6c13-4727-bd7f-ef56bba605de could not be found. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:01:33.730271 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-bb486ddd-fd5a-4de9-ae14-6675e04a53d5 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "GET /compute/v2.1/servers/ff2c3740-6c13-4727-bd7f-ef56bba605de/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.077271 Oct 04 19:01:33.732829 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2931/5508] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Oct 4 19:01:33 2022] GET /compute/v2.1/servers/ff2c3740-6c13-4727-bd7f-ef56bba605de/os-volume_attachments => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:01:33.740423 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-9433ff88-92db-49b3-aea2-34746b6aa3e9 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:33.741984 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-9433ff88-92db-49b3-aea2-34746b6aa3e9 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] [instance: 32f44032-85ec-43eb-b714-748a7f4f0b5b] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:33.758212 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9433ff88-92db-49b3-aea2-34746b6aa3e9 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:33.763840 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9433ff88-92db-49b3-aea2-34746b6aa3e9 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:33.769648 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9433ff88-92db-49b3-aea2-34746b6aa3e9 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:33.772807 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9433ff88-92db-49b3-aea2-34746b6aa3e9 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:33.773675 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9433ff88-92db-49b3-aea2-34746b6aa3e9 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:33.775384 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9433ff88-92db-49b3-aea2-34746b6aa3e9 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:34.071580 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-10ee6c1a-2554-45e5-bb5f-4ddef16d331a tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1381566366", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452", "networks": [{"uuid": "dcd99798-7080-4c74-b648-36288a298add"}]}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:01:34.203558 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.network.neutron [None req-10ee6c1a-2554-45e5-bb5f-4ddef16d331a tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] validate_networks() for [('dcd99798-7080-4c74-b648-36288a298add', None, None, None, None, None)] {{(pid=123596) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 19:01:34.247809 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-9433ff88-92db-49b3-aea2-34746b6aa3e9 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf87794979e844349d6ec6c6650565f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c25f1d17e94c74868357744e692487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:34.258571 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-9433ff88-92db-49b3-aea2-34746b6aa3e9 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] 10.222.0.43 "GET /compute/v2.1/servers/32f44032-85ec-43eb-b714-748a7f4f0b5b" status: 200 len: 1392 microversion: 2.1 time: 0.528404 Oct 04 19:01:34.259794 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2578/5509] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:01:33 2022] GET /compute/v2.1/servers/32f44032-85ec-43eb-b714-748a7f4f0b5b => generated 1392 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:01:35.285273 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-f7224b24-5c0e-4b5e-8c36-94da4e1cc805 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:35.286435 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-f7224b24-5c0e-4b5e-8c36-94da4e1cc805 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] [instance: 32f44032-85ec-43eb-b714-748a7f4f0b5b] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:35.295754 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f7224b24-5c0e-4b5e-8c36-94da4e1cc805 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:35.296515 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f7224b24-5c0e-4b5e-8c36-94da4e1cc805 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:35.297712 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f7224b24-5c0e-4b5e-8c36-94da4e1cc805 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:35.298612 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f7224b24-5c0e-4b5e-8c36-94da4e1cc805 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:35.299310 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f7224b24-5c0e-4b5e-8c36-94da4e1cc805 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:35.299903 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f7224b24-5c0e-4b5e-8c36-94da4e1cc805 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:35.516419 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-f7224b24-5c0e-4b5e-8c36-94da4e1cc805 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf87794979e844349d6ec6c6650565f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c25f1d17e94c74868357744e692487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:35.525686 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-f7224b24-5c0e-4b5e-8c36-94da4e1cc805 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] 10.222.0.43 "GET /compute/v2.1/servers/32f44032-85ec-43eb-b714-748a7f4f0b5b" status: 200 len: 1392 microversion: 2.1 time: 0.245584 Oct 04 19:01:35.527018 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2579/5510] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:01:35 2022] GET /compute/v2.1/servers/32f44032-85ec-43eb-b714-748a7f4f0b5b => generated 1392 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:01:35.816651 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-10ee6c1a-2554-45e5-bb5f-4ddef16d331a tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Flavor limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:01:35.817157 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-10ee6c1a-2554-45e5-bb5f-4ddef16d331a tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Image limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:01:35.817639 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-10ee6c1a-2554-45e5-bb5f-4ddef16d331a tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Flavor pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:01:35.818061 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-10ee6c1a-2554-45e5-bb5f-4ddef16d331a tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Image pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:01:35.818893 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-10ee6c1a-2554-45e5-bb5f-4ddef16d331a tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:01:35.838048 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-10ee6c1a-2554-45e5-bb5f-4ddef16d331a tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:35.838960 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-10ee6c1a-2554-45e5-bb5f-4ddef16d331a tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:35.839577 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-10ee6c1a-2554-45e5-bb5f-4ddef16d331a tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:35.840866 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-10ee6c1a-2554-45e5-bb5f-4ddef16d331a tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:35.841584 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-10ee6c1a-2554-45e5-bb5f-4ddef16d331a tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:35.842363 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-10ee6c1a-2554-45e5-bb5f-4ddef16d331a tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:35.867491 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-10ee6c1a-2554-45e5-bb5f-4ddef16d331a tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Getting quotas for project a6a711601b7a439caf395233de1febff. Resources: {'ram', 'cores', 'instances'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:01:35.890670 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-10ee6c1a-2554-45e5-bb5f-4ddef16d331a tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Getting quotas for user c997bc60473b43fd9fcf0c65111c44c0 and project a6a711601b7a439caf395233de1febff. Resources: {'ram', 'cores', 'instances'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:01:35.922818 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-10ee6c1a-2554-45e5-bb5f-4ddef16d331a tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Going to run 1 instances... {{(pid=123596) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 19:01:35.926634 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-10ee6c1a-2554-45e5-bb5f-4ddef16d331a tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: f5756da0-e167-4a21-881d-1479b42314db] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e8943ec5-4038-4d4b-b9b9-2415a79f5243',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123596) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 19:01:36.037028 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-10ee6c1a-2554-45e5-bb5f-4ddef16d331a tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.969412 Oct 04 19:01:36.038258 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2932/5511] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 19:01:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 1971 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 19:01:36.049876 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-4cd10a50-5c19-4119-868c-171898a84043 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:36.050692 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-4cd10a50-5c19-4119-868c-171898a84043 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: f5756da0-e167-4a21-881d-1479b42314db] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:36.235171 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-4cd10a50-5c19-4119-868c-171898a84043 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c997bc60473b43fd9fcf0c65111c44c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a711601b7a439caf395233de1febff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:36.251420 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-4cd10a50-5c19-4119-868c-171898a84043 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "GET /compute/v2.1/servers/f5756da0-e167-4a21-881d-1479b42314db" status: 200 len: 1215 microversion: 2.1 time: 0.198959 Oct 04 19:01:36.265550 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2580/5512] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:01:36 2022] GET /compute/v2.1/servers/f5756da0-e167-4a21-881d-1479b42314db => generated 1215 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:01:36.274551 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-a5920407-7622-4dc8-88eb-63f72debfb05 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:36.274950 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-a5920407-7622-4dc8-88eb-63f72debfb05 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: f5756da0-e167-4a21-881d-1479b42314db] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:36.302465 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-a5920407-7622-4dc8-88eb-63f72debfb05 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: f5756da0-e167-4a21-881d-1479b42314db] Going to try to terminate instance {{(pid=123596) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 19:01:36.550842 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-183162de-8cf3-4ac4-b2bb-4c4dc037a0ab tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:36.552731 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-183162de-8cf3-4ac4-b2bb-4c4dc037a0ab tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] [instance: 32f44032-85ec-43eb-b714-748a7f4f0b5b] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:36.577688 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-183162de-8cf3-4ac4-b2bb-4c4dc037a0ab tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:36.578193 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-183162de-8cf3-4ac4-b2bb-4c4dc037a0ab tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:36.581418 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-183162de-8cf3-4ac4-b2bb-4c4dc037a0ab tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:36.589715 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-183162de-8cf3-4ac4-b2bb-4c4dc037a0ab tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:36.591898 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-183162de-8cf3-4ac4-b2bb-4c4dc037a0ab tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:36.592373 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-183162de-8cf3-4ac4-b2bb-4c4dc037a0ab tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:37.022897 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-183162de-8cf3-4ac4-b2bb-4c4dc037a0ab tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf87794979e844349d6ec6c6650565f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c25f1d17e94c74868357744e692487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:37.031330 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.scheduler.client.report [None req-a5920407-7622-4dc8-88eb-63f72debfb05 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Deleted allocations for instance f5756da0-e167-4a21-881d-1479b42314db Oct 04 19:01:37.040712 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.compute.api [None req-a5920407-7622-4dc8-88eb-63f72debfb05 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: f5756da0-e167-4a21-881d-1479b42314db] Instance Mapping does not exist while attempting local delete cleanup. Oct 04 19:01:37.042402 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-a5920407-7622-4dc8-88eb-63f72debfb05 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "DELETE /compute/v2.1/servers/f5756da0-e167-4a21-881d-1479b42314db" status: 204 len: 0 microversion: 2.1 time: 0.772488 Oct 04 19:01:37.050869 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2933/5513] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 19:01:36 2022] DELETE /compute/v2.1/servers/f5756da0-e167-4a21-881d-1479b42314db => generated 0 bytes in 778 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 19:01:37.057087 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-183162de-8cf3-4ac4-b2bb-4c4dc037a0ab tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] 10.222.0.43 "GET /compute/v2.1/servers/32f44032-85ec-43eb-b714-748a7f4f0b5b" status: 200 len: 1392 microversion: 2.1 time: 0.511523 Oct 04 19:01:37.060060 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2581/5514] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:01:36 2022] GET /compute/v2.1/servers/32f44032-85ec-43eb-b714-748a7f4f0b5b => generated 1392 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:01:37.067634 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-45825168-2f8c-4c68-87d3-5709f4848ff6 req-cf44ac57-d750-4add-9c45-55b072ef8886 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32f44032-85ec-43eb-b714-748a7f4f0b5b", "name": "network-vif-plugged", "status": "completed", "tag": "d12de55b-02be-4f93-aca2-a6044af93e38"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:01:37.074809 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-47e0f69a-19d3-428c-a372-c9955b2d035f req-1b22e82f-9ff5-434f-b77a-ee5a769b83c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03c66e0a-0383-46dc-b2af-0158ae3eacbf", "tag": "7fc80ed0-682f-4c8a-859e-2ef4cbc1e353"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:01:37.097958 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-45825168-2f8c-4c68-87d3-5709f4848ff6 req-cf44ac57-d750-4add-9c45-55b072ef8886 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:37.105622 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-45825168-2f8c-4c68-87d3-5709f4848ff6 req-cf44ac57-d750-4add-9c45-55b072ef8886 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:37.108402 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-45825168-2f8c-4c68-87d3-5709f4848ff6 req-cf44ac57-d750-4add-9c45-55b072ef8886 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:37.113000 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-47e0f69a-19d3-428c-a372-c9955b2d035f req-1b22e82f-9ff5-434f-b77a-ee5a769b83c8 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:37.114006 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-47e0f69a-19d3-428c-a372-c9955b2d035f req-1b22e82f-9ff5-434f-b77a-ee5a769b83c8 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:37.114770 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-47e0f69a-19d3-428c-a372-c9955b2d035f req-1b22e82f-9ff5-434f-b77a-ee5a769b83c8 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:37.145172 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-45825168-2f8c-4c68-87d3-5709f4848ff6 req-cf44ac57-d750-4add-9c45-55b072ef8886 service nova] Creating event network-vif-plugged:d12de55b-02be-4f93-aca2-a6044af93e38 for instance 32f44032-85ec-43eb-b714-748a7f4f0b5b on n-h1-851028-13 Oct 04 19:01:37.149497 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-47e0f69a-19d3-428c-a372-c9955b2d035f req-1b22e82f-9ff5-434f-b77a-ee5a769b83c8 service nova] Creating event network-changed:7fc80ed0-682f-4c8a-859e-2ef4cbc1e353 for instance 03c66e0a-0383-46dc-b2af-0158ae3eacbf on n-h2-851028-13 Oct 04 19:01:37.162591 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-45825168-2f8c-4c68-87d3-5709f4848ff6 req-cf44ac57-d750-4add-9c45-55b072ef8886 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110271 Oct 04 19:01:37.167254 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2934/5515] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:01:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:01:37.169995 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-47e0f69a-19d3-428c-a372-c9955b2d035f req-1b22e82f-9ff5-434f-b77a-ee5a769b83c8 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105353 Oct 04 19:01:37.178754 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2582/5516] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:01:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:01:37.183601 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-0a7a2117-7216-43cc-88b5-00c9f8022edd tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:37.186694 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-0a7a2117-7216-43cc-88b5-00c9f8022edd tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: f5756da0-e167-4a21-881d-1479b42314db] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:37.204580 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-0a7a2117-7216-43cc-88b5-00c9f8022edd tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] HTTP exception thrown: Instance f5756da0-e167-4a21-881d-1479b42314db could not be found. Oct 04 19:01:37.207509 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-0a7a2117-7216-43cc-88b5-00c9f8022edd tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Request method failure captured: Oct 04 19:01:37.207509 n-d-851028-13 devstack@n-api.service[123596]: request: GET /compute/v2.1/servers/f5756da0-e167-4a21-881d-1479b42314db HTTP/1.1 Oct 04 19:01:37.207509 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 19:01:37.207509 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 19:01:37.207509 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 19:01:37.207509 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 19:01:37.207509 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 19:01:37.207509 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 19:01:37.207509 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 19:01:37.207509 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 19:01:37.207509 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPIKl7r6ZFtp0u4zXtNLGIhqHo70GyUJnklFY8mLM6SAvqzMqMYlk7FNNMFRu1dxhVJoaHCY-KymtUU7SbzcnaY3gmI4NmuaRKJjk_WfnM3eNlWdo1XIjmy2xIfTxketrHpoedtH-76PD0N1ebOmJq-sWqhFc1j62MJ2QKuwEgYmouJ4 Oct 04 19:01:37.207509 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 19:01:37.207509 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 19:01:37.207509 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 19:01:37.207509 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 19:01:37.207509 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 19:01:37.207509 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 19:01:37.207509 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: a6a711601b7a439caf395233de1febff Oct 04 19:01:37.207509 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-DeleteServersTestJSON-591734195 Oct 04 19:01:37.207509 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 19:01:37.207509 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 19:01:37.207509 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/a6a711601b7a439caf395233de1febff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_a6a711601b7a439caf395233de1febff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a6a711601b7a439caf395233de1febff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a6a711601b7a439caf395233de1febff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 19:01:37.207509 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-DeleteServersTestJSON-591734195 Oct 04 19:01:37.207509 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: a6a711601b7a439caf395233de1febff Oct 04 19:01:37.207509 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-DeleteServersTestJSON-591734195 Oct 04 19:01:37.207509 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-DeleteServersTestJSON-591734195-project Oct 04 19:01:37.207509 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 19:01:37.207509 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 19:01:37.207509 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: c997bc60473b43fd9fcf0c65111c44c0 Oct 04 19:01:37.207509 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-DeleteServersTestJSON-591734195-project Oct 04 19:01:37.207509 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 19:01:37.207509 n-d-851028-13 devstack@n-api.service[123596]: exception: Instance f5756da0-e167-4a21-881d-1479b42314db could not be found. Oct 04 19:01:37.207509 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': 'f5756da0-e167-4a21-881d-1479b42314db'} Oct 04 19:01:37.207509 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:01:37.207509 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:01:37.207509 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:01:37.207509 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:01:37.207509 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:01:37.207509 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:01:37.207509 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 19:01:37.207509 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 19:01:37.207509 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5756da0-e167-4a21-881d-1479b42314db could not be found. Oct 04 19:01:37.207509 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:01:37.207509 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:01:37.207509 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:01:37.207509 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:01:37.207509 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:01:37.207509 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:01:37.207509 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:01:37.207509 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:01:37.207509 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:01:37.207509 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:01:37.207509 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:01:37.207509 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:01:37.207509 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:01:37.207509 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:01:37.207509 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:01:37.207509 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:01:37.207509 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5756da0-e167-4a21-881d-1479b42314db could not be found. Oct 04 19:01:37.207509 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:01:37.207509 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:01:37.207509 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:01:37.207509 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:01:37.207509 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:01:37.211515 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:01:37.211515 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:01:37.211515 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:01:37.211515 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5756da0-e167-4a21-881d-1479b42314db could not be found. Oct 04 19:01:37.211515 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:01:37.213396 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-0a7a2117-7216-43cc-88b5-00c9f8022edd tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Returning 404 to user: Instance f5756da0-e167-4a21-881d-1479b42314db could not be found. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:01:37.214496 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-0a7a2117-7216-43cc-88b5-00c9f8022edd tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "GET /compute/v2.1/servers/f5756da0-e167-4a21-881d-1479b42314db" status: 404 len: 111 microversion: 2.1 time: 0.045520 Oct 04 19:01:37.219010 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2935/5517] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:01:37 2022] GET /compute/v2.1/servers/f5756da0-e167-4a21-881d-1479b42314db => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:01:37.503328 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-5c3ca47a-5e40-4123-8688-6b0931e388c5 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-438632697", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452", "networks": [{"uuid": "dcd99798-7080-4c74-b648-36288a298add"}]}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:01:37.630215 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.network.neutron [None req-5c3ca47a-5e40-4123-8688-6b0931e388c5 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] validate_networks() for [('dcd99798-7080-4c74-b648-36288a298add', None, None, None, None, None)] {{(pid=123595) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 19:01:38.084411 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-91ada793-741b-4d6a-8430-0ef959ab6602 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:38.088632 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-91ada793-741b-4d6a-8430-0ef959ab6602 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] [instance: 32f44032-85ec-43eb-b714-748a7f4f0b5b] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:38.107616 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-91ada793-741b-4d6a-8430-0ef959ab6602 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:38.113226 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-91ada793-741b-4d6a-8430-0ef959ab6602 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:38.114637 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-91ada793-741b-4d6a-8430-0ef959ab6602 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:38.126555 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-91ada793-741b-4d6a-8430-0ef959ab6602 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:38.128090 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-91ada793-741b-4d6a-8430-0ef959ab6602 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:38.129456 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-91ada793-741b-4d6a-8430-0ef959ab6602 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:38.521568 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-91ada793-741b-4d6a-8430-0ef959ab6602 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf87794979e844349d6ec6c6650565f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c25f1d17e94c74868357744e692487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:38.550898 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-91ada793-741b-4d6a-8430-0ef959ab6602 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] 10.222.0.43 "GET /compute/v2.1/servers/32f44032-85ec-43eb-b714-748a7f4f0b5b" status: 200 len: 1392 microversion: 2.1 time: 0.471863 Oct 04 19:01:38.551582 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2936/5518] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:01:38 2022] GET /compute/v2.1/servers/32f44032-85ec-43eb-b714-748a7f4f0b5b => generated 1392 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:01:39.227680 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-5c3ca47a-5e40-4123-8688-6b0931e388c5 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Flavor limits 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:01:39.228192 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-5c3ca47a-5e40-4123-8688-6b0931e388c5 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Image limits 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:01:39.232130 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-5c3ca47a-5e40-4123-8688-6b0931e388c5 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Flavor pref 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:01:39.233281 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-5c3ca47a-5e40-4123-8688-6b0931e388c5 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Image pref 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:01:39.234126 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-5c3ca47a-5e40-4123-8688-6b0931e388c5 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:01:39.262003 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5c3ca47a-5e40-4123-8688-6b0931e388c5 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:39.279418 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5c3ca47a-5e40-4123-8688-6b0931e388c5 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:39.283254 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5c3ca47a-5e40-4123-8688-6b0931e388c5 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:39.286430 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5c3ca47a-5e40-4123-8688-6b0931e388c5 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:39.287133 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5c3ca47a-5e40-4123-8688-6b0931e388c5 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:39.288483 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5c3ca47a-5e40-4123-8688-6b0931e388c5 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:39.324095 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-5c3ca47a-5e40-4123-8688-6b0931e388c5 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Getting quotas for project a6a711601b7a439caf395233de1febff. Resources: {'ram', 'cores', 'instances'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:01:39.329863 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-5c3ca47a-5e40-4123-8688-6b0931e388c5 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Getting quotas for user c997bc60473b43fd9fcf0c65111c44c0 and project a6a711601b7a439caf395233de1febff. Resources: {'ram', 'cores', 'instances'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:01:39.353086 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-5c3ca47a-5e40-4123-8688-6b0931e388c5 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Going to run 1 instances... {{(pid=123595) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 19:01:39.355884 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-5c3ca47a-5e40-4123-8688-6b0931e388c5 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: 703e06d0-b24b-4a2b-900c-55c8a9291887] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e8943ec5-4038-4d4b-b9b9-2415a79f5243',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 19:01:39.462872 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-5c3ca47a-5e40-4123-8688-6b0931e388c5 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.964818 Oct 04 19:01:39.464507 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2583/5519] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 19:01:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 1967 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 19:01:39.480047 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-748842e5-c04b-4db5-9a7e-fe161a684f6d tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:39.481500 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-748842e5-c04b-4db5-9a7e-fe161a684f6d tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: 703e06d0-b24b-4a2b-900c-55c8a9291887] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:39.576324 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-7e9698ea-415b-4bbf-84b5-d2a7e2d62db0 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:39.576954 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-7e9698ea-415b-4bbf-84b5-d2a7e2d62db0 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] [instance: 32f44032-85ec-43eb-b714-748a7f4f0b5b] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:39.586450 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7e9698ea-415b-4bbf-84b5-d2a7e2d62db0 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:39.590220 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7e9698ea-415b-4bbf-84b5-d2a7e2d62db0 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:39.590889 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7e9698ea-415b-4bbf-84b5-d2a7e2d62db0 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:39.593258 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7e9698ea-415b-4bbf-84b5-d2a7e2d62db0 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:39.593888 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7e9698ea-415b-4bbf-84b5-d2a7e2d62db0 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:39.596418 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7e9698ea-415b-4bbf-84b5-d2a7e2d62db0 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:39.619098 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-748842e5-c04b-4db5-9a7e-fe161a684f6d tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c997bc60473b43fd9fcf0c65111c44c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a711601b7a439caf395233de1febff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:39.628068 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-748842e5-c04b-4db5-9a7e-fe161a684f6d tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "GET /compute/v2.1/servers/703e06d0-b24b-4a2b-900c-55c8a9291887" status: 200 len: 1214 microversion: 2.1 time: 0.156309 Oct 04 19:01:39.642861 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2937/5520] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:01:39 2022] GET /compute/v2.1/servers/703e06d0-b24b-4a2b-900c-55c8a9291887 => generated 1214 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:01:39.947194 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-7e9698ea-415b-4bbf-84b5-d2a7e2d62db0 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf87794979e844349d6ec6c6650565f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c25f1d17e94c74868357744e692487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:39.957735 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-7e9698ea-415b-4bbf-84b5-d2a7e2d62db0 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] 10.222.0.43 "GET /compute/v2.1/servers/32f44032-85ec-43eb-b714-748a7f4f0b5b" status: 200 len: 1564 microversion: 2.1 time: 0.385304 Oct 04 19:01:39.976997 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2584/5521] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:01:39 2022] GET /compute/v2.1/servers/32f44032-85ec-43eb-b714-748a7f4f0b5b => generated 1564 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:01:39.999242 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-bbada2f9-27b7-4fc7-a387-3a85c066906f tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:40.004447 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-bbada2f9-27b7-4fc7-a387-3a85c066906f tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] [instance: 32f44032-85ec-43eb-b714-748a7f4f0b5b] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:40.029176 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bbada2f9-27b7-4fc7-a387-3a85c066906f tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:40.030142 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bbada2f9-27b7-4fc7-a387-3a85c066906f tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:40.034168 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bbada2f9-27b7-4fc7-a387-3a85c066906f tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:40.042869 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bbada2f9-27b7-4fc7-a387-3a85c066906f tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:40.046022 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bbada2f9-27b7-4fc7-a387-3a85c066906f tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:40.047788 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bbada2f9-27b7-4fc7-a387-3a85c066906f tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:40.391623 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-bbada2f9-27b7-4fc7-a387-3a85c066906f tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf87794979e844349d6ec6c6650565f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c25f1d17e94c74868357744e692487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:40.406186 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-bbada2f9-27b7-4fc7-a387-3a85c066906f tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] 10.222.0.43 "GET /compute/v2.1/servers/32f44032-85ec-43eb-b714-748a7f4f0b5b" status: 200 len: 1564 microversion: 2.1 time: 0.423495 Oct 04 19:01:40.407399 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2938/5522] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:01:39 2022] GET /compute/v2.1/servers/32f44032-85ec-43eb-b714-748a7f4f0b5b => generated 1564 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:01:40.651508 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-d7ad6b85-8eb1-45b2-a5ea-06211aa553cf tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:40.652130 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-d7ad6b85-8eb1-45b2-a5ea-06211aa553cf tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: 703e06d0-b24b-4a2b-900c-55c8a9291887] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:40.660369 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d7ad6b85-8eb1-45b2-a5ea-06211aa553cf tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:40.660865 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d7ad6b85-8eb1-45b2-a5ea-06211aa553cf tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:40.662491 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d7ad6b85-8eb1-45b2-a5ea-06211aa553cf tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:40.665550 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d7ad6b85-8eb1-45b2-a5ea-06211aa553cf tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:40.668578 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d7ad6b85-8eb1-45b2-a5ea-06211aa553cf tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:40.670372 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d7ad6b85-8eb1-45b2-a5ea-06211aa553cf tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:40.844006 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-d7ad6b85-8eb1-45b2-a5ea-06211aa553cf tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c997bc60473b43fd9fcf0c65111c44c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a711601b7a439caf395233de1febff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:40.863893 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-d7ad6b85-8eb1-45b2-a5ea-06211aa553cf tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "GET /compute/v2.1/servers/703e06d0-b24b-4a2b-900c-55c8a9291887" status: 200 len: 1218 microversion: 2.1 time: 0.216094 Oct 04 19:01:40.868456 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2585/5523] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:01:40 2022] GET /compute/v2.1/servers/703e06d0-b24b-4a2b-900c-55c8a9291887 => generated 1218 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:01:41.894236 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f283e98a-7333-4d2b-9a13-dcee0418ea5d tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:41.894874 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-f283e98a-7333-4d2b-9a13-dcee0418ea5d tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: 703e06d0-b24b-4a2b-900c-55c8a9291887] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:41.908550 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f283e98a-7333-4d2b-9a13-dcee0418ea5d tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:41.912284 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f283e98a-7333-4d2b-9a13-dcee0418ea5d tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:41.914484 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f283e98a-7333-4d2b-9a13-dcee0418ea5d tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:41.915425 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f283e98a-7333-4d2b-9a13-dcee0418ea5d tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:41.915916 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f283e98a-7333-4d2b-9a13-dcee0418ea5d tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:41.916359 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f283e98a-7333-4d2b-9a13-dcee0418ea5d tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:42.038023 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-f283e98a-7333-4d2b-9a13-dcee0418ea5d tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c997bc60473b43fd9fcf0c65111c44c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a711601b7a439caf395233de1febff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:42.054968 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-f283e98a-7333-4d2b-9a13-dcee0418ea5d tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "GET /compute/v2.1/servers/703e06d0-b24b-4a2b-900c-55c8a9291887" status: 200 len: 1272 microversion: 2.1 time: 0.166767 Oct 04 19:01:42.056217 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2939/5524] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:01:41 2022] GET /compute/v2.1/servers/703e06d0-b24b-4a2b-900c-55c8a9291887 => generated 1272 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:01:43.080232 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-a2e5755a-572d-4a72-b8ef-a3deb06ebc5a tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:43.080898 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-a2e5755a-572d-4a72-b8ef-a3deb06ebc5a tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: 703e06d0-b24b-4a2b-900c-55c8a9291887] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:43.112470 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a2e5755a-572d-4a72-b8ef-a3deb06ebc5a tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:43.113603 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a2e5755a-572d-4a72-b8ef-a3deb06ebc5a tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:43.120152 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a2e5755a-572d-4a72-b8ef-a3deb06ebc5a tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:43.123763 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a2e5755a-572d-4a72-b8ef-a3deb06ebc5a tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:43.124272 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a2e5755a-572d-4a72-b8ef-a3deb06ebc5a tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:43.126143 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a2e5755a-572d-4a72-b8ef-a3deb06ebc5a tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:43.533851 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-a2e5755a-572d-4a72-b8ef-a3deb06ebc5a tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c997bc60473b43fd9fcf0c65111c44c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a711601b7a439caf395233de1febff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:43.553290 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-a2e5755a-572d-4a72-b8ef-a3deb06ebc5a tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "GET /compute/v2.1/servers/703e06d0-b24b-4a2b-900c-55c8a9291887" status: 200 len: 1272 microversion: 2.1 time: 0.472908 Oct 04 19:01:43.557429 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2586/5525] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:01:43 2022] GET /compute/v2.1/servers/703e06d0-b24b-4a2b-900c-55c8a9291887 => generated 1272 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:01:44.591393 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-840fdfd2-4fa7-4e1e-ba8c-f4c180b08c37 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:44.595134 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-840fdfd2-4fa7-4e1e-ba8c-f4c180b08c37 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: 703e06d0-b24b-4a2b-900c-55c8a9291887] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:44.615829 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-840fdfd2-4fa7-4e1e-ba8c-f4c180b08c37 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:44.617009 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-840fdfd2-4fa7-4e1e-ba8c-f4c180b08c37 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:44.619376 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-840fdfd2-4fa7-4e1e-ba8c-f4c180b08c37 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:44.620533 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-840fdfd2-4fa7-4e1e-ba8c-f4c180b08c37 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:44.622410 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-840fdfd2-4fa7-4e1e-ba8c-f4c180b08c37 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:44.624118 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-840fdfd2-4fa7-4e1e-ba8c-f4c180b08c37 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:45.200609 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-840fdfd2-4fa7-4e1e-ba8c-f4c180b08c37 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c997bc60473b43fd9fcf0c65111c44c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a711601b7a439caf395233de1febff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:45.238639 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-840fdfd2-4fa7-4e1e-ba8c-f4c180b08c37 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "GET /compute/v2.1/servers/703e06d0-b24b-4a2b-900c-55c8a9291887" status: 200 len: 1314 microversion: 2.1 time: 0.655507 Oct 04 19:01:45.239245 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2940/5526] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:01:44 2022] GET /compute/v2.1/servers/703e06d0-b24b-4a2b-900c-55c8a9291887 => generated 1314 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:01:46.263984 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-076bfcad-9931-4d08-b2a1-d04e88ff5c88 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:46.265475 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-076bfcad-9931-4d08-b2a1-d04e88ff5c88 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: 703e06d0-b24b-4a2b-900c-55c8a9291887] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:46.279345 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-076bfcad-9931-4d08-b2a1-d04e88ff5c88 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:46.280190 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-076bfcad-9931-4d08-b2a1-d04e88ff5c88 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:46.282612 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-076bfcad-9931-4d08-b2a1-d04e88ff5c88 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:46.283661 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-076bfcad-9931-4d08-b2a1-d04e88ff5c88 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:46.284364 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-076bfcad-9931-4d08-b2a1-d04e88ff5c88 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:46.285449 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-076bfcad-9931-4d08-b2a1-d04e88ff5c88 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:46.822375 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-0cbbdae9-713e-41ac-a3f4-e84fd83d85f7 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:46.823896 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-0cbbdae9-713e-41ac-a3f4-e84fd83d85f7 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] [instance: 32f44032-85ec-43eb-b714-748a7f4f0b5b] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:46.827041 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=2 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:01:46.839993 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0cbbdae9-713e-41ac-a3f4-e84fd83d85f7 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:46.840789 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0cbbdae9-713e-41ac-a3f4-e84fd83d85f7 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:46.844396 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0cbbdae9-713e-41ac-a3f4-e84fd83d85f7 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:46.845410 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0cbbdae9-713e-41ac-a3f4-e84fd83d85f7 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:46.851496 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0cbbdae9-713e-41ac-a3f4-e84fd83d85f7 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:46.852210 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0cbbdae9-713e-41ac-a3f4-e84fd83d85f7 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:47.247763 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-076bfcad-9931-4d08-b2a1-d04e88ff5c88 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c997bc60473b43fd9fcf0c65111c44c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a711601b7a439caf395233de1febff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:47.259110 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-076bfcad-9931-4d08-b2a1-d04e88ff5c88 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "GET /compute/v2.1/servers/703e06d0-b24b-4a2b-900c-55c8a9291887" status: 200 len: 1314 microversion: 2.1 time: 0.999452 Oct 04 19:01:47.271044 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2587/5527] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:01:46 2022] GET /compute/v2.1/servers/703e06d0-b24b-4a2b-900c-55c8a9291887 => generated 1314 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:01:47.278133 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-659c6315-ea06-47a3-8040-38582f0c9a52 req-f87ca847-68fa-4ca9-85d7-0b5a0c2f9c1e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32f44032-85ec-43eb-b714-748a7f4f0b5b", "tag": "d12de55b-02be-4f93-aca2-a6044af93e38"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:01:47.317980 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-659c6315-ea06-47a3-8040-38582f0c9a52 req-f87ca847-68fa-4ca9-85d7-0b5a0c2f9c1e service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:47.318475 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-659c6315-ea06-47a3-8040-38582f0c9a52 req-f87ca847-68fa-4ca9-85d7-0b5a0c2f9c1e service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:47.318924 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-659c6315-ea06-47a3-8040-38582f0c9a52 req-f87ca847-68fa-4ca9-85d7-0b5a0c2f9c1e service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:47.334322 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-0cbbdae9-713e-41ac-a3f4-e84fd83d85f7 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf87794979e844349d6ec6c6650565f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c25f1d17e94c74868357744e692487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:47.342835 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-0cbbdae9-713e-41ac-a3f4-e84fd83d85f7 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] 10.222.0.43 "GET /compute/v2.1/servers/32f44032-85ec-43eb-b714-748a7f4f0b5b" status: 200 len: 1564 microversion: 2.1 time: 0.524535 Oct 04 19:01:47.354742 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2941/5528] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:01:46 2022] GET /compute/v2.1/servers/32f44032-85ec-43eb-b714-748a7f4f0b5b => generated 1564 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:01:47.375387 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-659c6315-ea06-47a3-8040-38582f0c9a52 req-f87ca847-68fa-4ca9-85d7-0b5a0c2f9c1e service nova] Creating event network-changed:d12de55b-02be-4f93-aca2-a6044af93e38 for instance 32f44032-85ec-43eb-b714-748a7f4f0b5b on n-h1-851028-13 Oct 04 19:01:47.388759 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-659c6315-ea06-47a3-8040-38582f0c9a52 req-f87ca847-68fa-4ca9-85d7-0b5a0c2f9c1e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116319 Oct 04 19:01:47.391868 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2588/5529] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:01:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:01:48.301025 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-cd28c96a-9569-408f-9168-2b14d5974c1d tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:48.301543 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-cd28c96a-9569-408f-9168-2b14d5974c1d tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: 703e06d0-b24b-4a2b-900c-55c8a9291887] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:48.331600 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cd28c96a-9569-408f-9168-2b14d5974c1d tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:48.332522 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cd28c96a-9569-408f-9168-2b14d5974c1d tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:48.333311 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cd28c96a-9569-408f-9168-2b14d5974c1d tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:48.334221 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cd28c96a-9569-408f-9168-2b14d5974c1d tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:48.334879 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cd28c96a-9569-408f-9168-2b14d5974c1d tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:48.336000 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cd28c96a-9569-408f-9168-2b14d5974c1d tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:48.991626 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-cd28c96a-9569-408f-9168-2b14d5974c1d tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c997bc60473b43fd9fcf0c65111c44c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a711601b7a439caf395233de1febff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:49.006640 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-cd28c96a-9569-408f-9168-2b14d5974c1d tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "GET /compute/v2.1/servers/703e06d0-b24b-4a2b-900c-55c8a9291887" status: 200 len: 1314 microversion: 2.1 time: 0.712904 Oct 04 19:01:49.017822 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2942/5530] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:01:48 2022] GET /compute/v2.1/servers/703e06d0-b24b-4a2b-900c-55c8a9291887 => generated 1314 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:01:49.418585 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=2 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:01:49.421574 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=8 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:01:49.430130 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-4861f912-ad1b-49df-b514-d780f6136c4e req-6f720b08-6c03-4295-bc78-f2d40307847b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "703e06d0-b24b-4a2b-900c-55c8a9291887", "tag": "c4f9f98c-707f-4eda-93e5-4aae0f4b6d42"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:01:49.481505 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-4861f912-ad1b-49df-b514-d780f6136c4e req-6f720b08-6c03-4295-bc78-f2d40307847b service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:49.484380 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-4861f912-ad1b-49df-b514-d780f6136c4e req-6f720b08-6c03-4295-bc78-f2d40307847b service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:49.484993 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-4861f912-ad1b-49df-b514-d780f6136c4e req-6f720b08-6c03-4295-bc78-f2d40307847b service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:49.505269 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-4861f912-ad1b-49df-b514-d780f6136c4e req-6f720b08-6c03-4295-bc78-f2d40307847b service nova] Creating event network-changed:c4f9f98c-707f-4eda-93e5-4aae0f4b6d42 for instance 703e06d0-b24b-4a2b-900c-55c8a9291887 on n-h2-851028-13 Oct 04 19:01:49.511350 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-4861f912-ad1b-49df-b514-d780f6136c4e req-6f720b08-6c03-4295-bc78-f2d40307847b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095408 Oct 04 19:01:49.512273 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2589/5531] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:01:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:01:50.033230 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-3ed70423-4977-492e-927e-4902ecc34023 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:50.034550 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-3ed70423-4977-492e-927e-4902ecc34023 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: 703e06d0-b24b-4a2b-900c-55c8a9291887] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:50.044550 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=10 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:01:50.056300 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3ed70423-4977-492e-927e-4902ecc34023 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:50.056931 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3ed70423-4977-492e-927e-4902ecc34023 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:50.057412 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3ed70423-4977-492e-927e-4902ecc34023 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:50.058138 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3ed70423-4977-492e-927e-4902ecc34023 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:50.058603 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3ed70423-4977-492e-927e-4902ecc34023 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:50.059042 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3ed70423-4977-492e-927e-4902ecc34023 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:50.482142 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-3ed70423-4977-492e-927e-4902ecc34023 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c997bc60473b43fd9fcf0c65111c44c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a711601b7a439caf395233de1febff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:50.498384 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-3ed70423-4977-492e-927e-4902ecc34023 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "GET /compute/v2.1/servers/703e06d0-b24b-4a2b-900c-55c8a9291887" status: 200 len: 1314 microversion: 2.1 time: 0.470442 Oct 04 19:01:50.520612 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2943/5532] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:01:50 2022] GET /compute/v2.1/servers/703e06d0-b24b-4a2b-900c-55c8a9291887 => generated 1314 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:01:51.550805 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-96a4a9b7-1a7f-4f2a-b428-ebd1d002e469 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:51.552161 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-96a4a9b7-1a7f-4f2a-b428-ebd1d002e469 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: 703e06d0-b24b-4a2b-900c-55c8a9291887] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:51.571826 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-96a4a9b7-1a7f-4f2a-b428-ebd1d002e469 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:51.572622 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-96a4a9b7-1a7f-4f2a-b428-ebd1d002e469 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:51.573541 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-96a4a9b7-1a7f-4f2a-b428-ebd1d002e469 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:51.574465 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-96a4a9b7-1a7f-4f2a-b428-ebd1d002e469 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:51.576807 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-96a4a9b7-1a7f-4f2a-b428-ebd1d002e469 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:51.577616 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-96a4a9b7-1a7f-4f2a-b428-ebd1d002e469 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:52.421765 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-96a4a9b7-1a7f-4f2a-b428-ebd1d002e469 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c997bc60473b43fd9fcf0c65111c44c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a711601b7a439caf395233de1febff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:52.434990 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-96a4a9b7-1a7f-4f2a-b428-ebd1d002e469 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "GET /compute/v2.1/servers/703e06d0-b24b-4a2b-900c-55c8a9291887" status: 200 len: 1314 microversion: 2.1 time: 0.889092 Oct 04 19:01:52.435921 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2590/5533] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:01:51 2022] GET /compute/v2.1/servers/703e06d0-b24b-4a2b-900c-55c8a9291887 => generated 1314 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:01:53.133578 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-5b929652-1d05-4b70-b214-d132aac172ba tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-1854042682", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452", "networks": [{"uuid": "dd8f4cb7-c396-495d-9065-e1ac1f86fb6e"}]}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:01:53.225259 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.network.neutron [None req-5b929652-1d05-4b70-b214-d132aac172ba tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] validate_networks() for [('dd8f4cb7-c396-495d-9065-e1ac1f86fb6e', None, None, None, None, None)] {{(pid=123596) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 19:01:53.459347 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-6256d776-2854-4052-bf78-e6f18dceb184 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:53.460015 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-6256d776-2854-4052-bf78-e6f18dceb184 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: 703e06d0-b24b-4a2b-900c-55c8a9291887] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:53.479971 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6256d776-2854-4052-bf78-e6f18dceb184 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:53.480496 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6256d776-2854-4052-bf78-e6f18dceb184 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:53.480912 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6256d776-2854-4052-bf78-e6f18dceb184 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:53.483700 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6256d776-2854-4052-bf78-e6f18dceb184 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:53.484372 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6256d776-2854-4052-bf78-e6f18dceb184 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:53.490175 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6256d776-2854-4052-bf78-e6f18dceb184 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:53.794073 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-6256d776-2854-4052-bf78-e6f18dceb184 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c997bc60473b43fd9fcf0c65111c44c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a711601b7a439caf395233de1febff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:53.811512 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-6256d776-2854-4052-bf78-e6f18dceb184 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "GET /compute/v2.1/servers/703e06d0-b24b-4a2b-900c-55c8a9291887" status: 200 len: 1314 microversion: 2.1 time: 0.356287 Oct 04 19:01:53.830914 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2591/5534] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:01:53 2022] GET /compute/v2.1/servers/703e06d0-b24b-4a2b-900c-55c8a9291887 => generated 1314 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:01:54.301820 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-5b929652-1d05-4b70-b214-d132aac172ba tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] Flavor limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:01:54.302921 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-5b929652-1d05-4b70-b214-d132aac172ba tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] Image limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:01:54.303622 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-5b929652-1d05-4b70-b214-d132aac172ba tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] Flavor pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:01:54.305425 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-5b929652-1d05-4b70-b214-d132aac172ba tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] Image pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:01:54.306061 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-5b929652-1d05-4b70-b214-d132aac172ba tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:01:54.320442 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5b929652-1d05-4b70-b214-d132aac172ba tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:54.321337 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5b929652-1d05-4b70-b214-d132aac172ba tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:54.322151 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5b929652-1d05-4b70-b214-d132aac172ba tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:54.323336 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5b929652-1d05-4b70-b214-d132aac172ba tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:54.324086 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5b929652-1d05-4b70-b214-d132aac172ba tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:54.324582 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5b929652-1d05-4b70-b214-d132aac172ba tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:54.351825 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-5b929652-1d05-4b70-b214-d132aac172ba tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] Getting quotas for project 2e0c1daab0894e32af9427fc51dea8d5. Resources: {'ram', 'cores', 'instances'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:01:54.359345 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-5b929652-1d05-4b70-b214-d132aac172ba tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] Getting quotas for user 1e42c4b6cf4143aaa88eea5a932dd387 and project 2e0c1daab0894e32af9427fc51dea8d5. Resources: {'ram', 'cores', 'instances'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:01:54.375548 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-5b929652-1d05-4b70-b214-d132aac172ba tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] Going to run 1 instances... {{(pid=123596) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 19:01:54.379813 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-5b929652-1d05-4b70-b214-d132aac172ba tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] [instance: dec86071-1ea0-4d1d-a36d-256b898add8e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e8943ec5-4038-4d4b-b9b9-2415a79f5243',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123596) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 19:01:54.448670 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-5b929652-1d05-4b70-b214-d132aac172ba tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.691376 Oct 04 19:01:54.456105 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2944/5535] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 19:01:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 1697 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 19:01:54.461644 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-1842b9c3-460e-48e9-b875-0412d08d13a0 tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:54.462478 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-1842b9c3-460e-48e9-b875-0412d08d13a0 tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] [instance: dec86071-1ea0-4d1d-a36d-256b898add8e] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:54.552694 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-1842b9c3-460e-48e9-b875-0412d08d13a0 tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42c4b6cf4143aaa88eea5a932dd387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0c1daab0894e32af9427fc51dea8d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:54.568355 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-1842b9c3-460e-48e9-b875-0412d08d13a0 tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] 10.222.0.43 "GET /compute/v2.1/servers/dec86071-1ea0-4d1d-a36d-256b898add8e" status: 200 len: 1225 microversion: 2.1 time: 0.110806 Oct 04 19:01:54.580238 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2592/5536] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:01:54 2022] GET /compute/v2.1/servers/dec86071-1ea0-4d1d-a36d-256b898add8e => generated 1225 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:01:54.842841 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-b9541b2f-de4c-482e-a2e9-fa85c14fc3b0 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:54.847775 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-b9541b2f-de4c-482e-a2e9-fa85c14fc3b0 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: 703e06d0-b24b-4a2b-900c-55c8a9291887] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:54.891023 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b9541b2f-de4c-482e-a2e9-fa85c14fc3b0 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:54.891914 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b9541b2f-de4c-482e-a2e9-fa85c14fc3b0 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:54.892854 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b9541b2f-de4c-482e-a2e9-fa85c14fc3b0 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:54.894356 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b9541b2f-de4c-482e-a2e9-fa85c14fc3b0 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:54.894883 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b9541b2f-de4c-482e-a2e9-fa85c14fc3b0 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:54.895392 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b9541b2f-de4c-482e-a2e9-fa85c14fc3b0 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:55.177778 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-b9541b2f-de4c-482e-a2e9-fa85c14fc3b0 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c997bc60473b43fd9fcf0c65111c44c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a711601b7a439caf395233de1febff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:55.195743 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-b9541b2f-de4c-482e-a2e9-fa85c14fc3b0 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "GET /compute/v2.1/servers/703e06d0-b24b-4a2b-900c-55c8a9291887" status: 200 len: 1314 microversion: 2.1 time: 0.353167 Oct 04 19:01:55.197156 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2945/5537] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:01:54 2022] GET /compute/v2.1/servers/703e06d0-b24b-4a2b-900c-55c8a9291887 => generated 1314 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:01:55.507866 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-78912d18-9a7b-45a8-bc84-8200fdf6c52a tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:01:55.514215 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-78912d18-9a7b-45a8-bc84-8200fdf6c52a tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] [instance: 03c66e0a-0383-46dc-b2af-0158ae3eacbf] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:55.543413 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-78912d18-9a7b-45a8-bc84-8200fdf6c52a tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:55.543917 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-78912d18-9a7b-45a8-bc84-8200fdf6c52a tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:55.544366 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-78912d18-9a7b-45a8-bc84-8200fdf6c52a tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:55.545084 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-78912d18-9a7b-45a8-bc84-8200fdf6c52a tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:55.553402 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-78912d18-9a7b-45a8-bc84-8200fdf6c52a tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:55.559106 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-78912d18-9a7b-45a8-bc84-8200fdf6c52a tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:55.603126 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-1bcdad52-d1ed-44cd-a034-2989edae7068 tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:55.605382 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-1bcdad52-d1ed-44cd-a034-2989edae7068 tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] [instance: dec86071-1ea0-4d1d-a36d-256b898add8e] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:55.636297 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1bcdad52-d1ed-44cd-a034-2989edae7068 tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:55.636814 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-78912d18-9a7b-45a8-bc84-8200fdf6c52a tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] 10.222.0.43 "POST /compute/v2.1/servers/03c66e0a-0383-46dc-b2af-0158ae3eacbf/action" status: 200 len: 24565 microversion: 2.1 time: 0.135336 Oct 04 19:01:55.637705 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1bcdad52-d1ed-44cd-a034-2989edae7068 tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:55.640030 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2593/5538] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 19:01:55 2022] POST /compute/v2.1/servers/03c66e0a-0383-46dc-b2af-0158ae3eacbf/action => generated 24565 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 19:01:55.650679 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1bcdad52-d1ed-44cd-a034-2989edae7068 tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:55.653164 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1bcdad52-d1ed-44cd-a034-2989edae7068 tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:55.654538 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1bcdad52-d1ed-44cd-a034-2989edae7068 tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:55.655804 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1bcdad52-d1ed-44cd-a034-2989edae7068 tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:55.807694 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-1bcdad52-d1ed-44cd-a034-2989edae7068 tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42c4b6cf4143aaa88eea5a932dd387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0c1daab0894e32af9427fc51dea8d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:55.818144 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-1bcdad52-d1ed-44cd-a034-2989edae7068 tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] 10.222.0.43 "GET /compute/v2.1/servers/dec86071-1ea0-4d1d-a36d-256b898add8e" status: 200 len: 1221 microversion: 2.1 time: 0.226996 Oct 04 19:01:55.833782 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2946/5539] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:01:55 2022] GET /compute/v2.1/servers/dec86071-1ea0-4d1d-a36d-256b898add8e => generated 1221 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:01:56.219878 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-65f9815e-3100-4b51-aa23-d1f047328fae tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:56.220947 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-65f9815e-3100-4b51-aa23-d1f047328fae tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: 703e06d0-b24b-4a2b-900c-55c8a9291887] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:56.231137 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-65f9815e-3100-4b51-aa23-d1f047328fae tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:56.231635 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-65f9815e-3100-4b51-aa23-d1f047328fae tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:56.232076 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-65f9815e-3100-4b51-aa23-d1f047328fae tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:56.232845 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-65f9815e-3100-4b51-aa23-d1f047328fae tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:56.233327 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-65f9815e-3100-4b51-aa23-d1f047328fae tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:56.233928 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-65f9815e-3100-4b51-aa23-d1f047328fae tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:56.640558 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-6877ce2f-9c03-44c4-a5ae-72c5bac0b103 req-b2800033-03da-43a8-9884-3c6e7f7472a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "703e06d0-b24b-4a2b-900c-55c8a9291887", "name": "network-vif-plugged", "status": "completed", "tag": "c4f9f98c-707f-4eda-93e5-4aae0f4b6d42"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:01:56.673445 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-6877ce2f-9c03-44c4-a5ae-72c5bac0b103 req-b2800033-03da-43a8-9884-3c6e7f7472a8 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:56.673940 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-6877ce2f-9c03-44c4-a5ae-72c5bac0b103 req-b2800033-03da-43a8-9884-3c6e7f7472a8 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:56.674393 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-6877ce2f-9c03-44c4-a5ae-72c5bac0b103 req-b2800033-03da-43a8-9884-3c6e7f7472a8 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:56.717279 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-6877ce2f-9c03-44c4-a5ae-72c5bac0b103 req-b2800033-03da-43a8-9884-3c6e7f7472a8 service nova] Creating event network-vif-plugged:c4f9f98c-707f-4eda-93e5-4aae0f4b6d42 for instance 703e06d0-b24b-4a2b-900c-55c8a9291887 on n-h2-851028-13 Oct 04 19:01:56.745805 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-6877ce2f-9c03-44c4-a5ae-72c5bac0b103 req-b2800033-03da-43a8-9884-3c6e7f7472a8 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109273 Oct 04 19:01:56.746442 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2947/5540] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:01:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:01:56.750257 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-65f9815e-3100-4b51-aa23-d1f047328fae tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c997bc60473b43fd9fcf0c65111c44c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a711601b7a439caf395233de1febff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:56.782481 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-65f9815e-3100-4b51-aa23-d1f047328fae tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "GET /compute/v2.1/servers/703e06d0-b24b-4a2b-900c-55c8a9291887" status: 200 len: 1314 microversion: 2.1 time: 0.554934 Oct 04 19:01:56.784116 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2594/5541] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:01:56 2022] GET /compute/v2.1/servers/703e06d0-b24b-4a2b-900c-55c8a9291887 => generated 1314 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:01:56.845661 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-cc660cbc-bc3c-4c00-a6dd-66735d9ec385 tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:56.846402 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-cc660cbc-bc3c-4c00-a6dd-66735d9ec385 tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] [instance: dec86071-1ea0-4d1d-a36d-256b898add8e] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:56.864351 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cc660cbc-bc3c-4c00-a6dd-66735d9ec385 tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:56.864867 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cc660cbc-bc3c-4c00-a6dd-66735d9ec385 tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:56.865353 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cc660cbc-bc3c-4c00-a6dd-66735d9ec385 tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:56.866081 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cc660cbc-bc3c-4c00-a6dd-66735d9ec385 tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:56.867414 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cc660cbc-bc3c-4c00-a6dd-66735d9ec385 tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:56.867856 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cc660cbc-bc3c-4c00-a6dd-66735d9ec385 tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:56.917976 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=100 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:01:57.012062 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-cc660cbc-bc3c-4c00-a6dd-66735d9ec385 tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42c4b6cf4143aaa88eea5a932dd387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0c1daab0894e32af9427fc51dea8d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:57.032076 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-cc660cbc-bc3c-4c00-a6dd-66735d9ec385 tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] 10.222.0.43 "GET /compute/v2.1/servers/dec86071-1ea0-4d1d-a36d-256b898add8e" status: 200 len: 1283 microversion: 2.1 time: 0.188853 Oct 04 19:01:57.041670 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2948/5542] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:01:56 2022] GET /compute/v2.1/servers/dec86071-1ea0-4d1d-a36d-256b898add8e => generated 1283 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:01:57.807126 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-b326d25b-e99c-4551-b37d-37abdbdbb4fb tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:57.807902 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-b326d25b-e99c-4551-b37d-37abdbdbb4fb tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: 703e06d0-b24b-4a2b-900c-55c8a9291887] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:57.832775 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b326d25b-e99c-4551-b37d-37abdbdbb4fb tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:57.836791 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b326d25b-e99c-4551-b37d-37abdbdbb4fb tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:57.837804 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b326d25b-e99c-4551-b37d-37abdbdbb4fb tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:57.847647 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b326d25b-e99c-4551-b37d-37abdbdbb4fb tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:57.848317 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b326d25b-e99c-4551-b37d-37abdbdbb4fb tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:57.850345 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b326d25b-e99c-4551-b37d-37abdbdbb4fb tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:58.062982 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-b14594e5-8f79-4ec5-bd6e-e30b23ae7457 tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:58.063757 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-b14594e5-8f79-4ec5-bd6e-e30b23ae7457 tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] [instance: dec86071-1ea0-4d1d-a36d-256b898add8e] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:58.071279 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b14594e5-8f79-4ec5-bd6e-e30b23ae7457 tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:58.071783 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b14594e5-8f79-4ec5-bd6e-e30b23ae7457 tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:58.072233 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b14594e5-8f79-4ec5-bd6e-e30b23ae7457 tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:58.072958 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b14594e5-8f79-4ec5-bd6e-e30b23ae7457 tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:58.073449 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b14594e5-8f79-4ec5-bd6e-e30b23ae7457 tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:58.073882 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b14594e5-8f79-4ec5-bd6e-e30b23ae7457 tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:58.280941 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-b326d25b-e99c-4551-b37d-37abdbdbb4fb tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c997bc60473b43fd9fcf0c65111c44c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a711601b7a439caf395233de1febff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:58.291568 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-b326d25b-e99c-4551-b37d-37abdbdbb4fb tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "GET /compute/v2.1/servers/703e06d0-b24b-4a2b-900c-55c8a9291887" status: 200 len: 1314 microversion: 2.1 time: 0.489180 Oct 04 19:01:58.295354 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2595/5543] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:01:57 2022] GET /compute/v2.1/servers/703e06d0-b24b-4a2b-900c-55c8a9291887 => generated 1314 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:01:58.316174 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-b14594e5-8f79-4ec5-bd6e-e30b23ae7457 tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42c4b6cf4143aaa88eea5a932dd387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0c1daab0894e32af9427fc51dea8d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:58.333388 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-b14594e5-8f79-4ec5-bd6e-e30b23ae7457 tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] 10.222.0.43 "GET /compute/v2.1/servers/dec86071-1ea0-4d1d-a36d-256b898add8e" status: 200 len: 1325 microversion: 2.1 time: 0.279361 Oct 04 19:01:58.334511 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2949/5544] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:01:58 2022] GET /compute/v2.1/servers/dec86071-1ea0-4d1d-a36d-256b898add8e => generated 1325 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:01:59.318116 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-08c8cc90-9555-4a6e-beec-4264dde087c0 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:59.321042 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-08c8cc90-9555-4a6e-beec-4264dde087c0 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: 703e06d0-b24b-4a2b-900c-55c8a9291887] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:59.336889 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-08c8cc90-9555-4a6e-beec-4264dde087c0 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:59.338057 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-08c8cc90-9555-4a6e-beec-4264dde087c0 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:59.340515 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-08c8cc90-9555-4a6e-beec-4264dde087c0 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:59.342163 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-08c8cc90-9555-4a6e-beec-4264dde087c0 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:59.344191 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-08c8cc90-9555-4a6e-beec-4264dde087c0 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:59.345620 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-08c8cc90-9555-4a6e-beec-4264dde087c0 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:59.359399 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-8f577866-ef30-4fb4-a602-39d4c861b1e9 tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:59.359874 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-8f577866-ef30-4fb4-a602-39d4c861b1e9 tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] [instance: dec86071-1ea0-4d1d-a36d-256b898add8e] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:59.368961 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:01:59.389720 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8f577866-ef30-4fb4-a602-39d4c861b1e9 tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:59.390440 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8f577866-ef30-4fb4-a602-39d4c861b1e9 tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:59.390832 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8f577866-ef30-4fb4-a602-39d4c861b1e9 tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:59.392158 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8f577866-ef30-4fb4-a602-39d4c861b1e9 tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:59.392320 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8f577866-ef30-4fb4-a602-39d4c861b1e9 tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:59.400876 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8f577866-ef30-4fb4-a602-39d4c861b1e9 tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:59.707639 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-8f577866-ef30-4fb4-a602-39d4c861b1e9 tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42c4b6cf4143aaa88eea5a932dd387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0c1daab0894e32af9427fc51dea8d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:59.716490 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-8f577866-ef30-4fb4-a602-39d4c861b1e9 tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] 10.222.0.43 "GET /compute/v2.1/servers/dec86071-1ea0-4d1d-a36d-256b898add8e" status: 200 len: 1325 microversion: 2.1 time: 0.361951 Oct 04 19:01:59.717091 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2950/5545] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:01:59 2022] GET /compute/v2.1/servers/dec86071-1ea0-4d1d-a36d-256b898add8e => generated 1325 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:01:59.721777 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-4f2b150d-6c96-48a1-a31b-50ff61098010 req-49b56d17-645d-4c7e-ae11-49cb6d25fe39 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dec86071-1ea0-4d1d-a36d-256b898add8e", "tag": "8278f8f9-983d-4cfa-a8ac-1087118dfdda"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:01:59.747823 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-4f2b150d-6c96-48a1-a31b-50ff61098010 req-49b56d17-645d-4c7e-ae11-49cb6d25fe39 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:59.748321 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-4f2b150d-6c96-48a1-a31b-50ff61098010 req-49b56d17-645d-4c7e-ae11-49cb6d25fe39 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:59.748841 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-4f2b150d-6c96-48a1-a31b-50ff61098010 req-49b56d17-645d-4c7e-ae11-49cb6d25fe39 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:59.774439 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-4f2b150d-6c96-48a1-a31b-50ff61098010 req-49b56d17-645d-4c7e-ae11-49cb6d25fe39 service nova] Creating event network-changed:8278f8f9-983d-4cfa-a8ac-1087118dfdda for instance dec86071-1ea0-4d1d-a36d-256b898add8e on n-h1-851028-13 Oct 04 19:01:59.779987 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-4f2b150d-6c96-48a1-a31b-50ff61098010 req-49b56d17-645d-4c7e-ae11-49cb6d25fe39 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061379 Oct 04 19:01:59.780915 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2951/5546] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:01:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:01:59.883213 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-08c8cc90-9555-4a6e-beec-4264dde087c0 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c997bc60473b43fd9fcf0c65111c44c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a711601b7a439caf395233de1febff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:59.898263 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-08c8cc90-9555-4a6e-beec-4264dde087c0 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "GET /compute/v2.1/servers/703e06d0-b24b-4a2b-900c-55c8a9291887" status: 200 len: 1500 microversion: 2.1 time: 0.583883 Oct 04 19:01:59.898864 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2596/5547] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:01:59 2022] GET /compute/v2.1/servers/703e06d0-b24b-4a2b-900c-55c8a9291887 => generated 1500 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:01:59.923323 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-50b24a81-77d9-4ea5-aaeb-5178c3577600 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:01:59.925913 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-50b24a81-77d9-4ea5-aaeb-5178c3577600 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: 703e06d0-b24b-4a2b-900c-55c8a9291887] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:59.937252 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-50b24a81-77d9-4ea5-aaeb-5178c3577600 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:59.937761 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-50b24a81-77d9-4ea5-aaeb-5178c3577600 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:59.943332 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-50b24a81-77d9-4ea5-aaeb-5178c3577600 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:59.954318 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-50b24a81-77d9-4ea5-aaeb-5178c3577600 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:59.961329 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-50b24a81-77d9-4ea5-aaeb-5178c3577600 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:59.962117 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-50b24a81-77d9-4ea5-aaeb-5178c3577600 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:00.088552 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-50b24a81-77d9-4ea5-aaeb-5178c3577600 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "POST /compute/v2.1/servers/703e06d0-b24b-4a2b-900c-55c8a9291887/action" status: 202 len: 0 microversion: 2.1 time: 0.169120 Oct 04 19:02:00.102504 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2952/5548] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 19:01:59 2022] POST /compute/v2.1/servers/703e06d0-b24b-4a2b-900c-55c8a9291887/action => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:02:00.113273 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-a9b4f6ef-21b1-41d2-bb5e-57b02d1f2e67 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:00.114099 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-a9b4f6ef-21b1-41d2-bb5e-57b02d1f2e67 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: 703e06d0-b24b-4a2b-900c-55c8a9291887] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:00.128361 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a9b4f6ef-21b1-41d2-bb5e-57b02d1f2e67 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:00.133170 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a9b4f6ef-21b1-41d2-bb5e-57b02d1f2e67 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:00.133908 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a9b4f6ef-21b1-41d2-bb5e-57b02d1f2e67 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:00.134810 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a9b4f6ef-21b1-41d2-bb5e-57b02d1f2e67 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:00.135341 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a9b4f6ef-21b1-41d2-bb5e-57b02d1f2e67 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:00.138487 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a9b4f6ef-21b1-41d2-bb5e-57b02d1f2e67 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:00.348249 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-a9b4f6ef-21b1-41d2-bb5e-57b02d1f2e67 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c997bc60473b43fd9fcf0c65111c44c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a711601b7a439caf395233de1febff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:00.361153 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-a9b4f6ef-21b1-41d2-bb5e-57b02d1f2e67 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "GET /compute/v2.1/servers/703e06d0-b24b-4a2b-900c-55c8a9291887" status: 200 len: 1505 microversion: 2.1 time: 0.254458 Oct 04 19:02:00.362523 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2597/5549] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:00 2022] GET /compute/v2.1/servers/703e06d0-b24b-4a2b-900c-55c8a9291887 => generated 1505 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:02:00.743442 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-431952f8-1cac-4f83-8af6-821e0ec7a31c tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:00.744655 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-431952f8-1cac-4f83-8af6-821e0ec7a31c tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] [instance: dec86071-1ea0-4d1d-a36d-256b898add8e] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:00.754901 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-431952f8-1cac-4f83-8af6-821e0ec7a31c tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:00.755566 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-431952f8-1cac-4f83-8af6-821e0ec7a31c tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:00.756252 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-431952f8-1cac-4f83-8af6-821e0ec7a31c tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:00.758780 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-431952f8-1cac-4f83-8af6-821e0ec7a31c tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:00.760404 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-431952f8-1cac-4f83-8af6-821e0ec7a31c tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:00.761933 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-431952f8-1cac-4f83-8af6-821e0ec7a31c tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:00.945546 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-431952f8-1cac-4f83-8af6-821e0ec7a31c tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42c4b6cf4143aaa88eea5a932dd387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0c1daab0894e32af9427fc51dea8d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:00.959488 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-431952f8-1cac-4f83-8af6-821e0ec7a31c tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] 10.222.0.43 "GET /compute/v2.1/servers/dec86071-1ea0-4d1d-a36d-256b898add8e" status: 200 len: 1325 microversion: 2.1 time: 0.223397 Oct 04 19:02:00.960131 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2953/5550] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:00 2022] GET /compute/v2.1/servers/dec86071-1ea0-4d1d-a36d-256b898add8e => generated 1325 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:02:01.386023 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-2b4627fc-0313-4aae-8009-25a9a401fed3 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:01.386663 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-2b4627fc-0313-4aae-8009-25a9a401fed3 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: 703e06d0-b24b-4a2b-900c-55c8a9291887] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:01.400999 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2b4627fc-0313-4aae-8009-25a9a401fed3 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:01.405318 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2b4627fc-0313-4aae-8009-25a9a401fed3 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:01.405859 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2b4627fc-0313-4aae-8009-25a9a401fed3 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:01.406628 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2b4627fc-0313-4aae-8009-25a9a401fed3 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:01.407110 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2b4627fc-0313-4aae-8009-25a9a401fed3 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:01.407554 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2b4627fc-0313-4aae-8009-25a9a401fed3 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:01.793630 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-2b4627fc-0313-4aae-8009-25a9a401fed3 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c997bc60473b43fd9fcf0c65111c44c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a711601b7a439caf395233de1febff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:01.811679 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-2b4627fc-0313-4aae-8009-25a9a401fed3 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "GET /compute/v2.1/servers/703e06d0-b24b-4a2b-900c-55c8a9291887" status: 200 len: 1485 microversion: 2.1 time: 0.429970 Oct 04 19:02:01.813983 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2598/5551] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:01 2022] GET /compute/v2.1/servers/703e06d0-b24b-4a2b-900c-55c8a9291887 => generated 1485 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:02:01.837848 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-a7896768-1d73-4e51-8194-0f9cfebd0f0a tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:01.839087 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-a7896768-1d73-4e51-8194-0f9cfebd0f0a tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: 703e06d0-b24b-4a2b-900c-55c8a9291887] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:01.852500 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a7896768-1d73-4e51-8194-0f9cfebd0f0a tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:01.852904 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a7896768-1d73-4e51-8194-0f9cfebd0f0a tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:01.853381 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a7896768-1d73-4e51-8194-0f9cfebd0f0a tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:01.854105 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a7896768-1d73-4e51-8194-0f9cfebd0f0a tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:01.854561 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a7896768-1d73-4e51-8194-0f9cfebd0f0a tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:01.855002 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a7896768-1d73-4e51-8194-0f9cfebd0f0a tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:01.893715 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-a7896768-1d73-4e51-8194-0f9cfebd0f0a tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: 703e06d0-b24b-4a2b-900c-55c8a9291887] Going to try to terminate instance {{(pid=123596) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 19:02:01.990123 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-a003a68c-50b5-4890-b556-9f17f0564e19 tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:01.993971 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-a003a68c-50b5-4890-b556-9f17f0564e19 tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] [instance: dec86071-1ea0-4d1d-a36d-256b898add8e] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:02.020754 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-a7896768-1d73-4e51-8194-0f9cfebd0f0a tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "DELETE /compute/v2.1/servers/703e06d0-b24b-4a2b-900c-55c8a9291887" status: 204 len: 0 microversion: 2.1 time: 0.184280 Oct 04 19:02:02.023013 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2954/5552] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 19:02:01 2022] DELETE /compute/v2.1/servers/703e06d0-b24b-4a2b-900c-55c8a9291887 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:02:02.029394 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a003a68c-50b5-4890-b556-9f17f0564e19 tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:02.031238 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a003a68c-50b5-4890-b556-9f17f0564e19 tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:02.034703 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-b90a23e8-49b1-48fb-89a9-4447331dba26 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:02.035414 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-b90a23e8-49b1-48fb-89a9-4447331dba26 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: 703e06d0-b24b-4a2b-900c-55c8a9291887] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:02.039055 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a003a68c-50b5-4890-b556-9f17f0564e19 tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:02.040366 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a003a68c-50b5-4890-b556-9f17f0564e19 tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:02.041033 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a003a68c-50b5-4890-b556-9f17f0564e19 tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:02.042883 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b90a23e8-49b1-48fb-89a9-4447331dba26 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:02.043616 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b90a23e8-49b1-48fb-89a9-4447331dba26 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:02.044224 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b90a23e8-49b1-48fb-89a9-4447331dba26 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:02.045099 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b90a23e8-49b1-48fb-89a9-4447331dba26 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:02.045752 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b90a23e8-49b1-48fb-89a9-4447331dba26 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:02.046344 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b90a23e8-49b1-48fb-89a9-4447331dba26 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:02.049839 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a003a68c-50b5-4890-b556-9f17f0564e19 tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:02.115747 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=100 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:02:02.289481 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-b90a23e8-49b1-48fb-89a9-4447331dba26 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c997bc60473b43fd9fcf0c65111c44c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a711601b7a439caf395233de1febff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:02.301084 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-b90a23e8-49b1-48fb-89a9-4447331dba26 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "GET /compute/v2.1/servers/703e06d0-b24b-4a2b-900c-55c8a9291887" status: 200 len: 1491 microversion: 2.1 time: 0.273805 Oct 04 19:02:02.313139 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2955/5553] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:02 2022] GET /compute/v2.1/servers/703e06d0-b24b-4a2b-900c-55c8a9291887 => generated 1491 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:02:02.316888 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-483bda6c-99eb-4e46-8c53-5665f1fedf2a tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:02:02.319202 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-483bda6c-99eb-4e46-8c53-5665f1fedf2a tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] [instance: 03c66e0a-0383-46dc-b2af-0158ae3eacbf] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:02.337128 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-483bda6c-99eb-4e46-8c53-5665f1fedf2a tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:02.337648 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-483bda6c-99eb-4e46-8c53-5665f1fedf2a tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:02.338098 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-483bda6c-99eb-4e46-8c53-5665f1fedf2a tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:02.338817 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-483bda6c-99eb-4e46-8c53-5665f1fedf2a tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:02.339277 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-483bda6c-99eb-4e46-8c53-5665f1fedf2a tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:02.339708 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-483bda6c-99eb-4e46-8c53-5665f1fedf2a tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:02.384759 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-a003a68c-50b5-4890-b556-9f17f0564e19 tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42c4b6cf4143aaa88eea5a932dd387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0c1daab0894e32af9427fc51dea8d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:02.393569 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-a003a68c-50b5-4890-b556-9f17f0564e19 tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] 10.222.0.43 "GET /compute/v2.1/servers/dec86071-1ea0-4d1d-a36d-256b898add8e" status: 200 len: 1325 microversion: 2.1 time: 0.413215 Oct 04 19:02:02.409880 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2599/5554] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:01 2022] GET /compute/v2.1/servers/dec86071-1ea0-4d1d-a36d-256b898add8e => generated 1325 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:02:03.256584 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-483bda6c-99eb-4e46-8c53-5665f1fedf2a tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] 10.222.0.43 "POST /compute/v2.1/servers/03c66e0a-0383-46dc-b2af-0158ae3eacbf/action" status: 200 len: 32634 microversion: 2.1 time: 0.946870 Oct 04 19:02:03.259293 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2956/5555] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 19:02:02 2022] POST /compute/v2.1/servers/03c66e0a-0383-46dc-b2af-0158ae3eacbf/action => generated 32634 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 19:02:03.329283 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-b9ca5a4f-1ad6-4368-b584-512fc13c283b tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:03.329905 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-b9ca5a4f-1ad6-4368-b584-512fc13c283b tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: 703e06d0-b24b-4a2b-900c-55c8a9291887] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:03.339537 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b9ca5a4f-1ad6-4368-b584-512fc13c283b tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:03.340037 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b9ca5a4f-1ad6-4368-b584-512fc13c283b tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:03.340484 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b9ca5a4f-1ad6-4368-b584-512fc13c283b tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:03.341241 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b9ca5a4f-1ad6-4368-b584-512fc13c283b tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:03.341700 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b9ca5a4f-1ad6-4368-b584-512fc13c283b tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:03.342148 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b9ca5a4f-1ad6-4368-b584-512fc13c283b tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:03.419258 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-038cec1f-1746-4068-8211-3f3d448e12d9 tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:03.420380 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-038cec1f-1746-4068-8211-3f3d448e12d9 tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] [instance: dec86071-1ea0-4d1d-a36d-256b898add8e] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:03.427883 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-038cec1f-1746-4068-8211-3f3d448e12d9 tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:03.429335 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-038cec1f-1746-4068-8211-3f3d448e12d9 tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:03.430353 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-038cec1f-1746-4068-8211-3f3d448e12d9 tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:03.431245 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-038cec1f-1746-4068-8211-3f3d448e12d9 tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:03.431871 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-038cec1f-1746-4068-8211-3f3d448e12d9 tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:03.432469 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-038cec1f-1746-4068-8211-3f3d448e12d9 tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:03.610971 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-038cec1f-1746-4068-8211-3f3d448e12d9 tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42c4b6cf4143aaa88eea5a932dd387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0c1daab0894e32af9427fc51dea8d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:03.620975 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-038cec1f-1746-4068-8211-3f3d448e12d9 tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] 10.222.0.43 "GET /compute/v2.1/servers/dec86071-1ea0-4d1d-a36d-256b898add8e" status: 200 len: 1325 microversion: 2.1 time: 0.205005 Oct 04 19:02:03.638060 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2957/5556] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:03 2022] GET /compute/v2.1/servers/dec86071-1ea0-4d1d-a36d-256b898add8e => generated 1325 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:02:03.639386 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-b9ca5a4f-1ad6-4368-b584-512fc13c283b tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c997bc60473b43fd9fcf0c65111c44c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a711601b7a439caf395233de1febff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:03.662875 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-b9ca5a4f-1ad6-4368-b584-512fc13c283b tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "GET /compute/v2.1/servers/703e06d0-b24b-4a2b-900c-55c8a9291887" status: 200 len: 1491 microversion: 2.1 time: 0.336167 Oct 04 19:02:03.672814 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2600/5557] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:03 2022] GET /compute/v2.1/servers/703e06d0-b24b-4a2b-900c-55c8a9291887 => generated 1491 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:02:03.982514 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-26b7a2fb-8550-4d5a-93b1-97f069263158 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:02:03.985198 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-26b7a2fb-8550-4d5a-93b1-97f069263158 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] [instance: 32f44032-85ec-43eb-b714-748a7f4f0b5b] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:04.015882 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-26b7a2fb-8550-4d5a-93b1-97f069263158 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:04.019356 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-26b7a2fb-8550-4d5a-93b1-97f069263158 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:04.021085 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-26b7a2fb-8550-4d5a-93b1-97f069263158 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:04.023428 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-26b7a2fb-8550-4d5a-93b1-97f069263158 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:04.024260 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-26b7a2fb-8550-4d5a-93b1-97f069263158 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:04.027493 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-26b7a2fb-8550-4d5a-93b1-97f069263158 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:04.120800 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-26b7a2fb-8550-4d5a-93b1-97f069263158 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] 10.222.0.43 "POST /compute/v2.1/servers/32f44032-85ec-43eb-b714-748a7f4f0b5b/action" status: 200 len: 24566 microversion: 2.1 time: 0.141968 Oct 04 19:02:04.122094 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2958/5558] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 19:02:03 2022] POST /compute/v2.1/servers/32f44032-85ec-43eb-b714-748a7f4f0b5b/action => generated 24566 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 19:02:04.648292 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-525e7f0d-b17e-4c40-847c-18600798c1a2 tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:04.648903 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-525e7f0d-b17e-4c40-847c-18600798c1a2 tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] [instance: dec86071-1ea0-4d1d-a36d-256b898add8e] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:04.652325 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=2 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:02:04.655284 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=3 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:02:04.671597 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-525e7f0d-b17e-4c40-847c-18600798c1a2 tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:04.672958 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-525e7f0d-b17e-4c40-847c-18600798c1a2 tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:04.675304 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-525e7f0d-b17e-4c40-847c-18600798c1a2 tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:04.677017 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-525e7f0d-b17e-4c40-847c-18600798c1a2 tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:04.679905 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-525e7f0d-b17e-4c40-847c-18600798c1a2 tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:04.681536 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-525e7f0d-b17e-4c40-847c-18600798c1a2 tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:04.699808 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-b02c263e-ecbb-4853-be30-0cfb78252521 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:04.701910 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-b02c263e-ecbb-4853-be30-0cfb78252521 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: 703e06d0-b24b-4a2b-900c-55c8a9291887] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:04.720534 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=2 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:02:04.723146 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=6 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:02:04.733125 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b02c263e-ecbb-4853-be30-0cfb78252521 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:04.733948 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b02c263e-ecbb-4853-be30-0cfb78252521 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:04.734914 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b02c263e-ecbb-4853-be30-0cfb78252521 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:04.737821 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b02c263e-ecbb-4853-be30-0cfb78252521 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:04.739186 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b02c263e-ecbb-4853-be30-0cfb78252521 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:04.739659 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b02c263e-ecbb-4853-be30-0cfb78252521 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:04.940965 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-b02c263e-ecbb-4853-be30-0cfb78252521 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c997bc60473b43fd9fcf0c65111c44c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a711601b7a439caf395233de1febff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:04.957019 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-b02c263e-ecbb-4853-be30-0cfb78252521 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "GET /compute/v2.1/servers/703e06d0-b24b-4a2b-900c-55c8a9291887" status: 200 len: 1449 microversion: 2.1 time: 0.265244 Oct 04 19:02:04.970867 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2959/5559] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:04 2022] GET /compute/v2.1/servers/703e06d0-b24b-4a2b-900c-55c8a9291887 => generated 1449 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:02:04.988322 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-fde8c2f0-6ce8-45e2-967b-785953619fe5 req-0d4f045c-963d-4a0f-a0aa-75a947b825a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "703e06d0-b24b-4a2b-900c-55c8a9291887", "name": "network-vif-deleted", "tag": "c4f9f98c-707f-4eda-93e5-4aae0f4b6d42"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:02:05.016200 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-fde8c2f0-6ce8-45e2-967b-785953619fe5 req-0d4f045c-963d-4a0f-a0aa-75a947b825a6 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:05.016939 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-fde8c2f0-6ce8-45e2-967b-785953619fe5 req-0d4f045c-963d-4a0f-a0aa-75a947b825a6 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:05.018486 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-fde8c2f0-6ce8-45e2-967b-785953619fe5 req-0d4f045c-963d-4a0f-a0aa-75a947b825a6 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:05.052817 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-fde8c2f0-6ce8-45e2-967b-785953619fe5 req-0d4f045c-963d-4a0f-a0aa-75a947b825a6 service nova] Creating event network-vif-deleted:c4f9f98c-707f-4eda-93e5-4aae0f4b6d42 for instance 703e06d0-b24b-4a2b-900c-55c8a9291887 on n-h2-851028-13 Oct 04 19:02:05.060386 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-fde8c2f0-6ce8-45e2-967b-785953619fe5 req-0d4f045c-963d-4a0f-a0aa-75a947b825a6 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087781 Oct 04 19:02:05.062091 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2960/5560] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:02:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:02:05.272867 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-525e7f0d-b17e-4c40-847c-18600798c1a2 tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42c4b6cf4143aaa88eea5a932dd387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0c1daab0894e32af9427fc51dea8d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:05.285315 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-525e7f0d-b17e-4c40-847c-18600798c1a2 tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] 10.222.0.43 "GET /compute/v2.1/servers/dec86071-1ea0-4d1d-a36d-256b898add8e" status: 200 len: 1325 microversion: 2.1 time: 0.642984 Oct 04 19:02:05.286038 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2601/5561] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:04 2022] GET /compute/v2.1/servers/dec86071-1ea0-4d1d-a36d-256b898add8e => generated 1325 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:02:05.682678 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-5e2dc90f-bcfb-46cf-9787-daf3c59643fb tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:05.683579 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-5e2dc90f-bcfb-46cf-9787-daf3c59643fb tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] [instance: 03c66e0a-0383-46dc-b2af-0158ae3eacbf] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:05.698580 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5e2dc90f-bcfb-46cf-9787-daf3c59643fb tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:05.699345 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5e2dc90f-bcfb-46cf-9787-daf3c59643fb tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:05.701970 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5e2dc90f-bcfb-46cf-9787-daf3c59643fb tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:05.703729 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5e2dc90f-bcfb-46cf-9787-daf3c59643fb tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:05.705683 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5e2dc90f-bcfb-46cf-9787-daf3c59643fb tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:05.706702 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5e2dc90f-bcfb-46cf-9787-daf3c59643fb tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:05.776903 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-5e2dc90f-bcfb-46cf-9787-daf3c59643fb tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] [instance: 03c66e0a-0383-46dc-b2af-0158ae3eacbf] Going to try to terminate instance {{(pid=123596) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 19:02:05.935218 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-5e2dc90f-bcfb-46cf-9787-daf3c59643fb tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] 10.222.0.43 "DELETE /compute/v2.1/servers/03c66e0a-0383-46dc-b2af-0158ae3eacbf" status: 204 len: 0 microversion: 2.1 time: 0.256808 Oct 04 19:02:05.936525 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2961/5562] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 19:02:05 2022] DELETE /compute/v2.1/servers/03c66e0a-0383-46dc-b2af-0158ae3eacbf => generated 0 bytes in 260 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:02:05.946125 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-c19ae0d0-7020-466d-b86b-58f6b8c2df25 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:05.946747 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-c19ae0d0-7020-466d-b86b-58f6b8c2df25 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] [instance: 03c66e0a-0383-46dc-b2af-0158ae3eacbf] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:05.961972 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c19ae0d0-7020-466d-b86b-58f6b8c2df25 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:05.963036 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c19ae0d0-7020-466d-b86b-58f6b8c2df25 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:05.964504 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c19ae0d0-7020-466d-b86b-58f6b8c2df25 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:05.966144 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c19ae0d0-7020-466d-b86b-58f6b8c2df25 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:05.969083 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c19ae0d0-7020-466d-b86b-58f6b8c2df25 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:05.973876 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c19ae0d0-7020-466d-b86b-58f6b8c2df25 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:05.987127 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-d3557d69-4e94-4c31-b278-7e25359a294d tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:05.988558 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-d3557d69-4e94-4c31-b278-7e25359a294d tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: 703e06d0-b24b-4a2b-900c-55c8a9291887] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:05.997248 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d3557d69-4e94-4c31-b278-7e25359a294d tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:05.998256 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d3557d69-4e94-4c31-b278-7e25359a294d tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:05.998887 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d3557d69-4e94-4c31-b278-7e25359a294d tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:05.999953 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d3557d69-4e94-4c31-b278-7e25359a294d tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:06.000420 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d3557d69-4e94-4c31-b278-7e25359a294d tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:06.000851 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d3557d69-4e94-4c31-b278-7e25359a294d tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:06.017381 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-d3557d69-4e94-4c31-b278-7e25359a294d tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] HTTP exception thrown: Instance 703e06d0-b24b-4a2b-900c-55c8a9291887 could not be found. Oct 04 19:02:06.019405 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-d3557d69-4e94-4c31-b278-7e25359a294d tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Request method failure captured: Oct 04 19:02:06.019405 n-d-851028-13 devstack@n-api.service[123596]: request: GET /compute/v2.1/servers/703e06d0-b24b-4a2b-900c-55c8a9291887 HTTP/1.1 Oct 04 19:02:06.019405 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 19:02:06.019405 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 19:02:06.019405 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 19:02:06.019405 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 19:02:06.019405 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 19:02:06.019405 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 19:02:06.019405 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 19:02:06.019405 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 19:02:06.019405 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPIKl7r6ZFtp0u4zXtNLGIhqHo70GyUJnklFY8mLM6SAvqzMqMYlk7FNNMFRu1dxhVJoaHCY-KymtUU7SbzcnaY3gmI4NmuaRKJjk_WfnM3eNlWdo1XIjmy2xIfTxketrHpoedtH-76PD0N1ebOmJq-sWqhFc1j62MJ2QKuwEgYmouJ4 Oct 04 19:02:06.019405 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 19:02:06.019405 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 19:02:06.019405 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 19:02:06.019405 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 19:02:06.019405 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 19:02:06.019405 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 19:02:06.019405 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: a6a711601b7a439caf395233de1febff Oct 04 19:02:06.019405 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-DeleteServersTestJSON-591734195 Oct 04 19:02:06.019405 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 19:02:06.019405 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 19:02:06.019405 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/a6a711601b7a439caf395233de1febff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_a6a711601b7a439caf395233de1febff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a6a711601b7a439caf395233de1febff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a6a711601b7a439caf395233de1febff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 19:02:06.019405 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-DeleteServersTestJSON-591734195 Oct 04 19:02:06.019405 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: a6a711601b7a439caf395233de1febff Oct 04 19:02:06.019405 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-DeleteServersTestJSON-591734195 Oct 04 19:02:06.019405 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-DeleteServersTestJSON-591734195-project Oct 04 19:02:06.019405 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 19:02:06.019405 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 19:02:06.019405 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: c997bc60473b43fd9fcf0c65111c44c0 Oct 04 19:02:06.019405 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-DeleteServersTestJSON-591734195-project Oct 04 19:02:06.019405 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 19:02:06.019405 n-d-851028-13 devstack@n-api.service[123596]: exception: Instance 703e06d0-b24b-4a2b-900c-55c8a9291887 could not be found. Oct 04 19:02:06.019405 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': '703e06d0-b24b-4a2b-900c-55c8a9291887'} Oct 04 19:02:06.019405 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:02:06.019405 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:02:06.019405 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:02:06.019405 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:02:06.019405 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:02:06.019405 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:02:06.019405 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:02:06.019405 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:02:06.019405 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:02:06.019405 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:02:06.019405 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 703e06d0-b24b-4a2b-900c-55c8a9291887 could not be found. Oct 04 19:02:06.019405 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:02:06.019405 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:02:06.019405 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:02:06.019405 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:02:06.019405 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:02:06.019405 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:02:06.019405 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:02:06.019405 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:02:06.019405 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:02:06.019405 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:02:06.019405 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:02:06.019405 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:02:06.019405 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:02:06.019405 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:02:06.019405 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:02:06.019405 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:02:06.019405 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 703e06d0-b24b-4a2b-900c-55c8a9291887 could not be found. Oct 04 19:02:06.019405 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:02:06.019405 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:02:06.019405 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:02:06.035460 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:02:06.035460 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:02:06.035460 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:02:06.035460 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:02:06.035460 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:02:06.035460 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 703e06d0-b24b-4a2b-900c-55c8a9291887 could not be found. Oct 04 19:02:06.035460 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:02:06.035460 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-d3557d69-4e94-4c31-b278-7e25359a294d tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Returning 404 to user: Instance 703e06d0-b24b-4a2b-900c-55c8a9291887 could not be found. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:02:06.035460 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-d3557d69-4e94-4c31-b278-7e25359a294d tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "GET /compute/v2.1/servers/703e06d0-b24b-4a2b-900c-55c8a9291887" status: 404 len: 111 microversion: 2.1 time: 0.042184 Oct 04 19:02:06.035460 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2962/5563] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:05 2022] GET /compute/v2.1/servers/703e06d0-b24b-4a2b-900c-55c8a9291887 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 19:02:06.311354 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-aeee51fa-454b-4432-977a-c6fc018180f2 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1111959546", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452", "networks": [{"uuid": "dcd99798-7080-4c74-b648-36288a298add"}]}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:02:06.338285 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-c19ae0d0-7020-466d-b86b-58f6b8c2df25 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1bb492fb294837b1e55d58bbfa3d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a4c327763b4440a9dc456cfbb31f88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:06.356372 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-c19ae0d0-7020-466d-b86b-58f6b8c2df25 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] 10.222.0.43 "GET /compute/v2.1/servers/03c66e0a-0383-46dc-b2af-0158ae3eacbf" status: 200 len: 1670 microversion: 2.1 time: 0.415276 Oct 04 19:02:06.357342 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2602/5564] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:05 2022] GET /compute/v2.1/servers/03c66e0a-0383-46dc-b2af-0158ae3eacbf => generated 1670 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:02:06.363549 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-9f01e1c2-d4ea-406f-b37e-df07d5807604 tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:06.364472 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-9f01e1c2-d4ea-406f-b37e-df07d5807604 tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] [instance: dec86071-1ea0-4d1d-a36d-256b898add8e] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:06.374094 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9f01e1c2-d4ea-406f-b37e-df07d5807604 tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:06.374871 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9f01e1c2-d4ea-406f-b37e-df07d5807604 tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:06.375535 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9f01e1c2-d4ea-406f-b37e-df07d5807604 tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:06.376620 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9f01e1c2-d4ea-406f-b37e-df07d5807604 tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:06.377336 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9f01e1c2-d4ea-406f-b37e-df07d5807604 tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:06.381462 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9f01e1c2-d4ea-406f-b37e-df07d5807604 tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:06.431664 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.network.neutron [None req-aeee51fa-454b-4432-977a-c6fc018180f2 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] validate_networks() for [('dcd99798-7080-4c74-b648-36288a298add', None, None, None, None, None)] {{(pid=123596) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 19:02:06.627255 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-9f01e1c2-d4ea-406f-b37e-df07d5807604 tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42c4b6cf4143aaa88eea5a932dd387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0c1daab0894e32af9427fc51dea8d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:06.644084 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-9f01e1c2-d4ea-406f-b37e-df07d5807604 tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] 10.222.0.43 "GET /compute/v2.1/servers/dec86071-1ea0-4d1d-a36d-256b898add8e" status: 200 len: 1325 microversion: 2.1 time: 0.284891 Oct 04 19:02:06.646538 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2603/5565] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:06 2022] GET /compute/v2.1/servers/dec86071-1ea0-4d1d-a36d-256b898add8e => generated 1325 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:02:06.657490 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-5ba19342-9e14-4dbd-be18-448abeb541ad req-1e41518f-35a0-4764-8559-59bf6f793b0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dec86071-1ea0-4d1d-a36d-256b898add8e", "name": "network-vif-plugged", "status": "completed", "tag": "8278f8f9-983d-4cfa-a8ac-1087118dfdda"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:02:06.686932 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-5ba19342-9e14-4dbd-be18-448abeb541ad req-1e41518f-35a0-4764-8559-59bf6f793b0d service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:06.687400 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-5ba19342-9e14-4dbd-be18-448abeb541ad req-1e41518f-35a0-4764-8559-59bf6f793b0d service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:06.687847 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-5ba19342-9e14-4dbd-be18-448abeb541ad req-1e41518f-35a0-4764-8559-59bf6f793b0d service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:06.708012 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-5ba19342-9e14-4dbd-be18-448abeb541ad req-1e41518f-35a0-4764-8559-59bf6f793b0d service nova] Creating event network-vif-plugged:8278f8f9-983d-4cfa-a8ac-1087118dfdda for instance dec86071-1ea0-4d1d-a36d-256b898add8e on n-h1-851028-13 Oct 04 19:02:06.724511 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-5ba19342-9e14-4dbd-be18-448abeb541ad req-1e41518f-35a0-4764-8559-59bf6f793b0d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070945 Oct 04 19:02:06.727766 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2604/5566] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:02:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:02:07.123010 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-aeee51fa-454b-4432-977a-c6fc018180f2 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Flavor limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:02:07.123486 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-aeee51fa-454b-4432-977a-c6fc018180f2 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Image limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:02:07.123887 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-aeee51fa-454b-4432-977a-c6fc018180f2 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Flavor pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:02:07.124745 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-aeee51fa-454b-4432-977a-c6fc018180f2 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Image pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:02:07.125553 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-aeee51fa-454b-4432-977a-c6fc018180f2 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:02:07.139232 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-aeee51fa-454b-4432-977a-c6fc018180f2 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:07.139923 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-aeee51fa-454b-4432-977a-c6fc018180f2 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:07.140581 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-aeee51fa-454b-4432-977a-c6fc018180f2 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:07.141276 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-c542a468-c678-4d96-a231-d2d7adcc94f7 req-4110beba-e027-4b82-b53a-5545719effce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03c66e0a-0383-46dc-b2af-0158ae3eacbf", "tag": "7fc80ed0-682f-4c8a-859e-2ef4cbc1e353"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:02:07.142083 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-aeee51fa-454b-4432-977a-c6fc018180f2 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:07.144244 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-aeee51fa-454b-4432-977a-c6fc018180f2 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:07.145059 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-aeee51fa-454b-4432-977a-c6fc018180f2 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:07.161245 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-c542a468-c678-4d96-a231-d2d7adcc94f7 req-4110beba-e027-4b82-b53a-5545719effce service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:07.161778 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-c542a468-c678-4d96-a231-d2d7adcc94f7 req-4110beba-e027-4b82-b53a-5545719effce service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:07.164756 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-c542a468-c678-4d96-a231-d2d7adcc94f7 req-4110beba-e027-4b82-b53a-5545719effce service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:07.174522 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-aeee51fa-454b-4432-977a-c6fc018180f2 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Getting quotas for project a6a711601b7a439caf395233de1febff. Resources: {'ram', 'cores', 'instances'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:02:07.181939 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-c542a468-c678-4d96-a231-d2d7adcc94f7 req-4110beba-e027-4b82-b53a-5545719effce service nova] Creating event network-changed:7fc80ed0-682f-4c8a-859e-2ef4cbc1e353 for instance 03c66e0a-0383-46dc-b2af-0158ae3eacbf on n-h2-851028-13 Oct 04 19:02:07.185366 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-aeee51fa-454b-4432-977a-c6fc018180f2 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Getting quotas for user c997bc60473b43fd9fcf0c65111c44c0 and project a6a711601b7a439caf395233de1febff. Resources: {'ram', 'cores', 'instances'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:02:07.190828 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-c542a468-c678-4d96-a231-d2d7adcc94f7 req-4110beba-e027-4b82-b53a-5545719effce service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055096 Oct 04 19:02:07.195970 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2605/5567] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:02:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:02:07.202721 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-aeee51fa-454b-4432-977a-c6fc018180f2 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Going to run 1 instances... {{(pid=123596) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 19:02:07.227731 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-aeee51fa-454b-4432-977a-c6fc018180f2 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: 3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e8943ec5-4038-4d4b-b9b9-2415a79f5243',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123596) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 19:02:07.338120 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-aeee51fa-454b-4432-977a-c6fc018180f2 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.031650 Oct 04 19:02:07.340451 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2963/5568] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 19:02:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 1035 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 19:02:07.355771 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-c754eefc-e5ec-45a6-b3e8-1352866d66e5 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:07.358106 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-c754eefc-e5ec-45a6-b3e8-1352866d66e5 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: 3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:07.387487 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-d21f238d-f7aa-4efb-80e9-b5d0221e4a52 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:07.387973 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-d21f238d-f7aa-4efb-80e9-b5d0221e4a52 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] [instance: 03c66e0a-0383-46dc-b2af-0158ae3eacbf] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:07.409545 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d21f238d-f7aa-4efb-80e9-b5d0221e4a52 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:07.412140 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d21f238d-f7aa-4efb-80e9-b5d0221e4a52 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:07.415390 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d21f238d-f7aa-4efb-80e9-b5d0221e4a52 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:07.416992 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d21f238d-f7aa-4efb-80e9-b5d0221e4a52 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:07.418666 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d21f238d-f7aa-4efb-80e9-b5d0221e4a52 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:07.420375 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d21f238d-f7aa-4efb-80e9-b5d0221e4a52 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:07.479210 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:02:07.542497 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-c754eefc-e5ec-45a6-b3e8-1352866d66e5 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c997bc60473b43fd9fcf0c65111c44c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a711601b7a439caf395233de1febff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:07.575044 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-c754eefc-e5ec-45a6-b3e8-1352866d66e5 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "GET /compute/v2.1/servers/3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff" status: 200 len: 1215 microversion: 2.1 time: 0.226230 Oct 04 19:02:07.575668 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2606/5569] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:07 2022] GET /compute/v2.1/servers/3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff => generated 1215 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:02:07.677048 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-aed1fb78-8a2f-4f2b-a379-b94a5594c65f tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:07.678487 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-aed1fb78-8a2f-4f2b-a379-b94a5594c65f tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] [instance: dec86071-1ea0-4d1d-a36d-256b898add8e] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:07.689280 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-aed1fb78-8a2f-4f2b-a379-b94a5594c65f tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:07.690802 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-aed1fb78-8a2f-4f2b-a379-b94a5594c65f tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:07.691970 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-aed1fb78-8a2f-4f2b-a379-b94a5594c65f tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:07.693477 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-aed1fb78-8a2f-4f2b-a379-b94a5594c65f tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:07.694627 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-aed1fb78-8a2f-4f2b-a379-b94a5594c65f tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:07.695850 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-aed1fb78-8a2f-4f2b-a379-b94a5594c65f tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:08.220038 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-d21f238d-f7aa-4efb-80e9-b5d0221e4a52 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1bb492fb294837b1e55d58bbfa3d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a4c327763b4440a9dc456cfbb31f88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:08.235308 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-d21f238d-f7aa-4efb-80e9-b5d0221e4a52 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] 10.222.0.43 "GET /compute/v2.1/servers/03c66e0a-0383-46dc-b2af-0158ae3eacbf" status: 200 len: 1670 microversion: 2.1 time: 0.851632 Oct 04 19:02:08.239502 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2964/5570] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:07 2022] GET /compute/v2.1/servers/03c66e0a-0383-46dc-b2af-0158ae3eacbf => generated 1670 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:02:08.551523 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-aed1fb78-8a2f-4f2b-a379-b94a5594c65f tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42c4b6cf4143aaa88eea5a932dd387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0c1daab0894e32af9427fc51dea8d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:08.571285 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-aed1fb78-8a2f-4f2b-a379-b94a5594c65f tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] 10.222.0.43 "GET /compute/v2.1/servers/dec86071-1ea0-4d1d-a36d-256b898add8e" status: 200 len: 1325 microversion: 2.1 time: 0.902252 Oct 04 19:02:08.571897 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2607/5571] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:07 2022] GET /compute/v2.1/servers/dec86071-1ea0-4d1d-a36d-256b898add8e => generated 1325 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:02:08.599969 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-dae6df1b-aef9-47fa-9a43-69f710f6ae6f req-6cba7006-5a3c-409f-b4b6-36f1022e1383 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03c66e0a-0383-46dc-b2af-0158ae3eacbf", "name": "network-vif-deleted", "tag": "7fc80ed0-682f-4c8a-859e-2ef4cbc1e353"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:02:08.605157 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-6dd834d5-6661-4688-83fb-baf97cbd1e05 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:08.605817 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-6dd834d5-6661-4688-83fb-baf97cbd1e05 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: 3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:08.627589 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-dae6df1b-aef9-47fa-9a43-69f710f6ae6f req-6cba7006-5a3c-409f-b4b6-36f1022e1383 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:08.632570 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-dae6df1b-aef9-47fa-9a43-69f710f6ae6f req-6cba7006-5a3c-409f-b4b6-36f1022e1383 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:08.633202 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-dae6df1b-aef9-47fa-9a43-69f710f6ae6f req-6cba7006-5a3c-409f-b4b6-36f1022e1383 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:08.633964 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6dd834d5-6661-4688-83fb-baf97cbd1e05 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:08.634471 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6dd834d5-6661-4688-83fb-baf97cbd1e05 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:08.634917 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6dd834d5-6661-4688-83fb-baf97cbd1e05 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:08.635645 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6dd834d5-6661-4688-83fb-baf97cbd1e05 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:08.636105 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6dd834d5-6661-4688-83fb-baf97cbd1e05 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:08.641911 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6dd834d5-6661-4688-83fb-baf97cbd1e05 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:08.664015 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-dae6df1b-aef9-47fa-9a43-69f710f6ae6f req-6cba7006-5a3c-409f-b4b6-36f1022e1383 service nova] Creating event network-vif-deleted:7fc80ed0-682f-4c8a-859e-2ef4cbc1e353 for instance 03c66e0a-0383-46dc-b2af-0158ae3eacbf on n-h2-851028-13 Oct 04 19:02:08.681608 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-dae6df1b-aef9-47fa-9a43-69f710f6ae6f req-6cba7006-5a3c-409f-b4b6-36f1022e1383 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086133 Oct 04 19:02:08.682109 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2965/5572] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:02:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:02:08.907641 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-6dd834d5-6661-4688-83fb-baf97cbd1e05 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c997bc60473b43fd9fcf0c65111c44c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a711601b7a439caf395233de1febff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:08.925900 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-6dd834d5-6661-4688-83fb-baf97cbd1e05 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "GET /compute/v2.1/servers/3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff" status: 200 len: 1211 microversion: 2.1 time: 0.327431 Oct 04 19:02:08.927292 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2608/5573] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:08 2022] GET /compute/v2.1/servers/3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff => generated 1211 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:02:09.269748 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-63222cee-ad34-4cc6-8477-9f05c40054e3 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:09.270659 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-63222cee-ad34-4cc6-8477-9f05c40054e3 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] [instance: 03c66e0a-0383-46dc-b2af-0158ae3eacbf] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:09.295495 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-63222cee-ad34-4cc6-8477-9f05c40054e3 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:09.296132 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-63222cee-ad34-4cc6-8477-9f05c40054e3 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:09.296602 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-63222cee-ad34-4cc6-8477-9f05c40054e3 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:09.300584 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-63222cee-ad34-4cc6-8477-9f05c40054e3 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:09.302055 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-63222cee-ad34-4cc6-8477-9f05c40054e3 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:09.302530 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-63222cee-ad34-4cc6-8477-9f05c40054e3 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:09.400874 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-63222cee-ad34-4cc6-8477-9f05c40054e3 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:09.401421 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-63222cee-ad34-4cc6-8477-9f05c40054e3 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:09.401879 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-63222cee-ad34-4cc6-8477-9f05c40054e3 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:09.402371 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.objects.instance [None req-63222cee-ad34-4cc6-8477-9f05c40054e3 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lazy-loading 'fault' on Instance uuid 03c66e0a-0383-46dc-b2af-0158ae3eacbf {{(pid=123596) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 19:02:09.484971 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-63222cee-ad34-4cc6-8477-9f05c40054e3 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1bb492fb294837b1e55d58bbfa3d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a4c327763b4440a9dc456cfbb31f88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:09.499696 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-63222cee-ad34-4cc6-8477-9f05c40054e3 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] 10.222.0.43 "GET /compute/v2.1/servers/03c66e0a-0383-46dc-b2af-0158ae3eacbf" status: 200 len: 1338 microversion: 2.1 time: 0.232021 Oct 04 19:02:09.500731 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2966/5574] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:09 2022] GET /compute/v2.1/servers/03c66e0a-0383-46dc-b2af-0158ae3eacbf => generated 1338 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:02:09.601003 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-3c2efc57-2906-41a0-a875-820d2b86199c tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:09.602092 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-3c2efc57-2906-41a0-a875-820d2b86199c tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] [instance: dec86071-1ea0-4d1d-a36d-256b898add8e] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:09.609749 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3c2efc57-2906-41a0-a875-820d2b86199c tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:09.611104 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3c2efc57-2906-41a0-a875-820d2b86199c tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:09.612338 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3c2efc57-2906-41a0-a875-820d2b86199c tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:09.613485 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3c2efc57-2906-41a0-a875-820d2b86199c tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:09.614119 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3c2efc57-2906-41a0-a875-820d2b86199c tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:09.614886 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3c2efc57-2906-41a0-a875-820d2b86199c tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:09.840766 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-3c2efc57-2906-41a0-a875-820d2b86199c tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42c4b6cf4143aaa88eea5a932dd387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0c1daab0894e32af9427fc51dea8d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:09.853882 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-3c2efc57-2906-41a0-a875-820d2b86199c tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] 10.222.0.43 "GET /compute/v2.1/servers/dec86071-1ea0-4d1d-a36d-256b898add8e" status: 200 len: 1521 microversion: 2.1 time: 0.253002 Oct 04 19:02:09.856273 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2609/5575] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:09 2022] GET /compute/v2.1/servers/dec86071-1ea0-4d1d-a36d-256b898add8e => generated 1521 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:02:09.882631 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-6df3eb94-4eb0-40ea-9e3f-2042c61addc4 tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:09.883132 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-6df3eb94-4eb0-40ea-9e3f-2042c61addc4 tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] [instance: dec86071-1ea0-4d1d-a36d-256b898add8e] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:09.897180 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6df3eb94-4eb0-40ea-9e3f-2042c61addc4 tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:09.897756 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6df3eb94-4eb0-40ea-9e3f-2042c61addc4 tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:09.898218 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6df3eb94-4eb0-40ea-9e3f-2042c61addc4 tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:09.898959 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6df3eb94-4eb0-40ea-9e3f-2042c61addc4 tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:09.899429 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6df3eb94-4eb0-40ea-9e3f-2042c61addc4 tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:09.899870 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6df3eb94-4eb0-40ea-9e3f-2042c61addc4 tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:09.928461 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-6df3eb94-4eb0-40ea-9e3f-2042c61addc4 tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] HTTP exception thrown: Instance is not a member of specified network Oct 04 19:02:09.933706 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-6df3eb94-4eb0-40ea-9e3f-2042c61addc4 tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] Request method failure captured: Oct 04 19:02:09.933706 n-d-851028-13 devstack@n-api.service[123596]: request: GET /compute/v2.1/servers/dec86071-1ea0-4d1d-a36d-256b898add8e/ips/invalid HTTP/1.1 Oct 04 19:02:09.933706 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 19:02:09.933706 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 19:02:09.933706 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 19:02:09.933706 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 19:02:09.933706 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 19:02:09.933706 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 19:02:09.933706 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 19:02:09.933706 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 19:02:09.933706 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPIMgHVvWGki8SA21zqW_qMKOnIp9N2XrHL2u6sv5PFrk0W1g4m9YwnmiE-KBXal3geMegyqOlDdFhjmeJ-6_1Nj6qKKBor5G3DYApdcT9s-OMw2J-dNI82ukEDaVKtZrYweRFLfplRO4xmWdG8CUq9Yw6iPmt6Co-KrCXUfeuyrRKlM Oct 04 19:02:09.933706 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 19:02:09.933706 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 19:02:09.933706 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 19:02:09.933706 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 19:02:09.933706 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 19:02:09.933706 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 19:02:09.933706 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: 2e0c1daab0894e32af9427fc51dea8d5 Oct 04 19:02:09.933706 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-2049688835 Oct 04 19:02:09.933706 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 19:02:09.933706 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 19:02:09.933706 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/2e0c1daab0894e32af9427fc51dea8d5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_2e0c1daab0894e32af9427fc51dea8d5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/2e0c1daab0894e32af9427fc51dea8d5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/2e0c1daab0894e32af9427fc51dea8d5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 19:02:09.933706 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-2049688835 Oct 04 19:02:09.933706 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: 2e0c1daab0894e32af9427fc51dea8d5 Oct 04 19:02:09.933706 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-2049688835 Oct 04 19:02:09.933706 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-ServerAddressesNegativeTestJSON-2049688835-project Oct 04 19:02:09.933706 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 19:02:09.933706 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 19:02:09.933706 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 1e42c4b6cf4143aaa88eea5a932dd387 Oct 04 19:02:09.933706 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-2049688835-project Oct 04 19:02:09.933706 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 19:02:09.933706 n-d-851028-13 devstack@n-api.service[123596]: exception: Instance is not a member of specified network Oct 04 19:02:09.933706 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'server_id': 'dec86071-1ea0-4d1d-a36d-256b898add8e', 'id': 'invalid'} Oct 04 19:02:09.933706 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:02:09.933706 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:02:09.933706 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:02:09.933706 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:02:09.933706 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:02:09.933706 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:02:09.933706 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:02:09.933706 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:02:09.933706 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 52, in show Oct 04 19:02:09.933706 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 04 19:02:09.933706 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance is not a member of specified network Oct 04 19:02:09.933706 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:02:09.933706 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:02:09.933706 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:02:09.933706 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:02:09.933706 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:02:09.933706 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:02:09.933706 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:02:09.933706 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:02:09.933706 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance is not a member of specified network Oct 04 19:02:09.933706 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:02:09.938055 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-6df3eb94-4eb0-40ea-9e3f-2042c61addc4 tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] Returning 404 to user: Instance is not a member of specified network {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:02:09.938055 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-6df3eb94-4eb0-40ea-9e3f-2042c61addc4 tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] 10.222.0.43 "GET /compute/v2.1/servers/dec86071-1ea0-4d1d-a36d-256b898add8e/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.057551 Oct 04 19:02:09.938055 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2967/5576] 10.222.0.43 () {58 vars in 1272 bytes} [Tue Oct 4 19:02:09 2022] GET /compute/v2.1/servers/dec86071-1ea0-4d1d-a36d-256b898add8e/ips/invalid => generated 91 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 19:02:09.952330 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-235e66b1-0b68-42cc-89c3-cc6cfe3edecd tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:09.953071 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-235e66b1-0b68-42cc-89c3-cc6cfe3edecd tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: 3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:09.954510 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-f026e591-8cf9-4234-805f-3548a12308b0 tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:09.955364 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-f026e591-8cf9-4234-805f-3548a12308b0 tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] Failed to fetch instance by id 999 {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 04 19:02:09.956046 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-f026e591-8cf9-4234-805f-3548a12308b0 tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] HTTP exception thrown: Instance 999 could not be found. Oct 04 19:02:09.958303 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-f026e591-8cf9-4234-805f-3548a12308b0 tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] Request method failure captured: Oct 04 19:02:09.958303 n-d-851028-13 devstack@n-api.service[123595]: request: GET /compute/v2.1/servers/999/ips HTTP/1.1 Oct 04 19:02:09.958303 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 19:02:09.958303 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 19:02:09.958303 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 19:02:09.958303 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 0 Oct 04 19:02:09.958303 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 19:02:09.958303 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 19:02:09.958303 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 19:02:09.958303 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 19:02:09.958303 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPIMgHVvWGki8SA21zqW_qMKOnIp9N2XrHL2u6sv5PFrk0W1g4m9YwnmiE-KBXal3geMegyqOlDdFhjmeJ-6_1Nj6qKKBor5G3DYApdcT9s-OMw2J-dNI82ukEDaVKtZrYweRFLfplRO4xmWdG8CUq9Yw6iPmt6Co-KrCXUfeuyrRKlM Oct 04 19:02:09.958303 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 19:02:09.958303 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 19:02:09.958303 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 19:02:09.958303 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 19:02:09.958303 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 19:02:09.958303 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 19:02:09.958303 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: 2e0c1daab0894e32af9427fc51dea8d5 Oct 04 19:02:09.958303 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-2049688835 Oct 04 19:02:09.958303 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 19:02:09.958303 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 19:02:09.958303 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/2e0c1daab0894e32af9427fc51dea8d5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_2e0c1daab0894e32af9427fc51dea8d5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/2e0c1daab0894e32af9427fc51dea8d5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/2e0c1daab0894e32af9427fc51dea8d5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 19:02:09.958303 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-2049688835 Oct 04 19:02:09.958303 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: 2e0c1daab0894e32af9427fc51dea8d5 Oct 04 19:02:09.958303 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-2049688835 Oct 04 19:02:09.958303 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-ServerAddressesNegativeTestJSON-2049688835-project Oct 04 19:02:09.958303 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 19:02:09.958303 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 19:02:09.958303 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: 1e42c4b6cf4143aaa88eea5a932dd387 Oct 04 19:02:09.958303 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-2049688835-project Oct 04 19:02:09.958303 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 19:02:09.958303 n-d-851028-13 devstack@n-api.service[123595]: exception: Instance 999 could not be found. Oct 04 19:02:09.958303 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'server_id': '999'} Oct 04 19:02:09.958303 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:02:09.958303 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:02:09.958303 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:02:09.958303 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:02:09.958303 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 04 19:02:09.958303 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 04 19:02:09.958303 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Oct 04 19:02:09.958303 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:02:09.958303 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:02:09.958303 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:02:09.958303 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:02:09.958303 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:02:09.958303 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:02:09.958303 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:02:09.958303 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:02:09.958303 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:02:09.958303 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:02:09.958303 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 37, in index Oct 04 19:02:09.958303 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self._compute_api, context, server_id) Oct 04 19:02:09.958303 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:02:09.958303 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:02:09.958303 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Oct 04 19:02:09.958303 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:02:09.958303 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:02:09.958303 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:02:09.958303 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:02:09.958303 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:02:09.958303 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:02:09.958303 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:02:09.958303 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:02:09.958303 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Oct 04 19:02:09.958303 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:02:09.962922 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-235e66b1-0b68-42cc-89c3-cc6cfe3edecd tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:09.962922 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-235e66b1-0b68-42cc-89c3-cc6cfe3edecd tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:09.962922 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-235e66b1-0b68-42cc-89c3-cc6cfe3edecd tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:09.964025 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-235e66b1-0b68-42cc-89c3-cc6cfe3edecd tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:09.964593 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-235e66b1-0b68-42cc-89c3-cc6cfe3edecd tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:09.965100 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-235e66b1-0b68-42cc-89c3-cc6cfe3edecd tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:09.965309 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-f026e591-8cf9-4234-805f-3548a12308b0 tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] Returning 404 to user: Instance 999 could not be found. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:02:09.966460 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-f026e591-8cf9-4234-805f-3548a12308b0 tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] 10.222.0.43 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.021670 Oct 04 19:02:09.967597 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2610/5577] 10.222.0.43 () {58 vars in 1149 bytes} [Tue Oct 4 19:02:09 2022] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 04 19:02:09.983244 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-89452777-2d7d-424a-955d-9da1d4113369 tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:09.984586 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-89452777-2d7d-424a-955d-9da1d4113369 tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] [instance: dec86071-1ea0-4d1d-a36d-256b898add8e] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:09.999920 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-89452777-2d7d-424a-955d-9da1d4113369 tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:10.001729 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-89452777-2d7d-424a-955d-9da1d4113369 tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:10.002409 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-89452777-2d7d-424a-955d-9da1d4113369 tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:10.004226 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-89452777-2d7d-424a-955d-9da1d4113369 tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:10.005524 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-89452777-2d7d-424a-955d-9da1d4113369 tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:10.006351 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-89452777-2d7d-424a-955d-9da1d4113369 tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:10.048684 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-89452777-2d7d-424a-955d-9da1d4113369 tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] [instance: dec86071-1ea0-4d1d-a36d-256b898add8e] Going to try to terminate instance {{(pid=123595) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 19:02:10.181349 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-89452777-2d7d-424a-955d-9da1d4113369 tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] 10.222.0.43 "DELETE /compute/v2.1/servers/dec86071-1ea0-4d1d-a36d-256b898add8e" status: 204 len: 0 microversion: 2.1 time: 0.204842 Oct 04 19:02:10.182129 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2611/5578] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 19:02:09 2022] DELETE /compute/v2.1/servers/dec86071-1ea0-4d1d-a36d-256b898add8e => generated 0 bytes in 210 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:02:10.200047 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-69faf320-f767-4a2f-9138-35638cc1ae39 tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:10.200851 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-69faf320-f767-4a2f-9138-35638cc1ae39 tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] [instance: dec86071-1ea0-4d1d-a36d-256b898add8e] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:10.210722 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-69faf320-f767-4a2f-9138-35638cc1ae39 tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:10.211325 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-69faf320-f767-4a2f-9138-35638cc1ae39 tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:10.212012 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-69faf320-f767-4a2f-9138-35638cc1ae39 tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:10.213354 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-69faf320-f767-4a2f-9138-35638cc1ae39 tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:10.213932 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-69faf320-f767-4a2f-9138-35638cc1ae39 tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:10.214590 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-69faf320-f767-4a2f-9138-35638cc1ae39 tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:10.232633 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-235e66b1-0b68-42cc-89c3-cc6cfe3edecd tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c997bc60473b43fd9fcf0c65111c44c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a711601b7a439caf395233de1febff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:10.250158 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-235e66b1-0b68-42cc-89c3-cc6cfe3edecd tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "GET /compute/v2.1/servers/3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff" status: 200 len: 1273 microversion: 2.1 time: 0.301957 Oct 04 19:02:10.250776 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2968/5579] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:09 2022] GET /compute/v2.1/servers/3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff => generated 1273 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:02:10.477408 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-69faf320-f767-4a2f-9138-35638cc1ae39 tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42c4b6cf4143aaa88eea5a932dd387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0c1daab0894e32af9427fc51dea8d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:10.489604 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-69faf320-f767-4a2f-9138-35638cc1ae39 tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] 10.222.0.43 "GET /compute/v2.1/servers/dec86071-1ea0-4d1d-a36d-256b898add8e" status: 200 len: 1527 microversion: 2.1 time: 0.301650 Oct 04 19:02:10.498581 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2612/5580] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:10 2022] GET /compute/v2.1/servers/dec86071-1ea0-4d1d-a36d-256b898add8e => generated 1527 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:02:10.525629 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-016a89e5-c527-46c4-a42c-5b24f6c281b0 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:10.526259 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-016a89e5-c527-46c4-a42c-5b24f6c281b0 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] [instance: 03c66e0a-0383-46dc-b2af-0158ae3eacbf] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:10.542223 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-016a89e5-c527-46c4-a42c-5b24f6c281b0 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:10.543747 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-016a89e5-c527-46c4-a42c-5b24f6c281b0 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:10.544213 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-016a89e5-c527-46c4-a42c-5b24f6c281b0 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:10.544956 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-016a89e5-c527-46c4-a42c-5b24f6c281b0 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:10.545449 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-016a89e5-c527-46c4-a42c-5b24f6c281b0 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:10.547467 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-016a89e5-c527-46c4-a42c-5b24f6c281b0 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:10.589261 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-016a89e5-c527-46c4-a42c-5b24f6c281b0 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] HTTP exception thrown: Instance 03c66e0a-0383-46dc-b2af-0158ae3eacbf could not be found. Oct 04 19:02:10.594209 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-016a89e5-c527-46c4-a42c-5b24f6c281b0 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Request method failure captured: Oct 04 19:02:10.594209 n-d-851028-13 devstack@n-api.service[123596]: request: GET /compute/v2.1/servers/03c66e0a-0383-46dc-b2af-0158ae3eacbf HTTP/1.1 Oct 04 19:02:10.594209 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 19:02:10.594209 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 19:02:10.594209 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 19:02:10.594209 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 19:02:10.594209 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 19:02:10.594209 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 19:02:10.594209 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 19:02:10.594209 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 19:02:10.594209 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPIIujzmbgnhbc79xmoqoHExspbgyH12GGkwkRMlz6Wk1fwNFn1e6GlOs3pSFHAbQBe7hSB4EwCSM1NbNoxM7YtIIvHYBABrrnKeiKHqo9RoOUqrLXsLMa-nwtPKL2I2nbSSkYfxI442WQXq8gqCf1KQPC_Nn5MfwtOvZw4RzsYhjvuo Oct 04 19:02:10.594209 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 19:02:10.594209 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 19:02:10.594209 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 19:02:10.594209 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 19:02:10.594209 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 19:02:10.594209 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 19:02:10.594209 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: 27a4c327763b4440a9dc456cfbb31f88 Oct 04 19:02:10.594209 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-TestNetworkBasicOps-1970804167 Oct 04 19:02:10.594209 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 19:02:10.594209 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 19:02:10.594209 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/27a4c327763b4440a9dc456cfbb31f88"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_27a4c327763b4440a9dc456cfbb31f88"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/27a4c327763b4440a9dc456cfbb31f88"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/27a4c327763b4440a9dc456cfbb31f88"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 19:02:10.594209 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-TestNetworkBasicOps-1970804167 Oct 04 19:02:10.594209 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: 27a4c327763b4440a9dc456cfbb31f88 Oct 04 19:02:10.594209 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-TestNetworkBasicOps-1970804167 Oct 04 19:02:10.594209 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-TestNetworkBasicOps-1970804167-project Oct 04 19:02:10.594209 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 19:02:10.594209 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 19:02:10.594209 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: fc1bb492fb294837b1e55d58bbfa3d0b Oct 04 19:02:10.594209 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-TestNetworkBasicOps-1970804167-project Oct 04 19:02:10.594209 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 19:02:10.594209 n-d-851028-13 devstack@n-api.service[123596]: exception: Instance 03c66e0a-0383-46dc-b2af-0158ae3eacbf could not be found. Oct 04 19:02:10.594209 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': '03c66e0a-0383-46dc-b2af-0158ae3eacbf'} Oct 04 19:02:10.594209 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:02:10.594209 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:02:10.594209 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:02:10.594209 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:02:10.594209 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:02:10.594209 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:02:10.594209 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:02:10.594209 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:02:10.594209 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:02:10.594209 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:02:10.594209 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03c66e0a-0383-46dc-b2af-0158ae3eacbf could not be found. Oct 04 19:02:10.594209 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:02:10.594209 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:02:10.594209 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:02:10.594209 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:02:10.594209 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:02:10.594209 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:02:10.594209 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:02:10.594209 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:02:10.594209 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:02:10.594209 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:02:10.594209 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:02:10.594209 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:02:10.594209 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:02:10.594209 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:02:10.594209 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:02:10.594209 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:02:10.594209 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03c66e0a-0383-46dc-b2af-0158ae3eacbf could not be found. Oct 04 19:02:10.594209 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:02:10.594209 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:02:10.594209 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:02:10.598968 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:02:10.598968 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:02:10.598968 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:02:10.598968 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:02:10.598968 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:02:10.598968 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03c66e0a-0383-46dc-b2af-0158ae3eacbf could not be found. Oct 04 19:02:10.598968 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:02:10.606096 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-016a89e5-c527-46c4-a42c-5b24f6c281b0 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Returning 404 to user: Instance 03c66e0a-0383-46dc-b2af-0158ae3eacbf could not be found. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:02:10.609713 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-016a89e5-c527-46c4-a42c-5b24f6c281b0 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] 10.222.0.43 "GET /compute/v2.1/servers/03c66e0a-0383-46dc-b2af-0158ae3eacbf" status: 404 len: 111 microversion: 2.1 time: 0.088063 Oct 04 19:02:10.613065 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2969/5581] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:10 2022] GET /compute/v2.1/servers/03c66e0a-0383-46dc-b2af-0158ae3eacbf => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:02:10.937760 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-29bb4c9f-96d8-4354-8056-97bb41787d22 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] Calling method '.version_select at 0x7fb21ecbca60>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:11.012337 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-29bb4c9f-96d8-4354-8056-97bb41787d22 tempest-TestNetworkBasicOps-1970804167 tempest-TestNetworkBasicOps-1970804167-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-426162738" status: 202 len: 0 microversion: 2.1 time: 0.079972 Oct 04 19:02:11.012972 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2613/5582] 10.222.0.43 () {58 vars in 1254 bytes} [Tue Oct 4 19:02:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-426162738 => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:02:11.279415 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-d3f32bd9-0500-44b5-b1cd-e5770866ef0d tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:11.280068 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-d3f32bd9-0500-44b5-b1cd-e5770866ef0d tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: 3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:11.296900 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d3f32bd9-0500-44b5-b1cd-e5770866ef0d tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:11.297427 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d3f32bd9-0500-44b5-b1cd-e5770866ef0d tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:11.297876 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d3f32bd9-0500-44b5-b1cd-e5770866ef0d tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:11.298596 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d3f32bd9-0500-44b5-b1cd-e5770866ef0d tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:11.299055 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d3f32bd9-0500-44b5-b1cd-e5770866ef0d tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:11.299483 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d3f32bd9-0500-44b5-b1cd-e5770866ef0d tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:11.522082 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-0d7e7e20-2540-4633-855e-73b3f854cac5 tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:11.523387 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-0d7e7e20-2540-4633-855e-73b3f854cac5 tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] [instance: dec86071-1ea0-4d1d-a36d-256b898add8e] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:11.532277 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0d7e7e20-2540-4633-855e-73b3f854cac5 tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:11.533195 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0d7e7e20-2540-4633-855e-73b3f854cac5 tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:11.534041 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0d7e7e20-2540-4633-855e-73b3f854cac5 tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:11.535981 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0d7e7e20-2540-4633-855e-73b3f854cac5 tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:11.536679 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0d7e7e20-2540-4633-855e-73b3f854cac5 tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:11.538039 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0d7e7e20-2540-4633-855e-73b3f854cac5 tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:11.701809 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-d3f32bd9-0500-44b5-b1cd-e5770866ef0d tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c997bc60473b43fd9fcf0c65111c44c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a711601b7a439caf395233de1febff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:11.719671 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-d3f32bd9-0500-44b5-b1cd-e5770866ef0d tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "GET /compute/v2.1/servers/3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff" status: 200 len: 1315 microversion: 2.1 time: 0.449246 Oct 04 19:02:11.735606 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2970/5583] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:11 2022] GET /compute/v2.1/servers/3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff => generated 1315 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:02:12.094939 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-0d7e7e20-2540-4633-855e-73b3f854cac5 tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42c4b6cf4143aaa88eea5a932dd387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0c1daab0894e32af9427fc51dea8d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:12.109567 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-0d7e7e20-2540-4633-855e-73b3f854cac5 tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] 10.222.0.43 "GET /compute/v2.1/servers/dec86071-1ea0-4d1d-a36d-256b898add8e" status: 200 len: 1527 microversion: 2.1 time: 0.595529 Oct 04 19:02:12.111508 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2614/5584] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:11 2022] GET /compute/v2.1/servers/dec86071-1ea0-4d1d-a36d-256b898add8e => generated 1527 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:02:12.436406 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-645ee0f5-131a-49dd-9f1c-29c75c56122c req-08ba04f8-bff2-432a-a82a-9707d3ae1f26 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff", "tag": "49a9f601-fe9e-4242-8553-215eee8014f3"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:02:12.462516 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-645ee0f5-131a-49dd-9f1c-29c75c56122c req-08ba04f8-bff2-432a-a82a-9707d3ae1f26 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:12.463244 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-645ee0f5-131a-49dd-9f1c-29c75c56122c req-08ba04f8-bff2-432a-a82a-9707d3ae1f26 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:12.463847 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-645ee0f5-131a-49dd-9f1c-29c75c56122c req-08ba04f8-bff2-432a-a82a-9707d3ae1f26 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:12.491971 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-645ee0f5-131a-49dd-9f1c-29c75c56122c req-08ba04f8-bff2-432a-a82a-9707d3ae1f26 service nova] Creating event network-changed:49a9f601-fe9e-4242-8553-215eee8014f3 for instance 3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff on n-h2-851028-13 Oct 04 19:02:12.519130 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-645ee0f5-131a-49dd-9f1c-29c75c56122c req-08ba04f8-bff2-432a-a82a-9707d3ae1f26 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086361 Oct 04 19:02:12.520140 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2971/5585] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:02:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:02:12.745879 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-21a43a5a-cb53-4e64-bf5b-4bfe0a29ef9f tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:12.746681 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-21a43a5a-cb53-4e64-bf5b-4bfe0a29ef9f tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: 3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:12.759459 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-21a43a5a-cb53-4e64-bf5b-4bfe0a29ef9f tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:12.759976 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-21a43a5a-cb53-4e64-bf5b-4bfe0a29ef9f tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:12.762880 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-21a43a5a-cb53-4e64-bf5b-4bfe0a29ef9f tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:12.763944 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-21a43a5a-cb53-4e64-bf5b-4bfe0a29ef9f tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:12.764441 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-21a43a5a-cb53-4e64-bf5b-4bfe0a29ef9f tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:12.764893 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-21a43a5a-cb53-4e64-bf5b-4bfe0a29ef9f tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:12.903233 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-aeb5f540-c104-4415-9985-7a9ac1f29bbf req-49ee2d05-6218-4ea8-8e37-94fb26df53c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dec86071-1ea0-4d1d-a36d-256b898add8e", "name": "network-vif-deleted", "tag": "8278f8f9-983d-4cfa-a8ac-1087118dfdda"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:02:12.949784 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-aeb5f540-c104-4415-9985-7a9ac1f29bbf req-49ee2d05-6218-4ea8-8e37-94fb26df53c9 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:12.950898 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-aeb5f540-c104-4415-9985-7a9ac1f29bbf req-49ee2d05-6218-4ea8-8e37-94fb26df53c9 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:12.951794 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-aeb5f540-c104-4415-9985-7a9ac1f29bbf req-49ee2d05-6218-4ea8-8e37-94fb26df53c9 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:13.008465 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-aeb5f540-c104-4415-9985-7a9ac1f29bbf req-49ee2d05-6218-4ea8-8e37-94fb26df53c9 service nova] Creating event network-vif-deleted:8278f8f9-983d-4cfa-a8ac-1087118dfdda for instance dec86071-1ea0-4d1d-a36d-256b898add8e on n-h1-851028-13 Oct 04 19:02:13.017216 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-aeb5f540-c104-4415-9985-7a9ac1f29bbf req-49ee2d05-6218-4ea8-8e37-94fb26df53c9 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119670 Oct 04 19:02:13.019786 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2972/5586] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:02:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:02:13.139405 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-df5909e8-8862-449c-bad5-94da43e26269 tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:13.141560 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-df5909e8-8862-449c-bad5-94da43e26269 tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] [instance: dec86071-1ea0-4d1d-a36d-256b898add8e] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:13.151628 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-df5909e8-8862-449c-bad5-94da43e26269 tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:13.155907 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-df5909e8-8862-449c-bad5-94da43e26269 tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:13.156998 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-df5909e8-8862-449c-bad5-94da43e26269 tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:13.162649 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-df5909e8-8862-449c-bad5-94da43e26269 tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:13.163571 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-df5909e8-8862-449c-bad5-94da43e26269 tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:13.169049 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-df5909e8-8862-449c-bad5-94da43e26269 tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:13.175582 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-21a43a5a-cb53-4e64-bf5b-4bfe0a29ef9f tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c997bc60473b43fd9fcf0c65111c44c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a711601b7a439caf395233de1febff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:13.189649 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-21a43a5a-cb53-4e64-bf5b-4bfe0a29ef9f tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "GET /compute/v2.1/servers/3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff" status: 200 len: 1315 microversion: 2.1 time: 0.448902 Oct 04 19:02:13.192417 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2615/5587] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:12 2022] GET /compute/v2.1/servers/3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff => generated 1315 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:02:13.256356 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-df5909e8-8862-449c-bad5-94da43e26269 tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:13.257847 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-df5909e8-8862-449c-bad5-94da43e26269 tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:13.258361 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-df5909e8-8862-449c-bad5-94da43e26269 tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:13.261655 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.objects.instance [None req-df5909e8-8862-449c-bad5-94da43e26269 tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] Lazy-loading 'fault' on Instance uuid dec86071-1ea0-4d1d-a36d-256b898add8e {{(pid=123596) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 19:02:13.456246 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-df5909e8-8862-449c-bad5-94da43e26269 tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42c4b6cf4143aaa88eea5a932dd387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0c1daab0894e32af9427fc51dea8d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:13.470142 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-df5909e8-8862-449c-bad5-94da43e26269 tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] 10.222.0.43 "GET /compute/v2.1/servers/dec86071-1ea0-4d1d-a36d-256b898add8e" status: 200 len: 1315 microversion: 2.1 time: 0.339977 Oct 04 19:02:13.471100 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2973/5588] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:13 2022] GET /compute/v2.1/servers/dec86071-1ea0-4d1d-a36d-256b898add8e => generated 1315 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:02:14.221042 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-5920a871-a46e-46c7-a4d3-750f081b3d0a tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:14.222025 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-5920a871-a46e-46c7-a4d3-750f081b3d0a tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: 3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:14.240516 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5920a871-a46e-46c7-a4d3-750f081b3d0a tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:14.241092 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5920a871-a46e-46c7-a4d3-750f081b3d0a tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:14.241961 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5920a871-a46e-46c7-a4d3-750f081b3d0a tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:14.243617 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5920a871-a46e-46c7-a4d3-750f081b3d0a tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:14.245299 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5920a871-a46e-46c7-a4d3-750f081b3d0a tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:14.245994 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5920a871-a46e-46c7-a4d3-750f081b3d0a tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:14.498191 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-aff84c24-1bff-49d3-918f-a1969130da25 tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:14.500164 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-aff84c24-1bff-49d3-918f-a1969130da25 tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] [instance: dec86071-1ea0-4d1d-a36d-256b898add8e] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:14.513985 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-aff84c24-1bff-49d3-918f-a1969130da25 tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:14.514710 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-aff84c24-1bff-49d3-918f-a1969130da25 tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:14.515330 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-aff84c24-1bff-49d3-918f-a1969130da25 tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:14.516054 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-aff84c24-1bff-49d3-918f-a1969130da25 tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:14.516526 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-aff84c24-1bff-49d3-918f-a1969130da25 tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:14.517092 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-aff84c24-1bff-49d3-918f-a1969130da25 tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:14.535682 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-aff84c24-1bff-49d3-918f-a1969130da25 tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] HTTP exception thrown: Instance dec86071-1ea0-4d1d-a36d-256b898add8e could not be found. Oct 04 19:02:14.538245 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-aff84c24-1bff-49d3-918f-a1969130da25 tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] Request method failure captured: Oct 04 19:02:14.538245 n-d-851028-13 devstack@n-api.service[123596]: request: GET /compute/v2.1/servers/dec86071-1ea0-4d1d-a36d-256b898add8e HTTP/1.1 Oct 04 19:02:14.538245 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 19:02:14.538245 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 19:02:14.538245 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 19:02:14.538245 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 19:02:14.538245 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 19:02:14.538245 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 19:02:14.538245 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 19:02:14.538245 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 19:02:14.538245 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPIMgHVvWGki8SA21zqW_qMKOnIp9N2XrHL2u6sv5PFrk0W1g4m9YwnmiE-KBXal3geMegyqOlDdFhjmeJ-6_1Nj6qKKBor5G3DYApdcT9s-OMw2J-dNI82ukEDaVKtZrYweRFLfplRO4xmWdG8CUq9Yw6iPmt6Co-KrCXUfeuyrRKlM Oct 04 19:02:14.538245 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 19:02:14.538245 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 19:02:14.538245 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 19:02:14.538245 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 19:02:14.538245 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 19:02:14.538245 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 19:02:14.538245 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: 2e0c1daab0894e32af9427fc51dea8d5 Oct 04 19:02:14.538245 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-2049688835 Oct 04 19:02:14.538245 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 19:02:14.538245 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 19:02:14.538245 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/2e0c1daab0894e32af9427fc51dea8d5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_2e0c1daab0894e32af9427fc51dea8d5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/2e0c1daab0894e32af9427fc51dea8d5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/2e0c1daab0894e32af9427fc51dea8d5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 19:02:14.538245 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-2049688835 Oct 04 19:02:14.538245 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: 2e0c1daab0894e32af9427fc51dea8d5 Oct 04 19:02:14.538245 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-2049688835 Oct 04 19:02:14.538245 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-ServerAddressesNegativeTestJSON-2049688835-project Oct 04 19:02:14.538245 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 19:02:14.538245 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 19:02:14.538245 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 1e42c4b6cf4143aaa88eea5a932dd387 Oct 04 19:02:14.538245 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-2049688835-project Oct 04 19:02:14.538245 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 19:02:14.538245 n-d-851028-13 devstack@n-api.service[123596]: exception: Instance dec86071-1ea0-4d1d-a36d-256b898add8e could not be found. Oct 04 19:02:14.538245 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': 'dec86071-1ea0-4d1d-a36d-256b898add8e'} Oct 04 19:02:14.538245 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:02:14.538245 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:02:14.538245 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:02:14.538245 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:02:14.538245 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:02:14.538245 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:02:14.538245 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:02:14.538245 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:02:14.538245 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:02:14.538245 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:02:14.538245 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dec86071-1ea0-4d1d-a36d-256b898add8e could not be found. Oct 04 19:02:14.538245 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:02:14.538245 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:02:14.538245 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:02:14.538245 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:02:14.538245 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:02:14.538245 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:02:14.538245 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:02:14.538245 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:02:14.538245 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:02:14.538245 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:02:14.538245 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:02:14.538245 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:02:14.538245 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:02:14.538245 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:02:14.538245 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:02:14.538245 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:02:14.538245 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dec86071-1ea0-4d1d-a36d-256b898add8e could not be found. Oct 04 19:02:14.538245 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:02:14.538245 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:02:14.542283 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:02:14.542283 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:02:14.542283 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:02:14.542283 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:02:14.542283 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:02:14.542283 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:02:14.542283 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dec86071-1ea0-4d1d-a36d-256b898add8e could not be found. Oct 04 19:02:14.542283 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:02:14.545595 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-aff84c24-1bff-49d3-918f-a1969130da25 tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] Returning 404 to user: Instance dec86071-1ea0-4d1d-a36d-256b898add8e could not be found. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:02:14.546705 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-aff84c24-1bff-49d3-918f-a1969130da25 tempest-ServerAddressesNegativeTestJSON-2049688835 tempest-ServerAddressesNegativeTestJSON-2049688835-project] 10.222.0.43 "GET /compute/v2.1/servers/dec86071-1ea0-4d1d-a36d-256b898add8e" status: 404 len: 111 microversion: 2.1 time: 0.055001 Oct 04 19:02:14.548798 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2974/5589] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:14 2022] GET /compute/v2.1/servers/dec86071-1ea0-4d1d-a36d-256b898add8e => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 19:02:14.573177 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-5920a871-a46e-46c7-a4d3-750f081b3d0a tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c997bc60473b43fd9fcf0c65111c44c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a711601b7a439caf395233de1febff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:14.586563 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-5920a871-a46e-46c7-a4d3-750f081b3d0a tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "GET /compute/v2.1/servers/3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff" status: 200 len: 1315 microversion: 2.1 time: 0.368025 Oct 04 19:02:14.589429 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2616/5590] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:14 2022] GET /compute/v2.1/servers/3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff => generated 1315 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:02:15.020290 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-4bc52128-426c-484d-afd1-aa244f066c89 tempest-TestNetworkAdvancedServerOps-1915185768 tempest-TestNetworkAdvancedServerOps-1915185768-project-admin] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:15.021697 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-4bc52128-426c-484d-afd1-aa244f066c89 tempest-TestNetworkAdvancedServerOps-1915185768 tempest-TestNetworkAdvancedServerOps-1915185768-project-admin] [instance: 32f44032-85ec-43eb-b714-748a7f4f0b5b] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:15.048957 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4bc52128-426c-484d-afd1-aa244f066c89 tempest-TestNetworkAdvancedServerOps-1915185768 tempest-TestNetworkAdvancedServerOps-1915185768-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:15.048957 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4bc52128-426c-484d-afd1-aa244f066c89 tempest-TestNetworkAdvancedServerOps-1915185768 tempest-TestNetworkAdvancedServerOps-1915185768-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:15.048957 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4bc52128-426c-484d-afd1-aa244f066c89 tempest-TestNetworkAdvancedServerOps-1915185768 tempest-TestNetworkAdvancedServerOps-1915185768-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:15.048957 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4bc52128-426c-484d-afd1-aa244f066c89 tempest-TestNetworkAdvancedServerOps-1915185768 tempest-TestNetworkAdvancedServerOps-1915185768-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:15.062492 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4bc52128-426c-484d-afd1-aa244f066c89 tempest-TestNetworkAdvancedServerOps-1915185768 tempest-TestNetworkAdvancedServerOps-1915185768-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:15.066809 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4bc52128-426c-484d-afd1-aa244f066c89 tempest-TestNetworkAdvancedServerOps-1915185768 tempest-TestNetworkAdvancedServerOps-1915185768-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:15.612493 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-ca8d024f-adf8-4fb0-997b-25016d71f20d tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:15.614254 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-ca8d024f-adf8-4fb0-997b-25016d71f20d tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: 3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:15.637842 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ca8d024f-adf8-4fb0-997b-25016d71f20d tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:15.638635 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ca8d024f-adf8-4fb0-997b-25016d71f20d tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:15.639249 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ca8d024f-adf8-4fb0-997b-25016d71f20d tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:15.640121 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ca8d024f-adf8-4fb0-997b-25016d71f20d tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:15.640734 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ca8d024f-adf8-4fb0-997b-25016d71f20d tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:15.641948 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ca8d024f-adf8-4fb0-997b-25016d71f20d tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:16.197410 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-ca8d024f-adf8-4fb0-997b-25016d71f20d tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c997bc60473b43fd9fcf0c65111c44c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a711601b7a439caf395233de1febff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:16.226163 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-ca8d024f-adf8-4fb0-997b-25016d71f20d tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "GET /compute/v2.1/servers/3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff" status: 200 len: 1315 microversion: 2.1 time: 0.616792 Oct 04 19:02:16.230354 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2617/5591] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:15 2022] GET /compute/v2.1/servers/3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff => generated 1315 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:02:17.154485 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=2 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:02:17.194422 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=6 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:02:17.257498 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-8f4403d8-8b04-4c11-9b92-93696dfa90d6 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:17.258337 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-8f4403d8-8b04-4c11-9b92-93696dfa90d6 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: 3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:17.276135 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8f4403d8-8b04-4c11-9b92-93696dfa90d6 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:17.277481 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8f4403d8-8b04-4c11-9b92-93696dfa90d6 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:17.281274 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8f4403d8-8b04-4c11-9b92-93696dfa90d6 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:17.282706 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8f4403d8-8b04-4c11-9b92-93696dfa90d6 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:17.283575 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8f4403d8-8b04-4c11-9b92-93696dfa90d6 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:17.284677 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8f4403d8-8b04-4c11-9b92-93696dfa90d6 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:17.546966 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=2 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:02:17.770632 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-8f4403d8-8b04-4c11-9b92-93696dfa90d6 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c997bc60473b43fd9fcf0c65111c44c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a711601b7a439caf395233de1febff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:17.774134 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:02:17.785904 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-4bc52128-426c-484d-afd1-aa244f066c89 tempest-TestNetworkAdvancedServerOps-1915185768 tempest-TestNetworkAdvancedServerOps-1915185768-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/32f44032-85ec-43eb-b714-748a7f4f0b5b" status: 200 len: 1835 microversion: 2.1 time: 2.771245 Oct 04 19:02:17.786743 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2975/5592] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:15 2022] GET /compute/v2.1/servers/32f44032-85ec-43eb-b714-748a7f4f0b5b => generated 1835 bytes in 2773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:02:17.799153 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-8f4403d8-8b04-4c11-9b92-93696dfa90d6 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "GET /compute/v2.1/servers/3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff" status: 200 len: 1315 microversion: 2.1 time: 0.548223 Oct 04 19:02:17.800085 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2618/5593] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:17 2022] GET /compute/v2.1/servers/3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff => generated 1315 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:02:17.814883 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-d7810ce9-287a-4dbe-a37c-02270a8a476e tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:17.816502 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-d7810ce9-287a-4dbe-a37c-02270a8a476e tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] [instance: 32f44032-85ec-43eb-b714-748a7f4f0b5b] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:17.832570 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d7810ce9-287a-4dbe-a37c-02270a8a476e tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:17.834180 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d7810ce9-287a-4dbe-a37c-02270a8a476e tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:17.834652 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d7810ce9-287a-4dbe-a37c-02270a8a476e tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:17.837698 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d7810ce9-287a-4dbe-a37c-02270a8a476e tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:17.839740 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d7810ce9-287a-4dbe-a37c-02270a8a476e tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:17.840436 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d7810ce9-287a-4dbe-a37c-02270a8a476e tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:18.402010 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-d7810ce9-287a-4dbe-a37c-02270a8a476e tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf87794979e844349d6ec6c6650565f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c25f1d17e94c74868357744e692487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:18.425215 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-d7810ce9-287a-4dbe-a37c-02270a8a476e tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] 10.222.0.43 "GET /compute/v2.1/servers/32f44032-85ec-43eb-b714-748a7f4f0b5b" status: 200 len: 1682 microversion: 2.1 time: 0.613209 Oct 04 19:02:18.427738 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2976/5594] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:17 2022] GET /compute/v2.1/servers/32f44032-85ec-43eb-b714-748a7f4f0b5b => generated 1682 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:02:18.588315 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-d8973290-9b9e-48f4-a113-2f48b0ad5824 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:02:18.592595 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-d8973290-9b9e-48f4-a113-2f48b0ad5824 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] [instance: 32f44032-85ec-43eb-b714-748a7f4f0b5b] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:18.610107 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d8973290-9b9e-48f4-a113-2f48b0ad5824 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:18.610798 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d8973290-9b9e-48f4-a113-2f48b0ad5824 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:18.611257 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d8973290-9b9e-48f4-a113-2f48b0ad5824 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:18.612052 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d8973290-9b9e-48f4-a113-2f48b0ad5824 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:18.634850 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d8973290-9b9e-48f4-a113-2f48b0ad5824 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:18.638857 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d8973290-9b9e-48f4-a113-2f48b0ad5824 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:18.775579 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-d8973290-9b9e-48f4-a113-2f48b0ad5824 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] 10.222.0.43 "POST /compute/v2.1/servers/32f44032-85ec-43eb-b714-748a7f4f0b5b/action" status: 200 len: 32640 microversion: 2.1 time: 0.191365 Oct 04 19:02:18.783621 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2619/5595] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 19:02:18 2022] POST /compute/v2.1/servers/32f44032-85ec-43eb-b714-748a7f4f0b5b/action => generated 32640 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 19:02:18.828414 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-5502dbca-fc49-4b9f-8928-7b987982329b tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:18.829458 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-5502dbca-fc49-4b9f-8928-7b987982329b tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: 3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:18.840514 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5502dbca-fc49-4b9f-8928-7b987982329b tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:18.841469 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5502dbca-fc49-4b9f-8928-7b987982329b tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:18.842213 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5502dbca-fc49-4b9f-8928-7b987982329b tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:18.843263 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5502dbca-fc49-4b9f-8928-7b987982329b tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:18.843991 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5502dbca-fc49-4b9f-8928-7b987982329b tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:18.845419 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5502dbca-fc49-4b9f-8928-7b987982329b tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:18.923349 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-449223a4-07d5-4c45-bfcc-c048bbf30673 tempest-TestNetworkAdvancedServerOps-1915185768 tempest-TestNetworkAdvancedServerOps-1915185768-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:02:18.924617 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-449223a4-07d5-4c45-bfcc-c048bbf30673 tempest-TestNetworkAdvancedServerOps-1915185768 tempest-TestNetworkAdvancedServerOps-1915185768-project-admin] [instance: 32f44032-85ec-43eb-b714-748a7f4f0b5b] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:18.947262 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-449223a4-07d5-4c45-bfcc-c048bbf30673 tempest-TestNetworkAdvancedServerOps-1915185768 tempest-TestNetworkAdvancedServerOps-1915185768-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:18.948735 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-449223a4-07d5-4c45-bfcc-c048bbf30673 tempest-TestNetworkAdvancedServerOps-1915185768 tempest-TestNetworkAdvancedServerOps-1915185768-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:18.949661 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-449223a4-07d5-4c45-bfcc-c048bbf30673 tempest-TestNetworkAdvancedServerOps-1915185768 tempest-TestNetworkAdvancedServerOps-1915185768-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:18.953001 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-449223a4-07d5-4c45-bfcc-c048bbf30673 tempest-TestNetworkAdvancedServerOps-1915185768 tempest-TestNetworkAdvancedServerOps-1915185768-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:18.953580 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-449223a4-07d5-4c45-bfcc-c048bbf30673 tempest-TestNetworkAdvancedServerOps-1915185768 tempest-TestNetworkAdvancedServerOps-1915185768-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:18.955067 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-449223a4-07d5-4c45-bfcc-c048bbf30673 tempest-TestNetworkAdvancedServerOps-1915185768 tempest-TestNetworkAdvancedServerOps-1915185768-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:19.048737 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-449223a4-07d5-4c45-bfcc-c048bbf30673 tempest-TestNetworkAdvancedServerOps-1915185768 tempest-TestNetworkAdvancedServerOps-1915185768-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '3abc94c41cf04fbaaa4af77d9b478186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943cb5a77b8f49f581fae7a1f32f8130', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:19.049863 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-449223a4-07d5-4c45-bfcc-c048bbf30673 tempest-TestNetworkAdvancedServerOps-1915185768 tempest-TestNetworkAdvancedServerOps-1915185768-project-admin] [instance: 32f44032-85ec-43eb-b714-748a7f4f0b5b] flavor_id is None. Assuming migration. {{(pid=123595) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 04 19:02:19.050498 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-449223a4-07d5-4c45-bfcc-c048bbf30673 tempest-TestNetworkAdvancedServerOps-1915185768 tempest-TestNetworkAdvancedServerOps-1915185768-project-admin] [instance: 32f44032-85ec-43eb-b714-748a7f4f0b5b] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=123595) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 04 19:02:19.434275 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-5502dbca-fc49-4b9f-8928-7b987982329b tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c997bc60473b43fd9fcf0c65111c44c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a711601b7a439caf395233de1febff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:19.467254 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-5502dbca-fc49-4b9f-8928-7b987982329b tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "GET /compute/v2.1/servers/3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff" status: 200 len: 1315 microversion: 2.1 time: 0.643038 Oct 04 19:02:19.481161 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2977/5596] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:18 2022] GET /compute/v2.1/servers/3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff => generated 1315 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:02:19.746121 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-449223a4-07d5-4c45-bfcc-c048bbf30673 tempest-TestNetworkAdvancedServerOps-1915185768 tempest-TestNetworkAdvancedServerOps-1915185768-project-admin] 10.222.0.43 "POST /compute/v2.1/servers/32f44032-85ec-43eb-b714-748a7f4f0b5b/action" status: 202 len: 0 microversion: 2.1 time: 0.827830 Oct 04 19:02:19.748033 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2620/5597] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 19:02:18 2022] POST /compute/v2.1/servers/32f44032-85ec-43eb-b714-748a7f4f0b5b/action => generated 0 bytes in 831 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:02:19.760819 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-df1607e3-1557-4a27-b6ce-5b93cc380466 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:19.762019 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-df1607e3-1557-4a27-b6ce-5b93cc380466 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] [instance: 32f44032-85ec-43eb-b714-748a7f4f0b5b] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:19.786353 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-df1607e3-1557-4a27-b6ce-5b93cc380466 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:19.787211 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-df1607e3-1557-4a27-b6ce-5b93cc380466 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:19.787675 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-df1607e3-1557-4a27-b6ce-5b93cc380466 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:19.788481 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-df1607e3-1557-4a27-b6ce-5b93cc380466 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:19.790952 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-df1607e3-1557-4a27-b6ce-5b93cc380466 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:19.791715 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-df1607e3-1557-4a27-b6ce-5b93cc380466 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:20.501976 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-54130fb3-05f8-4158-a992-8be6ed4f3c6e tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:20.503585 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-54130fb3-05f8-4158-a992-8be6ed4f3c6e tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: 3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:20.526409 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-54130fb3-05f8-4158-a992-8be6ed4f3c6e tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:20.528411 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-54130fb3-05f8-4158-a992-8be6ed4f3c6e tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:20.538110 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-54130fb3-05f8-4158-a992-8be6ed4f3c6e tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:20.539046 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-54130fb3-05f8-4158-a992-8be6ed4f3c6e tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:20.539632 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-54130fb3-05f8-4158-a992-8be6ed4f3c6e tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:20.540077 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-54130fb3-05f8-4158-a992-8be6ed4f3c6e tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:20.682251 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-df1607e3-1557-4a27-b6ce-5b93cc380466 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf87794979e844349d6ec6c6650565f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c25f1d17e94c74868357744e692487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:20.713369 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-df1607e3-1557-4a27-b6ce-5b93cc380466 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] 10.222.0.43 "GET /compute/v2.1/servers/32f44032-85ec-43eb-b714-748a7f4f0b5b" status: 200 len: 1691 microversion: 2.1 time: 0.948412 Oct 04 19:02:20.716287 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2978/5598] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:19 2022] GET /compute/v2.1/servers/32f44032-85ec-43eb-b714-748a7f4f0b5b => generated 1691 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:02:20.746200 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-b5886ff8-7941-473a-9ea9-75b173b4f63d tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:20.747023 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-b5886ff8-7941-473a-9ea9-75b173b4f63d tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] [instance: 21c5a32f-69a7-4836-8c9f-399b415c2c21] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:20.755191 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b5886ff8-7941-473a-9ea9-75b173b4f63d tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:20.756572 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b5886ff8-7941-473a-9ea9-75b173b4f63d tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:20.758071 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b5886ff8-7941-473a-9ea9-75b173b4f63d tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:20.759082 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b5886ff8-7941-473a-9ea9-75b173b4f63d tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:20.759793 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b5886ff8-7941-473a-9ea9-75b173b4f63d tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:20.760480 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b5886ff8-7941-473a-9ea9-75b173b4f63d tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:20.922954 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.objects.instance [None req-b5886ff8-7941-473a-9ea9-75b173b4f63d tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] Lazy-loading 'services' on Instance uuid 21c5a32f-69a7-4836-8c9f-399b415c2c21 {{(pid=123596) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 19:02:21.032504 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-54130fb3-05f8-4158-a992-8be6ed4f3c6e tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c997bc60473b43fd9fcf0c65111c44c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a711601b7a439caf395233de1febff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:21.043393 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-54130fb3-05f8-4158-a992-8be6ed4f3c6e tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "GET /compute/v2.1/servers/3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff" status: 200 len: 1315 microversion: 2.1 time: 0.551848 Oct 04 19:02:21.047935 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2621/5599] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:20 2022] GET /compute/v2.1/servers/3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff => generated 1315 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:02:21.064862 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-61535c6c-ad0d-4ea5-ac36-4ae6ebd3339e req-9b31318e-6ffb-4049-bbfc-96017468cd68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff", "name": "network-vif-plugged", "status": "completed", "tag": "49a9f601-fe9e-4242-8553-215eee8014f3"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:02:21.086480 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-61535c6c-ad0d-4ea5-ac36-4ae6ebd3339e req-9b31318e-6ffb-4049-bbfc-96017468cd68 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:21.088023 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-61535c6c-ad0d-4ea5-ac36-4ae6ebd3339e req-9b31318e-6ffb-4049-bbfc-96017468cd68 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:21.096467 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-61535c6c-ad0d-4ea5-ac36-4ae6ebd3339e req-9b31318e-6ffb-4049-bbfc-96017468cd68 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:21.107660 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-b5886ff8-7941-473a-9ea9-75b173b4f63d tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] 10.222.0.43 "DELETE /compute/v2.1/servers/21c5a32f-69a7-4836-8c9f-399b415c2c21/os-volume_attachments/eccc69d1-a3a1-4ee2-8218-370d73ba61f6" status: 202 len: 0 microversion: 2.1 time: 0.376793 Oct 04 19:02:21.108639 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2979/5600] 10.222.0.43 () {58 vars in 1416 bytes} [Tue Oct 4 19:02:20 2022] DELETE /compute/v2.1/servers/21c5a32f-69a7-4836-8c9f-399b415c2c21/os-volume_attachments/eccc69d1-a3a1-4ee2-8218-370d73ba61f6 => generated 0 bytes in 390 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:02:21.145240 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-61535c6c-ad0d-4ea5-ac36-4ae6ebd3339e req-9b31318e-6ffb-4049-bbfc-96017468cd68 service nova] Creating event network-vif-plugged:49a9f601-fe9e-4242-8553-215eee8014f3 for instance 3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff on n-h2-851028-13 Oct 04 19:02:21.179499 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-61535c6c-ad0d-4ea5-ac36-4ae6ebd3339e req-9b31318e-6ffb-4049-bbfc-96017468cd68 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129268 Oct 04 19:02:21.184961 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2622/5601] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:02:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:02:21.745558 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-a7124a13-8e7d-4484-8600-634edf990f90 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:21.746856 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-a7124a13-8e7d-4484-8600-634edf990f90 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] [instance: 32f44032-85ec-43eb-b714-748a7f4f0b5b] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:21.768317 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a7124a13-8e7d-4484-8600-634edf990f90 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:21.768840 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a7124a13-8e7d-4484-8600-634edf990f90 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:21.769354 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a7124a13-8e7d-4484-8600-634edf990f90 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:21.770114 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a7124a13-8e7d-4484-8600-634edf990f90 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:21.770549 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a7124a13-8e7d-4484-8600-634edf990f90 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:21.771182 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a7124a13-8e7d-4484-8600-634edf990f90 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:22.069695 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-8b71b386-e3a7-485b-8950-cefeaaea409b tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:22.070579 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-8b71b386-e3a7-485b-8950-cefeaaea409b tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: 3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:22.090774 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8b71b386-e3a7-485b-8950-cefeaaea409b tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:22.093744 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8b71b386-e3a7-485b-8950-cefeaaea409b tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:22.095636 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8b71b386-e3a7-485b-8950-cefeaaea409b tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:22.099209 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8b71b386-e3a7-485b-8950-cefeaaea409b tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:22.101939 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8b71b386-e3a7-485b-8950-cefeaaea409b tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:22.102521 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8b71b386-e3a7-485b-8950-cefeaaea409b tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:22.335718 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-a7124a13-8e7d-4484-8600-634edf990f90 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf87794979e844349d6ec6c6650565f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c25f1d17e94c74868357744e692487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:22.350959 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-a7124a13-8e7d-4484-8600-634edf990f90 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] 10.222.0.43 "GET /compute/v2.1/servers/32f44032-85ec-43eb-b714-748a7f4f0b5b" status: 200 len: 1691 microversion: 2.1 time: 0.605653 Oct 04 19:02:22.351808 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2980/5602] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:21 2022] GET /compute/v2.1/servers/32f44032-85ec-43eb-b714-748a7f4f0b5b => generated 1691 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:02:22.946830 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-8b71b386-e3a7-485b-8950-cefeaaea409b tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c997bc60473b43fd9fcf0c65111c44c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a711601b7a439caf395233de1febff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:22.955447 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-8b71b386-e3a7-485b-8950-cefeaaea409b tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "GET /compute/v2.1/servers/3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff" status: 200 len: 1315 microversion: 2.1 time: 0.890971 Oct 04 19:02:22.977369 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2623/5603] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:22 2022] GET /compute/v2.1/servers/3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff => generated 1315 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:02:23.379208 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-479c7fab-2b57-4a2b-89a9-e9068b279b50 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:23.380231 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-479c7fab-2b57-4a2b-89a9-e9068b279b50 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] [instance: 32f44032-85ec-43eb-b714-748a7f4f0b5b] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:23.412375 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-479c7fab-2b57-4a2b-89a9-e9068b279b50 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:23.412920 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-479c7fab-2b57-4a2b-89a9-e9068b279b50 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:23.413402 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-479c7fab-2b57-4a2b-89a9-e9068b279b50 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:23.414133 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-479c7fab-2b57-4a2b-89a9-e9068b279b50 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:23.414593 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-479c7fab-2b57-4a2b-89a9-e9068b279b50 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:23.415031 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-479c7fab-2b57-4a2b-89a9-e9068b279b50 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:23.808481 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-479c7fab-2b57-4a2b-89a9-e9068b279b50 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf87794979e844349d6ec6c6650565f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c25f1d17e94c74868357744e692487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:23.862926 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-479c7fab-2b57-4a2b-89a9-e9068b279b50 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] 10.222.0.43 "GET /compute/v2.1/servers/32f44032-85ec-43eb-b714-748a7f4f0b5b" status: 200 len: 1691 microversion: 2.1 time: 0.483670 Oct 04 19:02:23.868529 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2981/5604] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:23 2022] GET /compute/v2.1/servers/32f44032-85ec-43eb-b714-748a7f4f0b5b => generated 1691 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:02:23.989192 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-30c2d35f-246a-489d-9a7e-777d96b1d74d tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:23.989826 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-30c2d35f-246a-489d-9a7e-777d96b1d74d tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: 3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:24.019151 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-30c2d35f-246a-489d-9a7e-777d96b1d74d tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:24.024767 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-30c2d35f-246a-489d-9a7e-777d96b1d74d tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:24.025788 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-30c2d35f-246a-489d-9a7e-777d96b1d74d tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:24.028143 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-30c2d35f-246a-489d-9a7e-777d96b1d74d tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:24.028787 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-30c2d35f-246a-489d-9a7e-777d96b1d74d tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:24.034490 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-30c2d35f-246a-489d-9a7e-777d96b1d74d tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:24.780094 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-30c2d35f-246a-489d-9a7e-777d96b1d74d tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c997bc60473b43fd9fcf0c65111c44c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a711601b7a439caf395233de1febff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:24.794557 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-30c2d35f-246a-489d-9a7e-777d96b1d74d tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "GET /compute/v2.1/servers/3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff" status: 200 len: 1501 microversion: 2.1 time: 0.809710 Oct 04 19:02:24.795284 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2624/5605] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:23 2022] GET /compute/v2.1/servers/3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff => generated 1501 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:02:24.841153 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-5e715974-17ca-455e-9fde-f0ba933065b1 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:02:24.844159 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-5e715974-17ca-455e-9fde-f0ba933065b1 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: 3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:24.857496 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5e715974-17ca-455e-9fde-f0ba933065b1 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:24.858781 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5e715974-17ca-455e-9fde-f0ba933065b1 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:24.860102 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5e715974-17ca-455e-9fde-f0ba933065b1 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:24.861647 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5e715974-17ca-455e-9fde-f0ba933065b1 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:24.862729 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5e715974-17ca-455e-9fde-f0ba933065b1 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:24.864147 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5e715974-17ca-455e-9fde-f0ba933065b1 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:24.914885 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-75d56edd-6df7-4112-afb1-b707b15a67f4 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:24.918021 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-75d56edd-6df7-4112-afb1-b707b15a67f4 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] [instance: 32f44032-85ec-43eb-b714-748a7f4f0b5b] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:24.921327 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.objects.instance [None req-5e715974-17ca-455e-9fde-f0ba933065b1 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lazy-loading 'flavor' on Instance uuid 3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff {{(pid=123596) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 19:02:24.942448 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-75d56edd-6df7-4112-afb1-b707b15a67f4 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:24.951723 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-75d56edd-6df7-4112-afb1-b707b15a67f4 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:24.952801 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-75d56edd-6df7-4112-afb1-b707b15a67f4 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:24.954180 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-75d56edd-6df7-4112-afb1-b707b15a67f4 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:24.955302 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-75d56edd-6df7-4112-afb1-b707b15a67f4 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:24.956151 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-75d56edd-6df7-4112-afb1-b707b15a67f4 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:24.973595 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:02:25.521658 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-5e715974-17ca-455e-9fde-f0ba933065b1 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "POST /compute/v2.1/servers/3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff/action" status: 202 len: 0 microversion: 2.1 time: 0.688270 Oct 04 19:02:25.523635 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2982/5606] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 19:02:24 2022] POST /compute/v2.1/servers/3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff/action => generated 0 bytes in 692 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:02:25.539169 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-3f6408bd-ce94-425a-8180-9e498045252c tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:25.542349 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-3f6408bd-ce94-425a-8180-9e498045252c tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: 3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:25.550188 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-75d56edd-6df7-4112-afb1-b707b15a67f4 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf87794979e844349d6ec6c6650565f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c25f1d17e94c74868357744e692487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:25.555261 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3f6408bd-ce94-425a-8180-9e498045252c tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:25.556260 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3f6408bd-ce94-425a-8180-9e498045252c tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:25.556977 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3f6408bd-ce94-425a-8180-9e498045252c tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:25.562053 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3f6408bd-ce94-425a-8180-9e498045252c tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:25.562915 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3f6408bd-ce94-425a-8180-9e498045252c tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:25.564144 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3f6408bd-ce94-425a-8180-9e498045252c tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:25.572151 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-75d56edd-6df7-4112-afb1-b707b15a67f4 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] 10.222.0.43 "GET /compute/v2.1/servers/32f44032-85ec-43eb-b714-748a7f4f0b5b" status: 200 len: 1691 microversion: 2.1 time: 0.664919 Oct 04 19:02:25.572779 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2625/5607] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:24 2022] GET /compute/v2.1/servers/32f44032-85ec-43eb-b714-748a7f4f0b5b => generated 1691 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:02:26.402135 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-3f6408bd-ce94-425a-8180-9e498045252c tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c997bc60473b43fd9fcf0c65111c44c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a711601b7a439caf395233de1febff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:26.417393 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-3f6408bd-ce94-425a-8180-9e498045252c tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "GET /compute/v2.1/servers/3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff" status: 200 len: 1507 microversion: 2.1 time: 0.883730 Oct 04 19:02:26.419624 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2983/5608] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:25 2022] GET /compute/v2.1/servers/3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff => generated 1507 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:02:26.622106 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-8d8b079b-da51-407f-9b57-bcd11024c40a tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:26.623423 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-8d8b079b-da51-407f-9b57-bcd11024c40a tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] [instance: 32f44032-85ec-43eb-b714-748a7f4f0b5b] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:26.634045 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8d8b079b-da51-407f-9b57-bcd11024c40a tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:26.655312 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8d8b079b-da51-407f-9b57-bcd11024c40a tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:26.656042 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8d8b079b-da51-407f-9b57-bcd11024c40a tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:26.656970 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8d8b079b-da51-407f-9b57-bcd11024c40a tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:26.657636 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8d8b079b-da51-407f-9b57-bcd11024c40a tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:26.658257 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8d8b079b-da51-407f-9b57-bcd11024c40a tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:27.460893 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-a4ad1030-93fb-4135-a4ba-eafb0087a4cc tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:27.462671 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-a4ad1030-93fb-4135-a4ba-eafb0087a4cc tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: 3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:27.498586 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a4ad1030-93fb-4135-a4ba-eafb0087a4cc tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:27.501317 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a4ad1030-93fb-4135-a4ba-eafb0087a4cc tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:27.502478 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a4ad1030-93fb-4135-a4ba-eafb0087a4cc tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:27.504461 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a4ad1030-93fb-4135-a4ba-eafb0087a4cc tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:27.505518 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a4ad1030-93fb-4135-a4ba-eafb0087a4cc tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:27.508485 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a4ad1030-93fb-4135-a4ba-eafb0087a4cc tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:27.565016 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-8d8b079b-da51-407f-9b57-bcd11024c40a tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf87794979e844349d6ec6c6650565f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c25f1d17e94c74868357744e692487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:27.591939 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-8d8b079b-da51-407f-9b57-bcd11024c40a tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] 10.222.0.43 "GET /compute/v2.1/servers/32f44032-85ec-43eb-b714-748a7f4f0b5b" status: 200 len: 1696 microversion: 2.1 time: 0.973631 Oct 04 19:02:27.607792 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2626/5609] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:26 2022] GET /compute/v2.1/servers/32f44032-85ec-43eb-b714-748a7f4f0b5b => generated 1696 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:02:27.883209 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-a4ad1030-93fb-4135-a4ba-eafb0087a4cc tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c997bc60473b43fd9fcf0c65111c44c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a711601b7a439caf395233de1febff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:27.895238 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-a4ad1030-93fb-4135-a4ba-eafb0087a4cc tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "GET /compute/v2.1/servers/3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff" status: 200 len: 1507 microversion: 2.1 time: 0.440810 Oct 04 19:02:27.897556 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2984/5610] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:27 2022] GET /compute/v2.1/servers/3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff => generated 1507 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:02:28.624482 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-737a6aa9-725d-4d68-94df-4c68a79239ae tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:28.625866 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-737a6aa9-725d-4d68-94df-4c68a79239ae tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] [instance: 32f44032-85ec-43eb-b714-748a7f4f0b5b] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:28.635924 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-737a6aa9-725d-4d68-94df-4c68a79239ae tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:28.640428 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-737a6aa9-725d-4d68-94df-4c68a79239ae tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:28.641279 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-737a6aa9-725d-4d68-94df-4c68a79239ae tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:28.642752 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-737a6aa9-725d-4d68-94df-4c68a79239ae tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:28.648186 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-737a6aa9-725d-4d68-94df-4c68a79239ae tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:28.649276 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-737a6aa9-725d-4d68-94df-4c68a79239ae tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:28.922963 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-db56ac8c-2818-45ae-8e87-594e4094f3c4 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:28.923575 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-db56ac8c-2818-45ae-8e87-594e4094f3c4 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: 3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:28.937045 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:02:28.939928 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-db56ac8c-2818-45ae-8e87-594e4094f3c4 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:28.940773 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-db56ac8c-2818-45ae-8e87-594e4094f3c4 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:28.946104 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-737a6aa9-725d-4d68-94df-4c68a79239ae tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf87794979e844349d6ec6c6650565f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c25f1d17e94c74868357744e692487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:28.954429 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-db56ac8c-2818-45ae-8e87-594e4094f3c4 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:28.959408 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-db56ac8c-2818-45ae-8e87-594e4094f3c4 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:28.960491 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-737a6aa9-725d-4d68-94df-4c68a79239ae tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] 10.222.0.43 "GET /compute/v2.1/servers/32f44032-85ec-43eb-b714-748a7f4f0b5b" status: 200 len: 1696 microversion: 2.1 time: 0.340275 Oct 04 19:02:28.962366 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-db56ac8c-2818-45ae-8e87-594e4094f3c4 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:28.963032 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-db56ac8c-2818-45ae-8e87-594e4094f3c4 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:28.974416 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2627/5611] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:28 2022] GET /compute/v2.1/servers/32f44032-85ec-43eb-b714-748a7f4f0b5b => generated 1696 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:02:29.199176 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-db56ac8c-2818-45ae-8e87-594e4094f3c4 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c997bc60473b43fd9fcf0c65111c44c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a711601b7a439caf395233de1febff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:29.208650 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-db56ac8c-2818-45ae-8e87-594e4094f3c4 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "GET /compute/v2.1/servers/3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff" status: 200 len: 1507 microversion: 2.1 time: 0.290616 Oct 04 19:02:29.211648 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2985/5612] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:28 2022] GET /compute/v2.1/servers/3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff => generated 1507 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:02:29.987923 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-c0a4d6bb-30e7-404f-8dce-e85e01244188 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:29.989264 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-c0a4d6bb-30e7-404f-8dce-e85e01244188 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] [instance: 32f44032-85ec-43eb-b714-748a7f4f0b5b] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:30.002742 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c0a4d6bb-30e7-404f-8dce-e85e01244188 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:30.003536 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c0a4d6bb-30e7-404f-8dce-e85e01244188 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:30.004199 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c0a4d6bb-30e7-404f-8dce-e85e01244188 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:30.008241 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c0a4d6bb-30e7-404f-8dce-e85e01244188 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:30.010811 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c0a4d6bb-30e7-404f-8dce-e85e01244188 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:30.011568 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c0a4d6bb-30e7-404f-8dce-e85e01244188 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:30.232319 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-6d5c97a8-5f78-4858-ad46-2636e433ddad tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:30.233658 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-6d5c97a8-5f78-4858-ad46-2636e433ddad tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: 3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:30.249906 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6d5c97a8-5f78-4858-ad46-2636e433ddad tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:30.250754 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6d5c97a8-5f78-4858-ad46-2636e433ddad tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:30.251413 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6d5c97a8-5f78-4858-ad46-2636e433ddad tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:30.252422 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6d5c97a8-5f78-4858-ad46-2636e433ddad tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:30.253171 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6d5c97a8-5f78-4858-ad46-2636e433ddad tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:30.254071 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6d5c97a8-5f78-4858-ad46-2636e433ddad tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:30.479133 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-c0a4d6bb-30e7-404f-8dce-e85e01244188 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf87794979e844349d6ec6c6650565f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c25f1d17e94c74868357744e692487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:30.488971 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-c0a4d6bb-30e7-404f-8dce-e85e01244188 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] 10.222.0.43 "GET /compute/v2.1/servers/32f44032-85ec-43eb-b714-748a7f4f0b5b" status: 200 len: 1696 microversion: 2.1 time: 0.505097 Oct 04 19:02:30.489893 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2628/5613] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:29 2022] GET /compute/v2.1/servers/32f44032-85ec-43eb-b714-748a7f4f0b5b => generated 1696 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:02:30.593414 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-6d5c97a8-5f78-4858-ad46-2636e433ddad tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c997bc60473b43fd9fcf0c65111c44c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a711601b7a439caf395233de1febff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:30.617999 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-6d5c97a8-5f78-4858-ad46-2636e433ddad tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "GET /compute/v2.1/servers/3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff" status: 200 len: 1507 microversion: 2.1 time: 0.389217 Oct 04 19:02:30.619873 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2986/5614] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:30 2022] GET /compute/v2.1/servers/3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff => generated 1507 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:02:31.378948 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-6aef7fa5-1e00-4a8d-93f9-665771888e78 tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:31.383888 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-6aef7fa5-1e00-4a8d-93f9-665771888e78 tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] [instance: 21c5a32f-69a7-4836-8c9f-399b415c2c21] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:31.398306 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6aef7fa5-1e00-4a8d-93f9-665771888e78 tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:31.400868 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6aef7fa5-1e00-4a8d-93f9-665771888e78 tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:31.406797 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6aef7fa5-1e00-4a8d-93f9-665771888e78 tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:31.408409 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6aef7fa5-1e00-4a8d-93f9-665771888e78 tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:31.409004 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6aef7fa5-1e00-4a8d-93f9-665771888e78 tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:31.409554 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6aef7fa5-1e00-4a8d-93f9-665771888e78 tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:31.469774 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-6aef7fa5-1e00-4a8d-93f9-665771888e78 tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] [instance: 21c5a32f-69a7-4836-8c9f-399b415c2c21] Going to try to terminate instance {{(pid=123595) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 19:02:31.526834 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-35a90612-7269-44f2-990a-7a8158fb9740 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:31.527562 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-35a90612-7269-44f2-990a-7a8158fb9740 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] [instance: 32f44032-85ec-43eb-b714-748a7f4f0b5b] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:31.551426 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-35a90612-7269-44f2-990a-7a8158fb9740 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:31.552956 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-35a90612-7269-44f2-990a-7a8158fb9740 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:31.556772 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-35a90612-7269-44f2-990a-7a8158fb9740 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:31.557970 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-35a90612-7269-44f2-990a-7a8158fb9740 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:31.558882 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-35a90612-7269-44f2-990a-7a8158fb9740 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:31.561480 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-35a90612-7269-44f2-990a-7a8158fb9740 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:31.657951 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-6aef7fa5-1e00-4a8d-93f9-665771888e78 tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] 10.222.0.43 "DELETE /compute/v2.1/servers/21c5a32f-69a7-4836-8c9f-399b415c2c21" status: 204 len: 0 microversion: 2.1 time: 0.282975 Oct 04 19:02:31.660215 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2629/5615] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 19:02:31 2022] DELETE /compute/v2.1/servers/21c5a32f-69a7-4836-8c9f-399b415c2c21 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:02:31.670565 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-8638d34e-0dc6-49b8-924c-42e3ccb09a98 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:31.672172 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-8638d34e-0dc6-49b8-924c-42e3ccb09a98 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: 3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:31.681558 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8638d34e-0dc6-49b8-924c-42e3ccb09a98 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:31.682470 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8638d34e-0dc6-49b8-924c-42e3ccb09a98 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:31.683094 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8638d34e-0dc6-49b8-924c-42e3ccb09a98 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:31.684125 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8638d34e-0dc6-49b8-924c-42e3ccb09a98 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:31.684763 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8638d34e-0dc6-49b8-924c-42e3ccb09a98 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:31.685411 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8638d34e-0dc6-49b8-924c-42e3ccb09a98 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:31.898394 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-35a90612-7269-44f2-990a-7a8158fb9740 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf87794979e844349d6ec6c6650565f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c25f1d17e94c74868357744e692487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:31.908561 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-35a90612-7269-44f2-990a-7a8158fb9740 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] 10.222.0.43 "GET /compute/v2.1/servers/32f44032-85ec-43eb-b714-748a7f4f0b5b" status: 200 len: 1696 microversion: 2.1 time: 0.387407 Oct 04 19:02:31.910203 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2987/5616] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:31 2022] GET /compute/v2.1/servers/32f44032-85ec-43eb-b714-748a7f4f0b5b => generated 1696 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:02:31.915785 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f79816a5-3ad7-4a83-b31e-102ebe82664d tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:31.916635 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-f79816a5-3ad7-4a83-b31e-102ebe82664d tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] [instance: 21c5a32f-69a7-4836-8c9f-399b415c2c21] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:31.925166 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f79816a5-3ad7-4a83-b31e-102ebe82664d tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:31.925909 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f79816a5-3ad7-4a83-b31e-102ebe82664d tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:31.926574 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f79816a5-3ad7-4a83-b31e-102ebe82664d tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:31.927841 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f79816a5-3ad7-4a83-b31e-102ebe82664d tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:31.929396 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f79816a5-3ad7-4a83-b31e-102ebe82664d tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:31.930290 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f79816a5-3ad7-4a83-b31e-102ebe82664d tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:32.066540 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-8638d34e-0dc6-49b8-924c-42e3ccb09a98 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c997bc60473b43fd9fcf0c65111c44c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a711601b7a439caf395233de1febff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:32.079743 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-8638d34e-0dc6-49b8-924c-42e3ccb09a98 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "GET /compute/v2.1/servers/3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff" status: 200 len: 1507 microversion: 2.1 time: 0.417943 Oct 04 19:02:32.084127 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2630/5617] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:31 2022] GET /compute/v2.1/servers/3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff => generated 1507 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:02:32.197265 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-f79816a5-3ad7-4a83-b31e-102ebe82664d tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a63b38b57a347f282318730997e90ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0cfa6c678df4550bdf1b627efb0c46a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:32.218908 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-f79816a5-3ad7-4a83-b31e-102ebe82664d tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] 10.222.0.43 "GET /compute/v2.1/servers/21c5a32f-69a7-4836-8c9f-399b415c2c21" status: 200 len: 1468 microversion: 2.1 time: 0.307201 Oct 04 19:02:32.220223 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2988/5618] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:31 2022] GET /compute/v2.1/servers/21c5a32f-69a7-4836-8c9f-399b415c2c21 => generated 1468 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:02:32.942660 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-5ef9ad58-4342-4eb2-a5b1-3350f5dfcf32 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:32.943040 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-5ef9ad58-4342-4eb2-a5b1-3350f5dfcf32 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] [instance: 32f44032-85ec-43eb-b714-748a7f4f0b5b] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:32.960129 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5ef9ad58-4342-4eb2-a5b1-3350f5dfcf32 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:32.960958 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5ef9ad58-4342-4eb2-a5b1-3350f5dfcf32 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:32.961444 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5ef9ad58-4342-4eb2-a5b1-3350f5dfcf32 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:32.962176 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5ef9ad58-4342-4eb2-a5b1-3350f5dfcf32 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:32.962642 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5ef9ad58-4342-4eb2-a5b1-3350f5dfcf32 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:32.963080 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5ef9ad58-4342-4eb2-a5b1-3350f5dfcf32 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:33.112948 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-76877a2b-5372-471d-bd03-eda724b7f4b6 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:33.120588 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-76877a2b-5372-471d-bd03-eda724b7f4b6 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: 3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:33.128406 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-76877a2b-5372-471d-bd03-eda724b7f4b6 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:33.129381 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-76877a2b-5372-471d-bd03-eda724b7f4b6 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:33.137892 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-76877a2b-5372-471d-bd03-eda724b7f4b6 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:33.138851 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-76877a2b-5372-471d-bd03-eda724b7f4b6 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:33.139425 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-76877a2b-5372-471d-bd03-eda724b7f4b6 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:33.139951 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-76877a2b-5372-471d-bd03-eda724b7f4b6 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:33.449199 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-76877a2b-5372-471d-bd03-eda724b7f4b6 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c997bc60473b43fd9fcf0c65111c44c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a711601b7a439caf395233de1febff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:33.457665 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-76877a2b-5372-471d-bd03-eda724b7f4b6 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "GET /compute/v2.1/servers/3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff" status: 200 len: 1507 microversion: 2.1 time: 0.349514 Oct 04 19:02:33.461542 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2989/5619] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:33 2022] GET /compute/v2.1/servers/3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff => generated 1507 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:02:33.469474 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f5babcc8-2993-4ae8-9266-8a719f995d5d tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:33.478117 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-f5babcc8-2993-4ae8-9266-8a719f995d5d tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] [instance: 21c5a32f-69a7-4836-8c9f-399b415c2c21] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:33.484568 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f5babcc8-2993-4ae8-9266-8a719f995d5d tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:33.485061 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f5babcc8-2993-4ae8-9266-8a719f995d5d tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:33.485535 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f5babcc8-2993-4ae8-9266-8a719f995d5d tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:33.486245 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f5babcc8-2993-4ae8-9266-8a719f995d5d tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:33.486693 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f5babcc8-2993-4ae8-9266-8a719f995d5d tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:33.492397 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f5babcc8-2993-4ae8-9266-8a719f995d5d tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:33.724353 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-5ef9ad58-4342-4eb2-a5b1-3350f5dfcf32 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf87794979e844349d6ec6c6650565f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c25f1d17e94c74868357744e692487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:33.747727 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-5ef9ad58-4342-4eb2-a5b1-3350f5dfcf32 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] 10.222.0.43 "GET /compute/v2.1/servers/32f44032-85ec-43eb-b714-748a7f4f0b5b" status: 200 len: 1696 microversion: 2.1 time: 0.807420 Oct 04 19:02:33.749191 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2631/5620] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:32 2022] GET /compute/v2.1/servers/32f44032-85ec-43eb-b714-748a7f4f0b5b => generated 1696 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:02:33.790057 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-f5babcc8-2993-4ae8-9266-8a719f995d5d tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a63b38b57a347f282318730997e90ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0cfa6c678df4550bdf1b627efb0c46a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:33.804541 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-f5babcc8-2993-4ae8-9266-8a719f995d5d tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] 10.222.0.43 "GET /compute/v2.1/servers/21c5a32f-69a7-4836-8c9f-399b415c2c21" status: 200 len: 1468 microversion: 2.1 time: 0.338135 Oct 04 19:02:33.805627 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2990/5621] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:33 2022] GET /compute/v2.1/servers/21c5a32f-69a7-4836-8c9f-399b415c2c21 => generated 1468 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:02:34.378987 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-7a9b8f0c-c724-4b18-aa73-1bb6e27a60cc req-5c104752-b46a-4d1e-8651-4157bcacaa9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21c5a32f-69a7-4836-8c9f-399b415c2c21", "name": "network-vif-deleted", "tag": "0360c0a2-78bd-4dc0-bef2-e2d42ab6b1b4"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:02:34.396989 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-7a9b8f0c-c724-4b18-aa73-1bb6e27a60cc req-5c104752-b46a-4d1e-8651-4157bcacaa9f service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:34.398481 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-7a9b8f0c-c724-4b18-aa73-1bb6e27a60cc req-5c104752-b46a-4d1e-8651-4157bcacaa9f service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:34.399109 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-7a9b8f0c-c724-4b18-aa73-1bb6e27a60cc req-5c104752-b46a-4d1e-8651-4157bcacaa9f service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:34.419471 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-7a9b8f0c-c724-4b18-aa73-1bb6e27a60cc req-5c104752-b46a-4d1e-8651-4157bcacaa9f service nova] Creating event network-vif-deleted:0360c0a2-78bd-4dc0-bef2-e2d42ab6b1b4 for instance 21c5a32f-69a7-4836-8c9f-399b415c2c21 on n-h2-851028-13 Oct 04 19:02:34.430359 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-7a9b8f0c-c724-4b18-aa73-1bb6e27a60cc req-5c104752-b46a-4d1e-8651-4157bcacaa9f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056204 Oct 04 19:02:34.432747 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2632/5622] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:02:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:02:34.485768 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-b769e21f-4f26-4863-85df-2704586a49d9 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:34.487221 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-b769e21f-4f26-4863-85df-2704586a49d9 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: 3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:34.506288 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b769e21f-4f26-4863-85df-2704586a49d9 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:34.508088 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b769e21f-4f26-4863-85df-2704586a49d9 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:34.516663 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b769e21f-4f26-4863-85df-2704586a49d9 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:34.520135 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b769e21f-4f26-4863-85df-2704586a49d9 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:34.521275 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b769e21f-4f26-4863-85df-2704586a49d9 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:34.522059 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b769e21f-4f26-4863-85df-2704586a49d9 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:34.774490 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-a512287b-f77d-4b28-a168-7691e53db216 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:34.775353 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-a512287b-f77d-4b28-a168-7691e53db216 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] [instance: 32f44032-85ec-43eb-b714-748a7f4f0b5b] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:34.777841 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:02:34.798239 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a512287b-f77d-4b28-a168-7691e53db216 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:34.799041 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a512287b-f77d-4b28-a168-7691e53db216 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:34.799513 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a512287b-f77d-4b28-a168-7691e53db216 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:34.801659 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a512287b-f77d-4b28-a168-7691e53db216 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:34.802167 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a512287b-f77d-4b28-a168-7691e53db216 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:34.802621 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a512287b-f77d-4b28-a168-7691e53db216 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:34.861450 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-b769e21f-4f26-4863-85df-2704586a49d9 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c997bc60473b43fd9fcf0c65111c44c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a711601b7a439caf395233de1febff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:34.890698 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-b769e21f-4f26-4863-85df-2704586a49d9 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "GET /compute/v2.1/servers/3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff" status: 200 len: 1507 microversion: 2.1 time: 0.407994 Oct 04 19:02:34.893146 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2991/5623] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:34 2022] GET /compute/v2.1/servers/3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff => generated 1507 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:02:34.912592 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-5d1ca928-9fa0-46f9-9c40-5b9c7a00e189 tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:34.916391 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-5d1ca928-9fa0-46f9-9c40-5b9c7a00e189 tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] [instance: 21c5a32f-69a7-4836-8c9f-399b415c2c21] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:34.929327 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5d1ca928-9fa0-46f9-9c40-5b9c7a00e189 tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:34.930098 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5d1ca928-9fa0-46f9-9c40-5b9c7a00e189 tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:34.930715 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5d1ca928-9fa0-46f9-9c40-5b9c7a00e189 tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:34.932754 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5d1ca928-9fa0-46f9-9c40-5b9c7a00e189 tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:34.933434 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5d1ca928-9fa0-46f9-9c40-5b9c7a00e189 tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:34.934586 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5d1ca928-9fa0-46f9-9c40-5b9c7a00e189 tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:34.985257 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5d1ca928-9fa0-46f9-9c40-5b9c7a00e189 tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:34.987163 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5d1ca928-9fa0-46f9-9c40-5b9c7a00e189 tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:34.987636 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5d1ca928-9fa0-46f9-9c40-5b9c7a00e189 tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:34.988189 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.objects.instance [None req-5d1ca928-9fa0-46f9-9c40-5b9c7a00e189 tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] Lazy-loading 'fault' on Instance uuid 21c5a32f-69a7-4836-8c9f-399b415c2c21 {{(pid=123596) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 19:02:35.046680 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-5d1ca928-9fa0-46f9-9c40-5b9c7a00e189 tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a63b38b57a347f282318730997e90ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0cfa6c678df4550bdf1b627efb0c46a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:35.058097 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-5d1ca928-9fa0-46f9-9c40-5b9c7a00e189 tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] 10.222.0.43 "GET /compute/v2.1/servers/21c5a32f-69a7-4836-8c9f-399b415c2c21" status: 200 len: 1303 microversion: 2.1 time: 0.154927 Oct 04 19:02:35.059279 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2992/5624] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:34 2022] GET /compute/v2.1/servers/21c5a32f-69a7-4836-8c9f-399b415c2c21 => generated 1303 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:02:35.358649 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-a512287b-f77d-4b28-a168-7691e53db216 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf87794979e844349d6ec6c6650565f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c25f1d17e94c74868357744e692487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:35.361214 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:02:35.377154 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-a512287b-f77d-4b28-a168-7691e53db216 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] 10.222.0.43 "GET /compute/v2.1/servers/32f44032-85ec-43eb-b714-748a7f4f0b5b" status: 200 len: 1696 microversion: 2.1 time: 0.607170 Oct 04 19:02:35.380886 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2633/5625] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:34 2022] GET /compute/v2.1/servers/32f44032-85ec-43eb-b714-748a7f4f0b5b => generated 1696 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:02:35.915995 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-ebf2b382-5890-4b82-b492-481a76e64287 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:35.916601 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-ebf2b382-5890-4b82-b492-481a76e64287 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: 3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:35.924719 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ebf2b382-5890-4b82-b492-481a76e64287 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:35.925410 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ebf2b382-5890-4b82-b492-481a76e64287 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:35.926408 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ebf2b382-5890-4b82-b492-481a76e64287 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:35.927995 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ebf2b382-5890-4b82-b492-481a76e64287 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:35.929598 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ebf2b382-5890-4b82-b492-481a76e64287 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:35.930356 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ebf2b382-5890-4b82-b492-481a76e64287 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:36.093241 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-ebb23c32-22e4-48cb-a9c1-4ba3f8b29b02 tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:36.093892 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-ebb23c32-22e4-48cb-a9c1-4ba3f8b29b02 tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] [instance: 21c5a32f-69a7-4836-8c9f-399b415c2c21] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:36.105099 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ebb23c32-22e4-48cb-a9c1-4ba3f8b29b02 tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:36.105618 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ebb23c32-22e4-48cb-a9c1-4ba3f8b29b02 tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:36.112779 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ebb23c32-22e4-48cb-a9c1-4ba3f8b29b02 tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:36.113584 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ebb23c32-22e4-48cb-a9c1-4ba3f8b29b02 tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:36.114065 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ebb23c32-22e4-48cb-a9c1-4ba3f8b29b02 tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:36.114496 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ebb23c32-22e4-48cb-a9c1-4ba3f8b29b02 tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:36.178390 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-ebb23c32-22e4-48cb-a9c1-4ba3f8b29b02 tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] HTTP exception thrown: Instance 21c5a32f-69a7-4836-8c9f-399b415c2c21 could not be found. Oct 04 19:02:36.194145 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-ebb23c32-22e4-48cb-a9c1-4ba3f8b29b02 tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] Request method failure captured: Oct 04 19:02:36.194145 n-d-851028-13 devstack@n-api.service[123595]: request: GET /compute/v2.1/servers/21c5a32f-69a7-4836-8c9f-399b415c2c21 HTTP/1.1 Oct 04 19:02:36.194145 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 19:02:36.194145 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 19:02:36.194145 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 19:02:36.194145 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 0 Oct 04 19:02:36.194145 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 19:02:36.194145 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 19:02:36.194145 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 19:02:36.194145 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 19:02:36.194145 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPIKbA1pwra-J4FGGsXK7Mffj_Vkv3RB_H1CXvybcJtqfXR9j9_exUhRrN2WzXtxU0nqPi0FJX2gqQk4tzMp-FIGu_N_G6oAk9QnJBACouyjJ41sWE0ucS44tjJcDZVw1cTPn8FSNyQqWnNyTwyekUYdrSWWLV9Gl8QZsy305h-_fNuo Oct 04 19:02:36.194145 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 19:02:36.194145 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 19:02:36.194145 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 19:02:36.194145 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 19:02:36.194145 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 19:02:36.194145 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 19:02:36.194145 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: c0cfa6c678df4550bdf1b627efb0c46a Oct 04 19:02:36.194145 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-VolumesBackupsTest-2000636394 Oct 04 19:02:36.194145 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 19:02:36.194145 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 19:02:36.194145 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/c0cfa6c678df4550bdf1b627efb0c46a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_c0cfa6c678df4550bdf1b627efb0c46a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c0cfa6c678df4550bdf1b627efb0c46a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c0cfa6c678df4550bdf1b627efb0c46a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 19:02:36.194145 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-VolumesBackupsTest-2000636394 Oct 04 19:02:36.194145 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: c0cfa6c678df4550bdf1b627efb0c46a Oct 04 19:02:36.194145 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-VolumesBackupsTest-2000636394 Oct 04 19:02:36.194145 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-VolumesBackupsTest-2000636394-project Oct 04 19:02:36.194145 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 19:02:36.194145 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 19:02:36.194145 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: 9a63b38b57a347f282318730997e90ab Oct 04 19:02:36.194145 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-VolumesBackupsTest-2000636394-project Oct 04 19:02:36.194145 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 19:02:36.194145 n-d-851028-13 devstack@n-api.service[123595]: exception: Instance 21c5a32f-69a7-4836-8c9f-399b415c2c21 could not be found. Oct 04 19:02:36.194145 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': '21c5a32f-69a7-4836-8c9f-399b415c2c21'} Oct 04 19:02:36.194145 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:02:36.194145 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:02:36.194145 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:02:36.194145 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:02:36.194145 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:02:36.194145 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:02:36.194145 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:02:36.194145 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:02:36.194145 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:02:36.194145 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:02:36.194145 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21c5a32f-69a7-4836-8c9f-399b415c2c21 could not be found. Oct 04 19:02:36.194145 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:02:36.194145 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:02:36.194145 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:02:36.194145 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:02:36.194145 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:02:36.194145 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:02:36.194145 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:02:36.194145 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:02:36.194145 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:02:36.194145 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:02:36.194145 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:02:36.194145 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:02:36.194145 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:02:36.194145 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:02:36.194145 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:02:36.194145 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:02:36.194145 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21c5a32f-69a7-4836-8c9f-399b415c2c21 could not be found. Oct 04 19:02:36.194145 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:02:36.194145 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:02:36.194145 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:02:36.198633 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:02:36.198633 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:02:36.198633 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:02:36.198633 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:02:36.198633 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:02:36.198633 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21c5a32f-69a7-4836-8c9f-399b415c2c21 could not be found. Oct 04 19:02:36.198633 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:02:36.208154 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-ebb23c32-22e4-48cb-a9c1-4ba3f8b29b02 tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] Returning 404 to user: Instance 21c5a32f-69a7-4836-8c9f-399b415c2c21 could not be found. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:02:36.210528 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-ebb23c32-22e4-48cb-a9c1-4ba3f8b29b02 tempest-VolumesBackupsTest-2000636394 tempest-VolumesBackupsTest-2000636394-project] 10.222.0.43 "GET /compute/v2.1/servers/21c5a32f-69a7-4836-8c9f-399b415c2c21" status: 404 len: 111 microversion: 2.1 time: 0.121713 Oct 04 19:02:36.220635 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2634/5626] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:36 2022] GET /compute/v2.1/servers/21c5a32f-69a7-4836-8c9f-399b415c2c21 => generated 111 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 19:02:36.267070 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-ebf2b382-5890-4b82-b492-481a76e64287 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c997bc60473b43fd9fcf0c65111c44c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a711601b7a439caf395233de1febff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:36.277738 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-ebf2b382-5890-4b82-b492-481a76e64287 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "GET /compute/v2.1/servers/3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff" status: 200 len: 1507 microversion: 2.1 time: 0.366172 Oct 04 19:02:36.280851 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2993/5627] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:35 2022] GET /compute/v2.1/servers/3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff => generated 1507 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:02:36.418999 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-e7e10ae9-f706-4549-bae6-405c28275b8c tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:36.419811 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-e7e10ae9-f706-4549-bae6-405c28275b8c tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] [instance: 32f44032-85ec-43eb-b714-748a7f4f0b5b] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:36.440488 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e7e10ae9-f706-4549-bae6-405c28275b8c tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:36.441093 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e7e10ae9-f706-4549-bae6-405c28275b8c tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:36.441528 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e7e10ae9-f706-4549-bae6-405c28275b8c tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:36.451729 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e7e10ae9-f706-4549-bae6-405c28275b8c tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:36.452499 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e7e10ae9-f706-4549-bae6-405c28275b8c tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:36.452958 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e7e10ae9-f706-4549-bae6-405c28275b8c tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:36.777214 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-e7e10ae9-f706-4549-bae6-405c28275b8c tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf87794979e844349d6ec6c6650565f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c25f1d17e94c74868357744e692487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:36.790041 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-e7e10ae9-f706-4549-bae6-405c28275b8c tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] 10.222.0.43 "GET /compute/v2.1/servers/32f44032-85ec-43eb-b714-748a7f4f0b5b" status: 200 len: 1696 microversion: 2.1 time: 0.374971 Oct 04 19:02:36.791279 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2635/5628] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:36 2022] GET /compute/v2.1/servers/32f44032-85ec-43eb-b714-748a7f4f0b5b => generated 1696 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:02:37.307539 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-1fd1e2e6-2052-4614-8ecc-d0d16bf4a877 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:37.308769 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-1fd1e2e6-2052-4614-8ecc-d0d16bf4a877 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: 3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:37.332834 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1fd1e2e6-2052-4614-8ecc-d0d16bf4a877 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:37.333523 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1fd1e2e6-2052-4614-8ecc-d0d16bf4a877 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:37.339740 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1fd1e2e6-2052-4614-8ecc-d0d16bf4a877 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:37.348696 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1fd1e2e6-2052-4614-8ecc-d0d16bf4a877 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:37.350122 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1fd1e2e6-2052-4614-8ecc-d0d16bf4a877 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:37.360417 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1fd1e2e6-2052-4614-8ecc-d0d16bf4a877 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:37.703129 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-1fd1e2e6-2052-4614-8ecc-d0d16bf4a877 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c997bc60473b43fd9fcf0c65111c44c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a711601b7a439caf395233de1febff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:37.718559 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-1fd1e2e6-2052-4614-8ecc-d0d16bf4a877 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "GET /compute/v2.1/servers/3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff" status: 200 len: 1507 microversion: 2.1 time: 0.415323 Oct 04 19:02:37.722870 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2994/5629] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:37 2022] GET /compute/v2.1/servers/3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff => generated 1507 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:02:37.820039 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-22451029-421a-4888-9a34-7e4ce39666d9 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:37.820661 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-22451029-421a-4888-9a34-7e4ce39666d9 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] [instance: 32f44032-85ec-43eb-b714-748a7f4f0b5b] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:37.834337 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-22451029-421a-4888-9a34-7e4ce39666d9 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:37.835627 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-22451029-421a-4888-9a34-7e4ce39666d9 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:37.836195 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-22451029-421a-4888-9a34-7e4ce39666d9 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:37.838961 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-22451029-421a-4888-9a34-7e4ce39666d9 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:37.839474 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-22451029-421a-4888-9a34-7e4ce39666d9 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:37.839912 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-22451029-421a-4888-9a34-7e4ce39666d9 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:38.151776 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-22451029-421a-4888-9a34-7e4ce39666d9 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf87794979e844349d6ec6c6650565f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c25f1d17e94c74868357744e692487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:38.168928 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-22451029-421a-4888-9a34-7e4ce39666d9 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] 10.222.0.43 "GET /compute/v2.1/servers/32f44032-85ec-43eb-b714-748a7f4f0b5b" status: 200 len: 1696 microversion: 2.1 time: 0.350804 Oct 04 19:02:38.174024 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2636/5630] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:37 2022] GET /compute/v2.1/servers/32f44032-85ec-43eb-b714-748a7f4f0b5b => generated 1696 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:02:38.708034 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-74e08162-e1d3-4680-9741-026a59bf6ced tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-923139355", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "f0f6b25d-9f8f-4bc1-8d34-9d5925f245c2"}]}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:02:38.751583 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-66e231f4-8488-47f6-be4b-f3a41bfec033 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:38.752257 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-66e231f4-8488-47f6-be4b-f3a41bfec033 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: 3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:38.763754 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-66e231f4-8488-47f6-be4b-f3a41bfec033 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:38.764260 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-66e231f4-8488-47f6-be4b-f3a41bfec033 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:38.764698 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-66e231f4-8488-47f6-be4b-f3a41bfec033 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:38.768725 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-66e231f4-8488-47f6-be4b-f3a41bfec033 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:38.778315 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-66e231f4-8488-47f6-be4b-f3a41bfec033 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:38.779281 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-66e231f4-8488-47f6-be4b-f3a41bfec033 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:38.810254 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.network.neutron [None req-74e08162-e1d3-4680-9741-026a59bf6ced tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] validate_networks() for [('f0f6b25d-9f8f-4bc1-8d34-9d5925f245c2', None, None, None, None, None)] {{(pid=123596) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 19:02:39.069470 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-66e231f4-8488-47f6-be4b-f3a41bfec033 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c997bc60473b43fd9fcf0c65111c44c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a711601b7a439caf395233de1febff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:39.080686 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-66e231f4-8488-47f6-be4b-f3a41bfec033 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "GET /compute/v2.1/servers/3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff" status: 200 len: 1507 microversion: 2.1 time: 0.334135 Oct 04 19:02:39.081476 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2637/5631] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:38 2022] GET /compute/v2.1/servers/3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff => generated 1507 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:02:39.193559 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-9448ae84-1bd1-4045-a3b8-0203ac835162 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:39.194315 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-9448ae84-1bd1-4045-a3b8-0203ac835162 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] [instance: 32f44032-85ec-43eb-b714-748a7f4f0b5b] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:39.204326 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9448ae84-1bd1-4045-a3b8-0203ac835162 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:39.204825 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9448ae84-1bd1-4045-a3b8-0203ac835162 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:39.205300 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9448ae84-1bd1-4045-a3b8-0203ac835162 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:39.217090 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9448ae84-1bd1-4045-a3b8-0203ac835162 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:39.217647 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9448ae84-1bd1-4045-a3b8-0203ac835162 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:39.218113 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9448ae84-1bd1-4045-a3b8-0203ac835162 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:39.520177 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-9448ae84-1bd1-4045-a3b8-0203ac835162 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf87794979e844349d6ec6c6650565f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c25f1d17e94c74868357744e692487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:39.530433 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-9448ae84-1bd1-4045-a3b8-0203ac835162 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] 10.222.0.43 "GET /compute/v2.1/servers/32f44032-85ec-43eb-b714-748a7f4f0b5b" status: 200 len: 1696 microversion: 2.1 time: 0.341470 Oct 04 19:02:39.534985 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2638/5632] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:39 2022] GET /compute/v2.1/servers/32f44032-85ec-43eb-b714-748a7f4f0b5b => generated 1696 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:02:39.590551 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-74e08162-e1d3-4680-9741-026a59bf6ced tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] Flavor limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:02:39.591208 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-74e08162-e1d3-4680-9741-026a59bf6ced tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] Image limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:02:39.591697 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-74e08162-e1d3-4680-9741-026a59bf6ced tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] Flavor pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:02:39.592109 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-74e08162-e1d3-4680-9741-026a59bf6ced tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] Image pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:02:39.592697 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-74e08162-e1d3-4680-9741-026a59bf6ced tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:02:39.608092 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-74e08162-e1d3-4680-9741-026a59bf6ced tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:39.608793 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-74e08162-e1d3-4680-9741-026a59bf6ced tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:39.613625 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-74e08162-e1d3-4680-9741-026a59bf6ced tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:39.615342 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-74e08162-e1d3-4680-9741-026a59bf6ced tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:39.615830 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-74e08162-e1d3-4680-9741-026a59bf6ced tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:39.617168 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-74e08162-e1d3-4680-9741-026a59bf6ced tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:39.655031 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-74e08162-e1d3-4680-9741-026a59bf6ced tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] Getting quotas for project 3235f4d52e4b43728569e58f675cf922. Resources: {'ram', 'cores', 'instances'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:02:39.682344 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-74e08162-e1d3-4680-9741-026a59bf6ced tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] Getting quotas for user 82e0e6ed148c4452b054ffbfc185cd2a and project 3235f4d52e4b43728569e58f675cf922. Resources: {'ram', 'cores', 'instances'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:02:39.741835 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-74e08162-e1d3-4680-9741-026a59bf6ced tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] Going to run 1 instances... {{(pid=123596) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 19:02:39.744280 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-74e08162-e1d3-4680-9741-026a59bf6ced tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] [instance: 98ab602c-e2bc-4fa4-aafd-be3bd6b1589f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e8943ec5-4038-4d4b-b9b9-2415a79f5243',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123596) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 19:02:39.849162 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-74e08162-e1d3-4680-9741-026a59bf6ced tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.584421 Oct 04 19:02:39.850932 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2995/5633] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 19:02:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 1586 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 19:02:39.862609 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-7c12cf97-bbb4-48ae-a864-b07057d6fd2f tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:39.863385 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-7c12cf97-bbb4-48ae-a864-b07057d6fd2f tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] [instance: 98ab602c-e2bc-4fa4-aafd-be3bd6b1589f] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:40.110187 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-24372056-6f36-41b5-93a2-c2d8d377ab0d tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:40.112171 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-24372056-6f36-41b5-93a2-c2d8d377ab0d tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: 3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:40.124535 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-7c12cf97-bbb4-48ae-a864-b07057d6fd2f tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e0e6ed148c4452b054ffbfc185cd2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3235f4d52e4b43728569e58f675cf922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:40.135391 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-7c12cf97-bbb4-48ae-a864-b07057d6fd2f tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] 10.222.0.43 "GET /compute/v2.1/servers/98ab602c-e2bc-4fa4-aafd-be3bd6b1589f" status: 200 len: 1223 microversion: 2.1 time: 0.277187 Oct 04 19:02:40.137900 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2639/5634] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:39 2022] GET /compute/v2.1/servers/98ab602c-e2bc-4fa4-aafd-be3bd6b1589f => generated 1223 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:02:40.139038 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-24372056-6f36-41b5-93a2-c2d8d377ab0d tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:40.141339 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-24372056-6f36-41b5-93a2-c2d8d377ab0d tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:40.142068 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-24372056-6f36-41b5-93a2-c2d8d377ab0d tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:40.143799 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-24372056-6f36-41b5-93a2-c2d8d377ab0d tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:40.144479 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-24372056-6f36-41b5-93a2-c2d8d377ab0d tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:40.145148 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-24372056-6f36-41b5-93a2-c2d8d377ab0d tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:40.378489 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-24372056-6f36-41b5-93a2-c2d8d377ab0d tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c997bc60473b43fd9fcf0c65111c44c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a711601b7a439caf395233de1febff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:40.388887 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-24372056-6f36-41b5-93a2-c2d8d377ab0d tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "GET /compute/v2.1/servers/3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff" status: 200 len: 1507 microversion: 2.1 time: 0.284709 Oct 04 19:02:40.404604 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2996/5635] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:40 2022] GET /compute/v2.1/servers/3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff => generated 1507 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:02:40.555189 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-17f415f7-65f4-43ff-b278-96fb047c36dc tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:40.555189 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-17f415f7-65f4-43ff-b278-96fb047c36dc tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] [instance: 32f44032-85ec-43eb-b714-748a7f4f0b5b] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:40.565855 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-17f415f7-65f4-43ff-b278-96fb047c36dc tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:40.575377 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-17f415f7-65f4-43ff-b278-96fb047c36dc tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:40.576155 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-17f415f7-65f4-43ff-b278-96fb047c36dc tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:40.577538 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-17f415f7-65f4-43ff-b278-96fb047c36dc tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:40.578708 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-17f415f7-65f4-43ff-b278-96fb047c36dc tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:40.579505 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-17f415f7-65f4-43ff-b278-96fb047c36dc tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:40.843072 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-17f415f7-65f4-43ff-b278-96fb047c36dc tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf87794979e844349d6ec6c6650565f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c25f1d17e94c74868357744e692487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:40.851616 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-17f415f7-65f4-43ff-b278-96fb047c36dc tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] 10.222.0.43 "GET /compute/v2.1/servers/32f44032-85ec-43eb-b714-748a7f4f0b5b" status: 200 len: 1696 microversion: 2.1 time: 0.301188 Oct 04 19:02:40.857480 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2640/5636] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:40 2022] GET /compute/v2.1/servers/32f44032-85ec-43eb-b714-748a7f4f0b5b => generated 1696 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:02:41.167966 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-84c5aabb-ebe5-4d40-b82f-039175483f10 tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:41.168616 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-84c5aabb-ebe5-4d40-b82f-039175483f10 tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] [instance: 98ab602c-e2bc-4fa4-aafd-be3bd6b1589f] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:41.179217 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-84c5aabb-ebe5-4d40-b82f-039175483f10 tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:41.180084 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-84c5aabb-ebe5-4d40-b82f-039175483f10 tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:41.181236 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-84c5aabb-ebe5-4d40-b82f-039175483f10 tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:41.182177 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-84c5aabb-ebe5-4d40-b82f-039175483f10 tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:41.182866 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-84c5aabb-ebe5-4d40-b82f-039175483f10 tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:41.183472 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-84c5aabb-ebe5-4d40-b82f-039175483f10 tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:41.292229 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-84c5aabb-ebe5-4d40-b82f-039175483f10 tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e0e6ed148c4452b054ffbfc185cd2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3235f4d52e4b43728569e58f675cf922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:41.301340 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-84c5aabb-ebe5-4d40-b82f-039175483f10 tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] 10.222.0.43 "GET /compute/v2.1/servers/98ab602c-e2bc-4fa4-aafd-be3bd6b1589f" status: 200 len: 1227 microversion: 2.1 time: 0.140543 Oct 04 19:02:41.303161 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2997/5637] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:41 2022] GET /compute/v2.1/servers/98ab602c-e2bc-4fa4-aafd-be3bd6b1589f => generated 1227 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:02:41.416787 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-db6e7848-c736-412d-bf49-a62aa4b54c97 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:41.417441 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-db6e7848-c736-412d-bf49-a62aa4b54c97 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: 3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:41.436747 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-db6e7848-c736-412d-bf49-a62aa4b54c97 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:41.437391 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-db6e7848-c736-412d-bf49-a62aa4b54c97 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:41.437849 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-db6e7848-c736-412d-bf49-a62aa4b54c97 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:41.438583 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-db6e7848-c736-412d-bf49-a62aa4b54c97 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:41.439159 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-db6e7848-c736-412d-bf49-a62aa4b54c97 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:41.439734 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-db6e7848-c736-412d-bf49-a62aa4b54c97 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:41.702794 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-db6e7848-c736-412d-bf49-a62aa4b54c97 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c997bc60473b43fd9fcf0c65111c44c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a711601b7a439caf395233de1febff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:41.712037 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-db6e7848-c736-412d-bf49-a62aa4b54c97 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "GET /compute/v2.1/servers/3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff" status: 200 len: 1507 microversion: 2.1 time: 0.299649 Oct 04 19:02:41.716126 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2641/5638] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:41 2022] GET /compute/v2.1/servers/3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff => generated 1507 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:02:41.882219 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-6755ee8e-9ac3-4939-9b96-d169ad91a228 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:41.882846 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-6755ee8e-9ac3-4939-9b96-d169ad91a228 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] [instance: 32f44032-85ec-43eb-b714-748a7f4f0b5b] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:41.895584 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6755ee8e-9ac3-4939-9b96-d169ad91a228 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:41.897967 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6755ee8e-9ac3-4939-9b96-d169ad91a228 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:41.898798 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6755ee8e-9ac3-4939-9b96-d169ad91a228 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:41.900055 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6755ee8e-9ac3-4939-9b96-d169ad91a228 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:41.900990 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6755ee8e-9ac3-4939-9b96-d169ad91a228 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:41.901673 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6755ee8e-9ac3-4939-9b96-d169ad91a228 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:41.922986 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:02:42.325102 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-3dc17d52-c30c-4d7d-baa4-00c62a387f40 tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:42.326263 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-3dc17d52-c30c-4d7d-baa4-00c62a387f40 tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] [instance: 98ab602c-e2bc-4fa4-aafd-be3bd6b1589f] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:42.338105 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3dc17d52-c30c-4d7d-baa4-00c62a387f40 tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:42.339796 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3dc17d52-c30c-4d7d-baa4-00c62a387f40 tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:42.344225 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3dc17d52-c30c-4d7d-baa4-00c62a387f40 tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:42.345166 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3dc17d52-c30c-4d7d-baa4-00c62a387f40 tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:42.346642 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3dc17d52-c30c-4d7d-baa4-00c62a387f40 tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:42.348105 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3dc17d52-c30c-4d7d-baa4-00c62a387f40 tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:42.502222 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-6755ee8e-9ac3-4939-9b96-d169ad91a228 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf87794979e844349d6ec6c6650565f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c25f1d17e94c74868357744e692487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:42.512751 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-6755ee8e-9ac3-4939-9b96-d169ad91a228 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] 10.222.0.43 "GET /compute/v2.1/servers/32f44032-85ec-43eb-b714-748a7f4f0b5b" status: 200 len: 1696 microversion: 2.1 time: 0.634838 Oct 04 19:02:42.528885 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2998/5639] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:41 2022] GET /compute/v2.1/servers/32f44032-85ec-43eb-b714-748a7f4f0b5b => generated 1696 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:02:42.540616 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-3dc17d52-c30c-4d7d-baa4-00c62a387f40 tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e0e6ed148c4452b054ffbfc185cd2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3235f4d52e4b43728569e58f675cf922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:42.561164 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-3dc17d52-c30c-4d7d-baa4-00c62a387f40 tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] 10.222.0.43 "GET /compute/v2.1/servers/98ab602c-e2bc-4fa4-aafd-be3bd6b1589f" status: 200 len: 1293 microversion: 2.1 time: 0.239981 Oct 04 19:02:42.564797 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2642/5640] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:42 2022] GET /compute/v2.1/servers/98ab602c-e2bc-4fa4-aafd-be3bd6b1589f => generated 1293 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:02:42.744276 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-540dac52-2434-4339-9349-40a75f346ab9 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:42.744998 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-540dac52-2434-4339-9349-40a75f346ab9 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: 3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:42.760649 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-540dac52-2434-4339-9349-40a75f346ab9 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:42.761201 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-540dac52-2434-4339-9349-40a75f346ab9 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:42.761672 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-540dac52-2434-4339-9349-40a75f346ab9 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:42.762422 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-540dac52-2434-4339-9349-40a75f346ab9 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:42.762893 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-540dac52-2434-4339-9349-40a75f346ab9 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:42.763333 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-540dac52-2434-4339-9349-40a75f346ab9 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:43.118899 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-540dac52-2434-4339-9349-40a75f346ab9 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c997bc60473b43fd9fcf0c65111c44c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a711601b7a439caf395233de1febff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:43.136996 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-540dac52-2434-4339-9349-40a75f346ab9 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "GET /compute/v2.1/servers/3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff" status: 200 len: 1507 microversion: 2.1 time: 0.397624 Oct 04 19:02:43.141376 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 2999/5641] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:42 2022] GET /compute/v2.1/servers/3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff => generated 1507 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:02:43.539452 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-cffced03-890a-437f-acc5-4c2e4a3c4d5d tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:43.540392 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-cffced03-890a-437f-acc5-4c2e4a3c4d5d tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] [instance: 32f44032-85ec-43eb-b714-748a7f4f0b5b] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:43.561629 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cffced03-890a-437f-acc5-4c2e4a3c4d5d tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:43.562869 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cffced03-890a-437f-acc5-4c2e4a3c4d5d tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:43.564133 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cffced03-890a-437f-acc5-4c2e4a3c4d5d tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:43.568889 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cffced03-890a-437f-acc5-4c2e4a3c4d5d tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:43.572614 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cffced03-890a-437f-acc5-4c2e4a3c4d5d tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:43.573494 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cffced03-890a-437f-acc5-4c2e4a3c4d5d tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:43.591486 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-8bddc6cf-11b7-4c86-bc58-aa2979f5fa5b tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:43.593127 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-8bddc6cf-11b7-4c86-bc58-aa2979f5fa5b tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] [instance: 98ab602c-e2bc-4fa4-aafd-be3bd6b1589f] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:43.609866 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8bddc6cf-11b7-4c86-bc58-aa2979f5fa5b tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:43.614097 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8bddc6cf-11b7-4c86-bc58-aa2979f5fa5b tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:43.616048 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8bddc6cf-11b7-4c86-bc58-aa2979f5fa5b tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:43.618881 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8bddc6cf-11b7-4c86-bc58-aa2979f5fa5b tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:43.632503 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8bddc6cf-11b7-4c86-bc58-aa2979f5fa5b tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:43.634749 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8bddc6cf-11b7-4c86-bc58-aa2979f5fa5b tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:43.999527 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-cffced03-890a-437f-acc5-4c2e4a3c4d5d tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf87794979e844349d6ec6c6650565f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c25f1d17e94c74868357744e692487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:44.017940 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-cffced03-890a-437f-acc5-4c2e4a3c4d5d tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] 10.222.0.43 "GET /compute/v2.1/servers/32f44032-85ec-43eb-b714-748a7f4f0b5b" status: 200 len: 1696 microversion: 2.1 time: 0.483557 Oct 04 19:02:44.029527 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2643/5642] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:43 2022] GET /compute/v2.1/servers/32f44032-85ec-43eb-b714-748a7f4f0b5b => generated 1696 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:02:44.171955 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-e9b912bf-5ebd-4bd3-ad74-7eda1a8a4449 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:44.192093 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-e9b912bf-5ebd-4bd3-ad74-7eda1a8a4449 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: 3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:44.218756 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e9b912bf-5ebd-4bd3-ad74-7eda1a8a4449 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:44.223502 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e9b912bf-5ebd-4bd3-ad74-7eda1a8a4449 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:44.227585 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e9b912bf-5ebd-4bd3-ad74-7eda1a8a4449 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:44.228854 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e9b912bf-5ebd-4bd3-ad74-7eda1a8a4449 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:44.231418 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e9b912bf-5ebd-4bd3-ad74-7eda1a8a4449 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:44.232671 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e9b912bf-5ebd-4bd3-ad74-7eda1a8a4449 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:44.310190 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-8bddc6cf-11b7-4c86-bc58-aa2979f5fa5b tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e0e6ed148c4452b054ffbfc185cd2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3235f4d52e4b43728569e58f675cf922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:44.344923 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-8bddc6cf-11b7-4c86-bc58-aa2979f5fa5b tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] 10.222.0.43 "GET /compute/v2.1/servers/98ab602c-e2bc-4fa4-aafd-be3bd6b1589f" status: 200 len: 1281 microversion: 2.1 time: 0.745312 Oct 04 19:02:44.354653 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3000/5643] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:43 2022] GET /compute/v2.1/servers/98ab602c-e2bc-4fa4-aafd-be3bd6b1589f => generated 1281 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:02:44.528159 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-e9b912bf-5ebd-4bd3-ad74-7eda1a8a4449 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c997bc60473b43fd9fcf0c65111c44c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a711601b7a439caf395233de1febff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:44.538864 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-e9b912bf-5ebd-4bd3-ad74-7eda1a8a4449 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "GET /compute/v2.1/servers/3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff" status: 200 len: 1507 microversion: 2.1 time: 0.377781 Oct 04 19:02:44.541197 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2644/5644] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:44 2022] GET /compute/v2.1/servers/3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff => generated 1507 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:02:45.056677 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-30ee4ec1-1f0b-4115-8d98-1b15ab2a4a4a tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:45.057450 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-30ee4ec1-1f0b-4115-8d98-1b15ab2a4a4a tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] [instance: 32f44032-85ec-43eb-b714-748a7f4f0b5b] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:45.073415 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-30ee4ec1-1f0b-4115-8d98-1b15ab2a4a4a tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:45.073912 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-30ee4ec1-1f0b-4115-8d98-1b15ab2a4a4a tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:45.074352 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-30ee4ec1-1f0b-4115-8d98-1b15ab2a4a4a tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:45.075071 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-30ee4ec1-1f0b-4115-8d98-1b15ab2a4a4a tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:45.075532 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-30ee4ec1-1f0b-4115-8d98-1b15ab2a4a4a tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:45.075962 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-30ee4ec1-1f0b-4115-8d98-1b15ab2a4a4a tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:45.372886 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-30ee4ec1-1f0b-4115-8d98-1b15ab2a4a4a tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf87794979e844349d6ec6c6650565f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c25f1d17e94c74868357744e692487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:45.381557 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-e804f3ed-5796-46bd-9133-0a928d16ceb8 tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:45.382769 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-e804f3ed-5796-46bd-9133-0a928d16ceb8 tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] [instance: 98ab602c-e2bc-4fa4-aafd-be3bd6b1589f] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:45.390122 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-30ee4ec1-1f0b-4115-8d98-1b15ab2a4a4a tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] 10.222.0.43 "GET /compute/v2.1/servers/32f44032-85ec-43eb-b714-748a7f4f0b5b" status: 200 len: 1696 microversion: 2.1 time: 0.339853 Oct 04 19:02:45.390728 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3001/5645] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:45 2022] GET /compute/v2.1/servers/32f44032-85ec-43eb-b714-748a7f4f0b5b => generated 1696 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:02:45.404648 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e804f3ed-5796-46bd-9133-0a928d16ceb8 tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:45.405175 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e804f3ed-5796-46bd-9133-0a928d16ceb8 tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:45.405621 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e804f3ed-5796-46bd-9133-0a928d16ceb8 tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:45.406337 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e804f3ed-5796-46bd-9133-0a928d16ceb8 tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:45.406788 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e804f3ed-5796-46bd-9133-0a928d16ceb8 tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:45.407220 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e804f3ed-5796-46bd-9133-0a928d16ceb8 tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:45.583724 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-1ed28174-f9ec-4332-8aba-e3de326bd825 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:45.585778 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-1ed28174-f9ec-4332-8aba-e3de326bd825 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: 3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:45.598816 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1ed28174-f9ec-4332-8aba-e3de326bd825 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:45.601710 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1ed28174-f9ec-4332-8aba-e3de326bd825 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:45.602991 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1ed28174-f9ec-4332-8aba-e3de326bd825 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:45.604327 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1ed28174-f9ec-4332-8aba-e3de326bd825 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:45.606215 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1ed28174-f9ec-4332-8aba-e3de326bd825 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:45.606863 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1ed28174-f9ec-4332-8aba-e3de326bd825 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:45.699583 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-e804f3ed-5796-46bd-9133-0a928d16ceb8 tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e0e6ed148c4452b054ffbfc185cd2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3235f4d52e4b43728569e58f675cf922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:45.707701 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-e804f3ed-5796-46bd-9133-0a928d16ceb8 tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] 10.222.0.43 "GET /compute/v2.1/servers/98ab602c-e2bc-4fa4-aafd-be3bd6b1589f" status: 200 len: 1323 microversion: 2.1 time: 0.333337 Oct 04 19:02:45.717757 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2645/5646] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:45 2022] GET /compute/v2.1/servers/98ab602c-e2bc-4fa4-aafd-be3bd6b1589f => generated 1323 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:02:45.922665 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-1ed28174-f9ec-4332-8aba-e3de326bd825 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c997bc60473b43fd9fcf0c65111c44c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a711601b7a439caf395233de1febff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:45.934005 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-1ed28174-f9ec-4332-8aba-e3de326bd825 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "GET /compute/v2.1/servers/3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff" status: 200 len: 1507 microversion: 2.1 time: 0.365547 Oct 04 19:02:45.951808 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3002/5647] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:45 2022] GET /compute/v2.1/servers/3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff => generated 1507 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:02:46.058709 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-59ea2a7c-1f8c-4d72-a13a-bc44892843ec req-28f38995-dc23-4cd2-85e3-ea598182629c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98ab602c-e2bc-4fa4-aafd-be3bd6b1589f", "tag": "967cced9-22db-41a7-b033-401942fe77d8"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:02:46.085641 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-59ea2a7c-1f8c-4d72-a13a-bc44892843ec req-28f38995-dc23-4cd2-85e3-ea598182629c service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:46.093200 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-59ea2a7c-1f8c-4d72-a13a-bc44892843ec req-28f38995-dc23-4cd2-85e3-ea598182629c service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:46.093398 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-59ea2a7c-1f8c-4d72-a13a-bc44892843ec req-28f38995-dc23-4cd2-85e3-ea598182629c service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:46.122691 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-59ea2a7c-1f8c-4d72-a13a-bc44892843ec req-28f38995-dc23-4cd2-85e3-ea598182629c service nova] Creating event network-changed:967cced9-22db-41a7-b033-401942fe77d8 for instance 98ab602c-e2bc-4fa4-aafd-be3bd6b1589f on n-h2-851028-13 Oct 04 19:02:46.135566 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-59ea2a7c-1f8c-4d72-a13a-bc44892843ec req-28f38995-dc23-4cd2-85e3-ea598182629c service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081646 Oct 04 19:02:46.136905 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2646/5648] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:02:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:02:46.420015 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-d201b898-e521-4cd8-a235-ffd095d2c42f tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:46.421444 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-d201b898-e521-4cd8-a235-ffd095d2c42f tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] [instance: 32f44032-85ec-43eb-b714-748a7f4f0b5b] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:46.431565 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d201b898-e521-4cd8-a235-ffd095d2c42f tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:46.432401 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d201b898-e521-4cd8-a235-ffd095d2c42f tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:46.433023 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d201b898-e521-4cd8-a235-ffd095d2c42f tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:46.433998 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d201b898-e521-4cd8-a235-ffd095d2c42f tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:46.434645 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d201b898-e521-4cd8-a235-ffd095d2c42f tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:46.435291 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d201b898-e521-4cd8-a235-ffd095d2c42f tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:46.735299 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-06c7b330-34ba-4222-92a3-e3c539741115 tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:46.736009 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-06c7b330-34ba-4222-92a3-e3c539741115 tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] [instance: 98ab602c-e2bc-4fa4-aafd-be3bd6b1589f] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:46.747090 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-06c7b330-34ba-4222-92a3-e3c539741115 tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:46.747909 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-06c7b330-34ba-4222-92a3-e3c539741115 tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:46.748670 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-06c7b330-34ba-4222-92a3-e3c539741115 tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:46.749849 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-06c7b330-34ba-4222-92a3-e3c539741115 tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:46.750608 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-06c7b330-34ba-4222-92a3-e3c539741115 tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:46.751222 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-06c7b330-34ba-4222-92a3-e3c539741115 tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:46.832374 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-d201b898-e521-4cd8-a235-ffd095d2c42f tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf87794979e844349d6ec6c6650565f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c25f1d17e94c74868357744e692487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:46.841823 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-d201b898-e521-4cd8-a235-ffd095d2c42f tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] 10.222.0.43 "GET /compute/v2.1/servers/32f44032-85ec-43eb-b714-748a7f4f0b5b" status: 200 len: 1696 microversion: 2.1 time: 0.426510 Oct 04 19:02:46.862916 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3003/5649] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:46 2022] GET /compute/v2.1/servers/32f44032-85ec-43eb-b714-748a7f4f0b5b => generated 1696 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:02:46.944930 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-06c7b330-34ba-4222-92a3-e3c539741115 tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e0e6ed148c4452b054ffbfc185cd2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3235f4d52e4b43728569e58f675cf922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:46.959263 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-c4f5bb95-99b4-45be-838b-81b750f6e1f6 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:46.960210 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-c4f5bb95-99b4-45be-838b-81b750f6e1f6 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: 3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:46.962611 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-06c7b330-34ba-4222-92a3-e3c539741115 tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] 10.222.0.43 "GET /compute/v2.1/servers/98ab602c-e2bc-4fa4-aafd-be3bd6b1589f" status: 200 len: 1323 microversion: 2.1 time: 0.232274 Oct 04 19:02:46.968274 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c4f5bb95-99b4-45be-838b-81b750f6e1f6 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:46.969418 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c4f5bb95-99b4-45be-838b-81b750f6e1f6 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:46.970279 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c4f5bb95-99b4-45be-838b-81b750f6e1f6 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:46.971305 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c4f5bb95-99b4-45be-838b-81b750f6e1f6 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:46.971933 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c4f5bb95-99b4-45be-838b-81b750f6e1f6 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:46.972534 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c4f5bb95-99b4-45be-838b-81b750f6e1f6 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:46.979709 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2647/5650] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:46 2022] GET /compute/v2.1/servers/98ab602c-e2bc-4fa4-aafd-be3bd6b1589f => generated 1323 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:02:47.217940 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-c4f5bb95-99b4-45be-838b-81b750f6e1f6 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c997bc60473b43fd9fcf0c65111c44c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a711601b7a439caf395233de1febff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:47.226516 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-c4f5bb95-99b4-45be-838b-81b750f6e1f6 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "GET /compute/v2.1/servers/3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff" status: 200 len: 1507 microversion: 2.1 time: 0.272492 Oct 04 19:02:47.236769 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3004/5651] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:46 2022] GET /compute/v2.1/servers/3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff => generated 1507 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:02:47.868091 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-ef945511-dbb1-4c9e-8145-fe1f0845d03c tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:47.868702 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-ef945511-dbb1-4c9e-8145-fe1f0845d03c tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] [instance: 32f44032-85ec-43eb-b714-748a7f4f0b5b] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:47.888278 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ef945511-dbb1-4c9e-8145-fe1f0845d03c tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:47.889060 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ef945511-dbb1-4c9e-8145-fe1f0845d03c tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:47.889730 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ef945511-dbb1-4c9e-8145-fe1f0845d03c tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:47.890900 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ef945511-dbb1-4c9e-8145-fe1f0845d03c tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:47.893550 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ef945511-dbb1-4c9e-8145-fe1f0845d03c tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:47.894536 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ef945511-dbb1-4c9e-8145-fe1f0845d03c tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:48.000383 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-ebfaac18-e11c-48d5-a1d9-18f3df2f5d4b tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:48.001827 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-ebfaac18-e11c-48d5-a1d9-18f3df2f5d4b tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] [instance: 98ab602c-e2bc-4fa4-aafd-be3bd6b1589f] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:48.065992 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ebfaac18-e11c-48d5-a1d9-18f3df2f5d4b tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:48.067267 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ebfaac18-e11c-48d5-a1d9-18f3df2f5d4b tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:48.067978 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ebfaac18-e11c-48d5-a1d9-18f3df2f5d4b tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:48.074016 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ebfaac18-e11c-48d5-a1d9-18f3df2f5d4b tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:48.075294 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ebfaac18-e11c-48d5-a1d9-18f3df2f5d4b tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:48.080804 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ebfaac18-e11c-48d5-a1d9-18f3df2f5d4b tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:48.351879 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-ef945511-dbb1-4c9e-8145-fe1f0845d03c tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf87794979e844349d6ec6c6650565f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c25f1d17e94c74868357744e692487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:48.391089 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-ef945511-dbb1-4c9e-8145-fe1f0845d03c tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] 10.222.0.43 "GET /compute/v2.1/servers/32f44032-85ec-43eb-b714-748a7f4f0b5b" status: 200 len: 1695 microversion: 2.1 time: 0.523843 Oct 04 19:02:48.395345 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2648/5652] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:47 2022] GET /compute/v2.1/servers/32f44032-85ec-43eb-b714-748a7f4f0b5b => generated 1695 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:02:48.424297 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-81dd526d-6f85-49fe-b2a6-5ddfa256f80a tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:48.426441 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-81dd526d-6f85-49fe-b2a6-5ddfa256f80a tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: 3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:48.436521 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-81dd526d-6f85-49fe-b2a6-5ddfa256f80a tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:48.437289 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-81dd526d-6f85-49fe-b2a6-5ddfa256f80a tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:48.438018 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-81dd526d-6f85-49fe-b2a6-5ddfa256f80a tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:48.439110 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-81dd526d-6f85-49fe-b2a6-5ddfa256f80a tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:48.439738 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-81dd526d-6f85-49fe-b2a6-5ddfa256f80a tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:48.440431 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-81dd526d-6f85-49fe-b2a6-5ddfa256f80a tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:48.580277 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-ebfaac18-e11c-48d5-a1d9-18f3df2f5d4b tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e0e6ed148c4452b054ffbfc185cd2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3235f4d52e4b43728569e58f675cf922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:48.593090 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-ebfaac18-e11c-48d5-a1d9-18f3df2f5d4b tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] 10.222.0.43 "GET /compute/v2.1/servers/98ab602c-e2bc-4fa4-aafd-be3bd6b1589f" status: 200 len: 1323 microversion: 2.1 time: 0.610606 Oct 04 19:02:48.593730 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3005/5653] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:47 2022] GET /compute/v2.1/servers/98ab602c-e2bc-4fa4-aafd-be3bd6b1589f => generated 1323 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:02:48.747416 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-81dd526d-6f85-49fe-b2a6-5ddfa256f80a tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c997bc60473b43fd9fcf0c65111c44c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a711601b7a439caf395233de1febff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:48.762657 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-81dd526d-6f85-49fe-b2a6-5ddfa256f80a tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "GET /compute/v2.1/servers/3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff" status: 200 len: 1507 microversion: 2.1 time: 0.342658 Oct 04 19:02:48.763440 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2649/5654] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:48 2022] GET /compute/v2.1/servers/3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff => generated 1507 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:02:48.819758 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-0c37f062-3159-4358-9b7b-586a90d27ae8 req-f27743da-0830-47a2-b3ec-28ff27637087 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32f44032-85ec-43eb-b714-748a7f4f0b5b", "name": "network-vif-unplugged", "status": "completed", "tag": "d12de55b-02be-4f93-aca2-a6044af93e38"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:02:48.850060 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-0c37f062-3159-4358-9b7b-586a90d27ae8 req-f27743da-0830-47a2-b3ec-28ff27637087 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:48.851531 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-0c37f062-3159-4358-9b7b-586a90d27ae8 req-f27743da-0830-47a2-b3ec-28ff27637087 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:48.852342 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-0c37f062-3159-4358-9b7b-586a90d27ae8 req-f27743da-0830-47a2-b3ec-28ff27637087 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:48.872242 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-0c37f062-3159-4358-9b7b-586a90d27ae8 req-f27743da-0830-47a2-b3ec-28ff27637087 service nova] Creating event network-vif-unplugged:d12de55b-02be-4f93-aca2-a6044af93e38 for instance 32f44032-85ec-43eb-b714-748a7f4f0b5b on n-h2-851028-13 Oct 04 19:02:48.883291 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [req-0c37f062-3159-4358-9b7b-586a90d27ae8 req-f27743da-0830-47a2-b3ec-28ff27637087 service nova] Instance 32f44032-85ec-43eb-b714-748a7f4f0b5b is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851028-13', 'n-h2-851028-13'} {{(pid=123596) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 19:02:48.904905 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-0c37f062-3159-4358-9b7b-586a90d27ae8 req-f27743da-0830-47a2-b3ec-28ff27637087 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.094173 Oct 04 19:02:48.907545 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3006/5655] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:02:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:02:49.426390 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-2e36b540-98d2-4781-b6cf-b8ff1c8fe6b8 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:49.428140 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-2e36b540-98d2-4781-b6cf-b8ff1c8fe6b8 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] [instance: 32f44032-85ec-43eb-b714-748a7f4f0b5b] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:49.443920 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2e36b540-98d2-4781-b6cf-b8ff1c8fe6b8 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:49.445487 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2e36b540-98d2-4781-b6cf-b8ff1c8fe6b8 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:49.446460 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2e36b540-98d2-4781-b6cf-b8ff1c8fe6b8 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:49.447998 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2e36b540-98d2-4781-b6cf-b8ff1c8fe6b8 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:49.448846 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2e36b540-98d2-4781-b6cf-b8ff1c8fe6b8 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:49.449816 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2e36b540-98d2-4781-b6cf-b8ff1c8fe6b8 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:49.621195 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-a717b246-6942-4761-9aa0-542b2d5c5761 tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:49.622092 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-a717b246-6942-4761-9aa0-542b2d5c5761 tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] [instance: 98ab602c-e2bc-4fa4-aafd-be3bd6b1589f] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:49.636746 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=2 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:02:49.642949 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a717b246-6942-4761-9aa0-542b2d5c5761 tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:49.645017 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a717b246-6942-4761-9aa0-542b2d5c5761 tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:49.645728 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a717b246-6942-4761-9aa0-542b2d5c5761 tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:49.649385 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a717b246-6942-4761-9aa0-542b2d5c5761 tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:49.649885 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a717b246-6942-4761-9aa0-542b2d5c5761 tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:49.650345 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a717b246-6942-4761-9aa0-542b2d5c5761 tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:49.716059 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=6 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:02:49.748630 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-2e36b540-98d2-4781-b6cf-b8ff1c8fe6b8 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf87794979e844349d6ec6c6650565f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c25f1d17e94c74868357744e692487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:49.766443 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-2e36b540-98d2-4781-b6cf-b8ff1c8fe6b8 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] 10.222.0.43 "GET /compute/v2.1/servers/32f44032-85ec-43eb-b714-748a7f4f0b5b" status: 200 len: 1695 microversion: 2.1 time: 0.344644 Oct 04 19:02:49.768732 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2650/5656] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:49 2022] GET /compute/v2.1/servers/32f44032-85ec-43eb-b714-748a7f4f0b5b => generated 1695 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:02:49.799782 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-a21ddf6c-266a-47c0-80b8-5864300b8d5f tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:49.804840 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-a21ddf6c-266a-47c0-80b8-5864300b8d5f tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: 3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:49.837001 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a21ddf6c-266a-47c0-80b8-5864300b8d5f tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:49.841570 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a21ddf6c-266a-47c0-80b8-5864300b8d5f tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:49.842437 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a21ddf6c-266a-47c0-80b8-5864300b8d5f tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:49.843725 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a21ddf6c-266a-47c0-80b8-5864300b8d5f tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:49.845036 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a21ddf6c-266a-47c0-80b8-5864300b8d5f tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:49.847858 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a21ddf6c-266a-47c0-80b8-5864300b8d5f tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:49.938171 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-a717b246-6942-4761-9aa0-542b2d5c5761 tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e0e6ed148c4452b054ffbfc185cd2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3235f4d52e4b43728569e58f675cf922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:49.951928 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-a717b246-6942-4761-9aa0-542b2d5c5761 tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] 10.222.0.43 "GET /compute/v2.1/servers/98ab602c-e2bc-4fa4-aafd-be3bd6b1589f" status: 200 len: 1323 microversion: 2.1 time: 0.336792 Oct 04 19:02:49.953222 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3007/5657] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:49 2022] GET /compute/v2.1/servers/98ab602c-e2bc-4fa4-aafd-be3bd6b1589f => generated 1323 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:02:50.135423 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=2 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:02:50.263922 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-a21ddf6c-266a-47c0-80b8-5864300b8d5f tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c997bc60473b43fd9fcf0c65111c44c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a711601b7a439caf395233de1febff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:50.271785 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-a21ddf6c-266a-47c0-80b8-5864300b8d5f tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "GET /compute/v2.1/servers/3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff" status: 200 len: 1507 microversion: 2.1 time: 0.485853 Oct 04 19:02:50.276244 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2651/5658] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:49 2022] GET /compute/v2.1/servers/3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff => generated 1507 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:02:50.798010 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-ed5a07b7-87fb-433d-8f30-5b8b0c2e5ea0 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:50.800069 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-ed5a07b7-87fb-433d-8f30-5b8b0c2e5ea0 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] [instance: 32f44032-85ec-43eb-b714-748a7f4f0b5b] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:50.818871 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ed5a07b7-87fb-433d-8f30-5b8b0c2e5ea0 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:50.821386 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ed5a07b7-87fb-433d-8f30-5b8b0c2e5ea0 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:50.822865 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ed5a07b7-87fb-433d-8f30-5b8b0c2e5ea0 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:50.825943 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ed5a07b7-87fb-433d-8f30-5b8b0c2e5ea0 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:50.827643 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ed5a07b7-87fb-433d-8f30-5b8b0c2e5ea0 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:50.828321 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ed5a07b7-87fb-433d-8f30-5b8b0c2e5ea0 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:50.978502 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-06cc591f-31fa-4605-85b7-8d85a0bf5f03 tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:50.980181 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-06cc591f-31fa-4605-85b7-8d85a0bf5f03 tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] [instance: 98ab602c-e2bc-4fa4-aafd-be3bd6b1589f] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:51.004517 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-06cc591f-31fa-4605-85b7-8d85a0bf5f03 tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:51.009321 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-06cc591f-31fa-4605-85b7-8d85a0bf5f03 tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:51.010782 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-06cc591f-31fa-4605-85b7-8d85a0bf5f03 tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:51.011719 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-06cc591f-31fa-4605-85b7-8d85a0bf5f03 tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:51.019537 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-06cc591f-31fa-4605-85b7-8d85a0bf5f03 tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:51.022481 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-06cc591f-31fa-4605-85b7-8d85a0bf5f03 tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:51.238748 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-ed5a07b7-87fb-433d-8f30-5b8b0c2e5ea0 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf87794979e844349d6ec6c6650565f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c25f1d17e94c74868357744e692487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:51.255246 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-ed5a07b7-87fb-433d-8f30-5b8b0c2e5ea0 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] 10.222.0.43 "GET /compute/v2.1/servers/32f44032-85ec-43eb-b714-748a7f4f0b5b" status: 200 len: 1695 microversion: 2.1 time: 0.462075 Oct 04 19:02:51.262015 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3008/5659] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:50 2022] GET /compute/v2.1/servers/32f44032-85ec-43eb-b714-748a7f4f0b5b => generated 1695 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:02:51.336957 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-06cc591f-31fa-4605-85b7-8d85a0bf5f03 tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e0e6ed148c4452b054ffbfc185cd2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3235f4d52e4b43728569e58f675cf922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:51.341810 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=100 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:02:51.354113 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-06cc591f-31fa-4605-85b7-8d85a0bf5f03 tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] 10.222.0.43 "GET /compute/v2.1/servers/98ab602c-e2bc-4fa4-aafd-be3bd6b1589f" status: 200 len: 1323 microversion: 2.1 time: 0.378275 Oct 04 19:02:51.355501 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2652/5660] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:50 2022] GET /compute/v2.1/servers/98ab602c-e2bc-4fa4-aafd-be3bd6b1589f => generated 1323 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:02:51.360746 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-f2a16bfd-bebd-48fc-83d7-209bb4cc5ef4 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:51.362129 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-f2a16bfd-bebd-48fc-83d7-209bb4cc5ef4 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: 3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:51.371429 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f2a16bfd-bebd-48fc-83d7-209bb4cc5ef4 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:51.372256 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f2a16bfd-bebd-48fc-83d7-209bb4cc5ef4 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:51.372902 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f2a16bfd-bebd-48fc-83d7-209bb4cc5ef4 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:51.374443 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f2a16bfd-bebd-48fc-83d7-209bb4cc5ef4 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:51.375109 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f2a16bfd-bebd-48fc-83d7-209bb4cc5ef4 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:51.375879 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f2a16bfd-bebd-48fc-83d7-209bb4cc5ef4 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:51.592007 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-f2a16bfd-bebd-48fc-83d7-209bb4cc5ef4 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c997bc60473b43fd9fcf0c65111c44c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a711601b7a439caf395233de1febff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:51.601711 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-f2a16bfd-bebd-48fc-83d7-209bb4cc5ef4 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "GET /compute/v2.1/servers/3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff" status: 200 len: 1528 microversion: 2.1 time: 0.244969 Oct 04 19:02:51.605615 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2653/5661] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:51 2022] GET /compute/v2.1/servers/3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff => generated 1528 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:02:51.697804 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-64c465f4-fd41-45e7-b745-e70e2b130978 req-cb0878bb-f573-4967-b202-4d39e3a00801 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32f44032-85ec-43eb-b714-748a7f4f0b5b", "tag": "d12de55b-02be-4f93-aca2-a6044af93e38"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:02:51.723294 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-64c465f4-fd41-45e7-b745-e70e2b130978 req-cb0878bb-f573-4967-b202-4d39e3a00801 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:51.729817 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-64c465f4-fd41-45e7-b745-e70e2b130978 req-cb0878bb-f573-4967-b202-4d39e3a00801 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:51.730810 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-64c465f4-fd41-45e7-b745-e70e2b130978 req-cb0878bb-f573-4967-b202-4d39e3a00801 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:51.758472 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-64c465f4-fd41-45e7-b745-e70e2b130978 req-cb0878bb-f573-4967-b202-4d39e3a00801 service nova] Creating event network-changed:d12de55b-02be-4f93-aca2-a6044af93e38 for instance 32f44032-85ec-43eb-b714-748a7f4f0b5b on n-h2-851028-13 Oct 04 19:02:51.764861 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [req-64c465f4-fd41-45e7-b745-e70e2b130978 req-cb0878bb-f573-4967-b202-4d39e3a00801 service nova] Instance 32f44032-85ec-43eb-b714-748a7f4f0b5b is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851028-13', 'n-h2-851028-13'} {{(pid=123596) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 19:02:51.779453 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-64c465f4-fd41-45e7-b745-e70e2b130978 req-cb0878bb-f573-4967-b202-4d39e3a00801 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.515503 Oct 04 19:02:51.780058 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3009/5662] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:02:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:02:52.284295 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-70549719-0d68-4b59-b0d8-561502437243 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:52.285636 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-70549719-0d68-4b59-b0d8-561502437243 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] [instance: 32f44032-85ec-43eb-b714-748a7f4f0b5b] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:52.301502 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-70549719-0d68-4b59-b0d8-561502437243 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:52.302333 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-70549719-0d68-4b59-b0d8-561502437243 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:52.302985 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-70549719-0d68-4b59-b0d8-561502437243 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:52.304461 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-70549719-0d68-4b59-b0d8-561502437243 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:52.305403 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-70549719-0d68-4b59-b0d8-561502437243 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:52.306072 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-70549719-0d68-4b59-b0d8-561502437243 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:52.385236 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-631e6a8a-e8d5-4b36-b92b-358e865442c1 tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:52.386005 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-631e6a8a-e8d5-4b36-b92b-358e865442c1 tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] [instance: 98ab602c-e2bc-4fa4-aafd-be3bd6b1589f] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:52.399311 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-631e6a8a-e8d5-4b36-b92b-358e865442c1 tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:52.401989 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-631e6a8a-e8d5-4b36-b92b-358e865442c1 tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:52.406075 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-631e6a8a-e8d5-4b36-b92b-358e865442c1 tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:52.406939 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-631e6a8a-e8d5-4b36-b92b-358e865442c1 tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:52.407518 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-631e6a8a-e8d5-4b36-b92b-358e865442c1 tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:52.408196 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-631e6a8a-e8d5-4b36-b92b-358e865442c1 tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:52.671701 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-631e6a8a-e8d5-4b36-b92b-358e865442c1 tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e0e6ed148c4452b054ffbfc185cd2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3235f4d52e4b43728569e58f675cf922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:52.678328 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-70549719-0d68-4b59-b0d8-561502437243 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf87794979e844349d6ec6c6650565f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c25f1d17e94c74868357744e692487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:52.684035 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-631e6a8a-e8d5-4b36-b92b-358e865442c1 tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] 10.222.0.43 "GET /compute/v2.1/servers/98ab602c-e2bc-4fa4-aafd-be3bd6b1589f" status: 200 len: 1323 microversion: 2.1 time: 0.305515 Oct 04 19:02:52.684642 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3010/5663] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:52 2022] GET /compute/v2.1/servers/98ab602c-e2bc-4fa4-aafd-be3bd6b1589f => generated 1323 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:02:52.696570 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-70549719-0d68-4b59-b0d8-561502437243 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] 10.222.0.43 "GET /compute/v2.1/servers/32f44032-85ec-43eb-b714-748a7f4f0b5b" status: 200 len: 1693 microversion: 2.1 time: 0.416621 Oct 04 19:02:52.701561 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2654/5664] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:52 2022] GET /compute/v2.1/servers/32f44032-85ec-43eb-b714-748a7f4f0b5b => generated 1693 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:02:52.704627 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-83fb603a-0bc2-4e71-8674-1f40a17cc7e4 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:52.705506 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-83fb603a-0bc2-4e71-8674-1f40a17cc7e4 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: 3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:52.713213 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-83fb603a-0bc2-4e71-8674-1f40a17cc7e4 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:52.713724 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-83fb603a-0bc2-4e71-8674-1f40a17cc7e4 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:52.714362 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-83fb603a-0bc2-4e71-8674-1f40a17cc7e4 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:52.715265 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-83fb603a-0bc2-4e71-8674-1f40a17cc7e4 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:52.716245 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-83fb603a-0bc2-4e71-8674-1f40a17cc7e4 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:52.717472 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-83fb603a-0bc2-4e71-8674-1f40a17cc7e4 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:52.925579 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-b4783272-0b47-4687-9111-8e722b819689 req-aa959934-c310-4e1f-9b4e-7a6e48d82976 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98ab602c-e2bc-4fa4-aafd-be3bd6b1589f", "name": "network-vif-plugged", "status": "completed", "tag": "967cced9-22db-41a7-b033-401942fe77d8"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:02:52.951155 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-83fb603a-0bc2-4e71-8674-1f40a17cc7e4 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c997bc60473b43fd9fcf0c65111c44c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a711601b7a439caf395233de1febff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:52.953055 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-b4783272-0b47-4687-9111-8e722b819689 req-aa959934-c310-4e1f-9b4e-7a6e48d82976 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:52.953611 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-b4783272-0b47-4687-9111-8e722b819689 req-aa959934-c310-4e1f-9b4e-7a6e48d82976 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:52.959377 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-b4783272-0b47-4687-9111-8e722b819689 req-aa959934-c310-4e1f-9b4e-7a6e48d82976 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:52.964428 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-83fb603a-0bc2-4e71-8674-1f40a17cc7e4 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "GET /compute/v2.1/servers/3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff" status: 200 len: 1528 microversion: 2.1 time: 0.261606 Oct 04 19:02:52.971052 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3011/5665] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:52 2022] GET /compute/v2.1/servers/3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff => generated 1528 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:02:52.999465 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-b4783272-0b47-4687-9111-8e722b819689 req-aa959934-c310-4e1f-9b4e-7a6e48d82976 service nova] Creating event network-vif-plugged:967cced9-22db-41a7-b033-401942fe77d8 for instance 98ab602c-e2bc-4fa4-aafd-be3bd6b1589f on n-h2-851028-13 Oct 04 19:02:53.007866 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-b4783272-0b47-4687-9111-8e722b819689 req-aa959934-c310-4e1f-9b4e-7a6e48d82976 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086167 Oct 04 19:02:53.008691 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2655/5666] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:02:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:02:53.708357 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-0d6d649d-0bad-430a-ac54-2dc36e669edd tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:53.709052 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-0d6d649d-0bad-430a-ac54-2dc36e669edd tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] [instance: 98ab602c-e2bc-4fa4-aafd-be3bd6b1589f] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:53.717285 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0d6d649d-0bad-430a-ac54-2dc36e669edd tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:53.718259 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0d6d649d-0bad-430a-ac54-2dc36e669edd tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:53.718870 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0d6d649d-0bad-430a-ac54-2dc36e669edd tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:53.719952 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0d6d649d-0bad-430a-ac54-2dc36e669edd tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:53.721476 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0d6d649d-0bad-430a-ac54-2dc36e669edd tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:53.722677 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0d6d649d-0bad-430a-ac54-2dc36e669edd tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:53.730355 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-c6bd26a9-546b-4c6d-b7e0-1c627ff6c93b tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:53.731069 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-c6bd26a9-546b-4c6d-b7e0-1c627ff6c93b tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] [instance: 32f44032-85ec-43eb-b714-748a7f4f0b5b] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:53.749897 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c6bd26a9-546b-4c6d-b7e0-1c627ff6c93b tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:53.750654 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c6bd26a9-546b-4c6d-b7e0-1c627ff6c93b tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:53.751111 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c6bd26a9-546b-4c6d-b7e0-1c627ff6c93b tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:53.751831 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c6bd26a9-546b-4c6d-b7e0-1c627ff6c93b tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:53.752301 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c6bd26a9-546b-4c6d-b7e0-1c627ff6c93b tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:53.752734 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c6bd26a9-546b-4c6d-b7e0-1c627ff6c93b tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:54.126982 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-c6bd26a9-546b-4c6d-b7e0-1c627ff6c93b tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf87794979e844349d6ec6c6650565f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c25f1d17e94c74868357744e692487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:54.147856 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-c6bd26a9-546b-4c6d-b7e0-1c627ff6c93b tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] 10.222.0.43 "GET /compute/v2.1/servers/32f44032-85ec-43eb-b714-748a7f4f0b5b" status: 200 len: 1690 microversion: 2.1 time: 0.423434 Oct 04 19:02:54.148719 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2656/5667] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:53 2022] GET /compute/v2.1/servers/32f44032-85ec-43eb-b714-748a7f4f0b5b => generated 1690 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:02:54.153808 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-1084f997-60eb-49bc-afc3-fb8439816453 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:54.154614 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-1084f997-60eb-49bc-afc3-fb8439816453 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: 3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:54.160884 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1084f997-60eb-49bc-afc3-fb8439816453 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:54.161802 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1084f997-60eb-49bc-afc3-fb8439816453 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:54.164549 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1084f997-60eb-49bc-afc3-fb8439816453 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:54.165549 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1084f997-60eb-49bc-afc3-fb8439816453 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:54.166193 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1084f997-60eb-49bc-afc3-fb8439816453 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:54.166793 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1084f997-60eb-49bc-afc3-fb8439816453 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:54.212633 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-0d6d649d-0bad-430a-ac54-2dc36e669edd tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e0e6ed148c4452b054ffbfc185cd2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3235f4d52e4b43728569e58f675cf922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:54.220412 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-0d6d649d-0bad-430a-ac54-2dc36e669edd tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] 10.222.0.43 "GET /compute/v2.1/servers/98ab602c-e2bc-4fa4-aafd-be3bd6b1589f" status: 200 len: 1323 microversion: 2.1 time: 0.516253 Oct 04 19:02:54.233999 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3012/5668] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:53 2022] GET /compute/v2.1/servers/98ab602c-e2bc-4fa4-aafd-be3bd6b1589f => generated 1323 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:02:54.256314 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-39241b4a-e652-4af1-acf4-230d1dec5bcb tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:02:54.260327 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-39241b4a-e652-4af1-acf4-230d1dec5bcb tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] [instance: 32f44032-85ec-43eb-b714-748a7f4f0b5b] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:54.276995 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-39241b4a-e652-4af1-acf4-230d1dec5bcb tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:54.277562 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-39241b4a-e652-4af1-acf4-230d1dec5bcb tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:54.278232 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-39241b4a-e652-4af1-acf4-230d1dec5bcb tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:54.279151 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-39241b4a-e652-4af1-acf4-230d1dec5bcb tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:54.279626 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-39241b4a-e652-4af1-acf4-230d1dec5bcb tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:54.280074 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-39241b4a-e652-4af1-acf4-230d1dec5bcb tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:54.422445 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-39241b4a-e652-4af1-acf4-230d1dec5bcb tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] 10.222.0.43 "POST /compute/v2.1/servers/32f44032-85ec-43eb-b714-748a7f4f0b5b/action" status: 204 len: 0 microversion: 2.1 time: 0.175538 Oct 04 19:02:54.427474 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3013/5669] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 19:02:54 2022] POST /compute/v2.1/servers/32f44032-85ec-43eb-b714-748a7f4f0b5b/action => generated 0 bytes in 192 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:02:54.445010 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f3d1c044-6ccf-40e4-9d48-9714a2deaa4b tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:54.446852 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-f3d1c044-6ccf-40e4-9d48-9714a2deaa4b tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] [instance: 32f44032-85ec-43eb-b714-748a7f4f0b5b] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:54.463460 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f3d1c044-6ccf-40e4-9d48-9714a2deaa4b tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:54.466695 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f3d1c044-6ccf-40e4-9d48-9714a2deaa4b tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:54.469912 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f3d1c044-6ccf-40e4-9d48-9714a2deaa4b tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:54.471714 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f3d1c044-6ccf-40e4-9d48-9714a2deaa4b tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:54.474804 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f3d1c044-6ccf-40e4-9d48-9714a2deaa4b tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:54.476523 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f3d1c044-6ccf-40e4-9d48-9714a2deaa4b tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:54.523675 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:02:54.747942 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-1084f997-60eb-49bc-afc3-fb8439816453 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c997bc60473b43fd9fcf0c65111c44c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a711601b7a439caf395233de1febff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:54.783971 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-1084f997-60eb-49bc-afc3-fb8439816453 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "GET /compute/v2.1/servers/3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff" status: 200 len: 1523 microversion: 2.1 time: 0.633676 Oct 04 19:02:54.785220 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2657/5670] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:54 2022] GET /compute/v2.1/servers/3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff => generated 1523 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:02:54.992730 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-f3d1c044-6ccf-40e4-9d48-9714a2deaa4b tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf87794979e844349d6ec6c6650565f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c25f1d17e94c74868357744e692487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:55.010595 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-f3d1c044-6ccf-40e4-9d48-9714a2deaa4b tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] 10.222.0.43 "GET /compute/v2.1/servers/32f44032-85ec-43eb-b714-748a7f4f0b5b" status: 200 len: 1690 microversion: 2.1 time: 0.577321 Oct 04 19:02:55.013643 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3014/5671] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:54 2022] GET /compute/v2.1/servers/32f44032-85ec-43eb-b714-748a7f4f0b5b => generated 1690 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:02:55.145458 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-0c05af07-b180-41e7-8db2-f1bcae6db2ac req-160c34b1-3605-454c-bff5-720279d5c94c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff", "name": "network-vif-plugged", "status": "completed", "tag": "49a9f601-fe9e-4242-8553-215eee8014f3"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:02:55.176068 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-0c05af07-b180-41e7-8db2-f1bcae6db2ac req-160c34b1-3605-454c-bff5-720279d5c94c service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:55.176961 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-0c05af07-b180-41e7-8db2-f1bcae6db2ac req-160c34b1-3605-454c-bff5-720279d5c94c service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:55.179751 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-0c05af07-b180-41e7-8db2-f1bcae6db2ac req-160c34b1-3605-454c-bff5-720279d5c94c service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:55.219600 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-0c05af07-b180-41e7-8db2-f1bcae6db2ac req-160c34b1-3605-454c-bff5-720279d5c94c service nova] Creating event network-vif-plugged:49a9f601-fe9e-4242-8553-215eee8014f3 for instance 3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff on n-h2-851028-13 Oct 04 19:02:55.251197 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-85d7afc2-0911-403e-ae4b-5706e99b30d5 tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:55.252307 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-85d7afc2-0911-403e-ae4b-5706e99b30d5 tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] [instance: 98ab602c-e2bc-4fa4-aafd-be3bd6b1589f] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:55.258456 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-0c05af07-b180-41e7-8db2-f1bcae6db2ac req-160c34b1-3605-454c-bff5-720279d5c94c service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103899 Oct 04 19:02:55.261847 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2658/5672] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:02:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:02:55.266551 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-85d7afc2-0911-403e-ae4b-5706e99b30d5 tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:55.269141 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-85d7afc2-0911-403e-ae4b-5706e99b30d5 tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:55.269792 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-85d7afc2-0911-403e-ae4b-5706e99b30d5 tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:55.270836 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-85d7afc2-0911-403e-ae4b-5706e99b30d5 tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:55.273359 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-85d7afc2-0911-403e-ae4b-5706e99b30d5 tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:55.277861 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-85d7afc2-0911-403e-ae4b-5706e99b30d5 tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:55.635067 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-85d7afc2-0911-403e-ae4b-5706e99b30d5 tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e0e6ed148c4452b054ffbfc185cd2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3235f4d52e4b43728569e58f675cf922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:55.644039 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-85d7afc2-0911-403e-ae4b-5706e99b30d5 tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] 10.222.0.43 "GET /compute/v2.1/servers/98ab602c-e2bc-4fa4-aafd-be3bd6b1589f" status: 200 len: 1518 microversion: 2.1 time: 0.397458 Oct 04 19:02:55.648215 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3015/5673] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:55 2022] GET /compute/v2.1/servers/98ab602c-e2bc-4fa4-aafd-be3bd6b1589f => generated 1518 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:02:55.812698 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-ec61e7e4-fe26-438f-91c4-d18453e6ed7e tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:55.814074 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-ec61e7e4-fe26-438f-91c4-d18453e6ed7e tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: 3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:55.831031 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ec61e7e4-fe26-438f-91c4-d18453e6ed7e tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:55.843900 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ec61e7e4-fe26-438f-91c4-d18453e6ed7e tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:55.846659 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ec61e7e4-fe26-438f-91c4-d18453e6ed7e tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:55.848814 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ec61e7e4-fe26-438f-91c4-d18453e6ed7e tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:55.851012 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ec61e7e4-fe26-438f-91c4-d18453e6ed7e tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:55.860872 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ec61e7e4-fe26-438f-91c4-d18453e6ed7e tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:56.003785 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-dd65a6a3-780f-4403-9756-f0e6d8155c4d tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-2009278425", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "f0f6b25d-9f8f-4bc1-8d34-9d5925f245c2"}]}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:02:56.011969 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-dd65a6a3-780f-4403-9756-f0e6d8155c4d tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] Request method failure captured: Oct 04 19:02:56.011969 n-d-851028-13 devstack@n-api.service[123596]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 19:02:56.011969 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 19:02:56.011969 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 19:02:56.011969 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 19:02:56.011969 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 243 Oct 04 19:02:56.011969 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 19:02:56.011969 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 19:02:56.011969 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 19:02:56.011969 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 19:02:56.011969 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPINNC1yHkSUzzlXlApthXIJ06QPeUWE9iSk7VTHfjxXqB71RO8w-0kWRn9oAu6smRNi7q78rjdFwXJnWRs7IMYcgtz0y8wsWDxGxholQND4tJKewWgdRf_vhuAPoa0K8RpLBFUchLIK-sKJwmO9lYYVb17BDaeSNMBEa8EDTrZukweU Oct 04 19:02:56.011969 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 19:02:56.011969 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 19:02:56.011969 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 19:02:56.011969 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 19:02:56.011969 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 19:02:56.011969 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 19:02:56.011969 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: 3235f4d52e4b43728569e58f675cf922 Oct 04 19:02:56.011969 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-2071846802 Oct 04 19:02:56.011969 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 19:02:56.011969 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 19:02:56.011969 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/3235f4d52e4b43728569e58f675cf922"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_3235f4d52e4b43728569e58f675cf922"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/3235f4d52e4b43728569e58f675cf922"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/3235f4d52e4b43728569e58f675cf922"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 19:02:56.011969 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-2071846802 Oct 04 19:02:56.011969 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: 3235f4d52e4b43728569e58f675cf922 Oct 04 19:02:56.011969 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-2071846802 Oct 04 19:02:56.011969 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-ServerMetadataNegativeTestJSON-2071846802-project Oct 04 19:02:56.011969 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 19:02:56.011969 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 19:02:56.011969 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 82e0e6ed148c4452b054ffbfc185cd2a Oct 04 19:02:56.011969 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-2071846802-project Oct 04 19:02:56.011969 n-d-851028-13 devstack@n-api.service[123596]: Oct 04 19:02:56.011969 n-d-851028-13 devstack@n-api.service[123596]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-2009278425", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "f0f6b25d-9f8f-4bc1-8d34-9d5925f245c2"}]}} Oct 04 19:02:56.011969 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 19:02:56.011969 n-d-851028-13 devstack@n-api.service[123596]: exception: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 19:02:56.011969 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-2009278425', 'imageRef': 'e8943ec5-4038-4d4b-b9b9-2415a79f5243', 'flavorRef': '452', 'metadata': {'': 'data1'}, 'networks': [{'uuid': 'f0f6b25d-9f8f-4bc1-8d34-9d5925f245c2'}]}}} Oct 04 19:02:56.011969 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:02:56.011969 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:02:56.011969 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 19:02:56.011969 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 19:02:56.011969 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 19:02:56.011969 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise error Oct 04 19:02:56.011969 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 19:02:56.011969 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:02:56.011969 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 04 19:02:56.011969 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 04 19:02:56.011969 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 04 19:02:56.011969 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 04 19:02:56.011969 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 04 19:02:56.011969 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:02:56.011969 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 04 19:02:56.011969 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi {'': 'data1'} Oct 04 19:02:56.011969 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:02:56.011969 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:02:56.011969 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:02:56.011969 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:02:56.011969 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:02:56.011969 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:02:56.011969 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:02:56.011969 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:02:56.011969 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:02:56.011969 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:02:56.011969 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 19:02:56.016616 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 19:02:56.016616 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 19:02:56.016616 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 19:02:56.016616 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 19:02:56.016616 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 19:02:56.016616 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 19:02:56.016616 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 19:02:56.016616 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 19:02:56.016616 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:02:56.016616 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:02:56.016616 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:02:56.016616 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:02:56.016616 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:02:56.016616 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:02:56.016616 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 19:02:56.016616 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 19:02:56.016616 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 19:02:56.016616 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:02:56.016616 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-dd65a6a3-780f-4403-9756-f0e6d8155c4d tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:02:56.016616 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-dd65a6a3-780f-4403-9756-f0e6d8155c4d tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.016961 Oct 04 19:02:56.027218 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3016/5674] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 19:02:55 2022] POST /compute/v2.1/servers => generated 175 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 19:02:56.036544 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-fbe37482-d53b-41b6-bfad-4fa4ab38c2b3 tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:56.047859 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-fbe37482-d53b-41b6-bfad-4fa4ab38c2b3 tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] [instance: e4e4c5fd-4449-437a-8437-ead68328248d] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:56.078496 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-fbe37482-d53b-41b6-bfad-4fa4ab38c2b3 tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] HTTP exception thrown: Instance e4e4c5fd-4449-437a-8437-ead68328248d could not be found. Oct 04 19:02:56.093958 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-fbe37482-d53b-41b6-bfad-4fa4ab38c2b3 tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] Request method failure captured: Oct 04 19:02:56.093958 n-d-851028-13 devstack@n-api.service[123596]: request: GET /compute/v2.1/servers/e4e4c5fd-4449-437a-8437-ead68328248d/metadata HTTP/1.1 Oct 04 19:02:56.093958 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 19:02:56.093958 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 19:02:56.093958 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 19:02:56.093958 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 19:02:56.093958 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 19:02:56.093958 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 19:02:56.093958 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 19:02:56.093958 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 19:02:56.093958 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPINNC1yHkSUzzlXlApthXIJ06QPeUWE9iSk7VTHfjxXqB71RO8w-0kWRn9oAu6smRNi7q78rjdFwXJnWRs7IMYcgtz0y8wsWDxGxholQND4tJKewWgdRf_vhuAPoa0K8RpLBFUchLIK-sKJwmO9lYYVb17BDaeSNMBEa8EDTrZukweU Oct 04 19:02:56.093958 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 19:02:56.093958 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 19:02:56.093958 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 19:02:56.093958 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 19:02:56.093958 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 19:02:56.093958 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 19:02:56.093958 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: 3235f4d52e4b43728569e58f675cf922 Oct 04 19:02:56.093958 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-2071846802 Oct 04 19:02:56.093958 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 19:02:56.093958 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 19:02:56.093958 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/3235f4d52e4b43728569e58f675cf922"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_3235f4d52e4b43728569e58f675cf922"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/3235f4d52e4b43728569e58f675cf922"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/3235f4d52e4b43728569e58f675cf922"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 19:02:56.093958 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-2071846802 Oct 04 19:02:56.093958 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: 3235f4d52e4b43728569e58f675cf922 Oct 04 19:02:56.093958 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-2071846802 Oct 04 19:02:56.093958 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-ServerMetadataNegativeTestJSON-2071846802-project Oct 04 19:02:56.093958 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 19:02:56.093958 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 19:02:56.093958 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 82e0e6ed148c4452b054ffbfc185cd2a Oct 04 19:02:56.093958 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-2071846802-project Oct 04 19:02:56.093958 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 19:02:56.093958 n-d-851028-13 devstack@n-api.service[123596]: exception: Instance e4e4c5fd-4449-437a-8437-ead68328248d could not be found. Oct 04 19:02:56.093958 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'server_id': 'e4e4c5fd-4449-437a-8437-ead68328248d'} Oct 04 19:02:56.093958 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:02:56.093958 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:02:56.093958 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:02:56.093958 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:02:56.093958 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:02:56.093958 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:02:56.093958 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 19:02:56.093958 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 19:02:56.093958 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4e4c5fd-4449-437a-8437-ead68328248d could not be found. Oct 04 19:02:56.093958 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:02:56.093958 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:02:56.093958 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:02:56.093958 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:02:56.093958 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:02:56.093958 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:02:56.093958 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:02:56.093958 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:02:56.093958 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:02:56.093958 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:02:56.093958 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 54, in index Oct 04 19:02:56.093958 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Oct 04 19:02:56.093958 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:02:56.093958 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:02:56.093958 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4e4c5fd-4449-437a-8437-ead68328248d could not be found. Oct 04 19:02:56.093958 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:02:56.093958 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:02:56.093958 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:02:56.093958 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:02:56.093958 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:02:56.093958 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:02:56.098805 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:02:56.098805 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:02:56.098805 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4e4c5fd-4449-437a-8437-ead68328248d could not be found. Oct 04 19:02:56.098805 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:02:56.102669 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-fbe37482-d53b-41b6-bfad-4fa4ab38c2b3 tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] Returning 404 to user: Instance e4e4c5fd-4449-437a-8437-ead68328248d could not be found. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:02:56.104404 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-fbe37482-d53b-41b6-bfad-4fa4ab38c2b3 tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] 10.222.0.43 "GET /compute/v2.1/servers/e4e4c5fd-4449-437a-8437-ead68328248d/metadata" status: 404 len: 111 microversion: 2.1 time: 0.074139 Oct 04 19:02:56.119122 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3017/5675] 10.222.0.43 () {58 vars in 1263 bytes} [Tue Oct 4 19:02:56 2022] GET /compute/v2.1/servers/e4e4c5fd-4449-437a-8437-ead68328248d/metadata => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:02:56.129316 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-7e307e47-c71b-4519-a246-0adfa15958b1 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:56.132277 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-7e307e47-c71b-4519-a246-0adfa15958b1 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] [instance: 32f44032-85ec-43eb-b714-748a7f4f0b5b] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:56.145592 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7e307e47-c71b-4519-a246-0adfa15958b1 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:56.148158 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7e307e47-c71b-4519-a246-0adfa15958b1 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:56.148813 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7e307e47-c71b-4519-a246-0adfa15958b1 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:56.150411 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7e307e47-c71b-4519-a246-0adfa15958b1 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:56.152016 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7e307e47-c71b-4519-a246-0adfa15958b1 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:56.153832 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7e307e47-c71b-4519-a246-0adfa15958b1 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:56.623934 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-7e307e47-c71b-4519-a246-0adfa15958b1 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf87794979e844349d6ec6c6650565f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c25f1d17e94c74868357744e692487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:56.640021 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-7e307e47-c71b-4519-a246-0adfa15958b1 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] 10.222.0.43 "GET /compute/v2.1/servers/32f44032-85ec-43eb-b714-748a7f4f0b5b" status: 200 len: 1690 microversion: 2.1 time: 0.519414 Oct 04 19:02:56.646159 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3018/5676] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:56 2022] GET /compute/v2.1/servers/32f44032-85ec-43eb-b714-748a7f4f0b5b => generated 1690 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:02:56.661784 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-6fa51e5c-7bc9-46a4-b737-f093fb9b41c8 tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-509552352", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "f0f6b25d-9f8f-4bc1-8d34-9d5925f245c2"}]}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:02:56.677141 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-6fa51e5c-7bc9-46a4-b737-f093fb9b41c8 tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] Request method failure captured: Oct 04 19:02:56.677141 n-d-851028-13 devstack@n-api.service[123596]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 19:02:56.677141 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 19:02:56.677141 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 19:02:56.677141 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 19:02:56.677141 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 498 Oct 04 19:02:56.677141 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 19:02:56.677141 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 19:02:56.677141 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 19:02:56.677141 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 19:02:56.677141 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPINNC1yHkSUzzlXlApthXIJ06QPeUWE9iSk7VTHfjxXqB71RO8w-0kWRn9oAu6smRNi7q78rjdFwXJnWRs7IMYcgtz0y8wsWDxGxholQND4tJKewWgdRf_vhuAPoa0K8RpLBFUchLIK-sKJwmO9lYYVb17BDaeSNMBEa8EDTrZukweU Oct 04 19:02:56.677141 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 19:02:56.677141 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 19:02:56.677141 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 19:02:56.677141 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 19:02:56.677141 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 19:02:56.677141 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 19:02:56.677141 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: 3235f4d52e4b43728569e58f675cf922 Oct 04 19:02:56.677141 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-2071846802 Oct 04 19:02:56.677141 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 19:02:56.677141 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 19:02:56.677141 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/3235f4d52e4b43728569e58f675cf922"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_3235f4d52e4b43728569e58f675cf922"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/3235f4d52e4b43728569e58f675cf922"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/3235f4d52e4b43728569e58f675cf922"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 19:02:56.677141 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-2071846802 Oct 04 19:02:56.677141 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: 3235f4d52e4b43728569e58f675cf922 Oct 04 19:02:56.677141 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-2071846802 Oct 04 19:02:56.677141 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-ServerMetadataNegativeTestJSON-2071846802-project Oct 04 19:02:56.677141 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 19:02:56.677141 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 19:02:56.677141 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 82e0e6ed148c4452b054ffbfc185cd2a Oct 04 19:02:56.677141 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-2071846802-project Oct 04 19:02:56.677141 n-d-851028-13 devstack@n-api.service[123596]: Oct 04 19:02:56.677141 n-d-851028-13 devstack@n-api.service[123596]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-509552352", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "f0f6b25d-9f8f-4bc1-8d34-9d5925f245c2"}]}} Oct 04 19:02:56.677141 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 19:02:56.677141 n-d-851028-13 devstack@n-api.service[123596]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 19:02:56.677141 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-509552352', 'imageRef': 'e8943ec5-4038-4d4b-b9b9-2415a79f5243', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': 'f0f6b25d-9f8f-4bc1-8d34-9d5925f245c2'}]}}} Oct 04 19:02:56.677141 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:02:56.677141 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:02:56.677141 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 19:02:56.677141 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 19:02:56.677141 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 19:02:56.677141 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise error Oct 04 19:02:56.677141 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 19:02:56.677141 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:02:56.677141 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 04 19:02:56.677141 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 04 19:02:56.677141 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 04 19:02:56.677141 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 04 19:02:56.682633 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 04 19:02:56.682633 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:02:56.682633 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 04 19:02:56.682633 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 04 19:02:56.682633 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:02:56.682633 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:02:56.682633 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:02:56.682633 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:02:56.682633 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:02:56.682633 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:02:56.682633 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:02:56.682633 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:02:56.682633 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:02:56.682633 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:02:56.682633 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 19:02:56.682633 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 19:02:56.682633 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 19:02:56.682633 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 19:02:56.682633 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 19:02:56.682633 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 19:02:56.682633 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 19:02:56.682633 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 19:02:56.682633 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 19:02:56.682633 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:02:56.682633 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:02:56.682633 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:02:56.682633 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:02:56.682633 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:02:56.682633 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:02:56.682633 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 19:02:56.682633 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 19:02:56.682633 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 19:02:56.682633 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:02:56.694914 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-6fa51e5c-7bc9-46a4-b737-f093fb9b41c8 tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:02:56.700145 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-6fa51e5c-7bc9-46a4-b737-f093fb9b41c8 tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.050901 Oct 04 19:02:56.704110 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3019/5677] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 19:02:56 2022] POST /compute/v2.1/servers => generated 687 bytes in 56 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 19:02:56.721257 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-ec61e7e4-fe26-438f-91c4-d18453e6ed7e tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c997bc60473b43fd9fcf0c65111c44c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a711601b7a439caf395233de1febff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:56.754013 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-ec61e7e4-fe26-438f-91c4-d18453e6ed7e tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "GET /compute/v2.1/servers/3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff" status: 200 len: 1523 microversion: 2.1 time: 0.931316 Oct 04 19:02:56.756559 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2659/5678] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:55 2022] GET /compute/v2.1/servers/3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff => generated 1523 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:02:56.826285 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-cca3da61-74a9-40e0-a69f-fdb7d6bb6ae0 tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1906008531", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "f0f6b25d-9f8f-4bc1-8d34-9d5925f245c2"}]}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:02:56.833918 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-cca3da61-74a9-40e0-a69f-fdb7d6bb6ae0 tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] Request method failure captured: Oct 04 19:02:56.833918 n-d-851028-13 devstack@n-api.service[123596]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 19:02:56.833918 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 19:02:56.833918 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 19:02:56.833918 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 19:02:56.833918 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 500 Oct 04 19:02:56.833918 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 19:02:56.833918 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 19:02:56.833918 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 19:02:56.833918 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 19:02:56.833918 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPINNC1yHkSUzzlXlApthXIJ06QPeUWE9iSk7VTHfjxXqB71RO8w-0kWRn9oAu6smRNi7q78rjdFwXJnWRs7IMYcgtz0y8wsWDxGxholQND4tJKewWgdRf_vhuAPoa0K8RpLBFUchLIK-sKJwmO9lYYVb17BDaeSNMBEa8EDTrZukweU Oct 04 19:02:56.833918 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 19:02:56.833918 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 19:02:56.833918 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 19:02:56.833918 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 19:02:56.833918 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 19:02:56.833918 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 19:02:56.833918 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: 3235f4d52e4b43728569e58f675cf922 Oct 04 19:02:56.833918 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-2071846802 Oct 04 19:02:56.833918 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 19:02:56.833918 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 19:02:56.833918 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/3235f4d52e4b43728569e58f675cf922"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_3235f4d52e4b43728569e58f675cf922"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/3235f4d52e4b43728569e58f675cf922"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/3235f4d52e4b43728569e58f675cf922"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 19:02:56.833918 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-2071846802 Oct 04 19:02:56.833918 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: 3235f4d52e4b43728569e58f675cf922 Oct 04 19:02:56.833918 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-2071846802 Oct 04 19:02:56.833918 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-ServerMetadataNegativeTestJSON-2071846802-project Oct 04 19:02:56.833918 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 19:02:56.833918 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 19:02:56.833918 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 82e0e6ed148c4452b054ffbfc185cd2a Oct 04 19:02:56.833918 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-2071846802-project Oct 04 19:02:56.833918 n-d-851028-13 devstack@n-api.service[123596]: Oct 04 19:02:56.833918 n-d-851028-13 devstack@n-api.service[123596]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1906008531", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "f0f6b25d-9f8f-4bc1-8d34-9d5925f245c2"}]}} Oct 04 19:02:56.833918 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 19:02:56.833918 n-d-851028-13 devstack@n-api.service[123596]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 19:02:56.833918 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1906008531', 'imageRef': 'e8943ec5-4038-4d4b-b9b9-2415a79f5243', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': 'f0f6b25d-9f8f-4bc1-8d34-9d5925f245c2'}]}}} Oct 04 19:02:56.833918 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:02:56.833918 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:02:56.833918 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 19:02:56.833918 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 19:02:56.833918 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 19:02:56.833918 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise error Oct 04 19:02:56.833918 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 19:02:56.833918 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:02:56.833918 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 04 19:02:56.833918 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 04 19:02:56.833918 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 04 19:02:56.833918 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 04 19:02:56.837480 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 04 19:02:56.837480 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:02:56.837480 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 04 19:02:56.837480 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 04 19:02:56.837480 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:02:56.837480 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:02:56.837480 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:02:56.837480 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:02:56.837480 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:02:56.837480 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:02:56.837480 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:02:56.837480 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:02:56.837480 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:02:56.837480 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:02:56.837480 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 19:02:56.837480 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 19:02:56.837480 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 19:02:56.837480 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 19:02:56.837480 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 19:02:56.837480 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 19:02:56.837480 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 19:02:56.837480 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 19:02:56.837480 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 19:02:56.837480 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:02:56.837480 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:02:56.837480 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:02:56.837480 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:02:56.837480 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:02:56.837480 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:02:56.837480 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 19:02:56.837480 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 19:02:56.837480 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 19:02:56.837480 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:02:56.847843 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-cca3da61-74a9-40e0-a69f-fdb7d6bb6ae0 tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:02:56.852119 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-cca3da61-74a9-40e0-a69f-fdb7d6bb6ae0 tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.030196 Oct 04 19:02:56.869795 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3020/5679] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 19:02:56 2022] POST /compute/v2.1/servers => generated 689 bytes in 48 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 19:02:56.939687 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-b21f4200-5523-4aba-a3fb-fe27ee5294d1 tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-206630375", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "f0f6b25d-9f8f-4bc1-8d34-9d5925f245c2"}]}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:02:56.946874 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-b21f4200-5523-4aba-a3fb-fe27ee5294d1 tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] Request method failure captured: Oct 04 19:02:56.946874 n-d-851028-13 devstack@n-api.service[123595]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 19:02:56.946874 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 19:02:56.946874 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 19:02:56.946874 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 19:02:56.946874 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 753 Oct 04 19:02:56.946874 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 19:02:56.946874 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 19:02:56.946874 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 19:02:56.946874 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 19:02:56.946874 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPINNC1yHkSUzzlXlApthXIJ06QPeUWE9iSk7VTHfjxXqB71RO8w-0kWRn9oAu6smRNi7q78rjdFwXJnWRs7IMYcgtz0y8wsWDxGxholQND4tJKewWgdRf_vhuAPoa0K8RpLBFUchLIK-sKJwmO9lYYVb17BDaeSNMBEa8EDTrZukweU Oct 04 19:02:56.946874 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 19:02:56.946874 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 19:02:56.946874 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 19:02:56.946874 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 19:02:56.946874 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 19:02:56.946874 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 19:02:56.946874 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: 3235f4d52e4b43728569e58f675cf922 Oct 04 19:02:56.946874 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-2071846802 Oct 04 19:02:56.946874 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 19:02:56.946874 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 19:02:56.946874 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/3235f4d52e4b43728569e58f675cf922"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_3235f4d52e4b43728569e58f675cf922"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/3235f4d52e4b43728569e58f675cf922"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/3235f4d52e4b43728569e58f675cf922"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 19:02:56.946874 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-2071846802 Oct 04 19:02:56.946874 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: 3235f4d52e4b43728569e58f675cf922 Oct 04 19:02:56.946874 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-2071846802 Oct 04 19:02:56.946874 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-ServerMetadataNegativeTestJSON-2071846802-project Oct 04 19:02:56.946874 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 19:02:56.946874 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 19:02:56.946874 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: 82e0e6ed148c4452b054ffbfc185cd2a Oct 04 19:02:56.946874 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-2071846802-project Oct 04 19:02:56.946874 n-d-851028-13 devstack@n-api.service[123595]: Oct 04 19:02:56.946874 n-d-851028-13 devstack@n-api.service[123595]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-206630375", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "f0f6b25d-9f8f-4bc1-8d34-9d5925f245c2"}]}} Oct 04 19:02:56.946874 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 19:02:56.946874 n-d-851028-13 devstack@n-api.service[123595]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 19:02:56.946874 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-206630375', 'imageRef': 'e8943ec5-4038-4d4b-b9b9-2415a79f5243', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': 'f0f6b25d-9f8f-4bc1-8d34-9d5925f245c2'}]}}} Oct 04 19:02:56.946874 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:02:56.946874 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:02:56.946874 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 19:02:56.946874 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 19:02:56.946874 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 19:02:56.950134 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise error Oct 04 19:02:56.950134 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 19:02:56.950134 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:02:56.950134 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 04 19:02:56.950134 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 04 19:02:56.950134 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 04 19:02:56.950134 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 04 19:02:56.950134 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 04 19:02:56.950134 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:02:56.950134 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 04 19:02:56.950134 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 04 19:02:56.950134 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:02:56.950134 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:02:56.950134 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:02:56.950134 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:02:56.950134 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:02:56.950134 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:02:56.950134 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:02:56.950134 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:02:56.950134 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:02:56.950134 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:02:56.950134 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 19:02:56.950134 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 19:02:56.950134 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 19:02:56.950134 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 19:02:56.950134 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 19:02:56.950134 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 19:02:56.950134 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 19:02:56.950134 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 19:02:56.950134 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 19:02:56.950134 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:02:56.950134 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:02:56.950134 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:02:56.950134 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:02:56.950134 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:02:56.950134 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:02:56.950134 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 19:02:56.950134 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 19:02:56.956469 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 19:02:56.956469 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:02:56.956469 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-b21f4200-5523-4aba-a3fb-fe27ee5294d1 tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:02:56.956469 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-b21f4200-5523-4aba-a3fb-fe27ee5294d1 tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.012733 Oct 04 19:02:56.979637 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2660/5680] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 19:02:56 2022] POST /compute/v2.1/servers => generated 1197 bytes in 45 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Oct 04 19:02:57.034558 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-fcd2eeda-4476-42dd-9475-ceb98781eed7 tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-412596642", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "f0f6b25d-9f8f-4bc1-8d34-9d5925f245c2"}]}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:02:57.041994 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-fcd2eeda-4476-42dd-9475-ceb98781eed7 tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] Request method failure captured: Oct 04 19:02:57.041994 n-d-851028-13 devstack@n-api.service[123596]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 19:02:57.041994 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 19:02:57.041994 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 19:02:57.041994 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 19:02:57.041994 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 1265 Oct 04 19:02:57.041994 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 19:02:57.041994 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 19:02:57.041994 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 19:02:57.041994 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 19:02:57.041994 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPINNC1yHkSUzzlXlApthXIJ06QPeUWE9iSk7VTHfjxXqB71RO8w-0kWRn9oAu6smRNi7q78rjdFwXJnWRs7IMYcgtz0y8wsWDxGxholQND4tJKewWgdRf_vhuAPoa0K8RpLBFUchLIK-sKJwmO9lYYVb17BDaeSNMBEa8EDTrZukweU Oct 04 19:02:57.041994 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 19:02:57.041994 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 19:02:57.041994 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 19:02:57.041994 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 19:02:57.041994 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 19:02:57.041994 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 19:02:57.041994 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: 3235f4d52e4b43728569e58f675cf922 Oct 04 19:02:57.041994 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-2071846802 Oct 04 19:02:57.041994 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 19:02:57.041994 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 19:02:57.041994 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/3235f4d52e4b43728569e58f675cf922"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_3235f4d52e4b43728569e58f675cf922"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/3235f4d52e4b43728569e58f675cf922"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/3235f4d52e4b43728569e58f675cf922"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 19:02:57.041994 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-2071846802 Oct 04 19:02:57.041994 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: 3235f4d52e4b43728569e58f675cf922 Oct 04 19:02:57.041994 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-2071846802 Oct 04 19:02:57.041994 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-ServerMetadataNegativeTestJSON-2071846802-project Oct 04 19:02:57.041994 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 19:02:57.041994 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 19:02:57.041994 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 82e0e6ed148c4452b054ffbfc185cd2a Oct 04 19:02:57.041994 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-2071846802-project Oct 04 19:02:57.041994 n-d-851028-13 devstack@n-api.service[123596]: Oct 04 19:02:57.041994 n-d-851028-13 devstack@n-api.service[123596]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-412596642", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "f0f6b25d-9f8f-4bc1-8d34-9d5925f245c2"}]}} Oct 04 19:02:57.041994 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 19:02:57.044204 n-d-851028-13 devstack@n-api.service[123596]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 19:02:57.044204 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-412596642', 'imageRef': 'e8943ec5-4038-4d4b-b9b9-2415a79f5243', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': 'f0f6b25d-9f8f-4bc1-8d34-9d5925f245c2'}]}}} Oct 04 19:02:57.044204 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:02:57.044204 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:02:57.044204 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 19:02:57.044204 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 19:02:57.044204 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 19:02:57.044204 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise error Oct 04 19:02:57.044204 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 19:02:57.044204 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:02:57.044204 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 04 19:02:57.044204 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 04 19:02:57.044204 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 04 19:02:57.044204 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 04 19:02:57.044204 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 04 19:02:57.044204 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:02:57.044204 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 04 19:02:57.045732 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 04 19:02:57.045732 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:02:57.045732 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:02:57.045732 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:02:57.045732 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:02:57.045732 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:02:57.045732 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:02:57.045732 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:02:57.045732 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:02:57.045732 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:02:57.045732 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:02:57.045732 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 19:02:57.045732 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 19:02:57.045732 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 19:02:57.045732 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 19:02:57.045732 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 19:02:57.045732 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 19:02:57.045732 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 19:02:57.045732 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 19:02:57.045732 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 19:02:57.045732 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:02:57.045732 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:02:57.045732 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:02:57.045732 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:02:57.045732 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:02:57.045732 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:02:57.045732 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 19:02:57.045732 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 19:02:57.047934 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 19:02:57.047934 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:02:57.057248 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-fcd2eeda-4476-42dd-9475-ceb98781eed7 tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:02:57.058765 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-fcd2eeda-4476-42dd-9475-ceb98781eed7 tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.029301 Oct 04 19:02:57.068771 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3021/5681] 10.222.0.43 () {60 vars in 1148 bytes} [Tue Oct 4 19:02:57 2022] POST /compute/v2.1/servers => generated 2221 bytes in 40 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Oct 04 19:02:57.076305 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-0067151a-50d9-4ceb-9650-744e0aecc058 tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:57.077484 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-0067151a-50d9-4ceb-9650-744e0aecc058 tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] [instance: 2ee86b00-eb4c-43b2-813a-6617dcd5cc25] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:57.089608 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-0067151a-50d9-4ceb-9650-744e0aecc058 tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] HTTP exception thrown: Instance 2ee86b00-eb4c-43b2-813a-6617dcd5cc25 could not be found. Oct 04 19:02:57.091831 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-0067151a-50d9-4ceb-9650-744e0aecc058 tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] Request method failure captured: Oct 04 19:02:57.091831 n-d-851028-13 devstack@n-api.service[123595]: request: GET /compute/v2.1/servers/2ee86b00-eb4c-43b2-813a-6617dcd5cc25/metadata/test2 HTTP/1.1 Oct 04 19:02:57.091831 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 19:02:57.091831 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 19:02:57.091831 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 19:02:57.091831 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 0 Oct 04 19:02:57.091831 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 19:02:57.091831 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 19:02:57.091831 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 19:02:57.091831 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 19:02:57.091831 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPINNC1yHkSUzzlXlApthXIJ06QPeUWE9iSk7VTHfjxXqB71RO8w-0kWRn9oAu6smRNi7q78rjdFwXJnWRs7IMYcgtz0y8wsWDxGxholQND4tJKewWgdRf_vhuAPoa0K8RpLBFUchLIK-sKJwmO9lYYVb17BDaeSNMBEa8EDTrZukweU Oct 04 19:02:57.091831 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 19:02:57.091831 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 19:02:57.091831 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 19:02:57.091831 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 19:02:57.091831 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 19:02:57.091831 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 19:02:57.091831 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: 3235f4d52e4b43728569e58f675cf922 Oct 04 19:02:57.091831 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-2071846802 Oct 04 19:02:57.091831 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 19:02:57.091831 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 19:02:57.091831 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/3235f4d52e4b43728569e58f675cf922"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_3235f4d52e4b43728569e58f675cf922"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/3235f4d52e4b43728569e58f675cf922"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/3235f4d52e4b43728569e58f675cf922"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 19:02:57.091831 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-2071846802 Oct 04 19:02:57.091831 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: 3235f4d52e4b43728569e58f675cf922 Oct 04 19:02:57.091831 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-2071846802 Oct 04 19:02:57.091831 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-ServerMetadataNegativeTestJSON-2071846802-project Oct 04 19:02:57.091831 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 19:02:57.091831 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 19:02:57.091831 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: 82e0e6ed148c4452b054ffbfc185cd2a Oct 04 19:02:57.091831 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-2071846802-project Oct 04 19:02:57.091831 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 19:02:57.091831 n-d-851028-13 devstack@n-api.service[123595]: exception: Instance 2ee86b00-eb4c-43b2-813a-6617dcd5cc25 could not be found. Oct 04 19:02:57.091831 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'server_id': '2ee86b00-eb4c-43b2-813a-6617dcd5cc25', 'id': 'test2'} Oct 04 19:02:57.091831 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:02:57.091831 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:02:57.091831 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:02:57.091831 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:02:57.091831 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:02:57.091831 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:02:57.091831 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 19:02:57.091831 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 19:02:57.091831 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ee86b00-eb4c-43b2-813a-6617dcd5cc25 could not be found. Oct 04 19:02:57.091831 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:02:57.091831 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:02:57.091831 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:02:57.091831 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:02:57.091831 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:02:57.091831 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:02:57.091831 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:02:57.091831 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:02:57.091831 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:02:57.091831 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:02:57.091831 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 129, in show Oct 04 19:02:57.091831 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Oct 04 19:02:57.091831 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:02:57.091831 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:02:57.091831 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ee86b00-eb4c-43b2-813a-6617dcd5cc25 could not be found. Oct 04 19:02:57.091831 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:02:57.091831 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:02:57.091831 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:02:57.091831 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:02:57.091831 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:02:57.091831 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:02:57.097603 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:02:57.097603 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:02:57.097603 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ee86b00-eb4c-43b2-813a-6617dcd5cc25 could not be found. Oct 04 19:02:57.097603 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:02:57.099551 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-0067151a-50d9-4ceb-9650-744e0aecc058 tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] Returning 404 to user: Instance 2ee86b00-eb4c-43b2-813a-6617dcd5cc25 could not be found. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:02:57.100674 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-0067151a-50d9-4ceb-9650-744e0aecc058 tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] 10.222.0.43 "GET /compute/v2.1/servers/2ee86b00-eb4c-43b2-813a-6617dcd5cc25/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.030100 Oct 04 19:02:57.101838 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2661/5682] 10.222.0.43 () {58 vars in 1281 bytes} [Tue Oct 4 19:02:57 2022] GET /compute/v2.1/servers/2ee86b00-eb4c-43b2-813a-6617dcd5cc25/metadata/test2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:02:57.119890 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-aed36678-0666-48d1-9fd7-e75c886484d2 tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:57.121100 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-aed36678-0666-48d1-9fd7-e75c886484d2 tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] [instance: 98ab602c-e2bc-4fa4-aafd-be3bd6b1589f] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:57.128555 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-aed36678-0666-48d1-9fd7-e75c886484d2 tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:57.129363 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-aed36678-0666-48d1-9fd7-e75c886484d2 tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:57.130015 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-aed36678-0666-48d1-9fd7-e75c886484d2 tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:57.131174 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-aed36678-0666-48d1-9fd7-e75c886484d2 tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:57.132351 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-aed36678-0666-48d1-9fd7-e75c886484d2 tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:57.132953 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-aed36678-0666-48d1-9fd7-e75c886484d2 tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:57.209432 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-aed36678-0666-48d1-9fd7-e75c886484d2 tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] [instance: 98ab602c-e2bc-4fa4-aafd-be3bd6b1589f] Going to try to terminate instance {{(pid=123596) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 19:02:57.456528 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-aed36678-0666-48d1-9fd7-e75c886484d2 tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] 10.222.0.43 "DELETE /compute/v2.1/servers/98ab602c-e2bc-4fa4-aafd-be3bd6b1589f" status: 204 len: 0 microversion: 2.1 time: 0.344750 Oct 04 19:02:57.457762 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3022/5683] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 19:02:57 2022] DELETE /compute/v2.1/servers/98ab602c-e2bc-4fa4-aafd-be3bd6b1589f => generated 0 bytes in 347 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:02:57.467981 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-2dee258d-0f99-4cd0-a6ec-99735c80219c tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:57.469489 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-2dee258d-0f99-4cd0-a6ec-99735c80219c tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] [instance: 98ab602c-e2bc-4fa4-aafd-be3bd6b1589f] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:57.479625 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2dee258d-0f99-4cd0-a6ec-99735c80219c tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:57.480485 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2dee258d-0f99-4cd0-a6ec-99735c80219c tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:57.481138 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2dee258d-0f99-4cd0-a6ec-99735c80219c tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:57.482054 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2dee258d-0f99-4cd0-a6ec-99735c80219c tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:57.482732 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2dee258d-0f99-4cd0-a6ec-99735c80219c tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:57.483330 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2dee258d-0f99-4cd0-a6ec-99735c80219c tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:57.678539 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-1496971a-fd73-4a5d-a3de-7db4e0b9bc0f tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:57.679768 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-1496971a-fd73-4a5d-a3de-7db4e0b9bc0f tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] [instance: 32f44032-85ec-43eb-b714-748a7f4f0b5b] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:57.699472 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1496971a-fd73-4a5d-a3de-7db4e0b9bc0f tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:57.705843 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1496971a-fd73-4a5d-a3de-7db4e0b9bc0f tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:57.706531 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1496971a-fd73-4a5d-a3de-7db4e0b9bc0f tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:57.707583 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1496971a-fd73-4a5d-a3de-7db4e0b9bc0f tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:57.708226 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1496971a-fd73-4a5d-a3de-7db4e0b9bc0f tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:57.708852 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1496971a-fd73-4a5d-a3de-7db4e0b9bc0f tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:58.054950 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-1496971a-fd73-4a5d-a3de-7db4e0b9bc0f tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf87794979e844349d6ec6c6650565f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c25f1d17e94c74868357744e692487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:58.073975 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-1496971a-fd73-4a5d-a3de-7db4e0b9bc0f tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] 10.222.0.43 "GET /compute/v2.1/servers/32f44032-85ec-43eb-b714-748a7f4f0b5b" status: 200 len: 1682 microversion: 2.1 time: 0.409084 Oct 04 19:02:58.075186 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3023/5684] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:57 2022] GET /compute/v2.1/servers/32f44032-85ec-43eb-b714-748a7f4f0b5b => generated 1682 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:02:58.081900 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-8374db3d-ade7-4f1d-b8ec-a282fbbac6af tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:58.082748 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-8374db3d-ade7-4f1d-b8ec-a282fbbac6af tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: 3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:58.095454 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8374db3d-ade7-4f1d-b8ec-a282fbbac6af tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:58.096432 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8374db3d-ade7-4f1d-b8ec-a282fbbac6af tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:58.097642 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8374db3d-ade7-4f1d-b8ec-a282fbbac6af tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:58.098835 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8374db3d-ade7-4f1d-b8ec-a282fbbac6af tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:58.099485 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8374db3d-ade7-4f1d-b8ec-a282fbbac6af tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:58.100123 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8374db3d-ade7-4f1d-b8ec-a282fbbac6af tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:58.176772 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-2dee258d-0f99-4cd0-a6ec-99735c80219c tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e0e6ed148c4452b054ffbfc185cd2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3235f4d52e4b43728569e58f675cf922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:58.190290 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-2dee258d-0f99-4cd0-a6ec-99735c80219c tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] 10.222.0.43 "GET /compute/v2.1/servers/98ab602c-e2bc-4fa4-aafd-be3bd6b1589f" status: 200 len: 1524 microversion: 2.1 time: 0.727601 Oct 04 19:02:58.205140 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2662/5685] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:57 2022] GET /compute/v2.1/servers/98ab602c-e2bc-4fa4-aafd-be3bd6b1589f => generated 1524 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:02:58.404542 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-8374db3d-ade7-4f1d-b8ec-a282fbbac6af tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c997bc60473b43fd9fcf0c65111c44c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a711601b7a439caf395233de1febff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:58.419842 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-8374db3d-ade7-4f1d-b8ec-a282fbbac6af tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "GET /compute/v2.1/servers/3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff" status: 200 len: 1523 microversion: 2.1 time: 0.342745 Oct 04 19:02:58.422068 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3024/5686] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:58 2022] GET /compute/v2.1/servers/3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff => generated 1523 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:02:58.575118 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-b856dc9b-4c69-4be0-89b6-c48db8d5afb1 req-07aa5fba-0f8c-45a9-9a48-1f8be36f3bf8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32f44032-85ec-43eb-b714-748a7f4f0b5b", "name": "network-vif-plugged", "status": "completed", "tag": "d12de55b-02be-4f93-aca2-a6044af93e38"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:02:58.606855 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-b856dc9b-4c69-4be0-89b6-c48db8d5afb1 req-07aa5fba-0f8c-45a9-9a48-1f8be36f3bf8 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:58.607352 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-b856dc9b-4c69-4be0-89b6-c48db8d5afb1 req-07aa5fba-0f8c-45a9-9a48-1f8be36f3bf8 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:58.607796 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-b856dc9b-4c69-4be0-89b6-c48db8d5afb1 req-07aa5fba-0f8c-45a9-9a48-1f8be36f3bf8 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:58.651281 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-b856dc9b-4c69-4be0-89b6-c48db8d5afb1 req-07aa5fba-0f8c-45a9-9a48-1f8be36f3bf8 service nova] Creating event network-vif-plugged:d12de55b-02be-4f93-aca2-a6044af93e38 for instance 32f44032-85ec-43eb-b714-748a7f4f0b5b on n-h2-851028-13 Oct 04 19:02:58.670948 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-b856dc9b-4c69-4be0-89b6-c48db8d5afb1 req-07aa5fba-0f8c-45a9-9a48-1f8be36f3bf8 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100269 Oct 04 19:02:58.674985 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2663/5687] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:02:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:02:59.219758 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-18efc8c8-5e5a-4d8f-9725-6d927877786f tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:59.221205 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-18efc8c8-5e5a-4d8f-9725-6d927877786f tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] [instance: 98ab602c-e2bc-4fa4-aafd-be3bd6b1589f] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:59.237243 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:02:59.244164 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-18efc8c8-5e5a-4d8f-9725-6d927877786f tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:59.248414 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-18efc8c8-5e5a-4d8f-9725-6d927877786f tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:59.250620 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-18efc8c8-5e5a-4d8f-9725-6d927877786f tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:59.252035 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-18efc8c8-5e5a-4d8f-9725-6d927877786f tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:59.257652 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-18efc8c8-5e5a-4d8f-9725-6d927877786f tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:59.258752 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-18efc8c8-5e5a-4d8f-9725-6d927877786f tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:59.447693 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-916e8a07-3f33-4133-8c90-f8adf34e9f73 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:59.448670 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-916e8a07-3f33-4133-8c90-f8adf34e9f73 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: 3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:59.463120 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-916e8a07-3f33-4133-8c90-f8adf34e9f73 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:59.463944 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-916e8a07-3f33-4133-8c90-f8adf34e9f73 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:59.465225 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-916e8a07-3f33-4133-8c90-f8adf34e9f73 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:59.466141 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-916e8a07-3f33-4133-8c90-f8adf34e9f73 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:59.466775 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-916e8a07-3f33-4133-8c90-f8adf34e9f73 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:59.467399 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-916e8a07-3f33-4133-8c90-f8adf34e9f73 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:59.650829 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-18efc8c8-5e5a-4d8f-9725-6d927877786f tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e0e6ed148c4452b054ffbfc185cd2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3235f4d52e4b43728569e58f675cf922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:59.665748 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-18efc8c8-5e5a-4d8f-9725-6d927877786f tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] 10.222.0.43 "GET /compute/v2.1/servers/98ab602c-e2bc-4fa4-aafd-be3bd6b1589f" status: 200 len: 1524 microversion: 2.1 time: 0.452394 Oct 04 19:02:59.688458 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3025/5688] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:59 2022] GET /compute/v2.1/servers/98ab602c-e2bc-4fa4-aafd-be3bd6b1589f => generated 1524 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:03:00.340795 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-916e8a07-3f33-4133-8c90-f8adf34e9f73 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c997bc60473b43fd9fcf0c65111c44c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a711601b7a439caf395233de1febff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:00.371642 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-916e8a07-3f33-4133-8c90-f8adf34e9f73 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "GET /compute/v2.1/servers/3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff" status: 200 len: 1523 microversion: 2.1 time: 0.929379 Oct 04 19:03:00.372316 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2664/5689] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:59 2022] GET /compute/v2.1/servers/3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff => generated 1523 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:03:00.705082 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-93ae8737-a2a6-4795-8b70-fad93c8decd7 tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:00.707060 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-93ae8737-a2a6-4795-8b70-fad93c8decd7 tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] [instance: 98ab602c-e2bc-4fa4-aafd-be3bd6b1589f] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:00.736834 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-93ae8737-a2a6-4795-8b70-fad93c8decd7 tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:00.741665 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-93ae8737-a2a6-4795-8b70-fad93c8decd7 tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:00.742486 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-93ae8737-a2a6-4795-8b70-fad93c8decd7 tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:00.744849 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-93ae8737-a2a6-4795-8b70-fad93c8decd7 tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:00.751840 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-93ae8737-a2a6-4795-8b70-fad93c8decd7 tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:00.755020 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-93ae8737-a2a6-4795-8b70-fad93c8decd7 tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:01.027887 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-93ae8737-a2a6-4795-8b70-fad93c8decd7 tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e0e6ed148c4452b054ffbfc185cd2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3235f4d52e4b43728569e58f675cf922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:01.059899 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-93ae8737-a2a6-4795-8b70-fad93c8decd7 tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] 10.222.0.43 "GET /compute/v2.1/servers/98ab602c-e2bc-4fa4-aafd-be3bd6b1589f" status: 200 len: 1524 microversion: 2.1 time: 0.358981 Oct 04 19:03:01.061227 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3026/5690] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:03:00 2022] GET /compute/v2.1/servers/98ab602c-e2bc-4fa4-aafd-be3bd6b1589f => generated 1524 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:03:01.189896 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-9642f2c0-475f-4168-a832-8f1d92a9cfbe req-afe2d364-5643-48f1-a277-38e36b68682f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98ab602c-e2bc-4fa4-aafd-be3bd6b1589f", "name": "network-vif-deleted", "tag": "967cced9-22db-41a7-b033-401942fe77d8"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:03:01.213516 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-9642f2c0-475f-4168-a832-8f1d92a9cfbe req-afe2d364-5643-48f1-a277-38e36b68682f service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:01.216120 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-9642f2c0-475f-4168-a832-8f1d92a9cfbe req-afe2d364-5643-48f1-a277-38e36b68682f service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:01.216940 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-9642f2c0-475f-4168-a832-8f1d92a9cfbe req-afe2d364-5643-48f1-a277-38e36b68682f service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:01.238626 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-9642f2c0-475f-4168-a832-8f1d92a9cfbe req-afe2d364-5643-48f1-a277-38e36b68682f service nova] Creating event network-vif-deleted:967cced9-22db-41a7-b033-401942fe77d8 for instance 98ab602c-e2bc-4fa4-aafd-be3bd6b1589f on n-h2-851028-13 Oct 04 19:03:01.246892 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-9642f2c0-475f-4168-a832-8f1d92a9cfbe req-afe2d364-5643-48f1-a277-38e36b68682f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061164 Oct 04 19:03:01.247785 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2665/5691] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:03:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:03:01.394484 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-942e37c5-5896-410c-98e1-cf64cf1e4560 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:01.395123 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-942e37c5-5896-410c-98e1-cf64cf1e4560 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: 3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:01.414409 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-942e37c5-5896-410c-98e1-cf64cf1e4560 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:01.415156 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-942e37c5-5896-410c-98e1-cf64cf1e4560 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:01.415622 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-942e37c5-5896-410c-98e1-cf64cf1e4560 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:01.423343 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-942e37c5-5896-410c-98e1-cf64cf1e4560 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:01.423655 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-942e37c5-5896-410c-98e1-cf64cf1e4560 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:01.424071 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-942e37c5-5896-410c-98e1-cf64cf1e4560 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:01.645421 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-942e37c5-5896-410c-98e1-cf64cf1e4560 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c997bc60473b43fd9fcf0c65111c44c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a711601b7a439caf395233de1febff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:01.659943 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-942e37c5-5896-410c-98e1-cf64cf1e4560 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "GET /compute/v2.1/servers/3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff" status: 200 len: 1523 microversion: 2.1 time: 0.269186 Oct 04 19:03:01.680309 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3027/5692] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:03:01 2022] GET /compute/v2.1/servers/3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff => generated 1523 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:03:02.087851 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-34be0cc9-a079-41ea-a28e-dd9a3df7464d tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:02.105230 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-34be0cc9-a079-41ea-a28e-dd9a3df7464d tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] [instance: 98ab602c-e2bc-4fa4-aafd-be3bd6b1589f] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:02.173617 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-34be0cc9-a079-41ea-a28e-dd9a3df7464d tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:02.175417 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-34be0cc9-a079-41ea-a28e-dd9a3df7464d tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:02.177764 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-34be0cc9-a079-41ea-a28e-dd9a3df7464d tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:02.182574 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-34be0cc9-a079-41ea-a28e-dd9a3df7464d tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:02.183849 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-34be0cc9-a079-41ea-a28e-dd9a3df7464d tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:02.186924 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-34be0cc9-a079-41ea-a28e-dd9a3df7464d tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:02.313137 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-34be0cc9-a079-41ea-a28e-dd9a3df7464d tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:02.314820 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-34be0cc9-a079-41ea-a28e-dd9a3df7464d tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:02.316218 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-34be0cc9-a079-41ea-a28e-dd9a3df7464d tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:02.321752 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.objects.instance [None req-34be0cc9-a079-41ea-a28e-dd9a3df7464d tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] Lazy-loading 'fault' on Instance uuid 98ab602c-e2bc-4fa4-aafd-be3bd6b1589f {{(pid=123595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 19:03:02.402928 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-34be0cc9-a079-41ea-a28e-dd9a3df7464d tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e0e6ed148c4452b054ffbfc185cd2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3235f4d52e4b43728569e58f675cf922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:02.415805 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-34be0cc9-a079-41ea-a28e-dd9a3df7464d tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] 10.222.0.43 "GET /compute/v2.1/servers/98ab602c-e2bc-4fa4-aafd-be3bd6b1589f" status: 200 len: 1313 microversion: 2.1 time: 0.335779 Oct 04 19:03:02.416782 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2666/5693] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:03:02 2022] GET /compute/v2.1/servers/98ab602c-e2bc-4fa4-aafd-be3bd6b1589f => generated 1313 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:03:02.686302 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-832708a5-7839-4509-a20f-cfd98ce0f6ee tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:02.688074 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-832708a5-7839-4509-a20f-cfd98ce0f6ee tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: 3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:02.703134 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-832708a5-7839-4509-a20f-cfd98ce0f6ee tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:02.705838 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-832708a5-7839-4509-a20f-cfd98ce0f6ee tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:02.706626 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-832708a5-7839-4509-a20f-cfd98ce0f6ee tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:02.709056 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-832708a5-7839-4509-a20f-cfd98ce0f6ee tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:02.710637 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-832708a5-7839-4509-a20f-cfd98ce0f6ee tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:02.712671 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-832708a5-7839-4509-a20f-cfd98ce0f6ee tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:03.443371 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-032e362c-182c-48e2-81a8-f57865e888bb tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:03.444784 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-032e362c-182c-48e2-81a8-f57865e888bb tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] [instance: 98ab602c-e2bc-4fa4-aafd-be3bd6b1589f] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:03.473724 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-032e362c-182c-48e2-81a8-f57865e888bb tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:03.474453 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-032e362c-182c-48e2-81a8-f57865e888bb tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:03.475092 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-032e362c-182c-48e2-81a8-f57865e888bb tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:03.476031 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-032e362c-182c-48e2-81a8-f57865e888bb tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:03.476785 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-032e362c-182c-48e2-81a8-f57865e888bb tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:03.477189 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-032e362c-182c-48e2-81a8-f57865e888bb tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:03.511962 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-032e362c-182c-48e2-81a8-f57865e888bb tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] HTTP exception thrown: Instance 98ab602c-e2bc-4fa4-aafd-be3bd6b1589f could not be found. Oct 04 19:03:03.514638 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-032e362c-182c-48e2-81a8-f57865e888bb tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] Request method failure captured: Oct 04 19:03:03.514638 n-d-851028-13 devstack@n-api.service[123595]: request: GET /compute/v2.1/servers/98ab602c-e2bc-4fa4-aafd-be3bd6b1589f HTTP/1.1 Oct 04 19:03:03.514638 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 19:03:03.514638 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 19:03:03.514638 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 19:03:03.514638 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 0 Oct 04 19:03:03.514638 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 19:03:03.514638 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 19:03:03.514638 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 19:03:03.514638 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 19:03:03.514638 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPINNC1yHkSUzzlXlApthXIJ06QPeUWE9iSk7VTHfjxXqB71RO8w-0kWRn9oAu6smRNi7q78rjdFwXJnWRs7IMYcgtz0y8wsWDxGxholQND4tJKewWgdRf_vhuAPoa0K8RpLBFUchLIK-sKJwmO9lYYVb17BDaeSNMBEa8EDTrZukweU Oct 04 19:03:03.514638 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 19:03:03.514638 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 19:03:03.514638 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 19:03:03.514638 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 19:03:03.514638 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 19:03:03.514638 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 19:03:03.514638 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: 3235f4d52e4b43728569e58f675cf922 Oct 04 19:03:03.514638 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-2071846802 Oct 04 19:03:03.514638 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 19:03:03.514638 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 19:03:03.514638 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/3235f4d52e4b43728569e58f675cf922"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_3235f4d52e4b43728569e58f675cf922"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/3235f4d52e4b43728569e58f675cf922"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/3235f4d52e4b43728569e58f675cf922"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 19:03:03.514638 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-2071846802 Oct 04 19:03:03.514638 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: 3235f4d52e4b43728569e58f675cf922 Oct 04 19:03:03.514638 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-2071846802 Oct 04 19:03:03.514638 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-ServerMetadataNegativeTestJSON-2071846802-project Oct 04 19:03:03.514638 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 19:03:03.514638 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 19:03:03.514638 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: 82e0e6ed148c4452b054ffbfc185cd2a Oct 04 19:03:03.514638 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-2071846802-project Oct 04 19:03:03.514638 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 19:03:03.514638 n-d-851028-13 devstack@n-api.service[123595]: exception: Instance 98ab602c-e2bc-4fa4-aafd-be3bd6b1589f could not be found. Oct 04 19:03:03.514638 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': '98ab602c-e2bc-4fa4-aafd-be3bd6b1589f'} Oct 04 19:03:03.514638 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:03:03.514638 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:03:03.514638 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:03:03.514638 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:03:03.514638 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:03:03.514638 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:03:03.514638 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:03:03.514638 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:03:03.514638 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:03:03.514638 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:03:03.514638 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98ab602c-e2bc-4fa4-aafd-be3bd6b1589f could not be found. Oct 04 19:03:03.514638 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:03:03.514638 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:03:03.514638 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:03:03.514638 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:03:03.514638 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:03:03.514638 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:03:03.514638 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:03:03.514638 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:03:03.514638 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:03:03.514638 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:03:03.514638 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:03:03.514638 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:03:03.514638 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:03:03.514638 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:03:03.514638 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:03:03.514638 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:03:03.514638 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98ab602c-e2bc-4fa4-aafd-be3bd6b1589f could not be found. Oct 04 19:03:03.514638 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:03:03.514638 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:03:03.519537 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:03:03.519537 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:03:03.519537 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:03:03.519537 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:03:03.519537 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:03:03.519537 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:03:03.519537 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98ab602c-e2bc-4fa4-aafd-be3bd6b1589f could not be found. Oct 04 19:03:03.519537 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:03:03.521284 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-032e362c-182c-48e2-81a8-f57865e888bb tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] Returning 404 to user: Instance 98ab602c-e2bc-4fa4-aafd-be3bd6b1589f could not be found. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:03:03.523079 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-032e362c-182c-48e2-81a8-f57865e888bb tempest-ServerMetadataNegativeTestJSON-2071846802 tempest-ServerMetadataNegativeTestJSON-2071846802-project] 10.222.0.43 "GET /compute/v2.1/servers/98ab602c-e2bc-4fa4-aafd-be3bd6b1589f" status: 404 len: 111 microversion: 2.1 time: 0.084235 Oct 04 19:03:03.524460 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2667/5694] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:03:03 2022] GET /compute/v2.1/servers/98ab602c-e2bc-4fa4-aafd-be3bd6b1589f => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 19:03:03.814163 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-832708a5-7839-4509-a20f-cfd98ce0f6ee tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c997bc60473b43fd9fcf0c65111c44c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a711601b7a439caf395233de1febff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:03.827246 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-832708a5-7839-4509-a20f-cfd98ce0f6ee tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "GET /compute/v2.1/servers/3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff" status: 200 len: 1523 microversion: 2.1 time: 1.144626 Oct 04 19:03:03.844207 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3028/5695] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:03:02 2022] GET /compute/v2.1/servers/3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff => generated 1523 bytes in 1161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:03:04.865714 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-a037055b-b2a6-4fb9-ba37-8c1b732a6fe9 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:04.867503 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-a037055b-b2a6-4fb9-ba37-8c1b732a6fe9 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: 3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:04.874400 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_api:SELECT=72 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:03:04.889865 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a037055b-b2a6-4fb9-ba37-8c1b732a6fe9 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:04.890760 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a037055b-b2a6-4fb9-ba37-8c1b732a6fe9 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:04.891438 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a037055b-b2a6-4fb9-ba37-8c1b732a6fe9 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:04.892857 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a037055b-b2a6-4fb9-ba37-8c1b732a6fe9 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:04.893571 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a037055b-b2a6-4fb9-ba37-8c1b732a6fe9 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:04.895571 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a037055b-b2a6-4fb9-ba37-8c1b732a6fe9 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:05.424729 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-a037055b-b2a6-4fb9-ba37-8c1b732a6fe9 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c997bc60473b43fd9fcf0c65111c44c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a711601b7a439caf395233de1febff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:05.433539 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-a037055b-b2a6-4fb9-ba37-8c1b732a6fe9 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "GET /compute/v2.1/servers/3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff" status: 200 len: 1523 microversion: 2.1 time: 0.573496 Oct 04 19:03:05.437926 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2668/5696] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:03:04 2022] GET /compute/v2.1/servers/3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff => generated 1523 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:03:06.463660 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-630ae448-6fb0-47aa-8c00-77d2ca35361a tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:06.464402 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-630ae448-6fb0-47aa-8c00-77d2ca35361a tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: 3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:06.479343 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-630ae448-6fb0-47aa-8c00-77d2ca35361a tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:06.486702 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-630ae448-6fb0-47aa-8c00-77d2ca35361a tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:06.487180 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-630ae448-6fb0-47aa-8c00-77d2ca35361a tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:06.494765 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-630ae448-6fb0-47aa-8c00-77d2ca35361a tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:06.495322 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-630ae448-6fb0-47aa-8c00-77d2ca35361a tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:06.500658 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-630ae448-6fb0-47aa-8c00-77d2ca35361a tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:06.918593 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-630ae448-6fb0-47aa-8c00-77d2ca35361a tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c997bc60473b43fd9fcf0c65111c44c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a711601b7a439caf395233de1febff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:06.931909 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-630ae448-6fb0-47aa-8c00-77d2ca35361a tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "GET /compute/v2.1/servers/3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff" status: 200 len: 1523 microversion: 2.1 time: 0.473789 Oct 04 19:03:06.950290 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3029/5697] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:03:06 2022] GET /compute/v2.1/servers/3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff => generated 1523 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:03:07.964682 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-cf7d0360-c246-458d-974a-575644d8fd0d tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:07.965247 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-cf7d0360-c246-458d-974a-575644d8fd0d tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: 3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:07.977102 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cf7d0360-c246-458d-974a-575644d8fd0d tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:07.980537 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cf7d0360-c246-458d-974a-575644d8fd0d tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:07.985910 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cf7d0360-c246-458d-974a-575644d8fd0d tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:07.987828 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cf7d0360-c246-458d-974a-575644d8fd0d tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:07.992231 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cf7d0360-c246-458d-974a-575644d8fd0d tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:07.992928 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cf7d0360-c246-458d-974a-575644d8fd0d tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:08.598275 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-cf7d0360-c246-458d-974a-575644d8fd0d tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c997bc60473b43fd9fcf0c65111c44c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a711601b7a439caf395233de1febff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:08.606095 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-cf7d0360-c246-458d-974a-575644d8fd0d tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "GET /compute/v2.1/servers/3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff" status: 200 len: 1523 microversion: 2.1 time: 0.645350 Oct 04 19:03:08.606667 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2669/5698] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:03:07 2022] GET /compute/v2.1/servers/3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff => generated 1523 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:03:09.635038 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f3345009-75d8-4524-aa05-fd795ba65d60 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:09.636495 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-f3345009-75d8-4524-aa05-fd795ba65d60 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: 3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:09.661701 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f3345009-75d8-4524-aa05-fd795ba65d60 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:09.662585 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f3345009-75d8-4524-aa05-fd795ba65d60 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:09.665036 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f3345009-75d8-4524-aa05-fd795ba65d60 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:09.666155 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f3345009-75d8-4524-aa05-fd795ba65d60 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:09.669064 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f3345009-75d8-4524-aa05-fd795ba65d60 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:09.669839 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f3345009-75d8-4524-aa05-fd795ba65d60 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:10.107089 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-f3345009-75d8-4524-aa05-fd795ba65d60 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c997bc60473b43fd9fcf0c65111c44c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a711601b7a439caf395233de1febff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:10.153185 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-f3345009-75d8-4524-aa05-fd795ba65d60 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "GET /compute/v2.1/servers/3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff" status: 200 len: 1523 microversion: 2.1 time: 0.523131 Oct 04 19:03:10.154519 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3030/5699] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:03:09 2022] GET /compute/v2.1/servers/3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff => generated 1523 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:03:11.182826 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-cb16e993-5718-4e37-a692-5737d02fa26f tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:11.184165 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-cb16e993-5718-4e37-a692-5737d02fa26f tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: 3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:11.210662 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cb16e993-5718-4e37-a692-5737d02fa26f tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:11.211531 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cb16e993-5718-4e37-a692-5737d02fa26f tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:11.212248 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cb16e993-5718-4e37-a692-5737d02fa26f tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:11.213337 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cb16e993-5718-4e37-a692-5737d02fa26f tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:11.214020 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cb16e993-5718-4e37-a692-5737d02fa26f tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:11.214690 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cb16e993-5718-4e37-a692-5737d02fa26f tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:11.684220 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-cb16e993-5718-4e37-a692-5737d02fa26f tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c997bc60473b43fd9fcf0c65111c44c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a711601b7a439caf395233de1febff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:11.700844 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-cb16e993-5718-4e37-a692-5737d02fa26f tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "GET /compute/v2.1/servers/3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff" status: 200 len: 1523 microversion: 2.1 time: 0.524027 Oct 04 19:03:11.702601 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2670/5700] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:03:11 2022] GET /compute/v2.1/servers/3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff => generated 1523 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:03:12.723929 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-1fcab413-e74e-4a65-b2ea-78e8bce6e2cc tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:12.725874 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-1fcab413-e74e-4a65-b2ea-78e8bce6e2cc tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: 3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:12.748119 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1fcab413-e74e-4a65-b2ea-78e8bce6e2cc tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:12.749068 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1fcab413-e74e-4a65-b2ea-78e8bce6e2cc tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:12.749941 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1fcab413-e74e-4a65-b2ea-78e8bce6e2cc tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:12.751429 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1fcab413-e74e-4a65-b2ea-78e8bce6e2cc tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:12.752122 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1fcab413-e74e-4a65-b2ea-78e8bce6e2cc tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:12.752812 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1fcab413-e74e-4a65-b2ea-78e8bce6e2cc tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:13.910833 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-1fcab413-e74e-4a65-b2ea-78e8bce6e2cc tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c997bc60473b43fd9fcf0c65111c44c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a711601b7a439caf395233de1febff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:13.927450 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-1fcab413-e74e-4a65-b2ea-78e8bce6e2cc tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "GET /compute/v2.1/servers/3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff" status: 200 len: 1523 microversion: 2.1 time: 1.207437 Oct 04 19:03:13.928068 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3031/5701] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:03:12 2022] GET /compute/v2.1/servers/3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff => generated 1523 bytes in 1209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:03:14.965195 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-72a68e60-f149-4125-9cdc-e46aaeb2a119 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:14.967379 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-72a68e60-f149-4125-9cdc-e46aaeb2a119 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: 3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:15.004699 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-72a68e60-f149-4125-9cdc-e46aaeb2a119 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:15.009564 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-72a68e60-f149-4125-9cdc-e46aaeb2a119 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:15.012734 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-72a68e60-f149-4125-9cdc-e46aaeb2a119 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:15.021976 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-72a68e60-f149-4125-9cdc-e46aaeb2a119 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:15.023572 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-72a68e60-f149-4125-9cdc-e46aaeb2a119 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:15.042183 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-72a68e60-f149-4125-9cdc-e46aaeb2a119 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:15.420791 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-72a68e60-f149-4125-9cdc-e46aaeb2a119 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c997bc60473b43fd9fcf0c65111c44c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a711601b7a439caf395233de1febff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:15.440160 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-72a68e60-f149-4125-9cdc-e46aaeb2a119 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "GET /compute/v2.1/servers/3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff" status: 200 len: 1523 microversion: 2.1 time: 0.475666 Oct 04 19:03:15.444592 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2671/5702] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:03:14 2022] GET /compute/v2.1/servers/3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff => generated 1523 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:03:16.504875 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-3a39a1aa-f2d6-47e5-8fda-78c9986401b1 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:16.506857 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-3a39a1aa-f2d6-47e5-8fda-78c9986401b1 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: 3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:16.550811 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3a39a1aa-f2d6-47e5-8fda-78c9986401b1 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:16.553055 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3a39a1aa-f2d6-47e5-8fda-78c9986401b1 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:16.556360 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3a39a1aa-f2d6-47e5-8fda-78c9986401b1 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:16.559289 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3a39a1aa-f2d6-47e5-8fda-78c9986401b1 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:16.561640 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3a39a1aa-f2d6-47e5-8fda-78c9986401b1 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:16.563894 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3a39a1aa-f2d6-47e5-8fda-78c9986401b1 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:16.659750 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-9d7bfc49-03db-4fc8-9e24-eda8574118b4 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-519315573", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452", "networks": "none"}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:03:16.782503 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-9d7bfc49-03db-4fc8-9e24-eda8574118b4 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Flavor limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:03:16.783210 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-9d7bfc49-03db-4fc8-9e24-eda8574118b4 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Image limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:03:16.785022 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-9d7bfc49-03db-4fc8-9e24-eda8574118b4 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Flavor pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:03:16.785663 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-9d7bfc49-03db-4fc8-9e24-eda8574118b4 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Image pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:03:16.786280 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-9d7bfc49-03db-4fc8-9e24-eda8574118b4 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:03:16.807365 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9d7bfc49-03db-4fc8-9e24-eda8574118b4 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:16.808105 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9d7bfc49-03db-4fc8-9e24-eda8574118b4 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:16.808719 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9d7bfc49-03db-4fc8-9e24-eda8574118b4 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:16.809666 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9d7bfc49-03db-4fc8-9e24-eda8574118b4 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:16.810949 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9d7bfc49-03db-4fc8-9e24-eda8574118b4 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:16.811575 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9d7bfc49-03db-4fc8-9e24-eda8574118b4 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:16.832088 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-9d7bfc49-03db-4fc8-9e24-eda8574118b4 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Getting quotas for project a2bd7c2243464924b04efd5a343d5a0f. Resources: {'ram', 'cores', 'instances'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:03:16.849609 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-9d7bfc49-03db-4fc8-9e24-eda8574118b4 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Getting quotas for user 2b1a7754d7344f08ae1b3ef134339ba0 and project a2bd7c2243464924b04efd5a343d5a0f. Resources: {'ram', 'cores', 'instances'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:03:16.872963 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-9d7bfc49-03db-4fc8-9e24-eda8574118b4 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Going to run 1 instances... {{(pid=123596) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 19:03:16.876780 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-9d7bfc49-03db-4fc8-9e24-eda8574118b4 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] [instance: f264d970-6336-460a-88f8-cfee793a20dd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e8943ec5-4038-4d4b-b9b9-2415a79f5243',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123596) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 19:03:16.979793 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-3a39a1aa-f2d6-47e5-8fda-78c9986401b1 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c997bc60473b43fd9fcf0c65111c44c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a711601b7a439caf395233de1febff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:16.984964 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-9d7bfc49-03db-4fc8-9e24-eda8574118b4 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 0.699091 Oct 04 19:03:16.986003 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3032/5703] 10.222.0.43 () {62 vars in 1188 bytes} [Tue Oct 4 19:03:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 701 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 04 19:03:16.989385 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-3a39a1aa-f2d6-47e5-8fda-78c9986401b1 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "GET /compute/v2.1/servers/3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff" status: 200 len: 1523 microversion: 2.1 time: 0.500964 Oct 04 19:03:16.989968 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2672/5704] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:03:16 2022] GET /compute/v2.1/servers/3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff => generated 1523 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:03:17.009756 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-d1665b13-8b67-467f-960c-049246085ed2 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:17.015873 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-d1665b13-8b67-467f-960c-049246085ed2 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] [instance: f264d970-6336-460a-88f8-cfee793a20dd] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:17.109737 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-d1665b13-8b67-467f-960c-049246085ed2 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b1a7754d7344f08ae1b3ef134339ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bd7c2243464924b04efd5a343d5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:17.136457 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-d1665b13-8b67-467f-960c-049246085ed2 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b1a7754d7344f08ae1b3ef134339ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bd7c2243464924b04efd5a343d5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:17.139051 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-d1665b13-8b67-467f-960c-049246085ed2 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b1a7754d7344f08ae1b3ef134339ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bd7c2243464924b04efd5a343d5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:17.141183 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-d1665b13-8b67-467f-960c-049246085ed2 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] 10.222.0.43 "GET /compute/v2.1/servers/f264d970-6336-460a-88f8-cfee793a20dd" status: 200 len: 1277 microversion: 2.57 time: 0.139841 Oct 04 19:03:17.142845 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3033/5705] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:03:17 2022] GET /compute/v2.1/servers/f264d970-6336-460a-88f8-cfee793a20dd => generated 1277 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:03:18.016296 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-09508899-209d-4cef-8e05-d16a273033ec tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:18.017747 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-09508899-209d-4cef-8e05-d16a273033ec tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: 3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:18.030913 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-09508899-209d-4cef-8e05-d16a273033ec tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:18.031807 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-09508899-209d-4cef-8e05-d16a273033ec tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:18.032554 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-09508899-209d-4cef-8e05-d16a273033ec tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:18.036146 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-09508899-209d-4cef-8e05-d16a273033ec tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:18.036855 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-09508899-209d-4cef-8e05-d16a273033ec tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:18.037573 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-09508899-209d-4cef-8e05-d16a273033ec tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:18.175296 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-41d0df47-9a52-4c15-acaa-f017fe46857a tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:18.176694 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-41d0df47-9a52-4c15-acaa-f017fe46857a tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] [instance: f264d970-6336-460a-88f8-cfee793a20dd] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:18.292089 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-41d0df47-9a52-4c15-acaa-f017fe46857a tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b1a7754d7344f08ae1b3ef134339ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bd7c2243464924b04efd5a343d5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:18.304721 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-41d0df47-9a52-4c15-acaa-f017fe46857a tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b1a7754d7344f08ae1b3ef134339ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bd7c2243464924b04efd5a343d5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:18.308932 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-41d0df47-9a52-4c15-acaa-f017fe46857a tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b1a7754d7344f08ae1b3ef134339ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bd7c2243464924b04efd5a343d5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:18.310593 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-41d0df47-9a52-4c15-acaa-f017fe46857a tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] 10.222.0.43 "GET /compute/v2.1/servers/f264d970-6336-460a-88f8-cfee793a20dd" status: 200 len: 1277 microversion: 2.57 time: 0.139948 Oct 04 19:03:18.315005 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3034/5706] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:03:18 2022] GET /compute/v2.1/servers/f264d970-6336-460a-88f8-cfee793a20dd => generated 1277 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 19:03:18.769737 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-09508899-209d-4cef-8e05-d16a273033ec tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c997bc60473b43fd9fcf0c65111c44c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a711601b7a439caf395233de1febff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:18.796349 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-09508899-209d-4cef-8e05-d16a273033ec tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "GET /compute/v2.1/servers/3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff" status: 200 len: 1523 microversion: 2.1 time: 0.783798 Oct 04 19:03:18.805630 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2673/5707] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:03:18 2022] GET /compute/v2.1/servers/3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff => generated 1523 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:03:19.346077 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-635f64e0-37d9-4437-9d64-6719efe088ad tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:19.347482 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-635f64e0-37d9-4437-9d64-6719efe088ad tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] [instance: f264d970-6336-460a-88f8-cfee793a20dd] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:19.357566 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-635f64e0-37d9-4437-9d64-6719efe088ad tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:19.358528 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-635f64e0-37d9-4437-9d64-6719efe088ad tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:19.359208 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-635f64e0-37d9-4437-9d64-6719efe088ad tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:19.360149 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-635f64e0-37d9-4437-9d64-6719efe088ad tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:19.360842 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-635f64e0-37d9-4437-9d64-6719efe088ad tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:19.361609 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-635f64e0-37d9-4437-9d64-6719efe088ad tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:19.471188 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-635f64e0-37d9-4437-9d64-6719efe088ad tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b1a7754d7344f08ae1b3ef134339ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bd7c2243464924b04efd5a343d5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:19.484069 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-635f64e0-37d9-4437-9d64-6719efe088ad tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b1a7754d7344f08ae1b3ef134339ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bd7c2243464924b04efd5a343d5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:19.485829 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-635f64e0-37d9-4437-9d64-6719efe088ad tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b1a7754d7344f08ae1b3ef134339ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bd7c2243464924b04efd5a343d5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:19.487252 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-635f64e0-37d9-4437-9d64-6719efe088ad tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] 10.222.0.43 "GET /compute/v2.1/servers/f264d970-6336-460a-88f8-cfee793a20dd" status: 200 len: 1329 microversion: 2.57 time: 0.145353 Oct 04 19:03:19.502161 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3035/5708] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:03:19 2022] GET /compute/v2.1/servers/f264d970-6336-460a-88f8-cfee793a20dd => generated 1329 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:03:19.830607 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-9d6f70a0-d346-4ce9-a86f-04e896406445 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:19.831391 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-9d6f70a0-d346-4ce9-a86f-04e896406445 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: 3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:19.844217 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9d6f70a0-d346-4ce9-a86f-04e896406445 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:19.844957 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9d6f70a0-d346-4ce9-a86f-04e896406445 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:19.846018 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9d6f70a0-d346-4ce9-a86f-04e896406445 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:19.847304 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9d6f70a0-d346-4ce9-a86f-04e896406445 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:19.848077 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9d6f70a0-d346-4ce9-a86f-04e896406445 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:19.848669 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9d6f70a0-d346-4ce9-a86f-04e896406445 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:19.874428 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=100 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:03:20.200132 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-9d6f70a0-d346-4ce9-a86f-04e896406445 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c997bc60473b43fd9fcf0c65111c44c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a711601b7a439caf395233de1febff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:20.210451 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-9d6f70a0-d346-4ce9-a86f-04e896406445 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "GET /compute/v2.1/servers/3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff" status: 200 len: 1505 microversion: 2.1 time: 0.384717 Oct 04 19:03:20.211046 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2674/5709] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:03:19 2022] GET /compute/v2.1/servers/3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff => generated 1505 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:03:20.389361 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-1c2d925c-e100-4fc8-9905-e5592b6a09da tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:03:20.392953 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-1c2d925c-e100-4fc8-9905-e5592b6a09da tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] [instance: 32f44032-85ec-43eb-b714-748a7f4f0b5b] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:20.408691 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1c2d925c-e100-4fc8-9905-e5592b6a09da tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:20.409304 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1c2d925c-e100-4fc8-9905-e5592b6a09da tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:20.409763 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1c2d925c-e100-4fc8-9905-e5592b6a09da tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:20.410500 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1c2d925c-e100-4fc8-9905-e5592b6a09da tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:20.410968 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1c2d925c-e100-4fc8-9905-e5592b6a09da tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:20.411408 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1c2d925c-e100-4fc8-9905-e5592b6a09da tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:20.522178 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-8dc95fc5-78ff-4f1c-a39e-f37b73aaf821 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:20.523291 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-8dc95fc5-78ff-4f1c-a39e-f37b73aaf821 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] [instance: f264d970-6336-460a-88f8-cfee793a20dd] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:20.533552 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8dc95fc5-78ff-4f1c-a39e-f37b73aaf821 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:20.535830 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8dc95fc5-78ff-4f1c-a39e-f37b73aaf821 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:20.536494 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8dc95fc5-78ff-4f1c-a39e-f37b73aaf821 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:20.537634 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8dc95fc5-78ff-4f1c-a39e-f37b73aaf821 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:20.538348 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8dc95fc5-78ff-4f1c-a39e-f37b73aaf821 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:20.539149 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8dc95fc5-78ff-4f1c-a39e-f37b73aaf821 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:20.641204 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-8dc95fc5-78ff-4f1c-a39e-f37b73aaf821 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b1a7754d7344f08ae1b3ef134339ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bd7c2243464924b04efd5a343d5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:20.656749 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-8dc95fc5-78ff-4f1c-a39e-f37b73aaf821 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b1a7754d7344f08ae1b3ef134339ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bd7c2243464924b04efd5a343d5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:20.658781 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-8dc95fc5-78ff-4f1c-a39e-f37b73aaf821 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b1a7754d7344f08ae1b3ef134339ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bd7c2243464924b04efd5a343d5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:20.665442 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-8dc95fc5-78ff-4f1c-a39e-f37b73aaf821 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] 10.222.0.43 "GET /compute/v2.1/servers/f264d970-6336-460a-88f8-cfee793a20dd" status: 200 len: 1335 microversion: 2.57 time: 0.144655 Oct 04 19:03:20.666270 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2675/5710] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:03:20 2022] GET /compute/v2.1/servers/f264d970-6336-460a-88f8-cfee793a20dd => generated 1335 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 19:03:21.008762 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-1c2d925c-e100-4fc8-9905-e5592b6a09da tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] 10.222.0.43 "POST /compute/v2.1/servers/32f44032-85ec-43eb-b714-748a7f4f0b5b/action" status: 200 len: 24570 microversion: 2.1 time: 0.623615 Oct 04 19:03:21.009477 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3036/5711] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 19:03:20 2022] POST /compute/v2.1/servers/32f44032-85ec-43eb-b714-748a7f4f0b5b/action => generated 24570 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 19:03:21.235092 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-c25478d1-4092-4388-ad9a-99a70b2627ee tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:21.236740 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-c25478d1-4092-4388-ad9a-99a70b2627ee tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: 3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:21.246671 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c25478d1-4092-4388-ad9a-99a70b2627ee tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:21.248223 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c25478d1-4092-4388-ad9a-99a70b2627ee tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:21.248862 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c25478d1-4092-4388-ad9a-99a70b2627ee tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:21.251933 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c25478d1-4092-4388-ad9a-99a70b2627ee tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:21.253943 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c25478d1-4092-4388-ad9a-99a70b2627ee tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:21.254623 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c25478d1-4092-4388-ad9a-99a70b2627ee tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:21.682184 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-c25478d1-4092-4388-ad9a-99a70b2627ee tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c997bc60473b43fd9fcf0c65111c44c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a711601b7a439caf395233de1febff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:21.701399 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-498635f7-c240-40c8-87cb-81ecb0f1cd79 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:21.702122 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-498635f7-c240-40c8-87cb-81ecb0f1cd79 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] [instance: f264d970-6336-460a-88f8-cfee793a20dd] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:21.722729 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-c25478d1-4092-4388-ad9a-99a70b2627ee tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "GET /compute/v2.1/servers/3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff" status: 200 len: 1505 microversion: 2.1 time: 0.483281 Oct 04 19:03:21.723436 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2676/5712] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:03:21 2022] GET /compute/v2.1/servers/3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff => generated 1505 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:03:21.739546 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-498635f7-c240-40c8-87cb-81ecb0f1cd79 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:21.752421 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-498635f7-c240-40c8-87cb-81ecb0f1cd79 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:21.753971 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-498635f7-c240-40c8-87cb-81ecb0f1cd79 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:21.757366 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-498635f7-c240-40c8-87cb-81ecb0f1cd79 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:21.758506 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-498635f7-c240-40c8-87cb-81ecb0f1cd79 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:21.761622 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-498635f7-c240-40c8-87cb-81ecb0f1cd79 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:21.841588 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:03:21.955568 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-498635f7-c240-40c8-87cb-81ecb0f1cd79 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b1a7754d7344f08ae1b3ef134339ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bd7c2243464924b04efd5a343d5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:21.981066 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-498635f7-c240-40c8-87cb-81ecb0f1cd79 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b1a7754d7344f08ae1b3ef134339ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bd7c2243464924b04efd5a343d5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:21.983356 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-498635f7-c240-40c8-87cb-81ecb0f1cd79 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b1a7754d7344f08ae1b3ef134339ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bd7c2243464924b04efd5a343d5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:21.992988 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-498635f7-c240-40c8-87cb-81ecb0f1cd79 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] 10.222.0.43 "GET /compute/v2.1/servers/f264d970-6336-460a-88f8-cfee793a20dd" status: 200 len: 1335 microversion: 2.57 time: 0.295858 Oct 04 19:03:21.997293 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3037/5713] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:03:21 2022] GET /compute/v2.1/servers/f264d970-6336-460a-88f8-cfee793a20dd => generated 1335 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:03:22.749236 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-3cde9c11-0b2f-49a6-9e8a-8b5be2c42c5d tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:22.751352 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-3cde9c11-0b2f-49a6-9e8a-8b5be2c42c5d tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: 3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:22.763040 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3cde9c11-0b2f-49a6-9e8a-8b5be2c42c5d tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:22.764314 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3cde9c11-0b2f-49a6-9e8a-8b5be2c42c5d tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:22.765642 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3cde9c11-0b2f-49a6-9e8a-8b5be2c42c5d tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:22.768382 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3cde9c11-0b2f-49a6-9e8a-8b5be2c42c5d tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:22.769080 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3cde9c11-0b2f-49a6-9e8a-8b5be2c42c5d tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:22.771071 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3cde9c11-0b2f-49a6-9e8a-8b5be2c42c5d tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:22.805791 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-8eba5e40-27c0-4fe2-862a-33ac8a197a7c req-fd0f2702-fefb-4d6b-93aa-220bf3dbfb9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff", "name": "network-vif-unplugged", "status": "completed", "tag": "49a9f601-fe9e-4242-8553-215eee8014f3"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:03:22.817897 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-8eba5e40-27c0-4fe2-862a-33ac8a197a7c req-fd0f2702-fefb-4d6b-93aa-220bf3dbfb9d service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:22.818644 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-8eba5e40-27c0-4fe2-862a-33ac8a197a7c req-fd0f2702-fefb-4d6b-93aa-220bf3dbfb9d service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:22.819854 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-8eba5e40-27c0-4fe2-862a-33ac8a197a7c req-fd0f2702-fefb-4d6b-93aa-220bf3dbfb9d service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:22.839399 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-8eba5e40-27c0-4fe2-862a-33ac8a197a7c req-fd0f2702-fefb-4d6b-93aa-220bf3dbfb9d service nova] Creating event network-vif-unplugged:49a9f601-fe9e-4242-8553-215eee8014f3 for instance 3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff on n-h2-851028-13 Oct 04 19:03:22.845025 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-8eba5e40-27c0-4fe2-862a-33ac8a197a7c req-fd0f2702-fefb-4d6b-93aa-220bf3dbfb9d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.249683 Oct 04 19:03:22.845702 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2677/5714] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:03:22 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:03:22.977688 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-3cde9c11-0b2f-49a6-9e8a-8b5be2c42c5d tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c997bc60473b43fd9fcf0c65111c44c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a711601b7a439caf395233de1febff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:22.985735 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-3cde9c11-0b2f-49a6-9e8a-8b5be2c42c5d tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "GET /compute/v2.1/servers/3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff" status: 200 len: 1505 microversion: 2.1 time: 0.242460 Oct 04 19:03:22.986321 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3038/5715] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:03:22 2022] GET /compute/v2.1/servers/3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff => generated 1505 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:03:23.027633 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-939bfa8c-14a6-44fd-b6bb-965a3030f3f2 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:23.030882 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-939bfa8c-14a6-44fd-b6bb-965a3030f3f2 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] [instance: f264d970-6336-460a-88f8-cfee793a20dd] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:23.039361 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-939bfa8c-14a6-44fd-b6bb-965a3030f3f2 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:23.040294 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-939bfa8c-14a6-44fd-b6bb-965a3030f3f2 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:23.040946 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-939bfa8c-14a6-44fd-b6bb-965a3030f3f2 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:23.042169 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-939bfa8c-14a6-44fd-b6bb-965a3030f3f2 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:23.042802 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-939bfa8c-14a6-44fd-b6bb-965a3030f3f2 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:23.043391 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-939bfa8c-14a6-44fd-b6bb-965a3030f3f2 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:23.384724 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-939bfa8c-14a6-44fd-b6bb-965a3030f3f2 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b1a7754d7344f08ae1b3ef134339ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bd7c2243464924b04efd5a343d5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:23.397522 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-939bfa8c-14a6-44fd-b6bb-965a3030f3f2 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b1a7754d7344f08ae1b3ef134339ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bd7c2243464924b04efd5a343d5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:23.400305 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-939bfa8c-14a6-44fd-b6bb-965a3030f3f2 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b1a7754d7344f08ae1b3ef134339ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bd7c2243464924b04efd5a343d5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:23.403534 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-939bfa8c-14a6-44fd-b6bb-965a3030f3f2 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] 10.222.0.43 "GET /compute/v2.1/servers/f264d970-6336-460a-88f8-cfee793a20dd" status: 200 len: 1356 microversion: 2.57 time: 0.382138 Oct 04 19:03:23.407823 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2678/5716] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:03:23 2022] GET /compute/v2.1/servers/f264d970-6336-460a-88f8-cfee793a20dd => generated 1356 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:03:23.443305 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-9703275d-e35d-434b-a849-7fef42b16478 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243"}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:03:23.447857 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-9703275d-e35d-434b-a849-7fef42b16478 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] [instance: f264d970-6336-460a-88f8-cfee793a20dd] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:23.461467 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9703275d-e35d-434b-a849-7fef42b16478 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:23.462760 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9703275d-e35d-434b-a849-7fef42b16478 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:23.463470 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9703275d-e35d-434b-a849-7fef42b16478 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:23.464402 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9703275d-e35d-434b-a849-7fef42b16478 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:23.464987 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9703275d-e35d-434b-a849-7fef42b16478 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:23.468166 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9703275d-e35d-434b-a849-7fef42b16478 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:23.572049 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-9703275d-e35d-434b-a849-7fef42b16478 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Flavor limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:03:23.573083 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-9703275d-e35d-434b-a849-7fef42b16478 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Image limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:03:23.573870 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-9703275d-e35d-434b-a849-7fef42b16478 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Flavor pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:03:23.574521 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-9703275d-e35d-434b-a849-7fef42b16478 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Image pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:03:23.575170 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-9703275d-e35d-434b-a849-7fef42b16478 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:03:23.676475 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-9703275d-e35d-434b-a849-7fef42b16478 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] [instance: f264d970-6336-460a-88f8-cfee793a20dd] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:23.684816 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9703275d-e35d-434b-a849-7fef42b16478 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:23.686006 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9703275d-e35d-434b-a849-7fef42b16478 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:23.686727 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9703275d-e35d-434b-a849-7fef42b16478 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:23.687718 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9703275d-e35d-434b-a849-7fef42b16478 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:23.688575 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9703275d-e35d-434b-a849-7fef42b16478 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:23.690959 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9703275d-e35d-434b-a849-7fef42b16478 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:23.748444 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-9703275d-e35d-434b-a849-7fef42b16478 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] 10.222.0.43 "POST /compute/v2.1/servers/f264d970-6336-460a-88f8-cfee793a20dd/action" status: 202 len: 1137 microversion: 2.57 time: 0.309593 Oct 04 19:03:23.749125 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3039/5717] 10.222.0.43 () {62 vars in 1320 bytes} [Tue Oct 4 19:03:23 2022] POST /compute/v2.1/servers/f264d970-6336-460a-88f8-cfee793a20dd/action => generated 1137 bytes in 311 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 04 19:03:23.772812 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-dc623327-3025-442f-8c0f-8a24a878cd57 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:23.773569 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-dc623327-3025-442f-8c0f-8a24a878cd57 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] [instance: f264d970-6336-460a-88f8-cfee793a20dd] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:23.789288 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dc623327-3025-442f-8c0f-8a24a878cd57 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:23.789888 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dc623327-3025-442f-8c0f-8a24a878cd57 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:23.790572 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dc623327-3025-442f-8c0f-8a24a878cd57 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:23.792703 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dc623327-3025-442f-8c0f-8a24a878cd57 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:23.797900 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dc623327-3025-442f-8c0f-8a24a878cd57 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:23.798456 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dc623327-3025-442f-8c0f-8a24a878cd57 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:23.898898 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-dc623327-3025-442f-8c0f-8a24a878cd57 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b1a7754d7344f08ae1b3ef134339ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bd7c2243464924b04efd5a343d5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:23.909422 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-dc623327-3025-442f-8c0f-8a24a878cd57 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b1a7754d7344f08ae1b3ef134339ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bd7c2243464924b04efd5a343d5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:23.911504 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-dc623327-3025-442f-8c0f-8a24a878cd57 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b1a7754d7344f08ae1b3ef134339ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bd7c2243464924b04efd5a343d5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:23.914042 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-dc623327-3025-442f-8c0f-8a24a878cd57 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] 10.222.0.43 "GET /compute/v2.1/servers/f264d970-6336-460a-88f8-cfee793a20dd" status: 200 len: 1365 microversion: 2.57 time: 0.145521 Oct 04 19:03:23.930066 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2679/5718] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:03:23 2022] GET /compute/v2.1/servers/f264d970-6336-460a-88f8-cfee793a20dd => generated 1365 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:03:24.010145 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-4b4028a0-5c3b-4d66-b15a-968eebdb926b tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:24.010858 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-4b4028a0-5c3b-4d66-b15a-968eebdb926b tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: 3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:24.023468 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4b4028a0-5c3b-4d66-b15a-968eebdb926b tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:24.025846 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4b4028a0-5c3b-4d66-b15a-968eebdb926b tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:24.026243 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4b4028a0-5c3b-4d66-b15a-968eebdb926b tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:24.026995 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4b4028a0-5c3b-4d66-b15a-968eebdb926b tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:24.027458 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4b4028a0-5c3b-4d66-b15a-968eebdb926b tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:24.027893 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4b4028a0-5c3b-4d66-b15a-968eebdb926b tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:24.290005 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-4b4028a0-5c3b-4d66-b15a-968eebdb926b tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c997bc60473b43fd9fcf0c65111c44c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a711601b7a439caf395233de1febff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:24.300994 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-4b4028a0-5c3b-4d66-b15a-968eebdb926b tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "GET /compute/v2.1/servers/3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff" status: 200 len: 1505 microversion: 2.1 time: 0.295117 Oct 04 19:03:24.302907 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3040/5719] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:03:24 2022] GET /compute/v2.1/servers/3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff => generated 1505 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:03:24.948027 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-28a67f3d-e2a4-4d6b-bd49-8c09f9703209 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:24.950601 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-28a67f3d-e2a4-4d6b-bd49-8c09f9703209 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] [instance: f264d970-6336-460a-88f8-cfee793a20dd] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:24.960899 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-28a67f3d-e2a4-4d6b-bd49-8c09f9703209 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:24.961299 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-28a67f3d-e2a4-4d6b-bd49-8c09f9703209 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:24.962145 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-28a67f3d-e2a4-4d6b-bd49-8c09f9703209 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:24.963042 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-28a67f3d-e2a4-4d6b-bd49-8c09f9703209 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:24.963693 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-28a67f3d-e2a4-4d6b-bd49-8c09f9703209 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:24.964589 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-28a67f3d-e2a4-4d6b-bd49-8c09f9703209 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:25.108182 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-28a67f3d-e2a4-4d6b-bd49-8c09f9703209 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b1a7754d7344f08ae1b3ef134339ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bd7c2243464924b04efd5a343d5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:25.127838 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-28a67f3d-e2a4-4d6b-bd49-8c09f9703209 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b1a7754d7344f08ae1b3ef134339ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bd7c2243464924b04efd5a343d5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:25.130223 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-28a67f3d-e2a4-4d6b-bd49-8c09f9703209 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b1a7754d7344f08ae1b3ef134339ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bd7c2243464924b04efd5a343d5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:25.131921 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-28a67f3d-e2a4-4d6b-bd49-8c09f9703209 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] 10.222.0.43 "GET /compute/v2.1/servers/f264d970-6336-460a-88f8-cfee793a20dd" status: 200 len: 1365 microversion: 2.57 time: 0.190349 Oct 04 19:03:25.133160 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2680/5720] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:03:24 2022] GET /compute/v2.1/servers/f264d970-6336-460a-88f8-cfee793a20dd => generated 1365 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 19:03:25.330784 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-5f756a7a-0dcc-4326-9d7f-ac58ef67f746 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:25.332017 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-5f756a7a-0dcc-4326-9d7f-ac58ef67f746 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: 3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:25.341929 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5f756a7a-0dcc-4326-9d7f-ac58ef67f746 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:25.343180 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5f756a7a-0dcc-4326-9d7f-ac58ef67f746 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:25.343933 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5f756a7a-0dcc-4326-9d7f-ac58ef67f746 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:25.345086 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5f756a7a-0dcc-4326-9d7f-ac58ef67f746 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:25.345864 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5f756a7a-0dcc-4326-9d7f-ac58ef67f746 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:25.346766 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5f756a7a-0dcc-4326-9d7f-ac58ef67f746 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:25.570328 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-5f756a7a-0dcc-4326-9d7f-ac58ef67f746 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c997bc60473b43fd9fcf0c65111c44c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a711601b7a439caf395233de1febff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:25.591024 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-5f756a7a-0dcc-4326-9d7f-ac58ef67f746 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "GET /compute/v2.1/servers/3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff" status: 200 len: 1448 microversion: 2.1 time: 0.263780 Oct 04 19:03:25.591837 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3041/5721] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:03:25 2022] GET /compute/v2.1/servers/3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff => generated 1448 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:03:25.616901 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-98983e6f-0bba-4d5f-b2bb-fce9b5c77764 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:25.618552 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-98983e6f-0bba-4d5f-b2bb-fce9b5c77764 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: 3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:25.629692 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-98983e6f-0bba-4d5f-b2bb-fce9b5c77764 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:25.630199 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-98983e6f-0bba-4d5f-b2bb-fce9b5c77764 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:25.630631 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-98983e6f-0bba-4d5f-b2bb-fce9b5c77764 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:25.631311 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-98983e6f-0bba-4d5f-b2bb-fce9b5c77764 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:25.632349 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-98983e6f-0bba-4d5f-b2bb-fce9b5c77764 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:25.632780 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-98983e6f-0bba-4d5f-b2bb-fce9b5c77764 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:25.661808 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-98983e6f-0bba-4d5f-b2bb-fce9b5c77764 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: 3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff] Going to try to terminate instance {{(pid=123595) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 19:03:25.668744 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.compute.api [None req-98983e6f-0bba-4d5f-b2bb-fce9b5c77764 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: 3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff] Working on deleting snapshot 0a777d5b-721f-4ec1-9d39-4e6b55b7ee01 from shelved instance... Oct 04 19:03:26.165038 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-ffc0598e-1f84-4083-a584-1575e0d02357 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:26.168947 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-ffc0598e-1f84-4083-a584-1575e0d02357 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] [instance: f264d970-6336-460a-88f8-cfee793a20dd] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:26.184157 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ffc0598e-1f84-4083-a584-1575e0d02357 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:26.185004 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ffc0598e-1f84-4083-a584-1575e0d02357 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:26.185460 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ffc0598e-1f84-4083-a584-1575e0d02357 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:26.186245 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ffc0598e-1f84-4083-a584-1575e0d02357 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:26.186700 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ffc0598e-1f84-4083-a584-1575e0d02357 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:26.187128 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ffc0598e-1f84-4083-a584-1575e0d02357 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:26.354866 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-ffc0598e-1f84-4083-a584-1575e0d02357 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b1a7754d7344f08ae1b3ef134339ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bd7c2243464924b04efd5a343d5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:26.371660 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-ffc0598e-1f84-4083-a584-1575e0d02357 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b1a7754d7344f08ae1b3ef134339ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bd7c2243464924b04efd5a343d5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:26.376585 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-ffc0598e-1f84-4083-a584-1575e0d02357 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b1a7754d7344f08ae1b3ef134339ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bd7c2243464924b04efd5a343d5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:26.382265 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-ffc0598e-1f84-4083-a584-1575e0d02357 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] 10.222.0.43 "GET /compute/v2.1/servers/f264d970-6336-460a-88f8-cfee793a20dd" status: 200 len: 1365 microversion: 2.57 time: 0.221586 Oct 04 19:03:26.382883 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3042/5722] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:03:26 2022] GET /compute/v2.1/servers/f264d970-6336-460a-88f8-cfee793a20dd => generated 1365 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:03:26.605082 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-98983e6f-0bba-4d5f-b2bb-fce9b5c77764 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: 3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff] Doing local delete in cell 66287c68-6a08-453f-953b-bd2446fe0d25(cell1) {{(pid=123595) _delete /opt/stack/nova/nova/compute/api.py:2546}} Oct 04 19:03:26.610069 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-98983e6f-0bba-4d5f-b2bb-fce9b5c77764 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:26.611828 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-98983e6f-0bba-4d5f-b2bb-fce9b5c77764 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:26.612584 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-98983e6f-0bba-4d5f-b2bb-fce9b5c77764 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:26.613617 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.compute.api [None req-98983e6f-0bba-4d5f-b2bb-fce9b5c77764 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: 3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Oct 04 19:03:26.619557 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.network.neutron [None req-98983e6f-0bba-4d5f-b2bb-fce9b5c77764 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: 3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff] deallocate_for_instance() {{(pid=123595) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Oct 04 19:03:27.411507 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-ea2c856e-c11b-4332-b7f6-c302abe08876 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:27.412034 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-ea2c856e-c11b-4332-b7f6-c302abe08876 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] [instance: f264d970-6336-460a-88f8-cfee793a20dd] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:27.434468 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=2 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:03:27.438484 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ea2c856e-c11b-4332-b7f6-c302abe08876 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:27.439127 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ea2c856e-c11b-4332-b7f6-c302abe08876 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:27.439688 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ea2c856e-c11b-4332-b7f6-c302abe08876 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:27.440837 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ea2c856e-c11b-4332-b7f6-c302abe08876 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:27.441518 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ea2c856e-c11b-4332-b7f6-c302abe08876 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:27.442243 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ea2c856e-c11b-4332-b7f6-c302abe08876 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:27.599370 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.network.neutron [None req-98983e6f-0bba-4d5f-b2bb-fce9b5c77764 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: 3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff] Updating instance_info_cache with network_info: [] {{(pid=123595) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 04 19:03:27.614433 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-ea2c856e-c11b-4332-b7f6-c302abe08876 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b1a7754d7344f08ae1b3ef134339ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bd7c2243464924b04efd5a343d5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:27.626917 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-ea2c856e-c11b-4332-b7f6-c302abe08876 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b1a7754d7344f08ae1b3ef134339ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bd7c2243464924b04efd5a343d5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:27.629067 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-ea2c856e-c11b-4332-b7f6-c302abe08876 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b1a7754d7344f08ae1b3ef134339ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bd7c2243464924b04efd5a343d5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:27.630839 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-ea2c856e-c11b-4332-b7f6-c302abe08876 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] 10.222.0.43 "GET /compute/v2.1/servers/f264d970-6336-460a-88f8-cfee793a20dd" status: 200 len: 1365 microversion: 2.57 time: 0.223504 Oct 04 19:03:27.632525 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3043/5723] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:03:27 2022] GET /compute/v2.1/servers/f264d970-6336-460a-88f8-cfee793a20dd => generated 1365 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 19:03:27.651013 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-2c110c17-3320-4a1d-9ec4-2b42af0ddb59 req-f6eab213-649a-4aed-aa06-7d4bbe6869de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff", "name": "network-vif-deleted", "tag": "49a9f601-fe9e-4242-8553-215eee8014f3"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:03:27.692009 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-2c110c17-3320-4a1d-9ec4-2b42af0ddb59 req-f6eab213-649a-4aed-aa06-7d4bbe6869de service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:27.693422 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-2c110c17-3320-4a1d-9ec4-2b42af0ddb59 req-f6eab213-649a-4aed-aa06-7d4bbe6869de service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:27.694058 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-2c110c17-3320-4a1d-9ec4-2b42af0ddb59 req-f6eab213-649a-4aed-aa06-7d4bbe6869de service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:27.707648 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.compute.server_external_events [req-2c110c17-3320-4a1d-9ec4-2b42af0ddb59 req-f6eab213-649a-4aed-aa06-7d4bbe6869de service nova] Unable to find a host for instance 3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff. Dropping event network-vif-deleted {{(pid=123596) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 04 19:03:27.709269 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-2c110c17-3320-4a1d-9ec4-2b42af0ddb59 req-f6eab213-649a-4aed-aa06-7d4bbe6869de service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.075278 Oct 04 19:03:27.743337 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3044/5724] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:03:27 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 110 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 04 19:03:27.937670 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-98983e6f-0bba-4d5f-b2bb-fce9b5c77764 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "DELETE /compute/v2.1/servers/3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff" status: 204 len: 0 microversion: 2.1 time: 2.325844 Oct 04 19:03:27.942322 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2681/5725] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 19:03:25 2022] DELETE /compute/v2.1/servers/3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff => generated 0 bytes in 2330 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:03:27.950122 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f1aba82b-7b93-4166-829f-3485f71a24aa tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:27.950776 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-f1aba82b-7b93-4166-829f-3485f71a24aa tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: 3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:27.957266 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f1aba82b-7b93-4166-829f-3485f71a24aa tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:27.957971 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f1aba82b-7b93-4166-829f-3485f71a24aa tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:27.959020 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f1aba82b-7b93-4166-829f-3485f71a24aa tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:27.960520 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f1aba82b-7b93-4166-829f-3485f71a24aa tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:27.960916 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f1aba82b-7b93-4166-829f-3485f71a24aa tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:27.961682 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f1aba82b-7b93-4166-829f-3485f71a24aa tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:27.978413 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-f1aba82b-7b93-4166-829f-3485f71a24aa tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] HTTP exception thrown: Instance 3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff could not be found. Oct 04 19:03:27.980126 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f1aba82b-7b93-4166-829f-3485f71a24aa tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Request method failure captured: Oct 04 19:03:27.980126 n-d-851028-13 devstack@n-api.service[123596]: request: GET /compute/v2.1/servers/3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff HTTP/1.1 Oct 04 19:03:27.980126 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 19:03:27.980126 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 19:03:27.980126 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 19:03:27.980126 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 19:03:27.980126 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 19:03:27.980126 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 19:03:27.980126 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 19:03:27.980126 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 19:03:27.980126 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPIKl7r6ZFtp0u4zXtNLGIhqHo70GyUJnklFY8mLM6SAvqzMqMYlk7FNNMFRu1dxhVJoaHCY-KymtUU7SbzcnaY3gmI4NmuaRKJjk_WfnM3eNlWdo1XIjmy2xIfTxketrHpoedtH-76PD0N1ebOmJq-sWqhFc1j62MJ2QKuwEgYmouJ4 Oct 04 19:03:27.980126 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 19:03:27.980126 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 19:03:27.980126 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 19:03:27.980126 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 19:03:27.980126 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 19:03:27.980126 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 19:03:27.980126 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: a6a711601b7a439caf395233de1febff Oct 04 19:03:27.980126 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-DeleteServersTestJSON-591734195 Oct 04 19:03:27.980126 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 19:03:27.980126 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 19:03:27.980126 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/a6a711601b7a439caf395233de1febff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_a6a711601b7a439caf395233de1febff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a6a711601b7a439caf395233de1febff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a6a711601b7a439caf395233de1febff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 19:03:27.980126 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-DeleteServersTestJSON-591734195 Oct 04 19:03:27.980126 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: a6a711601b7a439caf395233de1febff Oct 04 19:03:27.980126 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-DeleteServersTestJSON-591734195 Oct 04 19:03:27.980126 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-DeleteServersTestJSON-591734195-project Oct 04 19:03:27.980126 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 19:03:27.980126 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 19:03:27.980126 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: c997bc60473b43fd9fcf0c65111c44c0 Oct 04 19:03:27.980126 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-DeleteServersTestJSON-591734195-project Oct 04 19:03:27.980126 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 19:03:27.980126 n-d-851028-13 devstack@n-api.service[123596]: exception: Instance 3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff could not be found. Oct 04 19:03:27.980126 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': '3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff'} Oct 04 19:03:27.980126 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:03:27.980126 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:03:27.980126 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:03:27.980126 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:03:27.980126 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:03:27.980126 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:03:27.980126 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:03:27.980126 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:03:27.980126 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:03:27.980126 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:03:27.980126 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff could not be found. Oct 04 19:03:27.980126 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:03:27.980126 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:03:27.980126 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:03:27.980126 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:03:27.980126 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:03:27.980126 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:03:27.980126 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:03:27.980126 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:03:27.980126 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:03:27.980126 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:03:27.980126 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:03:27.980126 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:03:27.980126 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:03:27.980126 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:03:27.980126 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:03:27.980126 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:03:27.980126 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff could not be found. Oct 04 19:03:27.980126 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:03:27.980126 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:03:27.980126 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:03:27.989784 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:03:27.989784 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:03:27.989784 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:03:27.989784 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:03:27.989784 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:03:27.989784 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff could not be found. Oct 04 19:03:27.989784 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:03:27.989784 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f1aba82b-7b93-4166-829f-3485f71a24aa tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Returning 404 to user: Instance 3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff could not be found. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:03:27.989784 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-f1aba82b-7b93-4166-829f-3485f71a24aa tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "GET /compute/v2.1/servers/3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff" status: 404 len: 111 microversion: 2.1 time: 0.036018 Oct 04 19:03:27.989784 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3045/5726] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:03:27 2022] GET /compute/v2.1/servers/3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:03:28.127777 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-40d18759-7f99-47a0-b5b6-7a840bb858c2 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1592281427", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452", "networks": [{"uuid": "dcd99798-7080-4c74-b648-36288a298add"}]}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:03:28.197590 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.network.neutron [None req-40d18759-7f99-47a0-b5b6-7a840bb858c2 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] validate_networks() for [('dcd99798-7080-4c74-b648-36288a298add', None, None, None, None, None)] {{(pid=123595) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 19:03:28.660121 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-0dcd81ef-a9d2-4a4f-b4ed-599835e1a1ce tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:28.661349 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-0dcd81ef-a9d2-4a4f-b4ed-599835e1a1ce tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] [instance: f264d970-6336-460a-88f8-cfee793a20dd] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:28.668010 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=10 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:03:28.671315 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0dcd81ef-a9d2-4a4f-b4ed-599835e1a1ce tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:28.672327 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0dcd81ef-a9d2-4a4f-b4ed-599835e1a1ce tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:28.672984 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0dcd81ef-a9d2-4a4f-b4ed-599835e1a1ce tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:28.673956 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0dcd81ef-a9d2-4a4f-b4ed-599835e1a1ce tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:28.674618 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0dcd81ef-a9d2-4a4f-b4ed-599835e1a1ce tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:28.675255 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0dcd81ef-a9d2-4a4f-b4ed-599835e1a1ce tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:28.702932 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-40d18759-7f99-47a0-b5b6-7a840bb858c2 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Flavor limits 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:03:28.703369 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-40d18759-7f99-47a0-b5b6-7a840bb858c2 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Image limits 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:03:28.704384 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-40d18759-7f99-47a0-b5b6-7a840bb858c2 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Flavor pref 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:03:28.705046 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-40d18759-7f99-47a0-b5b6-7a840bb858c2 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Image pref 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:03:28.705507 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-40d18759-7f99-47a0-b5b6-7a840bb858c2 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:03:28.720106 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-40d18759-7f99-47a0-b5b6-7a840bb858c2 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:28.720609 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-40d18759-7f99-47a0-b5b6-7a840bb858c2 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:28.721062 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-40d18759-7f99-47a0-b5b6-7a840bb858c2 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:28.725195 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-40d18759-7f99-47a0-b5b6-7a840bb858c2 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:28.725890 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-40d18759-7f99-47a0-b5b6-7a840bb858c2 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:28.726506 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-40d18759-7f99-47a0-b5b6-7a840bb858c2 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:28.758440 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-40d18759-7f99-47a0-b5b6-7a840bb858c2 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Getting quotas for project a6a711601b7a439caf395233de1febff. Resources: {'ram', 'cores', 'instances'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:03:28.765584 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-40d18759-7f99-47a0-b5b6-7a840bb858c2 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Getting quotas for user c997bc60473b43fd9fcf0c65111c44c0 and project a6a711601b7a439caf395233de1febff. Resources: {'ram', 'cores', 'instances'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:03:28.787625 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-40d18759-7f99-47a0-b5b6-7a840bb858c2 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Going to run 1 instances... {{(pid=123595) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 19:03:28.790667 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-40d18759-7f99-47a0-b5b6-7a840bb858c2 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: 3e01483e-8f33-43df-97b1-70f0834ac07d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e8943ec5-4038-4d4b-b9b9-2415a79f5243',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 19:03:28.799625 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-0dcd81ef-a9d2-4a4f-b4ed-599835e1a1ce tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b1a7754d7344f08ae1b3ef134339ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bd7c2243464924b04efd5a343d5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:28.811886 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-0dcd81ef-a9d2-4a4f-b4ed-599835e1a1ce tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b1a7754d7344f08ae1b3ef134339ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bd7c2243464924b04efd5a343d5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:28.814078 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-0dcd81ef-a9d2-4a4f-b4ed-599835e1a1ce tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b1a7754d7344f08ae1b3ef134339ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bd7c2243464924b04efd5a343d5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:28.815725 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-0dcd81ef-a9d2-4a4f-b4ed-599835e1a1ce tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] 10.222.0.43 "GET /compute/v2.1/servers/f264d970-6336-460a-88f8-cfee793a20dd" status: 200 len: 1365 microversion: 2.57 time: 0.160037 Oct 04 19:03:28.817069 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3046/5727] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:03:28 2022] GET /compute/v2.1/servers/f264d970-6336-460a-88f8-cfee793a20dd => generated 1365 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:03:28.880000 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-40d18759-7f99-47a0-b5b6-7a840bb858c2 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.757921 Oct 04 19:03:28.882026 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2682/5728] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 19:03:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 760 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 19:03:28.896144 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-c01be402-0207-4e24-800c-3317d976b2e4 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:28.897018 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-c01be402-0207-4e24-800c-3317d976b2e4 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: 3e01483e-8f33-43df-97b1-70f0834ac07d] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:28.979138 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-c01be402-0207-4e24-800c-3317d976b2e4 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c997bc60473b43fd9fcf0c65111c44c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a711601b7a439caf395233de1febff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:28.992072 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-c01be402-0207-4e24-800c-3317d976b2e4 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "GET /compute/v2.1/servers/3e01483e-8f33-43df-97b1-70f0834ac07d" status: 200 len: 1215 microversion: 2.1 time: 0.100229 Oct 04 19:03:28.994572 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3047/5729] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:03:28 2022] GET /compute/v2.1/servers/3e01483e-8f33-43df-97b1-70f0834ac07d => generated 1215 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:03:29.843942 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-0e8a58cb-8ba2-4067-a327-98779189dd47 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:29.844955 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-0e8a58cb-8ba2-4067-a327-98779189dd47 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] [instance: f264d970-6336-460a-88f8-cfee793a20dd] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:29.860916 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0e8a58cb-8ba2-4067-a327-98779189dd47 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:29.861867 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0e8a58cb-8ba2-4067-a327-98779189dd47 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:29.865102 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0e8a58cb-8ba2-4067-a327-98779189dd47 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:29.866968 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0e8a58cb-8ba2-4067-a327-98779189dd47 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:29.871729 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0e8a58cb-8ba2-4067-a327-98779189dd47 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:29.872456 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0e8a58cb-8ba2-4067-a327-98779189dd47 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:29.993386 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-0e8a58cb-8ba2-4067-a327-98779189dd47 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b1a7754d7344f08ae1b3ef134339ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bd7c2243464924b04efd5a343d5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:30.011544 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-0e8a58cb-8ba2-4067-a327-98779189dd47 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b1a7754d7344f08ae1b3ef134339ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bd7c2243464924b04efd5a343d5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:30.019760 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-98be8f7b-1eea-4619-b0e4-434c1f8a489b tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:30.020472 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-98be8f7b-1eea-4619-b0e4-434c1f8a489b tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: 3e01483e-8f33-43df-97b1-70f0834ac07d] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:30.052381 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-0e8a58cb-8ba2-4067-a327-98779189dd47 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b1a7754d7344f08ae1b3ef134339ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bd7c2243464924b04efd5a343d5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:30.053466 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=3 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:03:30.055400 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-0e8a58cb-8ba2-4067-a327-98779189dd47 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] 10.222.0.43 "GET /compute/v2.1/servers/f264d970-6336-460a-88f8-cfee793a20dd" status: 200 len: 1365 microversion: 2.57 time: 0.211257 Oct 04 19:03:30.058187 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2683/5730] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:03:29 2022] GET /compute/v2.1/servers/f264d970-6336-460a-88f8-cfee793a20dd => generated 1365 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:03:30.059812 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-98be8f7b-1eea-4619-b0e4-434c1f8a489b tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:30.061076 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-98be8f7b-1eea-4619-b0e4-434c1f8a489b tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:30.077612 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-98be8f7b-1eea-4619-b0e4-434c1f8a489b tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:30.078440 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-98be8f7b-1eea-4619-b0e4-434c1f8a489b tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:30.086453 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-98be8f7b-1eea-4619-b0e4-434c1f8a489b tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:30.088116 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-98be8f7b-1eea-4619-b0e4-434c1f8a489b tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:30.216135 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-98be8f7b-1eea-4619-b0e4-434c1f8a489b tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c997bc60473b43fd9fcf0c65111c44c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a711601b7a439caf395233de1febff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:30.226560 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-98be8f7b-1eea-4619-b0e4-434c1f8a489b tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "GET /compute/v2.1/servers/3e01483e-8f33-43df-97b1-70f0834ac07d" status: 200 len: 1267 microversion: 2.1 time: 0.210673 Oct 04 19:03:30.227752 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3048/5731] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:03:30 2022] GET /compute/v2.1/servers/3e01483e-8f33-43df-97b1-70f0834ac07d => generated 1267 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:03:31.090940 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-33250031-51ea-43e6-9606-394d246862f8 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:31.092392 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-33250031-51ea-43e6-9606-394d246862f8 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] [instance: f264d970-6336-460a-88f8-cfee793a20dd] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:31.113316 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-33250031-51ea-43e6-9606-394d246862f8 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:31.115447 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-33250031-51ea-43e6-9606-394d246862f8 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:31.118243 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-33250031-51ea-43e6-9606-394d246862f8 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:31.121421 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-33250031-51ea-43e6-9606-394d246862f8 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:31.123271 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-33250031-51ea-43e6-9606-394d246862f8 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:31.123944 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-33250031-51ea-43e6-9606-394d246862f8 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:31.253425 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-df0fa96a-97a5-4e7a-b0f1-8ec0c732e8b6 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:31.259032 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-33250031-51ea-43e6-9606-394d246862f8 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b1a7754d7344f08ae1b3ef134339ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bd7c2243464924b04efd5a343d5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:31.262929 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-df0fa96a-97a5-4e7a-b0f1-8ec0c732e8b6 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: 3e01483e-8f33-43df-97b1-70f0834ac07d] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:31.277373 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-33250031-51ea-43e6-9606-394d246862f8 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b1a7754d7344f08ae1b3ef134339ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bd7c2243464924b04efd5a343d5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:31.282815 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-df0fa96a-97a5-4e7a-b0f1-8ec0c732e8b6 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:31.286870 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-df0fa96a-97a5-4e7a-b0f1-8ec0c732e8b6 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:31.287334 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-df0fa96a-97a5-4e7a-b0f1-8ec0c732e8b6 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:31.288811 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-df0fa96a-97a5-4e7a-b0f1-8ec0c732e8b6 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:31.289246 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-33250031-51ea-43e6-9606-394d246862f8 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b1a7754d7344f08ae1b3ef134339ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bd7c2243464924b04efd5a343d5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:31.290890 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-33250031-51ea-43e6-9606-394d246862f8 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] 10.222.0.43 "GET /compute/v2.1/servers/f264d970-6336-460a-88f8-cfee793a20dd" status: 200 len: 1365 microversion: 2.57 time: 0.212823 Oct 04 19:03:31.305151 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2684/5732] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:03:31 2022] GET /compute/v2.1/servers/f264d970-6336-460a-88f8-cfee793a20dd => generated 1365 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:03:31.305390 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-df0fa96a-97a5-4e7a-b0f1-8ec0c732e8b6 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:31.305390 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-df0fa96a-97a5-4e7a-b0f1-8ec0c732e8b6 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:31.443711 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-df0fa96a-97a5-4e7a-b0f1-8ec0c732e8b6 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c997bc60473b43fd9fcf0c65111c44c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a711601b7a439caf395233de1febff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:31.455202 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-df0fa96a-97a5-4e7a-b0f1-8ec0c732e8b6 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "GET /compute/v2.1/servers/3e01483e-8f33-43df-97b1-70f0834ac07d" status: 200 len: 1273 microversion: 2.1 time: 0.207151 Oct 04 19:03:31.471240 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3049/5733] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:03:31 2022] GET /compute/v2.1/servers/3e01483e-8f33-43df-97b1-70f0834ac07d => generated 1273 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:03:32.057490 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-711ef096-b171-4e00-bcb6-8f17be15303a tempest-TestNetworkAdvancedServerOps-1915185768 tempest-TestNetworkAdvancedServerOps-1915185768-project-admin] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:32.058118 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-711ef096-b171-4e00-bcb6-8f17be15303a tempest-TestNetworkAdvancedServerOps-1915185768 tempest-TestNetworkAdvancedServerOps-1915185768-project-admin] [instance: 32f44032-85ec-43eb-b714-748a7f4f0b5b] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:32.071998 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-711ef096-b171-4e00-bcb6-8f17be15303a tempest-TestNetworkAdvancedServerOps-1915185768 tempest-TestNetworkAdvancedServerOps-1915185768-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:32.072507 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-711ef096-b171-4e00-bcb6-8f17be15303a tempest-TestNetworkAdvancedServerOps-1915185768 tempest-TestNetworkAdvancedServerOps-1915185768-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:32.072949 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-711ef096-b171-4e00-bcb6-8f17be15303a tempest-TestNetworkAdvancedServerOps-1915185768 tempest-TestNetworkAdvancedServerOps-1915185768-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:32.082086 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-711ef096-b171-4e00-bcb6-8f17be15303a tempest-TestNetworkAdvancedServerOps-1915185768 tempest-TestNetworkAdvancedServerOps-1915185768-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:32.082792 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-711ef096-b171-4e00-bcb6-8f17be15303a tempest-TestNetworkAdvancedServerOps-1915185768 tempest-TestNetworkAdvancedServerOps-1915185768-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:32.086509 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-711ef096-b171-4e00-bcb6-8f17be15303a tempest-TestNetworkAdvancedServerOps-1915185768 tempest-TestNetworkAdvancedServerOps-1915185768-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:32.322504 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-ab778616-999d-4773-9ddb-827a9d020359 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:32.323430 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-ab778616-999d-4773-9ddb-827a9d020359 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] [instance: f264d970-6336-460a-88f8-cfee793a20dd] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:32.335428 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ab778616-999d-4773-9ddb-827a9d020359 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:32.335636 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ab778616-999d-4773-9ddb-827a9d020359 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:32.336084 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ab778616-999d-4773-9ddb-827a9d020359 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:32.336799 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ab778616-999d-4773-9ddb-827a9d020359 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:32.337277 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ab778616-999d-4773-9ddb-827a9d020359 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:32.338031 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ab778616-999d-4773-9ddb-827a9d020359 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:32.367526 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-711ef096-b171-4e00-bcb6-8f17be15303a tempest-TestNetworkAdvancedServerOps-1915185768 tempest-TestNetworkAdvancedServerOps-1915185768-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/32f44032-85ec-43eb-b714-748a7f4f0b5b" status: 200 len: 1835 microversion: 2.1 time: 0.320619 Oct 04 19:03:32.370474 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2685/5734] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:03:32 2022] GET /compute/v2.1/servers/32f44032-85ec-43eb-b714-748a7f4f0b5b => generated 1835 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:03:32.482646 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-6418fa30-8b98-4b58-af06-027ed26dcad8 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:32.483269 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-6418fa30-8b98-4b58-af06-027ed26dcad8 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: 3e01483e-8f33-43df-97b1-70f0834ac07d] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:32.493585 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6418fa30-8b98-4b58-af06-027ed26dcad8 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:32.494088 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6418fa30-8b98-4b58-af06-027ed26dcad8 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:32.494534 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6418fa30-8b98-4b58-af06-027ed26dcad8 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:32.499601 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6418fa30-8b98-4b58-af06-027ed26dcad8 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:32.500319 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6418fa30-8b98-4b58-af06-027ed26dcad8 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:32.500934 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6418fa30-8b98-4b58-af06-027ed26dcad8 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:32.505719 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=16,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:03:32.674257 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-ab778616-999d-4773-9ddb-827a9d020359 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b1a7754d7344f08ae1b3ef134339ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bd7c2243464924b04efd5a343d5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:32.687030 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-ab778616-999d-4773-9ddb-827a9d020359 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b1a7754d7344f08ae1b3ef134339ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bd7c2243464924b04efd5a343d5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:32.691683 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-ab778616-999d-4773-9ddb-827a9d020359 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b1a7754d7344f08ae1b3ef134339ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bd7c2243464924b04efd5a343d5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:32.693150 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-ab778616-999d-4773-9ddb-827a9d020359 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] 10.222.0.43 "GET /compute/v2.1/servers/f264d970-6336-460a-88f8-cfee793a20dd" status: 200 len: 1365 microversion: 2.57 time: 0.376598 Oct 04 19:03:32.695588 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3050/5735] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:03:32 2022] GET /compute/v2.1/servers/f264d970-6336-460a-88f8-cfee793a20dd => generated 1365 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:03:32.927166 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-6418fa30-8b98-4b58-af06-027ed26dcad8 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c997bc60473b43fd9fcf0c65111c44c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a711601b7a439caf395233de1febff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:32.942277 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-6418fa30-8b98-4b58-af06-027ed26dcad8 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "GET /compute/v2.1/servers/3e01483e-8f33-43df-97b1-70f0834ac07d" status: 200 len: 1315 microversion: 2.1 time: 0.463255 Oct 04 19:03:32.943289 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2686/5736] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:03:32 2022] GET /compute/v2.1/servers/3e01483e-8f33-43df-97b1-70f0834ac07d => generated 1315 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:03:33.418600 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-ba61451d-6589-4bb4-89a3-f36f1351948e req-8538514f-b70c-48f4-a715-347ecfa41411 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e01483e-8f33-43df-97b1-70f0834ac07d", "tag": "1757a81c-3646-4099-a814-204aa7096c72"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:03:33.429803 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-ba61451d-6589-4bb4-89a3-f36f1351948e req-8538514f-b70c-48f4-a715-347ecfa41411 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:33.430740 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-ba61451d-6589-4bb4-89a3-f36f1351948e req-8538514f-b70c-48f4-a715-347ecfa41411 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:33.431528 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-ba61451d-6589-4bb4-89a3-f36f1351948e req-8538514f-b70c-48f4-a715-347ecfa41411 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:33.445782 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-ba61451d-6589-4bb4-89a3-f36f1351948e req-8538514f-b70c-48f4-a715-347ecfa41411 service nova] Creating event network-changed:1757a81c-3646-4099-a814-204aa7096c72 for instance 3e01483e-8f33-43df-97b1-70f0834ac07d on n-h1-851028-13 Oct 04 19:03:33.459413 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-ba61451d-6589-4bb4-89a3-f36f1351948e req-8538514f-b70c-48f4-a715-347ecfa41411 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044339 Oct 04 19:03:33.466257 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3051/5737] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:03:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:03:33.727726 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-aa43b357-762d-4e18-97d6-856340c1443e tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:33.729243 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-aa43b357-762d-4e18-97d6-856340c1443e tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] [instance: f264d970-6336-460a-88f8-cfee793a20dd] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:33.741379 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-aa43b357-762d-4e18-97d6-856340c1443e tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:33.742651 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-aa43b357-762d-4e18-97d6-856340c1443e tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:33.743459 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-aa43b357-762d-4e18-97d6-856340c1443e tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:33.744976 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-aa43b357-762d-4e18-97d6-856340c1443e tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:33.745656 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-aa43b357-762d-4e18-97d6-856340c1443e tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:33.747864 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-aa43b357-762d-4e18-97d6-856340c1443e tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:33.845634 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-aa43b357-762d-4e18-97d6-856340c1443e tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b1a7754d7344f08ae1b3ef134339ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bd7c2243464924b04efd5a343d5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:33.858414 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-aa43b357-762d-4e18-97d6-856340c1443e tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b1a7754d7344f08ae1b3ef134339ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bd7c2243464924b04efd5a343d5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:33.860539 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-aa43b357-762d-4e18-97d6-856340c1443e tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b1a7754d7344f08ae1b3ef134339ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bd7c2243464924b04efd5a343d5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:33.861905 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-aa43b357-762d-4e18-97d6-856340c1443e tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] 10.222.0.43 "GET /compute/v2.1/servers/f264d970-6336-460a-88f8-cfee793a20dd" status: 200 len: 1365 microversion: 2.57 time: 0.139500 Oct 04 19:03:33.865238 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2687/5738] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:03:33 2022] GET /compute/v2.1/servers/f264d970-6336-460a-88f8-cfee793a20dd => generated 1365 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:03:33.967743 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-d7998fe5-ac3f-4ec9-ba62-57413bfbfbb3 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:33.968480 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-d7998fe5-ac3f-4ec9-ba62-57413bfbfbb3 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: 3e01483e-8f33-43df-97b1-70f0834ac07d] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:33.989888 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d7998fe5-ac3f-4ec9-ba62-57413bfbfbb3 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:33.992697 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d7998fe5-ac3f-4ec9-ba62-57413bfbfbb3 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:33.993398 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d7998fe5-ac3f-4ec9-ba62-57413bfbfbb3 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:33.994339 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d7998fe5-ac3f-4ec9-ba62-57413bfbfbb3 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:34.000472 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d7998fe5-ac3f-4ec9-ba62-57413bfbfbb3 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:34.001518 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d7998fe5-ac3f-4ec9-ba62-57413bfbfbb3 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:34.288369 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-d7998fe5-ac3f-4ec9-ba62-57413bfbfbb3 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c997bc60473b43fd9fcf0c65111c44c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a711601b7a439caf395233de1febff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:34.291631 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-0b90837e-126c-402e-8fbd-dd3e48528893 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:34.292234 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-0b90837e-126c-402e-8fbd-dd3e48528893 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] [instance: 32f44032-85ec-43eb-b714-748a7f4f0b5b] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:34.301101 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0b90837e-126c-402e-8fbd-dd3e48528893 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:34.301896 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0b90837e-126c-402e-8fbd-dd3e48528893 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:34.302416 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0b90837e-126c-402e-8fbd-dd3e48528893 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:34.303296 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0b90837e-126c-402e-8fbd-dd3e48528893 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:34.303806 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0b90837e-126c-402e-8fbd-dd3e48528893 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:34.304361 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0b90837e-126c-402e-8fbd-dd3e48528893 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:34.314058 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-d7998fe5-ac3f-4ec9-ba62-57413bfbfbb3 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "GET /compute/v2.1/servers/3e01483e-8f33-43df-97b1-70f0834ac07d" status: 200 len: 1315 microversion: 2.1 time: 0.351481 Oct 04 19:03:34.330477 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3052/5739] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:03:33 2022] GET /compute/v2.1/servers/3e01483e-8f33-43df-97b1-70f0834ac07d => generated 1315 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:03:34.347274 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-0b90837e-126c-402e-8fbd-dd3e48528893 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] [instance: 32f44032-85ec-43eb-b714-748a7f4f0b5b] Going to try to terminate instance {{(pid=123595) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 19:03:34.497036 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-0b90837e-126c-402e-8fbd-dd3e48528893 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] 10.222.0.43 "DELETE /compute/v2.1/servers/32f44032-85ec-43eb-b714-748a7f4f0b5b" status: 204 len: 0 microversion: 2.1 time: 0.209764 Oct 04 19:03:34.498335 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2688/5740] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 19:03:34 2022] DELETE /compute/v2.1/servers/32f44032-85ec-43eb-b714-748a7f4f0b5b => generated 0 bytes in 212 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 19:03:34.507819 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-80499199-cd4e-4aa6-8ffe-a16991f4b51f tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:34.508451 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-80499199-cd4e-4aa6-8ffe-a16991f4b51f tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] [instance: 32f44032-85ec-43eb-b714-748a7f4f0b5b] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:34.549626 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-80499199-cd4e-4aa6-8ffe-a16991f4b51f tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:34.552845 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-80499199-cd4e-4aa6-8ffe-a16991f4b51f tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:34.555651 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-80499199-cd4e-4aa6-8ffe-a16991f4b51f tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:34.559917 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-80499199-cd4e-4aa6-8ffe-a16991f4b51f tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:34.564816 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-80499199-cd4e-4aa6-8ffe-a16991f4b51f tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:34.566087 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-80499199-cd4e-4aa6-8ffe-a16991f4b51f tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:34.825072 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-80499199-cd4e-4aa6-8ffe-a16991f4b51f tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf87794979e844349d6ec6c6650565f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c25f1d17e94c74868357744e692487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:34.843223 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-80499199-cd4e-4aa6-8ffe-a16991f4b51f tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] 10.222.0.43 "GET /compute/v2.1/servers/32f44032-85ec-43eb-b714-748a7f4f0b5b" status: 200 len: 1688 microversion: 2.1 time: 0.340724 Oct 04 19:03:34.844007 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3053/5741] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:03:34 2022] GET /compute/v2.1/servers/32f44032-85ec-43eb-b714-748a7f4f0b5b => generated 1688 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:03:34.894525 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-3d4497e7-e162-4fbb-aaac-8f8ff2957881 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:34.895315 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-3d4497e7-e162-4fbb-aaac-8f8ff2957881 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] [instance: f264d970-6336-460a-88f8-cfee793a20dd] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:34.909302 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:03:34.924482 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3d4497e7-e162-4fbb-aaac-8f8ff2957881 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:34.925056 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3d4497e7-e162-4fbb-aaac-8f8ff2957881 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:34.929339 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3d4497e7-e162-4fbb-aaac-8f8ff2957881 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:34.930899 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3d4497e7-e162-4fbb-aaac-8f8ff2957881 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:34.931523 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3d4497e7-e162-4fbb-aaac-8f8ff2957881 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:34.931984 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3d4497e7-e162-4fbb-aaac-8f8ff2957881 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:35.054208 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-3d4497e7-e162-4fbb-aaac-8f8ff2957881 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b1a7754d7344f08ae1b3ef134339ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bd7c2243464924b04efd5a343d5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:35.068741 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-3d4497e7-e162-4fbb-aaac-8f8ff2957881 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b1a7754d7344f08ae1b3ef134339ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bd7c2243464924b04efd5a343d5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:35.070910 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-3d4497e7-e162-4fbb-aaac-8f8ff2957881 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b1a7754d7344f08ae1b3ef134339ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bd7c2243464924b04efd5a343d5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:35.072140 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-3d4497e7-e162-4fbb-aaac-8f8ff2957881 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] 10.222.0.43 "GET /compute/v2.1/servers/f264d970-6336-460a-88f8-cfee793a20dd" status: 200 len: 1365 microversion: 2.57 time: 0.183603 Oct 04 19:03:35.072712 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2689/5742] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:03:34 2022] GET /compute/v2.1/servers/f264d970-6336-460a-88f8-cfee793a20dd => generated 1365 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:03:35.340831 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-bd750815-bca7-4b04-90d0-2ae0c701f1f4 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:35.341711 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-bd750815-bca7-4b04-90d0-2ae0c701f1f4 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: 3e01483e-8f33-43df-97b1-70f0834ac07d] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:35.354134 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bd750815-bca7-4b04-90d0-2ae0c701f1f4 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:35.354661 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bd750815-bca7-4b04-90d0-2ae0c701f1f4 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:35.355095 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bd750815-bca7-4b04-90d0-2ae0c701f1f4 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:35.355814 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bd750815-bca7-4b04-90d0-2ae0c701f1f4 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:35.356272 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bd750815-bca7-4b04-90d0-2ae0c701f1f4 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:35.356708 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bd750815-bca7-4b04-90d0-2ae0c701f1f4 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:35.482613 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-77a04614-465c-4810-a533-0d8096f0b443 req-79c60e3b-7f60-424e-9bcb-15781523d739 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32f44032-85ec-43eb-b714-748a7f4f0b5b", "tag": "d12de55b-02be-4f93-aca2-a6044af93e38"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:03:35.501602 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-77a04614-465c-4810-a533-0d8096f0b443 req-79c60e3b-7f60-424e-9bcb-15781523d739 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:35.501981 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-77a04614-465c-4810-a533-0d8096f0b443 req-79c60e3b-7f60-424e-9bcb-15781523d739 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:35.502423 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-77a04614-465c-4810-a533-0d8096f0b443 req-79c60e3b-7f60-424e-9bcb-15781523d739 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:35.528449 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-77a04614-465c-4810-a533-0d8096f0b443 req-79c60e3b-7f60-424e-9bcb-15781523d739 service nova] Creating event network-changed:d12de55b-02be-4f93-aca2-a6044af93e38 for instance 32f44032-85ec-43eb-b714-748a7f4f0b5b on n-h2-851028-13 Oct 04 19:03:35.537122 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-77a04614-465c-4810-a533-0d8096f0b443 req-79c60e3b-7f60-424e-9bcb-15781523d739 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058111 Oct 04 19:03:35.538382 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2690/5743] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:03:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:03:35.869225 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-54104cbd-f3ad-454b-8db8-59bf92230ded tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:35.870244 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-54104cbd-f3ad-454b-8db8-59bf92230ded tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] [instance: 32f44032-85ec-43eb-b714-748a7f4f0b5b] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:35.885487 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-54104cbd-f3ad-454b-8db8-59bf92230ded tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:35.886231 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-54104cbd-f3ad-454b-8db8-59bf92230ded tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:35.886845 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-54104cbd-f3ad-454b-8db8-59bf92230ded tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:35.887754 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-54104cbd-f3ad-454b-8db8-59bf92230ded tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:35.888366 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-54104cbd-f3ad-454b-8db8-59bf92230ded tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:35.888956 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-54104cbd-f3ad-454b-8db8-59bf92230ded tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:36.325529 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-bd750815-bca7-4b04-90d0-2ae0c701f1f4 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c997bc60473b43fd9fcf0c65111c44c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a711601b7a439caf395233de1febff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:36.338600 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-bd750815-bca7-4b04-90d0-2ae0c701f1f4 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "GET /compute/v2.1/servers/3e01483e-8f33-43df-97b1-70f0834ac07d" status: 200 len: 1315 microversion: 2.1 time: 0.999044 Oct 04 19:03:36.340887 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3054/5744] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:03:35 2022] GET /compute/v2.1/servers/3e01483e-8f33-43df-97b1-70f0834ac07d => generated 1315 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:03:36.352845 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-74f7b3fe-0a54-4881-be3a-c6ffe9bb918c tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:36.353726 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-74f7b3fe-0a54-4881-be3a-c6ffe9bb918c tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] [instance: f264d970-6336-460a-88f8-cfee793a20dd] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:36.370205 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-74f7b3fe-0a54-4881-be3a-c6ffe9bb918c tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:36.371254 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-74f7b3fe-0a54-4881-be3a-c6ffe9bb918c tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:36.371914 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-74f7b3fe-0a54-4881-be3a-c6ffe9bb918c tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:36.373567 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-74f7b3fe-0a54-4881-be3a-c6ffe9bb918c tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:36.375250 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-74f7b3fe-0a54-4881-be3a-c6ffe9bb918c tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:36.376419 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-74f7b3fe-0a54-4881-be3a-c6ffe9bb918c tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:36.391418 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:03:36.484375 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-54104cbd-f3ad-454b-8db8-59bf92230ded tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf87794979e844349d6ec6c6650565f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c25f1d17e94c74868357744e692487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:36.500641 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-54104cbd-f3ad-454b-8db8-59bf92230ded tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] 10.222.0.43 "GET /compute/v2.1/servers/32f44032-85ec-43eb-b714-748a7f4f0b5b" status: 200 len: 1688 microversion: 2.1 time: 0.636249 Oct 04 19:03:36.501583 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2691/5745] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:03:35 2022] GET /compute/v2.1/servers/32f44032-85ec-43eb-b714-748a7f4f0b5b => generated 1688 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:03:36.545020 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-74f7b3fe-0a54-4881-be3a-c6ffe9bb918c tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b1a7754d7344f08ae1b3ef134339ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bd7c2243464924b04efd5a343d5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:36.561593 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-74f7b3fe-0a54-4881-be3a-c6ffe9bb918c tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b1a7754d7344f08ae1b3ef134339ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bd7c2243464924b04efd5a343d5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:36.564204 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-74f7b3fe-0a54-4881-be3a-c6ffe9bb918c tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b1a7754d7344f08ae1b3ef134339ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bd7c2243464924b04efd5a343d5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:36.565893 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-74f7b3fe-0a54-4881-be3a-c6ffe9bb918c tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] 10.222.0.43 "GET /compute/v2.1/servers/f264d970-6336-460a-88f8-cfee793a20dd" status: 200 len: 1365 microversion: 2.57 time: 0.223696 Oct 04 19:03:36.567553 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3055/5746] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:03:36 2022] GET /compute/v2.1/servers/f264d970-6336-460a-88f8-cfee793a20dd => generated 1365 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:03:37.363920 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-0cbd2c70-d607-43a3-a8a4-0dc60b483e68 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:37.364606 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-0cbd2c70-d607-43a3-a8a4-0dc60b483e68 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: 3e01483e-8f33-43df-97b1-70f0834ac07d] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:37.372885 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0cbd2c70-d607-43a3-a8a4-0dc60b483e68 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:37.373529 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0cbd2c70-d607-43a3-a8a4-0dc60b483e68 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:37.374251 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0cbd2c70-d607-43a3-a8a4-0dc60b483e68 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:37.375314 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0cbd2c70-d607-43a3-a8a4-0dc60b483e68 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:37.376018 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0cbd2c70-d607-43a3-a8a4-0dc60b483e68 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:37.376685 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0cbd2c70-d607-43a3-a8a4-0dc60b483e68 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:37.554711 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-0cbd2c70-d607-43a3-a8a4-0dc60b483e68 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c997bc60473b43fd9fcf0c65111c44c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a711601b7a439caf395233de1febff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:37.565681 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-0cbd2c70-d607-43a3-a8a4-0dc60b483e68 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "GET /compute/v2.1/servers/3e01483e-8f33-43df-97b1-70f0834ac07d" status: 200 len: 1315 microversion: 2.1 time: 0.205922 Oct 04 19:03:37.566833 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2692/5747] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:03:37 2022] GET /compute/v2.1/servers/3e01483e-8f33-43df-97b1-70f0834ac07d => generated 1315 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:03:37.572171 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-6f089bd6-9945-448b-ab48-2caa11a6cf80 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:37.572985 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-6f089bd6-9945-448b-ab48-2caa11a6cf80 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] [instance: 32f44032-85ec-43eb-b714-748a7f4f0b5b] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:37.580734 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6f089bd6-9945-448b-ab48-2caa11a6cf80 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:37.581967 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6f089bd6-9945-448b-ab48-2caa11a6cf80 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:37.582659 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6f089bd6-9945-448b-ab48-2caa11a6cf80 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:37.583573 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6f089bd6-9945-448b-ab48-2caa11a6cf80 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:37.584415 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6f089bd6-9945-448b-ab48-2caa11a6cf80 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:37.585644 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6f089bd6-9945-448b-ab48-2caa11a6cf80 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:37.653182 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6f089bd6-9945-448b-ab48-2caa11a6cf80 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:37.653693 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6f089bd6-9945-448b-ab48-2caa11a6cf80 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:37.654274 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6f089bd6-9945-448b-ab48-2caa11a6cf80 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:37.654940 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.objects.instance [None req-6f089bd6-9945-448b-ab48-2caa11a6cf80 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lazy-loading 'fault' on Instance uuid 32f44032-85ec-43eb-b714-748a7f4f0b5b {{(pid=123595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 19:03:37.705440 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-6f089bd6-9945-448b-ab48-2caa11a6cf80 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf87794979e844349d6ec6c6650565f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c25f1d17e94c74868357744e692487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:37.717280 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-6f089bd6-9945-448b-ab48-2caa11a6cf80 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] 10.222.0.43 "GET /compute/v2.1/servers/32f44032-85ec-43eb-b714-748a7f4f0b5b" status: 200 len: 1356 microversion: 2.1 time: 0.148907 Oct 04 19:03:37.729136 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2693/5748] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:03:37 2022] GET /compute/v2.1/servers/32f44032-85ec-43eb-b714-748a7f4f0b5b => generated 1356 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:03:37.737679 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-cfb08ad1-16b2-48a8-be02-19ffbdf52771 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:37.738728 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-cfb08ad1-16b2-48a8-be02-19ffbdf52771 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] [instance: f264d970-6336-460a-88f8-cfee793a20dd] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:37.764708 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cfb08ad1-16b2-48a8-be02-19ffbdf52771 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:37.768393 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cfb08ad1-16b2-48a8-be02-19ffbdf52771 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:37.769240 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cfb08ad1-16b2-48a8-be02-19ffbdf52771 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:37.769649 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cfb08ad1-16b2-48a8-be02-19ffbdf52771 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:37.770118 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cfb08ad1-16b2-48a8-be02-19ffbdf52771 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:37.776104 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cfb08ad1-16b2-48a8-be02-19ffbdf52771 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:37.818328 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-731f51b4-4263-4b10-a160-0365cc164287 req-c176af76-1ef9-4ff7-b655-9e07029be772 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32f44032-85ec-43eb-b714-748a7f4f0b5b", "name": "network-vif-deleted", "tag": "d12de55b-02be-4f93-aca2-a6044af93e38"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:03:37.836933 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-731f51b4-4263-4b10-a160-0365cc164287 req-c176af76-1ef9-4ff7-b655-9e07029be772 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:37.837634 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-731f51b4-4263-4b10-a160-0365cc164287 req-c176af76-1ef9-4ff7-b655-9e07029be772 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:37.838247 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-731f51b4-4263-4b10-a160-0365cc164287 req-c176af76-1ef9-4ff7-b655-9e07029be772 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:37.868829 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-731f51b4-4263-4b10-a160-0365cc164287 req-c176af76-1ef9-4ff7-b655-9e07029be772 service nova] Creating event network-vif-deleted:d12de55b-02be-4f93-aca2-a6044af93e38 for instance 32f44032-85ec-43eb-b714-748a7f4f0b5b on n-h2-851028-13 Oct 04 19:03:37.876343 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-731f51b4-4263-4b10-a160-0365cc164287 req-c176af76-1ef9-4ff7-b655-9e07029be772 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.398584 Oct 04 19:03:37.887745 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3056/5749] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:03:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:03:37.982557 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-cfb08ad1-16b2-48a8-be02-19ffbdf52771 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b1a7754d7344f08ae1b3ef134339ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bd7c2243464924b04efd5a343d5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:37.992566 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-cfb08ad1-16b2-48a8-be02-19ffbdf52771 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b1a7754d7344f08ae1b3ef134339ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bd7c2243464924b04efd5a343d5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:37.994759 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-cfb08ad1-16b2-48a8-be02-19ffbdf52771 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b1a7754d7344f08ae1b3ef134339ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bd7c2243464924b04efd5a343d5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:37.996357 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-cfb08ad1-16b2-48a8-be02-19ffbdf52771 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] 10.222.0.43 "GET /compute/v2.1/servers/f264d970-6336-460a-88f8-cfee793a20dd" status: 200 len: 1365 microversion: 2.57 time: 0.265709 Oct 04 19:03:37.996939 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2694/5750] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:03:37 2022] GET /compute/v2.1/servers/f264d970-6336-460a-88f8-cfee793a20dd => generated 1365 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:03:38.597186 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-2a0729a3-a141-4e53-9338-1f329b92e402 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:38.597905 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-2a0729a3-a141-4e53-9338-1f329b92e402 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: 3e01483e-8f33-43df-97b1-70f0834ac07d] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:38.611458 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2a0729a3-a141-4e53-9338-1f329b92e402 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:38.614291 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2a0729a3-a141-4e53-9338-1f329b92e402 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:38.614925 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2a0729a3-a141-4e53-9338-1f329b92e402 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:38.615852 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2a0729a3-a141-4e53-9338-1f329b92e402 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:38.619082 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2a0729a3-a141-4e53-9338-1f329b92e402 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:38.620027 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2a0729a3-a141-4e53-9338-1f329b92e402 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:38.758071 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-688878eb-e1df-4458-9778-6d01ad984415 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:38.759637 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-688878eb-e1df-4458-9778-6d01ad984415 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] [instance: 32f44032-85ec-43eb-b714-748a7f4f0b5b] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:38.770467 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=2 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:03:38.773456 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-688878eb-e1df-4458-9778-6d01ad984415 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:38.774824 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-688878eb-e1df-4458-9778-6d01ad984415 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:38.775483 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-688878eb-e1df-4458-9778-6d01ad984415 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:38.777183 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-688878eb-e1df-4458-9778-6d01ad984415 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:38.778404 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-688878eb-e1df-4458-9778-6d01ad984415 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:38.779705 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-688878eb-e1df-4458-9778-6d01ad984415 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:38.804302 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=6 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:03:38.825342 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-688878eb-e1df-4458-9778-6d01ad984415 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] HTTP exception thrown: Instance 32f44032-85ec-43eb-b714-748a7f4f0b5b could not be found. Oct 04 19:03:38.827343 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-688878eb-e1df-4458-9778-6d01ad984415 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Request method failure captured: Oct 04 19:03:38.827343 n-d-851028-13 devstack@n-api.service[123595]: request: GET /compute/v2.1/servers/32f44032-85ec-43eb-b714-748a7f4f0b5b HTTP/1.1 Oct 04 19:03:38.827343 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 19:03:38.827343 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 19:03:38.827343 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 19:03:38.827343 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 0 Oct 04 19:03:38.827343 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 19:03:38.827343 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 19:03:38.827343 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 19:03:38.827343 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 19:03:38.827343 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPILod9KvQgJcndo-fDqHX9zocUdSDU033eT2D_YfhLSFm2T3SN0WEilNuSyZVFJ3atPPN5-bjqRuyPagdPBRhMzT--iezZU7INV-q8_AsQceK3zarsciUbdHJOGGNSClObQM90nB-AfRlEBDQ2E25Vo0hnf-nWJuE-QHVCgcYG2sZm8 Oct 04 19:03:38.827343 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 19:03:38.827343 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 19:03:38.827343 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 19:03:38.827343 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 19:03:38.827343 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 19:03:38.827343 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 19:03:38.827343 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: c0c25f1d17e94c74868357744e692487 Oct 04 19:03:38.827343 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1789911209 Oct 04 19:03:38.827343 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 19:03:38.827343 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 19:03:38.827343 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/c0c25f1d17e94c74868357744e692487"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_c0c25f1d17e94c74868357744e692487"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c0c25f1d17e94c74868357744e692487"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c0c25f1d17e94c74868357744e692487"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 19:03:38.827343 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1789911209 Oct 04 19:03:38.827343 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: c0c25f1d17e94c74868357744e692487 Oct 04 19:03:38.827343 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1789911209 Oct 04 19:03:38.827343 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-TestNetworkAdvancedServerOps-1789911209-project Oct 04 19:03:38.827343 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 19:03:38.827343 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 19:03:38.827343 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: bf87794979e844349d6ec6c6650565f7 Oct 04 19:03:38.827343 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1789911209-project Oct 04 19:03:38.827343 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 19:03:38.827343 n-d-851028-13 devstack@n-api.service[123595]: exception: Instance 32f44032-85ec-43eb-b714-748a7f4f0b5b could not be found. Oct 04 19:03:38.827343 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': '32f44032-85ec-43eb-b714-748a7f4f0b5b'} Oct 04 19:03:38.827343 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:03:38.827343 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:03:38.827343 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:03:38.827343 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:03:38.827343 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:03:38.827343 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:03:38.827343 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:03:38.827343 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:03:38.827343 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:03:38.827343 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:03:38.827343 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32f44032-85ec-43eb-b714-748a7f4f0b5b could not be found. Oct 04 19:03:38.827343 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:03:38.827343 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:03:38.827343 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:03:38.827343 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:03:38.827343 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:03:38.827343 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:03:38.827343 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:03:38.827343 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:03:38.827343 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:03:38.827343 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:03:38.827343 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:03:38.827343 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:03:38.827343 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:03:38.827343 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:03:38.827343 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:03:38.827343 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:03:38.827343 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32f44032-85ec-43eb-b714-748a7f4f0b5b could not be found. Oct 04 19:03:38.827343 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:03:38.827343 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:03:38.832717 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:03:38.832717 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:03:38.832717 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:03:38.832717 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:03:38.832717 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:03:38.832717 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:03:38.832717 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32f44032-85ec-43eb-b714-748a7f4f0b5b could not be found. Oct 04 19:03:38.832717 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:03:38.835125 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-688878eb-e1df-4458-9778-6d01ad984415 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Returning 404 to user: Instance 32f44032-85ec-43eb-b714-748a7f4f0b5b could not be found. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:03:38.836164 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-688878eb-e1df-4458-9778-6d01ad984415 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] 10.222.0.43 "GET /compute/v2.1/servers/32f44032-85ec-43eb-b714-748a7f4f0b5b" status: 404 len: 111 microversion: 2.1 time: 0.084223 Oct 04 19:03:38.837613 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2695/5751] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:03:38 2022] GET /compute/v2.1/servers/32f44032-85ec-43eb-b714-748a7f4f0b5b => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:03:38.985522 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=2 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:03:39.023563 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-25bc5d5c-5350-4995-a182-832b81f44e54 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:39.024185 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-25bc5d5c-5350-4995-a182-832b81f44e54 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] [instance: f264d970-6336-460a-88f8-cfee793a20dd] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:39.035983 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-25bc5d5c-5350-4995-a182-832b81f44e54 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:39.036485 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-25bc5d5c-5350-4995-a182-832b81f44e54 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:39.036967 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-25bc5d5c-5350-4995-a182-832b81f44e54 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:39.039226 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-25bc5d5c-5350-4995-a182-832b81f44e54 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:39.039707 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-25bc5d5c-5350-4995-a182-832b81f44e54 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:39.040148 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-25bc5d5c-5350-4995-a182-832b81f44e54 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:39.183917 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-25bc5d5c-5350-4995-a182-832b81f44e54 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b1a7754d7344f08ae1b3ef134339ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bd7c2243464924b04efd5a343d5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:39.193061 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-25bc5d5c-5350-4995-a182-832b81f44e54 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b1a7754d7344f08ae1b3ef134339ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bd7c2243464924b04efd5a343d5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:39.195210 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-25bc5d5c-5350-4995-a182-832b81f44e54 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b1a7754d7344f08ae1b3ef134339ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bd7c2243464924b04efd5a343d5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:39.196428 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-25bc5d5c-5350-4995-a182-832b81f44e54 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] 10.222.0.43 "GET /compute/v2.1/servers/f264d970-6336-460a-88f8-cfee793a20dd" status: 200 len: 1365 microversion: 2.57 time: 0.177462 Oct 04 19:03:39.213645 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2696/5752] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:03:39 2022] GET /compute/v2.1/servers/f264d970-6336-460a-88f8-cfee793a20dd => generated 1365 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 19:03:39.287322 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-2a0729a3-a141-4e53-9338-1f329b92e402 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c997bc60473b43fd9fcf0c65111c44c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a711601b7a439caf395233de1febff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:39.297825 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-2a0729a3-a141-4e53-9338-1f329b92e402 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "GET /compute/v2.1/servers/3e01483e-8f33-43df-97b1-70f0834ac07d" status: 200 len: 1315 microversion: 2.1 time: 0.705594 Oct 04 19:03:39.298425 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3057/5753] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:03:38 2022] GET /compute/v2.1/servers/3e01483e-8f33-43df-97b1-70f0834ac07d => generated 1315 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:03:40.223128 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-1abaf653-992f-4645-b634-cbc651066c2b tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:40.224371 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-1abaf653-992f-4645-b634-cbc651066c2b tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] [instance: f264d970-6336-460a-88f8-cfee793a20dd] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:40.238694 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1abaf653-992f-4645-b634-cbc651066c2b tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:40.239353 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1abaf653-992f-4645-b634-cbc651066c2b tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:40.259996 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1abaf653-992f-4645-b634-cbc651066c2b tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:40.260552 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1abaf653-992f-4645-b634-cbc651066c2b tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:40.261683 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1abaf653-992f-4645-b634-cbc651066c2b tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:40.262912 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1abaf653-992f-4645-b634-cbc651066c2b tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:40.328855 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-6c769cb9-1c8c-43a6-b878-d30dd14cf4fe tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:40.330198 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-6c769cb9-1c8c-43a6-b878-d30dd14cf4fe tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: 3e01483e-8f33-43df-97b1-70f0834ac07d] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:40.343014 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6c769cb9-1c8c-43a6-b878-d30dd14cf4fe tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:40.343966 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6c769cb9-1c8c-43a6-b878-d30dd14cf4fe tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:40.344645 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6c769cb9-1c8c-43a6-b878-d30dd14cf4fe tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:40.345868 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6c769cb9-1c8c-43a6-b878-d30dd14cf4fe tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:40.346629 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6c769cb9-1c8c-43a6-b878-d30dd14cf4fe tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:40.347315 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6c769cb9-1c8c-43a6-b878-d30dd14cf4fe tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:40.371083 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-1abaf653-992f-4645-b634-cbc651066c2b tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b1a7754d7344f08ae1b3ef134339ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bd7c2243464924b04efd5a343d5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:40.380018 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-1abaf653-992f-4645-b634-cbc651066c2b tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b1a7754d7344f08ae1b3ef134339ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bd7c2243464924b04efd5a343d5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:40.387809 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-1abaf653-992f-4645-b634-cbc651066c2b tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b1a7754d7344f08ae1b3ef134339ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bd7c2243464924b04efd5a343d5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:40.390404 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-1abaf653-992f-4645-b634-cbc651066c2b tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] 10.222.0.43 "GET /compute/v2.1/servers/f264d970-6336-460a-88f8-cfee793a20dd" status: 200 len: 1365 microversion: 2.57 time: 0.171588 Oct 04 19:03:40.400724 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2697/5754] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:03:40 2022] GET /compute/v2.1/servers/f264d970-6336-460a-88f8-cfee793a20dd => generated 1365 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:03:40.775871 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-f6e56392-b60a-40e9-a873-a914fdb19af7 req-b8130b41-6d96-41ec-aa36-060cce78a19c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e01483e-8f33-43df-97b1-70f0834ac07d", "name": "network-vif-plugged", "status": "completed", "tag": "1757a81c-3646-4099-a814-204aa7096c72"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:03:40.798481 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-f6e56392-b60a-40e9-a873-a914fdb19af7 req-b8130b41-6d96-41ec-aa36-060cce78a19c service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:40.806135 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-f6e56392-b60a-40e9-a873-a914fdb19af7 req-b8130b41-6d96-41ec-aa36-060cce78a19c service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:40.806646 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-f6e56392-b60a-40e9-a873-a914fdb19af7 req-b8130b41-6d96-41ec-aa36-060cce78a19c service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:40.839843 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-f6e56392-b60a-40e9-a873-a914fdb19af7 req-b8130b41-6d96-41ec-aa36-060cce78a19c service nova] Creating event network-vif-plugged:1757a81c-3646-4099-a814-204aa7096c72 for instance 3e01483e-8f33-43df-97b1-70f0834ac07d on n-h1-851028-13 Oct 04 19:03:40.865505 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-f6e56392-b60a-40e9-a873-a914fdb19af7 req-b8130b41-6d96-41ec-aa36-060cce78a19c service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093446 Oct 04 19:03:40.885872 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2698/5755] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:03:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:03:40.921433 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-6c769cb9-1c8c-43a6-b878-d30dd14cf4fe tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c997bc60473b43fd9fcf0c65111c44c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a711601b7a439caf395233de1febff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:40.934075 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-6c769cb9-1c8c-43a6-b878-d30dd14cf4fe tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "GET /compute/v2.1/servers/3e01483e-8f33-43df-97b1-70f0834ac07d" status: 200 len: 1315 microversion: 2.1 time: 0.613511 Oct 04 19:03:40.941364 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3058/5756] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:03:40 2022] GET /compute/v2.1/servers/3e01483e-8f33-43df-97b1-70f0834ac07d => generated 1315 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:03:41.420997 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-05a79409-6ca6-4d73-8df3-9b689e1654b7 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:41.421750 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-05a79409-6ca6-4d73-8df3-9b689e1654b7 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] [instance: f264d970-6336-460a-88f8-cfee793a20dd] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:41.452419 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-05a79409-6ca6-4d73-8df3-9b689e1654b7 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:41.453438 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-05a79409-6ca6-4d73-8df3-9b689e1654b7 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:41.454124 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-05a79409-6ca6-4d73-8df3-9b689e1654b7 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:41.455290 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-05a79409-6ca6-4d73-8df3-9b689e1654b7 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:41.455980 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-05a79409-6ca6-4d73-8df3-9b689e1654b7 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:41.456636 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-05a79409-6ca6-4d73-8df3-9b689e1654b7 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:41.588884 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-05a79409-6ca6-4d73-8df3-9b689e1654b7 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b1a7754d7344f08ae1b3ef134339ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bd7c2243464924b04efd5a343d5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:41.599995 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-05a79409-6ca6-4d73-8df3-9b689e1654b7 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b1a7754d7344f08ae1b3ef134339ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bd7c2243464924b04efd5a343d5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:41.601574 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-05a79409-6ca6-4d73-8df3-9b689e1654b7 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b1a7754d7344f08ae1b3ef134339ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bd7c2243464924b04efd5a343d5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:41.602776 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-05a79409-6ca6-4d73-8df3-9b689e1654b7 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] 10.222.0.43 "GET /compute/v2.1/servers/f264d970-6336-460a-88f8-cfee793a20dd" status: 200 len: 1365 microversion: 2.57 time: 0.186607 Oct 04 19:03:41.603350 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2699/5757] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:03:41 2022] GET /compute/v2.1/servers/f264d970-6336-460a-88f8-cfee793a20dd => generated 1365 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:03:41.979663 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-40fcf2a2-13a0-4e05-87d8-a9f1704a7df0 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:41.980285 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-40fcf2a2-13a0-4e05-87d8-a9f1704a7df0 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: 3e01483e-8f33-43df-97b1-70f0834ac07d] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:41.991752 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-40fcf2a2-13a0-4e05-87d8-a9f1704a7df0 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:41.992256 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-40fcf2a2-13a0-4e05-87d8-a9f1704a7df0 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:42.005238 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-40fcf2a2-13a0-4e05-87d8-a9f1704a7df0 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:42.006078 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-40fcf2a2-13a0-4e05-87d8-a9f1704a7df0 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:42.006700 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-40fcf2a2-13a0-4e05-87d8-a9f1704a7df0 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:42.007522 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-40fcf2a2-13a0-4e05-87d8-a9f1704a7df0 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:42.262080 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-40fcf2a2-13a0-4e05-87d8-a9f1704a7df0 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c997bc60473b43fd9fcf0c65111c44c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a711601b7a439caf395233de1febff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:42.276838 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-40fcf2a2-13a0-4e05-87d8-a9f1704a7df0 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "GET /compute/v2.1/servers/3e01483e-8f33-43df-97b1-70f0834ac07d" status: 200 len: 1315 microversion: 2.1 time: 0.308426 Oct 04 19:03:42.297436 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3059/5758] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:03:41 2022] GET /compute/v2.1/servers/3e01483e-8f33-43df-97b1-70f0834ac07d => generated 1315 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:03:42.633768 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-326c0dc9-72ec-4c24-bd4d-f83641c1e3a8 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:42.635161 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-326c0dc9-72ec-4c24-bd4d-f83641c1e3a8 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] [instance: f264d970-6336-460a-88f8-cfee793a20dd] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:42.643270 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-326c0dc9-72ec-4c24-bd4d-f83641c1e3a8 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:42.644015 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-326c0dc9-72ec-4c24-bd4d-f83641c1e3a8 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:42.644689 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-326c0dc9-72ec-4c24-bd4d-f83641c1e3a8 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:42.645656 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-326c0dc9-72ec-4c24-bd4d-f83641c1e3a8 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:42.646331 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-326c0dc9-72ec-4c24-bd4d-f83641c1e3a8 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:42.647148 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-326c0dc9-72ec-4c24-bd4d-f83641c1e3a8 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:42.810819 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-326c0dc9-72ec-4c24-bd4d-f83641c1e3a8 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b1a7754d7344f08ae1b3ef134339ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bd7c2243464924b04efd5a343d5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:42.823566 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-326c0dc9-72ec-4c24-bd4d-f83641c1e3a8 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b1a7754d7344f08ae1b3ef134339ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bd7c2243464924b04efd5a343d5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:42.837292 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-326c0dc9-72ec-4c24-bd4d-f83641c1e3a8 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b1a7754d7344f08ae1b3ef134339ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bd7c2243464924b04efd5a343d5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:42.839254 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-326c0dc9-72ec-4c24-bd4d-f83641c1e3a8 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] 10.222.0.43 "GET /compute/v2.1/servers/f264d970-6336-460a-88f8-cfee793a20dd" status: 200 len: 1365 microversion: 2.57 time: 0.210559 Oct 04 19:03:42.839924 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2700/5759] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:03:42 2022] GET /compute/v2.1/servers/f264d970-6336-460a-88f8-cfee793a20dd => generated 1365 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:03:43.306444 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-6dbf7a84-2089-463b-bdf2-b754779266d1 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:43.307587 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-6dbf7a84-2089-463b-bdf2-b754779266d1 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: 3e01483e-8f33-43df-97b1-70f0834ac07d] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:43.324903 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6dbf7a84-2089-463b-bdf2-b754779266d1 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:43.326982 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6dbf7a84-2089-463b-bdf2-b754779266d1 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:43.328127 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6dbf7a84-2089-463b-bdf2-b754779266d1 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:43.331372 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6dbf7a84-2089-463b-bdf2-b754779266d1 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:43.332048 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6dbf7a84-2089-463b-bdf2-b754779266d1 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:43.333843 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6dbf7a84-2089-463b-bdf2-b754779266d1 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:43.866993 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-5b83208d-02bf-4465-83b8-4b9bb39de012 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:43.868371 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-5b83208d-02bf-4465-83b8-4b9bb39de012 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] [instance: f264d970-6336-460a-88f8-cfee793a20dd] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:43.880609 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5b83208d-02bf-4465-83b8-4b9bb39de012 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:43.896245 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5b83208d-02bf-4465-83b8-4b9bb39de012 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:43.896909 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5b83208d-02bf-4465-83b8-4b9bb39de012 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:43.899803 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5b83208d-02bf-4465-83b8-4b9bb39de012 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:43.900709 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5b83208d-02bf-4465-83b8-4b9bb39de012 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:43.904508 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5b83208d-02bf-4465-83b8-4b9bb39de012 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:43.961639 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-6dbf7a84-2089-463b-bdf2-b754779266d1 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c997bc60473b43fd9fcf0c65111c44c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a711601b7a439caf395233de1febff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:43.975627 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-6dbf7a84-2089-463b-bdf2-b754779266d1 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "GET /compute/v2.1/servers/3e01483e-8f33-43df-97b1-70f0834ac07d" status: 200 len: 1502 microversion: 2.1 time: 0.674618 Oct 04 19:03:43.979183 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3060/5760] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:03:43 2022] GET /compute/v2.1/servers/3e01483e-8f33-43df-97b1-70f0834ac07d => generated 1502 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:03:44.002377 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-db500ae2-76c4-4f8c-8536-b159b2be2045 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:03:44.015050 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-db500ae2-76c4-4f8c-8536-b159b2be2045 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:44.017077 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-db500ae2-76c4-4f8c-8536-b159b2be2045 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:44.019288 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-db500ae2-76c4-4f8c-8536-b159b2be2045 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:44.094581 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-db500ae2-76c4-4f8c-8536-b159b2be2045 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: 3e01483e-8f33-43df-97b1-70f0834ac07d] Going to try to stop instance {{(pid=123596) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 04 19:03:44.146480 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-5b83208d-02bf-4465-83b8-4b9bb39de012 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b1a7754d7344f08ae1b3ef134339ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bd7c2243464924b04efd5a343d5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:44.164737 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-5b83208d-02bf-4465-83b8-4b9bb39de012 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b1a7754d7344f08ae1b3ef134339ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bd7c2243464924b04efd5a343d5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:44.166559 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-5b83208d-02bf-4465-83b8-4b9bb39de012 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b1a7754d7344f08ae1b3ef134339ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bd7c2243464924b04efd5a343d5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:44.167914 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-5b83208d-02bf-4465-83b8-4b9bb39de012 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] 10.222.0.43 "GET /compute/v2.1/servers/f264d970-6336-460a-88f8-cfee793a20dd" status: 200 len: 1365 microversion: 2.57 time: 0.306486 Oct 04 19:03:44.169153 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2701/5761] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:03:43 2022] GET /compute/v2.1/servers/f264d970-6336-460a-88f8-cfee793a20dd => generated 1365 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 19:03:44.204962 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-db500ae2-76c4-4f8c-8536-b159b2be2045 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "POST /compute/v2.1/servers/3e01483e-8f33-43df-97b1-70f0834ac07d/action" status: 202 len: 0 microversion: 2.1 time: 0.206852 Oct 04 19:03:44.206335 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3061/5762] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 19:03:43 2022] POST /compute/v2.1/servers/3e01483e-8f33-43df-97b1-70f0834ac07d/action => generated 0 bytes in 209 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 19:03:44.215460 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-2b9b9f11-c262-46f5-b894-4cb75c451599 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:44.216404 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-2b9b9f11-c262-46f5-b894-4cb75c451599 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: 3e01483e-8f33-43df-97b1-70f0834ac07d] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:44.226039 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2b9b9f11-c262-46f5-b894-4cb75c451599 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:44.231067 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2b9b9f11-c262-46f5-b894-4cb75c451599 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:44.231738 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2b9b9f11-c262-46f5-b894-4cb75c451599 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:44.234275 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2b9b9f11-c262-46f5-b894-4cb75c451599 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:44.234983 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2b9b9f11-c262-46f5-b894-4cb75c451599 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:44.235779 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2b9b9f11-c262-46f5-b894-4cb75c451599 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:44.617553 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-2b9b9f11-c262-46f5-b894-4cb75c451599 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c997bc60473b43fd9fcf0c65111c44c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a711601b7a439caf395233de1febff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:44.619997 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:03:44.631968 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-2b9b9f11-c262-46f5-b894-4cb75c451599 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "GET /compute/v2.1/servers/3e01483e-8f33-43df-97b1-70f0834ac07d" status: 200 len: 1512 microversion: 2.1 time: 0.421495 Oct 04 19:03:44.633077 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2702/5763] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:03:44 2022] GET /compute/v2.1/servers/3e01483e-8f33-43df-97b1-70f0834ac07d => generated 1512 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:03:44.836047 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-3850c313-d2c0-40db-9245-2400e2b45197 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Calling method '.version_select at 0x7fb21ea60670>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:44.889856 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-3850c313-d2c0-40db-9245-2400e2b45197 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1557681271" status: 202 len: 0 microversion: 2.1 time: 0.057959 Oct 04 19:03:44.897630 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3062/5764] 10.222.0.43 () {58 vars in 1284 bytes} [Tue Oct 4 19:03:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1557681271 => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:03:44.925398 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-0bb09b2a-f349-4029-b785-19dd7feb5d95 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Action: 'create', calling method: .version_select at 0x7fb21ed16310>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-2092852925", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL56sUOaM3aCZRr4evQ118zUjuCBDxmqihe9iZp58mH052gsWfegwGWucqrGsrRexjnY2n3HRhA8GuYdIZY/oID5yBKCBCaHT2hZqXcLgYYLA5atYPbF7Tl6b4F8P4IGuQ=="}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:03:44.995189 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-0bb09b2a-f349-4029-b785-19dd7feb5d95 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Getting quotas for project c0c25f1d17e94c74868357744e692487. Resources: {'key_pairs'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:03:45.010399 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-0bb09b2a-f349-4029-b785-19dd7feb5d95 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Getting quotas for user bf87794979e844349d6ec6c6650565f7 and project c0c25f1d17e94c74868357744e692487. Resources: {'key_pairs'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:03:45.063165 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-0bb09b2a-f349-4029-b785-19dd7feb5d95 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.143084 Oct 04 19:03:45.064089 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2703/5765] 10.222.0.43 () {60 vars in 1159 bytes} [Tue Oct 4 19:03:44 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:03:45.202975 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-4917c967-779b-4957-aecc-664bb9d378b4 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:45.204740 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-4917c967-779b-4957-aecc-664bb9d378b4 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] [instance: f264d970-6336-460a-88f8-cfee793a20dd] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:45.214921 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4917c967-779b-4957-aecc-664bb9d378b4 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:45.217169 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4917c967-779b-4957-aecc-664bb9d378b4 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:45.233452 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4917c967-779b-4957-aecc-664bb9d378b4 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:45.234381 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4917c967-779b-4957-aecc-664bb9d378b4 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:45.237490 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4917c967-779b-4957-aecc-664bb9d378b4 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:45.238261 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4917c967-779b-4957-aecc-664bb9d378b4 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:45.533988 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-4917c967-779b-4957-aecc-664bb9d378b4 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b1a7754d7344f08ae1b3ef134339ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bd7c2243464924b04efd5a343d5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:45.552599 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-4917c967-779b-4957-aecc-664bb9d378b4 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b1a7754d7344f08ae1b3ef134339ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bd7c2243464924b04efd5a343d5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:45.555849 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-4917c967-779b-4957-aecc-664bb9d378b4 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b1a7754d7344f08ae1b3ef134339ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bd7c2243464924b04efd5a343d5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:45.557405 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-4917c967-779b-4957-aecc-664bb9d378b4 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] 10.222.0.43 "GET /compute/v2.1/servers/f264d970-6336-460a-88f8-cfee793a20dd" status: 200 len: 1365 microversion: 2.57 time: 0.360602 Oct 04 19:03:45.558176 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3063/5766] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:03:45 2022] GET /compute/v2.1/servers/f264d970-6336-460a-88f8-cfee793a20dd => generated 1365 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:03:45.661226 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-1d9878b7-82f3-42af-9a4d-813d2920d01b tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:45.661923 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-1d9878b7-82f3-42af-9a4d-813d2920d01b tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: 3e01483e-8f33-43df-97b1-70f0834ac07d] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:45.674825 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1d9878b7-82f3-42af-9a4d-813d2920d01b tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:45.675353 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1d9878b7-82f3-42af-9a4d-813d2920d01b tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:45.675992 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1d9878b7-82f3-42af-9a4d-813d2920d01b tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:45.676741 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1d9878b7-82f3-42af-9a4d-813d2920d01b tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:45.677240 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1d9878b7-82f3-42af-9a4d-813d2920d01b tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:45.678009 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1d9878b7-82f3-42af-9a4d-813d2920d01b tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:45.885589 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-1d9878b7-82f3-42af-9a4d-813d2920d01b tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c997bc60473b43fd9fcf0c65111c44c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a711601b7a439caf395233de1febff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:45.895502 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-1d9878b7-82f3-42af-9a4d-813d2920d01b tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "GET /compute/v2.1/servers/3e01483e-8f33-43df-97b1-70f0834ac07d" status: 200 len: 1512 microversion: 2.1 time: 0.239568 Oct 04 19:03:45.896710 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2704/5767] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:03:45 2022] GET /compute/v2.1/servers/3e01483e-8f33-43df-97b1-70f0834ac07d => generated 1512 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:03:46.586162 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-e47459c4-a33d-4ae9-8a02-625ca5991247 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:46.587874 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-e47459c4-a33d-4ae9-8a02-625ca5991247 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] [instance: f264d970-6336-460a-88f8-cfee793a20dd] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:46.596819 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e47459c4-a33d-4ae9-8a02-625ca5991247 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:46.597928 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e47459c4-a33d-4ae9-8a02-625ca5991247 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:46.598587 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e47459c4-a33d-4ae9-8a02-625ca5991247 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:46.602801 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e47459c4-a33d-4ae9-8a02-625ca5991247 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:46.603560 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e47459c4-a33d-4ae9-8a02-625ca5991247 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:46.604198 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e47459c4-a33d-4ae9-8a02-625ca5991247 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:46.740459 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-e47459c4-a33d-4ae9-8a02-625ca5991247 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b1a7754d7344f08ae1b3ef134339ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bd7c2243464924b04efd5a343d5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:46.751388 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-e47459c4-a33d-4ae9-8a02-625ca5991247 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b1a7754d7344f08ae1b3ef134339ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bd7c2243464924b04efd5a343d5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:46.753734 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-e47459c4-a33d-4ae9-8a02-625ca5991247 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b1a7754d7344f08ae1b3ef134339ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bd7c2243464924b04efd5a343d5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:46.756227 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-e47459c4-a33d-4ae9-8a02-625ca5991247 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] 10.222.0.43 "GET /compute/v2.1/servers/f264d970-6336-460a-88f8-cfee793a20dd" status: 200 len: 1365 microversion: 2.57 time: 0.175673 Oct 04 19:03:46.773284 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3064/5768] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:03:46 2022] GET /compute/v2.1/servers/f264d970-6336-460a-88f8-cfee793a20dd => generated 1365 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:03:46.921451 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-c37b274f-ef20-4722-a38f-11d4aa2cb3b5 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:46.922082 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-c37b274f-ef20-4722-a38f-11d4aa2cb3b5 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: 3e01483e-8f33-43df-97b1-70f0834ac07d] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:46.934711 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c37b274f-ef20-4722-a38f-11d4aa2cb3b5 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:46.935403 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c37b274f-ef20-4722-a38f-11d4aa2cb3b5 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:46.936046 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c37b274f-ef20-4722-a38f-11d4aa2cb3b5 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:46.936937 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c37b274f-ef20-4722-a38f-11d4aa2cb3b5 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:46.937656 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c37b274f-ef20-4722-a38f-11d4aa2cb3b5 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:46.938250 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c37b274f-ef20-4722-a38f-11d4aa2cb3b5 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:47.183053 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-c37b274f-ef20-4722-a38f-11d4aa2cb3b5 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c997bc60473b43fd9fcf0c65111c44c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a711601b7a439caf395233de1febff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:47.198040 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-c37b274f-ef20-4722-a38f-11d4aa2cb3b5 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "GET /compute/v2.1/servers/3e01483e-8f33-43df-97b1-70f0834ac07d" status: 200 len: 1512 microversion: 2.1 time: 0.280559 Oct 04 19:03:47.199369 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2705/5769] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:03:46 2022] GET /compute/v2.1/servers/3e01483e-8f33-43df-97b1-70f0834ac07d => generated 1512 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:03:47.793294 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-ab7f9aed-9a66-4abd-9c26-5f66a6c45f47 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:47.794616 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-ab7f9aed-9a66-4abd-9c26-5f66a6c45f47 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] [instance: f264d970-6336-460a-88f8-cfee793a20dd] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:47.803457 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ab7f9aed-9a66-4abd-9c26-5f66a6c45f47 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:47.804283 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ab7f9aed-9a66-4abd-9c26-5f66a6c45f47 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:47.804927 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ab7f9aed-9a66-4abd-9c26-5f66a6c45f47 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:47.805925 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ab7f9aed-9a66-4abd-9c26-5f66a6c45f47 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:47.806559 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ab7f9aed-9a66-4abd-9c26-5f66a6c45f47 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:47.807168 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ab7f9aed-9a66-4abd-9c26-5f66a6c45f47 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:47.918166 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-ab7f9aed-9a66-4abd-9c26-5f66a6c45f47 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b1a7754d7344f08ae1b3ef134339ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bd7c2243464924b04efd5a343d5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:47.929793 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-ab7f9aed-9a66-4abd-9c26-5f66a6c45f47 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b1a7754d7344f08ae1b3ef134339ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bd7c2243464924b04efd5a343d5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:47.932287 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-ab7f9aed-9a66-4abd-9c26-5f66a6c45f47 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b1a7754d7344f08ae1b3ef134339ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bd7c2243464924b04efd5a343d5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:47.934140 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-ab7f9aed-9a66-4abd-9c26-5f66a6c45f47 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] 10.222.0.43 "GET /compute/v2.1/servers/f264d970-6336-460a-88f8-cfee793a20dd" status: 200 len: 1365 microversion: 2.57 time: 0.151399 Oct 04 19:03:47.935011 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3065/5770] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:03:47 2022] GET /compute/v2.1/servers/f264d970-6336-460a-88f8-cfee793a20dd => generated 1365 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 19:03:48.223152 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-8783b1c0-a98d-4044-b24a-1583e7598e05 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:48.224014 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-8783b1c0-a98d-4044-b24a-1583e7598e05 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: 3e01483e-8f33-43df-97b1-70f0834ac07d] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:48.239031 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8783b1c0-a98d-4044-b24a-1583e7598e05 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:48.241482 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8783b1c0-a98d-4044-b24a-1583e7598e05 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:48.242596 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8783b1c0-a98d-4044-b24a-1583e7598e05 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:48.245276 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8783b1c0-a98d-4044-b24a-1583e7598e05 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:48.259670 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8783b1c0-a98d-4044-b24a-1583e7598e05 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:48.260534 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8783b1c0-a98d-4044-b24a-1583e7598e05 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:48.660736 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-8783b1c0-a98d-4044-b24a-1583e7598e05 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c997bc60473b43fd9fcf0c65111c44c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a711601b7a439caf395233de1febff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:48.675744 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-8783b1c0-a98d-4044-b24a-1583e7598e05 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "GET /compute/v2.1/servers/3e01483e-8f33-43df-97b1-70f0834ac07d" status: 200 len: 1512 microversion: 2.1 time: 0.457538 Oct 04 19:03:48.681553 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2706/5771] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:03:48 2022] GET /compute/v2.1/servers/3e01483e-8f33-43df-97b1-70f0834ac07d => generated 1512 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:03:48.963030 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-d6f030d4-1f14-445a-86ba-6d1d78c08a96 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:48.964261 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-d6f030d4-1f14-445a-86ba-6d1d78c08a96 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] [instance: f264d970-6336-460a-88f8-cfee793a20dd] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:48.973936 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d6f030d4-1f14-445a-86ba-6d1d78c08a96 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:48.974810 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d6f030d4-1f14-445a-86ba-6d1d78c08a96 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:48.975976 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d6f030d4-1f14-445a-86ba-6d1d78c08a96 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:48.977135 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d6f030d4-1f14-445a-86ba-6d1d78c08a96 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:48.977730 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d6f030d4-1f14-445a-86ba-6d1d78c08a96 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:48.978267 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d6f030d4-1f14-445a-86ba-6d1d78c08a96 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:49.100845 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-d6f030d4-1f14-445a-86ba-6d1d78c08a96 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b1a7754d7344f08ae1b3ef134339ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bd7c2243464924b04efd5a343d5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:49.117743 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-d6f030d4-1f14-445a-86ba-6d1d78c08a96 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b1a7754d7344f08ae1b3ef134339ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bd7c2243464924b04efd5a343d5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:49.121827 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-d6f030d4-1f14-445a-86ba-6d1d78c08a96 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b1a7754d7344f08ae1b3ef134339ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bd7c2243464924b04efd5a343d5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:49.124875 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-d6f030d4-1f14-445a-86ba-6d1d78c08a96 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] 10.222.0.43 "GET /compute/v2.1/servers/f264d970-6336-460a-88f8-cfee793a20dd" status: 200 len: 1365 microversion: 2.57 time: 0.168074 Oct 04 19:03:49.126189 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3066/5772] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:03:48 2022] GET /compute/v2.1/servers/f264d970-6336-460a-88f8-cfee793a20dd => generated 1365 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:03:49.701560 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-9c79d650-9cfd-4d1f-8756-e4569f80354c tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:49.703336 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-9c79d650-9cfd-4d1f-8756-e4569f80354c tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: 3e01483e-8f33-43df-97b1-70f0834ac07d] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:49.719818 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9c79d650-9cfd-4d1f-8756-e4569f80354c tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:49.720711 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9c79d650-9cfd-4d1f-8756-e4569f80354c tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:49.728973 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9c79d650-9cfd-4d1f-8756-e4569f80354c tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:49.730085 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9c79d650-9cfd-4d1f-8756-e4569f80354c tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:49.730773 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9c79d650-9cfd-4d1f-8756-e4569f80354c tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:49.731448 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9c79d650-9cfd-4d1f-8756-e4569f80354c tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:50.091524 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-9c79d650-9cfd-4d1f-8756-e4569f80354c tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c997bc60473b43fd9fcf0c65111c44c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a711601b7a439caf395233de1febff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:50.111493 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-9c79d650-9cfd-4d1f-8756-e4569f80354c tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "GET /compute/v2.1/servers/3e01483e-8f33-43df-97b1-70f0834ac07d" status: 200 len: 1512 microversion: 2.1 time: 0.411237 Oct 04 19:03:50.114339 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2707/5773] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:03:49 2022] GET /compute/v2.1/servers/3e01483e-8f33-43df-97b1-70f0834ac07d => generated 1512 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:03:50.154229 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-646ef654-6aa1-4b96-8297-64bd339657e4 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:50.155943 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-646ef654-6aa1-4b96-8297-64bd339657e4 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] [instance: f264d970-6336-460a-88f8-cfee793a20dd] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:50.169574 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-646ef654-6aa1-4b96-8297-64bd339657e4 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:50.175828 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-646ef654-6aa1-4b96-8297-64bd339657e4 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:50.177223 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-646ef654-6aa1-4b96-8297-64bd339657e4 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:50.180070 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-646ef654-6aa1-4b96-8297-64bd339657e4 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:50.180740 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-646ef654-6aa1-4b96-8297-64bd339657e4 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:50.185404 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-646ef654-6aa1-4b96-8297-64bd339657e4 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:50.450464 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-646ef654-6aa1-4b96-8297-64bd339657e4 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b1a7754d7344f08ae1b3ef134339ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bd7c2243464924b04efd5a343d5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:50.464260 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-646ef654-6aa1-4b96-8297-64bd339657e4 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b1a7754d7344f08ae1b3ef134339ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bd7c2243464924b04efd5a343d5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:50.465866 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-646ef654-6aa1-4b96-8297-64bd339657e4 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b1a7754d7344f08ae1b3ef134339ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bd7c2243464924b04efd5a343d5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:50.467096 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-646ef654-6aa1-4b96-8297-64bd339657e4 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] 10.222.0.43 "GET /compute/v2.1/servers/f264d970-6336-460a-88f8-cfee793a20dd" status: 200 len: 1365 microversion: 2.57 time: 0.319871 Oct 04 19:03:50.481772 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3067/5774] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:03:50 2022] GET /compute/v2.1/servers/f264d970-6336-460a-88f8-cfee793a20dd => generated 1365 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:03:51.140514 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-4f8989ba-7d38-4323-8886-b3f3716a4096 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:51.141428 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-4f8989ba-7d38-4323-8886-b3f3716a4096 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: 3e01483e-8f33-43df-97b1-70f0834ac07d] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:51.150954 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4f8989ba-7d38-4323-8886-b3f3716a4096 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:51.152835 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4f8989ba-7d38-4323-8886-b3f3716a4096 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:51.153935 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4f8989ba-7d38-4323-8886-b3f3716a4096 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:51.156408 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4f8989ba-7d38-4323-8886-b3f3716a4096 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:51.158137 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4f8989ba-7d38-4323-8886-b3f3716a4096 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:51.159051 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4f8989ba-7d38-4323-8886-b3f3716a4096 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:51.484069 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-4f8989ba-7d38-4323-8886-b3f3716a4096 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c997bc60473b43fd9fcf0c65111c44c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a711601b7a439caf395233de1febff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:51.497551 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-4f8989ba-7d38-4323-8886-b3f3716a4096 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "GET /compute/v2.1/servers/3e01483e-8f33-43df-97b1-70f0834ac07d" status: 200 len: 1512 microversion: 2.1 time: 0.360849 Oct 04 19:03:51.497815 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-5578fbbf-b170-418a-83cb-4206d9a40397 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:51.498950 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-5578fbbf-b170-418a-83cb-4206d9a40397 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] [instance: f264d970-6336-460a-88f8-cfee793a20dd] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:51.513136 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2708/5775] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:03:51 2022] GET /compute/v2.1/servers/3e01483e-8f33-43df-97b1-70f0834ac07d => generated 1512 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:03:51.523246 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5578fbbf-b170-418a-83cb-4206d9a40397 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:51.524370 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5578fbbf-b170-418a-83cb-4206d9a40397 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:51.524979 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5578fbbf-b170-418a-83cb-4206d9a40397 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:51.525906 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5578fbbf-b170-418a-83cb-4206d9a40397 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:51.526557 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5578fbbf-b170-418a-83cb-4206d9a40397 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:51.527144 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5578fbbf-b170-418a-83cb-4206d9a40397 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:51.675291 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-5578fbbf-b170-418a-83cb-4206d9a40397 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b1a7754d7344f08ae1b3ef134339ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bd7c2243464924b04efd5a343d5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:51.688646 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-5578fbbf-b170-418a-83cb-4206d9a40397 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b1a7754d7344f08ae1b3ef134339ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bd7c2243464924b04efd5a343d5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:51.692539 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-5578fbbf-b170-418a-83cb-4206d9a40397 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b1a7754d7344f08ae1b3ef134339ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bd7c2243464924b04efd5a343d5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:51.695146 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-5578fbbf-b170-418a-83cb-4206d9a40397 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] 10.222.0.43 "GET /compute/v2.1/servers/f264d970-6336-460a-88f8-cfee793a20dd" status: 200 len: 1365 microversion: 2.57 time: 0.201125 Oct 04 19:03:51.706290 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3068/5776] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:03:51 2022] GET /compute/v2.1/servers/f264d970-6336-460a-88f8-cfee793a20dd => generated 1365 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 19:03:52.528718 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-fc969e00-97a9-4dd4-bbb4-c192574dbfeb tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:52.529269 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-fc969e00-97a9-4dd4-bbb4-c192574dbfeb tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: 3e01483e-8f33-43df-97b1-70f0834ac07d] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:52.546738 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fc969e00-97a9-4dd4-bbb4-c192574dbfeb tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:52.547469 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fc969e00-97a9-4dd4-bbb4-c192574dbfeb tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:52.548098 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fc969e00-97a9-4dd4-bbb4-c192574dbfeb tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:52.548998 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fc969e00-97a9-4dd4-bbb4-c192574dbfeb tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:52.549860 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fc969e00-97a9-4dd4-bbb4-c192574dbfeb tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:52.550297 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fc969e00-97a9-4dd4-bbb4-c192574dbfeb tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:52.743880 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-8ee3ceac-892f-49a2-a1f6-5912cad27ed0 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:52.744559 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-8ee3ceac-892f-49a2-a1f6-5912cad27ed0 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] [instance: f264d970-6336-460a-88f8-cfee793a20dd] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:52.763059 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8ee3ceac-892f-49a2-a1f6-5912cad27ed0 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:52.763564 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8ee3ceac-892f-49a2-a1f6-5912cad27ed0 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:52.764016 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8ee3ceac-892f-49a2-a1f6-5912cad27ed0 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:52.764739 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8ee3ceac-892f-49a2-a1f6-5912cad27ed0 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:52.765273 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8ee3ceac-892f-49a2-a1f6-5912cad27ed0 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:52.765711 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8ee3ceac-892f-49a2-a1f6-5912cad27ed0 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:52.948968 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-8ee3ceac-892f-49a2-a1f6-5912cad27ed0 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b1a7754d7344f08ae1b3ef134339ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bd7c2243464924b04efd5a343d5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:52.959180 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-8ee3ceac-892f-49a2-a1f6-5912cad27ed0 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b1a7754d7344f08ae1b3ef134339ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bd7c2243464924b04efd5a343d5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:52.960690 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-8ee3ceac-892f-49a2-a1f6-5912cad27ed0 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b1a7754d7344f08ae1b3ef134339ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bd7c2243464924b04efd5a343d5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:52.970945 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-8ee3ceac-892f-49a2-a1f6-5912cad27ed0 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] 10.222.0.43 "GET /compute/v2.1/servers/f264d970-6336-460a-88f8-cfee793a20dd" status: 200 len: 1371 microversion: 2.57 time: 0.232686 Oct 04 19:03:52.992028 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3069/5777] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:03:52 2022] GET /compute/v2.1/servers/f264d970-6336-460a-88f8-cfee793a20dd => generated 1371 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:03:53.176044 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-fc969e00-97a9-4dd4-bbb4-c192574dbfeb tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c997bc60473b43fd9fcf0c65111c44c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a711601b7a439caf395233de1febff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:53.189648 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-fc969e00-97a9-4dd4-bbb4-c192574dbfeb tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "GET /compute/v2.1/servers/3e01483e-8f33-43df-97b1-70f0834ac07d" status: 200 len: 1512 microversion: 2.1 time: 0.664999 Oct 04 19:03:53.219178 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2709/5778] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:03:52 2022] GET /compute/v2.1/servers/3e01483e-8f33-43df-97b1-70f0834ac07d => generated 1512 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:03:54.024317 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f380efa2-4d91-4708-9b5c-83b1c6d81a0e tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:54.024946 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-f380efa2-4d91-4708-9b5c-83b1c6d81a0e tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] [instance: f264d970-6336-460a-88f8-cfee793a20dd] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:54.037240 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f380efa2-4d91-4708-9b5c-83b1c6d81a0e tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:54.038298 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f380efa2-4d91-4708-9b5c-83b1c6d81a0e tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:54.047671 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f380efa2-4d91-4708-9b5c-83b1c6d81a0e tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:54.048941 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f380efa2-4d91-4708-9b5c-83b1c6d81a0e tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:54.049670 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f380efa2-4d91-4708-9b5c-83b1c6d81a0e tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:54.050288 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f380efa2-4d91-4708-9b5c-83b1c6d81a0e tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:54.222677 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-d797d1af-87ea-4c6f-b6e2-a0ecf8cf0488 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:54.223452 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-d797d1af-87ea-4c6f-b6e2-a0ecf8cf0488 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: 3e01483e-8f33-43df-97b1-70f0834ac07d] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:54.258365 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d797d1af-87ea-4c6f-b6e2-a0ecf8cf0488 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:54.266475 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d797d1af-87ea-4c6f-b6e2-a0ecf8cf0488 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:54.267285 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d797d1af-87ea-4c6f-b6e2-a0ecf8cf0488 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:54.268286 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d797d1af-87ea-4c6f-b6e2-a0ecf8cf0488 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:54.270435 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d797d1af-87ea-4c6f-b6e2-a0ecf8cf0488 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:54.271163 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d797d1af-87ea-4c6f-b6e2-a0ecf8cf0488 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:54.294992 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-f380efa2-4d91-4708-9b5c-83b1c6d81a0e tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b1a7754d7344f08ae1b3ef134339ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bd7c2243464924b04efd5a343d5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:54.309951 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-f380efa2-4d91-4708-9b5c-83b1c6d81a0e tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b1a7754d7344f08ae1b3ef134339ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bd7c2243464924b04efd5a343d5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:54.322841 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-f380efa2-4d91-4708-9b5c-83b1c6d81a0e tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b1a7754d7344f08ae1b3ef134339ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bd7c2243464924b04efd5a343d5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:54.327684 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-f380efa2-4d91-4708-9b5c-83b1c6d81a0e tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] 10.222.0.43 "GET /compute/v2.1/servers/f264d970-6336-460a-88f8-cfee793a20dd" status: 200 len: 1371 microversion: 2.57 time: 0.308701 Oct 04 19:03:54.336717 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3070/5779] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:03:54 2022] GET /compute/v2.1/servers/f264d970-6336-460a-88f8-cfee793a20dd => generated 1371 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:03:54.866550 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-d797d1af-87ea-4c6f-b6e2-a0ecf8cf0488 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c997bc60473b43fd9fcf0c65111c44c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a711601b7a439caf395233de1febff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:54.877488 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-d797d1af-87ea-4c6f-b6e2-a0ecf8cf0488 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "GET /compute/v2.1/servers/3e01483e-8f33-43df-97b1-70f0834ac07d" status: 200 len: 1512 microversion: 2.1 time: 0.658661 Oct 04 19:03:54.901481 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2710/5780] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:03:54 2022] GET /compute/v2.1/servers/3e01483e-8f33-43df-97b1-70f0834ac07d => generated 1512 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:03:55.359364 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-3c2f7ed3-13a9-4acc-b1ce-aba8de8c4307 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:55.360508 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-3c2f7ed3-13a9-4acc-b1ce-aba8de8c4307 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] [instance: f264d970-6336-460a-88f8-cfee793a20dd] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:55.376090 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3c2f7ed3-13a9-4acc-b1ce-aba8de8c4307 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:55.382088 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3c2f7ed3-13a9-4acc-b1ce-aba8de8c4307 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:55.382088 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3c2f7ed3-13a9-4acc-b1ce-aba8de8c4307 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:55.382088 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3c2f7ed3-13a9-4acc-b1ce-aba8de8c4307 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:55.383403 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3c2f7ed3-13a9-4acc-b1ce-aba8de8c4307 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:55.386205 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3c2f7ed3-13a9-4acc-b1ce-aba8de8c4307 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:55.560978 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-3c2f7ed3-13a9-4acc-b1ce-aba8de8c4307 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b1a7754d7344f08ae1b3ef134339ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bd7c2243464924b04efd5a343d5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:55.588772 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-3c2f7ed3-13a9-4acc-b1ce-aba8de8c4307 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b1a7754d7344f08ae1b3ef134339ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bd7c2243464924b04efd5a343d5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:55.590256 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-3c2f7ed3-13a9-4acc-b1ce-aba8de8c4307 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b1a7754d7344f08ae1b3ef134339ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bd7c2243464924b04efd5a343d5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:55.591458 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-3c2f7ed3-13a9-4acc-b1ce-aba8de8c4307 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] 10.222.0.43 "GET /compute/v2.1/servers/f264d970-6336-460a-88f8-cfee793a20dd" status: 200 len: 1356 microversion: 2.57 time: 0.236035 Oct 04 19:03:55.609255 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3071/5781] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:03:55 2022] GET /compute/v2.1/servers/f264d970-6336-460a-88f8-cfee793a20dd => generated 1356 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:03:55.633796 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-ae733b2d-fc25-46e7-8f2e-0927c0eeb373 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:55.634464 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-ae733b2d-fc25-46e7-8f2e-0927c0eeb373 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] [instance: f264d970-6336-460a-88f8-cfee793a20dd] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:55.637733 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=4 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:03:55.651550 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ae733b2d-fc25-46e7-8f2e-0927c0eeb373 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:55.652265 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ae733b2d-fc25-46e7-8f2e-0927c0eeb373 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:55.653780 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ae733b2d-fc25-46e7-8f2e-0927c0eeb373 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:55.655221 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ae733b2d-fc25-46e7-8f2e-0927c0eeb373 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:55.656289 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ae733b2d-fc25-46e7-8f2e-0927c0eeb373 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:55.658334 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ae733b2d-fc25-46e7-8f2e-0927c0eeb373 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:55.720961 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-ae733b2d-fc25-46e7-8f2e-0927c0eeb373 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] [instance: f264d970-6336-460a-88f8-cfee793a20dd] Going to try to terminate instance {{(pid=123595) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 19:03:55.835716 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-d454de46-5f2e-46b9-ba07-31b04c6e6c83 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-135819597", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452", "networks": [{"uuid": "cdfab835-85f7-4327-a593-7ab21787425b"}], "key_name": "tempest-TestNetworkAdvancedServerOps-2092852925", "security_groups": [{"name": "tempest-secgroup-smoke-1144851185"}]}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:03:55.966527 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-ae733b2d-fc25-46e7-8f2e-0927c0eeb373 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] 10.222.0.43 "DELETE /compute/v2.1/servers/f264d970-6336-460a-88f8-cfee793a20dd" status: 204 len: 0 microversion: 2.57 time: 0.337194 Oct 04 19:03:55.967091 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2711/5782] 10.222.0.43 () {60 vars in 1280 bytes} [Tue Oct 4 19:03:55 2022] DELETE /compute/v2.1/servers/f264d970-6336-460a-88f8-cfee793a20dd => generated 0 bytes in 339 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 19:03:55.980617 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-8e610fc8-0cce-4385-9676-1f93b55726b6 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:55.982085 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-8e610fc8-0cce-4385-9676-1f93b55726b6 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: 3e01483e-8f33-43df-97b1-70f0834ac07d] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:55.997244 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8e610fc8-0cce-4385-9676-1f93b55726b6 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:56.000173 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8e610fc8-0cce-4385-9676-1f93b55726b6 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:56.000712 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8e610fc8-0cce-4385-9676-1f93b55726b6 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:56.001476 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8e610fc8-0cce-4385-9676-1f93b55726b6 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:56.001940 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8e610fc8-0cce-4385-9676-1f93b55726b6 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:56.002373 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8e610fc8-0cce-4385-9676-1f93b55726b6 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:56.172208 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.network.neutron [None req-d454de46-5f2e-46b9-ba07-31b04c6e6c83 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] validate_networks() for [('cdfab835-85f7-4327-a593-7ab21787425b', None, None, None, None, None)] {{(pid=123596) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 19:03:56.325632 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-8e610fc8-0cce-4385-9676-1f93b55726b6 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c997bc60473b43fd9fcf0c65111c44c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a711601b7a439caf395233de1febff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:56.344450 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-8e610fc8-0cce-4385-9676-1f93b55726b6 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "GET /compute/v2.1/servers/3e01483e-8f33-43df-97b1-70f0834ac07d" status: 200 len: 1512 microversion: 2.1 time: 0.375040 Oct 04 19:03:56.345738 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2712/5783] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:03:55 2022] GET /compute/v2.1/servers/3e01483e-8f33-43df-97b1-70f0834ac07d => generated 1512 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:03:56.371235 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-dc5d5833-2ca7-4ab5-b59b-7050178bfafb tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:56.376234 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-dc5d5833-2ca7-4ab5-b59b-7050178bfafb tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] [instance: f264d970-6336-460a-88f8-cfee793a20dd] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:56.390307 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dc5d5833-2ca7-4ab5-b59b-7050178bfafb tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:56.391964 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dc5d5833-2ca7-4ab5-b59b-7050178bfafb tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:56.393543 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dc5d5833-2ca7-4ab5-b59b-7050178bfafb tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:56.394776 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dc5d5833-2ca7-4ab5-b59b-7050178bfafb tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:56.396590 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dc5d5833-2ca7-4ab5-b59b-7050178bfafb tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:56.397191 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dc5d5833-2ca7-4ab5-b59b-7050178bfafb tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:56.544837 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-dc5d5833-2ca7-4ab5-b59b-7050178bfafb tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b1a7754d7344f08ae1b3ef134339ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bd7c2243464924b04efd5a343d5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:56.561413 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-dc5d5833-2ca7-4ab5-b59b-7050178bfafb tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b1a7754d7344f08ae1b3ef134339ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bd7c2243464924b04efd5a343d5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:56.566922 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-dc5d5833-2ca7-4ab5-b59b-7050178bfafb tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b1a7754d7344f08ae1b3ef134339ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bd7c2243464924b04efd5a343d5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:56.568793 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-dc5d5833-2ca7-4ab5-b59b-7050178bfafb tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] 10.222.0.43 "GET /compute/v2.1/servers/f264d970-6336-460a-88f8-cfee793a20dd" status: 200 len: 1362 microversion: 2.57 time: 0.221874 Oct 04 19:03:56.570904 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2713/5784] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:03:56 2022] GET /compute/v2.1/servers/f264d970-6336-460a-88f8-cfee793a20dd => generated 1362 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:03:57.071282 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-d454de46-5f2e-46b9-ba07-31b04c6e6c83 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Flavor limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:03:57.071829 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-d454de46-5f2e-46b9-ba07-31b04c6e6c83 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Image limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:03:57.072201 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-d454de46-5f2e-46b9-ba07-31b04c6e6c83 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Flavor pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:03:57.072605 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-d454de46-5f2e-46b9-ba07-31b04c6e6c83 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Image pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:03:57.073714 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-d454de46-5f2e-46b9-ba07-31b04c6e6c83 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:03:57.086663 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d454de46-5f2e-46b9-ba07-31b04c6e6c83 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:57.087350 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d454de46-5f2e-46b9-ba07-31b04c6e6c83 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:57.088436 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d454de46-5f2e-46b9-ba07-31b04c6e6c83 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:57.089383 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d454de46-5f2e-46b9-ba07-31b04c6e6c83 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:57.089842 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d454de46-5f2e-46b9-ba07-31b04c6e6c83 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:57.102072 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d454de46-5f2e-46b9-ba07-31b04c6e6c83 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:57.164896 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-d454de46-5f2e-46b9-ba07-31b04c6e6c83 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Getting quotas for project c0c25f1d17e94c74868357744e692487. Resources: {'ram', 'cores', 'instances'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:03:57.172331 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-d454de46-5f2e-46b9-ba07-31b04c6e6c83 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Getting quotas for user bf87794979e844349d6ec6c6650565f7 and project c0c25f1d17e94c74868357744e692487. Resources: {'ram', 'cores', 'instances'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:03:57.186691 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-d454de46-5f2e-46b9-ba07-31b04c6e6c83 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Going to run 1 instances... {{(pid=123596) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 19:03:57.189396 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-d454de46-5f2e-46b9-ba07-31b04c6e6c83 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] [instance: 75c5754b-3489-46e5-9a52-43e0a6cfd1c7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e8943ec5-4038-4d4b-b9b9-2415a79f5243',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123596) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 19:03:57.261026 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-d454de46-5f2e-46b9-ba07-31b04c6e6c83 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.433673 Oct 04 19:03:57.274739 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-ed658901-60f6-45b5-ab5b-3e6f1ddb0805 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:57.275355 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-ed658901-60f6-45b5-ab5b-3e6f1ddb0805 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] [instance: 75c5754b-3489-46e5-9a52-43e0a6cfd1c7] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:57.283242 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3072/5785] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 19:03:55 2022] POST /compute/v2.1/servers => generated 406 bytes in 1456 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 19:03:57.372654 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-10f8d065-061c-465b-8d25-289444dd8a8e tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:57.373681 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-10f8d065-061c-465b-8d25-289444dd8a8e tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: 3e01483e-8f33-43df-97b1-70f0834ac07d] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:57.383516 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-10f8d065-061c-465b-8d25-289444dd8a8e tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:57.389191 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-10f8d065-061c-465b-8d25-289444dd8a8e tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:57.389674 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-10f8d065-061c-465b-8d25-289444dd8a8e tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:57.390422 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-10f8d065-061c-465b-8d25-289444dd8a8e tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:57.391043 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-10f8d065-061c-465b-8d25-289444dd8a8e tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:57.391560 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-10f8d065-061c-465b-8d25-289444dd8a8e tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:57.400428 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:03:57.405550 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-ed658901-60f6-45b5-ab5b-3e6f1ddb0805 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf87794979e844349d6ec6c6650565f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c25f1d17e94c74868357744e692487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:57.415690 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-ed658901-60f6-45b5-ab5b-3e6f1ddb0805 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] 10.222.0.43 "GET /compute/v2.1/servers/75c5754b-3489-46e5-9a52-43e0a6cfd1c7" status: 200 len: 1266 microversion: 2.1 time: 0.145869 Oct 04 19:03:57.420662 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2714/5786] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:03:57 2022] GET /compute/v2.1/servers/75c5754b-3489-46e5-9a52-43e0a6cfd1c7 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:03:57.608535 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-b96ca119-ec50-432c-8e49-730745c03bc8 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:57.609432 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-b96ca119-ec50-432c-8e49-730745c03bc8 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] [instance: f264d970-6336-460a-88f8-cfee793a20dd] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:57.625445 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b96ca119-ec50-432c-8e49-730745c03bc8 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:57.626206 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b96ca119-ec50-432c-8e49-730745c03bc8 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:57.626860 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b96ca119-ec50-432c-8e49-730745c03bc8 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:57.627795 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b96ca119-ec50-432c-8e49-730745c03bc8 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:57.628469 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b96ca119-ec50-432c-8e49-730745c03bc8 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:57.629129 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b96ca119-ec50-432c-8e49-730745c03bc8 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:57.740468 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-10f8d065-061c-465b-8d25-289444dd8a8e tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c997bc60473b43fd9fcf0c65111c44c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a711601b7a439caf395233de1febff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:57.756167 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-10f8d065-061c-465b-8d25-289444dd8a8e tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "GET /compute/v2.1/servers/3e01483e-8f33-43df-97b1-70f0834ac07d" status: 200 len: 1512 microversion: 2.1 time: 0.388203 Oct 04 19:03:57.757461 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3073/5787] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:03:57 2022] GET /compute/v2.1/servers/3e01483e-8f33-43df-97b1-70f0834ac07d => generated 1512 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:03:57.781368 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-b96ca119-ec50-432c-8e49-730745c03bc8 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b1a7754d7344f08ae1b3ef134339ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bd7c2243464924b04efd5a343d5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:57.805593 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-b96ca119-ec50-432c-8e49-730745c03bc8 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b1a7754d7344f08ae1b3ef134339ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bd7c2243464924b04efd5a343d5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:57.807059 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-b96ca119-ec50-432c-8e49-730745c03bc8 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b1a7754d7344f08ae1b3ef134339ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bd7c2243464924b04efd5a343d5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:57.809459 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-b96ca119-ec50-432c-8e49-730745c03bc8 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] 10.222.0.43 "GET /compute/v2.1/servers/f264d970-6336-460a-88f8-cfee793a20dd" status: 200 len: 1362 microversion: 2.57 time: 0.210840 Oct 04 19:03:57.822041 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2715/5788] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:03:57 2022] GET /compute/v2.1/servers/f264d970-6336-460a-88f8-cfee793a20dd => generated 1362 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:03:58.447213 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-9c242818-9092-45ba-9a49-9839f870701b tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:58.447817 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-9c242818-9092-45ba-9a49-9839f870701b tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] [instance: 75c5754b-3489-46e5-9a52-43e0a6cfd1c7] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:58.462676 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9c242818-9092-45ba-9a49-9839f870701b tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:58.463386 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9c242818-9092-45ba-9a49-9839f870701b tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:58.465723 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9c242818-9092-45ba-9a49-9839f870701b tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:58.467094 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9c242818-9092-45ba-9a49-9839f870701b tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:58.469189 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9c242818-9092-45ba-9a49-9839f870701b tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:58.470060 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9c242818-9092-45ba-9a49-9839f870701b tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:58.612357 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-9c242818-9092-45ba-9a49-9839f870701b tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf87794979e844349d6ec6c6650565f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c25f1d17e94c74868357744e692487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:58.638976 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-9c242818-9092-45ba-9a49-9839f870701b tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] 10.222.0.43 "GET /compute/v2.1/servers/75c5754b-3489-46e5-9a52-43e0a6cfd1c7" status: 200 len: 1262 microversion: 2.1 time: 0.195436 Oct 04 19:03:58.640309 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3074/5789] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:03:58 2022] GET /compute/v2.1/servers/75c5754b-3489-46e5-9a52-43e0a6cfd1c7 => generated 1262 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:03:58.780911 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-9c0cdfaa-c48e-47b7-9999-c612a9346acd tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:58.781621 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-9c0cdfaa-c48e-47b7-9999-c612a9346acd tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: 3e01483e-8f33-43df-97b1-70f0834ac07d] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:58.794280 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9c0cdfaa-c48e-47b7-9999-c612a9346acd tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:58.795313 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9c0cdfaa-c48e-47b7-9999-c612a9346acd tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:58.797523 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9c0cdfaa-c48e-47b7-9999-c612a9346acd tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:58.798455 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9c0cdfaa-c48e-47b7-9999-c612a9346acd tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:58.801258 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9c0cdfaa-c48e-47b7-9999-c612a9346acd tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:58.804549 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9c0cdfaa-c48e-47b7-9999-c612a9346acd tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:58.840648 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-69d007f9-dbe9-4d39-8a82-476283d0005a tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:58.842990 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-69d007f9-dbe9-4d39-8a82-476283d0005a tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] [instance: f264d970-6336-460a-88f8-cfee793a20dd] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:58.854530 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-69d007f9-dbe9-4d39-8a82-476283d0005a tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:58.855717 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-69d007f9-dbe9-4d39-8a82-476283d0005a tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:58.856626 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-69d007f9-dbe9-4d39-8a82-476283d0005a tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:58.857813 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-69d007f9-dbe9-4d39-8a82-476283d0005a tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:58.858539 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-69d007f9-dbe9-4d39-8a82-476283d0005a tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:58.859202 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-69d007f9-dbe9-4d39-8a82-476283d0005a tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:58.926925 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-69d007f9-dbe9-4d39-8a82-476283d0005a tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:58.927582 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-69d007f9-dbe9-4d39-8a82-476283d0005a tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:58.928043 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-69d007f9-dbe9-4d39-8a82-476283d0005a tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:58.928731 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.objects.instance [None req-69d007f9-dbe9-4d39-8a82-476283d0005a tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Lazy-loading 'fault' on Instance uuid f264d970-6336-460a-88f8-cfee793a20dd {{(pid=123596) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 19:03:59.036341 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-69d007f9-dbe9-4d39-8a82-476283d0005a tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b1a7754d7344f08ae1b3ef134339ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bd7c2243464924b04efd5a343d5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:59.058721 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-69d007f9-dbe9-4d39-8a82-476283d0005a tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b1a7754d7344f08ae1b3ef134339ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bd7c2243464924b04efd5a343d5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:59.060468 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-69d007f9-dbe9-4d39-8a82-476283d0005a tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b1a7754d7344f08ae1b3ef134339ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bd7c2243464924b04efd5a343d5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:59.061994 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-69d007f9-dbe9-4d39-8a82-476283d0005a tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] 10.222.0.43 "GET /compute/v2.1/servers/f264d970-6336-460a-88f8-cfee793a20dd" status: 200 len: 1367 microversion: 2.57 time: 0.230044 Oct 04 19:03:59.063572 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3075/5790] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:03:58 2022] GET /compute/v2.1/servers/f264d970-6336-460a-88f8-cfee793a20dd => generated 1367 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:03:59.119602 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-9c0cdfaa-c48e-47b7-9999-c612a9346acd tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c997bc60473b43fd9fcf0c65111c44c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a711601b7a439caf395233de1febff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:59.127607 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-9c0cdfaa-c48e-47b7-9999-c612a9346acd tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "GET /compute/v2.1/servers/3e01483e-8f33-43df-97b1-70f0834ac07d" status: 200 len: 1512 microversion: 2.1 time: 0.350501 Oct 04 19:03:59.153680 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2716/5791] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:03:58 2022] GET /compute/v2.1/servers/3e01483e-8f33-43df-97b1-70f0834ac07d => generated 1512 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:03:59.668145 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-2158fcac-8a98-4562-bf8e-e967e4b3804d tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:59.668981 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-2158fcac-8a98-4562-bf8e-e967e4b3804d tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] [instance: 75c5754b-3489-46e5-9a52-43e0a6cfd1c7] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:59.682216 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2158fcac-8a98-4562-bf8e-e967e4b3804d tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:59.683324 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2158fcac-8a98-4562-bf8e-e967e4b3804d tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:59.685233 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2158fcac-8a98-4562-bf8e-e967e4b3804d tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:59.686807 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2158fcac-8a98-4562-bf8e-e967e4b3804d tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:59.689742 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2158fcac-8a98-4562-bf8e-e967e4b3804d tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:59.691625 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2158fcac-8a98-4562-bf8e-e967e4b3804d tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:59.817834 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-2158fcac-8a98-4562-bf8e-e967e4b3804d tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf87794979e844349d6ec6c6650565f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c25f1d17e94c74868357744e692487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:59.841055 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-2158fcac-8a98-4562-bf8e-e967e4b3804d tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] 10.222.0.43 "GET /compute/v2.1/servers/75c5754b-3489-46e5-9a52-43e0a6cfd1c7" status: 200 len: 1324 microversion: 2.1 time: 0.177291 Oct 04 19:03:59.854824 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3076/5792] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:03:59 2022] GET /compute/v2.1/servers/75c5754b-3489-46e5-9a52-43e0a6cfd1c7 => generated 1324 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:04:00.089398 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-0d90c549-72c3-4e84-9581-7b3411653a01 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:00.091038 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-0d90c549-72c3-4e84-9581-7b3411653a01 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] [instance: f264d970-6336-460a-88f8-cfee793a20dd] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:00.116595 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0d90c549-72c3-4e84-9581-7b3411653a01 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:00.118025 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0d90c549-72c3-4e84-9581-7b3411653a01 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:00.118638 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0d90c549-72c3-4e84-9581-7b3411653a01 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:00.119623 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0d90c549-72c3-4e84-9581-7b3411653a01 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:00.127015 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0d90c549-72c3-4e84-9581-7b3411653a01 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:00.137001 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0d90c549-72c3-4e84-9581-7b3411653a01 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:00.169012 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-5e04aff1-458e-4ed4-9cc3-cf83518346db tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:00.169693 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-5e04aff1-458e-4ed4-9cc3-cf83518346db tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: 3e01483e-8f33-43df-97b1-70f0834ac07d] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:00.171903 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_api:SELECT=74,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:04:00.187587 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-0d90c549-72c3-4e84-9581-7b3411653a01 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] HTTP exception thrown: Instance f264d970-6336-460a-88f8-cfee793a20dd could not be found. Oct 04 19:04:00.188456 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5e04aff1-458e-4ed4-9cc3-cf83518346db tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:00.188972 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5e04aff1-458e-4ed4-9cc3-cf83518346db tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:00.189441 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5e04aff1-458e-4ed4-9cc3-cf83518346db tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:00.190162 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5e04aff1-458e-4ed4-9cc3-cf83518346db tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:00.190618 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5e04aff1-458e-4ed4-9cc3-cf83518346db tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:00.191050 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5e04aff1-458e-4ed4-9cc3-cf83518346db tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:00.192956 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-0d90c549-72c3-4e84-9581-7b3411653a01 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Request method failure captured: Oct 04 19:04:00.192956 n-d-851028-13 devstack@n-api.service[123595]: request: GET /compute/v2.1/servers/f264d970-6336-460a-88f8-cfee793a20dd HTTP/1.1 Oct 04 19:04:00.192956 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 19:04:00.192956 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 19:04:00.192956 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 19:04:00.192956 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 0 Oct 04 19:04:00.192956 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 19:04:00.192956 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 19:04:00.192956 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 19:04:00.192956 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 19:04:00.192956 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPINzm8207dR2nLNAlKtayr0fhKtYB7_5KP9sdZ8dNe2jYFcPB_1dtv05BK_VwxdTtUbAllkj70KkQi-DnG6-nHj6tW3gH6ZNyPt3O_xaVDSVhEAmiMKDdusQeUdp3x94fYBFJAKbbAWbFxds419Y9FZD3C8irr4siI4vdoI97E6TvQk Oct 04 19:04:00.192956 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 19:04:00.192956 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 19:04:00.192956 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 19:04:00.192956 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 19:04:00.192956 n-d-851028-13 devstack@n-api.service[123595]: X-Openstack-Nova-Api-Version: 2.57 Oct 04 19:04:00.192956 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 19:04:00.192956 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 19:04:00.192956 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: a2bd7c2243464924b04efd5a343d5a0f Oct 04 19:04:00.192956 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-ServerShowV257Test-1075324111 Oct 04 19:04:00.192956 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 19:04:00.192956 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 19:04:00.192956 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/a2bd7c2243464924b04efd5a343d5a0f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_a2bd7c2243464924b04efd5a343d5a0f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a2bd7c2243464924b04efd5a343d5a0f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a2bd7c2243464924b04efd5a343d5a0f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 19:04:00.192956 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-ServerShowV257Test-1075324111 Oct 04 19:04:00.192956 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: a2bd7c2243464924b04efd5a343d5a0f Oct 04 19:04:00.192956 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-ServerShowV257Test-1075324111 Oct 04 19:04:00.192956 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-ServerShowV257Test-1075324111-project Oct 04 19:04:00.192956 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 19:04:00.192956 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 19:04:00.192956 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: 2b1a7754d7344f08ae1b3ef134339ba0 Oct 04 19:04:00.192956 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-ServerShowV257Test-1075324111-project Oct 04 19:04:00.192956 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 19:04:00.192956 n-d-851028-13 devstack@n-api.service[123595]: exception: Instance f264d970-6336-460a-88f8-cfee793a20dd could not be found. Oct 04 19:04:00.192956 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': 'f264d970-6336-460a-88f8-cfee793a20dd'} Oct 04 19:04:00.192956 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:04:00.192956 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:04:00.192956 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:04:00.192956 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:04:00.192956 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:04:00.192956 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:04:00.192956 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:04:00.192956 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:04:00.192956 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:04:00.192956 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:04:00.192956 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f264d970-6336-460a-88f8-cfee793a20dd could not be found. Oct 04 19:04:00.192956 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:04:00.192956 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:04:00.192956 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:04:00.192956 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:04:00.192956 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:04:00.192956 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:04:00.192956 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:04:00.192956 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:04:00.192956 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:04:00.192956 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:04:00.192956 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:04:00.192956 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:04:00.192956 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:04:00.192956 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:04:00.192956 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:04:00.192956 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:04:00.192956 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f264d970-6336-460a-88f8-cfee793a20dd could not be found. Oct 04 19:04:00.192956 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:04:00.192956 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:04:00.192956 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:04:00.198184 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:04:00.198184 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:04:00.198184 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:04:00.198184 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:04:00.198184 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:04:00.198184 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f264d970-6336-460a-88f8-cfee793a20dd could not be found. Oct 04 19:04:00.198184 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:04:00.198184 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-0d90c549-72c3-4e84-9581-7b3411653a01 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] Returning 404 to user: Instance f264d970-6336-460a-88f8-cfee793a20dd could not be found. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:04:00.198184 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-0d90c549-72c3-4e84-9581-7b3411653a01 tempest-ServerShowV257Test-1075324111 tempest-ServerShowV257Test-1075324111-project] 10.222.0.43 "GET /compute/v2.1/servers/f264d970-6336-460a-88f8-cfee793a20dd" status: 404 len: 111 microversion: 2.57 time: 0.113279 Oct 04 19:04:00.201244 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2717/5793] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:04:00 2022] GET /compute/v2.1/servers/f264d970-6336-460a-88f8-cfee793a20dd => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 19:04:00.505797 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-5e04aff1-458e-4ed4-9cc3-cf83518346db tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c997bc60473b43fd9fcf0c65111c44c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a711601b7a439caf395233de1febff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:00.514640 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-5e04aff1-458e-4ed4-9cc3-cf83518346db tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "GET /compute/v2.1/servers/3e01483e-8f33-43df-97b1-70f0834ac07d" status: 200 len: 1512 microversion: 2.1 time: 0.349828 Oct 04 19:04:00.522795 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3077/5794] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:00 2022] GET /compute/v2.1/servers/3e01483e-8f33-43df-97b1-70f0834ac07d => generated 1512 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:04:00.867842 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-b446e112-b74a-4734-948e-94cc3d74d993 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:00.868711 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-b446e112-b74a-4734-948e-94cc3d74d993 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] [instance: 75c5754b-3489-46e5-9a52-43e0a6cfd1c7] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:00.881383 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b446e112-b74a-4734-948e-94cc3d74d993 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:00.882074 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b446e112-b74a-4734-948e-94cc3d74d993 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:00.883961 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b446e112-b74a-4734-948e-94cc3d74d993 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:00.887097 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b446e112-b74a-4734-948e-94cc3d74d993 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:00.890391 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b446e112-b74a-4734-948e-94cc3d74d993 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:00.891029 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b446e112-b74a-4734-948e-94cc3d74d993 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:01.305899 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-b446e112-b74a-4734-948e-94cc3d74d993 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf87794979e844349d6ec6c6650565f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c25f1d17e94c74868357744e692487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:01.315559 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-b446e112-b74a-4734-948e-94cc3d74d993 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] 10.222.0.43 "GET /compute/v2.1/servers/75c5754b-3489-46e5-9a52-43e0a6cfd1c7" status: 200 len: 1392 microversion: 2.1 time: 0.453552 Oct 04 19:04:01.318429 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2718/5795] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:00 2022] GET /compute/v2.1/servers/75c5754b-3489-46e5-9a52-43e0a6cfd1c7 => generated 1392 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:04:01.554553 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-29805e25-f54d-4508-8f3e-2b44325af354 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:01.555369 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-29805e25-f54d-4508-8f3e-2b44325af354 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: 3e01483e-8f33-43df-97b1-70f0834ac07d] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:01.592062 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-29805e25-f54d-4508-8f3e-2b44325af354 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:01.610026 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-29805e25-f54d-4508-8f3e-2b44325af354 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:01.611674 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-29805e25-f54d-4508-8f3e-2b44325af354 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:01.618179 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-29805e25-f54d-4508-8f3e-2b44325af354 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:01.619288 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-29805e25-f54d-4508-8f3e-2b44325af354 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:01.624330 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-29805e25-f54d-4508-8f3e-2b44325af354 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:02.066317 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-29805e25-f54d-4508-8f3e-2b44325af354 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c997bc60473b43fd9fcf0c65111c44c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a711601b7a439caf395233de1febff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:02.083972 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-29805e25-f54d-4508-8f3e-2b44325af354 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "GET /compute/v2.1/servers/3e01483e-8f33-43df-97b1-70f0834ac07d" status: 200 len: 1512 microversion: 2.1 time: 0.536550 Oct 04 19:04:02.106024 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3078/5796] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:01 2022] GET /compute/v2.1/servers/3e01483e-8f33-43df-97b1-70f0834ac07d => generated 1512 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:04:02.341614 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-41b831ff-fe19-4495-b9dc-e006ce535bb9 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:02.342231 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-41b831ff-fe19-4495-b9dc-e006ce535bb9 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] [instance: 75c5754b-3489-46e5-9a52-43e0a6cfd1c7] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:02.356126 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-41b831ff-fe19-4495-b9dc-e006ce535bb9 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:02.358177 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-41b831ff-fe19-4495-b9dc-e006ce535bb9 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:02.366810 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-41b831ff-fe19-4495-b9dc-e006ce535bb9 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:02.366937 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-41b831ff-fe19-4495-b9dc-e006ce535bb9 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:02.370851 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-41b831ff-fe19-4495-b9dc-e006ce535bb9 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:02.371335 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-41b831ff-fe19-4495-b9dc-e006ce535bb9 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:02.414150 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-295efc08-0779-4f0f-84f4-028207f7c1e5 req-e43b8616-85bc-493a-96eb-8b8279f03b1e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75c5754b-3489-46e5-9a52-43e0a6cfd1c7", "tag": "515e62ea-52d3-4ada-b96e-712f01398333"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:04:02.433379 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-295efc08-0779-4f0f-84f4-028207f7c1e5 req-e43b8616-85bc-493a-96eb-8b8279f03b1e service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:02.436006 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-295efc08-0779-4f0f-84f4-028207f7c1e5 req-e43b8616-85bc-493a-96eb-8b8279f03b1e service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:02.438154 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-295efc08-0779-4f0f-84f4-028207f7c1e5 req-e43b8616-85bc-493a-96eb-8b8279f03b1e service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:02.482534 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-295efc08-0779-4f0f-84f4-028207f7c1e5 req-e43b8616-85bc-493a-96eb-8b8279f03b1e service nova] Creating event network-changed:515e62ea-52d3-4ada-b96e-712f01398333 for instance 75c5754b-3489-46e5-9a52-43e0a6cfd1c7 on n-h1-851028-13 Oct 04 19:04:02.493722 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-295efc08-0779-4f0f-84f4-028207f7c1e5 req-e43b8616-85bc-493a-96eb-8b8279f03b1e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085219 Oct 04 19:04:02.499545 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3079/5797] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:04:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:04:02.908240 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-41b831ff-fe19-4495-b9dc-e006ce535bb9 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf87794979e844349d6ec6c6650565f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c25f1d17e94c74868357744e692487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:02.921323 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-41b831ff-fe19-4495-b9dc-e006ce535bb9 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] 10.222.0.43 "GET /compute/v2.1/servers/75c5754b-3489-46e5-9a52-43e0a6cfd1c7" status: 200 len: 1392 microversion: 2.1 time: 0.583433 Oct 04 19:04:02.922427 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2719/5798] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:02 2022] GET /compute/v2.1/servers/75c5754b-3489-46e5-9a52-43e0a6cfd1c7 => generated 1392 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:04:03.120795 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-6b150af9-2b27-46a0-bfbb-44c41ec978fb tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:03.122353 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-6b150af9-2b27-46a0-bfbb-44c41ec978fb tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: 3e01483e-8f33-43df-97b1-70f0834ac07d] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:03.148507 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6b150af9-2b27-46a0-bfbb-44c41ec978fb tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:03.149390 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6b150af9-2b27-46a0-bfbb-44c41ec978fb tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:03.150145 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6b150af9-2b27-46a0-bfbb-44c41ec978fb tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:03.151738 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6b150af9-2b27-46a0-bfbb-44c41ec978fb tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:03.152335 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6b150af9-2b27-46a0-bfbb-44c41ec978fb tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:03.152981 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6b150af9-2b27-46a0-bfbb-44c41ec978fb tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:03.874463 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-6b150af9-2b27-46a0-bfbb-44c41ec978fb tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c997bc60473b43fd9fcf0c65111c44c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a711601b7a439caf395233de1febff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:03.886250 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-6b150af9-2b27-46a0-bfbb-44c41ec978fb tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "GET /compute/v2.1/servers/3e01483e-8f33-43df-97b1-70f0834ac07d" status: 200 len: 1512 microversion: 2.1 time: 0.772604 Oct 04 19:04:03.890973 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3080/5799] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:03 2022] GET /compute/v2.1/servers/3e01483e-8f33-43df-97b1-70f0834ac07d => generated 1512 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:04:03.948569 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-448d23ba-dd45-42bb-bc98-f1bf49a83a29 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:03.949834 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-448d23ba-dd45-42bb-bc98-f1bf49a83a29 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] [instance: 75c5754b-3489-46e5-9a52-43e0a6cfd1c7] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:03.965515 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-448d23ba-dd45-42bb-bc98-f1bf49a83a29 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:03.966289 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-448d23ba-dd45-42bb-bc98-f1bf49a83a29 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:03.966908 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-448d23ba-dd45-42bb-bc98-f1bf49a83a29 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:03.967800 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-448d23ba-dd45-42bb-bc98-f1bf49a83a29 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:03.968442 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-448d23ba-dd45-42bb-bc98-f1bf49a83a29 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:03.969044 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-448d23ba-dd45-42bb-bc98-f1bf49a83a29 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:04.024140 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:04:04.374438 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-448d23ba-dd45-42bb-bc98-f1bf49a83a29 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf87794979e844349d6ec6c6650565f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c25f1d17e94c74868357744e692487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:04.386810 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-448d23ba-dd45-42bb-bc98-f1bf49a83a29 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] 10.222.0.43 "GET /compute/v2.1/servers/75c5754b-3489-46e5-9a52-43e0a6cfd1c7" status: 200 len: 1392 microversion: 2.1 time: 0.441978 Oct 04 19:04:04.401375 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2720/5800] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:03 2022] GET /compute/v2.1/servers/75c5754b-3489-46e5-9a52-43e0a6cfd1c7 => generated 1392 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:04:04.915761 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-62657f24-d021-430b-8a8e-4ebb1415648b tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:04.916392 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-62657f24-d021-430b-8a8e-4ebb1415648b tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: 3e01483e-8f33-43df-97b1-70f0834ac07d] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:04.926104 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-62657f24-d021-430b-8a8e-4ebb1415648b tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:04.927024 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-62657f24-d021-430b-8a8e-4ebb1415648b tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:04.929013 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-62657f24-d021-430b-8a8e-4ebb1415648b tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:04.930081 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-62657f24-d021-430b-8a8e-4ebb1415648b tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:04.930800 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-62657f24-d021-430b-8a8e-4ebb1415648b tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:04.931467 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-62657f24-d021-430b-8a8e-4ebb1415648b tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:05.414113 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-151bd94c-fe8b-462c-83d3-dc2dec560a4b tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:05.414778 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-151bd94c-fe8b-462c-83d3-dc2dec560a4b tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] [instance: 75c5754b-3489-46e5-9a52-43e0a6cfd1c7] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:05.428668 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:04:05.435759 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-151bd94c-fe8b-462c-83d3-dc2dec560a4b tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:05.437488 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-151bd94c-fe8b-462c-83d3-dc2dec560a4b tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:05.438181 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-151bd94c-fe8b-462c-83d3-dc2dec560a4b tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:05.439281 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-151bd94c-fe8b-462c-83d3-dc2dec560a4b tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:05.439942 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-151bd94c-fe8b-462c-83d3-dc2dec560a4b tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:05.441659 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-151bd94c-fe8b-462c-83d3-dc2dec560a4b tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:05.552756 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-62657f24-d021-430b-8a8e-4ebb1415648b tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c997bc60473b43fd9fcf0c65111c44c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a711601b7a439caf395233de1febff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:05.563300 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-62657f24-d021-430b-8a8e-4ebb1415648b tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "GET /compute/v2.1/servers/3e01483e-8f33-43df-97b1-70f0834ac07d" status: 200 len: 1512 microversion: 2.1 time: 0.653097 Oct 04 19:04:05.569479 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3081/5801] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:04 2022] GET /compute/v2.1/servers/3e01483e-8f33-43df-97b1-70f0834ac07d => generated 1512 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:04:05.690671 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-151bd94c-fe8b-462c-83d3-dc2dec560a4b tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf87794979e844349d6ec6c6650565f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c25f1d17e94c74868357744e692487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:05.715491 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-151bd94c-fe8b-462c-83d3-dc2dec560a4b tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] 10.222.0.43 "GET /compute/v2.1/servers/75c5754b-3489-46e5-9a52-43e0a6cfd1c7" status: 200 len: 1392 microversion: 2.1 time: 0.307385 Oct 04 19:04:05.736545 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2721/5802] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:05 2022] GET /compute/v2.1/servers/75c5754b-3489-46e5-9a52-43e0a6cfd1c7 => generated 1392 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:04:06.591359 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-b0563465-7880-4107-8f87-12e02883c2ee tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:06.593060 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-b0563465-7880-4107-8f87-12e02883c2ee tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: 3e01483e-8f33-43df-97b1-70f0834ac07d] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:06.606803 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b0563465-7880-4107-8f87-12e02883c2ee tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:06.608356 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b0563465-7880-4107-8f87-12e02883c2ee tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:06.609028 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b0563465-7880-4107-8f87-12e02883c2ee tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:06.610223 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b0563465-7880-4107-8f87-12e02883c2ee tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:06.610852 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b0563465-7880-4107-8f87-12e02883c2ee tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:06.611372 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b0563465-7880-4107-8f87-12e02883c2ee tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:06.743741 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-964a3dc9-b92a-4b49-81bf-46590b71f53f tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:06.745101 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-964a3dc9-b92a-4b49-81bf-46590b71f53f tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] [instance: 75c5754b-3489-46e5-9a52-43e0a6cfd1c7] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:06.757598 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-964a3dc9-b92a-4b49-81bf-46590b71f53f tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:06.758722 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-964a3dc9-b92a-4b49-81bf-46590b71f53f tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:06.762464 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-964a3dc9-b92a-4b49-81bf-46590b71f53f tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:06.763463 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-964a3dc9-b92a-4b49-81bf-46590b71f53f tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:06.764515 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-964a3dc9-b92a-4b49-81bf-46590b71f53f tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:06.769196 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-964a3dc9-b92a-4b49-81bf-46590b71f53f tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:07.123051 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-964a3dc9-b92a-4b49-81bf-46590b71f53f tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf87794979e844349d6ec6c6650565f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c25f1d17e94c74868357744e692487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:07.132590 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-964a3dc9-b92a-4b49-81bf-46590b71f53f tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] 10.222.0.43 "GET /compute/v2.1/servers/75c5754b-3489-46e5-9a52-43e0a6cfd1c7" status: 200 len: 1392 microversion: 2.1 time: 0.393009 Oct 04 19:04:07.136479 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-b0563465-7880-4107-8f87-12e02883c2ee tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c997bc60473b43fd9fcf0c65111c44c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a711601b7a439caf395233de1febff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:07.145609 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2722/5803] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:06 2022] GET /compute/v2.1/servers/75c5754b-3489-46e5-9a52-43e0a6cfd1c7 => generated 1392 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:04:07.150463 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=2 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:04:07.159302 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-b0563465-7880-4107-8f87-12e02883c2ee tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "GET /compute/v2.1/servers/3e01483e-8f33-43df-97b1-70f0834ac07d" status: 200 len: 1512 microversion: 2.1 time: 0.572251 Oct 04 19:04:07.163514 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3082/5804] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:06 2022] GET /compute/v2.1/servers/3e01483e-8f33-43df-97b1-70f0834ac07d => generated 1512 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:04:08.158699 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-dedd886b-517d-4ccd-8e56-cc107f719064 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:08.159371 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-dedd886b-517d-4ccd-8e56-cc107f719064 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] [instance: 75c5754b-3489-46e5-9a52-43e0a6cfd1c7] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:08.171042 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=2 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:04:08.174523 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dedd886b-517d-4ccd-8e56-cc107f719064 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:08.182916 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dedd886b-517d-4ccd-8e56-cc107f719064 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:08.183703 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dedd886b-517d-4ccd-8e56-cc107f719064 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:08.184877 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dedd886b-517d-4ccd-8e56-cc107f719064 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:08.185552 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dedd886b-517d-4ccd-8e56-cc107f719064 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:08.190002 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dedd886b-517d-4ccd-8e56-cc107f719064 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:08.210395 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-0c0cf426-e011-4b83-8fc9-d04ab4bb83af tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:08.229594 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-0c0cf426-e011-4b83-8fc9-d04ab4bb83af tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: 3e01483e-8f33-43df-97b1-70f0834ac07d] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:08.242541 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=6 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:04:08.248478 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0c0cf426-e011-4b83-8fc9-d04ab4bb83af tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:08.249406 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0c0cf426-e011-4b83-8fc9-d04ab4bb83af tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:08.250106 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0c0cf426-e011-4b83-8fc9-d04ab4bb83af tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:08.251080 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0c0cf426-e011-4b83-8fc9-d04ab4bb83af tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:08.251770 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0c0cf426-e011-4b83-8fc9-d04ab4bb83af tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:08.264598 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0c0cf426-e011-4b83-8fc9-d04ab4bb83af tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:08.518639 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-0c0cf426-e011-4b83-8fc9-d04ab4bb83af tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c997bc60473b43fd9fcf0c65111c44c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a711601b7a439caf395233de1febff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:08.536779 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-0c0cf426-e011-4b83-8fc9-d04ab4bb83af tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "GET /compute/v2.1/servers/3e01483e-8f33-43df-97b1-70f0834ac07d" status: 200 len: 1512 microversion: 2.1 time: 0.345775 Oct 04 19:04:08.538385 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3083/5805] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:08 2022] GET /compute/v2.1/servers/3e01483e-8f33-43df-97b1-70f0834ac07d => generated 1512 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:04:08.842892 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-dedd886b-517d-4ccd-8e56-cc107f719064 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf87794979e844349d6ec6c6650565f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c25f1d17e94c74868357744e692487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:08.854249 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-dedd886b-517d-4ccd-8e56-cc107f719064 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] 10.222.0.43 "GET /compute/v2.1/servers/75c5754b-3489-46e5-9a52-43e0a6cfd1c7" status: 200 len: 1392 microversion: 2.1 time: 0.697150 Oct 04 19:04:08.855413 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2723/5806] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:08 2022] GET /compute/v2.1/servers/75c5754b-3489-46e5-9a52-43e0a6cfd1c7 => generated 1392 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:04:09.565921 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-1a29901f-7eff-4238-8c93-1f6d8db032e0 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:09.567682 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-1a29901f-7eff-4238-8c93-1f6d8db032e0 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: 3e01483e-8f33-43df-97b1-70f0834ac07d] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:09.589727 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1a29901f-7eff-4238-8c93-1f6d8db032e0 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:09.594567 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1a29901f-7eff-4238-8c93-1f6d8db032e0 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:09.595038 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1a29901f-7eff-4238-8c93-1f6d8db032e0 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:09.595786 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1a29901f-7eff-4238-8c93-1f6d8db032e0 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:09.602953 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1a29901f-7eff-4238-8c93-1f6d8db032e0 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:09.603456 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1a29901f-7eff-4238-8c93-1f6d8db032e0 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:09.882723 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-3b5b0d07-24d0-48f4-a1b4-b063a58f17f6 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:09.889745 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-3b5b0d07-24d0-48f4-a1b4-b063a58f17f6 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] [instance: 75c5754b-3489-46e5-9a52-43e0a6cfd1c7] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:09.909979 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3b5b0d07-24d0-48f4-a1b4-b063a58f17f6 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:09.910474 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3b5b0d07-24d0-48f4-a1b4-b063a58f17f6 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:09.910917 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3b5b0d07-24d0-48f4-a1b4-b063a58f17f6 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:09.915528 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3b5b0d07-24d0-48f4-a1b4-b063a58f17f6 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:09.916141 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3b5b0d07-24d0-48f4-a1b4-b063a58f17f6 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:09.916600 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3b5b0d07-24d0-48f4-a1b4-b063a58f17f6 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:09.942826 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-1a29901f-7eff-4238-8c93-1f6d8db032e0 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c997bc60473b43fd9fcf0c65111c44c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a711601b7a439caf395233de1febff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:09.959257 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-1a29901f-7eff-4238-8c93-1f6d8db032e0 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "GET /compute/v2.1/servers/3e01483e-8f33-43df-97b1-70f0834ac07d" status: 200 len: 1489 microversion: 2.1 time: 0.400962 Oct 04 19:04:09.960995 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3084/5807] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:09 2022] GET /compute/v2.1/servers/3e01483e-8f33-43df-97b1-70f0834ac07d => generated 1489 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:04:09.985018 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-bab0d41b-400a-4319-a777-76c311cae4bd tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:09.985976 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-bab0d41b-400a-4319-a777-76c311cae4bd tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: 3e01483e-8f33-43df-97b1-70f0834ac07d] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:09.994033 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bab0d41b-400a-4319-a777-76c311cae4bd tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:09.994914 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bab0d41b-400a-4319-a777-76c311cae4bd tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:09.995593 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bab0d41b-400a-4319-a777-76c311cae4bd tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:09.996468 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bab0d41b-400a-4319-a777-76c311cae4bd tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:09.997089 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bab0d41b-400a-4319-a777-76c311cae4bd tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:09.997700 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bab0d41b-400a-4319-a777-76c311cae4bd tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:10.054550 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-bab0d41b-400a-4319-a777-76c311cae4bd tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: 3e01483e-8f33-43df-97b1-70f0834ac07d] Going to try to terminate instance {{(pid=123596) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 19:04:10.248226 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-bab0d41b-400a-4319-a777-76c311cae4bd tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "DELETE /compute/v2.1/servers/3e01483e-8f33-43df-97b1-70f0834ac07d" status: 204 len: 0 microversion: 2.1 time: 0.268071 Oct 04 19:04:10.248778 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3085/5808] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 19:04:09 2022] DELETE /compute/v2.1/servers/3e01483e-8f33-43df-97b1-70f0834ac07d => generated 0 bytes in 270 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:04:10.257703 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-48d1de0f-c6ac-48a9-806f-56f78346677c tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:10.268131 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-48d1de0f-c6ac-48a9-806f-56f78346677c tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: 3e01483e-8f33-43df-97b1-70f0834ac07d] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:10.275593 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-48d1de0f-c6ac-48a9-806f-56f78346677c tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:10.276098 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-48d1de0f-c6ac-48a9-806f-56f78346677c tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:10.281537 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-48d1de0f-c6ac-48a9-806f-56f78346677c tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:10.282478 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-48d1de0f-c6ac-48a9-806f-56f78346677c tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:10.283121 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-48d1de0f-c6ac-48a9-806f-56f78346677c tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:10.283714 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-48d1de0f-c6ac-48a9-806f-56f78346677c tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:10.590683 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-48d1de0f-c6ac-48a9-806f-56f78346677c tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c997bc60473b43fd9fcf0c65111c44c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a711601b7a439caf395233de1febff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:10.605050 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-48d1de0f-c6ac-48a9-806f-56f78346677c tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "GET /compute/v2.1/servers/3e01483e-8f33-43df-97b1-70f0834ac07d" status: 200 len: 1495 microversion: 2.1 time: 0.351557 Oct 04 19:04:10.605967 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3086/5809] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:10 2022] GET /compute/v2.1/servers/3e01483e-8f33-43df-97b1-70f0834ac07d => generated 1495 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:04:10.700512 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-3b5b0d07-24d0-48f4-a1b4-b063a58f17f6 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf87794979e844349d6ec6c6650565f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c25f1d17e94c74868357744e692487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:10.713678 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-3b5b0d07-24d0-48f4-a1b4-b063a58f17f6 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] 10.222.0.43 "GET /compute/v2.1/servers/75c5754b-3489-46e5-9a52-43e0a6cfd1c7" status: 200 len: 1392 microversion: 2.1 time: 0.834894 Oct 04 19:04:10.714605 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2724/5810] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:09 2022] GET /compute/v2.1/servers/75c5754b-3489-46e5-9a52-43e0a6cfd1c7 => generated 1392 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:04:11.407725 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-bf4b3592-28d9-4e8b-99a6-e69abdc74bf5 req-2b03878b-ae8d-450b-8755-d5208a5ec9dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75c5754b-3489-46e5-9a52-43e0a6cfd1c7", "name": "network-vif-plugged", "status": "completed", "tag": "515e62ea-52d3-4ada-b96e-712f01398333"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:04:11.441473 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-bf4b3592-28d9-4e8b-99a6-e69abdc74bf5 req-2b03878b-ae8d-450b-8755-d5208a5ec9dd service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:11.442256 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-bf4b3592-28d9-4e8b-99a6-e69abdc74bf5 req-2b03878b-ae8d-450b-8755-d5208a5ec9dd service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:11.442867 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-bf4b3592-28d9-4e8b-99a6-e69abdc74bf5 req-2b03878b-ae8d-450b-8755-d5208a5ec9dd service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:11.470536 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-bf4b3592-28d9-4e8b-99a6-e69abdc74bf5 req-2b03878b-ae8d-450b-8755-d5208a5ec9dd service nova] Creating event network-vif-plugged:515e62ea-52d3-4ada-b96e-712f01398333 for instance 75c5754b-3489-46e5-9a52-43e0a6cfd1c7 on n-h1-851028-13 Oct 04 19:04:11.486887 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-bf4b3592-28d9-4e8b-99a6-e69abdc74bf5 req-2b03878b-ae8d-450b-8755-d5208a5ec9dd service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084298 Oct 04 19:04:11.488186 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3087/5811] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:04:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:04:11.631399 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-65d418d3-899a-460b-8755-187e8836eaab tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:11.632178 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-65d418d3-899a-460b-8755-187e8836eaab tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: 3e01483e-8f33-43df-97b1-70f0834ac07d] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:11.681429 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-65d418d3-899a-460b-8755-187e8836eaab tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:11.683080 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-65d418d3-899a-460b-8755-187e8836eaab tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:11.683847 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-65d418d3-899a-460b-8755-187e8836eaab tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:11.684863 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-65d418d3-899a-460b-8755-187e8836eaab tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:11.685588 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-65d418d3-899a-460b-8755-187e8836eaab tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:11.686295 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-65d418d3-899a-460b-8755-187e8836eaab tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:11.737210 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-664dd39a-225a-486c-8de0-b326814c0d66 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:11.738040 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-664dd39a-225a-486c-8de0-b326814c0d66 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] [instance: 75c5754b-3489-46e5-9a52-43e0a6cfd1c7] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:11.765265 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-664dd39a-225a-486c-8de0-b326814c0d66 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:11.765969 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-664dd39a-225a-486c-8de0-b326814c0d66 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:11.766580 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-664dd39a-225a-486c-8de0-b326814c0d66 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:11.778087 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-664dd39a-225a-486c-8de0-b326814c0d66 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:11.778587 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-664dd39a-225a-486c-8de0-b326814c0d66 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:11.779038 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-664dd39a-225a-486c-8de0-b326814c0d66 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:12.122042 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-65d418d3-899a-460b-8755-187e8836eaab tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c997bc60473b43fd9fcf0c65111c44c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a711601b7a439caf395233de1febff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:12.134658 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-65d418d3-899a-460b-8755-187e8836eaab tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "GET /compute/v2.1/servers/3e01483e-8f33-43df-97b1-70f0834ac07d" status: 200 len: 1495 microversion: 2.1 time: 0.507097 Oct 04 19:04:12.136225 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2725/5812] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:11 2022] GET /compute/v2.1/servers/3e01483e-8f33-43df-97b1-70f0834ac07d => generated 1495 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:04:12.220356 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-664dd39a-225a-486c-8de0-b326814c0d66 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf87794979e844349d6ec6c6650565f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c25f1d17e94c74868357744e692487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:12.228799 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-664dd39a-225a-486c-8de0-b326814c0d66 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] 10.222.0.43 "GET /compute/v2.1/servers/75c5754b-3489-46e5-9a52-43e0a6cfd1c7" status: 200 len: 1392 microversion: 2.1 time: 0.496632 Oct 04 19:04:12.230876 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3088/5813] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:11 2022] GET /compute/v2.1/servers/75c5754b-3489-46e5-9a52-43e0a6cfd1c7 => generated 1392 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:04:12.728092 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-737c888a-bfa7-4c10-a35b-c072249569b9 req-ab76c50e-495d-4ac7-8512-088e4d319ce6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e01483e-8f33-43df-97b1-70f0834ac07d", "name": "network-vif-deleted", "tag": "1757a81c-3646-4099-a814-204aa7096c72"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:04:12.742721 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-737c888a-bfa7-4c10-a35b-c072249569b9 req-ab76c50e-495d-4ac7-8512-088e4d319ce6 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:12.743692 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-737c888a-bfa7-4c10-a35b-c072249569b9 req-ab76c50e-495d-4ac7-8512-088e4d319ce6 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:12.744399 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-737c888a-bfa7-4c10-a35b-c072249569b9 req-ab76c50e-495d-4ac7-8512-088e4d319ce6 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:12.760624 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-737c888a-bfa7-4c10-a35b-c072249569b9 req-ab76c50e-495d-4ac7-8512-088e4d319ce6 service nova] Creating event network-vif-deleted:1757a81c-3646-4099-a814-204aa7096c72 for instance 3e01483e-8f33-43df-97b1-70f0834ac07d on n-h1-851028-13 Oct 04 19:04:12.767673 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-737c888a-bfa7-4c10-a35b-c072249569b9 req-ab76c50e-495d-4ac7-8512-088e4d319ce6 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044750 Oct 04 19:04:12.773086 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2726/5814] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:04:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:04:13.169371 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-8494fe1f-aece-41cc-a101-59d0867fe90d tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:13.172272 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-8494fe1f-aece-41cc-a101-59d0867fe90d tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: 3e01483e-8f33-43df-97b1-70f0834ac07d] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:13.182129 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8494fe1f-aece-41cc-a101-59d0867fe90d tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:13.182953 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8494fe1f-aece-41cc-a101-59d0867fe90d tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:13.183805 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8494fe1f-aece-41cc-a101-59d0867fe90d tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:13.184799 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8494fe1f-aece-41cc-a101-59d0867fe90d tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:13.185706 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8494fe1f-aece-41cc-a101-59d0867fe90d tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:13.186336 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8494fe1f-aece-41cc-a101-59d0867fe90d tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:13.242659 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:04:13.259177 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-d4147b90-356c-42a0-a775-a2b26c8e0a39 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:13.260311 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-d4147b90-356c-42a0-a775-a2b26c8e0a39 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] [instance: 75c5754b-3489-46e5-9a52-43e0a6cfd1c7] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:13.270904 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8494fe1f-aece-41cc-a101-59d0867fe90d tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:13.271674 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8494fe1f-aece-41cc-a101-59d0867fe90d tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:13.275520 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8494fe1f-aece-41cc-a101-59d0867fe90d tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:13.276178 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.objects.instance [None req-8494fe1f-aece-41cc-a101-59d0867fe90d tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lazy-loading 'fault' on Instance uuid 3e01483e-8f33-43df-97b1-70f0834ac07d {{(pid=123596) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 19:04:13.329969 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d4147b90-356c-42a0-a775-a2b26c8e0a39 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:13.330716 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d4147b90-356c-42a0-a775-a2b26c8e0a39 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:13.331369 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d4147b90-356c-42a0-a775-a2b26c8e0a39 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:13.332292 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d4147b90-356c-42a0-a775-a2b26c8e0a39 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:13.332936 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d4147b90-356c-42a0-a775-a2b26c8e0a39 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:13.337723 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d4147b90-356c-42a0-a775-a2b26c8e0a39 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:13.419865 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-8494fe1f-aece-41cc-a101-59d0867fe90d tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c997bc60473b43fd9fcf0c65111c44c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a711601b7a439caf395233de1febff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:13.432069 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-8494fe1f-aece-41cc-a101-59d0867fe90d tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "GET /compute/v2.1/servers/3e01483e-8f33-43df-97b1-70f0834ac07d" status: 200 len: 1305 microversion: 2.1 time: 0.266573 Oct 04 19:04:13.433576 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3089/5815] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:13 2022] GET /compute/v2.1/servers/3e01483e-8f33-43df-97b1-70f0834ac07d => generated 1305 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:04:13.633344 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-d4147b90-356c-42a0-a775-a2b26c8e0a39 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf87794979e844349d6ec6c6650565f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c25f1d17e94c74868357744e692487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:13.653965 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-d4147b90-356c-42a0-a775-a2b26c8e0a39 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] 10.222.0.43 "GET /compute/v2.1/servers/75c5754b-3489-46e5-9a52-43e0a6cfd1c7" status: 200 len: 1564 microversion: 2.1 time: 0.400511 Oct 04 19:04:13.657343 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2727/5816] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:13 2022] GET /compute/v2.1/servers/75c5754b-3489-46e5-9a52-43e0a6cfd1c7 => generated 1564 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:04:13.687673 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-93c463ea-5a6d-47b1-95b3-a7ea0ad3059b tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:13.689472 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-93c463ea-5a6d-47b1-95b3-a7ea0ad3059b tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] [instance: 75c5754b-3489-46e5-9a52-43e0a6cfd1c7] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:13.702986 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-93c463ea-5a6d-47b1-95b3-a7ea0ad3059b tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:13.704237 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-93c463ea-5a6d-47b1-95b3-a7ea0ad3059b tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:13.705030 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-93c463ea-5a6d-47b1-95b3-a7ea0ad3059b tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:13.708593 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-93c463ea-5a6d-47b1-95b3-a7ea0ad3059b tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:13.710096 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-93c463ea-5a6d-47b1-95b3-a7ea0ad3059b tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:13.711284 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-93c463ea-5a6d-47b1-95b3-a7ea0ad3059b tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:14.137840 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-93c463ea-5a6d-47b1-95b3-a7ea0ad3059b tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf87794979e844349d6ec6c6650565f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c25f1d17e94c74868357744e692487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:14.147193 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-93c463ea-5a6d-47b1-95b3-a7ea0ad3059b tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] 10.222.0.43 "GET /compute/v2.1/servers/75c5754b-3489-46e5-9a52-43e0a6cfd1c7" status: 200 len: 1564 microversion: 2.1 time: 0.466784 Oct 04 19:04:14.163452 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3090/5817] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:13 2022] GET /compute/v2.1/servers/75c5754b-3489-46e5-9a52-43e0a6cfd1c7 => generated 1564 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:04:14.466183 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-fce708e6-5353-4f09-8726-0d5794713b77 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:14.467136 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-fce708e6-5353-4f09-8726-0d5794713b77 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: 3e01483e-8f33-43df-97b1-70f0834ac07d] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:14.482893 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fce708e6-5353-4f09-8726-0d5794713b77 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:14.488569 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fce708e6-5353-4f09-8726-0d5794713b77 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:14.489567 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fce708e6-5353-4f09-8726-0d5794713b77 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:14.493607 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fce708e6-5353-4f09-8726-0d5794713b77 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:14.496775 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fce708e6-5353-4f09-8726-0d5794713b77 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:14.497561 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fce708e6-5353-4f09-8726-0d5794713b77 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:14.584694 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-fce708e6-5353-4f09-8726-0d5794713b77 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] HTTP exception thrown: Instance 3e01483e-8f33-43df-97b1-70f0834ac07d could not be found. Oct 04 19:04:14.605283 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-fce708e6-5353-4f09-8726-0d5794713b77 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Request method failure captured: Oct 04 19:04:14.605283 n-d-851028-13 devstack@n-api.service[123595]: request: GET /compute/v2.1/servers/3e01483e-8f33-43df-97b1-70f0834ac07d HTTP/1.1 Oct 04 19:04:14.605283 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 19:04:14.605283 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 19:04:14.605283 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 19:04:14.605283 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 0 Oct 04 19:04:14.605283 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 19:04:14.605283 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 19:04:14.605283 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 19:04:14.605283 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 19:04:14.605283 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPIKl7r6ZFtp0u4zXtNLGIhqHo70GyUJnklFY8mLM6SAvqzMqMYlk7FNNMFRu1dxhVJoaHCY-KymtUU7SbzcnaY3gmI4NmuaRKJjk_WfnM3eNlWdo1XIjmy2xIfTxketrHpoedtH-76PD0N1ebOmJq-sWqhFc1j62MJ2QKuwEgYmouJ4 Oct 04 19:04:14.605283 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 19:04:14.605283 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 19:04:14.605283 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 19:04:14.605283 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 19:04:14.605283 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 19:04:14.605283 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 19:04:14.605283 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: a6a711601b7a439caf395233de1febff Oct 04 19:04:14.605283 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-DeleteServersTestJSON-591734195 Oct 04 19:04:14.605283 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 19:04:14.605283 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 19:04:14.605283 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/a6a711601b7a439caf395233de1febff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_a6a711601b7a439caf395233de1febff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a6a711601b7a439caf395233de1febff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a6a711601b7a439caf395233de1febff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 19:04:14.605283 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-DeleteServersTestJSON-591734195 Oct 04 19:04:14.605283 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: a6a711601b7a439caf395233de1febff Oct 04 19:04:14.605283 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-DeleteServersTestJSON-591734195 Oct 04 19:04:14.605283 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-DeleteServersTestJSON-591734195-project Oct 04 19:04:14.605283 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 19:04:14.605283 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 19:04:14.605283 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: c997bc60473b43fd9fcf0c65111c44c0 Oct 04 19:04:14.605283 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-DeleteServersTestJSON-591734195-project Oct 04 19:04:14.605283 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 19:04:14.605283 n-d-851028-13 devstack@n-api.service[123595]: exception: Instance 3e01483e-8f33-43df-97b1-70f0834ac07d could not be found. Oct 04 19:04:14.605283 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': '3e01483e-8f33-43df-97b1-70f0834ac07d'} Oct 04 19:04:14.605283 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:04:14.605283 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:04:14.605283 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:04:14.605283 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:04:14.605283 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:04:14.605283 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:04:14.605283 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:04:14.605283 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:04:14.605283 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:04:14.605283 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:04:14.605283 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e01483e-8f33-43df-97b1-70f0834ac07d could not be found. Oct 04 19:04:14.605283 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:04:14.605283 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:04:14.605283 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:04:14.605283 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:04:14.605283 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:04:14.605283 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:04:14.605283 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:04:14.605283 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:04:14.605283 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:04:14.605283 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:04:14.605283 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:04:14.605283 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:04:14.605283 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:04:14.605283 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:04:14.605283 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:04:14.605283 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:04:14.605283 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e01483e-8f33-43df-97b1-70f0834ac07d could not be found. Oct 04 19:04:14.605283 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:04:14.605283 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:04:14.605283 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:04:14.611885 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:04:14.611885 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:04:14.611885 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:04:14.611885 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:04:14.611885 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:04:14.611885 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e01483e-8f33-43df-97b1-70f0834ac07d could not be found. Oct 04 19:04:14.611885 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:04:14.618295 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-fce708e6-5353-4f09-8726-0d5794713b77 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Returning 404 to user: Instance 3e01483e-8f33-43df-97b1-70f0834ac07d could not be found. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:04:14.619641 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-fce708e6-5353-4f09-8726-0d5794713b77 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "GET /compute/v2.1/servers/3e01483e-8f33-43df-97b1-70f0834ac07d" status: 404 len: 111 microversion: 2.1 time: 0.157490 Oct 04 19:04:14.629418 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2728/5818] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:14 2022] GET /compute/v2.1/servers/3e01483e-8f33-43df-97b1-70f0834ac07d => generated 111 bytes in 163 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:04:14.828221 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-3cc70f7e-502c-47ce-be80-9f4f241afae3 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-304643170", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452", "networks": [{"uuid": "dcd99798-7080-4c74-b648-36288a298add"}]}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:04:14.960567 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.network.neutron [None req-3cc70f7e-502c-47ce-be80-9f4f241afae3 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] validate_networks() for [('dcd99798-7080-4c74-b648-36288a298add', None, None, None, None, None)] {{(pid=123596) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 19:04:16.677314 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-3cc70f7e-502c-47ce-be80-9f4f241afae3 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Flavor limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:04:16.679160 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-3cc70f7e-502c-47ce-be80-9f4f241afae3 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Image limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:04:16.679881 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-3cc70f7e-502c-47ce-be80-9f4f241afae3 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Flavor pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:04:16.680539 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-3cc70f7e-502c-47ce-be80-9f4f241afae3 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Image pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:04:16.681169 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-3cc70f7e-502c-47ce-be80-9f4f241afae3 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:04:16.694783 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3cc70f7e-502c-47ce-be80-9f4f241afae3 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:16.695557 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3cc70f7e-502c-47ce-be80-9f4f241afae3 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:16.696247 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3cc70f7e-502c-47ce-be80-9f4f241afae3 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:16.697251 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3cc70f7e-502c-47ce-be80-9f4f241afae3 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:16.697941 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3cc70f7e-502c-47ce-be80-9f4f241afae3 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:16.698622 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3cc70f7e-502c-47ce-be80-9f4f241afae3 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:16.721910 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-3cc70f7e-502c-47ce-be80-9f4f241afae3 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Getting quotas for project a6a711601b7a439caf395233de1febff. Resources: {'ram', 'cores', 'instances'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:04:16.728986 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-3cc70f7e-502c-47ce-be80-9f4f241afae3 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Getting quotas for user c997bc60473b43fd9fcf0c65111c44c0 and project a6a711601b7a439caf395233de1febff. Resources: {'ram', 'cores', 'instances'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:04:16.755861 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-3cc70f7e-502c-47ce-be80-9f4f241afae3 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Going to run 1 instances... {{(pid=123596) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 19:04:16.761060 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-3cc70f7e-502c-47ce-be80-9f4f241afae3 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: a0c3f46d-ba5d-4349-a406-6ed87b428a28] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e8943ec5-4038-4d4b-b9b9-2415a79f5243',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123596) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 19:04:16.895892 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-3cc70f7e-502c-47ce-be80-9f4f241afae3 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.072465 Oct 04 19:04:16.898383 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3091/5819] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 19:04:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 2076 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 19:04:16.915620 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-dff12345-3045-4caa-9b42-75c62ec82696 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:16.920769 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-dff12345-3045-4caa-9b42-75c62ec82696 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: a0c3f46d-ba5d-4349-a406-6ed87b428a28] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:17.128790 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-dff12345-3045-4caa-9b42-75c62ec82696 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c997bc60473b43fd9fcf0c65111c44c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a711601b7a439caf395233de1febff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:17.150110 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-dff12345-3045-4caa-9b42-75c62ec82696 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "GET /compute/v2.1/servers/a0c3f46d-ba5d-4349-a406-6ed87b428a28" status: 200 len: 1214 microversion: 2.1 time: 0.243074 Oct 04 19:04:17.166108 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2729/5820] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:16 2022] GET /compute/v2.1/servers/a0c3f46d-ba5d-4349-a406-6ed87b428a28 => generated 1214 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:04:18.175006 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-d53429f1-e447-47ef-90a1-f45b96434a1b tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:18.176436 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-d53429f1-e447-47ef-90a1-f45b96434a1b tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: a0c3f46d-ba5d-4349-a406-6ed87b428a28] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:18.187881 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d53429f1-e447-47ef-90a1-f45b96434a1b tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:18.194564 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d53429f1-e447-47ef-90a1-f45b96434a1b tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:18.204029 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d53429f1-e447-47ef-90a1-f45b96434a1b tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:18.205972 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d53429f1-e447-47ef-90a1-f45b96434a1b tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:18.210817 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d53429f1-e447-47ef-90a1-f45b96434a1b tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:18.211297 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d53429f1-e447-47ef-90a1-f45b96434a1b tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:18.550499 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-d53429f1-e447-47ef-90a1-f45b96434a1b tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c997bc60473b43fd9fcf0c65111c44c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a711601b7a439caf395233de1febff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:18.560375 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-d53429f1-e447-47ef-90a1-f45b96434a1b tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "GET /compute/v2.1/servers/a0c3f46d-ba5d-4349-a406-6ed87b428a28" status: 200 len: 1266 microversion: 2.1 time: 0.390435 Oct 04 19:04:18.563996 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3092/5821] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:18 2022] GET /compute/v2.1/servers/a0c3f46d-ba5d-4349-a406-6ed87b428a28 => generated 1266 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:04:19.590794 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-eabb0f61-ded6-44b6-bd92-6f2475add9c8 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:19.592039 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-eabb0f61-ded6-44b6-bd92-6f2475add9c8 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: a0c3f46d-ba5d-4349-a406-6ed87b428a28] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:19.604441 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-eabb0f61-ded6-44b6-bd92-6f2475add9c8 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:19.604960 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-eabb0f61-ded6-44b6-bd92-6f2475add9c8 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:19.606676 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-eabb0f61-ded6-44b6-bd92-6f2475add9c8 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:19.607424 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-eabb0f61-ded6-44b6-bd92-6f2475add9c8 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:19.607892 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-eabb0f61-ded6-44b6-bd92-6f2475add9c8 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:19.608330 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-eabb0f61-ded6-44b6-bd92-6f2475add9c8 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:19.895763 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-eabb0f61-ded6-44b6-bd92-6f2475add9c8 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c997bc60473b43fd9fcf0c65111c44c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a711601b7a439caf395233de1febff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:19.909555 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-eabb0f61-ded6-44b6-bd92-6f2475add9c8 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "GET /compute/v2.1/servers/a0c3f46d-ba5d-4349-a406-6ed87b428a28" status: 200 len: 1272 microversion: 2.1 time: 0.323296 Oct 04 19:04:19.910917 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2730/5822] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:19 2022] GET /compute/v2.1/servers/a0c3f46d-ba5d-4349-a406-6ed87b428a28 => generated 1272 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:04:20.938691 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f166078a-631f-4a04-906d-f1c5c77986d9 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:20.939347 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-f166078a-631f-4a04-906d-f1c5c77986d9 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: a0c3f46d-ba5d-4349-a406-6ed87b428a28] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:20.964855 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f166078a-631f-4a04-906d-f1c5c77986d9 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:20.966164 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f166078a-631f-4a04-906d-f1c5c77986d9 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:20.966762 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f166078a-631f-4a04-906d-f1c5c77986d9 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:20.967822 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f166078a-631f-4a04-906d-f1c5c77986d9 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:20.968307 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f166078a-631f-4a04-906d-f1c5c77986d9 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:20.973650 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f166078a-631f-4a04-906d-f1c5c77986d9 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:21.496907 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-f166078a-631f-4a04-906d-f1c5c77986d9 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c997bc60473b43fd9fcf0c65111c44c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a711601b7a439caf395233de1febff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:21.507745 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-f166078a-631f-4a04-906d-f1c5c77986d9 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "GET /compute/v2.1/servers/a0c3f46d-ba5d-4349-a406-6ed87b428a28" status: 200 len: 1314 microversion: 2.1 time: 0.573108 Oct 04 19:04:21.523665 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3093/5823] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:20 2022] GET /compute/v2.1/servers/a0c3f46d-ba5d-4349-a406-6ed87b428a28 => generated 1314 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:04:21.796530 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-a6567985-3363-46c9-9268-df253869282f tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:21.797902 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-a6567985-3363-46c9-9268-df253869282f tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] [instance: 75c5754b-3489-46e5-9a52-43e0a6cfd1c7] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:21.810260 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a6567985-3363-46c9-9268-df253869282f tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:21.814757 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a6567985-3363-46c9-9268-df253869282f tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:21.815448 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a6567985-3363-46c9-9268-df253869282f tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:21.816385 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a6567985-3363-46c9-9268-df253869282f tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:21.817017 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a6567985-3363-46c9-9268-df253869282f tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:21.818023 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a6567985-3363-46c9-9268-df253869282f tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:21.836568 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-b6ff6650-3e98-450f-83c5-c6829dd5b592 req-28745cb6-824b-4309-9997-496a9562ea9b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75c5754b-3489-46e5-9a52-43e0a6cfd1c7", "tag": "515e62ea-52d3-4ada-b96e-712f01398333"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:04:21.862809 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-b6ff6650-3e98-450f-83c5-c6829dd5b592 req-28745cb6-824b-4309-9997-496a9562ea9b service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:21.863359 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-b6ff6650-3e98-450f-83c5-c6829dd5b592 req-28745cb6-824b-4309-9997-496a9562ea9b service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:21.863821 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-b6ff6650-3e98-450f-83c5-c6829dd5b592 req-28745cb6-824b-4309-9997-496a9562ea9b service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:21.939535 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-b6ff6650-3e98-450f-83c5-c6829dd5b592 req-28745cb6-824b-4309-9997-496a9562ea9b service nova] Creating event network-changed:515e62ea-52d3-4ada-b96e-712f01398333 for instance 75c5754b-3489-46e5-9a52-43e0a6cfd1c7 on n-h1-851028-13 Oct 04 19:04:21.959317 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-b6ff6650-3e98-450f-83c5-c6829dd5b592 req-28745cb6-824b-4309-9997-496a9562ea9b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126359 Oct 04 19:04:21.965852 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3094/5824] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:04:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:04:22.535293 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f81a53b4-d45a-4d01-8b81-e7e100075c7d tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:22.536010 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-f81a53b4-d45a-4d01-8b81-e7e100075c7d tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: a0c3f46d-ba5d-4349-a406-6ed87b428a28] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:22.554471 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f81a53b4-d45a-4d01-8b81-e7e100075c7d tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:22.554967 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f81a53b4-d45a-4d01-8b81-e7e100075c7d tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:22.555410 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f81a53b4-d45a-4d01-8b81-e7e100075c7d tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:22.556128 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f81a53b4-d45a-4d01-8b81-e7e100075c7d tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:22.564216 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f81a53b4-d45a-4d01-8b81-e7e100075c7d tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:22.566935 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f81a53b4-d45a-4d01-8b81-e7e100075c7d tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:22.884975 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-a6567985-3363-46c9-9268-df253869282f tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf87794979e844349d6ec6c6650565f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c25f1d17e94c74868357744e692487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:22.894645 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-f81a53b4-d45a-4d01-8b81-e7e100075c7d tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c997bc60473b43fd9fcf0c65111c44c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a711601b7a439caf395233de1febff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:22.907636 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-f81a53b4-d45a-4d01-8b81-e7e100075c7d tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "GET /compute/v2.1/servers/a0c3f46d-ba5d-4349-a406-6ed87b428a28" status: 200 len: 1314 microversion: 2.1 time: 0.376726 Oct 04 19:04:22.909752 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3095/5825] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:22 2022] GET /compute/v2.1/servers/a0c3f46d-ba5d-4349-a406-6ed87b428a28 => generated 1314 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:04:22.910631 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-a6567985-3363-46c9-9268-df253869282f tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] 10.222.0.43 "GET /compute/v2.1/servers/75c5754b-3489-46e5-9a52-43e0a6cfd1c7" status: 200 len: 1564 microversion: 2.1 time: 1.116674 Oct 04 19:04:22.914167 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2731/5826] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:21 2022] GET /compute/v2.1/servers/75c5754b-3489-46e5-9a52-43e0a6cfd1c7 => generated 1564 bytes in 1122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:04:23.936103 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-11642eb9-bdb2-4b9c-84b6-4683479c7659 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:23.936709 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-11642eb9-bdb2-4b9c-84b6-4683479c7659 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: a0c3f46d-ba5d-4349-a406-6ed87b428a28] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:23.962059 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-11642eb9-bdb2-4b9c-84b6-4683479c7659 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:23.962609 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-11642eb9-bdb2-4b9c-84b6-4683479c7659 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:23.963063 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-11642eb9-bdb2-4b9c-84b6-4683479c7659 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:23.963797 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-11642eb9-bdb2-4b9c-84b6-4683479c7659 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:23.971279 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-11642eb9-bdb2-4b9c-84b6-4683479c7659 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:23.971750 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-11642eb9-bdb2-4b9c-84b6-4683479c7659 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:24.109925 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-1865666f-5484-44da-8b78-d6c0230bd769 req-ed53d946-4a47-4eb0-b51a-bf0b89eb0880 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0c3f46d-ba5d-4349-a406-6ed87b428a28", "tag": "0d284778-f203-4346-af42-d3ffadf62dc6"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:04:24.121882 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-1865666f-5484-44da-8b78-d6c0230bd769 req-ed53d946-4a47-4eb0-b51a-bf0b89eb0880 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:24.170255 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-1865666f-5484-44da-8b78-d6c0230bd769 req-ed53d946-4a47-4eb0-b51a-bf0b89eb0880 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.048s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:24.170393 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-1865666f-5484-44da-8b78-d6c0230bd769 req-ed53d946-4a47-4eb0-b51a-bf0b89eb0880 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:24.206647 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-1865666f-5484-44da-8b78-d6c0230bd769 req-ed53d946-4a47-4eb0-b51a-bf0b89eb0880 service nova] Creating event network-changed:0d284778-f203-4346-af42-d3ffadf62dc6 for instance a0c3f46d-ba5d-4349-a406-6ed87b428a28 on n-h2-851028-13 Oct 04 19:04:24.212165 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-1865666f-5484-44da-8b78-d6c0230bd769 req-ed53d946-4a47-4eb0-b51a-bf0b89eb0880 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110832 Oct 04 19:04:24.214380 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2732/5827] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:04:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Oct 04 19:04:24.487934 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-11642eb9-bdb2-4b9c-84b6-4683479c7659 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c997bc60473b43fd9fcf0c65111c44c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a711601b7a439caf395233de1febff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:24.501851 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-11642eb9-bdb2-4b9c-84b6-4683479c7659 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "GET /compute/v2.1/servers/a0c3f46d-ba5d-4349-a406-6ed87b428a28" status: 200 len: 1314 microversion: 2.1 time: 0.569554 Oct 04 19:04:24.502448 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3096/5828] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:23 2022] GET /compute/v2.1/servers/a0c3f46d-ba5d-4349-a406-6ed87b428a28 => generated 1314 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:04:25.535084 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-4b87a5a4-c8a5-4f6b-aad7-700ad6bacef3 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:25.535798 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-4b87a5a4-c8a5-4f6b-aad7-700ad6bacef3 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: a0c3f46d-ba5d-4349-a406-6ed87b428a28] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:25.551385 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4b87a5a4-c8a5-4f6b-aad7-700ad6bacef3 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:25.551893 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4b87a5a4-c8a5-4f6b-aad7-700ad6bacef3 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:25.552336 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4b87a5a4-c8a5-4f6b-aad7-700ad6bacef3 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:25.555099 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4b87a5a4-c8a5-4f6b-aad7-700ad6bacef3 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:25.557035 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4b87a5a4-c8a5-4f6b-aad7-700ad6bacef3 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:25.557526 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4b87a5a4-c8a5-4f6b-aad7-700ad6bacef3 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:26.477608 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-4b87a5a4-c8a5-4f6b-aad7-700ad6bacef3 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c997bc60473b43fd9fcf0c65111c44c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a711601b7a439caf395233de1febff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:26.488188 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-4b87a5a4-c8a5-4f6b-aad7-700ad6bacef3 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "GET /compute/v2.1/servers/a0c3f46d-ba5d-4349-a406-6ed87b428a28" status: 200 len: 1314 microversion: 2.1 time: 0.960716 Oct 04 19:04:26.501138 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2733/5829] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:25 2022] GET /compute/v2.1/servers/a0c3f46d-ba5d-4349-a406-6ed87b428a28 => generated 1314 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:04:27.516624 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-5de3c22e-daba-42d0-b445-1c74b05f1b6f tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:27.520159 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-5de3c22e-daba-42d0-b445-1c74b05f1b6f tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: a0c3f46d-ba5d-4349-a406-6ed87b428a28] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:27.532131 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=2 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:04:27.536087 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=6 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:04:27.555665 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5de3c22e-daba-42d0-b445-1c74b05f1b6f tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:27.556914 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5de3c22e-daba-42d0-b445-1c74b05f1b6f tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:27.559005 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5de3c22e-daba-42d0-b445-1c74b05f1b6f tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:27.561854 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5de3c22e-daba-42d0-b445-1c74b05f1b6f tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:27.562625 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5de3c22e-daba-42d0-b445-1c74b05f1b6f tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:27.563908 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5de3c22e-daba-42d0-b445-1c74b05f1b6f tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:27.836876 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-5de3c22e-daba-42d0-b445-1c74b05f1b6f tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c997bc60473b43fd9fcf0c65111c44c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a711601b7a439caf395233de1febff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:27.867555 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-5de3c22e-daba-42d0-b445-1c74b05f1b6f tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "GET /compute/v2.1/servers/a0c3f46d-ba5d-4349-a406-6ed87b428a28" status: 200 len: 1314 microversion: 2.1 time: 0.350070 Oct 04 19:04:27.868789 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3097/5830] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:27 2022] GET /compute/v2.1/servers/a0c3f46d-ba5d-4349-a406-6ed87b428a28 => generated 1314 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:04:28.207842 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=2 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:04:28.515816 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-aa66aba8-2512-445a-bcb5-bfc094adb124 tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-888708170", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452", "networks": [{"uuid": "963a4f7c-3ae2-4de7-91f3-31dc4f9ad2bd"}]}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:04:28.612297 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.network.neutron [None req-aa66aba8-2512-445a-bcb5-bfc094adb124 tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] validate_networks() for [('963a4f7c-3ae2-4de7-91f3-31dc4f9ad2bd', None, None, None, None, None)] {{(pid=123595) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 19:04:28.895808 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f192f615-b08e-4042-9bbf-00ba0d64200e tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:28.899238 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-f192f615-b08e-4042-9bbf-00ba0d64200e tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: a0c3f46d-ba5d-4349-a406-6ed87b428a28] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:28.912153 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f192f615-b08e-4042-9bbf-00ba0d64200e tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:28.915301 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f192f615-b08e-4042-9bbf-00ba0d64200e tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:28.917805 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f192f615-b08e-4042-9bbf-00ba0d64200e tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:28.920285 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f192f615-b08e-4042-9bbf-00ba0d64200e tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:28.923735 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f192f615-b08e-4042-9bbf-00ba0d64200e tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:28.924800 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f192f615-b08e-4042-9bbf-00ba0d64200e tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:29.436582 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-f192f615-b08e-4042-9bbf-00ba0d64200e tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c997bc60473b43fd9fcf0c65111c44c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a711601b7a439caf395233de1febff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:29.447332 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-f192f615-b08e-4042-9bbf-00ba0d64200e tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "GET /compute/v2.1/servers/a0c3f46d-ba5d-4349-a406-6ed87b428a28" status: 200 len: 1314 microversion: 2.1 time: 0.556582 Oct 04 19:04:29.451782 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3098/5831] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:28 2022] GET /compute/v2.1/servers/a0c3f46d-ba5d-4349-a406-6ed87b428a28 => generated 1314 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:04:29.626603 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-aa66aba8-2512-445a-bcb5-bfc094adb124 tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] Flavor limits 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:04:29.627184 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-aa66aba8-2512-445a-bcb5-bfc094adb124 tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] Image limits 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:04:29.628097 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-aa66aba8-2512-445a-bcb5-bfc094adb124 tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] Flavor pref 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:04:29.628599 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-aa66aba8-2512-445a-bcb5-bfc094adb124 tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] Image pref 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:04:29.629314 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-aa66aba8-2512-445a-bcb5-bfc094adb124 tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:04:29.649240 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-aa66aba8-2512-445a-bcb5-bfc094adb124 tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:29.650852 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-aa66aba8-2512-445a-bcb5-bfc094adb124 tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:29.651549 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-aa66aba8-2512-445a-bcb5-bfc094adb124 tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:29.653739 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-aa66aba8-2512-445a-bcb5-bfc094adb124 tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:29.655232 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-aa66aba8-2512-445a-bcb5-bfc094adb124 tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:29.655907 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-aa66aba8-2512-445a-bcb5-bfc094adb124 tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:29.703478 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-aa66aba8-2512-445a-bcb5-bfc094adb124 tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] Getting quotas for project d0c580523ce14c06a66a72339c18e9a2. Resources: {'ram', 'cores', 'instances'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:04:29.722882 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-aa66aba8-2512-445a-bcb5-bfc094adb124 tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] Getting quotas for user 4ef59c846e8342bf9147c621c7c4cc47 and project d0c580523ce14c06a66a72339c18e9a2. Resources: {'ram', 'cores', 'instances'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:04:29.740069 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-aa66aba8-2512-445a-bcb5-bfc094adb124 tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] Going to run 1 instances... {{(pid=123595) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 19:04:29.743703 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-aa66aba8-2512-445a-bcb5-bfc094adb124 tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] [instance: d29d308f-2367-4ae7-a65b-3730767427d1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e8943ec5-4038-4d4b-b9b9-2415a79f5243',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 19:04:29.856284 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-aa66aba8-2512-445a-bcb5-bfc094adb124 tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.653911 Oct 04 19:04:29.857426 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2734/5832] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 19:04:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 1657 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 19:04:29.873701 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-001c6a09-69b3-4fe4-b83b-d0f1fa010225 tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:29.874548 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-001c6a09-69b3-4fe4-b83b-d0f1fa010225 tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] [instance: d29d308f-2367-4ae7-a65b-3730767427d1] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:30.034244 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-001c6a09-69b3-4fe4-b83b-d0f1fa010225 tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef59c846e8342bf9147c621c7c4cc47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c580523ce14c06a66a72339c18e9a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:30.043079 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-001c6a09-69b3-4fe4-b83b-d0f1fa010225 tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] 10.222.0.43 "GET /compute/v2.1/servers/d29d308f-2367-4ae7-a65b-3730767427d1" status: 200 len: 1227 microversion: 2.1 time: 0.176299 Oct 04 19:04:30.075096 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3099/5833] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:29 2022] GET /compute/v2.1/servers/d29d308f-2367-4ae7-a65b-3730767427d1 => generated 1227 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:04:30.481042 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-e8e749a9-bcd2-4c6f-a441-cbaa24f914d6 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:30.486659 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-e8e749a9-bcd2-4c6f-a441-cbaa24f914d6 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: a0c3f46d-ba5d-4349-a406-6ed87b428a28] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:30.499496 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e8e749a9-bcd2-4c6f-a441-cbaa24f914d6 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:30.500009 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e8e749a9-bcd2-4c6f-a441-cbaa24f914d6 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:30.500452 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e8e749a9-bcd2-4c6f-a441-cbaa24f914d6 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:30.501197 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e8e749a9-bcd2-4c6f-a441-cbaa24f914d6 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:30.501660 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e8e749a9-bcd2-4c6f-a441-cbaa24f914d6 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:30.502092 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e8e749a9-bcd2-4c6f-a441-cbaa24f914d6 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:30.792436 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-e8e749a9-bcd2-4c6f-a441-cbaa24f914d6 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c997bc60473b43fd9fcf0c65111c44c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a711601b7a439caf395233de1febff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:30.801190 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-e8e749a9-bcd2-4c6f-a441-cbaa24f914d6 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "GET /compute/v2.1/servers/a0c3f46d-ba5d-4349-a406-6ed87b428a28" status: 200 len: 1314 microversion: 2.1 time: 0.324701 Oct 04 19:04:30.801883 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2735/5834] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:30 2022] GET /compute/v2.1/servers/a0c3f46d-ba5d-4349-a406-6ed87b428a28 => generated 1314 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:04:31.074273 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-d355304b-283d-4dd0-9bc9-b321c54e849f tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:31.076798 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-d355304b-283d-4dd0-9bc9-b321c54e849f tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] [instance: d29d308f-2367-4ae7-a65b-3730767427d1] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:31.082325 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:04:31.096220 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d355304b-283d-4dd0-9bc9-b321c54e849f tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:31.097262 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d355304b-283d-4dd0-9bc9-b321c54e849f tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:31.098103 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d355304b-283d-4dd0-9bc9-b321c54e849f tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:31.099181 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d355304b-283d-4dd0-9bc9-b321c54e849f tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:31.100798 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d355304b-283d-4dd0-9bc9-b321c54e849f tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:31.101514 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d355304b-283d-4dd0-9bc9-b321c54e849f tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:31.207395 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-d355304b-283d-4dd0-9bc9-b321c54e849f tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef59c846e8342bf9147c621c7c4cc47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c580523ce14c06a66a72339c18e9a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:31.218620 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-d355304b-283d-4dd0-9bc9-b321c54e849f tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] 10.222.0.43 "GET /compute/v2.1/servers/d29d308f-2367-4ae7-a65b-3730767427d1" status: 200 len: 1223 microversion: 2.1 time: 0.148274 Oct 04 19:04:31.221427 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3100/5835] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:31 2022] GET /compute/v2.1/servers/d29d308f-2367-4ae7-a65b-3730767427d1 => generated 1223 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:04:31.489147 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-5f267e0f-3717-4225-bb5a-cec2394c69db req-e21d8387-3130-43f3-81b7-fddbb4fc5a65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0c3f46d-ba5d-4349-a406-6ed87b428a28", "name": "network-vif-plugged", "status": "completed", "tag": "0d284778-f203-4346-af42-d3ffadf62dc6"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:04:31.505358 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-5f267e0f-3717-4225-bb5a-cec2394c69db req-e21d8387-3130-43f3-81b7-fddbb4fc5a65 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:31.508237 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-5f267e0f-3717-4225-bb5a-cec2394c69db req-e21d8387-3130-43f3-81b7-fddbb4fc5a65 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:31.508788 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-5f267e0f-3717-4225-bb5a-cec2394c69db req-e21d8387-3130-43f3-81b7-fddbb4fc5a65 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:31.550201 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-5f267e0f-3717-4225-bb5a-cec2394c69db req-e21d8387-3130-43f3-81b7-fddbb4fc5a65 service nova] Creating event network-vif-plugged:0d284778-f203-4346-af42-d3ffadf62dc6 for instance a0c3f46d-ba5d-4349-a406-6ed87b428a28 on n-h2-851028-13 Oct 04 19:04:31.561513 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-5f267e0f-3717-4225-bb5a-cec2394c69db req-e21d8387-3130-43f3-81b7-fddbb4fc5a65 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084260 Oct 04 19:04:31.562226 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2736/5836] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:04:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:04:31.825844 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f3369697-0f1f-459e-9dd8-a6477ef535ac tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:31.826635 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-f3369697-0f1f-459e-9dd8-a6477ef535ac tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: a0c3f46d-ba5d-4349-a406-6ed87b428a28] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:31.837901 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f3369697-0f1f-459e-9dd8-a6477ef535ac tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:31.839353 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f3369697-0f1f-459e-9dd8-a6477ef535ac tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:31.841024 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f3369697-0f1f-459e-9dd8-a6477ef535ac tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:31.846630 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f3369697-0f1f-459e-9dd8-a6477ef535ac tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:31.847348 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f3369697-0f1f-459e-9dd8-a6477ef535ac tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:31.848056 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f3369697-0f1f-459e-9dd8-a6477ef535ac tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:32.243312 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-1fc594a2-ab32-4714-8d98-032d597f2423 tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:32.244020 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-1fc594a2-ab32-4714-8d98-032d597f2423 tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] [instance: d29d308f-2367-4ae7-a65b-3730767427d1] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:32.257635 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1fc594a2-ab32-4714-8d98-032d597f2423 tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:32.258139 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1fc594a2-ab32-4714-8d98-032d597f2423 tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:32.258582 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1fc594a2-ab32-4714-8d98-032d597f2423 tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:32.259725 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1fc594a2-ab32-4714-8d98-032d597f2423 tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:32.260354 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1fc594a2-ab32-4714-8d98-032d597f2423 tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:32.261874 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1fc594a2-ab32-4714-8d98-032d597f2423 tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:32.470136 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-1fc594a2-ab32-4714-8d98-032d597f2423 tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef59c846e8342bf9147c621c7c4cc47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c580523ce14c06a66a72339c18e9a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:32.485032 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-1fc594a2-ab32-4714-8d98-032d597f2423 tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] 10.222.0.43 "GET /compute/v2.1/servers/d29d308f-2367-4ae7-a65b-3730767427d1" status: 200 len: 1287 microversion: 2.1 time: 0.246786 Oct 04 19:04:32.498451 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2737/5837] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:32 2022] GET /compute/v2.1/servers/d29d308f-2367-4ae7-a65b-3730767427d1 => generated 1287 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:04:32.503789 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-f3369697-0f1f-459e-9dd8-a6477ef535ac tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c997bc60473b43fd9fcf0c65111c44c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a711601b7a439caf395233de1febff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:32.516521 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-f3369697-0f1f-459e-9dd8-a6477ef535ac tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "GET /compute/v2.1/servers/a0c3f46d-ba5d-4349-a406-6ed87b428a28" status: 200 len: 1314 microversion: 2.1 time: 0.695368 Oct 04 19:04:32.531673 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3101/5838] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:31 2022] GET /compute/v2.1/servers/a0c3f46d-ba5d-4349-a406-6ed87b428a28 => generated 1314 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:04:33.520029 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-ce0a03f1-793a-49c9-8eef-fc867a0b11d6 tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:33.521459 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-ce0a03f1-793a-49c9-8eef-fc867a0b11d6 tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] [instance: d29d308f-2367-4ae7-a65b-3730767427d1] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:33.531631 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ce0a03f1-793a-49c9-8eef-fc867a0b11d6 tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:33.536422 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ce0a03f1-793a-49c9-8eef-fc867a0b11d6 tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:33.537153 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ce0a03f1-793a-49c9-8eef-fc867a0b11d6 tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:33.538829 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ce0a03f1-793a-49c9-8eef-fc867a0b11d6 tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:33.544135 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-4b494154-1f27-43c8-b357-7f66c889ace9 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:33.544918 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-4b494154-1f27-43c8-b357-7f66c889ace9 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: a0c3f46d-ba5d-4349-a406-6ed87b428a28] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:33.545517 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ce0a03f1-793a-49c9-8eef-fc867a0b11d6 tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:33.546214 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ce0a03f1-793a-49c9-8eef-fc867a0b11d6 tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:33.562013 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4b494154-1f27-43c8-b357-7f66c889ace9 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:33.563683 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4b494154-1f27-43c8-b357-7f66c889ace9 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:33.565419 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4b494154-1f27-43c8-b357-7f66c889ace9 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:33.568984 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4b494154-1f27-43c8-b357-7f66c889ace9 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:33.570513 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4b494154-1f27-43c8-b357-7f66c889ace9 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:33.572268 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4b494154-1f27-43c8-b357-7f66c889ace9 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:34.221411 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-4b494154-1f27-43c8-b357-7f66c889ace9 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c997bc60473b43fd9fcf0c65111c44c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a711601b7a439caf395233de1febff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:34.233309 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-4b494154-1f27-43c8-b357-7f66c889ace9 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "GET /compute/v2.1/servers/a0c3f46d-ba5d-4349-a406-6ed87b428a28" status: 200 len: 1500 microversion: 2.1 time: 0.694031 Oct 04 19:04:34.259672 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3102/5839] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:33 2022] GET /compute/v2.1/servers/a0c3f46d-ba5d-4349-a406-6ed87b428a28 => generated 1500 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:04:34.267973 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-ea0f6e2f-654e-46fa-85c7-4842e493c04d tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:04:34.268932 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-ea0f6e2f-654e-46fa-85c7-4842e493c04d tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: a0c3f46d-ba5d-4349-a406-6ed87b428a28] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:34.296202 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ea0f6e2f-654e-46fa-85c7-4842e493c04d tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:34.296747 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ea0f6e2f-654e-46fa-85c7-4842e493c04d tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:34.297239 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ea0f6e2f-654e-46fa-85c7-4842e493c04d tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:34.298002 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ea0f6e2f-654e-46fa-85c7-4842e493c04d tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:34.298473 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ea0f6e2f-654e-46fa-85c7-4842e493c04d tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:34.298917 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ea0f6e2f-654e-46fa-85c7-4842e493c04d tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:34.345368 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.objects.instance [None req-ea0f6e2f-654e-46fa-85c7-4842e493c04d tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lazy-loading 'flavor' on Instance uuid a0c3f46d-ba5d-4349-a406-6ed87b428a28 {{(pid=123596) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 19:04:34.485454 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-ea0f6e2f-654e-46fa-85c7-4842e493c04d tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "POST /compute/v2.1/servers/a0c3f46d-ba5d-4349-a406-6ed87b428a28/action" status: 202 len: 0 microversion: 2.1 time: 0.222076 Oct 04 19:04:34.492207 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3103/5840] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 19:04:34 2022] POST /compute/v2.1/servers/a0c3f46d-ba5d-4349-a406-6ed87b428a28/action => generated 0 bytes in 233 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 19:04:34.502843 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f5d2919f-06c6-433a-80ae-18a8074a5abe tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:34.507296 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-f5d2919f-06c6-433a-80ae-18a8074a5abe tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: a0c3f46d-ba5d-4349-a406-6ed87b428a28] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:34.522868 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f5d2919f-06c6-433a-80ae-18a8074a5abe tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:34.524340 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f5d2919f-06c6-433a-80ae-18a8074a5abe tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:34.526713 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f5d2919f-06c6-433a-80ae-18a8074a5abe tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:34.527426 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f5d2919f-06c6-433a-80ae-18a8074a5abe tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:34.529269 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-ce0a03f1-793a-49c9-8eef-fc867a0b11d6 tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef59c846e8342bf9147c621c7c4cc47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c580523ce14c06a66a72339c18e9a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:34.531066 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f5d2919f-06c6-433a-80ae-18a8074a5abe tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:34.531525 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f5d2919f-06c6-433a-80ae-18a8074a5abe tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:34.533868 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=84 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:04:34.550752 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-ce0a03f1-793a-49c9-8eef-fc867a0b11d6 tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] 10.222.0.43 "GET /compute/v2.1/servers/d29d308f-2367-4ae7-a65b-3730767427d1" status: 200 len: 1285 microversion: 2.1 time: 1.034976 Oct 04 19:04:34.552909 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2738/5841] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:33 2022] GET /compute/v2.1/servers/d29d308f-2367-4ae7-a65b-3730767427d1 => generated 1285 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:04:35.004692 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-f5d2919f-06c6-433a-80ae-18a8074a5abe tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c997bc60473b43fd9fcf0c65111c44c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a711601b7a439caf395233de1febff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:35.020063 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-f5d2919f-06c6-433a-80ae-18a8074a5abe tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "GET /compute/v2.1/servers/a0c3f46d-ba5d-4349-a406-6ed87b428a28" status: 200 len: 1508 microversion: 2.1 time: 0.526158 Oct 04 19:04:35.020924 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3104/5842] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:34 2022] GET /compute/v2.1/servers/a0c3f46d-ba5d-4349-a406-6ed87b428a28 => generated 1508 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:04:35.577641 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-d3140e0a-8163-4a3a-983f-b2a30fa42baa tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:35.580851 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-d3140e0a-8163-4a3a-983f-b2a30fa42baa tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] [instance: d29d308f-2367-4ae7-a65b-3730767427d1] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:35.589758 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:04:35.612497 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d3140e0a-8163-4a3a-983f-b2a30fa42baa tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:35.634015 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d3140e0a-8163-4a3a-983f-b2a30fa42baa tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:35.638694 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d3140e0a-8163-4a3a-983f-b2a30fa42baa tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:35.642117 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d3140e0a-8163-4a3a-983f-b2a30fa42baa tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:35.644277 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d3140e0a-8163-4a3a-983f-b2a30fa42baa tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:35.646670 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d3140e0a-8163-4a3a-983f-b2a30fa42baa tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:35.989904 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-8b084a36-2c12-4b0e-a5f5-aa8cf4b9ba08 req-3c89c3ee-eb67-49e7-91bd-7b5dd5f31f1c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d29d308f-2367-4ae7-a65b-3730767427d1", "tag": "b42a19c5-83fc-464f-837b-f94ecd10dbad"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:04:36.031632 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-8b084a36-2c12-4b0e-a5f5-aa8cf4b9ba08 req-3c89c3ee-eb67-49e7-91bd-7b5dd5f31f1c service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:36.032417 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-8b084a36-2c12-4b0e-a5f5-aa8cf4b9ba08 req-3c89c3ee-eb67-49e7-91bd-7b5dd5f31f1c service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:36.032957 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-8b084a36-2c12-4b0e-a5f5-aa8cf4b9ba08 req-3c89c3ee-eb67-49e7-91bd-7b5dd5f31f1c service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:36.065047 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-8b084a36-2c12-4b0e-a5f5-aa8cf4b9ba08 req-3c89c3ee-eb67-49e7-91bd-7b5dd5f31f1c service nova] Creating event network-changed:b42a19c5-83fc-464f-837b-f94ecd10dbad for instance d29d308f-2367-4ae7-a65b-3730767427d1 on n-h1-851028-13 Oct 04 19:04:36.085078 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-8b084a36-2c12-4b0e-a5f5-aa8cf4b9ba08 req-3c89c3ee-eb67-49e7-91bd-7b5dd5f31f1c service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097778 Oct 04 19:04:36.094138 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3105/5843] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:04:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:04:36.112510 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-9305887d-f8d8-4f7f-9743-e33ddd68adb3 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:36.116737 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-9305887d-f8d8-4f7f-9743-e33ddd68adb3 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: a0c3f46d-ba5d-4349-a406-6ed87b428a28] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:36.134352 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9305887d-f8d8-4f7f-9743-e33ddd68adb3 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:36.135024 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9305887d-f8d8-4f7f-9743-e33ddd68adb3 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:36.136572 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9305887d-f8d8-4f7f-9743-e33ddd68adb3 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:36.141486 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9305887d-f8d8-4f7f-9743-e33ddd68adb3 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:36.142447 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9305887d-f8d8-4f7f-9743-e33ddd68adb3 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:36.142979 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9305887d-f8d8-4f7f-9743-e33ddd68adb3 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:36.293268 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-d3140e0a-8163-4a3a-983f-b2a30fa42baa tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef59c846e8342bf9147c621c7c4cc47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c580523ce14c06a66a72339c18e9a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:36.302434 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-d3140e0a-8163-4a3a-983f-b2a30fa42baa tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] 10.222.0.43 "GET /compute/v2.1/servers/d29d308f-2367-4ae7-a65b-3730767427d1" status: 200 len: 1327 microversion: 2.1 time: 0.730474 Oct 04 19:04:36.319630 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2739/5844] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:35 2022] GET /compute/v2.1/servers/d29d308f-2367-4ae7-a65b-3730767427d1 => generated 1327 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:04:36.614601 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-9305887d-f8d8-4f7f-9743-e33ddd68adb3 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c997bc60473b43fd9fcf0c65111c44c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a711601b7a439caf395233de1febff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:36.617438 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:04:36.634183 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-9305887d-f8d8-4f7f-9743-e33ddd68adb3 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "GET /compute/v2.1/servers/a0c3f46d-ba5d-4349-a406-6ed87b428a28" status: 200 len: 1491 microversion: 2.1 time: 0.538395 Oct 04 19:04:36.635708 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3106/5845] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:36 2022] GET /compute/v2.1/servers/a0c3f46d-ba5d-4349-a406-6ed87b428a28 => generated 1491 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:04:36.658590 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-348c43a8-6701-40e2-a577-602b0bd71818 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:36.659156 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-348c43a8-6701-40e2-a577-602b0bd71818 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: a0c3f46d-ba5d-4349-a406-6ed87b428a28] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:36.672631 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-348c43a8-6701-40e2-a577-602b0bd71818 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:36.673278 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-348c43a8-6701-40e2-a577-602b0bd71818 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:36.676082 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-348c43a8-6701-40e2-a577-602b0bd71818 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:36.679804 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-348c43a8-6701-40e2-a577-602b0bd71818 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:36.686065 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-348c43a8-6701-40e2-a577-602b0bd71818 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:36.686648 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-348c43a8-6701-40e2-a577-602b0bd71818 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:36.739883 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-348c43a8-6701-40e2-a577-602b0bd71818 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: a0c3f46d-ba5d-4349-a406-6ed87b428a28] Going to try to terminate instance {{(pid=123595) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 19:04:36.862415 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-348c43a8-6701-40e2-a577-602b0bd71818 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "DELETE /compute/v2.1/servers/a0c3f46d-ba5d-4349-a406-6ed87b428a28" status: 204 len: 0 microversion: 2.1 time: 0.207426 Oct 04 19:04:36.863503 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2740/5846] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 19:04:36 2022] DELETE /compute/v2.1/servers/a0c3f46d-ba5d-4349-a406-6ed87b428a28 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:04:36.871773 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-98e89bc9-67ad-49d7-a948-4b06aec7e7ad tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:36.872355 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-98e89bc9-67ad-49d7-a948-4b06aec7e7ad tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: a0c3f46d-ba5d-4349-a406-6ed87b428a28] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:36.887881 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-98e89bc9-67ad-49d7-a948-4b06aec7e7ad tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:36.888410 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-98e89bc9-67ad-49d7-a948-4b06aec7e7ad tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:36.888888 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-98e89bc9-67ad-49d7-a948-4b06aec7e7ad tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:36.892033 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-98e89bc9-67ad-49d7-a948-4b06aec7e7ad tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:36.892529 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-98e89bc9-67ad-49d7-a948-4b06aec7e7ad tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:36.892978 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-98e89bc9-67ad-49d7-a948-4b06aec7e7ad tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:37.103672 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-98e89bc9-67ad-49d7-a948-4b06aec7e7ad tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c997bc60473b43fd9fcf0c65111c44c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a711601b7a439caf395233de1febff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:37.114711 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-98e89bc9-67ad-49d7-a948-4b06aec7e7ad tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "GET /compute/v2.1/servers/a0c3f46d-ba5d-4349-a406-6ed87b428a28" status: 200 len: 1497 microversion: 2.1 time: 0.247041 Oct 04 19:04:37.115748 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3107/5847] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:36 2022] GET /compute/v2.1/servers/a0c3f46d-ba5d-4349-a406-6ed87b428a28 => generated 1497 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:04:37.325737 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-c001b73f-e0c4-41aa-9661-f31e130cfd12 tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:37.326602 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-c001b73f-e0c4-41aa-9661-f31e130cfd12 tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] [instance: d29d308f-2367-4ae7-a65b-3730767427d1] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:37.333787 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c001b73f-e0c4-41aa-9661-f31e130cfd12 tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:37.336656 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c001b73f-e0c4-41aa-9661-f31e130cfd12 tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:37.337286 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c001b73f-e0c4-41aa-9661-f31e130cfd12 tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:37.338353 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c001b73f-e0c4-41aa-9661-f31e130cfd12 tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:37.339036 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c001b73f-e0c4-41aa-9661-f31e130cfd12 tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:37.339723 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c001b73f-e0c4-41aa-9661-f31e130cfd12 tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:37.575187 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-c001b73f-e0c4-41aa-9661-f31e130cfd12 tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef59c846e8342bf9147c621c7c4cc47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c580523ce14c06a66a72339c18e9a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:37.584247 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-c001b73f-e0c4-41aa-9661-f31e130cfd12 tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] 10.222.0.43 "GET /compute/v2.1/servers/d29d308f-2367-4ae7-a65b-3730767427d1" status: 200 len: 1327 microversion: 2.1 time: 0.262658 Oct 04 19:04:37.600791 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2741/5848] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:37 2022] GET /compute/v2.1/servers/d29d308f-2367-4ae7-a65b-3730767427d1 => generated 1327 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:04:38.139247 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-960dd431-2d39-422d-89df-6ca987f9295c tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:38.140090 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-960dd431-2d39-422d-89df-6ca987f9295c tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: a0c3f46d-ba5d-4349-a406-6ed87b428a28] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:38.154391 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-960dd431-2d39-422d-89df-6ca987f9295c tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:38.154824 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-960dd431-2d39-422d-89df-6ca987f9295c tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:38.155551 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-960dd431-2d39-422d-89df-6ca987f9295c tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:38.156478 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-960dd431-2d39-422d-89df-6ca987f9295c tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:38.157305 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-960dd431-2d39-422d-89df-6ca987f9295c tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:38.160067 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-960dd431-2d39-422d-89df-6ca987f9295c tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:38.449964 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-960dd431-2d39-422d-89df-6ca987f9295c tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c997bc60473b43fd9fcf0c65111c44c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a711601b7a439caf395233de1febff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:38.460730 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-960dd431-2d39-422d-89df-6ca987f9295c tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "GET /compute/v2.1/servers/a0c3f46d-ba5d-4349-a406-6ed87b428a28" status: 200 len: 1497 microversion: 2.1 time: 0.326181 Oct 04 19:04:38.465173 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3108/5849] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:38 2022] GET /compute/v2.1/servers/a0c3f46d-ba5d-4349-a406-6ed87b428a28 => generated 1497 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:04:38.610048 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-bf7e4f6a-1b71-496d-89ff-eb9880568473 tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:38.610790 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-bf7e4f6a-1b71-496d-89ff-eb9880568473 tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] [instance: d29d308f-2367-4ae7-a65b-3730767427d1] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:38.640289 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bf7e4f6a-1b71-496d-89ff-eb9880568473 tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:38.640792 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bf7e4f6a-1b71-496d-89ff-eb9880568473 tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:38.648256 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bf7e4f6a-1b71-496d-89ff-eb9880568473 tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:38.649562 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bf7e4f6a-1b71-496d-89ff-eb9880568473 tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:38.650632 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bf7e4f6a-1b71-496d-89ff-eb9880568473 tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:38.651281 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bf7e4f6a-1b71-496d-89ff-eb9880568473 tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:39.344130 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-bf7e4f6a-1b71-496d-89ff-eb9880568473 tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef59c846e8342bf9147c621c7c4cc47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c580523ce14c06a66a72339c18e9a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:39.352975 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-bf7e4f6a-1b71-496d-89ff-eb9880568473 tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] 10.222.0.43 "GET /compute/v2.1/servers/d29d308f-2367-4ae7-a65b-3730767427d1" status: 200 len: 1327 microversion: 2.1 time: 0.748395 Oct 04 19:04:39.354058 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2742/5850] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:38 2022] GET /compute/v2.1/servers/d29d308f-2367-4ae7-a65b-3730767427d1 => generated 1327 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:04:39.377505 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-2b6afd25-43ca-4430-8f4e-aad9992d1335 req-93bbed88-f073-46e7-a18a-fa2666041488 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0c3f46d-ba5d-4349-a406-6ed87b428a28", "name": "network-vif-deleted", "tag": "0d284778-f203-4346-af42-d3ffadf62dc6"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:04:39.397385 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-2b6afd25-43ca-4430-8f4e-aad9992d1335 req-93bbed88-f073-46e7-a18a-fa2666041488 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:39.397998 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-2b6afd25-43ca-4430-8f4e-aad9992d1335 req-93bbed88-f073-46e7-a18a-fa2666041488 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:39.398527 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-2b6afd25-43ca-4430-8f4e-aad9992d1335 req-93bbed88-f073-46e7-a18a-fa2666041488 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:39.432737 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-2b6afd25-43ca-4430-8f4e-aad9992d1335 req-93bbed88-f073-46e7-a18a-fa2666041488 service nova] Creating event network-vif-deleted:0d284778-f203-4346-af42-d3ffadf62dc6 for instance a0c3f46d-ba5d-4349-a406-6ed87b428a28 on n-h2-851028-13 Oct 04 19:04:39.439616 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-2b6afd25-43ca-4430-8f4e-aad9992d1335 req-93bbed88-f073-46e7-a18a-fa2666041488 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070646 Oct 04 19:04:39.441044 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3109/5851] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:04:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:04:39.466925 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-d352f161-d168-4ca0-909c-a304b796bb12 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:04:39.470448 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-d352f161-d168-4ca0-909c-a304b796bb12 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] [instance: 75c5754b-3489-46e5-9a52-43e0a6cfd1c7] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:39.477945 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d352f161-d168-4ca0-909c-a304b796bb12 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:39.478713 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d352f161-d168-4ca0-909c-a304b796bb12 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:39.479369 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d352f161-d168-4ca0-909c-a304b796bb12 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:39.480613 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d352f161-d168-4ca0-909c-a304b796bb12 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:39.481362 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d352f161-d168-4ca0-909c-a304b796bb12 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:39.481974 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d352f161-d168-4ca0-909c-a304b796bb12 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:39.493364 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-fe9c55a2-8a31-4c8f-9412-d40f1722aee9 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:39.494087 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-fe9c55a2-8a31-4c8f-9412-d40f1722aee9 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: a0c3f46d-ba5d-4349-a406-6ed87b428a28] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:39.513879 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fe9c55a2-8a31-4c8f-9412-d40f1722aee9 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:39.514391 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fe9c55a2-8a31-4c8f-9412-d40f1722aee9 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:39.515078 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fe9c55a2-8a31-4c8f-9412-d40f1722aee9 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:39.515818 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fe9c55a2-8a31-4c8f-9412-d40f1722aee9 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:39.516284 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fe9c55a2-8a31-4c8f-9412-d40f1722aee9 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:39.516733 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fe9c55a2-8a31-4c8f-9412-d40f1722aee9 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:39.602358 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fe9c55a2-8a31-4c8f-9412-d40f1722aee9 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:39.603130 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fe9c55a2-8a31-4c8f-9412-d40f1722aee9 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:39.603759 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fe9c55a2-8a31-4c8f-9412-d40f1722aee9 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:39.604716 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.objects.instance [None req-fe9c55a2-8a31-4c8f-9412-d40f1722aee9 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lazy-loading 'fault' on Instance uuid a0c3f46d-ba5d-4349-a406-6ed87b428a28 {{(pid=123596) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 19:04:39.609952 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-d352f161-d168-4ca0-909c-a304b796bb12 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] 10.222.0.43 "POST /compute/v2.1/servers/75c5754b-3489-46e5-9a52-43e0a6cfd1c7/action" status: 200 len: 24509 microversion: 2.1 time: 0.147845 Oct 04 19:04:39.611090 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2743/5852] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 19:04:39 2022] POST /compute/v2.1/servers/75c5754b-3489-46e5-9a52-43e0a6cfd1c7/action => generated 24509 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 19:04:39.690282 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-fe9c55a2-8a31-4c8f-9412-d40f1722aee9 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c997bc60473b43fd9fcf0c65111c44c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a711601b7a439caf395233de1febff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:39.717862 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-fe9c55a2-8a31-4c8f-9412-d40f1722aee9 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "GET /compute/v2.1/servers/a0c3f46d-ba5d-4349-a406-6ed87b428a28" status: 200 len: 1304 microversion: 2.1 time: 0.229902 Oct 04 19:04:39.718972 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3110/5853] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:39 2022] GET /compute/v2.1/servers/a0c3f46d-ba5d-4349-a406-6ed87b428a28 => generated 1304 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:04:40.377185 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-1064075b-7086-4c85-90c9-36fd5572f6ac tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:40.377907 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-1064075b-7086-4c85-90c9-36fd5572f6ac tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] [instance: d29d308f-2367-4ae7-a65b-3730767427d1] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:40.384049 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=2 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:04:40.385709 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=6 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:04:40.401770 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1064075b-7086-4c85-90c9-36fd5572f6ac tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:40.402273 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1064075b-7086-4c85-90c9-36fd5572f6ac tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:40.405629 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1064075b-7086-4c85-90c9-36fd5572f6ac tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:40.406401 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1064075b-7086-4c85-90c9-36fd5572f6ac tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:40.408496 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1064075b-7086-4c85-90c9-36fd5572f6ac tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:40.409027 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1064075b-7086-4c85-90c9-36fd5572f6ac tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:40.620025 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-1064075b-7086-4c85-90c9-36fd5572f6ac tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef59c846e8342bf9147c621c7c4cc47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c580523ce14c06a66a72339c18e9a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:40.631860 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-1064075b-7086-4c85-90c9-36fd5572f6ac tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] 10.222.0.43 "GET /compute/v2.1/servers/d29d308f-2367-4ae7-a65b-3730767427d1" status: 200 len: 1327 microversion: 2.1 time: 0.259173 Oct 04 19:04:40.633189 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2744/5854] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:40 2022] GET /compute/v2.1/servers/d29d308f-2367-4ae7-a65b-3730767427d1 => generated 1327 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:04:40.742599 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-162eb0cc-2c7d-46dd-bea6-954763719db8 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:40.743212 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-162eb0cc-2c7d-46dd-bea6-954763719db8 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: a0c3f46d-ba5d-4349-a406-6ed87b428a28] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:40.748937 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=2 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:04:40.753166 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-162eb0cc-2c7d-46dd-bea6-954763719db8 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:40.753909 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-162eb0cc-2c7d-46dd-bea6-954763719db8 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:40.754635 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-162eb0cc-2c7d-46dd-bea6-954763719db8 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:40.755511 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-162eb0cc-2c7d-46dd-bea6-954763719db8 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:40.756130 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-162eb0cc-2c7d-46dd-bea6-954763719db8 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:40.757261 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-162eb0cc-2c7d-46dd-bea6-954763719db8 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:40.775794 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-162eb0cc-2c7d-46dd-bea6-954763719db8 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] HTTP exception thrown: Instance a0c3f46d-ba5d-4349-a406-6ed87b428a28 could not be found. Oct 04 19:04:40.780986 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-162eb0cc-2c7d-46dd-bea6-954763719db8 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Request method failure captured: Oct 04 19:04:40.780986 n-d-851028-13 devstack@n-api.service[123596]: request: GET /compute/v2.1/servers/a0c3f46d-ba5d-4349-a406-6ed87b428a28 HTTP/1.1 Oct 04 19:04:40.780986 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 19:04:40.780986 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 19:04:40.780986 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 19:04:40.780986 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 19:04:40.780986 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 19:04:40.780986 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 19:04:40.780986 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 19:04:40.780986 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 19:04:40.780986 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPIKl7r6ZFtp0u4zXtNLGIhqHo70GyUJnklFY8mLM6SAvqzMqMYlk7FNNMFRu1dxhVJoaHCY-KymtUU7SbzcnaY3gmI4NmuaRKJjk_WfnM3eNlWdo1XIjmy2xIfTxketrHpoedtH-76PD0N1ebOmJq-sWqhFc1j62MJ2QKuwEgYmouJ4 Oct 04 19:04:40.780986 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 19:04:40.780986 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 19:04:40.780986 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 19:04:40.780986 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 19:04:40.780986 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 19:04:40.780986 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 19:04:40.780986 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: a6a711601b7a439caf395233de1febff Oct 04 19:04:40.780986 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-DeleteServersTestJSON-591734195 Oct 04 19:04:40.780986 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 19:04:40.780986 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 19:04:40.780986 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/a6a711601b7a439caf395233de1febff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_a6a711601b7a439caf395233de1febff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a6a711601b7a439caf395233de1febff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a6a711601b7a439caf395233de1febff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 19:04:40.780986 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-DeleteServersTestJSON-591734195 Oct 04 19:04:40.780986 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: a6a711601b7a439caf395233de1febff Oct 04 19:04:40.780986 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-DeleteServersTestJSON-591734195 Oct 04 19:04:40.780986 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-DeleteServersTestJSON-591734195-project Oct 04 19:04:40.780986 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 19:04:40.780986 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 19:04:40.780986 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: c997bc60473b43fd9fcf0c65111c44c0 Oct 04 19:04:40.780986 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-DeleteServersTestJSON-591734195-project Oct 04 19:04:40.780986 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 19:04:40.780986 n-d-851028-13 devstack@n-api.service[123596]: exception: Instance a0c3f46d-ba5d-4349-a406-6ed87b428a28 could not be found. Oct 04 19:04:40.780986 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': 'a0c3f46d-ba5d-4349-a406-6ed87b428a28'} Oct 04 19:04:40.780986 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:04:40.780986 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:04:40.780986 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:04:40.780986 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:04:40.780986 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:04:40.780986 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:04:40.780986 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:04:40.780986 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:04:40.780986 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:04:40.780986 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:04:40.780986 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0c3f46d-ba5d-4349-a406-6ed87b428a28 could not be found. Oct 04 19:04:40.780986 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:04:40.780986 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:04:40.780986 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:04:40.780986 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:04:40.780986 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:04:40.780986 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:04:40.780986 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:04:40.780986 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:04:40.780986 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:04:40.780986 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:04:40.780986 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:04:40.780986 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:04:40.780986 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:04:40.780986 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:04:40.780986 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:04:40.780986 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:04:40.780986 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0c3f46d-ba5d-4349-a406-6ed87b428a28 could not be found. Oct 04 19:04:40.780986 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:04:40.780986 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:04:40.780986 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:04:40.786576 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:04:40.786576 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:04:40.786576 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:04:40.786576 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:04:40.786576 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:04:40.786576 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0c3f46d-ba5d-4349-a406-6ed87b428a28 could not be found. Oct 04 19:04:40.786576 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:04:40.786576 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-162eb0cc-2c7d-46dd-bea6-954763719db8 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Returning 404 to user: Instance a0c3f46d-ba5d-4349-a406-6ed87b428a28 could not be found. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:04:40.786576 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-162eb0cc-2c7d-46dd-bea6-954763719db8 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "GET /compute/v2.1/servers/a0c3f46d-ba5d-4349-a406-6ed87b428a28" status: 404 len: 111 microversion: 2.1 time: 0.044901 Oct 04 19:04:40.786576 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3111/5855] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:40 2022] GET /compute/v2.1/servers/a0c3f46d-ba5d-4349-a406-6ed87b428a28 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:04:40.798486 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-914c1a0a-ca6e-4b11-a70a-e94b25fe33dd tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:40.799107 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-914c1a0a-ca6e-4b11-a70a-e94b25fe33dd tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: a0c3f46d-ba5d-4349-a406-6ed87b428a28] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:40.807218 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-914c1a0a-ca6e-4b11-a70a-e94b25fe33dd tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:40.807745 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-914c1a0a-ca6e-4b11-a70a-e94b25fe33dd tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:40.808208 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-914c1a0a-ca6e-4b11-a70a-e94b25fe33dd tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:40.808935 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-914c1a0a-ca6e-4b11-a70a-e94b25fe33dd tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:40.809499 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-914c1a0a-ca6e-4b11-a70a-e94b25fe33dd tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:40.809942 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-914c1a0a-ca6e-4b11-a70a-e94b25fe33dd tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:40.845781 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-914c1a0a-ca6e-4b11-a70a-e94b25fe33dd tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] HTTP exception thrown: Instance a0c3f46d-ba5d-4349-a406-6ed87b428a28 could not be found. Oct 04 19:04:40.847520 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-914c1a0a-ca6e-4b11-a70a-e94b25fe33dd tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Request method failure captured: Oct 04 19:04:40.847520 n-d-851028-13 devstack@n-api.service[123595]: request: DELETE /compute/v2.1/servers/a0c3f46d-ba5d-4349-a406-6ed87b428a28 HTTP/1.1 Oct 04 19:04:40.847520 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 19:04:40.847520 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 19:04:40.847520 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 19:04:40.847520 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 0 Oct 04 19:04:40.847520 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 19:04:40.847520 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 19:04:40.847520 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 19:04:40.847520 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 19:04:40.847520 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPIKl7r6ZFtp0u4zXtNLGIhqHo70GyUJnklFY8mLM6SAvqzMqMYlk7FNNMFRu1dxhVJoaHCY-KymtUU7SbzcnaY3gmI4NmuaRKJjk_WfnM3eNlWdo1XIjmy2xIfTxketrHpoedtH-76PD0N1ebOmJq-sWqhFc1j62MJ2QKuwEgYmouJ4 Oct 04 19:04:40.847520 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 19:04:40.847520 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 19:04:40.847520 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 19:04:40.847520 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 19:04:40.847520 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 19:04:40.847520 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 19:04:40.847520 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: a6a711601b7a439caf395233de1febff Oct 04 19:04:40.847520 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-DeleteServersTestJSON-591734195 Oct 04 19:04:40.847520 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 19:04:40.847520 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 19:04:40.847520 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/a6a711601b7a439caf395233de1febff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_a6a711601b7a439caf395233de1febff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a6a711601b7a439caf395233de1febff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a6a711601b7a439caf395233de1febff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 19:04:40.847520 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-DeleteServersTestJSON-591734195 Oct 04 19:04:40.847520 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: a6a711601b7a439caf395233de1febff Oct 04 19:04:40.847520 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-DeleteServersTestJSON-591734195 Oct 04 19:04:40.847520 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-DeleteServersTestJSON-591734195-project Oct 04 19:04:40.847520 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 19:04:40.847520 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 19:04:40.847520 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: c997bc60473b43fd9fcf0c65111c44c0 Oct 04 19:04:40.847520 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-DeleteServersTestJSON-591734195-project Oct 04 19:04:40.847520 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 19:04:40.847520 n-d-851028-13 devstack@n-api.service[123595]: exception: Instance a0c3f46d-ba5d-4349-a406-6ed87b428a28 could not be found. Oct 04 19:04:40.847520 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': 'a0c3f46d-ba5d-4349-a406-6ed87b428a28'} Oct 04 19:04:40.847520 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:04:40.847520 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:04:40.847520 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:04:40.847520 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:04:40.847520 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:04:40.847520 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:04:40.847520 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:04:40.847520 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:04:40.847520 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:04:40.847520 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:04:40.847520 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0c3f46d-ba5d-4349-a406-6ed87b428a28 could not be found. Oct 04 19:04:40.847520 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:04:40.847520 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:04:40.847520 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:04:40.847520 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:04:40.847520 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:04:40.847520 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:04:40.847520 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:04:40.847520 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:04:40.847520 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:04:40.847520 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:04:40.847520 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 19:04:40.847520 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 19:04:40.847520 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 19:04:40.847520 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 19:04:40.847520 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:04:40.847520 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:04:40.847520 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:04:40.847520 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:04:40.852568 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0c3f46d-ba5d-4349-a406-6ed87b428a28 could not be found. Oct 04 19:04:40.852568 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:04:40.852568 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:04:40.852568 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:04:40.852568 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:04:40.852568 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:04:40.852568 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:04:40.852568 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:04:40.852568 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:04:40.852568 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0c3f46d-ba5d-4349-a406-6ed87b428a28 could not be found. Oct 04 19:04:40.852568 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:04:40.852568 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-914c1a0a-ca6e-4b11-a70a-e94b25fe33dd tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Returning 404 to user: Instance a0c3f46d-ba5d-4349-a406-6ed87b428a28 could not be found. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:04:40.852568 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-914c1a0a-ca6e-4b11-a70a-e94b25fe33dd tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "DELETE /compute/v2.1/servers/a0c3f46d-ba5d-4349-a406-6ed87b428a28" status: 404 len: 111 microversion: 2.1 time: 0.055603 Oct 04 19:04:40.857913 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-d02b4706-4876-4474-9dd9-1f245342da04 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:40.858546 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-d02b4706-4876-4474-9dd9-1f245342da04 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: a0c3f46d-ba5d-4349-a406-6ed87b428a28] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:40.871249 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2745/5856] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 19:04:40 2022] DELETE /compute/v2.1/servers/a0c3f46d-ba5d-4349-a406-6ed87b428a28 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:04:40.871483 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d02b4706-4876-4474-9dd9-1f245342da04 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:40.871961 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d02b4706-4876-4474-9dd9-1f245342da04 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:40.872414 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d02b4706-4876-4474-9dd9-1f245342da04 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:40.873209 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d02b4706-4876-4474-9dd9-1f245342da04 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:40.873669 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d02b4706-4876-4474-9dd9-1f245342da04 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:40.874153 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d02b4706-4876-4474-9dd9-1f245342da04 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:40.904747 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-d02b4706-4876-4474-9dd9-1f245342da04 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] HTTP exception thrown: Instance a0c3f46d-ba5d-4349-a406-6ed87b428a28 could not be found. Oct 04 19:04:40.906339 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-d02b4706-4876-4474-9dd9-1f245342da04 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Request method failure captured: Oct 04 19:04:40.906339 n-d-851028-13 devstack@n-api.service[123596]: request: GET /compute/v2.1/servers/a0c3f46d-ba5d-4349-a406-6ed87b428a28 HTTP/1.1 Oct 04 19:04:40.906339 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 19:04:40.906339 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 19:04:40.906339 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 19:04:40.906339 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 19:04:40.906339 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 19:04:40.906339 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 19:04:40.906339 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 19:04:40.906339 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 19:04:40.906339 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPIKl7r6ZFtp0u4zXtNLGIhqHo70GyUJnklFY8mLM6SAvqzMqMYlk7FNNMFRu1dxhVJoaHCY-KymtUU7SbzcnaY3gmI4NmuaRKJjk_WfnM3eNlWdo1XIjmy2xIfTxketrHpoedtH-76PD0N1ebOmJq-sWqhFc1j62MJ2QKuwEgYmouJ4 Oct 04 19:04:40.906339 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 19:04:40.906339 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 19:04:40.906339 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 19:04:40.906339 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 19:04:40.906339 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 19:04:40.906339 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 19:04:40.906339 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: a6a711601b7a439caf395233de1febff Oct 04 19:04:40.906339 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-DeleteServersTestJSON-591734195 Oct 04 19:04:40.906339 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 19:04:40.906339 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 19:04:40.906339 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/a6a711601b7a439caf395233de1febff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_a6a711601b7a439caf395233de1febff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a6a711601b7a439caf395233de1febff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a6a711601b7a439caf395233de1febff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 19:04:40.906339 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-DeleteServersTestJSON-591734195 Oct 04 19:04:40.906339 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: a6a711601b7a439caf395233de1febff Oct 04 19:04:40.906339 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-DeleteServersTestJSON-591734195 Oct 04 19:04:40.906339 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-DeleteServersTestJSON-591734195-project Oct 04 19:04:40.906339 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 19:04:40.906339 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 19:04:40.906339 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: c997bc60473b43fd9fcf0c65111c44c0 Oct 04 19:04:40.906339 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-DeleteServersTestJSON-591734195-project Oct 04 19:04:40.906339 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 19:04:40.906339 n-d-851028-13 devstack@n-api.service[123596]: exception: Instance a0c3f46d-ba5d-4349-a406-6ed87b428a28 could not be found. Oct 04 19:04:40.906339 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': 'a0c3f46d-ba5d-4349-a406-6ed87b428a28'} Oct 04 19:04:40.906339 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:04:40.906339 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:04:40.906339 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:04:40.906339 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:04:40.906339 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:04:40.906339 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:04:40.906339 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:04:40.906339 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:04:40.906339 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:04:40.906339 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:04:40.906339 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0c3f46d-ba5d-4349-a406-6ed87b428a28 could not be found. Oct 04 19:04:40.906339 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:04:40.906339 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:04:40.906339 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:04:40.906339 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:04:40.906339 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:04:40.906339 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:04:40.906339 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:04:40.906339 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:04:40.906339 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:04:40.906339 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:04:40.906339 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:04:40.906339 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:04:40.906339 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:04:40.906339 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:04:40.906339 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:04:40.906339 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:04:40.906339 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0c3f46d-ba5d-4349-a406-6ed87b428a28 could not be found. Oct 04 19:04:40.906339 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:04:40.906339 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:04:40.906339 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:04:40.912794 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:04:40.912794 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:04:40.912794 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:04:40.912794 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:04:40.912794 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:04:40.912794 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0c3f46d-ba5d-4349-a406-6ed87b428a28 could not be found. Oct 04 19:04:40.912794 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:04:40.912794 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-d02b4706-4876-4474-9dd9-1f245342da04 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Returning 404 to user: Instance a0c3f46d-ba5d-4349-a406-6ed87b428a28 could not be found. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:04:40.917254 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-d02b4706-4876-4474-9dd9-1f245342da04 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "GET /compute/v2.1/servers/a0c3f46d-ba5d-4349-a406-6ed87b428a28" status: 404 len: 111 microversion: 2.1 time: 0.063366 Oct 04 19:04:40.926152 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-ded8ea29-4653-4c08-be50-cbd4db120386 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:40.926665 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-ded8ea29-4653-4c08-be50-cbd4db120386 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: 3e01483e-8f33-43df-97b1-70f0834ac07d] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:40.933538 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ded8ea29-4653-4c08-be50-cbd4db120386 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:40.934035 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ded8ea29-4653-4c08-be50-cbd4db120386 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:40.934483 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ded8ea29-4653-4c08-be50-cbd4db120386 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:40.935213 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ded8ea29-4653-4c08-be50-cbd4db120386 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:40.936616 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3112/5857] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:40 2022] GET /compute/v2.1/servers/a0c3f46d-ba5d-4349-a406-6ed87b428a28 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 19:04:40.937377 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ded8ea29-4653-4c08-be50-cbd4db120386 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:40.938072 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ded8ea29-4653-4c08-be50-cbd4db120386 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:40.961004 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-ded8ea29-4653-4c08-be50-cbd4db120386 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] HTTP exception thrown: Instance 3e01483e-8f33-43df-97b1-70f0834ac07d could not be found. Oct 04 19:04:40.963349 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-ded8ea29-4653-4c08-be50-cbd4db120386 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Request method failure captured: Oct 04 19:04:40.963349 n-d-851028-13 devstack@n-api.service[123595]: request: DELETE /compute/v2.1/servers/3e01483e-8f33-43df-97b1-70f0834ac07d HTTP/1.1 Oct 04 19:04:40.963349 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 19:04:40.963349 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 19:04:40.963349 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 19:04:40.963349 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 0 Oct 04 19:04:40.963349 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 19:04:40.963349 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 19:04:40.963349 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 19:04:40.963349 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 19:04:40.963349 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPIKl7r6ZFtp0u4zXtNLGIhqHo70GyUJnklFY8mLM6SAvqzMqMYlk7FNNMFRu1dxhVJoaHCY-KymtUU7SbzcnaY3gmI4NmuaRKJjk_WfnM3eNlWdo1XIjmy2xIfTxketrHpoedtH-76PD0N1ebOmJq-sWqhFc1j62MJ2QKuwEgYmouJ4 Oct 04 19:04:40.963349 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 19:04:40.963349 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 19:04:40.963349 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 19:04:40.963349 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 19:04:40.963349 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 19:04:40.963349 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 19:04:40.963349 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: a6a711601b7a439caf395233de1febff Oct 04 19:04:40.963349 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-DeleteServersTestJSON-591734195 Oct 04 19:04:40.963349 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 19:04:40.963349 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 19:04:40.963349 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/a6a711601b7a439caf395233de1febff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_a6a711601b7a439caf395233de1febff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a6a711601b7a439caf395233de1febff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a6a711601b7a439caf395233de1febff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 19:04:40.963349 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-DeleteServersTestJSON-591734195 Oct 04 19:04:40.963349 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: a6a711601b7a439caf395233de1febff Oct 04 19:04:40.963349 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-DeleteServersTestJSON-591734195 Oct 04 19:04:40.963349 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-DeleteServersTestJSON-591734195-project Oct 04 19:04:40.963349 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 19:04:40.963349 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 19:04:40.963349 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: c997bc60473b43fd9fcf0c65111c44c0 Oct 04 19:04:40.963349 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-DeleteServersTestJSON-591734195-project Oct 04 19:04:40.963349 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 19:04:40.963349 n-d-851028-13 devstack@n-api.service[123595]: exception: Instance 3e01483e-8f33-43df-97b1-70f0834ac07d could not be found. Oct 04 19:04:40.963349 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': '3e01483e-8f33-43df-97b1-70f0834ac07d'} Oct 04 19:04:40.963349 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:04:40.963349 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:04:40.963349 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:04:40.963349 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:04:40.963349 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:04:40.963349 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:04:40.963349 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:04:40.963349 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:04:40.963349 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:04:40.963349 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:04:40.963349 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e01483e-8f33-43df-97b1-70f0834ac07d could not be found. Oct 04 19:04:40.963349 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:04:40.963349 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:04:40.963349 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:04:40.963349 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:04:40.963349 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:04:40.963349 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:04:40.963349 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:04:40.963349 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:04:40.963349 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:04:40.963349 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:04:40.963349 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 19:04:40.963349 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 19:04:40.963349 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 19:04:40.963349 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 19:04:40.963349 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:04:40.963349 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:04:40.963349 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:04:40.963349 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:04:40.967682 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e01483e-8f33-43df-97b1-70f0834ac07d could not be found. Oct 04 19:04:40.967682 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:04:40.967682 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:04:40.967682 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:04:40.967682 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:04:40.967682 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:04:40.967682 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:04:40.967682 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:04:40.967682 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:04:40.967682 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e01483e-8f33-43df-97b1-70f0834ac07d could not be found. Oct 04 19:04:40.967682 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:04:40.967682 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-ded8ea29-4653-4c08-be50-cbd4db120386 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Returning 404 to user: Instance 3e01483e-8f33-43df-97b1-70f0834ac07d could not be found. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:04:40.967682 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-ded8ea29-4653-4c08-be50-cbd4db120386 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "DELETE /compute/v2.1/servers/3e01483e-8f33-43df-97b1-70f0834ac07d" status: 404 len: 111 microversion: 2.1 time: 0.042699 Oct 04 19:04:40.974213 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-58cade8f-ffcc-4f2d-9ea5-fc523539b2ae tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:40.975599 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-58cade8f-ffcc-4f2d-9ea5-fc523539b2ae tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: 3e01483e-8f33-43df-97b1-70f0834ac07d] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:40.978699 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2746/5858] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 19:04:40 2022] DELETE /compute/v2.1/servers/3e01483e-8f33-43df-97b1-70f0834ac07d => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:04:40.982994 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-58cade8f-ffcc-4f2d-9ea5-fc523539b2ae tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:40.983286 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-58cade8f-ffcc-4f2d-9ea5-fc523539b2ae tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:40.983974 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-58cade8f-ffcc-4f2d-9ea5-fc523539b2ae tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:40.984854 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-58cade8f-ffcc-4f2d-9ea5-fc523539b2ae tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:40.985540 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-58cade8f-ffcc-4f2d-9ea5-fc523539b2ae tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:40.986152 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-58cade8f-ffcc-4f2d-9ea5-fc523539b2ae tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:41.014248 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-58cade8f-ffcc-4f2d-9ea5-fc523539b2ae tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] HTTP exception thrown: Instance 3e01483e-8f33-43df-97b1-70f0834ac07d could not be found. Oct 04 19:04:41.017242 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-58cade8f-ffcc-4f2d-9ea5-fc523539b2ae tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Request method failure captured: Oct 04 19:04:41.017242 n-d-851028-13 devstack@n-api.service[123596]: request: GET /compute/v2.1/servers/3e01483e-8f33-43df-97b1-70f0834ac07d HTTP/1.1 Oct 04 19:04:41.017242 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 19:04:41.017242 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 19:04:41.017242 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 19:04:41.017242 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 19:04:41.017242 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 19:04:41.017242 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 19:04:41.017242 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 19:04:41.017242 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 19:04:41.017242 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPIKl7r6ZFtp0u4zXtNLGIhqHo70GyUJnklFY8mLM6SAvqzMqMYlk7FNNMFRu1dxhVJoaHCY-KymtUU7SbzcnaY3gmI4NmuaRKJjk_WfnM3eNlWdo1XIjmy2xIfTxketrHpoedtH-76PD0N1ebOmJq-sWqhFc1j62MJ2QKuwEgYmouJ4 Oct 04 19:04:41.017242 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 19:04:41.017242 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 19:04:41.017242 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 19:04:41.017242 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 19:04:41.017242 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 19:04:41.017242 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 19:04:41.017242 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: a6a711601b7a439caf395233de1febff Oct 04 19:04:41.017242 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-DeleteServersTestJSON-591734195 Oct 04 19:04:41.017242 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 19:04:41.017242 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 19:04:41.017242 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/a6a711601b7a439caf395233de1febff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_a6a711601b7a439caf395233de1febff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a6a711601b7a439caf395233de1febff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a6a711601b7a439caf395233de1febff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 19:04:41.017242 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-DeleteServersTestJSON-591734195 Oct 04 19:04:41.017242 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: a6a711601b7a439caf395233de1febff Oct 04 19:04:41.017242 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-DeleteServersTestJSON-591734195 Oct 04 19:04:41.017242 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-DeleteServersTestJSON-591734195-project Oct 04 19:04:41.017242 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 19:04:41.017242 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 19:04:41.017242 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: c997bc60473b43fd9fcf0c65111c44c0 Oct 04 19:04:41.017242 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-DeleteServersTestJSON-591734195-project Oct 04 19:04:41.017242 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 19:04:41.017242 n-d-851028-13 devstack@n-api.service[123596]: exception: Instance 3e01483e-8f33-43df-97b1-70f0834ac07d could not be found. Oct 04 19:04:41.017242 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': '3e01483e-8f33-43df-97b1-70f0834ac07d'} Oct 04 19:04:41.017242 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:04:41.017242 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:04:41.017242 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:04:41.017242 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:04:41.017242 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:04:41.017242 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:04:41.017242 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:04:41.017242 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:04:41.017242 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:04:41.017242 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:04:41.017242 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e01483e-8f33-43df-97b1-70f0834ac07d could not be found. Oct 04 19:04:41.017242 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:04:41.017242 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:04:41.017242 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:04:41.017242 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:04:41.017242 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:04:41.017242 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:04:41.017242 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:04:41.017242 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:04:41.017242 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:04:41.017242 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:04:41.017242 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:04:41.017242 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:04:41.017242 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:04:41.017242 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:04:41.017242 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:04:41.017242 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:04:41.017242 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e01483e-8f33-43df-97b1-70f0834ac07d could not be found. Oct 04 19:04:41.017242 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:04:41.017242 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:04:41.017242 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:04:41.022752 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:04:41.022752 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:04:41.022752 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:04:41.022752 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:04:41.022752 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:04:41.022752 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e01483e-8f33-43df-97b1-70f0834ac07d could not be found. Oct 04 19:04:41.022752 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:04:41.026680 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-58cade8f-ffcc-4f2d-9ea5-fc523539b2ae tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Returning 404 to user: Instance 3e01483e-8f33-43df-97b1-70f0834ac07d could not be found. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:04:41.026680 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-58cade8f-ffcc-4f2d-9ea5-fc523539b2ae tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "GET /compute/v2.1/servers/3e01483e-8f33-43df-97b1-70f0834ac07d" status: 404 len: 111 microversion: 2.1 time: 0.056236 Oct 04 19:04:41.027343 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3113/5859] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:40 2022] GET /compute/v2.1/servers/3e01483e-8f33-43df-97b1-70f0834ac07d => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 19:04:41.035292 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-4d36c8ea-a272-4f7f-b216-fda9dffbc62e tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:41.035821 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-4d36c8ea-a272-4f7f-b216-fda9dffbc62e tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: 3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:41.042746 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4d36c8ea-a272-4f7f-b216-fda9dffbc62e tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:41.043258 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4d36c8ea-a272-4f7f-b216-fda9dffbc62e tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:41.045655 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4d36c8ea-a272-4f7f-b216-fda9dffbc62e tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:41.046470 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4d36c8ea-a272-4f7f-b216-fda9dffbc62e tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:41.046953 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4d36c8ea-a272-4f7f-b216-fda9dffbc62e tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:41.047398 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4d36c8ea-a272-4f7f-b216-fda9dffbc62e tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:41.075789 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-4d36c8ea-a272-4f7f-b216-fda9dffbc62e tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] HTTP exception thrown: Instance 3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff could not be found. Oct 04 19:04:41.082890 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-4d36c8ea-a272-4f7f-b216-fda9dffbc62e tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Request method failure captured: Oct 04 19:04:41.082890 n-d-851028-13 devstack@n-api.service[123595]: request: DELETE /compute/v2.1/servers/3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff HTTP/1.1 Oct 04 19:04:41.082890 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 19:04:41.082890 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 19:04:41.082890 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 19:04:41.082890 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 0 Oct 04 19:04:41.082890 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 19:04:41.082890 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 19:04:41.082890 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 19:04:41.082890 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 19:04:41.082890 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPIKl7r6ZFtp0u4zXtNLGIhqHo70GyUJnklFY8mLM6SAvqzMqMYlk7FNNMFRu1dxhVJoaHCY-KymtUU7SbzcnaY3gmI4NmuaRKJjk_WfnM3eNlWdo1XIjmy2xIfTxketrHpoedtH-76PD0N1ebOmJq-sWqhFc1j62MJ2QKuwEgYmouJ4 Oct 04 19:04:41.082890 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 19:04:41.082890 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 19:04:41.082890 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 19:04:41.082890 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 19:04:41.082890 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 19:04:41.082890 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 19:04:41.082890 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: a6a711601b7a439caf395233de1febff Oct 04 19:04:41.082890 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-DeleteServersTestJSON-591734195 Oct 04 19:04:41.082890 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 19:04:41.082890 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 19:04:41.082890 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/a6a711601b7a439caf395233de1febff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_a6a711601b7a439caf395233de1febff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a6a711601b7a439caf395233de1febff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a6a711601b7a439caf395233de1febff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 19:04:41.082890 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-DeleteServersTestJSON-591734195 Oct 04 19:04:41.082890 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: a6a711601b7a439caf395233de1febff Oct 04 19:04:41.082890 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-DeleteServersTestJSON-591734195 Oct 04 19:04:41.082890 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-DeleteServersTestJSON-591734195-project Oct 04 19:04:41.082890 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 19:04:41.082890 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 19:04:41.082890 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: c997bc60473b43fd9fcf0c65111c44c0 Oct 04 19:04:41.082890 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-DeleteServersTestJSON-591734195-project Oct 04 19:04:41.082890 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 19:04:41.082890 n-d-851028-13 devstack@n-api.service[123595]: exception: Instance 3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff could not be found. Oct 04 19:04:41.082890 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': '3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff'} Oct 04 19:04:41.082890 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:04:41.082890 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:04:41.082890 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:04:41.082890 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:04:41.082890 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:04:41.082890 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:04:41.082890 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:04:41.082890 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:04:41.082890 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:04:41.082890 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:04:41.082890 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff could not be found. Oct 04 19:04:41.082890 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:04:41.082890 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:04:41.082890 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:04:41.082890 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:04:41.082890 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:04:41.082890 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:04:41.082890 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:04:41.082890 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:04:41.082890 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:04:41.082890 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:04:41.082890 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 19:04:41.082890 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 19:04:41.082890 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 19:04:41.082890 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 19:04:41.082890 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:04:41.082890 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:04:41.082890 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:04:41.082890 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:04:41.087754 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff could not be found. Oct 04 19:04:41.087754 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:04:41.087754 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:04:41.087754 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:04:41.087754 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:04:41.087754 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:04:41.087754 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:04:41.087754 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:04:41.087754 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:04:41.087754 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff could not be found. Oct 04 19:04:41.087754 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:04:41.087754 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-4d36c8ea-a272-4f7f-b216-fda9dffbc62e tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Returning 404 to user: Instance 3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff could not be found. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:04:41.087754 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-4d36c8ea-a272-4f7f-b216-fda9dffbc62e tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "DELETE /compute/v2.1/servers/3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff" status: 404 len: 111 microversion: 2.1 time: 0.053339 Oct 04 19:04:41.087754 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2747/5860] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 19:04:41 2022] DELETE /compute/v2.1/servers/3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:04:41.109102 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-e55f5795-4272-40ec-ac6c-9c46fd6ec4ed tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:41.110276 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-e55f5795-4272-40ec-ac6c-9c46fd6ec4ed tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: 3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:41.122294 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e55f5795-4272-40ec-ac6c-9c46fd6ec4ed tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:41.122917 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e55f5795-4272-40ec-ac6c-9c46fd6ec4ed tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:41.123381 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e55f5795-4272-40ec-ac6c-9c46fd6ec4ed tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:41.127237 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e55f5795-4272-40ec-ac6c-9c46fd6ec4ed tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:41.129943 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e55f5795-4272-40ec-ac6c-9c46fd6ec4ed tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:41.130849 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e55f5795-4272-40ec-ac6c-9c46fd6ec4ed tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:41.172984 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-e55f5795-4272-40ec-ac6c-9c46fd6ec4ed tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] HTTP exception thrown: Instance 3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff could not be found. Oct 04 19:04:41.176404 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-e55f5795-4272-40ec-ac6c-9c46fd6ec4ed tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Request method failure captured: Oct 04 19:04:41.176404 n-d-851028-13 devstack@n-api.service[123596]: request: GET /compute/v2.1/servers/3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff HTTP/1.1 Oct 04 19:04:41.176404 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 19:04:41.176404 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 19:04:41.176404 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 19:04:41.176404 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 19:04:41.176404 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 19:04:41.176404 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 19:04:41.176404 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 19:04:41.176404 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 19:04:41.176404 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPIKl7r6ZFtp0u4zXtNLGIhqHo70GyUJnklFY8mLM6SAvqzMqMYlk7FNNMFRu1dxhVJoaHCY-KymtUU7SbzcnaY3gmI4NmuaRKJjk_WfnM3eNlWdo1XIjmy2xIfTxketrHpoedtH-76PD0N1ebOmJq-sWqhFc1j62MJ2QKuwEgYmouJ4 Oct 04 19:04:41.176404 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 19:04:41.176404 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 19:04:41.176404 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 19:04:41.176404 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 19:04:41.176404 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 19:04:41.176404 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 19:04:41.176404 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: a6a711601b7a439caf395233de1febff Oct 04 19:04:41.176404 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-DeleteServersTestJSON-591734195 Oct 04 19:04:41.176404 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 19:04:41.176404 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 19:04:41.176404 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/a6a711601b7a439caf395233de1febff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_a6a711601b7a439caf395233de1febff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a6a711601b7a439caf395233de1febff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a6a711601b7a439caf395233de1febff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 19:04:41.176404 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-DeleteServersTestJSON-591734195 Oct 04 19:04:41.176404 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: a6a711601b7a439caf395233de1febff Oct 04 19:04:41.176404 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-DeleteServersTestJSON-591734195 Oct 04 19:04:41.176404 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-DeleteServersTestJSON-591734195-project Oct 04 19:04:41.176404 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 19:04:41.176404 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 19:04:41.176404 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: c997bc60473b43fd9fcf0c65111c44c0 Oct 04 19:04:41.176404 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-DeleteServersTestJSON-591734195-project Oct 04 19:04:41.176404 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 19:04:41.176404 n-d-851028-13 devstack@n-api.service[123596]: exception: Instance 3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff could not be found. Oct 04 19:04:41.176404 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': '3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff'} Oct 04 19:04:41.176404 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:04:41.176404 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:04:41.176404 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:04:41.176404 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:04:41.176404 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:04:41.176404 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:04:41.176404 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:04:41.176404 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:04:41.176404 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:04:41.176404 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:04:41.176404 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff could not be found. Oct 04 19:04:41.176404 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:04:41.176404 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:04:41.176404 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:04:41.176404 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:04:41.176404 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:04:41.176404 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:04:41.176404 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:04:41.176404 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:04:41.176404 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:04:41.176404 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:04:41.176404 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:04:41.176404 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:04:41.176404 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:04:41.176404 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:04:41.176404 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:04:41.176404 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:04:41.176404 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff could not be found. Oct 04 19:04:41.176404 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:04:41.176404 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:04:41.176404 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:04:41.181250 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:04:41.181250 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:04:41.181250 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:04:41.181250 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:04:41.181250 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:04:41.181250 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff could not be found. Oct 04 19:04:41.181250 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:04:41.184122 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-e55f5795-4272-40ec-ac6c-9c46fd6ec4ed tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Returning 404 to user: Instance 3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff could not be found. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:04:41.185443 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-e55f5795-4272-40ec-ac6c-9c46fd6ec4ed tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "GET /compute/v2.1/servers/3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff" status: 404 len: 111 microversion: 2.1 time: 0.088079 Oct 04 19:04:41.187265 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3114/5861] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:41 2022] GET /compute/v2.1/servers/3aaa8ca3-04fd-4cf1-b587-cd5e67de45ff => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:04:41.197855 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-c9844a08-c3ae-496c-a6a7-63f96b67a125 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:41.198427 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-c9844a08-c3ae-496c-a6a7-63f96b67a125 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: 703e06d0-b24b-4a2b-900c-55c8a9291887] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:41.204847 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c9844a08-c3ae-496c-a6a7-63f96b67a125 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:41.205381 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c9844a08-c3ae-496c-a6a7-63f96b67a125 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:41.205835 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c9844a08-c3ae-496c-a6a7-63f96b67a125 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:41.206598 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c9844a08-c3ae-496c-a6a7-63f96b67a125 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:41.207068 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c9844a08-c3ae-496c-a6a7-63f96b67a125 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:41.207732 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c9844a08-c3ae-496c-a6a7-63f96b67a125 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:41.224166 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-c9844a08-c3ae-496c-a6a7-63f96b67a125 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] HTTP exception thrown: Instance 703e06d0-b24b-4a2b-900c-55c8a9291887 could not be found. Oct 04 19:04:41.227981 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-c9844a08-c3ae-496c-a6a7-63f96b67a125 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Request method failure captured: Oct 04 19:04:41.227981 n-d-851028-13 devstack@n-api.service[123595]: request: DELETE /compute/v2.1/servers/703e06d0-b24b-4a2b-900c-55c8a9291887 HTTP/1.1 Oct 04 19:04:41.227981 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 19:04:41.227981 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 19:04:41.227981 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 19:04:41.227981 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 0 Oct 04 19:04:41.227981 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 19:04:41.227981 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 19:04:41.227981 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 19:04:41.227981 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 19:04:41.227981 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPIKl7r6ZFtp0u4zXtNLGIhqHo70GyUJnklFY8mLM6SAvqzMqMYlk7FNNMFRu1dxhVJoaHCY-KymtUU7SbzcnaY3gmI4NmuaRKJjk_WfnM3eNlWdo1XIjmy2xIfTxketrHpoedtH-76PD0N1ebOmJq-sWqhFc1j62MJ2QKuwEgYmouJ4 Oct 04 19:04:41.227981 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 19:04:41.227981 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 19:04:41.227981 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 19:04:41.227981 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 19:04:41.227981 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 19:04:41.227981 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 19:04:41.227981 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: a6a711601b7a439caf395233de1febff Oct 04 19:04:41.227981 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-DeleteServersTestJSON-591734195 Oct 04 19:04:41.227981 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 19:04:41.227981 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 19:04:41.227981 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/a6a711601b7a439caf395233de1febff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_a6a711601b7a439caf395233de1febff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a6a711601b7a439caf395233de1febff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a6a711601b7a439caf395233de1febff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 19:04:41.227981 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-DeleteServersTestJSON-591734195 Oct 04 19:04:41.227981 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: a6a711601b7a439caf395233de1febff Oct 04 19:04:41.227981 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-DeleteServersTestJSON-591734195 Oct 04 19:04:41.227981 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-DeleteServersTestJSON-591734195-project Oct 04 19:04:41.227981 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 19:04:41.227981 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 19:04:41.227981 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: c997bc60473b43fd9fcf0c65111c44c0 Oct 04 19:04:41.227981 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-DeleteServersTestJSON-591734195-project Oct 04 19:04:41.227981 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 19:04:41.227981 n-d-851028-13 devstack@n-api.service[123595]: exception: Instance 703e06d0-b24b-4a2b-900c-55c8a9291887 could not be found. Oct 04 19:04:41.227981 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': '703e06d0-b24b-4a2b-900c-55c8a9291887'} Oct 04 19:04:41.227981 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:04:41.227981 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:04:41.227981 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:04:41.227981 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:04:41.227981 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:04:41.227981 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:04:41.227981 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:04:41.227981 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:04:41.227981 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:04:41.227981 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:04:41.227981 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 703e06d0-b24b-4a2b-900c-55c8a9291887 could not be found. Oct 04 19:04:41.227981 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:04:41.227981 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:04:41.227981 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:04:41.227981 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:04:41.227981 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:04:41.227981 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:04:41.227981 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:04:41.227981 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:04:41.227981 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:04:41.227981 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:04:41.227981 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 19:04:41.227981 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 19:04:41.227981 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 19:04:41.227981 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 19:04:41.227981 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:04:41.227981 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:04:41.227981 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:04:41.227981 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:04:41.232608 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 703e06d0-b24b-4a2b-900c-55c8a9291887 could not be found. Oct 04 19:04:41.232608 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:04:41.232608 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:04:41.232608 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:04:41.232608 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:04:41.232608 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:04:41.232608 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:04:41.232608 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:04:41.232608 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:04:41.232608 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 703e06d0-b24b-4a2b-900c-55c8a9291887 could not be found. Oct 04 19:04:41.232608 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:04:41.235001 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-c9844a08-c3ae-496c-a6a7-63f96b67a125 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Returning 404 to user: Instance 703e06d0-b24b-4a2b-900c-55c8a9291887 could not be found. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:04:41.236579 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-c9844a08-c3ae-496c-a6a7-63f96b67a125 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "DELETE /compute/v2.1/servers/703e06d0-b24b-4a2b-900c-55c8a9291887" status: 404 len: 111 microversion: 2.1 time: 0.044867 Oct 04 19:04:41.247486 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-887f668d-4374-4408-97f8-328705f766f4 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:41.248400 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-887f668d-4374-4408-97f8-328705f766f4 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: 703e06d0-b24b-4a2b-900c-55c8a9291887] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:41.251550 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2748/5862] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 19:04:41 2022] DELETE /compute/v2.1/servers/703e06d0-b24b-4a2b-900c-55c8a9291887 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:04:41.258982 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-887f668d-4374-4408-97f8-328705f766f4 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:41.259500 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-887f668d-4374-4408-97f8-328705f766f4 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:41.259946 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-887f668d-4374-4408-97f8-328705f766f4 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:41.260656 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-887f668d-4374-4408-97f8-328705f766f4 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:41.261136 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-887f668d-4374-4408-97f8-328705f766f4 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:41.261571 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-887f668d-4374-4408-97f8-328705f766f4 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:41.302021 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-887f668d-4374-4408-97f8-328705f766f4 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] HTTP exception thrown: Instance 703e06d0-b24b-4a2b-900c-55c8a9291887 could not be found. Oct 04 19:04:41.303638 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-887f668d-4374-4408-97f8-328705f766f4 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Request method failure captured: Oct 04 19:04:41.303638 n-d-851028-13 devstack@n-api.service[123596]: request: GET /compute/v2.1/servers/703e06d0-b24b-4a2b-900c-55c8a9291887 HTTP/1.1 Oct 04 19:04:41.303638 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 19:04:41.303638 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 19:04:41.303638 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 19:04:41.303638 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 19:04:41.303638 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 19:04:41.303638 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 19:04:41.303638 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 19:04:41.303638 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 19:04:41.303638 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPIKl7r6ZFtp0u4zXtNLGIhqHo70GyUJnklFY8mLM6SAvqzMqMYlk7FNNMFRu1dxhVJoaHCY-KymtUU7SbzcnaY3gmI4NmuaRKJjk_WfnM3eNlWdo1XIjmy2xIfTxketrHpoedtH-76PD0N1ebOmJq-sWqhFc1j62MJ2QKuwEgYmouJ4 Oct 04 19:04:41.303638 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 19:04:41.303638 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 19:04:41.303638 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 19:04:41.303638 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 19:04:41.303638 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 19:04:41.303638 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 19:04:41.303638 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: a6a711601b7a439caf395233de1febff Oct 04 19:04:41.303638 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-DeleteServersTestJSON-591734195 Oct 04 19:04:41.303638 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 19:04:41.303638 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 19:04:41.303638 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/a6a711601b7a439caf395233de1febff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_a6a711601b7a439caf395233de1febff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a6a711601b7a439caf395233de1febff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a6a711601b7a439caf395233de1febff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 19:04:41.303638 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-DeleteServersTestJSON-591734195 Oct 04 19:04:41.303638 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: a6a711601b7a439caf395233de1febff Oct 04 19:04:41.303638 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-DeleteServersTestJSON-591734195 Oct 04 19:04:41.303638 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-DeleteServersTestJSON-591734195-project Oct 04 19:04:41.303638 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 19:04:41.303638 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 19:04:41.303638 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: c997bc60473b43fd9fcf0c65111c44c0 Oct 04 19:04:41.303638 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-DeleteServersTestJSON-591734195-project Oct 04 19:04:41.303638 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 19:04:41.303638 n-d-851028-13 devstack@n-api.service[123596]: exception: Instance 703e06d0-b24b-4a2b-900c-55c8a9291887 could not be found. Oct 04 19:04:41.303638 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': '703e06d0-b24b-4a2b-900c-55c8a9291887'} Oct 04 19:04:41.303638 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:04:41.303638 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:04:41.303638 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:04:41.303638 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:04:41.303638 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:04:41.303638 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:04:41.303638 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:04:41.303638 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:04:41.303638 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:04:41.303638 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:04:41.303638 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 703e06d0-b24b-4a2b-900c-55c8a9291887 could not be found. Oct 04 19:04:41.303638 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:04:41.303638 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:04:41.303638 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:04:41.303638 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:04:41.303638 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:04:41.303638 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:04:41.303638 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:04:41.303638 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:04:41.303638 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:04:41.303638 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:04:41.303638 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:04:41.303638 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:04:41.303638 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:04:41.303638 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:04:41.303638 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:04:41.303638 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:04:41.303638 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 703e06d0-b24b-4a2b-900c-55c8a9291887 could not be found. Oct 04 19:04:41.303638 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:04:41.303638 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:04:41.303638 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:04:41.308300 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:04:41.308300 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:04:41.308300 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:04:41.308300 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:04:41.308300 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:04:41.308300 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 703e06d0-b24b-4a2b-900c-55c8a9291887 could not be found. Oct 04 19:04:41.308300 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:04:41.310024 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-887f668d-4374-4408-97f8-328705f766f4 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Returning 404 to user: Instance 703e06d0-b24b-4a2b-900c-55c8a9291887 could not be found. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:04:41.311239 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-887f668d-4374-4408-97f8-328705f766f4 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "GET /compute/v2.1/servers/703e06d0-b24b-4a2b-900c-55c8a9291887" status: 404 len: 111 microversion: 2.1 time: 0.069134 Oct 04 19:04:41.312318 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3115/5863] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:41 2022] GET /compute/v2.1/servers/703e06d0-b24b-4a2b-900c-55c8a9291887 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:04:41.321546 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-654191a5-05dd-4b29-803e-ed29c731945e tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:41.322210 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-654191a5-05dd-4b29-803e-ed29c731945e tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: f5756da0-e167-4a21-881d-1479b42314db] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:41.333068 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-654191a5-05dd-4b29-803e-ed29c731945e tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] HTTP exception thrown: Instance f5756da0-e167-4a21-881d-1479b42314db could not be found. Oct 04 19:04:41.337256 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-654191a5-05dd-4b29-803e-ed29c731945e tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Request method failure captured: Oct 04 19:04:41.337256 n-d-851028-13 devstack@n-api.service[123595]: request: DELETE /compute/v2.1/servers/f5756da0-e167-4a21-881d-1479b42314db HTTP/1.1 Oct 04 19:04:41.337256 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 19:04:41.337256 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 19:04:41.337256 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 19:04:41.337256 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 0 Oct 04 19:04:41.337256 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 19:04:41.337256 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 19:04:41.337256 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 19:04:41.337256 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 19:04:41.337256 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPIKl7r6ZFtp0u4zXtNLGIhqHo70GyUJnklFY8mLM6SAvqzMqMYlk7FNNMFRu1dxhVJoaHCY-KymtUU7SbzcnaY3gmI4NmuaRKJjk_WfnM3eNlWdo1XIjmy2xIfTxketrHpoedtH-76PD0N1ebOmJq-sWqhFc1j62MJ2QKuwEgYmouJ4 Oct 04 19:04:41.337256 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 19:04:41.337256 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 19:04:41.337256 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 19:04:41.337256 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 19:04:41.337256 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 19:04:41.337256 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 19:04:41.337256 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: a6a711601b7a439caf395233de1febff Oct 04 19:04:41.337256 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-DeleteServersTestJSON-591734195 Oct 04 19:04:41.337256 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 19:04:41.337256 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 19:04:41.337256 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/a6a711601b7a439caf395233de1febff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_a6a711601b7a439caf395233de1febff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a6a711601b7a439caf395233de1febff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a6a711601b7a439caf395233de1febff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 19:04:41.337256 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-DeleteServersTestJSON-591734195 Oct 04 19:04:41.337256 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: a6a711601b7a439caf395233de1febff Oct 04 19:04:41.337256 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-DeleteServersTestJSON-591734195 Oct 04 19:04:41.337256 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-DeleteServersTestJSON-591734195-project Oct 04 19:04:41.337256 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 19:04:41.337256 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 19:04:41.337256 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: c997bc60473b43fd9fcf0c65111c44c0 Oct 04 19:04:41.337256 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-DeleteServersTestJSON-591734195-project Oct 04 19:04:41.337256 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 19:04:41.337256 n-d-851028-13 devstack@n-api.service[123595]: exception: Instance f5756da0-e167-4a21-881d-1479b42314db could not be found. Oct 04 19:04:41.337256 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': 'f5756da0-e167-4a21-881d-1479b42314db'} Oct 04 19:04:41.337256 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:04:41.337256 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:04:41.337256 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:04:41.337256 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:04:41.337256 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:04:41.337256 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:04:41.337256 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 19:04:41.337256 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 19:04:41.337256 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5756da0-e167-4a21-881d-1479b42314db could not be found. Oct 04 19:04:41.337256 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:04:41.337256 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:04:41.337256 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:04:41.337256 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:04:41.337256 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:04:41.337256 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:04:41.337256 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:04:41.337256 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:04:41.337256 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:04:41.337256 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:04:41.337256 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 19:04:41.337256 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 19:04:41.337256 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 19:04:41.337256 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 19:04:41.337256 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:04:41.337256 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:04:41.337256 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:04:41.337256 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:04:41.337256 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5756da0-e167-4a21-881d-1479b42314db could not be found. Oct 04 19:04:41.337256 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:04:41.337256 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:04:41.337256 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:04:41.342869 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:04:41.342869 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:04:41.342869 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:04:41.342869 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:04:41.342869 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:04:41.342869 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5756da0-e167-4a21-881d-1479b42314db could not be found. Oct 04 19:04:41.342869 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:04:41.345976 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-654191a5-05dd-4b29-803e-ed29c731945e tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Returning 404 to user: Instance f5756da0-e167-4a21-881d-1479b42314db could not be found. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:04:41.348544 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-654191a5-05dd-4b29-803e-ed29c731945e tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "DELETE /compute/v2.1/servers/f5756da0-e167-4a21-881d-1479b42314db" status: 404 len: 111 microversion: 2.1 time: 0.029052 Oct 04 19:04:41.362575 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-0d2e2be5-99ae-4a51-a366-26da8f9b6089 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:41.363450 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-0d2e2be5-99ae-4a51-a366-26da8f9b6089 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: f5756da0-e167-4a21-881d-1479b42314db] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:41.369589 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2749/5864] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 19:04:41 2022] DELETE /compute/v2.1/servers/f5756da0-e167-4a21-881d-1479b42314db => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:04:41.373041 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-0d2e2be5-99ae-4a51-a366-26da8f9b6089 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] HTTP exception thrown: Instance f5756da0-e167-4a21-881d-1479b42314db could not be found. Oct 04 19:04:41.378494 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-0d2e2be5-99ae-4a51-a366-26da8f9b6089 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Request method failure captured: Oct 04 19:04:41.378494 n-d-851028-13 devstack@n-api.service[123596]: request: GET /compute/v2.1/servers/f5756da0-e167-4a21-881d-1479b42314db HTTP/1.1 Oct 04 19:04:41.378494 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 19:04:41.378494 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 19:04:41.378494 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 19:04:41.378494 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 19:04:41.378494 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 19:04:41.378494 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 19:04:41.378494 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 19:04:41.378494 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 19:04:41.378494 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPIKl7r6ZFtp0u4zXtNLGIhqHo70GyUJnklFY8mLM6SAvqzMqMYlk7FNNMFRu1dxhVJoaHCY-KymtUU7SbzcnaY3gmI4NmuaRKJjk_WfnM3eNlWdo1XIjmy2xIfTxketrHpoedtH-76PD0N1ebOmJq-sWqhFc1j62MJ2QKuwEgYmouJ4 Oct 04 19:04:41.378494 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 19:04:41.378494 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 19:04:41.378494 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 19:04:41.378494 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 19:04:41.378494 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 19:04:41.378494 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 19:04:41.378494 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: a6a711601b7a439caf395233de1febff Oct 04 19:04:41.378494 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-DeleteServersTestJSON-591734195 Oct 04 19:04:41.378494 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 19:04:41.378494 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 19:04:41.378494 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/a6a711601b7a439caf395233de1febff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_a6a711601b7a439caf395233de1febff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a6a711601b7a439caf395233de1febff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a6a711601b7a439caf395233de1febff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 19:04:41.378494 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-DeleteServersTestJSON-591734195 Oct 04 19:04:41.378494 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: a6a711601b7a439caf395233de1febff Oct 04 19:04:41.378494 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-DeleteServersTestJSON-591734195 Oct 04 19:04:41.378494 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-DeleteServersTestJSON-591734195-project Oct 04 19:04:41.378494 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 19:04:41.378494 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 19:04:41.378494 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: c997bc60473b43fd9fcf0c65111c44c0 Oct 04 19:04:41.378494 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-DeleteServersTestJSON-591734195-project Oct 04 19:04:41.378494 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 19:04:41.378494 n-d-851028-13 devstack@n-api.service[123596]: exception: Instance f5756da0-e167-4a21-881d-1479b42314db could not be found. Oct 04 19:04:41.378494 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': 'f5756da0-e167-4a21-881d-1479b42314db'} Oct 04 19:04:41.378494 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:04:41.378494 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:04:41.378494 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:04:41.378494 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:04:41.378494 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:04:41.378494 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:04:41.378494 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 19:04:41.378494 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 19:04:41.378494 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5756da0-e167-4a21-881d-1479b42314db could not be found. Oct 04 19:04:41.378494 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:04:41.378494 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:04:41.378494 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:04:41.378494 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:04:41.378494 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:04:41.378494 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:04:41.378494 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:04:41.378494 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:04:41.378494 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:04:41.378494 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:04:41.378494 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:04:41.378494 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:04:41.378494 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:04:41.378494 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:04:41.378494 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:04:41.378494 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:04:41.378494 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5756da0-e167-4a21-881d-1479b42314db could not be found. Oct 04 19:04:41.378494 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:04:41.378494 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:04:41.378494 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:04:41.378494 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:04:41.378494 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:04:41.385724 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:04:41.385724 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:04:41.385724 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:04:41.385724 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5756da0-e167-4a21-881d-1479b42314db could not be found. Oct 04 19:04:41.385724 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:04:41.388804 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-0d2e2be5-99ae-4a51-a366-26da8f9b6089 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Returning 404 to user: Instance f5756da0-e167-4a21-881d-1479b42314db could not be found. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:04:41.390500 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-0d2e2be5-99ae-4a51-a366-26da8f9b6089 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "GET /compute/v2.1/servers/f5756da0-e167-4a21-881d-1479b42314db" status: 404 len: 111 microversion: 2.1 time: 0.032374 Oct 04 19:04:41.394833 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3116/5865] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:41 2022] GET /compute/v2.1/servers/f5756da0-e167-4a21-881d-1479b42314db => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:04:41.657591 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-e73b8fbb-cf3e-46a5-900f-6148887949c1 tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:41.658745 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-e73b8fbb-cf3e-46a5-900f-6148887949c1 tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] [instance: d29d308f-2367-4ae7-a65b-3730767427d1] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:41.669183 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e73b8fbb-cf3e-46a5-900f-6148887949c1 tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:41.669977 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e73b8fbb-cf3e-46a5-900f-6148887949c1 tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:41.670423 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e73b8fbb-cf3e-46a5-900f-6148887949c1 tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:41.673670 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e73b8fbb-cf3e-46a5-900f-6148887949c1 tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:41.674392 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e73b8fbb-cf3e-46a5-900f-6148887949c1 tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:41.675097 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e73b8fbb-cf3e-46a5-900f-6148887949c1 tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:41.842781 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-e73b8fbb-cf3e-46a5-900f-6148887949c1 tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef59c846e8342bf9147c621c7c4cc47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c580523ce14c06a66a72339c18e9a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:41.852700 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-e73b8fbb-cf3e-46a5-900f-6148887949c1 tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] 10.222.0.43 "GET /compute/v2.1/servers/d29d308f-2367-4ae7-a65b-3730767427d1" status: 200 len: 1327 microversion: 2.1 time: 0.200611 Oct 04 19:04:41.853655 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2750/5866] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:41 2022] GET /compute/v2.1/servers/d29d308f-2367-4ae7-a65b-3730767427d1 => generated 1327 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:04:42.878086 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-30fd32da-38ab-4d3a-b744-200ebb7fedb4 tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:42.878819 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-30fd32da-38ab-4d3a-b744-200ebb7fedb4 tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] [instance: d29d308f-2367-4ae7-a65b-3730767427d1] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:42.903798 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-30fd32da-38ab-4d3a-b744-200ebb7fedb4 tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:42.904605 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-30fd32da-38ab-4d3a-b744-200ebb7fedb4 tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:42.905079 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-30fd32da-38ab-4d3a-b744-200ebb7fedb4 tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:42.905873 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-30fd32da-38ab-4d3a-b744-200ebb7fedb4 tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:42.906772 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-30fd32da-38ab-4d3a-b744-200ebb7fedb4 tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:42.907406 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-30fd32da-38ab-4d3a-b744-200ebb7fedb4 tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:43.168833 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-bd371d0b-2671-4d99-b26f-4584bf814bbe req-7b16a51a-b5cd-4c9d-9447-3049f159755f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d29d308f-2367-4ae7-a65b-3730767427d1", "name": "network-vif-plugged", "status": "completed", "tag": "b42a19c5-83fc-464f-837b-f94ecd10dbad"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:04:43.211767 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-bd371d0b-2671-4d99-b26f-4584bf814bbe req-7b16a51a-b5cd-4c9d-9447-3049f159755f service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:43.212264 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-bd371d0b-2671-4d99-b26f-4584bf814bbe req-7b16a51a-b5cd-4c9d-9447-3049f159755f service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:43.214122 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-bd371d0b-2671-4d99-b26f-4584bf814bbe req-7b16a51a-b5cd-4c9d-9447-3049f159755f service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:43.242473 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-bd371d0b-2671-4d99-b26f-4584bf814bbe req-7b16a51a-b5cd-4c9d-9447-3049f159755f service nova] Creating event network-vif-plugged:b42a19c5-83fc-464f-837b-f94ecd10dbad for instance d29d308f-2367-4ae7-a65b-3730767427d1 on n-h1-851028-13 Oct 04 19:04:43.254086 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-bd371d0b-2671-4d99-b26f-4584bf814bbe req-7b16a51a-b5cd-4c9d-9447-3049f159755f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090805 Oct 04 19:04:43.258237 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2751/5867] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:04:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:04:43.335084 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-30fd32da-38ab-4d3a-b744-200ebb7fedb4 tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef59c846e8342bf9147c621c7c4cc47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c580523ce14c06a66a72339c18e9a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:43.345578 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-30fd32da-38ab-4d3a-b744-200ebb7fedb4 tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] 10.222.0.43 "GET /compute/v2.1/servers/d29d308f-2367-4ae7-a65b-3730767427d1" status: 200 len: 1327 microversion: 2.1 time: 0.473775 Oct 04 19:04:43.354666 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3117/5868] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:42 2022] GET /compute/v2.1/servers/d29d308f-2367-4ae7-a65b-3730767427d1 => generated 1327 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:04:44.377991 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-6e39fe8f-07e5-416f-9c8c-0b733fa5762d tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:44.378714 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-6e39fe8f-07e5-416f-9c8c-0b733fa5762d tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] [instance: d29d308f-2367-4ae7-a65b-3730767427d1] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:44.395682 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6e39fe8f-07e5-416f-9c8c-0b733fa5762d tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:44.396249 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6e39fe8f-07e5-416f-9c8c-0b733fa5762d tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:44.396857 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6e39fe8f-07e5-416f-9c8c-0b733fa5762d tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:44.398368 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6e39fe8f-07e5-416f-9c8c-0b733fa5762d tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:44.398836 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6e39fe8f-07e5-416f-9c8c-0b733fa5762d tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:44.399331 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6e39fe8f-07e5-416f-9c8c-0b733fa5762d tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:44.671723 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-6e39fe8f-07e5-416f-9c8c-0b733fa5762d tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef59c846e8342bf9147c621c7c4cc47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c580523ce14c06a66a72339c18e9a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:44.694617 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-6e39fe8f-07e5-416f-9c8c-0b733fa5762d tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] 10.222.0.43 "GET /compute/v2.1/servers/d29d308f-2367-4ae7-a65b-3730767427d1" status: 200 len: 1327 microversion: 2.1 time: 0.320441 Oct 04 19:04:44.705863 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2752/5869] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:44 2022] GET /compute/v2.1/servers/d29d308f-2367-4ae7-a65b-3730767427d1 => generated 1327 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:04:45.719190 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-3f15813d-2a5c-4b12-b239-a920fb4b670c tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:45.719854 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-3f15813d-2a5c-4b12-b239-a920fb4b670c tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] [instance: d29d308f-2367-4ae7-a65b-3730767427d1] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:45.732531 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3f15813d-2a5c-4b12-b239-a920fb4b670c tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:45.733471 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3f15813d-2a5c-4b12-b239-a920fb4b670c tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:45.733932 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3f15813d-2a5c-4b12-b239-a920fb4b670c tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:45.734706 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3f15813d-2a5c-4b12-b239-a920fb4b670c tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:45.735309 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3f15813d-2a5c-4b12-b239-a920fb4b670c tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:45.735850 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3f15813d-2a5c-4b12-b239-a920fb4b670c tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:46.099415 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-3f15813d-2a5c-4b12-b239-a920fb4b670c tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef59c846e8342bf9147c621c7c4cc47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c580523ce14c06a66a72339c18e9a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:46.112114 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-3f15813d-2a5c-4b12-b239-a920fb4b670c tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] 10.222.0.43 "GET /compute/v2.1/servers/d29d308f-2367-4ae7-a65b-3730767427d1" status: 200 len: 1526 microversion: 2.1 time: 0.396724 Oct 04 19:04:46.112764 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3118/5870] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:45 2022] GET /compute/v2.1/servers/d29d308f-2367-4ae7-a65b-3730767427d1 => generated 1526 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:04:46.141018 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-20f5e492-b2d5-4394-9413-bd042cd8496b tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:46.141844 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-20f5e492-b2d5-4394-9413-bd042cd8496b tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] [instance: d29d308f-2367-4ae7-a65b-3730767427d1] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:46.150538 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-20f5e492-b2d5-4394-9413-bd042cd8496b tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:46.151402 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-20f5e492-b2d5-4394-9413-bd042cd8496b tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:46.153139 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-20f5e492-b2d5-4394-9413-bd042cd8496b tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:46.154337 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-20f5e492-b2d5-4394-9413-bd042cd8496b tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:46.155179 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-20f5e492-b2d5-4394-9413-bd042cd8496b tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:46.156630 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-20f5e492-b2d5-4394-9413-bd042cd8496b tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:46.424751 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-20f5e492-b2d5-4394-9413-bd042cd8496b tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef59c846e8342bf9147c621c7c4cc47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c580523ce14c06a66a72339c18e9a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:46.434452 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-20f5e492-b2d5-4394-9413-bd042cd8496b tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] 10.222.0.43 "GET /compute/v2.1/servers/d29d308f-2367-4ae7-a65b-3730767427d1" status: 200 len: 1526 microversion: 2.1 time: 0.298176 Oct 04 19:04:46.454455 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2753/5871] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:46 2022] GET /compute/v2.1/servers/d29d308f-2367-4ae7-a65b-3730767427d1 => generated 1526 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:04:46.542362 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-3755cdac-4e73-4a65-9b95-28414fd1ce75 tempest-ServersNegativeTestMultiTenantJSON-1092411508 tempest-ServersNegativeTestMultiTenantJSON-1092411508-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:46.542697 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-3755cdac-4e73-4a65-9b95-28414fd1ce75 tempest-ServersNegativeTestMultiTenantJSON-1092411508 tempest-ServersNegativeTestMultiTenantJSON-1092411508-project] [instance: d29d308f-2367-4ae7-a65b-3730767427d1] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:46.555387 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3755cdac-4e73-4a65-9b95-28414fd1ce75 tempest-ServersNegativeTestMultiTenantJSON-1092411508 tempest-ServersNegativeTestMultiTenantJSON-1092411508-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:46.555978 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3755cdac-4e73-4a65-9b95-28414fd1ce75 tempest-ServersNegativeTestMultiTenantJSON-1092411508 tempest-ServersNegativeTestMultiTenantJSON-1092411508-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:46.560412 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3755cdac-4e73-4a65-9b95-28414fd1ce75 tempest-ServersNegativeTestMultiTenantJSON-1092411508 tempest-ServersNegativeTestMultiTenantJSON-1092411508-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:46.561972 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3755cdac-4e73-4a65-9b95-28414fd1ce75 tempest-ServersNegativeTestMultiTenantJSON-1092411508 tempest-ServersNegativeTestMultiTenantJSON-1092411508-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:46.562804 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3755cdac-4e73-4a65-9b95-28414fd1ce75 tempest-ServersNegativeTestMultiTenantJSON-1092411508 tempest-ServersNegativeTestMultiTenantJSON-1092411508-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:46.563404 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3755cdac-4e73-4a65-9b95-28414fd1ce75 tempest-ServersNegativeTestMultiTenantJSON-1092411508 tempest-ServersNegativeTestMultiTenantJSON-1092411508-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:46.602301 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-3755cdac-4e73-4a65-9b95-28414fd1ce75 tempest-ServersNegativeTestMultiTenantJSON-1092411508 tempest-ServersNegativeTestMultiTenantJSON-1092411508-project] HTTP exception thrown: Instance d29d308f-2367-4ae7-a65b-3730767427d1 could not be found. Oct 04 19:04:46.603917 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-3755cdac-4e73-4a65-9b95-28414fd1ce75 tempest-ServersNegativeTestMultiTenantJSON-1092411508 tempest-ServersNegativeTestMultiTenantJSON-1092411508-project] Request method failure captured: Oct 04 19:04:46.603917 n-d-851028-13 devstack@n-api.service[123596]: request: DELETE /compute/v2.1/servers/d29d308f-2367-4ae7-a65b-3730767427d1 HTTP/1.1 Oct 04 19:04:46.603917 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 19:04:46.603917 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 19:04:46.603917 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 19:04:46.603917 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 19:04:46.603917 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 19:04:46.603917 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 19:04:46.603917 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 19:04:46.603917 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 19:04:46.603917 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPIO7AHcfnx8BtU0y4SDR8ys1CoM_0hqlEFLa2s8-Yk7e2eZYevnnkmtnzPuSKDwIq2x35Mdms3hebV_uQ-ZDZ9wKgm_Hysf0Ofyt5QlTRO56ziWzxerDWCEP6oMvdeeyHmEQoT6EATadrO2ZpkhgUvqcmxC3223ajbbkyVeoKf5tWTA Oct 04 19:04:46.603917 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 19:04:46.603917 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 19:04:46.603917 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 19:04:46.603917 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 19:04:46.603917 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 19:04:46.603917 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 19:04:46.603917 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: a211806f60894fad90f28b2fea72d8d2 Oct 04 19:04:46.603917 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1092411508 Oct 04 19:04:46.603917 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 19:04:46.603917 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 19:04:46.603917 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/a211806f60894fad90f28b2fea72d8d2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_a211806f60894fad90f28b2fea72d8d2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a211806f60894fad90f28b2fea72d8d2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a211806f60894fad90f28b2fea72d8d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 19:04:46.603917 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1092411508 Oct 04 19:04:46.603917 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: a211806f60894fad90f28b2fea72d8d2 Oct 04 19:04:46.603917 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1092411508 Oct 04 19:04:46.603917 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1092411508-project Oct 04 19:04:46.603917 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 19:04:46.603917 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 19:04:46.603917 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 174bd1bd56244b1c86340eef4698a5f3 Oct 04 19:04:46.603917 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1092411508-project Oct 04 19:04:46.603917 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 19:04:46.603917 n-d-851028-13 devstack@n-api.service[123596]: exception: Instance d29d308f-2367-4ae7-a65b-3730767427d1 could not be found. Oct 04 19:04:46.603917 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': 'd29d308f-2367-4ae7-a65b-3730767427d1'} Oct 04 19:04:46.603917 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:04:46.603917 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:04:46.603917 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:04:46.603917 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:04:46.603917 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:04:46.603917 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:04:46.603917 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:04:46.603917 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:04:46.603917 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:04:46.603917 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:04:46.603917 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d29d308f-2367-4ae7-a65b-3730767427d1 could not be found. Oct 04 19:04:46.603917 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:04:46.603917 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:04:46.603917 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:04:46.603917 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:04:46.603917 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:04:46.603917 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:04:46.603917 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:04:46.603917 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:04:46.603917 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:04:46.603917 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:04:46.603917 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 19:04:46.603917 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 19:04:46.603917 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 19:04:46.603917 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 19:04:46.603917 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:04:46.603917 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:04:46.603917 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:04:46.603917 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:04:46.609466 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d29d308f-2367-4ae7-a65b-3730767427d1 could not be found. Oct 04 19:04:46.609466 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:04:46.609466 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:04:46.609466 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:04:46.609466 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:04:46.609466 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:04:46.609466 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:04:46.609466 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:04:46.609466 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:04:46.609466 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d29d308f-2367-4ae7-a65b-3730767427d1 could not be found. Oct 04 19:04:46.609466 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:04:46.609466 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-3755cdac-4e73-4a65-9b95-28414fd1ce75 tempest-ServersNegativeTestMultiTenantJSON-1092411508 tempest-ServersNegativeTestMultiTenantJSON-1092411508-project] Returning 404 to user: Instance d29d308f-2367-4ae7-a65b-3730767427d1 could not be found. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:04:46.609466 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-3755cdac-4e73-4a65-9b95-28414fd1ce75 tempest-ServersNegativeTestMultiTenantJSON-1092411508 tempest-ServersNegativeTestMultiTenantJSON-1092411508-project] 10.222.0.43 "DELETE /compute/v2.1/servers/d29d308f-2367-4ae7-a65b-3730767427d1" status: 404 len: 111 microversion: 2.1 time: 0.152030 Oct 04 19:04:46.616207 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-2303b4ae-e4f0-49dc-9583-a7519bc0d0e5 tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:46.616843 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-2303b4ae-e4f0-49dc-9583-a7519bc0d0e5 tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] [instance: d29d308f-2367-4ae7-a65b-3730767427d1] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:46.621677 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3119/5872] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 19:04:46 2022] DELETE /compute/v2.1/servers/d29d308f-2367-4ae7-a65b-3730767427d1 => generated 111 bytes in 169 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 19:04:46.630816 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2303b4ae-e4f0-49dc-9583-a7519bc0d0e5 tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:46.631918 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2303b4ae-e4f0-49dc-9583-a7519bc0d0e5 tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:46.632378 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2303b4ae-e4f0-49dc-9583-a7519bc0d0e5 tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:46.634340 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2303b4ae-e4f0-49dc-9583-a7519bc0d0e5 tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:46.635146 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2303b4ae-e4f0-49dc-9583-a7519bc0d0e5 tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:46.638316 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2303b4ae-e4f0-49dc-9583-a7519bc0d0e5 tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:46.832069 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-2303b4ae-e4f0-49dc-9583-a7519bc0d0e5 tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef59c846e8342bf9147c621c7c4cc47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c580523ce14c06a66a72339c18e9a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:46.842699 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-2303b4ae-e4f0-49dc-9583-a7519bc0d0e5 tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] 10.222.0.43 "GET /compute/v2.1/servers/d29d308f-2367-4ae7-a65b-3730767427d1" status: 200 len: 1526 microversion: 2.1 time: 0.231310 Oct 04 19:04:46.843668 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2754/5873] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:46 2022] GET /compute/v2.1/servers/d29d308f-2367-4ae7-a65b-3730767427d1 => generated 1526 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:04:46.898015 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f8d3532d-1d17-4411-b71e-4a5943a29224 tempest-ServersNegativeTestMultiTenantJSON-1092411508 tempest-ServersNegativeTestMultiTenantJSON-1092411508-project] Action: 'update', calling method: >, body: {"server": {"name": "d29d308f-2367-4ae7-a65b-3730767427d1_new"}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:04:46.901560 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-f8d3532d-1d17-4411-b71e-4a5943a29224 tempest-ServersNegativeTestMultiTenantJSON-1092411508 tempest-ServersNegativeTestMultiTenantJSON-1092411508-project] [instance: d29d308f-2367-4ae7-a65b-3730767427d1] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:46.929540 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f8d3532d-1d17-4411-b71e-4a5943a29224 tempest-ServersNegativeTestMultiTenantJSON-1092411508 tempest-ServersNegativeTestMultiTenantJSON-1092411508-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:46.930042 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f8d3532d-1d17-4411-b71e-4a5943a29224 tempest-ServersNegativeTestMultiTenantJSON-1092411508 tempest-ServersNegativeTestMultiTenantJSON-1092411508-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:46.930780 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f8d3532d-1d17-4411-b71e-4a5943a29224 tempest-ServersNegativeTestMultiTenantJSON-1092411508 tempest-ServersNegativeTestMultiTenantJSON-1092411508-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:46.931505 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f8d3532d-1d17-4411-b71e-4a5943a29224 tempest-ServersNegativeTestMultiTenantJSON-1092411508 tempest-ServersNegativeTestMultiTenantJSON-1092411508-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:46.932033 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f8d3532d-1d17-4411-b71e-4a5943a29224 tempest-ServersNegativeTestMultiTenantJSON-1092411508 tempest-ServersNegativeTestMultiTenantJSON-1092411508-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:46.932469 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f8d3532d-1d17-4411-b71e-4a5943a29224 tempest-ServersNegativeTestMultiTenantJSON-1092411508 tempest-ServersNegativeTestMultiTenantJSON-1092411508-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:46.963663 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-f8d3532d-1d17-4411-b71e-4a5943a29224 tempest-ServersNegativeTestMultiTenantJSON-1092411508 tempest-ServersNegativeTestMultiTenantJSON-1092411508-project] HTTP exception thrown: Instance d29d308f-2367-4ae7-a65b-3730767427d1 could not be found. Oct 04 19:04:46.965514 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f8d3532d-1d17-4411-b71e-4a5943a29224 tempest-ServersNegativeTestMultiTenantJSON-1092411508 tempest-ServersNegativeTestMultiTenantJSON-1092411508-project] Request method failure captured: Oct 04 19:04:46.965514 n-d-851028-13 devstack@n-api.service[123596]: request: PUT /compute/v2.1/servers/d29d308f-2367-4ae7-a65b-3730767427d1 HTTP/1.1 Oct 04 19:04:46.965514 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 19:04:46.965514 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 19:04:46.965514 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 19:04:46.965514 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 64 Oct 04 19:04:46.965514 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 19:04:46.965514 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 19:04:46.965514 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 19:04:46.965514 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 19:04:46.965514 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPIO7AHcfnx8BtU0y4SDR8ys1CoM_0hqlEFLa2s8-Yk7e2eZYevnnkmtnzPuSKDwIq2x35Mdms3hebV_uQ-ZDZ9wKgm_Hysf0Ofyt5QlTRO56ziWzxerDWCEP6oMvdeeyHmEQoT6EATadrO2ZpkhgUvqcmxC3223ajbbkyVeoKf5tWTA Oct 04 19:04:46.965514 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 19:04:46.965514 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 19:04:46.965514 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 19:04:46.965514 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 19:04:46.965514 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 19:04:46.965514 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 19:04:46.965514 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: a211806f60894fad90f28b2fea72d8d2 Oct 04 19:04:46.965514 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1092411508 Oct 04 19:04:46.965514 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 19:04:46.965514 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 19:04:46.965514 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/a211806f60894fad90f28b2fea72d8d2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_a211806f60894fad90f28b2fea72d8d2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a211806f60894fad90f28b2fea72d8d2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a211806f60894fad90f28b2fea72d8d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 19:04:46.965514 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1092411508 Oct 04 19:04:46.965514 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: a211806f60894fad90f28b2fea72d8d2 Oct 04 19:04:46.965514 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1092411508 Oct 04 19:04:46.965514 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1092411508-project Oct 04 19:04:46.965514 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 19:04:46.965514 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 19:04:46.965514 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 174bd1bd56244b1c86340eef4698a5f3 Oct 04 19:04:46.965514 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1092411508-project Oct 04 19:04:46.965514 n-d-851028-13 devstack@n-api.service[123596]: Oct 04 19:04:46.965514 n-d-851028-13 devstack@n-api.service[123596]: {"server": {"name": "d29d308f-2367-4ae7-a65b-3730767427d1_new"}} Oct 04 19:04:46.965514 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 19:04:46.965514 n-d-851028-13 devstack@n-api.service[123596]: exception: Instance d29d308f-2367-4ae7-a65b-3730767427d1 could not be found. Oct 04 19:04:46.965514 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': 'd29d308f-2367-4ae7-a65b-3730767427d1', 'body': {'server': {'name': 'd29d308f-2367-4ae7-a65b-3730767427d1_new'}}} Oct 04 19:04:46.965514 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:04:46.965514 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:04:46.965514 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:04:46.965514 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:04:46.965514 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:04:46.965514 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:04:46.965514 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:04:46.965514 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:04:46.965514 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:04:46.965514 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:04:46.965514 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d29d308f-2367-4ae7-a65b-3730767427d1 could not be found. Oct 04 19:04:46.965514 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:04:46.965514 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:04:46.965514 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:04:46.965514 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:04:46.965514 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:04:46.965514 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:04:46.965514 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:04:46.965514 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:04:46.965514 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:04:46.965514 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:04:46.965514 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 19:04:46.965514 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 19:04:46.965514 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 19:04:46.965514 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 19:04:46.965514 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 19:04:46.965514 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 19:04:46.965514 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 04 19:04:46.970116 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Oct 04 19:04:46.970116 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Oct 04 19:04:46.970116 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:04:46.970116 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:04:46.970116 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:04:46.970116 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:04:46.970116 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d29d308f-2367-4ae7-a65b-3730767427d1 could not be found. Oct 04 19:04:46.970116 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:04:46.970116 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:04:46.970116 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:04:46.970116 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:04:46.970116 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:04:46.970116 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:04:46.970116 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:04:46.970116 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:04:46.970116 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d29d308f-2367-4ae7-a65b-3730767427d1 could not be found. Oct 04 19:04:46.970116 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:04:46.977858 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f8d3532d-1d17-4411-b71e-4a5943a29224 tempest-ServersNegativeTestMultiTenantJSON-1092411508 tempest-ServersNegativeTestMultiTenantJSON-1092411508-project] Returning 404 to user: Instance d29d308f-2367-4ae7-a65b-3730767427d1 could not be found. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:04:46.982721 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-f8d3532d-1d17-4411-b71e-4a5943a29224 tempest-ServersNegativeTestMultiTenantJSON-1092411508 tempest-ServersNegativeTestMultiTenantJSON-1092411508-project] 10.222.0.43 "PUT /compute/v2.1/servers/d29d308f-2367-4ae7-a65b-3730767427d1" status: 404 len: 111 microversion: 2.1 time: 0.117533 Oct 04 19:04:46.984106 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3120/5874] 10.222.0.43 () {60 vars in 1256 bytes} [Tue Oct 4 19:04:46 2022] PUT /compute/v2.1/servers/d29d308f-2367-4ae7-a65b-3730767427d1 => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:04:46.995816 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-cf1588a8-9c39-446e-8898-789f7e53cff9 tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:46.996453 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-cf1588a8-9c39-446e-8898-789f7e53cff9 tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] [instance: d29d308f-2367-4ae7-a65b-3730767427d1] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:47.004231 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cf1588a8-9c39-446e-8898-789f7e53cff9 tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:47.004994 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cf1588a8-9c39-446e-8898-789f7e53cff9 tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:47.005746 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cf1588a8-9c39-446e-8898-789f7e53cff9 tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:47.006771 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cf1588a8-9c39-446e-8898-789f7e53cff9 tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:47.007537 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cf1588a8-9c39-446e-8898-789f7e53cff9 tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:47.008227 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cf1588a8-9c39-446e-8898-789f7e53cff9 tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:47.051223 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-cf1588a8-9c39-446e-8898-789f7e53cff9 tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] [instance: d29d308f-2367-4ae7-a65b-3730767427d1] Going to try to terminate instance {{(pid=123595) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 19:04:47.093557 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-6d2c5922-d283-451a-9ee4-922f1c154a06 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:47.094303 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-6d2c5922-d283-451a-9ee4-922f1c154a06 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: ff2c3740-6c13-4727-bd7f-ef56bba605de] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:47.103183 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6d2c5922-d283-451a-9ee4-922f1c154a06 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:47.104006 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6d2c5922-d283-451a-9ee4-922f1c154a06 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:47.104835 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6d2c5922-d283-451a-9ee4-922f1c154a06 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:47.105885 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6d2c5922-d283-451a-9ee4-922f1c154a06 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:47.106515 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6d2c5922-d283-451a-9ee4-922f1c154a06 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:47.107132 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6d2c5922-d283-451a-9ee4-922f1c154a06 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:47.125501 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-6d2c5922-d283-451a-9ee4-922f1c154a06 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] HTTP exception thrown: Instance ff2c3740-6c13-4727-bd7f-ef56bba605de could not be found. Oct 04 19:04:47.127358 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-6d2c5922-d283-451a-9ee4-922f1c154a06 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Request method failure captured: Oct 04 19:04:47.127358 n-d-851028-13 devstack@n-api.service[123596]: request: DELETE /compute/v2.1/servers/ff2c3740-6c13-4727-bd7f-ef56bba605de HTTP/1.1 Oct 04 19:04:47.127358 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 19:04:47.127358 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 19:04:47.127358 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 19:04:47.127358 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 19:04:47.127358 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 19:04:47.127358 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 19:04:47.127358 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 19:04:47.127358 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 19:04:47.127358 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPIKl7r6ZFtp0u4zXtNLGIhqHo70GyUJnklFY8mLM6SAvqzMqMYlk7FNNMFRu1dxhVJoaHCY-KymtUU7SbzcnaY3gmI4NmuaRKJjk_WfnM3eNlWdo1XIjmy2xIfTxketrHpoedtH-76PD0N1ebOmJq-sWqhFc1j62MJ2QKuwEgYmouJ4 Oct 04 19:04:47.127358 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 19:04:47.127358 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 19:04:47.127358 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 19:04:47.127358 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 19:04:47.127358 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 19:04:47.127358 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 19:04:47.127358 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: a6a711601b7a439caf395233de1febff Oct 04 19:04:47.127358 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-DeleteServersTestJSON-591734195 Oct 04 19:04:47.127358 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 19:04:47.127358 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 19:04:47.127358 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/a6a711601b7a439caf395233de1febff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_a6a711601b7a439caf395233de1febff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a6a711601b7a439caf395233de1febff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a6a711601b7a439caf395233de1febff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 19:04:47.127358 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-DeleteServersTestJSON-591734195 Oct 04 19:04:47.127358 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: a6a711601b7a439caf395233de1febff Oct 04 19:04:47.127358 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-DeleteServersTestJSON-591734195 Oct 04 19:04:47.127358 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-DeleteServersTestJSON-591734195-project Oct 04 19:04:47.127358 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 19:04:47.127358 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 19:04:47.127358 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: c997bc60473b43fd9fcf0c65111c44c0 Oct 04 19:04:47.127358 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-DeleteServersTestJSON-591734195-project Oct 04 19:04:47.127358 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 19:04:47.127358 n-d-851028-13 devstack@n-api.service[123596]: exception: Instance ff2c3740-6c13-4727-bd7f-ef56bba605de could not be found. Oct 04 19:04:47.127358 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': 'ff2c3740-6c13-4727-bd7f-ef56bba605de'} Oct 04 19:04:47.127358 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:04:47.127358 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:04:47.127358 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:04:47.127358 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:04:47.127358 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:04:47.127358 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:04:47.127358 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:04:47.127358 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:04:47.127358 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:04:47.127358 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:04:47.127358 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff2c3740-6c13-4727-bd7f-ef56bba605de could not be found. Oct 04 19:04:47.127358 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:04:47.127358 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:04:47.127358 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:04:47.127358 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:04:47.127358 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:04:47.127358 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:04:47.127358 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:04:47.127358 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:04:47.127358 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:04:47.127358 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:04:47.127358 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 19:04:47.127358 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 19:04:47.127358 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 19:04:47.127358 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 19:04:47.127358 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:04:47.127358 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:04:47.127358 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:04:47.127358 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:04:47.131963 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff2c3740-6c13-4727-bd7f-ef56bba605de could not be found. Oct 04 19:04:47.131963 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:04:47.131963 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:04:47.131963 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:04:47.131963 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:04:47.131963 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:04:47.131963 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:04:47.131963 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:04:47.131963 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:04:47.131963 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff2c3740-6c13-4727-bd7f-ef56bba605de could not be found. Oct 04 19:04:47.131963 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:04:47.134005 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-6d2c5922-d283-451a-9ee4-922f1c154a06 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Returning 404 to user: Instance ff2c3740-6c13-4727-bd7f-ef56bba605de could not be found. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:04:47.135102 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-6d2c5922-d283-451a-9ee4-922f1c154a06 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "DELETE /compute/v2.1/servers/ff2c3740-6c13-4727-bd7f-ef56bba605de" status: 404 len: 111 microversion: 2.1 time: 0.045702 Oct 04 19:04:47.139494 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3121/5875] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 19:04:47 2022] DELETE /compute/v2.1/servers/ff2c3740-6c13-4727-bd7f-ef56bba605de => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 19:04:47.146631 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-3a23bda1-f3d0-440a-910c-27563387475a tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:47.148026 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-3a23bda1-f3d0-440a-910c-27563387475a tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: ff2c3740-6c13-4727-bd7f-ef56bba605de] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:47.154936 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3a23bda1-f3d0-440a-910c-27563387475a tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:47.155725 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3a23bda1-f3d0-440a-910c-27563387475a tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:47.156428 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3a23bda1-f3d0-440a-910c-27563387475a tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:47.157349 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3a23bda1-f3d0-440a-910c-27563387475a tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:47.157983 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3a23bda1-f3d0-440a-910c-27563387475a tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:47.158614 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3a23bda1-f3d0-440a-910c-27563387475a tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:47.180065 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-3a23bda1-f3d0-440a-910c-27563387475a tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] HTTP exception thrown: Instance ff2c3740-6c13-4727-bd7f-ef56bba605de could not be found. Oct 04 19:04:47.181670 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-3a23bda1-f3d0-440a-910c-27563387475a tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Request method failure captured: Oct 04 19:04:47.181670 n-d-851028-13 devstack@n-api.service[123596]: request: GET /compute/v2.1/servers/ff2c3740-6c13-4727-bd7f-ef56bba605de HTTP/1.1 Oct 04 19:04:47.181670 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 19:04:47.181670 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 19:04:47.181670 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 19:04:47.181670 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 19:04:47.181670 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 19:04:47.181670 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 19:04:47.181670 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 19:04:47.181670 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 19:04:47.181670 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPIKl7r6ZFtp0u4zXtNLGIhqHo70GyUJnklFY8mLM6SAvqzMqMYlk7FNNMFRu1dxhVJoaHCY-KymtUU7SbzcnaY3gmI4NmuaRKJjk_WfnM3eNlWdo1XIjmy2xIfTxketrHpoedtH-76PD0N1ebOmJq-sWqhFc1j62MJ2QKuwEgYmouJ4 Oct 04 19:04:47.181670 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 19:04:47.181670 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 19:04:47.181670 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 19:04:47.181670 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 19:04:47.181670 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 19:04:47.181670 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 19:04:47.181670 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: a6a711601b7a439caf395233de1febff Oct 04 19:04:47.181670 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-DeleteServersTestJSON-591734195 Oct 04 19:04:47.181670 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 19:04:47.181670 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 19:04:47.181670 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/a6a711601b7a439caf395233de1febff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_a6a711601b7a439caf395233de1febff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a6a711601b7a439caf395233de1febff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a6a711601b7a439caf395233de1febff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 19:04:47.181670 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-DeleteServersTestJSON-591734195 Oct 04 19:04:47.181670 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: a6a711601b7a439caf395233de1febff Oct 04 19:04:47.181670 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-DeleteServersTestJSON-591734195 Oct 04 19:04:47.181670 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-DeleteServersTestJSON-591734195-project Oct 04 19:04:47.181670 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 19:04:47.181670 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 19:04:47.181670 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: c997bc60473b43fd9fcf0c65111c44c0 Oct 04 19:04:47.181670 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-DeleteServersTestJSON-591734195-project Oct 04 19:04:47.181670 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 19:04:47.181670 n-d-851028-13 devstack@n-api.service[123596]: exception: Instance ff2c3740-6c13-4727-bd7f-ef56bba605de could not be found. Oct 04 19:04:47.181670 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': 'ff2c3740-6c13-4727-bd7f-ef56bba605de'} Oct 04 19:04:47.181670 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:04:47.181670 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:04:47.181670 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:04:47.181670 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:04:47.181670 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:04:47.181670 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:04:47.181670 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:04:47.181670 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:04:47.181670 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:04:47.181670 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:04:47.181670 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff2c3740-6c13-4727-bd7f-ef56bba605de could not be found. Oct 04 19:04:47.181670 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:04:47.181670 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:04:47.181670 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:04:47.181670 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:04:47.181670 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:04:47.181670 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:04:47.181670 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:04:47.181670 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:04:47.181670 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:04:47.181670 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:04:47.181670 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:04:47.181670 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:04:47.181670 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:04:47.181670 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:04:47.181670 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:04:47.181670 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:04:47.181670 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff2c3740-6c13-4727-bd7f-ef56bba605de could not be found. Oct 04 19:04:47.181670 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:04:47.181670 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:04:47.181670 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:04:47.187072 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:04:47.187072 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:04:47.187072 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:04:47.187072 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:04:47.187072 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:04:47.187072 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff2c3740-6c13-4727-bd7f-ef56bba605de could not be found. Oct 04 19:04:47.187072 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:04:47.188829 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-cf1588a8-9c39-446e-8898-789f7e53cff9 tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] 10.222.0.43 "DELETE /compute/v2.1/servers/d29d308f-2367-4ae7-a65b-3730767427d1" status: 204 len: 0 microversion: 2.1 time: 0.192845 Oct 04 19:04:47.188829 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2755/5876] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 19:04:46 2022] DELETE /compute/v2.1/servers/d29d308f-2367-4ae7-a65b-3730767427d1 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:04:47.190812 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-3a23bda1-f3d0-440a-910c-27563387475a tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Returning 404 to user: Instance ff2c3740-6c13-4727-bd7f-ef56bba605de could not be found. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:04:47.192241 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-3a23bda1-f3d0-440a-910c-27563387475a tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "GET /compute/v2.1/servers/ff2c3740-6c13-4727-bd7f-ef56bba605de" status: 404 len: 111 microversion: 2.1 time: 0.050896 Oct 04 19:04:47.193489 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3122/5877] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:47 2022] GET /compute/v2.1/servers/ff2c3740-6c13-4727-bd7f-ef56bba605de => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:04:47.196996 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-367d5f48-1419-4c46-9582-d92f2b11a11f tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:47.198067 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-367d5f48-1419-4c46-9582-d92f2b11a11f tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] [instance: d29d308f-2367-4ae7-a65b-3730767427d1] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:47.208392 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-367d5f48-1419-4c46-9582-d92f2b11a11f tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:47.209039 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-367d5f48-1419-4c46-9582-d92f2b11a11f tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:47.210186 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-367d5f48-1419-4c46-9582-d92f2b11a11f tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:47.210879 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-0a293aaf-6037-4635-afdb-53878f5b7229 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:47.211715 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-0a293aaf-6037-4635-afdb-53878f5b7229 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: 37f52fe0-438c-41f3-9142-8c171e80385d] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:47.212479 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-367d5f48-1419-4c46-9582-d92f2b11a11f tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:47.212969 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-367d5f48-1419-4c46-9582-d92f2b11a11f tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:47.213438 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-367d5f48-1419-4c46-9582-d92f2b11a11f tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:47.220132 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0a293aaf-6037-4635-afdb-53878f5b7229 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:47.221049 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0a293aaf-6037-4635-afdb-53878f5b7229 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:47.221745 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0a293aaf-6037-4635-afdb-53878f5b7229 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:47.222686 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0a293aaf-6037-4635-afdb-53878f5b7229 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:47.223533 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0a293aaf-6037-4635-afdb-53878f5b7229 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:47.224180 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0a293aaf-6037-4635-afdb-53878f5b7229 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:47.260115 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-0a293aaf-6037-4635-afdb-53878f5b7229 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] HTTP exception thrown: Instance 37f52fe0-438c-41f3-9142-8c171e80385d could not be found. Oct 04 19:04:47.266247 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-0a293aaf-6037-4635-afdb-53878f5b7229 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Request method failure captured: Oct 04 19:04:47.266247 n-d-851028-13 devstack@n-api.service[123596]: request: DELETE /compute/v2.1/servers/37f52fe0-438c-41f3-9142-8c171e80385d HTTP/1.1 Oct 04 19:04:47.266247 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 19:04:47.266247 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 19:04:47.266247 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 19:04:47.266247 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 19:04:47.266247 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 19:04:47.266247 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 19:04:47.266247 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 19:04:47.266247 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 19:04:47.266247 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPIKl7r6ZFtp0u4zXtNLGIhqHo70GyUJnklFY8mLM6SAvqzMqMYlk7FNNMFRu1dxhVJoaHCY-KymtUU7SbzcnaY3gmI4NmuaRKJjk_WfnM3eNlWdo1XIjmy2xIfTxketrHpoedtH-76PD0N1ebOmJq-sWqhFc1j62MJ2QKuwEgYmouJ4 Oct 04 19:04:47.266247 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 19:04:47.266247 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 19:04:47.266247 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 19:04:47.266247 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 19:04:47.266247 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 19:04:47.266247 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 19:04:47.266247 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: a6a711601b7a439caf395233de1febff Oct 04 19:04:47.266247 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-DeleteServersTestJSON-591734195 Oct 04 19:04:47.266247 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 19:04:47.266247 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 19:04:47.266247 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/a6a711601b7a439caf395233de1febff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_a6a711601b7a439caf395233de1febff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a6a711601b7a439caf395233de1febff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a6a711601b7a439caf395233de1febff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 19:04:47.266247 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-DeleteServersTestJSON-591734195 Oct 04 19:04:47.266247 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: a6a711601b7a439caf395233de1febff Oct 04 19:04:47.266247 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-DeleteServersTestJSON-591734195 Oct 04 19:04:47.266247 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-DeleteServersTestJSON-591734195-project Oct 04 19:04:47.266247 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 19:04:47.266247 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 19:04:47.266247 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: c997bc60473b43fd9fcf0c65111c44c0 Oct 04 19:04:47.266247 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-DeleteServersTestJSON-591734195-project Oct 04 19:04:47.266247 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 19:04:47.266247 n-d-851028-13 devstack@n-api.service[123596]: exception: Instance 37f52fe0-438c-41f3-9142-8c171e80385d could not be found. Oct 04 19:04:47.266247 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': '37f52fe0-438c-41f3-9142-8c171e80385d'} Oct 04 19:04:47.266247 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:04:47.266247 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:04:47.266247 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:04:47.266247 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:04:47.266247 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:04:47.266247 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:04:47.266247 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:04:47.266247 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:04:47.266247 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:04:47.266247 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:04:47.266247 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37f52fe0-438c-41f3-9142-8c171e80385d could not be found. Oct 04 19:04:47.266247 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:04:47.266247 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:04:47.266247 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:04:47.266247 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:04:47.266247 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:04:47.266247 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:04:47.266247 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:04:47.266247 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:04:47.266247 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:04:47.266247 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:04:47.266247 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 19:04:47.266247 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 19:04:47.266247 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 19:04:47.266247 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 19:04:47.266247 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:04:47.266247 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:04:47.266247 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:04:47.266247 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:04:47.270649 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37f52fe0-438c-41f3-9142-8c171e80385d could not be found. Oct 04 19:04:47.270649 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:04:47.270649 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:04:47.270649 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:04:47.270649 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:04:47.270649 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:04:47.270649 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:04:47.270649 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:04:47.270649 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:04:47.270649 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37f52fe0-438c-41f3-9142-8c171e80385d could not be found. Oct 04 19:04:47.270649 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:04:47.278308 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-0a293aaf-6037-4635-afdb-53878f5b7229 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Returning 404 to user: Instance 37f52fe0-438c-41f3-9142-8c171e80385d could not be found. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:04:47.279403 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-0a293aaf-6037-4635-afdb-53878f5b7229 tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "DELETE /compute/v2.1/servers/37f52fe0-438c-41f3-9142-8c171e80385d" status: 404 len: 111 microversion: 2.1 time: 0.076959 Oct 04 19:04:47.283001 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3123/5878] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 19:04:47 2022] DELETE /compute/v2.1/servers/37f52fe0-438c-41f3-9142-8c171e80385d => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:04:47.293837 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-d1f3f695-c695-4076-b56e-dec19314273a tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:47.296601 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-d1f3f695-c695-4076-b56e-dec19314273a tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] [instance: 37f52fe0-438c-41f3-9142-8c171e80385d] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:47.323186 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d1f3f695-c695-4076-b56e-dec19314273a tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:47.327338 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d1f3f695-c695-4076-b56e-dec19314273a tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:47.328002 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d1f3f695-c695-4076-b56e-dec19314273a tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:47.333197 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d1f3f695-c695-4076-b56e-dec19314273a tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:47.333900 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d1f3f695-c695-4076-b56e-dec19314273a tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:47.336391 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d1f3f695-c695-4076-b56e-dec19314273a tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:47.381956 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-d1f3f695-c695-4076-b56e-dec19314273a tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] HTTP exception thrown: Instance 37f52fe0-438c-41f3-9142-8c171e80385d could not be found. Oct 04 19:04:47.383910 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-d1f3f695-c695-4076-b56e-dec19314273a tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Request method failure captured: Oct 04 19:04:47.383910 n-d-851028-13 devstack@n-api.service[123596]: request: GET /compute/v2.1/servers/37f52fe0-438c-41f3-9142-8c171e80385d HTTP/1.1 Oct 04 19:04:47.383910 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 19:04:47.383910 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 19:04:47.383910 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 19:04:47.383910 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 19:04:47.383910 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 19:04:47.383910 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 19:04:47.383910 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 19:04:47.383910 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 19:04:47.383910 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPIKl7r6ZFtp0u4zXtNLGIhqHo70GyUJnklFY8mLM6SAvqzMqMYlk7FNNMFRu1dxhVJoaHCY-KymtUU7SbzcnaY3gmI4NmuaRKJjk_WfnM3eNlWdo1XIjmy2xIfTxketrHpoedtH-76PD0N1ebOmJq-sWqhFc1j62MJ2QKuwEgYmouJ4 Oct 04 19:04:47.383910 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 19:04:47.383910 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 19:04:47.383910 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 19:04:47.383910 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 19:04:47.383910 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 19:04:47.383910 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 19:04:47.383910 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: a6a711601b7a439caf395233de1febff Oct 04 19:04:47.383910 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-DeleteServersTestJSON-591734195 Oct 04 19:04:47.383910 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 19:04:47.383910 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 19:04:47.383910 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/a6a711601b7a439caf395233de1febff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_a6a711601b7a439caf395233de1febff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a6a711601b7a439caf395233de1febff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a6a711601b7a439caf395233de1febff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 19:04:47.383910 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-DeleteServersTestJSON-591734195 Oct 04 19:04:47.383910 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: a6a711601b7a439caf395233de1febff Oct 04 19:04:47.383910 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-DeleteServersTestJSON-591734195 Oct 04 19:04:47.383910 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-DeleteServersTestJSON-591734195-project Oct 04 19:04:47.383910 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 19:04:47.383910 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 19:04:47.383910 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: c997bc60473b43fd9fcf0c65111c44c0 Oct 04 19:04:47.383910 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-DeleteServersTestJSON-591734195-project Oct 04 19:04:47.383910 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 19:04:47.383910 n-d-851028-13 devstack@n-api.service[123596]: exception: Instance 37f52fe0-438c-41f3-9142-8c171e80385d could not be found. Oct 04 19:04:47.383910 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': '37f52fe0-438c-41f3-9142-8c171e80385d'} Oct 04 19:04:47.383910 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:04:47.383910 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:04:47.383910 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:04:47.383910 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:04:47.383910 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:04:47.383910 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:04:47.383910 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:04:47.383910 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:04:47.383910 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:04:47.383910 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:04:47.383910 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37f52fe0-438c-41f3-9142-8c171e80385d could not be found. Oct 04 19:04:47.383910 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:04:47.383910 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:04:47.383910 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:04:47.383910 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:04:47.383910 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:04:47.383910 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:04:47.383910 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:04:47.383910 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:04:47.383910 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:04:47.383910 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:04:47.383910 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:04:47.383910 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:04:47.383910 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:04:47.383910 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:04:47.383910 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:04:47.383910 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:04:47.383910 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37f52fe0-438c-41f3-9142-8c171e80385d could not be found. Oct 04 19:04:47.383910 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:04:47.383910 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:04:47.383910 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:04:47.388532 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:04:47.388532 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:04:47.388532 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:04:47.388532 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:04:47.388532 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:04:47.388532 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37f52fe0-438c-41f3-9142-8c171e80385d could not be found. Oct 04 19:04:47.388532 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:04:47.390941 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-d1f3f695-c695-4076-b56e-dec19314273a tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] Returning 404 to user: Instance 37f52fe0-438c-41f3-9142-8c171e80385d could not be found. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:04:47.392285 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-d1f3f695-c695-4076-b56e-dec19314273a tempest-DeleteServersTestJSON-591734195 tempest-DeleteServersTestJSON-591734195-project] 10.222.0.43 "GET /compute/v2.1/servers/37f52fe0-438c-41f3-9142-8c171e80385d" status: 404 len: 111 microversion: 2.1 time: 0.106286 Oct 04 19:04:47.393916 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3124/5879] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:47 2022] GET /compute/v2.1/servers/37f52fe0-438c-41f3-9142-8c171e80385d => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:04:47.498021 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-367d5f48-1419-4c46-9582-d92f2b11a11f tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef59c846e8342bf9147c621c7c4cc47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c580523ce14c06a66a72339c18e9a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:47.500838 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:04:47.511647 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-367d5f48-1419-4c46-9582-d92f2b11a11f tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] 10.222.0.43 "GET /compute/v2.1/servers/d29d308f-2367-4ae7-a65b-3730767427d1" status: 200 len: 1532 microversion: 2.1 time: 0.322123 Oct 04 19:04:47.529072 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2756/5880] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:47 2022] GET /compute/v2.1/servers/d29d308f-2367-4ae7-a65b-3730767427d1 => generated 1532 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:04:48.535688 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-75c0afb6-179b-4630-b2c0-c164ab3070d4 tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:48.536301 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-75c0afb6-179b-4630-b2c0-c164ab3070d4 tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] [instance: d29d308f-2367-4ae7-a65b-3730767427d1] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:48.543682 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-75c0afb6-179b-4630-b2c0-c164ab3070d4 tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:48.544180 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-75c0afb6-179b-4630-b2c0-c164ab3070d4 tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:48.544632 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-75c0afb6-179b-4630-b2c0-c164ab3070d4 tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:48.545378 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-75c0afb6-179b-4630-b2c0-c164ab3070d4 tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:48.545852 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-75c0afb6-179b-4630-b2c0-c164ab3070d4 tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:48.546285 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-75c0afb6-179b-4630-b2c0-c164ab3070d4 tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:48.967651 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-75c0afb6-179b-4630-b2c0-c164ab3070d4 tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef59c846e8342bf9147c621c7c4cc47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c580523ce14c06a66a72339c18e9a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:48.977928 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-75c0afb6-179b-4630-b2c0-c164ab3070d4 tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] 10.222.0.43 "GET /compute/v2.1/servers/d29d308f-2367-4ae7-a65b-3730767427d1" status: 200 len: 1532 microversion: 2.1 time: 0.445689 Oct 04 19:04:48.979191 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3125/5881] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:48 2022] GET /compute/v2.1/servers/d29d308f-2367-4ae7-a65b-3730767427d1 => generated 1532 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:04:50.010026 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-64bb5aa5-3267-400a-be68-7f4b4ab23272 tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:50.010643 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-64bb5aa5-3267-400a-be68-7f4b4ab23272 tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] [instance: d29d308f-2367-4ae7-a65b-3730767427d1] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:50.025767 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-64bb5aa5-3267-400a-be68-7f4b4ab23272 tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:50.030129 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-64bb5aa5-3267-400a-be68-7f4b4ab23272 tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:50.030869 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-64bb5aa5-3267-400a-be68-7f4b4ab23272 tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:50.031813 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-64bb5aa5-3267-400a-be68-7f4b4ab23272 tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:50.032443 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-64bb5aa5-3267-400a-be68-7f4b4ab23272 tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:50.033040 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-64bb5aa5-3267-400a-be68-7f4b4ab23272 tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:50.192812 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-64bb5aa5-3267-400a-be68-7f4b4ab23272 tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef59c846e8342bf9147c621c7c4cc47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c580523ce14c06a66a72339c18e9a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:50.234494 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-64bb5aa5-3267-400a-be68-7f4b4ab23272 tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] 10.222.0.43 "GET /compute/v2.1/servers/d29d308f-2367-4ae7-a65b-3730767427d1" status: 200 len: 1490 microversion: 2.1 time: 0.224466 Oct 04 19:04:50.254217 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2757/5882] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:50 2022] GET /compute/v2.1/servers/d29d308f-2367-4ae7-a65b-3730767427d1 => generated 1490 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:04:50.441789 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-83f6bb12-e610-48c2-9b23-e8745a600b19 req-76326ff6-6ac4-4f2e-b26d-9b838fbfa3f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d29d308f-2367-4ae7-a65b-3730767427d1", "name": "network-vif-deleted", "tag": "b42a19c5-83fc-464f-837b-f94ecd10dbad"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:04:50.475626 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-83f6bb12-e610-48c2-9b23-e8745a600b19 req-76326ff6-6ac4-4f2e-b26d-9b838fbfa3f8 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:50.484392 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-83f6bb12-e610-48c2-9b23-e8745a600b19 req-76326ff6-6ac4-4f2e-b26d-9b838fbfa3f8 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:50.485275 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-83f6bb12-e610-48c2-9b23-e8745a600b19 req-76326ff6-6ac4-4f2e-b26d-9b838fbfa3f8 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:50.527275 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-83f6bb12-e610-48c2-9b23-e8745a600b19 req-76326ff6-6ac4-4f2e-b26d-9b838fbfa3f8 service nova] Creating event network-vif-deleted:b42a19c5-83fc-464f-837b-f94ecd10dbad for instance d29d308f-2367-4ae7-a65b-3730767427d1 on n-h1-851028-13 Oct 04 19:04:50.555440 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-83f6bb12-e610-48c2-9b23-e8745a600b19 req-76326ff6-6ac4-4f2e-b26d-9b838fbfa3f8 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116283 Oct 04 19:04:50.558889 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3126/5883] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:04:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:04:50.564066 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-6b09e7c4-f62d-4675-b85f-d81210a09f74 tempest-TestNetworkAdvancedServerOps-1915185768 tempest-TestNetworkAdvancedServerOps-1915185768-project-admin] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:50.564778 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-6b09e7c4-f62d-4675-b85f-d81210a09f74 tempest-TestNetworkAdvancedServerOps-1915185768 tempest-TestNetworkAdvancedServerOps-1915185768-project-admin] [instance: 75c5754b-3489-46e5-9a52-43e0a6cfd1c7] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:50.572681 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6b09e7c4-f62d-4675-b85f-d81210a09f74 tempest-TestNetworkAdvancedServerOps-1915185768 tempest-TestNetworkAdvancedServerOps-1915185768-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:50.573336 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6b09e7c4-f62d-4675-b85f-d81210a09f74 tempest-TestNetworkAdvancedServerOps-1915185768 tempest-TestNetworkAdvancedServerOps-1915185768-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:50.573863 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6b09e7c4-f62d-4675-b85f-d81210a09f74 tempest-TestNetworkAdvancedServerOps-1915185768 tempest-TestNetworkAdvancedServerOps-1915185768-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:50.575447 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6b09e7c4-f62d-4675-b85f-d81210a09f74 tempest-TestNetworkAdvancedServerOps-1915185768 tempest-TestNetworkAdvancedServerOps-1915185768-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:50.576007 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6b09e7c4-f62d-4675-b85f-d81210a09f74 tempest-TestNetworkAdvancedServerOps-1915185768 tempest-TestNetworkAdvancedServerOps-1915185768-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:50.576519 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6b09e7c4-f62d-4675-b85f-d81210a09f74 tempest-TestNetworkAdvancedServerOps-1915185768 tempest-TestNetworkAdvancedServerOps-1915185768-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:50.946240 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-6b09e7c4-f62d-4675-b85f-d81210a09f74 tempest-TestNetworkAdvancedServerOps-1915185768 tempest-TestNetworkAdvancedServerOps-1915185768-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/75c5754b-3489-46e5-9a52-43e0a6cfd1c7" status: 200 len: 1836 microversion: 2.1 time: 0.386023 Oct 04 19:04:50.968363 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2758/5884] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:50 2022] GET /compute/v2.1/servers/75c5754b-3489-46e5-9a52-43e0a6cfd1c7 => generated 1836 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:04:50.970628 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-5f5c8ec9-70a8-4a35-83ca-c78195e464be tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:50.971339 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-5f5c8ec9-70a8-4a35-83ca-c78195e464be tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] [instance: 75c5754b-3489-46e5-9a52-43e0a6cfd1c7] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:50.993166 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5f5c8ec9-70a8-4a35-83ca-c78195e464be tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:50.993689 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5f5c8ec9-70a8-4a35-83ca-c78195e464be tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:50.994137 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5f5c8ec9-70a8-4a35-83ca-c78195e464be tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:50.994853 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5f5c8ec9-70a8-4a35-83ca-c78195e464be tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:50.995313 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5f5c8ec9-70a8-4a35-83ca-c78195e464be tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:50.995744 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5f5c8ec9-70a8-4a35-83ca-c78195e464be tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:51.261029 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-8cafc0c7-0cdc-4a5c-9f51-88bf3789faf3 tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:51.261675 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-8cafc0c7-0cdc-4a5c-9f51-88bf3789faf3 tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] [instance: d29d308f-2367-4ae7-a65b-3730767427d1] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:51.284629 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8cafc0c7-0cdc-4a5c-9f51-88bf3789faf3 tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:51.285571 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8cafc0c7-0cdc-4a5c-9f51-88bf3789faf3 tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:51.287057 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8cafc0c7-0cdc-4a5c-9f51-88bf3789faf3 tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:51.288029 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8cafc0c7-0cdc-4a5c-9f51-88bf3789faf3 tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:51.289782 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8cafc0c7-0cdc-4a5c-9f51-88bf3789faf3 tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:51.291529 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8cafc0c7-0cdc-4a5c-9f51-88bf3789faf3 tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:51.401870 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8cafc0c7-0cdc-4a5c-9f51-88bf3789faf3 tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:51.406026 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8cafc0c7-0cdc-4a5c-9f51-88bf3789faf3 tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:51.408970 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8cafc0c7-0cdc-4a5c-9f51-88bf3789faf3 tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:51.411272 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.objects.instance [None req-8cafc0c7-0cdc-4a5c-9f51-88bf3789faf3 tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] Lazy-loading 'fault' on Instance uuid d29d308f-2367-4ae7-a65b-3730767427d1 {{(pid=123595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 19:04:51.421042 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-5f5c8ec9-70a8-4a35-83ca-c78195e464be tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf87794979e844349d6ec6c6650565f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c25f1d17e94c74868357744e692487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:51.430826 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-5f5c8ec9-70a8-4a35-83ca-c78195e464be tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] 10.222.0.43 "GET /compute/v2.1/servers/75c5754b-3489-46e5-9a52-43e0a6cfd1c7" status: 200 len: 1683 microversion: 2.1 time: 0.463999 Oct 04 19:04:51.433806 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3127/5885] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:50 2022] GET /compute/v2.1/servers/75c5754b-3489-46e5-9a52-43e0a6cfd1c7 => generated 1683 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:04:51.587153 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-8cafc0c7-0cdc-4a5c-9f51-88bf3789faf3 tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef59c846e8342bf9147c621c7c4cc47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c580523ce14c06a66a72339c18e9a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:51.595345 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-8cafc0c7-0cdc-4a5c-9f51-88bf3789faf3 tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] 10.222.0.43 "GET /compute/v2.1/servers/d29d308f-2367-4ae7-a65b-3730767427d1" status: 200 len: 1317 microversion: 2.1 time: 0.338964 Oct 04 19:04:51.606188 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2759/5886] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:51 2022] GET /compute/v2.1/servers/d29d308f-2367-4ae7-a65b-3730767427d1 => generated 1317 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:04:51.633088 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-564c6635-ac42-47ab-b7cf-57687bbb7475 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:04:51.635811 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-564c6635-ac42-47ab-b7cf-57687bbb7475 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] [instance: 75c5754b-3489-46e5-9a52-43e0a6cfd1c7] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:51.658664 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-564c6635-ac42-47ab-b7cf-57687bbb7475 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:51.665874 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-564c6635-ac42-47ab-b7cf-57687bbb7475 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:51.666613 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-564c6635-ac42-47ab-b7cf-57687bbb7475 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:51.667740 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-564c6635-ac42-47ab-b7cf-57687bbb7475 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:51.668791 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-564c6635-ac42-47ab-b7cf-57687bbb7475 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:51.672056 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-564c6635-ac42-47ab-b7cf-57687bbb7475 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:51.806630 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-564c6635-ac42-47ab-b7cf-57687bbb7475 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] 10.222.0.43 "POST /compute/v2.1/servers/75c5754b-3489-46e5-9a52-43e0a6cfd1c7/action" status: 200 len: 32583 microversion: 2.1 time: 0.178694 Oct 04 19:04:51.808359 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3128/5887] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 19:04:51 2022] POST /compute/v2.1/servers/75c5754b-3489-46e5-9a52-43e0a6cfd1c7/action => generated 32583 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 19:04:51.953477 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-10a11791-f6dd-4583-bd17-960f5db6f02a tempest-TestNetworkAdvancedServerOps-1915185768 tempest-TestNetworkAdvancedServerOps-1915185768-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:04:51.954386 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-10a11791-f6dd-4583-bd17-960f5db6f02a tempest-TestNetworkAdvancedServerOps-1915185768 tempest-TestNetworkAdvancedServerOps-1915185768-project-admin] [instance: 75c5754b-3489-46e5-9a52-43e0a6cfd1c7] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:51.965408 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-10a11791-f6dd-4583-bd17-960f5db6f02a tempest-TestNetworkAdvancedServerOps-1915185768 tempest-TestNetworkAdvancedServerOps-1915185768-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:51.966654 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-10a11791-f6dd-4583-bd17-960f5db6f02a tempest-TestNetworkAdvancedServerOps-1915185768 tempest-TestNetworkAdvancedServerOps-1915185768-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:51.967539 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-10a11791-f6dd-4583-bd17-960f5db6f02a tempest-TestNetworkAdvancedServerOps-1915185768 tempest-TestNetworkAdvancedServerOps-1915185768-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:51.968287 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-10a11791-f6dd-4583-bd17-960f5db6f02a tempest-TestNetworkAdvancedServerOps-1915185768 tempest-TestNetworkAdvancedServerOps-1915185768-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:51.973377 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-10a11791-f6dd-4583-bd17-960f5db6f02a tempest-TestNetworkAdvancedServerOps-1915185768 tempest-TestNetworkAdvancedServerOps-1915185768-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:51.974658 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-10a11791-f6dd-4583-bd17-960f5db6f02a tempest-TestNetworkAdvancedServerOps-1915185768 tempest-TestNetworkAdvancedServerOps-1915185768-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:52.048922 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-10a11791-f6dd-4583-bd17-960f5db6f02a tempest-TestNetworkAdvancedServerOps-1915185768 tempest-TestNetworkAdvancedServerOps-1915185768-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '3abc94c41cf04fbaaa4af77d9b478186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943cb5a77b8f49f581fae7a1f32f8130', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:52.050810 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-10a11791-f6dd-4583-bd17-960f5db6f02a tempest-TestNetworkAdvancedServerOps-1915185768 tempest-TestNetworkAdvancedServerOps-1915185768-project-admin] [instance: 75c5754b-3489-46e5-9a52-43e0a6cfd1c7] flavor_id is None. Assuming migration. {{(pid=123595) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 04 19:04:52.051474 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-10a11791-f6dd-4583-bd17-960f5db6f02a tempest-TestNetworkAdvancedServerOps-1915185768 tempest-TestNetworkAdvancedServerOps-1915185768-project-admin] [instance: 75c5754b-3489-46e5-9a52-43e0a6cfd1c7] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=123595) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 04 19:04:52.280892 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-10a11791-f6dd-4583-bd17-960f5db6f02a tempest-TestNetworkAdvancedServerOps-1915185768 tempest-TestNetworkAdvancedServerOps-1915185768-project-admin] 10.222.0.43 "POST /compute/v2.1/servers/75c5754b-3489-46e5-9a52-43e0a6cfd1c7/action" status: 202 len: 0 microversion: 2.1 time: 0.332458 Oct 04 19:04:52.294363 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2760/5888] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 19:04:51 2022] POST /compute/v2.1/servers/75c5754b-3489-46e5-9a52-43e0a6cfd1c7/action => generated 0 bytes in 347 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:04:52.315317 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-d7cb312d-4a11-469b-a655-3982a4248170 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:52.317595 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-d7cb312d-4a11-469b-a655-3982a4248170 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] [instance: 75c5754b-3489-46e5-9a52-43e0a6cfd1c7] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:52.335908 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d7cb312d-4a11-469b-a655-3982a4248170 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:52.337695 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d7cb312d-4a11-469b-a655-3982a4248170 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:52.338711 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d7cb312d-4a11-469b-a655-3982a4248170 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:52.340308 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d7cb312d-4a11-469b-a655-3982a4248170 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:52.342934 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d7cb312d-4a11-469b-a655-3982a4248170 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:52.343510 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d7cb312d-4a11-469b-a655-3982a4248170 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:52.635233 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-335f829a-288e-4dad-9522-27146dd5bd5e tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:52.636254 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-335f829a-288e-4dad-9522-27146dd5bd5e tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] [instance: d29d308f-2367-4ae7-a65b-3730767427d1] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:52.657423 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-335f829a-288e-4dad-9522-27146dd5bd5e tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:52.658400 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-335f829a-288e-4dad-9522-27146dd5bd5e tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:52.660263 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-335f829a-288e-4dad-9522-27146dd5bd5e tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:52.662719 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-335f829a-288e-4dad-9522-27146dd5bd5e tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:52.663223 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-335f829a-288e-4dad-9522-27146dd5bd5e tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:52.667910 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-335f829a-288e-4dad-9522-27146dd5bd5e tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:52.714339 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-335f829a-288e-4dad-9522-27146dd5bd5e tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] HTTP exception thrown: Instance d29d308f-2367-4ae7-a65b-3730767427d1 could not be found. Oct 04 19:04:52.716676 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-335f829a-288e-4dad-9522-27146dd5bd5e tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] Request method failure captured: Oct 04 19:04:52.716676 n-d-851028-13 devstack@n-api.service[123595]: request: GET /compute/v2.1/servers/d29d308f-2367-4ae7-a65b-3730767427d1 HTTP/1.1 Oct 04 19:04:52.716676 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 19:04:52.716676 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 19:04:52.716676 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 19:04:52.716676 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 0 Oct 04 19:04:52.716676 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 19:04:52.716676 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 19:04:52.716676 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 19:04:52.716676 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 19:04:52.716676 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPIOsm5odSMcoZ-cYctyH_CoWK3rxWp8GudP0tljfYpcKbpYtxP1LmSeHlTb0Fmp0IBfYKz3Va9pKUbTY3kSYS9mEjrEmyj_EJAZnVcTvBFArb78QCPia_TynKHqLw0qMDqutj3BtGtyPzXlxdSqwZTyrB-83GizWulWX9gfIrxkzCZw Oct 04 19:04:52.716676 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 19:04:52.716676 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 19:04:52.716676 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 19:04:52.716676 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 19:04:52.716676 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 19:04:52.716676 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 19:04:52.716676 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: d0c580523ce14c06a66a72339c18e9a2 Oct 04 19:04:52.716676 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1393568261 Oct 04 19:04:52.716676 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 19:04:52.716676 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 19:04:52.716676 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/d0c580523ce14c06a66a72339c18e9a2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_d0c580523ce14c06a66a72339c18e9a2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d0c580523ce14c06a66a72339c18e9a2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d0c580523ce14c06a66a72339c18e9a2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 19:04:52.716676 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1393568261 Oct 04 19:04:52.716676 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: d0c580523ce14c06a66a72339c18e9a2 Oct 04 19:04:52.716676 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1393568261 Oct 04 19:04:52.716676 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1393568261-project Oct 04 19:04:52.716676 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 19:04:52.716676 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 19:04:52.716676 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: 4ef59c846e8342bf9147c621c7c4cc47 Oct 04 19:04:52.716676 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1393568261-project Oct 04 19:04:52.716676 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 19:04:52.716676 n-d-851028-13 devstack@n-api.service[123595]: exception: Instance d29d308f-2367-4ae7-a65b-3730767427d1 could not be found. Oct 04 19:04:52.716676 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': 'd29d308f-2367-4ae7-a65b-3730767427d1'} Oct 04 19:04:52.716676 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:04:52.716676 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:04:52.716676 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:04:52.716676 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:04:52.716676 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:04:52.716676 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:04:52.716676 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:04:52.716676 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:04:52.716676 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:04:52.716676 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:04:52.716676 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d29d308f-2367-4ae7-a65b-3730767427d1 could not be found. Oct 04 19:04:52.716676 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:04:52.716676 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:04:52.716676 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:04:52.716676 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:04:52.716676 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:04:52.716676 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:04:52.716676 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:04:52.716676 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:04:52.716676 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:04:52.716676 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:04:52.716676 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:04:52.716676 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:04:52.716676 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:04:52.716676 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:04:52.716676 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:04:52.716676 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:04:52.716676 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d29d308f-2367-4ae7-a65b-3730767427d1 could not be found. Oct 04 19:04:52.716676 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:04:52.721814 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:04:52.721814 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:04:52.721814 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:04:52.721814 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:04:52.721814 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:04:52.721814 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:04:52.721814 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:04:52.721814 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d29d308f-2367-4ae7-a65b-3730767427d1 could not be found. Oct 04 19:04:52.721814 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:04:52.733950 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-335f829a-288e-4dad-9522-27146dd5bd5e tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] Returning 404 to user: Instance d29d308f-2367-4ae7-a65b-3730767427d1 could not be found. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:04:52.735081 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-335f829a-288e-4dad-9522-27146dd5bd5e tempest-ServersNegativeTestMultiTenantJSON-1393568261 tempest-ServersNegativeTestMultiTenantJSON-1393568261-project] 10.222.0.43 "GET /compute/v2.1/servers/d29d308f-2367-4ae7-a65b-3730767427d1" status: 404 len: 111 microversion: 2.1 time: 0.104430 Oct 04 19:04:52.736167 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2761/5889] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:52 2022] GET /compute/v2.1/servers/d29d308f-2367-4ae7-a65b-3730767427d1 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:04:52.932917 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-d7cb312d-4a11-469b-a655-3982a4248170 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf87794979e844349d6ec6c6650565f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c25f1d17e94c74868357744e692487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:52.939597 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-d7cb312d-4a11-469b-a655-3982a4248170 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] 10.222.0.43 "GET /compute/v2.1/servers/75c5754b-3489-46e5-9a52-43e0a6cfd1c7" status: 200 len: 1692 microversion: 2.1 time: 0.647964 Oct 04 19:04:52.941774 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3129/5890] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:52 2022] GET /compute/v2.1/servers/75c5754b-3489-46e5-9a52-43e0a6cfd1c7 => generated 1692 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:04:53.973834 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-cf13d252-f6a9-4b23-a810-3527b36d3768 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:53.975939 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-cf13d252-f6a9-4b23-a810-3527b36d3768 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] [instance: 75c5754b-3489-46e5-9a52-43e0a6cfd1c7] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:53.999379 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cf13d252-f6a9-4b23-a810-3527b36d3768 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:53.999883 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cf13d252-f6a9-4b23-a810-3527b36d3768 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:54.000328 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cf13d252-f6a9-4b23-a810-3527b36d3768 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:54.001042 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cf13d252-f6a9-4b23-a810-3527b36d3768 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:54.001536 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cf13d252-f6a9-4b23-a810-3527b36d3768 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:54.001957 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cf13d252-f6a9-4b23-a810-3527b36d3768 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:54.721768 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-cf13d252-f6a9-4b23-a810-3527b36d3768 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf87794979e844349d6ec6c6650565f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c25f1d17e94c74868357744e692487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:54.739656 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-cf13d252-f6a9-4b23-a810-3527b36d3768 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] 10.222.0.43 "GET /compute/v2.1/servers/75c5754b-3489-46e5-9a52-43e0a6cfd1c7" status: 200 len: 1692 microversion: 2.1 time: 0.771678 Oct 04 19:04:54.760471 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2762/5891] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:53 2022] GET /compute/v2.1/servers/75c5754b-3489-46e5-9a52-43e0a6cfd1c7 => generated 1692 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:04:55.768506 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-a5d55a87-3f66-463a-9434-44fd506d454b tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:55.769219 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-a5d55a87-3f66-463a-9434-44fd506d454b tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] [instance: 75c5754b-3489-46e5-9a52-43e0a6cfd1c7] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:55.785075 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a5d55a87-3f66-463a-9434-44fd506d454b tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:55.785601 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a5d55a87-3f66-463a-9434-44fd506d454b tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:55.786513 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a5d55a87-3f66-463a-9434-44fd506d454b tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:55.787676 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a5d55a87-3f66-463a-9434-44fd506d454b tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:55.788827 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a5d55a87-3f66-463a-9434-44fd506d454b tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:55.789672 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a5d55a87-3f66-463a-9434-44fd506d454b tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:56.266762 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-a5d55a87-3f66-463a-9434-44fd506d454b tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf87794979e844349d6ec6c6650565f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c25f1d17e94c74868357744e692487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:56.282332 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-a5d55a87-3f66-463a-9434-44fd506d454b tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] 10.222.0.43 "GET /compute/v2.1/servers/75c5754b-3489-46e5-9a52-43e0a6cfd1c7" status: 200 len: 1692 microversion: 2.1 time: 0.519075 Oct 04 19:04:56.285161 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3130/5892] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:55 2022] GET /compute/v2.1/servers/75c5754b-3489-46e5-9a52-43e0a6cfd1c7 => generated 1692 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:04:57.308239 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-42295d5e-0bad-4096-91e2-8e24f08e58ad tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:57.308848 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-42295d5e-0bad-4096-91e2-8e24f08e58ad tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] [instance: 75c5754b-3489-46e5-9a52-43e0a6cfd1c7] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:57.327593 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-42295d5e-0bad-4096-91e2-8e24f08e58ad tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:57.328340 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-42295d5e-0bad-4096-91e2-8e24f08e58ad tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:57.330002 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-42295d5e-0bad-4096-91e2-8e24f08e58ad tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:57.332187 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-42295d5e-0bad-4096-91e2-8e24f08e58ad tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:57.337841 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-42295d5e-0bad-4096-91e2-8e24f08e58ad tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:57.340409 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-42295d5e-0bad-4096-91e2-8e24f08e58ad tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:57.696354 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-42295d5e-0bad-4096-91e2-8e24f08e58ad tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf87794979e844349d6ec6c6650565f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c25f1d17e94c74868357744e692487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:57.718087 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-42295d5e-0bad-4096-91e2-8e24f08e58ad tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] 10.222.0.43 "GET /compute/v2.1/servers/75c5754b-3489-46e5-9a52-43e0a6cfd1c7" status: 200 len: 1697 microversion: 2.1 time: 0.413450 Oct 04 19:04:57.719573 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2763/5893] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:57 2022] GET /compute/v2.1/servers/75c5754b-3489-46e5-9a52-43e0a6cfd1c7 => generated 1697 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:04:58.744212 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-4b5c13b8-d7f0-4d70-bc8b-010f0f5d51f0 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:58.744730 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-4b5c13b8-d7f0-4d70-bc8b-010f0f5d51f0 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] [instance: 75c5754b-3489-46e5-9a52-43e0a6cfd1c7] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:58.790154 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4b5c13b8-d7f0-4d70-bc8b-010f0f5d51f0 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:58.791141 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4b5c13b8-d7f0-4d70-bc8b-010f0f5d51f0 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:58.792170 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4b5c13b8-d7f0-4d70-bc8b-010f0f5d51f0 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:58.793173 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4b5c13b8-d7f0-4d70-bc8b-010f0f5d51f0 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:58.793867 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4b5c13b8-d7f0-4d70-bc8b-010f0f5d51f0 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:58.794525 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4b5c13b8-d7f0-4d70-bc8b-010f0f5d51f0 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:59.077390 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-4b5c13b8-d7f0-4d70-bc8b-010f0f5d51f0 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf87794979e844349d6ec6c6650565f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c25f1d17e94c74868357744e692487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:59.092947 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-4b5c13b8-d7f0-4d70-bc8b-010f0f5d51f0 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] 10.222.0.43 "GET /compute/v2.1/servers/75c5754b-3489-46e5-9a52-43e0a6cfd1c7" status: 200 len: 1697 microversion: 2.1 time: 0.353752 Oct 04 19:04:59.109654 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3131/5894] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:58 2022] GET /compute/v2.1/servers/75c5754b-3489-46e5-9a52-43e0a6cfd1c7 => generated 1697 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:05:00.128580 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-4688c708-acb9-4caa-9d54-07d155012496 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:00.130281 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-4688c708-acb9-4caa-9d54-07d155012496 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] [instance: 75c5754b-3489-46e5-9a52-43e0a6cfd1c7] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:00.139427 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4688c708-acb9-4caa-9d54-07d155012496 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:00.140861 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4688c708-acb9-4caa-9d54-07d155012496 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:00.156446 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4688c708-acb9-4caa-9d54-07d155012496 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:00.160362 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4688c708-acb9-4caa-9d54-07d155012496 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:00.164349 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4688c708-acb9-4caa-9d54-07d155012496 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:00.166914 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4688c708-acb9-4caa-9d54-07d155012496 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:00.712743 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-4688c708-acb9-4caa-9d54-07d155012496 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf87794979e844349d6ec6c6650565f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c25f1d17e94c74868357744e692487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:00.740799 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-4688c708-acb9-4caa-9d54-07d155012496 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] 10.222.0.43 "GET /compute/v2.1/servers/75c5754b-3489-46e5-9a52-43e0a6cfd1c7" status: 200 len: 1697 microversion: 2.1 time: 0.622436 Oct 04 19:05:00.742252 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2764/5895] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:05:00 2022] GET /compute/v2.1/servers/75c5754b-3489-46e5-9a52-43e0a6cfd1c7 => generated 1697 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:05:01.772390 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-cd8463fe-ce83-4036-89d5-944a15d6ab15 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:01.773992 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-cd8463fe-ce83-4036-89d5-944a15d6ab15 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] [instance: 75c5754b-3489-46e5-9a52-43e0a6cfd1c7] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:01.789520 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_api:SELECT=66 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:05:01.799250 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cd8463fe-ce83-4036-89d5-944a15d6ab15 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:01.800859 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cd8463fe-ce83-4036-89d5-944a15d6ab15 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:01.804092 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cd8463fe-ce83-4036-89d5-944a15d6ab15 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:01.806629 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cd8463fe-ce83-4036-89d5-944a15d6ab15 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:01.807958 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cd8463fe-ce83-4036-89d5-944a15d6ab15 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:01.808762 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cd8463fe-ce83-4036-89d5-944a15d6ab15 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:02.661062 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-cd8463fe-ce83-4036-89d5-944a15d6ab15 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf87794979e844349d6ec6c6650565f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c25f1d17e94c74868357744e692487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:02.681378 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-cd8463fe-ce83-4036-89d5-944a15d6ab15 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] 10.222.0.43 "GET /compute/v2.1/servers/75c5754b-3489-46e5-9a52-43e0a6cfd1c7" status: 200 len: 1697 microversion: 2.1 time: 0.903882 Oct 04 19:05:02.682483 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3132/5896] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:05:01 2022] GET /compute/v2.1/servers/75c5754b-3489-46e5-9a52-43e0a6cfd1c7 => generated 1697 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:05:03.710226 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-c7653117-f196-4c47-bec7-39ef94da0c4a tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:03.711242 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-c7653117-f196-4c47-bec7-39ef94da0c4a tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] [instance: 75c5754b-3489-46e5-9a52-43e0a6cfd1c7] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:03.725295 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c7653117-f196-4c47-bec7-39ef94da0c4a tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:03.725804 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c7653117-f196-4c47-bec7-39ef94da0c4a tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:03.726256 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c7653117-f196-4c47-bec7-39ef94da0c4a tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:03.726973 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c7653117-f196-4c47-bec7-39ef94da0c4a tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:03.727437 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c7653117-f196-4c47-bec7-39ef94da0c4a tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:03.727876 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c7653117-f196-4c47-bec7-39ef94da0c4a tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:04.523426 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-c7653117-f196-4c47-bec7-39ef94da0c4a tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf87794979e844349d6ec6c6650565f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c25f1d17e94c74868357744e692487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:04.538584 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-c7653117-f196-4c47-bec7-39ef94da0c4a tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] 10.222.0.43 "GET /compute/v2.1/servers/75c5754b-3489-46e5-9a52-43e0a6cfd1c7" status: 200 len: 1697 microversion: 2.1 time: 0.827632 Oct 04 19:05:04.545423 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2765/5897] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:05:03 2022] GET /compute/v2.1/servers/75c5754b-3489-46e5-9a52-43e0a6cfd1c7 => generated 1697 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:05:05.579975 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-bfb3cef1-e994-4849-87b2-398af82c8a19 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:05.583550 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-bfb3cef1-e994-4849-87b2-398af82c8a19 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] [instance: 75c5754b-3489-46e5-9a52-43e0a6cfd1c7] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:05.629846 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bfb3cef1-e994-4849-87b2-398af82c8a19 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:05.632098 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bfb3cef1-e994-4849-87b2-398af82c8a19 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:05.632766 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bfb3cef1-e994-4849-87b2-398af82c8a19 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:05.636250 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bfb3cef1-e994-4849-87b2-398af82c8a19 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:05.637103 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bfb3cef1-e994-4849-87b2-398af82c8a19 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:05.638701 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bfb3cef1-e994-4849-87b2-398af82c8a19 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:05.649808 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=100 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:05:06.479080 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-bfb3cef1-e994-4849-87b2-398af82c8a19 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf87794979e844349d6ec6c6650565f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c25f1d17e94c74868357744e692487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:06.488233 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-bfb3cef1-e994-4849-87b2-398af82c8a19 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] 10.222.0.43 "GET /compute/v2.1/servers/75c5754b-3489-46e5-9a52-43e0a6cfd1c7" status: 200 len: 1697 microversion: 2.1 time: 0.922840 Oct 04 19:05:06.492362 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3133/5898] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:05:05 2022] GET /compute/v2.1/servers/75c5754b-3489-46e5-9a52-43e0a6cfd1c7 => generated 1697 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:05:07.524173 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-d5bee81c-331c-4401-8e62-72794d07e127 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:07.524800 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-d5bee81c-331c-4401-8e62-72794d07e127 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] [instance: 75c5754b-3489-46e5-9a52-43e0a6cfd1c7] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:07.530871 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_api:SELECT=68,nova_api:UPDATE=2 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:05:07.554833 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d5bee81c-331c-4401-8e62-72794d07e127 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:07.557724 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d5bee81c-331c-4401-8e62-72794d07e127 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:07.558408 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d5bee81c-331c-4401-8e62-72794d07e127 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:07.563442 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d5bee81c-331c-4401-8e62-72794d07e127 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:07.565455 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d5bee81c-331c-4401-8e62-72794d07e127 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:07.567298 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d5bee81c-331c-4401-8e62-72794d07e127 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:08.171818 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-d5bee81c-331c-4401-8e62-72794d07e127 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf87794979e844349d6ec6c6650565f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c25f1d17e94c74868357744e692487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:08.190979 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-d5bee81c-331c-4401-8e62-72794d07e127 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] 10.222.0.43 "GET /compute/v2.1/servers/75c5754b-3489-46e5-9a52-43e0a6cfd1c7" status: 200 len: 1697 microversion: 2.1 time: 0.671227 Oct 04 19:05:08.198896 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2766/5899] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:05:07 2022] GET /compute/v2.1/servers/75c5754b-3489-46e5-9a52-43e0a6cfd1c7 => generated 1697 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:05:08.660818 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-0b9598c7-b5f7-4a10-a3f8-bdb8c3f94edf tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-220002942", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452", "networks": [{"uuid": "2d7eb021-4d99-4d00-9464-e3158525c47d"}]}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:05:08.809566 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.network.neutron [None req-0b9598c7-b5f7-4a10-a3f8-bdb8c3f94edf tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] validate_networks() for [('2d7eb021-4d99-4d00-9464-e3158525c47d', None, None, None, None, None)] {{(pid=123596) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 19:05:09.238442 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-6d610ae6-3579-4e38-85cb-309639c2f535 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:09.240696 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-6d610ae6-3579-4e38-85cb-309639c2f535 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] [instance: 75c5754b-3489-46e5-9a52-43e0a6cfd1c7] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:09.251386 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6d610ae6-3579-4e38-85cb-309639c2f535 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:09.252562 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6d610ae6-3579-4e38-85cb-309639c2f535 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:09.253310 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6d610ae6-3579-4e38-85cb-309639c2f535 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:09.255175 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6d610ae6-3579-4e38-85cb-309639c2f535 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:09.255926 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6d610ae6-3579-4e38-85cb-309639c2f535 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:09.257256 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6d610ae6-3579-4e38-85cb-309639c2f535 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:09.577752 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-6d610ae6-3579-4e38-85cb-309639c2f535 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf87794979e844349d6ec6c6650565f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c25f1d17e94c74868357744e692487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:09.591958 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-6d610ae6-3579-4e38-85cb-309639c2f535 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] 10.222.0.43 "GET /compute/v2.1/servers/75c5754b-3489-46e5-9a52-43e0a6cfd1c7" status: 200 len: 1696 microversion: 2.1 time: 0.368334 Oct 04 19:05:09.596445 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2767/5900] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:05:09 2022] GET /compute/v2.1/servers/75c5754b-3489-46e5-9a52-43e0a6cfd1c7 => generated 1696 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:05:10.200329 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-0b9598c7-b5f7-4a10-a3f8-bdb8c3f94edf tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] Flavor limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:05:10.200820 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-0b9598c7-b5f7-4a10-a3f8-bdb8c3f94edf tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] Image limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:05:10.208021 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-0b9598c7-b5f7-4a10-a3f8-bdb8c3f94edf tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] Flavor pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:05:10.208557 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-0b9598c7-b5f7-4a10-a3f8-bdb8c3f94edf tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] Image pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:05:10.213392 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-0b9598c7-b5f7-4a10-a3f8-bdb8c3f94edf tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:05:10.250121 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0b9598c7-b5f7-4a10-a3f8-bdb8c3f94edf tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:10.250939 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0b9598c7-b5f7-4a10-a3f8-bdb8c3f94edf tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:10.251722 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0b9598c7-b5f7-4a10-a3f8-bdb8c3f94edf tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:10.255026 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0b9598c7-b5f7-4a10-a3f8-bdb8c3f94edf tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:10.255781 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0b9598c7-b5f7-4a10-a3f8-bdb8c3f94edf tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:10.257001 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0b9598c7-b5f7-4a10-a3f8-bdb8c3f94edf tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:10.310952 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-0b9598c7-b5f7-4a10-a3f8-bdb8c3f94edf tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] Getting quotas for project 946e98bf99e543b1a1b19909ba741874. Resources: {'ram', 'cores', 'instances'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:05:10.329590 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-0b9598c7-b5f7-4a10-a3f8-bdb8c3f94edf tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] Getting quotas for user 11bed3b641da4eeeb406a87b63ad1558 and project 946e98bf99e543b1a1b19909ba741874. Resources: {'ram', 'cores', 'instances'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:05:10.370457 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-0b9598c7-b5f7-4a10-a3f8-bdb8c3f94edf tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] Going to run 1 instances... {{(pid=123596) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 19:05:10.373847 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-0b9598c7-b5f7-4a10-a3f8-bdb8c3f94edf tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] [instance: 2845d7de-5b4d-4376-9e46-36d5da7c6a14] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e8943ec5-4038-4d4b-b9b9-2415a79f5243',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123596) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 19:05:10.418977 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-c81b99e0-61c5-4542-a096-6afcbbc90cb5 req-f5984479-b12b-4411-a8e1-b02940e3da16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75c5754b-3489-46e5-9a52-43e0a6cfd1c7", "name": "network-vif-unplugged", "status": "completed", "tag": "515e62ea-52d3-4ada-b96e-712f01398333"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:05:10.444927 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-c81b99e0-61c5-4542-a096-6afcbbc90cb5 req-f5984479-b12b-4411-a8e1-b02940e3da16 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:10.447450 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-c81b99e0-61c5-4542-a096-6afcbbc90cb5 req-f5984479-b12b-4411-a8e1-b02940e3da16 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:10.449174 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-c81b99e0-61c5-4542-a096-6afcbbc90cb5 req-f5984479-b12b-4411-a8e1-b02940e3da16 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:10.485486 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-c81b99e0-61c5-4542-a096-6afcbbc90cb5 req-f5984479-b12b-4411-a8e1-b02940e3da16 service nova] Creating event network-vif-unplugged:515e62ea-52d3-4ada-b96e-712f01398333 for instance 75c5754b-3489-46e5-9a52-43e0a6cfd1c7 on n-h2-851028-13 Oct 04 19:05:10.502090 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [req-c81b99e0-61c5-4542-a096-6afcbbc90cb5 req-f5984479-b12b-4411-a8e1-b02940e3da16 service nova] Instance 75c5754b-3489-46e5-9a52-43e0a6cfd1c7 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851028-13', 'n-h2-851028-13'} {{(pid=123595) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 19:05:10.561341 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-c81b99e0-61c5-4542-a096-6afcbbc90cb5 req-f5984479-b12b-4411-a8e1-b02940e3da16 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.130628 Oct 04 19:05:10.562313 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2768/5901] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:05:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:05:10.578592 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-0b9598c7-b5f7-4a10-a3f8-bdb8c3f94edf tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.192908 Oct 04 19:05:10.580217 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3134/5902] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 19:05:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 2195 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 19:05:10.592905 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-faa7c51d-c677-4d05-810f-3ec5cf51520e tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:10.593727 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-faa7c51d-c677-4d05-810f-3ec5cf51520e tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] [instance: 2845d7de-5b4d-4376-9e46-36d5da7c6a14] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:10.628356 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-abe29831-3a7c-4278-a3d4-051389f80e8f tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:10.629733 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-abe29831-3a7c-4278-a3d4-051389f80e8f tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] [instance: 75c5754b-3489-46e5-9a52-43e0a6cfd1c7] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:10.644339 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-abe29831-3a7c-4278-a3d4-051389f80e8f tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:10.644794 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-abe29831-3a7c-4278-a3d4-051389f80e8f tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:10.645413 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-abe29831-3a7c-4278-a3d4-051389f80e8f tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:10.650225 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-abe29831-3a7c-4278-a3d4-051389f80e8f tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:10.651103 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-abe29831-3a7c-4278-a3d4-051389f80e8f tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:10.651735 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-abe29831-3a7c-4278-a3d4-051389f80e8f tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:10.788371 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-faa7c51d-c677-4d05-810f-3ec5cf51520e tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11bed3b641da4eeeb406a87b63ad1558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946e98bf99e543b1a1b19909ba741874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:10.799844 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-faa7c51d-c677-4d05-810f-3ec5cf51520e tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] 10.222.0.43 "GET /compute/v2.1/servers/2845d7de-5b4d-4376-9e46-36d5da7c6a14" status: 200 len: 1216 microversion: 2.1 time: 0.211904 Oct 04 19:05:10.823536 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2769/5903] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:05:10 2022] GET /compute/v2.1/servers/2845d7de-5b4d-4376-9e46-36d5da7c6a14 => generated 1216 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:05:11.363195 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-abe29831-3a7c-4278-a3d4-051389f80e8f tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf87794979e844349d6ec6c6650565f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c25f1d17e94c74868357744e692487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:11.375244 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-abe29831-3a7c-4278-a3d4-051389f80e8f tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] 10.222.0.43 "GET /compute/v2.1/servers/75c5754b-3489-46e5-9a52-43e0a6cfd1c7" status: 200 len: 1696 microversion: 2.1 time: 0.756351 Oct 04 19:05:11.396379 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3135/5904] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:05:10 2022] GET /compute/v2.1/servers/75c5754b-3489-46e5-9a52-43e0a6cfd1c7 => generated 1696 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:05:11.827117 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-840321c9-f671-47ed-9da4-7d91b873898a tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:11.827737 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-840321c9-f671-47ed-9da4-7d91b873898a tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] [instance: 2845d7de-5b4d-4376-9e46-36d5da7c6a14] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:11.846342 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-840321c9-f671-47ed-9da4-7d91b873898a tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:11.846935 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-840321c9-f671-47ed-9da4-7d91b873898a tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:11.847395 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-840321c9-f671-47ed-9da4-7d91b873898a tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:11.848135 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-840321c9-f671-47ed-9da4-7d91b873898a tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:11.848593 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-840321c9-f671-47ed-9da4-7d91b873898a tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:11.849035 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-840321c9-f671-47ed-9da4-7d91b873898a tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:12.035451 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-840321c9-f671-47ed-9da4-7d91b873898a tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11bed3b641da4eeeb406a87b63ad1558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946e98bf99e543b1a1b19909ba741874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:12.048229 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-840321c9-f671-47ed-9da4-7d91b873898a tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] 10.222.0.43 "GET /compute/v2.1/servers/2845d7de-5b4d-4376-9e46-36d5da7c6a14" status: 200 len: 1212 microversion: 2.1 time: 0.225106 Oct 04 19:05:12.050667 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2770/5905] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:05:11 2022] GET /compute/v2.1/servers/2845d7de-5b4d-4376-9e46-36d5da7c6a14 => generated 1212 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:05:12.421455 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-b31f052a-8455-4ae7-827a-5fb3f1ccda76 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:12.423025 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-b31f052a-8455-4ae7-827a-5fb3f1ccda76 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] [instance: 75c5754b-3489-46e5-9a52-43e0a6cfd1c7] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:12.440146 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b31f052a-8455-4ae7-827a-5fb3f1ccda76 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:12.441301 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b31f052a-8455-4ae7-827a-5fb3f1ccda76 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:12.442120 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b31f052a-8455-4ae7-827a-5fb3f1ccda76 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:12.443088 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b31f052a-8455-4ae7-827a-5fb3f1ccda76 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:12.443842 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b31f052a-8455-4ae7-827a-5fb3f1ccda76 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:12.445030 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b31f052a-8455-4ae7-827a-5fb3f1ccda76 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:12.685245 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-aeb777a6-d058-42b9-b4df-517c9bbd80a8 req-f65ef90f-e84b-40df-89ce-c7f1d2c1a111 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75c5754b-3489-46e5-9a52-43e0a6cfd1c7", "tag": "515e62ea-52d3-4ada-b96e-712f01398333"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:05:12.707271 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-aeb777a6-d058-42b9-b4df-517c9bbd80a8 req-f65ef90f-e84b-40df-89ce-c7f1d2c1a111 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:12.708002 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-aeb777a6-d058-42b9-b4df-517c9bbd80a8 req-f65ef90f-e84b-40df-89ce-c7f1d2c1a111 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:12.709265 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-aeb777a6-d058-42b9-b4df-517c9bbd80a8 req-f65ef90f-e84b-40df-89ce-c7f1d2c1a111 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:12.761841 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-aeb777a6-d058-42b9-b4df-517c9bbd80a8 req-f65ef90f-e84b-40df-89ce-c7f1d2c1a111 service nova] Creating event network-changed:515e62ea-52d3-4ada-b96e-712f01398333 for instance 75c5754b-3489-46e5-9a52-43e0a6cfd1c7 on n-h2-851028-13 Oct 04 19:05:12.769825 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [req-aeb777a6-d058-42b9-b4df-517c9bbd80a8 req-f65ef90f-e84b-40df-89ce-c7f1d2c1a111 service nova] Instance 75c5754b-3489-46e5-9a52-43e0a6cfd1c7 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851028-13', 'n-h2-851028-13'} {{(pid=123595) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 19:05:12.784757 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-aeb777a6-d058-42b9-b4df-517c9bbd80a8 req-f65ef90f-e84b-40df-89ce-c7f1d2c1a111 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106476 Oct 04 19:05:12.786818 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2771/5906] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:05:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:05:13.075670 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-5b172b8a-dce0-4e1d-bdff-8c32a11f1a53 tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:13.076395 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-5b172b8a-dce0-4e1d-bdff-8c32a11f1a53 tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] [instance: 2845d7de-5b4d-4376-9e46-36d5da7c6a14] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:13.088284 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5b172b8a-dce0-4e1d-bdff-8c32a11f1a53 tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:13.088794 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5b172b8a-dce0-4e1d-bdff-8c32a11f1a53 tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:13.089271 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5b172b8a-dce0-4e1d-bdff-8c32a11f1a53 tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:13.090001 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5b172b8a-dce0-4e1d-bdff-8c32a11f1a53 tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:13.090459 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5b172b8a-dce0-4e1d-bdff-8c32a11f1a53 tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:13.104551 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5b172b8a-dce0-4e1d-bdff-8c32a11f1a53 tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:13.246350 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-b31f052a-8455-4ae7-827a-5fb3f1ccda76 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf87794979e844349d6ec6c6650565f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c25f1d17e94c74868357744e692487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:13.256599 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-b31f052a-8455-4ae7-827a-5fb3f1ccda76 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] 10.222.0.43 "GET /compute/v2.1/servers/75c5754b-3489-46e5-9a52-43e0a6cfd1c7" status: 200 len: 1696 microversion: 2.1 time: 0.838881 Oct 04 19:05:13.271449 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3136/5907] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:05:12 2022] GET /compute/v2.1/servers/75c5754b-3489-46e5-9a52-43e0a6cfd1c7 => generated 1696 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:05:14.173347 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-5b172b8a-dce0-4e1d-bdff-8c32a11f1a53 tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11bed3b641da4eeeb406a87b63ad1558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946e98bf99e543b1a1b19909ba741874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:14.182495 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-5b172b8a-dce0-4e1d-bdff-8c32a11f1a53 tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] 10.222.0.43 "GET /compute/v2.1/servers/2845d7de-5b4d-4376-9e46-36d5da7c6a14" status: 200 len: 1274 microversion: 2.1 time: 1.111991 Oct 04 19:05:14.204721 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2772/5908] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:05:13 2022] GET /compute/v2.1/servers/2845d7de-5b4d-4376-9e46-36d5da7c6a14 => generated 1274 bytes in 1134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:05:14.289637 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-d446f0da-b947-45d6-82bc-4e153371b254 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:14.290383 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-d446f0da-b947-45d6-82bc-4e153371b254 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] [instance: 75c5754b-3489-46e5-9a52-43e0a6cfd1c7] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:14.301887 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d446f0da-b947-45d6-82bc-4e153371b254 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:14.304010 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d446f0da-b947-45d6-82bc-4e153371b254 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:14.305258 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d446f0da-b947-45d6-82bc-4e153371b254 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:14.306857 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d446f0da-b947-45d6-82bc-4e153371b254 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:14.309101 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d446f0da-b947-45d6-82bc-4e153371b254 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:14.310527 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d446f0da-b947-45d6-82bc-4e153371b254 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:14.713387 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-d446f0da-b947-45d6-82bc-4e153371b254 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf87794979e844349d6ec6c6650565f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c25f1d17e94c74868357744e692487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:14.735360 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-d446f0da-b947-45d6-82bc-4e153371b254 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] 10.222.0.43 "GET /compute/v2.1/servers/75c5754b-3489-46e5-9a52-43e0a6cfd1c7" status: 200 len: 1694 microversion: 2.1 time: 0.455166 Oct 04 19:05:14.757874 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3137/5909] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:05:14 2022] GET /compute/v2.1/servers/75c5754b-3489-46e5-9a52-43e0a6cfd1c7 => generated 1694 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:05:15.211297 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-2b78122d-d6f6-4030-b2cd-b24b8cac6a0b tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:15.211921 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-2b78122d-d6f6-4030-b2cd-b24b8cac6a0b tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] [instance: 2845d7de-5b4d-4376-9e46-36d5da7c6a14] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:15.237879 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2b78122d-d6f6-4030-b2cd-b24b8cac6a0b tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:15.239838 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2b78122d-d6f6-4030-b2cd-b24b8cac6a0b tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:15.243269 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2b78122d-d6f6-4030-b2cd-b24b8cac6a0b tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:15.246307 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2b78122d-d6f6-4030-b2cd-b24b8cac6a0b tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:15.246662 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2b78122d-d6f6-4030-b2cd-b24b8cac6a0b tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:15.247128 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2b78122d-d6f6-4030-b2cd-b24b8cac6a0b tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:15.760844 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-050072a6-777b-4b53-907a-b20aa4aea691 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:15.761913 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-050072a6-777b-4b53-907a-b20aa4aea691 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] [instance: 75c5754b-3489-46e5-9a52-43e0a6cfd1c7] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:15.785732 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-050072a6-777b-4b53-907a-b20aa4aea691 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:15.786255 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-050072a6-777b-4b53-907a-b20aa4aea691 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:15.786714 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-050072a6-777b-4b53-907a-b20aa4aea691 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:15.789472 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-050072a6-777b-4b53-907a-b20aa4aea691 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:15.793482 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-050072a6-777b-4b53-907a-b20aa4aea691 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:15.793953 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-050072a6-777b-4b53-907a-b20aa4aea691 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:15.954313 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-2b78122d-d6f6-4030-b2cd-b24b8cac6a0b tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11bed3b641da4eeeb406a87b63ad1558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946e98bf99e543b1a1b19909ba741874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:15.958516 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:05:15.982739 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-2b78122d-d6f6-4030-b2cd-b24b8cac6a0b tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] 10.222.0.43 "GET /compute/v2.1/servers/2845d7de-5b4d-4376-9e46-36d5da7c6a14" status: 200 len: 1316 microversion: 2.1 time: 0.776039 Oct 04 19:05:15.985640 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2773/5910] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:05:15 2022] GET /compute/v2.1/servers/2845d7de-5b4d-4376-9e46-36d5da7c6a14 => generated 1316 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:05:16.253902 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-050072a6-777b-4b53-907a-b20aa4aea691 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf87794979e844349d6ec6c6650565f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c25f1d17e94c74868357744e692487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:16.263142 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-050072a6-777b-4b53-907a-b20aa4aea691 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] 10.222.0.43 "GET /compute/v2.1/servers/75c5754b-3489-46e5-9a52-43e0a6cfd1c7" status: 200 len: 1691 microversion: 2.1 time: 0.507200 Oct 04 19:05:16.269026 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3138/5911] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:05:15 2022] GET /compute/v2.1/servers/75c5754b-3489-46e5-9a52-43e0a6cfd1c7 => generated 1691 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:05:16.299840 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-6f24d664-e76b-4977-8729-acd27c0faa4a tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:05:16.301413 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-6f24d664-e76b-4977-8729-acd27c0faa4a tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] [instance: 75c5754b-3489-46e5-9a52-43e0a6cfd1c7] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:16.323102 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6f24d664-e76b-4977-8729-acd27c0faa4a tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:16.324229 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6f24d664-e76b-4977-8729-acd27c0faa4a tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:16.327819 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6f24d664-e76b-4977-8729-acd27c0faa4a tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:16.328671 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6f24d664-e76b-4977-8729-acd27c0faa4a tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:16.332066 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6f24d664-e76b-4977-8729-acd27c0faa4a tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:16.332742 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6f24d664-e76b-4977-8729-acd27c0faa4a tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:16.552331 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-6f24d664-e76b-4977-8729-acd27c0faa4a tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] 10.222.0.43 "POST /compute/v2.1/servers/75c5754b-3489-46e5-9a52-43e0a6cfd1c7/action" status: 202 len: 0 microversion: 2.1 time: 0.259700 Oct 04 19:05:16.554540 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2774/5912] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 19:05:16 2022] POST /compute/v2.1/servers/75c5754b-3489-46e5-9a52-43e0a6cfd1c7/action => generated 0 bytes in 263 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:05:16.568195 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-ceef9aa3-5a07-40f3-a8c1-7da859fe68e2 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:16.569667 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-ceef9aa3-5a07-40f3-a8c1-7da859fe68e2 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] [instance: 75c5754b-3489-46e5-9a52-43e0a6cfd1c7] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:16.589406 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ceef9aa3-5a07-40f3-a8c1-7da859fe68e2 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:16.589974 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ceef9aa3-5a07-40f3-a8c1-7da859fe68e2 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:16.592586 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ceef9aa3-5a07-40f3-a8c1-7da859fe68e2 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:16.593575 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ceef9aa3-5a07-40f3-a8c1-7da859fe68e2 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:16.596143 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ceef9aa3-5a07-40f3-a8c1-7da859fe68e2 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:16.599315 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ceef9aa3-5a07-40f3-a8c1-7da859fe68e2 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:17.011189 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-ec35aea4-99a1-49cb-ae78-10ca9af23d9f tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:17.012870 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-ec35aea4-99a1-49cb-ae78-10ca9af23d9f tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] [instance: 2845d7de-5b4d-4376-9e46-36d5da7c6a14] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:17.032752 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ec35aea4-99a1-49cb-ae78-10ca9af23d9f tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:17.036976 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ec35aea4-99a1-49cb-ae78-10ca9af23d9f tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:17.046769 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ec35aea4-99a1-49cb-ae78-10ca9af23d9f tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:17.048469 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ec35aea4-99a1-49cb-ae78-10ca9af23d9f tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:17.050011 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ec35aea4-99a1-49cb-ae78-10ca9af23d9f tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:17.051264 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ec35aea4-99a1-49cb-ae78-10ca9af23d9f tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:17.372340 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-ec35aea4-99a1-49cb-ae78-10ca9af23d9f tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11bed3b641da4eeeb406a87b63ad1558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946e98bf99e543b1a1b19909ba741874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:17.383432 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-ec35aea4-99a1-49cb-ae78-10ca9af23d9f tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] 10.222.0.43 "GET /compute/v2.1/servers/2845d7de-5b4d-4376-9e46-36d5da7c6a14" status: 200 len: 1316 microversion: 2.1 time: 0.377278 Oct 04 19:05:17.388551 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2775/5913] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:05:17 2022] GET /compute/v2.1/servers/2845d7de-5b4d-4376-9e46-36d5da7c6a14 => generated 1316 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:05:17.400587 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-1fadf796-fe55-4b9e-9bcb-34809f088b8f req-acf5052c-6096-4ae8-87d2-5e81a4486a99 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2845d7de-5b4d-4376-9e46-36d5da7c6a14", "tag": "0ed69789-d270-465f-b3d7-51787f0f2b02"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:05:17.434358 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-1fadf796-fe55-4b9e-9bcb-34809f088b8f req-acf5052c-6096-4ae8-87d2-5e81a4486a99 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:17.435426 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-1fadf796-fe55-4b9e-9bcb-34809f088b8f req-acf5052c-6096-4ae8-87d2-5e81a4486a99 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:17.436131 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-1fadf796-fe55-4b9e-9bcb-34809f088b8f req-acf5052c-6096-4ae8-87d2-5e81a4486a99 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:17.452696 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-1fadf796-fe55-4b9e-9bcb-34809f088b8f req-acf5052c-6096-4ae8-87d2-5e81a4486a99 service nova] Creating event network-changed:0ed69789-d270-465f-b3d7-51787f0f2b02 for instance 2845d7de-5b4d-4376-9e46-36d5da7c6a14 on n-h2-851028-13 Oct 04 19:05:17.461295 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-1fadf796-fe55-4b9e-9bcb-34809f088b8f req-acf5052c-6096-4ae8-87d2-5e81a4486a99 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069737 Oct 04 19:05:17.462611 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2776/5914] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:05:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:05:17.934391 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-ceef9aa3-5a07-40f3-a8c1-7da859fe68e2 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf87794979e844349d6ec6c6650565f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c25f1d17e94c74868357744e692487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:17.956138 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-ceef9aa3-5a07-40f3-a8c1-7da859fe68e2 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] 10.222.0.43 "GET /compute/v2.1/servers/75c5754b-3489-46e5-9a52-43e0a6cfd1c7" status: 200 len: 1690 microversion: 2.1 time: 1.386331 Oct 04 19:05:17.959008 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3139/5915] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:05:16 2022] GET /compute/v2.1/servers/75c5754b-3489-46e5-9a52-43e0a6cfd1c7 => generated 1690 bytes in 1396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:05:18.419482 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-06dd241a-dc71-46b8-aeac-d2674c0540b7 tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:18.420206 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-06dd241a-dc71-46b8-aeac-d2674c0540b7 tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] [instance: 2845d7de-5b4d-4376-9e46-36d5da7c6a14] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:18.437634 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-06dd241a-dc71-46b8-aeac-d2674c0540b7 tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:18.439581 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-06dd241a-dc71-46b8-aeac-d2674c0540b7 tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:18.440245 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-06dd241a-dc71-46b8-aeac-d2674c0540b7 tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:18.442972 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-06dd241a-dc71-46b8-aeac-d2674c0540b7 tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:18.443623 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-06dd241a-dc71-46b8-aeac-d2674c0540b7 tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:18.448105 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-06dd241a-dc71-46b8-aeac-d2674c0540b7 tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:18.754593 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-06dd241a-dc71-46b8-aeac-d2674c0540b7 tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11bed3b641da4eeeb406a87b63ad1558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946e98bf99e543b1a1b19909ba741874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:18.771410 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-06dd241a-dc71-46b8-aeac-d2674c0540b7 tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] 10.222.0.43 "GET /compute/v2.1/servers/2845d7de-5b4d-4376-9e46-36d5da7c6a14" status: 200 len: 1316 microversion: 2.1 time: 0.359751 Oct 04 19:05:18.773548 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2777/5916] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:05:18 2022] GET /compute/v2.1/servers/2845d7de-5b4d-4376-9e46-36d5da7c6a14 => generated 1316 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:05:18.985967 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-5d8be3bb-f4f3-4082-adcf-43d1a8d259f8 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:18.987599 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-5d8be3bb-f4f3-4082-adcf-43d1a8d259f8 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] [instance: 75c5754b-3489-46e5-9a52-43e0a6cfd1c7] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:18.999673 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5d8be3bb-f4f3-4082-adcf-43d1a8d259f8 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:19.003989 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5d8be3bb-f4f3-4082-adcf-43d1a8d259f8 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:19.004764 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5d8be3bb-f4f3-4082-adcf-43d1a8d259f8 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:19.005914 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5d8be3bb-f4f3-4082-adcf-43d1a8d259f8 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:19.007735 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5d8be3bb-f4f3-4082-adcf-43d1a8d259f8 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:19.017983 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5d8be3bb-f4f3-4082-adcf-43d1a8d259f8 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:19.269696 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-5d8be3bb-f4f3-4082-adcf-43d1a8d259f8 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf87794979e844349d6ec6c6650565f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c25f1d17e94c74868357744e692487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:19.288506 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-5d8be3bb-f4f3-4082-adcf-43d1a8d259f8 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] 10.222.0.43 "GET /compute/v2.1/servers/75c5754b-3489-46e5-9a52-43e0a6cfd1c7" status: 200 len: 1690 microversion: 2.1 time: 0.300721 Oct 04 19:05:19.298680 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3140/5917] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:05:18 2022] GET /compute/v2.1/servers/75c5754b-3489-46e5-9a52-43e0a6cfd1c7 => generated 1690 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:05:19.608992 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-3487a62e-d19a-41a2-94da-4592672cdb48 req-73bc8c08-6d91-4278-b8cd-e804c183978e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75c5754b-3489-46e5-9a52-43e0a6cfd1c7", "name": "network-vif-plugged", "status": "completed", "tag": "515e62ea-52d3-4ada-b96e-712f01398333"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:05:19.655904 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-3487a62e-d19a-41a2-94da-4592672cdb48 req-73bc8c08-6d91-4278-b8cd-e804c183978e service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:19.656560 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-3487a62e-d19a-41a2-94da-4592672cdb48 req-73bc8c08-6d91-4278-b8cd-e804c183978e service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:19.657030 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-3487a62e-d19a-41a2-94da-4592672cdb48 req-73bc8c08-6d91-4278-b8cd-e804c183978e service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:19.693335 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-3487a62e-d19a-41a2-94da-4592672cdb48 req-73bc8c08-6d91-4278-b8cd-e804c183978e service nova] Creating event network-vif-plugged:515e62ea-52d3-4ada-b96e-712f01398333 for instance 75c5754b-3489-46e5-9a52-43e0a6cfd1c7 on n-h2-851028-13 Oct 04 19:05:19.719431 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [req-3487a62e-d19a-41a2-94da-4592672cdb48 req-73bc8c08-6d91-4278-b8cd-e804c183978e service nova] Instance 75c5754b-3489-46e5-9a52-43e0a6cfd1c7 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851028-13', 'n-h2-851028-13'} {{(pid=123595) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 19:05:19.755414 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-3487a62e-d19a-41a2-94da-4592672cdb48 req-73bc8c08-6d91-4278-b8cd-e804c183978e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.151730 Oct 04 19:05:19.760059 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2778/5918] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:05:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:05:19.796927 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-fa0f9c08-c724-4109-8d8d-a2be9d0564dc tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:19.797859 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-fa0f9c08-c724-4109-8d8d-a2be9d0564dc tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] [instance: 2845d7de-5b4d-4376-9e46-36d5da7c6a14] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:19.836658 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fa0f9c08-c724-4109-8d8d-a2be9d0564dc tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:19.838515 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fa0f9c08-c724-4109-8d8d-a2be9d0564dc tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:19.840422 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fa0f9c08-c724-4109-8d8d-a2be9d0564dc tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:19.842924 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fa0f9c08-c724-4109-8d8d-a2be9d0564dc tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:19.843802 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fa0f9c08-c724-4109-8d8d-a2be9d0564dc tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:19.845986 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fa0f9c08-c724-4109-8d8d-a2be9d0564dc tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:20.176861 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-fa0f9c08-c724-4109-8d8d-a2be9d0564dc tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11bed3b641da4eeeb406a87b63ad1558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946e98bf99e543b1a1b19909ba741874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:20.191338 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-fa0f9c08-c724-4109-8d8d-a2be9d0564dc tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] 10.222.0.43 "GET /compute/v2.1/servers/2845d7de-5b4d-4376-9e46-36d5da7c6a14" status: 200 len: 1316 microversion: 2.1 time: 0.398100 Oct 04 19:05:20.194474 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3141/5919] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:05:19 2022] GET /compute/v2.1/servers/2845d7de-5b4d-4376-9e46-36d5da7c6a14 => generated 1316 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:05:20.318263 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-a7f344eb-43af-4190-abb3-f857a7eec0bb tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:20.319243 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-a7f344eb-43af-4190-abb3-f857a7eec0bb tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] [instance: 75c5754b-3489-46e5-9a52-43e0a6cfd1c7] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:20.337287 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a7f344eb-43af-4190-abb3-f857a7eec0bb tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:20.337926 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a7f344eb-43af-4190-abb3-f857a7eec0bb tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:20.338624 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a7f344eb-43af-4190-abb3-f857a7eec0bb tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:20.339965 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a7f344eb-43af-4190-abb3-f857a7eec0bb tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:20.343124 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a7f344eb-43af-4190-abb3-f857a7eec0bb tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:20.343702 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a7f344eb-43af-4190-abb3-f857a7eec0bb tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:20.753858 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-a7f344eb-43af-4190-abb3-f857a7eec0bb tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf87794979e844349d6ec6c6650565f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c25f1d17e94c74868357744e692487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:20.767812 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-a7f344eb-43af-4190-abb3-f857a7eec0bb tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] 10.222.0.43 "GET /compute/v2.1/servers/75c5754b-3489-46e5-9a52-43e0a6cfd1c7" status: 200 len: 1690 microversion: 2.1 time: 0.452515 Oct 04 19:05:20.769270 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2779/5920] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:05:20 2022] GET /compute/v2.1/servers/75c5754b-3489-46e5-9a52-43e0a6cfd1c7 => generated 1690 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:05:21.221211 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-149a71ba-2662-4c1d-a442-dbf4389f7428 tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:21.223650 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-149a71ba-2662-4c1d-a442-dbf4389f7428 tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] [instance: 2845d7de-5b4d-4376-9e46-36d5da7c6a14] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:21.237334 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=2 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:05:21.240920 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=6 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:05:21.245000 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-149a71ba-2662-4c1d-a442-dbf4389f7428 tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:21.248590 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-149a71ba-2662-4c1d-a442-dbf4389f7428 tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:21.250046 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-149a71ba-2662-4c1d-a442-dbf4389f7428 tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:21.251077 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-149a71ba-2662-4c1d-a442-dbf4389f7428 tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:21.251802 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-149a71ba-2662-4c1d-a442-dbf4389f7428 tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:21.252468 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-149a71ba-2662-4c1d-a442-dbf4389f7428 tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:21.730490 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-149a71ba-2662-4c1d-a442-dbf4389f7428 tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11bed3b641da4eeeb406a87b63ad1558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946e98bf99e543b1a1b19909ba741874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:21.748311 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-149a71ba-2662-4c1d-a442-dbf4389f7428 tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] 10.222.0.43 "GET /compute/v2.1/servers/2845d7de-5b4d-4376-9e46-36d5da7c6a14" status: 200 len: 1316 microversion: 2.1 time: 0.534632 Oct 04 19:05:21.749988 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3142/5921] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:05:21 2022] GET /compute/v2.1/servers/2845d7de-5b4d-4376-9e46-36d5da7c6a14 => generated 1316 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:05:21.799880 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-b986b933-d081-4c34-aa29-19fd430d7329 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:21.801204 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-b986b933-d081-4c34-aa29-19fd430d7329 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] [instance: 75c5754b-3489-46e5-9a52-43e0a6cfd1c7] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:21.810872 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=2 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:05:21.815821 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b986b933-d081-4c34-aa29-19fd430d7329 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:21.816690 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b986b933-d081-4c34-aa29-19fd430d7329 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:21.817814 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b986b933-d081-4c34-aa29-19fd430d7329 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:21.819800 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b986b933-d081-4c34-aa29-19fd430d7329 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:21.820638 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b986b933-d081-4c34-aa29-19fd430d7329 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:21.821401 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b986b933-d081-4c34-aa29-19fd430d7329 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:22.526872 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-b986b933-d081-4c34-aa29-19fd430d7329 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf87794979e844349d6ec6c6650565f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c25f1d17e94c74868357744e692487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:22.538523 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-b986b933-d081-4c34-aa29-19fd430d7329 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] 10.222.0.43 "GET /compute/v2.1/servers/75c5754b-3489-46e5-9a52-43e0a6cfd1c7" status: 200 len: 1690 microversion: 2.1 time: 0.743210 Oct 04 19:05:22.539937 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2780/5922] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:05:21 2022] GET /compute/v2.1/servers/75c5754b-3489-46e5-9a52-43e0a6cfd1c7 => generated 1690 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:05:22.775171 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-4c53b0b4-899a-4fce-965c-d46a95b5156f tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:22.778603 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-4c53b0b4-899a-4fce-965c-d46a95b5156f tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] [instance: 2845d7de-5b4d-4376-9e46-36d5da7c6a14] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:22.793309 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4c53b0b4-899a-4fce-965c-d46a95b5156f tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:22.797088 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4c53b0b4-899a-4fce-965c-d46a95b5156f tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:22.797846 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4c53b0b4-899a-4fce-965c-d46a95b5156f tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:22.799072 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4c53b0b4-899a-4fce-965c-d46a95b5156f tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:22.799868 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4c53b0b4-899a-4fce-965c-d46a95b5156f tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:22.800584 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4c53b0b4-899a-4fce-965c-d46a95b5156f tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:23.129604 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-4c53b0b4-899a-4fce-965c-d46a95b5156f tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11bed3b641da4eeeb406a87b63ad1558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946e98bf99e543b1a1b19909ba741874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:23.140640 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-4c53b0b4-899a-4fce-965c-d46a95b5156f tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] 10.222.0.43 "GET /compute/v2.1/servers/2845d7de-5b4d-4376-9e46-36d5da7c6a14" status: 200 len: 1316 microversion: 2.1 time: 0.370254 Oct 04 19:05:23.143970 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3143/5923] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:05:22 2022] GET /compute/v2.1/servers/2845d7de-5b4d-4376-9e46-36d5da7c6a14 => generated 1316 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:05:23.531628 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-f164b912-7446-4f64-918b-e34d60841c71 req-1178e73d-54ff-4acf-82dc-0337e91dbe7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2845d7de-5b4d-4376-9e46-36d5da7c6a14", "name": "network-vif-plugged", "status": "completed", "tag": "0ed69789-d270-465f-b3d7-51787f0f2b02"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:05:23.564405 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-7a0410a7-ce29-4979-a8b7-a3fcc85108f1 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:23.565452 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-7a0410a7-ce29-4979-a8b7-a3fcc85108f1 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] [instance: 75c5754b-3489-46e5-9a52-43e0a6cfd1c7] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:23.574302 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-f164b912-7446-4f64-918b-e34d60841c71 req-1178e73d-54ff-4acf-82dc-0337e91dbe7a service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:23.574811 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-f164b912-7446-4f64-918b-e34d60841c71 req-1178e73d-54ff-4acf-82dc-0337e91dbe7a service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:23.575263 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-f164b912-7446-4f64-918b-e34d60841c71 req-1178e73d-54ff-4acf-82dc-0337e91dbe7a service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:23.579047 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7a0410a7-ce29-4979-a8b7-a3fcc85108f1 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:23.588593 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7a0410a7-ce29-4979-a8b7-a3fcc85108f1 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:23.589485 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7a0410a7-ce29-4979-a8b7-a3fcc85108f1 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:23.590486 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7a0410a7-ce29-4979-a8b7-a3fcc85108f1 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:23.591421 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7a0410a7-ce29-4979-a8b7-a3fcc85108f1 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:23.594454 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7a0410a7-ce29-4979-a8b7-a3fcc85108f1 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:23.639704 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-f164b912-7446-4f64-918b-e34d60841c71 req-1178e73d-54ff-4acf-82dc-0337e91dbe7a service nova] Creating event network-vif-plugged:0ed69789-d270-465f-b3d7-51787f0f2b02 for instance 2845d7de-5b4d-4376-9e46-36d5da7c6a14 on n-h2-851028-13 Oct 04 19:05:23.665137 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-f164b912-7446-4f64-918b-e34d60841c71 req-1178e73d-54ff-4acf-82dc-0337e91dbe7a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133417 Oct 04 19:05:23.671226 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2781/5924] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:05:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:05:24.033933 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-db41cf38-5649-4c45-833c-1cf2ae13588b req-90697a75-ef10-46a3-a169-3681e70c66f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75c5754b-3489-46e5-9a52-43e0a6cfd1c7", "name": "network-vif-unplugged", "status": "completed", "tag": "515e62ea-52d3-4ada-b96e-712f01398333"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:05:24.039979 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-7a0410a7-ce29-4979-a8b7-a3fcc85108f1 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf87794979e844349d6ec6c6650565f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c25f1d17e94c74868357744e692487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:24.049620 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-7a0410a7-ce29-4979-a8b7-a3fcc85108f1 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] 10.222.0.43 "GET /compute/v2.1/servers/75c5754b-3489-46e5-9a52-43e0a6cfd1c7" status: 200 len: 1690 microversion: 2.1 time: 0.489077 Oct 04 19:05:24.050995 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3144/5925] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:05:23 2022] GET /compute/v2.1/servers/75c5754b-3489-46e5-9a52-43e0a6cfd1c7 => generated 1690 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:05:24.062101 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-db41cf38-5649-4c45-833c-1cf2ae13588b req-90697a75-ef10-46a3-a169-3681e70c66f2 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:24.067260 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-db41cf38-5649-4c45-833c-1cf2ae13588b req-90697a75-ef10-46a3-a169-3681e70c66f2 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:24.067759 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-db41cf38-5649-4c45-833c-1cf2ae13588b req-90697a75-ef10-46a3-a169-3681e70c66f2 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:24.124764 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-db41cf38-5649-4c45-833c-1cf2ae13588b req-90697a75-ef10-46a3-a169-3681e70c66f2 service nova] Creating event network-vif-unplugged:515e62ea-52d3-4ada-b96e-712f01398333 for instance 75c5754b-3489-46e5-9a52-43e0a6cfd1c7 on n-h1-851028-13 Oct 04 19:05:24.147696 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [req-db41cf38-5649-4c45-833c-1cf2ae13588b req-90697a75-ef10-46a3-a169-3681e70c66f2 service nova] Instance 75c5754b-3489-46e5-9a52-43e0a6cfd1c7 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851028-13', 'n-h2-851028-13'} {{(pid=123595) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 19:05:24.166235 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-2354b5eb-01eb-42f9-b155-c18cf5b28125 tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:24.169027 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-2354b5eb-01eb-42f9-b155-c18cf5b28125 tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] [instance: 2845d7de-5b4d-4376-9e46-36d5da7c6a14] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:24.196980 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-db41cf38-5649-4c45-833c-1cf2ae13588b req-90697a75-ef10-46a3-a169-3681e70c66f2 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.168182 Oct 04 19:05:24.201008 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2354b5eb-01eb-42f9-b155-c18cf5b28125 tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:24.201559 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2354b5eb-01eb-42f9-b155-c18cf5b28125 tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:24.202159 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2354b5eb-01eb-42f9-b155-c18cf5b28125 tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:24.204540 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2782/5926] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:05:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:05:24.210802 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2354b5eb-01eb-42f9-b155-c18cf5b28125 tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:24.213095 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2354b5eb-01eb-42f9-b155-c18cf5b28125 tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:24.213592 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2354b5eb-01eb-42f9-b155-c18cf5b28125 tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:24.601077 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-2354b5eb-01eb-42f9-b155-c18cf5b28125 tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11bed3b641da4eeeb406a87b63ad1558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946e98bf99e543b1a1b19909ba741874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:24.611629 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-2354b5eb-01eb-42f9-b155-c18cf5b28125 tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] 10.222.0.43 "GET /compute/v2.1/servers/2845d7de-5b4d-4376-9e46-36d5da7c6a14" status: 200 len: 1316 microversion: 2.1 time: 0.450014 Oct 04 19:05:24.619368 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3145/5927] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:05:24 2022] GET /compute/v2.1/servers/2845d7de-5b4d-4376-9e46-36d5da7c6a14 => generated 1316 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:05:25.076663 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-24d88325-69ab-426c-ab7f-974451e1dcb2 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:25.078093 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-24d88325-69ab-426c-ab7f-974451e1dcb2 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] [instance: 75c5754b-3489-46e5-9a52-43e0a6cfd1c7] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:25.108802 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-24d88325-69ab-426c-ab7f-974451e1dcb2 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:25.111446 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-24d88325-69ab-426c-ab7f-974451e1dcb2 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:25.113187 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-24d88325-69ab-426c-ab7f-974451e1dcb2 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:25.115395 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-24d88325-69ab-426c-ab7f-974451e1dcb2 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:25.118324 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-24d88325-69ab-426c-ab7f-974451e1dcb2 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:25.120280 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-24d88325-69ab-426c-ab7f-974451e1dcb2 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:25.624927 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-24d88325-69ab-426c-ab7f-974451e1dcb2 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf87794979e844349d6ec6c6650565f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c25f1d17e94c74868357744e692487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:25.635435 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-ce4883f9-5bff-4c57-8138-25568fc4e6e2 tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:25.636061 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-ce4883f9-5bff-4c57-8138-25568fc4e6e2 tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] [instance: 2845d7de-5b4d-4376-9e46-36d5da7c6a14] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:25.637148 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-24d88325-69ab-426c-ab7f-974451e1dcb2 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] 10.222.0.43 "GET /compute/v2.1/servers/75c5754b-3489-46e5-9a52-43e0a6cfd1c7" status: 200 len: 1690 microversion: 2.1 time: 0.565321 Oct 04 19:05:25.640466 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2783/5928] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:05:25 2022] GET /compute/v2.1/servers/75c5754b-3489-46e5-9a52-43e0a6cfd1c7 => generated 1690 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:05:25.664215 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ce4883f9-5bff-4c57-8138-25568fc4e6e2 tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:25.664825 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ce4883f9-5bff-4c57-8138-25568fc4e6e2 tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:25.665330 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ce4883f9-5bff-4c57-8138-25568fc4e6e2 tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:25.666114 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ce4883f9-5bff-4c57-8138-25568fc4e6e2 tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:25.666573 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ce4883f9-5bff-4c57-8138-25568fc4e6e2 tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:25.667017 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ce4883f9-5bff-4c57-8138-25568fc4e6e2 tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:26.306182 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-301b463c-fad0-4f53-8e55-69c3595132ef req-d5b16a4b-2ebd-4cf6-bbb7-0034afecc9fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75c5754b-3489-46e5-9a52-43e0a6cfd1c7", "tag": "515e62ea-52d3-4ada-b96e-712f01398333"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:05:26.323168 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-301b463c-fad0-4f53-8e55-69c3595132ef req-d5b16a4b-2ebd-4cf6-bbb7-0034afecc9fc service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:26.359722 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-301b463c-fad0-4f53-8e55-69c3595132ef req-d5b16a4b-2ebd-4cf6-bbb7-0034afecc9fc service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.036s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:26.362263 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-301b463c-fad0-4f53-8e55-69c3595132ef req-d5b16a4b-2ebd-4cf6-bbb7-0034afecc9fc service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:26.437543 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-301b463c-fad0-4f53-8e55-69c3595132ef req-d5b16a4b-2ebd-4cf6-bbb7-0034afecc9fc service nova] Creating event network-changed:515e62ea-52d3-4ada-b96e-712f01398333 for instance 75c5754b-3489-46e5-9a52-43e0a6cfd1c7 on n-h1-851028-13 Oct 04 19:05:26.699078 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [req-301b463c-fad0-4f53-8e55-69c3595132ef req-d5b16a4b-2ebd-4cf6-bbb7-0034afecc9fc service nova] Instance 75c5754b-3489-46e5-9a52-43e0a6cfd1c7 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851028-13', 'n-h2-851028-13'} {{(pid=123595) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 19:05:26.699078 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-301b463c-fad0-4f53-8e55-69c3595132ef req-d5b16a4b-2ebd-4cf6-bbb7-0034afecc9fc service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.231184 Oct 04 19:05:26.699078 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2784/5929] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:05:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Oct 04 19:05:26.707007 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-ce4883f9-5bff-4c57-8138-25568fc4e6e2 tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11bed3b641da4eeeb406a87b63ad1558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946e98bf99e543b1a1b19909ba741874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:26.707007 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-ce4883f9-5bff-4c57-8138-25568fc4e6e2 tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] 10.222.0.43 "GET /compute/v2.1/servers/2845d7de-5b4d-4376-9e46-36d5da7c6a14" status: 200 len: 1505 microversion: 2.1 time: 1.037530 Oct 04 19:05:26.708405 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-39be55d7-9648-4cb7-b322-842b32af5f20 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:26.708405 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-39be55d7-9648-4cb7-b322-842b32af5f20 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] [instance: 75c5754b-3489-46e5-9a52-43e0a6cfd1c7] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:26.708848 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3146/5930] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:05:25 2022] GET /compute/v2.1/servers/2845d7de-5b4d-4376-9e46-36d5da7c6a14 => generated 1505 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:05:26.708848 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-945f82b4-ca94-47d9-a8ad-fa6a73b421f6 tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:26.708848 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-945f82b4-ca94-47d9-a8ad-fa6a73b421f6 tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] [instance: 2845d7de-5b4d-4376-9e46-36d5da7c6a14] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:26.710964 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-945f82b4-ca94-47d9-a8ad-fa6a73b421f6 tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:26.711477 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-945f82b4-ca94-47d9-a8ad-fa6a73b421f6 tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:26.712296 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-945f82b4-ca94-47d9-a8ad-fa6a73b421f6 tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:26.713307 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-945f82b4-ca94-47d9-a8ad-fa6a73b421f6 tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:26.714100 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-945f82b4-ca94-47d9-a8ad-fa6a73b421f6 tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:26.714767 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-945f82b4-ca94-47d9-a8ad-fa6a73b421f6 tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:26.716092 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-39be55d7-9648-4cb7-b322-842b32af5f20 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:26.716455 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-39be55d7-9648-4cb7-b322-842b32af5f20 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:26.716677 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-39be55d7-9648-4cb7-b322-842b32af5f20 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:26.725928 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-39be55d7-9648-4cb7-b322-842b32af5f20 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:26.726446 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-39be55d7-9648-4cb7-b322-842b32af5f20 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:26.727184 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-39be55d7-9648-4cb7-b322-842b32af5f20 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:26.747022 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-945f82b4-ca94-47d9-a8ad-fa6a73b421f6 tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': '11bed3b641da4eeeb406a87b63ad1558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946e98bf99e543b1a1b19909ba741874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:26.748124 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-945f82b4-ca94-47d9-a8ad-fa6a73b421f6 tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] 10.222.0.43 "GET /compute/v2.1/servers/2845d7de-5b4d-4376-9e46-36d5da7c6a14/os-instance-actions/req-0b9598c7-b5f7-4a10-a3f8-bdb8c3f94edf" status: 200 len: 313 microversion: 2.1 time: 0.055552 Oct 04 19:05:26.758214 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3147/5931] 10.222.0.43 () {58 vars in 1419 bytes} [Tue Oct 4 19:05:26 2022] GET /compute/v2.1/servers/2845d7de-5b4d-4376-9e46-36d5da7c6a14/os-instance-actions/req-0b9598c7-b5f7-4a10-a3f8-bdb8c3f94edf => generated 313 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:05:26.763553 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-869d34ff-dd4a-4e8d-acf3-868577845bb8 tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:05:26.766182 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-869d34ff-dd4a-4e8d-acf3-868577845bb8 tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] [instance: 2845d7de-5b4d-4376-9e46-36d5da7c6a14] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:26.774112 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-869d34ff-dd4a-4e8d-acf3-868577845bb8 tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:26.774737 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-869d34ff-dd4a-4e8d-acf3-868577845bb8 tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:26.775255 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-869d34ff-dd4a-4e8d-acf3-868577845bb8 tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:26.776109 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-869d34ff-dd4a-4e8d-acf3-868577845bb8 tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:26.776649 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-869d34ff-dd4a-4e8d-acf3-868577845bb8 tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:26.777183 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-869d34ff-dd4a-4e8d-acf3-868577845bb8 tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:26.901796 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-869d34ff-dd4a-4e8d-acf3-868577845bb8 tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] 10.222.0.43 "POST /compute/v2.1/servers/2845d7de-5b4d-4376-9e46-36d5da7c6a14/action" status: 202 len: 0 microversion: 2.1 time: 0.134942 Oct 04 19:05:26.902551 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3148/5932] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 19:05:26 2022] POST /compute/v2.1/servers/2845d7de-5b4d-4376-9e46-36d5da7c6a14/action => generated 0 bytes in 144 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:05:26.916514 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-47d60074-5660-4607-9104-7598e09f8382 tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:26.918082 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-47d60074-5660-4607-9104-7598e09f8382 tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] [instance: 2845d7de-5b4d-4376-9e46-36d5da7c6a14] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:26.964232 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-47d60074-5660-4607-9104-7598e09f8382 tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:26.965272 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-47d60074-5660-4607-9104-7598e09f8382 tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.031s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:26.965917 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-47d60074-5660-4607-9104-7598e09f8382 tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:26.966886 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-47d60074-5660-4607-9104-7598e09f8382 tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:26.969773 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-47d60074-5660-4607-9104-7598e09f8382 tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:26.970452 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-47d60074-5660-4607-9104-7598e09f8382 tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:26.993315 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:05:27.408068 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-47d60074-5660-4607-9104-7598e09f8382 tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11bed3b641da4eeeb406a87b63ad1558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946e98bf99e543b1a1b19909ba741874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:27.419824 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-47d60074-5660-4607-9104-7598e09f8382 tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] 10.222.0.43 "GET /compute/v2.1/servers/2845d7de-5b4d-4376-9e46-36d5da7c6a14" status: 200 len: 1507 microversion: 2.1 time: 0.507447 Oct 04 19:05:27.421291 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3149/5933] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:05:26 2022] GET /compute/v2.1/servers/2845d7de-5b4d-4376-9e46-36d5da7c6a14 => generated 1507 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:05:27.604072 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-39be55d7-9648-4cb7-b322-842b32af5f20 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf87794979e844349d6ec6c6650565f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c25f1d17e94c74868357744e692487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:27.624537 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-39be55d7-9648-4cb7-b322-842b32af5f20 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] 10.222.0.43 "GET /compute/v2.1/servers/75c5754b-3489-46e5-9a52-43e0a6cfd1c7" status: 200 len: 1690 microversion: 2.1 time: 0.959334 Oct 04 19:05:27.625196 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2785/5934] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:05:26 2022] GET /compute/v2.1/servers/75c5754b-3489-46e5-9a52-43e0a6cfd1c7 => generated 1690 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:05:28.448258 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-8598cbee-294e-44b9-b041-0e12489ea2ab tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:28.449333 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-8598cbee-294e-44b9-b041-0e12489ea2ab tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] [instance: 2845d7de-5b4d-4376-9e46-36d5da7c6a14] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:28.483158 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8598cbee-294e-44b9-b041-0e12489ea2ab tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:28.487508 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8598cbee-294e-44b9-b041-0e12489ea2ab tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:28.489323 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8598cbee-294e-44b9-b041-0e12489ea2ab tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:28.493750 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8598cbee-294e-44b9-b041-0e12489ea2ab tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:28.495892 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8598cbee-294e-44b9-b041-0e12489ea2ab tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:28.496394 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8598cbee-294e-44b9-b041-0e12489ea2ab tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:28.796817 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-31845273-0e36-4cc7-beae-08f895b246fd tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Action: 'create', calling method: .version_select at 0x7fb21f0e8040>, body: {"keypair": {"name": "tempest-keypair-946758509", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKH6KLwCFBrnryk8RPdM/kAz8J33rTTsy8gfErHNC62XTnOwR6YjaD7KcafAiSil5Tbl44m03n7jMdw54x1OVE+MxudC02B+v7TaR8FkXU2vp+EEFDzNFTPCDjEoUPIffQ=="}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:05:28.862347 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-31845273-0e36-4cc7-beae-08f895b246fd tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Getting quotas for project 93413a82cb584df38e5686c1ffbcfefe. Resources: {'key_pairs'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:05:28.896621 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-31845273-0e36-4cc7-beae-08f895b246fd tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Getting quotas for user 78f8a576e39b4ef9a7fe0b8a2723e54e and project 93413a82cb584df38e5686c1ffbcfefe. Resources: {'key_pairs'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:05:28.986928 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-31845273-0e36-4cc7-beae-08f895b246fd tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.567065 Oct 04 19:05:28.997022 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3150/5935] 10.222.0.43 () {62 vars in 1200 bytes} [Tue Oct 4 19:05:28 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 578 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 04 19:05:29.008262 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-ebdff075-1c30-4709-86c1-7a310a1e4248 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:29.009544 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-ebdff075-1c30-4709-86c1-7a310a1e4248 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] [instance: 75c5754b-3489-46e5-9a52-43e0a6cfd1c7] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:29.037262 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ebdff075-1c30-4709-86c1-7a310a1e4248 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:29.038363 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ebdff075-1c30-4709-86c1-7a310a1e4248 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:29.038846 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ebdff075-1c30-4709-86c1-7a310a1e4248 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:29.039619 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ebdff075-1c30-4709-86c1-7a310a1e4248 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:29.040087 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ebdff075-1c30-4709-86c1-7a310a1e4248 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:29.040527 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ebdff075-1c30-4709-86c1-7a310a1e4248 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:29.726037 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-8598cbee-294e-44b9-b041-0e12489ea2ab tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11bed3b641da4eeeb406a87b63ad1558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946e98bf99e543b1a1b19909ba741874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:29.754290 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-8598cbee-294e-44b9-b041-0e12489ea2ab tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] 10.222.0.43 "GET /compute/v2.1/servers/2845d7de-5b4d-4376-9e46-36d5da7c6a14" status: 200 len: 1507 microversion: 2.1 time: 1.309064 Oct 04 19:05:29.755197 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2786/5936] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:05:28 2022] GET /compute/v2.1/servers/2845d7de-5b4d-4376-9e46-36d5da7c6a14 => generated 1507 bytes in 1313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:05:30.027184 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-ebdff075-1c30-4709-86c1-7a310a1e4248 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf87794979e844349d6ec6c6650565f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c25f1d17e94c74868357744e692487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:30.046310 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-ebdff075-1c30-4709-86c1-7a310a1e4248 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] 10.222.0.43 "GET /compute/v2.1/servers/75c5754b-3489-46e5-9a52-43e0a6cfd1c7" status: 200 len: 1683 microversion: 2.1 time: 1.036872 Oct 04 19:05:30.050026 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3151/5937] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:05:28 2022] GET /compute/v2.1/servers/75c5754b-3489-46e5-9a52-43e0a6cfd1c7 => generated 1683 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:05:30.784723 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-81f74c25-4a2f-4922-9b34-3f4b35ecc9a6 tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:30.785869 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-81f74c25-4a2f-4922-9b34-3f4b35ecc9a6 tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] [instance: 2845d7de-5b4d-4376-9e46-36d5da7c6a14] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:30.807818 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-81f74c25-4a2f-4922-9b34-3f4b35ecc9a6 tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:30.816857 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-81f74c25-4a2f-4922-9b34-3f4b35ecc9a6 tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:30.816857 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-81f74c25-4a2f-4922-9b34-3f4b35ecc9a6 tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:30.823204 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-81f74c25-4a2f-4922-9b34-3f4b35ecc9a6 tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:30.825926 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-81f74c25-4a2f-4922-9b34-3f4b35ecc9a6 tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:30.831291 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-81f74c25-4a2f-4922-9b34-3f4b35ecc9a6 tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:31.533536 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-81f74c25-4a2f-4922-9b34-3f4b35ecc9a6 tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11bed3b641da4eeeb406a87b63ad1558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946e98bf99e543b1a1b19909ba741874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:31.543242 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-81f74c25-4a2f-4922-9b34-3f4b35ecc9a6 tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] 10.222.0.43 "GET /compute/v2.1/servers/2845d7de-5b4d-4376-9e46-36d5da7c6a14" status: 200 len: 1505 microversion: 2.1 time: 0.763851 Oct 04 19:05:31.553945 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2787/5938] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:05:30 2022] GET /compute/v2.1/servers/2845d7de-5b4d-4376-9e46-36d5da7c6a14 => generated 1505 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:05:31.587206 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-45b24a12-526e-4c16-95ca-07feee00ddc7 tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] Calling method '.version_select at 0x7fb21ea80040>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:31.591778 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-45b24a12-526e-4c16-95ca-07feee00ddc7 tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] [instance: 2845d7de-5b4d-4376-9e46-36d5da7c6a14] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:31.617280 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-45b24a12-526e-4c16-95ca-07feee00ddc7 tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:31.622358 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-45b24a12-526e-4c16-95ca-07feee00ddc7 tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:31.622934 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-45b24a12-526e-4c16-95ca-07feee00ddc7 tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:31.624500 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-45b24a12-526e-4c16-95ca-07feee00ddc7 tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:31.627842 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-45b24a12-526e-4c16-95ca-07feee00ddc7 tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:31.629452 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-45b24a12-526e-4c16-95ca-07feee00ddc7 tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:31.726310 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-45b24a12-526e-4c16-95ca-07feee00ddc7 tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] 10.222.0.43 "GET /compute/v2.1/servers/2845d7de-5b4d-4376-9e46-36d5da7c6a14/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.148226 Oct 04 19:05:31.729670 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3152/5939] 10.222.0.43 () {58 vars in 1296 bytes} [Tue Oct 4 19:05:31 2022] GET /compute/v2.1/servers/2845d7de-5b4d-4376-9e46-36d5da7c6a14/os-instance-actions => generated 611 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:05:31.744212 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-39522a9c-e294-4ad2-b4e7-c6d0fbe91760 tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:31.744953 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-39522a9c-e294-4ad2-b4e7-c6d0fbe91760 tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] [instance: 2845d7de-5b4d-4376-9e46-36d5da7c6a14] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:31.757038 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-39522a9c-e294-4ad2-b4e7-c6d0fbe91760 tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:31.757717 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-39522a9c-e294-4ad2-b4e7-c6d0fbe91760 tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:31.759790 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-39522a9c-e294-4ad2-b4e7-c6d0fbe91760 tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:31.760621 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-39522a9c-e294-4ad2-b4e7-c6d0fbe91760 tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:31.762107 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-39522a9c-e294-4ad2-b4e7-c6d0fbe91760 tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:31.763395 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-39522a9c-e294-4ad2-b4e7-c6d0fbe91760 tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:31.825139 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-39522a9c-e294-4ad2-b4e7-c6d0fbe91760 tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] [instance: 2845d7de-5b4d-4376-9e46-36d5da7c6a14] Going to try to terminate instance {{(pid=123595) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 19:05:32.060675 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-39522a9c-e294-4ad2-b4e7-c6d0fbe91760 tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] 10.222.0.43 "DELETE /compute/v2.1/servers/2845d7de-5b4d-4376-9e46-36d5da7c6a14" status: 204 len: 0 microversion: 2.1 time: 0.320267 Oct 04 19:05:32.065583 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2788/5940] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 19:05:31 2022] DELETE /compute/v2.1/servers/2845d7de-5b4d-4376-9e46-36d5da7c6a14 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:05:32.070747 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-20103adf-715a-4a10-bbf7-e6a5164c90c7 tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:32.071372 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-20103adf-715a-4a10-bbf7-e6a5164c90c7 tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] [instance: 2845d7de-5b4d-4376-9e46-36d5da7c6a14] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:32.073505 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=4 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:05:32.091511 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-20103adf-715a-4a10-bbf7-e6a5164c90c7 tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:32.092016 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-20103adf-715a-4a10-bbf7-e6a5164c90c7 tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:32.092459 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-20103adf-715a-4a10-bbf7-e6a5164c90c7 tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:32.093224 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-20103adf-715a-4a10-bbf7-e6a5164c90c7 tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:32.093841 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-20103adf-715a-4a10-bbf7-e6a5164c90c7 tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:32.095518 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-20103adf-715a-4a10-bbf7-e6a5164c90c7 tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:32.526139 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-20103adf-715a-4a10-bbf7-e6a5164c90c7 tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11bed3b641da4eeeb406a87b63ad1558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946e98bf99e543b1a1b19909ba741874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:32.534490 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-20103adf-715a-4a10-bbf7-e6a5164c90c7 tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] 10.222.0.43 "GET /compute/v2.1/servers/2845d7de-5b4d-4376-9e46-36d5da7c6a14" status: 200 len: 1511 microversion: 2.1 time: 0.467577 Oct 04 19:05:32.537955 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3153/5941] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:05:32 2022] GET /compute/v2.1/servers/2845d7de-5b4d-4376-9e46-36d5da7c6a14 => generated 1511 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:05:33.168985 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-d90e41f7-abcf-4b40-a844-9f39d1ac44e4 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1325970873", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "610008a4-b36b-4884-9bcc-e009a3affe81"}], "security_groups": [{"name": "tempest-securitygroup--1351887241"}], "key_name": "tempest-keypair-946758509", "user_data": "}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:05:33.372599 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.network.neutron [None req-d90e41f7-abcf-4b40-a844-9f39d1ac44e4 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] validate_networks() for [('610008a4-b36b-4884-9bcc-e009a3affe81', None, None, None, None, None)] {{(pid=123595) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 19:05:33.560624 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-089aec1c-22a4-4566-9ced-22d0223d2f0c req-66232952-b461-44af-b43c-15c092967fdf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75c5754b-3489-46e5-9a52-43e0a6cfd1c7", "name": "network-vif-plugged", "status": "completed", "tag": "515e62ea-52d3-4ada-b96e-712f01398333"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:05:33.599420 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-089aec1c-22a4-4566-9ced-22d0223d2f0c req-66232952-b461-44af-b43c-15c092967fdf service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:33.600260 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-089aec1c-22a4-4566-9ced-22d0223d2f0c req-66232952-b461-44af-b43c-15c092967fdf service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:33.605356 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-089aec1c-22a4-4566-9ced-22d0223d2f0c req-66232952-b461-44af-b43c-15c092967fdf service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:33.636015 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-089aec1c-22a4-4566-9ced-22d0223d2f0c req-66232952-b461-44af-b43c-15c092967fdf service nova] Creating event network-vif-plugged:515e62ea-52d3-4ada-b96e-712f01398333 for instance 75c5754b-3489-46e5-9a52-43e0a6cfd1c7 on n-h1-851028-13 Oct 04 19:05:33.649271 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-089aec1c-22a4-4566-9ced-22d0223d2f0c req-66232952-b461-44af-b43c-15c092967fdf service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092988 Oct 04 19:05:33.670910 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3154/5942] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:05:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:05:33.693041 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-e77a3b58-1b07-4a9a-8c15-194faeb77f3e tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:33.696899 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-e77a3b58-1b07-4a9a-8c15-194faeb77f3e tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] [instance: 2845d7de-5b4d-4376-9e46-36d5da7c6a14] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:33.712670 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e77a3b58-1b07-4a9a-8c15-194faeb77f3e tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:33.713431 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e77a3b58-1b07-4a9a-8c15-194faeb77f3e tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:33.715345 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e77a3b58-1b07-4a9a-8c15-194faeb77f3e tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:33.716284 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e77a3b58-1b07-4a9a-8c15-194faeb77f3e tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:33.720756 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e77a3b58-1b07-4a9a-8c15-194faeb77f3e tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:33.721447 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e77a3b58-1b07-4a9a-8c15-194faeb77f3e tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:34.129032 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-d90e41f7-abcf-4b40-a844-9f39d1ac44e4 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Flavor limits 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:05:34.129611 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-d90e41f7-abcf-4b40-a844-9f39d1ac44e4 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Image limits 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:05:34.130180 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-d90e41f7-abcf-4b40-a844-9f39d1ac44e4 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Flavor pref 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:05:34.130936 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-d90e41f7-abcf-4b40-a844-9f39d1ac44e4 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Image pref 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:05:34.131991 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-d90e41f7-abcf-4b40-a844-9f39d1ac44e4 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:05:34.142966 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d90e41f7-abcf-4b40-a844-9f39d1ac44e4 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:34.143487 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d90e41f7-abcf-4b40-a844-9f39d1ac44e4 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:34.144011 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d90e41f7-abcf-4b40-a844-9f39d1ac44e4 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:34.144837 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d90e41f7-abcf-4b40-a844-9f39d1ac44e4 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:34.145403 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d90e41f7-abcf-4b40-a844-9f39d1ac44e4 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:34.146102 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d90e41f7-abcf-4b40-a844-9f39d1ac44e4 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:34.159452 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:05:34.175132 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-d90e41f7-abcf-4b40-a844-9f39d1ac44e4 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Getting quotas for project 93413a82cb584df38e5686c1ffbcfefe. Resources: {'ram', 'cores', 'instances'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:05:34.186299 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-d90e41f7-abcf-4b40-a844-9f39d1ac44e4 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Getting quotas for user 78f8a576e39b4ef9a7fe0b8a2723e54e and project 93413a82cb584df38e5686c1ffbcfefe. Resources: {'ram', 'cores', 'instances'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:05:34.203205 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-d90e41f7-abcf-4b40-a844-9f39d1ac44e4 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Going to run 1 instances... {{(pid=123595) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 19:05:34.206194 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-d90e41f7-abcf-4b40-a844-9f39d1ac44e4 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] [instance: 101952eb-ca4d-489c-8cb5-3bfadf241aa3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e8943ec5-4038-4d4b-b9b9-2415a79f5243',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 19:05:34.290259 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-d90e41f7-abcf-4b40-a844-9f39d1ac44e4 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.136619 Oct 04 19:05:34.301103 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2789/5943] 10.222.0.43 () {62 vars in 1188 bytes} [Tue Oct 4 19:05:33 2022] POST /compute/v2.1/servers => generated 402 bytes in 1148 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 04 19:05:34.305030 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-e77a3b58-1b07-4a9a-8c15-194faeb77f3e tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11bed3b641da4eeeb406a87b63ad1558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946e98bf99e543b1a1b19909ba741874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:34.315354 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-7cc90605-7751-4905-9875-e2ebd3c0a590 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:34.323434 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-e77a3b58-1b07-4a9a-8c15-194faeb77f3e tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] 10.222.0.43 "GET /compute/v2.1/servers/2845d7de-5b4d-4376-9e46-36d5da7c6a14" status: 200 len: 1511 microversion: 2.1 time: 0.649780 Oct 04 19:05:34.345493 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3155/5944] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:05:33 2022] GET /compute/v2.1/servers/2845d7de-5b4d-4376-9e46-36d5da7c6a14 => generated 1511 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:05:34.345733 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-7cc90605-7751-4905-9875-e2ebd3c0a590 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] [instance: 101952eb-ca4d-489c-8cb5-3bfadf241aa3] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:34.474456 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-7cc90605-7751-4905-9875-e2ebd3c0a590 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:34.494924 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-7cc90605-7751-4905-9875-e2ebd3c0a590 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:34.496387 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-7cc90605-7751-4905-9875-e2ebd3c0a590 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:34.512868 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-7cc90605-7751-4905-9875-e2ebd3c0a590 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] 10.222.0.43 "GET /compute/v2.1/servers/101952eb-ca4d-489c-8cb5-3bfadf241aa3" status: 200 len: 1281 microversion: 2.20 time: 0.201377 Oct 04 19:05:34.513515 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2790/5945] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:05:34 2022] GET /compute/v2.1/servers/101952eb-ca4d-489c-8cb5-3bfadf241aa3 => generated 1281 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:05:34.861556 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-0824f46e-454f-4cbf-8760-d3ff735be2a6 req-6de8f5bf-7777-48d0-aa8a-ac999ebe594d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2845d7de-5b4d-4376-9e46-36d5da7c6a14", "name": "network-vif-deleted", "tag": "0ed69789-d270-465f-b3d7-51787f0f2b02"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:05:34.908734 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-0824f46e-454f-4cbf-8760-d3ff735be2a6 req-6de8f5bf-7777-48d0-aa8a-ac999ebe594d service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:34.909532 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-0824f46e-454f-4cbf-8760-d3ff735be2a6 req-6de8f5bf-7777-48d0-aa8a-ac999ebe594d service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:34.910163 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-0824f46e-454f-4cbf-8760-d3ff735be2a6 req-6de8f5bf-7777-48d0-aa8a-ac999ebe594d service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:34.949801 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-0824f46e-454f-4cbf-8760-d3ff735be2a6 req-6de8f5bf-7777-48d0-aa8a-ac999ebe594d service nova] Creating event network-vif-deleted:0ed69789-d270-465f-b3d7-51787f0f2b02 for instance 2845d7de-5b4d-4376-9e46-36d5da7c6a14 on n-h2-851028-13 Oct 04 19:05:34.955485 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-0824f46e-454f-4cbf-8760-d3ff735be2a6 req-6de8f5bf-7777-48d0-aa8a-ac999ebe594d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097378 Oct 04 19:05:34.967761 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3156/5946] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:05:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:05:35.356759 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-c8d88aa9-95bf-4d5b-be3d-29032f9a2cc2 tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:35.364983 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-c8d88aa9-95bf-4d5b-be3d-29032f9a2cc2 tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] [instance: 2845d7de-5b4d-4376-9e46-36d5da7c6a14] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:35.392079 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c8d88aa9-95bf-4d5b-be3d-29032f9a2cc2 tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:35.392576 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c8d88aa9-95bf-4d5b-be3d-29032f9a2cc2 tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:35.415226 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c8d88aa9-95bf-4d5b-be3d-29032f9a2cc2 tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:35.419432 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c8d88aa9-95bf-4d5b-be3d-29032f9a2cc2 tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:35.420458 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c8d88aa9-95bf-4d5b-be3d-29032f9a2cc2 tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:35.422215 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c8d88aa9-95bf-4d5b-be3d-29032f9a2cc2 tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:35.482541 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c8d88aa9-95bf-4d5b-be3d-29032f9a2cc2 tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:35.483174 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c8d88aa9-95bf-4d5b-be3d-29032f9a2cc2 tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:35.483630 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c8d88aa9-95bf-4d5b-be3d-29032f9a2cc2 tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:35.484097 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.objects.instance [None req-c8d88aa9-95bf-4d5b-be3d-29032f9a2cc2 tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] Lazy-loading 'fault' on Instance uuid 2845d7de-5b4d-4376-9e46-36d5da7c6a14 {{(pid=123595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 19:05:35.541305 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-1097e516-6146-4b9c-b081-ff0714012355 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:35.542035 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-1097e516-6146-4b9c-b081-ff0714012355 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] [instance: 101952eb-ca4d-489c-8cb5-3bfadf241aa3] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:35.549428 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-c8d88aa9-95bf-4d5b-be3d-29032f9a2cc2 tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11bed3b641da4eeeb406a87b63ad1558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946e98bf99e543b1a1b19909ba741874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:35.560250 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1097e516-6146-4b9c-b081-ff0714012355 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:35.560250 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1097e516-6146-4b9c-b081-ff0714012355 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:35.560250 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1097e516-6146-4b9c-b081-ff0714012355 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:35.560967 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1097e516-6146-4b9c-b081-ff0714012355 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:35.562486 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1097e516-6146-4b9c-b081-ff0714012355 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:35.563104 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1097e516-6146-4b9c-b081-ff0714012355 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:35.569535 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-c8d88aa9-95bf-4d5b-be3d-29032f9a2cc2 tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] 10.222.0.43 "GET /compute/v2.1/servers/2845d7de-5b4d-4376-9e46-36d5da7c6a14" status: 200 len: 1306 microversion: 2.1 time: 0.216395 Oct 04 19:05:35.572661 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2791/5947] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:05:35 2022] GET /compute/v2.1/servers/2845d7de-5b4d-4376-9e46-36d5da7c6a14 => generated 1306 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:05:35.656639 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-1097e516-6146-4b9c-b081-ff0714012355 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:35.668660 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-1097e516-6146-4b9c-b081-ff0714012355 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:35.670531 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-1097e516-6146-4b9c-b081-ff0714012355 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:35.671983 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-1097e516-6146-4b9c-b081-ff0714012355 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] 10.222.0.43 "GET /compute/v2.1/servers/101952eb-ca4d-489c-8cb5-3bfadf241aa3" status: 200 len: 1277 microversion: 2.20 time: 0.135779 Oct 04 19:05:35.685335 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3157/5948] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:05:35 2022] GET /compute/v2.1/servers/101952eb-ca4d-489c-8cb5-3bfadf241aa3 => generated 1277 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 19:05:36.594603 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-0e5ccb9d-5c9e-4315-9471-beb9594dd240 tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:36.596262 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-0e5ccb9d-5c9e-4315-9471-beb9594dd240 tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] [instance: 2845d7de-5b4d-4376-9e46-36d5da7c6a14] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:36.604697 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0e5ccb9d-5c9e-4315-9471-beb9594dd240 tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:36.605672 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0e5ccb9d-5c9e-4315-9471-beb9594dd240 tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:36.606308 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0e5ccb9d-5c9e-4315-9471-beb9594dd240 tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:36.607212 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0e5ccb9d-5c9e-4315-9471-beb9594dd240 tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:36.607844 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0e5ccb9d-5c9e-4315-9471-beb9594dd240 tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:36.608453 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0e5ccb9d-5c9e-4315-9471-beb9594dd240 tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:36.626444 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-0e5ccb9d-5c9e-4315-9471-beb9594dd240 tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] HTTP exception thrown: Instance 2845d7de-5b4d-4376-9e46-36d5da7c6a14 could not be found. Oct 04 19:05:36.628371 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-0e5ccb9d-5c9e-4315-9471-beb9594dd240 tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] Request method failure captured: Oct 04 19:05:36.628371 n-d-851028-13 devstack@n-api.service[123595]: request: GET /compute/v2.1/servers/2845d7de-5b4d-4376-9e46-36d5da7c6a14 HTTP/1.1 Oct 04 19:05:36.628371 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 19:05:36.628371 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 19:05:36.628371 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 19:05:36.628371 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 0 Oct 04 19:05:36.628371 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 19:05:36.628371 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 19:05:36.628371 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 19:05:36.628371 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 19:05:36.628371 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPIPk9eUhQNhYHz9IjYtwk_NTtNkFN3WdmpA72T8x8wvuuC2AdNPmZy8DnJIp1m0pR-7sPLbuJI4LPri3icYxgbf-Pvwo_-gVeuPc8ygyRjMkDhb3LoevfkN7jGHM06wnWC2-6vDXuzMw8jCUA_G2MTqqvKCKTK7VQ1dRaBkZwPTLEw4 Oct 04 19:05:36.628371 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 19:05:36.628371 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 19:05:36.628371 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 19:05:36.628371 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 19:05:36.628371 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 19:05:36.628371 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 19:05:36.628371 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: 946e98bf99e543b1a1b19909ba741874 Oct 04 19:05:36.628371 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-InstanceActionsTestJSON-1643299746 Oct 04 19:05:36.628371 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 19:05:36.628371 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 19:05:36.628371 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/946e98bf99e543b1a1b19909ba741874"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_946e98bf99e543b1a1b19909ba741874"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/946e98bf99e543b1a1b19909ba741874"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/946e98bf99e543b1a1b19909ba741874"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 19:05:36.628371 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-InstanceActionsTestJSON-1643299746 Oct 04 19:05:36.628371 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: 946e98bf99e543b1a1b19909ba741874 Oct 04 19:05:36.628371 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-InstanceActionsTestJSON-1643299746 Oct 04 19:05:36.628371 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-InstanceActionsTestJSON-1643299746-project Oct 04 19:05:36.628371 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 19:05:36.628371 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 19:05:36.628371 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: 11bed3b641da4eeeb406a87b63ad1558 Oct 04 19:05:36.628371 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-InstanceActionsTestJSON-1643299746-project Oct 04 19:05:36.628371 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 19:05:36.628371 n-d-851028-13 devstack@n-api.service[123595]: exception: Instance 2845d7de-5b4d-4376-9e46-36d5da7c6a14 could not be found. Oct 04 19:05:36.628371 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': '2845d7de-5b4d-4376-9e46-36d5da7c6a14'} Oct 04 19:05:36.628371 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:05:36.628371 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:05:36.628371 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:05:36.628371 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:05:36.628371 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:05:36.628371 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:05:36.628371 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:05:36.628371 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:05:36.628371 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:05:36.628371 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:05:36.628371 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2845d7de-5b4d-4376-9e46-36d5da7c6a14 could not be found. Oct 04 19:05:36.628371 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:05:36.628371 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:05:36.628371 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:05:36.628371 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:05:36.628371 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:05:36.628371 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:05:36.628371 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:05:36.628371 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:05:36.628371 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:05:36.628371 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:05:36.628371 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:05:36.628371 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:05:36.628371 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:05:36.628371 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:05:36.628371 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:05:36.628371 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:05:36.628371 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2845d7de-5b4d-4376-9e46-36d5da7c6a14 could not be found. Oct 04 19:05:36.628371 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:05:36.628371 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:05:36.628371 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:05:36.634224 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:05:36.634224 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:05:36.634224 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:05:36.634224 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:05:36.634224 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:05:36.634224 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2845d7de-5b4d-4376-9e46-36d5da7c6a14 could not be found. Oct 04 19:05:36.634224 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:05:36.635752 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-0e5ccb9d-5c9e-4315-9471-beb9594dd240 tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] Returning 404 to user: Instance 2845d7de-5b4d-4376-9e46-36d5da7c6a14 could not be found. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:05:36.636942 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-0e5ccb9d-5c9e-4315-9471-beb9594dd240 tempest-InstanceActionsTestJSON-1643299746 tempest-InstanceActionsTestJSON-1643299746-project] 10.222.0.43 "GET /compute/v2.1/servers/2845d7de-5b4d-4376-9e46-36d5da7c6a14" status: 404 len: 111 microversion: 2.1 time: 0.046305 Oct 04 19:05:36.638030 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2792/5949] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:05:36 2022] GET /compute/v2.1/servers/2845d7de-5b4d-4376-9e46-36d5da7c6a14 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:05:36.702939 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-11ac11a1-e90c-4972-8d86-bdc56560f94f tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:36.704224 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-11ac11a1-e90c-4972-8d86-bdc56560f94f tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] [instance: 101952eb-ca4d-489c-8cb5-3bfadf241aa3] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:36.722023 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-11ac11a1-e90c-4972-8d86-bdc56560f94f tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:36.722734 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-11ac11a1-e90c-4972-8d86-bdc56560f94f tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:36.723762 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-11ac11a1-e90c-4972-8d86-bdc56560f94f tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:36.724656 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-11ac11a1-e90c-4972-8d86-bdc56560f94f tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:36.725886 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-11ac11a1-e90c-4972-8d86-bdc56560f94f tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:36.726687 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-11ac11a1-e90c-4972-8d86-bdc56560f94f tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:36.989548 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-11ac11a1-e90c-4972-8d86-bdc56560f94f tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:36.998392 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-11ac11a1-e90c-4972-8d86-bdc56560f94f tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:36.999840 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-11ac11a1-e90c-4972-8d86-bdc56560f94f tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:37.005439 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-11ac11a1-e90c-4972-8d86-bdc56560f94f tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] 10.222.0.43 "GET /compute/v2.1/servers/101952eb-ca4d-489c-8cb5-3bfadf241aa3" status: 200 len: 1339 microversion: 2.20 time: 0.307174 Oct 04 19:05:37.027677 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3158/5950] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:05:36 2022] GET /compute/v2.1/servers/101952eb-ca4d-489c-8cb5-3bfadf241aa3 => generated 1339 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 19:05:38.035315 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-31ce543a-3635-49a3-86c3-5b25897ed2a1 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:38.036597 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-31ce543a-3635-49a3-86c3-5b25897ed2a1 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] [instance: 101952eb-ca4d-489c-8cb5-3bfadf241aa3] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:38.041294 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_api:SELECT=82,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:05:38.056468 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-31ce543a-3635-49a3-86c3-5b25897ed2a1 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:38.057823 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-31ce543a-3635-49a3-86c3-5b25897ed2a1 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:38.059819 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-31ce543a-3635-49a3-86c3-5b25897ed2a1 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:38.060762 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-31ce543a-3635-49a3-86c3-5b25897ed2a1 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:38.062712 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-31ce543a-3635-49a3-86c3-5b25897ed2a1 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:38.063355 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-31ce543a-3635-49a3-86c3-5b25897ed2a1 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:38.884527 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-31ce543a-3635-49a3-86c3-5b25897ed2a1 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:38.897633 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-31ce543a-3635-49a3-86c3-5b25897ed2a1 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:38.908960 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-31ce543a-3635-49a3-86c3-5b25897ed2a1 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:38.910340 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-31ce543a-3635-49a3-86c3-5b25897ed2a1 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] 10.222.0.43 "GET /compute/v2.1/servers/101952eb-ca4d-489c-8cb5-3bfadf241aa3" status: 200 len: 1407 microversion: 2.20 time: 0.879224 Oct 04 19:05:38.917348 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2793/5951] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:05:38 2022] GET /compute/v2.1/servers/101952eb-ca4d-489c-8cb5-3bfadf241aa3 => generated 1407 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:05:39.630217 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-bef3bb32-242d-43f5-b8b0-76acdc133947 req-33601607-a7b2-449c-8393-bec5a5867a49 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "101952eb-ca4d-489c-8cb5-3bfadf241aa3", "tag": "1c32f64c-fd96-488e-ad04-113ec01cb7c8"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:05:39.637016 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=4 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:05:39.656139 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-bef3bb32-242d-43f5-b8b0-76acdc133947 req-33601607-a7b2-449c-8393-bec5a5867a49 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:39.656805 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-bef3bb32-242d-43f5-b8b0-76acdc133947 req-33601607-a7b2-449c-8393-bec5a5867a49 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:39.657388 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-bef3bb32-242d-43f5-b8b0-76acdc133947 req-33601607-a7b2-449c-8393-bec5a5867a49 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:39.692100 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-bef3bb32-242d-43f5-b8b0-76acdc133947 req-33601607-a7b2-449c-8393-bec5a5867a49 service nova] Creating event network-changed:1c32f64c-fd96-488e-ad04-113ec01cb7c8 for instance 101952eb-ca4d-489c-8cb5-3bfadf241aa3 on n-h1-851028-13 Oct 04 19:05:39.711447 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-bef3bb32-242d-43f5-b8b0-76acdc133947 req-33601607-a7b2-449c-8393-bec5a5867a49 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091814 Oct 04 19:05:39.712867 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3159/5952] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:05:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:05:39.940446 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-cc09ab2d-4ae2-4f40-9931-361e85478724 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:39.941078 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-cc09ab2d-4ae2-4f40-9931-361e85478724 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] [instance: 101952eb-ca4d-489c-8cb5-3bfadf241aa3] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:39.965654 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cc09ab2d-4ae2-4f40-9931-361e85478724 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:39.966776 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cc09ab2d-4ae2-4f40-9931-361e85478724 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:39.967238 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cc09ab2d-4ae2-4f40-9931-361e85478724 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:39.967976 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cc09ab2d-4ae2-4f40-9931-361e85478724 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:39.968550 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cc09ab2d-4ae2-4f40-9931-361e85478724 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:39.969000 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cc09ab2d-4ae2-4f40-9931-361e85478724 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:40.441971 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-cc09ab2d-4ae2-4f40-9931-361e85478724 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:40.468724 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-cc09ab2d-4ae2-4f40-9931-361e85478724 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:40.471082 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-cc09ab2d-4ae2-4f40-9931-361e85478724 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:40.472861 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-cc09ab2d-4ae2-4f40-9931-361e85478724 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] 10.222.0.43 "GET /compute/v2.1/servers/101952eb-ca4d-489c-8cb5-3bfadf241aa3" status: 200 len: 1407 microversion: 2.20 time: 0.540381 Oct 04 19:05:40.474088 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2794/5953] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:05:39 2022] GET /compute/v2.1/servers/101952eb-ca4d-489c-8cb5-3bfadf241aa3 => generated 1407 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:05:41.505848 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-87a2ac2a-2b02-4fbe-a803-4c85a606f849 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:41.508116 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-87a2ac2a-2b02-4fbe-a803-4c85a606f849 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] [instance: 101952eb-ca4d-489c-8cb5-3bfadf241aa3] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:41.524691 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-87a2ac2a-2b02-4fbe-a803-4c85a606f849 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:41.525977 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-87a2ac2a-2b02-4fbe-a803-4c85a606f849 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:41.529445 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-87a2ac2a-2b02-4fbe-a803-4c85a606f849 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:41.531052 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-87a2ac2a-2b02-4fbe-a803-4c85a606f849 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:41.531958 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-87a2ac2a-2b02-4fbe-a803-4c85a606f849 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:41.535967 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-87a2ac2a-2b02-4fbe-a803-4c85a606f849 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:41.958556 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-87a2ac2a-2b02-4fbe-a803-4c85a606f849 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:41.981397 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-87a2ac2a-2b02-4fbe-a803-4c85a606f849 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:41.993467 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-87a2ac2a-2b02-4fbe-a803-4c85a606f849 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:41.997581 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-87a2ac2a-2b02-4fbe-a803-4c85a606f849 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] 10.222.0.43 "GET /compute/v2.1/servers/101952eb-ca4d-489c-8cb5-3bfadf241aa3" status: 200 len: 1407 microversion: 2.20 time: 0.495785 Oct 04 19:05:42.000742 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3160/5954] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:05:41 2022] GET /compute/v2.1/servers/101952eb-ca4d-489c-8cb5-3bfadf241aa3 => generated 1407 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:05:43.029911 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-045c7c0e-5795-4736-aed9-6368db844829 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:43.032928 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-045c7c0e-5795-4736-aed9-6368db844829 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] [instance: 101952eb-ca4d-489c-8cb5-3bfadf241aa3] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:43.041206 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-045c7c0e-5795-4736-aed9-6368db844829 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:43.041984 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-045c7c0e-5795-4736-aed9-6368db844829 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:43.042429 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-045c7c0e-5795-4736-aed9-6368db844829 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:43.043479 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-045c7c0e-5795-4736-aed9-6368db844829 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:43.044116 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-045c7c0e-5795-4736-aed9-6368db844829 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:43.044763 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-045c7c0e-5795-4736-aed9-6368db844829 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:43.323776 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-045c7c0e-5795-4736-aed9-6368db844829 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:43.338453 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-045c7c0e-5795-4736-aed9-6368db844829 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:43.342306 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-045c7c0e-5795-4736-aed9-6368db844829 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:43.351371 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-045c7c0e-5795-4736-aed9-6368db844829 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] 10.222.0.43 "GET /compute/v2.1/servers/101952eb-ca4d-489c-8cb5-3bfadf241aa3" status: 200 len: 1407 microversion: 2.20 time: 0.325703 Oct 04 19:05:43.370410 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2795/5955] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:05:43 2022] GET /compute/v2.1/servers/101952eb-ca4d-489c-8cb5-3bfadf241aa3 => generated 1407 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:05:44.380259 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-48a053eb-5c5e-4b64-aef0-e269aea861a8 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:44.381041 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-48a053eb-5c5e-4b64-aef0-e269aea861a8 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] [instance: 101952eb-ca4d-489c-8cb5-3bfadf241aa3] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:44.397712 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-48a053eb-5c5e-4b64-aef0-e269aea861a8 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:44.398219 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-48a053eb-5c5e-4b64-aef0-e269aea861a8 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:44.398662 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-48a053eb-5c5e-4b64-aef0-e269aea861a8 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:44.399575 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-48a053eb-5c5e-4b64-aef0-e269aea861a8 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:44.400211 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-48a053eb-5c5e-4b64-aef0-e269aea861a8 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:44.400818 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-48a053eb-5c5e-4b64-aef0-e269aea861a8 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:44.664509 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-48a053eb-5c5e-4b64-aef0-e269aea861a8 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:44.674926 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-48a053eb-5c5e-4b64-aef0-e269aea861a8 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:44.680523 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-48a053eb-5c5e-4b64-aef0-e269aea861a8 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:44.694387 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-48a053eb-5c5e-4b64-aef0-e269aea861a8 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] 10.222.0.43 "GET /compute/v2.1/servers/101952eb-ca4d-489c-8cb5-3bfadf241aa3" status: 200 len: 1407 microversion: 2.20 time: 0.310907 Oct 04 19:05:44.694387 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3161/5956] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:05:44 2022] GET /compute/v2.1/servers/101952eb-ca4d-489c-8cb5-3bfadf241aa3 => generated 1407 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:05:45.713441 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-95fbacf1-7114-4f35-9031-c455eb5833ac tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:45.714059 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-95fbacf1-7114-4f35-9031-c455eb5833ac tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] [instance: 101952eb-ca4d-489c-8cb5-3bfadf241aa3] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:45.716911 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=2 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:05:45.722035 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=8 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:05:45.736122 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-95fbacf1-7114-4f35-9031-c455eb5833ac tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:45.736636 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-95fbacf1-7114-4f35-9031-c455eb5833ac tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:45.737089 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-95fbacf1-7114-4f35-9031-c455eb5833ac tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:45.737986 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-95fbacf1-7114-4f35-9031-c455eb5833ac tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:45.738454 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-95fbacf1-7114-4f35-9031-c455eb5833ac tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:45.738891 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-95fbacf1-7114-4f35-9031-c455eb5833ac tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:46.069357 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-f63977e1-3af4-4552-8388-5c4b8f4a19f8 req-1398731f-5226-464d-921b-7c2fb9720ab5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "101952eb-ca4d-489c-8cb5-3bfadf241aa3", "name": "network-vif-plugged", "status": "completed", "tag": "1c32f64c-fd96-488e-ad04-113ec01cb7c8"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:05:46.082643 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-f63977e1-3af4-4552-8388-5c4b8f4a19f8 req-1398731f-5226-464d-921b-7c2fb9720ab5 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:46.083409 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-f63977e1-3af4-4552-8388-5c4b8f4a19f8 req-1398731f-5226-464d-921b-7c2fb9720ab5 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:46.084158 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-f63977e1-3af4-4552-8388-5c4b8f4a19f8 req-1398731f-5226-464d-921b-7c2fb9720ab5 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:46.105391 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-f63977e1-3af4-4552-8388-5c4b8f4a19f8 req-1398731f-5226-464d-921b-7c2fb9720ab5 service nova] Creating event network-vif-plugged:1c32f64c-fd96-488e-ad04-113ec01cb7c8 for instance 101952eb-ca4d-489c-8cb5-3bfadf241aa3 on n-h1-851028-13 Oct 04 19:05:46.118830 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-f63977e1-3af4-4552-8388-5c4b8f4a19f8 req-1398731f-5226-464d-921b-7c2fb9720ab5 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065015 Oct 04 19:05:46.123308 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3162/5957] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:05:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:05:46.200413 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-95fbacf1-7114-4f35-9031-c455eb5833ac tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:46.236284 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-95fbacf1-7114-4f35-9031-c455eb5833ac tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:46.238272 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-95fbacf1-7114-4f35-9031-c455eb5833ac tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:46.243739 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-95fbacf1-7114-4f35-9031-c455eb5833ac tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] 10.222.0.43 "GET /compute/v2.1/servers/101952eb-ca4d-489c-8cb5-3bfadf241aa3" status: 200 len: 1407 microversion: 2.20 time: 0.534697 Oct 04 19:05:46.250248 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2796/5958] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:05:45 2022] GET /compute/v2.1/servers/101952eb-ca4d-489c-8cb5-3bfadf241aa3 => generated 1407 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:05:47.280246 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-9c31bc52-29bc-4762-926d-6cd35f59706c tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:47.289522 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-9c31bc52-29bc-4762-926d-6cd35f59706c tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] [instance: 101952eb-ca4d-489c-8cb5-3bfadf241aa3] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:47.306906 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9c31bc52-29bc-4762-926d-6cd35f59706c tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:47.307656 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9c31bc52-29bc-4762-926d-6cd35f59706c tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:47.308173 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9c31bc52-29bc-4762-926d-6cd35f59706c tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:47.311162 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9c31bc52-29bc-4762-926d-6cd35f59706c tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:47.312737 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9c31bc52-29bc-4762-926d-6cd35f59706c tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:47.314542 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9c31bc52-29bc-4762-926d-6cd35f59706c tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:47.760210 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-9c31bc52-29bc-4762-926d-6cd35f59706c tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:47.774475 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-9c31bc52-29bc-4762-926d-6cd35f59706c tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:47.781791 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-9c31bc52-29bc-4762-926d-6cd35f59706c tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:47.783611 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-9c31bc52-29bc-4762-926d-6cd35f59706c tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] 10.222.0.43 "GET /compute/v2.1/servers/101952eb-ca4d-489c-8cb5-3bfadf241aa3" status: 200 len: 1407 microversion: 2.20 time: 0.508845 Oct 04 19:05:47.793182 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3163/5959] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:05:47 2022] GET /compute/v2.1/servers/101952eb-ca4d-489c-8cb5-3bfadf241aa3 => generated 1407 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:05:48.809199 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-67493710-8744-4120-840d-98c753d6829f tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:48.809943 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-67493710-8744-4120-840d-98c753d6829f tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] [instance: 101952eb-ca4d-489c-8cb5-3bfadf241aa3] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:48.824531 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-67493710-8744-4120-840d-98c753d6829f tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:48.825465 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-67493710-8744-4120-840d-98c753d6829f tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:48.826158 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-67493710-8744-4120-840d-98c753d6829f tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:48.827132 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-67493710-8744-4120-840d-98c753d6829f tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:48.828086 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-67493710-8744-4120-840d-98c753d6829f tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:48.828756 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-67493710-8744-4120-840d-98c753d6829f tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:49.745232 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-67493710-8744-4120-840d-98c753d6829f tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:49.762228 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-67493710-8744-4120-840d-98c753d6829f tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:49.763840 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-67493710-8744-4120-840d-98c753d6829f tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:49.765154 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-67493710-8744-4120-840d-98c753d6829f tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] 10.222.0.43 "GET /compute/v2.1/servers/101952eb-ca4d-489c-8cb5-3bfadf241aa3" status: 200 len: 1599 microversion: 2.20 time: 0.960275 Oct 04 19:05:49.781146 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2797/5960] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:05:48 2022] GET /compute/v2.1/servers/101952eb-ca4d-489c-8cb5-3bfadf241aa3 => generated 1599 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:05:49.801439 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-cc5e979e-b244-4fe9-a7e4-22c2b80287e6 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:49.803787 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-cc5e979e-b244-4fe9-a7e4-22c2b80287e6 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] [instance: 101952eb-ca4d-489c-8cb5-3bfadf241aa3] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:49.817676 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cc5e979e-b244-4fe9-a7e4-22c2b80287e6 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:49.818388 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cc5e979e-b244-4fe9-a7e4-22c2b80287e6 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:49.819546 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cc5e979e-b244-4fe9-a7e4-22c2b80287e6 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:49.820436 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cc5e979e-b244-4fe9-a7e4-22c2b80287e6 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:49.821227 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cc5e979e-b244-4fe9-a7e4-22c2b80287e6 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:49.821835 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cc5e979e-b244-4fe9-a7e4-22c2b80287e6 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:50.012983 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-cc5e979e-b244-4fe9-a7e4-22c2b80287e6 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] 10.222.0.43 "GET /compute/v2.1/servers/101952eb-ca4d-489c-8cb5-3bfadf241aa3/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.216384 Oct 04 19:05:50.014030 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3164/5961] 10.222.0.43 () {60 vars in 1316 bytes} [Tue Oct 4 19:05:49 2022] GET /compute/v2.1/servers/101952eb-ca4d-489c-8cb5-3bfadf241aa3/os-interface => generated 285 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 19:05:54.211403 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-fd3e1f0e-be64-4ddd-8ca5-36d3d4061152 req-b642a45d-b06f-4bb1-a8c7-fafbb633af3d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "101952eb-ca4d-489c-8cb5-3bfadf241aa3", "tag": "1c32f64c-fd96-488e-ad04-113ec01cb7c8"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:05:54.238188 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-fd3e1f0e-be64-4ddd-8ca5-36d3d4061152 req-b642a45d-b06f-4bb1-a8c7-fafbb633af3d service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:54.246041 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-fd3e1f0e-be64-4ddd-8ca5-36d3d4061152 req-b642a45d-b06f-4bb1-a8c7-fafbb633af3d service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:54.246509 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-fd3e1f0e-be64-4ddd-8ca5-36d3d4061152 req-b642a45d-b06f-4bb1-a8c7-fafbb633af3d service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:54.306859 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-fd3e1f0e-be64-4ddd-8ca5-36d3d4061152 req-b642a45d-b06f-4bb1-a8c7-fafbb633af3d service nova] Creating event network-changed:1c32f64c-fd96-488e-ad04-113ec01cb7c8 for instance 101952eb-ca4d-489c-8cb5-3bfadf241aa3 on n-h1-851028-13 Oct 04 19:05:54.331298 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-fd3e1f0e-be64-4ddd-8ca5-36d3d4061152 req-b642a45d-b06f-4bb1-a8c7-fafbb633af3d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127580 Oct 04 19:05:54.336645 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2798/5962] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:05:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:05:54.351613 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-6f7cfdb3-8640-4733-a0fc-a54c3ce0a44d tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:05:54.354613 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-6f7cfdb3-8640-4733-a0fc-a54c3ce0a44d tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] [instance: 75c5754b-3489-46e5-9a52-43e0a6cfd1c7] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:54.380379 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6f7cfdb3-8640-4733-a0fc-a54c3ce0a44d tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:54.380884 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6f7cfdb3-8640-4733-a0fc-a54c3ce0a44d tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:54.385044 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6f7cfdb3-8640-4733-a0fc-a54c3ce0a44d tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:54.386218 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6f7cfdb3-8640-4733-a0fc-a54c3ce0a44d tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:54.386924 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6f7cfdb3-8640-4733-a0fc-a54c3ce0a44d tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:54.389854 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6f7cfdb3-8640-4733-a0fc-a54c3ce0a44d tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:54.659808 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-6f7cfdb3-8640-4733-a0fc-a54c3ce0a44d tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] 10.222.0.43 "POST /compute/v2.1/servers/75c5754b-3489-46e5-9a52-43e0a6cfd1c7/action" status: 200 len: 63173 microversion: 2.1 time: 0.305304 Oct 04 19:05:54.666850 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3165/5963] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 19:05:54 2022] POST /compute/v2.1/servers/75c5754b-3489-46e5-9a52-43e0a6cfd1c7/action => generated 63173 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 19:05:59.909758 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-d409bc56-7367-4381-aadd-de9550769504 tempest-InstanceActionsNegativeTestJSON-1315066910 tempest-InstanceActionsNegativeTestJSON-1315066910-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-1307744153", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452", "networks": [{"uuid": "85dad7a4-27ce-402e-9c40-59256c291023"}]}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:06:00.022659 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.network.neutron [None req-d409bc56-7367-4381-aadd-de9550769504 tempest-InstanceActionsNegativeTestJSON-1315066910 tempest-InstanceActionsNegativeTestJSON-1315066910-project] validate_networks() for [('85dad7a4-27ce-402e-9c40-59256c291023', None, None, None, None, None)] {{(pid=123595) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 19:06:00.911063 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-bd3b994e-5537-49e6-92e0-ff0fe13b41d9 tempest-TestNetworkAdvancedServerOps-1915185768 tempest-TestNetworkAdvancedServerOps-1915185768-project-admin] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:00.912432 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-bd3b994e-5537-49e6-92e0-ff0fe13b41d9 tempest-TestNetworkAdvancedServerOps-1915185768 tempest-TestNetworkAdvancedServerOps-1915185768-project-admin] [instance: 75c5754b-3489-46e5-9a52-43e0a6cfd1c7] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:00.931534 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bd3b994e-5537-49e6-92e0-ff0fe13b41d9 tempest-TestNetworkAdvancedServerOps-1915185768 tempest-TestNetworkAdvancedServerOps-1915185768-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:00.937887 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bd3b994e-5537-49e6-92e0-ff0fe13b41d9 tempest-TestNetworkAdvancedServerOps-1915185768 tempest-TestNetworkAdvancedServerOps-1915185768-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:00.938368 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bd3b994e-5537-49e6-92e0-ff0fe13b41d9 tempest-TestNetworkAdvancedServerOps-1915185768 tempest-TestNetworkAdvancedServerOps-1915185768-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:00.939300 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bd3b994e-5537-49e6-92e0-ff0fe13b41d9 tempest-TestNetworkAdvancedServerOps-1915185768 tempest-TestNetworkAdvancedServerOps-1915185768-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:00.943497 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bd3b994e-5537-49e6-92e0-ff0fe13b41d9 tempest-TestNetworkAdvancedServerOps-1915185768 tempest-TestNetworkAdvancedServerOps-1915185768-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:00.948858 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bd3b994e-5537-49e6-92e0-ff0fe13b41d9 tempest-TestNetworkAdvancedServerOps-1915185768 tempest-TestNetworkAdvancedServerOps-1915185768-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:01.012922 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=74 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:06:01.222967 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-bd3b994e-5537-49e6-92e0-ff0fe13b41d9 tempest-TestNetworkAdvancedServerOps-1915185768 tempest-TestNetworkAdvancedServerOps-1915185768-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/75c5754b-3489-46e5-9a52-43e0a6cfd1c7" status: 200 len: 1836 microversion: 2.1 time: 0.315470 Oct 04 19:06:01.224440 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3166/5964] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:00 2022] GET /compute/v2.1/servers/75c5754b-3489-46e5-9a52-43e0a6cfd1c7 => generated 1836 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:06:02.910542 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-d409bc56-7367-4381-aadd-de9550769504 tempest-InstanceActionsNegativeTestJSON-1315066910 tempest-InstanceActionsNegativeTestJSON-1315066910-project] Flavor limits 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:06:02.911550 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-d409bc56-7367-4381-aadd-de9550769504 tempest-InstanceActionsNegativeTestJSON-1315066910 tempest-InstanceActionsNegativeTestJSON-1315066910-project] Image limits 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:06:02.912337 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-d409bc56-7367-4381-aadd-de9550769504 tempest-InstanceActionsNegativeTestJSON-1315066910 tempest-InstanceActionsNegativeTestJSON-1315066910-project] Flavor pref 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:06:02.913000 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-d409bc56-7367-4381-aadd-de9550769504 tempest-InstanceActionsNegativeTestJSON-1315066910 tempest-InstanceActionsNegativeTestJSON-1315066910-project] Image pref 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:06:02.913764 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-d409bc56-7367-4381-aadd-de9550769504 tempest-InstanceActionsNegativeTestJSON-1315066910 tempest-InstanceActionsNegativeTestJSON-1315066910-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:06:02.931687 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d409bc56-7367-4381-aadd-de9550769504 tempest-InstanceActionsNegativeTestJSON-1315066910 tempest-InstanceActionsNegativeTestJSON-1315066910-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:02.932470 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d409bc56-7367-4381-aadd-de9550769504 tempest-InstanceActionsNegativeTestJSON-1315066910 tempest-InstanceActionsNegativeTestJSON-1315066910-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:02.933265 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d409bc56-7367-4381-aadd-de9550769504 tempest-InstanceActionsNegativeTestJSON-1315066910 tempest-InstanceActionsNegativeTestJSON-1315066910-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:02.934337 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d409bc56-7367-4381-aadd-de9550769504 tempest-InstanceActionsNegativeTestJSON-1315066910 tempest-InstanceActionsNegativeTestJSON-1315066910-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:02.935385 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d409bc56-7367-4381-aadd-de9550769504 tempest-InstanceActionsNegativeTestJSON-1315066910 tempest-InstanceActionsNegativeTestJSON-1315066910-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:02.936070 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d409bc56-7367-4381-aadd-de9550769504 tempest-InstanceActionsNegativeTestJSON-1315066910 tempest-InstanceActionsNegativeTestJSON-1315066910-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:02.964687 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-d409bc56-7367-4381-aadd-de9550769504 tempest-InstanceActionsNegativeTestJSON-1315066910 tempest-InstanceActionsNegativeTestJSON-1315066910-project] Getting quotas for project 640e091c32694f0888f5b3cf911fd929. Resources: {'ram', 'cores', 'instances'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:06:02.995616 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-d409bc56-7367-4381-aadd-de9550769504 tempest-InstanceActionsNegativeTestJSON-1315066910 tempest-InstanceActionsNegativeTestJSON-1315066910-project] Getting quotas for user 3144c32444154921905e50ee4de9ad0b and project 640e091c32694f0888f5b3cf911fd929. Resources: {'ram', 'cores', 'instances'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:06:03.079292 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-d409bc56-7367-4381-aadd-de9550769504 tempest-InstanceActionsNegativeTestJSON-1315066910 tempest-InstanceActionsNegativeTestJSON-1315066910-project] Going to run 1 instances... {{(pid=123595) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 19:06:03.086793 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-d409bc56-7367-4381-aadd-de9550769504 tempest-InstanceActionsNegativeTestJSON-1315066910 tempest-InstanceActionsNegativeTestJSON-1315066910-project] [instance: 9bd429e4-d892-476d-b131-cdeabcaede79] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e8943ec5-4038-4d4b-b9b9-2415a79f5243',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 19:06:03.261427 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-d409bc56-7367-4381-aadd-de9550769504 tempest-InstanceActionsNegativeTestJSON-1315066910 tempest-InstanceActionsNegativeTestJSON-1315066910-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.556007 Oct 04 19:06:03.263190 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2799/5965] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 19:05:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 3559 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 19:06:03.276314 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-1c470675-d26c-4fc5-be3c-f566d36a123b tempest-InstanceActionsNegativeTestJSON-1315066910 tempest-InstanceActionsNegativeTestJSON-1315066910-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:03.277593 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-1c470675-d26c-4fc5-be3c-f566d36a123b tempest-InstanceActionsNegativeTestJSON-1315066910 tempest-InstanceActionsNegativeTestJSON-1315066910-project] [instance: 9bd429e4-d892-476d-b131-cdeabcaede79] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:03.280608 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_api:SELECT=28 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:06:03.482909 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-1c470675-d26c-4fc5-be3c-f566d36a123b tempest-InstanceActionsNegativeTestJSON-1315066910 tempest-InstanceActionsNegativeTestJSON-1315066910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3144c32444154921905e50ee4de9ad0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '640e091c32694f0888f5b3cf911fd929', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:03.493098 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-1c470675-d26c-4fc5-be3c-f566d36a123b tempest-InstanceActionsNegativeTestJSON-1315066910 tempest-InstanceActionsNegativeTestJSON-1315066910-project] 10.222.0.43 "GET /compute/v2.1/servers/9bd429e4-d892-476d-b131-cdeabcaede79" status: 200 len: 1225 microversion: 2.1 time: 0.221967 Oct 04 19:06:03.512506 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3167/5966] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:03 2022] GET /compute/v2.1/servers/9bd429e4-d892-476d-b131-cdeabcaede79 => generated 1225 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:06:04.307740 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-ecc80684-0269-43eb-94f1-85674f4ce5f8 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:04.308219 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-ecc80684-0269-43eb-94f1-85674f4ce5f8 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] [instance: 75c5754b-3489-46e5-9a52-43e0a6cfd1c7] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:04.314932 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-8294b254-1fc9-4ddb-b20c-f36841a00898 req-f57d4d48-f7bd-45ea-bfe0-80824c9d13c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75c5754b-3489-46e5-9a52-43e0a6cfd1c7", "tag": "515e62ea-52d3-4ada-b96e-712f01398333"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:06:04.337386 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ecc80684-0269-43eb-94f1-85674f4ce5f8 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:04.337881 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ecc80684-0269-43eb-94f1-85674f4ce5f8 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:04.338326 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ecc80684-0269-43eb-94f1-85674f4ce5f8 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:04.339042 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ecc80684-0269-43eb-94f1-85674f4ce5f8 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:04.339495 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ecc80684-0269-43eb-94f1-85674f4ce5f8 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:04.339922 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ecc80684-0269-43eb-94f1-85674f4ce5f8 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:04.358894 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-8294b254-1fc9-4ddb-b20c-f36841a00898 req-f57d4d48-f7bd-45ea-bfe0-80824c9d13c2 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:04.359379 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-8294b254-1fc9-4ddb-b20c-f36841a00898 req-f57d4d48-f7bd-45ea-bfe0-80824c9d13c2 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:04.374061 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-8294b254-1fc9-4ddb-b20c-f36841a00898 req-f57d4d48-f7bd-45ea-bfe0-80824c9d13c2 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:04.374211 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=45 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:06:04.409419 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-8294b254-1fc9-4ddb-b20c-f36841a00898 req-f57d4d48-f7bd-45ea-bfe0-80824c9d13c2 service nova] Creating event network-changed:515e62ea-52d3-4ada-b96e-712f01398333 for instance 75c5754b-3489-46e5-9a52-43e0a6cfd1c7 on n-h1-851028-13 Oct 04 19:06:04.435599 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-8294b254-1fc9-4ddb-b20c-f36841a00898 req-f57d4d48-f7bd-45ea-bfe0-80824c9d13c2 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122526 Oct 04 19:06:04.437643 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3168/5967] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:06:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:06:04.465848 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-ecc80684-0269-43eb-94f1-85674f4ce5f8 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] [instance: 75c5754b-3489-46e5-9a52-43e0a6cfd1c7] Going to try to terminate instance {{(pid=123595) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 19:06:04.521593 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-a2b0b676-e35d-4859-ba4d-aaff24d637e2 tempest-InstanceActionsNegativeTestJSON-1315066910 tempest-InstanceActionsNegativeTestJSON-1315066910-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:04.522392 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-a2b0b676-e35d-4859-ba4d-aaff24d637e2 tempest-InstanceActionsNegativeTestJSON-1315066910 tempest-InstanceActionsNegativeTestJSON-1315066910-project] [instance: 9bd429e4-d892-476d-b131-cdeabcaede79] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:04.714586 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-ecc80684-0269-43eb-94f1-85674f4ce5f8 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] 10.222.0.43 "DELETE /compute/v2.1/servers/75c5754b-3489-46e5-9a52-43e0a6cfd1c7" status: 204 len: 0 microversion: 2.1 time: 0.411085 Oct 04 19:06:04.717422 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2800/5968] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 19:06:04 2022] DELETE /compute/v2.1/servers/75c5754b-3489-46e5-9a52-43e0a6cfd1c7 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:06:04.735047 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-d5de76fc-b3f1-4216-8303-433e6431950a tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:04.737381 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-d5de76fc-b3f1-4216-8303-433e6431950a tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] [instance: 75c5754b-3489-46e5-9a52-43e0a6cfd1c7] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:04.752474 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d5de76fc-b3f1-4216-8303-433e6431950a tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:04.754349 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d5de76fc-b3f1-4216-8303-433e6431950a tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:04.755244 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d5de76fc-b3f1-4216-8303-433e6431950a tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:04.757816 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d5de76fc-b3f1-4216-8303-433e6431950a tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:04.759569 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d5de76fc-b3f1-4216-8303-433e6431950a tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:04.760223 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d5de76fc-b3f1-4216-8303-433e6431950a tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:04.965062 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-a2b0b676-e35d-4859-ba4d-aaff24d637e2 tempest-InstanceActionsNegativeTestJSON-1315066910 tempest-InstanceActionsNegativeTestJSON-1315066910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3144c32444154921905e50ee4de9ad0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '640e091c32694f0888f5b3cf911fd929', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:04.973653 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-a2b0b676-e35d-4859-ba4d-aaff24d637e2 tempest-InstanceActionsNegativeTestJSON-1315066910 tempest-InstanceActionsNegativeTestJSON-1315066910-project] 10.222.0.43 "GET /compute/v2.1/servers/9bd429e4-d892-476d-b131-cdeabcaede79" status: 200 len: 1225 microversion: 2.1 time: 0.457178 Oct 04 19:06:04.977009 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3169/5969] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:04 2022] GET /compute/v2.1/servers/9bd429e4-d892-476d-b131-cdeabcaede79 => generated 1225 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:06:05.123069 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-dfd8a914-207c-45cd-91f2-0a6b22378cd4 tempest-TestAggregatesBasicOps-2034792798 tempest-TestAggregatesBasicOps-2034792798-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-1258331342", "availability_zone": "foo_zone"}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:06:05.126961 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.objects.aggregate [None req-dfd8a914-207c-45cd-91f2-0a6b22378cd4 tempest-TestAggregatesBasicOps-2034792798 tempest-TestAggregatesBasicOps-2034792798-project-admin] Generated uuid 54447170-5221-49e4-ac57-31aec388e3f7 for aggregate {{(pid=123596) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 19:06:05.207299 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-dfd8a914-207c-45cd-91f2-0a6b22378cd4 tempest-TestAggregatesBasicOps-2034792798 tempest-TestAggregatesBasicOps-2034792798-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates" status: 200 len: 209 microversion: 2.1 time: 0.228249 Oct 04 19:06:05.208554 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3170/5970] 10.222.0.43 () {60 vars in 1164 bytes} [Tue Oct 4 19:06:04 2022] POST /compute/v2.1/os-aggregates => generated 209 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:06:05.220656 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-fc9c262f-8c23-413a-b6c1-667d4cd6ebb5 tempest-TestAggregatesBasicOps-2034792798 tempest-TestAggregatesBasicOps-2034792798-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:06:05.252939 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-d5de76fc-b3f1-4216-8303-433e6431950a tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf87794979e844349d6ec6c6650565f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c25f1d17e94c74868357744e692487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:05.261466 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-fc9c262f-8c23-413a-b6c1-667d4cd6ebb5 tempest-TestAggregatesBasicOps-2034792798 tempest-TestAggregatesBasicOps-2034792798-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 319 microversion: 2.1 time: 0.044836 Oct 04 19:06:05.261988 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3171/5971] 10.222.0.43 () {60 vars in 1194 bytes} [Tue Oct 4 19:06:05 2022] POST /compute/v2.1/os-aggregates/19/action => generated 319 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:06:05.274162 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-bde277b5-cef2-4ef6-ac6b-91b67e1ab79f tempest-TestAggregatesBasicOps-2034792798 tempest-TestAggregatesBasicOps-2034792798-project-admin] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:05.277839 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bde277b5-cef2-4ef6-ac6b-91b67e1ab79f tempest-TestAggregatesBasicOps-2034792798 tempest-TestAggregatesBasicOps-2034792798-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:05.278333 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bde277b5-cef2-4ef6-ac6b-91b67e1ab79f tempest-TestAggregatesBasicOps-2034792798 tempest-TestAggregatesBasicOps-2034792798-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:05.278779 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bde277b5-cef2-4ef6-ac6b-91b67e1ab79f tempest-TestAggregatesBasicOps-2034792798 tempest-TestAggregatesBasicOps-2034792798-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:05.279522 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bde277b5-cef2-4ef6-ac6b-91b67e1ab79f tempest-TestAggregatesBasicOps-2034792798 tempest-TestAggregatesBasicOps-2034792798-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:05.279978 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bde277b5-cef2-4ef6-ac6b-91b67e1ab79f tempest-TestAggregatesBasicOps-2034792798 tempest-TestAggregatesBasicOps-2034792798-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:05.289013 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-d5de76fc-b3f1-4216-8303-433e6431950a tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] 10.222.0.43 "GET /compute/v2.1/servers/75c5754b-3489-46e5-9a52-43e0a6cfd1c7" status: 200 len: 1689 microversion: 2.1 time: 0.564917 Oct 04 19:06:05.297931 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bde277b5-cef2-4ef6-ac6b-91b67e1ab79f tempest-TestAggregatesBasicOps-2034792798 tempest-TestAggregatesBasicOps-2034792798-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:05.306018 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2801/5972] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:04 2022] GET /compute/v2.1/servers/75c5754b-3489-46e5-9a52-43e0a6cfd1c7 => generated 1689 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:06:05.357695 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-bde277b5-cef2-4ef6-ac6b-91b67e1ab79f tempest-TestAggregatesBasicOps-2034792798 tempest-TestAggregatesBasicOps-2034792798-project-admin] 10.222.0.43 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.087570 Oct 04 19:06:05.368750 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3172/5973] 10.222.0.43 () {58 vars in 1176 bytes} [Tue Oct 4 19:06:05 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:06:05.372438 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-e42116b8-7c39-4985-9fab-64b78d4d9667 tempest-TestAggregatesBasicOps-2034792798 tempest-TestAggregatesBasicOps-2034792798-project-admin] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:05.383038 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-e42116b8-7c39-4985-9fab-64b78d4d9667 tempest-TestAggregatesBasicOps-2034792798 tempest-TestAggregatesBasicOps-2034792798-project-admin] 10.222.0.43 "GET /compute/v2.1/os-aggregates" status: 200 len: 298 microversion: 2.1 time: 0.016414 Oct 04 19:06:05.384167 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2802/5974] 10.222.0.43 () {58 vars in 1143 bytes} [Tue Oct 4 19:06:05 2022] GET /compute/v2.1/os-aggregates => generated 298 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:06:05.410231 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-eb45ebec-12d4-457f-b16b-04be09feab1e tempest-TestAggregatesBasicOps-2034792798 tempest-TestAggregatesBasicOps-2034792798-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-851028-13"}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:06:05.435289 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-eb45ebec-12d4-457f-b16b-04be09feab1e tempest-TestAggregatesBasicOps-2034792798 tempest-TestAggregatesBasicOps-2034792798-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:05.436138 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-eb45ebec-12d4-457f-b16b-04be09feab1e tempest-TestAggregatesBasicOps-2034792798 tempest-TestAggregatesBasicOps-2034792798-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:05.436923 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-eb45ebec-12d4-457f-b16b-04be09feab1e tempest-TestAggregatesBasicOps-2034792798 tempest-TestAggregatesBasicOps-2034792798-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:05.786618 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-eb45ebec-12d4-457f-b16b-04be09feab1e tempest-TestAggregatesBasicOps-2034792798 tempest-TestAggregatesBasicOps-2034792798-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 311 microversion: 2.1 time: 0.392888 Oct 04 19:06:05.794011 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3173/5975] 10.222.0.43 () {60 vars in 1194 bytes} [Tue Oct 4 19:06:05 2022] POST /compute/v2.1/os-aggregates/19/action => generated 311 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:06:05.806342 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-51c0c143-a706-4237-8a2e-0cfd031e1834 tempest-TestAggregatesBasicOps-2034792798 tempest-TestAggregatesBasicOps-2034792798-project-admin] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:05.838563 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-51c0c143-a706-4237-8a2e-0cfd031e1834 tempest-TestAggregatesBasicOps-2034792798 tempest-TestAggregatesBasicOps-2034792798-project-admin] 10.222.0.43 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 311 microversion: 2.1 time: 0.037506 Oct 04 19:06:05.842067 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2803/5976] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Oct 4 19:06:05 2022] GET /compute/v2.1/os-aggregates/19 => generated 311 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:06:05.853509 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-20d3b2aa-2c50-433c-996d-0b1078368932 tempest-TestAggregatesBasicOps-2034792798 tempest-TestAggregatesBasicOps-2034792798-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-1086927118", "availability_zone": "foo_zone"}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:06:06.005140 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-4c317e24-d4fd-40ce-b808-86da938eec44 tempest-InstanceActionsNegativeTestJSON-1315066910 tempest-InstanceActionsNegativeTestJSON-1315066910-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:06.006016 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-4c317e24-d4fd-40ce-b808-86da938eec44 tempest-InstanceActionsNegativeTestJSON-1315066910 tempest-InstanceActionsNegativeTestJSON-1315066910-project] [instance: 9bd429e4-d892-476d-b131-cdeabcaede79] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:06.018025 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4c317e24-d4fd-40ce-b808-86da938eec44 tempest-InstanceActionsNegativeTestJSON-1315066910 tempest-InstanceActionsNegativeTestJSON-1315066910-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:06.020543 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4c317e24-d4fd-40ce-b808-86da938eec44 tempest-InstanceActionsNegativeTestJSON-1315066910 tempest-InstanceActionsNegativeTestJSON-1315066910-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:06.021313 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4c317e24-d4fd-40ce-b808-86da938eec44 tempest-InstanceActionsNegativeTestJSON-1315066910 tempest-InstanceActionsNegativeTestJSON-1315066910-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:06.022785 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4c317e24-d4fd-40ce-b808-86da938eec44 tempest-InstanceActionsNegativeTestJSON-1315066910 tempest-InstanceActionsNegativeTestJSON-1315066910-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:06.025809 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4c317e24-d4fd-40ce-b808-86da938eec44 tempest-InstanceActionsNegativeTestJSON-1315066910 tempest-InstanceActionsNegativeTestJSON-1315066910-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:06.029311 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4c317e24-d4fd-40ce-b808-86da938eec44 tempest-InstanceActionsNegativeTestJSON-1315066910 tempest-InstanceActionsNegativeTestJSON-1315066910-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:06.153347 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-20d3b2aa-2c50-433c-996d-0b1078368932 tempest-TestAggregatesBasicOps-2034792798 tempest-TestAggregatesBasicOps-2034792798-project-admin] 10.222.0.43 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 343 microversion: 2.1 time: 0.304581 Oct 04 19:06:06.160913 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3174/5977] 10.222.0.43 () {60 vars in 1173 bytes} [Tue Oct 4 19:06:05 2022] PUT /compute/v2.1/os-aggregates/19 => generated 343 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:06:06.167529 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-465e6b6c-bad3-442c-9184-fdcdbcf84f1d tempest-TestAggregatesBasicOps-2034792798 tempest-TestAggregatesBasicOps-2034792798-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:06:06.219413 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-4c317e24-d4fd-40ce-b808-86da938eec44 tempest-InstanceActionsNegativeTestJSON-1315066910 tempest-InstanceActionsNegativeTestJSON-1315066910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3144c32444154921905e50ee4de9ad0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '640e091c32694f0888f5b3cf911fd929', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:06.232108 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-4c317e24-d4fd-40ce-b808-86da938eec44 tempest-InstanceActionsNegativeTestJSON-1315066910 tempest-InstanceActionsNegativeTestJSON-1315066910-project] 10.222.0.43 "GET /compute/v2.1/servers/9bd429e4-d892-476d-b131-cdeabcaede79" status: 200 len: 1287 microversion: 2.1 time: 0.231793 Oct 04 19:06:06.248481 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2804/5978] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:05 2022] GET /compute/v2.1/servers/9bd429e4-d892-476d-b131-cdeabcaede79 => generated 1287 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:06:06.260216 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-465e6b6c-bad3-442c-9184-fdcdbcf84f1d tempest-TestAggregatesBasicOps-2034792798 tempest-TestAggregatesBasicOps-2034792798-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 357 microversion: 2.1 time: 0.097944 Oct 04 19:06:06.261213 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3175/5979] 10.222.0.43 () {60 vars in 1194 bytes} [Tue Oct 4 19:06:06 2022] POST /compute/v2.1/os-aggregates/19/action => generated 357 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:06:06.273786 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-8da966e3-8d7d-40cf-9c19-d2a062964d43 tempest-TestAggregatesBasicOps-2034792798 tempest-TestAggregatesBasicOps-2034792798-project-admin] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:06.289336 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-8da966e3-8d7d-40cf-9c19-d2a062964d43 tempest-TestAggregatesBasicOps-2034792798 tempest-TestAggregatesBasicOps-2034792798-project-admin] 10.222.0.43 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 357 microversion: 2.1 time: 0.020005 Oct 04 19:06:06.290615 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2805/5980] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Oct 4 19:06:06 2022] GET /compute/v2.1/os-aggregates/19 => generated 357 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:06:06.303968 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-01d70d2c-cc44-4564-9f3a-056aaea7d1ce tempest-TestAggregatesBasicOps-2034792798 tempest-TestAggregatesBasicOps-2034792798-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-851028-13"}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:06:06.315612 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-0bd87bbe-8de2-494a-a15a-38809c83849c tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:06.316526 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-0bd87bbe-8de2-494a-a15a-38809c83849c tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] [instance: 75c5754b-3489-46e5-9a52-43e0a6cfd1c7] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:06.326411 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0bd87bbe-8de2-494a-a15a-38809c83849c tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:06.329729 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0bd87bbe-8de2-494a-a15a-38809c83849c tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:06.330738 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-01d70d2c-cc44-4564-9f3a-056aaea7d1ce tempest-TestAggregatesBasicOps-2034792798 tempest-TestAggregatesBasicOps-2034792798-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:06.331253 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-01d70d2c-cc44-4564-9f3a-056aaea7d1ce tempest-TestAggregatesBasicOps-2034792798 tempest-TestAggregatesBasicOps-2034792798-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:06.331716 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0bd87bbe-8de2-494a-a15a-38809c83849c tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:06.333628 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0bd87bbe-8de2-494a-a15a-38809c83849c tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:06.336034 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-01d70d2c-cc44-4564-9f3a-056aaea7d1ce tempest-TestAggregatesBasicOps-2034792798 tempest-TestAggregatesBasicOps-2034792798-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:06.336817 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0bd87bbe-8de2-494a-a15a-38809c83849c tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:06.337654 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0bd87bbe-8de2-494a-a15a-38809c83849c tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:06.655681 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-01d70d2c-cc44-4564-9f3a-056aaea7d1ce tempest-TestAggregatesBasicOps-2034792798 tempest-TestAggregatesBasicOps-2034792798-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 341 microversion: 2.1 time: 0.357226 Oct 04 19:06:06.664025 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3176/5981] 10.222.0.43 () {60 vars in 1194 bytes} [Tue Oct 4 19:06:06 2022] POST /compute/v2.1/os-aggregates/19/action => generated 341 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:06:06.668979 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-74f903fd-7d3b-480b-9b1d-5d85dd0cec18 tempest-TestAggregatesBasicOps-2034792798 tempest-TestAggregatesBasicOps-2034792798-project-admin] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:06.741515 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-74f903fd-7d3b-480b-9b1d-5d85dd0cec18 tempest-TestAggregatesBasicOps-2034792798 tempest-TestAggregatesBasicOps-2034792798-project-admin] 10.222.0.43 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.076097 Oct 04 19:06:06.742900 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3177/5982] 10.222.0.43 () {58 vars in 1155 bytes} [Tue Oct 4 19:06:06 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 19:06:06.763650 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-0bd87bbe-8de2-494a-a15a-38809c83849c tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf87794979e844349d6ec6c6650565f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c25f1d17e94c74868357744e692487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:06.791519 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-0bd87bbe-8de2-494a-a15a-38809c83849c tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] 10.222.0.43 "GET /compute/v2.1/servers/75c5754b-3489-46e5-9a52-43e0a6cfd1c7" status: 200 len: 1689 microversion: 2.1 time: 0.481426 Oct 04 19:06:06.813943 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2806/5983] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:06 2022] GET /compute/v2.1/servers/75c5754b-3489-46e5-9a52-43e0a6cfd1c7 => generated 1689 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:06:07.270518 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-60357641-baea-4d54-806e-d579bdf2555d tempest-InstanceActionsNegativeTestJSON-1315066910 tempest-InstanceActionsNegativeTestJSON-1315066910-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:07.271499 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-60357641-baea-4d54-806e-d579bdf2555d tempest-InstanceActionsNegativeTestJSON-1315066910 tempest-InstanceActionsNegativeTestJSON-1315066910-project] [instance: 9bd429e4-d892-476d-b131-cdeabcaede79] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:07.296453 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-60357641-baea-4d54-806e-d579bdf2555d tempest-InstanceActionsNegativeTestJSON-1315066910 tempest-InstanceActionsNegativeTestJSON-1315066910-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:07.297316 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-60357641-baea-4d54-806e-d579bdf2555d tempest-InstanceActionsNegativeTestJSON-1315066910 tempest-InstanceActionsNegativeTestJSON-1315066910-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:07.305938 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-60357641-baea-4d54-806e-d579bdf2555d tempest-InstanceActionsNegativeTestJSON-1315066910 tempest-InstanceActionsNegativeTestJSON-1315066910-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:07.307363 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-60357641-baea-4d54-806e-d579bdf2555d tempest-InstanceActionsNegativeTestJSON-1315066910 tempest-InstanceActionsNegativeTestJSON-1315066910-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:07.308273 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-60357641-baea-4d54-806e-d579bdf2555d tempest-InstanceActionsNegativeTestJSON-1315066910 tempest-InstanceActionsNegativeTestJSON-1315066910-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:07.309210 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-60357641-baea-4d54-806e-d579bdf2555d tempest-InstanceActionsNegativeTestJSON-1315066910 tempest-InstanceActionsNegativeTestJSON-1315066910-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:07.519919 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-60357641-baea-4d54-806e-d579bdf2555d tempest-InstanceActionsNegativeTestJSON-1315066910 tempest-InstanceActionsNegativeTestJSON-1315066910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3144c32444154921905e50ee4de9ad0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '640e091c32694f0888f5b3cf911fd929', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:07.534304 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-60357641-baea-4d54-806e-d579bdf2555d tempest-InstanceActionsNegativeTestJSON-1315066910 tempest-InstanceActionsNegativeTestJSON-1315066910-project] 10.222.0.43 "GET /compute/v2.1/servers/9bd429e4-d892-476d-b131-cdeabcaede79" status: 200 len: 1283 microversion: 2.1 time: 0.276278 Oct 04 19:06:07.543549 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3178/5984] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:07 2022] GET /compute/v2.1/servers/9bd429e4-d892-476d-b131-cdeabcaede79 => generated 1283 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:06:07.820712 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-dda421a3-31d6-4820-80de-2ac6528f4d9b tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:07.822239 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-dda421a3-31d6-4820-80de-2ac6528f4d9b tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] [instance: 75c5754b-3489-46e5-9a52-43e0a6cfd1c7] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:07.861486 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dda421a3-31d6-4820-80de-2ac6528f4d9b tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:07.864056 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dda421a3-31d6-4820-80de-2ac6528f4d9b tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:07.867791 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dda421a3-31d6-4820-80de-2ac6528f4d9b tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:07.870310 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dda421a3-31d6-4820-80de-2ac6528f4d9b tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:07.871118 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dda421a3-31d6-4820-80de-2ac6528f4d9b tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:07.872151 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dda421a3-31d6-4820-80de-2ac6528f4d9b tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:08.114230 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-dda421a3-31d6-4820-80de-2ac6528f4d9b tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf87794979e844349d6ec6c6650565f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c25f1d17e94c74868357744e692487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:08.116415 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-6cad1926-4da5-4381-b8c5-8cd42065c9ad req-37167dc7-4203-4110-b61d-aa82064f9cf6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75c5754b-3489-46e5-9a52-43e0a6cfd1c7", "name": "network-vif-deleted", "tag": "515e62ea-52d3-4ada-b96e-712f01398333"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:06:08.137597 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-dda421a3-31d6-4820-80de-2ac6528f4d9b tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] 10.222.0.43 "GET /compute/v2.1/servers/75c5754b-3489-46e5-9a52-43e0a6cfd1c7" status: 200 len: 1621 microversion: 2.1 time: 0.315442 Oct 04 19:06:08.141811 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2807/5985] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:07 2022] GET /compute/v2.1/servers/75c5754b-3489-46e5-9a52-43e0a6cfd1c7 => generated 1621 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:06:08.165072 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-6cad1926-4da5-4381-b8c5-8cd42065c9ad req-37167dc7-4203-4110-b61d-aa82064f9cf6 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:08.174761 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-6cad1926-4da5-4381-b8c5-8cd42065c9ad req-37167dc7-4203-4110-b61d-aa82064f9cf6 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:08.184884 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-6cad1926-4da5-4381-b8c5-8cd42065c9ad req-37167dc7-4203-4110-b61d-aa82064f9cf6 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:08.243943 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-6cad1926-4da5-4381-b8c5-8cd42065c9ad req-37167dc7-4203-4110-b61d-aa82064f9cf6 service nova] Creating event network-vif-deleted:515e62ea-52d3-4ada-b96e-712f01398333 for instance 75c5754b-3489-46e5-9a52-43e0a6cfd1c7 on n-h1-851028-13 Oct 04 19:06:08.268698 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-6cad1926-4da5-4381-b8c5-8cd42065c9ad req-37167dc7-4203-4110-b61d-aa82064f9cf6 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.155641 Oct 04 19:06:08.269226 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3179/5986] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:06:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:06:08.573960 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-a2a7740c-6f02-4128-9c25-e8b0f643201e tempest-InstanceActionsNegativeTestJSON-1315066910 tempest-InstanceActionsNegativeTestJSON-1315066910-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:08.574852 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-a2a7740c-6f02-4128-9c25-e8b0f643201e tempest-InstanceActionsNegativeTestJSON-1315066910 tempest-InstanceActionsNegativeTestJSON-1315066910-project] [instance: 9bd429e4-d892-476d-b131-cdeabcaede79] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:08.583649 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:06:08.600748 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a2a7740c-6f02-4128-9c25-e8b0f643201e tempest-InstanceActionsNegativeTestJSON-1315066910 tempest-InstanceActionsNegativeTestJSON-1315066910-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:08.602361 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a2a7740c-6f02-4128-9c25-e8b0f643201e tempest-InstanceActionsNegativeTestJSON-1315066910 tempest-InstanceActionsNegativeTestJSON-1315066910-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:08.604015 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a2a7740c-6f02-4128-9c25-e8b0f643201e tempest-InstanceActionsNegativeTestJSON-1315066910 tempest-InstanceActionsNegativeTestJSON-1315066910-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:08.606030 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a2a7740c-6f02-4128-9c25-e8b0f643201e tempest-InstanceActionsNegativeTestJSON-1315066910 tempest-InstanceActionsNegativeTestJSON-1315066910-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:08.608477 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a2a7740c-6f02-4128-9c25-e8b0f643201e tempest-InstanceActionsNegativeTestJSON-1315066910 tempest-InstanceActionsNegativeTestJSON-1315066910-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:08.609848 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a2a7740c-6f02-4128-9c25-e8b0f643201e tempest-InstanceActionsNegativeTestJSON-1315066910 tempest-InstanceActionsNegativeTestJSON-1315066910-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:08.976998 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-a2a7740c-6f02-4128-9c25-e8b0f643201e tempest-InstanceActionsNegativeTestJSON-1315066910 tempest-InstanceActionsNegativeTestJSON-1315066910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3144c32444154921905e50ee4de9ad0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '640e091c32694f0888f5b3cf911fd929', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:08.999377 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-a2a7740c-6f02-4128-9c25-e8b0f643201e tempest-InstanceActionsNegativeTestJSON-1315066910 tempest-InstanceActionsNegativeTestJSON-1315066910-project] 10.222.0.43 "GET /compute/v2.1/servers/9bd429e4-d892-476d-b131-cdeabcaede79" status: 200 len: 1283 microversion: 2.1 time: 0.429546 Oct 04 19:06:09.004002 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2808/5987] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:08 2022] GET /compute/v2.1/servers/9bd429e4-d892-476d-b131-cdeabcaede79 => generated 1283 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:06:09.171885 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-8c0ba0c9-d979-4867-8be8-f0aab2a5c871 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:09.172736 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-8c0ba0c9-d979-4867-8be8-f0aab2a5c871 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] [instance: 75c5754b-3489-46e5-9a52-43e0a6cfd1c7] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:09.190192 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8c0ba0c9-d979-4867-8be8-f0aab2a5c871 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:09.191632 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8c0ba0c9-d979-4867-8be8-f0aab2a5c871 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:09.195038 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8c0ba0c9-d979-4867-8be8-f0aab2a5c871 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:09.196066 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8c0ba0c9-d979-4867-8be8-f0aab2a5c871 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:09.197922 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8c0ba0c9-d979-4867-8be8-f0aab2a5c871 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:09.200439 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8c0ba0c9-d979-4867-8be8-f0aab2a5c871 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:09.340816 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8c0ba0c9-d979-4867-8be8-f0aab2a5c871 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:09.341698 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8c0ba0c9-d979-4867-8be8-f0aab2a5c871 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:09.343636 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8c0ba0c9-d979-4867-8be8-f0aab2a5c871 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:09.344246 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.objects.instance [None req-8c0ba0c9-d979-4867-8be8-f0aab2a5c871 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lazy-loading 'fault' on Instance uuid 75c5754b-3489-46e5-9a52-43e0a6cfd1c7 {{(pid=123596) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 19:06:09.536019 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-8c0ba0c9-d979-4867-8be8-f0aab2a5c871 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf87794979e844349d6ec6c6650565f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c25f1d17e94c74868357744e692487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:09.550541 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-8c0ba0c9-d979-4867-8be8-f0aab2a5c871 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] 10.222.0.43 "GET /compute/v2.1/servers/75c5754b-3489-46e5-9a52-43e0a6cfd1c7" status: 200 len: 1356 microversion: 2.1 time: 0.385378 Oct 04 19:06:09.551154 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3180/5988] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:09 2022] GET /compute/v2.1/servers/75c5754b-3489-46e5-9a52-43e0a6cfd1c7 => generated 1356 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:06:10.030168 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-c6477d53-f66d-49ee-bef1-62491fdfc65c tempest-InstanceActionsNegativeTestJSON-1315066910 tempest-InstanceActionsNegativeTestJSON-1315066910-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:10.031419 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-c6477d53-f66d-49ee-bef1-62491fdfc65c tempest-InstanceActionsNegativeTestJSON-1315066910 tempest-InstanceActionsNegativeTestJSON-1315066910-project] [instance: 9bd429e4-d892-476d-b131-cdeabcaede79] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:10.049248 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c6477d53-f66d-49ee-bef1-62491fdfc65c tempest-InstanceActionsNegativeTestJSON-1315066910 tempest-InstanceActionsNegativeTestJSON-1315066910-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:10.058314 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c6477d53-f66d-49ee-bef1-62491fdfc65c tempest-InstanceActionsNegativeTestJSON-1315066910 tempest-InstanceActionsNegativeTestJSON-1315066910-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:10.059053 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c6477d53-f66d-49ee-bef1-62491fdfc65c tempest-InstanceActionsNegativeTestJSON-1315066910 tempest-InstanceActionsNegativeTestJSON-1315066910-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:10.062209 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c6477d53-f66d-49ee-bef1-62491fdfc65c tempest-InstanceActionsNegativeTestJSON-1315066910 tempest-InstanceActionsNegativeTestJSON-1315066910-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:10.064683 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c6477d53-f66d-49ee-bef1-62491fdfc65c tempest-InstanceActionsNegativeTestJSON-1315066910 tempest-InstanceActionsNegativeTestJSON-1315066910-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:10.066995 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c6477d53-f66d-49ee-bef1-62491fdfc65c tempest-InstanceActionsNegativeTestJSON-1315066910 tempest-InstanceActionsNegativeTestJSON-1315066910-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:10.579382 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-3ee0b7e7-3771-45a2-89fe-37bc1d58959a tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:10.580005 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-3ee0b7e7-3771-45a2-89fe-37bc1d58959a tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] [instance: 75c5754b-3489-46e5-9a52-43e0a6cfd1c7] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:10.602192 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3ee0b7e7-3771-45a2-89fe-37bc1d58959a tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:10.602710 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3ee0b7e7-3771-45a2-89fe-37bc1d58959a tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:10.603161 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3ee0b7e7-3771-45a2-89fe-37bc1d58959a tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:10.604145 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3ee0b7e7-3771-45a2-89fe-37bc1d58959a tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:10.605242 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3ee0b7e7-3771-45a2-89fe-37bc1d58959a tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:10.606547 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3ee0b7e7-3771-45a2-89fe-37bc1d58959a tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:10.704675 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-3ee0b7e7-3771-45a2-89fe-37bc1d58959a tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] HTTP exception thrown: Instance 75c5754b-3489-46e5-9a52-43e0a6cfd1c7 could not be found. Oct 04 19:06:10.710675 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-3ee0b7e7-3771-45a2-89fe-37bc1d58959a tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Request method failure captured: Oct 04 19:06:10.710675 n-d-851028-13 devstack@n-api.service[123596]: request: GET /compute/v2.1/servers/75c5754b-3489-46e5-9a52-43e0a6cfd1c7 HTTP/1.1 Oct 04 19:06:10.710675 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 19:06:10.710675 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 19:06:10.710675 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 19:06:10.710675 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 19:06:10.710675 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 19:06:10.710675 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 19:06:10.710675 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 19:06:10.710675 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 19:06:10.710675 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPILod9KvQgJcndo-fDqHX9zocUdSDU033eT2D_YfhLSFm2T3SN0WEilNuSyZVFJ3atPPN5-bjqRuyPagdPBRhMzT--iezZU7INV-q8_AsQceK3zarsciUbdHJOGGNSClObQM90nB-AfRlEBDQ2E25Vo0hnf-nWJuE-QHVCgcYG2sZm8 Oct 04 19:06:10.710675 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 19:06:10.710675 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 19:06:10.710675 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 19:06:10.710675 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 19:06:10.710675 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 19:06:10.710675 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 19:06:10.710675 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: c0c25f1d17e94c74868357744e692487 Oct 04 19:06:10.710675 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1789911209 Oct 04 19:06:10.710675 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 19:06:10.710675 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 19:06:10.710675 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/c0c25f1d17e94c74868357744e692487"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_c0c25f1d17e94c74868357744e692487"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c0c25f1d17e94c74868357744e692487"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c0c25f1d17e94c74868357744e692487"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 19:06:10.710675 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1789911209 Oct 04 19:06:10.710675 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: c0c25f1d17e94c74868357744e692487 Oct 04 19:06:10.710675 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1789911209 Oct 04 19:06:10.710675 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-TestNetworkAdvancedServerOps-1789911209-project Oct 04 19:06:10.710675 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 19:06:10.710675 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 19:06:10.710675 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: bf87794979e844349d6ec6c6650565f7 Oct 04 19:06:10.710675 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1789911209-project Oct 04 19:06:10.710675 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 19:06:10.710675 n-d-851028-13 devstack@n-api.service[123596]: exception: Instance 75c5754b-3489-46e5-9a52-43e0a6cfd1c7 could not be found. Oct 04 19:06:10.710675 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': '75c5754b-3489-46e5-9a52-43e0a6cfd1c7'} Oct 04 19:06:10.710675 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:06:10.710675 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:06:10.710675 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:06:10.710675 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:06:10.710675 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:06:10.710675 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:06:10.710675 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:06:10.710675 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:06:10.710675 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:06:10.710675 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:06:10.710675 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75c5754b-3489-46e5-9a52-43e0a6cfd1c7 could not be found. Oct 04 19:06:10.710675 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:06:10.710675 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:06:10.710675 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:06:10.710675 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:06:10.710675 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:06:10.710675 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:06:10.710675 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:06:10.710675 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:06:10.710675 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:06:10.710675 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:06:10.710675 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:06:10.710675 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:06:10.710675 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:06:10.710675 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:06:10.710675 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:06:10.710675 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:06:10.710675 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75c5754b-3489-46e5-9a52-43e0a6cfd1c7 could not be found. Oct 04 19:06:10.710675 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:06:10.710675 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:06:10.715500 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:06:10.715500 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:06:10.715500 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:06:10.715500 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:06:10.715500 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:06:10.715500 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:06:10.715500 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75c5754b-3489-46e5-9a52-43e0a6cfd1c7 could not be found. Oct 04 19:06:10.715500 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:06:10.715500 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-3ee0b7e7-3771-45a2-89fe-37bc1d58959a tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Returning 404 to user: Instance 75c5754b-3489-46e5-9a52-43e0a6cfd1c7 could not be found. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:06:10.715500 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-3ee0b7e7-3771-45a2-89fe-37bc1d58959a tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] 10.222.0.43 "GET /compute/v2.1/servers/75c5754b-3489-46e5-9a52-43e0a6cfd1c7" status: 404 len: 111 microversion: 2.1 time: 0.137597 Oct 04 19:06:10.716420 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3181/5989] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:10 2022] GET /compute/v2.1/servers/75c5754b-3489-46e5-9a52-43e0a6cfd1c7 => generated 111 bytes in 142 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 19:06:10.891291 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-c6477d53-f66d-49ee-bef1-62491fdfc65c tempest-InstanceActionsNegativeTestJSON-1315066910 tempest-InstanceActionsNegativeTestJSON-1315066910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3144c32444154921905e50ee4de9ad0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '640e091c32694f0888f5b3cf911fd929', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:10.903352 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-c6477d53-f66d-49ee-bef1-62491fdfc65c tempest-InstanceActionsNegativeTestJSON-1315066910 tempest-InstanceActionsNegativeTestJSON-1315066910-project] 10.222.0.43 "GET /compute/v2.1/servers/9bd429e4-d892-476d-b131-cdeabcaede79" status: 200 len: 1325 microversion: 2.1 time: 0.877615 Oct 04 19:06:10.905752 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2809/5990] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:10 2022] GET /compute/v2.1/servers/9bd429e4-d892-476d-b131-cdeabcaede79 => generated 1325 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:06:11.806566 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-9e1fea69-d311-46a0-946c-fc08be10693a req-cac7ce71-c60a-4bb5-994c-500429523dad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9bd429e4-d892-476d-b131-cdeabcaede79", "tag": "54d0a5d9-960b-4d7a-862e-e99a4a6c0914"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:06:11.878022 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-9e1fea69-d311-46a0-946c-fc08be10693a req-cac7ce71-c60a-4bb5-994c-500429523dad service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:11.878577 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-9e1fea69-d311-46a0-946c-fc08be10693a req-cac7ce71-c60a-4bb5-994c-500429523dad service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:11.883068 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-9e1fea69-d311-46a0-946c-fc08be10693a req-cac7ce71-c60a-4bb5-994c-500429523dad service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:11.904065 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-9e1fea69-d311-46a0-946c-fc08be10693a req-cac7ce71-c60a-4bb5-994c-500429523dad service nova] Creating event network-changed:54d0a5d9-960b-4d7a-862e-e99a4a6c0914 for instance 9bd429e4-d892-476d-b131-cdeabcaede79 on n-h2-851028-13 Oct 04 19:06:11.909708 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-9e1fea69-d311-46a0-946c-fc08be10693a req-cac7ce71-c60a-4bb5-994c-500429523dad service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109094 Oct 04 19:06:11.910620 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3182/5991] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:06:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:06:11.934657 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-c0bfb6bf-1673-4c3f-a341-ee286ed0d075 tempest-InstanceActionsNegativeTestJSON-1315066910 tempest-InstanceActionsNegativeTestJSON-1315066910-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:11.935463 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-c0bfb6bf-1673-4c3f-a341-ee286ed0d075 tempest-InstanceActionsNegativeTestJSON-1315066910 tempest-InstanceActionsNegativeTestJSON-1315066910-project] [instance: 9bd429e4-d892-476d-b131-cdeabcaede79] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:11.971853 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c0bfb6bf-1673-4c3f-a341-ee286ed0d075 tempest-InstanceActionsNegativeTestJSON-1315066910 tempest-InstanceActionsNegativeTestJSON-1315066910-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:11.972649 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c0bfb6bf-1673-4c3f-a341-ee286ed0d075 tempest-InstanceActionsNegativeTestJSON-1315066910 tempest-InstanceActionsNegativeTestJSON-1315066910-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:11.973104 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c0bfb6bf-1673-4c3f-a341-ee286ed0d075 tempest-InstanceActionsNegativeTestJSON-1315066910 tempest-InstanceActionsNegativeTestJSON-1315066910-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:11.977686 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c0bfb6bf-1673-4c3f-a341-ee286ed0d075 tempest-InstanceActionsNegativeTestJSON-1315066910 tempest-InstanceActionsNegativeTestJSON-1315066910-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:11.978264 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c0bfb6bf-1673-4c3f-a341-ee286ed0d075 tempest-InstanceActionsNegativeTestJSON-1315066910 tempest-InstanceActionsNegativeTestJSON-1315066910-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:11.981489 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c0bfb6bf-1673-4c3f-a341-ee286ed0d075 tempest-InstanceActionsNegativeTestJSON-1315066910 tempest-InstanceActionsNegativeTestJSON-1315066910-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:12.422192 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-c0bfb6bf-1673-4c3f-a341-ee286ed0d075 tempest-InstanceActionsNegativeTestJSON-1315066910 tempest-InstanceActionsNegativeTestJSON-1315066910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3144c32444154921905e50ee4de9ad0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '640e091c32694f0888f5b3cf911fd929', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:12.422192 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-c0bfb6bf-1673-4c3f-a341-ee286ed0d075 tempest-InstanceActionsNegativeTestJSON-1315066910 tempest-InstanceActionsNegativeTestJSON-1315066910-project] 10.222.0.43 "GET /compute/v2.1/servers/9bd429e4-d892-476d-b131-cdeabcaede79" status: 200 len: 1325 microversion: 2.1 time: 0.447343 Oct 04 19:06:12.422192 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2810/5992] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:11 2022] GET /compute/v2.1/servers/9bd429e4-d892-476d-b131-cdeabcaede79 => generated 1325 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:06:13.426328 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-69175996-ace9-4aa2-b6ca-0a749d7d2949 tempest-InstanceActionsNegativeTestJSON-1315066910 tempest-InstanceActionsNegativeTestJSON-1315066910-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:13.427324 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-69175996-ace9-4aa2-b6ca-0a749d7d2949 tempest-InstanceActionsNegativeTestJSON-1315066910 tempest-InstanceActionsNegativeTestJSON-1315066910-project] [instance: 9bd429e4-d892-476d-b131-cdeabcaede79] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:13.457542 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-69175996-ace9-4aa2-b6ca-0a749d7d2949 tempest-InstanceActionsNegativeTestJSON-1315066910 tempest-InstanceActionsNegativeTestJSON-1315066910-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:13.458045 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-69175996-ace9-4aa2-b6ca-0a749d7d2949 tempest-InstanceActionsNegativeTestJSON-1315066910 tempest-InstanceActionsNegativeTestJSON-1315066910-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:13.458488 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-69175996-ace9-4aa2-b6ca-0a749d7d2949 tempest-InstanceActionsNegativeTestJSON-1315066910 tempest-InstanceActionsNegativeTestJSON-1315066910-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:13.459206 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-69175996-ace9-4aa2-b6ca-0a749d7d2949 tempest-InstanceActionsNegativeTestJSON-1315066910 tempest-InstanceActionsNegativeTestJSON-1315066910-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:13.460158 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-69175996-ace9-4aa2-b6ca-0a749d7d2949 tempest-InstanceActionsNegativeTestJSON-1315066910 tempest-InstanceActionsNegativeTestJSON-1315066910-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:13.460593 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-69175996-ace9-4aa2-b6ca-0a749d7d2949 tempest-InstanceActionsNegativeTestJSON-1315066910 tempest-InstanceActionsNegativeTestJSON-1315066910-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:14.530659 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-69175996-ace9-4aa2-b6ca-0a749d7d2949 tempest-InstanceActionsNegativeTestJSON-1315066910 tempest-InstanceActionsNegativeTestJSON-1315066910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3144c32444154921905e50ee4de9ad0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '640e091c32694f0888f5b3cf911fd929', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:14.551595 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-69175996-ace9-4aa2-b6ca-0a749d7d2949 tempest-InstanceActionsNegativeTestJSON-1315066910 tempest-InstanceActionsNegativeTestJSON-1315066910-project] 10.222.0.43 "GET /compute/v2.1/servers/9bd429e4-d892-476d-b131-cdeabcaede79" status: 200 len: 1325 microversion: 2.1 time: 1.129292 Oct 04 19:06:14.554966 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3183/5993] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:13 2022] GET /compute/v2.1/servers/9bd429e4-d892-476d-b131-cdeabcaede79 => generated 1325 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:06:15.577005 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-13f5e106-d767-483a-ba4c-2e46b176fad1 tempest-InstanceActionsNegativeTestJSON-1315066910 tempest-InstanceActionsNegativeTestJSON-1315066910-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:15.578383 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-13f5e106-d767-483a-ba4c-2e46b176fad1 tempest-InstanceActionsNegativeTestJSON-1315066910 tempest-InstanceActionsNegativeTestJSON-1315066910-project] [instance: 9bd429e4-d892-476d-b131-cdeabcaede79] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:15.593551 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=2 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:06:15.594830 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=6 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:06:15.596709 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-13f5e106-d767-483a-ba4c-2e46b176fad1 tempest-InstanceActionsNegativeTestJSON-1315066910 tempest-InstanceActionsNegativeTestJSON-1315066910-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:15.601088 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-13f5e106-d767-483a-ba4c-2e46b176fad1 tempest-InstanceActionsNegativeTestJSON-1315066910 tempest-InstanceActionsNegativeTestJSON-1315066910-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:15.601773 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-13f5e106-d767-483a-ba4c-2e46b176fad1 tempest-InstanceActionsNegativeTestJSON-1315066910 tempest-InstanceActionsNegativeTestJSON-1315066910-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:15.603555 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-13f5e106-d767-483a-ba4c-2e46b176fad1 tempest-InstanceActionsNegativeTestJSON-1315066910 tempest-InstanceActionsNegativeTestJSON-1315066910-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:15.610410 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-13f5e106-d767-483a-ba4c-2e46b176fad1 tempest-InstanceActionsNegativeTestJSON-1315066910 tempest-InstanceActionsNegativeTestJSON-1315066910-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:15.611226 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-13f5e106-d767-483a-ba4c-2e46b176fad1 tempest-InstanceActionsNegativeTestJSON-1315066910 tempest-InstanceActionsNegativeTestJSON-1315066910-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:17.774199 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-13f5e106-d767-483a-ba4c-2e46b176fad1 tempest-InstanceActionsNegativeTestJSON-1315066910 tempest-InstanceActionsNegativeTestJSON-1315066910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3144c32444154921905e50ee4de9ad0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '640e091c32694f0888f5b3cf911fd929', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:17.782533 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-13f5e106-d767-483a-ba4c-2e46b176fad1 tempest-InstanceActionsNegativeTestJSON-1315066910 tempest-InstanceActionsNegativeTestJSON-1315066910-project] 10.222.0.43 "GET /compute/v2.1/servers/9bd429e4-d892-476d-b131-cdeabcaede79" status: 200 len: 1325 microversion: 2.1 time: 2.209234 Oct 04 19:06:17.787166 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2811/5994] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:15 2022] GET /compute/v2.1/servers/9bd429e4-d892-476d-b131-cdeabcaede79 => generated 1325 bytes in 2214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:06:18.812796 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-81d6d468-36c6-48a4-9b9b-250a310f7e8f tempest-InstanceActionsNegativeTestJSON-1315066910 tempest-InstanceActionsNegativeTestJSON-1315066910-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:18.814282 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-81d6d468-36c6-48a4-9b9b-250a310f7e8f tempest-InstanceActionsNegativeTestJSON-1315066910 tempest-InstanceActionsNegativeTestJSON-1315066910-project] [instance: 9bd429e4-d892-476d-b131-cdeabcaede79] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:18.835073 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=4 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:06:18.847386 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=2 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:06:18.874037 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-81d6d468-36c6-48a4-9b9b-250a310f7e8f tempest-InstanceActionsNegativeTestJSON-1315066910 tempest-InstanceActionsNegativeTestJSON-1315066910-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:18.874567 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-81d6d468-36c6-48a4-9b9b-250a310f7e8f tempest-InstanceActionsNegativeTestJSON-1315066910 tempest-InstanceActionsNegativeTestJSON-1315066910-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:18.875269 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-81d6d468-36c6-48a4-9b9b-250a310f7e8f tempest-InstanceActionsNegativeTestJSON-1315066910 tempest-InstanceActionsNegativeTestJSON-1315066910-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:18.876185 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-81d6d468-36c6-48a4-9b9b-250a310f7e8f tempest-InstanceActionsNegativeTestJSON-1315066910 tempest-InstanceActionsNegativeTestJSON-1315066910-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:18.876656 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-81d6d468-36c6-48a4-9b9b-250a310f7e8f tempest-InstanceActionsNegativeTestJSON-1315066910 tempest-InstanceActionsNegativeTestJSON-1315066910-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:18.877086 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-81d6d468-36c6-48a4-9b9b-250a310f7e8f tempest-InstanceActionsNegativeTestJSON-1315066910 tempest-InstanceActionsNegativeTestJSON-1315066910-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:19.541854 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-81d6d468-36c6-48a4-9b9b-250a310f7e8f tempest-InstanceActionsNegativeTestJSON-1315066910 tempest-InstanceActionsNegativeTestJSON-1315066910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3144c32444154921905e50ee4de9ad0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '640e091c32694f0888f5b3cf911fd929', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:19.554181 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-81d6d468-36c6-48a4-9b9b-250a310f7e8f tempest-InstanceActionsNegativeTestJSON-1315066910 tempest-InstanceActionsNegativeTestJSON-1315066910-project] 10.222.0.43 "GET /compute/v2.1/servers/9bd429e4-d892-476d-b131-cdeabcaede79" status: 200 len: 1325 microversion: 2.1 time: 0.745939 Oct 04 19:06:19.573778 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3184/5995] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:18 2022] GET /compute/v2.1/servers/9bd429e4-d892-476d-b131-cdeabcaede79 => generated 1325 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:06:19.873047 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-084bfe9b-7c83-46ae-8b59-9a6e0ff3876c req-34287b22-faeb-4049-99dc-6f4241dbe78d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9bd429e4-d892-476d-b131-cdeabcaede79", "name": "network-vif-plugged", "status": "completed", "tag": "54d0a5d9-960b-4d7a-862e-e99a4a6c0914"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:06:19.905254 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-084bfe9b-7c83-46ae-8b59-9a6e0ff3876c req-34287b22-faeb-4049-99dc-6f4241dbe78d service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:19.910149 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-084bfe9b-7c83-46ae-8b59-9a6e0ff3876c req-34287b22-faeb-4049-99dc-6f4241dbe78d service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:19.910847 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-084bfe9b-7c83-46ae-8b59-9a6e0ff3876c req-34287b22-faeb-4049-99dc-6f4241dbe78d service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:19.933422 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-084bfe9b-7c83-46ae-8b59-9a6e0ff3876c req-34287b22-faeb-4049-99dc-6f4241dbe78d service nova] Creating event network-vif-plugged:54d0a5d9-960b-4d7a-862e-e99a4a6c0914 for instance 9bd429e4-d892-476d-b131-cdeabcaede79 on n-h2-851028-13 Oct 04 19:06:19.943431 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-084bfe9b-7c83-46ae-8b59-9a6e0ff3876c req-34287b22-faeb-4049-99dc-6f4241dbe78d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074171 Oct 04 19:06:19.949530 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2812/5996] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:06:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:06:20.594952 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-74ce6dd0-e25f-4694-b81a-cd353142b8c5 tempest-InstanceActionsNegativeTestJSON-1315066910 tempest-InstanceActionsNegativeTestJSON-1315066910-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:20.595648 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-74ce6dd0-e25f-4694-b81a-cd353142b8c5 tempest-InstanceActionsNegativeTestJSON-1315066910 tempest-InstanceActionsNegativeTestJSON-1315066910-project] [instance: 9bd429e4-d892-476d-b131-cdeabcaede79] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:20.619083 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-74ce6dd0-e25f-4694-b81a-cd353142b8c5 tempest-InstanceActionsNegativeTestJSON-1315066910 tempest-InstanceActionsNegativeTestJSON-1315066910-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:20.619884 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-74ce6dd0-e25f-4694-b81a-cd353142b8c5 tempest-InstanceActionsNegativeTestJSON-1315066910 tempest-InstanceActionsNegativeTestJSON-1315066910-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:20.620499 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-74ce6dd0-e25f-4694-b81a-cd353142b8c5 tempest-InstanceActionsNegativeTestJSON-1315066910 tempest-InstanceActionsNegativeTestJSON-1315066910-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:20.628578 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-74ce6dd0-e25f-4694-b81a-cd353142b8c5 tempest-InstanceActionsNegativeTestJSON-1315066910 tempest-InstanceActionsNegativeTestJSON-1315066910-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:20.629482 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-74ce6dd0-e25f-4694-b81a-cd353142b8c5 tempest-InstanceActionsNegativeTestJSON-1315066910 tempest-InstanceActionsNegativeTestJSON-1315066910-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:20.630463 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-74ce6dd0-e25f-4694-b81a-cd353142b8c5 tempest-InstanceActionsNegativeTestJSON-1315066910 tempest-InstanceActionsNegativeTestJSON-1315066910-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:20.926892 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-74ce6dd0-e25f-4694-b81a-cd353142b8c5 tempest-InstanceActionsNegativeTestJSON-1315066910 tempest-InstanceActionsNegativeTestJSON-1315066910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3144c32444154921905e50ee4de9ad0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '640e091c32694f0888f5b3cf911fd929', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:20.938394 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-74ce6dd0-e25f-4694-b81a-cd353142b8c5 tempest-InstanceActionsNegativeTestJSON-1315066910 tempest-InstanceActionsNegativeTestJSON-1315066910-project] 10.222.0.43 "GET /compute/v2.1/servers/9bd429e4-d892-476d-b131-cdeabcaede79" status: 200 len: 1325 microversion: 2.1 time: 0.349897 Oct 04 19:06:20.938981 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3185/5997] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:20 2022] GET /compute/v2.1/servers/9bd429e4-d892-476d-b131-cdeabcaede79 => generated 1325 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:06:20.994649 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-6a5d2207-34c9-4270-aa36-8b20eb4d9d95 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Calling method '.version_select at 0x7fb21eace1f0>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:21.033158 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-6a5d2207-34c9-4270-aa36-8b20eb4d9d95 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2092852925" status: 202 len: 0 microversion: 2.1 time: 0.044836 Oct 04 19:06:21.033774 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2813/5998] 10.222.0.43 () {58 vars in 1284 bytes} [Tue Oct 4 19:06:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2092852925 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:06:21.068727 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-356903f8-55fd-44ad-b1f4-b08415e08832 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:21.070846 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-356903f8-55fd-44ad-b1f4-b08415e08832 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] [instance: 101952eb-ca4d-489c-8cb5-3bfadf241aa3] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:21.083570 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-356903f8-55fd-44ad-b1f4-b08415e08832 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:21.085046 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-356903f8-55fd-44ad-b1f4-b08415e08832 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:21.085782 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-356903f8-55fd-44ad-b1f4-b08415e08832 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:21.090192 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-84f8126a-de48-45dd-a843-f390fe3597a3 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Action: 'create', calling method: .version_select at 0x7fb21ec75310>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1195087969", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ0DGhAwS0mdf5WQMVjHs5OLpZLASqkVbmRa0WthKHknJeVc0OoC5MgIx+ghh4dSf4ZUSstdj++j6mYuv0fbh5Yuv9a7RQ23QmxBpYQRvAcTJXKpTEYWueHeKWZw33MA2A=="}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:06:21.091951 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-356903f8-55fd-44ad-b1f4-b08415e08832 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:21.095435 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-356903f8-55fd-44ad-b1f4-b08415e08832 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:21.095917 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-356903f8-55fd-44ad-b1f4-b08415e08832 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:21.129048 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-84f8126a-de48-45dd-a843-f390fe3597a3 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Getting quotas for project c0c25f1d17e94c74868357744e692487. Resources: {'key_pairs'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:06:21.135193 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-356903f8-55fd-44ad-b1f4-b08415e08832 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] 10.222.0.43 "GET /compute/v2.1/servers/101952eb-ca4d-489c-8cb5-3bfadf241aa3/ips" status: 200 len: 151 microversion: 2.20 time: 0.070179 Oct 04 19:06:21.135826 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3186/5999] 10.222.0.43 () {60 vars in 1289 bytes} [Tue Oct 4 19:06:21 2022] GET /compute/v2.1/servers/101952eb-ca4d-489c-8cb5-3bfadf241aa3/ips => generated 151 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 19:06:21.137692 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-84f8126a-de48-45dd-a843-f390fe3597a3 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Getting quotas for user bf87794979e844349d6ec6c6650565f7 and project c0c25f1d17e94c74868357744e692487. Resources: {'key_pairs'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:06:21.215182 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-84f8126a-de48-45dd-a843-f390fe3597a3 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.128253 Oct 04 19:06:21.219839 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2814/6000] 10.222.0.43 () {60 vars in 1159 bytes} [Tue Oct 4 19:06:21 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:06:21.966079 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-b0d73ff8-66c2-4f6c-9df0-f2b3aea44c45 tempest-InstanceActionsNegativeTestJSON-1315066910 tempest-InstanceActionsNegativeTestJSON-1315066910-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:21.967346 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-b0d73ff8-66c2-4f6c-9df0-f2b3aea44c45 tempest-InstanceActionsNegativeTestJSON-1315066910 tempest-InstanceActionsNegativeTestJSON-1315066910-project] [instance: 9bd429e4-d892-476d-b131-cdeabcaede79] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:21.974835 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b0d73ff8-66c2-4f6c-9df0-f2b3aea44c45 tempest-InstanceActionsNegativeTestJSON-1315066910 tempest-InstanceActionsNegativeTestJSON-1315066910-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:21.980475 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b0d73ff8-66c2-4f6c-9df0-f2b3aea44c45 tempest-InstanceActionsNegativeTestJSON-1315066910 tempest-InstanceActionsNegativeTestJSON-1315066910-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:21.981420 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b0d73ff8-66c2-4f6c-9df0-f2b3aea44c45 tempest-InstanceActionsNegativeTestJSON-1315066910 tempest-InstanceActionsNegativeTestJSON-1315066910-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:21.987591 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b0d73ff8-66c2-4f6c-9df0-f2b3aea44c45 tempest-InstanceActionsNegativeTestJSON-1315066910 tempest-InstanceActionsNegativeTestJSON-1315066910-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:21.988399 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b0d73ff8-66c2-4f6c-9df0-f2b3aea44c45 tempest-InstanceActionsNegativeTestJSON-1315066910 tempest-InstanceActionsNegativeTestJSON-1315066910-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:21.989061 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b0d73ff8-66c2-4f6c-9df0-f2b3aea44c45 tempest-InstanceActionsNegativeTestJSON-1315066910 tempest-InstanceActionsNegativeTestJSON-1315066910-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:22.836852 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-b0d73ff8-66c2-4f6c-9df0-f2b3aea44c45 tempest-InstanceActionsNegativeTestJSON-1315066910 tempest-InstanceActionsNegativeTestJSON-1315066910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3144c32444154921905e50ee4de9ad0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '640e091c32694f0888f5b3cf911fd929', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:22.845380 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-b0d73ff8-66c2-4f6c-9df0-f2b3aea44c45 tempest-InstanceActionsNegativeTestJSON-1315066910 tempest-InstanceActionsNegativeTestJSON-1315066910-project] 10.222.0.43 "GET /compute/v2.1/servers/9bd429e4-d892-476d-b131-cdeabcaede79" status: 200 len: 1522 microversion: 2.1 time: 0.883057 Oct 04 19:06:22.855745 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3187/6001] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:21 2022] GET /compute/v2.1/servers/9bd429e4-d892-476d-b131-cdeabcaede79 => generated 1522 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:06:22.882136 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-11e0db51-4ed9-4288-97ab-0e91f84bb42d tempest-InstanceActionsNegativeTestJSON-1315066910 tempest-InstanceActionsNegativeTestJSON-1315066910-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:22.882793 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-11e0db51-4ed9-4288-97ab-0e91f84bb42d tempest-InstanceActionsNegativeTestJSON-1315066910 tempest-InstanceActionsNegativeTestJSON-1315066910-project] [instance: 9bd429e4-d892-476d-b131-cdeabcaede79] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:22.898167 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-11e0db51-4ed9-4288-97ab-0e91f84bb42d tempest-InstanceActionsNegativeTestJSON-1315066910 tempest-InstanceActionsNegativeTestJSON-1315066910-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:22.899015 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-11e0db51-4ed9-4288-97ab-0e91f84bb42d tempest-InstanceActionsNegativeTestJSON-1315066910 tempest-InstanceActionsNegativeTestJSON-1315066910-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:22.899637 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-11e0db51-4ed9-4288-97ab-0e91f84bb42d tempest-InstanceActionsNegativeTestJSON-1315066910 tempest-InstanceActionsNegativeTestJSON-1315066910-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:22.900520 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-11e0db51-4ed9-4288-97ab-0e91f84bb42d tempest-InstanceActionsNegativeTestJSON-1315066910 tempest-InstanceActionsNegativeTestJSON-1315066910-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:22.901198 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-11e0db51-4ed9-4288-97ab-0e91f84bb42d tempest-InstanceActionsNegativeTestJSON-1315066910 tempest-InstanceActionsNegativeTestJSON-1315066910-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:22.901900 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-11e0db51-4ed9-4288-97ab-0e91f84bb42d tempest-InstanceActionsNegativeTestJSON-1315066910 tempest-InstanceActionsNegativeTestJSON-1315066910-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:23.028745 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-11e0db51-4ed9-4288-97ab-0e91f84bb42d tempest-InstanceActionsNegativeTestJSON-1315066910 tempest-InstanceActionsNegativeTestJSON-1315066910-project] HTTP exception thrown: Action 999 not found Oct 04 19:06:23.043543 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-11e0db51-4ed9-4288-97ab-0e91f84bb42d tempest-InstanceActionsNegativeTestJSON-1315066910 tempest-InstanceActionsNegativeTestJSON-1315066910-project] Request method failure captured: Oct 04 19:06:23.043543 n-d-851028-13 devstack@n-api.service[123595]: request: GET /compute/v2.1/servers/9bd429e4-d892-476d-b131-cdeabcaede79/os-instance-actions/999 HTTP/1.1 Oct 04 19:06:23.043543 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 19:06:23.043543 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 19:06:23.043543 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 19:06:23.043543 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 0 Oct 04 19:06:23.043543 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 19:06:23.043543 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 19:06:23.043543 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 19:06:23.043543 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 19:06:23.043543 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPIQXHn-BGdMQ_LiwhkijZdT7KHj8FfgGbeEV4pqwPP7kOsofvVKA0OnEzt_DrDCVTiebai-PH_LmHUlSvbTMGNdxQwfAd9OWdBwCKTcgE6C6xoekMEwNsi2wmTkR_dX4xMrBAe7iKl3XJWHRAebk0YjCLBToUpTtujQH4Tr_UfHPFAs Oct 04 19:06:23.043543 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 19:06:23.043543 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 19:06:23.043543 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 19:06:23.043543 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 19:06:23.043543 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 19:06:23.043543 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 19:06:23.043543 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: 640e091c32694f0888f5b3cf911fd929 Oct 04 19:06:23.043543 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1315066910 Oct 04 19:06:23.043543 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 19:06:23.043543 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 19:06:23.043543 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/640e091c32694f0888f5b3cf911fd929"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_640e091c32694f0888f5b3cf911fd929"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/640e091c32694f0888f5b3cf911fd929"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/640e091c32694f0888f5b3cf911fd929"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 19:06:23.043543 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1315066910 Oct 04 19:06:23.043543 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: 640e091c32694f0888f5b3cf911fd929 Oct 04 19:06:23.043543 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1315066910 Oct 04 19:06:23.043543 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-InstanceActionsNegativeTestJSON-1315066910-project Oct 04 19:06:23.043543 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 19:06:23.043543 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 19:06:23.043543 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: 3144c32444154921905e50ee4de9ad0b Oct 04 19:06:23.043543 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1315066910-project Oct 04 19:06:23.043543 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 19:06:23.043543 n-d-851028-13 devstack@n-api.service[123595]: exception: Action 999 not found Oct 04 19:06:23.043543 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'server_id': '9bd429e4-d892-476d-b131-cdeabcaede79', 'id': '999'} Oct 04 19:06:23.043543 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:06:23.043543 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:06:23.043543 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:06:23.043543 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:06:23.043543 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:06:23.043543 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:06:23.043543 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:06:23.043543 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:06:23.043543 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 152, in show Oct 04 19:06:23.043543 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 04 19:06:23.043543 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Action 999 not found Oct 04 19:06:23.043543 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:06:23.043543 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:06:23.043543 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:06:23.043543 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:06:23.043543 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:06:23.043543 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:06:23.043543 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:06:23.043543 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:06:23.043543 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Action 999 not found Oct 04 19:06:23.043543 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:06:23.052424 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-11e0db51-4ed9-4288-97ab-0e91f84bb42d tempest-InstanceActionsNegativeTestJSON-1315066910 tempest-InstanceActionsNegativeTestJSON-1315066910-project] Returning 404 to user: Action 999 not found {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:06:23.057357 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-11e0db51-4ed9-4288-97ab-0e91f84bb42d tempest-InstanceActionsNegativeTestJSON-1315066910 tempest-InstanceActionsNegativeTestJSON-1315066910-project] 10.222.0.43 "GET /compute/v2.1/servers/9bd429e4-d892-476d-b131-cdeabcaede79/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.180450 Oct 04 19:06:23.059468 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2815/6002] 10.222.0.43 () {58 vars in 1308 bytes} [Tue Oct 4 19:06:22 2022] GET /compute/v2.1/servers/9bd429e4-d892-476d-b131-cdeabcaede79/os-instance-actions/999 => generated 66 bytes in 183 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 19:06:23.074211 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-bedbe95f-d9d8-419c-b4a2-a2c2227603a3 tempest-InstanceActionsNegativeTestJSON-1315066910 tempest-InstanceActionsNegativeTestJSON-1315066910-project] Calling method '.version_select at 0x7fb227d59e50>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:23.076434 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-bedbe95f-d9d8-419c-b4a2-a2c2227603a3 tempest-InstanceActionsNegativeTestJSON-1315066910 tempest-InstanceActionsNegativeTestJSON-1315066910-project] [instance: 3b652d2d-5f7b-4157-874c-64f0da00a4ad] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:23.093153 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-bedbe95f-d9d8-419c-b4a2-a2c2227603a3 tempest-InstanceActionsNegativeTestJSON-1315066910 tempest-InstanceActionsNegativeTestJSON-1315066910-project] HTTP exception thrown: Instance 3b652d2d-5f7b-4157-874c-64f0da00a4ad could not be found. Oct 04 19:06:23.106524 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-bedbe95f-d9d8-419c-b4a2-a2c2227603a3 tempest-InstanceActionsNegativeTestJSON-1315066910 tempest-InstanceActionsNegativeTestJSON-1315066910-project] Request method failure captured: Oct 04 19:06:23.106524 n-d-851028-13 devstack@n-api.service[123596]: request: GET /compute/v2.1/servers/3b652d2d-5f7b-4157-874c-64f0da00a4ad/os-instance-actions HTTP/1.1 Oct 04 19:06:23.106524 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 19:06:23.106524 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 19:06:23.106524 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 19:06:23.106524 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 19:06:23.106524 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 19:06:23.106524 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 19:06:23.106524 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 19:06:23.106524 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 19:06:23.106524 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPIQXHn-BGdMQ_LiwhkijZdT7KHj8FfgGbeEV4pqwPP7kOsofvVKA0OnEzt_DrDCVTiebai-PH_LmHUlSvbTMGNdxQwfAd9OWdBwCKTcgE6C6xoekMEwNsi2wmTkR_dX4xMrBAe7iKl3XJWHRAebk0YjCLBToUpTtujQH4Tr_UfHPFAs Oct 04 19:06:23.106524 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 19:06:23.106524 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 19:06:23.106524 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 19:06:23.106524 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 19:06:23.106524 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 19:06:23.106524 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 19:06:23.106524 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: 640e091c32694f0888f5b3cf911fd929 Oct 04 19:06:23.106524 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1315066910 Oct 04 19:06:23.106524 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 19:06:23.106524 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 19:06:23.106524 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/640e091c32694f0888f5b3cf911fd929"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_640e091c32694f0888f5b3cf911fd929"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/640e091c32694f0888f5b3cf911fd929"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/640e091c32694f0888f5b3cf911fd929"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 19:06:23.106524 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1315066910 Oct 04 19:06:23.106524 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: 640e091c32694f0888f5b3cf911fd929 Oct 04 19:06:23.106524 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1315066910 Oct 04 19:06:23.106524 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-InstanceActionsNegativeTestJSON-1315066910-project Oct 04 19:06:23.106524 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 19:06:23.106524 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 19:06:23.106524 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 3144c32444154921905e50ee4de9ad0b Oct 04 19:06:23.106524 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1315066910-project Oct 04 19:06:23.106524 n-d-851028-13 devstack@n-api.service[123596]: method: Oct 04 19:06:23.106524 n-d-851028-13 devstack@n-api.service[123596]: exception: Instance 3b652d2d-5f7b-4157-874c-64f0da00a4ad could not be found. Oct 04 19:06:23.106524 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'server_id': '3b652d2d-5f7b-4157-874c-64f0da00a4ad'} Oct 04 19:06:23.106524 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:06:23.106524 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:06:23.106524 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:06:23.106524 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:06:23.106524 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:06:23.106524 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:06:23.106524 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 19:06:23.106524 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 19:06:23.106524 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b652d2d-5f7b-4157-874c-64f0da00a4ad could not be found. Oct 04 19:06:23.106524 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:06:23.106524 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:06:23.106524 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:06:23.106524 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:06:23.106524 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:06:23.106524 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:06:23.106524 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:06:23.106524 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:06:23.106524 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 19:06:23.106524 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 19:06:23.106524 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:06:23.106524 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:06:23.106524 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 89, in index Oct 04 19:06:23.106524 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(req, context, server_id) Oct 04 19:06:23.106524 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 19:06:23.106524 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 19:06:23.106524 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 77, in _get_instance Oct 04 19:06:23.106524 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return common.get_instance(self.compute_api, context, server_id) Oct 04 19:06:23.106524 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:06:23.106524 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:06:23.110002 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b652d2d-5f7b-4157-874c-64f0da00a4ad could not be found. Oct 04 19:06:23.110002 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:06:23.110002 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:06:23.110002 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:06:23.110002 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:06:23.110002 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:06:23.110002 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:06:23.110002 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:06:23.110002 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:06:23.110002 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b652d2d-5f7b-4157-874c-64f0da00a4ad could not be found. Oct 04 19:06:23.110002 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:06:23.118006 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-bedbe95f-d9d8-419c-b4a2-a2c2227603a3 tempest-InstanceActionsNegativeTestJSON-1315066910 tempest-InstanceActionsNegativeTestJSON-1315066910-project] Returning 404 to user: Instance 3b652d2d-5f7b-4157-874c-64f0da00a4ad could not be found. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:06:23.120347 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-bedbe95f-d9d8-419c-b4a2-a2c2227603a3 tempest-InstanceActionsNegativeTestJSON-1315066910 tempest-InstanceActionsNegativeTestJSON-1315066910-project] 10.222.0.43 "GET /compute/v2.1/servers/3b652d2d-5f7b-4157-874c-64f0da00a4ad/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.052066 Oct 04 19:06:23.147719 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-3c7b08d9-3793-4bd2-844f-65fea9f0d7c4 tempest-InstanceActionsNegativeTestJSON-1315066910 tempest-InstanceActionsNegativeTestJSON-1315066910-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:23.151574 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-3c7b08d9-3793-4bd2-844f-65fea9f0d7c4 tempest-InstanceActionsNegativeTestJSON-1315066910 tempest-InstanceActionsNegativeTestJSON-1315066910-project] [instance: 9bd429e4-d892-476d-b131-cdeabcaede79] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:23.158186 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3188/6003] 10.222.0.43 () {58 vars in 1296 bytes} [Tue Oct 4 19:06:23 2022] GET /compute/v2.1/servers/3b652d2d-5f7b-4157-874c-64f0da00a4ad/os-instance-actions => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:06:23.174690 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3c7b08d9-3793-4bd2-844f-65fea9f0d7c4 tempest-InstanceActionsNegativeTestJSON-1315066910 tempest-InstanceActionsNegativeTestJSON-1315066910-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:23.178489 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3c7b08d9-3793-4bd2-844f-65fea9f0d7c4 tempest-InstanceActionsNegativeTestJSON-1315066910 tempest-InstanceActionsNegativeTestJSON-1315066910-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:23.180490 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3c7b08d9-3793-4bd2-844f-65fea9f0d7c4 tempest-InstanceActionsNegativeTestJSON-1315066910 tempest-InstanceActionsNegativeTestJSON-1315066910-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:23.182004 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3c7b08d9-3793-4bd2-844f-65fea9f0d7c4 tempest-InstanceActionsNegativeTestJSON-1315066910 tempest-InstanceActionsNegativeTestJSON-1315066910-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:23.185853 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3c7b08d9-3793-4bd2-844f-65fea9f0d7c4 tempest-InstanceActionsNegativeTestJSON-1315066910 tempest-InstanceActionsNegativeTestJSON-1315066910-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:23.186808 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3c7b08d9-3793-4bd2-844f-65fea9f0d7c4 tempest-InstanceActionsNegativeTestJSON-1315066910 tempest-InstanceActionsNegativeTestJSON-1315066910-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:23.277050 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-3c7b08d9-3793-4bd2-844f-65fea9f0d7c4 tempest-InstanceActionsNegativeTestJSON-1315066910 tempest-InstanceActionsNegativeTestJSON-1315066910-project] [instance: 9bd429e4-d892-476d-b131-cdeabcaede79] Going to try to terminate instance {{(pid=123595) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 19:06:23.510256 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-3c7b08d9-3793-4bd2-844f-65fea9f0d7c4 tempest-InstanceActionsNegativeTestJSON-1315066910 tempest-InstanceActionsNegativeTestJSON-1315066910-project] 10.222.0.43 "DELETE /compute/v2.1/servers/9bd429e4-d892-476d-b131-cdeabcaede79" status: 204 len: 0 microversion: 2.1 time: 0.367342 Oct 04 19:06:23.511011 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2816/6004] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 19:06:23 2022] DELETE /compute/v2.1/servers/9bd429e4-d892-476d-b131-cdeabcaede79 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:06:23.527286 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-b7f21b6c-0c41-441b-9569-e6b32dc5a45d tempest-InstanceActionsNegativeTestJSON-1315066910 tempest-InstanceActionsNegativeTestJSON-1315066910-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:23.528997 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-b7f21b6c-0c41-441b-9569-e6b32dc5a45d tempest-InstanceActionsNegativeTestJSON-1315066910 tempest-InstanceActionsNegativeTestJSON-1315066910-project] [instance: 9bd429e4-d892-476d-b131-cdeabcaede79] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:23.538801 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b7f21b6c-0c41-441b-9569-e6b32dc5a45d tempest-InstanceActionsNegativeTestJSON-1315066910 tempest-InstanceActionsNegativeTestJSON-1315066910-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:23.539348 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b7f21b6c-0c41-441b-9569-e6b32dc5a45d tempest-InstanceActionsNegativeTestJSON-1315066910 tempest-InstanceActionsNegativeTestJSON-1315066910-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:23.540700 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b7f21b6c-0c41-441b-9569-e6b32dc5a45d tempest-InstanceActionsNegativeTestJSON-1315066910 tempest-InstanceActionsNegativeTestJSON-1315066910-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:23.542903 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b7f21b6c-0c41-441b-9569-e6b32dc5a45d tempest-InstanceActionsNegativeTestJSON-1315066910 tempest-InstanceActionsNegativeTestJSON-1315066910-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:23.544309 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b7f21b6c-0c41-441b-9569-e6b32dc5a45d tempest-InstanceActionsNegativeTestJSON-1315066910 tempest-InstanceActionsNegativeTestJSON-1315066910-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:23.544955 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b7f21b6c-0c41-441b-9569-e6b32dc5a45d tempest-InstanceActionsNegativeTestJSON-1315066910 tempest-InstanceActionsNegativeTestJSON-1315066910-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:23.951075 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-b7f21b6c-0c41-441b-9569-e6b32dc5a45d tempest-InstanceActionsNegativeTestJSON-1315066910 tempest-InstanceActionsNegativeTestJSON-1315066910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3144c32444154921905e50ee4de9ad0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '640e091c32694f0888f5b3cf911fd929', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:23.968871 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-b7f21b6c-0c41-441b-9569-e6b32dc5a45d tempest-InstanceActionsNegativeTestJSON-1315066910 tempest-InstanceActionsNegativeTestJSON-1315066910-project] 10.222.0.43 "GET /compute/v2.1/servers/9bd429e4-d892-476d-b131-cdeabcaede79" status: 200 len: 1528 microversion: 2.1 time: 0.444281 Oct 04 19:06:23.981963 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3189/6005] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:23 2022] GET /compute/v2.1/servers/9bd429e4-d892-476d-b131-cdeabcaede79 => generated 1528 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:06:24.780323 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-59a7c25e-d010-46f4-9ee2-b3e317d0b7fd tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:06:24.781595 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-59a7c25e-d010-46f4-9ee2-b3e317d0b7fd tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] [instance: 101952eb-ca4d-489c-8cb5-3bfadf241aa3] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:24.799556 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-59a7c25e-d010-46f4-9ee2-b3e317d0b7fd tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:24.803088 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-59a7c25e-d010-46f4-9ee2-b3e317d0b7fd tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:24.804439 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-59a7c25e-d010-46f4-9ee2-b3e317d0b7fd tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:24.805456 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-59a7c25e-d010-46f4-9ee2-b3e317d0b7fd tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:24.807299 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-59a7c25e-d010-46f4-9ee2-b3e317d0b7fd tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:24.807978 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-59a7c25e-d010-46f4-9ee2-b3e317d0b7fd tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:24.851783 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.objects.instance [None req-59a7c25e-d010-46f4-9ee2-b3e317d0b7fd tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lazy-loading 'flavor' on Instance uuid 101952eb-ca4d-489c-8cb5-3bfadf241aa3 {{(pid=123595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 19:06:24.937663 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:06:24.994392 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-1c430b96-6fee-46a0-baa9-93d66686cdc4 tempest-InstanceActionsNegativeTestJSON-1315066910 tempest-InstanceActionsNegativeTestJSON-1315066910-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:24.994890 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-1c430b96-6fee-46a0-baa9-93d66686cdc4 tempest-InstanceActionsNegativeTestJSON-1315066910 tempest-InstanceActionsNegativeTestJSON-1315066910-project] [instance: 9bd429e4-d892-476d-b131-cdeabcaede79] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:25.013496 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1c430b96-6fee-46a0-baa9-93d66686cdc4 tempest-InstanceActionsNegativeTestJSON-1315066910 tempest-InstanceActionsNegativeTestJSON-1315066910-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:25.015469 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1c430b96-6fee-46a0-baa9-93d66686cdc4 tempest-InstanceActionsNegativeTestJSON-1315066910 tempest-InstanceActionsNegativeTestJSON-1315066910-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:25.019776 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1c430b96-6fee-46a0-baa9-93d66686cdc4 tempest-InstanceActionsNegativeTestJSON-1315066910 tempest-InstanceActionsNegativeTestJSON-1315066910-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:25.021008 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1c430b96-6fee-46a0-baa9-93d66686cdc4 tempest-InstanceActionsNegativeTestJSON-1315066910 tempest-InstanceActionsNegativeTestJSON-1315066910-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:25.021695 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1c430b96-6fee-46a0-baa9-93d66686cdc4 tempest-InstanceActionsNegativeTestJSON-1315066910 tempest-InstanceActionsNegativeTestJSON-1315066910-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:25.024430 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1c430b96-6fee-46a0-baa9-93d66686cdc4 tempest-InstanceActionsNegativeTestJSON-1315066910 tempest-InstanceActionsNegativeTestJSON-1315066910-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:25.282738 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-59a7c25e-d010-46f4-9ee2-b3e317d0b7fd tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] 10.222.0.43 "POST /compute/v2.1/servers/101952eb-ca4d-489c-8cb5-3bfadf241aa3/action" status: 202 len: 0 microversion: 2.20 time: 0.506526 Oct 04 19:06:25.283686 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2817/6006] 10.222.0.43 () {62 vars in 1319 bytes} [Tue Oct 4 19:06:24 2022] POST /compute/v2.1/servers/101952eb-ca4d-489c-8cb5-3bfadf241aa3/action => generated 0 bytes in 509 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 04 19:06:25.310435 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-70875d82-7499-4518-93e0-97507bc32c48 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:25.311646 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-70875d82-7499-4518-93e0-97507bc32c48 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] [instance: 101952eb-ca4d-489c-8cb5-3bfadf241aa3] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:25.335000 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-70875d82-7499-4518-93e0-97507bc32c48 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:25.335745 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-70875d82-7499-4518-93e0-97507bc32c48 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:25.338055 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-70875d82-7499-4518-93e0-97507bc32c48 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:25.339798 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-70875d82-7499-4518-93e0-97507bc32c48 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:25.342905 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-70875d82-7499-4518-93e0-97507bc32c48 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:25.343827 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-70875d82-7499-4518-93e0-97507bc32c48 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:25.649591 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-1c430b96-6fee-46a0-baa9-93d66686cdc4 tempest-InstanceActionsNegativeTestJSON-1315066910 tempest-InstanceActionsNegativeTestJSON-1315066910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3144c32444154921905e50ee4de9ad0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '640e091c32694f0888f5b3cf911fd929', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:25.659333 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-70875d82-7499-4518-93e0-97507bc32c48 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:25.675369 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-70875d82-7499-4518-93e0-97507bc32c48 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:25.676433 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-1c430b96-6fee-46a0-baa9-93d66686cdc4 tempest-InstanceActionsNegativeTestJSON-1315066910 tempest-InstanceActionsNegativeTestJSON-1315066910-project] 10.222.0.43 "GET /compute/v2.1/servers/9bd429e4-d892-476d-b131-cdeabcaede79" status: 200 len: 1528 microversion: 2.1 time: 0.685405 Oct 04 19:06:25.693703 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3190/6007] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:24 2022] GET /compute/v2.1/servers/9bd429e4-d892-476d-b131-cdeabcaede79 => generated 1528 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:06:25.696028 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-70875d82-7499-4518-93e0-97507bc32c48 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:25.697414 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-70875d82-7499-4518-93e0-97507bc32c48 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] 10.222.0.43 "GET /compute/v2.1/servers/101952eb-ca4d-489c-8cb5-3bfadf241aa3" status: 200 len: 1723 microversion: 2.20 time: 0.408232 Oct 04 19:06:25.713101 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2818/6008] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:06:25 2022] GET /compute/v2.1/servers/101952eb-ca4d-489c-8cb5-3bfadf241aa3 => generated 1723 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:06:26.012546 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-3b0d0fa4-8307-4166-b816-a47a3477c6f4 req-641b6697-0e53-4638-a83f-36d47ec5045a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9bd429e4-d892-476d-b131-cdeabcaede79", "name": "network-vif-deleted", "tag": "54d0a5d9-960b-4d7a-862e-e99a4a6c0914"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:06:26.029819 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-3b0d0fa4-8307-4166-b816-a47a3477c6f4 req-641b6697-0e53-4638-a83f-36d47ec5045a service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:26.030558 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-3b0d0fa4-8307-4166-b816-a47a3477c6f4 req-641b6697-0e53-4638-a83f-36d47ec5045a service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:26.031177 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-3b0d0fa4-8307-4166-b816-a47a3477c6f4 req-641b6697-0e53-4638-a83f-36d47ec5045a service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:26.049072 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-3b0d0fa4-8307-4166-b816-a47a3477c6f4 req-641b6697-0e53-4638-a83f-36d47ec5045a service nova] Creating event network-vif-deleted:54d0a5d9-960b-4d7a-862e-e99a4a6c0914 for instance 9bd429e4-d892-476d-b131-cdeabcaede79 on n-h2-851028-13 Oct 04 19:06:26.059344 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-3b0d0fa4-8307-4166-b816-a47a3477c6f4 req-641b6697-0e53-4638-a83f-36d47ec5045a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049581 Oct 04 19:06:26.065277 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3191/6009] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:06:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:06:26.701642 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-54d38626-33f7-4b0a-bc01-d35e0d8db452 tempest-InstanceActionsNegativeTestJSON-1315066910 tempest-InstanceActionsNegativeTestJSON-1315066910-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:26.702948 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-54d38626-33f7-4b0a-bc01-d35e0d8db452 tempest-InstanceActionsNegativeTestJSON-1315066910 tempest-InstanceActionsNegativeTestJSON-1315066910-project] [instance: 9bd429e4-d892-476d-b131-cdeabcaede79] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:26.710607 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-54d38626-33f7-4b0a-bc01-d35e0d8db452 tempest-InstanceActionsNegativeTestJSON-1315066910 tempest-InstanceActionsNegativeTestJSON-1315066910-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:26.711471 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-54d38626-33f7-4b0a-bc01-d35e0d8db452 tempest-InstanceActionsNegativeTestJSON-1315066910 tempest-InstanceActionsNegativeTestJSON-1315066910-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:26.712150 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-54d38626-33f7-4b0a-bc01-d35e0d8db452 tempest-InstanceActionsNegativeTestJSON-1315066910 tempest-InstanceActionsNegativeTestJSON-1315066910-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:26.713086 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-54d38626-33f7-4b0a-bc01-d35e0d8db452 tempest-InstanceActionsNegativeTestJSON-1315066910 tempest-InstanceActionsNegativeTestJSON-1315066910-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:26.713874 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-54d38626-33f7-4b0a-bc01-d35e0d8db452 tempest-InstanceActionsNegativeTestJSON-1315066910 tempest-InstanceActionsNegativeTestJSON-1315066910-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:26.714514 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-54d38626-33f7-4b0a-bc01-d35e0d8db452 tempest-InstanceActionsNegativeTestJSON-1315066910 tempest-InstanceActionsNegativeTestJSON-1315066910-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:26.730081 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-deb2b8bc-f645-4381-bd04-759fc942d235 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:26.730857 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-deb2b8bc-f645-4381-bd04-759fc942d235 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] [instance: 101952eb-ca4d-489c-8cb5-3bfadf241aa3] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:26.733748 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-54d38626-33f7-4b0a-bc01-d35e0d8db452 tempest-InstanceActionsNegativeTestJSON-1315066910 tempest-InstanceActionsNegativeTestJSON-1315066910-project] HTTP exception thrown: Instance 9bd429e4-d892-476d-b131-cdeabcaede79 could not be found. Oct 04 19:06:26.736453 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-54d38626-33f7-4b0a-bc01-d35e0d8db452 tempest-InstanceActionsNegativeTestJSON-1315066910 tempest-InstanceActionsNegativeTestJSON-1315066910-project] Request method failure captured: Oct 04 19:06:26.736453 n-d-851028-13 devstack@n-api.service[123595]: request: GET /compute/v2.1/servers/9bd429e4-d892-476d-b131-cdeabcaede79 HTTP/1.1 Oct 04 19:06:26.736453 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 19:06:26.736453 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 19:06:26.736453 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 19:06:26.736453 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 0 Oct 04 19:06:26.736453 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 19:06:26.736453 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 19:06:26.736453 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 19:06:26.736453 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 19:06:26.736453 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPIQXHn-BGdMQ_LiwhkijZdT7KHj8FfgGbeEV4pqwPP7kOsofvVKA0OnEzt_DrDCVTiebai-PH_LmHUlSvbTMGNdxQwfAd9OWdBwCKTcgE6C6xoekMEwNsi2wmTkR_dX4xMrBAe7iKl3XJWHRAebk0YjCLBToUpTtujQH4Tr_UfHPFAs Oct 04 19:06:26.736453 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 19:06:26.736453 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 19:06:26.736453 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 19:06:26.736453 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 19:06:26.736453 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 19:06:26.736453 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 19:06:26.736453 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: 640e091c32694f0888f5b3cf911fd929 Oct 04 19:06:26.736453 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1315066910 Oct 04 19:06:26.736453 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 19:06:26.736453 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 19:06:26.736453 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/640e091c32694f0888f5b3cf911fd929"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_640e091c32694f0888f5b3cf911fd929"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/640e091c32694f0888f5b3cf911fd929"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/640e091c32694f0888f5b3cf911fd929"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 19:06:26.736453 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1315066910 Oct 04 19:06:26.736453 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: 640e091c32694f0888f5b3cf911fd929 Oct 04 19:06:26.736453 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1315066910 Oct 04 19:06:26.736453 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-InstanceActionsNegativeTestJSON-1315066910-project Oct 04 19:06:26.736453 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 19:06:26.736453 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 19:06:26.736453 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: 3144c32444154921905e50ee4de9ad0b Oct 04 19:06:26.736453 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1315066910-project Oct 04 19:06:26.736453 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 19:06:26.736453 n-d-851028-13 devstack@n-api.service[123595]: exception: Instance 9bd429e4-d892-476d-b131-cdeabcaede79 could not be found. Oct 04 19:06:26.736453 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': '9bd429e4-d892-476d-b131-cdeabcaede79'} Oct 04 19:06:26.736453 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:06:26.736453 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:06:26.736453 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:06:26.736453 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:06:26.736453 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:06:26.736453 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:06:26.736453 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:06:26.736453 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:06:26.736453 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:06:26.736453 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:06:26.736453 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9bd429e4-d892-476d-b131-cdeabcaede79 could not be found. Oct 04 19:06:26.736453 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:06:26.736453 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:06:26.736453 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:06:26.736453 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:06:26.736453 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:06:26.736453 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:06:26.736453 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:06:26.736453 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:06:26.736453 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:06:26.736453 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:06:26.736453 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:06:26.736453 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:06:26.736453 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:06:26.736453 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:06:26.736453 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:06:26.736453 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:06:26.736453 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9bd429e4-d892-476d-b131-cdeabcaede79 could not be found. Oct 04 19:06:26.736453 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:06:26.736453 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:06:26.739534 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:06:26.739534 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:06:26.739534 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:06:26.739534 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:06:26.739534 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:06:26.739534 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:06:26.739534 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9bd429e4-d892-476d-b131-cdeabcaede79 could not be found. Oct 04 19:06:26.739534 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:06:26.741844 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-54d38626-33f7-4b0a-bc01-d35e0d8db452 tempest-InstanceActionsNegativeTestJSON-1315066910 tempest-InstanceActionsNegativeTestJSON-1315066910-project] Returning 404 to user: Instance 9bd429e4-d892-476d-b131-cdeabcaede79 could not be found. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:06:26.742923 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-54d38626-33f7-4b0a-bc01-d35e0d8db452 tempest-InstanceActionsNegativeTestJSON-1315066910 tempest-InstanceActionsNegativeTestJSON-1315066910-project] 10.222.0.43 "GET /compute/v2.1/servers/9bd429e4-d892-476d-b131-cdeabcaede79" status: 404 len: 111 microversion: 2.1 time: 0.045317 Oct 04 19:06:26.744021 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2819/6010] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:26 2022] GET /compute/v2.1/servers/9bd429e4-d892-476d-b131-cdeabcaede79 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 19:06:26.749465 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-deb2b8bc-f645-4381-bd04-759fc942d235 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:26.749979 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-deb2b8bc-f645-4381-bd04-759fc942d235 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:26.752002 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-deb2b8bc-f645-4381-bd04-759fc942d235 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:26.753850 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-deb2b8bc-f645-4381-bd04-759fc942d235 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:26.759827 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-deb2b8bc-f645-4381-bd04-759fc942d235 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:26.760344 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-deb2b8bc-f645-4381-bd04-759fc942d235 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:27.386810 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-deb2b8bc-f645-4381-bd04-759fc942d235 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:27.411305 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-deb2b8bc-f645-4381-bd04-759fc942d235 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:27.422682 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-deb2b8bc-f645-4381-bd04-759fc942d235 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:27.427702 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-deb2b8bc-f645-4381-bd04-759fc942d235 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] 10.222.0.43 "GET /compute/v2.1/servers/101952eb-ca4d-489c-8cb5-3bfadf241aa3" status: 200 len: 1723 microversion: 2.20 time: 0.702085 Oct 04 19:06:27.430700 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3192/6011] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:06:26 2022] GET /compute/v2.1/servers/101952eb-ca4d-489c-8cb5-3bfadf241aa3 => generated 1723 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 19:06:28.456499 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-b52eeec7-6d0f-4432-aa82-5ccda707d31d tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:28.457888 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-b52eeec7-6d0f-4432-aa82-5ccda707d31d tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] [instance: 101952eb-ca4d-489c-8cb5-3bfadf241aa3] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:28.479787 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b52eeec7-6d0f-4432-aa82-5ccda707d31d tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:28.491557 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b52eeec7-6d0f-4432-aa82-5ccda707d31d tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:28.493750 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b52eeec7-6d0f-4432-aa82-5ccda707d31d tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:28.494780 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b52eeec7-6d0f-4432-aa82-5ccda707d31d tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:28.503919 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b52eeec7-6d0f-4432-aa82-5ccda707d31d tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:28.506178 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b52eeec7-6d0f-4432-aa82-5ccda707d31d tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:28.782554 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-b52eeec7-6d0f-4432-aa82-5ccda707d31d tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:28.796263 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-b52eeec7-6d0f-4432-aa82-5ccda707d31d tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:28.802679 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-b52eeec7-6d0f-4432-aa82-5ccda707d31d tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:28.805070 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-b52eeec7-6d0f-4432-aa82-5ccda707d31d tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] 10.222.0.43 "GET /compute/v2.1/servers/101952eb-ca4d-489c-8cb5-3bfadf241aa3" status: 200 len: 1723 microversion: 2.20 time: 0.353206 Oct 04 19:06:28.806176 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2820/6012] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:06:28 2022] GET /compute/v2.1/servers/101952eb-ca4d-489c-8cb5-3bfadf241aa3 => generated 1723 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:06:29.833479 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-992d1b5f-1709-4a4d-b064-a257ab8a48c7 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:29.834713 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-992d1b5f-1709-4a4d-b064-a257ab8a48c7 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] [instance: 101952eb-ca4d-489c-8cb5-3bfadf241aa3] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:29.842668 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=5,nova_api:UPDATE=1,nova_api:DELETE=3 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:06:29.856313 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-992d1b5f-1709-4a4d-b064-a257ab8a48c7 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:29.860728 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-992d1b5f-1709-4a4d-b064-a257ab8a48c7 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:29.861951 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-992d1b5f-1709-4a4d-b064-a257ab8a48c7 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:29.862782 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-992d1b5f-1709-4a4d-b064-a257ab8a48c7 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:29.864475 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-992d1b5f-1709-4a4d-b064-a257ab8a48c7 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:29.873802 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-992d1b5f-1709-4a4d-b064-a257ab8a48c7 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:30.349760 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-992d1b5f-1709-4a4d-b064-a257ab8a48c7 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:30.360576 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-992d1b5f-1709-4a4d-b064-a257ab8a48c7 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:30.366131 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-992d1b5f-1709-4a4d-b064-a257ab8a48c7 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:30.369062 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-992d1b5f-1709-4a4d-b064-a257ab8a48c7 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] 10.222.0.43 "GET /compute/v2.1/servers/101952eb-ca4d-489c-8cb5-3bfadf241aa3" status: 200 len: 1723 microversion: 2.20 time: 0.541083 Oct 04 19:06:30.370285 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3193/6013] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:06:29 2022] GET /compute/v2.1/servers/101952eb-ca4d-489c-8cb5-3bfadf241aa3 => generated 1723 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:06:31.400538 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-05cab718-0701-4367-90ca-f2e5f479fcf5 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:31.401242 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-05cab718-0701-4367-90ca-f2e5f479fcf5 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] [instance: 101952eb-ca4d-489c-8cb5-3bfadf241aa3] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:31.412219 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=4 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:06:31.419495 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-05cab718-0701-4367-90ca-f2e5f479fcf5 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:31.420506 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-05cab718-0701-4367-90ca-f2e5f479fcf5 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:31.421320 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-05cab718-0701-4367-90ca-f2e5f479fcf5 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:31.422265 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-05cab718-0701-4367-90ca-f2e5f479fcf5 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:31.426363 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-05cab718-0701-4367-90ca-f2e5f479fcf5 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:31.427107 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-05cab718-0701-4367-90ca-f2e5f479fcf5 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:32.064768 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-05cab718-0701-4367-90ca-f2e5f479fcf5 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:32.091006 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-05cab718-0701-4367-90ca-f2e5f479fcf5 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:32.092785 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-05cab718-0701-4367-90ca-f2e5f479fcf5 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:32.103800 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-05cab718-0701-4367-90ca-f2e5f479fcf5 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] 10.222.0.43 "GET /compute/v2.1/servers/101952eb-ca4d-489c-8cb5-3bfadf241aa3" status: 200 len: 1723 microversion: 2.20 time: 0.707176 Oct 04 19:06:32.110348 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2821/6014] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:06:31 2022] GET /compute/v2.1/servers/101952eb-ca4d-489c-8cb5-3bfadf241aa3 => generated 1723 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:06:33.139380 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-e711b701-8b25-45a0-8050-67bda55a2432 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:33.139890 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-e711b701-8b25-45a0-8050-67bda55a2432 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] [instance: 101952eb-ca4d-489c-8cb5-3bfadf241aa3] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:33.154264 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e711b701-8b25-45a0-8050-67bda55a2432 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:33.155033 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e711b701-8b25-45a0-8050-67bda55a2432 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:33.155670 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e711b701-8b25-45a0-8050-67bda55a2432 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:33.156570 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e711b701-8b25-45a0-8050-67bda55a2432 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:33.157912 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e711b701-8b25-45a0-8050-67bda55a2432 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:33.179956 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e711b701-8b25-45a0-8050-67bda55a2432 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:33.196822 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=92 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:06:33.672780 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-e711b701-8b25-45a0-8050-67bda55a2432 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:33.692365 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-e711b701-8b25-45a0-8050-67bda55a2432 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:33.698915 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-e711b701-8b25-45a0-8050-67bda55a2432 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:33.711123 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-e711b701-8b25-45a0-8050-67bda55a2432 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] 10.222.0.43 "GET /compute/v2.1/servers/101952eb-ca4d-489c-8cb5-3bfadf241aa3" status: 200 len: 1723 microversion: 2.20 time: 0.576762 Oct 04 19:06:33.715487 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3194/6015] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:06:33 2022] GET /compute/v2.1/servers/101952eb-ca4d-489c-8cb5-3bfadf241aa3 => generated 1723 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:06:34.751353 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-5e6b80df-5ffd-4c03-8e6b-ba774f271284 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:34.752150 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-5e6b80df-5ffd-4c03-8e6b-ba774f271284 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] [instance: 101952eb-ca4d-489c-8cb5-3bfadf241aa3] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:34.764794 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5e6b80df-5ffd-4c03-8e6b-ba774f271284 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:34.765616 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5e6b80df-5ffd-4c03-8e6b-ba774f271284 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:34.766063 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5e6b80df-5ffd-4c03-8e6b-ba774f271284 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:34.766943 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5e6b80df-5ffd-4c03-8e6b-ba774f271284 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:34.767513 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5e6b80df-5ffd-4c03-8e6b-ba774f271284 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:34.768094 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5e6b80df-5ffd-4c03-8e6b-ba774f271284 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:35.057433 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-5e6b80df-5ffd-4c03-8e6b-ba774f271284 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:35.078959 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-5e6b80df-5ffd-4c03-8e6b-ba774f271284 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:35.087107 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-5e6b80df-5ffd-4c03-8e6b-ba774f271284 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:35.091412 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-5e6b80df-5ffd-4c03-8e6b-ba774f271284 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] 10.222.0.43 "GET /compute/v2.1/servers/101952eb-ca4d-489c-8cb5-3bfadf241aa3" status: 200 len: 1723 microversion: 2.20 time: 0.351091 Oct 04 19:06:35.094574 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2822/6016] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:06:34 2022] GET /compute/v2.1/servers/101952eb-ca4d-489c-8cb5-3bfadf241aa3 => generated 1723 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:06:35.637857 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-dda3183c-63e2-4df2-8d89-b96d7ebf9972 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1104319901", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452", "networks": [{"uuid": "88410367-90ef-41ff-af80-f98b1328d3c0"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1195087969", "security_groups": [{"name": "tempest-secgroup-smoke-1436476423"}]}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:06:35.934793 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.network.neutron [None req-dda3183c-63e2-4df2-8d89-b96d7ebf9972 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] validate_networks() for [('88410367-90ef-41ff-af80-f98b1328d3c0', None, None, None, None, None)] {{(pid=123596) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 19:06:36.127662 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-37da59f8-7331-4d76-b2f1-b6102cf658b7 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:36.128909 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-37da59f8-7331-4d76-b2f1-b6102cf658b7 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] [instance: 101952eb-ca4d-489c-8cb5-3bfadf241aa3] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:36.142327 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-37da59f8-7331-4d76-b2f1-b6102cf658b7 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:36.146172 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-37da59f8-7331-4d76-b2f1-b6102cf658b7 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:36.146826 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-37da59f8-7331-4d76-b2f1-b6102cf658b7 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:36.148947 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-37da59f8-7331-4d76-b2f1-b6102cf658b7 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:36.149622 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-37da59f8-7331-4d76-b2f1-b6102cf658b7 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:36.155232 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-37da59f8-7331-4d76-b2f1-b6102cf658b7 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:36.466798 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-37da59f8-7331-4d76-b2f1-b6102cf658b7 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:36.478167 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-37da59f8-7331-4d76-b2f1-b6102cf658b7 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:36.480064 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-37da59f8-7331-4d76-b2f1-b6102cf658b7 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:36.481659 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-37da59f8-7331-4d76-b2f1-b6102cf658b7 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] 10.222.0.43 "GET /compute/v2.1/servers/101952eb-ca4d-489c-8cb5-3bfadf241aa3" status: 200 len: 1723 microversion: 2.20 time: 0.358197 Oct 04 19:06:36.494986 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2823/6017] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:06:36 2022] GET /compute/v2.1/servers/101952eb-ca4d-489c-8cb5-3bfadf241aa3 => generated 1723 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:06:37.511261 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-e73af9c3-3056-4627-a6f0-085eb3b9d727 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:37.512857 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-e73af9c3-3056-4627-a6f0-085eb3b9d727 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] [instance: 101952eb-ca4d-489c-8cb5-3bfadf241aa3] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:37.535668 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e73af9c3-3056-4627-a6f0-085eb3b9d727 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:37.539096 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e73af9c3-3056-4627-a6f0-085eb3b9d727 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:37.540535 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e73af9c3-3056-4627-a6f0-085eb3b9d727 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:37.546077 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e73af9c3-3056-4627-a6f0-085eb3b9d727 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:37.547407 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e73af9c3-3056-4627-a6f0-085eb3b9d727 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:37.551179 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e73af9c3-3056-4627-a6f0-085eb3b9d727 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:37.624777 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-dda3183c-63e2-4df2-8d89-b96d7ebf9972 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Flavor limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:06:37.625240 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-dda3183c-63e2-4df2-8d89-b96d7ebf9972 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Image limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:06:37.625566 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-dda3183c-63e2-4df2-8d89-b96d7ebf9972 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Flavor pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:06:37.626019 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-dda3183c-63e2-4df2-8d89-b96d7ebf9972 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Image pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:06:37.626427 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-dda3183c-63e2-4df2-8d89-b96d7ebf9972 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:06:37.650031 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dda3183c-63e2-4df2-8d89-b96d7ebf9972 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:37.650547 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dda3183c-63e2-4df2-8d89-b96d7ebf9972 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:37.658810 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dda3183c-63e2-4df2-8d89-b96d7ebf9972 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:37.659796 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dda3183c-63e2-4df2-8d89-b96d7ebf9972 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:37.660294 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dda3183c-63e2-4df2-8d89-b96d7ebf9972 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:37.660748 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dda3183c-63e2-4df2-8d89-b96d7ebf9972 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:37.738248 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-dda3183c-63e2-4df2-8d89-b96d7ebf9972 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Getting quotas for project c0c25f1d17e94c74868357744e692487. Resources: {'ram', 'cores', 'instances'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:06:37.753024 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-dda3183c-63e2-4df2-8d89-b96d7ebf9972 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Getting quotas for user bf87794979e844349d6ec6c6650565f7 and project c0c25f1d17e94c74868357744e692487. Resources: {'ram', 'cores', 'instances'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:06:37.785155 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-dda3183c-63e2-4df2-8d89-b96d7ebf9972 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Going to run 1 instances... {{(pid=123596) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 19:06:37.787728 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-dda3183c-63e2-4df2-8d89-b96d7ebf9972 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] [instance: b01e7e24-c866-4852-9fa8-568f69f68b27] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e8943ec5-4038-4d4b-b9b9-2415a79f5243',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123596) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 19:06:37.877681 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-dda3183c-63e2-4df2-8d89-b96d7ebf9972 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.251013 Oct 04 19:06:37.880266 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3195/6018] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 19:06:35 2022] POST /compute/v2.1/servers => generated 406 bytes in 2254 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 19:06:37.898325 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-44bbf4fd-ce8a-4323-ade8-d29adee399a7 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:37.899106 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-44bbf4fd-ce8a-4323-ade8-d29adee399a7 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] [instance: b01e7e24-c866-4852-9fa8-568f69f68b27] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:38.023813 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-44bbf4fd-ce8a-4323-ade8-d29adee399a7 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf87794979e844349d6ec6c6650565f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c25f1d17e94c74868357744e692487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:38.037310 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-44bbf4fd-ce8a-4323-ade8-d29adee399a7 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] 10.222.0.43 "GET /compute/v2.1/servers/b01e7e24-c866-4852-9fa8-568f69f68b27" status: 200 len: 1267 microversion: 2.1 time: 0.148147 Oct 04 19:06:38.038315 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3196/6019] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:37 2022] GET /compute/v2.1/servers/b01e7e24-c866-4852-9fa8-568f69f68b27 => generated 1267 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:06:38.212027 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-e73af9c3-3056-4627-a6f0-085eb3b9d727 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:38.229440 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-e73af9c3-3056-4627-a6f0-085eb3b9d727 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:38.232363 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-e73af9c3-3056-4627-a6f0-085eb3b9d727 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:38.234007 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-e73af9c3-3056-4627-a6f0-085eb3b9d727 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] 10.222.0.43 "GET /compute/v2.1/servers/101952eb-ca4d-489c-8cb5-3bfadf241aa3" status: 200 len: 1723 microversion: 2.20 time: 0.728852 Oct 04 19:06:38.259217 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2824/6020] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:06:37 2022] GET /compute/v2.1/servers/101952eb-ca4d-489c-8cb5-3bfadf241aa3 => generated 1723 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 19:06:39.071476 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-849d161e-0b0b-4b59-bf9e-11f60a504159 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:39.073178 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-849d161e-0b0b-4b59-bf9e-11f60a504159 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] [instance: b01e7e24-c866-4852-9fa8-568f69f68b27] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:39.101413 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-849d161e-0b0b-4b59-bf9e-11f60a504159 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:39.102644 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-849d161e-0b0b-4b59-bf9e-11f60a504159 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:39.103510 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-849d161e-0b0b-4b59-bf9e-11f60a504159 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:39.109004 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-849d161e-0b0b-4b59-bf9e-11f60a504159 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:39.112066 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-849d161e-0b0b-4b59-bf9e-11f60a504159 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:39.112867 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-849d161e-0b0b-4b59-bf9e-11f60a504159 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:39.265873 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-5a0a430f-8119-4fe8-80cd-532d430acc6d tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:39.266669 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-5a0a430f-8119-4fe8-80cd-532d430acc6d tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] [instance: 101952eb-ca4d-489c-8cb5-3bfadf241aa3] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:39.270298 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_api:SELECT=49,nova_api:DELETE=1,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:06:39.281749 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5a0a430f-8119-4fe8-80cd-532d430acc6d tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:39.289953 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5a0a430f-8119-4fe8-80cd-532d430acc6d tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:39.290645 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5a0a430f-8119-4fe8-80cd-532d430acc6d tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:39.294029 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5a0a430f-8119-4fe8-80cd-532d430acc6d tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:39.295149 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5a0a430f-8119-4fe8-80cd-532d430acc6d tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:39.296118 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5a0a430f-8119-4fe8-80cd-532d430acc6d tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:39.320112 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-849d161e-0b0b-4b59-bf9e-11f60a504159 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf87794979e844349d6ec6c6650565f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c25f1d17e94c74868357744e692487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:39.332505 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-849d161e-0b0b-4b59-bf9e-11f60a504159 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] 10.222.0.43 "GET /compute/v2.1/servers/b01e7e24-c866-4852-9fa8-568f69f68b27" status: 200 len: 1263 microversion: 2.1 time: 0.267812 Oct 04 19:06:39.336556 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3197/6021] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:39 2022] GET /compute/v2.1/servers/b01e7e24-c866-4852-9fa8-568f69f68b27 => generated 1263 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:06:39.651712 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-5a0a430f-8119-4fe8-80cd-532d430acc6d tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:39.664017 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-5a0a430f-8119-4fe8-80cd-532d430acc6d tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:39.666308 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-5a0a430f-8119-4fe8-80cd-532d430acc6d tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:39.668378 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-5a0a430f-8119-4fe8-80cd-532d430acc6d tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] 10.222.0.43 "GET /compute/v2.1/servers/101952eb-ca4d-489c-8cb5-3bfadf241aa3" status: 200 len: 1723 microversion: 2.20 time: 0.406838 Oct 04 19:06:39.669605 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2825/6022] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:06:39 2022] GET /compute/v2.1/servers/101952eb-ca4d-489c-8cb5-3bfadf241aa3 => generated 1723 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:06:40.363900 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-6dbc0519-d53a-4369-b99e-3a992741fd01 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:40.364539 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-6dbc0519-d53a-4369-b99e-3a992741fd01 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] [instance: b01e7e24-c866-4852-9fa8-568f69f68b27] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:40.376563 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6dbc0519-d53a-4369-b99e-3a992741fd01 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:40.383831 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6dbc0519-d53a-4369-b99e-3a992741fd01 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:40.388617 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6dbc0519-d53a-4369-b99e-3a992741fd01 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:40.392383 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6dbc0519-d53a-4369-b99e-3a992741fd01 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:40.396803 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6dbc0519-d53a-4369-b99e-3a992741fd01 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:40.397863 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6dbc0519-d53a-4369-b99e-3a992741fd01 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:40.699424 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-813976aa-e537-4279-b573-de203f581afa tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:40.700055 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-813976aa-e537-4279-b573-de203f581afa tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] [instance: 101952eb-ca4d-489c-8cb5-3bfadf241aa3] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:40.720841 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-813976aa-e537-4279-b573-de203f581afa tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:40.729661 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-813976aa-e537-4279-b573-de203f581afa tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:40.733236 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-813976aa-e537-4279-b573-de203f581afa tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:40.734502 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-813976aa-e537-4279-b573-de203f581afa tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:40.737136 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-813976aa-e537-4279-b573-de203f581afa tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:40.738024 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-813976aa-e537-4279-b573-de203f581afa tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:40.764393 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-6dbc0519-d53a-4369-b99e-3a992741fd01 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf87794979e844349d6ec6c6650565f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c25f1d17e94c74868357744e692487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:40.786992 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-6dbc0519-d53a-4369-b99e-3a992741fd01 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] 10.222.0.43 "GET /compute/v2.1/servers/b01e7e24-c866-4852-9fa8-568f69f68b27" status: 200 len: 1325 microversion: 2.1 time: 0.427570 Oct 04 19:06:40.792793 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3198/6023] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:40 2022] GET /compute/v2.1/servers/b01e7e24-c866-4852-9fa8-568f69f68b27 => generated 1325 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:06:41.074714 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-813976aa-e537-4279-b573-de203f581afa tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:41.091262 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-813976aa-e537-4279-b573-de203f581afa tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:41.099027 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-813976aa-e537-4279-b573-de203f581afa tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:41.101059 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-813976aa-e537-4279-b573-de203f581afa tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] 10.222.0.43 "GET /compute/v2.1/servers/101952eb-ca4d-489c-8cb5-3bfadf241aa3" status: 200 len: 1723 microversion: 2.20 time: 0.407097 Oct 04 19:06:41.102322 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2826/6024] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:06:40 2022] GET /compute/v2.1/servers/101952eb-ca4d-489c-8cb5-3bfadf241aa3 => generated 1723 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 19:06:41.821397 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f99a968b-acb1-49b7-9882-64f280dee84f tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:41.822799 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-f99a968b-acb1-49b7-9882-64f280dee84f tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] [instance: b01e7e24-c866-4852-9fa8-568f69f68b27] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:41.846526 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f99a968b-acb1-49b7-9882-64f280dee84f tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:41.848070 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f99a968b-acb1-49b7-9882-64f280dee84f tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:41.851908 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f99a968b-acb1-49b7-9882-64f280dee84f tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:41.852847 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f99a968b-acb1-49b7-9882-64f280dee84f tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:41.853506 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f99a968b-acb1-49b7-9882-64f280dee84f tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:41.854091 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f99a968b-acb1-49b7-9882-64f280dee84f tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:42.073696 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-f99a968b-acb1-49b7-9882-64f280dee84f tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf87794979e844349d6ec6c6650565f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c25f1d17e94c74868357744e692487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:42.083169 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-f99a968b-acb1-49b7-9882-64f280dee84f tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] 10.222.0.43 "GET /compute/v2.1/servers/b01e7e24-c866-4852-9fa8-568f69f68b27" status: 200 len: 1325 microversion: 2.1 time: 0.266615 Oct 04 19:06:42.084270 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3199/6025] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:41 2022] GET /compute/v2.1/servers/b01e7e24-c866-4852-9fa8-568f69f68b27 => generated 1325 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:06:42.132418 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-b7885f5a-3c24-4fd5-9724-6e798749a857 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:42.135432 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-b7885f5a-3c24-4fd5-9724-6e798749a857 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] [instance: 101952eb-ca4d-489c-8cb5-3bfadf241aa3] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:42.153342 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b7885f5a-3c24-4fd5-9724-6e798749a857 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:42.154134 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b7885f5a-3c24-4fd5-9724-6e798749a857 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:42.160947 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b7885f5a-3c24-4fd5-9724-6e798749a857 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:42.161968 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b7885f5a-3c24-4fd5-9724-6e798749a857 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:42.168189 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b7885f5a-3c24-4fd5-9724-6e798749a857 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:42.168930 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b7885f5a-3c24-4fd5-9724-6e798749a857 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:42.515817 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-b7885f5a-3c24-4fd5-9724-6e798749a857 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:42.543400 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-b7885f5a-3c24-4fd5-9724-6e798749a857 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:42.546966 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-b7885f5a-3c24-4fd5-9724-6e798749a857 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:42.548204 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-b7885f5a-3c24-4fd5-9724-6e798749a857 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] 10.222.0.43 "GET /compute/v2.1/servers/101952eb-ca4d-489c-8cb5-3bfadf241aa3" status: 200 len: 1744 microversion: 2.20 time: 0.420624 Oct 04 19:06:42.550949 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2827/6026] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:06:42 2022] GET /compute/v2.1/servers/101952eb-ca4d-489c-8cb5-3bfadf241aa3 => generated 1744 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:06:43.110573 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-d015905c-1410-4411-a584-7dadbaa1f02c tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:43.111922 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-d015905c-1410-4411-a584-7dadbaa1f02c tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] [instance: b01e7e24-c866-4852-9fa8-568f69f68b27] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:43.122644 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d015905c-1410-4411-a584-7dadbaa1f02c tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:43.123382 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d015905c-1410-4411-a584-7dadbaa1f02c tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:43.123993 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d015905c-1410-4411-a584-7dadbaa1f02c tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:43.124883 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d015905c-1410-4411-a584-7dadbaa1f02c tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:43.125527 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d015905c-1410-4411-a584-7dadbaa1f02c tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:43.126109 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d015905c-1410-4411-a584-7dadbaa1f02c tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:43.581805 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-6002dac6-6840-44b7-93bb-a645cd48ddcd tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:43.582751 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-6002dac6-6840-44b7-93bb-a645cd48ddcd tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] [instance: 101952eb-ca4d-489c-8cb5-3bfadf241aa3] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:43.603992 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6002dac6-6840-44b7-93bb-a645cd48ddcd tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:43.604708 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6002dac6-6840-44b7-93bb-a645cd48ddcd tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:43.605956 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6002dac6-6840-44b7-93bb-a645cd48ddcd tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:43.608758 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6002dac6-6840-44b7-93bb-a645cd48ddcd tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:43.609456 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6002dac6-6840-44b7-93bb-a645cd48ddcd tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:43.610655 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6002dac6-6840-44b7-93bb-a645cd48ddcd tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:43.669821 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-d015905c-1410-4411-a584-7dadbaa1f02c tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf87794979e844349d6ec6c6650565f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c25f1d17e94c74868357744e692487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:43.693355 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-d015905c-1410-4411-a584-7dadbaa1f02c tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] 10.222.0.43 "GET /compute/v2.1/servers/b01e7e24-c866-4852-9fa8-568f69f68b27" status: 200 len: 1393 microversion: 2.1 time: 0.577513 Oct 04 19:06:43.697323 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3200/6027] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:43 2022] GET /compute/v2.1/servers/b01e7e24-c866-4852-9fa8-568f69f68b27 => generated 1393 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:06:44.210572 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-6002dac6-6840-44b7-93bb-a645cd48ddcd tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:44.224396 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-6002dac6-6840-44b7-93bb-a645cd48ddcd tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:44.226920 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-6002dac6-6840-44b7-93bb-a645cd48ddcd tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:44.233301 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-6002dac6-6840-44b7-93bb-a645cd48ddcd tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] 10.222.0.43 "GET /compute/v2.1/servers/101952eb-ca4d-489c-8cb5-3bfadf241aa3" status: 200 len: 1739 microversion: 2.20 time: 0.656682 Oct 04 19:06:44.241445 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2828/6028] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:06:43 2022] GET /compute/v2.1/servers/101952eb-ca4d-489c-8cb5-3bfadf241aa3 => generated 1739 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 19:06:44.724010 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f071bf9e-97e4-4f46-9e00-011dc0fab2a8 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:44.724691 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-f071bf9e-97e4-4f46-9e00-011dc0fab2a8 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] [instance: b01e7e24-c866-4852-9fa8-568f69f68b27] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:44.744413 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f071bf9e-97e4-4f46-9e00-011dc0fab2a8 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:44.745718 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f071bf9e-97e4-4f46-9e00-011dc0fab2a8 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:44.747758 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f071bf9e-97e4-4f46-9e00-011dc0fab2a8 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:44.748719 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f071bf9e-97e4-4f46-9e00-011dc0fab2a8 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:44.753293 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f071bf9e-97e4-4f46-9e00-011dc0fab2a8 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:44.754766 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f071bf9e-97e4-4f46-9e00-011dc0fab2a8 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:45.239829 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-f071bf9e-97e4-4f46-9e00-011dc0fab2a8 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf87794979e844349d6ec6c6650565f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c25f1d17e94c74868357744e692487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:45.260627 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-f071bf9e-97e4-4f46-9e00-011dc0fab2a8 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] 10.222.0.43 "GET /compute/v2.1/servers/b01e7e24-c866-4852-9fa8-568f69f68b27" status: 200 len: 1393 microversion: 2.1 time: 0.542092 Oct 04 19:06:45.261304 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3201/6029] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:44 2022] GET /compute/v2.1/servers/b01e7e24-c866-4852-9fa8-568f69f68b27 => generated 1393 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:06:45.272015 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-e596cf9d-3405-4e8c-b649-53d52dc444ff tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:45.281703 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-e596cf9d-3405-4e8c-b649-53d52dc444ff tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] [instance: 101952eb-ca4d-489c-8cb5-3bfadf241aa3] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:45.356164 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e596cf9d-3405-4e8c-b649-53d52dc444ff tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:45.373884 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e596cf9d-3405-4e8c-b649-53d52dc444ff tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.028s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:45.377551 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e596cf9d-3405-4e8c-b649-53d52dc444ff tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:45.383784 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e596cf9d-3405-4e8c-b649-53d52dc444ff tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:45.387092 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e596cf9d-3405-4e8c-b649-53d52dc444ff tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:45.393171 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e596cf9d-3405-4e8c-b649-53d52dc444ff tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:45.924791 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-d7b4ba7d-16dd-4a1a-b05b-88f8d692c863 req-0fc058e9-5d36-40a4-809f-20a448d84ba7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b01e7e24-c866-4852-9fa8-568f69f68b27", "tag": "fd2276f3-9cc1-4bd3-bf40-500abff51568"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:06:45.960806 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-d7b4ba7d-16dd-4a1a-b05b-88f8d692c863 req-0fc058e9-5d36-40a4-809f-20a448d84ba7 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:45.965205 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-d7b4ba7d-16dd-4a1a-b05b-88f8d692c863 req-0fc058e9-5d36-40a4-809f-20a448d84ba7 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:45.966976 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-d7b4ba7d-16dd-4a1a-b05b-88f8d692c863 req-0fc058e9-5d36-40a4-809f-20a448d84ba7 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:45.999611 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-d7b4ba7d-16dd-4a1a-b05b-88f8d692c863 req-0fc058e9-5d36-40a4-809f-20a448d84ba7 service nova] Creating event network-changed:fd2276f3-9cc1-4bd3-bf40-500abff51568 for instance b01e7e24-c866-4852-9fa8-568f69f68b27 on n-h2-851028-13 Oct 04 19:06:46.007967 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-d7b4ba7d-16dd-4a1a-b05b-88f8d692c863 req-0fc058e9-5d36-40a4-809f-20a448d84ba7 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087181 Oct 04 19:06:46.016227 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3202/6030] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:06:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:06:46.289143 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-80534f0f-3973-4476-b8e3-a4742dfa7fb4 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:46.290170 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-80534f0f-3973-4476-b8e3-a4742dfa7fb4 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] [instance: b01e7e24-c866-4852-9fa8-568f69f68b27] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:46.311359 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-80534f0f-3973-4476-b8e3-a4742dfa7fb4 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:46.312244 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-80534f0f-3973-4476-b8e3-a4742dfa7fb4 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:46.314644 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-80534f0f-3973-4476-b8e3-a4742dfa7fb4 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:46.316538 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-80534f0f-3973-4476-b8e3-a4742dfa7fb4 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:46.318684 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-80534f0f-3973-4476-b8e3-a4742dfa7fb4 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:46.319948 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-80534f0f-3973-4476-b8e3-a4742dfa7fb4 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:46.835606 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-80534f0f-3973-4476-b8e3-a4742dfa7fb4 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf87794979e844349d6ec6c6650565f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c25f1d17e94c74868357744e692487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:46.848841 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-80534f0f-3973-4476-b8e3-a4742dfa7fb4 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] 10.222.0.43 "GET /compute/v2.1/servers/b01e7e24-c866-4852-9fa8-568f69f68b27" status: 200 len: 1393 microversion: 2.1 time: 0.564353 Oct 04 19:06:46.858316 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-e596cf9d-3405-4e8c-b649-53d52dc444ff tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:46.868305 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3203/6031] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:46 2022] GET /compute/v2.1/servers/b01e7e24-c866-4852-9fa8-568f69f68b27 => generated 1393 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:06:46.909645 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-e596cf9d-3405-4e8c-b649-53d52dc444ff tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:46.913222 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-e596cf9d-3405-4e8c-b649-53d52dc444ff tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:46.915641 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-e596cf9d-3405-4e8c-b649-53d52dc444ff tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] 10.222.0.43 "GET /compute/v2.1/servers/101952eb-ca4d-489c-8cb5-3bfadf241aa3" status: 200 len: 1739 microversion: 2.20 time: 1.657850 Oct 04 19:06:46.930321 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2829/6032] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:06:45 2022] GET /compute/v2.1/servers/101952eb-ca4d-489c-8cb5-3bfadf241aa3 => generated 1739 bytes in 1673 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:06:47.877125 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-8413f758-6879-4422-b720-d095350177fb tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:47.877753 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-8413f758-6879-4422-b720-d095350177fb tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] [instance: b01e7e24-c866-4852-9fa8-568f69f68b27] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:47.891465 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=2 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:06:47.901277 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8413f758-6879-4422-b720-d095350177fb tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:47.902599 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8413f758-6879-4422-b720-d095350177fb tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:47.903280 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8413f758-6879-4422-b720-d095350177fb tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:47.904211 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8413f758-6879-4422-b720-d095350177fb tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:47.904836 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8413f758-6879-4422-b720-d095350177fb tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:47.905469 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8413f758-6879-4422-b720-d095350177fb tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:47.949387 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-80708574-e547-48ea-91af-83c30592e117 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:47.950962 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-80708574-e547-48ea-91af-83c30592e117 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] [instance: 101952eb-ca4d-489c-8cb5-3bfadf241aa3] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:47.961966 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-80708574-e547-48ea-91af-83c30592e117 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:47.963291 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-80708574-e547-48ea-91af-83c30592e117 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:47.964188 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-80708574-e547-48ea-91af-83c30592e117 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:47.965926 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-80708574-e547-48ea-91af-83c30592e117 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:47.967235 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-80708574-e547-48ea-91af-83c30592e117 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:47.967845 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-80708574-e547-48ea-91af-83c30592e117 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:48.032482 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=8 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:06:48.210755 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-80708574-e547-48ea-91af-83c30592e117 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:48.227792 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-80708574-e547-48ea-91af-83c30592e117 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:48.229278 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-80708574-e547-48ea-91af-83c30592e117 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:48.238122 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-80708574-e547-48ea-91af-83c30592e117 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] 10.222.0.43 "GET /compute/v2.1/servers/101952eb-ca4d-489c-8cb5-3bfadf241aa3" status: 200 len: 1739 microversion: 2.20 time: 0.292804 Oct 04 19:06:48.239335 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2830/6033] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:06:47 2022] GET /compute/v2.1/servers/101952eb-ca4d-489c-8cb5-3bfadf241aa3 => generated 1739 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:06:48.308286 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-8413f758-6879-4422-b720-d095350177fb tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf87794979e844349d6ec6c6650565f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c25f1d17e94c74868357744e692487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:48.319536 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-8413f758-6879-4422-b720-d095350177fb tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] 10.222.0.43 "GET /compute/v2.1/servers/b01e7e24-c866-4852-9fa8-568f69f68b27" status: 200 len: 1393 microversion: 2.1 time: 0.446151 Oct 04 19:06:48.320151 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3204/6034] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:47 2022] GET /compute/v2.1/servers/b01e7e24-c866-4852-9fa8-568f69f68b27 => generated 1393 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:06:48.590403 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-cea92836-2455-4926-a413-0033566b69c9 req-bdc5ba9f-2b15-4743-8e13-8b527c683e3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "101952eb-ca4d-489c-8cb5-3bfadf241aa3", "name": "network-vif-plugged", "status": "completed", "tag": "1c32f64c-fd96-488e-ad04-113ec01cb7c8"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:06:48.617347 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-cea92836-2455-4926-a413-0033566b69c9 req-bdc5ba9f-2b15-4743-8e13-8b527c683e3e service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:48.620176 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-cea92836-2455-4926-a413-0033566b69c9 req-bdc5ba9f-2b15-4743-8e13-8b527c683e3e service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:48.620745 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-cea92836-2455-4926-a413-0033566b69c9 req-bdc5ba9f-2b15-4743-8e13-8b527c683e3e service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:48.655819 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-cea92836-2455-4926-a413-0033566b69c9 req-bdc5ba9f-2b15-4743-8e13-8b527c683e3e service nova] Creating event network-vif-plugged:1c32f64c-fd96-488e-ad04-113ec01cb7c8 for instance 101952eb-ca4d-489c-8cb5-3bfadf241aa3 on n-h1-851028-13 Oct 04 19:06:48.671159 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-cea92836-2455-4926-a413-0033566b69c9 req-bdc5ba9f-2b15-4743-8e13-8b527c683e3e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084520 Oct 04 19:06:48.674273 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2831/6035] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:06:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:06:49.269335 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-0f131f6e-bbe9-4832-853d-6e4a15a58d98 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:49.273512 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-0f131f6e-bbe9-4832-853d-6e4a15a58d98 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] [instance: 101952eb-ca4d-489c-8cb5-3bfadf241aa3] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:49.294275 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0f131f6e-bbe9-4832-853d-6e4a15a58d98 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:49.295077 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0f131f6e-bbe9-4832-853d-6e4a15a58d98 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:49.295858 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0f131f6e-bbe9-4832-853d-6e4a15a58d98 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:49.297098 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0f131f6e-bbe9-4832-853d-6e4a15a58d98 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:49.297964 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0f131f6e-bbe9-4832-853d-6e4a15a58d98 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:49.298943 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0f131f6e-bbe9-4832-853d-6e4a15a58d98 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:49.448965 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-ef1e8188-278c-40a9-8568-ef94297006c8 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-1679005357", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452", "networks": [{"uuid": "3e245823-d88c-4351-9475-83210f04cacd"}]}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:06:49.538593 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-0f131f6e-bbe9-4832-853d-6e4a15a58d98 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:49.541710 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.network.neutron [None req-ef1e8188-278c-40a9-8568-ef94297006c8 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] validate_networks() for [('3e245823-d88c-4351-9475-83210f04cacd', None, None, None, None, None)] {{(pid=123596) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 19:06:49.548908 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-0f131f6e-bbe9-4832-853d-6e4a15a58d98 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:49.552230 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-0f131f6e-bbe9-4832-853d-6e4a15a58d98 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:49.554009 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-0f131f6e-bbe9-4832-853d-6e4a15a58d98 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] 10.222.0.43 "GET /compute/v2.1/servers/101952eb-ca4d-489c-8cb5-3bfadf241aa3" status: 200 len: 1739 microversion: 2.20 time: 0.288703 Oct 04 19:06:49.565816 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2832/6036] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:06:49 2022] GET /compute/v2.1/servers/101952eb-ca4d-489c-8cb5-3bfadf241aa3 => generated 1739 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:06:49.571454 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-fe802aa4-a08f-4a49-afe6-c12fd0372f19 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:49.572331 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-fe802aa4-a08f-4a49-afe6-c12fd0372f19 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] [instance: b01e7e24-c866-4852-9fa8-568f69f68b27] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:49.579157 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fe802aa4-a08f-4a49-afe6-c12fd0372f19 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:49.580330 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fe802aa4-a08f-4a49-afe6-c12fd0372f19 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:49.581016 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fe802aa4-a08f-4a49-afe6-c12fd0372f19 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:49.582362 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fe802aa4-a08f-4a49-afe6-c12fd0372f19 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:49.583760 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fe802aa4-a08f-4a49-afe6-c12fd0372f19 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:49.585445 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fe802aa4-a08f-4a49-afe6-c12fd0372f19 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:49.924236 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-fe802aa4-a08f-4a49-afe6-c12fd0372f19 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf87794979e844349d6ec6c6650565f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c25f1d17e94c74868357744e692487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:49.934288 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-fe802aa4-a08f-4a49-afe6-c12fd0372f19 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] 10.222.0.43 "GET /compute/v2.1/servers/b01e7e24-c866-4852-9fa8-568f69f68b27" status: 200 len: 1393 microversion: 2.1 time: 0.367056 Oct 04 19:06:49.943304 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2833/6037] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:49 2022] GET /compute/v2.1/servers/b01e7e24-c866-4852-9fa8-568f69f68b27 => generated 1393 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:06:50.367902 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-ef1e8188-278c-40a9-8568-ef94297006c8 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Flavor limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:06:50.368337 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-ef1e8188-278c-40a9-8568-ef94297006c8 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Image limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:06:50.368821 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-ef1e8188-278c-40a9-8568-ef94297006c8 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Flavor pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:06:50.369266 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-ef1e8188-278c-40a9-8568-ef94297006c8 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Image pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:06:50.369875 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-ef1e8188-278c-40a9-8568-ef94297006c8 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:06:50.389333 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ef1e8188-278c-40a9-8568-ef94297006c8 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:50.390355 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ef1e8188-278c-40a9-8568-ef94297006c8 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:50.390968 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ef1e8188-278c-40a9-8568-ef94297006c8 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:50.393017 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ef1e8188-278c-40a9-8568-ef94297006c8 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:50.402407 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ef1e8188-278c-40a9-8568-ef94297006c8 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:50.402900 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ef1e8188-278c-40a9-8568-ef94297006c8 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:50.446043 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-ef1e8188-278c-40a9-8568-ef94297006c8 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Getting quotas for project 229b7380efe14b739ead311d8ad55065. Resources: {'ram', 'cores', 'instances'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:06:50.486888 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-ef1e8188-278c-40a9-8568-ef94297006c8 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Getting quotas for user 1d730241785c494486329e88bd218c2b and project 229b7380efe14b739ead311d8ad55065. Resources: {'ram', 'cores', 'instances'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:06:50.520338 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-ef1e8188-278c-40a9-8568-ef94297006c8 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Going to run 1 instances... {{(pid=123596) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 19:06:50.523476 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-ef1e8188-278c-40a9-8568-ef94297006c8 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] [instance: 588c4f48-5a52-4a12-b79b-2bfa7b9769d4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e8943ec5-4038-4d4b-b9b9-2415a79f5243',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123596) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 19:06:50.581638 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-e7042ec8-72aa-417a-b9c2-2ba27b56bdb9 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:50.582262 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-e7042ec8-72aa-417a-b9c2-2ba27b56bdb9 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] [instance: 101952eb-ca4d-489c-8cb5-3bfadf241aa3] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:50.609378 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e7042ec8-72aa-417a-b9c2-2ba27b56bdb9 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:50.609929 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e7042ec8-72aa-417a-b9c2-2ba27b56bdb9 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:50.613236 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e7042ec8-72aa-417a-b9c2-2ba27b56bdb9 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:50.613946 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e7042ec8-72aa-417a-b9c2-2ba27b56bdb9 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:50.617681 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e7042ec8-72aa-417a-b9c2-2ba27b56bdb9 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:50.619286 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e7042ec8-72aa-417a-b9c2-2ba27b56bdb9 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:50.646313 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-ef1e8188-278c-40a9-8568-ef94297006c8 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.26 time: 1.494408 Oct 04 19:06:50.647353 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3205/6038] 10.222.0.43 () {62 vars in 1188 bytes} [Tue Oct 4 19:06:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 1496 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 04 19:06:50.660113 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-67221feb-871b-41d2-b3c5-4acbd6ab9e6a tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:50.663738 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-67221feb-871b-41d2-b3c5-4acbd6ab9e6a tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] [instance: 588c4f48-5a52-4a12-b79b-2bfa7b9769d4] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:50.747059 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-67221feb-871b-41d2-b3c5-4acbd6ab9e6a tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d730241785c494486329e88bd218c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229b7380efe14b739ead311d8ad55065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:50.757544 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-67221feb-871b-41d2-b3c5-4acbd6ab9e6a tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d730241785c494486329e88bd218c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229b7380efe14b739ead311d8ad55065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:50.759751 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-67221feb-871b-41d2-b3c5-4acbd6ab9e6a tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d730241785c494486329e88bd218c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229b7380efe14b739ead311d8ad55065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:50.761377 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-67221feb-871b-41d2-b3c5-4acbd6ab9e6a tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] 10.222.0.43 "GET /compute/v2.1/servers/588c4f48-5a52-4a12-b79b-2bfa7b9769d4" status: 200 len: 1262 microversion: 2.26 time: 0.105642 Oct 04 19:06:50.778089 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3206/6039] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:06:50 2022] GET /compute/v2.1/servers/588c4f48-5a52-4a12-b79b-2bfa7b9769d4 => generated 1262 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:06:50.969675 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-ab82ae9f-fdb0-45a8-b457-a6ba5ba11bbc tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:50.970631 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-ab82ae9f-fdb0-45a8-b457-a6ba5ba11bbc tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] [instance: b01e7e24-c866-4852-9fa8-568f69f68b27] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:50.983926 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ab82ae9f-fdb0-45a8-b457-a6ba5ba11bbc tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:50.989397 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ab82ae9f-fdb0-45a8-b457-a6ba5ba11bbc tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:50.990825 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ab82ae9f-fdb0-45a8-b457-a6ba5ba11bbc tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:50.995806 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ab82ae9f-fdb0-45a8-b457-a6ba5ba11bbc tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:50.996605 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ab82ae9f-fdb0-45a8-b457-a6ba5ba11bbc tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:50.997297 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ab82ae9f-fdb0-45a8-b457-a6ba5ba11bbc tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:50.999290 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-e7042ec8-72aa-417a-b9c2-2ba27b56bdb9 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:51.009998 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-e7042ec8-72aa-417a-b9c2-2ba27b56bdb9 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:51.011483 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-e7042ec8-72aa-417a-b9c2-2ba27b56bdb9 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:51.012679 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-e7042ec8-72aa-417a-b9c2-2ba27b56bdb9 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] 10.222.0.43 "GET /compute/v2.1/servers/101952eb-ca4d-489c-8cb5-3bfadf241aa3" status: 200 len: 1739 microversion: 2.20 time: 0.436145 Oct 04 19:06:51.013261 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2834/6040] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:06:50 2022] GET /compute/v2.1/servers/101952eb-ca4d-489c-8cb5-3bfadf241aa3 => generated 1739 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:06:51.276377 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-ab82ae9f-fdb0-45a8-b457-a6ba5ba11bbc tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf87794979e844349d6ec6c6650565f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c25f1d17e94c74868357744e692487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:51.284688 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-ab82ae9f-fdb0-45a8-b457-a6ba5ba11bbc tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] 10.222.0.43 "GET /compute/v2.1/servers/b01e7e24-c866-4852-9fa8-568f69f68b27" status: 200 len: 1393 microversion: 2.1 time: 0.320546 Oct 04 19:06:51.285526 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3207/6041] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:50 2022] GET /compute/v2.1/servers/b01e7e24-c866-4852-9fa8-568f69f68b27 => generated 1393 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:06:51.790684 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-84223fb6-9839-42fd-966d-072e4921dac9 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:51.792105 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-84223fb6-9839-42fd-966d-072e4921dac9 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] [instance: 588c4f48-5a52-4a12-b79b-2bfa7b9769d4] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:51.814914 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-84223fb6-9839-42fd-966d-072e4921dac9 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:51.815568 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-84223fb6-9839-42fd-966d-072e4921dac9 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:51.823911 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-84223fb6-9839-42fd-966d-072e4921dac9 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:51.824904 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-84223fb6-9839-42fd-966d-072e4921dac9 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:51.829346 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-84223fb6-9839-42fd-966d-072e4921dac9 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:51.830127 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-84223fb6-9839-42fd-966d-072e4921dac9 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:51.835865 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:06:51.943459 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-49efcc74-a16b-4bd3-925a-67e969b5e57a req-cec0807c-1662-4e99-b31b-022ab9ab4ec9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b01e7e24-c866-4852-9fa8-568f69f68b27", "name": "network-vif-plugged", "status": "completed", "tag": "fd2276f3-9cc1-4bd3-bf40-500abff51568"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:06:51.972310 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-49efcc74-a16b-4bd3-925a-67e969b5e57a req-cec0807c-1662-4e99-b31b-022ab9ab4ec9 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:51.972803 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-49efcc74-a16b-4bd3-925a-67e969b5e57a req-cec0807c-1662-4e99-b31b-022ab9ab4ec9 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:51.981402 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-49efcc74-a16b-4bd3-925a-67e969b5e57a req-cec0807c-1662-4e99-b31b-022ab9ab4ec9 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:52.023597 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-84223fb6-9839-42fd-966d-072e4921dac9 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d730241785c494486329e88bd218c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229b7380efe14b739ead311d8ad55065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:52.033190 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-49efcc74-a16b-4bd3-925a-67e969b5e57a req-cec0807c-1662-4e99-b31b-022ab9ab4ec9 service nova] Creating event network-vif-plugged:fd2276f3-9cc1-4bd3-bf40-500abff51568 for instance b01e7e24-c866-4852-9fa8-568f69f68b27 on n-h2-851028-13 Oct 04 19:06:52.052561 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-84223fb6-9839-42fd-966d-072e4921dac9 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d730241785c494486329e88bd218c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229b7380efe14b739ead311d8ad55065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:52.059436 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-49efcc74-a16b-4bd3-925a-67e969b5e57a req-cec0807c-1662-4e99-b31b-022ab9ab4ec9 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119493 Oct 04 19:06:52.063318 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3208/6042] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:06:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:06:52.063592 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-84223fb6-9839-42fd-966d-072e4921dac9 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d730241785c494486329e88bd218c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229b7380efe14b739ead311d8ad55065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:52.065288 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-84223fb6-9839-42fd-966d-072e4921dac9 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] 10.222.0.43 "GET /compute/v2.1/servers/588c4f48-5a52-4a12-b79b-2bfa7b9769d4" status: 200 len: 1314 microversion: 2.26 time: 0.279105 Oct 04 19:06:52.073024 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2835/6043] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:06:51 2022] GET /compute/v2.1/servers/588c4f48-5a52-4a12-b79b-2bfa7b9769d4 => generated 1314 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 19:06:52.140951 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-2f1d9e61-9ced-47eb-81ac-5a33833788e5 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:52.151954 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-2f1d9e61-9ced-47eb-81ac-5a33833788e5 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] [instance: 101952eb-ca4d-489c-8cb5-3bfadf241aa3] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:52.180216 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2f1d9e61-9ced-47eb-81ac-5a33833788e5 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:52.183353 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2f1d9e61-9ced-47eb-81ac-5a33833788e5 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:52.184134 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2f1d9e61-9ced-47eb-81ac-5a33833788e5 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:52.185100 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2f1d9e61-9ced-47eb-81ac-5a33833788e5 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:52.185809 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2f1d9e61-9ced-47eb-81ac-5a33833788e5 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:52.186431 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2f1d9e61-9ced-47eb-81ac-5a33833788e5 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:52.308510 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-bbf11312-ad25-4ec8-9314-9c5f13e97a7f tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:52.309332 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-bbf11312-ad25-4ec8-9314-9c5f13e97a7f tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] [instance: b01e7e24-c866-4852-9fa8-568f69f68b27] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:52.319522 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bbf11312-ad25-4ec8-9314-9c5f13e97a7f tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:52.320017 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bbf11312-ad25-4ec8-9314-9c5f13e97a7f tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:52.320459 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bbf11312-ad25-4ec8-9314-9c5f13e97a7f tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:52.323577 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bbf11312-ad25-4ec8-9314-9c5f13e97a7f tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:52.324066 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bbf11312-ad25-4ec8-9314-9c5f13e97a7f tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:52.324505 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bbf11312-ad25-4ec8-9314-9c5f13e97a7f tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:52.584303 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-bbf11312-ad25-4ec8-9314-9c5f13e97a7f tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf87794979e844349d6ec6c6650565f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c25f1d17e94c74868357744e692487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:52.584562 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-2f1d9e61-9ced-47eb-81ac-5a33833788e5 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:52.595123 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-bbf11312-ad25-4ec8-9314-9c5f13e97a7f tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] 10.222.0.43 "GET /compute/v2.1/servers/b01e7e24-c866-4852-9fa8-568f69f68b27" status: 200 len: 1393 microversion: 2.1 time: 0.290038 Oct 04 19:06:52.596895 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2836/6044] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:52 2022] GET /compute/v2.1/servers/b01e7e24-c866-4852-9fa8-568f69f68b27 => generated 1393 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:06:52.604281 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-2f1d9e61-9ced-47eb-81ac-5a33833788e5 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:52.606856 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-2f1d9e61-9ced-47eb-81ac-5a33833788e5 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:52.608306 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-2f1d9e61-9ced-47eb-81ac-5a33833788e5 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] 10.222.0.43 "GET /compute/v2.1/servers/101952eb-ca4d-489c-8cb5-3bfadf241aa3" status: 200 len: 1739 microversion: 2.20 time: 0.509306 Oct 04 19:06:52.609413 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3209/6045] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:06:52 2022] GET /compute/v2.1/servers/101952eb-ca4d-489c-8cb5-3bfadf241aa3 => generated 1739 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:06:53.101995 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-631ff4f2-c3a5-46a3-b5ef-a61a6a280436 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:53.102770 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-631ff4f2-c3a5-46a3-b5ef-a61a6a280436 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] [instance: 588c4f48-5a52-4a12-b79b-2bfa7b9769d4] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:53.118242 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-631ff4f2-c3a5-46a3-b5ef-a61a6a280436 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:53.118848 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-631ff4f2-c3a5-46a3-b5ef-a61a6a280436 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:53.122708 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-631ff4f2-c3a5-46a3-b5ef-a61a6a280436 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:53.123657 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-631ff4f2-c3a5-46a3-b5ef-a61a6a280436 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:53.124317 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-631ff4f2-c3a5-46a3-b5ef-a61a6a280436 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:53.124939 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-631ff4f2-c3a5-46a3-b5ef-a61a6a280436 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:53.324386 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-631ff4f2-c3a5-46a3-b5ef-a61a6a280436 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d730241785c494486329e88bd218c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229b7380efe14b739ead311d8ad55065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:53.343180 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-631ff4f2-c3a5-46a3-b5ef-a61a6a280436 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d730241785c494486329e88bd218c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229b7380efe14b739ead311d8ad55065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:53.343544 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-631ff4f2-c3a5-46a3-b5ef-a61a6a280436 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d730241785c494486329e88bd218c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229b7380efe14b739ead311d8ad55065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:53.348442 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-631ff4f2-c3a5-46a3-b5ef-a61a6a280436 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] 10.222.0.43 "GET /compute/v2.1/servers/588c4f48-5a52-4a12-b79b-2bfa7b9769d4" status: 200 len: 1320 microversion: 2.26 time: 0.250849 Oct 04 19:06:53.356442 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2837/6046] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:06:53 2022] GET /compute/v2.1/servers/588c4f48-5a52-4a12-b79b-2bfa7b9769d4 => generated 1320 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:06:53.623160 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-922441e6-bcb5-4249-ae51-d6c42c22773e tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:53.624547 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-922441e6-bcb5-4249-ae51-d6c42c22773e tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] [instance: b01e7e24-c866-4852-9fa8-568f69f68b27] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:53.638149 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-6a612295-6a2c-45ba-bb87-3aa910ebda80 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:53.638804 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-6a612295-6a2c-45ba-bb87-3aa910ebda80 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] [instance: 101952eb-ca4d-489c-8cb5-3bfadf241aa3] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:53.645208 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-922441e6-bcb5-4249-ae51-d6c42c22773e tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:53.646172 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-922441e6-bcb5-4249-ae51-d6c42c22773e tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:53.647591 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-922441e6-bcb5-4249-ae51-d6c42c22773e tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:53.651187 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-922441e6-bcb5-4249-ae51-d6c42c22773e tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:53.651656 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6a612295-6a2c-45ba-bb87-3aa910ebda80 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:53.652354 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6a612295-6a2c-45ba-bb87-3aa910ebda80 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:53.653358 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6a612295-6a2c-45ba-bb87-3aa910ebda80 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:53.654025 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-922441e6-bcb5-4249-ae51-d6c42c22773e tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:53.656160 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6a612295-6a2c-45ba-bb87-3aa910ebda80 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:53.657189 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6a612295-6a2c-45ba-bb87-3aa910ebda80 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:53.660723 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-922441e6-bcb5-4249-ae51-d6c42c22773e tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:53.660852 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6a612295-6a2c-45ba-bb87-3aa910ebda80 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:53.980362 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-922441e6-bcb5-4249-ae51-d6c42c22773e tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf87794979e844349d6ec6c6650565f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c25f1d17e94c74868357744e692487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:53.990864 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-922441e6-bcb5-4249-ae51-d6c42c22773e tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] 10.222.0.43 "GET /compute/v2.1/servers/b01e7e24-c866-4852-9fa8-568f69f68b27" status: 200 len: 1393 microversion: 2.1 time: 0.372563 Oct 04 19:06:54.005887 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3210/6047] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:53 2022] GET /compute/v2.1/servers/b01e7e24-c866-4852-9fa8-568f69f68b27 => generated 1393 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:06:54.110882 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-6a612295-6a2c-45ba-bb87-3aa910ebda80 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:54.121974 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-6a612295-6a2c-45ba-bb87-3aa910ebda80 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:54.129680 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-6a612295-6a2c-45ba-bb87-3aa910ebda80 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:54.136800 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-6a612295-6a2c-45ba-bb87-3aa910ebda80 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] 10.222.0.43 "GET /compute/v2.1/servers/101952eb-ca4d-489c-8cb5-3bfadf241aa3" status: 200 len: 1739 microversion: 2.20 time: 0.504466 Oct 04 19:06:54.137445 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2838/6048] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:06:53 2022] GET /compute/v2.1/servers/101952eb-ca4d-489c-8cb5-3bfadf241aa3 => generated 1739 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 19:06:54.376774 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f48b9cd5-eba5-4e4e-9d2c-c2ccbd581378 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:54.377524 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-f48b9cd5-eba5-4e4e-9d2c-c2ccbd581378 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] [instance: 588c4f48-5a52-4a12-b79b-2bfa7b9769d4] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:54.407268 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f48b9cd5-eba5-4e4e-9d2c-c2ccbd581378 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:54.411973 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f48b9cd5-eba5-4e4e-9d2c-c2ccbd581378 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:54.412795 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f48b9cd5-eba5-4e4e-9d2c-c2ccbd581378 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:54.413789 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f48b9cd5-eba5-4e4e-9d2c-c2ccbd581378 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:54.414586 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f48b9cd5-eba5-4e4e-9d2c-c2ccbd581378 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:54.415579 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f48b9cd5-eba5-4e4e-9d2c-c2ccbd581378 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:54.775613 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-f48b9cd5-eba5-4e4e-9d2c-c2ccbd581378 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d730241785c494486329e88bd218c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229b7380efe14b739ead311d8ad55065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:54.785131 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-f48b9cd5-eba5-4e4e-9d2c-c2ccbd581378 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d730241785c494486329e88bd218c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229b7380efe14b739ead311d8ad55065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:54.786853 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-f48b9cd5-eba5-4e4e-9d2c-c2ccbd581378 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d730241785c494486329e88bd218c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229b7380efe14b739ead311d8ad55065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:54.788754 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-f48b9cd5-eba5-4e4e-9d2c-c2ccbd581378 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] 10.222.0.43 "GET /compute/v2.1/servers/588c4f48-5a52-4a12-b79b-2bfa7b9769d4" status: 200 len: 1362 microversion: 2.26 time: 0.416214 Oct 04 19:06:54.789896 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3211/6049] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:06:54 2022] GET /compute/v2.1/servers/588c4f48-5a52-4a12-b79b-2bfa7b9769d4 => generated 1362 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:06:55.018355 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-e12fce1a-0d05-4352-ba3c-9a0659c5f0b9 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:55.018791 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-e12fce1a-0d05-4352-ba3c-9a0659c5f0b9 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] [instance: b01e7e24-c866-4852-9fa8-568f69f68b27] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:55.035249 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e12fce1a-0d05-4352-ba3c-9a0659c5f0b9 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:55.035785 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e12fce1a-0d05-4352-ba3c-9a0659c5f0b9 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:55.036293 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e12fce1a-0d05-4352-ba3c-9a0659c5f0b9 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:55.037238 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e12fce1a-0d05-4352-ba3c-9a0659c5f0b9 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:55.038406 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e12fce1a-0d05-4352-ba3c-9a0659c5f0b9 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:55.038993 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e12fce1a-0d05-4352-ba3c-9a0659c5f0b9 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:55.184622 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-96e8f1fb-3fe8-466f-b502-c6779ee8f8cd tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:55.185704 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-96e8f1fb-3fe8-466f-b502-c6779ee8f8cd tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] [instance: 101952eb-ca4d-489c-8cb5-3bfadf241aa3] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:55.197548 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-96e8f1fb-3fe8-466f-b502-c6779ee8f8cd tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:55.198539 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-96e8f1fb-3fe8-466f-b502-c6779ee8f8cd tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:55.199396 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-96e8f1fb-3fe8-466f-b502-c6779ee8f8cd tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:55.203634 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-96e8f1fb-3fe8-466f-b502-c6779ee8f8cd tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:55.204333 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-96e8f1fb-3fe8-466f-b502-c6779ee8f8cd tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:55.205014 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-96e8f1fb-3fe8-466f-b502-c6779ee8f8cd tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:55.387133 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-e12fce1a-0d05-4352-ba3c-9a0659c5f0b9 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf87794979e844349d6ec6c6650565f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c25f1d17e94c74868357744e692487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:55.396008 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-e12fce1a-0d05-4352-ba3c-9a0659c5f0b9 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] 10.222.0.43 "GET /compute/v2.1/servers/b01e7e24-c866-4852-9fa8-568f69f68b27" status: 200 len: 1565 microversion: 2.1 time: 0.381741 Oct 04 19:06:55.397065 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2839/6050] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:55 2022] GET /compute/v2.1/servers/b01e7e24-c866-4852-9fa8-568f69f68b27 => generated 1565 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:06:55.427135 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-a5fcf006-d1c0-4949-8727-bf1eb7130c6f tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:55.430824 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-a5fcf006-d1c0-4949-8727-bf1eb7130c6f tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] [instance: b01e7e24-c866-4852-9fa8-568f69f68b27] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:55.449218 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a5fcf006-d1c0-4949-8727-bf1eb7130c6f tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:55.449712 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a5fcf006-d1c0-4949-8727-bf1eb7130c6f tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:55.450166 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a5fcf006-d1c0-4949-8727-bf1eb7130c6f tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:55.450897 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a5fcf006-d1c0-4949-8727-bf1eb7130c6f tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:55.451343 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a5fcf006-d1c0-4949-8727-bf1eb7130c6f tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:55.451770 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a5fcf006-d1c0-4949-8727-bf1eb7130c6f tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:55.527234 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-96e8f1fb-3fe8-466f-b502-c6779ee8f8cd tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:55.536630 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-96e8f1fb-3fe8-466f-b502-c6779ee8f8cd tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:55.538834 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-96e8f1fb-3fe8-466f-b502-c6779ee8f8cd tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:55.540331 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-96e8f1fb-3fe8-466f-b502-c6779ee8f8cd tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] 10.222.0.43 "GET /compute/v2.1/servers/101952eb-ca4d-489c-8cb5-3bfadf241aa3" status: 200 len: 1739 microversion: 2.20 time: 0.365492 Oct 04 19:06:55.554335 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3212/6051] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:06:55 2022] GET /compute/v2.1/servers/101952eb-ca4d-489c-8cb5-3bfadf241aa3 => generated 1739 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:06:55.774495 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-a5fcf006-d1c0-4949-8727-bf1eb7130c6f tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf87794979e844349d6ec6c6650565f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c25f1d17e94c74868357744e692487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:55.806739 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-a5fcf006-d1c0-4949-8727-bf1eb7130c6f tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] 10.222.0.43 "GET /compute/v2.1/servers/b01e7e24-c866-4852-9fa8-568f69f68b27" status: 200 len: 1565 microversion: 2.1 time: 0.386790 Oct 04 19:06:55.807733 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2840/6052] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:55 2022] GET /compute/v2.1/servers/b01e7e24-c866-4852-9fa8-568f69f68b27 => generated 1565 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:06:55.843499 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-3fcc4a56-dfd1-48b4-babf-83cab874e83c tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:55.845207 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-3fcc4a56-dfd1-48b4-babf-83cab874e83c tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] [instance: 588c4f48-5a52-4a12-b79b-2bfa7b9769d4] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:55.870115 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3fcc4a56-dfd1-48b4-babf-83cab874e83c tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:55.871213 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3fcc4a56-dfd1-48b4-babf-83cab874e83c tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:55.872068 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3fcc4a56-dfd1-48b4-babf-83cab874e83c tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:55.874765 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3fcc4a56-dfd1-48b4-babf-83cab874e83c tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:55.876211 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3fcc4a56-dfd1-48b4-babf-83cab874e83c tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:55.878175 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3fcc4a56-dfd1-48b4-babf-83cab874e83c tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:55.930265 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-ab5f8c96-fd1d-425d-9157-2a1d23b18d1d req-e53f23d0-4546-4cae-883f-c93763ce781f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "588c4f48-5a52-4a12-b79b-2bfa7b9769d4", "tag": "83f63fab-6404-4ffa-afc3-9c1a88c38542"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:06:55.978185 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-ab5f8c96-fd1d-425d-9157-2a1d23b18d1d req-e53f23d0-4546-4cae-883f-c93763ce781f service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:55.979017 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-ab5f8c96-fd1d-425d-9157-2a1d23b18d1d req-e53f23d0-4546-4cae-883f-c93763ce781f service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:55.979676 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-ab5f8c96-fd1d-425d-9157-2a1d23b18d1d req-e53f23d0-4546-4cae-883f-c93763ce781f service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:56.011637 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-ab5f8c96-fd1d-425d-9157-2a1d23b18d1d req-e53f23d0-4546-4cae-883f-c93763ce781f service nova] Creating event network-changed:83f63fab-6404-4ffa-afc3-9c1a88c38542 for instance 588c4f48-5a52-4a12-b79b-2bfa7b9769d4 on n-h1-851028-13 Oct 04 19:06:56.021886 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-ab5f8c96-fd1d-425d-9157-2a1d23b18d1d req-e53f23d0-4546-4cae-883f-c93763ce781f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095004 Oct 04 19:06:56.025963 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2841/6053] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:06:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:06:56.266767 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-3fcc4a56-dfd1-48b4-babf-83cab874e83c tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d730241785c494486329e88bd218c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229b7380efe14b739ead311d8ad55065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:56.284346 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-3fcc4a56-dfd1-48b4-babf-83cab874e83c tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d730241785c494486329e88bd218c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229b7380efe14b739ead311d8ad55065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:56.289233 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-3fcc4a56-dfd1-48b4-babf-83cab874e83c tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d730241785c494486329e88bd218c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229b7380efe14b739ead311d8ad55065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:56.290504 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-3fcc4a56-dfd1-48b4-babf-83cab874e83c tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] 10.222.0.43 "GET /compute/v2.1/servers/588c4f48-5a52-4a12-b79b-2bfa7b9769d4" status: 200 len: 1362 microversion: 2.26 time: 0.467406 Oct 04 19:06:56.314186 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3213/6054] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:06:55 2022] GET /compute/v2.1/servers/588c4f48-5a52-4a12-b79b-2bfa7b9769d4 => generated 1362 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 19:06:56.579774 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-91f9fd0d-2b47-453f-ba6a-4eaaa27d7fab tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:56.583387 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-91f9fd0d-2b47-453f-ba6a-4eaaa27d7fab tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] [instance: 101952eb-ca4d-489c-8cb5-3bfadf241aa3] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:56.591748 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-91f9fd0d-2b47-453f-ba6a-4eaaa27d7fab tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:56.592671 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-91f9fd0d-2b47-453f-ba6a-4eaaa27d7fab tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:56.593418 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-91f9fd0d-2b47-453f-ba6a-4eaaa27d7fab tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:56.594557 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-91f9fd0d-2b47-453f-ba6a-4eaaa27d7fab tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:56.595301 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-91f9fd0d-2b47-453f-ba6a-4eaaa27d7fab tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:56.596024 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-91f9fd0d-2b47-453f-ba6a-4eaaa27d7fab tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:56.945041 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-91f9fd0d-2b47-453f-ba6a-4eaaa27d7fab tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:56.960647 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-91f9fd0d-2b47-453f-ba6a-4eaaa27d7fab tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:56.962498 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-91f9fd0d-2b47-453f-ba6a-4eaaa27d7fab tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:56.963901 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-91f9fd0d-2b47-453f-ba6a-4eaaa27d7fab tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] 10.222.0.43 "GET /compute/v2.1/servers/101952eb-ca4d-489c-8cb5-3bfadf241aa3" status: 200 len: 1739 microversion: 2.20 time: 0.400547 Oct 04 19:06:56.966602 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2842/6055] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:06:56 2022] GET /compute/v2.1/servers/101952eb-ca4d-489c-8cb5-3bfadf241aa3 => generated 1739 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:06:57.322366 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-77c166be-ce00-4785-91a0-b4f3542f233f tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:57.323548 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-77c166be-ce00-4785-91a0-b4f3542f233f tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] [instance: 588c4f48-5a52-4a12-b79b-2bfa7b9769d4] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:57.335151 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-77c166be-ce00-4785-91a0-b4f3542f233f tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:57.336255 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-77c166be-ce00-4785-91a0-b4f3542f233f tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:57.337819 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-77c166be-ce00-4785-91a0-b4f3542f233f tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:57.338708 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-77c166be-ce00-4785-91a0-b4f3542f233f tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:57.339321 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-77c166be-ce00-4785-91a0-b4f3542f233f tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:57.339914 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-77c166be-ce00-4785-91a0-b4f3542f233f tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:57.537573 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-77c166be-ce00-4785-91a0-b4f3542f233f tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d730241785c494486329e88bd218c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229b7380efe14b739ead311d8ad55065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:57.549920 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-77c166be-ce00-4785-91a0-b4f3542f233f tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d730241785c494486329e88bd218c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229b7380efe14b739ead311d8ad55065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:57.552288 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-77c166be-ce00-4785-91a0-b4f3542f233f tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d730241785c494486329e88bd218c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229b7380efe14b739ead311d8ad55065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:57.555006 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-77c166be-ce00-4785-91a0-b4f3542f233f tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] 10.222.0.43 "GET /compute/v2.1/servers/588c4f48-5a52-4a12-b79b-2bfa7b9769d4" status: 200 len: 1362 microversion: 2.26 time: 0.237097 Oct 04 19:06:57.556118 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3214/6056] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:06:57 2022] GET /compute/v2.1/servers/588c4f48-5a52-4a12-b79b-2bfa7b9769d4 => generated 1362 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:06:57.999775 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-ba3b2044-7e79-449d-929f-bfc3e97339bd tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:58.000413 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-ba3b2044-7e79-449d-929f-bfc3e97339bd tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] [instance: 101952eb-ca4d-489c-8cb5-3bfadf241aa3] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:58.011804 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ba3b2044-7e79-449d-929f-bfc3e97339bd tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:58.012501 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ba3b2044-7e79-449d-929f-bfc3e97339bd tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:58.024228 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ba3b2044-7e79-449d-929f-bfc3e97339bd tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:58.026264 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ba3b2044-7e79-449d-929f-bfc3e97339bd tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:58.026768 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ba3b2044-7e79-449d-929f-bfc3e97339bd tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:58.027221 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ba3b2044-7e79-449d-929f-bfc3e97339bd tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:58.404903 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-ba3b2044-7e79-449d-929f-bfc3e97339bd tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:58.422692 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-ba3b2044-7e79-449d-929f-bfc3e97339bd tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:58.429506 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-ba3b2044-7e79-449d-929f-bfc3e97339bd tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:58.432017 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-ba3b2044-7e79-449d-929f-bfc3e97339bd tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] 10.222.0.43 "GET /compute/v2.1/servers/101952eb-ca4d-489c-8cb5-3bfadf241aa3" status: 200 len: 1739 microversion: 2.20 time: 0.436356 Oct 04 19:06:58.432618 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2843/6057] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:06:57 2022] GET /compute/v2.1/servers/101952eb-ca4d-489c-8cb5-3bfadf241aa3 => generated 1739 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:06:58.581737 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-2efd337a-20dc-40b1-8f60-90b55aa5f5b8 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:58.588536 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-2efd337a-20dc-40b1-8f60-90b55aa5f5b8 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] [instance: 588c4f48-5a52-4a12-b79b-2bfa7b9769d4] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:58.604129 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2efd337a-20dc-40b1-8f60-90b55aa5f5b8 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:58.604761 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2efd337a-20dc-40b1-8f60-90b55aa5f5b8 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:58.605246 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2efd337a-20dc-40b1-8f60-90b55aa5f5b8 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:58.606165 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2efd337a-20dc-40b1-8f60-90b55aa5f5b8 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:58.606780 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2efd337a-20dc-40b1-8f60-90b55aa5f5b8 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:58.617803 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2efd337a-20dc-40b1-8f60-90b55aa5f5b8 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:58.656160 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=100 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:06:58.852010 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-2efd337a-20dc-40b1-8f60-90b55aa5f5b8 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d730241785c494486329e88bd218c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229b7380efe14b739ead311d8ad55065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:58.863038 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-2efd337a-20dc-40b1-8f60-90b55aa5f5b8 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d730241785c494486329e88bd218c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229b7380efe14b739ead311d8ad55065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:58.864908 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-2efd337a-20dc-40b1-8f60-90b55aa5f5b8 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d730241785c494486329e88bd218c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229b7380efe14b739ead311d8ad55065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:58.866628 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-2efd337a-20dc-40b1-8f60-90b55aa5f5b8 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] 10.222.0.43 "GET /compute/v2.1/servers/588c4f48-5a52-4a12-b79b-2bfa7b9769d4" status: 200 len: 1362 microversion: 2.26 time: 0.289346 Oct 04 19:06:58.867752 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3215/6058] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:06:58 2022] GET /compute/v2.1/servers/588c4f48-5a52-4a12-b79b-2bfa7b9769d4 => generated 1362 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:06:59.461480 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-494b915b-5480-4cc7-87ab-99d163511efd tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:59.462124 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-494b915b-5480-4cc7-87ab-99d163511efd tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] [instance: 101952eb-ca4d-489c-8cb5-3bfadf241aa3] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:59.482903 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-494b915b-5480-4cc7-87ab-99d163511efd tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:59.500243 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-494b915b-5480-4cc7-87ab-99d163511efd tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:59.501860 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-494b915b-5480-4cc7-87ab-99d163511efd tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:59.502654 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-494b915b-5480-4cc7-87ab-99d163511efd tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:59.504719 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-494b915b-5480-4cc7-87ab-99d163511efd tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:59.507487 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-494b915b-5480-4cc7-87ab-99d163511efd tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:59.562813 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-85a1a1b9-7c28-4542-a646-f1ce26225a2f tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:59.565142 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-85a1a1b9-7c28-4542-a646-f1ce26225a2f tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] [instance: b01e7e24-c866-4852-9fa8-568f69f68b27] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:59.576877 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-85a1a1b9-7c28-4542-a646-f1ce26225a2f tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:59.579755 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-85a1a1b9-7c28-4542-a646-f1ce26225a2f tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:59.580830 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-85a1a1b9-7c28-4542-a646-f1ce26225a2f tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:59.583144 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-85a1a1b9-7c28-4542-a646-f1ce26225a2f tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:59.584355 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-85a1a1b9-7c28-4542-a646-f1ce26225a2f tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:59.585612 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-85a1a1b9-7c28-4542-a646-f1ce26225a2f tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:59.759143 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-494b915b-5480-4cc7-87ab-99d163511efd tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:59.777289 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-494b915b-5480-4cc7-87ab-99d163511efd tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:59.778742 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-494b915b-5480-4cc7-87ab-99d163511efd tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:59.779936 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-494b915b-5480-4cc7-87ab-99d163511efd tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] 10.222.0.43 "GET /compute/v2.1/servers/101952eb-ca4d-489c-8cb5-3bfadf241aa3" status: 200 len: 1739 microversion: 2.20 time: 0.323870 Oct 04 19:06:59.780497 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2844/6059] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:06:59 2022] GET /compute/v2.1/servers/101952eb-ca4d-489c-8cb5-3bfadf241aa3 => generated 1739 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:06:59.805974 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-557fc17b-370a-4023-a7fc-3f45192ef378 req-26fdbbd3-47a5-4b45-87da-0a2f070f2181 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b01e7e24-c866-4852-9fa8-568f69f68b27", "tag": "fd2276f3-9cc1-4bd3-bf40-500abff51568"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:06:59.817911 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-557fc17b-370a-4023-a7fc-3f45192ef378 req-26fdbbd3-47a5-4b45-87da-0a2f070f2181 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:59.818691 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-557fc17b-370a-4023-a7fc-3f45192ef378 req-26fdbbd3-47a5-4b45-87da-0a2f070f2181 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:59.819345 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-557fc17b-370a-4023-a7fc-3f45192ef378 req-26fdbbd3-47a5-4b45-87da-0a2f070f2181 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:59.832581 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-557fc17b-370a-4023-a7fc-3f45192ef378 req-26fdbbd3-47a5-4b45-87da-0a2f070f2181 service nova] Creating event network-changed:fd2276f3-9cc1-4bd3-bf40-500abff51568 for instance b01e7e24-c866-4852-9fa8-568f69f68b27 on n-h2-851028-13 Oct 04 19:06:59.838925 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-557fc17b-370a-4023-a7fc-3f45192ef378 req-26fdbbd3-47a5-4b45-87da-0a2f070f2181 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043428 Oct 04 19:06:59.846080 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-85a1a1b9-7c28-4542-a646-f1ce26225a2f tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf87794979e844349d6ec6c6650565f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c25f1d17e94c74868357744e692487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:59.855121 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-85a1a1b9-7c28-4542-a646-f1ce26225a2f tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] 10.222.0.43 "GET /compute/v2.1/servers/b01e7e24-c866-4852-9fa8-568f69f68b27" status: 200 len: 1565 microversion: 2.1 time: 0.296351 Oct 04 19:06:59.856382 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2845/6060] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:06:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:06:59.857456 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3216/6061] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:59 2022] GET /compute/v2.1/servers/b01e7e24-c866-4852-9fa8-568f69f68b27 => generated 1565 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:06:59.900510 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-c32d7271-a0f1-434e-8023-1d983d14b0fc tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:59.901239 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-c32d7271-a0f1-434e-8023-1d983d14b0fc tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] [instance: 588c4f48-5a52-4a12-b79b-2bfa7b9769d4] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:59.916444 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c32d7271-a0f1-434e-8023-1d983d14b0fc tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:59.916944 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c32d7271-a0f1-434e-8023-1d983d14b0fc tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:59.917399 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c32d7271-a0f1-434e-8023-1d983d14b0fc tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:59.918268 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c32d7271-a0f1-434e-8023-1d983d14b0fc tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:59.918870 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c32d7271-a0f1-434e-8023-1d983d14b0fc tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:59.919445 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c32d7271-a0f1-434e-8023-1d983d14b0fc tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:00.223633 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-c32d7271-a0f1-434e-8023-1d983d14b0fc tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d730241785c494486329e88bd218c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229b7380efe14b739ead311d8ad55065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:00.238316 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-c32d7271-a0f1-434e-8023-1d983d14b0fc tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d730241785c494486329e88bd218c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229b7380efe14b739ead311d8ad55065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:00.243348 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-c32d7271-a0f1-434e-8023-1d983d14b0fc tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d730241785c494486329e88bd218c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229b7380efe14b739ead311d8ad55065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:00.247715 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-c32d7271-a0f1-434e-8023-1d983d14b0fc tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] 10.222.0.43 "GET /compute/v2.1/servers/588c4f48-5a52-4a12-b79b-2bfa7b9769d4" status: 200 len: 1362 microversion: 2.26 time: 0.351641 Oct 04 19:07:00.248880 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2846/6062] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:06:59 2022] GET /compute/v2.1/servers/588c4f48-5a52-4a12-b79b-2bfa7b9769d4 => generated 1362 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:07:00.811672 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-845902aa-b2d0-475e-b04b-2d12e4d419a9 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:00.812722 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-845902aa-b2d0-475e-b04b-2d12e4d419a9 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] [instance: 101952eb-ca4d-489c-8cb5-3bfadf241aa3] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:00.826576 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=2 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:07:00.830304 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=8 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:07:00.832035 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=6 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:07:00.835258 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-845902aa-b2d0-475e-b04b-2d12e4d419a9 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:00.836306 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-845902aa-b2d0-475e-b04b-2d12e4d419a9 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:00.837332 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-845902aa-b2d0-475e-b04b-2d12e4d419a9 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:00.838814 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-845902aa-b2d0-475e-b04b-2d12e4d419a9 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:00.839792 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-845902aa-b2d0-475e-b04b-2d12e4d419a9 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:00.840735 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-845902aa-b2d0-475e-b04b-2d12e4d419a9 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:01.068877 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-845902aa-b2d0-475e-b04b-2d12e4d419a9 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:01.083187 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-845902aa-b2d0-475e-b04b-2d12e4d419a9 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:01.086146 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-845902aa-b2d0-475e-b04b-2d12e4d419a9 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:01.088239 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-845902aa-b2d0-475e-b04b-2d12e4d419a9 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] 10.222.0.43 "GET /compute/v2.1/servers/101952eb-ca4d-489c-8cb5-3bfadf241aa3" status: 200 len: 1739 microversion: 2.20 time: 0.283254 Oct 04 19:07:01.101636 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3217/6063] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:07:00 2022] GET /compute/v2.1/servers/101952eb-ca4d-489c-8cb5-3bfadf241aa3 => generated 1739 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:07:01.281708 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-a99a2d54-7f83-491f-a337-e6a1e931483b tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:01.282988 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-a99a2d54-7f83-491f-a337-e6a1e931483b tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] [instance: 588c4f48-5a52-4a12-b79b-2bfa7b9769d4] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:01.293610 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a99a2d54-7f83-491f-a337-e6a1e931483b tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:01.298124 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a99a2d54-7f83-491f-a337-e6a1e931483b tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:01.298826 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a99a2d54-7f83-491f-a337-e6a1e931483b tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:01.299823 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a99a2d54-7f83-491f-a337-e6a1e931483b tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:01.300285 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a99a2d54-7f83-491f-a337-e6a1e931483b tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:01.300870 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a99a2d54-7f83-491f-a337-e6a1e931483b tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:01.586417 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-a99a2d54-7f83-491f-a337-e6a1e931483b tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d730241785c494486329e88bd218c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229b7380efe14b739ead311d8ad55065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:01.597054 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-a99a2d54-7f83-491f-a337-e6a1e931483b tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d730241785c494486329e88bd218c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229b7380efe14b739ead311d8ad55065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:01.598809 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-a99a2d54-7f83-491f-a337-e6a1e931483b tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d730241785c494486329e88bd218c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229b7380efe14b739ead311d8ad55065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:01.600320 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-a99a2d54-7f83-491f-a337-e6a1e931483b tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] 10.222.0.43 "GET /compute/v2.1/servers/588c4f48-5a52-4a12-b79b-2bfa7b9769d4" status: 200 len: 1362 microversion: 2.26 time: 0.323485 Oct 04 19:07:01.617218 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2847/6064] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:07:01 2022] GET /compute/v2.1/servers/588c4f48-5a52-4a12-b79b-2bfa7b9769d4 => generated 1362 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:07:02.116613 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-439bd463-1c70-4d4e-b763-b3a26583ddc9 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:02.117264 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-439bd463-1c70-4d4e-b763-b3a26583ddc9 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] [instance: 101952eb-ca4d-489c-8cb5-3bfadf241aa3] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:02.134947 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-439bd463-1c70-4d4e-b763-b3a26583ddc9 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:02.135460 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-439bd463-1c70-4d4e-b763-b3a26583ddc9 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:02.135901 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-439bd463-1c70-4d4e-b763-b3a26583ddc9 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:02.139549 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-439bd463-1c70-4d4e-b763-b3a26583ddc9 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:02.139722 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-b41c2755-b2be-40f7-8160-2466f80243d8 req-a5073843-a923-4018-8f89-5ae83cb3f65b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "588c4f48-5a52-4a12-b79b-2bfa7b9769d4", "name": "network-vif-plugged", "status": "completed", "tag": "83f63fab-6404-4ffa-afc3-9c1a88c38542"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:07:02.140375 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-439bd463-1c70-4d4e-b763-b3a26583ddc9 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:02.140975 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-439bd463-1c70-4d4e-b763-b3a26583ddc9 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:02.193643 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-b41c2755-b2be-40f7-8160-2466f80243d8 req-a5073843-a923-4018-8f89-5ae83cb3f65b service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:02.195163 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-b41c2755-b2be-40f7-8160-2466f80243d8 req-a5073843-a923-4018-8f89-5ae83cb3f65b service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:02.195765 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-b41c2755-b2be-40f7-8160-2466f80243d8 req-a5073843-a923-4018-8f89-5ae83cb3f65b service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:02.213281 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-b41c2755-b2be-40f7-8160-2466f80243d8 req-a5073843-a923-4018-8f89-5ae83cb3f65b service nova] Creating event network-vif-plugged:83f63fab-6404-4ffa-afc3-9c1a88c38542 for instance 588c4f48-5a52-4a12-b79b-2bfa7b9769d4 on n-h1-851028-13 Oct 04 19:07:02.224176 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-b41c2755-b2be-40f7-8160-2466f80243d8 req-a5073843-a923-4018-8f89-5ae83cb3f65b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088321 Oct 04 19:07:02.225618 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2848/6065] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:07:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:07:02.443454 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-439bd463-1c70-4d4e-b763-b3a26583ddc9 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:02.468408 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-439bd463-1c70-4d4e-b763-b3a26583ddc9 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:02.470750 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-439bd463-1c70-4d4e-b763-b3a26583ddc9 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:02.473101 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-439bd463-1c70-4d4e-b763-b3a26583ddc9 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] 10.222.0.43 "GET /compute/v2.1/servers/101952eb-ca4d-489c-8cb5-3bfadf241aa3" status: 200 len: 1739 microversion: 2.20 time: 0.360657 Oct 04 19:07:02.485498 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3218/6066] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:07:02 2022] GET /compute/v2.1/servers/101952eb-ca4d-489c-8cb5-3bfadf241aa3 => generated 1739 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:07:02.628947 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-cdefc50b-d33e-4ecf-816d-d964a512f776 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:02.630470 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-cdefc50b-d33e-4ecf-816d-d964a512f776 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] [instance: 588c4f48-5a52-4a12-b79b-2bfa7b9769d4] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:02.639141 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cdefc50b-d33e-4ecf-816d-d964a512f776 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:02.639635 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cdefc50b-d33e-4ecf-816d-d964a512f776 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:02.640077 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cdefc50b-d33e-4ecf-816d-d964a512f776 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:02.640786 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cdefc50b-d33e-4ecf-816d-d964a512f776 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:02.641273 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cdefc50b-d33e-4ecf-816d-d964a512f776 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:02.641705 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cdefc50b-d33e-4ecf-816d-d964a512f776 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:02.822072 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-cdefc50b-d33e-4ecf-816d-d964a512f776 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d730241785c494486329e88bd218c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229b7380efe14b739ead311d8ad55065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:02.833082 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-cdefc50b-d33e-4ecf-816d-d964a512f776 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d730241785c494486329e88bd218c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229b7380efe14b739ead311d8ad55065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:02.834610 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-cdefc50b-d33e-4ecf-816d-d964a512f776 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d730241785c494486329e88bd218c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229b7380efe14b739ead311d8ad55065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:02.836292 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-cdefc50b-d33e-4ecf-816d-d964a512f776 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] 10.222.0.43 "GET /compute/v2.1/servers/588c4f48-5a52-4a12-b79b-2bfa7b9769d4" status: 200 len: 1362 microversion: 2.26 time: 0.212523 Oct 04 19:07:02.837047 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2849/6067] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:07:02 2022] GET /compute/v2.1/servers/588c4f48-5a52-4a12-b79b-2bfa7b9769d4 => generated 1362 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:07:03.499995 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-a678ad93-154b-40fc-8a31-4b1f395107b4 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:03.500717 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-a678ad93-154b-40fc-8a31-4b1f395107b4 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] [instance: 101952eb-ca4d-489c-8cb5-3bfadf241aa3] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:03.510833 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a678ad93-154b-40fc-8a31-4b1f395107b4 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:03.511334 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a678ad93-154b-40fc-8a31-4b1f395107b4 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:03.512192 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a678ad93-154b-40fc-8a31-4b1f395107b4 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:03.519394 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a678ad93-154b-40fc-8a31-4b1f395107b4 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:03.519394 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a678ad93-154b-40fc-8a31-4b1f395107b4 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:03.519394 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a678ad93-154b-40fc-8a31-4b1f395107b4 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:03.689350 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-a678ad93-154b-40fc-8a31-4b1f395107b4 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:03.699286 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-a678ad93-154b-40fc-8a31-4b1f395107b4 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:03.700739 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-a678ad93-154b-40fc-8a31-4b1f395107b4 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:03.701966 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-a678ad93-154b-40fc-8a31-4b1f395107b4 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] 10.222.0.43 "GET /compute/v2.1/servers/101952eb-ca4d-489c-8cb5-3bfadf241aa3" status: 200 len: 1739 microversion: 2.20 time: 0.206626 Oct 04 19:07:03.702547 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3219/6068] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:07:03 2022] GET /compute/v2.1/servers/101952eb-ca4d-489c-8cb5-3bfadf241aa3 => generated 1739 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:07:03.862988 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-704413e0-5c16-4b48-8629-4b2550c51333 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:03.863596 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-704413e0-5c16-4b48-8629-4b2550c51333 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] [instance: 588c4f48-5a52-4a12-b79b-2bfa7b9769d4] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:03.871208 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-704413e0-5c16-4b48-8629-4b2550c51333 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:03.871629 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-704413e0-5c16-4b48-8629-4b2550c51333 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:03.872095 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-704413e0-5c16-4b48-8629-4b2550c51333 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:03.872782 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-704413e0-5c16-4b48-8629-4b2550c51333 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:03.873271 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-704413e0-5c16-4b48-8629-4b2550c51333 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:03.873696 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-704413e0-5c16-4b48-8629-4b2550c51333 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:04.031541 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-704413e0-5c16-4b48-8629-4b2550c51333 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d730241785c494486329e88bd218c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229b7380efe14b739ead311d8ad55065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:04.042949 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-704413e0-5c16-4b48-8629-4b2550c51333 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d730241785c494486329e88bd218c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229b7380efe14b739ead311d8ad55065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:04.044460 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-704413e0-5c16-4b48-8629-4b2550c51333 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d730241785c494486329e88bd218c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229b7380efe14b739ead311d8ad55065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:04.045729 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-704413e0-5c16-4b48-8629-4b2550c51333 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] 10.222.0.43 "GET /compute/v2.1/servers/588c4f48-5a52-4a12-b79b-2bfa7b9769d4" status: 200 len: 1547 microversion: 2.26 time: 0.186707 Oct 04 19:07:04.046837 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2850/6069] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:07:03 2022] GET /compute/v2.1/servers/588c4f48-5a52-4a12-b79b-2bfa7b9769d4 => generated 1547 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:07:04.078495 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-4288a1e4-362a-45d8-9f58-e3343ece65b2 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Calling method '.version_select at 0x7fb227e02940>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:04.101854 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4288a1e4-362a-45d8-9f58-e3343ece65b2 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:04.102586 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4288a1e4-362a-45d8-9f58-e3343ece65b2 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:04.103037 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4288a1e4-362a-45d8-9f58-e3343ece65b2 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:04.103593 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-4288a1e4-362a-45d8-9f58-e3343ece65b2 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] [instance: 588c4f48-5a52-4a12-b79b-2bfa7b9769d4] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:04.111335 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4288a1e4-362a-45d8-9f58-e3343ece65b2 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:04.111934 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4288a1e4-362a-45d8-9f58-e3343ece65b2 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:04.112463 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4288a1e4-362a-45d8-9f58-e3343ece65b2 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:04.113321 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4288a1e4-362a-45d8-9f58-e3343ece65b2 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:04.113865 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4288a1e4-362a-45d8-9f58-e3343ece65b2 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:04.114551 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4288a1e4-362a-45d8-9f58-e3343ece65b2 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:04.145833 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4288a1e4-362a-45d8-9f58-e3343ece65b2 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:04.147100 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4288a1e4-362a-45d8-9f58-e3343ece65b2 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:04.147100 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4288a1e4-362a-45d8-9f58-e3343ece65b2 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:04.164699 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4288a1e4-362a-45d8-9f58-e3343ece65b2 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:04.165383 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4288a1e4-362a-45d8-9f58-e3343ece65b2 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:04.165924 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4288a1e4-362a-45d8-9f58-e3343ece65b2 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:04.197528 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.objects.instance [None req-4288a1e4-362a-45d8-9f58-e3343ece65b2 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lazy-loading 'flavor' on Instance uuid 588c4f48-5a52-4a12-b79b-2bfa7b9769d4 {{(pid=123596) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 19:07:04.215710 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-4288a1e4-362a-45d8-9f58-e3343ece65b2 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] 10.222.0.43 "PUT /compute/v2.1/servers/588c4f48-5a52-4a12-b79b-2bfa7b9769d4/tags/tempest-tag-682599449" status: 201 len: 0 microversion: 2.26 time: 0.141226 Oct 04 19:07:04.217047 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3220/6070] 10.222.0.43 () {62 vars in 1377 bytes} [Tue Oct 4 19:07:04 2022] PUT /compute/v2.1/servers/588c4f48-5a52-4a12-b79b-2bfa7b9769d4/tags/tempest-tag-682599449 => generated 0 bytes in 143 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Oct 04 19:07:04.230020 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-f288e811-ce1f-40b8-8370-3c29bd1fda2a tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Calling method '.version_select at 0x7fb21e99f790>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:04.238428 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f288e811-ce1f-40b8-8370-3c29bd1fda2a tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:04.239135 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f288e811-ce1f-40b8-8370-3c29bd1fda2a tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:04.239858 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f288e811-ce1f-40b8-8370-3c29bd1fda2a tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:04.258816 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-f288e811-ce1f-40b8-8370-3c29bd1fda2a tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] 10.222.0.43 "GET /compute/v2.1/servers/588c4f48-5a52-4a12-b79b-2bfa7b9769d4/tags/tempest-tag-682599449" status: 204 len: 0 microversion: 2.26 time: 0.034754 Oct 04 19:07:04.263318 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2851/6071] 10.222.0.43 () {60 vars in 1358 bytes} [Tue Oct 4 19:07:04 2022] GET /compute/v2.1/servers/588c4f48-5a52-4a12-b79b-2bfa7b9769d4/tags/tempest-tag-682599449 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 19:07:04.268496 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-031a7a03-178c-4a3e-b0f9-afb2febc17ef tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Calling method '.version_select at 0x7fb21edc5f70>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:04.278780 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-031a7a03-178c-4a3e-b0f9-afb2febc17ef tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:04.279490 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-031a7a03-178c-4a3e-b0f9-afb2febc17ef tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:04.280119 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-031a7a03-178c-4a3e-b0f9-afb2febc17ef tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:04.280749 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-031a7a03-178c-4a3e-b0f9-afb2febc17ef tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] [instance: 588c4f48-5a52-4a12-b79b-2bfa7b9769d4] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:04.287673 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-031a7a03-178c-4a3e-b0f9-afb2febc17ef tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:04.288403 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-031a7a03-178c-4a3e-b0f9-afb2febc17ef tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:04.288996 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-031a7a03-178c-4a3e-b0f9-afb2febc17ef tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:04.289876 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-031a7a03-178c-4a3e-b0f9-afb2febc17ef tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:04.290508 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-031a7a03-178c-4a3e-b0f9-afb2febc17ef tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:04.291077 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-031a7a03-178c-4a3e-b0f9-afb2febc17ef tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:04.317492 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-031a7a03-178c-4a3e-b0f9-afb2febc17ef tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:04.318228 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-031a7a03-178c-4a3e-b0f9-afb2febc17ef tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:04.318819 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-031a7a03-178c-4a3e-b0f9-afb2febc17ef tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:04.349307 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.objects.instance [None req-031a7a03-178c-4a3e-b0f9-afb2febc17ef tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lazy-loading 'flavor' on Instance uuid 588c4f48-5a52-4a12-b79b-2bfa7b9769d4 {{(pid=123596) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 19:07:04.377037 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-031a7a03-178c-4a3e-b0f9-afb2febc17ef tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] 10.222.0.43 "DELETE /compute/v2.1/servers/588c4f48-5a52-4a12-b79b-2bfa7b9769d4/tags" status: 204 len: 0 microversion: 2.26 time: 0.112436 Oct 04 19:07:04.377798 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3221/6072] 10.222.0.43 () {60 vars in 1295 bytes} [Tue Oct 4 19:07:04 2022] DELETE /compute/v2.1/servers/588c4f48-5a52-4a12-b79b-2bfa7b9769d4/tags => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 04 19:07:04.389955 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-26555057-4bd0-4a17-b9d8-3dc1f7becfcf tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Calling method '.version_select at 0x7fb21eae94c0>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:04.398820 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-26555057-4bd0-4a17-b9d8-3dc1f7becfcf tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:04.399507 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-26555057-4bd0-4a17-b9d8-3dc1f7becfcf tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:04.400093 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-26555057-4bd0-4a17-b9d8-3dc1f7becfcf tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:04.411440 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-26555057-4bd0-4a17-b9d8-3dc1f7becfcf tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] 10.222.0.43 "GET /compute/v2.1/servers/588c4f48-5a52-4a12-b79b-2bfa7b9769d4/tags" status: 200 len: 12 microversion: 2.26 time: 0.027361 Oct 04 19:07:04.417384 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2852/6073] 10.222.0.43 () {60 vars in 1292 bytes} [Tue Oct 4 19:07:04 2022] GET /compute/v2.1/servers/588c4f48-5a52-4a12-b79b-2bfa7b9769d4/tags => generated 12 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:07:04.425221 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-def9f8c0-4d52-4c42-b13c-1358e600ebb8 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Calling method '.version_select at 0x7fb22445fca0>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:04.439585 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-def9f8c0-4d52-4c42-b13c-1358e600ebb8 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:04.440089 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-def9f8c0-4d52-4c42-b13c-1358e600ebb8 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:04.440564 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-def9f8c0-4d52-4c42-b13c-1358e600ebb8 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:04.441045 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-def9f8c0-4d52-4c42-b13c-1358e600ebb8 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] [instance: 588c4f48-5a52-4a12-b79b-2bfa7b9769d4] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:04.448186 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-def9f8c0-4d52-4c42-b13c-1358e600ebb8 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:04.448689 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-def9f8c0-4d52-4c42-b13c-1358e600ebb8 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:04.449166 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-def9f8c0-4d52-4c42-b13c-1358e600ebb8 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:04.449884 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-def9f8c0-4d52-4c42-b13c-1358e600ebb8 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:04.450527 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-def9f8c0-4d52-4c42-b13c-1358e600ebb8 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:04.451126 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-def9f8c0-4d52-4c42-b13c-1358e600ebb8 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:04.480087 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-def9f8c0-4d52-4c42-b13c-1358e600ebb8 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:04.480580 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-def9f8c0-4d52-4c42-b13c-1358e600ebb8 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:04.481034 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-def9f8c0-4d52-4c42-b13c-1358e600ebb8 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:04.494009 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-def9f8c0-4d52-4c42-b13c-1358e600ebb8 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:04.494742 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-def9f8c0-4d52-4c42-b13c-1358e600ebb8 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:04.495296 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-def9f8c0-4d52-4c42-b13c-1358e600ebb8 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:04.520523 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.objects.instance [None req-def9f8c0-4d52-4c42-b13c-1358e600ebb8 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lazy-loading 'flavor' on Instance uuid 588c4f48-5a52-4a12-b79b-2bfa7b9769d4 {{(pid=123596) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 19:07:04.538844 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-def9f8c0-4d52-4c42-b13c-1358e600ebb8 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] 10.222.0.43 "PUT /compute/v2.1/servers/588c4f48-5a52-4a12-b79b-2bfa7b9769d4/tags/tempest-tag-2000330507" status: 201 len: 0 microversion: 2.26 time: 0.120193 Oct 04 19:07:04.539523 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3222/6074] 10.222.0.43 () {62 vars in 1380 bytes} [Tue Oct 4 19:07:04 2022] PUT /compute/v2.1/servers/588c4f48-5a52-4a12-b79b-2bfa7b9769d4/tags/tempest-tag-2000330507 => generated 0 bytes in 122 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Oct 04 19:07:04.550901 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-2a9d896d-68b8-404b-8c4b-8af11a40d220 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Calling method '.version_select at 0x7fb21eab2550>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:04.581556 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2a9d896d-68b8-404b-8c4b-8af11a40d220 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:04.582065 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2a9d896d-68b8-404b-8c4b-8af11a40d220 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:04.582513 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2a9d896d-68b8-404b-8c4b-8af11a40d220 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:04.593004 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-2a9d896d-68b8-404b-8c4b-8af11a40d220 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] 10.222.0.43 "GET /compute/v2.1/servers/588c4f48-5a52-4a12-b79b-2bfa7b9769d4/tags" status: 200 len: 36 microversion: 2.26 time: 0.047222 Oct 04 19:07:04.593674 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2853/6075] 10.222.0.43 () {60 vars in 1292 bytes} [Tue Oct 4 19:07:04 2022] GET /compute/v2.1/servers/588c4f48-5a52-4a12-b79b-2bfa7b9769d4/tags => generated 36 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:07:04.605842 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-a52f91ae-1e80-4bd6-a89b-f56d0dd5b097 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Calling method '.version_select at 0x7fb21eb02940>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:04.613611 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a52f91ae-1e80-4bd6-a89b-f56d0dd5b097 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:04.614093 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a52f91ae-1e80-4bd6-a89b-f56d0dd5b097 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:04.614530 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a52f91ae-1e80-4bd6-a89b-f56d0dd5b097 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:04.615028 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-a52f91ae-1e80-4bd6-a89b-f56d0dd5b097 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] [instance: 588c4f48-5a52-4a12-b79b-2bfa7b9769d4] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:04.626307 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a52f91ae-1e80-4bd6-a89b-f56d0dd5b097 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:04.626814 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a52f91ae-1e80-4bd6-a89b-f56d0dd5b097 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:04.627317 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a52f91ae-1e80-4bd6-a89b-f56d0dd5b097 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:04.627971 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a52f91ae-1e80-4bd6-a89b-f56d0dd5b097 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:04.628444 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a52f91ae-1e80-4bd6-a89b-f56d0dd5b097 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:04.628883 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a52f91ae-1e80-4bd6-a89b-f56d0dd5b097 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:04.654678 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a52f91ae-1e80-4bd6-a89b-f56d0dd5b097 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:04.655207 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a52f91ae-1e80-4bd6-a89b-f56d0dd5b097 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:04.655790 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a52f91ae-1e80-4bd6-a89b-f56d0dd5b097 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:04.684808 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.objects.instance [None req-a52f91ae-1e80-4bd6-a89b-f56d0dd5b097 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lazy-loading 'flavor' on Instance uuid 588c4f48-5a52-4a12-b79b-2bfa7b9769d4 {{(pid=123596) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 19:07:04.709772 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-a52f91ae-1e80-4bd6-a89b-f56d0dd5b097 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] 10.222.0.43 "DELETE /compute/v2.1/servers/588c4f48-5a52-4a12-b79b-2bfa7b9769d4/tags/tempest-tag-2000330507" status: 204 len: 0 microversion: 2.26 time: 0.108417 Oct 04 19:07:04.710772 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3223/6076] 10.222.0.43 () {60 vars in 1364 bytes} [Tue Oct 4 19:07:04 2022] DELETE /compute/v2.1/servers/588c4f48-5a52-4a12-b79b-2bfa7b9769d4/tags/tempest-tag-2000330507 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 19:07:04.719712 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-1b1f71da-7bbd-4b24-843d-2a6e81212ee4 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Calling method '.version_select at 0x7fb21e99ff70>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:04.729140 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1b1f71da-7bbd-4b24-843d-2a6e81212ee4 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:04.729835 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1b1f71da-7bbd-4b24-843d-2a6e81212ee4 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:04.730511 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1b1f71da-7bbd-4b24-843d-2a6e81212ee4 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:04.732394 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-0ed2f83c-e499-48c3-a32f-cba3c148e957 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:04.733050 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-0ed2f83c-e499-48c3-a32f-cba3c148e957 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] [instance: 101952eb-ca4d-489c-8cb5-3bfadf241aa3] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:04.739951 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0ed2f83c-e499-48c3-a32f-cba3c148e957 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:04.740643 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0ed2f83c-e499-48c3-a32f-cba3c148e957 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:04.741966 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0ed2f83c-e499-48c3-a32f-cba3c148e957 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:04.742790 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0ed2f83c-e499-48c3-a32f-cba3c148e957 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:04.743264 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0ed2f83c-e499-48c3-a32f-cba3c148e957 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:04.743372 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-1b1f71da-7bbd-4b24-843d-2a6e81212ee4 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] 10.222.0.43 "GET /compute/v2.1/servers/588c4f48-5a52-4a12-b79b-2bfa7b9769d4/tags" status: 200 len: 12 microversion: 2.26 time: 0.027767 Oct 04 19:07:04.743698 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0ed2f83c-e499-48c3-a32f-cba3c148e957 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:04.744991 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2854/6077] 10.222.0.43 () {60 vars in 1292 bytes} [Tue Oct 4 19:07:04 2022] GET /compute/v2.1/servers/588c4f48-5a52-4a12-b79b-2bfa7b9769d4/tags => generated 12 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:07:04.755643 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-c6419710-d31e-4d2e-b09f-c7b90032559d tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Calling method '.version_select at 0x7fb21fa8a310>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:04.771829 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c6419710-d31e-4d2e-b09f-c7b90032559d tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:04.772773 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c6419710-d31e-4d2e-b09f-c7b90032559d tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:04.774002 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c6419710-d31e-4d2e-b09f-c7b90032559d tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:04.774705 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-c6419710-d31e-4d2e-b09f-c7b90032559d tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] [instance: 588c4f48-5a52-4a12-b79b-2bfa7b9769d4] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:04.783325 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c6419710-d31e-4d2e-b09f-c7b90032559d tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:04.784593 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c6419710-d31e-4d2e-b09f-c7b90032559d tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:04.785382 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c6419710-d31e-4d2e-b09f-c7b90032559d tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:04.787015 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c6419710-d31e-4d2e-b09f-c7b90032559d tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:04.787912 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c6419710-d31e-4d2e-b09f-c7b90032559d tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:04.789250 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c6419710-d31e-4d2e-b09f-c7b90032559d tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:04.818393 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c6419710-d31e-4d2e-b09f-c7b90032559d tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:04.818885 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c6419710-d31e-4d2e-b09f-c7b90032559d tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:04.820085 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c6419710-d31e-4d2e-b09f-c7b90032559d tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:04.823513 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=100 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:07:04.834458 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.objects.instance [None req-c6419710-d31e-4d2e-b09f-c7b90032559d tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lazy-loading 'flavor' on Instance uuid 588c4f48-5a52-4a12-b79b-2bfa7b9769d4 {{(pid=123595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 19:07:04.854303 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-c6419710-d31e-4d2e-b09f-c7b90032559d tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] 10.222.0.43 "DELETE /compute/v2.1/servers/588c4f48-5a52-4a12-b79b-2bfa7b9769d4/tags" status: 204 len: 0 microversion: 2.26 time: 0.103198 Oct 04 19:07:04.860346 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2855/6078] 10.222.0.43 () {60 vars in 1295 bytes} [Tue Oct 4 19:07:04 2022] DELETE /compute/v2.1/servers/588c4f48-5a52-4a12-b79b-2bfa7b9769d4/tags => generated 0 bytes in 105 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 04 19:07:04.867056 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-e10a47af-912b-48cb-ab00-dc4296cfb8f6 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Calling method '.version_select at 0x7fb21e99f4c0>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:04.879635 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e10a47af-912b-48cb-ab00-dc4296cfb8f6 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:04.880147 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e10a47af-912b-48cb-ab00-dc4296cfb8f6 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:04.880604 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e10a47af-912b-48cb-ab00-dc4296cfb8f6 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:04.881101 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-e10a47af-912b-48cb-ab00-dc4296cfb8f6 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] [instance: 588c4f48-5a52-4a12-b79b-2bfa7b9769d4] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:04.888363 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e10a47af-912b-48cb-ab00-dc4296cfb8f6 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:04.888864 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e10a47af-912b-48cb-ab00-dc4296cfb8f6 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:04.889384 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e10a47af-912b-48cb-ab00-dc4296cfb8f6 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:04.890173 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e10a47af-912b-48cb-ab00-dc4296cfb8f6 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:04.890677 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e10a47af-912b-48cb-ab00-dc4296cfb8f6 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:04.891154 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e10a47af-912b-48cb-ab00-dc4296cfb8f6 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:04.918176 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-0ed2f83c-e499-48c3-a32f-cba3c148e957 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:04.920144 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e10a47af-912b-48cb-ab00-dc4296cfb8f6 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:04.920642 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e10a47af-912b-48cb-ab00-dc4296cfb8f6 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:04.921090 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e10a47af-912b-48cb-ab00-dc4296cfb8f6 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:04.927939 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-0ed2f83c-e499-48c3-a32f-cba3c148e957 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:04.931624 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e10a47af-912b-48cb-ab00-dc4296cfb8f6 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:04.932226 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e10a47af-912b-48cb-ab00-dc4296cfb8f6 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:04.932540 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e10a47af-912b-48cb-ab00-dc4296cfb8f6 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:04.933773 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-0ed2f83c-e499-48c3-a32f-cba3c148e957 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:04.935655 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-0ed2f83c-e499-48c3-a32f-cba3c148e957 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] 10.222.0.43 "GET /compute/v2.1/servers/101952eb-ca4d-489c-8cb5-3bfadf241aa3" status: 200 len: 1721 microversion: 2.20 time: 0.207785 Oct 04 19:07:04.936118 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3224/6079] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:07:04 2022] GET /compute/v2.1/servers/101952eb-ca4d-489c-8cb5-3bfadf241aa3 => generated 1721 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 19:07:04.964732 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.objects.instance [None req-e10a47af-912b-48cb-ab00-dc4296cfb8f6 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lazy-loading 'flavor' on Instance uuid 588c4f48-5a52-4a12-b79b-2bfa7b9769d4 {{(pid=123595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 19:07:04.987143 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-e10a47af-912b-48cb-ab00-dc4296cfb8f6 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] 10.222.0.43 "PUT /compute/v2.1/servers/588c4f48-5a52-4a12-b79b-2bfa7b9769d4/tags/tempest-tag-1516175583" status: 201 len: 0 microversion: 2.26 time: 0.124810 Oct 04 19:07:04.987841 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2856/6080] 10.222.0.43 () {62 vars in 1380 bytes} [Tue Oct 4 19:07:04 2022] PUT /compute/v2.1/servers/588c4f48-5a52-4a12-b79b-2bfa7b9769d4/tags/tempest-tag-1516175583 => generated 0 bytes in 126 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Oct 04 19:07:04.998222 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-0b22733b-caef-4e70-a5f5-fc57a46fdae5 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Calling method '.version_select at 0x7fb21ee5b040>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:05.008901 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0b22733b-caef-4e70-a5f5-fc57a46fdae5 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:05.009534 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0b22733b-caef-4e70-a5f5-fc57a46fdae5 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:05.010047 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0b22733b-caef-4e70-a5f5-fc57a46fdae5 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:05.010604 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-0b22733b-caef-4e70-a5f5-fc57a46fdae5 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] [instance: 588c4f48-5a52-4a12-b79b-2bfa7b9769d4] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:05.018558 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0b22733b-caef-4e70-a5f5-fc57a46fdae5 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:05.019314 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0b22733b-caef-4e70-a5f5-fc57a46fdae5 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:05.020204 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0b22733b-caef-4e70-a5f5-fc57a46fdae5 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:05.021273 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0b22733b-caef-4e70-a5f5-fc57a46fdae5 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:05.021780 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0b22733b-caef-4e70-a5f5-fc57a46fdae5 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:05.022879 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0b22733b-caef-4e70-a5f5-fc57a46fdae5 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:05.051364 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0b22733b-caef-4e70-a5f5-fc57a46fdae5 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:05.051773 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0b22733b-caef-4e70-a5f5-fc57a46fdae5 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:05.052220 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0b22733b-caef-4e70-a5f5-fc57a46fdae5 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:05.061770 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0b22733b-caef-4e70-a5f5-fc57a46fdae5 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:05.062287 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0b22733b-caef-4e70-a5f5-fc57a46fdae5 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:05.062734 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0b22733b-caef-4e70-a5f5-fc57a46fdae5 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:05.071763 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=89,nova_cell1:SAVEPOINT=3,nova_cell1:INSERT=3,nova_cell1:RELEASE=3,nova_cell1:DELETE=2 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:07:05.090078 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.objects.instance [None req-0b22733b-caef-4e70-a5f5-fc57a46fdae5 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lazy-loading 'flavor' on Instance uuid 588c4f48-5a52-4a12-b79b-2bfa7b9769d4 {{(pid=123596) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 19:07:05.106635 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-0b22733b-caef-4e70-a5f5-fc57a46fdae5 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] 10.222.0.43 "PUT /compute/v2.1/servers/588c4f48-5a52-4a12-b79b-2bfa7b9769d4/tags/tempest-tag-1484637530" status: 201 len: 0 microversion: 2.26 time: 0.112566 Oct 04 19:07:05.111014 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3225/6081] 10.222.0.43 () {62 vars in 1380 bytes} [Tue Oct 4 19:07:04 2022] PUT /compute/v2.1/servers/588c4f48-5a52-4a12-b79b-2bfa7b9769d4/tags/tempest-tag-1484637530 => generated 0 bytes in 114 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Oct 04 19:07:05.119436 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-ee9ecc06-36ad-4529-922a-1a197be30064 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Calling method '.version_select at 0x7fb21ea985e0>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:05.130112 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ee9ecc06-36ad-4529-922a-1a197be30064 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:05.130600 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ee9ecc06-36ad-4529-922a-1a197be30064 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:05.131041 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ee9ecc06-36ad-4529-922a-1a197be30064 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:05.132086 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-ee9ecc06-36ad-4529-922a-1a197be30064 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] [instance: 588c4f48-5a52-4a12-b79b-2bfa7b9769d4] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:05.137619 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ee9ecc06-36ad-4529-922a-1a197be30064 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:05.138094 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ee9ecc06-36ad-4529-922a-1a197be30064 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:05.138533 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ee9ecc06-36ad-4529-922a-1a197be30064 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:05.139214 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ee9ecc06-36ad-4529-922a-1a197be30064 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:05.139667 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ee9ecc06-36ad-4529-922a-1a197be30064 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:05.140100 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ee9ecc06-36ad-4529-922a-1a197be30064 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:05.162421 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ee9ecc06-36ad-4529-922a-1a197be30064 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:05.162876 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ee9ecc06-36ad-4529-922a-1a197be30064 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:05.163316 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ee9ecc06-36ad-4529-922a-1a197be30064 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:05.176535 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.objects.instance [None req-ee9ecc06-36ad-4529-922a-1a197be30064 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lazy-loading 'flavor' on Instance uuid 588c4f48-5a52-4a12-b79b-2bfa7b9769d4 {{(pid=123595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 19:07:05.193016 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-ee9ecc06-36ad-4529-922a-1a197be30064 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] 10.222.0.43 "DELETE /compute/v2.1/servers/588c4f48-5a52-4a12-b79b-2bfa7b9769d4/tags" status: 204 len: 0 microversion: 2.26 time: 0.078016 Oct 04 19:07:05.195316 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2857/6082] 10.222.0.43 () {60 vars in 1295 bytes} [Tue Oct 4 19:07:05 2022] DELETE /compute/v2.1/servers/588c4f48-5a52-4a12-b79b-2bfa7b9769d4/tags => generated 0 bytes in 82 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 19:07:05.204499 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f7132320-a3cd-4340-b13b-4e5d982e7a34 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Calling method '.version_select at 0x7fb224110ee0>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:05.214331 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f7132320-a3cd-4340-b13b-4e5d982e7a34 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:05.214832 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f7132320-a3cd-4340-b13b-4e5d982e7a34 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:05.215283 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f7132320-a3cd-4340-b13b-4e5d982e7a34 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:05.226642 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-f7132320-a3cd-4340-b13b-4e5d982e7a34 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] 10.222.0.43 "GET /compute/v2.1/servers/588c4f48-5a52-4a12-b79b-2bfa7b9769d4/tags" status: 200 len: 12 microversion: 2.26 time: 0.026309 Oct 04 19:07:05.227577 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3226/6083] 10.222.0.43 () {60 vars in 1292 bytes} [Tue Oct 4 19:07:05 2022] GET /compute/v2.1/servers/588c4f48-5a52-4a12-b79b-2bfa7b9769d4/tags => generated 12 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:07:05.237277 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-9ba76d24-e409-4778-bd77-44b92c70e405 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Calling method '.version_select at 0x7fb21ee173a0>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:05.245425 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9ba76d24-e409-4778-bd77-44b92c70e405 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:05.245906 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9ba76d24-e409-4778-bd77-44b92c70e405 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:05.246336 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9ba76d24-e409-4778-bd77-44b92c70e405 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:05.246804 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-9ba76d24-e409-4778-bd77-44b92c70e405 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] [instance: 588c4f48-5a52-4a12-b79b-2bfa7b9769d4] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:05.252301 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9ba76d24-e409-4778-bd77-44b92c70e405 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:05.252865 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9ba76d24-e409-4778-bd77-44b92c70e405 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:05.253389 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9ba76d24-e409-4778-bd77-44b92c70e405 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:05.254020 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9ba76d24-e409-4778-bd77-44b92c70e405 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:05.254488 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9ba76d24-e409-4778-bd77-44b92c70e405 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:05.254895 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9ba76d24-e409-4778-bd77-44b92c70e405 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:05.290790 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9ba76d24-e409-4778-bd77-44b92c70e405 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:05.291286 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9ba76d24-e409-4778-bd77-44b92c70e405 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:05.291734 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9ba76d24-e409-4778-bd77-44b92c70e405 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:05.305406 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.objects.instance [None req-9ba76d24-e409-4778-bd77-44b92c70e405 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lazy-loading 'flavor' on Instance uuid 588c4f48-5a52-4a12-b79b-2bfa7b9769d4 {{(pid=123595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 19:07:05.320253 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-9ba76d24-e409-4778-bd77-44b92c70e405 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] 10.222.0.43 "DELETE /compute/v2.1/servers/588c4f48-5a52-4a12-b79b-2bfa7b9769d4/tags" status: 204 len: 0 microversion: 2.26 time: 0.087096 Oct 04 19:07:05.320877 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2858/6084] 10.222.0.43 () {60 vars in 1295 bytes} [Tue Oct 4 19:07:05 2022] DELETE /compute/v2.1/servers/588c4f48-5a52-4a12-b79b-2bfa7b9769d4/tags => generated 0 bytes in 88 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 19:07:05.330343 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-2874e864-16d5-44f0-9c8d-6e3c7ba61396 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Calling method '.version_select at 0x7fb21edc5a60>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:05.339755 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2874e864-16d5-44f0-9c8d-6e3c7ba61396 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:05.340233 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2874e864-16d5-44f0-9c8d-6e3c7ba61396 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:05.340668 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2874e864-16d5-44f0-9c8d-6e3c7ba61396 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:05.341155 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-2874e864-16d5-44f0-9c8d-6e3c7ba61396 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] [instance: 588c4f48-5a52-4a12-b79b-2bfa7b9769d4] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:05.346462 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2874e864-16d5-44f0-9c8d-6e3c7ba61396 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:05.346932 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2874e864-16d5-44f0-9c8d-6e3c7ba61396 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:05.347367 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2874e864-16d5-44f0-9c8d-6e3c7ba61396 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:05.348048 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2874e864-16d5-44f0-9c8d-6e3c7ba61396 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:05.348501 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2874e864-16d5-44f0-9c8d-6e3c7ba61396 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:05.348929 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2874e864-16d5-44f0-9c8d-6e3c7ba61396 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:05.377372 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2874e864-16d5-44f0-9c8d-6e3c7ba61396 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:05.377860 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2874e864-16d5-44f0-9c8d-6e3c7ba61396 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:05.378303 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2874e864-16d5-44f0-9c8d-6e3c7ba61396 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:05.387706 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2874e864-16d5-44f0-9c8d-6e3c7ba61396 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:05.388328 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2874e864-16d5-44f0-9c8d-6e3c7ba61396 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:05.388609 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2874e864-16d5-44f0-9c8d-6e3c7ba61396 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:05.412167 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.objects.instance [None req-2874e864-16d5-44f0-9c8d-6e3c7ba61396 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lazy-loading 'flavor' on Instance uuid 588c4f48-5a52-4a12-b79b-2bfa7b9769d4 {{(pid=123596) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 19:07:05.429464 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-2874e864-16d5-44f0-9c8d-6e3c7ba61396 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] 10.222.0.43 "PUT /compute/v2.1/servers/588c4f48-5a52-4a12-b79b-2bfa7b9769d4/tags/tempest-tag-1074203938" status: 201 len: 0 microversion: 2.26 time: 0.102328 Oct 04 19:07:05.430050 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3227/6085] 10.222.0.43 () {62 vars in 1380 bytes} [Tue Oct 4 19:07:05 2022] PUT /compute/v2.1/servers/588c4f48-5a52-4a12-b79b-2bfa7b9769d4/tags/tempest-tag-1074203938 => generated 0 bytes in 104 msecs (HTTP/1.1 201) 10 headers in 486 bytes (2 switches on core 0) Oct 04 19:07:05.439858 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-8e7ef63c-93de-45f0-a06f-1eab8c5384a8 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Calling method '.version_select at 0x7fb21ea77310>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:05.449623 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8e7ef63c-93de-45f0-a06f-1eab8c5384a8 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:05.450107 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8e7ef63c-93de-45f0-a06f-1eab8c5384a8 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:05.450550 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8e7ef63c-93de-45f0-a06f-1eab8c5384a8 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:05.451022 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-8e7ef63c-93de-45f0-a06f-1eab8c5384a8 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] [instance: 588c4f48-5a52-4a12-b79b-2bfa7b9769d4] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:05.456614 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8e7ef63c-93de-45f0-a06f-1eab8c5384a8 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:05.457254 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8e7ef63c-93de-45f0-a06f-1eab8c5384a8 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:05.457689 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8e7ef63c-93de-45f0-a06f-1eab8c5384a8 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:05.458546 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8e7ef63c-93de-45f0-a06f-1eab8c5384a8 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:05.459180 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8e7ef63c-93de-45f0-a06f-1eab8c5384a8 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:05.459637 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8e7ef63c-93de-45f0-a06f-1eab8c5384a8 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:05.485821 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8e7ef63c-93de-45f0-a06f-1eab8c5384a8 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:05.486316 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8e7ef63c-93de-45f0-a06f-1eab8c5384a8 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:05.486758 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8e7ef63c-93de-45f0-a06f-1eab8c5384a8 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:05.497970 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8e7ef63c-93de-45f0-a06f-1eab8c5384a8 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:05.498519 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8e7ef63c-93de-45f0-a06f-1eab8c5384a8 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:05.498965 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8e7ef63c-93de-45f0-a06f-1eab8c5384a8 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:05.526508 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.objects.instance [None req-8e7ef63c-93de-45f0-a06f-1eab8c5384a8 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lazy-loading 'flavor' on Instance uuid 588c4f48-5a52-4a12-b79b-2bfa7b9769d4 {{(pid=123595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 19:07:05.542165 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-8e7ef63c-93de-45f0-a06f-1eab8c5384a8 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] 10.222.0.43 "PUT /compute/v2.1/servers/588c4f48-5a52-4a12-b79b-2bfa7b9769d4/tags/tempest-tag-1592416005" status: 201 len: 0 microversion: 2.26 time: 0.106353 Oct 04 19:07:05.543078 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2859/6086] 10.222.0.43 () {62 vars in 1380 bytes} [Tue Oct 4 19:07:05 2022] PUT /compute/v2.1/servers/588c4f48-5a52-4a12-b79b-2bfa7b9769d4/tags/tempest-tag-1592416005 => generated 0 bytes in 108 msecs (HTTP/1.1 201) 10 headers in 486 bytes (2 switches on core 0) Oct 04 19:07:05.554797 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-598d3d31-b1fc-41a9-b2a4-bb2f31ce62d2 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Action: 'update_all', calling method: .version_select at 0x7fb224110ee0>, body: {"tags": ["tempest-tag-403847261", "tempest-tag-1102927300"]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:07:05.565537 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-598d3d31-b1fc-41a9-b2a4-bb2f31ce62d2 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:05.566034 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-598d3d31-b1fc-41a9-b2a4-bb2f31ce62d2 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:05.566496 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-598d3d31-b1fc-41a9-b2a4-bb2f31ce62d2 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:05.566962 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-598d3d31-b1fc-41a9-b2a4-bb2f31ce62d2 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] [instance: 588c4f48-5a52-4a12-b79b-2bfa7b9769d4] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:05.573381 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-598d3d31-b1fc-41a9-b2a4-bb2f31ce62d2 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:05.573862 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-598d3d31-b1fc-41a9-b2a4-bb2f31ce62d2 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:05.574340 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-598d3d31-b1fc-41a9-b2a4-bb2f31ce62d2 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:05.575024 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-598d3d31-b1fc-41a9-b2a4-bb2f31ce62d2 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:05.575486 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-598d3d31-b1fc-41a9-b2a4-bb2f31ce62d2 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:05.575916 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-598d3d31-b1fc-41a9-b2a4-bb2f31ce62d2 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:05.606462 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-598d3d31-b1fc-41a9-b2a4-bb2f31ce62d2 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:05.606969 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-598d3d31-b1fc-41a9-b2a4-bb2f31ce62d2 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:05.607568 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-598d3d31-b1fc-41a9-b2a4-bb2f31ce62d2 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:05.637299 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.objects.instance [None req-598d3d31-b1fc-41a9-b2a4-bb2f31ce62d2 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lazy-loading 'flavor' on Instance uuid 588c4f48-5a52-4a12-b79b-2bfa7b9769d4 {{(pid=123596) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 19:07:05.657006 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-598d3d31-b1fc-41a9-b2a4-bb2f31ce62d2 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] 10.222.0.43 "PUT /compute/v2.1/servers/588c4f48-5a52-4a12-b79b-2bfa7b9769d4/tags" status: 200 len: 61 microversion: 2.26 time: 0.107749 Oct 04 19:07:05.660456 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3228/6087] 10.222.0.43 () {62 vars in 1312 bytes} [Tue Oct 4 19:07:05 2022] PUT /compute/v2.1/servers/588c4f48-5a52-4a12-b79b-2bfa7b9769d4/tags => generated 61 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:07:05.669410 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-f38b88ab-39da-4efc-a91d-a18040da412e tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Calling method '.version_select at 0x7fb21ee17e50>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:05.677182 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f38b88ab-39da-4efc-a91d-a18040da412e tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:05.677747 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f38b88ab-39da-4efc-a91d-a18040da412e tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:05.678262 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f38b88ab-39da-4efc-a91d-a18040da412e tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:05.694625 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-f38b88ab-39da-4efc-a91d-a18040da412e tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] 10.222.0.43 "GET /compute/v2.1/servers/588c4f48-5a52-4a12-b79b-2bfa7b9769d4/tags" status: 200 len: 61 microversion: 2.26 time: 0.029105 Oct 04 19:07:05.697187 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2860/6088] 10.222.0.43 () {60 vars in 1292 bytes} [Tue Oct 4 19:07:05 2022] GET /compute/v2.1/servers/588c4f48-5a52-4a12-b79b-2bfa7b9769d4/tags => generated 61 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:07:05.706906 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-c7763266-bebc-4957-8af6-49cb57948607 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Calling method '.version_select at 0x7fb2241104c0>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:05.714862 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c7763266-bebc-4957-8af6-49cb57948607 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:05.715353 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c7763266-bebc-4957-8af6-49cb57948607 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:05.715798 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c7763266-bebc-4957-8af6-49cb57948607 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:05.716307 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-c7763266-bebc-4957-8af6-49cb57948607 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] [instance: 588c4f48-5a52-4a12-b79b-2bfa7b9769d4] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:05.721925 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c7763266-bebc-4957-8af6-49cb57948607 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:05.722407 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c7763266-bebc-4957-8af6-49cb57948607 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:05.722846 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c7763266-bebc-4957-8af6-49cb57948607 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:05.723530 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c7763266-bebc-4957-8af6-49cb57948607 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:05.723988 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c7763266-bebc-4957-8af6-49cb57948607 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:05.724419 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c7763266-bebc-4957-8af6-49cb57948607 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:05.747688 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c7763266-bebc-4957-8af6-49cb57948607 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:05.748189 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c7763266-bebc-4957-8af6-49cb57948607 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:05.748626 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c7763266-bebc-4957-8af6-49cb57948607 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:05.763250 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.objects.instance [None req-c7763266-bebc-4957-8af6-49cb57948607 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lazy-loading 'flavor' on Instance uuid 588c4f48-5a52-4a12-b79b-2bfa7b9769d4 {{(pid=123596) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 19:07:05.779715 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-c7763266-bebc-4957-8af6-49cb57948607 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] 10.222.0.43 "DELETE /compute/v2.1/servers/588c4f48-5a52-4a12-b79b-2bfa7b9769d4/tags" status: 204 len: 0 microversion: 2.26 time: 0.076824 Oct 04 19:07:05.780345 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3229/6089] 10.222.0.43 () {60 vars in 1295 bytes} [Tue Oct 4 19:07:05 2022] DELETE /compute/v2.1/servers/588c4f48-5a52-4a12-b79b-2bfa7b9769d4/tags => generated 0 bytes in 78 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 19:07:05.790401 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-8a1ba920-2ca7-4db8-b9a3-1cc9b389ffe0 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:05.790906 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-8a1ba920-2ca7-4db8-b9a3-1cc9b389ffe0 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] [instance: 588c4f48-5a52-4a12-b79b-2bfa7b9769d4] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:05.797294 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8a1ba920-2ca7-4db8-b9a3-1cc9b389ffe0 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:05.797789 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8a1ba920-2ca7-4db8-b9a3-1cc9b389ffe0 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:05.798225 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8a1ba920-2ca7-4db8-b9a3-1cc9b389ffe0 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:05.798930 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8a1ba920-2ca7-4db8-b9a3-1cc9b389ffe0 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:05.799386 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8a1ba920-2ca7-4db8-b9a3-1cc9b389ffe0 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:05.799823 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8a1ba920-2ca7-4db8-b9a3-1cc9b389ffe0 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:05.829986 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-8a1ba920-2ca7-4db8-b9a3-1cc9b389ffe0 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] [instance: 588c4f48-5a52-4a12-b79b-2bfa7b9769d4] Going to try to terminate instance {{(pid=123595) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 19:07:05.925037 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-8a1ba920-2ca7-4db8-b9a3-1cc9b389ffe0 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] 10.222.0.43 "DELETE /compute/v2.1/servers/588c4f48-5a52-4a12-b79b-2bfa7b9769d4" status: 204 len: 0 microversion: 2.26 time: 0.138967 Oct 04 19:07:05.925972 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2861/6090] 10.222.0.43 () {60 vars in 1280 bytes} [Tue Oct 4 19:07:05 2022] DELETE /compute/v2.1/servers/588c4f48-5a52-4a12-b79b-2bfa7b9769d4 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 19:07:05.934759 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-a32e3d3f-1d03-43fd-bd44-ed9d3755f334 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:05.936462 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-a32e3d3f-1d03-43fd-bd44-ed9d3755f334 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] [instance: 588c4f48-5a52-4a12-b79b-2bfa7b9769d4] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:05.942655 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a32e3d3f-1d03-43fd-bd44-ed9d3755f334 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:05.943140 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a32e3d3f-1d03-43fd-bd44-ed9d3755f334 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:05.943578 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a32e3d3f-1d03-43fd-bd44-ed9d3755f334 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:05.944352 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a32e3d3f-1d03-43fd-bd44-ed9d3755f334 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:05.944856 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a32e3d3f-1d03-43fd-bd44-ed9d3755f334 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:05.945320 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a32e3d3f-1d03-43fd-bd44-ed9d3755f334 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:05.966527 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-1360c2e4-3cca-4a5d-b4a2-584bbe24bbfb tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:05.967317 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-1360c2e4-3cca-4a5d-b4a2-584bbe24bbfb tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] [instance: 101952eb-ca4d-489c-8cb5-3bfadf241aa3] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:05.973931 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1360c2e4-3cca-4a5d-b4a2-584bbe24bbfb tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:05.974516 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1360c2e4-3cca-4a5d-b4a2-584bbe24bbfb tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:05.975036 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1360c2e4-3cca-4a5d-b4a2-584bbe24bbfb tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:05.976621 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1360c2e4-3cca-4a5d-b4a2-584bbe24bbfb tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:05.977354 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1360c2e4-3cca-4a5d-b4a2-584bbe24bbfb tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:05.977793 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1360c2e4-3cca-4a5d-b4a2-584bbe24bbfb tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:06.119140 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-a32e3d3f-1d03-43fd-bd44-ed9d3755f334 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d730241785c494486329e88bd218c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229b7380efe14b739ead311d8ad55065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:06.128807 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-a32e3d3f-1d03-43fd-bd44-ed9d3755f334 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d730241785c494486329e88bd218c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229b7380efe14b739ead311d8ad55065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:06.129408 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-1360c2e4-3cca-4a5d-b4a2-584bbe24bbfb tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:06.129838 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-a32e3d3f-1d03-43fd-bd44-ed9d3755f334 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d730241785c494486329e88bd218c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229b7380efe14b739ead311d8ad55065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:06.131337 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-a32e3d3f-1d03-43fd-bd44-ed9d3755f334 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] 10.222.0.43 "GET /compute/v2.1/servers/588c4f48-5a52-4a12-b79b-2bfa7b9769d4" status: 200 len: 1553 microversion: 2.26 time: 0.200317 Oct 04 19:07:06.131998 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3230/6091] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:07:05 2022] GET /compute/v2.1/servers/588c4f48-5a52-4a12-b79b-2bfa7b9769d4 => generated 1553 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 19:07:06.138704 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-1360c2e4-3cca-4a5d-b4a2-584bbe24bbfb tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:06.140149 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-1360c2e4-3cca-4a5d-b4a2-584bbe24bbfb tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:06.141343 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-1360c2e4-3cca-4a5d-b4a2-584bbe24bbfb tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] 10.222.0.43 "GET /compute/v2.1/servers/101952eb-ca4d-489c-8cb5-3bfadf241aa3" status: 200 len: 1721 microversion: 2.20 time: 0.181819 Oct 04 19:07:06.141908 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2862/6092] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:07:05 2022] GET /compute/v2.1/servers/101952eb-ca4d-489c-8cb5-3bfadf241aa3 => generated 1721 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:07:07.160303 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-d9b7f9f4-a841-4dd4-ac2d-9be54ff7ef54 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:07.160923 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-d9b7f9f4-a841-4dd4-ac2d-9be54ff7ef54 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] [instance: 588c4f48-5a52-4a12-b79b-2bfa7b9769d4] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:07.168483 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d9b7f9f4-a841-4dd4-ac2d-9be54ff7ef54 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:07.168978 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d9b7f9f4-a841-4dd4-ac2d-9be54ff7ef54 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:07.169082 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-a26b7bb0-c03a-4785-a41d-7a6d676e237a tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:07.169536 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d9b7f9f4-a841-4dd4-ac2d-9be54ff7ef54 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:07.169718 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-a26b7bb0-c03a-4785-a41d-7a6d676e237a tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] [instance: 101952eb-ca4d-489c-8cb5-3bfadf241aa3] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:07.170154 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d9b7f9f4-a841-4dd4-ac2d-9be54ff7ef54 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:07.170696 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d9b7f9f4-a841-4dd4-ac2d-9be54ff7ef54 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:07.171132 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d9b7f9f4-a841-4dd4-ac2d-9be54ff7ef54 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:07.177245 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a26b7bb0-c03a-4785-a41d-7a6d676e237a tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:07.177749 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a26b7bb0-c03a-4785-a41d-7a6d676e237a tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:07.178194 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a26b7bb0-c03a-4785-a41d-7a6d676e237a tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:07.179583 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a26b7bb0-c03a-4785-a41d-7a6d676e237a tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:07.180097 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a26b7bb0-c03a-4785-a41d-7a6d676e237a tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:07.180727 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a26b7bb0-c03a-4785-a41d-7a6d676e237a tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:07.347234 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-d9b7f9f4-a841-4dd4-ac2d-9be54ff7ef54 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d730241785c494486329e88bd218c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229b7380efe14b739ead311d8ad55065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:07.347403 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-a26b7bb0-c03a-4785-a41d-7a6d676e237a tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:07.356421 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-a26b7bb0-c03a-4785-a41d-7a6d676e237a tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:07.358388 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-d9b7f9f4-a841-4dd4-ac2d-9be54ff7ef54 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d730241785c494486329e88bd218c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229b7380efe14b739ead311d8ad55065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:07.359841 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-d9b7f9f4-a841-4dd4-ac2d-9be54ff7ef54 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d730241785c494486329e88bd218c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229b7380efe14b739ead311d8ad55065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:07.361260 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-d9b7f9f4-a841-4dd4-ac2d-9be54ff7ef54 tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] 10.222.0.43 "GET /compute/v2.1/servers/588c4f48-5a52-4a12-b79b-2bfa7b9769d4" status: 200 len: 1553 microversion: 2.26 time: 0.205058 Oct 04 19:07:07.362276 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3231/6093] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:07:07 2022] GET /compute/v2.1/servers/588c4f48-5a52-4a12-b79b-2bfa7b9769d4 => generated 1553 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:07:07.369190 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-a26b7bb0-c03a-4785-a41d-7a6d676e237a tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:07.369190 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-a26b7bb0-c03a-4785-a41d-7a6d676e237a tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] 10.222.0.43 "GET /compute/v2.1/servers/101952eb-ca4d-489c-8cb5-3bfadf241aa3" status: 200 len: 1721 microversion: 2.20 time: 0.200651 Oct 04 19:07:07.369190 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2863/6094] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:07:07 2022] GET /compute/v2.1/servers/101952eb-ca4d-489c-8cb5-3bfadf241aa3 => generated 1721 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:07:08.088269 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-bbaebcb0-9127-47ec-8d5e-9858d9d93cd2 req-bb3fc102-b57f-4dd9-aa82-6d0fd55a83f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "101952eb-ca4d-489c-8cb5-3bfadf241aa3", "name": "network-vif-unplugged", "status": "completed", "tag": "1c32f64c-fd96-488e-ad04-113ec01cb7c8"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:07:08.099685 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-bbaebcb0-9127-47ec-8d5e-9858d9d93cd2 req-bb3fc102-b57f-4dd9-aa82-6d0fd55a83f3 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:08.100307 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-bbaebcb0-9127-47ec-8d5e-9858d9d93cd2 req-bb3fc102-b57f-4dd9-aa82-6d0fd55a83f3 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:08.100807 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-bbaebcb0-9127-47ec-8d5e-9858d9d93cd2 req-bb3fc102-b57f-4dd9-aa82-6d0fd55a83f3 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:08.116686 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.compute.server_external_events [req-bbaebcb0-9127-47ec-8d5e-9858d9d93cd2 req-bb3fc102-b57f-4dd9-aa82-6d0fd55a83f3 service nova] Unable to find a host for instance 101952eb-ca4d-489c-8cb5-3bfadf241aa3. Dropping event network-vif-unplugged {{(pid=123596) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 04 19:07:08.118211 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-bbaebcb0-9127-47ec-8d5e-9858d9d93cd2 req-bb3fc102-b57f-4dd9-aa82-6d0fd55a83f3 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.035321 Oct 04 19:07:08.119820 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3232/6095] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:07:08 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 37 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 04 19:07:08.332106 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-386a15db-eda3-4120-a37c-63a233932b21 req-ba384d90-ef73-4b4d-81ca-0bec9e4c3de0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "588c4f48-5a52-4a12-b79b-2bfa7b9769d4", "name": "network-vif-deleted", "tag": "83f63fab-6404-4ffa-afc3-9c1a88c38542"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:07:08.344145 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-386a15db-eda3-4120-a37c-63a233932b21 req-ba384d90-ef73-4b4d-81ca-0bec9e4c3de0 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:08.344876 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-386a15db-eda3-4120-a37c-63a233932b21 req-ba384d90-ef73-4b4d-81ca-0bec9e4c3de0 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:08.345490 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-386a15db-eda3-4120-a37c-63a233932b21 req-ba384d90-ef73-4b4d-81ca-0bec9e4c3de0 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:08.361397 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-386a15db-eda3-4120-a37c-63a233932b21 req-ba384d90-ef73-4b4d-81ca-0bec9e4c3de0 service nova] Creating event network-vif-deleted:83f63fab-6404-4ffa-afc3-9c1a88c38542 for instance 588c4f48-5a52-4a12-b79b-2bfa7b9769d4 on n-h1-851028-13 Oct 04 19:07:08.372533 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-386a15db-eda3-4120-a37c-63a233932b21 req-ba384d90-ef73-4b4d-81ca-0bec9e4c3de0 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044742 Oct 04 19:07:08.373925 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2864/6096] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:07:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:07:08.393630 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-bab9a4e1-d4f6-4534-b7fa-2cd49e50af4a tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:08.397549 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-bab9a4e1-d4f6-4534-b7fa-2cd49e50af4a tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] [instance: 101952eb-ca4d-489c-8cb5-3bfadf241aa3] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:08.407830 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-cb660031-f769-496d-abbc-328112b4ba8f tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:08.408630 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-cb660031-f769-496d-abbc-328112b4ba8f tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] [instance: 588c4f48-5a52-4a12-b79b-2bfa7b9769d4] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:08.415320 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cb660031-f769-496d-abbc-328112b4ba8f tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:08.416880 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bab9a4e1-d4f6-4534-b7fa-2cd49e50af4a tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:08.417411 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bab9a4e1-d4f6-4534-b7fa-2cd49e50af4a tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:08.417858 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bab9a4e1-d4f6-4534-b7fa-2cd49e50af4a tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:08.418408 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cb660031-f769-496d-abbc-328112b4ba8f tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:08.418574 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bab9a4e1-d4f6-4534-b7fa-2cd49e50af4a tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:08.419188 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bab9a4e1-d4f6-4534-b7fa-2cd49e50af4a tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:08.419306 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cb660031-f769-496d-abbc-328112b4ba8f tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:08.419868 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bab9a4e1-d4f6-4534-b7fa-2cd49e50af4a tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:08.420210 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cb660031-f769-496d-abbc-328112b4ba8f tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:08.420816 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cb660031-f769-496d-abbc-328112b4ba8f tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:08.421512 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cb660031-f769-496d-abbc-328112b4ba8f tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:08.534268 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-cb660031-f769-496d-abbc-328112b4ba8f tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d730241785c494486329e88bd218c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229b7380efe14b739ead311d8ad55065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:08.545814 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-cb660031-f769-496d-abbc-328112b4ba8f tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d730241785c494486329e88bd218c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229b7380efe14b739ead311d8ad55065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:08.547317 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-cb660031-f769-496d-abbc-328112b4ba8f tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d730241785c494486329e88bd218c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229b7380efe14b739ead311d8ad55065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:08.548710 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-cb660031-f769-496d-abbc-328112b4ba8f tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] 10.222.0.43 "GET /compute/v2.1/servers/588c4f48-5a52-4a12-b79b-2bfa7b9769d4" status: 200 len: 1347 microversion: 2.26 time: 0.155457 Oct 04 19:07:08.549642 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2865/6097] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:07:08 2022] GET /compute/v2.1/servers/588c4f48-5a52-4a12-b79b-2bfa7b9769d4 => generated 1347 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:07:08.598362 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-bab9a4e1-d4f6-4534-b7fa-2cd49e50af4a tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:08.608139 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-bab9a4e1-d4f6-4534-b7fa-2cd49e50af4a tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:08.609535 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-bab9a4e1-d4f6-4534-b7fa-2cd49e50af4a tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:08.610737 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-bab9a4e1-d4f6-4534-b7fa-2cd49e50af4a tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] 10.222.0.43 "GET /compute/v2.1/servers/101952eb-ca4d-489c-8cb5-3bfadf241aa3" status: 200 len: 1664 microversion: 2.20 time: 0.222741 Oct 04 19:07:08.611345 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3233/6098] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:07:08 2022] GET /compute/v2.1/servers/101952eb-ca4d-489c-8cb5-3bfadf241aa3 => generated 1664 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:07:08.639709 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-ff116322-5ad6-455e-b40a-80dd2175994b tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "033f0d6e-63ef-4fa7-af27-0da03ee9f927"}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:07:08.642538 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-ff116322-5ad6-455e-b40a-80dd2175994b tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] [instance: 101952eb-ca4d-489c-8cb5-3bfadf241aa3] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:08.650668 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ff116322-5ad6-455e-b40a-80dd2175994b tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:08.651432 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ff116322-5ad6-455e-b40a-80dd2175994b tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:08.651915 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ff116322-5ad6-455e-b40a-80dd2175994b tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:08.652637 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ff116322-5ad6-455e-b40a-80dd2175994b tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:08.653100 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ff116322-5ad6-455e-b40a-80dd2175994b tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:08.653560 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ff116322-5ad6-455e-b40a-80dd2175994b tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:08.746920 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=89,nova_cell1:DELETE=3,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=3,nova_cell1:RELEASE=2,nova_cell1:UPDATE=1 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:07:09.013153 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-ff116322-5ad6-455e-b40a-80dd2175994b tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] 10.222.0.43 "POST /compute/v2.1/servers/101952eb-ca4d-489c-8cb5-3bfadf241aa3/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.377405 Oct 04 19:07:09.021399 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2866/6099] 10.222.0.43 () {62 vars in 1364 bytes} [Tue Oct 4 19:07:08 2022] POST /compute/v2.1/servers/101952eb-ca4d-489c-8cb5-3bfadf241aa3/os-volume_attachments => generated 188 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 19:07:09.159963 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-1f069a3e-e99c-4322-a678-127ac7f9b33d tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:07:09.160663 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-1f069a3e-e99c-4322-a678-127ac7f9b33d tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] [instance: 101952eb-ca4d-489c-8cb5-3bfadf241aa3] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:09.167581 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1f069a3e-e99c-4322-a678-127ac7f9b33d tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:09.168071 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1f069a3e-e99c-4322-a678-127ac7f9b33d tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:09.168511 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1f069a3e-e99c-4322-a678-127ac7f9b33d tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:09.169234 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1f069a3e-e99c-4322-a678-127ac7f9b33d tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:09.169691 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1f069a3e-e99c-4322-a678-127ac7f9b33d tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:09.170119 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1f069a3e-e99c-4322-a678-127ac7f9b33d tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:09.200979 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-1f069a3e-e99c-4322-a678-127ac7f9b33d tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] [instance: 101952eb-ca4d-489c-8cb5-3bfadf241aa3] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=123596) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 04 19:07:09.278146 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-1f069a3e-e99c-4322-a678-127ac7f9b33d tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] 10.222.0.43 "POST /compute/v2.1/servers/101952eb-ca4d-489c-8cb5-3bfadf241aa3/action" status: 202 len: 0 microversion: 2.20 time: 0.122198 Oct 04 19:07:09.279116 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3234/6100] 10.222.0.43 () {62 vars in 1319 bytes} [Tue Oct 4 19:07:09 2022] POST /compute/v2.1/servers/101952eb-ca4d-489c-8cb5-3bfadf241aa3/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:07:09.292338 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-054beb64-21c3-4c88-afd1-46d0d2f8de06 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:09.293067 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-054beb64-21c3-4c88-afd1-46d0d2f8de06 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] [instance: 101952eb-ca4d-489c-8cb5-3bfadf241aa3] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:09.295463 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:07:09.303305 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-054beb64-21c3-4c88-afd1-46d0d2f8de06 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:09.304160 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-054beb64-21c3-4c88-afd1-46d0d2f8de06 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:09.304828 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-054beb64-21c3-4c88-afd1-46d0d2f8de06 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:09.305720 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-054beb64-21c3-4c88-afd1-46d0d2f8de06 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:09.306593 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-054beb64-21c3-4c88-afd1-46d0d2f8de06 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:09.307703 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-054beb64-21c3-4c88-afd1-46d0d2f8de06 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:09.466450 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-054beb64-21c3-4c88-afd1-46d0d2f8de06 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:09.477154 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-054beb64-21c3-4c88-afd1-46d0d2f8de06 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:09.478751 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-054beb64-21c3-4c88-afd1-46d0d2f8de06 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:09.479896 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-054beb64-21c3-4c88-afd1-46d0d2f8de06 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] 10.222.0.43 "GET /compute/v2.1/servers/101952eb-ca4d-489c-8cb5-3bfadf241aa3" status: 200 len: 1750 microversion: 2.20 time: 0.194757 Oct 04 19:07:09.480460 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2867/6101] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:07:09 2022] GET /compute/v2.1/servers/101952eb-ca4d-489c-8cb5-3bfadf241aa3 => generated 1750 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:07:09.576838 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-cbd53c8f-0c4a-4928-bdd2-3776a44d0bed tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:09.578416 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-cbd53c8f-0c4a-4928-bdd2-3776a44d0bed tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] [instance: 588c4f48-5a52-4a12-b79b-2bfa7b9769d4] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:09.586489 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cbd53c8f-0c4a-4928-bdd2-3776a44d0bed tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:09.586993 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cbd53c8f-0c4a-4928-bdd2-3776a44d0bed tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:09.587519 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cbd53c8f-0c4a-4928-bdd2-3776a44d0bed tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:09.588220 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cbd53c8f-0c4a-4928-bdd2-3776a44d0bed tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:09.588684 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cbd53c8f-0c4a-4928-bdd2-3776a44d0bed tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:09.589149 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cbd53c8f-0c4a-4928-bdd2-3776a44d0bed tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:09.605441 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-cbd53c8f-0c4a-4928-bdd2-3776a44d0bed tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] HTTP exception thrown: Instance 588c4f48-5a52-4a12-b79b-2bfa7b9769d4 could not be found. Oct 04 19:07:09.607186 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-cbd53c8f-0c4a-4928-bdd2-3776a44d0bed tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Request method failure captured: Oct 04 19:07:09.607186 n-d-851028-13 devstack@n-api.service[123596]: request: GET /compute/v2.1/servers/588c4f48-5a52-4a12-b79b-2bfa7b9769d4 HTTP/1.1 Oct 04 19:07:09.607186 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 19:07:09.607186 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 19:07:09.607186 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 19:07:09.607186 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 19:07:09.607186 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 19:07:09.607186 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 19:07:09.607186 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 19:07:09.607186 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 19:07:09.607186 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPIRIe4UWbdWxY6SQ0VuHcYVDORZRtb1mScxJ5iHEHA5pTn007EFrbwYaJu1-sO8FKIiOSjnoRKQrDOMU8IjQOhJKAOxLENhdHQD980UNhVv32ytim-_poZbGrNJOZOOfqoeC65_Y3rjYAQijHHn3DOEH5xpy8H8Uzmxhi2ZG47WQaTU Oct 04 19:07:09.607186 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 19:07:09.607186 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 19:07:09.607186 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 19:07:09.607186 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 19:07:09.607186 n-d-851028-13 devstack@n-api.service[123596]: X-Openstack-Nova-Api-Version: 2.26 Oct 04 19:07:09.607186 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 19:07:09.607186 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 19:07:09.607186 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: 229b7380efe14b739ead311d8ad55065 Oct 04 19:07:09.607186 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-ServerTagsTestJSON-970924922 Oct 04 19:07:09.607186 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 19:07:09.607186 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 19:07:09.607186 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/229b7380efe14b739ead311d8ad55065"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_229b7380efe14b739ead311d8ad55065"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/229b7380efe14b739ead311d8ad55065"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/229b7380efe14b739ead311d8ad55065"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 19:07:09.607186 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-ServerTagsTestJSON-970924922 Oct 04 19:07:09.607186 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: 229b7380efe14b739ead311d8ad55065 Oct 04 19:07:09.607186 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-ServerTagsTestJSON-970924922 Oct 04 19:07:09.607186 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-ServerTagsTestJSON-970924922-project Oct 04 19:07:09.607186 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 19:07:09.607186 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 19:07:09.607186 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 1d730241785c494486329e88bd218c2b Oct 04 19:07:09.607186 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-ServerTagsTestJSON-970924922-project Oct 04 19:07:09.607186 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 19:07:09.607186 n-d-851028-13 devstack@n-api.service[123596]: exception: Instance 588c4f48-5a52-4a12-b79b-2bfa7b9769d4 could not be found. Oct 04 19:07:09.607186 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': '588c4f48-5a52-4a12-b79b-2bfa7b9769d4'} Oct 04 19:07:09.607186 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:07:09.607186 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:07:09.607186 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:07:09.607186 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:07:09.607186 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:07:09.607186 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:07:09.607186 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:07:09.607186 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:07:09.607186 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:07:09.607186 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:07:09.607186 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 588c4f48-5a52-4a12-b79b-2bfa7b9769d4 could not be found. Oct 04 19:07:09.607186 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:07:09.607186 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:07:09.607186 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:07:09.607186 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:07:09.607186 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:07:09.607186 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:07:09.607186 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:07:09.607186 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:07:09.607186 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:07:09.607186 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:07:09.607186 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:07:09.607186 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:07:09.607186 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:07:09.607186 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:07:09.607186 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:07:09.607186 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:07:09.607186 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 588c4f48-5a52-4a12-b79b-2bfa7b9769d4 could not be found. Oct 04 19:07:09.607186 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:07:09.607186 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:07:09.607186 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:07:09.611405 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:07:09.611405 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:07:09.611405 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:07:09.611405 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:07:09.611405 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:07:09.611405 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 588c4f48-5a52-4a12-b79b-2bfa7b9769d4 could not be found. Oct 04 19:07:09.611405 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:07:09.611405 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-cbd53c8f-0c4a-4928-bdd2-3776a44d0bed tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] Returning 404 to user: Instance 588c4f48-5a52-4a12-b79b-2bfa7b9769d4 could not be found. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:07:09.611405 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-cbd53c8f-0c4a-4928-bdd2-3776a44d0bed tempest-ServerTagsTestJSON-970924922 tempest-ServerTagsTestJSON-970924922-project] 10.222.0.43 "GET /compute/v2.1/servers/588c4f48-5a52-4a12-b79b-2bfa7b9769d4" status: 404 len: 111 microversion: 2.26 time: 0.036938 Oct 04 19:07:09.612923 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3235/6102] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:07:09 2022] GET /compute/v2.1/servers/588c4f48-5a52-4a12-b79b-2bfa7b9769d4 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 19:07:10.507954 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-cc9d2a6a-6e25-41fd-b1a0-c69238dd11d0 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:10.508860 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-cc9d2a6a-6e25-41fd-b1a0-c69238dd11d0 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] [instance: 101952eb-ca4d-489c-8cb5-3bfadf241aa3] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:10.518211 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cc9d2a6a-6e25-41fd-b1a0-c69238dd11d0 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:10.518865 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cc9d2a6a-6e25-41fd-b1a0-c69238dd11d0 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:10.519391 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cc9d2a6a-6e25-41fd-b1a0-c69238dd11d0 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:10.520684 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cc9d2a6a-6e25-41fd-b1a0-c69238dd11d0 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:10.521372 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cc9d2a6a-6e25-41fd-b1a0-c69238dd11d0 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:10.521926 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cc9d2a6a-6e25-41fd-b1a0-c69238dd11d0 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:10.717339 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-cc9d2a6a-6e25-41fd-b1a0-c69238dd11d0 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:10.727648 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-cc9d2a6a-6e25-41fd-b1a0-c69238dd11d0 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:10.729476 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-cc9d2a6a-6e25-41fd-b1a0-c69238dd11d0 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:10.730918 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-cc9d2a6a-6e25-41fd-b1a0-c69238dd11d0 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] 10.222.0.43 "GET /compute/v2.1/servers/101952eb-ca4d-489c-8cb5-3bfadf241aa3" status: 200 len: 1752 microversion: 2.20 time: 0.229519 Oct 04 19:07:10.731719 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2868/6103] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:07:10 2022] GET /compute/v2.1/servers/101952eb-ca4d-489c-8cb5-3bfadf241aa3 => generated 1752 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:07:11.758713 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-b20361dc-ffea-4c30-8ded-9084f11b5cce tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:11.760020 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-b20361dc-ffea-4c30-8ded-9084f11b5cce tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] [instance: 101952eb-ca4d-489c-8cb5-3bfadf241aa3] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:11.767652 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b20361dc-ffea-4c30-8ded-9084f11b5cce tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:11.768463 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b20361dc-ffea-4c30-8ded-9084f11b5cce tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:11.769299 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b20361dc-ffea-4c30-8ded-9084f11b5cce tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:11.770478 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b20361dc-ffea-4c30-8ded-9084f11b5cce tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:11.771139 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b20361dc-ffea-4c30-8ded-9084f11b5cce tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:11.771807 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b20361dc-ffea-4c30-8ded-9084f11b5cce tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:11.994637 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-b20361dc-ffea-4c30-8ded-9084f11b5cce tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:12.006777 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-b20361dc-ffea-4c30-8ded-9084f11b5cce tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:12.009898 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-b20361dc-ffea-4c30-8ded-9084f11b5cce tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:12.012043 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-b20361dc-ffea-4c30-8ded-9084f11b5cce tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] 10.222.0.43 "GET /compute/v2.1/servers/101952eb-ca4d-489c-8cb5-3bfadf241aa3" status: 200 len: 1752 microversion: 2.20 time: 0.258742 Oct 04 19:07:12.026520 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3236/6104] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:07:11 2022] GET /compute/v2.1/servers/101952eb-ca4d-489c-8cb5-3bfadf241aa3 => generated 1752 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:07:13.040822 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-64446485-aa56-456d-bf2a-62fc18073667 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:13.041448 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-64446485-aa56-456d-bf2a-62fc18073667 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] [instance: 101952eb-ca4d-489c-8cb5-3bfadf241aa3] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:13.049849 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-64446485-aa56-456d-bf2a-62fc18073667 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:13.050545 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-64446485-aa56-456d-bf2a-62fc18073667 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:13.051061 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-64446485-aa56-456d-bf2a-62fc18073667 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:13.052034 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-64446485-aa56-456d-bf2a-62fc18073667 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:13.053976 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-64446485-aa56-456d-bf2a-62fc18073667 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:13.054430 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-64446485-aa56-456d-bf2a-62fc18073667 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:13.259982 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-64446485-aa56-456d-bf2a-62fc18073667 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:13.274042 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-64446485-aa56-456d-bf2a-62fc18073667 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:13.293952 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-64446485-aa56-456d-bf2a-62fc18073667 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:13.300653 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-64446485-aa56-456d-bf2a-62fc18073667 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] 10.222.0.43 "GET /compute/v2.1/servers/101952eb-ca4d-489c-8cb5-3bfadf241aa3" status: 200 len: 1752 microversion: 2.20 time: 0.264157 Oct 04 19:07:13.326563 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2869/6105] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:07:13 2022] GET /compute/v2.1/servers/101952eb-ca4d-489c-8cb5-3bfadf241aa3 => generated 1752 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 19:07:14.332564 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-557222b7-4572-4e8e-bc0f-9e36d708cd63 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:14.333742 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-557222b7-4572-4e8e-bc0f-9e36d708cd63 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] [instance: 101952eb-ca4d-489c-8cb5-3bfadf241aa3] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:14.344310 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-557222b7-4572-4e8e-bc0f-9e36d708cd63 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:14.344310 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-557222b7-4572-4e8e-bc0f-9e36d708cd63 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:14.344310 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-557222b7-4572-4e8e-bc0f-9e36d708cd63 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:14.344310 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-557222b7-4572-4e8e-bc0f-9e36d708cd63 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:14.344310 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-557222b7-4572-4e8e-bc0f-9e36d708cd63 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:14.344310 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-557222b7-4572-4e8e-bc0f-9e36d708cd63 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:14.508556 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-557222b7-4572-4e8e-bc0f-9e36d708cd63 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:14.519914 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-557222b7-4572-4e8e-bc0f-9e36d708cd63 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:14.521708 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-557222b7-4572-4e8e-bc0f-9e36d708cd63 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:14.522939 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-557222b7-4572-4e8e-bc0f-9e36d708cd63 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] 10.222.0.43 "GET /compute/v2.1/servers/101952eb-ca4d-489c-8cb5-3bfadf241aa3" status: 200 len: 1752 microversion: 2.20 time: 0.194997 Oct 04 19:07:14.523506 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3237/6106] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:07:14 2022] GET /compute/v2.1/servers/101952eb-ca4d-489c-8cb5-3bfadf241aa3 => generated 1752 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 19:07:14.984842 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-8587b333-f94a-4a0a-9e0c-ffc473eb9370 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-1037674741", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452", "networks": "none"}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:07:15.047395 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-8587b333-f94a-4a0a-9e0c-ffc473eb9370 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Flavor limits 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:07:15.047964 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-8587b333-f94a-4a0a-9e0c-ffc473eb9370 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Image limits 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:07:15.048457 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-8587b333-f94a-4a0a-9e0c-ffc473eb9370 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Flavor pref 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:07:15.048976 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-8587b333-f94a-4a0a-9e0c-ffc473eb9370 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Image pref 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:07:15.049313 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-8587b333-f94a-4a0a-9e0c-ffc473eb9370 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:07:15.058883 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8587b333-f94a-4a0a-9e0c-ffc473eb9370 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:15.059600 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8587b333-f94a-4a0a-9e0c-ffc473eb9370 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:15.060178 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8587b333-f94a-4a0a-9e0c-ffc473eb9370 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:15.061060 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8587b333-f94a-4a0a-9e0c-ffc473eb9370 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:15.061547 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8587b333-f94a-4a0a-9e0c-ffc473eb9370 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:15.061969 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8587b333-f94a-4a0a-9e0c-ffc473eb9370 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:15.079169 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-8587b333-f94a-4a0a-9e0c-ffc473eb9370 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Getting quotas for project d7b18ccd11a84c7888bc34e94320cb45. Resources: {'ram', 'cores', 'instances'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:07:15.086287 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-8587b333-f94a-4a0a-9e0c-ffc473eb9370 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Getting quotas for user 4797a0a06faf431cb97448684460f58e and project d7b18ccd11a84c7888bc34e94320cb45. Resources: {'ram', 'cores', 'instances'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:07:15.099425 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-8587b333-f94a-4a0a-9e0c-ffc473eb9370 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Going to run 1 instances... {{(pid=123595) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 19:07:15.102974 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-8587b333-f94a-4a0a-9e0c-ffc473eb9370 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] [instance: 9a0fdfda-c32f-4eb6-bc66-64756354b77e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e8943ec5-4038-4d4b-b9b9-2415a79f5243',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 19:07:15.154274 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-8587b333-f94a-4a0a-9e0c-ffc473eb9370 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.305627 Oct 04 19:07:15.156086 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2870/6107] 10.222.0.43 () {62 vars in 1188 bytes} [Tue Oct 4 19:07:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 309 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 04 19:07:15.168420 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-a3b6b89b-a86d-4b34-868f-4dd294e5a447 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:15.169574 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-a3b6b89b-a86d-4b34-868f-4dd294e5a447 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] [instance: 9a0fdfda-c32f-4eb6-bc66-64756354b77e] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:15.230579 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-a3b6b89b-a86d-4b34-868f-4dd294e5a447 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4797a0a06faf431cb97448684460f58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b18ccd11a84c7888bc34e94320cb45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:15.239435 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-a3b6b89b-a86d-4b34-868f-4dd294e5a447 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4797a0a06faf431cb97448684460f58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b18ccd11a84c7888bc34e94320cb45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:15.241411 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-a3b6b89b-a86d-4b34-868f-4dd294e5a447 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4797a0a06faf431cb97448684460f58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b18ccd11a84c7888bc34e94320cb45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:15.242773 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-a3b6b89b-a86d-4b34-868f-4dd294e5a447 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] 10.222.0.43 "GET /compute/v2.1/servers/9a0fdfda-c32f-4eb6-bc66-64756354b77e" status: 200 len: 1278 microversion: 2.47 time: 0.080329 Oct 04 19:07:15.248735 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3238/6108] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:07:15 2022] GET /compute/v2.1/servers/9a0fdfda-c32f-4eb6-bc66-64756354b77e => generated 1278 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:07:15.320682 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-f3c1a4fc-ba92-487a-8821-19f69d1f45cf tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-2108267150", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452", "networks": "none"}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:07:15.388763 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-f3c1a4fc-ba92-487a-8821-19f69d1f45cf tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Flavor limits 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:07:15.389316 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-f3c1a4fc-ba92-487a-8821-19f69d1f45cf tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Image limits 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:07:15.389810 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-f3c1a4fc-ba92-487a-8821-19f69d1f45cf tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Flavor pref 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:07:15.390228 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-f3c1a4fc-ba92-487a-8821-19f69d1f45cf tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Image pref 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:07:15.390646 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-f3c1a4fc-ba92-487a-8821-19f69d1f45cf tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:07:15.404817 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f3c1a4fc-ba92-487a-8821-19f69d1f45cf tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:15.405465 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f3c1a4fc-ba92-487a-8821-19f69d1f45cf tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:15.406050 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f3c1a4fc-ba92-487a-8821-19f69d1f45cf tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:15.406818 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f3c1a4fc-ba92-487a-8821-19f69d1f45cf tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:15.407545 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f3c1a4fc-ba92-487a-8821-19f69d1f45cf tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:15.408014 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f3c1a4fc-ba92-487a-8821-19f69d1f45cf tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:15.429358 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-f3c1a4fc-ba92-487a-8821-19f69d1f45cf tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Getting quotas for project d7b18ccd11a84c7888bc34e94320cb45. Resources: {'ram', 'cores', 'instances'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:07:15.435073 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-f3c1a4fc-ba92-487a-8821-19f69d1f45cf tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Getting quotas for user 4797a0a06faf431cb97448684460f58e and project d7b18ccd11a84c7888bc34e94320cb45. Resources: {'ram', 'cores', 'instances'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:07:15.453327 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-f3c1a4fc-ba92-487a-8821-19f69d1f45cf tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Going to run 1 instances... {{(pid=123595) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 19:07:15.456939 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-f3c1a4fc-ba92-487a-8821-19f69d1f45cf tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] [instance: 8c95f5b8-35dd-4d5e-9ca6-a023614dd859] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e8943ec5-4038-4d4b-b9b9-2415a79f5243',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 19:07:15.507837 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-f3c1a4fc-ba92-487a-8821-19f69d1f45cf tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.191514 Oct 04 19:07:15.508570 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2871/6109] 10.222.0.43 () {62 vars in 1188 bytes} [Tue Oct 4 19:07:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 193 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Oct 04 19:07:15.519732 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-bdb96d99-317d-4017-a377-ffe61a8f6f06 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:07:15.523672 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-bdb96d99-317d-4017-a377-ffe61a8f6f06 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] [instance: 8c95f5b8-35dd-4d5e-9ca6-a023614dd859] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:15.557332 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-b1f545b4-eca6-41f5-8fec-ca8431c59910 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:15.557936 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-b1f545b4-eca6-41f5-8fec-ca8431c59910 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] [instance: 101952eb-ca4d-489c-8cb5-3bfadf241aa3] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:15.568475 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b1f545b4-eca6-41f5-8fec-ca8431c59910 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:15.568958 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b1f545b4-eca6-41f5-8fec-ca8431c59910 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:15.569962 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b1f545b4-eca6-41f5-8fec-ca8431c59910 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:15.570671 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b1f545b4-eca6-41f5-8fec-ca8431c59910 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:15.571299 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b1f545b4-eca6-41f5-8fec-ca8431c59910 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:15.571878 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-bdb96d99-317d-4017-a377-ffe61a8f6f06 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] 10.222.0.43 "PUT /compute/v2.1/servers/8c95f5b8-35dd-4d5e-9ca6-a023614dd859" status: 200 len: 992 microversion: 2.47 time: 0.056005 Oct 04 19:07:15.572177 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b1f545b4-eca6-41f5-8fec-ca8431c59910 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:15.572462 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3239/6110] 10.222.0.43 () {62 vars in 1297 bytes} [Tue Oct 4 19:07:15 2022] PUT /compute/v2.1/servers/8c95f5b8-35dd-4d5e-9ca6-a023614dd859 => generated 992 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 19:07:15.595664 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-d6c1108c-9742-4d1e-927d-2b66e63f1f79 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:15.596324 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-d6c1108c-9742-4d1e-927d-2b66e63f1f79 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] [instance: 8c95f5b8-35dd-4d5e-9ca6-a023614dd859] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:15.663764 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-d6c1108c-9742-4d1e-927d-2b66e63f1f79 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4797a0a06faf431cb97448684460f58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b18ccd11a84c7888bc34e94320cb45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:15.675637 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-d6c1108c-9742-4d1e-927d-2b66e63f1f79 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4797a0a06faf431cb97448684460f58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b18ccd11a84c7888bc34e94320cb45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:15.677017 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-d6c1108c-9742-4d1e-927d-2b66e63f1f79 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4797a0a06faf431cb97448684460f58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b18ccd11a84c7888bc34e94320cb45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:15.678235 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-d6c1108c-9742-4d1e-927d-2b66e63f1f79 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] 10.222.0.43 "GET /compute/v2.1/servers/8c95f5b8-35dd-4d5e-9ca6-a023614dd859" status: 200 len: 1278 microversion: 2.47 time: 0.087509 Oct 04 19:07:15.678840 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3240/6111] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:07:15 2022] GET /compute/v2.1/servers/8c95f5b8-35dd-4d5e-9ca6-a023614dd859 => generated 1278 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:07:15.783445 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-b1f545b4-eca6-41f5-8fec-ca8431c59910 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:15.794753 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-b1f545b4-eca6-41f5-8fec-ca8431c59910 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:15.796405 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-b1f545b4-eca6-41f5-8fec-ca8431c59910 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:15.797936 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-b1f545b4-eca6-41f5-8fec-ca8431c59910 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] 10.222.0.43 "GET /compute/v2.1/servers/101952eb-ca4d-489c-8cb5-3bfadf241aa3" status: 200 len: 1752 microversion: 2.20 time: 0.252769 Oct 04 19:07:15.798500 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2872/6112] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:07:15 2022] GET /compute/v2.1/servers/101952eb-ca4d-489c-8cb5-3bfadf241aa3 => generated 1752 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:07:16.705942 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-eee6d0b7-3241-48d1-aad2-0a33119a7fec tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:16.706559 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-eee6d0b7-3241-48d1-aad2-0a33119a7fec tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] [instance: 8c95f5b8-35dd-4d5e-9ca6-a023614dd859] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:16.714436 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-eee6d0b7-3241-48d1-aad2-0a33119a7fec tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:16.714932 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-eee6d0b7-3241-48d1-aad2-0a33119a7fec tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:16.715376 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-eee6d0b7-3241-48d1-aad2-0a33119a7fec tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:16.716077 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-eee6d0b7-3241-48d1-aad2-0a33119a7fec tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:16.716534 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-eee6d0b7-3241-48d1-aad2-0a33119a7fec tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:16.716995 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-eee6d0b7-3241-48d1-aad2-0a33119a7fec tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:16.787046 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-eee6d0b7-3241-48d1-aad2-0a33119a7fec tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4797a0a06faf431cb97448684460f58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b18ccd11a84c7888bc34e94320cb45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:16.795588 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-eee6d0b7-3241-48d1-aad2-0a33119a7fec tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4797a0a06faf431cb97448684460f58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b18ccd11a84c7888bc34e94320cb45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:16.797046 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-eee6d0b7-3241-48d1-aad2-0a33119a7fec tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4797a0a06faf431cb97448684460f58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b18ccd11a84c7888bc34e94320cb45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:16.798379 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-eee6d0b7-3241-48d1-aad2-0a33119a7fec tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] 10.222.0.43 "GET /compute/v2.1/servers/8c95f5b8-35dd-4d5e-9ca6-a023614dd859" status: 200 len: 1330 microversion: 2.47 time: 0.096405 Oct 04 19:07:16.799083 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3241/6113] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:07:16 2022] GET /compute/v2.1/servers/8c95f5b8-35dd-4d5e-9ca6-a023614dd859 => generated 1330 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:07:16.829592 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-d2f67d7a-02c1-4fd8-b8c9-48ebca2702d2 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:16.830206 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-d2f67d7a-02c1-4fd8-b8c9-48ebca2702d2 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] [instance: 101952eb-ca4d-489c-8cb5-3bfadf241aa3] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:16.839412 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d2f67d7a-02c1-4fd8-b8c9-48ebca2702d2 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:16.839905 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d2f67d7a-02c1-4fd8-b8c9-48ebca2702d2 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:16.840350 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d2f67d7a-02c1-4fd8-b8c9-48ebca2702d2 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:16.841065 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d2f67d7a-02c1-4fd8-b8c9-48ebca2702d2 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:16.841549 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d2f67d7a-02c1-4fd8-b8c9-48ebca2702d2 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:16.841978 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d2f67d7a-02c1-4fd8-b8c9-48ebca2702d2 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:16.992223 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-d2f67d7a-02c1-4fd8-b8c9-48ebca2702d2 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:17.003337 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-d2f67d7a-02c1-4fd8-b8c9-48ebca2702d2 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:17.004909 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-d2f67d7a-02c1-4fd8-b8c9-48ebca2702d2 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:17.006140 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-d2f67d7a-02c1-4fd8-b8c9-48ebca2702d2 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] 10.222.0.43 "GET /compute/v2.1/servers/101952eb-ca4d-489c-8cb5-3bfadf241aa3" status: 200 len: 1752 microversion: 2.20 time: 0.180506 Oct 04 19:07:17.006774 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2873/6114] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:07:16 2022] GET /compute/v2.1/servers/101952eb-ca4d-489c-8cb5-3bfadf241aa3 => generated 1752 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 19:07:17.824085 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-da7067a3-5739-4008-8c47-1ae26562c3ee tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:17.824799 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-da7067a3-5739-4008-8c47-1ae26562c3ee tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] [instance: 8c95f5b8-35dd-4d5e-9ca6-a023614dd859] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:17.831612 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-da7067a3-5739-4008-8c47-1ae26562c3ee tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:17.832191 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-da7067a3-5739-4008-8c47-1ae26562c3ee tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:17.832711 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-da7067a3-5739-4008-8c47-1ae26562c3ee tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:17.833553 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-da7067a3-5739-4008-8c47-1ae26562c3ee tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:17.834090 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-da7067a3-5739-4008-8c47-1ae26562c3ee tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:17.834634 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-da7067a3-5739-4008-8c47-1ae26562c3ee tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:17.838975 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=92,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=3,nova_cell1:RELEASE=1,nova_cell1:DELETE=2,nova_cell1:UPDATE=1 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:07:17.903346 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-da7067a3-5739-4008-8c47-1ae26562c3ee tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4797a0a06faf431cb97448684460f58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b18ccd11a84c7888bc34e94320cb45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:17.911964 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-da7067a3-5739-4008-8c47-1ae26562c3ee tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4797a0a06faf431cb97448684460f58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b18ccd11a84c7888bc34e94320cb45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:17.914005 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-da7067a3-5739-4008-8c47-1ae26562c3ee tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4797a0a06faf431cb97448684460f58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b18ccd11a84c7888bc34e94320cb45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:17.915310 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-da7067a3-5739-4008-8c47-1ae26562c3ee tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] 10.222.0.43 "GET /compute/v2.1/servers/8c95f5b8-35dd-4d5e-9ca6-a023614dd859" status: 200 len: 1336 microversion: 2.47 time: 0.095286 Oct 04 19:07:17.916106 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3242/6115] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:07:17 2022] GET /compute/v2.1/servers/8c95f5b8-35dd-4d5e-9ca6-a023614dd859 => generated 1336 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:07:18.033184 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-d75b3f5e-cbf5-476b-a422-c3873c451986 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:18.034169 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-d75b3f5e-cbf5-476b-a422-c3873c451986 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] [instance: 101952eb-ca4d-489c-8cb5-3bfadf241aa3] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:18.045231 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d75b3f5e-cbf5-476b-a422-c3873c451986 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:18.045795 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d75b3f5e-cbf5-476b-a422-c3873c451986 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:18.047462 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d75b3f5e-cbf5-476b-a422-c3873c451986 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:18.048584 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d75b3f5e-cbf5-476b-a422-c3873c451986 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:18.049299 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d75b3f5e-cbf5-476b-a422-c3873c451986 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:18.051243 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d75b3f5e-cbf5-476b-a422-c3873c451986 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:18.203725 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-d75b3f5e-cbf5-476b-a422-c3873c451986 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:18.212708 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-d75b3f5e-cbf5-476b-a422-c3873c451986 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:18.214561 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-d75b3f5e-cbf5-476b-a422-c3873c451986 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:18.215957 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-d75b3f5e-cbf5-476b-a422-c3873c451986 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] 10.222.0.43 "GET /compute/v2.1/servers/101952eb-ca4d-489c-8cb5-3bfadf241aa3" status: 200 len: 1752 microversion: 2.20 time: 0.186864 Oct 04 19:07:18.216902 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2874/6116] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:07:18 2022] GET /compute/v2.1/servers/101952eb-ca4d-489c-8cb5-3bfadf241aa3 => generated 1752 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:07:18.942500 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-ae11a419-362a-489c-8bb7-c23a07b85726 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:18.943097 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-ae11a419-362a-489c-8bb7-c23a07b85726 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] [instance: 8c95f5b8-35dd-4d5e-9ca6-a023614dd859] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:18.951156 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ae11a419-362a-489c-8bb7-c23a07b85726 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:18.951658 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ae11a419-362a-489c-8bb7-c23a07b85726 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:18.952106 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ae11a419-362a-489c-8bb7-c23a07b85726 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:18.952826 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ae11a419-362a-489c-8bb7-c23a07b85726 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:18.953310 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ae11a419-362a-489c-8bb7-c23a07b85726 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:18.953755 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ae11a419-362a-489c-8bb7-c23a07b85726 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:19.021519 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-ae11a419-362a-489c-8bb7-c23a07b85726 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4797a0a06faf431cb97448684460f58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b18ccd11a84c7888bc34e94320cb45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:19.030074 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-ae11a419-362a-489c-8bb7-c23a07b85726 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4797a0a06faf431cb97448684460f58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b18ccd11a84c7888bc34e94320cb45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:19.032341 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-ae11a419-362a-489c-8bb7-c23a07b85726 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4797a0a06faf431cb97448684460f58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b18ccd11a84c7888bc34e94320cb45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:19.033170 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-ae11a419-362a-489c-8bb7-c23a07b85726 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] 10.222.0.43 "GET /compute/v2.1/servers/8c95f5b8-35dd-4d5e-9ca6-a023614dd859" status: 200 len: 1336 microversion: 2.47 time: 0.094975 Oct 04 19:07:19.033730 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3243/6117] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:07:18 2022] GET /compute/v2.1/servers/8c95f5b8-35dd-4d5e-9ca6-a023614dd859 => generated 1336 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:07:19.243131 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-985f54b0-3fd2-49c4-baa8-37b63063897c tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:19.243661 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-985f54b0-3fd2-49c4-baa8-37b63063897c tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] [instance: 101952eb-ca4d-489c-8cb5-3bfadf241aa3] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:19.250773 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-985f54b0-3fd2-49c4-baa8-37b63063897c tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:19.251256 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-985f54b0-3fd2-49c4-baa8-37b63063897c tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:19.251693 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-985f54b0-3fd2-49c4-baa8-37b63063897c tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:19.252387 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-985f54b0-3fd2-49c4-baa8-37b63063897c tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:19.252842 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-985f54b0-3fd2-49c4-baa8-37b63063897c tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:19.253311 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-985f54b0-3fd2-49c4-baa8-37b63063897c tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:19.388827 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-985f54b0-3fd2-49c4-baa8-37b63063897c tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:19.397937 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-985f54b0-3fd2-49c4-baa8-37b63063897c tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:19.399389 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-985f54b0-3fd2-49c4-baa8-37b63063897c tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:19.400574 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-985f54b0-3fd2-49c4-baa8-37b63063897c tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] 10.222.0.43 "GET /compute/v2.1/servers/101952eb-ca4d-489c-8cb5-3bfadf241aa3" status: 200 len: 1808 microversion: 2.20 time: 0.162196 Oct 04 19:07:19.401180 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2875/6118] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:07:19 2022] GET /compute/v2.1/servers/101952eb-ca4d-489c-8cb5-3bfadf241aa3 => generated 1808 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:07:19.439469 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-1bde5bc3-60cc-42e8-9b92-f7d9226d1f46 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:07:19.442021 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-1bde5bc3-60cc-42e8-9b92-f7d9226d1f46 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] [instance: b01e7e24-c866-4852-9fa8-568f69f68b27] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:19.448640 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1bde5bc3-60cc-42e8-9b92-f7d9226d1f46 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:19.449534 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1bde5bc3-60cc-42e8-9b92-f7d9226d1f46 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:19.450354 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1bde5bc3-60cc-42e8-9b92-f7d9226d1f46 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:19.451278 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1bde5bc3-60cc-42e8-9b92-f7d9226d1f46 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:19.452022 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1bde5bc3-60cc-42e8-9b92-f7d9226d1f46 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:19.452690 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1bde5bc3-60cc-42e8-9b92-f7d9226d1f46 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:19.528156 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-1bde5bc3-60cc-42e8-9b92-f7d9226d1f46 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] 10.222.0.43 "POST /compute/v2.1/servers/b01e7e24-c866-4852-9fa8-568f69f68b27/action" status: 200 len: 24568 microversion: 2.1 time: 0.094103 Oct 04 19:07:19.528739 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3244/6119] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 19:07:19 2022] POST /compute/v2.1/servers/b01e7e24-c866-4852-9fa8-568f69f68b27/action => generated 24568 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 19:07:20.059011 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-4ce82b02-22f5-4310-86f9-adcd880b1a95 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:20.059620 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-4ce82b02-22f5-4310-86f9-adcd880b1a95 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] [instance: 8c95f5b8-35dd-4d5e-9ca6-a023614dd859] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:20.066274 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4ce82b02-22f5-4310-86f9-adcd880b1a95 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:20.066762 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4ce82b02-22f5-4310-86f9-adcd880b1a95 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:20.067300 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4ce82b02-22f5-4310-86f9-adcd880b1a95 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:20.067964 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4ce82b02-22f5-4310-86f9-adcd880b1a95 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:20.068413 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4ce82b02-22f5-4310-86f9-adcd880b1a95 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:20.068838 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4ce82b02-22f5-4310-86f9-adcd880b1a95 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:20.153397 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-4ce82b02-22f5-4310-86f9-adcd880b1a95 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4797a0a06faf431cb97448684460f58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b18ccd11a84c7888bc34e94320cb45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:20.162147 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-4ce82b02-22f5-4310-86f9-adcd880b1a95 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4797a0a06faf431cb97448684460f58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b18ccd11a84c7888bc34e94320cb45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:20.163692 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-4ce82b02-22f5-4310-86f9-adcd880b1a95 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4797a0a06faf431cb97448684460f58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b18ccd11a84c7888bc34e94320cb45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:20.165077 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-4ce82b02-22f5-4310-86f9-adcd880b1a95 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] 10.222.0.43 "GET /compute/v2.1/servers/8c95f5b8-35dd-4d5e-9ca6-a023614dd859" status: 200 len: 1336 microversion: 2.47 time: 0.109839 Oct 04 19:07:20.166231 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2876/6120] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:07:20 2022] GET /compute/v2.1/servers/8c95f5b8-35dd-4d5e-9ca6-a023614dd859 => generated 1336 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:07:20.427545 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f874b712-208c-449c-8981-d019225c6da9 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:20.429288 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-f874b712-208c-449c-8981-d019225c6da9 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] [instance: 101952eb-ca4d-489c-8cb5-3bfadf241aa3] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:20.438083 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f874b712-208c-449c-8981-d019225c6da9 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:20.438613 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f874b712-208c-449c-8981-d019225c6da9 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:20.439580 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f874b712-208c-449c-8981-d019225c6da9 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:20.439935 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f874b712-208c-449c-8981-d019225c6da9 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:20.440394 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f874b712-208c-449c-8981-d019225c6da9 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:20.441016 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f874b712-208c-449c-8981-d019225c6da9 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:20.601862 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-f874b712-208c-449c-8981-d019225c6da9 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:20.614096 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-f874b712-208c-449c-8981-d019225c6da9 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:20.615636 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-f874b712-208c-449c-8981-d019225c6da9 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:20.618067 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-f874b712-208c-449c-8981-d019225c6da9 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] 10.222.0.43 "GET /compute/v2.1/servers/101952eb-ca4d-489c-8cb5-3bfadf241aa3" status: 200 len: 1808 microversion: 2.20 time: 0.194700 Oct 04 19:07:20.618827 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3245/6121] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:07:20 2022] GET /compute/v2.1/servers/101952eb-ca4d-489c-8cb5-3bfadf241aa3 => generated 1808 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:07:21.191218 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-a5f62cbf-b6e0-484a-9a3c-ed14a20a6eb3 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:21.192069 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-a5f62cbf-b6e0-484a-9a3c-ed14a20a6eb3 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] [instance: 8c95f5b8-35dd-4d5e-9ca6-a023614dd859] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:21.200170 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a5f62cbf-b6e0-484a-9a3c-ed14a20a6eb3 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:21.200810 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a5f62cbf-b6e0-484a-9a3c-ed14a20a6eb3 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:21.201284 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a5f62cbf-b6e0-484a-9a3c-ed14a20a6eb3 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:21.202231 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a5f62cbf-b6e0-484a-9a3c-ed14a20a6eb3 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:21.202900 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a5f62cbf-b6e0-484a-9a3c-ed14a20a6eb3 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:21.203288 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a5f62cbf-b6e0-484a-9a3c-ed14a20a6eb3 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:21.285968 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-a5f62cbf-b6e0-484a-9a3c-ed14a20a6eb3 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4797a0a06faf431cb97448684460f58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b18ccd11a84c7888bc34e94320cb45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:21.301612 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-a5f62cbf-b6e0-484a-9a3c-ed14a20a6eb3 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4797a0a06faf431cb97448684460f58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b18ccd11a84c7888bc34e94320cb45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:21.303794 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-a5f62cbf-b6e0-484a-9a3c-ed14a20a6eb3 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4797a0a06faf431cb97448684460f58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b18ccd11a84c7888bc34e94320cb45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:21.305439 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-a5f62cbf-b6e0-484a-9a3c-ed14a20a6eb3 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] 10.222.0.43 "GET /compute/v2.1/servers/8c95f5b8-35dd-4d5e-9ca6-a023614dd859" status: 200 len: 1357 microversion: 2.47 time: 0.118149 Oct 04 19:07:21.306423 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2877/6122] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:07:21 2022] GET /compute/v2.1/servers/8c95f5b8-35dd-4d5e-9ca6-a023614dd859 => generated 1357 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:07:21.342263 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-1fd4b4f1-7f81-4a75-ae77-ee330ace8246 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243"}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:07:21.345274 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-1fd4b4f1-7f81-4a75-ae77-ee330ace8246 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] [instance: 8c95f5b8-35dd-4d5e-9ca6-a023614dd859] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:21.354078 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1fd4b4f1-7f81-4a75-ae77-ee330ace8246 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:21.354952 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1fd4b4f1-7f81-4a75-ae77-ee330ace8246 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:21.355593 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1fd4b4f1-7f81-4a75-ae77-ee330ace8246 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:21.356614 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1fd4b4f1-7f81-4a75-ae77-ee330ace8246 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:21.357403 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1fd4b4f1-7f81-4a75-ae77-ee330ace8246 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:21.358291 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1fd4b4f1-7f81-4a75-ae77-ee330ace8246 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:21.507001 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-1fd4b4f1-7f81-4a75-ae77-ee330ace8246 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Flavor limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:07:21.507738 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-1fd4b4f1-7f81-4a75-ae77-ee330ace8246 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Image limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:07:21.507897 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-1fd4b4f1-7f81-4a75-ae77-ee330ace8246 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Flavor pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:07:21.508469 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-1fd4b4f1-7f81-4a75-ae77-ee330ace8246 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Image pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:07:21.509325 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-1fd4b4f1-7f81-4a75-ae77-ee330ace8246 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:07:21.602969 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-1fd4b4f1-7f81-4a75-ae77-ee330ace8246 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] [instance: 8c95f5b8-35dd-4d5e-9ca6-a023614dd859] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:21.612516 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1fd4b4f1-7f81-4a75-ae77-ee330ace8246 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:21.613681 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1fd4b4f1-7f81-4a75-ae77-ee330ace8246 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:21.614599 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1fd4b4f1-7f81-4a75-ae77-ee330ace8246 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:21.615519 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1fd4b4f1-7f81-4a75-ae77-ee330ace8246 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:21.616952 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1fd4b4f1-7f81-4a75-ae77-ee330ace8246 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:21.617691 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1fd4b4f1-7f81-4a75-ae77-ee330ace8246 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:21.644951 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-353ae4ea-b436-4b1c-afb6-3085f75d360e tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:21.645797 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-353ae4ea-b436-4b1c-afb6-3085f75d360e tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] [instance: 101952eb-ca4d-489c-8cb5-3bfadf241aa3] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:21.653906 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-353ae4ea-b436-4b1c-afb6-3085f75d360e tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:21.654384 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-353ae4ea-b436-4b1c-afb6-3085f75d360e tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:21.654836 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-353ae4ea-b436-4b1c-afb6-3085f75d360e tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:21.655553 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-353ae4ea-b436-4b1c-afb6-3085f75d360e tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:21.656007 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-353ae4ea-b436-4b1c-afb6-3085f75d360e tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:21.656439 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-353ae4ea-b436-4b1c-afb6-3085f75d360e tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:21.680113 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-1fd4b4f1-7f81-4a75-ae77-ee330ace8246 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] 10.222.0.43 "POST /compute/v2.1/servers/8c95f5b8-35dd-4d5e-9ca6-a023614dd859/action" status: 202 len: 1079 microversion: 2.47 time: 0.342618 Oct 04 19:07:21.680748 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3246/6123] 10.222.0.43 () {62 vars in 1319 bytes} [Tue Oct 4 19:07:21 2022] POST /compute/v2.1/servers/8c95f5b8-35dd-4d5e-9ca6-a023614dd859/action => generated 1079 bytes in 344 msecs (HTTP/1.1 202) 10 headers in 454 bytes (2 switches on core 0) Oct 04 19:07:21.711118 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-1d937ae7-5244-4137-a8f9-9a5c68a65b91 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:21.712038 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-1d937ae7-5244-4137-a8f9-9a5c68a65b91 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] [instance: 8c95f5b8-35dd-4d5e-9ca6-a023614dd859] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:21.721960 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1d937ae7-5244-4137-a8f9-9a5c68a65b91 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:21.722463 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1d937ae7-5244-4137-a8f9-9a5c68a65b91 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:21.722903 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1d937ae7-5244-4137-a8f9-9a5c68a65b91 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:21.723609 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1d937ae7-5244-4137-a8f9-9a5c68a65b91 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:21.724062 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1d937ae7-5244-4137-a8f9-9a5c68a65b91 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:21.724516 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1d937ae7-5244-4137-a8f9-9a5c68a65b91 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:21.817141 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-1d937ae7-5244-4137-a8f9-9a5c68a65b91 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4797a0a06faf431cb97448684460f58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b18ccd11a84c7888bc34e94320cb45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:21.837819 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-1d937ae7-5244-4137-a8f9-9a5c68a65b91 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4797a0a06faf431cb97448684460f58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b18ccd11a84c7888bc34e94320cb45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:21.839792 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-1d937ae7-5244-4137-a8f9-9a5c68a65b91 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4797a0a06faf431cb97448684460f58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b18ccd11a84c7888bc34e94320cb45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:21.842345 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-1d937ae7-5244-4137-a8f9-9a5c68a65b91 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] 10.222.0.43 "GET /compute/v2.1/servers/8c95f5b8-35dd-4d5e-9ca6-a023614dd859" status: 200 len: 1366 microversion: 2.47 time: 0.135593 Oct 04 19:07:21.843379 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3247/6124] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:07:21 2022] GET /compute/v2.1/servers/8c95f5b8-35dd-4d5e-9ca6-a023614dd859 => generated 1366 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 19:07:21.865777 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-353ae4ea-b436-4b1c-afb6-3085f75d360e tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:21.877897 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-353ae4ea-b436-4b1c-afb6-3085f75d360e tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:21.879987 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-353ae4ea-b436-4b1c-afb6-3085f75d360e tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:21.882347 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-353ae4ea-b436-4b1c-afb6-3085f75d360e tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] 10.222.0.43 "GET /compute/v2.1/servers/101952eb-ca4d-489c-8cb5-3bfadf241aa3" status: 200 len: 1808 microversion: 2.20 time: 0.240566 Oct 04 19:07:21.893790 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2878/6125] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:07:21 2022] GET /compute/v2.1/servers/101952eb-ca4d-489c-8cb5-3bfadf241aa3 => generated 1808 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 19:07:22.872071 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-8d08bdf2-9275-4276-8722-e8931994a0b3 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:22.873534 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-8d08bdf2-9275-4276-8722-e8931994a0b3 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] [instance: 8c95f5b8-35dd-4d5e-9ca6-a023614dd859] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:22.881413 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8d08bdf2-9275-4276-8722-e8931994a0b3 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:22.882314 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8d08bdf2-9275-4276-8722-e8931994a0b3 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:22.882986 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8d08bdf2-9275-4276-8722-e8931994a0b3 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:22.883979 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8d08bdf2-9275-4276-8722-e8931994a0b3 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:22.884646 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8d08bdf2-9275-4276-8722-e8931994a0b3 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:22.885340 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8d08bdf2-9275-4276-8722-e8931994a0b3 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:22.916329 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-890f3cac-781d-4ca0-991e-5cce3ac27fb7 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:22.917276 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-890f3cac-781d-4ca0-991e-5cce3ac27fb7 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] [instance: 101952eb-ca4d-489c-8cb5-3bfadf241aa3] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:22.929765 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-890f3cac-781d-4ca0-991e-5cce3ac27fb7 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:22.930414 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-890f3cac-781d-4ca0-991e-5cce3ac27fb7 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:22.930961 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-890f3cac-781d-4ca0-991e-5cce3ac27fb7 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:22.931865 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-890f3cac-781d-4ca0-991e-5cce3ac27fb7 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:22.932564 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-890f3cac-781d-4ca0-991e-5cce3ac27fb7 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:22.933245 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-890f3cac-781d-4ca0-991e-5cce3ac27fb7 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:22.980453 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-8d08bdf2-9275-4276-8722-e8931994a0b3 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4797a0a06faf431cb97448684460f58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b18ccd11a84c7888bc34e94320cb45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:22.998263 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-8d08bdf2-9275-4276-8722-e8931994a0b3 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4797a0a06faf431cb97448684460f58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b18ccd11a84c7888bc34e94320cb45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:23.002344 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-8d08bdf2-9275-4276-8722-e8931994a0b3 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4797a0a06faf431cb97448684460f58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b18ccd11a84c7888bc34e94320cb45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:23.012239 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-8d08bdf2-9275-4276-8722-e8931994a0b3 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] 10.222.0.43 "GET /compute/v2.1/servers/8c95f5b8-35dd-4d5e-9ca6-a023614dd859" status: 200 len: 1366 microversion: 2.47 time: 0.144692 Oct 04 19:07:23.013554 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3248/6126] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:07:22 2022] GET /compute/v2.1/servers/8c95f5b8-35dd-4d5e-9ca6-a023614dd859 => generated 1366 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:07:23.162301 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-890f3cac-781d-4ca0-991e-5cce3ac27fb7 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:23.171223 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-890f3cac-781d-4ca0-991e-5cce3ac27fb7 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:23.172709 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-890f3cac-781d-4ca0-991e-5cce3ac27fb7 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:23.174103 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-890f3cac-781d-4ca0-991e-5cce3ac27fb7 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] 10.222.0.43 "GET /compute/v2.1/servers/101952eb-ca4d-489c-8cb5-3bfadf241aa3" status: 200 len: 1808 microversion: 2.20 time: 0.267263 Oct 04 19:07:23.174963 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2879/6127] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:07:22 2022] GET /compute/v2.1/servers/101952eb-ca4d-489c-8cb5-3bfadf241aa3 => generated 1808 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 19:07:24.044706 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-54156c7c-1e34-4883-8e88-f84008ef9b13 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:24.045380 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-54156c7c-1e34-4883-8e88-f84008ef9b13 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] [instance: 8c95f5b8-35dd-4d5e-9ca6-a023614dd859] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:24.049152 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:07:24.054340 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-54156c7c-1e34-4883-8e88-f84008ef9b13 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:24.054963 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-54156c7c-1e34-4883-8e88-f84008ef9b13 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:24.055417 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-54156c7c-1e34-4883-8e88-f84008ef9b13 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:24.056139 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-54156c7c-1e34-4883-8e88-f84008ef9b13 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:24.056598 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-54156c7c-1e34-4883-8e88-f84008ef9b13 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:24.057255 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-54156c7c-1e34-4883-8e88-f84008ef9b13 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:24.166867 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-54156c7c-1e34-4883-8e88-f84008ef9b13 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4797a0a06faf431cb97448684460f58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b18ccd11a84c7888bc34e94320cb45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:24.178963 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-54156c7c-1e34-4883-8e88-f84008ef9b13 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4797a0a06faf431cb97448684460f58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b18ccd11a84c7888bc34e94320cb45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:24.181091 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-54156c7c-1e34-4883-8e88-f84008ef9b13 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4797a0a06faf431cb97448684460f58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b18ccd11a84c7888bc34e94320cb45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:24.182874 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-54156c7c-1e34-4883-8e88-f84008ef9b13 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] 10.222.0.43 "GET /compute/v2.1/servers/8c95f5b8-35dd-4d5e-9ca6-a023614dd859" status: 200 len: 1366 microversion: 2.47 time: 0.143418 Oct 04 19:07:24.184110 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3249/6128] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:07:24 2022] GET /compute/v2.1/servers/8c95f5b8-35dd-4d5e-9ca6-a023614dd859 => generated 1366 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:07:24.227717 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-7317d5bc-28ce-4e84-a726-90f9a75aa3a3 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:24.240176 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-7317d5bc-28ce-4e84-a726-90f9a75aa3a3 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] [instance: 101952eb-ca4d-489c-8cb5-3bfadf241aa3] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:24.247724 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7317d5bc-28ce-4e84-a726-90f9a75aa3a3 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:24.248214 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7317d5bc-28ce-4e84-a726-90f9a75aa3a3 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:24.248657 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7317d5bc-28ce-4e84-a726-90f9a75aa3a3 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:24.249561 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7317d5bc-28ce-4e84-a726-90f9a75aa3a3 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:24.250021 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7317d5bc-28ce-4e84-a726-90f9a75aa3a3 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:24.250441 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7317d5bc-28ce-4e84-a726-90f9a75aa3a3 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:24.449861 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-7317d5bc-28ce-4e84-a726-90f9a75aa3a3 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:24.459024 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-7317d5bc-28ce-4e84-a726-90f9a75aa3a3 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:24.461480 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-7317d5bc-28ce-4e84-a726-90f9a75aa3a3 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:24.462919 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-7317d5bc-28ce-4e84-a726-90f9a75aa3a3 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] 10.222.0.43 "GET /compute/v2.1/servers/101952eb-ca4d-489c-8cb5-3bfadf241aa3" status: 200 len: 1808 microversion: 2.20 time: 0.239263 Oct 04 19:07:24.472734 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2880/6129] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:07:24 2022] GET /compute/v2.1/servers/101952eb-ca4d-489c-8cb5-3bfadf241aa3 => generated 1808 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:07:25.222410 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-79026b77-5b5a-4d90-b878-af5fa63f258f tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:25.223075 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-79026b77-5b5a-4d90-b878-af5fa63f258f tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] [instance: 8c95f5b8-35dd-4d5e-9ca6-a023614dd859] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:25.231051 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-79026b77-5b5a-4d90-b878-af5fa63f258f tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:25.231553 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-79026b77-5b5a-4d90-b878-af5fa63f258f tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:25.232000 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-79026b77-5b5a-4d90-b878-af5fa63f258f tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:25.232713 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-79026b77-5b5a-4d90-b878-af5fa63f258f tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:25.233259 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-79026b77-5b5a-4d90-b878-af5fa63f258f tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:25.233987 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-79026b77-5b5a-4d90-b878-af5fa63f258f tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:25.302547 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-79026b77-5b5a-4d90-b878-af5fa63f258f tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4797a0a06faf431cb97448684460f58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b18ccd11a84c7888bc34e94320cb45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:25.313467 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-79026b77-5b5a-4d90-b878-af5fa63f258f tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4797a0a06faf431cb97448684460f58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b18ccd11a84c7888bc34e94320cb45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:25.315481 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-79026b77-5b5a-4d90-b878-af5fa63f258f tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4797a0a06faf431cb97448684460f58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b18ccd11a84c7888bc34e94320cb45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:25.317633 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-79026b77-5b5a-4d90-b878-af5fa63f258f tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] 10.222.0.43 "GET /compute/v2.1/servers/8c95f5b8-35dd-4d5e-9ca6-a023614dd859" status: 200 len: 1366 microversion: 2.47 time: 0.100307 Oct 04 19:07:25.318568 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3250/6130] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:07:25 2022] GET /compute/v2.1/servers/8c95f5b8-35dd-4d5e-9ca6-a023614dd859 => generated 1366 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:07:25.488996 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-7e226f37-cf0c-4397-96db-f5984a305357 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:25.490228 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-7e226f37-cf0c-4397-96db-f5984a305357 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] [instance: 101952eb-ca4d-489c-8cb5-3bfadf241aa3] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:25.493234 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=4 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:07:25.493911 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=12 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:07:25.500244 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7e226f37-cf0c-4397-96db-f5984a305357 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:25.500733 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7e226f37-cf0c-4397-96db-f5984a305357 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:25.501192 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7e226f37-cf0c-4397-96db-f5984a305357 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:25.501896 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7e226f37-cf0c-4397-96db-f5984a305357 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:25.502349 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7e226f37-cf0c-4397-96db-f5984a305357 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:25.502775 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7e226f37-cf0c-4397-96db-f5984a305357 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:25.668230 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-7e226f37-cf0c-4397-96db-f5984a305357 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:25.685432 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-7e226f37-cf0c-4397-96db-f5984a305357 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:25.696315 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-7e226f37-cf0c-4397-96db-f5984a305357 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:25.698060 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-7e226f37-cf0c-4397-96db-f5984a305357 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] 10.222.0.43 "GET /compute/v2.1/servers/101952eb-ca4d-489c-8cb5-3bfadf241aa3" status: 200 len: 1808 microversion: 2.20 time: 0.213125 Oct 04 19:07:25.699164 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2881/6131] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:07:25 2022] GET /compute/v2.1/servers/101952eb-ca4d-489c-8cb5-3bfadf241aa3 => generated 1808 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:07:26.344899 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-0e6376cc-9e87-478e-8348-fbe08ced31c7 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:26.346327 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-0e6376cc-9e87-478e-8348-fbe08ced31c7 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] [instance: 8c95f5b8-35dd-4d5e-9ca6-a023614dd859] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:26.348810 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=4 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:07:26.360937 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0e6376cc-9e87-478e-8348-fbe08ced31c7 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:26.361831 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0e6376cc-9e87-478e-8348-fbe08ced31c7 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:26.362519 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0e6376cc-9e87-478e-8348-fbe08ced31c7 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:26.363958 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0e6376cc-9e87-478e-8348-fbe08ced31c7 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:26.364914 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0e6376cc-9e87-478e-8348-fbe08ced31c7 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:26.365739 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0e6376cc-9e87-478e-8348-fbe08ced31c7 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:26.458679 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-0e6376cc-9e87-478e-8348-fbe08ced31c7 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4797a0a06faf431cb97448684460f58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b18ccd11a84c7888bc34e94320cb45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:26.468493 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-0e6376cc-9e87-478e-8348-fbe08ced31c7 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4797a0a06faf431cb97448684460f58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b18ccd11a84c7888bc34e94320cb45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:26.470147 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-0e6376cc-9e87-478e-8348-fbe08ced31c7 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4797a0a06faf431cb97448684460f58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b18ccd11a84c7888bc34e94320cb45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:26.471382 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-0e6376cc-9e87-478e-8348-fbe08ced31c7 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] 10.222.0.43 "GET /compute/v2.1/servers/8c95f5b8-35dd-4d5e-9ca6-a023614dd859" status: 200 len: 1366 microversion: 2.47 time: 0.131334 Oct 04 19:07:26.472524 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3251/6132] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:07:26 2022] GET /compute/v2.1/servers/8c95f5b8-35dd-4d5e-9ca6-a023614dd859 => generated 1366 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:07:26.726769 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-2bff54ae-525b-47e7-ba34-cf64a5cee72b tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:26.727296 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-2bff54ae-525b-47e7-ba34-cf64a5cee72b tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] [instance: 101952eb-ca4d-489c-8cb5-3bfadf241aa3] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:26.734800 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2bff54ae-525b-47e7-ba34-cf64a5cee72b tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:26.735662 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2bff54ae-525b-47e7-ba34-cf64a5cee72b tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:26.736351 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2bff54ae-525b-47e7-ba34-cf64a5cee72b tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:26.737344 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2bff54ae-525b-47e7-ba34-cf64a5cee72b tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:26.738044 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2bff54ae-525b-47e7-ba34-cf64a5cee72b tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:26.738690 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2bff54ae-525b-47e7-ba34-cf64a5cee72b tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:26.742490 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:07:26.910901 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-2bff54ae-525b-47e7-ba34-cf64a5cee72b tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:26.920342 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-2bff54ae-525b-47e7-ba34-cf64a5cee72b tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:26.922866 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-2bff54ae-525b-47e7-ba34-cf64a5cee72b tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:26.924403 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-2bff54ae-525b-47e7-ba34-cf64a5cee72b tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] 10.222.0.43 "GET /compute/v2.1/servers/101952eb-ca4d-489c-8cb5-3bfadf241aa3" status: 200 len: 1808 microversion: 2.20 time: 0.201708 Oct 04 19:07:26.925304 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2882/6133] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:07:26 2022] GET /compute/v2.1/servers/101952eb-ca4d-489c-8cb5-3bfadf241aa3 => generated 1808 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:07:27.504039 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-240afa0e-138e-444f-a488-1443cf07bf14 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:27.504673 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-240afa0e-138e-444f-a488-1443cf07bf14 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] [instance: 8c95f5b8-35dd-4d5e-9ca6-a023614dd859] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:27.512077 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-240afa0e-138e-444f-a488-1443cf07bf14 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:27.512893 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-240afa0e-138e-444f-a488-1443cf07bf14 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:27.513594 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-240afa0e-138e-444f-a488-1443cf07bf14 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:27.514535 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-240afa0e-138e-444f-a488-1443cf07bf14 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:27.515206 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-240afa0e-138e-444f-a488-1443cf07bf14 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:27.515851 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-240afa0e-138e-444f-a488-1443cf07bf14 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:27.587045 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-240afa0e-138e-444f-a488-1443cf07bf14 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4797a0a06faf431cb97448684460f58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b18ccd11a84c7888bc34e94320cb45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:27.595309 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-240afa0e-138e-444f-a488-1443cf07bf14 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4797a0a06faf431cb97448684460f58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b18ccd11a84c7888bc34e94320cb45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:27.596732 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-240afa0e-138e-444f-a488-1443cf07bf14 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4797a0a06faf431cb97448684460f58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b18ccd11a84c7888bc34e94320cb45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:27.597940 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-240afa0e-138e-444f-a488-1443cf07bf14 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] 10.222.0.43 "GET /compute/v2.1/servers/8c95f5b8-35dd-4d5e-9ca6-a023614dd859" status: 200 len: 1366 microversion: 2.47 time: 0.099086 Oct 04 19:07:27.598503 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3252/6134] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:07:27 2022] GET /compute/v2.1/servers/8c95f5b8-35dd-4d5e-9ca6-a023614dd859 => generated 1366 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:07:27.954424 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-ea487647-435e-44ac-ab15-af84bc75d487 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:27.955576 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-ea487647-435e-44ac-ab15-af84bc75d487 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] [instance: 101952eb-ca4d-489c-8cb5-3bfadf241aa3] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:27.970192 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ea487647-435e-44ac-ab15-af84bc75d487 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:27.970837 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ea487647-435e-44ac-ab15-af84bc75d487 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:27.971443 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ea487647-435e-44ac-ab15-af84bc75d487 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:27.972385 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ea487647-435e-44ac-ab15-af84bc75d487 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:27.972913 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ea487647-435e-44ac-ab15-af84bc75d487 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:27.973506 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ea487647-435e-44ac-ab15-af84bc75d487 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:28.164604 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-ea487647-435e-44ac-ab15-af84bc75d487 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:28.168405 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-ea487647-435e-44ac-ab15-af84bc75d487 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:28.169922 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-ea487647-435e-44ac-ab15-af84bc75d487 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:28.171123 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-ea487647-435e-44ac-ab15-af84bc75d487 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] 10.222.0.43 "GET /compute/v2.1/servers/101952eb-ca4d-489c-8cb5-3bfadf241aa3" status: 200 len: 1808 microversion: 2.20 time: 0.222242 Oct 04 19:07:28.171958 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2883/6135] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:07:27 2022] GET /compute/v2.1/servers/101952eb-ca4d-489c-8cb5-3bfadf241aa3 => generated 1808 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:07:28.624830 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-2c5ec012-7e49-4c04-9e09-e85cdc680546 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:28.625753 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-2c5ec012-7e49-4c04-9e09-e85cdc680546 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] [instance: 8c95f5b8-35dd-4d5e-9ca6-a023614dd859] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:28.632917 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2c5ec012-7e49-4c04-9e09-e85cdc680546 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:28.633437 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2c5ec012-7e49-4c04-9e09-e85cdc680546 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:28.633876 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2c5ec012-7e49-4c04-9e09-e85cdc680546 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:28.634573 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2c5ec012-7e49-4c04-9e09-e85cdc680546 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:28.635025 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2c5ec012-7e49-4c04-9e09-e85cdc680546 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:28.635612 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2c5ec012-7e49-4c04-9e09-e85cdc680546 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:28.701661 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-2c5ec012-7e49-4c04-9e09-e85cdc680546 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4797a0a06faf431cb97448684460f58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b18ccd11a84c7888bc34e94320cb45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:28.709939 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-2c5ec012-7e49-4c04-9e09-e85cdc680546 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4797a0a06faf431cb97448684460f58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b18ccd11a84c7888bc34e94320cb45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:28.711376 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-2c5ec012-7e49-4c04-9e09-e85cdc680546 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4797a0a06faf431cb97448684460f58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b18ccd11a84c7888bc34e94320cb45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:28.712535 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-2c5ec012-7e49-4c04-9e09-e85cdc680546 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] 10.222.0.43 "GET /compute/v2.1/servers/8c95f5b8-35dd-4d5e-9ca6-a023614dd859" status: 200 len: 1366 microversion: 2.47 time: 0.091746 Oct 04 19:07:28.713093 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3253/6136] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:07:28 2022] GET /compute/v2.1/servers/8c95f5b8-35dd-4d5e-9ca6-a023614dd859 => generated 1366 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:07:29.198034 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-dc13a4c9-cabe-4bd6-87d6-fc622f79be1b tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:29.199044 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-dc13a4c9-cabe-4bd6-87d6-fc622f79be1b tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] [instance: 101952eb-ca4d-489c-8cb5-3bfadf241aa3] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:29.207031 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dc13a4c9-cabe-4bd6-87d6-fc622f79be1b tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:29.208182 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dc13a4c9-cabe-4bd6-87d6-fc622f79be1b tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:29.209244 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dc13a4c9-cabe-4bd6-87d6-fc622f79be1b tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:29.211110 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dc13a4c9-cabe-4bd6-87d6-fc622f79be1b tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:29.211907 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dc13a4c9-cabe-4bd6-87d6-fc622f79be1b tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:29.212668 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dc13a4c9-cabe-4bd6-87d6-fc622f79be1b tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:29.353492 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-dc13a4c9-cabe-4bd6-87d6-fc622f79be1b tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:29.362317 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-dc13a4c9-cabe-4bd6-87d6-fc622f79be1b tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:29.363780 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-dc13a4c9-cabe-4bd6-87d6-fc622f79be1b tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:29.364987 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-dc13a4c9-cabe-4bd6-87d6-fc622f79be1b tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] 10.222.0.43 "GET /compute/v2.1/servers/101952eb-ca4d-489c-8cb5-3bfadf241aa3" status: 200 len: 1808 microversion: 2.20 time: 0.172745 Oct 04 19:07:29.365602 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2884/6137] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:07:29 2022] GET /compute/v2.1/servers/101952eb-ca4d-489c-8cb5-3bfadf241aa3 => generated 1808 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:07:29.738373 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-50b8f7c8-1aac-4ace-9a6b-e548c36d426b tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:29.739037 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-50b8f7c8-1aac-4ace-9a6b-e548c36d426b tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] [instance: 8c95f5b8-35dd-4d5e-9ca6-a023614dd859] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:29.746565 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-50b8f7c8-1aac-4ace-9a6b-e548c36d426b tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:29.747061 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-50b8f7c8-1aac-4ace-9a6b-e548c36d426b tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:29.747501 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-50b8f7c8-1aac-4ace-9a6b-e548c36d426b tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:29.748212 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-50b8f7c8-1aac-4ace-9a6b-e548c36d426b tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:29.748672 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-50b8f7c8-1aac-4ace-9a6b-e548c36d426b tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:29.749099 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-50b8f7c8-1aac-4ace-9a6b-e548c36d426b tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:29.816274 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-50b8f7c8-1aac-4ace-9a6b-e548c36d426b tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4797a0a06faf431cb97448684460f58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b18ccd11a84c7888bc34e94320cb45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:29.825467 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-50b8f7c8-1aac-4ace-9a6b-e548c36d426b tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4797a0a06faf431cb97448684460f58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b18ccd11a84c7888bc34e94320cb45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:29.826906 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-50b8f7c8-1aac-4ace-9a6b-e548c36d426b tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4797a0a06faf431cb97448684460f58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b18ccd11a84c7888bc34e94320cb45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:29.828068 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-50b8f7c8-1aac-4ace-9a6b-e548c36d426b tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] 10.222.0.43 "GET /compute/v2.1/servers/8c95f5b8-35dd-4d5e-9ca6-a023614dd859" status: 200 len: 1366 microversion: 2.47 time: 0.093680 Oct 04 19:07:29.828628 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3254/6138] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:07:29 2022] GET /compute/v2.1/servers/8c95f5b8-35dd-4d5e-9ca6-a023614dd859 => generated 1366 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:07:30.394663 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-7d313472-31b9-4b8a-897d-06e92044fbe9 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:30.395813 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-7d313472-31b9-4b8a-897d-06e92044fbe9 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] [instance: 101952eb-ca4d-489c-8cb5-3bfadf241aa3] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:30.415105 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7d313472-31b9-4b8a-897d-06e92044fbe9 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:30.415597 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7d313472-31b9-4b8a-897d-06e92044fbe9 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:30.416037 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7d313472-31b9-4b8a-897d-06e92044fbe9 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:30.416745 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7d313472-31b9-4b8a-897d-06e92044fbe9 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:30.417221 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7d313472-31b9-4b8a-897d-06e92044fbe9 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:30.417647 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7d313472-31b9-4b8a-897d-06e92044fbe9 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:30.587073 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-7d313472-31b9-4b8a-897d-06e92044fbe9 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:30.596958 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-7d313472-31b9-4b8a-897d-06e92044fbe9 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:30.598678 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-7d313472-31b9-4b8a-897d-06e92044fbe9 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:30.599076 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-bdf056a6-63e6-4320-97d6-f54d3dc66364 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:30.599698 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-bdf056a6-63e6-4320-97d6-f54d3dc66364 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] [instance: b01e7e24-c866-4852-9fa8-568f69f68b27] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:30.599924 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-7d313472-31b9-4b8a-897d-06e92044fbe9 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] 10.222.0.43 "GET /compute/v2.1/servers/101952eb-ca4d-489c-8cb5-3bfadf241aa3" status: 200 len: 1808 microversion: 2.20 time: 0.209362 Oct 04 19:07:30.601838 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2885/6139] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:07:30 2022] GET /compute/v2.1/servers/101952eb-ca4d-489c-8cb5-3bfadf241aa3 => generated 1808 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:07:30.606609 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bdf056a6-63e6-4320-97d6-f54d3dc66364 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:30.607113 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bdf056a6-63e6-4320-97d6-f54d3dc66364 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:30.607564 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bdf056a6-63e6-4320-97d6-f54d3dc66364 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:30.608276 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bdf056a6-63e6-4320-97d6-f54d3dc66364 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:30.608740 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bdf056a6-63e6-4320-97d6-f54d3dc66364 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:30.609201 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bdf056a6-63e6-4320-97d6-f54d3dc66364 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:30.755628 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-bdf056a6-63e6-4320-97d6-f54d3dc66364 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf87794979e844349d6ec6c6650565f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c25f1d17e94c74868357744e692487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:30.764204 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-bdf056a6-63e6-4320-97d6-f54d3dc66364 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] 10.222.0.43 "GET /compute/v2.1/servers/b01e7e24-c866-4852-9fa8-568f69f68b27" status: 200 len: 1684 microversion: 2.1 time: 0.168847 Oct 04 19:07:30.764802 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3255/6140] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:07:30 2022] GET /compute/v2.1/servers/b01e7e24-c866-4852-9fa8-568f69f68b27 => generated 1684 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:07:30.854435 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-3ea44286-8a80-48ec-80bf-0ca42a888d62 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:30.855634 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-3ea44286-8a80-48ec-80bf-0ca42a888d62 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] [instance: 8c95f5b8-35dd-4d5e-9ca6-a023614dd859] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:30.862514 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3ea44286-8a80-48ec-80bf-0ca42a888d62 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:30.863053 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3ea44286-8a80-48ec-80bf-0ca42a888d62 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:30.863662 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3ea44286-8a80-48ec-80bf-0ca42a888d62 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:30.869322 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3ea44286-8a80-48ec-80bf-0ca42a888d62 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:30.869322 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3ea44286-8a80-48ec-80bf-0ca42a888d62 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:30.869322 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3ea44286-8a80-48ec-80bf-0ca42a888d62 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:30.879401 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-6375e7d6-52a5-443e-a9d4-d801b588d3bb tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:07:30.882469 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-6375e7d6-52a5-443e-a9d4-d801b588d3bb tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] [instance: b01e7e24-c866-4852-9fa8-568f69f68b27] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:30.888465 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6375e7d6-52a5-443e-a9d4-d801b588d3bb tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:30.888965 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6375e7d6-52a5-443e-a9d4-d801b588d3bb tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:30.889448 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6375e7d6-52a5-443e-a9d4-d801b588d3bb tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:30.890156 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6375e7d6-52a5-443e-a9d4-d801b588d3bb tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:30.890771 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6375e7d6-52a5-443e-a9d4-d801b588d3bb tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:30.891207 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6375e7d6-52a5-443e-a9d4-d801b588d3bb tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:30.952216 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-3ea44286-8a80-48ec-80bf-0ca42a888d62 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4797a0a06faf431cb97448684460f58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b18ccd11a84c7888bc34e94320cb45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:30.958993 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-6375e7d6-52a5-443e-a9d4-d801b588d3bb tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] 10.222.0.43 "POST /compute/v2.1/servers/b01e7e24-c866-4852-9fa8-568f69f68b27/action" status: 200 len: 32641 microversion: 2.1 time: 0.086118 Oct 04 19:07:30.960401 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3256/6141] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 19:07:30 2022] POST /compute/v2.1/servers/b01e7e24-c866-4852-9fa8-568f69f68b27/action => generated 32641 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 19:07:30.963762 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-3ea44286-8a80-48ec-80bf-0ca42a888d62 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4797a0a06faf431cb97448684460f58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b18ccd11a84c7888bc34e94320cb45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:30.963937 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-3ea44286-8a80-48ec-80bf-0ca42a888d62 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4797a0a06faf431cb97448684460f58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b18ccd11a84c7888bc34e94320cb45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:30.965478 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-3ea44286-8a80-48ec-80bf-0ca42a888d62 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] 10.222.0.43 "GET /compute/v2.1/servers/8c95f5b8-35dd-4d5e-9ca6-a023614dd859" status: 200 len: 1366 microversion: 2.47 time: 0.115672 Oct 04 19:07:30.966221 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2886/6142] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:07:30 2022] GET /compute/v2.1/servers/8c95f5b8-35dd-4d5e-9ca6-a023614dd859 => generated 1366 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:07:31.130890 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-8ade77a6-31e1-4ec4-832d-e2070d0d7921 tempest-TestNetworkAdvancedServerOps-1915185768 tempest-TestNetworkAdvancedServerOps-1915185768-project-admin] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:31.132874 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-8ade77a6-31e1-4ec4-832d-e2070d0d7921 tempest-TestNetworkAdvancedServerOps-1915185768 tempest-TestNetworkAdvancedServerOps-1915185768-project-admin] [instance: b01e7e24-c866-4852-9fa8-568f69f68b27] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:31.140629 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8ade77a6-31e1-4ec4-832d-e2070d0d7921 tempest-TestNetworkAdvancedServerOps-1915185768 tempest-TestNetworkAdvancedServerOps-1915185768-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:31.141145 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8ade77a6-31e1-4ec4-832d-e2070d0d7921 tempest-TestNetworkAdvancedServerOps-1915185768 tempest-TestNetworkAdvancedServerOps-1915185768-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:31.141735 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8ade77a6-31e1-4ec4-832d-e2070d0d7921 tempest-TestNetworkAdvancedServerOps-1915185768 tempest-TestNetworkAdvancedServerOps-1915185768-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:31.142452 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8ade77a6-31e1-4ec4-832d-e2070d0d7921 tempest-TestNetworkAdvancedServerOps-1915185768 tempest-TestNetworkAdvancedServerOps-1915185768-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:31.142913 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8ade77a6-31e1-4ec4-832d-e2070d0d7921 tempest-TestNetworkAdvancedServerOps-1915185768 tempest-TestNetworkAdvancedServerOps-1915185768-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:31.143353 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8ade77a6-31e1-4ec4-832d-e2070d0d7921 tempest-TestNetworkAdvancedServerOps-1915185768 tempest-TestNetworkAdvancedServerOps-1915185768-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:31.164534 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:07:31.315084 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-8ade77a6-31e1-4ec4-832d-e2070d0d7921 tempest-TestNetworkAdvancedServerOps-1915185768 tempest-TestNetworkAdvancedServerOps-1915185768-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/b01e7e24-c866-4852-9fa8-568f69f68b27" status: 200 len: 1837 microversion: 2.1 time: 0.188372 Oct 04 19:07:31.316068 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3257/6143] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:07:31 2022] GET /compute/v2.1/servers/b01e7e24-c866-4852-9fa8-568f69f68b27 => generated 1837 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:07:31.345949 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-f029e119-5dc6-4a58-96d2-eee26b4b3c9b tempest-TestNetworkAdvancedServerOps-1915185768 tempest-TestNetworkAdvancedServerOps-1915185768-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": null, "block_migration": true, "disk_over_commit": false}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:07:31.348706 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-f029e119-5dc6-4a58-96d2-eee26b4b3c9b tempest-TestNetworkAdvancedServerOps-1915185768 tempest-TestNetworkAdvancedServerOps-1915185768-project-admin] [instance: b01e7e24-c866-4852-9fa8-568f69f68b27] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:31.355396 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f029e119-5dc6-4a58-96d2-eee26b4b3c9b tempest-TestNetworkAdvancedServerOps-1915185768 tempest-TestNetworkAdvancedServerOps-1915185768-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:31.355899 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f029e119-5dc6-4a58-96d2-eee26b4b3c9b tempest-TestNetworkAdvancedServerOps-1915185768 tempest-TestNetworkAdvancedServerOps-1915185768-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:31.356347 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f029e119-5dc6-4a58-96d2-eee26b4b3c9b tempest-TestNetworkAdvancedServerOps-1915185768 tempest-TestNetworkAdvancedServerOps-1915185768-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:31.357076 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f029e119-5dc6-4a58-96d2-eee26b4b3c9b tempest-TestNetworkAdvancedServerOps-1915185768 tempest-TestNetworkAdvancedServerOps-1915185768-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:31.357560 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f029e119-5dc6-4a58-96d2-eee26b4b3c9b tempest-TestNetworkAdvancedServerOps-1915185768 tempest-TestNetworkAdvancedServerOps-1915185768-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:31.357997 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f029e119-5dc6-4a58-96d2-eee26b4b3c9b tempest-TestNetworkAdvancedServerOps-1915185768 tempest-TestNetworkAdvancedServerOps-1915185768-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:31.385888 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.objects.instance [None req-f029e119-5dc6-4a58-96d2-eee26b4b3c9b tempest-TestNetworkAdvancedServerOps-1915185768 tempest-TestNetworkAdvancedServerOps-1915185768-project-admin] Lazy-loading 'flavor' on Instance uuid b01e7e24-c866-4852-9fa8-568f69f68b27 {{(pid=123595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 19:07:31.400425 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-f029e119-5dc6-4a58-96d2-eee26b4b3c9b tempest-TestNetworkAdvancedServerOps-1915185768 tempest-TestNetworkAdvancedServerOps-1915185768-project-admin] [instance: b01e7e24-c866-4852-9fa8-568f69f68b27] Going to try to live migrate instance to another host {{(pid=123595) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 04 19:07:31.632258 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-663004e2-599f-45bf-af14-c816e5cee2be tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:31.633145 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-663004e2-599f-45bf-af14-c816e5cee2be tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] [instance: 101952eb-ca4d-489c-8cb5-3bfadf241aa3] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:31.641087 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-663004e2-599f-45bf-af14-c816e5cee2be tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:31.642482 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-663004e2-599f-45bf-af14-c816e5cee2be tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:31.642937 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-663004e2-599f-45bf-af14-c816e5cee2be tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:31.647025 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-663004e2-599f-45bf-af14-c816e5cee2be tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:31.647787 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-663004e2-599f-45bf-af14-c816e5cee2be tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:31.648237 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-663004e2-599f-45bf-af14-c816e5cee2be tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:31.832092 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-663004e2-599f-45bf-af14-c816e5cee2be tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:31.842830 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-663004e2-599f-45bf-af14-c816e5cee2be tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:31.845382 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-663004e2-599f-45bf-af14-c816e5cee2be tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:31.846795 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-663004e2-599f-45bf-af14-c816e5cee2be tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] 10.222.0.43 "GET /compute/v2.1/servers/101952eb-ca4d-489c-8cb5-3bfadf241aa3" status: 200 len: 1808 microversion: 2.20 time: 0.220359 Oct 04 19:07:31.868325 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3258/6144] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:07:31 2022] GET /compute/v2.1/servers/101952eb-ca4d-489c-8cb5-3bfadf241aa3 => generated 1808 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:07:31.997837 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-faa3c635-7051-4249-b41e-aebb3d2db0c9 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:31.998608 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-faa3c635-7051-4249-b41e-aebb3d2db0c9 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] [instance: 8c95f5b8-35dd-4d5e-9ca6-a023614dd859] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:32.006458 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-faa3c635-7051-4249-b41e-aebb3d2db0c9 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:32.008093 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-faa3c635-7051-4249-b41e-aebb3d2db0c9 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:32.008252 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-faa3c635-7051-4249-b41e-aebb3d2db0c9 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:32.009028 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-faa3c635-7051-4249-b41e-aebb3d2db0c9 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:32.009586 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-faa3c635-7051-4249-b41e-aebb3d2db0c9 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:32.010084 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-faa3c635-7051-4249-b41e-aebb3d2db0c9 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:32.087099 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-faa3c635-7051-4249-b41e-aebb3d2db0c9 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4797a0a06faf431cb97448684460f58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b18ccd11a84c7888bc34e94320cb45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:32.098820 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-faa3c635-7051-4249-b41e-aebb3d2db0c9 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4797a0a06faf431cb97448684460f58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b18ccd11a84c7888bc34e94320cb45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:32.100705 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-faa3c635-7051-4249-b41e-aebb3d2db0c9 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4797a0a06faf431cb97448684460f58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b18ccd11a84c7888bc34e94320cb45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:32.102171 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-faa3c635-7051-4249-b41e-aebb3d2db0c9 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] 10.222.0.43 "GET /compute/v2.1/servers/8c95f5b8-35dd-4d5e-9ca6-a023614dd859" status: 200 len: 1366 microversion: 2.47 time: 0.109838 Oct 04 19:07:32.102869 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3259/6145] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:07:31 2022] GET /compute/v2.1/servers/8c95f5b8-35dd-4d5e-9ca6-a023614dd859 => generated 1366 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 19:07:32.875301 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-baef6abf-8102-47c0-9824-770d9230fd9e tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:32.875924 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-baef6abf-8102-47c0-9824-770d9230fd9e tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] [instance: 101952eb-ca4d-489c-8cb5-3bfadf241aa3] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:32.883536 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-baef6abf-8102-47c0-9824-770d9230fd9e tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:32.884270 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-baef6abf-8102-47c0-9824-770d9230fd9e tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:32.885168 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-baef6abf-8102-47c0-9824-770d9230fd9e tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:32.891949 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-baef6abf-8102-47c0-9824-770d9230fd9e tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:32.893033 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-baef6abf-8102-47c0-9824-770d9230fd9e tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:32.893033 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-baef6abf-8102-47c0-9824-770d9230fd9e tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:33.032935 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-baef6abf-8102-47c0-9824-770d9230fd9e tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:33.043101 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-baef6abf-8102-47c0-9824-770d9230fd9e tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:33.044550 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-baef6abf-8102-47c0-9824-770d9230fd9e tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:33.045793 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-baef6abf-8102-47c0-9824-770d9230fd9e tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] 10.222.0.43 "GET /compute/v2.1/servers/101952eb-ca4d-489c-8cb5-3bfadf241aa3" status: 200 len: 1808 microversion: 2.20 time: 0.174602 Oct 04 19:07:33.052207 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3260/6146] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:07:32 2022] GET /compute/v2.1/servers/101952eb-ca4d-489c-8cb5-3bfadf241aa3 => generated 1808 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 19:07:33.130208 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-04d28a3e-24ad-4c77-8b46-397492ff35af tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:33.131515 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-04d28a3e-24ad-4c77-8b46-397492ff35af tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] [instance: 8c95f5b8-35dd-4d5e-9ca6-a023614dd859] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:33.138938 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-04d28a3e-24ad-4c77-8b46-397492ff35af tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:33.139707 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-04d28a3e-24ad-4c77-8b46-397492ff35af tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:33.140361 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-04d28a3e-24ad-4c77-8b46-397492ff35af tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:33.141158 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-04d28a3e-24ad-4c77-8b46-397492ff35af tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:33.141844 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-04d28a3e-24ad-4c77-8b46-397492ff35af tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:33.142466 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-04d28a3e-24ad-4c77-8b46-397492ff35af tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:33.244996 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-04d28a3e-24ad-4c77-8b46-397492ff35af tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4797a0a06faf431cb97448684460f58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b18ccd11a84c7888bc34e94320cb45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:33.255996 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-04d28a3e-24ad-4c77-8b46-397492ff35af tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4797a0a06faf431cb97448684460f58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b18ccd11a84c7888bc34e94320cb45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:33.258642 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-04d28a3e-24ad-4c77-8b46-397492ff35af tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4797a0a06faf431cb97448684460f58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b18ccd11a84c7888bc34e94320cb45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:33.260313 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-04d28a3e-24ad-4c77-8b46-397492ff35af tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] 10.222.0.43 "GET /compute/v2.1/servers/8c95f5b8-35dd-4d5e-9ca6-a023614dd859" status: 200 len: 1366 microversion: 2.47 time: 0.135984 Oct 04 19:07:33.261076 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3261/6147] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:07:33 2022] GET /compute/v2.1/servers/8c95f5b8-35dd-4d5e-9ca6-a023614dd859 => generated 1366 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 19:07:33.331043 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-f029e119-5dc6-4a58-96d2-eee26b4b3c9b tempest-TestNetworkAdvancedServerOps-1915185768 tempest-TestNetworkAdvancedServerOps-1915185768-project-admin] 10.222.0.43 "POST /compute/v2.1/servers/b01e7e24-c866-4852-9fa8-568f69f68b27/action" status: 202 len: 0 microversion: 2.1 time: 1.988566 Oct 04 19:07:33.332806 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2887/6148] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 19:07:31 2022] POST /compute/v2.1/servers/b01e7e24-c866-4852-9fa8-568f69f68b27/action => generated 0 bytes in 1991 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:07:33.343633 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-a01225eb-402f-43e5-85bc-3e369b3841dd tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:33.344257 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-a01225eb-402f-43e5-85bc-3e369b3841dd tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] [instance: b01e7e24-c866-4852-9fa8-568f69f68b27] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:33.358416 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a01225eb-402f-43e5-85bc-3e369b3841dd tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:33.359335 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a01225eb-402f-43e5-85bc-3e369b3841dd tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:33.360194 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a01225eb-402f-43e5-85bc-3e369b3841dd tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:33.361795 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a01225eb-402f-43e5-85bc-3e369b3841dd tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:33.362972 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a01225eb-402f-43e5-85bc-3e369b3841dd tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:33.363695 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a01225eb-402f-43e5-85bc-3e369b3841dd tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:33.642736 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-a01225eb-402f-43e5-85bc-3e369b3841dd tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf87794979e844349d6ec6c6650565f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c25f1d17e94c74868357744e692487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:33.654314 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-a01225eb-402f-43e5-85bc-3e369b3841dd tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] 10.222.0.43 "GET /compute/v2.1/servers/b01e7e24-c866-4852-9fa8-568f69f68b27" status: 200 len: 1694 microversion: 2.1 time: 0.315235 Oct 04 19:07:33.655739 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3262/6149] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:07:33 2022] GET /compute/v2.1/servers/b01e7e24-c866-4852-9fa8-568f69f68b27 => generated 1694 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:07:34.072449 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-cb8e631b-8d29-434e-9806-96f57cec2147 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:34.073082 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-cb8e631b-8d29-434e-9806-96f57cec2147 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] [instance: 101952eb-ca4d-489c-8cb5-3bfadf241aa3] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:34.091083 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cb8e631b-8d29-434e-9806-96f57cec2147 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:34.091716 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cb8e631b-8d29-434e-9806-96f57cec2147 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:34.092425 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cb8e631b-8d29-434e-9806-96f57cec2147 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:34.093273 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cb8e631b-8d29-434e-9806-96f57cec2147 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:34.093806 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cb8e631b-8d29-434e-9806-96f57cec2147 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:34.094500 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cb8e631b-8d29-434e-9806-96f57cec2147 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:34.289470 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-83805c85-0f19-41d7-9028-505c7ee24ef1 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:34.290395 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-83805c85-0f19-41d7-9028-505c7ee24ef1 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] [instance: 8c95f5b8-35dd-4d5e-9ca6-a023614dd859] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:34.297049 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-83805c85-0f19-41d7-9028-505c7ee24ef1 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:34.297577 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-83805c85-0f19-41d7-9028-505c7ee24ef1 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:34.298019 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-83805c85-0f19-41d7-9028-505c7ee24ef1 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:34.298723 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-83805c85-0f19-41d7-9028-505c7ee24ef1 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:34.299186 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-83805c85-0f19-41d7-9028-505c7ee24ef1 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:34.299617 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-83805c85-0f19-41d7-9028-505c7ee24ef1 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:34.347049 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-cb8e631b-8d29-434e-9806-96f57cec2147 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:34.364900 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-cb8e631b-8d29-434e-9806-96f57cec2147 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:34.366647 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-cb8e631b-8d29-434e-9806-96f57cec2147 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:34.375071 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-cb8e631b-8d29-434e-9806-96f57cec2147 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] 10.222.0.43 "GET /compute/v2.1/servers/101952eb-ca4d-489c-8cb5-3bfadf241aa3" status: 200 len: 1808 microversion: 2.20 time: 0.307135 Oct 04 19:07:34.375668 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2888/6150] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:07:34 2022] GET /compute/v2.1/servers/101952eb-ca4d-489c-8cb5-3bfadf241aa3 => generated 1808 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:07:34.391619 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-83805c85-0f19-41d7-9028-505c7ee24ef1 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4797a0a06faf431cb97448684460f58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b18ccd11a84c7888bc34e94320cb45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:34.402581 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-83805c85-0f19-41d7-9028-505c7ee24ef1 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4797a0a06faf431cb97448684460f58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b18ccd11a84c7888bc34e94320cb45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:34.404385 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-83805c85-0f19-41d7-9028-505c7ee24ef1 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4797a0a06faf431cb97448684460f58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b18ccd11a84c7888bc34e94320cb45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:34.405898 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-83805c85-0f19-41d7-9028-505c7ee24ef1 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] 10.222.0.43 "GET /compute/v2.1/servers/8c95f5b8-35dd-4d5e-9ca6-a023614dd859" status: 200 len: 1366 microversion: 2.47 time: 0.120746 Oct 04 19:07:34.406839 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3263/6151] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:07:34 2022] GET /compute/v2.1/servers/8c95f5b8-35dd-4d5e-9ca6-a023614dd859 => generated 1366 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:07:34.638131 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-e49fd60e-2a37-45eb-8da9-b9a3e3e5c27c req-ee0c6bc2-a09f-4b29-ac5b-f2da173c774d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b01e7e24-c866-4852-9fa8-568f69f68b27", "name": "network-vif-unplugged", "status": "completed", "tag": "fd2276f3-9cc1-4bd3-bf40-500abff51568"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:07:34.649201 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-e49fd60e-2a37-45eb-8da9-b9a3e3e5c27c req-ee0c6bc2-a09f-4b29-ac5b-f2da173c774d service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:34.649781 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-e49fd60e-2a37-45eb-8da9-b9a3e3e5c27c req-ee0c6bc2-a09f-4b29-ac5b-f2da173c774d service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:34.650312 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-e49fd60e-2a37-45eb-8da9-b9a3e3e5c27c req-ee0c6bc2-a09f-4b29-ac5b-f2da173c774d service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:34.664257 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-e49fd60e-2a37-45eb-8da9-b9a3e3e5c27c req-ee0c6bc2-a09f-4b29-ac5b-f2da173c774d service nova] Creating event network-vif-unplugged:fd2276f3-9cc1-4bd3-bf40-500abff51568 for instance b01e7e24-c866-4852-9fa8-568f69f68b27 on n-h2-851028-13 Oct 04 19:07:34.669880 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-e49fd60e-2a37-45eb-8da9-b9a3e3e5c27c req-ee0c6bc2-a09f-4b29-ac5b-f2da173c774d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037375 Oct 04 19:07:34.671085 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2889/6152] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:07:34 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:07:34.681786 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-890421b8-3b90-4af0-8a4c-d5ff20b7597b tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:34.682593 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-890421b8-3b90-4af0-8a4c-d5ff20b7597b tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] [instance: b01e7e24-c866-4852-9fa8-568f69f68b27] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:34.689469 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-890421b8-3b90-4af0-8a4c-d5ff20b7597b tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:34.689971 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-890421b8-3b90-4af0-8a4c-d5ff20b7597b tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:34.690418 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-890421b8-3b90-4af0-8a4c-d5ff20b7597b tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:34.691267 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-890421b8-3b90-4af0-8a4c-d5ff20b7597b tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:34.691549 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-890421b8-3b90-4af0-8a4c-d5ff20b7597b tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:34.692047 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-890421b8-3b90-4af0-8a4c-d5ff20b7597b tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:34.858170 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-890421b8-3b90-4af0-8a4c-d5ff20b7597b tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf87794979e844349d6ec6c6650565f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c25f1d17e94c74868357744e692487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:34.867128 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-890421b8-3b90-4af0-8a4c-d5ff20b7597b tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] 10.222.0.43 "GET /compute/v2.1/servers/b01e7e24-c866-4852-9fa8-568f69f68b27" status: 200 len: 1694 microversion: 2.1 time: 0.189734 Oct 04 19:07:34.867772 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3264/6153] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:07:34 2022] GET /compute/v2.1/servers/b01e7e24-c866-4852-9fa8-568f69f68b27 => generated 1694 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:07:35.402932 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-f55ac214-8e26-4ba2-9282-a9bd8917f83f tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:35.403632 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-f55ac214-8e26-4ba2-9282-a9bd8917f83f tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] [instance: 101952eb-ca4d-489c-8cb5-3bfadf241aa3] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:35.411745 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f55ac214-8e26-4ba2-9282-a9bd8917f83f tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:35.412083 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f55ac214-8e26-4ba2-9282-a9bd8917f83f tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:35.412434 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f55ac214-8e26-4ba2-9282-a9bd8917f83f tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:35.413195 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f55ac214-8e26-4ba2-9282-a9bd8917f83f tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:35.413647 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f55ac214-8e26-4ba2-9282-a9bd8917f83f tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:35.414074 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f55ac214-8e26-4ba2-9282-a9bd8917f83f tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:35.432964 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-006cbde2-7a87-4941-b0a5-6e70449329e0 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:35.433621 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-006cbde2-7a87-4941-b0a5-6e70449329e0 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] [instance: 8c95f5b8-35dd-4d5e-9ca6-a023614dd859] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:35.441756 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-006cbde2-7a87-4941-b0a5-6e70449329e0 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:35.445739 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-006cbde2-7a87-4941-b0a5-6e70449329e0 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:35.446373 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-006cbde2-7a87-4941-b0a5-6e70449329e0 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:35.447276 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-006cbde2-7a87-4941-b0a5-6e70449329e0 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:35.447877 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-006cbde2-7a87-4941-b0a5-6e70449329e0 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:35.448452 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-006cbde2-7a87-4941-b0a5-6e70449329e0 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:35.547102 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-006cbde2-7a87-4941-b0a5-6e70449329e0 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4797a0a06faf431cb97448684460f58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b18ccd11a84c7888bc34e94320cb45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:35.556797 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-006cbde2-7a87-4941-b0a5-6e70449329e0 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4797a0a06faf431cb97448684460f58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b18ccd11a84c7888bc34e94320cb45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:35.558323 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-006cbde2-7a87-4941-b0a5-6e70449329e0 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4797a0a06faf431cb97448684460f58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b18ccd11a84c7888bc34e94320cb45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:35.560453 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-006cbde2-7a87-4941-b0a5-6e70449329e0 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] 10.222.0.43 "GET /compute/v2.1/servers/8c95f5b8-35dd-4d5e-9ca6-a023614dd859" status: 200 len: 1366 microversion: 2.47 time: 0.131913 Oct 04 19:07:35.561131 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3265/6154] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:07:35 2022] GET /compute/v2.1/servers/8c95f5b8-35dd-4d5e-9ca6-a023614dd859 => generated 1366 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 19:07:35.589772 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-f55ac214-8e26-4ba2-9282-a9bd8917f83f tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:35.602933 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-f55ac214-8e26-4ba2-9282-a9bd8917f83f tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:35.604396 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-f55ac214-8e26-4ba2-9282-a9bd8917f83f tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:35.605665 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-f55ac214-8e26-4ba2-9282-a9bd8917f83f tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] 10.222.0.43 "GET /compute/v2.1/servers/101952eb-ca4d-489c-8cb5-3bfadf241aa3" status: 200 len: 1808 microversion: 2.20 time: 0.207854 Oct 04 19:07:35.613716 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2890/6155] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:07:35 2022] GET /compute/v2.1/servers/101952eb-ca4d-489c-8cb5-3bfadf241aa3 => generated 1808 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:07:35.890959 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-6e3cf960-f589-4463-a0b0-fe88a4099a9b tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:35.891577 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-6e3cf960-f589-4463-a0b0-fe88a4099a9b tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] [instance: b01e7e24-c866-4852-9fa8-568f69f68b27] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:35.898778 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6e3cf960-f589-4463-a0b0-fe88a4099a9b tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:35.899244 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6e3cf960-f589-4463-a0b0-fe88a4099a9b tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:35.899676 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6e3cf960-f589-4463-a0b0-fe88a4099a9b tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:35.900392 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6e3cf960-f589-4463-a0b0-fe88a4099a9b tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:35.900826 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6e3cf960-f589-4463-a0b0-fe88a4099a9b tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:35.901281 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6e3cf960-f589-4463-a0b0-fe88a4099a9b tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:36.050952 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-6e3cf960-f589-4463-a0b0-fe88a4099a9b tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf87794979e844349d6ec6c6650565f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c25f1d17e94c74868357744e692487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:36.062319 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-6e3cf960-f589-4463-a0b0-fe88a4099a9b tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] 10.222.0.43 "GET /compute/v2.1/servers/b01e7e24-c866-4852-9fa8-568f69f68b27" status: 200 len: 1694 microversion: 2.1 time: 0.174973 Oct 04 19:07:36.063441 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3266/6156] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:07:35 2022] GET /compute/v2.1/servers/b01e7e24-c866-4852-9fa8-568f69f68b27 => generated 1694 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:07:36.586788 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-760068c1-12e7-49df-8629-3ca19c8d1c02 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:36.587430 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-760068c1-12e7-49df-8629-3ca19c8d1c02 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] [instance: 8c95f5b8-35dd-4d5e-9ca6-a023614dd859] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:36.594347 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-760068c1-12e7-49df-8629-3ca19c8d1c02 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:36.594842 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-760068c1-12e7-49df-8629-3ca19c8d1c02 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:36.595280 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-760068c1-12e7-49df-8629-3ca19c8d1c02 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:36.596047 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-760068c1-12e7-49df-8629-3ca19c8d1c02 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:36.596510 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-760068c1-12e7-49df-8629-3ca19c8d1c02 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:36.597004 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-760068c1-12e7-49df-8629-3ca19c8d1c02 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:36.633525 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-507f4455-64c1-493a-8fd5-031dcaf2fe02 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:36.634166 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-507f4455-64c1-493a-8fd5-031dcaf2fe02 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] [instance: 101952eb-ca4d-489c-8cb5-3bfadf241aa3] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:36.644770 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-507f4455-64c1-493a-8fd5-031dcaf2fe02 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:36.645314 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-507f4455-64c1-493a-8fd5-031dcaf2fe02 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:36.646025 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-507f4455-64c1-493a-8fd5-031dcaf2fe02 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:36.646772 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-507f4455-64c1-493a-8fd5-031dcaf2fe02 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:36.647265 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-507f4455-64c1-493a-8fd5-031dcaf2fe02 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:36.647864 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-507f4455-64c1-493a-8fd5-031dcaf2fe02 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:36.675419 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-760068c1-12e7-49df-8629-3ca19c8d1c02 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4797a0a06faf431cb97448684460f58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b18ccd11a84c7888bc34e94320cb45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:36.684820 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-760068c1-12e7-49df-8629-3ca19c8d1c02 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4797a0a06faf431cb97448684460f58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b18ccd11a84c7888bc34e94320cb45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:36.686331 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-760068c1-12e7-49df-8629-3ca19c8d1c02 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4797a0a06faf431cb97448684460f58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b18ccd11a84c7888bc34e94320cb45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:36.687539 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-760068c1-12e7-49df-8629-3ca19c8d1c02 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] 10.222.0.43 "GET /compute/v2.1/servers/8c95f5b8-35dd-4d5e-9ca6-a023614dd859" status: 200 len: 1366 microversion: 2.47 time: 0.104728 Oct 04 19:07:36.688154 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2891/6157] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:07:36 2022] GET /compute/v2.1/servers/8c95f5b8-35dd-4d5e-9ca6-a023614dd859 => generated 1366 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 19:07:36.703207 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-6f84dc63-cbbe-49e2-8a9a-88c59c5f0b5f req-04f72b52-eb25-47f1-8fb7-aefd7b7d5111 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b01e7e24-c866-4852-9fa8-568f69f68b27", "tag": "fd2276f3-9cc1-4bd3-bf40-500abff51568"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:07:36.713590 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-6f84dc63-cbbe-49e2-8a9a-88c59c5f0b5f req-04f72b52-eb25-47f1-8fb7-aefd7b7d5111 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:36.714083 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-6f84dc63-cbbe-49e2-8a9a-88c59c5f0b5f req-04f72b52-eb25-47f1-8fb7-aefd7b7d5111 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:36.714521 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-6f84dc63-cbbe-49e2-8a9a-88c59c5f0b5f req-04f72b52-eb25-47f1-8fb7-aefd7b7d5111 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:36.735196 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-6f84dc63-cbbe-49e2-8a9a-88c59c5f0b5f req-04f72b52-eb25-47f1-8fb7-aefd7b7d5111 service nova] Creating event network-changed:fd2276f3-9cc1-4bd3-bf40-500abff51568 for instance b01e7e24-c866-4852-9fa8-568f69f68b27 on n-h2-851028-13 Oct 04 19:07:36.740488 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-6f84dc63-cbbe-49e2-8a9a-88c59c5f0b5f req-04f72b52-eb25-47f1-8fb7-aefd7b7d5111 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041202 Oct 04 19:07:36.741842 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2892/6158] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:07:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:07:36.847500 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-507f4455-64c1-493a-8fd5-031dcaf2fe02 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:36.862386 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-507f4455-64c1-493a-8fd5-031dcaf2fe02 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:36.863976 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-507f4455-64c1-493a-8fd5-031dcaf2fe02 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:36.865189 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-507f4455-64c1-493a-8fd5-031dcaf2fe02 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] 10.222.0.43 "GET /compute/v2.1/servers/101952eb-ca4d-489c-8cb5-3bfadf241aa3" status: 200 len: 1808 microversion: 2.20 time: 0.237327 Oct 04 19:07:36.865918 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3267/6159] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:07:36 2022] GET /compute/v2.1/servers/101952eb-ca4d-489c-8cb5-3bfadf241aa3 => generated 1808 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 19:07:37.087858 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-7fc4e1df-d05e-429c-a379-ee1ac9925819 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:37.088638 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-7fc4e1df-d05e-429c-a379-ee1ac9925819 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] [instance: b01e7e24-c866-4852-9fa8-568f69f68b27] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:37.095040 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7fc4e1df-d05e-429c-a379-ee1ac9925819 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:37.095602 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7fc4e1df-d05e-429c-a379-ee1ac9925819 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:37.096118 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7fc4e1df-d05e-429c-a379-ee1ac9925819 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:37.096906 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7fc4e1df-d05e-429c-a379-ee1ac9925819 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:37.097476 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7fc4e1df-d05e-429c-a379-ee1ac9925819 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:37.098026 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7fc4e1df-d05e-429c-a379-ee1ac9925819 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:37.270175 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-7fc4e1df-d05e-429c-a379-ee1ac9925819 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf87794979e844349d6ec6c6650565f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c25f1d17e94c74868357744e692487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:37.279999 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-7fc4e1df-d05e-429c-a379-ee1ac9925819 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] 10.222.0.43 "GET /compute/v2.1/servers/b01e7e24-c866-4852-9fa8-568f69f68b27" status: 200 len: 1694 microversion: 2.1 time: 0.196826 Oct 04 19:07:37.280764 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2893/6160] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:07:37 2022] GET /compute/v2.1/servers/b01e7e24-c866-4852-9fa8-568f69f68b27 => generated 1694 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:07:37.714803 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-d272f566-2d8d-4466-88fb-0c20e7a1b01c tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:37.715582 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-d272f566-2d8d-4466-88fb-0c20e7a1b01c tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] [instance: 8c95f5b8-35dd-4d5e-9ca6-a023614dd859] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:37.722800 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d272f566-2d8d-4466-88fb-0c20e7a1b01c tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:37.723306 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d272f566-2d8d-4466-88fb-0c20e7a1b01c tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:37.723755 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d272f566-2d8d-4466-88fb-0c20e7a1b01c tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:37.724470 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d272f566-2d8d-4466-88fb-0c20e7a1b01c tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:37.724934 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d272f566-2d8d-4466-88fb-0c20e7a1b01c tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:37.725466 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d272f566-2d8d-4466-88fb-0c20e7a1b01c tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:37.796516 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-d272f566-2d8d-4466-88fb-0c20e7a1b01c tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4797a0a06faf431cb97448684460f58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b18ccd11a84c7888bc34e94320cb45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:37.805692 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-d272f566-2d8d-4466-88fb-0c20e7a1b01c tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4797a0a06faf431cb97448684460f58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b18ccd11a84c7888bc34e94320cb45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:37.807280 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-d272f566-2d8d-4466-88fb-0c20e7a1b01c tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4797a0a06faf431cb97448684460f58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b18ccd11a84c7888bc34e94320cb45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:37.808604 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-d272f566-2d8d-4466-88fb-0c20e7a1b01c tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] 10.222.0.43 "GET /compute/v2.1/servers/8c95f5b8-35dd-4d5e-9ca6-a023614dd859" status: 200 len: 1366 microversion: 2.47 time: 0.097761 Oct 04 19:07:37.809269 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3268/6161] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:07:37 2022] GET /compute/v2.1/servers/8c95f5b8-35dd-4d5e-9ca6-a023614dd859 => generated 1366 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:07:37.891900 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-6e60e3cf-fa14-4b41-9b08-1ffd77ad2988 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:37.892498 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-6e60e3cf-fa14-4b41-9b08-1ffd77ad2988 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] [instance: 101952eb-ca4d-489c-8cb5-3bfadf241aa3] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:37.899735 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6e60e3cf-fa14-4b41-9b08-1ffd77ad2988 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:37.900225 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6e60e3cf-fa14-4b41-9b08-1ffd77ad2988 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:37.900665 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6e60e3cf-fa14-4b41-9b08-1ffd77ad2988 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:37.901403 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6e60e3cf-fa14-4b41-9b08-1ffd77ad2988 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:37.901988 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6e60e3cf-fa14-4b41-9b08-1ffd77ad2988 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:37.902416 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6e60e3cf-fa14-4b41-9b08-1ffd77ad2988 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:38.051997 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-6e60e3cf-fa14-4b41-9b08-1ffd77ad2988 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:38.071847 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-6e60e3cf-fa14-4b41-9b08-1ffd77ad2988 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:38.073586 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-6e60e3cf-fa14-4b41-9b08-1ffd77ad2988 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:38.074967 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-6e60e3cf-fa14-4b41-9b08-1ffd77ad2988 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] 10.222.0.43 "GET /compute/v2.1/servers/101952eb-ca4d-489c-8cb5-3bfadf241aa3" status: 200 len: 1808 microversion: 2.20 time: 0.187102 Oct 04 19:07:38.075707 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2894/6162] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:07:37 2022] GET /compute/v2.1/servers/101952eb-ca4d-489c-8cb5-3bfadf241aa3 => generated 1808 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:07:38.304806 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-508e2227-f811-4806-9bca-954e5e771ef9 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:38.305610 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-508e2227-f811-4806-9bca-954e5e771ef9 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] [instance: b01e7e24-c866-4852-9fa8-568f69f68b27] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:38.312150 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-508e2227-f811-4806-9bca-954e5e771ef9 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:38.312673 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-508e2227-f811-4806-9bca-954e5e771ef9 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:38.313134 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-508e2227-f811-4806-9bca-954e5e771ef9 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:38.313862 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-508e2227-f811-4806-9bca-954e5e771ef9 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:38.314321 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-508e2227-f811-4806-9bca-954e5e771ef9 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:38.314747 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-508e2227-f811-4806-9bca-954e5e771ef9 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:38.455888 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-508e2227-f811-4806-9bca-954e5e771ef9 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf87794979e844349d6ec6c6650565f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c25f1d17e94c74868357744e692487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:38.464156 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-508e2227-f811-4806-9bca-954e5e771ef9 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] 10.222.0.43 "GET /compute/v2.1/servers/b01e7e24-c866-4852-9fa8-568f69f68b27" status: 200 len: 1694 microversion: 2.1 time: 0.163993 Oct 04 19:07:38.464756 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3269/6163] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:07:38 2022] GET /compute/v2.1/servers/b01e7e24-c866-4852-9fa8-568f69f68b27 => generated 1694 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:07:38.836384 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-47dfb41f-d503-43cc-ac58-aa50dbf51727 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:38.837029 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-47dfb41f-d503-43cc-ac58-aa50dbf51727 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] [instance: 8c95f5b8-35dd-4d5e-9ca6-a023614dd859] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:38.844429 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-47dfb41f-d503-43cc-ac58-aa50dbf51727 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:38.845045 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-47dfb41f-d503-43cc-ac58-aa50dbf51727 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:38.845905 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-47dfb41f-d503-43cc-ac58-aa50dbf51727 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:38.846705 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-47dfb41f-d503-43cc-ac58-aa50dbf51727 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:38.847170 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-47dfb41f-d503-43cc-ac58-aa50dbf51727 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:38.847606 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-47dfb41f-d503-43cc-ac58-aa50dbf51727 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:38.922147 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-47dfb41f-d503-43cc-ac58-aa50dbf51727 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4797a0a06faf431cb97448684460f58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b18ccd11a84c7888bc34e94320cb45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:38.930412 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-47dfb41f-d503-43cc-ac58-aa50dbf51727 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4797a0a06faf431cb97448684460f58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b18ccd11a84c7888bc34e94320cb45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:38.931855 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-47dfb41f-d503-43cc-ac58-aa50dbf51727 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4797a0a06faf431cb97448684460f58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b18ccd11a84c7888bc34e94320cb45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:38.933019 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-47dfb41f-d503-43cc-ac58-aa50dbf51727 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] 10.222.0.43 "GET /compute/v2.1/servers/8c95f5b8-35dd-4d5e-9ca6-a023614dd859" status: 200 len: 1366 microversion: 2.47 time: 0.101316 Oct 04 19:07:38.933614 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2895/6164] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:07:38 2022] GET /compute/v2.1/servers/8c95f5b8-35dd-4d5e-9ca6-a023614dd859 => generated 1366 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:07:39.100072 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-39eb08a8-e5d6-4778-95c4-4fdd72650b7a tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:39.100791 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-39eb08a8-e5d6-4778-95c4-4fdd72650b7a tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] [instance: 101952eb-ca4d-489c-8cb5-3bfadf241aa3] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:39.107870 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-39eb08a8-e5d6-4778-95c4-4fdd72650b7a tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:39.108363 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-39eb08a8-e5d6-4778-95c4-4fdd72650b7a tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:39.108806 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-39eb08a8-e5d6-4778-95c4-4fdd72650b7a tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:39.109556 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-39eb08a8-e5d6-4778-95c4-4fdd72650b7a tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:39.110009 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-39eb08a8-e5d6-4778-95c4-4fdd72650b7a tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:39.110437 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-39eb08a8-e5d6-4778-95c4-4fdd72650b7a tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:39.287100 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-39eb08a8-e5d6-4778-95c4-4fdd72650b7a tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:39.297297 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-39eb08a8-e5d6-4778-95c4-4fdd72650b7a tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:39.300164 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-39eb08a8-e5d6-4778-95c4-4fdd72650b7a tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:39.302196 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-39eb08a8-e5d6-4778-95c4-4fdd72650b7a tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] 10.222.0.43 "GET /compute/v2.1/servers/101952eb-ca4d-489c-8cb5-3bfadf241aa3" status: 200 len: 1808 microversion: 2.20 time: 0.205876 Oct 04 19:07:39.303253 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3270/6165] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:07:39 2022] GET /compute/v2.1/servers/101952eb-ca4d-489c-8cb5-3bfadf241aa3 => generated 1808 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:07:39.490691 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-2f6d0924-55b5-4b71-a635-fff5f48bb18a tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:39.492708 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-2f6d0924-55b5-4b71-a635-fff5f48bb18a tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] [instance: b01e7e24-c866-4852-9fa8-568f69f68b27] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:39.496215 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=6 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:07:39.504698 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2f6d0924-55b5-4b71-a635-fff5f48bb18a tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:39.505247 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2f6d0924-55b5-4b71-a635-fff5f48bb18a tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:39.505662 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2f6d0924-55b5-4b71-a635-fff5f48bb18a tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:39.506426 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2f6d0924-55b5-4b71-a635-fff5f48bb18a tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:39.507536 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2f6d0924-55b5-4b71-a635-fff5f48bb18a tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:39.508179 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2f6d0924-55b5-4b71-a635-fff5f48bb18a tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:39.655913 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-2f6d0924-55b5-4b71-a635-fff5f48bb18a tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf87794979e844349d6ec6c6650565f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c25f1d17e94c74868357744e692487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:39.665465 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-2f6d0924-55b5-4b71-a635-fff5f48bb18a tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] 10.222.0.43 "GET /compute/v2.1/servers/b01e7e24-c866-4852-9fa8-568f69f68b27" status: 200 len: 1694 microversion: 2.1 time: 0.180847 Oct 04 19:07:39.666062 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2896/6166] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:07:39 2022] GET /compute/v2.1/servers/b01e7e24-c866-4852-9fa8-568f69f68b27 => generated 1694 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:07:39.958164 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-89f0e94e-54cc-495a-b86d-45aed8e4ae0e tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:39.958807 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-89f0e94e-54cc-495a-b86d-45aed8e4ae0e tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] [instance: 8c95f5b8-35dd-4d5e-9ca6-a023614dd859] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:39.965554 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-89f0e94e-54cc-495a-b86d-45aed8e4ae0e tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:39.966072 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-89f0e94e-54cc-495a-b86d-45aed8e4ae0e tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:39.966504 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-89f0e94e-54cc-495a-b86d-45aed8e4ae0e tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:39.967268 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-89f0e94e-54cc-495a-b86d-45aed8e4ae0e tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:39.967719 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-89f0e94e-54cc-495a-b86d-45aed8e4ae0e tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:39.968142 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-89f0e94e-54cc-495a-b86d-45aed8e4ae0e tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:40.047198 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-89f0e94e-54cc-495a-b86d-45aed8e4ae0e tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4797a0a06faf431cb97448684460f58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b18ccd11a84c7888bc34e94320cb45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:40.056156 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-89f0e94e-54cc-495a-b86d-45aed8e4ae0e tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4797a0a06faf431cb97448684460f58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b18ccd11a84c7888bc34e94320cb45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:40.057921 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-89f0e94e-54cc-495a-b86d-45aed8e4ae0e tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4797a0a06faf431cb97448684460f58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b18ccd11a84c7888bc34e94320cb45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:40.059249 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-89f0e94e-54cc-495a-b86d-45aed8e4ae0e tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] 10.222.0.43 "GET /compute/v2.1/servers/8c95f5b8-35dd-4d5e-9ca6-a023614dd859" status: 200 len: 1366 microversion: 2.47 time: 0.105146 Oct 04 19:07:40.060192 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3271/6167] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:07:39 2022] GET /compute/v2.1/servers/8c95f5b8-35dd-4d5e-9ca6-a023614dd859 => generated 1366 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:07:40.332503 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-1f54b896-d461-4968-b18b-ae1b0032dec9 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:40.333154 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-1f54b896-d461-4968-b18b-ae1b0032dec9 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] [instance: 101952eb-ca4d-489c-8cb5-3bfadf241aa3] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:40.341314 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1f54b896-d461-4968-b18b-ae1b0032dec9 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:40.342157 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1f54b896-d461-4968-b18b-ae1b0032dec9 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:40.342774 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1f54b896-d461-4968-b18b-ae1b0032dec9 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:40.343664 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1f54b896-d461-4968-b18b-ae1b0032dec9 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:40.344321 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1f54b896-d461-4968-b18b-ae1b0032dec9 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:40.344757 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1f54b896-d461-4968-b18b-ae1b0032dec9 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:40.498832 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-1f54b896-d461-4968-b18b-ae1b0032dec9 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:40.507739 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-1f54b896-d461-4968-b18b-ae1b0032dec9 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:40.509244 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-1f54b896-d461-4968-b18b-ae1b0032dec9 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:40.510431 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-1f54b896-d461-4968-b18b-ae1b0032dec9 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] 10.222.0.43 "GET /compute/v2.1/servers/101952eb-ca4d-489c-8cb5-3bfadf241aa3" status: 200 len: 1808 microversion: 2.20 time: 0.184586 Oct 04 19:07:40.511152 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2897/6168] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:07:40 2022] GET /compute/v2.1/servers/101952eb-ca4d-489c-8cb5-3bfadf241aa3 => generated 1808 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:07:40.690183 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-4a29c6b3-d9e3-498d-bea7-b69162888738 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:40.692084 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-4a29c6b3-d9e3-498d-bea7-b69162888738 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] [instance: b01e7e24-c866-4852-9fa8-568f69f68b27] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:40.699531 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4a29c6b3-d9e3-498d-bea7-b69162888738 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:40.700424 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4a29c6b3-d9e3-498d-bea7-b69162888738 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:40.701128 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4a29c6b3-d9e3-498d-bea7-b69162888738 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:40.702088 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4a29c6b3-d9e3-498d-bea7-b69162888738 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:40.702758 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4a29c6b3-d9e3-498d-bea7-b69162888738 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:40.703402 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4a29c6b3-d9e3-498d-bea7-b69162888738 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:40.938379 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-4a29c6b3-d9e3-498d-bea7-b69162888738 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf87794979e844349d6ec6c6650565f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c25f1d17e94c74868357744e692487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:40.947172 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-4a29c6b3-d9e3-498d-bea7-b69162888738 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] 10.222.0.43 "GET /compute/v2.1/servers/b01e7e24-c866-4852-9fa8-568f69f68b27" status: 200 len: 1694 microversion: 2.1 time: 0.261387 Oct 04 19:07:40.953478 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3272/6169] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:07:40 2022] GET /compute/v2.1/servers/b01e7e24-c866-4852-9fa8-568f69f68b27 => generated 1694 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:07:41.086002 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-b6b97eb3-0086-40ef-8de5-f7bf48924fe9 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:41.087117 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-b6b97eb3-0086-40ef-8de5-f7bf48924fe9 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] [instance: 8c95f5b8-35dd-4d5e-9ca6-a023614dd859] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:41.093555 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b6b97eb3-0086-40ef-8de5-f7bf48924fe9 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:41.094175 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b6b97eb3-0086-40ef-8de5-f7bf48924fe9 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:41.094723 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b6b97eb3-0086-40ef-8de5-f7bf48924fe9 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:41.095573 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b6b97eb3-0086-40ef-8de5-f7bf48924fe9 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:41.096146 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b6b97eb3-0086-40ef-8de5-f7bf48924fe9 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:41.096981 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b6b97eb3-0086-40ef-8de5-f7bf48924fe9 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:41.115972 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:07:41.184886 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-b6b97eb3-0086-40ef-8de5-f7bf48924fe9 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4797a0a06faf431cb97448684460f58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b18ccd11a84c7888bc34e94320cb45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:41.196168 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-b6b97eb3-0086-40ef-8de5-f7bf48924fe9 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4797a0a06faf431cb97448684460f58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b18ccd11a84c7888bc34e94320cb45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:41.197834 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-b6b97eb3-0086-40ef-8de5-f7bf48924fe9 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4797a0a06faf431cb97448684460f58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b18ccd11a84c7888bc34e94320cb45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:41.199388 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-b6b97eb3-0086-40ef-8de5-f7bf48924fe9 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] 10.222.0.43 "GET /compute/v2.1/servers/8c95f5b8-35dd-4d5e-9ca6-a023614dd859" status: 200 len: 1366 microversion: 2.47 time: 0.117762 Oct 04 19:07:41.204970 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2898/6170] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:07:41 2022] GET /compute/v2.1/servers/8c95f5b8-35dd-4d5e-9ca6-a023614dd859 => generated 1366 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:07:41.536213 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-042178d7-6de5-42a6-a766-9e0e17b51a07 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:41.536770 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-042178d7-6de5-42a6-a766-9e0e17b51a07 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] [instance: 101952eb-ca4d-489c-8cb5-3bfadf241aa3] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:41.545090 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-042178d7-6de5-42a6-a766-9e0e17b51a07 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:41.545639 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-042178d7-6de5-42a6-a766-9e0e17b51a07 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:41.546093 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-042178d7-6de5-42a6-a766-9e0e17b51a07 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:41.546824 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-042178d7-6de5-42a6-a766-9e0e17b51a07 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:41.547290 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-042178d7-6de5-42a6-a766-9e0e17b51a07 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:41.547725 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-042178d7-6de5-42a6-a766-9e0e17b51a07 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:41.793222 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-042178d7-6de5-42a6-a766-9e0e17b51a07 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:41.802963 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-042178d7-6de5-42a6-a766-9e0e17b51a07 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:41.805484 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-042178d7-6de5-42a6-a766-9e0e17b51a07 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:41.807010 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-042178d7-6de5-42a6-a766-9e0e17b51a07 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] 10.222.0.43 "GET /compute/v2.1/servers/101952eb-ca4d-489c-8cb5-3bfadf241aa3" status: 200 len: 1808 microversion: 2.20 time: 0.275055 Oct 04 19:07:41.807704 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3273/6171] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:07:41 2022] GET /compute/v2.1/servers/101952eb-ca4d-489c-8cb5-3bfadf241aa3 => generated 1808 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:07:41.973736 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-c4be5768-b8e7-4152-aba1-b5fe9d4b937d tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:41.974354 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-c4be5768-b8e7-4152-aba1-b5fe9d4b937d tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] [instance: b01e7e24-c866-4852-9fa8-568f69f68b27] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:41.982141 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c4be5768-b8e7-4152-aba1-b5fe9d4b937d tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:41.982631 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c4be5768-b8e7-4152-aba1-b5fe9d4b937d tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:41.983074 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c4be5768-b8e7-4152-aba1-b5fe9d4b937d tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:41.983771 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c4be5768-b8e7-4152-aba1-b5fe9d4b937d tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:41.984388 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c4be5768-b8e7-4152-aba1-b5fe9d4b937d tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:41.984971 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c4be5768-b8e7-4152-aba1-b5fe9d4b937d tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:42.228083 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-c60f71f1-b0ec-4854-b72f-9019ff546851 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:42.228985 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-c60f71f1-b0ec-4854-b72f-9019ff546851 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] [instance: 8c95f5b8-35dd-4d5e-9ca6-a023614dd859] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:42.235386 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c60f71f1-b0ec-4854-b72f-9019ff546851 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:42.236385 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c60f71f1-b0ec-4854-b72f-9019ff546851 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:42.237008 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c60f71f1-b0ec-4854-b72f-9019ff546851 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:42.237921 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c60f71f1-b0ec-4854-b72f-9019ff546851 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:42.238539 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c60f71f1-b0ec-4854-b72f-9019ff546851 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:42.239123 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c60f71f1-b0ec-4854-b72f-9019ff546851 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:42.245163 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=100 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:07:42.274262 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-c4be5768-b8e7-4152-aba1-b5fe9d4b937d tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf87794979e844349d6ec6c6650565f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c25f1d17e94c74868357744e692487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:42.290288 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-c4be5768-b8e7-4152-aba1-b5fe9d4b937d tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] 10.222.0.43 "GET /compute/v2.1/servers/b01e7e24-c866-4852-9fa8-568f69f68b27" status: 200 len: 1694 microversion: 2.1 time: 0.315950 Oct 04 19:07:42.293547 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2899/6172] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:07:41 2022] GET /compute/v2.1/servers/b01e7e24-c866-4852-9fa8-568f69f68b27 => generated 1694 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:07:42.332343 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-6044d986-e48b-494e-b45e-e9172492e000 req-96d4195b-ce92-4a27-925a-db378a6c67cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "101952eb-ca4d-489c-8cb5-3bfadf241aa3", "name": "network-vif-plugged", "status": "completed", "tag": "1c32f64c-fd96-488e-ad04-113ec01cb7c8"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:07:42.347449 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-c60f71f1-b0ec-4854-b72f-9019ff546851 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4797a0a06faf431cb97448684460f58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b18ccd11a84c7888bc34e94320cb45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:42.356047 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-6044d986-e48b-494e-b45e-e9172492e000 req-96d4195b-ce92-4a27-925a-db378a6c67cc service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:42.356546 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-6044d986-e48b-494e-b45e-e9172492e000 req-96d4195b-ce92-4a27-925a-db378a6c67cc service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:42.356992 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-6044d986-e48b-494e-b45e-e9172492e000 req-96d4195b-ce92-4a27-925a-db378a6c67cc service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:42.359244 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-c60f71f1-b0ec-4854-b72f-9019ff546851 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4797a0a06faf431cb97448684460f58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b18ccd11a84c7888bc34e94320cb45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:42.360898 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-c60f71f1-b0ec-4854-b72f-9019ff546851 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4797a0a06faf431cb97448684460f58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b18ccd11a84c7888bc34e94320cb45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:42.362412 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-c60f71f1-b0ec-4854-b72f-9019ff546851 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] 10.222.0.43 "GET /compute/v2.1/servers/8c95f5b8-35dd-4d5e-9ca6-a023614dd859" status: 200 len: 1366 microversion: 2.47 time: 0.138834 Oct 04 19:07:42.363465 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3274/6173] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:07:42 2022] GET /compute/v2.1/servers/8c95f5b8-35dd-4d5e-9ca6-a023614dd859 => generated 1366 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:07:42.371049 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-6044d986-e48b-494e-b45e-e9172492e000 req-96d4195b-ce92-4a27-925a-db378a6c67cc service nova] Creating event network-vif-plugged:1c32f64c-fd96-488e-ad04-113ec01cb7c8 for instance 101952eb-ca4d-489c-8cb5-3bfadf241aa3 on n-h1-851028-13 Oct 04 19:07:42.377073 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-6044d986-e48b-494e-b45e-e9172492e000 req-96d4195b-ce92-4a27-925a-db378a6c67cc service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049582 Oct 04 19:07:42.378287 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2900/6174] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:07:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:07:42.833216 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-c6f33218-7b40-4164-884a-4f8f2028e390 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:42.833829 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-c6f33218-7b40-4164-884a-4f8f2028e390 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] [instance: 101952eb-ca4d-489c-8cb5-3bfadf241aa3] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:42.841165 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c6f33218-7b40-4164-884a-4f8f2028e390 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:42.841659 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c6f33218-7b40-4164-884a-4f8f2028e390 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:42.842105 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c6f33218-7b40-4164-884a-4f8f2028e390 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:42.842793 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c6f33218-7b40-4164-884a-4f8f2028e390 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:42.843244 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c6f33218-7b40-4164-884a-4f8f2028e390 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:42.843667 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c6f33218-7b40-4164-884a-4f8f2028e390 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:42.990235 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-c6f33218-7b40-4164-884a-4f8f2028e390 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:43.001510 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-c6f33218-7b40-4164-884a-4f8f2028e390 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:43.003078 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-c6f33218-7b40-4164-884a-4f8f2028e390 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:43.004370 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-c6f33218-7b40-4164-884a-4f8f2028e390 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] 10.222.0.43 "GET /compute/v2.1/servers/101952eb-ca4d-489c-8cb5-3bfadf241aa3" status: 200 len: 1808 microversion: 2.20 time: 0.175117 Oct 04 19:07:43.005525 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3275/6175] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:07:42 2022] GET /compute/v2.1/servers/101952eb-ca4d-489c-8cb5-3bfadf241aa3 => generated 1808 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:07:43.320393 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-ddaf89c0-2cf3-4d8e-9f54-cc24b5f68033 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:43.321924 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-ddaf89c0-2cf3-4d8e-9f54-cc24b5f68033 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] [instance: b01e7e24-c866-4852-9fa8-568f69f68b27] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:43.330526 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ddaf89c0-2cf3-4d8e-9f54-cc24b5f68033 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:43.331098 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ddaf89c0-2cf3-4d8e-9f54-cc24b5f68033 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:43.331618 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ddaf89c0-2cf3-4d8e-9f54-cc24b5f68033 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:43.332407 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ddaf89c0-2cf3-4d8e-9f54-cc24b5f68033 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:43.332960 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ddaf89c0-2cf3-4d8e-9f54-cc24b5f68033 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:43.333488 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ddaf89c0-2cf3-4d8e-9f54-cc24b5f68033 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:43.390332 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-004782a2-a2d9-4e7c-b8bc-871b66c4f7ce tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:43.390989 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-004782a2-a2d9-4e7c-b8bc-871b66c4f7ce tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] [instance: 8c95f5b8-35dd-4d5e-9ca6-a023614dd859] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:43.399940 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-004782a2-a2d9-4e7c-b8bc-871b66c4f7ce tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:43.400661 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-004782a2-a2d9-4e7c-b8bc-871b66c4f7ce tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:43.401308 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-004782a2-a2d9-4e7c-b8bc-871b66c4f7ce tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:43.402198 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-004782a2-a2d9-4e7c-b8bc-871b66c4f7ce tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:43.402814 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-004782a2-a2d9-4e7c-b8bc-871b66c4f7ce tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:43.403442 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-004782a2-a2d9-4e7c-b8bc-871b66c4f7ce tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:43.486237 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-004782a2-a2d9-4e7c-b8bc-871b66c4f7ce tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4797a0a06faf431cb97448684460f58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b18ccd11a84c7888bc34e94320cb45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:43.498044 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-004782a2-a2d9-4e7c-b8bc-871b66c4f7ce tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4797a0a06faf431cb97448684460f58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b18ccd11a84c7888bc34e94320cb45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:43.499811 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-004782a2-a2d9-4e7c-b8bc-871b66c4f7ce tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4797a0a06faf431cb97448684460f58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b18ccd11a84c7888bc34e94320cb45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:43.502054 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-004782a2-a2d9-4e7c-b8bc-871b66c4f7ce tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] 10.222.0.43 "GET /compute/v2.1/servers/8c95f5b8-35dd-4d5e-9ca6-a023614dd859" status: 200 len: 1366 microversion: 2.47 time: 0.115890 Oct 04 19:07:43.502840 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3276/6176] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:07:43 2022] GET /compute/v2.1/servers/8c95f5b8-35dd-4d5e-9ca6-a023614dd859 => generated 1366 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:07:43.581013 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-ddaf89c0-2cf3-4d8e-9f54-cc24b5f68033 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf87794979e844349d6ec6c6650565f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c25f1d17e94c74868357744e692487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:43.595536 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-ddaf89c0-2cf3-4d8e-9f54-cc24b5f68033 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] 10.222.0.43 "GET /compute/v2.1/servers/b01e7e24-c866-4852-9fa8-568f69f68b27" status: 200 len: 1684 microversion: 2.1 time: 0.281011 Oct 04 19:07:43.596763 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2901/6177] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:07:43 2022] GET /compute/v2.1/servers/b01e7e24-c866-4852-9fa8-568f69f68b27 => generated 1684 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:07:43.620075 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-71a3e5f2-4ec0-46d3-b2eb-3addd81d9a02 tempest-TestNetworkAdvancedServerOps-1915185768 tempest-TestNetworkAdvancedServerOps-1915185768-project-admin] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:43.620708 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-71a3e5f2-4ec0-46d3-b2eb-3addd81d9a02 tempest-TestNetworkAdvancedServerOps-1915185768 tempest-TestNetworkAdvancedServerOps-1915185768-project-admin] [instance: b01e7e24-c866-4852-9fa8-568f69f68b27] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:43.627213 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-71a3e5f2-4ec0-46d3-b2eb-3addd81d9a02 tempest-TestNetworkAdvancedServerOps-1915185768 tempest-TestNetworkAdvancedServerOps-1915185768-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:43.627922 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-71a3e5f2-4ec0-46d3-b2eb-3addd81d9a02 tempest-TestNetworkAdvancedServerOps-1915185768 tempest-TestNetworkAdvancedServerOps-1915185768-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:43.628532 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-71a3e5f2-4ec0-46d3-b2eb-3addd81d9a02 tempest-TestNetworkAdvancedServerOps-1915185768 tempest-TestNetworkAdvancedServerOps-1915185768-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:43.629459 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-71a3e5f2-4ec0-46d3-b2eb-3addd81d9a02 tempest-TestNetworkAdvancedServerOps-1915185768 tempest-TestNetworkAdvancedServerOps-1915185768-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:43.630092 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-71a3e5f2-4ec0-46d3-b2eb-3addd81d9a02 tempest-TestNetworkAdvancedServerOps-1915185768 tempest-TestNetworkAdvancedServerOps-1915185768-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:43.630685 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-71a3e5f2-4ec0-46d3-b2eb-3addd81d9a02 tempest-TestNetworkAdvancedServerOps-1915185768 tempest-TestNetworkAdvancedServerOps-1915185768-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:43.785681 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-71a3e5f2-4ec0-46d3-b2eb-3addd81d9a02 tempest-TestNetworkAdvancedServerOps-1915185768 tempest-TestNetworkAdvancedServerOps-1915185768-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/b01e7e24-c866-4852-9fa8-568f69f68b27" status: 200 len: 1837 microversion: 2.1 time: 0.170199 Oct 04 19:07:43.786269 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3277/6178] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:07:43 2022] GET /compute/v2.1/servers/b01e7e24-c866-4852-9fa8-568f69f68b27 => generated 1837 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:07:43.809880 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-79a41258-5122-4a54-b9c3-23dc3fa0002c tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:43.810500 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-79a41258-5122-4a54-b9c3-23dc3fa0002c tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] [instance: b01e7e24-c866-4852-9fa8-568f69f68b27] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:43.817187 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-79a41258-5122-4a54-b9c3-23dc3fa0002c tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:43.817978 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-79a41258-5122-4a54-b9c3-23dc3fa0002c tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:43.818420 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-79a41258-5122-4a54-b9c3-23dc3fa0002c tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:43.819204 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-79a41258-5122-4a54-b9c3-23dc3fa0002c tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:43.819663 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-79a41258-5122-4a54-b9c3-23dc3fa0002c tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:43.820093 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-79a41258-5122-4a54-b9c3-23dc3fa0002c tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:43.996036 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-79a41258-5122-4a54-b9c3-23dc3fa0002c tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf87794979e844349d6ec6c6650565f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c25f1d17e94c74868357744e692487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:44.009711 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-79a41258-5122-4a54-b9c3-23dc3fa0002c tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] 10.222.0.43 "GET /compute/v2.1/servers/b01e7e24-c866-4852-9fa8-568f69f68b27" status: 200 len: 1684 microversion: 2.1 time: 0.203644 Oct 04 19:07:44.011074 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2902/6179] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:07:43 2022] GET /compute/v2.1/servers/b01e7e24-c866-4852-9fa8-568f69f68b27 => generated 1684 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:07:44.031714 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-c25cab4e-9a52-4f5c-a2e6-c24020aca9ac tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:44.032339 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-c25cab4e-9a52-4f5c-a2e6-c24020aca9ac tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] [instance: 101952eb-ca4d-489c-8cb5-3bfadf241aa3] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:44.041334 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c25cab4e-9a52-4f5c-a2e6-c24020aca9ac tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:44.048540 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c25cab4e-9a52-4f5c-a2e6-c24020aca9ac tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:44.049294 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c25cab4e-9a52-4f5c-a2e6-c24020aca9ac tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:44.049829 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c25cab4e-9a52-4f5c-a2e6-c24020aca9ac tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:44.050456 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c25cab4e-9a52-4f5c-a2e6-c24020aca9ac tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:44.050730 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c25cab4e-9a52-4f5c-a2e6-c24020aca9ac tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:44.157682 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-811d46ba-90a2-47ea-8789-a663d6d37053 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:07:44.160366 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-811d46ba-90a2-47ea-8789-a663d6d37053 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] [instance: b01e7e24-c866-4852-9fa8-568f69f68b27] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:44.172291 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-811d46ba-90a2-47ea-8789-a663d6d37053 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:44.174421 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-811d46ba-90a2-47ea-8789-a663d6d37053 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:44.177301 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-811d46ba-90a2-47ea-8789-a663d6d37053 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:44.178488 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-811d46ba-90a2-47ea-8789-a663d6d37053 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:44.180698 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-811d46ba-90a2-47ea-8789-a663d6d37053 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:44.181409 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-811d46ba-90a2-47ea-8789-a663d6d37053 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:44.275896 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-811d46ba-90a2-47ea-8789-a663d6d37053 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] 10.222.0.43 "POST /compute/v2.1/servers/b01e7e24-c866-4852-9fa8-568f69f68b27/action" status: 200 len: 38668 microversion: 2.1 time: 0.121781 Oct 04 19:07:44.286950 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2903/6180] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 19:07:44 2022] POST /compute/v2.1/servers/b01e7e24-c866-4852-9fa8-568f69f68b27/action => generated 38668 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 19:07:44.347601 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-c25cab4e-9a52-4f5c-a2e6-c24020aca9ac tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:44.358231 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-c25cab4e-9a52-4f5c-a2e6-c24020aca9ac tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:44.360220 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-c25cab4e-9a52-4f5c-a2e6-c24020aca9ac tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:44.361769 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-c25cab4e-9a52-4f5c-a2e6-c24020aca9ac tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] 10.222.0.43 "GET /compute/v2.1/servers/101952eb-ca4d-489c-8cb5-3bfadf241aa3" status: 200 len: 1808 microversion: 2.20 time: 0.333994 Oct 04 19:07:44.363808 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3278/6181] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:07:44 2022] GET /compute/v2.1/servers/101952eb-ca4d-489c-8cb5-3bfadf241aa3 => generated 1808 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:07:44.529012 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-4565ec5b-9a7b-4add-95ac-5faac13bd8d1 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:44.530347 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-4565ec5b-9a7b-4add-95ac-5faac13bd8d1 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] [instance: 8c95f5b8-35dd-4d5e-9ca6-a023614dd859] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:44.544660 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4565ec5b-9a7b-4add-95ac-5faac13bd8d1 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:44.545455 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4565ec5b-9a7b-4add-95ac-5faac13bd8d1 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:44.546090 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4565ec5b-9a7b-4add-95ac-5faac13bd8d1 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:44.546857 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4565ec5b-9a7b-4add-95ac-5faac13bd8d1 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:44.547324 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4565ec5b-9a7b-4add-95ac-5faac13bd8d1 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:44.547764 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4565ec5b-9a7b-4add-95ac-5faac13bd8d1 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:44.647517 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-4565ec5b-9a7b-4add-95ac-5faac13bd8d1 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4797a0a06faf431cb97448684460f58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b18ccd11a84c7888bc34e94320cb45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:44.656964 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-4565ec5b-9a7b-4add-95ac-5faac13bd8d1 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4797a0a06faf431cb97448684460f58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b18ccd11a84c7888bc34e94320cb45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:44.658871 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-4565ec5b-9a7b-4add-95ac-5faac13bd8d1 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4797a0a06faf431cb97448684460f58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b18ccd11a84c7888bc34e94320cb45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:44.660214 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-4565ec5b-9a7b-4add-95ac-5faac13bd8d1 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] 10.222.0.43 "GET /compute/v2.1/servers/8c95f5b8-35dd-4d5e-9ca6-a023614dd859" status: 200 len: 1366 microversion: 2.47 time: 0.135736 Oct 04 19:07:44.660782 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2904/6182] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:07:44 2022] GET /compute/v2.1/servers/8c95f5b8-35dd-4d5e-9ca6-a023614dd859 => generated 1366 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:07:45.394111 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-0438fff5-498d-4502-af00-04bbf68fea5e tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:45.396686 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-0438fff5-498d-4502-af00-04bbf68fea5e tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] [instance: 101952eb-ca4d-489c-8cb5-3bfadf241aa3] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:45.403781 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-91d1e5da-4a00-473b-b9d9-1a2fc5e0f84b tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:45.404377 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-91d1e5da-4a00-473b-b9d9-1a2fc5e0f84b tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] [instance: b01e7e24-c866-4852-9fa8-568f69f68b27] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:45.424029 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-91d1e5da-4a00-473b-b9d9-1a2fc5e0f84b tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:45.424517 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-91d1e5da-4a00-473b-b9d9-1a2fc5e0f84b tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:45.424959 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-91d1e5da-4a00-473b-b9d9-1a2fc5e0f84b tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:45.425714 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-91d1e5da-4a00-473b-b9d9-1a2fc5e0f84b tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:45.430447 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0438fff5-498d-4502-af00-04bbf68fea5e tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:45.431183 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0438fff5-498d-4502-af00-04bbf68fea5e tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:45.432529 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-91d1e5da-4a00-473b-b9d9-1a2fc5e0f84b tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:45.432852 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0438fff5-498d-4502-af00-04bbf68fea5e tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:45.434120 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0438fff5-498d-4502-af00-04bbf68fea5e tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:45.434581 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0438fff5-498d-4502-af00-04bbf68fea5e tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:45.435014 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0438fff5-498d-4502-af00-04bbf68fea5e tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:45.437744 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-91d1e5da-4a00-473b-b9d9-1a2fc5e0f84b tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:45.471089 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-91d1e5da-4a00-473b-b9d9-1a2fc5e0f84b tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] [instance: b01e7e24-c866-4852-9fa8-568f69f68b27] Going to try to terminate instance {{(pid=123595) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 19:07:45.570078 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-91d1e5da-4a00-473b-b9d9-1a2fc5e0f84b tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] 10.222.0.43 "DELETE /compute/v2.1/servers/b01e7e24-c866-4852-9fa8-568f69f68b27" status: 204 len: 0 microversion: 2.1 time: 0.169061 Oct 04 19:07:45.572360 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2905/6183] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 19:07:45 2022] DELETE /compute/v2.1/servers/b01e7e24-c866-4852-9fa8-568f69f68b27 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:07:45.581526 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-d40e8411-8eef-48f0-a991-98602a777175 req-a371a580-9440-48a3-bf34-8012e0cad48d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b01e7e24-c866-4852-9fa8-568f69f68b27", "tag": "fd2276f3-9cc1-4bd3-bf40-500abff51568"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:07:45.596403 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-d40e8411-8eef-48f0-a991-98602a777175 req-a371a580-9440-48a3-bf34-8012e0cad48d service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:45.597229 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-d40e8411-8eef-48f0-a991-98602a777175 req-a371a580-9440-48a3-bf34-8012e0cad48d service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:45.597824 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-d40e8411-8eef-48f0-a991-98602a777175 req-a371a580-9440-48a3-bf34-8012e0cad48d service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:45.611188 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-d40e8411-8eef-48f0-a991-98602a777175 req-a371a580-9440-48a3-bf34-8012e0cad48d service nova] Creating event network-changed:fd2276f3-9cc1-4bd3-bf40-500abff51568 for instance b01e7e24-c866-4852-9fa8-568f69f68b27 on n-h1-851028-13 Oct 04 19:07:45.616163 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-0438fff5-498d-4502-af00-04bbf68fea5e tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:45.618205 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-d40e8411-8eef-48f0-a991-98602a777175 req-a371a580-9440-48a3-bf34-8012e0cad48d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043910 Oct 04 19:07:45.619634 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2906/6184] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:07:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:07:45.627858 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-cf53d8bf-e9d6-46e4-8025-88f26da0780a tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:45.629258 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-cf53d8bf-e9d6-46e4-8025-88f26da0780a tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] [instance: b01e7e24-c866-4852-9fa8-568f69f68b27] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:45.632361 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-0438fff5-498d-4502-af00-04bbf68fea5e tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:45.634282 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-0438fff5-498d-4502-af00-04bbf68fea5e tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:45.635876 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-0438fff5-498d-4502-af00-04bbf68fea5e tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] 10.222.0.43 "GET /compute/v2.1/servers/101952eb-ca4d-489c-8cb5-3bfadf241aa3" status: 200 len: 1795 microversion: 2.20 time: 0.245611 Oct 04 19:07:45.636350 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cf53d8bf-e9d6-46e4-8025-88f26da0780a tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:45.636850 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cf53d8bf-e9d6-46e4-8025-88f26da0780a tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:45.637261 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3279/6185] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:07:45 2022] GET /compute/v2.1/servers/101952eb-ca4d-489c-8cb5-3bfadf241aa3 => generated 1795 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 19:07:45.642186 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cf53d8bf-e9d6-46e4-8025-88f26da0780a tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:45.643268 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cf53d8bf-e9d6-46e4-8025-88f26da0780a tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:45.644127 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cf53d8bf-e9d6-46e4-8025-88f26da0780a tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:45.644805 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cf53d8bf-e9d6-46e4-8025-88f26da0780a tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:45.688715 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-1b886ad5-d9e6-4cf5-9490-9c801ce49356 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:45.689232 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-1b886ad5-d9e6-4cf5-9490-9c801ce49356 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] [instance: 8c95f5b8-35dd-4d5e-9ca6-a023614dd859] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:45.696949 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1b886ad5-d9e6-4cf5-9490-9c801ce49356 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:45.697763 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1b886ad5-d9e6-4cf5-9490-9c801ce49356 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:45.698404 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1b886ad5-d9e6-4cf5-9490-9c801ce49356 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:45.699304 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1b886ad5-d9e6-4cf5-9490-9c801ce49356 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:45.699761 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1b886ad5-d9e6-4cf5-9490-9c801ce49356 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:45.710884 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1b886ad5-d9e6-4cf5-9490-9c801ce49356 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:45.800796 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-1b886ad5-d9e6-4cf5-9490-9c801ce49356 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4797a0a06faf431cb97448684460f58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b18ccd11a84c7888bc34e94320cb45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:45.815493 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-1b886ad5-d9e6-4cf5-9490-9c801ce49356 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4797a0a06faf431cb97448684460f58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b18ccd11a84c7888bc34e94320cb45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:45.821966 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-1b886ad5-d9e6-4cf5-9490-9c801ce49356 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4797a0a06faf431cb97448684460f58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b18ccd11a84c7888bc34e94320cb45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:45.823649 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-1b886ad5-d9e6-4cf5-9490-9c801ce49356 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] 10.222.0.43 "GET /compute/v2.1/servers/8c95f5b8-35dd-4d5e-9ca6-a023614dd859" status: 200 len: 1366 microversion: 2.47 time: 0.138975 Oct 04 19:07:45.824445 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3280/6186] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:07:45 2022] GET /compute/v2.1/servers/8c95f5b8-35dd-4d5e-9ca6-a023614dd859 => generated 1366 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 19:07:45.845359 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-cf53d8bf-e9d6-46e4-8025-88f26da0780a tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf87794979e844349d6ec6c6650565f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c25f1d17e94c74868357744e692487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:45.853739 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-cf53d8bf-e9d6-46e4-8025-88f26da0780a tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] 10.222.0.43 "GET /compute/v2.1/servers/b01e7e24-c866-4852-9fa8-568f69f68b27" status: 200 len: 1690 microversion: 2.1 time: 0.232762 Oct 04 19:07:45.854680 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2907/6187] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:07:45 2022] GET /compute/v2.1/servers/b01e7e24-c866-4852-9fa8-568f69f68b27 => generated 1690 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:07:46.796453 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-9b954b4a-a541-468d-9ac1-2bda302c3e21 req-f18d38bd-2fa9-4531-a6f7-ec74980c11f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b01e7e24-c866-4852-9fa8-568f69f68b27", "name": "network-vif-deleted", "tag": "fd2276f3-9cc1-4bd3-bf40-500abff51568"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:07:46.812304 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-9b954b4a-a541-468d-9ac1-2bda302c3e21 req-f18d38bd-2fa9-4531-a6f7-ec74980c11f5 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:46.812793 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-9b954b4a-a541-468d-9ac1-2bda302c3e21 req-f18d38bd-2fa9-4531-a6f7-ec74980c11f5 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:46.813262 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-9b954b4a-a541-468d-9ac1-2bda302c3e21 req-f18d38bd-2fa9-4531-a6f7-ec74980c11f5 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:46.834382 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-9b954b4a-a541-468d-9ac1-2bda302c3e21 req-f18d38bd-2fa9-4531-a6f7-ec74980c11f5 service nova] Creating event network-vif-deleted:fd2276f3-9cc1-4bd3-bf40-500abff51568 for instance b01e7e24-c866-4852-9fa8-568f69f68b27 on n-h1-851028-13 Oct 04 19:07:46.839862 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-9b954b4a-a541-468d-9ac1-2bda302c3e21 req-f18d38bd-2fa9-4531-a6f7-ec74980c11f5 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048194 Oct 04 19:07:46.841748 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3281/6188] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:07:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:07:46.851807 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-0bca0f57-bac1-4c5a-8ffc-5923f03b59a4 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:46.853399 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-0bca0f57-bac1-4c5a-8ffc-5923f03b59a4 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] [instance: 8c95f5b8-35dd-4d5e-9ca6-a023614dd859] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:46.859272 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0bca0f57-bac1-4c5a-8ffc-5923f03b59a4 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:46.859758 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0bca0f57-bac1-4c5a-8ffc-5923f03b59a4 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:46.860266 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0bca0f57-bac1-4c5a-8ffc-5923f03b59a4 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:46.860978 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0bca0f57-bac1-4c5a-8ffc-5923f03b59a4 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:46.862463 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0bca0f57-bac1-4c5a-8ffc-5923f03b59a4 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:46.862463 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0bca0f57-bac1-4c5a-8ffc-5923f03b59a4 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:46.879166 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-4cbbb1bd-8a96-4c04-b843-57793b9b8362 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:46.879871 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-4cbbb1bd-8a96-4c04-b843-57793b9b8362 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] [instance: b01e7e24-c866-4852-9fa8-568f69f68b27] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:46.887896 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4cbbb1bd-8a96-4c04-b843-57793b9b8362 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:46.889330 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4cbbb1bd-8a96-4c04-b843-57793b9b8362 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:46.889929 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4cbbb1bd-8a96-4c04-b843-57793b9b8362 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:46.890786 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4cbbb1bd-8a96-4c04-b843-57793b9b8362 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:46.891390 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4cbbb1bd-8a96-4c04-b843-57793b9b8362 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:46.891969 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4cbbb1bd-8a96-4c04-b843-57793b9b8362 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:46.930104 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4cbbb1bd-8a96-4c04-b843-57793b9b8362 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:46.930510 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4cbbb1bd-8a96-4c04-b843-57793b9b8362 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:46.931135 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4cbbb1bd-8a96-4c04-b843-57793b9b8362 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:46.931587 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.objects.instance [None req-4cbbb1bd-8a96-4c04-b843-57793b9b8362 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lazy-loading 'fault' on Instance uuid b01e7e24-c866-4852-9fa8-568f69f68b27 {{(pid=123596) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 19:07:46.956639 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-0bca0f57-bac1-4c5a-8ffc-5923f03b59a4 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4797a0a06faf431cb97448684460f58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b18ccd11a84c7888bc34e94320cb45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:46.968326 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-0bca0f57-bac1-4c5a-8ffc-5923f03b59a4 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4797a0a06faf431cb97448684460f58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b18ccd11a84c7888bc34e94320cb45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:46.970236 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-0bca0f57-bac1-4c5a-8ffc-5923f03b59a4 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4797a0a06faf431cb97448684460f58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b18ccd11a84c7888bc34e94320cb45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:46.972031 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-0bca0f57-bac1-4c5a-8ffc-5923f03b59a4 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] 10.222.0.43 "GET /compute/v2.1/servers/8c95f5b8-35dd-4d5e-9ca6-a023614dd859" status: 200 len: 1366 microversion: 2.47 time: 0.125876 Oct 04 19:07:46.973580 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2908/6189] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:07:46 2022] GET /compute/v2.1/servers/8c95f5b8-35dd-4d5e-9ca6-a023614dd859 => generated 1366 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:07:46.976790 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-4cbbb1bd-8a96-4c04-b843-57793b9b8362 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf87794979e844349d6ec6c6650565f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c25f1d17e94c74868357744e692487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:46.984688 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-4cbbb1bd-8a96-4c04-b843-57793b9b8362 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] 10.222.0.43 "GET /compute/v2.1/servers/b01e7e24-c866-4852-9fa8-568f69f68b27" status: 200 len: 1508 microversion: 2.1 time: 0.109677 Oct 04 19:07:46.993094 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3282/6190] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:07:46 2022] GET /compute/v2.1/servers/b01e7e24-c866-4852-9fa8-568f69f68b27 => generated 1508 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:07:47.999838 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-5622de82-9959-4f01-adb6-3fe3417a1d13 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:48.000449 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-5622de82-9959-4f01-adb6-3fe3417a1d13 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] [instance: 8c95f5b8-35dd-4d5e-9ca6-a023614dd859] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:48.008296 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5622de82-9959-4f01-adb6-3fe3417a1d13 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:48.008933 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5622de82-9959-4f01-adb6-3fe3417a1d13 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:48.009661 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5622de82-9959-4f01-adb6-3fe3417a1d13 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:48.010037 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-b0abf47e-cfc8-421f-b492-13c0d56a0419 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:48.010531 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5622de82-9959-4f01-adb6-3fe3417a1d13 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:48.010651 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-b0abf47e-cfc8-421f-b492-13c0d56a0419 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] [instance: b01e7e24-c866-4852-9fa8-568f69f68b27] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:48.011284 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5622de82-9959-4f01-adb6-3fe3417a1d13 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:48.011985 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5622de82-9959-4f01-adb6-3fe3417a1d13 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:48.017463 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b0abf47e-cfc8-421f-b492-13c0d56a0419 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:48.017955 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b0abf47e-cfc8-421f-b492-13c0d56a0419 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:48.018391 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b0abf47e-cfc8-421f-b492-13c0d56a0419 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:48.019096 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b0abf47e-cfc8-421f-b492-13c0d56a0419 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:48.019554 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b0abf47e-cfc8-421f-b492-13c0d56a0419 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:48.019983 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b0abf47e-cfc8-421f-b492-13c0d56a0419 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:48.034760 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-b0abf47e-cfc8-421f-b492-13c0d56a0419 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] HTTP exception thrown: Instance b01e7e24-c866-4852-9fa8-568f69f68b27 could not be found. Oct 04 19:07:48.036490 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-b0abf47e-cfc8-421f-b492-13c0d56a0419 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Request method failure captured: Oct 04 19:07:48.036490 n-d-851028-13 devstack@n-api.service[123596]: request: GET /compute/v2.1/servers/b01e7e24-c866-4852-9fa8-568f69f68b27 HTTP/1.1 Oct 04 19:07:48.036490 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 19:07:48.036490 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 19:07:48.036490 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 19:07:48.036490 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 19:07:48.036490 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 19:07:48.036490 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 19:07:48.036490 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 19:07:48.036490 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 19:07:48.036490 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPILod9KvQgJcndo-fDqHX9zocUdSDU033eT2D_YfhLSFm2T3SN0WEilNuSyZVFJ3atPPN5-bjqRuyPagdPBRhMzT--iezZU7INV-q8_AsQceK3zarsciUbdHJOGGNSClObQM90nB-AfRlEBDQ2E25Vo0hnf-nWJuE-QHVCgcYG2sZm8 Oct 04 19:07:48.036490 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 19:07:48.036490 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 19:07:48.036490 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 19:07:48.036490 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 19:07:48.036490 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 19:07:48.036490 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 19:07:48.036490 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: c0c25f1d17e94c74868357744e692487 Oct 04 19:07:48.036490 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1789911209 Oct 04 19:07:48.036490 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 19:07:48.036490 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 19:07:48.036490 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/c0c25f1d17e94c74868357744e692487"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_c0c25f1d17e94c74868357744e692487"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c0c25f1d17e94c74868357744e692487"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c0c25f1d17e94c74868357744e692487"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 19:07:48.036490 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1789911209 Oct 04 19:07:48.036490 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: c0c25f1d17e94c74868357744e692487 Oct 04 19:07:48.036490 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1789911209 Oct 04 19:07:48.036490 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-TestNetworkAdvancedServerOps-1789911209-project Oct 04 19:07:48.036490 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 19:07:48.036490 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 19:07:48.036490 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: bf87794979e844349d6ec6c6650565f7 Oct 04 19:07:48.036490 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1789911209-project Oct 04 19:07:48.036490 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 19:07:48.036490 n-d-851028-13 devstack@n-api.service[123596]: exception: Instance b01e7e24-c866-4852-9fa8-568f69f68b27 could not be found. Oct 04 19:07:48.036490 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': 'b01e7e24-c866-4852-9fa8-568f69f68b27'} Oct 04 19:07:48.036490 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:07:48.036490 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:07:48.036490 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:07:48.036490 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:07:48.036490 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:07:48.036490 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:07:48.036490 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:07:48.036490 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:07:48.036490 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:07:48.036490 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:07:48.036490 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b01e7e24-c866-4852-9fa8-568f69f68b27 could not be found. Oct 04 19:07:48.036490 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:07:48.036490 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:07:48.036490 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:07:48.036490 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:07:48.036490 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:07:48.036490 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:07:48.036490 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:07:48.036490 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:07:48.036490 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:07:48.036490 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:07:48.036490 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:07:48.036490 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:07:48.036490 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:07:48.036490 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:07:48.036490 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:07:48.036490 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:07:48.036490 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b01e7e24-c866-4852-9fa8-568f69f68b27 could not be found. Oct 04 19:07:48.036490 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:07:48.036490 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:07:48.041081 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:07:48.041081 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:07:48.041081 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:07:48.041081 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:07:48.041081 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:07:48.041081 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:07:48.041081 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b01e7e24-c866-4852-9fa8-568f69f68b27 could not be found. Oct 04 19:07:48.041081 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:07:48.041081 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-b0abf47e-cfc8-421f-b492-13c0d56a0419 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Returning 404 to user: Instance b01e7e24-c866-4852-9fa8-568f69f68b27 could not be found. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:07:48.041081 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-b0abf47e-cfc8-421f-b492-13c0d56a0419 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] 10.222.0.43 "GET /compute/v2.1/servers/b01e7e24-c866-4852-9fa8-568f69f68b27" status: 404 len: 111 microversion: 2.1 time: 0.032433 Oct 04 19:07:48.041081 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3283/6191] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:07:48 2022] GET /compute/v2.1/servers/b01e7e24-c866-4852-9fa8-568f69f68b27 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:07:48.086736 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-5622de82-9959-4f01-adb6-3fe3417a1d13 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4797a0a06faf431cb97448684460f58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b18ccd11a84c7888bc34e94320cb45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:48.095386 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-5622de82-9959-4f01-adb6-3fe3417a1d13 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4797a0a06faf431cb97448684460f58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b18ccd11a84c7888bc34e94320cb45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:48.097147 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-5622de82-9959-4f01-adb6-3fe3417a1d13 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4797a0a06faf431cb97448684460f58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b18ccd11a84c7888bc34e94320cb45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:48.098328 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-5622de82-9959-4f01-adb6-3fe3417a1d13 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] 10.222.0.43 "GET /compute/v2.1/servers/8c95f5b8-35dd-4d5e-9ca6-a023614dd859" status: 200 len: 1366 microversion: 2.47 time: 0.102395 Oct 04 19:07:48.099035 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2909/6192] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:07:47 2022] GET /compute/v2.1/servers/8c95f5b8-35dd-4d5e-9ca6-a023614dd859 => generated 1366 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:07:49.124133 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f7a3131b-c293-4caa-8aaa-365a8ad147dc tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:49.125474 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-f7a3131b-c293-4caa-8aaa-365a8ad147dc tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] [instance: 8c95f5b8-35dd-4d5e-9ca6-a023614dd859] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:49.133363 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f7a3131b-c293-4caa-8aaa-365a8ad147dc tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:49.134068 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f7a3131b-c293-4caa-8aaa-365a8ad147dc tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:49.134659 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f7a3131b-c293-4caa-8aaa-365a8ad147dc tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:49.135548 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f7a3131b-c293-4caa-8aaa-365a8ad147dc tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:49.135986 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f7a3131b-c293-4caa-8aaa-365a8ad147dc tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:49.136583 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f7a3131b-c293-4caa-8aaa-365a8ad147dc tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:49.246907 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-f7a3131b-c293-4caa-8aaa-365a8ad147dc tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4797a0a06faf431cb97448684460f58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b18ccd11a84c7888bc34e94320cb45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:49.257801 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-f7a3131b-c293-4caa-8aaa-365a8ad147dc tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4797a0a06faf431cb97448684460f58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b18ccd11a84c7888bc34e94320cb45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:49.259402 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-f7a3131b-c293-4caa-8aaa-365a8ad147dc tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4797a0a06faf431cb97448684460f58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b18ccd11a84c7888bc34e94320cb45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:49.260800 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-f7a3131b-c293-4caa-8aaa-365a8ad147dc tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] 10.222.0.43 "GET /compute/v2.1/servers/8c95f5b8-35dd-4d5e-9ca6-a023614dd859" status: 200 len: 1366 microversion: 2.47 time: 0.140537 Oct 04 19:07:49.261501 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3284/6193] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:07:49 2022] GET /compute/v2.1/servers/8c95f5b8-35dd-4d5e-9ca6-a023614dd859 => generated 1366 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:07:50.289818 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-e620ba0c-1f42-4ce6-b922-866d6f9a2f2e tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:50.290380 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-e620ba0c-1f42-4ce6-b922-866d6f9a2f2e tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] [instance: 8c95f5b8-35dd-4d5e-9ca6-a023614dd859] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:50.304791 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e620ba0c-1f42-4ce6-b922-866d6f9a2f2e tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:50.307891 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e620ba0c-1f42-4ce6-b922-866d6f9a2f2e tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:50.308531 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e620ba0c-1f42-4ce6-b922-866d6f9a2f2e tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:50.310097 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e620ba0c-1f42-4ce6-b922-866d6f9a2f2e tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:50.311544 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e620ba0c-1f42-4ce6-b922-866d6f9a2f2e tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:50.312624 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e620ba0c-1f42-4ce6-b922-866d6f9a2f2e tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:50.447694 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-e620ba0c-1f42-4ce6-b922-866d6f9a2f2e tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4797a0a06faf431cb97448684460f58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b18ccd11a84c7888bc34e94320cb45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:50.476235 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-e620ba0c-1f42-4ce6-b922-866d6f9a2f2e tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4797a0a06faf431cb97448684460f58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b18ccd11a84c7888bc34e94320cb45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:50.477915 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-e620ba0c-1f42-4ce6-b922-866d6f9a2f2e tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4797a0a06faf431cb97448684460f58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b18ccd11a84c7888bc34e94320cb45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:50.480176 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-e620ba0c-1f42-4ce6-b922-866d6f9a2f2e tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] 10.222.0.43 "GET /compute/v2.1/servers/8c95f5b8-35dd-4d5e-9ca6-a023614dd859" status: 200 len: 1366 microversion: 2.47 time: 0.197057 Oct 04 19:07:50.481915 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2910/6194] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:07:50 2022] GET /compute/v2.1/servers/8c95f5b8-35dd-4d5e-9ca6-a023614dd859 => generated 1366 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:07:51.507406 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f0faca78-691a-4817-bc49-37a0d8d7b172 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:51.508060 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-f0faca78-691a-4817-bc49-37a0d8d7b172 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] [instance: 8c95f5b8-35dd-4d5e-9ca6-a023614dd859] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:51.517680 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f0faca78-691a-4817-bc49-37a0d8d7b172 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:51.518178 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f0faca78-691a-4817-bc49-37a0d8d7b172 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:51.518797 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f0faca78-691a-4817-bc49-37a0d8d7b172 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:51.519515 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f0faca78-691a-4817-bc49-37a0d8d7b172 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:51.519978 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f0faca78-691a-4817-bc49-37a0d8d7b172 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:51.520415 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f0faca78-691a-4817-bc49-37a0d8d7b172 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:51.590291 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-96c8d1d0-1a74-4f88-afb3-0bc0ea81aec4 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Calling method '.version_select at 0x7fb21e9aeee0>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:51.616911 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-f0faca78-691a-4817-bc49-37a0d8d7b172 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4797a0a06faf431cb97448684460f58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b18ccd11a84c7888bc34e94320cb45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:51.633991 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-96c8d1d0-1a74-4f88-afb3-0bc0ea81aec4 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1195087969" status: 202 len: 0 microversion: 2.1 time: 0.057950 Oct 04 19:07:51.635083 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2911/6195] 10.222.0.43 () {58 vars in 1284 bytes} [Tue Oct 4 19:07:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1195087969 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 19:07:51.638599 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-f0faca78-691a-4817-bc49-37a0d8d7b172 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4797a0a06faf431cb97448684460f58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b18ccd11a84c7888bc34e94320cb45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:51.640099 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-f0faca78-691a-4817-bc49-37a0d8d7b172 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4797a0a06faf431cb97448684460f58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b18ccd11a84c7888bc34e94320cb45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:51.641356 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-f0faca78-691a-4817-bc49-37a0d8d7b172 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] 10.222.0.43 "GET /compute/v2.1/servers/8c95f5b8-35dd-4d5e-9ca6-a023614dd859" status: 200 len: 1366 microversion: 2.47 time: 0.138921 Oct 04 19:07:51.643254 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3285/6196] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:07:51 2022] GET /compute/v2.1/servers/8c95f5b8-35dd-4d5e-9ca6-a023614dd859 => generated 1366 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 19:07:51.680151 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-81335a83-be9f-4865-9a3c-4a108d3d94ae tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Action: 'create', calling method: .version_select at 0x7fb21ea36550>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1345898799", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE27R8zpMcNxGBdN6T+oM5OJUiA5/oeOZm11IL92Hu/rZxQWuaplU9i3DLktNd0P1Z1/9ycjvqob4tOm1PVYePc8cEe+WoJMHsxZ63MD5Itdj0Vwioof3gbGlXFWJihVJA=="}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:07:51.697993 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-81335a83-be9f-4865-9a3c-4a108d3d94ae tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Getting quotas for project c0c25f1d17e94c74868357744e692487. Resources: {'key_pairs'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:07:51.703355 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-81335a83-be9f-4865-9a3c-4a108d3d94ae tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Getting quotas for user bf87794979e844349d6ec6c6650565f7 and project c0c25f1d17e94c74868357744e692487. Resources: {'key_pairs'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:07:51.728097 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-81335a83-be9f-4865-9a3c-4a108d3d94ae tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.062275 Oct 04 19:07:51.729015 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2912/6197] 10.222.0.43 () {60 vars in 1159 bytes} [Tue Oct 4 19:07:51 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:07:52.674816 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-34ae70d3-ffdc-4add-b16b-ad73f42981d8 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:52.675494 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-34ae70d3-ffdc-4add-b16b-ad73f42981d8 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] [instance: 8c95f5b8-35dd-4d5e-9ca6-a023614dd859] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:52.682519 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-34ae70d3-ffdc-4add-b16b-ad73f42981d8 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:52.683031 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-34ae70d3-ffdc-4add-b16b-ad73f42981d8 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:52.683493 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-34ae70d3-ffdc-4add-b16b-ad73f42981d8 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:52.684207 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-34ae70d3-ffdc-4add-b16b-ad73f42981d8 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:52.684671 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-34ae70d3-ffdc-4add-b16b-ad73f42981d8 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:52.685504 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-34ae70d3-ffdc-4add-b16b-ad73f42981d8 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:52.765441 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-34ae70d3-ffdc-4add-b16b-ad73f42981d8 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4797a0a06faf431cb97448684460f58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b18ccd11a84c7888bc34e94320cb45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:52.777264 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-34ae70d3-ffdc-4add-b16b-ad73f42981d8 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4797a0a06faf431cb97448684460f58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b18ccd11a84c7888bc34e94320cb45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:52.778770 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-34ae70d3-ffdc-4add-b16b-ad73f42981d8 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4797a0a06faf431cb97448684460f58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b18ccd11a84c7888bc34e94320cb45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:52.779974 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-34ae70d3-ffdc-4add-b16b-ad73f42981d8 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] 10.222.0.43 "GET /compute/v2.1/servers/8c95f5b8-35dd-4d5e-9ca6-a023614dd859" status: 200 len: 1372 microversion: 2.47 time: 0.109067 Oct 04 19:07:52.780725 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3286/6198] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:07:52 2022] GET /compute/v2.1/servers/8c95f5b8-35dd-4d5e-9ca6-a023614dd859 => generated 1372 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:07:53.807239 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-74412e12-e65b-4fbd-9a3f-3731a7c712d0 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:53.807858 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-74412e12-e65b-4fbd-9a3f-3731a7c712d0 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] [instance: 8c95f5b8-35dd-4d5e-9ca6-a023614dd859] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:53.814901 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-74412e12-e65b-4fbd-9a3f-3731a7c712d0 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:53.815389 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-74412e12-e65b-4fbd-9a3f-3731a7c712d0 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:53.815830 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-74412e12-e65b-4fbd-9a3f-3731a7c712d0 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:53.816533 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-74412e12-e65b-4fbd-9a3f-3731a7c712d0 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:53.816988 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-74412e12-e65b-4fbd-9a3f-3731a7c712d0 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:53.817447 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-74412e12-e65b-4fbd-9a3f-3731a7c712d0 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:53.883712 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-74412e12-e65b-4fbd-9a3f-3731a7c712d0 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4797a0a06faf431cb97448684460f58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b18ccd11a84c7888bc34e94320cb45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:53.892120 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-74412e12-e65b-4fbd-9a3f-3731a7c712d0 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4797a0a06faf431cb97448684460f58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b18ccd11a84c7888bc34e94320cb45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:53.893584 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-74412e12-e65b-4fbd-9a3f-3731a7c712d0 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4797a0a06faf431cb97448684460f58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b18ccd11a84c7888bc34e94320cb45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:53.894759 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-74412e12-e65b-4fbd-9a3f-3731a7c712d0 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] 10.222.0.43 "GET /compute/v2.1/servers/8c95f5b8-35dd-4d5e-9ca6-a023614dd859" status: 200 len: 1372 microversion: 2.47 time: 0.091528 Oct 04 19:07:53.895330 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2913/6199] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:07:53 2022] GET /compute/v2.1/servers/8c95f5b8-35dd-4d5e-9ca6-a023614dd859 => generated 1372 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:07:54.921304 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-9c16c6a9-5ea1-493b-ab23-4fd05fd9c266 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:54.921920 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-9c16c6a9-5ea1-493b-ab23-4fd05fd9c266 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] [instance: 8c95f5b8-35dd-4d5e-9ca6-a023614dd859] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:54.925029 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_api:SELECT=77 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:07:54.933275 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9c16c6a9-5ea1-493b-ab23-4fd05fd9c266 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:54.937704 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9c16c6a9-5ea1-493b-ab23-4fd05fd9c266 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:54.940789 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9c16c6a9-5ea1-493b-ab23-4fd05fd9c266 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:54.941826 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9c16c6a9-5ea1-493b-ab23-4fd05fd9c266 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:54.942592 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9c16c6a9-5ea1-493b-ab23-4fd05fd9c266 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:54.943196 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9c16c6a9-5ea1-493b-ab23-4fd05fd9c266 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:55.081814 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-9c16c6a9-5ea1-493b-ab23-4fd05fd9c266 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4797a0a06faf431cb97448684460f58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b18ccd11a84c7888bc34e94320cb45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:55.096459 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-9c16c6a9-5ea1-493b-ab23-4fd05fd9c266 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4797a0a06faf431cb97448684460f58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b18ccd11a84c7888bc34e94320cb45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:55.098038 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-9c16c6a9-5ea1-493b-ab23-4fd05fd9c266 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4797a0a06faf431cb97448684460f58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b18ccd11a84c7888bc34e94320cb45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:55.099962 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-9c16c6a9-5ea1-493b-ab23-4fd05fd9c266 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] 10.222.0.43 "GET /compute/v2.1/servers/8c95f5b8-35dd-4d5e-9ca6-a023614dd859" status: 200 len: 1357 microversion: 2.47 time: 0.182683 Oct 04 19:07:55.102050 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3287/6200] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:07:54 2022] GET /compute/v2.1/servers/8c95f5b8-35dd-4d5e-9ca6-a023614dd859 => generated 1357 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:07:55.129591 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-b76af856-c83a-46d1-87cc-2ac49b179842 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:55.136053 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-b76af856-c83a-46d1-87cc-2ac49b179842 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4797a0a06faf431cb97448684460f58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b18ccd11a84c7888bc34e94320cb45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:55.138031 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-b76af856-c83a-46d1-87cc-2ac49b179842 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Searching by: {'deleted': False, 'project_id': 'd7b18ccd11a84c7888bc34e94320cb45'} {{(pid=123595) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 19:07:55.148898 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b76af856-c83a-46d1-87cc-2ac49b179842 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:55.149649 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b76af856-c83a-46d1-87cc-2ac49b179842 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:55.150238 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b76af856-c83a-46d1-87cc-2ac49b179842 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:55.151243 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b76af856-c83a-46d1-87cc-2ac49b179842 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:55.152373 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b76af856-c83a-46d1-87cc-2ac49b179842 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:55.153157 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b76af856-c83a-46d1-87cc-2ac49b179842 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:55.286011 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.multi_cell_list [None req-b76af856-c83a-46d1-87cc-2ac49b179842 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=123595) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 19:07:55.374052 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-b76af856-c83a-46d1-87cc-2ac49b179842 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4797a0a06faf431cb97448684460f58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b18ccd11a84c7888bc34e94320cb45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:55.383214 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b76af856-c83a-46d1-87cc-2ac49b179842 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:55.383714 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b76af856-c83a-46d1-87cc-2ac49b179842 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:55.384181 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b76af856-c83a-46d1-87cc-2ac49b179842 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:55.398226 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-b76af856-c83a-46d1-87cc-2ac49b179842 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4797a0a06faf431cb97448684460f58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b18ccd11a84c7888bc34e94320cb45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:55.400628 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-b76af856-c83a-46d1-87cc-2ac49b179842 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4797a0a06faf431cb97448684460f58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b18ccd11a84c7888bc34e94320cb45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:55.442654 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-b76af856-c83a-46d1-87cc-2ac49b179842 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] 10.222.0.43 "GET /compute/v2.1/servers/detail" status: 200 len: 2707 microversion: 2.47 time: 0.318841 Oct 04 19:07:55.444034 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2914/6201] 10.222.0.43 () {60 vars in 1187 bytes} [Tue Oct 4 19:07:55 2022] GET /compute/v2.1/servers/detail => generated 2707 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:07:55.483567 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-8b1b7c0c-6504-46b0-a8a7-65d4a2deb7fe tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:55.484311 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-8b1b7c0c-6504-46b0-a8a7-65d4a2deb7fe tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] [instance: 8c95f5b8-35dd-4d5e-9ca6-a023614dd859] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:55.491351 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8b1b7c0c-6504-46b0-a8a7-65d4a2deb7fe tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:55.492440 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8b1b7c0c-6504-46b0-a8a7-65d4a2deb7fe tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:55.493096 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8b1b7c0c-6504-46b0-a8a7-65d4a2deb7fe tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:55.494062 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8b1b7c0c-6504-46b0-a8a7-65d4a2deb7fe tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:55.494722 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8b1b7c0c-6504-46b0-a8a7-65d4a2deb7fe tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:55.495351 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8b1b7c0c-6504-46b0-a8a7-65d4a2deb7fe tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:55.528045 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-8b1b7c0c-6504-46b0-a8a7-65d4a2deb7fe tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] [instance: 8c95f5b8-35dd-4d5e-9ca6-a023614dd859] Going to try to terminate instance {{(pid=123596) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 19:07:55.640089 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-8b1b7c0c-6504-46b0-a8a7-65d4a2deb7fe tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] 10.222.0.43 "DELETE /compute/v2.1/servers/8c95f5b8-35dd-4d5e-9ca6-a023614dd859" status: 204 len: 0 microversion: 2.47 time: 0.160825 Oct 04 19:07:55.641630 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3288/6202] 10.222.0.43 () {60 vars in 1280 bytes} [Tue Oct 4 19:07:55 2022] DELETE /compute/v2.1/servers/8c95f5b8-35dd-4d5e-9ca6-a023614dd859 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 19:07:55.651987 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-609c5bc9-630d-462d-81ce-785dd0e94d96 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:55.653088 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-609c5bc9-630d-462d-81ce-785dd0e94d96 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] [instance: 8c95f5b8-35dd-4d5e-9ca6-a023614dd859] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:55.660855 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-609c5bc9-630d-462d-81ce-785dd0e94d96 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:55.661636 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-609c5bc9-630d-462d-81ce-785dd0e94d96 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:55.662247 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-609c5bc9-630d-462d-81ce-785dd0e94d96 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:55.663721 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-609c5bc9-630d-462d-81ce-785dd0e94d96 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:55.664334 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-609c5bc9-630d-462d-81ce-785dd0e94d96 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:55.664927 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-609c5bc9-630d-462d-81ce-785dd0e94d96 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:55.776841 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-609c5bc9-630d-462d-81ce-785dd0e94d96 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4797a0a06faf431cb97448684460f58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b18ccd11a84c7888bc34e94320cb45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:55.785137 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-609c5bc9-630d-462d-81ce-785dd0e94d96 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4797a0a06faf431cb97448684460f58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b18ccd11a84c7888bc34e94320cb45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:55.786884 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-609c5bc9-630d-462d-81ce-785dd0e94d96 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4797a0a06faf431cb97448684460f58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b18ccd11a84c7888bc34e94320cb45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:55.788920 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-609c5bc9-630d-462d-81ce-785dd0e94d96 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] 10.222.0.43 "GET /compute/v2.1/servers/8c95f5b8-35dd-4d5e-9ca6-a023614dd859" status: 200 len: 1363 microversion: 2.47 time: 0.142246 Oct 04 19:07:55.790024 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2915/6203] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:07:55 2022] GET /compute/v2.1/servers/8c95f5b8-35dd-4d5e-9ca6-a023614dd859 => generated 1363 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:07:56.820312 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-2f2e7966-5436-4cc0-a8c8-c2dcb9686bcd tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:56.821658 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-2f2e7966-5436-4cc0-a8c8-c2dcb9686bcd tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] [instance: 8c95f5b8-35dd-4d5e-9ca6-a023614dd859] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:56.830235 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2f2e7966-5436-4cc0-a8c8-c2dcb9686bcd tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:56.831275 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2f2e7966-5436-4cc0-a8c8-c2dcb9686bcd tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:56.831877 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2f2e7966-5436-4cc0-a8c8-c2dcb9686bcd tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:56.832760 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2f2e7966-5436-4cc0-a8c8-c2dcb9686bcd tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:56.833394 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2f2e7966-5436-4cc0-a8c8-c2dcb9686bcd tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:56.838081 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2f2e7966-5436-4cc0-a8c8-c2dcb9686bcd tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:56.936362 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-2f2e7966-5436-4cc0-a8c8-c2dcb9686bcd tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4797a0a06faf431cb97448684460f58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b18ccd11a84c7888bc34e94320cb45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:56.949718 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-2f2e7966-5436-4cc0-a8c8-c2dcb9686bcd tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4797a0a06faf431cb97448684460f58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b18ccd11a84c7888bc34e94320cb45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:56.951180 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-2f2e7966-5436-4cc0-a8c8-c2dcb9686bcd tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4797a0a06faf431cb97448684460f58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b18ccd11a84c7888bc34e94320cb45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:56.952394 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-2f2e7966-5436-4cc0-a8c8-c2dcb9686bcd tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] 10.222.0.43 "GET /compute/v2.1/servers/8c95f5b8-35dd-4d5e-9ca6-a023614dd859" status: 200 len: 1363 microversion: 2.47 time: 0.137676 Oct 04 19:07:56.952960 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3289/6204] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:07:56 2022] GET /compute/v2.1/servers/8c95f5b8-35dd-4d5e-9ca6-a023614dd859 => generated 1363 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:07:57.986468 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-0f6ba26e-945a-409b-b108-70a5b25df2f6 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:57.992366 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-0f6ba26e-945a-409b-b108-70a5b25df2f6 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] [instance: 8c95f5b8-35dd-4d5e-9ca6-a023614dd859] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:58.005974 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0f6ba26e-945a-409b-b108-70a5b25df2f6 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:58.013956 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0f6ba26e-945a-409b-b108-70a5b25df2f6 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:58.014667 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0f6ba26e-945a-409b-b108-70a5b25df2f6 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:58.023717 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0f6ba26e-945a-409b-b108-70a5b25df2f6 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:58.027275 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0f6ba26e-945a-409b-b108-70a5b25df2f6 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:58.028027 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0f6ba26e-945a-409b-b108-70a5b25df2f6 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:58.071963 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:07:58.130428 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0f6ba26e-945a-409b-b108-70a5b25df2f6 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:58.131889 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0f6ba26e-945a-409b-b108-70a5b25df2f6 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:58.132558 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0f6ba26e-945a-409b-b108-70a5b25df2f6 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:58.133243 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.objects.instance [None req-0f6ba26e-945a-409b-b108-70a5b25df2f6 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lazy-loading 'fault' on Instance uuid 8c95f5b8-35dd-4d5e-9ca6-a023614dd859 {{(pid=123595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 19:07:58.713040 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-0f6ba26e-945a-409b-b108-70a5b25df2f6 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4797a0a06faf431cb97448684460f58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b18ccd11a84c7888bc34e94320cb45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:58.722026 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-0f6ba26e-945a-409b-b108-70a5b25df2f6 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4797a0a06faf431cb97448684460f58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b18ccd11a84c7888bc34e94320cb45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:58.723904 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-0f6ba26e-945a-409b-b108-70a5b25df2f6 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4797a0a06faf431cb97448684460f58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b18ccd11a84c7888bc34e94320cb45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:58.725582 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-0f6ba26e-945a-409b-b108-70a5b25df2f6 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] 10.222.0.43 "GET /compute/v2.1/servers/8c95f5b8-35dd-4d5e-9ca6-a023614dd859" status: 200 len: 1368 microversion: 2.47 time: 0.743673 Oct 04 19:07:58.726905 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2916/6205] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:07:57 2022] GET /compute/v2.1/servers/8c95f5b8-35dd-4d5e-9ca6-a023614dd859 => generated 1368 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:07:59.087402 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-8bb9274d-f2c8-4579-b4a7-93765bf01693 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1999827139", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452", "networks": [{"uuid": "0871005d-5e7e-4166-913b-2257280fa9c6"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1345898799", "security_groups": [{"name": "tempest-secgroup-smoke-1023047659"}]}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:07:59.260418 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.network.neutron [None req-8bb9274d-f2c8-4579-b4a7-93765bf01693 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] validate_networks() for [('0871005d-5e7e-4166-913b-2257280fa9c6', None, None, None, None, None)] {{(pid=123596) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 19:07:59.754027 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-8bb9274d-f2c8-4579-b4a7-93765bf01693 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Flavor limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:07:59.754818 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-8bb9274d-f2c8-4579-b4a7-93765bf01693 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Image limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:07:59.755520 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-8bb9274d-f2c8-4579-b4a7-93765bf01693 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Flavor pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:07:59.756197 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-8bb9274d-f2c8-4579-b4a7-93765bf01693 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Image pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:07:59.757384 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-8bb9274d-f2c8-4579-b4a7-93765bf01693 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:07:59.757952 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-5cb8a6fb-3a8f-4968-963f-0e297de57d74 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:59.758592 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-5cb8a6fb-3a8f-4968-963f-0e297de57d74 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] [instance: 8c95f5b8-35dd-4d5e-9ca6-a023614dd859] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:59.766657 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5cb8a6fb-3a8f-4968-963f-0e297de57d74 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:59.769715 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8bb9274d-f2c8-4579-b4a7-93765bf01693 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:59.770481 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8bb9274d-f2c8-4579-b4a7-93765bf01693 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:59.771328 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8bb9274d-f2c8-4579-b4a7-93765bf01693 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:59.773984 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8bb9274d-f2c8-4579-b4a7-93765bf01693 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:59.774234 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5cb8a6fb-3a8f-4968-963f-0e297de57d74 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:59.774705 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5cb8a6fb-3a8f-4968-963f-0e297de57d74 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:59.775124 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8bb9274d-f2c8-4579-b4a7-93765bf01693 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:59.775455 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5cb8a6fb-3a8f-4968-963f-0e297de57d74 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:59.775925 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5cb8a6fb-3a8f-4968-963f-0e297de57d74 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:59.776204 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8bb9274d-f2c8-4579-b4a7-93765bf01693 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:59.776382 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5cb8a6fb-3a8f-4968-963f-0e297de57d74 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:59.795440 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-5cb8a6fb-3a8f-4968-963f-0e297de57d74 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] HTTP exception thrown: Instance 8c95f5b8-35dd-4d5e-9ca6-a023614dd859 could not be found. Oct 04 19:07:59.799492 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-5cb8a6fb-3a8f-4968-963f-0e297de57d74 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Request method failure captured: Oct 04 19:07:59.799492 n-d-851028-13 devstack@n-api.service[123595]: request: GET /compute/v2.1/servers/8c95f5b8-35dd-4d5e-9ca6-a023614dd859 HTTP/1.1 Oct 04 19:07:59.799492 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 19:07:59.799492 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 19:07:59.799492 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 19:07:59.799492 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 0 Oct 04 19:07:59.799492 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 19:07:59.799492 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 19:07:59.799492 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 19:07:59.799492 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 19:07:59.799492 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPIRitBsjtlY2eXxoSUrWQGPIVb2XJurTwepjlGTyW5gV3X2lZU5dQLEdw1dC6piidk446lyy9yIi377h7OfD0-KfoLtANsaxtTA1KNBV5uGwiQStfdfLbomvA8cGTEu2SwgAed0YRmBgl9xldFDh7GarH8y4yzrIByZu2gjjoIlh8q4 Oct 04 19:07:59.799492 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 19:07:59.799492 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 19:07:59.799492 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 19:07:59.799492 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 19:07:59.799492 n-d-851028-13 devstack@n-api.service[123595]: X-Openstack-Nova-Api-Version: 2.47 Oct 04 19:07:59.799492 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 19:07:59.799492 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 19:07:59.799492 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: d7b18ccd11a84c7888bc34e94320cb45 Oct 04 19:07:59.799492 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-ServerShowV247Test-449061005 Oct 04 19:07:59.799492 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 19:07:59.799492 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 19:07:59.799492 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/d7b18ccd11a84c7888bc34e94320cb45"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_d7b18ccd11a84c7888bc34e94320cb45"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d7b18ccd11a84c7888bc34e94320cb45"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d7b18ccd11a84c7888bc34e94320cb45"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 19:07:59.799492 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-ServerShowV247Test-449061005 Oct 04 19:07:59.799492 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: d7b18ccd11a84c7888bc34e94320cb45 Oct 04 19:07:59.799492 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-ServerShowV247Test-449061005 Oct 04 19:07:59.799492 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-ServerShowV247Test-449061005-project Oct 04 19:07:59.799492 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 19:07:59.799492 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 19:07:59.799492 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: 4797a0a06faf431cb97448684460f58e Oct 04 19:07:59.799492 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-ServerShowV247Test-449061005-project Oct 04 19:07:59.799492 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 19:07:59.799492 n-d-851028-13 devstack@n-api.service[123595]: exception: Instance 8c95f5b8-35dd-4d5e-9ca6-a023614dd859 could not be found. Oct 04 19:07:59.799492 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': '8c95f5b8-35dd-4d5e-9ca6-a023614dd859'} Oct 04 19:07:59.799492 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:07:59.799492 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:07:59.799492 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:07:59.799492 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:07:59.799492 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:07:59.799492 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:07:59.799492 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:07:59.799492 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:07:59.799492 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:07:59.799492 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:07:59.799492 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c95f5b8-35dd-4d5e-9ca6-a023614dd859 could not be found. Oct 04 19:07:59.799492 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:07:59.799492 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:07:59.799492 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:07:59.799492 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:07:59.799492 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:07:59.799492 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:07:59.799492 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:07:59.799492 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:07:59.799492 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:07:59.799492 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:07:59.799492 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:07:59.799492 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:07:59.799492 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:07:59.799492 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:07:59.799492 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:07:59.799492 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:07:59.799492 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c95f5b8-35dd-4d5e-9ca6-a023614dd859 could not be found. Oct 04 19:07:59.799492 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:07:59.799492 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:07:59.799492 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:07:59.803611 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:07:59.803611 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:07:59.803611 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:07:59.803611 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:07:59.803611 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:07:59.803611 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c95f5b8-35dd-4d5e-9ca6-a023614dd859 could not be found. Oct 04 19:07:59.803611 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:07:59.805372 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-5cb8a6fb-3a8f-4968-963f-0e297de57d74 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Returning 404 to user: Instance 8c95f5b8-35dd-4d5e-9ca6-a023614dd859 could not be found. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:07:59.806401 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-5cb8a6fb-3a8f-4968-963f-0e297de57d74 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] 10.222.0.43 "GET /compute/v2.1/servers/8c95f5b8-35dd-4d5e-9ca6-a023614dd859" status: 404 len: 111 microversion: 2.47 time: 0.053411 Oct 04 19:07:59.807459 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2917/6206] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:07:59 2022] GET /compute/v2.1/servers/8c95f5b8-35dd-4d5e-9ca6-a023614dd859 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 19:07:59.815597 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-826918ff-d7df-4835-bd16-0a8f60859794 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:59.816170 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:07:59.816508 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-826918ff-d7df-4835-bd16-0a8f60859794 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] [instance: 9a0fdfda-c32f-4eb6-bc66-64756354b77e] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:59.823440 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-826918ff-d7df-4835-bd16-0a8f60859794 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:59.824158 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-826918ff-d7df-4835-bd16-0a8f60859794 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:59.825997 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-826918ff-d7df-4835-bd16-0a8f60859794 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:59.826989 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-826918ff-d7df-4835-bd16-0a8f60859794 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:59.827597 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-826918ff-d7df-4835-bd16-0a8f60859794 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:59.828176 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-826918ff-d7df-4835-bd16-0a8f60859794 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:59.843979 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-8bb9274d-f2c8-4579-b4a7-93765bf01693 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Getting quotas for project c0c25f1d17e94c74868357744e692487. Resources: {'ram', 'cores', 'instances'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:07:59.868049 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-826918ff-d7df-4835-bd16-0a8f60859794 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] [instance: 9a0fdfda-c32f-4eb6-bc66-64756354b77e] Going to try to terminate instance {{(pid=123595) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 19:07:59.869131 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-8bb9274d-f2c8-4579-b4a7-93765bf01693 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Getting quotas for user bf87794979e844349d6ec6c6650565f7 and project c0c25f1d17e94c74868357744e692487. Resources: {'ram', 'cores', 'instances'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:07:59.898706 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-8bb9274d-f2c8-4579-b4a7-93765bf01693 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Going to run 1 instances... {{(pid=123596) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 19:07:59.901137 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-8bb9274d-f2c8-4579-b4a7-93765bf01693 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] [instance: 021d75cf-769e-47ee-87a7-3e19da9e9bf4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e8943ec5-4038-4d4b-b9b9-2415a79f5243',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123596) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 19:07:59.967419 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-8bb9274d-f2c8-4579-b4a7-93765bf01693 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.885161 Oct 04 19:07:59.968412 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3290/6207] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 19:07:59 2022] POST /compute/v2.1/servers => generated 406 bytes in 887 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 19:07:59.981880 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f6741615-8dfa-4602-b35e-9298d009aba4 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:59.983600 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-f6741615-8dfa-4602-b35e-9298d009aba4 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] [instance: 021d75cf-769e-47ee-87a7-3e19da9e9bf4] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:08:00.012395 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-826918ff-d7df-4835-bd16-0a8f60859794 tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] 10.222.0.43 "DELETE /compute/v2.1/servers/9a0fdfda-c32f-4eb6-bc66-64756354b77e" status: 204 len: 0 microversion: 2.47 time: 0.200350 Oct 04 19:08:00.015775 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2918/6208] 10.222.0.43 () {60 vars in 1280 bytes} [Tue Oct 4 19:07:59 2022] DELETE /compute/v2.1/servers/9a0fdfda-c32f-4eb6-bc66-64756354b77e => generated 0 bytes in 202 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 19:08:00.034062 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-674984c3-d3c7-4f94-808e-3c17c387666b tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:08:00.035350 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-674984c3-d3c7-4f94-808e-3c17c387666b tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] [instance: 9a0fdfda-c32f-4eb6-bc66-64756354b77e] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:08:00.075573 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-674984c3-d3c7-4f94-808e-3c17c387666b tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:00.076147 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-674984c3-d3c7-4f94-808e-3c17c387666b tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:00.077154 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-674984c3-d3c7-4f94-808e-3c17c387666b tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:00.077363 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-674984c3-d3c7-4f94-808e-3c17c387666b tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:00.077830 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-674984c3-d3c7-4f94-808e-3c17c387666b tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:00.078364 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-674984c3-d3c7-4f94-808e-3c17c387666b tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:00.144938 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-f6741615-8dfa-4602-b35e-9298d009aba4 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf87794979e844349d6ec6c6650565f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c25f1d17e94c74868357744e692487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:08:00.158483 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-f6741615-8dfa-4602-b35e-9298d009aba4 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] 10.222.0.43 "GET /compute/v2.1/servers/021d75cf-769e-47ee-87a7-3e19da9e9bf4" status: 200 len: 1267 microversion: 2.1 time: 0.178515 Oct 04 19:08:00.160807 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3291/6209] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:07:59 2022] GET /compute/v2.1/servers/021d75cf-769e-47ee-87a7-3e19da9e9bf4 => generated 1267 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:08:00.218336 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-674984c3-d3c7-4f94-808e-3c17c387666b tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4797a0a06faf431cb97448684460f58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b18ccd11a84c7888bc34e94320cb45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:08:00.229974 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-674984c3-d3c7-4f94-808e-3c17c387666b tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4797a0a06faf431cb97448684460f58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b18ccd11a84c7888bc34e94320cb45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:08:00.238631 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-674984c3-d3c7-4f94-808e-3c17c387666b tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4797a0a06faf431cb97448684460f58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b18ccd11a84c7888bc34e94320cb45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:08:00.239995 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-674984c3-d3c7-4f94-808e-3c17c387666b tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] 10.222.0.43 "GET /compute/v2.1/servers/9a0fdfda-c32f-4eb6-bc66-64756354b77e" status: 200 len: 1363 microversion: 2.47 time: 0.222799 Oct 04 19:08:00.242433 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2919/6210] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:08:00 2022] GET /compute/v2.1/servers/9a0fdfda-c32f-4eb6-bc66-64756354b77e => generated 1363 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:08:01.186959 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-d73bfbc1-465a-461b-8cce-ec9eec744d2f tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:08:01.188157 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-d73bfbc1-465a-461b-8cce-ec9eec744d2f tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] [instance: 021d75cf-769e-47ee-87a7-3e19da9e9bf4] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:08:01.199176 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d73bfbc1-465a-461b-8cce-ec9eec744d2f tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:01.199679 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d73bfbc1-465a-461b-8cce-ec9eec744d2f tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:01.200126 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d73bfbc1-465a-461b-8cce-ec9eec744d2f tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:01.200848 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d73bfbc1-465a-461b-8cce-ec9eec744d2f tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:01.201348 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d73bfbc1-465a-461b-8cce-ec9eec744d2f tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:01.201784 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d73bfbc1-465a-461b-8cce-ec9eec744d2f tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:01.270242 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-a72d44c0-dd43-40e0-969e-3ff866355b1e tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:08:01.271415 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-a72d44c0-dd43-40e0-969e-3ff866355b1e tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] [instance: 9a0fdfda-c32f-4eb6-bc66-64756354b77e] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:08:01.284659 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a72d44c0-dd43-40e0-969e-3ff866355b1e tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:01.285414 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a72d44c0-dd43-40e0-969e-3ff866355b1e tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:01.286002 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a72d44c0-dd43-40e0-969e-3ff866355b1e tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:01.286868 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a72d44c0-dd43-40e0-969e-3ff866355b1e tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:01.287325 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a72d44c0-dd43-40e0-969e-3ff866355b1e tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:01.287753 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a72d44c0-dd43-40e0-969e-3ff866355b1e tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:01.306428 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-d73bfbc1-465a-461b-8cce-ec9eec744d2f tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf87794979e844349d6ec6c6650565f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c25f1d17e94c74868357744e692487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:08:01.317802 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-d73bfbc1-465a-461b-8cce-ec9eec744d2f tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] 10.222.0.43 "GET /compute/v2.1/servers/021d75cf-769e-47ee-87a7-3e19da9e9bf4" status: 200 len: 1319 microversion: 2.1 time: 0.133555 Oct 04 19:08:01.336420 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3292/6211] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:08:01 2022] GET /compute/v2.1/servers/021d75cf-769e-47ee-87a7-3e19da9e9bf4 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:08:01.371508 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-a72d44c0-dd43-40e0-969e-3ff866355b1e tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4797a0a06faf431cb97448684460f58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b18ccd11a84c7888bc34e94320cb45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:08:01.382561 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-a72d44c0-dd43-40e0-969e-3ff866355b1e tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4797a0a06faf431cb97448684460f58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b18ccd11a84c7888bc34e94320cb45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:08:01.385788 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-a72d44c0-dd43-40e0-969e-3ff866355b1e tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4797a0a06faf431cb97448684460f58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b18ccd11a84c7888bc34e94320cb45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:08:01.387720 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-a72d44c0-dd43-40e0-969e-3ff866355b1e tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] 10.222.0.43 "GET /compute/v2.1/servers/9a0fdfda-c32f-4eb6-bc66-64756354b77e" status: 200 len: 1363 microversion: 2.47 time: 0.121437 Oct 04 19:08:01.388774 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2920/6212] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:08:01 2022] GET /compute/v2.1/servers/9a0fdfda-c32f-4eb6-bc66-64756354b77e => generated 1363 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:08:02.346378 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-23c874a6-f3db-46d2-958b-fd65eb0e78a0 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:08:02.347727 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-23c874a6-f3db-46d2-958b-fd65eb0e78a0 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] [instance: 021d75cf-769e-47ee-87a7-3e19da9e9bf4] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:08:02.361366 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-23c874a6-f3db-46d2-958b-fd65eb0e78a0 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:02.363136 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-23c874a6-f3db-46d2-958b-fd65eb0e78a0 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:02.364950 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-23c874a6-f3db-46d2-958b-fd65eb0e78a0 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:02.365959 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-23c874a6-f3db-46d2-958b-fd65eb0e78a0 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:02.369235 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-23c874a6-f3db-46d2-958b-fd65eb0e78a0 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:02.370320 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-23c874a6-f3db-46d2-958b-fd65eb0e78a0 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:02.414519 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-077ab060-be7d-4519-9339-0ba60366bcbe tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:08:02.415724 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-077ab060-be7d-4519-9339-0ba60366bcbe tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] [instance: 9a0fdfda-c32f-4eb6-bc66-64756354b77e] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:08:02.437532 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-077ab060-be7d-4519-9339-0ba60366bcbe tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:02.439020 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-077ab060-be7d-4519-9339-0ba60366bcbe tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:02.440453 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-077ab060-be7d-4519-9339-0ba60366bcbe tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:02.447167 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-077ab060-be7d-4519-9339-0ba60366bcbe tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:02.448004 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-077ab060-be7d-4519-9339-0ba60366bcbe tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:02.448482 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-077ab060-be7d-4519-9339-0ba60366bcbe tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:02.528289 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-077ab060-be7d-4519-9339-0ba60366bcbe tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:02.530981 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-077ab060-be7d-4519-9339-0ba60366bcbe tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:02.531471 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-077ab060-be7d-4519-9339-0ba60366bcbe tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:02.533350 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.objects.instance [None req-077ab060-be7d-4519-9339-0ba60366bcbe tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lazy-loading 'fault' on Instance uuid 9a0fdfda-c32f-4eb6-bc66-64756354b77e {{(pid=123595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 19:08:02.622040 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-077ab060-be7d-4519-9339-0ba60366bcbe tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4797a0a06faf431cb97448684460f58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b18ccd11a84c7888bc34e94320cb45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:08:02.637906 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-077ab060-be7d-4519-9339-0ba60366bcbe tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4797a0a06faf431cb97448684460f58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b18ccd11a84c7888bc34e94320cb45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:08:02.647201 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-077ab060-be7d-4519-9339-0ba60366bcbe tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4797a0a06faf431cb97448684460f58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b18ccd11a84c7888bc34e94320cb45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:08:02.649538 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-077ab060-be7d-4519-9339-0ba60366bcbe tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] 10.222.0.43 "GET /compute/v2.1/servers/9a0fdfda-c32f-4eb6-bc66-64756354b77e" status: 200 len: 1368 microversion: 2.47 time: 0.239812 Oct 04 19:08:02.652202 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2921/6213] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:08:02 2022] GET /compute/v2.1/servers/9a0fdfda-c32f-4eb6-bc66-64756354b77e => generated 1368 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 19:08:02.861488 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-23c874a6-f3db-46d2-958b-fd65eb0e78a0 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf87794979e844349d6ec6c6650565f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c25f1d17e94c74868357744e692487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:08:02.872312 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-23c874a6-f3db-46d2-958b-fd65eb0e78a0 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] 10.222.0.43 "GET /compute/v2.1/servers/021d75cf-769e-47ee-87a7-3e19da9e9bf4" status: 200 len: 1393 microversion: 2.1 time: 0.530433 Oct 04 19:08:02.873936 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3293/6214] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:08:02 2022] GET /compute/v2.1/servers/021d75cf-769e-47ee-87a7-3e19da9e9bf4 => generated 1393 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:08:03.682910 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-95697658-b720-4684-aacc-bb166a46d04e tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:08:03.683834 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-95697658-b720-4684-aacc-bb166a46d04e tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] [instance: 9a0fdfda-c32f-4eb6-bc66-64756354b77e] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:08:03.691091 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-95697658-b720-4684-aacc-bb166a46d04e tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:03.691734 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-95697658-b720-4684-aacc-bb166a46d04e tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:03.692278 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-95697658-b720-4684-aacc-bb166a46d04e tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:03.693064 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-95697658-b720-4684-aacc-bb166a46d04e tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:03.693746 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-95697658-b720-4684-aacc-bb166a46d04e tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:03.694878 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-95697658-b720-4684-aacc-bb166a46d04e tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:03.709449 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-95697658-b720-4684-aacc-bb166a46d04e tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] HTTP exception thrown: Instance 9a0fdfda-c32f-4eb6-bc66-64756354b77e could not be found. Oct 04 19:08:03.711780 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-95697658-b720-4684-aacc-bb166a46d04e tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Request method failure captured: Oct 04 19:08:03.711780 n-d-851028-13 devstack@n-api.service[123595]: request: GET /compute/v2.1/servers/9a0fdfda-c32f-4eb6-bc66-64756354b77e HTTP/1.1 Oct 04 19:08:03.711780 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 19:08:03.711780 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 19:08:03.711780 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 19:08:03.711780 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 0 Oct 04 19:08:03.711780 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 19:08:03.711780 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 19:08:03.711780 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 19:08:03.711780 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 19:08:03.711780 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPIRitBsjtlY2eXxoSUrWQGPIVb2XJurTwepjlGTyW5gV3X2lZU5dQLEdw1dC6piidk446lyy9yIi377h7OfD0-KfoLtANsaxtTA1KNBV5uGwiQStfdfLbomvA8cGTEu2SwgAed0YRmBgl9xldFDh7GarH8y4yzrIByZu2gjjoIlh8q4 Oct 04 19:08:03.711780 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 19:08:03.711780 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 19:08:03.711780 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 19:08:03.711780 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 19:08:03.711780 n-d-851028-13 devstack@n-api.service[123595]: X-Openstack-Nova-Api-Version: 2.47 Oct 04 19:08:03.711780 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 19:08:03.711780 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 19:08:03.711780 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: d7b18ccd11a84c7888bc34e94320cb45 Oct 04 19:08:03.711780 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-ServerShowV247Test-449061005 Oct 04 19:08:03.711780 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 19:08:03.711780 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 19:08:03.711780 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/d7b18ccd11a84c7888bc34e94320cb45"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_d7b18ccd11a84c7888bc34e94320cb45"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d7b18ccd11a84c7888bc34e94320cb45"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d7b18ccd11a84c7888bc34e94320cb45"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 19:08:03.711780 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-ServerShowV247Test-449061005 Oct 04 19:08:03.711780 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: d7b18ccd11a84c7888bc34e94320cb45 Oct 04 19:08:03.711780 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-ServerShowV247Test-449061005 Oct 04 19:08:03.711780 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-ServerShowV247Test-449061005-project Oct 04 19:08:03.711780 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 19:08:03.711780 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 19:08:03.711780 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: 4797a0a06faf431cb97448684460f58e Oct 04 19:08:03.711780 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-ServerShowV247Test-449061005-project Oct 04 19:08:03.711780 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 19:08:03.711780 n-d-851028-13 devstack@n-api.service[123595]: exception: Instance 9a0fdfda-c32f-4eb6-bc66-64756354b77e could not be found. Oct 04 19:08:03.711780 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': '9a0fdfda-c32f-4eb6-bc66-64756354b77e'} Oct 04 19:08:03.711780 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:08:03.711780 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:08:03.711780 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:08:03.711780 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:08:03.711780 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:08:03.711780 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:08:03.711780 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:08:03.711780 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:08:03.711780 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:08:03.711780 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:08:03.711780 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a0fdfda-c32f-4eb6-bc66-64756354b77e could not be found. Oct 04 19:08:03.711780 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:08:03.711780 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:08:03.711780 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:08:03.711780 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:08:03.711780 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:08:03.711780 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:08:03.711780 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:08:03.711780 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:08:03.711780 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:08:03.711780 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:08:03.711780 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:08:03.711780 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:08:03.711780 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:08:03.711780 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:08:03.711780 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:08:03.711780 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:08:03.711780 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a0fdfda-c32f-4eb6-bc66-64756354b77e could not be found. Oct 04 19:08:03.711780 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:08:03.711780 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:08:03.711780 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:08:03.719821 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:08:03.719821 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:08:03.719821 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:08:03.719821 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:08:03.719821 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:08:03.719821 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a0fdfda-c32f-4eb6-bc66-64756354b77e could not be found. Oct 04 19:08:03.719821 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:08:03.719821 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-95697658-b720-4684-aacc-bb166a46d04e tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] Returning 404 to user: Instance 9a0fdfda-c32f-4eb6-bc66-64756354b77e could not be found. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:08:03.719821 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-95697658-b720-4684-aacc-bb166a46d04e tempest-ServerShowV247Test-449061005 tempest-ServerShowV247Test-449061005-project] 10.222.0.43 "GET /compute/v2.1/servers/9a0fdfda-c32f-4eb6-bc66-64756354b77e" status: 404 len: 111 microversion: 2.47 time: 0.035399 Oct 04 19:08:03.719821 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2922/6215] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:08:03 2022] GET /compute/v2.1/servers/9a0fdfda-c32f-4eb6-bc66-64756354b77e => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 19:08:03.897548 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-128a7f23-a8fc-4271-9872-924953246af7 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:08:03.898174 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-128a7f23-a8fc-4271-9872-924953246af7 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] [instance: 021d75cf-769e-47ee-87a7-3e19da9e9bf4] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:08:03.911004 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-128a7f23-a8fc-4271-9872-924953246af7 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:03.911514 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-128a7f23-a8fc-4271-9872-924953246af7 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:03.912624 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-128a7f23-a8fc-4271-9872-924953246af7 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:03.913433 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-128a7f23-a8fc-4271-9872-924953246af7 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:03.913899 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-128a7f23-a8fc-4271-9872-924953246af7 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:03.914489 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-128a7f23-a8fc-4271-9872-924953246af7 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:04.108986 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-e137c381-a06d-4344-a7ab-37588418aa67 req-3a802793-f350-4771-9548-13117cd789e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "021d75cf-769e-47ee-87a7-3e19da9e9bf4", "tag": "28ebdde4-3296-4851-b0f6-5feb9448703b"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:08:04.128861 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-e137c381-a06d-4344-a7ab-37588418aa67 req-3a802793-f350-4771-9548-13117cd789e8 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:04.129423 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-e137c381-a06d-4344-a7ab-37588418aa67 req-3a802793-f350-4771-9548-13117cd789e8 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:04.131341 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-e137c381-a06d-4344-a7ab-37588418aa67 req-3a802793-f350-4771-9548-13117cd789e8 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:04.152263 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-128a7f23-a8fc-4271-9872-924953246af7 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf87794979e844349d6ec6c6650565f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c25f1d17e94c74868357744e692487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:08:04.164448 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-128a7f23-a8fc-4271-9872-924953246af7 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] 10.222.0.43 "GET /compute/v2.1/servers/021d75cf-769e-47ee-87a7-3e19da9e9bf4" status: 200 len: 1393 microversion: 2.1 time: 0.271419 Oct 04 19:08:04.165050 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3294/6216] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:08:03 2022] GET /compute/v2.1/servers/021d75cf-769e-47ee-87a7-3e19da9e9bf4 => generated 1393 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:08:04.187219 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-e137c381-a06d-4344-a7ab-37588418aa67 req-3a802793-f350-4771-9548-13117cd789e8 service nova] Creating event network-changed:28ebdde4-3296-4851-b0f6-5feb9448703b for instance 021d75cf-769e-47ee-87a7-3e19da9e9bf4 on n-h2-851028-13 Oct 04 19:08:04.200472 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-e137c381-a06d-4344-a7ab-37588418aa67 req-3a802793-f350-4771-9548-13117cd789e8 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097008 Oct 04 19:08:04.201095 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2923/6217] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:08:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:08:05.187549 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-33fd8870-0ec9-4211-8765-0bc38c15874d tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:08:05.188171 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-33fd8870-0ec9-4211-8765-0bc38c15874d tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] [instance: 021d75cf-769e-47ee-87a7-3e19da9e9bf4] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:08:05.195928 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-33fd8870-0ec9-4211-8765-0bc38c15874d tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:05.196601 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-33fd8870-0ec9-4211-8765-0bc38c15874d tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:05.197441 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-33fd8870-0ec9-4211-8765-0bc38c15874d tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:05.198154 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-33fd8870-0ec9-4211-8765-0bc38c15874d tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:05.198623 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-33fd8870-0ec9-4211-8765-0bc38c15874d tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:05.199041 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-33fd8870-0ec9-4211-8765-0bc38c15874d tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:05.354343 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-33fd8870-0ec9-4211-8765-0bc38c15874d tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf87794979e844349d6ec6c6650565f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c25f1d17e94c74868357744e692487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:08:05.363067 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-33fd8870-0ec9-4211-8765-0bc38c15874d tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] 10.222.0.43 "GET /compute/v2.1/servers/021d75cf-769e-47ee-87a7-3e19da9e9bf4" status: 200 len: 1393 microversion: 2.1 time: 0.179851 Oct 04 19:08:05.364981 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3295/6218] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:08:05 2022] GET /compute/v2.1/servers/021d75cf-769e-47ee-87a7-3e19da9e9bf4 => generated 1393 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:08:05.421138 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-e137c381-a06d-4344-a7ab-37588418aa67 req-3a802793-f350-4771-9548-13117cd789e8 service nova] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:08:05.422230 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-e137c381-a06d-4344-a7ab-37588418aa67 req-3a802793-f350-4771-9548-13117cd789e8 service nova] 10.222.0.43 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001588 Oct 04 19:08:05.422550 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2924/6219] 10.222.0.43 () {56 vars in 886 bytes} [Tue Oct 4 19:08:05 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 04 19:08:05.430428 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-33fd8870-0ec9-4211-8765-0bc38c15874d tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:08:05.431583 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-33fd8870-0ec9-4211-8765-0bc38c15874d tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] 10.222.0.43 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.001667 Oct 04 19:08:05.431972 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3296/6220] 10.222.0.43 () {54 vars in 1035 bytes} [Tue Oct 4 19:08:05 2022] GET /compute/v2/ => generated 379 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 221 bytes (1 switches on core 0) Oct 04 19:08:05.439485 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-e137c381-a06d-4344-a7ab-37588418aa67 req-3a802793-f350-4771-9548-13117cd789e8 service nova] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:08:05.440699 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-e137c381-a06d-4344-a7ab-37588418aa67 req-3a802793-f350-4771-9548-13117cd789e8 service nova] 10.222.0.43 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001671 Oct 04 19:08:05.441348 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2925/6221] 10.222.0.43 () {54 vars in 1041 bytes} [Tue Oct 4 19:08:05 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:08:05.450012 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-33fd8870-0ec9-4211-8765-0bc38c15874d tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:08:05.451027 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-33fd8870-0ec9-4211-8765-0bc38c15874d tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] 10.222.0.43 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001372 Oct 04 19:08:05.451375 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3297/6222] 10.222.0.43 () {56 vars in 886 bytes} [Tue Oct 4 19:08:05 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 04 19:08:06.385829 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=2 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:08:06.386854 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=6 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:08:06.392124 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-ff9ee2fc-6139-4d7d-ac17-9de243bff189 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:08:06.392879 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-ff9ee2fc-6139-4d7d-ac17-9de243bff189 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] [instance: 021d75cf-769e-47ee-87a7-3e19da9e9bf4] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:08:06.404895 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ff9ee2fc-6139-4d7d-ac17-9de243bff189 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:06.405535 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ff9ee2fc-6139-4d7d-ac17-9de243bff189 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:06.405859 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ff9ee2fc-6139-4d7d-ac17-9de243bff189 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:06.406857 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ff9ee2fc-6139-4d7d-ac17-9de243bff189 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:06.407318 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ff9ee2fc-6139-4d7d-ac17-9de243bff189 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:06.407798 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ff9ee2fc-6139-4d7d-ac17-9de243bff189 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:06.595911 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-ff9ee2fc-6139-4d7d-ac17-9de243bff189 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf87794979e844349d6ec6c6650565f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c25f1d17e94c74868357744e692487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:08:06.603795 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-ff9ee2fc-6139-4d7d-ac17-9de243bff189 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] 10.222.0.43 "GET /compute/v2.1/servers/021d75cf-769e-47ee-87a7-3e19da9e9bf4" status: 200 len: 1393 microversion: 2.1 time: 0.219849 Oct 04 19:08:06.604535 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2926/6223] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:08:06 2022] GET /compute/v2.1/servers/021d75cf-769e-47ee-87a7-3e19da9e9bf4 => generated 1393 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:08:07.629244 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-d885535f-a8c1-4cdb-8c1e-7495fc8d827e tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:08:07.630439 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-d885535f-a8c1-4cdb-8c1e-7495fc8d827e tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] [instance: 021d75cf-769e-47ee-87a7-3e19da9e9bf4] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:08:07.637915 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d885535f-a8c1-4cdb-8c1e-7495fc8d827e tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:07.638505 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d885535f-a8c1-4cdb-8c1e-7495fc8d827e tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:07.639026 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d885535f-a8c1-4cdb-8c1e-7495fc8d827e tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:07.639842 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d885535f-a8c1-4cdb-8c1e-7495fc8d827e tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:07.640377 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d885535f-a8c1-4cdb-8c1e-7495fc8d827e tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:07.640883 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d885535f-a8c1-4cdb-8c1e-7495fc8d827e tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:07.786912 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-d885535f-a8c1-4cdb-8c1e-7495fc8d827e tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf87794979e844349d6ec6c6650565f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c25f1d17e94c74868357744e692487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:08:07.795536 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-d885535f-a8c1-4cdb-8c1e-7495fc8d827e tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] 10.222.0.43 "GET /compute/v2.1/servers/021d75cf-769e-47ee-87a7-3e19da9e9bf4" status: 200 len: 1393 microversion: 2.1 time: 0.171013 Oct 04 19:08:07.796141 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3298/6224] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:08:07 2022] GET /compute/v2.1/servers/021d75cf-769e-47ee-87a7-3e19da9e9bf4 => generated 1393 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:08:08.479424 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-34f97b20-a0b0-402f-b638-3fb0b11407fb tempest-VolumesTestJSON-1900062490 tempest-VolumesTestJSON-1900062490-project] Calling method '.version_select at 0x7fb21e84eaf0>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:08:08.529960 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-34f97b20-a0b0-402f-b638-3fb0b11407fb tempest-VolumesTestJSON-1900062490 tempest-VolumesTestJSON-1900062490-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/1934b75d-cb6c-4de5-9fc8-db592c57a36e" status: 200 len: 351 microversion: 2.1 time: 0.055526 Oct 04 19:08:08.530850 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2927/6225] 10.222.0.43 () {58 vars in 1245 bytes} [Tue Oct 4 19:08:08 2022] GET /compute/v2.1/os-volumes/1934b75d-cb6c-4de5-9fc8-db592c57a36e => generated 351 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:08:08.829311 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-5743b419-849e-438a-9488-0e56ce934f12 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:08:08.829311 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-5743b419-849e-438a-9488-0e56ce934f12 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] [instance: 021d75cf-769e-47ee-87a7-3e19da9e9bf4] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:08:08.829311 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5743b419-849e-438a-9488-0e56ce934f12 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:08.829311 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5743b419-849e-438a-9488-0e56ce934f12 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:08.829311 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5743b419-849e-438a-9488-0e56ce934f12 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:08.829311 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5743b419-849e-438a-9488-0e56ce934f12 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:08.830476 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5743b419-849e-438a-9488-0e56ce934f12 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:08.831289 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5743b419-849e-438a-9488-0e56ce934f12 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:08.985220 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-5743b419-849e-438a-9488-0e56ce934f12 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf87794979e844349d6ec6c6650565f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c25f1d17e94c74868357744e692487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:08:08.994078 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-5743b419-849e-438a-9488-0e56ce934f12 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] 10.222.0.43 "GET /compute/v2.1/servers/021d75cf-769e-47ee-87a7-3e19da9e9bf4" status: 200 len: 1393 microversion: 2.1 time: 0.179066 Oct 04 19:08:08.994881 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3299/6226] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:08:08 2022] GET /compute/v2.1/servers/021d75cf-769e-47ee-87a7-3e19da9e9bf4 => generated 1393 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:08:09.901704 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-f5c6db46-a5ad-4cbb-bae7-874020292349 tempest-VolumesTestJSON-1900062490 tempest-VolumesTestJSON-1900062490-project] Calling method '.version_select at 0x7fb21e957a60>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:08:09.968823 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-f5c6db46-a5ad-4cbb-bae7-874020292349 tempest-VolumesTestJSON-1900062490 tempest-VolumesTestJSON-1900062490-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/4e131200-828e-4250-b282-b05da8fc32bf" status: 200 len: 350 microversion: 2.1 time: 0.072488 Oct 04 19:08:09.983104 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2928/6227] 10.222.0.43 () {58 vars in 1245 bytes} [Tue Oct 4 19:08:09 2022] GET /compute/v2.1/os-volumes/4e131200-828e-4250-b282-b05da8fc32bf => generated 350 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:08:10.018039 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-cf350b41-d4cd-4d0b-a1c0-79d83fb0aed2 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:08:10.018506 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-cf350b41-d4cd-4d0b-a1c0-79d83fb0aed2 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] [instance: 021d75cf-769e-47ee-87a7-3e19da9e9bf4] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:08:10.020361 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=2 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:08:10.039622 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cf350b41-d4cd-4d0b-a1c0-79d83fb0aed2 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:10.040120 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cf350b41-d4cd-4d0b-a1c0-79d83fb0aed2 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:10.040579 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cf350b41-d4cd-4d0b-a1c0-79d83fb0aed2 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:10.041849 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cf350b41-d4cd-4d0b-a1c0-79d83fb0aed2 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:10.042494 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cf350b41-d4cd-4d0b-a1c0-79d83fb0aed2 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:10.043090 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cf350b41-d4cd-4d0b-a1c0-79d83fb0aed2 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:10.153058 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=8 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:08:10.166731 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-4fdefdeb-6c2c-4801-8015-eebef84256f4 req-22aed638-b1ab-4440-aac0-0b0be73895ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "021d75cf-769e-47ee-87a7-3e19da9e9bf4", "name": "network-vif-plugged", "status": "completed", "tag": "28ebdde4-3296-4851-b0f6-5feb9448703b"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:08:10.180473 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:08:10.183168 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-4fdefdeb-6c2c-4801-8015-eebef84256f4 req-22aed638-b1ab-4440-aac0-0b0be73895ee service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:10.184802 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-4fdefdeb-6c2c-4801-8015-eebef84256f4 req-22aed638-b1ab-4440-aac0-0b0be73895ee service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:10.186916 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-4fdefdeb-6c2c-4801-8015-eebef84256f4 req-22aed638-b1ab-4440-aac0-0b0be73895ee service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:10.213223 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-4fdefdeb-6c2c-4801-8015-eebef84256f4 req-22aed638-b1ab-4440-aac0-0b0be73895ee service nova] Creating event network-vif-plugged:28ebdde4-3296-4851-b0f6-5feb9448703b for instance 021d75cf-769e-47ee-87a7-3e19da9e9bf4 on n-h2-851028-13 Oct 04 19:08:10.221876 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-4fdefdeb-6c2c-4801-8015-eebef84256f4 req-22aed638-b1ab-4440-aac0-0b0be73895ee service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071613 Oct 04 19:08:10.223518 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2929/6228] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:08:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:08:10.325806 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-cf350b41-d4cd-4d0b-a1c0-79d83fb0aed2 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf87794979e844349d6ec6c6650565f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c25f1d17e94c74868357744e692487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:08:10.334667 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-cf350b41-d4cd-4d0b-a1c0-79d83fb0aed2 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] 10.222.0.43 "GET /compute/v2.1/servers/021d75cf-769e-47ee-87a7-3e19da9e9bf4" status: 200 len: 1393 microversion: 2.1 time: 0.320457 Oct 04 19:08:10.341275 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3300/6229] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:08:10 2022] GET /compute/v2.1/servers/021d75cf-769e-47ee-87a7-3e19da9e9bf4 => generated 1393 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:08:11.360648 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-97f210fa-efeb-43ee-b58b-9fb0d81c8402 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:08:11.373505 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-97f210fa-efeb-43ee-b58b-9fb0d81c8402 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] [instance: 021d75cf-769e-47ee-87a7-3e19da9e9bf4] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:08:11.381635 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-97f210fa-efeb-43ee-b58b-9fb0d81c8402 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:11.382417 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-97f210fa-efeb-43ee-b58b-9fb0d81c8402 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:11.383053 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-97f210fa-efeb-43ee-b58b-9fb0d81c8402 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:11.383776 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-97f210fa-efeb-43ee-b58b-9fb0d81c8402 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:11.384270 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-97f210fa-efeb-43ee-b58b-9fb0d81c8402 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:11.385002 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-97f210fa-efeb-43ee-b58b-9fb0d81c8402 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:11.516440 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-df47a8d8-b6af-4967-8496-e0716e4bd798 tempest-VolumesTestJSON-1900062490 tempest-VolumesTestJSON-1900062490-project] Calling method '.version_select at 0x7fb21e842280>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:08:11.547917 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-97f210fa-efeb-43ee-b58b-9fb0d81c8402 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf87794979e844349d6ec6c6650565f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c25f1d17e94c74868357744e692487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:08:11.556992 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-97f210fa-efeb-43ee-b58b-9fb0d81c8402 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] 10.222.0.43 "GET /compute/v2.1/servers/021d75cf-769e-47ee-87a7-3e19da9e9bf4" status: 200 len: 1393 microversion: 2.1 time: 0.201732 Oct 04 19:08:11.558240 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2930/6230] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:08:11 2022] GET /compute/v2.1/servers/021d75cf-769e-47ee-87a7-3e19da9e9bf4 => generated 1393 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:08:11.574013 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-df47a8d8-b6af-4967-8496-e0716e4bd798 tempest-VolumesTestJSON-1900062490 tempest-VolumesTestJSON-1900062490-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/c67ee9fd-4dac-4074-bf5c-44ba9ee7e578" status: 200 len: 350 microversion: 2.1 time: 0.061526 Oct 04 19:08:11.574680 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3301/6231] 10.222.0.43 () {58 vars in 1245 bytes} [Tue Oct 4 19:08:11 2022] GET /compute/v2.1/os-volumes/c67ee9fd-4dac-4074-bf5c-44ba9ee7e578 => generated 350 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:08:11.588935 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-db7d336d-0cca-4d38-90ce-44f6cefb15e6 tempest-VolumesTestJSON-1900062490 tempest-VolumesTestJSON-1900062490-project] Calling method '.version_select at 0x7fb21e957550>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:08:11.691866 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-db7d336d-0cca-4d38-90ce-44f6cefb15e6 tempest-VolumesTestJSON-1900062490 tempest-VolumesTestJSON-1900062490-project] 10.222.0.43 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.107546 Oct 04 19:08:11.692682 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2931/6232] 10.222.0.43 () {58 vars in 1134 bytes} [Tue Oct 4 19:08:11 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:08:11.713299 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-cdf043c9-3787-4c43-a586-0cde357ac786 tempest-VolumesTestJSON-1900062490 tempest-VolumesTestJSON-1900062490-project] Calling method '.version_select at 0x7fb21e6a51f0>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:08:11.801522 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-cdf043c9-3787-4c43-a586-0cde357ac786 tempest-VolumesTestJSON-1900062490 tempest-VolumesTestJSON-1900062490-project] 10.222.0.43 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.098066 Oct 04 19:08:11.802186 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3302/6233] 10.222.0.43 () {58 vars in 1149 bytes} [Tue Oct 4 19:08:11 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:08:11.816225 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-5ede1100-5ffa-4ca4-b385-1aaba9151a01 tempest-VolumesTestJSON-1900062490 tempest-VolumesTestJSON-1900062490-project] Calling method '.version_select at 0x7fb21e9c7d30>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:08:11.903610 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-5ede1100-5ffa-4ca4-b385-1aaba9151a01 tempest-VolumesTestJSON-1900062490 tempest-VolumesTestJSON-1900062490-project] 10.222.0.43 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.091095 Oct 04 19:08:11.904262 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2932/6234] 10.222.0.43 () {58 vars in 1134 bytes} [Tue Oct 4 19:08:11 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:08:11.918807 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-376e1efa-9e53-4535-9ad7-e1dd7d1d464b tempest-VolumesTestJSON-1900062490 tempest-VolumesTestJSON-1900062490-project] Calling method '.version_select at 0x7fb21ee5b790>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:08:12.017663 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-376e1efa-9e53-4535-9ad7-e1dd7d1d464b tempest-VolumesTestJSON-1900062490 tempest-VolumesTestJSON-1900062490-project] 10.222.0.43 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.102301 Oct 04 19:08:12.021356 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3303/6235] 10.222.0.43 () {58 vars in 1167 bytes} [Tue Oct 4 19:08:11 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:08:12.034337 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-32ac41db-bad4-48de-ad1c-4af66de128fb tempest-VolumesTestJSON-1900062490 tempest-VolumesTestJSON-1900062490-project] Calling method '.version_select at 0x7fb21ea2a160>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:08:12.126020 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-32ac41db-bad4-48de-ad1c-4af66de128fb tempest-VolumesTestJSON-1900062490 tempest-VolumesTestJSON-1900062490-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.095430 Oct 04 19:08:12.126773 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2933/6236] 10.222.0.43 () {58 vars in 1170 bytes} [Tue Oct 4 19:08:12 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:08:12.144054 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-ce0d3b9d-f76a-473f-993c-8ab391209fcb tempest-VolumesTestJSON-1900062490 tempest-VolumesTestJSON-1900062490-project] Calling method '.version_select at 0x7fb21e6cae50>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:08:12.232616 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-ce0d3b9d-f76a-473f-993c-8ab391209fcb tempest-VolumesTestJSON-1900062490 tempest-VolumesTestJSON-1900062490-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.094431 Oct 04 19:08:12.233229 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3304/6237] 10.222.0.43 () {58 vars in 1155 bytes} [Tue Oct 4 19:08:12 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:08:12.247054 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-a319fb9e-80bb-47bc-84b0-08ecbed229e4 tempest-VolumesTestJSON-1900062490 tempest-VolumesTestJSON-1900062490-project] Calling method '.version_select at 0x7fb21e84edc0>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:08:12.344771 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-a319fb9e-80bb-47bc-84b0-08ecbed229e4 tempest-VolumesTestJSON-1900062490 tempest-VolumesTestJSON-1900062490-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.101332 Oct 04 19:08:12.345994 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2934/6238] 10.222.0.43 () {58 vars in 1188 bytes} [Tue Oct 4 19:08:12 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:08:12.359837 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-e1ff2bf3-9531-4558-9cc1-4ede98f73f17 tempest-VolumesTestJSON-1900062490 tempest-VolumesTestJSON-1900062490-project] Calling method '.version_select at 0x7fb227cf3a60>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:08:12.449277 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-e1ff2bf3-9531-4558-9cc1-4ede98f73f17 tempest-VolumesTestJSON-1900062490 tempest-VolumesTestJSON-1900062490-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.093102 Oct 04 19:08:12.449866 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3305/6239] 10.222.0.43 () {58 vars in 1155 bytes} [Tue Oct 4 19:08:12 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:08:12.583429 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-ddff0e52-ecce-42e9-92ba-1153580de888 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:08:12.584809 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-ddff0e52-ecce-42e9-92ba-1153580de888 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] [instance: 021d75cf-769e-47ee-87a7-3e19da9e9bf4] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:08:12.591668 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ddff0e52-ecce-42e9-92ba-1153580de888 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:12.592153 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ddff0e52-ecce-42e9-92ba-1153580de888 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:12.592589 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ddff0e52-ecce-42e9-92ba-1153580de888 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:12.593311 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ddff0e52-ecce-42e9-92ba-1153580de888 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:12.593767 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ddff0e52-ecce-42e9-92ba-1153580de888 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:12.594189 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ddff0e52-ecce-42e9-92ba-1153580de888 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:12.742668 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-ddff0e52-ecce-42e9-92ba-1153580de888 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf87794979e844349d6ec6c6650565f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c25f1d17e94c74868357744e692487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:08:12.751234 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-ddff0e52-ecce-42e9-92ba-1153580de888 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] 10.222.0.43 "GET /compute/v2.1/servers/021d75cf-769e-47ee-87a7-3e19da9e9bf4" status: 200 len: 1564 microversion: 2.1 time: 0.172564 Oct 04 19:08:12.751814 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2935/6240] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:08:12 2022] GET /compute/v2.1/servers/021d75cf-769e-47ee-87a7-3e19da9e9bf4 => generated 1564 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:08:12.775398 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f03a371f-8dd3-4509-be89-c3af16288256 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:08:12.777313 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-f03a371f-8dd3-4509-be89-c3af16288256 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] [instance: 021d75cf-769e-47ee-87a7-3e19da9e9bf4] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:08:12.784701 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f03a371f-8dd3-4509-be89-c3af16288256 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:12.785484 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f03a371f-8dd3-4509-be89-c3af16288256 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:12.786131 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f03a371f-8dd3-4509-be89-c3af16288256 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:12.787813 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f03a371f-8dd3-4509-be89-c3af16288256 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:12.788488 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f03a371f-8dd3-4509-be89-c3af16288256 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:12.789104 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f03a371f-8dd3-4509-be89-c3af16288256 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:12.946373 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-f03a371f-8dd3-4509-be89-c3af16288256 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf87794979e844349d6ec6c6650565f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c25f1d17e94c74868357744e692487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:08:12.954846 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-f03a371f-8dd3-4509-be89-c3af16288256 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] 10.222.0.43 "GET /compute/v2.1/servers/021d75cf-769e-47ee-87a7-3e19da9e9bf4" status: 200 len: 1564 microversion: 2.1 time: 0.183392 Oct 04 19:08:12.956208 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3306/6241] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:08:12 2022] GET /compute/v2.1/servers/021d75cf-769e-47ee-87a7-3e19da9e9bf4 => generated 1564 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:08:14.851147 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-4686e1c2-ca6b-44f0-9eaa-811f387c9b47 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:08:14.855583 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-4686e1c2-ca6b-44f0-9eaa-811f387c9b47 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] [instance: 021d75cf-769e-47ee-87a7-3e19da9e9bf4] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:08:14.866332 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4686e1c2-ca6b-44f0-9eaa-811f387c9b47 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:14.867527 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4686e1c2-ca6b-44f0-9eaa-811f387c9b47 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:14.868042 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4686e1c2-ca6b-44f0-9eaa-811f387c9b47 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:14.868716 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4686e1c2-ca6b-44f0-9eaa-811f387c9b47 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:14.870352 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4686e1c2-ca6b-44f0-9eaa-811f387c9b47 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:14.871460 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4686e1c2-ca6b-44f0-9eaa-811f387c9b47 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:15.060391 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-49b7c3c0-2572-443d-b9d8-d9c157b5aba9 req-cdbe2fab-8f8a-49d4-a20c-626cb2b25d8e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "021d75cf-769e-47ee-87a7-3e19da9e9bf4", "tag": "28ebdde4-3296-4851-b0f6-5feb9448703b"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:08:15.070961 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-49b7c3c0-2572-443d-b9d8-d9c157b5aba9 req-cdbe2fab-8f8a-49d4-a20c-626cb2b25d8e service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:15.071792 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-49b7c3c0-2572-443d-b9d8-d9c157b5aba9 req-cdbe2fab-8f8a-49d4-a20c-626cb2b25d8e service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:15.072457 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-49b7c3c0-2572-443d-b9d8-d9c157b5aba9 req-cdbe2fab-8f8a-49d4-a20c-626cb2b25d8e service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:15.090513 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-49b7c3c0-2572-443d-b9d8-d9c157b5aba9 req-cdbe2fab-8f8a-49d4-a20c-626cb2b25d8e service nova] Creating event network-changed:28ebdde4-3296-4851-b0f6-5feb9448703b for instance 021d75cf-769e-47ee-87a7-3e19da9e9bf4 on n-h2-851028-13 Oct 04 19:08:15.107046 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-49b7c3c0-2572-443d-b9d8-d9c157b5aba9 req-cdbe2fab-8f8a-49d4-a20c-626cb2b25d8e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.253847 Oct 04 19:08:15.108293 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3307/6242] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:08:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:08:15.155425 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-4686e1c2-ca6b-44f0-9eaa-811f387c9b47 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf87794979e844349d6ec6c6650565f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c25f1d17e94c74868357744e692487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:08:15.170505 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-4686e1c2-ca6b-44f0-9eaa-811f387c9b47 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] 10.222.0.43 "GET /compute/v2.1/servers/021d75cf-769e-47ee-87a7-3e19da9e9bf4" status: 200 len: 1564 microversion: 2.1 time: 0.323077 Oct 04 19:08:15.171829 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2936/6243] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:08:14 2022] GET /compute/v2.1/servers/021d75cf-769e-47ee-87a7-3e19da9e9bf4 => generated 1564 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:08:18.196014 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-c4d01596-45b8-41df-ba92-44bc83a370d6 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:08:18.196618 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-c4d01596-45b8-41df-ba92-44bc83a370d6 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] [instance: 101952eb-ca4d-489c-8cb5-3bfadf241aa3] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:08:18.203703 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c4d01596-45b8-41df-ba92-44bc83a370d6 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:18.206100 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c4d01596-45b8-41df-ba92-44bc83a370d6 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:18.206817 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c4d01596-45b8-41df-ba92-44bc83a370d6 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:18.208617 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c4d01596-45b8-41df-ba92-44bc83a370d6 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:18.209367 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c4d01596-45b8-41df-ba92-44bc83a370d6 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:18.210024 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c4d01596-45b8-41df-ba92-44bc83a370d6 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:18.258066 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-c4d01596-45b8-41df-ba92-44bc83a370d6 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] 10.222.0.43 "GET /compute/v2.1/servers/101952eb-ca4d-489c-8cb5-3bfadf241aa3/os-volume_attachments/033f0d6e-63ef-4fa7-af27-0da03ee9f927" status: 200 len: 194 microversion: 2.20 time: 0.066464 Oct 04 19:08:18.265345 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3308/6244] 10.222.0.43 () {60 vars in 1454 bytes} [Tue Oct 4 19:08:18 2022] GET /compute/v2.1/servers/101952eb-ca4d-489c-8cb5-3bfadf241aa3/os-volume_attachments/033f0d6e-63ef-4fa7-af27-0da03ee9f927 => generated 194 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 19:08:18.342429 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-de2aa077-6cfb-4ab4-b855-ab575265e161 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:08:18.343497 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-de2aa077-6cfb-4ab4-b855-ab575265e161 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] [instance: 101952eb-ca4d-489c-8cb5-3bfadf241aa3] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:08:18.350853 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-de2aa077-6cfb-4ab4-b855-ab575265e161 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:18.351565 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-de2aa077-6cfb-4ab4-b855-ab575265e161 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:18.352185 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-de2aa077-6cfb-4ab4-b855-ab575265e161 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:18.353059 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-de2aa077-6cfb-4ab4-b855-ab575265e161 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:18.353693 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-de2aa077-6cfb-4ab4-b855-ab575265e161 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:18.354296 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-de2aa077-6cfb-4ab4-b855-ab575265e161 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:18.443576 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.objects.instance [None req-de2aa077-6cfb-4ab4-b855-ab575265e161 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lazy-loading 'services' on Instance uuid 101952eb-ca4d-489c-8cb5-3bfadf241aa3 {{(pid=123595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 19:08:18.529807 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-de2aa077-6cfb-4ab4-b855-ab575265e161 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] 10.222.0.43 "DELETE /compute/v2.1/servers/101952eb-ca4d-489c-8cb5-3bfadf241aa3/os-volume_attachments/033f0d6e-63ef-4fa7-af27-0da03ee9f927" status: 202 len: 0 microversion: 2.20 time: 0.191150 Oct 04 19:08:18.530871 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2937/6245] 10.222.0.43 () {60 vars in 1457 bytes} [Tue Oct 4 19:08:18 2022] DELETE /compute/v2.1/servers/101952eb-ca4d-489c-8cb5-3bfadf241aa3/os-volume_attachments/033f0d6e-63ef-4fa7-af27-0da03ee9f927 => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:08:18.541151 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-4c8bdf44-5a98-499b-8e38-e7438025f370 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:08:18.544043 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-4c8bdf44-5a98-499b-8e38-e7438025f370 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] [instance: 101952eb-ca4d-489c-8cb5-3bfadf241aa3] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:08:18.554701 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4c8bdf44-5a98-499b-8e38-e7438025f370 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:18.557470 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4c8bdf44-5a98-499b-8e38-e7438025f370 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:18.558327 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4c8bdf44-5a98-499b-8e38-e7438025f370 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:18.559748 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4c8bdf44-5a98-499b-8e38-e7438025f370 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:18.560451 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4c8bdf44-5a98-499b-8e38-e7438025f370 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:18.561306 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4c8bdf44-5a98-499b-8e38-e7438025f370 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:18.601219 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-4c8bdf44-5a98-499b-8e38-e7438025f370 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] 10.222.0.43 "GET /compute/v2.1/servers/101952eb-ca4d-489c-8cb5-3bfadf241aa3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.064788 Oct 04 19:08:18.602338 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3309/6246] 10.222.0.43 () {60 vars in 1343 bytes} [Tue Oct 4 19:08:18 2022] GET /compute/v2.1/servers/101952eb-ca4d-489c-8cb5-3bfadf241aa3/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 19:08:19.653789 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-11f26076-ac16-4460-a6d0-ee887785b817 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:08:19.675456 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-11f26076-ac16-4460-a6d0-ee887785b817 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] [instance: 101952eb-ca4d-489c-8cb5-3bfadf241aa3] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:08:19.723407 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-11f26076-ac16-4460-a6d0-ee887785b817 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:19.724337 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-11f26076-ac16-4460-a6d0-ee887785b817 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:19.725002 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-11f26076-ac16-4460-a6d0-ee887785b817 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:19.727729 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-11f26076-ac16-4460-a6d0-ee887785b817 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:19.728415 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-11f26076-ac16-4460-a6d0-ee887785b817 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:19.729012 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-11f26076-ac16-4460-a6d0-ee887785b817 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:19.784326 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-11f26076-ac16-4460-a6d0-ee887785b817 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] 10.222.0.43 "GET /compute/v2.1/servers/101952eb-ca4d-489c-8cb5-3bfadf241aa3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.165428 Oct 04 19:08:19.785270 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2938/6247] 10.222.0.43 () {60 vars in 1343 bytes} [Tue Oct 4 19:08:19 2022] GET /compute/v2.1/servers/101952eb-ca4d-489c-8cb5-3bfadf241aa3/os-volume_attachments => generated 197 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 19:08:20.797155 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-db6c1253-e78d-4399-93b6-46d9acfe5532 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:08:20.799314 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-db6c1253-e78d-4399-93b6-46d9acfe5532 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] [instance: 101952eb-ca4d-489c-8cb5-3bfadf241aa3] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:08:20.807165 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-db6c1253-e78d-4399-93b6-46d9acfe5532 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:20.807837 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-db6c1253-e78d-4399-93b6-46d9acfe5532 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:20.808512 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-db6c1253-e78d-4399-93b6-46d9acfe5532 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:20.809461 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-db6c1253-e78d-4399-93b6-46d9acfe5532 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:20.810127 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-db6c1253-e78d-4399-93b6-46d9acfe5532 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:20.810813 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-db6c1253-e78d-4399-93b6-46d9acfe5532 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:20.843100 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-db6c1253-e78d-4399-93b6-46d9acfe5532 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] 10.222.0.43 "GET /compute/v2.1/servers/101952eb-ca4d-489c-8cb5-3bfadf241aa3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050012 Oct 04 19:08:20.844348 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3310/6248] 10.222.0.43 () {60 vars in 1343 bytes} [Tue Oct 4 19:08:20 2022] GET /compute/v2.1/servers/101952eb-ca4d-489c-8cb5-3bfadf241aa3/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 19:08:21.857548 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-d77789dc-83a5-4d96-b25d-650c44ada5a1 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:08:21.860216 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-d77789dc-83a5-4d96-b25d-650c44ada5a1 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] [instance: 101952eb-ca4d-489c-8cb5-3bfadf241aa3] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:08:21.871992 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d77789dc-83a5-4d96-b25d-650c44ada5a1 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:21.872872 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d77789dc-83a5-4d96-b25d-650c44ada5a1 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:21.873560 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d77789dc-83a5-4d96-b25d-650c44ada5a1 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:21.874494 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d77789dc-83a5-4d96-b25d-650c44ada5a1 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:21.875186 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d77789dc-83a5-4d96-b25d-650c44ada5a1 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:21.875875 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d77789dc-83a5-4d96-b25d-650c44ada5a1 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:21.921417 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-d77789dc-83a5-4d96-b25d-650c44ada5a1 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] 10.222.0.43 "GET /compute/v2.1/servers/101952eb-ca4d-489c-8cb5-3bfadf241aa3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.067988 Oct 04 19:08:21.922346 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2939/6249] 10.222.0.43 () {60 vars in 1343 bytes} [Tue Oct 4 19:08:21 2022] GET /compute/v2.1/servers/101952eb-ca4d-489c-8cb5-3bfadf241aa3/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 19:08:22.937635 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-ca5e03ae-b084-44a0-8106-7bb311402d5c tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:08:22.940007 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-ca5e03ae-b084-44a0-8106-7bb311402d5c tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] [instance: 101952eb-ca4d-489c-8cb5-3bfadf241aa3] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:08:22.954956 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ca5e03ae-b084-44a0-8106-7bb311402d5c tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:22.956363 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ca5e03ae-b084-44a0-8106-7bb311402d5c tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:22.957064 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ca5e03ae-b084-44a0-8106-7bb311402d5c tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:22.960632 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ca5e03ae-b084-44a0-8106-7bb311402d5c tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:22.961621 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ca5e03ae-b084-44a0-8106-7bb311402d5c tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:22.962415 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ca5e03ae-b084-44a0-8106-7bb311402d5c tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:23.010250 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-ca5e03ae-b084-44a0-8106-7bb311402d5c tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] 10.222.0.43 "GET /compute/v2.1/servers/101952eb-ca4d-489c-8cb5-3bfadf241aa3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.076764 Oct 04 19:08:23.011408 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3311/6250] 10.222.0.43 () {60 vars in 1343 bytes} [Tue Oct 4 19:08:22 2022] GET /compute/v2.1/servers/101952eb-ca4d-489c-8cb5-3bfadf241aa3/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 19:08:24.023691 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-e6ddaba5-26ea-4f2f-ace5-a00467b2116b tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:08:24.026466 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-e6ddaba5-26ea-4f2f-ace5-a00467b2116b tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] [instance: 101952eb-ca4d-489c-8cb5-3bfadf241aa3] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:08:24.033768 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e6ddaba5-26ea-4f2f-ace5-a00467b2116b tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:24.034576 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e6ddaba5-26ea-4f2f-ace5-a00467b2116b tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:24.035029 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e6ddaba5-26ea-4f2f-ace5-a00467b2116b tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:24.035743 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e6ddaba5-26ea-4f2f-ace5-a00467b2116b tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:24.036326 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e6ddaba5-26ea-4f2f-ace5-a00467b2116b tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:24.036916 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e6ddaba5-26ea-4f2f-ace5-a00467b2116b tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:24.080263 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:08:24.085960 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-e6ddaba5-26ea-4f2f-ace5-a00467b2116b tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] 10.222.0.43 "GET /compute/v2.1/servers/101952eb-ca4d-489c-8cb5-3bfadf241aa3/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.066555 Oct 04 19:08:24.087399 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2940/6251] 10.222.0.43 () {60 vars in 1343 bytes} [Tue Oct 4 19:08:24 2022] GET /compute/v2.1/servers/101952eb-ca4d-489c-8cb5-3bfadf241aa3/os-volume_attachments => generated 25 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:08:24.153225 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-63176818-ae88-40d6-adcd-c74da99a0f64 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:08:24.153725 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-63176818-ae88-40d6-adcd-c74da99a0f64 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] [instance: 101952eb-ca4d-489c-8cb5-3bfadf241aa3] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:08:24.161243 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-63176818-ae88-40d6-adcd-c74da99a0f64 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:24.161863 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-63176818-ae88-40d6-adcd-c74da99a0f64 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:24.162404 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-63176818-ae88-40d6-adcd-c74da99a0f64 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:24.163234 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-63176818-ae88-40d6-adcd-c74da99a0f64 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:24.163790 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-63176818-ae88-40d6-adcd-c74da99a0f64 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:24.164330 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-63176818-ae88-40d6-adcd-c74da99a0f64 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:24.192571 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-63176818-ae88-40d6-adcd-c74da99a0f64 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] [instance: 101952eb-ca4d-489c-8cb5-3bfadf241aa3] Going to try to terminate instance {{(pid=123596) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 19:08:24.289806 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-63176818-ae88-40d6-adcd-c74da99a0f64 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] 10.222.0.43 "DELETE /compute/v2.1/servers/101952eb-ca4d-489c-8cb5-3bfadf241aa3" status: 204 len: 0 microversion: 2.20 time: 0.138949 Oct 04 19:08:24.290731 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3312/6252] 10.222.0.43 () {60 vars in 1280 bytes} [Tue Oct 4 19:08:24 2022] DELETE /compute/v2.1/servers/101952eb-ca4d-489c-8cb5-3bfadf241aa3 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 19:08:24.302081 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-b3c0f0f8-3122-4391-a62b-4353f340e55f tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:08:24.303127 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-b3c0f0f8-3122-4391-a62b-4353f340e55f tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] [instance: 101952eb-ca4d-489c-8cb5-3bfadf241aa3] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:08:24.311032 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b3c0f0f8-3122-4391-a62b-4353f340e55f tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:24.314119 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b3c0f0f8-3122-4391-a62b-4353f340e55f tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:24.315024 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b3c0f0f8-3122-4391-a62b-4353f340e55f tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:24.316098 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b3c0f0f8-3122-4391-a62b-4353f340e55f tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:24.316718 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b3c0f0f8-3122-4391-a62b-4353f340e55f tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:24.317342 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b3c0f0f8-3122-4391-a62b-4353f340e55f tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:24.479495 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-b3c0f0f8-3122-4391-a62b-4353f340e55f tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:08:24.488737 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-b3c0f0f8-3122-4391-a62b-4353f340e55f tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:08:24.494563 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-b3c0f0f8-3122-4391-a62b-4353f340e55f tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:08:24.495892 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-b3c0f0f8-3122-4391-a62b-4353f340e55f tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] 10.222.0.43 "GET /compute/v2.1/servers/101952eb-ca4d-489c-8cb5-3bfadf241aa3" status: 200 len: 1723 microversion: 2.20 time: 0.199022 Oct 04 19:08:24.497148 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2941/6253] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:08:24 2022] GET /compute/v2.1/servers/101952eb-ca4d-489c-8cb5-3bfadf241aa3 => generated 1723 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:08:25.521973 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-e9dcf5cb-8694-4c61-bc2e-7acaad03e4a7 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:08:25.523003 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-e9dcf5cb-8694-4c61-bc2e-7acaad03e4a7 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] [instance: 101952eb-ca4d-489c-8cb5-3bfadf241aa3] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:08:25.525998 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:08:25.531670 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e9dcf5cb-8694-4c61-bc2e-7acaad03e4a7 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:25.532162 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e9dcf5cb-8694-4c61-bc2e-7acaad03e4a7 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:25.532598 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e9dcf5cb-8694-4c61-bc2e-7acaad03e4a7 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:25.533339 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e9dcf5cb-8694-4c61-bc2e-7acaad03e4a7 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:25.533789 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e9dcf5cb-8694-4c61-bc2e-7acaad03e4a7 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:25.534212 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e9dcf5cb-8694-4c61-bc2e-7acaad03e4a7 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:25.692628 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-e9dcf5cb-8694-4c61-bc2e-7acaad03e4a7 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:08:25.703520 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-e9dcf5cb-8694-4c61-bc2e-7acaad03e4a7 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:08:25.705428 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-e9dcf5cb-8694-4c61-bc2e-7acaad03e4a7 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:08:25.707003 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-e9dcf5cb-8694-4c61-bc2e-7acaad03e4a7 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] 10.222.0.43 "GET /compute/v2.1/servers/101952eb-ca4d-489c-8cb5-3bfadf241aa3" status: 200 len: 1723 microversion: 2.20 time: 0.189505 Oct 04 19:08:25.707762 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3313/6254] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:08:25 2022] GET /compute/v2.1/servers/101952eb-ca4d-489c-8cb5-3bfadf241aa3 => generated 1723 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:08:26.735219 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-3e9e3c88-c03f-44f3-969a-0c85b50b0c99 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:08:26.736310 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-3e9e3c88-c03f-44f3-969a-0c85b50b0c99 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] [instance: 101952eb-ca4d-489c-8cb5-3bfadf241aa3] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:08:26.746763 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3e9e3c88-c03f-44f3-969a-0c85b50b0c99 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:26.747407 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3e9e3c88-c03f-44f3-969a-0c85b50b0c99 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:26.747937 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3e9e3c88-c03f-44f3-969a-0c85b50b0c99 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:26.748759 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3e9e3c88-c03f-44f3-969a-0c85b50b0c99 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:26.749356 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3e9e3c88-c03f-44f3-969a-0c85b50b0c99 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:26.749891 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3e9e3c88-c03f-44f3-969a-0c85b50b0c99 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:26.853335 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-3e9e3c88-c03f-44f3-969a-0c85b50b0c99 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:08:26.873562 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-3e9e3c88-c03f-44f3-969a-0c85b50b0c99 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:08:26.875263 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-3e9e3c88-c03f-44f3-969a-0c85b50b0c99 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:08:26.877764 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-3e9e3c88-c03f-44f3-969a-0c85b50b0c99 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] 10.222.0.43 "GET /compute/v2.1/servers/101952eb-ca4d-489c-8cb5-3bfadf241aa3" status: 200 len: 1655 microversion: 2.20 time: 0.146892 Oct 04 19:08:26.879017 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2942/6255] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:08:26 2022] GET /compute/v2.1/servers/101952eb-ca4d-489c-8cb5-3bfadf241aa3 => generated 1655 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:08:26.930582 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-aaa7bbd4-9a59-4c8d-98a7-9fa08e30d6b2 req-cf411660-f019-429d-85dd-2725ce286e64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "101952eb-ca4d-489c-8cb5-3bfadf241aa3", "name": "network-vif-deleted", "tag": "1c32f64c-fd96-488e-ad04-113ec01cb7c8"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:08:26.954262 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-aaa7bbd4-9a59-4c8d-98a7-9fa08e30d6b2 req-cf411660-f019-429d-85dd-2725ce286e64 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:26.958156 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-aaa7bbd4-9a59-4c8d-98a7-9fa08e30d6b2 req-cf411660-f019-429d-85dd-2725ce286e64 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:26.959407 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-aaa7bbd4-9a59-4c8d-98a7-9fa08e30d6b2 req-cf411660-f019-429d-85dd-2725ce286e64 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:26.987822 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-aaa7bbd4-9a59-4c8d-98a7-9fa08e30d6b2 req-cf411660-f019-429d-85dd-2725ce286e64 service nova] Creating event network-vif-deleted:1c32f64c-fd96-488e-ad04-113ec01cb7c8 for instance 101952eb-ca4d-489c-8cb5-3bfadf241aa3 on n-h1-851028-13 Oct 04 19:08:26.998241 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-aaa7bbd4-9a59-4c8d-98a7-9fa08e30d6b2 req-cf411660-f019-429d-85dd-2725ce286e64 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071446 Oct 04 19:08:26.999386 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3314/6256] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:08:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:08:27.909313 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-07252d4f-1897-4f03-a951-6387ab642799 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:08:27.910022 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-07252d4f-1897-4f03-a951-6387ab642799 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] [instance: 101952eb-ca4d-489c-8cb5-3bfadf241aa3] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:08:27.917735 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-07252d4f-1897-4f03-a951-6387ab642799 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:27.918305 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-07252d4f-1897-4f03-a951-6387ab642799 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:27.919505 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-07252d4f-1897-4f03-a951-6387ab642799 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:27.920281 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-07252d4f-1897-4f03-a951-6387ab642799 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:27.920813 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-07252d4f-1897-4f03-a951-6387ab642799 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:27.921340 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-07252d4f-1897-4f03-a951-6387ab642799 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:27.936803 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-07252d4f-1897-4f03-a951-6387ab642799 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] HTTP exception thrown: Instance 101952eb-ca4d-489c-8cb5-3bfadf241aa3 could not be found. Oct 04 19:08:27.938876 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-07252d4f-1897-4f03-a951-6387ab642799 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Request method failure captured: Oct 04 19:08:27.938876 n-d-851028-13 devstack@n-api.service[123595]: request: GET /compute/v2.1/servers/101952eb-ca4d-489c-8cb5-3bfadf241aa3 HTTP/1.1 Oct 04 19:08:27.938876 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 19:08:27.938876 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 19:08:27.938876 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 19:08:27.938876 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 0 Oct 04 19:08:27.938876 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 19:08:27.938876 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 19:08:27.938876 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 19:08:27.938876 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 19:08:27.938876 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPIP4EsHxdrJtfXXftgSjd0DkgWU3RyKaqVrtoobsnxnJ73kFXTCStVuGKNNY5HTtavcBESe4zaZDg6zGQScTV0MQIQ57AmI-VfZnXPvc4tm44tDlywrOX9AzxAjxtSyPTeCxkNwziG-3xAyNx5Rp_xTNv8mWLNGWRmLvw_gjdamPn-0 Oct 04 19:08:27.938876 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 19:08:27.938876 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 19:08:27.938876 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 19:08:27.938876 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 19:08:27.938876 n-d-851028-13 devstack@n-api.service[123595]: X-Openstack-Nova-Api-Version: 2.20 Oct 04 19:08:27.938876 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 19:08:27.938876 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 19:08:27.938876 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: 93413a82cb584df38e5686c1ffbcfefe Oct 04 19:08:27.938876 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1971175812 Oct 04 19:08:27.938876 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 19:08:27.938876 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 19:08:27.938876 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/93413a82cb584df38e5686c1ffbcfefe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_93413a82cb584df38e5686c1ffbcfefe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/93413a82cb584df38e5686c1ffbcfefe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/93413a82cb584df38e5686c1ffbcfefe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 19:08:27.938876 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1971175812 Oct 04 19:08:27.938876 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: 93413a82cb584df38e5686c1ffbcfefe Oct 04 19:08:27.938876 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1971175812 Oct 04 19:08:27.938876 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-AttachVolumeShelveTestJSON-1971175812-project Oct 04 19:08:27.938876 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 19:08:27.938876 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 19:08:27.938876 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: 78f8a576e39b4ef9a7fe0b8a2723e54e Oct 04 19:08:27.938876 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1971175812-project Oct 04 19:08:27.938876 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 19:08:27.938876 n-d-851028-13 devstack@n-api.service[123595]: exception: Instance 101952eb-ca4d-489c-8cb5-3bfadf241aa3 could not be found. Oct 04 19:08:27.938876 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': '101952eb-ca4d-489c-8cb5-3bfadf241aa3'} Oct 04 19:08:27.938876 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:08:27.938876 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:08:27.938876 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:08:27.938876 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:08:27.938876 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:08:27.938876 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:08:27.938876 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:08:27.938876 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:08:27.938876 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:08:27.938876 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:08:27.938876 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 101952eb-ca4d-489c-8cb5-3bfadf241aa3 could not be found. Oct 04 19:08:27.938876 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:08:27.938876 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:08:27.938876 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:08:27.938876 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:08:27.938876 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:08:27.938876 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:08:27.938876 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:08:27.938876 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:08:27.938876 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:08:27.938876 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:08:27.938876 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:08:27.938876 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:08:27.938876 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:08:27.938876 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:08:27.938876 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:08:27.938876 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:08:27.938876 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 101952eb-ca4d-489c-8cb5-3bfadf241aa3 could not be found. Oct 04 19:08:27.938876 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:08:27.938876 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:08:27.942981 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:08:27.942981 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:08:27.942981 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:08:27.942981 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:08:27.942981 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:08:27.942981 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:08:27.942981 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 101952eb-ca4d-489c-8cb5-3bfadf241aa3 could not be found. Oct 04 19:08:27.942981 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:08:27.944657 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-07252d4f-1897-4f03-a951-6387ab642799 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Returning 404 to user: Instance 101952eb-ca4d-489c-8cb5-3bfadf241aa3 could not be found. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:08:27.945772 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-07252d4f-1897-4f03-a951-6387ab642799 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] 10.222.0.43 "GET /compute/v2.1/servers/101952eb-ca4d-489c-8cb5-3bfadf241aa3" status: 404 len: 111 microversion: 2.20 time: 0.041266 Oct 04 19:08:27.950026 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2943/6257] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:08:27 2022] GET /compute/v2.1/servers/101952eb-ca4d-489c-8cb5-3bfadf241aa3 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 19:08:27.956620 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-9b0e3080-0201-4ba7-ab79-dc9bc410de54 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Calling method '.version_select at 0x7fb21e7c6dc0>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:08:27.986358 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-9b0e3080-0201-4ba7-ab79-dc9bc410de54 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-946758509" status: 204 len: 0 microversion: 2.20 time: 0.034828 Oct 04 19:08:27.991789 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3315/6258] 10.222.0.43 () {60 vars in 1259 bytes} [Tue Oct 4 19:08:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-946758509 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 19:08:28.740672 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-ec200305-4d18-475f-a9e9-f293e82713eb tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Action: 'create', calling method: .version_select at 0x7fb21e84e4c0>, body: {"keypair": {"name": "tempest-keypair-721847814", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEX68+OIk/hKR+Azdpz3kL8NvrDlf08E42DEIDdrsdEg/dgZxPKYJgG1gKm0f33a/KxguVGhhUw6y8EvWw2TAWMCLOrfnPmeWfx9dTWjOKA3xa6bXhDP1DjohqBdlgxXJA=="}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:08:28.760741 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-ec200305-4d18-475f-a9e9-f293e82713eb tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Getting quotas for project 93413a82cb584df38e5686c1ffbcfefe. Resources: {'key_pairs'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:08:28.771203 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-ec200305-4d18-475f-a9e9-f293e82713eb tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Getting quotas for user 78f8a576e39b4ef9a7fe0b8a2723e54e and project 93413a82cb584df38e5686c1ffbcfefe. Resources: {'key_pairs'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:08:28.801045 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-ec200305-4d18-475f-a9e9-f293e82713eb tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.064424 Oct 04 19:08:28.801672 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2944/6259] 10.222.0.43 () {62 vars in 1200 bytes} [Tue Oct 4 19:08:28 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 66 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 04 19:08:30.254631 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-694dfeb6-650d-43d4-bbaa-fb87f34f4bd7 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-127994451", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "610008a4-b36b-4884-9bcc-e009a3affe81"}], "security_groups": [{"name": "tempest-securitygroup--865842050"}], "key_name": "tempest-keypair-721847814", "user_data": "}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:08:30.376768 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.network.neutron [None req-694dfeb6-650d-43d4-bbaa-fb87f34f4bd7 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] validate_networks() for [('610008a4-b36b-4884-9bcc-e009a3affe81', None, None, None, None, None)] {{(pid=123596) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 19:08:30.819370 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-694dfeb6-650d-43d4-bbaa-fb87f34f4bd7 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Flavor limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:08:30.820691 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-694dfeb6-650d-43d4-bbaa-fb87f34f4bd7 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Image limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:08:30.821202 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-694dfeb6-650d-43d4-bbaa-fb87f34f4bd7 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Flavor pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:08:30.821617 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-694dfeb6-650d-43d4-bbaa-fb87f34f4bd7 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Image pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:08:30.822033 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-694dfeb6-650d-43d4-bbaa-fb87f34f4bd7 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:08:30.834745 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-694dfeb6-650d-43d4-bbaa-fb87f34f4bd7 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:30.836021 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-694dfeb6-650d-43d4-bbaa-fb87f34f4bd7 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:30.836537 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-694dfeb6-650d-43d4-bbaa-fb87f34f4bd7 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:30.837784 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-694dfeb6-650d-43d4-bbaa-fb87f34f4bd7 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:30.838371 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-694dfeb6-650d-43d4-bbaa-fb87f34f4bd7 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:30.839050 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-694dfeb6-650d-43d4-bbaa-fb87f34f4bd7 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:30.848696 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:08:30.867247 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-694dfeb6-650d-43d4-bbaa-fb87f34f4bd7 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Getting quotas for project 93413a82cb584df38e5686c1ffbcfefe. Resources: {'ram', 'cores', 'instances'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:08:30.873856 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-694dfeb6-650d-43d4-bbaa-fb87f34f4bd7 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Getting quotas for user 78f8a576e39b4ef9a7fe0b8a2723e54e and project 93413a82cb584df38e5686c1ffbcfefe. Resources: {'ram', 'cores', 'instances'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:08:30.891986 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-694dfeb6-650d-43d4-bbaa-fb87f34f4bd7 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Going to run 1 instances... {{(pid=123596) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 19:08:30.896928 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-694dfeb6-650d-43d4-bbaa-fb87f34f4bd7 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] [instance: 95863fa8-413d-4cc5-bbbf-2b044f1bdc89] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e8943ec5-4038-4d4b-b9b9-2415a79f5243',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123596) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 19:08:30.954100 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-694dfeb6-650d-43d4-bbaa-fb87f34f4bd7 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.704243 Oct 04 19:08:30.955002 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3316/6260] 10.222.0.43 () {62 vars in 1188 bytes} [Tue Oct 4 19:08:30 2022] POST /compute/v2.1/servers => generated 401 bytes in 706 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 04 19:08:30.967663 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-65a21aac-da16-4f82-b0a3-3c0b5fd9e873 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:08:30.968901 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-65a21aac-da16-4f82-b0a3-3c0b5fd9e873 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] [instance: 95863fa8-413d-4cc5-bbbf-2b044f1bdc89] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:08:31.049542 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-65a21aac-da16-4f82-b0a3-3c0b5fd9e873 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:08:31.064697 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-65a21aac-da16-4f82-b0a3-3c0b5fd9e873 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:08:31.067196 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-65a21aac-da16-4f82-b0a3-3c0b5fd9e873 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:08:31.068820 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-65a21aac-da16-4f82-b0a3-3c0b5fd9e873 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] 10.222.0.43 "GET /compute/v2.1/servers/95863fa8-413d-4cc5-bbbf-2b044f1bdc89" status: 200 len: 1280 microversion: 2.20 time: 0.106217 Oct 04 19:08:31.070851 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2945/6261] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:08:30 2022] GET /compute/v2.1/servers/95863fa8-413d-4cc5-bbbf-2b044f1bdc89 => generated 1280 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:08:32.098563 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-d80a9ad2-2c90-4b7b-9b3d-a999d7d92c9b tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:08:32.100035 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-d80a9ad2-2c90-4b7b-9b3d-a999d7d92c9b tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] [instance: 95863fa8-413d-4cc5-bbbf-2b044f1bdc89] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:08:32.116782 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d80a9ad2-2c90-4b7b-9b3d-a999d7d92c9b tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:32.118555 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d80a9ad2-2c90-4b7b-9b3d-a999d7d92c9b tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:32.119103 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d80a9ad2-2c90-4b7b-9b3d-a999d7d92c9b tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:32.121542 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d80a9ad2-2c90-4b7b-9b3d-a999d7d92c9b tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:32.122192 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d80a9ad2-2c90-4b7b-9b3d-a999d7d92c9b tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:32.125227 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d80a9ad2-2c90-4b7b-9b3d-a999d7d92c9b tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:32.211928 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-d80a9ad2-2c90-4b7b-9b3d-a999d7d92c9b tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:08:32.224628 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-d80a9ad2-2c90-4b7b-9b3d-a999d7d92c9b tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:08:32.227203 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-d80a9ad2-2c90-4b7b-9b3d-a999d7d92c9b tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:08:32.229883 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-d80a9ad2-2c90-4b7b-9b3d-a999d7d92c9b tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] 10.222.0.43 "GET /compute/v2.1/servers/95863fa8-413d-4cc5-bbbf-2b044f1bdc89" status: 200 len: 1340 microversion: 2.20 time: 0.138692 Oct 04 19:08:32.258461 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3317/6262] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:08:32 2022] GET /compute/v2.1/servers/95863fa8-413d-4cc5-bbbf-2b044f1bdc89 => generated 1340 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:08:33.256355 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-c9efffec-0143-4846-8750-61c1fc727b8b tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:08:33.258118 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-c9efffec-0143-4846-8750-61c1fc727b8b tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] [instance: 95863fa8-413d-4cc5-bbbf-2b044f1bdc89] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:08:33.607594 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c9efffec-0143-4846-8750-61c1fc727b8b tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:33.608396 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c9efffec-0143-4846-8750-61c1fc727b8b tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:33.608848 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c9efffec-0143-4846-8750-61c1fc727b8b tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:33.609598 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c9efffec-0143-4846-8750-61c1fc727b8b tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:33.610061 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c9efffec-0143-4846-8750-61c1fc727b8b tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:33.610594 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c9efffec-0143-4846-8750-61c1fc727b8b tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:33.908416 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-c9efffec-0143-4846-8750-61c1fc727b8b tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:08:33.918150 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-c9efffec-0143-4846-8750-61c1fc727b8b tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:08:33.919809 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-c9efffec-0143-4846-8750-61c1fc727b8b tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:08:33.921154 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-c9efffec-0143-4846-8750-61c1fc727b8b tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] 10.222.0.43 "GET /compute/v2.1/servers/95863fa8-413d-4cc5-bbbf-2b044f1bdc89" status: 200 len: 1405 microversion: 2.20 time: 0.668970 Oct 04 19:08:33.921731 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2946/6263] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:08:33 2022] GET /compute/v2.1/servers/95863fa8-413d-4cc5-bbbf-2b044f1bdc89 => generated 1405 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:08:34.921533 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-8345485f-c79c-45e1-8e75-34b116521963 req-960c747b-2b4a-484a-9c6f-90369993a42b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95863fa8-413d-4cc5-bbbf-2b044f1bdc89", "tag": "3f8b2d23-6735-464b-9f26-f53f462f3e82"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:08:34.933613 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-8345485f-c79c-45e1-8e75-34b116521963 req-960c747b-2b4a-484a-9c6f-90369993a42b service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:34.934466 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-8345485f-c79c-45e1-8e75-34b116521963 req-960c747b-2b4a-484a-9c6f-90369993a42b service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:34.935143 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-8345485f-c79c-45e1-8e75-34b116521963 req-960c747b-2b4a-484a-9c6f-90369993a42b service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:34.951408 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-814eb2ee-ef04-4928-8600-3de74d6d6c66 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:08:34.952089 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-814eb2ee-ef04-4928-8600-3de74d6d6c66 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] [instance: 95863fa8-413d-4cc5-bbbf-2b044f1bdc89] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:08:34.952807 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-8345485f-c79c-45e1-8e75-34b116521963 req-960c747b-2b4a-484a-9c6f-90369993a42b service nova] Creating event network-changed:3f8b2d23-6735-464b-9f26-f53f462f3e82 for instance 95863fa8-413d-4cc5-bbbf-2b044f1bdc89 on n-h1-851028-13 Oct 04 19:08:34.959201 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-8345485f-c79c-45e1-8e75-34b116521963 req-960c747b-2b4a-484a-9c6f-90369993a42b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041350 Oct 04 19:08:34.961564 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3318/6264] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:08:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:08:34.967803 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-814eb2ee-ef04-4928-8600-3de74d6d6c66 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:34.968490 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-814eb2ee-ef04-4928-8600-3de74d6d6c66 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:34.969128 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-814eb2ee-ef04-4928-8600-3de74d6d6c66 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:34.969988 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-814eb2ee-ef04-4928-8600-3de74d6d6c66 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:34.970592 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-814eb2ee-ef04-4928-8600-3de74d6d6c66 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:34.972433 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-814eb2ee-ef04-4928-8600-3de74d6d6c66 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:35.369368 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-814eb2ee-ef04-4928-8600-3de74d6d6c66 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:08:35.381226 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-814eb2ee-ef04-4928-8600-3de74d6d6c66 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:08:35.390005 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-814eb2ee-ef04-4928-8600-3de74d6d6c66 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:08:35.410107 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-814eb2ee-ef04-4928-8600-3de74d6d6c66 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] 10.222.0.43 "GET /compute/v2.1/servers/95863fa8-413d-4cc5-bbbf-2b044f1bdc89" status: 200 len: 1405 microversion: 2.20 time: 0.448367 Oct 04 19:08:35.411068 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2947/6265] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:08:34 2022] GET /compute/v2.1/servers/95863fa8-413d-4cc5-bbbf-2b044f1bdc89 => generated 1405 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:08:36.440044 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-4ecbd3aa-87f4-45be-9596-289444e8e665 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:08:36.440815 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-4ecbd3aa-87f4-45be-9596-289444e8e665 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] [instance: 95863fa8-413d-4cc5-bbbf-2b044f1bdc89] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:08:36.449706 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4ecbd3aa-87f4-45be-9596-289444e8e665 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:36.450208 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4ecbd3aa-87f4-45be-9596-289444e8e665 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:36.450660 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4ecbd3aa-87f4-45be-9596-289444e8e665 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:36.451438 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4ecbd3aa-87f4-45be-9596-289444e8e665 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:36.452096 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4ecbd3aa-87f4-45be-9596-289444e8e665 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:36.452911 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4ecbd3aa-87f4-45be-9596-289444e8e665 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:36.641388 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-4ecbd3aa-87f4-45be-9596-289444e8e665 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:08:36.654947 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-4ecbd3aa-87f4-45be-9596-289444e8e665 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:08:36.657805 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-4ecbd3aa-87f4-45be-9596-289444e8e665 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:08:36.661037 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-4ecbd3aa-87f4-45be-9596-289444e8e665 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] 10.222.0.43 "GET /compute/v2.1/servers/95863fa8-413d-4cc5-bbbf-2b044f1bdc89" status: 200 len: 1405 microversion: 2.20 time: 0.226560 Oct 04 19:08:36.662913 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3319/6266] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:08:36 2022] GET /compute/v2.1/servers/95863fa8-413d-4cc5-bbbf-2b044f1bdc89 => generated 1405 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:08:37.671263 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-aa050308-8e92-42d8-b7a3-3ab8d7af82f2 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:08:37.674691 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-aa050308-8e92-42d8-b7a3-3ab8d7af82f2 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] [instance: 021d75cf-769e-47ee-87a7-3e19da9e9bf4] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:08:37.683874 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-aa050308-8e92-42d8-b7a3-3ab8d7af82f2 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:37.684822 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-aa050308-8e92-42d8-b7a3-3ab8d7af82f2 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:37.685680 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-aa050308-8e92-42d8-b7a3-3ab8d7af82f2 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:37.686636 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-aa050308-8e92-42d8-b7a3-3ab8d7af82f2 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:37.687375 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-aa050308-8e92-42d8-b7a3-3ab8d7af82f2 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:37.687966 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-aa050308-8e92-42d8-b7a3-3ab8d7af82f2 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:37.692021 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-c8d2553a-118b-4a90-b87b-b8ba2ca201f8 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:08:37.692726 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-c8d2553a-118b-4a90-b87b-b8ba2ca201f8 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] [instance: 95863fa8-413d-4cc5-bbbf-2b044f1bdc89] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:08:37.699628 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c8d2553a-118b-4a90-b87b-b8ba2ca201f8 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:37.704765 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c8d2553a-118b-4a90-b87b-b8ba2ca201f8 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:37.709248 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c8d2553a-118b-4a90-b87b-b8ba2ca201f8 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:37.711380 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c8d2553a-118b-4a90-b87b-b8ba2ca201f8 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:37.711874 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c8d2553a-118b-4a90-b87b-b8ba2ca201f8 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:37.713995 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c8d2553a-118b-4a90-b87b-b8ba2ca201f8 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:37.771614 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-aa050308-8e92-42d8-b7a3-3ab8d7af82f2 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] 10.222.0.43 "POST /compute/v2.1/servers/021d75cf-769e-47ee-87a7-3e19da9e9bf4/action" status: 200 len: 24573 microversion: 2.1 time: 0.104899 Oct 04 19:08:37.773224 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2948/6267] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 19:08:37 2022] POST /compute/v2.1/servers/021d75cf-769e-47ee-87a7-3e19da9e9bf4/action => generated 24573 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 19:08:37.997882 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-c8d2553a-118b-4a90-b87b-b8ba2ca201f8 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:08:38.021833 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-c8d2553a-118b-4a90-b87b-b8ba2ca201f8 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:08:38.025317 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-c8d2553a-118b-4a90-b87b-b8ba2ca201f8 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:08:38.027256 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-c8d2553a-118b-4a90-b87b-b8ba2ca201f8 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] 10.222.0.43 "GET /compute/v2.1/servers/95863fa8-413d-4cc5-bbbf-2b044f1bdc89" status: 200 len: 1405 microversion: 2.20 time: 0.338986 Oct 04 19:08:38.028215 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3320/6268] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:08:37 2022] GET /compute/v2.1/servers/95863fa8-413d-4cc5-bbbf-2b044f1bdc89 => generated 1405 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 19:08:39.070832 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-f6171273-b3a4-4baa-a3cf-17f8ac5cc27d tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:08:39.072665 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-f6171273-b3a4-4baa-a3cf-17f8ac5cc27d tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] [instance: 95863fa8-413d-4cc5-bbbf-2b044f1bdc89] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:08:39.083979 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f6171273-b3a4-4baa-a3cf-17f8ac5cc27d tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:39.084794 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f6171273-b3a4-4baa-a3cf-17f8ac5cc27d tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:39.085473 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f6171273-b3a4-4baa-a3cf-17f8ac5cc27d tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:39.086767 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f6171273-b3a4-4baa-a3cf-17f8ac5cc27d tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:39.087394 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f6171273-b3a4-4baa-a3cf-17f8ac5cc27d tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:39.087988 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f6171273-b3a4-4baa-a3cf-17f8ac5cc27d tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:39.311102 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-f6171273-b3a4-4baa-a3cf-17f8ac5cc27d tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:08:39.330350 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-f6171273-b3a4-4baa-a3cf-17f8ac5cc27d tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:08:39.331836 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-f6171273-b3a4-4baa-a3cf-17f8ac5cc27d tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:08:39.332992 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-f6171273-b3a4-4baa-a3cf-17f8ac5cc27d tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] 10.222.0.43 "GET /compute/v2.1/servers/95863fa8-413d-4cc5-bbbf-2b044f1bdc89" status: 200 len: 1405 microversion: 2.20 time: 0.269764 Oct 04 19:08:39.333748 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2949/6269] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:08:39 2022] GET /compute/v2.1/servers/95863fa8-413d-4cc5-bbbf-2b044f1bdc89 => generated 1405 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:08:40.357748 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-e6a833e5-cc27-4582-8e11-72cd7994666a tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:08:40.358624 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-e6a833e5-cc27-4582-8e11-72cd7994666a tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] [instance: 95863fa8-413d-4cc5-bbbf-2b044f1bdc89] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:08:40.365689 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e6a833e5-cc27-4582-8e11-72cd7994666a tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:40.366493 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e6a833e5-cc27-4582-8e11-72cd7994666a tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:40.367115 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e6a833e5-cc27-4582-8e11-72cd7994666a tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:40.368003 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e6a833e5-cc27-4582-8e11-72cd7994666a tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:40.368464 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e6a833e5-cc27-4582-8e11-72cd7994666a tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:40.368904 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e6a833e5-cc27-4582-8e11-72cd7994666a tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:40.552104 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-e6a833e5-cc27-4582-8e11-72cd7994666a tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:08:40.588092 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-e6a833e5-cc27-4582-8e11-72cd7994666a tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:08:40.590034 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-e6a833e5-cc27-4582-8e11-72cd7994666a tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:08:40.591704 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-e6a833e5-cc27-4582-8e11-72cd7994666a tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] 10.222.0.43 "GET /compute/v2.1/servers/95863fa8-413d-4cc5-bbbf-2b044f1bdc89" status: 200 len: 1405 microversion: 2.20 time: 0.237725 Oct 04 19:08:40.592234 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3321/6270] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:08:40 2022] GET /compute/v2.1/servers/95863fa8-413d-4cc5-bbbf-2b044f1bdc89 => generated 1405 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:08:40.861775 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-f24d0391-c805-460b-8fec-2eac8d6ef44a req-d1016ee8-89fd-4a8d-87f7-cc24f7c98bfe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95863fa8-413d-4cc5-bbbf-2b044f1bdc89", "name": "network-vif-plugged", "status": "completed", "tag": "3f8b2d23-6735-464b-9f26-f53f462f3e82"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:08:40.874682 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-f24d0391-c805-460b-8fec-2eac8d6ef44a req-d1016ee8-89fd-4a8d-87f7-cc24f7c98bfe service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:40.875184 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-f24d0391-c805-460b-8fec-2eac8d6ef44a req-d1016ee8-89fd-4a8d-87f7-cc24f7c98bfe service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:40.875828 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-f24d0391-c805-460b-8fec-2eac8d6ef44a req-d1016ee8-89fd-4a8d-87f7-cc24f7c98bfe service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:40.888094 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-f24d0391-c805-460b-8fec-2eac8d6ef44a req-d1016ee8-89fd-4a8d-87f7-cc24f7c98bfe service nova] Creating event network-vif-plugged:3f8b2d23-6735-464b-9f26-f53f462f3e82 for instance 95863fa8-413d-4cc5-bbbf-2b044f1bdc89 on n-h1-851028-13 Oct 04 19:08:40.895094 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-f24d0391-c805-460b-8fec-2eac8d6ef44a req-d1016ee8-89fd-4a8d-87f7-cc24f7c98bfe service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.234231 Oct 04 19:08:40.895968 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2950/6271] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:08:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:08:41.617603 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-3a229484-0d81-4d9c-8e32-986d0169a8b0 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:08:41.618214 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-3a229484-0d81-4d9c-8e32-986d0169a8b0 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] [instance: 95863fa8-413d-4cc5-bbbf-2b044f1bdc89] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:08:41.621333 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=2 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:08:41.622316 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=6 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:08:41.628255 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3a229484-0d81-4d9c-8e32-986d0169a8b0 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:41.628755 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3a229484-0d81-4d9c-8e32-986d0169a8b0 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:41.629237 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3a229484-0d81-4d9c-8e32-986d0169a8b0 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:41.629956 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3a229484-0d81-4d9c-8e32-986d0169a8b0 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:41.630430 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3a229484-0d81-4d9c-8e32-986d0169a8b0 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:41.630845 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3a229484-0d81-4d9c-8e32-986d0169a8b0 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:41.787115 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-3a229484-0d81-4d9c-8e32-986d0169a8b0 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:08:41.797254 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-3a229484-0d81-4d9c-8e32-986d0169a8b0 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:08:41.798711 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-3a229484-0d81-4d9c-8e32-986d0169a8b0 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:08:41.800175 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-3a229484-0d81-4d9c-8e32-986d0169a8b0 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] 10.222.0.43 "GET /compute/v2.1/servers/95863fa8-413d-4cc5-bbbf-2b044f1bdc89" status: 200 len: 1405 microversion: 2.20 time: 0.187146 Oct 04 19:08:41.800902 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3322/6272] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:08:41 2022] GET /compute/v2.1/servers/95863fa8-413d-4cc5-bbbf-2b044f1bdc89 => generated 1405 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:08:42.828524 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-8c8b97ad-2f21-43a9-91e8-26ddd03ba3f8 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:08:42.831004 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-8c8b97ad-2f21-43a9-91e8-26ddd03ba3f8 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] [instance: 95863fa8-413d-4cc5-bbbf-2b044f1bdc89] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:08:42.839476 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=6 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:08:42.841044 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=1 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:08:42.842817 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8c8b97ad-2f21-43a9-91e8-26ddd03ba3f8 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:42.843485 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8c8b97ad-2f21-43a9-91e8-26ddd03ba3f8 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:42.844092 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8c8b97ad-2f21-43a9-91e8-26ddd03ba3f8 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:42.845102 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8c8b97ad-2f21-43a9-91e8-26ddd03ba3f8 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:42.845759 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8c8b97ad-2f21-43a9-91e8-26ddd03ba3f8 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:42.846615 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8c8b97ad-2f21-43a9-91e8-26ddd03ba3f8 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:43.022559 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-8c8b97ad-2f21-43a9-91e8-26ddd03ba3f8 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:08:43.033186 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-8c8b97ad-2f21-43a9-91e8-26ddd03ba3f8 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:08:43.035034 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-8c8b97ad-2f21-43a9-91e8-26ddd03ba3f8 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:08:43.036889 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-8c8b97ad-2f21-43a9-91e8-26ddd03ba3f8 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] 10.222.0.43 "GET /compute/v2.1/servers/95863fa8-413d-4cc5-bbbf-2b044f1bdc89" status: 200 len: 1596 microversion: 2.20 time: 0.213197 Oct 04 19:08:43.037719 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2951/6273] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:08:42 2022] GET /compute/v2.1/servers/95863fa8-413d-4cc5-bbbf-2b044f1bdc89 => generated 1596 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:08:43.062296 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-bd3440ce-416d-49f0-a878-50f48ec25f34 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:08:43.063389 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-bd3440ce-416d-49f0-a878-50f48ec25f34 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] [instance: 95863fa8-413d-4cc5-bbbf-2b044f1bdc89] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:08:43.071705 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bd3440ce-416d-49f0-a878-50f48ec25f34 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:43.072282 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bd3440ce-416d-49f0-a878-50f48ec25f34 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:43.072763 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bd3440ce-416d-49f0-a878-50f48ec25f34 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:43.073508 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bd3440ce-416d-49f0-a878-50f48ec25f34 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:43.073970 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bd3440ce-416d-49f0-a878-50f48ec25f34 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:43.074406 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bd3440ce-416d-49f0-a878-50f48ec25f34 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:43.208165 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-bd3440ce-416d-49f0-a878-50f48ec25f34 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] 10.222.0.43 "GET /compute/v2.1/servers/95863fa8-413d-4cc5-bbbf-2b044f1bdc89/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.149787 Oct 04 19:08:43.209524 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3323/6274] 10.222.0.43 () {60 vars in 1316 bytes} [Tue Oct 4 19:08:43 2022] GET /compute/v2.1/servers/95863fa8-413d-4cc5-bbbf-2b044f1bdc89/os-interface => generated 284 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 19:08:44.214167 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-abc17b5c-9f0c-4acc-a951-5a190bbc1f00 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243"}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:08:44.219318 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-abc17b5c-9f0c-4acc-a951-5a190bbc1f00 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] [instance: 021d75cf-769e-47ee-87a7-3e19da9e9bf4] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:08:44.239376 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-abc17b5c-9f0c-4acc-a951-5a190bbc1f00 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:44.242113 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-abc17b5c-9f0c-4acc-a951-5a190bbc1f00 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:44.244328 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-abc17b5c-9f0c-4acc-a951-5a190bbc1f00 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:44.247847 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-abc17b5c-9f0c-4acc-a951-5a190bbc1f00 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:44.248558 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-abc17b5c-9f0c-4acc-a951-5a190bbc1f00 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:44.249300 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-abc17b5c-9f0c-4acc-a951-5a190bbc1f00 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:44.366668 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-abc17b5c-9f0c-4acc-a951-5a190bbc1f00 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Flavor limits 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:08:44.367090 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-abc17b5c-9f0c-4acc-a951-5a190bbc1f00 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Image limits 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:08:44.367569 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-abc17b5c-9f0c-4acc-a951-5a190bbc1f00 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Flavor pref 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:08:44.368102 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-abc17b5c-9f0c-4acc-a951-5a190bbc1f00 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Image pref 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:08:44.368520 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-abc17b5c-9f0c-4acc-a951-5a190bbc1f00 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:08:44.449780 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-abc17b5c-9f0c-4acc-a951-5a190bbc1f00 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] [instance: 021d75cf-769e-47ee-87a7-3e19da9e9bf4] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:08:44.458879 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-abc17b5c-9f0c-4acc-a951-5a190bbc1f00 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:44.459840 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-abc17b5c-9f0c-4acc-a951-5a190bbc1f00 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:44.461088 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-abc17b5c-9f0c-4acc-a951-5a190bbc1f00 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:44.462942 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-abc17b5c-9f0c-4acc-a951-5a190bbc1f00 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:44.463881 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-abc17b5c-9f0c-4acc-a951-5a190bbc1f00 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:44.464792 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-abc17b5c-9f0c-4acc-a951-5a190bbc1f00 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:44.534773 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-abc17b5c-9f0c-4acc-a951-5a190bbc1f00 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] 10.222.0.43 "POST /compute/v2.1/servers/021d75cf-769e-47ee-87a7-3e19da9e9bf4/action" status: 202 len: 1136 microversion: 2.1 time: 0.325938 Oct 04 19:08:44.536055 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2952/6275] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 19:08:44 2022] POST /compute/v2.1/servers/021d75cf-769e-47ee-87a7-3e19da9e9bf4/action => generated 1136 bytes in 329 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 04 19:08:44.558711 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-822e5ba9-d0b8-407d-b615-fdcc2eacdc28 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:08:44.562714 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-822e5ba9-d0b8-407d-b615-fdcc2eacdc28 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] [instance: 021d75cf-769e-47ee-87a7-3e19da9e9bf4] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:08:44.586929 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-822e5ba9-d0b8-407d-b615-fdcc2eacdc28 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:44.587558 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-822e5ba9-d0b8-407d-b615-fdcc2eacdc28 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:44.589415 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-822e5ba9-d0b8-407d-b615-fdcc2eacdc28 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:44.591285 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-822e5ba9-d0b8-407d-b615-fdcc2eacdc28 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:44.594821 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-822e5ba9-d0b8-407d-b615-fdcc2eacdc28 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:44.597419 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-822e5ba9-d0b8-407d-b615-fdcc2eacdc28 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:44.612137 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-49d8a977-27de-47ff-bea0-1ef6ef8455ee req-42735ec7-c9fb-4ae7-8c2d-a4ab80c29033 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95863fa8-413d-4cc5-bbbf-2b044f1bdc89", "tag": "3f8b2d23-6735-464b-9f26-f53f462f3e82"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:08:44.638190 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-49d8a977-27de-47ff-bea0-1ef6ef8455ee req-42735ec7-c9fb-4ae7-8c2d-a4ab80c29033 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:44.639076 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-49d8a977-27de-47ff-bea0-1ef6ef8455ee req-42735ec7-c9fb-4ae7-8c2d-a4ab80c29033 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:44.639668 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-49d8a977-27de-47ff-bea0-1ef6ef8455ee req-42735ec7-c9fb-4ae7-8c2d-a4ab80c29033 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:44.674737 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-49d8a977-27de-47ff-bea0-1ef6ef8455ee req-42735ec7-c9fb-4ae7-8c2d-a4ab80c29033 service nova] Creating event network-changed:3f8b2d23-6735-464b-9f26-f53f462f3e82 for instance 95863fa8-413d-4cc5-bbbf-2b044f1bdc89 on n-h1-851028-13 Oct 04 19:08:44.686049 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-49d8a977-27de-47ff-bea0-1ef6ef8455ee req-42735ec7-c9fb-4ae7-8c2d-a4ab80c29033 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079598 Oct 04 19:08:44.689479 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2953/6276] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:08:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:08:44.914407 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-822e5ba9-d0b8-407d-b615-fdcc2eacdc28 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf87794979e844349d6ec6c6650565f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c25f1d17e94c74868357744e692487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:08:44.930437 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-822e5ba9-d0b8-407d-b615-fdcc2eacdc28 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] 10.222.0.43 "GET /compute/v2.1/servers/021d75cf-769e-47ee-87a7-3e19da9e9bf4" status: 200 len: 1691 microversion: 2.1 time: 0.377138 Oct 04 19:08:44.945134 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3324/6277] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:08:44 2022] GET /compute/v2.1/servers/021d75cf-769e-47ee-87a7-3e19da9e9bf4 => generated 1691 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:08:45.967560 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-1a3c1f61-0e18-445c-a65d-f69623ac8d77 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:08:45.970150 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-1a3c1f61-0e18-445c-a65d-f69623ac8d77 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] [instance: 021d75cf-769e-47ee-87a7-3e19da9e9bf4] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:08:45.980523 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1a3c1f61-0e18-445c-a65d-f69623ac8d77 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:45.981319 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1a3c1f61-0e18-445c-a65d-f69623ac8d77 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:45.981865 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1a3c1f61-0e18-445c-a65d-f69623ac8d77 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:45.982788 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1a3c1f61-0e18-445c-a65d-f69623ac8d77 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:45.983470 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1a3c1f61-0e18-445c-a65d-f69623ac8d77 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:45.984060 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1a3c1f61-0e18-445c-a65d-f69623ac8d77 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:46.219938 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-1a3c1f61-0e18-445c-a65d-f69623ac8d77 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf87794979e844349d6ec6c6650565f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c25f1d17e94c74868357744e692487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:08:46.231190 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-1a3c1f61-0e18-445c-a65d-f69623ac8d77 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] 10.222.0.43 "GET /compute/v2.1/servers/021d75cf-769e-47ee-87a7-3e19da9e9bf4" status: 200 len: 1691 microversion: 2.1 time: 0.276220 Oct 04 19:08:46.232655 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2954/6278] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:08:45 2022] GET /compute/v2.1/servers/021d75cf-769e-47ee-87a7-3e19da9e9bf4 => generated 1691 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:08:47.258805 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-2460ba06-09d4-4f1e-8813-5a188996da2d tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:08:47.260174 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-2460ba06-09d4-4f1e-8813-5a188996da2d tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] [instance: 021d75cf-769e-47ee-87a7-3e19da9e9bf4] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:08:47.268259 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2460ba06-09d4-4f1e-8813-5a188996da2d tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:47.269055 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2460ba06-09d4-4f1e-8813-5a188996da2d tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:47.269771 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2460ba06-09d4-4f1e-8813-5a188996da2d tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:47.270691 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2460ba06-09d4-4f1e-8813-5a188996da2d tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:47.271653 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2460ba06-09d4-4f1e-8813-5a188996da2d tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:47.272101 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2460ba06-09d4-4f1e-8813-5a188996da2d tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:47.448583 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-2460ba06-09d4-4f1e-8813-5a188996da2d tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf87794979e844349d6ec6c6650565f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c25f1d17e94c74868357744e692487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:08:47.456844 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-2460ba06-09d4-4f1e-8813-5a188996da2d tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] 10.222.0.43 "GET /compute/v2.1/servers/021d75cf-769e-47ee-87a7-3e19da9e9bf4" status: 200 len: 1691 microversion: 2.1 time: 0.204953 Oct 04 19:08:47.465258 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3325/6279] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:08:47 2022] GET /compute/v2.1/servers/021d75cf-769e-47ee-87a7-3e19da9e9bf4 => generated 1691 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:08:48.481031 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-45ac914d-2165-4d6b-8a87-61f51d4f5cda tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:08:48.482012 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-45ac914d-2165-4d6b-8a87-61f51d4f5cda tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] [instance: 021d75cf-769e-47ee-87a7-3e19da9e9bf4] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:08:48.488884 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-45ac914d-2165-4d6b-8a87-61f51d4f5cda tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:48.489867 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-45ac914d-2165-4d6b-8a87-61f51d4f5cda tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:48.490526 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-45ac914d-2165-4d6b-8a87-61f51d4f5cda tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:48.492109 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-45ac914d-2165-4d6b-8a87-61f51d4f5cda tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:48.492797 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-45ac914d-2165-4d6b-8a87-61f51d4f5cda tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:48.493318 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-45ac914d-2165-4d6b-8a87-61f51d4f5cda tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:48.661726 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-45ac914d-2165-4d6b-8a87-61f51d4f5cda tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf87794979e844349d6ec6c6650565f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c25f1d17e94c74868357744e692487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:08:48.670516 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-45ac914d-2165-4d6b-8a87-61f51d4f5cda tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] 10.222.0.43 "GET /compute/v2.1/servers/021d75cf-769e-47ee-87a7-3e19da9e9bf4" status: 200 len: 1691 microversion: 2.1 time: 0.194419 Oct 04 19:08:48.671409 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2955/6280] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:08:48 2022] GET /compute/v2.1/servers/021d75cf-769e-47ee-87a7-3e19da9e9bf4 => generated 1691 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:08:49.694453 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-7b52dd44-d54b-4da5-89c2-8941f5b8a5d3 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:08:49.695911 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-7b52dd44-d54b-4da5-89c2-8941f5b8a5d3 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] [instance: 021d75cf-769e-47ee-87a7-3e19da9e9bf4] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:08:49.703459 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7b52dd44-d54b-4da5-89c2-8941f5b8a5d3 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:49.703959 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7b52dd44-d54b-4da5-89c2-8941f5b8a5d3 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:49.704401 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7b52dd44-d54b-4da5-89c2-8941f5b8a5d3 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:49.705191 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7b52dd44-d54b-4da5-89c2-8941f5b8a5d3 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:49.705811 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7b52dd44-d54b-4da5-89c2-8941f5b8a5d3 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:49.706244 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7b52dd44-d54b-4da5-89c2-8941f5b8a5d3 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:50.082374 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-7b52dd44-d54b-4da5-89c2-8941f5b8a5d3 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf87794979e844349d6ec6c6650565f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c25f1d17e94c74868357744e692487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:08:50.091505 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-7b52dd44-d54b-4da5-89c2-8941f5b8a5d3 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] 10.222.0.43 "GET /compute/v2.1/servers/021d75cf-769e-47ee-87a7-3e19da9e9bf4" status: 200 len: 1691 microversion: 2.1 time: 0.400965 Oct 04 19:08:50.105574 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3326/6281] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:08:49 2022] GET /compute/v2.1/servers/021d75cf-769e-47ee-87a7-3e19da9e9bf4 => generated 1691 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:08:51.117100 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-352dc5f4-0381-401e-b7ac-5623389aa065 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:08:51.118432 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-352dc5f4-0381-401e-b7ac-5623389aa065 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] [instance: 021d75cf-769e-47ee-87a7-3e19da9e9bf4] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:08:51.128696 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-352dc5f4-0381-401e-b7ac-5623389aa065 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:51.129550 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-352dc5f4-0381-401e-b7ac-5623389aa065 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:51.130203 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-352dc5f4-0381-401e-b7ac-5623389aa065 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:51.131328 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-352dc5f4-0381-401e-b7ac-5623389aa065 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:51.131989 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-352dc5f4-0381-401e-b7ac-5623389aa065 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:51.132960 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-352dc5f4-0381-401e-b7ac-5623389aa065 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:51.396589 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-352dc5f4-0381-401e-b7ac-5623389aa065 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf87794979e844349d6ec6c6650565f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c25f1d17e94c74868357744e692487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:08:51.407100 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-352dc5f4-0381-401e-b7ac-5623389aa065 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] 10.222.0.43 "GET /compute/v2.1/servers/021d75cf-769e-47ee-87a7-3e19da9e9bf4" status: 200 len: 1691 microversion: 2.1 time: 0.295274 Oct 04 19:08:51.417419 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2956/6282] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:08:51 2022] GET /compute/v2.1/servers/021d75cf-769e-47ee-87a7-3e19da9e9bf4 => generated 1691 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:08:52.433313 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-2640ff40-0252-48f2-85b7-e2b846614232 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:08:52.433942 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-2640ff40-0252-48f2-85b7-e2b846614232 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] [instance: 021d75cf-769e-47ee-87a7-3e19da9e9bf4] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:08:52.441766 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2640ff40-0252-48f2-85b7-e2b846614232 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:52.442513 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2640ff40-0252-48f2-85b7-e2b846614232 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:52.443161 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2640ff40-0252-48f2-85b7-e2b846614232 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:52.443879 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2640ff40-0252-48f2-85b7-e2b846614232 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:52.445171 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2640ff40-0252-48f2-85b7-e2b846614232 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:52.445728 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2640ff40-0252-48f2-85b7-e2b846614232 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:52.682177 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-2640ff40-0252-48f2-85b7-e2b846614232 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf87794979e844349d6ec6c6650565f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c25f1d17e94c74868357744e692487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:08:52.691014 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-2640ff40-0252-48f2-85b7-e2b846614232 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] 10.222.0.43 "GET /compute/v2.1/servers/021d75cf-769e-47ee-87a7-3e19da9e9bf4" status: 200 len: 1691 microversion: 2.1 time: 0.262436 Oct 04 19:08:52.691721 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3327/6283] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:08:52 2022] GET /compute/v2.1/servers/021d75cf-769e-47ee-87a7-3e19da9e9bf4 => generated 1691 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:08:53.719181 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-316074ce-de48-4707-a3fe-ebfc773f78f9 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:08:53.719969 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-316074ce-de48-4707-a3fe-ebfc773f78f9 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] [instance: 021d75cf-769e-47ee-87a7-3e19da9e9bf4] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:08:53.727389 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-316074ce-de48-4707-a3fe-ebfc773f78f9 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:53.728038 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-316074ce-de48-4707-a3fe-ebfc773f78f9 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:53.728595 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-316074ce-de48-4707-a3fe-ebfc773f78f9 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:53.729465 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-316074ce-de48-4707-a3fe-ebfc773f78f9 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:53.730421 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-316074ce-de48-4707-a3fe-ebfc773f78f9 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:53.731548 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-316074ce-de48-4707-a3fe-ebfc773f78f9 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:53.887231 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-316074ce-de48-4707-a3fe-ebfc773f78f9 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf87794979e844349d6ec6c6650565f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c25f1d17e94c74868357744e692487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:08:53.897148 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-316074ce-de48-4707-a3fe-ebfc773f78f9 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] 10.222.0.43 "GET /compute/v2.1/servers/021d75cf-769e-47ee-87a7-3e19da9e9bf4" status: 200 len: 1691 microversion: 2.1 time: 0.183110 Oct 04 19:08:53.903119 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2957/6284] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:08:53 2022] GET /compute/v2.1/servers/021d75cf-769e-47ee-87a7-3e19da9e9bf4 => generated 1691 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:08:54.922833 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-a1d4c25b-822d-4798-bad6-e45408e97943 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:08:54.923634 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-a1d4c25b-822d-4798-bad6-e45408e97943 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] [instance: 021d75cf-769e-47ee-87a7-3e19da9e9bf4] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:08:54.930060 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a1d4c25b-822d-4798-bad6-e45408e97943 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:54.930558 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a1d4c25b-822d-4798-bad6-e45408e97943 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:54.931007 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a1d4c25b-822d-4798-bad6-e45408e97943 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:54.931717 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a1d4c25b-822d-4798-bad6-e45408e97943 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:54.932180 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a1d4c25b-822d-4798-bad6-e45408e97943 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:54.932754 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a1d4c25b-822d-4798-bad6-e45408e97943 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:55.161584 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-a1d4c25b-822d-4798-bad6-e45408e97943 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf87794979e844349d6ec6c6650565f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c25f1d17e94c74868357744e692487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:08:55.170298 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-a1d4c25b-822d-4798-bad6-e45408e97943 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] 10.222.0.43 "GET /compute/v2.1/servers/021d75cf-769e-47ee-87a7-3e19da9e9bf4" status: 200 len: 1691 microversion: 2.1 time: 0.251566 Oct 04 19:08:55.170888 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3328/6285] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:08:54 2022] GET /compute/v2.1/servers/021d75cf-769e-47ee-87a7-3e19da9e9bf4 => generated 1691 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:08:56.194576 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-6a558bdb-495c-4165-ba07-63360ac96483 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:08:56.195199 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-6a558bdb-495c-4165-ba07-63360ac96483 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] [instance: 021d75cf-769e-47ee-87a7-3e19da9e9bf4] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:08:56.203244 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6a558bdb-495c-4165-ba07-63360ac96483 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:56.203741 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6a558bdb-495c-4165-ba07-63360ac96483 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:56.204189 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6a558bdb-495c-4165-ba07-63360ac96483 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:56.204908 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6a558bdb-495c-4165-ba07-63360ac96483 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:56.205405 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6a558bdb-495c-4165-ba07-63360ac96483 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:56.205842 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6a558bdb-495c-4165-ba07-63360ac96483 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:56.210938 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:08:56.461616 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-6a558bdb-495c-4165-ba07-63360ac96483 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf87794979e844349d6ec6c6650565f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c25f1d17e94c74868357744e692487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:08:56.486037 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-6a558bdb-495c-4165-ba07-63360ac96483 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] 10.222.0.43 "GET /compute/v2.1/servers/021d75cf-769e-47ee-87a7-3e19da9e9bf4" status: 200 len: 1691 microversion: 2.1 time: 0.294954 Oct 04 19:08:56.487201 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2958/6286] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:08:56 2022] GET /compute/v2.1/servers/021d75cf-769e-47ee-87a7-3e19da9e9bf4 => generated 1691 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:08:57.510810 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-d252e214-f0a6-4bbc-b700-55eae3e4784e tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:08:57.511502 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-d252e214-f0a6-4bbc-b700-55eae3e4784e tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] [instance: 021d75cf-769e-47ee-87a7-3e19da9e9bf4] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:08:57.515816 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_api:SELECT=46,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:08:57.520734 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d252e214-f0a6-4bbc-b700-55eae3e4784e tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:57.521331 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d252e214-f0a6-4bbc-b700-55eae3e4784e tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:57.521875 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d252e214-f0a6-4bbc-b700-55eae3e4784e tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:57.522689 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d252e214-f0a6-4bbc-b700-55eae3e4784e tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:57.523207 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d252e214-f0a6-4bbc-b700-55eae3e4784e tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:57.524135 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d252e214-f0a6-4bbc-b700-55eae3e4784e tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:57.679795 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-d252e214-f0a6-4bbc-b700-55eae3e4784e tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf87794979e844349d6ec6c6650565f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c25f1d17e94c74868357744e692487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:08:57.688750 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-d252e214-f0a6-4bbc-b700-55eae3e4784e tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] 10.222.0.43 "GET /compute/v2.1/servers/021d75cf-769e-47ee-87a7-3e19da9e9bf4" status: 200 len: 1697 microversion: 2.1 time: 0.182136 Oct 04 19:08:57.705139 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3329/6287] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:08:57 2022] GET /compute/v2.1/servers/021d75cf-769e-47ee-87a7-3e19da9e9bf4 => generated 1697 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:08:58.714976 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-dbcf2e86-a1d2-480d-9072-cbdbea67fc62 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:08:58.716191 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-dbcf2e86-a1d2-480d-9072-cbdbea67fc62 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] [instance: 021d75cf-769e-47ee-87a7-3e19da9e9bf4] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:08:58.723473 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dbcf2e86-a1d2-480d-9072-cbdbea67fc62 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:58.724194 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dbcf2e86-a1d2-480d-9072-cbdbea67fc62 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:58.724805 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dbcf2e86-a1d2-480d-9072-cbdbea67fc62 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:58.725793 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dbcf2e86-a1d2-480d-9072-cbdbea67fc62 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:58.726423 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dbcf2e86-a1d2-480d-9072-cbdbea67fc62 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:58.726852 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dbcf2e86-a1d2-480d-9072-cbdbea67fc62 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:58.920978 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-dbcf2e86-a1d2-480d-9072-cbdbea67fc62 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf87794979e844349d6ec6c6650565f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c25f1d17e94c74868357744e692487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:08:58.931532 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-dbcf2e86-a1d2-480d-9072-cbdbea67fc62 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] 10.222.0.43 "GET /compute/v2.1/servers/021d75cf-769e-47ee-87a7-3e19da9e9bf4" status: 200 len: 1682 microversion: 2.1 time: 0.220167 Oct 04 19:08:58.949103 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2959/6288] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:08:58 2022] GET /compute/v2.1/servers/021d75cf-769e-47ee-87a7-3e19da9e9bf4 => generated 1682 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:09:00.392687 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-2d518255-fe8a-447f-8718-3e54a0ce76be req-60eaa7f0-8a69-4de5-a411-743a475a715a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "021d75cf-769e-47ee-87a7-3e19da9e9bf4", "name": "network-vif-plugged", "status": "completed", "tag": "28ebdde4-3296-4851-b0f6-5feb9448703b"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:09:00.435825 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-2d518255-fe8a-447f-8718-3e54a0ce76be req-60eaa7f0-8a69-4de5-a411-743a475a715a service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:00.436875 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-2d518255-fe8a-447f-8718-3e54a0ce76be req-60eaa7f0-8a69-4de5-a411-743a475a715a service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:00.437576 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-2d518255-fe8a-447f-8718-3e54a0ce76be req-60eaa7f0-8a69-4de5-a411-743a475a715a service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:00.453607 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-2d518255-fe8a-447f-8718-3e54a0ce76be req-60eaa7f0-8a69-4de5-a411-743a475a715a service nova] Creating event network-vif-plugged:28ebdde4-3296-4851-b0f6-5feb9448703b for instance 021d75cf-769e-47ee-87a7-3e19da9e9bf4 on n-h2-851028-13 Oct 04 19:09:00.461845 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-2d518255-fe8a-447f-8718-3e54a0ce76be req-60eaa7f0-8a69-4de5-a411-743a475a715a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071277 Oct 04 19:09:00.463840 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3330/6289] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:09:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:09:08.649422 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-42010d97-db91-4e8a-beaa-742636a702ad tempest-VolumesNegativeTest-576433402 tempest-VolumesNegativeTest-576433402-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1198262284", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452"}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:09:08.705049 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.network.neutron [None req-42010d97-db91-4e8a-beaa-742636a702ad tempest-VolumesNegativeTest-576433402 tempest-VolumesNegativeTest-576433402-project] validate_networks() for None {{(pid=123595) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 19:09:08.925981 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=11 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:09:09.015414 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-42010d97-db91-4e8a-beaa-742636a702ad tempest-VolumesNegativeTest-576433402 tempest-VolumesNegativeTest-576433402-project] Flavor limits 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:09:09.015993 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-42010d97-db91-4e8a-beaa-742636a702ad tempest-VolumesNegativeTest-576433402 tempest-VolumesNegativeTest-576433402-project] Image limits 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:09:09.016405 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-42010d97-db91-4e8a-beaa-742636a702ad tempest-VolumesNegativeTest-576433402 tempest-VolumesNegativeTest-576433402-project] Flavor pref 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:09:09.016880 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-42010d97-db91-4e8a-beaa-742636a702ad tempest-VolumesNegativeTest-576433402 tempest-VolumesNegativeTest-576433402-project] Image pref 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:09:09.017339 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-42010d97-db91-4e8a-beaa-742636a702ad tempest-VolumesNegativeTest-576433402 tempest-VolumesNegativeTest-576433402-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:09:09.027236 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-42010d97-db91-4e8a-beaa-742636a702ad tempest-VolumesNegativeTest-576433402 tempest-VolumesNegativeTest-576433402-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:09.027722 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-42010d97-db91-4e8a-beaa-742636a702ad tempest-VolumesNegativeTest-576433402 tempest-VolumesNegativeTest-576433402-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:09.028169 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-42010d97-db91-4e8a-beaa-742636a702ad tempest-VolumesNegativeTest-576433402 tempest-VolumesNegativeTest-576433402-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:09.028897 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-42010d97-db91-4e8a-beaa-742636a702ad tempest-VolumesNegativeTest-576433402 tempest-VolumesNegativeTest-576433402-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:09.029378 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-42010d97-db91-4e8a-beaa-742636a702ad tempest-VolumesNegativeTest-576433402 tempest-VolumesNegativeTest-576433402-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:09.029799 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-42010d97-db91-4e8a-beaa-742636a702ad tempest-VolumesNegativeTest-576433402 tempest-VolumesNegativeTest-576433402-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:09.048464 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-42010d97-db91-4e8a-beaa-742636a702ad tempest-VolumesNegativeTest-576433402 tempest-VolumesNegativeTest-576433402-project] Getting quotas for project de1f42445b8441be8d6b0e52d288d8c6. Resources: {'ram', 'cores', 'instances'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:09:09.056513 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-42010d97-db91-4e8a-beaa-742636a702ad tempest-VolumesNegativeTest-576433402 tempest-VolumesNegativeTest-576433402-project] Getting quotas for user 2a616bf8f1864e428996142a5438f532 and project de1f42445b8441be8d6b0e52d288d8c6. Resources: {'ram', 'cores', 'instances'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:09:09.080370 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-42010d97-db91-4e8a-beaa-742636a702ad tempest-VolumesNegativeTest-576433402 tempest-VolumesNegativeTest-576433402-project] Going to run 1 instances... {{(pid=123595) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 19:09:09.083895 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-42010d97-db91-4e8a-beaa-742636a702ad tempest-VolumesNegativeTest-576433402 tempest-VolumesNegativeTest-576433402-project] [instance: d14f274d-ec3f-4eb1-bf59-de6e71db5d97] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e8943ec5-4038-4d4b-b9b9-2415a79f5243',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 19:09:09.140592 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-42010d97-db91-4e8a-beaa-742636a702ad tempest-VolumesNegativeTest-576433402 tempest-VolumesNegativeTest-576433402-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.494526 Oct 04 19:09:09.145965 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2960/6290] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 19:09:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 499 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 19:09:09.156382 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-87fb9885-15aa-4999-96d5-65be5a798c11 tempest-VolumesNegativeTest-576433402 tempest-VolumesNegativeTest-576433402-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:09.157232 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-87fb9885-15aa-4999-96d5-65be5a798c11 tempest-VolumesNegativeTest-576433402 tempest-VolumesNegativeTest-576433402-project] [instance: d14f274d-ec3f-4eb1-bf59-de6e71db5d97] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:09.237742 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-87fb9885-15aa-4999-96d5-65be5a798c11 tempest-VolumesNegativeTest-576433402 tempest-VolumesNegativeTest-576433402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a616bf8f1864e428996142a5438f532', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1f42445b8441be8d6b0e52d288d8c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:09:09.247177 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-87fb9885-15aa-4999-96d5-65be5a798c11 tempest-VolumesNegativeTest-576433402 tempest-VolumesNegativeTest-576433402-project] 10.222.0.43 "GET /compute/v2.1/servers/d14f274d-ec3f-4eb1-bf59-de6e71db5d97" status: 200 len: 1215 microversion: 2.1 time: 0.095143 Oct 04 19:09:09.247904 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3331/6291] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:09:09 2022] GET /compute/v2.1/servers/d14f274d-ec3f-4eb1-bf59-de6e71db5d97 => generated 1215 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:09:10.284023 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-cd9e7bd5-d2e3-4073-87c4-3c2993af0b7c tempest-VolumesNegativeTest-576433402 tempest-VolumesNegativeTest-576433402-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:10.286505 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-cd9e7bd5-d2e3-4073-87c4-3c2993af0b7c tempest-VolumesNegativeTest-576433402 tempest-VolumesNegativeTest-576433402-project] [instance: d14f274d-ec3f-4eb1-bf59-de6e71db5d97] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:10.299636 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cd9e7bd5-d2e3-4073-87c4-3c2993af0b7c tempest-VolumesNegativeTest-576433402 tempest-VolumesNegativeTest-576433402-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:10.300352 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cd9e7bd5-d2e3-4073-87c4-3c2993af0b7c tempest-VolumesNegativeTest-576433402 tempest-VolumesNegativeTest-576433402-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:10.301156 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cd9e7bd5-d2e3-4073-87c4-3c2993af0b7c tempest-VolumesNegativeTest-576433402 tempest-VolumesNegativeTest-576433402-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:10.302169 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cd9e7bd5-d2e3-4073-87c4-3c2993af0b7c tempest-VolumesNegativeTest-576433402 tempest-VolumesNegativeTest-576433402-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:10.302772 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cd9e7bd5-d2e3-4073-87c4-3c2993af0b7c tempest-VolumesNegativeTest-576433402 tempest-VolumesNegativeTest-576433402-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:10.304562 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cd9e7bd5-d2e3-4073-87c4-3c2993af0b7c tempest-VolumesNegativeTest-576433402 tempest-VolumesNegativeTest-576433402-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:10.575550 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-cd9e7bd5-d2e3-4073-87c4-3c2993af0b7c tempest-VolumesNegativeTest-576433402 tempest-VolumesNegativeTest-576433402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a616bf8f1864e428996142a5438f532', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1f42445b8441be8d6b0e52d288d8c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:09:10.584753 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-cd9e7bd5-d2e3-4073-87c4-3c2993af0b7c tempest-VolumesNegativeTest-576433402 tempest-VolumesNegativeTest-576433402-project] 10.222.0.43 "GET /compute/v2.1/servers/d14f274d-ec3f-4eb1-bf59-de6e71db5d97" status: 200 len: 1275 microversion: 2.1 time: 0.313392 Oct 04 19:09:10.586142 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2961/6292] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:09:10 2022] GET /compute/v2.1/servers/d14f274d-ec3f-4eb1-bf59-de6e71db5d97 => generated 1275 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:09:11.611471 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-973951b1-fe62-45aa-bdd2-e62d2782374f tempest-VolumesNegativeTest-576433402 tempest-VolumesNegativeTest-576433402-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:11.612186 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-973951b1-fe62-45aa-bdd2-e62d2782374f tempest-VolumesNegativeTest-576433402 tempest-VolumesNegativeTest-576433402-project] [instance: d14f274d-ec3f-4eb1-bf59-de6e71db5d97] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:11.615598 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=75 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:09:11.628868 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-973951b1-fe62-45aa-bdd2-e62d2782374f tempest-VolumesNegativeTest-576433402 tempest-VolumesNegativeTest-576433402-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:11.629402 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-973951b1-fe62-45aa-bdd2-e62d2782374f tempest-VolumesNegativeTest-576433402 tempest-VolumesNegativeTest-576433402-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:11.634839 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-973951b1-fe62-45aa-bdd2-e62d2782374f tempest-VolumesNegativeTest-576433402 tempest-VolumesNegativeTest-576433402-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:11.635768 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-973951b1-fe62-45aa-bdd2-e62d2782374f tempest-VolumesNegativeTest-576433402 tempest-VolumesNegativeTest-576433402-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:11.636402 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-973951b1-fe62-45aa-bdd2-e62d2782374f tempest-VolumesNegativeTest-576433402 tempest-VolumesNegativeTest-576433402-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:11.637004 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-973951b1-fe62-45aa-bdd2-e62d2782374f tempest-VolumesNegativeTest-576433402 tempest-VolumesNegativeTest-576433402-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:11.930786 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-973951b1-fe62-45aa-bdd2-e62d2782374f tempest-VolumesNegativeTest-576433402 tempest-VolumesNegativeTest-576433402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a616bf8f1864e428996142a5438f532', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1f42445b8441be8d6b0e52d288d8c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:09:11.939394 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-973951b1-fe62-45aa-bdd2-e62d2782374f tempest-VolumesNegativeTest-576433402 tempest-VolumesNegativeTest-576433402-project] 10.222.0.43 "GET /compute/v2.1/servers/d14f274d-ec3f-4eb1-bf59-de6e71db5d97" status: 200 len: 1315 microversion: 2.1 time: 0.333241 Oct 04 19:09:11.940328 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3332/6293] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:09:11 2022] GET /compute/v2.1/servers/d14f274d-ec3f-4eb1-bf59-de6e71db5d97 => generated 1315 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:09:12.611912 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-cece4f27-8547-4dc3-935c-6cdded447a95 req-5310d19c-6d0e-4c43-a7b4-0f46420ad900 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d14f274d-ec3f-4eb1-bf59-de6e71db5d97", "tag": "6311e525-8254-4c54-ba6a-142ecb8d5d90"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:09:12.645226 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-cece4f27-8547-4dc3-935c-6cdded447a95 req-5310d19c-6d0e-4c43-a7b4-0f46420ad900 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:12.650396 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-cece4f27-8547-4dc3-935c-6cdded447a95 req-5310d19c-6d0e-4c43-a7b4-0f46420ad900 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:12.651009 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-cece4f27-8547-4dc3-935c-6cdded447a95 req-5310d19c-6d0e-4c43-a7b4-0f46420ad900 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:12.677444 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-cece4f27-8547-4dc3-935c-6cdded447a95 req-5310d19c-6d0e-4c43-a7b4-0f46420ad900 service nova] Creating event network-changed:6311e525-8254-4c54-ba6a-142ecb8d5d90 for instance d14f274d-ec3f-4eb1-bf59-de6e71db5d97 on n-h2-851028-13 Oct 04 19:09:12.684436 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-cece4f27-8547-4dc3-935c-6cdded447a95 req-5310d19c-6d0e-4c43-a7b4-0f46420ad900 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.326826 Oct 04 19:09:12.685590 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2962/6294] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:09:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:09:12.965621 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-ffce0dd1-65f7-49bc-bc37-2395ce6ca588 tempest-VolumesNegativeTest-576433402 tempest-VolumesNegativeTest-576433402-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:12.967537 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-ffce0dd1-65f7-49bc-bc37-2395ce6ca588 tempest-VolumesNegativeTest-576433402 tempest-VolumesNegativeTest-576433402-project] [instance: d14f274d-ec3f-4eb1-bf59-de6e71db5d97] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:12.978558 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ffce0dd1-65f7-49bc-bc37-2395ce6ca588 tempest-VolumesNegativeTest-576433402 tempest-VolumesNegativeTest-576433402-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:12.979673 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ffce0dd1-65f7-49bc-bc37-2395ce6ca588 tempest-VolumesNegativeTest-576433402 tempest-VolumesNegativeTest-576433402-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:12.980237 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ffce0dd1-65f7-49bc-bc37-2395ce6ca588 tempest-VolumesNegativeTest-576433402 tempest-VolumesNegativeTest-576433402-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:12.981424 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ffce0dd1-65f7-49bc-bc37-2395ce6ca588 tempest-VolumesNegativeTest-576433402 tempest-VolumesNegativeTest-576433402-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:12.982367 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ffce0dd1-65f7-49bc-bc37-2395ce6ca588 tempest-VolumesNegativeTest-576433402 tempest-VolumesNegativeTest-576433402-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:12.983293 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ffce0dd1-65f7-49bc-bc37-2395ce6ca588 tempest-VolumesNegativeTest-576433402 tempest-VolumesNegativeTest-576433402-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:13.269698 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-ffce0dd1-65f7-49bc-bc37-2395ce6ca588 tempest-VolumesNegativeTest-576433402 tempest-VolumesNegativeTest-576433402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a616bf8f1864e428996142a5438f532', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1f42445b8441be8d6b0e52d288d8c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:09:13.279036 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-ffce0dd1-65f7-49bc-bc37-2395ce6ca588 tempest-VolumesNegativeTest-576433402 tempest-VolumesNegativeTest-576433402-project] 10.222.0.43 "GET /compute/v2.1/servers/d14f274d-ec3f-4eb1-bf59-de6e71db5d97" status: 200 len: 1315 microversion: 2.1 time: 0.317483 Oct 04 19:09:13.279923 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3333/6295] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:09:12 2022] GET /compute/v2.1/servers/d14f274d-ec3f-4eb1-bf59-de6e71db5d97 => generated 1315 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:09:14.303706 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-5b688db1-b71e-46d8-be93-db0a0b568287 tempest-VolumesNegativeTest-576433402 tempest-VolumesNegativeTest-576433402-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:14.304923 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-5b688db1-b71e-46d8-be93-db0a0b568287 tempest-VolumesNegativeTest-576433402 tempest-VolumesNegativeTest-576433402-project] [instance: d14f274d-ec3f-4eb1-bf59-de6e71db5d97] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:14.307824 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:09:14.316902 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5b688db1-b71e-46d8-be93-db0a0b568287 tempest-VolumesNegativeTest-576433402 tempest-VolumesNegativeTest-576433402-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:14.317504 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5b688db1-b71e-46d8-be93-db0a0b568287 tempest-VolumesNegativeTest-576433402 tempest-VolumesNegativeTest-576433402-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:14.317960 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5b688db1-b71e-46d8-be93-db0a0b568287 tempest-VolumesNegativeTest-576433402 tempest-VolumesNegativeTest-576433402-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:14.318711 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5b688db1-b71e-46d8-be93-db0a0b568287 tempest-VolumesNegativeTest-576433402 tempest-VolumesNegativeTest-576433402-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:14.319172 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5b688db1-b71e-46d8-be93-db0a0b568287 tempest-VolumesNegativeTest-576433402 tempest-VolumesNegativeTest-576433402-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:14.320403 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5b688db1-b71e-46d8-be93-db0a0b568287 tempest-VolumesNegativeTest-576433402 tempest-VolumesNegativeTest-576433402-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:14.870895 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-5b688db1-b71e-46d8-be93-db0a0b568287 tempest-VolumesNegativeTest-576433402 tempest-VolumesNegativeTest-576433402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a616bf8f1864e428996142a5438f532', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1f42445b8441be8d6b0e52d288d8c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:09:14.878912 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-5b688db1-b71e-46d8-be93-db0a0b568287 tempest-VolumesNegativeTest-576433402 tempest-VolumesNegativeTest-576433402-project] 10.222.0.43 "GET /compute/v2.1/servers/d14f274d-ec3f-4eb1-bf59-de6e71db5d97" status: 200 len: 1315 microversion: 2.1 time: 0.579789 Oct 04 19:09:14.879580 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2963/6296] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:09:14 2022] GET /compute/v2.1/servers/d14f274d-ec3f-4eb1-bf59-de6e71db5d97 => generated 1315 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:09:15.902833 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-0ffd6ca9-02a7-44c4-ad68-1482879d69c9 tempest-VolumesNegativeTest-576433402 tempest-VolumesNegativeTest-576433402-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:15.904716 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-0ffd6ca9-02a7-44c4-ad68-1482879d69c9 tempest-VolumesNegativeTest-576433402 tempest-VolumesNegativeTest-576433402-project] [instance: d14f274d-ec3f-4eb1-bf59-de6e71db5d97] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:15.914488 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0ffd6ca9-02a7-44c4-ad68-1482879d69c9 tempest-VolumesNegativeTest-576433402 tempest-VolumesNegativeTest-576433402-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:15.915184 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0ffd6ca9-02a7-44c4-ad68-1482879d69c9 tempest-VolumesNegativeTest-576433402 tempest-VolumesNegativeTest-576433402-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:15.916069 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0ffd6ca9-02a7-44c4-ad68-1482879d69c9 tempest-VolumesNegativeTest-576433402 tempest-VolumesNegativeTest-576433402-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:15.917072 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0ffd6ca9-02a7-44c4-ad68-1482879d69c9 tempest-VolumesNegativeTest-576433402 tempest-VolumesNegativeTest-576433402-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:15.917758 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0ffd6ca9-02a7-44c4-ad68-1482879d69c9 tempest-VolumesNegativeTest-576433402 tempest-VolumesNegativeTest-576433402-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:15.918426 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0ffd6ca9-02a7-44c4-ad68-1482879d69c9 tempest-VolumesNegativeTest-576433402 tempest-VolumesNegativeTest-576433402-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:16.060935 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-0ffd6ca9-02a7-44c4-ad68-1482879d69c9 tempest-VolumesNegativeTest-576433402 tempest-VolumesNegativeTest-576433402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a616bf8f1864e428996142a5438f532', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1f42445b8441be8d6b0e52d288d8c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:09:16.069294 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-0ffd6ca9-02a7-44c4-ad68-1482879d69c9 tempest-VolumesNegativeTest-576433402 tempest-VolumesNegativeTest-576433402-project] 10.222.0.43 "GET /compute/v2.1/servers/d14f274d-ec3f-4eb1-bf59-de6e71db5d97" status: 200 len: 1315 microversion: 2.1 time: 0.172007 Oct 04 19:09:16.070112 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3334/6297] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:09:15 2022] GET /compute/v2.1/servers/d14f274d-ec3f-4eb1-bf59-de6e71db5d97 => generated 1315 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:09:17.094548 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-ac7d9c05-2eba-4c50-ac83-10b165ad5920 tempest-VolumesNegativeTest-576433402 tempest-VolumesNegativeTest-576433402-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:17.095177 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-ac7d9c05-2eba-4c50-ac83-10b165ad5920 tempest-VolumesNegativeTest-576433402 tempest-VolumesNegativeTest-576433402-project] [instance: d14f274d-ec3f-4eb1-bf59-de6e71db5d97] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:17.102994 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ac7d9c05-2eba-4c50-ac83-10b165ad5920 tempest-VolumesNegativeTest-576433402 tempest-VolumesNegativeTest-576433402-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:17.103500 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ac7d9c05-2eba-4c50-ac83-10b165ad5920 tempest-VolumesNegativeTest-576433402 tempest-VolumesNegativeTest-576433402-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:17.103943 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ac7d9c05-2eba-4c50-ac83-10b165ad5920 tempest-VolumesNegativeTest-576433402 tempest-VolumesNegativeTest-576433402-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:17.104657 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ac7d9c05-2eba-4c50-ac83-10b165ad5920 tempest-VolumesNegativeTest-576433402 tempest-VolumesNegativeTest-576433402-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:17.105136 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ac7d9c05-2eba-4c50-ac83-10b165ad5920 tempest-VolumesNegativeTest-576433402 tempest-VolumesNegativeTest-576433402-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:17.105582 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ac7d9c05-2eba-4c50-ac83-10b165ad5920 tempest-VolumesNegativeTest-576433402 tempest-VolumesNegativeTest-576433402-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:17.246107 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-ac7d9c05-2eba-4c50-ac83-10b165ad5920 tempest-VolumesNegativeTest-576433402 tempest-VolumesNegativeTest-576433402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a616bf8f1864e428996142a5438f532', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1f42445b8441be8d6b0e52d288d8c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:09:17.254394 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-ac7d9c05-2eba-4c50-ac83-10b165ad5920 tempest-VolumesNegativeTest-576433402 tempest-VolumesNegativeTest-576433402-project] 10.222.0.43 "GET /compute/v2.1/servers/d14f274d-ec3f-4eb1-bf59-de6e71db5d97" status: 200 len: 1315 microversion: 2.1 time: 0.164539 Oct 04 19:09:17.255217 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2964/6298] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:09:17 2022] GET /compute/v2.1/servers/d14f274d-ec3f-4eb1-bf59-de6e71db5d97 => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:09:18.278405 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-a91ac471-0deb-4550-a723-b4b18790f2fd tempest-VolumesNegativeTest-576433402 tempest-VolumesNegativeTest-576433402-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:18.279182 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-a91ac471-0deb-4550-a723-b4b18790f2fd tempest-VolumesNegativeTest-576433402 tempest-VolumesNegativeTest-576433402-project] [instance: d14f274d-ec3f-4eb1-bf59-de6e71db5d97] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:18.287117 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a91ac471-0deb-4550-a723-b4b18790f2fd tempest-VolumesNegativeTest-576433402 tempest-VolumesNegativeTest-576433402-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:18.288217 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a91ac471-0deb-4550-a723-b4b18790f2fd tempest-VolumesNegativeTest-576433402 tempest-VolumesNegativeTest-576433402-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:18.289353 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a91ac471-0deb-4550-a723-b4b18790f2fd tempest-VolumesNegativeTest-576433402 tempest-VolumesNegativeTest-576433402-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:18.290989 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a91ac471-0deb-4550-a723-b4b18790f2fd tempest-VolumesNegativeTest-576433402 tempest-VolumesNegativeTest-576433402-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:18.291287 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a91ac471-0deb-4550-a723-b4b18790f2fd tempest-VolumesNegativeTest-576433402 tempest-VolumesNegativeTest-576433402-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:18.291828 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a91ac471-0deb-4550-a723-b4b18790f2fd tempest-VolumesNegativeTest-576433402 tempest-VolumesNegativeTest-576433402-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:18.442866 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-268b8c46-9afe-40d0-959f-f8efc394bee2 req-f145356d-2218-4b1a-bb8f-08b86ec1916f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d14f274d-ec3f-4eb1-bf59-de6e71db5d97", "name": "network-vif-plugged", "status": "completed", "tag": "6311e525-8254-4c54-ba6a-142ecb8d5d90"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:09:18.456095 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-268b8c46-9afe-40d0-959f-f8efc394bee2 req-f145356d-2218-4b1a-bb8f-08b86ec1916f service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:18.456924 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-268b8c46-9afe-40d0-959f-f8efc394bee2 req-f145356d-2218-4b1a-bb8f-08b86ec1916f service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:18.457474 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-268b8c46-9afe-40d0-959f-f8efc394bee2 req-f145356d-2218-4b1a-bb8f-08b86ec1916f service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:18.475602 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-268b8c46-9afe-40d0-959f-f8efc394bee2 req-f145356d-2218-4b1a-bb8f-08b86ec1916f service nova] Creating event network-vif-plugged:6311e525-8254-4c54-ba6a-142ecb8d5d90 for instance d14f274d-ec3f-4eb1-bf59-de6e71db5d97 on n-h2-851028-13 Oct 04 19:09:18.481555 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-268b8c46-9afe-40d0-959f-f8efc394bee2 req-f145356d-2218-4b1a-bb8f-08b86ec1916f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042594 Oct 04 19:09:18.482266 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2965/6299] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:09:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:09:18.550911 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-a91ac471-0deb-4550-a723-b4b18790f2fd tempest-VolumesNegativeTest-576433402 tempest-VolumesNegativeTest-576433402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a616bf8f1864e428996142a5438f532', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1f42445b8441be8d6b0e52d288d8c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:09:18.559928 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-a91ac471-0deb-4550-a723-b4b18790f2fd tempest-VolumesNegativeTest-576433402 tempest-VolumesNegativeTest-576433402-project] 10.222.0.43 "GET /compute/v2.1/servers/d14f274d-ec3f-4eb1-bf59-de6e71db5d97" status: 200 len: 1315 microversion: 2.1 time: 0.285743 Oct 04 19:09:18.560768 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3335/6300] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:09:18 2022] GET /compute/v2.1/servers/d14f274d-ec3f-4eb1-bf59-de6e71db5d97 => generated 1315 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:09:19.579755 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=2 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:09:19.580588 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=6 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:09:19.585665 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-c63592a2-10ba-4d9f-8fae-a89e3932f3be tempest-VolumesNegativeTest-576433402 tempest-VolumesNegativeTest-576433402-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:19.586390 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-c63592a2-10ba-4d9f-8fae-a89e3932f3be tempest-VolumesNegativeTest-576433402 tempest-VolumesNegativeTest-576433402-project] [instance: d14f274d-ec3f-4eb1-bf59-de6e71db5d97] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:19.595268 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c63592a2-10ba-4d9f-8fae-a89e3932f3be tempest-VolumesNegativeTest-576433402 tempest-VolumesNegativeTest-576433402-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:19.595816 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c63592a2-10ba-4d9f-8fae-a89e3932f3be tempest-VolumesNegativeTest-576433402 tempest-VolumesNegativeTest-576433402-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:19.596281 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c63592a2-10ba-4d9f-8fae-a89e3932f3be tempest-VolumesNegativeTest-576433402 tempest-VolumesNegativeTest-576433402-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:19.597007 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c63592a2-10ba-4d9f-8fae-a89e3932f3be tempest-VolumesNegativeTest-576433402 tempest-VolumesNegativeTest-576433402-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:19.597519 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c63592a2-10ba-4d9f-8fae-a89e3932f3be tempest-VolumesNegativeTest-576433402 tempest-VolumesNegativeTest-576433402-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:19.597973 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c63592a2-10ba-4d9f-8fae-a89e3932f3be tempest-VolumesNegativeTest-576433402 tempest-VolumesNegativeTest-576433402-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:19.740986 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-c63592a2-10ba-4d9f-8fae-a89e3932f3be tempest-VolumesNegativeTest-576433402 tempest-VolumesNegativeTest-576433402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a616bf8f1864e428996142a5438f532', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1f42445b8441be8d6b0e52d288d8c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:09:19.749569 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-c63592a2-10ba-4d9f-8fae-a89e3932f3be tempest-VolumesNegativeTest-576433402 tempest-VolumesNegativeTest-576433402-project] 10.222.0.43 "GET /compute/v2.1/servers/d14f274d-ec3f-4eb1-bf59-de6e71db5d97" status: 200 len: 1315 microversion: 2.1 time: 0.170670 Oct 04 19:09:19.750167 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2966/6301] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:09:19 2022] GET /compute/v2.1/servers/d14f274d-ec3f-4eb1-bf59-de6e71db5d97 => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:09:19.831806 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-ad15cb1e-fc57-4835-bccc-af899a5dc26b tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:19.832443 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-ad15cb1e-fc57-4835-bccc-af899a5dc26b tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] [instance: 95863fa8-413d-4cc5-bbbf-2b044f1bdc89] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:19.834555 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=2 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:09:19.841404 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ad15cb1e-fc57-4835-bccc-af899a5dc26b tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:19.841903 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ad15cb1e-fc57-4835-bccc-af899a5dc26b tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:19.842370 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ad15cb1e-fc57-4835-bccc-af899a5dc26b tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:19.843083 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ad15cb1e-fc57-4835-bccc-af899a5dc26b tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:19.843544 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ad15cb1e-fc57-4835-bccc-af899a5dc26b tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:19.843975 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ad15cb1e-fc57-4835-bccc-af899a5dc26b tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:19.870894 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-ad15cb1e-fc57-4835-bccc-af899a5dc26b tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] 10.222.0.43 "GET /compute/v2.1/servers/95863fa8-413d-4cc5-bbbf-2b044f1bdc89/ips" status: 200 len: 150 microversion: 2.20 time: 0.043981 Oct 04 19:09:19.871699 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3336/6302] 10.222.0.43 () {60 vars in 1289 bytes} [Tue Oct 4 19:09:19 2022] GET /compute/v2.1/servers/95863fa8-413d-4cc5-bbbf-2b044f1bdc89/ips => generated 150 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 19:09:20.775317 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-f8787e34-5465-46c5-ba1d-a7d35f962207 tempest-VolumesNegativeTest-576433402 tempest-VolumesNegativeTest-576433402-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:20.776629 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-f8787e34-5465-46c5-ba1d-a7d35f962207 tempest-VolumesNegativeTest-576433402 tempest-VolumesNegativeTest-576433402-project] [instance: d14f274d-ec3f-4eb1-bf59-de6e71db5d97] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:20.784265 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f8787e34-5465-46c5-ba1d-a7d35f962207 tempest-VolumesNegativeTest-576433402 tempest-VolumesNegativeTest-576433402-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:20.784774 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f8787e34-5465-46c5-ba1d-a7d35f962207 tempest-VolumesNegativeTest-576433402 tempest-VolumesNegativeTest-576433402-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:20.785254 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f8787e34-5465-46c5-ba1d-a7d35f962207 tempest-VolumesNegativeTest-576433402 tempest-VolumesNegativeTest-576433402-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:20.785986 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f8787e34-5465-46c5-ba1d-a7d35f962207 tempest-VolumesNegativeTest-576433402 tempest-VolumesNegativeTest-576433402-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:20.786447 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f8787e34-5465-46c5-ba1d-a7d35f962207 tempest-VolumesNegativeTest-576433402 tempest-VolumesNegativeTest-576433402-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:20.787636 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f8787e34-5465-46c5-ba1d-a7d35f962207 tempest-VolumesNegativeTest-576433402 tempest-VolumesNegativeTest-576433402-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:20.974097 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-f8787e34-5465-46c5-ba1d-a7d35f962207 tempest-VolumesNegativeTest-576433402 tempest-VolumesNegativeTest-576433402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a616bf8f1864e428996142a5438f532', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1f42445b8441be8d6b0e52d288d8c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:09:20.984232 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-f8787e34-5465-46c5-ba1d-a7d35f962207 tempest-VolumesNegativeTest-576433402 tempest-VolumesNegativeTest-576433402-project] 10.222.0.43 "GET /compute/v2.1/servers/d14f274d-ec3f-4eb1-bf59-de6e71db5d97" status: 200 len: 1465 microversion: 2.1 time: 0.214285 Oct 04 19:09:20.985568 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2967/6303] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:09:20 2022] GET /compute/v2.1/servers/d14f274d-ec3f-4eb1-bf59-de6e71db5d97 => generated 1465 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:09:21.054627 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-e0a9e72a-d726-4c7d-ae33-e37b40ef42cd tempest-VolumesNegativeTest-576433402 tempest-VolumesNegativeTest-576433402-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:21.062021 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-e0a9e72a-d726-4c7d-ae33-e37b40ef42cd tempest-VolumesNegativeTest-576433402 tempest-VolumesNegativeTest-576433402-project] [instance: d14f274d-ec3f-4eb1-bf59-de6e71db5d97] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:21.071455 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e0a9e72a-d726-4c7d-ae33-e37b40ef42cd tempest-VolumesNegativeTest-576433402 tempest-VolumesNegativeTest-576433402-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:21.071971 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e0a9e72a-d726-4c7d-ae33-e37b40ef42cd tempest-VolumesNegativeTest-576433402 tempest-VolumesNegativeTest-576433402-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:21.072426 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e0a9e72a-d726-4c7d-ae33-e37b40ef42cd tempest-VolumesNegativeTest-576433402 tempest-VolumesNegativeTest-576433402-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:21.073700 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e0a9e72a-d726-4c7d-ae33-e37b40ef42cd tempest-VolumesNegativeTest-576433402 tempest-VolumesNegativeTest-576433402-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:21.074167 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e0a9e72a-d726-4c7d-ae33-e37b40ef42cd tempest-VolumesNegativeTest-576433402 tempest-VolumesNegativeTest-576433402-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:21.074642 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e0a9e72a-d726-4c7d-ae33-e37b40ef42cd tempest-VolumesNegativeTest-576433402 tempest-VolumesNegativeTest-576433402-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:21.106050 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-e0a9e72a-d726-4c7d-ae33-e37b40ef42cd tempest-VolumesNegativeTest-576433402 tempest-VolumesNegativeTest-576433402-project] [instance: d14f274d-ec3f-4eb1-bf59-de6e71db5d97] Going to try to terminate instance {{(pid=123596) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 19:09:21.198387 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-e0a9e72a-d726-4c7d-ae33-e37b40ef42cd tempest-VolumesNegativeTest-576433402 tempest-VolumesNegativeTest-576433402-project] 10.222.0.43 "DELETE /compute/v2.1/servers/d14f274d-ec3f-4eb1-bf59-de6e71db5d97" status: 204 len: 0 microversion: 2.1 time: 0.156140 Oct 04 19:09:21.199315 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3337/6304] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 19:09:21 2022] DELETE /compute/v2.1/servers/d14f274d-ec3f-4eb1-bf59-de6e71db5d97 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:09:21.209156 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-9cfa09fd-0ddd-4b06-83c2-6e69d36d4549 tempest-VolumesNegativeTest-576433402 tempest-VolumesNegativeTest-576433402-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:21.209844 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-9cfa09fd-0ddd-4b06-83c2-6e69d36d4549 tempest-VolumesNegativeTest-576433402 tempest-VolumesNegativeTest-576433402-project] [instance: d14f274d-ec3f-4eb1-bf59-de6e71db5d97] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:21.218670 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9cfa09fd-0ddd-4b06-83c2-6e69d36d4549 tempest-VolumesNegativeTest-576433402 tempest-VolumesNegativeTest-576433402-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:21.219179 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9cfa09fd-0ddd-4b06-83c2-6e69d36d4549 tempest-VolumesNegativeTest-576433402 tempest-VolumesNegativeTest-576433402-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:21.221809 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9cfa09fd-0ddd-4b06-83c2-6e69d36d4549 tempest-VolumesNegativeTest-576433402 tempest-VolumesNegativeTest-576433402-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:21.231693 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9cfa09fd-0ddd-4b06-83c2-6e69d36d4549 tempest-VolumesNegativeTest-576433402 tempest-VolumesNegativeTest-576433402-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:21.232371 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9cfa09fd-0ddd-4b06-83c2-6e69d36d4549 tempest-VolumesNegativeTest-576433402 tempest-VolumesNegativeTest-576433402-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:21.233240 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9cfa09fd-0ddd-4b06-83c2-6e69d36d4549 tempest-VolumesNegativeTest-576433402 tempest-VolumesNegativeTest-576433402-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:21.389756 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-9cfa09fd-0ddd-4b06-83c2-6e69d36d4549 tempest-VolumesNegativeTest-576433402 tempest-VolumesNegativeTest-576433402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a616bf8f1864e428996142a5438f532', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1f42445b8441be8d6b0e52d288d8c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:09:21.400214 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-9cfa09fd-0ddd-4b06-83c2-6e69d36d4549 tempest-VolumesNegativeTest-576433402 tempest-VolumesNegativeTest-576433402-project] 10.222.0.43 "GET /compute/v2.1/servers/d14f274d-ec3f-4eb1-bf59-de6e71db5d97" status: 200 len: 1471 microversion: 2.1 time: 0.196267 Oct 04 19:09:21.401187 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2968/6305] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:09:21 2022] GET /compute/v2.1/servers/d14f274d-ec3f-4eb1-bf59-de6e71db5d97 => generated 1471 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:09:21.928681 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-958c6337-f1a6-476e-9bee-e44f86621fa2 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:09:21.929443 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-958c6337-f1a6-476e-9bee-e44f86621fa2 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] [instance: 95863fa8-413d-4cc5-bbbf-2b044f1bdc89] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:21.935602 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-958c6337-f1a6-476e-9bee-e44f86621fa2 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:21.936227 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-958c6337-f1a6-476e-9bee-e44f86621fa2 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:21.936784 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-958c6337-f1a6-476e-9bee-e44f86621fa2 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:21.937645 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-958c6337-f1a6-476e-9bee-e44f86621fa2 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:21.938195 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-958c6337-f1a6-476e-9bee-e44f86621fa2 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:21.938771 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-958c6337-f1a6-476e-9bee-e44f86621fa2 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:21.962794 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.objects.instance [None req-958c6337-f1a6-476e-9bee-e44f86621fa2 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lazy-loading 'flavor' on Instance uuid 95863fa8-413d-4cc5-bbbf-2b044f1bdc89 {{(pid=123596) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 19:09:22.193337 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-958c6337-f1a6-476e-9bee-e44f86621fa2 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] 10.222.0.43 "POST /compute/v2.1/servers/95863fa8-413d-4cc5-bbbf-2b044f1bdc89/action" status: 202 len: 0 microversion: 2.20 time: 0.268953 Oct 04 19:09:22.195239 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3338/6306] 10.222.0.43 () {62 vars in 1319 bytes} [Tue Oct 4 19:09:21 2022] POST /compute/v2.1/servers/95863fa8-413d-4cc5-bbbf-2b044f1bdc89/action => generated 0 bytes in 271 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:09:22.203234 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-556a5d68-a38a-4fdb-af25-e10f4de52e4e tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:22.203866 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-556a5d68-a38a-4fdb-af25-e10f4de52e4e tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] [instance: 95863fa8-413d-4cc5-bbbf-2b044f1bdc89] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:22.211449 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-556a5d68-a38a-4fdb-af25-e10f4de52e4e tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:22.212011 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-556a5d68-a38a-4fdb-af25-e10f4de52e4e tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:22.212684 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-556a5d68-a38a-4fdb-af25-e10f4de52e4e tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:22.213555 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-556a5d68-a38a-4fdb-af25-e10f4de52e4e tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:22.214240 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-556a5d68-a38a-4fdb-af25-e10f4de52e4e tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:22.214718 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-556a5d68-a38a-4fdb-af25-e10f4de52e4e tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:22.424758 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-b62128c6-860b-4286-a972-b7d1456a85b4 tempest-VolumesNegativeTest-576433402 tempest-VolumesNegativeTest-576433402-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:22.425498 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-b62128c6-860b-4286-a972-b7d1456a85b4 tempest-VolumesNegativeTest-576433402 tempest-VolumesNegativeTest-576433402-project] [instance: d14f274d-ec3f-4eb1-bf59-de6e71db5d97] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:22.436978 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b62128c6-860b-4286-a972-b7d1456a85b4 tempest-VolumesNegativeTest-576433402 tempest-VolumesNegativeTest-576433402-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:22.437771 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b62128c6-860b-4286-a972-b7d1456a85b4 tempest-VolumesNegativeTest-576433402 tempest-VolumesNegativeTest-576433402-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:22.438397 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b62128c6-860b-4286-a972-b7d1456a85b4 tempest-VolumesNegativeTest-576433402 tempest-VolumesNegativeTest-576433402-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:22.439308 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b62128c6-860b-4286-a972-b7d1456a85b4 tempest-VolumesNegativeTest-576433402 tempest-VolumesNegativeTest-576433402-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:22.439764 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b62128c6-860b-4286-a972-b7d1456a85b4 tempest-VolumesNegativeTest-576433402 tempest-VolumesNegativeTest-576433402-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:22.440193 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b62128c6-860b-4286-a972-b7d1456a85b4 tempest-VolumesNegativeTest-576433402 tempest-VolumesNegativeTest-576433402-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:22.453294 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-556a5d68-a38a-4fdb-af25-e10f4de52e4e tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:09:22.462798 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-556a5d68-a38a-4fdb-af25-e10f4de52e4e tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:09:22.464505 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-556a5d68-a38a-4fdb-af25-e10f4de52e4e tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:09:22.466024 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-556a5d68-a38a-4fdb-af25-e10f4de52e4e tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] 10.222.0.43 "GET /compute/v2.1/servers/95863fa8-413d-4cc5-bbbf-2b044f1bdc89" status: 200 len: 1720 microversion: 2.20 time: 0.267346 Oct 04 19:09:22.466703 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2969/6307] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:09:22 2022] GET /compute/v2.1/servers/95863fa8-413d-4cc5-bbbf-2b044f1bdc89 => generated 1720 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:09:22.578748 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-b62128c6-860b-4286-a972-b7d1456a85b4 tempest-VolumesNegativeTest-576433402 tempest-VolumesNegativeTest-576433402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a616bf8f1864e428996142a5438f532', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1f42445b8441be8d6b0e52d288d8c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:09:22.588056 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-b62128c6-860b-4286-a972-b7d1456a85b4 tempest-VolumesNegativeTest-576433402 tempest-VolumesNegativeTest-576433402-project] 10.222.0.43 "GET /compute/v2.1/servers/d14f274d-ec3f-4eb1-bf59-de6e71db5d97" status: 200 len: 1471 microversion: 2.1 time: 0.167558 Oct 04 19:09:22.588648 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3339/6308] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:09:22 2022] GET /compute/v2.1/servers/d14f274d-ec3f-4eb1-bf59-de6e71db5d97 => generated 1471 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:09:23.273994 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-496201a6-2a50-47a0-bf82-e04fa0e77a27 req-cf1a01b6-7615-4a22-bed3-e6f497329f50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d14f274d-ec3f-4eb1-bf59-de6e71db5d97", "name": "network-vif-deleted", "tag": "6311e525-8254-4c54-ba6a-142ecb8d5d90"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:09:23.286036 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-496201a6-2a50-47a0-bf82-e04fa0e77a27 req-cf1a01b6-7615-4a22-bed3-e6f497329f50 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:23.286531 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-496201a6-2a50-47a0-bf82-e04fa0e77a27 req-cf1a01b6-7615-4a22-bed3-e6f497329f50 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:23.286984 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-496201a6-2a50-47a0-bf82-e04fa0e77a27 req-cf1a01b6-7615-4a22-bed3-e6f497329f50 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:23.300084 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-496201a6-2a50-47a0-bf82-e04fa0e77a27 req-cf1a01b6-7615-4a22-bed3-e6f497329f50 service nova] Creating event network-vif-deleted:6311e525-8254-4c54-ba6a-142ecb8d5d90 for instance d14f274d-ec3f-4eb1-bf59-de6e71db5d97 on n-h2-851028-13 Oct 04 19:09:23.306408 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-496201a6-2a50-47a0-bf82-e04fa0e77a27 req-cf1a01b6-7615-4a22-bed3-e6f497329f50 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037086 Oct 04 19:09:23.309308 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2970/6309] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:09:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:09:23.492310 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-4d57d4f8-b22a-4a6b-a5d3-cf3caabb83a8 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:23.493189 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-4d57d4f8-b22a-4a6b-a5d3-cf3caabb83a8 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] [instance: 95863fa8-413d-4cc5-bbbf-2b044f1bdc89] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:23.500130 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4d57d4f8-b22a-4a6b-a5d3-cf3caabb83a8 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:23.500774 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4d57d4f8-b22a-4a6b-a5d3-cf3caabb83a8 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:23.501246 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4d57d4f8-b22a-4a6b-a5d3-cf3caabb83a8 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:23.501952 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4d57d4f8-b22a-4a6b-a5d3-cf3caabb83a8 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:23.502412 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4d57d4f8-b22a-4a6b-a5d3-cf3caabb83a8 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:23.502845 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4d57d4f8-b22a-4a6b-a5d3-cf3caabb83a8 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:23.615276 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-a83d6bea-59db-4852-8a63-34e023933698 tempest-VolumesNegativeTest-576433402 tempest-VolumesNegativeTest-576433402-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:23.616091 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-a83d6bea-59db-4852-8a63-34e023933698 tempest-VolumesNegativeTest-576433402 tempest-VolumesNegativeTest-576433402-project] [instance: d14f274d-ec3f-4eb1-bf59-de6e71db5d97] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:23.623382 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a83d6bea-59db-4852-8a63-34e023933698 tempest-VolumesNegativeTest-576433402 tempest-VolumesNegativeTest-576433402-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:23.624009 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a83d6bea-59db-4852-8a63-34e023933698 tempest-VolumesNegativeTest-576433402 tempest-VolumesNegativeTest-576433402-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:23.624521 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a83d6bea-59db-4852-8a63-34e023933698 tempest-VolumesNegativeTest-576433402 tempest-VolumesNegativeTest-576433402-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:23.625339 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a83d6bea-59db-4852-8a63-34e023933698 tempest-VolumesNegativeTest-576433402 tempest-VolumesNegativeTest-576433402-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:23.625891 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a83d6bea-59db-4852-8a63-34e023933698 tempest-VolumesNegativeTest-576433402 tempest-VolumesNegativeTest-576433402-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:23.626394 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a83d6bea-59db-4852-8a63-34e023933698 tempest-VolumesNegativeTest-576433402 tempest-VolumesNegativeTest-576433402-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:23.639949 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-4d57d4f8-b22a-4a6b-a5d3-cf3caabb83a8 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:09:23.649898 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-4d57d4f8-b22a-4a6b-a5d3-cf3caabb83a8 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:09:23.651723 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-4d57d4f8-b22a-4a6b-a5d3-cf3caabb83a8 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:09:23.652959 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-4d57d4f8-b22a-4a6b-a5d3-cf3caabb83a8 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] 10.222.0.43 "GET /compute/v2.1/servers/95863fa8-413d-4cc5-bbbf-2b044f1bdc89" status: 200 len: 1720 microversion: 2.20 time: 0.165258 Oct 04 19:09:23.653749 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3340/6310] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:09:23 2022] GET /compute/v2.1/servers/95863fa8-413d-4cc5-bbbf-2b044f1bdc89 => generated 1720 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:09:23.665041 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a83d6bea-59db-4852-8a63-34e023933698 tempest-VolumesNegativeTest-576433402 tempest-VolumesNegativeTest-576433402-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:23.665561 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a83d6bea-59db-4852-8a63-34e023933698 tempest-VolumesNegativeTest-576433402 tempest-VolumesNegativeTest-576433402-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:23.666004 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a83d6bea-59db-4852-8a63-34e023933698 tempest-VolumesNegativeTest-576433402 tempest-VolumesNegativeTest-576433402-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:23.666464 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.objects.instance [None req-a83d6bea-59db-4852-8a63-34e023933698 tempest-VolumesNegativeTest-576433402 tempest-VolumesNegativeTest-576433402-project] Lazy-loading 'fault' on Instance uuid d14f274d-ec3f-4eb1-bf59-de6e71db5d97 {{(pid=123595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 19:09:24.057195 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-a83d6bea-59db-4852-8a63-34e023933698 tempest-VolumesNegativeTest-576433402 tempest-VolumesNegativeTest-576433402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a616bf8f1864e428996142a5438f532', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1f42445b8441be8d6b0e52d288d8c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:09:24.064363 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-a83d6bea-59db-4852-8a63-34e023933698 tempest-VolumesNegativeTest-576433402 tempest-VolumesNegativeTest-576433402-project] 10.222.0.43 "GET /compute/v2.1/servers/d14f274d-ec3f-4eb1-bf59-de6e71db5d97" status: 200 len: 1305 microversion: 2.1 time: 0.456408 Oct 04 19:09:24.064950 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2971/6311] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:09:23 2022] GET /compute/v2.1/servers/d14f274d-ec3f-4eb1-bf59-de6e71db5d97 => generated 1305 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:09:24.681900 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-9f0b57e6-fc83-463b-a6cc-2965ce62ab86 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:24.682512 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-9f0b57e6-fc83-463b-a6cc-2965ce62ab86 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] [instance: 95863fa8-413d-4cc5-bbbf-2b044f1bdc89] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:24.689652 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9f0b57e6-fc83-463b-a6cc-2965ce62ab86 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:24.690155 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9f0b57e6-fc83-463b-a6cc-2965ce62ab86 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:24.690593 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9f0b57e6-fc83-463b-a6cc-2965ce62ab86 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:24.691312 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9f0b57e6-fc83-463b-a6cc-2965ce62ab86 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:24.691765 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9f0b57e6-fc83-463b-a6cc-2965ce62ab86 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:24.692205 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9f0b57e6-fc83-463b-a6cc-2965ce62ab86 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:24.847447 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-9f0b57e6-fc83-463b-a6cc-2965ce62ab86 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:09:24.860210 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-9f0b57e6-fc83-463b-a6cc-2965ce62ab86 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:09:24.861712 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-9f0b57e6-fc83-463b-a6cc-2965ce62ab86 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:09:24.862906 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-9f0b57e6-fc83-463b-a6cc-2965ce62ab86 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] 10.222.0.43 "GET /compute/v2.1/servers/95863fa8-413d-4cc5-bbbf-2b044f1bdc89" status: 200 len: 1720 microversion: 2.20 time: 0.187216 Oct 04 19:09:24.863478 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3341/6312] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:09:24 2022] GET /compute/v2.1/servers/95863fa8-413d-4cc5-bbbf-2b044f1bdc89 => generated 1720 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:09:25.088693 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-9293d582-e622-4525-9928-7396d863a3de tempest-VolumesNegativeTest-576433402 tempest-VolumesNegativeTest-576433402-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:25.089527 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-9293d582-e622-4525-9928-7396d863a3de tempest-VolumesNegativeTest-576433402 tempest-VolumesNegativeTest-576433402-project] [instance: d14f274d-ec3f-4eb1-bf59-de6e71db5d97] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:25.098015 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9293d582-e622-4525-9928-7396d863a3de tempest-VolumesNegativeTest-576433402 tempest-VolumesNegativeTest-576433402-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:25.098645 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9293d582-e622-4525-9928-7396d863a3de tempest-VolumesNegativeTest-576433402 tempest-VolumesNegativeTest-576433402-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:25.099221 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9293d582-e622-4525-9928-7396d863a3de tempest-VolumesNegativeTest-576433402 tempest-VolumesNegativeTest-576433402-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:25.100046 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9293d582-e622-4525-9928-7396d863a3de tempest-VolumesNegativeTest-576433402 tempest-VolumesNegativeTest-576433402-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:25.100610 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9293d582-e622-4525-9928-7396d863a3de tempest-VolumesNegativeTest-576433402 tempest-VolumesNegativeTest-576433402-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:25.101317 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9293d582-e622-4525-9928-7396d863a3de tempest-VolumesNegativeTest-576433402 tempest-VolumesNegativeTest-576433402-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:25.115883 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-9293d582-e622-4525-9928-7396d863a3de tempest-VolumesNegativeTest-576433402 tempest-VolumesNegativeTest-576433402-project] HTTP exception thrown: Instance d14f274d-ec3f-4eb1-bf59-de6e71db5d97 could not be found. Oct 04 19:09:25.119747 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-9293d582-e622-4525-9928-7396d863a3de tempest-VolumesNegativeTest-576433402 tempest-VolumesNegativeTest-576433402-project] Request method failure captured: Oct 04 19:09:25.119747 n-d-851028-13 devstack@n-api.service[123595]: request: GET /compute/v2.1/servers/d14f274d-ec3f-4eb1-bf59-de6e71db5d97 HTTP/1.1 Oct 04 19:09:25.119747 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 19:09:25.119747 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 19:09:25.119747 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 19:09:25.119747 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 0 Oct 04 19:09:25.119747 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 19:09:25.119747 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 19:09:25.119747 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 19:09:25.119747 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 19:09:25.119747 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPITSu1JKePr5QbwrqdTlRmOEYf5SRMmXlTAtzmdb1ty2tnygz_ubjqt_UPyVqLFG1QN1zcA-qRWDYlEKPhtq9HPo7Hk602awldzIWWd6966PXvkwEy4YCFgP_7s-z5kYb6uzDWsoHF3thTAkLtpTC9pVdqrLXa2teMUjwAbCAhsh_fo Oct 04 19:09:25.119747 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 19:09:25.119747 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 19:09:25.119747 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 19:09:25.119747 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 19:09:25.119747 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 19:09:25.119747 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 19:09:25.119747 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: de1f42445b8441be8d6b0e52d288d8c6 Oct 04 19:09:25.119747 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-VolumesNegativeTest-576433402 Oct 04 19:09:25.119747 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 19:09:25.119747 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 19:09:25.119747 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/de1f42445b8441be8d6b0e52d288d8c6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_de1f42445b8441be8d6b0e52d288d8c6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/de1f42445b8441be8d6b0e52d288d8c6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/de1f42445b8441be8d6b0e52d288d8c6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 19:09:25.119747 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-VolumesNegativeTest-576433402 Oct 04 19:09:25.119747 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: de1f42445b8441be8d6b0e52d288d8c6 Oct 04 19:09:25.119747 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-VolumesNegativeTest-576433402 Oct 04 19:09:25.119747 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-VolumesNegativeTest-576433402-project Oct 04 19:09:25.119747 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 19:09:25.119747 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 19:09:25.119747 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: 2a616bf8f1864e428996142a5438f532 Oct 04 19:09:25.119747 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-VolumesNegativeTest-576433402-project Oct 04 19:09:25.119747 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 19:09:25.119747 n-d-851028-13 devstack@n-api.service[123595]: exception: Instance d14f274d-ec3f-4eb1-bf59-de6e71db5d97 could not be found. Oct 04 19:09:25.119747 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': 'd14f274d-ec3f-4eb1-bf59-de6e71db5d97'} Oct 04 19:09:25.119747 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:09:25.119747 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:09:25.119747 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:09:25.119747 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:09:25.119747 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:09:25.119747 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:09:25.119747 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:09:25.119747 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:09:25.119747 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:09:25.119747 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:09:25.119747 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d14f274d-ec3f-4eb1-bf59-de6e71db5d97 could not be found. Oct 04 19:09:25.119747 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:09:25.119747 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:09:25.119747 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:09:25.119747 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:09:25.119747 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:09:25.119747 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:09:25.119747 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:09:25.119747 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:09:25.119747 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:09:25.119747 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:09:25.119747 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:09:25.119747 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:09:25.119747 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:09:25.119747 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:09:25.119747 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:09:25.119747 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:09:25.119747 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d14f274d-ec3f-4eb1-bf59-de6e71db5d97 could not be found. Oct 04 19:09:25.119747 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:09:25.119747 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:09:25.119747 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:09:25.124738 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:09:25.124738 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:09:25.124738 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:09:25.124738 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:09:25.124738 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:09:25.124738 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d14f274d-ec3f-4eb1-bf59-de6e71db5d97 could not be found. Oct 04 19:09:25.124738 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:09:25.124738 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-9293d582-e622-4525-9928-7396d863a3de tempest-VolumesNegativeTest-576433402 tempest-VolumesNegativeTest-576433402-project] Returning 404 to user: Instance d14f274d-ec3f-4eb1-bf59-de6e71db5d97 could not be found. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:09:25.124738 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-9293d582-e622-4525-9928-7396d863a3de tempest-VolumesNegativeTest-576433402 tempest-VolumesNegativeTest-576433402-project] 10.222.0.43 "GET /compute/v2.1/servers/d14f274d-ec3f-4eb1-bf59-de6e71db5d97" status: 404 len: 111 microversion: 2.1 time: 0.035339 Oct 04 19:09:25.126967 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2972/6313] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:09:25 2022] GET /compute/v2.1/servers/d14f274d-ec3f-4eb1-bf59-de6e71db5d97 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:09:25.164728 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-7a27104e-dc68-40ba-829a-2422f1a15d92 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:09:25.167263 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-7a27104e-dc68-40ba-829a-2422f1a15d92 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] [instance: 021d75cf-769e-47ee-87a7-3e19da9e9bf4] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:25.173603 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7a27104e-dc68-40ba-829a-2422f1a15d92 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:25.174250 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7a27104e-dc68-40ba-829a-2422f1a15d92 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:25.174949 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7a27104e-dc68-40ba-829a-2422f1a15d92 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:25.175865 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7a27104e-dc68-40ba-829a-2422f1a15d92 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:25.176980 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7a27104e-dc68-40ba-829a-2422f1a15d92 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:25.177589 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7a27104e-dc68-40ba-829a-2422f1a15d92 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:25.242416 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-7a27104e-dc68-40ba-829a-2422f1a15d92 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] 10.222.0.43 "POST /compute/v2.1/servers/021d75cf-769e-47ee-87a7-3e19da9e9bf4/action" status: 200 len: 24576 microversion: 2.1 time: 0.079919 Oct 04 19:09:25.254450 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3342/6314] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 19:09:25 2022] POST /compute/v2.1/servers/021d75cf-769e-47ee-87a7-3e19da9e9bf4/action => generated 24576 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 19:09:25.888601 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-170922f5-0ed3-4529-bc23-151d27ac910b tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:25.889256 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-170922f5-0ed3-4529-bc23-151d27ac910b tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] [instance: 95863fa8-413d-4cc5-bbbf-2b044f1bdc89] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:25.897327 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-170922f5-0ed3-4529-bc23-151d27ac910b tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:25.897867 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-170922f5-0ed3-4529-bc23-151d27ac910b tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:25.898776 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-170922f5-0ed3-4529-bc23-151d27ac910b tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:25.899939 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-170922f5-0ed3-4529-bc23-151d27ac910b tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:25.900406 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-170922f5-0ed3-4529-bc23-151d27ac910b tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:25.901956 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-170922f5-0ed3-4529-bc23-151d27ac910b tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:26.096625 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-170922f5-0ed3-4529-bc23-151d27ac910b tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:09:26.110015 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-170922f5-0ed3-4529-bc23-151d27ac910b tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:09:26.113767 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-170922f5-0ed3-4529-bc23-151d27ac910b tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:09:26.115261 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-170922f5-0ed3-4529-bc23-151d27ac910b tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] 10.222.0.43 "GET /compute/v2.1/servers/95863fa8-413d-4cc5-bbbf-2b044f1bdc89" status: 200 len: 1720 microversion: 2.20 time: 0.230719 Oct 04 19:09:26.117198 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2973/6315] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:09:25 2022] GET /compute/v2.1/servers/95863fa8-413d-4cc5-bbbf-2b044f1bdc89 => generated 1720 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:09:27.144150 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-4c5d43e0-e4ef-4625-9b7b-2a60a5bed8b5 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:27.144858 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-4c5d43e0-e4ef-4625-9b7b-2a60a5bed8b5 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] [instance: 95863fa8-413d-4cc5-bbbf-2b044f1bdc89] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:27.153909 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4c5d43e0-e4ef-4625-9b7b-2a60a5bed8b5 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:27.154394 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4c5d43e0-e4ef-4625-9b7b-2a60a5bed8b5 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:27.155124 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4c5d43e0-e4ef-4625-9b7b-2a60a5bed8b5 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:27.156002 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4c5d43e0-e4ef-4625-9b7b-2a60a5bed8b5 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:27.156752 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4c5d43e0-e4ef-4625-9b7b-2a60a5bed8b5 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:27.157369 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4c5d43e0-e4ef-4625-9b7b-2a60a5bed8b5 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:27.363997 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-4c5d43e0-e4ef-4625-9b7b-2a60a5bed8b5 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:09:27.380716 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-4c5d43e0-e4ef-4625-9b7b-2a60a5bed8b5 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:09:27.382905 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-4c5d43e0-e4ef-4625-9b7b-2a60a5bed8b5 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:09:27.384256 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-4c5d43e0-e4ef-4625-9b7b-2a60a5bed8b5 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] 10.222.0.43 "GET /compute/v2.1/servers/95863fa8-413d-4cc5-bbbf-2b044f1bdc89" status: 200 len: 1720 microversion: 2.20 time: 0.244871 Oct 04 19:09:27.384820 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3343/6316] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:09:27 2022] GET /compute/v2.1/servers/95863fa8-413d-4cc5-bbbf-2b044f1bdc89 => generated 1720 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 19:09:28.410916 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-02a11031-8293-43e6-997b-f9fb357c55d6 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:28.411540 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-02a11031-8293-43e6-997b-f9fb357c55d6 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] [instance: 95863fa8-413d-4cc5-bbbf-2b044f1bdc89] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:28.418577 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-02a11031-8293-43e6-997b-f9fb357c55d6 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:28.419192 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-02a11031-8293-43e6-997b-f9fb357c55d6 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:28.419988 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-02a11031-8293-43e6-997b-f9fb357c55d6 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:28.420782 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-02a11031-8293-43e6-997b-f9fb357c55d6 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:28.421519 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-02a11031-8293-43e6-997b-f9fb357c55d6 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:28.422029 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-02a11031-8293-43e6-997b-f9fb357c55d6 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:28.584885 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-02a11031-8293-43e6-997b-f9fb357c55d6 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:09:28.598312 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-02a11031-8293-43e6-997b-f9fb357c55d6 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:09:28.601638 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-02a11031-8293-43e6-997b-f9fb357c55d6 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:09:28.603116 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-02a11031-8293-43e6-997b-f9fb357c55d6 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] 10.222.0.43 "GET /compute/v2.1/servers/95863fa8-413d-4cc5-bbbf-2b044f1bdc89" status: 200 len: 1720 microversion: 2.20 time: 0.197209 Oct 04 19:09:28.604269 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2974/6317] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:09:28 2022] GET /compute/v2.1/servers/95863fa8-413d-4cc5-bbbf-2b044f1bdc89 => generated 1720 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 19:09:29.643322 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-c89ac7df-4ee7-4acd-aa48-fca8e6cd65e5 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:29.645037 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-c89ac7df-4ee7-4acd-aa48-fca8e6cd65e5 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] [instance: 95863fa8-413d-4cc5-bbbf-2b044f1bdc89] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:29.651616 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:09:29.653554 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c89ac7df-4ee7-4acd-aa48-fca8e6cd65e5 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:29.654238 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c89ac7df-4ee7-4acd-aa48-fca8e6cd65e5 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:29.654987 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c89ac7df-4ee7-4acd-aa48-fca8e6cd65e5 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:29.655852 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c89ac7df-4ee7-4acd-aa48-fca8e6cd65e5 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:29.656308 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c89ac7df-4ee7-4acd-aa48-fca8e6cd65e5 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:29.656736 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c89ac7df-4ee7-4acd-aa48-fca8e6cd65e5 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:29.863210 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-c89ac7df-4ee7-4acd-aa48-fca8e6cd65e5 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:09:29.873220 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-c89ac7df-4ee7-4acd-aa48-fca8e6cd65e5 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:09:29.874772 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-c89ac7df-4ee7-4acd-aa48-fca8e6cd65e5 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:09:29.876074 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-c89ac7df-4ee7-4acd-aa48-fca8e6cd65e5 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] 10.222.0.43 "GET /compute/v2.1/servers/95863fa8-413d-4cc5-bbbf-2b044f1bdc89" status: 200 len: 1720 microversion: 2.20 time: 0.238688 Oct 04 19:09:29.877150 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3344/6318] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:09:29 2022] GET /compute/v2.1/servers/95863fa8-413d-4cc5-bbbf-2b044f1bdc89 => generated 1720 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 19:09:30.908372 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-884d371c-c374-4fc2-bc57-d97b4b5a6054 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:30.909631 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-884d371c-c374-4fc2-bc57-d97b4b5a6054 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] [instance: 95863fa8-413d-4cc5-bbbf-2b044f1bdc89] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:30.919556 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-884d371c-c374-4fc2-bc57-d97b4b5a6054 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:30.920153 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-884d371c-c374-4fc2-bc57-d97b4b5a6054 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:30.920701 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-884d371c-c374-4fc2-bc57-d97b4b5a6054 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:30.921857 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-884d371c-c374-4fc2-bc57-d97b4b5a6054 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:30.922522 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-884d371c-c374-4fc2-bc57-d97b4b5a6054 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:30.923061 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-884d371c-c374-4fc2-bc57-d97b4b5a6054 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:31.223603 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-884d371c-c374-4fc2-bc57-d97b4b5a6054 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:09:31.237545 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-884d371c-c374-4fc2-bc57-d97b4b5a6054 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:09:31.244134 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-884d371c-c374-4fc2-bc57-d97b4b5a6054 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:09:31.250415 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-884d371c-c374-4fc2-bc57-d97b4b5a6054 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] 10.222.0.43 "GET /compute/v2.1/servers/95863fa8-413d-4cc5-bbbf-2b044f1bdc89" status: 200 len: 1720 microversion: 2.20 time: 0.346716 Oct 04 19:09:31.250697 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2975/6319] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:09:30 2022] GET /compute/v2.1/servers/95863fa8-413d-4cc5-bbbf-2b044f1bdc89 => generated 1720 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:09:32.283038 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-d7a5e0fc-c08b-43b8-8644-1aceed6185ca tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:32.284358 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-d7a5e0fc-c08b-43b8-8644-1aceed6185ca tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] [instance: 95863fa8-413d-4cc5-bbbf-2b044f1bdc89] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:32.294395 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d7a5e0fc-c08b-43b8-8644-1aceed6185ca tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:32.295199 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d7a5e0fc-c08b-43b8-8644-1aceed6185ca tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:32.296158 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d7a5e0fc-c08b-43b8-8644-1aceed6185ca tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:32.297508 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d7a5e0fc-c08b-43b8-8644-1aceed6185ca tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:32.298205 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d7a5e0fc-c08b-43b8-8644-1aceed6185ca tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:32.298865 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d7a5e0fc-c08b-43b8-8644-1aceed6185ca tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:32.345258 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:09:32.810762 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-d7a5e0fc-c08b-43b8-8644-1aceed6185ca tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:09:32.820065 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-d7a5e0fc-c08b-43b8-8644-1aceed6185ca tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:09:32.821561 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-d7a5e0fc-c08b-43b8-8644-1aceed6185ca tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:09:32.823023 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-d7a5e0fc-c08b-43b8-8644-1aceed6185ca tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] 10.222.0.43 "GET /compute/v2.1/servers/95863fa8-413d-4cc5-bbbf-2b044f1bdc89" status: 200 len: 1720 microversion: 2.20 time: 0.545527 Oct 04 19:09:32.823768 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3345/6320] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:09:32 2022] GET /compute/v2.1/servers/95863fa8-413d-4cc5-bbbf-2b044f1bdc89 => generated 1720 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:09:33.851011 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-b32feed8-baa3-45aa-a3d9-ce5ef1e26e78 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:33.852479 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-b32feed8-baa3-45aa-a3d9-ce5ef1e26e78 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] [instance: 95863fa8-413d-4cc5-bbbf-2b044f1bdc89] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:33.861896 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b32feed8-baa3-45aa-a3d9-ce5ef1e26e78 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:33.862617 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b32feed8-baa3-45aa-a3d9-ce5ef1e26e78 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:33.863069 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b32feed8-baa3-45aa-a3d9-ce5ef1e26e78 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:33.863791 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b32feed8-baa3-45aa-a3d9-ce5ef1e26e78 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:33.864255 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b32feed8-baa3-45aa-a3d9-ce5ef1e26e78 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:33.864698 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b32feed8-baa3-45aa-a3d9-ce5ef1e26e78 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:34.028989 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-b32feed8-baa3-45aa-a3d9-ce5ef1e26e78 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:09:34.037285 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-b32feed8-baa3-45aa-a3d9-ce5ef1e26e78 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:09:34.039247 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-b32feed8-baa3-45aa-a3d9-ce5ef1e26e78 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:09:34.040437 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-b32feed8-baa3-45aa-a3d9-ce5ef1e26e78 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] 10.222.0.43 "GET /compute/v2.1/servers/95863fa8-413d-4cc5-bbbf-2b044f1bdc89" status: 200 len: 1720 microversion: 2.20 time: 0.194150 Oct 04 19:09:34.040993 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2976/6321] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:09:33 2022] GET /compute/v2.1/servers/95863fa8-413d-4cc5-bbbf-2b044f1bdc89 => generated 1720 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:09:35.081257 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-9cb7ae3c-e6b0-4d50-a359-b75154430eee tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:35.081952 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-9cb7ae3c-e6b0-4d50-a359-b75154430eee tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] [instance: 95863fa8-413d-4cc5-bbbf-2b044f1bdc89] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:35.090235 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9cb7ae3c-e6b0-4d50-a359-b75154430eee tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:35.090658 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9cb7ae3c-e6b0-4d50-a359-b75154430eee tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:35.092207 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9cb7ae3c-e6b0-4d50-a359-b75154430eee tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:35.092207 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9cb7ae3c-e6b0-4d50-a359-b75154430eee tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:35.092477 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9cb7ae3c-e6b0-4d50-a359-b75154430eee tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:35.093103 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9cb7ae3c-e6b0-4d50-a359-b75154430eee tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:35.279211 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-9cb7ae3c-e6b0-4d50-a359-b75154430eee tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:09:35.287993 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-9cb7ae3c-e6b0-4d50-a359-b75154430eee tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:09:35.289860 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-9cb7ae3c-e6b0-4d50-a359-b75154430eee tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:09:35.291226 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-9cb7ae3c-e6b0-4d50-a359-b75154430eee tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] 10.222.0.43 "GET /compute/v2.1/servers/95863fa8-413d-4cc5-bbbf-2b044f1bdc89" status: 200 len: 1720 microversion: 2.20 time: 0.227177 Oct 04 19:09:35.291786 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3346/6322] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:09:35 2022] GET /compute/v2.1/servers/95863fa8-413d-4cc5-bbbf-2b044f1bdc89 => generated 1720 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:09:36.319213 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-a5b4e0d6-80c3-4dcc-b3c4-7d59c4c2ba4e tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:36.322087 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-a5b4e0d6-80c3-4dcc-b3c4-7d59c4c2ba4e tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] [instance: 95863fa8-413d-4cc5-bbbf-2b044f1bdc89] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:36.342684 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a5b4e0d6-80c3-4dcc-b3c4-7d59c4c2ba4e tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:36.343569 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a5b4e0d6-80c3-4dcc-b3c4-7d59c4c2ba4e tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:36.344292 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a5b4e0d6-80c3-4dcc-b3c4-7d59c4c2ba4e tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:36.345311 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a5b4e0d6-80c3-4dcc-b3c4-7d59c4c2ba4e tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:36.346136 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a5b4e0d6-80c3-4dcc-b3c4-7d59c4c2ba4e tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:36.346819 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a5b4e0d6-80c3-4dcc-b3c4-7d59c4c2ba4e tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:36.680138 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-a5b4e0d6-80c3-4dcc-b3c4-7d59c4c2ba4e tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:09:36.690880 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-a5b4e0d6-80c3-4dcc-b3c4-7d59c4c2ba4e tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:09:36.692475 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-a5b4e0d6-80c3-4dcc-b3c4-7d59c4c2ba4e tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:09:36.694161 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-a5b4e0d6-80c3-4dcc-b3c4-7d59c4c2ba4e tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] 10.222.0.43 "GET /compute/v2.1/servers/95863fa8-413d-4cc5-bbbf-2b044f1bdc89" status: 200 len: 1720 microversion: 2.20 time: 0.380334 Oct 04 19:09:36.695635 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2977/6323] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:09:36 2022] GET /compute/v2.1/servers/95863fa8-413d-4cc5-bbbf-2b044f1bdc89 => generated 1720 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:09:37.364116 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-1b49d527-b574-43ce-9261-b67f516299ff tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:37.364810 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-1b49d527-b574-43ce-9261-b67f516299ff tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] [instance: 021d75cf-769e-47ee-87a7-3e19da9e9bf4] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:37.367710 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-07734941-f26f-4c4a-b018-f2e939283c9c req-03e607f3-46c6-48d6-9666-43e66bf530a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "021d75cf-769e-47ee-87a7-3e19da9e9bf4", "tag": "28ebdde4-3296-4851-b0f6-5feb9448703b"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:09:37.381587 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-07734941-f26f-4c4a-b018-f2e939283c9c req-03e607f3-46c6-48d6-9666-43e66bf530a8 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:37.381906 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1b49d527-b574-43ce-9261-b67f516299ff tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:37.382461 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-07734941-f26f-4c4a-b018-f2e939283c9c req-03e607f3-46c6-48d6-9666-43e66bf530a8 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:37.382672 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1b49d527-b574-43ce-9261-b67f516299ff tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:37.383231 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1b49d527-b574-43ce-9261-b67f516299ff tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:37.383401 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-07734941-f26f-4c4a-b018-f2e939283c9c req-03e607f3-46c6-48d6-9666-43e66bf530a8 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:37.384165 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1b49d527-b574-43ce-9261-b67f516299ff tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:37.388044 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1b49d527-b574-43ce-9261-b67f516299ff tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:37.388617 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1b49d527-b574-43ce-9261-b67f516299ff tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:37.406439 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-07734941-f26f-4c4a-b018-f2e939283c9c req-03e607f3-46c6-48d6-9666-43e66bf530a8 service nova] Creating event network-changed:28ebdde4-3296-4851-b0f6-5feb9448703b for instance 021d75cf-769e-47ee-87a7-3e19da9e9bf4 on n-h2-851028-13 Oct 04 19:09:37.419240 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-07734941-f26f-4c4a-b018-f2e939283c9c req-03e607f3-46c6-48d6-9666-43e66bf530a8 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055668 Oct 04 19:09:37.424063 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2978/6324] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:09:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:09:37.431698 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-1b49d527-b574-43ce-9261-b67f516299ff tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] [instance: 021d75cf-769e-47ee-87a7-3e19da9e9bf4] Going to try to terminate instance {{(pid=123596) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 19:09:37.544879 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-1b49d527-b574-43ce-9261-b67f516299ff tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] 10.222.0.43 "DELETE /compute/v2.1/servers/021d75cf-769e-47ee-87a7-3e19da9e9bf4" status: 204 len: 0 microversion: 2.1 time: 0.188527 Oct 04 19:09:37.546578 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3347/6325] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 19:09:37 2022] DELETE /compute/v2.1/servers/021d75cf-769e-47ee-87a7-3e19da9e9bf4 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:09:37.559688 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-59179023-603f-4300-b4e8-93139ee91d17 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:37.560835 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-59179023-603f-4300-b4e8-93139ee91d17 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] [instance: 021d75cf-769e-47ee-87a7-3e19da9e9bf4] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:37.572908 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-59179023-603f-4300-b4e8-93139ee91d17 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:37.576569 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-59179023-603f-4300-b4e8-93139ee91d17 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:37.577061 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-59179023-603f-4300-b4e8-93139ee91d17 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:37.577842 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-59179023-603f-4300-b4e8-93139ee91d17 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:37.578403 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-59179023-603f-4300-b4e8-93139ee91d17 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:37.578847 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-59179023-603f-4300-b4e8-93139ee91d17 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:37.721079 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-608c82ca-fddd-4550-a348-9d5535b21b49 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:37.722057 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-608c82ca-fddd-4550-a348-9d5535b21b49 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] [instance: 95863fa8-413d-4cc5-bbbf-2b044f1bdc89] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:37.739894 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-608c82ca-fddd-4550-a348-9d5535b21b49 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:37.740528 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-608c82ca-fddd-4550-a348-9d5535b21b49 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:37.741003 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-608c82ca-fddd-4550-a348-9d5535b21b49 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:37.741835 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-608c82ca-fddd-4550-a348-9d5535b21b49 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:37.742492 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-608c82ca-fddd-4550-a348-9d5535b21b49 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:37.742943 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-608c82ca-fddd-4550-a348-9d5535b21b49 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:37.924051 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-608c82ca-fddd-4550-a348-9d5535b21b49 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:09:37.933445 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-608c82ca-fddd-4550-a348-9d5535b21b49 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:09:37.936393 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-608c82ca-fddd-4550-a348-9d5535b21b49 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:09:37.937945 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-608c82ca-fddd-4550-a348-9d5535b21b49 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] 10.222.0.43 "GET /compute/v2.1/servers/95863fa8-413d-4cc5-bbbf-2b044f1bdc89" status: 200 len: 1741 microversion: 2.20 time: 0.221820 Oct 04 19:09:37.939105 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3348/6326] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:09:37 2022] GET /compute/v2.1/servers/95863fa8-413d-4cc5-bbbf-2b044f1bdc89 => generated 1741 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:09:38.150372 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-59179023-603f-4300-b4e8-93139ee91d17 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf87794979e844349d6ec6c6650565f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c25f1d17e94c74868357744e692487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:09:38.164141 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-59179023-603f-4300-b4e8-93139ee91d17 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] 10.222.0.43 "GET /compute/v2.1/servers/021d75cf-769e-47ee-87a7-3e19da9e9bf4" status: 200 len: 1688 microversion: 2.1 time: 0.612170 Oct 04 19:09:38.184454 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2979/6327] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:09:37 2022] GET /compute/v2.1/servers/021d75cf-769e-47ee-87a7-3e19da9e9bf4 => generated 1688 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:09:38.970601 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-7efa23c1-4201-4390-a26b-88be650e8c2f tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:38.971227 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-7efa23c1-4201-4390-a26b-88be650e8c2f tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] [instance: 95863fa8-413d-4cc5-bbbf-2b044f1bdc89] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:38.984075 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7efa23c1-4201-4390-a26b-88be650e8c2f tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:38.985155 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7efa23c1-4201-4390-a26b-88be650e8c2f tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:38.986175 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7efa23c1-4201-4390-a26b-88be650e8c2f tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:38.987136 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7efa23c1-4201-4390-a26b-88be650e8c2f tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:38.988594 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7efa23c1-4201-4390-a26b-88be650e8c2f tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:38.989568 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7efa23c1-4201-4390-a26b-88be650e8c2f tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:39.202850 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-6fb978b7-6025-4179-8f11-22bd39c600e6 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:39.204327 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-6fb978b7-6025-4179-8f11-22bd39c600e6 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] [instance: 021d75cf-769e-47ee-87a7-3e19da9e9bf4] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:39.224141 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6fb978b7-6025-4179-8f11-22bd39c600e6 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:39.225000 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6fb978b7-6025-4179-8f11-22bd39c600e6 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:39.226605 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6fb978b7-6025-4179-8f11-22bd39c600e6 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:39.229254 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6fb978b7-6025-4179-8f11-22bd39c600e6 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:39.229943 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6fb978b7-6025-4179-8f11-22bd39c600e6 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:39.232953 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6fb978b7-6025-4179-8f11-22bd39c600e6 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:39.242842 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=99 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:09:39.462868 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-7efa23c1-4201-4390-a26b-88be650e8c2f tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:09:39.478312 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-7efa23c1-4201-4390-a26b-88be650e8c2f tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:09:39.482357 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-7efa23c1-4201-4390-a26b-88be650e8c2f tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:09:39.484510 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-7efa23c1-4201-4390-a26b-88be650e8c2f tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] 10.222.0.43 "GET /compute/v2.1/servers/95863fa8-413d-4cc5-bbbf-2b044f1bdc89" status: 200 len: 1741 microversion: 2.20 time: 0.523857 Oct 04 19:09:39.490967 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3349/6328] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:09:38 2022] GET /compute/v2.1/servers/95863fa8-413d-4cc5-bbbf-2b044f1bdc89 => generated 1741 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:09:39.522117 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-6fb978b7-6025-4179-8f11-22bd39c600e6 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf87794979e844349d6ec6c6650565f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c25f1d17e94c74868357744e692487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:09:39.531370 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-6fb978b7-6025-4179-8f11-22bd39c600e6 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] 10.222.0.43 "GET /compute/v2.1/servers/021d75cf-769e-47ee-87a7-3e19da9e9bf4" status: 200 len: 1688 microversion: 2.1 time: 0.347306 Oct 04 19:09:39.545727 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2980/6329] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:09:39 2022] GET /compute/v2.1/servers/021d75cf-769e-47ee-87a7-3e19da9e9bf4 => generated 1688 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:09:39.731373 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-16c00be2-762a-4b6c-8ad6-f6ff8d9c6476 req-841c51bd-2d55-4aab-9392-59f263e65c8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "021d75cf-769e-47ee-87a7-3e19da9e9bf4", "name": "network-vif-deleted", "tag": "28ebdde4-3296-4851-b0f6-5feb9448703b"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:09:39.746657 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-16c00be2-762a-4b6c-8ad6-f6ff8d9c6476 req-841c51bd-2d55-4aab-9392-59f263e65c8a service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:39.747429 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-16c00be2-762a-4b6c-8ad6-f6ff8d9c6476 req-841c51bd-2d55-4aab-9392-59f263e65c8a service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:39.748031 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-16c00be2-762a-4b6c-8ad6-f6ff8d9c6476 req-841c51bd-2d55-4aab-9392-59f263e65c8a service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:39.765590 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-16c00be2-762a-4b6c-8ad6-f6ff8d9c6476 req-841c51bd-2d55-4aab-9392-59f263e65c8a service nova] Creating event network-vif-deleted:28ebdde4-3296-4851-b0f6-5feb9448703b for instance 021d75cf-769e-47ee-87a7-3e19da9e9bf4 on n-h2-851028-13 Oct 04 19:09:39.771794 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-16c00be2-762a-4b6c-8ad6-f6ff8d9c6476 req-841c51bd-2d55-4aab-9392-59f263e65c8a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043632 Oct 04 19:09:39.772761 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3350/6330] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:09:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:09:40.520593 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-c41fb253-13cb-446a-b347-fc2a9eca21c7 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:40.521260 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-c41fb253-13cb-446a-b347-fc2a9eca21c7 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] [instance: 95863fa8-413d-4cc5-bbbf-2b044f1bdc89] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:40.533212 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c41fb253-13cb-446a-b347-fc2a9eca21c7 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:40.534292 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c41fb253-13cb-446a-b347-fc2a9eca21c7 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:40.534917 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c41fb253-13cb-446a-b347-fc2a9eca21c7 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:40.535842 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c41fb253-13cb-446a-b347-fc2a9eca21c7 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:40.536471 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c41fb253-13cb-446a-b347-fc2a9eca21c7 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:40.537075 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c41fb253-13cb-446a-b347-fc2a9eca21c7 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:40.566600 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-bed36482-d55a-4a21-b298-f385bae7d4b0 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:40.567341 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-bed36482-d55a-4a21-b298-f385bae7d4b0 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] [instance: 021d75cf-769e-47ee-87a7-3e19da9e9bf4] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:40.598339 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bed36482-d55a-4a21-b298-f385bae7d4b0 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:40.599753 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bed36482-d55a-4a21-b298-f385bae7d4b0 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:40.603538 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bed36482-d55a-4a21-b298-f385bae7d4b0 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:40.606193 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bed36482-d55a-4a21-b298-f385bae7d4b0 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:40.606812 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bed36482-d55a-4a21-b298-f385bae7d4b0 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:40.607612 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bed36482-d55a-4a21-b298-f385bae7d4b0 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:40.685349 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bed36482-d55a-4a21-b298-f385bae7d4b0 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:40.686581 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bed36482-d55a-4a21-b298-f385bae7d4b0 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:40.687382 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bed36482-d55a-4a21-b298-f385bae7d4b0 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:40.688063 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.objects.instance [None req-bed36482-d55a-4a21-b298-f385bae7d4b0 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lazy-loading 'fault' on Instance uuid 021d75cf-769e-47ee-87a7-3e19da9e9bf4 {{(pid=123596) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 19:09:40.761872 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-c41fb253-13cb-446a-b347-fc2a9eca21c7 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:09:40.785316 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-c41fb253-13cb-446a-b347-fc2a9eca21c7 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:09:40.786909 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-c41fb253-13cb-446a-b347-fc2a9eca21c7 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:09:40.788944 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-c41fb253-13cb-446a-b347-fc2a9eca21c7 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] 10.222.0.43 "GET /compute/v2.1/servers/95863fa8-413d-4cc5-bbbf-2b044f1bdc89" status: 200 len: 1736 microversion: 2.20 time: 0.272828 Oct 04 19:09:40.789976 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2981/6331] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:09:40 2022] GET /compute/v2.1/servers/95863fa8-413d-4cc5-bbbf-2b044f1bdc89 => generated 1736 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:09:40.821628 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-bed36482-d55a-4a21-b298-f385bae7d4b0 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf87794979e844349d6ec6c6650565f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c25f1d17e94c74868357744e692487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:09:40.834998 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-bed36482-d55a-4a21-b298-f385bae7d4b0 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] 10.222.0.43 "GET /compute/v2.1/servers/021d75cf-769e-47ee-87a7-3e19da9e9bf4" status: 200 len: 1357 microversion: 2.1 time: 0.282044 Oct 04 19:09:40.836539 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3351/6332] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:09:40 2022] GET /compute/v2.1/servers/021d75cf-769e-47ee-87a7-3e19da9e9bf4 => generated 1357 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:09:41.829013 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-2da2f286-07d2-4dd9-b8e2-5a77b9e105ab tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:41.829715 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-2da2f286-07d2-4dd9-b8e2-5a77b9e105ab tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] [instance: 95863fa8-413d-4cc5-bbbf-2b044f1bdc89] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:41.862884 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-134ca98f-31cd-494f-85fd-36243845fd81 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:41.864264 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-134ca98f-31cd-494f-85fd-36243845fd81 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] [instance: 021d75cf-769e-47ee-87a7-3e19da9e9bf4] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:41.875416 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2da2f286-07d2-4dd9-b8e2-5a77b9e105ab tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:41.880345 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2da2f286-07d2-4dd9-b8e2-5a77b9e105ab tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:41.880794 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2da2f286-07d2-4dd9-b8e2-5a77b9e105ab tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:41.883575 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-134ca98f-31cd-494f-85fd-36243845fd81 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:41.896355 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2da2f286-07d2-4dd9-b8e2-5a77b9e105ab tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:41.899225 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-134ca98f-31cd-494f-85fd-36243845fd81 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:41.901672 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2da2f286-07d2-4dd9-b8e2-5a77b9e105ab tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:41.904571 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2da2f286-07d2-4dd9-b8e2-5a77b9e105ab tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:41.905255 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-134ca98f-31cd-494f-85fd-36243845fd81 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:41.906284 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-134ca98f-31cd-494f-85fd-36243845fd81 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:41.911144 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-134ca98f-31cd-494f-85fd-36243845fd81 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:41.915572 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-134ca98f-31cd-494f-85fd-36243845fd81 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:41.946688 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-134ca98f-31cd-494f-85fd-36243845fd81 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] HTTP exception thrown: Instance 021d75cf-769e-47ee-87a7-3e19da9e9bf4 could not be found. Oct 04 19:09:41.949671 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-134ca98f-31cd-494f-85fd-36243845fd81 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Request method failure captured: Oct 04 19:09:41.949671 n-d-851028-13 devstack@n-api.service[123596]: request: GET /compute/v2.1/servers/021d75cf-769e-47ee-87a7-3e19da9e9bf4 HTTP/1.1 Oct 04 19:09:41.949671 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 19:09:41.949671 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 19:09:41.949671 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 19:09:41.949671 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 19:09:41.949671 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 19:09:41.949671 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 19:09:41.949671 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 19:09:41.949671 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 19:09:41.949671 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPILod9KvQgJcndo-fDqHX9zocUdSDU033eT2D_YfhLSFm2T3SN0WEilNuSyZVFJ3atPPN5-bjqRuyPagdPBRhMzT--iezZU7INV-q8_AsQceK3zarsciUbdHJOGGNSClObQM90nB-AfRlEBDQ2E25Vo0hnf-nWJuE-QHVCgcYG2sZm8 Oct 04 19:09:41.949671 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 19:09:41.949671 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 19:09:41.949671 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 19:09:41.949671 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 19:09:41.949671 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 19:09:41.949671 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 19:09:41.949671 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: c0c25f1d17e94c74868357744e692487 Oct 04 19:09:41.949671 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1789911209 Oct 04 19:09:41.949671 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 19:09:41.949671 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 19:09:41.949671 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/c0c25f1d17e94c74868357744e692487"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_c0c25f1d17e94c74868357744e692487"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c0c25f1d17e94c74868357744e692487"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c0c25f1d17e94c74868357744e692487"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 19:09:41.949671 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1789911209 Oct 04 19:09:41.949671 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: c0c25f1d17e94c74868357744e692487 Oct 04 19:09:41.949671 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1789911209 Oct 04 19:09:41.949671 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-TestNetworkAdvancedServerOps-1789911209-project Oct 04 19:09:41.949671 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 19:09:41.949671 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 19:09:41.949671 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: bf87794979e844349d6ec6c6650565f7 Oct 04 19:09:41.949671 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1789911209-project Oct 04 19:09:41.949671 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 19:09:41.949671 n-d-851028-13 devstack@n-api.service[123596]: exception: Instance 021d75cf-769e-47ee-87a7-3e19da9e9bf4 could not be found. Oct 04 19:09:41.949671 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': '021d75cf-769e-47ee-87a7-3e19da9e9bf4'} Oct 04 19:09:41.949671 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:09:41.949671 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:09:41.949671 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:09:41.949671 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:09:41.949671 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:09:41.949671 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:09:41.949671 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:09:41.949671 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:09:41.949671 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:09:41.949671 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:09:41.949671 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 021d75cf-769e-47ee-87a7-3e19da9e9bf4 could not be found. Oct 04 19:09:41.949671 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:09:41.949671 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:09:41.949671 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:09:41.949671 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:09:41.949671 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:09:41.949671 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:09:41.949671 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:09:41.949671 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:09:41.949671 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:09:41.949671 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:09:41.949671 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:09:41.949671 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:09:41.949671 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:09:41.949671 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:09:41.949671 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:09:41.949671 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:09:41.949671 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 021d75cf-769e-47ee-87a7-3e19da9e9bf4 could not be found. Oct 04 19:09:41.949671 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:09:41.949671 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:09:41.953419 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:09:41.953419 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:09:41.953419 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:09:41.953419 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:09:41.953419 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:09:41.953419 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:09:41.953419 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 021d75cf-769e-47ee-87a7-3e19da9e9bf4 could not be found. Oct 04 19:09:41.953419 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:09:41.954516 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-134ca98f-31cd-494f-85fd-36243845fd81 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Returning 404 to user: Instance 021d75cf-769e-47ee-87a7-3e19da9e9bf4 could not be found. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:09:41.955512 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-134ca98f-31cd-494f-85fd-36243845fd81 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] 10.222.0.43 "GET /compute/v2.1/servers/021d75cf-769e-47ee-87a7-3e19da9e9bf4" status: 404 len: 111 microversion: 2.1 time: 0.097303 Oct 04 19:09:41.956631 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3352/6333] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:09:41 2022] GET /compute/v2.1/servers/021d75cf-769e-47ee-87a7-3e19da9e9bf4 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:09:42.126179 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-2da2f286-07d2-4dd9-b8e2-5a77b9e105ab tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:09:42.136792 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-2da2f286-07d2-4dd9-b8e2-5a77b9e105ab tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:09:42.138768 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-2da2f286-07d2-4dd9-b8e2-5a77b9e105ab tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:09:42.140680 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-2da2f286-07d2-4dd9-b8e2-5a77b9e105ab tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] 10.222.0.43 "GET /compute/v2.1/servers/95863fa8-413d-4cc5-bbbf-2b044f1bdc89" status: 200 len: 1736 microversion: 2.20 time: 0.328215 Oct 04 19:09:42.141965 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2982/6334] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:09:41 2022] GET /compute/v2.1/servers/95863fa8-413d-4cc5-bbbf-2b044f1bdc89 => generated 1736 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:09:43.078532 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-2dd82ba2-8158-4b4b-9a8b-858e884ecb44 req-79790e5d-5d9d-4db6-b8e4-b10306a1b90b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95863fa8-413d-4cc5-bbbf-2b044f1bdc89", "name": "network-vif-plugged", "status": "completed", "tag": "3f8b2d23-6735-464b-9f26-f53f462f3e82"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:09:43.109703 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-2dd82ba2-8158-4b4b-9a8b-858e884ecb44 req-79790e5d-5d9d-4db6-b8e4-b10306a1b90b service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:43.110436 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-2dd82ba2-8158-4b4b-9a8b-858e884ecb44 req-79790e5d-5d9d-4db6-b8e4-b10306a1b90b service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:43.112240 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-2dd82ba2-8158-4b4b-9a8b-858e884ecb44 req-79790e5d-5d9d-4db6-b8e4-b10306a1b90b service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:43.145377 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-2dd82ba2-8158-4b4b-9a8b-858e884ecb44 req-79790e5d-5d9d-4db6-b8e4-b10306a1b90b service nova] Creating event network-vif-plugged:3f8b2d23-6735-464b-9f26-f53f462f3e82 for instance 95863fa8-413d-4cc5-bbbf-2b044f1bdc89 on n-h1-851028-13 Oct 04 19:09:43.166608 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-2dd82ba2-8158-4b4b-9a8b-858e884ecb44 req-79790e5d-5d9d-4db6-b8e4-b10306a1b90b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091101 Oct 04 19:09:43.171109 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-8b06e545-f414-40ee-aeb7-928f03e59a16 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:43.172278 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-8b06e545-f414-40ee-aeb7-928f03e59a16 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] [instance: 95863fa8-413d-4cc5-bbbf-2b044f1bdc89] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:43.172406 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3353/6335] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:09:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:09:43.201501 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8b06e545-f414-40ee-aeb7-928f03e59a16 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:43.208849 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8b06e545-f414-40ee-aeb7-928f03e59a16 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:43.209991 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8b06e545-f414-40ee-aeb7-928f03e59a16 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:43.211842 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8b06e545-f414-40ee-aeb7-928f03e59a16 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:43.212785 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8b06e545-f414-40ee-aeb7-928f03e59a16 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:43.213461 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8b06e545-f414-40ee-aeb7-928f03e59a16 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:44.128387 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-8b06e545-f414-40ee-aeb7-928f03e59a16 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:09:44.138125 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-8b06e545-f414-40ee-aeb7-928f03e59a16 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:09:44.157242 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-8b06e545-f414-40ee-aeb7-928f03e59a16 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:09:44.159881 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-8b06e545-f414-40ee-aeb7-928f03e59a16 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] 10.222.0.43 "GET /compute/v2.1/servers/95863fa8-413d-4cc5-bbbf-2b044f1bdc89" status: 200 len: 1736 microversion: 2.20 time: 0.993103 Oct 04 19:09:44.166999 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2983/6336] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:09:43 2022] GET /compute/v2.1/servers/95863fa8-413d-4cc5-bbbf-2b044f1bdc89 => generated 1736 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:09:45.197020 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-78e773cb-be30-4636-b363-785fc2e20061 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:45.198020 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-78e773cb-be30-4636-b363-785fc2e20061 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] [instance: 95863fa8-413d-4cc5-bbbf-2b044f1bdc89] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:45.211351 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-78e773cb-be30-4636-b363-785fc2e20061 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:45.222152 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-78e773cb-be30-4636-b363-785fc2e20061 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:45.222901 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-78e773cb-be30-4636-b363-785fc2e20061 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:45.227713 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-78e773cb-be30-4636-b363-785fc2e20061 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:45.230835 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-78e773cb-be30-4636-b363-785fc2e20061 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:45.231544 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-78e773cb-be30-4636-b363-785fc2e20061 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:45.943814 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-78e773cb-be30-4636-b363-785fc2e20061 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:09:45.955662 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-78e773cb-be30-4636-b363-785fc2e20061 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:09:45.969746 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-78e773cb-be30-4636-b363-785fc2e20061 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:09:45.973579 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-78e773cb-be30-4636-b363-785fc2e20061 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] 10.222.0.43 "GET /compute/v2.1/servers/95863fa8-413d-4cc5-bbbf-2b044f1bdc89" status: 200 len: 1736 microversion: 2.20 time: 0.781720 Oct 04 19:09:45.976579 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3354/6337] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:09:45 2022] GET /compute/v2.1/servers/95863fa8-413d-4cc5-bbbf-2b044f1bdc89 => generated 1736 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:09:47.001759 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-e9771e6b-53cb-4595-bd2e-753baebb366d tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:47.009054 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-e9771e6b-53cb-4595-bd2e-753baebb366d tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] [instance: 95863fa8-413d-4cc5-bbbf-2b044f1bdc89] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:47.017297 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_api:SELECT=44 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:09:47.022703 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e9771e6b-53cb-4595-bd2e-753baebb366d tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:47.023937 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e9771e6b-53cb-4595-bd2e-753baebb366d tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:47.024753 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e9771e6b-53cb-4595-bd2e-753baebb366d tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:47.026525 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e9771e6b-53cb-4595-bd2e-753baebb366d tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:47.028131 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e9771e6b-53cb-4595-bd2e-753baebb366d tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:47.030345 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e9771e6b-53cb-4595-bd2e-753baebb366d tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:47.679497 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-e9771e6b-53cb-4595-bd2e-753baebb366d tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:09:47.695284 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-e9771e6b-53cb-4595-bd2e-753baebb366d tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:09:47.697503 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-e9771e6b-53cb-4595-bd2e-753baebb366d tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:09:47.700538 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-e9771e6b-53cb-4595-bd2e-753baebb366d tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] 10.222.0.43 "GET /compute/v2.1/servers/95863fa8-413d-4cc5-bbbf-2b044f1bdc89" status: 200 len: 1736 microversion: 2.20 time: 0.705060 Oct 04 19:09:47.720928 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2984/6338] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:09:46 2022] GET /compute/v2.1/servers/95863fa8-413d-4cc5-bbbf-2b044f1bdc89 => generated 1736 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:09:48.731775 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-8c827bb3-5319-4903-af59-45e1f12ee730 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:48.732369 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-8c827bb3-5319-4903-af59-45e1f12ee730 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] [instance: 95863fa8-413d-4cc5-bbbf-2b044f1bdc89] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:48.777553 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8c827bb3-5319-4903-af59-45e1f12ee730 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:48.778073 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8c827bb3-5319-4903-af59-45e1f12ee730 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:48.778655 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8c827bb3-5319-4903-af59-45e1f12ee730 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:48.780035 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8c827bb3-5319-4903-af59-45e1f12ee730 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:48.781754 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8c827bb3-5319-4903-af59-45e1f12ee730 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:48.783382 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8c827bb3-5319-4903-af59-45e1f12ee730 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:49.102044 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-8c827bb3-5319-4903-af59-45e1f12ee730 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:09:49.123853 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-8c827bb3-5319-4903-af59-45e1f12ee730 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:09:49.129670 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-8c827bb3-5319-4903-af59-45e1f12ee730 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:09:49.131663 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-8c827bb3-5319-4903-af59-45e1f12ee730 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] 10.222.0.43 "GET /compute/v2.1/servers/95863fa8-413d-4cc5-bbbf-2b044f1bdc89" status: 200 len: 1736 microversion: 2.20 time: 0.404178 Oct 04 19:09:49.133879 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3355/6339] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:09:48 2022] GET /compute/v2.1/servers/95863fa8-413d-4cc5-bbbf-2b044f1bdc89 => generated 1736 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:09:49.953229 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-beaa2276-4975-42dc-8e1c-b149df8783f4 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] Calling method '.version_select at 0x7fb21eb20670>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:50.002111 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-beaa2276-4975-42dc-8e1c-b149df8783f4 tempest-TestNetworkAdvancedServerOps-1789911209 tempest-TestNetworkAdvancedServerOps-1789911209-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1345898799" status: 202 len: 0 microversion: 2.1 time: 0.053609 Oct 04 19:09:50.007988 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2985/6340] 10.222.0.43 () {58 vars in 1284 bytes} [Tue Oct 4 19:09:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1345898799 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:09:50.164513 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-9c2033bb-4737-4ea5-af30-8dff604359fa tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:50.165238 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-9c2033bb-4737-4ea5-af30-8dff604359fa tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] [instance: 95863fa8-413d-4cc5-bbbf-2b044f1bdc89] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:50.206256 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9c2033bb-4737-4ea5-af30-8dff604359fa tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:50.208284 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9c2033bb-4737-4ea5-af30-8dff604359fa tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:50.209629 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9c2033bb-4737-4ea5-af30-8dff604359fa tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:50.211070 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9c2033bb-4737-4ea5-af30-8dff604359fa tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:50.211418 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9c2033bb-4737-4ea5-af30-8dff604359fa tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:50.215901 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9c2033bb-4737-4ea5-af30-8dff604359fa tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:50.703199 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-9c2033bb-4737-4ea5-af30-8dff604359fa tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:09:50.712929 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-9c2033bb-4737-4ea5-af30-8dff604359fa tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:09:50.721254 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-9c2033bb-4737-4ea5-af30-8dff604359fa tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:09:50.722765 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-9c2033bb-4737-4ea5-af30-8dff604359fa tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] 10.222.0.43 "GET /compute/v2.1/servers/95863fa8-413d-4cc5-bbbf-2b044f1bdc89" status: 200 len: 1736 microversion: 2.20 time: 0.563524 Oct 04 19:09:50.728611 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3356/6341] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:09:50 2022] GET /compute/v2.1/servers/95863fa8-413d-4cc5-bbbf-2b044f1bdc89 => generated 1736 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:09:51.797784 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-9864c6be-45a9-4a25-9fe5-66764f4dd116 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:51.797784 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-9864c6be-45a9-4a25-9fe5-66764f4dd116 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] [instance: 95863fa8-413d-4cc5-bbbf-2b044f1bdc89] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:51.797784 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9864c6be-45a9-4a25-9fe5-66764f4dd116 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:51.800683 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9864c6be-45a9-4a25-9fe5-66764f4dd116 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:51.800999 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9864c6be-45a9-4a25-9fe5-66764f4dd116 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:51.804808 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9864c6be-45a9-4a25-9fe5-66764f4dd116 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:51.807491 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9864c6be-45a9-4a25-9fe5-66764f4dd116 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:51.807970 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9864c6be-45a9-4a25-9fe5-66764f4dd116 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:52.160951 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-9864c6be-45a9-4a25-9fe5-66764f4dd116 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:09:52.175246 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-9864c6be-45a9-4a25-9fe5-66764f4dd116 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:09:52.180846 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-9864c6be-45a9-4a25-9fe5-66764f4dd116 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:09:52.182041 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-9864c6be-45a9-4a25-9fe5-66764f4dd116 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] 10.222.0.43 "GET /compute/v2.1/servers/95863fa8-413d-4cc5-bbbf-2b044f1bdc89" status: 200 len: 1736 microversion: 2.20 time: 0.432297 Oct 04 19:09:52.195224 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2986/6342] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:09:51 2022] GET /compute/v2.1/servers/95863fa8-413d-4cc5-bbbf-2b044f1bdc89 => generated 1736 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:09:53.228827 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-0ea23ee7-cb6e-4fb3-9572-20117fd43ee2 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:53.229694 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-0ea23ee7-cb6e-4fb3-9572-20117fd43ee2 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] [instance: 95863fa8-413d-4cc5-bbbf-2b044f1bdc89] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:53.244672 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0ea23ee7-cb6e-4fb3-9572-20117fd43ee2 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:53.249393 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0ea23ee7-cb6e-4fb3-9572-20117fd43ee2 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:53.251742 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0ea23ee7-cb6e-4fb3-9572-20117fd43ee2 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:53.252764 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0ea23ee7-cb6e-4fb3-9572-20117fd43ee2 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:53.258309 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0ea23ee7-cb6e-4fb3-9572-20117fd43ee2 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:53.259655 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0ea23ee7-cb6e-4fb3-9572-20117fd43ee2 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:53.986152 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-0ea23ee7-cb6e-4fb3-9572-20117fd43ee2 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:09:53.999337 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-0ea23ee7-cb6e-4fb3-9572-20117fd43ee2 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:09:54.017840 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-0ea23ee7-cb6e-4fb3-9572-20117fd43ee2 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:09:54.023689 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-0ea23ee7-cb6e-4fb3-9572-20117fd43ee2 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] 10.222.0.43 "GET /compute/v2.1/servers/95863fa8-413d-4cc5-bbbf-2b044f1bdc89" status: 200 len: 1736 microversion: 2.20 time: 0.812247 Oct 04 19:09:54.027894 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3357/6343] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:09:53 2022] GET /compute/v2.1/servers/95863fa8-413d-4cc5-bbbf-2b044f1bdc89 => generated 1736 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:09:55.064715 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-5c954328-b572-41cc-bb50-e29b5e499514 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:55.065697 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-5c954328-b572-41cc-bb50-e29b5e499514 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] [instance: 95863fa8-413d-4cc5-bbbf-2b044f1bdc89] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:55.084350 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5c954328-b572-41cc-bb50-e29b5e499514 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:55.084846 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5c954328-b572-41cc-bb50-e29b5e499514 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:55.085355 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5c954328-b572-41cc-bb50-e29b5e499514 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:55.098780 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5c954328-b572-41cc-bb50-e29b5e499514 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:55.099278 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5c954328-b572-41cc-bb50-e29b5e499514 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:55.099730 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5c954328-b572-41cc-bb50-e29b5e499514 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:55.315862 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-5c954328-b572-41cc-bb50-e29b5e499514 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:09:55.327155 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-5c954328-b572-41cc-bb50-e29b5e499514 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:09:55.328787 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-5c954328-b572-41cc-bb50-e29b5e499514 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:09:55.330265 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-5c954328-b572-41cc-bb50-e29b5e499514 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] 10.222.0.43 "GET /compute/v2.1/servers/95863fa8-413d-4cc5-bbbf-2b044f1bdc89" status: 200 len: 1736 microversion: 2.20 time: 0.280207 Oct 04 19:09:55.331590 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2987/6344] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:09:55 2022] GET /compute/v2.1/servers/95863fa8-413d-4cc5-bbbf-2b044f1bdc89 => generated 1736 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:09:56.364044 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-61087e39-533b-48f4-bf8b-f41ecfa3d428 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:56.364044 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-61087e39-533b-48f4-bf8b-f41ecfa3d428 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] [instance: 95863fa8-413d-4cc5-bbbf-2b044f1bdc89] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:56.376853 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-61087e39-533b-48f4-bf8b-f41ecfa3d428 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:56.385599 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-61087e39-533b-48f4-bf8b-f41ecfa3d428 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:56.390189 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-61087e39-533b-48f4-bf8b-f41ecfa3d428 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:56.395879 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-61087e39-533b-48f4-bf8b-f41ecfa3d428 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:56.402852 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-61087e39-533b-48f4-bf8b-f41ecfa3d428 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:56.403318 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-61087e39-533b-48f4-bf8b-f41ecfa3d428 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:57.213390 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-61087e39-533b-48f4-bf8b-f41ecfa3d428 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:09:57.244985 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-61087e39-533b-48f4-bf8b-f41ecfa3d428 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:09:57.250680 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-61087e39-533b-48f4-bf8b-f41ecfa3d428 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:09:57.259102 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-61087e39-533b-48f4-bf8b-f41ecfa3d428 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] 10.222.0.43 "GET /compute/v2.1/servers/95863fa8-413d-4cc5-bbbf-2b044f1bdc89" status: 200 len: 1736 microversion: 2.20 time: 0.901227 Oct 04 19:09:57.263816 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3358/6345] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:09:56 2022] GET /compute/v2.1/servers/95863fa8-413d-4cc5-bbbf-2b044f1bdc89 => generated 1736 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:09:58.306400 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-8a1b11a9-80a4-4951-b59e-d51638293c3d tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:58.306995 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-8a1b11a9-80a4-4951-b59e-d51638293c3d tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] [instance: 95863fa8-413d-4cc5-bbbf-2b044f1bdc89] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:58.317759 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8a1b11a9-80a4-4951-b59e-d51638293c3d tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:58.318270 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8a1b11a9-80a4-4951-b59e-d51638293c3d tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:58.318726 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8a1b11a9-80a4-4951-b59e-d51638293c3d tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:58.319455 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8a1b11a9-80a4-4951-b59e-d51638293c3d tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:58.320457 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8a1b11a9-80a4-4951-b59e-d51638293c3d tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:58.320901 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8a1b11a9-80a4-4951-b59e-d51638293c3d tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:58.943194 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-8a1b11a9-80a4-4951-b59e-d51638293c3d tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:09:58.957258 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-8a1b11a9-80a4-4951-b59e-d51638293c3d tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:09:58.957480 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-8a1b11a9-80a4-4951-b59e-d51638293c3d tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:09:58.979586 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-8a1b11a9-80a4-4951-b59e-d51638293c3d tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] 10.222.0.43 "GET /compute/v2.1/servers/95863fa8-413d-4cc5-bbbf-2b044f1bdc89" status: 200 len: 1736 microversion: 2.20 time: 0.665424 Oct 04 19:09:58.981013 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2988/6346] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:09:58 2022] GET /compute/v2.1/servers/95863fa8-413d-4cc5-bbbf-2b044f1bdc89 => generated 1736 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:10:00.031136 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-914c7f13-86b1-4dc6-9a7c-fa2b79aaf55a tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:10:00.036621 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-914c7f13-86b1-4dc6-9a7c-fa2b79aaf55a tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] [instance: 95863fa8-413d-4cc5-bbbf-2b044f1bdc89] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:00.094007 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:10:00.105054 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-914c7f13-86b1-4dc6-9a7c-fa2b79aaf55a tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:00.108359 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-914c7f13-86b1-4dc6-9a7c-fa2b79aaf55a tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:00.110856 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-914c7f13-86b1-4dc6-9a7c-fa2b79aaf55a tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:00.113016 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-914c7f13-86b1-4dc6-9a7c-fa2b79aaf55a tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:00.114893 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-914c7f13-86b1-4dc6-9a7c-fa2b79aaf55a tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:00.117265 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-914c7f13-86b1-4dc6-9a7c-fa2b79aaf55a tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:00.635590 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-914c7f13-86b1-4dc6-9a7c-fa2b79aaf55a tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:00.651505 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-914c7f13-86b1-4dc6-9a7c-fa2b79aaf55a tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:00.653011 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-914c7f13-86b1-4dc6-9a7c-fa2b79aaf55a tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:00.654696 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-914c7f13-86b1-4dc6-9a7c-fa2b79aaf55a tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] 10.222.0.43 "GET /compute/v2.1/servers/95863fa8-413d-4cc5-bbbf-2b044f1bdc89" status: 200 len: 1736 microversion: 2.20 time: 0.646999 Oct 04 19:10:00.657079 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3359/6347] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:10:00 2022] GET /compute/v2.1/servers/95863fa8-413d-4cc5-bbbf-2b044f1bdc89 => generated 1736 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:10:01.682846 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-d4eebee0-1973-4347-8fbd-f35925d7da9c tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:10:01.683475 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-d4eebee0-1973-4347-8fbd-f35925d7da9c tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] [instance: 95863fa8-413d-4cc5-bbbf-2b044f1bdc89] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:01.704701 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d4eebee0-1973-4347-8fbd-f35925d7da9c tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:01.705239 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d4eebee0-1973-4347-8fbd-f35925d7da9c tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:01.705755 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d4eebee0-1973-4347-8fbd-f35925d7da9c tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:01.706487 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d4eebee0-1973-4347-8fbd-f35925d7da9c tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:01.714377 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d4eebee0-1973-4347-8fbd-f35925d7da9c tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:01.729169 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d4eebee0-1973-4347-8fbd-f35925d7da9c tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:02.192566 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-d4eebee0-1973-4347-8fbd-f35925d7da9c tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:02.209443 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-d4eebee0-1973-4347-8fbd-f35925d7da9c tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:02.212583 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-d4eebee0-1973-4347-8fbd-f35925d7da9c tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:02.219036 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-d4eebee0-1973-4347-8fbd-f35925d7da9c tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] 10.222.0.43 "GET /compute/v2.1/servers/95863fa8-413d-4cc5-bbbf-2b044f1bdc89" status: 200 len: 1718 microversion: 2.20 time: 0.539864 Oct 04 19:10:02.222606 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2989/6348] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:10:01 2022] GET /compute/v2.1/servers/95863fa8-413d-4cc5-bbbf-2b044f1bdc89 => generated 1718 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:10:03.251645 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-6e32b6b4-0d4d-41f7-80c4-107d555b2db3 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:10:03.251645 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-6e32b6b4-0d4d-41f7-80c4-107d555b2db3 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] [instance: 95863fa8-413d-4cc5-bbbf-2b044f1bdc89] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:03.273394 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6e32b6b4-0d4d-41f7-80c4-107d555b2db3 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:03.275032 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6e32b6b4-0d4d-41f7-80c4-107d555b2db3 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:03.275814 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6e32b6b4-0d4d-41f7-80c4-107d555b2db3 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:03.277156 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6e32b6b4-0d4d-41f7-80c4-107d555b2db3 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:03.287936 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6e32b6b4-0d4d-41f7-80c4-107d555b2db3 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:03.289427 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6e32b6b4-0d4d-41f7-80c4-107d555b2db3 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:03.300343 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:10:03.623994 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-6e32b6b4-0d4d-41f7-80c4-107d555b2db3 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:03.633406 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-6e32b6b4-0d4d-41f7-80c4-107d555b2db3 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:03.635206 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-6e32b6b4-0d4d-41f7-80c4-107d555b2db3 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:03.636920 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-6e32b6b4-0d4d-41f7-80c4-107d555b2db3 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] 10.222.0.43 "GET /compute/v2.1/servers/95863fa8-413d-4cc5-bbbf-2b044f1bdc89" status: 200 len: 1718 microversion: 2.20 time: 0.390970 Oct 04 19:10:03.638306 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3360/6349] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:10:03 2022] GET /compute/v2.1/servers/95863fa8-413d-4cc5-bbbf-2b044f1bdc89 => generated 1718 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:10:04.667066 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-d17ac9d3-55ea-4860-bde6-e4feca0bef55 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:10:04.668442 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-d17ac9d3-55ea-4860-bde6-e4feca0bef55 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] [instance: 95863fa8-413d-4cc5-bbbf-2b044f1bdc89] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:04.685209 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d17ac9d3-55ea-4860-bde6-e4feca0bef55 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:04.688278 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d17ac9d3-55ea-4860-bde6-e4feca0bef55 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:04.689012 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d17ac9d3-55ea-4860-bde6-e4feca0bef55 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:04.690323 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d17ac9d3-55ea-4860-bde6-e4feca0bef55 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:04.690999 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d17ac9d3-55ea-4860-bde6-e4feca0bef55 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:04.691929 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d17ac9d3-55ea-4860-bde6-e4feca0bef55 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:04.995824 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-d17ac9d3-55ea-4860-bde6-e4feca0bef55 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:05.010629 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-d17ac9d3-55ea-4860-bde6-e4feca0bef55 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:05.016983 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-d17ac9d3-55ea-4860-bde6-e4feca0bef55 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:05.020529 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-d17ac9d3-55ea-4860-bde6-e4feca0bef55 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] 10.222.0.43 "GET /compute/v2.1/servers/95863fa8-413d-4cc5-bbbf-2b044f1bdc89" status: 200 len: 1661 microversion: 2.20 time: 0.358458 Oct 04 19:10:05.041325 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2990/6350] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:10:04 2022] GET /compute/v2.1/servers/95863fa8-413d-4cc5-bbbf-2b044f1bdc89 => generated 1661 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:10:05.049495 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-cab0b768-f8d3-46ea-83ad-b2399c64fff9 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "afcfc298-47af-4e3c-b1ce-44fabbee0c4a"}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:10:05.053078 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-cab0b768-f8d3-46ea-83ad-b2399c64fff9 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] [instance: 95863fa8-413d-4cc5-bbbf-2b044f1bdc89] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:05.063973 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cab0b768-f8d3-46ea-83ad-b2399c64fff9 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:05.065167 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cab0b768-f8d3-46ea-83ad-b2399c64fff9 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:05.065852 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cab0b768-f8d3-46ea-83ad-b2399c64fff9 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:05.067076 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cab0b768-f8d3-46ea-83ad-b2399c64fff9 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:05.067856 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cab0b768-f8d3-46ea-83ad-b2399c64fff9 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:05.069274 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cab0b768-f8d3-46ea-83ad-b2399c64fff9 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:05.377769 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-a974525e-ebbf-441e-95ab-464047126e0b req-334ad706-b4b5-4d4d-8e35-7e8027df372f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95863fa8-413d-4cc5-bbbf-2b044f1bdc89", "name": "network-vif-unplugged", "status": "completed", "tag": "3f8b2d23-6735-464b-9f26-f53f462f3e82"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:10:05.416144 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-a974525e-ebbf-441e-95ab-464047126e0b req-334ad706-b4b5-4d4d-8e35-7e8027df372f service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:05.418628 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-a974525e-ebbf-441e-95ab-464047126e0b req-334ad706-b4b5-4d4d-8e35-7e8027df372f service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:05.418628 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-a974525e-ebbf-441e-95ab-464047126e0b req-334ad706-b4b5-4d4d-8e35-7e8027df372f service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:05.455369 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.compute.server_external_events [req-a974525e-ebbf-441e-95ab-464047126e0b req-334ad706-b4b5-4d4d-8e35-7e8027df372f service nova] Unable to find a host for instance 95863fa8-413d-4cc5-bbbf-2b044f1bdc89. Dropping event network-vif-unplugged {{(pid=123595) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 04 19:10:05.457062 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-a974525e-ebbf-441e-95ab-464047126e0b req-334ad706-b4b5-4d4d-8e35-7e8027df372f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.091669 Oct 04 19:10:05.458196 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2991/6351] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:10:05 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 93 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 04 19:10:05.742255 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-cab0b768-f8d3-46ea-83ad-b2399c64fff9 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] 10.222.0.43 "POST /compute/v2.1/servers/95863fa8-413d-4cc5-bbbf-2b044f1bdc89/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.694750 Oct 04 19:10:05.746161 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3361/6352] 10.222.0.43 () {62 vars in 1364 bytes} [Tue Oct 4 19:10:05 2022] POST /compute/v2.1/servers/95863fa8-413d-4cc5-bbbf-2b044f1bdc89/os-volume_attachments => generated 188 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 19:10:05.990049 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-fb6fbc8a-53c2-4749-8502-b59d20bdf17b tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:10:05.990599 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-fb6fbc8a-53c2-4749-8502-b59d20bdf17b tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] [instance: 95863fa8-413d-4cc5-bbbf-2b044f1bdc89] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:06.005513 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fb6fbc8a-53c2-4749-8502-b59d20bdf17b tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:06.006281 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fb6fbc8a-53c2-4749-8502-b59d20bdf17b tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:06.008431 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fb6fbc8a-53c2-4749-8502-b59d20bdf17b tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:06.012504 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fb6fbc8a-53c2-4749-8502-b59d20bdf17b tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:06.013444 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fb6fbc8a-53c2-4749-8502-b59d20bdf17b tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:06.014108 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fb6fbc8a-53c2-4749-8502-b59d20bdf17b tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:06.678897 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-fb6fbc8a-53c2-4749-8502-b59d20bdf17b tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] 10.222.0.43 "DELETE /compute/v2.1/servers/95863fa8-413d-4cc5-bbbf-2b044f1bdc89/os-volume_attachments/afcfc298-47af-4e3c-b1ce-44fabbee0c4a" status: 202 len: 0 microversion: 2.20 time: 0.692606 Oct 04 19:10:06.688535 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2992/6353] 10.222.0.43 () {60 vars in 1457 bytes} [Tue Oct 4 19:10:05 2022] DELETE /compute/v2.1/servers/95863fa8-413d-4cc5-bbbf-2b044f1bdc89/os-volume_attachments/afcfc298-47af-4e3c-b1ce-44fabbee0c4a => generated 0 bytes in 703 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 04 19:10:06.784506 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-28b490d3-2144-4f0d-85f8-f5fac3116861 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:10:06.785451 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-28b490d3-2144-4f0d-85f8-f5fac3116861 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] [instance: 95863fa8-413d-4cc5-bbbf-2b044f1bdc89] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:06.800851 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-28b490d3-2144-4f0d-85f8-f5fac3116861 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:06.801659 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-28b490d3-2144-4f0d-85f8-f5fac3116861 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:06.803113 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-28b490d3-2144-4f0d-85f8-f5fac3116861 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:06.805611 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-28b490d3-2144-4f0d-85f8-f5fac3116861 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:06.806263 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-28b490d3-2144-4f0d-85f8-f5fac3116861 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:06.809513 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-28b490d3-2144-4f0d-85f8-f5fac3116861 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:06.958977 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-28b490d3-2144-4f0d-85f8-f5fac3116861 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] [instance: 95863fa8-413d-4cc5-bbbf-2b044f1bdc89] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=123596) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 04 19:10:07.256270 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-28b490d3-2144-4f0d-85f8-f5fac3116861 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] 10.222.0.43 "POST /compute/v2.1/servers/95863fa8-413d-4cc5-bbbf-2b044f1bdc89/action" status: 202 len: 0 microversion: 2.20 time: 0.477714 Oct 04 19:10:07.263281 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3362/6354] 10.222.0.43 () {62 vars in 1319 bytes} [Tue Oct 4 19:10:06 2022] POST /compute/v2.1/servers/95863fa8-413d-4cc5-bbbf-2b044f1bdc89/action => generated 0 bytes in 487 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:10:07.270956 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-cd9c8563-e49d-43b8-b99c-f2df2d0f5a1a tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:10:07.272309 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-cd9c8563-e49d-43b8-b99c-f2df2d0f5a1a tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] [instance: 95863fa8-413d-4cc5-bbbf-2b044f1bdc89] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:07.291288 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cd9c8563-e49d-43b8-b99c-f2df2d0f5a1a tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:07.315620 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cd9c8563-e49d-43b8-b99c-f2df2d0f5a1a tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:07.317529 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cd9c8563-e49d-43b8-b99c-f2df2d0f5a1a tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:07.318881 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cd9c8563-e49d-43b8-b99c-f2df2d0f5a1a tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:07.324137 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cd9c8563-e49d-43b8-b99c-f2df2d0f5a1a tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:07.324946 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cd9c8563-e49d-43b8-b99c-f2df2d0f5a1a tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:07.799808 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-cd9c8563-e49d-43b8-b99c-f2df2d0f5a1a tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:07.816319 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-cd9c8563-e49d-43b8-b99c-f2df2d0f5a1a tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:07.818233 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-cd9c8563-e49d-43b8-b99c-f2df2d0f5a1a tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:07.825480 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-cd9c8563-e49d-43b8-b99c-f2df2d0f5a1a tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] 10.222.0.43 "GET /compute/v2.1/servers/95863fa8-413d-4cc5-bbbf-2b044f1bdc89" status: 200 len: 1669 microversion: 2.20 time: 0.559028 Oct 04 19:10:07.828906 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2993/6355] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:10:07 2022] GET /compute/v2.1/servers/95863fa8-413d-4cc5-bbbf-2b044f1bdc89 => generated 1669 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:10:08.859068 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-5adc145e-edea-444e-8756-a05a11b7eab7 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:10:08.864001 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-5adc145e-edea-444e-8756-a05a11b7eab7 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] [instance: 95863fa8-413d-4cc5-bbbf-2b044f1bdc89] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:08.879046 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5adc145e-edea-444e-8756-a05a11b7eab7 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:08.879477 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5adc145e-edea-444e-8756-a05a11b7eab7 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:08.901505 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5adc145e-edea-444e-8756-a05a11b7eab7 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:08.902524 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5adc145e-edea-444e-8756-a05a11b7eab7 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:08.903072 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5adc145e-edea-444e-8756-a05a11b7eab7 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:08.903534 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5adc145e-edea-444e-8756-a05a11b7eab7 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:09.220178 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-5adc145e-edea-444e-8756-a05a11b7eab7 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:09.235347 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-5adc145e-edea-444e-8756-a05a11b7eab7 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:09.259010 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-5adc145e-edea-444e-8756-a05a11b7eab7 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:09.260304 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-5adc145e-edea-444e-8756-a05a11b7eab7 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] 10.222.0.43 "GET /compute/v2.1/servers/95863fa8-413d-4cc5-bbbf-2b044f1bdc89" status: 200 len: 1669 microversion: 2.20 time: 0.405331 Oct 04 19:10:09.272315 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3363/6356] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:10:08 2022] GET /compute/v2.1/servers/95863fa8-413d-4cc5-bbbf-2b044f1bdc89 => generated 1669 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:10:10.332675 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-1585aaee-bf13-4afe-9d32-08848422f839 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:10:10.343617 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-1585aaee-bf13-4afe-9d32-08848422f839 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] [instance: 95863fa8-413d-4cc5-bbbf-2b044f1bdc89] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:10.381852 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1585aaee-bf13-4afe-9d32-08848422f839 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:10.385673 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1585aaee-bf13-4afe-9d32-08848422f839 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:10.386371 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1585aaee-bf13-4afe-9d32-08848422f839 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:10.390214 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1585aaee-bf13-4afe-9d32-08848422f839 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:10.390872 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1585aaee-bf13-4afe-9d32-08848422f839 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:10.391770 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1585aaee-bf13-4afe-9d32-08848422f839 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:10.404755 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=83,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:10:10.712454 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-1585aaee-bf13-4afe-9d32-08848422f839 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:10.729332 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-1585aaee-bf13-4afe-9d32-08848422f839 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:10.738051 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-1585aaee-bf13-4afe-9d32-08848422f839 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:10.744129 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-1585aaee-bf13-4afe-9d32-08848422f839 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] 10.222.0.43 "GET /compute/v2.1/servers/95863fa8-413d-4cc5-bbbf-2b044f1bdc89" status: 200 len: 1727 microversion: 2.20 time: 0.415327 Oct 04 19:10:10.745197 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2994/6357] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:10:10 2022] GET /compute/v2.1/servers/95863fa8-413d-4cc5-bbbf-2b044f1bdc89 => generated 1727 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:10:11.445446 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-5194c33c-efdf-4602-a14e-2e5c05a2e10e tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Action: 'create', calling method: .version_select at 0x7fb21e832b80>, body: {"keypair": {"name": "tempest-TestServerBasicOps-427034637", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB66J3r0P/GYrui1zhvCoWwZMZV9tCDs1YseVUjndcR6QZCrie4znaIAfeZvZjrxZ4MXtOwuf1/xZah5gHxo8lWC2aqz2CULP31C6CWqNsfKsp8EOX+4sYUQgOO3C7W2sQ=="}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:10:11.467633 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-5194c33c-efdf-4602-a14e-2e5c05a2e10e tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Getting quotas for project bee908d0a57d46b29fc0c6c07ecf365a. Resources: {'key_pairs'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:10:11.479320 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-5194c33c-efdf-4602-a14e-2e5c05a2e10e tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Getting quotas for user dd7603a21403497bbdf24e6c2cfc31b2 and project bee908d0a57d46b29fc0c6c07ecf365a. Resources: {'key_pairs'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:10:11.516360 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-5194c33c-efdf-4602-a14e-2e5c05a2e10e tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.274772 Oct 04 19:10:11.517630 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3364/6358] 10.222.0.43 () {60 vars in 1159 bytes} [Tue Oct 4 19:10:11 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:10:11.807432 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-dcdcb56d-469b-4ed0-9d4c-cb4f2c6cdcfd tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:10:11.819343 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-dcdcb56d-469b-4ed0-9d4c-cb4f2c6cdcfd tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] [instance: 95863fa8-413d-4cc5-bbbf-2b044f1bdc89] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:11.912136 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dcdcb56d-469b-4ed0-9d4c-cb4f2c6cdcfd tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:11.914940 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dcdcb56d-469b-4ed0-9d4c-cb4f2c6cdcfd tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:11.917765 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dcdcb56d-469b-4ed0-9d4c-cb4f2c6cdcfd tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:11.920098 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dcdcb56d-469b-4ed0-9d4c-cb4f2c6cdcfd tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:11.923900 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dcdcb56d-469b-4ed0-9d4c-cb4f2c6cdcfd tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:11.925636 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dcdcb56d-469b-4ed0-9d4c-cb4f2c6cdcfd tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:12.433965 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-15c7b53d-24ed-421f-893c-6537966df20b req-836ab45a-6558-4622-8a6c-a82ee466ac21 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95863fa8-413d-4cc5-bbbf-2b044f1bdc89", "tag": "3f8b2d23-6735-464b-9f26-f53f462f3e82"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:10:12.456005 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-15c7b53d-24ed-421f-893c-6537966df20b req-836ab45a-6558-4622-8a6c-a82ee466ac21 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:12.457286 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-15c7b53d-24ed-421f-893c-6537966df20b req-836ab45a-6558-4622-8a6c-a82ee466ac21 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:12.457992 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-15c7b53d-24ed-421f-893c-6537966df20b req-836ab45a-6558-4622-8a6c-a82ee466ac21 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:12.481274 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-15c7b53d-24ed-421f-893c-6537966df20b req-836ab45a-6558-4622-8a6c-a82ee466ac21 service nova] Creating event network-changed:3f8b2d23-6735-464b-9f26-f53f462f3e82 for instance 95863fa8-413d-4cc5-bbbf-2b044f1bdc89 on n-h2-851028-13 Oct 04 19:10:12.508600 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-15c7b53d-24ed-421f-893c-6537966df20b req-836ab45a-6558-4622-8a6c-a82ee466ac21 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080221 Oct 04 19:10:12.511313 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-dcdcb56d-469b-4ed0-9d4c-cb4f2c6cdcfd tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:12.511713 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3365/6359] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:10:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:10:12.520700 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-dcdcb56d-469b-4ed0-9d4c-cb4f2c6cdcfd tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:12.528125 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-dcdcb56d-469b-4ed0-9d4c-cb4f2c6cdcfd tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:12.529392 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-dcdcb56d-469b-4ed0-9d4c-cb4f2c6cdcfd tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] 10.222.0.43 "GET /compute/v2.1/servers/95863fa8-413d-4cc5-bbbf-2b044f1bdc89" status: 200 len: 1727 microversion: 2.20 time: 0.760425 Oct 04 19:10:12.532910 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2995/6360] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:10:11 2022] GET /compute/v2.1/servers/95863fa8-413d-4cc5-bbbf-2b044f1bdc89 => generated 1727 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:10:13.294803 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-a86adf81-e537-43db-b182-db1719f57306 tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-590613991", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-427034637", "security_groups": [{"name": "tempest-secgroup-smoke-1403747719"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "43f39d8e-19be-4207-bdfa-ef0506563660"}]}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:10:13.560733 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-79ef754a-b568-41b3-b712-1b3c28e60d61 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:10:13.561457 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-79ef754a-b568-41b3-b712-1b3c28e60d61 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] [instance: 95863fa8-413d-4cc5-bbbf-2b044f1bdc89] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:13.574214 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.network.neutron [None req-a86adf81-e537-43db-b182-db1719f57306 tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] validate_networks() for [('43f39d8e-19be-4207-bdfa-ef0506563660', None, None, None, None, None)] {{(pid=123596) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 19:10:13.582011 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-79ef754a-b568-41b3-b712-1b3c28e60d61 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:13.582994 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-79ef754a-b568-41b3-b712-1b3c28e60d61 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:13.583587 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-79ef754a-b568-41b3-b712-1b3c28e60d61 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:13.584466 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-79ef754a-b568-41b3-b712-1b3c28e60d61 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:13.596006 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-79ef754a-b568-41b3-b712-1b3c28e60d61 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:13.596824 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-79ef754a-b568-41b3-b712-1b3c28e60d61 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:14.154029 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-79ef754a-b568-41b3-b712-1b3c28e60d61 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:14.166322 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-79ef754a-b568-41b3-b712-1b3c28e60d61 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:14.170397 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-79ef754a-b568-41b3-b712-1b3c28e60d61 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:14.171836 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-79ef754a-b568-41b3-b712-1b3c28e60d61 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] 10.222.0.43 "GET /compute/v2.1/servers/95863fa8-413d-4cc5-bbbf-2b044f1bdc89" status: 200 len: 1727 microversion: 2.20 time: 0.617676 Oct 04 19:10:14.172894 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2996/6361] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:10:13 2022] GET /compute/v2.1/servers/95863fa8-413d-4cc5-bbbf-2b044f1bdc89 => generated 1727 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:10:14.669609 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-a86adf81-e537-43db-b182-db1719f57306 tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Getting quotas for project bee908d0a57d46b29fc0c6c07ecf365a. Resources: dict_keys(['metadata_items']) {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:10:14.690116 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-a86adf81-e537-43db-b182-db1719f57306 tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Getting quotas for user dd7603a21403497bbdf24e6c2cfc31b2 and project bee908d0a57d46b29fc0c6c07ecf365a. Resources: dict_keys(['metadata_items']) {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:10:14.705924 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-a86adf81-e537-43db-b182-db1719f57306 tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Flavor limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:10:14.706631 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-a86adf81-e537-43db-b182-db1719f57306 tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Image limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:10:14.707359 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-a86adf81-e537-43db-b182-db1719f57306 tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Flavor pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:10:14.727417 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-a86adf81-e537-43db-b182-db1719f57306 tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Image pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:10:14.728498 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-a86adf81-e537-43db-b182-db1719f57306 tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:10:14.761019 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a86adf81-e537-43db-b182-db1719f57306 tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:14.765201 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a86adf81-e537-43db-b182-db1719f57306 tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:14.765993 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a86adf81-e537-43db-b182-db1719f57306 tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:14.766945 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a86adf81-e537-43db-b182-db1719f57306 tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:14.769827 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a86adf81-e537-43db-b182-db1719f57306 tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:14.771224 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a86adf81-e537-43db-b182-db1719f57306 tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:14.811996 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-a86adf81-e537-43db-b182-db1719f57306 tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Getting quotas for project bee908d0a57d46b29fc0c6c07ecf365a. Resources: {'ram', 'cores', 'instances'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:10:14.827527 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-a86adf81-e537-43db-b182-db1719f57306 tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Getting quotas for user dd7603a21403497bbdf24e6c2cfc31b2 and project bee908d0a57d46b29fc0c6c07ecf365a. Resources: {'ram', 'cores', 'instances'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:10:14.856132 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-a86adf81-e537-43db-b182-db1719f57306 tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Going to run 1 instances... {{(pid=123596) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 19:10:14.863539 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-a86adf81-e537-43db-b182-db1719f57306 tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] [instance: a5f1279e-dd4c-43fa-9f32-8da8714f1ffd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e8943ec5-4038-4d4b-b9b9-2415a79f5243',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123596) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 19:10:14.979220 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-a86adf81-e537-43db-b182-db1719f57306 tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.690222 Oct 04 19:10:14.979909 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3366/6362] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 19:10:13 2022] POST /compute/v2.1/servers => generated 406 bytes in 1692 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 19:10:14.999197 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-d7d545e7-35aa-4257-a2b7-9f88a8d4987b tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:10:15.002009 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-d7d545e7-35aa-4257-a2b7-9f88a8d4987b tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] [instance: a5f1279e-dd4c-43fa-9f32-8da8714f1ffd] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:15.117759 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-d7d545e7-35aa-4257-a2b7-9f88a8d4987b tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd7603a21403497bbdf24e6c2cfc31b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bee908d0a57d46b29fc0c6c07ecf365a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:15.155874 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-d7d545e7-35aa-4257-a2b7-9f88a8d4987b tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] 10.222.0.43 "GET /compute/v2.1/servers/a5f1279e-dd4c-43fa-9f32-8da8714f1ffd" status: 200 len: 1301 microversion: 2.1 time: 0.150149 Oct 04 19:10:15.159138 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2997/6363] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:10:14 2022] GET /compute/v2.1/servers/a5f1279e-dd4c-43fa-9f32-8da8714f1ffd => generated 1301 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:10:15.204225 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-923cab5d-55d0-4abc-b162-9298721235e3 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:10:15.205415 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-923cab5d-55d0-4abc-b162-9298721235e3 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] [instance: 95863fa8-413d-4cc5-bbbf-2b044f1bdc89] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:15.217164 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-923cab5d-55d0-4abc-b162-9298721235e3 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:15.218041 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-923cab5d-55d0-4abc-b162-9298721235e3 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:15.225968 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-923cab5d-55d0-4abc-b162-9298721235e3 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:15.227319 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-923cab5d-55d0-4abc-b162-9298721235e3 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:15.227804 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-923cab5d-55d0-4abc-b162-9298721235e3 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:15.228336 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-923cab5d-55d0-4abc-b162-9298721235e3 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:15.615827 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-923cab5d-55d0-4abc-b162-9298721235e3 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:15.645565 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-923cab5d-55d0-4abc-b162-9298721235e3 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:15.645565 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-923cab5d-55d0-4abc-b162-9298721235e3 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:15.646415 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-923cab5d-55d0-4abc-b162-9298721235e3 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] 10.222.0.43 "GET /compute/v2.1/servers/95863fa8-413d-4cc5-bbbf-2b044f1bdc89" status: 200 len: 1727 microversion: 2.20 time: 0.446563 Oct 04 19:10:15.656563 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3367/6364] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:10:15 2022] GET /compute/v2.1/servers/95863fa8-413d-4cc5-bbbf-2b044f1bdc89 => generated 1727 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:10:16.182959 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-a43a8b15-6d34-4abf-acb9-3647eee62273 tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:10:16.184660 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-a43a8b15-6d34-4abf-acb9-3647eee62273 tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] [instance: a5f1279e-dd4c-43fa-9f32-8da8714f1ffd] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:16.207836 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a43a8b15-6d34-4abf-acb9-3647eee62273 tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:16.208641 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a43a8b15-6d34-4abf-acb9-3647eee62273 tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:16.209324 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a43a8b15-6d34-4abf-acb9-3647eee62273 tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:16.210210 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a43a8b15-6d34-4abf-acb9-3647eee62273 tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:16.211015 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a43a8b15-6d34-4abf-acb9-3647eee62273 tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:16.211682 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a43a8b15-6d34-4abf-acb9-3647eee62273 tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:16.361085 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-a43a8b15-6d34-4abf-acb9-3647eee62273 tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd7603a21403497bbdf24e6c2cfc31b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bee908d0a57d46b29fc0c6c07ecf365a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:16.372773 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-a43a8b15-6d34-4abf-acb9-3647eee62273 tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] 10.222.0.43 "GET /compute/v2.1/servers/a5f1279e-dd4c-43fa-9f32-8da8714f1ffd" status: 200 len: 1305 microversion: 2.1 time: 0.195440 Oct 04 19:10:16.380011 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2998/6365] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:10:16 2022] GET /compute/v2.1/servers/a5f1279e-dd4c-43fa-9f32-8da8714f1ffd => generated 1305 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:10:16.682000 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-d4c16707-eda4-409e-b2d5-23c61a92e962 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:10:16.683346 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-d4c16707-eda4-409e-b2d5-23c61a92e962 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] [instance: 95863fa8-413d-4cc5-bbbf-2b044f1bdc89] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:16.700421 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d4c16707-eda4-409e-b2d5-23c61a92e962 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:16.701260 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d4c16707-eda4-409e-b2d5-23c61a92e962 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:16.702344 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d4c16707-eda4-409e-b2d5-23c61a92e962 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:16.706157 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d4c16707-eda4-409e-b2d5-23c61a92e962 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:16.706889 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d4c16707-eda4-409e-b2d5-23c61a92e962 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:16.707973 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d4c16707-eda4-409e-b2d5-23c61a92e962 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:17.138222 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-d4c16707-eda4-409e-b2d5-23c61a92e962 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:17.159330 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-d4c16707-eda4-409e-b2d5-23c61a92e962 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:17.167312 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-d4c16707-eda4-409e-b2d5-23c61a92e962 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:17.169172 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-d4c16707-eda4-409e-b2d5-23c61a92e962 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] 10.222.0.43 "GET /compute/v2.1/servers/95863fa8-413d-4cc5-bbbf-2b044f1bdc89" status: 200 len: 1727 microversion: 2.20 time: 0.492507 Oct 04 19:10:17.171157 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3368/6366] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:10:16 2022] GET /compute/v2.1/servers/95863fa8-413d-4cc5-bbbf-2b044f1bdc89 => generated 1727 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:10:17.396633 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-b66f6945-3a8f-4869-b51c-82b453c7a1d2 tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:10:17.397424 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-b66f6945-3a8f-4869-b51c-82b453c7a1d2 tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] [instance: a5f1279e-dd4c-43fa-9f32-8da8714f1ffd] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:17.402265 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_api:SELECT=33,nova_api:DELETE=1 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:10:17.431566 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b66f6945-3a8f-4869-b51c-82b453c7a1d2 tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:17.432125 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b66f6945-3a8f-4869-b51c-82b453c7a1d2 tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:17.432638 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b66f6945-3a8f-4869-b51c-82b453c7a1d2 tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:17.442685 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b66f6945-3a8f-4869-b51c-82b453c7a1d2 tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:17.443813 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b66f6945-3a8f-4869-b51c-82b453c7a1d2 tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:17.444552 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b66f6945-3a8f-4869-b51c-82b453c7a1d2 tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:17.664321 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-b66f6945-3a8f-4869-b51c-82b453c7a1d2 tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd7603a21403497bbdf24e6c2cfc31b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bee908d0a57d46b29fc0c6c07ecf365a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:17.672822 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-b66f6945-3a8f-4869-b51c-82b453c7a1d2 tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] 10.222.0.43 "GET /compute/v2.1/servers/a5f1279e-dd4c-43fa-9f32-8da8714f1ffd" status: 200 len: 1359 microversion: 2.1 time: 0.280427 Oct 04 19:10:17.674831 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 2999/6367] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:10:17 2022] GET /compute/v2.1/servers/a5f1279e-dd4c-43fa-9f32-8da8714f1ffd => generated 1359 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:10:18.203399 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-33053fdd-1e3b-427b-8913-33eb14d36ba3 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:10:18.204157 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-33053fdd-1e3b-427b-8913-33eb14d36ba3 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] [instance: 95863fa8-413d-4cc5-bbbf-2b044f1bdc89] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:18.230665 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-33053fdd-1e3b-427b-8913-33eb14d36ba3 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:18.231437 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-33053fdd-1e3b-427b-8913-33eb14d36ba3 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:18.232585 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-33053fdd-1e3b-427b-8913-33eb14d36ba3 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:18.233543 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-33053fdd-1e3b-427b-8913-33eb14d36ba3 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:18.234061 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-33053fdd-1e3b-427b-8913-33eb14d36ba3 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:18.234549 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-33053fdd-1e3b-427b-8913-33eb14d36ba3 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:18.690761 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-33053fdd-1e3b-427b-8913-33eb14d36ba3 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:18.701702 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-33053fdd-1e3b-427b-8913-33eb14d36ba3 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:18.708448 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-33053fdd-1e3b-427b-8913-33eb14d36ba3 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:18.708985 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-4f846548-11f5-4283-95d2-c1b870cf0c11 tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:10:18.709637 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-4f846548-11f5-4283-95d2-c1b870cf0c11 tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] [instance: a5f1279e-dd4c-43fa-9f32-8da8714f1ffd] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:18.713716 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-33053fdd-1e3b-427b-8913-33eb14d36ba3 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] 10.222.0.43 "GET /compute/v2.1/servers/95863fa8-413d-4cc5-bbbf-2b044f1bdc89" status: 200 len: 1727 microversion: 2.20 time: 0.515360 Oct 04 19:10:18.722688 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4f846548-11f5-4283-95d2-c1b870cf0c11 tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:18.725718 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4f846548-11f5-4283-95d2-c1b870cf0c11 tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:18.726203 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4f846548-11f5-4283-95d2-c1b870cf0c11 tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:18.726977 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4f846548-11f5-4283-95d2-c1b870cf0c11 tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:18.727438 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4f846548-11f5-4283-95d2-c1b870cf0c11 tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:18.727867 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4f846548-11f5-4283-95d2-c1b870cf0c11 tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:18.730576 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3369/6368] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:10:18 2022] GET /compute/v2.1/servers/95863fa8-413d-4cc5-bbbf-2b044f1bdc89 => generated 1727 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:10:19.313705 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-4f846548-11f5-4283-95d2-c1b870cf0c11 tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd7603a21403497bbdf24e6c2cfc31b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bee908d0a57d46b29fc0c6c07ecf365a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:19.324530 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-4f846548-11f5-4283-95d2-c1b870cf0c11 tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] 10.222.0.43 "GET /compute/v2.1/servers/a5f1279e-dd4c-43fa-9f32-8da8714f1ffd" status: 200 len: 1427 microversion: 2.1 time: 0.619495 Oct 04 19:10:19.325145 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3000/6369] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:10:18 2022] GET /compute/v2.1/servers/a5f1279e-dd4c-43fa-9f32-8da8714f1ffd => generated 1427 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:10:19.742682 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-589962de-1611-425c-8794-8b85925ddc73 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:10:19.744105 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-589962de-1611-425c-8794-8b85925ddc73 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] [instance: 95863fa8-413d-4cc5-bbbf-2b044f1bdc89] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:19.761082 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-589962de-1611-425c-8794-8b85925ddc73 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:19.762106 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-589962de-1611-425c-8794-8b85925ddc73 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:19.762802 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-589962de-1611-425c-8794-8b85925ddc73 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:19.767779 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-589962de-1611-425c-8794-8b85925ddc73 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:19.768485 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-589962de-1611-425c-8794-8b85925ddc73 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:19.769705 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-589962de-1611-425c-8794-8b85925ddc73 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:20.151234 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-589962de-1611-425c-8794-8b85925ddc73 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:20.180598 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-589962de-1611-425c-8794-8b85925ddc73 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:20.184392 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-589962de-1611-425c-8794-8b85925ddc73 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:20.187186 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-589962de-1611-425c-8794-8b85925ddc73 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] 10.222.0.43 "GET /compute/v2.1/servers/95863fa8-413d-4cc5-bbbf-2b044f1bdc89" status: 200 len: 1727 microversion: 2.20 time: 0.450828 Oct 04 19:10:20.193184 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3370/6370] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:10:19 2022] GET /compute/v2.1/servers/95863fa8-413d-4cc5-bbbf-2b044f1bdc89 => generated 1727 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:10:20.355441 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-8467a04f-7f75-4cf5-a6cb-cf2ec98e3ba8 tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:10:20.356812 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-8467a04f-7f75-4cf5-a6cb-cf2ec98e3ba8 tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] [instance: a5f1279e-dd4c-43fa-9f32-8da8714f1ffd] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:20.391776 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8467a04f-7f75-4cf5-a6cb-cf2ec98e3ba8 tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:20.405662 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8467a04f-7f75-4cf5-a6cb-cf2ec98e3ba8 tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:20.406481 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8467a04f-7f75-4cf5-a6cb-cf2ec98e3ba8 tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:20.408517 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8467a04f-7f75-4cf5-a6cb-cf2ec98e3ba8 tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:20.411520 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8467a04f-7f75-4cf5-a6cb-cf2ec98e3ba8 tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:20.412212 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8467a04f-7f75-4cf5-a6cb-cf2ec98e3ba8 tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:21.009260 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-8467a04f-7f75-4cf5-a6cb-cf2ec98e3ba8 tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd7603a21403497bbdf24e6c2cfc31b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bee908d0a57d46b29fc0c6c07ecf365a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:21.021196 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-8467a04f-7f75-4cf5-a6cb-cf2ec98e3ba8 tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] 10.222.0.43 "GET /compute/v2.1/servers/a5f1279e-dd4c-43fa-9f32-8da8714f1ffd" status: 200 len: 1427 microversion: 2.1 time: 0.667216 Oct 04 19:10:21.021791 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3001/6371] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:10:20 2022] GET /compute/v2.1/servers/a5f1279e-dd4c-43fa-9f32-8da8714f1ffd => generated 1427 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:10:21.227276 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-1b000301-dfd7-4a43-8952-c269c3f581c5 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:10:21.228297 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-1b000301-dfd7-4a43-8952-c269c3f581c5 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] [instance: 95863fa8-413d-4cc5-bbbf-2b044f1bdc89] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:21.248459 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-3ac35cb9-1bc7-4b7a-bf5e-b9f77b875c68 req-c9f3cf9d-187f-48d4-b758-90b35233972e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5f1279e-dd4c-43fa-9f32-8da8714f1ffd", "tag": "bcc86ae2-3e8f-4b18-9506-312af53b1933"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:10:21.265563 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1b000301-dfd7-4a43-8952-c269c3f581c5 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:21.269487 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1b000301-dfd7-4a43-8952-c269c3f581c5 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:21.272427 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1b000301-dfd7-4a43-8952-c269c3f581c5 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:21.279872 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1b000301-dfd7-4a43-8952-c269c3f581c5 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:21.280595 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1b000301-dfd7-4a43-8952-c269c3f581c5 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:21.281248 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1b000301-dfd7-4a43-8952-c269c3f581c5 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:21.283319 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-3ac35cb9-1bc7-4b7a-bf5e-b9f77b875c68 req-c9f3cf9d-187f-48d4-b758-90b35233972e service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:21.284074 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-3ac35cb9-1bc7-4b7a-bf5e-b9f77b875c68 req-c9f3cf9d-187f-48d4-b758-90b35233972e service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:21.284530 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-3ac35cb9-1bc7-4b7a-bf5e-b9f77b875c68 req-c9f3cf9d-187f-48d4-b758-90b35233972e service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:21.382008 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-3ac35cb9-1bc7-4b7a-bf5e-b9f77b875c68 req-c9f3cf9d-187f-48d4-b758-90b35233972e service nova] Creating event network-changed:bcc86ae2-3e8f-4b18-9506-312af53b1933 for instance a5f1279e-dd4c-43fa-9f32-8da8714f1ffd on n-h1-851028-13 Oct 04 19:10:21.410594 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-3ac35cb9-1bc7-4b7a-bf5e-b9f77b875c68 req-c9f3cf9d-187f-48d4-b758-90b35233972e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.166410 Oct 04 19:10:21.412352 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3002/6372] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:10:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:10:21.762627 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-1b000301-dfd7-4a43-8952-c269c3f581c5 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:21.777299 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-1b000301-dfd7-4a43-8952-c269c3f581c5 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:21.778992 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-1b000301-dfd7-4a43-8952-c269c3f581c5 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:21.780253 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-1b000301-dfd7-4a43-8952-c269c3f581c5 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] 10.222.0.43 "GET /compute/v2.1/servers/95863fa8-413d-4cc5-bbbf-2b044f1bdc89" status: 200 len: 1727 microversion: 2.20 time: 0.560338 Oct 04 19:10:21.780956 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3371/6373] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:10:21 2022] GET /compute/v2.1/servers/95863fa8-413d-4cc5-bbbf-2b044f1bdc89 => generated 1727 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:10:22.055551 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-331f377c-d7c7-4a64-8c5e-9e7171183de7 tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:10:22.056499 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-331f377c-d7c7-4a64-8c5e-9e7171183de7 tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] [instance: a5f1279e-dd4c-43fa-9f32-8da8714f1ffd] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:22.072007 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-331f377c-d7c7-4a64-8c5e-9e7171183de7 tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:22.073631 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-331f377c-d7c7-4a64-8c5e-9e7171183de7 tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:22.074269 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-331f377c-d7c7-4a64-8c5e-9e7171183de7 tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:22.077394 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-331f377c-d7c7-4a64-8c5e-9e7171183de7 tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:22.078137 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-331f377c-d7c7-4a64-8c5e-9e7171183de7 tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:22.078811 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-331f377c-d7c7-4a64-8c5e-9e7171183de7 tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:22.855984 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-2f362284-21f7-490c-8391-e1559d18beb2 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:10:22.857479 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-2f362284-21f7-490c-8391-e1559d18beb2 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] [instance: 95863fa8-413d-4cc5-bbbf-2b044f1bdc89] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:22.881348 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2f362284-21f7-490c-8391-e1559d18beb2 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:22.882969 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2f362284-21f7-490c-8391-e1559d18beb2 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:22.884019 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2f362284-21f7-490c-8391-e1559d18beb2 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:22.885920 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2f362284-21f7-490c-8391-e1559d18beb2 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:22.887154 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2f362284-21f7-490c-8391-e1559d18beb2 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:22.888585 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2f362284-21f7-490c-8391-e1559d18beb2 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:22.891723 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-331f377c-d7c7-4a64-8c5e-9e7171183de7 tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd7603a21403497bbdf24e6c2cfc31b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bee908d0a57d46b29fc0c6c07ecf365a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:22.899998 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-331f377c-d7c7-4a64-8c5e-9e7171183de7 tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] 10.222.0.43 "GET /compute/v2.1/servers/a5f1279e-dd4c-43fa-9f32-8da8714f1ffd" status: 200 len: 1427 microversion: 2.1 time: 0.851746 Oct 04 19:10:22.902763 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3003/6374] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:10:22 2022] GET /compute/v2.1/servers/a5f1279e-dd4c-43fa-9f32-8da8714f1ffd => generated 1427 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:10:23.175468 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-2f362284-21f7-490c-8391-e1559d18beb2 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:23.186750 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-2f362284-21f7-490c-8391-e1559d18beb2 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:23.188280 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-2f362284-21f7-490c-8391-e1559d18beb2 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:23.189709 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-2f362284-21f7-490c-8391-e1559d18beb2 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] 10.222.0.43 "GET /compute/v2.1/servers/95863fa8-413d-4cc5-bbbf-2b044f1bdc89" status: 200 len: 1727 microversion: 2.20 time: 0.377884 Oct 04 19:10:23.190759 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3372/6375] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:10:22 2022] GET /compute/v2.1/servers/95863fa8-413d-4cc5-bbbf-2b044f1bdc89 => generated 1727 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:10:23.958010 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-9ab82b5c-3db8-4aac-9447-e2581f647c1e tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:10:23.958643 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-9ab82b5c-3db8-4aac-9447-e2581f647c1e tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] [instance: a5f1279e-dd4c-43fa-9f32-8da8714f1ffd] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:23.966423 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9ab82b5c-3db8-4aac-9447-e2581f647c1e tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:23.979829 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9ab82b5c-3db8-4aac-9447-e2581f647c1e tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:23.980762 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9ab82b5c-3db8-4aac-9447-e2581f647c1e tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:23.981799 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9ab82b5c-3db8-4aac-9447-e2581f647c1e tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:23.985698 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9ab82b5c-3db8-4aac-9447-e2581f647c1e tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:23.986437 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9ab82b5c-3db8-4aac-9447-e2581f647c1e tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:24.237587 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-b1ed12b1-7e41-4051-8fae-8c9e26631061 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:10:24.238415 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-b1ed12b1-7e41-4051-8fae-8c9e26631061 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] [instance: 95863fa8-413d-4cc5-bbbf-2b044f1bdc89] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:24.267513 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b1ed12b1-7e41-4051-8fae-8c9e26631061 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:24.268006 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b1ed12b1-7e41-4051-8fae-8c9e26631061 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:24.277013 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b1ed12b1-7e41-4051-8fae-8c9e26631061 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:24.277812 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b1ed12b1-7e41-4051-8fae-8c9e26631061 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:24.278282 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b1ed12b1-7e41-4051-8fae-8c9e26631061 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:24.283670 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b1ed12b1-7e41-4051-8fae-8c9e26631061 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:24.678657 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-9ab82b5c-3db8-4aac-9447-e2581f647c1e tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd7603a21403497bbdf24e6c2cfc31b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bee908d0a57d46b29fc0c6c07ecf365a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:24.696149 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-9ab82b5c-3db8-4aac-9447-e2581f647c1e tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] 10.222.0.43 "GET /compute/v2.1/servers/a5f1279e-dd4c-43fa-9f32-8da8714f1ffd" status: 200 len: 1427 microversion: 2.1 time: 0.741895 Oct 04 19:10:24.701323 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3004/6376] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:10:23 2022] GET /compute/v2.1/servers/a5f1279e-dd4c-43fa-9f32-8da8714f1ffd => generated 1427 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:10:24.784940 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=2 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:10:24.844000 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=14 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:10:24.893451 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-b1ed12b1-7e41-4051-8fae-8c9e26631061 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:24.914958 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-b1ed12b1-7e41-4051-8fae-8c9e26631061 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:24.919778 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-b1ed12b1-7e41-4051-8fae-8c9e26631061 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:24.924088 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-b1ed12b1-7e41-4051-8fae-8c9e26631061 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] 10.222.0.43 "GET /compute/v2.1/servers/95863fa8-413d-4cc5-bbbf-2b044f1bdc89" status: 200 len: 1727 microversion: 2.20 time: 0.707044 Oct 04 19:10:24.945755 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3373/6377] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:10:24 2022] GET /compute/v2.1/servers/95863fa8-413d-4cc5-bbbf-2b044f1bdc89 => generated 1727 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:10:25.723125 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-438c11e8-62b5-4ac2-8784-8ead382e74d2 tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:10:25.727712 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-438c11e8-62b5-4ac2-8784-8ead382e74d2 tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] [instance: a5f1279e-dd4c-43fa-9f32-8da8714f1ffd] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:25.727712 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=2 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:10:25.735983 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-438c11e8-62b5-4ac2-8784-8ead382e74d2 tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:25.736725 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-438c11e8-62b5-4ac2-8784-8ead382e74d2 tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:25.737452 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-438c11e8-62b5-4ac2-8784-8ead382e74d2 tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:25.738405 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-438c11e8-62b5-4ac2-8784-8ead382e74d2 tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:25.739092 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-438c11e8-62b5-4ac2-8784-8ead382e74d2 tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:25.739750 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-438c11e8-62b5-4ac2-8784-8ead382e74d2 tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:25.906945 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-438c11e8-62b5-4ac2-8784-8ead382e74d2 tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd7603a21403497bbdf24e6c2cfc31b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bee908d0a57d46b29fc0c6c07ecf365a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:25.916301 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-438c11e8-62b5-4ac2-8784-8ead382e74d2 tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] 10.222.0.43 "GET /compute/v2.1/servers/a5f1279e-dd4c-43fa-9f32-8da8714f1ffd" status: 200 len: 1427 microversion: 2.1 time: 0.197253 Oct 04 19:10:25.917175 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3005/6378] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:10:25 2022] GET /compute/v2.1/servers/a5f1279e-dd4c-43fa-9f32-8da8714f1ffd => generated 1427 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:10:25.974605 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f850e1af-4b9e-4ce3-9a55-60e043499e04 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:10:25.975806 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-f850e1af-4b9e-4ce3-9a55-60e043499e04 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] [instance: 95863fa8-413d-4cc5-bbbf-2b044f1bdc89] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:25.986761 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f850e1af-4b9e-4ce3-9a55-60e043499e04 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:25.987671 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f850e1af-4b9e-4ce3-9a55-60e043499e04 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:25.988319 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f850e1af-4b9e-4ce3-9a55-60e043499e04 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:25.989356 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f850e1af-4b9e-4ce3-9a55-60e043499e04 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:25.989920 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f850e1af-4b9e-4ce3-9a55-60e043499e04 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:25.990390 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f850e1af-4b9e-4ce3-9a55-60e043499e04 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:26.202345 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-f850e1af-4b9e-4ce3-9a55-60e043499e04 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:26.218154 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-f850e1af-4b9e-4ce3-9a55-60e043499e04 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:26.219813 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-f850e1af-4b9e-4ce3-9a55-60e043499e04 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:26.220975 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-f850e1af-4b9e-4ce3-9a55-60e043499e04 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] 10.222.0.43 "GET /compute/v2.1/servers/95863fa8-413d-4cc5-bbbf-2b044f1bdc89" status: 200 len: 1727 microversion: 2.20 time: 0.250852 Oct 04 19:10:26.233451 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3374/6379] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:10:25 2022] GET /compute/v2.1/servers/95863fa8-413d-4cc5-bbbf-2b044f1bdc89 => generated 1727 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:10:26.944464 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-aad10517-6948-49bb-97e2-8adf2c7efa4f tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:10:26.945864 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-aad10517-6948-49bb-97e2-8adf2c7efa4f tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] [instance: a5f1279e-dd4c-43fa-9f32-8da8714f1ffd] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:26.955030 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-aad10517-6948-49bb-97e2-8adf2c7efa4f tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:26.956109 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-aad10517-6948-49bb-97e2-8adf2c7efa4f tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:26.956635 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-aad10517-6948-49bb-97e2-8adf2c7efa4f tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:26.957637 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-aad10517-6948-49bb-97e2-8adf2c7efa4f tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:26.958169 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-aad10517-6948-49bb-97e2-8adf2c7efa4f tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:26.958676 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-aad10517-6948-49bb-97e2-8adf2c7efa4f tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:27.123084 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-e2c2b2d5-b700-4c73-852f-29ea64017b53 req-3a6fb724-021c-4103-85a5-ce411b2ac34a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5f1279e-dd4c-43fa-9f32-8da8714f1ffd", "name": "network-vif-plugged", "status": "completed", "tag": "bcc86ae2-3e8f-4b18-9506-312af53b1933"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:10:27.126415 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-aad10517-6948-49bb-97e2-8adf2c7efa4f tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd7603a21403497bbdf24e6c2cfc31b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bee908d0a57d46b29fc0c6c07ecf365a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:27.137510 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-aad10517-6948-49bb-97e2-8adf2c7efa4f tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] 10.222.0.43 "GET /compute/v2.1/servers/a5f1279e-dd4c-43fa-9f32-8da8714f1ffd" status: 200 len: 1427 microversion: 2.1 time: 0.197267 Oct 04 19:10:27.139236 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-e2c2b2d5-b700-4c73-852f-29ea64017b53 req-3a6fb724-021c-4103-85a5-ce411b2ac34a service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:27.139998 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-e2c2b2d5-b700-4c73-852f-29ea64017b53 req-3a6fb724-021c-4103-85a5-ce411b2ac34a service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:27.140842 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-e2c2b2d5-b700-4c73-852f-29ea64017b53 req-3a6fb724-021c-4103-85a5-ce411b2ac34a service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:27.146955 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3006/6380] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:10:26 2022] GET /compute/v2.1/servers/a5f1279e-dd4c-43fa-9f32-8da8714f1ffd => generated 1427 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:10:27.155787 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-e2c2b2d5-b700-4c73-852f-29ea64017b53 req-3a6fb724-021c-4103-85a5-ce411b2ac34a service nova] Creating event network-vif-plugged:bcc86ae2-3e8f-4b18-9506-312af53b1933 for instance a5f1279e-dd4c-43fa-9f32-8da8714f1ffd on n-h1-851028-13 Oct 04 19:10:27.162338 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-e2c2b2d5-b700-4c73-852f-29ea64017b53 req-3a6fb724-021c-4103-85a5-ce411b2ac34a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044010 Oct 04 19:10:27.163109 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3375/6381] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:10:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:10:27.251132 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-8d088dad-b31f-4ca9-9fc3-8ae70e541e27 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:10:27.252171 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-8d088dad-b31f-4ca9-9fc3-8ae70e541e27 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] [instance: 95863fa8-413d-4cc5-bbbf-2b044f1bdc89] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:27.259326 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8d088dad-b31f-4ca9-9fc3-8ae70e541e27 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:27.260105 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8d088dad-b31f-4ca9-9fc3-8ae70e541e27 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:27.260665 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8d088dad-b31f-4ca9-9fc3-8ae70e541e27 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:27.261614 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8d088dad-b31f-4ca9-9fc3-8ae70e541e27 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:27.262167 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8d088dad-b31f-4ca9-9fc3-8ae70e541e27 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:27.263069 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8d088dad-b31f-4ca9-9fc3-8ae70e541e27 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:27.431816 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-8d088dad-b31f-4ca9-9fc3-8ae70e541e27 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:27.440546 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-8d088dad-b31f-4ca9-9fc3-8ae70e541e27 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:27.442030 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-8d088dad-b31f-4ca9-9fc3-8ae70e541e27 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:27.443205 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-8d088dad-b31f-4ca9-9fc3-8ae70e541e27 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] 10.222.0.43 "GET /compute/v2.1/servers/95863fa8-413d-4cc5-bbbf-2b044f1bdc89" status: 200 len: 1727 microversion: 2.20 time: 0.196555 Oct 04 19:10:27.443769 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3007/6382] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:10:27 2022] GET /compute/v2.1/servers/95863fa8-413d-4cc5-bbbf-2b044f1bdc89 => generated 1727 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:10:28.176418 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-1669bd20-e77d-4a45-aeae-71cec90b2cf3 tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:10:28.177156 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-1669bd20-e77d-4a45-aeae-71cec90b2cf3 tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] [instance: a5f1279e-dd4c-43fa-9f32-8da8714f1ffd] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:28.185765 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1669bd20-e77d-4a45-aeae-71cec90b2cf3 tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:28.187061 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1669bd20-e77d-4a45-aeae-71cec90b2cf3 tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:28.187381 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1669bd20-e77d-4a45-aeae-71cec90b2cf3 tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:28.188113 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1669bd20-e77d-4a45-aeae-71cec90b2cf3 tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:28.188573 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1669bd20-e77d-4a45-aeae-71cec90b2cf3 tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:28.189008 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1669bd20-e77d-4a45-aeae-71cec90b2cf3 tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:28.192079 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:10:28.338363 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-1669bd20-e77d-4a45-aeae-71cec90b2cf3 tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd7603a21403497bbdf24e6c2cfc31b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bee908d0a57d46b29fc0c6c07ecf365a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:28.347952 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-1669bd20-e77d-4a45-aeae-71cec90b2cf3 tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] 10.222.0.43 "GET /compute/v2.1/servers/a5f1279e-dd4c-43fa-9f32-8da8714f1ffd" status: 200 len: 1427 microversion: 2.1 time: 0.190208 Oct 04 19:10:28.367477 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3376/6383] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:10:28 2022] GET /compute/v2.1/servers/a5f1279e-dd4c-43fa-9f32-8da8714f1ffd => generated 1427 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:10:28.470225 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-3ffb905c-5748-4e21-a648-cee69ad0b552 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:10:28.471232 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-3ffb905c-5748-4e21-a648-cee69ad0b552 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] [instance: 95863fa8-413d-4cc5-bbbf-2b044f1bdc89] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:28.489401 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3ffb905c-5748-4e21-a648-cee69ad0b552 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:28.489939 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3ffb905c-5748-4e21-a648-cee69ad0b552 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:28.490383 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3ffb905c-5748-4e21-a648-cee69ad0b552 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:28.491117 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3ffb905c-5748-4e21-a648-cee69ad0b552 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:28.491576 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3ffb905c-5748-4e21-a648-cee69ad0b552 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:28.492516 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3ffb905c-5748-4e21-a648-cee69ad0b552 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:28.661056 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-3ffb905c-5748-4e21-a648-cee69ad0b552 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:28.673871 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-3ffb905c-5748-4e21-a648-cee69ad0b552 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:28.676020 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-3ffb905c-5748-4e21-a648-cee69ad0b552 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:28.677250 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-3ffb905c-5748-4e21-a648-cee69ad0b552 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] 10.222.0.43 "GET /compute/v2.1/servers/95863fa8-413d-4cc5-bbbf-2b044f1bdc89" status: 200 len: 1727 microversion: 2.20 time: 0.211136 Oct 04 19:10:28.677988 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3008/6384] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:10:28 2022] GET /compute/v2.1/servers/95863fa8-413d-4cc5-bbbf-2b044f1bdc89 => generated 1727 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 19:10:29.371909 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-ca6778af-aaca-4cbb-9d98-bb7bd737781d tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:10:29.372642 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-ca6778af-aaca-4cbb-9d98-bb7bd737781d tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] [instance: a5f1279e-dd4c-43fa-9f32-8da8714f1ffd] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:29.379777 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ca6778af-aaca-4cbb-9d98-bb7bd737781d tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:29.380353 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ca6778af-aaca-4cbb-9d98-bb7bd737781d tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:29.380859 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ca6778af-aaca-4cbb-9d98-bb7bd737781d tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:29.381701 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ca6778af-aaca-4cbb-9d98-bb7bd737781d tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:29.382222 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ca6778af-aaca-4cbb-9d98-bb7bd737781d tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:29.393482 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ca6778af-aaca-4cbb-9d98-bb7bd737781d tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:29.559379 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-ca6778af-aaca-4cbb-9d98-bb7bd737781d tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd7603a21403497bbdf24e6c2cfc31b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bee908d0a57d46b29fc0c6c07ecf365a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:29.567775 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-ca6778af-aaca-4cbb-9d98-bb7bd737781d tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] 10.222.0.43 "GET /compute/v2.1/servers/a5f1279e-dd4c-43fa-9f32-8da8714f1ffd" status: 200 len: 1608 microversion: 2.1 time: 0.199840 Oct 04 19:10:29.568367 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3377/6385] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:10:29 2022] GET /compute/v2.1/servers/a5f1279e-dd4c-43fa-9f32-8da8714f1ffd => generated 1608 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:10:29.597869 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-e763fa77-a02b-4d5d-8a69-1a444e0f0300 tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:10:29.598489 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-e763fa77-a02b-4d5d-8a69-1a444e0f0300 tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] [instance: a5f1279e-dd4c-43fa-9f32-8da8714f1ffd] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:29.607952 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e763fa77-a02b-4d5d-8a69-1a444e0f0300 tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:29.621729 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e763fa77-a02b-4d5d-8a69-1a444e0f0300 tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:29.622346 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e763fa77-a02b-4d5d-8a69-1a444e0f0300 tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:29.623197 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e763fa77-a02b-4d5d-8a69-1a444e0f0300 tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:29.623758 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e763fa77-a02b-4d5d-8a69-1a444e0f0300 tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:29.624277 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e763fa77-a02b-4d5d-8a69-1a444e0f0300 tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:29.802412 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-e763fa77-a02b-4d5d-8a69-1a444e0f0300 tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd7603a21403497bbdf24e6c2cfc31b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bee908d0a57d46b29fc0c6c07ecf365a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:29.828136 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-e763fa77-a02b-4d5d-8a69-1a444e0f0300 tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] 10.222.0.43 "GET /compute/v2.1/servers/a5f1279e-dd4c-43fa-9f32-8da8714f1ffd" status: 200 len: 1608 microversion: 2.1 time: 0.236119 Oct 04 19:10:29.829020 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3009/6386] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:10:29 2022] GET /compute/v2.1/servers/a5f1279e-dd4c-43fa-9f32-8da8714f1ffd => generated 1608 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:10:29.851538 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-8cdd15dd-0e22-45ea-8da6-a85aedbe84ee tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:10:29.852022 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f69d49ae-74d4-4811-aecd-b9be0ce6d71d tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:10:29.852213 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-8cdd15dd-0e22-45ea-8da6-a85aedbe84ee tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] [instance: a5f1279e-dd4c-43fa-9f32-8da8714f1ffd] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:29.852648 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-f69d49ae-74d4-4811-aecd-b9be0ce6d71d tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] [instance: 95863fa8-413d-4cc5-bbbf-2b044f1bdc89] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:29.859663 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f69d49ae-74d4-4811-aecd-b9be0ce6d71d tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:29.860155 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f69d49ae-74d4-4811-aecd-b9be0ce6d71d tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:29.861048 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f69d49ae-74d4-4811-aecd-b9be0ce6d71d tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:29.862003 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f69d49ae-74d4-4811-aecd-b9be0ce6d71d tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:29.862639 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f69d49ae-74d4-4811-aecd-b9be0ce6d71d tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:29.863233 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f69d49ae-74d4-4811-aecd-b9be0ce6d71d tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:29.863521 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8cdd15dd-0e22-45ea-8da6-a85aedbe84ee tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:29.864039 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8cdd15dd-0e22-45ea-8da6-a85aedbe84ee tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:29.864490 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8cdd15dd-0e22-45ea-8da6-a85aedbe84ee tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:29.865440 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8cdd15dd-0e22-45ea-8da6-a85aedbe84ee tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:29.866012 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8cdd15dd-0e22-45ea-8da6-a85aedbe84ee tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:29.866549 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8cdd15dd-0e22-45ea-8da6-a85aedbe84ee tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:30.065373 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-f69d49ae-74d4-4811-aecd-b9be0ce6d71d tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:30.076558 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-f69d49ae-74d4-4811-aecd-b9be0ce6d71d tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:30.078827 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-f69d49ae-74d4-4811-aecd-b9be0ce6d71d tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:30.084047 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-f69d49ae-74d4-4811-aecd-b9be0ce6d71d tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] 10.222.0.43 "GET /compute/v2.1/servers/95863fa8-413d-4cc5-bbbf-2b044f1bdc89" status: 200 len: 1727 microversion: 2.20 time: 0.383743 Oct 04 19:10:30.085387 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3378/6387] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:10:29 2022] GET /compute/v2.1/servers/95863fa8-413d-4cc5-bbbf-2b044f1bdc89 => generated 1727 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:10:30.120930 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-8cdd15dd-0e22-45ea-8da6-a85aedbe84ee tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd7603a21403497bbdf24e6c2cfc31b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bee908d0a57d46b29fc0c6c07ecf365a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:30.143697 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-8cdd15dd-0e22-45ea-8da6-a85aedbe84ee tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] 10.222.0.43 "GET /compute/v2.1/servers/a5f1279e-dd4c-43fa-9f32-8da8714f1ffd" status: 200 len: 1608 microversion: 2.1 time: 0.281730 Oct 04 19:10:30.144622 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3010/6388] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:10:29 2022] GET /compute/v2.1/servers/a5f1279e-dd4c-43fa-9f32-8da8714f1ffd => generated 1608 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:10:31.110946 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-e078fad2-1eb8-4e0f-a7bf-09e484c4dea9 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:10:31.111915 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-e078fad2-1eb8-4e0f-a7bf-09e484c4dea9 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] [instance: 95863fa8-413d-4cc5-bbbf-2b044f1bdc89] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:31.123466 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:10:31.128482 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e078fad2-1eb8-4e0f-a7bf-09e484c4dea9 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:31.129876 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e078fad2-1eb8-4e0f-a7bf-09e484c4dea9 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:31.132101 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e078fad2-1eb8-4e0f-a7bf-09e484c4dea9 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:31.136362 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e078fad2-1eb8-4e0f-a7bf-09e484c4dea9 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:31.137041 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e078fad2-1eb8-4e0f-a7bf-09e484c4dea9 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:31.139132 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e078fad2-1eb8-4e0f-a7bf-09e484c4dea9 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:31.269001 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-98fe3587-3ebc-4b85-aa55-cf5e67819764 req-6514df29-435c-452c-bcdf-fd303140e9de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95863fa8-413d-4cc5-bbbf-2b044f1bdc89", "name": "network-vif-plugged", "status": "completed", "tag": "3f8b2d23-6735-464b-9f26-f53f462f3e82"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:10:31.287328 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-98fe3587-3ebc-4b85-aa55-cf5e67819764 req-6514df29-435c-452c-bcdf-fd303140e9de service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:31.287831 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-98fe3587-3ebc-4b85-aa55-cf5e67819764 req-6514df29-435c-452c-bcdf-fd303140e9de service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:31.288274 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-98fe3587-3ebc-4b85-aa55-cf5e67819764 req-6514df29-435c-452c-bcdf-fd303140e9de service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:31.318354 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-98fe3587-3ebc-4b85-aa55-cf5e67819764 req-6514df29-435c-452c-bcdf-fd303140e9de service nova] Creating event network-vif-plugged:3f8b2d23-6735-464b-9f26-f53f462f3e82 for instance 95863fa8-413d-4cc5-bbbf-2b044f1bdc89 on n-h2-851028-13 Oct 04 19:10:31.330791 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-98fe3587-3ebc-4b85-aa55-cf5e67819764 req-6514df29-435c-452c-bcdf-fd303140e9de service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065495 Oct 04 19:10:31.333578 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3011/6389] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:10:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:10:31.415160 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-e078fad2-1eb8-4e0f-a7bf-09e484c4dea9 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:31.425524 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-e078fad2-1eb8-4e0f-a7bf-09e484c4dea9 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:31.426966 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-e078fad2-1eb8-4e0f-a7bf-09e484c4dea9 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:31.431602 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-e078fad2-1eb8-4e0f-a7bf-09e484c4dea9 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] 10.222.0.43 "GET /compute/v2.1/servers/95863fa8-413d-4cc5-bbbf-2b044f1bdc89" status: 200 len: 1727 microversion: 2.20 time: 0.324421 Oct 04 19:10:31.450380 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3379/6390] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:10:31 2022] GET /compute/v2.1/servers/95863fa8-413d-4cc5-bbbf-2b044f1bdc89 => generated 1727 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:10:32.461312 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-1a969fbb-4102-4e0a-8040-cd9983404dd8 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:10:32.462910 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-1a969fbb-4102-4e0a-8040-cd9983404dd8 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] [instance: 95863fa8-413d-4cc5-bbbf-2b044f1bdc89] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:32.472593 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1a969fbb-4102-4e0a-8040-cd9983404dd8 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:32.474159 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1a969fbb-4102-4e0a-8040-cd9983404dd8 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:32.474757 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1a969fbb-4102-4e0a-8040-cd9983404dd8 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:32.475760 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1a969fbb-4102-4e0a-8040-cd9983404dd8 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:32.477178 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1a969fbb-4102-4e0a-8040-cd9983404dd8 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:32.478062 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1a969fbb-4102-4e0a-8040-cd9983404dd8 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:32.724935 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-1a969fbb-4102-4e0a-8040-cd9983404dd8 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:32.736939 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-1a969fbb-4102-4e0a-8040-cd9983404dd8 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:32.739894 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-1a969fbb-4102-4e0a-8040-cd9983404dd8 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:32.742774 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-1a969fbb-4102-4e0a-8040-cd9983404dd8 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] 10.222.0.43 "GET /compute/v2.1/servers/95863fa8-413d-4cc5-bbbf-2b044f1bdc89" status: 200 len: 1727 microversion: 2.20 time: 0.288842 Oct 04 19:10:32.748837 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3012/6391] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:10:32 2022] GET /compute/v2.1/servers/95863fa8-413d-4cc5-bbbf-2b044f1bdc89 => generated 1727 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:10:32.775005 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-50c757ae-318d-41b7-b65d-957a877aea93 req-f20a2db1-4f3d-40b6-8e30-fc7b3bfaeb36 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5f1279e-dd4c-43fa-9f32-8da8714f1ffd", "tag": "bcc86ae2-3e8f-4b18-9506-312af53b1933"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:10:32.788525 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-50c757ae-318d-41b7-b65d-957a877aea93 req-f20a2db1-4f3d-40b6-8e30-fc7b3bfaeb36 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:32.789968 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-50c757ae-318d-41b7-b65d-957a877aea93 req-f20a2db1-4f3d-40b6-8e30-fc7b3bfaeb36 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:32.790638 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-50c757ae-318d-41b7-b65d-957a877aea93 req-f20a2db1-4f3d-40b6-8e30-fc7b3bfaeb36 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:32.804112 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-50c757ae-318d-41b7-b65d-957a877aea93 req-f20a2db1-4f3d-40b6-8e30-fc7b3bfaeb36 service nova] Creating event network-changed:bcc86ae2-3e8f-4b18-9506-312af53b1933 for instance a5f1279e-dd4c-43fa-9f32-8da8714f1ffd on n-h1-851028-13 Oct 04 19:10:32.811106 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-50c757ae-318d-41b7-b65d-957a877aea93 req-f20a2db1-4f3d-40b6-8e30-fc7b3bfaeb36 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039950 Oct 04 19:10:32.812237 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3380/6392] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:10:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:10:33.774702 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-750fa32f-d867-4119-99db-553a75a4b299 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:10:33.775986 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-750fa32f-d867-4119-99db-553a75a4b299 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] [instance: 95863fa8-413d-4cc5-bbbf-2b044f1bdc89] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:33.783244 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-750fa32f-d867-4119-99db-553a75a4b299 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:33.783975 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-750fa32f-d867-4119-99db-553a75a4b299 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:33.784592 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-750fa32f-d867-4119-99db-553a75a4b299 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:33.785591 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-750fa32f-d867-4119-99db-553a75a4b299 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:33.786215 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-750fa32f-d867-4119-99db-553a75a4b299 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:33.786809 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-750fa32f-d867-4119-99db-553a75a4b299 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:33.792350 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=100 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:10:33.973833 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-750fa32f-d867-4119-99db-553a75a4b299 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:33.985406 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-750fa32f-d867-4119-99db-553a75a4b299 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:33.987114 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-750fa32f-d867-4119-99db-553a75a4b299 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:33.988517 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-750fa32f-d867-4119-99db-553a75a4b299 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] 10.222.0.43 "GET /compute/v2.1/servers/95863fa8-413d-4cc5-bbbf-2b044f1bdc89" status: 200 len: 1727 microversion: 2.20 time: 0.218059 Oct 04 19:10:33.989268 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3013/6393] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:10:33 2022] GET /compute/v2.1/servers/95863fa8-413d-4cc5-bbbf-2b044f1bdc89 => generated 1727 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:10:35.020242 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-950d9465-524d-4307-8ee9-81b95a95b69b tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:10:35.024661 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-950d9465-524d-4307-8ee9-81b95a95b69b tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] [instance: 95863fa8-413d-4cc5-bbbf-2b044f1bdc89] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:35.035244 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-950d9465-524d-4307-8ee9-81b95a95b69b tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:35.035816 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-950d9465-524d-4307-8ee9-81b95a95b69b tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:35.036858 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-950d9465-524d-4307-8ee9-81b95a95b69b tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:35.037914 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-950d9465-524d-4307-8ee9-81b95a95b69b tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:35.038503 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-950d9465-524d-4307-8ee9-81b95a95b69b tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:35.039657 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-950d9465-524d-4307-8ee9-81b95a95b69b tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:35.207594 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-950d9465-524d-4307-8ee9-81b95a95b69b tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:35.216496 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-950d9465-524d-4307-8ee9-81b95a95b69b tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:35.217952 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-950d9465-524d-4307-8ee9-81b95a95b69b tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:35.219129 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-950d9465-524d-4307-8ee9-81b95a95b69b tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] 10.222.0.43 "GET /compute/v2.1/servers/95863fa8-413d-4cc5-bbbf-2b044f1bdc89" status: 200 len: 1714 microversion: 2.20 time: 0.203836 Oct 04 19:10:35.219742 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3381/6394] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:10:35 2022] GET /compute/v2.1/servers/95863fa8-413d-4cc5-bbbf-2b044f1bdc89 => generated 1714 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:10:50.276544 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-5612b745-947b-4d35-a1dc-dadada300126 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-898212231", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452", "networks": [{"uuid": "c9efdd18-1ad0-4af8-8ebc-062c80f244c1"}]}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:10:50.286053 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_api:SELECT=29 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:10:50.286732 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=5 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:10:50.337819 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.network.neutron [None req-5612b745-947b-4d35-a1dc-dadada300126 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] validate_networks() for [('c9efdd18-1ad0-4af8-8ebc-062c80f244c1', None, None, None, None, None)] {{(pid=123595) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 19:10:50.751348 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-5612b745-947b-4d35-a1dc-dadada300126 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Flavor limits 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:10:50.751783 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-5612b745-947b-4d35-a1dc-dadada300126 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Image limits 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:10:50.752272 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-5612b745-947b-4d35-a1dc-dadada300126 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Flavor pref 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:10:50.752700 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-5612b745-947b-4d35-a1dc-dadada300126 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Image pref 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:10:50.753135 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-5612b745-947b-4d35-a1dc-dadada300126 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:10:50.763446 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5612b745-947b-4d35-a1dc-dadada300126 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:50.763936 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5612b745-947b-4d35-a1dc-dadada300126 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:50.764381 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5612b745-947b-4d35-a1dc-dadada300126 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:50.765140 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5612b745-947b-4d35-a1dc-dadada300126 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:50.765642 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5612b745-947b-4d35-a1dc-dadada300126 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:50.766082 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5612b745-947b-4d35-a1dc-dadada300126 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:50.783577 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-5612b745-947b-4d35-a1dc-dadada300126 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Getting quotas for project 6dca72b323a14a33b422400007a816cc. Resources: {'ram', 'cores', 'instances'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:10:50.789437 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-5612b745-947b-4d35-a1dc-dadada300126 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Getting quotas for user 22ac079f44ac4d48b3eb48ee17a5c58d and project 6dca72b323a14a33b422400007a816cc. Resources: {'ram', 'cores', 'instances'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:10:50.802407 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-5612b745-947b-4d35-a1dc-dadada300126 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Going to run 1 instances... {{(pid=123595) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 19:10:50.804646 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-5612b745-947b-4d35-a1dc-dadada300126 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] [instance: 05904eb8-6786-4d08-bb1c-03d36d74e3a7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e8943ec5-4038-4d4b-b9b9-2415a79f5243',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 19:10:50.870335 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-5612b745-947b-4d35-a1dc-dadada300126 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.598524 Oct 04 19:10:50.871040 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3014/6395] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 19:10:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 600 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 19:10:50.884311 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-ff5182aa-d77a-48b1-940c-117526f8882c tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:10:50.885034 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-ff5182aa-d77a-48b1-940c-117526f8882c tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] [instance: 05904eb8-6786-4d08-bb1c-03d36d74e3a7] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:50.888423 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_api:SELECT=5 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:10:50.893777 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=31 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:10:50.972468 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-ff5182aa-d77a-48b1-940c-117526f8882c tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ac079f44ac4d48b3eb48ee17a5c58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dca72b323a14a33b422400007a816cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:50.979502 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-ff5182aa-d77a-48b1-940c-117526f8882c tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] 10.222.0.43 "GET /compute/v2.1/servers/05904eb8-6786-4d08-bb1c-03d36d74e3a7" status: 200 len: 1218 microversion: 2.1 time: 0.099232 Oct 04 19:10:50.980100 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3382/6396] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:10:50 2022] GET /compute/v2.1/servers/05904eb8-6786-4d08-bb1c-03d36d74e3a7 => generated 1218 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:10:52.006089 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-d7da7ce6-2822-4082-b344-e045f3e14278 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:10:52.007379 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-d7da7ce6-2822-4082-b344-e045f3e14278 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] [instance: 05904eb8-6786-4d08-bb1c-03d36d74e3a7] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:52.015647 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d7da7ce6-2822-4082-b344-e045f3e14278 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:52.016148 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d7da7ce6-2822-4082-b344-e045f3e14278 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:52.016597 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d7da7ce6-2822-4082-b344-e045f3e14278 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:52.017341 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d7da7ce6-2822-4082-b344-e045f3e14278 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:52.017811 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d7da7ce6-2822-4082-b344-e045f3e14278 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:52.018276 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d7da7ce6-2822-4082-b344-e045f3e14278 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:52.142443 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-d7da7ce6-2822-4082-b344-e045f3e14278 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ac079f44ac4d48b3eb48ee17a5c58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dca72b323a14a33b422400007a816cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:52.150595 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-d7da7ce6-2822-4082-b344-e045f3e14278 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] 10.222.0.43 "GET /compute/v2.1/servers/05904eb8-6786-4d08-bb1c-03d36d74e3a7" status: 200 len: 1278 microversion: 2.1 time: 0.151126 Oct 04 19:10:52.166813 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3015/6397] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:10:51 2022] GET /compute/v2.1/servers/05904eb8-6786-4d08-bb1c-03d36d74e3a7 => generated 1278 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:10:53.176454 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-9db1ef4c-5c2f-4e10-818f-439c39d0f27c tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:10:53.177343 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-9db1ef4c-5c2f-4e10-818f-439c39d0f27c tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] [instance: 05904eb8-6786-4d08-bb1c-03d36d74e3a7] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:53.190674 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9db1ef4c-5c2f-4e10-818f-439c39d0f27c tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:53.191168 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9db1ef4c-5c2f-4e10-818f-439c39d0f27c tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:53.191616 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9db1ef4c-5c2f-4e10-818f-439c39d0f27c tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:53.192834 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9db1ef4c-5c2f-4e10-818f-439c39d0f27c tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:53.193479 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9db1ef4c-5c2f-4e10-818f-439c39d0f27c tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:53.194229 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9db1ef4c-5c2f-4e10-818f-439c39d0f27c tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:53.345458 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-9db1ef4c-5c2f-4e10-818f-439c39d0f27c tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ac079f44ac4d48b3eb48ee17a5c58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dca72b323a14a33b422400007a816cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:53.367949 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-9db1ef4c-5c2f-4e10-818f-439c39d0f27c tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] 10.222.0.43 "GET /compute/v2.1/servers/05904eb8-6786-4d08-bb1c-03d36d74e3a7" status: 200 len: 1318 microversion: 2.1 time: 0.195564 Oct 04 19:10:53.369184 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3383/6398] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:10:53 2022] GET /compute/v2.1/servers/05904eb8-6786-4d08-bb1c-03d36d74e3a7 => generated 1318 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:10:53.814158 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-68f14381-e0de-493a-bbea-0b655f25f274 req-2eb2fbb7-4533-4c84-9ce8-173e6ee5def7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05904eb8-6786-4d08-bb1c-03d36d74e3a7", "tag": "dfda49b2-af9d-4481-92fe-397b9ec4d0a7"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:10:53.827386 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-68f14381-e0de-493a-bbea-0b655f25f274 req-2eb2fbb7-4533-4c84-9ce8-173e6ee5def7 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:53.827875 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-68f14381-e0de-493a-bbea-0b655f25f274 req-2eb2fbb7-4533-4c84-9ce8-173e6ee5def7 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:53.828321 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-68f14381-e0de-493a-bbea-0b655f25f274 req-2eb2fbb7-4533-4c84-9ce8-173e6ee5def7 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:53.841063 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-68f14381-e0de-493a-bbea-0b655f25f274 req-2eb2fbb7-4533-4c84-9ce8-173e6ee5def7 service nova] Creating event network-changed:dfda49b2-af9d-4481-92fe-397b9ec4d0a7 for instance 05904eb8-6786-4d08-bb1c-03d36d74e3a7 on n-h1-851028-13 Oct 04 19:10:53.846456 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-68f14381-e0de-493a-bbea-0b655f25f274 req-2eb2fbb7-4533-4c84-9ce8-173e6ee5def7 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038659 Oct 04 19:10:53.847316 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3016/6399] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:10:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:10:54.394824 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-9f0edc0d-e090-4292-9380-fdeafdfe5a04 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:10:54.396204 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-9f0edc0d-e090-4292-9380-fdeafdfe5a04 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] [instance: 05904eb8-6786-4d08-bb1c-03d36d74e3a7] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:54.404329 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9f0edc0d-e090-4292-9380-fdeafdfe5a04 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:54.404828 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9f0edc0d-e090-4292-9380-fdeafdfe5a04 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:54.405296 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9f0edc0d-e090-4292-9380-fdeafdfe5a04 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:54.405998 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9f0edc0d-e090-4292-9380-fdeafdfe5a04 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:54.406625 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9f0edc0d-e090-4292-9380-fdeafdfe5a04 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:54.407061 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9f0edc0d-e090-4292-9380-fdeafdfe5a04 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:54.548446 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-9f0edc0d-e090-4292-9380-fdeafdfe5a04 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ac079f44ac4d48b3eb48ee17a5c58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dca72b323a14a33b422400007a816cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:54.556387 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-9f0edc0d-e090-4292-9380-fdeafdfe5a04 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] 10.222.0.43 "GET /compute/v2.1/servers/05904eb8-6786-4d08-bb1c-03d36d74e3a7" status: 200 len: 1318 microversion: 2.1 time: 0.166940 Oct 04 19:10:54.556978 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3384/6400] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:10:54 2022] GET /compute/v2.1/servers/05904eb8-6786-4d08-bb1c-03d36d74e3a7 => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:10:55.580412 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-8bba9a29-d9d1-4c64-92f0-9e83b33f0b37 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:10:55.581910 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-8bba9a29-d9d1-4c64-92f0-9e83b33f0b37 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] [instance: 05904eb8-6786-4d08-bb1c-03d36d74e3a7] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:55.589242 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8bba9a29-d9d1-4c64-92f0-9e83b33f0b37 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:55.589774 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8bba9a29-d9d1-4c64-92f0-9e83b33f0b37 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:55.590201 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8bba9a29-d9d1-4c64-92f0-9e83b33f0b37 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:55.591001 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8bba9a29-d9d1-4c64-92f0-9e83b33f0b37 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:55.591393 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8bba9a29-d9d1-4c64-92f0-9e83b33f0b37 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:55.591826 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8bba9a29-d9d1-4c64-92f0-9e83b33f0b37 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:55.785065 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-8bba9a29-d9d1-4c64-92f0-9e83b33f0b37 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ac079f44ac4d48b3eb48ee17a5c58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dca72b323a14a33b422400007a816cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:55.793550 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-8bba9a29-d9d1-4c64-92f0-9e83b33f0b37 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] 10.222.0.43 "GET /compute/v2.1/servers/05904eb8-6786-4d08-bb1c-03d36d74e3a7" status: 200 len: 1318 microversion: 2.1 time: 0.217592 Oct 04 19:10:55.794217 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3017/6401] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:10:55 2022] GET /compute/v2.1/servers/05904eb8-6786-4d08-bb1c-03d36d74e3a7 => generated 1318 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:10:56.815741 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-6761982b-6485-450a-8906-200b59d0ec87 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:10:56.816353 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-6761982b-6485-450a-8906-200b59d0ec87 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] [instance: 05904eb8-6786-4d08-bb1c-03d36d74e3a7] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:56.823032 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6761982b-6485-450a-8906-200b59d0ec87 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:56.823524 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6761982b-6485-450a-8906-200b59d0ec87 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:56.823951 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6761982b-6485-450a-8906-200b59d0ec87 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:56.824642 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6761982b-6485-450a-8906-200b59d0ec87 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:56.825088 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6761982b-6485-450a-8906-200b59d0ec87 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:56.825540 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6761982b-6485-450a-8906-200b59d0ec87 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:56.970107 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-6761982b-6485-450a-8906-200b59d0ec87 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ac079f44ac4d48b3eb48ee17a5c58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dca72b323a14a33b422400007a816cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:56.978403 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-6761982b-6485-450a-8906-200b59d0ec87 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] 10.222.0.43 "GET /compute/v2.1/servers/05904eb8-6786-4d08-bb1c-03d36d74e3a7" status: 200 len: 1318 microversion: 2.1 time: 0.166478 Oct 04 19:10:56.978986 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3385/6402] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:10:56 2022] GET /compute/v2.1/servers/05904eb8-6786-4d08-bb1c-03d36d74e3a7 => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:10:58.001028 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-e91cd264-5944-472d-8679-c88fd6b27cc4 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:10:58.001867 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-e91cd264-5944-472d-8679-c88fd6b27cc4 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] [instance: 05904eb8-6786-4d08-bb1c-03d36d74e3a7] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:58.009619 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e91cd264-5944-472d-8679-c88fd6b27cc4 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:58.010269 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e91cd264-5944-472d-8679-c88fd6b27cc4 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:58.010786 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e91cd264-5944-472d-8679-c88fd6b27cc4 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:58.011579 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e91cd264-5944-472d-8679-c88fd6b27cc4 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:58.012137 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e91cd264-5944-472d-8679-c88fd6b27cc4 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:58.012666 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e91cd264-5944-472d-8679-c88fd6b27cc4 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:58.146046 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-e91cd264-5944-472d-8679-c88fd6b27cc4 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ac079f44ac4d48b3eb48ee17a5c58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dca72b323a14a33b422400007a816cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:58.155054 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-e91cd264-5944-472d-8679-c88fd6b27cc4 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] 10.222.0.43 "GET /compute/v2.1/servers/05904eb8-6786-4d08-bb1c-03d36d74e3a7" status: 200 len: 1318 microversion: 2.1 time: 0.157905 Oct 04 19:10:58.155509 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3018/6403] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:10:57 2022] GET /compute/v2.1/servers/05904eb8-6786-4d08-bb1c-03d36d74e3a7 => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:10:59.177825 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-4c65c962-f995-42ee-b904-db10f132f507 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:10:59.178445 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-4c65c962-f995-42ee-b904-db10f132f507 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] [instance: 05904eb8-6786-4d08-bb1c-03d36d74e3a7] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:59.185390 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4c65c962-f995-42ee-b904-db10f132f507 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:59.185807 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4c65c962-f995-42ee-b904-db10f132f507 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:59.186253 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4c65c962-f995-42ee-b904-db10f132f507 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:59.186956 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4c65c962-f995-42ee-b904-db10f132f507 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:59.187416 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4c65c962-f995-42ee-b904-db10f132f507 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:59.187848 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4c65c962-f995-42ee-b904-db10f132f507 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:59.291131 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-6b406fd0-2d6f-4d5f-9abf-3172ac5940e1 req-4654ffae-e893-47eb-beca-06a6aa87bd54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05904eb8-6786-4d08-bb1c-03d36d74e3a7", "name": "network-vif-plugged", "status": "completed", "tag": "dfda49b2-af9d-4481-92fe-397b9ec4d0a7"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:10:59.312016 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-6b406fd0-2d6f-4d5f-9abf-3172ac5940e1 req-4654ffae-e893-47eb-beca-06a6aa87bd54 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:59.315648 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-6b406fd0-2d6f-4d5f-9abf-3172ac5940e1 req-4654ffae-e893-47eb-beca-06a6aa87bd54 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:59.316490 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-6b406fd0-2d6f-4d5f-9abf-3172ac5940e1 req-4654ffae-e893-47eb-beca-06a6aa87bd54 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:59.347579 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-6b406fd0-2d6f-4d5f-9abf-3172ac5940e1 req-4654ffae-e893-47eb-beca-06a6aa87bd54 service nova] Creating event network-vif-plugged:dfda49b2-af9d-4481-92fe-397b9ec4d0a7 for instance 05904eb8-6786-4d08-bb1c-03d36d74e3a7 on n-h1-851028-13 Oct 04 19:10:59.355598 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-6b406fd0-2d6f-4d5f-9abf-3172ac5940e1 req-4654ffae-e893-47eb-beca-06a6aa87bd54 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070152 Oct 04 19:10:59.358701 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3019/6404] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:10:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:10:59.391841 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-4c65c962-f995-42ee-b904-db10f132f507 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ac079f44ac4d48b3eb48ee17a5c58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dca72b323a14a33b422400007a816cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:59.401020 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-4c65c962-f995-42ee-b904-db10f132f507 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] 10.222.0.43 "GET /compute/v2.1/servers/05904eb8-6786-4d08-bb1c-03d36d74e3a7" status: 200 len: 1318 microversion: 2.1 time: 0.227036 Oct 04 19:10:59.401622 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3386/6405] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:10:59 2022] GET /compute/v2.1/servers/05904eb8-6786-4d08-bb1c-03d36d74e3a7 => generated 1318 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:11:00.424596 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-9df8edaf-0ef2-4369-aaba-504c4fdc0a3c tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:11:00.425354 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-9df8edaf-0ef2-4369-aaba-504c4fdc0a3c tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] [instance: 05904eb8-6786-4d08-bb1c-03d36d74e3a7] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:11:00.433137 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9df8edaf-0ef2-4369-aaba-504c4fdc0a3c tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:00.433647 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9df8edaf-0ef2-4369-aaba-504c4fdc0a3c tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:00.434100 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9df8edaf-0ef2-4369-aaba-504c4fdc0a3c tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:00.434803 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9df8edaf-0ef2-4369-aaba-504c4fdc0a3c tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:00.435262 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9df8edaf-0ef2-4369-aaba-504c4fdc0a3c tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:00.435696 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9df8edaf-0ef2-4369-aaba-504c4fdc0a3c tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:00.578708 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-9df8edaf-0ef2-4369-aaba-504c4fdc0a3c tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ac079f44ac4d48b3eb48ee17a5c58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dca72b323a14a33b422400007a816cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:11:00.586646 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-9df8edaf-0ef2-4369-aaba-504c4fdc0a3c tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] 10.222.0.43 "GET /compute/v2.1/servers/05904eb8-6786-4d08-bb1c-03d36d74e3a7" status: 200 len: 1318 microversion: 2.1 time: 0.166272 Oct 04 19:11:00.587305 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3020/6406] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:11:00 2022] GET /compute/v2.1/servers/05904eb8-6786-4d08-bb1c-03d36d74e3a7 => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:11:01.614416 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-a1e5e11d-3891-4886-9ae0-3ddfd89a9df4 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:11:01.615022 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-a1e5e11d-3891-4886-9ae0-3ddfd89a9df4 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] [instance: 05904eb8-6786-4d08-bb1c-03d36d74e3a7] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:11:01.617788 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=2 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:11:01.623857 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a1e5e11d-3891-4886-9ae0-3ddfd89a9df4 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:01.624346 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a1e5e11d-3891-4886-9ae0-3ddfd89a9df4 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:01.624837 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a1e5e11d-3891-4886-9ae0-3ddfd89a9df4 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:01.625581 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a1e5e11d-3891-4886-9ae0-3ddfd89a9df4 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:01.626059 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a1e5e11d-3891-4886-9ae0-3ddfd89a9df4 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:01.626483 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a1e5e11d-3891-4886-9ae0-3ddfd89a9df4 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:01.775953 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-a1e5e11d-3891-4886-9ae0-3ddfd89a9df4 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ac079f44ac4d48b3eb48ee17a5c58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dca72b323a14a33b422400007a816cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:11:01.784543 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-a1e5e11d-3891-4886-9ae0-3ddfd89a9df4 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] 10.222.0.43 "GET /compute/v2.1/servers/05904eb8-6786-4d08-bb1c-03d36d74e3a7" status: 200 len: 1507 microversion: 2.1 time: 0.174206 Oct 04 19:11:01.785187 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3387/6407] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:11:01 2022] GET /compute/v2.1/servers/05904eb8-6786-4d08-bb1c-03d36d74e3a7 => generated 1507 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:11:07.157637 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-3e55c332-311a-45ca-8562-2dea8a7aaf28 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:11:07.160147 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-3e55c332-311a-45ca-8562-2dea8a7aaf28 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] [instance: 95863fa8-413d-4cc5-bbbf-2b044f1bdc89] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:11:07.164549 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=2 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:11:07.165685 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=6 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:11:07.171826 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3e55c332-311a-45ca-8562-2dea8a7aaf28 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:07.172324 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3e55c332-311a-45ca-8562-2dea8a7aaf28 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:07.172764 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3e55c332-311a-45ca-8562-2dea8a7aaf28 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:07.173548 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3e55c332-311a-45ca-8562-2dea8a7aaf28 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:07.174003 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3e55c332-311a-45ca-8562-2dea8a7aaf28 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:07.174435 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3e55c332-311a-45ca-8562-2dea8a7aaf28 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:07.206646 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-3e55c332-311a-45ca-8562-2dea8a7aaf28 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] 10.222.0.43 "GET /compute/v2.1/servers/95863fa8-413d-4cc5-bbbf-2b044f1bdc89/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.054079 Oct 04 19:11:07.207559 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3021/6408] 10.222.0.43 () {60 vars in 1343 bytes} [Tue Oct 4 19:11:07 2022] GET /compute/v2.1/servers/95863fa8-413d-4cc5-bbbf-2b044f1bdc89/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:11:07.278579 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-472ffa3d-e76b-4333-bebf-c9228d4b034d tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:11:07.279143 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-472ffa3d-e76b-4333-bebf-c9228d4b034d tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] [instance: 95863fa8-413d-4cc5-bbbf-2b044f1bdc89] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:11:07.291031 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-472ffa3d-e76b-4333-bebf-c9228d4b034d tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:07.291918 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-472ffa3d-e76b-4333-bebf-c9228d4b034d tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:07.292747 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-472ffa3d-e76b-4333-bebf-c9228d4b034d tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:07.293583 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-472ffa3d-e76b-4333-bebf-c9228d4b034d tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:07.294320 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-472ffa3d-e76b-4333-bebf-c9228d4b034d tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:07.294754 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-472ffa3d-e76b-4333-bebf-c9228d4b034d tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:07.325499 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-472ffa3d-e76b-4333-bebf-c9228d4b034d tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] [instance: 95863fa8-413d-4cc5-bbbf-2b044f1bdc89] Going to try to terminate instance {{(pid=123596) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 19:11:07.419879 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-472ffa3d-e76b-4333-bebf-c9228d4b034d tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] 10.222.0.43 "DELETE /compute/v2.1/servers/95863fa8-413d-4cc5-bbbf-2b044f1bdc89" status: 204 len: 0 microversion: 2.20 time: 0.144861 Oct 04 19:11:07.425378 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3388/6409] 10.222.0.43 () {60 vars in 1280 bytes} [Tue Oct 4 19:11:07 2022] DELETE /compute/v2.1/servers/95863fa8-413d-4cc5-bbbf-2b044f1bdc89 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 19:11:07.430895 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-6ed79fb1-0062-4cde-80c1-e6d5ff7da45d tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:11:07.431886 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-6ed79fb1-0062-4cde-80c1-e6d5ff7da45d tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] [instance: 95863fa8-413d-4cc5-bbbf-2b044f1bdc89] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:11:07.440141 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6ed79fb1-0062-4cde-80c1-e6d5ff7da45d tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:07.441201 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6ed79fb1-0062-4cde-80c1-e6d5ff7da45d tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:07.441783 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6ed79fb1-0062-4cde-80c1-e6d5ff7da45d tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:07.442637 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6ed79fb1-0062-4cde-80c1-e6d5ff7da45d tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:07.443208 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6ed79fb1-0062-4cde-80c1-e6d5ff7da45d tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:07.443879 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6ed79fb1-0062-4cde-80c1-e6d5ff7da45d tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:07.613814 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-6ed79fb1-0062-4cde-80c1-e6d5ff7da45d tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:11:07.624127 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-6ed79fb1-0062-4cde-80c1-e6d5ff7da45d tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:11:07.625961 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-6ed79fb1-0062-4cde-80c1-e6d5ff7da45d tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:11:07.627340 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-6ed79fb1-0062-4cde-80c1-e6d5ff7da45d tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] 10.222.0.43 "GET /compute/v2.1/servers/95863fa8-413d-4cc5-bbbf-2b044f1bdc89" status: 200 len: 1720 microversion: 2.20 time: 0.202219 Oct 04 19:11:07.627917 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3022/6410] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:11:07 2022] GET /compute/v2.1/servers/95863fa8-413d-4cc5-bbbf-2b044f1bdc89 => generated 1720 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 19:11:08.657523 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-95992af1-239c-4c9c-9710-e0d96741a428 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:11:08.658166 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-95992af1-239c-4c9c-9710-e0d96741a428 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] [instance: 95863fa8-413d-4cc5-bbbf-2b044f1bdc89] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:11:08.677308 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-95992af1-239c-4c9c-9710-e0d96741a428 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:08.678250 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-95992af1-239c-4c9c-9710-e0d96741a428 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:08.679145 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-95992af1-239c-4c9c-9710-e0d96741a428 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:08.680787 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-95992af1-239c-4c9c-9710-e0d96741a428 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:08.684800 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-95992af1-239c-4c9c-9710-e0d96741a428 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:08.685527 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-95992af1-239c-4c9c-9710-e0d96741a428 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:08.895282 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-95992af1-239c-4c9c-9710-e0d96741a428 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:11:08.909786 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-95992af1-239c-4c9c-9710-e0d96741a428 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:11:08.911373 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-95992af1-239c-4c9c-9710-e0d96741a428 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:11:08.913071 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-95992af1-239c-4c9c-9710-e0d96741a428 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] 10.222.0.43 "GET /compute/v2.1/servers/95863fa8-413d-4cc5-bbbf-2b044f1bdc89" status: 200 len: 1720 microversion: 2.20 time: 0.261739 Oct 04 19:11:08.914354 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3389/6411] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:11:08 2022] GET /compute/v2.1/servers/95863fa8-413d-4cc5-bbbf-2b044f1bdc89 => generated 1720 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:11:09.944110 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-5ef797a6-3b9f-4fa0-ba4d-4dd2d76dda2a tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:11:09.944728 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-5ef797a6-3b9f-4fa0-ba4d-4dd2d76dda2a tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] [instance: 95863fa8-413d-4cc5-bbbf-2b044f1bdc89] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:11:09.951549 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5ef797a6-3b9f-4fa0-ba4d-4dd2d76dda2a tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:09.952301 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5ef797a6-3b9f-4fa0-ba4d-4dd2d76dda2a tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:09.952941 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5ef797a6-3b9f-4fa0-ba4d-4dd2d76dda2a tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:09.953912 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5ef797a6-3b9f-4fa0-ba4d-4dd2d76dda2a tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:09.954524 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5ef797a6-3b9f-4fa0-ba4d-4dd2d76dda2a tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:09.955546 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5ef797a6-3b9f-4fa0-ba4d-4dd2d76dda2a tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:09.999390 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-97b830a7-8c42-42c9-8e0c-92640c1697a4 tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:11:10.001810 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-97b830a7-8c42-42c9-8e0c-92640c1697a4 tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] [instance: a5f1279e-dd4c-43fa-9f32-8da8714f1ffd] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:11:10.027264 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-97b830a7-8c42-42c9-8e0c-92640c1697a4 tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:10.048544 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-97b830a7-8c42-42c9-8e0c-92640c1697a4 tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:10.049446 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-97b830a7-8c42-42c9-8e0c-92640c1697a4 tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:10.052238 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-97b830a7-8c42-42c9-8e0c-92640c1697a4 tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:10.054288 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-97b830a7-8c42-42c9-8e0c-92640c1697a4 tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:10.055308 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-97b830a7-8c42-42c9-8e0c-92640c1697a4 tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:10.118946 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-97b830a7-8c42-42c9-8e0c-92640c1697a4 tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] 10.222.0.43 "GET /compute/v2.1/servers/a5f1279e-dd4c-43fa-9f32-8da8714f1ffd/os-server-password" status: 200 len: 116 microversion: 2.1 time: 0.124203 Oct 04 19:11:10.120211 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3390/6412] 10.222.0.43 () {58 vars in 1293 bytes} [Tue Oct 4 19:11:09 2022] GET /compute/v2.1/servers/a5f1279e-dd4c-43fa-9f32-8da8714f1ffd/os-server-password => generated 116 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:11:10.125399 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-5ef797a6-3b9f-4fa0-ba4d-4dd2d76dda2a tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:11:10.132041 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-19b5e32a-60a4-4d39-9927-e0e4e6008e69 req-ac2428b4-933f-421d-b5c1-38426a9d4c5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95863fa8-413d-4cc5-bbbf-2b044f1bdc89", "name": "network-vif-deleted", "tag": "3f8b2d23-6735-464b-9f26-f53f462f3e82"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:11:10.151468 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-5ef797a6-3b9f-4fa0-ba4d-4dd2d76dda2a tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:11:10.152289 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-19b5e32a-60a4-4d39-9927-e0e4e6008e69 req-ac2428b4-933f-421d-b5c1-38426a9d4c5a service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:10.153223 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-19b5e32a-60a4-4d39-9927-e0e4e6008e69 req-ac2428b4-933f-421d-b5c1-38426a9d4c5a service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:10.154507 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-19b5e32a-60a4-4d39-9927-e0e4e6008e69 req-ac2428b4-933f-421d-b5c1-38426a9d4c5a service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:10.167694 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-5ef797a6-3b9f-4fa0-ba4d-4dd2d76dda2a tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78f8a576e39b4ef9a7fe0b8a2723e54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93413a82cb584df38e5686c1ffbcfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:11:10.173225 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-5ef797a6-3b9f-4fa0-ba4d-4dd2d76dda2a tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] 10.222.0.43 "GET /compute/v2.1/servers/95863fa8-413d-4cc5-bbbf-2b044f1bdc89" status: 200 len: 1653 microversion: 2.20 time: 0.229633 Oct 04 19:11:10.173895 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3023/6413] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:11:09 2022] GET /compute/v2.1/servers/95863fa8-413d-4cc5-bbbf-2b044f1bdc89 => generated 1653 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 19:11:10.201435 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-19b5e32a-60a4-4d39-9927-e0e4e6008e69 req-ac2428b4-933f-421d-b5c1-38426a9d4c5a service nova] Creating event network-vif-deleted:3f8b2d23-6735-464b-9f26-f53f462f3e82 for instance 95863fa8-413d-4cc5-bbbf-2b044f1bdc89 on n-h2-851028-13 Oct 04 19:11:10.227501 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-19b5e32a-60a4-4d39-9927-e0e4e6008e69 req-ac2428b4-933f-421d-b5c1-38426a9d4c5a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104937 Oct 04 19:11:10.231908 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3391/6414] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:11:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:11:11.203136 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-b7dfd494-0595-43eb-b5fe-51057f76f8e0 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:11:11.204222 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-b7dfd494-0595-43eb-b5fe-51057f76f8e0 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] [instance: 95863fa8-413d-4cc5-bbbf-2b044f1bdc89] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:11:11.213295 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b7dfd494-0595-43eb-b5fe-51057f76f8e0 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:11.213752 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b7dfd494-0595-43eb-b5fe-51057f76f8e0 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:11.214397 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b7dfd494-0595-43eb-b5fe-51057f76f8e0 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:11.215325 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b7dfd494-0595-43eb-b5fe-51057f76f8e0 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:11.216025 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b7dfd494-0595-43eb-b5fe-51057f76f8e0 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:11.220611 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b7dfd494-0595-43eb-b5fe-51057f76f8e0 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:11.244069 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-b7dfd494-0595-43eb-b5fe-51057f76f8e0 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] HTTP exception thrown: Instance 95863fa8-413d-4cc5-bbbf-2b044f1bdc89 could not be found. Oct 04 19:11:11.250799 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-b7dfd494-0595-43eb-b5fe-51057f76f8e0 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Request method failure captured: Oct 04 19:11:11.250799 n-d-851028-13 devstack@n-api.service[123595]: request: GET /compute/v2.1/servers/95863fa8-413d-4cc5-bbbf-2b044f1bdc89 HTTP/1.1 Oct 04 19:11:11.250799 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 19:11:11.250799 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 19:11:11.250799 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 19:11:11.250799 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 0 Oct 04 19:11:11.250799 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 19:11:11.250799 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 19:11:11.250799 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 19:11:11.250799 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 19:11:11.250799 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPIP4EsHxdrJtfXXftgSjd0DkgWU3RyKaqVrtoobsnxnJ73kFXTCStVuGKNNY5HTtavcBESe4zaZDg6zGQScTV0MQIQ57AmI-VfZnXPvc4tm44tDlywrOX9AzxAjxtSyPTeCxkNwziG-3xAyNx5Rp_xTNv8mWLNGWRmLvw_gjdamPn-0 Oct 04 19:11:11.250799 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 19:11:11.250799 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 19:11:11.250799 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 19:11:11.250799 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 19:11:11.250799 n-d-851028-13 devstack@n-api.service[123595]: X-Openstack-Nova-Api-Version: 2.20 Oct 04 19:11:11.250799 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 19:11:11.250799 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 19:11:11.250799 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: 93413a82cb584df38e5686c1ffbcfefe Oct 04 19:11:11.250799 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1971175812 Oct 04 19:11:11.250799 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 19:11:11.250799 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 19:11:11.250799 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/93413a82cb584df38e5686c1ffbcfefe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_93413a82cb584df38e5686c1ffbcfefe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/93413a82cb584df38e5686c1ffbcfefe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/93413a82cb584df38e5686c1ffbcfefe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 19:11:11.250799 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1971175812 Oct 04 19:11:11.250799 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: 93413a82cb584df38e5686c1ffbcfefe Oct 04 19:11:11.250799 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1971175812 Oct 04 19:11:11.250799 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-AttachVolumeShelveTestJSON-1971175812-project Oct 04 19:11:11.250799 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 19:11:11.250799 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 19:11:11.250799 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: 78f8a576e39b4ef9a7fe0b8a2723e54e Oct 04 19:11:11.250799 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1971175812-project Oct 04 19:11:11.250799 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 19:11:11.250799 n-d-851028-13 devstack@n-api.service[123595]: exception: Instance 95863fa8-413d-4cc5-bbbf-2b044f1bdc89 could not be found. Oct 04 19:11:11.250799 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': '95863fa8-413d-4cc5-bbbf-2b044f1bdc89'} Oct 04 19:11:11.250799 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:11:11.250799 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:11:11.250799 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:11:11.250799 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:11:11.250799 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:11:11.250799 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:11:11.250799 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:11:11.250799 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:11:11.250799 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:11:11.250799 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:11:11.250799 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95863fa8-413d-4cc5-bbbf-2b044f1bdc89 could not be found. Oct 04 19:11:11.250799 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:11:11.250799 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:11:11.250799 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:11:11.250799 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:11:11.250799 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:11:11.250799 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:11:11.250799 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:11:11.250799 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:11:11.250799 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:11:11.250799 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:11:11.250799 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:11:11.250799 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:11:11.250799 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:11:11.250799 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:11:11.250799 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:11:11.250799 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:11:11.250799 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95863fa8-413d-4cc5-bbbf-2b044f1bdc89 could not be found. Oct 04 19:11:11.250799 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:11:11.250799 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:11:11.255091 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:11:11.255091 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:11:11.255091 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:11:11.255091 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:11:11.255091 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:11:11.255091 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:11:11.255091 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95863fa8-413d-4cc5-bbbf-2b044f1bdc89 could not be found. Oct 04 19:11:11.255091 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:11:11.258689 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-b7dfd494-0595-43eb-b5fe-51057f76f8e0 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Returning 404 to user: Instance 95863fa8-413d-4cc5-bbbf-2b044f1bdc89 could not be found. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:11:11.260288 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-b7dfd494-0595-43eb-b5fe-51057f76f8e0 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] 10.222.0.43 "GET /compute/v2.1/servers/95863fa8-413d-4cc5-bbbf-2b044f1bdc89" status: 404 len: 111 microversion: 2.20 time: 0.061322 Oct 04 19:11:11.261667 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3024/6415] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:11:11 2022] GET /compute/v2.1/servers/95863fa8-413d-4cc5-bbbf-2b044f1bdc89 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 19:11:11.270911 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-ed8bbfd7-f051-4e78-819c-293a2337c239 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Calling method '.version_select at 0x7fb21ea9e310>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:11:11.299638 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-ed8bbfd7-f051-4e78-819c-293a2337c239 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-721847814" status: 204 len: 0 microversion: 2.20 time: 0.032860 Oct 04 19:11:11.300745 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3392/6416] 10.222.0.43 () {60 vars in 1259 bytes} [Tue Oct 4 19:11:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-721847814 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 19:11:14.378178 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-6a337cfe-1a96-4f85-9510-e1b14e24d4ed tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:11:14.378739 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-6a337cfe-1a96-4f85-9510-e1b14e24d4ed tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] [instance: 95863fa8-413d-4cc5-bbbf-2b044f1bdc89] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:11:14.386668 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6a337cfe-1a96-4f85-9510-e1b14e24d4ed tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:14.387474 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6a337cfe-1a96-4f85-9510-e1b14e24d4ed tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:14.388232 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6a337cfe-1a96-4f85-9510-e1b14e24d4ed tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:14.389152 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6a337cfe-1a96-4f85-9510-e1b14e24d4ed tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:14.389777 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6a337cfe-1a96-4f85-9510-e1b14e24d4ed tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:14.390374 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6a337cfe-1a96-4f85-9510-e1b14e24d4ed tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:14.414896 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-6a337cfe-1a96-4f85-9510-e1b14e24d4ed tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] HTTP exception thrown: Instance 95863fa8-413d-4cc5-bbbf-2b044f1bdc89 could not be found. Oct 04 19:11:14.417518 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-6a337cfe-1a96-4f85-9510-e1b14e24d4ed tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Request method failure captured: Oct 04 19:11:14.417518 n-d-851028-13 devstack@n-api.service[123595]: request: DELETE /compute/v2.1/servers/95863fa8-413d-4cc5-bbbf-2b044f1bdc89 HTTP/1.1 Oct 04 19:11:14.417518 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 19:11:14.417518 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 19:11:14.417518 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 19:11:14.417518 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 0 Oct 04 19:11:14.417518 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 19:11:14.417518 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 19:11:14.417518 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 19:11:14.417518 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 19:11:14.417518 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPIP4EsHxdrJtfXXftgSjd0DkgWU3RyKaqVrtoobsnxnJ73kFXTCStVuGKNNY5HTtavcBESe4zaZDg6zGQScTV0MQIQ57AmI-VfZnXPvc4tm44tDlywrOX9AzxAjxtSyPTeCxkNwziG-3xAyNx5Rp_xTNv8mWLNGWRmLvw_gjdamPn-0 Oct 04 19:11:14.417518 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 19:11:14.417518 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 19:11:14.417518 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 19:11:14.417518 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 19:11:14.417518 n-d-851028-13 devstack@n-api.service[123595]: X-Openstack-Nova-Api-Version: 2.20 Oct 04 19:11:14.417518 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 19:11:14.417518 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 19:11:14.417518 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: 93413a82cb584df38e5686c1ffbcfefe Oct 04 19:11:14.417518 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1971175812 Oct 04 19:11:14.417518 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 19:11:14.417518 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 19:11:14.417518 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/93413a82cb584df38e5686c1ffbcfefe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_93413a82cb584df38e5686c1ffbcfefe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/93413a82cb584df38e5686c1ffbcfefe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/93413a82cb584df38e5686c1ffbcfefe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 19:11:14.417518 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1971175812 Oct 04 19:11:14.417518 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: 93413a82cb584df38e5686c1ffbcfefe Oct 04 19:11:14.417518 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1971175812 Oct 04 19:11:14.417518 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-AttachVolumeShelveTestJSON-1971175812-project Oct 04 19:11:14.417518 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 19:11:14.417518 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 19:11:14.417518 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: 78f8a576e39b4ef9a7fe0b8a2723e54e Oct 04 19:11:14.417518 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1971175812-project Oct 04 19:11:14.417518 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 19:11:14.417518 n-d-851028-13 devstack@n-api.service[123595]: exception: Instance 95863fa8-413d-4cc5-bbbf-2b044f1bdc89 could not be found. Oct 04 19:11:14.417518 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': '95863fa8-413d-4cc5-bbbf-2b044f1bdc89'} Oct 04 19:11:14.417518 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:11:14.417518 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:11:14.417518 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:11:14.417518 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:11:14.417518 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:11:14.417518 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:11:14.417518 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:11:14.417518 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:11:14.417518 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:11:14.417518 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:11:14.417518 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95863fa8-413d-4cc5-bbbf-2b044f1bdc89 could not be found. Oct 04 19:11:14.417518 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:11:14.417518 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:11:14.417518 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:11:14.417518 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:11:14.417518 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:11:14.417518 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:11:14.417518 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:11:14.417518 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:11:14.417518 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:11:14.417518 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:11:14.417518 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 19:11:14.417518 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 19:11:14.417518 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 19:11:14.417518 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 19:11:14.417518 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:11:14.417518 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:11:14.417518 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:11:14.417518 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:11:14.422182 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95863fa8-413d-4cc5-bbbf-2b044f1bdc89 could not be found. Oct 04 19:11:14.422182 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:11:14.422182 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:11:14.422182 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:11:14.422182 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:11:14.422182 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:11:14.422182 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:11:14.422182 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:11:14.422182 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:11:14.422182 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95863fa8-413d-4cc5-bbbf-2b044f1bdc89 could not be found. Oct 04 19:11:14.422182 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:11:14.424044 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-6a337cfe-1a96-4f85-9510-e1b14e24d4ed tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Returning 404 to user: Instance 95863fa8-413d-4cc5-bbbf-2b044f1bdc89 could not be found. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:11:14.425451 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-6a337cfe-1a96-4f85-9510-e1b14e24d4ed tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] 10.222.0.43 "DELETE /compute/v2.1/servers/95863fa8-413d-4cc5-bbbf-2b044f1bdc89" status: 404 len: 111 microversion: 2.20 time: 0.051521 Oct 04 19:11:14.426673 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3025/6417] 10.222.0.43 () {60 vars in 1280 bytes} [Tue Oct 4 19:11:14 2022] DELETE /compute/v2.1/servers/95863fa8-413d-4cc5-bbbf-2b044f1bdc89 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 19:11:14.436610 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-a44fde4f-7357-4e66-a953-4d1d26701284 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:11:14.437940 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-a44fde4f-7357-4e66-a953-4d1d26701284 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] [instance: 95863fa8-413d-4cc5-bbbf-2b044f1bdc89] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:11:14.445931 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a44fde4f-7357-4e66-a953-4d1d26701284 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:14.446640 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a44fde4f-7357-4e66-a953-4d1d26701284 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:14.447249 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a44fde4f-7357-4e66-a953-4d1d26701284 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:14.448123 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a44fde4f-7357-4e66-a953-4d1d26701284 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:14.448730 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a44fde4f-7357-4e66-a953-4d1d26701284 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:14.449396 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a44fde4f-7357-4e66-a953-4d1d26701284 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:14.466109 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-a44fde4f-7357-4e66-a953-4d1d26701284 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] HTTP exception thrown: Instance 95863fa8-413d-4cc5-bbbf-2b044f1bdc89 could not be found. Oct 04 19:11:14.468140 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-a44fde4f-7357-4e66-a953-4d1d26701284 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Request method failure captured: Oct 04 19:11:14.468140 n-d-851028-13 devstack@n-api.service[123596]: request: GET /compute/v2.1/servers/95863fa8-413d-4cc5-bbbf-2b044f1bdc89 HTTP/1.1 Oct 04 19:11:14.468140 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 19:11:14.468140 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 19:11:14.468140 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 19:11:14.468140 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 19:11:14.468140 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 19:11:14.468140 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 19:11:14.468140 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 19:11:14.468140 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 19:11:14.468140 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPIP4EsHxdrJtfXXftgSjd0DkgWU3RyKaqVrtoobsnxnJ73kFXTCStVuGKNNY5HTtavcBESe4zaZDg6zGQScTV0MQIQ57AmI-VfZnXPvc4tm44tDlywrOX9AzxAjxtSyPTeCxkNwziG-3xAyNx5Rp_xTNv8mWLNGWRmLvw_gjdamPn-0 Oct 04 19:11:14.468140 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 19:11:14.468140 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 19:11:14.468140 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 19:11:14.468140 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 19:11:14.468140 n-d-851028-13 devstack@n-api.service[123596]: X-Openstack-Nova-Api-Version: 2.20 Oct 04 19:11:14.468140 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 19:11:14.468140 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 19:11:14.468140 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: 93413a82cb584df38e5686c1ffbcfefe Oct 04 19:11:14.468140 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1971175812 Oct 04 19:11:14.468140 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 19:11:14.468140 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 19:11:14.468140 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/93413a82cb584df38e5686c1ffbcfefe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_93413a82cb584df38e5686c1ffbcfefe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/93413a82cb584df38e5686c1ffbcfefe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/93413a82cb584df38e5686c1ffbcfefe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 19:11:14.468140 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1971175812 Oct 04 19:11:14.468140 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: 93413a82cb584df38e5686c1ffbcfefe Oct 04 19:11:14.468140 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1971175812 Oct 04 19:11:14.468140 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-AttachVolumeShelveTestJSON-1971175812-project Oct 04 19:11:14.468140 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 19:11:14.468140 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 19:11:14.468140 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 78f8a576e39b4ef9a7fe0b8a2723e54e Oct 04 19:11:14.468140 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1971175812-project Oct 04 19:11:14.468140 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 19:11:14.468140 n-d-851028-13 devstack@n-api.service[123596]: exception: Instance 95863fa8-413d-4cc5-bbbf-2b044f1bdc89 could not be found. Oct 04 19:11:14.468140 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': '95863fa8-413d-4cc5-bbbf-2b044f1bdc89'} Oct 04 19:11:14.468140 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:11:14.468140 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:11:14.468140 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:11:14.468140 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:11:14.468140 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:11:14.468140 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:11:14.468140 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:11:14.468140 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:11:14.468140 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:11:14.468140 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:11:14.468140 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95863fa8-413d-4cc5-bbbf-2b044f1bdc89 could not be found. Oct 04 19:11:14.468140 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:11:14.468140 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:11:14.468140 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:11:14.468140 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:11:14.468140 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:11:14.468140 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:11:14.468140 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:11:14.468140 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:11:14.468140 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:11:14.468140 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:11:14.468140 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:11:14.468140 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:11:14.468140 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:11:14.468140 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:11:14.468140 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:11:14.468140 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:11:14.468140 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95863fa8-413d-4cc5-bbbf-2b044f1bdc89 could not be found. Oct 04 19:11:14.468140 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:11:14.468140 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:11:14.472692 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:11:14.472692 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:11:14.472692 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:11:14.472692 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:11:14.472692 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:11:14.472692 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:11:14.472692 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95863fa8-413d-4cc5-bbbf-2b044f1bdc89 could not be found. Oct 04 19:11:14.472692 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:11:14.474116 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-a44fde4f-7357-4e66-a953-4d1d26701284 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Returning 404 to user: Instance 95863fa8-413d-4cc5-bbbf-2b044f1bdc89 could not be found. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:11:14.475465 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-a44fde4f-7357-4e66-a953-4d1d26701284 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] 10.222.0.43 "GET /compute/v2.1/servers/95863fa8-413d-4cc5-bbbf-2b044f1bdc89" status: 404 len: 111 microversion: 2.20 time: 0.044643 Oct 04 19:11:14.476039 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3393/6418] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:11:14 2022] GET /compute/v2.1/servers/95863fa8-413d-4cc5-bbbf-2b044f1bdc89 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 04 19:11:17.818792 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-af9bc311-2590-451e-9f91-de43757996a9 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:11:17.819326 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-af9bc311-2590-451e-9f91-de43757996a9 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] [instance: 101952eb-ca4d-489c-8cb5-3bfadf241aa3] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:11:17.835303 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-af9bc311-2590-451e-9f91-de43757996a9 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:17.835934 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-af9bc311-2590-451e-9f91-de43757996a9 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:17.836452 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-af9bc311-2590-451e-9f91-de43757996a9 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:17.837257 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-af9bc311-2590-451e-9f91-de43757996a9 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:17.837785 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-af9bc311-2590-451e-9f91-de43757996a9 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:17.838282 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-af9bc311-2590-451e-9f91-de43757996a9 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:17.871310 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-af9bc311-2590-451e-9f91-de43757996a9 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] HTTP exception thrown: Instance 101952eb-ca4d-489c-8cb5-3bfadf241aa3 could not be found. Oct 04 19:11:17.872993 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-af9bc311-2590-451e-9f91-de43757996a9 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Request method failure captured: Oct 04 19:11:17.872993 n-d-851028-13 devstack@n-api.service[123595]: request: DELETE /compute/v2.1/servers/101952eb-ca4d-489c-8cb5-3bfadf241aa3 HTTP/1.1 Oct 04 19:11:17.872993 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 19:11:17.872993 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 19:11:17.872993 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 19:11:17.872993 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 0 Oct 04 19:11:17.872993 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 19:11:17.872993 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 19:11:17.872993 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 19:11:17.872993 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 19:11:17.872993 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPIP4EsHxdrJtfXXftgSjd0DkgWU3RyKaqVrtoobsnxnJ73kFXTCStVuGKNNY5HTtavcBESe4zaZDg6zGQScTV0MQIQ57AmI-VfZnXPvc4tm44tDlywrOX9AzxAjxtSyPTeCxkNwziG-3xAyNx5Rp_xTNv8mWLNGWRmLvw_gjdamPn-0 Oct 04 19:11:17.872993 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 19:11:17.872993 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 19:11:17.872993 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 19:11:17.872993 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 19:11:17.872993 n-d-851028-13 devstack@n-api.service[123595]: X-Openstack-Nova-Api-Version: 2.20 Oct 04 19:11:17.872993 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 19:11:17.872993 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 19:11:17.872993 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: 93413a82cb584df38e5686c1ffbcfefe Oct 04 19:11:17.872993 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1971175812 Oct 04 19:11:17.872993 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 19:11:17.872993 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 19:11:17.872993 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/93413a82cb584df38e5686c1ffbcfefe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_93413a82cb584df38e5686c1ffbcfefe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/93413a82cb584df38e5686c1ffbcfefe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/93413a82cb584df38e5686c1ffbcfefe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 19:11:17.872993 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1971175812 Oct 04 19:11:17.872993 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: 93413a82cb584df38e5686c1ffbcfefe Oct 04 19:11:17.872993 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1971175812 Oct 04 19:11:17.872993 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-AttachVolumeShelveTestJSON-1971175812-project Oct 04 19:11:17.872993 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 19:11:17.872993 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 19:11:17.872993 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: 78f8a576e39b4ef9a7fe0b8a2723e54e Oct 04 19:11:17.872993 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1971175812-project Oct 04 19:11:17.872993 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 19:11:17.872993 n-d-851028-13 devstack@n-api.service[123595]: exception: Instance 101952eb-ca4d-489c-8cb5-3bfadf241aa3 could not be found. Oct 04 19:11:17.872993 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': '101952eb-ca4d-489c-8cb5-3bfadf241aa3'} Oct 04 19:11:17.872993 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:11:17.872993 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:11:17.872993 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:11:17.872993 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:11:17.872993 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:11:17.872993 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:11:17.872993 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:11:17.872993 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:11:17.872993 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:11:17.872993 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:11:17.872993 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 101952eb-ca4d-489c-8cb5-3bfadf241aa3 could not be found. Oct 04 19:11:17.872993 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:11:17.872993 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:11:17.872993 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:11:17.872993 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:11:17.872993 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:11:17.872993 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:11:17.872993 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:11:17.872993 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:11:17.872993 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:11:17.872993 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:11:17.872993 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 19:11:17.872993 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 19:11:17.872993 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 19:11:17.872993 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 19:11:17.872993 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:11:17.872993 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:11:17.872993 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:11:17.872993 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:11:17.876914 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 101952eb-ca4d-489c-8cb5-3bfadf241aa3 could not be found. Oct 04 19:11:17.876914 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:11:17.876914 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:11:17.876914 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:11:17.876914 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:11:17.876914 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:11:17.876914 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:11:17.876914 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:11:17.876914 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:11:17.876914 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 101952eb-ca4d-489c-8cb5-3bfadf241aa3 could not be found. Oct 04 19:11:17.876914 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:11:17.876914 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-af9bc311-2590-451e-9f91-de43757996a9 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Returning 404 to user: Instance 101952eb-ca4d-489c-8cb5-3bfadf241aa3 could not be found. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:11:17.876914 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-af9bc311-2590-451e-9f91-de43757996a9 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] 10.222.0.43 "DELETE /compute/v2.1/servers/101952eb-ca4d-489c-8cb5-3bfadf241aa3" status: 404 len: 111 microversion: 2.20 time: 0.059678 Oct 04 19:11:17.876914 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3026/6419] 10.222.0.43 () {60 vars in 1280 bytes} [Tue Oct 4 19:11:17 2022] DELETE /compute/v2.1/servers/101952eb-ca4d-489c-8cb5-3bfadf241aa3 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 19:11:17.885474 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f12cb04d-48f0-4b1d-8f47-4af6ef957757 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:11:17.886088 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-f12cb04d-48f0-4b1d-8f47-4af6ef957757 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] [instance: 101952eb-ca4d-489c-8cb5-3bfadf241aa3] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:11:17.901328 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f12cb04d-48f0-4b1d-8f47-4af6ef957757 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:17.902005 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f12cb04d-48f0-4b1d-8f47-4af6ef957757 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:17.902462 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f12cb04d-48f0-4b1d-8f47-4af6ef957757 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:17.903193 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f12cb04d-48f0-4b1d-8f47-4af6ef957757 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:17.905770 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f12cb04d-48f0-4b1d-8f47-4af6ef957757 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:17.906231 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f12cb04d-48f0-4b1d-8f47-4af6ef957757 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:17.934586 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-f12cb04d-48f0-4b1d-8f47-4af6ef957757 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] HTTP exception thrown: Instance 101952eb-ca4d-489c-8cb5-3bfadf241aa3 could not be found. Oct 04 19:11:17.936951 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f12cb04d-48f0-4b1d-8f47-4af6ef957757 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Request method failure captured: Oct 04 19:11:17.936951 n-d-851028-13 devstack@n-api.service[123596]: request: GET /compute/v2.1/servers/101952eb-ca4d-489c-8cb5-3bfadf241aa3 HTTP/1.1 Oct 04 19:11:17.936951 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 19:11:17.936951 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 19:11:17.936951 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 19:11:17.936951 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 19:11:17.936951 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 19:11:17.936951 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 19:11:17.936951 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 19:11:17.936951 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 19:11:17.936951 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPIP4EsHxdrJtfXXftgSjd0DkgWU3RyKaqVrtoobsnxnJ73kFXTCStVuGKNNY5HTtavcBESe4zaZDg6zGQScTV0MQIQ57AmI-VfZnXPvc4tm44tDlywrOX9AzxAjxtSyPTeCxkNwziG-3xAyNx5Rp_xTNv8mWLNGWRmLvw_gjdamPn-0 Oct 04 19:11:17.936951 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 19:11:17.936951 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 19:11:17.936951 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 19:11:17.936951 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 19:11:17.936951 n-d-851028-13 devstack@n-api.service[123596]: X-Openstack-Nova-Api-Version: 2.20 Oct 04 19:11:17.936951 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 19:11:17.936951 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 19:11:17.936951 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: 93413a82cb584df38e5686c1ffbcfefe Oct 04 19:11:17.936951 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1971175812 Oct 04 19:11:17.936951 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 19:11:17.936951 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 19:11:17.936951 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/93413a82cb584df38e5686c1ffbcfefe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_93413a82cb584df38e5686c1ffbcfefe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/93413a82cb584df38e5686c1ffbcfefe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/93413a82cb584df38e5686c1ffbcfefe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 19:11:17.936951 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1971175812 Oct 04 19:11:17.936951 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: 93413a82cb584df38e5686c1ffbcfefe Oct 04 19:11:17.936951 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1971175812 Oct 04 19:11:17.936951 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-AttachVolumeShelveTestJSON-1971175812-project Oct 04 19:11:17.936951 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 19:11:17.936951 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 19:11:17.936951 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 78f8a576e39b4ef9a7fe0b8a2723e54e Oct 04 19:11:17.936951 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1971175812-project Oct 04 19:11:17.936951 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 19:11:17.936951 n-d-851028-13 devstack@n-api.service[123596]: exception: Instance 101952eb-ca4d-489c-8cb5-3bfadf241aa3 could not be found. Oct 04 19:11:17.936951 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': '101952eb-ca4d-489c-8cb5-3bfadf241aa3'} Oct 04 19:11:17.936951 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:11:17.936951 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:11:17.936951 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:11:17.936951 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:11:17.936951 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:11:17.936951 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:11:17.936951 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:11:17.936951 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:11:17.936951 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:11:17.936951 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:11:17.936951 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 101952eb-ca4d-489c-8cb5-3bfadf241aa3 could not be found. Oct 04 19:11:17.936951 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:11:17.936951 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:11:17.936951 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:11:17.936951 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:11:17.936951 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:11:17.936951 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:11:17.936951 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:11:17.936951 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:11:17.936951 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:11:17.936951 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:11:17.936951 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:11:17.936951 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:11:17.936951 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:11:17.936951 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:11:17.936951 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:11:17.936951 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:11:17.936951 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 101952eb-ca4d-489c-8cb5-3bfadf241aa3 could not be found. Oct 04 19:11:17.936951 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:11:17.936951 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:11:17.941669 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:11:17.941669 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:11:17.941669 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:11:17.941669 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:11:17.941669 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:11:17.941669 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:11:17.941669 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 101952eb-ca4d-489c-8cb5-3bfadf241aa3 could not be found. Oct 04 19:11:17.941669 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:11:17.944236 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f12cb04d-48f0-4b1d-8f47-4af6ef957757 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] Returning 404 to user: Instance 101952eb-ca4d-489c-8cb5-3bfadf241aa3 could not be found. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:11:17.946752 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-f12cb04d-48f0-4b1d-8f47-4af6ef957757 tempest-AttachVolumeShelveTestJSON-1971175812 tempest-AttachVolumeShelveTestJSON-1971175812-project] 10.222.0.43 "GET /compute/v2.1/servers/101952eb-ca4d-489c-8cb5-3bfadf241aa3" status: 404 len: 111 microversion: 2.20 time: 0.067200 Oct 04 19:11:17.954840 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3394/6420] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 19:11:17 2022] GET /compute/v2.1/servers/101952eb-ca4d-489c-8cb5-3bfadf241aa3 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 19:11:20.863635 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-aa703430-da2f-45d6-97ec-3a322d72dc24 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "06328b38-d8a4-4f93-a3e7-645d08264fd1", "device": "/dev/sdb"}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:11:20.868314 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-aa703430-da2f-45d6-97ec-3a322d72dc24 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] [instance: 05904eb8-6786-4d08-bb1c-03d36d74e3a7] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:11:20.871189 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=3 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:11:20.878036 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-aa703430-da2f-45d6-97ec-3a322d72dc24 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:20.878856 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-aa703430-da2f-45d6-97ec-3a322d72dc24 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:20.881896 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-aa703430-da2f-45d6-97ec-3a322d72dc24 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:20.882943 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-aa703430-da2f-45d6-97ec-3a322d72dc24 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:20.883587 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-aa703430-da2f-45d6-97ec-3a322d72dc24 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:20.884239 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-aa703430-da2f-45d6-97ec-3a322d72dc24 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:20.892029 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=55 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:11:21.380992 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-aa703430-da2f-45d6-97ec-3a322d72dc24 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] 10.222.0.43 "POST /compute/v2.1/servers/05904eb8-6786-4d08-bb1c-03d36d74e3a7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.521558 Oct 04 19:11:21.383198 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3027/6421] 10.222.0.43 () {60 vars in 1323 bytes} [Tue Oct 4 19:11:20 2022] POST /compute/v2.1/servers/05904eb8-6786-4d08-bb1c-03d36d74e3a7/os-volume_attachments => generated 194 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:11:23.750035 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-cb1eace9-9255-4184-94e1-e03f30efa2ac tempest-VolumesGetTestJSON-270811249 tempest-VolumesGetTestJSON-270811249-project] Action: 'create', calling method: .version_select at 0x7fb21edc5f70>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-465338127", "metadata": {"Type": "work"}}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:11:24.290159 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-cb1eace9-9255-4184-94e1-e03f30efa2ac tempest-VolumesGetTestJSON-270811249 tempest-VolumesGetTestJSON-270811249-project] 10.222.0.43 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.684820 Oct 04 19:11:24.291008 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3395/6422] 10.222.0.43 () {60 vars in 1156 bytes} [Tue Oct 4 19:11:23 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 686 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 04 19:11:24.306236 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-f3840a68-2680-4940-bfe1-4f8ca7142576 tempest-VolumesGetTestJSON-270811249 tempest-VolumesGetTestJSON-270811249-project] Calling method '.version_select at 0x7fb21e9d1b80>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:11:24.374396 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-f3840a68-2680-4940-bfe1-4f8ca7142576 tempest-VolumesGetTestJSON-270811249 tempest-VolumesGetTestJSON-270811249-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/999fa353-d096-4db1-95b7-d567b082fd80" status: 200 len: 352 microversion: 2.1 time: 0.073281 Oct 04 19:11:24.375195 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3028/6423] 10.222.0.43 () {58 vars in 1245 bytes} [Tue Oct 4 19:11:24 2022] GET /compute/v2.1/os-volumes/999fa353-d096-4db1-95b7-d567b082fd80 => generated 352 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:11:25.390406 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-9a6a25cc-c3c8-4e0f-aa44-86b43e15ef54 tempest-VolumesGetTestJSON-270811249 tempest-VolumesGetTestJSON-270811249-project] Calling method '.version_select at 0x7fb21e73bc10>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:11:25.449502 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-9a6a25cc-c3c8-4e0f-aa44-86b43e15ef54 tempest-VolumesGetTestJSON-270811249 tempest-VolumesGetTestJSON-270811249-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/999fa353-d096-4db1-95b7-d567b082fd80" status: 200 len: 353 microversion: 2.1 time: 0.062935 Oct 04 19:11:25.450182 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3396/6424] 10.222.0.43 () {58 vars in 1245 bytes} [Tue Oct 4 19:11:25 2022] GET /compute/v2.1/os-volumes/999fa353-d096-4db1-95b7-d567b082fd80 => generated 353 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:11:25.464746 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-1f591759-1d04-416f-8e7a-54d5ff8a7f9a tempest-VolumesGetTestJSON-270811249 tempest-VolumesGetTestJSON-270811249-project] Calling method '.version_select at 0x7fb21eb4f5e0>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:11:25.538436 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-1f591759-1d04-416f-8e7a-54d5ff8a7f9a tempest-VolumesGetTestJSON-270811249 tempest-VolumesGetTestJSON-270811249-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/999fa353-d096-4db1-95b7-d567b082fd80" status: 200 len: 353 microversion: 2.1 time: 0.078676 Oct 04 19:11:25.539211 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3029/6425] 10.222.0.43 () {58 vars in 1245 bytes} [Tue Oct 4 19:11:25 2022] GET /compute/v2.1/os-volumes/999fa353-d096-4db1-95b7-d567b082fd80 => generated 353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:11:25.552528 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-ee0b71d4-100a-4cdf-b6fc-3c4f4af9ca2b tempest-VolumesGetTestJSON-270811249 tempest-VolumesGetTestJSON-270811249-project] Calling method '.version_select at 0x7fb21e66d310>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:11:25.622619 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-ee0b71d4-100a-4cdf-b6fc-3c4f4af9ca2b tempest-VolumesGetTestJSON-270811249 tempest-VolumesGetTestJSON-270811249-project] 10.222.0.43 "DELETE /compute/v2.1/os-volumes/999fa353-d096-4db1-95b7-d567b082fd80" status: 202 len: 0 microversion: 2.1 time: 0.073813 Oct 04 19:11:25.624999 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3397/6426] 10.222.0.43 () {58 vars in 1248 bytes} [Tue Oct 4 19:11:25 2022] DELETE /compute/v2.1/os-volumes/999fa353-d096-4db1-95b7-d567b082fd80 => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:11:25.635197 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-0f564639-2f18-48ae-b34e-cd2f4f387479 tempest-VolumesGetTestJSON-270811249 tempest-VolumesGetTestJSON-270811249-project] Calling method '.version_select at 0x7fb21ec755e0>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:11:25.720400 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-0f564639-2f18-48ae-b34e-cd2f4f387479 tempest-VolumesGetTestJSON-270811249 tempest-VolumesGetTestJSON-270811249-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/999fa353-d096-4db1-95b7-d567b082fd80" status: 200 len: 352 microversion: 2.1 time: 0.091162 Oct 04 19:11:25.722450 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3030/6427] 10.222.0.43 () {58 vars in 1245 bytes} [Tue Oct 4 19:11:25 2022] GET /compute/v2.1/os-volumes/999fa353-d096-4db1-95b7-d567b082fd80 => generated 352 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:11:26.735997 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-bf9c988d-5689-42bd-a1c6-f843f69d67a3 tempest-VolumesGetTestJSON-270811249 tempest-VolumesGetTestJSON-270811249-project] Calling method '.version_select at 0x7fb21e66dd30>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:11:26.810697 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-bf9c988d-5689-42bd-a1c6-f843f69d67a3 tempest-VolumesGetTestJSON-270811249 tempest-VolumesGetTestJSON-270811249-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/999fa353-d096-4db1-95b7-d567b082fd80" status: 200 len: 352 microversion: 2.1 time: 0.078473 Oct 04 19:11:26.818489 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3398/6428] 10.222.0.43 () {58 vars in 1245 bytes} [Tue Oct 4 19:11:26 2022] GET /compute/v2.1/os-volumes/999fa353-d096-4db1-95b7-d567b082fd80 => generated 352 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:11:27.836520 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-15a3e858-7050-44a4-8545-65797caf75b5 tempest-VolumesGetTestJSON-270811249 tempest-VolumesGetTestJSON-270811249-project] Calling method '.version_select at 0x7fb21eab29d0>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:11:27.871686 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-15a3e858-7050-44a4-8545-65797caf75b5 tempest-VolumesGetTestJSON-270811249 tempest-VolumesGetTestJSON-270811249-project] HTTP exception thrown: Volume 999fa353-d096-4db1-95b7-d567b082fd80 could not be found. Oct 04 19:11:27.888244 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-15a3e858-7050-44a4-8545-65797caf75b5 tempest-VolumesGetTestJSON-270811249 tempest-VolumesGetTestJSON-270811249-project] Request method failure captured: Oct 04 19:11:27.888244 n-d-851028-13 devstack@n-api.service[123595]: request: GET /compute/v2.1/os-volumes/999fa353-d096-4db1-95b7-d567b082fd80 HTTP/1.1 Oct 04 19:11:27.888244 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 19:11:27.888244 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 19:11:27.888244 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 19:11:27.888244 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 0 Oct 04 19:11:27.888244 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 19:11:27.888244 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 19:11:27.888244 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 19:11:27.888244 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 19:11:27.888244 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPIVbYzFsBEqRtq6dxRM8W3CBRi1So09D1_ErAIynjfBg3Z040HmM_XAOnq89t9DA5wO3d4JURh_Rhv-4lO09DURr-Yp0-B4E_eg7E3JIGeLW3xf1-tXY4Yw6cH-lPSgZ4YUP-l1diEpfy5voSaqx9mxuWFlCKPzHqYUk7nDXgRH0qj4 Oct 04 19:11:27.888244 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 19:11:27.888244 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 19:11:27.888244 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 19:11:27.888244 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 19:11:27.888244 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 19:11:27.888244 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 19:11:27.888244 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: 52ab02c6af9e4dada4b2278740a8f626 Oct 04 19:11:27.888244 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-VolumesGetTestJSON-270811249 Oct 04 19:11:27.888244 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 19:11:27.888244 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 19:11:27.888244 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/52ab02c6af9e4dada4b2278740a8f626"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_52ab02c6af9e4dada4b2278740a8f626"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/52ab02c6af9e4dada4b2278740a8f626"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/52ab02c6af9e4dada4b2278740a8f626"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 19:11:27.888244 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-VolumesGetTestJSON-270811249 Oct 04 19:11:27.888244 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: 52ab02c6af9e4dada4b2278740a8f626 Oct 04 19:11:27.888244 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-VolumesGetTestJSON-270811249 Oct 04 19:11:27.888244 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-VolumesGetTestJSON-270811249-project Oct 04 19:11:27.888244 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 19:11:27.888244 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 19:11:27.888244 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: 350c5fa52c6546c0bb6ede9084ce4bb2 Oct 04 19:11:27.888244 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-VolumesGetTestJSON-270811249-project Oct 04 19:11:27.888244 n-d-851028-13 devstack@n-api.service[123595]: method: Oct 04 19:11:27.888244 n-d-851028-13 devstack@n-api.service[123595]: exception: Volume 999fa353-d096-4db1-95b7-d567b082fd80 could not be found. Oct 04 19:11:27.888244 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': '999fa353-d096-4db1-95b7-d567b082fd80'} Oct 04 19:11:27.888244 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:11:27.888244 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:11:27.888244 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 19:11:27.888244 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 19:11:27.888244 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 19:11:27.888244 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 19:11:27.888244 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 19:11:27.888244 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 19:11:27.888244 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 19:11:27.888244 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 19:11:27.888244 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 19:11:27.888244 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 19:11:27.888244 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 19:11:27.888244 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 19:11:27.888244 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 19:11:27.888244 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 19:11:27.888244 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 999fa353-d096-4db1-95b7-d567b082fd80 could not be found. (HTTP 404) (Request-ID: req-e52aed62-2de2-4398-b509-3698a9248a76) Oct 04 19:11:27.888244 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:11:27.888244 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:11:27.888244 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:11:27.888244 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:11:27.888244 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 04 19:11:27.888244 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 04 19:11:27.888244 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 04 19:11:27.888244 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 04 19:11:27.888244 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 04 19:11:27.888244 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 04 19:11:27.888244 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 04 19:11:27.888244 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 04 19:11:27.888244 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 19:11:27.895265 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 19:11:27.895265 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 19:11:27.895265 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 19:11:27.895265 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 19:11:27.895265 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 19:11:27.895265 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 19:11:27.895265 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 19:11:27.895265 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 19:11:27.895265 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 19:11:27.895265 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 19:11:27.895265 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 19:11:27.895265 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 19:11:27.895265 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 19:11:27.895265 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 999fa353-d096-4db1-95b7-d567b082fd80 could not be found. Oct 04 19:11:27.895265 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:11:27.895265 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:11:27.895265 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:11:27.895265 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:11:27.895265 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:11:27.895265 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:11:27.895265 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:11:27.895265 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:11:27.895265 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 19:11:27.895265 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 19:11:27.895265 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:11:27.895265 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:11:27.895265 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 04 19:11:27.895265 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:11:27.895265 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 999fa353-d096-4db1-95b7-d567b082fd80 could not be found. Oct 04 19:11:27.895265 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:11:27.895265 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:11:27.895265 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:11:27.895265 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:11:27.895265 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:11:27.895265 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:11:27.895265 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:11:27.895265 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:11:27.895265 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 999fa353-d096-4db1-95b7-d567b082fd80 could not be found. Oct 04 19:11:27.895265 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:11:27.895265 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-15a3e858-7050-44a4-8545-65797caf75b5 tempest-VolumesGetTestJSON-270811249 tempest-VolumesGetTestJSON-270811249-project] Returning 404 to user: Volume 999fa353-d096-4db1-95b7-d567b082fd80 could not be found. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:11:27.895265 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-15a3e858-7050-44a4-8545-65797caf75b5 tempest-VolumesGetTestJSON-270811249 tempest-VolumesGetTestJSON-270811249-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/999fa353-d096-4db1-95b7-d567b082fd80" status: 404 len: 109 microversion: 2.1 time: 0.057570 Oct 04 19:11:27.895265 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3031/6429] 10.222.0.43 () {58 vars in 1245 bytes} [Tue Oct 4 19:11:27 2022] GET /compute/v2.1/os-volumes/999fa353-d096-4db1-95b7-d567b082fd80 => generated 109 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 19:11:29.565584 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:11:29.566654 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:11:29.818964 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-3cfb25ff-54d5-40c6-9973-99f91c621aa5 tempest-VolumesNegativeTest-354879835 tempest-VolumesNegativeTest-354879835-project] Action: 'create', calling method: .version_select at 0x7fb21e64eb80>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1809787165", "metadata": {"Type": "work"}}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:11:29.823364 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-3cfb25ff-54d5-40c6-9973-99f91c621aa5 tempest-VolumesNegativeTest-354879835 tempest-VolumesNegativeTest-354879835-project] Request method failure captured: Oct 04 19:11:29.823364 n-d-851028-13 devstack@n-api.service[123596]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 04 19:11:29.823364 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 19:11:29.823364 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 19:11:29.823364 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 19:11:29.823364 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 122 Oct 04 19:11:29.823364 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 19:11:29.823364 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 19:11:29.823364 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 19:11:29.823364 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 19:11:29.823364 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPIVhaMD6yzyn9iVfMi9t8HOvtzPQLnUTHlQXvN4zmzDv-_vxykNaQhlOjdD52WoMbgKfOBjC3YXAtoDeT21By0wYpHQIszYDINGXCvb6LtJ1TdBHbI9dROYIIl-T_h8B8Aq03DblwFUeA8cmXIatMJZoCDJ1XMmWcy4CnJSkayvFJxU Oct 04 19:11:29.823364 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 19:11:29.823364 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 19:11:29.823364 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 19:11:29.823364 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 19:11:29.823364 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 19:11:29.823364 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 19:11:29.823364 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: b2b003c5250643aaad748a542cbcc32b Oct 04 19:11:29.823364 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-VolumesNegativeTest-354879835 Oct 04 19:11:29.823364 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 19:11:29.823364 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 19:11:29.823364 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/b2b003c5250643aaad748a542cbcc32b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_b2b003c5250643aaad748a542cbcc32b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b2b003c5250643aaad748a542cbcc32b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b2b003c5250643aaad748a542cbcc32b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 19:11:29.823364 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-VolumesNegativeTest-354879835 Oct 04 19:11:29.823364 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: b2b003c5250643aaad748a542cbcc32b Oct 04 19:11:29.823364 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-VolumesNegativeTest-354879835 Oct 04 19:11:29.823364 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-VolumesNegativeTest-354879835-project Oct 04 19:11:29.823364 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 19:11:29.823364 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 19:11:29.823364 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 73769b89addf407ab95587c0f428ae47 Oct 04 19:11:29.823364 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-VolumesNegativeTest-354879835-project Oct 04 19:11:29.823364 n-d-851028-13 devstack@n-api.service[123596]: Oct 04 19:11:29.823364 n-d-851028-13 devstack@n-api.service[123596]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1809787165", "metadata": {"Type": "work"}}} Oct 04 19:11:29.823364 n-d-851028-13 devstack@n-api.service[123596]: method: Oct 04 19:11:29.823364 n-d-851028-13 devstack@n-api.service[123596]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 04 19:11:29.823364 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1809787165', 'metadata': {'Type': 'work'}}}} Oct 04 19:11:29.823364 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:11:29.823364 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:11:29.823364 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 19:11:29.823364 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 19:11:29.823364 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 19:11:29.823364 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise error Oct 04 19:11:29.823364 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Oct 04 19:11:29.823364 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:11:29.823364 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 04 19:11:29.823364 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 04 19:11:29.823364 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:11:29.823364 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 04 19:11:29.823364 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi '#$%' Oct 04 19:11:29.823364 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:11:29.823364 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:11:29.823364 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:11:29.823364 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:11:29.823364 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:11:29.823364 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:11:29.823364 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:11:29.823364 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:11:29.823364 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 19:11:29.823364 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 19:11:29.823364 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:11:29.823364 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:11:29.823364 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 19:11:29.823364 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 19:11:29.823364 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 19:11:29.823364 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 19:11:29.823364 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 19:11:29.823364 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 19:11:29.828193 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 04 19:11:29.828193 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:11:29.828193 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:11:29.828193 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:11:29.828193 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:11:29.828193 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:11:29.828193 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:11:29.828193 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 19:11:29.828193 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 19:11:29.828193 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 04 19:11:29.828193 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:11:29.828193 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-3cfb25ff-54d5-40c6-9973-99f91c621aa5 tempest-VolumesNegativeTest-354879835 tempest-VolumesNegativeTest-354879835-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:11:29.828193 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-3cfb25ff-54d5-40c6-9973-99f91c621aa5 tempest-VolumesNegativeTest-354879835 tempest-VolumesNegativeTest-354879835-project] 10.222.0.43 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.261728 Oct 04 19:11:29.828193 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3399/6430] 10.222.0.43 () {60 vars in 1156 bytes} [Tue Oct 4 19:11:29 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 263 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 19:11:29.836137 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-a2d89733-6505-4314-b743-c4af082b6b01 tempest-VolumesNegativeTest-354879835 tempest-VolumesNegativeTest-354879835-project] Action: 'create', calling method: .version_select at 0x7fb21ec75ca0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2132519136", "metadata": {"Type": "work"}}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:11:29.841082 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-a2d89733-6505-4314-b743-c4af082b6b01 tempest-VolumesNegativeTest-354879835 tempest-VolumesNegativeTest-354879835-project] Request method failure captured: Oct 04 19:11:29.841082 n-d-851028-13 devstack@n-api.service[123595]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 04 19:11:29.841082 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 19:11:29.841082 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 19:11:29.841082 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 19:11:29.841082 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 120 Oct 04 19:11:29.841082 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 19:11:29.841082 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 19:11:29.841082 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 19:11:29.841082 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 19:11:29.841082 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPIVhaMD6yzyn9iVfMi9t8HOvtzPQLnUTHlQXvN4zmzDv-_vxykNaQhlOjdD52WoMbgKfOBjC3YXAtoDeT21By0wYpHQIszYDINGXCvb6LtJ1TdBHbI9dROYIIl-T_h8B8Aq03DblwFUeA8cmXIatMJZoCDJ1XMmWcy4CnJSkayvFJxU Oct 04 19:11:29.841082 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 19:11:29.841082 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 19:11:29.841082 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 19:11:29.841082 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 19:11:29.841082 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 19:11:29.841082 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 19:11:29.841082 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: b2b003c5250643aaad748a542cbcc32b Oct 04 19:11:29.841082 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-VolumesNegativeTest-354879835 Oct 04 19:11:29.841082 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 19:11:29.841082 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 19:11:29.841082 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/b2b003c5250643aaad748a542cbcc32b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_b2b003c5250643aaad748a542cbcc32b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b2b003c5250643aaad748a542cbcc32b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b2b003c5250643aaad748a542cbcc32b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 19:11:29.841082 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-VolumesNegativeTest-354879835 Oct 04 19:11:29.841082 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: b2b003c5250643aaad748a542cbcc32b Oct 04 19:11:29.841082 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-VolumesNegativeTest-354879835 Oct 04 19:11:29.841082 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-VolumesNegativeTest-354879835-project Oct 04 19:11:29.841082 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 19:11:29.841082 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 19:11:29.841082 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: 73769b89addf407ab95587c0f428ae47 Oct 04 19:11:29.841082 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-VolumesNegativeTest-354879835-project Oct 04 19:11:29.841082 n-d-851028-13 devstack@n-api.service[123595]: Oct 04 19:11:29.841082 n-d-851028-13 devstack@n-api.service[123595]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2132519136", "metadata": {"Type": "work"}}} Oct 04 19:11:29.841082 n-d-851028-13 devstack@n-api.service[123595]: method: Oct 04 19:11:29.841082 n-d-851028-13 devstack@n-api.service[123595]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 04 19:11:29.841082 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-2132519136', 'metadata': {'Type': 'work'}}}} Oct 04 19:11:29.841082 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:11:29.841082 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:11:29.841082 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 19:11:29.841082 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 19:11:29.841082 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 19:11:29.841082 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise error Oct 04 19:11:29.841082 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 04 19:11:29.841082 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:11:29.841082 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Oct 04 19:11:29.841082 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 04 19:11:29.841082 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:11:29.841082 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 04 19:11:29.841082 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi '0' Oct 04 19:11:29.841082 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:11:29.841082 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:11:29.841082 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:11:29.841082 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:11:29.841082 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:11:29.841082 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:11:29.841082 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:11:29.841082 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:11:29.841082 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 19:11:29.841082 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 19:11:29.841082 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:11:29.841082 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:11:29.841082 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 19:11:29.841082 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 19:11:29.841082 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 19:11:29.841082 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 19:11:29.841082 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 19:11:29.841082 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 19:11:29.845606 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 04 19:11:29.845606 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:11:29.845606 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:11:29.845606 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:11:29.845606 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:11:29.845606 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:11:29.845606 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:11:29.845606 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 19:11:29.845606 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 19:11:29.845606 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 04 19:11:29.845606 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:11:29.845606 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-a2d89733-6505-4314-b743-c4af082b6b01 tempest-VolumesNegativeTest-354879835 tempest-VolumesNegativeTest-354879835-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:11:29.845606 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-a2d89733-6505-4314-b743-c4af082b6b01 tempest-VolumesNegativeTest-354879835 tempest-VolumesNegativeTest-354879835-project] 10.222.0.43 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.012037 Oct 04 19:11:29.845606 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3032/6431] 10.222.0.43 () {60 vars in 1156 bytes} [Tue Oct 4 19:11:29 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 19:11:29.853142 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-fc9deb7f-c063-4fac-ac76-4b0f99fdf63d tempest-VolumesNegativeTest-354879835 tempest-VolumesNegativeTest-354879835-project] Action: 'create', calling method: .version_select at 0x7fb21e616c10>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-699018332", "metadata": {"Type": "work"}}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:11:29.857517 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-fc9deb7f-c063-4fac-ac76-4b0f99fdf63d tempest-VolumesNegativeTest-354879835 tempest-VolumesNegativeTest-354879835-project] Request method failure captured: Oct 04 19:11:29.857517 n-d-851028-13 devstack@n-api.service[123596]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 04 19:11:29.857517 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 19:11:29.857517 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 19:11:29.857517 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 19:11:29.857517 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 118 Oct 04 19:11:29.857517 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 19:11:29.857517 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 19:11:29.857517 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 19:11:29.857517 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 19:11:29.857517 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPIVhaMD6yzyn9iVfMi9t8HOvtzPQLnUTHlQXvN4zmzDv-_vxykNaQhlOjdD52WoMbgKfOBjC3YXAtoDeT21By0wYpHQIszYDINGXCvb6LtJ1TdBHbI9dROYIIl-T_h8B8Aq03DblwFUeA8cmXIatMJZoCDJ1XMmWcy4CnJSkayvFJxU Oct 04 19:11:29.857517 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 19:11:29.857517 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 19:11:29.857517 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 19:11:29.857517 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 19:11:29.857517 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 19:11:29.857517 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 19:11:29.857517 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: b2b003c5250643aaad748a542cbcc32b Oct 04 19:11:29.857517 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-VolumesNegativeTest-354879835 Oct 04 19:11:29.857517 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 19:11:29.857517 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 19:11:29.857517 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/b2b003c5250643aaad748a542cbcc32b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_b2b003c5250643aaad748a542cbcc32b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b2b003c5250643aaad748a542cbcc32b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b2b003c5250643aaad748a542cbcc32b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 19:11:29.857517 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-VolumesNegativeTest-354879835 Oct 04 19:11:29.857517 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: b2b003c5250643aaad748a542cbcc32b Oct 04 19:11:29.857517 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-VolumesNegativeTest-354879835 Oct 04 19:11:29.857517 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-VolumesNegativeTest-354879835-project Oct 04 19:11:29.857517 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 19:11:29.857517 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 19:11:29.857517 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 73769b89addf407ab95587c0f428ae47 Oct 04 19:11:29.857517 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-VolumesNegativeTest-354879835-project Oct 04 19:11:29.857517 n-d-851028-13 devstack@n-api.service[123596]: Oct 04 19:11:29.857517 n-d-851028-13 devstack@n-api.service[123596]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-699018332", "metadata": {"Type": "work"}}} Oct 04 19:11:29.857517 n-d-851028-13 devstack@n-api.service[123596]: method: Oct 04 19:11:29.857517 n-d-851028-13 devstack@n-api.service[123596]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 04 19:11:29.857517 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-699018332', 'metadata': {'Type': 'work'}}}} Oct 04 19:11:29.857517 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:11:29.857517 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:11:29.857517 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 19:11:29.857517 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 19:11:29.857517 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 19:11:29.857517 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise error Oct 04 19:11:29.857517 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Oct 04 19:11:29.857517 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:11:29.857517 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 04 19:11:29.857517 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 04 19:11:29.857517 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:11:29.857517 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 04 19:11:29.857517 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi '' Oct 04 19:11:29.857517 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:11:29.857517 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:11:29.857517 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:11:29.857517 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:11:29.857517 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:11:29.857517 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:11:29.857517 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:11:29.857517 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:11:29.857517 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 19:11:29.857517 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 19:11:29.857517 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:11:29.857517 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:11:29.857517 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 19:11:29.857517 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 19:11:29.857517 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 19:11:29.857517 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 19:11:29.857517 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 19:11:29.857517 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 19:11:29.861873 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 04 19:11:29.861873 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:11:29.861873 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:11:29.861873 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:11:29.861873 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:11:29.861873 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:11:29.861873 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:11:29.861873 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 19:11:29.861873 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 19:11:29.861873 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 04 19:11:29.861873 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:11:29.861873 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-fc9deb7f-c063-4fac-ac76-4b0f99fdf63d tempest-VolumesNegativeTest-354879835 tempest-VolumesNegativeTest-354879835-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:11:29.861873 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-fc9deb7f-c063-4fac-ac76-4b0f99fdf63d tempest-VolumesNegativeTest-354879835 tempest-VolumesNegativeTest-354879835-project] 10.222.0.43 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.010050 Oct 04 19:11:29.861873 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3400/6432] 10.222.0.43 () {60 vars in 1156 bytes} [Tue Oct 4 19:11:29 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 19:11:29.868904 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-7daf8027-016c-47c4-9a10-e645525ef95c tempest-VolumesNegativeTest-354879835 tempest-VolumesNegativeTest-354879835-project] Calling method '.version_select at 0x7fb21eb20280>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:11:29.897666 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-7daf8027-016c-47c4-9a10-e645525ef95c tempest-VolumesNegativeTest-354879835 tempest-VolumesNegativeTest-354879835-project] HTTP exception thrown: Volume tempest-invalid-1172151391 could not be found. Oct 04 19:11:29.900473 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-7daf8027-016c-47c4-9a10-e645525ef95c tempest-VolumesNegativeTest-354879835 tempest-VolumesNegativeTest-354879835-project] Request method failure captured: Oct 04 19:11:29.900473 n-d-851028-13 devstack@n-api.service[123595]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1172151391 HTTP/1.1 Oct 04 19:11:29.900473 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 19:11:29.900473 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 19:11:29.900473 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 19:11:29.900473 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 0 Oct 04 19:11:29.900473 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 19:11:29.900473 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 19:11:29.900473 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 19:11:29.900473 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 19:11:29.900473 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPIVhaMD6yzyn9iVfMi9t8HOvtzPQLnUTHlQXvN4zmzDv-_vxykNaQhlOjdD52WoMbgKfOBjC3YXAtoDeT21By0wYpHQIszYDINGXCvb6LtJ1TdBHbI9dROYIIl-T_h8B8Aq03DblwFUeA8cmXIatMJZoCDJ1XMmWcy4CnJSkayvFJxU Oct 04 19:11:29.900473 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 19:11:29.900473 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 19:11:29.900473 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 19:11:29.900473 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 19:11:29.900473 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 19:11:29.900473 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 19:11:29.900473 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: b2b003c5250643aaad748a542cbcc32b Oct 04 19:11:29.900473 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-VolumesNegativeTest-354879835 Oct 04 19:11:29.900473 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 19:11:29.900473 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 19:11:29.900473 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/b2b003c5250643aaad748a542cbcc32b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_b2b003c5250643aaad748a542cbcc32b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b2b003c5250643aaad748a542cbcc32b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b2b003c5250643aaad748a542cbcc32b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 19:11:29.900473 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-VolumesNegativeTest-354879835 Oct 04 19:11:29.900473 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: b2b003c5250643aaad748a542cbcc32b Oct 04 19:11:29.900473 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-VolumesNegativeTest-354879835 Oct 04 19:11:29.900473 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-VolumesNegativeTest-354879835-project Oct 04 19:11:29.900473 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 19:11:29.900473 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 19:11:29.900473 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: 73769b89addf407ab95587c0f428ae47 Oct 04 19:11:29.900473 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-VolumesNegativeTest-354879835-project Oct 04 19:11:29.900473 n-d-851028-13 devstack@n-api.service[123595]: method: Oct 04 19:11:29.900473 n-d-851028-13 devstack@n-api.service[123595]: exception: Volume tempest-invalid-1172151391 could not be found. Oct 04 19:11:29.900473 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': 'tempest-invalid-1172151391'} Oct 04 19:11:29.900473 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:11:29.900473 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:11:29.900473 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 19:11:29.900473 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 19:11:29.900473 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 04 19:11:29.900473 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 04 19:11:29.900473 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 04 19:11:29.900473 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 04 19:11:29.900473 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 04 19:11:29.900473 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 04 19:11:29.900473 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 04 19:11:29.900473 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 04 19:11:29.900473 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 19:11:29.900473 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 19:11:29.900473 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 19:11:29.900473 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 19:11:29.900473 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1172151391 could not be found. (HTTP 404) (Request-ID: req-c9ca1b74-7617-453f-ac01-e5882d79072f) Oct 04 19:11:29.900473 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:11:29.900473 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:11:29.900473 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:11:29.900473 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:11:29.900473 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 04 19:11:29.900473 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 04 19:11:29.900473 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 04 19:11:29.900473 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 04 19:11:29.900473 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 04 19:11:29.900473 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 04 19:11:29.900473 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 04 19:11:29.900473 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 04 19:11:29.900473 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 19:11:29.904728 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 19:11:29.904728 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 04 19:11:29.904728 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 04 19:11:29.904728 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 04 19:11:29.904728 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 04 19:11:29.904728 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 04 19:11:29.904728 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 04 19:11:29.904728 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 04 19:11:29.904728 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 04 19:11:29.904728 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 19:11:29.904728 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 19:11:29.904728 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 19:11:29.904728 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 19:11:29.904728 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1172151391 could not be found. Oct 04 19:11:29.904728 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:11:29.904728 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:11:29.904728 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:11:29.904728 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:11:29.904728 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:11:29.904728 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:11:29.904728 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:11:29.904728 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:11:29.904728 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 19:11:29.904728 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 19:11:29.904728 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:11:29.904728 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:11:29.904728 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 04 19:11:29.904728 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:11:29.904728 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1172151391 could not be found. Oct 04 19:11:29.904728 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:11:29.904728 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:11:29.904728 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:11:29.904728 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:11:29.904728 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:11:29.904728 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:11:29.904728 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:11:29.904728 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:11:29.904728 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1172151391 could not be found. Oct 04 19:11:29.904728 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:11:29.904728 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-7daf8027-016c-47c4-9a10-e645525ef95c tempest-VolumesNegativeTest-354879835 tempest-VolumesNegativeTest-354879835-project] Returning 404 to user: Volume tempest-invalid-1172151391 could not be found. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:11:29.904728 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-7daf8027-016c-47c4-9a10-e645525ef95c tempest-VolumesNegativeTest-354879835 tempest-VolumesNegativeTest-354879835-project] 10.222.0.43 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1172151391" status: 404 len: 99 microversion: 2.1 time: 0.037777 Oct 04 19:11:29.904728 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3033/6433] 10.222.0.43 () {58 vars in 1218 bytes} [Tue Oct 4 19:11:29 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1172151391 => generated 99 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 04 19:11:29.914493 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-e8e69fb1-d93e-4fa7-87cc-e84b1951a157 tempest-VolumesNegativeTest-354879835 tempest-VolumesNegativeTest-354879835-project] 10.222.0.43 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003925 Oct 04 19:11:29.914989 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3401/6434] 10.222.0.43 () {58 vars in 1140 bytes} [Tue Oct 4 19:11:29 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Oct 04 19:11:29.923915 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-29ebc8a9-38bb-4908-89a1-8ea0e77918f2 tempest-VolumesNegativeTest-354879835 tempest-VolumesNegativeTest-354879835-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003680 Oct 04 19:11:29.924412 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3034/6435] 10.222.0.43 () {58 vars in 1137 bytes} [Tue Oct 4 19:11:29 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Oct 04 19:11:29.933568 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-d5c10aac-6cca-4878-b3d5-0dde44a3799c tempest-VolumesNegativeTest-354879835 tempest-VolumesNegativeTest-354879835-project] Calling method '.version_select at 0x7fb21e66db80>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:11:29.962620 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-d5c10aac-6cca-4878-b3d5-0dde44a3799c tempest-VolumesNegativeTest-354879835 tempest-VolumesNegativeTest-354879835-project] HTTP exception thrown: Volume 4c6998ed-1d11-4577-baa4-bfbe7ba05b08 could not be found. Oct 04 19:11:29.964622 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-d5c10aac-6cca-4878-b3d5-0dde44a3799c tempest-VolumesNegativeTest-354879835 tempest-VolumesNegativeTest-354879835-project] Request method failure captured: Oct 04 19:11:29.964622 n-d-851028-13 devstack@n-api.service[123596]: request: DELETE /compute/v2.1/os-volumes/4c6998ed-1d11-4577-baa4-bfbe7ba05b08 HTTP/1.1 Oct 04 19:11:29.964622 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 19:11:29.964622 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 19:11:29.964622 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 19:11:29.964622 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 19:11:29.964622 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 19:11:29.964622 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 19:11:29.964622 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 19:11:29.964622 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 19:11:29.964622 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPIVhaMD6yzyn9iVfMi9t8HOvtzPQLnUTHlQXvN4zmzDv-_vxykNaQhlOjdD52WoMbgKfOBjC3YXAtoDeT21By0wYpHQIszYDINGXCvb6LtJ1TdBHbI9dROYIIl-T_h8B8Aq03DblwFUeA8cmXIatMJZoCDJ1XMmWcy4CnJSkayvFJxU Oct 04 19:11:29.964622 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 19:11:29.964622 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 19:11:29.964622 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 19:11:29.964622 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 19:11:29.964622 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 19:11:29.964622 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 19:11:29.964622 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: b2b003c5250643aaad748a542cbcc32b Oct 04 19:11:29.964622 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-VolumesNegativeTest-354879835 Oct 04 19:11:29.964622 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 19:11:29.964622 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 19:11:29.964622 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/b2b003c5250643aaad748a542cbcc32b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_b2b003c5250643aaad748a542cbcc32b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b2b003c5250643aaad748a542cbcc32b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b2b003c5250643aaad748a542cbcc32b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 19:11:29.964622 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-VolumesNegativeTest-354879835 Oct 04 19:11:29.964622 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: b2b003c5250643aaad748a542cbcc32b Oct 04 19:11:29.964622 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-VolumesNegativeTest-354879835 Oct 04 19:11:29.964622 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-VolumesNegativeTest-354879835-project Oct 04 19:11:29.964622 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 19:11:29.964622 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 19:11:29.964622 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 73769b89addf407ab95587c0f428ae47 Oct 04 19:11:29.964622 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-VolumesNegativeTest-354879835-project Oct 04 19:11:29.964622 n-d-851028-13 devstack@n-api.service[123596]: method: Oct 04 19:11:29.964622 n-d-851028-13 devstack@n-api.service[123596]: exception: Volume 4c6998ed-1d11-4577-baa4-bfbe7ba05b08 could not be found. Oct 04 19:11:29.964622 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': '4c6998ed-1d11-4577-baa4-bfbe7ba05b08'} Oct 04 19:11:29.964622 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:11:29.964622 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:11:29.964622 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 19:11:29.964622 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 19:11:29.964622 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 04 19:11:29.964622 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 04 19:11:29.964622 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 04 19:11:29.964622 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 04 19:11:29.964622 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 04 19:11:29.964622 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 04 19:11:29.964622 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 04 19:11:29.964622 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 04 19:11:29.964622 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 19:11:29.964622 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 19:11:29.964622 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 19:11:29.964622 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 19:11:29.964622 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4c6998ed-1d11-4577-baa4-bfbe7ba05b08 could not be found. (HTTP 404) (Request-ID: req-5ab1a352-c78c-4614-86c0-c93bf127f537) Oct 04 19:11:29.964622 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:11:29.964622 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:11:29.964622 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:11:29.964622 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:11:29.964622 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 04 19:11:29.964622 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 04 19:11:29.964622 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 04 19:11:29.964622 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 04 19:11:29.964622 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 04 19:11:29.964622 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 04 19:11:29.964622 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 04 19:11:29.964622 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 04 19:11:29.964622 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 19:11:29.972553 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 19:11:29.972553 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 04 19:11:29.972553 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 04 19:11:29.972553 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 04 19:11:29.972553 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 04 19:11:29.972553 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 04 19:11:29.972553 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 04 19:11:29.972553 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 04 19:11:29.972553 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 04 19:11:29.972553 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 19:11:29.972553 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 19:11:29.972553 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 19:11:29.972553 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 19:11:29.972553 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4c6998ed-1d11-4577-baa4-bfbe7ba05b08 could not be found. Oct 04 19:11:29.972553 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:11:29.972553 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:11:29.972553 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:11:29.972553 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:11:29.972553 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:11:29.972553 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:11:29.972553 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:11:29.972553 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:11:29.972553 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 19:11:29.972553 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 19:11:29.972553 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:11:29.972553 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:11:29.972553 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 04 19:11:29.972553 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:11:29.972553 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4c6998ed-1d11-4577-baa4-bfbe7ba05b08 could not be found. Oct 04 19:11:29.972553 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:11:29.972553 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:11:29.972553 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:11:29.972553 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:11:29.972553 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:11:29.972553 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:11:29.972553 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:11:29.972553 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:11:29.972553 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4c6998ed-1d11-4577-baa4-bfbe7ba05b08 could not be found. Oct 04 19:11:29.972553 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:11:29.972553 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-d5c10aac-6cca-4878-b3d5-0dde44a3799c tempest-VolumesNegativeTest-354879835 tempest-VolumesNegativeTest-354879835-project] Returning 404 to user: Volume 4c6998ed-1d11-4577-baa4-bfbe7ba05b08 could not be found. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:11:29.972553 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-d5c10aac-6cca-4878-b3d5-0dde44a3799c tempest-VolumesNegativeTest-354879835 tempest-VolumesNegativeTest-354879835-project] 10.222.0.43 "DELETE /compute/v2.1/os-volumes/4c6998ed-1d11-4577-baa4-bfbe7ba05b08" status: 404 len: 109 microversion: 2.1 time: 0.037186 Oct 04 19:11:29.972553 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3402/6436] 10.222.0.43 () {58 vars in 1248 bytes} [Tue Oct 4 19:11:29 2022] DELETE /compute/v2.1/os-volumes/4c6998ed-1d11-4577-baa4-bfbe7ba05b08 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:11:29.978724 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-2e3268cf-6551-431d-8d7c-ab95636e4298 tempest-VolumesNegativeTest-354879835 tempest-VolumesNegativeTest-354879835-project] Calling method '.version_select at 0x7fb21e9b0280>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:11:30.007379 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-2e3268cf-6551-431d-8d7c-ab95636e4298 tempest-VolumesNegativeTest-354879835 tempest-VolumesNegativeTest-354879835-project] HTTP exception thrown: Volume dd5c3316-939d-4eff-9193-19503895b395 could not be found. Oct 04 19:11:30.009926 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-2e3268cf-6551-431d-8d7c-ab95636e4298 tempest-VolumesNegativeTest-354879835 tempest-VolumesNegativeTest-354879835-project] Request method failure captured: Oct 04 19:11:30.009926 n-d-851028-13 devstack@n-api.service[123595]: request: GET /compute/v2.1/os-volumes/dd5c3316-939d-4eff-9193-19503895b395 HTTP/1.1 Oct 04 19:11:30.009926 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 19:11:30.009926 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 19:11:30.009926 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 19:11:30.009926 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 0 Oct 04 19:11:30.009926 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 19:11:30.009926 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 19:11:30.009926 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 19:11:30.009926 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 19:11:30.009926 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPIVhaMD6yzyn9iVfMi9t8HOvtzPQLnUTHlQXvN4zmzDv-_vxykNaQhlOjdD52WoMbgKfOBjC3YXAtoDeT21By0wYpHQIszYDINGXCvb6LtJ1TdBHbI9dROYIIl-T_h8B8Aq03DblwFUeA8cmXIatMJZoCDJ1XMmWcy4CnJSkayvFJxU Oct 04 19:11:30.009926 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 19:11:30.009926 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 19:11:30.009926 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 19:11:30.009926 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 19:11:30.009926 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 19:11:30.009926 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 19:11:30.009926 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: b2b003c5250643aaad748a542cbcc32b Oct 04 19:11:30.009926 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-VolumesNegativeTest-354879835 Oct 04 19:11:30.009926 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 19:11:30.009926 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 19:11:30.009926 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/b2b003c5250643aaad748a542cbcc32b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_b2b003c5250643aaad748a542cbcc32b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b2b003c5250643aaad748a542cbcc32b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b2b003c5250643aaad748a542cbcc32b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 19:11:30.009926 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-VolumesNegativeTest-354879835 Oct 04 19:11:30.009926 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: b2b003c5250643aaad748a542cbcc32b Oct 04 19:11:30.009926 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-VolumesNegativeTest-354879835 Oct 04 19:11:30.009926 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-VolumesNegativeTest-354879835-project Oct 04 19:11:30.009926 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 19:11:30.009926 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 19:11:30.009926 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: 73769b89addf407ab95587c0f428ae47 Oct 04 19:11:30.009926 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-VolumesNegativeTest-354879835-project Oct 04 19:11:30.009926 n-d-851028-13 devstack@n-api.service[123595]: method: Oct 04 19:11:30.009926 n-d-851028-13 devstack@n-api.service[123595]: exception: Volume dd5c3316-939d-4eff-9193-19503895b395 could not be found. Oct 04 19:11:30.009926 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': 'dd5c3316-939d-4eff-9193-19503895b395'} Oct 04 19:11:30.009926 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:11:30.009926 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:11:30.009926 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 19:11:30.009926 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 19:11:30.009926 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 19:11:30.009926 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 19:11:30.009926 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 19:11:30.009926 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 19:11:30.009926 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 19:11:30.009926 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 19:11:30.009926 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 19:11:30.009926 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 19:11:30.009926 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 19:11:30.009926 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 19:11:30.009926 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 19:11:30.009926 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 19:11:30.009926 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume dd5c3316-939d-4eff-9193-19503895b395 could not be found. (HTTP 404) (Request-ID: req-a8d8a6a5-7f4d-4957-a383-9dc075511470) Oct 04 19:11:30.009926 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:11:30.009926 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:11:30.009926 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:11:30.009926 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:11:30.009926 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 04 19:11:30.009926 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 04 19:11:30.009926 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 04 19:11:30.009926 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 04 19:11:30.009926 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 04 19:11:30.009926 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 04 19:11:30.009926 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 04 19:11:30.009926 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 04 19:11:30.009926 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 19:11:30.016269 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 19:11:30.016269 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 19:11:30.016269 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 19:11:30.016269 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 19:11:30.016269 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 19:11:30.016269 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 19:11:30.016269 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 19:11:30.016269 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 19:11:30.016269 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 19:11:30.016269 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 19:11:30.016269 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 19:11:30.016269 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 19:11:30.016269 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 19:11:30.016269 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume dd5c3316-939d-4eff-9193-19503895b395 could not be found. Oct 04 19:11:30.016269 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:11:30.016269 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:11:30.016269 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:11:30.016269 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:11:30.016269 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:11:30.016269 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:11:30.016269 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:11:30.016269 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:11:30.016269 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 19:11:30.016269 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 19:11:30.016269 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:11:30.016269 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:11:30.016269 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 04 19:11:30.016269 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:11:30.016269 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume dd5c3316-939d-4eff-9193-19503895b395 could not be found. Oct 04 19:11:30.016269 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:11:30.016269 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:11:30.016269 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:11:30.016269 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:11:30.016269 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:11:30.016269 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:11:30.016269 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:11:30.016269 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:11:30.016269 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume dd5c3316-939d-4eff-9193-19503895b395 could not be found. Oct 04 19:11:30.016269 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:11:30.016269 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-2e3268cf-6551-431d-8d7c-ab95636e4298 tempest-VolumesNegativeTest-354879835 tempest-VolumesNegativeTest-354879835-project] Returning 404 to user: Volume dd5c3316-939d-4eff-9193-19503895b395 could not be found. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:11:30.016269 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-2e3268cf-6551-431d-8d7c-ab95636e4298 tempest-VolumesNegativeTest-354879835 tempest-VolumesNegativeTest-354879835-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/dd5c3316-939d-4eff-9193-19503895b395" status: 404 len: 109 microversion: 2.1 time: 0.039422 Oct 04 19:11:30.016269 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3035/6437] 10.222.0.43 () {58 vars in 1245 bytes} [Tue Oct 4 19:11:29 2022] GET /compute/v2.1/os-volumes/dd5c3316-939d-4eff-9193-19503895b395 => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:11:46.945294 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-b856cc8f-ac5c-40cc-b62d-b688a1019b98 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:11:46.946484 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-b856cc8f-ac5c-40cc-b62d-b688a1019b98 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] [instance: 05904eb8-6786-4d08-bb1c-03d36d74e3a7] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:11:46.954406 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b856cc8f-ac5c-40cc-b62d-b688a1019b98 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:46.954979 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b856cc8f-ac5c-40cc-b62d-b688a1019b98 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:46.955658 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b856cc8f-ac5c-40cc-b62d-b688a1019b98 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:46.956447 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b856cc8f-ac5c-40cc-b62d-b688a1019b98 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:46.956987 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b856cc8f-ac5c-40cc-b62d-b688a1019b98 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:46.957517 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b856cc8f-ac5c-40cc-b62d-b688a1019b98 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:47.078355 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.objects.instance [None req-b856cc8f-ac5c-40cc-b62d-b688a1019b98 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Lazy-loading 'services' on Instance uuid 05904eb8-6786-4d08-bb1c-03d36d74e3a7 {{(pid=123596) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 19:11:47.176483 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-b856cc8f-ac5c-40cc-b62d-b688a1019b98 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] 10.222.0.43 "DELETE /compute/v2.1/servers/05904eb8-6786-4d08-bb1c-03d36d74e3a7/os-volume_attachments/06328b38-d8a4-4f93-a3e7-645d08264fd1" status: 202 len: 0 microversion: 2.1 time: 0.236312 Oct 04 19:11:47.177968 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3403/6438] 10.222.0.43 () {58 vars in 1416 bytes} [Tue Oct 4 19:11:46 2022] DELETE /compute/v2.1/servers/05904eb8-6786-4d08-bb1c-03d36d74e3a7/os-volume_attachments/06328b38-d8a4-4f93-a3e7-645d08264fd1 => generated 0 bytes in 240 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:11:52.740787 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_api:SELECT=1 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:11:52.742306 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=10,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:11:52.749214 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-6de9813d-3f1e-4952-bf7e-8d8a01f03293 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:11:52.749848 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-6de9813d-3f1e-4952-bf7e-8d8a01f03293 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] [instance: 05904eb8-6786-4d08-bb1c-03d36d74e3a7] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:11:52.756452 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6de9813d-3f1e-4952-bf7e-8d8a01f03293 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:52.756956 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6de9813d-3f1e-4952-bf7e-8d8a01f03293 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:52.757555 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6de9813d-3f1e-4952-bf7e-8d8a01f03293 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:52.758819 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6de9813d-3f1e-4952-bf7e-8d8a01f03293 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:52.759286 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6de9813d-3f1e-4952-bf7e-8d8a01f03293 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:52.759719 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6de9813d-3f1e-4952-bf7e-8d8a01f03293 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:52.790762 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-6de9813d-3f1e-4952-bf7e-8d8a01f03293 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] [instance: 05904eb8-6786-4d08-bb1c-03d36d74e3a7] Going to try to terminate instance {{(pid=123595) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 19:11:52.879071 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-6de9813d-3f1e-4952-bf7e-8d8a01f03293 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] 10.222.0.43 "DELETE /compute/v2.1/servers/05904eb8-6786-4d08-bb1c-03d36d74e3a7" status: 204 len: 0 microversion: 2.1 time: 0.139929 Oct 04 19:11:52.879937 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3036/6439] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 19:11:52 2022] DELETE /compute/v2.1/servers/05904eb8-6786-4d08-bb1c-03d36d74e3a7 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:11:52.892157 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-213dae9c-73f1-4792-a6b9-9c0891b91e79 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:11:52.894980 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-213dae9c-73f1-4792-a6b9-9c0891b91e79 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] [instance: 05904eb8-6786-4d08-bb1c-03d36d74e3a7] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:11:52.900339 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-213dae9c-73f1-4792-a6b9-9c0891b91e79 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:52.901075 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-213dae9c-73f1-4792-a6b9-9c0891b91e79 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:52.901630 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-213dae9c-73f1-4792-a6b9-9c0891b91e79 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:52.902456 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-213dae9c-73f1-4792-a6b9-9c0891b91e79 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:52.902989 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-213dae9c-73f1-4792-a6b9-9c0891b91e79 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:52.903492 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-213dae9c-73f1-4792-a6b9-9c0891b91e79 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:53.124158 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-213dae9c-73f1-4792-a6b9-9c0891b91e79 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ac079f44ac4d48b3eb48ee17a5c58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dca72b323a14a33b422400007a816cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:11:53.136034 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-213dae9c-73f1-4792-a6b9-9c0891b91e79 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] 10.222.0.43 "GET /compute/v2.1/servers/05904eb8-6786-4d08-bb1c-03d36d74e3a7" status: 200 len: 1513 microversion: 2.1 time: 0.250185 Oct 04 19:11:53.137029 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3404/6440] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:11:52 2022] GET /compute/v2.1/servers/05904eb8-6786-4d08-bb1c-03d36d74e3a7 => generated 1513 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:11:54.161249 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-cda13488-5688-42c0-9e36-0459a5a7f538 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:11:54.162063 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-cda13488-5688-42c0-9e36-0459a5a7f538 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] [instance: 05904eb8-6786-4d08-bb1c-03d36d74e3a7] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:11:54.172388 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cda13488-5688-42c0-9e36-0459a5a7f538 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:54.172388 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cda13488-5688-42c0-9e36-0459a5a7f538 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:54.172388 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cda13488-5688-42c0-9e36-0459a5a7f538 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:54.172388 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cda13488-5688-42c0-9e36-0459a5a7f538 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:54.172388 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cda13488-5688-42c0-9e36-0459a5a7f538 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:54.172388 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cda13488-5688-42c0-9e36-0459a5a7f538 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:54.338774 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-cda13488-5688-42c0-9e36-0459a5a7f538 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ac079f44ac4d48b3eb48ee17a5c58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dca72b323a14a33b422400007a816cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:11:54.350380 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-cda13488-5688-42c0-9e36-0459a5a7f538 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] 10.222.0.43 "GET /compute/v2.1/servers/05904eb8-6786-4d08-bb1c-03d36d74e3a7" status: 200 len: 1513 microversion: 2.1 time: 0.193811 Oct 04 19:11:54.351412 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3037/6441] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:11:54 2022] GET /compute/v2.1/servers/05904eb8-6786-4d08-bb1c-03d36d74e3a7 => generated 1513 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:11:54.990276 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-6b6920e3-fc1a-4dd3-a496-60495bc54cfe req-299cc571-0449-4fb5-9ec2-d27644efd5a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05904eb8-6786-4d08-bb1c-03d36d74e3a7", "name": "network-vif-deleted", "tag": "dfda49b2-af9d-4481-92fe-397b9ec4d0a7"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:11:55.002263 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-6b6920e3-fc1a-4dd3-a496-60495bc54cfe req-299cc571-0449-4fb5-9ec2-d27644efd5a7 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:55.002784 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-6b6920e3-fc1a-4dd3-a496-60495bc54cfe req-299cc571-0449-4fb5-9ec2-d27644efd5a7 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:55.003657 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-6b6920e3-fc1a-4dd3-a496-60495bc54cfe req-299cc571-0449-4fb5-9ec2-d27644efd5a7 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:55.020627 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-6b6920e3-fc1a-4dd3-a496-60495bc54cfe req-299cc571-0449-4fb5-9ec2-d27644efd5a7 service nova] Creating event network-vif-deleted:dfda49b2-af9d-4481-92fe-397b9ec4d0a7 for instance 05904eb8-6786-4d08-bb1c-03d36d74e3a7 on n-h1-851028-13 Oct 04 19:11:55.027350 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-6b6920e3-fc1a-4dd3-a496-60495bc54cfe req-299cc571-0449-4fb5-9ec2-d27644efd5a7 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040918 Oct 04 19:11:55.028754 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3405/6442] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:11:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:11:55.385776 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-8caa08c4-82a7-498e-937f-28c312c90cdc tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:11:55.386469 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-8caa08c4-82a7-498e-937f-28c312c90cdc tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] [instance: 05904eb8-6786-4d08-bb1c-03d36d74e3a7] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:11:55.394058 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8caa08c4-82a7-498e-937f-28c312c90cdc tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:55.394555 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8caa08c4-82a7-498e-937f-28c312c90cdc tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:55.395026 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8caa08c4-82a7-498e-937f-28c312c90cdc tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:55.395795 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8caa08c4-82a7-498e-937f-28c312c90cdc tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:55.396278 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8caa08c4-82a7-498e-937f-28c312c90cdc tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:55.396711 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8caa08c4-82a7-498e-937f-28c312c90cdc tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:55.448995 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8caa08c4-82a7-498e-937f-28c312c90cdc tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:55.449287 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8caa08c4-82a7-498e-937f-28c312c90cdc tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:55.449734 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8caa08c4-82a7-498e-937f-28c312c90cdc tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:55.450195 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.objects.instance [None req-8caa08c4-82a7-498e-937f-28c312c90cdc tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Lazy-loading 'fault' on Instance uuid 05904eb8-6786-4d08-bb1c-03d36d74e3a7 {{(pid=123595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 19:11:55.518156 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-8caa08c4-82a7-498e-937f-28c312c90cdc tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ac079f44ac4d48b3eb48ee17a5c58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dca72b323a14a33b422400007a816cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:11:55.527010 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-8caa08c4-82a7-498e-937f-28c312c90cdc tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] 10.222.0.43 "GET /compute/v2.1/servers/05904eb8-6786-4d08-bb1c-03d36d74e3a7" status: 200 len: 1308 microversion: 2.1 time: 0.146708 Oct 04 19:11:55.527619 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3038/6443] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:11:55 2022] GET /compute/v2.1/servers/05904eb8-6786-4d08-bb1c-03d36d74e3a7 => generated 1308 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:11:56.563924 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-0079ebb3-bfea-4037-8037-8b7b65eab43a tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:11:56.565320 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-0079ebb3-bfea-4037-8037-8b7b65eab43a tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] [instance: 05904eb8-6786-4d08-bb1c-03d36d74e3a7] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:11:56.573415 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0079ebb3-bfea-4037-8037-8b7b65eab43a tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:56.573984 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0079ebb3-bfea-4037-8037-8b7b65eab43a tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:56.574512 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0079ebb3-bfea-4037-8037-8b7b65eab43a tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:56.575280 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0079ebb3-bfea-4037-8037-8b7b65eab43a tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:56.575811 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0079ebb3-bfea-4037-8037-8b7b65eab43a tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:56.576304 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0079ebb3-bfea-4037-8037-8b7b65eab43a tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:56.594078 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-0079ebb3-bfea-4037-8037-8b7b65eab43a tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] HTTP exception thrown: Instance 05904eb8-6786-4d08-bb1c-03d36d74e3a7 could not be found. Oct 04 19:11:56.596332 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-0079ebb3-bfea-4037-8037-8b7b65eab43a tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Request method failure captured: Oct 04 19:11:56.596332 n-d-851028-13 devstack@n-api.service[123596]: request: GET /compute/v2.1/servers/05904eb8-6786-4d08-bb1c-03d36d74e3a7 HTTP/1.1 Oct 04 19:11:56.596332 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 19:11:56.596332 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 19:11:56.596332 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 19:11:56.596332 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 19:11:56.596332 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 19:11:56.596332 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 19:11:56.596332 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 19:11:56.596332 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 19:11:56.596332 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPITtuOU1kGAU2cWVl9hcn8O705PYsf8kG7oB5E1XeZRacWJ1TjUt7vEKzSv9V2dSWehaEQud_AENJSgRK4CF3g6RZNw4YNDFxVfWsKTPxq1_0YUWDoEUEJejOLJz1OjXfSvZiyXGdbkSkmh9y8dX-1rRD1J72ZALxPzqJPHf4yr2uUQ Oct 04 19:11:56.596332 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 19:11:56.596332 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 19:11:56.596332 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 19:11:56.596332 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 19:11:56.596332 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 19:11:56.596332 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 19:11:56.596332 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: 6dca72b323a14a33b422400007a816cc Oct 04 19:11:56.596332 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1812333119 Oct 04 19:11:56.596332 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 19:11:56.596332 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 19:11:56.596332 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/6dca72b323a14a33b422400007a816cc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_6dca72b323a14a33b422400007a816cc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/6dca72b323a14a33b422400007a816cc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/6dca72b323a14a33b422400007a816cc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 19:11:56.596332 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-VolumesSnapshotTestJSON-1812333119 Oct 04 19:11:56.596332 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: 6dca72b323a14a33b422400007a816cc Oct 04 19:11:56.596332 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1812333119 Oct 04 19:11:56.596332 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-VolumesSnapshotTestJSON-1812333119-project Oct 04 19:11:56.596332 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 19:11:56.596332 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 19:11:56.596332 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 22ac079f44ac4d48b3eb48ee17a5c58d Oct 04 19:11:56.596332 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-VolumesSnapshotTestJSON-1812333119-project Oct 04 19:11:56.596332 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 19:11:56.596332 n-d-851028-13 devstack@n-api.service[123596]: exception: Instance 05904eb8-6786-4d08-bb1c-03d36d74e3a7 could not be found. Oct 04 19:11:56.596332 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': '05904eb8-6786-4d08-bb1c-03d36d74e3a7'} Oct 04 19:11:56.596332 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:11:56.596332 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:11:56.596332 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:11:56.596332 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:11:56.596332 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:11:56.596332 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:11:56.596332 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:11:56.596332 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:11:56.596332 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:11:56.596332 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:11:56.596332 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 05904eb8-6786-4d08-bb1c-03d36d74e3a7 could not be found. Oct 04 19:11:56.596332 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:11:56.596332 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:11:56.596332 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:11:56.596332 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:11:56.596332 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:11:56.596332 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:11:56.596332 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:11:56.596332 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:11:56.596332 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:11:56.596332 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:11:56.596332 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:11:56.596332 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:11:56.596332 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:11:56.596332 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:11:56.596332 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:11:56.596332 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:11:56.596332 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 05904eb8-6786-4d08-bb1c-03d36d74e3a7 could not be found. Oct 04 19:11:56.596332 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:11:56.596332 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:11:56.596332 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:11:56.602855 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:11:56.602855 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:11:56.602855 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:11:56.602855 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:11:56.602855 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:11:56.602855 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 05904eb8-6786-4d08-bb1c-03d36d74e3a7 could not be found. Oct 04 19:11:56.602855 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:11:56.604184 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-0079ebb3-bfea-4037-8037-8b7b65eab43a tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Returning 404 to user: Instance 05904eb8-6786-4d08-bb1c-03d36d74e3a7 could not be found. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:11:56.605284 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-0079ebb3-bfea-4037-8037-8b7b65eab43a tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] 10.222.0.43 "GET /compute/v2.1/servers/05904eb8-6786-4d08-bb1c-03d36d74e3a7" status: 404 len: 111 microversion: 2.1 time: 0.048633 Oct 04 19:11:56.606364 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3406/6444] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:11:56 2022] GET /compute/v2.1/servers/05904eb8-6786-4d08-bb1c-03d36d74e3a7 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:12:03.717606 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-618ff53b-9c7c-48de-9f2c-e4c637945af5 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-924889357", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452", "networks": [{"uuid": "c9efdd18-1ad0-4af8-8ebc-062c80f244c1"}]}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:12:03.784285 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.network.neutron [None req-618ff53b-9c7c-48de-9f2c-e4c637945af5 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] validate_networks() for [('c9efdd18-1ad0-4af8-8ebc-062c80f244c1', None, None, None, None, None)] {{(pid=123595) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 19:12:04.212626 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-618ff53b-9c7c-48de-9f2c-e4c637945af5 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Flavor limits 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:12:04.213068 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-618ff53b-9c7c-48de-9f2c-e4c637945af5 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Image limits 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:12:04.213569 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-618ff53b-9c7c-48de-9f2c-e4c637945af5 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Flavor pref 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:12:04.214255 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-618ff53b-9c7c-48de-9f2c-e4c637945af5 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Image pref 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:12:04.214682 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-618ff53b-9c7c-48de-9f2c-e4c637945af5 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:12:04.230917 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-618ff53b-9c7c-48de-9f2c-e4c637945af5 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:04.231739 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-618ff53b-9c7c-48de-9f2c-e4c637945af5 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:04.232288 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-618ff53b-9c7c-48de-9f2c-e4c637945af5 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:04.233380 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-618ff53b-9c7c-48de-9f2c-e4c637945af5 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:04.233937 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-618ff53b-9c7c-48de-9f2c-e4c637945af5 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:04.234631 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-618ff53b-9c7c-48de-9f2c-e4c637945af5 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:04.256061 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-618ff53b-9c7c-48de-9f2c-e4c637945af5 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Getting quotas for project 6dca72b323a14a33b422400007a816cc. Resources: {'ram', 'cores', 'instances'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:12:04.265525 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-618ff53b-9c7c-48de-9f2c-e4c637945af5 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Getting quotas for user 22ac079f44ac4d48b3eb48ee17a5c58d and project 6dca72b323a14a33b422400007a816cc. Resources: {'ram', 'cores', 'instances'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:12:04.283043 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-618ff53b-9c7c-48de-9f2c-e4c637945af5 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Going to run 1 instances... {{(pid=123595) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 19:12:04.285809 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-618ff53b-9c7c-48de-9f2c-e4c637945af5 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] [instance: fb0d234a-9ad9-4818-84b6-fdc900c89f89] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e8943ec5-4038-4d4b-b9b9-2415a79f5243',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 19:12:04.339034 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-618ff53b-9c7c-48de-9f2c-e4c637945af5 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.626123 Oct 04 19:12:04.353163 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f331264f-25f6-43b2-be5e-6ebf639e5865 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:12:04.353968 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-f331264f-25f6-43b2-be5e-6ebf639e5865 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] [instance: fb0d234a-9ad9-4818-84b6-fdc900c89f89] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:12:04.358289 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3039/6445] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 19:12:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 643 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 19:12:04.453007 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-f331264f-25f6-43b2-be5e-6ebf639e5865 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ac079f44ac4d48b3eb48ee17a5c58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dca72b323a14a33b422400007a816cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:12:04.468346 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-f331264f-25f6-43b2-be5e-6ebf639e5865 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] 10.222.0.43 "GET /compute/v2.1/servers/fb0d234a-9ad9-4818-84b6-fdc900c89f89" status: 200 len: 1218 microversion: 2.1 time: 0.120528 Oct 04 19:12:04.471430 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3407/6446] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:12:04 2022] GET /compute/v2.1/servers/fb0d234a-9ad9-4818-84b6-fdc900c89f89 => generated 1218 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:12:05.493203 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-cc882c68-e75b-4e35-8c7f-6b57ce223831 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:12:05.494442 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-cc882c68-e75b-4e35-8c7f-6b57ce223831 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] [instance: fb0d234a-9ad9-4818-84b6-fdc900c89f89] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:12:05.501495 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cc882c68-e75b-4e35-8c7f-6b57ce223831 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:05.502203 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cc882c68-e75b-4e35-8c7f-6b57ce223831 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:05.502860 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cc882c68-e75b-4e35-8c7f-6b57ce223831 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:05.503733 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cc882c68-e75b-4e35-8c7f-6b57ce223831 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:05.504368 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cc882c68-e75b-4e35-8c7f-6b57ce223831 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:05.504953 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cc882c68-e75b-4e35-8c7f-6b57ce223831 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:05.585668 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-cc882c68-e75b-4e35-8c7f-6b57ce223831 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ac079f44ac4d48b3eb48ee17a5c58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dca72b323a14a33b422400007a816cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:12:05.595894 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-cc882c68-e75b-4e35-8c7f-6b57ce223831 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] 10.222.0.43 "GET /compute/v2.1/servers/fb0d234a-9ad9-4818-84b6-fdc900c89f89" status: 200 len: 1270 microversion: 2.1 time: 0.107926 Oct 04 19:12:05.597024 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3040/6447] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:12:05 2022] GET /compute/v2.1/servers/fb0d234a-9ad9-4818-84b6-fdc900c89f89 => generated 1270 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:12:06.627463 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-678ae2f1-e303-4127-af17-e8630628a0d7 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:12:06.628163 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-678ae2f1-e303-4127-af17-e8630628a0d7 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] [instance: fb0d234a-9ad9-4818-84b6-fdc900c89f89] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:12:06.633979 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=19,nova_cell1:INSERT=1 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:12:06.641059 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-678ae2f1-e303-4127-af17-e8630628a0d7 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:06.641810 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-678ae2f1-e303-4127-af17-e8630628a0d7 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:06.642569 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-678ae2f1-e303-4127-af17-e8630628a0d7 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:06.643435 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-678ae2f1-e303-4127-af17-e8630628a0d7 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:06.644137 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-678ae2f1-e303-4127-af17-e8630628a0d7 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:06.644721 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-678ae2f1-e303-4127-af17-e8630628a0d7 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:06.854718 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-678ae2f1-e303-4127-af17-e8630628a0d7 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ac079f44ac4d48b3eb48ee17a5c58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dca72b323a14a33b422400007a816cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:12:06.861842 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-678ae2f1-e303-4127-af17-e8630628a0d7 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] 10.222.0.43 "GET /compute/v2.1/servers/fb0d234a-9ad9-4818-84b6-fdc900c89f89" status: 200 len: 1318 microversion: 2.1 time: 0.244495 Oct 04 19:12:06.862862 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3408/6448] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:12:06 2022] GET /compute/v2.1/servers/fb0d234a-9ad9-4818-84b6-fdc900c89f89 => generated 1318 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:12:07.399758 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-b7453267-f733-4a69-9c24-34b01f44a5f8 req-3457c2ec-bec0-496e-9a9e-ba793693b237 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb0d234a-9ad9-4818-84b6-fdc900c89f89", "tag": "ae0b74d0-9b58-42cd-b8e2-aad51dd28c47"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:12:07.411608 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-b7453267-f733-4a69-9c24-34b01f44a5f8 req-3457c2ec-bec0-496e-9a9e-ba793693b237 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:07.412522 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-b7453267-f733-4a69-9c24-34b01f44a5f8 req-3457c2ec-bec0-496e-9a9e-ba793693b237 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:07.413400 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-b7453267-f733-4a69-9c24-34b01f44a5f8 req-3457c2ec-bec0-496e-9a9e-ba793693b237 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:07.427898 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-b7453267-f733-4a69-9c24-34b01f44a5f8 req-3457c2ec-bec0-496e-9a9e-ba793693b237 service nova] Creating event network-changed:ae0b74d0-9b58-42cd-b8e2-aad51dd28c47 for instance fb0d234a-9ad9-4818-84b6-fdc900c89f89 on n-h2-851028-13 Oct 04 19:12:07.434651 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-b7453267-f733-4a69-9c24-34b01f44a5f8 req-3457c2ec-bec0-496e-9a9e-ba793693b237 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038604 Oct 04 19:12:07.435767 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3041/6449] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:12:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:12:07.886938 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-61d43651-c49d-449a-b026-50ceb40f1c00 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:12:07.888134 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-61d43651-c49d-449a-b026-50ceb40f1c00 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] [instance: fb0d234a-9ad9-4818-84b6-fdc900c89f89] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:12:07.895893 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-61d43651-c49d-449a-b026-50ceb40f1c00 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:07.896798 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-61d43651-c49d-449a-b026-50ceb40f1c00 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:07.913771 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-61d43651-c49d-449a-b026-50ceb40f1c00 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:07.915241 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-61d43651-c49d-449a-b026-50ceb40f1c00 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:07.915655 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-61d43651-c49d-449a-b026-50ceb40f1c00 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:07.916328 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-61d43651-c49d-449a-b026-50ceb40f1c00 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:08.153160 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-61d43651-c49d-449a-b026-50ceb40f1c00 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ac079f44ac4d48b3eb48ee17a5c58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dca72b323a14a33b422400007a816cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:12:08.168949 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-61d43651-c49d-449a-b026-50ceb40f1c00 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] 10.222.0.43 "GET /compute/v2.1/servers/fb0d234a-9ad9-4818-84b6-fdc900c89f89" status: 200 len: 1318 microversion: 2.1 time: 0.285106 Oct 04 19:12:08.170242 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3409/6450] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:12:07 2022] GET /compute/v2.1/servers/fb0d234a-9ad9-4818-84b6-fdc900c89f89 => generated 1318 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:12:09.195171 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-21dd93a8-e4a2-4401-ace7-56a067361e68 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:12:09.195924 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-21dd93a8-e4a2-4401-ace7-56a067361e68 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] [instance: fb0d234a-9ad9-4818-84b6-fdc900c89f89] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:12:09.203565 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-21dd93a8-e4a2-4401-ace7-56a067361e68 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:09.204072 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-21dd93a8-e4a2-4401-ace7-56a067361e68 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:09.204516 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-21dd93a8-e4a2-4401-ace7-56a067361e68 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:09.205254 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-21dd93a8-e4a2-4401-ace7-56a067361e68 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:09.205829 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-21dd93a8-e4a2-4401-ace7-56a067361e68 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:09.206207 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-21dd93a8-e4a2-4401-ace7-56a067361e68 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:09.492940 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-21dd93a8-e4a2-4401-ace7-56a067361e68 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ac079f44ac4d48b3eb48ee17a5c58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dca72b323a14a33b422400007a816cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:12:09.505853 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-21dd93a8-e4a2-4401-ace7-56a067361e68 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] 10.222.0.43 "GET /compute/v2.1/servers/fb0d234a-9ad9-4818-84b6-fdc900c89f89" status: 200 len: 1318 microversion: 2.1 time: 0.315122 Oct 04 19:12:09.506948 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3042/6451] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:12:09 2022] GET /compute/v2.1/servers/fb0d234a-9ad9-4818-84b6-fdc900c89f89 => generated 1318 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:12:10.534889 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-007d2725-d8ea-465e-a9b8-04bc6beb489e tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:12:10.536045 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-007d2725-d8ea-465e-a9b8-04bc6beb489e tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] [instance: fb0d234a-9ad9-4818-84b6-fdc900c89f89] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:12:10.548633 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-007d2725-d8ea-465e-a9b8-04bc6beb489e tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:10.549414 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-007d2725-d8ea-465e-a9b8-04bc6beb489e tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:10.550094 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-007d2725-d8ea-465e-a9b8-04bc6beb489e tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:10.550881 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-007d2725-d8ea-465e-a9b8-04bc6beb489e tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:10.551483 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-007d2725-d8ea-465e-a9b8-04bc6beb489e tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:10.551927 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-007d2725-d8ea-465e-a9b8-04bc6beb489e tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:10.713983 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-007d2725-d8ea-465e-a9b8-04bc6beb489e tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ac079f44ac4d48b3eb48ee17a5c58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dca72b323a14a33b422400007a816cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:12:10.728124 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-007d2725-d8ea-465e-a9b8-04bc6beb489e tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] 10.222.0.43 "GET /compute/v2.1/servers/fb0d234a-9ad9-4818-84b6-fdc900c89f89" status: 200 len: 1318 microversion: 2.1 time: 0.200223 Oct 04 19:12:10.729317 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3410/6452] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:12:10 2022] GET /compute/v2.1/servers/fb0d234a-9ad9-4818-84b6-fdc900c89f89 => generated 1318 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:12:11.514545 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-4027d650-face-4ce3-93e1-3bade49d8626 tempest-PortsAdminExtendedAttrsTestJSON-269349743 tempest-PortsAdminExtendedAttrsTestJSON-269349743-project-admin] Calling method '.version_select at 0x7fb21e9ce310>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:12:11.517086 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4027d650-face-4ce3-93e1-3bade49d8626 tempest-PortsAdminExtendedAttrsTestJSON-269349743 tempest-PortsAdminExtendedAttrsTestJSON-269349743-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:11.517780 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4027d650-face-4ce3-93e1-3bade49d8626 tempest-PortsAdminExtendedAttrsTestJSON-269349743 tempest-PortsAdminExtendedAttrsTestJSON-269349743-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:11.518397 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4027d650-face-4ce3-93e1-3bade49d8626 tempest-PortsAdminExtendedAttrsTestJSON-269349743 tempest-PortsAdminExtendedAttrsTestJSON-269349743-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:11.534315 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4027d650-face-4ce3-93e1-3bade49d8626 tempest-PortsAdminExtendedAttrsTestJSON-269349743 tempest-PortsAdminExtendedAttrsTestJSON-269349743-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:11.534805 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4027d650-face-4ce3-93e1-3bade49d8626 tempest-PortsAdminExtendedAttrsTestJSON-269349743 tempest-PortsAdminExtendedAttrsTestJSON-269349743-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:11.535242 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4027d650-face-4ce3-93e1-3bade49d8626 tempest-PortsAdminExtendedAttrsTestJSON-269349743 tempest-PortsAdminExtendedAttrsTestJSON-269349743-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:11.546477 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4027d650-face-4ce3-93e1-3bade49d8626 tempest-PortsAdminExtendedAttrsTestJSON-269349743 tempest-PortsAdminExtendedAttrsTestJSON-269349743-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:11.546978 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4027d650-face-4ce3-93e1-3bade49d8626 tempest-PortsAdminExtendedAttrsTestJSON-269349743 tempest-PortsAdminExtendedAttrsTestJSON-269349743-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:11.547423 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4027d650-face-4ce3-93e1-3bade49d8626 tempest-PortsAdminExtendedAttrsTestJSON-269349743 tempest-PortsAdminExtendedAttrsTestJSON-269349743-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:11.556898 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-4027d650-face-4ce3-93e1-3bade49d8626 tempest-PortsAdminExtendedAttrsTestJSON-269349743 tempest-PortsAdminExtendedAttrsTestJSON-269349743-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.279259 Oct 04 19:12:11.558128 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3043/6453] 10.222.0.43 () {58 vars in 1146 bytes} [Tue Oct 4 19:12:11 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:12:11.755261 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-052964ce-84e4-4db7-8929-159ab93c0054 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:12:11.756414 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-052964ce-84e4-4db7-8929-159ab93c0054 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] [instance: fb0d234a-9ad9-4818-84b6-fdc900c89f89] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:12:11.772844 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-052964ce-84e4-4db7-8929-159ab93c0054 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:11.774449 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-052964ce-84e4-4db7-8929-159ab93c0054 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:11.774904 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-052964ce-84e4-4db7-8929-159ab93c0054 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:11.775616 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-052964ce-84e4-4db7-8929-159ab93c0054 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:11.776842 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-052964ce-84e4-4db7-8929-159ab93c0054 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:11.777466 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-052964ce-84e4-4db7-8929-159ab93c0054 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:11.975781 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-052964ce-84e4-4db7-8929-159ab93c0054 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ac079f44ac4d48b3eb48ee17a5c58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dca72b323a14a33b422400007a816cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:12:11.985801 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-052964ce-84e4-4db7-8929-159ab93c0054 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] 10.222.0.43 "GET /compute/v2.1/servers/fb0d234a-9ad9-4818-84b6-fdc900c89f89" status: 200 len: 1318 microversion: 2.1 time: 0.237537 Oct 04 19:12:11.988932 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3411/6454] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:12:11 2022] GET /compute/v2.1/servers/fb0d234a-9ad9-4818-84b6-fdc900c89f89 => generated 1318 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:12:13.011713 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-a5bd7a03-5e0e-4ff2-8b08-22bb7dc3f59b tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:12:13.012990 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-a5bd7a03-5e0e-4ff2-8b08-22bb7dc3f59b tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] [instance: fb0d234a-9ad9-4818-84b6-fdc900c89f89] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:12:13.019646 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a5bd7a03-5e0e-4ff2-8b08-22bb7dc3f59b tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:13.020148 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a5bd7a03-5e0e-4ff2-8b08-22bb7dc3f59b tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:13.020585 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a5bd7a03-5e0e-4ff2-8b08-22bb7dc3f59b tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:13.021434 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a5bd7a03-5e0e-4ff2-8b08-22bb7dc3f59b tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:13.021952 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a5bd7a03-5e0e-4ff2-8b08-22bb7dc3f59b tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:13.022264 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a5bd7a03-5e0e-4ff2-8b08-22bb7dc3f59b tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:13.235859 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-a5bd7a03-5e0e-4ff2-8b08-22bb7dc3f59b tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ac079f44ac4d48b3eb48ee17a5c58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dca72b323a14a33b422400007a816cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:12:13.249025 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-a5bd7a03-5e0e-4ff2-8b08-22bb7dc3f59b tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] 10.222.0.43 "GET /compute/v2.1/servers/fb0d234a-9ad9-4818-84b6-fdc900c89f89" status: 200 len: 1318 microversion: 2.1 time: 0.241687 Oct 04 19:12:13.257664 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3044/6455] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:12:13 2022] GET /compute/v2.1/servers/fb0d234a-9ad9-4818-84b6-fdc900c89f89 => generated 1318 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:12:13.495313 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-6a4ddb69-4742-4cc5-882b-d7f89d2f80cf req-88269511-d2ed-49cb-8646-bc35172581aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb0d234a-9ad9-4818-84b6-fdc900c89f89", "name": "network-vif-plugged", "status": "completed", "tag": "ae0b74d0-9b58-42cd-b8e2-aad51dd28c47"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:12:13.507377 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-6a4ddb69-4742-4cc5-882b-d7f89d2f80cf req-88269511-d2ed-49cb-8646-bc35172581aa service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:13.508209 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-6a4ddb69-4742-4cc5-882b-d7f89d2f80cf req-88269511-d2ed-49cb-8646-bc35172581aa service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:13.509393 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-6a4ddb69-4742-4cc5-882b-d7f89d2f80cf req-88269511-d2ed-49cb-8646-bc35172581aa service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:13.523289 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-6a4ddb69-4742-4cc5-882b-d7f89d2f80cf req-88269511-d2ed-49cb-8646-bc35172581aa service nova] Creating event network-vif-plugged:ae0b74d0-9b58-42cd-b8e2-aad51dd28c47 for instance fb0d234a-9ad9-4818-84b6-fdc900c89f89 on n-h2-851028-13 Oct 04 19:12:13.531557 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-6a4ddb69-4742-4cc5-882b-d7f89d2f80cf req-88269511-d2ed-49cb-8646-bc35172581aa service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041790 Oct 04 19:12:13.533004 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3412/6456] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:12:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:12:14.276239 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-468e103b-f901-43ff-bd1d-7bba6b972ed3 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:12:14.277259 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-468e103b-f901-43ff-bd1d-7bba6b972ed3 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] [instance: fb0d234a-9ad9-4818-84b6-fdc900c89f89] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:12:14.281506 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=2 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:12:14.282185 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=6 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:12:14.288733 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-468e103b-f901-43ff-bd1d-7bba6b972ed3 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:14.289340 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-468e103b-f901-43ff-bd1d-7bba6b972ed3 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:14.290109 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-468e103b-f901-43ff-bd1d-7bba6b972ed3 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:14.290843 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-468e103b-f901-43ff-bd1d-7bba6b972ed3 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:14.291752 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-468e103b-f901-43ff-bd1d-7bba6b972ed3 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:14.292199 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-468e103b-f901-43ff-bd1d-7bba6b972ed3 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:14.485915 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-468e103b-f901-43ff-bd1d-7bba6b972ed3 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ac079f44ac4d48b3eb48ee17a5c58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dca72b323a14a33b422400007a816cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:12:14.494228 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-468e103b-f901-43ff-bd1d-7bba6b972ed3 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] 10.222.0.43 "GET /compute/v2.1/servers/fb0d234a-9ad9-4818-84b6-fdc900c89f89" status: 200 len: 1318 microversion: 2.1 time: 0.224201 Oct 04 19:12:14.495175 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3045/6457] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:12:14 2022] GET /compute/v2.1/servers/fb0d234a-9ad9-4818-84b6-fdc900c89f89 => generated 1318 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:12:15.517590 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=2 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:12:15.524874 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-51132bed-66d5-4277-a964-1a8627a403a0 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:12:15.525809 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-51132bed-66d5-4277-a964-1a8627a403a0 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] [instance: fb0d234a-9ad9-4818-84b6-fdc900c89f89] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:12:15.534526 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-51132bed-66d5-4277-a964-1a8627a403a0 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:15.535124 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-51132bed-66d5-4277-a964-1a8627a403a0 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:15.535570 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-51132bed-66d5-4277-a964-1a8627a403a0 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:15.536592 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-51132bed-66d5-4277-a964-1a8627a403a0 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:15.537306 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-51132bed-66d5-4277-a964-1a8627a403a0 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:15.537926 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-51132bed-66d5-4277-a964-1a8627a403a0 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:15.694670 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-51132bed-66d5-4277-a964-1a8627a403a0 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ac079f44ac4d48b3eb48ee17a5c58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dca72b323a14a33b422400007a816cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:12:15.712078 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-51132bed-66d5-4277-a964-1a8627a403a0 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] 10.222.0.43 "GET /compute/v2.1/servers/fb0d234a-9ad9-4818-84b6-fdc900c89f89" status: 200 len: 1507 microversion: 2.1 time: 0.194699 Oct 04 19:12:15.713015 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3413/6458] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:12:15 2022] GET /compute/v2.1/servers/fb0d234a-9ad9-4818-84b6-fdc900c89f89 => generated 1507 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:12:15.736050 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-9234314c-6521-4871-8c14-ec39dec0cfc8 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4cd39211-ae6a-46ef-99ac-a6371916c932", "device": "/dev/sdb"}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:12:15.738928 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-9234314c-6521-4871-8c14-ec39dec0cfc8 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] [instance: fb0d234a-9ad9-4818-84b6-fdc900c89f89] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:12:15.746557 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9234314c-6521-4871-8c14-ec39dec0cfc8 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:15.747048 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9234314c-6521-4871-8c14-ec39dec0cfc8 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:15.747489 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9234314c-6521-4871-8c14-ec39dec0cfc8 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:15.748192 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9234314c-6521-4871-8c14-ec39dec0cfc8 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:15.748843 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9234314c-6521-4871-8c14-ec39dec0cfc8 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:15.749452 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9234314c-6521-4871-8c14-ec39dec0cfc8 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:16.070216 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-9234314c-6521-4871-8c14-ec39dec0cfc8 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] 10.222.0.43 "POST /compute/v2.1/servers/fb0d234a-9ad9-4818-84b6-fdc900c89f89/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.338069 Oct 04 19:12:16.072075 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3046/6459] 10.222.0.43 () {60 vars in 1323 bytes} [Tue Oct 4 19:12:15 2022] POST /compute/v2.1/servers/fb0d234a-9ad9-4818-84b6-fdc900c89f89/os-volume_attachments => generated 194 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:12:41.353155 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-c867f15b-3ab1-4351-bced-540238446079 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:12:41.353760 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-c867f15b-3ab1-4351-bced-540238446079 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] [instance: fb0d234a-9ad9-4818-84b6-fdc900c89f89] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:12:41.355844 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_api:SELECT=24 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:12:41.356574 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=32 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:12:41.362706 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c867f15b-3ab1-4351-bced-540238446079 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:41.363208 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c867f15b-3ab1-4351-bced-540238446079 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:41.363656 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c867f15b-3ab1-4351-bced-540238446079 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:41.364645 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c867f15b-3ab1-4351-bced-540238446079 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:41.365137 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c867f15b-3ab1-4351-bced-540238446079 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:41.365577 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c867f15b-3ab1-4351-bced-540238446079 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:41.452689 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.objects.instance [None req-c867f15b-3ab1-4351-bced-540238446079 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Lazy-loading 'services' on Instance uuid fb0d234a-9ad9-4818-84b6-fdc900c89f89 {{(pid=123596) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 19:12:41.530287 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-c867f15b-3ab1-4351-bced-540238446079 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] 10.222.0.43 "DELETE /compute/v2.1/servers/fb0d234a-9ad9-4818-84b6-fdc900c89f89/os-volume_attachments/4cd39211-ae6a-46ef-99ac-a6371916c932" status: 202 len: 0 microversion: 2.1 time: 0.181357 Oct 04 19:12:41.531143 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3414/6460] 10.222.0.43 () {58 vars in 1416 bytes} [Tue Oct 4 19:12:41 2022] DELETE /compute/v2.1/servers/fb0d234a-9ad9-4818-84b6-fdc900c89f89/os-volume_attachments/4cd39211-ae6a-46ef-99ac-a6371916c932 => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:12:47.340766 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-cc95983b-749f-435e-98c3-21c97f42146b tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:12:47.341392 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-cc95983b-749f-435e-98c3-21c97f42146b tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] [instance: fb0d234a-9ad9-4818-84b6-fdc900c89f89] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:12:47.351146 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:12:47.352003 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:12:47.353598 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cc95983b-749f-435e-98c3-21c97f42146b tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:47.354388 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cc95983b-749f-435e-98c3-21c97f42146b tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:47.355153 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cc95983b-749f-435e-98c3-21c97f42146b tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:47.356123 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cc95983b-749f-435e-98c3-21c97f42146b tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:47.356931 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cc95983b-749f-435e-98c3-21c97f42146b tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:47.357609 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cc95983b-749f-435e-98c3-21c97f42146b tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:47.394680 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-cc95983b-749f-435e-98c3-21c97f42146b tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] [instance: fb0d234a-9ad9-4818-84b6-fdc900c89f89] Going to try to terminate instance {{(pid=123595) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 19:12:47.502763 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-cc95983b-749f-435e-98c3-21c97f42146b tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] 10.222.0.43 "DELETE /compute/v2.1/servers/fb0d234a-9ad9-4818-84b6-fdc900c89f89" status: 204 len: 0 microversion: 2.1 time: 0.167876 Oct 04 19:12:47.504504 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3047/6461] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 19:12:47 2022] DELETE /compute/v2.1/servers/fb0d234a-9ad9-4818-84b6-fdc900c89f89 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:12:47.515698 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-3f96d375-91c8-4f70-849d-751eb7004d4a tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:12:47.516451 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-3f96d375-91c8-4f70-849d-751eb7004d4a tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] [instance: fb0d234a-9ad9-4818-84b6-fdc900c89f89] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:12:47.523468 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3f96d375-91c8-4f70-849d-751eb7004d4a tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:47.524767 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3f96d375-91c8-4f70-849d-751eb7004d4a tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:47.525621 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3f96d375-91c8-4f70-849d-751eb7004d4a tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:47.526588 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3f96d375-91c8-4f70-849d-751eb7004d4a tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:47.527902 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3f96d375-91c8-4f70-849d-751eb7004d4a tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:47.528569 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3f96d375-91c8-4f70-849d-751eb7004d4a tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:47.812853 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-3f96d375-91c8-4f70-849d-751eb7004d4a tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ac079f44ac4d48b3eb48ee17a5c58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dca72b323a14a33b422400007a816cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:12:47.823158 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-3f96d375-91c8-4f70-849d-751eb7004d4a tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] 10.222.0.43 "GET /compute/v2.1/servers/fb0d234a-9ad9-4818-84b6-fdc900c89f89" status: 200 len: 1513 microversion: 2.1 time: 0.313280 Oct 04 19:12:47.824113 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3415/6462] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:12:47 2022] GET /compute/v2.1/servers/fb0d234a-9ad9-4818-84b6-fdc900c89f89 => generated 1513 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:12:48.848553 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-f57bdf62-28d7-4517-a95d-758809f22d02 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:12:48.849558 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-f57bdf62-28d7-4517-a95d-758809f22d02 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] [instance: fb0d234a-9ad9-4818-84b6-fdc900c89f89] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:12:48.857618 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f57bdf62-28d7-4517-a95d-758809f22d02 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:48.858098 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f57bdf62-28d7-4517-a95d-758809f22d02 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:48.858544 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f57bdf62-28d7-4517-a95d-758809f22d02 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:48.859283 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f57bdf62-28d7-4517-a95d-758809f22d02 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:48.859740 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f57bdf62-28d7-4517-a95d-758809f22d02 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:48.860171 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f57bdf62-28d7-4517-a95d-758809f22d02 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:49.009367 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-f57bdf62-28d7-4517-a95d-758809f22d02 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ac079f44ac4d48b3eb48ee17a5c58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dca72b323a14a33b422400007a816cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:12:49.018772 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-f57bdf62-28d7-4517-a95d-758809f22d02 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] 10.222.0.43 "GET /compute/v2.1/servers/fb0d234a-9ad9-4818-84b6-fdc900c89f89" status: 200 len: 1513 microversion: 2.1 time: 0.175288 Oct 04 19:12:49.019056 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3048/6463] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:12:48 2022] GET /compute/v2.1/servers/fb0d234a-9ad9-4818-84b6-fdc900c89f89 => generated 1513 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:12:49.892339 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-23cb9428-11d1-46cd-845e-9a2c1d68cf89 req-32bdd793-b697-4e17-8b67-a5ac1dc00842 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb0d234a-9ad9-4818-84b6-fdc900c89f89", "name": "network-vif-deleted", "tag": "ae0b74d0-9b58-42cd-b8e2-aad51dd28c47"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:12:49.908649 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-23cb9428-11d1-46cd-845e-9a2c1d68cf89 req-32bdd793-b697-4e17-8b67-a5ac1dc00842 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:49.909432 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-23cb9428-11d1-46cd-845e-9a2c1d68cf89 req-32bdd793-b697-4e17-8b67-a5ac1dc00842 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:49.910462 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-23cb9428-11d1-46cd-845e-9a2c1d68cf89 req-32bdd793-b697-4e17-8b67-a5ac1dc00842 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:49.927917 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-23cb9428-11d1-46cd-845e-9a2c1d68cf89 req-32bdd793-b697-4e17-8b67-a5ac1dc00842 service nova] Creating event network-vif-deleted:ae0b74d0-9b58-42cd-b8e2-aad51dd28c47 for instance fb0d234a-9ad9-4818-84b6-fdc900c89f89 on n-h2-851028-13 Oct 04 19:12:49.934921 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-23cb9428-11d1-46cd-845e-9a2c1d68cf89 req-32bdd793-b697-4e17-8b67-a5ac1dc00842 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049212 Oct 04 19:12:49.939394 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3416/6464] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:12:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:12:50.044245 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-c99713a3-ad77-4a83-a400-cb01d2988e26 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:12:50.045514 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-c99713a3-ad77-4a83-a400-cb01d2988e26 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] [instance: fb0d234a-9ad9-4818-84b6-fdc900c89f89] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:12:50.055656 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c99713a3-ad77-4a83-a400-cb01d2988e26 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:50.056434 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c99713a3-ad77-4a83-a400-cb01d2988e26 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:50.057465 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c99713a3-ad77-4a83-a400-cb01d2988e26 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:50.058428 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c99713a3-ad77-4a83-a400-cb01d2988e26 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:50.059091 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c99713a3-ad77-4a83-a400-cb01d2988e26 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:50.059729 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c99713a3-ad77-4a83-a400-cb01d2988e26 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:50.137067 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c99713a3-ad77-4a83-a400-cb01d2988e26 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:50.138443 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c99713a3-ad77-4a83-a400-cb01d2988e26 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:50.138901 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c99713a3-ad77-4a83-a400-cb01d2988e26 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:50.139369 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.objects.instance [None req-c99713a3-ad77-4a83-a400-cb01d2988e26 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Lazy-loading 'fault' on Instance uuid fb0d234a-9ad9-4818-84b6-fdc900c89f89 {{(pid=123595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 19:12:50.223345 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-c99713a3-ad77-4a83-a400-cb01d2988e26 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ac079f44ac4d48b3eb48ee17a5c58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dca72b323a14a33b422400007a816cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:12:50.231858 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-c99713a3-ad77-4a83-a400-cb01d2988e26 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] 10.222.0.43 "GET /compute/v2.1/servers/fb0d234a-9ad9-4818-84b6-fdc900c89f89" status: 200 len: 1308 microversion: 2.1 time: 0.193066 Oct 04 19:12:50.232827 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3049/6465] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:12:50 2022] GET /compute/v2.1/servers/fb0d234a-9ad9-4818-84b6-fdc900c89f89 => generated 1308 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:12:51.265252 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-8d03916c-f6a9-4c39-bd3a-965d110d0894 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:12:51.266919 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-8d03916c-f6a9-4c39-bd3a-965d110d0894 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] [instance: fb0d234a-9ad9-4818-84b6-fdc900c89f89] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:12:51.286593 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8d03916c-f6a9-4c39-bd3a-965d110d0894 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:51.287276 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8d03916c-f6a9-4c39-bd3a-965d110d0894 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:51.287994 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8d03916c-f6a9-4c39-bd3a-965d110d0894 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:51.289032 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8d03916c-f6a9-4c39-bd3a-965d110d0894 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:51.291512 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8d03916c-f6a9-4c39-bd3a-965d110d0894 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:51.294307 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8d03916c-f6a9-4c39-bd3a-965d110d0894 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:51.330285 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-8d03916c-f6a9-4c39-bd3a-965d110d0894 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] HTTP exception thrown: Instance fb0d234a-9ad9-4818-84b6-fdc900c89f89 could not be found. Oct 04 19:12:51.332245 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-8d03916c-f6a9-4c39-bd3a-965d110d0894 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Request method failure captured: Oct 04 19:12:51.332245 n-d-851028-13 devstack@n-api.service[123596]: request: GET /compute/v2.1/servers/fb0d234a-9ad9-4818-84b6-fdc900c89f89 HTTP/1.1 Oct 04 19:12:51.332245 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 19:12:51.332245 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 19:12:51.332245 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 19:12:51.332245 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 19:12:51.332245 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 19:12:51.332245 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 19:12:51.332245 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 19:12:51.332245 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 19:12:51.332245 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPITtuOU1kGAU2cWVl9hcn8O705PYsf8kG7oB5E1XeZRacWJ1TjUt7vEKzSv9V2dSWehaEQud_AENJSgRK4CF3g6RZNw4YNDFxVfWsKTPxq1_0YUWDoEUEJejOLJz1OjXfSvZiyXGdbkSkmh9y8dX-1rRD1J72ZALxPzqJPHf4yr2uUQ Oct 04 19:12:51.332245 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 19:12:51.332245 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 19:12:51.332245 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 19:12:51.332245 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 19:12:51.332245 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 19:12:51.332245 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 19:12:51.332245 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: 6dca72b323a14a33b422400007a816cc Oct 04 19:12:51.332245 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1812333119 Oct 04 19:12:51.332245 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 19:12:51.332245 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 19:12:51.332245 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/6dca72b323a14a33b422400007a816cc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_6dca72b323a14a33b422400007a816cc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/6dca72b323a14a33b422400007a816cc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/6dca72b323a14a33b422400007a816cc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 19:12:51.332245 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-VolumesSnapshotTestJSON-1812333119 Oct 04 19:12:51.332245 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: 6dca72b323a14a33b422400007a816cc Oct 04 19:12:51.332245 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1812333119 Oct 04 19:12:51.332245 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-VolumesSnapshotTestJSON-1812333119-project Oct 04 19:12:51.332245 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 19:12:51.332245 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 19:12:51.332245 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 22ac079f44ac4d48b3eb48ee17a5c58d Oct 04 19:12:51.332245 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-VolumesSnapshotTestJSON-1812333119-project Oct 04 19:12:51.332245 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 19:12:51.332245 n-d-851028-13 devstack@n-api.service[123596]: exception: Instance fb0d234a-9ad9-4818-84b6-fdc900c89f89 could not be found. Oct 04 19:12:51.332245 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': 'fb0d234a-9ad9-4818-84b6-fdc900c89f89'} Oct 04 19:12:51.332245 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:12:51.332245 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:12:51.332245 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:12:51.332245 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:12:51.332245 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:12:51.332245 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:12:51.332245 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:12:51.332245 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:12:51.332245 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:12:51.332245 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:12:51.332245 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb0d234a-9ad9-4818-84b6-fdc900c89f89 could not be found. Oct 04 19:12:51.332245 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:12:51.332245 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:12:51.332245 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:12:51.332245 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:12:51.332245 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:12:51.332245 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:12:51.332245 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:12:51.332245 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:12:51.332245 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:12:51.332245 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:12:51.332245 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:12:51.332245 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:12:51.332245 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:12:51.332245 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:12:51.332245 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:12:51.332245 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:12:51.332245 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb0d234a-9ad9-4818-84b6-fdc900c89f89 could not be found. Oct 04 19:12:51.332245 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:12:51.332245 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:12:51.332245 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:12:51.337506 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:12:51.337506 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:12:51.337506 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:12:51.337506 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:12:51.337506 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:12:51.337506 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb0d234a-9ad9-4818-84b6-fdc900c89f89 could not be found. Oct 04 19:12:51.337506 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:12:51.337506 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-8d03916c-f6a9-4c39-bd3a-965d110d0894 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] Returning 404 to user: Instance fb0d234a-9ad9-4818-84b6-fdc900c89f89 could not be found. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:12:51.337506 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-8d03916c-f6a9-4c39-bd3a-965d110d0894 tempest-VolumesSnapshotTestJSON-1812333119 tempest-VolumesSnapshotTestJSON-1812333119-project] 10.222.0.43 "GET /compute/v2.1/servers/fb0d234a-9ad9-4818-84b6-fdc900c89f89" status: 404 len: 111 microversion: 2.1 time: 0.082878 Oct 04 19:12:51.344683 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3417/6466] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:12:51 2022] GET /compute/v2.1/servers/fb0d234a-9ad9-4818-84b6-fdc900c89f89 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:14:05.444480 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:14:05.445424 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:14:05.629182 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-8dddffe8-bf6e-4e72-bc94-180d62a43f00 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Action: 'create', calling method: .version_select at 0x7fb21edbb5e0>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-2038855990", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDw2v7buPx52JzZsChg2kySJ98sbTuRh4HmJ3Yd/PVwPaI0pD197D6YJMsWBz0dPxaijl8rdIysZA+Vj6JAC8XF3NlcTj0IthAf9hrU3ifiO4pebbBx4cT0ceRv4MpowJQ=="}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:14:05.645441 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-8dddffe8-bf6e-4e72-bc94-180d62a43f00 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Getting quotas for project d8a8fc3734114650b0f84fc940836ea9. Resources: {'key_pairs'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:14:05.651197 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-8dddffe8-bf6e-4e72-bc94-180d62a43f00 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Getting quotas for user 3cfe96b673c04bc0803c2751988e0cd6 and project d8a8fc3734114650b0f84fc940836ea9. Resources: {'key_pairs'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:14:05.677583 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-8dddffe8-bf6e-4e72-bc94-180d62a43f00 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.235156 Oct 04 19:14:05.684300 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3050/6467] 10.222.0.43 () {60 vars in 1159 bytes} [Tue Oct 4 19:14:05 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:14:12.243649 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-a4307524-0ee5-4803-968d-dbbfef83b5fa tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-649906329-access_point-54932014", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452", "networks": [{"uuid": "03394db5-b133-415d-b1ea-ffa70f7f95ec"}], "key_name": "tempest-TestSecurityGroupsBasicOps-2038855990", "security_groups": [{"name": "tempest-secgroup_access--555839213"}, {"name": "tempest-secgroup_general--3018755"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:14:12.271094 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_api:SELECT=8 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:14:12.272342 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=19,nova_cell1:INSERT=1 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:14:12.274860 n-d-851028-13 devstack@n-api.service[123596]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 19:14:12.275332 n-d-851028-13 devstack@n-api.service[123596]: Tue Oct 4 19:14:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.43) !!! Oct 04 19:14:12.277163 n-d-851028-13 devstack@n-api.service[123596]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 19:14:12.277616 n-d-851028-13 devstack@n-api.service[123596]: Tue Oct 4 19:14:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.43) !!! Oct 04 19:14:12.838863 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.network.neutron [None req-a4307524-0ee5-4803-968d-dbbfef83b5fa tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] validate_networks() for [('03394db5-b133-415d-b1ea-ffa70f7f95ec', None, None, None, None, None)] {{(pid=123596) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 19:14:13.371372 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-a4307524-0ee5-4803-968d-dbbfef83b5fa tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Flavor limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:14:13.372520 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-a4307524-0ee5-4803-968d-dbbfef83b5fa tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Image limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:14:13.373272 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-a4307524-0ee5-4803-968d-dbbfef83b5fa tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Flavor pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:14:13.374197 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-a4307524-0ee5-4803-968d-dbbfef83b5fa tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Image pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:14:13.375147 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-a4307524-0ee5-4803-968d-dbbfef83b5fa tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:14:13.386791 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a4307524-0ee5-4803-968d-dbbfef83b5fa tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:14:13.387420 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a4307524-0ee5-4803-968d-dbbfef83b5fa tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:14:13.388106 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a4307524-0ee5-4803-968d-dbbfef83b5fa tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:14:13.389080 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a4307524-0ee5-4803-968d-dbbfef83b5fa tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:14:13.389822 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a4307524-0ee5-4803-968d-dbbfef83b5fa tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:14:13.390487 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a4307524-0ee5-4803-968d-dbbfef83b5fa tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:14:13.410485 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-a4307524-0ee5-4803-968d-dbbfef83b5fa tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Getting quotas for project d8a8fc3734114650b0f84fc940836ea9. Resources: {'ram', 'cores', 'instances'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:14:13.417642 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-a4307524-0ee5-4803-968d-dbbfef83b5fa tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Getting quotas for user 3cfe96b673c04bc0803c2751988e0cd6 and project d8a8fc3734114650b0f84fc940836ea9. Resources: {'ram', 'cores', 'instances'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:14:13.444887 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-a4307524-0ee5-4803-968d-dbbfef83b5fa tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Going to run 1 instances... {{(pid=123596) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 19:14:13.447798 n-d-851028-13 devstack@n-api.service[123596]: WARNING nova.utils [None req-a4307524-0ee5-4803-968d-dbbfef83b5fa tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-649906329-access_point-54932014 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-649906329-acc Oct 04 19:14:13.449099 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-a4307524-0ee5-4803-968d-dbbfef83b5fa tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] [instance: d0b88d36-472f-40fb-b98e-0a13425443b0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e8943ec5-4038-4d4b-b9b9-2415a79f5243',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123596) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 19:14:13.515686 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-a4307524-0ee5-4803-968d-dbbfef83b5fa tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 454 microversion: 2.1 time: 1.279749 Oct 04 19:14:13.516456 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3418/6468] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 19:14:12 2022] POST /compute/v2.1/servers => generated 454 bytes in 1281 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 19:14:13.528432 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-d07843bf-d098-4f89-b444-08d6a7dae8bb tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:14:13.529881 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-d07843bf-d098-4f89-b444-08d6a7dae8bb tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] [instance: d0b88d36-472f-40fb-b98e-0a13425443b0] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:14:13.613625 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-d07843bf-d098-4f89-b444-08d6a7dae8bb tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfe96b673c04bc0803c2751988e0cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8fc3734114650b0f84fc940836ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:14:13.630055 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-d07843bf-d098-4f89-b444-08d6a7dae8bb tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] 10.222.0.43 "GET /compute/v2.1/servers/d0b88d36-472f-40fb-b98e-0a13425443b0" status: 200 len: 1292 microversion: 2.1 time: 0.105894 Oct 04 19:14:13.630734 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3051/6469] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:14:13 2022] GET /compute/v2.1/servers/d0b88d36-472f-40fb-b98e-0a13425443b0 => generated 1292 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:14:14.652350 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-1b2d482b-a09c-4d3f-94b9-e4715cab85b6 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:14:14.653058 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-1b2d482b-a09c-4d3f-94b9-e4715cab85b6 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] [instance: d0b88d36-472f-40fb-b98e-0a13425443b0] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:14:14.664760 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1b2d482b-a09c-4d3f-94b9-e4715cab85b6 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:14:14.666024 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1b2d482b-a09c-4d3f-94b9-e4715cab85b6 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:14:14.666534 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1b2d482b-a09c-4d3f-94b9-e4715cab85b6 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:14:14.667317 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1b2d482b-a09c-4d3f-94b9-e4715cab85b6 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:14:14.667870 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1b2d482b-a09c-4d3f-94b9-e4715cab85b6 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:14:14.668365 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1b2d482b-a09c-4d3f-94b9-e4715cab85b6 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:14:14.763808 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-1b2d482b-a09c-4d3f-94b9-e4715cab85b6 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfe96b673c04bc0803c2751988e0cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8fc3734114650b0f84fc940836ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:14:14.786115 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-1b2d482b-a09c-4d3f-94b9-e4715cab85b6 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] 10.222.0.43 "GET /compute/v2.1/servers/d0b88d36-472f-40fb-b98e-0a13425443b0" status: 200 len: 1344 microversion: 2.1 time: 0.138111 Oct 04 19:14:14.786703 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3419/6470] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:14:14 2022] GET /compute/v2.1/servers/d0b88d36-472f-40fb-b98e-0a13425443b0 => generated 1344 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:14:15.812300 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-ee78fe23-005d-4d19-96e1-affb3c8685f8 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:14:15.812940 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-ee78fe23-005d-4d19-96e1-affb3c8685f8 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] [instance: d0b88d36-472f-40fb-b98e-0a13425443b0] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:14:15.821101 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ee78fe23-005d-4d19-96e1-affb3c8685f8 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:14:15.822220 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ee78fe23-005d-4d19-96e1-affb3c8685f8 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:14:15.822626 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ee78fe23-005d-4d19-96e1-affb3c8685f8 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:14:15.824479 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ee78fe23-005d-4d19-96e1-affb3c8685f8 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:14:15.824946 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ee78fe23-005d-4d19-96e1-affb3c8685f8 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:14:15.829079 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ee78fe23-005d-4d19-96e1-affb3c8685f8 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:14:16.099628 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-ee78fe23-005d-4d19-96e1-affb3c8685f8 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfe96b673c04bc0803c2751988e0cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8fc3734114650b0f84fc940836ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:14:16.111848 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-ee78fe23-005d-4d19-96e1-affb3c8685f8 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] 10.222.0.43 "GET /compute/v2.1/servers/d0b88d36-472f-40fb-b98e-0a13425443b0" status: 200 len: 1466 microversion: 2.1 time: 0.303971 Oct 04 19:14:16.113354 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3052/6471] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:14:15 2022] GET /compute/v2.1/servers/d0b88d36-472f-40fb-b98e-0a13425443b0 => generated 1466 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:14:17.003042 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-e3549c4e-7b74-4878-a5de-d7f6d43eb2d1 req-f24fa2b7-a0d2-48d7-8c4c-a57ff0fafa73 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0b88d36-472f-40fb-b98e-0a13425443b0", "tag": "76ce889e-c1a1-4d3b-ac79-5b06427b78b3"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:14:17.012502 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-e3549c4e-7b74-4878-a5de-d7f6d43eb2d1 req-f24fa2b7-a0d2-48d7-8c4c-a57ff0fafa73 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:14:17.012984 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-e3549c4e-7b74-4878-a5de-d7f6d43eb2d1 req-f24fa2b7-a0d2-48d7-8c4c-a57ff0fafa73 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:14:17.013451 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-e3549c4e-7b74-4878-a5de-d7f6d43eb2d1 req-f24fa2b7-a0d2-48d7-8c4c-a57ff0fafa73 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:14:17.027445 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-e3549c4e-7b74-4878-a5de-d7f6d43eb2d1 req-f24fa2b7-a0d2-48d7-8c4c-a57ff0fafa73 service nova] Creating event network-changed:76ce889e-c1a1-4d3b-ac79-5b06427b78b3 for instance d0b88d36-472f-40fb-b98e-0a13425443b0 on n-h2-851028-13 Oct 04 19:14:17.032406 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-e3549c4e-7b74-4878-a5de-d7f6d43eb2d1 req-f24fa2b7-a0d2-48d7-8c4c-a57ff0fafa73 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.199330 Oct 04 19:14:17.033023 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3420/6472] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:14:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:14:17.137052 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-a778edf9-3997-4fad-9fde-4ea21d10e64b tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:14:17.137947 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-a778edf9-3997-4fad-9fde-4ea21d10e64b tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] [instance: d0b88d36-472f-40fb-b98e-0a13425443b0] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:14:17.146780 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a778edf9-3997-4fad-9fde-4ea21d10e64b tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:14:17.147345 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a778edf9-3997-4fad-9fde-4ea21d10e64b tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:14:17.147826 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a778edf9-3997-4fad-9fde-4ea21d10e64b tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:14:17.148642 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a778edf9-3997-4fad-9fde-4ea21d10e64b tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:14:17.149312 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a778edf9-3997-4fad-9fde-4ea21d10e64b tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:14:17.149858 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a778edf9-3997-4fad-9fde-4ea21d10e64b tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:14:17.427237 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-a778edf9-3997-4fad-9fde-4ea21d10e64b tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfe96b673c04bc0803c2751988e0cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8fc3734114650b0f84fc940836ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:14:17.435756 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-a778edf9-3997-4fad-9fde-4ea21d10e64b tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] 10.222.0.43 "GET /compute/v2.1/servers/d0b88d36-472f-40fb-b98e-0a13425443b0" status: 200 len: 1466 microversion: 2.1 time: 0.304222 Oct 04 19:14:17.436340 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3053/6473] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:14:17 2022] GET /compute/v2.1/servers/d0b88d36-472f-40fb-b98e-0a13425443b0 => generated 1466 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:14:18.465736 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-839ac19b-27cb-4cdf-b740-0d246a255197 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:14:18.466785 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-839ac19b-27cb-4cdf-b740-0d246a255197 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] [instance: d0b88d36-472f-40fb-b98e-0a13425443b0] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:14:18.473557 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-839ac19b-27cb-4cdf-b740-0d246a255197 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:14:18.474073 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-839ac19b-27cb-4cdf-b740-0d246a255197 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:14:18.474513 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-839ac19b-27cb-4cdf-b740-0d246a255197 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:14:18.475247 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-839ac19b-27cb-4cdf-b740-0d246a255197 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:14:18.475677 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-839ac19b-27cb-4cdf-b740-0d246a255197 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:14:18.476310 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-839ac19b-27cb-4cdf-b740-0d246a255197 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:14:18.906539 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-839ac19b-27cb-4cdf-b740-0d246a255197 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfe96b673c04bc0803c2751988e0cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8fc3734114650b0f84fc940836ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:14:18.915464 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-839ac19b-27cb-4cdf-b740-0d246a255197 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] 10.222.0.43 "GET /compute/v2.1/servers/d0b88d36-472f-40fb-b98e-0a13425443b0" status: 200 len: 1466 microversion: 2.1 time: 0.455087 Oct 04 19:14:18.916049 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3421/6474] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:14:18 2022] GET /compute/v2.1/servers/d0b88d36-472f-40fb-b98e-0a13425443b0 => generated 1466 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:14:19.938366 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-e3d65ac2-34d2-4639-b320-d7b3c89cf453 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:14:19.939008 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-e3d65ac2-34d2-4639-b320-d7b3c89cf453 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] [instance: d0b88d36-472f-40fb-b98e-0a13425443b0] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:14:19.945517 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e3d65ac2-34d2-4639-b320-d7b3c89cf453 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:14:19.946002 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e3d65ac2-34d2-4639-b320-d7b3c89cf453 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:14:19.947071 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e3d65ac2-34d2-4639-b320-d7b3c89cf453 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:14:19.947770 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e3d65ac2-34d2-4639-b320-d7b3c89cf453 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:14:19.948235 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e3d65ac2-34d2-4639-b320-d7b3c89cf453 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:14:19.948669 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e3d65ac2-34d2-4639-b320-d7b3c89cf453 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:14:20.388200 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-e3d65ac2-34d2-4639-b320-d7b3c89cf453 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfe96b673c04bc0803c2751988e0cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8fc3734114650b0f84fc940836ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:14:20.396401 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-e3d65ac2-34d2-4639-b320-d7b3c89cf453 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] 10.222.0.43 "GET /compute/v2.1/servers/d0b88d36-472f-40fb-b98e-0a13425443b0" status: 200 len: 1466 microversion: 2.1 time: 0.462124 Oct 04 19:14:20.396991 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3054/6475] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:14:19 2022] GET /compute/v2.1/servers/d0b88d36-472f-40fb-b98e-0a13425443b0 => generated 1466 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:14:21.419626 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-16d93d38-6e33-49f3-975e-ee14d8462884 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:14:21.420232 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-16d93d38-6e33-49f3-975e-ee14d8462884 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] [instance: d0b88d36-472f-40fb-b98e-0a13425443b0] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:14:21.427106 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-16d93d38-6e33-49f3-975e-ee14d8462884 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:14:21.427590 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-16d93d38-6e33-49f3-975e-ee14d8462884 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:14:21.428030 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-16d93d38-6e33-49f3-975e-ee14d8462884 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:14:21.428780 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-16d93d38-6e33-49f3-975e-ee14d8462884 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:14:21.429207 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-16d93d38-6e33-49f3-975e-ee14d8462884 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:14:21.429636 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-16d93d38-6e33-49f3-975e-ee14d8462884 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:14:21.569275 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-16d93d38-6e33-49f3-975e-ee14d8462884 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfe96b673c04bc0803c2751988e0cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8fc3734114650b0f84fc940836ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:14:21.576994 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-16d93d38-6e33-49f3-975e-ee14d8462884 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] 10.222.0.43 "GET /compute/v2.1/servers/d0b88d36-472f-40fb-b98e-0a13425443b0" status: 200 len: 1466 microversion: 2.1 time: 0.161757 Oct 04 19:14:21.577580 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3422/6476] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:14:21 2022] GET /compute/v2.1/servers/d0b88d36-472f-40fb-b98e-0a13425443b0 => generated 1466 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:14:22.458354 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-ffb83e0d-cf83-481a-880b-914f4ed68d8b req-6f05245c-e059-4681-bf39-249f090b26b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0b88d36-472f-40fb-b98e-0a13425443b0", "name": "network-vif-plugged", "status": "completed", "tag": "76ce889e-c1a1-4d3b-ac79-5b06427b78b3"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:14:22.468700 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-ffb83e0d-cf83-481a-880b-914f4ed68d8b req-6f05245c-e059-4681-bf39-249f090b26b2 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:14:22.469429 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-ffb83e0d-cf83-481a-880b-914f4ed68d8b req-6f05245c-e059-4681-bf39-249f090b26b2 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:14:22.469854 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-ffb83e0d-cf83-481a-880b-914f4ed68d8b req-6f05245c-e059-4681-bf39-249f090b26b2 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:14:22.481357 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-ffb83e0d-cf83-481a-880b-914f4ed68d8b req-6f05245c-e059-4681-bf39-249f090b26b2 service nova] Creating event network-vif-plugged:76ce889e-c1a1-4d3b-ac79-5b06427b78b3 for instance d0b88d36-472f-40fb-b98e-0a13425443b0 on n-h2-851028-13 Oct 04 19:14:22.486737 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-ffb83e0d-cf83-481a-880b-914f4ed68d8b req-6f05245c-e059-4681-bf39-249f090b26b2 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.189998 Oct 04 19:14:22.487384 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3055/6477] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:14:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:14:22.601473 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-b6bd3fac-b17a-450a-a94d-ac9868432a00 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:14:22.602095 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-b6bd3fac-b17a-450a-a94d-ac9868432a00 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] [instance: d0b88d36-472f-40fb-b98e-0a13425443b0] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:14:22.612933 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b6bd3fac-b17a-450a-a94d-ac9868432a00 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:14:22.612933 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b6bd3fac-b17a-450a-a94d-ac9868432a00 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:14:22.612933 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b6bd3fac-b17a-450a-a94d-ac9868432a00 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:14:22.612933 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b6bd3fac-b17a-450a-a94d-ac9868432a00 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:14:22.614265 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b6bd3fac-b17a-450a-a94d-ac9868432a00 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:14:22.614265 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b6bd3fac-b17a-450a-a94d-ac9868432a00 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:14:22.763539 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-b6bd3fac-b17a-450a-a94d-ac9868432a00 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfe96b673c04bc0803c2751988e0cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8fc3734114650b0f84fc940836ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:14:22.771513 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-b6bd3fac-b17a-450a-a94d-ac9868432a00 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] 10.222.0.43 "GET /compute/v2.1/servers/d0b88d36-472f-40fb-b98e-0a13425443b0" status: 200 len: 1466 microversion: 2.1 time: 0.175094 Oct 04 19:14:22.772088 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3423/6478] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:14:22 2022] GET /compute/v2.1/servers/d0b88d36-472f-40fb-b98e-0a13425443b0 => generated 1466 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:14:23.793058 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=6 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:14:23.798323 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-42927b9b-4900-493e-8aaf-da808f5b0ecb tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:14:23.799046 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-42927b9b-4900-493e-8aaf-da808f5b0ecb tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] [instance: d0b88d36-472f-40fb-b98e-0a13425443b0] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:14:23.806327 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-42927b9b-4900-493e-8aaf-da808f5b0ecb tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:14:23.806878 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-42927b9b-4900-493e-8aaf-da808f5b0ecb tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:14:23.807337 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-42927b9b-4900-493e-8aaf-da808f5b0ecb tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:14:23.808034 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-42927b9b-4900-493e-8aaf-da808f5b0ecb tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:14:23.808497 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-42927b9b-4900-493e-8aaf-da808f5b0ecb tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:14:23.808928 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-42927b9b-4900-493e-8aaf-da808f5b0ecb tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:14:23.970225 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-42927b9b-4900-493e-8aaf-da808f5b0ecb tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfe96b673c04bc0803c2751988e0cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8fc3734114650b0f84fc940836ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:14:23.978033 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-42927b9b-4900-493e-8aaf-da808f5b0ecb tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] 10.222.0.43 "GET /compute/v2.1/servers/d0b88d36-472f-40fb-b98e-0a13425443b0" status: 200 len: 1638 microversion: 2.1 time: 0.186789 Oct 04 19:14:23.978642 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3056/6479] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:14:23 2022] GET /compute/v2.1/servers/d0b88d36-472f-40fb-b98e-0a13425443b0 => generated 1638 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:14:24.000196 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-0390007b-83a1-45b1-b6ec-3db2688c4e47 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:14:24.000951 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-0390007b-83a1-45b1-b6ec-3db2688c4e47 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] [instance: d0b88d36-472f-40fb-b98e-0a13425443b0] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:14:24.003017 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=2 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:14:24.003923 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=6 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:14:24.011743 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0390007b-83a1-45b1-b6ec-3db2688c4e47 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:14:24.012242 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0390007b-83a1-45b1-b6ec-3db2688c4e47 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:14:24.012693 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0390007b-83a1-45b1-b6ec-3db2688c4e47 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:14:24.013446 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0390007b-83a1-45b1-b6ec-3db2688c4e47 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:14:24.013910 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0390007b-83a1-45b1-b6ec-3db2688c4e47 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:14:24.014408 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0390007b-83a1-45b1-b6ec-3db2688c4e47 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:14:24.156480 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-0390007b-83a1-45b1-b6ec-3db2688c4e47 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfe96b673c04bc0803c2751988e0cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8fc3734114650b0f84fc940836ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:14:24.164715 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-0390007b-83a1-45b1-b6ec-3db2688c4e47 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] 10.222.0.43 "GET /compute/v2.1/servers/d0b88d36-472f-40fb-b98e-0a13425443b0" status: 200 len: 1638 microversion: 2.1 time: 0.168457 Oct 04 19:14:24.165311 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3424/6480] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:14:23 2022] GET /compute/v2.1/servers/d0b88d36-472f-40fb-b98e-0a13425443b0 => generated 1638 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:14:24.187305 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-ae5a9d2e-e8ff-455b-a8d3-7ddec039a42a tempest-TestSecurityGroupsBasicOps-1532370090 tempest-TestSecurityGroupsBasicOps-1532370090-project-admin] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:14:24.187919 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-ae5a9d2e-e8ff-455b-a8d3-7ddec039a42a tempest-TestSecurityGroupsBasicOps-1532370090 tempest-TestSecurityGroupsBasicOps-1532370090-project-admin] [instance: d0b88d36-472f-40fb-b98e-0a13425443b0] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:14:24.194013 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ae5a9d2e-e8ff-455b-a8d3-7ddec039a42a tempest-TestSecurityGroupsBasicOps-1532370090 tempest-TestSecurityGroupsBasicOps-1532370090-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:14:24.194502 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ae5a9d2e-e8ff-455b-a8d3-7ddec039a42a tempest-TestSecurityGroupsBasicOps-1532370090 tempest-TestSecurityGroupsBasicOps-1532370090-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:14:24.194964 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ae5a9d2e-e8ff-455b-a8d3-7ddec039a42a tempest-TestSecurityGroupsBasicOps-1532370090 tempest-TestSecurityGroupsBasicOps-1532370090-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:14:24.195989 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ae5a9d2e-e8ff-455b-a8d3-7ddec039a42a tempest-TestSecurityGroupsBasicOps-1532370090 tempest-TestSecurityGroupsBasicOps-1532370090-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:14:24.196119 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ae5a9d2e-e8ff-455b-a8d3-7ddec039a42a tempest-TestSecurityGroupsBasicOps-1532370090 tempest-TestSecurityGroupsBasicOps-1532370090-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:14:24.196530 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ae5a9d2e-e8ff-455b-a8d3-7ddec039a42a tempest-TestSecurityGroupsBasicOps-1532370090 tempest-TestSecurityGroupsBasicOps-1532370090-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:14:24.438889 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-ae5a9d2e-e8ff-455b-a8d3-7ddec039a42a tempest-TestSecurityGroupsBasicOps-1532370090 tempest-TestSecurityGroupsBasicOps-1532370090-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/d0b88d36-472f-40fb-b98e-0a13425443b0" status: 200 len: 1791 microversion: 2.1 time: 0.255511 Oct 04 19:14:24.439486 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3057/6481] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:14:24 2022] GET /compute/v2.1/servers/d0b88d36-472f-40fb-b98e-0a13425443b0 => generated 1791 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:14:26.266836 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-63282cfb-2ace-41bd-9d67-adea2a641c88 req-dd4bb4a6-509f-432a-905d-bbd09bfce0f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0b88d36-472f-40fb-b98e-0a13425443b0", "tag": "76ce889e-c1a1-4d3b-ac79-5b06427b78b3"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:14:26.278243 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-63282cfb-2ace-41bd-9d67-adea2a641c88 req-dd4bb4a6-509f-432a-905d-bbd09bfce0f3 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:14:26.278958 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-63282cfb-2ace-41bd-9d67-adea2a641c88 req-dd4bb4a6-509f-432a-905d-bbd09bfce0f3 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:14:26.279607 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-63282cfb-2ace-41bd-9d67-adea2a641c88 req-dd4bb4a6-509f-432a-905d-bbd09bfce0f3 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:14:26.292590 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-63282cfb-2ace-41bd-9d67-adea2a641c88 req-dd4bb4a6-509f-432a-905d-bbd09bfce0f3 service nova] Creating event network-changed:76ce889e-c1a1-4d3b-ac79-5b06427b78b3 for instance d0b88d36-472f-40fb-b98e-0a13425443b0 on n-h2-851028-13 Oct 04 19:14:26.298941 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-63282cfb-2ace-41bd-9d67-adea2a641c88 req-dd4bb4a6-509f-432a-905d-bbd09bfce0f3 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.195416 Oct 04 19:14:26.304916 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3425/6482] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:14:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:15:07.300921 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-378b2d5d-bcb4-4921-a8a6-0746c20192ee tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-smoke-664000893", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452", "networks": [{"uuid": "14e03375-8490-4b53-acbe-f8ccdd44e85b"}], "key_name": "tempest-TestSecurityGroupsBasicOps-2038855990", "security_groups": []}, "os:scheduler_hints": {"different_host": ["d0b88d36-472f-40fb-b98e-0a13425443b0"]}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:15:07.326965 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:15:07.327954 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=32 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:15:07.373489 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.network.neutron [None req-378b2d5d-bcb4-4921-a8a6-0746c20192ee tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] validate_networks() for [('14e03375-8490-4b53-acbe-f8ccdd44e85b', None, None, None, None, None)] {{(pid=123595) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 19:15:07.956638 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-378b2d5d-bcb4-4921-a8a6-0746c20192ee tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Flavor limits 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:15:07.957066 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-378b2d5d-bcb4-4921-a8a6-0746c20192ee tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Image limits 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:15:07.957603 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-378b2d5d-bcb4-4921-a8a6-0746c20192ee tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Flavor pref 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:15:07.958053 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-378b2d5d-bcb4-4921-a8a6-0746c20192ee tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Image pref 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:15:07.958474 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-378b2d5d-bcb4-4921-a8a6-0746c20192ee tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:15:07.969222 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-378b2d5d-bcb4-4921-a8a6-0746c20192ee tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:07.969983 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-378b2d5d-bcb4-4921-a8a6-0746c20192ee tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:07.970427 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-378b2d5d-bcb4-4921-a8a6-0746c20192ee tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:07.971226 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-378b2d5d-bcb4-4921-a8a6-0746c20192ee tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:07.971876 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-378b2d5d-bcb4-4921-a8a6-0746c20192ee tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:07.972322 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-378b2d5d-bcb4-4921-a8a6-0746c20192ee tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:08.005991 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-378b2d5d-bcb4-4921-a8a6-0746c20192ee tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Getting quotas for project d8a8fc3734114650b0f84fc940836ea9. Resources: {'ram', 'cores', 'instances'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:15:08.013056 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-378b2d5d-bcb4-4921-a8a6-0746c20192ee tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Getting quotas for user 3cfe96b673c04bc0803c2751988e0cd6 and project d8a8fc3734114650b0f84fc940836ea9. Resources: {'ram', 'cores', 'instances'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:15:08.029592 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-378b2d5d-bcb4-4921-a8a6-0746c20192ee tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Going to run 1 instances... {{(pid=123595) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 19:15:08.032418 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-378b2d5d-bcb4-4921-a8a6-0746c20192ee tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] [instance: e94a031c-6f7a-4ca3-bfae-3af49304114f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e8943ec5-4038-4d4b-b9b9-2415a79f5243',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 19:15:08.119457 n-d-851028-13 devstack@n-api.service[123595]: ERROR oslo.messaging._drivers.impl_rabbit [None req-378b2d5d-bcb4-4921-a8a6-0746c20192ee tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] [ad49b5de-7934-46fc-8e8f-373f91b0bcd2] AMQP server on 10.222.0.43:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 19:15:09.131610 n-d-851028-13 devstack@n-api.service[123595]: INFO oslo.messaging._drivers.impl_rabbit [None req-378b2d5d-bcb4-4921-a8a6-0746c20192ee tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] [ad49b5de-7934-46fc-8e8f-373f91b0bcd2] Reconnected to AMQP server on 10.222.0.43:5672 via [amqp] client with port 42266. Oct 04 19:15:09.148112 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-378b2d5d-bcb4-4921-a8a6-0746c20192ee tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 361 microversion: 2.1 time: 1.859647 Oct 04 19:15:09.149478 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3058/6483] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 19:15:07 2022] POST /compute/v2.1/servers => generated 361 bytes in 1862 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 19:15:09.159229 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:15:09.159848 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=36 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:15:09.164514 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-0a8cf7a1-01aa-44b9-acf2-d50f40660313 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:15:09.165140 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-0a8cf7a1-01aa-44b9-acf2-d50f40660313 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] [instance: e94a031c-6f7a-4ca3-bfae-3af49304114f] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:15:09.253165 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-0a8cf7a1-01aa-44b9-acf2-d50f40660313 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfe96b673c04bc0803c2751988e0cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8fc3734114650b0f84fc940836ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:15:09.283374 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-0a8cf7a1-01aa-44b9-acf2-d50f40660313 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] 10.222.0.43 "GET /compute/v2.1/servers/e94a031c-6f7a-4ca3-bfae-3af49304114f" status: 200 len: 1241 microversion: 2.1 time: 0.126566 Oct 04 19:15:09.296634 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3426/6484] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:15:09 2022] GET /compute/v2.1/servers/e94a031c-6f7a-4ca3-bfae-3af49304114f => generated 1241 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:15:10.315666 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-4c3a194c-6374-40fa-8e3f-e3c5c03465b6 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:15:10.316974 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-4c3a194c-6374-40fa-8e3f-e3c5c03465b6 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] [instance: e94a031c-6f7a-4ca3-bfae-3af49304114f] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:15:10.327454 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4c3a194c-6374-40fa-8e3f-e3c5c03465b6 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:10.328282 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4c3a194c-6374-40fa-8e3f-e3c5c03465b6 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:10.328910 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4c3a194c-6374-40fa-8e3f-e3c5c03465b6 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:10.331068 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4c3a194c-6374-40fa-8e3f-e3c5c03465b6 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:10.332057 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4c3a194c-6374-40fa-8e3f-e3c5c03465b6 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:10.332661 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4c3a194c-6374-40fa-8e3f-e3c5c03465b6 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:10.438764 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-4c3a194c-6374-40fa-8e3f-e3c5c03465b6 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfe96b673c04bc0803c2751988e0cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8fc3734114650b0f84fc940836ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:15:10.449604 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-4c3a194c-6374-40fa-8e3f-e3c5c03465b6 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] 10.222.0.43 "GET /compute/v2.1/servers/e94a031c-6f7a-4ca3-bfae-3af49304114f" status: 200 len: 1293 microversion: 2.1 time: 0.137118 Oct 04 19:15:10.450806 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3059/6485] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:15:10 2022] GET /compute/v2.1/servers/e94a031c-6f7a-4ca3-bfae-3af49304114f => generated 1293 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:15:11.475825 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-35eabbc7-893f-4af0-a984-577b3b2ac046 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:15:11.476442 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-35eabbc7-893f-4af0-a984-577b3b2ac046 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] [instance: e94a031c-6f7a-4ca3-bfae-3af49304114f] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:15:11.485775 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-35eabbc7-893f-4af0-a984-577b3b2ac046 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:11.486621 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-35eabbc7-893f-4af0-a984-577b3b2ac046 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:11.487067 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-35eabbc7-893f-4af0-a984-577b3b2ac046 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:11.488174 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-35eabbc7-893f-4af0-a984-577b3b2ac046 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:11.488639 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-35eabbc7-893f-4af0-a984-577b3b2ac046 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:11.489447 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-35eabbc7-893f-4af0-a984-577b3b2ac046 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:11.585372 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-35eabbc7-893f-4af0-a984-577b3b2ac046 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfe96b673c04bc0803c2751988e0cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8fc3734114650b0f84fc940836ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:15:11.593441 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-35eabbc7-893f-4af0-a984-577b3b2ac046 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] 10.222.0.43 "GET /compute/v2.1/servers/e94a031c-6f7a-4ca3-bfae-3af49304114f" status: 200 len: 1299 microversion: 2.1 time: 0.121543 Oct 04 19:15:11.594187 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3427/6486] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:15:11 2022] GET /compute/v2.1/servers/e94a031c-6f7a-4ca3-bfae-3af49304114f => generated 1299 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:15:11.865966 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-52d5c4d0-dcc8-4311-bd4d-99e65bc1fb80 req-a2c80381-d957-457a-b811-a67aa0e6021b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e94a031c-6f7a-4ca3-bfae-3af49304114f", "tag": "96b636a6-46da-444f-be37-3bad038cd810"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:15:11.887783 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-52d5c4d0-dcc8-4311-bd4d-99e65bc1fb80 req-a2c80381-d957-457a-b811-a67aa0e6021b service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:11.889355 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-52d5c4d0-dcc8-4311-bd4d-99e65bc1fb80 req-a2c80381-d957-457a-b811-a67aa0e6021b service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:11.890940 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-52d5c4d0-dcc8-4311-bd4d-99e65bc1fb80 req-a2c80381-d957-457a-b811-a67aa0e6021b service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:11.906091 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-52d5c4d0-dcc8-4311-bd4d-99e65bc1fb80 req-a2c80381-d957-457a-b811-a67aa0e6021b service nova] Creating event network-changed:96b636a6-46da-444f-be37-3bad038cd810 for instance e94a031c-6f7a-4ca3-bfae-3af49304114f on n-h1-851028-13 Oct 04 19:15:11.912294 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-52d5c4d0-dcc8-4311-bd4d-99e65bc1fb80 req-a2c80381-d957-457a-b811-a67aa0e6021b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049384 Oct 04 19:15:11.913417 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3060/6487] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:15:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:15:12.618142 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-ba07f618-8699-4fe8-9eae-701d76d7f695 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:15:12.619633 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-ba07f618-8699-4fe8-9eae-701d76d7f695 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] [instance: e94a031c-6f7a-4ca3-bfae-3af49304114f] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:15:12.626666 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ba07f618-8699-4fe8-9eae-701d76d7f695 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:12.627169 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ba07f618-8699-4fe8-9eae-701d76d7f695 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:12.627616 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ba07f618-8699-4fe8-9eae-701d76d7f695 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:12.628335 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ba07f618-8699-4fe8-9eae-701d76d7f695 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:12.628798 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ba07f618-8699-4fe8-9eae-701d76d7f695 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:12.629258 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ba07f618-8699-4fe8-9eae-701d76d7f695 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:12.720158 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-ba07f618-8699-4fe8-9eae-701d76d7f695 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfe96b673c04bc0803c2751988e0cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8fc3734114650b0f84fc940836ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:15:12.728530 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-ba07f618-8699-4fe8-9eae-701d76d7f695 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] 10.222.0.43 "GET /compute/v2.1/servers/e94a031c-6f7a-4ca3-bfae-3af49304114f" status: 200 len: 1299 microversion: 2.1 time: 0.115343 Oct 04 19:15:12.729619 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3428/6488] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:15:12 2022] GET /compute/v2.1/servers/e94a031c-6f7a-4ca3-bfae-3af49304114f => generated 1299 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:15:13.753074 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-9e259913-1265-45f7-9f9b-7848cf95f540 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:15:13.753804 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-9e259913-1265-45f7-9f9b-7848cf95f540 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] [instance: e94a031c-6f7a-4ca3-bfae-3af49304114f] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:15:13.760177 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9e259913-1265-45f7-9f9b-7848cf95f540 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:13.760669 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9e259913-1265-45f7-9f9b-7848cf95f540 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:13.761135 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9e259913-1265-45f7-9f9b-7848cf95f540 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:13.761836 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9e259913-1265-45f7-9f9b-7848cf95f540 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:13.762299 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9e259913-1265-45f7-9f9b-7848cf95f540 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:13.762773 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9e259913-1265-45f7-9f9b-7848cf95f540 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:13.846450 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-9e259913-1265-45f7-9f9b-7848cf95f540 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfe96b673c04bc0803c2751988e0cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8fc3734114650b0f84fc940836ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:15:13.855498 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-9e259913-1265-45f7-9f9b-7848cf95f540 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] 10.222.0.43 "GET /compute/v2.1/servers/e94a031c-6f7a-4ca3-bfae-3af49304114f" status: 200 len: 1299 microversion: 2.1 time: 0.107459 Oct 04 19:15:13.856185 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3061/6489] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:15:13 2022] GET /compute/v2.1/servers/e94a031c-6f7a-4ca3-bfae-3af49304114f => generated 1299 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:15:14.054371 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-cdec7021-10be-4b60-872a-63cd41b7fa9f tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:15:14.055005 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-cdec7021-10be-4b60-872a-63cd41b7fa9f tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] [instance: a5f1279e-dd4c-43fa-9f32-8da8714f1ffd] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:15:14.061140 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cdec7021-10be-4b60-872a-63cd41b7fa9f tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:14.061644 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cdec7021-10be-4b60-872a-63cd41b7fa9f tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:14.062091 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cdec7021-10be-4b60-872a-63cd41b7fa9f tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:14.062792 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cdec7021-10be-4b60-872a-63cd41b7fa9f tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:14.063251 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cdec7021-10be-4b60-872a-63cd41b7fa9f tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:14.063683 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cdec7021-10be-4b60-872a-63cd41b7fa9f tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:14.096763 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-cdec7021-10be-4b60-872a-63cd41b7fa9f tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] [instance: a5f1279e-dd4c-43fa-9f32-8da8714f1ffd] Going to try to terminate instance {{(pid=123596) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 19:15:14.182461 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-cdec7021-10be-4b60-872a-63cd41b7fa9f tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] 10.222.0.43 "DELETE /compute/v2.1/servers/a5f1279e-dd4c-43fa-9f32-8da8714f1ffd" status: 204 len: 0 microversion: 2.1 time: 0.315408 Oct 04 19:15:14.183343 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3429/6490] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 19:15:13 2022] DELETE /compute/v2.1/servers/a5f1279e-dd4c-43fa-9f32-8da8714f1ffd => generated 0 bytes in 317 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:15:14.191930 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-e0333c9f-c16f-4dd2-af7d-9383221344f4 tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:15:14.192568 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-e0333c9f-c16f-4dd2-af7d-9383221344f4 tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] [instance: a5f1279e-dd4c-43fa-9f32-8da8714f1ffd] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:15:14.199525 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e0333c9f-c16f-4dd2-af7d-9383221344f4 tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:14.200021 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e0333c9f-c16f-4dd2-af7d-9383221344f4 tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:14.200466 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e0333c9f-c16f-4dd2-af7d-9383221344f4 tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:14.201216 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e0333c9f-c16f-4dd2-af7d-9383221344f4 tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:14.201680 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e0333c9f-c16f-4dd2-af7d-9383221344f4 tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:14.202119 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e0333c9f-c16f-4dd2-af7d-9383221344f4 tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:14.354790 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-e0333c9f-c16f-4dd2-af7d-9383221344f4 tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd7603a21403497bbdf24e6c2cfc31b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bee908d0a57d46b29fc0c6c07ecf365a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:15:14.363497 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-e0333c9f-c16f-4dd2-af7d-9383221344f4 tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] 10.222.0.43 "GET /compute/v2.1/servers/a5f1279e-dd4c-43fa-9f32-8da8714f1ffd" status: 200 len: 1733 microversion: 2.1 time: 0.175726 Oct 04 19:15:14.364083 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3062/6491] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:15:14 2022] GET /compute/v2.1/servers/a5f1279e-dd4c-43fa-9f32-8da8714f1ffd => generated 1733 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:15:14.880157 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-4a481bb3-dd85-4fa8-b3b4-7b9945c5e534 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:15:14.880884 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-4a481bb3-dd85-4fa8-b3b4-7b9945c5e534 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] [instance: e94a031c-6f7a-4ca3-bfae-3af49304114f] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:15:14.888261 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4a481bb3-dd85-4fa8-b3b4-7b9945c5e534 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:14.888768 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4a481bb3-dd85-4fa8-b3b4-7b9945c5e534 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:14.889248 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4a481bb3-dd85-4fa8-b3b4-7b9945c5e534 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:14.890032 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4a481bb3-dd85-4fa8-b3b4-7b9945c5e534 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:14.890481 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4a481bb3-dd85-4fa8-b3b4-7b9945c5e534 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:14.890993 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4a481bb3-dd85-4fa8-b3b4-7b9945c5e534 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:15.031717 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-4a481bb3-dd85-4fa8-b3b4-7b9945c5e534 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfe96b673c04bc0803c2751988e0cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8fc3734114650b0f84fc940836ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:15:15.040776 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-4a481bb3-dd85-4fa8-b3b4-7b9945c5e534 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] 10.222.0.43 "GET /compute/v2.1/servers/e94a031c-6f7a-4ca3-bfae-3af49304114f" status: 200 len: 1299 microversion: 2.1 time: 0.165713 Oct 04 19:15:15.054980 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3430/6492] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:15:14 2022] GET /compute/v2.1/servers/e94a031c-6f7a-4ca3-bfae-3af49304114f => generated 1299 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:15:15.392444 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-883c583c-fc8a-4a1d-8053-5591f918a2f1 tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:15:15.394130 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-883c583c-fc8a-4a1d-8053-5591f918a2f1 tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] [instance: a5f1279e-dd4c-43fa-9f32-8da8714f1ffd] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:15:15.403784 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-883c583c-fc8a-4a1d-8053-5591f918a2f1 tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:15.404549 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-883c583c-fc8a-4a1d-8053-5591f918a2f1 tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:15.405484 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-883c583c-fc8a-4a1d-8053-5591f918a2f1 tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:15.406197 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-883c583c-fc8a-4a1d-8053-5591f918a2f1 tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:15.407068 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-883c583c-fc8a-4a1d-8053-5591f918a2f1 tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:15.407538 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-883c583c-fc8a-4a1d-8053-5591f918a2f1 tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:15.594434 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-883c583c-fc8a-4a1d-8053-5591f918a2f1 tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd7603a21403497bbdf24e6c2cfc31b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bee908d0a57d46b29fc0c6c07ecf365a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:15:15.606764 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-883c583c-fc8a-4a1d-8053-5591f918a2f1 tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] 10.222.0.43 "GET /compute/v2.1/servers/a5f1279e-dd4c-43fa-9f32-8da8714f1ffd" status: 200 len: 1733 microversion: 2.1 time: 0.222480 Oct 04 19:15:15.626325 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3063/6493] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:15:15 2022] GET /compute/v2.1/servers/a5f1279e-dd4c-43fa-9f32-8da8714f1ffd => generated 1733 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:15:16.067341 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-269ac0b3-1cf7-4e55-bf3d-e1569b9c813e tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:15:16.068080 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-269ac0b3-1cf7-4e55-bf3d-e1569b9c813e tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] [instance: e94a031c-6f7a-4ca3-bfae-3af49304114f] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:15:16.076045 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-269ac0b3-1cf7-4e55-bf3d-e1569b9c813e tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:16.076538 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-269ac0b3-1cf7-4e55-bf3d-e1569b9c813e tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:16.076981 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-269ac0b3-1cf7-4e55-bf3d-e1569b9c813e tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:16.077933 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-269ac0b3-1cf7-4e55-bf3d-e1569b9c813e tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:16.078398 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-269ac0b3-1cf7-4e55-bf3d-e1569b9c813e tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:16.078837 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-269ac0b3-1cf7-4e55-bf3d-e1569b9c813e tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:16.182976 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-269ac0b3-1cf7-4e55-bf3d-e1569b9c813e tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfe96b673c04bc0803c2751988e0cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8fc3734114650b0f84fc940836ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:15:16.193002 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-269ac0b3-1cf7-4e55-bf3d-e1569b9c813e tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] 10.222.0.43 "GET /compute/v2.1/servers/e94a031c-6f7a-4ca3-bfae-3af49304114f" status: 200 len: 1299 microversion: 2.1 time: 0.129441 Oct 04 19:15:16.193973 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3431/6494] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:15:16 2022] GET /compute/v2.1/servers/e94a031c-6f7a-4ca3-bfae-3af49304114f => generated 1299 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:15:16.518552 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-bae5f9fa-6939-4fed-a00c-afed336220e7 req-dc74371a-f3d2-4f1b-91a2-35541f3fd336 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e94a031c-6f7a-4ca3-bfae-3af49304114f", "name": "network-vif-plugged", "status": "completed", "tag": "96b636a6-46da-444f-be37-3bad038cd810"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:15:16.539020 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-bae5f9fa-6939-4fed-a00c-afed336220e7 req-dc74371a-f3d2-4f1b-91a2-35541f3fd336 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:16.540749 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-bae5f9fa-6939-4fed-a00c-afed336220e7 req-dc74371a-f3d2-4f1b-91a2-35541f3fd336 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:16.541238 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-bae5f9fa-6939-4fed-a00c-afed336220e7 req-dc74371a-f3d2-4f1b-91a2-35541f3fd336 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:16.556458 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-bae5f9fa-6939-4fed-a00c-afed336220e7 req-dc74371a-f3d2-4f1b-91a2-35541f3fd336 service nova] Creating event network-vif-plugged:96b636a6-46da-444f-be37-3bad038cd810 for instance e94a031c-6f7a-4ca3-bfae-3af49304114f on n-h1-851028-13 Oct 04 19:15:16.563084 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-bae5f9fa-6939-4fed-a00c-afed336220e7 req-dc74371a-f3d2-4f1b-91a2-35541f3fd336 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048132 Oct 04 19:15:16.564434 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3064/6495] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:15:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:15:16.639249 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-e1c2b8fd-23ae-4d99-89aa-efd453fb9d65 tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:15:16.645586 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-e1c2b8fd-23ae-4d99-89aa-efd453fb9d65 tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] [instance: a5f1279e-dd4c-43fa-9f32-8da8714f1ffd] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:15:16.665516 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e1c2b8fd-23ae-4d99-89aa-efd453fb9d65 tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:16.669711 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e1c2b8fd-23ae-4d99-89aa-efd453fb9d65 tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:16.670336 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e1c2b8fd-23ae-4d99-89aa-efd453fb9d65 tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:16.672943 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e1c2b8fd-23ae-4d99-89aa-efd453fb9d65 tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:16.673554 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e1c2b8fd-23ae-4d99-89aa-efd453fb9d65 tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:16.675730 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e1c2b8fd-23ae-4d99-89aa-efd453fb9d65 tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:16.773769 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-e1c2b8fd-23ae-4d99-89aa-efd453fb9d65 tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd7603a21403497bbdf24e6c2cfc31b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bee908d0a57d46b29fc0c6c07ecf365a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:15:16.783479 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-e1c2b8fd-23ae-4d99-89aa-efd453fb9d65 tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] 10.222.0.43 "GET /compute/v2.1/servers/a5f1279e-dd4c-43fa-9f32-8da8714f1ffd" status: 200 len: 1665 microversion: 2.1 time: 0.155322 Oct 04 19:15:16.784148 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3432/6496] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:15:16 2022] GET /compute/v2.1/servers/a5f1279e-dd4c-43fa-9f32-8da8714f1ffd => generated 1665 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:15:16.920012 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-c1161d9e-ae51-4923-b44b-524445a64fb9 req-da3cdcb9-ad30-4d91-9bad-20f5ffc76783 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5f1279e-dd4c-43fa-9f32-8da8714f1ffd", "name": "network-vif-deleted", "tag": "bcc86ae2-3e8f-4b18-9506-312af53b1933"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:15:16.931030 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-c1161d9e-ae51-4923-b44b-524445a64fb9 req-da3cdcb9-ad30-4d91-9bad-20f5ffc76783 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:16.931841 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-c1161d9e-ae51-4923-b44b-524445a64fb9 req-da3cdcb9-ad30-4d91-9bad-20f5ffc76783 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:16.933085 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-c1161d9e-ae51-4923-b44b-524445a64fb9 req-da3cdcb9-ad30-4d91-9bad-20f5ffc76783 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:16.945521 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-c1161d9e-ae51-4923-b44b-524445a64fb9 req-da3cdcb9-ad30-4d91-9bad-20f5ffc76783 service nova] Creating event network-vif-deleted:bcc86ae2-3e8f-4b18-9506-312af53b1933 for instance a5f1279e-dd4c-43fa-9f32-8da8714f1ffd on n-h1-851028-13 Oct 04 19:15:16.950235 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-c1161d9e-ae51-4923-b44b-524445a64fb9 req-da3cdcb9-ad30-4d91-9bad-20f5ffc76783 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034896 Oct 04 19:15:16.951319 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3065/6497] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:15:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:15:17.217906 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-7e8c1c39-3422-490e-b4ee-dfd091abe8c3 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:15:17.220429 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-7e8c1c39-3422-490e-b4ee-dfd091abe8c3 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] [instance: e94a031c-6f7a-4ca3-bfae-3af49304114f] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:15:17.228384 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7e8c1c39-3422-490e-b4ee-dfd091abe8c3 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:17.229544 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7e8c1c39-3422-490e-b4ee-dfd091abe8c3 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:17.230351 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7e8c1c39-3422-490e-b4ee-dfd091abe8c3 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:17.231443 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7e8c1c39-3422-490e-b4ee-dfd091abe8c3 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:17.231965 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7e8c1c39-3422-490e-b4ee-dfd091abe8c3 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:17.232616 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7e8c1c39-3422-490e-b4ee-dfd091abe8c3 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:17.335160 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-7e8c1c39-3422-490e-b4ee-dfd091abe8c3 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfe96b673c04bc0803c2751988e0cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8fc3734114650b0f84fc940836ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:15:17.346234 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-7e8c1c39-3422-490e-b4ee-dfd091abe8c3 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] 10.222.0.43 "GET /compute/v2.1/servers/e94a031c-6f7a-4ca3-bfae-3af49304114f" status: 200 len: 1299 microversion: 2.1 time: 0.133852 Oct 04 19:15:17.347828 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3433/6498] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:15:17 2022] GET /compute/v2.1/servers/e94a031c-6f7a-4ca3-bfae-3af49304114f => generated 1299 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:15:17.808331 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-42c68787-2de2-4069-87c0-5ad3d1c030bb tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:15:17.810150 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-42c68787-2de2-4069-87c0-5ad3d1c030bb tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] [instance: a5f1279e-dd4c-43fa-9f32-8da8714f1ffd] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:15:17.818187 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-42c68787-2de2-4069-87c0-5ad3d1c030bb tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:17.819144 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-42c68787-2de2-4069-87c0-5ad3d1c030bb tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:17.820013 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-42c68787-2de2-4069-87c0-5ad3d1c030bb tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:17.821289 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-42c68787-2de2-4069-87c0-5ad3d1c030bb tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:17.822002 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-42c68787-2de2-4069-87c0-5ad3d1c030bb tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:17.822508 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-42c68787-2de2-4069-87c0-5ad3d1c030bb tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:17.882896 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-42c68787-2de2-4069-87c0-5ad3d1c030bb tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:17.885883 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-42c68787-2de2-4069-87c0-5ad3d1c030bb tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:17.886478 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-42c68787-2de2-4069-87c0-5ad3d1c030bb tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:17.887051 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.objects.instance [None req-42c68787-2de2-4069-87c0-5ad3d1c030bb tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Lazy-loading 'fault' on Instance uuid a5f1279e-dd4c-43fa-9f32-8da8714f1ffd {{(pid=123595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 19:15:17.959082 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-42c68787-2de2-4069-87c0-5ad3d1c030bb tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd7603a21403497bbdf24e6c2cfc31b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bee908d0a57d46b29fc0c6c07ecf365a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:15:17.972411 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-42c68787-2de2-4069-87c0-5ad3d1c030bb tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] 10.222.0.43 "GET /compute/v2.1/servers/a5f1279e-dd4c-43fa-9f32-8da8714f1ffd" status: 200 len: 1387 microversion: 2.1 time: 0.168720 Oct 04 19:15:17.973144 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3066/6499] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:15:17 2022] GET /compute/v2.1/servers/a5f1279e-dd4c-43fa-9f32-8da8714f1ffd => generated 1387 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:15:18.373510 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-c0ed7207-7f47-4844-b6c4-451408e87c75 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:15:18.374124 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-c0ed7207-7f47-4844-b6c4-451408e87c75 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] [instance: e94a031c-6f7a-4ca3-bfae-3af49304114f] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:15:18.381323 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c0ed7207-7f47-4844-b6c4-451408e87c75 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:18.381827 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c0ed7207-7f47-4844-b6c4-451408e87c75 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:18.382277 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c0ed7207-7f47-4844-b6c4-451408e87c75 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:18.382989 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c0ed7207-7f47-4844-b6c4-451408e87c75 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:18.383473 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c0ed7207-7f47-4844-b6c4-451408e87c75 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:18.383910 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c0ed7207-7f47-4844-b6c4-451408e87c75 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:18.484794 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-c0ed7207-7f47-4844-b6c4-451408e87c75 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfe96b673c04bc0803c2751988e0cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8fc3734114650b0f84fc940836ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:15:18.496332 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-c0ed7207-7f47-4844-b6c4-451408e87c75 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] 10.222.0.43 "GET /compute/v2.1/servers/e94a031c-6f7a-4ca3-bfae-3af49304114f" status: 200 len: 1472 microversion: 2.1 time: 0.127182 Oct 04 19:15:18.501710 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3434/6500] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:15:18 2022] GET /compute/v2.1/servers/e94a031c-6f7a-4ca3-bfae-3af49304114f => generated 1472 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:15:18.520501 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-04115ad2-0e83-4308-b59f-e70bd742eb96 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:15:18.521158 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-04115ad2-0e83-4308-b59f-e70bd742eb96 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] [instance: e94a031c-6f7a-4ca3-bfae-3af49304114f] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:15:18.523611 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=2 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:15:18.524882 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=6 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:15:18.533985 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-04115ad2-0e83-4308-b59f-e70bd742eb96 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:18.534765 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-04115ad2-0e83-4308-b59f-e70bd742eb96 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:18.535432 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-04115ad2-0e83-4308-b59f-e70bd742eb96 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:18.536508 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-04115ad2-0e83-4308-b59f-e70bd742eb96 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:18.538121 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-04115ad2-0e83-4308-b59f-e70bd742eb96 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:18.538740 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-04115ad2-0e83-4308-b59f-e70bd742eb96 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:18.673316 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-04115ad2-0e83-4308-b59f-e70bd742eb96 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfe96b673c04bc0803c2751988e0cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8fc3734114650b0f84fc940836ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:15:18.688569 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-04115ad2-0e83-4308-b59f-e70bd742eb96 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] 10.222.0.43 "GET /compute/v2.1/servers/e94a031c-6f7a-4ca3-bfae-3af49304114f" status: 200 len: 1472 microversion: 2.1 time: 0.171885 Oct 04 19:15:18.697186 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3067/6501] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:15:18 2022] GET /compute/v2.1/servers/e94a031c-6f7a-4ca3-bfae-3af49304114f => generated 1472 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:15:18.711305 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-40b44a60-d4cc-487f-aafd-8e99f76379ce tempest-TestSecurityGroupsBasicOps-1532370090 tempest-TestSecurityGroupsBasicOps-1532370090-project-admin] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:15:18.712038 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-40b44a60-d4cc-487f-aafd-8e99f76379ce tempest-TestSecurityGroupsBasicOps-1532370090 tempest-TestSecurityGroupsBasicOps-1532370090-project-admin] [instance: e94a031c-6f7a-4ca3-bfae-3af49304114f] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:15:18.723599 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-40b44a60-d4cc-487f-aafd-8e99f76379ce tempest-TestSecurityGroupsBasicOps-1532370090 tempest-TestSecurityGroupsBasicOps-1532370090-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:18.727786 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-40b44a60-d4cc-487f-aafd-8e99f76379ce tempest-TestSecurityGroupsBasicOps-1532370090 tempest-TestSecurityGroupsBasicOps-1532370090-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:18.728490 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-40b44a60-d4cc-487f-aafd-8e99f76379ce tempest-TestSecurityGroupsBasicOps-1532370090 tempest-TestSecurityGroupsBasicOps-1532370090-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:18.733045 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-40b44a60-d4cc-487f-aafd-8e99f76379ce tempest-TestSecurityGroupsBasicOps-1532370090 tempest-TestSecurityGroupsBasicOps-1532370090-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:18.733842 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-40b44a60-d4cc-487f-aafd-8e99f76379ce tempest-TestSecurityGroupsBasicOps-1532370090 tempest-TestSecurityGroupsBasicOps-1532370090-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:18.735242 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-40b44a60-d4cc-487f-aafd-8e99f76379ce tempest-TestSecurityGroupsBasicOps-1532370090 tempest-TestSecurityGroupsBasicOps-1532370090-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:18.904307 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-40b44a60-d4cc-487f-aafd-8e99f76379ce tempest-TestSecurityGroupsBasicOps-1532370090 tempest-TestSecurityGroupsBasicOps-1532370090-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/e94a031c-6f7a-4ca3-bfae-3af49304114f" status: 200 len: 1625 microversion: 2.1 time: 0.196780 Oct 04 19:15:18.905083 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3435/6502] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:15:18 2022] GET /compute/v2.1/servers/e94a031c-6f7a-4ca3-bfae-3af49304114f => generated 1625 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:15:18.936049 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-912f1275-05c8-40fd-bf43-6fda8a5f71ba tempest-TestSecurityGroupsBasicOps-1532370090 tempest-TestSecurityGroupsBasicOps-1532370090-project-admin] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:15:18.936658 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-912f1275-05c8-40fd-bf43-6fda8a5f71ba tempest-TestSecurityGroupsBasicOps-1532370090 tempest-TestSecurityGroupsBasicOps-1532370090-project-admin] [instance: d0b88d36-472f-40fb-b98e-0a13425443b0] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:15:18.943843 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-912f1275-05c8-40fd-bf43-6fda8a5f71ba tempest-TestSecurityGroupsBasicOps-1532370090 tempest-TestSecurityGroupsBasicOps-1532370090-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:18.944578 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-912f1275-05c8-40fd-bf43-6fda8a5f71ba tempest-TestSecurityGroupsBasicOps-1532370090 tempest-TestSecurityGroupsBasicOps-1532370090-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:18.945221 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-912f1275-05c8-40fd-bf43-6fda8a5f71ba tempest-TestSecurityGroupsBasicOps-1532370090 tempest-TestSecurityGroupsBasicOps-1532370090-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:18.946096 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-912f1275-05c8-40fd-bf43-6fda8a5f71ba tempest-TestSecurityGroupsBasicOps-1532370090 tempest-TestSecurityGroupsBasicOps-1532370090-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:18.946714 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-912f1275-05c8-40fd-bf43-6fda8a5f71ba tempest-TestSecurityGroupsBasicOps-1532370090 tempest-TestSecurityGroupsBasicOps-1532370090-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:18.947334 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-912f1275-05c8-40fd-bf43-6fda8a5f71ba tempest-TestSecurityGroupsBasicOps-1532370090 tempest-TestSecurityGroupsBasicOps-1532370090-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:18.996728 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-1591f7d4-438c-4f95-9149-1016b28f6ee4 tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:15:18.997885 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-1591f7d4-438c-4f95-9149-1016b28f6ee4 tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] [instance: a5f1279e-dd4c-43fa-9f32-8da8714f1ffd] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:15:19.009055 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1591f7d4-438c-4f95-9149-1016b28f6ee4 tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:19.009885 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1591f7d4-438c-4f95-9149-1016b28f6ee4 tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:19.011211 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1591f7d4-438c-4f95-9149-1016b28f6ee4 tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:19.012121 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1591f7d4-438c-4f95-9149-1016b28f6ee4 tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:19.012746 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1591f7d4-438c-4f95-9149-1016b28f6ee4 tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:19.013472 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1591f7d4-438c-4f95-9149-1016b28f6ee4 tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:19.031134 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-1591f7d4-438c-4f95-9149-1016b28f6ee4 tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] HTTP exception thrown: Instance a5f1279e-dd4c-43fa-9f32-8da8714f1ffd could not be found. Oct 04 19:15:19.033088 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-1591f7d4-438c-4f95-9149-1016b28f6ee4 tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Request method failure captured: Oct 04 19:15:19.033088 n-d-851028-13 devstack@n-api.service[123596]: request: GET /compute/v2.1/servers/a5f1279e-dd4c-43fa-9f32-8da8714f1ffd HTTP/1.1 Oct 04 19:15:19.033088 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 19:15:19.033088 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 19:15:19.033088 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 19:15:19.033088 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 19:15:19.033088 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 19:15:19.033088 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 19:15:19.033088 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 19:15:19.033088 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 19:15:19.033088 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPIUJFZmVC4jMOwaA-T9OnLrFM554eGn-fJdMGxux9zX39rZsL65eqfEp9Iz0Z8MoY1hbHIZQjHBDa5QpSlVo5GMPMYUDgEnE7Z2LvpXXGELj5MOiKVYmldS9YlKQNGZ_CZT3ne3_hXzp7QyTODX9mBhon7CeBQljJZf0cT1hmm02XNA Oct 04 19:15:19.033088 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 19:15:19.033088 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 19:15:19.033088 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 19:15:19.033088 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 19:15:19.033088 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 19:15:19.033088 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 19:15:19.033088 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: bee908d0a57d46b29fc0c6c07ecf365a Oct 04 19:15:19.033088 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-TestServerBasicOps-260408163 Oct 04 19:15:19.033088 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 19:15:19.033088 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 19:15:19.033088 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/bee908d0a57d46b29fc0c6c07ecf365a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_bee908d0a57d46b29fc0c6c07ecf365a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/bee908d0a57d46b29fc0c6c07ecf365a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/bee908d0a57d46b29fc0c6c07ecf365a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 19:15:19.033088 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-TestServerBasicOps-260408163 Oct 04 19:15:19.033088 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: bee908d0a57d46b29fc0c6c07ecf365a Oct 04 19:15:19.033088 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-TestServerBasicOps-260408163 Oct 04 19:15:19.033088 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-TestServerBasicOps-260408163-project Oct 04 19:15:19.033088 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 19:15:19.033088 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 19:15:19.033088 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: dd7603a21403497bbdf24e6c2cfc31b2 Oct 04 19:15:19.033088 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-TestServerBasicOps-260408163-project Oct 04 19:15:19.033088 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 19:15:19.033088 n-d-851028-13 devstack@n-api.service[123596]: exception: Instance a5f1279e-dd4c-43fa-9f32-8da8714f1ffd could not be found. Oct 04 19:15:19.033088 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': 'a5f1279e-dd4c-43fa-9f32-8da8714f1ffd'} Oct 04 19:15:19.033088 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:15:19.033088 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:15:19.033088 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:15:19.033088 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:15:19.033088 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:15:19.033088 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:15:19.033088 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:15:19.033088 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:15:19.033088 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:15:19.033088 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:15:19.033088 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a5f1279e-dd4c-43fa-9f32-8da8714f1ffd could not be found. Oct 04 19:15:19.033088 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:15:19.033088 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:15:19.033088 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:15:19.033088 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:15:19.033088 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:15:19.033088 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:15:19.033088 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:15:19.033088 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:15:19.033088 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:15:19.033088 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:15:19.033088 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:15:19.033088 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:15:19.033088 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:15:19.033088 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:15:19.033088 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:15:19.033088 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:15:19.033088 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a5f1279e-dd4c-43fa-9f32-8da8714f1ffd could not be found. Oct 04 19:15:19.033088 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:15:19.033088 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:15:19.033088 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:15:19.038810 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:15:19.038810 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:15:19.038810 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:15:19.038810 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:15:19.038810 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:15:19.038810 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a5f1279e-dd4c-43fa-9f32-8da8714f1ffd could not be found. Oct 04 19:15:19.038810 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:15:19.040354 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-1591f7d4-438c-4f95-9149-1016b28f6ee4 tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Returning 404 to user: Instance a5f1279e-dd4c-43fa-9f32-8da8714f1ffd could not be found. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:15:19.041249 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-1591f7d4-438c-4f95-9149-1016b28f6ee4 tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] 10.222.0.43 "GET /compute/v2.1/servers/a5f1279e-dd4c-43fa-9f32-8da8714f1ffd" status: 404 len: 111 microversion: 2.1 time: 0.049372 Oct 04 19:15:19.045252 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3436/6503] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:15:18 2022] GET /compute/v2.1/servers/a5f1279e-dd4c-43fa-9f32-8da8714f1ffd => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 19:15:19.291022 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-912f1275-05c8-40fd-bf43-6fda8a5f71ba tempest-TestSecurityGroupsBasicOps-1532370090 tempest-TestSecurityGroupsBasicOps-1532370090-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/d0b88d36-472f-40fb-b98e-0a13425443b0" status: 200 len: 1910 microversion: 2.1 time: 0.359651 Oct 04 19:15:19.293140 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3068/6504] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:15:18 2022] GET /compute/v2.1/servers/d0b88d36-472f-40fb-b98e-0a13425443b0 => generated 1910 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:15:19.411012 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-cb2947b7-1e89-4070-af09-a39dc36a8df9 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:15:19.411662 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-cb2947b7-1e89-4070-af09-a39dc36a8df9 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] [instance: e94a031c-6f7a-4ca3-bfae-3af49304114f] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:15:19.415398 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=2 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:15:19.427033 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cb2947b7-1e89-4070-af09-a39dc36a8df9 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:19.427537 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cb2947b7-1e89-4070-af09-a39dc36a8df9 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:19.427986 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cb2947b7-1e89-4070-af09-a39dc36a8df9 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:19.428703 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cb2947b7-1e89-4070-af09-a39dc36a8df9 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:19.435004 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cb2947b7-1e89-4070-af09-a39dc36a8df9 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:19.436521 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cb2947b7-1e89-4070-af09-a39dc36a8df9 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:19.488559 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-cb2947b7-1e89-4070-af09-a39dc36a8df9 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] [instance: e94a031c-6f7a-4ca3-bfae-3af49304114f] Going to try to terminate instance {{(pid=123596) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 19:15:19.646898 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-cb2947b7-1e89-4070-af09-a39dc36a8df9 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] 10.222.0.43 "DELETE /compute/v2.1/servers/e94a031c-6f7a-4ca3-bfae-3af49304114f" status: 204 len: 0 microversion: 2.1 time: 0.237930 Oct 04 19:15:19.649709 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3437/6505] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 19:15:19 2022] DELETE /compute/v2.1/servers/e94a031c-6f7a-4ca3-bfae-3af49304114f => generated 0 bytes in 243 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:15:19.665947 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-caee65c4-f97b-4681-9271-609d999a1650 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:15:19.668664 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-caee65c4-f97b-4681-9271-609d999a1650 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] [instance: e94a031c-6f7a-4ca3-bfae-3af49304114f] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:15:19.686944 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-caee65c4-f97b-4681-9271-609d999a1650 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:19.687501 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-caee65c4-f97b-4681-9271-609d999a1650 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:19.688018 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-caee65c4-f97b-4681-9271-609d999a1650 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:19.688905 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-caee65c4-f97b-4681-9271-609d999a1650 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:19.689554 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-caee65c4-f97b-4681-9271-609d999a1650 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:19.690311 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-caee65c4-f97b-4681-9271-609d999a1650 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:19.860474 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-caee65c4-f97b-4681-9271-609d999a1650 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfe96b673c04bc0803c2751988e0cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8fc3734114650b0f84fc940836ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:15:19.875062 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-caee65c4-f97b-4681-9271-609d999a1650 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] 10.222.0.43 "GET /compute/v2.1/servers/e94a031c-6f7a-4ca3-bfae-3af49304114f" status: 200 len: 1478 microversion: 2.1 time: 0.218580 Oct 04 19:15:19.880592 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-5559c345-8997-4922-94eb-dcc582dc6f9e tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:15:19.884087 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-5559c345-8997-4922-94eb-dcc582dc6f9e tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] [instance: a5f1279e-dd4c-43fa-9f32-8da8714f1ffd] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:15:19.890162 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3069/6506] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:15:19 2022] GET /compute/v2.1/servers/e94a031c-6f7a-4ca3-bfae-3af49304114f => generated 1478 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:15:19.891583 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5559c345-8997-4922-94eb-dcc582dc6f9e tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:19.892270 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5559c345-8997-4922-94eb-dcc582dc6f9e tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:19.892958 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5559c345-8997-4922-94eb-dcc582dc6f9e tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:19.894304 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5559c345-8997-4922-94eb-dcc582dc6f9e tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:19.895081 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5559c345-8997-4922-94eb-dcc582dc6f9e tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:19.895724 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5559c345-8997-4922-94eb-dcc582dc6f9e tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:19.913525 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-5559c345-8997-4922-94eb-dcc582dc6f9e tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] HTTP exception thrown: Instance a5f1279e-dd4c-43fa-9f32-8da8714f1ffd could not be found. Oct 04 19:15:19.915669 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-5559c345-8997-4922-94eb-dcc582dc6f9e tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Request method failure captured: Oct 04 19:15:19.915669 n-d-851028-13 devstack@n-api.service[123596]: request: DELETE /compute/v2.1/servers/a5f1279e-dd4c-43fa-9f32-8da8714f1ffd HTTP/1.1 Oct 04 19:15:19.915669 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 19:15:19.915669 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 19:15:19.915669 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 19:15:19.915669 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 19:15:19.915669 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 19:15:19.915669 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 19:15:19.915669 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 19:15:19.915669 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 19:15:19.915669 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPIUJFZmVC4jMOwaA-T9OnLrFM554eGn-fJdMGxux9zX39rZsL65eqfEp9Iz0Z8MoY1hbHIZQjHBDa5QpSlVo5GMPMYUDgEnE7Z2LvpXXGELj5MOiKVYmldS9YlKQNGZ_CZT3ne3_hXzp7QyTODX9mBhon7CeBQljJZf0cT1hmm02XNA Oct 04 19:15:19.915669 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 19:15:19.915669 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 19:15:19.915669 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 19:15:19.915669 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 19:15:19.915669 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 19:15:19.915669 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 19:15:19.915669 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: bee908d0a57d46b29fc0c6c07ecf365a Oct 04 19:15:19.915669 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-TestServerBasicOps-260408163 Oct 04 19:15:19.915669 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 19:15:19.915669 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 19:15:19.915669 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/bee908d0a57d46b29fc0c6c07ecf365a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_bee908d0a57d46b29fc0c6c07ecf365a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/bee908d0a57d46b29fc0c6c07ecf365a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/bee908d0a57d46b29fc0c6c07ecf365a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 19:15:19.915669 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-TestServerBasicOps-260408163 Oct 04 19:15:19.915669 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: bee908d0a57d46b29fc0c6c07ecf365a Oct 04 19:15:19.915669 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-TestServerBasicOps-260408163 Oct 04 19:15:19.915669 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-TestServerBasicOps-260408163-project Oct 04 19:15:19.915669 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 19:15:19.915669 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 19:15:19.915669 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: dd7603a21403497bbdf24e6c2cfc31b2 Oct 04 19:15:19.915669 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-TestServerBasicOps-260408163-project Oct 04 19:15:19.915669 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 19:15:19.915669 n-d-851028-13 devstack@n-api.service[123596]: exception: Instance a5f1279e-dd4c-43fa-9f32-8da8714f1ffd could not be found. Oct 04 19:15:19.915669 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': 'a5f1279e-dd4c-43fa-9f32-8da8714f1ffd'} Oct 04 19:15:19.915669 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:15:19.915669 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:15:19.915669 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:15:19.915669 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:15:19.915669 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:15:19.915669 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:15:19.915669 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:15:19.915669 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:15:19.915669 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:15:19.915669 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:15:19.915669 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a5f1279e-dd4c-43fa-9f32-8da8714f1ffd could not be found. Oct 04 19:15:19.915669 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:15:19.915669 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:15:19.915669 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:15:19.915669 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:15:19.915669 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:15:19.915669 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:15:19.915669 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:15:19.915669 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:15:19.915669 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:15:19.915669 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:15:19.915669 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 19:15:19.915669 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 19:15:19.915669 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 19:15:19.915669 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 19:15:19.915669 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:15:19.915669 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:15:19.915669 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:15:19.915669 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:15:19.921471 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a5f1279e-dd4c-43fa-9f32-8da8714f1ffd could not be found. Oct 04 19:15:19.921471 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:15:19.921471 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:15:19.921471 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:15:19.921471 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:15:19.921471 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:15:19.921471 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:15:19.921471 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:15:19.921471 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:15:19.921471 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a5f1279e-dd4c-43fa-9f32-8da8714f1ffd could not be found. Oct 04 19:15:19.921471 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:15:19.921471 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-5559c345-8997-4922-94eb-dcc582dc6f9e tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Returning 404 to user: Instance a5f1279e-dd4c-43fa-9f32-8da8714f1ffd could not be found. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:15:19.921471 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-5559c345-8997-4922-94eb-dcc582dc6f9e tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] 10.222.0.43 "DELETE /compute/v2.1/servers/a5f1279e-dd4c-43fa-9f32-8da8714f1ffd" status: 404 len: 111 microversion: 2.1 time: 0.043539 Oct 04 19:15:19.921471 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3438/6507] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 19:15:19 2022] DELETE /compute/v2.1/servers/a5f1279e-dd4c-43fa-9f32-8da8714f1ffd => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:15:19.931944 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-afc4fdb3-6869-4073-a45b-21438502e9ae tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:15:19.932581 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-afc4fdb3-6869-4073-a45b-21438502e9ae tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] [instance: a5f1279e-dd4c-43fa-9f32-8da8714f1ffd] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:15:19.939379 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-afc4fdb3-6869-4073-a45b-21438502e9ae tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:19.940086 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-afc4fdb3-6869-4073-a45b-21438502e9ae tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:19.940303 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-afc4fdb3-6869-4073-a45b-21438502e9ae tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:19.941010 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-afc4fdb3-6869-4073-a45b-21438502e9ae tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:19.941520 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-afc4fdb3-6869-4073-a45b-21438502e9ae tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:19.941945 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-afc4fdb3-6869-4073-a45b-21438502e9ae tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:19.957578 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-afc4fdb3-6869-4073-a45b-21438502e9ae tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] HTTP exception thrown: Instance a5f1279e-dd4c-43fa-9f32-8da8714f1ffd could not be found. Oct 04 19:15:19.959288 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-afc4fdb3-6869-4073-a45b-21438502e9ae tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Request method failure captured: Oct 04 19:15:19.959288 n-d-851028-13 devstack@n-api.service[123595]: request: GET /compute/v2.1/servers/a5f1279e-dd4c-43fa-9f32-8da8714f1ffd HTTP/1.1 Oct 04 19:15:19.959288 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 19:15:19.959288 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 19:15:19.959288 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 19:15:19.959288 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 0 Oct 04 19:15:19.959288 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 19:15:19.959288 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 19:15:19.959288 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 19:15:19.959288 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 19:15:19.959288 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPIUJFZmVC4jMOwaA-T9OnLrFM554eGn-fJdMGxux9zX39rZsL65eqfEp9Iz0Z8MoY1hbHIZQjHBDa5QpSlVo5GMPMYUDgEnE7Z2LvpXXGELj5MOiKVYmldS9YlKQNGZ_CZT3ne3_hXzp7QyTODX9mBhon7CeBQljJZf0cT1hmm02XNA Oct 04 19:15:19.959288 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 19:15:19.959288 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 19:15:19.959288 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 19:15:19.959288 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 19:15:19.959288 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 19:15:19.959288 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 19:15:19.959288 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: bee908d0a57d46b29fc0c6c07ecf365a Oct 04 19:15:19.959288 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-TestServerBasicOps-260408163 Oct 04 19:15:19.959288 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 19:15:19.959288 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 19:15:19.959288 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/bee908d0a57d46b29fc0c6c07ecf365a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_bee908d0a57d46b29fc0c6c07ecf365a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/bee908d0a57d46b29fc0c6c07ecf365a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/bee908d0a57d46b29fc0c6c07ecf365a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 19:15:19.959288 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-TestServerBasicOps-260408163 Oct 04 19:15:19.959288 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: bee908d0a57d46b29fc0c6c07ecf365a Oct 04 19:15:19.959288 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-TestServerBasicOps-260408163 Oct 04 19:15:19.959288 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-TestServerBasicOps-260408163-project Oct 04 19:15:19.959288 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 19:15:19.959288 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 19:15:19.959288 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: dd7603a21403497bbdf24e6c2cfc31b2 Oct 04 19:15:19.959288 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-TestServerBasicOps-260408163-project Oct 04 19:15:19.959288 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 19:15:19.959288 n-d-851028-13 devstack@n-api.service[123595]: exception: Instance a5f1279e-dd4c-43fa-9f32-8da8714f1ffd could not be found. Oct 04 19:15:19.959288 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': 'a5f1279e-dd4c-43fa-9f32-8da8714f1ffd'} Oct 04 19:15:19.959288 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:15:19.959288 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:15:19.959288 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:15:19.959288 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:15:19.959288 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:15:19.959288 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:15:19.959288 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:15:19.959288 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:15:19.959288 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:15:19.959288 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:15:19.959288 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a5f1279e-dd4c-43fa-9f32-8da8714f1ffd could not be found. Oct 04 19:15:19.959288 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:15:19.959288 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:15:19.959288 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:15:19.959288 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:15:19.959288 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:15:19.959288 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:15:19.959288 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:15:19.959288 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:15:19.959288 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:15:19.959288 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:15:19.959288 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:15:19.959288 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:15:19.959288 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:15:19.959288 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:15:19.959288 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:15:19.959288 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:15:19.959288 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a5f1279e-dd4c-43fa-9f32-8da8714f1ffd could not be found. Oct 04 19:15:19.959288 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:15:19.959288 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:15:19.959288 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:15:19.966095 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:15:19.966095 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:15:19.966095 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:15:19.966095 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:15:19.966095 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:15:19.966095 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a5f1279e-dd4c-43fa-9f32-8da8714f1ffd could not be found. Oct 04 19:15:19.966095 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:15:19.966095 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-afc4fdb3-6869-4073-a45b-21438502e9ae tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Returning 404 to user: Instance a5f1279e-dd4c-43fa-9f32-8da8714f1ffd could not be found. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:15:19.966095 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-afc4fdb3-6869-4073-a45b-21438502e9ae tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] 10.222.0.43 "GET /compute/v2.1/servers/a5f1279e-dd4c-43fa-9f32-8da8714f1ffd" status: 404 len: 111 microversion: 2.1 time: 0.034841 Oct 04 19:15:19.966095 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3070/6508] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:15:19 2022] GET /compute/v2.1/servers/a5f1279e-dd4c-43fa-9f32-8da8714f1ffd => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:15:20.157452 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-bf7b5a33-348d-4872-acc5-ebe980809c46 tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] Calling method '.version_select at 0x7fb21e7b4d30>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:15:20.216147 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-bf7b5a33-348d-4872-acc5-ebe980809c46 tempest-TestServerBasicOps-260408163 tempest-TestServerBasicOps-260408163-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-427034637" status: 202 len: 0 microversion: 2.1 time: 0.062545 Oct 04 19:15:20.216764 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3439/6509] 10.222.0.43 () {58 vars in 1251 bytes} [Tue Oct 4 19:15:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-427034637 => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:15:20.901746 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-1412287c-20b5-4222-bb41-6afa0e55dcac tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:15:20.902226 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-1412287c-20b5-4222-bb41-6afa0e55dcac tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] [instance: e94a031c-6f7a-4ca3-bfae-3af49304114f] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:15:20.918749 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1412287c-20b5-4222-bb41-6afa0e55dcac tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:20.919253 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1412287c-20b5-4222-bb41-6afa0e55dcac tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:20.919702 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1412287c-20b5-4222-bb41-6afa0e55dcac tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:20.920430 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1412287c-20b5-4222-bb41-6afa0e55dcac tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:20.920897 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1412287c-20b5-4222-bb41-6afa0e55dcac tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:20.921452 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1412287c-20b5-4222-bb41-6afa0e55dcac tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:21.196658 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-1412287c-20b5-4222-bb41-6afa0e55dcac tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfe96b673c04bc0803c2751988e0cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8fc3734114650b0f84fc940836ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:15:21.209701 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-1412287c-20b5-4222-bb41-6afa0e55dcac tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] 10.222.0.43 "GET /compute/v2.1/servers/e94a031c-6f7a-4ca3-bfae-3af49304114f" status: 200 len: 1478 microversion: 2.1 time: 0.312196 Oct 04 19:15:21.211140 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3071/6510] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:15:20 2022] GET /compute/v2.1/servers/e94a031c-6f7a-4ca3-bfae-3af49304114f => generated 1478 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:15:22.236254 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-e55d2e3e-e354-4d36-8269-32847b362633 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:15:22.236889 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-e55d2e3e-e354-4d36-8269-32847b362633 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] [instance: e94a031c-6f7a-4ca3-bfae-3af49304114f] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:15:22.262639 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e55d2e3e-e354-4d36-8269-32847b362633 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:22.263416 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e55d2e3e-e354-4d36-8269-32847b362633 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:22.264057 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e55d2e3e-e354-4d36-8269-32847b362633 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:22.264979 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e55d2e3e-e354-4d36-8269-32847b362633 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:22.265638 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e55d2e3e-e354-4d36-8269-32847b362633 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:22.266244 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e55d2e3e-e354-4d36-8269-32847b362633 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:22.352119 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-f3f7d1db-bd48-44f5-b4dc-b8efd15bb6f0 req-ec329130-3336-489f-a361-60c50192ea4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e94a031c-6f7a-4ca3-bfae-3af49304114f", "name": "network-vif-deleted", "tag": "96b636a6-46da-444f-be37-3bad038cd810"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:15:22.389826 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-f3f7d1db-bd48-44f5-b4dc-b8efd15bb6f0 req-ec329130-3336-489f-a361-60c50192ea4a service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:22.392092 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-f3f7d1db-bd48-44f5-b4dc-b8efd15bb6f0 req-ec329130-3336-489f-a361-60c50192ea4a service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:22.393127 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-f3f7d1db-bd48-44f5-b4dc-b8efd15bb6f0 req-ec329130-3336-489f-a361-60c50192ea4a service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:22.427576 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-f3f7d1db-bd48-44f5-b4dc-b8efd15bb6f0 req-ec329130-3336-489f-a361-60c50192ea4a service nova] Creating event network-vif-deleted:96b636a6-46da-444f-be37-3bad038cd810 for instance e94a031c-6f7a-4ca3-bfae-3af49304114f on n-h1-851028-13 Oct 04 19:15:22.440584 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-f3f7d1db-bd48-44f5-b4dc-b8efd15bb6f0 req-ec329130-3336-489f-a361-60c50192ea4a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090771 Oct 04 19:15:22.444319 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3072/6511] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:15:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:15:22.476475 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-e55d2e3e-e354-4d36-8269-32847b362633 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfe96b673c04bc0803c2751988e0cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8fc3734114650b0f84fc940836ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:15:22.487097 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-e55d2e3e-e354-4d36-8269-32847b362633 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] 10.222.0.43 "GET /compute/v2.1/servers/e94a031c-6f7a-4ca3-bfae-3af49304114f" status: 200 len: 1478 microversion: 2.1 time: 0.256101 Oct 04 19:15:22.487986 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3440/6512] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:15:22 2022] GET /compute/v2.1/servers/e94a031c-6f7a-4ca3-bfae-3af49304114f => generated 1478 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:15:23.513070 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-d1085ad9-25ab-4a04-a08e-ae95f126b179 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:15:23.513818 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-d1085ad9-25ab-4a04-a08e-ae95f126b179 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] [instance: e94a031c-6f7a-4ca3-bfae-3af49304114f] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:15:23.528668 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d1085ad9-25ab-4a04-a08e-ae95f126b179 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:23.529155 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d1085ad9-25ab-4a04-a08e-ae95f126b179 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:23.529529 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d1085ad9-25ab-4a04-a08e-ae95f126b179 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:23.530263 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d1085ad9-25ab-4a04-a08e-ae95f126b179 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:23.530724 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d1085ad9-25ab-4a04-a08e-ae95f126b179 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:23.531157 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d1085ad9-25ab-4a04-a08e-ae95f126b179 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:23.567866 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-d1085ad9-25ab-4a04-a08e-ae95f126b179 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] HTTP exception thrown: Instance e94a031c-6f7a-4ca3-bfae-3af49304114f could not be found. Oct 04 19:15:23.569628 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-d1085ad9-25ab-4a04-a08e-ae95f126b179 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Request method failure captured: Oct 04 19:15:23.569628 n-d-851028-13 devstack@n-api.service[123595]: request: GET /compute/v2.1/servers/e94a031c-6f7a-4ca3-bfae-3af49304114f HTTP/1.1 Oct 04 19:15:23.569628 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 19:15:23.569628 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 19:15:23.569628 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 19:15:23.569628 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 0 Oct 04 19:15:23.569628 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 19:15:23.569628 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 19:15:23.569628 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 19:15:23.569628 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 19:15:23.569628 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPIX8TyJ_LXNA4IQw0gX1sPT9Tb_l-Z94u45rj1eNM1JyvYwShZMXObEgHlRlIYFnwgmOwtwNwbUiGI2yC5T6_b5E_OJRjQ5RxhkMQGFeO4OX4J2qQ73X4ZK6V4NUlDmhcJ7TqyRYL1E8BNUkH1c0GPz7FMyiFBI5VF8aBZgN9yGdjFo Oct 04 19:15:23.569628 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 19:15:23.569628 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 19:15:23.569628 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 19:15:23.569628 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 19:15:23.569628 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 19:15:23.569628 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 19:15:23.569628 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: d8a8fc3734114650b0f84fc940836ea9 Oct 04 19:15:23.569628 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-649906329 Oct 04 19:15:23.569628 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 19:15:23.569628 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 19:15:23.569628 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/d8a8fc3734114650b0f84fc940836ea9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_d8a8fc3734114650b0f84fc940836ea9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d8a8fc3734114650b0f84fc940836ea9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d8a8fc3734114650b0f84fc940836ea9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 19:15:23.569628 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-TestSecurityGroupsBasicOps-649906329 Oct 04 19:15:23.569628 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: d8a8fc3734114650b0f84fc940836ea9 Oct 04 19:15:23.569628 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-649906329 Oct 04 19:15:23.569628 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-TestSecurityGroupsBasicOps-649906329-project Oct 04 19:15:23.569628 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 19:15:23.569628 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 19:15:23.569628 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: 3cfe96b673c04bc0803c2751988e0cd6 Oct 04 19:15:23.569628 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-TestSecurityGroupsBasicOps-649906329-project Oct 04 19:15:23.569628 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 19:15:23.569628 n-d-851028-13 devstack@n-api.service[123595]: exception: Instance e94a031c-6f7a-4ca3-bfae-3af49304114f could not be found. Oct 04 19:15:23.569628 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': 'e94a031c-6f7a-4ca3-bfae-3af49304114f'} Oct 04 19:15:23.569628 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:15:23.569628 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:15:23.569628 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:15:23.569628 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:15:23.569628 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:15:23.569628 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:15:23.569628 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:15:23.569628 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:15:23.569628 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:15:23.569628 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:15:23.569628 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e94a031c-6f7a-4ca3-bfae-3af49304114f could not be found. Oct 04 19:15:23.569628 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:15:23.569628 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:15:23.569628 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:15:23.569628 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:15:23.569628 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:15:23.569628 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:15:23.569628 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:15:23.569628 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:15:23.569628 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:15:23.569628 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:15:23.569628 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:15:23.569628 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:15:23.569628 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:15:23.569628 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:15:23.569628 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:15:23.569628 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:15:23.569628 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e94a031c-6f7a-4ca3-bfae-3af49304114f could not be found. Oct 04 19:15:23.569628 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:15:23.569628 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:15:23.569628 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:15:23.574614 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:15:23.574614 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:15:23.574614 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:15:23.574614 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:15:23.574614 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:15:23.574614 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e94a031c-6f7a-4ca3-bfae-3af49304114f could not be found. Oct 04 19:15:23.574614 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:15:23.574614 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-d1085ad9-25ab-4a04-a08e-ae95f126b179 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Returning 404 to user: Instance e94a031c-6f7a-4ca3-bfae-3af49304114f could not be found. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:15:23.574614 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-d1085ad9-25ab-4a04-a08e-ae95f126b179 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] 10.222.0.43 "GET /compute/v2.1/servers/e94a031c-6f7a-4ca3-bfae-3af49304114f" status: 404 len: 111 microversion: 2.1 time: 0.065326 Oct 04 19:15:23.575453 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3073/6513] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:15:23 2022] GET /compute/v2.1/servers/e94a031c-6f7a-4ca3-bfae-3af49304114f => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:15:31.329333 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-b2948b11-540f-401d-9ae9-46d281a21ce7 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:15:31.331058 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b2948b11-540f-401d-9ae9-46d281a21ce7 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:31.331555 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b2948b11-540f-401d-9ae9-46d281a21ce7 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:31.332002 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b2948b11-540f-401d-9ae9-46d281a21ce7 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:31.332747 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b2948b11-540f-401d-9ae9-46d281a21ce7 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:31.333267 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b2948b11-540f-401d-9ae9-46d281a21ce7 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:31.334738 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b2948b11-540f-401d-9ae9-46d281a21ce7 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:31.359343 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-b2948b11-540f-401d-9ae9-46d281a21ce7 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] 10.222.0.43 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 615 microversion: 2.1 time: 0.181407 Oct 04 19:15:31.373642 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3441/6514] 10.222.0.43 () {58 vars in 1185 bytes} [Tue Oct 4 19:15:31 2022] GET /compute/v2.1/os-availability-zone/detail => generated 615 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:15:31.508899 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-b639707b-c617-4f77-a19a-77a5753318c1 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-1994065740", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452", "availability_zone": "nova:n-h1-851028-13", "networks": [{"uuid": "5be18aa9-c4d8-4054-b36c-61b3c5ae4de7"}]}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:15:31.610796 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.network.neutron [None req-b639707b-c617-4f77-a19a-77a5753318c1 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] validate_networks() for [('5be18aa9-c4d8-4054-b36c-61b3c5ae4de7', None, None, None, None, None)] {{(pid=123595) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 19:15:32.142279 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-ea0a503b-73fc-4691-8300-10ec0eaec66c tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:15:32.143046 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-ea0a503b-73fc-4691-8300-10ec0eaec66c tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] [instance: d0b88d36-472f-40fb-b98e-0a13425443b0] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:15:32.149927 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ea0a503b-73fc-4691-8300-10ec0eaec66c tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:32.150601 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ea0a503b-73fc-4691-8300-10ec0eaec66c tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:32.151267 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ea0a503b-73fc-4691-8300-10ec0eaec66c tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:32.152162 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ea0a503b-73fc-4691-8300-10ec0eaec66c tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:32.152931 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ea0a503b-73fc-4691-8300-10ec0eaec66c tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:32.153717 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ea0a503b-73fc-4691-8300-10ec0eaec66c tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:32.188315 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-ea0a503b-73fc-4691-8300-10ec0eaec66c tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] [instance: d0b88d36-472f-40fb-b98e-0a13425443b0] Going to try to terminate instance {{(pid=123596) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 19:15:32.238409 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:15:32.320255 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-ea0a503b-73fc-4691-8300-10ec0eaec66c tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] 10.222.0.43 "DELETE /compute/v2.1/servers/d0b88d36-472f-40fb-b98e-0a13425443b0" status: 204 len: 0 microversion: 2.1 time: 0.179894 Oct 04 19:15:32.323013 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3442/6515] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 19:15:32 2022] DELETE /compute/v2.1/servers/d0b88d36-472f-40fb-b98e-0a13425443b0 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 19:15:32.329981 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-06702399-7ddf-4275-88bf-b988efcf8f72 req-33a9737a-7fb0-4ce3-ae8e-76ba0bb17a9e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0b88d36-472f-40fb-b98e-0a13425443b0", "tag": "76ce889e-c1a1-4d3b-ac79-5b06427b78b3"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:15:32.343194 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-06702399-7ddf-4275-88bf-b988efcf8f72 req-33a9737a-7fb0-4ce3-ae8e-76ba0bb17a9e service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:32.343715 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-06702399-7ddf-4275-88bf-b988efcf8f72 req-33a9737a-7fb0-4ce3-ae8e-76ba0bb17a9e service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:32.344206 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-06702399-7ddf-4275-88bf-b988efcf8f72 req-33a9737a-7fb0-4ce3-ae8e-76ba0bb17a9e service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:32.359615 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-06702399-7ddf-4275-88bf-b988efcf8f72 req-33a9737a-7fb0-4ce3-ae8e-76ba0bb17a9e service nova] Creating event network-changed:76ce889e-c1a1-4d3b-ac79-5b06427b78b3 for instance d0b88d36-472f-40fb-b98e-0a13425443b0 on n-h2-851028-13 Oct 04 19:15:32.365829 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-06702399-7ddf-4275-88bf-b988efcf8f72 req-33a9737a-7fb0-4ce3-ae8e-76ba0bb17a9e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040930 Oct 04 19:15:32.366839 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3443/6516] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:15:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:15:32.373469 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-beb9da4f-eae2-4c18-abb2-fb36c348a38f tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:15:32.374549 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-beb9da4f-eae2-4c18-abb2-fb36c348a38f tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] [instance: d0b88d36-472f-40fb-b98e-0a13425443b0] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:15:32.381875 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-beb9da4f-eae2-4c18-abb2-fb36c348a38f tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:32.382134 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-beb9da4f-eae2-4c18-abb2-fb36c348a38f tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:32.382627 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-beb9da4f-eae2-4c18-abb2-fb36c348a38f tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:32.383752 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-beb9da4f-eae2-4c18-abb2-fb36c348a38f tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:32.384702 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-beb9da4f-eae2-4c18-abb2-fb36c348a38f tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:32.385000 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-beb9da4f-eae2-4c18-abb2-fb36c348a38f tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:32.549144 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-b639707b-c617-4f77-a19a-77a5753318c1 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Flavor limits 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:15:32.549676 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-b639707b-c617-4f77-a19a-77a5753318c1 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Image limits 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:15:32.550535 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-b639707b-c617-4f77-a19a-77a5753318c1 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Flavor pref 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:15:32.550988 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-b639707b-c617-4f77-a19a-77a5753318c1 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Image pref 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:15:32.551482 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-b639707b-c617-4f77-a19a-77a5753318c1 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:15:32.570144 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b639707b-c617-4f77-a19a-77a5753318c1 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:32.572881 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-beb9da4f-eae2-4c18-abb2-fb36c348a38f tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfe96b673c04bc0803c2751988e0cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8fc3734114650b0f84fc940836ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:15:32.574372 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b639707b-c617-4f77-a19a-77a5753318c1 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:32.575003 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b639707b-c617-4f77-a19a-77a5753318c1 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:32.576691 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b639707b-c617-4f77-a19a-77a5753318c1 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:32.581558 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b639707b-c617-4f77-a19a-77a5753318c1 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:32.582606 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b639707b-c617-4f77-a19a-77a5753318c1 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:32.583489 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-beb9da4f-eae2-4c18-abb2-fb36c348a38f tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] 10.222.0.43 "GET /compute/v2.1/servers/d0b88d36-472f-40fb-b98e-0a13425443b0" status: 200 len: 1763 microversion: 2.1 time: 0.215441 Oct 04 19:15:32.597138 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3444/6517] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:15:32 2022] GET /compute/v2.1/servers/d0b88d36-472f-40fb-b98e-0a13425443b0 => generated 1763 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:15:32.624200 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-b639707b-c617-4f77-a19a-77a5753318c1 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Getting quotas for project 4153b53d11ea43f3825177f2ace63313. Resources: {'ram', 'cores', 'instances'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:15:32.631134 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-b639707b-c617-4f77-a19a-77a5753318c1 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Getting quotas for user 6d79f7bc52de4a26ae92ca8182189d3b and project 4153b53d11ea43f3825177f2ace63313. Resources: {'ram', 'cores', 'instances'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:15:32.646033 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-b639707b-c617-4f77-a19a-77a5753318c1 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Going to run 1 instances... {{(pid=123595) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 19:15:32.648904 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-b639707b-c617-4f77-a19a-77a5753318c1 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] [instance: a342b2c8-6705-49b0-baeb-90c538744203] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e8943ec5-4038-4d4b-b9b9-2415a79f5243',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 19:15:32.721792 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-b639707b-c617-4f77-a19a-77a5753318c1 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.216594 Oct 04 19:15:32.729743 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3074/6518] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 19:15:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 1224 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 19:15:32.735258 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-73072f48-03e0-4153-80ad-e59bb86df9c6 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:15:32.736008 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-73072f48-03e0-4153-80ad-e59bb86df9c6 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] [instance: a342b2c8-6705-49b0-baeb-90c538744203] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:15:32.822929 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-73072f48-03e0-4153-80ad-e59bb86df9c6 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/a342b2c8-6705-49b0-baeb-90c538744203" status: 200 len: 1329 microversion: 2.1 time: 0.091904 Oct 04 19:15:32.825341 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3445/6519] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:15:32 2022] GET /compute/v2.1/servers/a342b2c8-6705-49b0-baeb-90c538744203 => generated 1329 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:15:33.611592 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-099601e2-f939-48c4-b6c7-dd6be4e53a5d tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:15:33.612290 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-099601e2-f939-48c4-b6c7-dd6be4e53a5d tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] [instance: d0b88d36-472f-40fb-b98e-0a13425443b0] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:15:33.631415 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-099601e2-f939-48c4-b6c7-dd6be4e53a5d tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:33.632179 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-099601e2-f939-48c4-b6c7-dd6be4e53a5d tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:33.632920 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-099601e2-f939-48c4-b6c7-dd6be4e53a5d tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:33.633893 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-099601e2-f939-48c4-b6c7-dd6be4e53a5d tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:33.635894 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-099601e2-f939-48c4-b6c7-dd6be4e53a5d tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:33.639157 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-099601e2-f939-48c4-b6c7-dd6be4e53a5d tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:33.851730 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-71a117cb-6248-417f-b804-80d927372a14 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:15:33.856609 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-71a117cb-6248-417f-b804-80d927372a14 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] [instance: a342b2c8-6705-49b0-baeb-90c538744203] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:15:33.878020 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-71a117cb-6248-417f-b804-80d927372a14 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:33.879117 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-71a117cb-6248-417f-b804-80d927372a14 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:33.879694 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-71a117cb-6248-417f-b804-80d927372a14 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:33.880901 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-71a117cb-6248-417f-b804-80d927372a14 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:33.882631 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-71a117cb-6248-417f-b804-80d927372a14 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:33.883272 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-71a117cb-6248-417f-b804-80d927372a14 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:33.966235 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-099601e2-f939-48c4-b6c7-dd6be4e53a5d tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfe96b673c04bc0803c2751988e0cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8fc3734114650b0f84fc940836ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:15:33.982444 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-099601e2-f939-48c4-b6c7-dd6be4e53a5d tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] 10.222.0.43 "GET /compute/v2.1/servers/d0b88d36-472f-40fb-b98e-0a13425443b0" status: 200 len: 1763 microversion: 2.1 time: 0.376440 Oct 04 19:15:33.983967 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3075/6520] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:15:33 2022] GET /compute/v2.1/servers/d0b88d36-472f-40fb-b98e-0a13425443b0 => generated 1763 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:15:34.047033 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-71a117cb-6248-417f-b804-80d927372a14 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/a342b2c8-6705-49b0-baeb-90c538744203" status: 200 len: 1338 microversion: 2.1 time: 0.202492 Oct 04 19:15:34.047628 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3446/6521] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:15:33 2022] GET /compute/v2.1/servers/a342b2c8-6705-49b0-baeb-90c538744203 => generated 1338 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:15:34.526967 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-039891f3-a8a3-474b-89fb-0162a7d25c2c req-38f1823d-8bdc-43e4-9c65-2db140640ae9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0b88d36-472f-40fb-b98e-0a13425443b0", "name": "network-vif-deleted", "tag": "76ce889e-c1a1-4d3b-ac79-5b06427b78b3"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:15:34.552632 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-039891f3-a8a3-474b-89fb-0162a7d25c2c req-38f1823d-8bdc-43e4-9c65-2db140640ae9 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:34.555167 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-039891f3-a8a3-474b-89fb-0162a7d25c2c req-38f1823d-8bdc-43e4-9c65-2db140640ae9 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:34.555626 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-039891f3-a8a3-474b-89fb-0162a7d25c2c req-38f1823d-8bdc-43e4-9c65-2db140640ae9 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:34.583062 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-039891f3-a8a3-474b-89fb-0162a7d25c2c req-38f1823d-8bdc-43e4-9c65-2db140640ae9 service nova] Creating event network-vif-deleted:76ce889e-c1a1-4d3b-ac79-5b06427b78b3 for instance d0b88d36-472f-40fb-b98e-0a13425443b0 on n-h2-851028-13 Oct 04 19:15:34.599052 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-039891f3-a8a3-474b-89fb-0162a7d25c2c req-38f1823d-8bdc-43e4-9c65-2db140640ae9 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078071 Oct 04 19:15:34.600360 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3076/6522] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:15:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:15:35.010129 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-59647579-05cc-4a1d-85cc-22f3ec82b954 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:15:35.012493 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-59647579-05cc-4a1d-85cc-22f3ec82b954 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] [instance: d0b88d36-472f-40fb-b98e-0a13425443b0] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:15:35.027904 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-59647579-05cc-4a1d-85cc-22f3ec82b954 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:35.028951 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-59647579-05cc-4a1d-85cc-22f3ec82b954 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:35.031003 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-59647579-05cc-4a1d-85cc-22f3ec82b954 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:35.033497 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-59647579-05cc-4a1d-85cc-22f3ec82b954 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:35.035112 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-59647579-05cc-4a1d-85cc-22f3ec82b954 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:35.036133 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-59647579-05cc-4a1d-85cc-22f3ec82b954 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:35.075332 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-4c5bd9a0-359a-40b0-9e58-e4d60d6459ef tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:15:35.077002 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-4c5bd9a0-359a-40b0-9e58-e4d60d6459ef tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] [instance: a342b2c8-6705-49b0-baeb-90c538744203] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:15:35.087922 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-59647579-05cc-4a1d-85cc-22f3ec82b954 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:35.088819 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-59647579-05cc-4a1d-85cc-22f3ec82b954 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:35.089659 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-59647579-05cc-4a1d-85cc-22f3ec82b954 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:35.091002 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.objects.instance [None req-59647579-05cc-4a1d-85cc-22f3ec82b954 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Lazy-loading 'fault' on Instance uuid d0b88d36-472f-40fb-b98e-0a13425443b0 {{(pid=123596) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 19:15:35.102966 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4c5bd9a0-359a-40b0-9e58-e4d60d6459ef tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:35.108851 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4c5bd9a0-359a-40b0-9e58-e4d60d6459ef tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:35.111053 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4c5bd9a0-359a-40b0-9e58-e4d60d6459ef tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:35.116685 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4c5bd9a0-359a-40b0-9e58-e4d60d6459ef tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:35.120593 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4c5bd9a0-359a-40b0-9e58-e4d60d6459ef tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:35.123501 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4c5bd9a0-359a-40b0-9e58-e4d60d6459ef tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:35.168467 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-59647579-05cc-4a1d-85cc-22f3ec82b954 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfe96b673c04bc0803c2751988e0cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a8fc3734114650b0f84fc940836ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:15:35.192280 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-59647579-05cc-4a1d-85cc-22f3ec82b954 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] 10.222.0.43 "GET /compute/v2.1/servers/d0b88d36-472f-40fb-b98e-0a13425443b0" status: 200 len: 1382 microversion: 2.1 time: 0.187248 Oct 04 19:15:35.193935 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3447/6523] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:15:35 2022] GET /compute/v2.1/servers/d0b88d36-472f-40fb-b98e-0a13425443b0 => generated 1382 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:15:35.578894 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-4c5bd9a0-359a-40b0-9e58-e4d60d6459ef tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/a342b2c8-6705-49b0-baeb-90c538744203" status: 200 len: 1424 microversion: 2.1 time: 0.508833 Oct 04 19:15:35.579484 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3077/6524] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:15:35 2022] GET /compute/v2.1/servers/a342b2c8-6705-49b0-baeb-90c538744203 => generated 1424 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:15:36.220621 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-22a7a849-9227-4717-9a64-9d6985678758 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:15:36.221271 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-22a7a849-9227-4717-9a64-9d6985678758 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] [instance: d0b88d36-472f-40fb-b98e-0a13425443b0] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:15:36.228172 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-22a7a849-9227-4717-9a64-9d6985678758 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:36.228663 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-22a7a849-9227-4717-9a64-9d6985678758 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:36.229804 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-22a7a849-9227-4717-9a64-9d6985678758 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:36.230529 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-22a7a849-9227-4717-9a64-9d6985678758 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:36.230991 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-22a7a849-9227-4717-9a64-9d6985678758 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:36.231423 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-22a7a849-9227-4717-9a64-9d6985678758 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:36.256132 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-22a7a849-9227-4717-9a64-9d6985678758 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] HTTP exception thrown: Instance d0b88d36-472f-40fb-b98e-0a13425443b0 could not be found. Oct 04 19:15:36.258500 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-22a7a849-9227-4717-9a64-9d6985678758 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Request method failure captured: Oct 04 19:15:36.258500 n-d-851028-13 devstack@n-api.service[123596]: request: GET /compute/v2.1/servers/d0b88d36-472f-40fb-b98e-0a13425443b0 HTTP/1.1 Oct 04 19:15:36.258500 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 19:15:36.258500 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 19:15:36.258500 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 19:15:36.258500 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 19:15:36.258500 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 19:15:36.258500 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 19:15:36.258500 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 19:15:36.258500 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 19:15:36.258500 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPIX8TyJ_LXNA4IQw0gX1sPT9Tb_l-Z94u45rj1eNM1JyvYwShZMXObEgHlRlIYFnwgmOwtwNwbUiGI2yC5T6_b5E_OJRjQ5RxhkMQGFeO4OX4J2qQ73X4ZK6V4NUlDmhcJ7TqyRYL1E8BNUkH1c0GPz7FMyiFBI5VF8aBZgN9yGdjFo Oct 04 19:15:36.258500 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 19:15:36.258500 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 19:15:36.258500 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 19:15:36.258500 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 19:15:36.258500 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 19:15:36.258500 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 19:15:36.258500 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: d8a8fc3734114650b0f84fc940836ea9 Oct 04 19:15:36.258500 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-649906329 Oct 04 19:15:36.258500 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 19:15:36.258500 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 19:15:36.258500 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/d8a8fc3734114650b0f84fc940836ea9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_d8a8fc3734114650b0f84fc940836ea9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d8a8fc3734114650b0f84fc940836ea9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d8a8fc3734114650b0f84fc940836ea9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 19:15:36.258500 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-TestSecurityGroupsBasicOps-649906329 Oct 04 19:15:36.258500 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: d8a8fc3734114650b0f84fc940836ea9 Oct 04 19:15:36.258500 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-649906329 Oct 04 19:15:36.258500 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-TestSecurityGroupsBasicOps-649906329-project Oct 04 19:15:36.258500 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 19:15:36.258500 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 19:15:36.258500 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 3cfe96b673c04bc0803c2751988e0cd6 Oct 04 19:15:36.258500 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-TestSecurityGroupsBasicOps-649906329-project Oct 04 19:15:36.258500 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 19:15:36.258500 n-d-851028-13 devstack@n-api.service[123596]: exception: Instance d0b88d36-472f-40fb-b98e-0a13425443b0 could not be found. Oct 04 19:15:36.258500 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': 'd0b88d36-472f-40fb-b98e-0a13425443b0'} Oct 04 19:15:36.258500 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:15:36.258500 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:15:36.258500 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:15:36.258500 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:15:36.258500 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:15:36.258500 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:15:36.258500 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:15:36.258500 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:15:36.258500 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:15:36.258500 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:15:36.258500 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0b88d36-472f-40fb-b98e-0a13425443b0 could not be found. Oct 04 19:15:36.258500 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:15:36.258500 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:15:36.258500 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:15:36.258500 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:15:36.258500 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:15:36.258500 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:15:36.258500 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:15:36.258500 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:15:36.258500 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:15:36.258500 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:15:36.258500 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:15:36.258500 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:15:36.258500 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:15:36.258500 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:15:36.258500 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:15:36.258500 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:15:36.258500 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0b88d36-472f-40fb-b98e-0a13425443b0 could not be found. Oct 04 19:15:36.258500 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:15:36.258500 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:15:36.258500 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:15:36.262984 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:15:36.262984 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:15:36.262984 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:15:36.262984 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:15:36.262984 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:15:36.262984 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0b88d36-472f-40fb-b98e-0a13425443b0 could not be found. Oct 04 19:15:36.262984 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:15:36.262984 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-22a7a849-9227-4717-9a64-9d6985678758 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Returning 404 to user: Instance d0b88d36-472f-40fb-b98e-0a13425443b0 could not be found. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:15:36.262984 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-22a7a849-9227-4717-9a64-9d6985678758 tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] 10.222.0.43 "GET /compute/v2.1/servers/d0b88d36-472f-40fb-b98e-0a13425443b0" status: 404 len: 111 microversion: 2.1 time: 0.043529 Oct 04 19:15:36.262984 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3448/6525] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:15:36 2022] GET /compute/v2.1/servers/d0b88d36-472f-40fb-b98e-0a13425443b0 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 19:15:36.406698 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-c8df9f59-bd8b-4a30-aeaf-4750d4624db1 req-16c694ad-95dc-4adc-bfce-f6a1b6a64139 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a342b2c8-6705-49b0-baeb-90c538744203", "tag": "21179aeb-9677-4fa5-b3c1-ccbaa6d64ac9"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:15:36.440074 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-c8df9f59-bd8b-4a30-aeaf-4750d4624db1 req-16c694ad-95dc-4adc-bfce-f6a1b6a64139 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:36.440679 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-c8df9f59-bd8b-4a30-aeaf-4750d4624db1 req-16c694ad-95dc-4adc-bfce-f6a1b6a64139 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:36.441409 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-c8df9f59-bd8b-4a30-aeaf-4750d4624db1 req-16c694ad-95dc-4adc-bfce-f6a1b6a64139 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:36.453595 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-c8df9f59-bd8b-4a30-aeaf-4750d4624db1 req-16c694ad-95dc-4adc-bfce-f6a1b6a64139 service nova] Creating event network-changed:21179aeb-9677-4fa5-b3c1-ccbaa6d64ac9 for instance a342b2c8-6705-49b0-baeb-90c538744203 on n-h1-851028-13 Oct 04 19:15:36.459928 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-c8df9f59-bd8b-4a30-aeaf-4750d4624db1 req-16c694ad-95dc-4adc-bfce-f6a1b6a64139 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074368 Oct 04 19:15:36.466993 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3078/6526] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:15:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:15:36.602406 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-752c9e0f-7cb8-4f00-ae2c-b241129b12f5 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:15:36.603091 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-752c9e0f-7cb8-4f00-ae2c-b241129b12f5 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] [instance: a342b2c8-6705-49b0-baeb-90c538744203] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:15:36.609383 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-752c9e0f-7cb8-4f00-ae2c-b241129b12f5 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:36.609889 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-752c9e0f-7cb8-4f00-ae2c-b241129b12f5 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:36.610338 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-752c9e0f-7cb8-4f00-ae2c-b241129b12f5 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:36.611062 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-752c9e0f-7cb8-4f00-ae2c-b241129b12f5 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:36.611528 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-752c9e0f-7cb8-4f00-ae2c-b241129b12f5 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:36.611963 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-752c9e0f-7cb8-4f00-ae2c-b241129b12f5 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:36.811380 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-752c9e0f-7cb8-4f00-ae2c-b241129b12f5 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/a342b2c8-6705-49b0-baeb-90c538744203" status: 200 len: 1466 microversion: 2.1 time: 0.212700 Oct 04 19:15:36.825752 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3449/6527] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:15:36 2022] GET /compute/v2.1/servers/a342b2c8-6705-49b0-baeb-90c538744203 => generated 1466 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:15:37.837860 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-b2a500fb-bdbf-47ea-92b4-025435b497c9 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:15:37.839119 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-b2a500fb-bdbf-47ea-92b4-025435b497c9 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] [instance: a342b2c8-6705-49b0-baeb-90c538744203] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:15:37.841404 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=6 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:15:37.847818 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b2a500fb-bdbf-47ea-92b4-025435b497c9 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:37.848322 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b2a500fb-bdbf-47ea-92b4-025435b497c9 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:37.848831 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b2a500fb-bdbf-47ea-92b4-025435b497c9 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:37.849573 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b2a500fb-bdbf-47ea-92b4-025435b497c9 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:37.850034 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b2a500fb-bdbf-47ea-92b4-025435b497c9 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:37.850463 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b2a500fb-bdbf-47ea-92b4-025435b497c9 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:37.855216 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=89 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:15:38.096596 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-b2a500fb-bdbf-47ea-92b4-025435b497c9 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/a342b2c8-6705-49b0-baeb-90c538744203" status: 200 len: 1466 microversion: 2.1 time: 0.264163 Oct 04 19:15:38.097413 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3079/6528] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:15:37 2022] GET /compute/v2.1/servers/a342b2c8-6705-49b0-baeb-90c538744203 => generated 1466 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:15:39.121349 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-07784aad-b5c0-4831-94ea-aaa40a2cef59 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:15:39.123061 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-07784aad-b5c0-4831-94ea-aaa40a2cef59 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] [instance: a342b2c8-6705-49b0-baeb-90c538744203] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:15:39.133826 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-07784aad-b5c0-4831-94ea-aaa40a2cef59 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:39.134789 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-07784aad-b5c0-4831-94ea-aaa40a2cef59 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:39.136615 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-07784aad-b5c0-4831-94ea-aaa40a2cef59 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:39.137585 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-07784aad-b5c0-4831-94ea-aaa40a2cef59 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:39.138260 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-07784aad-b5c0-4831-94ea-aaa40a2cef59 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:39.138869 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-07784aad-b5c0-4831-94ea-aaa40a2cef59 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:39.367554 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-07784aad-b5c0-4831-94ea-aaa40a2cef59 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/a342b2c8-6705-49b0-baeb-90c538744203" status: 200 len: 1466 microversion: 2.1 time: 0.251198 Oct 04 19:15:39.368858 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3450/6529] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:15:39 2022] GET /compute/v2.1/servers/a342b2c8-6705-49b0-baeb-90c538744203 => generated 1466 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:15:40.082913 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-5f81566b-8291-4289-8dc4-7e819ce9d1ee tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] Calling method '.version_select at 0x7fb21eb2ad30>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:15:40.107673 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-5f81566b-8291-4289-8dc4-7e819ce9d1ee tempest-TestSecurityGroupsBasicOps-649906329 tempest-TestSecurityGroupsBasicOps-649906329-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-2038855990" status: 202 len: 0 microversion: 2.1 time: 0.030166 Oct 04 19:15:40.108351 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3080/6530] 10.222.0.43 () {58 vars in 1278 bytes} [Tue Oct 4 19:15:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-2038855990 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:15:40.390449 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-a7a5900b-9315-4d74-99e8-2118f2669e0b tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:15:40.391073 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-a7a5900b-9315-4d74-99e8-2118f2669e0b tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] [instance: a342b2c8-6705-49b0-baeb-90c538744203] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:15:40.397406 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:15:40.399329 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a7a5900b-9315-4d74-99e8-2118f2669e0b tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:40.400238 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a7a5900b-9315-4d74-99e8-2118f2669e0b tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:40.400535 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a7a5900b-9315-4d74-99e8-2118f2669e0b tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:40.401625 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a7a5900b-9315-4d74-99e8-2118f2669e0b tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:40.402258 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a7a5900b-9315-4d74-99e8-2118f2669e0b tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:40.402922 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a7a5900b-9315-4d74-99e8-2118f2669e0b tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:40.530737 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-10a27af1-3c29-4577-81ab-8c79a6d7329a req-47e1e0c7-db4b-4db3-85af-6f0654dddc14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a342b2c8-6705-49b0-baeb-90c538744203", "name": "network-vif-plugged", "status": "completed", "tag": "21179aeb-9677-4fa5-b3c1-ccbaa6d64ac9"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:15:40.542266 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-10a27af1-3c29-4577-81ab-8c79a6d7329a req-47e1e0c7-db4b-4db3-85af-6f0654dddc14 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:40.542951 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-10a27af1-3c29-4577-81ab-8c79a6d7329a req-47e1e0c7-db4b-4db3-85af-6f0654dddc14 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:40.543580 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-10a27af1-3c29-4577-81ab-8c79a6d7329a req-47e1e0c7-db4b-4db3-85af-6f0654dddc14 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:40.554923 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-10a27af1-3c29-4577-81ab-8c79a6d7329a req-47e1e0c7-db4b-4db3-85af-6f0654dddc14 service nova] Creating event network-vif-plugged:21179aeb-9677-4fa5-b3c1-ccbaa6d64ac9 for instance a342b2c8-6705-49b0-baeb-90c538744203 on n-h1-851028-13 Oct 04 19:15:40.560049 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-10a27af1-3c29-4577-81ab-8c79a6d7329a req-47e1e0c7-db4b-4db3-85af-6f0654dddc14 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033534 Oct 04 19:15:40.560877 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3081/6531] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:15:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:15:40.625027 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-a7a5900b-9315-4d74-99e8-2118f2669e0b tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/a342b2c8-6705-49b0-baeb-90c538744203" status: 200 len: 1466 microversion: 2.1 time: 0.238175 Oct 04 19:15:40.626176 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3451/6532] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:15:40 2022] GET /compute/v2.1/servers/a342b2c8-6705-49b0-baeb-90c538744203 => generated 1466 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:15:41.649685 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-6760e09d-874f-47af-9234-d17d6838fd5a tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:15:41.651107 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-6760e09d-874f-47af-9234-d17d6838fd5a tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] [instance: a342b2c8-6705-49b0-baeb-90c538744203] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:15:41.658117 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6760e09d-874f-47af-9234-d17d6838fd5a tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:41.658609 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6760e09d-874f-47af-9234-d17d6838fd5a tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:41.659058 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6760e09d-874f-47af-9234-d17d6838fd5a tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:41.659778 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6760e09d-874f-47af-9234-d17d6838fd5a tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:41.660338 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6760e09d-874f-47af-9234-d17d6838fd5a tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:41.660810 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6760e09d-874f-47af-9234-d17d6838fd5a tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:41.814078 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-6760e09d-874f-47af-9234-d17d6838fd5a tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/a342b2c8-6705-49b0-baeb-90c538744203" status: 200 len: 1466 microversion: 2.1 time: 0.169668 Oct 04 19:15:41.814955 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3082/6533] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:15:41 2022] GET /compute/v2.1/servers/a342b2c8-6705-49b0-baeb-90c538744203 => generated 1466 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:15:42.838753 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-68176c3c-c432-4341-b915-293652f8f533 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:15:42.839405 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-68176c3c-c432-4341-b915-293652f8f533 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] [instance: a342b2c8-6705-49b0-baeb-90c538744203] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:15:42.841336 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=2 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:15:42.843303 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=2 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:15:42.851028 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-68176c3c-c432-4341-b915-293652f8f533 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:42.851524 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-68176c3c-c432-4341-b915-293652f8f533 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:42.851974 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-68176c3c-c432-4341-b915-293652f8f533 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:42.852687 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-68176c3c-c432-4341-b915-293652f8f533 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:42.853378 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-68176c3c-c432-4341-b915-293652f8f533 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:42.853828 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-68176c3c-c432-4341-b915-293652f8f533 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:43.047543 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-68176c3c-c432-4341-b915-293652f8f533 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/a342b2c8-6705-49b0-baeb-90c538744203" status: 200 len: 1652 microversion: 2.1 time: 0.212471 Oct 04 19:15:43.050764 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3452/6534] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:15:42 2022] GET /compute/v2.1/servers/a342b2c8-6705-49b0-baeb-90c538744203 => generated 1652 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:15:43.075514 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-40f94021-4619-4f7c-a88f-3fb82fc4a3cb tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:15:43.076763 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-40f94021-4619-4f7c-a88f-3fb82fc4a3cb tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] [instance: a342b2c8-6705-49b0-baeb-90c538744203] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:15:43.084185 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=2 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:15:43.084492 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=6 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:15:43.092361 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-40f94021-4619-4f7c-a88f-3fb82fc4a3cb tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:43.093006 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-40f94021-4619-4f7c-a88f-3fb82fc4a3cb tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:43.093708 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-40f94021-4619-4f7c-a88f-3fb82fc4a3cb tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:43.094420 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-40f94021-4619-4f7c-a88f-3fb82fc4a3cb tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:43.095288 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-40f94021-4619-4f7c-a88f-3fb82fc4a3cb tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:43.096277 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-40f94021-4619-4f7c-a88f-3fb82fc4a3cb tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:43.317176 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-40f94021-4619-4f7c-a88f-3fb82fc4a3cb tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/a342b2c8-6705-49b0-baeb-90c538744203" status: 200 len: 1652 microversion: 2.1 time: 0.247696 Oct 04 19:15:43.319010 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3083/6535] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:15:43 2022] GET /compute/v2.1/servers/a342b2c8-6705-49b0-baeb-90c538744203 => generated 1652 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:15:43.340194 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-59b62435-4d68-469b-bfb4-09e9bcc6191c tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:15:43.341233 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-59b62435-4d68-469b-bfb4-09e9bcc6191c tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] [instance: a342b2c8-6705-49b0-baeb-90c538744203] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:15:43.348590 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-59b62435-4d68-469b-bfb4-09e9bcc6191c tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:43.349330 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-59b62435-4d68-469b-bfb4-09e9bcc6191c tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:43.350447 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-59b62435-4d68-469b-bfb4-09e9bcc6191c tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:43.351337 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-59b62435-4d68-469b-bfb4-09e9bcc6191c tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:43.351968 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-59b62435-4d68-469b-bfb4-09e9bcc6191c tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:43.352585 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-59b62435-4d68-469b-bfb4-09e9bcc6191c tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:43.520307 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-59b62435-4d68-469b-bfb4-09e9bcc6191c tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/a342b2c8-6705-49b0-baeb-90c538744203" status: 200 len: 1652 microversion: 2.1 time: 0.183778 Oct 04 19:15:43.521908 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3453/6536] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:15:43 2022] GET /compute/v2.1/servers/a342b2c8-6705-49b0-baeb-90c538744203 => generated 1652 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:15:43.656687 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-8e6c897a-b482-459b-b880-29faf8f21525 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-1180770336", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452", "availability_zone": "nova:n-h2-851028-13", "networks": [{"uuid": "5be18aa9-c4d8-4054-b36c-61b3c5ae4de7"}]}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:15:43.725431 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.network.neutron [None req-8e6c897a-b482-459b-b880-29faf8f21525 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] validate_networks() for [('5be18aa9-c4d8-4054-b36c-61b3c5ae4de7', None, None, None, None, None)] {{(pid=123595) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 19:15:44.132730 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-8e6c897a-b482-459b-b880-29faf8f21525 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Flavor limits 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:15:44.133458 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-8e6c897a-b482-459b-b880-29faf8f21525 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Image limits 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:15:44.133660 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-8e6c897a-b482-459b-b880-29faf8f21525 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Flavor pref 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:15:44.134274 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-8e6c897a-b482-459b-b880-29faf8f21525 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Image pref 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:15:44.134706 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-8e6c897a-b482-459b-b880-29faf8f21525 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:15:44.143652 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8e6c897a-b482-459b-b880-29faf8f21525 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:44.144139 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8e6c897a-b482-459b-b880-29faf8f21525 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:44.144578 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8e6c897a-b482-459b-b880-29faf8f21525 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:44.145607 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8e6c897a-b482-459b-b880-29faf8f21525 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:44.146063 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8e6c897a-b482-459b-b880-29faf8f21525 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:44.146673 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8e6c897a-b482-459b-b880-29faf8f21525 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:44.166120 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-8e6c897a-b482-459b-b880-29faf8f21525 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Getting quotas for project 4153b53d11ea43f3825177f2ace63313. Resources: {'ram', 'cores', 'instances'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:15:44.173452 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-8e6c897a-b482-459b-b880-29faf8f21525 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Getting quotas for user 6d79f7bc52de4a26ae92ca8182189d3b and project 4153b53d11ea43f3825177f2ace63313. Resources: {'ram', 'cores', 'instances'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:15:44.190824 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-8e6c897a-b482-459b-b880-29faf8f21525 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Going to run 1 instances... {{(pid=123595) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 19:15:44.194271 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-8e6c897a-b482-459b-b880-29faf8f21525 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] [instance: ae61be3c-c1ff-442c-aece-a940792e0855] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e8943ec5-4038-4d4b-b9b9-2415a79f5243',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 19:15:44.257128 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-8e6c897a-b482-459b-b880-29faf8f21525 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.605509 Oct 04 19:15:44.259312 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3084/6537] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 19:15:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 608 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 19:15:44.270483 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-4a16bfef-b13c-45aa-b2ac-e973de64b936 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:15:44.272338 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-4a16bfef-b13c-45aa-b2ac-e973de64b936 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] [instance: ae61be3c-c1ff-442c-aece-a940792e0855] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:15:44.412222 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-4a16bfef-b13c-45aa-b2ac-e973de64b936 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/ae61be3c-c1ff-442c-aece-a940792e0855" status: 200 len: 1329 microversion: 2.1 time: 0.145956 Oct 04 19:15:44.425737 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3454/6538] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:15:44 2022] GET /compute/v2.1/servers/ae61be3c-c1ff-442c-aece-a940792e0855 => generated 1329 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:15:45.091920 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-edd587df-3153-4e32-a386-7235b416b6e3 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-1713045677", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452", "networks": [{"uuid": "485d1b8d-1bbb-487c-a29d-7ba9e2f023bd"}]}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:15:45.143160 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.network.neutron [None req-edd587df-3153-4e32-a386-7235b416b6e3 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] validate_networks() for [('485d1b8d-1bbb-487c-a29d-7ba9e2f023bd', None, None, None, None, None)] {{(pid=123595) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 19:15:45.438286 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-729c0bc5-3082-4b4e-abb4-aad75cd00b57 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:15:45.439138 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-729c0bc5-3082-4b4e-abb4-aad75cd00b57 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] [instance: ae61be3c-c1ff-442c-aece-a940792e0855] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:15:45.448059 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-729c0bc5-3082-4b4e-abb4-aad75cd00b57 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:45.449471 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-729c0bc5-3082-4b4e-abb4-aad75cd00b57 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:45.450241 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-729c0bc5-3082-4b4e-abb4-aad75cd00b57 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:45.451859 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-729c0bc5-3082-4b4e-abb4-aad75cd00b57 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:45.452624 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-729c0bc5-3082-4b4e-abb4-aad75cd00b57 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:45.453149 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-729c0bc5-3082-4b4e-abb4-aad75cd00b57 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:45.516204 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-edd587df-3153-4e32-a386-7235b416b6e3 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Flavor limits 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:15:45.516648 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-edd587df-3153-4e32-a386-7235b416b6e3 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Image limits 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:15:45.517169 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-edd587df-3153-4e32-a386-7235b416b6e3 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Flavor pref 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:15:45.517585 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-edd587df-3153-4e32-a386-7235b416b6e3 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Image pref 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:15:45.517997 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-edd587df-3153-4e32-a386-7235b416b6e3 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:15:45.530995 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-edd587df-3153-4e32-a386-7235b416b6e3 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:45.532149 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-edd587df-3153-4e32-a386-7235b416b6e3 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:45.532682 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-edd587df-3153-4e32-a386-7235b416b6e3 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:45.533704 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-edd587df-3153-4e32-a386-7235b416b6e3 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:45.534467 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-edd587df-3153-4e32-a386-7235b416b6e3 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:45.535026 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-edd587df-3153-4e32-a386-7235b416b6e3 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:45.536510 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-729c0bc5-3082-4b4e-abb4-aad75cd00b57 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/ae61be3c-c1ff-442c-aece-a940792e0855" status: 200 len: 1436 microversion: 2.1 time: 0.102143 Oct 04 19:15:45.537342 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3455/6539] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:15:45 2022] GET /compute/v2.1/servers/ae61be3c-c1ff-442c-aece-a940792e0855 => generated 1436 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:15:45.561596 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-edd587df-3153-4e32-a386-7235b416b6e3 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Getting quotas for project bd1b4cee855b4a9192331adfb4e2fec8. Resources: {'ram', 'cores', 'instances'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:15:45.567317 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-edd587df-3153-4e32-a386-7235b416b6e3 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Getting quotas for user f88deea46eb6447dadd18ee13341e2c1 and project bd1b4cee855b4a9192331adfb4e2fec8. Resources: {'ram', 'cores', 'instances'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:15:45.580940 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-edd587df-3153-4e32-a386-7235b416b6e3 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Going to run 1 instances... {{(pid=123595) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 19:15:45.583163 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-edd587df-3153-4e32-a386-7235b416b6e3 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] [instance: b92ff689-d715-4759-85aa-f88e94901a5b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e8943ec5-4038-4d4b-b9b9-2415a79f5243',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 19:15:45.629914 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-edd587df-3153-4e32-a386-7235b416b6e3 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.664451 Oct 04 19:15:45.630799 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3085/6540] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 19:15:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 666 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 19:15:45.642092 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-28ec65f0-aa18-44d3-b3d7-388ec82a490c tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:15:45.643049 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-28ec65f0-aa18-44d3-b3d7-388ec82a490c tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] [instance: b92ff689-d715-4759-85aa-f88e94901a5b] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:15:45.707919 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-28ec65f0-aa18-44d3-b3d7-388ec82a490c tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88deea46eb6447dadd18ee13341e2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1b4cee855b4a9192331adfb4e2fec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:15:45.715120 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-28ec65f0-aa18-44d3-b3d7-388ec82a490c tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] 10.222.0.43 "GET /compute/v2.1/servers/b92ff689-d715-4759-85aa-f88e94901a5b" status: 200 len: 1215 microversion: 2.1 time: 0.076983 Oct 04 19:15:45.716074 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3456/6541] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:15:45 2022] GET /compute/v2.1/servers/b92ff689-d715-4759-85aa-f88e94901a5b => generated 1215 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:15:46.562674 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-645ef1ee-5eaf-45bc-879c-0a30f4daa014 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:15:46.563387 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-645ef1ee-5eaf-45bc-879c-0a30f4daa014 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] [instance: ae61be3c-c1ff-442c-aece-a940792e0855] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:15:46.569452 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-645ef1ee-5eaf-45bc-879c-0a30f4daa014 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:46.569938 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-645ef1ee-5eaf-45bc-879c-0a30f4daa014 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:46.570374 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-645ef1ee-5eaf-45bc-879c-0a30f4daa014 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:46.571071 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-645ef1ee-5eaf-45bc-879c-0a30f4daa014 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:46.571585 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-645ef1ee-5eaf-45bc-879c-0a30f4daa014 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:46.572016 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-645ef1ee-5eaf-45bc-879c-0a30f4daa014 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:46.710216 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-645ef1ee-5eaf-45bc-879c-0a30f4daa014 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/ae61be3c-c1ff-442c-aece-a940792e0855" status: 200 len: 1466 microversion: 2.1 time: 0.152641 Oct 04 19:15:46.710810 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3086/6542] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:15:46 2022] GET /compute/v2.1/servers/ae61be3c-c1ff-442c-aece-a940792e0855 => generated 1466 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:15:46.740725 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-324e624c-60cd-4881-9a33-7beb2334f1c6 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:15:46.741392 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-324e624c-60cd-4881-9a33-7beb2334f1c6 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] [instance: b92ff689-d715-4759-85aa-f88e94901a5b] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:15:46.751871 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-324e624c-60cd-4881-9a33-7beb2334f1c6 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:46.753096 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-324e624c-60cd-4881-9a33-7beb2334f1c6 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:46.753855 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-324e624c-60cd-4881-9a33-7beb2334f1c6 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:46.754162 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-e5803af0-c5df-43ff-a1de-b3433d886418 req-2329734d-aeef-4f61-b66b-eb73fde583ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae61be3c-c1ff-442c-aece-a940792e0855", "tag": "72f85364-f963-409f-b8d6-5cbb9c2dc269"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:15:46.755366 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-324e624c-60cd-4881-9a33-7beb2334f1c6 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:46.756549 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-324e624c-60cd-4881-9a33-7beb2334f1c6 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:46.757283 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-324e624c-60cd-4881-9a33-7beb2334f1c6 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:46.765918 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-e5803af0-c5df-43ff-a1de-b3433d886418 req-2329734d-aeef-4f61-b66b-eb73fde583ab service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:46.766702 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-e5803af0-c5df-43ff-a1de-b3433d886418 req-2329734d-aeef-4f61-b66b-eb73fde583ab service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:46.767404 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-e5803af0-c5df-43ff-a1de-b3433d886418 req-2329734d-aeef-4f61-b66b-eb73fde583ab service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:46.780375 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-e5803af0-c5df-43ff-a1de-b3433d886418 req-2329734d-aeef-4f61-b66b-eb73fde583ab service nova] Creating event network-changed:72f85364-f963-409f-b8d6-5cbb9c2dc269 for instance ae61be3c-c1ff-442c-aece-a940792e0855 on n-h2-851028-13 Oct 04 19:15:46.786339 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-e5803af0-c5df-43ff-a1de-b3433d886418 req-2329734d-aeef-4f61-b66b-eb73fde583ab service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039441 Oct 04 19:15:46.787804 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3087/6543] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:15:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:15:46.882620 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-324e624c-60cd-4881-9a33-7beb2334f1c6 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88deea46eb6447dadd18ee13341e2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1b4cee855b4a9192331adfb4e2fec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:15:46.891146 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-324e624c-60cd-4881-9a33-7beb2334f1c6 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] 10.222.0.43 "GET /compute/v2.1/servers/b92ff689-d715-4759-85aa-f88e94901a5b" status: 200 len: 1275 microversion: 2.1 time: 0.155702 Oct 04 19:15:46.891935 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3457/6544] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:15:46 2022] GET /compute/v2.1/servers/b92ff689-d715-4759-85aa-f88e94901a5b => generated 1275 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:15:47.737838 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-4c5c47fb-464e-4957-a6bc-c7e237b9845e tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:15:47.738606 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-4c5c47fb-464e-4957-a6bc-c7e237b9845e tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] [instance: ae61be3c-c1ff-442c-aece-a940792e0855] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:15:47.745014 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4c5c47fb-464e-4957-a6bc-c7e237b9845e tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:47.745547 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4c5c47fb-464e-4957-a6bc-c7e237b9845e tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:47.746616 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4c5c47fb-464e-4957-a6bc-c7e237b9845e tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:47.747318 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4c5c47fb-464e-4957-a6bc-c7e237b9845e tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:47.747784 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4c5c47fb-464e-4957-a6bc-c7e237b9845e tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:47.748219 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4c5c47fb-464e-4957-a6bc-c7e237b9845e tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:47.916106 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-295ffb4e-6db3-4e8c-ba28-5f6a4025cfa9 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:15:47.916791 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-295ffb4e-6db3-4e8c-ba28-5f6a4025cfa9 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] [instance: b92ff689-d715-4759-85aa-f88e94901a5b] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:15:47.924466 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-295ffb4e-6db3-4e8c-ba28-5f6a4025cfa9 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:47.924955 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-295ffb4e-6db3-4e8c-ba28-5f6a4025cfa9 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:47.925425 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-295ffb4e-6db3-4e8c-ba28-5f6a4025cfa9 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:47.926131 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-295ffb4e-6db3-4e8c-ba28-5f6a4025cfa9 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:47.926584 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-295ffb4e-6db3-4e8c-ba28-5f6a4025cfa9 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:47.927074 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-295ffb4e-6db3-4e8c-ba28-5f6a4025cfa9 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:47.952318 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-4c5c47fb-464e-4957-a6bc-c7e237b9845e tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/ae61be3c-c1ff-442c-aece-a940792e0855" status: 200 len: 1466 microversion: 2.1 time: 0.219536 Oct 04 19:15:47.953353 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3088/6545] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:15:47 2022] GET /compute/v2.1/servers/ae61be3c-c1ff-442c-aece-a940792e0855 => generated 1466 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:15:48.069879 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-295ffb4e-6db3-4e8c-ba28-5f6a4025cfa9 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88deea46eb6447dadd18ee13341e2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1b4cee855b4a9192331adfb4e2fec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:15:48.078671 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-295ffb4e-6db3-4e8c-ba28-5f6a4025cfa9 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] 10.222.0.43 "GET /compute/v2.1/servers/b92ff689-d715-4759-85aa-f88e94901a5b" status: 200 len: 1315 microversion: 2.1 time: 0.166760 Oct 04 19:15:48.079348 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3458/6546] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:15:47 2022] GET /compute/v2.1/servers/b92ff689-d715-4759-85aa-f88e94901a5b => generated 1315 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:15:48.209450 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-17da930e-0526-4782-be1f-52ad2b680688 req-06cd2368-3411-4500-87a0-63074bf015fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b92ff689-d715-4759-85aa-f88e94901a5b", "tag": "38052cf2-05a0-4e7f-8c69-27b351f0b3d9"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:15:48.223978 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-17da930e-0526-4782-be1f-52ad2b680688 req-06cd2368-3411-4500-87a0-63074bf015fa service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:48.224659 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-17da930e-0526-4782-be1f-52ad2b680688 req-06cd2368-3411-4500-87a0-63074bf015fa service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:48.225654 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-17da930e-0526-4782-be1f-52ad2b680688 req-06cd2368-3411-4500-87a0-63074bf015fa service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:48.239263 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-17da930e-0526-4782-be1f-52ad2b680688 req-06cd2368-3411-4500-87a0-63074bf015fa service nova] Creating event network-changed:38052cf2-05a0-4e7f-8c69-27b351f0b3d9 for instance b92ff689-d715-4759-85aa-f88e94901a5b on n-h1-851028-13 Oct 04 19:15:48.244267 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-17da930e-0526-4782-be1f-52ad2b680688 req-06cd2368-3411-4500-87a0-63074bf015fa service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041524 Oct 04 19:15:48.245298 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3089/6547] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:15:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:15:48.976032 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-b294fa10-ca22-47c0-b827-f2f0e0b73b4d tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:15:48.976660 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-b294fa10-ca22-47c0-b827-f2f0e0b73b4d tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] [instance: ae61be3c-c1ff-442c-aece-a940792e0855] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:15:48.984382 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b294fa10-ca22-47c0-b827-f2f0e0b73b4d tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:48.984880 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b294fa10-ca22-47c0-b827-f2f0e0b73b4d tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:48.985425 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b294fa10-ca22-47c0-b827-f2f0e0b73b4d tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:48.986132 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b294fa10-ca22-47c0-b827-f2f0e0b73b4d tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:48.986595 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b294fa10-ca22-47c0-b827-f2f0e0b73b4d tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:48.987031 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b294fa10-ca22-47c0-b827-f2f0e0b73b4d tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:49.103752 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-8b82e2aa-4b4e-4509-8293-33915c7f1c2b tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:15:49.104458 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-8b82e2aa-4b4e-4509-8293-33915c7f1c2b tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] [instance: b92ff689-d715-4759-85aa-f88e94901a5b] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:15:49.111233 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8b82e2aa-4b4e-4509-8293-33915c7f1c2b tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:49.111725 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8b82e2aa-4b4e-4509-8293-33915c7f1c2b tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:49.112162 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8b82e2aa-4b4e-4509-8293-33915c7f1c2b tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:49.113049 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8b82e2aa-4b4e-4509-8293-33915c7f1c2b tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:49.113534 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8b82e2aa-4b4e-4509-8293-33915c7f1c2b tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:49.113963 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8b82e2aa-4b4e-4509-8293-33915c7f1c2b tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:49.116907 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-b294fa10-ca22-47c0-b827-f2f0e0b73b4d tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/ae61be3c-c1ff-442c-aece-a940792e0855" status: 200 len: 1466 microversion: 2.1 time: 0.144828 Oct 04 19:15:49.117513 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3459/6548] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:15:48 2022] GET /compute/v2.1/servers/ae61be3c-c1ff-442c-aece-a940792e0855 => generated 1466 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:15:49.242108 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-8b82e2aa-4b4e-4509-8293-33915c7f1c2b tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88deea46eb6447dadd18ee13341e2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1b4cee855b4a9192331adfb4e2fec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:15:49.249925 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-8b82e2aa-4b4e-4509-8293-33915c7f1c2b tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] 10.222.0.43 "GET /compute/v2.1/servers/b92ff689-d715-4759-85aa-f88e94901a5b" status: 200 len: 1315 microversion: 2.1 time: 0.151390 Oct 04 19:15:49.250509 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3090/6549] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:15:49 2022] GET /compute/v2.1/servers/b92ff689-d715-4759-85aa-f88e94901a5b => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:15:50.139908 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-62accb3e-b9f7-4c1b-8db7-8e37348c7b37 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:15:50.140633 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-62accb3e-b9f7-4c1b-8db7-8e37348c7b37 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] [instance: ae61be3c-c1ff-442c-aece-a940792e0855] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:15:50.150806 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-62accb3e-b9f7-4c1b-8db7-8e37348c7b37 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:50.151694 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-62accb3e-b9f7-4c1b-8db7-8e37348c7b37 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:50.153247 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-62accb3e-b9f7-4c1b-8db7-8e37348c7b37 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:50.154520 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-62accb3e-b9f7-4c1b-8db7-8e37348c7b37 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:50.155336 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-62accb3e-b9f7-4c1b-8db7-8e37348c7b37 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:50.156044 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-62accb3e-b9f7-4c1b-8db7-8e37348c7b37 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:50.273411 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-9e41070f-fd57-4c42-b5f7-57df62679d65 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:15:50.274035 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-9e41070f-fd57-4c42-b5f7-57df62679d65 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] [instance: b92ff689-d715-4759-85aa-f88e94901a5b] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:15:50.281392 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9e41070f-fd57-4c42-b5f7-57df62679d65 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:50.281910 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9e41070f-fd57-4c42-b5f7-57df62679d65 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:50.282357 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9e41070f-fd57-4c42-b5f7-57df62679d65 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:50.283070 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9e41070f-fd57-4c42-b5f7-57df62679d65 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:50.283529 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9e41070f-fd57-4c42-b5f7-57df62679d65 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:50.283971 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9e41070f-fd57-4c42-b5f7-57df62679d65 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:50.296356 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-62accb3e-b9f7-4c1b-8db7-8e37348c7b37 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/ae61be3c-c1ff-442c-aece-a940792e0855" status: 200 len: 1466 microversion: 2.1 time: 0.160660 Oct 04 19:15:50.296944 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3460/6550] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:15:50 2022] GET /compute/v2.1/servers/ae61be3c-c1ff-442c-aece-a940792e0855 => generated 1466 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:15:50.420970 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-9e41070f-fd57-4c42-b5f7-57df62679d65 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88deea46eb6447dadd18ee13341e2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1b4cee855b4a9192331adfb4e2fec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:15:50.428953 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-9e41070f-fd57-4c42-b5f7-57df62679d65 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] 10.222.0.43 "GET /compute/v2.1/servers/b92ff689-d715-4759-85aa-f88e94901a5b" status: 200 len: 1315 microversion: 2.1 time: 0.159491 Oct 04 19:15:50.429572 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3091/6551] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:15:50 2022] GET /compute/v2.1/servers/b92ff689-d715-4759-85aa-f88e94901a5b => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:15:51.319699 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-a8922b79-0ab2-4067-9d07-5e510e6f6cda tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:15:51.320255 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-a8922b79-0ab2-4067-9d07-5e510e6f6cda tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] [instance: ae61be3c-c1ff-442c-aece-a940792e0855] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:15:51.327144 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a8922b79-0ab2-4067-9d07-5e510e6f6cda tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:51.327630 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a8922b79-0ab2-4067-9d07-5e510e6f6cda tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:51.328072 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a8922b79-0ab2-4067-9d07-5e510e6f6cda tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:51.328766 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a8922b79-0ab2-4067-9d07-5e510e6f6cda tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:51.329257 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a8922b79-0ab2-4067-9d07-5e510e6f6cda tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:51.329690 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a8922b79-0ab2-4067-9d07-5e510e6f6cda tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:51.452518 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-8b085083-c99d-420c-935e-b5df285a2479 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:15:51.453171 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-8b085083-c99d-420c-935e-b5df285a2479 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] [instance: b92ff689-d715-4759-85aa-f88e94901a5b] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:15:51.459268 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-a8922b79-0ab2-4067-9d07-5e510e6f6cda tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/ae61be3c-c1ff-442c-aece-a940792e0855" status: 200 len: 1466 microversion: 2.1 time: 0.143342 Oct 04 19:15:51.459853 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3461/6552] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:15:51 2022] GET /compute/v2.1/servers/ae61be3c-c1ff-442c-aece-a940792e0855 => generated 1466 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:15:51.460128 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8b085083-c99d-420c-935e-b5df285a2479 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:51.460641 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8b085083-c99d-420c-935e-b5df285a2479 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:51.461123 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8b085083-c99d-420c-935e-b5df285a2479 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:51.462023 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8b085083-c99d-420c-935e-b5df285a2479 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:51.462310 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8b085083-c99d-420c-935e-b5df285a2479 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:51.462741 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8b085083-c99d-420c-935e-b5df285a2479 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:51.593664 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-8b085083-c99d-420c-935e-b5df285a2479 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88deea46eb6447dadd18ee13341e2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1b4cee855b4a9192331adfb4e2fec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:15:51.601634 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-8b085083-c99d-420c-935e-b5df285a2479 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] 10.222.0.43 "GET /compute/v2.1/servers/b92ff689-d715-4759-85aa-f88e94901a5b" status: 200 len: 1315 microversion: 2.1 time: 0.153562 Oct 04 19:15:51.602217 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3092/6553] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:15:51 2022] GET /compute/v2.1/servers/b92ff689-d715-4759-85aa-f88e94901a5b => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:15:52.482977 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-827a585f-b2a0-4bb4-9e25-0abbdb803ea8 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:15:52.483580 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-827a585f-b2a0-4bb4-9e25-0abbdb803ea8 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] [instance: ae61be3c-c1ff-442c-aece-a940792e0855] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:15:52.491325 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-827a585f-b2a0-4bb4-9e25-0abbdb803ea8 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:52.491816 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-827a585f-b2a0-4bb4-9e25-0abbdb803ea8 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:52.492263 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-827a585f-b2a0-4bb4-9e25-0abbdb803ea8 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:52.492967 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-827a585f-b2a0-4bb4-9e25-0abbdb803ea8 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:52.493453 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-827a585f-b2a0-4bb4-9e25-0abbdb803ea8 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:52.493881 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-827a585f-b2a0-4bb4-9e25-0abbdb803ea8 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:52.498369 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:15:52.518140 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-0ab1c5ee-682a-4004-9639-06c386537ee9 req-3cc09575-2213-4a79-93be-1485cfd12f24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b92ff689-d715-4759-85aa-f88e94901a5b", "name": "network-vif-plugged", "status": "completed", "tag": "38052cf2-05a0-4e7f-8c69-27b351f0b3d9"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:15:52.530241 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-0ab1c5ee-682a-4004-9639-06c386537ee9 req-3cc09575-2213-4a79-93be-1485cfd12f24 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:52.530798 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-0ab1c5ee-682a-4004-9639-06c386537ee9 req-3cc09575-2213-4a79-93be-1485cfd12f24 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:52.531332 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-0ab1c5ee-682a-4004-9639-06c386537ee9 req-3cc09575-2213-4a79-93be-1485cfd12f24 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:52.546344 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-0ab1c5ee-682a-4004-9639-06c386537ee9 req-3cc09575-2213-4a79-93be-1485cfd12f24 service nova] Creating event network-vif-plugged:38052cf2-05a0-4e7f-8c69-27b351f0b3d9 for instance b92ff689-d715-4759-85aa-f88e94901a5b on n-h1-851028-13 Oct 04 19:15:52.551444 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-0ab1c5ee-682a-4004-9639-06c386537ee9 req-3cc09575-2213-4a79-93be-1485cfd12f24 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037121 Oct 04 19:15:52.552277 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3093/6554] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:15:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:15:52.628202 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-fafbf382-53cd-4b8f-aa80-c181843e97ec tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:15:52.628448 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-fafbf382-53cd-4b8f-aa80-c181843e97ec tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] [instance: b92ff689-d715-4759-85aa-f88e94901a5b] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:15:52.638946 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fafbf382-53cd-4b8f-aa80-c181843e97ec tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:52.639663 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fafbf382-53cd-4b8f-aa80-c181843e97ec tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:52.641215 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fafbf382-53cd-4b8f-aa80-c181843e97ec tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:52.642600 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fafbf382-53cd-4b8f-aa80-c181843e97ec tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:52.643253 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fafbf382-53cd-4b8f-aa80-c181843e97ec tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:52.644112 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-827a585f-b2a0-4bb4-9e25-0abbdb803ea8 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/ae61be3c-c1ff-442c-aece-a940792e0855" status: 200 len: 1466 microversion: 2.1 time: 0.159366 Oct 04 19:15:52.644645 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fafbf382-53cd-4b8f-aa80-c181843e97ec tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:52.645414 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3462/6555] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:15:52 2022] GET /compute/v2.1/servers/ae61be3c-c1ff-442c-aece-a940792e0855 => generated 1466 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:15:52.818285 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-fafbf382-53cd-4b8f-aa80-c181843e97ec tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88deea46eb6447dadd18ee13341e2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1b4cee855b4a9192331adfb4e2fec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:15:52.826709 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-fafbf382-53cd-4b8f-aa80-c181843e97ec tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] 10.222.0.43 "GET /compute/v2.1/servers/b92ff689-d715-4759-85aa-f88e94901a5b" status: 200 len: 1315 microversion: 2.1 time: 0.203956 Oct 04 19:15:52.827278 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3094/6556] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:15:52 2022] GET /compute/v2.1/servers/b92ff689-d715-4759-85aa-f88e94901a5b => generated 1315 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:15:53.667919 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-3cb841e4-8c46-4ebb-bf26-55a5582378f8 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:15:53.668565 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-3cb841e4-8c46-4ebb-bf26-55a5582378f8 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] [instance: ae61be3c-c1ff-442c-aece-a940792e0855] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:15:53.675500 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3cb841e4-8c46-4ebb-bf26-55a5582378f8 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:53.675988 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3cb841e4-8c46-4ebb-bf26-55a5582378f8 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:53.676432 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3cb841e4-8c46-4ebb-bf26-55a5582378f8 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:53.677137 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3cb841e4-8c46-4ebb-bf26-55a5582378f8 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:53.677602 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3cb841e4-8c46-4ebb-bf26-55a5582378f8 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:53.678028 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3cb841e4-8c46-4ebb-bf26-55a5582378f8 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:53.805387 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-3cb841e4-8c46-4ebb-bf26-55a5582378f8 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/ae61be3c-c1ff-442c-aece-a940792e0855" status: 200 len: 1466 microversion: 2.1 time: 0.141373 Oct 04 19:15:53.806023 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3463/6557] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:15:53 2022] GET /compute/v2.1/servers/ae61be3c-c1ff-442c-aece-a940792e0855 => generated 1466 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:15:53.849874 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-7844cef2-8978-4b4b-ab3c-c8a555a21b23 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:15:53.850527 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-7844cef2-8978-4b4b-ab3c-c8a555a21b23 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] [instance: b92ff689-d715-4759-85aa-f88e94901a5b] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:15:53.857761 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7844cef2-8978-4b4b-ab3c-c8a555a21b23 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:53.858253 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7844cef2-8978-4b4b-ab3c-c8a555a21b23 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:53.858703 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7844cef2-8978-4b4b-ab3c-c8a555a21b23 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:53.859400 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7844cef2-8978-4b4b-ab3c-c8a555a21b23 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:53.859862 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7844cef2-8978-4b4b-ab3c-c8a555a21b23 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:53.860296 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7844cef2-8978-4b4b-ab3c-c8a555a21b23 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:53.998491 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-7844cef2-8978-4b4b-ab3c-c8a555a21b23 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88deea46eb6447dadd18ee13341e2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1b4cee855b4a9192331adfb4e2fec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:15:54.006430 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-7844cef2-8978-4b4b-ab3c-c8a555a21b23 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] 10.222.0.43 "GET /compute/v2.1/servers/b92ff689-d715-4759-85aa-f88e94901a5b" status: 200 len: 1315 microversion: 2.1 time: 0.160634 Oct 04 19:15:54.007025 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3095/6558] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:15:53 2022] GET /compute/v2.1/servers/b92ff689-d715-4759-85aa-f88e94901a5b => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:15:54.569402 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-9a0ddc29-1b7e-4911-978a-c40d0da4d3d9 req-1ec881e1-7908-454b-9d21-84aead8a2acc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae61be3c-c1ff-442c-aece-a940792e0855", "name": "network-vif-plugged", "status": "completed", "tag": "72f85364-f963-409f-b8d6-5cbb9c2dc269"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:15:54.579160 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-9a0ddc29-1b7e-4911-978a-c40d0da4d3d9 req-1ec881e1-7908-454b-9d21-84aead8a2acc service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:54.579652 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-9a0ddc29-1b7e-4911-978a-c40d0da4d3d9 req-1ec881e1-7908-454b-9d21-84aead8a2acc service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:54.580097 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-9a0ddc29-1b7e-4911-978a-c40d0da4d3d9 req-1ec881e1-7908-454b-9d21-84aead8a2acc service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:54.590965 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-9a0ddc29-1b7e-4911-978a-c40d0da4d3d9 req-1ec881e1-7908-454b-9d21-84aead8a2acc service nova] Creating event network-vif-plugged:72f85364-f963-409f-b8d6-5cbb9c2dc269 for instance ae61be3c-c1ff-442c-aece-a940792e0855 on n-h2-851028-13 Oct 04 19:15:54.595961 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-9a0ddc29-1b7e-4911-978a-c40d0da4d3d9 req-1ec881e1-7908-454b-9d21-84aead8a2acc service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030520 Oct 04 19:15:54.596646 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3464/6559] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:15:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:15:54.827698 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-9d2a3e57-4bdb-426d-8103-6b7cc254aa87 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:15:54.828328 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-9d2a3e57-4bdb-426d-8103-6b7cc254aa87 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] [instance: ae61be3c-c1ff-442c-aece-a940792e0855] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:15:54.834541 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9d2a3e57-4bdb-426d-8103-6b7cc254aa87 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:54.835036 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9d2a3e57-4bdb-426d-8103-6b7cc254aa87 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:54.835485 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9d2a3e57-4bdb-426d-8103-6b7cc254aa87 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:54.836471 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9d2a3e57-4bdb-426d-8103-6b7cc254aa87 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:54.836934 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9d2a3e57-4bdb-426d-8103-6b7cc254aa87 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:54.837403 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9d2a3e57-4bdb-426d-8103-6b7cc254aa87 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:54.966194 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-9d2a3e57-4bdb-426d-8103-6b7cc254aa87 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/ae61be3c-c1ff-442c-aece-a940792e0855" status: 200 len: 1466 microversion: 2.1 time: 0.142231 Oct 04 19:15:54.967091 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3096/6560] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:15:54 2022] GET /compute/v2.1/servers/ae61be3c-c1ff-442c-aece-a940792e0855 => generated 1466 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:15:55.031643 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-61fee7f0-20da-48b0-97f5-5af6c408b71b tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:15:55.032359 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-61fee7f0-20da-48b0-97f5-5af6c408b71b tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] [instance: b92ff689-d715-4759-85aa-f88e94901a5b] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:15:55.039380 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-61fee7f0-20da-48b0-97f5-5af6c408b71b tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:55.039874 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-61fee7f0-20da-48b0-97f5-5af6c408b71b tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:55.040326 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-61fee7f0-20da-48b0-97f5-5af6c408b71b tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:55.041031 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-61fee7f0-20da-48b0-97f5-5af6c408b71b tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:55.041544 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-61fee7f0-20da-48b0-97f5-5af6c408b71b tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:55.041985 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-61fee7f0-20da-48b0-97f5-5af6c408b71b tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:55.178043 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-61fee7f0-20da-48b0-97f5-5af6c408b71b tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88deea46eb6447dadd18ee13341e2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1b4cee855b4a9192331adfb4e2fec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:15:55.185893 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-61fee7f0-20da-48b0-97f5-5af6c408b71b tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] 10.222.0.43 "GET /compute/v2.1/servers/b92ff689-d715-4759-85aa-f88e94901a5b" status: 200 len: 1501 microversion: 2.1 time: 0.159921 Oct 04 19:15:55.186476 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3465/6561] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:15:55 2022] GET /compute/v2.1/servers/b92ff689-d715-4759-85aa-f88e94901a5b => generated 1501 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:15:55.208742 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-5daa6b0a-b94a-4542-a610-a083af514016 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:15:55.209382 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-5daa6b0a-b94a-4542-a610-a083af514016 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] [instance: b92ff689-d715-4759-85aa-f88e94901a5b] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:15:55.215920 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5daa6b0a-b94a-4542-a610-a083af514016 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:55.216403 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5daa6b0a-b94a-4542-a610-a083af514016 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:55.216838 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5daa6b0a-b94a-4542-a610-a083af514016 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:55.217561 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5daa6b0a-b94a-4542-a610-a083af514016 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:55.218015 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5daa6b0a-b94a-4542-a610-a083af514016 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:55.218442 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5daa6b0a-b94a-4542-a610-a083af514016 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:55.354995 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-5daa6b0a-b94a-4542-a610-a083af514016 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88deea46eb6447dadd18ee13341e2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1b4cee855b4a9192331adfb4e2fec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:15:55.362656 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-5daa6b0a-b94a-4542-a610-a083af514016 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] 10.222.0.43 "GET /compute/v2.1/servers/b92ff689-d715-4759-85aa-f88e94901a5b" status: 200 len: 1501 microversion: 2.1 time: 0.157725 Oct 04 19:15:55.363230 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3097/6562] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:15:55 2022] GET /compute/v2.1/servers/b92ff689-d715-4759-85aa-f88e94901a5b => generated 1501 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:15:55.384752 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-eb2992c3-a501-407c-a6e6-6021458d32be tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:15:55.385331 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-eb2992c3-a501-407c-a6e6-6021458d32be tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] [instance: b92ff689-d715-4759-85aa-f88e94901a5b] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:15:55.391966 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-eb2992c3-a501-407c-a6e6-6021458d32be tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:55.392458 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-eb2992c3-a501-407c-a6e6-6021458d32be tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:55.392911 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-eb2992c3-a501-407c-a6e6-6021458d32be tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:55.393690 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-eb2992c3-a501-407c-a6e6-6021458d32be tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:55.394162 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-eb2992c3-a501-407c-a6e6-6021458d32be tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:55.394603 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-eb2992c3-a501-407c-a6e6-6021458d32be tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:55.418286 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.objects.instance [None req-eb2992c3-a501-407c-a6e6-6021458d32be tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Lazy-loading 'flavor' on Instance uuid b92ff689-d715-4759-85aa-f88e94901a5b {{(pid=123596) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 19:15:55.484428 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-eb2992c3-a501-407c-a6e6-6021458d32be tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] 10.222.0.43 "POST /compute/v2.1/servers/b92ff689-d715-4759-85aa-f88e94901a5b/action" status: 202 len: 0 microversion: 2.1 time: 0.103369 Oct 04 19:15:55.485176 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3466/6563] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 19:15:55 2022] POST /compute/v2.1/servers/b92ff689-d715-4759-85aa-f88e94901a5b/action => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:15:55.493398 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-3f052acb-af29-40a7-bdcf-907ae42891d3 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:15:55.494015 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-3f052acb-af29-40a7-bdcf-907ae42891d3 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] [instance: b92ff689-d715-4759-85aa-f88e94901a5b] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:15:55.500461 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3f052acb-af29-40a7-bdcf-907ae42891d3 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:55.500898 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3f052acb-af29-40a7-bdcf-907ae42891d3 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:55.501372 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3f052acb-af29-40a7-bdcf-907ae42891d3 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:55.502121 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3f052acb-af29-40a7-bdcf-907ae42891d3 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:55.502614 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3f052acb-af29-40a7-bdcf-907ae42891d3 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:55.503034 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3f052acb-af29-40a7-bdcf-907ae42891d3 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:55.546881 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=4 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:15:55.575133 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=12 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:15:55.635621 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-3f052acb-af29-40a7-bdcf-907ae42891d3 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88deea46eb6447dadd18ee13341e2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1b4cee855b4a9192331adfb4e2fec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:15:55.644393 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-3f052acb-af29-40a7-bdcf-907ae42891d3 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] 10.222.0.43 "GET /compute/v2.1/servers/b92ff689-d715-4759-85aa-f88e94901a5b" status: 200 len: 1509 microversion: 2.1 time: 0.154919 Oct 04 19:15:55.645227 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3098/6564] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:15:55 2022] GET /compute/v2.1/servers/b92ff689-d715-4759-85aa-f88e94901a5b => generated 1509 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:15:55.987159 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=4 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:15:55.992116 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-5600b94c-c9ca-4151-83e2-cf61084dc097 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:15:55.992876 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-5600b94c-c9ca-4151-83e2-cf61084dc097 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] [instance: ae61be3c-c1ff-442c-aece-a940792e0855] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:15:56.002595 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5600b94c-c9ca-4151-83e2-cf61084dc097 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:56.003100 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5600b94c-c9ca-4151-83e2-cf61084dc097 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:56.003549 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5600b94c-c9ca-4151-83e2-cf61084dc097 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:56.005073 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5600b94c-c9ca-4151-83e2-cf61084dc097 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:56.005883 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5600b94c-c9ca-4151-83e2-cf61084dc097 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:56.006327 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5600b94c-c9ca-4151-83e2-cf61084dc097 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:56.152050 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-5600b94c-c9ca-4151-83e2-cf61084dc097 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/ae61be3c-c1ff-442c-aece-a940792e0855" status: 200 len: 1651 microversion: 2.1 time: 0.166268 Oct 04 19:15:56.152676 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3467/6565] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:15:55 2022] GET /compute/v2.1/servers/ae61be3c-c1ff-442c-aece-a940792e0855 => generated 1651 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:15:56.174510 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-e9056e61-dfe6-4c3d-b167-b4baa09b368f tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:15:56.175191 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-e9056e61-dfe6-4c3d-b167-b4baa09b368f tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] [instance: ae61be3c-c1ff-442c-aece-a940792e0855] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:15:56.182028 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e9056e61-dfe6-4c3d-b167-b4baa09b368f tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:56.182519 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e9056e61-dfe6-4c3d-b167-b4baa09b368f tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:56.182960 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e9056e61-dfe6-4c3d-b167-b4baa09b368f tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:56.184320 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e9056e61-dfe6-4c3d-b167-b4baa09b368f tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:56.184781 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e9056e61-dfe6-4c3d-b167-b4baa09b368f tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:56.185246 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e9056e61-dfe6-4c3d-b167-b4baa09b368f tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:56.313360 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-e9056e61-dfe6-4c3d-b167-b4baa09b368f tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/ae61be3c-c1ff-442c-aece-a940792e0855" status: 200 len: 1651 microversion: 2.1 time: 0.142466 Oct 04 19:15:56.313935 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3099/6566] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:15:56 2022] GET /compute/v2.1/servers/ae61be3c-c1ff-442c-aece-a940792e0855 => generated 1651 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:15:56.334670 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-6bb06b0e-4bd6-48c6-b847-06f3779dcdb8 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:15:56.335281 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-6bb06b0e-4bd6-48c6-b847-06f3779dcdb8 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] [instance: ae61be3c-c1ff-442c-aece-a940792e0855] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:15:56.341863 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6bb06b0e-4bd6-48c6-b847-06f3779dcdb8 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:56.342356 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6bb06b0e-4bd6-48c6-b847-06f3779dcdb8 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:56.342797 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6bb06b0e-4bd6-48c6-b847-06f3779dcdb8 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:56.343486 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6bb06b0e-4bd6-48c6-b847-06f3779dcdb8 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:56.343944 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6bb06b0e-4bd6-48c6-b847-06f3779dcdb8 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:56.344369 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6bb06b0e-4bd6-48c6-b847-06f3779dcdb8 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:56.469552 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-6bb06b0e-4bd6-48c6-b847-06f3779dcdb8 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/ae61be3c-c1ff-442c-aece-a940792e0855" status: 200 len: 1651 microversion: 2.1 time: 0.138554 Oct 04 19:15:56.470133 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3468/6567] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:15:56 2022] GET /compute/v2.1/servers/ae61be3c-c1ff-442c-aece-a940792e0855 => generated 1651 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:15:56.492012 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-8baaf26e-366e-46d5-b2e8-6e043008f6f4 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:15:56.492526 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-8baaf26e-366e-46d5-b2e8-6e043008f6f4 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] [instance: ae61be3c-c1ff-442c-aece-a940792e0855] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:15:56.498525 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8baaf26e-366e-46d5-b2e8-6e043008f6f4 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:56.499021 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8baaf26e-366e-46d5-b2e8-6e043008f6f4 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:56.499472 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8baaf26e-366e-46d5-b2e8-6e043008f6f4 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:56.500171 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8baaf26e-366e-46d5-b2e8-6e043008f6f4 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:56.500635 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8baaf26e-366e-46d5-b2e8-6e043008f6f4 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:56.501071 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8baaf26e-366e-46d5-b2e8-6e043008f6f4 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:56.525478 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-8baaf26e-366e-46d5-b2e8-6e043008f6f4 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] [instance: ae61be3c-c1ff-442c-aece-a940792e0855] Going to try to terminate instance {{(pid=123595) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 19:15:56.527699 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=100 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:15:56.602906 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-8baaf26e-366e-46d5-b2e8-6e043008f6f4 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] 10.222.0.43 "DELETE /compute/v2.1/servers/ae61be3c-c1ff-442c-aece-a940792e0855" status: 204 len: 0 microversion: 2.1 time: 0.114465 Oct 04 19:15:56.603499 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3100/6568] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 19:15:56 2022] DELETE /compute/v2.1/servers/ae61be3c-c1ff-442c-aece-a940792e0855 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:15:56.612691 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-e9765718-c50d-47c1-887e-405fb42d1195 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:15:56.613364 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-e9765718-c50d-47c1-887e-405fb42d1195 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] [instance: ae61be3c-c1ff-442c-aece-a940792e0855] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:15:56.619375 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e9765718-c50d-47c1-887e-405fb42d1195 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:56.619871 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e9765718-c50d-47c1-887e-405fb42d1195 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:56.620325 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e9765718-c50d-47c1-887e-405fb42d1195 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:56.621062 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e9765718-c50d-47c1-887e-405fb42d1195 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:56.621558 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e9765718-c50d-47c1-887e-405fb42d1195 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:56.621997 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e9765718-c50d-47c1-887e-405fb42d1195 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:56.668149 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-b9f0c89a-8fe4-4ea2-be52-eb6d2edf80a7 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:15:56.670277 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-b9f0c89a-8fe4-4ea2-be52-eb6d2edf80a7 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] [instance: b92ff689-d715-4759-85aa-f88e94901a5b] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:15:56.677435 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b9f0c89a-8fe4-4ea2-be52-eb6d2edf80a7 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:56.677936 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b9f0c89a-8fe4-4ea2-be52-eb6d2edf80a7 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:56.678401 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b9f0c89a-8fe4-4ea2-be52-eb6d2edf80a7 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:56.680084 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b9f0c89a-8fe4-4ea2-be52-eb6d2edf80a7 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:56.680725 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b9f0c89a-8fe4-4ea2-be52-eb6d2edf80a7 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:56.681188 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b9f0c89a-8fe4-4ea2-be52-eb6d2edf80a7 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:56.755507 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-e9765718-c50d-47c1-887e-405fb42d1195 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/ae61be3c-c1ff-442c-aece-a940792e0855" status: 200 len: 1657 microversion: 2.1 time: 0.146482 Oct 04 19:15:56.756109 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3469/6569] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:15:56 2022] GET /compute/v2.1/servers/ae61be3c-c1ff-442c-aece-a940792e0855 => generated 1657 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:15:56.816104 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-b9f0c89a-8fe4-4ea2-be52-eb6d2edf80a7 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88deea46eb6447dadd18ee13341e2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1b4cee855b4a9192331adfb4e2fec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:15:56.824440 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-b9f0c89a-8fe4-4ea2-be52-eb6d2edf80a7 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] 10.222.0.43 "GET /compute/v2.1/servers/b92ff689-d715-4759-85aa-f88e94901a5b" status: 200 len: 1492 microversion: 2.1 time: 0.160459 Oct 04 19:15:56.825008 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3101/6570] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:15:56 2022] GET /compute/v2.1/servers/b92ff689-d715-4759-85aa-f88e94901a5b => generated 1492 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:15:56.847516 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-3428267a-a0de-4481-b833-7242a76c2ff2 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:15:56.848059 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-3428267a-a0de-4481-b833-7242a76c2ff2 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] [instance: b92ff689-d715-4759-85aa-f88e94901a5b] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:15:56.854042 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3428267a-a0de-4481-b833-7242a76c2ff2 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:56.854525 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3428267a-a0de-4481-b833-7242a76c2ff2 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:56.854963 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3428267a-a0de-4481-b833-7242a76c2ff2 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:56.855939 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3428267a-a0de-4481-b833-7242a76c2ff2 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:56.856402 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3428267a-a0de-4481-b833-7242a76c2ff2 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:56.856833 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3428267a-a0de-4481-b833-7242a76c2ff2 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:56.922640 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-3428267a-a0de-4481-b833-7242a76c2ff2 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] 10.222.0.43 "POST /compute/v2.1/servers/b92ff689-d715-4759-85aa-f88e94901a5b/action" status: 202 len: 0 microversion: 2.1 time: 0.078780 Oct 04 19:15:56.923284 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3470/6571] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 19:15:56 2022] POST /compute/v2.1/servers/b92ff689-d715-4759-85aa-f88e94901a5b/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:15:56.931736 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-6c02635a-bbdf-41a4-93db-b4298f3aed2b tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:15:56.932393 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-6c02635a-bbdf-41a4-93db-b4298f3aed2b tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] [instance: b92ff689-d715-4759-85aa-f88e94901a5b] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:15:56.938705 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6c02635a-bbdf-41a4-93db-b4298f3aed2b tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:56.939208 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6c02635a-bbdf-41a4-93db-b4298f3aed2b tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:56.939658 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6c02635a-bbdf-41a4-93db-b4298f3aed2b tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:56.940526 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6c02635a-bbdf-41a4-93db-b4298f3aed2b tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:56.940991 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6c02635a-bbdf-41a4-93db-b4298f3aed2b tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:56.941465 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6c02635a-bbdf-41a4-93db-b4298f3aed2b tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:57.165435 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-6c02635a-bbdf-41a4-93db-b4298f3aed2b tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88deea46eb6447dadd18ee13341e2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1b4cee855b4a9192331adfb4e2fec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:15:57.173475 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-6c02635a-bbdf-41a4-93db-b4298f3aed2b tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] 10.222.0.43 "GET /compute/v2.1/servers/b92ff689-d715-4759-85aa-f88e94901a5b" status: 200 len: 1498 microversion: 2.1 time: 0.245733 Oct 04 19:15:57.174060 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3102/6572] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:15:56 2022] GET /compute/v2.1/servers/b92ff689-d715-4759-85aa-f88e94901a5b => generated 1498 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:15:57.781238 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-4a3369cf-803a-481e-bc44-2ed6d4578e43 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:15:57.781946 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-4a3369cf-803a-481e-bc44-2ed6d4578e43 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] [instance: ae61be3c-c1ff-442c-aece-a940792e0855] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:15:57.788238 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4a3369cf-803a-481e-bc44-2ed6d4578e43 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:57.788733 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4a3369cf-803a-481e-bc44-2ed6d4578e43 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:57.789458 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4a3369cf-803a-481e-bc44-2ed6d4578e43 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:57.790159 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4a3369cf-803a-481e-bc44-2ed6d4578e43 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:57.790613 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4a3369cf-803a-481e-bc44-2ed6d4578e43 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:57.791044 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4a3369cf-803a-481e-bc44-2ed6d4578e43 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:57.940762 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-4a3369cf-803a-481e-bc44-2ed6d4578e43 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/ae61be3c-c1ff-442c-aece-a940792e0855" status: 200 len: 1657 microversion: 2.1 time: 0.165303 Oct 04 19:15:57.941385 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3471/6573] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:15:57 2022] GET /compute/v2.1/servers/ae61be3c-c1ff-442c-aece-a940792e0855 => generated 1657 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:15:58.196943 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-eb483215-91ae-4078-b42a-6c2343ade366 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:15:58.197690 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-eb483215-91ae-4078-b42a-6c2343ade366 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] [instance: b92ff689-d715-4759-85aa-f88e94901a5b] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:15:58.204955 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-eb483215-91ae-4078-b42a-6c2343ade366 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:58.205487 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-eb483215-91ae-4078-b42a-6c2343ade366 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:58.205939 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-eb483215-91ae-4078-b42a-6c2343ade366 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:58.206647 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-eb483215-91ae-4078-b42a-6c2343ade366 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:58.207114 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-eb483215-91ae-4078-b42a-6c2343ade366 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:58.207559 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-eb483215-91ae-4078-b42a-6c2343ade366 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:58.346495 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-d2859cde-631e-4e59-a8cf-4f0a2182da38 req-d5c4bbeb-bd3b-404c-a8e1-9bb843dd4a83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae61be3c-c1ff-442c-aece-a940792e0855", "name": "network-vif-deleted", "tag": "72f85364-f963-409f-b8d6-5cbb9c2dc269"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:15:58.359877 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-d2859cde-631e-4e59-a8cf-4f0a2182da38 req-d5c4bbeb-bd3b-404c-a8e1-9bb843dd4a83 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:58.360493 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-d2859cde-631e-4e59-a8cf-4f0a2182da38 req-d5c4bbeb-bd3b-404c-a8e1-9bb843dd4a83 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:58.361290 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-d2859cde-631e-4e59-a8cf-4f0a2182da38 req-d5c4bbeb-bd3b-404c-a8e1-9bb843dd4a83 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:58.378046 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-d2859cde-631e-4e59-a8cf-4f0a2182da38 req-d5c4bbeb-bd3b-404c-a8e1-9bb843dd4a83 service nova] Creating event network-vif-deleted:72f85364-f963-409f-b8d6-5cbb9c2dc269 for instance ae61be3c-c1ff-442c-aece-a940792e0855 on n-h2-851028-13 Oct 04 19:15:58.384332 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-d2859cde-631e-4e59-a8cf-4f0a2182da38 req-d5c4bbeb-bd3b-404c-a8e1-9bb843dd4a83 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045167 Oct 04 19:15:58.385128 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3472/6574] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:15:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:15:58.409360 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-eb483215-91ae-4078-b42a-6c2343ade366 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88deea46eb6447dadd18ee13341e2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1b4cee855b4a9192331adfb4e2fec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:15:58.429446 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-eb483215-91ae-4078-b42a-6c2343ade366 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] 10.222.0.43 "GET /compute/v2.1/servers/b92ff689-d715-4759-85aa-f88e94901a5b" status: 200 len: 1498 microversion: 2.1 time: 0.231599 Oct 04 19:15:58.433278 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3103/6575] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:15:58 2022] GET /compute/v2.1/servers/b92ff689-d715-4759-85aa-f88e94901a5b => generated 1498 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:15:58.965430 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-087ea7cd-a97b-490d-a7a7-318f6d788729 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:15:58.966141 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-087ea7cd-a97b-490d-a7a7-318f6d788729 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] [instance: ae61be3c-c1ff-442c-aece-a940792e0855] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:15:58.972424 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-087ea7cd-a97b-490d-a7a7-318f6d788729 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:58.973018 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-087ea7cd-a97b-490d-a7a7-318f6d788729 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:58.973489 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-087ea7cd-a97b-490d-a7a7-318f6d788729 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:58.974192 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-087ea7cd-a97b-490d-a7a7-318f6d788729 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:58.974654 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-087ea7cd-a97b-490d-a7a7-318f6d788729 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:58.975093 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-087ea7cd-a97b-490d-a7a7-318f6d788729 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:58.989632 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-087ea7cd-a97b-490d-a7a7-318f6d788729 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] HTTP exception thrown: Instance ae61be3c-c1ff-442c-aece-a940792e0855 could not be found. Oct 04 19:15:58.991288 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-087ea7cd-a97b-490d-a7a7-318f6d788729 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Request method failure captured: Oct 04 19:15:58.991288 n-d-851028-13 devstack@n-api.service[123596]: request: GET /compute/v2.1/servers/ae61be3c-c1ff-442c-aece-a940792e0855 HTTP/1.1 Oct 04 19:15:58.991288 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 19:15:58.991288 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 19:15:58.991288 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 19:15:58.991288 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 19:15:58.991288 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 19:15:58.991288 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 19:15:58.991288 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 19:15:58.991288 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 19:15:58.991288 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPIZTwHCYh_srxW_q0unbxa_NCXh87u9MSSZwwEK_3D_0gdP9fPr22hxjwr1ufh_jfQ4OnvDm3VLUwAuUWsxXFtyMIR0zS6XdP6lhLWEBdWEy6jr_U58IWJyYXMJIGR6jfBYUb7B5XY4KhTzAPDIRAGT-Qhh-dMwbH49c58hC_4i31rQ Oct 04 19:15:58.991288 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 19:15:58.991288 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 19:15:58.991288 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 19:15:58.991288 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 19:15:58.991288 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 19:15:58.991288 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 19:15:58.991288 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: 4153b53d11ea43f3825177f2ace63313 Oct 04 19:15:58.991288 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-TestServerMultinode-1409660307 Oct 04 19:15:58.991288 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,admin,reader Oct 04 19:15:58.991288 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,admin,reader Oct 04 19:15:58.991288 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/4153b53d11ea43f3825177f2ace63313"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_4153b53d11ea43f3825177f2ace63313"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4153b53d11ea43f3825177f2ace63313"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4153b53d11ea43f3825177f2ace63313"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 19:15:58.991288 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-TestServerMultinode-1409660307 Oct 04 19:15:58.991288 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: 4153b53d11ea43f3825177f2ace63313 Oct 04 19:15:58.991288 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-TestServerMultinode-1409660307 Oct 04 19:15:58.991288 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-TestServerMultinode-1409660307-project-admin Oct 04 19:15:58.991288 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 19:15:58.991288 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 19:15:58.991288 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 6d79f7bc52de4a26ae92ca8182189d3b Oct 04 19:15:58.991288 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-TestServerMultinode-1409660307-project-admin Oct 04 19:15:58.991288 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 19:15:58.991288 n-d-851028-13 devstack@n-api.service[123596]: exception: Instance ae61be3c-c1ff-442c-aece-a940792e0855 could not be found. Oct 04 19:15:58.991288 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': 'ae61be3c-c1ff-442c-aece-a940792e0855'} Oct 04 19:15:58.991288 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:15:58.991288 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:15:58.991288 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:15:58.991288 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:15:58.991288 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:15:58.991288 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:15:58.991288 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:15:58.991288 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:15:58.991288 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:15:58.991288 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:15:58.991288 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ae61be3c-c1ff-442c-aece-a940792e0855 could not be found. Oct 04 19:15:58.991288 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:15:58.991288 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:15:58.991288 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:15:58.991288 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:15:58.991288 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:15:58.991288 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:15:58.991288 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:15:58.991288 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:15:58.991288 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:15:58.991288 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:15:58.991288 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:15:58.991288 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:15:58.991288 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:15:58.991288 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:15:58.991288 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:15:58.991288 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:15:58.991288 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae61be3c-c1ff-442c-aece-a940792e0855 could not be found. Oct 04 19:15:58.991288 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:15:58.991288 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:15:58.991288 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:15:58.997414 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:15:58.997414 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:15:58.997414 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:15:58.997414 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:15:58.997414 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:15:58.997414 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae61be3c-c1ff-442c-aece-a940792e0855 could not be found. Oct 04 19:15:58.997414 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:15:58.997414 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-087ea7cd-a97b-490d-a7a7-318f6d788729 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Returning 404 to user: Instance ae61be3c-c1ff-442c-aece-a940792e0855 could not be found. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:15:58.997414 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-087ea7cd-a97b-490d-a7a7-318f6d788729 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/ae61be3c-c1ff-442c-aece-a940792e0855" status: 404 len: 111 microversion: 2.1 time: 0.032422 Oct 04 19:15:58.997414 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3473/6576] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:15:58 2022] GET /compute/v2.1/servers/ae61be3c-c1ff-442c-aece-a940792e0855 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:15:59.002100 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-d93f0c69-baf9-45e8-aed9-d7f2d3857972 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:15:59.002612 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-d93f0c69-baf9-45e8-aed9-d7f2d3857972 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] [instance: a342b2c8-6705-49b0-baeb-90c538744203] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:15:59.008676 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d93f0c69-baf9-45e8-aed9-d7f2d3857972 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:59.009203 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d93f0c69-baf9-45e8-aed9-d7f2d3857972 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:59.009656 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d93f0c69-baf9-45e8-aed9-d7f2d3857972 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:59.010354 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d93f0c69-baf9-45e8-aed9-d7f2d3857972 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:59.010819 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d93f0c69-baf9-45e8-aed9-d7f2d3857972 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:59.011256 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d93f0c69-baf9-45e8-aed9-d7f2d3857972 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:59.035830 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-d93f0c69-baf9-45e8-aed9-d7f2d3857972 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] [instance: a342b2c8-6705-49b0-baeb-90c538744203] Going to try to terminate instance {{(pid=123595) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 19:15:59.116059 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-d93f0c69-baf9-45e8-aed9-d7f2d3857972 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] 10.222.0.43 "DELETE /compute/v2.1/servers/a342b2c8-6705-49b0-baeb-90c538744203" status: 204 len: 0 microversion: 2.1 time: 0.117460 Oct 04 19:15:59.116968 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3104/6577] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 19:15:58 2022] DELETE /compute/v2.1/servers/a342b2c8-6705-49b0-baeb-90c538744203 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:15:59.126870 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-6cbef5c3-fac1-4b1d-bd83-494fcd81f519 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:15:59.127521 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-6cbef5c3-fac1-4b1d-bd83-494fcd81f519 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] [instance: a342b2c8-6705-49b0-baeb-90c538744203] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:15:59.133869 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6cbef5c3-fac1-4b1d-bd83-494fcd81f519 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:59.134359 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6cbef5c3-fac1-4b1d-bd83-494fcd81f519 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:59.134800 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6cbef5c3-fac1-4b1d-bd83-494fcd81f519 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:59.135497 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6cbef5c3-fac1-4b1d-bd83-494fcd81f519 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:59.135980 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6cbef5c3-fac1-4b1d-bd83-494fcd81f519 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:59.136922 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6cbef5c3-fac1-4b1d-bd83-494fcd81f519 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:59.267598 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-6cbef5c3-fac1-4b1d-bd83-494fcd81f519 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/a342b2c8-6705-49b0-baeb-90c538744203" status: 200 len: 1658 microversion: 2.1 time: 0.146403 Oct 04 19:15:59.268174 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3474/6578] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:15:59 2022] GET /compute/v2.1/servers/a342b2c8-6705-49b0-baeb-90c538744203 => generated 1658 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:15:59.453586 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-b5c0e34b-d556-4451-b8dc-998114c02235 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:15:59.454209 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-b5c0e34b-d556-4451-b8dc-998114c02235 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] [instance: b92ff689-d715-4759-85aa-f88e94901a5b] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:15:59.461301 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b5c0e34b-d556-4451-b8dc-998114c02235 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:59.461789 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b5c0e34b-d556-4451-b8dc-998114c02235 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:59.462234 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b5c0e34b-d556-4451-b8dc-998114c02235 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:59.463004 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b5c0e34b-d556-4451-b8dc-998114c02235 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:59.463382 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b5c0e34b-d556-4451-b8dc-998114c02235 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:59.463811 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b5c0e34b-d556-4451-b8dc-998114c02235 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:59.596051 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-b5c0e34b-d556-4451-b8dc-998114c02235 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88deea46eb6447dadd18ee13341e2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1b4cee855b4a9192331adfb4e2fec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:15:59.603375 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-b5c0e34b-d556-4451-b8dc-998114c02235 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] 10.222.0.43 "GET /compute/v2.1/servers/b92ff689-d715-4759-85aa-f88e94901a5b" status: 200 len: 1501 microversion: 2.1 time: 0.155284 Oct 04 19:15:59.603954 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3105/6579] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:15:59 2022] GET /compute/v2.1/servers/b92ff689-d715-4759-85aa-f88e94901a5b => generated 1501 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:15:59.627077 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-d82fdd9c-f31c-4fe8-b27c-623589ff1143 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:15:59.627619 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-d82fdd9c-f31c-4fe8-b27c-623589ff1143 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] [instance: b92ff689-d715-4759-85aa-f88e94901a5b] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:15:59.633813 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d82fdd9c-f31c-4fe8-b27c-623589ff1143 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:59.634306 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d82fdd9c-f31c-4fe8-b27c-623589ff1143 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:59.634745 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d82fdd9c-f31c-4fe8-b27c-623589ff1143 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:59.635448 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d82fdd9c-f31c-4fe8-b27c-623589ff1143 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:59.635903 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d82fdd9c-f31c-4fe8-b27c-623589ff1143 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:59.636340 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d82fdd9c-f31c-4fe8-b27c-623589ff1143 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:59.659625 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.objects.instance [None req-d82fdd9c-f31c-4fe8-b27c-623589ff1143 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Lazy-loading 'flavor' on Instance uuid b92ff689-d715-4759-85aa-f88e94901a5b {{(pid=123596) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 19:15:59.725626 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-d82fdd9c-f31c-4fe8-b27c-623589ff1143 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] 10.222.0.43 "POST /compute/v2.1/servers/b92ff689-d715-4759-85aa-f88e94901a5b/action" status: 202 len: 0 microversion: 2.1 time: 0.102196 Oct 04 19:15:59.726185 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3475/6580] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 19:15:59 2022] POST /compute/v2.1/servers/b92ff689-d715-4759-85aa-f88e94901a5b/action => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:15:59.735521 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-36798955-037d-4533-be84-4f71dc19317f tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:15:59.736141 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-36798955-037d-4533-be84-4f71dc19317f tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] [instance: b92ff689-d715-4759-85aa-f88e94901a5b] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:15:59.742428 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-36798955-037d-4533-be84-4f71dc19317f tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:59.742911 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-36798955-037d-4533-be84-4f71dc19317f tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:59.743354 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-36798955-037d-4533-be84-4f71dc19317f tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:59.744045 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-36798955-037d-4533-be84-4f71dc19317f tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:59.744504 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-36798955-037d-4533-be84-4f71dc19317f tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:59.744938 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-36798955-037d-4533-be84-4f71dc19317f tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:59.882444 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-36798955-037d-4533-be84-4f71dc19317f tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88deea46eb6447dadd18ee13341e2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1b4cee855b4a9192331adfb4e2fec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:15:59.890129 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-36798955-037d-4533-be84-4f71dc19317f tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] 10.222.0.43 "GET /compute/v2.1/servers/b92ff689-d715-4759-85aa-f88e94901a5b" status: 200 len: 1509 microversion: 2.1 time: 0.158535 Oct 04 19:15:59.890701 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3106/6581] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:15:59 2022] GET /compute/v2.1/servers/b92ff689-d715-4759-85aa-f88e94901a5b => generated 1509 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:16:00.292703 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-6cecdc0b-9a0d-4bf3-b16b-c35eaec0588f tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:16:00.294136 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-6cecdc0b-9a0d-4bf3-b16b-c35eaec0588f tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] [instance: a342b2c8-6705-49b0-baeb-90c538744203] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:16:00.300492 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6cecdc0b-9a0d-4bf3-b16b-c35eaec0588f tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:16:00.300923 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6cecdc0b-9a0d-4bf3-b16b-c35eaec0588f tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:16:00.301451 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6cecdc0b-9a0d-4bf3-b16b-c35eaec0588f tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:16:00.302107 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6cecdc0b-9a0d-4bf3-b16b-c35eaec0588f tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:16:00.302561 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6cecdc0b-9a0d-4bf3-b16b-c35eaec0588f tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:16:00.302992 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6cecdc0b-9a0d-4bf3-b16b-c35eaec0588f tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:16:00.321909 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:16:00.432299 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-6cecdc0b-9a0d-4bf3-b16b-c35eaec0588f tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/a342b2c8-6705-49b0-baeb-90c538744203" status: 200 len: 1658 microversion: 2.1 time: 0.145008 Oct 04 19:16:00.432879 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3476/6582] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:16:00 2022] GET /compute/v2.1/servers/a342b2c8-6705-49b0-baeb-90c538744203 => generated 1658 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:16:00.916642 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-aa5a8a85-0442-4efb-81fa-cb8823417fb6 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:16:00.917855 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-aa5a8a85-0442-4efb-81fa-cb8823417fb6 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] [instance: b92ff689-d715-4759-85aa-f88e94901a5b] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:16:00.922611 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_api:SELECT=91,nova_api:DELETE=1,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:16:00.929216 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-aa5a8a85-0442-4efb-81fa-cb8823417fb6 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:16:00.929720 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-aa5a8a85-0442-4efb-81fa-cb8823417fb6 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:16:00.930409 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-aa5a8a85-0442-4efb-81fa-cb8823417fb6 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:16:00.931136 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-aa5a8a85-0442-4efb-81fa-cb8823417fb6 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:16:00.931598 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-aa5a8a85-0442-4efb-81fa-cb8823417fb6 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:16:00.932036 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-aa5a8a85-0442-4efb-81fa-cb8823417fb6 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:16:01.075946 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-7e4edba4-79cf-4058-8547-f5f41cd5d8c5 req-1680c7b5-951d-4ae4-b62f-3f2fc0593dba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a342b2c8-6705-49b0-baeb-90c538744203", "name": "network-vif-deleted", "tag": "21179aeb-9677-4fa5-b3c1-ccbaa6d64ac9"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:16:01.092948 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-7e4edba4-79cf-4058-8547-f5f41cd5d8c5 req-1680c7b5-951d-4ae4-b62f-3f2fc0593dba service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:16:01.093596 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-7e4edba4-79cf-4058-8547-f5f41cd5d8c5 req-1680c7b5-951d-4ae4-b62f-3f2fc0593dba service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:16:01.094414 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-7e4edba4-79cf-4058-8547-f5f41cd5d8c5 req-1680c7b5-951d-4ae4-b62f-3f2fc0593dba service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:16:01.109412 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-7e4edba4-79cf-4058-8547-f5f41cd5d8c5 req-1680c7b5-951d-4ae4-b62f-3f2fc0593dba service nova] Creating event network-vif-deleted:21179aeb-9677-4fa5-b3c1-ccbaa6d64ac9 for instance a342b2c8-6705-49b0-baeb-90c538744203 on n-h1-851028-13 Oct 04 19:16:01.126052 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-7e4edba4-79cf-4058-8547-f5f41cd5d8c5 req-1680c7b5-951d-4ae4-b62f-3f2fc0593dba service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043416 Oct 04 19:16:01.128536 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3477/6583] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:16:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:16:01.141768 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-aa5a8a85-0442-4efb-81fa-cb8823417fb6 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88deea46eb6447dadd18ee13341e2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1b4cee855b4a9192331adfb4e2fec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:16:01.150442 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-aa5a8a85-0442-4efb-81fa-cb8823417fb6 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] 10.222.0.43 "GET /compute/v2.1/servers/b92ff689-d715-4759-85aa-f88e94901a5b" status: 200 len: 1492 microversion: 2.1 time: 0.240817 Oct 04 19:16:01.151382 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3107/6584] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:16:00 2022] GET /compute/v2.1/servers/b92ff689-d715-4759-85aa-f88e94901a5b => generated 1492 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:16:01.176594 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-a059590f-2c5a-4be3-9e0f-9dfaf6e005b2 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:16:01.178266 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-a059590f-2c5a-4be3-9e0f-9dfaf6e005b2 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] [instance: b92ff689-d715-4759-85aa-f88e94901a5b] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:16:01.185237 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a059590f-2c5a-4be3-9e0f-9dfaf6e005b2 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:16:01.185845 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a059590f-2c5a-4be3-9e0f-9dfaf6e005b2 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:16:01.186367 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a059590f-2c5a-4be3-9e0f-9dfaf6e005b2 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:16:01.187157 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a059590f-2c5a-4be3-9e0f-9dfaf6e005b2 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:16:01.187694 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a059590f-2c5a-4be3-9e0f-9dfaf6e005b2 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:16:01.188231 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a059590f-2c5a-4be3-9e0f-9dfaf6e005b2 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:16:01.262710 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-a059590f-2c5a-4be3-9e0f-9dfaf6e005b2 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] 10.222.0.43 "POST /compute/v2.1/servers/b92ff689-d715-4759-85aa-f88e94901a5b/action" status: 202 len: 0 microversion: 2.1 time: 0.090889 Oct 04 19:16:01.263392 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3478/6585] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 19:16:01 2022] POST /compute/v2.1/servers/b92ff689-d715-4759-85aa-f88e94901a5b/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:16:01.271631 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-810e6111-cde7-49bc-b43b-6c744aefd7b1 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:16:01.272882 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-810e6111-cde7-49bc-b43b-6c744aefd7b1 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] [instance: b92ff689-d715-4759-85aa-f88e94901a5b] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:16:01.280108 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-810e6111-cde7-49bc-b43b-6c744aefd7b1 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:16:01.280722 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-810e6111-cde7-49bc-b43b-6c744aefd7b1 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:16:01.281413 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-810e6111-cde7-49bc-b43b-6c744aefd7b1 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:16:01.282191 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-810e6111-cde7-49bc-b43b-6c744aefd7b1 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:16:01.282939 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-810e6111-cde7-49bc-b43b-6c744aefd7b1 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:16:01.283594 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-810e6111-cde7-49bc-b43b-6c744aefd7b1 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:16:01.417007 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-810e6111-cde7-49bc-b43b-6c744aefd7b1 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88deea46eb6447dadd18ee13341e2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1b4cee855b4a9192331adfb4e2fec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:16:01.424748 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-810e6111-cde7-49bc-b43b-6c744aefd7b1 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] 10.222.0.43 "GET /compute/v2.1/servers/b92ff689-d715-4759-85aa-f88e94901a5b" status: 200 len: 1498 microversion: 2.1 time: 0.157228 Oct 04 19:16:01.425282 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3108/6586] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:16:01 2022] GET /compute/v2.1/servers/b92ff689-d715-4759-85aa-f88e94901a5b => generated 1498 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:16:01.457090 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-48b1950e-212b-404f-8ce3-7875e8effd14 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:16:01.457817 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-48b1950e-212b-404f-8ce3-7875e8effd14 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] [instance: a342b2c8-6705-49b0-baeb-90c538744203] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:16:01.464199 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-48b1950e-212b-404f-8ce3-7875e8effd14 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:16:01.465374 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-48b1950e-212b-404f-8ce3-7875e8effd14 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:16:01.465828 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-48b1950e-212b-404f-8ce3-7875e8effd14 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:16:01.466546 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-48b1950e-212b-404f-8ce3-7875e8effd14 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:16:01.467008 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-48b1950e-212b-404f-8ce3-7875e8effd14 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:16:01.467441 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-48b1950e-212b-404f-8ce3-7875e8effd14 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:16:01.502181 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-48b1950e-212b-404f-8ce3-7875e8effd14 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:16:01.502672 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-48b1950e-212b-404f-8ce3-7875e8effd14 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:16:01.503122 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-48b1950e-212b-404f-8ce3-7875e8effd14 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:16:01.503792 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.objects.instance [None req-48b1950e-212b-404f-8ce3-7875e8effd14 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Lazy-loading 'fault' on Instance uuid a342b2c8-6705-49b0-baeb-90c538744203 {{(pid=123596) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 19:16:01.563113 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-48b1950e-212b-404f-8ce3-7875e8effd14 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/a342b2c8-6705-49b0-baeb-90c538744203" status: 200 len: 1456 microversion: 2.1 time: 0.110880 Oct 04 19:16:01.563686 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3479/6587] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:16:01 2022] GET /compute/v2.1/servers/a342b2c8-6705-49b0-baeb-90c538744203 => generated 1456 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:16:02.449157 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-b380e5f1-52b5-419c-a67c-8cd8f1526b73 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:16:02.449795 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-b380e5f1-52b5-419c-a67c-8cd8f1526b73 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] [instance: b92ff689-d715-4759-85aa-f88e94901a5b] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:16:02.456838 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b380e5f1-52b5-419c-a67c-8cd8f1526b73 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:16:02.458279 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b380e5f1-52b5-419c-a67c-8cd8f1526b73 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:16:02.458279 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b380e5f1-52b5-419c-a67c-8cd8f1526b73 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:16:02.458537 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b380e5f1-52b5-419c-a67c-8cd8f1526b73 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:16:02.459007 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b380e5f1-52b5-419c-a67c-8cd8f1526b73 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:16:02.459441 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b380e5f1-52b5-419c-a67c-8cd8f1526b73 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:16:02.590538 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-4604ab48-889a-4194-bd82-04b976f87e03 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:16:02.591186 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-4604ab48-889a-4194-bd82-04b976f87e03 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] [instance: a342b2c8-6705-49b0-baeb-90c538744203] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:16:02.599121 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4604ab48-889a-4194-bd82-04b976f87e03 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:16:02.599616 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4604ab48-889a-4194-bd82-04b976f87e03 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:16:02.600073 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4604ab48-889a-4194-bd82-04b976f87e03 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:16:02.600938 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4604ab48-889a-4194-bd82-04b976f87e03 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:16:02.601455 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4604ab48-889a-4194-bd82-04b976f87e03 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:16:02.601895 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4604ab48-889a-4194-bd82-04b976f87e03 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:16:02.604211 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-b380e5f1-52b5-419c-a67c-8cd8f1526b73 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88deea46eb6447dadd18ee13341e2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1b4cee855b4a9192331adfb4e2fec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:16:02.613247 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-b380e5f1-52b5-419c-a67c-8cd8f1526b73 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] 10.222.0.43 "GET /compute/v2.1/servers/b92ff689-d715-4759-85aa-f88e94901a5b" status: 200 len: 1498 microversion: 2.1 time: 0.167618 Oct 04 19:16:02.613911 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3109/6588] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:16:02 2022] GET /compute/v2.1/servers/b92ff689-d715-4759-85aa-f88e94901a5b => generated 1498 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:16:02.616661 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-4604ab48-889a-4194-bd82-04b976f87e03 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] HTTP exception thrown: Instance a342b2c8-6705-49b0-baeb-90c538744203 could not be found. Oct 04 19:16:02.618387 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-4604ab48-889a-4194-bd82-04b976f87e03 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Request method failure captured: Oct 04 19:16:02.618387 n-d-851028-13 devstack@n-api.service[123596]: request: GET /compute/v2.1/servers/a342b2c8-6705-49b0-baeb-90c538744203 HTTP/1.1 Oct 04 19:16:02.618387 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 19:16:02.618387 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 19:16:02.618387 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 19:16:02.618387 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 19:16:02.618387 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 19:16:02.618387 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 19:16:02.618387 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 19:16:02.618387 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 19:16:02.618387 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPIZTwHCYh_srxW_q0unbxa_NCXh87u9MSSZwwEK_3D_0gdP9fPr22hxjwr1ufh_jfQ4OnvDm3VLUwAuUWsxXFtyMIR0zS6XdP6lhLWEBdWEy6jr_U58IWJyYXMJIGR6jfBYUb7B5XY4KhTzAPDIRAGT-Qhh-dMwbH49c58hC_4i31rQ Oct 04 19:16:02.618387 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 19:16:02.618387 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 19:16:02.618387 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 19:16:02.618387 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 19:16:02.618387 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 19:16:02.618387 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 19:16:02.618387 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: 4153b53d11ea43f3825177f2ace63313 Oct 04 19:16:02.618387 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-TestServerMultinode-1409660307 Oct 04 19:16:02.618387 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,admin,reader Oct 04 19:16:02.618387 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,admin,reader Oct 04 19:16:02.618387 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/4153b53d11ea43f3825177f2ace63313"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_4153b53d11ea43f3825177f2ace63313"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4153b53d11ea43f3825177f2ace63313"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4153b53d11ea43f3825177f2ace63313"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 19:16:02.618387 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-TestServerMultinode-1409660307 Oct 04 19:16:02.618387 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: 4153b53d11ea43f3825177f2ace63313 Oct 04 19:16:02.618387 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-TestServerMultinode-1409660307 Oct 04 19:16:02.618387 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-TestServerMultinode-1409660307-project-admin Oct 04 19:16:02.618387 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 19:16:02.618387 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 19:16:02.618387 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 6d79f7bc52de4a26ae92ca8182189d3b Oct 04 19:16:02.618387 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-TestServerMultinode-1409660307-project-admin Oct 04 19:16:02.618387 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 19:16:02.618387 n-d-851028-13 devstack@n-api.service[123596]: exception: Instance a342b2c8-6705-49b0-baeb-90c538744203 could not be found. Oct 04 19:16:02.618387 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': 'a342b2c8-6705-49b0-baeb-90c538744203'} Oct 04 19:16:02.618387 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:16:02.618387 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:16:02.618387 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:16:02.618387 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:16:02.618387 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:16:02.618387 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:16:02.618387 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:16:02.618387 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:16:02.618387 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:16:02.618387 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:16:02.618387 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a342b2c8-6705-49b0-baeb-90c538744203 could not be found. Oct 04 19:16:02.618387 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:16:02.618387 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:16:02.618387 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:16:02.618387 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:16:02.618387 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:16:02.618387 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:16:02.618387 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:16:02.618387 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:16:02.618387 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:16:02.618387 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:16:02.618387 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:16:02.618387 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:16:02.618387 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:16:02.618387 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:16:02.618387 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:16:02.618387 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:16:02.618387 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a342b2c8-6705-49b0-baeb-90c538744203 could not be found. Oct 04 19:16:02.618387 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:16:02.618387 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:16:02.618387 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:16:02.622810 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:16:02.622810 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:16:02.622810 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:16:02.622810 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:16:02.622810 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:16:02.622810 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a342b2c8-6705-49b0-baeb-90c538744203 could not be found. Oct 04 19:16:02.622810 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:16:02.622810 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-4604ab48-889a-4194-bd82-04b976f87e03 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] Returning 404 to user: Instance a342b2c8-6705-49b0-baeb-90c538744203 could not be found. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:16:02.622810 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-4604ab48-889a-4194-bd82-04b976f87e03 tempest-TestServerMultinode-1409660307 tempest-TestServerMultinode-1409660307-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/a342b2c8-6705-49b0-baeb-90c538744203" status: 404 len: 111 microversion: 2.1 time: 0.033632 Oct 04 19:16:02.629942 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3480/6589] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:16:02 2022] GET /compute/v2.1/servers/a342b2c8-6705-49b0-baeb-90c538744203 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 19:16:03.637392 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-c428f510-e077-4c3c-811c-ddaff1f92e3d tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:16:03.638021 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-c428f510-e077-4c3c-811c-ddaff1f92e3d tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] [instance: b92ff689-d715-4759-85aa-f88e94901a5b] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:16:03.645306 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c428f510-e077-4c3c-811c-ddaff1f92e3d tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:16:03.645803 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c428f510-e077-4c3c-811c-ddaff1f92e3d tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:16:03.646474 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c428f510-e077-4c3c-811c-ddaff1f92e3d tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:16:03.651604 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c428f510-e077-4c3c-811c-ddaff1f92e3d tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:16:03.651604 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c428f510-e077-4c3c-811c-ddaff1f92e3d tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:16:03.651604 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c428f510-e077-4c3c-811c-ddaff1f92e3d tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:16:03.879970 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-c428f510-e077-4c3c-811c-ddaff1f92e3d tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88deea46eb6447dadd18ee13341e2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1b4cee855b4a9192331adfb4e2fec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:16:03.888449 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-c428f510-e077-4c3c-811c-ddaff1f92e3d tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] 10.222.0.43 "GET /compute/v2.1/servers/b92ff689-d715-4759-85aa-f88e94901a5b" status: 200 len: 1501 microversion: 2.1 time: 0.255514 Oct 04 19:16:03.889039 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3110/6590] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:16:03 2022] GET /compute/v2.1/servers/b92ff689-d715-4759-85aa-f88e94901a5b => generated 1501 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:16:03.910726 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-1f806f90-17ac-4c5c-be6f-b3cc276dce90 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:16:03.911285 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-1f806f90-17ac-4c5c-be6f-b3cc276dce90 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] [instance: b92ff689-d715-4759-85aa-f88e94901a5b] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:16:03.918682 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1f806f90-17ac-4c5c-be6f-b3cc276dce90 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:16:03.919250 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1f806f90-17ac-4c5c-be6f-b3cc276dce90 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:16:03.919770 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1f806f90-17ac-4c5c-be6f-b3cc276dce90 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:16:03.920552 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1f806f90-17ac-4c5c-be6f-b3cc276dce90 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:16:03.921102 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1f806f90-17ac-4c5c-be6f-b3cc276dce90 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:16:03.921625 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1f806f90-17ac-4c5c-be6f-b3cc276dce90 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:16:03.948018 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-1f806f90-17ac-4c5c-be6f-b3cc276dce90 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] [instance: b92ff689-d715-4759-85aa-f88e94901a5b] Going to try to terminate instance {{(pid=123596) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 19:16:04.026818 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-1f806f90-17ac-4c5c-be6f-b3cc276dce90 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] 10.222.0.43 "DELETE /compute/v2.1/servers/b92ff689-d715-4759-85aa-f88e94901a5b" status: 204 len: 0 microversion: 2.1 time: 0.119741 Oct 04 19:16:04.027704 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3481/6591] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 19:16:03 2022] DELETE /compute/v2.1/servers/b92ff689-d715-4759-85aa-f88e94901a5b => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:16:04.037525 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-72d2a0af-26ed-4e5e-995b-319a69a7513d tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:16:04.038068 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-72d2a0af-26ed-4e5e-995b-319a69a7513d tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] [instance: b92ff689-d715-4759-85aa-f88e94901a5b] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:16:04.044764 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-72d2a0af-26ed-4e5e-995b-319a69a7513d tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:16:04.045416 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-72d2a0af-26ed-4e5e-995b-319a69a7513d tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:16:04.046104 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-72d2a0af-26ed-4e5e-995b-319a69a7513d tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:16:04.047232 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-72d2a0af-26ed-4e5e-995b-319a69a7513d tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:16:04.047776 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-72d2a0af-26ed-4e5e-995b-319a69a7513d tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:16:04.048320 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-72d2a0af-26ed-4e5e-995b-319a69a7513d tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:16:04.291097 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-72d2a0af-26ed-4e5e-995b-319a69a7513d tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88deea46eb6447dadd18ee13341e2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1b4cee855b4a9192331adfb4e2fec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:16:04.300000 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-72d2a0af-26ed-4e5e-995b-319a69a7513d tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] 10.222.0.43 "GET /compute/v2.1/servers/b92ff689-d715-4759-85aa-f88e94901a5b" status: 200 len: 1507 microversion: 2.1 time: 0.268107 Oct 04 19:16:04.301207 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3111/6592] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:16:04 2022] GET /compute/v2.1/servers/b92ff689-d715-4759-85aa-f88e94901a5b => generated 1507 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:16:05.326442 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-0627c96a-2b86-4b6a-b5c5-7b8d99677346 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:16:05.327330 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-0627c96a-2b86-4b6a-b5c5-7b8d99677346 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] [instance: b92ff689-d715-4759-85aa-f88e94901a5b] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:16:05.334619 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0627c96a-2b86-4b6a-b5c5-7b8d99677346 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:16:05.335120 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0627c96a-2b86-4b6a-b5c5-7b8d99677346 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:16:05.335560 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0627c96a-2b86-4b6a-b5c5-7b8d99677346 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:16:05.336271 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0627c96a-2b86-4b6a-b5c5-7b8d99677346 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:16:05.336728 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0627c96a-2b86-4b6a-b5c5-7b8d99677346 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:16:05.337199 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0627c96a-2b86-4b6a-b5c5-7b8d99677346 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:16:05.478806 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-0627c96a-2b86-4b6a-b5c5-7b8d99677346 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88deea46eb6447dadd18ee13341e2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1b4cee855b4a9192331adfb4e2fec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:16:05.487779 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-0627c96a-2b86-4b6a-b5c5-7b8d99677346 tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] 10.222.0.43 "GET /compute/v2.1/servers/b92ff689-d715-4759-85aa-f88e94901a5b" status: 200 len: 1507 microversion: 2.1 time: 0.165578 Oct 04 19:16:05.488409 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3482/6593] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:16:05 2022] GET /compute/v2.1/servers/b92ff689-d715-4759-85aa-f88e94901a5b => generated 1507 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:16:06.513999 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-5facb0b4-7464-4da2-b883-9e989ceb76fb tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:16:06.514937 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-5facb0b4-7464-4da2-b883-9e989ceb76fb tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] [instance: b92ff689-d715-4759-85aa-f88e94901a5b] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:16:06.525229 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5facb0b4-7464-4da2-b883-9e989ceb76fb tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:16:06.525408 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5facb0b4-7464-4da2-b883-9e989ceb76fb tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:16:06.525791 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5facb0b4-7464-4da2-b883-9e989ceb76fb tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:16:06.532595 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-ad7c3ede-9ada-4089-8807-9f3cc491fa1f req-1847058c-b166-44fd-850f-8ba1151f5667 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b92ff689-d715-4759-85aa-f88e94901a5b", "name": "network-vif-deleted", "tag": "38052cf2-05a0-4e7f-8c69-27b351f0b3d9"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:16:06.536534 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5facb0b4-7464-4da2-b883-9e989ceb76fb tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:16:06.538286 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5facb0b4-7464-4da2-b883-9e989ceb76fb tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:16:06.540332 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5facb0b4-7464-4da2-b883-9e989ceb76fb tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:16:06.551935 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-ad7c3ede-9ada-4089-8807-9f3cc491fa1f req-1847058c-b166-44fd-850f-8ba1151f5667 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:16:06.552434 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-ad7c3ede-9ada-4089-8807-9f3cc491fa1f req-1847058c-b166-44fd-850f-8ba1151f5667 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:16:06.564416 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-ad7c3ede-9ada-4089-8807-9f3cc491fa1f req-1847058c-b166-44fd-850f-8ba1151f5667 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:16:06.579289 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-ad7c3ede-9ada-4089-8807-9f3cc491fa1f req-1847058c-b166-44fd-850f-8ba1151f5667 service nova] Creating event network-vif-deleted:38052cf2-05a0-4e7f-8c69-27b351f0b3d9 for instance b92ff689-d715-4759-85aa-f88e94901a5b on n-h1-851028-13 Oct 04 19:16:06.592745 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-ad7c3ede-9ada-4089-8807-9f3cc491fa1f req-1847058c-b166-44fd-850f-8ba1151f5667 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064784 Oct 04 19:16:06.594672 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3483/6594] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:16:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:16:06.626052 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-5facb0b4-7464-4da2-b883-9e989ceb76fb tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88deea46eb6447dadd18ee13341e2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1b4cee855b4a9192331adfb4e2fec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:16:06.635712 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-5facb0b4-7464-4da2-b883-9e989ceb76fb tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] 10.222.0.43 "GET /compute/v2.1/servers/b92ff689-d715-4759-85aa-f88e94901a5b" status: 200 len: 1465 microversion: 2.1 time: 0.127415 Oct 04 19:16:06.651843 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3112/6595] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:16:06 2022] GET /compute/v2.1/servers/b92ff689-d715-4759-85aa-f88e94901a5b => generated 1465 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:16:07.662007 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-7fcf0bae-a3b5-40f8-a157-2cf9e98b564f tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:16:07.662761 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-7fcf0bae-a3b5-40f8-a157-2cf9e98b564f tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] [instance: b92ff689-d715-4759-85aa-f88e94901a5b] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:16:07.670142 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7fcf0bae-a3b5-40f8-a157-2cf9e98b564f tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:16:07.670632 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7fcf0bae-a3b5-40f8-a157-2cf9e98b564f tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:16:07.671077 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7fcf0bae-a3b5-40f8-a157-2cf9e98b564f tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:16:07.671782 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7fcf0bae-a3b5-40f8-a157-2cf9e98b564f tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:16:07.672242 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7fcf0bae-a3b5-40f8-a157-2cf9e98b564f tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:16:07.672674 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7fcf0bae-a3b5-40f8-a157-2cf9e98b564f tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:16:07.689798 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-7fcf0bae-a3b5-40f8-a157-2cf9e98b564f tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] HTTP exception thrown: Instance b92ff689-d715-4759-85aa-f88e94901a5b could not be found. Oct 04 19:16:07.691482 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-7fcf0bae-a3b5-40f8-a157-2cf9e98b564f tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Request method failure captured: Oct 04 19:16:07.691482 n-d-851028-13 devstack@n-api.service[123596]: request: GET /compute/v2.1/servers/b92ff689-d715-4759-85aa-f88e94901a5b HTTP/1.1 Oct 04 19:16:07.691482 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 19:16:07.691482 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 19:16:07.691482 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 19:16:07.691482 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 19:16:07.691482 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 19:16:07.691482 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 19:16:07.691482 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 19:16:07.691482 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 19:16:07.691482 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPIZf-QomjGGYGXX9as53gzEmEaiDhp5nYDQZass8TuW6zrtp8_0Eg8JNr9nQxROU9GKzX97HB2xaLNuH-d089evL3anAck0aE_TfUSy35CmGipptP7YsucDTftGZGHCHHlII4UcJGKZpuGlIx-iCmf9TzoF_Bx0U4arUOBc9UBkfctg Oct 04 19:16:07.691482 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 19:16:07.691482 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 19:16:07.691482 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 19:16:07.691482 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 19:16:07.691482 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 19:16:07.691482 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 19:16:07.691482 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: bd1b4cee855b4a9192331adfb4e2fec8 Oct 04 19:16:07.691482 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-TestServerAdvancedOps-431203904 Oct 04 19:16:07.691482 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 19:16:07.691482 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 19:16:07.691482 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/bd1b4cee855b4a9192331adfb4e2fec8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_bd1b4cee855b4a9192331adfb4e2fec8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/bd1b4cee855b4a9192331adfb4e2fec8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/bd1b4cee855b4a9192331adfb4e2fec8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 19:16:07.691482 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-TestServerAdvancedOps-431203904 Oct 04 19:16:07.691482 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: bd1b4cee855b4a9192331adfb4e2fec8 Oct 04 19:16:07.691482 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-TestServerAdvancedOps-431203904 Oct 04 19:16:07.691482 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-TestServerAdvancedOps-431203904-project Oct 04 19:16:07.691482 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 19:16:07.691482 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 19:16:07.691482 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: f88deea46eb6447dadd18ee13341e2c1 Oct 04 19:16:07.691482 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-TestServerAdvancedOps-431203904-project Oct 04 19:16:07.691482 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 19:16:07.691482 n-d-851028-13 devstack@n-api.service[123596]: exception: Instance b92ff689-d715-4759-85aa-f88e94901a5b could not be found. Oct 04 19:16:07.691482 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': 'b92ff689-d715-4759-85aa-f88e94901a5b'} Oct 04 19:16:07.691482 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:16:07.691482 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:16:07.691482 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:16:07.691482 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:16:07.691482 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:16:07.691482 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:16:07.691482 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:16:07.691482 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:16:07.691482 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:16:07.691482 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:16:07.691482 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b92ff689-d715-4759-85aa-f88e94901a5b could not be found. Oct 04 19:16:07.691482 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:16:07.691482 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:16:07.691482 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:16:07.691482 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:16:07.691482 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:16:07.691482 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:16:07.691482 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:16:07.691482 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:16:07.691482 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:16:07.691482 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:16:07.691482 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:16:07.691482 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:16:07.691482 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:16:07.691482 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:16:07.691482 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:16:07.691482 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:16:07.691482 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b92ff689-d715-4759-85aa-f88e94901a5b could not be found. Oct 04 19:16:07.691482 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:16:07.691482 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:16:07.691482 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:16:07.697396 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:16:07.697396 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:16:07.697396 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:16:07.697396 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:16:07.697396 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:16:07.697396 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b92ff689-d715-4759-85aa-f88e94901a5b could not be found. Oct 04 19:16:07.697396 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:16:07.697396 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-7fcf0bae-a3b5-40f8-a157-2cf9e98b564f tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] Returning 404 to user: Instance b92ff689-d715-4759-85aa-f88e94901a5b could not be found. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:16:07.697396 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-7fcf0bae-a3b5-40f8-a157-2cf9e98b564f tempest-TestServerAdvancedOps-431203904 tempest-TestServerAdvancedOps-431203904-project] 10.222.0.43 "GET /compute/v2.1/servers/b92ff689-d715-4759-85aa-f88e94901a5b" status: 404 len: 111 microversion: 2.1 time: 0.035531 Oct 04 19:16:07.697396 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3484/6596] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:16:07 2022] GET /compute/v2.1/servers/b92ff689-d715-4759-85aa-f88e94901a5b => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:18:10.753573 n-d-851028-13 devstack@n-api.service[123595]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b5b0be1f-cd68-4bfe-8e95-82ae6af61476] AMQP server on 10.222.0.43:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 04 19:18:10.754809 n-d-851028-13 devstack@n-api.service[123595]: ERROR oslo.messaging._drivers.impl_rabbit [-] [457acf28-5277-4578-be2f-82b18e59b660] AMQP server on 10.222.0.43:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 04 19:18:10.756018 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_api:SELECT=11 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:18:10.758047 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:18:10.759823 n-d-851028-13 devstack@n-api.service[123595]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 04 19:18:10.759997 n-d-851028-13 devstack@n-api.service[123595]: Tue Oct 4 19:18:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.43) !!! Oct 04 19:18:10.762185 n-d-851028-13 devstack@n-api.service[123595]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 19:18:10.762333 n-d-851028-13 devstack@n-api.service[123595]: Tue Oct 4 19:18:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.43) !!! Oct 04 19:18:10.767942 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-d7294fa2-6c34-420e-9f7c-a43ffbc3ce12 tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Action: 'create', calling method: .version_select at 0x7fb21fbc0820>, body: {"keypair": {"name": "tempest-TestVolumeBackupRestore-1528116260", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI09h0SvO8aPKEihbioTy5HeLkbgjSmcdPNNyvAlRuAJVCLbsOhwnwVgp05spslmWhXnJIrrmek09Epu2XnGBeXT1CYX2iAMgjirnoopXM90+2IzE4JEBi3y98ckfzcS2A=="}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:18:10.792158 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-d7294fa2-6c34-420e-9f7c-a43ffbc3ce12 tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Getting quotas for project 0e23503eb33643f8a085f95db9f27c9f. Resources: {'key_pairs'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:18:10.797693 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-d7294fa2-6c34-420e-9f7c-a43ffbc3ce12 tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Getting quotas for user a397e76042e84375a1ef04101937dc84 and project 0e23503eb33643f8a085f95db9f27c9f. Resources: {'key_pairs'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:18:10.825253 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-d7294fa2-6c34-420e-9f7c-a43ffbc3ce12 tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.073907 Oct 04 19:18:10.826509 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3113/6597] 10.222.0.43 () {60 vars in 1159 bytes} [Tue Oct 4 19:18:10 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:18:11.796619 n-d-851028-13 devstack@n-api.service[123596]: ERROR oslo.messaging._drivers.impl_rabbit [-] [c592c758-2dc3-4024-92b0-c949515e0281] AMQP server on 10.222.0.43:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 04 19:18:11.797617 n-d-851028-13 devstack@n-api.service[123596]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ced6bcbb-f7de-451e-861c-054aba6c81f5] AMQP server on 10.222.0.43:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 04 19:18:11.798383 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=1 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:18:11.799194 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:18:11.801013 n-d-851028-13 devstack@n-api.service[123596]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Oct 04 19:18:11.801898 n-d-851028-13 devstack@n-api.service[123596]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 19:18:11.802027 n-d-851028-13 devstack@n-api.service[123596]: Tue Oct 4 19:18:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.43) !!! Oct 04 19:18:11.806450 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-12f8b003-79f8-48b6-8934-6da2805a0167 tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBackupRestore-server-1647786291", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "2742f47e-b118-4569-90b8-8c4ef749eafe", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-1528116260", "security_groups": [{"name": "tempest-secgroup-smoke-918915247"}], "networks": [{"uuid": "c5fd2064-7633-4e87-a6c6-b26de99e70b4"}]}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:18:12.102617 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.network.neutron [None req-12f8b003-79f8-48b6-8934-6da2805a0167 tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] validate_networks() for [('c5fd2064-7633-4e87-a6c6-b26de99e70b4', None, None, None, None, None)] {{(pid=123596) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 19:18:12.580825 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-12f8b003-79f8-48b6-8934-6da2805a0167 tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Flavor limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:18:12.581300 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-12f8b003-79f8-48b6-8934-6da2805a0167 tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Image limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:18:12.581778 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-12f8b003-79f8-48b6-8934-6da2805a0167 tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Flavor pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:18:12.582303 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-12f8b003-79f8-48b6-8934-6da2805a0167 tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Image pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:18:12.582725 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-12f8b003-79f8-48b6-8934-6da2805a0167 tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:18:12.591616 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-12f8b003-79f8-48b6-8934-6da2805a0167 tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:12.592175 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-12f8b003-79f8-48b6-8934-6da2805a0167 tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:12.592612 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-12f8b003-79f8-48b6-8934-6da2805a0167 tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:12.593387 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-12f8b003-79f8-48b6-8934-6da2805a0167 tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:12.593838 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-12f8b003-79f8-48b6-8934-6da2805a0167 tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:12.594263 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-12f8b003-79f8-48b6-8934-6da2805a0167 tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:12.611157 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-12f8b003-79f8-48b6-8934-6da2805a0167 tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Getting quotas for project 0e23503eb33643f8a085f95db9f27c9f. Resources: {'ram', 'cores', 'instances'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:18:12.616362 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-12f8b003-79f8-48b6-8934-6da2805a0167 tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Getting quotas for user a397e76042e84375a1ef04101937dc84 and project 0e23503eb33643f8a085f95db9f27c9f. Resources: {'ram', 'cores', 'instances'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:18:12.673556 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-12f8b003-79f8-48b6-8934-6da2805a0167 tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Going to run 1 instances... {{(pid=123596) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 19:18:12.675694 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-12f8b003-79f8-48b6-8934-6da2805a0167 tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] [instance: 7f20fab3-e431-4d64-859d-ef0eaa13c0a9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2742f47e-b118-4569-90b8-8c4ef749eafe',volume_size=None,volume_type=None)] {{(pid=123596) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 19:18:12.810954 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-12f8b003-79f8-48b6-8934-6da2805a0167 tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.016666 Oct 04 19:18:12.811633 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3485/6598] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 19:18:11 2022] POST /compute/v2.1/servers => generated 405 bytes in 1018 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 19:18:12.822695 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-8265e6e3-1a3a-43b0-bbd2-efafa3cd572e tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:18:12.823326 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-8265e6e3-1a3a-43b0-bbd2-efafa3cd572e tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] [instance: 7f20fab3-e431-4d64-859d-ef0eaa13c0a9] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:18:12.836482 n-d-851028-13 devstack@n-api.service[123595]: INFO oslo.messaging._drivers.impl_rabbit [-] [b5b0be1f-cd68-4bfe-8e95-82ae6af61476] Reconnected to AMQP server on 10.222.0.43:5672 via [amqp] client with port 43978. Oct 04 19:18:12.851322 n-d-851028-13 devstack@n-api.service[123595]: INFO oslo.messaging._drivers.impl_rabbit [-] [457acf28-5277-4578-be2f-82b18e59b660] Reconnected to AMQP server on 10.222.0.43:5672 via [amqp] client with port 43980. Oct 04 19:18:12.943131 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-8265e6e3-1a3a-43b0-bbd2-efafa3cd572e tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a397e76042e84375a1ef04101937dc84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e23503eb33643f8a085f95db9f27c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:18:12.950653 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-8265e6e3-1a3a-43b0-bbd2-efafa3cd572e tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] 10.222.0.43 "GET /compute/v2.1/servers/7f20fab3-e431-4d64-859d-ef0eaa13c0a9" status: 200 len: 1099 microversion: 2.1 time: 0.131827 Oct 04 19:18:12.951234 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3114/6599] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:18:12 2022] GET /compute/v2.1/servers/7f20fab3-e431-4d64-859d-ef0eaa13c0a9 => generated 1099 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:18:13.974664 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-b91f9289-b5db-49af-82cf-f92e8b44843f tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:18:13.975951 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-b91f9289-b5db-49af-82cf-f92e8b44843f tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] [instance: 7f20fab3-e431-4d64-859d-ef0eaa13c0a9] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:18:13.979409 n-d-851028-13 devstack@n-api.service[123596]: INFO oslo.messaging._drivers.impl_rabbit [-] [c592c758-2dc3-4024-92b0-c949515e0281] Reconnected to AMQP server on 10.222.0.43:5672 via [amqp] client with port 43972. Oct 04 19:18:13.980219 n-d-851028-13 devstack@n-api.service[123596]: INFO oslo.messaging._drivers.impl_rabbit [-] [ced6bcbb-f7de-451e-861c-054aba6c81f5] Reconnected to AMQP server on 10.222.0.43:5672 via [amqp] client with port 43974. Oct 04 19:18:13.984772 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b91f9289-b5db-49af-82cf-f92e8b44843f tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:13.985299 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b91f9289-b5db-49af-82cf-f92e8b44843f tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:13.985773 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b91f9289-b5db-49af-82cf-f92e8b44843f tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:13.986509 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b91f9289-b5db-49af-82cf-f92e8b44843f tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:13.987064 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b91f9289-b5db-49af-82cf-f92e8b44843f tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:13.988342 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b91f9289-b5db-49af-82cf-f92e8b44843f tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:14.073177 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-b91f9289-b5db-49af-82cf-f92e8b44843f tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a397e76042e84375a1ef04101937dc84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e23503eb33643f8a085f95db9f27c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:18:14.081868 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-b91f9289-b5db-49af-82cf-f92e8b44843f tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] 10.222.0.43 "GET /compute/v2.1/servers/7f20fab3-e431-4d64-859d-ef0eaa13c0a9" status: 200 len: 1215 microversion: 2.1 time: 0.112316 Oct 04 19:18:14.082755 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3486/6600] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:18:13 2022] GET /compute/v2.1/servers/7f20fab3-e431-4d64-859d-ef0eaa13c0a9 => generated 1215 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:18:15.105307 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-343afa93-42c0-46ff-9052-d9615dc81abf tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:18:15.106778 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-343afa93-42c0-46ff-9052-d9615dc81abf tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] [instance: 7f20fab3-e431-4d64-859d-ef0eaa13c0a9] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:18:15.115668 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-343afa93-42c0-46ff-9052-d9615dc81abf tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:15.116194 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-343afa93-42c0-46ff-9052-d9615dc81abf tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:15.116644 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-343afa93-42c0-46ff-9052-d9615dc81abf tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:15.117496 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-343afa93-42c0-46ff-9052-d9615dc81abf tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:15.117858 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-343afa93-42c0-46ff-9052-d9615dc81abf tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:15.118292 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-343afa93-42c0-46ff-9052-d9615dc81abf tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:15.323241 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-343afa93-42c0-46ff-9052-d9615dc81abf tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a397e76042e84375a1ef04101937dc84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e23503eb33643f8a085f95db9f27c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:18:15.335562 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-343afa93-42c0-46ff-9052-d9615dc81abf tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] 10.222.0.43 "GET /compute/v2.1/servers/7f20fab3-e431-4d64-859d-ef0eaa13c0a9" status: 200 len: 1282 microversion: 2.1 time: 0.234509 Oct 04 19:18:15.336154 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3115/6601] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:18:15 2022] GET /compute/v2.1/servers/7f20fab3-e431-4d64-859d-ef0eaa13c0a9 => generated 1282 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:18:15.359849 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-8a4856c5-c230-494d-84ea-d1307fd9ddd2 req-1e34f280-0f85-4676-9722-dafda7cde2b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f20fab3-e431-4d64-859d-ef0eaa13c0a9", "tag": "a4afb684-0b39-48bb-ae18-e54124bbeab8"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:18:15.370932 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-8a4856c5-c230-494d-84ea-d1307fd9ddd2 req-1e34f280-0f85-4676-9722-dafda7cde2b3 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:15.371529 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-8a4856c5-c230-494d-84ea-d1307fd9ddd2 req-1e34f280-0f85-4676-9722-dafda7cde2b3 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:15.372059 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-8a4856c5-c230-494d-84ea-d1307fd9ddd2 req-1e34f280-0f85-4676-9722-dafda7cde2b3 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:15.386662 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-8a4856c5-c230-494d-84ea-d1307fd9ddd2 req-1e34f280-0f85-4676-9722-dafda7cde2b3 service nova] Creating event network-changed:a4afb684-0b39-48bb-ae18-e54124bbeab8 for instance 7f20fab3-e431-4d64-859d-ef0eaa13c0a9 on n-h1-851028-13 Oct 04 19:18:15.391899 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-8a4856c5-c230-494d-84ea-d1307fd9ddd2 req-1e34f280-0f85-4676-9722-dafda7cde2b3 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040982 Oct 04 19:18:15.392784 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3487/6602] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:18:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:18:16.359066 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-efe62854-1781-4b3c-a2c8-4cdd5e5afa96 tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:18:16.359687 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-efe62854-1781-4b3c-a2c8-4cdd5e5afa96 tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] [instance: 7f20fab3-e431-4d64-859d-ef0eaa13c0a9] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:18:16.366635 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-efe62854-1781-4b3c-a2c8-4cdd5e5afa96 tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:16.367122 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-efe62854-1781-4b3c-a2c8-4cdd5e5afa96 tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:16.367563 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-efe62854-1781-4b3c-a2c8-4cdd5e5afa96 tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:16.368261 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-efe62854-1781-4b3c-a2c8-4cdd5e5afa96 tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:16.368713 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-efe62854-1781-4b3c-a2c8-4cdd5e5afa96 tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:16.369165 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-efe62854-1781-4b3c-a2c8-4cdd5e5afa96 tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:16.832435 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-efe62854-1781-4b3c-a2c8-4cdd5e5afa96 tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a397e76042e84375a1ef04101937dc84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e23503eb33643f8a085f95db9f27c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:18:16.840378 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-efe62854-1781-4b3c-a2c8-4cdd5e5afa96 tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] 10.222.0.43 "GET /compute/v2.1/servers/7f20fab3-e431-4d64-859d-ef0eaa13c0a9" status: 200 len: 1282 microversion: 2.1 time: 0.485717 Oct 04 19:18:16.840961 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3116/6603] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:18:16 2022] GET /compute/v2.1/servers/7f20fab3-e431-4d64-859d-ef0eaa13c0a9 => generated 1282 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:18:17.864837 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-0ff5c85a-7ca4-4f9c-873e-37e8da7b71e1 tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:18:17.865286 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-0ff5c85a-7ca4-4f9c-873e-37e8da7b71e1 tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] [instance: 7f20fab3-e431-4d64-859d-ef0eaa13c0a9] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:18:17.871795 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0ff5c85a-7ca4-4f9c-873e-37e8da7b71e1 tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:17.872390 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0ff5c85a-7ca4-4f9c-873e-37e8da7b71e1 tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:17.872909 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0ff5c85a-7ca4-4f9c-873e-37e8da7b71e1 tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:17.873726 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0ff5c85a-7ca4-4f9c-873e-37e8da7b71e1 tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:17.874254 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0ff5c85a-7ca4-4f9c-873e-37e8da7b71e1 tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:17.874760 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0ff5c85a-7ca4-4f9c-873e-37e8da7b71e1 tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:18.011196 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-0ff5c85a-7ca4-4f9c-873e-37e8da7b71e1 tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a397e76042e84375a1ef04101937dc84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e23503eb33643f8a085f95db9f27c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:18:18.019820 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-0ff5c85a-7ca4-4f9c-873e-37e8da7b71e1 tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] 10.222.0.43 "GET /compute/v2.1/servers/7f20fab3-e431-4d64-859d-ef0eaa13c0a9" status: 200 len: 1282 microversion: 2.1 time: 0.160881 Oct 04 19:18:18.020411 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3488/6604] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:18:17 2022] GET /compute/v2.1/servers/7f20fab3-e431-4d64-859d-ef0eaa13c0a9 => generated 1282 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:18:19.042745 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-47d62769-1486-4138-9f41-04daf36166cd tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:18:19.043294 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-47d62769-1486-4138-9f41-04daf36166cd tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] [instance: 7f20fab3-e431-4d64-859d-ef0eaa13c0a9] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:18:19.051232 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-47d62769-1486-4138-9f41-04daf36166cd tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:19.051742 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-47d62769-1486-4138-9f41-04daf36166cd tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:19.052176 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-47d62769-1486-4138-9f41-04daf36166cd tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:19.052887 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-47d62769-1486-4138-9f41-04daf36166cd tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:19.053374 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-47d62769-1486-4138-9f41-04daf36166cd tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:19.053814 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-47d62769-1486-4138-9f41-04daf36166cd tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:19.189372 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-47d62769-1486-4138-9f41-04daf36166cd tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a397e76042e84375a1ef04101937dc84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e23503eb33643f8a085f95db9f27c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:18:19.197965 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-47d62769-1486-4138-9f41-04daf36166cd tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] 10.222.0.43 "GET /compute/v2.1/servers/7f20fab3-e431-4d64-859d-ef0eaa13c0a9" status: 200 len: 1270 microversion: 2.1 time: 0.159182 Oct 04 19:18:19.198574 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3117/6605] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:18:19 2022] GET /compute/v2.1/servers/7f20fab3-e431-4d64-859d-ef0eaa13c0a9 => generated 1270 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:18:20.230842 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-b8c3b8e6-2b8d-40ce-ac9e-355b3a0b1615 tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:18:20.231459 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-b8c3b8e6-2b8d-40ce-ac9e-355b3a0b1615 tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] [instance: 7f20fab3-e431-4d64-859d-ef0eaa13c0a9] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:18:20.239099 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b8c3b8e6-2b8d-40ce-ac9e-355b3a0b1615 tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:20.239583 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b8c3b8e6-2b8d-40ce-ac9e-355b3a0b1615 tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:20.240020 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b8c3b8e6-2b8d-40ce-ac9e-355b3a0b1615 tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:20.240711 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b8c3b8e6-2b8d-40ce-ac9e-355b3a0b1615 tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:20.241187 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b8c3b8e6-2b8d-40ce-ac9e-355b3a0b1615 tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:20.241614 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b8c3b8e6-2b8d-40ce-ac9e-355b3a0b1615 tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:20.373914 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-b8c3b8e6-2b8d-40ce-ac9e-355b3a0b1615 tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a397e76042e84375a1ef04101937dc84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e23503eb33643f8a085f95db9f27c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:18:20.381932 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-b8c3b8e6-2b8d-40ce-ac9e-355b3a0b1615 tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] 10.222.0.43 "GET /compute/v2.1/servers/7f20fab3-e431-4d64-859d-ef0eaa13c0a9" status: 200 len: 1270 microversion: 2.1 time: 0.155010 Oct 04 19:18:20.382508 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3489/6606] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:18:20 2022] GET /compute/v2.1/servers/7f20fab3-e431-4d64-859d-ef0eaa13c0a9 => generated 1270 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:18:21.404608 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-c2828899-9fa6-4407-8bf3-1889275fe447 tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:18:21.405262 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-c2828899-9fa6-4407-8bf3-1889275fe447 tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] [instance: 7f20fab3-e431-4d64-859d-ef0eaa13c0a9] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:18:21.412241 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c2828899-9fa6-4407-8bf3-1889275fe447 tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:21.412839 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c2828899-9fa6-4407-8bf3-1889275fe447 tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:21.413333 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c2828899-9fa6-4407-8bf3-1889275fe447 tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:21.414043 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c2828899-9fa6-4407-8bf3-1889275fe447 tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:21.414504 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c2828899-9fa6-4407-8bf3-1889275fe447 tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:21.414939 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c2828899-9fa6-4407-8bf3-1889275fe447 tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:21.546633 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-c2828899-9fa6-4407-8bf3-1889275fe447 tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a397e76042e84375a1ef04101937dc84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e23503eb33643f8a085f95db9f27c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:18:21.554509 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-c2828899-9fa6-4407-8bf3-1889275fe447 tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] 10.222.0.43 "GET /compute/v2.1/servers/7f20fab3-e431-4d64-859d-ef0eaa13c0a9" status: 200 len: 1270 microversion: 2.1 time: 0.153841 Oct 04 19:18:21.555107 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3118/6607] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:18:21 2022] GET /compute/v2.1/servers/7f20fab3-e431-4d64-859d-ef0eaa13c0a9 => generated 1270 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:18:22.578341 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-5870f74e-cd63-46fc-96e2-c144c4adf8fd tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:18:22.578961 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-5870f74e-cd63-46fc-96e2-c144c4adf8fd tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] [instance: 7f20fab3-e431-4d64-859d-ef0eaa13c0a9] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:18:22.585993 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5870f74e-cd63-46fc-96e2-c144c4adf8fd tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:22.586480 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5870f74e-cd63-46fc-96e2-c144c4adf8fd tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:22.586921 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5870f74e-cd63-46fc-96e2-c144c4adf8fd tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:22.587618 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5870f74e-cd63-46fc-96e2-c144c4adf8fd tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:22.588079 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5870f74e-cd63-46fc-96e2-c144c4adf8fd tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:22.588518 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5870f74e-cd63-46fc-96e2-c144c4adf8fd tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:22.603417 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=2 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:18:22.622490 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=6 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:18:22.723146 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-5870f74e-cd63-46fc-96e2-c144c4adf8fd tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a397e76042e84375a1ef04101937dc84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e23503eb33643f8a085f95db9f27c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:18:22.730991 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-5870f74e-cd63-46fc-96e2-c144c4adf8fd tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] 10.222.0.43 "GET /compute/v2.1/servers/7f20fab3-e431-4d64-859d-ef0eaa13c0a9" status: 200 len: 1270 microversion: 2.1 time: 0.157223 Oct 04 19:18:22.731565 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3490/6608] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:18:22 2022] GET /compute/v2.1/servers/7f20fab3-e431-4d64-859d-ef0eaa13c0a9 => generated 1270 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:18:23.753994 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-6f663a40-91df-473a-8a44-b5deb1a16802 tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:18:23.754539 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-6f663a40-91df-473a-8a44-b5deb1a16802 tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] [instance: 7f20fab3-e431-4d64-859d-ef0eaa13c0a9] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:18:23.757275 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=6 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:18:23.762682 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6f663a40-91df-473a-8a44-b5deb1a16802 tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:23.763164 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6f663a40-91df-473a-8a44-b5deb1a16802 tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:23.764109 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6f663a40-91df-473a-8a44-b5deb1a16802 tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:23.764798 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6f663a40-91df-473a-8a44-b5deb1a16802 tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:23.765281 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6f663a40-91df-473a-8a44-b5deb1a16802 tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:23.765709 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6f663a40-91df-473a-8a44-b5deb1a16802 tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:23.899671 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-6f663a40-91df-473a-8a44-b5deb1a16802 tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a397e76042e84375a1ef04101937dc84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e23503eb33643f8a085f95db9f27c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:18:23.908188 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-6f663a40-91df-473a-8a44-b5deb1a16802 tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] 10.222.0.43 "GET /compute/v2.1/servers/7f20fab3-e431-4d64-859d-ef0eaa13c0a9" status: 200 len: 1270 microversion: 2.1 time: 0.158204 Oct 04 19:18:23.908782 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3119/6609] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:18:23 2022] GET /compute/v2.1/servers/7f20fab3-e431-4d64-859d-ef0eaa13c0a9 => generated 1270 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:18:24.931133 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-e19a0fa5-76b6-4385-94ee-7333a70eb2e3 tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:18:24.931741 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-e19a0fa5-76b6-4385-94ee-7333a70eb2e3 tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] [instance: 7f20fab3-e431-4d64-859d-ef0eaa13c0a9] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:18:24.939206 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e19a0fa5-76b6-4385-94ee-7333a70eb2e3 tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:24.939687 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e19a0fa5-76b6-4385-94ee-7333a70eb2e3 tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:24.940121 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e19a0fa5-76b6-4385-94ee-7333a70eb2e3 tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:24.940812 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e19a0fa5-76b6-4385-94ee-7333a70eb2e3 tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:24.941325 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e19a0fa5-76b6-4385-94ee-7333a70eb2e3 tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:24.941754 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e19a0fa5-76b6-4385-94ee-7333a70eb2e3 tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:25.073319 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-e19a0fa5-76b6-4385-94ee-7333a70eb2e3 tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a397e76042e84375a1ef04101937dc84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e23503eb33643f8a085f95db9f27c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:18:25.081985 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-e19a0fa5-76b6-4385-94ee-7333a70eb2e3 tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] 10.222.0.43 "GET /compute/v2.1/servers/7f20fab3-e431-4d64-859d-ef0eaa13c0a9" status: 200 len: 1270 microversion: 2.1 time: 0.154748 Oct 04 19:18:25.082574 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3491/6610] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:18:24 2022] GET /compute/v2.1/servers/7f20fab3-e431-4d64-859d-ef0eaa13c0a9 => generated 1270 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:18:26.103869 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-1b85b554-bde9-454e-a9ae-45465f914a47 tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:18:26.104483 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-1b85b554-bde9-454e-a9ae-45465f914a47 tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] [instance: 7f20fab3-e431-4d64-859d-ef0eaa13c0a9] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:18:26.111527 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1b85b554-bde9-454e-a9ae-45465f914a47 tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:26.112009 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1b85b554-bde9-454e-a9ae-45465f914a47 tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:26.112449 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1b85b554-bde9-454e-a9ae-45465f914a47 tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:26.113154 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1b85b554-bde9-454e-a9ae-45465f914a47 tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:26.113612 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1b85b554-bde9-454e-a9ae-45465f914a47 tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:26.114039 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1b85b554-bde9-454e-a9ae-45465f914a47 tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:26.247044 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-1b85b554-bde9-454e-a9ae-45465f914a47 tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a397e76042e84375a1ef04101937dc84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e23503eb33643f8a085f95db9f27c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:18:26.255344 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-1b85b554-bde9-454e-a9ae-45465f914a47 tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] 10.222.0.43 "GET /compute/v2.1/servers/7f20fab3-e431-4d64-859d-ef0eaa13c0a9" status: 200 len: 1270 microversion: 2.1 time: 0.155387 Oct 04 19:18:26.255913 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3120/6611] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:18:26 2022] GET /compute/v2.1/servers/7f20fab3-e431-4d64-859d-ef0eaa13c0a9 => generated 1270 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:18:27.215426 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-8c1238c3-900a-4a62-a5f5-15e4576e69ff req-0666933e-e755-4e86-9368-ae4f65ad37d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f20fab3-e431-4d64-859d-ef0eaa13c0a9", "name": "network-vif-plugged", "status": "completed", "tag": "a4afb684-0b39-48bb-ae18-e54124bbeab8"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:18:27.226168 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-8c1238c3-900a-4a62-a5f5-15e4576e69ff req-0666933e-e755-4e86-9368-ae4f65ad37d9 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:27.226658 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-8c1238c3-900a-4a62-a5f5-15e4576e69ff req-0666933e-e755-4e86-9368-ae4f65ad37d9 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:27.227095 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-8c1238c3-900a-4a62-a5f5-15e4576e69ff req-0666933e-e755-4e86-9368-ae4f65ad37d9 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:27.239499 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-8c1238c3-900a-4a62-a5f5-15e4576e69ff req-0666933e-e755-4e86-9368-ae4f65ad37d9 service nova] Creating event network-vif-plugged:a4afb684-0b39-48bb-ae18-e54124bbeab8 for instance 7f20fab3-e431-4d64-859d-ef0eaa13c0a9 on n-h1-851028-13 Oct 04 19:18:27.245372 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-8c1238c3-900a-4a62-a5f5-15e4576e69ff req-0666933e-e755-4e86-9368-ae4f65ad37d9 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035468 Oct 04 19:18:27.245995 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3492/6612] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:18:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:18:27.283765 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-7ef094fd-bd70-498f-b3d6-d5a6f8ca65ae tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:18:27.285858 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-7ef094fd-bd70-498f-b3d6-d5a6f8ca65ae tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] [instance: 7f20fab3-e431-4d64-859d-ef0eaa13c0a9] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:18:27.305634 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7ef094fd-bd70-498f-b3d6-d5a6f8ca65ae tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:27.306160 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7ef094fd-bd70-498f-b3d6-d5a6f8ca65ae tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:27.306654 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7ef094fd-bd70-498f-b3d6-d5a6f8ca65ae tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:27.307397 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7ef094fd-bd70-498f-b3d6-d5a6f8ca65ae tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:27.307864 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7ef094fd-bd70-498f-b3d6-d5a6f8ca65ae tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:27.308303 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7ef094fd-bd70-498f-b3d6-d5a6f8ca65ae tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:27.492158 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-7ef094fd-bd70-498f-b3d6-d5a6f8ca65ae tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a397e76042e84375a1ef04101937dc84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e23503eb33643f8a085f95db9f27c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:18:27.501275 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-7ef094fd-bd70-498f-b3d6-d5a6f8ca65ae tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] 10.222.0.43 "GET /compute/v2.1/servers/7f20fab3-e431-4d64-859d-ef0eaa13c0a9" status: 200 len: 1270 microversion: 2.1 time: 0.226327 Oct 04 19:18:27.501852 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3121/6613] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:18:27 2022] GET /compute/v2.1/servers/7f20fab3-e431-4d64-859d-ef0eaa13c0a9 => generated 1270 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:18:28.525318 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-bec1e8a2-052a-4d32-82b8-c96ab536133e tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:18:28.526029 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-bec1e8a2-052a-4d32-82b8-c96ab536133e tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] [instance: 7f20fab3-e431-4d64-859d-ef0eaa13c0a9] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:18:28.532210 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bec1e8a2-052a-4d32-82b8-c96ab536133e tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:28.532697 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bec1e8a2-052a-4d32-82b8-c96ab536133e tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:28.533161 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bec1e8a2-052a-4d32-82b8-c96ab536133e tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:28.533860 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bec1e8a2-052a-4d32-82b8-c96ab536133e tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:28.534318 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bec1e8a2-052a-4d32-82b8-c96ab536133e tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:28.534754 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bec1e8a2-052a-4d32-82b8-c96ab536133e tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:28.678942 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-bec1e8a2-052a-4d32-82b8-c96ab536133e tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a397e76042e84375a1ef04101937dc84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e23503eb33643f8a085f95db9f27c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:18:28.687317 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-bec1e8a2-052a-4d32-82b8-c96ab536133e tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] 10.222.0.43 "GET /compute/v2.1/servers/7f20fab3-e431-4d64-859d-ef0eaa13c0a9" status: 200 len: 1270 microversion: 2.1 time: 0.167190 Oct 04 19:18:28.687905 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3493/6614] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:18:28 2022] GET /compute/v2.1/servers/7f20fab3-e431-4d64-859d-ef0eaa13c0a9 => generated 1270 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:18:29.710517 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-36d77b1b-5079-49d8-ba6b-66b436afe68e tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:18:29.711167 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-36d77b1b-5079-49d8-ba6b-66b436afe68e tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] [instance: 7f20fab3-e431-4d64-859d-ef0eaa13c0a9] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:18:29.718044 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-36d77b1b-5079-49d8-ba6b-66b436afe68e tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:29.718535 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-36d77b1b-5079-49d8-ba6b-66b436afe68e tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:29.718985 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-36d77b1b-5079-49d8-ba6b-66b436afe68e tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:29.719688 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-36d77b1b-5079-49d8-ba6b-66b436afe68e tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:29.720149 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-36d77b1b-5079-49d8-ba6b-66b436afe68e tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:29.720609 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-36d77b1b-5079-49d8-ba6b-66b436afe68e tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:29.852223 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-36d77b1b-5079-49d8-ba6b-66b436afe68e tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a397e76042e84375a1ef04101937dc84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e23503eb33643f8a085f95db9f27c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:18:29.860699 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-36d77b1b-5079-49d8-ba6b-66b436afe68e tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] 10.222.0.43 "GET /compute/v2.1/servers/7f20fab3-e431-4d64-859d-ef0eaa13c0a9" status: 200 len: 1460 microversion: 2.1 time: 0.154159 Oct 04 19:18:29.861309 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3122/6615] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:18:29 2022] GET /compute/v2.1/servers/7f20fab3-e431-4d64-859d-ef0eaa13c0a9 => generated 1460 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:18:29.883238 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-ab4fb483-86ce-440a-9e89-f20cff828e6e tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:18:29.883899 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-ab4fb483-86ce-440a-9e89-f20cff828e6e tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] [instance: 7f20fab3-e431-4d64-859d-ef0eaa13c0a9] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:18:29.890778 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ab4fb483-86ce-440a-9e89-f20cff828e6e tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:29.891272 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ab4fb483-86ce-440a-9e89-f20cff828e6e tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:29.891715 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ab4fb483-86ce-440a-9e89-f20cff828e6e tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:29.892411 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ab4fb483-86ce-440a-9e89-f20cff828e6e tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:29.892891 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ab4fb483-86ce-440a-9e89-f20cff828e6e tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:29.893343 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ab4fb483-86ce-440a-9e89-f20cff828e6e tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:30.030609 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-ab4fb483-86ce-440a-9e89-f20cff828e6e tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a397e76042e84375a1ef04101937dc84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e23503eb33643f8a085f95db9f27c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:18:30.038686 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-ab4fb483-86ce-440a-9e89-f20cff828e6e tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] 10.222.0.43 "GET /compute/v2.1/servers/7f20fab3-e431-4d64-859d-ef0eaa13c0a9" status: 200 len: 1460 microversion: 2.1 time: 0.159390 Oct 04 19:18:30.039286 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3494/6616] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:18:29 2022] GET /compute/v2.1/servers/7f20fab3-e431-4d64-859d-ef0eaa13c0a9 => generated 1460 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:18:31.896051 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-70ac7d71-f6d4-4ab8-9d79-e03b75d35798 req-3d81f7d4-349b-490d-8310-4d1fa1b8192f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f20fab3-e431-4d64-859d-ef0eaa13c0a9", "tag": "a4afb684-0b39-48bb-ae18-e54124bbeab8"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:18:31.911649 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-70ac7d71-f6d4-4ab8-9d79-e03b75d35798 req-3d81f7d4-349b-490d-8310-4d1fa1b8192f service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:31.912233 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-70ac7d71-f6d4-4ab8-9d79-e03b75d35798 req-3d81f7d4-349b-490d-8310-4d1fa1b8192f service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:31.912909 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-70ac7d71-f6d4-4ab8-9d79-e03b75d35798 req-3d81f7d4-349b-490d-8310-4d1fa1b8192f service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:31.926550 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-70ac7d71-f6d4-4ab8-9d79-e03b75d35798 req-3d81f7d4-349b-490d-8310-4d1fa1b8192f service nova] Creating event network-changed:a4afb684-0b39-48bb-ae18-e54124bbeab8 for instance 7f20fab3-e431-4d64-859d-ef0eaa13c0a9 on n-h1-851028-13 Oct 04 19:18:31.932266 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-70ac7d71-f6d4-4ab8-9d79-e03b75d35798 req-3d81f7d4-349b-490d-8310-4d1fa1b8192f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040048 Oct 04 19:18:31.933462 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3123/6617] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:18:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:18:33.950512 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-1f20ea53-2154-46ef-bb97-54769644ed24 req-3497aac6-9525-4c8e-8a5c-50611a172a36 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f20fab3-e431-4d64-859d-ef0eaa13c0a9", "tag": "a4afb684-0b39-48bb-ae18-e54124bbeab8"}, {"name": "network-changed", "server_uuid": "7f20fab3-e431-4d64-859d-ef0eaa13c0a9", "tag": "a4afb684-0b39-48bb-ae18-e54124bbeab8"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:18:33.961335 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-1f20ea53-2154-46ef-bb97-54769644ed24 req-3497aac6-9525-4c8e-8a5c-50611a172a36 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:33.961818 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-1f20ea53-2154-46ef-bb97-54769644ed24 req-3497aac6-9525-4c8e-8a5c-50611a172a36 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:33.962250 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-1f20ea53-2154-46ef-bb97-54769644ed24 req-3497aac6-9525-4c8e-8a5c-50611a172a36 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:33.974786 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-1f20ea53-2154-46ef-bb97-54769644ed24 req-3497aac6-9525-4c8e-8a5c-50611a172a36 service nova] Creating event network-changed:a4afb684-0b39-48bb-ae18-e54124bbeab8 for instance 7f20fab3-e431-4d64-859d-ef0eaa13c0a9 on n-h1-851028-13 Oct 04 19:18:33.975792 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-1f20ea53-2154-46ef-bb97-54769644ed24 req-3497aac6-9525-4c8e-8a5c-50611a172a36 service nova] Creating event network-changed:a4afb684-0b39-48bb-ae18-e54124bbeab8 for instance 7f20fab3-e431-4d64-859d-ef0eaa13c0a9 on n-h1-851028-13 Oct 04 19:18:33.983602 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-1f20ea53-2154-46ef-bb97-54769644ed24 req-3497aac6-9525-4c8e-8a5c-50611a172a36 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.036210 Oct 04 19:18:33.984321 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3495/6618] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:18:33 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:19:07.755724 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-e34f78a5-d16d-47f9-babb-66260f0b0ef1 req-c7f784be-39a0-46c2-80f1-bbb90f6bb195 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f20fab3-e431-4d64-859d-ef0eaa13c0a9", "tag": "a4afb684-0b39-48bb-ae18-e54124bbeab8"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:19:07.757470 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-6ebef331-bdfa-4269-a081-f4fd37131cb7 tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:19:07.758072 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-6ebef331-bdfa-4269-a081-f4fd37131cb7 tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] [instance: 7f20fab3-e431-4d64-859d-ef0eaa13c0a9] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:19:07.762383 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=1 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:19:07.763125 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=50 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:19:07.763835 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:19:07.764544 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=50 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:19:07.766295 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6ebef331-bdfa-4269-a081-f4fd37131cb7 tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:07.766750 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6ebef331-bdfa-4269-a081-f4fd37131cb7 tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:07.767217 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6ebef331-bdfa-4269-a081-f4fd37131cb7 tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:07.769010 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6ebef331-bdfa-4269-a081-f4fd37131cb7 tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:07.769010 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6ebef331-bdfa-4269-a081-f4fd37131cb7 tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:07.769585 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6ebef331-bdfa-4269-a081-f4fd37131cb7 tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:07.771108 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-e34f78a5-d16d-47f9-babb-66260f0b0ef1 req-c7f784be-39a0-46c2-80f1-bbb90f6bb195 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:07.771595 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-e34f78a5-d16d-47f9-babb-66260f0b0ef1 req-c7f784be-39a0-46c2-80f1-bbb90f6bb195 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:07.772037 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-e34f78a5-d16d-47f9-babb-66260f0b0ef1 req-c7f784be-39a0-46c2-80f1-bbb90f6bb195 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:07.784471 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-e34f78a5-d16d-47f9-babb-66260f0b0ef1 req-c7f784be-39a0-46c2-80f1-bbb90f6bb195 service nova] Creating event network-changed:a4afb684-0b39-48bb-ae18-e54124bbeab8 for instance 7f20fab3-e431-4d64-859d-ef0eaa13c0a9 on n-h1-851028-13 Oct 04 19:19:07.789787 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-e34f78a5-d16d-47f9-babb-66260f0b0ef1 req-c7f784be-39a0-46c2-80f1-bbb90f6bb195 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039030 Oct 04 19:19:07.790741 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3124/6619] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:19:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:19:07.797354 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-6ebef331-bdfa-4269-a081-f4fd37131cb7 tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] [instance: 7f20fab3-e431-4d64-859d-ef0eaa13c0a9] Going to try to terminate instance {{(pid=123596) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 19:19:07.884104 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-6ebef331-bdfa-4269-a081-f4fd37131cb7 tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] 10.222.0.43 "DELETE /compute/v2.1/servers/7f20fab3-e431-4d64-859d-ef0eaa13c0a9" status: 204 len: 0 microversion: 2.1 time: 0.131486 Oct 04 19:19:07.884962 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3496/6620] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 19:19:07 2022] DELETE /compute/v2.1/servers/7f20fab3-e431-4d64-859d-ef0eaa13c0a9 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 19:19:07.894546 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-642ebd13-3bc4-47c5-9206-b3d899166e40 tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:19:07.895266 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-642ebd13-3bc4-47c5-9206-b3d899166e40 tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] [instance: 7f20fab3-e431-4d64-859d-ef0eaa13c0a9] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:19:07.902461 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-642ebd13-3bc4-47c5-9206-b3d899166e40 tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:07.902970 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-642ebd13-3bc4-47c5-9206-b3d899166e40 tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:07.903572 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-642ebd13-3bc4-47c5-9206-b3d899166e40 tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:07.904167 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-642ebd13-3bc4-47c5-9206-b3d899166e40 tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:07.904678 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-642ebd13-3bc4-47c5-9206-b3d899166e40 tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:07.905248 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-642ebd13-3bc4-47c5-9206-b3d899166e40 tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:08.080657 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-642ebd13-3bc4-47c5-9206-b3d899166e40 tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a397e76042e84375a1ef04101937dc84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e23503eb33643f8a085f95db9f27c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:19:08.088617 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-642ebd13-3bc4-47c5-9206-b3d899166e40 tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] 10.222.0.43 "GET /compute/v2.1/servers/7f20fab3-e431-4d64-859d-ef0eaa13c0a9" status: 200 len: 1584 microversion: 2.1 time: 0.198989 Oct 04 19:19:08.089224 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3125/6621] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:19:07 2022] GET /compute/v2.1/servers/7f20fab3-e431-4d64-859d-ef0eaa13c0a9 => generated 1584 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:19:09.113192 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-4a7007ce-9253-4cf1-b971-2d40819e1aa9 tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:19:09.113904 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-4a7007ce-9253-4cf1-b971-2d40819e1aa9 tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] [instance: 7f20fab3-e431-4d64-859d-ef0eaa13c0a9] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:19:09.121415 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4a7007ce-9253-4cf1-b971-2d40819e1aa9 tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:09.121907 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4a7007ce-9253-4cf1-b971-2d40819e1aa9 tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:09.122349 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4a7007ce-9253-4cf1-b971-2d40819e1aa9 tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:09.123048 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4a7007ce-9253-4cf1-b971-2d40819e1aa9 tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:09.123498 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4a7007ce-9253-4cf1-b971-2d40819e1aa9 tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:09.123922 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4a7007ce-9253-4cf1-b971-2d40819e1aa9 tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:09.264947 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-4a7007ce-9253-4cf1-b971-2d40819e1aa9 tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a397e76042e84375a1ef04101937dc84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e23503eb33643f8a085f95db9f27c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:19:09.274227 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-4a7007ce-9253-4cf1-b971-2d40819e1aa9 tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] 10.222.0.43 "GET /compute/v2.1/servers/7f20fab3-e431-4d64-859d-ef0eaa13c0a9" status: 200 len: 1584 microversion: 2.1 time: 0.165915 Oct 04 19:19:09.274758 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3497/6622] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:19:09 2022] GET /compute/v2.1/servers/7f20fab3-e431-4d64-859d-ef0eaa13c0a9 => generated 1584 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:19:09.965337 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-519a3013-c26d-49a6-ba5f-1fd307a00326 req-2c4ef549-8d32-4165-a70c-d2a1af216d5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f20fab3-e431-4d64-859d-ef0eaa13c0a9", "name": "network-vif-deleted", "tag": "a4afb684-0b39-48bb-ae18-e54124bbeab8"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:19:09.976883 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-519a3013-c26d-49a6-ba5f-1fd307a00326 req-2c4ef549-8d32-4165-a70c-d2a1af216d5b service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:09.977494 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-519a3013-c26d-49a6-ba5f-1fd307a00326 req-2c4ef549-8d32-4165-a70c-d2a1af216d5b service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:09.978010 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-519a3013-c26d-49a6-ba5f-1fd307a00326 req-2c4ef549-8d32-4165-a70c-d2a1af216d5b service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:09.993216 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-519a3013-c26d-49a6-ba5f-1fd307a00326 req-2c4ef549-8d32-4165-a70c-d2a1af216d5b service nova] Creating event network-vif-deleted:a4afb684-0b39-48bb-ae18-e54124bbeab8 for instance 7f20fab3-e431-4d64-859d-ef0eaa13c0a9 on n-h1-851028-13 Oct 04 19:19:09.998212 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-519a3013-c26d-49a6-ba5f-1fd307a00326 req-2c4ef549-8d32-4165-a70c-d2a1af216d5b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036588 Oct 04 19:19:09.998841 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3126/6623] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:19:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:19:10.297856 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-b7bf0f5a-9ed3-42be-b27a-69e8563fe033 tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:19:10.298481 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-b7bf0f5a-9ed3-42be-b27a-69e8563fe033 tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] [instance: 7f20fab3-e431-4d64-859d-ef0eaa13c0a9] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:19:10.308281 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b7bf0f5a-9ed3-42be-b27a-69e8563fe033 tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:10.309176 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b7bf0f5a-9ed3-42be-b27a-69e8563fe033 tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:10.309829 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b7bf0f5a-9ed3-42be-b27a-69e8563fe033 tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:10.310554 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b7bf0f5a-9ed3-42be-b27a-69e8563fe033 tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:10.311018 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b7bf0f5a-9ed3-42be-b27a-69e8563fe033 tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:10.311523 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b7bf0f5a-9ed3-42be-b27a-69e8563fe033 tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:10.382736 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-b7bf0f5a-9ed3-42be-b27a-69e8563fe033 tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a397e76042e84375a1ef04101937dc84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e23503eb33643f8a085f95db9f27c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:19:10.391291 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-b7bf0f5a-9ed3-42be-b27a-69e8563fe033 tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] 10.222.0.43 "GET /compute/v2.1/servers/7f20fab3-e431-4d64-859d-ef0eaa13c0a9" status: 200 len: 1230 microversion: 2.1 time: 0.097578 Oct 04 19:19:10.391874 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3498/6624] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:19:10 2022] GET /compute/v2.1/servers/7f20fab3-e431-4d64-859d-ef0eaa13c0a9 => generated 1230 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:19:11.416885 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-f3a1886a-50c1-44b5-b83a-8e71eb5713d9 tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:19:11.417688 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-f3a1886a-50c1-44b5-b83a-8e71eb5713d9 tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] [instance: 7f20fab3-e431-4d64-859d-ef0eaa13c0a9] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:19:11.424440 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f3a1886a-50c1-44b5-b83a-8e71eb5713d9 tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:11.424958 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f3a1886a-50c1-44b5-b83a-8e71eb5713d9 tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:11.425431 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f3a1886a-50c1-44b5-b83a-8e71eb5713d9 tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:11.426138 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f3a1886a-50c1-44b5-b83a-8e71eb5713d9 tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:11.426595 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f3a1886a-50c1-44b5-b83a-8e71eb5713d9 tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:11.427023 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f3a1886a-50c1-44b5-b83a-8e71eb5713d9 tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:11.489471 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-f3a1886a-50c1-44b5-b83a-8e71eb5713d9 tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a397e76042e84375a1ef04101937dc84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e23503eb33643f8a085f95db9f27c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:19:11.497321 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-f3a1886a-50c1-44b5-b83a-8e71eb5713d9 tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] 10.222.0.43 "GET /compute/v2.1/servers/7f20fab3-e431-4d64-859d-ef0eaa13c0a9" status: 200 len: 1230 microversion: 2.1 time: 0.085443 Oct 04 19:19:11.497900 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3127/6625] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:19:11 2022] GET /compute/v2.1/servers/7f20fab3-e431-4d64-859d-ef0eaa13c0a9 => generated 1230 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:19:12.519900 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-c900d53d-e47b-4d83-8bf7-2cb0ad0f365a tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:19:12.520540 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-c900d53d-e47b-4d83-8bf7-2cb0ad0f365a tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] [instance: 7f20fab3-e431-4d64-859d-ef0eaa13c0a9] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:19:12.527539 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c900d53d-e47b-4d83-8bf7-2cb0ad0f365a tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:12.528029 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c900d53d-e47b-4d83-8bf7-2cb0ad0f365a tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:12.528484 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c900d53d-e47b-4d83-8bf7-2cb0ad0f365a tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:12.529220 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c900d53d-e47b-4d83-8bf7-2cb0ad0f365a tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:12.529683 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c900d53d-e47b-4d83-8bf7-2cb0ad0f365a tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:12.530114 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c900d53d-e47b-4d83-8bf7-2cb0ad0f365a tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:12.595752 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-c900d53d-e47b-4d83-8bf7-2cb0ad0f365a tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a397e76042e84375a1ef04101937dc84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e23503eb33643f8a085f95db9f27c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:19:12.604298 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-c900d53d-e47b-4d83-8bf7-2cb0ad0f365a tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] 10.222.0.43 "GET /compute/v2.1/servers/7f20fab3-e431-4d64-859d-ef0eaa13c0a9" status: 200 len: 1230 microversion: 2.1 time: 0.088289 Oct 04 19:19:12.604894 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3499/6626] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:19:12 2022] GET /compute/v2.1/servers/7f20fab3-e431-4d64-859d-ef0eaa13c0a9 => generated 1230 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:19:13.628323 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-e7e9af92-8eb4-4ef8-9cf9-4bfcc3f39763 tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:19:13.628893 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-e7e9af92-8eb4-4ef8-9cf9-4bfcc3f39763 tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] [instance: 7f20fab3-e431-4d64-859d-ef0eaa13c0a9] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:19:13.636236 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e7e9af92-8eb4-4ef8-9cf9-4bfcc3f39763 tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:13.636726 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e7e9af92-8eb4-4ef8-9cf9-4bfcc3f39763 tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:13.637200 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e7e9af92-8eb4-4ef8-9cf9-4bfcc3f39763 tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:13.637923 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e7e9af92-8eb4-4ef8-9cf9-4bfcc3f39763 tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:13.638379 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e7e9af92-8eb4-4ef8-9cf9-4bfcc3f39763 tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:13.638815 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e7e9af92-8eb4-4ef8-9cf9-4bfcc3f39763 tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:13.706983 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-e7e9af92-8eb4-4ef8-9cf9-4bfcc3f39763 tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a397e76042e84375a1ef04101937dc84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e23503eb33643f8a085f95db9f27c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:19:13.714971 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-e7e9af92-8eb4-4ef8-9cf9-4bfcc3f39763 tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] 10.222.0.43 "GET /compute/v2.1/servers/7f20fab3-e431-4d64-859d-ef0eaa13c0a9" status: 200 len: 1230 microversion: 2.1 time: 0.090918 Oct 04 19:19:13.715552 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3128/6627] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:19:13 2022] GET /compute/v2.1/servers/7f20fab3-e431-4d64-859d-ef0eaa13c0a9 => generated 1230 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:19:14.739168 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-2d5617e4-84d2-4458-bf54-3b18ae4b8950 tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:19:14.739763 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-2d5617e4-84d2-4458-bf54-3b18ae4b8950 tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] [instance: 7f20fab3-e431-4d64-859d-ef0eaa13c0a9] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:19:14.746404 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2d5617e4-84d2-4458-bf54-3b18ae4b8950 tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:14.746615 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2d5617e4-84d2-4458-bf54-3b18ae4b8950 tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:14.747057 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2d5617e4-84d2-4458-bf54-3b18ae4b8950 tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:14.747752 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2d5617e4-84d2-4458-bf54-3b18ae4b8950 tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:14.748298 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2d5617e4-84d2-4458-bf54-3b18ae4b8950 tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:14.748622 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2d5617e4-84d2-4458-bf54-3b18ae4b8950 tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:14.762824 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-2d5617e4-84d2-4458-bf54-3b18ae4b8950 tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] HTTP exception thrown: Instance 7f20fab3-e431-4d64-859d-ef0eaa13c0a9 could not be found. Oct 04 19:19:14.764487 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-2d5617e4-84d2-4458-bf54-3b18ae4b8950 tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Request method failure captured: Oct 04 19:19:14.764487 n-d-851028-13 devstack@n-api.service[123596]: request: GET /compute/v2.1/servers/7f20fab3-e431-4d64-859d-ef0eaa13c0a9 HTTP/1.1 Oct 04 19:19:14.764487 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 19:19:14.764487 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 19:19:14.764487 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 19:19:14.764487 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 19:19:14.764487 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 19:19:14.764487 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 19:19:14.764487 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 19:19:14.764487 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 19:19:14.764487 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPIZ__4AnQIBPIfsQ9mtfYXYpCiIgChebUuLov-d0IQTitcqrVfB0tbLnRdu9XkYt7W8RuhZXW0BZ5St5XDEfMDaVZY7ZfP-tkZVyqek8xwR394JmGNaAlkNlOYj8FHkpBx4Zy8SI4_QINlpwufdQLtn4utQZD6i1E9GlTzKA8BPNb-Q Oct 04 19:19:14.764487 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 19:19:14.764487 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 19:19:14.764487 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 19:19:14.764487 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 19:19:14.764487 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 19:19:14.764487 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 19:19:14.764487 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: 0e23503eb33643f8a085f95db9f27c9f Oct 04 19:19:14.764487 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-TestVolumeBackupRestore-1496609826 Oct 04 19:19:14.764487 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 19:19:14.764487 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 19:19:14.764487 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/0e23503eb33643f8a085f95db9f27c9f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_0e23503eb33643f8a085f95db9f27c9f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0e23503eb33643f8a085f95db9f27c9f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0e23503eb33643f8a085f95db9f27c9f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 19:19:14.764487 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-TestVolumeBackupRestore-1496609826 Oct 04 19:19:14.764487 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: 0e23503eb33643f8a085f95db9f27c9f Oct 04 19:19:14.764487 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-TestVolumeBackupRestore-1496609826 Oct 04 19:19:14.764487 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-TestVolumeBackupRestore-1496609826-project Oct 04 19:19:14.764487 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 19:19:14.764487 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 19:19:14.764487 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: a397e76042e84375a1ef04101937dc84 Oct 04 19:19:14.764487 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-TestVolumeBackupRestore-1496609826-project Oct 04 19:19:14.764487 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 19:19:14.764487 n-d-851028-13 devstack@n-api.service[123596]: exception: Instance 7f20fab3-e431-4d64-859d-ef0eaa13c0a9 could not be found. Oct 04 19:19:14.764487 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': '7f20fab3-e431-4d64-859d-ef0eaa13c0a9'} Oct 04 19:19:14.764487 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:19:14.764487 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:19:14.764487 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:19:14.764487 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:19:14.764487 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:19:14.764487 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:19:14.764487 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:19:14.764487 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:19:14.764487 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:19:14.764487 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:19:14.764487 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f20fab3-e431-4d64-859d-ef0eaa13c0a9 could not be found. Oct 04 19:19:14.764487 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:19:14.764487 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:19:14.764487 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:19:14.764487 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:19:14.764487 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:19:14.764487 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:19:14.764487 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:19:14.764487 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:19:14.764487 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:19:14.764487 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:19:14.764487 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:19:14.764487 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:19:14.764487 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:19:14.764487 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:19:14.764487 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:19:14.764487 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:19:14.764487 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f20fab3-e431-4d64-859d-ef0eaa13c0a9 could not be found. Oct 04 19:19:14.764487 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:19:14.764487 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:19:14.764487 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:19:14.770711 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:19:14.770711 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:19:14.770711 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:19:14.770711 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:19:14.770711 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:19:14.770711 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f20fab3-e431-4d64-859d-ef0eaa13c0a9 could not be found. Oct 04 19:19:14.770711 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:19:14.770711 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-2d5617e4-84d2-4458-bf54-3b18ae4b8950 tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Returning 404 to user: Instance 7f20fab3-e431-4d64-859d-ef0eaa13c0a9 could not be found. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:19:14.770711 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-2d5617e4-84d2-4458-bf54-3b18ae4b8950 tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] 10.222.0.43 "GET /compute/v2.1/servers/7f20fab3-e431-4d64-859d-ef0eaa13c0a9" status: 404 len: 111 microversion: 2.1 time: 0.030936 Oct 04 19:19:14.770711 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3500/6628] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:19:14 2022] GET /compute/v2.1/servers/7f20fab3-e431-4d64-859d-ef0eaa13c0a9 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:19:14.928159 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-4152ffee-9bc5-4148-a1ff-3b2e39a4ddd8 tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] Calling method '.version_select at 0x7fb21fd39c10>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:19:14.951487 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-4152ffee-9bc5-4148-a1ff-3b2e39a4ddd8 tempest-TestVolumeBackupRestore-1496609826 tempest-TestVolumeBackupRestore-1496609826-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-1528116260" status: 202 len: 0 microversion: 2.1 time: 0.027937 Oct 04 19:19:14.952161 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3129/6629] 10.222.0.43 () {58 vars in 1269 bytes} [Tue Oct 4 19:19:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-1528116260 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:19:39.102696 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-a6db58d3-6f41-4477-a17c-7aac34f2e29d tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-107641515", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "3fbf14cc-a14a-4705-8cb6-a6599298ef79", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "2ddfee4a-681a-4b64-a4ab-40481cf11577"}]}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:19:39.114013 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:19:39.114670 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:19:39.169575 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.network.neutron [None req-a6db58d3-6f41-4477-a17c-7aac34f2e29d tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] validate_networks() for [('2ddfee4a-681a-4b64-a4ab-40481cf11577', None, None, None, None, None)] {{(pid=123596) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 19:19:39.546004 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-a6db58d3-6f41-4477-a17c-7aac34f2e29d tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Flavor limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:19:39.546436 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-a6db58d3-6f41-4477-a17c-7aac34f2e29d tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Image limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:19:39.546919 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-a6db58d3-6f41-4477-a17c-7aac34f2e29d tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Flavor pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:19:39.547337 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-a6db58d3-6f41-4477-a17c-7aac34f2e29d tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Image pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:19:39.548013 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-a6db58d3-6f41-4477-a17c-7aac34f2e29d tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:19:39.557366 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a6db58d3-6f41-4477-a17c-7aac34f2e29d tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:39.557865 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a6db58d3-6f41-4477-a17c-7aac34f2e29d tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:39.558313 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a6db58d3-6f41-4477-a17c-7aac34f2e29d tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:39.559051 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a6db58d3-6f41-4477-a17c-7aac34f2e29d tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:39.559511 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a6db58d3-6f41-4477-a17c-7aac34f2e29d tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:39.559943 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a6db58d3-6f41-4477-a17c-7aac34f2e29d tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:39.577824 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-a6db58d3-6f41-4477-a17c-7aac34f2e29d tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Getting quotas for project 9cd28590bda749c5aa109ae292cb32e6. Resources: {'ram', 'cores', 'instances'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:19:39.583807 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-a6db58d3-6f41-4477-a17c-7aac34f2e29d tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Getting quotas for user 43efdccf8e2f4934ae5cfe3da828511e and project 9cd28590bda749c5aa109ae292cb32e6. Resources: {'ram', 'cores', 'instances'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:19:39.642655 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-a6db58d3-6f41-4477-a17c-7aac34f2e29d tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Going to run 1 instances... {{(pid=123596) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 19:19:39.644760 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-a6db58d3-6f41-4477-a17c-7aac34f2e29d tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: f2f65cfc-dc4c-4340-ad26-72361828703a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3fbf14cc-a14a-4705-8cb6-a6599298ef79',volume_size=None,volume_type=None)] {{(pid=123596) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 19:19:39.784749 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-a6db58d3-6f41-4477-a17c-7aac34f2e29d tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.685328 Oct 04 19:19:39.785198 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3501/6630] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 19:19:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 688 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 19:19:39.796693 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-099a73be-be39-4ead-a068-46ab775d92eb tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:19:39.797292 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-099a73be-be39-4ead-a068-46ab775d92eb tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: f2f65cfc-dc4c-4340-ad26-72361828703a] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:19:39.804898 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=22 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:19:39.805223 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_api:SELECT=13,nova_api:DELETE=1 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:19:39.871361 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-099a73be-be39-4ead-a068-46ab775d92eb tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:19:39.881251 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-099a73be-be39-4ead-a068-46ab775d92eb tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/f2f65cfc-dc4c-4340-ad26-72361828703a" status: 200 len: 1056 microversion: 2.1 time: 0.088415 Oct 04 19:19:39.897994 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3130/6631] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:19:39 2022] GET /compute/v2.1/servers/f2f65cfc-dc4c-4340-ad26-72361828703a => generated 1056 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:19:40.904889 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-27569413-e6f7-4e15-a219-b57fce2c009e tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:19:40.905656 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-27569413-e6f7-4e15-a219-b57fce2c009e tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: f2f65cfc-dc4c-4340-ad26-72361828703a] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:19:40.913584 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-27569413-e6f7-4e15-a219-b57fce2c009e tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:40.914168 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-27569413-e6f7-4e15-a219-b57fce2c009e tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:40.914707 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-27569413-e6f7-4e15-a219-b57fce2c009e tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:40.915482 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-27569413-e6f7-4e15-a219-b57fce2c009e tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:40.916020 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-27569413-e6f7-4e15-a219-b57fce2c009e tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:40.916458 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-27569413-e6f7-4e15-a219-b57fce2c009e tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:40.983594 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-27569413-e6f7-4e15-a219-b57fce2c009e tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:19:40.993744 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-27569413-e6f7-4e15-a219-b57fce2c009e tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/f2f65cfc-dc4c-4340-ad26-72361828703a" status: 200 len: 1154 microversion: 2.1 time: 0.093604 Oct 04 19:19:40.994643 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3502/6632] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:19:40 2022] GET /compute/v2.1/servers/f2f65cfc-dc4c-4340-ad26-72361828703a => generated 1154 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:19:42.022906 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-f0236dc1-8e90-44b4-8094-ffff55549b06 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:19:42.024603 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-f0236dc1-8e90-44b4-8094-ffff55549b06 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: f2f65cfc-dc4c-4340-ad26-72361828703a] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:19:42.034977 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f0236dc1-8e90-44b4-8094-ffff55549b06 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:42.035669 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f0236dc1-8e90-44b4-8094-ffff55549b06 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:42.036314 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f0236dc1-8e90-44b4-8094-ffff55549b06 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:42.037643 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f0236dc1-8e90-44b4-8094-ffff55549b06 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:42.038304 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f0236dc1-8e90-44b4-8094-ffff55549b06 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:42.038884 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f0236dc1-8e90-44b4-8094-ffff55549b06 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:42.211135 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-f0236dc1-8e90-44b4-8094-ffff55549b06 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:19:42.220002 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-f0236dc1-8e90-44b4-8094-ffff55549b06 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/f2f65cfc-dc4c-4340-ad26-72361828703a" status: 200 len: 1214 microversion: 2.1 time: 0.206137 Oct 04 19:19:42.220728 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3131/6633] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:19:42 2022] GET /compute/v2.1/servers/f2f65cfc-dc4c-4340-ad26-72361828703a => generated 1214 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:19:42.927003 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-554e8a51-af96-43e2-b299-a70ea3723121 req-b29528cf-0f86-4250-b2ea-773f576578cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2f65cfc-dc4c-4340-ad26-72361828703a", "tag": "e2bd0702-26ae-4969-8819-eb781f9c8fdc"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:19:42.950891 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-554e8a51-af96-43e2-b299-a70ea3723121 req-b29528cf-0f86-4250-b2ea-773f576578cf service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:42.951489 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-554e8a51-af96-43e2-b299-a70ea3723121 req-b29528cf-0f86-4250-b2ea-773f576578cf service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:42.951949 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-554e8a51-af96-43e2-b299-a70ea3723121 req-b29528cf-0f86-4250-b2ea-773f576578cf service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:42.967018 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-554e8a51-af96-43e2-b299-a70ea3723121 req-b29528cf-0f86-4250-b2ea-773f576578cf service nova] Creating event network-changed:e2bd0702-26ae-4969-8819-eb781f9c8fdc for instance f2f65cfc-dc4c-4340-ad26-72361828703a on n-h2-851028-13 Oct 04 19:19:42.972981 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-554e8a51-af96-43e2-b299-a70ea3723121 req-b29528cf-0f86-4250-b2ea-773f576578cf service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.245845 Oct 04 19:19:42.974230 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3503/6634] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:19:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:19:43.247294 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-0a79f9a1-d7c5-49d5-a622-518f885372ec tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:19:43.249218 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-0a79f9a1-d7c5-49d5-a622-518f885372ec tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: f2f65cfc-dc4c-4340-ad26-72361828703a] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:19:43.257926 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0a79f9a1-d7c5-49d5-a622-518f885372ec tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:43.258699 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0a79f9a1-d7c5-49d5-a622-518f885372ec tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:43.259318 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0a79f9a1-d7c5-49d5-a622-518f885372ec tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:43.261075 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0a79f9a1-d7c5-49d5-a622-518f885372ec tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:43.261721 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0a79f9a1-d7c5-49d5-a622-518f885372ec tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:43.262845 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0a79f9a1-d7c5-49d5-a622-518f885372ec tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:43.430123 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-0a79f9a1-d7c5-49d5-a622-518f885372ec tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:19:43.438859 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-0a79f9a1-d7c5-49d5-a622-518f885372ec tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/f2f65cfc-dc4c-4340-ad26-72361828703a" status: 200 len: 1214 microversion: 2.1 time: 0.198909 Oct 04 19:19:43.442138 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3132/6635] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:19:43 2022] GET /compute/v2.1/servers/f2f65cfc-dc4c-4340-ad26-72361828703a => generated 1214 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:19:44.466008 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-c4d35cc6-b2a3-4a23-8ba4-8872103e0a5a tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:19:44.467176 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-c4d35cc6-b2a3-4a23-8ba4-8872103e0a5a tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: f2f65cfc-dc4c-4340-ad26-72361828703a] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:19:44.474909 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c4d35cc6-b2a3-4a23-8ba4-8872103e0a5a tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:44.475429 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c4d35cc6-b2a3-4a23-8ba4-8872103e0a5a tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:44.475891 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c4d35cc6-b2a3-4a23-8ba4-8872103e0a5a tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:44.476880 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c4d35cc6-b2a3-4a23-8ba4-8872103e0a5a tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:44.477407 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c4d35cc6-b2a3-4a23-8ba4-8872103e0a5a tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:44.477857 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c4d35cc6-b2a3-4a23-8ba4-8872103e0a5a tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:44.621899 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-c4d35cc6-b2a3-4a23-8ba4-8872103e0a5a tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:19:44.630537 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-c4d35cc6-b2a3-4a23-8ba4-8872103e0a5a tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/f2f65cfc-dc4c-4340-ad26-72361828703a" status: 200 len: 1214 microversion: 2.1 time: 0.170362 Oct 04 19:19:44.631133 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3504/6636] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:19:44 2022] GET /compute/v2.1/servers/f2f65cfc-dc4c-4340-ad26-72361828703a => generated 1214 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:19:45.654523 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-bab79b9a-ce97-46fc-9752-ba684cef9c57 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:19:45.655142 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-bab79b9a-ce97-46fc-9752-ba684cef9c57 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: f2f65cfc-dc4c-4340-ad26-72361828703a] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:19:45.662783 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bab79b9a-ce97-46fc-9752-ba684cef9c57 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:45.663277 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bab79b9a-ce97-46fc-9752-ba684cef9c57 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:45.663720 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bab79b9a-ce97-46fc-9752-ba684cef9c57 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:45.664426 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bab79b9a-ce97-46fc-9752-ba684cef9c57 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:45.664885 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bab79b9a-ce97-46fc-9752-ba684cef9c57 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:45.665343 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bab79b9a-ce97-46fc-9752-ba684cef9c57 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:45.797687 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-bab79b9a-ce97-46fc-9752-ba684cef9c57 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:19:45.806822 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-bab79b9a-ce97-46fc-9752-ba684cef9c57 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/f2f65cfc-dc4c-4340-ad26-72361828703a" status: 200 len: 1214 microversion: 2.1 time: 0.156219 Oct 04 19:19:45.807401 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3133/6637] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:19:45 2022] GET /compute/v2.1/servers/f2f65cfc-dc4c-4340-ad26-72361828703a => generated 1214 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:19:46.832391 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-0616a952-8524-4af6-98b7-b034ca193660 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:19:46.833015 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-0616a952-8524-4af6-98b7-b034ca193660 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: f2f65cfc-dc4c-4340-ad26-72361828703a] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:19:46.840999 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0616a952-8524-4af6-98b7-b034ca193660 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:46.841803 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0616a952-8524-4af6-98b7-b034ca193660 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:46.842401 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0616a952-8524-4af6-98b7-b034ca193660 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:46.843105 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0616a952-8524-4af6-98b7-b034ca193660 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:46.843567 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0616a952-8524-4af6-98b7-b034ca193660 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:46.844004 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0616a952-8524-4af6-98b7-b034ca193660 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:46.978071 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-0616a952-8524-4af6-98b7-b034ca193660 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:19:46.986310 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-0616a952-8524-4af6-98b7-b034ca193660 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/f2f65cfc-dc4c-4340-ad26-72361828703a" status: 200 len: 1202 microversion: 2.1 time: 0.158057 Oct 04 19:19:46.986894 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3505/6638] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:19:46 2022] GET /compute/v2.1/servers/f2f65cfc-dc4c-4340-ad26-72361828703a => generated 1202 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:19:48.010811 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-17d9e752-5aca-41b5-83f0-01ad329c8f9b tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:19:48.011392 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-17d9e752-5aca-41b5-83f0-01ad329c8f9b tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: f2f65cfc-dc4c-4340-ad26-72361828703a] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:19:48.018308 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-17d9e752-5aca-41b5-83f0-01ad329c8f9b tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:48.018803 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-17d9e752-5aca-41b5-83f0-01ad329c8f9b tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:48.019284 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-17d9e752-5aca-41b5-83f0-01ad329c8f9b tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:48.019991 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-17d9e752-5aca-41b5-83f0-01ad329c8f9b tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:48.020461 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-17d9e752-5aca-41b5-83f0-01ad329c8f9b tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:48.020895 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-17d9e752-5aca-41b5-83f0-01ad329c8f9b tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:48.153156 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-17d9e752-5aca-41b5-83f0-01ad329c8f9b tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:19:48.160776 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-17d9e752-5aca-41b5-83f0-01ad329c8f9b tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/f2f65cfc-dc4c-4340-ad26-72361828703a" status: 200 len: 1202 microversion: 2.1 time: 0.154051 Oct 04 19:19:48.161379 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3134/6639] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:19:48 2022] GET /compute/v2.1/servers/f2f65cfc-dc4c-4340-ad26-72361828703a => generated 1202 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:19:49.183133 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-62325cc7-6579-408c-b577-60870042ac1f tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:19:49.183746 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-62325cc7-6579-408c-b577-60870042ac1f tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: f2f65cfc-dc4c-4340-ad26-72361828703a] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:19:49.191834 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-62325cc7-6579-408c-b577-60870042ac1f tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:49.192458 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-62325cc7-6579-408c-b577-60870042ac1f tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:49.193028 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-62325cc7-6579-408c-b577-60870042ac1f tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:49.193848 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-62325cc7-6579-408c-b577-60870042ac1f tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:49.194408 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-62325cc7-6579-408c-b577-60870042ac1f tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:49.194928 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-62325cc7-6579-408c-b577-60870042ac1f tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:49.334374 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-62325cc7-6579-408c-b577-60870042ac1f tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:19:49.342594 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-62325cc7-6579-408c-b577-60870042ac1f tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/f2f65cfc-dc4c-4340-ad26-72361828703a" status: 200 len: 1202 microversion: 2.1 time: 0.163591 Oct 04 19:19:49.343162 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3506/6640] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:19:49 2022] GET /compute/v2.1/servers/f2f65cfc-dc4c-4340-ad26-72361828703a => generated 1202 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:19:50.366858 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-14ec47bc-e553-49de-b6fa-7c97443a7e2c tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:19:50.367494 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-14ec47bc-e553-49de-b6fa-7c97443a7e2c tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: f2f65cfc-dc4c-4340-ad26-72361828703a] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:19:50.370473 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=2 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:19:50.376314 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-14ec47bc-e553-49de-b6fa-7c97443a7e2c tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:50.376809 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-14ec47bc-e553-49de-b6fa-7c97443a7e2c tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:50.377287 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-14ec47bc-e553-49de-b6fa-7c97443a7e2c tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:50.377991 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-14ec47bc-e553-49de-b6fa-7c97443a7e2c tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:50.378451 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-14ec47bc-e553-49de-b6fa-7c97443a7e2c tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:50.378886 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-14ec47bc-e553-49de-b6fa-7c97443a7e2c tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:50.508179 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-14ec47bc-e553-49de-b6fa-7c97443a7e2c tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:19:50.515969 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-14ec47bc-e553-49de-b6fa-7c97443a7e2c tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/f2f65cfc-dc4c-4340-ad26-72361828703a" status: 200 len: 1202 microversion: 2.1 time: 0.153940 Oct 04 19:19:50.516551 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3135/6641] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:19:50 2022] GET /compute/v2.1/servers/f2f65cfc-dc4c-4340-ad26-72361828703a => generated 1202 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:19:51.539043 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-26110f13-d9d9-49b5-9888-80ac17750f9c tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:19:51.539640 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-26110f13-d9d9-49b5-9888-80ac17750f9c tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: f2f65cfc-dc4c-4340-ad26-72361828703a] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:19:51.541688 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=2 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:19:51.542357 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=6 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:19:51.549450 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-26110f13-d9d9-49b5-9888-80ac17750f9c tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:51.549936 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-26110f13-d9d9-49b5-9888-80ac17750f9c tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:51.550373 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-26110f13-d9d9-49b5-9888-80ac17750f9c tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:51.551069 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-26110f13-d9d9-49b5-9888-80ac17750f9c tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:51.551521 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-26110f13-d9d9-49b5-9888-80ac17750f9c tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:51.551950 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-26110f13-d9d9-49b5-9888-80ac17750f9c tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:51.684654 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-26110f13-d9d9-49b5-9888-80ac17750f9c tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:19:51.693066 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-26110f13-d9d9-49b5-9888-80ac17750f9c tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/f2f65cfc-dc4c-4340-ad26-72361828703a" status: 200 len: 1202 microversion: 2.1 time: 0.158391 Oct 04 19:19:51.693694 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3507/6642] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:19:51 2022] GET /compute/v2.1/servers/f2f65cfc-dc4c-4340-ad26-72361828703a => generated 1202 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:19:52.716022 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-cf1a0df1-8203-48cb-ab8d-ae54905e8ac6 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:19:52.716644 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-cf1a0df1-8203-48cb-ab8d-ae54905e8ac6 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: f2f65cfc-dc4c-4340-ad26-72361828703a] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:19:52.724410 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cf1a0df1-8203-48cb-ab8d-ae54905e8ac6 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:52.724907 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cf1a0df1-8203-48cb-ab8d-ae54905e8ac6 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:52.725385 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cf1a0df1-8203-48cb-ab8d-ae54905e8ac6 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:52.726087 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cf1a0df1-8203-48cb-ab8d-ae54905e8ac6 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:52.726548 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cf1a0df1-8203-48cb-ab8d-ae54905e8ac6 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:52.726982 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cf1a0df1-8203-48cb-ab8d-ae54905e8ac6 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:52.859028 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-cf1a0df1-8203-48cb-ab8d-ae54905e8ac6 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:19:52.867485 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-cf1a0df1-8203-48cb-ab8d-ae54905e8ac6 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/f2f65cfc-dc4c-4340-ad26-72361828703a" status: 200 len: 1202 microversion: 2.1 time: 0.155389 Oct 04 19:19:52.868071 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3136/6643] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:19:52 2022] GET /compute/v2.1/servers/f2f65cfc-dc4c-4340-ad26-72361828703a => generated 1202 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:19:53.891249 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-76225230-9e2e-46ac-bad1-53ad16d8641b tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:19:53.891872 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-76225230-9e2e-46ac-bad1-53ad16d8641b tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: f2f65cfc-dc4c-4340-ad26-72361828703a] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:19:53.900113 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-76225230-9e2e-46ac-bad1-53ad16d8641b tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:53.900609 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-76225230-9e2e-46ac-bad1-53ad16d8641b tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:53.901068 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-76225230-9e2e-46ac-bad1-53ad16d8641b tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:53.901791 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-76225230-9e2e-46ac-bad1-53ad16d8641b tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:53.902251 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-76225230-9e2e-46ac-bad1-53ad16d8641b tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:53.902685 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-76225230-9e2e-46ac-bad1-53ad16d8641b tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:54.035552 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-76225230-9e2e-46ac-bad1-53ad16d8641b tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:19:54.043534 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-76225230-9e2e-46ac-bad1-53ad16d8641b tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/f2f65cfc-dc4c-4340-ad26-72361828703a" status: 200 len: 1202 microversion: 2.1 time: 0.156317 Oct 04 19:19:54.044103 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3508/6644] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:19:53 2022] GET /compute/v2.1/servers/f2f65cfc-dc4c-4340-ad26-72361828703a => generated 1202 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:19:55.067566 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-c6afefbe-6d9f-4279-90eb-73803eaefc97 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:19:55.068869 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-c6afefbe-6d9f-4279-90eb-73803eaefc97 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: f2f65cfc-dc4c-4340-ad26-72361828703a] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:19:55.075779 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c6afefbe-6d9f-4279-90eb-73803eaefc97 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:55.076268 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c6afefbe-6d9f-4279-90eb-73803eaefc97 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:55.076712 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c6afefbe-6d9f-4279-90eb-73803eaefc97 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:55.077455 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c6afefbe-6d9f-4279-90eb-73803eaefc97 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:55.077918 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c6afefbe-6d9f-4279-90eb-73803eaefc97 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:55.078354 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c6afefbe-6d9f-4279-90eb-73803eaefc97 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:55.206796 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-c6afefbe-6d9f-4279-90eb-73803eaefc97 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:19:55.214585 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-c6afefbe-6d9f-4279-90eb-73803eaefc97 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/f2f65cfc-dc4c-4340-ad26-72361828703a" status: 200 len: 1202 microversion: 2.1 time: 0.150932 Oct 04 19:19:55.215157 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3137/6645] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:19:55 2022] GET /compute/v2.1/servers/f2f65cfc-dc4c-4340-ad26-72361828703a => generated 1202 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:19:55.936350 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-82f19171-11fb-4a26-b1ad-fa8ab307191a req-399250be-e486-4ac5-ac1a-001cc9765489 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2f65cfc-dc4c-4340-ad26-72361828703a", "name": "network-vif-plugged", "status": "completed", "tag": "e2bd0702-26ae-4969-8819-eb781f9c8fdc"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:19:55.946039 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-82f19171-11fb-4a26-b1ad-fa8ab307191a req-399250be-e486-4ac5-ac1a-001cc9765489 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:55.946523 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-82f19171-11fb-4a26-b1ad-fa8ab307191a req-399250be-e486-4ac5-ac1a-001cc9765489 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:55.946966 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-82f19171-11fb-4a26-b1ad-fa8ab307191a req-399250be-e486-4ac5-ac1a-001cc9765489 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:55.957957 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-82f19171-11fb-4a26-b1ad-fa8ab307191a req-399250be-e486-4ac5-ac1a-001cc9765489 service nova] Creating event network-vif-plugged:e2bd0702-26ae-4969-8819-eb781f9c8fdc for instance f2f65cfc-dc4c-4340-ad26-72361828703a on n-h2-851028-13 Oct 04 19:19:55.963692 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-82f19171-11fb-4a26-b1ad-fa8ab307191a req-399250be-e486-4ac5-ac1a-001cc9765489 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096022 Oct 04 19:19:55.964346 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3509/6646] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:19:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:19:56.240607 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-1a20e6c8-743a-4664-8487-316f777d2817 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:19:56.241212 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-1a20e6c8-743a-4664-8487-316f777d2817 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: f2f65cfc-dc4c-4340-ad26-72361828703a] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:19:56.248140 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1a20e6c8-743a-4664-8487-316f777d2817 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:56.248632 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1a20e6c8-743a-4664-8487-316f777d2817 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:56.249079 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1a20e6c8-743a-4664-8487-316f777d2817 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:56.249835 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1a20e6c8-743a-4664-8487-316f777d2817 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:56.250298 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1a20e6c8-743a-4664-8487-316f777d2817 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:56.250736 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1a20e6c8-743a-4664-8487-316f777d2817 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:56.380262 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-1a20e6c8-743a-4664-8487-316f777d2817 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:19:56.388018 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-1a20e6c8-743a-4664-8487-316f777d2817 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/f2f65cfc-dc4c-4340-ad26-72361828703a" status: 200 len: 1202 microversion: 2.1 time: 0.151967 Oct 04 19:19:56.388623 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3138/6647] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:19:56 2022] GET /compute/v2.1/servers/f2f65cfc-dc4c-4340-ad26-72361828703a => generated 1202 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:19:57.411846 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-72e3405b-3332-43a6-83fe-ab8fa3a31011 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:19:57.412563 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-72e3405b-3332-43a6-83fe-ab8fa3a31011 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: f2f65cfc-dc4c-4340-ad26-72361828703a] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:19:57.419127 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-72e3405b-3332-43a6-83fe-ab8fa3a31011 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:57.419618 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-72e3405b-3332-43a6-83fe-ab8fa3a31011 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:57.420063 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-72e3405b-3332-43a6-83fe-ab8fa3a31011 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:57.420766 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-72e3405b-3332-43a6-83fe-ab8fa3a31011 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:57.421266 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-72e3405b-3332-43a6-83fe-ab8fa3a31011 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:57.421703 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-72e3405b-3332-43a6-83fe-ab8fa3a31011 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:57.557700 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-72e3405b-3332-43a6-83fe-ab8fa3a31011 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:19:57.565507 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-72e3405b-3332-43a6-83fe-ab8fa3a31011 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/f2f65cfc-dc4c-4340-ad26-72361828703a" status: 200 len: 1389 microversion: 2.1 time: 0.158736 Oct 04 19:19:57.566090 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3510/6648] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:19:57 2022] GET /compute/v2.1/servers/f2f65cfc-dc4c-4340-ad26-72361828703a => generated 1389 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:19:57.588123 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-afbfd9c0-6e46-45e4-bfaa-419d3dce042e tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:19:57.588742 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-afbfd9c0-6e46-45e4-bfaa-419d3dce042e tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: f2f65cfc-dc4c-4340-ad26-72361828703a] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:19:57.595740 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-afbfd9c0-6e46-45e4-bfaa-419d3dce042e tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:57.596221 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-afbfd9c0-6e46-45e4-bfaa-419d3dce042e tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:57.596661 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-afbfd9c0-6e46-45e4-bfaa-419d3dce042e tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:57.597389 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-afbfd9c0-6e46-45e4-bfaa-419d3dce042e tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:57.597880 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-afbfd9c0-6e46-45e4-bfaa-419d3dce042e tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:57.598313 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-afbfd9c0-6e46-45e4-bfaa-419d3dce042e tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:57.730886 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-afbfd9c0-6e46-45e4-bfaa-419d3dce042e tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:19:57.738954 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-afbfd9c0-6e46-45e4-bfaa-419d3dce042e tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/f2f65cfc-dc4c-4340-ad26-72361828703a" status: 200 len: 1389 microversion: 2.1 time: 0.154803 Oct 04 19:19:57.739823 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3139/6649] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:19:57 2022] GET /compute/v2.1/servers/f2f65cfc-dc4c-4340-ad26-72361828703a => generated 1389 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:19:57.760904 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-211b08ac-cb14-4a7c-93eb-1dcae5475d4a tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:19:57.761540 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-211b08ac-cb14-4a7c-93eb-1dcae5475d4a tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: f2f65cfc-dc4c-4340-ad26-72361828703a] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:19:57.767529 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-211b08ac-cb14-4a7c-93eb-1dcae5475d4a tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:57.768016 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-211b08ac-cb14-4a7c-93eb-1dcae5475d4a tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:57.768456 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-211b08ac-cb14-4a7c-93eb-1dcae5475d4a tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:57.769184 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-211b08ac-cb14-4a7c-93eb-1dcae5475d4a tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:57.769643 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-211b08ac-cb14-4a7c-93eb-1dcae5475d4a tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:57.770070 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-211b08ac-cb14-4a7c-93eb-1dcae5475d4a tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:57.896993 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-211b08ac-cb14-4a7c-93eb-1dcae5475d4a tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:19:57.904877 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-211b08ac-cb14-4a7c-93eb-1dcae5475d4a tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/f2f65cfc-dc4c-4340-ad26-72361828703a" status: 200 len: 1389 microversion: 2.1 time: 0.147826 Oct 04 19:19:57.905502 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3511/6650] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:19:57 2022] GET /compute/v2.1/servers/f2f65cfc-dc4c-4340-ad26-72361828703a => generated 1389 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:19:57.928089 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-c66f40dd-7dc2-4e86-b3af-07a8a7c6e7aa tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:19:57.928596 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-c66f40dd-7dc2-4e86-b3af-07a8a7c6e7aa tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: f2f65cfc-dc4c-4340-ad26-72361828703a] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:19:57.934942 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c66f40dd-7dc2-4e86-b3af-07a8a7c6e7aa tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:57.935369 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c66f40dd-7dc2-4e86-b3af-07a8a7c6e7aa tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:57.936102 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c66f40dd-7dc2-4e86-b3af-07a8a7c6e7aa tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:57.936815 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c66f40dd-7dc2-4e86-b3af-07a8a7c6e7aa tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:57.937314 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c66f40dd-7dc2-4e86-b3af-07a8a7c6e7aa tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:57.937801 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c66f40dd-7dc2-4e86-b3af-07a8a7c6e7aa tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:57.963190 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-c66f40dd-7dc2-4e86-b3af-07a8a7c6e7aa tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: f2f65cfc-dc4c-4340-ad26-72361828703a] Going to try to terminate instance {{(pid=123595) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 19:19:58.040998 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-c66f40dd-7dc2-4e86-b3af-07a8a7c6e7aa tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "DELETE /compute/v2.1/servers/f2f65cfc-dc4c-4340-ad26-72361828703a" status: 204 len: 0 microversion: 2.1 time: 0.117374 Oct 04 19:19:58.041925 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3140/6651] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 19:19:57 2022] DELETE /compute/v2.1/servers/f2f65cfc-dc4c-4340-ad26-72361828703a => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:19:58.050533 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-355e0f9a-bf73-4cba-adfb-64fff49a5e27 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:19:58.051162 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-355e0f9a-bf73-4cba-adfb-64fff49a5e27 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: f2f65cfc-dc4c-4340-ad26-72361828703a] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:19:58.057476 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-355e0f9a-bf73-4cba-adfb-64fff49a5e27 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:58.057992 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-355e0f9a-bf73-4cba-adfb-64fff49a5e27 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:58.058425 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-355e0f9a-bf73-4cba-adfb-64fff49a5e27 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:58.059132 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-355e0f9a-bf73-4cba-adfb-64fff49a5e27 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:58.059599 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-355e0f9a-bf73-4cba-adfb-64fff49a5e27 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:58.060037 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-355e0f9a-bf73-4cba-adfb-64fff49a5e27 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:58.186415 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-355e0f9a-bf73-4cba-adfb-64fff49a5e27 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:19:58.194308 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-355e0f9a-bf73-4cba-adfb-64fff49a5e27 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/f2f65cfc-dc4c-4340-ad26-72361828703a" status: 200 len: 1395 microversion: 2.1 time: 0.147989 Oct 04 19:19:58.194887 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3512/6652] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:19:58 2022] GET /compute/v2.1/servers/f2f65cfc-dc4c-4340-ad26-72361828703a => generated 1395 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:19:59.218198 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-53acba82-1327-458b-a49b-a1ca016dd016 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:19:59.218905 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-53acba82-1327-458b-a49b-a1ca016dd016 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: f2f65cfc-dc4c-4340-ad26-72361828703a] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:19:59.226257 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-53acba82-1327-458b-a49b-a1ca016dd016 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:59.226753 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-53acba82-1327-458b-a49b-a1ca016dd016 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:59.227200 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-53acba82-1327-458b-a49b-a1ca016dd016 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:59.227906 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-53acba82-1327-458b-a49b-a1ca016dd016 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:59.228366 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-53acba82-1327-458b-a49b-a1ca016dd016 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:59.228802 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-53acba82-1327-458b-a49b-a1ca016dd016 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:59.358016 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-53acba82-1327-458b-a49b-a1ca016dd016 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:19:59.367091 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-53acba82-1327-458b-a49b-a1ca016dd016 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/f2f65cfc-dc4c-4340-ad26-72361828703a" status: 200 len: 1395 microversion: 2.1 time: 0.152867 Oct 04 19:19:59.367765 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3141/6653] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:19:59 2022] GET /compute/v2.1/servers/f2f65cfc-dc4c-4340-ad26-72361828703a => generated 1395 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:20:00.076747 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-9b5f7251-28a3-4ead-9879-3de996504027 req-dec5939b-90d7-47cf-aaec-0d6ace1a8cb3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2f65cfc-dc4c-4340-ad26-72361828703a", "name": "network-vif-deleted", "tag": "e2bd0702-26ae-4969-8819-eb781f9c8fdc"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:20:00.087415 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-9b5f7251-28a3-4ead-9879-3de996504027 req-dec5939b-90d7-47cf-aaec-0d6ace1a8cb3 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:00.087903 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-9b5f7251-28a3-4ead-9879-3de996504027 req-dec5939b-90d7-47cf-aaec-0d6ace1a8cb3 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:00.088335 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-9b5f7251-28a3-4ead-9879-3de996504027 req-dec5939b-90d7-47cf-aaec-0d6ace1a8cb3 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:00.100949 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-9b5f7251-28a3-4ead-9879-3de996504027 req-dec5939b-90d7-47cf-aaec-0d6ace1a8cb3 service nova] Creating event network-vif-deleted:e2bd0702-26ae-4969-8819-eb781f9c8fdc for instance f2f65cfc-dc4c-4340-ad26-72361828703a on n-h2-851028-13 Oct 04 19:20:00.106378 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-9b5f7251-28a3-4ead-9879-3de996504027 req-dec5939b-90d7-47cf-aaec-0d6ace1a8cb3 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033292 Oct 04 19:20:00.107226 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3513/6654] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:20:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:20:00.390421 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-a12386e5-255e-4a9a-96e4-7aec00540217 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:20:00.391044 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-a12386e5-255e-4a9a-96e4-7aec00540217 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: f2f65cfc-dc4c-4340-ad26-72361828703a] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:20:00.398567 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a12386e5-255e-4a9a-96e4-7aec00540217 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:00.399058 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a12386e5-255e-4a9a-96e4-7aec00540217 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:00.399503 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a12386e5-255e-4a9a-96e4-7aec00540217 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:00.400208 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a12386e5-255e-4a9a-96e4-7aec00540217 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:00.400667 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a12386e5-255e-4a9a-96e4-7aec00540217 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:00.401102 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a12386e5-255e-4a9a-96e4-7aec00540217 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:00.462258 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-a12386e5-255e-4a9a-96e4-7aec00540217 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:20:00.470033 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-a12386e5-255e-4a9a-96e4-7aec00540217 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/f2f65cfc-dc4c-4340-ad26-72361828703a" status: 200 len: 1187 microversion: 2.1 time: 0.083560 Oct 04 19:20:00.470607 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3142/6655] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:20:00 2022] GET /compute/v2.1/servers/f2f65cfc-dc4c-4340-ad26-72361828703a => generated 1187 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:20:01.494430 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-381257b1-cde6-42d5-8f9c-c68727df17e1 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:20:01.495141 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-381257b1-cde6-42d5-8f9c-c68727df17e1 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: f2f65cfc-dc4c-4340-ad26-72361828703a] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:20:01.501539 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-381257b1-cde6-42d5-8f9c-c68727df17e1 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:01.502036 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-381257b1-cde6-42d5-8f9c-c68727df17e1 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:01.502482 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-381257b1-cde6-42d5-8f9c-c68727df17e1 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:01.503189 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-381257b1-cde6-42d5-8f9c-c68727df17e1 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:01.503650 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-381257b1-cde6-42d5-8f9c-c68727df17e1 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:01.504084 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-381257b1-cde6-42d5-8f9c-c68727df17e1 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:01.567035 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-381257b1-cde6-42d5-8f9c-c68727df17e1 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:20:01.575647 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-381257b1-cde6-42d5-8f9c-c68727df17e1 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/f2f65cfc-dc4c-4340-ad26-72361828703a" status: 200 len: 1187 microversion: 2.1 time: 0.086476 Oct 04 19:20:01.576234 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3514/6656] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:20:01 2022] GET /compute/v2.1/servers/f2f65cfc-dc4c-4340-ad26-72361828703a => generated 1187 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:20:02.599190 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-371764e5-7903-43d0-9403-8b9c67e763fa tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:20:02.600369 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-371764e5-7903-43d0-9403-8b9c67e763fa tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: f2f65cfc-dc4c-4340-ad26-72361828703a] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:20:02.607556 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-371764e5-7903-43d0-9403-8b9c67e763fa tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:02.608368 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-371764e5-7903-43d0-9403-8b9c67e763fa tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:02.609166 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-371764e5-7903-43d0-9403-8b9c67e763fa tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:02.609919 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-371764e5-7903-43d0-9403-8b9c67e763fa tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:02.610380 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-371764e5-7903-43d0-9403-8b9c67e763fa tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:02.610861 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-371764e5-7903-43d0-9403-8b9c67e763fa tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:02.677922 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-371764e5-7903-43d0-9403-8b9c67e763fa tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:20:02.685892 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-371764e5-7903-43d0-9403-8b9c67e763fa tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/f2f65cfc-dc4c-4340-ad26-72361828703a" status: 200 len: 1187 microversion: 2.1 time: 0.090660 Oct 04 19:20:02.686462 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3143/6657] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:20:02 2022] GET /compute/v2.1/servers/f2f65cfc-dc4c-4340-ad26-72361828703a => generated 1187 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:20:03.709862 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-47da7169-37da-4fd3-a754-0eae1ba87b95 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:20:03.710469 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-47da7169-37da-4fd3-a754-0eae1ba87b95 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: f2f65cfc-dc4c-4340-ad26-72361828703a] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:20:03.717430 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-47da7169-37da-4fd3-a754-0eae1ba87b95 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:03.717917 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-47da7169-37da-4fd3-a754-0eae1ba87b95 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:03.718351 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-47da7169-37da-4fd3-a754-0eae1ba87b95 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:03.719049 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-47da7169-37da-4fd3-a754-0eae1ba87b95 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:03.719502 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-47da7169-37da-4fd3-a754-0eae1ba87b95 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:03.719929 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-47da7169-37da-4fd3-a754-0eae1ba87b95 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:03.788266 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-47da7169-37da-4fd3-a754-0eae1ba87b95 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:20:03.796609 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-47da7169-37da-4fd3-a754-0eae1ba87b95 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/f2f65cfc-dc4c-4340-ad26-72361828703a" status: 200 len: 1187 microversion: 2.1 time: 0.090748 Oct 04 19:20:03.797213 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3515/6658] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:20:03 2022] GET /compute/v2.1/servers/f2f65cfc-dc4c-4340-ad26-72361828703a => generated 1187 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:20:04.820493 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-15764ae0-3603-419f-927a-b733a01c171b tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:20:04.821135 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-15764ae0-3603-419f-927a-b733a01c171b tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: f2f65cfc-dc4c-4340-ad26-72361828703a] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:20:04.828292 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-15764ae0-3603-419f-927a-b733a01c171b tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:04.828784 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-15764ae0-3603-419f-927a-b733a01c171b tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:04.829254 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-15764ae0-3603-419f-927a-b733a01c171b tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:04.829956 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-15764ae0-3603-419f-927a-b733a01c171b tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:04.830418 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-15764ae0-3603-419f-927a-b733a01c171b tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:04.830851 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-15764ae0-3603-419f-927a-b733a01c171b tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:04.844287 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-15764ae0-3603-419f-927a-b733a01c171b tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] HTTP exception thrown: Instance f2f65cfc-dc4c-4340-ad26-72361828703a could not be found. Oct 04 19:20:04.845896 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-15764ae0-3603-419f-927a-b733a01c171b tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Request method failure captured: Oct 04 19:20:04.845896 n-d-851028-13 devstack@n-api.service[123595]: request: GET /compute/v2.1/servers/f2f65cfc-dc4c-4340-ad26-72361828703a HTTP/1.1 Oct 04 19:20:04.845896 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 19:20:04.845896 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 19:20:04.845896 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 19:20:04.845896 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 0 Oct 04 19:20:04.845896 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 19:20:04.845896 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 19:20:04.845896 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 19:20:04.845896 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 19:20:04.845896 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPIdD9eu-sNppZso9GBgF0qiQcNSNfbptUObqTJdNMmQeJtmiNalN1HCCgoRlIsnKAnm3yDfemx5F9JCBtqQ5VFIZ41axYIUJNVoTUZoGs-EEXp4RLTVvMn1M_mAUAx-w46wS7k3RPeCrtItzG8FEbUjMK8RLhn-Xr_i-jB7aqW9aWok Oct 04 19:20:04.845896 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 19:20:04.845896 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 19:20:04.845896 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 19:20:04.845896 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 19:20:04.845896 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 19:20:04.845896 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 19:20:04.845896 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: 9cd28590bda749c5aa109ae292cb32e6 Oct 04 19:20:04.845896 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-TestVolumeBootPattern-410499789 Oct 04 19:20:04.845896 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 19:20:04.845896 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 19:20:04.845896 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/9cd28590bda749c5aa109ae292cb32e6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_9cd28590bda749c5aa109ae292cb32e6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/9cd28590bda749c5aa109ae292cb32e6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/9cd28590bda749c5aa109ae292cb32e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 19:20:04.845896 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-TestVolumeBootPattern-410499789 Oct 04 19:20:04.845896 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: 9cd28590bda749c5aa109ae292cb32e6 Oct 04 19:20:04.845896 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-TestVolumeBootPattern-410499789 Oct 04 19:20:04.845896 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-TestVolumeBootPattern-410499789-project Oct 04 19:20:04.845896 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 19:20:04.845896 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 19:20:04.845896 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: 43efdccf8e2f4934ae5cfe3da828511e Oct 04 19:20:04.845896 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-TestVolumeBootPattern-410499789-project Oct 04 19:20:04.845896 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 19:20:04.845896 n-d-851028-13 devstack@n-api.service[123595]: exception: Instance f2f65cfc-dc4c-4340-ad26-72361828703a could not be found. Oct 04 19:20:04.845896 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': 'f2f65cfc-dc4c-4340-ad26-72361828703a'} Oct 04 19:20:04.845896 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:20:04.845896 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:20:04.845896 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:20:04.845896 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:20:04.845896 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:20:04.845896 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:20:04.845896 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:20:04.845896 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:20:04.845896 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:20:04.845896 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:20:04.845896 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2f65cfc-dc4c-4340-ad26-72361828703a could not be found. Oct 04 19:20:04.845896 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:20:04.845896 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:20:04.845896 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:20:04.845896 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:20:04.845896 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:20:04.845896 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:20:04.845896 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:20:04.845896 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:20:04.845896 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:20:04.845896 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:20:04.845896 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:20:04.845896 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:20:04.845896 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:20:04.845896 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:20:04.845896 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:20:04.845896 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:20:04.845896 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2f65cfc-dc4c-4340-ad26-72361828703a could not be found. Oct 04 19:20:04.845896 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:20:04.845896 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:20:04.845896 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:20:04.849968 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:20:04.849968 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:20:04.849968 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:20:04.849968 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:20:04.849968 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:20:04.849968 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2f65cfc-dc4c-4340-ad26-72361828703a could not be found. Oct 04 19:20:04.849968 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:20:04.849968 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-15764ae0-3603-419f-927a-b733a01c171b tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Returning 404 to user: Instance f2f65cfc-dc4c-4340-ad26-72361828703a could not be found. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:20:04.849968 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-15764ae0-3603-419f-927a-b733a01c171b tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/f2f65cfc-dc4c-4340-ad26-72361828703a" status: 404 len: 111 microversion: 2.1 time: 0.031412 Oct 04 19:20:04.849968 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3144/6659] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:20:04 2022] GET /compute/v2.1/servers/f2f65cfc-dc4c-4340-ad26-72361828703a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:20:09.831760 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-a1fd2bee-5841-46ff-8c18-32e4c8925b45 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-726313402", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "cc53d516-4188-4268-bff8-dc0caf05fc9b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "2ddfee4a-681a-4b64-a4ab-40481cf11577"}]}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:20:09.842654 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=3 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:20:09.892717 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.network.neutron [None req-a1fd2bee-5841-46ff-8c18-32e4c8925b45 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] validate_networks() for [('2ddfee4a-681a-4b64-a4ab-40481cf11577', None, None, None, None, None)] {{(pid=123596) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 19:20:10.251440 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-a1fd2bee-5841-46ff-8c18-32e4c8925b45 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Flavor limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:20:10.251874 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-a1fd2bee-5841-46ff-8c18-32e4c8925b45 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Image limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:20:10.252356 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-a1fd2bee-5841-46ff-8c18-32e4c8925b45 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Flavor pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:20:10.252769 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-a1fd2bee-5841-46ff-8c18-32e4c8925b45 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Image pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:20:10.253222 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-a1fd2bee-5841-46ff-8c18-32e4c8925b45 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:20:10.262624 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a1fd2bee-5841-46ff-8c18-32e4c8925b45 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:10.263393 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a1fd2bee-5841-46ff-8c18-32e4c8925b45 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:10.263872 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a1fd2bee-5841-46ff-8c18-32e4c8925b45 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:10.264825 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a1fd2bee-5841-46ff-8c18-32e4c8925b45 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:10.265329 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a1fd2bee-5841-46ff-8c18-32e4c8925b45 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:10.265849 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a1fd2bee-5841-46ff-8c18-32e4c8925b45 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:10.273295 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=75 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:20:10.285269 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-a1fd2bee-5841-46ff-8c18-32e4c8925b45 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Getting quotas for project 9cd28590bda749c5aa109ae292cb32e6. Resources: {'ram', 'cores', 'instances'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:20:10.291265 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-a1fd2bee-5841-46ff-8c18-32e4c8925b45 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Getting quotas for user 43efdccf8e2f4934ae5cfe3da828511e and project 9cd28590bda749c5aa109ae292cb32e6. Resources: {'ram', 'cores', 'instances'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:20:10.348881 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-a1fd2bee-5841-46ff-8c18-32e4c8925b45 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Going to run 1 instances... {{(pid=123596) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 19:20:10.351573 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-a1fd2bee-5841-46ff-8c18-32e4c8925b45 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: aab45346-7141-4c36-87fa-595222553df8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='cc53d516-4188-4268-bff8-dc0caf05fc9b',volume_size=None,volume_type=None)] {{(pid=123596) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 19:20:10.486210 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-a1fd2bee-5841-46ff-8c18-32e4c8925b45 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.658318 Oct 04 19:20:10.486870 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3516/6660] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 19:20:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 660 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 19:20:10.497992 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-b69d04f0-7acd-4332-ba76-ff4eccb6dd0f tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:20:10.498617 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-b69d04f0-7acd-4332-ba76-ff4eccb6dd0f tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: aab45346-7141-4c36-87fa-595222553df8] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:20:10.501959 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:20:10.556354 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-b69d04f0-7acd-4332-ba76-ff4eccb6dd0f tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:20:10.563690 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-b69d04f0-7acd-4332-ba76-ff4eccb6dd0f tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/aab45346-7141-4c36-87fa-595222553df8" status: 200 len: 1056 microversion: 2.1 time: 0.069533 Oct 04 19:20:10.564266 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3145/6661] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:20:10 2022] GET /compute/v2.1/servers/aab45346-7141-4c36-87fa-595222553df8 => generated 1056 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:20:11.589979 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-76ed9bfc-8234-43c3-b82a-ccdffc90f91d tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:20:11.591185 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-76ed9bfc-8234-43c3-b82a-ccdffc90f91d tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: aab45346-7141-4c36-87fa-595222553df8] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:20:11.598648 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-76ed9bfc-8234-43c3-b82a-ccdffc90f91d tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:11.600262 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-76ed9bfc-8234-43c3-b82a-ccdffc90f91d tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:11.601271 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-76ed9bfc-8234-43c3-b82a-ccdffc90f91d tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:11.601624 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-76ed9bfc-8234-43c3-b82a-ccdffc90f91d tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:11.602092 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-76ed9bfc-8234-43c3-b82a-ccdffc90f91d tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:11.602667 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-76ed9bfc-8234-43c3-b82a-ccdffc90f91d tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:11.687679 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-76ed9bfc-8234-43c3-b82a-ccdffc90f91d tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:20:11.701426 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-76ed9bfc-8234-43c3-b82a-ccdffc90f91d tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/aab45346-7141-4c36-87fa-595222553df8" status: 200 len: 1172 microversion: 2.1 time: 0.117863 Oct 04 19:20:11.713144 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3517/6662] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:20:11 2022] GET /compute/v2.1/servers/aab45346-7141-4c36-87fa-595222553df8 => generated 1172 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:20:12.726968 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-57c27ab0-3b85-457f-b3e4-6451f852217b tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:20:12.727829 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-57c27ab0-3b85-457f-b3e4-6451f852217b tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: aab45346-7141-4c36-87fa-595222553df8] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:20:12.736353 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-57c27ab0-3b85-457f-b3e4-6451f852217b tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:12.736942 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-57c27ab0-3b85-457f-b3e4-6451f852217b tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:12.737493 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-57c27ab0-3b85-457f-b3e4-6451f852217b tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:12.738403 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-57c27ab0-3b85-457f-b3e4-6451f852217b tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:12.738951 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-57c27ab0-3b85-457f-b3e4-6451f852217b tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:12.739464 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-57c27ab0-3b85-457f-b3e4-6451f852217b tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:12.744252 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:20:12.883549 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-57c27ab0-3b85-457f-b3e4-6451f852217b tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:20:12.892213 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-57c27ab0-3b85-457f-b3e4-6451f852217b tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/aab45346-7141-4c36-87fa-595222553df8" status: 200 len: 1214 microversion: 2.1 time: 0.169385 Oct 04 19:20:12.892915 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3146/6663] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:20:12 2022] GET /compute/v2.1/servers/aab45346-7141-4c36-87fa-595222553df8 => generated 1214 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:20:13.324167 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-43c5f077-d1d9-4e58-bbff-f265a14c510d req-810c57b7-5410-436f-a703-9bef64bac79d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aab45346-7141-4c36-87fa-595222553df8", "tag": "ae3cdc33-b130-4898-8aae-3ad281c9271e"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:20:13.339076 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-43c5f077-d1d9-4e58-bbff-f265a14c510d req-810c57b7-5410-436f-a703-9bef64bac79d service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:13.340323 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-43c5f077-d1d9-4e58-bbff-f265a14c510d req-810c57b7-5410-436f-a703-9bef64bac79d service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:13.341004 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-43c5f077-d1d9-4e58-bbff-f265a14c510d req-810c57b7-5410-436f-a703-9bef64bac79d service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:13.356564 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-43c5f077-d1d9-4e58-bbff-f265a14c510d req-810c57b7-5410-436f-a703-9bef64bac79d service nova] Creating event network-changed:ae3cdc33-b130-4898-8aae-3ad281c9271e for instance aab45346-7141-4c36-87fa-595222553df8 on n-h1-851028-13 Oct 04 19:20:13.362939 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-43c5f077-d1d9-4e58-bbff-f265a14c510d req-810c57b7-5410-436f-a703-9bef64bac79d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042754 Oct 04 19:20:13.363733 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3518/6664] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:20:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:20:13.915515 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-35581bee-9a6a-4718-9c69-6541b4c21911 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:20:13.916320 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-35581bee-9a6a-4718-9c69-6541b4c21911 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: aab45346-7141-4c36-87fa-595222553df8] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:20:13.923699 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-35581bee-9a6a-4718-9c69-6541b4c21911 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:13.924634 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-35581bee-9a6a-4718-9c69-6541b4c21911 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:13.925218 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-35581bee-9a6a-4718-9c69-6541b4c21911 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:13.926052 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-35581bee-9a6a-4718-9c69-6541b4c21911 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:13.926620 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-35581bee-9a6a-4718-9c69-6541b4c21911 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:13.927159 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-35581bee-9a6a-4718-9c69-6541b4c21911 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:14.081340 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-35581bee-9a6a-4718-9c69-6541b4c21911 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:20:14.090551 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-35581bee-9a6a-4718-9c69-6541b4c21911 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/aab45346-7141-4c36-87fa-595222553df8" status: 200 len: 1214 microversion: 2.1 time: 0.179145 Oct 04 19:20:14.091469 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3147/6665] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:20:13 2022] GET /compute/v2.1/servers/aab45346-7141-4c36-87fa-595222553df8 => generated 1214 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:20:15.114616 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-112ab641-6354-426f-9fdf-6905488ebfd1 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:20:15.115944 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-112ab641-6354-426f-9fdf-6905488ebfd1 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: aab45346-7141-4c36-87fa-595222553df8] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:20:15.123129 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-112ab641-6354-426f-9fdf-6905488ebfd1 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:15.123628 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-112ab641-6354-426f-9fdf-6905488ebfd1 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:15.124077 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-112ab641-6354-426f-9fdf-6905488ebfd1 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:15.124774 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-112ab641-6354-426f-9fdf-6905488ebfd1 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:15.125256 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-112ab641-6354-426f-9fdf-6905488ebfd1 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:15.125689 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-112ab641-6354-426f-9fdf-6905488ebfd1 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:15.260409 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-112ab641-6354-426f-9fdf-6905488ebfd1 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:20:15.268356 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-112ab641-6354-426f-9fdf-6905488ebfd1 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/aab45346-7141-4c36-87fa-595222553df8" status: 200 len: 1214 microversion: 2.1 time: 0.158152 Oct 04 19:20:15.268973 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3519/6666] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:20:15 2022] GET /compute/v2.1/servers/aab45346-7141-4c36-87fa-595222553df8 => generated 1214 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:20:16.292230 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-3c6a5fd2-977a-4055-b3b8-5b274343d749 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:20:16.292847 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-3c6a5fd2-977a-4055-b3b8-5b274343d749 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: aab45346-7141-4c36-87fa-595222553df8] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:20:16.300507 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3c6a5fd2-977a-4055-b3b8-5b274343d749 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:16.300733 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3c6a5fd2-977a-4055-b3b8-5b274343d749 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:16.301367 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3c6a5fd2-977a-4055-b3b8-5b274343d749 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:16.302077 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3c6a5fd2-977a-4055-b3b8-5b274343d749 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:16.303027 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3c6a5fd2-977a-4055-b3b8-5b274343d749 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:16.303652 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3c6a5fd2-977a-4055-b3b8-5b274343d749 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:16.448030 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-3c6a5fd2-977a-4055-b3b8-5b274343d749 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:20:16.455800 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-3c6a5fd2-977a-4055-b3b8-5b274343d749 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/aab45346-7141-4c36-87fa-595222553df8" status: 200 len: 1214 microversion: 2.1 time: 0.167566 Oct 04 19:20:16.456393 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3148/6667] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:20:16 2022] GET /compute/v2.1/servers/aab45346-7141-4c36-87fa-595222553df8 => generated 1214 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:20:17.479038 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-5d3f0e84-dc0c-4a91-929c-19e27c05e1f7 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:20:17.479653 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-5d3f0e84-dc0c-4a91-929c-19e27c05e1f7 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: aab45346-7141-4c36-87fa-595222553df8] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:20:17.486605 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5d3f0e84-dc0c-4a91-929c-19e27c05e1f7 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:17.487089 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5d3f0e84-dc0c-4a91-929c-19e27c05e1f7 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:17.487527 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5d3f0e84-dc0c-4a91-929c-19e27c05e1f7 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:17.488213 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5d3f0e84-dc0c-4a91-929c-19e27c05e1f7 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:17.488663 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5d3f0e84-dc0c-4a91-929c-19e27c05e1f7 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:17.489092 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5d3f0e84-dc0c-4a91-929c-19e27c05e1f7 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:17.618728 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-5d3f0e84-dc0c-4a91-929c-19e27c05e1f7 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:20:17.626584 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-5d3f0e84-dc0c-4a91-929c-19e27c05e1f7 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/aab45346-7141-4c36-87fa-595222553df8" status: 200 len: 1202 microversion: 2.1 time: 0.151971 Oct 04 19:20:17.627151 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3520/6668] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:20:17 2022] GET /compute/v2.1/servers/aab45346-7141-4c36-87fa-595222553df8 => generated 1202 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:20:18.649569 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-e2cc283e-2334-4425-a45f-86dd02bb6a06 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:20:18.650190 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-e2cc283e-2334-4425-a45f-86dd02bb6a06 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: aab45346-7141-4c36-87fa-595222553df8] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:20:18.657065 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e2cc283e-2334-4425-a45f-86dd02bb6a06 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:18.657584 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e2cc283e-2334-4425-a45f-86dd02bb6a06 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:18.658024 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e2cc283e-2334-4425-a45f-86dd02bb6a06 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:18.658718 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e2cc283e-2334-4425-a45f-86dd02bb6a06 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:18.659173 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e2cc283e-2334-4425-a45f-86dd02bb6a06 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:18.659602 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e2cc283e-2334-4425-a45f-86dd02bb6a06 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:18.792215 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-e2cc283e-2334-4425-a45f-86dd02bb6a06 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:20:18.800230 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-e2cc283e-2334-4425-a45f-86dd02bb6a06 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/aab45346-7141-4c36-87fa-595222553df8" status: 200 len: 1202 microversion: 2.1 time: 0.154590 Oct 04 19:20:18.800800 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3149/6669] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:20:18 2022] GET /compute/v2.1/servers/aab45346-7141-4c36-87fa-595222553df8 => generated 1202 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:20:19.824323 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-63a16f93-d90d-491d-a30b-89c6741eb092 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:20:19.824946 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-63a16f93-d90d-491d-a30b-89c6741eb092 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: aab45346-7141-4c36-87fa-595222553df8] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:20:19.831963 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-63a16f93-d90d-491d-a30b-89c6741eb092 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:19.832464 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-63a16f93-d90d-491d-a30b-89c6741eb092 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:19.832915 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-63a16f93-d90d-491d-a30b-89c6741eb092 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:19.833650 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-63a16f93-d90d-491d-a30b-89c6741eb092 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:19.834123 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-63a16f93-d90d-491d-a30b-89c6741eb092 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:19.834565 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-63a16f93-d90d-491d-a30b-89c6741eb092 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:19.966375 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-63a16f93-d90d-491d-a30b-89c6741eb092 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:20:19.974427 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-63a16f93-d90d-491d-a30b-89c6741eb092 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/aab45346-7141-4c36-87fa-595222553df8" status: 200 len: 1202 microversion: 2.1 time: 0.154013 Oct 04 19:20:19.975387 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3521/6670] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:20:19 2022] GET /compute/v2.1/servers/aab45346-7141-4c36-87fa-595222553df8 => generated 1202 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:20:20.999701 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-74153fd1-559a-401c-a84a-92173f7bfb20 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:20:21.000349 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-74153fd1-559a-401c-a84a-92173f7bfb20 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: aab45346-7141-4c36-87fa-595222553df8] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:20:21.003121 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=2 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:20:21.008926 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-74153fd1-559a-401c-a84a-92173f7bfb20 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:21.009456 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-74153fd1-559a-401c-a84a-92173f7bfb20 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:21.009906 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-74153fd1-559a-401c-a84a-92173f7bfb20 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:21.010617 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-74153fd1-559a-401c-a84a-92173f7bfb20 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:21.011105 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-74153fd1-559a-401c-a84a-92173f7bfb20 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:21.011540 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-74153fd1-559a-401c-a84a-92173f7bfb20 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:21.138581 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-74153fd1-559a-401c-a84a-92173f7bfb20 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:20:21.146301 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-74153fd1-559a-401c-a84a-92173f7bfb20 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/aab45346-7141-4c36-87fa-595222553df8" status: 200 len: 1202 microversion: 2.1 time: 0.150537 Oct 04 19:20:21.146873 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3150/6671] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:20:20 2022] GET /compute/v2.1/servers/aab45346-7141-4c36-87fa-595222553df8 => generated 1202 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:20:22.169703 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-d938f6f7-47b3-44a0-a95b-4e0ce0441d42 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:20:22.170313 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-d938f6f7-47b3-44a0-a95b-4e0ce0441d42 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: aab45346-7141-4c36-87fa-595222553df8] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:20:22.172309 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=2 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:20:22.173186 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=6 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:20:22.180922 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d938f6f7-47b3-44a0-a95b-4e0ce0441d42 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:22.181441 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d938f6f7-47b3-44a0-a95b-4e0ce0441d42 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:22.181891 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d938f6f7-47b3-44a0-a95b-4e0ce0441d42 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:22.182600 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d938f6f7-47b3-44a0-a95b-4e0ce0441d42 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:22.183066 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d938f6f7-47b3-44a0-a95b-4e0ce0441d42 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:22.183504 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d938f6f7-47b3-44a0-a95b-4e0ce0441d42 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:22.314027 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-d938f6f7-47b3-44a0-a95b-4e0ce0441d42 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:20:22.322289 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-d938f6f7-47b3-44a0-a95b-4e0ce0441d42 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/aab45346-7141-4c36-87fa-595222553df8" status: 200 len: 1202 microversion: 2.1 time: 0.156605 Oct 04 19:20:22.322879 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3522/6672] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:20:22 2022] GET /compute/v2.1/servers/aab45346-7141-4c36-87fa-595222553df8 => generated 1202 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:20:23.345963 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-9e0e0fdf-3c57-4995-8549-499246e93ff1 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:20:23.346587 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-9e0e0fdf-3c57-4995-8549-499246e93ff1 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: aab45346-7141-4c36-87fa-595222553df8] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:20:23.353779 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9e0e0fdf-3c57-4995-8549-499246e93ff1 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:23.354284 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9e0e0fdf-3c57-4995-8549-499246e93ff1 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:23.354718 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9e0e0fdf-3c57-4995-8549-499246e93ff1 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:23.355419 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9e0e0fdf-3c57-4995-8549-499246e93ff1 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:23.355879 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9e0e0fdf-3c57-4995-8549-499246e93ff1 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:23.356316 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9e0e0fdf-3c57-4995-8549-499246e93ff1 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:23.484016 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-9e0e0fdf-3c57-4995-8549-499246e93ff1 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:20:23.492572 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-9e0e0fdf-3c57-4995-8549-499246e93ff1 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/aab45346-7141-4c36-87fa-595222553df8" status: 200 len: 1202 microversion: 2.1 time: 0.150541 Oct 04 19:20:23.493225 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3151/6673] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:20:23 2022] GET /compute/v2.1/servers/aab45346-7141-4c36-87fa-595222553df8 => generated 1202 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:20:24.516160 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-209084f4-90b6-4ebd-b299-581ebaabe70d tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:20:24.516882 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-209084f4-90b6-4ebd-b299-581ebaabe70d tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: aab45346-7141-4c36-87fa-595222553df8] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:20:24.525104 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-209084f4-90b6-4ebd-b299-581ebaabe70d tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:24.525661 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-209084f4-90b6-4ebd-b299-581ebaabe70d tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:24.526145 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-209084f4-90b6-4ebd-b299-581ebaabe70d tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:24.526935 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-209084f4-90b6-4ebd-b299-581ebaabe70d tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:24.527446 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-209084f4-90b6-4ebd-b299-581ebaabe70d tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:24.527926 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-209084f4-90b6-4ebd-b299-581ebaabe70d tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:24.662482 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-209084f4-90b6-4ebd-b299-581ebaabe70d tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:20:24.670374 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-209084f4-90b6-4ebd-b299-581ebaabe70d tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/aab45346-7141-4c36-87fa-595222553df8" status: 200 len: 1202 microversion: 2.1 time: 0.158655 Oct 04 19:20:24.670951 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3523/6674] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:20:24 2022] GET /compute/v2.1/servers/aab45346-7141-4c36-87fa-595222553df8 => generated 1202 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:20:25.693536 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-4c7dd5d2-5e29-4960-a465-0b9fdb61fbbf tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:20:25.694411 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-4c7dd5d2-5e29-4960-a465-0b9fdb61fbbf tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: aab45346-7141-4c36-87fa-595222553df8] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:20:25.701325 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4c7dd5d2-5e29-4960-a465-0b9fdb61fbbf tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:25.701818 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4c7dd5d2-5e29-4960-a465-0b9fdb61fbbf tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:25.702262 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4c7dd5d2-5e29-4960-a465-0b9fdb61fbbf tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:25.702965 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4c7dd5d2-5e29-4960-a465-0b9fdb61fbbf tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:25.703424 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4c7dd5d2-5e29-4960-a465-0b9fdb61fbbf tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:25.703857 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4c7dd5d2-5e29-4960-a465-0b9fdb61fbbf tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:25.838765 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-4c7dd5d2-5e29-4960-a465-0b9fdb61fbbf tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:20:25.846948 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-4c7dd5d2-5e29-4960-a465-0b9fdb61fbbf tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/aab45346-7141-4c36-87fa-595222553df8" status: 200 len: 1202 microversion: 2.1 time: 0.157372 Oct 04 19:20:25.847471 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3152/6675] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:20:25 2022] GET /compute/v2.1/servers/aab45346-7141-4c36-87fa-595222553df8 => generated 1202 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:20:26.871166 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-cdb6c322-063a-4a43-ac97-a88d32c66bd8 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:20:26.871788 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-cdb6c322-063a-4a43-ac97-a88d32c66bd8 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: aab45346-7141-4c36-87fa-595222553df8] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:20:26.878889 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cdb6c322-063a-4a43-ac97-a88d32c66bd8 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:26.879389 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cdb6c322-063a-4a43-ac97-a88d32c66bd8 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:26.879840 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cdb6c322-063a-4a43-ac97-a88d32c66bd8 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:26.880543 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cdb6c322-063a-4a43-ac97-a88d32c66bd8 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:26.881123 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cdb6c322-063a-4a43-ac97-a88d32c66bd8 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:26.881565 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cdb6c322-063a-4a43-ac97-a88d32c66bd8 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:27.012853 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-cdb6c322-063a-4a43-ac97-a88d32c66bd8 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:20:27.020545 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-cdb6c322-063a-4a43-ac97-a88d32c66bd8 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/aab45346-7141-4c36-87fa-595222553df8" status: 200 len: 1202 microversion: 2.1 time: 0.153315 Oct 04 19:20:27.021135 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3524/6676] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:20:26 2022] GET /compute/v2.1/servers/aab45346-7141-4c36-87fa-595222553df8 => generated 1202 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:20:27.751545 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-a2dce909-4ef9-461c-a9d8-311a21de10fc req-2f6ad5b3-fe01-4b82-aeed-07e4ba3bdded service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aab45346-7141-4c36-87fa-595222553df8", "name": "network-vif-plugged", "status": "completed", "tag": "ae3cdc33-b130-4898-8aae-3ad281c9271e"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:20:27.762920 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-a2dce909-4ef9-461c-a9d8-311a21de10fc req-2f6ad5b3-fe01-4b82-aeed-07e4ba3bdded service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:27.763505 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-a2dce909-4ef9-461c-a9d8-311a21de10fc req-2f6ad5b3-fe01-4b82-aeed-07e4ba3bdded service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:27.763941 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-a2dce909-4ef9-461c-a9d8-311a21de10fc req-2f6ad5b3-fe01-4b82-aeed-07e4ba3bdded service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:27.776258 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-a2dce909-4ef9-461c-a9d8-311a21de10fc req-2f6ad5b3-fe01-4b82-aeed-07e4ba3bdded service nova] Creating event network-vif-plugged:ae3cdc33-b130-4898-8aae-3ad281c9271e for instance aab45346-7141-4c36-87fa-595222553df8 on n-h1-851028-13 Oct 04 19:20:27.781242 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-a2dce909-4ef9-461c-a9d8-311a21de10fc req-2f6ad5b3-fe01-4b82-aeed-07e4ba3bdded service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033378 Oct 04 19:20:27.782037 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3153/6677] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:20:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:20:28.044353 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-a38ca177-31c3-4b31-b972-0c0bf524d22f tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:20:28.044900 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-a38ca177-31c3-4b31-b972-0c0bf524d22f tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: aab45346-7141-4c36-87fa-595222553df8] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:20:28.052168 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a38ca177-31c3-4b31-b972-0c0bf524d22f tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:28.052661 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a38ca177-31c3-4b31-b972-0c0bf524d22f tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:28.053125 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a38ca177-31c3-4b31-b972-0c0bf524d22f tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:28.053838 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a38ca177-31c3-4b31-b972-0c0bf524d22f tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:28.054298 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a38ca177-31c3-4b31-b972-0c0bf524d22f tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:28.054766 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a38ca177-31c3-4b31-b972-0c0bf524d22f tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:28.188696 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-a38ca177-31c3-4b31-b972-0c0bf524d22f tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:20:28.196412 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-a38ca177-31c3-4b31-b972-0c0bf524d22f tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/aab45346-7141-4c36-87fa-595222553df8" status: 200 len: 1202 microversion: 2.1 time: 0.156086 Oct 04 19:20:28.196981 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3525/6678] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:20:28 2022] GET /compute/v2.1/servers/aab45346-7141-4c36-87fa-595222553df8 => generated 1202 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:20:29.221164 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-1d7db8fa-1b27-4e01-9781-ef80c9443143 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:20:29.221891 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-1d7db8fa-1b27-4e01-9781-ef80c9443143 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: aab45346-7141-4c36-87fa-595222553df8] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:20:29.228343 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1d7db8fa-1b27-4e01-9781-ef80c9443143 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:29.228824 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1d7db8fa-1b27-4e01-9781-ef80c9443143 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:29.229295 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1d7db8fa-1b27-4e01-9781-ef80c9443143 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:29.230018 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1d7db8fa-1b27-4e01-9781-ef80c9443143 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:29.230470 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1d7db8fa-1b27-4e01-9781-ef80c9443143 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:29.230898 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1d7db8fa-1b27-4e01-9781-ef80c9443143 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:29.360024 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-1d7db8fa-1b27-4e01-9781-ef80c9443143 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:20:29.367856 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-1d7db8fa-1b27-4e01-9781-ef80c9443143 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/aab45346-7141-4c36-87fa-595222553df8" status: 200 len: 1388 microversion: 2.1 time: 0.151919 Oct 04 19:20:29.368436 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3154/6679] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:20:29 2022] GET /compute/v2.1/servers/aab45346-7141-4c36-87fa-595222553df8 => generated 1388 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:20:29.390448 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-e8bbf493-91f5-49c0-9b14-5eac8d0f3874 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:20:29.391072 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-e8bbf493-91f5-49c0-9b14-5eac8d0f3874 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: aab45346-7141-4c36-87fa-595222553df8] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:20:29.398618 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e8bbf493-91f5-49c0-9b14-5eac8d0f3874 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:29.399109 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e8bbf493-91f5-49c0-9b14-5eac8d0f3874 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:29.399556 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e8bbf493-91f5-49c0-9b14-5eac8d0f3874 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:29.400255 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e8bbf493-91f5-49c0-9b14-5eac8d0f3874 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:29.400717 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e8bbf493-91f5-49c0-9b14-5eac8d0f3874 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:29.401177 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e8bbf493-91f5-49c0-9b14-5eac8d0f3874 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:29.527481 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-e8bbf493-91f5-49c0-9b14-5eac8d0f3874 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:20:29.535383 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-e8bbf493-91f5-49c0-9b14-5eac8d0f3874 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/aab45346-7141-4c36-87fa-595222553df8" status: 200 len: 1388 microversion: 2.1 time: 0.148835 Oct 04 19:20:29.535958 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3526/6680] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:20:29 2022] GET /compute/v2.1/servers/aab45346-7141-4c36-87fa-595222553df8 => generated 1388 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:20:29.557567 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-30fd77b4-32cc-4b64-a425-3604c79fe40a tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:20:29.558111 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-30fd77b4-32cc-4b64-a425-3604c79fe40a tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: aab45346-7141-4c36-87fa-595222553df8] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:20:29.564320 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-30fd77b4-32cc-4b64-a425-3604c79fe40a tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:29.564825 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-30fd77b4-32cc-4b64-a425-3604c79fe40a tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:29.565339 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-30fd77b4-32cc-4b64-a425-3604c79fe40a tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:29.566043 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-30fd77b4-32cc-4b64-a425-3604c79fe40a tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:29.566504 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-30fd77b4-32cc-4b64-a425-3604c79fe40a tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:29.566938 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-30fd77b4-32cc-4b64-a425-3604c79fe40a tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:29.700540 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-30fd77b4-32cc-4b64-a425-3604c79fe40a tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:20:29.709025 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-30fd77b4-32cc-4b64-a425-3604c79fe40a tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/aab45346-7141-4c36-87fa-595222553df8" status: 200 len: 1388 microversion: 2.1 time: 0.155824 Oct 04 19:20:29.709760 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3155/6681] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:20:29 2022] GET /compute/v2.1/servers/aab45346-7141-4c36-87fa-595222553df8 => generated 1388 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:20:29.733774 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-96f42ec2-8029-45ef-9ada-3a1cddbcd302 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:20:29.734285 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-96f42ec2-8029-45ef-9ada-3a1cddbcd302 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: aab45346-7141-4c36-87fa-595222553df8] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:20:29.740410 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-96f42ec2-8029-45ef-9ada-3a1cddbcd302 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:29.741412 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-96f42ec2-8029-45ef-9ada-3a1cddbcd302 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:29.741865 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-96f42ec2-8029-45ef-9ada-3a1cddbcd302 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:29.742564 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-96f42ec2-8029-45ef-9ada-3a1cddbcd302 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:29.743027 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-96f42ec2-8029-45ef-9ada-3a1cddbcd302 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:29.743463 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-96f42ec2-8029-45ef-9ada-3a1cddbcd302 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:29.769350 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-96f42ec2-8029-45ef-9ada-3a1cddbcd302 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: aab45346-7141-4c36-87fa-595222553df8] Going to try to terminate instance {{(pid=123596) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 19:20:29.847832 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-96f42ec2-8029-45ef-9ada-3a1cddbcd302 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "DELETE /compute/v2.1/servers/aab45346-7141-4c36-87fa-595222553df8" status: 204 len: 0 microversion: 2.1 time: 0.117763 Oct 04 19:20:29.848464 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3527/6682] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 19:20:29 2022] DELETE /compute/v2.1/servers/aab45346-7141-4c36-87fa-595222553df8 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:20:29.858597 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-6e4f049b-1d96-4e40-92c3-973651a7b530 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:20:29.859217 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-6e4f049b-1d96-4e40-92c3-973651a7b530 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: aab45346-7141-4c36-87fa-595222553df8] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:20:29.865158 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6e4f049b-1d96-4e40-92c3-973651a7b530 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:29.865644 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6e4f049b-1d96-4e40-92c3-973651a7b530 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:29.866735 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6e4f049b-1d96-4e40-92c3-973651a7b530 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:29.867421 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6e4f049b-1d96-4e40-92c3-973651a7b530 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:29.867874 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6e4f049b-1d96-4e40-92c3-973651a7b530 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:29.868300 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6e4f049b-1d96-4e40-92c3-973651a7b530 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:29.997793 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-6e4f049b-1d96-4e40-92c3-973651a7b530 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:20:30.005569 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-6e4f049b-1d96-4e40-92c3-973651a7b530 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/aab45346-7141-4c36-87fa-595222553df8" status: 200 len: 1394 microversion: 2.1 time: 0.150850 Oct 04 19:20:30.006147 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3156/6683] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:20:29 2022] GET /compute/v2.1/servers/aab45346-7141-4c36-87fa-595222553df8 => generated 1394 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:20:31.028981 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-29fc02ef-6019-4ac3-9eab-a32d5ad6e748 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:20:31.029722 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-29fc02ef-6019-4ac3-9eab-a32d5ad6e748 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: aab45346-7141-4c36-87fa-595222553df8] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:20:31.036576 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-29fc02ef-6019-4ac3-9eab-a32d5ad6e748 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:31.037061 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-29fc02ef-6019-4ac3-9eab-a32d5ad6e748 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:31.037538 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-29fc02ef-6019-4ac3-9eab-a32d5ad6e748 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:31.038881 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-29fc02ef-6019-4ac3-9eab-a32d5ad6e748 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:31.039386 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-29fc02ef-6019-4ac3-9eab-a32d5ad6e748 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:31.039771 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-29fc02ef-6019-4ac3-9eab-a32d5ad6e748 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:31.175549 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-29fc02ef-6019-4ac3-9eab-a32d5ad6e748 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:20:31.183504 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-29fc02ef-6019-4ac3-9eab-a32d5ad6e748 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/aab45346-7141-4c36-87fa-595222553df8" status: 200 len: 1394 microversion: 2.1 time: 0.158841 Oct 04 19:20:31.184079 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3528/6684] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:20:31 2022] GET /compute/v2.1/servers/aab45346-7141-4c36-87fa-595222553df8 => generated 1394 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:20:31.887221 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-bc09ba82-5f77-4cc2-b2eb-55866a5a297f req-cd903b23-9e65-416c-a44f-7a014c86a87d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aab45346-7141-4c36-87fa-595222553df8", "name": "network-vif-deleted", "tag": "ae3cdc33-b130-4898-8aae-3ad281c9271e"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:20:31.902684 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-bc09ba82-5f77-4cc2-b2eb-55866a5a297f req-cd903b23-9e65-416c-a44f-7a014c86a87d service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:31.903309 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-bc09ba82-5f77-4cc2-b2eb-55866a5a297f req-cd903b23-9e65-416c-a44f-7a014c86a87d service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:31.903827 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-bc09ba82-5f77-4cc2-b2eb-55866a5a297f req-cd903b23-9e65-416c-a44f-7a014c86a87d service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:31.919890 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-bc09ba82-5f77-4cc2-b2eb-55866a5a297f req-cd903b23-9e65-416c-a44f-7a014c86a87d service nova] Creating event network-vif-deleted:ae3cdc33-b130-4898-8aae-3ad281c9271e for instance aab45346-7141-4c36-87fa-595222553df8 on n-h1-851028-13 Oct 04 19:20:31.925775 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-bc09ba82-5f77-4cc2-b2eb-55866a5a297f req-cd903b23-9e65-416c-a44f-7a014c86a87d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045389 Oct 04 19:20:31.926975 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3157/6685] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:20:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:20:32.206980 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-a22b6f1d-67b2-4672-9d8c-6609a235ae0c tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:20:32.207528 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-a22b6f1d-67b2-4672-9d8c-6609a235ae0c tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: aab45346-7141-4c36-87fa-595222553df8] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:20:32.215470 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a22b6f1d-67b2-4672-9d8c-6609a235ae0c tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:32.216001 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a22b6f1d-67b2-4672-9d8c-6609a235ae0c tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:32.216492 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a22b6f1d-67b2-4672-9d8c-6609a235ae0c tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:32.217296 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a22b6f1d-67b2-4672-9d8c-6609a235ae0c tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:32.217767 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a22b6f1d-67b2-4672-9d8c-6609a235ae0c tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:32.218205 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a22b6f1d-67b2-4672-9d8c-6609a235ae0c tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:32.280170 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-a22b6f1d-67b2-4672-9d8c-6609a235ae0c tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:20:32.288424 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-a22b6f1d-67b2-4672-9d8c-6609a235ae0c tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/aab45346-7141-4c36-87fa-595222553df8" status: 200 len: 1187 microversion: 2.1 time: 0.085538 Oct 04 19:20:32.289012 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3529/6686] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:20:32 2022] GET /compute/v2.1/servers/aab45346-7141-4c36-87fa-595222553df8 => generated 1187 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:20:33.312191 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-b579861e-d2cc-46b3-877c-4fd982ffcbd3 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:20:33.312822 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-b579861e-d2cc-46b3-877c-4fd982ffcbd3 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: aab45346-7141-4c36-87fa-595222553df8] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:20:33.321122 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b579861e-d2cc-46b3-877c-4fd982ffcbd3 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:33.321666 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b579861e-d2cc-46b3-877c-4fd982ffcbd3 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:33.322111 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b579861e-d2cc-46b3-877c-4fd982ffcbd3 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:33.322821 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b579861e-d2cc-46b3-877c-4fd982ffcbd3 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:33.323277 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b579861e-d2cc-46b3-877c-4fd982ffcbd3 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:33.323740 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b579861e-d2cc-46b3-877c-4fd982ffcbd3 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:33.387027 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-b579861e-d2cc-46b3-877c-4fd982ffcbd3 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:20:33.394944 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-b579861e-d2cc-46b3-877c-4fd982ffcbd3 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/aab45346-7141-4c36-87fa-595222553df8" status: 200 len: 1187 microversion: 2.1 time: 0.087133 Oct 04 19:20:33.395722 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3158/6687] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:20:33 2022] GET /compute/v2.1/servers/aab45346-7141-4c36-87fa-595222553df8 => generated 1187 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:20:34.418503 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-b1cf67e1-da29-447c-967b-c6ed490886a0 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:20:34.419302 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-b1cf67e1-da29-447c-967b-c6ed490886a0 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: aab45346-7141-4c36-87fa-595222553df8] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:20:34.426722 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b1cf67e1-da29-447c-967b-c6ed490886a0 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:34.427224 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b1cf67e1-da29-447c-967b-c6ed490886a0 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:34.427669 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b1cf67e1-da29-447c-967b-c6ed490886a0 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:34.428379 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b1cf67e1-da29-447c-967b-c6ed490886a0 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:34.428841 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b1cf67e1-da29-447c-967b-c6ed490886a0 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:34.429365 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b1cf67e1-da29-447c-967b-c6ed490886a0 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:34.495924 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-b1cf67e1-da29-447c-967b-c6ed490886a0 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:20:34.504065 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-b1cf67e1-da29-447c-967b-c6ed490886a0 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/aab45346-7141-4c36-87fa-595222553df8" status: 200 len: 1187 microversion: 2.1 time: 0.090284 Oct 04 19:20:34.504643 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3530/6688] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:20:34 2022] GET /compute/v2.1/servers/aab45346-7141-4c36-87fa-595222553df8 => generated 1187 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:20:35.526809 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-06291a0f-1709-480d-9194-aedfa0120169 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:20:35.527326 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-06291a0f-1709-480d-9194-aedfa0120169 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: aab45346-7141-4c36-87fa-595222553df8] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:20:35.534255 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-06291a0f-1709-480d-9194-aedfa0120169 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:35.534739 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-06291a0f-1709-480d-9194-aedfa0120169 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:35.535179 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-06291a0f-1709-480d-9194-aedfa0120169 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:35.535867 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-06291a0f-1709-480d-9194-aedfa0120169 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:35.536320 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-06291a0f-1709-480d-9194-aedfa0120169 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:35.536746 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-06291a0f-1709-480d-9194-aedfa0120169 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:35.602203 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-06291a0f-1709-480d-9194-aedfa0120169 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:20:35.611477 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-06291a0f-1709-480d-9194-aedfa0120169 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/aab45346-7141-4c36-87fa-595222553df8" status: 200 len: 1187 microversion: 2.1 time: 0.088311 Oct 04 19:20:35.612369 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3159/6689] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:20:35 2022] GET /compute/v2.1/servers/aab45346-7141-4c36-87fa-595222553df8 => generated 1187 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:20:36.635820 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-62972dc0-af6c-4c74-b3b7-04e197313b31 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:20:36.636442 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-62972dc0-af6c-4c74-b3b7-04e197313b31 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: aab45346-7141-4c36-87fa-595222553df8] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:20:36.643326 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-62972dc0-af6c-4c74-b3b7-04e197313b31 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:36.643851 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-62972dc0-af6c-4c74-b3b7-04e197313b31 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:36.644299 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-62972dc0-af6c-4c74-b3b7-04e197313b31 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:36.645003 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-62972dc0-af6c-4c74-b3b7-04e197313b31 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:36.645490 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-62972dc0-af6c-4c74-b3b7-04e197313b31 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:36.645927 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-62972dc0-af6c-4c74-b3b7-04e197313b31 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:36.659895 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-62972dc0-af6c-4c74-b3b7-04e197313b31 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] HTTP exception thrown: Instance aab45346-7141-4c36-87fa-595222553df8 could not be found. Oct 04 19:20:36.661602 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-62972dc0-af6c-4c74-b3b7-04e197313b31 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Request method failure captured: Oct 04 19:20:36.661602 n-d-851028-13 devstack@n-api.service[123596]: request: GET /compute/v2.1/servers/aab45346-7141-4c36-87fa-595222553df8 HTTP/1.1 Oct 04 19:20:36.661602 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 19:20:36.661602 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 19:20:36.661602 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 19:20:36.661602 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 19:20:36.661602 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 19:20:36.661602 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 19:20:36.661602 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 19:20:36.661602 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 19:20:36.661602 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPIdD9eu-sNppZso9GBgF0qiQcNSNfbptUObqTJdNMmQeJtmiNalN1HCCgoRlIsnKAnm3yDfemx5F9JCBtqQ5VFIZ41axYIUJNVoTUZoGs-EEXp4RLTVvMn1M_mAUAx-w46wS7k3RPeCrtItzG8FEbUjMK8RLhn-Xr_i-jB7aqW9aWok Oct 04 19:20:36.661602 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 19:20:36.661602 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 19:20:36.661602 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 19:20:36.661602 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 19:20:36.661602 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 19:20:36.661602 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 19:20:36.661602 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: 9cd28590bda749c5aa109ae292cb32e6 Oct 04 19:20:36.661602 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-TestVolumeBootPattern-410499789 Oct 04 19:20:36.661602 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 19:20:36.661602 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 19:20:36.661602 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/9cd28590bda749c5aa109ae292cb32e6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_9cd28590bda749c5aa109ae292cb32e6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/9cd28590bda749c5aa109ae292cb32e6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/9cd28590bda749c5aa109ae292cb32e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 19:20:36.661602 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-TestVolumeBootPattern-410499789 Oct 04 19:20:36.661602 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: 9cd28590bda749c5aa109ae292cb32e6 Oct 04 19:20:36.661602 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-TestVolumeBootPattern-410499789 Oct 04 19:20:36.661602 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-TestVolumeBootPattern-410499789-project Oct 04 19:20:36.661602 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 19:20:36.661602 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 19:20:36.661602 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 43efdccf8e2f4934ae5cfe3da828511e Oct 04 19:20:36.661602 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-TestVolumeBootPattern-410499789-project Oct 04 19:20:36.661602 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 19:20:36.661602 n-d-851028-13 devstack@n-api.service[123596]: exception: Instance aab45346-7141-4c36-87fa-595222553df8 could not be found. Oct 04 19:20:36.661602 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': 'aab45346-7141-4c36-87fa-595222553df8'} Oct 04 19:20:36.661602 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:20:36.661602 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:20:36.661602 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:20:36.661602 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:20:36.661602 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:20:36.661602 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:20:36.661602 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:20:36.661602 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:20:36.661602 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:20:36.661602 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:20:36.661602 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aab45346-7141-4c36-87fa-595222553df8 could not be found. Oct 04 19:20:36.661602 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:20:36.661602 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:20:36.661602 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:20:36.661602 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:20:36.661602 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:20:36.661602 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:20:36.661602 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:20:36.661602 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:20:36.661602 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:20:36.661602 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:20:36.661602 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:20:36.661602 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:20:36.661602 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:20:36.661602 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:20:36.661602 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:20:36.661602 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:20:36.661602 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aab45346-7141-4c36-87fa-595222553df8 could not be found. Oct 04 19:20:36.661602 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:20:36.661602 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:20:36.661602 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:20:36.666436 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:20:36.666436 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:20:36.666436 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:20:36.666436 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:20:36.666436 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:20:36.666436 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aab45346-7141-4c36-87fa-595222553df8 could not be found. Oct 04 19:20:36.666436 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:20:36.666436 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-62972dc0-af6c-4c74-b3b7-04e197313b31 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Returning 404 to user: Instance aab45346-7141-4c36-87fa-595222553df8 could not be found. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:20:36.666436 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-62972dc0-af6c-4c74-b3b7-04e197313b31 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/aab45346-7141-4c36-87fa-595222553df8" status: 404 len: 111 microversion: 2.1 time: 0.031695 Oct 04 19:20:36.666436 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3531/6690] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:20:36 2022] GET /compute/v2.1/servers/aab45346-7141-4c36-87fa-595222553df8 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:20:57.626372 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-09d5695f-1274-4d52-bacb-620aae8cbc35 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-260194761", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "bdf01c41-6ef0-4873-a3e4-055c672907b8", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "2ddfee4a-681a-4b64-a4ab-40481cf11577"}]}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:20:57.636441 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_api:SELECT=31 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:20:57.637344 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=75 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:20:57.715269 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.network.neutron [None req-09d5695f-1274-4d52-bacb-620aae8cbc35 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] validate_networks() for [('2ddfee4a-681a-4b64-a4ab-40481cf11577', None, None, None, None, None)] {{(pid=123595) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 19:20:58.129396 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-09d5695f-1274-4d52-bacb-620aae8cbc35 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Flavor limits 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:20:58.129836 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-09d5695f-1274-4d52-bacb-620aae8cbc35 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Image limits 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:20:58.130319 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-09d5695f-1274-4d52-bacb-620aae8cbc35 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Flavor pref 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:20:58.130739 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-09d5695f-1274-4d52-bacb-620aae8cbc35 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Image pref 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:20:58.131160 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-09d5695f-1274-4d52-bacb-620aae8cbc35 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:20:58.140085 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-09d5695f-1274-4d52-bacb-620aae8cbc35 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:58.140572 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-09d5695f-1274-4d52-bacb-620aae8cbc35 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:58.141017 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-09d5695f-1274-4d52-bacb-620aae8cbc35 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:58.141785 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-09d5695f-1274-4d52-bacb-620aae8cbc35 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:58.142250 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-09d5695f-1274-4d52-bacb-620aae8cbc35 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:58.142686 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-09d5695f-1274-4d52-bacb-620aae8cbc35 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:58.160009 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-09d5695f-1274-4d52-bacb-620aae8cbc35 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Getting quotas for project 9cd28590bda749c5aa109ae292cb32e6. Resources: {'ram', 'cores', 'instances'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:20:58.166079 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-09d5695f-1274-4d52-bacb-620aae8cbc35 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Getting quotas for user 43efdccf8e2f4934ae5cfe3da828511e and project 9cd28590bda749c5aa109ae292cb32e6. Resources: {'ram', 'cores', 'instances'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:20:58.178705 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-09d5695f-1274-4d52-bacb-620aae8cbc35 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Going to run 1 instances... {{(pid=123595) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 19:20:58.180795 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-09d5695f-1274-4d52-bacb-620aae8cbc35 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: 45f4a08c-c1bc-4a72-bee0-776dd2c4987f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='bdf01c41-6ef0-4873-a3e4-055c672907b8',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 19:20:58.254035 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-09d5695f-1274-4d52-bacb-620aae8cbc35 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.631924 Oct 04 19:20:58.254780 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3160/6691] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 19:20:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 633 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 19:20:58.266144 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-467ce083-17c4-4c7d-93d3-2013c332e570 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:20:58.266806 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-467ce083-17c4-4c7d-93d3-2013c332e570 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: 45f4a08c-c1bc-4a72-bee0-776dd2c4987f] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:20:58.269398 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:20:58.270213 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:20:58.327292 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-467ce083-17c4-4c7d-93d3-2013c332e570 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:20:58.334160 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-467ce083-17c4-4c7d-93d3-2013c332e570 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/45f4a08c-c1bc-4a72-bee0-776dd2c4987f" status: 200 len: 1056 microversion: 2.1 time: 0.071887 Oct 04 19:20:58.334758 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3532/6692] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:20:58 2022] GET /compute/v2.1/servers/45f4a08c-c1bc-4a72-bee0-776dd2c4987f => generated 1056 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:20:59.358235 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-c2844b31-d81e-4a3b-b0f2-55d7d919a504 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:20:59.359493 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-c2844b31-d81e-4a3b-b0f2-55d7d919a504 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: 45f4a08c-c1bc-4a72-bee0-776dd2c4987f] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:20:59.367672 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c2844b31-d81e-4a3b-b0f2-55d7d919a504 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:59.368158 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c2844b31-d81e-4a3b-b0f2-55d7d919a504 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:59.368597 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c2844b31-d81e-4a3b-b0f2-55d7d919a504 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:59.369335 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c2844b31-d81e-4a3b-b0f2-55d7d919a504 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:59.369794 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c2844b31-d81e-4a3b-b0f2-55d7d919a504 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:59.370220 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c2844b31-d81e-4a3b-b0f2-55d7d919a504 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:59.435063 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-c2844b31-d81e-4a3b-b0f2-55d7d919a504 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:20:59.442892 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-c2844b31-d81e-4a3b-b0f2-55d7d919a504 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/45f4a08c-c1bc-4a72-bee0-776dd2c4987f" status: 200 len: 1126 microversion: 2.1 time: 0.088442 Oct 04 19:20:59.443691 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3161/6693] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:20:59 2022] GET /compute/v2.1/servers/45f4a08c-c1bc-4a72-bee0-776dd2c4987f => generated 1126 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:21:00.471203 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-fff1ee57-70d3-434a-b94b-4a340f3e4022 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:21:00.471918 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-fff1ee57-70d3-434a-b94b-4a340f3e4022 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: 45f4a08c-c1bc-4a72-bee0-776dd2c4987f] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:21:00.482515 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fff1ee57-70d3-434a-b94b-4a340f3e4022 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:00.483218 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fff1ee57-70d3-434a-b94b-4a340f3e4022 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:00.483671 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fff1ee57-70d3-434a-b94b-4a340f3e4022 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:00.484582 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fff1ee57-70d3-434a-b94b-4a340f3e4022 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:00.485054 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fff1ee57-70d3-434a-b94b-4a340f3e4022 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:00.485733 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fff1ee57-70d3-434a-b94b-4a340f3e4022 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:00.676227 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-fff1ee57-70d3-434a-b94b-4a340f3e4022 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:21:00.685986 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-fff1ee57-70d3-434a-b94b-4a340f3e4022 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/45f4a08c-c1bc-4a72-bee0-776dd2c4987f" status: 200 len: 1168 microversion: 2.1 time: 0.223623 Oct 04 19:21:00.687026 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3533/6694] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:21:00 2022] GET /compute/v2.1/servers/45f4a08c-c1bc-4a72-bee0-776dd2c4987f => generated 1168 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:21:00.765818 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-6a435c5f-8d25-4f76-8186-6fc26083d37e req-d2ef898a-6793-4242-872f-2f1754304f57 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45f4a08c-c1bc-4a72-bee0-776dd2c4987f", "tag": "a357c0fc-62d7-41ad-9702-54a7497b4120"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:21:00.787452 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-6a435c5f-8d25-4f76-8186-6fc26083d37e req-d2ef898a-6793-4242-872f-2f1754304f57 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:00.788625 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-6a435c5f-8d25-4f76-8186-6fc26083d37e req-d2ef898a-6793-4242-872f-2f1754304f57 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:00.789178 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-6a435c5f-8d25-4f76-8186-6fc26083d37e req-d2ef898a-6793-4242-872f-2f1754304f57 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:00.801482 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-6a435c5f-8d25-4f76-8186-6fc26083d37e req-d2ef898a-6793-4242-872f-2f1754304f57 service nova] Creating event network-changed:a357c0fc-62d7-41ad-9702-54a7497b4120 for instance 45f4a08c-c1bc-4a72-bee0-776dd2c4987f on n-h1-851028-13 Oct 04 19:21:00.810840 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-6a435c5f-8d25-4f76-8186-6fc26083d37e req-d2ef898a-6793-4242-872f-2f1754304f57 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050097 Oct 04 19:21:00.811903 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3162/6695] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:21:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:21:01.717956 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-004ca7e9-9e39-494e-b87d-e891126cf59f tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:21:01.719338 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-004ca7e9-9e39-494e-b87d-e891126cf59f tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: 45f4a08c-c1bc-4a72-bee0-776dd2c4987f] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:21:01.733162 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-004ca7e9-9e39-494e-b87d-e891126cf59f tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:01.734402 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-004ca7e9-9e39-494e-b87d-e891126cf59f tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:01.734883 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-004ca7e9-9e39-494e-b87d-e891126cf59f tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:01.735716 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-004ca7e9-9e39-494e-b87d-e891126cf59f tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:01.736358 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-004ca7e9-9e39-494e-b87d-e891126cf59f tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:01.736966 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-004ca7e9-9e39-494e-b87d-e891126cf59f tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:01.880806 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-004ca7e9-9e39-494e-b87d-e891126cf59f tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:21:01.890525 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-004ca7e9-9e39-494e-b87d-e891126cf59f tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/45f4a08c-c1bc-4a72-bee0-776dd2c4987f" status: 200 len: 1168 microversion: 2.1 time: 0.186370 Oct 04 19:21:01.891129 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3534/6696] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:21:01 2022] GET /compute/v2.1/servers/45f4a08c-c1bc-4a72-bee0-776dd2c4987f => generated 1168 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:21:02.918695 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-6277aea5-a9fc-47fa-9fe0-8f541ddfbc12 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:21:02.920845 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-6277aea5-a9fc-47fa-9fe0-8f541ddfbc12 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: 45f4a08c-c1bc-4a72-bee0-776dd2c4987f] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:21:02.933428 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6277aea5-a9fc-47fa-9fe0-8f541ddfbc12 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:02.934308 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6277aea5-a9fc-47fa-9fe0-8f541ddfbc12 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:02.935098 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6277aea5-a9fc-47fa-9fe0-8f541ddfbc12 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:02.936823 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6277aea5-a9fc-47fa-9fe0-8f541ddfbc12 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:02.937293 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6277aea5-a9fc-47fa-9fe0-8f541ddfbc12 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:02.937868 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6277aea5-a9fc-47fa-9fe0-8f541ddfbc12 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:03.135850 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-6277aea5-a9fc-47fa-9fe0-8f541ddfbc12 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:21:03.145706 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-6277aea5-a9fc-47fa-9fe0-8f541ddfbc12 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/45f4a08c-c1bc-4a72-bee0-776dd2c4987f" status: 200 len: 1168 microversion: 2.1 time: 0.234384 Oct 04 19:21:03.153195 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3163/6697] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:21:02 2022] GET /compute/v2.1/servers/45f4a08c-c1bc-4a72-bee0-776dd2c4987f => generated 1168 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:21:04.188863 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-02046c80-d573-439e-ac36-7af91ff39ffd tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:21:04.191203 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-02046c80-d573-439e-ac36-7af91ff39ffd tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: 45f4a08c-c1bc-4a72-bee0-776dd2c4987f] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:21:04.208568 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-02046c80-d573-439e-ac36-7af91ff39ffd tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:04.212159 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-02046c80-d573-439e-ac36-7af91ff39ffd tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:04.212904 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-02046c80-d573-439e-ac36-7af91ff39ffd tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:04.215124 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-02046c80-d573-439e-ac36-7af91ff39ffd tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:04.215124 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-02046c80-d573-439e-ac36-7af91ff39ffd tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:04.216717 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-02046c80-d573-439e-ac36-7af91ff39ffd tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:04.466789 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-02046c80-d573-439e-ac36-7af91ff39ffd tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:21:04.480256 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-02046c80-d573-439e-ac36-7af91ff39ffd tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/45f4a08c-c1bc-4a72-bee0-776dd2c4987f" status: 200 len: 1168 microversion: 2.1 time: 0.303788 Oct 04 19:21:04.493142 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3535/6698] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:21:04 2022] GET /compute/v2.1/servers/45f4a08c-c1bc-4a72-bee0-776dd2c4987f => generated 1168 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:21:05.508481 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-6cadd421-d00b-4a12-942a-bfddf093fe7a tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:21:05.509203 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-6cadd421-d00b-4a12-942a-bfddf093fe7a tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: 45f4a08c-c1bc-4a72-bee0-776dd2c4987f] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:21:05.516293 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6cadd421-d00b-4a12-942a-bfddf093fe7a tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:05.516976 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6cadd421-d00b-4a12-942a-bfddf093fe7a tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:05.517481 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6cadd421-d00b-4a12-942a-bfddf093fe7a tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:05.518146 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6cadd421-d00b-4a12-942a-bfddf093fe7a tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:05.518815 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6cadd421-d00b-4a12-942a-bfddf093fe7a tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:05.519253 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6cadd421-d00b-4a12-942a-bfddf093fe7a tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:05.725478 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-6cadd421-d00b-4a12-942a-bfddf093fe7a tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:21:05.738149 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-6cadd421-d00b-4a12-942a-bfddf093fe7a tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/45f4a08c-c1bc-4a72-bee0-776dd2c4987f" status: 200 len: 1168 microversion: 2.1 time: 0.233780 Oct 04 19:21:05.738740 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3164/6699] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:21:05 2022] GET /compute/v2.1/servers/45f4a08c-c1bc-4a72-bee0-776dd2c4987f => generated 1168 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:21:06.766532 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-58bae2df-515a-4366-b456-f776e0e0d1c9 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:21:06.767233 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-58bae2df-515a-4366-b456-f776e0e0d1c9 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: 45f4a08c-c1bc-4a72-bee0-776dd2c4987f] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:21:06.774729 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-58bae2df-515a-4366-b456-f776e0e0d1c9 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:06.775256 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-58bae2df-515a-4366-b456-f776e0e0d1c9 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:06.775699 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-58bae2df-515a-4366-b456-f776e0e0d1c9 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:06.776595 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-58bae2df-515a-4366-b456-f776e0e0d1c9 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:06.777055 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-58bae2df-515a-4366-b456-f776e0e0d1c9 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:06.777535 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-58bae2df-515a-4366-b456-f776e0e0d1c9 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:06.917615 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-58bae2df-515a-4366-b456-f776e0e0d1c9 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:21:06.925488 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-58bae2df-515a-4366-b456-f776e0e0d1c9 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/45f4a08c-c1bc-4a72-bee0-776dd2c4987f" status: 200 len: 1168 microversion: 2.1 time: 0.163609 Oct 04 19:21:06.929271 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3536/6700] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:21:06 2022] GET /compute/v2.1/servers/45f4a08c-c1bc-4a72-bee0-776dd2c4987f => generated 1168 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:21:07.949343 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-171b795a-4481-40f0-8258-8eb6e25b5d90 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:21:07.949956 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-171b795a-4481-40f0-8258-8eb6e25b5d90 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: 45f4a08c-c1bc-4a72-bee0-776dd2c4987f] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:21:07.957067 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-171b795a-4481-40f0-8258-8eb6e25b5d90 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:07.957618 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-171b795a-4481-40f0-8258-8eb6e25b5d90 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:07.958069 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-171b795a-4481-40f0-8258-8eb6e25b5d90 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:07.958782 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-171b795a-4481-40f0-8258-8eb6e25b5d90 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:07.959246 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-171b795a-4481-40f0-8258-8eb6e25b5d90 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:07.959685 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-171b795a-4481-40f0-8258-8eb6e25b5d90 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:08.091154 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-171b795a-4481-40f0-8258-8eb6e25b5d90 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:21:08.098901 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-171b795a-4481-40f0-8258-8eb6e25b5d90 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/45f4a08c-c1bc-4a72-bee0-776dd2c4987f" status: 200 len: 1168 microversion: 2.1 time: 0.153511 Oct 04 19:21:08.099479 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3165/6701] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:21:07 2022] GET /compute/v2.1/servers/45f4a08c-c1bc-4a72-bee0-776dd2c4987f => generated 1168 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:21:09.122937 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-e288e301-1c6f-470a-ba98-a25973a57b44 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:21:09.124144 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-e288e301-1c6f-470a-ba98-a25973a57b44 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: 45f4a08c-c1bc-4a72-bee0-776dd2c4987f] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:21:09.127138 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=2 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:21:09.133751 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e288e301-1c6f-470a-ba98-a25973a57b44 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:09.134250 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e288e301-1c6f-470a-ba98-a25973a57b44 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:09.134692 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e288e301-1c6f-470a-ba98-a25973a57b44 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:09.135397 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e288e301-1c6f-470a-ba98-a25973a57b44 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:09.135853 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e288e301-1c6f-470a-ba98-a25973a57b44 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:09.136281 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e288e301-1c6f-470a-ba98-a25973a57b44 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:09.276536 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-e288e301-1c6f-470a-ba98-a25973a57b44 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:21:09.284776 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-e288e301-1c6f-470a-ba98-a25973a57b44 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/45f4a08c-c1bc-4a72-bee0-776dd2c4987f" status: 200 len: 1168 microversion: 2.1 time: 0.165689 Oct 04 19:21:09.297137 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3537/6702] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:21:09 2022] GET /compute/v2.1/servers/45f4a08c-c1bc-4a72-bee0-776dd2c4987f => generated 1168 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:21:10.307752 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-7b4a86f4-93c2-4ace-95c0-e292b170b6d4 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:21:10.308329 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-7b4a86f4-93c2-4ace-95c0-e292b170b6d4 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: 45f4a08c-c1bc-4a72-bee0-776dd2c4987f] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:21:10.310416 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=2 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:21:10.311094 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=6 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:21:10.317307 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7b4a86f4-93c2-4ace-95c0-e292b170b6d4 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:10.318095 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7b4a86f4-93c2-4ace-95c0-e292b170b6d4 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:10.318636 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7b4a86f4-93c2-4ace-95c0-e292b170b6d4 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:10.319919 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7b4a86f4-93c2-4ace-95c0-e292b170b6d4 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:10.320390 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7b4a86f4-93c2-4ace-95c0-e292b170b6d4 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:10.320828 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7b4a86f4-93c2-4ace-95c0-e292b170b6d4 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:10.467783 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-7b4a86f4-93c2-4ace-95c0-e292b170b6d4 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:21:10.476111 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-7b4a86f4-93c2-4ace-95c0-e292b170b6d4 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/45f4a08c-c1bc-4a72-bee0-776dd2c4987f" status: 200 len: 1168 microversion: 2.1 time: 0.172283 Oct 04 19:21:10.476707 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3166/6703] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:21:10 2022] GET /compute/v2.1/servers/45f4a08c-c1bc-4a72-bee0-776dd2c4987f => generated 1168 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:21:11.498459 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-2bf4c0d0-9477-4901-b8f7-55e5a373b288 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:21:11.499097 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-2bf4c0d0-9477-4901-b8f7-55e5a373b288 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: 45f4a08c-c1bc-4a72-bee0-776dd2c4987f] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:21:11.506241 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2bf4c0d0-9477-4901-b8f7-55e5a373b288 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:11.506755 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2bf4c0d0-9477-4901-b8f7-55e5a373b288 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:11.507174 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2bf4c0d0-9477-4901-b8f7-55e5a373b288 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:11.507879 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2bf4c0d0-9477-4901-b8f7-55e5a373b288 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:11.508330 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2bf4c0d0-9477-4901-b8f7-55e5a373b288 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:11.508757 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2bf4c0d0-9477-4901-b8f7-55e5a373b288 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:11.652399 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-2bf4c0d0-9477-4901-b8f7-55e5a373b288 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:21:11.660571 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-2bf4c0d0-9477-4901-b8f7-55e5a373b288 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/45f4a08c-c1bc-4a72-bee0-776dd2c4987f" status: 200 len: 1168 microversion: 2.1 time: 0.165993 Oct 04 19:21:11.661849 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3538/6704] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:21:11 2022] GET /compute/v2.1/servers/45f4a08c-c1bc-4a72-bee0-776dd2c4987f => generated 1168 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:21:12.684446 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-c6a23737-df1f-4eaa-b959-69b8b9e55c89 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:21:12.685186 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-c6a23737-df1f-4eaa-b959-69b8b9e55c89 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: 45f4a08c-c1bc-4a72-bee0-776dd2c4987f] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:21:12.692280 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c6a23737-df1f-4eaa-b959-69b8b9e55c89 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:12.692774 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c6a23737-df1f-4eaa-b959-69b8b9e55c89 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:12.693237 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c6a23737-df1f-4eaa-b959-69b8b9e55c89 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:12.693942 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c6a23737-df1f-4eaa-b959-69b8b9e55c89 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:12.694398 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c6a23737-df1f-4eaa-b959-69b8b9e55c89 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:12.694823 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c6a23737-df1f-4eaa-b959-69b8b9e55c89 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:12.836025 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-c6a23737-df1f-4eaa-b959-69b8b9e55c89 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:21:12.844752 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-c6a23737-df1f-4eaa-b959-69b8b9e55c89 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/45f4a08c-c1bc-4a72-bee0-776dd2c4987f" status: 200 len: 1168 microversion: 2.1 time: 0.164124 Oct 04 19:21:12.845373 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3167/6705] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:21:12 2022] GET /compute/v2.1/servers/45f4a08c-c1bc-4a72-bee0-776dd2c4987f => generated 1168 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:21:13.870546 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-ab256df2-6bad-46b9-b80a-14021969f68a tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:21:13.871553 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-ab256df2-6bad-46b9-b80a-14021969f68a tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: 45f4a08c-c1bc-4a72-bee0-776dd2c4987f] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:21:13.877983 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ab256df2-6bad-46b9-b80a-14021969f68a tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:13.878406 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ab256df2-6bad-46b9-b80a-14021969f68a tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:13.878904 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ab256df2-6bad-46b9-b80a-14021969f68a tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:13.879723 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ab256df2-6bad-46b9-b80a-14021969f68a tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:13.880192 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ab256df2-6bad-46b9-b80a-14021969f68a tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:13.880648 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ab256df2-6bad-46b9-b80a-14021969f68a tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:14.013981 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-ab256df2-6bad-46b9-b80a-14021969f68a tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:21:14.021948 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-ab256df2-6bad-46b9-b80a-14021969f68a tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/45f4a08c-c1bc-4a72-bee0-776dd2c4987f" status: 200 len: 1214 microversion: 2.1 time: 0.156293 Oct 04 19:21:14.022654 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3539/6706] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:21:13 2022] GET /compute/v2.1/servers/45f4a08c-c1bc-4a72-bee0-776dd2c4987f => generated 1214 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:21:15.045070 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-3f2d7aa6-ba12-4ced-ac92-b4ab4f250a91 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:21:15.045720 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-3f2d7aa6-ba12-4ced-ac92-b4ab4f250a91 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: 45f4a08c-c1bc-4a72-bee0-776dd2c4987f] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:21:15.053052 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3f2d7aa6-ba12-4ced-ac92-b4ab4f250a91 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:15.053581 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3f2d7aa6-ba12-4ced-ac92-b4ab4f250a91 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:15.054026 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3f2d7aa6-ba12-4ced-ac92-b4ab4f250a91 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:15.055160 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3f2d7aa6-ba12-4ced-ac92-b4ab4f250a91 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:15.055613 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3f2d7aa6-ba12-4ced-ac92-b4ab4f250a91 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:15.056056 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3f2d7aa6-ba12-4ced-ac92-b4ab4f250a91 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:15.199486 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-3f2d7aa6-ba12-4ced-ac92-b4ab4f250a91 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:21:15.207738 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-3f2d7aa6-ba12-4ced-ac92-b4ab4f250a91 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/45f4a08c-c1bc-4a72-bee0-776dd2c4987f" status: 200 len: 1202 microversion: 2.1 time: 0.166571 Oct 04 19:21:15.208462 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3168/6707] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:21:15 2022] GET /compute/v2.1/servers/45f4a08c-c1bc-4a72-bee0-776dd2c4987f => generated 1202 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:21:16.232334 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-517d3f0c-5fe7-4839-ac27-cf1111e839d7 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:21:16.232955 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-517d3f0c-5fe7-4839-ac27-cf1111e839d7 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: 45f4a08c-c1bc-4a72-bee0-776dd2c4987f] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:21:16.239924 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-517d3f0c-5fe7-4839-ac27-cf1111e839d7 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:16.240415 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-517d3f0c-5fe7-4839-ac27-cf1111e839d7 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:16.240864 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-517d3f0c-5fe7-4839-ac27-cf1111e839d7 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:16.241609 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-517d3f0c-5fe7-4839-ac27-cf1111e839d7 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:16.242067 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-517d3f0c-5fe7-4839-ac27-cf1111e839d7 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:16.242497 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-517d3f0c-5fe7-4839-ac27-cf1111e839d7 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:16.376125 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-517d3f0c-5fe7-4839-ac27-cf1111e839d7 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:21:16.384519 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-517d3f0c-5fe7-4839-ac27-cf1111e839d7 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/45f4a08c-c1bc-4a72-bee0-776dd2c4987f" status: 200 len: 1202 microversion: 2.1 time: 0.156056 Oct 04 19:21:16.385103 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3540/6708] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:21:16 2022] GET /compute/v2.1/servers/45f4a08c-c1bc-4a72-bee0-776dd2c4987f => generated 1202 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:21:17.407891 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-d46b28aa-b50a-4c9a-a6fd-5384fd24984a tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:21:17.408510 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-d46b28aa-b50a-4c9a-a6fd-5384fd24984a tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: 45f4a08c-c1bc-4a72-bee0-776dd2c4987f] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:21:17.415732 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d46b28aa-b50a-4c9a-a6fd-5384fd24984a tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:17.416225 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d46b28aa-b50a-4c9a-a6fd-5384fd24984a tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:17.416678 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d46b28aa-b50a-4c9a-a6fd-5384fd24984a tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:17.417435 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d46b28aa-b50a-4c9a-a6fd-5384fd24984a tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:17.417899 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d46b28aa-b50a-4c9a-a6fd-5384fd24984a tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:17.418335 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d46b28aa-b50a-4c9a-a6fd-5384fd24984a tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:17.570913 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-d46b28aa-b50a-4c9a-a6fd-5384fd24984a tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:21:17.579401 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-d46b28aa-b50a-4c9a-a6fd-5384fd24984a tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/45f4a08c-c1bc-4a72-bee0-776dd2c4987f" status: 200 len: 1202 microversion: 2.1 time: 0.175715 Oct 04 19:21:17.579933 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3169/6709] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:21:17 2022] GET /compute/v2.1/servers/45f4a08c-c1bc-4a72-bee0-776dd2c4987f => generated 1202 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:21:18.603685 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-790159a1-d95d-4403-9607-b6c88810b181 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:21:18.604368 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-790159a1-d95d-4403-9607-b6c88810b181 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: 45f4a08c-c1bc-4a72-bee0-776dd2c4987f] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:21:18.611738 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-790159a1-d95d-4403-9607-b6c88810b181 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:18.612311 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-790159a1-d95d-4403-9607-b6c88810b181 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:18.612768 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-790159a1-d95d-4403-9607-b6c88810b181 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:18.613629 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-790159a1-d95d-4403-9607-b6c88810b181 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:18.614063 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-790159a1-d95d-4403-9607-b6c88810b181 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:18.614504 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-790159a1-d95d-4403-9607-b6c88810b181 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:18.754490 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-790159a1-d95d-4403-9607-b6c88810b181 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:21:18.764745 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-790159a1-d95d-4403-9607-b6c88810b181 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/45f4a08c-c1bc-4a72-bee0-776dd2c4987f" status: 200 len: 1202 microversion: 2.1 time: 0.165088 Oct 04 19:21:18.765522 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3541/6710] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:21:18 2022] GET /compute/v2.1/servers/45f4a08c-c1bc-4a72-bee0-776dd2c4987f => generated 1202 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:21:19.789900 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-a4af896b-4e92-4dd2-90c8-f4723d20cef2 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:21:19.790549 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-a4af896b-4e92-4dd2-90c8-f4723d20cef2 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: 45f4a08c-c1bc-4a72-bee0-776dd2c4987f] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:21:19.797591 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a4af896b-4e92-4dd2-90c8-f4723d20cef2 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:19.798084 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a4af896b-4e92-4dd2-90c8-f4723d20cef2 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:19.798524 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a4af896b-4e92-4dd2-90c8-f4723d20cef2 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:19.799224 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a4af896b-4e92-4dd2-90c8-f4723d20cef2 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:19.799683 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a4af896b-4e92-4dd2-90c8-f4723d20cef2 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:19.800119 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a4af896b-4e92-4dd2-90c8-f4723d20cef2 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:19.935645 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-a4af896b-4e92-4dd2-90c8-f4723d20cef2 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:21:19.944275 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-a4af896b-4e92-4dd2-90c8-f4723d20cef2 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/45f4a08c-c1bc-4a72-bee0-776dd2c4987f" status: 200 len: 1202 microversion: 2.1 time: 0.158907 Oct 04 19:21:19.944925 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3170/6711] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:21:19 2022] GET /compute/v2.1/servers/45f4a08c-c1bc-4a72-bee0-776dd2c4987f => generated 1202 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:21:20.967863 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-776cb21c-f583-45e9-a680-a8c7a012f05e tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:21:20.968461 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-776cb21c-f583-45e9-a680-a8c7a012f05e tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: 45f4a08c-c1bc-4a72-bee0-776dd2c4987f] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:21:20.975504 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-776cb21c-f583-45e9-a680-a8c7a012f05e tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:20.976508 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-776cb21c-f583-45e9-a680-a8c7a012f05e tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:20.976947 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-776cb21c-f583-45e9-a680-a8c7a012f05e tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:20.977668 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-776cb21c-f583-45e9-a680-a8c7a012f05e tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:20.978123 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-776cb21c-f583-45e9-a680-a8c7a012f05e tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:20.978549 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-776cb21c-f583-45e9-a680-a8c7a012f05e tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:21.111668 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-776cb21c-f583-45e9-a680-a8c7a012f05e tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:21:21.120236 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-776cb21c-f583-45e9-a680-a8c7a012f05e tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/45f4a08c-c1bc-4a72-bee0-776dd2c4987f" status: 200 len: 1202 microversion: 2.1 time: 0.156316 Oct 04 19:21:21.120845 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3542/6712] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:21:20 2022] GET /compute/v2.1/servers/45f4a08c-c1bc-4a72-bee0-776dd2c4987f => generated 1202 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:21:22.142976 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-12ab8a2d-74db-4755-9fad-7fbebaa5706e tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:21:22.143595 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-12ab8a2d-74db-4755-9fad-7fbebaa5706e tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: 45f4a08c-c1bc-4a72-bee0-776dd2c4987f] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:21:22.150821 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-12ab8a2d-74db-4755-9fad-7fbebaa5706e tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:22.151312 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-12ab8a2d-74db-4755-9fad-7fbebaa5706e tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:22.151757 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-12ab8a2d-74db-4755-9fad-7fbebaa5706e tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:22.152461 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-12ab8a2d-74db-4755-9fad-7fbebaa5706e tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:22.152925 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-12ab8a2d-74db-4755-9fad-7fbebaa5706e tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:22.153385 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-12ab8a2d-74db-4755-9fad-7fbebaa5706e tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:22.293602 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-12ab8a2d-74db-4755-9fad-7fbebaa5706e tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:21:22.301377 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-12ab8a2d-74db-4755-9fad-7fbebaa5706e tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/45f4a08c-c1bc-4a72-bee0-776dd2c4987f" status: 200 len: 1202 microversion: 2.1 time: 0.162313 Oct 04 19:21:22.302411 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3171/6713] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:21:22 2022] GET /compute/v2.1/servers/45f4a08c-c1bc-4a72-bee0-776dd2c4987f => generated 1202 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:21:23.333559 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-c19459a0-772a-44ad-a953-98dd221924a0 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:21:23.334192 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-c19459a0-772a-44ad-a953-98dd221924a0 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: 45f4a08c-c1bc-4a72-bee0-776dd2c4987f] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:21:23.341716 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c19459a0-772a-44ad-a953-98dd221924a0 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:23.342748 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c19459a0-772a-44ad-a953-98dd221924a0 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:23.343331 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c19459a0-772a-44ad-a953-98dd221924a0 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:23.344444 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c19459a0-772a-44ad-a953-98dd221924a0 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:23.345094 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c19459a0-772a-44ad-a953-98dd221924a0 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:23.345810 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c19459a0-772a-44ad-a953-98dd221924a0 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:23.479827 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-c19459a0-772a-44ad-a953-98dd221924a0 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:21:23.487717 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-c19459a0-772a-44ad-a953-98dd221924a0 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/45f4a08c-c1bc-4a72-bee0-776dd2c4987f" status: 200 len: 1202 microversion: 2.1 time: 0.158190 Oct 04 19:21:23.488652 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3543/6714] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:21:23 2022] GET /compute/v2.1/servers/45f4a08c-c1bc-4a72-bee0-776dd2c4987f => generated 1202 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:21:24.010334 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-52a3f65b-c212-4f0b-8544-a206dd73c8be req-a2375a5c-5667-4579-87e8-3b55c0f4305c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45f4a08c-c1bc-4a72-bee0-776dd2c4987f", "name": "network-vif-plugged", "status": "completed", "tag": "a357c0fc-62d7-41ad-9702-54a7497b4120"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:21:24.021151 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-52a3f65b-c212-4f0b-8544-a206dd73c8be req-a2375a5c-5667-4579-87e8-3b55c0f4305c service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:24.021764 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-52a3f65b-c212-4f0b-8544-a206dd73c8be req-a2375a5c-5667-4579-87e8-3b55c0f4305c service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:24.022976 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-52a3f65b-c212-4f0b-8544-a206dd73c8be req-a2375a5c-5667-4579-87e8-3b55c0f4305c service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:24.034146 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-52a3f65b-c212-4f0b-8544-a206dd73c8be req-a2375a5c-5667-4579-87e8-3b55c0f4305c service nova] Creating event network-vif-plugged:a357c0fc-62d7-41ad-9702-54a7497b4120 for instance 45f4a08c-c1bc-4a72-bee0-776dd2c4987f on n-h1-851028-13 Oct 04 19:21:24.039478 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-52a3f65b-c212-4f0b-8544-a206dd73c8be req-a2375a5c-5667-4579-87e8-3b55c0f4305c service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033475 Oct 04 19:21:24.040217 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3172/6715] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:21:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:21:24.511093 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-4e7f3cc6-47be-47c6-b32e-c2cc81421db0 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:21:24.511640 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-4e7f3cc6-47be-47c6-b32e-c2cc81421db0 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: 45f4a08c-c1bc-4a72-bee0-776dd2c4987f] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:21:24.518559 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4e7f3cc6-47be-47c6-b32e-c2cc81421db0 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:24.519047 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4e7f3cc6-47be-47c6-b32e-c2cc81421db0 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:24.519698 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4e7f3cc6-47be-47c6-b32e-c2cc81421db0 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:24.520187 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4e7f3cc6-47be-47c6-b32e-c2cc81421db0 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:24.520639 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4e7f3cc6-47be-47c6-b32e-c2cc81421db0 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:24.521062 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4e7f3cc6-47be-47c6-b32e-c2cc81421db0 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:24.660114 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-4e7f3cc6-47be-47c6-b32e-c2cc81421db0 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:21:24.668023 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-4e7f3cc6-47be-47c6-b32e-c2cc81421db0 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/45f4a08c-c1bc-4a72-bee0-776dd2c4987f" status: 200 len: 1202 microversion: 2.1 time: 0.160930 Oct 04 19:21:24.668603 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3544/6716] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:21:24 2022] GET /compute/v2.1/servers/45f4a08c-c1bc-4a72-bee0-776dd2c4987f => generated 1202 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:21:25.692954 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-c548d83d-098c-4ee2-9167-b125d7949060 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:21:25.693771 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-c548d83d-098c-4ee2-9167-b125d7949060 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: 45f4a08c-c1bc-4a72-bee0-776dd2c4987f] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:21:25.700338 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c548d83d-098c-4ee2-9167-b125d7949060 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:25.700816 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c548d83d-098c-4ee2-9167-b125d7949060 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:25.701297 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c548d83d-098c-4ee2-9167-b125d7949060 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:25.701992 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c548d83d-098c-4ee2-9167-b125d7949060 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:25.702447 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c548d83d-098c-4ee2-9167-b125d7949060 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:25.702873 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c548d83d-098c-4ee2-9167-b125d7949060 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:25.832435 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-c548d83d-098c-4ee2-9167-b125d7949060 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:21:25.840979 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-c548d83d-098c-4ee2-9167-b125d7949060 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/45f4a08c-c1bc-4a72-bee0-776dd2c4987f" status: 200 len: 1389 microversion: 2.1 time: 0.153375 Oct 04 19:21:25.841590 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3173/6717] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:21:25 2022] GET /compute/v2.1/servers/45f4a08c-c1bc-4a72-bee0-776dd2c4987f => generated 1389 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:21:25.863767 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-6ff55bc6-f5df-430e-af6c-483e704feff0 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:21:25.864382 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-6ff55bc6-f5df-430e-af6c-483e704feff0 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: 45f4a08c-c1bc-4a72-bee0-776dd2c4987f] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:21:25.871441 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6ff55bc6-f5df-430e-af6c-483e704feff0 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:25.871932 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6ff55bc6-f5df-430e-af6c-483e704feff0 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:25.872376 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6ff55bc6-f5df-430e-af6c-483e704feff0 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:25.873073 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6ff55bc6-f5df-430e-af6c-483e704feff0 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:25.873573 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6ff55bc6-f5df-430e-af6c-483e704feff0 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:25.873998 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6ff55bc6-f5df-430e-af6c-483e704feff0 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:26.007673 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-6ff55bc6-f5df-430e-af6c-483e704feff0 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:21:26.015686 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-6ff55bc6-f5df-430e-af6c-483e704feff0 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/45f4a08c-c1bc-4a72-bee0-776dd2c4987f" status: 200 len: 1389 microversion: 2.1 time: 0.155797 Oct 04 19:21:26.016260 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3545/6718] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:21:25 2022] GET /compute/v2.1/servers/45f4a08c-c1bc-4a72-bee0-776dd2c4987f => generated 1389 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:21:26.038827 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-586003df-1232-4f13-9c22-e576114647e1 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:21:26.039437 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-586003df-1232-4f13-9c22-e576114647e1 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: 45f4a08c-c1bc-4a72-bee0-776dd2c4987f] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:21:26.045927 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-586003df-1232-4f13-9c22-e576114647e1 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:26.046417 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-586003df-1232-4f13-9c22-e576114647e1 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:26.046859 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-586003df-1232-4f13-9c22-e576114647e1 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:26.047560 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-586003df-1232-4f13-9c22-e576114647e1 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:26.048017 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-586003df-1232-4f13-9c22-e576114647e1 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:26.048447 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-586003df-1232-4f13-9c22-e576114647e1 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:26.178885 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-586003df-1232-4f13-9c22-e576114647e1 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:21:26.186911 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-586003df-1232-4f13-9c22-e576114647e1 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/45f4a08c-c1bc-4a72-bee0-776dd2c4987f" status: 200 len: 1389 microversion: 2.1 time: 0.152756 Oct 04 19:21:26.187525 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3174/6719] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:21:26 2022] GET /compute/v2.1/servers/45f4a08c-c1bc-4a72-bee0-776dd2c4987f => generated 1389 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:21:26.269930 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-45c4c60d-16ae-46f6-b76a-ffc926f4a0a3 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:21:26.270525 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-45c4c60d-16ae-46f6-b76a-ffc926f4a0a3 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: 45f4a08c-c1bc-4a72-bee0-776dd2c4987f] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:21:26.277511 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-45c4c60d-16ae-46f6-b76a-ffc926f4a0a3 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:26.277964 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-45c4c60d-16ae-46f6-b76a-ffc926f4a0a3 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:26.278771 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-45c4c60d-16ae-46f6-b76a-ffc926f4a0a3 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:26.279134 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-45c4c60d-16ae-46f6-b76a-ffc926f4a0a3 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:26.279574 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-45c4c60d-16ae-46f6-b76a-ffc926f4a0a3 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:26.280018 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-45c4c60d-16ae-46f6-b76a-ffc926f4a0a3 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:26.306149 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-45c4c60d-16ae-46f6-b76a-ffc926f4a0a3 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: 45f4a08c-c1bc-4a72-bee0-776dd2c4987f] Going to try to terminate instance {{(pid=123596) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 19:21:26.387659 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-45c4c60d-16ae-46f6-b76a-ffc926f4a0a3 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "DELETE /compute/v2.1/servers/45f4a08c-c1bc-4a72-bee0-776dd2c4987f" status: 204 len: 0 microversion: 2.1 time: 0.121359 Oct 04 19:21:26.388286 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3546/6720] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 19:21:26 2022] DELETE /compute/v2.1/servers/45f4a08c-c1bc-4a72-bee0-776dd2c4987f => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:21:26.397011 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-8d489f32-caeb-4400-8380-eddb5b6b6929 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:21:26.397655 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-8d489f32-caeb-4400-8380-eddb5b6b6929 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: 45f4a08c-c1bc-4a72-bee0-776dd2c4987f] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:21:26.403662 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8d489f32-caeb-4400-8380-eddb5b6b6929 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:26.404149 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8d489f32-caeb-4400-8380-eddb5b6b6929 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:26.404588 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8d489f32-caeb-4400-8380-eddb5b6b6929 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:26.405326 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8d489f32-caeb-4400-8380-eddb5b6b6929 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:26.405782 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8d489f32-caeb-4400-8380-eddb5b6b6929 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:26.406207 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8d489f32-caeb-4400-8380-eddb5b6b6929 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:26.540008 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-8d489f32-caeb-4400-8380-eddb5b6b6929 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:21:26.548057 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-8d489f32-caeb-4400-8380-eddb5b6b6929 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/45f4a08c-c1bc-4a72-bee0-776dd2c4987f" status: 200 len: 1395 microversion: 2.1 time: 0.155417 Oct 04 19:21:26.548590 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3175/6721] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:21:26 2022] GET /compute/v2.1/servers/45f4a08c-c1bc-4a72-bee0-776dd2c4987f => generated 1395 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:21:27.573051 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-167e1441-9ce1-4d83-af50-83d7f684ec5a tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:21:27.574045 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-167e1441-9ce1-4d83-af50-83d7f684ec5a tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: 45f4a08c-c1bc-4a72-bee0-776dd2c4987f] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:21:27.586135 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-167e1441-9ce1-4d83-af50-83d7f684ec5a tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:27.586624 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-167e1441-9ce1-4d83-af50-83d7f684ec5a tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:27.587068 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-167e1441-9ce1-4d83-af50-83d7f684ec5a tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:27.587786 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-167e1441-9ce1-4d83-af50-83d7f684ec5a tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:27.588295 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-167e1441-9ce1-4d83-af50-83d7f684ec5a tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:27.588719 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-167e1441-9ce1-4d83-af50-83d7f684ec5a tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:27.728651 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-167e1441-9ce1-4d83-af50-83d7f684ec5a tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:21:27.732387 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:21:27.738420 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-167e1441-9ce1-4d83-af50-83d7f684ec5a tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/45f4a08c-c1bc-4a72-bee0-776dd2c4987f" status: 200 len: 1395 microversion: 2.1 time: 0.170238 Oct 04 19:21:27.739155 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3547/6722] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:21:27 2022] GET /compute/v2.1/servers/45f4a08c-c1bc-4a72-bee0-776dd2c4987f => generated 1395 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:21:28.338731 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-35799a1c-a0fa-4e75-8d77-c28c6fba2b0b req-a6beb051-686b-407e-af06-9381ae550a6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45f4a08c-c1bc-4a72-bee0-776dd2c4987f", "name": "network-vif-deleted", "tag": "a357c0fc-62d7-41ad-9702-54a7497b4120"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:21:28.344696 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:21:28.351305 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-35799a1c-a0fa-4e75-8d77-c28c6fba2b0b req-a6beb051-686b-407e-af06-9381ae550a6d service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:28.351783 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-35799a1c-a0fa-4e75-8d77-c28c6fba2b0b req-a6beb051-686b-407e-af06-9381ae550a6d service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:28.352224 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-35799a1c-a0fa-4e75-8d77-c28c6fba2b0b req-a6beb051-686b-407e-af06-9381ae550a6d service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:28.357884 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=85 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:21:28.366773 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-35799a1c-a0fa-4e75-8d77-c28c6fba2b0b req-a6beb051-686b-407e-af06-9381ae550a6d service nova] Creating event network-vif-deleted:a357c0fc-62d7-41ad-9702-54a7497b4120 for instance 45f4a08c-c1bc-4a72-bee0-776dd2c4987f on n-h1-851028-13 Oct 04 19:21:28.371865 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-35799a1c-a0fa-4e75-8d77-c28c6fba2b0b req-a6beb051-686b-407e-af06-9381ae550a6d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036944 Oct 04 19:21:28.372500 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3176/6723] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:21:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:21:28.763964 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-4e57f4f1-4a0b-4c01-bb19-9463faea991a tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:21:28.764587 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-4e57f4f1-4a0b-4c01-bb19-9463faea991a tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: 45f4a08c-c1bc-4a72-bee0-776dd2c4987f] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:21:28.767930 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:21:28.775409 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4e57f4f1-4a0b-4c01-bb19-9463faea991a tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:28.775908 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4e57f4f1-4a0b-4c01-bb19-9463faea991a tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:28.776353 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4e57f4f1-4a0b-4c01-bb19-9463faea991a tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:28.777062 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4e57f4f1-4a0b-4c01-bb19-9463faea991a tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:28.777547 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4e57f4f1-4a0b-4c01-bb19-9463faea991a tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:28.777983 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4e57f4f1-4a0b-4c01-bb19-9463faea991a tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:28.847570 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-4e57f4f1-4a0b-4c01-bb19-9463faea991a tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:21:28.856599 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-4e57f4f1-4a0b-4c01-bb19-9463faea991a tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/45f4a08c-c1bc-4a72-bee0-776dd2c4987f" status: 200 len: 1187 microversion: 2.1 time: 0.096603 Oct 04 19:21:28.857199 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3548/6724] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:21:28 2022] GET /compute/v2.1/servers/45f4a08c-c1bc-4a72-bee0-776dd2c4987f => generated 1187 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:21:29.880625 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-6a481d0b-f668-4af6-8a3c-91c13d954f7e tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:21:29.881369 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-6a481d0b-f668-4af6-8a3c-91c13d954f7e tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: 45f4a08c-c1bc-4a72-bee0-776dd2c4987f] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:21:29.887783 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6a481d0b-f668-4af6-8a3c-91c13d954f7e tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:29.888281 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6a481d0b-f668-4af6-8a3c-91c13d954f7e tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:29.888721 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6a481d0b-f668-4af6-8a3c-91c13d954f7e tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:29.889444 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6a481d0b-f668-4af6-8a3c-91c13d954f7e tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:29.889896 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6a481d0b-f668-4af6-8a3c-91c13d954f7e tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:29.890320 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6a481d0b-f668-4af6-8a3c-91c13d954f7e tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:29.960425 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-6a481d0b-f668-4af6-8a3c-91c13d954f7e tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:21:29.969296 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-6a481d0b-f668-4af6-8a3c-91c13d954f7e tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/45f4a08c-c1bc-4a72-bee0-776dd2c4987f" status: 200 len: 1187 microversion: 2.1 time: 0.093737 Oct 04 19:21:29.969914 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3177/6725] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:21:29 2022] GET /compute/v2.1/servers/45f4a08c-c1bc-4a72-bee0-776dd2c4987f => generated 1187 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:21:30.993726 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-abb69899-a192-4a05-8830-8b6494ae163c tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:21:30.994337 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-abb69899-a192-4a05-8830-8b6494ae163c tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: 45f4a08c-c1bc-4a72-bee0-776dd2c4987f] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:21:31.001481 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-abb69899-a192-4a05-8830-8b6494ae163c tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:31.001968 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-abb69899-a192-4a05-8830-8b6494ae163c tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:31.002427 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-abb69899-a192-4a05-8830-8b6494ae163c tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:31.003154 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-abb69899-a192-4a05-8830-8b6494ae163c tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:31.003610 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-abb69899-a192-4a05-8830-8b6494ae163c tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:31.004661 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-abb69899-a192-4a05-8830-8b6494ae163c tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:31.068973 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-abb69899-a192-4a05-8830-8b6494ae163c tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:21:31.076992 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-abb69899-a192-4a05-8830-8b6494ae163c tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/45f4a08c-c1bc-4a72-bee0-776dd2c4987f" status: 200 len: 1187 microversion: 2.1 time: 0.087186 Oct 04 19:21:31.077605 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3549/6726] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:21:30 2022] GET /compute/v2.1/servers/45f4a08c-c1bc-4a72-bee0-776dd2c4987f => generated 1187 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:21:32.101047 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-f50c1d86-de96-4b3a-b55a-5f83f59bd959 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:21:32.101824 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-f50c1d86-de96-4b3a-b55a-5f83f59bd959 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: 45f4a08c-c1bc-4a72-bee0-776dd2c4987f] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:21:32.108803 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f50c1d86-de96-4b3a-b55a-5f83f59bd959 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:32.109338 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f50c1d86-de96-4b3a-b55a-5f83f59bd959 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:32.109790 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f50c1d86-de96-4b3a-b55a-5f83f59bd959 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:32.110498 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f50c1d86-de96-4b3a-b55a-5f83f59bd959 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:32.110962 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f50c1d86-de96-4b3a-b55a-5f83f59bd959 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:32.111398 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f50c1d86-de96-4b3a-b55a-5f83f59bd959 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:32.172936 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-f50c1d86-de96-4b3a-b55a-5f83f59bd959 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:21:32.180846 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-f50c1d86-de96-4b3a-b55a-5f83f59bd959 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/45f4a08c-c1bc-4a72-bee0-776dd2c4987f" status: 200 len: 1187 microversion: 2.1 time: 0.084454 Oct 04 19:21:32.181459 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3178/6727] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:21:32 2022] GET /compute/v2.1/servers/45f4a08c-c1bc-4a72-bee0-776dd2c4987f => generated 1187 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:21:33.204293 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-8b865fc9-08f9-4823-be4f-269a43e8ba80 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:21:33.204918 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-8b865fc9-08f9-4823-be4f-269a43e8ba80 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: 45f4a08c-c1bc-4a72-bee0-776dd2c4987f] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:21:33.212405 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8b865fc9-08f9-4823-be4f-269a43e8ba80 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:33.212887 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8b865fc9-08f9-4823-be4f-269a43e8ba80 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:33.213364 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8b865fc9-08f9-4823-be4f-269a43e8ba80 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:33.214071 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8b865fc9-08f9-4823-be4f-269a43e8ba80 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:33.214532 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8b865fc9-08f9-4823-be4f-269a43e8ba80 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:33.214965 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8b865fc9-08f9-4823-be4f-269a43e8ba80 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:33.229439 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-8b865fc9-08f9-4823-be4f-269a43e8ba80 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] HTTP exception thrown: Instance 45f4a08c-c1bc-4a72-bee0-776dd2c4987f could not be found. Oct 04 19:21:33.231115 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-8b865fc9-08f9-4823-be4f-269a43e8ba80 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Request method failure captured: Oct 04 19:21:33.231115 n-d-851028-13 devstack@n-api.service[123596]: request: GET /compute/v2.1/servers/45f4a08c-c1bc-4a72-bee0-776dd2c4987f HTTP/1.1 Oct 04 19:21:33.231115 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 19:21:33.231115 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 19:21:33.231115 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 19:21:33.231115 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 19:21:33.231115 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 19:21:33.231115 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 19:21:33.231115 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 19:21:33.231115 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 19:21:33.231115 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPIdD9eu-sNppZso9GBgF0qiQcNSNfbptUObqTJdNMmQeJtmiNalN1HCCgoRlIsnKAnm3yDfemx5F9JCBtqQ5VFIZ41axYIUJNVoTUZoGs-EEXp4RLTVvMn1M_mAUAx-w46wS7k3RPeCrtItzG8FEbUjMK8RLhn-Xr_i-jB7aqW9aWok Oct 04 19:21:33.231115 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 19:21:33.231115 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 19:21:33.231115 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 19:21:33.231115 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 19:21:33.231115 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 19:21:33.231115 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 19:21:33.231115 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: 9cd28590bda749c5aa109ae292cb32e6 Oct 04 19:21:33.231115 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-TestVolumeBootPattern-410499789 Oct 04 19:21:33.231115 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 19:21:33.231115 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 19:21:33.231115 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/9cd28590bda749c5aa109ae292cb32e6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_9cd28590bda749c5aa109ae292cb32e6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/9cd28590bda749c5aa109ae292cb32e6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/9cd28590bda749c5aa109ae292cb32e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 19:21:33.231115 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-TestVolumeBootPattern-410499789 Oct 04 19:21:33.231115 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: 9cd28590bda749c5aa109ae292cb32e6 Oct 04 19:21:33.231115 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-TestVolumeBootPattern-410499789 Oct 04 19:21:33.231115 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-TestVolumeBootPattern-410499789-project Oct 04 19:21:33.231115 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 19:21:33.231115 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 19:21:33.231115 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 43efdccf8e2f4934ae5cfe3da828511e Oct 04 19:21:33.231115 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-TestVolumeBootPattern-410499789-project Oct 04 19:21:33.231115 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 19:21:33.231115 n-d-851028-13 devstack@n-api.service[123596]: exception: Instance 45f4a08c-c1bc-4a72-bee0-776dd2c4987f could not be found. Oct 04 19:21:33.231115 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': '45f4a08c-c1bc-4a72-bee0-776dd2c4987f'} Oct 04 19:21:33.231115 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:21:33.231115 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:21:33.231115 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:21:33.231115 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:21:33.231115 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:21:33.231115 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:21:33.231115 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:21:33.231115 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:21:33.231115 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:21:33.231115 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:21:33.231115 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45f4a08c-c1bc-4a72-bee0-776dd2c4987f could not be found. Oct 04 19:21:33.231115 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:21:33.231115 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:21:33.231115 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:21:33.231115 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:21:33.231115 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:21:33.231115 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:21:33.231115 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:21:33.231115 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:21:33.231115 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:21:33.231115 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:21:33.231115 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:21:33.231115 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:21:33.231115 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:21:33.231115 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:21:33.231115 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:21:33.231115 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:21:33.231115 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45f4a08c-c1bc-4a72-bee0-776dd2c4987f could not be found. Oct 04 19:21:33.231115 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:21:33.231115 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:21:33.231115 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:21:33.235226 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:21:33.235226 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:21:33.235226 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:21:33.235226 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:21:33.235226 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:21:33.235226 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45f4a08c-c1bc-4a72-bee0-776dd2c4987f could not be found. Oct 04 19:21:33.235226 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:21:33.235226 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-8b865fc9-08f9-4823-be4f-269a43e8ba80 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Returning 404 to user: Instance 45f4a08c-c1bc-4a72-bee0-776dd2c4987f could not be found. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:21:33.235226 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-8b865fc9-08f9-4823-be4f-269a43e8ba80 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/45f4a08c-c1bc-4a72-bee0-776dd2c4987f" status: 404 len: 111 microversion: 2.1 time: 0.032285 Oct 04 19:21:33.235226 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3550/6728] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:21:33 2022] GET /compute/v2.1/servers/45f4a08c-c1bc-4a72-bee0-776dd2c4987f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:21:35.383702 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-83b34423-31bd-4ed6-bcf8-b08cc29c19c1 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:21:35.384164 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-83b34423-31bd-4ed6-bcf8-b08cc29c19c1 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: 45f4a08c-c1bc-4a72-bee0-776dd2c4987f] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:21:35.400546 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-83b34423-31bd-4ed6-bcf8-b08cc29c19c1 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:35.401438 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-83b34423-31bd-4ed6-bcf8-b08cc29c19c1 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:35.402215 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-83b34423-31bd-4ed6-bcf8-b08cc29c19c1 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:35.403436 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-83b34423-31bd-4ed6-bcf8-b08cc29c19c1 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:35.404255 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-83b34423-31bd-4ed6-bcf8-b08cc29c19c1 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:35.405004 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-83b34423-31bd-4ed6-bcf8-b08cc29c19c1 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:35.430199 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-83b34423-31bd-4ed6-bcf8-b08cc29c19c1 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] HTTP exception thrown: Instance 45f4a08c-c1bc-4a72-bee0-776dd2c4987f could not be found. Oct 04 19:21:35.433542 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-83b34423-31bd-4ed6-bcf8-b08cc29c19c1 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Request method failure captured: Oct 04 19:21:35.433542 n-d-851028-13 devstack@n-api.service[123595]: request: DELETE /compute/v2.1/servers/45f4a08c-c1bc-4a72-bee0-776dd2c4987f HTTP/1.1 Oct 04 19:21:35.433542 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 19:21:35.433542 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 19:21:35.433542 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 19:21:35.433542 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 0 Oct 04 19:21:35.433542 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 19:21:35.433542 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 19:21:35.433542 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 19:21:35.433542 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 19:21:35.433542 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPIdD9eu-sNppZso9GBgF0qiQcNSNfbptUObqTJdNMmQeJtmiNalN1HCCgoRlIsnKAnm3yDfemx5F9JCBtqQ5VFIZ41axYIUJNVoTUZoGs-EEXp4RLTVvMn1M_mAUAx-w46wS7k3RPeCrtItzG8FEbUjMK8RLhn-Xr_i-jB7aqW9aWok Oct 04 19:21:35.433542 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 19:21:35.433542 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 19:21:35.433542 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 19:21:35.433542 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 19:21:35.433542 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 19:21:35.433542 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 19:21:35.433542 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: 9cd28590bda749c5aa109ae292cb32e6 Oct 04 19:21:35.433542 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-TestVolumeBootPattern-410499789 Oct 04 19:21:35.433542 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 19:21:35.433542 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 19:21:35.433542 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/9cd28590bda749c5aa109ae292cb32e6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_9cd28590bda749c5aa109ae292cb32e6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/9cd28590bda749c5aa109ae292cb32e6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/9cd28590bda749c5aa109ae292cb32e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 19:21:35.433542 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-TestVolumeBootPattern-410499789 Oct 04 19:21:35.433542 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: 9cd28590bda749c5aa109ae292cb32e6 Oct 04 19:21:35.433542 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-TestVolumeBootPattern-410499789 Oct 04 19:21:35.433542 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-TestVolumeBootPattern-410499789-project Oct 04 19:21:35.433542 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 19:21:35.433542 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 19:21:35.433542 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: 43efdccf8e2f4934ae5cfe3da828511e Oct 04 19:21:35.433542 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-TestVolumeBootPattern-410499789-project Oct 04 19:21:35.433542 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 19:21:35.433542 n-d-851028-13 devstack@n-api.service[123595]: exception: Instance 45f4a08c-c1bc-4a72-bee0-776dd2c4987f could not be found. Oct 04 19:21:35.433542 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': '45f4a08c-c1bc-4a72-bee0-776dd2c4987f'} Oct 04 19:21:35.433542 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:21:35.433542 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:21:35.433542 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:21:35.433542 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:21:35.433542 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:21:35.433542 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:21:35.433542 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:21:35.433542 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:21:35.433542 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:21:35.433542 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:21:35.433542 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45f4a08c-c1bc-4a72-bee0-776dd2c4987f could not be found. Oct 04 19:21:35.433542 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:21:35.433542 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:21:35.433542 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:21:35.433542 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:21:35.433542 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:21:35.433542 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:21:35.433542 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:21:35.433542 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:21:35.433542 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:21:35.433542 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:21:35.433542 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 19:21:35.433542 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 19:21:35.433542 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 19:21:35.433542 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 19:21:35.433542 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:21:35.433542 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:21:35.433542 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:21:35.433542 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:21:35.437560 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45f4a08c-c1bc-4a72-bee0-776dd2c4987f could not be found. Oct 04 19:21:35.437560 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:21:35.437560 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:21:35.437560 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:21:35.437560 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:21:35.437560 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:21:35.437560 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:21:35.437560 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:21:35.437560 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:21:35.437560 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45f4a08c-c1bc-4a72-bee0-776dd2c4987f could not be found. Oct 04 19:21:35.437560 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:21:35.437560 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-83b34423-31bd-4ed6-bcf8-b08cc29c19c1 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Returning 404 to user: Instance 45f4a08c-c1bc-4a72-bee0-776dd2c4987f could not be found. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:21:35.437560 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-83b34423-31bd-4ed6-bcf8-b08cc29c19c1 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "DELETE /compute/v2.1/servers/45f4a08c-c1bc-4a72-bee0-776dd2c4987f" status: 404 len: 111 microversion: 2.1 time: 0.055928 Oct 04 19:21:35.438640 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3179/6729] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 19:21:35 2022] DELETE /compute/v2.1/servers/45f4a08c-c1bc-4a72-bee0-776dd2c4987f => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:21:35.447214 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-c3533cb1-a7c1-47ef-87b2-ffef0e9bedd8 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:21:35.448114 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-c3533cb1-a7c1-47ef-87b2-ffef0e9bedd8 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: 45f4a08c-c1bc-4a72-bee0-776dd2c4987f] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:21:35.450517 n-d-851028-13 devstack@n-api.service[123596]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 19:21:35.450725 n-d-851028-13 devstack@n-api.service[123596]: Tue Oct 4 19:21:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/45f4a08c-c1bc-4a72-bee0-776dd2c4987f (ip 10.222.0.43) !!! Oct 04 19:21:35.459887 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c3533cb1-a7c1-47ef-87b2-ffef0e9bedd8 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:35.460384 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c3533cb1-a7c1-47ef-87b2-ffef0e9bedd8 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:35.460835 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c3533cb1-a7c1-47ef-87b2-ffef0e9bedd8 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:35.461587 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c3533cb1-a7c1-47ef-87b2-ffef0e9bedd8 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:35.462055 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c3533cb1-a7c1-47ef-87b2-ffef0e9bedd8 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:35.462493 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c3533cb1-a7c1-47ef-87b2-ffef0e9bedd8 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:35.477830 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-c3533cb1-a7c1-47ef-87b2-ffef0e9bedd8 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] HTTP exception thrown: Instance 45f4a08c-c1bc-4a72-bee0-776dd2c4987f could not be found. Oct 04 19:21:35.479402 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-c3533cb1-a7c1-47ef-87b2-ffef0e9bedd8 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Request method failure captured: Oct 04 19:21:35.479402 n-d-851028-13 devstack@n-api.service[123596]: request: GET /compute/v2.1/servers/45f4a08c-c1bc-4a72-bee0-776dd2c4987f HTTP/1.1 Oct 04 19:21:35.479402 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 19:21:35.479402 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 19:21:35.479402 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 19:21:35.479402 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 19:21:35.479402 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 19:21:35.479402 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 19:21:35.479402 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 19:21:35.479402 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 19:21:35.479402 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPIdD9eu-sNppZso9GBgF0qiQcNSNfbptUObqTJdNMmQeJtmiNalN1HCCgoRlIsnKAnm3yDfemx5F9JCBtqQ5VFIZ41axYIUJNVoTUZoGs-EEXp4RLTVvMn1M_mAUAx-w46wS7k3RPeCrtItzG8FEbUjMK8RLhn-Xr_i-jB7aqW9aWok Oct 04 19:21:35.479402 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 19:21:35.479402 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 19:21:35.479402 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 19:21:35.479402 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 19:21:35.479402 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 19:21:35.479402 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 19:21:35.479402 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: 9cd28590bda749c5aa109ae292cb32e6 Oct 04 19:21:35.479402 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-TestVolumeBootPattern-410499789 Oct 04 19:21:35.479402 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 19:21:35.479402 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 19:21:35.479402 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/9cd28590bda749c5aa109ae292cb32e6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_9cd28590bda749c5aa109ae292cb32e6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/9cd28590bda749c5aa109ae292cb32e6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/9cd28590bda749c5aa109ae292cb32e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 19:21:35.479402 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-TestVolumeBootPattern-410499789 Oct 04 19:21:35.479402 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: 9cd28590bda749c5aa109ae292cb32e6 Oct 04 19:21:35.479402 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-TestVolumeBootPattern-410499789 Oct 04 19:21:35.479402 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-TestVolumeBootPattern-410499789-project Oct 04 19:21:35.479402 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 19:21:35.479402 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 19:21:35.479402 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 43efdccf8e2f4934ae5cfe3da828511e Oct 04 19:21:35.479402 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-TestVolumeBootPattern-410499789-project Oct 04 19:21:35.479402 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 19:21:35.479402 n-d-851028-13 devstack@n-api.service[123596]: exception: Instance 45f4a08c-c1bc-4a72-bee0-776dd2c4987f could not be found. Oct 04 19:21:35.479402 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': '45f4a08c-c1bc-4a72-bee0-776dd2c4987f'} Oct 04 19:21:35.479402 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:21:35.479402 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:21:35.479402 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:21:35.479402 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:21:35.479402 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:21:35.479402 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:21:35.479402 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:21:35.479402 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:21:35.479402 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:21:35.479402 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:21:35.479402 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45f4a08c-c1bc-4a72-bee0-776dd2c4987f could not be found. Oct 04 19:21:35.479402 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:21:35.479402 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:21:35.479402 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:21:35.479402 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:21:35.479402 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:21:35.479402 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:21:35.479402 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:21:35.479402 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:21:35.479402 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:21:35.479402 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:21:35.479402 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:21:35.479402 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:21:35.479402 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:21:35.479402 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:21:35.479402 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:21:35.479402 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:21:35.479402 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45f4a08c-c1bc-4a72-bee0-776dd2c4987f could not be found. Oct 04 19:21:35.479402 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:21:35.479402 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:21:35.479402 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:21:35.483099 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:21:35.483099 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:21:35.483099 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:21:35.483099 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:21:35.483099 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:21:35.483099 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45f4a08c-c1bc-4a72-bee0-776dd2c4987f could not be found. Oct 04 19:21:35.483099 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:21:35.483099 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-c3533cb1-a7c1-47ef-87b2-ffef0e9bedd8 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Returning 404 to user: Instance 45f4a08c-c1bc-4a72-bee0-776dd2c4987f could not be found. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:21:35.483099 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-c3533cb1-a7c1-47ef-87b2-ffef0e9bedd8 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/45f4a08c-c1bc-4a72-bee0-776dd2c4987f" status: 404 len: 111 microversion: 2.1 time: 0.037594 Oct 04 19:21:35.483099 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3551/6730] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:21:35 2022] GET /compute/v2.1/servers/45f4a08c-c1bc-4a72-bee0-776dd2c4987f => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:21:55.142052 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-b54ce085-c6b7-4b01-a42c-895b70d260d4 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-1759824261", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "06e0dec8-4ff9-4351-a097-253b9270fb72", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "2ddfee4a-681a-4b64-a4ab-40481cf11577"}]}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:21:55.152119 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_api:SELECT=7 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:21:55.153325 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=15 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:21:55.203872 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.network.neutron [None req-b54ce085-c6b7-4b01-a42c-895b70d260d4 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] validate_networks() for [('2ddfee4a-681a-4b64-a4ab-40481cf11577', None, None, None, None, None)] {{(pid=123595) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 19:21:55.568120 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-b54ce085-c6b7-4b01-a42c-895b70d260d4 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Flavor limits 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:21:55.568553 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-b54ce085-c6b7-4b01-a42c-895b70d260d4 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Image limits 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:21:55.569034 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-b54ce085-c6b7-4b01-a42c-895b70d260d4 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Flavor pref 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:21:55.569476 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-b54ce085-c6b7-4b01-a42c-895b70d260d4 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Image pref 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:21:55.569892 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-b54ce085-c6b7-4b01-a42c-895b70d260d4 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:21:55.578971 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b54ce085-c6b7-4b01-a42c-895b70d260d4 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:55.579463 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b54ce085-c6b7-4b01-a42c-895b70d260d4 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:55.579910 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b54ce085-c6b7-4b01-a42c-895b70d260d4 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:55.580649 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b54ce085-c6b7-4b01-a42c-895b70d260d4 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:55.581131 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b54ce085-c6b7-4b01-a42c-895b70d260d4 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:55.581562 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b54ce085-c6b7-4b01-a42c-895b70d260d4 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:55.598273 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-b54ce085-c6b7-4b01-a42c-895b70d260d4 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Getting quotas for project 9cd28590bda749c5aa109ae292cb32e6. Resources: {'ram', 'cores', 'instances'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:21:55.603902 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-b54ce085-c6b7-4b01-a42c-895b70d260d4 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Getting quotas for user 43efdccf8e2f4934ae5cfe3da828511e and project 9cd28590bda749c5aa109ae292cb32e6. Resources: {'ram', 'cores', 'instances'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:21:55.667713 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-b54ce085-c6b7-4b01-a42c-895b70d260d4 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Going to run 1 instances... {{(pid=123595) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 19:21:55.670439 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-b54ce085-c6b7-4b01-a42c-895b70d260d4 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: 5a300902-48ba-46b4-9e50-c90491a1dbc8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='06e0dec8-4ff9-4351-a097-253b9270fb72',volume_size=None,volume_type=None)] {{(pid=123595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 19:21:55.798217 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-b54ce085-c6b7-4b01-a42c-895b70d260d4 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.660939 Oct 04 19:21:55.798866 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3180/6731] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 19:21:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 662 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 19:21:55.810860 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-69603dfc-0c79-4722-9933-738fef7c9be3 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:21:55.811483 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-69603dfc-0c79-4722-9933-738fef7c9be3 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: 5a300902-48ba-46b4-9e50-c90491a1dbc8] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:21:55.813623 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_api:SELECT=7 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:21:55.814271 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=16 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:21:55.866218 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-69603dfc-0c79-4722-9933-738fef7c9be3 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:21:55.873860 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-69603dfc-0c79-4722-9933-738fef7c9be3 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/5a300902-48ba-46b4-9e50-c90491a1dbc8" status: 200 len: 1071 microversion: 2.1 time: 0.067752 Oct 04 19:21:55.874517 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3552/6732] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:21:55 2022] GET /compute/v2.1/servers/5a300902-48ba-46b4-9e50-c90491a1dbc8 => generated 1071 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:21:56.898526 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-204ff448-fa95-41b5-84b8-3b234945b207 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:21:56.899334 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-204ff448-fa95-41b5-84b8-3b234945b207 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: 5a300902-48ba-46b4-9e50-c90491a1dbc8] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:21:56.906767 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-204ff448-fa95-41b5-84b8-3b234945b207 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:56.907271 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-204ff448-fa95-41b5-84b8-3b234945b207 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:56.907720 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-204ff448-fa95-41b5-84b8-3b234945b207 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:56.908440 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-204ff448-fa95-41b5-84b8-3b234945b207 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:56.908905 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-204ff448-fa95-41b5-84b8-3b234945b207 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:56.910042 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-204ff448-fa95-41b5-84b8-3b234945b207 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:56.981911 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-204ff448-fa95-41b5-84b8-3b234945b207 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:21:56.991242 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-204ff448-fa95-41b5-84b8-3b234945b207 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/5a300902-48ba-46b4-9e50-c90491a1dbc8" status: 200 len: 1187 microversion: 2.1 time: 0.099169 Oct 04 19:21:56.992007 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3181/6733] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:21:56 2022] GET /compute/v2.1/servers/5a300902-48ba-46b4-9e50-c90491a1dbc8 => generated 1187 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:21:58.016619 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-8a46fec3-8b11-4be6-baeb-5c9578eb54ab tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:21:58.017423 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-8a46fec3-8b11-4be6-baeb-5c9578eb54ab tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: 5a300902-48ba-46b4-9e50-c90491a1dbc8] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:21:58.039347 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8a46fec3-8b11-4be6-baeb-5c9578eb54ab tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:58.039844 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8a46fec3-8b11-4be6-baeb-5c9578eb54ab tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:58.040285 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8a46fec3-8b11-4be6-baeb-5c9578eb54ab tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:58.041004 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8a46fec3-8b11-4be6-baeb-5c9578eb54ab tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:58.043642 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8a46fec3-8b11-4be6-baeb-5c9578eb54ab tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:58.044099 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8a46fec3-8b11-4be6-baeb-5c9578eb54ab tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:58.249499 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-8a46fec3-8b11-4be6-baeb-5c9578eb54ab tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:21:58.258643 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-8a46fec3-8b11-4be6-baeb-5c9578eb54ab tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/5a300902-48ba-46b4-9e50-c90491a1dbc8" status: 200 len: 1229 microversion: 2.1 time: 0.246313 Oct 04 19:21:58.259317 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3553/6734] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:21:58 2022] GET /compute/v2.1/servers/5a300902-48ba-46b4-9e50-c90491a1dbc8 => generated 1229 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:21:58.584844 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-b652bb69-a11c-4d27-90c5-789fc14a0eac req-14ef3b70-2d91-4c35-a4a6-3e76a2a8fca0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a300902-48ba-46b4-9e50-c90491a1dbc8", "tag": "c8a11590-86f4-4ac0-9b15-c85d77417b60"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:21:58.599440 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-b652bb69-a11c-4d27-90c5-789fc14a0eac req-14ef3b70-2d91-4c35-a4a6-3e76a2a8fca0 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:58.600256 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-b652bb69-a11c-4d27-90c5-789fc14a0eac req-14ef3b70-2d91-4c35-a4a6-3e76a2a8fca0 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:58.601467 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-b652bb69-a11c-4d27-90c5-789fc14a0eac req-14ef3b70-2d91-4c35-a4a6-3e76a2a8fca0 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:58.616553 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-b652bb69-a11c-4d27-90c5-789fc14a0eac req-14ef3b70-2d91-4c35-a4a6-3e76a2a8fca0 service nova] Creating event network-changed:c8a11590-86f4-4ac0-9b15-c85d77417b60 for instance 5a300902-48ba-46b4-9e50-c90491a1dbc8 on n-h1-851028-13 Oct 04 19:21:58.622978 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-b652bb69-a11c-4d27-90c5-789fc14a0eac req-14ef3b70-2d91-4c35-a4a6-3e76a2a8fca0 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044781 Oct 04 19:21:58.624894 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3182/6735] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:21:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:21:59.282444 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-c1eeca3e-ea32-4001-99dc-131f256f2abc tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:21:59.283071 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-c1eeca3e-ea32-4001-99dc-131f256f2abc tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: 5a300902-48ba-46b4-9e50-c90491a1dbc8] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:21:59.290644 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c1eeca3e-ea32-4001-99dc-131f256f2abc tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:59.291149 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c1eeca3e-ea32-4001-99dc-131f256f2abc tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:59.292395 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c1eeca3e-ea32-4001-99dc-131f256f2abc tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:59.292893 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c1eeca3e-ea32-4001-99dc-131f256f2abc tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:59.293428 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c1eeca3e-ea32-4001-99dc-131f256f2abc tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:59.294081 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c1eeca3e-ea32-4001-99dc-131f256f2abc tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:59.518171 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-c1eeca3e-ea32-4001-99dc-131f256f2abc tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:21:59.526713 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-c1eeca3e-ea32-4001-99dc-131f256f2abc tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/5a300902-48ba-46b4-9e50-c90491a1dbc8" status: 200 len: 1229 microversion: 2.1 time: 0.247862 Oct 04 19:21:59.527245 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3554/6736] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:21:59 2022] GET /compute/v2.1/servers/5a300902-48ba-46b4-9e50-c90491a1dbc8 => generated 1229 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:22:00.550470 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-b16f7b8d-03ce-4e35-900f-ff1a9979ec4f tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:22:00.552308 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-b16f7b8d-03ce-4e35-900f-ff1a9979ec4f tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: 5a300902-48ba-46b4-9e50-c90491a1dbc8] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:22:00.559686 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b16f7b8d-03ce-4e35-900f-ff1a9979ec4f tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:00.560185 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b16f7b8d-03ce-4e35-900f-ff1a9979ec4f tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:00.560623 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b16f7b8d-03ce-4e35-900f-ff1a9979ec4f tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:00.561356 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b16f7b8d-03ce-4e35-900f-ff1a9979ec4f tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:00.561809 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b16f7b8d-03ce-4e35-900f-ff1a9979ec4f tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:00.562237 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b16f7b8d-03ce-4e35-900f-ff1a9979ec4f tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:00.693101 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-b16f7b8d-03ce-4e35-900f-ff1a9979ec4f tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:22:00.701521 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-b16f7b8d-03ce-4e35-900f-ff1a9979ec4f tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/5a300902-48ba-46b4-9e50-c90491a1dbc8" status: 200 len: 1229 microversion: 2.1 time: 0.155288 Oct 04 19:22:00.702112 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3183/6737] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:22:00 2022] GET /compute/v2.1/servers/5a300902-48ba-46b4-9e50-c90491a1dbc8 => generated 1229 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:22:01.724901 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-3b248a74-65d9-4309-9bf0-249c19c9bfd7 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:22:01.725554 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-3b248a74-65d9-4309-9bf0-249c19c9bfd7 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: 5a300902-48ba-46b4-9e50-c90491a1dbc8] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:22:01.734450 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3b248a74-65d9-4309-9bf0-249c19c9bfd7 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:01.735253 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3b248a74-65d9-4309-9bf0-249c19c9bfd7 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:01.737586 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3b248a74-65d9-4309-9bf0-249c19c9bfd7 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:01.738496 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3b248a74-65d9-4309-9bf0-249c19c9bfd7 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:01.739077 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3b248a74-65d9-4309-9bf0-249c19c9bfd7 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:01.739661 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3b248a74-65d9-4309-9bf0-249c19c9bfd7 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:01.879006 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-3b248a74-65d9-4309-9bf0-249c19c9bfd7 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:22:01.886809 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-3b248a74-65d9-4309-9bf0-249c19c9bfd7 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/5a300902-48ba-46b4-9e50-c90491a1dbc8" status: 200 len: 1229 microversion: 2.1 time: 0.166058 Oct 04 19:22:01.887387 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3555/6738] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:22:01 2022] GET /compute/v2.1/servers/5a300902-48ba-46b4-9e50-c90491a1dbc8 => generated 1229 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:22:02.910012 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-bbefd115-6da2-4d20-880f-1e461e1b571c tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:22:02.910627 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-bbefd115-6da2-4d20-880f-1e461e1b571c tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: 5a300902-48ba-46b4-9e50-c90491a1dbc8] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:22:02.919050 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bbefd115-6da2-4d20-880f-1e461e1b571c tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:02.919545 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bbefd115-6da2-4d20-880f-1e461e1b571c tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:02.919990 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bbefd115-6da2-4d20-880f-1e461e1b571c tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:02.920693 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bbefd115-6da2-4d20-880f-1e461e1b571c tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:02.921171 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bbefd115-6da2-4d20-880f-1e461e1b571c tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:02.921608 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bbefd115-6da2-4d20-880f-1e461e1b571c tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:03.054599 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-bbefd115-6da2-4d20-880f-1e461e1b571c tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:22:03.062575 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-bbefd115-6da2-4d20-880f-1e461e1b571c tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/5a300902-48ba-46b4-9e50-c90491a1dbc8" status: 200 len: 1217 microversion: 2.1 time: 0.156713 Oct 04 19:22:03.063152 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3184/6739] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:22:02 2022] GET /compute/v2.1/servers/5a300902-48ba-46b4-9e50-c90491a1dbc8 => generated 1217 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:22:04.088001 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-57b178fa-76b9-4857-872b-4c16f866ebad tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:22:04.088676 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-57b178fa-76b9-4857-872b-4c16f866ebad tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: 5a300902-48ba-46b4-9e50-c90491a1dbc8] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:22:04.095662 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-57b178fa-76b9-4857-872b-4c16f866ebad tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:04.096150 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-57b178fa-76b9-4857-872b-4c16f866ebad tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:04.096587 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-57b178fa-76b9-4857-872b-4c16f866ebad tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:04.097313 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-57b178fa-76b9-4857-872b-4c16f866ebad tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:04.097939 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-57b178fa-76b9-4857-872b-4c16f866ebad tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:04.098201 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-57b178fa-76b9-4857-872b-4c16f866ebad tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:04.226275 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-57b178fa-76b9-4857-872b-4c16f866ebad tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:22:04.234623 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-57b178fa-76b9-4857-872b-4c16f866ebad tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/5a300902-48ba-46b4-9e50-c90491a1dbc8" status: 200 len: 1217 microversion: 2.1 time: 0.150515 Oct 04 19:22:04.235197 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3556/6740] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:22:04 2022] GET /compute/v2.1/servers/5a300902-48ba-46b4-9e50-c90491a1dbc8 => generated 1217 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:22:05.257338 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-02fd2a16-4b32-4855-a6a6-dbb85483d47f tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:22:05.257976 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-02fd2a16-4b32-4855-a6a6-dbb85483d47f tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: 5a300902-48ba-46b4-9e50-c90491a1dbc8] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:22:05.264837 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-02fd2a16-4b32-4855-a6a6-dbb85483d47f tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:05.265351 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-02fd2a16-4b32-4855-a6a6-dbb85483d47f tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:05.265790 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-02fd2a16-4b32-4855-a6a6-dbb85483d47f tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:05.266482 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-02fd2a16-4b32-4855-a6a6-dbb85483d47f tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:05.266932 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-02fd2a16-4b32-4855-a6a6-dbb85483d47f tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:05.267498 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-02fd2a16-4b32-4855-a6a6-dbb85483d47f tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:05.399173 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-02fd2a16-4b32-4855-a6a6-dbb85483d47f tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:22:05.406913 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-02fd2a16-4b32-4855-a6a6-dbb85483d47f tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/5a300902-48ba-46b4-9e50-c90491a1dbc8" status: 200 len: 1217 microversion: 2.1 time: 0.153538 Oct 04 19:22:05.407759 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3185/6741] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:22:05 2022] GET /compute/v2.1/servers/5a300902-48ba-46b4-9e50-c90491a1dbc8 => generated 1217 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:22:06.430856 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-78abdf4d-10e8-413f-9e9a-5ac783e897ef tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:22:06.431481 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-78abdf4d-10e8-413f-9e9a-5ac783e897ef tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: 5a300902-48ba-46b4-9e50-c90491a1dbc8] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:22:06.434280 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=2 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:22:06.440120 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-78abdf4d-10e8-413f-9e9a-5ac783e897ef tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:06.440620 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-78abdf4d-10e8-413f-9e9a-5ac783e897ef tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:06.441068 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-78abdf4d-10e8-413f-9e9a-5ac783e897ef tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:06.441810 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-78abdf4d-10e8-413f-9e9a-5ac783e897ef tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:06.442303 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-78abdf4d-10e8-413f-9e9a-5ac783e897ef tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:06.442770 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-78abdf4d-10e8-413f-9e9a-5ac783e897ef tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:06.575076 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-78abdf4d-10e8-413f-9e9a-5ac783e897ef tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:22:06.582862 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-78abdf4d-10e8-413f-9e9a-5ac783e897ef tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/5a300902-48ba-46b4-9e50-c90491a1dbc8" status: 200 len: 1217 microversion: 2.1 time: 0.156525 Oct 04 19:22:06.583440 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3557/6742] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:22:06 2022] GET /compute/v2.1/servers/5a300902-48ba-46b4-9e50-c90491a1dbc8 => generated 1217 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:22:07.606504 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-8ef02cf3-7fd6-44d3-a6ff-a28a64a14a22 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:22:07.607124 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-8ef02cf3-7fd6-44d3-a6ff-a28a64a14a22 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: 5a300902-48ba-46b4-9e50-c90491a1dbc8] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:22:07.609191 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=2 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:22:07.609876 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=6 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:22:07.617433 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8ef02cf3-7fd6-44d3-a6ff-a28a64a14a22 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:07.617928 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8ef02cf3-7fd6-44d3-a6ff-a28a64a14a22 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:07.618364 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8ef02cf3-7fd6-44d3-a6ff-a28a64a14a22 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:07.619068 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8ef02cf3-7fd6-44d3-a6ff-a28a64a14a22 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:07.619526 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8ef02cf3-7fd6-44d3-a6ff-a28a64a14a22 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:07.619954 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8ef02cf3-7fd6-44d3-a6ff-a28a64a14a22 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:07.746707 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-8ef02cf3-7fd6-44d3-a6ff-a28a64a14a22 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:22:07.754379 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-8ef02cf3-7fd6-44d3-a6ff-a28a64a14a22 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/5a300902-48ba-46b4-9e50-c90491a1dbc8" status: 200 len: 1217 microversion: 2.1 time: 0.151804 Oct 04 19:22:07.754993 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3186/6743] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:22:07 2022] GET /compute/v2.1/servers/5a300902-48ba-46b4-9e50-c90491a1dbc8 => generated 1217 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:22:08.776630 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-3d5684c9-f2f7-495d-9cf0-337ff57bf538 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:22:08.777192 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-3d5684c9-f2f7-495d-9cf0-337ff57bf538 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: 5a300902-48ba-46b4-9e50-c90491a1dbc8] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:22:08.784360 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3d5684c9-f2f7-495d-9cf0-337ff57bf538 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:08.784853 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3d5684c9-f2f7-495d-9cf0-337ff57bf538 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:08.785343 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3d5684c9-f2f7-495d-9cf0-337ff57bf538 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:08.786048 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3d5684c9-f2f7-495d-9cf0-337ff57bf538 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:08.786515 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3d5684c9-f2f7-495d-9cf0-337ff57bf538 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:08.786949 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3d5684c9-f2f7-495d-9cf0-337ff57bf538 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:08.919420 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-3d5684c9-f2f7-495d-9cf0-337ff57bf538 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:22:08.927272 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-3d5684c9-f2f7-495d-9cf0-337ff57bf538 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/5a300902-48ba-46b4-9e50-c90491a1dbc8" status: 200 len: 1217 microversion: 2.1 time: 0.154776 Oct 04 19:22:08.928457 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3558/6744] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:22:08 2022] GET /compute/v2.1/servers/5a300902-48ba-46b4-9e50-c90491a1dbc8 => generated 1217 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:22:09.950756 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-66ac5133-86d8-4414-8b12-877164e2e31d tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:22:09.951377 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-66ac5133-86d8-4414-8b12-877164e2e31d tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: 5a300902-48ba-46b4-9e50-c90491a1dbc8] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:22:09.958398 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-66ac5133-86d8-4414-8b12-877164e2e31d tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:09.959532 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-66ac5133-86d8-4414-8b12-877164e2e31d tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:09.959980 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-66ac5133-86d8-4414-8b12-877164e2e31d tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:09.960681 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-66ac5133-86d8-4414-8b12-877164e2e31d tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:09.961171 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-66ac5133-86d8-4414-8b12-877164e2e31d tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:09.961611 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-66ac5133-86d8-4414-8b12-877164e2e31d tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:10.100258 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-66ac5133-86d8-4414-8b12-877164e2e31d tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:22:10.107906 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-66ac5133-86d8-4414-8b12-877164e2e31d tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/5a300902-48ba-46b4-9e50-c90491a1dbc8" status: 200 len: 1217 microversion: 2.1 time: 0.161088 Oct 04 19:22:10.108487 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3187/6745] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:22:09 2022] GET /compute/v2.1/servers/5a300902-48ba-46b4-9e50-c90491a1dbc8 => generated 1217 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:22:11.130142 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-fb4270b5-1037-410a-9874-5a9ac8fa6777 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:22:11.131388 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-fb4270b5-1037-410a-9874-5a9ac8fa6777 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: 5a300902-48ba-46b4-9e50-c90491a1dbc8] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:22:11.138732 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fb4270b5-1037-410a-9874-5a9ac8fa6777 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:11.139224 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fb4270b5-1037-410a-9874-5a9ac8fa6777 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:11.139670 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fb4270b5-1037-410a-9874-5a9ac8fa6777 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:11.140374 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fb4270b5-1037-410a-9874-5a9ac8fa6777 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:11.140836 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fb4270b5-1037-410a-9874-5a9ac8fa6777 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:11.141300 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fb4270b5-1037-410a-9874-5a9ac8fa6777 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:11.272715 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-fb4270b5-1037-410a-9874-5a9ac8fa6777 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:22:11.280735 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-fb4270b5-1037-410a-9874-5a9ac8fa6777 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/5a300902-48ba-46b4-9e50-c90491a1dbc8" status: 200 len: 1217 microversion: 2.1 time: 0.154800 Oct 04 19:22:11.281340 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3559/6746] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:22:11 2022] GET /compute/v2.1/servers/5a300902-48ba-46b4-9e50-c90491a1dbc8 => generated 1217 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:22:12.184968 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-b8a20810-470a-4895-a6bf-789897a8a041 req-3818432a-044b-4603-ad78-6611d708edc1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a300902-48ba-46b4-9e50-c90491a1dbc8", "name": "network-vif-plugged", "status": "completed", "tag": "c8a11590-86f4-4ac0-9b15-c85d77417b60"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:22:12.197747 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-b8a20810-470a-4895-a6bf-789897a8a041 req-3818432a-044b-4603-ad78-6611d708edc1 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:12.198233 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-b8a20810-470a-4895-a6bf-789897a8a041 req-3818432a-044b-4603-ad78-6611d708edc1 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:12.198666 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-b8a20810-470a-4895-a6bf-789897a8a041 req-3818432a-044b-4603-ad78-6611d708edc1 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:12.210621 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-b8a20810-470a-4895-a6bf-789897a8a041 req-3818432a-044b-4603-ad78-6611d708edc1 service nova] Creating event network-vif-plugged:c8a11590-86f4-4ac0-9b15-c85d77417b60 for instance 5a300902-48ba-46b4-9e50-c90491a1dbc8 on n-h1-851028-13 Oct 04 19:22:12.215835 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-b8a20810-470a-4895-a6bf-789897a8a041 req-3818432a-044b-4603-ad78-6611d708edc1 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034934 Oct 04 19:22:12.216825 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3188/6747] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:22:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:22:12.304051 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f5d82af9-74b4-4799-b34b-a9c9700cab08 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:22:12.304588 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-f5d82af9-74b4-4799-b34b-a9c9700cab08 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: 5a300902-48ba-46b4-9e50-c90491a1dbc8] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:22:12.311681 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f5d82af9-74b4-4799-b34b-a9c9700cab08 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:12.312179 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f5d82af9-74b4-4799-b34b-a9c9700cab08 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:12.312635 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f5d82af9-74b4-4799-b34b-a9c9700cab08 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:12.313370 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f5d82af9-74b4-4799-b34b-a9c9700cab08 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:12.313842 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f5d82af9-74b4-4799-b34b-a9c9700cab08 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:12.314494 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f5d82af9-74b4-4799-b34b-a9c9700cab08 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:12.458119 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-f5d82af9-74b4-4799-b34b-a9c9700cab08 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:22:12.465909 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-f5d82af9-74b4-4799-b34b-a9c9700cab08 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/5a300902-48ba-46b4-9e50-c90491a1dbc8" status: 200 len: 1217 microversion: 2.1 time: 0.166011 Oct 04 19:22:12.466506 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3560/6748] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:22:12 2022] GET /compute/v2.1/servers/5a300902-48ba-46b4-9e50-c90491a1dbc8 => generated 1217 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:22:13.489633 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-364809da-9244-4db2-bbe4-b5774866036f tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:22:13.490402 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-364809da-9244-4db2-bbe4-b5774866036f tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: 5a300902-48ba-46b4-9e50-c90491a1dbc8] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:22:13.496698 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-364809da-9244-4db2-bbe4-b5774866036f tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:13.497254 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-364809da-9244-4db2-bbe4-b5774866036f tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:13.497704 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-364809da-9244-4db2-bbe4-b5774866036f tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:13.498419 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-364809da-9244-4db2-bbe4-b5774866036f tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:13.498874 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-364809da-9244-4db2-bbe4-b5774866036f tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:13.499309 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-364809da-9244-4db2-bbe4-b5774866036f tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:13.631199 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-364809da-9244-4db2-bbe4-b5774866036f tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:22:13.639079 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-364809da-9244-4db2-bbe4-b5774866036f tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/5a300902-48ba-46b4-9e50-c90491a1dbc8" status: 200 len: 1217 microversion: 2.1 time: 0.154892 Oct 04 19:22:13.639637 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3189/6749] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:22:13 2022] GET /compute/v2.1/servers/5a300902-48ba-46b4-9e50-c90491a1dbc8 => generated 1217 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:22:14.662795 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-1d8f4025-e72d-4b4b-9d46-8fbf2d02991f tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:22:14.663403 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-1d8f4025-e72d-4b4b-9d46-8fbf2d02991f tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: 5a300902-48ba-46b4-9e50-c90491a1dbc8] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:22:14.669756 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1d8f4025-e72d-4b4b-9d46-8fbf2d02991f tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:14.670237 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1d8f4025-e72d-4b4b-9d46-8fbf2d02991f tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:14.670672 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1d8f4025-e72d-4b4b-9d46-8fbf2d02991f tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:14.671362 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1d8f4025-e72d-4b4b-9d46-8fbf2d02991f tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:14.671812 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1d8f4025-e72d-4b4b-9d46-8fbf2d02991f tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:14.672238 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1d8f4025-e72d-4b4b-9d46-8fbf2d02991f tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:14.802238 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-1d8f4025-e72d-4b4b-9d46-8fbf2d02991f tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:22:14.809915 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-1d8f4025-e72d-4b4b-9d46-8fbf2d02991f tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/5a300902-48ba-46b4-9e50-c90491a1dbc8" status: 200 len: 1403 microversion: 2.1 time: 0.151040 Oct 04 19:22:14.810486 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3561/6750] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:22:14 2022] GET /compute/v2.1/servers/5a300902-48ba-46b4-9e50-c90491a1dbc8 => generated 1403 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:22:14.832561 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-ce1e0957-d1cc-4f5e-b0ec-7bec96e5e54e tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:22:14.833234 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-ce1e0957-d1cc-4f5e-b0ec-7bec96e5e54e tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: 5a300902-48ba-46b4-9e50-c90491a1dbc8] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:22:14.840301 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ce1e0957-d1cc-4f5e-b0ec-7bec96e5e54e tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:14.840790 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ce1e0957-d1cc-4f5e-b0ec-7bec96e5e54e tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:14.841260 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ce1e0957-d1cc-4f5e-b0ec-7bec96e5e54e tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:14.841960 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ce1e0957-d1cc-4f5e-b0ec-7bec96e5e54e tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:14.842417 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ce1e0957-d1cc-4f5e-b0ec-7bec96e5e54e tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:14.843266 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ce1e0957-d1cc-4f5e-b0ec-7bec96e5e54e tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:14.974221 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-ce1e0957-d1cc-4f5e-b0ec-7bec96e5e54e tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:22:14.982095 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-ce1e0957-d1cc-4f5e-b0ec-7bec96e5e54e tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/5a300902-48ba-46b4-9e50-c90491a1dbc8" status: 200 len: 1403 microversion: 2.1 time: 0.153631 Oct 04 19:22:14.982673 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3190/6751] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:22:14 2022] GET /compute/v2.1/servers/5a300902-48ba-46b4-9e50-c90491a1dbc8 => generated 1403 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:22:15.004682 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f90c3e11-431c-4d8a-a1ec-12d37fea0225 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-263023220"}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:22:15.007035 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-f90c3e11-431c-4d8a-a1ec-12d37fea0225 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: 5a300902-48ba-46b4-9e50-c90491a1dbc8] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:22:15.013148 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f90c3e11-431c-4d8a-a1ec-12d37fea0225 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:15.013641 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f90c3e11-431c-4d8a-a1ec-12d37fea0225 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:15.014082 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f90c3e11-431c-4d8a-a1ec-12d37fea0225 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:15.014771 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f90c3e11-431c-4d8a-a1ec-12d37fea0225 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:15.015223 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f90c3e11-431c-4d8a-a1ec-12d37fea0225 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:15.015653 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f90c3e11-431c-4d8a-a1ec-12d37fea0225 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:15.107307 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.compute.api [None req-f90c3e11-431c-4d8a-a1ec-12d37fea0225 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: 5a300902-48ba-46b4-9e50-c90491a1dbc8] Attempting to quiesce instance before volume snapshot. Oct 04 19:22:15.178847 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.compute.api [None req-f90c3e11-431c-4d8a-a1ec-12d37fea0225 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: 5a300902-48ba-46b4-9e50-c90491a1dbc8] Skipping quiescing instance because the operation is not supported by the underlying compute driver. Oct 04 19:22:15.248520 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-f90c3e11-431c-4d8a-a1ec-12d37fea0225 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: 5a300902-48ba-46b4-9e50-c90491a1dbc8] Creating snapshot from volume 06e0dec8-4ff9-4351-a097-253b9270fb72. {{(pid=123596) snapshot_instance /opt/stack/nova/nova/compute/api.py:3509}} Oct 04 19:22:16.136970 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-f90c3e11-431c-4d8a-a1ec-12d37fea0225 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "POST /compute/v2.1/servers/5a300902-48ba-46b4-9e50-c90491a1dbc8/action" status: 202 len: 0 microversion: 2.1 time: 1.136182 Oct 04 19:22:16.143821 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3562/6752] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 19:22:14 2022] POST /compute/v2.1/servers/5a300902-48ba-46b4-9e50-c90491a1dbc8/action => generated 0 bytes in 1138 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 04 19:22:17.295834 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-07ea0ed1-517c-4196-8a19-8f8ed86491c6 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-415955082", "imageRef": "8a14c60b-c106-4c5f-a33f-2e2f28a86b4a", "flavorRef": "452", "networks": [{"uuid": "2ddfee4a-681a-4b64-a4ab-40481cf11577"}]}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:22:17.351959 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.network.neutron [None req-07ea0ed1-517c-4196-8a19-8f8ed86491c6 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] validate_networks() for [('2ddfee4a-681a-4b64-a4ab-40481cf11577', None, None, None, None, None)] {{(pid=123595) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 19:22:17.714914 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-07ea0ed1-517c-4196-8a19-8f8ed86491c6 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Flavor limits 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:22:17.715348 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-07ea0ed1-517c-4196-8a19-8f8ed86491c6 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Image limits 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:22:17.715837 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-07ea0ed1-517c-4196-8a19-8f8ed86491c6 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Flavor pref 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:22:17.716258 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-07ea0ed1-517c-4196-8a19-8f8ed86491c6 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Image pref 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:22:17.716792 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-07ea0ed1-517c-4196-8a19-8f8ed86491c6 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:22:17.726379 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-07ea0ed1-517c-4196-8a19-8f8ed86491c6 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:17.726887 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-07ea0ed1-517c-4196-8a19-8f8ed86491c6 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:17.727332 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-07ea0ed1-517c-4196-8a19-8f8ed86491c6 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:17.728074 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-07ea0ed1-517c-4196-8a19-8f8ed86491c6 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:17.728539 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-07ea0ed1-517c-4196-8a19-8f8ed86491c6 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:17.728977 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-07ea0ed1-517c-4196-8a19-8f8ed86491c6 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:17.745813 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-07ea0ed1-517c-4196-8a19-8f8ed86491c6 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Getting quotas for project 9cd28590bda749c5aa109ae292cb32e6. Resources: {'ram', 'cores', 'instances'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:22:17.751658 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-07ea0ed1-517c-4196-8a19-8f8ed86491c6 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Getting quotas for user 43efdccf8e2f4934ae5cfe3da828511e and project 9cd28590bda749c5aa109ae292cb32e6. Resources: {'ram', 'cores', 'instances'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:22:17.764421 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-07ea0ed1-517c-4196-8a19-8f8ed86491c6 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Going to run 1 instances... {{(pid=123595) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 19:22:17.767024 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-07ea0ed1-517c-4196-8a19-8f8ed86491c6 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: e899b363-4d30-4b46-b1d1-939974abe265] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='a00e8a22-a730-400a-928d-0b4ccfcba474',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=123595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 19:22:17.848673 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-07ea0ed1-517c-4196-8a19-8f8ed86491c6 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.556732 Oct 04 19:22:17.849368 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3191/6753] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 19:22:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 558 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 19:22:17.862052 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-8211f92e-c6f5-4904-9182-b8393e9027a4 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:22:17.862773 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-8211f92e-c6f5-4904-9182-b8393e9027a4 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: e899b363-4d30-4b46-b1d1-939974abe265] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:22:17.919284 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-8211f92e-c6f5-4904-9182-b8393e9027a4 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:22:17.926365 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-8211f92e-c6f5-4904-9182-b8393e9027a4 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/e899b363-4d30-4b46-b1d1-939974abe265" status: 200 len: 1229 microversion: 2.1 time: 0.069612 Oct 04 19:22:17.926947 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3563/6754] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:22:17 2022] GET /compute/v2.1/servers/e899b363-4d30-4b46-b1d1-939974abe265 => generated 1229 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:22:18.949970 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-7b287952-0974-43ce-880d-3d791a0f564a tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:22:18.950655 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-7b287952-0974-43ce-880d-3d791a0f564a tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: e899b363-4d30-4b46-b1d1-939974abe265] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:22:18.958143 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7b287952-0974-43ce-880d-3d791a0f564a tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:18.958892 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7b287952-0974-43ce-880d-3d791a0f564a tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:18.959538 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7b287952-0974-43ce-880d-3d791a0f564a tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:18.960234 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7b287952-0974-43ce-880d-3d791a0f564a tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:18.960691 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7b287952-0974-43ce-880d-3d791a0f564a tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:18.961312 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7b287952-0974-43ce-880d-3d791a0f564a tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:19.034099 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-7b287952-0974-43ce-880d-3d791a0f564a tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:22:19.042518 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-7b287952-0974-43ce-880d-3d791a0f564a tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/e899b363-4d30-4b46-b1d1-939974abe265" status: 200 len: 1299 microversion: 2.1 time: 0.096726 Oct 04 19:22:19.057623 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3192/6755] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:22:18 2022] GET /compute/v2.1/servers/e899b363-4d30-4b46-b1d1-939974abe265 => generated 1299 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:22:20.067928 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-54d73541-285b-4416-9fff-17bc8d7f1b34 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:22:20.069634 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-54d73541-285b-4416-9fff-17bc8d7f1b34 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: e899b363-4d30-4b46-b1d1-939974abe265] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:22:20.077417 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-54d73541-285b-4416-9fff-17bc8d7f1b34 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:20.078284 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-54d73541-285b-4416-9fff-17bc8d7f1b34 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:20.078814 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-54d73541-285b-4416-9fff-17bc8d7f1b34 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:20.080319 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-54d73541-285b-4416-9fff-17bc8d7f1b34 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:20.080875 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-54d73541-285b-4416-9fff-17bc8d7f1b34 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:20.081421 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-54d73541-285b-4416-9fff-17bc8d7f1b34 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:20.292070 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-54d73541-285b-4416-9fff-17bc8d7f1b34 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:22:20.300937 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-54d73541-285b-4416-9fff-17bc8d7f1b34 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/e899b363-4d30-4b46-b1d1-939974abe265" status: 200 len: 1341 microversion: 2.1 time: 0.236815 Oct 04 19:22:20.302110 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3564/6756] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:22:20 2022] GET /compute/v2.1/servers/e899b363-4d30-4b46-b1d1-939974abe265 => generated 1341 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:22:20.435634 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-2db20709-879b-468f-955c-8627794a1214 req-e04a4ca0-7fdd-444e-88c4-c73d7816eabf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e899b363-4d30-4b46-b1d1-939974abe265", "tag": "a5ed5ffe-e77e-48e2-9763-378d47b26d88"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:22:20.452430 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-2db20709-879b-468f-955c-8627794a1214 req-e04a4ca0-7fdd-444e-88c4-c73d7816eabf service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:20.453432 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-2db20709-879b-468f-955c-8627794a1214 req-e04a4ca0-7fdd-444e-88c4-c73d7816eabf service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:20.454904 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-2db20709-879b-468f-955c-8627794a1214 req-e04a4ca0-7fdd-444e-88c4-c73d7816eabf service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:20.468269 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-2db20709-879b-468f-955c-8627794a1214 req-e04a4ca0-7fdd-444e-88c4-c73d7816eabf service nova] Creating event network-changed:a5ed5ffe-e77e-48e2-9763-378d47b26d88 for instance e899b363-4d30-4b46-b1d1-939974abe265 on n-h2-851028-13 Oct 04 19:22:20.474801 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-2db20709-879b-468f-955c-8627794a1214 req-e04a4ca0-7fdd-444e-88c4-c73d7816eabf service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045141 Oct 04 19:22:20.475570 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3193/6757] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:22:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:22:21.324503 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-ab249f64-2f28-4e1b-bea4-5ced11b285f9 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:22:21.325282 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-ab249f64-2f28-4e1b-bea4-5ced11b285f9 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: e899b363-4d30-4b46-b1d1-939974abe265] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:22:21.333081 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ab249f64-2f28-4e1b-bea4-5ced11b285f9 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:21.333687 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ab249f64-2f28-4e1b-bea4-5ced11b285f9 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:21.334222 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ab249f64-2f28-4e1b-bea4-5ced11b285f9 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:21.335013 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ab249f64-2f28-4e1b-bea4-5ced11b285f9 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:21.335581 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ab249f64-2f28-4e1b-bea4-5ced11b285f9 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:21.336100 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ab249f64-2f28-4e1b-bea4-5ced11b285f9 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:21.504142 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-ab249f64-2f28-4e1b-bea4-5ced11b285f9 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:22:21.512241 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-ab249f64-2f28-4e1b-bea4-5ced11b285f9 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/e899b363-4d30-4b46-b1d1-939974abe265" status: 200 len: 1341 microversion: 2.1 time: 0.191622 Oct 04 19:22:21.512822 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3565/6758] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:22:21 2022] GET /compute/v2.1/servers/e899b363-4d30-4b46-b1d1-939974abe265 => generated 1341 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:22:22.541000 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-655b5790-07a9-437a-b468-9e40d52b321a tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:22:22.542315 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-655b5790-07a9-437a-b468-9e40d52b321a tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: e899b363-4d30-4b46-b1d1-939974abe265] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:22:22.553531 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-655b5790-07a9-437a-b468-9e40d52b321a tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:22.553962 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-655b5790-07a9-437a-b468-9e40d52b321a tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:22.554408 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-655b5790-07a9-437a-b468-9e40d52b321a tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:22.555169 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-655b5790-07a9-437a-b468-9e40d52b321a tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:22.555801 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-655b5790-07a9-437a-b468-9e40d52b321a tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:22.556410 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-655b5790-07a9-437a-b468-9e40d52b321a tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:22.744992 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-655b5790-07a9-437a-b468-9e40d52b321a tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:22:22.756781 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-655b5790-07a9-437a-b468-9e40d52b321a tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/e899b363-4d30-4b46-b1d1-939974abe265" status: 200 len: 1341 microversion: 2.1 time: 0.222602 Oct 04 19:22:22.757526 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3194/6759] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:22:22 2022] GET /compute/v2.1/servers/e899b363-4d30-4b46-b1d1-939974abe265 => generated 1341 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:22:23.792327 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-5f2cd118-b229-454e-8399-adf7c9f71552 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:22:23.793708 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-5f2cd118-b229-454e-8399-adf7c9f71552 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: e899b363-4d30-4b46-b1d1-939974abe265] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:22:23.808123 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5f2cd118-b229-454e-8399-adf7c9f71552 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:23.809414 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5f2cd118-b229-454e-8399-adf7c9f71552 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:23.810372 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5f2cd118-b229-454e-8399-adf7c9f71552 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:23.811583 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5f2cd118-b229-454e-8399-adf7c9f71552 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:23.812818 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5f2cd118-b229-454e-8399-adf7c9f71552 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:23.814294 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5f2cd118-b229-454e-8399-adf7c9f71552 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:24.064754 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-5f2cd118-b229-454e-8399-adf7c9f71552 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:22:24.090282 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-5f2cd118-b229-454e-8399-adf7c9f71552 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/e899b363-4d30-4b46-b1d1-939974abe265" status: 200 len: 1341 microversion: 2.1 time: 0.305618 Oct 04 19:22:24.092949 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3566/6760] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:22:23 2022] GET /compute/v2.1/servers/e899b363-4d30-4b46-b1d1-939974abe265 => generated 1341 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:22:25.126351 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-ffb8e52a-8bfc-4dcc-8bc4-9497fe82d2fc tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:22:25.126962 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-ffb8e52a-8bfc-4dcc-8bc4-9497fe82d2fc tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: e899b363-4d30-4b46-b1d1-939974abe265] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:22:25.136800 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ffb8e52a-8bfc-4dcc-8bc4-9497fe82d2fc tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:25.137432 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ffb8e52a-8bfc-4dcc-8bc4-9497fe82d2fc tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:25.138251 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ffb8e52a-8bfc-4dcc-8bc4-9497fe82d2fc tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:25.139973 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ffb8e52a-8bfc-4dcc-8bc4-9497fe82d2fc tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:25.141065 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ffb8e52a-8bfc-4dcc-8bc4-9497fe82d2fc tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:25.141536 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ffb8e52a-8bfc-4dcc-8bc4-9497fe82d2fc tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:25.168882 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=74 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:22:25.316334 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-ffb8e52a-8bfc-4dcc-8bc4-9497fe82d2fc tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:22:25.324902 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-ffb8e52a-8bfc-4dcc-8bc4-9497fe82d2fc tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/e899b363-4d30-4b46-b1d1-939974abe265" status: 200 len: 1341 microversion: 2.1 time: 0.204958 Oct 04 19:22:25.337291 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3195/6761] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:22:25 2022] GET /compute/v2.1/servers/e899b363-4d30-4b46-b1d1-939974abe265 => generated 1341 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:22:26.349248 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-8ade91b8-43fe-42e4-83da-f6f93cb56f03 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:22:26.350067 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-8ade91b8-43fe-42e4-83da-f6f93cb56f03 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: e899b363-4d30-4b46-b1d1-939974abe265] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:22:26.353184 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_api:SELECT=35 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:22:26.358206 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8ade91b8-43fe-42e4-83da-f6f93cb56f03 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:26.358701 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8ade91b8-43fe-42e4-83da-f6f93cb56f03 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:26.359163 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8ade91b8-43fe-42e4-83da-f6f93cb56f03 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:26.359965 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8ade91b8-43fe-42e4-83da-f6f93cb56f03 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:26.360577 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8ade91b8-43fe-42e4-83da-f6f93cb56f03 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:26.361030 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8ade91b8-43fe-42e4-83da-f6f93cb56f03 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:26.376835 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=87,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:22:26.496180 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-8ade91b8-43fe-42e4-83da-f6f93cb56f03 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:22:26.505196 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-8ade91b8-43fe-42e4-83da-f6f93cb56f03 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/e899b363-4d30-4b46-b1d1-939974abe265" status: 200 len: 1341 microversion: 2.1 time: 0.160001 Oct 04 19:22:26.506159 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3567/6762] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:22:26 2022] GET /compute/v2.1/servers/e899b363-4d30-4b46-b1d1-939974abe265 => generated 1341 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:22:27.529380 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-7b34e887-3fdf-4147-ab2c-c3c86a6db9e8 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:22:27.529951 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-7b34e887-3fdf-4147-ab2c-c3c86a6db9e8 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: e899b363-4d30-4b46-b1d1-939974abe265] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:22:27.532615 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=6 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:22:27.538076 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7b34e887-3fdf-4147-ab2c-c3c86a6db9e8 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:27.538567 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7b34e887-3fdf-4147-ab2c-c3c86a6db9e8 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:27.539010 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7b34e887-3fdf-4147-ab2c-c3c86a6db9e8 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:27.539711 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7b34e887-3fdf-4147-ab2c-c3c86a6db9e8 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:27.540167 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7b34e887-3fdf-4147-ab2c-c3c86a6db9e8 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:27.540597 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7b34e887-3fdf-4147-ab2c-c3c86a6db9e8 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:27.668391 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-7b34e887-3fdf-4147-ab2c-c3c86a6db9e8 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:22:27.676891 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-7b34e887-3fdf-4147-ab2c-c3c86a6db9e8 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/e899b363-4d30-4b46-b1d1-939974abe265" status: 200 len: 1341 microversion: 2.1 time: 0.151553 Oct 04 19:22:27.677510 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3196/6763] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:22:27 2022] GET /compute/v2.1/servers/e899b363-4d30-4b46-b1d1-939974abe265 => generated 1341 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:22:28.699785 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-3493eb7a-04b7-4506-b4ff-43f770290e2d tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:22:28.700449 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-3493eb7a-04b7-4506-b4ff-43f770290e2d tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: e899b363-4d30-4b46-b1d1-939974abe265] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:22:28.703306 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=2 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:22:28.711264 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3493eb7a-04b7-4506-b4ff-43f770290e2d tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:28.711772 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3493eb7a-04b7-4506-b4ff-43f770290e2d tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:28.712224 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3493eb7a-04b7-4506-b4ff-43f770290e2d tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:28.712944 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3493eb7a-04b7-4506-b4ff-43f770290e2d tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:28.713454 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3493eb7a-04b7-4506-b4ff-43f770290e2d tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:28.713897 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3493eb7a-04b7-4506-b4ff-43f770290e2d tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:28.850265 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-3493eb7a-04b7-4506-b4ff-43f770290e2d tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:22:28.860044 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-3493eb7a-04b7-4506-b4ff-43f770290e2d tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/e899b363-4d30-4b46-b1d1-939974abe265" status: 200 len: 1341 microversion: 2.1 time: 0.164086 Oct 04 19:22:28.860636 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3568/6764] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:22:28 2022] GET /compute/v2.1/servers/e899b363-4d30-4b46-b1d1-939974abe265 => generated 1341 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:22:29.883952 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-a45e8117-64fc-432e-b4b2-89610f570cae tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:22:29.884567 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-a45e8117-64fc-432e-b4b2-89610f570cae tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: e899b363-4d30-4b46-b1d1-939974abe265] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:22:29.886481 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=2 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:22:29.887146 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=6 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:22:29.895251 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a45e8117-64fc-432e-b4b2-89610f570cae tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:29.895818 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a45e8117-64fc-432e-b4b2-89610f570cae tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:29.896298 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a45e8117-64fc-432e-b4b2-89610f570cae tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:29.897144 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a45e8117-64fc-432e-b4b2-89610f570cae tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:29.897625 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a45e8117-64fc-432e-b4b2-89610f570cae tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:29.898071 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a45e8117-64fc-432e-b4b2-89610f570cae tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:30.037897 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-a45e8117-64fc-432e-b4b2-89610f570cae tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:22:30.052539 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-a45e8117-64fc-432e-b4b2-89610f570cae tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/e899b363-4d30-4b46-b1d1-939974abe265" status: 200 len: 1341 microversion: 2.1 time: 0.171978 Oct 04 19:22:30.053682 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3197/6765] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:22:29 2022] GET /compute/v2.1/servers/e899b363-4d30-4b46-b1d1-939974abe265 => generated 1341 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:22:31.077233 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-e1f8ebfb-f336-46f2-a89d-393ddc0f306b tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:22:31.077871 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-e1f8ebfb-f336-46f2-a89d-393ddc0f306b tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: e899b363-4d30-4b46-b1d1-939974abe265] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:22:31.084874 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e1f8ebfb-f336-46f2-a89d-393ddc0f306b tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:31.085437 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e1f8ebfb-f336-46f2-a89d-393ddc0f306b tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:31.085901 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e1f8ebfb-f336-46f2-a89d-393ddc0f306b tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:31.086630 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e1f8ebfb-f336-46f2-a89d-393ddc0f306b tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:31.087101 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e1f8ebfb-f336-46f2-a89d-393ddc0f306b tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:31.087550 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e1f8ebfb-f336-46f2-a89d-393ddc0f306b tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:31.220979 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-e1f8ebfb-f336-46f2-a89d-393ddc0f306b tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:22:31.232982 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-e1f8ebfb-f336-46f2-a89d-393ddc0f306b tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/e899b363-4d30-4b46-b1d1-939974abe265" status: 200 len: 1341 microversion: 2.1 time: 0.159226 Oct 04 19:22:31.234381 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3569/6766] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:22:31 2022] GET /compute/v2.1/servers/e899b363-4d30-4b46-b1d1-939974abe265 => generated 1341 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:22:32.259123 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-2081e1ed-bef5-406a-8f93-9098ba62213f tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:22:32.259859 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-2081e1ed-bef5-406a-8f93-9098ba62213f tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: e899b363-4d30-4b46-b1d1-939974abe265] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:22:32.266891 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2081e1ed-bef5-406a-8f93-9098ba62213f tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:32.267371 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2081e1ed-bef5-406a-8f93-9098ba62213f tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:32.267811 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2081e1ed-bef5-406a-8f93-9098ba62213f tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:32.268502 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2081e1ed-bef5-406a-8f93-9098ba62213f tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:32.268952 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2081e1ed-bef5-406a-8f93-9098ba62213f tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:32.269407 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2081e1ed-bef5-406a-8f93-9098ba62213f tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:32.406191 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-2081e1ed-bef5-406a-8f93-9098ba62213f tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:22:32.414456 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-2081e1ed-bef5-406a-8f93-9098ba62213f tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/e899b363-4d30-4b46-b1d1-939974abe265" status: 200 len: 1341 microversion: 2.1 time: 0.159190 Oct 04 19:22:32.415041 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3198/6767] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:22:32 2022] GET /compute/v2.1/servers/e899b363-4d30-4b46-b1d1-939974abe265 => generated 1341 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:22:33.439138 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-49644956-5079-485e-abe9-0073c84f3584 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:22:33.439913 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-49644956-5079-485e-abe9-0073c84f3584 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: e899b363-4d30-4b46-b1d1-939974abe265] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:22:33.447872 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-49644956-5079-485e-abe9-0073c84f3584 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:33.448377 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-49644956-5079-485e-abe9-0073c84f3584 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:33.448835 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-49644956-5079-485e-abe9-0073c84f3584 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:33.449828 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-49644956-5079-485e-abe9-0073c84f3584 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:33.450542 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-49644956-5079-485e-abe9-0073c84f3584 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:33.451119 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-49644956-5079-485e-abe9-0073c84f3584 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:33.594889 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-49644956-5079-485e-abe9-0073c84f3584 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:22:33.603781 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-49644956-5079-485e-abe9-0073c84f3584 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/e899b363-4d30-4b46-b1d1-939974abe265" status: 200 len: 1387 microversion: 2.1 time: 0.169282 Oct 04 19:22:33.604371 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3570/6768] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:22:33 2022] GET /compute/v2.1/servers/e899b363-4d30-4b46-b1d1-939974abe265 => generated 1387 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:22:34.628500 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-2b607900-a7c5-48ca-858d-2dbdc21c36c7 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:22:34.629137 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-2b607900-a7c5-48ca-858d-2dbdc21c36c7 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: e899b363-4d30-4b46-b1d1-939974abe265] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:22:34.636192 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2b607900-a7c5-48ca-858d-2dbdc21c36c7 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:34.636686 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2b607900-a7c5-48ca-858d-2dbdc21c36c7 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:34.637823 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2b607900-a7c5-48ca-858d-2dbdc21c36c7 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:34.638533 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2b607900-a7c5-48ca-858d-2dbdc21c36c7 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:34.638992 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2b607900-a7c5-48ca-858d-2dbdc21c36c7 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:34.639427 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2b607900-a7c5-48ca-858d-2dbdc21c36c7 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:34.769397 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-2b607900-a7c5-48ca-858d-2dbdc21c36c7 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:22:34.777999 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-2b607900-a7c5-48ca-858d-2dbdc21c36c7 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/e899b363-4d30-4b46-b1d1-939974abe265" status: 200 len: 1375 microversion: 2.1 time: 0.152955 Oct 04 19:22:34.778578 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3199/6769] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:22:34 2022] GET /compute/v2.1/servers/e899b363-4d30-4b46-b1d1-939974abe265 => generated 1375 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:22:35.801403 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-4e9b44d1-1df1-41f1-b1b4-aa25c2ff3aec tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:22:35.802046 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-4e9b44d1-1df1-41f1-b1b4-aa25c2ff3aec tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: e899b363-4d30-4b46-b1d1-939974abe265] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:22:35.809155 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4e9b44d1-1df1-41f1-b1b4-aa25c2ff3aec tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:35.809671 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4e9b44d1-1df1-41f1-b1b4-aa25c2ff3aec tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:35.810133 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4e9b44d1-1df1-41f1-b1b4-aa25c2ff3aec tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:35.810847 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4e9b44d1-1df1-41f1-b1b4-aa25c2ff3aec tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:35.811342 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4e9b44d1-1df1-41f1-b1b4-aa25c2ff3aec tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:35.811775 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4e9b44d1-1df1-41f1-b1b4-aa25c2ff3aec tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:35.948636 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-4e9b44d1-1df1-41f1-b1b4-aa25c2ff3aec tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:22:35.956998 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-4e9b44d1-1df1-41f1-b1b4-aa25c2ff3aec tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/e899b363-4d30-4b46-b1d1-939974abe265" status: 200 len: 1375 microversion: 2.1 time: 0.159660 Oct 04 19:22:35.957613 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3571/6770] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:22:35 2022] GET /compute/v2.1/servers/e899b363-4d30-4b46-b1d1-939974abe265 => generated 1375 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:22:36.982503 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-fccf3dfb-1d9b-4714-b624-02e986d84aa6 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:22:36.983135 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-fccf3dfb-1d9b-4714-b624-02e986d84aa6 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: e899b363-4d30-4b46-b1d1-939974abe265] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:22:36.990900 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fccf3dfb-1d9b-4714-b624-02e986d84aa6 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:36.991413 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fccf3dfb-1d9b-4714-b624-02e986d84aa6 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:36.991857 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fccf3dfb-1d9b-4714-b624-02e986d84aa6 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:36.992578 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fccf3dfb-1d9b-4714-b624-02e986d84aa6 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:36.993037 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fccf3dfb-1d9b-4714-b624-02e986d84aa6 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:36.993509 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fccf3dfb-1d9b-4714-b624-02e986d84aa6 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:37.158739 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-fccf3dfb-1d9b-4714-b624-02e986d84aa6 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:22:37.167285 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-fccf3dfb-1d9b-4714-b624-02e986d84aa6 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/e899b363-4d30-4b46-b1d1-939974abe265" status: 200 len: 1375 microversion: 2.1 time: 0.189225 Oct 04 19:22:37.168749 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3200/6771] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:22:36 2022] GET /compute/v2.1/servers/e899b363-4d30-4b46-b1d1-939974abe265 => generated 1375 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:22:38.191076 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-3a4ebadd-fc82-41c0-863d-18b33d63f9ae tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:22:38.192163 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-3a4ebadd-fc82-41c0-863d-18b33d63f9ae tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: e899b363-4d30-4b46-b1d1-939974abe265] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:22:38.200725 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3a4ebadd-fc82-41c0-863d-18b33d63f9ae tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:38.201466 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3a4ebadd-fc82-41c0-863d-18b33d63f9ae tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:38.202085 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3a4ebadd-fc82-41c0-863d-18b33d63f9ae tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:38.203338 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3a4ebadd-fc82-41c0-863d-18b33d63f9ae tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:38.204114 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3a4ebadd-fc82-41c0-863d-18b33d63f9ae tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:38.204728 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3a4ebadd-fc82-41c0-863d-18b33d63f9ae tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:38.356043 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-3a4ebadd-fc82-41c0-863d-18b33d63f9ae tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:22:38.363857 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-3a4ebadd-fc82-41c0-863d-18b33d63f9ae tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/e899b363-4d30-4b46-b1d1-939974abe265" status: 200 len: 1375 microversion: 2.1 time: 0.177313 Oct 04 19:22:38.364442 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3572/6772] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:22:38 2022] GET /compute/v2.1/servers/e899b363-4d30-4b46-b1d1-939974abe265 => generated 1375 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:22:39.387839 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-71b49ffc-542b-4393-a68c-14ced99c4716 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:22:39.388528 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-71b49ffc-542b-4393-a68c-14ced99c4716 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: e899b363-4d30-4b46-b1d1-939974abe265] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:22:39.395358 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-71b49ffc-542b-4393-a68c-14ced99c4716 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:39.396103 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-71b49ffc-542b-4393-a68c-14ced99c4716 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:39.396537 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-71b49ffc-542b-4393-a68c-14ced99c4716 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:39.397281 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-71b49ffc-542b-4393-a68c-14ced99c4716 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:39.397764 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-71b49ffc-542b-4393-a68c-14ced99c4716 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:39.398151 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-71b49ffc-542b-4393-a68c-14ced99c4716 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:39.536110 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-71b49ffc-542b-4393-a68c-14ced99c4716 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:22:39.544942 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-71b49ffc-542b-4393-a68c-14ced99c4716 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/e899b363-4d30-4b46-b1d1-939974abe265" status: 200 len: 1375 microversion: 2.1 time: 0.161651 Oct 04 19:22:39.545501 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3201/6773] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:22:39 2022] GET /compute/v2.1/servers/e899b363-4d30-4b46-b1d1-939974abe265 => generated 1375 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:22:40.572015 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-130152a9-7d14-454a-9a20-f858f873fc67 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:22:40.572675 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-130152a9-7d14-454a-9a20-f858f873fc67 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: e899b363-4d30-4b46-b1d1-939974abe265] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:22:40.579683 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-130152a9-7d14-454a-9a20-f858f873fc67 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:40.580187 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-130152a9-7d14-454a-9a20-f858f873fc67 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:40.580645 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-130152a9-7d14-454a-9a20-f858f873fc67 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:40.581388 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-130152a9-7d14-454a-9a20-f858f873fc67 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:40.581859 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-130152a9-7d14-454a-9a20-f858f873fc67 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:40.582302 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-130152a9-7d14-454a-9a20-f858f873fc67 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:40.719585 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-130152a9-7d14-454a-9a20-f858f873fc67 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:22:40.727956 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-130152a9-7d14-454a-9a20-f858f873fc67 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/e899b363-4d30-4b46-b1d1-939974abe265" status: 200 len: 1375 microversion: 2.1 time: 0.159692 Oct 04 19:22:40.728401 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3573/6774] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:22:40 2022] GET /compute/v2.1/servers/e899b363-4d30-4b46-b1d1-939974abe265 => generated 1375 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:22:41.752733 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-2c72fb95-3069-4ef6-8596-f7721401f072 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:22:41.753394 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-2c72fb95-3069-4ef6-8596-f7721401f072 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: e899b363-4d30-4b46-b1d1-939974abe265] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:22:41.762488 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2c72fb95-3069-4ef6-8596-f7721401f072 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:41.763189 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2c72fb95-3069-4ef6-8596-f7721401f072 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:41.763910 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2c72fb95-3069-4ef6-8596-f7721401f072 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:41.764764 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2c72fb95-3069-4ef6-8596-f7721401f072 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:41.765500 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2c72fb95-3069-4ef6-8596-f7721401f072 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:41.766218 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2c72fb95-3069-4ef6-8596-f7721401f072 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:41.913461 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-2c72fb95-3069-4ef6-8596-f7721401f072 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:22:41.923823 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-2c72fb95-3069-4ef6-8596-f7721401f072 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/e899b363-4d30-4b46-b1d1-939974abe265" status: 200 len: 1375 microversion: 2.1 time: 0.176387 Oct 04 19:22:41.924741 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3202/6775] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:22:41 2022] GET /compute/v2.1/servers/e899b363-4d30-4b46-b1d1-939974abe265 => generated 1375 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:22:42.643778 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-e3dcab6a-6063-45e8-b640-81e70c647f93 req-6a25d551-362d-4326-b56e-2239c3532815 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e899b363-4d30-4b46-b1d1-939974abe265", "name": "network-vif-plugged", "status": "completed", "tag": "a5ed5ffe-e77e-48e2-9763-378d47b26d88"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:22:42.660918 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-e3dcab6a-6063-45e8-b640-81e70c647f93 req-6a25d551-362d-4326-b56e-2239c3532815 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:42.661459 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-e3dcab6a-6063-45e8-b640-81e70c647f93 req-6a25d551-362d-4326-b56e-2239c3532815 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:42.662181 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-e3dcab6a-6063-45e8-b640-81e70c647f93 req-6a25d551-362d-4326-b56e-2239c3532815 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:42.676985 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-e3dcab6a-6063-45e8-b640-81e70c647f93 req-6a25d551-362d-4326-b56e-2239c3532815 service nova] Creating event network-vif-plugged:a5ed5ffe-e77e-48e2-9763-378d47b26d88 for instance e899b363-4d30-4b46-b1d1-939974abe265 on n-h2-851028-13 Oct 04 19:22:42.684631 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-e3dcab6a-6063-45e8-b640-81e70c647f93 req-6a25d551-362d-4326-b56e-2239c3532815 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046032 Oct 04 19:22:42.685714 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3574/6776] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:22:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:22:42.953778 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-c7a1a1b7-386f-45e0-b0c4-317d5b9ef332 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:22:42.954509 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-c7a1a1b7-386f-45e0-b0c4-317d5b9ef332 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: e899b363-4d30-4b46-b1d1-939974abe265] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:22:42.960910 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c7a1a1b7-386f-45e0-b0c4-317d5b9ef332 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:42.961365 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c7a1a1b7-386f-45e0-b0c4-317d5b9ef332 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:42.961817 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c7a1a1b7-386f-45e0-b0c4-317d5b9ef332 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:42.962513 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c7a1a1b7-386f-45e0-b0c4-317d5b9ef332 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:42.962987 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c7a1a1b7-386f-45e0-b0c4-317d5b9ef332 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:42.963420 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c7a1a1b7-386f-45e0-b0c4-317d5b9ef332 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:43.101452 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-c7a1a1b7-386f-45e0-b0c4-317d5b9ef332 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:22:43.109501 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-c7a1a1b7-386f-45e0-b0c4-317d5b9ef332 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/e899b363-4d30-4b46-b1d1-939974abe265" status: 200 len: 1375 microversion: 2.1 time: 0.161528 Oct 04 19:22:43.110074 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3203/6777] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:22:42 2022] GET /compute/v2.1/servers/e899b363-4d30-4b46-b1d1-939974abe265 => generated 1375 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:22:44.133886 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-e9605fa4-1ee9-4545-9489-c8c3c293d2e2 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:22:44.135317 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-e9605fa4-1ee9-4545-9489-c8c3c293d2e2 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: e899b363-4d30-4b46-b1d1-939974abe265] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:22:44.144019 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e9605fa4-1ee9-4545-9489-c8c3c293d2e2 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:44.144786 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e9605fa4-1ee9-4545-9489-c8c3c293d2e2 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:44.145281 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e9605fa4-1ee9-4545-9489-c8c3c293d2e2 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:44.146014 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e9605fa4-1ee9-4545-9489-c8c3c293d2e2 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:44.146491 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e9605fa4-1ee9-4545-9489-c8c3c293d2e2 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:44.146940 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e9605fa4-1ee9-4545-9489-c8c3c293d2e2 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:44.652912 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-e9605fa4-1ee9-4545-9489-c8c3c293d2e2 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:22:44.661736 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-e9605fa4-1ee9-4545-9489-c8c3c293d2e2 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/e899b363-4d30-4b46-b1d1-939974abe265" status: 200 len: 1561 microversion: 2.1 time: 0.533243 Oct 04 19:22:44.662326 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3575/6778] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:22:44 2022] GET /compute/v2.1/servers/e899b363-4d30-4b46-b1d1-939974abe265 => generated 1561 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:22:44.685329 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-b8811bb6-700c-4127-9fd5-2530903809d4 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:22:44.685928 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-b8811bb6-700c-4127-9fd5-2530903809d4 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: e899b363-4d30-4b46-b1d1-939974abe265] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:22:44.692849 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b8811bb6-700c-4127-9fd5-2530903809d4 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:44.693564 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b8811bb6-700c-4127-9fd5-2530903809d4 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:44.693980 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b8811bb6-700c-4127-9fd5-2530903809d4 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:44.694655 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b8811bb6-700c-4127-9fd5-2530903809d4 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:44.695113 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b8811bb6-700c-4127-9fd5-2530903809d4 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:44.695544 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b8811bb6-700c-4127-9fd5-2530903809d4 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:44.827206 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-b8811bb6-700c-4127-9fd5-2530903809d4 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:22:44.836393 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-b8811bb6-700c-4127-9fd5-2530903809d4 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/e899b363-4d30-4b46-b1d1-939974abe265" status: 200 len: 1561 microversion: 2.1 time: 0.155492 Oct 04 19:22:44.837012 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3204/6779] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:22:44 2022] GET /compute/v2.1/servers/e899b363-4d30-4b46-b1d1-939974abe265 => generated 1561 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:22:44.927805 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-4331f123-28bf-4894-9158-f44fea3f4e97 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:22:44.928324 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-4331f123-28bf-4894-9158-f44fea3f4e97 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: e899b363-4d30-4b46-b1d1-939974abe265] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:22:44.935071 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4331f123-28bf-4894-9158-f44fea3f4e97 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:44.935572 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4331f123-28bf-4894-9158-f44fea3f4e97 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:44.936022 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4331f123-28bf-4894-9158-f44fea3f4e97 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:44.936725 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4331f123-28bf-4894-9158-f44fea3f4e97 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:44.937247 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4331f123-28bf-4894-9158-f44fea3f4e97 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:44.937666 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4331f123-28bf-4894-9158-f44fea3f4e97 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:44.963536 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-4331f123-28bf-4894-9158-f44fea3f4e97 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: e899b363-4d30-4b46-b1d1-939974abe265] Going to try to terminate instance {{(pid=123596) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 19:22:45.040449 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-4331f123-28bf-4894-9158-f44fea3f4e97 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "DELETE /compute/v2.1/servers/e899b363-4d30-4b46-b1d1-939974abe265" status: 204 len: 0 microversion: 2.1 time: 0.116953 Oct 04 19:22:45.041672 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3576/6780] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 19:22:44 2022] DELETE /compute/v2.1/servers/e899b363-4d30-4b46-b1d1-939974abe265 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:22:45.050489 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-54d57b8d-f721-4007-ac28-9626ae8b44be tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:22:45.051213 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-54d57b8d-f721-4007-ac28-9626ae8b44be tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: e899b363-4d30-4b46-b1d1-939974abe265] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:22:45.057480 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-54d57b8d-f721-4007-ac28-9626ae8b44be tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:45.057981 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-54d57b8d-f721-4007-ac28-9626ae8b44be tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:45.058442 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-54d57b8d-f721-4007-ac28-9626ae8b44be tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:45.059135 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-54d57b8d-f721-4007-ac28-9626ae8b44be tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:45.059620 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-54d57b8d-f721-4007-ac28-9626ae8b44be tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:45.060055 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-54d57b8d-f721-4007-ac28-9626ae8b44be tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:45.203475 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-54d57b8d-f721-4007-ac28-9626ae8b44be tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:22:45.212778 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-54d57b8d-f721-4007-ac28-9626ae8b44be tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/e899b363-4d30-4b46-b1d1-939974abe265" status: 200 len: 1567 microversion: 2.1 time: 0.166256 Oct 04 19:22:45.214039 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3205/6781] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:22:45 2022] GET /compute/v2.1/servers/e899b363-4d30-4b46-b1d1-939974abe265 => generated 1567 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:22:46.241626 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-a09f06cd-b63c-4944-a898-5562ddd51240 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:22:46.241626 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-a09f06cd-b63c-4944-a898-5562ddd51240 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: e899b363-4d30-4b46-b1d1-939974abe265] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:22:46.247369 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a09f06cd-b63c-4944-a898-5562ddd51240 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:46.248119 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a09f06cd-b63c-4944-a898-5562ddd51240 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:46.248577 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a09f06cd-b63c-4944-a898-5562ddd51240 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:46.249339 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a09f06cd-b63c-4944-a898-5562ddd51240 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:46.249895 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a09f06cd-b63c-4944-a898-5562ddd51240 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:46.250345 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a09f06cd-b63c-4944-a898-5562ddd51240 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:46.384689 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-a09f06cd-b63c-4944-a898-5562ddd51240 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:22:46.393250 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-a09f06cd-b63c-4944-a898-5562ddd51240 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/e899b363-4d30-4b46-b1d1-939974abe265" status: 200 len: 1567 microversion: 2.1 time: 0.159009 Oct 04 19:22:46.394498 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3577/6782] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:22:46 2022] GET /compute/v2.1/servers/e899b363-4d30-4b46-b1d1-939974abe265 => generated 1567 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:22:46.958704 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-d215a88c-7017-4739-ad3f-cce3b32007d1 req-e92df308-6563-445e-9ce1-7b9ce4eea209 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e899b363-4d30-4b46-b1d1-939974abe265", "name": "network-vif-deleted", "tag": "a5ed5ffe-e77e-48e2-9763-378d47b26d88"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:22:46.969271 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-d215a88c-7017-4739-ad3f-cce3b32007d1 req-e92df308-6563-445e-9ce1-7b9ce4eea209 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:46.969963 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-d215a88c-7017-4739-ad3f-cce3b32007d1 req-e92df308-6563-445e-9ce1-7b9ce4eea209 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:46.970864 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-d215a88c-7017-4739-ad3f-cce3b32007d1 req-e92df308-6563-445e-9ce1-7b9ce4eea209 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:46.990603 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-d215a88c-7017-4739-ad3f-cce3b32007d1 req-e92df308-6563-445e-9ce1-7b9ce4eea209 service nova] Creating event network-vif-deleted:a5ed5ffe-e77e-48e2-9763-378d47b26d88 for instance e899b363-4d30-4b46-b1d1-939974abe265 on n-h2-851028-13 Oct 04 19:22:46.996979 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-d215a88c-7017-4739-ad3f-cce3b32007d1 req-e92df308-6563-445e-9ce1-7b9ce4eea209 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042364 Oct 04 19:22:46.998941 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3206/6783] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:22:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:22:47.418396 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-687be395-de3b-4adf-9e03-4c1c0662bd05 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:22:47.418947 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-687be395-de3b-4adf-9e03-4c1c0662bd05 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: e899b363-4d30-4b46-b1d1-939974abe265] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:22:47.425877 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-687be395-de3b-4adf-9e03-4c1c0662bd05 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:47.426384 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-687be395-de3b-4adf-9e03-4c1c0662bd05 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:47.427029 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-687be395-de3b-4adf-9e03-4c1c0662bd05 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:47.427753 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-687be395-de3b-4adf-9e03-4c1c0662bd05 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:47.428222 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-687be395-de3b-4adf-9e03-4c1c0662bd05 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:47.428671 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-687be395-de3b-4adf-9e03-4c1c0662bd05 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:47.495937 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-687be395-de3b-4adf-9e03-4c1c0662bd05 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:22:47.503850 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-687be395-de3b-4adf-9e03-4c1c0662bd05 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/e899b363-4d30-4b46-b1d1-939974abe265" status: 200 len: 1360 microversion: 2.1 time: 0.090136 Oct 04 19:22:47.504425 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3578/6784] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:22:47 2022] GET /compute/v2.1/servers/e899b363-4d30-4b46-b1d1-939974abe265 => generated 1360 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:22:48.529062 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-4324d9f8-9a37-4646-8f4e-ce36daf2c903 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:22:48.529792 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-4324d9f8-9a37-4646-8f4e-ce36daf2c903 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: e899b363-4d30-4b46-b1d1-939974abe265] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:22:48.536219 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4324d9f8-9a37-4646-8f4e-ce36daf2c903 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:48.536710 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4324d9f8-9a37-4646-8f4e-ce36daf2c903 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:48.537169 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4324d9f8-9a37-4646-8f4e-ce36daf2c903 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:48.537873 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4324d9f8-9a37-4646-8f4e-ce36daf2c903 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:48.538328 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4324d9f8-9a37-4646-8f4e-ce36daf2c903 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:48.538764 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4324d9f8-9a37-4646-8f4e-ce36daf2c903 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:48.603580 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-4324d9f8-9a37-4646-8f4e-ce36daf2c903 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:22:48.612670 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-4324d9f8-9a37-4646-8f4e-ce36daf2c903 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/e899b363-4d30-4b46-b1d1-939974abe265" status: 200 len: 1360 microversion: 2.1 time: 0.089035 Oct 04 19:22:48.613302 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3207/6785] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:22:48 2022] GET /compute/v2.1/servers/e899b363-4d30-4b46-b1d1-939974abe265 => generated 1360 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:22:49.638445 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-ad725a1e-7157-44dd-8f97-55f99ade8a39 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:22:49.639186 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-ad725a1e-7157-44dd-8f97-55f99ade8a39 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: e899b363-4d30-4b46-b1d1-939974abe265] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:22:49.646462 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ad725a1e-7157-44dd-8f97-55f99ade8a39 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:49.647011 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ad725a1e-7157-44dd-8f97-55f99ade8a39 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:49.647601 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ad725a1e-7157-44dd-8f97-55f99ade8a39 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:49.648328 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ad725a1e-7157-44dd-8f97-55f99ade8a39 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:49.648806 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ad725a1e-7157-44dd-8f97-55f99ade8a39 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:49.649283 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ad725a1e-7157-44dd-8f97-55f99ade8a39 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:49.722504 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-ad725a1e-7157-44dd-8f97-55f99ade8a39 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:22:49.731244 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-ad725a1e-7157-44dd-8f97-55f99ade8a39 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/e899b363-4d30-4b46-b1d1-939974abe265" status: 200 len: 1360 microversion: 2.1 time: 0.097797 Oct 04 19:22:49.731814 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3579/6786] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:22:49 2022] GET /compute/v2.1/servers/e899b363-4d30-4b46-b1d1-939974abe265 => generated 1360 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:22:50.754067 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-62748a60-40c7-4c67-b0ad-1c6883600686 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:22:50.754673 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-62748a60-40c7-4c67-b0ad-1c6883600686 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: e899b363-4d30-4b46-b1d1-939974abe265] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:22:50.762304 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-62748a60-40c7-4c67-b0ad-1c6883600686 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:50.762788 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-62748a60-40c7-4c67-b0ad-1c6883600686 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:50.763229 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-62748a60-40c7-4c67-b0ad-1c6883600686 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:50.763927 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-62748a60-40c7-4c67-b0ad-1c6883600686 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:50.764701 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-62748a60-40c7-4c67-b0ad-1c6883600686 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:50.764798 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-62748a60-40c7-4c67-b0ad-1c6883600686 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:50.837766 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-62748a60-40c7-4c67-b0ad-1c6883600686 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:22:50.846732 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-62748a60-40c7-4c67-b0ad-1c6883600686 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/e899b363-4d30-4b46-b1d1-939974abe265" status: 200 len: 1360 microversion: 2.1 time: 0.096530 Oct 04 19:22:50.847579 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3208/6787] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:22:50 2022] GET /compute/v2.1/servers/e899b363-4d30-4b46-b1d1-939974abe265 => generated 1360 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:22:51.874325 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-58befdc4-fbfe-4958-a11b-9e95fe7a0fa6 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:22:51.876063 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-58befdc4-fbfe-4958-a11b-9e95fe7a0fa6 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: e899b363-4d30-4b46-b1d1-939974abe265] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:22:51.885977 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-58befdc4-fbfe-4958-a11b-9e95fe7a0fa6 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:51.886527 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-58befdc4-fbfe-4958-a11b-9e95fe7a0fa6 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:51.887283 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-58befdc4-fbfe-4958-a11b-9e95fe7a0fa6 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:51.887858 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-58befdc4-fbfe-4958-a11b-9e95fe7a0fa6 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:51.888374 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-58befdc4-fbfe-4958-a11b-9e95fe7a0fa6 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:51.888853 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-58befdc4-fbfe-4958-a11b-9e95fe7a0fa6 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:51.907232 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-58befdc4-fbfe-4958-a11b-9e95fe7a0fa6 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] HTTP exception thrown: Instance e899b363-4d30-4b46-b1d1-939974abe265 could not be found. Oct 04 19:22:51.909255 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-58befdc4-fbfe-4958-a11b-9e95fe7a0fa6 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Request method failure captured: Oct 04 19:22:51.909255 n-d-851028-13 devstack@n-api.service[123596]: request: GET /compute/v2.1/servers/e899b363-4d30-4b46-b1d1-939974abe265 HTTP/1.1 Oct 04 19:22:51.909255 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 19:22:51.909255 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 19:22:51.909255 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 19:22:51.909255 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 19:22:51.909255 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 19:22:51.909255 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 19:22:51.909255 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 19:22:51.909255 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 19:22:51.909255 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPIdD9eu-sNppZso9GBgF0qiQcNSNfbptUObqTJdNMmQeJtmiNalN1HCCgoRlIsnKAnm3yDfemx5F9JCBtqQ5VFIZ41axYIUJNVoTUZoGs-EEXp4RLTVvMn1M_mAUAx-w46wS7k3RPeCrtItzG8FEbUjMK8RLhn-Xr_i-jB7aqW9aWok Oct 04 19:22:51.909255 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 19:22:51.909255 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 19:22:51.909255 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 19:22:51.909255 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 19:22:51.909255 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 19:22:51.909255 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 19:22:51.909255 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: 9cd28590bda749c5aa109ae292cb32e6 Oct 04 19:22:51.909255 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-TestVolumeBootPattern-410499789 Oct 04 19:22:51.909255 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 19:22:51.909255 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 19:22:51.909255 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/9cd28590bda749c5aa109ae292cb32e6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_9cd28590bda749c5aa109ae292cb32e6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/9cd28590bda749c5aa109ae292cb32e6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/9cd28590bda749c5aa109ae292cb32e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 19:22:51.909255 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-TestVolumeBootPattern-410499789 Oct 04 19:22:51.909255 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: 9cd28590bda749c5aa109ae292cb32e6 Oct 04 19:22:51.909255 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-TestVolumeBootPattern-410499789 Oct 04 19:22:51.909255 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-TestVolumeBootPattern-410499789-project Oct 04 19:22:51.909255 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 19:22:51.909255 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 19:22:51.909255 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 43efdccf8e2f4934ae5cfe3da828511e Oct 04 19:22:51.909255 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-TestVolumeBootPattern-410499789-project Oct 04 19:22:51.909255 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 19:22:51.909255 n-d-851028-13 devstack@n-api.service[123596]: exception: Instance e899b363-4d30-4b46-b1d1-939974abe265 could not be found. Oct 04 19:22:51.909255 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': 'e899b363-4d30-4b46-b1d1-939974abe265'} Oct 04 19:22:51.909255 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:22:51.909255 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:22:51.909255 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:22:51.909255 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:22:51.909255 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:22:51.909255 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:22:51.909255 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:22:51.909255 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:22:51.909255 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:22:51.909255 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:22:51.909255 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e899b363-4d30-4b46-b1d1-939974abe265 could not be found. Oct 04 19:22:51.909255 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:22:51.909255 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:22:51.909255 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:22:51.909255 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:22:51.909255 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:22:51.909255 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:22:51.909255 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:22:51.909255 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:22:51.909255 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:22:51.909255 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:22:51.909255 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:22:51.909255 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:22:51.909255 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:22:51.909255 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:22:51.909255 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:22:51.909255 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:22:51.909255 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e899b363-4d30-4b46-b1d1-939974abe265 could not be found. Oct 04 19:22:51.909255 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:22:51.909255 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:22:51.909255 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:22:51.921752 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:22:51.921752 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:22:51.921752 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:22:51.921752 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:22:51.921752 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:22:51.921752 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e899b363-4d30-4b46-b1d1-939974abe265 could not be found. Oct 04 19:22:51.921752 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:22:51.921752 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-58befdc4-fbfe-4958-a11b-9e95fe7a0fa6 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Returning 404 to user: Instance e899b363-4d30-4b46-b1d1-939974abe265 could not be found. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:22:51.921752 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-58befdc4-fbfe-4958-a11b-9e95fe7a0fa6 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/e899b363-4d30-4b46-b1d1-939974abe265" status: 404 len: 111 microversion: 2.1 time: 0.041933 Oct 04 19:22:51.921752 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3580/6788] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:22:51 2022] GET /compute/v2.1/servers/e899b363-4d30-4b46-b1d1-939974abe265 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:22:57.323552 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-0ba8aac0-ee89-417a-84d2-de205b23cf12 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:22:57.324034 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-0ba8aac0-ee89-417a-84d2-de205b23cf12 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: 5a300902-48ba-46b4-9e50-c90491a1dbc8] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:22:57.331141 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0ba8aac0-ee89-417a-84d2-de205b23cf12 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:57.331634 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0ba8aac0-ee89-417a-84d2-de205b23cf12 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:57.332076 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0ba8aac0-ee89-417a-84d2-de205b23cf12 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:57.332784 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0ba8aac0-ee89-417a-84d2-de205b23cf12 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:57.333306 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0ba8aac0-ee89-417a-84d2-de205b23cf12 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:57.333718 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0ba8aac0-ee89-417a-84d2-de205b23cf12 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:57.337177 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=77 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:22:57.361706 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-0ba8aac0-ee89-417a-84d2-de205b23cf12 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: 5a300902-48ba-46b4-9e50-c90491a1dbc8] Going to try to terminate instance {{(pid=123595) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 19:22:57.437869 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-0ba8aac0-ee89-417a-84d2-de205b23cf12 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "DELETE /compute/v2.1/servers/5a300902-48ba-46b4-9e50-c90491a1dbc8" status: 204 len: 0 microversion: 2.1 time: 0.118391 Oct 04 19:22:57.438651 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3209/6789] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 19:22:57 2022] DELETE /compute/v2.1/servers/5a300902-48ba-46b4-9e50-c90491a1dbc8 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:22:57.447723 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-09bc7c8e-e9b2-4620-a33f-a06c60874e60 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:22:57.448353 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-09bc7c8e-e9b2-4620-a33f-a06c60874e60 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: 5a300902-48ba-46b4-9e50-c90491a1dbc8] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:22:57.451305 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:22:57.458024 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-09bc7c8e-e9b2-4620-a33f-a06c60874e60 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:57.458528 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-09bc7c8e-e9b2-4620-a33f-a06c60874e60 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:57.458996 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-09bc7c8e-e9b2-4620-a33f-a06c60874e60 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:57.459788 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-09bc7c8e-e9b2-4620-a33f-a06c60874e60 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:57.460269 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-09bc7c8e-e9b2-4620-a33f-a06c60874e60 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:57.460724 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-09bc7c8e-e9b2-4620-a33f-a06c60874e60 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:57.466696 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:22:57.602083 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-09bc7c8e-e9b2-4620-a33f-a06c60874e60 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:22:57.610208 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-09bc7c8e-e9b2-4620-a33f-a06c60874e60 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/5a300902-48ba-46b4-9e50-c90491a1dbc8" status: 200 len: 1409 microversion: 2.1 time: 0.166957 Oct 04 19:22:57.610799 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3581/6790] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:22:57 2022] GET /compute/v2.1/servers/5a300902-48ba-46b4-9e50-c90491a1dbc8 => generated 1409 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:22:58.633973 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-b5801142-9c1e-4868-98be-09dc25dc5559 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:22:58.634659 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-b5801142-9c1e-4868-98be-09dc25dc5559 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: 5a300902-48ba-46b4-9e50-c90491a1dbc8] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:22:58.637451 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:22:58.646757 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b5801142-9c1e-4868-98be-09dc25dc5559 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:58.647250 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b5801142-9c1e-4868-98be-09dc25dc5559 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:58.647686 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b5801142-9c1e-4868-98be-09dc25dc5559 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:58.648913 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b5801142-9c1e-4868-98be-09dc25dc5559 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:58.649516 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b5801142-9c1e-4868-98be-09dc25dc5559 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:58.649947 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b5801142-9c1e-4868-98be-09dc25dc5559 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:58.787005 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-b5801142-9c1e-4868-98be-09dc25dc5559 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:22:58.796175 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-b5801142-9c1e-4868-98be-09dc25dc5559 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/5a300902-48ba-46b4-9e50-c90491a1dbc8" status: 200 len: 1409 microversion: 2.1 time: 0.166400 Oct 04 19:22:58.796742 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3210/6791] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:22:58 2022] GET /compute/v2.1/servers/5a300902-48ba-46b4-9e50-c90491a1dbc8 => generated 1409 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:22:59.592268 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-8047c61e-f12a-44e6-adee-845dd1661c66 req-75621dc8-ce57-43aa-a728-cde4bce6b090 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a300902-48ba-46b4-9e50-c90491a1dbc8", "name": "network-vif-deleted", "tag": "c8a11590-86f4-4ac0-9b15-c85d77417b60"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:22:59.604158 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-8047c61e-f12a-44e6-adee-845dd1661c66 req-75621dc8-ce57-43aa-a728-cde4bce6b090 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:59.604666 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-8047c61e-f12a-44e6-adee-845dd1661c66 req-75621dc8-ce57-43aa-a728-cde4bce6b090 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:59.605136 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-8047c61e-f12a-44e6-adee-845dd1661c66 req-75621dc8-ce57-43aa-a728-cde4bce6b090 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:59.617820 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-8047c61e-f12a-44e6-adee-845dd1661c66 req-75621dc8-ce57-43aa-a728-cde4bce6b090 service nova] Creating event network-vif-deleted:c8a11590-86f4-4ac0-9b15-c85d77417b60 for instance 5a300902-48ba-46b4-9e50-c90491a1dbc8 on n-h1-851028-13 Oct 04 19:22:59.623268 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-8047c61e-f12a-44e6-adee-845dd1661c66 req-75621dc8-ce57-43aa-a728-cde4bce6b090 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034748 Oct 04 19:22:59.625186 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3582/6792] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:22:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:22:59.819443 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-c97066f7-81b7-49bb-a3ea-19c834f2c4a4 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:22:59.820472 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-c97066f7-81b7-49bb-a3ea-19c834f2c4a4 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: 5a300902-48ba-46b4-9e50-c90491a1dbc8] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:22:59.827709 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c97066f7-81b7-49bb-a3ea-19c834f2c4a4 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:59.828198 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c97066f7-81b7-49bb-a3ea-19c834f2c4a4 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:59.828639 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c97066f7-81b7-49bb-a3ea-19c834f2c4a4 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:59.829371 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c97066f7-81b7-49bb-a3ea-19c834f2c4a4 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:59.829828 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c97066f7-81b7-49bb-a3ea-19c834f2c4a4 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:59.830259 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c97066f7-81b7-49bb-a3ea-19c834f2c4a4 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:59.897441 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-c97066f7-81b7-49bb-a3ea-19c834f2c4a4 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:22:59.907111 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-c97066f7-81b7-49bb-a3ea-19c834f2c4a4 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/5a300902-48ba-46b4-9e50-c90491a1dbc8" status: 200 len: 1202 microversion: 2.1 time: 0.091657 Oct 04 19:22:59.907937 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3211/6793] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:22:59 2022] GET /compute/v2.1/servers/5a300902-48ba-46b4-9e50-c90491a1dbc8 => generated 1202 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:23:00.932207 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-46de166e-9a21-442d-85fd-fddba2417fb8 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:23:00.932964 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-46de166e-9a21-442d-85fd-fddba2417fb8 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: 5a300902-48ba-46b4-9e50-c90491a1dbc8] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:23:00.939604 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-46de166e-9a21-442d-85fd-fddba2417fb8 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:00.940129 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-46de166e-9a21-442d-85fd-fddba2417fb8 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:00.940614 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-46de166e-9a21-442d-85fd-fddba2417fb8 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:00.941383 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-46de166e-9a21-442d-85fd-fddba2417fb8 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:00.941873 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-46de166e-9a21-442d-85fd-fddba2417fb8 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:00.942327 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-46de166e-9a21-442d-85fd-fddba2417fb8 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:01.014110 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-46de166e-9a21-442d-85fd-fddba2417fb8 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:23:01.022497 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-46de166e-9a21-442d-85fd-fddba2417fb8 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/5a300902-48ba-46b4-9e50-c90491a1dbc8" status: 200 len: 1202 microversion: 2.1 time: 0.095922 Oct 04 19:23:01.023632 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3583/6794] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:23:00 2022] GET /compute/v2.1/servers/5a300902-48ba-46b4-9e50-c90491a1dbc8 => generated 1202 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:23:02.047460 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-25770359-9f5b-464e-966e-65aa22494dba tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:23:02.048222 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-25770359-9f5b-464e-966e-65aa22494dba tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: 5a300902-48ba-46b4-9e50-c90491a1dbc8] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:23:02.056783 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-25770359-9f5b-464e-966e-65aa22494dba tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:02.057248 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-25770359-9f5b-464e-966e-65aa22494dba tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:02.057695 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-25770359-9f5b-464e-966e-65aa22494dba tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:02.058421 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-25770359-9f5b-464e-966e-65aa22494dba tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:02.059066 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-25770359-9f5b-464e-966e-65aa22494dba tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:02.059518 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-25770359-9f5b-464e-966e-65aa22494dba tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:02.123735 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-25770359-9f5b-464e-966e-65aa22494dba tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:23:02.132117 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-25770359-9f5b-464e-966e-65aa22494dba tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/5a300902-48ba-46b4-9e50-c90491a1dbc8" status: 200 len: 1202 microversion: 2.1 time: 0.088651 Oct 04 19:23:02.132700 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3212/6795] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:23:02 2022] GET /compute/v2.1/servers/5a300902-48ba-46b4-9e50-c90491a1dbc8 => generated 1202 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:23:03.155746 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-3094d750-d9db-4fa8-a150-f3a78e627018 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:23:03.156350 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-3094d750-d9db-4fa8-a150-f3a78e627018 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: 5a300902-48ba-46b4-9e50-c90491a1dbc8] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:23:03.164131 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3094d750-d9db-4fa8-a150-f3a78e627018 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:03.164645 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3094d750-d9db-4fa8-a150-f3a78e627018 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:03.165158 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3094d750-d9db-4fa8-a150-f3a78e627018 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:03.165886 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3094d750-d9db-4fa8-a150-f3a78e627018 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:03.166397 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3094d750-d9db-4fa8-a150-f3a78e627018 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:03.166849 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3094d750-d9db-4fa8-a150-f3a78e627018 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:03.231214 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-3094d750-d9db-4fa8-a150-f3a78e627018 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:23:03.239099 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-3094d750-d9db-4fa8-a150-f3a78e627018 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/5a300902-48ba-46b4-9e50-c90491a1dbc8" status: 200 len: 1202 microversion: 2.1 time: 0.087690 Oct 04 19:23:03.239680 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3584/6796] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:23:03 2022] GET /compute/v2.1/servers/5a300902-48ba-46b4-9e50-c90491a1dbc8 => generated 1202 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:23:04.266988 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-3e689265-423d-4068-99ba-2360fc3d179a tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:23:04.268285 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-3e689265-423d-4068-99ba-2360fc3d179a tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: 5a300902-48ba-46b4-9e50-c90491a1dbc8] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:23:04.281982 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3e689265-423d-4068-99ba-2360fc3d179a tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:04.282915 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3e689265-423d-4068-99ba-2360fc3d179a tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:04.283742 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3e689265-423d-4068-99ba-2360fc3d179a tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:04.285003 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3e689265-423d-4068-99ba-2360fc3d179a tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:04.285924 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3e689265-423d-4068-99ba-2360fc3d179a tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:04.286706 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3e689265-423d-4068-99ba-2360fc3d179a tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:04.317571 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-3e689265-423d-4068-99ba-2360fc3d179a tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] HTTP exception thrown: Instance 5a300902-48ba-46b4-9e50-c90491a1dbc8 could not be found. Oct 04 19:23:04.320719 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-3e689265-423d-4068-99ba-2360fc3d179a tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Request method failure captured: Oct 04 19:23:04.320719 n-d-851028-13 devstack@n-api.service[123595]: request: GET /compute/v2.1/servers/5a300902-48ba-46b4-9e50-c90491a1dbc8 HTTP/1.1 Oct 04 19:23:04.320719 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 19:23:04.320719 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 19:23:04.320719 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 19:23:04.320719 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 0 Oct 04 19:23:04.320719 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 19:23:04.320719 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 19:23:04.320719 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 19:23:04.320719 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 19:23:04.320719 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPIdD9eu-sNppZso9GBgF0qiQcNSNfbptUObqTJdNMmQeJtmiNalN1HCCgoRlIsnKAnm3yDfemx5F9JCBtqQ5VFIZ41axYIUJNVoTUZoGs-EEXp4RLTVvMn1M_mAUAx-w46wS7k3RPeCrtItzG8FEbUjMK8RLhn-Xr_i-jB7aqW9aWok Oct 04 19:23:04.320719 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 19:23:04.320719 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 19:23:04.320719 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 19:23:04.320719 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 19:23:04.320719 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 19:23:04.320719 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 19:23:04.320719 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: 9cd28590bda749c5aa109ae292cb32e6 Oct 04 19:23:04.320719 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-TestVolumeBootPattern-410499789 Oct 04 19:23:04.320719 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 19:23:04.320719 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 19:23:04.320719 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/9cd28590bda749c5aa109ae292cb32e6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_9cd28590bda749c5aa109ae292cb32e6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/9cd28590bda749c5aa109ae292cb32e6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/9cd28590bda749c5aa109ae292cb32e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 19:23:04.320719 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-TestVolumeBootPattern-410499789 Oct 04 19:23:04.320719 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: 9cd28590bda749c5aa109ae292cb32e6 Oct 04 19:23:04.320719 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-TestVolumeBootPattern-410499789 Oct 04 19:23:04.320719 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-TestVolumeBootPattern-410499789-project Oct 04 19:23:04.320719 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 19:23:04.320719 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 19:23:04.320719 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: 43efdccf8e2f4934ae5cfe3da828511e Oct 04 19:23:04.320719 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-TestVolumeBootPattern-410499789-project Oct 04 19:23:04.320719 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 19:23:04.320719 n-d-851028-13 devstack@n-api.service[123595]: exception: Instance 5a300902-48ba-46b4-9e50-c90491a1dbc8 could not be found. Oct 04 19:23:04.320719 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': '5a300902-48ba-46b4-9e50-c90491a1dbc8'} Oct 04 19:23:04.320719 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:23:04.320719 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:23:04.320719 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:23:04.320719 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:23:04.320719 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:23:04.320719 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:23:04.320719 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:23:04.320719 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:23:04.320719 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:23:04.320719 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:23:04.320719 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a300902-48ba-46b4-9e50-c90491a1dbc8 could not be found. Oct 04 19:23:04.320719 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:23:04.320719 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:23:04.320719 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:23:04.320719 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:23:04.320719 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:23:04.320719 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:23:04.320719 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:23:04.320719 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:23:04.320719 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:23:04.320719 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:23:04.320719 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:23:04.320719 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:23:04.320719 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:23:04.320719 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:23:04.320719 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:23:04.320719 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:23:04.320719 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a300902-48ba-46b4-9e50-c90491a1dbc8 could not be found. Oct 04 19:23:04.320719 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:23:04.320719 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:23:04.320719 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:23:04.324231 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:23:04.324231 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:23:04.324231 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:23:04.324231 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:23:04.324231 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:23:04.324231 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a300902-48ba-46b4-9e50-c90491a1dbc8 could not be found. Oct 04 19:23:04.324231 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:23:04.324231 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-3e689265-423d-4068-99ba-2360fc3d179a tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Returning 404 to user: Instance 5a300902-48ba-46b4-9e50-c90491a1dbc8 could not be found. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:23:04.324231 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-3e689265-423d-4068-99ba-2360fc3d179a tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/5a300902-48ba-46b4-9e50-c90491a1dbc8" status: 404 len: 111 microversion: 2.1 time: 0.063993 Oct 04 19:23:04.327948 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3213/6797] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:23:04 2022] GET /compute/v2.1/servers/5a300902-48ba-46b4-9e50-c90491a1dbc8 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:23:07.532908 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-745f0b17-81b6-45f6-8dd9-b2b64ec2b366 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:23:07.533459 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-745f0b17-81b6-45f6-8dd9-b2b64ec2b366 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: e899b363-4d30-4b46-b1d1-939974abe265] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:23:07.541336 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-745f0b17-81b6-45f6-8dd9-b2b64ec2b366 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:07.541848 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-745f0b17-81b6-45f6-8dd9-b2b64ec2b366 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:07.542308 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-745f0b17-81b6-45f6-8dd9-b2b64ec2b366 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:07.543024 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-745f0b17-81b6-45f6-8dd9-b2b64ec2b366 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:07.543497 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-745f0b17-81b6-45f6-8dd9-b2b64ec2b366 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:07.543948 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-745f0b17-81b6-45f6-8dd9-b2b64ec2b366 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:07.557621 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-745f0b17-81b6-45f6-8dd9-b2b64ec2b366 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] HTTP exception thrown: Instance e899b363-4d30-4b46-b1d1-939974abe265 could not be found. Oct 04 19:23:07.559319 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-745f0b17-81b6-45f6-8dd9-b2b64ec2b366 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Request method failure captured: Oct 04 19:23:07.559319 n-d-851028-13 devstack@n-api.service[123596]: request: DELETE /compute/v2.1/servers/e899b363-4d30-4b46-b1d1-939974abe265 HTTP/1.1 Oct 04 19:23:07.559319 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 19:23:07.559319 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 19:23:07.559319 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 19:23:07.559319 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 19:23:07.559319 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 19:23:07.559319 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 19:23:07.559319 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 19:23:07.559319 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 19:23:07.559319 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPIdD9eu-sNppZso9GBgF0qiQcNSNfbptUObqTJdNMmQeJtmiNalN1HCCgoRlIsnKAnm3yDfemx5F9JCBtqQ5VFIZ41axYIUJNVoTUZoGs-EEXp4RLTVvMn1M_mAUAx-w46wS7k3RPeCrtItzG8FEbUjMK8RLhn-Xr_i-jB7aqW9aWok Oct 04 19:23:07.559319 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 19:23:07.559319 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 19:23:07.559319 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 19:23:07.559319 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 19:23:07.559319 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 19:23:07.559319 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 19:23:07.559319 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: 9cd28590bda749c5aa109ae292cb32e6 Oct 04 19:23:07.559319 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-TestVolumeBootPattern-410499789 Oct 04 19:23:07.559319 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 19:23:07.559319 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 19:23:07.559319 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/9cd28590bda749c5aa109ae292cb32e6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_9cd28590bda749c5aa109ae292cb32e6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/9cd28590bda749c5aa109ae292cb32e6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/9cd28590bda749c5aa109ae292cb32e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 19:23:07.559319 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-TestVolumeBootPattern-410499789 Oct 04 19:23:07.559319 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: 9cd28590bda749c5aa109ae292cb32e6 Oct 04 19:23:07.559319 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-TestVolumeBootPattern-410499789 Oct 04 19:23:07.559319 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-TestVolumeBootPattern-410499789-project Oct 04 19:23:07.559319 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 19:23:07.559319 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 19:23:07.559319 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 43efdccf8e2f4934ae5cfe3da828511e Oct 04 19:23:07.559319 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-TestVolumeBootPattern-410499789-project Oct 04 19:23:07.559319 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 19:23:07.559319 n-d-851028-13 devstack@n-api.service[123596]: exception: Instance e899b363-4d30-4b46-b1d1-939974abe265 could not be found. Oct 04 19:23:07.559319 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': 'e899b363-4d30-4b46-b1d1-939974abe265'} Oct 04 19:23:07.559319 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:23:07.559319 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:23:07.559319 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:23:07.559319 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:23:07.559319 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:23:07.559319 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:23:07.559319 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:23:07.559319 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:23:07.559319 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:23:07.559319 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:23:07.559319 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e899b363-4d30-4b46-b1d1-939974abe265 could not be found. Oct 04 19:23:07.559319 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:23:07.559319 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:23:07.559319 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:23:07.559319 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:23:07.559319 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:23:07.559319 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:23:07.559319 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:23:07.559319 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:23:07.559319 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:23:07.559319 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:23:07.559319 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 19:23:07.559319 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 19:23:07.559319 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 19:23:07.559319 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 19:23:07.559319 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:23:07.559319 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:23:07.559319 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:23:07.559319 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:23:07.563071 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e899b363-4d30-4b46-b1d1-939974abe265 could not be found. Oct 04 19:23:07.563071 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:23:07.563071 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:23:07.563071 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:23:07.563071 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:23:07.563071 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:23:07.563071 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:23:07.563071 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:23:07.563071 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:23:07.563071 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e899b363-4d30-4b46-b1d1-939974abe265 could not be found. Oct 04 19:23:07.563071 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:23:07.563071 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-745f0b17-81b6-45f6-8dd9-b2b64ec2b366 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Returning 404 to user: Instance e899b363-4d30-4b46-b1d1-939974abe265 could not be found. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:23:07.563071 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-745f0b17-81b6-45f6-8dd9-b2b64ec2b366 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "DELETE /compute/v2.1/servers/e899b363-4d30-4b46-b1d1-939974abe265" status: 404 len: 111 microversion: 2.1 time: 0.031876 Oct 04 19:23:07.563071 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3585/6798] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 19:23:07 2022] DELETE /compute/v2.1/servers/e899b363-4d30-4b46-b1d1-939974abe265 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:23:07.569681 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-04f64b37-d8c3-4196-8b58-e16c776bcf18 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:23:07.570303 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-04f64b37-d8c3-4196-8b58-e16c776bcf18 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: e899b363-4d30-4b46-b1d1-939974abe265] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:23:07.577560 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-04f64b37-d8c3-4196-8b58-e16c776bcf18 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:07.578050 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-04f64b37-d8c3-4196-8b58-e16c776bcf18 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:07.578491 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-04f64b37-d8c3-4196-8b58-e16c776bcf18 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:07.579190 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-04f64b37-d8c3-4196-8b58-e16c776bcf18 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:07.579648 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-04f64b37-d8c3-4196-8b58-e16c776bcf18 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:07.580078 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-04f64b37-d8c3-4196-8b58-e16c776bcf18 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:07.594229 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-04f64b37-d8c3-4196-8b58-e16c776bcf18 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] HTTP exception thrown: Instance e899b363-4d30-4b46-b1d1-939974abe265 could not be found. Oct 04 19:23:07.595790 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-04f64b37-d8c3-4196-8b58-e16c776bcf18 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Request method failure captured: Oct 04 19:23:07.595790 n-d-851028-13 devstack@n-api.service[123595]: request: GET /compute/v2.1/servers/e899b363-4d30-4b46-b1d1-939974abe265 HTTP/1.1 Oct 04 19:23:07.595790 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 19:23:07.595790 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 19:23:07.595790 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 19:23:07.595790 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 0 Oct 04 19:23:07.595790 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 19:23:07.595790 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 19:23:07.595790 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 19:23:07.595790 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 19:23:07.595790 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPIdD9eu-sNppZso9GBgF0qiQcNSNfbptUObqTJdNMmQeJtmiNalN1HCCgoRlIsnKAnm3yDfemx5F9JCBtqQ5VFIZ41axYIUJNVoTUZoGs-EEXp4RLTVvMn1M_mAUAx-w46wS7k3RPeCrtItzG8FEbUjMK8RLhn-Xr_i-jB7aqW9aWok Oct 04 19:23:07.595790 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 19:23:07.595790 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 19:23:07.595790 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 19:23:07.595790 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 19:23:07.595790 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 19:23:07.595790 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 19:23:07.595790 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: 9cd28590bda749c5aa109ae292cb32e6 Oct 04 19:23:07.595790 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-TestVolumeBootPattern-410499789 Oct 04 19:23:07.595790 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 19:23:07.595790 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 19:23:07.595790 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/9cd28590bda749c5aa109ae292cb32e6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_9cd28590bda749c5aa109ae292cb32e6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/9cd28590bda749c5aa109ae292cb32e6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/9cd28590bda749c5aa109ae292cb32e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 19:23:07.595790 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-TestVolumeBootPattern-410499789 Oct 04 19:23:07.595790 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: 9cd28590bda749c5aa109ae292cb32e6 Oct 04 19:23:07.595790 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-TestVolumeBootPattern-410499789 Oct 04 19:23:07.595790 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-TestVolumeBootPattern-410499789-project Oct 04 19:23:07.595790 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 19:23:07.595790 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 19:23:07.595790 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: 43efdccf8e2f4934ae5cfe3da828511e Oct 04 19:23:07.595790 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-TestVolumeBootPattern-410499789-project Oct 04 19:23:07.595790 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 19:23:07.595790 n-d-851028-13 devstack@n-api.service[123595]: exception: Instance e899b363-4d30-4b46-b1d1-939974abe265 could not be found. Oct 04 19:23:07.595790 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': 'e899b363-4d30-4b46-b1d1-939974abe265'} Oct 04 19:23:07.595790 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:23:07.595790 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:23:07.595790 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:23:07.595790 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:23:07.595790 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:23:07.595790 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:23:07.595790 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:23:07.595790 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:23:07.595790 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:23:07.595790 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:23:07.595790 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e899b363-4d30-4b46-b1d1-939974abe265 could not be found. Oct 04 19:23:07.595790 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:23:07.595790 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:23:07.595790 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:23:07.595790 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:23:07.595790 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:23:07.595790 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:23:07.595790 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:23:07.595790 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:23:07.595790 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:23:07.595790 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:23:07.595790 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:23:07.595790 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:23:07.595790 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:23:07.595790 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:23:07.595790 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:23:07.595790 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:23:07.595790 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e899b363-4d30-4b46-b1d1-939974abe265 could not be found. Oct 04 19:23:07.595790 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:23:07.595790 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:23:07.595790 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:23:07.601153 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:23:07.601153 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:23:07.601153 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:23:07.601153 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:23:07.601153 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:23:07.601153 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e899b363-4d30-4b46-b1d1-939974abe265 could not be found. Oct 04 19:23:07.601153 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:23:07.601153 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-04f64b37-d8c3-4196-8b58-e16c776bcf18 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Returning 404 to user: Instance e899b363-4d30-4b46-b1d1-939974abe265 could not be found. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:23:07.601153 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-04f64b37-d8c3-4196-8b58-e16c776bcf18 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/e899b363-4d30-4b46-b1d1-939974abe265" status: 404 len: 111 microversion: 2.1 time: 0.031358 Oct 04 19:23:07.601153 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3214/6799] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:23:07 2022] GET /compute/v2.1/servers/e899b363-4d30-4b46-b1d1-939974abe265 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 19:23:07.960522 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-16d967ea-f035-4c64-b588-3af8c466b958 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:23:07.961049 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-16d967ea-f035-4c64-b588-3af8c466b958 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: 5a300902-48ba-46b4-9e50-c90491a1dbc8] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:23:07.967172 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-16d967ea-f035-4c64-b588-3af8c466b958 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:07.967680 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-16d967ea-f035-4c64-b588-3af8c466b958 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:07.968144 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-16d967ea-f035-4c64-b588-3af8c466b958 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:07.968853 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-16d967ea-f035-4c64-b588-3af8c466b958 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:07.969363 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-16d967ea-f035-4c64-b588-3af8c466b958 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:07.969813 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-16d967ea-f035-4c64-b588-3af8c466b958 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:07.986413 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-16d967ea-f035-4c64-b588-3af8c466b958 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] HTTP exception thrown: Instance 5a300902-48ba-46b4-9e50-c90491a1dbc8 could not be found. Oct 04 19:23:07.987989 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-16d967ea-f035-4c64-b588-3af8c466b958 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Request method failure captured: Oct 04 19:23:07.987989 n-d-851028-13 devstack@n-api.service[123596]: request: DELETE /compute/v2.1/servers/5a300902-48ba-46b4-9e50-c90491a1dbc8 HTTP/1.1 Oct 04 19:23:07.987989 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 19:23:07.987989 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 19:23:07.987989 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 19:23:07.987989 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 19:23:07.987989 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 19:23:07.987989 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 19:23:07.987989 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 19:23:07.987989 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 19:23:07.987989 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPIdD9eu-sNppZso9GBgF0qiQcNSNfbptUObqTJdNMmQeJtmiNalN1HCCgoRlIsnKAnm3yDfemx5F9JCBtqQ5VFIZ41axYIUJNVoTUZoGs-EEXp4RLTVvMn1M_mAUAx-w46wS7k3RPeCrtItzG8FEbUjMK8RLhn-Xr_i-jB7aqW9aWok Oct 04 19:23:07.987989 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 19:23:07.987989 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 19:23:07.987989 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 19:23:07.987989 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 19:23:07.987989 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 19:23:07.987989 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 19:23:07.987989 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: 9cd28590bda749c5aa109ae292cb32e6 Oct 04 19:23:07.987989 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-TestVolumeBootPattern-410499789 Oct 04 19:23:07.987989 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 19:23:07.987989 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 19:23:07.987989 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/9cd28590bda749c5aa109ae292cb32e6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_9cd28590bda749c5aa109ae292cb32e6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/9cd28590bda749c5aa109ae292cb32e6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/9cd28590bda749c5aa109ae292cb32e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 19:23:07.987989 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-TestVolumeBootPattern-410499789 Oct 04 19:23:07.987989 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: 9cd28590bda749c5aa109ae292cb32e6 Oct 04 19:23:07.987989 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-TestVolumeBootPattern-410499789 Oct 04 19:23:07.987989 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-TestVolumeBootPattern-410499789-project Oct 04 19:23:07.987989 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 19:23:07.987989 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 19:23:07.987989 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 43efdccf8e2f4934ae5cfe3da828511e Oct 04 19:23:07.987989 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-TestVolumeBootPattern-410499789-project Oct 04 19:23:07.987989 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 19:23:07.987989 n-d-851028-13 devstack@n-api.service[123596]: exception: Instance 5a300902-48ba-46b4-9e50-c90491a1dbc8 could not be found. Oct 04 19:23:07.987989 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': '5a300902-48ba-46b4-9e50-c90491a1dbc8'} Oct 04 19:23:07.987989 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:23:07.987989 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:23:07.987989 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:23:07.987989 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:23:07.987989 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:23:07.987989 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:23:07.987989 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:23:07.987989 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:23:07.987989 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:23:07.987989 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:23:07.987989 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a300902-48ba-46b4-9e50-c90491a1dbc8 could not be found. Oct 04 19:23:07.987989 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:23:07.987989 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:23:07.987989 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:23:07.987989 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:23:07.987989 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:23:07.987989 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:23:07.987989 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:23:07.987989 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:23:07.987989 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:23:07.987989 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:23:07.987989 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 19:23:07.987989 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 19:23:07.987989 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 19:23:07.987989 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 19:23:07.987989 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:23:07.987989 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:23:07.987989 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:23:07.987989 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:23:07.991947 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a300902-48ba-46b4-9e50-c90491a1dbc8 could not be found. Oct 04 19:23:07.991947 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:23:07.991947 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:23:07.991947 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:23:07.991947 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:23:07.991947 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:23:07.991947 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:23:07.991947 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:23:07.991947 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:23:07.991947 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a300902-48ba-46b4-9e50-c90491a1dbc8 could not be found. Oct 04 19:23:07.991947 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:23:07.991947 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-16d967ea-f035-4c64-b588-3af8c466b958 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Returning 404 to user: Instance 5a300902-48ba-46b4-9e50-c90491a1dbc8 could not be found. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:23:07.991947 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-16d967ea-f035-4c64-b588-3af8c466b958 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "DELETE /compute/v2.1/servers/5a300902-48ba-46b4-9e50-c90491a1dbc8" status: 404 len: 111 microversion: 2.1 time: 0.033375 Oct 04 19:23:07.991947 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3586/6800] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 19:23:07 2022] DELETE /compute/v2.1/servers/5a300902-48ba-46b4-9e50-c90491a1dbc8 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:23:07.998380 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-906f266c-cfd4-42d8-9b59-9c77b8fd9033 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:23:07.999002 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-906f266c-cfd4-42d8-9b59-9c77b8fd9033 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: 5a300902-48ba-46b4-9e50-c90491a1dbc8] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:23:08.005534 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-906f266c-cfd4-42d8-9b59-9c77b8fd9033 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:08.006021 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-906f266c-cfd4-42d8-9b59-9c77b8fd9033 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:08.006459 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-906f266c-cfd4-42d8-9b59-9c77b8fd9033 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:08.007154 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-906f266c-cfd4-42d8-9b59-9c77b8fd9033 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:08.007605 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-906f266c-cfd4-42d8-9b59-9c77b8fd9033 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:08.008032 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-906f266c-cfd4-42d8-9b59-9c77b8fd9033 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:08.022664 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-906f266c-cfd4-42d8-9b59-9c77b8fd9033 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] HTTP exception thrown: Instance 5a300902-48ba-46b4-9e50-c90491a1dbc8 could not be found. Oct 04 19:23:08.024129 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-906f266c-cfd4-42d8-9b59-9c77b8fd9033 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Request method failure captured: Oct 04 19:23:08.024129 n-d-851028-13 devstack@n-api.service[123595]: request: GET /compute/v2.1/servers/5a300902-48ba-46b4-9e50-c90491a1dbc8 HTTP/1.1 Oct 04 19:23:08.024129 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 19:23:08.024129 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 19:23:08.024129 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 19:23:08.024129 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 0 Oct 04 19:23:08.024129 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 19:23:08.024129 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 19:23:08.024129 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 19:23:08.024129 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 19:23:08.024129 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPIdD9eu-sNppZso9GBgF0qiQcNSNfbptUObqTJdNMmQeJtmiNalN1HCCgoRlIsnKAnm3yDfemx5F9JCBtqQ5VFIZ41axYIUJNVoTUZoGs-EEXp4RLTVvMn1M_mAUAx-w46wS7k3RPeCrtItzG8FEbUjMK8RLhn-Xr_i-jB7aqW9aWok Oct 04 19:23:08.024129 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 19:23:08.024129 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 19:23:08.024129 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 19:23:08.024129 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 19:23:08.024129 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 19:23:08.024129 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 19:23:08.024129 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: 9cd28590bda749c5aa109ae292cb32e6 Oct 04 19:23:08.024129 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-TestVolumeBootPattern-410499789 Oct 04 19:23:08.024129 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 19:23:08.024129 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 19:23:08.024129 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/9cd28590bda749c5aa109ae292cb32e6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_9cd28590bda749c5aa109ae292cb32e6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/9cd28590bda749c5aa109ae292cb32e6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/9cd28590bda749c5aa109ae292cb32e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 19:23:08.024129 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-TestVolumeBootPattern-410499789 Oct 04 19:23:08.024129 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: 9cd28590bda749c5aa109ae292cb32e6 Oct 04 19:23:08.024129 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-TestVolumeBootPattern-410499789 Oct 04 19:23:08.024129 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-TestVolumeBootPattern-410499789-project Oct 04 19:23:08.024129 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 19:23:08.024129 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 19:23:08.024129 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: 43efdccf8e2f4934ae5cfe3da828511e Oct 04 19:23:08.024129 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-TestVolumeBootPattern-410499789-project Oct 04 19:23:08.024129 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 19:23:08.024129 n-d-851028-13 devstack@n-api.service[123595]: exception: Instance 5a300902-48ba-46b4-9e50-c90491a1dbc8 could not be found. Oct 04 19:23:08.024129 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': '5a300902-48ba-46b4-9e50-c90491a1dbc8'} Oct 04 19:23:08.024129 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:23:08.024129 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:23:08.024129 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:23:08.024129 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:23:08.024129 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:23:08.024129 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:23:08.024129 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:23:08.024129 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:23:08.024129 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:23:08.024129 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:23:08.024129 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a300902-48ba-46b4-9e50-c90491a1dbc8 could not be found. Oct 04 19:23:08.024129 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:23:08.024129 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:23:08.024129 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:23:08.024129 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:23:08.024129 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:23:08.024129 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:23:08.024129 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:23:08.024129 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:23:08.024129 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:23:08.024129 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:23:08.024129 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:23:08.024129 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:23:08.024129 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:23:08.024129 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:23:08.024129 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:23:08.024129 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:23:08.024129 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a300902-48ba-46b4-9e50-c90491a1dbc8 could not be found. Oct 04 19:23:08.024129 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:23:08.024129 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:23:08.024129 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:23:08.028390 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:23:08.028390 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:23:08.028390 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:23:08.028390 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:23:08.028390 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:23:08.028390 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a300902-48ba-46b4-9e50-c90491a1dbc8 could not be found. Oct 04 19:23:08.028390 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:23:08.028390 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-906f266c-cfd4-42d8-9b59-9c77b8fd9033 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Returning 404 to user: Instance 5a300902-48ba-46b4-9e50-c90491a1dbc8 could not be found. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:23:08.028390 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-906f266c-cfd4-42d8-9b59-9c77b8fd9033 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/5a300902-48ba-46b4-9e50-c90491a1dbc8" status: 404 len: 111 microversion: 2.1 time: 0.031122 Oct 04 19:23:08.028390 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3215/6801] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:23:07 2022] GET /compute/v2.1/servers/5a300902-48ba-46b4-9e50-c90491a1dbc8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:23:08.102246 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-90081682-b206-4334-9cde-280c37f10db1 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Action: 'create', calling method: .version_select at 0x7fb21eae1820>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1548771095", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCV4ts+iM209zQZvpbtzRhvaz6dHMO5VW9F+ZhJmLHpR0y5PSCWaBmtjZ72qc+eX/z96jnJw3dqY/89WL9kWVV1WrMRNqSMRD+XJ+Q3AI5Y98TLxSxtAX78PS4XU+ujyjA=="}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:23:08.117955 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-90081682-b206-4334-9cde-280c37f10db1 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Getting quotas for project 9cd28590bda749c5aa109ae292cb32e6. Resources: {'key_pairs'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:23:08.123200 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-90081682-b206-4334-9cde-280c37f10db1 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Getting quotas for user 43efdccf8e2f4934ae5cfe3da828511e and project 9cd28590bda749c5aa109ae292cb32e6. Resources: {'key_pairs'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:23:08.150905 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-90081682-b206-4334-9cde-280c37f10db1 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.052574 Oct 04 19:23:08.151518 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3587/6802] 10.222.0.43 () {60 vars in 1159 bytes} [Tue Oct 4 19:23:08 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:23:24.368764 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-d82e97dd-570d-4006-a192-cb37329f46b4 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-708166115", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1548771095", "security_groups": [{"name": "tempest-secgroup-smoke-1298951911"}], "block_device_mapping_v2": [{"uuid": "f436bcb7-ef8d-49de-acb6-eb87ad185258", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "2ddfee4a-681a-4b64-a4ab-40481cf11577"}]}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:23:24.380068 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_api:SELECT=11 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:23:24.380902 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=37,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:23:24.634871 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.network.neutron [None req-d82e97dd-570d-4006-a192-cb37329f46b4 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] validate_networks() for [('2ddfee4a-681a-4b64-a4ab-40481cf11577', None, None, None, None, None)] {{(pid=123595) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 19:23:25.000407 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-d82e97dd-570d-4006-a192-cb37329f46b4 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Flavor limits 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:23:25.000842 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-d82e97dd-570d-4006-a192-cb37329f46b4 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Image limits 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:23:25.001363 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-d82e97dd-570d-4006-a192-cb37329f46b4 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Flavor pref 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:23:25.002341 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-d82e97dd-570d-4006-a192-cb37329f46b4 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Image pref 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:23:25.002768 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-d82e97dd-570d-4006-a192-cb37329f46b4 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:23:25.011847 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d82e97dd-570d-4006-a192-cb37329f46b4 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:25.012332 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d82e97dd-570d-4006-a192-cb37329f46b4 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:25.012778 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d82e97dd-570d-4006-a192-cb37329f46b4 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:25.013559 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d82e97dd-570d-4006-a192-cb37329f46b4 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:25.014018 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d82e97dd-570d-4006-a192-cb37329f46b4 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:25.014452 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d82e97dd-570d-4006-a192-cb37329f46b4 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:25.031234 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-d82e97dd-570d-4006-a192-cb37329f46b4 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Getting quotas for project 9cd28590bda749c5aa109ae292cb32e6. Resources: {'ram', 'cores', 'instances'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:23:25.037102 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-d82e97dd-570d-4006-a192-cb37329f46b4 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Getting quotas for user 43efdccf8e2f4934ae5cfe3da828511e and project 9cd28590bda749c5aa109ae292cb32e6. Resources: {'ram', 'cores', 'instances'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:23:25.098754 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-d82e97dd-570d-4006-a192-cb37329f46b4 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Going to run 1 instances... {{(pid=123595) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 19:23:25.100884 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-d82e97dd-570d-4006-a192-cb37329f46b4 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: 3ee9d2bd-d2f8-4660-9134-fdb8c9c153b4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f436bcb7-ef8d-49de-acb6-eb87ad185258',volume_size=None,volume_type=None)] {{(pid=123595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 19:23:25.228614 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-d82e97dd-570d-4006-a192-cb37329f46b4 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.864032 Oct 04 19:23:25.229299 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3216/6803] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 19:23:24 2022] POST /compute/v2.1/servers => generated 406 bytes in 865 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 19:23:25.239666 n-d-851028-13 devstack@n-api.service[123596]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 19:23:25.240188 n-d-851028-13 devstack@n-api.service[123596]: Tue Oct 4 19:23:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3ee9d2bd-d2f8-4660-9134-fdb8c9c153b4 (ip 10.222.0.43) !!! Oct 04 19:23:25.242072 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=23 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:23:25.242881 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=4 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:23:25.243651 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_api:SELECT=22,nova_api:INSERT=1 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:23:25.248904 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-cb55a284-e216-4b96-be49-77388e366f4a tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:23:25.249574 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-cb55a284-e216-4b96-be49-77388e366f4a tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: 3ee9d2bd-d2f8-4660-9134-fdb8c9c153b4] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:23:25.374829 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-cb55a284-e216-4b96-be49-77388e366f4a tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:23:25.382157 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-cb55a284-e216-4b96-be49-77388e366f4a tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/3ee9d2bd-d2f8-4660-9134-fdb8c9c153b4" status: 200 len: 1094 microversion: 2.1 time: 0.144944 Oct 04 19:23:25.382745 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3588/6804] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:23:25 2022] GET /compute/v2.1/servers/3ee9d2bd-d2f8-4660-9134-fdb8c9c153b4 => generated 1094 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:23:26.404678 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-46e33982-33c2-4cec-8b66-a180e0390b47 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:23:26.405462 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-46e33982-33c2-4cec-8b66-a180e0390b47 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: 3ee9d2bd-d2f8-4660-9134-fdb8c9c153b4] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:23:26.411785 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-46e33982-33c2-4cec-8b66-a180e0390b47 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:26.412393 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-46e33982-33c2-4cec-8b66-a180e0390b47 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:26.413063 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-46e33982-33c2-4cec-8b66-a180e0390b47 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:26.414012 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-46e33982-33c2-4cec-8b66-a180e0390b47 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:26.414553 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-46e33982-33c2-4cec-8b66-a180e0390b47 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:26.415062 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-46e33982-33c2-4cec-8b66-a180e0390b47 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:26.486439 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-46e33982-33c2-4cec-8b66-a180e0390b47 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:23:26.496523 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-46e33982-33c2-4cec-8b66-a180e0390b47 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/3ee9d2bd-d2f8-4660-9134-fdb8c9c153b4" status: 200 len: 1210 microversion: 2.1 time: 0.096157 Oct 04 19:23:26.497350 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3217/6805] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:23:26 2022] GET /compute/v2.1/servers/3ee9d2bd-d2f8-4660-9134-fdb8c9c153b4 => generated 1210 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:23:27.521126 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-a2744854-b203-4208-b984-cb33ef121ee2 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:23:27.522350 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-a2744854-b203-4208-b984-cb33ef121ee2 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: 3ee9d2bd-d2f8-4660-9134-fdb8c9c153b4] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:23:27.528684 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a2744854-b203-4208-b984-cb33ef121ee2 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:27.529365 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a2744854-b203-4208-b984-cb33ef121ee2 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:27.530065 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a2744854-b203-4208-b984-cb33ef121ee2 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:27.531000 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a2744854-b203-4208-b984-cb33ef121ee2 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:27.531599 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a2744854-b203-4208-b984-cb33ef121ee2 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:27.532863 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a2744854-b203-4208-b984-cb33ef121ee2 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:27.740261 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-a2744854-b203-4208-b984-cb33ef121ee2 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:23:27.749884 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-a2744854-b203-4208-b984-cb33ef121ee2 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/3ee9d2bd-d2f8-4660-9134-fdb8c9c153b4" status: 200 len: 1278 microversion: 2.1 time: 0.233835 Oct 04 19:23:27.750693 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3589/6806] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:23:27 2022] GET /compute/v2.1/servers/3ee9d2bd-d2f8-4660-9134-fdb8c9c153b4 => generated 1278 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:23:27.757616 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-2905b844-ccfe-4ba9-ac30-808463da0d7a req-b6933227-7f12-454b-ae87-4ccb3bb0feb4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ee9d2bd-d2f8-4660-9134-fdb8c9c153b4", "tag": "f9c9b7c3-0a87-4476-af5b-c169ad271e11"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:23:27.778598 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-2905b844-ccfe-4ba9-ac30-808463da0d7a req-b6933227-7f12-454b-ae87-4ccb3bb0feb4 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:27.779254 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-2905b844-ccfe-4ba9-ac30-808463da0d7a req-b6933227-7f12-454b-ae87-4ccb3bb0feb4 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:27.779734 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-2905b844-ccfe-4ba9-ac30-808463da0d7a req-b6933227-7f12-454b-ae87-4ccb3bb0feb4 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:27.792848 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-2905b844-ccfe-4ba9-ac30-808463da0d7a req-b6933227-7f12-454b-ae87-4ccb3bb0feb4 service nova] Creating event network-changed:f9c9b7c3-0a87-4476-af5b-c169ad271e11 for instance 3ee9d2bd-d2f8-4660-9134-fdb8c9c153b4 on n-h2-851028-13 Oct 04 19:23:27.798665 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-2905b844-ccfe-4ba9-ac30-808463da0d7a req-b6933227-7f12-454b-ae87-4ccb3bb0feb4 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044714 Oct 04 19:23:27.799326 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3218/6807] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:23:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:23:28.777252 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-8d336307-9664-4de1-913e-eb122ca9fd5d tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:23:28.777892 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-8d336307-9664-4de1-913e-eb122ca9fd5d tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: 3ee9d2bd-d2f8-4660-9134-fdb8c9c153b4] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:23:28.785492 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8d336307-9664-4de1-913e-eb122ca9fd5d tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:28.786003 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8d336307-9664-4de1-913e-eb122ca9fd5d tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:28.786500 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8d336307-9664-4de1-913e-eb122ca9fd5d tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:28.787252 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8d336307-9664-4de1-913e-eb122ca9fd5d tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:28.787716 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8d336307-9664-4de1-913e-eb122ca9fd5d tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:28.788173 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8d336307-9664-4de1-913e-eb122ca9fd5d tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:28.923581 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-8d336307-9664-4de1-913e-eb122ca9fd5d tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:23:28.931729 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-8d336307-9664-4de1-913e-eb122ca9fd5d tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/3ee9d2bd-d2f8-4660-9134-fdb8c9c153b4" status: 200 len: 1278 microversion: 2.1 time: 0.158626 Oct 04 19:23:28.932304 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3590/6808] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:23:28 2022] GET /compute/v2.1/servers/3ee9d2bd-d2f8-4660-9134-fdb8c9c153b4 => generated 1278 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:23:29.955773 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-57367ed7-dbe7-4863-b44a-41374a45692a tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:23:29.956627 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-57367ed7-dbe7-4863-b44a-41374a45692a tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: 3ee9d2bd-d2f8-4660-9134-fdb8c9c153b4] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:23:29.963238 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-57367ed7-dbe7-4863-b44a-41374a45692a tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:29.963743 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-57367ed7-dbe7-4863-b44a-41374a45692a tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:29.964192 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-57367ed7-dbe7-4863-b44a-41374a45692a tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:29.964906 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-57367ed7-dbe7-4863-b44a-41374a45692a tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:29.965409 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-57367ed7-dbe7-4863-b44a-41374a45692a tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:29.965846 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-57367ed7-dbe7-4863-b44a-41374a45692a tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:30.101762 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-57367ed7-dbe7-4863-b44a-41374a45692a tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:23:30.109673 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-57367ed7-dbe7-4863-b44a-41374a45692a tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/3ee9d2bd-d2f8-4660-9134-fdb8c9c153b4" status: 200 len: 1278 microversion: 2.1 time: 0.159034 Oct 04 19:23:30.110743 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3219/6809] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:23:29 2022] GET /compute/v2.1/servers/3ee9d2bd-d2f8-4660-9134-fdb8c9c153b4 => generated 1278 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:23:31.133200 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-a62e2c10-a7f4-4540-8ae7-5d9f4e53f268 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:23:31.133839 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-a62e2c10-a7f4-4540-8ae7-5d9f4e53f268 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: 3ee9d2bd-d2f8-4660-9134-fdb8c9c153b4] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:23:31.140493 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a62e2c10-a7f4-4540-8ae7-5d9f4e53f268 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:31.141582 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a62e2c10-a7f4-4540-8ae7-5d9f4e53f268 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:31.142048 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a62e2c10-a7f4-4540-8ae7-5d9f4e53f268 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:31.142768 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a62e2c10-a7f4-4540-8ae7-5d9f4e53f268 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:31.143242 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a62e2c10-a7f4-4540-8ae7-5d9f4e53f268 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:31.143688 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a62e2c10-a7f4-4540-8ae7-5d9f4e53f268 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:31.285202 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-a62e2c10-a7f4-4540-8ae7-5d9f4e53f268 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:23:31.293348 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-a62e2c10-a7f4-4540-8ae7-5d9f4e53f268 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/3ee9d2bd-d2f8-4660-9134-fdb8c9c153b4" status: 200 len: 1278 microversion: 2.1 time: 0.164244 Oct 04 19:23:31.293936 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3591/6810] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:23:31 2022] GET /compute/v2.1/servers/3ee9d2bd-d2f8-4660-9134-fdb8c9c153b4 => generated 1278 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:23:32.316309 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-494c19cb-1338-449a-a0f5-1849f454bd6d tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:23:32.316842 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-494c19cb-1338-449a-a0f5-1849f454bd6d tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: 3ee9d2bd-d2f8-4660-9134-fdb8c9c153b4] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:23:32.324079 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-494c19cb-1338-449a-a0f5-1849f454bd6d tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:32.324575 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-494c19cb-1338-449a-a0f5-1849f454bd6d tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:32.325671 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-494c19cb-1338-449a-a0f5-1849f454bd6d tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:32.325769 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-494c19cb-1338-449a-a0f5-1849f454bd6d tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:32.326176 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-494c19cb-1338-449a-a0f5-1849f454bd6d tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:32.326672 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-494c19cb-1338-449a-a0f5-1849f454bd6d tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:32.460270 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-494c19cb-1338-449a-a0f5-1849f454bd6d tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:23:32.467960 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-494c19cb-1338-449a-a0f5-1849f454bd6d tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/3ee9d2bd-d2f8-4660-9134-fdb8c9c153b4" status: 200 len: 1266 microversion: 2.1 time: 0.155647 Oct 04 19:23:32.468533 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3220/6811] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:23:32 2022] GET /compute/v2.1/servers/3ee9d2bd-d2f8-4660-9134-fdb8c9c153b4 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:23:33.494194 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-fdd024d1-baa9-4fde-854c-2a6ede4c26c0 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:23:33.494830 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-fdd024d1-baa9-4fde-854c-2a6ede4c26c0 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: 3ee9d2bd-d2f8-4660-9134-fdb8c9c153b4] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:23:33.501926 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fdd024d1-baa9-4fde-854c-2a6ede4c26c0 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:33.502437 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fdd024d1-baa9-4fde-854c-2a6ede4c26c0 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:33.502892 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fdd024d1-baa9-4fde-854c-2a6ede4c26c0 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:33.503612 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fdd024d1-baa9-4fde-854c-2a6ede4c26c0 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:33.504087 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fdd024d1-baa9-4fde-854c-2a6ede4c26c0 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:33.504538 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fdd024d1-baa9-4fde-854c-2a6ede4c26c0 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:33.635177 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-fdd024d1-baa9-4fde-854c-2a6ede4c26c0 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:23:33.643144 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-fdd024d1-baa9-4fde-854c-2a6ede4c26c0 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/3ee9d2bd-d2f8-4660-9134-fdb8c9c153b4" status: 200 len: 1266 microversion: 2.1 time: 0.152890 Oct 04 19:23:33.643722 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3592/6812] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:23:33 2022] GET /compute/v2.1/servers/3ee9d2bd-d2f8-4660-9134-fdb8c9c153b4 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:23:34.666659 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-01caeb0f-d33c-442b-9f79-130497b706d9 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:23:34.667278 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-01caeb0f-d33c-442b-9f79-130497b706d9 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: 3ee9d2bd-d2f8-4660-9134-fdb8c9c153b4] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:23:34.674656 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-01caeb0f-d33c-442b-9f79-130497b706d9 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:34.675144 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-01caeb0f-d33c-442b-9f79-130497b706d9 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:34.675592 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-01caeb0f-d33c-442b-9f79-130497b706d9 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:34.676385 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-01caeb0f-d33c-442b-9f79-130497b706d9 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:34.676845 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-01caeb0f-d33c-442b-9f79-130497b706d9 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:34.677318 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-01caeb0f-d33c-442b-9f79-130497b706d9 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:34.808876 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-01caeb0f-d33c-442b-9f79-130497b706d9 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:23:34.817142 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-01caeb0f-d33c-442b-9f79-130497b706d9 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/3ee9d2bd-d2f8-4660-9134-fdb8c9c153b4" status: 200 len: 1266 microversion: 2.1 time: 0.154477 Oct 04 19:23:34.817709 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3221/6813] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:23:34 2022] GET /compute/v2.1/servers/3ee9d2bd-d2f8-4660-9134-fdb8c9c153b4 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:23:35.840075 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f6d8c753-20d1-492c-bfe8-0f42cf24d601 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:23:35.840698 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-f6d8c753-20d1-492c-bfe8-0f42cf24d601 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: 3ee9d2bd-d2f8-4660-9134-fdb8c9c153b4] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:23:35.843984 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=2 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:23:35.849560 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f6d8c753-20d1-492c-bfe8-0f42cf24d601 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:35.850060 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f6d8c753-20d1-492c-bfe8-0f42cf24d601 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:35.850539 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f6d8c753-20d1-492c-bfe8-0f42cf24d601 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:35.851245 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f6d8c753-20d1-492c-bfe8-0f42cf24d601 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:35.851716 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f6d8c753-20d1-492c-bfe8-0f42cf24d601 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:35.852157 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f6d8c753-20d1-492c-bfe8-0f42cf24d601 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:35.991175 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-f6d8c753-20d1-492c-bfe8-0f42cf24d601 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:23:35.999045 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-f6d8c753-20d1-492c-bfe8-0f42cf24d601 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/3ee9d2bd-d2f8-4660-9134-fdb8c9c153b4" status: 200 len: 1266 microversion: 2.1 time: 0.163031 Oct 04 19:23:35.999578 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3593/6814] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:23:35 2022] GET /compute/v2.1/servers/3ee9d2bd-d2f8-4660-9134-fdb8c9c153b4 => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:23:37.022347 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-1a8dc1db-d1a3-4c57-b5f5-a6d8b379e51e tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:23:37.022884 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-1a8dc1db-d1a3-4c57-b5f5-a6d8b379e51e tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: 3ee9d2bd-d2f8-4660-9134-fdb8c9c153b4] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:23:37.024844 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=2 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:23:37.025551 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=6 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:23:37.032752 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1a8dc1db-d1a3-4c57-b5f5-a6d8b379e51e tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:37.033258 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1a8dc1db-d1a3-4c57-b5f5-a6d8b379e51e tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:37.033703 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1a8dc1db-d1a3-4c57-b5f5-a6d8b379e51e tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:37.034395 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1a8dc1db-d1a3-4c57-b5f5-a6d8b379e51e tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:37.034855 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1a8dc1db-d1a3-4c57-b5f5-a6d8b379e51e tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:37.035278 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1a8dc1db-d1a3-4c57-b5f5-a6d8b379e51e tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:37.167269 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-1a8dc1db-d1a3-4c57-b5f5-a6d8b379e51e tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:23:37.175863 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-1a8dc1db-d1a3-4c57-b5f5-a6d8b379e51e tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/3ee9d2bd-d2f8-4660-9134-fdb8c9c153b4" status: 200 len: 1266 microversion: 2.1 time: 0.157477 Oct 04 19:23:37.176435 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3222/6815] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:23:37 2022] GET /compute/v2.1/servers/3ee9d2bd-d2f8-4660-9134-fdb8c9c153b4 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:23:38.199212 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-ef9cde91-21b5-4cd4-afc5-1296acfdaf2c tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:23:38.199833 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-ef9cde91-21b5-4cd4-afc5-1296acfdaf2c tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: 3ee9d2bd-d2f8-4660-9134-fdb8c9c153b4] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:23:38.206853 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ef9cde91-21b5-4cd4-afc5-1296acfdaf2c tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:38.207358 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ef9cde91-21b5-4cd4-afc5-1296acfdaf2c tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:38.207808 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ef9cde91-21b5-4cd4-afc5-1296acfdaf2c tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:38.208525 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ef9cde91-21b5-4cd4-afc5-1296acfdaf2c tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:38.208995 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ef9cde91-21b5-4cd4-afc5-1296acfdaf2c tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:38.209456 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ef9cde91-21b5-4cd4-afc5-1296acfdaf2c tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:38.345682 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-ef9cde91-21b5-4cd4-afc5-1296acfdaf2c tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:23:38.353552 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-ef9cde91-21b5-4cd4-afc5-1296acfdaf2c tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/3ee9d2bd-d2f8-4660-9134-fdb8c9c153b4" status: 200 len: 1266 microversion: 2.1 time: 0.158658 Oct 04 19:23:38.354216 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3594/6816] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:23:38 2022] GET /compute/v2.1/servers/3ee9d2bd-d2f8-4660-9134-fdb8c9c153b4 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:23:39.377749 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-b4cf71de-71dc-499c-a044-17219b085196 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:23:39.378370 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-b4cf71de-71dc-499c-a044-17219b085196 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: 3ee9d2bd-d2f8-4660-9134-fdb8c9c153b4] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:23:39.385523 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b4cf71de-71dc-499c-a044-17219b085196 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:39.386013 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b4cf71de-71dc-499c-a044-17219b085196 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:39.386457 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b4cf71de-71dc-499c-a044-17219b085196 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:39.387156 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b4cf71de-71dc-499c-a044-17219b085196 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:39.387615 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b4cf71de-71dc-499c-a044-17219b085196 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:39.388048 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b4cf71de-71dc-499c-a044-17219b085196 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:39.516595 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-b4cf71de-71dc-499c-a044-17219b085196 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:23:39.524353 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-b4cf71de-71dc-499c-a044-17219b085196 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/3ee9d2bd-d2f8-4660-9134-fdb8c9c153b4" status: 200 len: 1266 microversion: 2.1 time: 0.151098 Oct 04 19:23:39.524926 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3223/6817] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:23:39 2022] GET /compute/v2.1/servers/3ee9d2bd-d2f8-4660-9134-fdb8c9c153b4 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:23:40.547352 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-4dc57e23-c77b-4e32-b3ce-50f0b3ce111b tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:23:40.547980 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-4dc57e23-c77b-4e32-b3ce-50f0b3ce111b tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: 3ee9d2bd-d2f8-4660-9134-fdb8c9c153b4] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:23:40.554944 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4dc57e23-c77b-4e32-b3ce-50f0b3ce111b tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:40.555447 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4dc57e23-c77b-4e32-b3ce-50f0b3ce111b tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:40.555901 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4dc57e23-c77b-4e32-b3ce-50f0b3ce111b tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:40.556612 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4dc57e23-c77b-4e32-b3ce-50f0b3ce111b tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:40.557088 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4dc57e23-c77b-4e32-b3ce-50f0b3ce111b tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:40.557588 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4dc57e23-c77b-4e32-b3ce-50f0b3ce111b tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:40.691805 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-4dc57e23-c77b-4e32-b3ce-50f0b3ce111b tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:23:40.699826 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-4dc57e23-c77b-4e32-b3ce-50f0b3ce111b tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/3ee9d2bd-d2f8-4660-9134-fdb8c9c153b4" status: 200 len: 1266 microversion: 2.1 time: 0.156504 Oct 04 19:23:40.700601 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3595/6818] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:23:40 2022] GET /compute/v2.1/servers/3ee9d2bd-d2f8-4660-9134-fdb8c9c153b4 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:23:41.723758 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-7dd8af25-4b64-42ae-aeb9-8c98bc393cec tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:23:41.724370 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-7dd8af25-4b64-42ae-aeb9-8c98bc393cec tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: 3ee9d2bd-d2f8-4660-9134-fdb8c9c153b4] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:23:41.733181 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7dd8af25-4b64-42ae-aeb9-8c98bc393cec tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:41.733601 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7dd8af25-4b64-42ae-aeb9-8c98bc393cec tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:41.734040 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7dd8af25-4b64-42ae-aeb9-8c98bc393cec tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:41.734758 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7dd8af25-4b64-42ae-aeb9-8c98bc393cec tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:41.735208 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7dd8af25-4b64-42ae-aeb9-8c98bc393cec tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:41.735632 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7dd8af25-4b64-42ae-aeb9-8c98bc393cec tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:41.867951 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-7dd8af25-4b64-42ae-aeb9-8c98bc393cec tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:23:41.875683 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-7dd8af25-4b64-42ae-aeb9-8c98bc393cec tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/3ee9d2bd-d2f8-4660-9134-fdb8c9c153b4" status: 200 len: 1266 microversion: 2.1 time: 0.156226 Oct 04 19:23:41.876268 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3224/6819] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:23:41 2022] GET /compute/v2.1/servers/3ee9d2bd-d2f8-4660-9134-fdb8c9c153b4 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:23:42.827921 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-d9a7188a-b511-4771-a765-2bb78bc2ce1e req-26961194-b36e-4f14-af34-83ad8069dc6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ee9d2bd-d2f8-4660-9134-fdb8c9c153b4", "name": "network-vif-plugged", "status": "completed", "tag": "f9c9b7c3-0a87-4476-af5b-c169ad271e11"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:23:42.839241 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-d9a7188a-b511-4771-a765-2bb78bc2ce1e req-26961194-b36e-4f14-af34-83ad8069dc6c service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:42.839827 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-d9a7188a-b511-4771-a765-2bb78bc2ce1e req-26961194-b36e-4f14-af34-83ad8069dc6c service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:42.840358 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-d9a7188a-b511-4771-a765-2bb78bc2ce1e req-26961194-b36e-4f14-af34-83ad8069dc6c service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:42.851618 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-d9a7188a-b511-4771-a765-2bb78bc2ce1e req-26961194-b36e-4f14-af34-83ad8069dc6c service nova] Creating event network-vif-plugged:f9c9b7c3-0a87-4476-af5b-c169ad271e11 for instance 3ee9d2bd-d2f8-4660-9134-fdb8c9c153b4 on n-h2-851028-13 Oct 04 19:23:42.857310 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-d9a7188a-b511-4771-a765-2bb78bc2ce1e req-26961194-b36e-4f14-af34-83ad8069dc6c service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033104 Oct 04 19:23:42.857966 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3596/6820] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:23:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:23:42.898349 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-04b94a3b-b528-4f3d-8a33-6ba4875022d6 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:23:42.909159 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-04b94a3b-b528-4f3d-8a33-6ba4875022d6 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: 3ee9d2bd-d2f8-4660-9134-fdb8c9c153b4] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:23:42.915838 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-04b94a3b-b528-4f3d-8a33-6ba4875022d6 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:42.916332 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-04b94a3b-b528-4f3d-8a33-6ba4875022d6 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:42.916801 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-04b94a3b-b528-4f3d-8a33-6ba4875022d6 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:42.917618 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-04b94a3b-b528-4f3d-8a33-6ba4875022d6 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:42.918133 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-04b94a3b-b528-4f3d-8a33-6ba4875022d6 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:42.918513 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-04b94a3b-b528-4f3d-8a33-6ba4875022d6 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:43.056477 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-04b94a3b-b528-4f3d-8a33-6ba4875022d6 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:23:43.065078 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-04b94a3b-b528-4f3d-8a33-6ba4875022d6 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/3ee9d2bd-d2f8-4660-9134-fdb8c9c153b4" status: 200 len: 1266 microversion: 2.1 time: 0.170682 Oct 04 19:23:43.065678 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3225/6821] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:23:42 2022] GET /compute/v2.1/servers/3ee9d2bd-d2f8-4660-9134-fdb8c9c153b4 => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:23:44.090619 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-21537bd7-a8e7-4726-8753-a892ea8f5208 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:23:44.091884 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-21537bd7-a8e7-4726-8753-a892ea8f5208 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: 3ee9d2bd-d2f8-4660-9134-fdb8c9c153b4] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:23:44.098522 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-21537bd7-a8e7-4726-8753-a892ea8f5208 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:44.099234 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-21537bd7-a8e7-4726-8753-a892ea8f5208 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:44.099694 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-21537bd7-a8e7-4726-8753-a892ea8f5208 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:44.100574 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-21537bd7-a8e7-4726-8753-a892ea8f5208 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:44.101054 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-21537bd7-a8e7-4726-8753-a892ea8f5208 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:44.101534 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-21537bd7-a8e7-4726-8753-a892ea8f5208 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:44.233655 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-21537bd7-a8e7-4726-8753-a892ea8f5208 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:23:44.242257 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-21537bd7-a8e7-4726-8753-a892ea8f5208 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/3ee9d2bd-d2f8-4660-9134-fdb8c9c153b4" status: 200 len: 1452 microversion: 2.1 time: 0.156653 Oct 04 19:23:44.242854 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3597/6822] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:23:44 2022] GET /compute/v2.1/servers/3ee9d2bd-d2f8-4660-9134-fdb8c9c153b4 => generated 1452 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:23:44.265139 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-02d3f3cc-d1e0-4019-befc-957c31559757 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:23:44.265776 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-02d3f3cc-d1e0-4019-befc-957c31559757 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: 3ee9d2bd-d2f8-4660-9134-fdb8c9c153b4] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:23:44.272888 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-02d3f3cc-d1e0-4019-befc-957c31559757 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:44.273423 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-02d3f3cc-d1e0-4019-befc-957c31559757 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:44.274368 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-02d3f3cc-d1e0-4019-befc-957c31559757 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:44.274589 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-02d3f3cc-d1e0-4019-befc-957c31559757 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:44.275052 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-02d3f3cc-d1e0-4019-befc-957c31559757 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:44.275500 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-02d3f3cc-d1e0-4019-befc-957c31559757 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:44.413312 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-02d3f3cc-d1e0-4019-befc-957c31559757 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:23:44.421149 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-02d3f3cc-d1e0-4019-befc-957c31559757 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/3ee9d2bd-d2f8-4660-9134-fdb8c9c153b4" status: 200 len: 1452 microversion: 2.1 time: 0.160367 Oct 04 19:23:44.421762 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3226/6823] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:23:44 2022] GET /compute/v2.1/servers/3ee9d2bd-d2f8-4660-9134-fdb8c9c153b4 => generated 1452 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:23:45.981822 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-a40a4fd0-9be8-4c49-8903-bb334bec68c4 req-62196c8f-f9a2-4a2a-bde1-4b0658248104 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ee9d2bd-d2f8-4660-9134-fdb8c9c153b4", "tag": "f9c9b7c3-0a87-4476-af5b-c169ad271e11"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:23:45.993535 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-a40a4fd0-9be8-4c49-8903-bb334bec68c4 req-62196c8f-f9a2-4a2a-bde1-4b0658248104 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:45.994380 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-a40a4fd0-9be8-4c49-8903-bb334bec68c4 req-62196c8f-f9a2-4a2a-bde1-4b0658248104 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:45.994493 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-a40a4fd0-9be8-4c49-8903-bb334bec68c4 req-62196c8f-f9a2-4a2a-bde1-4b0658248104 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:46.006849 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-a40a4fd0-9be8-4c49-8903-bb334bec68c4 req-62196c8f-f9a2-4a2a-bde1-4b0658248104 service nova] Creating event network-changed:f9c9b7c3-0a87-4476-af5b-c169ad271e11 for instance 3ee9d2bd-d2f8-4660-9134-fdb8c9c153b4 on n-h2-851028-13 Oct 04 19:23:46.011754 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-a40a4fd0-9be8-4c49-8903-bb334bec68c4 req-62196c8f-f9a2-4a2a-bde1-4b0658248104 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033683 Oct 04 19:23:46.012869 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3598/6824] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:23:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:25:43.162650 n-d-851028-13 devstack@n-api.service[123595]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b5b0be1f-cd68-4bfe-8e95-82ae6af61476] AMQP server on 10.222.0.43:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 04 19:25:43.163597 n-d-851028-13 devstack@n-api.service[123595]: ERROR oslo.messaging._drivers.impl_rabbit [-] [457acf28-5277-4578-be2f-82b18e59b660] AMQP server on 10.222.0.43:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 04 19:25:43.164437 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:25:43.165205 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=58 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:25:43.166166 n-d-851028-13 devstack@n-api.service[123595]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 04 19:25:43.166328 n-d-851028-13 devstack@n-api.service[123595]: Tue Oct 4 19:25:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3ee9d2bd-d2f8-4660-9134-fdb8c9c153b4 (ip 10.222.0.43) !!! Oct 04 19:25:43.167790 n-d-851028-13 devstack@n-api.service[123595]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 19:25:43.167963 n-d-851028-13 devstack@n-api.service[123595]: Tue Oct 4 19:25:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3ee9d2bd-d2f8-4660-9134-fdb8c9c153b4 (ip 10.222.0.43) !!! Oct 04 19:25:43.233024 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-e5b7421d-59e5-4178-9cce-c75488391806 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:25:43.233555 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-e5b7421d-59e5-4178-9cce-c75488391806 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: 3ee9d2bd-d2f8-4660-9134-fdb8c9c153b4] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:25:43.239971 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e5b7421d-59e5-4178-9cce-c75488391806 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:25:43.240461 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e5b7421d-59e5-4178-9cce-c75488391806 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:25:43.240903 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e5b7421d-59e5-4178-9cce-c75488391806 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:25:43.241630 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e5b7421d-59e5-4178-9cce-c75488391806 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:25:43.242090 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e5b7421d-59e5-4178-9cce-c75488391806 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:25:43.242523 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e5b7421d-59e5-4178-9cce-c75488391806 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:25:43.270765 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-e5b7421d-59e5-4178-9cce-c75488391806 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: 3ee9d2bd-d2f8-4660-9134-fdb8c9c153b4] Going to try to terminate instance {{(pid=123595) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 19:25:43.350621 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-e5b7421d-59e5-4178-9cce-c75488391806 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "DELETE /compute/v2.1/servers/3ee9d2bd-d2f8-4660-9134-fdb8c9c153b4" status: 204 len: 0 microversion: 2.1 time: 0.189487 Oct 04 19:25:43.354307 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3227/6825] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 19:25:43 2022] DELETE /compute/v2.1/servers/3ee9d2bd-d2f8-4660-9134-fdb8c9c153b4 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:25:43.359206 n-d-851028-13 devstack@n-api.service[123596]: ERROR oslo.messaging._drivers.impl_rabbit [-] [c592c758-2dc3-4024-92b0-c949515e0281] AMQP server on 10.222.0.43:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 19:25:43.359854 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_api:SELECT=24 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:25:43.360590 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=52 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:25:43.361731 n-d-851028-13 devstack@n-api.service[123596]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 19:25:43.361847 n-d-851028-13 devstack@n-api.service[123596]: Tue Oct 4 19:25:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3ee9d2bd-d2f8-4660-9134-fdb8c9c153b4 (ip 10.222.0.43) !!! Oct 04 19:25:43.375063 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-7c65bc80-a229-44bd-a73c-fddef102353c tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:25:43.375819 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-7c65bc80-a229-44bd-a73c-fddef102353c tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: 3ee9d2bd-d2f8-4660-9134-fdb8c9c153b4] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:25:43.384286 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7c65bc80-a229-44bd-a73c-fddef102353c tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:25:43.384618 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7c65bc80-a229-44bd-a73c-fddef102353c tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:25:43.385079 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7c65bc80-a229-44bd-a73c-fddef102353c tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:25:43.385830 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7c65bc80-a229-44bd-a73c-fddef102353c tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:25:43.386306 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7c65bc80-a229-44bd-a73c-fddef102353c tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:25:43.386754 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7c65bc80-a229-44bd-a73c-fddef102353c tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:25:43.525818 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-7c65bc80-a229-44bd-a73c-fddef102353c tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:25:43.534199 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-7c65bc80-a229-44bd-a73c-fddef102353c tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/3ee9d2bd-d2f8-4660-9134-fdb8c9c153b4" status: 200 len: 1576 microversion: 2.1 time: 0.177620 Oct 04 19:25:43.535395 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3599/6826] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:25:43 2022] GET /compute/v2.1/servers/3ee9d2bd-d2f8-4660-9134-fdb8c9c153b4 => generated 1576 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:25:44.558388 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-44739685-9045-4af1-b4df-ef0eb1ab6927 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:25:44.559134 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-44739685-9045-4af1-b4df-ef0eb1ab6927 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: 3ee9d2bd-d2f8-4660-9134-fdb8c9c153b4] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:25:44.569582 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-44739685-9045-4af1-b4df-ef0eb1ab6927 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:25:44.570081 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-44739685-9045-4af1-b4df-ef0eb1ab6927 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:25:44.570527 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-44739685-9045-4af1-b4df-ef0eb1ab6927 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:25:44.571235 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-44739685-9045-4af1-b4df-ef0eb1ab6927 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:25:44.571694 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-44739685-9045-4af1-b4df-ef0eb1ab6927 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:25:44.572136 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-44739685-9045-4af1-b4df-ef0eb1ab6927 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:25:44.577512 n-d-851028-13 devstack@n-api.service[123595]: INFO oslo.messaging._drivers.impl_rabbit [-] [457acf28-5277-4578-be2f-82b18e59b660] Reconnected to AMQP server on 10.222.0.43:5672 via [amqp] client with port 45868. Oct 04 19:25:44.578343 n-d-851028-13 devstack@n-api.service[123595]: INFO oslo.messaging._drivers.impl_rabbit [-] [b5b0be1f-cd68-4bfe-8e95-82ae6af61476] Reconnected to AMQP server on 10.222.0.43:5672 via [amqp] client with port 45866. Oct 04 19:25:44.712615 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-44739685-9045-4af1-b4df-ef0eb1ab6927 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:25:44.720540 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-44739685-9045-4af1-b4df-ef0eb1ab6927 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/3ee9d2bd-d2f8-4660-9134-fdb8c9c153b4" status: 200 len: 1576 microversion: 2.1 time: 0.166500 Oct 04 19:25:44.721134 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3228/6827] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:25:44 2022] GET /compute/v2.1/servers/3ee9d2bd-d2f8-4660-9134-fdb8c9c153b4 => generated 1576 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:25:45.745526 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-2c3c409a-4bde-4f49-97a6-ec801b57786b tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:25:45.746634 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-2c3c409a-4bde-4f49-97a6-ec801b57786b tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: 3ee9d2bd-d2f8-4660-9134-fdb8c9c153b4] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:25:45.755487 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2c3c409a-4bde-4f49-97a6-ec801b57786b tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:25:45.755950 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2c3c409a-4bde-4f49-97a6-ec801b57786b tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:25:45.756632 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2c3c409a-4bde-4f49-97a6-ec801b57786b tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:25:45.757379 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2c3c409a-4bde-4f49-97a6-ec801b57786b tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:25:45.757858 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2c3c409a-4bde-4f49-97a6-ec801b57786b tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:25:45.758305 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2c3c409a-4bde-4f49-97a6-ec801b57786b tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:25:45.788548 n-d-851028-13 devstack@n-api.service[123596]: INFO oslo.messaging._drivers.impl_rabbit [-] [c592c758-2dc3-4024-92b0-c949515e0281] Reconnected to AMQP server on 10.222.0.43:5672 via [amqp] client with port 45874. Oct 04 19:25:45.852961 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-2c3c409a-4bde-4f49-97a6-ec801b57786b tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:25:45.876488 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-2c3c409a-4bde-4f49-97a6-ec801b57786b tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/3ee9d2bd-d2f8-4660-9134-fdb8c9c153b4" status: 200 len: 1508 microversion: 2.1 time: 0.135543 Oct 04 19:25:45.879653 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3600/6828] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:25:45 2022] GET /compute/v2.1/servers/3ee9d2bd-d2f8-4660-9134-fdb8c9c153b4 => generated 1508 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:25:45.896157 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-399b6b50-99b2-4cf9-9e2e-77bdc137c06f req-f9b71c96-708a-4fbe-97c4-f8a09ed5aede service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ee9d2bd-d2f8-4660-9134-fdb8c9c153b4", "name": "network-vif-deleted", "tag": "f9c9b7c3-0a87-4476-af5b-c169ad271e11"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:25:45.907985 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-399b6b50-99b2-4cf9-9e2e-77bdc137c06f req-f9b71c96-708a-4fbe-97c4-f8a09ed5aede service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:25:45.908480 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-399b6b50-99b2-4cf9-9e2e-77bdc137c06f req-f9b71c96-708a-4fbe-97c4-f8a09ed5aede service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:25:45.909500 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-399b6b50-99b2-4cf9-9e2e-77bdc137c06f req-f9b71c96-708a-4fbe-97c4-f8a09ed5aede service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:25:45.921777 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-399b6b50-99b2-4cf9-9e2e-77bdc137c06f req-f9b71c96-708a-4fbe-97c4-f8a09ed5aede service nova] Creating event network-vif-deleted:f9c9b7c3-0a87-4476-af5b-c169ad271e11 for instance 3ee9d2bd-d2f8-4660-9134-fdb8c9c153b4 on n-h2-851028-13 Oct 04 19:25:45.927522 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-399b6b50-99b2-4cf9-9e2e-77bdc137c06f req-f9b71c96-708a-4fbe-97c4-f8a09ed5aede service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.146570 Oct 04 19:25:45.928148 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3229/6829] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:25:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:25:46.900589 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-efd92494-1ac1-4862-95ad-dae5851d0a40 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:25:46.901280 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-efd92494-1ac1-4862-95ad-dae5851d0a40 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: 3ee9d2bd-d2f8-4660-9134-fdb8c9c153b4] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:25:46.908670 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-efd92494-1ac1-4862-95ad-dae5851d0a40 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:25:46.909953 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-efd92494-1ac1-4862-95ad-dae5851d0a40 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:25:46.910419 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-efd92494-1ac1-4862-95ad-dae5851d0a40 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:25:46.911189 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-efd92494-1ac1-4862-95ad-dae5851d0a40 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:25:46.911670 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-efd92494-1ac1-4862-95ad-dae5851d0a40 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:25:46.912120 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-efd92494-1ac1-4862-95ad-dae5851d0a40 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:25:46.980114 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-efd92494-1ac1-4862-95ad-dae5851d0a40 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:25:46.988562 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-efd92494-1ac1-4862-95ad-dae5851d0a40 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/3ee9d2bd-d2f8-4660-9134-fdb8c9c153b4" status: 200 len: 1225 microversion: 2.1 time: 0.092056 Oct 04 19:25:46.989425 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3601/6830] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:25:46 2022] GET /compute/v2.1/servers/3ee9d2bd-d2f8-4660-9134-fdb8c9c153b4 => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:25:48.012765 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-7924db27-d114-4da5-89fa-3c0dbd44afc4 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:25:48.013523 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-7924db27-d114-4da5-89fa-3c0dbd44afc4 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: 3ee9d2bd-d2f8-4660-9134-fdb8c9c153b4] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:25:48.021751 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7924db27-d114-4da5-89fa-3c0dbd44afc4 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:25:48.022248 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7924db27-d114-4da5-89fa-3c0dbd44afc4 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:25:48.022697 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7924db27-d114-4da5-89fa-3c0dbd44afc4 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:25:48.023403 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7924db27-d114-4da5-89fa-3c0dbd44afc4 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:25:48.023868 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7924db27-d114-4da5-89fa-3c0dbd44afc4 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:25:48.024307 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7924db27-d114-4da5-89fa-3c0dbd44afc4 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:25:48.091430 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-7924db27-d114-4da5-89fa-3c0dbd44afc4 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:25:48.099386 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-7924db27-d114-4da5-89fa-3c0dbd44afc4 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/3ee9d2bd-d2f8-4660-9134-fdb8c9c153b4" status: 200 len: 1225 microversion: 2.1 time: 0.091176 Oct 04 19:25:48.099965 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3230/6831] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:25:48 2022] GET /compute/v2.1/servers/3ee9d2bd-d2f8-4660-9134-fdb8c9c153b4 => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:25:49.123019 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f171965f-2545-40fe-916a-456a58bd23f3 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:25:49.123645 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-f171965f-2545-40fe-916a-456a58bd23f3 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: 3ee9d2bd-d2f8-4660-9134-fdb8c9c153b4] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:25:49.131721 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f171965f-2545-40fe-916a-456a58bd23f3 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:25:49.132226 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f171965f-2545-40fe-916a-456a58bd23f3 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:25:49.132681 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f171965f-2545-40fe-916a-456a58bd23f3 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:25:49.133435 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f171965f-2545-40fe-916a-456a58bd23f3 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:25:49.133904 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f171965f-2545-40fe-916a-456a58bd23f3 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:25:49.134627 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f171965f-2545-40fe-916a-456a58bd23f3 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:25:49.200947 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-f171965f-2545-40fe-916a-456a58bd23f3 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:25:49.208956 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-f171965f-2545-40fe-916a-456a58bd23f3 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/3ee9d2bd-d2f8-4660-9134-fdb8c9c153b4" status: 200 len: 1225 microversion: 2.1 time: 0.089870 Oct 04 19:25:49.209500 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3602/6832] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:25:49 2022] GET /compute/v2.1/servers/3ee9d2bd-d2f8-4660-9134-fdb8c9c153b4 => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:25:50.232063 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-326b363c-e1de-4ebd-9757-213850b9a3ed tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:25:50.232583 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-326b363c-e1de-4ebd-9757-213850b9a3ed tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: 3ee9d2bd-d2f8-4660-9134-fdb8c9c153b4] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:25:50.239719 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-326b363c-e1de-4ebd-9757-213850b9a3ed tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:25:50.240204 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-326b363c-e1de-4ebd-9757-213850b9a3ed tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:25:50.240637 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-326b363c-e1de-4ebd-9757-213850b9a3ed tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:25:50.241353 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-326b363c-e1de-4ebd-9757-213850b9a3ed tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:25:50.241809 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-326b363c-e1de-4ebd-9757-213850b9a3ed tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:25:50.242233 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-326b363c-e1de-4ebd-9757-213850b9a3ed tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:25:50.275175 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-326b363c-e1de-4ebd-9757-213850b9a3ed tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:25:50.275661 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-326b363c-e1de-4ebd-9757-213850b9a3ed tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:25:50.276107 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-326b363c-e1de-4ebd-9757-213850b9a3ed tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:25:50.276550 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.objects.instance [None req-326b363c-e1de-4ebd-9757-213850b9a3ed tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lazy-loading 'fault' on Instance uuid 3ee9d2bd-d2f8-4660-9134-fdb8c9c153b4 {{(pid=123595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 19:25:50.320052 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-326b363c-e1de-4ebd-9757-213850b9a3ed tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:25:50.329021 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-326b363c-e1de-4ebd-9757-213850b9a3ed tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/3ee9d2bd-d2f8-4660-9134-fdb8c9c153b4" status: 200 len: 1230 microversion: 2.1 time: 0.100934 Oct 04 19:25:50.333185 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3231/6833] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:25:50 2022] GET /compute/v2.1/servers/3ee9d2bd-d2f8-4660-9134-fdb8c9c153b4 => generated 1230 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:25:51.353061 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-933b6f54-a2e9-4382-86b9-b0676581aba5 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:25:51.353753 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-933b6f54-a2e9-4382-86b9-b0676581aba5 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: 3ee9d2bd-d2f8-4660-9134-fdb8c9c153b4] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:25:51.360910 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-933b6f54-a2e9-4382-86b9-b0676581aba5 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:25:51.361948 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-933b6f54-a2e9-4382-86b9-b0676581aba5 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:25:51.362410 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-933b6f54-a2e9-4382-86b9-b0676581aba5 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:25:51.363954 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-933b6f54-a2e9-4382-86b9-b0676581aba5 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:25:51.364588 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-933b6f54-a2e9-4382-86b9-b0676581aba5 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:25:51.365137 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-933b6f54-a2e9-4382-86b9-b0676581aba5 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:25:51.381582 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-933b6f54-a2e9-4382-86b9-b0676581aba5 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] HTTP exception thrown: Instance 3ee9d2bd-d2f8-4660-9134-fdb8c9c153b4 could not be found. Oct 04 19:25:51.383314 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-933b6f54-a2e9-4382-86b9-b0676581aba5 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Request method failure captured: Oct 04 19:25:51.383314 n-d-851028-13 devstack@n-api.service[123596]: request: GET /compute/v2.1/servers/3ee9d2bd-d2f8-4660-9134-fdb8c9c153b4 HTTP/1.1 Oct 04 19:25:51.383314 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 19:25:51.383314 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 19:25:51.383314 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 19:25:51.383314 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 19:25:51.383314 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 19:25:51.383314 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 19:25:51.383314 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 19:25:51.383314 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 19:25:51.383314 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPIdD9eu-sNppZso9GBgF0qiQcNSNfbptUObqTJdNMmQeJtmiNalN1HCCgoRlIsnKAnm3yDfemx5F9JCBtqQ5VFIZ41axYIUJNVoTUZoGs-EEXp4RLTVvMn1M_mAUAx-w46wS7k3RPeCrtItzG8FEbUjMK8RLhn-Xr_i-jB7aqW9aWok Oct 04 19:25:51.383314 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 19:25:51.383314 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 19:25:51.383314 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 19:25:51.383314 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 19:25:51.383314 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 19:25:51.383314 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 19:25:51.383314 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: 9cd28590bda749c5aa109ae292cb32e6 Oct 04 19:25:51.383314 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-TestVolumeBootPattern-410499789 Oct 04 19:25:51.383314 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 19:25:51.383314 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 19:25:51.383314 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/9cd28590bda749c5aa109ae292cb32e6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_9cd28590bda749c5aa109ae292cb32e6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/9cd28590bda749c5aa109ae292cb32e6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/9cd28590bda749c5aa109ae292cb32e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 19:25:51.383314 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-TestVolumeBootPattern-410499789 Oct 04 19:25:51.383314 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: 9cd28590bda749c5aa109ae292cb32e6 Oct 04 19:25:51.383314 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-TestVolumeBootPattern-410499789 Oct 04 19:25:51.383314 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-TestVolumeBootPattern-410499789-project Oct 04 19:25:51.383314 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 19:25:51.383314 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 19:25:51.383314 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 43efdccf8e2f4934ae5cfe3da828511e Oct 04 19:25:51.383314 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-TestVolumeBootPattern-410499789-project Oct 04 19:25:51.383314 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 19:25:51.383314 n-d-851028-13 devstack@n-api.service[123596]: exception: Instance 3ee9d2bd-d2f8-4660-9134-fdb8c9c153b4 could not be found. Oct 04 19:25:51.383314 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': '3ee9d2bd-d2f8-4660-9134-fdb8c9c153b4'} Oct 04 19:25:51.383314 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:25:51.383314 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:25:51.383314 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:25:51.383314 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:25:51.383314 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:25:51.383314 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:25:51.383314 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:25:51.383314 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:25:51.383314 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:25:51.383314 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:25:51.383314 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ee9d2bd-d2f8-4660-9134-fdb8c9c153b4 could not be found. Oct 04 19:25:51.383314 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:25:51.383314 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:25:51.383314 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:25:51.383314 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:25:51.383314 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:25:51.383314 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:25:51.383314 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:25:51.383314 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:25:51.383314 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:25:51.383314 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:25:51.383314 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:25:51.383314 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:25:51.383314 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:25:51.383314 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:25:51.383314 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:25:51.383314 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:25:51.383314 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ee9d2bd-d2f8-4660-9134-fdb8c9c153b4 could not be found. Oct 04 19:25:51.383314 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:25:51.383314 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:25:51.383314 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:25:51.391000 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:25:51.391000 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:25:51.391000 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:25:51.391000 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:25:51.391000 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:25:51.391000 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ee9d2bd-d2f8-4660-9134-fdb8c9c153b4 could not be found. Oct 04 19:25:51.391000 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:25:51.391000 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-933b6f54-a2e9-4382-86b9-b0676581aba5 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Returning 404 to user: Instance 3ee9d2bd-d2f8-4660-9134-fdb8c9c153b4 could not be found. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:25:51.391000 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-933b6f54-a2e9-4382-86b9-b0676581aba5 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/3ee9d2bd-d2f8-4660-9134-fdb8c9c153b4" status: 404 len: 111 microversion: 2.1 time: 0.035710 Oct 04 19:25:51.391000 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3603/6834] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:25:51 2022] GET /compute/v2.1/servers/3ee9d2bd-d2f8-4660-9134-fdb8c9c153b4 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:25:51.435358 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-94202822-6c50-434e-8fb4-a739ff398652 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-952341386", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1548771095", "security_groups": [{"name": "tempest-secgroup-smoke-1298951911"}], "block_device_mapping_v2": [{"uuid": "f436bcb7-ef8d-49de-acb6-eb87ad185258", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "2ddfee4a-681a-4b64-a4ab-40481cf11577"}]}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:25:51.554615 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.network.neutron [None req-94202822-6c50-434e-8fb4-a739ff398652 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] validate_networks() for [('2ddfee4a-681a-4b64-a4ab-40481cf11577', None, None, None, None, None)] {{(pid=123595) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 19:25:52.319756 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-94202822-6c50-434e-8fb4-a739ff398652 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Flavor limits 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:25:52.320318 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-94202822-6c50-434e-8fb4-a739ff398652 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Image limits 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:25:52.320641 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-94202822-6c50-434e-8fb4-a739ff398652 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Flavor pref 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:25:52.321048 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-94202822-6c50-434e-8fb4-a739ff398652 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Image pref 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:25:52.321485 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-94202822-6c50-434e-8fb4-a739ff398652 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:25:52.331311 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-94202822-6c50-434e-8fb4-a739ff398652 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:25:52.331793 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-94202822-6c50-434e-8fb4-a739ff398652 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:25:52.332234 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-94202822-6c50-434e-8fb4-a739ff398652 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:25:52.332963 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-94202822-6c50-434e-8fb4-a739ff398652 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:25:52.333445 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-94202822-6c50-434e-8fb4-a739ff398652 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:25:52.333873 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-94202822-6c50-434e-8fb4-a739ff398652 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:25:52.350639 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-94202822-6c50-434e-8fb4-a739ff398652 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Getting quotas for project 9cd28590bda749c5aa109ae292cb32e6. Resources: {'ram', 'cores', 'instances'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:25:52.355950 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-94202822-6c50-434e-8fb4-a739ff398652 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Getting quotas for user 43efdccf8e2f4934ae5cfe3da828511e and project 9cd28590bda749c5aa109ae292cb32e6. Resources: {'ram', 'cores', 'instances'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:25:52.420761 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-94202822-6c50-434e-8fb4-a739ff398652 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Going to run 1 instances... {{(pid=123595) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 19:25:52.422956 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-94202822-6c50-434e-8fb4-a739ff398652 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: 53b4fbba-ff8d-4b05-96d5-171cc6bd9f41] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f436bcb7-ef8d-49de-acb6-eb87ad185258',volume_size=None,volume_type=None)] {{(pid=123595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 19:25:52.557864 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-94202822-6c50-434e-8fb4-a739ff398652 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.126352 Oct 04 19:25:52.558559 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3232/6835] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 19:25:51 2022] POST /compute/v2.1/servers => generated 406 bytes in 1128 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 19:25:52.570791 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-30b9cfc5-3ebd-4099-9ba4-4a9710d9ccc5 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:25:52.571307 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-30b9cfc5-3ebd-4099-9ba4-4a9710d9ccc5 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: 53b4fbba-ff8d-4b05-96d5-171cc6bd9f41] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:25:52.629391 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-30b9cfc5-3ebd-4099-9ba4-4a9710d9ccc5 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:25:52.642797 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-30b9cfc5-3ebd-4099-9ba4-4a9710d9ccc5 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/53b4fbba-ff8d-4b05-96d5-171cc6bd9f41" status: 200 len: 1094 microversion: 2.1 time: 0.075485 Oct 04 19:25:52.643830 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3604/6836] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:25:52 2022] GET /compute/v2.1/servers/53b4fbba-ff8d-4b05-96d5-171cc6bd9f41 => generated 1094 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:25:53.677133 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-78104d0f-349f-4ead-803a-1745067cffd0 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:25:53.677796 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-78104d0f-349f-4ead-803a-1745067cffd0 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: 53b4fbba-ff8d-4b05-96d5-171cc6bd9f41] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:25:53.685296 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-78104d0f-349f-4ead-803a-1745067cffd0 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:25:53.685866 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-78104d0f-349f-4ead-803a-1745067cffd0 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:25:53.686359 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-78104d0f-349f-4ead-803a-1745067cffd0 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:25:53.687389 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-78104d0f-349f-4ead-803a-1745067cffd0 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:25:53.687974 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-78104d0f-349f-4ead-803a-1745067cffd0 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:25:53.688575 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-78104d0f-349f-4ead-803a-1745067cffd0 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:25:53.764021 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-78104d0f-349f-4ead-803a-1745067cffd0 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:25:53.772530 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-78104d0f-349f-4ead-803a-1745067cffd0 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/53b4fbba-ff8d-4b05-96d5-171cc6bd9f41" status: 200 len: 1192 microversion: 2.1 time: 0.099411 Oct 04 19:25:53.773134 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3233/6837] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:25:53 2022] GET /compute/v2.1/servers/53b4fbba-ff8d-4b05-96d5-171cc6bd9f41 => generated 1192 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:25:54.795908 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-9dfdb8da-67f0-494d-8eef-cc0fb8834cc6 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:25:54.796888 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-9dfdb8da-67f0-494d-8eef-cc0fb8834cc6 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: 53b4fbba-ff8d-4b05-96d5-171cc6bd9f41] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:25:54.804573 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9dfdb8da-67f0-494d-8eef-cc0fb8834cc6 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:25:54.805263 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9dfdb8da-67f0-494d-8eef-cc0fb8834cc6 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:25:54.805824 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9dfdb8da-67f0-494d-8eef-cc0fb8834cc6 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:25:54.806667 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9dfdb8da-67f0-494d-8eef-cc0fb8834cc6 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:25:54.807370 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9dfdb8da-67f0-494d-8eef-cc0fb8834cc6 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:25:54.808014 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9dfdb8da-67f0-494d-8eef-cc0fb8834cc6 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:25:55.027511 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-9dfdb8da-67f0-494d-8eef-cc0fb8834cc6 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:25:55.036973 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-9dfdb8da-67f0-494d-8eef-cc0fb8834cc6 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/53b4fbba-ff8d-4b05-96d5-171cc6bd9f41" status: 200 len: 1278 microversion: 2.1 time: 0.244946 Oct 04 19:25:55.037965 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3605/6838] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:25:54 2022] GET /compute/v2.1/servers/53b4fbba-ff8d-4b05-96d5-171cc6bd9f41 => generated 1278 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:25:55.448309 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-8163eed0-2e3e-447b-bdff-ea54cda2f9de req-9925fd9c-100c-4ac0-9684-139cbe750eb9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53b4fbba-ff8d-4b05-96d5-171cc6bd9f41", "tag": "4b2c39bd-061a-416e-8eb1-d9f9790e91a8"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:25:55.466714 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-8163eed0-2e3e-447b-bdff-ea54cda2f9de req-9925fd9c-100c-4ac0-9684-139cbe750eb9 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:25:55.467523 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-8163eed0-2e3e-447b-bdff-ea54cda2f9de req-9925fd9c-100c-4ac0-9684-139cbe750eb9 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:25:55.468161 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-8163eed0-2e3e-447b-bdff-ea54cda2f9de req-9925fd9c-100c-4ac0-9684-139cbe750eb9 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:25:55.481762 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-8163eed0-2e3e-447b-bdff-ea54cda2f9de req-9925fd9c-100c-4ac0-9684-139cbe750eb9 service nova] Creating event network-changed:4b2c39bd-061a-416e-8eb1-d9f9790e91a8 for instance 53b4fbba-ff8d-4b05-96d5-171cc6bd9f41 on n-h1-851028-13 Oct 04 19:25:55.489080 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-8163eed0-2e3e-447b-bdff-ea54cda2f9de req-9925fd9c-100c-4ac0-9684-139cbe750eb9 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053326 Oct 04 19:25:55.490480 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3234/6839] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:25:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:25:56.061087 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-bb08493d-f7b8-4230-a5ea-34d695bd4c3e tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:25:56.061828 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-bb08493d-f7b8-4230-a5ea-34d695bd4c3e tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: 53b4fbba-ff8d-4b05-96d5-171cc6bd9f41] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:25:56.069846 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bb08493d-f7b8-4230-a5ea-34d695bd4c3e tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:25:56.070605 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bb08493d-f7b8-4230-a5ea-34d695bd4c3e tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:25:56.071291 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bb08493d-f7b8-4230-a5ea-34d695bd4c3e tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:25:56.072266 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bb08493d-f7b8-4230-a5ea-34d695bd4c3e tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:25:56.072940 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bb08493d-f7b8-4230-a5ea-34d695bd4c3e tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:25:56.073600 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bb08493d-f7b8-4230-a5ea-34d695bd4c3e tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:25:56.351481 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-bb08493d-f7b8-4230-a5ea-34d695bd4c3e tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:25:56.366739 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-bb08493d-f7b8-4230-a5ea-34d695bd4c3e tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/53b4fbba-ff8d-4b05-96d5-171cc6bd9f41" status: 200 len: 1278 microversion: 2.1 time: 0.309364 Oct 04 19:25:56.369236 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3606/6840] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:25:56 2022] GET /compute/v2.1/servers/53b4fbba-ff8d-4b05-96d5-171cc6bd9f41 => generated 1278 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:25:57.393700 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-5b4a5e0e-2ab1-4431-a436-2d98e08e8a91 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:25:57.394484 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-5b4a5e0e-2ab1-4431-a436-2d98e08e8a91 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: 53b4fbba-ff8d-4b05-96d5-171cc6bd9f41] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:25:57.400731 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5b4a5e0e-2ab1-4431-a436-2d98e08e8a91 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:25:57.401251 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5b4a5e0e-2ab1-4431-a436-2d98e08e8a91 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:25:57.401696 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5b4a5e0e-2ab1-4431-a436-2d98e08e8a91 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:25:57.402408 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5b4a5e0e-2ab1-4431-a436-2d98e08e8a91 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:25:57.402865 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5b4a5e0e-2ab1-4431-a436-2d98e08e8a91 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:25:57.403299 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5b4a5e0e-2ab1-4431-a436-2d98e08e8a91 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:25:57.538315 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-5b4a5e0e-2ab1-4431-a436-2d98e08e8a91 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:25:57.546438 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-5b4a5e0e-2ab1-4431-a436-2d98e08e8a91 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/53b4fbba-ff8d-4b05-96d5-171cc6bd9f41" status: 200 len: 1278 microversion: 2.1 time: 0.158396 Oct 04 19:25:57.547032 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3235/6841] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:25:57 2022] GET /compute/v2.1/servers/53b4fbba-ff8d-4b05-96d5-171cc6bd9f41 => generated 1278 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:25:58.571558 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f181f2ff-cfd1-42d9-bfb0-9d4a52088579 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:25:58.572577 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-f181f2ff-cfd1-42d9-bfb0-9d4a52088579 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: 53b4fbba-ff8d-4b05-96d5-171cc6bd9f41] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:25:58.582127 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f181f2ff-cfd1-42d9-bfb0-9d4a52088579 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:25:58.582647 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f181f2ff-cfd1-42d9-bfb0-9d4a52088579 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:25:58.583115 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f181f2ff-cfd1-42d9-bfb0-9d4a52088579 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:25:58.583851 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f181f2ff-cfd1-42d9-bfb0-9d4a52088579 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:25:58.584330 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f181f2ff-cfd1-42d9-bfb0-9d4a52088579 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:25:58.584776 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f181f2ff-cfd1-42d9-bfb0-9d4a52088579 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:25:58.736272 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-f181f2ff-cfd1-42d9-bfb0-9d4a52088579 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:25:58.745046 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-f181f2ff-cfd1-42d9-bfb0-9d4a52088579 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/53b4fbba-ff8d-4b05-96d5-171cc6bd9f41" status: 200 len: 1278 microversion: 2.1 time: 0.177986 Oct 04 19:25:58.745690 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3607/6842] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:25:58 2022] GET /compute/v2.1/servers/53b4fbba-ff8d-4b05-96d5-171cc6bd9f41 => generated 1278 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:25:59.769036 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-e74496da-3f49-4572-a378-bde4ed41301b tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:25:59.769712 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-e74496da-3f49-4572-a378-bde4ed41301b tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: 53b4fbba-ff8d-4b05-96d5-171cc6bd9f41] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:25:59.776502 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e74496da-3f49-4572-a378-bde4ed41301b tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:25:59.777012 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e74496da-3f49-4572-a378-bde4ed41301b tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:25:59.777479 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e74496da-3f49-4572-a378-bde4ed41301b tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:25:59.778174 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e74496da-3f49-4572-a378-bde4ed41301b tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:25:59.778623 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e74496da-3f49-4572-a378-bde4ed41301b tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:25:59.779047 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e74496da-3f49-4572-a378-bde4ed41301b tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:25:59.919580 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-e74496da-3f49-4572-a378-bde4ed41301b tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:25:59.928563 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-e74496da-3f49-4572-a378-bde4ed41301b tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/53b4fbba-ff8d-4b05-96d5-171cc6bd9f41" status: 200 len: 1266 microversion: 2.1 time: 0.163915 Oct 04 19:25:59.929195 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3236/6843] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:25:59 2022] GET /compute/v2.1/servers/53b4fbba-ff8d-4b05-96d5-171cc6bd9f41 => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:26:00.952875 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-173b2ff8-00cd-4ab7-aed9-4cb7bb8f8093 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:26:00.953646 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-173b2ff8-00cd-4ab7-aed9-4cb7bb8f8093 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: 53b4fbba-ff8d-4b05-96d5-171cc6bd9f41] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:26:00.961689 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-173b2ff8-00cd-4ab7-aed9-4cb7bb8f8093 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:26:00.962202 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-173b2ff8-00cd-4ab7-aed9-4cb7bb8f8093 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:26:00.962656 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-173b2ff8-00cd-4ab7-aed9-4cb7bb8f8093 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:26:00.963386 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-173b2ff8-00cd-4ab7-aed9-4cb7bb8f8093 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:26:00.963857 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-173b2ff8-00cd-4ab7-aed9-4cb7bb8f8093 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:26:00.964298 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-173b2ff8-00cd-4ab7-aed9-4cb7bb8f8093 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:26:01.117677 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-173b2ff8-00cd-4ab7-aed9-4cb7bb8f8093 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:26:01.127358 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-173b2ff8-00cd-4ab7-aed9-4cb7bb8f8093 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/53b4fbba-ff8d-4b05-96d5-171cc6bd9f41" status: 200 len: 1266 microversion: 2.1 time: 0.178303 Oct 04 19:26:01.127961 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3608/6844] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:26:00 2022] GET /compute/v2.1/servers/53b4fbba-ff8d-4b05-96d5-171cc6bd9f41 => generated 1266 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:26:02.150131 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-b00e6c9f-eaca-49d6-9ca9-f43108ac8220 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:26:02.150777 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-b00e6c9f-eaca-49d6-9ca9-f43108ac8220 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: 53b4fbba-ff8d-4b05-96d5-171cc6bd9f41] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:26:02.157863 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b00e6c9f-eaca-49d6-9ca9-f43108ac8220 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:26:02.158347 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b00e6c9f-eaca-49d6-9ca9-f43108ac8220 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:26:02.158780 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b00e6c9f-eaca-49d6-9ca9-f43108ac8220 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:26:02.159473 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b00e6c9f-eaca-49d6-9ca9-f43108ac8220 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:26:02.159921 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b00e6c9f-eaca-49d6-9ca9-f43108ac8220 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:26:02.160346 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b00e6c9f-eaca-49d6-9ca9-f43108ac8220 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:26:02.296229 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-b00e6c9f-eaca-49d6-9ca9-f43108ac8220 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:26:02.308038 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-b00e6c9f-eaca-49d6-9ca9-f43108ac8220 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/53b4fbba-ff8d-4b05-96d5-171cc6bd9f41" status: 200 len: 1266 microversion: 2.1 time: 0.159703 Oct 04 19:26:02.308038 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3237/6845] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:26:02 2022] GET /compute/v2.1/servers/53b4fbba-ff8d-4b05-96d5-171cc6bd9f41 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:26:03.330306 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-68762424-e016-4bce-80f8-959da71cea11 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:26:03.330949 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-68762424-e016-4bce-80f8-959da71cea11 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: 53b4fbba-ff8d-4b05-96d5-171cc6bd9f41] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:26:03.333751 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=2 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:26:03.339226 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-68762424-e016-4bce-80f8-959da71cea11 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:26:03.339763 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-68762424-e016-4bce-80f8-959da71cea11 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:26:03.340226 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-68762424-e016-4bce-80f8-959da71cea11 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:26:03.340950 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-68762424-e016-4bce-80f8-959da71cea11 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:26:03.341463 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-68762424-e016-4bce-80f8-959da71cea11 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:26:03.341917 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-68762424-e016-4bce-80f8-959da71cea11 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:26:03.480109 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-68762424-e016-4bce-80f8-959da71cea11 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:26:03.489425 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-68762424-e016-4bce-80f8-959da71cea11 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/53b4fbba-ff8d-4b05-96d5-171cc6bd9f41" status: 200 len: 1266 microversion: 2.1 time: 0.163553 Oct 04 19:26:03.490004 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3609/6846] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:26:03 2022] GET /compute/v2.1/servers/53b4fbba-ff8d-4b05-96d5-171cc6bd9f41 => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:26:04.511967 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-7ff8301c-c76b-4932-89ee-f4d5aaa8c784 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:26:04.512617 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-7ff8301c-c76b-4932-89ee-f4d5aaa8c784 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: 53b4fbba-ff8d-4b05-96d5-171cc6bd9f41] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:26:04.514676 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=2 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:26:04.515348 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=6 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:26:04.523043 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7ff8301c-c76b-4932-89ee-f4d5aaa8c784 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:26:04.523266 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7ff8301c-c76b-4932-89ee-f4d5aaa8c784 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:26:04.523706 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7ff8301c-c76b-4932-89ee-f4d5aaa8c784 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:26:04.524438 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7ff8301c-c76b-4932-89ee-f4d5aaa8c784 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:26:04.524905 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7ff8301c-c76b-4932-89ee-f4d5aaa8c784 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:26:04.525371 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7ff8301c-c76b-4932-89ee-f4d5aaa8c784 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:26:04.666093 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-7ff8301c-c76b-4932-89ee-f4d5aaa8c784 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:26:04.674091 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-7ff8301c-c76b-4932-89ee-f4d5aaa8c784 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/53b4fbba-ff8d-4b05-96d5-171cc6bd9f41" status: 200 len: 1266 microversion: 2.1 time: 0.166075 Oct 04 19:26:04.674668 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3238/6847] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:26:04 2022] GET /compute/v2.1/servers/53b4fbba-ff8d-4b05-96d5-171cc6bd9f41 => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:26:05.697566 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f749dc89-d9ad-4277-97b7-fdfc6f3202e6 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:26:05.698193 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-f749dc89-d9ad-4277-97b7-fdfc6f3202e6 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: 53b4fbba-ff8d-4b05-96d5-171cc6bd9f41] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:26:05.705241 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f749dc89-d9ad-4277-97b7-fdfc6f3202e6 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:26:05.705746 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f749dc89-d9ad-4277-97b7-fdfc6f3202e6 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:26:05.706202 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f749dc89-d9ad-4277-97b7-fdfc6f3202e6 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:26:05.706923 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f749dc89-d9ad-4277-97b7-fdfc6f3202e6 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:26:05.707386 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f749dc89-d9ad-4277-97b7-fdfc6f3202e6 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:26:05.707830 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f749dc89-d9ad-4277-97b7-fdfc6f3202e6 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:26:05.847170 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-f749dc89-d9ad-4277-97b7-fdfc6f3202e6 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:26:05.856102 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-f749dc89-d9ad-4277-97b7-fdfc6f3202e6 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/53b4fbba-ff8d-4b05-96d5-171cc6bd9f41" status: 200 len: 1266 microversion: 2.1 time: 0.162472 Oct 04 19:26:05.856693 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3610/6848] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:26:05 2022] GET /compute/v2.1/servers/53b4fbba-ff8d-4b05-96d5-171cc6bd9f41 => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:26:06.880357 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-5c5ff9b4-f27f-49c9-9b24-6c5811a2022c tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:26:06.880979 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-5c5ff9b4-f27f-49c9-9b24-6c5811a2022c tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: 53b4fbba-ff8d-4b05-96d5-171cc6bd9f41] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:26:06.887893 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5c5ff9b4-f27f-49c9-9b24-6c5811a2022c tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:26:06.888383 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5c5ff9b4-f27f-49c9-9b24-6c5811a2022c tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:26:06.888828 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5c5ff9b4-f27f-49c9-9b24-6c5811a2022c tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:26:06.889566 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5c5ff9b4-f27f-49c9-9b24-6c5811a2022c tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:26:06.890023 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5c5ff9b4-f27f-49c9-9b24-6c5811a2022c tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:26:06.890455 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5c5ff9b4-f27f-49c9-9b24-6c5811a2022c tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:26:07.027599 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-5c5ff9b4-f27f-49c9-9b24-6c5811a2022c tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:26:07.036237 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-5c5ff9b4-f27f-49c9-9b24-6c5811a2022c tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/53b4fbba-ff8d-4b05-96d5-171cc6bd9f41" status: 200 len: 1266 microversion: 2.1 time: 0.159767 Oct 04 19:26:07.036823 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3239/6849] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:26:06 2022] GET /compute/v2.1/servers/53b4fbba-ff8d-4b05-96d5-171cc6bd9f41 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:26:08.059309 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-3427ada8-691f-45bd-954d-873f37cc07ab tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:26:08.059955 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-3427ada8-691f-45bd-954d-873f37cc07ab tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: 53b4fbba-ff8d-4b05-96d5-171cc6bd9f41] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:26:08.067227 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3427ada8-691f-45bd-954d-873f37cc07ab tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:26:08.067742 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3427ada8-691f-45bd-954d-873f37cc07ab tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:26:08.068207 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3427ada8-691f-45bd-954d-873f37cc07ab tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:26:08.068935 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3427ada8-691f-45bd-954d-873f37cc07ab tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:26:08.069447 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3427ada8-691f-45bd-954d-873f37cc07ab tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:26:08.070009 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3427ada8-691f-45bd-954d-873f37cc07ab tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:26:08.526446 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-3427ada8-691f-45bd-954d-873f37cc07ab tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:26:08.535278 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-3427ada8-691f-45bd-954d-873f37cc07ab tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/53b4fbba-ff8d-4b05-96d5-171cc6bd9f41" status: 200 len: 1266 microversion: 2.1 time: 0.480195 Oct 04 19:26:08.535847 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3611/6850] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:26:08 2022] GET /compute/v2.1/servers/53b4fbba-ff8d-4b05-96d5-171cc6bd9f41 => generated 1266 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:26:09.337795 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-c49698fe-d31e-455a-bd0b-48d8f8305a5d req-101c4878-7405-43a2-a757-f601902f3051 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53b4fbba-ff8d-4b05-96d5-171cc6bd9f41", "name": "network-vif-plugged", "status": "completed", "tag": "4b2c39bd-061a-416e-8eb1-d9f9790e91a8"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:26:09.347400 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-c49698fe-d31e-455a-bd0b-48d8f8305a5d req-101c4878-7405-43a2-a757-f601902f3051 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:26:09.347882 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-c49698fe-d31e-455a-bd0b-48d8f8305a5d req-101c4878-7405-43a2-a757-f601902f3051 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:26:09.348321 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-c49698fe-d31e-455a-bd0b-48d8f8305a5d req-101c4878-7405-43a2-a757-f601902f3051 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:26:09.363571 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-c49698fe-d31e-455a-bd0b-48d8f8305a5d req-101c4878-7405-43a2-a757-f601902f3051 service nova] Creating event network-vif-plugged:4b2c39bd-061a-416e-8eb1-d9f9790e91a8 for instance 53b4fbba-ff8d-4b05-96d5-171cc6bd9f41 on n-h1-851028-13 Oct 04 19:26:09.370969 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-c49698fe-d31e-455a-bd0b-48d8f8305a5d req-101c4878-7405-43a2-a757-f601902f3051 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105029 Oct 04 19:26:09.371599 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3240/6851] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:26:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:26:09.558853 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-fa15e665-2491-4476-9e4c-00fb82ebb2e7 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:26:09.559486 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-fa15e665-2491-4476-9e4c-00fb82ebb2e7 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: 53b4fbba-ff8d-4b05-96d5-171cc6bd9f41] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:26:09.566937 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fa15e665-2491-4476-9e4c-00fb82ebb2e7 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:26:09.567465 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fa15e665-2491-4476-9e4c-00fb82ebb2e7 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:26:09.567927 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fa15e665-2491-4476-9e4c-00fb82ebb2e7 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:26:09.568653 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fa15e665-2491-4476-9e4c-00fb82ebb2e7 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:26:09.569160 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fa15e665-2491-4476-9e4c-00fb82ebb2e7 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:26:09.569619 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fa15e665-2491-4476-9e4c-00fb82ebb2e7 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:26:09.707097 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-fa15e665-2491-4476-9e4c-00fb82ebb2e7 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:26:09.715039 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-fa15e665-2491-4476-9e4c-00fb82ebb2e7 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/53b4fbba-ff8d-4b05-96d5-171cc6bd9f41" status: 200 len: 1266 microversion: 2.1 time: 0.160074 Oct 04 19:26:09.715635 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3612/6852] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:26:09 2022] GET /compute/v2.1/servers/53b4fbba-ff8d-4b05-96d5-171cc6bd9f41 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:26:10.742128 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-8ea76adf-4ff1-4a25-851e-3d704f98346a tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:26:10.742987 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-8ea76adf-4ff1-4a25-851e-3d704f98346a tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: 53b4fbba-ff8d-4b05-96d5-171cc6bd9f41] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:26:10.749699 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8ea76adf-4ff1-4a25-851e-3d704f98346a tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:26:10.750198 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8ea76adf-4ff1-4a25-851e-3d704f98346a tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:26:10.750678 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8ea76adf-4ff1-4a25-851e-3d704f98346a tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:26:10.751974 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8ea76adf-4ff1-4a25-851e-3d704f98346a tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:26:10.752410 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8ea76adf-4ff1-4a25-851e-3d704f98346a tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:26:10.752850 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8ea76adf-4ff1-4a25-851e-3d704f98346a tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:26:10.900121 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-8ea76adf-4ff1-4a25-851e-3d704f98346a tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:26:10.909630 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-8ea76adf-4ff1-4a25-851e-3d704f98346a tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/53b4fbba-ff8d-4b05-96d5-171cc6bd9f41" status: 200 len: 1452 microversion: 2.1 time: 0.173276 Oct 04 19:26:10.910218 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3241/6853] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:26:10 2022] GET /compute/v2.1/servers/53b4fbba-ff8d-4b05-96d5-171cc6bd9f41 => generated 1452 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:26:10.933527 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-ac2c6c54-bb1e-468f-935f-ce9fa1f1975e tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:26:10.934564 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-ac2c6c54-bb1e-468f-935f-ce9fa1f1975e tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: 53b4fbba-ff8d-4b05-96d5-171cc6bd9f41] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:26:10.944760 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ac2c6c54-bb1e-468f-935f-ce9fa1f1975e tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:26:10.945306 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ac2c6c54-bb1e-468f-935f-ce9fa1f1975e tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:26:10.945767 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ac2c6c54-bb1e-468f-935f-ce9fa1f1975e tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:26:10.946499 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ac2c6c54-bb1e-468f-935f-ce9fa1f1975e tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:26:10.947043 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ac2c6c54-bb1e-468f-935f-ce9fa1f1975e tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:26:10.947463 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ac2c6c54-bb1e-468f-935f-ce9fa1f1975e tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:26:11.109498 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-ac2c6c54-bb1e-468f-935f-ce9fa1f1975e tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:26:11.118625 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-ac2c6c54-bb1e-468f-935f-ce9fa1f1975e tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/53b4fbba-ff8d-4b05-96d5-171cc6bd9f41" status: 200 len: 1452 microversion: 2.1 time: 0.189115 Oct 04 19:26:11.119217 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3613/6854] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:26:10 2022] GET /compute/v2.1/servers/53b4fbba-ff8d-4b05-96d5-171cc6bd9f41 => generated 1452 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:26:12.886499 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-8aa39b18-cebb-4fc4-a17c-e5c4059e6f81 req-74ef2af3-aaf0-4286-ae60-981e642b8fee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53b4fbba-ff8d-4b05-96d5-171cc6bd9f41", "tag": "4b2c39bd-061a-416e-8eb1-d9f9790e91a8"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:26:12.897280 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-8aa39b18-cebb-4fc4-a17c-e5c4059e6f81 req-74ef2af3-aaf0-4286-ae60-981e642b8fee service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:26:12.897785 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-8aa39b18-cebb-4fc4-a17c-e5c4059e6f81 req-74ef2af3-aaf0-4286-ae60-981e642b8fee service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:26:12.898209 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-8aa39b18-cebb-4fc4-a17c-e5c4059e6f81 req-74ef2af3-aaf0-4286-ae60-981e642b8fee service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:26:12.912049 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-8aa39b18-cebb-4fc4-a17c-e5c4059e6f81 req-74ef2af3-aaf0-4286-ae60-981e642b8fee service nova] Creating event network-changed:4b2c39bd-061a-416e-8eb1-d9f9790e91a8 for instance 53b4fbba-ff8d-4b05-96d5-171cc6bd9f41 on n-h1-851028-13 Oct 04 19:26:12.918154 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-8aa39b18-cebb-4fc4-a17c-e5c4059e6f81 req-74ef2af3-aaf0-4286-ae60-981e642b8fee service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035309 Oct 04 19:26:12.918772 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3242/6855] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:26:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:27:55.202356 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_api:SELECT=32 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:27:55.203113 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=80 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:27:55.204191 n-d-851028-13 devstack@n-api.service[123596]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 19:27:55.204373 n-d-851028-13 devstack@n-api.service[123596]: Tue Oct 4 19:27:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.43) !!! Oct 04 19:27:55.205607 n-d-851028-13 devstack@n-api.service[123596]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 19:27:55.205733 n-d-851028-13 devstack@n-api.service[123596]: Tue Oct 4 19:27:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.43) !!! Oct 04 19:27:55.210209 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-4808040d-c4a7-42fb-a6ba-9d6208e482c8 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-809189985", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1548771095", "security_groups": [{"name": "tempest-secgroup-smoke-1298951911"}], "block_device_mapping_v2": [{"uuid": "fce18f2c-393a-4cbc-891e-45b47f5d45de", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "2ddfee4a-681a-4b64-a4ab-40481cf11577"}]}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:27:55.336362 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.network.neutron [None req-4808040d-c4a7-42fb-a6ba-9d6208e482c8 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] validate_networks() for [('2ddfee4a-681a-4b64-a4ab-40481cf11577', None, None, None, None, None)] {{(pid=123596) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 19:27:55.773538 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-4808040d-c4a7-42fb-a6ba-9d6208e482c8 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Flavor limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:27:55.773992 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-4808040d-c4a7-42fb-a6ba-9d6208e482c8 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Image limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:27:55.774493 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-4808040d-c4a7-42fb-a6ba-9d6208e482c8 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Flavor pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:27:55.774929 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-4808040d-c4a7-42fb-a6ba-9d6208e482c8 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Image pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:27:55.775370 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-4808040d-c4a7-42fb-a6ba-9d6208e482c8 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:27:55.784933 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4808040d-c4a7-42fb-a6ba-9d6208e482c8 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:27:55.785467 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4808040d-c4a7-42fb-a6ba-9d6208e482c8 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:27:55.785930 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4808040d-c4a7-42fb-a6ba-9d6208e482c8 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:27:55.786680 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4808040d-c4a7-42fb-a6ba-9d6208e482c8 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:27:55.787154 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4808040d-c4a7-42fb-a6ba-9d6208e482c8 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:27:55.787600 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4808040d-c4a7-42fb-a6ba-9d6208e482c8 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:27:55.805754 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-4808040d-c4a7-42fb-a6ba-9d6208e482c8 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Getting quotas for project 9cd28590bda749c5aa109ae292cb32e6. Resources: {'ram', 'cores', 'instances'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:27:55.811027 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-4808040d-c4a7-42fb-a6ba-9d6208e482c8 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Getting quotas for user 43efdccf8e2f4934ae5cfe3da828511e and project 9cd28590bda749c5aa109ae292cb32e6. Resources: {'ram', 'cores', 'instances'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:27:55.870773 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-4808040d-c4a7-42fb-a6ba-9d6208e482c8 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Going to run 1 instances... {{(pid=123596) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 19:27:55.872942 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-4808040d-c4a7-42fb-a6ba-9d6208e482c8 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: 62243100-b523-40d3-997e-f7b8839a8be7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='fce18f2c-393a-4cbc-891e-45b47f5d45de',volume_size=None,volume_type=None)] {{(pid=123596) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 19:27:56.005580 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-4808040d-c4a7-42fb-a6ba-9d6208e482c8 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.804908 Oct 04 19:27:56.011107 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3614/6856] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 19:27:55 2022] POST /compute/v2.1/servers => generated 406 bytes in 807 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 19:27:56.020919 n-d-851028-13 devstack@n-api.service[123595]: ERROR oslo.messaging._drivers.impl_rabbit [-] [457acf28-5277-4578-be2f-82b18e59b660] AMQP server on 10.222.0.43:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Oct 04 19:27:56.023815 n-d-851028-13 devstack@n-api.service[123595]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b5b0be1f-cd68-4bfe-8e95-82ae6af61476] AMQP server on 10.222.0.43:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Oct 04 19:27:56.024710 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:27:56.026016 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:27:56.035146 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-b31794b6-f754-439d-8635-186222ad0e35 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:27:56.036135 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-b31794b6-f754-439d-8635-186222ad0e35 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: 62243100-b523-40d3-997e-f7b8839a8be7] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:27:56.121019 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-b31794b6-f754-439d-8635-186222ad0e35 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:27:56.129454 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-b31794b6-f754-439d-8635-186222ad0e35 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/62243100-b523-40d3-997e-f7b8839a8be7" status: 200 len: 1094 microversion: 2.1 time: 0.111462 Oct 04 19:27:56.130032 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3243/6857] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:27:56 2022] GET /compute/v2.1/servers/62243100-b523-40d3-997e-f7b8839a8be7 => generated 1094 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:27:57.153895 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-7764110c-ce0f-41fe-9512-cb9d69d2a460 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:27:57.155191 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-7764110c-ce0f-41fe-9512-cb9d69d2a460 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: 62243100-b523-40d3-997e-f7b8839a8be7] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:27:57.163844 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7764110c-ce0f-41fe-9512-cb9d69d2a460 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:27:57.164472 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7764110c-ce0f-41fe-9512-cb9d69d2a460 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:27:57.165166 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7764110c-ce0f-41fe-9512-cb9d69d2a460 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:27:57.165905 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7764110c-ce0f-41fe-9512-cb9d69d2a460 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:27:57.166382 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7764110c-ce0f-41fe-9512-cb9d69d2a460 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:27:57.166832 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7764110c-ce0f-41fe-9512-cb9d69d2a460 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:27:57.244828 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-7764110c-ce0f-41fe-9512-cb9d69d2a460 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:27:57.254984 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-7764110c-ce0f-41fe-9512-cb9d69d2a460 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/62243100-b523-40d3-997e-f7b8839a8be7" status: 200 len: 1210 microversion: 2.1 time: 0.106163 Oct 04 19:27:57.255577 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3615/6858] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:27:57 2022] GET /compute/v2.1/servers/62243100-b523-40d3-997e-f7b8839a8be7 => generated 1210 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:27:58.280541 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-88511ac2-c227-4767-b14b-acac5aec356e tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:27:58.281441 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-88511ac2-c227-4767-b14b-acac5aec356e tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: 62243100-b523-40d3-997e-f7b8839a8be7] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:27:58.299002 n-d-851028-13 devstack@n-api.service[123595]: INFO oslo.messaging._drivers.impl_rabbit [-] [457acf28-5277-4578-be2f-82b18e59b660] Reconnected to AMQP server on 10.222.0.43:5672 via [amqp] client with port 46074. Oct 04 19:27:58.305969 n-d-851028-13 devstack@n-api.service[123595]: INFO oslo.messaging._drivers.impl_rabbit [-] [b5b0be1f-cd68-4bfe-8e95-82ae6af61476] Reconnected to AMQP server on 10.222.0.43:5672 via [amqp] client with port 46076. Oct 04 19:27:58.308442 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-88511ac2-c227-4767-b14b-acac5aec356e tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:27:58.309655 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-88511ac2-c227-4767-b14b-acac5aec356e tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:27:58.310184 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-88511ac2-c227-4767-b14b-acac5aec356e tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:27:58.310986 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-88511ac2-c227-4767-b14b-acac5aec356e tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:27:58.311518 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-88511ac2-c227-4767-b14b-acac5aec356e tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:27:58.312038 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-88511ac2-c227-4767-b14b-acac5aec356e tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:27:58.458838 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-88511ac2-c227-4767-b14b-acac5aec356e tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:27:58.467310 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-88511ac2-c227-4767-b14b-acac5aec356e tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/62243100-b523-40d3-997e-f7b8839a8be7" status: 200 len: 1278 microversion: 2.1 time: 0.190728 Oct 04 19:27:58.468266 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3244/6859] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:27:58 2022] GET /compute/v2.1/servers/62243100-b523-40d3-997e-f7b8839a8be7 => generated 1278 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:27:58.602173 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-e0fe9f73-232e-47cc-b8c0-c9439f70a8c4 req-96f0f4d8-f1e4-4c61-9a13-ad97b27bb63e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62243100-b523-40d3-997e-f7b8839a8be7", "tag": "1eb61395-8761-4826-80b1-0816a75bf4b0"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:27:58.621965 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-e0fe9f73-232e-47cc-b8c0-c9439f70a8c4 req-96f0f4d8-f1e4-4c61-9a13-ad97b27bb63e service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:27:58.622908 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-e0fe9f73-232e-47cc-b8c0-c9439f70a8c4 req-96f0f4d8-f1e4-4c61-9a13-ad97b27bb63e service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:27:58.623548 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-e0fe9f73-232e-47cc-b8c0-c9439f70a8c4 req-96f0f4d8-f1e4-4c61-9a13-ad97b27bb63e service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:27:58.638133 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-e0fe9f73-232e-47cc-b8c0-c9439f70a8c4 req-96f0f4d8-f1e4-4c61-9a13-ad97b27bb63e service nova] Creating event network-changed:1eb61395-8761-4826-80b1-0816a75bf4b0 for instance 62243100-b523-40d3-997e-f7b8839a8be7 on n-h2-851028-13 Oct 04 19:27:58.645870 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-e0fe9f73-232e-47cc-b8c0-c9439f70a8c4 req-96f0f4d8-f1e4-4c61-9a13-ad97b27bb63e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056477 Oct 04 19:27:58.647090 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3616/6860] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:27:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:27:59.490998 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-9f365009-4472-44fe-a267-0608529dd797 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:27:59.491524 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-9f365009-4472-44fe-a267-0608529dd797 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: 62243100-b523-40d3-997e-f7b8839a8be7] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:27:59.499394 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9f365009-4472-44fe-a267-0608529dd797 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:27:59.499889 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9f365009-4472-44fe-a267-0608529dd797 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:27:59.500536 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9f365009-4472-44fe-a267-0608529dd797 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:27:59.501341 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9f365009-4472-44fe-a267-0608529dd797 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:27:59.501863 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9f365009-4472-44fe-a267-0608529dd797 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:27:59.502478 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9f365009-4472-44fe-a267-0608529dd797 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:27:59.646722 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-9f365009-4472-44fe-a267-0608529dd797 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:27:59.655721 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-9f365009-4472-44fe-a267-0608529dd797 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/62243100-b523-40d3-997e-f7b8839a8be7" status: 200 len: 1278 microversion: 2.1 time: 0.168673 Oct 04 19:27:59.656532 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3245/6861] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:27:59 2022] GET /compute/v2.1/servers/62243100-b523-40d3-997e-f7b8839a8be7 => generated 1278 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:28:00.680978 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-22a1700a-ac85-4ba7-b0a0-cd44fed46b25 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:28:00.681619 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-22a1700a-ac85-4ba7-b0a0-cd44fed46b25 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: 62243100-b523-40d3-997e-f7b8839a8be7] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:28:00.688749 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-22a1700a-ac85-4ba7-b0a0-cd44fed46b25 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:28:00.689282 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-22a1700a-ac85-4ba7-b0a0-cd44fed46b25 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:28:00.689742 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-22a1700a-ac85-4ba7-b0a0-cd44fed46b25 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:28:00.690462 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-22a1700a-ac85-4ba7-b0a0-cd44fed46b25 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:28:00.690935 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-22a1700a-ac85-4ba7-b0a0-cd44fed46b25 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:28:00.691381 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-22a1700a-ac85-4ba7-b0a0-cd44fed46b25 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:28:00.827016 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-22a1700a-ac85-4ba7-b0a0-cd44fed46b25 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:28:00.834914 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-22a1700a-ac85-4ba7-b0a0-cd44fed46b25 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/62243100-b523-40d3-997e-f7b8839a8be7" status: 200 len: 1278 microversion: 2.1 time: 0.159751 Oct 04 19:28:00.835646 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3617/6862] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:28:00 2022] GET /compute/v2.1/servers/62243100-b523-40d3-997e-f7b8839a8be7 => generated 1278 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:28:01.859700 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-923e366a-f3eb-408b-bd0e-12b5e6a12772 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:28:01.860592 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-923e366a-f3eb-408b-bd0e-12b5e6a12772 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: 62243100-b523-40d3-997e-f7b8839a8be7] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:28:01.869751 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-923e366a-f3eb-408b-bd0e-12b5e6a12772 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:28:01.870325 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-923e366a-f3eb-408b-bd0e-12b5e6a12772 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:28:01.870818 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-923e366a-f3eb-408b-bd0e-12b5e6a12772 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:28:01.871873 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-923e366a-f3eb-408b-bd0e-12b5e6a12772 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:28:01.872496 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-923e366a-f3eb-408b-bd0e-12b5e6a12772 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:28:01.873025 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-923e366a-f3eb-408b-bd0e-12b5e6a12772 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:28:02.034896 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-923e366a-f3eb-408b-bd0e-12b5e6a12772 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:28:02.044249 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-923e366a-f3eb-408b-bd0e-12b5e6a12772 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/62243100-b523-40d3-997e-f7b8839a8be7" status: 200 len: 1278 microversion: 2.1 time: 0.189919 Oct 04 19:28:02.057428 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3246/6863] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:28:01 2022] GET /compute/v2.1/servers/62243100-b523-40d3-997e-f7b8839a8be7 => generated 1278 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:28:03.067946 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-9cb5a57b-83b8-49b4-a544-62c9dfb96462 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:28:03.068571 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-9cb5a57b-83b8-49b4-a544-62c9dfb96462 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: 62243100-b523-40d3-997e-f7b8839a8be7] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:28:03.075783 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9cb5a57b-83b8-49b4-a544-62c9dfb96462 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:28:03.076295 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9cb5a57b-83b8-49b4-a544-62c9dfb96462 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:28:03.076760 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9cb5a57b-83b8-49b4-a544-62c9dfb96462 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:28:03.077513 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9cb5a57b-83b8-49b4-a544-62c9dfb96462 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:28:03.077991 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9cb5a57b-83b8-49b4-a544-62c9dfb96462 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:28:03.078474 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9cb5a57b-83b8-49b4-a544-62c9dfb96462 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:28:03.216150 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-9cb5a57b-83b8-49b4-a544-62c9dfb96462 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:28:03.224302 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-9cb5a57b-83b8-49b4-a544-62c9dfb96462 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/62243100-b523-40d3-997e-f7b8839a8be7" status: 200 len: 1266 microversion: 2.1 time: 0.160297 Oct 04 19:28:03.224883 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3618/6864] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:28:03 2022] GET /compute/v2.1/servers/62243100-b523-40d3-997e-f7b8839a8be7 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:28:04.249991 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-f43d2421-703a-4d6b-aa66-269afa2d1d7b tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:28:04.250744 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-f43d2421-703a-4d6b-aa66-269afa2d1d7b tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: 62243100-b523-40d3-997e-f7b8839a8be7] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:28:04.258374 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f43d2421-703a-4d6b-aa66-269afa2d1d7b tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:28:04.258897 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f43d2421-703a-4d6b-aa66-269afa2d1d7b tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:28:04.259387 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f43d2421-703a-4d6b-aa66-269afa2d1d7b tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:28:04.260168 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f43d2421-703a-4d6b-aa66-269afa2d1d7b tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:28:04.260635 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f43d2421-703a-4d6b-aa66-269afa2d1d7b tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:28:04.261240 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f43d2421-703a-4d6b-aa66-269afa2d1d7b tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:28:04.394716 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-f43d2421-703a-4d6b-aa66-269afa2d1d7b tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:28:04.404390 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-f43d2421-703a-4d6b-aa66-269afa2d1d7b tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/62243100-b523-40d3-997e-f7b8839a8be7" status: 200 len: 1266 microversion: 2.1 time: 0.158986 Oct 04 19:28:04.404970 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3247/6865] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:28:04 2022] GET /compute/v2.1/servers/62243100-b523-40d3-997e-f7b8839a8be7 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:28:05.431370 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f87b8b65-82da-43f6-9850-7e5d14dffa88 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:28:05.431997 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-f87b8b65-82da-43f6-9850-7e5d14dffa88 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: 62243100-b523-40d3-997e-f7b8839a8be7] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:28:05.439207 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f87b8b65-82da-43f6-9850-7e5d14dffa88 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:28:05.439710 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f87b8b65-82da-43f6-9850-7e5d14dffa88 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:28:05.440165 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f87b8b65-82da-43f6-9850-7e5d14dffa88 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:28:05.440876 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f87b8b65-82da-43f6-9850-7e5d14dffa88 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:28:05.441387 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f87b8b65-82da-43f6-9850-7e5d14dffa88 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:28:05.441830 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f87b8b65-82da-43f6-9850-7e5d14dffa88 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:28:05.577159 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-f87b8b65-82da-43f6-9850-7e5d14dffa88 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:28:05.585591 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-f87b8b65-82da-43f6-9850-7e5d14dffa88 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/62243100-b523-40d3-997e-f7b8839a8be7" status: 200 len: 1266 microversion: 2.1 time: 0.158245 Oct 04 19:28:05.586243 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3619/6866] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:28:05 2022] GET /compute/v2.1/servers/62243100-b523-40d3-997e-f7b8839a8be7 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:28:06.610184 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-06f4b3f8-5ce6-4306-a04a-e0aded7a3b49 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:28:06.610902 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-06f4b3f8-5ce6-4306-a04a-e0aded7a3b49 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: 62243100-b523-40d3-997e-f7b8839a8be7] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:28:06.613571 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=2 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:28:06.619416 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-06f4b3f8-5ce6-4306-a04a-e0aded7a3b49 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:28:06.619902 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-06f4b3f8-5ce6-4306-a04a-e0aded7a3b49 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:28:06.620341 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-06f4b3f8-5ce6-4306-a04a-e0aded7a3b49 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:28:06.621038 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-06f4b3f8-5ce6-4306-a04a-e0aded7a3b49 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:28:06.621532 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-06f4b3f8-5ce6-4306-a04a-e0aded7a3b49 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:28:06.621962 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-06f4b3f8-5ce6-4306-a04a-e0aded7a3b49 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:28:06.758914 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-06f4b3f8-5ce6-4306-a04a-e0aded7a3b49 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:28:06.766883 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-06f4b3f8-5ce6-4306-a04a-e0aded7a3b49 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/62243100-b523-40d3-997e-f7b8839a8be7" status: 200 len: 1266 microversion: 2.1 time: 0.160341 Oct 04 19:28:06.767456 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3248/6867] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:28:06 2022] GET /compute/v2.1/servers/62243100-b523-40d3-997e-f7b8839a8be7 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:28:07.790135 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-68bc3318-5eb1-4d19-9d47-c769e6c0310d tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:28:07.790789 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-68bc3318-5eb1-4d19-9d47-c769e6c0310d tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: 62243100-b523-40d3-997e-f7b8839a8be7] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:28:07.792780 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=2 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:28:07.793495 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=6 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:28:07.800811 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-68bc3318-5eb1-4d19-9d47-c769e6c0310d tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:28:07.801356 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-68bc3318-5eb1-4d19-9d47-c769e6c0310d tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:28:07.801819 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-68bc3318-5eb1-4d19-9d47-c769e6c0310d tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:28:07.802544 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-68bc3318-5eb1-4d19-9d47-c769e6c0310d tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:28:07.803032 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-68bc3318-5eb1-4d19-9d47-c769e6c0310d tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:28:07.803486 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-68bc3318-5eb1-4d19-9d47-c769e6c0310d tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:28:07.937967 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-68bc3318-5eb1-4d19-9d47-c769e6c0310d tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:28:07.945759 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-68bc3318-5eb1-4d19-9d47-c769e6c0310d tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/62243100-b523-40d3-997e-f7b8839a8be7" status: 200 len: 1266 microversion: 2.1 time: 0.160033 Oct 04 19:28:07.946336 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3620/6868] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:28:07 2022] GET /compute/v2.1/servers/62243100-b523-40d3-997e-f7b8839a8be7 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:28:08.968135 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-c3c8fc7a-e48a-492c-adc5-92134228c3b2 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:28:08.968746 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-c3c8fc7a-e48a-492c-adc5-92134228c3b2 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: 62243100-b523-40d3-997e-f7b8839a8be7] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:28:08.976361 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c3c8fc7a-e48a-492c-adc5-92134228c3b2 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:28:08.976850 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c3c8fc7a-e48a-492c-adc5-92134228c3b2 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:28:08.977315 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c3c8fc7a-e48a-492c-adc5-92134228c3b2 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:28:08.978009 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c3c8fc7a-e48a-492c-adc5-92134228c3b2 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:28:08.978461 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c3c8fc7a-e48a-492c-adc5-92134228c3b2 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:28:08.978887 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c3c8fc7a-e48a-492c-adc5-92134228c3b2 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:28:09.111551 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-c3c8fc7a-e48a-492c-adc5-92134228c3b2 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:28:09.119318 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-c3c8fc7a-e48a-492c-adc5-92134228c3b2 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/62243100-b523-40d3-997e-f7b8839a8be7" status: 200 len: 1266 microversion: 2.1 time: 0.155097 Oct 04 19:28:09.119896 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3249/6869] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:28:08 2022] GET /compute/v2.1/servers/62243100-b523-40d3-997e-f7b8839a8be7 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:28:10.143518 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-912c0c9f-15f5-4e1e-951c-0429985917ea tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:28:10.144159 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-912c0c9f-15f5-4e1e-951c-0429985917ea tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: 62243100-b523-40d3-997e-f7b8839a8be7] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:28:10.153657 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-912c0c9f-15f5-4e1e-951c-0429985917ea tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:28:10.154181 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-912c0c9f-15f5-4e1e-951c-0429985917ea tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:28:10.154989 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-912c0c9f-15f5-4e1e-951c-0429985917ea tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:28:10.155717 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-912c0c9f-15f5-4e1e-951c-0429985917ea tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:28:10.156332 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-912c0c9f-15f5-4e1e-951c-0429985917ea tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:28:10.156653 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-912c0c9f-15f5-4e1e-951c-0429985917ea tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:28:10.623048 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-912c0c9f-15f5-4e1e-951c-0429985917ea tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:28:10.630937 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-912c0c9f-15f5-4e1e-951c-0429985917ea tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/62243100-b523-40d3-997e-f7b8839a8be7" status: 200 len: 1266 microversion: 2.1 time: 0.492135 Oct 04 19:28:10.631528 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3621/6870] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:28:10 2022] GET /compute/v2.1/servers/62243100-b523-40d3-997e-f7b8839a8be7 => generated 1266 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:28:11.655947 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-606b6da2-b411-4adf-834d-c5ef519c1e73 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:28:11.656716 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-606b6da2-b411-4adf-834d-c5ef519c1e73 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: 62243100-b523-40d3-997e-f7b8839a8be7] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:28:11.664144 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-606b6da2-b411-4adf-834d-c5ef519c1e73 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:28:11.664627 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-606b6da2-b411-4adf-834d-c5ef519c1e73 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:28:11.665068 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-606b6da2-b411-4adf-834d-c5ef519c1e73 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:28:11.665819 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-606b6da2-b411-4adf-834d-c5ef519c1e73 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:28:11.666276 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-606b6da2-b411-4adf-834d-c5ef519c1e73 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:28:11.666741 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-606b6da2-b411-4adf-834d-c5ef519c1e73 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:28:11.799414 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-606b6da2-b411-4adf-834d-c5ef519c1e73 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:28:11.807335 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-606b6da2-b411-4adf-834d-c5ef519c1e73 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/62243100-b523-40d3-997e-f7b8839a8be7" status: 200 len: 1266 microversion: 2.1 time: 0.155340 Oct 04 19:28:11.807922 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3250/6871] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:28:11 2022] GET /compute/v2.1/servers/62243100-b523-40d3-997e-f7b8839a8be7 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:28:12.001863 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-7fa78be5-d772-436e-a72e-23931ee8c168 req-2a27a775-a12d-43c4-b47c-881cbdb661d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62243100-b523-40d3-997e-f7b8839a8be7", "name": "network-vif-plugged", "status": "completed", "tag": "1eb61395-8761-4826-80b1-0816a75bf4b0"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:28:12.013770 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-7fa78be5-d772-436e-a72e-23931ee8c168 req-2a27a775-a12d-43c4-b47c-881cbdb661d6 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:28:12.014273 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-7fa78be5-d772-436e-a72e-23931ee8c168 req-2a27a775-a12d-43c4-b47c-881cbdb661d6 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:28:12.014761 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-7fa78be5-d772-436e-a72e-23931ee8c168 req-2a27a775-a12d-43c4-b47c-881cbdb661d6 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:28:12.026782 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-7fa78be5-d772-436e-a72e-23931ee8c168 req-2a27a775-a12d-43c4-b47c-881cbdb661d6 service nova] Creating event network-vif-plugged:1eb61395-8761-4826-80b1-0816a75bf4b0 for instance 62243100-b523-40d3-997e-f7b8839a8be7 on n-h2-851028-13 Oct 04 19:28:12.031780 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-7fa78be5-d772-436e-a72e-23931ee8c168 req-2a27a775-a12d-43c4-b47c-881cbdb661d6 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033705 Oct 04 19:28:12.032419 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3622/6872] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:28:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:28:12.831051 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-feedcb64-f9c5-42b0-a5b7-aff4ed756bdf tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:28:12.831724 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-feedcb64-f9c5-42b0-a5b7-aff4ed756bdf tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: 62243100-b523-40d3-997e-f7b8839a8be7] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:28:12.838758 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-feedcb64-f9c5-42b0-a5b7-aff4ed756bdf tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:28:12.839247 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-feedcb64-f9c5-42b0-a5b7-aff4ed756bdf tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:28:12.839782 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-feedcb64-f9c5-42b0-a5b7-aff4ed756bdf tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:28:12.840494 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-feedcb64-f9c5-42b0-a5b7-aff4ed756bdf tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:28:12.840934 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-feedcb64-f9c5-42b0-a5b7-aff4ed756bdf tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:28:12.841389 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-feedcb64-f9c5-42b0-a5b7-aff4ed756bdf tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:28:12.977262 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-feedcb64-f9c5-42b0-a5b7-aff4ed756bdf tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:28:12.985196 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-feedcb64-f9c5-42b0-a5b7-aff4ed756bdf tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/62243100-b523-40d3-997e-f7b8839a8be7" status: 200 len: 1266 microversion: 2.1 time: 0.158071 Oct 04 19:28:12.985772 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3251/6873] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:28:12 2022] GET /compute/v2.1/servers/62243100-b523-40d3-997e-f7b8839a8be7 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:28:14.010870 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-585e74ec-74d8-44a9-8003-91515cc6d9ca tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:28:14.011634 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-585e74ec-74d8-44a9-8003-91515cc6d9ca tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: 62243100-b523-40d3-997e-f7b8839a8be7] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:28:14.018350 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-585e74ec-74d8-44a9-8003-91515cc6d9ca tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:28:14.018862 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-585e74ec-74d8-44a9-8003-91515cc6d9ca tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:28:14.019370 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-585e74ec-74d8-44a9-8003-91515cc6d9ca tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:28:14.020137 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-585e74ec-74d8-44a9-8003-91515cc6d9ca tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:28:14.020617 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-585e74ec-74d8-44a9-8003-91515cc6d9ca tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:28:14.021098 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-585e74ec-74d8-44a9-8003-91515cc6d9ca tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:28:14.155840 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-585e74ec-74d8-44a9-8003-91515cc6d9ca tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:28:14.164096 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-585e74ec-74d8-44a9-8003-91515cc6d9ca tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/62243100-b523-40d3-997e-f7b8839a8be7" status: 200 len: 1453 microversion: 2.1 time: 0.159316 Oct 04 19:28:14.164679 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3623/6874] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:28:14 2022] GET /compute/v2.1/servers/62243100-b523-40d3-997e-f7b8839a8be7 => generated 1453 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:28:14.186927 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-16cae9f4-0cea-4075-b243-d0321e9c1ef0 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:28:14.187538 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-16cae9f4-0cea-4075-b243-d0321e9c1ef0 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: 62243100-b523-40d3-997e-f7b8839a8be7] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:28:14.194934 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-16cae9f4-0cea-4075-b243-d0321e9c1ef0 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:28:14.195412 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-16cae9f4-0cea-4075-b243-d0321e9c1ef0 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:28:14.195848 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-16cae9f4-0cea-4075-b243-d0321e9c1ef0 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:28:14.196538 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-16cae9f4-0cea-4075-b243-d0321e9c1ef0 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:28:14.196989 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-16cae9f4-0cea-4075-b243-d0321e9c1ef0 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:28:14.197472 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-16cae9f4-0cea-4075-b243-d0321e9c1ef0 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:28:14.328712 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-16cae9f4-0cea-4075-b243-d0321e9c1ef0 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:28:14.336634 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-16cae9f4-0cea-4075-b243-d0321e9c1ef0 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/62243100-b523-40d3-997e-f7b8839a8be7" status: 200 len: 1453 microversion: 2.1 time: 0.153606 Oct 04 19:28:14.337229 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3252/6875] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:28:14 2022] GET /compute/v2.1/servers/62243100-b523-40d3-997e-f7b8839a8be7 => generated 1453 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:28:16.035644 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-7721f144-b8cf-4a60-a8b2-15a04ceba5fc req-e66f2229-2cb1-44cf-a572-0d2db2ab2730 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62243100-b523-40d3-997e-f7b8839a8be7", "tag": "1eb61395-8761-4826-80b1-0816a75bf4b0"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:28:16.045983 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-7721f144-b8cf-4a60-a8b2-15a04ceba5fc req-e66f2229-2cb1-44cf-a572-0d2db2ab2730 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:28:16.046487 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-7721f144-b8cf-4a60-a8b2-15a04ceba5fc req-e66f2229-2cb1-44cf-a572-0d2db2ab2730 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:28:16.046935 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-7721f144-b8cf-4a60-a8b2-15a04ceba5fc req-e66f2229-2cb1-44cf-a572-0d2db2ab2730 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:28:16.059105 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-7721f144-b8cf-4a60-a8b2-15a04ceba5fc req-e66f2229-2cb1-44cf-a572-0d2db2ab2730 service nova] Creating event network-changed:1eb61395-8761-4826-80b1-0816a75bf4b0 for instance 62243100-b523-40d3-997e-f7b8839a8be7 on n-h2-851028-13 Oct 04 19:28:16.064802 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-7721f144-b8cf-4a60-a8b2-15a04ceba5fc req-e66f2229-2cb1-44cf-a572-0d2db2ab2730 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105910 Oct 04 19:28:16.065449 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3624/6876] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:28:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:29:44.267985 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-08793e45-2d84-4840-9f03-5fb3e5828525 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:29:44.268550 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-08793e45-2d84-4840-9f03-5fb3e5828525 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: 62243100-b523-40d3-997e-f7b8839a8be7] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:29:44.271449 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_api:SELECT=22 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:29:44.274349 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=54 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:29:44.283279 n-d-851028-13 devstack@n-api.service[123595]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 19:29:44.283720 n-d-851028-13 devstack@n-api.service[123595]: Tue Oct 4 19:29:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/62243100-b523-40d3-997e-f7b8839a8be7 (ip 10.222.0.43) !!! Oct 04 19:29:44.285345 n-d-851028-13 devstack@n-api.service[123595]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 19:29:44.285652 n-d-851028-13 devstack@n-api.service[123595]: Tue Oct 4 19:29:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/62243100-b523-40d3-997e-f7b8839a8be7 (ip 10.222.0.43) !!! Oct 04 19:29:44.287699 n-d-851028-13 devstack@n-api.service[123595]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 19:29:44.290728 n-d-851028-13 devstack@n-api.service[123595]: Tue Oct 4 19:29:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/62243100-b523-40d3-997e-f7b8839a8be7 (ip 10.222.0.43) !!! Oct 04 19:29:44.307787 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-08793e45-2d84-4840-9f03-5fb3e5828525 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:29:44.309861 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-08793e45-2d84-4840-9f03-5fb3e5828525 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:29:44.312932 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-08793e45-2d84-4840-9f03-5fb3e5828525 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:29:44.317969 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-08793e45-2d84-4840-9f03-5fb3e5828525 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:29:44.318654 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-08793e45-2d84-4840-9f03-5fb3e5828525 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:29:44.319177 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-08793e45-2d84-4840-9f03-5fb3e5828525 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:29:44.392558 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-08793e45-2d84-4840-9f03-5fb3e5828525 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: 62243100-b523-40d3-997e-f7b8839a8be7] Going to try to terminate instance {{(pid=123595) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 19:29:44.497246 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-08793e45-2d84-4840-9f03-5fb3e5828525 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "DELETE /compute/v2.1/servers/62243100-b523-40d3-997e-f7b8839a8be7" status: 204 len: 0 microversion: 2.1 time: 0.239740 Oct 04 19:29:44.497846 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3253/6877] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 19:29:44 2022] DELETE /compute/v2.1/servers/62243100-b523-40d3-997e-f7b8839a8be7 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:29:44.505979 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:29:44.507287 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=50 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:29:44.508427 n-d-851028-13 devstack@n-api.service[123596]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 19:29:44.508761 n-d-851028-13 devstack@n-api.service[123596]: Tue Oct 4 19:29:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/62243100-b523-40d3-997e-f7b8839a8be7 (ip 10.222.0.43) !!! Oct 04 19:29:44.517255 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-a8964ca4-16aa-4cce-818c-39761b7d5577 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:29:44.518295 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-a8964ca4-16aa-4cce-818c-39761b7d5577 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: 62243100-b523-40d3-997e-f7b8839a8be7] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:29:44.534857 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a8964ca4-16aa-4cce-818c-39761b7d5577 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:29:44.535748 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a8964ca4-16aa-4cce-818c-39761b7d5577 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:29:44.536438 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a8964ca4-16aa-4cce-818c-39761b7d5577 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:29:44.537418 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a8964ca4-16aa-4cce-818c-39761b7d5577 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:29:44.538112 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a8964ca4-16aa-4cce-818c-39761b7d5577 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:29:44.538758 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a8964ca4-16aa-4cce-818c-39761b7d5577 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:29:44.722650 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-64596be3-b86c-4d15-bf80-9e33a2fe810d req-a07b6e01-adb1-4f31-8e8a-3b0d88c4d610 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62243100-b523-40d3-997e-f7b8839a8be7", "tag": "1eb61395-8761-4826-80b1-0816a75bf4b0"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:29:44.734392 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-64596be3-b86c-4d15-bf80-9e33a2fe810d req-a07b6e01-adb1-4f31-8e8a-3b0d88c4d610 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:29:44.735361 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-64596be3-b86c-4d15-bf80-9e33a2fe810d req-a07b6e01-adb1-4f31-8e8a-3b0d88c4d610 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:29:44.736505 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-64596be3-b86c-4d15-bf80-9e33a2fe810d req-a07b6e01-adb1-4f31-8e8a-3b0d88c4d610 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:29:44.760140 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-64596be3-b86c-4d15-bf80-9e33a2fe810d req-a07b6e01-adb1-4f31-8e8a-3b0d88c4d610 service nova] Creating event network-changed:1eb61395-8761-4826-80b1-0816a75bf4b0 for instance 62243100-b523-40d3-997e-f7b8839a8be7 on n-h2-851028-13 Oct 04 19:29:44.765383 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-64596be3-b86c-4d15-bf80-9e33a2fe810d req-a07b6e01-adb1-4f31-8e8a-3b0d88c4d610 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.203047 Oct 04 19:29:44.767134 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3254/6878] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:29:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:29:44.902316 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-a8964ca4-16aa-4cce-818c-39761b7d5577 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:29:44.910359 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-a8964ca4-16aa-4cce-818c-39761b7d5577 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/62243100-b523-40d3-997e-f7b8839a8be7" status: 200 len: 1578 microversion: 2.1 time: 0.407558 Oct 04 19:29:44.910880 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3625/6879] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:29:44 2022] GET /compute/v2.1/servers/62243100-b523-40d3-997e-f7b8839a8be7 => generated 1578 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:29:45.934618 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-48256485-f8f8-4622-8f6c-5dcb2dec2269 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:29:45.935355 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-48256485-f8f8-4622-8f6c-5dcb2dec2269 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: 62243100-b523-40d3-997e-f7b8839a8be7] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:29:45.943428 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-48256485-f8f8-4622-8f6c-5dcb2dec2269 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:29:45.943914 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-48256485-f8f8-4622-8f6c-5dcb2dec2269 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:29:45.944354 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-48256485-f8f8-4622-8f6c-5dcb2dec2269 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:29:45.945047 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-48256485-f8f8-4622-8f6c-5dcb2dec2269 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:29:45.945531 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-48256485-f8f8-4622-8f6c-5dcb2dec2269 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:29:45.945959 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-48256485-f8f8-4622-8f6c-5dcb2dec2269 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:29:46.301194 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-48256485-f8f8-4622-8f6c-5dcb2dec2269 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:29:46.309207 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-48256485-f8f8-4622-8f6c-5dcb2dec2269 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/62243100-b523-40d3-997e-f7b8839a8be7" status: 200 len: 1578 microversion: 2.1 time: 0.378797 Oct 04 19:29:46.310001 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3255/6880] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:29:45 2022] GET /compute/v2.1/servers/62243100-b523-40d3-997e-f7b8839a8be7 => generated 1578 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:29:46.787264 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-863dceea-4c09-4583-9cfd-6d08428870f2 req-18d4888d-3786-4019-a916-cb695c57183b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62243100-b523-40d3-997e-f7b8839a8be7", "name": "network-vif-deleted", "tag": "1eb61395-8761-4826-80b1-0816a75bf4b0"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:29:46.798082 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-863dceea-4c09-4583-9cfd-6d08428870f2 req-18d4888d-3786-4019-a916-cb695c57183b service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:29:46.798510 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-863dceea-4c09-4583-9cfd-6d08428870f2 req-18d4888d-3786-4019-a916-cb695c57183b service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:29:46.799229 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-863dceea-4c09-4583-9cfd-6d08428870f2 req-18d4888d-3786-4019-a916-cb695c57183b service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:29:46.810608 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-863dceea-4c09-4583-9cfd-6d08428870f2 req-18d4888d-3786-4019-a916-cb695c57183b service nova] Creating event network-vif-deleted:1eb61395-8761-4826-80b1-0816a75bf4b0 for instance 62243100-b523-40d3-997e-f7b8839a8be7 on n-h2-851028-13 Oct 04 19:29:46.815580 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-863dceea-4c09-4583-9cfd-6d08428870f2 req-18d4888d-3786-4019-a916-cb695c57183b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032189 Oct 04 19:29:46.816183 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3626/6881] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:29:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:29:47.334045 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-8171387e-d5f1-410f-93f5-0c3d67fa96a5 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:29:47.334665 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-8171387e-d5f1-410f-93f5-0c3d67fa96a5 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: 62243100-b523-40d3-997e-f7b8839a8be7] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:29:47.341754 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8171387e-d5f1-410f-93f5-0c3d67fa96a5 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:29:47.342246 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8171387e-d5f1-410f-93f5-0c3d67fa96a5 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:29:47.342690 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8171387e-d5f1-410f-93f5-0c3d67fa96a5 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:29:47.343395 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8171387e-d5f1-410f-93f5-0c3d67fa96a5 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:29:47.344434 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8171387e-d5f1-410f-93f5-0c3d67fa96a5 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:29:47.344863 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8171387e-d5f1-410f-93f5-0c3d67fa96a5 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:29:47.414907 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-8171387e-d5f1-410f-93f5-0c3d67fa96a5 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:29:47.423370 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-8171387e-d5f1-410f-93f5-0c3d67fa96a5 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/62243100-b523-40d3-997e-f7b8839a8be7" status: 200 len: 1225 microversion: 2.1 time: 0.093167 Oct 04 19:29:47.423970 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3256/6882] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:29:47 2022] GET /compute/v2.1/servers/62243100-b523-40d3-997e-f7b8839a8be7 => generated 1225 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:29:48.448145 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-785682fe-7885-4139-93ca-211d67e56976 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:29:48.448896 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-785682fe-7885-4139-93ca-211d67e56976 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: 62243100-b523-40d3-997e-f7b8839a8be7] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:29:48.455974 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-785682fe-7885-4139-93ca-211d67e56976 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:29:48.456478 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-785682fe-7885-4139-93ca-211d67e56976 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:29:48.456934 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-785682fe-7885-4139-93ca-211d67e56976 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:29:48.457691 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-785682fe-7885-4139-93ca-211d67e56976 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:29:48.458164 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-785682fe-7885-4139-93ca-211d67e56976 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:29:48.458608 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-785682fe-7885-4139-93ca-211d67e56976 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:29:48.524491 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-785682fe-7885-4139-93ca-211d67e56976 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:29:48.532451 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-785682fe-7885-4139-93ca-211d67e56976 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/62243100-b523-40d3-997e-f7b8839a8be7" status: 200 len: 1225 microversion: 2.1 time: 0.089675 Oct 04 19:29:48.533030 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3627/6883] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:29:48 2022] GET /compute/v2.1/servers/62243100-b523-40d3-997e-f7b8839a8be7 => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:29:49.555572 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-0c9f80cb-03f0-40c1-9a21-0f74af3a47bb tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:29:49.556185 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-0c9f80cb-03f0-40c1-9a21-0f74af3a47bb tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: 62243100-b523-40d3-997e-f7b8839a8be7] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:29:49.563708 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0c9f80cb-03f0-40c1-9a21-0f74af3a47bb tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:29:49.564195 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0c9f80cb-03f0-40c1-9a21-0f74af3a47bb tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:29:49.564636 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0c9f80cb-03f0-40c1-9a21-0f74af3a47bb tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:29:49.565368 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0c9f80cb-03f0-40c1-9a21-0f74af3a47bb tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:29:49.565829 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0c9f80cb-03f0-40c1-9a21-0f74af3a47bb tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:29:49.566257 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0c9f80cb-03f0-40c1-9a21-0f74af3a47bb tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:29:49.632858 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-0c9f80cb-03f0-40c1-9a21-0f74af3a47bb tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:29:49.641091 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-0c9f80cb-03f0-40c1-9a21-0f74af3a47bb tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/62243100-b523-40d3-997e-f7b8839a8be7" status: 200 len: 1225 microversion: 2.1 time: 0.089386 Oct 04 19:29:49.641699 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3257/6884] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:29:49 2022] GET /compute/v2.1/servers/62243100-b523-40d3-997e-f7b8839a8be7 => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:29:50.664066 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-49aa6c73-596c-4da0-9f44-3f0c01a9b5f6 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:29:50.664786 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-49aa6c73-596c-4da0-9f44-3f0c01a9b5f6 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: 62243100-b523-40d3-997e-f7b8839a8be7] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:29:50.672543 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-49aa6c73-596c-4da0-9f44-3f0c01a9b5f6 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:29:50.673048 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-49aa6c73-596c-4da0-9f44-3f0c01a9b5f6 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:29:50.673544 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-49aa6c73-596c-4da0-9f44-3f0c01a9b5f6 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:29:50.674255 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-49aa6c73-596c-4da0-9f44-3f0c01a9b5f6 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:29:50.674721 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-49aa6c73-596c-4da0-9f44-3f0c01a9b5f6 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:29:50.675166 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-49aa6c73-596c-4da0-9f44-3f0c01a9b5f6 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:29:50.755466 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-49aa6c73-596c-4da0-9f44-3f0c01a9b5f6 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:29:50.766514 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-49aa6c73-596c-4da0-9f44-3f0c01a9b5f6 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/62243100-b523-40d3-997e-f7b8839a8be7" status: 200 len: 1225 microversion: 2.1 time: 0.105273 Oct 04 19:29:50.767137 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3628/6885] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:29:50 2022] GET /compute/v2.1/servers/62243100-b523-40d3-997e-f7b8839a8be7 => generated 1225 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:29:51.790520 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-650fa224-c40e-4e2f-be9b-a482e57ea3ed tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:29:51.791135 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-650fa224-c40e-4e2f-be9b-a482e57ea3ed tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: 62243100-b523-40d3-997e-f7b8839a8be7] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:29:51.798985 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-650fa224-c40e-4e2f-be9b-a482e57ea3ed tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:29:51.799479 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-650fa224-c40e-4e2f-be9b-a482e57ea3ed tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:29:51.800201 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-650fa224-c40e-4e2f-be9b-a482e57ea3ed tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:29:51.800943 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-650fa224-c40e-4e2f-be9b-a482e57ea3ed tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:29:51.801429 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-650fa224-c40e-4e2f-be9b-a482e57ea3ed tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:29:51.801865 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-650fa224-c40e-4e2f-be9b-a482e57ea3ed tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:29:51.816259 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-650fa224-c40e-4e2f-be9b-a482e57ea3ed tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] HTTP exception thrown: Instance 62243100-b523-40d3-997e-f7b8839a8be7 could not be found. Oct 04 19:29:51.817976 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-650fa224-c40e-4e2f-be9b-a482e57ea3ed tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Request method failure captured: Oct 04 19:29:51.817976 n-d-851028-13 devstack@n-api.service[123595]: request: GET /compute/v2.1/servers/62243100-b523-40d3-997e-f7b8839a8be7 HTTP/1.1 Oct 04 19:29:51.817976 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 19:29:51.817976 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 19:29:51.817976 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 19:29:51.817976 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 0 Oct 04 19:29:51.817976 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 19:29:51.817976 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 19:29:51.817976 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 19:29:51.817976 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 19:29:51.817976 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPIdD9eu-sNppZso9GBgF0qiQcNSNfbptUObqTJdNMmQeJtmiNalN1HCCgoRlIsnKAnm3yDfemx5F9JCBtqQ5VFIZ41axYIUJNVoTUZoGs-EEXp4RLTVvMn1M_mAUAx-w46wS7k3RPeCrtItzG8FEbUjMK8RLhn-Xr_i-jB7aqW9aWok Oct 04 19:29:51.817976 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 19:29:51.817976 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 19:29:51.817976 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 19:29:51.817976 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 19:29:51.817976 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 19:29:51.817976 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 19:29:51.817976 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: 9cd28590bda749c5aa109ae292cb32e6 Oct 04 19:29:51.817976 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-TestVolumeBootPattern-410499789 Oct 04 19:29:51.817976 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 19:29:51.817976 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 19:29:51.817976 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/9cd28590bda749c5aa109ae292cb32e6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_9cd28590bda749c5aa109ae292cb32e6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/9cd28590bda749c5aa109ae292cb32e6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/9cd28590bda749c5aa109ae292cb32e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 19:29:51.817976 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-TestVolumeBootPattern-410499789 Oct 04 19:29:51.817976 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: 9cd28590bda749c5aa109ae292cb32e6 Oct 04 19:29:51.817976 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-TestVolumeBootPattern-410499789 Oct 04 19:29:51.817976 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-TestVolumeBootPattern-410499789-project Oct 04 19:29:51.817976 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 19:29:51.817976 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 19:29:51.817976 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: 43efdccf8e2f4934ae5cfe3da828511e Oct 04 19:29:51.817976 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-TestVolumeBootPattern-410499789-project Oct 04 19:29:51.817976 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 19:29:51.817976 n-d-851028-13 devstack@n-api.service[123595]: exception: Instance 62243100-b523-40d3-997e-f7b8839a8be7 could not be found. Oct 04 19:29:51.817976 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': '62243100-b523-40d3-997e-f7b8839a8be7'} Oct 04 19:29:51.817976 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:29:51.817976 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:29:51.817976 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:29:51.817976 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:29:51.817976 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:29:51.817976 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:29:51.817976 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:29:51.817976 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:29:51.817976 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:29:51.817976 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:29:51.817976 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62243100-b523-40d3-997e-f7b8839a8be7 could not be found. Oct 04 19:29:51.817976 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:29:51.817976 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:29:51.817976 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:29:51.817976 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:29:51.817976 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:29:51.817976 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:29:51.817976 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:29:51.817976 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:29:51.817976 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:29:51.817976 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:29:51.817976 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:29:51.817976 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:29:51.817976 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:29:51.817976 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:29:51.817976 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:29:51.817976 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:29:51.817976 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62243100-b523-40d3-997e-f7b8839a8be7 could not be found. Oct 04 19:29:51.817976 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:29:51.817976 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:29:51.817976 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:29:51.822134 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:29:51.822134 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:29:51.822134 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:29:51.822134 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:29:51.822134 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:29:51.822134 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62243100-b523-40d3-997e-f7b8839a8be7 could not be found. Oct 04 19:29:51.822134 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:29:51.822134 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-650fa224-c40e-4e2f-be9b-a482e57ea3ed tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Returning 404 to user: Instance 62243100-b523-40d3-997e-f7b8839a8be7 could not be found. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:29:51.822134 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-650fa224-c40e-4e2f-be9b-a482e57ea3ed tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/62243100-b523-40d3-997e-f7b8839a8be7" status: 404 len: 111 microversion: 2.1 time: 0.032809 Oct 04 19:29:51.822134 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3258/6886] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:29:51 2022] GET /compute/v2.1/servers/62243100-b523-40d3-997e-f7b8839a8be7 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:29:58.100821 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-5daa5e1b-afa4-4e37-8c59-b67c37289da8 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:29:58.101957 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-5daa5e1b-afa4-4e37-8c59-b67c37289da8 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: 53b4fbba-ff8d-4b05-96d5-171cc6bd9f41] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:29:58.103392 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-f7e78d28-c8a9-4c33-858b-185309c5e66b req-5681053e-8ac0-4c31-91d9-0f0454c51651 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53b4fbba-ff8d-4b05-96d5-171cc6bd9f41", "tag": "4b2c39bd-061a-416e-8eb1-d9f9790e91a8"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:29:58.109281 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5daa5e1b-afa4-4e37-8c59-b67c37289da8 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:29:58.109794 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5daa5e1b-afa4-4e37-8c59-b67c37289da8 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:29:58.110249 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5daa5e1b-afa4-4e37-8c59-b67c37289da8 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:29:58.111014 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5daa5e1b-afa4-4e37-8c59-b67c37289da8 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:29:58.111474 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5daa5e1b-afa4-4e37-8c59-b67c37289da8 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:29:58.111917 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5daa5e1b-afa4-4e37-8c59-b67c37289da8 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:29:58.114873 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-f7e78d28-c8a9-4c33-858b-185309c5e66b req-5681053e-8ac0-4c31-91d9-0f0454c51651 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:29:58.115576 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-f7e78d28-c8a9-4c33-858b-185309c5e66b req-5681053e-8ac0-4c31-91d9-0f0454c51651 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:29:58.116264 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-f7e78d28-c8a9-4c33-858b-185309c5e66b req-5681053e-8ac0-4c31-91d9-0f0454c51651 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:29:58.129191 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-f7e78d28-c8a9-4c33-858b-185309c5e66b req-5681053e-8ac0-4c31-91d9-0f0454c51651 service nova] Creating event network-changed:4b2c39bd-061a-416e-8eb1-d9f9790e91a8 for instance 53b4fbba-ff8d-4b05-96d5-171cc6bd9f41 on n-h1-851028-13 Oct 04 19:29:58.135093 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-f7e78d28-c8a9-4c33-858b-185309c5e66b req-5681053e-8ac0-4c31-91d9-0f0454c51651 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035722 Oct 04 19:29:58.136084 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3259/6887] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:29:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:29:58.140372 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-5daa5e1b-afa4-4e37-8c59-b67c37289da8 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: 53b4fbba-ff8d-4b05-96d5-171cc6bd9f41] Going to try to terminate instance {{(pid=123596) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 19:29:58.223449 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-5daa5e1b-afa4-4e37-8c59-b67c37289da8 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "DELETE /compute/v2.1/servers/53b4fbba-ff8d-4b05-96d5-171cc6bd9f41" status: 204 len: 0 microversion: 2.1 time: 0.126786 Oct 04 19:29:58.224733 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3629/6888] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 19:29:58 2022] DELETE /compute/v2.1/servers/53b4fbba-ff8d-4b05-96d5-171cc6bd9f41 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:29:58.241966 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-424cd97b-1e72-49af-b7ba-36db6c083d7a tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:29:58.243003 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-424cd97b-1e72-49af-b7ba-36db6c083d7a tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: 53b4fbba-ff8d-4b05-96d5-171cc6bd9f41] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:29:58.250881 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-424cd97b-1e72-49af-b7ba-36db6c083d7a tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:29:58.252129 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-424cd97b-1e72-49af-b7ba-36db6c083d7a tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:29:58.252564 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-424cd97b-1e72-49af-b7ba-36db6c083d7a tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:29:58.253335 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-424cd97b-1e72-49af-b7ba-36db6c083d7a tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:29:58.253802 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-424cd97b-1e72-49af-b7ba-36db6c083d7a tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:29:58.254241 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-424cd97b-1e72-49af-b7ba-36db6c083d7a tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:29:58.396150 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-424cd97b-1e72-49af-b7ba-36db6c083d7a tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:29:58.404067 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-424cd97b-1e72-49af-b7ba-36db6c083d7a tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/53b4fbba-ff8d-4b05-96d5-171cc6bd9f41" status: 200 len: 1577 microversion: 2.1 time: 0.171390 Oct 04 19:29:58.404693 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3260/6889] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:29:58 2022] GET /compute/v2.1/servers/53b4fbba-ff8d-4b05-96d5-171cc6bd9f41 => generated 1577 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:29:59.429099 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-70c7aa01-9164-4206-946c-6ec5c0a3a468 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:29:59.429926 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-70c7aa01-9164-4206-946c-6ec5c0a3a468 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: 53b4fbba-ff8d-4b05-96d5-171cc6bd9f41] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:29:59.436990 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-70c7aa01-9164-4206-946c-6ec5c0a3a468 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:29:59.437533 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-70c7aa01-9164-4206-946c-6ec5c0a3a468 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:29:59.437995 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-70c7aa01-9164-4206-946c-6ec5c0a3a468 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:29:59.438719 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-70c7aa01-9164-4206-946c-6ec5c0a3a468 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:29:59.439201 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-70c7aa01-9164-4206-946c-6ec5c0a3a468 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:29:59.439659 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-70c7aa01-9164-4206-946c-6ec5c0a3a468 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:29:59.604113 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-70c7aa01-9164-4206-946c-6ec5c0a3a468 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:29:59.612048 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-70c7aa01-9164-4206-946c-6ec5c0a3a468 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/53b4fbba-ff8d-4b05-96d5-171cc6bd9f41" status: 200 len: 1577 microversion: 2.1 time: 0.187423 Oct 04 19:29:59.612616 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3630/6890] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:29:59 2022] GET /compute/v2.1/servers/53b4fbba-ff8d-4b05-96d5-171cc6bd9f41 => generated 1577 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:30:00.217928 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-fe7501ed-d5ea-48db-bac5-b9d6e8b5bcb1 req-76f2d72d-6f30-4e75-a5cf-1722aea22a44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53b4fbba-ff8d-4b05-96d5-171cc6bd9f41", "name": "network-vif-deleted", "tag": "4b2c39bd-061a-416e-8eb1-d9f9790e91a8"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:30:00.230644 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-fe7501ed-d5ea-48db-bac5-b9d6e8b5bcb1 req-76f2d72d-6f30-4e75-a5cf-1722aea22a44 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:30:00.231129 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-fe7501ed-d5ea-48db-bac5-b9d6e8b5bcb1 req-76f2d72d-6f30-4e75-a5cf-1722aea22a44 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:30:00.231565 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-fe7501ed-d5ea-48db-bac5-b9d6e8b5bcb1 req-76f2d72d-6f30-4e75-a5cf-1722aea22a44 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:30:00.245092 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-fe7501ed-d5ea-48db-bac5-b9d6e8b5bcb1 req-76f2d72d-6f30-4e75-a5cf-1722aea22a44 service nova] Creating event network-vif-deleted:4b2c39bd-061a-416e-8eb1-d9f9790e91a8 for instance 53b4fbba-ff8d-4b05-96d5-171cc6bd9f41 on n-h1-851028-13 Oct 04 19:30:00.251365 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-fe7501ed-d5ea-48db-bac5-b9d6e8b5bcb1 req-76f2d72d-6f30-4e75-a5cf-1722aea22a44 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037498 Oct 04 19:30:00.251671 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3261/6891] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:30:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:30:00.636760 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-62ff7568-30ad-42e1-90a2-17a069bf7479 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:30:00.641638 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-62ff7568-30ad-42e1-90a2-17a069bf7479 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: 53b4fbba-ff8d-4b05-96d5-171cc6bd9f41] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:30:00.650062 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-62ff7568-30ad-42e1-90a2-17a069bf7479 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:30:00.650906 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-62ff7568-30ad-42e1-90a2-17a069bf7479 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:30:00.651465 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-62ff7568-30ad-42e1-90a2-17a069bf7479 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:30:00.652279 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-62ff7568-30ad-42e1-90a2-17a069bf7479 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:30:00.653076 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-62ff7568-30ad-42e1-90a2-17a069bf7479 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:30:00.653827 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-62ff7568-30ad-42e1-90a2-17a069bf7479 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:30:00.721022 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-62ff7568-30ad-42e1-90a2-17a069bf7479 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:30:00.729629 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-62ff7568-30ad-42e1-90a2-17a069bf7479 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/53b4fbba-ff8d-4b05-96d5-171cc6bd9f41" status: 200 len: 1225 microversion: 2.1 time: 0.097793 Oct 04 19:30:00.730218 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3631/6892] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:30:00 2022] GET /compute/v2.1/servers/53b4fbba-ff8d-4b05-96d5-171cc6bd9f41 => generated 1225 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:30:01.753515 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-b08fc9f4-1b49-4bc8-b4eb-365f0ba55915 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:30:01.754318 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-b08fc9f4-1b49-4bc8-b4eb-365f0ba55915 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: 53b4fbba-ff8d-4b05-96d5-171cc6bd9f41] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:30:01.761759 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b08fc9f4-1b49-4bc8-b4eb-365f0ba55915 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:30:01.762255 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b08fc9f4-1b49-4bc8-b4eb-365f0ba55915 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:30:01.762700 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b08fc9f4-1b49-4bc8-b4eb-365f0ba55915 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:30:01.763422 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b08fc9f4-1b49-4bc8-b4eb-365f0ba55915 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:30:01.763885 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b08fc9f4-1b49-4bc8-b4eb-365f0ba55915 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:30:01.764319 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b08fc9f4-1b49-4bc8-b4eb-365f0ba55915 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:30:01.832322 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-b08fc9f4-1b49-4bc8-b4eb-365f0ba55915 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:30:01.841213 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-b08fc9f4-1b49-4bc8-b4eb-365f0ba55915 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/53b4fbba-ff8d-4b05-96d5-171cc6bd9f41" status: 200 len: 1225 microversion: 2.1 time: 0.091900 Oct 04 19:30:01.842056 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3262/6893] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:30:01 2022] GET /compute/v2.1/servers/53b4fbba-ff8d-4b05-96d5-171cc6bd9f41 => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:30:02.866055 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-48bc5330-a231-40ee-99c4-a2cf0b4c73a0 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:30:02.866809 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-48bc5330-a231-40ee-99c4-a2cf0b4c73a0 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: 53b4fbba-ff8d-4b05-96d5-171cc6bd9f41] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:30:02.873808 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-48bc5330-a231-40ee-99c4-a2cf0b4c73a0 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:30:02.874314 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-48bc5330-a231-40ee-99c4-a2cf0b4c73a0 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:30:02.874816 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-48bc5330-a231-40ee-99c4-a2cf0b4c73a0 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:30:02.875529 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-48bc5330-a231-40ee-99c4-a2cf0b4c73a0 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:30:02.876226 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-48bc5330-a231-40ee-99c4-a2cf0b4c73a0 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:30:02.876474 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-48bc5330-a231-40ee-99c4-a2cf0b4c73a0 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:30:02.942457 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-48bc5330-a231-40ee-99c4-a2cf0b4c73a0 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:30:02.950479 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-48bc5330-a231-40ee-99c4-a2cf0b4c73a0 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/53b4fbba-ff8d-4b05-96d5-171cc6bd9f41" status: 200 len: 1225 microversion: 2.1 time: 0.088679 Oct 04 19:30:02.951141 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3632/6894] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:30:02 2022] GET /compute/v2.1/servers/53b4fbba-ff8d-4b05-96d5-171cc6bd9f41 => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:30:03.973726 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-7ad95660-1fd1-4108-a7f8-f33d8c7c94ea tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:30:03.974351 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-7ad95660-1fd1-4108-a7f8-f33d8c7c94ea tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: 53b4fbba-ff8d-4b05-96d5-171cc6bd9f41] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:30:03.981675 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7ad95660-1fd1-4108-a7f8-f33d8c7c94ea tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:30:03.982171 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7ad95660-1fd1-4108-a7f8-f33d8c7c94ea tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:30:03.982618 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7ad95660-1fd1-4108-a7f8-f33d8c7c94ea tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:30:03.983862 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7ad95660-1fd1-4108-a7f8-f33d8c7c94ea tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:30:03.984323 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7ad95660-1fd1-4108-a7f8-f33d8c7c94ea tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:30:03.984761 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7ad95660-1fd1-4108-a7f8-f33d8c7c94ea tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:30:04.048555 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-7ad95660-1fd1-4108-a7f8-f33d8c7c94ea tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43efdccf8e2f4934ae5cfe3da828511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd28590bda749c5aa109ae292cb32e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:30:04.056909 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-7ad95660-1fd1-4108-a7f8-f33d8c7c94ea tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/53b4fbba-ff8d-4b05-96d5-171cc6bd9f41" status: 200 len: 1225 microversion: 2.1 time: 0.086989 Oct 04 19:30:04.069130 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3263/6895] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:30:03 2022] GET /compute/v2.1/servers/53b4fbba-ff8d-4b05-96d5-171cc6bd9f41 => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:30:05.081344 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-161c619f-d1f6-490e-ba04-7c18dfd1ac73 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:30:05.081979 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-161c619f-d1f6-490e-ba04-7c18dfd1ac73 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: 53b4fbba-ff8d-4b05-96d5-171cc6bd9f41] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:30:05.088945 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-161c619f-d1f6-490e-ba04-7c18dfd1ac73 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:30:05.089483 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-161c619f-d1f6-490e-ba04-7c18dfd1ac73 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:30:05.089936 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-161c619f-d1f6-490e-ba04-7c18dfd1ac73 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:30:05.090639 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-161c619f-d1f6-490e-ba04-7c18dfd1ac73 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:30:05.091107 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-161c619f-d1f6-490e-ba04-7c18dfd1ac73 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:30:05.091548 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-161c619f-d1f6-490e-ba04-7c18dfd1ac73 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:30:05.105137 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-161c619f-d1f6-490e-ba04-7c18dfd1ac73 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] HTTP exception thrown: Instance 53b4fbba-ff8d-4b05-96d5-171cc6bd9f41 could not be found. Oct 04 19:30:05.106784 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-161c619f-d1f6-490e-ba04-7c18dfd1ac73 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Request method failure captured: Oct 04 19:30:05.106784 n-d-851028-13 devstack@n-api.service[123596]: request: GET /compute/v2.1/servers/53b4fbba-ff8d-4b05-96d5-171cc6bd9f41 HTTP/1.1 Oct 04 19:30:05.106784 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 19:30:05.106784 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 19:30:05.106784 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 19:30:05.106784 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 19:30:05.106784 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 19:30:05.106784 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 19:30:05.106784 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 19:30:05.106784 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 19:30:05.106784 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPIdD9eu-sNppZso9GBgF0qiQcNSNfbptUObqTJdNMmQeJtmiNalN1HCCgoRlIsnKAnm3yDfemx5F9JCBtqQ5VFIZ41axYIUJNVoTUZoGs-EEXp4RLTVvMn1M_mAUAx-w46wS7k3RPeCrtItzG8FEbUjMK8RLhn-Xr_i-jB7aqW9aWok Oct 04 19:30:05.106784 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 19:30:05.106784 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 19:30:05.106784 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 19:30:05.106784 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 19:30:05.106784 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 19:30:05.106784 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 19:30:05.106784 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: 9cd28590bda749c5aa109ae292cb32e6 Oct 04 19:30:05.106784 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-TestVolumeBootPattern-410499789 Oct 04 19:30:05.106784 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 19:30:05.106784 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 19:30:05.106784 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/9cd28590bda749c5aa109ae292cb32e6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_9cd28590bda749c5aa109ae292cb32e6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/9cd28590bda749c5aa109ae292cb32e6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/9cd28590bda749c5aa109ae292cb32e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 19:30:05.106784 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-TestVolumeBootPattern-410499789 Oct 04 19:30:05.106784 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: 9cd28590bda749c5aa109ae292cb32e6 Oct 04 19:30:05.106784 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-TestVolumeBootPattern-410499789 Oct 04 19:30:05.106784 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-TestVolumeBootPattern-410499789-project Oct 04 19:30:05.106784 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 19:30:05.106784 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 19:30:05.106784 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 43efdccf8e2f4934ae5cfe3da828511e Oct 04 19:30:05.106784 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-TestVolumeBootPattern-410499789-project Oct 04 19:30:05.106784 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 19:30:05.106784 n-d-851028-13 devstack@n-api.service[123596]: exception: Instance 53b4fbba-ff8d-4b05-96d5-171cc6bd9f41 could not be found. Oct 04 19:30:05.106784 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': '53b4fbba-ff8d-4b05-96d5-171cc6bd9f41'} Oct 04 19:30:05.106784 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:30:05.106784 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:30:05.106784 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:30:05.106784 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:30:05.106784 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:30:05.106784 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:30:05.106784 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:30:05.106784 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:30:05.106784 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:30:05.106784 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:30:05.106784 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53b4fbba-ff8d-4b05-96d5-171cc6bd9f41 could not be found. Oct 04 19:30:05.106784 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:30:05.106784 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:30:05.106784 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:30:05.106784 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:30:05.106784 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:30:05.106784 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:30:05.106784 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:30:05.106784 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:30:05.106784 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:30:05.106784 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:30:05.106784 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:30:05.106784 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:30:05.106784 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:30:05.106784 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:30:05.106784 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:30:05.106784 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:30:05.106784 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53b4fbba-ff8d-4b05-96d5-171cc6bd9f41 could not be found. Oct 04 19:30:05.106784 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:30:05.106784 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:30:05.106784 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:30:05.110769 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:30:05.110769 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:30:05.110769 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:30:05.110769 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:30:05.110769 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:30:05.110769 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53b4fbba-ff8d-4b05-96d5-171cc6bd9f41 could not be found. Oct 04 19:30:05.110769 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:30:05.110769 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-161c619f-d1f6-490e-ba04-7c18dfd1ac73 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Returning 404 to user: Instance 53b4fbba-ff8d-4b05-96d5-171cc6bd9f41 could not be found. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:30:05.110769 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-161c619f-d1f6-490e-ba04-7c18dfd1ac73 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/53b4fbba-ff8d-4b05-96d5-171cc6bd9f41" status: 404 len: 111 microversion: 2.1 time: 0.031395 Oct 04 19:30:05.110769 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3633/6896] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:30:05 2022] GET /compute/v2.1/servers/53b4fbba-ff8d-4b05-96d5-171cc6bd9f41 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:30:05.560204 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-c166fab9-e10c-42ae-86de-06cca8df6d96 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:30:05.560690 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-c166fab9-e10c-42ae-86de-06cca8df6d96 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: 3ee9d2bd-d2f8-4660-9134-fdb8c9c153b4] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:30:05.568372 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c166fab9-e10c-42ae-86de-06cca8df6d96 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:30:05.568868 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c166fab9-e10c-42ae-86de-06cca8df6d96 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:30:05.569374 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c166fab9-e10c-42ae-86de-06cca8df6d96 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:30:05.570132 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c166fab9-e10c-42ae-86de-06cca8df6d96 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:30:05.570619 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c166fab9-e10c-42ae-86de-06cca8df6d96 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:30:05.571120 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c166fab9-e10c-42ae-86de-06cca8df6d96 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:30:05.587337 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-c166fab9-e10c-42ae-86de-06cca8df6d96 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] HTTP exception thrown: Instance 3ee9d2bd-d2f8-4660-9134-fdb8c9c153b4 could not be found. Oct 04 19:30:05.590574 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-c166fab9-e10c-42ae-86de-06cca8df6d96 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Request method failure captured: Oct 04 19:30:05.590574 n-d-851028-13 devstack@n-api.service[123595]: request: DELETE /compute/v2.1/servers/3ee9d2bd-d2f8-4660-9134-fdb8c9c153b4 HTTP/1.1 Oct 04 19:30:05.590574 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 19:30:05.590574 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 19:30:05.590574 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 19:30:05.590574 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 0 Oct 04 19:30:05.590574 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 19:30:05.590574 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 19:30:05.590574 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 19:30:05.590574 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 19:30:05.590574 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPIdD9eu-sNppZso9GBgF0qiQcNSNfbptUObqTJdNMmQeJtmiNalN1HCCgoRlIsnKAnm3yDfemx5F9JCBtqQ5VFIZ41axYIUJNVoTUZoGs-EEXp4RLTVvMn1M_mAUAx-w46wS7k3RPeCrtItzG8FEbUjMK8RLhn-Xr_i-jB7aqW9aWok Oct 04 19:30:05.590574 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 19:30:05.590574 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 19:30:05.590574 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 19:30:05.590574 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 19:30:05.590574 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 19:30:05.590574 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 19:30:05.590574 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: 9cd28590bda749c5aa109ae292cb32e6 Oct 04 19:30:05.590574 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-TestVolumeBootPattern-410499789 Oct 04 19:30:05.590574 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 19:30:05.590574 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 19:30:05.590574 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/9cd28590bda749c5aa109ae292cb32e6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_9cd28590bda749c5aa109ae292cb32e6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/9cd28590bda749c5aa109ae292cb32e6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/9cd28590bda749c5aa109ae292cb32e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 19:30:05.590574 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-TestVolumeBootPattern-410499789 Oct 04 19:30:05.590574 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: 9cd28590bda749c5aa109ae292cb32e6 Oct 04 19:30:05.590574 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-TestVolumeBootPattern-410499789 Oct 04 19:30:05.590574 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-TestVolumeBootPattern-410499789-project Oct 04 19:30:05.590574 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 19:30:05.590574 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 19:30:05.590574 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: 43efdccf8e2f4934ae5cfe3da828511e Oct 04 19:30:05.590574 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-TestVolumeBootPattern-410499789-project Oct 04 19:30:05.590574 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 19:30:05.590574 n-d-851028-13 devstack@n-api.service[123595]: exception: Instance 3ee9d2bd-d2f8-4660-9134-fdb8c9c153b4 could not be found. Oct 04 19:30:05.590574 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': '3ee9d2bd-d2f8-4660-9134-fdb8c9c153b4'} Oct 04 19:30:05.590574 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:30:05.590574 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:30:05.590574 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:30:05.590574 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:30:05.590574 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:30:05.590574 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:30:05.590574 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:30:05.590574 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:30:05.590574 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:30:05.590574 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:30:05.590574 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ee9d2bd-d2f8-4660-9134-fdb8c9c153b4 could not be found. Oct 04 19:30:05.590574 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:30:05.590574 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:30:05.590574 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:30:05.590574 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:30:05.590574 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:30:05.590574 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:30:05.590574 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:30:05.590574 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:30:05.590574 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:30:05.590574 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:30:05.590574 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 19:30:05.590574 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 19:30:05.590574 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 19:30:05.590574 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 19:30:05.590574 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:30:05.590574 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:30:05.590574 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:30:05.590574 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:30:05.594836 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ee9d2bd-d2f8-4660-9134-fdb8c9c153b4 could not be found. Oct 04 19:30:05.594836 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:30:05.594836 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:30:05.594836 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:30:05.594836 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:30:05.594836 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:30:05.594836 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:30:05.594836 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:30:05.594836 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:30:05.594836 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ee9d2bd-d2f8-4660-9134-fdb8c9c153b4 could not be found. Oct 04 19:30:05.594836 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:30:05.594836 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-c166fab9-e10c-42ae-86de-06cca8df6d96 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Returning 404 to user: Instance 3ee9d2bd-d2f8-4660-9134-fdb8c9c153b4 could not be found. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:30:05.594836 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-c166fab9-e10c-42ae-86de-06cca8df6d96 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "DELETE /compute/v2.1/servers/3ee9d2bd-d2f8-4660-9134-fdb8c9c153b4" status: 404 len: 111 microversion: 2.1 time: 0.036659 Oct 04 19:30:05.594836 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3264/6897] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 19:30:05 2022] DELETE /compute/v2.1/servers/3ee9d2bd-d2f8-4660-9134-fdb8c9c153b4 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:30:05.605086 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-9a42f5ef-e562-462c-9b4c-3c8a428d4104 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:30:05.605757 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-9a42f5ef-e562-462c-9b4c-3c8a428d4104 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] [instance: 3ee9d2bd-d2f8-4660-9134-fdb8c9c153b4] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:30:05.612572 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9a42f5ef-e562-462c-9b4c-3c8a428d4104 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:30:05.613076 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9a42f5ef-e562-462c-9b4c-3c8a428d4104 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:30:05.613620 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9a42f5ef-e562-462c-9b4c-3c8a428d4104 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:30:05.614339 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9a42f5ef-e562-462c-9b4c-3c8a428d4104 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:30:05.614812 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9a42f5ef-e562-462c-9b4c-3c8a428d4104 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:30:05.615259 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9a42f5ef-e562-462c-9b4c-3c8a428d4104 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:30:05.629188 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-9a42f5ef-e562-462c-9b4c-3c8a428d4104 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] HTTP exception thrown: Instance 3ee9d2bd-d2f8-4660-9134-fdb8c9c153b4 could not be found. Oct 04 19:30:05.630750 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-9a42f5ef-e562-462c-9b4c-3c8a428d4104 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Request method failure captured: Oct 04 19:30:05.630750 n-d-851028-13 devstack@n-api.service[123596]: request: GET /compute/v2.1/servers/3ee9d2bd-d2f8-4660-9134-fdb8c9c153b4 HTTP/1.1 Oct 04 19:30:05.630750 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 19:30:05.630750 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 19:30:05.630750 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 19:30:05.630750 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 19:30:05.630750 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 19:30:05.630750 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 19:30:05.630750 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 19:30:05.630750 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 19:30:05.630750 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPIdD9eu-sNppZso9GBgF0qiQcNSNfbptUObqTJdNMmQeJtmiNalN1HCCgoRlIsnKAnm3yDfemx5F9JCBtqQ5VFIZ41axYIUJNVoTUZoGs-EEXp4RLTVvMn1M_mAUAx-w46wS7k3RPeCrtItzG8FEbUjMK8RLhn-Xr_i-jB7aqW9aWok Oct 04 19:30:05.630750 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 19:30:05.630750 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 19:30:05.630750 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 19:30:05.630750 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 19:30:05.630750 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 19:30:05.630750 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 19:30:05.630750 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: 9cd28590bda749c5aa109ae292cb32e6 Oct 04 19:30:05.630750 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-TestVolumeBootPattern-410499789 Oct 04 19:30:05.630750 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 19:30:05.630750 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 19:30:05.630750 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/9cd28590bda749c5aa109ae292cb32e6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_9cd28590bda749c5aa109ae292cb32e6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/9cd28590bda749c5aa109ae292cb32e6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/9cd28590bda749c5aa109ae292cb32e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 19:30:05.630750 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-TestVolumeBootPattern-410499789 Oct 04 19:30:05.630750 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: 9cd28590bda749c5aa109ae292cb32e6 Oct 04 19:30:05.630750 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-TestVolumeBootPattern-410499789 Oct 04 19:30:05.630750 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-TestVolumeBootPattern-410499789-project Oct 04 19:30:05.630750 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 19:30:05.630750 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 19:30:05.630750 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 43efdccf8e2f4934ae5cfe3da828511e Oct 04 19:30:05.630750 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-TestVolumeBootPattern-410499789-project Oct 04 19:30:05.630750 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 19:30:05.630750 n-d-851028-13 devstack@n-api.service[123596]: exception: Instance 3ee9d2bd-d2f8-4660-9134-fdb8c9c153b4 could not be found. Oct 04 19:30:05.630750 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': '3ee9d2bd-d2f8-4660-9134-fdb8c9c153b4'} Oct 04 19:30:05.630750 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:30:05.630750 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:30:05.630750 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:30:05.630750 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:30:05.630750 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:30:05.630750 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:30:05.630750 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:30:05.630750 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:30:05.630750 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:30:05.630750 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:30:05.630750 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ee9d2bd-d2f8-4660-9134-fdb8c9c153b4 could not be found. Oct 04 19:30:05.630750 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:30:05.630750 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:30:05.630750 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:30:05.630750 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:30:05.630750 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:30:05.630750 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:30:05.630750 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:30:05.630750 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:30:05.630750 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:30:05.630750 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:30:05.630750 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:30:05.630750 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:30:05.630750 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:30:05.630750 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:30:05.630750 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:30:05.630750 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:30:05.630750 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ee9d2bd-d2f8-4660-9134-fdb8c9c153b4 could not be found. Oct 04 19:30:05.630750 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:30:05.630750 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:30:05.630750 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:30:05.635793 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:30:05.635793 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:30:05.635793 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:30:05.635793 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:30:05.635793 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:30:05.635793 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ee9d2bd-d2f8-4660-9134-fdb8c9c153b4 could not be found. Oct 04 19:30:05.635793 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:30:05.635793 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-9a42f5ef-e562-462c-9b4c-3c8a428d4104 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Returning 404 to user: Instance 3ee9d2bd-d2f8-4660-9134-fdb8c9c153b4 could not be found. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:30:05.635793 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-9a42f5ef-e562-462c-9b4c-3c8a428d4104 tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "GET /compute/v2.1/servers/3ee9d2bd-d2f8-4660-9134-fdb8c9c153b4" status: 404 len: 111 microversion: 2.1 time: 0.031029 Oct 04 19:30:05.635793 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3634/6898] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:30:05 2022] GET /compute/v2.1/servers/3ee9d2bd-d2f8-4660-9134-fdb8c9c153b4 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:30:09.060042 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-fa649be1-57fc-407c-8170-eb42323d848b tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] Calling method '.version_select at 0x7fb21ec61310>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:30:09.096995 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-fa649be1-57fc-407c-8170-eb42323d848b tempest-TestVolumeBootPattern-410499789 tempest-TestVolumeBootPattern-410499789-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1548771095" status: 202 len: 0 microversion: 2.1 time: 0.049597 Oct 04 19:30:09.097721 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3265/6899] 10.222.0.43 () {58 vars in 1263 bytes} [Tue Oct 4 19:30:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1548771095 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:30:27.649889 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_api:SELECT=25,nova_api:UPDATE=1 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:30:27.650719 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:30:27.763753 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-653525c3-9b40-4fbc-b272-aa7b90cd4c51 tempest-ServersAdminNegativeTestJSON-1308021455 tempest-ServersAdminNegativeTestJSON-1308021455-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1978219496", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452"}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:30:27.820156 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.network.neutron [None req-653525c3-9b40-4fbc-b272-aa7b90cd4c51 tempest-ServersAdminNegativeTestJSON-1308021455 tempest-ServersAdminNegativeTestJSON-1308021455-project] validate_networks() for None {{(pid=123596) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 19:30:28.015836 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-653525c3-9b40-4fbc-b272-aa7b90cd4c51 tempest-ServersAdminNegativeTestJSON-1308021455 tempest-ServersAdminNegativeTestJSON-1308021455-project] Flavor limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:30:28.016363 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-653525c3-9b40-4fbc-b272-aa7b90cd4c51 tempest-ServersAdminNegativeTestJSON-1308021455 tempest-ServersAdminNegativeTestJSON-1308021455-project] Image limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:30:28.016931 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-653525c3-9b40-4fbc-b272-aa7b90cd4c51 tempest-ServersAdminNegativeTestJSON-1308021455 tempest-ServersAdminNegativeTestJSON-1308021455-project] Flavor pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:30:28.017470 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-653525c3-9b40-4fbc-b272-aa7b90cd4c51 tempest-ServersAdminNegativeTestJSON-1308021455 tempest-ServersAdminNegativeTestJSON-1308021455-project] Image pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:30:28.017980 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-653525c3-9b40-4fbc-b272-aa7b90cd4c51 tempest-ServersAdminNegativeTestJSON-1308021455 tempest-ServersAdminNegativeTestJSON-1308021455-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:30:28.028208 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-653525c3-9b40-4fbc-b272-aa7b90cd4c51 tempest-ServersAdminNegativeTestJSON-1308021455 tempest-ServersAdminNegativeTestJSON-1308021455-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:30:28.028719 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-653525c3-9b40-4fbc-b272-aa7b90cd4c51 tempest-ServersAdminNegativeTestJSON-1308021455 tempest-ServersAdminNegativeTestJSON-1308021455-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:30:28.029883 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-653525c3-9b40-4fbc-b272-aa7b90cd4c51 tempest-ServersAdminNegativeTestJSON-1308021455 tempest-ServersAdminNegativeTestJSON-1308021455-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:30:28.030650 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-653525c3-9b40-4fbc-b272-aa7b90cd4c51 tempest-ServersAdminNegativeTestJSON-1308021455 tempest-ServersAdminNegativeTestJSON-1308021455-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:30:28.031138 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-653525c3-9b40-4fbc-b272-aa7b90cd4c51 tempest-ServersAdminNegativeTestJSON-1308021455 tempest-ServersAdminNegativeTestJSON-1308021455-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:30:28.031594 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-653525c3-9b40-4fbc-b272-aa7b90cd4c51 tempest-ServersAdminNegativeTestJSON-1308021455 tempest-ServersAdminNegativeTestJSON-1308021455-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:30:28.048630 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-653525c3-9b40-4fbc-b272-aa7b90cd4c51 tempest-ServersAdminNegativeTestJSON-1308021455 tempest-ServersAdminNegativeTestJSON-1308021455-project] Getting quotas for project fe4e7bbd838c4a0fbdaf60289c9be6d6. Resources: {'ram', 'cores', 'instances'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:30:28.054421 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-653525c3-9b40-4fbc-b272-aa7b90cd4c51 tempest-ServersAdminNegativeTestJSON-1308021455 tempest-ServersAdminNegativeTestJSON-1308021455-project] Getting quotas for user 4b2308d736ad42959d0316e3cbd7cc34 and project fe4e7bbd838c4a0fbdaf60289c9be6d6. Resources: {'ram', 'cores', 'instances'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:30:28.067576 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-653525c3-9b40-4fbc-b272-aa7b90cd4c51 tempest-ServersAdminNegativeTestJSON-1308021455 tempest-ServersAdminNegativeTestJSON-1308021455-project] Going to run 1 instances... {{(pid=123596) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 19:30:28.070067 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-653525c3-9b40-4fbc-b272-aa7b90cd4c51 tempest-ServersAdminNegativeTestJSON-1308021455 tempest-ServersAdminNegativeTestJSON-1308021455-project] [instance: 7f73f8fe-deca-4154-8fbc-d4fd6a1b158f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e8943ec5-4038-4d4b-b9b9-2415a79f5243',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123596) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 19:30:28.116593 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-653525c3-9b40-4fbc-b272-aa7b90cd4c51 tempest-ServersAdminNegativeTestJSON-1308021455 tempest-ServersAdminNegativeTestJSON-1308021455-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.471876 Oct 04 19:30:28.117293 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3635/6900] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 19:30:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 473 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 19:30:28.128373 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:30:28.129317 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:30:28.133834 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-718e759e-1a2f-47f6-bda9-3fbe007bca8c tempest-ServersAdminNegativeTestJSON-1308021455 tempest-ServersAdminNegativeTestJSON-1308021455-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:30:28.134449 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-718e759e-1a2f-47f6-bda9-3fbe007bca8c tempest-ServersAdminNegativeTestJSON-1308021455 tempest-ServersAdminNegativeTestJSON-1308021455-project] [instance: 7f73f8fe-deca-4154-8fbc-d4fd6a1b158f] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:30:28.192881 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-718e759e-1a2f-47f6-bda9-3fbe007bca8c tempest-ServersAdminNegativeTestJSON-1308021455 tempest-ServersAdminNegativeTestJSON-1308021455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b2308d736ad42959d0316e3cbd7cc34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4e7bbd838c4a0fbdaf60289c9be6d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:30:28.199740 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-718e759e-1a2f-47f6-bda9-3fbe007bca8c tempest-ServersAdminNegativeTestJSON-1308021455 tempest-ServersAdminNegativeTestJSON-1308021455-project] 10.222.0.43 "GET /compute/v2.1/servers/7f73f8fe-deca-4154-8fbc-d4fd6a1b158f" status: 200 len: 1222 microversion: 2.1 time: 0.073112 Oct 04 19:30:28.200305 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3266/6901] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:30:28 2022] GET /compute/v2.1/servers/7f73f8fe-deca-4154-8fbc-d4fd6a1b158f => generated 1222 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:30:29.224266 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-bb9a11c0-05d1-4ec8-b997-dc114e2d3c05 tempest-ServersAdminNegativeTestJSON-1308021455 tempest-ServersAdminNegativeTestJSON-1308021455-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:30:29.225181 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-bb9a11c0-05d1-4ec8-b997-dc114e2d3c05 tempest-ServersAdminNegativeTestJSON-1308021455 tempest-ServersAdminNegativeTestJSON-1308021455-project] [instance: 7f73f8fe-deca-4154-8fbc-d4fd6a1b158f] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:30:29.277885 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-bb9a11c0-05d1-4ec8-b997-dc114e2d3c05 tempest-ServersAdminNegativeTestJSON-1308021455 tempest-ServersAdminNegativeTestJSON-1308021455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b2308d736ad42959d0316e3cbd7cc34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4e7bbd838c4a0fbdaf60289c9be6d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:30:29.288833 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-bb9a11c0-05d1-4ec8-b997-dc114e2d3c05 tempest-ServersAdminNegativeTestJSON-1308021455 tempest-ServersAdminNegativeTestJSON-1308021455-project] 10.222.0.43 "GET /compute/v2.1/servers/7f73f8fe-deca-4154-8fbc-d4fd6a1b158f" status: 200 len: 1222 microversion: 2.1 time: 0.069257 Oct 04 19:30:29.289460 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3636/6902] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:30:29 2022] GET /compute/v2.1/servers/7f73f8fe-deca-4154-8fbc-d4fd6a1b158f => generated 1222 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:30:30.313580 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-bc6f8c1a-5500-4ebd-bbbb-8562116eaea4 tempest-ServersAdminNegativeTestJSON-1308021455 tempest-ServersAdminNegativeTestJSON-1308021455-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:30:30.313580 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-bc6f8c1a-5500-4ebd-bbbb-8562116eaea4 tempest-ServersAdminNegativeTestJSON-1308021455 tempest-ServersAdminNegativeTestJSON-1308021455-project] [instance: 7f73f8fe-deca-4154-8fbc-d4fd6a1b158f] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:30:30.374574 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-bc6f8c1a-5500-4ebd-bbbb-8562116eaea4 tempest-ServersAdminNegativeTestJSON-1308021455 tempest-ServersAdminNegativeTestJSON-1308021455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b2308d736ad42959d0316e3cbd7cc34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4e7bbd838c4a0fbdaf60289c9be6d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:30:30.384207 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-bc6f8c1a-5500-4ebd-bbbb-8562116eaea4 tempest-ServersAdminNegativeTestJSON-1308021455 tempest-ServersAdminNegativeTestJSON-1308021455-project] 10.222.0.43 "GET /compute/v2.1/servers/7f73f8fe-deca-4154-8fbc-d4fd6a1b158f" status: 200 len: 1222 microversion: 2.1 time: 0.076215 Oct 04 19:30:30.384780 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3267/6903] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:30:30 2022] GET /compute/v2.1/servers/7f73f8fe-deca-4154-8fbc-d4fd6a1b158f => generated 1222 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:30:31.409716 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-8ff3f5dd-d0a2-47e1-bfa4-00ea11c37e0b tempest-ServersAdminNegativeTestJSON-1308021455 tempest-ServersAdminNegativeTestJSON-1308021455-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:30:31.410426 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-8ff3f5dd-d0a2-47e1-bfa4-00ea11c37e0b tempest-ServersAdminNegativeTestJSON-1308021455 tempest-ServersAdminNegativeTestJSON-1308021455-project] [instance: 7f73f8fe-deca-4154-8fbc-d4fd6a1b158f] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:30:31.471920 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-8ff3f5dd-d0a2-47e1-bfa4-00ea11c37e0b tempest-ServersAdminNegativeTestJSON-1308021455 tempest-ServersAdminNegativeTestJSON-1308021455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b2308d736ad42959d0316e3cbd7cc34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4e7bbd838c4a0fbdaf60289c9be6d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:30:31.480117 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-8ff3f5dd-d0a2-47e1-bfa4-00ea11c37e0b tempest-ServersAdminNegativeTestJSON-1308021455 tempest-ServersAdminNegativeTestJSON-1308021455-project] 10.222.0.43 "GET /compute/v2.1/servers/7f73f8fe-deca-4154-8fbc-d4fd6a1b158f" status: 200 len: 1222 microversion: 2.1 time: 0.074230 Oct 04 19:30:31.480818 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3637/6904] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:30:31 2022] GET /compute/v2.1/servers/7f73f8fe-deca-4154-8fbc-d4fd6a1b158f => generated 1222 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:30:32.505550 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-fb86ceeb-c4f0-4645-a74e-7415266179c7 tempest-ServersAdminNegativeTestJSON-1308021455 tempest-ServersAdminNegativeTestJSON-1308021455-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:30:32.506384 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-fb86ceeb-c4f0-4645-a74e-7415266179c7 tempest-ServersAdminNegativeTestJSON-1308021455 tempest-ServersAdminNegativeTestJSON-1308021455-project] [instance: 7f73f8fe-deca-4154-8fbc-d4fd6a1b158f] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:30:32.514749 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fb86ceeb-c4f0-4645-a74e-7415266179c7 tempest-ServersAdminNegativeTestJSON-1308021455 tempest-ServersAdminNegativeTestJSON-1308021455-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:30:32.515252 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fb86ceeb-c4f0-4645-a74e-7415266179c7 tempest-ServersAdminNegativeTestJSON-1308021455 tempest-ServersAdminNegativeTestJSON-1308021455-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:30:32.515721 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fb86ceeb-c4f0-4645-a74e-7415266179c7 tempest-ServersAdminNegativeTestJSON-1308021455 tempest-ServersAdminNegativeTestJSON-1308021455-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:30:32.516404 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fb86ceeb-c4f0-4645-a74e-7415266179c7 tempest-ServersAdminNegativeTestJSON-1308021455 tempest-ServersAdminNegativeTestJSON-1308021455-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:30:32.516868 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fb86ceeb-c4f0-4645-a74e-7415266179c7 tempest-ServersAdminNegativeTestJSON-1308021455 tempest-ServersAdminNegativeTestJSON-1308021455-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:30:32.517329 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fb86ceeb-c4f0-4645-a74e-7415266179c7 tempest-ServersAdminNegativeTestJSON-1308021455 tempest-ServersAdminNegativeTestJSON-1308021455-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:30:32.599742 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-fb86ceeb-c4f0-4645-a74e-7415266179c7 tempest-ServersAdminNegativeTestJSON-1308021455 tempest-ServersAdminNegativeTestJSON-1308021455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b2308d736ad42959d0316e3cbd7cc34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4e7bbd838c4a0fbdaf60289c9be6d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:30:32.608687 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-fb86ceeb-c4f0-4645-a74e-7415266179c7 tempest-ServersAdminNegativeTestJSON-1308021455 tempest-ServersAdminNegativeTestJSON-1308021455-project] 10.222.0.43 "GET /compute/v2.1/servers/7f73f8fe-deca-4154-8fbc-d4fd6a1b158f" status: 200 len: 1280 microversion: 2.1 time: 0.107836 Oct 04 19:30:32.609306 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3268/6905] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:30:32 2022] GET /compute/v2.1/servers/7f73f8fe-deca-4154-8fbc-d4fd6a1b158f => generated 1280 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:30:33.631954 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-a426dd70-9e45-429b-a2dd-cc9ba45510a0 tempest-ServersAdminNegativeTestJSON-1308021455 tempest-ServersAdminNegativeTestJSON-1308021455-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:30:33.632726 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-a426dd70-9e45-429b-a2dd-cc9ba45510a0 tempest-ServersAdminNegativeTestJSON-1308021455 tempest-ServersAdminNegativeTestJSON-1308021455-project] [instance: 7f73f8fe-deca-4154-8fbc-d4fd6a1b158f] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:30:33.639755 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a426dd70-9e45-429b-a2dd-cc9ba45510a0 tempest-ServersAdminNegativeTestJSON-1308021455 tempest-ServersAdminNegativeTestJSON-1308021455-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:30:33.640261 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a426dd70-9e45-429b-a2dd-cc9ba45510a0 tempest-ServersAdminNegativeTestJSON-1308021455 tempest-ServersAdminNegativeTestJSON-1308021455-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:30:33.640727 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a426dd70-9e45-429b-a2dd-cc9ba45510a0 tempest-ServersAdminNegativeTestJSON-1308021455 tempest-ServersAdminNegativeTestJSON-1308021455-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:30:33.641475 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a426dd70-9e45-429b-a2dd-cc9ba45510a0 tempest-ServersAdminNegativeTestJSON-1308021455 tempest-ServersAdminNegativeTestJSON-1308021455-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:30:33.641951 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a426dd70-9e45-429b-a2dd-cc9ba45510a0 tempest-ServersAdminNegativeTestJSON-1308021455 tempest-ServersAdminNegativeTestJSON-1308021455-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:30:33.642404 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a426dd70-9e45-429b-a2dd-cc9ba45510a0 tempest-ServersAdminNegativeTestJSON-1308021455 tempest-ServersAdminNegativeTestJSON-1308021455-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:30:33.777852 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-a426dd70-9e45-429b-a2dd-cc9ba45510a0 tempest-ServersAdminNegativeTestJSON-1308021455 tempest-ServersAdminNegativeTestJSON-1308021455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b2308d736ad42959d0316e3cbd7cc34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4e7bbd838c4a0fbdaf60289c9be6d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:30:33.787497 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-a426dd70-9e45-429b-a2dd-cc9ba45510a0 tempest-ServersAdminNegativeTestJSON-1308021455 tempest-ServersAdminNegativeTestJSON-1308021455-project] 10.222.0.43 "GET /compute/v2.1/servers/7f73f8fe-deca-4154-8fbc-d4fd6a1b158f" status: 200 len: 1322 microversion: 2.1 time: 0.159110 Oct 04 19:30:33.787818 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3638/6906] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:30:33 2022] GET /compute/v2.1/servers/7f73f8fe-deca-4154-8fbc-d4fd6a1b158f => generated 1322 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:30:33.802820 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-1efd3e48-43b8-43b6-adb1-48ed7232d0b5 req-846ecedb-ed10-4c85-a71a-dd25e410722b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f73f8fe-deca-4154-8fbc-d4fd6a1b158f", "tag": "24ea7676-5542-4fd0-a12a-b25425f9f402"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:30:33.814203 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-1efd3e48-43b8-43b6-adb1-48ed7232d0b5 req-846ecedb-ed10-4c85-a71a-dd25e410722b service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:30:33.814694 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-1efd3e48-43b8-43b6-adb1-48ed7232d0b5 req-846ecedb-ed10-4c85-a71a-dd25e410722b service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:30:33.815138 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-1efd3e48-43b8-43b6-adb1-48ed7232d0b5 req-846ecedb-ed10-4c85-a71a-dd25e410722b service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:30:33.827216 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-1efd3e48-43b8-43b6-adb1-48ed7232d0b5 req-846ecedb-ed10-4c85-a71a-dd25e410722b service nova] Creating event network-changed:24ea7676-5542-4fd0-a12a-b25425f9f402 for instance 7f73f8fe-deca-4154-8fbc-d4fd6a1b158f on n-h2-851028-13 Oct 04 19:30:33.832126 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-1efd3e48-43b8-43b6-adb1-48ed7232d0b5 req-846ecedb-ed10-4c85-a71a-dd25e410722b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033168 Oct 04 19:30:33.832738 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3269/6907] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:30:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:30:34.811630 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-fda5dbc2-f45c-44ac-9975-5c7286e42847 tempest-ServersAdminNegativeTestJSON-1308021455 tempest-ServersAdminNegativeTestJSON-1308021455-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:30:34.812163 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-fda5dbc2-f45c-44ac-9975-5c7286e42847 tempest-ServersAdminNegativeTestJSON-1308021455 tempest-ServersAdminNegativeTestJSON-1308021455-project] [instance: 7f73f8fe-deca-4154-8fbc-d4fd6a1b158f] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:30:34.819197 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fda5dbc2-f45c-44ac-9975-5c7286e42847 tempest-ServersAdminNegativeTestJSON-1308021455 tempest-ServersAdminNegativeTestJSON-1308021455-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:30:34.819702 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fda5dbc2-f45c-44ac-9975-5c7286e42847 tempest-ServersAdminNegativeTestJSON-1308021455 tempest-ServersAdminNegativeTestJSON-1308021455-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:30:34.820161 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fda5dbc2-f45c-44ac-9975-5c7286e42847 tempest-ServersAdminNegativeTestJSON-1308021455 tempest-ServersAdminNegativeTestJSON-1308021455-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:30:34.820880 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fda5dbc2-f45c-44ac-9975-5c7286e42847 tempest-ServersAdminNegativeTestJSON-1308021455 tempest-ServersAdminNegativeTestJSON-1308021455-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:30:34.821386 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fda5dbc2-f45c-44ac-9975-5c7286e42847 tempest-ServersAdminNegativeTestJSON-1308021455 tempest-ServersAdminNegativeTestJSON-1308021455-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:30:34.821837 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fda5dbc2-f45c-44ac-9975-5c7286e42847 tempest-ServersAdminNegativeTestJSON-1308021455 tempest-ServersAdminNegativeTestJSON-1308021455-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:30:34.953249 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-fda5dbc2-f45c-44ac-9975-5c7286e42847 tempest-ServersAdminNegativeTestJSON-1308021455 tempest-ServersAdminNegativeTestJSON-1308021455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b2308d736ad42959d0316e3cbd7cc34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4e7bbd838c4a0fbdaf60289c9be6d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:30:34.961188 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-fda5dbc2-f45c-44ac-9975-5c7286e42847 tempest-ServersAdminNegativeTestJSON-1308021455 tempest-ServersAdminNegativeTestJSON-1308021455-project] 10.222.0.43 "GET /compute/v2.1/servers/7f73f8fe-deca-4154-8fbc-d4fd6a1b158f" status: 200 len: 1322 microversion: 2.1 time: 0.154147 Oct 04 19:30:34.961768 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3639/6908] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:30:34 2022] GET /compute/v2.1/servers/7f73f8fe-deca-4154-8fbc-d4fd6a1b158f => generated 1322 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:30:35.989096 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-ef107e15-11c4-4948-b755-f63c7936547b tempest-ServersAdminNegativeTestJSON-1308021455 tempest-ServersAdminNegativeTestJSON-1308021455-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:30:35.989833 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-ef107e15-11c4-4948-b755-f63c7936547b tempest-ServersAdminNegativeTestJSON-1308021455 tempest-ServersAdminNegativeTestJSON-1308021455-project] [instance: 7f73f8fe-deca-4154-8fbc-d4fd6a1b158f] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:30:35.996396 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ef107e15-11c4-4948-b755-f63c7936547b tempest-ServersAdminNegativeTestJSON-1308021455 tempest-ServersAdminNegativeTestJSON-1308021455-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:30:35.996887 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ef107e15-11c4-4948-b755-f63c7936547b tempest-ServersAdminNegativeTestJSON-1308021455 tempest-ServersAdminNegativeTestJSON-1308021455-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:30:35.998132 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ef107e15-11c4-4948-b755-f63c7936547b tempest-ServersAdminNegativeTestJSON-1308021455 tempest-ServersAdminNegativeTestJSON-1308021455-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:30:35.998796 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ef107e15-11c4-4948-b755-f63c7936547b tempest-ServersAdminNegativeTestJSON-1308021455 tempest-ServersAdminNegativeTestJSON-1308021455-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:30:35.999257 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ef107e15-11c4-4948-b755-f63c7936547b tempest-ServersAdminNegativeTestJSON-1308021455 tempest-ServersAdminNegativeTestJSON-1308021455-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:30:35.999690 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ef107e15-11c4-4948-b755-f63c7936547b tempest-ServersAdminNegativeTestJSON-1308021455 tempest-ServersAdminNegativeTestJSON-1308021455-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:30:36.131280 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-ef107e15-11c4-4948-b755-f63c7936547b tempest-ServersAdminNegativeTestJSON-1308021455 tempest-ServersAdminNegativeTestJSON-1308021455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b2308d736ad42959d0316e3cbd7cc34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4e7bbd838c4a0fbdaf60289c9be6d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:30:36.138926 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-ef107e15-11c4-4948-b755-f63c7936547b tempest-ServersAdminNegativeTestJSON-1308021455 tempest-ServersAdminNegativeTestJSON-1308021455-project] 10.222.0.43 "GET /compute/v2.1/servers/7f73f8fe-deca-4154-8fbc-d4fd6a1b158f" status: 200 len: 1322 microversion: 2.1 time: 0.157783 Oct 04 19:30:36.139503 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3270/6909] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:30:35 2022] GET /compute/v2.1/servers/7f73f8fe-deca-4154-8fbc-d4fd6a1b158f => generated 1322 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:30:37.161516 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-15a597ae-fdfd-4366-9c7e-7f839ce4fe73 tempest-ServersAdminNegativeTestJSON-1308021455 tempest-ServersAdminNegativeTestJSON-1308021455-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:30:37.162147 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-15a597ae-fdfd-4366-9c7e-7f839ce4fe73 tempest-ServersAdminNegativeTestJSON-1308021455 tempest-ServersAdminNegativeTestJSON-1308021455-project] [instance: 7f73f8fe-deca-4154-8fbc-d4fd6a1b158f] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:30:37.170607 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-15a597ae-fdfd-4366-9c7e-7f839ce4fe73 tempest-ServersAdminNegativeTestJSON-1308021455 tempest-ServersAdminNegativeTestJSON-1308021455-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:30:37.171105 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-15a597ae-fdfd-4366-9c7e-7f839ce4fe73 tempest-ServersAdminNegativeTestJSON-1308021455 tempest-ServersAdminNegativeTestJSON-1308021455-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:30:37.171567 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-15a597ae-fdfd-4366-9c7e-7f839ce4fe73 tempest-ServersAdminNegativeTestJSON-1308021455 tempest-ServersAdminNegativeTestJSON-1308021455-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:30:37.172287 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-15a597ae-fdfd-4366-9c7e-7f839ce4fe73 tempest-ServersAdminNegativeTestJSON-1308021455 tempest-ServersAdminNegativeTestJSON-1308021455-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:30:37.172760 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-15a597ae-fdfd-4366-9c7e-7f839ce4fe73 tempest-ServersAdminNegativeTestJSON-1308021455 tempest-ServersAdminNegativeTestJSON-1308021455-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:30:37.173238 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-15a597ae-fdfd-4366-9c7e-7f839ce4fe73 tempest-ServersAdminNegativeTestJSON-1308021455 tempest-ServersAdminNegativeTestJSON-1308021455-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:30:37.304843 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-15a597ae-fdfd-4366-9c7e-7f839ce4fe73 tempest-ServersAdminNegativeTestJSON-1308021455 tempest-ServersAdminNegativeTestJSON-1308021455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b2308d736ad42959d0316e3cbd7cc34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4e7bbd838c4a0fbdaf60289c9be6d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:30:37.312656 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-15a597ae-fdfd-4366-9c7e-7f839ce4fe73 tempest-ServersAdminNegativeTestJSON-1308021455 tempest-ServersAdminNegativeTestJSON-1308021455-project] 10.222.0.43 "GET /compute/v2.1/servers/7f73f8fe-deca-4154-8fbc-d4fd6a1b158f" status: 200 len: 1322 microversion: 2.1 time: 0.155123 Oct 04 19:30:37.313263 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3640/6910] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:30:37 2022] GET /compute/v2.1/servers/7f73f8fe-deca-4154-8fbc-d4fd6a1b158f => generated 1322 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:30:38.334849 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-1c3773f6-2e85-401d-a67d-82c6730e52fe tempest-ServersAdminNegativeTestJSON-1308021455 tempest-ServersAdminNegativeTestJSON-1308021455-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:30:38.335472 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-1c3773f6-2e85-401d-a67d-82c6730e52fe tempest-ServersAdminNegativeTestJSON-1308021455 tempest-ServersAdminNegativeTestJSON-1308021455-project] [instance: 7f73f8fe-deca-4154-8fbc-d4fd6a1b158f] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:30:38.343640 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1c3773f6-2e85-401d-a67d-82c6730e52fe tempest-ServersAdminNegativeTestJSON-1308021455 tempest-ServersAdminNegativeTestJSON-1308021455-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:30:38.344524 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1c3773f6-2e85-401d-a67d-82c6730e52fe tempest-ServersAdminNegativeTestJSON-1308021455 tempest-ServersAdminNegativeTestJSON-1308021455-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:30:38.345364 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1c3773f6-2e85-401d-a67d-82c6730e52fe tempest-ServersAdminNegativeTestJSON-1308021455 tempest-ServersAdminNegativeTestJSON-1308021455-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:30:38.346631 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1c3773f6-2e85-401d-a67d-82c6730e52fe tempest-ServersAdminNegativeTestJSON-1308021455 tempest-ServersAdminNegativeTestJSON-1308021455-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:30:38.347451 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1c3773f6-2e85-401d-a67d-82c6730e52fe tempest-ServersAdminNegativeTestJSON-1308021455 tempest-ServersAdminNegativeTestJSON-1308021455-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:30:38.348217 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1c3773f6-2e85-401d-a67d-82c6730e52fe tempest-ServersAdminNegativeTestJSON-1308021455 tempest-ServersAdminNegativeTestJSON-1308021455-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:30:38.486503 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-1c3773f6-2e85-401d-a67d-82c6730e52fe tempest-ServersAdminNegativeTestJSON-1308021455 tempest-ServersAdminNegativeTestJSON-1308021455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b2308d736ad42959d0316e3cbd7cc34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4e7bbd838c4a0fbdaf60289c9be6d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:30:38.494347 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-1c3773f6-2e85-401d-a67d-82c6730e52fe tempest-ServersAdminNegativeTestJSON-1308021455 tempest-ServersAdminNegativeTestJSON-1308021455-project] 10.222.0.43 "GET /compute/v2.1/servers/7f73f8fe-deca-4154-8fbc-d4fd6a1b158f" status: 200 len: 1322 microversion: 2.1 time: 0.163887 Oct 04 19:30:38.494920 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3271/6911] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:30:38 2022] GET /compute/v2.1/servers/7f73f8fe-deca-4154-8fbc-d4fd6a1b158f => generated 1322 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:30:38.802158 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=2 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:30:38.854224 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-3b78bb14-5000-4de5-9e63-6d2a555750fb req-9e3697b7-d46c-4fef-889f-e8bf886476b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f73f8fe-deca-4154-8fbc-d4fd6a1b158f", "name": "network-vif-plugged", "status": "completed", "tag": "24ea7676-5542-4fd0-a12a-b25425f9f402"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:30:38.863875 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-3b78bb14-5000-4de5-9e63-6d2a555750fb req-9e3697b7-d46c-4fef-889f-e8bf886476b3 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:30:38.864376 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-3b78bb14-5000-4de5-9e63-6d2a555750fb req-9e3697b7-d46c-4fef-889f-e8bf886476b3 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:30:38.864832 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-3b78bb14-5000-4de5-9e63-6d2a555750fb req-9e3697b7-d46c-4fef-889f-e8bf886476b3 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:30:38.876318 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-3b78bb14-5000-4de5-9e63-6d2a555750fb req-9e3697b7-d46c-4fef-889f-e8bf886476b3 service nova] Creating event network-vif-plugged:24ea7676-5542-4fd0-a12a-b25425f9f402 for instance 7f73f8fe-deca-4154-8fbc-d4fd6a1b158f on n-h2-851028-13 Oct 04 19:30:38.881596 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-3b78bb14-5000-4de5-9e63-6d2a555750fb req-9e3697b7-d46c-4fef-889f-e8bf886476b3 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083778 Oct 04 19:30:38.882201 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3641/6912] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:30:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:30:39.517102 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-f58ff529-3a10-4dd9-a0ab-ef0028f97cde tempest-ServersAdminNegativeTestJSON-1308021455 tempest-ServersAdminNegativeTestJSON-1308021455-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:30:39.517673 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-f58ff529-3a10-4dd9-a0ab-ef0028f97cde tempest-ServersAdminNegativeTestJSON-1308021455 tempest-ServersAdminNegativeTestJSON-1308021455-project] [instance: 7f73f8fe-deca-4154-8fbc-d4fd6a1b158f] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:30:39.524905 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f58ff529-3a10-4dd9-a0ab-ef0028f97cde tempest-ServersAdminNegativeTestJSON-1308021455 tempest-ServersAdminNegativeTestJSON-1308021455-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:30:39.525433 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f58ff529-3a10-4dd9-a0ab-ef0028f97cde tempest-ServersAdminNegativeTestJSON-1308021455 tempest-ServersAdminNegativeTestJSON-1308021455-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:30:39.525877 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f58ff529-3a10-4dd9-a0ab-ef0028f97cde tempest-ServersAdminNegativeTestJSON-1308021455 tempest-ServersAdminNegativeTestJSON-1308021455-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:30:39.526570 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f58ff529-3a10-4dd9-a0ab-ef0028f97cde tempest-ServersAdminNegativeTestJSON-1308021455 tempest-ServersAdminNegativeTestJSON-1308021455-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:30:39.527030 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f58ff529-3a10-4dd9-a0ab-ef0028f97cde tempest-ServersAdminNegativeTestJSON-1308021455 tempest-ServersAdminNegativeTestJSON-1308021455-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:30:39.527461 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f58ff529-3a10-4dd9-a0ab-ef0028f97cde tempest-ServersAdminNegativeTestJSON-1308021455 tempest-ServersAdminNegativeTestJSON-1308021455-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:30:39.658671 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-f58ff529-3a10-4dd9-a0ab-ef0028f97cde tempest-ServersAdminNegativeTestJSON-1308021455 tempest-ServersAdminNegativeTestJSON-1308021455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b2308d736ad42959d0316e3cbd7cc34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4e7bbd838c4a0fbdaf60289c9be6d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:30:39.666840 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-f58ff529-3a10-4dd9-a0ab-ef0028f97cde tempest-ServersAdminNegativeTestJSON-1308021455 tempest-ServersAdminNegativeTestJSON-1308021455-project] 10.222.0.43 "GET /compute/v2.1/servers/7f73f8fe-deca-4154-8fbc-d4fd6a1b158f" status: 200 len: 1322 microversion: 2.1 time: 0.153789 Oct 04 19:30:39.667414 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3272/6913] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:30:39 2022] GET /compute/v2.1/servers/7f73f8fe-deca-4154-8fbc-d4fd6a1b158f => generated 1322 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:30:40.692297 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-ee5c0b57-9072-4931-b77d-bc3f44b3c5a5 tempest-ServersAdminNegativeTestJSON-1308021455 tempest-ServersAdminNegativeTestJSON-1308021455-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:30:40.693016 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-ee5c0b57-9072-4931-b77d-bc3f44b3c5a5 tempest-ServersAdminNegativeTestJSON-1308021455 tempest-ServersAdminNegativeTestJSON-1308021455-project] [instance: 7f73f8fe-deca-4154-8fbc-d4fd6a1b158f] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:30:40.699394 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ee5c0b57-9072-4931-b77d-bc3f44b3c5a5 tempest-ServersAdminNegativeTestJSON-1308021455 tempest-ServersAdminNegativeTestJSON-1308021455-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:30:40.699895 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ee5c0b57-9072-4931-b77d-bc3f44b3c5a5 tempest-ServersAdminNegativeTestJSON-1308021455 tempest-ServersAdminNegativeTestJSON-1308021455-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:30:40.700355 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ee5c0b57-9072-4931-b77d-bc3f44b3c5a5 tempest-ServersAdminNegativeTestJSON-1308021455 tempest-ServersAdminNegativeTestJSON-1308021455-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:30:40.701063 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ee5c0b57-9072-4931-b77d-bc3f44b3c5a5 tempest-ServersAdminNegativeTestJSON-1308021455 tempest-ServersAdminNegativeTestJSON-1308021455-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:30:40.701559 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ee5c0b57-9072-4931-b77d-bc3f44b3c5a5 tempest-ServersAdminNegativeTestJSON-1308021455 tempest-ServersAdminNegativeTestJSON-1308021455-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:30:40.702003 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ee5c0b57-9072-4931-b77d-bc3f44b3c5a5 tempest-ServersAdminNegativeTestJSON-1308021455 tempest-ServersAdminNegativeTestJSON-1308021455-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:30:40.841921 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-ee5c0b57-9072-4931-b77d-bc3f44b3c5a5 tempest-ServersAdminNegativeTestJSON-1308021455 tempest-ServersAdminNegativeTestJSON-1308021455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b2308d736ad42959d0316e3cbd7cc34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4e7bbd838c4a0fbdaf60289c9be6d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:30:40.850125 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-ee5c0b57-9072-4931-b77d-bc3f44b3c5a5 tempest-ServersAdminNegativeTestJSON-1308021455 tempest-ServersAdminNegativeTestJSON-1308021455-project] 10.222.0.43 "GET /compute/v2.1/servers/7f73f8fe-deca-4154-8fbc-d4fd6a1b158f" status: 200 len: 1471 microversion: 2.1 time: 0.162699 Oct 04 19:30:40.850695 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3642/6914] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:30:40 2022] GET /compute/v2.1/servers/7f73f8fe-deca-4154-8fbc-d4fd6a1b158f => generated 1471 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:30:40.875749 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=4 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:30:40.926297 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-2daf068f-d93f-453a-8cd7-5b9ceda1c84c tempest-ServersAdminNegativeTestJSON-349826930 tempest-ServersAdminNegativeTestJSON-349826930-project-admin] Calling method '.version_select at 0x7fb21ea7ef70>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:30:40.990548 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-2daf068f-d93f-453a-8cd7-5b9ceda1c84c tempest-ServersAdminNegativeTestJSON-349826930 tempest-ServersAdminNegativeTestJSON-349826930-project-admin] 10.222.0.43 "GET /compute/v2.1/os-quota-sets/19cb4a5339a14201963c8851f970783a" status: 200 len: 371 microversion: 2.1 time: 0.119330 Oct 04 19:30:40.991110 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3273/6915] 10.222.0.43 () {58 vars in 1242 bytes} [Tue Oct 4 19:30:40 2022] GET /compute/v2.1/os-quota-sets/19cb4a5339a14201963c8851f970783a => generated 371 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:30:41.003079 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-b6f0656e-808b-4a31-88df-8d1f82ec3585 tempest-ServersAdminNegativeTestJSON-349826930 tempest-ServersAdminNegativeTestJSON-349826930-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-563327737", "id": 1147130109, "os-flavor-access:is_public": "True"}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:30:41.021442 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-b6f0656e-808b-4a31-88df-8d1f82ec3585 tempest-ServersAdminNegativeTestJSON-349826930 tempest-ServersAdminNegativeTestJSON-349826930-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 437 microversion: 2.1 time: 0.021985 Oct 04 19:30:41.022050 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3643/6916] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 19:30:40 2022] POST /compute/v2.1/flavors => generated 437 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:30:41.035725 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-81a37df0-e011-4f58-b318-518313afbfd3 tempest-ServersAdminNegativeTestJSON-349826930 tempest-ServersAdminNegativeTestJSON-349826930-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "1147130109"}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:30:41.038465 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-81a37df0-e011-4f58-b318-518313afbfd3 tempest-ServersAdminNegativeTestJSON-349826930 tempest-ServersAdminNegativeTestJSON-349826930-project-admin] [instance: 7f73f8fe-deca-4154-8fbc-d4fd6a1b158f] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:30:41.046124 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-81a37df0-e011-4f58-b318-518313afbfd3 tempest-ServersAdminNegativeTestJSON-349826930 tempest-ServersAdminNegativeTestJSON-349826930-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:30:41.046632 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-81a37df0-e011-4f58-b318-518313afbfd3 tempest-ServersAdminNegativeTestJSON-349826930 tempest-ServersAdminNegativeTestJSON-349826930-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:30:41.047136 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-81a37df0-e011-4f58-b318-518313afbfd3 tempest-ServersAdminNegativeTestJSON-349826930 tempest-ServersAdminNegativeTestJSON-349826930-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:30:41.047869 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-81a37df0-e011-4f58-b318-518313afbfd3 tempest-ServersAdminNegativeTestJSON-349826930 tempest-ServersAdminNegativeTestJSON-349826930-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:30:41.048334 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-81a37df0-e011-4f58-b318-518313afbfd3 tempest-ServersAdminNegativeTestJSON-349826930 tempest-ServersAdminNegativeTestJSON-349826930-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:30:41.048771 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-81a37df0-e011-4f58-b318-518313afbfd3 tempest-ServersAdminNegativeTestJSON-349826930 tempest-ServersAdminNegativeTestJSON-349826930-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:30:41.286089 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-81a37df0-e011-4f58-b318-518313afbfd3 tempest-ServersAdminNegativeTestJSON-349826930 tempest-ServersAdminNegativeTestJSON-349826930-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '58879f0c4b8a4067900736832faaf04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19cb4a5339a14201963c8851f970783a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:30:41.292517 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-81a37df0-e011-4f58-b318-518313afbfd3 tempest-ServersAdminNegativeTestJSON-349826930 tempest-ServersAdminNegativeTestJSON-349826930-project-admin] [instance: 7f73f8fe-deca-4154-8fbc-d4fd6a1b158f] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-563327737 {{(pid=123595) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 04 19:30:41.299951 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-81a37df0-e011-4f58-b318-518313afbfd3 tempest-ServersAdminNegativeTestJSON-349826930 tempest-ServersAdminNegativeTestJSON-349826930-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:30:41.300426 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-81a37df0-e011-4f58-b318-518313afbfd3 tempest-ServersAdminNegativeTestJSON-349826930 tempest-ServersAdminNegativeTestJSON-349826930-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:30:41.300858 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-81a37df0-e011-4f58-b318-518313afbfd3 tempest-ServersAdminNegativeTestJSON-349826930 tempest-ServersAdminNegativeTestJSON-349826930-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:30:41.301622 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-81a37df0-e011-4f58-b318-518313afbfd3 tempest-ServersAdminNegativeTestJSON-349826930 tempest-ServersAdminNegativeTestJSON-349826930-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:30:41.302102 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-81a37df0-e011-4f58-b318-518313afbfd3 tempest-ServersAdminNegativeTestJSON-349826930 tempest-ServersAdminNegativeTestJSON-349826930-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:30:41.302534 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-81a37df0-e011-4f58-b318-518313afbfd3 tempest-ServersAdminNegativeTestJSON-349826930 tempest-ServersAdminNegativeTestJSON-349826930-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:30:41.327245 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-81a37df0-e011-4f58-b318-518313afbfd3 tempest-ServersAdminNegativeTestJSON-349826930 tempest-ServersAdminNegativeTestJSON-349826930-project-admin] Getting quotas for project fe4e7bbd838c4a0fbdaf60289c9be6d6. Resources: {'ram', 'cores'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:30:41.332634 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-81a37df0-e011-4f58-b318-518313afbfd3 tempest-ServersAdminNegativeTestJSON-349826930 tempest-ServersAdminNegativeTestJSON-349826930-project-admin] Getting quotas for user 4b2308d736ad42959d0316e3cbd7cc34 and project fe4e7bbd838c4a0fbdaf60289c9be6d6. Resources: {'ram', 'cores'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:30:41.344498 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.compute.api [None req-81a37df0-e011-4f58-b318-518313afbfd3 tempest-ServersAdminNegativeTestJSON-349826930 tempest-ServersAdminNegativeTestJSON-349826930-project-admin] ram quota exceeded for 19cb4a5339a14201963c8851f970783a, tried to resize instance. Oct 04 19:30:41.345041 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-81a37df0-e011-4f58-b318-518313afbfd3 tempest-ServersAdminNegativeTestJSON-349826930 tempest-ServersAdminNegativeTestJSON-349826930-project-admin] HTTP exception thrown: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 04 19:30:41.347153 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-81a37df0-e011-4f58-b318-518313afbfd3 tempest-ServersAdminNegativeTestJSON-349826930 tempest-ServersAdminNegativeTestJSON-349826930-project-admin] Request method failure captured: Oct 04 19:30:41.347153 n-d-851028-13 devstack@n-api.service[123595]: request: POST /compute/v2.1/servers/7f73f8fe-deca-4154-8fbc-d4fd6a1b158f/action HTTP/1.1 Oct 04 19:30:41.347153 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 19:30:41.347153 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 19:30:41.347153 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 19:30:41.347153 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 39 Oct 04 19:30:41.347153 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 19:30:41.347153 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 19:30:41.347153 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 19:30:41.347153 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 19:30:41.347153 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPInTVPEnD1RXtv4lncV29p8jm1TfJu6FUZ_jtF4iAd13nQ-o5_wNXnW_hk1g7gp2ik6PdEjq8Ur360EgmhPq7cgj7ryDlBueFx8NrtSymGl5RwqntlQnYwRkogu7OxlxLZbrZe_oQqjaDIEXi50ikORcDSR9Yx_SXulSHfjIb3J1lIo Oct 04 19:30:41.347153 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 19:30:41.347153 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 19:30:41.347153 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 19:30:41.347153 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 19:30:41.347153 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 19:30:41.347153 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 19:30:41.347153 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: 19cb4a5339a14201963c8851f970783a Oct 04 19:30:41.347153 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-349826930 Oct 04 19:30:41.347153 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,admin,reader Oct 04 19:30:41.347153 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,admin,reader Oct 04 19:30:41.347153 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/19cb4a5339a14201963c8851f970783a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_19cb4a5339a14201963c8851f970783a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/19cb4a5339a14201963c8851f970783a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/19cb4a5339a14201963c8851f970783a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 19:30:41.347153 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-ServersAdminNegativeTestJSON-349826930 Oct 04 19:30:41.347153 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: 19cb4a5339a14201963c8851f970783a Oct 04 19:30:41.347153 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-349826930 Oct 04 19:30:41.347153 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-ServersAdminNegativeTestJSON-349826930-project-admin Oct 04 19:30:41.347153 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 19:30:41.347153 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 19:30:41.347153 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: 58879f0c4b8a4067900736832faaf04f Oct 04 19:30:41.347153 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-ServersAdminNegativeTestJSON-349826930-project-admin Oct 04 19:30:41.347153 n-d-851028-13 devstack@n-api.service[123595]: Oct 04 19:30:41.347153 n-d-851028-13 devstack@n-api.service[123595]: {"resize": {"flavorRef": "1147130109"}} Oct 04 19:30:41.347153 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 19:30:41.347153 n-d-851028-13 devstack@n-api.service[123595]: exception: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 04 19:30:41.347153 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': '7f73f8fe-deca-4154-8fbc-d4fd6a1b158f', 'body': {'resize': {'flavorRef': '1147130109'}}} Oct 04 19:30:41.347153 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:30:41.347153 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:30:41.347153 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3878, in _check_quota_for_upsize Oct 04 19:30:41.347153 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Oct 04 19:30:41.347153 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 19:30:41.347153 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 19:30:41.347153 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 04 19:30:41.347153 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc Oct 04 19:30:41.347153 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 04 19:30:41.347153 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 04 19:30:41.347153 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 19:30:41.347153 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 19:30:41.347153 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 04 19:30:41.347153 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 04 19:30:41.347153 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 04 19:30:41.347153 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 04 19:30:41.347153 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Oct 04 19:30:41.347153 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 04 19:30:41.347153 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Oct 04 19:30:41.347153 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:30:41.347153 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:30:41.347153 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:30:41.347153 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:30:41.347153 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 04 19:30:41.347153 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 04 19:30:41.347153 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 04 19:30:41.347153 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 19:30:41.347153 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 04 19:30:41.351654 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 04 19:30:41.351654 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 04 19:30:41.351654 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 04 19:30:41.351654 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 19:30:41.351654 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 19:30:41.351654 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 04 19:30:41.351654 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 19:30:41.351654 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 04 19:30:41.351654 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 19:30:41.351654 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4244, in resize Oct 04 19:30:41.351654 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Oct 04 19:30:41.351654 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3896, in _check_quota_for_upsize Oct 04 19:30:41.351654 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 04 19:30:41.351654 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 04 19:30:41.351654 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:30:41.351654 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:30:41.351654 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:30:41.351654 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:30:41.351654 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:30:41.351654 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:30:41.351654 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:30:41.351654 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:30:41.351654 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:30:41.351654 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:30:41.351654 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 19:30:41.351654 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 19:30:41.351654 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 04 19:30:41.351654 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 04 19:30:41.351654 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Oct 04 19:30:41.351654 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 04 19:30:41.351654 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 04 19:30:41.351654 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:30:41.351654 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:30:41.351654 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:30:41.351654 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:30:41.351654 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:30:41.351654 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:30:41.351654 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:30:41.351654 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:30:41.351654 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 04 19:30:41.351654 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:30:41.351654 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-81a37df0-e011-4f58-b318-518313afbfd3 tempest-ServersAdminNegativeTestJSON-349826930 tempest-ServersAdminNegativeTestJSON-349826930-project-admin] Returning 403 to user: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:30:41.351654 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-81a37df0-e011-4f58-b318-518313afbfd3 tempest-ServersAdminNegativeTestJSON-349826930 tempest-ServersAdminNegativeTestJSON-349826930-project-admin] 10.222.0.43 "POST /compute/v2.1/servers/7f73f8fe-deca-4154-8fbc-d4fd6a1b158f/action" status: 403 len: 118 microversion: 2.1 time: 0.317482 Oct 04 19:30:41.351654 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3274/6917] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 19:30:41 2022] POST /compute/v2.1/servers/7f73f8fe-deca-4154-8fbc-d4fd6a1b158f/action => generated 118 bytes in 319 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:30:41.358429 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-b6b84415-ce24-4e06-874c-5490cd194fb1 tempest-ServersAdminNegativeTestJSON-349826930 tempest-ServersAdminNegativeTestJSON-349826930-project-admin] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:30:41.376316 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-b6b84415-ce24-4e06-874c-5490cd194fb1 tempest-ServersAdminNegativeTestJSON-349826930 tempest-ServersAdminNegativeTestJSON-349826930-project-admin] 10.222.0.43 "DELETE /compute/v2.1/flavors/1147130109" status: 202 len: 0 microversion: 2.1 time: 0.022165 Oct 04 19:30:41.376876 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3644/6918] 10.222.0.43 () {58 vars in 1161 bytes} [Tue Oct 4 19:30:41 2022] DELETE /compute/v2.1/flavors/1147130109 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 19:30:41.384631 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-f2beb5eb-0493-4e32-bcb9-7f9f8720d435 tempest-ServersAdminNegativeTestJSON-349826930 tempest-ServersAdminNegativeTestJSON-349826930-project-admin] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:30:41.404951 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-f2beb5eb-0493-4e32-bcb9-7f9f8720d435 tempest-ServersAdminNegativeTestJSON-349826930 tempest-ServersAdminNegativeTestJSON-349826930-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.023899 Oct 04 19:30:41.405529 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3275/6919] 10.222.0.43 () {58 vars in 1146 bytes} [Tue Oct 4 19:30:41 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:30:41.426093 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-bf107626-f27c-4b4e-a5fa-a868af78e4fd tempest-ServersAdminNegativeTestJSON-349826930 tempest-ServersAdminNegativeTestJSON-349826930-project-admin] Calling method '.version_select at 0x7fb21ea60550>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:30:41.476692 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=10 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:30:41.496537 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-bf107626-f27c-4b4e-a5fa-a868af78e4fd tempest-ServersAdminNegativeTestJSON-349826930 tempest-ServersAdminNegativeTestJSON-349826930-project-admin] 10.222.0.43 "GET /compute/v2.1/os-quota-sets/19cb4a5339a14201963c8851f970783a" status: 200 len: 371 microversion: 2.1 time: 0.074138 Oct 04 19:30:41.497731 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3645/6920] 10.222.0.43 () {58 vars in 1242 bytes} [Tue Oct 4 19:30:41 2022] GET /compute/v2.1/os-quota-sets/19cb4a5339a14201963c8851f970783a => generated 371 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:30:41.509647 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-d9730248-f6ac-452e-b040-b5f83e2657f3 tempest-ServersAdminNegativeTestJSON-349826930 tempest-ServersAdminNegativeTestJSON-349826930-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-2135980396", "id": 922868607, "os-flavor-access:is_public": "True"}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:30:41.527351 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-d9730248-f6ac-452e-b040-b5f83e2657f3 tempest-ServersAdminNegativeTestJSON-349826930 tempest-ServersAdminNegativeTestJSON-349826930-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 434 microversion: 2.1 time: 0.021551 Oct 04 19:30:41.527920 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3276/6921] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 19:30:41 2022] POST /compute/v2.1/flavors => generated 434 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:30:41.540997 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-5a0504b8-0291-4dc8-8c17-095a0608573f tempest-ServersAdminNegativeTestJSON-349826930 tempest-ServersAdminNegativeTestJSON-349826930-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "922868607"}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:30:41.543390 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-5a0504b8-0291-4dc8-8c17-095a0608573f tempest-ServersAdminNegativeTestJSON-349826930 tempest-ServersAdminNegativeTestJSON-349826930-project-admin] [instance: 7f73f8fe-deca-4154-8fbc-d4fd6a1b158f] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:30:41.550262 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5a0504b8-0291-4dc8-8c17-095a0608573f tempest-ServersAdminNegativeTestJSON-349826930 tempest-ServersAdminNegativeTestJSON-349826930-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:30:41.550767 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5a0504b8-0291-4dc8-8c17-095a0608573f tempest-ServersAdminNegativeTestJSON-349826930 tempest-ServersAdminNegativeTestJSON-349826930-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:30:41.551235 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5a0504b8-0291-4dc8-8c17-095a0608573f tempest-ServersAdminNegativeTestJSON-349826930 tempest-ServersAdminNegativeTestJSON-349826930-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:30:41.551959 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5a0504b8-0291-4dc8-8c17-095a0608573f tempest-ServersAdminNegativeTestJSON-349826930 tempest-ServersAdminNegativeTestJSON-349826930-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:30:41.552437 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5a0504b8-0291-4dc8-8c17-095a0608573f tempest-ServersAdminNegativeTestJSON-349826930 tempest-ServersAdminNegativeTestJSON-349826930-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:30:41.552885 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5a0504b8-0291-4dc8-8c17-095a0608573f tempest-ServersAdminNegativeTestJSON-349826930 tempest-ServersAdminNegativeTestJSON-349826930-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:30:41.720317 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-5a0504b8-0291-4dc8-8c17-095a0608573f tempest-ServersAdminNegativeTestJSON-349826930 tempest-ServersAdminNegativeTestJSON-349826930-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '58879f0c4b8a4067900736832faaf04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19cb4a5339a14201963c8851f970783a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:30:41.726878 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-5a0504b8-0291-4dc8-8c17-095a0608573f tempest-ServersAdminNegativeTestJSON-349826930 tempest-ServersAdminNegativeTestJSON-349826930-project-admin] [instance: 7f73f8fe-deca-4154-8fbc-d4fd6a1b158f] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-2135980396 {{(pid=123596) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 04 19:30:41.734238 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5a0504b8-0291-4dc8-8c17-095a0608573f tempest-ServersAdminNegativeTestJSON-349826930 tempest-ServersAdminNegativeTestJSON-349826930-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:30:41.734670 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5a0504b8-0291-4dc8-8c17-095a0608573f tempest-ServersAdminNegativeTestJSON-349826930 tempest-ServersAdminNegativeTestJSON-349826930-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:30:41.735125 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5a0504b8-0291-4dc8-8c17-095a0608573f tempest-ServersAdminNegativeTestJSON-349826930 tempest-ServersAdminNegativeTestJSON-349826930-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:30:41.735865 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5a0504b8-0291-4dc8-8c17-095a0608573f tempest-ServersAdminNegativeTestJSON-349826930 tempest-ServersAdminNegativeTestJSON-349826930-project-admin] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:30:41.736332 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5a0504b8-0291-4dc8-8c17-095a0608573f tempest-ServersAdminNegativeTestJSON-349826930 tempest-ServersAdminNegativeTestJSON-349826930-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:30:41.736771 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5a0504b8-0291-4dc8-8c17-095a0608573f tempest-ServersAdminNegativeTestJSON-349826930 tempest-ServersAdminNegativeTestJSON-349826930-project-admin] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:30:41.762470 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-5a0504b8-0291-4dc8-8c17-095a0608573f tempest-ServersAdminNegativeTestJSON-349826930 tempest-ServersAdminNegativeTestJSON-349826930-project-admin] Getting quotas for project fe4e7bbd838c4a0fbdaf60289c9be6d6. Resources: {'ram', 'cores'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:30:41.767676 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-5a0504b8-0291-4dc8-8c17-095a0608573f tempest-ServersAdminNegativeTestJSON-349826930 tempest-ServersAdminNegativeTestJSON-349826930-project-admin] Getting quotas for user 4b2308d736ad42959d0316e3cbd7cc34 and project fe4e7bbd838c4a0fbdaf60289c9be6d6. Resources: {'ram', 'cores'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:30:41.781604 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.compute.api [None req-5a0504b8-0291-4dc8-8c17-095a0608573f tempest-ServersAdminNegativeTestJSON-349826930 tempest-ServersAdminNegativeTestJSON-349826930-project-admin] cores quota exceeded for 19cb4a5339a14201963c8851f970783a, tried to resize instance. Oct 04 19:30:41.782160 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-5a0504b8-0291-4dc8-8c17-095a0608573f tempest-ServersAdminNegativeTestJSON-349826930 tempest-ServersAdminNegativeTestJSON-349826930-project-admin] HTTP exception thrown: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 04 19:30:41.784275 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-5a0504b8-0291-4dc8-8c17-095a0608573f tempest-ServersAdminNegativeTestJSON-349826930 tempest-ServersAdminNegativeTestJSON-349826930-project-admin] Request method failure captured: Oct 04 19:30:41.784275 n-d-851028-13 devstack@n-api.service[123596]: request: POST /compute/v2.1/servers/7f73f8fe-deca-4154-8fbc-d4fd6a1b158f/action HTTP/1.1 Oct 04 19:30:41.784275 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 19:30:41.784275 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 19:30:41.784275 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 19:30:41.784275 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 38 Oct 04 19:30:41.784275 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 19:30:41.784275 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 19:30:41.784275 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 19:30:41.784275 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 19:30:41.784275 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPInTVPEnD1RXtv4lncV29p8jm1TfJu6FUZ_jtF4iAd13nQ-o5_wNXnW_hk1g7gp2ik6PdEjq8Ur360EgmhPq7cgj7ryDlBueFx8NrtSymGl5RwqntlQnYwRkogu7OxlxLZbrZe_oQqjaDIEXi50ikORcDSR9Yx_SXulSHfjIb3J1lIo Oct 04 19:30:41.784275 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 19:30:41.784275 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 19:30:41.784275 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 19:30:41.784275 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 19:30:41.784275 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 19:30:41.784275 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 19:30:41.784275 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: 19cb4a5339a14201963c8851f970783a Oct 04 19:30:41.784275 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-349826930 Oct 04 19:30:41.784275 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,admin,reader Oct 04 19:30:41.784275 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,admin,reader Oct 04 19:30:41.784275 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/19cb4a5339a14201963c8851f970783a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_19cb4a5339a14201963c8851f970783a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/19cb4a5339a14201963c8851f970783a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/19cb4a5339a14201963c8851f970783a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 19:30:41.784275 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-ServersAdminNegativeTestJSON-349826930 Oct 04 19:30:41.784275 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: 19cb4a5339a14201963c8851f970783a Oct 04 19:30:41.784275 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-349826930 Oct 04 19:30:41.784275 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-ServersAdminNegativeTestJSON-349826930-project-admin Oct 04 19:30:41.784275 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 19:30:41.784275 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 19:30:41.784275 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 58879f0c4b8a4067900736832faaf04f Oct 04 19:30:41.784275 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-ServersAdminNegativeTestJSON-349826930-project-admin Oct 04 19:30:41.784275 n-d-851028-13 devstack@n-api.service[123596]: Oct 04 19:30:41.784275 n-d-851028-13 devstack@n-api.service[123596]: {"resize": {"flavorRef": "922868607"}} Oct 04 19:30:41.784275 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 19:30:41.784275 n-d-851028-13 devstack@n-api.service[123596]: exception: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 04 19:30:41.784275 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': '7f73f8fe-deca-4154-8fbc-d4fd6a1b158f', 'body': {'resize': {'flavorRef': '922868607'}}} Oct 04 19:30:41.784275 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:30:41.784275 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:30:41.784275 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3878, in _check_quota_for_upsize Oct 04 19:30:41.784275 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Oct 04 19:30:41.784275 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 19:30:41.784275 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 19:30:41.784275 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 04 19:30:41.784275 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc Oct 04 19:30:41.784275 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 04 19:30:41.784275 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 04 19:30:41.784275 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 19:30:41.784275 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 19:30:41.784275 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 04 19:30:41.784275 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 04 19:30:41.784275 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 04 19:30:41.784275 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 04 19:30:41.784275 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Oct 04 19:30:41.784275 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 04 19:30:41.784275 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Oct 04 19:30:41.784275 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:30:41.784275 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:30:41.784275 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:30:41.784275 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:30:41.784275 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 04 19:30:41.784275 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 04 19:30:41.784275 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 04 19:30:41.784275 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 19:30:41.784275 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 04 19:30:41.788294 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 04 19:30:41.788294 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 04 19:30:41.788294 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 04 19:30:41.788294 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 19:30:41.788294 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 19:30:41.788294 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 04 19:30:41.788294 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 19:30:41.788294 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 04 19:30:41.788294 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 19:30:41.788294 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4244, in resize Oct 04 19:30:41.788294 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Oct 04 19:30:41.788294 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3896, in _check_quota_for_upsize Oct 04 19:30:41.788294 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 04 19:30:41.788294 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 04 19:30:41.788294 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:30:41.788294 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:30:41.788294 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:30:41.788294 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:30:41.788294 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:30:41.788294 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:30:41.788294 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:30:41.788294 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:30:41.788294 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:30:41.788294 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:30:41.788294 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 19:30:41.788294 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 19:30:41.788294 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 04 19:30:41.788294 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 04 19:30:41.788294 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Oct 04 19:30:41.788294 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 04 19:30:41.788294 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 04 19:30:41.788294 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:30:41.788294 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:30:41.788294 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:30:41.788294 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:30:41.788294 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:30:41.788294 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:30:41.788294 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:30:41.788294 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:30:41.788294 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 04 19:30:41.788294 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:30:41.788294 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-5a0504b8-0291-4dc8-8c17-095a0608573f tempest-ServersAdminNegativeTestJSON-349826930 tempest-ServersAdminNegativeTestJSON-349826930-project-admin] Returning 403 to user: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:30:41.788294 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-5a0504b8-0291-4dc8-8c17-095a0608573f tempest-ServersAdminNegativeTestJSON-349826930 tempest-ServersAdminNegativeTestJSON-349826930-project-admin] 10.222.0.43 "POST /compute/v2.1/servers/7f73f8fe-deca-4154-8fbc-d4fd6a1b158f/action" status: 403 len: 113 microversion: 2.1 time: 0.248765 Oct 04 19:30:41.788294 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3646/6922] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 19:30:41 2022] POST /compute/v2.1/servers/7f73f8fe-deca-4154-8fbc-d4fd6a1b158f/action => generated 113 bytes in 250 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:30:41.795802 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-3c22fae8-fb8b-4ab6-bbcd-c692bd30441f tempest-ServersAdminNegativeTestJSON-349826930 tempest-ServersAdminNegativeTestJSON-349826930-project-admin] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:30:41.812278 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-3c22fae8-fb8b-4ab6-bbcd-c692bd30441f tempest-ServersAdminNegativeTestJSON-349826930 tempest-ServersAdminNegativeTestJSON-349826930-project-admin] 10.222.0.43 "DELETE /compute/v2.1/flavors/922868607" status: 202 len: 0 microversion: 2.1 time: 0.021279 Oct 04 19:30:41.812836 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3277/6923] 10.222.0.43 () {58 vars in 1158 bytes} [Tue Oct 4 19:30:41 2022] DELETE /compute/v2.1/flavors/922868607 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:30:41.821029 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-8dc3f246-cdc0-403c-8084-3f1a52e8ae06 tempest-ServersAdminNegativeTestJSON-349826930 tempest-ServersAdminNegativeTestJSON-349826930-project-admin] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:30:41.841558 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-8dc3f246-cdc0-403c-8084-3f1a52e8ae06 tempest-ServersAdminNegativeTestJSON-349826930 tempest-ServersAdminNegativeTestJSON-349826930-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.023671 Oct 04 19:30:41.841839 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3647/6924] 10.222.0.43 () {58 vars in 1146 bytes} [Tue Oct 4 19:30:41 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:30:41.862819 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-d796d9f5-ab8c-4002-920c-b33405ecadce tempest-ServersAdminNegativeTestJSON-1308021455 tempest-ServersAdminNegativeTestJSON-1308021455-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:30:41.863324 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-d796d9f5-ab8c-4002-920c-b33405ecadce tempest-ServersAdminNegativeTestJSON-1308021455 tempest-ServersAdminNegativeTestJSON-1308021455-project] [instance: 7f73f8fe-deca-4154-8fbc-d4fd6a1b158f] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:30:41.869415 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d796d9f5-ab8c-4002-920c-b33405ecadce tempest-ServersAdminNegativeTestJSON-1308021455 tempest-ServersAdminNegativeTestJSON-1308021455-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:30:41.869909 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d796d9f5-ab8c-4002-920c-b33405ecadce tempest-ServersAdminNegativeTestJSON-1308021455 tempest-ServersAdminNegativeTestJSON-1308021455-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:30:41.870352 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d796d9f5-ab8c-4002-920c-b33405ecadce tempest-ServersAdminNegativeTestJSON-1308021455 tempest-ServersAdminNegativeTestJSON-1308021455-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:30:41.871052 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d796d9f5-ab8c-4002-920c-b33405ecadce tempest-ServersAdminNegativeTestJSON-1308021455 tempest-ServersAdminNegativeTestJSON-1308021455-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:30:41.871509 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d796d9f5-ab8c-4002-920c-b33405ecadce tempest-ServersAdminNegativeTestJSON-1308021455 tempest-ServersAdminNegativeTestJSON-1308021455-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:30:41.871975 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d796d9f5-ab8c-4002-920c-b33405ecadce tempest-ServersAdminNegativeTestJSON-1308021455 tempest-ServersAdminNegativeTestJSON-1308021455-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:30:41.897208 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-d796d9f5-ab8c-4002-920c-b33405ecadce tempest-ServersAdminNegativeTestJSON-1308021455 tempest-ServersAdminNegativeTestJSON-1308021455-project] [instance: 7f73f8fe-deca-4154-8fbc-d4fd6a1b158f] Going to try to terminate instance {{(pid=123595) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 19:30:41.971314 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-d796d9f5-ab8c-4002-920c-b33405ecadce tempest-ServersAdminNegativeTestJSON-1308021455 tempest-ServersAdminNegativeTestJSON-1308021455-project] 10.222.0.43 "DELETE /compute/v2.1/servers/7f73f8fe-deca-4154-8fbc-d4fd6a1b158f" status: 204 len: 0 microversion: 2.1 time: 0.112143 Oct 04 19:30:41.971933 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3278/6925] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 19:30:41 2022] DELETE /compute/v2.1/servers/7f73f8fe-deca-4154-8fbc-d4fd6a1b158f => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 19:30:41.980578 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-5643971c-9e82-4bc9-a312-c3f400dbc415 tempest-ServersAdminNegativeTestJSON-1308021455 tempest-ServersAdminNegativeTestJSON-1308021455-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:30:41.981818 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-5643971c-9e82-4bc9-a312-c3f400dbc415 tempest-ServersAdminNegativeTestJSON-1308021455 tempest-ServersAdminNegativeTestJSON-1308021455-project] [instance: 7f73f8fe-deca-4154-8fbc-d4fd6a1b158f] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:30:41.987923 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5643971c-9e82-4bc9-a312-c3f400dbc415 tempest-ServersAdminNegativeTestJSON-1308021455 tempest-ServersAdminNegativeTestJSON-1308021455-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:30:41.988371 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5643971c-9e82-4bc9-a312-c3f400dbc415 tempest-ServersAdminNegativeTestJSON-1308021455 tempest-ServersAdminNegativeTestJSON-1308021455-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:30:41.988834 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5643971c-9e82-4bc9-a312-c3f400dbc415 tempest-ServersAdminNegativeTestJSON-1308021455 tempest-ServersAdminNegativeTestJSON-1308021455-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:30:41.989584 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5643971c-9e82-4bc9-a312-c3f400dbc415 tempest-ServersAdminNegativeTestJSON-1308021455 tempest-ServersAdminNegativeTestJSON-1308021455-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:30:41.990056 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5643971c-9e82-4bc9-a312-c3f400dbc415 tempest-ServersAdminNegativeTestJSON-1308021455 tempest-ServersAdminNegativeTestJSON-1308021455-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:30:41.990586 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5643971c-9e82-4bc9-a312-c3f400dbc415 tempest-ServersAdminNegativeTestJSON-1308021455 tempest-ServersAdminNegativeTestJSON-1308021455-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:30:42.122891 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-5643971c-9e82-4bc9-a312-c3f400dbc415 tempest-ServersAdminNegativeTestJSON-1308021455 tempest-ServersAdminNegativeTestJSON-1308021455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b2308d736ad42959d0316e3cbd7cc34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4e7bbd838c4a0fbdaf60289c9be6d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:30:42.130811 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-5643971c-9e82-4bc9-a312-c3f400dbc415 tempest-ServersAdminNegativeTestJSON-1308021455 tempest-ServersAdminNegativeTestJSON-1308021455-project] 10.222.0.43 "GET /compute/v2.1/servers/7f73f8fe-deca-4154-8fbc-d4fd6a1b158f" status: 200 len: 1477 microversion: 2.1 time: 0.154150 Oct 04 19:30:42.131380 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3648/6926] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:30:41 2022] GET /compute/v2.1/servers/7f73f8fe-deca-4154-8fbc-d4fd6a1b158f => generated 1477 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:30:43.153866 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-14c5008e-e01c-4a16-9d86-0abb52e21313 tempest-ServersAdminNegativeTestJSON-1308021455 tempest-ServersAdminNegativeTestJSON-1308021455-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:30:43.154568 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-14c5008e-e01c-4a16-9d86-0abb52e21313 tempest-ServersAdminNegativeTestJSON-1308021455 tempest-ServersAdminNegativeTestJSON-1308021455-project] [instance: 7f73f8fe-deca-4154-8fbc-d4fd6a1b158f] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:30:43.161479 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-14c5008e-e01c-4a16-9d86-0abb52e21313 tempest-ServersAdminNegativeTestJSON-1308021455 tempest-ServersAdminNegativeTestJSON-1308021455-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:30:43.161973 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-14c5008e-e01c-4a16-9d86-0abb52e21313 tempest-ServersAdminNegativeTestJSON-1308021455 tempest-ServersAdminNegativeTestJSON-1308021455-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:30:43.162418 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-14c5008e-e01c-4a16-9d86-0abb52e21313 tempest-ServersAdminNegativeTestJSON-1308021455 tempest-ServersAdminNegativeTestJSON-1308021455-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:30:43.163103 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-14c5008e-e01c-4a16-9d86-0abb52e21313 tempest-ServersAdminNegativeTestJSON-1308021455 tempest-ServersAdminNegativeTestJSON-1308021455-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:30:43.163557 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-14c5008e-e01c-4a16-9d86-0abb52e21313 tempest-ServersAdminNegativeTestJSON-1308021455 tempest-ServersAdminNegativeTestJSON-1308021455-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:30:43.163985 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-14c5008e-e01c-4a16-9d86-0abb52e21313 tempest-ServersAdminNegativeTestJSON-1308021455 tempest-ServersAdminNegativeTestJSON-1308021455-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:30:43.338515 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-14c5008e-e01c-4a16-9d86-0abb52e21313 tempest-ServersAdminNegativeTestJSON-1308021455 tempest-ServersAdminNegativeTestJSON-1308021455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b2308d736ad42959d0316e3cbd7cc34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4e7bbd838c4a0fbdaf60289c9be6d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:30:43.348505 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-14c5008e-e01c-4a16-9d86-0abb52e21313 tempest-ServersAdminNegativeTestJSON-1308021455 tempest-ServersAdminNegativeTestJSON-1308021455-project] 10.222.0.43 "GET /compute/v2.1/servers/7f73f8fe-deca-4154-8fbc-d4fd6a1b158f" status: 200 len: 1477 microversion: 2.1 time: 0.198814 Oct 04 19:30:43.361136 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3279/6927] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:30:43 2022] GET /compute/v2.1/servers/7f73f8fe-deca-4154-8fbc-d4fd6a1b158f => generated 1477 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:30:44.194343 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-641015af-9ca7-4f6b-81d1-cf2ae976c0c5 req-575b5229-3922-403f-a18f-d6e7ba6d9fd2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f73f8fe-deca-4154-8fbc-d4fd6a1b158f", "name": "network-vif-deleted", "tag": "24ea7676-5542-4fd0-a12a-b25425f9f402"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:30:44.210763 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-641015af-9ca7-4f6b-81d1-cf2ae976c0c5 req-575b5229-3922-403f-a18f-d6e7ba6d9fd2 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:30:44.217785 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-641015af-9ca7-4f6b-81d1-cf2ae976c0c5 req-575b5229-3922-403f-a18f-d6e7ba6d9fd2 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:30:44.218449 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-641015af-9ca7-4f6b-81d1-cf2ae976c0c5 req-575b5229-3922-403f-a18f-d6e7ba6d9fd2 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:30:44.236900 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-641015af-9ca7-4f6b-81d1-cf2ae976c0c5 req-575b5229-3922-403f-a18f-d6e7ba6d9fd2 service nova] Creating event network-vif-deleted:24ea7676-5542-4fd0-a12a-b25425f9f402 for instance 7f73f8fe-deca-4154-8fbc-d4fd6a1b158f on n-h2-851028-13 Oct 04 19:30:44.242218 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-641015af-9ca7-4f6b-81d1-cf2ae976c0c5 req-575b5229-3922-403f-a18f-d6e7ba6d9fd2 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051492 Oct 04 19:30:44.243614 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3649/6928] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:30:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:30:44.373568 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-55b5b447-cc36-4186-a319-040630532ab0 tempest-ServersAdminNegativeTestJSON-1308021455 tempest-ServersAdminNegativeTestJSON-1308021455-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:30:44.374300 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-55b5b447-cc36-4186-a319-040630532ab0 tempest-ServersAdminNegativeTestJSON-1308021455 tempest-ServersAdminNegativeTestJSON-1308021455-project] [instance: 7f73f8fe-deca-4154-8fbc-d4fd6a1b158f] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:30:44.380857 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-55b5b447-cc36-4186-a319-040630532ab0 tempest-ServersAdminNegativeTestJSON-1308021455 tempest-ServersAdminNegativeTestJSON-1308021455-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:30:44.381482 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-55b5b447-cc36-4186-a319-040630532ab0 tempest-ServersAdminNegativeTestJSON-1308021455 tempest-ServersAdminNegativeTestJSON-1308021455-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:30:44.381985 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-55b5b447-cc36-4186-a319-040630532ab0 tempest-ServersAdminNegativeTestJSON-1308021455 tempest-ServersAdminNegativeTestJSON-1308021455-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:30:44.382916 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-55b5b447-cc36-4186-a319-040630532ab0 tempest-ServersAdminNegativeTestJSON-1308021455 tempest-ServersAdminNegativeTestJSON-1308021455-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:30:44.383611 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-55b5b447-cc36-4186-a319-040630532ab0 tempest-ServersAdminNegativeTestJSON-1308021455 tempest-ServersAdminNegativeTestJSON-1308021455-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:30:44.384134 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-55b5b447-cc36-4186-a319-040630532ab0 tempest-ServersAdminNegativeTestJSON-1308021455 tempest-ServersAdminNegativeTestJSON-1308021455-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:30:44.419537 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-55b5b447-cc36-4186-a319-040630532ab0 tempest-ServersAdminNegativeTestJSON-1308021455 tempest-ServersAdminNegativeTestJSON-1308021455-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:30:44.420017 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-55b5b447-cc36-4186-a319-040630532ab0 tempest-ServersAdminNegativeTestJSON-1308021455 tempest-ServersAdminNegativeTestJSON-1308021455-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:30:44.420455 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-55b5b447-cc36-4186-a319-040630532ab0 tempest-ServersAdminNegativeTestJSON-1308021455 tempest-ServersAdminNegativeTestJSON-1308021455-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:30:44.420895 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.objects.instance [None req-55b5b447-cc36-4186-a319-040630532ab0 tempest-ServersAdminNegativeTestJSON-1308021455 tempest-ServersAdminNegativeTestJSON-1308021455-project] Lazy-loading 'fault' on Instance uuid 7f73f8fe-deca-4154-8fbc-d4fd6a1b158f {{(pid=123595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 19:30:44.461328 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-55b5b447-cc36-4186-a319-040630532ab0 tempest-ServersAdminNegativeTestJSON-1308021455 tempest-ServersAdminNegativeTestJSON-1308021455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b2308d736ad42959d0316e3cbd7cc34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4e7bbd838c4a0fbdaf60289c9be6d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:30:44.468958 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-55b5b447-cc36-4186-a319-040630532ab0 tempest-ServersAdminNegativeTestJSON-1308021455 tempest-ServersAdminNegativeTestJSON-1308021455-project] 10.222.0.43 "GET /compute/v2.1/servers/7f73f8fe-deca-4154-8fbc-d4fd6a1b158f" status: 200 len: 1312 microversion: 2.1 time: 0.101069 Oct 04 19:30:44.469563 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3280/6929] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:30:44 2022] GET /compute/v2.1/servers/7f73f8fe-deca-4154-8fbc-d4fd6a1b158f => generated 1312 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:30:45.493312 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-a7f413e7-d2db-4a93-a76d-fd74f5a58065 tempest-ServersAdminNegativeTestJSON-1308021455 tempest-ServersAdminNegativeTestJSON-1308021455-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:30:45.494054 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-a7f413e7-d2db-4a93-a76d-fd74f5a58065 tempest-ServersAdminNegativeTestJSON-1308021455 tempest-ServersAdminNegativeTestJSON-1308021455-project] [instance: 7f73f8fe-deca-4154-8fbc-d4fd6a1b158f] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:30:45.500585 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a7f413e7-d2db-4a93-a76d-fd74f5a58065 tempest-ServersAdminNegativeTestJSON-1308021455 tempest-ServersAdminNegativeTestJSON-1308021455-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:30:45.501084 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a7f413e7-d2db-4a93-a76d-fd74f5a58065 tempest-ServersAdminNegativeTestJSON-1308021455 tempest-ServersAdminNegativeTestJSON-1308021455-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:30:45.501571 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a7f413e7-d2db-4a93-a76d-fd74f5a58065 tempest-ServersAdminNegativeTestJSON-1308021455 tempest-ServersAdminNegativeTestJSON-1308021455-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:30:45.502285 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a7f413e7-d2db-4a93-a76d-fd74f5a58065 tempest-ServersAdminNegativeTestJSON-1308021455 tempest-ServersAdminNegativeTestJSON-1308021455-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:30:45.502756 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a7f413e7-d2db-4a93-a76d-fd74f5a58065 tempest-ServersAdminNegativeTestJSON-1308021455 tempest-ServersAdminNegativeTestJSON-1308021455-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:30:45.503201 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a7f413e7-d2db-4a93-a76d-fd74f5a58065 tempest-ServersAdminNegativeTestJSON-1308021455 tempest-ServersAdminNegativeTestJSON-1308021455-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:30:45.516636 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-a7f413e7-d2db-4a93-a76d-fd74f5a58065 tempest-ServersAdminNegativeTestJSON-1308021455 tempest-ServersAdminNegativeTestJSON-1308021455-project] HTTP exception thrown: Instance 7f73f8fe-deca-4154-8fbc-d4fd6a1b158f could not be found. Oct 04 19:30:45.518314 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-a7f413e7-d2db-4a93-a76d-fd74f5a58065 tempest-ServersAdminNegativeTestJSON-1308021455 tempest-ServersAdminNegativeTestJSON-1308021455-project] Request method failure captured: Oct 04 19:30:45.518314 n-d-851028-13 devstack@n-api.service[123596]: request: GET /compute/v2.1/servers/7f73f8fe-deca-4154-8fbc-d4fd6a1b158f HTTP/1.1 Oct 04 19:30:45.518314 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 19:30:45.518314 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 19:30:45.518314 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 19:30:45.518314 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 19:30:45.518314 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 19:30:45.518314 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 19:30:45.518314 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 19:30:45.518314 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 19:30:45.518314 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPInS9ZklseojJVnAOdvO3mUPExj6UjdNNXE8k78DxS2tNGr7bKuTNDzityCHDuPygUMqddY60VVZmXED36LHXHCvPSjllnzrAbnCUFIuNb4OevXK7AtnbaQBmH8_ayj_ag8J1hgmFHqg8Sc739gOJ_ZoykMdwTDqw7UwkUa0nz-ZArE Oct 04 19:30:45.518314 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 19:30:45.518314 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 19:30:45.518314 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 19:30:45.518314 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 19:30:45.518314 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 19:30:45.518314 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 19:30:45.518314 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: fe4e7bbd838c4a0fbdaf60289c9be6d6 Oct 04 19:30:45.518314 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1308021455 Oct 04 19:30:45.518314 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 19:30:45.518314 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 19:30:45.518314 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/fe4e7bbd838c4a0fbdaf60289c9be6d6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_fe4e7bbd838c4a0fbdaf60289c9be6d6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/fe4e7bbd838c4a0fbdaf60289c9be6d6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/fe4e7bbd838c4a0fbdaf60289c9be6d6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 19:30:45.518314 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1308021455 Oct 04 19:30:45.518314 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: fe4e7bbd838c4a0fbdaf60289c9be6d6 Oct 04 19:30:45.518314 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1308021455 Oct 04 19:30:45.518314 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-ServersAdminNegativeTestJSON-1308021455-project Oct 04 19:30:45.518314 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 19:30:45.518314 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 19:30:45.518314 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 4b2308d736ad42959d0316e3cbd7cc34 Oct 04 19:30:45.518314 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1308021455-project Oct 04 19:30:45.518314 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 19:30:45.518314 n-d-851028-13 devstack@n-api.service[123596]: exception: Instance 7f73f8fe-deca-4154-8fbc-d4fd6a1b158f could not be found. Oct 04 19:30:45.518314 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': '7f73f8fe-deca-4154-8fbc-d4fd6a1b158f'} Oct 04 19:30:45.518314 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:30:45.518314 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:30:45.518314 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:30:45.518314 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:30:45.518314 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:30:45.518314 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:30:45.518314 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:30:45.518314 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:30:45.518314 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:30:45.518314 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:30:45.518314 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f73f8fe-deca-4154-8fbc-d4fd6a1b158f could not be found. Oct 04 19:30:45.518314 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:30:45.518314 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:30:45.518314 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:30:45.518314 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:30:45.518314 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:30:45.518314 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:30:45.518314 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:30:45.518314 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:30:45.518314 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:30:45.518314 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:30:45.518314 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:30:45.518314 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:30:45.518314 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:30:45.518314 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:30:45.518314 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:30:45.518314 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:30:45.518314 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f73f8fe-deca-4154-8fbc-d4fd6a1b158f could not be found. Oct 04 19:30:45.518314 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:30:45.518314 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:30:45.522662 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:30:45.522662 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:30:45.522662 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:30:45.522662 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:30:45.522662 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:30:45.522662 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:30:45.522662 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f73f8fe-deca-4154-8fbc-d4fd6a1b158f could not be found. Oct 04 19:30:45.522662 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:30:45.522662 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-a7f413e7-d2db-4a93-a76d-fd74f5a58065 tempest-ServersAdminNegativeTestJSON-1308021455 tempest-ServersAdminNegativeTestJSON-1308021455-project] Returning 404 to user: Instance 7f73f8fe-deca-4154-8fbc-d4fd6a1b158f could not be found. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:30:45.522662 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-a7f413e7-d2db-4a93-a76d-fd74f5a58065 tempest-ServersAdminNegativeTestJSON-1308021455 tempest-ServersAdminNegativeTestJSON-1308021455-project] 10.222.0.43 "GET /compute/v2.1/servers/7f73f8fe-deca-4154-8fbc-d4fd6a1b158f" status: 404 len: 111 microversion: 2.1 time: 0.031637 Oct 04 19:30:45.522662 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3650/6930] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:30:45 2022] GET /compute/v2.1/servers/7f73f8fe-deca-4154-8fbc-d4fd6a1b158f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:30:51.921653 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=2 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:30:51.922631 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=3 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:30:52.041295 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-bde8ac9b-5638-4767-be4c-78877d5f6bc9 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-139166661", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452", "networks": [{"uuid": "b583fce7-6d9d-4107-9b57-c669feb903a4"}]}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:30:52.098228 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.network.neutron [None req-bde8ac9b-5638-4767-be4c-78877d5f6bc9 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] validate_networks() for [('b583fce7-6d9d-4107-9b57-c669feb903a4', None, None, None, None, None)] {{(pid=123595) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 19:30:52.484343 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-bde8ac9b-5638-4767-be4c-78877d5f6bc9 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Flavor limits 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:30:52.484769 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-bde8ac9b-5638-4767-be4c-78877d5f6bc9 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Image limits 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:30:52.485282 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-bde8ac9b-5638-4767-be4c-78877d5f6bc9 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Flavor pref 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:30:52.485696 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-bde8ac9b-5638-4767-be4c-78877d5f6bc9 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Image pref 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:30:52.486139 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-bde8ac9b-5638-4767-be4c-78877d5f6bc9 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:30:52.495236 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bde8ac9b-5638-4767-be4c-78877d5f6bc9 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:30:52.495654 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bde8ac9b-5638-4767-be4c-78877d5f6bc9 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:30:52.496092 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bde8ac9b-5638-4767-be4c-78877d5f6bc9 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:30:52.496828 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bde8ac9b-5638-4767-be4c-78877d5f6bc9 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:30:52.497318 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bde8ac9b-5638-4767-be4c-78877d5f6bc9 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:30:52.497747 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bde8ac9b-5638-4767-be4c-78877d5f6bc9 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:30:52.514901 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-bde8ac9b-5638-4767-be4c-78877d5f6bc9 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Getting quotas for project 031ac4c004ed404ea279cb14ce98f7fb. Resources: {'ram', 'cores', 'instances'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:30:52.520114 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-bde8ac9b-5638-4767-be4c-78877d5f6bc9 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Getting quotas for user 8ff9e10ea4d64644a0389ebfbf90af00 and project 031ac4c004ed404ea279cb14ce98f7fb. Resources: {'ram', 'cores', 'instances'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:30:52.533515 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-bde8ac9b-5638-4767-be4c-78877d5f6bc9 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Going to run 1 instances... {{(pid=123595) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 19:30:52.535845 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-bde8ac9b-5638-4767-be4c-78877d5f6bc9 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] [instance: 4f9b487c-de25-439c-9340-8f3706de75eb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e8943ec5-4038-4d4b-b9b9-2415a79f5243',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 19:30:52.585264 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-bde8ac9b-5638-4767-be4c-78877d5f6bc9 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.670285 Oct 04 19:30:52.585932 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3281/6931] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 19:30:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 672 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 19:30:52.598035 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-087b8140-770f-4e40-af22-631f3e509fec tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:30:52.599276 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-087b8140-770f-4e40-af22-631f3e509fec tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] [instance: 4f9b487c-de25-439c-9340-8f3706de75eb] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:30:52.602613 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=2 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:30:52.603629 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=3 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:30:52.664608 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-087b8140-770f-4e40-af22-631f3e509fec tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ff9e10ea4d64644a0389ebfbf90af00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '031ac4c004ed404ea279cb14ce98f7fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:30:52.672067 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-087b8140-770f-4e40-af22-631f3e509fec tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] 10.222.0.43 "GET /compute/v2.1/servers/4f9b487c-de25-439c-9340-8f3706de75eb" status: 200 len: 1214 microversion: 2.1 time: 0.077935 Oct 04 19:30:52.672729 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3651/6932] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:30:52 2022] GET /compute/v2.1/servers/4f9b487c-de25-439c-9340-8f3706de75eb => generated 1214 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:30:53.696660 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-96d66242-1f8b-4cdc-97d1-0928897a7556 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:30:53.698041 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-96d66242-1f8b-4cdc-97d1-0928897a7556 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] [instance: 4f9b487c-de25-439c-9340-8f3706de75eb] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:30:53.706232 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-96d66242-1f8b-4cdc-97d1-0928897a7556 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:30:53.707047 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-96d66242-1f8b-4cdc-97d1-0928897a7556 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:30:53.707738 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-96d66242-1f8b-4cdc-97d1-0928897a7556 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:30:53.708674 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-96d66242-1f8b-4cdc-97d1-0928897a7556 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:30:53.709401 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-96d66242-1f8b-4cdc-97d1-0928897a7556 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:30:53.710044 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-96d66242-1f8b-4cdc-97d1-0928897a7556 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:30:53.793214 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-96d66242-1f8b-4cdc-97d1-0928897a7556 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ff9e10ea4d64644a0389ebfbf90af00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '031ac4c004ed404ea279cb14ce98f7fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:30:53.803335 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-96d66242-1f8b-4cdc-97d1-0928897a7556 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] 10.222.0.43 "GET /compute/v2.1/servers/4f9b487c-de25-439c-9340-8f3706de75eb" status: 200 len: 1274 microversion: 2.1 time: 0.111439 Oct 04 19:30:53.804630 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3282/6933] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:30:53 2022] GET /compute/v2.1/servers/4f9b487c-de25-439c-9340-8f3706de75eb => generated 1274 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:30:54.828777 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-3215bb46-b91e-4cba-b143-c6a4b75de949 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:30:54.831149 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-3215bb46-b91e-4cba-b143-c6a4b75de949 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] [instance: 4f9b487c-de25-439c-9340-8f3706de75eb] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:30:54.839894 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3215bb46-b91e-4cba-b143-c6a4b75de949 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:30:54.841698 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3215bb46-b91e-4cba-b143-c6a4b75de949 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:30:54.842406 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3215bb46-b91e-4cba-b143-c6a4b75de949 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:30:54.843673 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3215bb46-b91e-4cba-b143-c6a4b75de949 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:30:54.844683 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3215bb46-b91e-4cba-b143-c6a4b75de949 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:30:54.845460 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3215bb46-b91e-4cba-b143-c6a4b75de949 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:30:54.996968 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-3215bb46-b91e-4cba-b143-c6a4b75de949 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ff9e10ea4d64644a0389ebfbf90af00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '031ac4c004ed404ea279cb14ce98f7fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:30:55.007171 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-3215bb46-b91e-4cba-b143-c6a4b75de949 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] 10.222.0.43 "GET /compute/v2.1/servers/4f9b487c-de25-439c-9340-8f3706de75eb" status: 200 len: 1314 microversion: 2.1 time: 0.182881 Oct 04 19:30:55.013187 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3652/6934] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:30:54 2022] GET /compute/v2.1/servers/4f9b487c-de25-439c-9340-8f3706de75eb => generated 1314 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:30:55.465831 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-2c8ddd19-5fe4-4683-9515-588c52288ebf req-4d2e9d15-e549-4d97-8085-acff9e5aac2d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f9b487c-de25-439c-9340-8f3706de75eb", "tag": "66223cd4-9d17-4f9b-b5a1-9135f78e3972"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:30:55.485100 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-2c8ddd19-5fe4-4683-9515-588c52288ebf req-4d2e9d15-e549-4d97-8085-acff9e5aac2d service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:30:55.485879 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-2c8ddd19-5fe4-4683-9515-588c52288ebf req-4d2e9d15-e549-4d97-8085-acff9e5aac2d service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:30:55.486472 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-2c8ddd19-5fe4-4683-9515-588c52288ebf req-4d2e9d15-e549-4d97-8085-acff9e5aac2d service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:30:55.505746 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-2c8ddd19-5fe4-4683-9515-588c52288ebf req-4d2e9d15-e549-4d97-8085-acff9e5aac2d service nova] Creating event network-changed:66223cd4-9d17-4f9b-b5a1-9135f78e3972 for instance 4f9b487c-de25-439c-9340-8f3706de75eb on n-h2-851028-13 Oct 04 19:30:55.516378 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-2c8ddd19-5fe4-4683-9515-588c52288ebf req-4d2e9d15-e549-4d97-8085-acff9e5aac2d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059843 Oct 04 19:30:55.517658 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3283/6935] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:30:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:30:56.031164 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-709c3e80-2a0b-4e7a-890e-808e4b3c26b4 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:30:56.031820 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-709c3e80-2a0b-4e7a-890e-808e4b3c26b4 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] [instance: 4f9b487c-de25-439c-9340-8f3706de75eb] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:30:56.038868 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-709c3e80-2a0b-4e7a-890e-808e4b3c26b4 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:30:56.039371 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-709c3e80-2a0b-4e7a-890e-808e4b3c26b4 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:30:56.039825 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-709c3e80-2a0b-4e7a-890e-808e4b3c26b4 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:30:56.040534 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-709c3e80-2a0b-4e7a-890e-808e4b3c26b4 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:30:56.041001 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-709c3e80-2a0b-4e7a-890e-808e4b3c26b4 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:30:56.041472 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-709c3e80-2a0b-4e7a-890e-808e4b3c26b4 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:30:56.183393 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-709c3e80-2a0b-4e7a-890e-808e4b3c26b4 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ff9e10ea4d64644a0389ebfbf90af00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '031ac4c004ed404ea279cb14ce98f7fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:30:56.192253 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-709c3e80-2a0b-4e7a-890e-808e4b3c26b4 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] 10.222.0.43 "GET /compute/v2.1/servers/4f9b487c-de25-439c-9340-8f3706de75eb" status: 200 len: 1314 microversion: 2.1 time: 0.164952 Oct 04 19:30:56.194789 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3653/6936] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:30:56 2022] GET /compute/v2.1/servers/4f9b487c-de25-439c-9340-8f3706de75eb => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:30:57.219102 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-31366039-ea91-46ce-9f9b-ef304bdc0521 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:30:57.219822 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-31366039-ea91-46ce-9f9b-ef304bdc0521 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] [instance: 4f9b487c-de25-439c-9340-8f3706de75eb] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:30:57.227562 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-31366039-ea91-46ce-9f9b-ef304bdc0521 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:30:57.228061 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-31366039-ea91-46ce-9f9b-ef304bdc0521 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:30:57.228505 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-31366039-ea91-46ce-9f9b-ef304bdc0521 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:30:57.229424 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-31366039-ea91-46ce-9f9b-ef304bdc0521 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:30:57.229887 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-31366039-ea91-46ce-9f9b-ef304bdc0521 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:30:57.230536 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-31366039-ea91-46ce-9f9b-ef304bdc0521 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:30:57.363202 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-31366039-ea91-46ce-9f9b-ef304bdc0521 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ff9e10ea4d64644a0389ebfbf90af00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '031ac4c004ed404ea279cb14ce98f7fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:30:57.371482 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-31366039-ea91-46ce-9f9b-ef304bdc0521 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] 10.222.0.43 "GET /compute/v2.1/servers/4f9b487c-de25-439c-9340-8f3706de75eb" status: 200 len: 1314 microversion: 2.1 time: 0.156988 Oct 04 19:30:57.372064 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3284/6937] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:30:57 2022] GET /compute/v2.1/servers/4f9b487c-de25-439c-9340-8f3706de75eb => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:30:58.394883 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-2de5b853-11ab-4b68-92e1-7a70a54b3fa5 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:30:58.395510 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-2de5b853-11ab-4b68-92e1-7a70a54b3fa5 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] [instance: 4f9b487c-de25-439c-9340-8f3706de75eb] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:30:58.398254 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=4,nova_api:DELETE=3 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:30:58.404230 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2de5b853-11ab-4b68-92e1-7a70a54b3fa5 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:30:58.404767 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2de5b853-11ab-4b68-92e1-7a70a54b3fa5 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:30:58.405275 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2de5b853-11ab-4b68-92e1-7a70a54b3fa5 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:30:58.405988 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2de5b853-11ab-4b68-92e1-7a70a54b3fa5 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:30:58.406458 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2de5b853-11ab-4b68-92e1-7a70a54b3fa5 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:30:58.406905 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2de5b853-11ab-4b68-92e1-7a70a54b3fa5 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:30:58.410035 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=64 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:30:58.541953 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-2de5b853-11ab-4b68-92e1-7a70a54b3fa5 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ff9e10ea4d64644a0389ebfbf90af00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '031ac4c004ed404ea279cb14ce98f7fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:30:58.550628 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-2de5b853-11ab-4b68-92e1-7a70a54b3fa5 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] 10.222.0.43 "GET /compute/v2.1/servers/4f9b487c-de25-439c-9340-8f3706de75eb" status: 200 len: 1314 microversion: 2.1 time: 0.160015 Oct 04 19:30:58.551264 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3654/6938] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:30:58 2022] GET /compute/v2.1/servers/4f9b487c-de25-439c-9340-8f3706de75eb => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:30:59.575064 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-28e739dc-aec0-4a07-93b8-e9bbc9616195 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:30:59.575662 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-28e739dc-aec0-4a07-93b8-e9bbc9616195 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] [instance: 4f9b487c-de25-439c-9340-8f3706de75eb] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:30:59.577706 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=4,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:30:59.582967 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-28e739dc-aec0-4a07-93b8-e9bbc9616195 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:30:59.583448 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-28e739dc-aec0-4a07-93b8-e9bbc9616195 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:30:59.583884 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-28e739dc-aec0-4a07-93b8-e9bbc9616195 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:30:59.584575 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-28e739dc-aec0-4a07-93b8-e9bbc9616195 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:30:59.585031 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-28e739dc-aec0-4a07-93b8-e9bbc9616195 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:30:59.585480 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-28e739dc-aec0-4a07-93b8-e9bbc9616195 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:30:59.590669 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:30:59.721697 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-28e739dc-aec0-4a07-93b8-e9bbc9616195 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ff9e10ea4d64644a0389ebfbf90af00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '031ac4c004ed404ea279cb14ce98f7fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:30:59.729843 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-28e739dc-aec0-4a07-93b8-e9bbc9616195 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] 10.222.0.43 "GET /compute/v2.1/servers/4f9b487c-de25-439c-9340-8f3706de75eb" status: 200 len: 1314 microversion: 2.1 time: 0.159026 Oct 04 19:30:59.730953 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3285/6939] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:30:59 2022] GET /compute/v2.1/servers/4f9b487c-de25-439c-9340-8f3706de75eb => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:31:00.754857 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f71c9454-4ffd-4135-af85-29df52ca9274 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:31:00.755581 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-f71c9454-4ffd-4135-af85-29df52ca9274 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] [instance: 4f9b487c-de25-439c-9340-8f3706de75eb] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:31:00.763433 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f71c9454-4ffd-4135-af85-29df52ca9274 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:00.763941 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f71c9454-4ffd-4135-af85-29df52ca9274 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:00.764407 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f71c9454-4ffd-4135-af85-29df52ca9274 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:00.765144 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f71c9454-4ffd-4135-af85-29df52ca9274 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:00.765622 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f71c9454-4ffd-4135-af85-29df52ca9274 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:00.766074 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f71c9454-4ffd-4135-af85-29df52ca9274 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:00.875477 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-16b54f2b-e2f6-4911-8228-23ee6789259f req-a38252c9-909d-421d-8cac-2642f60623d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f9b487c-de25-439c-9340-8f3706de75eb", "name": "network-vif-plugged", "status": "completed", "tag": "66223cd4-9d17-4f9b-b5a1-9135f78e3972"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:31:00.889092 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-16b54f2b-e2f6-4911-8228-23ee6789259f req-a38252c9-909d-421d-8cac-2642f60623d2 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:00.889883 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-16b54f2b-e2f6-4911-8228-23ee6789259f req-a38252c9-909d-421d-8cac-2642f60623d2 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:00.890430 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-16b54f2b-e2f6-4911-8228-23ee6789259f req-a38252c9-909d-421d-8cac-2642f60623d2 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:00.902188 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-16b54f2b-e2f6-4911-8228-23ee6789259f req-a38252c9-909d-421d-8cac-2642f60623d2 service nova] Creating event network-vif-plugged:66223cd4-9d17-4f9b-b5a1-9135f78e3972 for instance 4f9b487c-de25-439c-9340-8f3706de75eb on n-h2-851028-13 Oct 04 19:31:00.908023 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-f71c9454-4ffd-4135-af85-29df52ca9274 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ff9e10ea4d64644a0389ebfbf90af00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '031ac4c004ed404ea279cb14ce98f7fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:31:00.909136 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-16b54f2b-e2f6-4911-8228-23ee6789259f req-a38252c9-909d-421d-8cac-2642f60623d2 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037401 Oct 04 19:31:00.910098 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3286/6940] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:31:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:31:00.916249 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-f71c9454-4ffd-4135-af85-29df52ca9274 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] 10.222.0.43 "GET /compute/v2.1/servers/4f9b487c-de25-439c-9340-8f3706de75eb" status: 200 len: 1314 microversion: 2.1 time: 0.166804 Oct 04 19:31:00.917435 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3655/6941] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:31:00 2022] GET /compute/v2.1/servers/4f9b487c-de25-439c-9340-8f3706de75eb => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:31:01.942931 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-e246acda-cb42-48b5-bdfc-283b833b8423 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:31:01.944021 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-e246acda-cb42-48b5-bdfc-283b833b8423 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] [instance: 4f9b487c-de25-439c-9340-8f3706de75eb] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:31:01.954004 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e246acda-cb42-48b5-bdfc-283b833b8423 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:01.954746 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e246acda-cb42-48b5-bdfc-283b833b8423 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:01.955424 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e246acda-cb42-48b5-bdfc-283b833b8423 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:01.956497 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e246acda-cb42-48b5-bdfc-283b833b8423 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:01.957245 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e246acda-cb42-48b5-bdfc-283b833b8423 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:01.958004 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e246acda-cb42-48b5-bdfc-283b833b8423 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:02.107037 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-e246acda-cb42-48b5-bdfc-283b833b8423 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ff9e10ea4d64644a0389ebfbf90af00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '031ac4c004ed404ea279cb14ce98f7fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:31:02.114910 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-e246acda-cb42-48b5-bdfc-283b833b8423 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] 10.222.0.43 "GET /compute/v2.1/servers/4f9b487c-de25-439c-9340-8f3706de75eb" status: 200 len: 1314 microversion: 2.1 time: 0.179675 Oct 04 19:31:02.115484 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3287/6942] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:31:01 2022] GET /compute/v2.1/servers/4f9b487c-de25-439c-9340-8f3706de75eb => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:31:03.138511 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-3793cc9d-5c63-41d1-bd73-10832de60356 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:31:03.139163 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-3793cc9d-5c63-41d1-bd73-10832de60356 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] [instance: 4f9b487c-de25-439c-9340-8f3706de75eb] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:31:03.141991 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=2 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:31:03.147944 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3793cc9d-5c63-41d1-bd73-10832de60356 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:03.148467 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3793cc9d-5c63-41d1-bd73-10832de60356 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:03.148936 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3793cc9d-5c63-41d1-bd73-10832de60356 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:03.149694 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3793cc9d-5c63-41d1-bd73-10832de60356 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:03.150177 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3793cc9d-5c63-41d1-bd73-10832de60356 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:03.150631 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3793cc9d-5c63-41d1-bd73-10832de60356 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:03.288919 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-3793cc9d-5c63-41d1-bd73-10832de60356 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ff9e10ea4d64644a0389ebfbf90af00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '031ac4c004ed404ea279cb14ce98f7fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:31:03.296796 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-3793cc9d-5c63-41d1-bd73-10832de60356 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] 10.222.0.43 "GET /compute/v2.1/servers/4f9b487c-de25-439c-9340-8f3706de75eb" status: 200 len: 1502 microversion: 2.1 time: 0.162756 Oct 04 19:31:03.297410 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3656/6943] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:31:03 2022] GET /compute/v2.1/servers/4f9b487c-de25-439c-9340-8f3706de75eb => generated 1502 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:31:03.319060 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-b9abe507-7730-44bb-81ef-6a3be2385b46 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:31:03.321357 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-b9abe507-7730-44bb-81ef-6a3be2385b46 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] [instance: 4f9b487c-de25-439c-9340-8f3706de75eb] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:31:03.323497 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=2 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:31:03.324871 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=6 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:31:03.331923 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b9abe507-7730-44bb-81ef-6a3be2385b46 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:03.332418 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b9abe507-7730-44bb-81ef-6a3be2385b46 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:03.332865 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b9abe507-7730-44bb-81ef-6a3be2385b46 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:03.333599 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b9abe507-7730-44bb-81ef-6a3be2385b46 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:03.334060 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b9abe507-7730-44bb-81ef-6a3be2385b46 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:03.334494 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b9abe507-7730-44bb-81ef-6a3be2385b46 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:03.413435 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-b9abe507-7730-44bb-81ef-6a3be2385b46 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '8ff9e10ea4d64644a0389ebfbf90af00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '031ac4c004ed404ea279cb14ce98f7fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:31:03.418922 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-b9abe507-7730-44bb-81ef-6a3be2385b46 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] [instance: 4f9b487c-de25-439c-9340-8f3706de75eb] Old instance type m1.heat2, new instance type m1.heat {{(pid=123595) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 04 19:31:03.425649 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-b9abe507-7730-44bb-81ef-6a3be2385b46 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Flavor limits 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:31:03.426156 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-b9abe507-7730-44bb-81ef-6a3be2385b46 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Image limits 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:31:03.426780 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-b9abe507-7730-44bb-81ef-6a3be2385b46 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Flavor pref 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:31:03.427195 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-b9abe507-7730-44bb-81ef-6a3be2385b46 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Image pref 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:31:03.427607 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-b9abe507-7730-44bb-81ef-6a3be2385b46 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:31:03.536821 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-b9abe507-7730-44bb-81ef-6a3be2385b46 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] 10.222.0.43 "POST /compute/v2.1/servers/4f9b487c-de25-439c-9340-8f3706de75eb/action" status: 202 len: 0 microversion: 2.1 time: 0.221581 Oct 04 19:31:03.537310 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3288/6944] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 19:31:03 2022] POST /compute/v2.1/servers/4f9b487c-de25-439c-9340-8f3706de75eb/action => generated 0 bytes in 223 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:31:03.545459 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-2231509c-603f-4cff-9c1a-c8cfec1280cd tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:31:03.546102 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-2231509c-603f-4cff-9c1a-c8cfec1280cd tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] [instance: 4f9b487c-de25-439c-9340-8f3706de75eb] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:31:03.552080 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2231509c-603f-4cff-9c1a-c8cfec1280cd tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:03.552576 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2231509c-603f-4cff-9c1a-c8cfec1280cd tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:03.553034 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2231509c-603f-4cff-9c1a-c8cfec1280cd tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:03.553780 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2231509c-603f-4cff-9c1a-c8cfec1280cd tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:03.554255 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2231509c-603f-4cff-9c1a-c8cfec1280cd tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:03.554705 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2231509c-603f-4cff-9c1a-c8cfec1280cd tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:03.731563 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-2231509c-603f-4cff-9c1a-c8cfec1280cd tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ff9e10ea4d64644a0389ebfbf90af00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '031ac4c004ed404ea279cb14ce98f7fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:31:03.739431 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-2231509c-603f-4cff-9c1a-c8cfec1280cd tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] 10.222.0.43 "GET /compute/v2.1/servers/4f9b487c-de25-439c-9340-8f3706de75eb" status: 200 len: 1511 microversion: 2.1 time: 0.197786 Oct 04 19:31:03.740399 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3657/6945] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:31:03 2022] GET /compute/v2.1/servers/4f9b487c-de25-439c-9340-8f3706de75eb => generated 1511 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:31:04.764751 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-f29a12af-8555-45af-b3b0-00299ec8427f tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:31:04.765466 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-f29a12af-8555-45af-b3b0-00299ec8427f tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] [instance: 4f9b487c-de25-439c-9340-8f3706de75eb] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:31:04.772445 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f29a12af-8555-45af-b3b0-00299ec8427f tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:04.772941 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f29a12af-8555-45af-b3b0-00299ec8427f tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:04.773412 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f29a12af-8555-45af-b3b0-00299ec8427f tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:04.774109 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f29a12af-8555-45af-b3b0-00299ec8427f tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:04.774559 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f29a12af-8555-45af-b3b0-00299ec8427f tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:04.774987 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f29a12af-8555-45af-b3b0-00299ec8427f tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:04.912990 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-f29a12af-8555-45af-b3b0-00299ec8427f tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ff9e10ea4d64644a0389ebfbf90af00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '031ac4c004ed404ea279cb14ce98f7fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:31:04.921512 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-f29a12af-8555-45af-b3b0-00299ec8427f tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] 10.222.0.43 "GET /compute/v2.1/servers/4f9b487c-de25-439c-9340-8f3706de75eb" status: 200 len: 1511 microversion: 2.1 time: 0.161586 Oct 04 19:31:04.922090 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3289/6946] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:31:04 2022] GET /compute/v2.1/servers/4f9b487c-de25-439c-9340-8f3706de75eb => generated 1511 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:31:05.944065 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-324e5d11-fbd7-4b99-a981-84226b6ba044 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:31:05.944699 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-324e5d11-fbd7-4b99-a981-84226b6ba044 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] [instance: 4f9b487c-de25-439c-9340-8f3706de75eb] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:31:05.952400 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-324e5d11-fbd7-4b99-a981-84226b6ba044 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:05.952951 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-324e5d11-fbd7-4b99-a981-84226b6ba044 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:05.953437 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-324e5d11-fbd7-4b99-a981-84226b6ba044 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:05.954169 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-324e5d11-fbd7-4b99-a981-84226b6ba044 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:05.954648 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-324e5d11-fbd7-4b99-a981-84226b6ba044 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:05.955121 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-324e5d11-fbd7-4b99-a981-84226b6ba044 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:06.087474 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-324e5d11-fbd7-4b99-a981-84226b6ba044 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ff9e10ea4d64644a0389ebfbf90af00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '031ac4c004ed404ea279cb14ce98f7fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:31:06.095398 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-324e5d11-fbd7-4b99-a981-84226b6ba044 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] 10.222.0.43 "GET /compute/v2.1/servers/4f9b487c-de25-439c-9340-8f3706de75eb" status: 200 len: 1516 microversion: 2.1 time: 0.155414 Oct 04 19:31:06.095975 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3658/6947] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:31:05 2022] GET /compute/v2.1/servers/4f9b487c-de25-439c-9340-8f3706de75eb => generated 1516 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:31:07.118438 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-8fb3064f-bf0c-429c-9c8f-ff8a7957d384 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:31:07.119033 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-8fb3064f-bf0c-429c-9c8f-ff8a7957d384 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] [instance: 4f9b487c-de25-439c-9340-8f3706de75eb] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:31:07.125854 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8fb3064f-bf0c-429c-9c8f-ff8a7957d384 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:07.126335 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8fb3064f-bf0c-429c-9c8f-ff8a7957d384 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:07.126769 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8fb3064f-bf0c-429c-9c8f-ff8a7957d384 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:07.127460 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8fb3064f-bf0c-429c-9c8f-ff8a7957d384 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:07.127910 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8fb3064f-bf0c-429c-9c8f-ff8a7957d384 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:07.128332 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8fb3064f-bf0c-429c-9c8f-ff8a7957d384 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:07.267119 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-8fb3064f-bf0c-429c-9c8f-ff8a7957d384 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ff9e10ea4d64644a0389ebfbf90af00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '031ac4c004ed404ea279cb14ce98f7fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:31:07.274942 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-8fb3064f-bf0c-429c-9c8f-ff8a7957d384 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] 10.222.0.43 "GET /compute/v2.1/servers/4f9b487c-de25-439c-9340-8f3706de75eb" status: 200 len: 1516 microversion: 2.1 time: 0.160377 Oct 04 19:31:07.275527 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3290/6948] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:31:07 2022] GET /compute/v2.1/servers/4f9b487c-de25-439c-9340-8f3706de75eb => generated 1516 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:31:08.299167 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-90099f32-c388-45a8-b83d-a045fc815f5f tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:31:08.299736 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-90099f32-c388-45a8-b83d-a045fc815f5f tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] [instance: 4f9b487c-de25-439c-9340-8f3706de75eb] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:31:08.306623 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-90099f32-c388-45a8-b83d-a045fc815f5f tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:08.307129 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-90099f32-c388-45a8-b83d-a045fc815f5f tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:08.307590 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-90099f32-c388-45a8-b83d-a045fc815f5f tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:08.308300 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-90099f32-c388-45a8-b83d-a045fc815f5f tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:08.308778 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-90099f32-c388-45a8-b83d-a045fc815f5f tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:08.309256 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-90099f32-c388-45a8-b83d-a045fc815f5f tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:08.451607 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-90099f32-c388-45a8-b83d-a045fc815f5f tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ff9e10ea4d64644a0389ebfbf90af00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '031ac4c004ed404ea279cb14ce98f7fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:31:08.459445 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-90099f32-c388-45a8-b83d-a045fc815f5f tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] 10.222.0.43 "GET /compute/v2.1/servers/4f9b487c-de25-439c-9340-8f3706de75eb" status: 200 len: 1516 microversion: 2.1 time: 0.164300 Oct 04 19:31:08.460028 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3659/6949] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:31:08 2022] GET /compute/v2.1/servers/4f9b487c-de25-439c-9340-8f3706de75eb => generated 1516 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:31:09.483795 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-89442f05-9bd1-4320-a04d-9a50cfd5151b tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:31:09.484415 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-89442f05-9bd1-4320-a04d-9a50cfd5151b tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] [instance: 4f9b487c-de25-439c-9340-8f3706de75eb] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:31:09.491197 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-89442f05-9bd1-4320-a04d-9a50cfd5151b tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:09.491675 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-89442f05-9bd1-4320-a04d-9a50cfd5151b tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:09.492109 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-89442f05-9bd1-4320-a04d-9a50cfd5151b tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:09.492797 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-89442f05-9bd1-4320-a04d-9a50cfd5151b tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:09.493269 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-89442f05-9bd1-4320-a04d-9a50cfd5151b tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:09.493693 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-89442f05-9bd1-4320-a04d-9a50cfd5151b tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:09.622883 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-89442f05-9bd1-4320-a04d-9a50cfd5151b tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ff9e10ea4d64644a0389ebfbf90af00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '031ac4c004ed404ea279cb14ce98f7fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:31:09.630678 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-89442f05-9bd1-4320-a04d-9a50cfd5151b tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] 10.222.0.43 "GET /compute/v2.1/servers/4f9b487c-de25-439c-9340-8f3706de75eb" status: 200 len: 1516 microversion: 2.1 time: 0.150732 Oct 04 19:31:09.631244 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3291/6950] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:31:09 2022] GET /compute/v2.1/servers/4f9b487c-de25-439c-9340-8f3706de75eb => generated 1516 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:31:10.654181 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-ac58a425-2e53-4e6c-a9a7-6c3324bb14ab tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:31:10.654954 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-ac58a425-2e53-4e6c-a9a7-6c3324bb14ab tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] [instance: 4f9b487c-de25-439c-9340-8f3706de75eb] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:31:10.661921 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ac58a425-2e53-4e6c-a9a7-6c3324bb14ab tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:10.662432 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ac58a425-2e53-4e6c-a9a7-6c3324bb14ab tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:10.662893 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ac58a425-2e53-4e6c-a9a7-6c3324bb14ab tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:10.663612 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ac58a425-2e53-4e6c-a9a7-6c3324bb14ab tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:10.664090 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ac58a425-2e53-4e6c-a9a7-6c3324bb14ab tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:10.664540 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ac58a425-2e53-4e6c-a9a7-6c3324bb14ab tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:10.796841 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-ac58a425-2e53-4e6c-a9a7-6c3324bb14ab tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ff9e10ea4d64644a0389ebfbf90af00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '031ac4c004ed404ea279cb14ce98f7fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:31:10.804623 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-ac58a425-2e53-4e6c-a9a7-6c3324bb14ab tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] 10.222.0.43 "GET /compute/v2.1/servers/4f9b487c-de25-439c-9340-8f3706de75eb" status: 200 len: 1516 microversion: 2.1 time: 0.154440 Oct 04 19:31:10.805223 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3660/6951] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:31:10 2022] GET /compute/v2.1/servers/4f9b487c-de25-439c-9340-8f3706de75eb => generated 1516 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:31:11.829071 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-7d8911d2-2234-4d52-bd87-a4f64e2469b2 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:31:11.829720 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-7d8911d2-2234-4d52-bd87-a4f64e2469b2 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] [instance: 4f9b487c-de25-439c-9340-8f3706de75eb] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:31:11.836630 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7d8911d2-2234-4d52-bd87-a4f64e2469b2 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:11.837131 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7d8911d2-2234-4d52-bd87-a4f64e2469b2 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:11.837601 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7d8911d2-2234-4d52-bd87-a4f64e2469b2 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:11.838305 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7d8911d2-2234-4d52-bd87-a4f64e2469b2 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:11.838767 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7d8911d2-2234-4d52-bd87-a4f64e2469b2 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:11.839797 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7d8911d2-2234-4d52-bd87-a4f64e2469b2 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:11.979152 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-7d8911d2-2234-4d52-bd87-a4f64e2469b2 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ff9e10ea4d64644a0389ebfbf90af00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '031ac4c004ed404ea279cb14ce98f7fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:31:11.988489 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-7d8911d2-2234-4d52-bd87-a4f64e2469b2 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] 10.222.0.43 "GET /compute/v2.1/servers/4f9b487c-de25-439c-9340-8f3706de75eb" status: 200 len: 1516 microversion: 2.1 time: 0.163350 Oct 04 19:31:11.989188 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3292/6952] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:31:11 2022] GET /compute/v2.1/servers/4f9b487c-de25-439c-9340-8f3706de75eb => generated 1516 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:31:13.013025 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-7c293411-63a0-43ec-81c0-e647527b895f tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:31:13.013676 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-7c293411-63a0-43ec-81c0-e647527b895f tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] [instance: 4f9b487c-de25-439c-9340-8f3706de75eb] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:31:13.020337 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7c293411-63a0-43ec-81c0-e647527b895f tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:13.020842 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7c293411-63a0-43ec-81c0-e647527b895f tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:13.021329 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7c293411-63a0-43ec-81c0-e647527b895f tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:13.022035 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7c293411-63a0-43ec-81c0-e647527b895f tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:13.022507 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7c293411-63a0-43ec-81c0-e647527b895f tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:13.022953 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7c293411-63a0-43ec-81c0-e647527b895f tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:13.154434 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-7c293411-63a0-43ec-81c0-e647527b895f tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ff9e10ea4d64644a0389ebfbf90af00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '031ac4c004ed404ea279cb14ce98f7fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:31:13.162165 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-7c293411-63a0-43ec-81c0-e647527b895f tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] 10.222.0.43 "GET /compute/v2.1/servers/4f9b487c-de25-439c-9340-8f3706de75eb" status: 200 len: 1516 microversion: 2.1 time: 0.153619 Oct 04 19:31:13.162739 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3661/6953] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:31:13 2022] GET /compute/v2.1/servers/4f9b487c-de25-439c-9340-8f3706de75eb => generated 1516 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:31:14.185526 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-94a0d355-3ed6-4580-a53c-6b53cf03a6ee tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:31:14.186149 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-94a0d355-3ed6-4580-a53c-6b53cf03a6ee tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] [instance: 4f9b487c-de25-439c-9340-8f3706de75eb] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:31:14.193232 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-94a0d355-3ed6-4580-a53c-6b53cf03a6ee tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:14.193721 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-94a0d355-3ed6-4580-a53c-6b53cf03a6ee tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:14.194165 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-94a0d355-3ed6-4580-a53c-6b53cf03a6ee tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:14.194862 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-94a0d355-3ed6-4580-a53c-6b53cf03a6ee tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:14.195321 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-94a0d355-3ed6-4580-a53c-6b53cf03a6ee tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:14.195756 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-94a0d355-3ed6-4580-a53c-6b53cf03a6ee tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:14.324263 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-94a0d355-3ed6-4580-a53c-6b53cf03a6ee tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ff9e10ea4d64644a0389ebfbf90af00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '031ac4c004ed404ea279cb14ce98f7fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:31:14.332363 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-94a0d355-3ed6-4580-a53c-6b53cf03a6ee tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] 10.222.0.43 "GET /compute/v2.1/servers/4f9b487c-de25-439c-9340-8f3706de75eb" status: 200 len: 1516 microversion: 2.1 time: 0.151413 Oct 04 19:31:14.332946 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3293/6954] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:31:14 2022] GET /compute/v2.1/servers/4f9b487c-de25-439c-9340-8f3706de75eb => generated 1516 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:31:15.355597 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-62362540-ef64-45fc-9c69-5795c087d62f tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:31:15.356346 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-62362540-ef64-45fc-9c69-5795c087d62f tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] [instance: 4f9b487c-de25-439c-9340-8f3706de75eb] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:31:15.363383 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-62362540-ef64-45fc-9c69-5795c087d62f tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:15.363892 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-62362540-ef64-45fc-9c69-5795c087d62f tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:15.364355 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-62362540-ef64-45fc-9c69-5795c087d62f tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:15.365075 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-62362540-ef64-45fc-9c69-5795c087d62f tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:15.365578 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-62362540-ef64-45fc-9c69-5795c087d62f tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:15.366045 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-62362540-ef64-45fc-9c69-5795c087d62f tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:15.500077 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-62362540-ef64-45fc-9c69-5795c087d62f tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ff9e10ea4d64644a0389ebfbf90af00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '031ac4c004ed404ea279cb14ce98f7fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:31:15.508021 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-62362540-ef64-45fc-9c69-5795c087d62f tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] 10.222.0.43 "GET /compute/v2.1/servers/4f9b487c-de25-439c-9340-8f3706de75eb" status: 200 len: 1516 microversion: 2.1 time: 0.156362 Oct 04 19:31:15.508599 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3662/6955] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:31:15 2022] GET /compute/v2.1/servers/4f9b487c-de25-439c-9340-8f3706de75eb => generated 1516 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:31:16.532203 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-acd69633-78df-4d79-a0ed-d26283395215 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:31:16.532814 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-acd69633-78df-4d79-a0ed-d26283395215 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] [instance: 4f9b487c-de25-439c-9340-8f3706de75eb] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:31:16.541778 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-acd69633-78df-4d79-a0ed-d26283395215 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:16.542260 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-acd69633-78df-4d79-a0ed-d26283395215 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:16.542695 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-acd69633-78df-4d79-a0ed-d26283395215 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:16.543380 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-acd69633-78df-4d79-a0ed-d26283395215 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:16.543830 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-acd69633-78df-4d79-a0ed-d26283395215 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:16.544253 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-acd69633-78df-4d79-a0ed-d26283395215 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:16.674775 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-acd69633-78df-4d79-a0ed-d26283395215 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ff9e10ea4d64644a0389ebfbf90af00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '031ac4c004ed404ea279cb14ce98f7fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:31:16.682607 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-acd69633-78df-4d79-a0ed-d26283395215 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] 10.222.0.43 "GET /compute/v2.1/servers/4f9b487c-de25-439c-9340-8f3706de75eb" status: 200 len: 1516 microversion: 2.1 time: 0.154274 Oct 04 19:31:16.683256 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3294/6956] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:31:16 2022] GET /compute/v2.1/servers/4f9b487c-de25-439c-9340-8f3706de75eb => generated 1516 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:31:17.706492 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-a0ee7d45-30d6-41b1-bbf6-97a9dc8199ed tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:31:17.707223 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-a0ee7d45-30d6-41b1-bbf6-97a9dc8199ed tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] [instance: 4f9b487c-de25-439c-9340-8f3706de75eb] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:31:17.714376 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a0ee7d45-30d6-41b1-bbf6-97a9dc8199ed tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:17.714886 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a0ee7d45-30d6-41b1-bbf6-97a9dc8199ed tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:17.715347 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a0ee7d45-30d6-41b1-bbf6-97a9dc8199ed tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:17.716066 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a0ee7d45-30d6-41b1-bbf6-97a9dc8199ed tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:17.716541 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a0ee7d45-30d6-41b1-bbf6-97a9dc8199ed tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:17.716990 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a0ee7d45-30d6-41b1-bbf6-97a9dc8199ed tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:17.854222 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-a0ee7d45-30d6-41b1-bbf6-97a9dc8199ed tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ff9e10ea4d64644a0389ebfbf90af00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '031ac4c004ed404ea279cb14ce98f7fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:31:17.863047 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-a0ee7d45-30d6-41b1-bbf6-97a9dc8199ed tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] 10.222.0.43 "GET /compute/v2.1/servers/4f9b487c-de25-439c-9340-8f3706de75eb" status: 200 len: 1516 microversion: 2.1 time: 0.161141 Oct 04 19:31:17.863989 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3663/6957] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:31:17 2022] GET /compute/v2.1/servers/4f9b487c-de25-439c-9340-8f3706de75eb => generated 1516 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:31:18.885956 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-af62bc06-9797-4ec7-aabb-b52a8beda46a tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:31:18.886611 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-af62bc06-9797-4ec7-aabb-b52a8beda46a tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] [instance: 4f9b487c-de25-439c-9340-8f3706de75eb] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:31:18.893514 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-af62bc06-9797-4ec7-aabb-b52a8beda46a tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:18.894036 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-af62bc06-9797-4ec7-aabb-b52a8beda46a tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:18.894636 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-af62bc06-9797-4ec7-aabb-b52a8beda46a tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:18.895424 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-af62bc06-9797-4ec7-aabb-b52a8beda46a tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:18.895887 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-af62bc06-9797-4ec7-aabb-b52a8beda46a tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:18.896321 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-af62bc06-9797-4ec7-aabb-b52a8beda46a tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:19.035085 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-af62bc06-9797-4ec7-aabb-b52a8beda46a tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ff9e10ea4d64644a0389ebfbf90af00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '031ac4c004ed404ea279cb14ce98f7fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:31:19.043001 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-af62bc06-9797-4ec7-aabb-b52a8beda46a tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] 10.222.0.43 "GET /compute/v2.1/servers/4f9b487c-de25-439c-9340-8f3706de75eb" status: 200 len: 1516 microversion: 2.1 time: 0.161426 Oct 04 19:31:19.043585 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3295/6958] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:31:18 2022] GET /compute/v2.1/servers/4f9b487c-de25-439c-9340-8f3706de75eb => generated 1516 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:31:20.066116 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-d96180d2-19bd-45fa-8f20-0563ee362ff2 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:31:20.066882 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-d96180d2-19bd-45fa-8f20-0563ee362ff2 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] [instance: 4f9b487c-de25-439c-9340-8f3706de75eb] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:31:20.076706 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d96180d2-19bd-45fa-8f20-0563ee362ff2 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:20.077240 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d96180d2-19bd-45fa-8f20-0563ee362ff2 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:20.077712 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d96180d2-19bd-45fa-8f20-0563ee362ff2 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:20.078429 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d96180d2-19bd-45fa-8f20-0563ee362ff2 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:20.078905 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d96180d2-19bd-45fa-8f20-0563ee362ff2 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:20.079355 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d96180d2-19bd-45fa-8f20-0563ee362ff2 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:20.214661 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-d96180d2-19bd-45fa-8f20-0563ee362ff2 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ff9e10ea4d64644a0389ebfbf90af00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '031ac4c004ed404ea279cb14ce98f7fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:31:20.222951 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-d96180d2-19bd-45fa-8f20-0563ee362ff2 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] 10.222.0.43 "GET /compute/v2.1/servers/4f9b487c-de25-439c-9340-8f3706de75eb" status: 200 len: 1516 microversion: 2.1 time: 0.160891 Oct 04 19:31:20.223529 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3664/6959] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:31:20 2022] GET /compute/v2.1/servers/4f9b487c-de25-439c-9340-8f3706de75eb => generated 1516 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:31:21.246346 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-278faf3d-efd0-401f-a4bf-061ce764a77c tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:31:21.246988 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-278faf3d-efd0-401f-a4bf-061ce764a77c tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] [instance: 4f9b487c-de25-439c-9340-8f3706de75eb] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:31:21.254145 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-278faf3d-efd0-401f-a4bf-061ce764a77c tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:21.254633 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-278faf3d-efd0-401f-a4bf-061ce764a77c tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:21.255074 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-278faf3d-efd0-401f-a4bf-061ce764a77c tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:21.255767 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-278faf3d-efd0-401f-a4bf-061ce764a77c tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:21.256220 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-278faf3d-efd0-401f-a4bf-061ce764a77c tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:21.257027 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-278faf3d-efd0-401f-a4bf-061ce764a77c tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:21.392184 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-278faf3d-efd0-401f-a4bf-061ce764a77c tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ff9e10ea4d64644a0389ebfbf90af00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '031ac4c004ed404ea279cb14ce98f7fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:31:21.400726 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-278faf3d-efd0-401f-a4bf-061ce764a77c tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] 10.222.0.43 "GET /compute/v2.1/servers/4f9b487c-de25-439c-9340-8f3706de75eb" status: 200 len: 1516 microversion: 2.1 time: 0.158215 Oct 04 19:31:21.401368 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3296/6960] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:31:21 2022] GET /compute/v2.1/servers/4f9b487c-de25-439c-9340-8f3706de75eb => generated 1516 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:31:22.423908 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-15c85e15-f060-4598-ae6d-1e880912c91b tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:31:22.424534 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-15c85e15-f060-4598-ae6d-1e880912c91b tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] [instance: 4f9b487c-de25-439c-9340-8f3706de75eb] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:31:22.431535 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-15c85e15-f060-4598-ae6d-1e880912c91b tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:22.432034 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-15c85e15-f060-4598-ae6d-1e880912c91b tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:22.432989 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-15c85e15-f060-4598-ae6d-1e880912c91b tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:22.433718 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-15c85e15-f060-4598-ae6d-1e880912c91b tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:22.434190 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-15c85e15-f060-4598-ae6d-1e880912c91b tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:22.434631 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-15c85e15-f060-4598-ae6d-1e880912c91b tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:22.573323 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-15c85e15-f060-4598-ae6d-1e880912c91b tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ff9e10ea4d64644a0389ebfbf90af00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '031ac4c004ed404ea279cb14ce98f7fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:31:22.581149 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-15c85e15-f060-4598-ae6d-1e880912c91b tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] 10.222.0.43 "GET /compute/v2.1/servers/4f9b487c-de25-439c-9340-8f3706de75eb" status: 200 len: 1516 microversion: 2.1 time: 0.161149 Oct 04 19:31:22.581724 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3665/6961] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:31:22 2022] GET /compute/v2.1/servers/4f9b487c-de25-439c-9340-8f3706de75eb => generated 1516 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:31:23.604867 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-e67f1d19-c3e1-46dc-ac0a-87366a458682 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:31:23.605572 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-e67f1d19-c3e1-46dc-ac0a-87366a458682 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] [instance: 4f9b487c-de25-439c-9340-8f3706de75eb] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:31:23.613684 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e67f1d19-c3e1-46dc-ac0a-87366a458682 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:23.614174 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e67f1d19-c3e1-46dc-ac0a-87366a458682 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:23.614615 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e67f1d19-c3e1-46dc-ac0a-87366a458682 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:23.615322 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e67f1d19-c3e1-46dc-ac0a-87366a458682 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:23.615777 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e67f1d19-c3e1-46dc-ac0a-87366a458682 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:23.616211 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e67f1d19-c3e1-46dc-ac0a-87366a458682 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:23.751338 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-e67f1d19-c3e1-46dc-ac0a-87366a458682 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ff9e10ea4d64644a0389ebfbf90af00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '031ac4c004ed404ea279cb14ce98f7fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:31:23.759596 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-e67f1d19-c3e1-46dc-ac0a-87366a458682 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] 10.222.0.43 "GET /compute/v2.1/servers/4f9b487c-de25-439c-9340-8f3706de75eb" status: 200 len: 1516 microversion: 2.1 time: 0.158861 Oct 04 19:31:23.760189 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3297/6962] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:31:23 2022] GET /compute/v2.1/servers/4f9b487c-de25-439c-9340-8f3706de75eb => generated 1516 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:31:24.783216 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-455d9d7d-af39-4e11-8b5f-8aeb7926a6b6 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:31:24.783840 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-455d9d7d-af39-4e11-8b5f-8aeb7926a6b6 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] [instance: 4f9b487c-de25-439c-9340-8f3706de75eb] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:31:24.791430 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-455d9d7d-af39-4e11-8b5f-8aeb7926a6b6 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:24.791925 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-455d9d7d-af39-4e11-8b5f-8aeb7926a6b6 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:24.792376 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-455d9d7d-af39-4e11-8b5f-8aeb7926a6b6 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:24.793077 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-455d9d7d-af39-4e11-8b5f-8aeb7926a6b6 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:24.793635 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-455d9d7d-af39-4e11-8b5f-8aeb7926a6b6 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:24.794072 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-455d9d7d-af39-4e11-8b5f-8aeb7926a6b6 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:24.924672 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-455d9d7d-af39-4e11-8b5f-8aeb7926a6b6 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ff9e10ea4d64644a0389ebfbf90af00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '031ac4c004ed404ea279cb14ce98f7fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:31:24.932471 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-455d9d7d-af39-4e11-8b5f-8aeb7926a6b6 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] 10.222.0.43 "GET /compute/v2.1/servers/4f9b487c-de25-439c-9340-8f3706de75eb" status: 200 len: 1516 microversion: 2.1 time: 0.153227 Oct 04 19:31:24.933041 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3666/6963] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:31:24 2022] GET /compute/v2.1/servers/4f9b487c-de25-439c-9340-8f3706de75eb => generated 1516 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:31:25.955311 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-8abfb3e0-231b-42bd-bc22-f10356aa5a1a tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:31:25.955951 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-8abfb3e0-231b-42bd-bc22-f10356aa5a1a tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] [instance: 4f9b487c-de25-439c-9340-8f3706de75eb] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:31:25.963614 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8abfb3e0-231b-42bd-bc22-f10356aa5a1a tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:25.964199 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8abfb3e0-231b-42bd-bc22-f10356aa5a1a tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:25.964642 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8abfb3e0-231b-42bd-bc22-f10356aa5a1a tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:25.965367 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8abfb3e0-231b-42bd-bc22-f10356aa5a1a tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:25.965829 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8abfb3e0-231b-42bd-bc22-f10356aa5a1a tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:25.966264 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8abfb3e0-231b-42bd-bc22-f10356aa5a1a tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:26.096434 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-8abfb3e0-231b-42bd-bc22-f10356aa5a1a tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ff9e10ea4d64644a0389ebfbf90af00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '031ac4c004ed404ea279cb14ce98f7fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:31:26.104371 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-8abfb3e0-231b-42bd-bc22-f10356aa5a1a tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] 10.222.0.43 "GET /compute/v2.1/servers/4f9b487c-de25-439c-9340-8f3706de75eb" status: 200 len: 1516 microversion: 2.1 time: 0.152979 Oct 04 19:31:26.104942 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3298/6964] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:31:25 2022] GET /compute/v2.1/servers/4f9b487c-de25-439c-9340-8f3706de75eb => generated 1516 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:31:27.127286 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-11715b78-f7c4-4b34-8d6e-30d92db39181 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:31:27.127954 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-11715b78-f7c4-4b34-8d6e-30d92db39181 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] [instance: 4f9b487c-de25-439c-9340-8f3706de75eb] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:31:27.135547 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-11715b78-f7c4-4b34-8d6e-30d92db39181 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:27.136055 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-11715b78-f7c4-4b34-8d6e-30d92db39181 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:27.136514 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-11715b78-f7c4-4b34-8d6e-30d92db39181 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:27.137260 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-11715b78-f7c4-4b34-8d6e-30d92db39181 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:27.137735 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-11715b78-f7c4-4b34-8d6e-30d92db39181 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:27.138183 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-11715b78-f7c4-4b34-8d6e-30d92db39181 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:27.269975 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-11715b78-f7c4-4b34-8d6e-30d92db39181 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ff9e10ea4d64644a0389ebfbf90af00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '031ac4c004ed404ea279cb14ce98f7fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:31:27.278481 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-11715b78-f7c4-4b34-8d6e-30d92db39181 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] 10.222.0.43 "GET /compute/v2.1/servers/4f9b487c-de25-439c-9340-8f3706de75eb" status: 200 len: 1516 microversion: 2.1 time: 0.155193 Oct 04 19:31:27.279067 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3667/6965] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:31:27 2022] GET /compute/v2.1/servers/4f9b487c-de25-439c-9340-8f3706de75eb => generated 1516 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:31:28.302101 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-ac5c5322-71d3-4313-8a31-e8ade8b85945 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:31:28.302634 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-ac5c5322-71d3-4313-8a31-e8ade8b85945 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] [instance: 4f9b487c-de25-439c-9340-8f3706de75eb] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:31:28.310460 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ac5c5322-71d3-4313-8a31-e8ade8b85945 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:28.310943 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ac5c5322-71d3-4313-8a31-e8ade8b85945 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:28.311387 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ac5c5322-71d3-4313-8a31-e8ade8b85945 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:28.312077 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ac5c5322-71d3-4313-8a31-e8ade8b85945 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:28.312529 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ac5c5322-71d3-4313-8a31-e8ade8b85945 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:28.312961 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ac5c5322-71d3-4313-8a31-e8ade8b85945 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:28.440864 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-ac5c5322-71d3-4313-8a31-e8ade8b85945 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ff9e10ea4d64644a0389ebfbf90af00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '031ac4c004ed404ea279cb14ce98f7fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:31:28.449245 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-ac5c5322-71d3-4313-8a31-e8ade8b85945 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] 10.222.0.43 "GET /compute/v2.1/servers/4f9b487c-de25-439c-9340-8f3706de75eb" status: 200 len: 1516 microversion: 2.1 time: 0.151472 Oct 04 19:31:28.449819 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3299/6966] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:31:28 2022] GET /compute/v2.1/servers/4f9b487c-de25-439c-9340-8f3706de75eb => generated 1516 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:31:29.472644 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-5db582af-9283-4ee0-8328-bd6ba700a1c6 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:31:29.473359 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-5db582af-9283-4ee0-8328-bd6ba700a1c6 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] [instance: 4f9b487c-de25-439c-9340-8f3706de75eb] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:31:29.476252 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_api:SELECT=28 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:31:29.482170 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5db582af-9283-4ee0-8328-bd6ba700a1c6 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:29.482674 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5db582af-9283-4ee0-8328-bd6ba700a1c6 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:29.483130 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5db582af-9283-4ee0-8328-bd6ba700a1c6 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:29.483843 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5db582af-9283-4ee0-8328-bd6ba700a1c6 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:29.484314 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5db582af-9283-4ee0-8328-bd6ba700a1c6 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:29.484761 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5db582af-9283-4ee0-8328-bd6ba700a1c6 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:29.489010 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=84 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:31:29.615859 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-5db582af-9283-4ee0-8328-bd6ba700a1c6 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ff9e10ea4d64644a0389ebfbf90af00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '031ac4c004ed404ea279cb14ce98f7fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:31:29.623646 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-5db582af-9283-4ee0-8328-bd6ba700a1c6 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] 10.222.0.43 "GET /compute/v2.1/servers/4f9b487c-de25-439c-9340-8f3706de75eb" status: 200 len: 1516 microversion: 2.1 time: 0.155068 Oct 04 19:31:29.624219 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3668/6967] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:31:29 2022] GET /compute/v2.1/servers/4f9b487c-de25-439c-9340-8f3706de75eb => generated 1516 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:31:30.646665 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-3de5256b-f3dc-4b0e-830d-b5c47571a1f9 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:31:30.647301 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-3de5256b-f3dc-4b0e-830d-b5c47571a1f9 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] [instance: 4f9b487c-de25-439c-9340-8f3706de75eb] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:31:30.650099 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_api:SELECT=34 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:31:30.656043 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3de5256b-f3dc-4b0e-830d-b5c47571a1f9 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:30.656462 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3de5256b-f3dc-4b0e-830d-b5c47571a1f9 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:30.656897 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3de5256b-f3dc-4b0e-830d-b5c47571a1f9 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:30.657618 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3de5256b-f3dc-4b0e-830d-b5c47571a1f9 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:30.658067 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3de5256b-f3dc-4b0e-830d-b5c47571a1f9 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:30.658489 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3de5256b-f3dc-4b0e-830d-b5c47571a1f9 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:30.661040 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:31:30.792626 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-3de5256b-f3dc-4b0e-830d-b5c47571a1f9 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ff9e10ea4d64644a0389ebfbf90af00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '031ac4c004ed404ea279cb14ce98f7fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:31:30.800287 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-3de5256b-f3dc-4b0e-830d-b5c47571a1f9 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] 10.222.0.43 "GET /compute/v2.1/servers/4f9b487c-de25-439c-9340-8f3706de75eb" status: 200 len: 1516 microversion: 2.1 time: 0.157537 Oct 04 19:31:30.800867 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3300/6968] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:31:30 2022] GET /compute/v2.1/servers/4f9b487c-de25-439c-9340-8f3706de75eb => generated 1516 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:31:31.823785 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-44740ef1-0c57-4815-97f5-529d30c8ed04 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:31:31.824412 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-44740ef1-0c57-4815-97f5-529d30c8ed04 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] [instance: 4f9b487c-de25-439c-9340-8f3706de75eb] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:31:31.831315 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-44740ef1-0c57-4815-97f5-529d30c8ed04 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:31.831818 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-44740ef1-0c57-4815-97f5-529d30c8ed04 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:31.832262 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-44740ef1-0c57-4815-97f5-529d30c8ed04 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:31.832970 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-44740ef1-0c57-4815-97f5-529d30c8ed04 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:31.833459 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-44740ef1-0c57-4815-97f5-529d30c8ed04 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:31.833902 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-44740ef1-0c57-4815-97f5-529d30c8ed04 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:31.966479 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-44740ef1-0c57-4815-97f5-529d30c8ed04 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ff9e10ea4d64644a0389ebfbf90af00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '031ac4c004ed404ea279cb14ce98f7fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:31:31.974600 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-44740ef1-0c57-4815-97f5-529d30c8ed04 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] 10.222.0.43 "GET /compute/v2.1/servers/4f9b487c-de25-439c-9340-8f3706de75eb" status: 200 len: 1516 microversion: 2.1 time: 0.155186 Oct 04 19:31:31.975180 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3669/6969] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:31:31 2022] GET /compute/v2.1/servers/4f9b487c-de25-439c-9340-8f3706de75eb => generated 1516 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:31:32.998880 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-9902ca3d-0245-4272-b422-f1eccba38920 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:31:32.999710 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-9902ca3d-0245-4272-b422-f1eccba38920 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] [instance: 4f9b487c-de25-439c-9340-8f3706de75eb] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:31:33.007417 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9902ca3d-0245-4272-b422-f1eccba38920 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:33.007904 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9902ca3d-0245-4272-b422-f1eccba38920 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:33.008341 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9902ca3d-0245-4272-b422-f1eccba38920 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:33.009085 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9902ca3d-0245-4272-b422-f1eccba38920 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:33.009673 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9902ca3d-0245-4272-b422-f1eccba38920 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:33.010110 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9902ca3d-0245-4272-b422-f1eccba38920 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:33.068438 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-d36e154a-6fab-4428-8699-482d2d1ade4f req-e212ac46-a17a-4dff-82e7-58baf4cf57f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f9b487c-de25-439c-9340-8f3706de75eb", "name": "network-vif-unplugged", "status": "completed", "tag": "66223cd4-9d17-4f9b-b5a1-9135f78e3972"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:31:33.078953 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-d36e154a-6fab-4428-8699-482d2d1ade4f req-e212ac46-a17a-4dff-82e7-58baf4cf57f9 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:33.079595 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-d36e154a-6fab-4428-8699-482d2d1ade4f req-e212ac46-a17a-4dff-82e7-58baf4cf57f9 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:33.080252 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-d36e154a-6fab-4428-8699-482d2d1ade4f req-e212ac46-a17a-4dff-82e7-58baf4cf57f9 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:33.093931 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-d36e154a-6fab-4428-8699-482d2d1ade4f req-e212ac46-a17a-4dff-82e7-58baf4cf57f9 service nova] Creating event network-vif-unplugged:66223cd4-9d17-4f9b-b5a1-9135f78e3972 for instance 4f9b487c-de25-439c-9340-8f3706de75eb on n-h1-851028-13 Oct 04 19:31:33.101385 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [req-d36e154a-6fab-4428-8699-482d2d1ade4f req-e212ac46-a17a-4dff-82e7-58baf4cf57f9 service nova] Instance 4f9b487c-de25-439c-9340-8f3706de75eb is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851028-13', 'n-h2-851028-13'} {{(pid=123596) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 19:31:33.116952 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-d36e154a-6fab-4428-8699-482d2d1ade4f req-e212ac46-a17a-4dff-82e7-58baf4cf57f9 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.051973 Oct 04 19:31:33.117578 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3670/6970] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:31:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:31:33.230861 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-9902ca3d-0245-4272-b422-f1eccba38920 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ff9e10ea4d64644a0389ebfbf90af00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '031ac4c004ed404ea279cb14ce98f7fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:31:33.238934 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-9902ca3d-0245-4272-b422-f1eccba38920 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] 10.222.0.43 "GET /compute/v2.1/servers/4f9b487c-de25-439c-9340-8f3706de75eb" status: 200 len: 1515 microversion: 2.1 time: 0.244522 Oct 04 19:31:33.239519 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3301/6971] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:31:32 2022] GET /compute/v2.1/servers/4f9b487c-de25-439c-9340-8f3706de75eb => generated 1515 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:31:34.264772 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-7fdb6c93-4c99-48b6-97b8-7c46c1beb567 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:31:34.265513 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-7fdb6c93-4c99-48b6-97b8-7c46c1beb567 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] [instance: 4f9b487c-de25-439c-9340-8f3706de75eb] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:31:34.271756 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7fdb6c93-4c99-48b6-97b8-7c46c1beb567 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:34.272258 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7fdb6c93-4c99-48b6-97b8-7c46c1beb567 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:34.272711 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7fdb6c93-4c99-48b6-97b8-7c46c1beb567 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:34.273453 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7fdb6c93-4c99-48b6-97b8-7c46c1beb567 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:34.273923 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7fdb6c93-4c99-48b6-97b8-7c46c1beb567 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:34.274366 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7fdb6c93-4c99-48b6-97b8-7c46c1beb567 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:34.410630 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-7fdb6c93-4c99-48b6-97b8-7c46c1beb567 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ff9e10ea4d64644a0389ebfbf90af00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '031ac4c004ed404ea279cb14ce98f7fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:31:34.419104 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-7fdb6c93-4c99-48b6-97b8-7c46c1beb567 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] 10.222.0.43 "GET /compute/v2.1/servers/4f9b487c-de25-439c-9340-8f3706de75eb" status: 200 len: 1513 microversion: 2.1 time: 0.159535 Oct 04 19:31:34.419694 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3671/6972] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:31:34 2022] GET /compute/v2.1/servers/4f9b487c-de25-439c-9340-8f3706de75eb => generated 1513 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:31:35.134099 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-cfe10728-69aa-4203-a6db-1a31996c8801 req-d1ada7d4-58cc-4e4c-bf33-1683f046a9f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f9b487c-de25-439c-9340-8f3706de75eb", "tag": "66223cd4-9d17-4f9b-b5a1-9135f78e3972"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:31:35.144430 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-cfe10728-69aa-4203-a6db-1a31996c8801 req-d1ada7d4-58cc-4e4c-bf33-1683f046a9f0 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:35.144907 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-cfe10728-69aa-4203-a6db-1a31996c8801 req-d1ada7d4-58cc-4e4c-bf33-1683f046a9f0 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:35.145375 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-cfe10728-69aa-4203-a6db-1a31996c8801 req-d1ada7d4-58cc-4e4c-bf33-1683f046a9f0 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:35.157310 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-cfe10728-69aa-4203-a6db-1a31996c8801 req-d1ada7d4-58cc-4e4c-bf33-1683f046a9f0 service nova] Creating event network-changed:66223cd4-9d17-4f9b-b5a1-9135f78e3972 for instance 4f9b487c-de25-439c-9340-8f3706de75eb on n-h1-851028-13 Oct 04 19:31:35.163089 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [req-cfe10728-69aa-4203-a6db-1a31996c8801 req-d1ada7d4-58cc-4e4c-bf33-1683f046a9f0 service nova] Instance 4f9b487c-de25-439c-9340-8f3706de75eb is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851028-13', 'n-h2-851028-13'} {{(pid=123595) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 19:31:35.174401 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-cfe10728-69aa-4203-a6db-1a31996c8801 req-d1ada7d4-58cc-4e4c-bf33-1683f046a9f0 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044023 Oct 04 19:31:35.175198 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3302/6973] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:31:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:31:35.442887 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-5a87b102-31b8-4f83-9add-c024f1bc45b5 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:31:35.443669 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-5a87b102-31b8-4f83-9add-c024f1bc45b5 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] [instance: 4f9b487c-de25-439c-9340-8f3706de75eb] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:31:35.451938 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5a87b102-31b8-4f83-9add-c024f1bc45b5 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:35.452550 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5a87b102-31b8-4f83-9add-c024f1bc45b5 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:35.453273 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5a87b102-31b8-4f83-9add-c024f1bc45b5 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:35.454071 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5a87b102-31b8-4f83-9add-c024f1bc45b5 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:35.454759 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5a87b102-31b8-4f83-9add-c024f1bc45b5 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:35.455364 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5a87b102-31b8-4f83-9add-c024f1bc45b5 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:35.606498 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-5a87b102-31b8-4f83-9add-c024f1bc45b5 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ff9e10ea4d64644a0389ebfbf90af00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '031ac4c004ed404ea279cb14ce98f7fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:31:35.615156 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-5a87b102-31b8-4f83-9add-c024f1bc45b5 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] 10.222.0.43 "GET /compute/v2.1/servers/4f9b487c-de25-439c-9340-8f3706de75eb" status: 200 len: 1513 microversion: 2.1 time: 0.176142 Oct 04 19:31:35.615985 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3672/6974] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:31:35 2022] GET /compute/v2.1/servers/4f9b487c-de25-439c-9340-8f3706de75eb => generated 1513 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:31:36.640489 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-c4092aed-b7e4-4164-8a0a-d2a390644a60 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:31:36.641225 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-c4092aed-b7e4-4164-8a0a-d2a390644a60 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] [instance: 4f9b487c-de25-439c-9340-8f3706de75eb] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:31:36.650746 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c4092aed-b7e4-4164-8a0a-d2a390644a60 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:36.651646 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c4092aed-b7e4-4164-8a0a-d2a390644a60 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:36.652452 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c4092aed-b7e4-4164-8a0a-d2a390644a60 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:36.653775 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c4092aed-b7e4-4164-8a0a-d2a390644a60 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:36.654617 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c4092aed-b7e4-4164-8a0a-d2a390644a60 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:36.655429 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c4092aed-b7e4-4164-8a0a-d2a390644a60 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:36.797057 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-c4092aed-b7e4-4164-8a0a-d2a390644a60 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ff9e10ea4d64644a0389ebfbf90af00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '031ac4c004ed404ea279cb14ce98f7fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:31:36.805013 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-c4092aed-b7e4-4164-8a0a-d2a390644a60 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] 10.222.0.43 "GET /compute/v2.1/servers/4f9b487c-de25-439c-9340-8f3706de75eb" status: 200 len: 1510 microversion: 2.1 time: 0.170357 Oct 04 19:31:36.805635 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3303/6975] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:31:36 2022] GET /compute/v2.1/servers/4f9b487c-de25-439c-9340-8f3706de75eb => generated 1510 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:31:36.828008 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-4ace3dd5-6ce8-44a0-b182-723dc64c12c7 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:31:36.828525 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-4ace3dd5-6ce8-44a0-b182-723dc64c12c7 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] [instance: 4f9b487c-de25-439c-9340-8f3706de75eb] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:31:36.835793 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4ace3dd5-6ce8-44a0-b182-723dc64c12c7 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:36.836307 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4ace3dd5-6ce8-44a0-b182-723dc64c12c7 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:36.836803 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4ace3dd5-6ce8-44a0-b182-723dc64c12c7 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:36.837554 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4ace3dd5-6ce8-44a0-b182-723dc64c12c7 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:36.838034 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4ace3dd5-6ce8-44a0-b182-723dc64c12c7 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:36.838484 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4ace3dd5-6ce8-44a0-b182-723dc64c12c7 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:36.866536 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-4ace3dd5-6ce8-44a0-b182-723dc64c12c7 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] [instance: 4f9b487c-de25-439c-9340-8f3706de75eb] Going to try to terminate instance {{(pid=123596) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 19:31:36.918239 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.compute.api [None req-4ace3dd5-6ce8-44a0-b182-723dc64c12c7 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] [instance: 4f9b487c-de25-439c-9340-8f3706de75eb] Found an unconfirmed migration during delete, id: 16, status: finished Oct 04 19:31:38.313943 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-4ace3dd5-6ce8-44a0-b182-723dc64c12c7 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] 10.222.0.43 "DELETE /compute/v2.1/servers/4f9b487c-de25-439c-9340-8f3706de75eb" status: 204 len: 0 microversion: 2.1 time: 1.489682 Oct 04 19:31:38.314605 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3673/6976] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 19:31:36 2022] DELETE /compute/v2.1/servers/4f9b487c-de25-439c-9340-8f3706de75eb => generated 0 bytes in 1491 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:31:38.323208 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-30ddcabb-8aff-40c2-85db-bf69c6b99c71 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:31:38.323820 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-30ddcabb-8aff-40c2-85db-bf69c6b99c71 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] [instance: 4f9b487c-de25-439c-9340-8f3706de75eb] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:31:38.330801 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-30ddcabb-8aff-40c2-85db-bf69c6b99c71 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:38.331287 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-30ddcabb-8aff-40c2-85db-bf69c6b99c71 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:38.331722 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-30ddcabb-8aff-40c2-85db-bf69c6b99c71 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:38.332413 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-30ddcabb-8aff-40c2-85db-bf69c6b99c71 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:38.333032 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-30ddcabb-8aff-40c2-85db-bf69c6b99c71 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:38.333503 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-30ddcabb-8aff-40c2-85db-bf69c6b99c71 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:38.466083 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-30ddcabb-8aff-40c2-85db-bf69c6b99c71 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ff9e10ea4d64644a0389ebfbf90af00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '031ac4c004ed404ea279cb14ce98f7fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:31:38.474295 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-30ddcabb-8aff-40c2-85db-bf69c6b99c71 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] 10.222.0.43 "GET /compute/v2.1/servers/4f9b487c-de25-439c-9340-8f3706de75eb" status: 200 len: 1502 microversion: 2.1 time: 0.155527 Oct 04 19:31:38.474861 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3304/6977] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:31:38 2022] GET /compute/v2.1/servers/4f9b487c-de25-439c-9340-8f3706de75eb => generated 1502 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:31:39.018790 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-01ee4d27-578d-4f95-b10f-1a19cbafb75a req-d5c7efb3-402c-48e8-bc91-06281f992854 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f9b487c-de25-439c-9340-8f3706de75eb", "name": "network-vif-plugged", "status": "completed", "tag": "66223cd4-9d17-4f9b-b5a1-9135f78e3972"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:31:39.031427 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-01ee4d27-578d-4f95-b10f-1a19cbafb75a req-d5c7efb3-402c-48e8-bc91-06281f992854 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:39.031930 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-01ee4d27-578d-4f95-b10f-1a19cbafb75a req-d5c7efb3-402c-48e8-bc91-06281f992854 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:39.032377 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-01ee4d27-578d-4f95-b10f-1a19cbafb75a req-d5c7efb3-402c-48e8-bc91-06281f992854 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:39.045581 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-01ee4d27-578d-4f95-b10f-1a19cbafb75a req-d5c7efb3-402c-48e8-bc91-06281f992854 service nova] Creating event network-vif-plugged:66223cd4-9d17-4f9b-b5a1-9135f78e3972 for instance 4f9b487c-de25-439c-9340-8f3706de75eb on n-h1-851028-13 Oct 04 19:31:39.051581 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-01ee4d27-578d-4f95-b10f-1a19cbafb75a req-d5c7efb3-402c-48e8-bc91-06281f992854 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036521 Oct 04 19:31:39.052330 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3674/6978] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:31:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:31:39.497917 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-a7f42b23-a018-48cf-80d0-6d4b610d9400 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:31:39.498500 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-a7f42b23-a018-48cf-80d0-6d4b610d9400 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] [instance: 4f9b487c-de25-439c-9340-8f3706de75eb] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:31:39.505858 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a7f42b23-a018-48cf-80d0-6d4b610d9400 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:39.506350 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a7f42b23-a018-48cf-80d0-6d4b610d9400 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:39.506798 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a7f42b23-a018-48cf-80d0-6d4b610d9400 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:39.507500 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a7f42b23-a018-48cf-80d0-6d4b610d9400 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:39.507962 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a7f42b23-a018-48cf-80d0-6d4b610d9400 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:39.508460 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a7f42b23-a018-48cf-80d0-6d4b610d9400 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:39.640366 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-a7f42b23-a018-48cf-80d0-6d4b610d9400 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ff9e10ea4d64644a0389ebfbf90af00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '031ac4c004ed404ea279cb14ce98f7fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:31:39.648329 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-a7f42b23-a018-48cf-80d0-6d4b610d9400 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] 10.222.0.43 "GET /compute/v2.1/servers/4f9b487c-de25-439c-9340-8f3706de75eb" status: 200 len: 1502 microversion: 2.1 time: 0.155080 Oct 04 19:31:39.648910 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3305/6979] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:31:39 2022] GET /compute/v2.1/servers/4f9b487c-de25-439c-9340-8f3706de75eb => generated 1502 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:31:40.125672 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-236ddb8d-6fb7-42ab-af43-572ebe14e023 req-d1a87100-f6ad-4cd4-988f-81af3af28375 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f9b487c-de25-439c-9340-8f3706de75eb", "name": "network-vif-deleted", "tag": "66223cd4-9d17-4f9b-b5a1-9135f78e3972"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:31:40.139780 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-236ddb8d-6fb7-42ab-af43-572ebe14e023 req-d1a87100-f6ad-4cd4-988f-81af3af28375 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:40.140363 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-236ddb8d-6fb7-42ab-af43-572ebe14e023 req-d1a87100-f6ad-4cd4-988f-81af3af28375 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:40.140881 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-236ddb8d-6fb7-42ab-af43-572ebe14e023 req-d1a87100-f6ad-4cd4-988f-81af3af28375 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:40.153989 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-236ddb8d-6fb7-42ab-af43-572ebe14e023 req-d1a87100-f6ad-4cd4-988f-81af3af28375 service nova] Creating event network-vif-deleted:66223cd4-9d17-4f9b-b5a1-9135f78e3972 for instance 4f9b487c-de25-439c-9340-8f3706de75eb on n-h1-851028-13 Oct 04 19:31:40.160274 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-236ddb8d-6fb7-42ab-af43-572ebe14e023 req-d1a87100-f6ad-4cd4-988f-81af3af28375 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038622 Oct 04 19:31:40.160928 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3675/6980] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:31:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:31:40.671776 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-9689e86a-f94d-474c-8c1b-cdec0a6b83c9 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:31:40.672380 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-9689e86a-f94d-474c-8c1b-cdec0a6b83c9 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] [instance: 4f9b487c-de25-439c-9340-8f3706de75eb] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:31:40.679173 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9689e86a-f94d-474c-8c1b-cdec0a6b83c9 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:40.679660 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9689e86a-f94d-474c-8c1b-cdec0a6b83c9 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:40.680100 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9689e86a-f94d-474c-8c1b-cdec0a6b83c9 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:40.680800 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9689e86a-f94d-474c-8c1b-cdec0a6b83c9 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:40.681962 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9689e86a-f94d-474c-8c1b-cdec0a6b83c9 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:40.682398 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9689e86a-f94d-474c-8c1b-cdec0a6b83c9 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:40.695646 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-9689e86a-f94d-474c-8c1b-cdec0a6b83c9 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] HTTP exception thrown: Instance 4f9b487c-de25-439c-9340-8f3706de75eb could not be found. Oct 04 19:31:40.697323 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-9689e86a-f94d-474c-8c1b-cdec0a6b83c9 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Request method failure captured: Oct 04 19:31:40.697323 n-d-851028-13 devstack@n-api.service[123595]: request: GET /compute/v2.1/servers/4f9b487c-de25-439c-9340-8f3706de75eb HTTP/1.1 Oct 04 19:31:40.697323 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 19:31:40.697323 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 19:31:40.697323 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 19:31:40.697323 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 0 Oct 04 19:31:40.697323 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 19:31:40.697323 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 19:31:40.697323 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 19:31:40.697323 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 19:31:40.697323 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPInrsGfQdtADb9H8G7sCRJTM0fr7Ut1W-Hhnmhz507Ixp_DaL3XPeiPtQJla1NRSJd4IWN2naGM3xvOu0T3X7KGernqywIe5HPhCLIcnqxD_xj_qz6pf3-tqNABu9n_CE-jsZlbMrgZgZCJNCbv8CtUZPV-KfPaeILKDqT-zigN6XZM Oct 04 19:31:40.697323 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 19:31:40.697323 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 19:31:40.697323 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 19:31:40.697323 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 19:31:40.697323 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 19:31:40.697323 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 19:31:40.697323 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: 031ac4c004ed404ea279cb14ce98f7fb Oct 04 19:31:40.697323 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-DeleteServersTestJSON-949308462 Oct 04 19:31:40.697323 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 19:31:40.697323 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 19:31:40.697323 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/031ac4c004ed404ea279cb14ce98f7fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_031ac4c004ed404ea279cb14ce98f7fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/031ac4c004ed404ea279cb14ce98f7fb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/031ac4c004ed404ea279cb14ce98f7fb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 19:31:40.697323 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-DeleteServersTestJSON-949308462 Oct 04 19:31:40.697323 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: 031ac4c004ed404ea279cb14ce98f7fb Oct 04 19:31:40.697323 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-DeleteServersTestJSON-949308462 Oct 04 19:31:40.697323 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-DeleteServersTestJSON-949308462-project Oct 04 19:31:40.697323 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 19:31:40.697323 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 19:31:40.697323 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: 8ff9e10ea4d64644a0389ebfbf90af00 Oct 04 19:31:40.697323 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-DeleteServersTestJSON-949308462-project Oct 04 19:31:40.697323 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 19:31:40.697323 n-d-851028-13 devstack@n-api.service[123595]: exception: Instance 4f9b487c-de25-439c-9340-8f3706de75eb could not be found. Oct 04 19:31:40.697323 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': '4f9b487c-de25-439c-9340-8f3706de75eb'} Oct 04 19:31:40.697323 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:31:40.697323 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:31:40.697323 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:31:40.697323 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:31:40.697323 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:31:40.697323 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:31:40.697323 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:31:40.697323 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:31:40.697323 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:31:40.697323 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:31:40.697323 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f9b487c-de25-439c-9340-8f3706de75eb could not be found. Oct 04 19:31:40.697323 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:31:40.697323 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:31:40.697323 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:31:40.697323 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:31:40.697323 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:31:40.697323 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:31:40.697323 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:31:40.697323 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:31:40.697323 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:31:40.697323 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:31:40.697323 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:31:40.697323 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:31:40.697323 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:31:40.697323 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:31:40.697323 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:31:40.697323 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:31:40.697323 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f9b487c-de25-439c-9340-8f3706de75eb could not be found. Oct 04 19:31:40.697323 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:31:40.697323 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:31:40.697323 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:31:40.701683 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:31:40.701683 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:31:40.701683 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:31:40.701683 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:31:40.701683 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:31:40.701683 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f9b487c-de25-439c-9340-8f3706de75eb could not be found. Oct 04 19:31:40.701683 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:31:40.701683 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-9689e86a-f94d-474c-8c1b-cdec0a6b83c9 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Returning 404 to user: Instance 4f9b487c-de25-439c-9340-8f3706de75eb could not be found. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:31:40.701683 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-9689e86a-f94d-474c-8c1b-cdec0a6b83c9 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] 10.222.0.43 "GET /compute/v2.1/servers/4f9b487c-de25-439c-9340-8f3706de75eb" status: 404 len: 111 microversion: 2.1 time: 0.030988 Oct 04 19:31:40.701683 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3306/6981] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:31:40 2022] GET /compute/v2.1/servers/4f9b487c-de25-439c-9340-8f3706de75eb => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:31:40.717285 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-4518a87f-c976-4fc7-8a02-17b33f238092 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:31:40.717917 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-4518a87f-c976-4fc7-8a02-17b33f238092 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] [instance: 4f9b487c-de25-439c-9340-8f3706de75eb] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:31:40.725089 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4518a87f-c976-4fc7-8a02-17b33f238092 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:40.725623 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4518a87f-c976-4fc7-8a02-17b33f238092 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:40.726110 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4518a87f-c976-4fc7-8a02-17b33f238092 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:40.726828 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4518a87f-c976-4fc7-8a02-17b33f238092 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:40.727309 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4518a87f-c976-4fc7-8a02-17b33f238092 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:40.727755 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4518a87f-c976-4fc7-8a02-17b33f238092 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:40.741903 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-4518a87f-c976-4fc7-8a02-17b33f238092 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] HTTP exception thrown: Instance 4f9b487c-de25-439c-9340-8f3706de75eb could not be found. Oct 04 19:31:40.743566 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-4518a87f-c976-4fc7-8a02-17b33f238092 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Request method failure captured: Oct 04 19:31:40.743566 n-d-851028-13 devstack@n-api.service[123596]: request: DELETE /compute/v2.1/servers/4f9b487c-de25-439c-9340-8f3706de75eb HTTP/1.1 Oct 04 19:31:40.743566 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 19:31:40.743566 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 19:31:40.743566 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 19:31:40.743566 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 19:31:40.743566 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 19:31:40.743566 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 19:31:40.743566 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 19:31:40.743566 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 19:31:40.743566 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPInrsGfQdtADb9H8G7sCRJTM0fr7Ut1W-Hhnmhz507Ixp_DaL3XPeiPtQJla1NRSJd4IWN2naGM3xvOu0T3X7KGernqywIe5HPhCLIcnqxD_xj_qz6pf3-tqNABu9n_CE-jsZlbMrgZgZCJNCbv8CtUZPV-KfPaeILKDqT-zigN6XZM Oct 04 19:31:40.743566 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 19:31:40.743566 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 19:31:40.743566 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 19:31:40.743566 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 19:31:40.743566 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 19:31:40.743566 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 19:31:40.743566 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: 031ac4c004ed404ea279cb14ce98f7fb Oct 04 19:31:40.743566 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-DeleteServersTestJSON-949308462 Oct 04 19:31:40.743566 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 19:31:40.743566 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 19:31:40.743566 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/031ac4c004ed404ea279cb14ce98f7fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_031ac4c004ed404ea279cb14ce98f7fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/031ac4c004ed404ea279cb14ce98f7fb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/031ac4c004ed404ea279cb14ce98f7fb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 19:31:40.743566 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-DeleteServersTestJSON-949308462 Oct 04 19:31:40.743566 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: 031ac4c004ed404ea279cb14ce98f7fb Oct 04 19:31:40.743566 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-DeleteServersTestJSON-949308462 Oct 04 19:31:40.743566 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-DeleteServersTestJSON-949308462-project Oct 04 19:31:40.743566 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 19:31:40.743566 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 19:31:40.743566 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 8ff9e10ea4d64644a0389ebfbf90af00 Oct 04 19:31:40.743566 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-DeleteServersTestJSON-949308462-project Oct 04 19:31:40.743566 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 19:31:40.743566 n-d-851028-13 devstack@n-api.service[123596]: exception: Instance 4f9b487c-de25-439c-9340-8f3706de75eb could not be found. Oct 04 19:31:40.743566 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': '4f9b487c-de25-439c-9340-8f3706de75eb'} Oct 04 19:31:40.743566 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:31:40.743566 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:31:40.743566 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:31:40.743566 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:31:40.743566 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:31:40.743566 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:31:40.743566 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:31:40.743566 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:31:40.743566 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:31:40.743566 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:31:40.743566 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f9b487c-de25-439c-9340-8f3706de75eb could not be found. Oct 04 19:31:40.743566 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:31:40.743566 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:31:40.743566 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:31:40.743566 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:31:40.743566 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:31:40.743566 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:31:40.743566 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:31:40.743566 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:31:40.743566 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:31:40.743566 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:31:40.743566 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 19:31:40.743566 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 19:31:40.743566 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 19:31:40.743566 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 19:31:40.743566 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:31:40.743566 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:31:40.743566 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:31:40.743566 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:31:40.747606 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f9b487c-de25-439c-9340-8f3706de75eb could not be found. Oct 04 19:31:40.747606 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:31:40.747606 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:31:40.747606 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:31:40.747606 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:31:40.747606 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:31:40.747606 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:31:40.747606 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:31:40.747606 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:31:40.747606 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f9b487c-de25-439c-9340-8f3706de75eb could not be found. Oct 04 19:31:40.747606 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:31:40.747606 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-4518a87f-c976-4fc7-8a02-17b33f238092 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Returning 404 to user: Instance 4f9b487c-de25-439c-9340-8f3706de75eb could not be found. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:31:40.747606 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-4518a87f-c976-4fc7-8a02-17b33f238092 tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] 10.222.0.43 "DELETE /compute/v2.1/servers/4f9b487c-de25-439c-9340-8f3706de75eb" status: 404 len: 111 microversion: 2.1 time: 0.033260 Oct 04 19:31:40.747606 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3676/6982] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 19:31:40 2022] DELETE /compute/v2.1/servers/4f9b487c-de25-439c-9340-8f3706de75eb => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:31:40.754179 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-28e89f74-e559-4aed-894a-4c5373b7f27e tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:31:40.754821 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-28e89f74-e559-4aed-894a-4c5373b7f27e tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] [instance: 4f9b487c-de25-439c-9340-8f3706de75eb] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:31:40.761442 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-28e89f74-e559-4aed-894a-4c5373b7f27e tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:40.761939 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-28e89f74-e559-4aed-894a-4c5373b7f27e tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:40.762386 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-28e89f74-e559-4aed-894a-4c5373b7f27e tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:40.763096 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-28e89f74-e559-4aed-894a-4c5373b7f27e tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:40.763554 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-28e89f74-e559-4aed-894a-4c5373b7f27e tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:40.763982 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-28e89f74-e559-4aed-894a-4c5373b7f27e tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:40.777853 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-28e89f74-e559-4aed-894a-4c5373b7f27e tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] HTTP exception thrown: Instance 4f9b487c-de25-439c-9340-8f3706de75eb could not be found. Oct 04 19:31:40.779364 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-28e89f74-e559-4aed-894a-4c5373b7f27e tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Request method failure captured: Oct 04 19:31:40.779364 n-d-851028-13 devstack@n-api.service[123595]: request: GET /compute/v2.1/servers/4f9b487c-de25-439c-9340-8f3706de75eb HTTP/1.1 Oct 04 19:31:40.779364 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 19:31:40.779364 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 19:31:40.779364 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 19:31:40.779364 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 0 Oct 04 19:31:40.779364 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 19:31:40.779364 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 19:31:40.779364 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 19:31:40.779364 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 19:31:40.779364 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPInrsGfQdtADb9H8G7sCRJTM0fr7Ut1W-Hhnmhz507Ixp_DaL3XPeiPtQJla1NRSJd4IWN2naGM3xvOu0T3X7KGernqywIe5HPhCLIcnqxD_xj_qz6pf3-tqNABu9n_CE-jsZlbMrgZgZCJNCbv8CtUZPV-KfPaeILKDqT-zigN6XZM Oct 04 19:31:40.779364 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 19:31:40.779364 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 19:31:40.779364 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 19:31:40.779364 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 19:31:40.779364 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 19:31:40.779364 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 19:31:40.779364 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: 031ac4c004ed404ea279cb14ce98f7fb Oct 04 19:31:40.779364 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-DeleteServersTestJSON-949308462 Oct 04 19:31:40.779364 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 19:31:40.779364 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 19:31:40.779364 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/031ac4c004ed404ea279cb14ce98f7fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_031ac4c004ed404ea279cb14ce98f7fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/031ac4c004ed404ea279cb14ce98f7fb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/031ac4c004ed404ea279cb14ce98f7fb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 19:31:40.779364 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-DeleteServersTestJSON-949308462 Oct 04 19:31:40.779364 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: 031ac4c004ed404ea279cb14ce98f7fb Oct 04 19:31:40.779364 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-DeleteServersTestJSON-949308462 Oct 04 19:31:40.779364 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-DeleteServersTestJSON-949308462-project Oct 04 19:31:40.779364 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 19:31:40.779364 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 19:31:40.779364 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: 8ff9e10ea4d64644a0389ebfbf90af00 Oct 04 19:31:40.779364 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-DeleteServersTestJSON-949308462-project Oct 04 19:31:40.779364 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 19:31:40.779364 n-d-851028-13 devstack@n-api.service[123595]: exception: Instance 4f9b487c-de25-439c-9340-8f3706de75eb could not be found. Oct 04 19:31:40.779364 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': '4f9b487c-de25-439c-9340-8f3706de75eb'} Oct 04 19:31:40.779364 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:31:40.779364 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:31:40.779364 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:31:40.779364 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:31:40.779364 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:31:40.779364 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:31:40.779364 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:31:40.779364 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:31:40.779364 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:31:40.779364 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:31:40.779364 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f9b487c-de25-439c-9340-8f3706de75eb could not be found. Oct 04 19:31:40.779364 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:31:40.779364 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:31:40.779364 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:31:40.779364 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:31:40.779364 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:31:40.779364 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:31:40.779364 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:31:40.779364 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:31:40.779364 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:31:40.779364 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:31:40.779364 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:31:40.779364 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:31:40.779364 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:31:40.779364 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:31:40.779364 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:31:40.779364 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:31:40.779364 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f9b487c-de25-439c-9340-8f3706de75eb could not be found. Oct 04 19:31:40.779364 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:31:40.779364 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:31:40.779364 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:31:40.783788 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:31:40.783788 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:31:40.783788 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:31:40.783788 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:31:40.783788 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:31:40.783788 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f9b487c-de25-439c-9340-8f3706de75eb could not be found. Oct 04 19:31:40.783788 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:31:40.783788 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-28e89f74-e559-4aed-894a-4c5373b7f27e tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] Returning 404 to user: Instance 4f9b487c-de25-439c-9340-8f3706de75eb could not be found. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:31:40.783788 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-28e89f74-e559-4aed-894a-4c5373b7f27e tempest-DeleteServersTestJSON-949308462 tempest-DeleteServersTestJSON-949308462-project] 10.222.0.43 "GET /compute/v2.1/servers/4f9b487c-de25-439c-9340-8f3706de75eb" status: 404 len: 111 microversion: 2.1 time: 0.030397 Oct 04 19:31:40.783788 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3307/6983] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:31:40 2022] GET /compute/v2.1/servers/4f9b487c-de25-439c-9340-8f3706de75eb => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:31:49.586864 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-3b527ef3-d48b-4ddf-a7f3-120ad54eaabb tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-198030508", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452", "networks": [{"uuid": "89860fe2-b58b-43af-b0e1-555044a2dc91"}]}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:31:49.643791 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.network.neutron [None req-3b527ef3-d48b-4ddf-a7f3-120ad54eaabb tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] validate_networks() for [('89860fe2-b58b-43af-b0e1-555044a2dc91', None, None, None, None, None)] {{(pid=123596) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 19:31:50.034066 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-3b527ef3-d48b-4ddf-a7f3-120ad54eaabb tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Flavor limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:31:50.034566 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-3b527ef3-d48b-4ddf-a7f3-120ad54eaabb tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Image limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:31:50.035085 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-3b527ef3-d48b-4ddf-a7f3-120ad54eaabb tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Flavor pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:31:50.035516 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-3b527ef3-d48b-4ddf-a7f3-120ad54eaabb tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Image pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:31:50.035947 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-3b527ef3-d48b-4ddf-a7f3-120ad54eaabb tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:31:50.045371 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3b527ef3-d48b-4ddf-a7f3-120ad54eaabb tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:50.045874 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3b527ef3-d48b-4ddf-a7f3-120ad54eaabb tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:50.046328 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3b527ef3-d48b-4ddf-a7f3-120ad54eaabb tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:50.047074 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3b527ef3-d48b-4ddf-a7f3-120ad54eaabb tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:50.047543 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3b527ef3-d48b-4ddf-a7f3-120ad54eaabb tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:50.047992 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3b527ef3-d48b-4ddf-a7f3-120ad54eaabb tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:50.066208 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-3b527ef3-d48b-4ddf-a7f3-120ad54eaabb tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Getting quotas for project a1025a52a7ef44d6b3727e87ea3dfcf9. Resources: {'ram', 'cores', 'instances'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:31:50.072342 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-3b527ef3-d48b-4ddf-a7f3-120ad54eaabb tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Getting quotas for user 3a20d5dbdbb74c0c9921ed0eecb688c3 and project a1025a52a7ef44d6b3727e87ea3dfcf9. Resources: {'ram', 'cores', 'instances'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:31:50.084910 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-3b527ef3-d48b-4ddf-a7f3-120ad54eaabb tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Going to run 1 instances... {{(pid=123596) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 19:31:50.087324 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-3b527ef3-d48b-4ddf-a7f3-120ad54eaabb tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] [instance: 3984d73b-0520-4591-9b30-a83a383e9062] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e8943ec5-4038-4d4b-b9b9-2415a79f5243',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123596) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 19:31:50.134523 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-3b527ef3-d48b-4ddf-a7f3-120ad54eaabb tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.675854 Oct 04 19:31:50.135204 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3677/6984] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 19:31:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 678 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 19:31:50.146332 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-6a332675-c98a-491f-90b9-04d76a414a8d tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:31:50.146937 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-6a332675-c98a-491f-90b9-04d76a414a8d tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] [instance: 3984d73b-0520-4591-9b30-a83a383e9062] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:31:50.210367 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-6a332675-c98a-491f-90b9-04d76a414a8d tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a20d5dbdbb74c0c9921ed0eecb688c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1025a52a7ef44d6b3727e87ea3dfcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:31:50.217252 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-6a332675-c98a-491f-90b9-04d76a414a8d tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] 10.222.0.43 "GET /compute/v2.1/servers/3984d73b-0520-4591-9b30-a83a383e9062" status: 200 len: 1217 microversion: 2.1 time: 0.074771 Oct 04 19:31:50.217819 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3308/6985] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:31:50 2022] GET /compute/v2.1/servers/3984d73b-0520-4591-9b30-a83a383e9062 => generated 1217 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:31:51.243549 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-fba8b750-506e-4f26-9bf1-bfda8ef1175b tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:31:51.244213 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-fba8b750-506e-4f26-9bf1-bfda8ef1175b tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] [instance: 3984d73b-0520-4591-9b30-a83a383e9062] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:31:51.251554 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fba8b750-506e-4f26-9bf1-bfda8ef1175b tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:51.252431 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fba8b750-506e-4f26-9bf1-bfda8ef1175b tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:51.253710 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fba8b750-506e-4f26-9bf1-bfda8ef1175b tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:51.254698 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fba8b750-506e-4f26-9bf1-bfda8ef1175b tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:51.255360 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fba8b750-506e-4f26-9bf1-bfda8ef1175b tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:51.256275 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fba8b750-506e-4f26-9bf1-bfda8ef1175b tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:51.352157 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-fba8b750-506e-4f26-9bf1-bfda8ef1175b tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a20d5dbdbb74c0c9921ed0eecb688c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1025a52a7ef44d6b3727e87ea3dfcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:31:51.365924 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-fba8b750-506e-4f26-9bf1-bfda8ef1175b tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] 10.222.0.43 "GET /compute/v2.1/servers/3984d73b-0520-4591-9b30-a83a383e9062" status: 200 len: 1277 microversion: 2.1 time: 0.129123 Oct 04 19:31:51.367039 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3678/6986] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:31:51 2022] GET /compute/v2.1/servers/3984d73b-0520-4591-9b30-a83a383e9062 => generated 1277 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:31:52.390012 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-47d081c9-3235-43df-bab1-6f22a037c72d tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:31:52.390817 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-47d081c9-3235-43df-bab1-6f22a037c72d tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] [instance: 3984d73b-0520-4591-9b30-a83a383e9062] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:31:52.393886 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=37 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:31:52.401441 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-47d081c9-3235-43df-bab1-6f22a037c72d tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:52.407520 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-47d081c9-3235-43df-bab1-6f22a037c72d tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:52.408022 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-47d081c9-3235-43df-bab1-6f22a037c72d tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:52.408956 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-47d081c9-3235-43df-bab1-6f22a037c72d tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:52.409475 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-47d081c9-3235-43df-bab1-6f22a037c72d tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:52.409913 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-47d081c9-3235-43df-bab1-6f22a037c72d tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:52.647332 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-47d081c9-3235-43df-bab1-6f22a037c72d tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a20d5dbdbb74c0c9921ed0eecb688c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1025a52a7ef44d6b3727e87ea3dfcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:31:52.655685 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-47d081c9-3235-43df-bab1-6f22a037c72d tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] 10.222.0.43 "GET /compute/v2.1/servers/3984d73b-0520-4591-9b30-a83a383e9062" status: 200 len: 1317 microversion: 2.1 time: 0.269485 Oct 04 19:31:52.656468 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3309/6987] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:31:52 2022] GET /compute/v2.1/servers/3984d73b-0520-4591-9b30-a83a383e9062 => generated 1317 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:31:52.891226 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-2cc5f970-1da7-4bb6-a49a-b757e5f60509 req-8f153b10-7405-4190-9d5a-f94c152f9791 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3984d73b-0520-4591-9b30-a83a383e9062", "tag": "19d0dd08-7ec8-4e2e-bae0-bffbdb80e286"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:31:52.906127 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-2cc5f970-1da7-4bb6-a49a-b757e5f60509 req-8f153b10-7405-4190-9d5a-f94c152f9791 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:52.906917 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-2cc5f970-1da7-4bb6-a49a-b757e5f60509 req-8f153b10-7405-4190-9d5a-f94c152f9791 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:52.907894 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-2cc5f970-1da7-4bb6-a49a-b757e5f60509 req-8f153b10-7405-4190-9d5a-f94c152f9791 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:52.922192 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-2cc5f970-1da7-4bb6-a49a-b757e5f60509 req-8f153b10-7405-4190-9d5a-f94c152f9791 service nova] Creating event network-changed:19d0dd08-7ec8-4e2e-bae0-bffbdb80e286 for instance 3984d73b-0520-4591-9b30-a83a383e9062 on n-h1-851028-13 Oct 04 19:31:52.927700 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-2cc5f970-1da7-4bb6-a49a-b757e5f60509 req-8f153b10-7405-4190-9d5a-f94c152f9791 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041035 Oct 04 19:31:52.928708 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3679/6988] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:31:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:31:53.679109 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-48113ab4-cb65-4dab-99ab-a6f07eb5a3cf tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:31:53.679729 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-48113ab4-cb65-4dab-99ab-a6f07eb5a3cf tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] [instance: 3984d73b-0520-4591-9b30-a83a383e9062] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:31:53.687117 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-48113ab4-cb65-4dab-99ab-a6f07eb5a3cf tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:53.687604 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-48113ab4-cb65-4dab-99ab-a6f07eb5a3cf tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:53.688048 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-48113ab4-cb65-4dab-99ab-a6f07eb5a3cf tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:53.688743 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-48113ab4-cb65-4dab-99ab-a6f07eb5a3cf tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:53.689262 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-48113ab4-cb65-4dab-99ab-a6f07eb5a3cf tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:53.689695 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-48113ab4-cb65-4dab-99ab-a6f07eb5a3cf tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:53.827469 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-48113ab4-cb65-4dab-99ab-a6f07eb5a3cf tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a20d5dbdbb74c0c9921ed0eecb688c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1025a52a7ef44d6b3727e87ea3dfcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:31:53.838505 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-48113ab4-cb65-4dab-99ab-a6f07eb5a3cf tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] 10.222.0.43 "GET /compute/v2.1/servers/3984d73b-0520-4591-9b30-a83a383e9062" status: 200 len: 1317 microversion: 2.1 time: 0.163006 Oct 04 19:31:53.839379 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3310/6989] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:31:53 2022] GET /compute/v2.1/servers/3984d73b-0520-4591-9b30-a83a383e9062 => generated 1317 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:31:54.872612 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-c3d34a01-f006-4d1f-96a2-69ec81e3e8ea tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:31:54.873496 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-c3d34a01-f006-4d1f-96a2-69ec81e3e8ea tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] [instance: 3984d73b-0520-4591-9b30-a83a383e9062] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:31:54.880752 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c3d34a01-f006-4d1f-96a2-69ec81e3e8ea tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:54.881292 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c3d34a01-f006-4d1f-96a2-69ec81e3e8ea tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:54.881754 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c3d34a01-f006-4d1f-96a2-69ec81e3e8ea tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:54.882482 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c3d34a01-f006-4d1f-96a2-69ec81e3e8ea tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:54.882951 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c3d34a01-f006-4d1f-96a2-69ec81e3e8ea tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:54.883431 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c3d34a01-f006-4d1f-96a2-69ec81e3e8ea tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:55.021633 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-c3d34a01-f006-4d1f-96a2-69ec81e3e8ea tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a20d5dbdbb74c0c9921ed0eecb688c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1025a52a7ef44d6b3727e87ea3dfcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:31:55.029948 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-c3d34a01-f006-4d1f-96a2-69ec81e3e8ea tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] 10.222.0.43 "GET /compute/v2.1/servers/3984d73b-0520-4591-9b30-a83a383e9062" status: 200 len: 1317 microversion: 2.1 time: 0.162199 Oct 04 19:31:55.030541 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3680/6990] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:31:54 2022] GET /compute/v2.1/servers/3984d73b-0520-4591-9b30-a83a383e9062 => generated 1317 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:31:56.052481 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-c999904f-1578-45e9-8c52-39fb8cef796e tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:31:56.053099 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-c999904f-1578-45e9-8c52-39fb8cef796e tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] [instance: 3984d73b-0520-4591-9b30-a83a383e9062] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:31:56.061082 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c999904f-1578-45e9-8c52-39fb8cef796e tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:56.061598 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c999904f-1578-45e9-8c52-39fb8cef796e tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:56.062129 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c999904f-1578-45e9-8c52-39fb8cef796e tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:56.062866 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c999904f-1578-45e9-8c52-39fb8cef796e tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:56.063319 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c999904f-1578-45e9-8c52-39fb8cef796e tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:56.063749 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c999904f-1578-45e9-8c52-39fb8cef796e tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:56.202676 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-c999904f-1578-45e9-8c52-39fb8cef796e tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a20d5dbdbb74c0c9921ed0eecb688c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1025a52a7ef44d6b3727e87ea3dfcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:31:56.210519 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-c999904f-1578-45e9-8c52-39fb8cef796e tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] 10.222.0.43 "GET /compute/v2.1/servers/3984d73b-0520-4591-9b30-a83a383e9062" status: 200 len: 1317 microversion: 2.1 time: 0.161871 Oct 04 19:31:56.212284 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3311/6991] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:31:56 2022] GET /compute/v2.1/servers/3984d73b-0520-4591-9b30-a83a383e9062 => generated 1317 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:31:57.104815 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-4410229d-0eb1-4b0d-ace4-7425fa772850 req-a41cd39f-ae2e-4917-80a1-9de5b5861221 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3984d73b-0520-4591-9b30-a83a383e9062", "name": "network-vif-plugged", "status": "completed", "tag": "19d0dd08-7ec8-4e2e-bae0-bffbdb80e286"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:31:57.116226 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-4410229d-0eb1-4b0d-ace4-7425fa772850 req-a41cd39f-ae2e-4917-80a1-9de5b5861221 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:57.116843 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-4410229d-0eb1-4b0d-ace4-7425fa772850 req-a41cd39f-ae2e-4917-80a1-9de5b5861221 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:57.117361 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-4410229d-0eb1-4b0d-ace4-7425fa772850 req-a41cd39f-ae2e-4917-80a1-9de5b5861221 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:57.129538 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-4410229d-0eb1-4b0d-ace4-7425fa772850 req-a41cd39f-ae2e-4917-80a1-9de5b5861221 service nova] Creating event network-vif-plugged:19d0dd08-7ec8-4e2e-bae0-bffbdb80e286 for instance 3984d73b-0520-4591-9b30-a83a383e9062 on n-h1-851028-13 Oct 04 19:31:57.134781 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-4410229d-0eb1-4b0d-ace4-7425fa772850 req-a41cd39f-ae2e-4917-80a1-9de5b5861221 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034239 Oct 04 19:31:57.135420 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3681/6992] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:31:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:31:57.235249 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-99305144-395a-498f-967d-a32ed16c2e9b tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:31:57.236065 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-99305144-395a-498f-967d-a32ed16c2e9b tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] [instance: 3984d73b-0520-4591-9b30-a83a383e9062] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:31:57.243296 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-99305144-395a-498f-967d-a32ed16c2e9b tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:57.244686 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-99305144-395a-498f-967d-a32ed16c2e9b tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:57.245289 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-99305144-395a-498f-967d-a32ed16c2e9b tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:57.247195 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-99305144-395a-498f-967d-a32ed16c2e9b tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:57.247195 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-99305144-395a-498f-967d-a32ed16c2e9b tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:57.247195 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-99305144-395a-498f-967d-a32ed16c2e9b tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:57.443262 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-99305144-395a-498f-967d-a32ed16c2e9b tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a20d5dbdbb74c0c9921ed0eecb688c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1025a52a7ef44d6b3727e87ea3dfcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:31:57.451078 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-99305144-395a-498f-967d-a32ed16c2e9b tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] 10.222.0.43 "GET /compute/v2.1/servers/3984d73b-0520-4591-9b30-a83a383e9062" status: 200 len: 1317 microversion: 2.1 time: 0.219863 Oct 04 19:31:57.451655 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3312/6993] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:31:57 2022] GET /compute/v2.1/servers/3984d73b-0520-4591-9b30-a83a383e9062 => generated 1317 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:31:58.475794 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-c21ff266-0800-4b8b-bca5-1d4d54600720 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:31:58.476540 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-c21ff266-0800-4b8b-bca5-1d4d54600720 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] [instance: 3984d73b-0520-4591-9b30-a83a383e9062] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:31:58.483305 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c21ff266-0800-4b8b-bca5-1d4d54600720 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:58.483802 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c21ff266-0800-4b8b-bca5-1d4d54600720 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:58.484253 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c21ff266-0800-4b8b-bca5-1d4d54600720 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:58.484957 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c21ff266-0800-4b8b-bca5-1d4d54600720 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:58.485450 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c21ff266-0800-4b8b-bca5-1d4d54600720 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:58.485892 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c21ff266-0800-4b8b-bca5-1d4d54600720 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:58.616505 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-c21ff266-0800-4b8b-bca5-1d4d54600720 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a20d5dbdbb74c0c9921ed0eecb688c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1025a52a7ef44d6b3727e87ea3dfcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:31:58.624954 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-c21ff266-0800-4b8b-bca5-1d4d54600720 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] 10.222.0.43 "GET /compute/v2.1/servers/3984d73b-0520-4591-9b30-a83a383e9062" status: 200 len: 1507 microversion: 2.1 time: 0.154471 Oct 04 19:31:58.625572 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3682/6994] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:31:58 2022] GET /compute/v2.1/servers/3984d73b-0520-4591-9b30-a83a383e9062 => generated 1507 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:31:58.647172 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-cb6d5ff9-1bac-4405-9e4a-0ad232f417f2 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:31:58.647787 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-cb6d5ff9-1bac-4405-9e4a-0ad232f417f2 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] [instance: 3984d73b-0520-4591-9b30-a83a383e9062] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:31:58.654246 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cb6d5ff9-1bac-4405-9e4a-0ad232f417f2 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:58.654732 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cb6d5ff9-1bac-4405-9e4a-0ad232f417f2 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:58.655175 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cb6d5ff9-1bac-4405-9e4a-0ad232f417f2 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:58.655871 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cb6d5ff9-1bac-4405-9e4a-0ad232f417f2 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:58.656327 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cb6d5ff9-1bac-4405-9e4a-0ad232f417f2 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:58.656754 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cb6d5ff9-1bac-4405-9e4a-0ad232f417f2 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:58.785422 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-cb6d5ff9-1bac-4405-9e4a-0ad232f417f2 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a20d5dbdbb74c0c9921ed0eecb688c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1025a52a7ef44d6b3727e87ea3dfcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:31:58.793613 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-cb6d5ff9-1bac-4405-9e4a-0ad232f417f2 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] 10.222.0.43 "GET /compute/v2.1/servers/3984d73b-0520-4591-9b30-a83a383e9062" status: 200 len: 1507 microversion: 2.1 time: 0.150310 Oct 04 19:31:58.794188 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3313/6995] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:31:58 2022] GET /compute/v2.1/servers/3984d73b-0520-4591-9b30-a83a383e9062 => generated 1507 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:31:58.816018 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-1237b0fd-a231-4290-8c69-4fac217ebd58 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:31:58.818439 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-1237b0fd-a231-4290-8c69-4fac217ebd58 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] [instance: 3984d73b-0520-4591-9b30-a83a383e9062] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:31:58.824438 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1237b0fd-a231-4290-8c69-4fac217ebd58 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:58.824937 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1237b0fd-a231-4290-8c69-4fac217ebd58 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:58.825421 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1237b0fd-a231-4290-8c69-4fac217ebd58 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:58.826138 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1237b0fd-a231-4290-8c69-4fac217ebd58 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:58.826606 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1237b0fd-a231-4290-8c69-4fac217ebd58 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:58.827049 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1237b0fd-a231-4290-8c69-4fac217ebd58 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:58.890892 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-1237b0fd-a231-4290-8c69-4fac217ebd58 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] 10.222.0.43 "PUT /compute/v2.1/servers/3984d73b-0520-4591-9b30-a83a383e9062" status: 200 len: 1079 microversion: 2.1 time: 0.078558 Oct 04 19:31:58.891567 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3683/6996] 10.222.0.43 () {60 vars in 1256 bytes} [Tue Oct 4 19:31:58 2022] PUT /compute/v2.1/servers/3984d73b-0520-4591-9b30-a83a383e9062 => generated 1079 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:31:58.910339 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-912aafa2-b67f-4586-b3c7-5be7323e1021 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:31:58.910951 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-912aafa2-b67f-4586-b3c7-5be7323e1021 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] [instance: 3984d73b-0520-4591-9b30-a83a383e9062] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:31:58.917721 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-912aafa2-b67f-4586-b3c7-5be7323e1021 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:58.918202 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-912aafa2-b67f-4586-b3c7-5be7323e1021 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:58.918637 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-912aafa2-b67f-4586-b3c7-5be7323e1021 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:58.919328 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-912aafa2-b67f-4586-b3c7-5be7323e1021 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:58.919783 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-912aafa2-b67f-4586-b3c7-5be7323e1021 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:58.920209 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-912aafa2-b67f-4586-b3c7-5be7323e1021 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:59.063089 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-912aafa2-b67f-4586-b3c7-5be7323e1021 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a20d5dbdbb74c0c9921ed0eecb688c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1025a52a7ef44d6b3727e87ea3dfcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:31:59.071344 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-912aafa2-b67f-4586-b3c7-5be7323e1021 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] 10.222.0.43 "GET /compute/v2.1/servers/3984d73b-0520-4591-9b30-a83a383e9062" status: 200 len: 1505 microversion: 2.1 time: 0.164889 Oct 04 19:31:59.071951 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3314/6997] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:31:58 2022] GET /compute/v2.1/servers/3984d73b-0520-4591-9b30-a83a383e9062 => generated 1505 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:31:59.093587 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-8d09f99d-3b19-4db8-a7a6-5f8e8bb4b1d9 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:31:59.094221 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-8d09f99d-3b19-4db8-a7a6-5f8e8bb4b1d9 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] [instance: 3984d73b-0520-4591-9b30-a83a383e9062] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:31:59.100930 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8d09f99d-3b19-4db8-a7a6-5f8e8bb4b1d9 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:59.101472 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8d09f99d-3b19-4db8-a7a6-5f8e8bb4b1d9 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:59.101938 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8d09f99d-3b19-4db8-a7a6-5f8e8bb4b1d9 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:59.102673 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8d09f99d-3b19-4db8-a7a6-5f8e8bb4b1d9 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:59.103822 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8d09f99d-3b19-4db8-a7a6-5f8e8bb4b1d9 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:59.104275 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8d09f99d-3b19-4db8-a7a6-5f8e8bb4b1d9 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:59.243545 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-8d09f99d-3b19-4db8-a7a6-5f8e8bb4b1d9 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a20d5dbdbb74c0c9921ed0eecb688c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1025a52a7ef44d6b3727e87ea3dfcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:31:59.251321 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-8d09f99d-3b19-4db8-a7a6-5f8e8bb4b1d9 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] 10.222.0.43 "GET /compute/v2.1/servers/3984d73b-0520-4591-9b30-a83a383e9062" status: 200 len: 1505 microversion: 2.1 time: 0.161604 Oct 04 19:31:59.251902 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3684/6998] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:31:59 2022] GET /compute/v2.1/servers/3984d73b-0520-4591-9b30-a83a383e9062 => generated 1505 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:31:59.275386 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-9cbf81cb-b732-44ed-9027-5d087de14e5b tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:31:59.277661 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-9cbf81cb-b732-44ed-9027-5d087de14e5b tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] [instance: 3984d73b-0520-4591-9b30-a83a383e9062] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:31:59.283775 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9cbf81cb-b732-44ed-9027-5d087de14e5b tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:59.284267 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9cbf81cb-b732-44ed-9027-5d087de14e5b tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:59.284711 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9cbf81cb-b732-44ed-9027-5d087de14e5b tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:59.285441 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9cbf81cb-b732-44ed-9027-5d087de14e5b tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:59.285899 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9cbf81cb-b732-44ed-9027-5d087de14e5b tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:59.286333 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9cbf81cb-b732-44ed-9027-5d087de14e5b tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:59.315434 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-9cbf81cb-b732-44ed-9027-5d087de14e5b tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '3a20d5dbdbb74c0c9921ed0eecb688c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1025a52a7ef44d6b3727e87ea3dfcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:31:59.321049 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-9cbf81cb-b732-44ed-9027-5d087de14e5b tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] [instance: 3984d73b-0520-4591-9b30-a83a383e9062] Old instance type m1.heat2, new instance type m1.heat {{(pid=123595) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 04 19:31:59.328136 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-9cbf81cb-b732-44ed-9027-5d087de14e5b tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Flavor limits 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:31:59.328569 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-9cbf81cb-b732-44ed-9027-5d087de14e5b tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Image limits 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:31:59.329046 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-9cbf81cb-b732-44ed-9027-5d087de14e5b tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Flavor pref 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:31:59.329486 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-9cbf81cb-b732-44ed-9027-5d087de14e5b tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Image pref 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:31:59.329905 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-9cbf81cb-b732-44ed-9027-5d087de14e5b tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:31:59.393470 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-9cbf81cb-b732-44ed-9027-5d087de14e5b tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] 10.222.0.43 "POST /compute/v2.1/servers/3984d73b-0520-4591-9b30-a83a383e9062/action" status: 202 len: 0 microversion: 2.1 time: 0.122561 Oct 04 19:31:59.394500 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3315/6999] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 19:31:59 2022] POST /compute/v2.1/servers/3984d73b-0520-4591-9b30-a83a383e9062/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:31:59.403444 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-9810ead8-95b3-44b1-961f-fc5fd1d12f3e tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:31:59.404102 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-9810ead8-95b3-44b1-961f-fc5fd1d12f3e tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] [instance: 3984d73b-0520-4591-9b30-a83a383e9062] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:31:59.411112 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9810ead8-95b3-44b1-961f-fc5fd1d12f3e tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:59.411594 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9810ead8-95b3-44b1-961f-fc5fd1d12f3e tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:59.412047 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9810ead8-95b3-44b1-961f-fc5fd1d12f3e tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:59.412761 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9810ead8-95b3-44b1-961f-fc5fd1d12f3e tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:59.413264 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9810ead8-95b3-44b1-961f-fc5fd1d12f3e tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:59.413688 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9810ead8-95b3-44b1-961f-fc5fd1d12f3e tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:59.582203 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-9810ead8-95b3-44b1-961f-fc5fd1d12f3e tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a20d5dbdbb74c0c9921ed0eecb688c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1025a52a7ef44d6b3727e87ea3dfcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:31:59.584609 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:31:59.592583 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-9810ead8-95b3-44b1-961f-fc5fd1d12f3e tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] 10.222.0.43 "GET /compute/v2.1/servers/3984d73b-0520-4591-9b30-a83a383e9062" status: 200 len: 1516 microversion: 2.1 time: 0.193624 Oct 04 19:31:59.593418 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3685/7000] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:31:59 2022] GET /compute/v2.1/servers/3984d73b-0520-4591-9b30-a83a383e9062 => generated 1516 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:32:00.612970 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=2 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:32:00.617415 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-494c7fa8-0ca3-4de6-afcc-d50af101057e tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:32:00.618159 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-494c7fa8-0ca3-4de6-afcc-d50af101057e tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] [instance: 3984d73b-0520-4591-9b30-a83a383e9062] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:32:00.625731 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-494c7fa8-0ca3-4de6-afcc-d50af101057e tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:00.626225 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-494c7fa8-0ca3-4de6-afcc-d50af101057e tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:00.626771 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-494c7fa8-0ca3-4de6-afcc-d50af101057e tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:00.627499 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-494c7fa8-0ca3-4de6-afcc-d50af101057e tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:00.627962 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-494c7fa8-0ca3-4de6-afcc-d50af101057e tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:00.628450 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-494c7fa8-0ca3-4de6-afcc-d50af101057e tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:00.847077 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-494c7fa8-0ca3-4de6-afcc-d50af101057e tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a20d5dbdbb74c0c9921ed0eecb688c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1025a52a7ef44d6b3727e87ea3dfcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:32:00.855773 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-494c7fa8-0ca3-4de6-afcc-d50af101057e tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] 10.222.0.43 "GET /compute/v2.1/servers/3984d73b-0520-4591-9b30-a83a383e9062" status: 200 len: 1516 microversion: 2.1 time: 0.244485 Oct 04 19:32:00.856634 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3316/7001] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:32:00 2022] GET /compute/v2.1/servers/3984d73b-0520-4591-9b30-a83a383e9062 => generated 1516 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:32:01.878695 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-4214d1b6-c019-4320-8b2d-715f843e477b tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:32:01.879299 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-4214d1b6-c019-4320-8b2d-715f843e477b tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] [instance: 3984d73b-0520-4591-9b30-a83a383e9062] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:32:01.881492 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=2 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:32:01.882191 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=6 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:32:01.883950 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:32:01.891279 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4214d1b6-c019-4320-8b2d-715f843e477b tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:01.891779 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4214d1b6-c019-4320-8b2d-715f843e477b tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:01.892229 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4214d1b6-c019-4320-8b2d-715f843e477b tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:01.892933 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4214d1b6-c019-4320-8b2d-715f843e477b tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:01.893431 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4214d1b6-c019-4320-8b2d-715f843e477b tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:01.893892 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4214d1b6-c019-4320-8b2d-715f843e477b tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:02.031630 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-4214d1b6-c019-4320-8b2d-715f843e477b tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a20d5dbdbb74c0c9921ed0eecb688c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1025a52a7ef44d6b3727e87ea3dfcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:32:02.039493 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-4214d1b6-c019-4320-8b2d-715f843e477b tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] 10.222.0.43 "GET /compute/v2.1/servers/3984d73b-0520-4591-9b30-a83a383e9062" status: 200 len: 1521 microversion: 2.1 time: 0.164712 Oct 04 19:32:02.040073 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3686/7002] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:32:01 2022] GET /compute/v2.1/servers/3984d73b-0520-4591-9b30-a83a383e9062 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:32:03.063218 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-b031da7a-3ea8-4a07-8fd1-9b0a7b900f71 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:32:03.063828 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-b031da7a-3ea8-4a07-8fd1-9b0a7b900f71 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] [instance: 3984d73b-0520-4591-9b30-a83a383e9062] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:32:03.066661 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_api:SELECT=40 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:32:03.072128 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b031da7a-3ea8-4a07-8fd1-9b0a7b900f71 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:03.072602 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b031da7a-3ea8-4a07-8fd1-9b0a7b900f71 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:03.073038 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b031da7a-3ea8-4a07-8fd1-9b0a7b900f71 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:03.073778 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b031da7a-3ea8-4a07-8fd1-9b0a7b900f71 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:03.074231 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b031da7a-3ea8-4a07-8fd1-9b0a7b900f71 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:03.074655 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b031da7a-3ea8-4a07-8fd1-9b0a7b900f71 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:03.213793 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-b031da7a-3ea8-4a07-8fd1-9b0a7b900f71 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a20d5dbdbb74c0c9921ed0eecb688c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1025a52a7ef44d6b3727e87ea3dfcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:32:03.221503 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-b031da7a-3ea8-4a07-8fd1-9b0a7b900f71 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] 10.222.0.43 "GET /compute/v2.1/servers/3984d73b-0520-4591-9b30-a83a383e9062" status: 200 len: 1521 microversion: 2.1 time: 0.162104 Oct 04 19:32:03.222080 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3317/7003] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:32:03 2022] GET /compute/v2.1/servers/3984d73b-0520-4591-9b30-a83a383e9062 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:32:04.245043 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-c829bd9e-013e-4ff8-ac1c-f6432f57e2f2 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:32:04.245716 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-c829bd9e-013e-4ff8-ac1c-f6432f57e2f2 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] [instance: 3984d73b-0520-4591-9b30-a83a383e9062] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:32:04.252572 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c829bd9e-013e-4ff8-ac1c-f6432f57e2f2 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:04.253081 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c829bd9e-013e-4ff8-ac1c-f6432f57e2f2 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:04.253840 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c829bd9e-013e-4ff8-ac1c-f6432f57e2f2 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:04.254557 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c829bd9e-013e-4ff8-ac1c-f6432f57e2f2 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:04.255030 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c829bd9e-013e-4ff8-ac1c-f6432f57e2f2 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:04.255472 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c829bd9e-013e-4ff8-ac1c-f6432f57e2f2 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:04.387884 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-c829bd9e-013e-4ff8-ac1c-f6432f57e2f2 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a20d5dbdbb74c0c9921ed0eecb688c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1025a52a7ef44d6b3727e87ea3dfcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:32:04.396436 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-c829bd9e-013e-4ff8-ac1c-f6432f57e2f2 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] 10.222.0.43 "GET /compute/v2.1/servers/3984d73b-0520-4591-9b30-a83a383e9062" status: 200 len: 1521 microversion: 2.1 time: 0.155616 Oct 04 19:32:04.397294 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3687/7004] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:32:04 2022] GET /compute/v2.1/servers/3984d73b-0520-4591-9b30-a83a383e9062 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:32:05.419859 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-78eea54a-52f1-4083-8996-d5b97ef6b474 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:32:05.420505 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-78eea54a-52f1-4083-8996-d5b97ef6b474 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] [instance: 3984d73b-0520-4591-9b30-a83a383e9062] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:32:05.427349 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-78eea54a-52f1-4083-8996-d5b97ef6b474 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:05.427834 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-78eea54a-52f1-4083-8996-d5b97ef6b474 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:05.428271 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-78eea54a-52f1-4083-8996-d5b97ef6b474 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:05.428963 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-78eea54a-52f1-4083-8996-d5b97ef6b474 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:05.429443 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-78eea54a-52f1-4083-8996-d5b97ef6b474 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:05.429875 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-78eea54a-52f1-4083-8996-d5b97ef6b474 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:05.564303 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-78eea54a-52f1-4083-8996-d5b97ef6b474 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a20d5dbdbb74c0c9921ed0eecb688c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1025a52a7ef44d6b3727e87ea3dfcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:32:05.572546 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-78eea54a-52f1-4083-8996-d5b97ef6b474 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] 10.222.0.43 "GET /compute/v2.1/servers/3984d73b-0520-4591-9b30-a83a383e9062" status: 200 len: 1521 microversion: 2.1 time: 0.156532 Oct 04 19:32:05.573147 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3318/7005] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:32:05 2022] GET /compute/v2.1/servers/3984d73b-0520-4591-9b30-a83a383e9062 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:32:06.598666 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-83303646-5f7e-4991-bce9-3efb17040e20 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:32:06.599300 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-83303646-5f7e-4991-bce9-3efb17040e20 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] [instance: 3984d73b-0520-4591-9b30-a83a383e9062] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:32:06.606593 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-83303646-5f7e-4991-bce9-3efb17040e20 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:06.607141 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-83303646-5f7e-4991-bce9-3efb17040e20 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:06.607669 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-83303646-5f7e-4991-bce9-3efb17040e20 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:06.608423 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-83303646-5f7e-4991-bce9-3efb17040e20 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:06.608935 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-83303646-5f7e-4991-bce9-3efb17040e20 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:06.609419 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-83303646-5f7e-4991-bce9-3efb17040e20 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:06.746282 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-83303646-5f7e-4991-bce9-3efb17040e20 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a20d5dbdbb74c0c9921ed0eecb688c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1025a52a7ef44d6b3727e87ea3dfcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:32:06.754239 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-83303646-5f7e-4991-bce9-3efb17040e20 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] 10.222.0.43 "GET /compute/v2.1/servers/3984d73b-0520-4591-9b30-a83a383e9062" status: 200 len: 1521 microversion: 2.1 time: 0.159837 Oct 04 19:32:06.755056 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3688/7006] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:32:06 2022] GET /compute/v2.1/servers/3984d73b-0520-4591-9b30-a83a383e9062 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:32:07.778072 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-ef9a34ef-4328-4689-bfb1-d2fcb11e25e7 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:32:07.778711 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-ef9a34ef-4328-4689-bfb1-d2fcb11e25e7 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] [instance: 3984d73b-0520-4591-9b30-a83a383e9062] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:32:07.785566 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ef9a34ef-4328-4689-bfb1-d2fcb11e25e7 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:07.786047 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ef9a34ef-4328-4689-bfb1-d2fcb11e25e7 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:07.786484 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ef9a34ef-4328-4689-bfb1-d2fcb11e25e7 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:07.787170 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ef9a34ef-4328-4689-bfb1-d2fcb11e25e7 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:07.787620 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ef9a34ef-4328-4689-bfb1-d2fcb11e25e7 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:07.788045 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ef9a34ef-4328-4689-bfb1-d2fcb11e25e7 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:07.921194 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-ef9a34ef-4328-4689-bfb1-d2fcb11e25e7 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a20d5dbdbb74c0c9921ed0eecb688c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1025a52a7ef44d6b3727e87ea3dfcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:32:07.929209 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-ef9a34ef-4328-4689-bfb1-d2fcb11e25e7 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] 10.222.0.43 "GET /compute/v2.1/servers/3984d73b-0520-4591-9b30-a83a383e9062" status: 200 len: 1521 microversion: 2.1 time: 0.155627 Oct 04 19:32:07.929798 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3319/7007] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:32:07 2022] GET /compute/v2.1/servers/3984d73b-0520-4591-9b30-a83a383e9062 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:32:08.952442 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-af2aedde-4ad8-42a9-9e24-1ccfaa80bbc8 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:32:08.953137 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-af2aedde-4ad8-42a9-9e24-1ccfaa80bbc8 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] [instance: 3984d73b-0520-4591-9b30-a83a383e9062] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:32:08.960214 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-af2aedde-4ad8-42a9-9e24-1ccfaa80bbc8 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:08.960717 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-af2aedde-4ad8-42a9-9e24-1ccfaa80bbc8 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:08.961196 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-af2aedde-4ad8-42a9-9e24-1ccfaa80bbc8 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:08.962596 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-af2aedde-4ad8-42a9-9e24-1ccfaa80bbc8 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:08.963065 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-af2aedde-4ad8-42a9-9e24-1ccfaa80bbc8 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:08.963606 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-af2aedde-4ad8-42a9-9e24-1ccfaa80bbc8 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:09.099441 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-af2aedde-4ad8-42a9-9e24-1ccfaa80bbc8 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a20d5dbdbb74c0c9921ed0eecb688c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1025a52a7ef44d6b3727e87ea3dfcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:32:09.107718 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-af2aedde-4ad8-42a9-9e24-1ccfaa80bbc8 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] 10.222.0.43 "GET /compute/v2.1/servers/3984d73b-0520-4591-9b30-a83a383e9062" status: 200 len: 1521 microversion: 2.1 time: 0.159145 Oct 04 19:32:09.108368 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3689/7008] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:32:08 2022] GET /compute/v2.1/servers/3984d73b-0520-4591-9b30-a83a383e9062 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:32:10.130942 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-f329ae42-1276-4b59-8c78-00a09230a8e5 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:32:10.131554 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-f329ae42-1276-4b59-8c78-00a09230a8e5 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] [instance: 3984d73b-0520-4591-9b30-a83a383e9062] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:32:10.138915 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f329ae42-1276-4b59-8c78-00a09230a8e5 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:10.139400 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f329ae42-1276-4b59-8c78-00a09230a8e5 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:10.139839 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f329ae42-1276-4b59-8c78-00a09230a8e5 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:10.140538 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f329ae42-1276-4b59-8c78-00a09230a8e5 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:10.140990 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f329ae42-1276-4b59-8c78-00a09230a8e5 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:10.141444 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f329ae42-1276-4b59-8c78-00a09230a8e5 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:10.272107 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-f329ae42-1276-4b59-8c78-00a09230a8e5 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a20d5dbdbb74c0c9921ed0eecb688c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1025a52a7ef44d6b3727e87ea3dfcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:32:10.280385 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-f329ae42-1276-4b59-8c78-00a09230a8e5 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] 10.222.0.43 "GET /compute/v2.1/servers/3984d73b-0520-4591-9b30-a83a383e9062" status: 200 len: 1521 microversion: 2.1 time: 0.153295 Oct 04 19:32:10.280949 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3320/7009] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:32:10 2022] GET /compute/v2.1/servers/3984d73b-0520-4591-9b30-a83a383e9062 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:32:11.304041 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-1ffd623b-010e-4abe-9d3a-f6b0c48fa04c tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:32:11.304643 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-1ffd623b-010e-4abe-9d3a-f6b0c48fa04c tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] [instance: 3984d73b-0520-4591-9b30-a83a383e9062] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:32:11.312252 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1ffd623b-010e-4abe-9d3a-f6b0c48fa04c tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:11.312759 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1ffd623b-010e-4abe-9d3a-f6b0c48fa04c tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:11.313258 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1ffd623b-010e-4abe-9d3a-f6b0c48fa04c tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:11.313975 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1ffd623b-010e-4abe-9d3a-f6b0c48fa04c tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:11.314448 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1ffd623b-010e-4abe-9d3a-f6b0c48fa04c tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:11.314895 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1ffd623b-010e-4abe-9d3a-f6b0c48fa04c tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:11.456981 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-1ffd623b-010e-4abe-9d3a-f6b0c48fa04c tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a20d5dbdbb74c0c9921ed0eecb688c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1025a52a7ef44d6b3727e87ea3dfcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:32:11.464844 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-1ffd623b-010e-4abe-9d3a-f6b0c48fa04c tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] 10.222.0.43 "GET /compute/v2.1/servers/3984d73b-0520-4591-9b30-a83a383e9062" status: 200 len: 1521 microversion: 2.1 time: 0.164868 Oct 04 19:32:11.465436 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3690/7010] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:32:11 2022] GET /compute/v2.1/servers/3984d73b-0520-4591-9b30-a83a383e9062 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:32:12.487819 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-d8828160-61ef-4e5d-a844-a26d1b1644c1 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:32:12.488441 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-d8828160-61ef-4e5d-a844-a26d1b1644c1 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] [instance: 3984d73b-0520-4591-9b30-a83a383e9062] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:32:12.495935 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d8828160-61ef-4e5d-a844-a26d1b1644c1 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:12.496424 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d8828160-61ef-4e5d-a844-a26d1b1644c1 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:12.496867 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d8828160-61ef-4e5d-a844-a26d1b1644c1 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:12.497603 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d8828160-61ef-4e5d-a844-a26d1b1644c1 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:12.498061 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d8828160-61ef-4e5d-a844-a26d1b1644c1 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:12.498492 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d8828160-61ef-4e5d-a844-a26d1b1644c1 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:12.631826 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-d8828160-61ef-4e5d-a844-a26d1b1644c1 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a20d5dbdbb74c0c9921ed0eecb688c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1025a52a7ef44d6b3727e87ea3dfcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:32:12.640122 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-d8828160-61ef-4e5d-a844-a26d1b1644c1 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] 10.222.0.43 "GET /compute/v2.1/servers/3984d73b-0520-4591-9b30-a83a383e9062" status: 200 len: 1521 microversion: 2.1 time: 0.156195 Oct 04 19:32:12.640700 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3321/7011] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:32:12 2022] GET /compute/v2.1/servers/3984d73b-0520-4591-9b30-a83a383e9062 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:32:13.662997 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-3ccbbfc7-a8b0-44c2-b2fd-737e87c3f962 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:32:13.663555 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-3ccbbfc7-a8b0-44c2-b2fd-737e87c3f962 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] [instance: 3984d73b-0520-4591-9b30-a83a383e9062] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:32:13.670673 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3ccbbfc7-a8b0-44c2-b2fd-737e87c3f962 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:13.671168 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3ccbbfc7-a8b0-44c2-b2fd-737e87c3f962 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:13.671616 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3ccbbfc7-a8b0-44c2-b2fd-737e87c3f962 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:13.672327 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3ccbbfc7-a8b0-44c2-b2fd-737e87c3f962 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:13.672790 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3ccbbfc7-a8b0-44c2-b2fd-737e87c3f962 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:13.673261 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3ccbbfc7-a8b0-44c2-b2fd-737e87c3f962 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:13.808736 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-3ccbbfc7-a8b0-44c2-b2fd-737e87c3f962 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a20d5dbdbb74c0c9921ed0eecb688c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1025a52a7ef44d6b3727e87ea3dfcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:32:13.816614 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-3ccbbfc7-a8b0-44c2-b2fd-737e87c3f962 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] 10.222.0.43 "GET /compute/v2.1/servers/3984d73b-0520-4591-9b30-a83a383e9062" status: 200 len: 1521 microversion: 2.1 time: 0.157731 Oct 04 19:32:13.817191 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3691/7012] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:32:13 2022] GET /compute/v2.1/servers/3984d73b-0520-4591-9b30-a83a383e9062 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:32:14.840256 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-6e576e5f-e4aa-45a3-934b-6bd63eb53e89 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:32:14.840879 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-6e576e5f-e4aa-45a3-934b-6bd63eb53e89 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] [instance: 3984d73b-0520-4591-9b30-a83a383e9062] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:32:14.848111 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6e576e5f-e4aa-45a3-934b-6bd63eb53e89 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:14.848597 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6e576e5f-e4aa-45a3-934b-6bd63eb53e89 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:14.849037 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6e576e5f-e4aa-45a3-934b-6bd63eb53e89 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:14.849761 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6e576e5f-e4aa-45a3-934b-6bd63eb53e89 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:14.850223 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6e576e5f-e4aa-45a3-934b-6bd63eb53e89 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:14.850651 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6e576e5f-e4aa-45a3-934b-6bd63eb53e89 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:14.983399 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-6e576e5f-e4aa-45a3-934b-6bd63eb53e89 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a20d5dbdbb74c0c9921ed0eecb688c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1025a52a7ef44d6b3727e87ea3dfcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:32:14.991568 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-6e576e5f-e4aa-45a3-934b-6bd63eb53e89 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] 10.222.0.43 "GET /compute/v2.1/servers/3984d73b-0520-4591-9b30-a83a383e9062" status: 200 len: 1521 microversion: 2.1 time: 0.155655 Oct 04 19:32:14.992186 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3322/7013] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:32:14 2022] GET /compute/v2.1/servers/3984d73b-0520-4591-9b30-a83a383e9062 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:32:16.015417 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-50c8e152-1371-4a8c-8ac0-27914db07b7a tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:32:16.016051 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-50c8e152-1371-4a8c-8ac0-27914db07b7a tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] [instance: 3984d73b-0520-4591-9b30-a83a383e9062] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:32:16.022647 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-50c8e152-1371-4a8c-8ac0-27914db07b7a tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:16.023153 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-50c8e152-1371-4a8c-8ac0-27914db07b7a tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:16.023610 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-50c8e152-1371-4a8c-8ac0-27914db07b7a tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:16.024896 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-50c8e152-1371-4a8c-8ac0-27914db07b7a tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:16.025530 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-50c8e152-1371-4a8c-8ac0-27914db07b7a tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:16.025992 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-50c8e152-1371-4a8c-8ac0-27914db07b7a tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:16.156474 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-50c8e152-1371-4a8c-8ac0-27914db07b7a tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a20d5dbdbb74c0c9921ed0eecb688c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1025a52a7ef44d6b3727e87ea3dfcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:32:16.164326 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-50c8e152-1371-4a8c-8ac0-27914db07b7a tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] 10.222.0.43 "GET /compute/v2.1/servers/3984d73b-0520-4591-9b30-a83a383e9062" status: 200 len: 1521 microversion: 2.1 time: 0.152971 Oct 04 19:32:16.164904 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3692/7014] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:32:16 2022] GET /compute/v2.1/servers/3984d73b-0520-4591-9b30-a83a383e9062 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:32:17.188979 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-18d8df49-46cc-4424-a9a8-1420e6604644 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:32:17.189632 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-18d8df49-46cc-4424-a9a8-1420e6604644 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] [instance: 3984d73b-0520-4591-9b30-a83a383e9062] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:32:17.196896 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-18d8df49-46cc-4424-a9a8-1420e6604644 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:17.197436 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-18d8df49-46cc-4424-a9a8-1420e6604644 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:17.197875 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-18d8df49-46cc-4424-a9a8-1420e6604644 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:17.198568 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-18d8df49-46cc-4424-a9a8-1420e6604644 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:17.199021 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-18d8df49-46cc-4424-a9a8-1420e6604644 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:17.199444 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-18d8df49-46cc-4424-a9a8-1420e6604644 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:17.331607 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-18d8df49-46cc-4424-a9a8-1420e6604644 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a20d5dbdbb74c0c9921ed0eecb688c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1025a52a7ef44d6b3727e87ea3dfcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:32:17.339955 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-18d8df49-46cc-4424-a9a8-1420e6604644 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] 10.222.0.43 "GET /compute/v2.1/servers/3984d73b-0520-4591-9b30-a83a383e9062" status: 200 len: 1521 microversion: 2.1 time: 0.154883 Oct 04 19:32:17.340541 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3323/7015] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:32:17 2022] GET /compute/v2.1/servers/3984d73b-0520-4591-9b30-a83a383e9062 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:32:18.363688 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-db00fac7-0b98-44eb-a451-289b9d8278fd tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:32:18.364319 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-db00fac7-0b98-44eb-a451-289b9d8278fd tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] [instance: 3984d73b-0520-4591-9b30-a83a383e9062] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:32:18.371222 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-db00fac7-0b98-44eb-a451-289b9d8278fd tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:18.371727 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-db00fac7-0b98-44eb-a451-289b9d8278fd tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:18.372184 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-db00fac7-0b98-44eb-a451-289b9d8278fd tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:18.372900 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-db00fac7-0b98-44eb-a451-289b9d8278fd tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:18.373403 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-db00fac7-0b98-44eb-a451-289b9d8278fd tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:18.373852 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-db00fac7-0b98-44eb-a451-289b9d8278fd tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:18.508543 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-db00fac7-0b98-44eb-a451-289b9d8278fd tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a20d5dbdbb74c0c9921ed0eecb688c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1025a52a7ef44d6b3727e87ea3dfcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:32:18.516779 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-db00fac7-0b98-44eb-a451-289b9d8278fd tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] 10.222.0.43 "GET /compute/v2.1/servers/3984d73b-0520-4591-9b30-a83a383e9062" status: 200 len: 1521 microversion: 2.1 time: 0.156765 Oct 04 19:32:18.517020 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3693/7016] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:32:18 2022] GET /compute/v2.1/servers/3984d73b-0520-4591-9b30-a83a383e9062 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:32:19.539766 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-51ee3792-b6f0-4b88-b3e8-a180df21759f tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:32:19.540381 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-51ee3792-b6f0-4b88-b3e8-a180df21759f tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] [instance: 3984d73b-0520-4591-9b30-a83a383e9062] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:32:19.547187 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-51ee3792-b6f0-4b88-b3e8-a180df21759f tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:19.547666 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-51ee3792-b6f0-4b88-b3e8-a180df21759f tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:19.548107 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-51ee3792-b6f0-4b88-b3e8-a180df21759f tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:19.548797 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-51ee3792-b6f0-4b88-b3e8-a180df21759f tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:19.549280 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-51ee3792-b6f0-4b88-b3e8-a180df21759f tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:19.549712 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-51ee3792-b6f0-4b88-b3e8-a180df21759f tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:19.553702 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:32:19.685489 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-51ee3792-b6f0-4b88-b3e8-a180df21759f tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a20d5dbdbb74c0c9921ed0eecb688c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1025a52a7ef44d6b3727e87ea3dfcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:32:19.693236 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-51ee3792-b6f0-4b88-b3e8-a180df21759f tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] 10.222.0.43 "GET /compute/v2.1/servers/3984d73b-0520-4591-9b30-a83a383e9062" status: 200 len: 1521 microversion: 2.1 time: 0.157272 Oct 04 19:32:19.693805 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3324/7017] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:32:19 2022] GET /compute/v2.1/servers/3984d73b-0520-4591-9b30-a83a383e9062 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:32:20.716397 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f217c4f4-2172-4b1e-b68c-41ba2f900010 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:32:20.716997 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-f217c4f4-2172-4b1e-b68c-41ba2f900010 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] [instance: 3984d73b-0520-4591-9b30-a83a383e9062] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:32:20.724168 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f217c4f4-2172-4b1e-b68c-41ba2f900010 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:20.724664 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f217c4f4-2172-4b1e-b68c-41ba2f900010 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:20.725210 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f217c4f4-2172-4b1e-b68c-41ba2f900010 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:20.725917 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f217c4f4-2172-4b1e-b68c-41ba2f900010 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:20.726379 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f217c4f4-2172-4b1e-b68c-41ba2f900010 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:20.727455 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f217c4f4-2172-4b1e-b68c-41ba2f900010 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:20.857075 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-f217c4f4-2172-4b1e-b68c-41ba2f900010 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a20d5dbdbb74c0c9921ed0eecb688c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1025a52a7ef44d6b3727e87ea3dfcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:32:20.865087 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-f217c4f4-2172-4b1e-b68c-41ba2f900010 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] 10.222.0.43 "GET /compute/v2.1/servers/3984d73b-0520-4591-9b30-a83a383e9062" status: 200 len: 1521 microversion: 2.1 time: 0.152650 Oct 04 19:32:20.865681 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3694/7018] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:32:20 2022] GET /compute/v2.1/servers/3984d73b-0520-4591-9b30-a83a383e9062 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:32:21.888674 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-f9f54ae0-1da5-46e9-b071-44f7f1ae07e9 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:32:21.889330 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-f9f54ae0-1da5-46e9-b071-44f7f1ae07e9 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] [instance: 3984d73b-0520-4591-9b30-a83a383e9062] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:32:21.896172 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f9f54ae0-1da5-46e9-b071-44f7f1ae07e9 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:21.896656 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f9f54ae0-1da5-46e9-b071-44f7f1ae07e9 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:21.897092 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f9f54ae0-1da5-46e9-b071-44f7f1ae07e9 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:21.897809 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f9f54ae0-1da5-46e9-b071-44f7f1ae07e9 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:21.898256 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f9f54ae0-1da5-46e9-b071-44f7f1ae07e9 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:21.898679 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f9f54ae0-1da5-46e9-b071-44f7f1ae07e9 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:22.027947 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-f9f54ae0-1da5-46e9-b071-44f7f1ae07e9 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a20d5dbdbb74c0c9921ed0eecb688c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1025a52a7ef44d6b3727e87ea3dfcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:32:22.035560 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-f9f54ae0-1da5-46e9-b071-44f7f1ae07e9 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] 10.222.0.43 "GET /compute/v2.1/servers/3984d73b-0520-4591-9b30-a83a383e9062" status: 200 len: 1521 microversion: 2.1 time: 0.150848 Oct 04 19:32:22.036127 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3325/7019] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:32:21 2022] GET /compute/v2.1/servers/3984d73b-0520-4591-9b30-a83a383e9062 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:32:23.059321 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-225c8cd5-3b71-4728-860b-739aeea66372 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:32:23.059958 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-225c8cd5-3b71-4728-860b-739aeea66372 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] [instance: 3984d73b-0520-4591-9b30-a83a383e9062] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:32:23.066968 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-225c8cd5-3b71-4728-860b-739aeea66372 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:23.067476 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-225c8cd5-3b71-4728-860b-739aeea66372 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:23.067935 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-225c8cd5-3b71-4728-860b-739aeea66372 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:23.068656 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-225c8cd5-3b71-4728-860b-739aeea66372 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:23.069147 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-225c8cd5-3b71-4728-860b-739aeea66372 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:23.069598 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-225c8cd5-3b71-4728-860b-739aeea66372 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:23.204647 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-225c8cd5-3b71-4728-860b-739aeea66372 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a20d5dbdbb74c0c9921ed0eecb688c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1025a52a7ef44d6b3727e87ea3dfcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:32:23.212553 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-225c8cd5-3b71-4728-860b-739aeea66372 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] 10.222.0.43 "GET /compute/v2.1/servers/3984d73b-0520-4591-9b30-a83a383e9062" status: 200 len: 1521 microversion: 2.1 time: 0.157163 Oct 04 19:32:23.213153 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3695/7020] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:32:23 2022] GET /compute/v2.1/servers/3984d73b-0520-4591-9b30-a83a383e9062 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:32:24.236365 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-19b8eebd-d5e8-42f8-b382-904b69dfa5ed tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:32:24.236978 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-19b8eebd-d5e8-42f8-b382-904b69dfa5ed tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] [instance: 3984d73b-0520-4591-9b30-a83a383e9062] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:32:24.243989 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-19b8eebd-d5e8-42f8-b382-904b69dfa5ed tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:24.244473 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-19b8eebd-d5e8-42f8-b382-904b69dfa5ed tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:24.244912 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-19b8eebd-d5e8-42f8-b382-904b69dfa5ed tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:24.245637 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-19b8eebd-d5e8-42f8-b382-904b69dfa5ed tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:24.246089 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-19b8eebd-d5e8-42f8-b382-904b69dfa5ed tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:24.246517 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-19b8eebd-d5e8-42f8-b382-904b69dfa5ed tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:24.375732 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-19b8eebd-d5e8-42f8-b382-904b69dfa5ed tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a20d5dbdbb74c0c9921ed0eecb688c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1025a52a7ef44d6b3727e87ea3dfcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:32:24.384004 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-19b8eebd-d5e8-42f8-b382-904b69dfa5ed tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] 10.222.0.43 "GET /compute/v2.1/servers/3984d73b-0520-4591-9b30-a83a383e9062" status: 200 len: 1521 microversion: 2.1 time: 0.151563 Oct 04 19:32:24.384582 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3326/7021] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:32:24 2022] GET /compute/v2.1/servers/3984d73b-0520-4591-9b30-a83a383e9062 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:32:25.407221 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-455175ab-249b-47ea-899a-6cf9e693fa8c tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:32:25.407873 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-455175ab-249b-47ea-899a-6cf9e693fa8c tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] [instance: 3984d73b-0520-4591-9b30-a83a383e9062] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:32:25.414941 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-455175ab-249b-47ea-899a-6cf9e693fa8c tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:25.415441 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-455175ab-249b-47ea-899a-6cf9e693fa8c tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:25.415890 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-455175ab-249b-47ea-899a-6cf9e693fa8c tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:25.416595 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-455175ab-249b-47ea-899a-6cf9e693fa8c tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:25.417056 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-455175ab-249b-47ea-899a-6cf9e693fa8c tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:25.417521 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-455175ab-249b-47ea-899a-6cf9e693fa8c tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:25.555744 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-455175ab-249b-47ea-899a-6cf9e693fa8c tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a20d5dbdbb74c0c9921ed0eecb688c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1025a52a7ef44d6b3727e87ea3dfcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:32:25.563500 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-455175ab-249b-47ea-899a-6cf9e693fa8c tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] 10.222.0.43 "GET /compute/v2.1/servers/3984d73b-0520-4591-9b30-a83a383e9062" status: 200 len: 1521 microversion: 2.1 time: 0.160254 Oct 04 19:32:25.564070 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3696/7022] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:32:25 2022] GET /compute/v2.1/servers/3984d73b-0520-4591-9b30-a83a383e9062 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:32:26.587241 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-09900302-f727-42ba-bda2-4c7782da52ab tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:32:26.587850 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-09900302-f727-42ba-bda2-4c7782da52ab tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] [instance: 3984d73b-0520-4591-9b30-a83a383e9062] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:32:26.594888 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-09900302-f727-42ba-bda2-4c7782da52ab tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:26.595375 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-09900302-f727-42ba-bda2-4c7782da52ab tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:26.595850 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-09900302-f727-42ba-bda2-4c7782da52ab tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:26.596590 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-09900302-f727-42ba-bda2-4c7782da52ab tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:26.597049 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-09900302-f727-42ba-bda2-4c7782da52ab tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:26.597765 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-09900302-f727-42ba-bda2-4c7782da52ab tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:26.731904 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-09900302-f727-42ba-bda2-4c7782da52ab tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a20d5dbdbb74c0c9921ed0eecb688c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1025a52a7ef44d6b3727e87ea3dfcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:32:26.739764 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-09900302-f727-42ba-bda2-4c7782da52ab tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] 10.222.0.43 "GET /compute/v2.1/servers/3984d73b-0520-4591-9b30-a83a383e9062" status: 200 len: 1521 microversion: 2.1 time: 0.156985 Oct 04 19:32:26.740321 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3327/7023] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:32:26 2022] GET /compute/v2.1/servers/3984d73b-0520-4591-9b30-a83a383e9062 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:32:27.764109 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-59374612-82f6-458d-9253-5b921573c69b tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:32:27.764753 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-59374612-82f6-458d-9253-5b921573c69b tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] [instance: 3984d73b-0520-4591-9b30-a83a383e9062] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:32:27.771649 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-59374612-82f6-458d-9253-5b921573c69b tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:27.772155 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-59374612-82f6-458d-9253-5b921573c69b tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:27.772617 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-59374612-82f6-458d-9253-5b921573c69b tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:27.773988 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-59374612-82f6-458d-9253-5b921573c69b tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:27.774458 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-59374612-82f6-458d-9253-5b921573c69b tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:27.774905 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-59374612-82f6-458d-9253-5b921573c69b tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:27.908228 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-59374612-82f6-458d-9253-5b921573c69b tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a20d5dbdbb74c0c9921ed0eecb688c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1025a52a7ef44d6b3727e87ea3dfcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:32:27.916032 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-59374612-82f6-458d-9253-5b921573c69b tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] 10.222.0.43 "GET /compute/v2.1/servers/3984d73b-0520-4591-9b30-a83a383e9062" status: 200 len: 1521 microversion: 2.1 time: 0.155930 Oct 04 19:32:27.916610 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3697/7024] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:32:27 2022] GET /compute/v2.1/servers/3984d73b-0520-4591-9b30-a83a383e9062 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:32:28.939096 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-ac1ab956-f1ba-4e17-b7ce-e0e8b6012a48 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:32:28.939712 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-ac1ab956-f1ba-4e17-b7ce-e0e8b6012a48 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] [instance: 3984d73b-0520-4591-9b30-a83a383e9062] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:32:28.945927 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ac1ab956-f1ba-4e17-b7ce-e0e8b6012a48 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:28.946418 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ac1ab956-f1ba-4e17-b7ce-e0e8b6012a48 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:28.946892 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ac1ab956-f1ba-4e17-b7ce-e0e8b6012a48 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:28.947565 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ac1ab956-f1ba-4e17-b7ce-e0e8b6012a48 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:28.948025 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ac1ab956-f1ba-4e17-b7ce-e0e8b6012a48 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:28.948456 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ac1ab956-f1ba-4e17-b7ce-e0e8b6012a48 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:29.166225 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-ac1ab956-f1ba-4e17-b7ce-e0e8b6012a48 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a20d5dbdbb74c0c9921ed0eecb688c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1025a52a7ef44d6b3727e87ea3dfcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:32:29.172642 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-a7043aed-b449-4749-954f-d893725c20b6 req-faee6ec8-1c5c-4090-b354-6b7955030fe9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3984d73b-0520-4591-9b30-a83a383e9062", "name": "network-vif-unplugged", "status": "completed", "tag": "19d0dd08-7ec8-4e2e-bae0-bffbdb80e286"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:32:29.186057 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-ac1ab956-f1ba-4e17-b7ce-e0e8b6012a48 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] 10.222.0.43 "GET /compute/v2.1/servers/3984d73b-0520-4591-9b30-a83a383e9062" status: 200 len: 1520 microversion: 2.1 time: 0.251049 Oct 04 19:32:29.197197 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3328/7025] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:32:28 2022] GET /compute/v2.1/servers/3984d73b-0520-4591-9b30-a83a383e9062 => generated 1520 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:32:29.197446 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-a7043aed-b449-4749-954f-d893725c20b6 req-faee6ec8-1c5c-4090-b354-6b7955030fe9 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:29.197446 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-a7043aed-b449-4749-954f-d893725c20b6 req-faee6ec8-1c5c-4090-b354-6b7955030fe9 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:29.197446 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-a7043aed-b449-4749-954f-d893725c20b6 req-faee6ec8-1c5c-4090-b354-6b7955030fe9 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:29.201617 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-a7043aed-b449-4749-954f-d893725c20b6 req-faee6ec8-1c5c-4090-b354-6b7955030fe9 service nova] Creating event network-vif-unplugged:19d0dd08-7ec8-4e2e-bae0-bffbdb80e286 for instance 3984d73b-0520-4591-9b30-a83a383e9062 on n-h2-851028-13 Oct 04 19:32:29.208185 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [req-a7043aed-b449-4749-954f-d893725c20b6 req-faee6ec8-1c5c-4090-b354-6b7955030fe9 service nova] Instance 3984d73b-0520-4591-9b30-a83a383e9062 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851028-13', 'n-h2-851028-13'} {{(pid=123596) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 19:32:29.221133 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-a7043aed-b449-4749-954f-d893725c20b6 req-faee6ec8-1c5c-4090-b354-6b7955030fe9 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.051880 Oct 04 19:32:29.221792 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3698/7026] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:32:29 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:32:30.210524 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-7bc8c32a-e804-4560-b0dd-5ae5a66b3786 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:32:30.211136 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-7bc8c32a-e804-4560-b0dd-5ae5a66b3786 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] [instance: 3984d73b-0520-4591-9b30-a83a383e9062] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:32:30.218086 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7bc8c32a-e804-4560-b0dd-5ae5a66b3786 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:30.218504 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7bc8c32a-e804-4560-b0dd-5ae5a66b3786 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:30.218937 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7bc8c32a-e804-4560-b0dd-5ae5a66b3786 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:30.219623 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7bc8c32a-e804-4560-b0dd-5ae5a66b3786 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:30.220077 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7bc8c32a-e804-4560-b0dd-5ae5a66b3786 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:30.220503 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7bc8c32a-e804-4560-b0dd-5ae5a66b3786 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:30.359930 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-7bc8c32a-e804-4560-b0dd-5ae5a66b3786 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a20d5dbdbb74c0c9921ed0eecb688c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1025a52a7ef44d6b3727e87ea3dfcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:32:30.370905 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-7bc8c32a-e804-4560-b0dd-5ae5a66b3786 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] 10.222.0.43 "GET /compute/v2.1/servers/3984d73b-0520-4591-9b30-a83a383e9062" status: 200 len: 1518 microversion: 2.1 time: 0.164123 Oct 04 19:32:30.371632 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3329/7027] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:32:30 2022] GET /compute/v2.1/servers/3984d73b-0520-4591-9b30-a83a383e9062 => generated 1518 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:32:31.246843 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-753fa500-9dcc-405f-a8c2-e9e2d00e9c6b req-9bccc64b-edd7-4c27-bcb3-282ad98dfcf6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3984d73b-0520-4591-9b30-a83a383e9062", "tag": "19d0dd08-7ec8-4e2e-bae0-bffbdb80e286"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:32:31.258837 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-753fa500-9dcc-405f-a8c2-e9e2d00e9c6b req-9bccc64b-edd7-4c27-bcb3-282ad98dfcf6 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:31.259420 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-753fa500-9dcc-405f-a8c2-e9e2d00e9c6b req-9bccc64b-edd7-4c27-bcb3-282ad98dfcf6 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:31.259913 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-753fa500-9dcc-405f-a8c2-e9e2d00e9c6b req-9bccc64b-edd7-4c27-bcb3-282ad98dfcf6 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:31.272118 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-753fa500-9dcc-405f-a8c2-e9e2d00e9c6b req-9bccc64b-edd7-4c27-bcb3-282ad98dfcf6 service nova] Creating event network-changed:19d0dd08-7ec8-4e2e-bae0-bffbdb80e286 for instance 3984d73b-0520-4591-9b30-a83a383e9062 on n-h2-851028-13 Oct 04 19:32:31.277574 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [req-753fa500-9dcc-405f-a8c2-e9e2d00e9c6b req-9bccc64b-edd7-4c27-bcb3-282ad98dfcf6 service nova] Instance 3984d73b-0520-4591-9b30-a83a383e9062 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851028-13', 'n-h2-851028-13'} {{(pid=123596) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 19:32:31.294998 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-753fa500-9dcc-405f-a8c2-e9e2d00e9c6b req-9bccc64b-edd7-4c27-bcb3-282ad98dfcf6 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053797 Oct 04 19:32:31.297278 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3699/7028] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:32:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:32:31.394880 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-31efa00d-fa1e-4efe-8cc0-69865291ef0d tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:32:31.395707 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-31efa00d-fa1e-4efe-8cc0-69865291ef0d tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] [instance: 3984d73b-0520-4591-9b30-a83a383e9062] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:32:31.403170 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-31efa00d-fa1e-4efe-8cc0-69865291ef0d tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:31.403669 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-31efa00d-fa1e-4efe-8cc0-69865291ef0d tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:31.404113 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-31efa00d-fa1e-4efe-8cc0-69865291ef0d tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:31.404917 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-31efa00d-fa1e-4efe-8cc0-69865291ef0d tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:31.405407 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-31efa00d-fa1e-4efe-8cc0-69865291ef0d tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:31.405881 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-31efa00d-fa1e-4efe-8cc0-69865291ef0d tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:31.694412 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-31efa00d-fa1e-4efe-8cc0-69865291ef0d tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a20d5dbdbb74c0c9921ed0eecb688c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1025a52a7ef44d6b3727e87ea3dfcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:32:31.702926 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-31efa00d-fa1e-4efe-8cc0-69865291ef0d tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] 10.222.0.43 "GET /compute/v2.1/servers/3984d73b-0520-4591-9b30-a83a383e9062" status: 200 len: 1518 microversion: 2.1 time: 0.312379 Oct 04 19:32:31.703437 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3330/7029] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:32:31 2022] GET /compute/v2.1/servers/3984d73b-0520-4591-9b30-a83a383e9062 => generated 1518 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:32:32.728752 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-518a506c-5591-4ae9-b3c5-c758a10eab41 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:32:32.729490 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-518a506c-5591-4ae9-b3c5-c758a10eab41 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] [instance: 3984d73b-0520-4591-9b30-a83a383e9062] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:32:32.731437 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_api:SELECT=28 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:32:32.736924 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-518a506c-5591-4ae9-b3c5-c758a10eab41 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:32.737459 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-518a506c-5591-4ae9-b3c5-c758a10eab41 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:32.737909 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-518a506c-5591-4ae9-b3c5-c758a10eab41 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:32.738610 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-518a506c-5591-4ae9-b3c5-c758a10eab41 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:32.739075 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-518a506c-5591-4ae9-b3c5-c758a10eab41 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:32.739514 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-518a506c-5591-4ae9-b3c5-c758a10eab41 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:32.742790 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=82 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:32:32.881627 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-518a506c-5591-4ae9-b3c5-c758a10eab41 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a20d5dbdbb74c0c9921ed0eecb688c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1025a52a7ef44d6b3727e87ea3dfcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:32:32.889443 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-518a506c-5591-4ae9-b3c5-c758a10eab41 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] 10.222.0.43 "GET /compute/v2.1/servers/3984d73b-0520-4591-9b30-a83a383e9062" status: 200 len: 1515 microversion: 2.1 time: 0.165738 Oct 04 19:32:32.890043 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3700/7030] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:32:32 2022] GET /compute/v2.1/servers/3984d73b-0520-4591-9b30-a83a383e9062 => generated 1515 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:32:32.911968 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-1471c03a-541f-4fa9-804f-e1b284beb283 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:32:32.912515 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-1471c03a-541f-4fa9-804f-e1b284beb283 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] [instance: 3984d73b-0520-4591-9b30-a83a383e9062] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:32:32.919889 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1471c03a-541f-4fa9-804f-e1b284beb283 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:32.920367 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1471c03a-541f-4fa9-804f-e1b284beb283 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:32.920800 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1471c03a-541f-4fa9-804f-e1b284beb283 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:32.921609 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1471c03a-541f-4fa9-804f-e1b284beb283 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:32.922057 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1471c03a-541f-4fa9-804f-e1b284beb283 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:32.922484 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1471c03a-541f-4fa9-804f-e1b284beb283 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:32.981610 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-1471c03a-541f-4fa9-804f-e1b284beb283 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] 10.222.0.43 "POST /compute/v2.1/servers/3984d73b-0520-4591-9b30-a83a383e9062/action" status: 204 len: 0 microversion: 2.1 time: 0.073245 Oct 04 19:32:32.982290 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3331/7031] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 19:32:32 2022] POST /compute/v2.1/servers/3984d73b-0520-4591-9b30-a83a383e9062/action => generated 0 bytes in 75 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:32:32.990527 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-051e90e5-4b26-41f7-bf8a-b9b52bf3f3b1 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:32:32.991314 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-051e90e5-4b26-41f7-bf8a-b9b52bf3f3b1 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] [instance: 3984d73b-0520-4591-9b30-a83a383e9062] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:32:32.997922 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-051e90e5-4b26-41f7-bf8a-b9b52bf3f3b1 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:32.998436 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-051e90e5-4b26-41f7-bf8a-b9b52bf3f3b1 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:32.998944 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-051e90e5-4b26-41f7-bf8a-b9b52bf3f3b1 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:32.999687 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-051e90e5-4b26-41f7-bf8a-b9b52bf3f3b1 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:33.000221 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-051e90e5-4b26-41f7-bf8a-b9b52bf3f3b1 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:33.000747 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-051e90e5-4b26-41f7-bf8a-b9b52bf3f3b1 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:33.140195 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-051e90e5-4b26-41f7-bf8a-b9b52bf3f3b1 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a20d5dbdbb74c0c9921ed0eecb688c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1025a52a7ef44d6b3727e87ea3dfcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:32:33.149590 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-051e90e5-4b26-41f7-bf8a-b9b52bf3f3b1 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] 10.222.0.43 "GET /compute/v2.1/servers/3984d73b-0520-4591-9b30-a83a383e9062" status: 200 len: 1515 microversion: 2.1 time: 0.162847 Oct 04 19:32:33.150392 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3701/7032] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:32:32 2022] GET /compute/v2.1/servers/3984d73b-0520-4591-9b30-a83a383e9062 => generated 1515 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:32:34.173525 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-1e5c8b50-33a8-4ca9-bd8d-6c259533c327 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:32:34.174232 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-1e5c8b50-33a8-4ca9-bd8d-6c259533c327 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] [instance: 3984d73b-0520-4591-9b30-a83a383e9062] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:32:34.176190 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_api:SELECT=30 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:32:34.182353 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1e5c8b50-33a8-4ca9-bd8d-6c259533c327 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:34.182843 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1e5c8b50-33a8-4ca9-bd8d-6c259533c327 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:34.183286 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1e5c8b50-33a8-4ca9-bd8d-6c259533c327 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:34.183985 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1e5c8b50-33a8-4ca9-bd8d-6c259533c327 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:34.184441 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1e5c8b50-33a8-4ca9-bd8d-6c259533c327 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:34.184878 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1e5c8b50-33a8-4ca9-bd8d-6c259533c327 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:34.321291 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-1e5c8b50-33a8-4ca9-bd8d-6c259533c327 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a20d5dbdbb74c0c9921ed0eecb688c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1025a52a7ef44d6b3727e87ea3dfcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:32:34.329467 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-1e5c8b50-33a8-4ca9-bd8d-6c259533c327 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] 10.222.0.43 "GET /compute/v2.1/servers/3984d73b-0520-4591-9b30-a83a383e9062" status: 200 len: 1515 microversion: 2.1 time: 0.161113 Oct 04 19:32:34.330055 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3332/7033] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:32:34 2022] GET /compute/v2.1/servers/3984d73b-0520-4591-9b30-a83a383e9062 => generated 1515 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:32:35.300483 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-71dae1ae-1f79-412e-8235-a8730430da87 req-1985b5e7-5012-49f4-a5ce-039f0bca156c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3984d73b-0520-4591-9b30-a83a383e9062", "name": "network-vif-plugged", "status": "completed", "tag": "19d0dd08-7ec8-4e2e-bae0-bffbdb80e286"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:32:35.312741 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-71dae1ae-1f79-412e-8235-a8730430da87 req-1985b5e7-5012-49f4-a5ce-039f0bca156c service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:35.313301 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-71dae1ae-1f79-412e-8235-a8730430da87 req-1985b5e7-5012-49f4-a5ce-039f0bca156c service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:35.313779 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-71dae1ae-1f79-412e-8235-a8730430da87 req-1985b5e7-5012-49f4-a5ce-039f0bca156c service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:35.325270 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-71dae1ae-1f79-412e-8235-a8730430da87 req-1985b5e7-5012-49f4-a5ce-039f0bca156c service nova] Creating event network-vif-plugged:19d0dd08-7ec8-4e2e-bae0-bffbdb80e286 for instance 3984d73b-0520-4591-9b30-a83a383e9062 on n-h2-851028-13 Oct 04 19:32:35.332496 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-71dae1ae-1f79-412e-8235-a8730430da87 req-1985b5e7-5012-49f4-a5ce-039f0bca156c service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035748 Oct 04 19:32:35.333222 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3702/7034] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:32:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:32:35.354702 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-4063654d-1238-4079-9f97-dd2bb23b64c5 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:32:35.355432 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-4063654d-1238-4079-9f97-dd2bb23b64c5 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] [instance: 3984d73b-0520-4591-9b30-a83a383e9062] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:32:35.362334 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4063654d-1238-4079-9f97-dd2bb23b64c5 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:35.362922 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4063654d-1238-4079-9f97-dd2bb23b64c5 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:35.363357 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4063654d-1238-4079-9f97-dd2bb23b64c5 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:35.364066 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4063654d-1238-4079-9f97-dd2bb23b64c5 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:35.364531 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4063654d-1238-4079-9f97-dd2bb23b64c5 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:35.364969 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4063654d-1238-4079-9f97-dd2bb23b64c5 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:35.497268 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-4063654d-1238-4079-9f97-dd2bb23b64c5 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a20d5dbdbb74c0c9921ed0eecb688c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1025a52a7ef44d6b3727e87ea3dfcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:32:35.505100 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-4063654d-1238-4079-9f97-dd2bb23b64c5 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] 10.222.0.43 "GET /compute/v2.1/servers/3984d73b-0520-4591-9b30-a83a383e9062" status: 200 len: 1507 microversion: 2.1 time: 0.154866 Oct 04 19:32:35.505719 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3333/7035] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:32:35 2022] GET /compute/v2.1/servers/3984d73b-0520-4591-9b30-a83a383e9062 => generated 1507 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:32:35.527770 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-5b61d946-1912-42ea-82d9-bc8937df663f tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:32:35.528661 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-5b61d946-1912-42ea-82d9-bc8937df663f tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] [instance: 3984d73b-0520-4591-9b30-a83a383e9062] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:32:35.535645 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5b61d946-1912-42ea-82d9-bc8937df663f tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:35.536154 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5b61d946-1912-42ea-82d9-bc8937df663f tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:35.536612 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5b61d946-1912-42ea-82d9-bc8937df663f tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:35.537371 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5b61d946-1912-42ea-82d9-bc8937df663f tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:35.537843 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5b61d946-1912-42ea-82d9-bc8937df663f tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:35.538809 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5b61d946-1912-42ea-82d9-bc8937df663f tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:35.688918 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-5b61d946-1912-42ea-82d9-bc8937df663f tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a20d5dbdbb74c0c9921ed0eecb688c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1025a52a7ef44d6b3727e87ea3dfcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:32:35.698874 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-5b61d946-1912-42ea-82d9-bc8937df663f tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] 10.222.0.43 "GET /compute/v2.1/servers/3984d73b-0520-4591-9b30-a83a383e9062" status: 200 len: 1507 microversion: 2.1 time: 0.175375 Oct 04 19:32:35.699457 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3703/7036] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:32:35 2022] GET /compute/v2.1/servers/3984d73b-0520-4591-9b30-a83a383e9062 => generated 1507 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:32:35.725461 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-29c9a258-1e86-4de9-9873-a1dda2a88d3a tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Action: 'create', calling method: .version_select at 0x7fb21e7969d0>, body: {"keypair": {"name": "tempest-keypair-1122837157", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHEvDDBB5J4rgM7jm3x8bexFRRa3lG1TE6mSyLVON6UM0hV5CnR+4WOh3lPtartZ8dLMJSAK2mZEj/DS9teCXNlDKlXJhER7zsidobFzM+E+dSe5IpyaGJbMeX5ETS6fSQ=="}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:32:35.742379 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-29c9a258-1e86-4de9-9873-a1dda2a88d3a tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Getting quotas for project a1025a52a7ef44d6b3727e87ea3dfcf9. Resources: {'key_pairs'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:32:35.746925 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-29c9a258-1e86-4de9-9873-a1dda2a88d3a tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Getting quotas for user 3a20d5dbdbb74c0c9921ed0eecb688c3 and project a1025a52a7ef44d6b3727e87ea3dfcf9. Resources: {'key_pairs'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:32:35.772247 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-29c9a258-1e86-4de9-9873-a1dda2a88d3a tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.051052 Oct 04 19:32:35.773413 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3334/7037] 10.222.0.43 () {60 vars in 1159 bytes} [Tue Oct 4 19:32:35 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:32:36.969342 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-5ae36ff5-1f02-4e41-8e82-5ed36edee4d9 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:32:36.969969 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-5ae36ff5-1f02-4e41-8e82-5ed36edee4d9 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] [instance: 3984d73b-0520-4591-9b30-a83a383e9062] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:32:36.977628 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5ae36ff5-1f02-4e41-8e82-5ed36edee4d9 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:36.978123 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5ae36ff5-1f02-4e41-8e82-5ed36edee4d9 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:36.978574 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5ae36ff5-1f02-4e41-8e82-5ed36edee4d9 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:36.979274 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5ae36ff5-1f02-4e41-8e82-5ed36edee4d9 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:36.979737 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5ae36ff5-1f02-4e41-8e82-5ed36edee4d9 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:36.980174 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5ae36ff5-1f02-4e41-8e82-5ed36edee4d9 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:37.109702 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-5ae36ff5-1f02-4e41-8e82-5ed36edee4d9 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a20d5dbdbb74c0c9921ed0eecb688c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1025a52a7ef44d6b3727e87ea3dfcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:32:37.117479 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-5ae36ff5-1f02-4e41-8e82-5ed36edee4d9 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] 10.222.0.43 "GET /compute/v2.1/servers/3984d73b-0520-4591-9b30-a83a383e9062" status: 200 len: 1507 microversion: 2.1 time: 0.152019 Oct 04 19:32:37.118050 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3704/7038] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:32:36 2022] GET /compute/v2.1/servers/3984d73b-0520-4591-9b30-a83a383e9062 => generated 1507 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:32:37.140520 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-eb7030f9-d0bb-4df0-8936-5114aa486da1 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:32:37.141040 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-eb7030f9-d0bb-4df0-8936-5114aa486da1 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] [instance: 3984d73b-0520-4591-9b30-a83a383e9062] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:32:37.148179 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-eb7030f9-d0bb-4df0-8936-5114aa486da1 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:37.148670 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-eb7030f9-d0bb-4df0-8936-5114aa486da1 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:37.149145 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-eb7030f9-d0bb-4df0-8936-5114aa486da1 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:37.149842 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-eb7030f9-d0bb-4df0-8936-5114aa486da1 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:37.150302 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-eb7030f9-d0bb-4df0-8936-5114aa486da1 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:37.151177 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-eb7030f9-d0bb-4df0-8936-5114aa486da1 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:37.175854 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-eb7030f9-d0bb-4df0-8936-5114aa486da1 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] [instance: 3984d73b-0520-4591-9b30-a83a383e9062] Going to try to terminate instance {{(pid=123595) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 19:32:37.250424 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-eb7030f9-d0bb-4df0-8936-5114aa486da1 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] 10.222.0.43 "DELETE /compute/v2.1/servers/3984d73b-0520-4591-9b30-a83a383e9062" status: 204 len: 0 microversion: 2.1 time: 0.114398 Oct 04 19:32:37.250996 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3335/7039] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 19:32:37 2022] DELETE /compute/v2.1/servers/3984d73b-0520-4591-9b30-a83a383e9062 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:32:37.313076 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-2a933152-e393-4993-9ca7-07fad7ea3ce2 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-2085009354", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452", "networks": [{"uuid": "89860fe2-b58b-43af-b0e1-555044a2dc91"}]}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:32:37.387586 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.network.neutron [None req-2a933152-e393-4993-9ca7-07fad7ea3ce2 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] validate_networks() for [('89860fe2-b58b-43af-b0e1-555044a2dc91', None, None, None, None, None)] {{(pid=123596) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 19:32:37.768764 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-2a933152-e393-4993-9ca7-07fad7ea3ce2 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Flavor limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:32:37.769252 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-2a933152-e393-4993-9ca7-07fad7ea3ce2 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Image limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:32:37.769754 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-2a933152-e393-4993-9ca7-07fad7ea3ce2 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Flavor pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:32:37.770189 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-2a933152-e393-4993-9ca7-07fad7ea3ce2 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Image pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:32:37.770628 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-2a933152-e393-4993-9ca7-07fad7ea3ce2 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:32:37.780254 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2a933152-e393-4993-9ca7-07fad7ea3ce2 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:37.780844 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2a933152-e393-4993-9ca7-07fad7ea3ce2 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:37.781348 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2a933152-e393-4993-9ca7-07fad7ea3ce2 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:37.782189 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2a933152-e393-4993-9ca7-07fad7ea3ce2 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:37.782664 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2a933152-e393-4993-9ca7-07fad7ea3ce2 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:37.783113 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2a933152-e393-4993-9ca7-07fad7ea3ce2 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:37.799968 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-2a933152-e393-4993-9ca7-07fad7ea3ce2 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Getting quotas for project a1025a52a7ef44d6b3727e87ea3dfcf9. Resources: {'ram', 'cores', 'instances'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:32:37.805459 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-2a933152-e393-4993-9ca7-07fad7ea3ce2 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Getting quotas for user 3a20d5dbdbb74c0c9921ed0eecb688c3 and project a1025a52a7ef44d6b3727e87ea3dfcf9. Resources: {'ram', 'cores', 'instances'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:32:37.818054 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-2a933152-e393-4993-9ca7-07fad7ea3ce2 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Going to run 1 instances... {{(pid=123596) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 19:32:37.821053 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-2a933152-e393-4993-9ca7-07fad7ea3ce2 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] [instance: f6958fe8-4e4e-4662-917a-3aa480f32fc8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e8943ec5-4038-4d4b-b9b9-2415a79f5243',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123596) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 19:32:37.866088 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-2a933152-e393-4993-9ca7-07fad7ea3ce2 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.560484 Oct 04 19:32:37.867299 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3705/7040] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 19:32:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 563 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 19:32:37.878810 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-9431b840-80e3-49d0-833c-ae4437e06b13 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:32:37.879504 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-9431b840-80e3-49d0-833c-ae4437e06b13 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] [instance: f6958fe8-4e4e-4662-917a-3aa480f32fc8] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:32:37.936009 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-9431b840-80e3-49d0-833c-ae4437e06b13 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a20d5dbdbb74c0c9921ed0eecb688c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1025a52a7ef44d6b3727e87ea3dfcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:32:37.943202 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-9431b840-80e3-49d0-833c-ae4437e06b13 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] 10.222.0.43 "GET /compute/v2.1/servers/f6958fe8-4e4e-4662-917a-3aa480f32fc8" status: 200 len: 1218 microversion: 2.1 time: 0.068506 Oct 04 19:32:37.943774 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3336/7041] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:32:37 2022] GET /compute/v2.1/servers/f6958fe8-4e4e-4662-917a-3aa480f32fc8 => generated 1218 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:32:38.970912 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-bea64565-c15f-4d02-a8fb-6114e131065a tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:32:38.972716 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-bea64565-c15f-4d02-a8fb-6114e131065a tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] [instance: f6958fe8-4e4e-4662-917a-3aa480f32fc8] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:32:38.981256 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bea64565-c15f-4d02-a8fb-6114e131065a tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:38.981769 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bea64565-c15f-4d02-a8fb-6114e131065a tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:38.982228 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bea64565-c15f-4d02-a8fb-6114e131065a tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:38.982954 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bea64565-c15f-4d02-a8fb-6114e131065a tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:38.983428 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bea64565-c15f-4d02-a8fb-6114e131065a tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:38.983874 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bea64565-c15f-4d02-a8fb-6114e131065a tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:39.086644 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-bea64565-c15f-4d02-a8fb-6114e131065a tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a20d5dbdbb74c0c9921ed0eecb688c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1025a52a7ef44d6b3727e87ea3dfcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:32:39.101695 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-bea64565-c15f-4d02-a8fb-6114e131065a tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] 10.222.0.43 "GET /compute/v2.1/servers/f6958fe8-4e4e-4662-917a-3aa480f32fc8" status: 200 len: 1270 microversion: 2.1 time: 0.138180 Oct 04 19:32:39.102398 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3706/7042] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:32:38 2022] GET /compute/v2.1/servers/f6958fe8-4e4e-4662-917a-3aa480f32fc8 => generated 1270 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:32:39.139407 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-b1687593-d33c-4fd8-92b4-b99a8efff4ba req-28c06046-f868-437f-8542-8390dab6fe28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3984d73b-0520-4591-9b30-a83a383e9062", "name": "network-vif-deleted", "tag": "19d0dd08-7ec8-4e2e-bae0-bffbdb80e286"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:32:39.159295 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-b1687593-d33c-4fd8-92b4-b99a8efff4ba req-28c06046-f868-437f-8542-8390dab6fe28 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:39.159778 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-b1687593-d33c-4fd8-92b4-b99a8efff4ba req-28c06046-f868-437f-8542-8390dab6fe28 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:39.160243 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-b1687593-d33c-4fd8-92b4-b99a8efff4ba req-28c06046-f868-437f-8542-8390dab6fe28 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:39.183872 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-b1687593-d33c-4fd8-92b4-b99a8efff4ba req-28c06046-f868-437f-8542-8390dab6fe28 service nova] Creating event network-vif-deleted:19d0dd08-7ec8-4e2e-bae0-bffbdb80e286 for instance 3984d73b-0520-4591-9b30-a83a383e9062 on n-h2-851028-13 Oct 04 19:32:39.191116 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-b1687593-d33c-4fd8-92b4-b99a8efff4ba req-28c06046-f868-437f-8542-8390dab6fe28 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056075 Oct 04 19:32:39.192217 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3337/7043] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:32:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:32:40.123961 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-625786e3-bc4a-402a-840f-59503d3e8ac9 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:32:40.124614 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-625786e3-bc4a-402a-840f-59503d3e8ac9 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] [instance: f6958fe8-4e4e-4662-917a-3aa480f32fc8] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:32:40.131565 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-625786e3-bc4a-402a-840f-59503d3e8ac9 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:40.132048 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-625786e3-bc4a-402a-840f-59503d3e8ac9 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:40.132502 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-625786e3-bc4a-402a-840f-59503d3e8ac9 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:40.133476 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-625786e3-bc4a-402a-840f-59503d3e8ac9 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:40.133713 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-625786e3-bc4a-402a-840f-59503d3e8ac9 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:40.134156 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-625786e3-bc4a-402a-840f-59503d3e8ac9 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:40.361626 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-625786e3-bc4a-402a-840f-59503d3e8ac9 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a20d5dbdbb74c0c9921ed0eecb688c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1025a52a7ef44d6b3727e87ea3dfcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:32:40.371369 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-625786e3-bc4a-402a-840f-59503d3e8ac9 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] 10.222.0.43 "GET /compute/v2.1/servers/f6958fe8-4e4e-4662-917a-3aa480f32fc8" status: 200 len: 1318 microversion: 2.1 time: 0.251033 Oct 04 19:32:40.371970 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3707/7044] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:32:40 2022] GET /compute/v2.1/servers/f6958fe8-4e4e-4662-917a-3aa480f32fc8 => generated 1318 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:32:40.710884 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-ffde573f-f868-41bc-9024-0c450787306a req-5a410b49-7a42-44bd-be76-ed82c8a992aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6958fe8-4e4e-4662-917a-3aa480f32fc8", "tag": "869ea618-2637-4c7e-965f-fc57d5aa8fdf"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:32:40.721360 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-ffde573f-f868-41bc-9024-0c450787306a req-5a410b49-7a42-44bd-be76-ed82c8a992aa service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:40.722175 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-ffde573f-f868-41bc-9024-0c450787306a req-5a410b49-7a42-44bd-be76-ed82c8a992aa service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:40.722604 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-ffde573f-f868-41bc-9024-0c450787306a req-5a410b49-7a42-44bd-be76-ed82c8a992aa service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:40.734070 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-ffde573f-f868-41bc-9024-0c450787306a req-5a410b49-7a42-44bd-be76-ed82c8a992aa service nova] Creating event network-changed:869ea618-2637-4c7e-965f-fc57d5aa8fdf for instance f6958fe8-4e4e-4662-917a-3aa480f32fc8 on n-h2-851028-13 Oct 04 19:32:40.739072 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-ffde573f-f868-41bc-9024-0c450787306a req-5a410b49-7a42-44bd-be76-ed82c8a992aa service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089439 Oct 04 19:32:40.739671 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3338/7045] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:32:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:32:41.395212 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-239a653e-7221-4f1e-bd0e-34da51373ac4 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:32:41.395877 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-239a653e-7221-4f1e-bd0e-34da51373ac4 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] [instance: f6958fe8-4e4e-4662-917a-3aa480f32fc8] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:32:41.404058 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-239a653e-7221-4f1e-bd0e-34da51373ac4 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:41.404556 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-239a653e-7221-4f1e-bd0e-34da51373ac4 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:41.405005 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-239a653e-7221-4f1e-bd0e-34da51373ac4 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:41.405746 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-239a653e-7221-4f1e-bd0e-34da51373ac4 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:41.406208 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-239a653e-7221-4f1e-bd0e-34da51373ac4 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:41.406645 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-239a653e-7221-4f1e-bd0e-34da51373ac4 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:41.538255 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-239a653e-7221-4f1e-bd0e-34da51373ac4 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a20d5dbdbb74c0c9921ed0eecb688c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1025a52a7ef44d6b3727e87ea3dfcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:32:41.546101 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-239a653e-7221-4f1e-bd0e-34da51373ac4 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] 10.222.0.43 "GET /compute/v2.1/servers/f6958fe8-4e4e-4662-917a-3aa480f32fc8" status: 200 len: 1318 microversion: 2.1 time: 0.155071 Oct 04 19:32:41.546681 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3708/7046] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:32:41 2022] GET /compute/v2.1/servers/f6958fe8-4e4e-4662-917a-3aa480f32fc8 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:32:42.568504 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-e3940461-7507-43c7-9098-3df88b0c821b tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:32:42.570042 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-e3940461-7507-43c7-9098-3df88b0c821b tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] [instance: f6958fe8-4e4e-4662-917a-3aa480f32fc8] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:32:42.577145 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e3940461-7507-43c7-9098-3df88b0c821b tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:42.577841 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e3940461-7507-43c7-9098-3df88b0c821b tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:42.578596 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e3940461-7507-43c7-9098-3df88b0c821b tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:42.579324 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e3940461-7507-43c7-9098-3df88b0c821b tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:42.579810 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e3940461-7507-43c7-9098-3df88b0c821b tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:42.580244 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e3940461-7507-43c7-9098-3df88b0c821b tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:42.711733 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-e3940461-7507-43c7-9098-3df88b0c821b tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a20d5dbdbb74c0c9921ed0eecb688c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1025a52a7ef44d6b3727e87ea3dfcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:32:42.719479 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-e3940461-7507-43c7-9098-3df88b0c821b tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] 10.222.0.43 "GET /compute/v2.1/servers/f6958fe8-4e4e-4662-917a-3aa480f32fc8" status: 200 len: 1318 microversion: 2.1 time: 0.155288 Oct 04 19:32:42.720053 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3339/7047] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:32:42 2022] GET /compute/v2.1/servers/f6958fe8-4e4e-4662-917a-3aa480f32fc8 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:32:43.743370 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-dca9944d-9bab-47df-afd3-601fb2ab8d7b tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:32:43.744177 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-dca9944d-9bab-47df-afd3-601fb2ab8d7b tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] [instance: f6958fe8-4e4e-4662-917a-3aa480f32fc8] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:32:43.751215 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dca9944d-9bab-47df-afd3-601fb2ab8d7b tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:43.751849 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dca9944d-9bab-47df-afd3-601fb2ab8d7b tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:43.752377 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dca9944d-9bab-47df-afd3-601fb2ab8d7b tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:43.753186 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dca9944d-9bab-47df-afd3-601fb2ab8d7b tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:43.753731 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dca9944d-9bab-47df-afd3-601fb2ab8d7b tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:43.754245 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dca9944d-9bab-47df-afd3-601fb2ab8d7b tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:43.891183 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-dca9944d-9bab-47df-afd3-601fb2ab8d7b tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a20d5dbdbb74c0c9921ed0eecb688c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1025a52a7ef44d6b3727e87ea3dfcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:32:43.900091 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-dca9944d-9bab-47df-afd3-601fb2ab8d7b tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] 10.222.0.43 "GET /compute/v2.1/servers/f6958fe8-4e4e-4662-917a-3aa480f32fc8" status: 200 len: 1318 microversion: 2.1 time: 0.161254 Oct 04 19:32:43.900689 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3709/7048] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:32:43 2022] GET /compute/v2.1/servers/f6958fe8-4e4e-4662-917a-3aa480f32fc8 => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:32:44.922765 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-053c341c-17f7-40fd-ace8-345057cac2ec tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:32:44.923378 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-053c341c-17f7-40fd-ace8-345057cac2ec tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] [instance: f6958fe8-4e4e-4662-917a-3aa480f32fc8] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:32:44.930489 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-053c341c-17f7-40fd-ace8-345057cac2ec tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:44.931035 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-053c341c-17f7-40fd-ace8-345057cac2ec tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:44.931516 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-053c341c-17f7-40fd-ace8-345057cac2ec tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:44.932264 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-053c341c-17f7-40fd-ace8-345057cac2ec tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:44.932772 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-053c341c-17f7-40fd-ace8-345057cac2ec tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:44.933247 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-053c341c-17f7-40fd-ace8-345057cac2ec tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:45.061039 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-053c341c-17f7-40fd-ace8-345057cac2ec tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a20d5dbdbb74c0c9921ed0eecb688c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1025a52a7ef44d6b3727e87ea3dfcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:32:45.069762 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-053c341c-17f7-40fd-ace8-345057cac2ec tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] 10.222.0.43 "GET /compute/v2.1/servers/f6958fe8-4e4e-4662-917a-3aa480f32fc8" status: 200 len: 1318 microversion: 2.1 time: 0.150208 Oct 04 19:32:45.070337 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3340/7049] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:32:44 2022] GET /compute/v2.1/servers/f6958fe8-4e4e-4662-917a-3aa480f32fc8 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:32:45.312060 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-62eddfcb-55b1-433b-8f33-de073346617d req-41671a2d-a7c1-4013-98f5-6cfccfa63851 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6958fe8-4e4e-4662-917a-3aa480f32fc8", "name": "network-vif-plugged", "status": "completed", "tag": "869ea618-2637-4c7e-965f-fc57d5aa8fdf"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:32:45.323042 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-62eddfcb-55b1-433b-8f33-de073346617d req-41671a2d-a7c1-4013-98f5-6cfccfa63851 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:45.323548 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-62eddfcb-55b1-433b-8f33-de073346617d req-41671a2d-a7c1-4013-98f5-6cfccfa63851 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:45.324074 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-62eddfcb-55b1-433b-8f33-de073346617d req-41671a2d-a7c1-4013-98f5-6cfccfa63851 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:45.337125 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-62eddfcb-55b1-433b-8f33-de073346617d req-41671a2d-a7c1-4013-98f5-6cfccfa63851 service nova] Creating event network-vif-plugged:869ea618-2637-4c7e-965f-fc57d5aa8fdf for instance f6958fe8-4e4e-4662-917a-3aa480f32fc8 on n-h2-851028-13 Oct 04 19:32:45.342572 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-62eddfcb-55b1-433b-8f33-de073346617d req-41671a2d-a7c1-4013-98f5-6cfccfa63851 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034523 Oct 04 19:32:45.343618 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3710/7050] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:32:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:32:46.093503 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-5bd5a998-6475-4afb-a008-8c7d1f9f8c45 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:32:46.094115 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-5bd5a998-6475-4afb-a008-8c7d1f9f8c45 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] [instance: f6958fe8-4e4e-4662-917a-3aa480f32fc8] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:32:46.101966 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5bd5a998-6475-4afb-a008-8c7d1f9f8c45 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:46.102446 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5bd5a998-6475-4afb-a008-8c7d1f9f8c45 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:46.102881 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5bd5a998-6475-4afb-a008-8c7d1f9f8c45 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:46.103565 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5bd5a998-6475-4afb-a008-8c7d1f9f8c45 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:46.104015 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5bd5a998-6475-4afb-a008-8c7d1f9f8c45 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:46.104439 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5bd5a998-6475-4afb-a008-8c7d1f9f8c45 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:46.119397 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:32:46.250059 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-5bd5a998-6475-4afb-a008-8c7d1f9f8c45 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a20d5dbdbb74c0c9921ed0eecb688c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1025a52a7ef44d6b3727e87ea3dfcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:32:46.258393 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-5bd5a998-6475-4afb-a008-8c7d1f9f8c45 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] 10.222.0.43 "GET /compute/v2.1/servers/f6958fe8-4e4e-4662-917a-3aa480f32fc8" status: 200 len: 1318 microversion: 2.1 time: 0.168805 Oct 04 19:32:46.258982 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3341/7051] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:32:46 2022] GET /compute/v2.1/servers/f6958fe8-4e4e-4662-917a-3aa480f32fc8 => generated 1318 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:32:47.280959 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-874140c6-429c-421d-821b-3643cafaa473 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:32:47.281727 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-874140c6-429c-421d-821b-3643cafaa473 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] [instance: f6958fe8-4e4e-4662-917a-3aa480f32fc8] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:32:47.289514 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-874140c6-429c-421d-821b-3643cafaa473 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:47.290010 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-874140c6-429c-421d-821b-3643cafaa473 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:47.290467 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-874140c6-429c-421d-821b-3643cafaa473 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:47.291178 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-874140c6-429c-421d-821b-3643cafaa473 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:47.291645 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-874140c6-429c-421d-821b-3643cafaa473 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:47.292095 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-874140c6-429c-421d-821b-3643cafaa473 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:47.426885 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-874140c6-429c-421d-821b-3643cafaa473 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a20d5dbdbb74c0c9921ed0eecb688c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1025a52a7ef44d6b3727e87ea3dfcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:32:47.435316 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-874140c6-429c-421d-821b-3643cafaa473 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] 10.222.0.43 "GET /compute/v2.1/servers/f6958fe8-4e4e-4662-917a-3aa480f32fc8" status: 200 len: 1509 microversion: 2.1 time: 0.158862 Oct 04 19:32:47.435867 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3711/7052] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:32:47 2022] GET /compute/v2.1/servers/f6958fe8-4e4e-4662-917a-3aa480f32fc8 => generated 1509 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:32:47.456999 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-ac354210-0655-4c3d-81dd-957dedb3f5d3 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:32:47.457689 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-ac354210-0655-4c3d-81dd-957dedb3f5d3 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] [instance: f6958fe8-4e4e-4662-917a-3aa480f32fc8] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:32:47.464563 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ac354210-0655-4c3d-81dd-957dedb3f5d3 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:47.465051 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ac354210-0655-4c3d-81dd-957dedb3f5d3 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:47.465541 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ac354210-0655-4c3d-81dd-957dedb3f5d3 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:47.466251 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ac354210-0655-4c3d-81dd-957dedb3f5d3 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:47.466695 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ac354210-0655-4c3d-81dd-957dedb3f5d3 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:47.467127 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ac354210-0655-4c3d-81dd-957dedb3f5d3 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:47.597973 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-ac354210-0655-4c3d-81dd-957dedb3f5d3 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a20d5dbdbb74c0c9921ed0eecb688c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1025a52a7ef44d6b3727e87ea3dfcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:32:47.606380 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-ac354210-0655-4c3d-81dd-957dedb3f5d3 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] 10.222.0.43 "GET /compute/v2.1/servers/f6958fe8-4e4e-4662-917a-3aa480f32fc8" status: 200 len: 1509 microversion: 2.1 time: 0.153265 Oct 04 19:32:47.606951 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3342/7053] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:32:47 2022] GET /compute/v2.1/servers/f6958fe8-4e4e-4662-917a-3aa480f32fc8 => generated 1509 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:32:47.628616 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-d9522b85-3f6f-4d6b-b7f3-00a22f50dab4 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "AUTO"}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:32:47.631118 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-d9522b85-3f6f-4d6b-b7f3-00a22f50dab4 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] [instance: f6958fe8-4e4e-4662-917a-3aa480f32fc8] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:32:47.637354 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d9522b85-3f6f-4d6b-b7f3-00a22f50dab4 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:47.637852 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d9522b85-3f6f-4d6b-b7f3-00a22f50dab4 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:47.638348 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d9522b85-3f6f-4d6b-b7f3-00a22f50dab4 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:47.639076 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d9522b85-3f6f-4d6b-b7f3-00a22f50dab4 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:47.639537 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d9522b85-3f6f-4d6b-b7f3-00a22f50dab4 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:47.639980 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d9522b85-3f6f-4d6b-b7f3-00a22f50dab4 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:47.671771 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-d9522b85-3f6f-4d6b-b7f3-00a22f50dab4 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '3a20d5dbdbb74c0c9921ed0eecb688c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1025a52a7ef44d6b3727e87ea3dfcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:32:47.677250 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-d9522b85-3f6f-4d6b-b7f3-00a22f50dab4 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] [instance: f6958fe8-4e4e-4662-917a-3aa480f32fc8] Old instance type m1.heat2, new instance type m1.heat {{(pid=123596) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 04 19:32:47.683688 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-d9522b85-3f6f-4d6b-b7f3-00a22f50dab4 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Flavor limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:32:47.684121 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-d9522b85-3f6f-4d6b-b7f3-00a22f50dab4 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Image limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:32:47.684604 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-d9522b85-3f6f-4d6b-b7f3-00a22f50dab4 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Flavor pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:32:47.685023 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-d9522b85-3f6f-4d6b-b7f3-00a22f50dab4 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Image pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:32:47.685466 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-d9522b85-3f6f-4d6b-b7f3-00a22f50dab4 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:32:47.748699 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-d9522b85-3f6f-4d6b-b7f3-00a22f50dab4 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] 10.222.0.43 "POST /compute/v2.1/servers/f6958fe8-4e4e-4662-917a-3aa480f32fc8/action" status: 202 len: 0 microversion: 2.1 time: 0.124029 Oct 04 19:32:47.749350 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3712/7054] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 19:32:47 2022] POST /compute/v2.1/servers/f6958fe8-4e4e-4662-917a-3aa480f32fc8/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:32:47.757394 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-6b4dec3f-3900-43db-b7a9-8fcba1b3b962 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:32:47.758015 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-6b4dec3f-3900-43db-b7a9-8fcba1b3b962 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] [instance: f6958fe8-4e4e-4662-917a-3aa480f32fc8] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:32:47.764070 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6b4dec3f-3900-43db-b7a9-8fcba1b3b962 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:47.764673 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6b4dec3f-3900-43db-b7a9-8fcba1b3b962 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:47.765210 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6b4dec3f-3900-43db-b7a9-8fcba1b3b962 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:47.765915 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6b4dec3f-3900-43db-b7a9-8fcba1b3b962 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:47.766543 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6b4dec3f-3900-43db-b7a9-8fcba1b3b962 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:47.766977 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6b4dec3f-3900-43db-b7a9-8fcba1b3b962 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:47.909038 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-6b4dec3f-3900-43db-b7a9-8fcba1b3b962 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a20d5dbdbb74c0c9921ed0eecb688c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1025a52a7ef44d6b3727e87ea3dfcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:32:47.917602 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-6b4dec3f-3900-43db-b7a9-8fcba1b3b962 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] 10.222.0.43 "GET /compute/v2.1/servers/f6958fe8-4e4e-4662-917a-3aa480f32fc8" status: 200 len: 1516 microversion: 2.1 time: 0.163991 Oct 04 19:32:47.918261 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3343/7055] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:32:47 2022] GET /compute/v2.1/servers/f6958fe8-4e4e-4662-917a-3aa480f32fc8 => generated 1516 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:32:48.937040 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=2 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:32:48.938566 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=6 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:32:48.945714 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f174283c-b94a-4353-a308-aefe9b21e413 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:32:48.946539 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-f174283c-b94a-4353-a308-aefe9b21e413 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] [instance: f6958fe8-4e4e-4662-917a-3aa480f32fc8] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:32:48.957452 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f174283c-b94a-4353-a308-aefe9b21e413 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:48.957961 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f174283c-b94a-4353-a308-aefe9b21e413 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:48.958415 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f174283c-b94a-4353-a308-aefe9b21e413 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:48.959128 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f174283c-b94a-4353-a308-aefe9b21e413 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:48.960202 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f174283c-b94a-4353-a308-aefe9b21e413 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:48.961137 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f174283c-b94a-4353-a308-aefe9b21e413 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:49.181757 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-f174283c-b94a-4353-a308-aefe9b21e413 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a20d5dbdbb74c0c9921ed0eecb688c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1025a52a7ef44d6b3727e87ea3dfcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:32:49.189746 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-f174283c-b94a-4353-a308-aefe9b21e413 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] 10.222.0.43 "GET /compute/v2.1/servers/f6958fe8-4e4e-4662-917a-3aa480f32fc8" status: 200 len: 1516 microversion: 2.1 time: 0.253756 Oct 04 19:32:49.190489 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3713/7056] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:32:48 2022] GET /compute/v2.1/servers/f6958fe8-4e4e-4662-917a-3aa480f32fc8 => generated 1516 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:32:50.214424 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-2414d206-56f5-430a-9a79-f613edba1b6f tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:32:50.215066 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-2414d206-56f5-430a-9a79-f613edba1b6f tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] [instance: f6958fe8-4e4e-4662-917a-3aa480f32fc8] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:32:50.216926 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=6 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:32:50.223567 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2414d206-56f5-430a-9a79-f613edba1b6f tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:50.224054 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2414d206-56f5-430a-9a79-f613edba1b6f tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:50.224493 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2414d206-56f5-430a-9a79-f613edba1b6f tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:50.225710 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2414d206-56f5-430a-9a79-f613edba1b6f tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:50.226169 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2414d206-56f5-430a-9a79-f613edba1b6f tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:50.226599 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2414d206-56f5-430a-9a79-f613edba1b6f tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:50.360804 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-2414d206-56f5-430a-9a79-f613edba1b6f tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a20d5dbdbb74c0c9921ed0eecb688c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1025a52a7ef44d6b3727e87ea3dfcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:32:50.370407 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-2414d206-56f5-430a-9a79-f613edba1b6f tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] 10.222.0.43 "GET /compute/v2.1/servers/f6958fe8-4e4e-4662-917a-3aa480f32fc8" status: 200 len: 1521 microversion: 2.1 time: 0.159831 Oct 04 19:32:50.371070 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3344/7057] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:32:50 2022] GET /compute/v2.1/servers/f6958fe8-4e4e-4662-917a-3aa480f32fc8 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:32:51.393925 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-603aa1f8-ce4e-4bef-a2e3-ad4719cd27f6 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:32:51.394567 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-603aa1f8-ce4e-4bef-a2e3-ad4719cd27f6 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] [instance: f6958fe8-4e4e-4662-917a-3aa480f32fc8] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:32:51.402716 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-603aa1f8-ce4e-4bef-a2e3-ad4719cd27f6 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:51.403222 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-603aa1f8-ce4e-4bef-a2e3-ad4719cd27f6 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:51.403680 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-603aa1f8-ce4e-4bef-a2e3-ad4719cd27f6 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:51.404397 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-603aa1f8-ce4e-4bef-a2e3-ad4719cd27f6 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:51.404879 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-603aa1f8-ce4e-4bef-a2e3-ad4719cd27f6 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:51.405353 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-603aa1f8-ce4e-4bef-a2e3-ad4719cd27f6 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:51.540323 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-603aa1f8-ce4e-4bef-a2e3-ad4719cd27f6 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a20d5dbdbb74c0c9921ed0eecb688c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1025a52a7ef44d6b3727e87ea3dfcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:32:51.548537 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-603aa1f8-ce4e-4bef-a2e3-ad4719cd27f6 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] 10.222.0.43 "GET /compute/v2.1/servers/f6958fe8-4e4e-4662-917a-3aa480f32fc8" status: 200 len: 1521 microversion: 2.1 time: 0.158567 Oct 04 19:32:51.549133 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3714/7058] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:32:51 2022] GET /compute/v2.1/servers/f6958fe8-4e4e-4662-917a-3aa480f32fc8 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:32:52.572199 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-07877998-15c9-4452-bd4f-3126e16ffc9c tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:32:52.572811 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-07877998-15c9-4452-bd4f-3126e16ffc9c tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] [instance: f6958fe8-4e4e-4662-917a-3aa480f32fc8] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:32:52.579675 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-07877998-15c9-4452-bd4f-3126e16ffc9c tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:52.580152 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-07877998-15c9-4452-bd4f-3126e16ffc9c tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:52.580585 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-07877998-15c9-4452-bd4f-3126e16ffc9c tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:52.581303 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-07877998-15c9-4452-bd4f-3126e16ffc9c tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:52.581753 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-07877998-15c9-4452-bd4f-3126e16ffc9c tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:52.582174 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-07877998-15c9-4452-bd4f-3126e16ffc9c tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:52.711185 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-07877998-15c9-4452-bd4f-3126e16ffc9c tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a20d5dbdbb74c0c9921ed0eecb688c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1025a52a7ef44d6b3727e87ea3dfcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:32:52.718847 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-07877998-15c9-4452-bd4f-3126e16ffc9c tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] 10.222.0.43 "GET /compute/v2.1/servers/f6958fe8-4e4e-4662-917a-3aa480f32fc8" status: 200 len: 1521 microversion: 2.1 time: 0.151160 Oct 04 19:32:52.719419 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3345/7059] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:32:52 2022] GET /compute/v2.1/servers/f6958fe8-4e4e-4662-917a-3aa480f32fc8 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:32:53.742175 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-8462b6b8-766a-4e55-bb67-8b897fab3144 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:32:53.742808 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-8462b6b8-766a-4e55-bb67-8b897fab3144 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] [instance: f6958fe8-4e4e-4662-917a-3aa480f32fc8] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:32:53.749750 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8462b6b8-766a-4e55-bb67-8b897fab3144 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:53.750255 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8462b6b8-766a-4e55-bb67-8b897fab3144 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:53.750721 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8462b6b8-766a-4e55-bb67-8b897fab3144 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:53.751435 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8462b6b8-766a-4e55-bb67-8b897fab3144 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:53.751912 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8462b6b8-766a-4e55-bb67-8b897fab3144 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:53.752360 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8462b6b8-766a-4e55-bb67-8b897fab3144 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:53.891996 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-8462b6b8-766a-4e55-bb67-8b897fab3144 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a20d5dbdbb74c0c9921ed0eecb688c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1025a52a7ef44d6b3727e87ea3dfcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:32:53.899772 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-8462b6b8-766a-4e55-bb67-8b897fab3144 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] 10.222.0.43 "GET /compute/v2.1/servers/f6958fe8-4e4e-4662-917a-3aa480f32fc8" status: 200 len: 1521 microversion: 2.1 time: 0.162066 Oct 04 19:32:53.900349 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3715/7060] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:32:53 2022] GET /compute/v2.1/servers/f6958fe8-4e4e-4662-917a-3aa480f32fc8 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:32:54.922950 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-d79036fc-480d-4e35-bb4f-7736a3e527a2 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:32:54.923568 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-d79036fc-480d-4e35-bb4f-7736a3e527a2 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] [instance: f6958fe8-4e4e-4662-917a-3aa480f32fc8] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:32:54.930932 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d79036fc-480d-4e35-bb4f-7736a3e527a2 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:54.931413 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d79036fc-480d-4e35-bb4f-7736a3e527a2 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:54.931860 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d79036fc-480d-4e35-bb4f-7736a3e527a2 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:54.932553 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d79036fc-480d-4e35-bb4f-7736a3e527a2 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:54.933006 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d79036fc-480d-4e35-bb4f-7736a3e527a2 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:54.933459 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d79036fc-480d-4e35-bb4f-7736a3e527a2 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:55.068494 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-d79036fc-480d-4e35-bb4f-7736a3e527a2 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a20d5dbdbb74c0c9921ed0eecb688c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1025a52a7ef44d6b3727e87ea3dfcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:32:55.076572 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-d79036fc-480d-4e35-bb4f-7736a3e527a2 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] 10.222.0.43 "GET /compute/v2.1/servers/f6958fe8-4e4e-4662-917a-3aa480f32fc8" status: 200 len: 1521 microversion: 2.1 time: 0.157695 Oct 04 19:32:55.077223 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3346/7061] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:32:54 2022] GET /compute/v2.1/servers/f6958fe8-4e4e-4662-917a-3aa480f32fc8 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:32:56.100125 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-79b6389a-4791-4128-b851-905c9fb3ce89 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:32:56.100745 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-79b6389a-4791-4128-b851-905c9fb3ce89 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] [instance: f6958fe8-4e4e-4662-917a-3aa480f32fc8] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:32:56.107972 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-79b6389a-4791-4128-b851-905c9fb3ce89 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:56.108473 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-79b6389a-4791-4128-b851-905c9fb3ce89 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:56.108928 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-79b6389a-4791-4128-b851-905c9fb3ce89 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:56.109664 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-79b6389a-4791-4128-b851-905c9fb3ce89 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:56.110138 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-79b6389a-4791-4128-b851-905c9fb3ce89 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:56.110606 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-79b6389a-4791-4128-b851-905c9fb3ce89 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:56.242730 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-79b6389a-4791-4128-b851-905c9fb3ce89 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a20d5dbdbb74c0c9921ed0eecb688c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1025a52a7ef44d6b3727e87ea3dfcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:32:56.250851 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-79b6389a-4791-4128-b851-905c9fb3ce89 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] 10.222.0.43 "GET /compute/v2.1/servers/f6958fe8-4e4e-4662-917a-3aa480f32fc8" status: 200 len: 1521 microversion: 2.1 time: 0.154886 Oct 04 19:32:56.251434 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3716/7062] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:32:56 2022] GET /compute/v2.1/servers/f6958fe8-4e4e-4662-917a-3aa480f32fc8 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:32:57.280220 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-73bd5a76-88f1-4860-b888-2acfcda99cae tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:32:57.280819 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-73bd5a76-88f1-4860-b888-2acfcda99cae tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] [instance: f6958fe8-4e4e-4662-917a-3aa480f32fc8] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:32:57.288155 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-73bd5a76-88f1-4860-b888-2acfcda99cae tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:57.288640 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-73bd5a76-88f1-4860-b888-2acfcda99cae tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:57.289080 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-73bd5a76-88f1-4860-b888-2acfcda99cae tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:57.289789 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-73bd5a76-88f1-4860-b888-2acfcda99cae tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:57.290243 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-73bd5a76-88f1-4860-b888-2acfcda99cae tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:57.290669 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-73bd5a76-88f1-4860-b888-2acfcda99cae tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:57.425435 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-73bd5a76-88f1-4860-b888-2acfcda99cae tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a20d5dbdbb74c0c9921ed0eecb688c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1025a52a7ef44d6b3727e87ea3dfcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:32:57.433832 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-73bd5a76-88f1-4860-b888-2acfcda99cae tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] 10.222.0.43 "GET /compute/v2.1/servers/f6958fe8-4e4e-4662-917a-3aa480f32fc8" status: 200 len: 1521 microversion: 2.1 time: 0.157824 Oct 04 19:32:57.434417 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3347/7063] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:32:57 2022] GET /compute/v2.1/servers/f6958fe8-4e4e-4662-917a-3aa480f32fc8 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:32:58.458080 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-1dae0151-250d-4ef2-a762-21b8801c1b10 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:32:58.458715 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-1dae0151-250d-4ef2-a762-21b8801c1b10 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] [instance: f6958fe8-4e4e-4662-917a-3aa480f32fc8] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:32:58.465774 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1dae0151-250d-4ef2-a762-21b8801c1b10 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:58.466283 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1dae0151-250d-4ef2-a762-21b8801c1b10 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:58.466741 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1dae0151-250d-4ef2-a762-21b8801c1b10 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:58.467456 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1dae0151-250d-4ef2-a762-21b8801c1b10 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:58.467932 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1dae0151-250d-4ef2-a762-21b8801c1b10 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:58.468384 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1dae0151-250d-4ef2-a762-21b8801c1b10 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:58.483867 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:32:58.605377 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-1dae0151-250d-4ef2-a762-21b8801c1b10 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a20d5dbdbb74c0c9921ed0eecb688c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1025a52a7ef44d6b3727e87ea3dfcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:32:58.613269 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-1dae0151-250d-4ef2-a762-21b8801c1b10 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] 10.222.0.43 "GET /compute/v2.1/servers/f6958fe8-4e4e-4662-917a-3aa480f32fc8" status: 200 len: 1521 microversion: 2.1 time: 0.159058 Oct 04 19:32:58.613886 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3717/7064] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:32:58 2022] GET /compute/v2.1/servers/f6958fe8-4e4e-4662-917a-3aa480f32fc8 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:32:59.637126 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-74e7b4e9-41ae-47ab-85aa-ddaa2c376a01 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:32:59.637779 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-74e7b4e9-41ae-47ab-85aa-ddaa2c376a01 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] [instance: f6958fe8-4e4e-4662-917a-3aa480f32fc8] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:32:59.643883 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-74e7b4e9-41ae-47ab-85aa-ddaa2c376a01 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:59.644367 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-74e7b4e9-41ae-47ab-85aa-ddaa2c376a01 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:59.644809 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-74e7b4e9-41ae-47ab-85aa-ddaa2c376a01 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:59.645523 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-74e7b4e9-41ae-47ab-85aa-ddaa2c376a01 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:59.645991 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-74e7b4e9-41ae-47ab-85aa-ddaa2c376a01 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:59.646432 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-74e7b4e9-41ae-47ab-85aa-ddaa2c376a01 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:59.781529 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-74e7b4e9-41ae-47ab-85aa-ddaa2c376a01 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a20d5dbdbb74c0c9921ed0eecb688c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1025a52a7ef44d6b3727e87ea3dfcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:32:59.789369 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-74e7b4e9-41ae-47ab-85aa-ddaa2c376a01 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] 10.222.0.43 "GET /compute/v2.1/servers/f6958fe8-4e4e-4662-917a-3aa480f32fc8" status: 200 len: 1521 microversion: 2.1 time: 0.156403 Oct 04 19:32:59.789946 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3348/7065] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:32:59 2022] GET /compute/v2.1/servers/f6958fe8-4e4e-4662-917a-3aa480f32fc8 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:33:00.813290 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-207595d9-bd5b-408f-99c0-32986c97d8d5 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:33:00.813955 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-207595d9-bd5b-408f-99c0-32986c97d8d5 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] [instance: f6958fe8-4e4e-4662-917a-3aa480f32fc8] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:33:00.821678 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-207595d9-bd5b-408f-99c0-32986c97d8d5 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:00.822183 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-207595d9-bd5b-408f-99c0-32986c97d8d5 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:00.822639 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-207595d9-bd5b-408f-99c0-32986c97d8d5 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:00.823360 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-207595d9-bd5b-408f-99c0-32986c97d8d5 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:00.823832 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-207595d9-bd5b-408f-99c0-32986c97d8d5 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:00.824278 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-207595d9-bd5b-408f-99c0-32986c97d8d5 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:00.968076 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-207595d9-bd5b-408f-99c0-32986c97d8d5 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a20d5dbdbb74c0c9921ed0eecb688c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1025a52a7ef44d6b3727e87ea3dfcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:33:00.976435 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-207595d9-bd5b-408f-99c0-32986c97d8d5 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] 10.222.0.43 "GET /compute/v2.1/servers/f6958fe8-4e4e-4662-917a-3aa480f32fc8" status: 200 len: 1521 microversion: 2.1 time: 0.167139 Oct 04 19:33:00.977012 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3718/7066] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:33:00 2022] GET /compute/v2.1/servers/f6958fe8-4e4e-4662-917a-3aa480f32fc8 => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:33:01.999464 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-591fd000-a7ac-42bb-aea8-1b794f1674e3 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:33:02.000147 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-591fd000-a7ac-42bb-aea8-1b794f1674e3 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] [instance: f6958fe8-4e4e-4662-917a-3aa480f32fc8] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:33:02.007030 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-591fd000-a7ac-42bb-aea8-1b794f1674e3 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:02.007580 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-591fd000-a7ac-42bb-aea8-1b794f1674e3 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:02.008024 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-591fd000-a7ac-42bb-aea8-1b794f1674e3 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:02.008715 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-591fd000-a7ac-42bb-aea8-1b794f1674e3 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:02.009200 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-591fd000-a7ac-42bb-aea8-1b794f1674e3 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:02.009634 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-591fd000-a7ac-42bb-aea8-1b794f1674e3 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:02.138289 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-591fd000-a7ac-42bb-aea8-1b794f1674e3 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a20d5dbdbb74c0c9921ed0eecb688c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1025a52a7ef44d6b3727e87ea3dfcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:33:02.145936 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-591fd000-a7ac-42bb-aea8-1b794f1674e3 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] 10.222.0.43 "GET /compute/v2.1/servers/f6958fe8-4e4e-4662-917a-3aa480f32fc8" status: 200 len: 1521 microversion: 2.1 time: 0.150331 Oct 04 19:33:02.146506 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3349/7067] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:33:01 2022] GET /compute/v2.1/servers/f6958fe8-4e4e-4662-917a-3aa480f32fc8 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:33:03.172278 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-22bb92f4-4097-4ec5-b615-8a3db7dbe0fd tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:33:03.172924 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-22bb92f4-4097-4ec5-b615-8a3db7dbe0fd tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] [instance: f6958fe8-4e4e-4662-917a-3aa480f32fc8] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:33:03.175998 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:33:03.182335 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-22bb92f4-4097-4ec5-b615-8a3db7dbe0fd tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:03.182841 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-22bb92f4-4097-4ec5-b615-8a3db7dbe0fd tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:03.183304 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-22bb92f4-4097-4ec5-b615-8a3db7dbe0fd tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:03.184021 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-22bb92f4-4097-4ec5-b615-8a3db7dbe0fd tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:03.184498 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-22bb92f4-4097-4ec5-b615-8a3db7dbe0fd tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:03.184947 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-22bb92f4-4097-4ec5-b615-8a3db7dbe0fd tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:03.313555 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-22bb92f4-4097-4ec5-b615-8a3db7dbe0fd tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a20d5dbdbb74c0c9921ed0eecb688c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1025a52a7ef44d6b3727e87ea3dfcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:33:03.321359 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-22bb92f4-4097-4ec5-b615-8a3db7dbe0fd tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] 10.222.0.43 "GET /compute/v2.1/servers/f6958fe8-4e4e-4662-917a-3aa480f32fc8" status: 200 len: 1521 microversion: 2.1 time: 0.154957 Oct 04 19:33:03.321941 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3719/7068] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:33:03 2022] GET /compute/v2.1/servers/f6958fe8-4e4e-4662-917a-3aa480f32fc8 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:33:04.345320 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-94b87266-fab6-4220-8688-5b954dcef18d tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:33:04.345943 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-94b87266-fab6-4220-8688-5b954dcef18d tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] [instance: f6958fe8-4e4e-4662-917a-3aa480f32fc8] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:33:04.348925 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:33:04.354265 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-94b87266-fab6-4220-8688-5b954dcef18d tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:04.354786 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-94b87266-fab6-4220-8688-5b954dcef18d tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:04.355234 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-94b87266-fab6-4220-8688-5b954dcef18d tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:04.355929 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-94b87266-fab6-4220-8688-5b954dcef18d tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:04.356391 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-94b87266-fab6-4220-8688-5b954dcef18d tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:04.356826 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-94b87266-fab6-4220-8688-5b954dcef18d tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:04.492045 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-94b87266-fab6-4220-8688-5b954dcef18d tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a20d5dbdbb74c0c9921ed0eecb688c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1025a52a7ef44d6b3727e87ea3dfcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:33:04.500987 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-94b87266-fab6-4220-8688-5b954dcef18d tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] 10.222.0.43 "GET /compute/v2.1/servers/f6958fe8-4e4e-4662-917a-3aa480f32fc8" status: 200 len: 1521 microversion: 2.1 time: 0.159763 Oct 04 19:33:04.501596 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3350/7069] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:33:04 2022] GET /compute/v2.1/servers/f6958fe8-4e4e-4662-917a-3aa480f32fc8 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:33:05.524687 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-83f7ff8f-2a3e-443c-87eb-98cd4b175293 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:33:05.525348 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-83f7ff8f-2a3e-443c-87eb-98cd4b175293 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] [instance: f6958fe8-4e4e-4662-917a-3aa480f32fc8] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:33:05.528203 n-d-851028-13 devstack@n-api.service[123596]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 19:33:05.528350 n-d-851028-13 devstack@n-api.service[123596]: Tue Oct 4 19:33:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f6958fe8-4e4e-4662-917a-3aa480f32fc8 (ip 10.222.0.43) !!! Oct 04 19:33:05.540603 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-83f7ff8f-2a3e-443c-87eb-98cd4b175293 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:05.541123 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-83f7ff8f-2a3e-443c-87eb-98cd4b175293 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:05.541584 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-83f7ff8f-2a3e-443c-87eb-98cd4b175293 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:05.542330 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-83f7ff8f-2a3e-443c-87eb-98cd4b175293 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:05.542819 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-83f7ff8f-2a3e-443c-87eb-98cd4b175293 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:05.543272 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-83f7ff8f-2a3e-443c-87eb-98cd4b175293 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:05.675040 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-83f7ff8f-2a3e-443c-87eb-98cd4b175293 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a20d5dbdbb74c0c9921ed0eecb688c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1025a52a7ef44d6b3727e87ea3dfcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:33:05.683027 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-83f7ff8f-2a3e-443c-87eb-98cd4b175293 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] 10.222.0.43 "GET /compute/v2.1/servers/f6958fe8-4e4e-4662-917a-3aa480f32fc8" status: 200 len: 1521 microversion: 2.1 time: 0.162913 Oct 04 19:33:05.683609 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3720/7070] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:33:05 2022] GET /compute/v2.1/servers/f6958fe8-4e4e-4662-917a-3aa480f32fc8 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:33:06.706232 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-f9b7a10f-71e7-4350-8716-34a7f1b3933d tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:33:06.706848 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-f9b7a10f-71e7-4350-8716-34a7f1b3933d tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] [instance: f6958fe8-4e4e-4662-917a-3aa480f32fc8] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:33:06.714326 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f9b7a10f-71e7-4350-8716-34a7f1b3933d tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:06.714804 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f9b7a10f-71e7-4350-8716-34a7f1b3933d tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:06.715239 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f9b7a10f-71e7-4350-8716-34a7f1b3933d tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:06.715922 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f9b7a10f-71e7-4350-8716-34a7f1b3933d tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:06.716403 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f9b7a10f-71e7-4350-8716-34a7f1b3933d tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:06.716863 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f9b7a10f-71e7-4350-8716-34a7f1b3933d tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:06.851268 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-f9b7a10f-71e7-4350-8716-34a7f1b3933d tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a20d5dbdbb74c0c9921ed0eecb688c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1025a52a7ef44d6b3727e87ea3dfcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:33:06.859573 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-f9b7a10f-71e7-4350-8716-34a7f1b3933d tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] 10.222.0.43 "GET /compute/v2.1/servers/f6958fe8-4e4e-4662-917a-3aa480f32fc8" status: 200 len: 1521 microversion: 2.1 time: 0.157277 Oct 04 19:33:06.860180 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3351/7071] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:33:06 2022] GET /compute/v2.1/servers/f6958fe8-4e4e-4662-917a-3aa480f32fc8 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:33:07.882815 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-bce90f7b-e289-467a-8251-d166ce48605f tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:33:07.883476 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-bce90f7b-e289-467a-8251-d166ce48605f tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] [instance: f6958fe8-4e4e-4662-917a-3aa480f32fc8] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:33:07.891426 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bce90f7b-e289-467a-8251-d166ce48605f tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:07.891956 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bce90f7b-e289-467a-8251-d166ce48605f tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:07.892406 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bce90f7b-e289-467a-8251-d166ce48605f tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:07.893161 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bce90f7b-e289-467a-8251-d166ce48605f tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:07.893630 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bce90f7b-e289-467a-8251-d166ce48605f tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:07.894070 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bce90f7b-e289-467a-8251-d166ce48605f tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:08.031002 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-bce90f7b-e289-467a-8251-d166ce48605f tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a20d5dbdbb74c0c9921ed0eecb688c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1025a52a7ef44d6b3727e87ea3dfcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:33:08.038961 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-bce90f7b-e289-467a-8251-d166ce48605f tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] 10.222.0.43 "GET /compute/v2.1/servers/f6958fe8-4e4e-4662-917a-3aa480f32fc8" status: 200 len: 1521 microversion: 2.1 time: 0.160111 Oct 04 19:33:08.039539 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3721/7072] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:33:07 2022] GET /compute/v2.1/servers/f6958fe8-4e4e-4662-917a-3aa480f32fc8 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:33:09.062487 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-46b17f52-0384-4a9f-b2b6-57cf1e8a9e6f tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:33:09.063100 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-46b17f52-0384-4a9f-b2b6-57cf1e8a9e6f tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] [instance: f6958fe8-4e4e-4662-917a-3aa480f32fc8] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:33:09.069890 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-46b17f52-0384-4a9f-b2b6-57cf1e8a9e6f tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:09.070355 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-46b17f52-0384-4a9f-b2b6-57cf1e8a9e6f tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:09.070785 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-46b17f52-0384-4a9f-b2b6-57cf1e8a9e6f tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:09.071469 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-46b17f52-0384-4a9f-b2b6-57cf1e8a9e6f tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:09.072483 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-46b17f52-0384-4a9f-b2b6-57cf1e8a9e6f tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:09.072910 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-46b17f52-0384-4a9f-b2b6-57cf1e8a9e6f tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:09.202151 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-46b17f52-0384-4a9f-b2b6-57cf1e8a9e6f tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a20d5dbdbb74c0c9921ed0eecb688c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1025a52a7ef44d6b3727e87ea3dfcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:33:09.209929 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-46b17f52-0384-4a9f-b2b6-57cf1e8a9e6f tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] 10.222.0.43 "GET /compute/v2.1/servers/f6958fe8-4e4e-4662-917a-3aa480f32fc8" status: 200 len: 1521 microversion: 2.1 time: 0.151347 Oct 04 19:33:09.210503 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3352/7073] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:33:09 2022] GET /compute/v2.1/servers/f6958fe8-4e4e-4662-917a-3aa480f32fc8 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:33:10.234479 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-35d30f82-d865-49c7-8391-f821ec243ddb tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:33:10.235115 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-35d30f82-d865-49c7-8391-f821ec243ddb tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] [instance: f6958fe8-4e4e-4662-917a-3aa480f32fc8] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:33:10.242052 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-35d30f82-d865-49c7-8391-f821ec243ddb tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:10.242556 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-35d30f82-d865-49c7-8391-f821ec243ddb tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:10.243019 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-35d30f82-d865-49c7-8391-f821ec243ddb tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:10.244234 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-35d30f82-d865-49c7-8391-f821ec243ddb tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:10.244704 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-35d30f82-d865-49c7-8391-f821ec243ddb tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:10.245169 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-35d30f82-d865-49c7-8391-f821ec243ddb tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:10.376319 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-35d30f82-d865-49c7-8391-f821ec243ddb tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a20d5dbdbb74c0c9921ed0eecb688c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1025a52a7ef44d6b3727e87ea3dfcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:33:10.385762 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-35d30f82-d865-49c7-8391-f821ec243ddb tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] 10.222.0.43 "GET /compute/v2.1/servers/f6958fe8-4e4e-4662-917a-3aa480f32fc8" status: 200 len: 1521 microversion: 2.1 time: 0.155706 Oct 04 19:33:10.386345 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3722/7074] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:33:10 2022] GET /compute/v2.1/servers/f6958fe8-4e4e-4662-917a-3aa480f32fc8 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:33:11.408437 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-ef2d23f8-e683-4452-a0b8-d6dc61c558c8 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:33:11.409050 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-ef2d23f8-e683-4452-a0b8-d6dc61c558c8 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] [instance: f6958fe8-4e4e-4662-917a-3aa480f32fc8] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:33:11.415863 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ef2d23f8-e683-4452-a0b8-d6dc61c558c8 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:11.416340 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ef2d23f8-e683-4452-a0b8-d6dc61c558c8 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:11.416775 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ef2d23f8-e683-4452-a0b8-d6dc61c558c8 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:11.417480 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ef2d23f8-e683-4452-a0b8-d6dc61c558c8 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:11.417931 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ef2d23f8-e683-4452-a0b8-d6dc61c558c8 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:11.418357 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ef2d23f8-e683-4452-a0b8-d6dc61c558c8 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:11.551971 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-ef2d23f8-e683-4452-a0b8-d6dc61c558c8 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a20d5dbdbb74c0c9921ed0eecb688c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1025a52a7ef44d6b3727e87ea3dfcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:33:11.560169 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-ef2d23f8-e683-4452-a0b8-d6dc61c558c8 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] 10.222.0.43 "GET /compute/v2.1/servers/f6958fe8-4e4e-4662-917a-3aa480f32fc8" status: 200 len: 1521 microversion: 2.1 time: 0.155570 Oct 04 19:33:11.560746 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3353/7075] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:33:11 2022] GET /compute/v2.1/servers/f6958fe8-4e4e-4662-917a-3aa480f32fc8 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:33:12.583962 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-ab41371f-66c6-4f98-97d8-0e0818ddc68f tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:33:12.584720 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-ab41371f-66c6-4f98-97d8-0e0818ddc68f tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] [instance: f6958fe8-4e4e-4662-917a-3aa480f32fc8] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:33:12.592274 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ab41371f-66c6-4f98-97d8-0e0818ddc68f tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:12.592782 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ab41371f-66c6-4f98-97d8-0e0818ddc68f tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:12.593273 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ab41371f-66c6-4f98-97d8-0e0818ddc68f tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:12.593996 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ab41371f-66c6-4f98-97d8-0e0818ddc68f tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:12.594464 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ab41371f-66c6-4f98-97d8-0e0818ddc68f tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:12.594909 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ab41371f-66c6-4f98-97d8-0e0818ddc68f tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:12.734395 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-ab41371f-66c6-4f98-97d8-0e0818ddc68f tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a20d5dbdbb74c0c9921ed0eecb688c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1025a52a7ef44d6b3727e87ea3dfcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:33:12.742474 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-ab41371f-66c6-4f98-97d8-0e0818ddc68f tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] 10.222.0.43 "GET /compute/v2.1/servers/f6958fe8-4e4e-4662-917a-3aa480f32fc8" status: 200 len: 1521 microversion: 2.1 time: 0.162485 Oct 04 19:33:12.743057 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3723/7076] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:33:12 2022] GET /compute/v2.1/servers/f6958fe8-4e4e-4662-917a-3aa480f32fc8 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:33:13.775683 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-c6ee083e-f6f1-407b-a508-270159d78685 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:33:13.776294 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-c6ee083e-f6f1-407b-a508-270159d78685 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] [instance: f6958fe8-4e4e-4662-917a-3aa480f32fc8] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:33:13.783433 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c6ee083e-f6f1-407b-a508-270159d78685 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:13.783915 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c6ee083e-f6f1-407b-a508-270159d78685 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:13.784351 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c6ee083e-f6f1-407b-a508-270159d78685 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:13.785053 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c6ee083e-f6f1-407b-a508-270159d78685 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:13.785542 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c6ee083e-f6f1-407b-a508-270159d78685 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:13.785964 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c6ee083e-f6f1-407b-a508-270159d78685 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:13.926155 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-c6ee083e-f6f1-407b-a508-270159d78685 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a20d5dbdbb74c0c9921ed0eecb688c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1025a52a7ef44d6b3727e87ea3dfcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:33:13.934779 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-c6ee083e-f6f1-407b-a508-270159d78685 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] 10.222.0.43 "GET /compute/v2.1/servers/f6958fe8-4e4e-4662-917a-3aa480f32fc8" status: 200 len: 1521 microversion: 2.1 time: 0.163646 Oct 04 19:33:13.935374 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3354/7077] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:33:13 2022] GET /compute/v2.1/servers/f6958fe8-4e4e-4662-917a-3aa480f32fc8 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:33:14.959101 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-4f5abcb0-b7ae-4c41-8238-8fda281ec18c tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:33:14.959734 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-4f5abcb0-b7ae-4c41-8238-8fda281ec18c tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] [instance: f6958fe8-4e4e-4662-917a-3aa480f32fc8] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:33:14.967425 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4f5abcb0-b7ae-4c41-8238-8fda281ec18c tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:14.967931 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4f5abcb0-b7ae-4c41-8238-8fda281ec18c tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:14.968388 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4f5abcb0-b7ae-4c41-8238-8fda281ec18c tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:14.969198 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4f5abcb0-b7ae-4c41-8238-8fda281ec18c tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:14.969625 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4f5abcb0-b7ae-4c41-8238-8fda281ec18c tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:14.970071 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4f5abcb0-b7ae-4c41-8238-8fda281ec18c tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:15.103820 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-4f5abcb0-b7ae-4c41-8238-8fda281ec18c tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a20d5dbdbb74c0c9921ed0eecb688c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1025a52a7ef44d6b3727e87ea3dfcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:33:15.111757 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-4f5abcb0-b7ae-4c41-8238-8fda281ec18c tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] 10.222.0.43 "GET /compute/v2.1/servers/f6958fe8-4e4e-4662-917a-3aa480f32fc8" status: 200 len: 1521 microversion: 2.1 time: 0.156572 Oct 04 19:33:15.112347 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3724/7078] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:33:14 2022] GET /compute/v2.1/servers/f6958fe8-4e4e-4662-917a-3aa480f32fc8 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:33:16.135550 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-612a14a8-3241-485a-b858-5c697700f6e8 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:33:16.136845 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-612a14a8-3241-485a-b858-5c697700f6e8 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] [instance: f6958fe8-4e4e-4662-917a-3aa480f32fc8] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:33:16.144014 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-612a14a8-3241-485a-b858-5c697700f6e8 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:16.144553 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-612a14a8-3241-485a-b858-5c697700f6e8 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:16.144990 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-612a14a8-3241-485a-b858-5c697700f6e8 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:16.145772 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-612a14a8-3241-485a-b858-5c697700f6e8 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:16.146237 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-612a14a8-3241-485a-b858-5c697700f6e8 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:16.146669 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-612a14a8-3241-485a-b858-5c697700f6e8 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:16.151498 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=82 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:33:16.291503 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-612a14a8-3241-485a-b858-5c697700f6e8 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a20d5dbdbb74c0c9921ed0eecb688c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1025a52a7ef44d6b3727e87ea3dfcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:33:16.299562 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-612a14a8-3241-485a-b858-5c697700f6e8 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] 10.222.0.43 "GET /compute/v2.1/servers/f6958fe8-4e4e-4662-917a-3aa480f32fc8" status: 200 len: 1521 microversion: 2.1 time: 0.168296 Oct 04 19:33:16.300160 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3355/7079] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:33:16 2022] GET /compute/v2.1/servers/f6958fe8-4e4e-4662-917a-3aa480f32fc8 => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:33:16.940532 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-c21ed6cc-d795-43c2-8d62-fc0433367f7d req-23434a29-8561-45ee-bb83-bb617b0ce9dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6958fe8-4e4e-4662-917a-3aa480f32fc8", "name": "network-vif-unplugged", "status": "completed", "tag": "869ea618-2637-4c7e-965f-fc57d5aa8fdf"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:33:16.951683 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-c21ed6cc-d795-43c2-8d62-fc0433367f7d req-23434a29-8561-45ee-bb83-bb617b0ce9dd service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:16.952210 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-c21ed6cc-d795-43c2-8d62-fc0433367f7d req-23434a29-8561-45ee-bb83-bb617b0ce9dd service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:16.952808 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-c21ed6cc-d795-43c2-8d62-fc0433367f7d req-23434a29-8561-45ee-bb83-bb617b0ce9dd service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:16.966029 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-c21ed6cc-d795-43c2-8d62-fc0433367f7d req-23434a29-8561-45ee-bb83-bb617b0ce9dd service nova] Creating event network-vif-unplugged:869ea618-2637-4c7e-965f-fc57d5aa8fdf for instance f6958fe8-4e4e-4662-917a-3aa480f32fc8 on n-h1-851028-13 Oct 04 19:33:16.972660 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [req-c21ed6cc-d795-43c2-8d62-fc0433367f7d req-23434a29-8561-45ee-bb83-bb617b0ce9dd service nova] Instance f6958fe8-4e4e-4662-917a-3aa480f32fc8 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851028-13', 'n-h2-851028-13'} {{(pid=123596) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 19:33:16.986284 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-c21ed6cc-d795-43c2-8d62-fc0433367f7d req-23434a29-8561-45ee-bb83-bb617b0ce9dd service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049336 Oct 04 19:33:16.986956 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3725/7080] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:33:16 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:33:17.323655 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-8e422611-6551-4efd-92c2-29ef6ec522b1 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:33:17.324291 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-8e422611-6551-4efd-92c2-29ef6ec522b1 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] [instance: f6958fe8-4e4e-4662-917a-3aa480f32fc8] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:33:17.331708 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8e422611-6551-4efd-92c2-29ef6ec522b1 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:17.332211 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8e422611-6551-4efd-92c2-29ef6ec522b1 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:17.332657 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8e422611-6551-4efd-92c2-29ef6ec522b1 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:17.333402 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8e422611-6551-4efd-92c2-29ef6ec522b1 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:17.333862 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8e422611-6551-4efd-92c2-29ef6ec522b1 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:17.334293 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8e422611-6551-4efd-92c2-29ef6ec522b1 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:17.547737 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-8e422611-6551-4efd-92c2-29ef6ec522b1 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a20d5dbdbb74c0c9921ed0eecb688c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1025a52a7ef44d6b3727e87ea3dfcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:33:17.555610 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-8e422611-6551-4efd-92c2-29ef6ec522b1 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] 10.222.0.43 "GET /compute/v2.1/servers/f6958fe8-4e4e-4662-917a-3aa480f32fc8" status: 200 len: 1520 microversion: 2.1 time: 0.236336 Oct 04 19:33:17.556329 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3356/7081] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:33:17 2022] GET /compute/v2.1/servers/f6958fe8-4e4e-4662-917a-3aa480f32fc8 => generated 1520 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:33:18.580578 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-d6a318fe-286b-45b4-92bf-32c9ec82403e tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:33:18.581346 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-d6a318fe-286b-45b4-92bf-32c9ec82403e tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] [instance: f6958fe8-4e4e-4662-917a-3aa480f32fc8] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:33:18.588530 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d6a318fe-286b-45b4-92bf-32c9ec82403e tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:18.589036 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d6a318fe-286b-45b4-92bf-32c9ec82403e tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:18.589519 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d6a318fe-286b-45b4-92bf-32c9ec82403e tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:18.590238 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d6a318fe-286b-45b4-92bf-32c9ec82403e tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:18.590712 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d6a318fe-286b-45b4-92bf-32c9ec82403e tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:18.591160 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d6a318fe-286b-45b4-92bf-32c9ec82403e tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:18.731065 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-d6a318fe-286b-45b4-92bf-32c9ec82403e tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a20d5dbdbb74c0c9921ed0eecb688c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1025a52a7ef44d6b3727e87ea3dfcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:33:18.739409 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-d6a318fe-286b-45b4-92bf-32c9ec82403e tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] 10.222.0.43 "GET /compute/v2.1/servers/f6958fe8-4e4e-4662-917a-3aa480f32fc8" status: 200 len: 1518 microversion: 2.1 time: 0.163908 Oct 04 19:33:18.740025 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3726/7082] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:33:18 2022] GET /compute/v2.1/servers/f6958fe8-4e4e-4662-917a-3aa480f32fc8 => generated 1518 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:33:19.015839 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-81822066-a61c-426d-90f9-d2fdecfca8fe req-451c7637-93b7-446a-9230-e60b62a30538 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6958fe8-4e4e-4662-917a-3aa480f32fc8", "tag": "869ea618-2637-4c7e-965f-fc57d5aa8fdf"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:33:19.026707 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-81822066-a61c-426d-90f9-d2fdecfca8fe req-451c7637-93b7-446a-9230-e60b62a30538 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:19.027195 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-81822066-a61c-426d-90f9-d2fdecfca8fe req-451c7637-93b7-446a-9230-e60b62a30538 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:19.027627 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-81822066-a61c-426d-90f9-d2fdecfca8fe req-451c7637-93b7-446a-9230-e60b62a30538 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:19.042748 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-81822066-a61c-426d-90f9-d2fdecfca8fe req-451c7637-93b7-446a-9230-e60b62a30538 service nova] Creating event network-changed:869ea618-2637-4c7e-965f-fc57d5aa8fdf for instance f6958fe8-4e4e-4662-917a-3aa480f32fc8 on n-h1-851028-13 Oct 04 19:33:19.049188 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [req-81822066-a61c-426d-90f9-d2fdecfca8fe req-451c7637-93b7-446a-9230-e60b62a30538 service nova] Instance f6958fe8-4e4e-4662-917a-3aa480f32fc8 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851028-13', 'n-h2-851028-13'} {{(pid=123595) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 19:33:19.061975 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-81822066-a61c-426d-90f9-d2fdecfca8fe req-451c7637-93b7-446a-9230-e60b62a30538 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049790 Oct 04 19:33:19.062634 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3357/7083] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:33:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:33:19.763835 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-81a5b5b1-d808-4463-b68b-8915632cab7f tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:33:19.764378 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-81a5b5b1-d808-4463-b68b-8915632cab7f tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] [instance: f6958fe8-4e4e-4662-917a-3aa480f32fc8] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:33:19.771456 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-81a5b5b1-d808-4463-b68b-8915632cab7f tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:19.771951 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-81a5b5b1-d808-4463-b68b-8915632cab7f tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:19.772409 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-81a5b5b1-d808-4463-b68b-8915632cab7f tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:19.773136 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-81a5b5b1-d808-4463-b68b-8915632cab7f tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:19.773619 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-81a5b5b1-d808-4463-b68b-8915632cab7f tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:19.774062 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-81a5b5b1-d808-4463-b68b-8915632cab7f tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:19.922676 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-81a5b5b1-d808-4463-b68b-8915632cab7f tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a20d5dbdbb74c0c9921ed0eecb688c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1025a52a7ef44d6b3727e87ea3dfcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:33:19.936735 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-81a5b5b1-d808-4463-b68b-8915632cab7f tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] 10.222.0.43 "GET /compute/v2.1/servers/f6958fe8-4e4e-4662-917a-3aa480f32fc8" status: 200 len: 1515 microversion: 2.1 time: 0.176366 Oct 04 19:33:19.937854 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3727/7084] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:33:19 2022] GET /compute/v2.1/servers/f6958fe8-4e4e-4662-917a-3aa480f32fc8 => generated 1515 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:33:19.965325 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-97ccbe47-c53b-4fae-b25a-c8a746588706 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:33:19.966325 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-97ccbe47-c53b-4fae-b25a-c8a746588706 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] [instance: f6958fe8-4e4e-4662-917a-3aa480f32fc8] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:33:19.973310 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-97ccbe47-c53b-4fae-b25a-c8a746588706 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:19.973809 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-97ccbe47-c53b-4fae-b25a-c8a746588706 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:19.974241 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-97ccbe47-c53b-4fae-b25a-c8a746588706 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:19.975186 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-97ccbe47-c53b-4fae-b25a-c8a746588706 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:19.975645 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-97ccbe47-c53b-4fae-b25a-c8a746588706 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:19.976073 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-97ccbe47-c53b-4fae-b25a-c8a746588706 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:20.039907 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-97ccbe47-c53b-4fae-b25a-c8a746588706 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] 10.222.0.43 "POST /compute/v2.1/servers/f6958fe8-4e4e-4662-917a-3aa480f32fc8/action" status: 204 len: 0 microversion: 2.1 time: 0.082717 Oct 04 19:33:20.041634 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3358/7085] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 19:33:19 2022] POST /compute/v2.1/servers/f6958fe8-4e4e-4662-917a-3aa480f32fc8/action => generated 0 bytes in 86 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:33:20.050287 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-d797fa31-0dc7-49b0-b438-27aa2813b07c tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:33:20.050934 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-d797fa31-0dc7-49b0-b438-27aa2813b07c tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] [instance: f6958fe8-4e4e-4662-917a-3aa480f32fc8] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:33:20.057856 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d797fa31-0dc7-49b0-b438-27aa2813b07c tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:20.058794 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d797fa31-0dc7-49b0-b438-27aa2813b07c tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:20.059195 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d797fa31-0dc7-49b0-b438-27aa2813b07c tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:20.059634 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d797fa31-0dc7-49b0-b438-27aa2813b07c tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:20.060290 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d797fa31-0dc7-49b0-b438-27aa2813b07c tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:20.060552 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d797fa31-0dc7-49b0-b438-27aa2813b07c tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:20.282370 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-d797fa31-0dc7-49b0-b438-27aa2813b07c tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a20d5dbdbb74c0c9921ed0eecb688c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1025a52a7ef44d6b3727e87ea3dfcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:33:20.291053 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-d797fa31-0dc7-49b0-b438-27aa2813b07c tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] 10.222.0.43 "GET /compute/v2.1/servers/f6958fe8-4e4e-4662-917a-3aa480f32fc8" status: 200 len: 1515 microversion: 2.1 time: 0.244857 Oct 04 19:33:20.291582 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3728/7086] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:33:20 2022] GET /compute/v2.1/servers/f6958fe8-4e4e-4662-917a-3aa480f32fc8 => generated 1515 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:33:21.315969 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-3db24d0a-b248-4858-a2f8-ea3f469af82b tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:33:21.316688 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-3db24d0a-b248-4858-a2f8-ea3f469af82b tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] [instance: f6958fe8-4e4e-4662-917a-3aa480f32fc8] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:33:21.323606 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3db24d0a-b248-4858-a2f8-ea3f469af82b tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:21.324085 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3db24d0a-b248-4858-a2f8-ea3f469af82b tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:21.324720 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3db24d0a-b248-4858-a2f8-ea3f469af82b tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:21.325458 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3db24d0a-b248-4858-a2f8-ea3f469af82b tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:21.325935 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3db24d0a-b248-4858-a2f8-ea3f469af82b tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:21.326362 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3db24d0a-b248-4858-a2f8-ea3f469af82b tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:21.476403 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-3db24d0a-b248-4858-a2f8-ea3f469af82b tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a20d5dbdbb74c0c9921ed0eecb688c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1025a52a7ef44d6b3727e87ea3dfcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:33:21.484922 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-3db24d0a-b248-4858-a2f8-ea3f469af82b tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] 10.222.0.43 "GET /compute/v2.1/servers/f6958fe8-4e4e-4662-917a-3aa480f32fc8" status: 200 len: 1507 microversion: 2.1 time: 0.173095 Oct 04 19:33:21.485754 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3359/7087] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:33:21 2022] GET /compute/v2.1/servers/f6958fe8-4e4e-4662-917a-3aa480f32fc8 => generated 1507 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:33:21.508021 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-7c25adb1-676d-4b34-bfda-6081fac71aec tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:33:21.508674 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-7c25adb1-676d-4b34-bfda-6081fac71aec tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] [instance: f6958fe8-4e4e-4662-917a-3aa480f32fc8] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:33:21.516284 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7c25adb1-676d-4b34-bfda-6081fac71aec tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:21.516882 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7c25adb1-676d-4b34-bfda-6081fac71aec tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:21.517354 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-e679fe35-6850-4ce8-b36b-63035769aca3 req-bc77f859-52b4-41a1-be09-fee493b24d95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6958fe8-4e4e-4662-917a-3aa480f32fc8", "name": "network-vif-plugged", "status": "completed", "tag": "869ea618-2637-4c7e-965f-fc57d5aa8fdf"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:33:21.517507 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7c25adb1-676d-4b34-bfda-6081fac71aec tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:21.518138 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7c25adb1-676d-4b34-bfda-6081fac71aec tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:21.518825 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7c25adb1-676d-4b34-bfda-6081fac71aec tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:21.519283 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7c25adb1-676d-4b34-bfda-6081fac71aec tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:21.532096 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-e679fe35-6850-4ce8-b36b-63035769aca3 req-bc77f859-52b4-41a1-be09-fee493b24d95 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:21.532588 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-e679fe35-6850-4ce8-b36b-63035769aca3 req-bc77f859-52b4-41a1-be09-fee493b24d95 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:21.533021 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-e679fe35-6850-4ce8-b36b-63035769aca3 req-bc77f859-52b4-41a1-be09-fee493b24d95 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:21.545417 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-e679fe35-6850-4ce8-b36b-63035769aca3 req-bc77f859-52b4-41a1-be09-fee493b24d95 service nova] Creating event network-vif-plugged:869ea618-2637-4c7e-965f-fc57d5aa8fdf for instance f6958fe8-4e4e-4662-917a-3aa480f32fc8 on n-h1-851028-13 Oct 04 19:33:21.550376 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-e679fe35-6850-4ce8-b36b-63035769aca3 req-bc77f859-52b4-41a1-be09-fee493b24d95 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036578 Oct 04 19:33:21.551400 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3360/7088] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:33:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:33:21.655425 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-7c25adb1-676d-4b34-bfda-6081fac71aec tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a20d5dbdbb74c0c9921ed0eecb688c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1025a52a7ef44d6b3727e87ea3dfcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:33:21.663339 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-7c25adb1-676d-4b34-bfda-6081fac71aec tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] 10.222.0.43 "GET /compute/v2.1/servers/f6958fe8-4e4e-4662-917a-3aa480f32fc8" status: 200 len: 1507 microversion: 2.1 time: 0.159419 Oct 04 19:33:21.663912 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3729/7089] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:33:21 2022] GET /compute/v2.1/servers/f6958fe8-4e4e-4662-917a-3aa480f32fc8 => generated 1507 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:33:21.685600 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-2af011ea-83b1-4100-97fa-05edc7920f0e tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:33:21.686323 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-2af011ea-83b1-4100-97fa-05edc7920f0e tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] [instance: f6958fe8-4e4e-4662-917a-3aa480f32fc8] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:33:21.692772 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2af011ea-83b1-4100-97fa-05edc7920f0e tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:21.693296 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2af011ea-83b1-4100-97fa-05edc7920f0e tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:21.693734 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2af011ea-83b1-4100-97fa-05edc7920f0e tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:21.694471 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2af011ea-83b1-4100-97fa-05edc7920f0e tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:21.694944 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2af011ea-83b1-4100-97fa-05edc7920f0e tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:21.695372 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2af011ea-83b1-4100-97fa-05edc7920f0e tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:21.837769 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-2af011ea-83b1-4100-97fa-05edc7920f0e tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a20d5dbdbb74c0c9921ed0eecb688c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1025a52a7ef44d6b3727e87ea3dfcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:33:21.845857 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-2af011ea-83b1-4100-97fa-05edc7920f0e tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] 10.222.0.43 "GET /compute/v2.1/servers/f6958fe8-4e4e-4662-917a-3aa480f32fc8" status: 200 len: 1507 microversion: 2.1 time: 0.164632 Oct 04 19:33:21.846693 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3361/7090] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:33:21 2022] GET /compute/v2.1/servers/f6958fe8-4e4e-4662-917a-3aa480f32fc8 => generated 1507 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:33:21.868433 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-8b3db6d6-604e-4e44-8b5b-6b349d3a9302 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:33:21.868939 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-8b3db6d6-604e-4e44-8b5b-6b349d3a9302 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] [instance: f6958fe8-4e4e-4662-917a-3aa480f32fc8] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:33:21.875220 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8b3db6d6-604e-4e44-8b5b-6b349d3a9302 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:21.875722 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8b3db6d6-604e-4e44-8b5b-6b349d3a9302 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:21.876179 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8b3db6d6-604e-4e44-8b5b-6b349d3a9302 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:21.876898 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8b3db6d6-604e-4e44-8b5b-6b349d3a9302 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:21.877420 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8b3db6d6-604e-4e44-8b5b-6b349d3a9302 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:21.877864 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8b3db6d6-604e-4e44-8b5b-6b349d3a9302 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:21.907353 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-8b3db6d6-604e-4e44-8b5b-6b349d3a9302 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] [instance: f6958fe8-4e4e-4662-917a-3aa480f32fc8] Going to try to terminate instance {{(pid=123596) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 19:33:21.987526 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-8b3db6d6-604e-4e44-8b5b-6b349d3a9302 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] 10.222.0.43 "DELETE /compute/v2.1/servers/f6958fe8-4e4e-4662-917a-3aa480f32fc8" status: 204 len: 0 microversion: 2.1 time: 0.122884 Oct 04 19:33:21.988337 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3730/7091] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 19:33:21 2022] DELETE /compute/v2.1/servers/f6958fe8-4e4e-4662-917a-3aa480f32fc8 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:33:22.004864 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-434465aa-86b2-4304-822c-c9b6b6e6cfa7 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:33:22.005416 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-434465aa-86b2-4304-822c-c9b6b6e6cfa7 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] [instance: f6958fe8-4e4e-4662-917a-3aa480f32fc8] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:33:22.012037 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-434465aa-86b2-4304-822c-c9b6b6e6cfa7 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:22.012518 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-434465aa-86b2-4304-822c-c9b6b6e6cfa7 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:22.013028 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-434465aa-86b2-4304-822c-c9b6b6e6cfa7 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:22.013754 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-434465aa-86b2-4304-822c-c9b6b6e6cfa7 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:22.014286 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-434465aa-86b2-4304-822c-c9b6b6e6cfa7 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:22.014714 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-434465aa-86b2-4304-822c-c9b6b6e6cfa7 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:22.039473 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-434465aa-86b2-4304-822c-c9b6b6e6cfa7 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] [instance: f6958fe8-4e4e-4662-917a-3aa480f32fc8] Going to try to terminate instance {{(pid=123595) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 19:33:22.086515 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.compute.api [None req-434465aa-86b2-4304-822c-c9b6b6e6cfa7 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] [instance: f6958fe8-4e4e-4662-917a-3aa480f32fc8] Instance is already in deleting state, ignoring this request Oct 04 19:33:22.087421 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-434465aa-86b2-4304-822c-c9b6b6e6cfa7 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] 10.222.0.43 "DELETE /compute/v2.1/servers/f6958fe8-4e4e-4662-917a-3aa480f32fc8" status: 204 len: 0 microversion: 2.1 time: 0.086473 Oct 04 19:33:22.088025 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3362/7092] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 19:33:21 2022] DELETE /compute/v2.1/servers/f6958fe8-4e4e-4662-917a-3aa480f32fc8 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:33:22.097262 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-571e54d8-ed46-413c-98de-8534d46a2080 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:33:22.097986 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-571e54d8-ed46-413c-98de-8534d46a2080 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] [instance: f6958fe8-4e4e-4662-917a-3aa480f32fc8] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:33:22.104353 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-571e54d8-ed46-413c-98de-8534d46a2080 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:22.104858 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-571e54d8-ed46-413c-98de-8534d46a2080 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:22.105401 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-571e54d8-ed46-413c-98de-8534d46a2080 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:22.106146 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-571e54d8-ed46-413c-98de-8534d46a2080 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:22.106731 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-571e54d8-ed46-413c-98de-8534d46a2080 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:22.107203 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-571e54d8-ed46-413c-98de-8534d46a2080 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:22.251983 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-571e54d8-ed46-413c-98de-8534d46a2080 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a20d5dbdbb74c0c9921ed0eecb688c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1025a52a7ef44d6b3727e87ea3dfcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:33:22.260796 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-571e54d8-ed46-413c-98de-8534d46a2080 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] 10.222.0.43 "GET /compute/v2.1/servers/f6958fe8-4e4e-4662-917a-3aa480f32fc8" status: 200 len: 1513 microversion: 2.1 time: 0.168297 Oct 04 19:33:22.261404 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3731/7093] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:33:22 2022] GET /compute/v2.1/servers/f6958fe8-4e4e-4662-917a-3aa480f32fc8 => generated 1513 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:33:23.283938 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-4e4f856a-a670-4505-a0aa-07c25f316be0 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:33:23.284754 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-4e4f856a-a670-4505-a0aa-07c25f316be0 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] [instance: f6958fe8-4e4e-4662-917a-3aa480f32fc8] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:33:23.291437 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4e4f856a-a670-4505-a0aa-07c25f316be0 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:23.291925 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4e4f856a-a670-4505-a0aa-07c25f316be0 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:23.292361 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4e4f856a-a670-4505-a0aa-07c25f316be0 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:23.293064 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4e4f856a-a670-4505-a0aa-07c25f316be0 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:23.293545 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4e4f856a-a670-4505-a0aa-07c25f316be0 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:23.293976 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4e4f856a-a670-4505-a0aa-07c25f316be0 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:23.517300 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-4e4f856a-a670-4505-a0aa-07c25f316be0 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a20d5dbdbb74c0c9921ed0eecb688c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1025a52a7ef44d6b3727e87ea3dfcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:33:23.525561 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-4e4f856a-a670-4505-a0aa-07c25f316be0 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] 10.222.0.43 "GET /compute/v2.1/servers/f6958fe8-4e4e-4662-917a-3aa480f32fc8" status: 200 len: 1513 microversion: 2.1 time: 0.245379 Oct 04 19:33:23.526158 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3363/7094] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:33:23 2022] GET /compute/v2.1/servers/f6958fe8-4e4e-4662-917a-3aa480f32fc8 => generated 1513 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:33:24.127622 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-d03fdace-3344-4132-b39c-07d39dae6205 req-639d88da-77e3-4ed4-890f-b39afd5ff018 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6958fe8-4e4e-4662-917a-3aa480f32fc8", "name": "network-vif-deleted", "tag": "869ea618-2637-4c7e-965f-fc57d5aa8fdf"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:33:24.140263 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-d03fdace-3344-4132-b39c-07d39dae6205 req-639d88da-77e3-4ed4-890f-b39afd5ff018 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:24.140773 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-d03fdace-3344-4132-b39c-07d39dae6205 req-639d88da-77e3-4ed4-890f-b39afd5ff018 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:24.141528 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-d03fdace-3344-4132-b39c-07d39dae6205 req-639d88da-77e3-4ed4-890f-b39afd5ff018 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:24.155456 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-d03fdace-3344-4132-b39c-07d39dae6205 req-639d88da-77e3-4ed4-890f-b39afd5ff018 service nova] Creating event network-vif-deleted:869ea618-2637-4c7e-965f-fc57d5aa8fdf for instance f6958fe8-4e4e-4662-917a-3aa480f32fc8 on n-h1-851028-13 Oct 04 19:33:24.161200 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-d03fdace-3344-4132-b39c-07d39dae6205 req-639d88da-77e3-4ed4-890f-b39afd5ff018 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037099 Oct 04 19:33:24.162193 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3732/7095] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:33:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:33:24.548059 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-694280e2-8558-4cc6-aa64-daf61724a6d8 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:33:24.548665 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-694280e2-8558-4cc6-aa64-daf61724a6d8 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] [instance: f6958fe8-4e4e-4662-917a-3aa480f32fc8] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:33:24.556081 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-694280e2-8558-4cc6-aa64-daf61724a6d8 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:24.556560 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-694280e2-8558-4cc6-aa64-daf61724a6d8 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:24.556992 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-694280e2-8558-4cc6-aa64-daf61724a6d8 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:24.557703 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-694280e2-8558-4cc6-aa64-daf61724a6d8 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:24.558154 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-694280e2-8558-4cc6-aa64-daf61724a6d8 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:24.558602 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-694280e2-8558-4cc6-aa64-daf61724a6d8 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:24.573541 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-694280e2-8558-4cc6-aa64-daf61724a6d8 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] HTTP exception thrown: Instance f6958fe8-4e4e-4662-917a-3aa480f32fc8 could not be found. Oct 04 19:33:24.575257 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-694280e2-8558-4cc6-aa64-daf61724a6d8 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Request method failure captured: Oct 04 19:33:24.575257 n-d-851028-13 devstack@n-api.service[123595]: request: GET /compute/v2.1/servers/f6958fe8-4e4e-4662-917a-3aa480f32fc8 HTTP/1.1 Oct 04 19:33:24.575257 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 19:33:24.575257 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 19:33:24.575257 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 19:33:24.575257 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 0 Oct 04 19:33:24.575257 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 19:33:24.575257 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 19:33:24.575257 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 19:33:24.575257 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 19:33:24.575257 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPIol1DZQ-q8GlLeGwIRa-jr4lcWCeDEX_h0pQJlVSNZHLqKUJ-9-R0uNR3wG8VJkaf_jtZ-6f3qhfn4tWNQfB9dXmUZ4iSK1BYr_bTbT4d5pfl_4qaVjHIfxkGYLaSKu36uOdVORerW4mr9aXeWfy7M7tnJaJ5qUDQuZZDsZBSPAyg8 Oct 04 19:33:24.575257 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 19:33:24.575257 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 19:33:24.575257 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 19:33:24.575257 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 19:33:24.575257 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 19:33:24.575257 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 19:33:24.575257 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: a1025a52a7ef44d6b3727e87ea3dfcf9 Oct 04 19:33:24.575257 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-ServerDiskConfigTestJSON-961030076 Oct 04 19:33:24.575257 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 19:33:24.575257 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 19:33:24.575257 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/a1025a52a7ef44d6b3727e87ea3dfcf9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_a1025a52a7ef44d6b3727e87ea3dfcf9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a1025a52a7ef44d6b3727e87ea3dfcf9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a1025a52a7ef44d6b3727e87ea3dfcf9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 19:33:24.575257 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-ServerDiskConfigTestJSON-961030076 Oct 04 19:33:24.575257 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: a1025a52a7ef44d6b3727e87ea3dfcf9 Oct 04 19:33:24.575257 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-961030076 Oct 04 19:33:24.575257 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-ServerDiskConfigTestJSON-961030076-project Oct 04 19:33:24.575257 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 19:33:24.575257 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 19:33:24.575257 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: 3a20d5dbdbb74c0c9921ed0eecb688c3 Oct 04 19:33:24.575257 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-ServerDiskConfigTestJSON-961030076-project Oct 04 19:33:24.575257 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 19:33:24.575257 n-d-851028-13 devstack@n-api.service[123595]: exception: Instance f6958fe8-4e4e-4662-917a-3aa480f32fc8 could not be found. Oct 04 19:33:24.575257 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': 'f6958fe8-4e4e-4662-917a-3aa480f32fc8'} Oct 04 19:33:24.575257 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:33:24.575257 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:33:24.575257 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:33:24.575257 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:33:24.575257 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:33:24.575257 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:33:24.575257 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:33:24.575257 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:33:24.575257 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:33:24.575257 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:33:24.575257 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f6958fe8-4e4e-4662-917a-3aa480f32fc8 could not be found. Oct 04 19:33:24.575257 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:33:24.575257 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:33:24.575257 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:33:24.575257 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:33:24.575257 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:33:24.575257 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:33:24.575257 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:33:24.575257 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:33:24.575257 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:33:24.575257 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:33:24.575257 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:33:24.575257 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:33:24.575257 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:33:24.575257 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:33:24.575257 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:33:24.575257 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:33:24.575257 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6958fe8-4e4e-4662-917a-3aa480f32fc8 could not be found. Oct 04 19:33:24.575257 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:33:24.575257 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:33:24.575257 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:33:24.580051 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:33:24.580051 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:33:24.580051 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:33:24.580051 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:33:24.580051 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:33:24.580051 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6958fe8-4e4e-4662-917a-3aa480f32fc8 could not be found. Oct 04 19:33:24.580051 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:33:24.580051 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-694280e2-8558-4cc6-aa64-daf61724a6d8 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Returning 404 to user: Instance f6958fe8-4e4e-4662-917a-3aa480f32fc8 could not be found. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:33:24.580051 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-694280e2-8558-4cc6-aa64-daf61724a6d8 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] 10.222.0.43 "GET /compute/v2.1/servers/f6958fe8-4e4e-4662-917a-3aa480f32fc8" status: 404 len: 111 microversion: 2.1 time: 0.032673 Oct 04 19:33:24.580051 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3364/7096] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:33:24 2022] GET /compute/v2.1/servers/f6958fe8-4e4e-4662-917a-3aa480f32fc8 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:33:24.586481 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-90e8ad28-a6e6-41c6-9863-82c538eab221 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Calling method '.version_select at 0x7fb21eb1c790>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:33:24.611135 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-90e8ad28-a6e6-41c6-9863-82c538eab221 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1122837157" status: 202 len: 0 microversion: 2.1 time: 0.028822 Oct 04 19:33:24.611681 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3733/7097] 10.222.0.43 () {58 vars in 1221 bytes} [Tue Oct 4 19:33:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1122837157 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:33:25.262339 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-14904d9a-efaa-4a40-80fb-998633474463 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:33:25.262910 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-14904d9a-efaa-4a40-80fb-998633474463 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] [instance: 3984d73b-0520-4591-9b30-a83a383e9062] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:33:25.269308 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-14904d9a-efaa-4a40-80fb-998633474463 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:25.269868 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-14904d9a-efaa-4a40-80fb-998633474463 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:25.270316 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-14904d9a-efaa-4a40-80fb-998633474463 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:25.271085 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-14904d9a-efaa-4a40-80fb-998633474463 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:25.271622 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-14904d9a-efaa-4a40-80fb-998633474463 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:25.272061 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-14904d9a-efaa-4a40-80fb-998633474463 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:25.288780 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-14904d9a-efaa-4a40-80fb-998633474463 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] HTTP exception thrown: Instance 3984d73b-0520-4591-9b30-a83a383e9062 could not be found. Oct 04 19:33:25.291146 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-14904d9a-efaa-4a40-80fb-998633474463 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Request method failure captured: Oct 04 19:33:25.291146 n-d-851028-13 devstack@n-api.service[123595]: request: DELETE /compute/v2.1/servers/3984d73b-0520-4591-9b30-a83a383e9062 HTTP/1.1 Oct 04 19:33:25.291146 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 19:33:25.291146 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 19:33:25.291146 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 19:33:25.291146 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 0 Oct 04 19:33:25.291146 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 19:33:25.291146 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 19:33:25.291146 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 19:33:25.291146 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 19:33:25.291146 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPIol1DZQ-q8GlLeGwIRa-jr4lcWCeDEX_h0pQJlVSNZHLqKUJ-9-R0uNR3wG8VJkaf_jtZ-6f3qhfn4tWNQfB9dXmUZ4iSK1BYr_bTbT4d5pfl_4qaVjHIfxkGYLaSKu36uOdVORerW4mr9aXeWfy7M7tnJaJ5qUDQuZZDsZBSPAyg8 Oct 04 19:33:25.291146 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 19:33:25.291146 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 19:33:25.291146 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 19:33:25.291146 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 19:33:25.291146 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 19:33:25.291146 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 19:33:25.291146 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: a1025a52a7ef44d6b3727e87ea3dfcf9 Oct 04 19:33:25.291146 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-ServerDiskConfigTestJSON-961030076 Oct 04 19:33:25.291146 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 19:33:25.291146 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 19:33:25.291146 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/a1025a52a7ef44d6b3727e87ea3dfcf9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_a1025a52a7ef44d6b3727e87ea3dfcf9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a1025a52a7ef44d6b3727e87ea3dfcf9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a1025a52a7ef44d6b3727e87ea3dfcf9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 19:33:25.291146 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-ServerDiskConfigTestJSON-961030076 Oct 04 19:33:25.291146 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: a1025a52a7ef44d6b3727e87ea3dfcf9 Oct 04 19:33:25.291146 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-961030076 Oct 04 19:33:25.291146 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-ServerDiskConfigTestJSON-961030076-project Oct 04 19:33:25.291146 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 19:33:25.291146 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 19:33:25.291146 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: 3a20d5dbdbb74c0c9921ed0eecb688c3 Oct 04 19:33:25.291146 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-ServerDiskConfigTestJSON-961030076-project Oct 04 19:33:25.291146 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 19:33:25.291146 n-d-851028-13 devstack@n-api.service[123595]: exception: Instance 3984d73b-0520-4591-9b30-a83a383e9062 could not be found. Oct 04 19:33:25.291146 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': '3984d73b-0520-4591-9b30-a83a383e9062'} Oct 04 19:33:25.291146 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:33:25.291146 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:33:25.291146 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:33:25.291146 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:33:25.291146 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:33:25.291146 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:33:25.291146 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:33:25.291146 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:33:25.291146 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:33:25.291146 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:33:25.291146 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3984d73b-0520-4591-9b30-a83a383e9062 could not be found. Oct 04 19:33:25.291146 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:33:25.291146 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:33:25.291146 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:33:25.291146 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:33:25.291146 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:33:25.291146 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:33:25.291146 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:33:25.291146 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:33:25.291146 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:33:25.291146 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:33:25.291146 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 19:33:25.291146 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 19:33:25.291146 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 19:33:25.291146 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 19:33:25.291146 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:33:25.291146 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:33:25.291146 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:33:25.291146 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:33:25.294942 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3984d73b-0520-4591-9b30-a83a383e9062 could not be found. Oct 04 19:33:25.294942 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:33:25.294942 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:33:25.294942 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:33:25.294942 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:33:25.294942 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:33:25.294942 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:33:25.294942 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:33:25.294942 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:33:25.294942 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3984d73b-0520-4591-9b30-a83a383e9062 could not be found. Oct 04 19:33:25.294942 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:33:25.294942 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-14904d9a-efaa-4a40-80fb-998633474463 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Returning 404 to user: Instance 3984d73b-0520-4591-9b30-a83a383e9062 could not be found. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:33:25.294942 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-14904d9a-efaa-4a40-80fb-998633474463 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] 10.222.0.43 "DELETE /compute/v2.1/servers/3984d73b-0520-4591-9b30-a83a383e9062" status: 404 len: 111 microversion: 2.1 time: 0.034436 Oct 04 19:33:25.294942 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3365/7098] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 19:33:25 2022] DELETE /compute/v2.1/servers/3984d73b-0520-4591-9b30-a83a383e9062 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:33:25.303221 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-a763cd6e-83a2-4a2d-90d2-cc5f89482e17 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:33:25.303967 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-a763cd6e-83a2-4a2d-90d2-cc5f89482e17 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] [instance: 3984d73b-0520-4591-9b30-a83a383e9062] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:33:25.314525 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a763cd6e-83a2-4a2d-90d2-cc5f89482e17 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:25.315027 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a763cd6e-83a2-4a2d-90d2-cc5f89482e17 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:25.315480 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a763cd6e-83a2-4a2d-90d2-cc5f89482e17 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:25.316189 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a763cd6e-83a2-4a2d-90d2-cc5f89482e17 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:25.316654 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a763cd6e-83a2-4a2d-90d2-cc5f89482e17 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:25.317094 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a763cd6e-83a2-4a2d-90d2-cc5f89482e17 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:25.330370 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-a763cd6e-83a2-4a2d-90d2-cc5f89482e17 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] HTTP exception thrown: Instance 3984d73b-0520-4591-9b30-a83a383e9062 could not be found. Oct 04 19:33:25.332026 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-a763cd6e-83a2-4a2d-90d2-cc5f89482e17 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Request method failure captured: Oct 04 19:33:25.332026 n-d-851028-13 devstack@n-api.service[123596]: request: GET /compute/v2.1/servers/3984d73b-0520-4591-9b30-a83a383e9062 HTTP/1.1 Oct 04 19:33:25.332026 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 19:33:25.332026 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 19:33:25.332026 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 19:33:25.332026 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 19:33:25.332026 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 19:33:25.332026 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 19:33:25.332026 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 19:33:25.332026 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 19:33:25.332026 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPIol1DZQ-q8GlLeGwIRa-jr4lcWCeDEX_h0pQJlVSNZHLqKUJ-9-R0uNR3wG8VJkaf_jtZ-6f3qhfn4tWNQfB9dXmUZ4iSK1BYr_bTbT4d5pfl_4qaVjHIfxkGYLaSKu36uOdVORerW4mr9aXeWfy7M7tnJaJ5qUDQuZZDsZBSPAyg8 Oct 04 19:33:25.332026 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 19:33:25.332026 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 19:33:25.332026 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 19:33:25.332026 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 19:33:25.332026 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 19:33:25.332026 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 19:33:25.332026 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: a1025a52a7ef44d6b3727e87ea3dfcf9 Oct 04 19:33:25.332026 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-ServerDiskConfigTestJSON-961030076 Oct 04 19:33:25.332026 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 19:33:25.332026 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 19:33:25.332026 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/a1025a52a7ef44d6b3727e87ea3dfcf9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_a1025a52a7ef44d6b3727e87ea3dfcf9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a1025a52a7ef44d6b3727e87ea3dfcf9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a1025a52a7ef44d6b3727e87ea3dfcf9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 19:33:25.332026 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-ServerDiskConfigTestJSON-961030076 Oct 04 19:33:25.332026 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: a1025a52a7ef44d6b3727e87ea3dfcf9 Oct 04 19:33:25.332026 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-961030076 Oct 04 19:33:25.332026 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-ServerDiskConfigTestJSON-961030076-project Oct 04 19:33:25.332026 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 19:33:25.332026 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 19:33:25.332026 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 3a20d5dbdbb74c0c9921ed0eecb688c3 Oct 04 19:33:25.332026 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-ServerDiskConfigTestJSON-961030076-project Oct 04 19:33:25.332026 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 19:33:25.332026 n-d-851028-13 devstack@n-api.service[123596]: exception: Instance 3984d73b-0520-4591-9b30-a83a383e9062 could not be found. Oct 04 19:33:25.332026 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': '3984d73b-0520-4591-9b30-a83a383e9062'} Oct 04 19:33:25.332026 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:33:25.332026 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:33:25.332026 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:33:25.332026 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:33:25.332026 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:33:25.332026 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:33:25.332026 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:33:25.332026 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:33:25.332026 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:33:25.332026 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:33:25.332026 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3984d73b-0520-4591-9b30-a83a383e9062 could not be found. Oct 04 19:33:25.332026 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:33:25.332026 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:33:25.332026 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:33:25.332026 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:33:25.332026 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:33:25.332026 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:33:25.332026 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:33:25.332026 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:33:25.332026 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:33:25.332026 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:33:25.332026 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:33:25.332026 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:33:25.332026 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:33:25.332026 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:33:25.332026 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:33:25.332026 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:33:25.332026 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3984d73b-0520-4591-9b30-a83a383e9062 could not be found. Oct 04 19:33:25.332026 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:33:25.332026 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:33:25.332026 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:33:25.336496 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:33:25.336496 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:33:25.336496 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:33:25.336496 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:33:25.336496 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:33:25.336496 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3984d73b-0520-4591-9b30-a83a383e9062 could not be found. Oct 04 19:33:25.336496 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:33:25.336496 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-a763cd6e-83a2-4a2d-90d2-cc5f89482e17 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] Returning 404 to user: Instance 3984d73b-0520-4591-9b30-a83a383e9062 could not be found. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:33:25.336496 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-a763cd6e-83a2-4a2d-90d2-cc5f89482e17 tempest-ServerDiskConfigTestJSON-961030076 tempest-ServerDiskConfigTestJSON-961030076-project] 10.222.0.43 "GET /compute/v2.1/servers/3984d73b-0520-4591-9b30-a83a383e9062" status: 404 len: 111 microversion: 2.1 time: 0.035076 Oct 04 19:33:25.336496 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3734/7099] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:33:25 2022] GET /compute/v2.1/servers/3984d73b-0520-4591-9b30-a83a383e9062 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:33:33.889148 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-11e9b0e6-ff4d-4336-9d8f-6e97aad3fecd tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Action: 'create', calling method: .version_select at 0x7fb21e800160>, body: {"keypair": {"name": "tempest-keypair-1677005794", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPHJQLkU1BXKGs5QSlsJAEqyGV1InYNv8e30tv3YHSy4pJ/FYSxdQ3XVgySIECQH5Fb7girXHSqp4Vl3gR5lyumjfsJR7Z4rDVVZn51JM/uGqUPgt8vLAkFegrFy5HAmyQ=="}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:33:33.906375 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-11e9b0e6-ff4d-4336-9d8f-6e97aad3fecd tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Getting quotas for project 0652fe65874b4606822aa7f261387bc8. Resources: {'key_pairs'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:33:33.912174 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-11e9b0e6-ff4d-4336-9d8f-6e97aad3fecd tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Getting quotas for user 0f67ee6767314bfb9cc04ea9c0dafb4b and project 0652fe65874b4606822aa7f261387bc8. Resources: {'key_pairs'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:33:33.939235 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-11e9b0e6-ff4d-4336-9d8f-6e97aad3fecd tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.194550 Oct 04 19:33:33.939840 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3366/7100] 10.222.0.43 () {60 vars in 1159 bytes} [Tue Oct 4 19:33:33 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:33:35.192046 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-18a21f80-4554-49d7-9508-199f0425c1e5 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-126111216", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6c9a7653-1520-46af-adc6-2fa7ddb22865"}], "security_groups": [{"name": "tempest-securitygroup--1858182781"}], "key_name": "tempest-keypair-1677005794", "user_data": "}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:33:35.203072 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:33:35.319142 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.network.neutron [None req-18a21f80-4554-49d7-9508-199f0425c1e5 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] validate_networks() for [('6c9a7653-1520-46af-adc6-2fa7ddb22865', None, None, None, None, None)] {{(pid=123596) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 19:33:35.323410 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:33:35.698528 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-18a21f80-4554-49d7-9508-199f0425c1e5 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Flavor limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:33:35.699074 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-18a21f80-4554-49d7-9508-199f0425c1e5 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Image limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:33:35.699633 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-18a21f80-4554-49d7-9508-199f0425c1e5 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Flavor pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:33:35.700156 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-18a21f80-4554-49d7-9508-199f0425c1e5 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Image pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:33:35.700659 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-18a21f80-4554-49d7-9508-199f0425c1e5 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:33:35.713172 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-18a21f80-4554-49d7-9508-199f0425c1e5 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:35.713897 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-18a21f80-4554-49d7-9508-199f0425c1e5 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:35.714383 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-18a21f80-4554-49d7-9508-199f0425c1e5 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:35.715167 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-18a21f80-4554-49d7-9508-199f0425c1e5 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:35.715742 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-18a21f80-4554-49d7-9508-199f0425c1e5 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:35.716021 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-18a21f80-4554-49d7-9508-199f0425c1e5 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:35.733979 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-18a21f80-4554-49d7-9508-199f0425c1e5 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Getting quotas for project 0652fe65874b4606822aa7f261387bc8. Resources: {'ram', 'cores', 'instances'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:33:35.739305 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-18a21f80-4554-49d7-9508-199f0425c1e5 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Getting quotas for user 0f67ee6767314bfb9cc04ea9c0dafb4b and project 0652fe65874b4606822aa7f261387bc8. Resources: {'ram', 'cores', 'instances'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:33:35.751617 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-18a21f80-4554-49d7-9508-199f0425c1e5 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Going to run 1 instances... {{(pid=123596) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 19:33:35.753969 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-18a21f80-4554-49d7-9508-199f0425c1e5 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: 8f69d18a-8407-4ab4-8f5c-5f23979b2ac6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e8943ec5-4038-4d4b-b9b9-2415a79f5243',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123596) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 19:33:35.803699 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-18a21f80-4554-49d7-9508-199f0425c1e5 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.617370 Oct 04 19:33:35.810415 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3735/7101] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 19:33:35 2022] POST /compute/v2.1/servers => generated 409 bytes in 619 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 19:33:35.813314 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:33:35.817530 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-050a5eb0-ce14-49eb-b263-13d6c04ce5c3 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:33:35.818194 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-050a5eb0-ce14-49eb-b263-13d6c04ce5c3 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: 8f69d18a-8407-4ab4-8f5c-5f23979b2ac6] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:33:35.822727 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=1 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:33:35.895048 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-050a5eb0-ce14-49eb-b263-13d6c04ce5c3 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f67ee6767314bfb9cc04ea9c0dafb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0652fe65874b4606822aa7f261387bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:33:35.903368 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-050a5eb0-ce14-49eb-b263-13d6c04ce5c3 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "GET /compute/v2.1/servers/8f69d18a-8407-4ab4-8f5c-5f23979b2ac6" status: 200 len: 1238 microversion: 2.1 time: 0.091653 Oct 04 19:33:35.903950 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3367/7102] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:33:35 2022] GET /compute/v2.1/servers/8f69d18a-8407-4ab4-8f5c-5f23979b2ac6 => generated 1238 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:33:36.928852 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-1705f7c5-646a-4693-a849-2f3b54e3ee86 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:33:36.929506 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-1705f7c5-646a-4693-a849-2f3b54e3ee86 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: 8f69d18a-8407-4ab4-8f5c-5f23979b2ac6] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:33:36.937339 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1705f7c5-646a-4693-a849-2f3b54e3ee86 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:36.937858 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1705f7c5-646a-4693-a849-2f3b54e3ee86 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:36.938319 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1705f7c5-646a-4693-a849-2f3b54e3ee86 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:36.939046 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1705f7c5-646a-4693-a849-2f3b54e3ee86 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:36.939721 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1705f7c5-646a-4693-a849-2f3b54e3ee86 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:36.940139 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1705f7c5-646a-4693-a849-2f3b54e3ee86 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:37.009164 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-1705f7c5-646a-4693-a849-2f3b54e3ee86 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f67ee6767314bfb9cc04ea9c0dafb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0652fe65874b4606822aa7f261387bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:33:37.017203 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-1705f7c5-646a-4693-a849-2f3b54e3ee86 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "GET /compute/v2.1/servers/8f69d18a-8407-4ab4-8f5c-5f23979b2ac6" status: 200 len: 1290 microversion: 2.1 time: 0.092927 Oct 04 19:33:37.017644 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3736/7103] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:33:36 2022] GET /compute/v2.1/servers/8f69d18a-8407-4ab4-8f5c-5f23979b2ac6 => generated 1290 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:33:38.042301 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-88409447-3b66-417c-abc9-674e5c2d2ece tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:33:38.044352 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-88409447-3b66-417c-abc9-674e5c2d2ece tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: 8f69d18a-8407-4ab4-8f5c-5f23979b2ac6] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:33:38.051857 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-88409447-3b66-417c-abc9-674e5c2d2ece tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:38.052422 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-88409447-3b66-417c-abc9-674e5c2d2ece tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:38.052945 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-88409447-3b66-417c-abc9-674e5c2d2ece tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:38.053844 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-88409447-3b66-417c-abc9-674e5c2d2ece tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:38.054370 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-88409447-3b66-417c-abc9-674e5c2d2ece tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:38.055635 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-88409447-3b66-417c-abc9-674e5c2d2ece tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:38.510238 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-88409447-3b66-417c-abc9-674e5c2d2ece tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f67ee6767314bfb9cc04ea9c0dafb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0652fe65874b4606822aa7f261387bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:33:38.518116 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-88409447-3b66-417c-abc9-674e5c2d2ece tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "GET /compute/v2.1/servers/8f69d18a-8407-4ab4-8f5c-5f23979b2ac6" status: 200 len: 1364 microversion: 2.1 time: 0.481863 Oct 04 19:33:38.518727 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3368/7104] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:33:38 2022] GET /compute/v2.1/servers/8f69d18a-8407-4ab4-8f5c-5f23979b2ac6 => generated 1364 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:33:38.862028 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-fdce303c-a6f1-43df-b4cc-5142da440eeb req-f830126b-4cc5-4d95-a6d3-8553c299660e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f69d18a-8407-4ab4-8f5c-5f23979b2ac6", "tag": "0c21810a-3b21-4130-803f-8da097578121"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:33:38.879785 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-fdce303c-a6f1-43df-b4cc-5142da440eeb req-f830126b-4cc5-4d95-a6d3-8553c299660e service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:38.880467 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-fdce303c-a6f1-43df-b4cc-5142da440eeb req-f830126b-4cc5-4d95-a6d3-8553c299660e service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:38.880916 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-fdce303c-a6f1-43df-b4cc-5142da440eeb req-f830126b-4cc5-4d95-a6d3-8553c299660e service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:38.893621 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-fdce303c-a6f1-43df-b4cc-5142da440eeb req-f830126b-4cc5-4d95-a6d3-8553c299660e service nova] Creating event network-changed:0c21810a-3b21-4130-803f-8da097578121 for instance 8f69d18a-8407-4ab4-8f5c-5f23979b2ac6 on n-h1-851028-13 Oct 04 19:33:38.898715 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-fdce303c-a6f1-43df-b4cc-5142da440eeb req-f830126b-4cc5-4d95-a6d3-8553c299660e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040322 Oct 04 19:33:38.899308 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3737/7105] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:33:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:33:39.543121 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-38c03649-3830-42c3-bfc6-df2d1a766de4 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:33:39.543685 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-38c03649-3830-42c3-bfc6-df2d1a766de4 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: 8f69d18a-8407-4ab4-8f5c-5f23979b2ac6] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:33:39.550428 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-38c03649-3830-42c3-bfc6-df2d1a766de4 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:39.550913 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-38c03649-3830-42c3-bfc6-df2d1a766de4 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:39.551352 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-38c03649-3830-42c3-bfc6-df2d1a766de4 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:39.552044 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-38c03649-3830-42c3-bfc6-df2d1a766de4 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:39.552496 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-38c03649-3830-42c3-bfc6-df2d1a766de4 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:39.552921 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-38c03649-3830-42c3-bfc6-df2d1a766de4 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:39.684929 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-38c03649-3830-42c3-bfc6-df2d1a766de4 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f67ee6767314bfb9cc04ea9c0dafb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0652fe65874b4606822aa7f261387bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:33:39.692562 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-38c03649-3830-42c3-bfc6-df2d1a766de4 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "GET /compute/v2.1/servers/8f69d18a-8407-4ab4-8f5c-5f23979b2ac6" status: 200 len: 1364 microversion: 2.1 time: 0.153929 Oct 04 19:33:39.693151 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3369/7106] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:33:39 2022] GET /compute/v2.1/servers/8f69d18a-8407-4ab4-8f5c-5f23979b2ac6 => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:33:40.717146 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-4b15266f-4217-4f0e-a6f5-dd58a3e08751 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:33:40.717794 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-4b15266f-4217-4f0e-a6f5-dd58a3e08751 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: 8f69d18a-8407-4ab4-8f5c-5f23979b2ac6] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:33:40.724249 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4b15266f-4217-4f0e-a6f5-dd58a3e08751 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:40.724751 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4b15266f-4217-4f0e-a6f5-dd58a3e08751 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:40.725236 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4b15266f-4217-4f0e-a6f5-dd58a3e08751 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:40.725947 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4b15266f-4217-4f0e-a6f5-dd58a3e08751 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:40.726512 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4b15266f-4217-4f0e-a6f5-dd58a3e08751 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:40.727531 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4b15266f-4217-4f0e-a6f5-dd58a3e08751 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:40.859957 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-4b15266f-4217-4f0e-a6f5-dd58a3e08751 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f67ee6767314bfb9cc04ea9c0dafb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0652fe65874b4606822aa7f261387bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:33:40.868262 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-4b15266f-4217-4f0e-a6f5-dd58a3e08751 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "GET /compute/v2.1/servers/8f69d18a-8407-4ab4-8f5c-5f23979b2ac6" status: 200 len: 1364 microversion: 2.1 time: 0.157583 Oct 04 19:33:40.868852 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3738/7107] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:33:40 2022] GET /compute/v2.1/servers/8f69d18a-8407-4ab4-8f5c-5f23979b2ac6 => generated 1364 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:33:41.892163 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-95c9d9a7-f1c0-46f7-aaac-352fa9b2ec05 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:33:41.892902 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-95c9d9a7-f1c0-46f7-aaac-352fa9b2ec05 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: 8f69d18a-8407-4ab4-8f5c-5f23979b2ac6] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:33:41.900156 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-95c9d9a7-f1c0-46f7-aaac-352fa9b2ec05 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:41.900647 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-95c9d9a7-f1c0-46f7-aaac-352fa9b2ec05 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:41.901091 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-95c9d9a7-f1c0-46f7-aaac-352fa9b2ec05 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:41.901819 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-95c9d9a7-f1c0-46f7-aaac-352fa9b2ec05 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:41.902388 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-95c9d9a7-f1c0-46f7-aaac-352fa9b2ec05 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:41.902969 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-95c9d9a7-f1c0-46f7-aaac-352fa9b2ec05 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:42.033767 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-95c9d9a7-f1c0-46f7-aaac-352fa9b2ec05 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f67ee6767314bfb9cc04ea9c0dafb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0652fe65874b4606822aa7f261387bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:33:42.041951 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-95c9d9a7-f1c0-46f7-aaac-352fa9b2ec05 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "GET /compute/v2.1/servers/8f69d18a-8407-4ab4-8f5c-5f23979b2ac6" status: 200 len: 1364 microversion: 2.1 time: 0.153746 Oct 04 19:33:42.042521 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3370/7108] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:33:41 2022] GET /compute/v2.1/servers/8f69d18a-8407-4ab4-8f5c-5f23979b2ac6 => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:33:43.064535 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-cb51092d-581a-4649-9171-01164aefd6f5 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:33:43.065372 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-cb51092d-581a-4649-9171-01164aefd6f5 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: 8f69d18a-8407-4ab4-8f5c-5f23979b2ac6] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:33:43.072224 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cb51092d-581a-4649-9171-01164aefd6f5 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:43.072723 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cb51092d-581a-4649-9171-01164aefd6f5 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:43.073206 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cb51092d-581a-4649-9171-01164aefd6f5 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:43.074000 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cb51092d-581a-4649-9171-01164aefd6f5 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:43.074428 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cb51092d-581a-4649-9171-01164aefd6f5 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:43.074873 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cb51092d-581a-4649-9171-01164aefd6f5 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:43.536145 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-cb51092d-581a-4649-9171-01164aefd6f5 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f67ee6767314bfb9cc04ea9c0dafb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0652fe65874b4606822aa7f261387bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:33:43.546242 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-cb51092d-581a-4649-9171-01164aefd6f5 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "GET /compute/v2.1/servers/8f69d18a-8407-4ab4-8f5c-5f23979b2ac6" status: 200 len: 1364 microversion: 2.1 time: 0.485769 Oct 04 19:33:43.547005 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3739/7109] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:33:43 2022] GET /compute/v2.1/servers/8f69d18a-8407-4ab4-8f5c-5f23979b2ac6 => generated 1364 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:33:43.635202 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-d3a6e836-1823-4e5e-9109-563333f029ea req-5ad47f56-2eb8-42e9-8688-0d6d0722c427 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f69d18a-8407-4ab4-8f5c-5f23979b2ac6", "name": "network-vif-plugged", "status": "completed", "tag": "0c21810a-3b21-4130-803f-8da097578121"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:33:43.647586 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-d3a6e836-1823-4e5e-9109-563333f029ea req-5ad47f56-2eb8-42e9-8688-0d6d0722c427 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:43.648077 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-d3a6e836-1823-4e5e-9109-563333f029ea req-5ad47f56-2eb8-42e9-8688-0d6d0722c427 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:43.648716 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-d3a6e836-1823-4e5e-9109-563333f029ea req-5ad47f56-2eb8-42e9-8688-0d6d0722c427 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:43.660632 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-d3a6e836-1823-4e5e-9109-563333f029ea req-5ad47f56-2eb8-42e9-8688-0d6d0722c427 service nova] Creating event network-vif-plugged:0c21810a-3b21-4130-803f-8da097578121 for instance 8f69d18a-8407-4ab4-8f5c-5f23979b2ac6 on n-h1-851028-13 Oct 04 19:33:43.666028 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-d3a6e836-1823-4e5e-9109-563333f029ea req-5ad47f56-2eb8-42e9-8688-0d6d0722c427 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035898 Oct 04 19:33:43.667074 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3371/7110] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:33:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:33:44.569519 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-49136af1-a94c-4f1f-b8c9-a01ae7892df2 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:33:44.570697 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-49136af1-a94c-4f1f-b8c9-a01ae7892df2 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: 8f69d18a-8407-4ab4-8f5c-5f23979b2ac6] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:33:44.577693 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-49136af1-a94c-4f1f-b8c9-a01ae7892df2 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:44.578200 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-49136af1-a94c-4f1f-b8c9-a01ae7892df2 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:44.578660 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-49136af1-a94c-4f1f-b8c9-a01ae7892df2 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:44.579377 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-49136af1-a94c-4f1f-b8c9-a01ae7892df2 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:44.579853 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-49136af1-a94c-4f1f-b8c9-a01ae7892df2 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:44.580304 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-49136af1-a94c-4f1f-b8c9-a01ae7892df2 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:44.705779 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-49136af1-a94c-4f1f-b8c9-a01ae7892df2 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f67ee6767314bfb9cc04ea9c0dafb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0652fe65874b4606822aa7f261387bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:33:44.714363 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-49136af1-a94c-4f1f-b8c9-a01ae7892df2 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "GET /compute/v2.1/servers/8f69d18a-8407-4ab4-8f5c-5f23979b2ac6" status: 200 len: 1364 microversion: 2.1 time: 0.148705 Oct 04 19:33:44.714959 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3740/7111] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:33:44 2022] GET /compute/v2.1/servers/8f69d18a-8407-4ab4-8f5c-5f23979b2ac6 => generated 1364 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:33:45.738792 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-3c2c4a8c-717b-4601-b600-df7f09190c03 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:33:45.739503 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-3c2c4a8c-717b-4601-b600-df7f09190c03 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: 8f69d18a-8407-4ab4-8f5c-5f23979b2ac6] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:33:45.746453 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3c2c4a8c-717b-4601-b600-df7f09190c03 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:45.746938 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3c2c4a8c-717b-4601-b600-df7f09190c03 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:45.747382 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3c2c4a8c-717b-4601-b600-df7f09190c03 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:45.748098 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3c2c4a8c-717b-4601-b600-df7f09190c03 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:45.748559 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3c2c4a8c-717b-4601-b600-df7f09190c03 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:45.748996 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3c2c4a8c-717b-4601-b600-df7f09190c03 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:45.885608 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-3c2c4a8c-717b-4601-b600-df7f09190c03 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f67ee6767314bfb9cc04ea9c0dafb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0652fe65874b4606822aa7f261387bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:33:45.893334 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-3c2c4a8c-717b-4601-b600-df7f09190c03 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "GET /compute/v2.1/servers/8f69d18a-8407-4ab4-8f5c-5f23979b2ac6" status: 200 len: 1552 microversion: 2.1 time: 0.159764 Oct 04 19:33:45.893906 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3372/7112] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:33:45 2022] GET /compute/v2.1/servers/8f69d18a-8407-4ab4-8f5c-5f23979b2ac6 => generated 1552 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:33:45.916261 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-a330bc6d-af86-4b7a-9e88-ca094846b888 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:33:45.916786 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-a330bc6d-af86-4b7a-9e88-ca094846b888 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: 8f69d18a-8407-4ab4-8f5c-5f23979b2ac6] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:33:45.919243 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=2 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:33:45.919920 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=6 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:33:45.926070 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a330bc6d-af86-4b7a-9e88-ca094846b888 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:45.926569 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a330bc6d-af86-4b7a-9e88-ca094846b888 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:45.927019 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a330bc6d-af86-4b7a-9e88-ca094846b888 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:45.927725 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a330bc6d-af86-4b7a-9e88-ca094846b888 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:45.928229 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a330bc6d-af86-4b7a-9e88-ca094846b888 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:45.928730 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a330bc6d-af86-4b7a-9e88-ca094846b888 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:46.015735 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-a330bc6d-af86-4b7a-9e88-ca094846b888 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "GET /compute/v2.1/servers/8f69d18a-8407-4ab4-8f5c-5f23979b2ac6/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.103492 Oct 04 19:33:46.016344 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3741/7113] 10.222.0.43 () {58 vars in 1275 bytes} [Tue Oct 4 19:33:45 2022] GET /compute/v2.1/servers/8f69d18a-8407-4ab4-8f5c-5f23979b2ac6/os-interface => generated 285 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:33:46.973445 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-9e7f1e58-56ba-4a94-b296-5193f52bf41c req-f3c68065-4259-4574-8f61-6b9676b83c11 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f69d18a-8407-4ab4-8f5c-5f23979b2ac6", "tag": "0c21810a-3b21-4130-803f-8da097578121"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:33:46.978712 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=6 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:33:46.985628 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-9e7f1e58-56ba-4a94-b296-5193f52bf41c req-f3c68065-4259-4574-8f61-6b9676b83c11 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:46.986199 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-9e7f1e58-56ba-4a94-b296-5193f52bf41c req-f3c68065-4259-4574-8f61-6b9676b83c11 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:46.986719 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-9e7f1e58-56ba-4a94-b296-5193f52bf41c req-f3c68065-4259-4574-8f61-6b9676b83c11 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:46.997758 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-9e7f1e58-56ba-4a94-b296-5193f52bf41c req-f3c68065-4259-4574-8f61-6b9676b83c11 service nova] Creating event network-changed:0c21810a-3b21-4130-803f-8da097578121 for instance 8f69d18a-8407-4ab4-8f5c-5f23979b2ac6 on n-h1-851028-13 Oct 04 19:33:47.002858 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-9e7f1e58-56ba-4a94-b296-5193f52bf41c req-f3c68065-4259-4574-8f61-6b9676b83c11 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033468 Oct 04 19:33:47.003474 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3373/7114] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:33:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:34:23.269067 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=3 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:34:23.269990 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=32 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:34:23.274004 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-bcc110a1-22a7-4a34-b8de-ceeef6a10f17 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:34:23.274627 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-bcc110a1-22a7-4a34-b8de-ceeef6a10f17 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: 8f69d18a-8407-4ab4-8f5c-5f23979b2ac6] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:34:23.281586 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bcc110a1-22a7-4a34-b8de-ceeef6a10f17 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:23.282126 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bcc110a1-22a7-4a34-b8de-ceeef6a10f17 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:23.282613 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bcc110a1-22a7-4a34-b8de-ceeef6a10f17 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:23.283316 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bcc110a1-22a7-4a34-b8de-ceeef6a10f17 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:23.283828 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bcc110a1-22a7-4a34-b8de-ceeef6a10f17 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:23.284266 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bcc110a1-22a7-4a34-b8de-ceeef6a10f17 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:23.418874 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-bcc110a1-22a7-4a34-b8de-ceeef6a10f17 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f67ee6767314bfb9cc04ea9c0dafb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0652fe65874b4606822aa7f261387bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:34:23.426588 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-bcc110a1-22a7-4a34-b8de-ceeef6a10f17 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "GET /compute/v2.1/servers/8f69d18a-8407-4ab4-8f5c-5f23979b2ac6" status: 200 len: 1670 microversion: 2.1 time: 0.159441 Oct 04 19:34:23.427160 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3742/7115] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:34:23 2022] GET /compute/v2.1/servers/8f69d18a-8407-4ab4-8f5c-5f23979b2ac6 => generated 1670 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:34:23.447641 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_api:SELECT=15 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:34:23.448788 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=28 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:34:23.453342 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-57f4b767-6053-4e2f-bfd2-ada39121ef29 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:34:23.454053 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-57f4b767-6053-4e2f-bfd2-ada39121ef29 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: 8f69d18a-8407-4ab4-8f5c-5f23979b2ac6] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:34:23.460874 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-57f4b767-6053-4e2f-bfd2-ada39121ef29 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:23.461388 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-57f4b767-6053-4e2f-bfd2-ada39121ef29 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:23.461925 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-57f4b767-6053-4e2f-bfd2-ada39121ef29 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:23.462567 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-57f4b767-6053-4e2f-bfd2-ada39121ef29 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:23.463018 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-57f4b767-6053-4e2f-bfd2-ada39121ef29 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:23.463445 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-57f4b767-6053-4e2f-bfd2-ada39121ef29 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:23.598437 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-57f4b767-6053-4e2f-bfd2-ada39121ef29 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f67ee6767314bfb9cc04ea9c0dafb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0652fe65874b4606822aa7f261387bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:34:23.606705 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-57f4b767-6053-4e2f-bfd2-ada39121ef29 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "GET /compute/v2.1/servers/8f69d18a-8407-4ab4-8f5c-5f23979b2ac6" status: 200 len: 1670 microversion: 2.1 time: 0.161537 Oct 04 19:34:23.607301 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3374/7116] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:34:23 2022] GET /compute/v2.1/servers/8f69d18a-8407-4ab4-8f5c-5f23979b2ac6 => generated 1670 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:34:23.628979 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-1edfd6ab-bfae-4bde-9771-7b75aa0208e7 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:34:23.629607 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-1edfd6ab-bfae-4bde-9771-7b75aa0208e7 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: 8f69d18a-8407-4ab4-8f5c-5f23979b2ac6] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:34:23.635816 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1edfd6ab-bfae-4bde-9771-7b75aa0208e7 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:23.636340 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1edfd6ab-bfae-4bde-9771-7b75aa0208e7 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:23.636800 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1edfd6ab-bfae-4bde-9771-7b75aa0208e7 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:23.637535 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1edfd6ab-bfae-4bde-9771-7b75aa0208e7 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:23.638009 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1edfd6ab-bfae-4bde-9771-7b75aa0208e7 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:23.638451 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1edfd6ab-bfae-4bde-9771-7b75aa0208e7 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:23.768067 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-1edfd6ab-bfae-4bde-9771-7b75aa0208e7 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f67ee6767314bfb9cc04ea9c0dafb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0652fe65874b4606822aa7f261387bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:34:23.776068 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-1edfd6ab-bfae-4bde-9771-7b75aa0208e7 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "GET /compute/v2.1/servers/8f69d18a-8407-4ab4-8f5c-5f23979b2ac6" status: 200 len: 1670 microversion: 2.1 time: 0.151087 Oct 04 19:34:23.777142 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3743/7117] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:34:23 2022] GET /compute/v2.1/servers/8f69d18a-8407-4ab4-8f5c-5f23979b2ac6 => generated 1670 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:34:23.799029 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-9ca47dea-5d90-4594-8708-f2727abc9ec8 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:34:23.801260 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-9ca47dea-5d90-4594-8708-f2727abc9ec8 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: 8f69d18a-8407-4ab4-8f5c-5f23979b2ac6] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:34:23.807390 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9ca47dea-5d90-4594-8708-f2727abc9ec8 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:23.807901 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9ca47dea-5d90-4594-8708-f2727abc9ec8 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:23.808360 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9ca47dea-5d90-4594-8708-f2727abc9ec8 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:23.809029 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9ca47dea-5d90-4594-8708-f2727abc9ec8 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:23.809505 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9ca47dea-5d90-4594-8708-f2727abc9ec8 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:23.809930 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9ca47dea-5d90-4594-8708-f2727abc9ec8 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:23.837401 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-9ca47dea-5d90-4594-8708-f2727abc9ec8 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '0f67ee6767314bfb9cc04ea9c0dafb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0652fe65874b4606822aa7f261387bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:34:23.843278 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-9ca47dea-5d90-4594-8708-f2727abc9ec8 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: 8f69d18a-8407-4ab4-8f5c-5f23979b2ac6] Old instance type m1.heat2, new instance type m1.heat {{(pid=123595) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 04 19:34:23.849942 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-9ca47dea-5d90-4594-8708-f2727abc9ec8 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Flavor limits 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:34:23.850364 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-9ca47dea-5d90-4594-8708-f2727abc9ec8 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Image limits 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:34:23.850834 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-9ca47dea-5d90-4594-8708-f2727abc9ec8 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Flavor pref 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:34:23.851299 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-9ca47dea-5d90-4594-8708-f2727abc9ec8 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Image pref 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:34:23.851702 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-9ca47dea-5d90-4594-8708-f2727abc9ec8 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:34:23.914590 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-9ca47dea-5d90-4594-8708-f2727abc9ec8 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "POST /compute/v2.1/servers/8f69d18a-8407-4ab4-8f5c-5f23979b2ac6/action" status: 202 len: 0 microversion: 2.1 time: 0.119264 Oct 04 19:34:23.915282 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3375/7118] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 19:34:23 2022] POST /compute/v2.1/servers/8f69d18a-8407-4ab4-8f5c-5f23979b2ac6/action => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:34:23.923911 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-0e0e6fb7-a2a9-42fa-8fa4-06a1c1c231f5 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:34:23.924529 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-0e0e6fb7-a2a9-42fa-8fa4-06a1c1c231f5 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: 8f69d18a-8407-4ab4-8f5c-5f23979b2ac6] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:34:23.930464 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0e0e6fb7-a2a9-42fa-8fa4-06a1c1c231f5 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:23.930959 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0e0e6fb7-a2a9-42fa-8fa4-06a1c1c231f5 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:23.931440 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0e0e6fb7-a2a9-42fa-8fa4-06a1c1c231f5 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:23.932144 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0e0e6fb7-a2a9-42fa-8fa4-06a1c1c231f5 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:23.932604 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0e0e6fb7-a2a9-42fa-8fa4-06a1c1c231f5 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:23.933071 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0e0e6fb7-a2a9-42fa-8fa4-06a1c1c231f5 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:24.096559 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-0e0e6fb7-a2a9-42fa-8fa4-06a1c1c231f5 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f67ee6767314bfb9cc04ea9c0dafb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0652fe65874b4606822aa7f261387bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:34:24.104526 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-0e0e6fb7-a2a9-42fa-8fa4-06a1c1c231f5 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "GET /compute/v2.1/servers/8f69d18a-8407-4ab4-8f5c-5f23979b2ac6" status: 200 len: 1679 microversion: 2.1 time: 0.184373 Oct 04 19:34:24.105772 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3744/7119] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:34:23 2022] GET /compute/v2.1/servers/8f69d18a-8407-4ab4-8f5c-5f23979b2ac6 => generated 1679 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:34:25.128214 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-fe8946e0-ba41-46d4-8848-14d34f2697c6 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:34:25.129368 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-fe8946e0-ba41-46d4-8848-14d34f2697c6 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: 8f69d18a-8407-4ab4-8f5c-5f23979b2ac6] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:34:25.137469 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fe8946e0-ba41-46d4-8848-14d34f2697c6 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:25.137958 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fe8946e0-ba41-46d4-8848-14d34f2697c6 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:25.138400 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fe8946e0-ba41-46d4-8848-14d34f2697c6 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:25.139095 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fe8946e0-ba41-46d4-8848-14d34f2697c6 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:25.139550 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fe8946e0-ba41-46d4-8848-14d34f2697c6 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:25.139976 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fe8946e0-ba41-46d4-8848-14d34f2697c6 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:25.356334 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-fe8946e0-ba41-46d4-8848-14d34f2697c6 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f67ee6767314bfb9cc04ea9c0dafb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0652fe65874b4606822aa7f261387bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:34:25.364007 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-fe8946e0-ba41-46d4-8848-14d34f2697c6 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "GET /compute/v2.1/servers/8f69d18a-8407-4ab4-8f5c-5f23979b2ac6" status: 200 len: 1679 microversion: 2.1 time: 0.239664 Oct 04 19:34:25.364583 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3376/7120] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:34:25 2022] GET /compute/v2.1/servers/8f69d18a-8407-4ab4-8f5c-5f23979b2ac6 => generated 1679 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:34:26.388209 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-bd138670-aecf-44e8-af7a-9dbaedae337a tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:34:26.388935 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-bd138670-aecf-44e8-af7a-9dbaedae337a tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: 8f69d18a-8407-4ab4-8f5c-5f23979b2ac6] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:34:26.395817 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bd138670-aecf-44e8-af7a-9dbaedae337a tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:26.396317 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bd138670-aecf-44e8-af7a-9dbaedae337a tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:26.396783 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bd138670-aecf-44e8-af7a-9dbaedae337a tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:26.397584 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bd138670-aecf-44e8-af7a-9dbaedae337a tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:26.398055 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bd138670-aecf-44e8-af7a-9dbaedae337a tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:26.398498 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bd138670-aecf-44e8-af7a-9dbaedae337a tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:26.531956 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-bd138670-aecf-44e8-af7a-9dbaedae337a tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f67ee6767314bfb9cc04ea9c0dafb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0652fe65874b4606822aa7f261387bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:34:26.539823 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-bd138670-aecf-44e8-af7a-9dbaedae337a tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "GET /compute/v2.1/servers/8f69d18a-8407-4ab4-8f5c-5f23979b2ac6" status: 200 len: 1684 microversion: 2.1 time: 0.156199 Oct 04 19:34:26.540398 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3745/7121] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:34:26 2022] GET /compute/v2.1/servers/8f69d18a-8407-4ab4-8f5c-5f23979b2ac6 => generated 1684 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:34:27.564111 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-077f48e7-fe4e-47db-81bf-571380c063a3 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:34:27.564728 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-077f48e7-fe4e-47db-81bf-571380c063a3 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: 8f69d18a-8407-4ab4-8f5c-5f23979b2ac6] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:34:27.571656 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-077f48e7-fe4e-47db-81bf-571380c063a3 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:27.572144 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-077f48e7-fe4e-47db-81bf-571380c063a3 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:27.572584 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-077f48e7-fe4e-47db-81bf-571380c063a3 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:27.573408 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-077f48e7-fe4e-47db-81bf-571380c063a3 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:27.574647 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-077f48e7-fe4e-47db-81bf-571380c063a3 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:27.575102 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-077f48e7-fe4e-47db-81bf-571380c063a3 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:27.704700 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-077f48e7-fe4e-47db-81bf-571380c063a3 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f67ee6767314bfb9cc04ea9c0dafb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0652fe65874b4606822aa7f261387bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:34:27.712353 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-077f48e7-fe4e-47db-81bf-571380c063a3 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "GET /compute/v2.1/servers/8f69d18a-8407-4ab4-8f5c-5f23979b2ac6" status: 200 len: 1684 microversion: 2.1 time: 0.152150 Oct 04 19:34:27.712928 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3377/7122] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:34:27 2022] GET /compute/v2.1/servers/8f69d18a-8407-4ab4-8f5c-5f23979b2ac6 => generated 1684 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:34:28.736624 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-78a45245-74b6-4673-bef2-8b8281857cd5 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:34:28.737280 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-78a45245-74b6-4673-bef2-8b8281857cd5 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: 8f69d18a-8407-4ab4-8f5c-5f23979b2ac6] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:34:28.744168 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-78a45245-74b6-4673-bef2-8b8281857cd5 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:28.744988 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-78a45245-74b6-4673-bef2-8b8281857cd5 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:28.745104 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-78a45245-74b6-4673-bef2-8b8281857cd5 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:28.746588 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-78a45245-74b6-4673-bef2-8b8281857cd5 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:28.746895 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-78a45245-74b6-4673-bef2-8b8281857cd5 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:28.747339 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-78a45245-74b6-4673-bef2-8b8281857cd5 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:28.875969 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-78a45245-74b6-4673-bef2-8b8281857cd5 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f67ee6767314bfb9cc04ea9c0dafb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0652fe65874b4606822aa7f261387bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:34:28.883880 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-78a45245-74b6-4673-bef2-8b8281857cd5 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "GET /compute/v2.1/servers/8f69d18a-8407-4ab4-8f5c-5f23979b2ac6" status: 200 len: 1684 microversion: 2.1 time: 0.151231 Oct 04 19:34:28.884461 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3746/7123] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:34:28 2022] GET /compute/v2.1/servers/8f69d18a-8407-4ab4-8f5c-5f23979b2ac6 => generated 1684 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:34:29.907664 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-dce633f0-097c-47c8-8fbf-71491cf8f0af tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:34:29.908284 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-dce633f0-097c-47c8-8fbf-71491cf8f0af tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: 8f69d18a-8407-4ab4-8f5c-5f23979b2ac6] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:34:29.914843 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dce633f0-097c-47c8-8fbf-71491cf8f0af tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:29.915412 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dce633f0-097c-47c8-8fbf-71491cf8f0af tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:29.915884 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dce633f0-097c-47c8-8fbf-71491cf8f0af tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:29.916585 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dce633f0-097c-47c8-8fbf-71491cf8f0af tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:29.917690 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dce633f0-097c-47c8-8fbf-71491cf8f0af tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:29.918131 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dce633f0-097c-47c8-8fbf-71491cf8f0af tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:30.053971 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-dce633f0-097c-47c8-8fbf-71491cf8f0af tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f67ee6767314bfb9cc04ea9c0dafb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0652fe65874b4606822aa7f261387bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:34:30.061973 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-dce633f0-097c-47c8-8fbf-71491cf8f0af tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "GET /compute/v2.1/servers/8f69d18a-8407-4ab4-8f5c-5f23979b2ac6" status: 200 len: 1684 microversion: 2.1 time: 0.158421 Oct 04 19:34:30.062554 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3378/7124] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:34:29 2022] GET /compute/v2.1/servers/8f69d18a-8407-4ab4-8f5c-5f23979b2ac6 => generated 1684 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:34:31.084944 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-94bf983c-e2db-48d8-ad60-18b5460d7e47 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:34:31.085607 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-94bf983c-e2db-48d8-ad60-18b5460d7e47 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: 8f69d18a-8407-4ab4-8f5c-5f23979b2ac6] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:34:31.093306 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-94bf983c-e2db-48d8-ad60-18b5460d7e47 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:31.093815 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-94bf983c-e2db-48d8-ad60-18b5460d7e47 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:31.094275 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-94bf983c-e2db-48d8-ad60-18b5460d7e47 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:31.095279 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-94bf983c-e2db-48d8-ad60-18b5460d7e47 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:31.095752 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-94bf983c-e2db-48d8-ad60-18b5460d7e47 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:31.096202 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-94bf983c-e2db-48d8-ad60-18b5460d7e47 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:31.223461 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-94bf983c-e2db-48d8-ad60-18b5460d7e47 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f67ee6767314bfb9cc04ea9c0dafb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0652fe65874b4606822aa7f261387bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:34:31.231921 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-94bf983c-e2db-48d8-ad60-18b5460d7e47 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "GET /compute/v2.1/servers/8f69d18a-8407-4ab4-8f5c-5f23979b2ac6" status: 200 len: 1684 microversion: 2.1 time: 0.150925 Oct 04 19:34:31.232512 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3747/7125] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:34:31 2022] GET /compute/v2.1/servers/8f69d18a-8407-4ab4-8f5c-5f23979b2ac6 => generated 1684 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:34:32.255941 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-c4cdb7fd-766e-42f7-9119-3518697ab9e5 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:34:32.256556 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-c4cdb7fd-766e-42f7-9119-3518697ab9e5 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: 8f69d18a-8407-4ab4-8f5c-5f23979b2ac6] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:34:32.264015 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c4cdb7fd-766e-42f7-9119-3518697ab9e5 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:32.264501 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c4cdb7fd-766e-42f7-9119-3518697ab9e5 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:32.264944 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c4cdb7fd-766e-42f7-9119-3518697ab9e5 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:32.265674 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c4cdb7fd-766e-42f7-9119-3518697ab9e5 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:32.266128 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c4cdb7fd-766e-42f7-9119-3518697ab9e5 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:32.266559 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c4cdb7fd-766e-42f7-9119-3518697ab9e5 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:32.398746 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-c4cdb7fd-766e-42f7-9119-3518697ab9e5 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f67ee6767314bfb9cc04ea9c0dafb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0652fe65874b4606822aa7f261387bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:34:32.406602 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-c4cdb7fd-766e-42f7-9119-3518697ab9e5 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "GET /compute/v2.1/servers/8f69d18a-8407-4ab4-8f5c-5f23979b2ac6" status: 200 len: 1684 microversion: 2.1 time: 0.154550 Oct 04 19:34:32.407239 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3379/7126] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:34:32 2022] GET /compute/v2.1/servers/8f69d18a-8407-4ab4-8f5c-5f23979b2ac6 => generated 1684 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:34:33.430414 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-480d2d24-731b-4995-8b21-eccc4b07e2ee tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:34:33.431043 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-480d2d24-731b-4995-8b21-eccc4b07e2ee tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: 8f69d18a-8407-4ab4-8f5c-5f23979b2ac6] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:34:33.438027 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-480d2d24-731b-4995-8b21-eccc4b07e2ee tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:33.438522 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-480d2d24-731b-4995-8b21-eccc4b07e2ee tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:33.438973 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-480d2d24-731b-4995-8b21-eccc4b07e2ee tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:33.439670 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-480d2d24-731b-4995-8b21-eccc4b07e2ee tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:33.440133 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-480d2d24-731b-4995-8b21-eccc4b07e2ee tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:33.440568 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-480d2d24-731b-4995-8b21-eccc4b07e2ee tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:33.576790 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-480d2d24-731b-4995-8b21-eccc4b07e2ee tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f67ee6767314bfb9cc04ea9c0dafb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0652fe65874b4606822aa7f261387bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:34:33.584514 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-480d2d24-731b-4995-8b21-eccc4b07e2ee tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "GET /compute/v2.1/servers/8f69d18a-8407-4ab4-8f5c-5f23979b2ac6" status: 200 len: 1684 microversion: 2.1 time: 0.157933 Oct 04 19:34:33.585086 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3748/7127] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:34:33 2022] GET /compute/v2.1/servers/8f69d18a-8407-4ab4-8f5c-5f23979b2ac6 => generated 1684 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:34:34.608312 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-3385b5d9-1035-4682-ab34-08d16d6a9727 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:34:34.608955 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-3385b5d9-1035-4682-ab34-08d16d6a9727 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: 8f69d18a-8407-4ab4-8f5c-5f23979b2ac6] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:34:34.615897 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3385b5d9-1035-4682-ab34-08d16d6a9727 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:34.616379 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3385b5d9-1035-4682-ab34-08d16d6a9727 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:34.616818 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3385b5d9-1035-4682-ab34-08d16d6a9727 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:34.617532 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3385b5d9-1035-4682-ab34-08d16d6a9727 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:34.618069 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3385b5d9-1035-4682-ab34-08d16d6a9727 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:34.618422 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3385b5d9-1035-4682-ab34-08d16d6a9727 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:34.754992 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-3385b5d9-1035-4682-ab34-08d16d6a9727 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f67ee6767314bfb9cc04ea9c0dafb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0652fe65874b4606822aa7f261387bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:34:34.763305 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-3385b5d9-1035-4682-ab34-08d16d6a9727 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "GET /compute/v2.1/servers/8f69d18a-8407-4ab4-8f5c-5f23979b2ac6" status: 200 len: 1684 microversion: 2.1 time: 0.159402 Oct 04 19:34:34.763870 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3380/7128] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:34:34 2022] GET /compute/v2.1/servers/8f69d18a-8407-4ab4-8f5c-5f23979b2ac6 => generated 1684 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:34:35.787433 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-c1d44e4d-e09c-437d-938b-19239bc3ef0b tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:34:35.788090 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-c1d44e4d-e09c-437d-938b-19239bc3ef0b tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: 8f69d18a-8407-4ab4-8f5c-5f23979b2ac6] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:34:35.796357 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c1d44e4d-e09c-437d-938b-19239bc3ef0b tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:35.797176 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c1d44e4d-e09c-437d-938b-19239bc3ef0b tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:35.797640 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c1d44e4d-e09c-437d-938b-19239bc3ef0b tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:35.798356 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c1d44e4d-e09c-437d-938b-19239bc3ef0b tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:35.798830 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c1d44e4d-e09c-437d-938b-19239bc3ef0b tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:35.799279 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c1d44e4d-e09c-437d-938b-19239bc3ef0b tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:35.926995 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-c1d44e4d-e09c-437d-938b-19239bc3ef0b tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f67ee6767314bfb9cc04ea9c0dafb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0652fe65874b4606822aa7f261387bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:34:35.934912 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-c1d44e4d-e09c-437d-938b-19239bc3ef0b tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "GET /compute/v2.1/servers/8f69d18a-8407-4ab4-8f5c-5f23979b2ac6" status: 200 len: 1684 microversion: 2.1 time: 0.151399 Oct 04 19:34:35.935568 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3749/7129] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:34:35 2022] GET /compute/v2.1/servers/8f69d18a-8407-4ab4-8f5c-5f23979b2ac6 => generated 1684 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:34:36.957775 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-f668988a-1f05-4931-8914-dea8f3a40b46 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:34:36.958390 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-f668988a-1f05-4931-8914-dea8f3a40b46 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: 8f69d18a-8407-4ab4-8f5c-5f23979b2ac6] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:34:36.966004 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f668988a-1f05-4931-8914-dea8f3a40b46 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:36.966491 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f668988a-1f05-4931-8914-dea8f3a40b46 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:36.966936 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f668988a-1f05-4931-8914-dea8f3a40b46 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:36.967626 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f668988a-1f05-4931-8914-dea8f3a40b46 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:36.968080 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f668988a-1f05-4931-8914-dea8f3a40b46 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:36.968502 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f668988a-1f05-4931-8914-dea8f3a40b46 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:37.097986 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-f668988a-1f05-4931-8914-dea8f3a40b46 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f67ee6767314bfb9cc04ea9c0dafb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0652fe65874b4606822aa7f261387bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:34:37.105574 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-f668988a-1f05-4931-8914-dea8f3a40b46 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "GET /compute/v2.1/servers/8f69d18a-8407-4ab4-8f5c-5f23979b2ac6" status: 200 len: 1684 microversion: 2.1 time: 0.151613 Oct 04 19:34:37.106136 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3381/7130] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:34:36 2022] GET /compute/v2.1/servers/8f69d18a-8407-4ab4-8f5c-5f23979b2ac6 => generated 1684 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:34:38.096625 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-f703bd49-b1bb-4c06-9b2f-aa6fb61aef04 req-bd6262ac-998b-4e00-a964-bbc48a4471e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f69d18a-8407-4ab4-8f5c-5f23979b2ac6", "name": "network-vif-unplugged", "status": "completed", "tag": "0c21810a-3b21-4130-803f-8da097578121"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:34:38.107552 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-f703bd49-b1bb-4c06-9b2f-aa6fb61aef04 req-bd6262ac-998b-4e00-a964-bbc48a4471e7 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:38.107940 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-f703bd49-b1bb-4c06-9b2f-aa6fb61aef04 req-bd6262ac-998b-4e00-a964-bbc48a4471e7 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:38.108480 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-f703bd49-b1bb-4c06-9b2f-aa6fb61aef04 req-bd6262ac-998b-4e00-a964-bbc48a4471e7 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:38.121789 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-f703bd49-b1bb-4c06-9b2f-aa6fb61aef04 req-bd6262ac-998b-4e00-a964-bbc48a4471e7 service nova] Creating event network-vif-unplugged:0c21810a-3b21-4130-803f-8da097578121 for instance 8f69d18a-8407-4ab4-8f5c-5f23979b2ac6 on n-h2-851028-13 Oct 04 19:34:38.127536 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [req-f703bd49-b1bb-4c06-9b2f-aa6fb61aef04 req-bd6262ac-998b-4e00-a964-bbc48a4471e7 service nova] Instance 8f69d18a-8407-4ab4-8f5c-5f23979b2ac6 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851028-13', 'n-h2-851028-13'} {{(pid=123596) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 19:34:38.131425 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-cdc04dc9-11a6-4b64-9fc8-8ca5b21101e6 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:34:38.132098 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-cdc04dc9-11a6-4b64-9fc8-8ca5b21101e6 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: 8f69d18a-8407-4ab4-8f5c-5f23979b2ac6] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:34:38.140089 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-f703bd49-b1bb-4c06-9b2f-aa6fb61aef04 req-bd6262ac-998b-4e00-a964-bbc48a4471e7 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047357 Oct 04 19:34:38.141022 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3750/7131] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:34:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:34:38.142633 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cdc04dc9-11a6-4b64-9fc8-8ca5b21101e6 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:38.143141 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cdc04dc9-11a6-4b64-9fc8-8ca5b21101e6 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:38.143591 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cdc04dc9-11a6-4b64-9fc8-8ca5b21101e6 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:38.144349 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cdc04dc9-11a6-4b64-9fc8-8ca5b21101e6 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:38.144750 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cdc04dc9-11a6-4b64-9fc8-8ca5b21101e6 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:38.145269 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cdc04dc9-11a6-4b64-9fc8-8ca5b21101e6 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:38.283104 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-cdc04dc9-11a6-4b64-9fc8-8ca5b21101e6 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f67ee6767314bfb9cc04ea9c0dafb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0652fe65874b4606822aa7f261387bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:34:38.291182 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-cdc04dc9-11a6-4b64-9fc8-8ca5b21101e6 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "GET /compute/v2.1/servers/8f69d18a-8407-4ab4-8f5c-5f23979b2ac6" status: 200 len: 1683 microversion: 2.1 time: 0.167260 Oct 04 19:34:38.291817 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3382/7132] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:34:38 2022] GET /compute/v2.1/servers/8f69d18a-8407-4ab4-8f5c-5f23979b2ac6 => generated 1683 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:34:39.316947 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-93c7b826-9cf9-4c6e-88fa-d81974e7bfa7 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:34:39.317707 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-93c7b826-9cf9-4c6e-88fa-d81974e7bfa7 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: 8f69d18a-8407-4ab4-8f5c-5f23979b2ac6] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:34:39.324015 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-93c7b826-9cf9-4c6e-88fa-d81974e7bfa7 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:39.324527 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-93c7b826-9cf9-4c6e-88fa-d81974e7bfa7 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:39.324987 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-93c7b826-9cf9-4c6e-88fa-d81974e7bfa7 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:39.325726 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-93c7b826-9cf9-4c6e-88fa-d81974e7bfa7 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:39.326207 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-93c7b826-9cf9-4c6e-88fa-d81974e7bfa7 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:39.326659 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-93c7b826-9cf9-4c6e-88fa-d81974e7bfa7 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:39.456791 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-93c7b826-9cf9-4c6e-88fa-d81974e7bfa7 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f67ee6767314bfb9cc04ea9c0dafb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0652fe65874b4606822aa7f261387bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:34:39.464715 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-93c7b826-9cf9-4c6e-88fa-d81974e7bfa7 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "GET /compute/v2.1/servers/8f69d18a-8407-4ab4-8f5c-5f23979b2ac6" status: 200 len: 1681 microversion: 2.1 time: 0.152828 Oct 04 19:34:39.465324 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3751/7133] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:34:39 2022] GET /compute/v2.1/servers/8f69d18a-8407-4ab4-8f5c-5f23979b2ac6 => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:34:40.158299 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-ffcf2c52-b9f8-4cb0-8a1a-34886e1ed40a req-f084dce2-e7c1-4ea0-a8c9-170be0107fe8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f69d18a-8407-4ab4-8f5c-5f23979b2ac6", "tag": "0c21810a-3b21-4130-803f-8da097578121"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:34:40.168365 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-ffcf2c52-b9f8-4cb0-8a1a-34886e1ed40a req-f084dce2-e7c1-4ea0-a8c9-170be0107fe8 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:40.168837 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-ffcf2c52-b9f8-4cb0-8a1a-34886e1ed40a req-f084dce2-e7c1-4ea0-a8c9-170be0107fe8 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:40.169297 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-ffcf2c52-b9f8-4cb0-8a1a-34886e1ed40a req-f084dce2-e7c1-4ea0-a8c9-170be0107fe8 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:40.180330 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-ffcf2c52-b9f8-4cb0-8a1a-34886e1ed40a req-f084dce2-e7c1-4ea0-a8c9-170be0107fe8 service nova] Creating event network-changed:0c21810a-3b21-4130-803f-8da097578121 for instance 8f69d18a-8407-4ab4-8f5c-5f23979b2ac6 on n-h2-851028-13 Oct 04 19:34:40.185556 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [req-ffcf2c52-b9f8-4cb0-8a1a-34886e1ed40a req-f084dce2-e7c1-4ea0-a8c9-170be0107fe8 service nova] Instance 8f69d18a-8407-4ab4-8f5c-5f23979b2ac6 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851028-13', 'n-h2-851028-13'} {{(pid=123595) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 19:34:40.196233 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-ffcf2c52-b9f8-4cb0-8a1a-34886e1ed40a req-f084dce2-e7c1-4ea0-a8c9-170be0107fe8 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041597 Oct 04 19:34:40.196791 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3383/7134] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:34:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:34:40.488121 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-b92373be-972d-4803-b255-7ddd085779a3 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:34:40.488758 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-b92373be-972d-4803-b255-7ddd085779a3 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: 8f69d18a-8407-4ab4-8f5c-5f23979b2ac6] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:34:40.495708 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b92373be-972d-4803-b255-7ddd085779a3 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:40.496216 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b92373be-972d-4803-b255-7ddd085779a3 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:40.496672 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b92373be-972d-4803-b255-7ddd085779a3 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:40.497444 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b92373be-972d-4803-b255-7ddd085779a3 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:40.497917 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b92373be-972d-4803-b255-7ddd085779a3 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:40.498410 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b92373be-972d-4803-b255-7ddd085779a3 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:40.678662 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-b92373be-972d-4803-b255-7ddd085779a3 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f67ee6767314bfb9cc04ea9c0dafb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0652fe65874b4606822aa7f261387bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:34:40.688929 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-b92373be-972d-4803-b255-7ddd085779a3 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "GET /compute/v2.1/servers/8f69d18a-8407-4ab4-8f5c-5f23979b2ac6" status: 200 len: 1681 microversion: 2.1 time: 0.204809 Oct 04 19:34:40.689962 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3752/7135] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:34:40 2022] GET /compute/v2.1/servers/8f69d18a-8407-4ab4-8f5c-5f23979b2ac6 => generated 1681 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:34:41.714972 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-9ccf86e8-bc9b-4af2-920a-2625a96aeb39 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:34:41.715677 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-9ccf86e8-bc9b-4af2-920a-2625a96aeb39 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: 8f69d18a-8407-4ab4-8f5c-5f23979b2ac6] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:34:41.723014 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9ccf86e8-bc9b-4af2-920a-2625a96aeb39 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:41.723014 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9ccf86e8-bc9b-4af2-920a-2625a96aeb39 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:41.723240 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9ccf86e8-bc9b-4af2-920a-2625a96aeb39 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:41.723790 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9ccf86e8-bc9b-4af2-920a-2625a96aeb39 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:41.724281 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9ccf86e8-bc9b-4af2-920a-2625a96aeb39 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:41.724714 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9ccf86e8-bc9b-4af2-920a-2625a96aeb39 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:41.857949 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-9ccf86e8-bc9b-4af2-920a-2625a96aeb39 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f67ee6767314bfb9cc04ea9c0dafb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0652fe65874b4606822aa7f261387bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:34:41.865708 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-9ccf86e8-bc9b-4af2-920a-2625a96aeb39 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "GET /compute/v2.1/servers/8f69d18a-8407-4ab4-8f5c-5f23979b2ac6" status: 200 len: 1678 microversion: 2.1 time: 0.156545 Oct 04 19:34:41.866287 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3384/7136] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:34:41 2022] GET /compute/v2.1/servers/8f69d18a-8407-4ab4-8f5c-5f23979b2ac6 => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:34:41.889370 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-91146887-dfec-45b2-8628-4b3bc59e48e3 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:34:41.889942 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-91146887-dfec-45b2-8628-4b3bc59e48e3 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: 8f69d18a-8407-4ab4-8f5c-5f23979b2ac6] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:34:41.896807 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-91146887-dfec-45b2-8628-4b3bc59e48e3 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:41.897348 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-91146887-dfec-45b2-8628-4b3bc59e48e3 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:41.897806 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-91146887-dfec-45b2-8628-4b3bc59e48e3 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:41.898525 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-91146887-dfec-45b2-8628-4b3bc59e48e3 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:41.898993 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-91146887-dfec-45b2-8628-4b3bc59e48e3 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:41.899446 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-91146887-dfec-45b2-8628-4b3bc59e48e3 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:41.964826 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-91146887-dfec-45b2-8628-4b3bc59e48e3 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "POST /compute/v2.1/servers/8f69d18a-8407-4ab4-8f5c-5f23979b2ac6/action" status: 204 len: 0 microversion: 2.1 time: 0.079542 Oct 04 19:34:41.966097 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3753/7137] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 19:34:41 2022] POST /compute/v2.1/servers/8f69d18a-8407-4ab4-8f5c-5f23979b2ac6/action => generated 0 bytes in 82 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:34:41.974620 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-823c5364-c791-46ea-ab8d-1f61d93ef00e tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:34:41.975611 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-823c5364-c791-46ea-ab8d-1f61d93ef00e tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: 8f69d18a-8407-4ab4-8f5c-5f23979b2ac6] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:34:41.983638 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-823c5364-c791-46ea-ab8d-1f61d93ef00e tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:41.984288 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-823c5364-c791-46ea-ab8d-1f61d93ef00e tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:41.984854 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-823c5364-c791-46ea-ab8d-1f61d93ef00e tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:41.985687 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-823c5364-c791-46ea-ab8d-1f61d93ef00e tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:41.986256 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-823c5364-c791-46ea-ab8d-1f61d93ef00e tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:41.986696 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-823c5364-c791-46ea-ab8d-1f61d93ef00e tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:42.455311 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-823c5364-c791-46ea-ab8d-1f61d93ef00e tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f67ee6767314bfb9cc04ea9c0dafb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0652fe65874b4606822aa7f261387bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:34:42.464354 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-823c5364-c791-46ea-ab8d-1f61d93ef00e tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "GET /compute/v2.1/servers/8f69d18a-8407-4ab4-8f5c-5f23979b2ac6" status: 200 len: 1678 microversion: 2.1 time: 0.493294 Oct 04 19:34:42.464934 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3385/7138] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:34:41 2022] GET /compute/v2.1/servers/8f69d18a-8407-4ab4-8f5c-5f23979b2ac6 => generated 1678 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:34:43.488551 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-447f0585-da5f-487b-9337-8c22816afd29 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:34:43.489396 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-447f0585-da5f-487b-9337-8c22816afd29 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: 8f69d18a-8407-4ab4-8f5c-5f23979b2ac6] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:34:43.496584 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-447f0585-da5f-487b-9337-8c22816afd29 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:43.497244 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-447f0585-da5f-487b-9337-8c22816afd29 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:43.497727 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-447f0585-da5f-487b-9337-8c22816afd29 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:43.498505 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-447f0585-da5f-487b-9337-8c22816afd29 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:43.498976 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-447f0585-da5f-487b-9337-8c22816afd29 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:43.499416 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-447f0585-da5f-487b-9337-8c22816afd29 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:43.649320 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-447f0585-da5f-487b-9337-8c22816afd29 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f67ee6767314bfb9cc04ea9c0dafb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0652fe65874b4606822aa7f261387bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:34:43.657429 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-447f0585-da5f-487b-9337-8c22816afd29 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "GET /compute/v2.1/servers/8f69d18a-8407-4ab4-8f5c-5f23979b2ac6" status: 200 len: 1670 microversion: 2.1 time: 0.173241 Oct 04 19:34:43.658008 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3754/7139] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:34:43 2022] GET /compute/v2.1/servers/8f69d18a-8407-4ab4-8f5c-5f23979b2ac6 => generated 1670 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:34:43.681404 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-7d3d325b-7354-4886-ba22-bc573ddf2b3e tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:34:43.682637 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-7d3d325b-7354-4886-ba22-bc573ddf2b3e tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: 8f69d18a-8407-4ab4-8f5c-5f23979b2ac6] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:34:43.689576 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7d3d325b-7354-4886-ba22-bc573ddf2b3e tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:43.690057 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7d3d325b-7354-4886-ba22-bc573ddf2b3e tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:43.690493 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7d3d325b-7354-4886-ba22-bc573ddf2b3e tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:43.691181 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7d3d325b-7354-4886-ba22-bc573ddf2b3e tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:43.691629 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7d3d325b-7354-4886-ba22-bc573ddf2b3e tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:43.692052 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7d3d325b-7354-4886-ba22-bc573ddf2b3e tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:43.829607 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-7d3d325b-7354-4886-ba22-bc573ddf2b3e tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f67ee6767314bfb9cc04ea9c0dafb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0652fe65874b4606822aa7f261387bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:34:43.838044 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-7d3d325b-7354-4886-ba22-bc573ddf2b3e tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "GET /compute/v2.1/servers/8f69d18a-8407-4ab4-8f5c-5f23979b2ac6" status: 200 len: 1670 microversion: 2.1 time: 0.160671 Oct 04 19:34:43.838995 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3386/7140] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:34:43 2022] GET /compute/v2.1/servers/8f69d18a-8407-4ab4-8f5c-5f23979b2ac6 => generated 1670 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:34:43.863648 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-7cbbf641-543a-426d-b56a-b67a00832541 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:34:43.864291 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-7cbbf641-543a-426d-b56a-b67a00832541 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: 8f69d18a-8407-4ab4-8f5c-5f23979b2ac6] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:34:43.872106 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7cbbf641-543a-426d-b56a-b67a00832541 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:43.872347 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7cbbf641-543a-426d-b56a-b67a00832541 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:43.872688 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7cbbf641-543a-426d-b56a-b67a00832541 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:43.873483 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7cbbf641-543a-426d-b56a-b67a00832541 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:43.874067 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7cbbf641-543a-426d-b56a-b67a00832541 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:43.874396 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7cbbf641-543a-426d-b56a-b67a00832541 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:43.992386 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-0e6bf34b-f218-4946-b28a-04df5c87fd3e req-29fb4447-b2ca-4ae2-a6e8-de6bb97af21d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f69d18a-8407-4ab4-8f5c-5f23979b2ac6", "name": "network-vif-plugged", "status": "completed", "tag": "0c21810a-3b21-4130-803f-8da097578121"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:34:44.006198 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-0e6bf34b-f218-4946-b28a-04df5c87fd3e req-29fb4447-b2ca-4ae2-a6e8-de6bb97af21d service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:44.007313 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-0e6bf34b-f218-4946-b28a-04df5c87fd3e req-29fb4447-b2ca-4ae2-a6e8-de6bb97af21d service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:44.007586 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-0e6bf34b-f218-4946-b28a-04df5c87fd3e req-29fb4447-b2ca-4ae2-a6e8-de6bb97af21d service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:44.022988 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-7cbbf641-543a-426d-b56a-b67a00832541 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f67ee6767314bfb9cc04ea9c0dafb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0652fe65874b4606822aa7f261387bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:34:44.023169 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-0e6bf34b-f218-4946-b28a-04df5c87fd3e req-29fb4447-b2ca-4ae2-a6e8-de6bb97af21d service nova] Creating event network-vif-plugged:0c21810a-3b21-4130-803f-8da097578121 for instance 8f69d18a-8407-4ab4-8f5c-5f23979b2ac6 on n-h2-851028-13 Oct 04 19:34:44.029004 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-0e6bf34b-f218-4946-b28a-04df5c87fd3e req-29fb4447-b2ca-4ae2-a6e8-de6bb97af21d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040545 Oct 04 19:34:44.030199 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3387/7141] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:34:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:34:44.034726 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-7cbbf641-543a-426d-b56a-b67a00832541 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "GET /compute/v2.1/servers/8f69d18a-8407-4ab4-8f5c-5f23979b2ac6" status: 200 len: 1670 microversion: 2.1 time: 0.175097 Oct 04 19:34:44.035316 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3755/7142] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:34:43 2022] GET /compute/v2.1/servers/8f69d18a-8407-4ab4-8f5c-5f23979b2ac6 => generated 1670 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:34:44.062633 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-e8e0deac-db16-432f-afec-1fc23aaf1903 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:34:44.063229 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-e8e0deac-db16-432f-afec-1fc23aaf1903 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: 8f69d18a-8407-4ab4-8f5c-5f23979b2ac6] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:34:44.070203 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e8e0deac-db16-432f-afec-1fc23aaf1903 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:44.070698 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e8e0deac-db16-432f-afec-1fc23aaf1903 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:44.071143 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e8e0deac-db16-432f-afec-1fc23aaf1903 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:44.071858 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e8e0deac-db16-432f-afec-1fc23aaf1903 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:44.072320 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e8e0deac-db16-432f-afec-1fc23aaf1903 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:44.072751 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e8e0deac-db16-432f-afec-1fc23aaf1903 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:44.100012 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-e8e0deac-db16-432f-afec-1fc23aaf1903 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: 8f69d18a-8407-4ab4-8f5c-5f23979b2ac6] Going to try to terminate instance {{(pid=123595) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 19:34:44.147088 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:34:44.180298 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-e8e0deac-db16-432f-afec-1fc23aaf1903 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "DELETE /compute/v2.1/servers/8f69d18a-8407-4ab4-8f5c-5f23979b2ac6" status: 204 len: 0 microversion: 2.1 time: 0.122181 Oct 04 19:34:44.180906 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3388/7143] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 19:34:44 2022] DELETE /compute/v2.1/servers/8f69d18a-8407-4ab4-8f5c-5f23979b2ac6 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:34:44.189762 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-71eb8a09-d9b6-4cc0-82b3-bc3f506aa244 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:34:44.190539 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-71eb8a09-d9b6-4cc0-82b3-bc3f506aa244 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: 8f69d18a-8407-4ab4-8f5c-5f23979b2ac6] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:34:44.196868 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-71eb8a09-d9b6-4cc0-82b3-bc3f506aa244 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:44.197526 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-71eb8a09-d9b6-4cc0-82b3-bc3f506aa244 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:44.198093 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-71eb8a09-d9b6-4cc0-82b3-bc3f506aa244 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:44.199250 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-71eb8a09-d9b6-4cc0-82b3-bc3f506aa244 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:44.199803 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-71eb8a09-d9b6-4cc0-82b3-bc3f506aa244 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:44.200325 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-71eb8a09-d9b6-4cc0-82b3-bc3f506aa244 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:44.335400 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-71eb8a09-d9b6-4cc0-82b3-bc3f506aa244 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f67ee6767314bfb9cc04ea9c0dafb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0652fe65874b4606822aa7f261387bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:34:44.344895 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-71eb8a09-d9b6-4cc0-82b3-bc3f506aa244 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "GET /compute/v2.1/servers/8f69d18a-8407-4ab4-8f5c-5f23979b2ac6" status: 200 len: 1676 microversion: 2.1 time: 0.159379 Oct 04 19:34:44.345601 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3756/7144] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:34:44 2022] GET /compute/v2.1/servers/8f69d18a-8407-4ab4-8f5c-5f23979b2ac6 => generated 1676 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:34:45.369350 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-e861fc36-03ca-4351-8b8a-eaf6c7399b51 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:34:45.370050 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-e861fc36-03ca-4351-8b8a-eaf6c7399b51 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: 8f69d18a-8407-4ab4-8f5c-5f23979b2ac6] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:34:45.377439 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e861fc36-03ca-4351-8b8a-eaf6c7399b51 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:45.377936 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e861fc36-03ca-4351-8b8a-eaf6c7399b51 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:45.378450 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e861fc36-03ca-4351-8b8a-eaf6c7399b51 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:45.379153 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e861fc36-03ca-4351-8b8a-eaf6c7399b51 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:45.379604 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e861fc36-03ca-4351-8b8a-eaf6c7399b51 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:45.380037 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e861fc36-03ca-4351-8b8a-eaf6c7399b51 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:45.562162 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-e861fc36-03ca-4351-8b8a-eaf6c7399b51 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f67ee6767314bfb9cc04ea9c0dafb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0652fe65874b4606822aa7f261387bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:34:45.569944 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-e861fc36-03ca-4351-8b8a-eaf6c7399b51 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "GET /compute/v2.1/servers/8f69d18a-8407-4ab4-8f5c-5f23979b2ac6" status: 200 len: 1676 microversion: 2.1 time: 0.204917 Oct 04 19:34:45.570523 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3389/7145] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:34:45 2022] GET /compute/v2.1/servers/8f69d18a-8407-4ab4-8f5c-5f23979b2ac6 => generated 1676 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:34:46.367729 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-fb1db052-3bce-4b08-a898-432903ca6484 req-45084f63-82ac-4d4d-9b43-a1224b9fe2b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f69d18a-8407-4ab4-8f5c-5f23979b2ac6", "name": "network-vif-deleted", "tag": "0c21810a-3b21-4130-803f-8da097578121"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:34:46.381383 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-fb1db052-3bce-4b08-a898-432903ca6484 req-45084f63-82ac-4d4d-9b43-a1224b9fe2b6 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:46.381892 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-fb1db052-3bce-4b08-a898-432903ca6484 req-45084f63-82ac-4d4d-9b43-a1224b9fe2b6 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:46.382344 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-fb1db052-3bce-4b08-a898-432903ca6484 req-45084f63-82ac-4d4d-9b43-a1224b9fe2b6 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:46.397143 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-fb1db052-3bce-4b08-a898-432903ca6484 req-45084f63-82ac-4d4d-9b43-a1224b9fe2b6 service nova] Creating event network-vif-deleted:0c21810a-3b21-4130-803f-8da097578121 for instance 8f69d18a-8407-4ab4-8f5c-5f23979b2ac6 on n-h2-851028-13 Oct 04 19:34:46.402439 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-fb1db052-3bce-4b08-a898-432903ca6484 req-45084f63-82ac-4d4d-9b43-a1224b9fe2b6 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038372 Oct 04 19:34:46.406398 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3757/7146] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:34:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:34:46.595486 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-241b0ce8-7bfa-49a1-9b06-ce4eff426676 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:34:46.596101 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-241b0ce8-7bfa-49a1-9b06-ce4eff426676 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: 8f69d18a-8407-4ab4-8f5c-5f23979b2ac6] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:34:46.603281 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-241b0ce8-7bfa-49a1-9b06-ce4eff426676 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:46.604798 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-241b0ce8-7bfa-49a1-9b06-ce4eff426676 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:46.605267 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-241b0ce8-7bfa-49a1-9b06-ce4eff426676 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:46.606155 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-241b0ce8-7bfa-49a1-9b06-ce4eff426676 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:46.606909 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-241b0ce8-7bfa-49a1-9b06-ce4eff426676 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:46.607509 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-241b0ce8-7bfa-49a1-9b06-ce4eff426676 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:46.622883 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-241b0ce8-7bfa-49a1-9b06-ce4eff426676 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] HTTP exception thrown: Instance 8f69d18a-8407-4ab4-8f5c-5f23979b2ac6 could not be found. Oct 04 19:34:46.624697 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-241b0ce8-7bfa-49a1-9b06-ce4eff426676 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Request method failure captured: Oct 04 19:34:46.624697 n-d-851028-13 devstack@n-api.service[123595]: request: GET /compute/v2.1/servers/8f69d18a-8407-4ab4-8f5c-5f23979b2ac6 HTTP/1.1 Oct 04 19:34:46.624697 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 19:34:46.624697 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 19:34:46.624697 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 19:34:46.624697 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 0 Oct 04 19:34:46.624697 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 19:34:46.624697 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 19:34:46.624697 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 19:34:46.624697 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 19:34:46.624697 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPIqNPSW-jY_CXlvweXkAb59PzbD_M9ifcFUjpTbr3KbdOrHUB_aNtkTXlDq8uWp-Uz3LkN9Bpw8W-Ed2va8SU5LJbVHgy-uC1qVHJobUD1nv6xPfp-0ohneG8KzimTY76cYfXn9BJJ6sDEX25dNNYJgqA5GKr8Hn0LvuJeIH2g-v6U8 Oct 04 19:34:46.624697 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 19:34:46.624697 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 19:34:46.624697 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 19:34:46.624697 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 19:34:46.624697 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 19:34:46.624697 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 19:34:46.624697 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: 0652fe65874b4606822aa7f261387bc8 Oct 04 19:34:46.624697 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-ServerActionsTestJSON-1261889807 Oct 04 19:34:46.624697 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 19:34:46.624697 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 19:34:46.624697 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/0652fe65874b4606822aa7f261387bc8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_0652fe65874b4606822aa7f261387bc8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0652fe65874b4606822aa7f261387bc8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0652fe65874b4606822aa7f261387bc8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 19:34:46.624697 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-ServerActionsTestJSON-1261889807 Oct 04 19:34:46.624697 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: 0652fe65874b4606822aa7f261387bc8 Oct 04 19:34:46.624697 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-ServerActionsTestJSON-1261889807 Oct 04 19:34:46.624697 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-ServerActionsTestJSON-1261889807-project Oct 04 19:34:46.624697 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 19:34:46.624697 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 19:34:46.624697 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: 0f67ee6767314bfb9cc04ea9c0dafb4b Oct 04 19:34:46.624697 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-ServerActionsTestJSON-1261889807-project Oct 04 19:34:46.624697 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 19:34:46.624697 n-d-851028-13 devstack@n-api.service[123595]: exception: Instance 8f69d18a-8407-4ab4-8f5c-5f23979b2ac6 could not be found. Oct 04 19:34:46.624697 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': '8f69d18a-8407-4ab4-8f5c-5f23979b2ac6'} Oct 04 19:34:46.624697 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:34:46.624697 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:34:46.624697 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:34:46.624697 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:34:46.624697 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:34:46.624697 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:34:46.624697 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:34:46.624697 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:34:46.624697 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:34:46.624697 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:34:46.624697 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f69d18a-8407-4ab4-8f5c-5f23979b2ac6 could not be found. Oct 04 19:34:46.624697 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:34:46.624697 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:34:46.624697 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:34:46.624697 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:34:46.624697 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:34:46.624697 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:34:46.624697 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:34:46.624697 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:34:46.624697 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:34:46.624697 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:34:46.624697 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:34:46.624697 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:34:46.624697 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:34:46.624697 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:34:46.624697 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:34:46.624697 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:34:46.624697 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f69d18a-8407-4ab4-8f5c-5f23979b2ac6 could not be found. Oct 04 19:34:46.624697 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:34:46.624697 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:34:46.624697 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:34:46.628875 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:34:46.628875 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:34:46.628875 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:34:46.628875 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:34:46.628875 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:34:46.628875 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f69d18a-8407-4ab4-8f5c-5f23979b2ac6 could not be found. Oct 04 19:34:46.628875 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:34:46.628875 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-241b0ce8-7bfa-49a1-9b06-ce4eff426676 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Returning 404 to user: Instance 8f69d18a-8407-4ab4-8f5c-5f23979b2ac6 could not be found. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:34:46.628875 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-241b0ce8-7bfa-49a1-9b06-ce4eff426676 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "GET /compute/v2.1/servers/8f69d18a-8407-4ab4-8f5c-5f23979b2ac6" status: 404 len: 111 microversion: 2.1 time: 0.035350 Oct 04 19:34:46.628875 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3390/7147] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:34:46 2022] GET /compute/v2.1/servers/8f69d18a-8407-4ab4-8f5c-5f23979b2ac6 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:34:46.640978 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-6e52aa3c-2de9-4e09-9fdd-b75b149e4003 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:34:46.641883 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-6e52aa3c-2de9-4e09-9fdd-b75b149e4003 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: 8f69d18a-8407-4ab4-8f5c-5f23979b2ac6] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:34:46.649511 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6e52aa3c-2de9-4e09-9fdd-b75b149e4003 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:46.649511 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6e52aa3c-2de9-4e09-9fdd-b75b149e4003 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:46.650581 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6e52aa3c-2de9-4e09-9fdd-b75b149e4003 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:46.651385 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6e52aa3c-2de9-4e09-9fdd-b75b149e4003 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:46.651924 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6e52aa3c-2de9-4e09-9fdd-b75b149e4003 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:46.652411 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6e52aa3c-2de9-4e09-9fdd-b75b149e4003 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:46.667202 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-6e52aa3c-2de9-4e09-9fdd-b75b149e4003 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] HTTP exception thrown: Instance 8f69d18a-8407-4ab4-8f5c-5f23979b2ac6 could not be found. Oct 04 19:34:46.668961 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-6e52aa3c-2de9-4e09-9fdd-b75b149e4003 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Request method failure captured: Oct 04 19:34:46.668961 n-d-851028-13 devstack@n-api.service[123596]: request: GET /compute/v2.1/servers/8f69d18a-8407-4ab4-8f5c-5f23979b2ac6 HTTP/1.1 Oct 04 19:34:46.668961 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 19:34:46.668961 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 19:34:46.668961 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 19:34:46.668961 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 19:34:46.668961 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 19:34:46.668961 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 19:34:46.668961 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 19:34:46.668961 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 19:34:46.668961 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPIqNPSW-jY_CXlvweXkAb59PzbD_M9ifcFUjpTbr3KbdOrHUB_aNtkTXlDq8uWp-Uz3LkN9Bpw8W-Ed2va8SU5LJbVHgy-uC1qVHJobUD1nv6xPfp-0ohneG8KzimTY76cYfXn9BJJ6sDEX25dNNYJgqA5GKr8Hn0LvuJeIH2g-v6U8 Oct 04 19:34:46.668961 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 19:34:46.668961 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 19:34:46.668961 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 19:34:46.668961 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 19:34:46.668961 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 19:34:46.668961 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 19:34:46.668961 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: 0652fe65874b4606822aa7f261387bc8 Oct 04 19:34:46.668961 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-ServerActionsTestJSON-1261889807 Oct 04 19:34:46.668961 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 19:34:46.668961 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 19:34:46.668961 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/0652fe65874b4606822aa7f261387bc8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_0652fe65874b4606822aa7f261387bc8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0652fe65874b4606822aa7f261387bc8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0652fe65874b4606822aa7f261387bc8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 19:34:46.668961 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-ServerActionsTestJSON-1261889807 Oct 04 19:34:46.668961 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: 0652fe65874b4606822aa7f261387bc8 Oct 04 19:34:46.668961 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-ServerActionsTestJSON-1261889807 Oct 04 19:34:46.668961 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-ServerActionsTestJSON-1261889807-project Oct 04 19:34:46.668961 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 19:34:46.668961 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 19:34:46.668961 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 0f67ee6767314bfb9cc04ea9c0dafb4b Oct 04 19:34:46.668961 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-ServerActionsTestJSON-1261889807-project Oct 04 19:34:46.668961 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 19:34:46.668961 n-d-851028-13 devstack@n-api.service[123596]: exception: Instance 8f69d18a-8407-4ab4-8f5c-5f23979b2ac6 could not be found. Oct 04 19:34:46.668961 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': '8f69d18a-8407-4ab4-8f5c-5f23979b2ac6'} Oct 04 19:34:46.668961 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:34:46.668961 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:34:46.668961 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:34:46.668961 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:34:46.668961 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:34:46.668961 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:34:46.668961 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:34:46.668961 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:34:46.668961 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:34:46.668961 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:34:46.668961 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f69d18a-8407-4ab4-8f5c-5f23979b2ac6 could not be found. Oct 04 19:34:46.668961 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:34:46.668961 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:34:46.668961 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:34:46.668961 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:34:46.668961 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:34:46.668961 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:34:46.668961 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:34:46.668961 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:34:46.668961 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:34:46.668961 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:34:46.668961 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:34:46.668961 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:34:46.668961 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:34:46.668961 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:34:46.668961 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:34:46.668961 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:34:46.668961 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f69d18a-8407-4ab4-8f5c-5f23979b2ac6 could not be found. Oct 04 19:34:46.668961 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:34:46.668961 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:34:46.668961 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:34:46.679370 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:34:46.679370 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:34:46.679370 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:34:46.679370 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:34:46.679370 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:34:46.679370 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f69d18a-8407-4ab4-8f5c-5f23979b2ac6 could not be found. Oct 04 19:34:46.679370 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:34:46.679370 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-6e52aa3c-2de9-4e09-9fdd-b75b149e4003 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Returning 404 to user: Instance 8f69d18a-8407-4ab4-8f5c-5f23979b2ac6 could not be found. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:34:46.679370 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-6e52aa3c-2de9-4e09-9fdd-b75b149e4003 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "GET /compute/v2.1/servers/8f69d18a-8407-4ab4-8f5c-5f23979b2ac6" status: 404 len: 111 microversion: 2.1 time: 0.034031 Oct 04 19:34:46.679370 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3758/7148] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:34:46 2022] GET /compute/v2.1/servers/8f69d18a-8407-4ab4-8f5c-5f23979b2ac6 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:34:46.723485 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-66e943a9-cf3f-4d98-917d-7a2994ec825e tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1818675937", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452", "networks": [{"uuid": "6c9a7653-1520-46af-adc6-2fa7ddb22865"}], "security_groups": [{"name": "tempest-securitygroup--1858182781"}], "key_name": "tempest-keypair-1677005794", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:34:46.841428 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.network.neutron [None req-66e943a9-cf3f-4d98-917d-7a2994ec825e tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] validate_networks() for [('6c9a7653-1520-46af-adc6-2fa7ddb22865', None, None, None, None, None)] {{(pid=123595) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 19:34:47.238112 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-66e943a9-cf3f-4d98-917d-7a2994ec825e tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Flavor limits 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:34:47.238531 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-66e943a9-cf3f-4d98-917d-7a2994ec825e tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Image limits 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:34:47.239015 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-66e943a9-cf3f-4d98-917d-7a2994ec825e tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Flavor pref 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:34:47.239428 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-66e943a9-cf3f-4d98-917d-7a2994ec825e tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Image pref 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:34:47.239850 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-66e943a9-cf3f-4d98-917d-7a2994ec825e tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:34:47.249623 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-66e943a9-cf3f-4d98-917d-7a2994ec825e tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:47.250452 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-66e943a9-cf3f-4d98-917d-7a2994ec825e tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:47.250938 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-66e943a9-cf3f-4d98-917d-7a2994ec825e tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:47.251700 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-66e943a9-cf3f-4d98-917d-7a2994ec825e tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:47.252167 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-66e943a9-cf3f-4d98-917d-7a2994ec825e tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:47.252715 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-66e943a9-cf3f-4d98-917d-7a2994ec825e tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:47.270112 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-66e943a9-cf3f-4d98-917d-7a2994ec825e tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Getting quotas for project 0652fe65874b4606822aa7f261387bc8. Resources: {'ram', 'cores', 'instances'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:34:47.276201 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-66e943a9-cf3f-4d98-917d-7a2994ec825e tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Getting quotas for user 0f67ee6767314bfb9cc04ea9c0dafb4b and project 0652fe65874b4606822aa7f261387bc8. Resources: {'ram', 'cores', 'instances'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:34:47.289383 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-66e943a9-cf3f-4d98-917d-7a2994ec825e tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Going to run 1 instances... {{(pid=123595) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 19:34:47.292337 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-66e943a9-cf3f-4d98-917d-7a2994ec825e tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: aa080ff6-baae-4d71-aa99-37b55ab7f2ed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e8943ec5-4038-4d4b-b9b9-2415a79f5243',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 19:34:47.350420 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-66e943a9-cf3f-4d98-917d-7a2994ec825e tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.631032 Oct 04 19:34:47.351252 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3391/7149] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 19:34:46 2022] POST /compute/v2.1/servers => generated 406 bytes in 632 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 19:34:47.362971 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-973df419-0560-4974-8698-d025de3dfa1e tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:34:47.363605 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-973df419-0560-4974-8698-d025de3dfa1e tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: aa080ff6-baae-4d71-aa99-37b55ab7f2ed] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:34:47.487562 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-973df419-0560-4974-8698-d025de3dfa1e tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f67ee6767314bfb9cc04ea9c0dafb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0652fe65874b4606822aa7f261387bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:34:47.495633 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-973df419-0560-4974-8698-d025de3dfa1e tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "GET /compute/v2.1/servers/aa080ff6-baae-4d71-aa99-37b55ab7f2ed" status: 200 len: 1239 microversion: 2.1 time: 0.136477 Oct 04 19:34:47.496211 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3759/7150] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:34:47 2022] GET /compute/v2.1/servers/aa080ff6-baae-4d71-aa99-37b55ab7f2ed => generated 1239 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:34:48.519610 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-559fb2a6-3889-4e88-9cc1-87b8b6fd25dc tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:34:48.520234 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-559fb2a6-3889-4e88-9cc1-87b8b6fd25dc tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: aa080ff6-baae-4d71-aa99-37b55ab7f2ed] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:34:48.526968 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-559fb2a6-3889-4e88-9cc1-87b8b6fd25dc tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:48.527460 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-559fb2a6-3889-4e88-9cc1-87b8b6fd25dc tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:48.527908 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-559fb2a6-3889-4e88-9cc1-87b8b6fd25dc tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:48.528633 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-559fb2a6-3889-4e88-9cc1-87b8b6fd25dc tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:48.529095 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-559fb2a6-3889-4e88-9cc1-87b8b6fd25dc tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:48.529553 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-559fb2a6-3889-4e88-9cc1-87b8b6fd25dc tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:48.599220 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-559fb2a6-3889-4e88-9cc1-87b8b6fd25dc tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f67ee6767314bfb9cc04ea9c0dafb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0652fe65874b4606822aa7f261387bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:34:48.606952 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-559fb2a6-3889-4e88-9cc1-87b8b6fd25dc tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "GET /compute/v2.1/servers/aa080ff6-baae-4d71-aa99-37b55ab7f2ed" status: 200 len: 1297 microversion: 2.1 time: 0.092018 Oct 04 19:34:48.607524 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3392/7151] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:34:48 2022] GET /compute/v2.1/servers/aa080ff6-baae-4d71-aa99-37b55ab7f2ed => generated 1297 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:34:49.632376 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-21095ee3-c44b-450f-af79-9f2419161d3f tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:34:49.634066 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-21095ee3-c44b-450f-af79-9f2419161d3f tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: aa080ff6-baae-4d71-aa99-37b55ab7f2ed] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:34:49.641277 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-21095ee3-c44b-450f-af79-9f2419161d3f tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:49.641799 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-21095ee3-c44b-450f-af79-9f2419161d3f tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:49.642261 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-21095ee3-c44b-450f-af79-9f2419161d3f tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:49.643030 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-21095ee3-c44b-450f-af79-9f2419161d3f tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:49.643550 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-21095ee3-c44b-450f-af79-9f2419161d3f tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:49.644944 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-21095ee3-c44b-450f-af79-9f2419161d3f tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:49.660883 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:34:49.779486 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-21095ee3-c44b-450f-af79-9f2419161d3f tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f67ee6767314bfb9cc04ea9c0dafb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0652fe65874b4606822aa7f261387bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:34:49.788439 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-21095ee3-c44b-450f-af79-9f2419161d3f tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "GET /compute/v2.1/servers/aa080ff6-baae-4d71-aa99-37b55ab7f2ed" status: 200 len: 1365 microversion: 2.1 time: 0.160886 Oct 04 19:34:49.789214 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3760/7152] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:34:49 2022] GET /compute/v2.1/servers/aa080ff6-baae-4d71-aa99-37b55ab7f2ed => generated 1365 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:34:49.885320 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-39fe8bf5-b1c4-4c09-a427-125164cbe0ed req-4040d0f3-2d53-4ca9-b314-e3f0c7ec819c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa080ff6-baae-4d71-aa99-37b55ab7f2ed", "tag": "0aaddccd-42fc-4c0f-a2d6-9fb1679cb0c4"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:34:49.895865 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-39fe8bf5-b1c4-4c09-a427-125164cbe0ed req-4040d0f3-2d53-4ca9-b314-e3f0c7ec819c service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:49.896349 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-39fe8bf5-b1c4-4c09-a427-125164cbe0ed req-4040d0f3-2d53-4ca9-b314-e3f0c7ec819c service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:49.896780 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-39fe8bf5-b1c4-4c09-a427-125164cbe0ed req-4040d0f3-2d53-4ca9-b314-e3f0c7ec819c service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:49.911457 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-39fe8bf5-b1c4-4c09-a427-125164cbe0ed req-4040d0f3-2d53-4ca9-b314-e3f0c7ec819c service nova] Creating event network-changed:0aaddccd-42fc-4c0f-a2d6-9fb1679cb0c4 for instance aa080ff6-baae-4d71-aa99-37b55ab7f2ed on n-h1-851028-13 Oct 04 19:34:49.916847 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-39fe8bf5-b1c4-4c09-a427-125164cbe0ed req-4040d0f3-2d53-4ca9-b314-e3f0c7ec819c service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107328 Oct 04 19:34:49.917485 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3393/7153] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:34:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:34:50.813653 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-b509f64f-66c6-48d2-bb7f-fed83414e6fa tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:34:50.814267 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-b509f64f-66c6-48d2-bb7f-fed83414e6fa tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: aa080ff6-baae-4d71-aa99-37b55ab7f2ed] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:34:50.821095 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b509f64f-66c6-48d2-bb7f-fed83414e6fa tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:50.821615 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b509f64f-66c6-48d2-bb7f-fed83414e6fa tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:50.822066 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b509f64f-66c6-48d2-bb7f-fed83414e6fa tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:50.823424 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b509f64f-66c6-48d2-bb7f-fed83414e6fa tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:50.823887 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b509f64f-66c6-48d2-bb7f-fed83414e6fa tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:50.824328 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b509f64f-66c6-48d2-bb7f-fed83414e6fa tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:50.955739 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-b509f64f-66c6-48d2-bb7f-fed83414e6fa tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f67ee6767314bfb9cc04ea9c0dafb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0652fe65874b4606822aa7f261387bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:34:50.963458 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-b509f64f-66c6-48d2-bb7f-fed83414e6fa tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "GET /compute/v2.1/servers/aa080ff6-baae-4d71-aa99-37b55ab7f2ed" status: 200 len: 1365 microversion: 2.1 time: 0.153732 Oct 04 19:34:50.964026 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3761/7154] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:34:50 2022] GET /compute/v2.1/servers/aa080ff6-baae-4d71-aa99-37b55ab7f2ed => generated 1365 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:34:51.987988 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-cbfaabd1-7509-4ed4-8bb3-52a498fe3363 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:34:51.988851 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-cbfaabd1-7509-4ed4-8bb3-52a498fe3363 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: aa080ff6-baae-4d71-aa99-37b55ab7f2ed] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:34:51.995127 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cbfaabd1-7509-4ed4-8bb3-52a498fe3363 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:51.995619 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cbfaabd1-7509-4ed4-8bb3-52a498fe3363 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:51.996060 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cbfaabd1-7509-4ed4-8bb3-52a498fe3363 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:51.996766 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cbfaabd1-7509-4ed4-8bb3-52a498fe3363 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:51.997251 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cbfaabd1-7509-4ed4-8bb3-52a498fe3363 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:51.997683 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cbfaabd1-7509-4ed4-8bb3-52a498fe3363 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:52.384242 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-cbfaabd1-7509-4ed4-8bb3-52a498fe3363 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f67ee6767314bfb9cc04ea9c0dafb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0652fe65874b4606822aa7f261387bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:34:52.392436 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-cbfaabd1-7509-4ed4-8bb3-52a498fe3363 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "GET /compute/v2.1/servers/aa080ff6-baae-4d71-aa99-37b55ab7f2ed" status: 200 len: 1365 microversion: 2.1 time: 0.409494 Oct 04 19:34:52.392999 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3394/7155] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:34:51 2022] GET /compute/v2.1/servers/aa080ff6-baae-4d71-aa99-37b55ab7f2ed => generated 1365 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:34:53.415458 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-b7d646fe-985b-4a1c-9041-806f5c69fb28 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:34:53.416083 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-b7d646fe-985b-4a1c-9041-806f5c69fb28 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: aa080ff6-baae-4d71-aa99-37b55ab7f2ed] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:34:53.418819 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_api:SELECT=43 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:34:53.424238 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b7d646fe-985b-4a1c-9041-806f5c69fb28 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:53.424744 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b7d646fe-985b-4a1c-9041-806f5c69fb28 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:53.425226 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b7d646fe-985b-4a1c-9041-806f5c69fb28 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:53.425938 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b7d646fe-985b-4a1c-9041-806f5c69fb28 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:53.426410 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b7d646fe-985b-4a1c-9041-806f5c69fb28 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:53.426857 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b7d646fe-985b-4a1c-9041-806f5c69fb28 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:53.557692 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-b7d646fe-985b-4a1c-9041-806f5c69fb28 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f67ee6767314bfb9cc04ea9c0dafb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0652fe65874b4606822aa7f261387bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:34:53.565403 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-b7d646fe-985b-4a1c-9041-806f5c69fb28 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "GET /compute/v2.1/servers/aa080ff6-baae-4d71-aa99-37b55ab7f2ed" status: 200 len: 1365 microversion: 2.1 time: 0.153901 Oct 04 19:34:53.565984 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3762/7156] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:34:53 2022] GET /compute/v2.1/servers/aa080ff6-baae-4d71-aa99-37b55ab7f2ed => generated 1365 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:34:54.105018 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-8d0a42fa-1fe6-40cc-b831-75eb2a61b001 req-f4cfa1c0-2d76-4ca7-942d-01e866a8e173 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa080ff6-baae-4d71-aa99-37b55ab7f2ed", "name": "network-vif-plugged", "status": "completed", "tag": "0aaddccd-42fc-4c0f-a2d6-9fb1679cb0c4"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:34:54.110879 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:34:54.116498 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-8d0a42fa-1fe6-40cc-b831-75eb2a61b001 req-f4cfa1c0-2d76-4ca7-942d-01e866a8e173 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:54.117141 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-8d0a42fa-1fe6-40cc-b831-75eb2a61b001 req-f4cfa1c0-2d76-4ca7-942d-01e866a8e173 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:54.117604 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-8d0a42fa-1fe6-40cc-b831-75eb2a61b001 req-f4cfa1c0-2d76-4ca7-942d-01e866a8e173 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:54.130266 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-8d0a42fa-1fe6-40cc-b831-75eb2a61b001 req-f4cfa1c0-2d76-4ca7-942d-01e866a8e173 service nova] Creating event network-vif-plugged:0aaddccd-42fc-4c0f-a2d6-9fb1679cb0c4 for instance aa080ff6-baae-4d71-aa99-37b55ab7f2ed on n-h1-851028-13 Oct 04 19:34:54.135436 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-8d0a42fa-1fe6-40cc-b831-75eb2a61b001 req-f4cfa1c0-2d76-4ca7-942d-01e866a8e173 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034499 Oct 04 19:34:54.136080 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3395/7157] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:34:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:34:54.589853 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-ba55ac29-079c-412e-9f39-f2e318a6c1b5 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:34:54.590495 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-ba55ac29-079c-412e-9f39-f2e318a6c1b5 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: aa080ff6-baae-4d71-aa99-37b55ab7f2ed] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:34:54.597989 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ba55ac29-079c-412e-9f39-f2e318a6c1b5 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:54.598499 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ba55ac29-079c-412e-9f39-f2e318a6c1b5 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:54.598957 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ba55ac29-079c-412e-9f39-f2e318a6c1b5 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:54.599670 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ba55ac29-079c-412e-9f39-f2e318a6c1b5 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:54.600147 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ba55ac29-079c-412e-9f39-f2e318a6c1b5 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:54.600596 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ba55ac29-079c-412e-9f39-f2e318a6c1b5 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:54.727143 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-ba55ac29-079c-412e-9f39-f2e318a6c1b5 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f67ee6767314bfb9cc04ea9c0dafb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0652fe65874b4606822aa7f261387bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:34:54.735652 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-ba55ac29-079c-412e-9f39-f2e318a6c1b5 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "GET /compute/v2.1/servers/aa080ff6-baae-4d71-aa99-37b55ab7f2ed" status: 200 len: 1365 microversion: 2.1 time: 0.150421 Oct 04 19:34:54.736230 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3763/7158] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:34:54 2022] GET /compute/v2.1/servers/aa080ff6-baae-4d71-aa99-37b55ab7f2ed => generated 1365 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:34:55.760495 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-d071eb88-56fb-4366-9407-21671fa3727f tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:34:55.761252 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-d071eb88-56fb-4366-9407-21671fa3727f tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: aa080ff6-baae-4d71-aa99-37b55ab7f2ed] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:34:55.767270 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d071eb88-56fb-4366-9407-21671fa3727f tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:55.767748 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d071eb88-56fb-4366-9407-21671fa3727f tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:55.768189 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d071eb88-56fb-4366-9407-21671fa3727f tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:55.768873 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d071eb88-56fb-4366-9407-21671fa3727f tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:55.769364 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d071eb88-56fb-4366-9407-21671fa3727f tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:55.769800 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d071eb88-56fb-4366-9407-21671fa3727f tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:55.901264 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-d071eb88-56fb-4366-9407-21671fa3727f tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f67ee6767314bfb9cc04ea9c0dafb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0652fe65874b4606822aa7f261387bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:34:55.908900 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-d071eb88-56fb-4366-9407-21671fa3727f tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "GET /compute/v2.1/servers/aa080ff6-baae-4d71-aa99-37b55ab7f2ed" status: 200 len: 1552 microversion: 2.1 time: 0.153799 Oct 04 19:34:55.909501 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3396/7159] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:34:55 2022] GET /compute/v2.1/servers/aa080ff6-baae-4d71-aa99-37b55ab7f2ed => generated 1552 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:34:55.932645 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-61d498e5-b11c-4343-855a-3b11edb0f404 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:34:55.933190 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-61d498e5-b11c-4343-855a-3b11edb0f404 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: aa080ff6-baae-4d71-aa99-37b55ab7f2ed] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:34:55.940103 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-61d498e5-b11c-4343-855a-3b11edb0f404 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:55.940607 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-61d498e5-b11c-4343-855a-3b11edb0f404 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:55.941064 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-61d498e5-b11c-4343-855a-3b11edb0f404 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:55.941798 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-61d498e5-b11c-4343-855a-3b11edb0f404 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:55.942270 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-61d498e5-b11c-4343-855a-3b11edb0f404 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:55.942719 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-61d498e5-b11c-4343-855a-3b11edb0f404 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:56.019695 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-61d498e5-b11c-4343-855a-3b11edb0f404 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "GET /compute/v2.1/servers/aa080ff6-baae-4d71-aa99-37b55ab7f2ed/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091834 Oct 04 19:34:56.020302 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3764/7160] 10.222.0.43 () {58 vars in 1275 bytes} [Tue Oct 4 19:34:55 2022] GET /compute/v2.1/servers/aa080ff6-baae-4d71-aa99-37b55ab7f2ed/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:34:57.259355 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-e6b32ad0-9b2f-4331-8933-b44605943df0 req-0a3a46e5-c48f-4e16-a28c-cb917996c0bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa080ff6-baae-4d71-aa99-37b55ab7f2ed", "tag": "0aaddccd-42fc-4c0f-a2d6-9fb1679cb0c4"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:34:57.265126 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=2 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:34:57.271186 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-e6b32ad0-9b2f-4331-8933-b44605943df0 req-0a3a46e5-c48f-4e16-a28c-cb917996c0bc service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:57.271665 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-e6b32ad0-9b2f-4331-8933-b44605943df0 req-0a3a46e5-c48f-4e16-a28c-cb917996c0bc service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:57.272100 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-e6b32ad0-9b2f-4331-8933-b44605943df0 req-0a3a46e5-c48f-4e16-a28c-cb917996c0bc service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:57.283153 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-e6b32ad0-9b2f-4331-8933-b44605943df0 req-0a3a46e5-c48f-4e16-a28c-cb917996c0bc service nova] Creating event network-changed:0aaddccd-42fc-4c0f-a2d6-9fb1679cb0c4 for instance aa080ff6-baae-4d71-aa99-37b55ab7f2ed on n-h1-851028-13 Oct 04 19:34:57.287552 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=6 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:34:57.288546 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-e6b32ad0-9b2f-4331-8933-b44605943df0 req-0a3a46e5-c48f-4e16-a28c-cb917996c0bc service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033729 Oct 04 19:34:57.289168 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3397/7161] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:34:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:35:30.433009 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=2 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:35:30.434275 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_api:SELECT=5 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:35:30.434966 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=27 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:35:30.440693 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-c10972df-95d3-4b8e-9729-2bfa5aaf2162 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:35:30.448190 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c10972df-95d3-4b8e-9729-2bfa5aaf2162 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:35:30.448699 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c10972df-95d3-4b8e-9729-2bfa5aaf2162 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:35:30.449185 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c10972df-95d3-4b8e-9729-2bfa5aaf2162 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:35:30.472260 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-c10972df-95d3-4b8e-9729-2bfa5aaf2162 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: aa080ff6-baae-4d71-aa99-37b55ab7f2ed] Going to try to stop instance {{(pid=123596) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 04 19:35:30.516654 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-c10972df-95d3-4b8e-9729-2bfa5aaf2162 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "POST /compute/v2.1/servers/aa080ff6-baae-4d71-aa99-37b55ab7f2ed/action" status: 202 len: 0 microversion: 2.1 time: 0.085267 Oct 04 19:35:30.517289 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3765/7162] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 19:35:30 2022] POST /compute/v2.1/servers/aa080ff6-baae-4d71-aa99-37b55ab7f2ed/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:35:30.523815 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_api:SELECT=5 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:35:30.524609 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=35,nova_cell1:INSERT=1 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:35:30.529042 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-48dd96f6-666c-49f0-83bc-68e7c27c88d4 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:35:30.529849 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-48dd96f6-666c-49f0-83bc-68e7c27c88d4 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: aa080ff6-baae-4d71-aa99-37b55ab7f2ed] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:35:30.537634 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-48dd96f6-666c-49f0-83bc-68e7c27c88d4 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:35:30.538220 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-48dd96f6-666c-49f0-83bc-68e7c27c88d4 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:35:30.538649 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-48dd96f6-666c-49f0-83bc-68e7c27c88d4 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:35:30.539384 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-48dd96f6-666c-49f0-83bc-68e7c27c88d4 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:35:30.539840 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-48dd96f6-666c-49f0-83bc-68e7c27c88d4 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:35:30.540267 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-48dd96f6-666c-49f0-83bc-68e7c27c88d4 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:35:30.676079 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-48dd96f6-666c-49f0-83bc-68e7c27c88d4 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f67ee6767314bfb9cc04ea9c0dafb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0652fe65874b4606822aa7f261387bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:35:30.683946 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-48dd96f6-666c-49f0-83bc-68e7c27c88d4 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "GET /compute/v2.1/servers/aa080ff6-baae-4d71-aa99-37b55ab7f2ed" status: 200 len: 1680 microversion: 2.1 time: 0.162109 Oct 04 19:35:30.684460 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3398/7163] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:35:30 2022] GET /compute/v2.1/servers/aa080ff6-baae-4d71-aa99-37b55ab7f2ed => generated 1680 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:35:31.709406 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-ce81e3bd-9536-4068-b790-c41c3ea7ec78 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:35:31.710118 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-ce81e3bd-9536-4068-b790-c41c3ea7ec78 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: aa080ff6-baae-4d71-aa99-37b55ab7f2ed] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:35:31.716699 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ce81e3bd-9536-4068-b790-c41c3ea7ec78 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:35:31.717225 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ce81e3bd-9536-4068-b790-c41c3ea7ec78 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:35:31.717673 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ce81e3bd-9536-4068-b790-c41c3ea7ec78 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:35:31.718632 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ce81e3bd-9536-4068-b790-c41c3ea7ec78 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:35:31.719093 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ce81e3bd-9536-4068-b790-c41c3ea7ec78 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:35:31.719760 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ce81e3bd-9536-4068-b790-c41c3ea7ec78 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:35:31.855005 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-ce81e3bd-9536-4068-b790-c41c3ea7ec78 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f67ee6767314bfb9cc04ea9c0dafb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0652fe65874b4606822aa7f261387bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:35:31.863511 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-ce81e3bd-9536-4068-b790-c41c3ea7ec78 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "GET /compute/v2.1/servers/aa080ff6-baae-4d71-aa99-37b55ab7f2ed" status: 200 len: 1680 microversion: 2.1 time: 0.159243 Oct 04 19:35:31.864083 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3766/7164] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:35:31 2022] GET /compute/v2.1/servers/aa080ff6-baae-4d71-aa99-37b55ab7f2ed => generated 1680 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:35:32.886838 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-9aaa29fc-880e-440e-8202-09f482c8fb09 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:35:32.887385 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-9aaa29fc-880e-440e-8202-09f482c8fb09 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: aa080ff6-baae-4d71-aa99-37b55ab7f2ed] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:35:32.894820 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9aaa29fc-880e-440e-8202-09f482c8fb09 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:35:32.895312 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9aaa29fc-880e-440e-8202-09f482c8fb09 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:35:32.895762 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9aaa29fc-880e-440e-8202-09f482c8fb09 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:35:32.896470 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9aaa29fc-880e-440e-8202-09f482c8fb09 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:35:32.896933 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9aaa29fc-880e-440e-8202-09f482c8fb09 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:35:32.897399 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9aaa29fc-880e-440e-8202-09f482c8fb09 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:35:33.024685 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-9aaa29fc-880e-440e-8202-09f482c8fb09 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f67ee6767314bfb9cc04ea9c0dafb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0652fe65874b4606822aa7f261387bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:35:33.032298 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-9aaa29fc-880e-440e-8202-09f482c8fb09 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "GET /compute/v2.1/servers/aa080ff6-baae-4d71-aa99-37b55ab7f2ed" status: 200 len: 1680 microversion: 2.1 time: 0.149508 Oct 04 19:35:33.032858 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3399/7165] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:35:32 2022] GET /compute/v2.1/servers/aa080ff6-baae-4d71-aa99-37b55ab7f2ed => generated 1680 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:35:34.055927 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f462de7b-b539-4c5b-8051-48863ca9ec40 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:35:34.056564 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-f462de7b-b539-4c5b-8051-48863ca9ec40 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: aa080ff6-baae-4d71-aa99-37b55ab7f2ed] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:35:34.064200 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f462de7b-b539-4c5b-8051-48863ca9ec40 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:35:34.064705 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f462de7b-b539-4c5b-8051-48863ca9ec40 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:35:34.065198 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f462de7b-b539-4c5b-8051-48863ca9ec40 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:35:34.065921 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f462de7b-b539-4c5b-8051-48863ca9ec40 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:35:34.066400 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f462de7b-b539-4c5b-8051-48863ca9ec40 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:35:34.066860 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f462de7b-b539-4c5b-8051-48863ca9ec40 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:35:34.195677 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-f462de7b-b539-4c5b-8051-48863ca9ec40 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f67ee6767314bfb9cc04ea9c0dafb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0652fe65874b4606822aa7f261387bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:35:34.204287 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-f462de7b-b539-4c5b-8051-48863ca9ec40 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "GET /compute/v2.1/servers/aa080ff6-baae-4d71-aa99-37b55ab7f2ed" status: 200 len: 1680 microversion: 2.1 time: 0.152364 Oct 04 19:35:34.204873 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3767/7166] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:35:34 2022] GET /compute/v2.1/servers/aa080ff6-baae-4d71-aa99-37b55ab7f2ed => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:35:35.227902 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-32d365f6-fca3-4394-b7bd-58468390fc76 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:35:35.228519 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-32d365f6-fca3-4394-b7bd-58468390fc76 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: aa080ff6-baae-4d71-aa99-37b55ab7f2ed] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:35:35.235931 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-32d365f6-fca3-4394-b7bd-58468390fc76 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:35:35.236423 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-32d365f6-fca3-4394-b7bd-58468390fc76 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:35:35.236874 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-32d365f6-fca3-4394-b7bd-58468390fc76 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:35:35.237608 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-32d365f6-fca3-4394-b7bd-58468390fc76 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:35:35.238069 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-32d365f6-fca3-4394-b7bd-58468390fc76 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:35:35.238503 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-32d365f6-fca3-4394-b7bd-58468390fc76 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:35:35.371424 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-32d365f6-fca3-4394-b7bd-58468390fc76 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f67ee6767314bfb9cc04ea9c0dafb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0652fe65874b4606822aa7f261387bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:35:35.379804 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-32d365f6-fca3-4394-b7bd-58468390fc76 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "GET /compute/v2.1/servers/aa080ff6-baae-4d71-aa99-37b55ab7f2ed" status: 200 len: 1680 microversion: 2.1 time: 0.155971 Oct 04 19:35:35.380469 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3400/7167] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:35:35 2022] GET /compute/v2.1/servers/aa080ff6-baae-4d71-aa99-37b55ab7f2ed => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:35:36.404462 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-49e58f56-b600-43c9-b68e-c21bcb82f797 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:35:36.405097 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-49e58f56-b600-43c9-b68e-c21bcb82f797 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: aa080ff6-baae-4d71-aa99-37b55ab7f2ed] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:35:36.412596 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-49e58f56-b600-43c9-b68e-c21bcb82f797 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:35:36.413254 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-49e58f56-b600-43c9-b68e-c21bcb82f797 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:35:36.413789 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-49e58f56-b600-43c9-b68e-c21bcb82f797 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:35:36.414604 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-49e58f56-b600-43c9-b68e-c21bcb82f797 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:35:36.415083 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-49e58f56-b600-43c9-b68e-c21bcb82f797 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:35:36.415535 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-49e58f56-b600-43c9-b68e-c21bcb82f797 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:35:36.544919 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-49e58f56-b600-43c9-b68e-c21bcb82f797 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f67ee6767314bfb9cc04ea9c0dafb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0652fe65874b4606822aa7f261387bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:35:36.552753 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-49e58f56-b600-43c9-b68e-c21bcb82f797 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "GET /compute/v2.1/servers/aa080ff6-baae-4d71-aa99-37b55ab7f2ed" status: 200 len: 1680 microversion: 2.1 time: 0.152299 Oct 04 19:35:36.553364 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3768/7168] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:35:36 2022] GET /compute/v2.1/servers/aa080ff6-baae-4d71-aa99-37b55ab7f2ed => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:35:37.576501 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-e1fb2859-83d6-4593-aa2e-3395984b63dd tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:35:37.577134 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-e1fb2859-83d6-4593-aa2e-3395984b63dd tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: aa080ff6-baae-4d71-aa99-37b55ab7f2ed] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:35:37.584032 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e1fb2859-83d6-4593-aa2e-3395984b63dd tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:35:37.584516 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e1fb2859-83d6-4593-aa2e-3395984b63dd tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:35:37.584961 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e1fb2859-83d6-4593-aa2e-3395984b63dd tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:35:37.585682 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e1fb2859-83d6-4593-aa2e-3395984b63dd tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:35:37.586141 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e1fb2859-83d6-4593-aa2e-3395984b63dd tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:35:37.586580 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e1fb2859-83d6-4593-aa2e-3395984b63dd tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:35:37.716535 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-e1fb2859-83d6-4593-aa2e-3395984b63dd tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f67ee6767314bfb9cc04ea9c0dafb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0652fe65874b4606822aa7f261387bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:35:37.724763 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-e1fb2859-83d6-4593-aa2e-3395984b63dd tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "GET /compute/v2.1/servers/aa080ff6-baae-4d71-aa99-37b55ab7f2ed" status: 200 len: 1680 microversion: 2.1 time: 0.152202 Oct 04 19:35:37.725373 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3401/7169] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:35:37 2022] GET /compute/v2.1/servers/aa080ff6-baae-4d71-aa99-37b55ab7f2ed => generated 1680 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:35:38.747859 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-611e15b0-131c-45c3-ae37-86d50b34dadf tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:35:38.748484 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-611e15b0-131c-45c3-ae37-86d50b34dadf tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: aa080ff6-baae-4d71-aa99-37b55ab7f2ed] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:35:38.755404 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-611e15b0-131c-45c3-ae37-86d50b34dadf tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:35:38.755899 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-611e15b0-131c-45c3-ae37-86d50b34dadf tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:35:38.756350 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-611e15b0-131c-45c3-ae37-86d50b34dadf tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:35:38.757047 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-611e15b0-131c-45c3-ae37-86d50b34dadf tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:35:38.757562 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-611e15b0-131c-45c3-ae37-86d50b34dadf tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:35:38.758002 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-611e15b0-131c-45c3-ae37-86d50b34dadf tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:35:38.889081 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-611e15b0-131c-45c3-ae37-86d50b34dadf tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f67ee6767314bfb9cc04ea9c0dafb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0652fe65874b4606822aa7f261387bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:35:38.896946 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-611e15b0-131c-45c3-ae37-86d50b34dadf tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "GET /compute/v2.1/servers/aa080ff6-baae-4d71-aa99-37b55ab7f2ed" status: 200 len: 1680 microversion: 2.1 time: 0.153001 Oct 04 19:35:38.897566 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3769/7170] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:35:38 2022] GET /compute/v2.1/servers/aa080ff6-baae-4d71-aa99-37b55ab7f2ed => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:35:39.920833 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-d72f80b5-7075-4f6a-bab8-5a3b158355c5 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:35:39.921484 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-d72f80b5-7075-4f6a-bab8-5a3b158355c5 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: aa080ff6-baae-4d71-aa99-37b55ab7f2ed] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:35:39.928290 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d72f80b5-7075-4f6a-bab8-5a3b158355c5 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:35:39.928785 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d72f80b5-7075-4f6a-bab8-5a3b158355c5 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:35:39.929266 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d72f80b5-7075-4f6a-bab8-5a3b158355c5 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:35:39.929972 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d72f80b5-7075-4f6a-bab8-5a3b158355c5 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:35:39.930434 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d72f80b5-7075-4f6a-bab8-5a3b158355c5 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:35:39.930870 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d72f80b5-7075-4f6a-bab8-5a3b158355c5 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:35:40.063267 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-d72f80b5-7075-4f6a-bab8-5a3b158355c5 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f67ee6767314bfb9cc04ea9c0dafb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0652fe65874b4606822aa7f261387bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:35:40.071002 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-d72f80b5-7075-4f6a-bab8-5a3b158355c5 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "GET /compute/v2.1/servers/aa080ff6-baae-4d71-aa99-37b55ab7f2ed" status: 200 len: 1680 microversion: 2.1 time: 0.154609 Oct 04 19:35:40.071602 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3402/7171] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:35:39 2022] GET /compute/v2.1/servers/aa080ff6-baae-4d71-aa99-37b55ab7f2ed => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:35:41.094475 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-aa82ff04-41cb-41df-a6b9-74815536796e tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:35:41.095036 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-aa82ff04-41cb-41df-a6b9-74815536796e tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: aa080ff6-baae-4d71-aa99-37b55ab7f2ed] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:35:41.102330 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-aa82ff04-41cb-41df-a6b9-74815536796e tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:35:41.102836 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-aa82ff04-41cb-41df-a6b9-74815536796e tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:35:41.103296 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-aa82ff04-41cb-41df-a6b9-74815536796e tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:35:41.104004 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-aa82ff04-41cb-41df-a6b9-74815536796e tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:35:41.104475 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-aa82ff04-41cb-41df-a6b9-74815536796e tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:35:41.104920 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-aa82ff04-41cb-41df-a6b9-74815536796e tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:35:41.231094 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-aa82ff04-41cb-41df-a6b9-74815536796e tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f67ee6767314bfb9cc04ea9c0dafb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0652fe65874b4606822aa7f261387bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:35:41.239270 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-aa82ff04-41cb-41df-a6b9-74815536796e tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "GET /compute/v2.1/servers/aa080ff6-baae-4d71-aa99-37b55ab7f2ed" status: 200 len: 1657 microversion: 2.1 time: 0.149092 Oct 04 19:35:41.239849 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3770/7172] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:35:41 2022] GET /compute/v2.1/servers/aa080ff6-baae-4d71-aa99-37b55ab7f2ed => generated 1657 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:35:41.262177 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-5f626618-5708-41b5-b03a-fdd12a9364de tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:35:41.264489 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-5f626618-5708-41b5-b03a-fdd12a9364de tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: aa080ff6-baae-4d71-aa99-37b55ab7f2ed] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:35:41.271530 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5f626618-5708-41b5-b03a-fdd12a9364de tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:35:41.272019 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5f626618-5708-41b5-b03a-fdd12a9364de tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:35:41.272467 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5f626618-5708-41b5-b03a-fdd12a9364de tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:35:41.273201 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5f626618-5708-41b5-b03a-fdd12a9364de tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:35:41.273666 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5f626618-5708-41b5-b03a-fdd12a9364de tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:35:41.274103 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5f626618-5708-41b5-b03a-fdd12a9364de tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:35:41.302653 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-5f626618-5708-41b5-b03a-fdd12a9364de tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '0f67ee6767314bfb9cc04ea9c0dafb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0652fe65874b4606822aa7f261387bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:35:41.308714 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-5f626618-5708-41b5-b03a-fdd12a9364de tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: aa080ff6-baae-4d71-aa99-37b55ab7f2ed] Old instance type m1.heat2, new instance type m1.heat {{(pid=123595) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 04 19:35:41.315840 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-5f626618-5708-41b5-b03a-fdd12a9364de tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Flavor limits 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:35:41.316273 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-5f626618-5708-41b5-b03a-fdd12a9364de tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Image limits 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:35:41.316756 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-5f626618-5708-41b5-b03a-fdd12a9364de tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Flavor pref 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:35:41.317208 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-5f626618-5708-41b5-b03a-fdd12a9364de tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Image pref 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:35:41.317633 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-5f626618-5708-41b5-b03a-fdd12a9364de tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:35:41.382750 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-5f626618-5708-41b5-b03a-fdd12a9364de tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "POST /compute/v2.1/servers/aa080ff6-baae-4d71-aa99-37b55ab7f2ed/action" status: 202 len: 0 microversion: 2.1 time: 0.124453 Oct 04 19:35:41.383280 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3403/7173] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 19:35:41 2022] POST /compute/v2.1/servers/aa080ff6-baae-4d71-aa99-37b55ab7f2ed/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:35:41.391574 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-1e73756a-f38c-4776-9f6b-d7670ccbda60 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:35:41.392350 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-1e73756a-f38c-4776-9f6b-d7670ccbda60 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: aa080ff6-baae-4d71-aa99-37b55ab7f2ed] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:35:41.398580 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1e73756a-f38c-4776-9f6b-d7670ccbda60 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:35:41.399084 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1e73756a-f38c-4776-9f6b-d7670ccbda60 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:35:41.399544 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1e73756a-f38c-4776-9f6b-d7670ccbda60 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:35:41.400263 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1e73756a-f38c-4776-9f6b-d7670ccbda60 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:35:41.400767 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1e73756a-f38c-4776-9f6b-d7670ccbda60 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:35:41.401359 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1e73756a-f38c-4776-9f6b-d7670ccbda60 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:35:41.566904 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-1e73756a-f38c-4776-9f6b-d7670ccbda60 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f67ee6767314bfb9cc04ea9c0dafb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0652fe65874b4606822aa7f261387bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:35:41.574966 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-1e73756a-f38c-4776-9f6b-d7670ccbda60 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "GET /compute/v2.1/servers/aa080ff6-baae-4d71-aa99-37b55ab7f2ed" status: 200 len: 1680 microversion: 2.1 time: 0.187305 Oct 04 19:35:41.575732 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3771/7174] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:35:41 2022] GET /compute/v2.1/servers/aa080ff6-baae-4d71-aa99-37b55ab7f2ed => generated 1680 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:35:42.603893 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-5f130287-bb8b-4c32-ab28-54a860cc798e tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:35:42.605058 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-5f130287-bb8b-4c32-ab28-54a860cc798e tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: aa080ff6-baae-4d71-aa99-37b55ab7f2ed] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:35:42.616623 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5f130287-bb8b-4c32-ab28-54a860cc798e tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:35:42.617635 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5f130287-bb8b-4c32-ab28-54a860cc798e tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:35:42.618445 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5f130287-bb8b-4c32-ab28-54a860cc798e tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:35:42.619733 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5f130287-bb8b-4c32-ab28-54a860cc798e tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:35:42.620559 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5f130287-bb8b-4c32-ab28-54a860cc798e tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:35:42.621398 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5f130287-bb8b-4c32-ab28-54a860cc798e tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:35:43.102785 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-5f130287-bb8b-4c32-ab28-54a860cc798e tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f67ee6767314bfb9cc04ea9c0dafb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0652fe65874b4606822aa7f261387bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:35:43.111193 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-5f130287-bb8b-4c32-ab28-54a860cc798e tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "GET /compute/v2.1/servers/aa080ff6-baae-4d71-aa99-37b55ab7f2ed" status: 200 len: 1680 microversion: 2.1 time: 0.516224 Oct 04 19:35:43.111762 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3404/7175] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:35:42 2022] GET /compute/v2.1/servers/aa080ff6-baae-4d71-aa99-37b55ab7f2ed => generated 1680 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:35:44.134577 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-8fd55bd9-1c1d-41f8-a8b0-24f800449b85 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:35:44.135111 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-8fd55bd9-1c1d-41f8-a8b0-24f800449b85 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: aa080ff6-baae-4d71-aa99-37b55ab7f2ed] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:35:44.142255 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8fd55bd9-1c1d-41f8-a8b0-24f800449b85 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:35:44.142767 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8fd55bd9-1c1d-41f8-a8b0-24f800449b85 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:35:44.143228 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8fd55bd9-1c1d-41f8-a8b0-24f800449b85 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:35:44.143956 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8fd55bd9-1c1d-41f8-a8b0-24f800449b85 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:35:44.144430 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8fd55bd9-1c1d-41f8-a8b0-24f800449b85 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:35:44.144880 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8fd55bd9-1c1d-41f8-a8b0-24f800449b85 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:35:44.287586 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-8fd55bd9-1c1d-41f8-a8b0-24f800449b85 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f67ee6767314bfb9cc04ea9c0dafb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0652fe65874b4606822aa7f261387bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:35:44.295614 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-8fd55bd9-1c1d-41f8-a8b0-24f800449b85 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "GET /compute/v2.1/servers/aa080ff6-baae-4d71-aa99-37b55ab7f2ed" status: 200 len: 1685 microversion: 2.1 time: 0.165042 Oct 04 19:35:44.296255 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3772/7176] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:35:44 2022] GET /compute/v2.1/servers/aa080ff6-baae-4d71-aa99-37b55ab7f2ed => generated 1685 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:35:45.320446 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-18bf3a02-90be-4967-9daf-abec859554e7 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:35:45.321144 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-18bf3a02-90be-4967-9daf-abec859554e7 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: aa080ff6-baae-4d71-aa99-37b55ab7f2ed] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:35:45.328563 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-18bf3a02-90be-4967-9daf-abec859554e7 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:35:45.329289 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-18bf3a02-90be-4967-9daf-abec859554e7 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:35:45.329809 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-18bf3a02-90be-4967-9daf-abec859554e7 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:35:45.330646 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-18bf3a02-90be-4967-9daf-abec859554e7 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:35:45.331117 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-18bf3a02-90be-4967-9daf-abec859554e7 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:35:45.331565 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-18bf3a02-90be-4967-9daf-abec859554e7 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:35:45.468984 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-18bf3a02-90be-4967-9daf-abec859554e7 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f67ee6767314bfb9cc04ea9c0dafb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0652fe65874b4606822aa7f261387bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:35:45.476854 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-18bf3a02-90be-4967-9daf-abec859554e7 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "GET /compute/v2.1/servers/aa080ff6-baae-4d71-aa99-37b55ab7f2ed" status: 200 len: 1684 microversion: 2.1 time: 0.160418 Oct 04 19:35:45.477460 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3405/7177] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:35:45 2022] GET /compute/v2.1/servers/aa080ff6-baae-4d71-aa99-37b55ab7f2ed => generated 1684 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:35:45.794210 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-3a1d6ecf-ecb9-455d-8b73-7abf267d7d2f req-5e8a06cb-70f8-42ed-909b-f34fd3bd471b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa080ff6-baae-4d71-aa99-37b55ab7f2ed", "name": "network-vif-unplugged", "status": "completed", "tag": "0aaddccd-42fc-4c0f-a2d6-9fb1679cb0c4"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:35:45.804267 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-3a1d6ecf-ecb9-455d-8b73-7abf267d7d2f req-5e8a06cb-70f8-42ed-909b-f34fd3bd471b service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:35:45.804761 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-3a1d6ecf-ecb9-455d-8b73-7abf267d7d2f req-5e8a06cb-70f8-42ed-909b-f34fd3bd471b service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:35:45.805291 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-3a1d6ecf-ecb9-455d-8b73-7abf267d7d2f req-5e8a06cb-70f8-42ed-909b-f34fd3bd471b service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:35:45.817382 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-3a1d6ecf-ecb9-455d-8b73-7abf267d7d2f req-5e8a06cb-70f8-42ed-909b-f34fd3bd471b service nova] Creating event network-vif-unplugged:0aaddccd-42fc-4c0f-a2d6-9fb1679cb0c4 for instance aa080ff6-baae-4d71-aa99-37b55ab7f2ed on n-h2-851028-13 Oct 04 19:35:45.822873 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [req-3a1d6ecf-ecb9-455d-8b73-7abf267d7d2f req-5e8a06cb-70f8-42ed-909b-f34fd3bd471b service nova] Instance aa080ff6-baae-4d71-aa99-37b55ab7f2ed is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851028-13', 'n-h2-851028-13'} {{(pid=123596) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 19:35:45.834565 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-3a1d6ecf-ecb9-455d-8b73-7abf267d7d2f req-5e8a06cb-70f8-42ed-909b-f34fd3bd471b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044073 Oct 04 19:35:45.835182 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3773/7178] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:35:45 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:35:46.501539 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-56441a5e-c111-465f-8f9c-26fd1aeba776 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:35:46.502193 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-56441a5e-c111-465f-8f9c-26fd1aeba776 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: aa080ff6-baae-4d71-aa99-37b55ab7f2ed] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:35:46.509393 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-56441a5e-c111-465f-8f9c-26fd1aeba776 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:35:46.509891 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-56441a5e-c111-465f-8f9c-26fd1aeba776 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:35:46.510336 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-56441a5e-c111-465f-8f9c-26fd1aeba776 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:35:46.511044 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-56441a5e-c111-465f-8f9c-26fd1aeba776 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:35:46.511503 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-56441a5e-c111-465f-8f9c-26fd1aeba776 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:35:46.511936 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-56441a5e-c111-465f-8f9c-26fd1aeba776 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:35:46.657415 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-56441a5e-c111-465f-8f9c-26fd1aeba776 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f67ee6767314bfb9cc04ea9c0dafb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0652fe65874b4606822aa7f261387bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:35:46.665612 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-56441a5e-c111-465f-8f9c-26fd1aeba776 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "GET /compute/v2.1/servers/aa080ff6-baae-4d71-aa99-37b55ab7f2ed" status: 200 len: 1684 microversion: 2.1 time: 0.168485 Oct 04 19:35:46.666211 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3406/7179] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:35:46 2022] GET /compute/v2.1/servers/aa080ff6-baae-4d71-aa99-37b55ab7f2ed => generated 1684 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:35:47.691500 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-ba5553e4-590c-4d8f-9cc4-b31269da0251 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:35:47.692254 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-ba5553e4-590c-4d8f-9cc4-b31269da0251 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: aa080ff6-baae-4d71-aa99-37b55ab7f2ed] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:35:47.698411 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ba5553e4-590c-4d8f-9cc4-b31269da0251 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:35:47.698908 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ba5553e4-590c-4d8f-9cc4-b31269da0251 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:35:47.699365 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ba5553e4-590c-4d8f-9cc4-b31269da0251 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:35:47.700070 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ba5553e4-590c-4d8f-9cc4-b31269da0251 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:35:47.701212 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ba5553e4-590c-4d8f-9cc4-b31269da0251 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:35:47.701661 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ba5553e4-590c-4d8f-9cc4-b31269da0251 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:35:47.837391 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-ba5553e4-590c-4d8f-9cc4-b31269da0251 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f67ee6767314bfb9cc04ea9c0dafb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0652fe65874b4606822aa7f261387bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:35:47.845696 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-ba5553e4-590c-4d8f-9cc4-b31269da0251 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "GET /compute/v2.1/servers/aa080ff6-baae-4d71-aa99-37b55ab7f2ed" status: 200 len: 1682 microversion: 2.1 time: 0.159400 Oct 04 19:35:47.846277 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3774/7180] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:35:47 2022] GET /compute/v2.1/servers/aa080ff6-baae-4d71-aa99-37b55ab7f2ed => generated 1682 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:35:47.877752 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-69e2d411-da66-4c8c-bb8a-070aee2e2cfb req-d6b686e6-2c14-45a6-a3cd-3de70c3ffb93 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa080ff6-baae-4d71-aa99-37b55ab7f2ed", "tag": "0aaddccd-42fc-4c0f-a2d6-9fb1679cb0c4"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:35:47.888538 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-69e2d411-da66-4c8c-bb8a-070aee2e2cfb req-d6b686e6-2c14-45a6-a3cd-3de70c3ffb93 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:35:47.889022 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-69e2d411-da66-4c8c-bb8a-070aee2e2cfb req-d6b686e6-2c14-45a6-a3cd-3de70c3ffb93 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:35:47.889506 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-69e2d411-da66-4c8c-bb8a-070aee2e2cfb req-d6b686e6-2c14-45a6-a3cd-3de70c3ffb93 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:35:47.900732 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-69e2d411-da66-4c8c-bb8a-070aee2e2cfb req-d6b686e6-2c14-45a6-a3cd-3de70c3ffb93 service nova] Creating event network-changed:0aaddccd-42fc-4c0f-a2d6-9fb1679cb0c4 for instance aa080ff6-baae-4d71-aa99-37b55ab7f2ed on n-h2-851028-13 Oct 04 19:35:47.906011 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [req-69e2d411-da66-4c8c-bb8a-070aee2e2cfb req-d6b686e6-2c14-45a6-a3cd-3de70c3ffb93 service nova] Instance aa080ff6-baae-4d71-aa99-37b55ab7f2ed is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851028-13', 'n-h2-851028-13'} {{(pid=123595) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 19:35:47.916783 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-69e2d411-da66-4c8c-bb8a-070aee2e2cfb req-d6b686e6-2c14-45a6-a3cd-3de70c3ffb93 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042737 Oct 04 19:35:47.917465 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3407/7181] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:35:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:35:48.869004 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-6a71d4e1-b25b-40fe-91bd-b323ca1b090b tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:35:48.869676 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-6a71d4e1-b25b-40fe-91bd-b323ca1b090b tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: aa080ff6-baae-4d71-aa99-37b55ab7f2ed] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:35:48.877346 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6a71d4e1-b25b-40fe-91bd-b323ca1b090b tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:35:48.877879 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6a71d4e1-b25b-40fe-91bd-b323ca1b090b tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:35:48.878338 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6a71d4e1-b25b-40fe-91bd-b323ca1b090b tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:35:48.879047 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6a71d4e1-b25b-40fe-91bd-b323ca1b090b tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:35:48.879522 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6a71d4e1-b25b-40fe-91bd-b323ca1b090b tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:35:48.879970 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6a71d4e1-b25b-40fe-91bd-b323ca1b090b tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:35:49.014914 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-6a71d4e1-b25b-40fe-91bd-b323ca1b090b tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f67ee6767314bfb9cc04ea9c0dafb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0652fe65874b4606822aa7f261387bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:35:49.022742 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-6a71d4e1-b25b-40fe-91bd-b323ca1b090b tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "GET /compute/v2.1/servers/aa080ff6-baae-4d71-aa99-37b55ab7f2ed" status: 200 len: 1678 microversion: 2.1 time: 0.157705 Oct 04 19:35:49.023319 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3775/7182] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:35:48 2022] GET /compute/v2.1/servers/aa080ff6-baae-4d71-aa99-37b55ab7f2ed => generated 1678 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:35:49.046799 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-2ea55226-4dd7-4413-9985-7db61a1afa00 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:35:49.047432 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-2ea55226-4dd7-4413-9985-7db61a1afa00 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: aa080ff6-baae-4d71-aa99-37b55ab7f2ed] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:35:49.053660 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2ea55226-4dd7-4413-9985-7db61a1afa00 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:35:49.054154 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2ea55226-4dd7-4413-9985-7db61a1afa00 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:35:49.054599 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2ea55226-4dd7-4413-9985-7db61a1afa00 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:35:49.055308 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2ea55226-4dd7-4413-9985-7db61a1afa00 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:35:49.055768 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2ea55226-4dd7-4413-9985-7db61a1afa00 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:35:49.056203 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2ea55226-4dd7-4413-9985-7db61a1afa00 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:35:49.114675 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-2ea55226-4dd7-4413-9985-7db61a1afa00 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "POST /compute/v2.1/servers/aa080ff6-baae-4d71-aa99-37b55ab7f2ed/action" status: 204 len: 0 microversion: 2.1 time: 0.072890 Oct 04 19:35:49.115310 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3408/7183] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 19:35:49 2022] POST /compute/v2.1/servers/aa080ff6-baae-4d71-aa99-37b55ab7f2ed/action => generated 0 bytes in 75 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:35:49.123559 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-9ef09579-36a4-435d-8984-544d4bca5f99 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:35:49.124188 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-9ef09579-36a4-435d-8984-544d4bca5f99 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: aa080ff6-baae-4d71-aa99-37b55ab7f2ed] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:35:49.130411 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9ef09579-36a4-435d-8984-544d4bca5f99 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:35:49.130949 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9ef09579-36a4-435d-8984-544d4bca5f99 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:35:49.131412 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9ef09579-36a4-435d-8984-544d4bca5f99 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:35:49.132095 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9ef09579-36a4-435d-8984-544d4bca5f99 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:35:49.132569 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9ef09579-36a4-435d-8984-544d4bca5f99 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:35:49.133141 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9ef09579-36a4-435d-8984-544d4bca5f99 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:35:49.265714 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-9ef09579-36a4-435d-8984-544d4bca5f99 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f67ee6767314bfb9cc04ea9c0dafb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0652fe65874b4606822aa7f261387bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:35:49.273557 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-9ef09579-36a4-435d-8984-544d4bca5f99 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "GET /compute/v2.1/servers/aa080ff6-baae-4d71-aa99-37b55ab7f2ed" status: 200 len: 1678 microversion: 2.1 time: 0.153888 Oct 04 19:35:49.274146 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3776/7184] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:35:49 2022] GET /compute/v2.1/servers/aa080ff6-baae-4d71-aa99-37b55ab7f2ed => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:35:50.300589 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-b03aa476-481b-445f-a347-08cd0e9b576c tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:35:50.301508 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-b03aa476-481b-445f-a347-08cd0e9b576c tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: aa080ff6-baae-4d71-aa99-37b55ab7f2ed] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:35:50.308803 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b03aa476-481b-445f-a347-08cd0e9b576c tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:35:50.309443 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b03aa476-481b-445f-a347-08cd0e9b576c tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:35:50.310638 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b03aa476-481b-445f-a347-08cd0e9b576c tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:35:50.311554 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b03aa476-481b-445f-a347-08cd0e9b576c tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:35:50.312250 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b03aa476-481b-445f-a347-08cd0e9b576c tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:35:50.312745 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b03aa476-481b-445f-a347-08cd0e9b576c tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:35:50.468711 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-b03aa476-481b-445f-a347-08cd0e9b576c tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f67ee6767314bfb9cc04ea9c0dafb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0652fe65874b4606822aa7f261387bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:35:50.477869 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-b03aa476-481b-445f-a347-08cd0e9b576c tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "GET /compute/v2.1/servers/aa080ff6-baae-4d71-aa99-37b55ab7f2ed" status: 200 len: 1657 microversion: 2.1 time: 0.183895 Oct 04 19:35:50.478459 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3409/7185] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:35:50 2022] GET /compute/v2.1/servers/aa080ff6-baae-4d71-aa99-37b55ab7f2ed => generated 1657 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:35:50.503110 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-277cef14-3cd2-48c6-b0cb-55f13b9c3c97 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:35:50.503669 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-277cef14-3cd2-48c6-b0cb-55f13b9c3c97 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: aa080ff6-baae-4d71-aa99-37b55ab7f2ed] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:35:50.510551 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-277cef14-3cd2-48c6-b0cb-55f13b9c3c97 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:35:50.511045 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-277cef14-3cd2-48c6-b0cb-55f13b9c3c97 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:35:50.511493 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-277cef14-3cd2-48c6-b0cb-55f13b9c3c97 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:35:50.512191 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-277cef14-3cd2-48c6-b0cb-55f13b9c3c97 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:35:50.512770 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-277cef14-3cd2-48c6-b0cb-55f13b9c3c97 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:35:50.513136 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-277cef14-3cd2-48c6-b0cb-55f13b9c3c97 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:35:50.648029 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-277cef14-3cd2-48c6-b0cb-55f13b9c3c97 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f67ee6767314bfb9cc04ea9c0dafb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0652fe65874b4606822aa7f261387bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:35:50.657837 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-277cef14-3cd2-48c6-b0cb-55f13b9c3c97 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "GET /compute/v2.1/servers/aa080ff6-baae-4d71-aa99-37b55ab7f2ed" status: 200 len: 1657 microversion: 2.1 time: 0.158943 Oct 04 19:35:50.658924 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3777/7186] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:35:50 2022] GET /compute/v2.1/servers/aa080ff6-baae-4d71-aa99-37b55ab7f2ed => generated 1657 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:35:50.680864 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-920d90a5-b6cb-4485-bb5d-f45a04666bf1 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:35:50.687013 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-920d90a5-b6cb-4485-bb5d-f45a04666bf1 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:35:50.687505 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-920d90a5-b6cb-4485-bb5d-f45a04666bf1 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:35:50.687952 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-920d90a5-b6cb-4485-bb5d-f45a04666bf1 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:35:50.709563 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-920d90a5-b6cb-4485-bb5d-f45a04666bf1 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: aa080ff6-baae-4d71-aa99-37b55ab7f2ed] Going to try to start instance {{(pid=123595) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 04 19:35:50.751429 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-920d90a5-b6cb-4485-bb5d-f45a04666bf1 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "POST /compute/v2.1/servers/aa080ff6-baae-4d71-aa99-37b55ab7f2ed/action" status: 202 len: 0 microversion: 2.1 time: 0.074219 Oct 04 19:35:50.752042 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3410/7187] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 19:35:50 2022] POST /compute/v2.1/servers/aa080ff6-baae-4d71-aa99-37b55ab7f2ed/action => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:35:50.760445 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-e812689f-e010-4540-9a27-17c0428239b7 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:35:50.761004 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-e812689f-e010-4540-9a27-17c0428239b7 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: aa080ff6-baae-4d71-aa99-37b55ab7f2ed] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:35:50.767507 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e812689f-e010-4540-9a27-17c0428239b7 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:35:50.768080 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e812689f-e010-4540-9a27-17c0428239b7 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:35:50.768598 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e812689f-e010-4540-9a27-17c0428239b7 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:35:50.769372 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e812689f-e010-4540-9a27-17c0428239b7 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:35:50.769852 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e812689f-e010-4540-9a27-17c0428239b7 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:35:50.770458 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e812689f-e010-4540-9a27-17c0428239b7 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:35:50.976236 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-e812689f-e010-4540-9a27-17c0428239b7 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f67ee6767314bfb9cc04ea9c0dafb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0652fe65874b4606822aa7f261387bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:35:50.984164 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-e812689f-e010-4540-9a27-17c0428239b7 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "GET /compute/v2.1/servers/aa080ff6-baae-4d71-aa99-37b55ab7f2ed" status: 200 len: 1666 microversion: 2.1 time: 0.227657 Oct 04 19:35:50.984837 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3778/7188] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:35:50 2022] GET /compute/v2.1/servers/aa080ff6-baae-4d71-aa99-37b55ab7f2ed => generated 1666 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:35:52.009187 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-b1a937ce-6580-40da-8ea5-7260e573d479 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:35:52.009893 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-b1a937ce-6580-40da-8ea5-7260e573d479 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: aa080ff6-baae-4d71-aa99-37b55ab7f2ed] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:35:52.016018 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b1a937ce-6580-40da-8ea5-7260e573d479 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:35:52.016501 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b1a937ce-6580-40da-8ea5-7260e573d479 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:35:52.016943 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b1a937ce-6580-40da-8ea5-7260e573d479 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:35:52.017663 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b1a937ce-6580-40da-8ea5-7260e573d479 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:35:52.018120 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b1a937ce-6580-40da-8ea5-7260e573d479 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:35:52.018572 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b1a937ce-6580-40da-8ea5-7260e573d479 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:35:52.033330 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:35:52.157296 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-b1a937ce-6580-40da-8ea5-7260e573d479 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f67ee6767314bfb9cc04ea9c0dafb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0652fe65874b4606822aa7f261387bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:35:52.165431 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-b1a937ce-6580-40da-8ea5-7260e573d479 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "GET /compute/v2.1/servers/aa080ff6-baae-4d71-aa99-37b55ab7f2ed" status: 200 len: 1670 microversion: 2.1 time: 0.161531 Oct 04 19:35:52.166012 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3411/7189] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:35:52 2022] GET /compute/v2.1/servers/aa080ff6-baae-4d71-aa99-37b55ab7f2ed => generated 1670 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:35:52.188642 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-c34d6bd5-a7d3-4350-8c91-c881b104479c tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:35:52.189209 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-c34d6bd5-a7d3-4350-8c91-c881b104479c tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: aa080ff6-baae-4d71-aa99-37b55ab7f2ed] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:35:52.196222 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c34d6bd5-a7d3-4350-8c91-c881b104479c tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:35:52.196731 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c34d6bd5-a7d3-4350-8c91-c881b104479c tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:35:52.197234 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c34d6bd5-a7d3-4350-8c91-c881b104479c tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:35:52.197960 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c34d6bd5-a7d3-4350-8c91-c881b104479c tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:35:52.198433 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c34d6bd5-a7d3-4350-8c91-c881b104479c tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:35:52.198880 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c34d6bd5-a7d3-4350-8c91-c881b104479c tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:35:52.226688 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-c34d6bd5-a7d3-4350-8c91-c881b104479c tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: aa080ff6-baae-4d71-aa99-37b55ab7f2ed] Going to try to terminate instance {{(pid=123596) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 19:35:52.261698 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:35:52.312101 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-c34d6bd5-a7d3-4350-8c91-c881b104479c tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "DELETE /compute/v2.1/servers/aa080ff6-baae-4d71-aa99-37b55ab7f2ed" status: 204 len: 0 microversion: 2.1 time: 0.126868 Oct 04 19:35:52.313090 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3779/7190] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 19:35:52 2022] DELETE /compute/v2.1/servers/aa080ff6-baae-4d71-aa99-37b55ab7f2ed => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:35:52.322914 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-b97fa123-fe52-44bb-b2bf-4c74e97831ea tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:35:52.323677 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-b97fa123-fe52-44bb-b2bf-4c74e97831ea tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: aa080ff6-baae-4d71-aa99-37b55ab7f2ed] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:35:52.330736 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b97fa123-fe52-44bb-b2bf-4c74e97831ea tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:35:52.331504 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b97fa123-fe52-44bb-b2bf-4c74e97831ea tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:35:52.332033 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b97fa123-fe52-44bb-b2bf-4c74e97831ea tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:35:52.333045 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b97fa123-fe52-44bb-b2bf-4c74e97831ea tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:35:52.333601 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b97fa123-fe52-44bb-b2bf-4c74e97831ea tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:35:52.334111 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b97fa123-fe52-44bb-b2bf-4c74e97831ea tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:35:52.389569 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-28e28559-e238-4124-8683-01d17921f1ae req-93400718-b365-4cec-9eda-c33694254a10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa080ff6-baae-4d71-aa99-37b55ab7f2ed", "name": "network-vif-plugged", "status": "completed", "tag": "0aaddccd-42fc-4c0f-a2d6-9fb1679cb0c4"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:35:52.400143 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-28e28559-e238-4124-8683-01d17921f1ae req-93400718-b365-4cec-9eda-c33694254a10 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:35:52.400764 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-28e28559-e238-4124-8683-01d17921f1ae req-93400718-b365-4cec-9eda-c33694254a10 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:35:52.401289 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-28e28559-e238-4124-8683-01d17921f1ae req-93400718-b365-4cec-9eda-c33694254a10 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:35:52.414823 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-28e28559-e238-4124-8683-01d17921f1ae req-93400718-b365-4cec-9eda-c33694254a10 service nova] Creating event network-vif-plugged:0aaddccd-42fc-4c0f-a2d6-9fb1679cb0c4 for instance aa080ff6-baae-4d71-aa99-37b55ab7f2ed on n-h2-851028-13 Oct 04 19:35:52.420760 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-28e28559-e238-4124-8683-01d17921f1ae req-93400718-b365-4cec-9eda-c33694254a10 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100861 Oct 04 19:35:52.421507 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3780/7191] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:35:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:35:52.483374 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-b97fa123-fe52-44bb-b2bf-4c74e97831ea tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f67ee6767314bfb9cc04ea9c0dafb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0652fe65874b4606822aa7f261387bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:35:52.491219 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-b97fa123-fe52-44bb-b2bf-4c74e97831ea tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "GET /compute/v2.1/servers/aa080ff6-baae-4d71-aa99-37b55ab7f2ed" status: 200 len: 1676 microversion: 2.1 time: 0.173829 Oct 04 19:35:52.491789 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3412/7192] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:35:52 2022] GET /compute/v2.1/servers/aa080ff6-baae-4d71-aa99-37b55ab7f2ed => generated 1676 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:35:53.515487 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-1374e737-7a13-4c8a-a2ac-31e05b196f4d tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:35:53.516230 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-1374e737-7a13-4c8a-a2ac-31e05b196f4d tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: aa080ff6-baae-4d71-aa99-37b55ab7f2ed] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:35:53.523403 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1374e737-7a13-4c8a-a2ac-31e05b196f4d tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:35:53.523904 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1374e737-7a13-4c8a-a2ac-31e05b196f4d tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:35:53.524357 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1374e737-7a13-4c8a-a2ac-31e05b196f4d tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:35:53.525060 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1374e737-7a13-4c8a-a2ac-31e05b196f4d tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:35:53.525553 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1374e737-7a13-4c8a-a2ac-31e05b196f4d tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:35:53.525994 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1374e737-7a13-4c8a-a2ac-31e05b196f4d tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:35:53.735138 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-1374e737-7a13-4c8a-a2ac-31e05b196f4d tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f67ee6767314bfb9cc04ea9c0dafb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0652fe65874b4606822aa7f261387bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:35:53.743218 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-1374e737-7a13-4c8a-a2ac-31e05b196f4d tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "GET /compute/v2.1/servers/aa080ff6-baae-4d71-aa99-37b55ab7f2ed" status: 200 len: 1676 microversion: 2.1 time: 0.232446 Oct 04 19:35:53.743892 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3781/7193] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:35:53 2022] GET /compute/v2.1/servers/aa080ff6-baae-4d71-aa99-37b55ab7f2ed => generated 1676 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:35:54.467901 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-63414190-db43-4d91-92d6-77ad83cd8a96 req-23b2c210-9d99-4d45-8b31-c8e6bde5d2fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa080ff6-baae-4d71-aa99-37b55ab7f2ed", "name": "network-vif-deleted", "tag": "0aaddccd-42fc-4c0f-a2d6-9fb1679cb0c4"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:35:54.478412 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-63414190-db43-4d91-92d6-77ad83cd8a96 req-23b2c210-9d99-4d45-8b31-c8e6bde5d2fb service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:35:54.479064 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-63414190-db43-4d91-92d6-77ad83cd8a96 req-23b2c210-9d99-4d45-8b31-c8e6bde5d2fb service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:35:54.479509 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-63414190-db43-4d91-92d6-77ad83cd8a96 req-23b2c210-9d99-4d45-8b31-c8e6bde5d2fb service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:35:54.491895 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-63414190-db43-4d91-92d6-77ad83cd8a96 req-23b2c210-9d99-4d45-8b31-c8e6bde5d2fb service nova] Creating event network-vif-deleted:0aaddccd-42fc-4c0f-a2d6-9fb1679cb0c4 for instance aa080ff6-baae-4d71-aa99-37b55ab7f2ed on n-h2-851028-13 Oct 04 19:35:54.496809 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-63414190-db43-4d91-92d6-77ad83cd8a96 req-23b2c210-9d99-4d45-8b31-c8e6bde5d2fb service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033551 Oct 04 19:35:54.497443 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3413/7194] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:35:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:35:54.767689 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-13268361-c248-488c-9ad5-c36f1181f95f tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:35:54.768318 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-13268361-c248-488c-9ad5-c36f1181f95f tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: aa080ff6-baae-4d71-aa99-37b55ab7f2ed] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:35:54.775407 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-13268361-c248-488c-9ad5-c36f1181f95f tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:35:54.775917 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-13268361-c248-488c-9ad5-c36f1181f95f tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:35:54.776378 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-13268361-c248-488c-9ad5-c36f1181f95f tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:35:54.777088 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-13268361-c248-488c-9ad5-c36f1181f95f tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:35:54.777582 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-13268361-c248-488c-9ad5-c36f1181f95f tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:35:54.778029 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-13268361-c248-488c-9ad5-c36f1181f95f tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:35:54.792175 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-13268361-c248-488c-9ad5-c36f1181f95f tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] HTTP exception thrown: Instance aa080ff6-baae-4d71-aa99-37b55ab7f2ed could not be found. Oct 04 19:35:54.793896 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-13268361-c248-488c-9ad5-c36f1181f95f tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Request method failure captured: Oct 04 19:35:54.793896 n-d-851028-13 devstack@n-api.service[123596]: request: GET /compute/v2.1/servers/aa080ff6-baae-4d71-aa99-37b55ab7f2ed HTTP/1.1 Oct 04 19:35:54.793896 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 19:35:54.793896 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 19:35:54.793896 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 19:35:54.793896 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 19:35:54.793896 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 19:35:54.793896 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 19:35:54.793896 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 19:35:54.793896 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 19:35:54.793896 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPIqNPSW-jY_CXlvweXkAb59PzbD_M9ifcFUjpTbr3KbdOrHUB_aNtkTXlDq8uWp-Uz3LkN9Bpw8W-Ed2va8SU5LJbVHgy-uC1qVHJobUD1nv6xPfp-0ohneG8KzimTY76cYfXn9BJJ6sDEX25dNNYJgqA5GKr8Hn0LvuJeIH2g-v6U8 Oct 04 19:35:54.793896 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 19:35:54.793896 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 19:35:54.793896 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 19:35:54.793896 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 19:35:54.793896 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 19:35:54.793896 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 19:35:54.793896 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: 0652fe65874b4606822aa7f261387bc8 Oct 04 19:35:54.793896 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-ServerActionsTestJSON-1261889807 Oct 04 19:35:54.793896 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 19:35:54.793896 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 19:35:54.793896 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/0652fe65874b4606822aa7f261387bc8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_0652fe65874b4606822aa7f261387bc8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0652fe65874b4606822aa7f261387bc8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0652fe65874b4606822aa7f261387bc8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 19:35:54.793896 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-ServerActionsTestJSON-1261889807 Oct 04 19:35:54.793896 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: 0652fe65874b4606822aa7f261387bc8 Oct 04 19:35:54.793896 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-ServerActionsTestJSON-1261889807 Oct 04 19:35:54.793896 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-ServerActionsTestJSON-1261889807-project Oct 04 19:35:54.793896 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 19:35:54.793896 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 19:35:54.793896 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 0f67ee6767314bfb9cc04ea9c0dafb4b Oct 04 19:35:54.793896 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-ServerActionsTestJSON-1261889807-project Oct 04 19:35:54.793896 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 19:35:54.793896 n-d-851028-13 devstack@n-api.service[123596]: exception: Instance aa080ff6-baae-4d71-aa99-37b55ab7f2ed could not be found. Oct 04 19:35:54.793896 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': 'aa080ff6-baae-4d71-aa99-37b55ab7f2ed'} Oct 04 19:35:54.793896 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:35:54.793896 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:35:54.793896 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:35:54.793896 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:35:54.793896 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:35:54.793896 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:35:54.793896 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:35:54.793896 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:35:54.793896 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:35:54.793896 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:35:54.793896 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa080ff6-baae-4d71-aa99-37b55ab7f2ed could not be found. Oct 04 19:35:54.793896 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:35:54.793896 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:35:54.793896 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:35:54.793896 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:35:54.793896 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:35:54.793896 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:35:54.793896 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:35:54.793896 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:35:54.793896 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:35:54.793896 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:35:54.793896 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:35:54.793896 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:35:54.793896 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:35:54.793896 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:35:54.793896 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:35:54.793896 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:35:54.793896 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa080ff6-baae-4d71-aa99-37b55ab7f2ed could not be found. Oct 04 19:35:54.793896 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:35:54.793896 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:35:54.793896 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:35:54.798680 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:35:54.798680 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:35:54.798680 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:35:54.798680 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:35:54.798680 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:35:54.798680 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa080ff6-baae-4d71-aa99-37b55ab7f2ed could not be found. Oct 04 19:35:54.798680 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:35:54.798680 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-13268361-c248-488c-9ad5-c36f1181f95f tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Returning 404 to user: Instance aa080ff6-baae-4d71-aa99-37b55ab7f2ed could not be found. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:35:54.798680 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-13268361-c248-488c-9ad5-c36f1181f95f tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "GET /compute/v2.1/servers/aa080ff6-baae-4d71-aa99-37b55ab7f2ed" status: 404 len: 111 microversion: 2.1 time: 0.031595 Oct 04 19:35:54.798680 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3782/7195] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:35:54 2022] GET /compute/v2.1/servers/aa080ff6-baae-4d71-aa99-37b55ab7f2ed => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:35:54.816185 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-6e9aeeff-70fe-4097-a5c6-f0569cef2dbf tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:35:54.817052 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-6e9aeeff-70fe-4097-a5c6-f0569cef2dbf tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: aa080ff6-baae-4d71-aa99-37b55ab7f2ed] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:35:54.823232 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6e9aeeff-70fe-4097-a5c6-f0569cef2dbf tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:35:54.823722 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6e9aeeff-70fe-4097-a5c6-f0569cef2dbf tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:35:54.824159 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6e9aeeff-70fe-4097-a5c6-f0569cef2dbf tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:35:54.824853 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6e9aeeff-70fe-4097-a5c6-f0569cef2dbf tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:35:54.825897 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6e9aeeff-70fe-4097-a5c6-f0569cef2dbf tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:35:54.826328 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6e9aeeff-70fe-4097-a5c6-f0569cef2dbf tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:35:54.839716 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-6e9aeeff-70fe-4097-a5c6-f0569cef2dbf tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] HTTP exception thrown: Instance aa080ff6-baae-4d71-aa99-37b55ab7f2ed could not be found. Oct 04 19:35:54.842011 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-6e9aeeff-70fe-4097-a5c6-f0569cef2dbf tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Request method failure captured: Oct 04 19:35:54.842011 n-d-851028-13 devstack@n-api.service[123595]: request: GET /compute/v2.1/servers/aa080ff6-baae-4d71-aa99-37b55ab7f2ed HTTP/1.1 Oct 04 19:35:54.842011 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 19:35:54.842011 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 19:35:54.842011 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 19:35:54.842011 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 0 Oct 04 19:35:54.842011 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 19:35:54.842011 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 19:35:54.842011 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 19:35:54.842011 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 19:35:54.842011 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPIqNPSW-jY_CXlvweXkAb59PzbD_M9ifcFUjpTbr3KbdOrHUB_aNtkTXlDq8uWp-Uz3LkN9Bpw8W-Ed2va8SU5LJbVHgy-uC1qVHJobUD1nv6xPfp-0ohneG8KzimTY76cYfXn9BJJ6sDEX25dNNYJgqA5GKr8Hn0LvuJeIH2g-v6U8 Oct 04 19:35:54.842011 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 19:35:54.842011 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 19:35:54.842011 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 19:35:54.842011 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 19:35:54.842011 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 19:35:54.842011 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 19:35:54.842011 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: 0652fe65874b4606822aa7f261387bc8 Oct 04 19:35:54.842011 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-ServerActionsTestJSON-1261889807 Oct 04 19:35:54.842011 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 19:35:54.842011 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 19:35:54.842011 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/0652fe65874b4606822aa7f261387bc8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_0652fe65874b4606822aa7f261387bc8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0652fe65874b4606822aa7f261387bc8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0652fe65874b4606822aa7f261387bc8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 19:35:54.842011 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-ServerActionsTestJSON-1261889807 Oct 04 19:35:54.842011 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: 0652fe65874b4606822aa7f261387bc8 Oct 04 19:35:54.842011 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-ServerActionsTestJSON-1261889807 Oct 04 19:35:54.842011 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-ServerActionsTestJSON-1261889807-project Oct 04 19:35:54.842011 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 19:35:54.842011 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 19:35:54.842011 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: 0f67ee6767314bfb9cc04ea9c0dafb4b Oct 04 19:35:54.842011 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-ServerActionsTestJSON-1261889807-project Oct 04 19:35:54.842011 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 19:35:54.842011 n-d-851028-13 devstack@n-api.service[123595]: exception: Instance aa080ff6-baae-4d71-aa99-37b55ab7f2ed could not be found. Oct 04 19:35:54.842011 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': 'aa080ff6-baae-4d71-aa99-37b55ab7f2ed'} Oct 04 19:35:54.842011 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:35:54.842011 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:35:54.842011 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:35:54.842011 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:35:54.842011 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:35:54.842011 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:35:54.842011 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:35:54.842011 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:35:54.842011 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:35:54.842011 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:35:54.842011 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa080ff6-baae-4d71-aa99-37b55ab7f2ed could not be found. Oct 04 19:35:54.842011 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:35:54.842011 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:35:54.842011 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:35:54.842011 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:35:54.842011 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:35:54.842011 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:35:54.842011 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:35:54.842011 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:35:54.842011 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:35:54.842011 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:35:54.842011 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:35:54.842011 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:35:54.842011 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:35:54.842011 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:35:54.842011 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:35:54.842011 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:35:54.842011 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa080ff6-baae-4d71-aa99-37b55ab7f2ed could not be found. Oct 04 19:35:54.842011 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:35:54.842011 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:35:54.842011 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:35:54.846352 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:35:54.846352 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:35:54.846352 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:35:54.846352 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:35:54.846352 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:35:54.846352 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa080ff6-baae-4d71-aa99-37b55ab7f2ed could not be found. Oct 04 19:35:54.846352 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:35:54.846352 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-6e9aeeff-70fe-4097-a5c6-f0569cef2dbf tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Returning 404 to user: Instance aa080ff6-baae-4d71-aa99-37b55ab7f2ed could not be found. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:35:54.846352 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-6e9aeeff-70fe-4097-a5c6-f0569cef2dbf tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "GET /compute/v2.1/servers/aa080ff6-baae-4d71-aa99-37b55ab7f2ed" status: 404 len: 111 microversion: 2.1 time: 0.031795 Oct 04 19:35:54.846352 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3414/7196] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:35:54 2022] GET /compute/v2.1/servers/aa080ff6-baae-4d71-aa99-37b55ab7f2ed => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:35:54.892127 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-593064fe-eec1-4d23-8fc1-4a7a19d5ea13 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1772272773", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452", "networks": [{"uuid": "6c9a7653-1520-46af-adc6-2fa7ddb22865"}], "security_groups": [{"name": "tempest-securitygroup--1858182781"}], "key_name": "tempest-keypair-1677005794", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:35:55.324114 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.network.neutron [None req-593064fe-eec1-4d23-8fc1-4a7a19d5ea13 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] validate_networks() for [('6c9a7653-1520-46af-adc6-2fa7ddb22865', None, None, None, None, None)] {{(pid=123596) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 19:35:55.757658 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-593064fe-eec1-4d23-8fc1-4a7a19d5ea13 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Flavor limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:35:55.758132 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-593064fe-eec1-4d23-8fc1-4a7a19d5ea13 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Image limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:35:55.758626 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-593064fe-eec1-4d23-8fc1-4a7a19d5ea13 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Flavor pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:35:55.759054 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-593064fe-eec1-4d23-8fc1-4a7a19d5ea13 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Image pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:35:55.759485 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-593064fe-eec1-4d23-8fc1-4a7a19d5ea13 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:35:55.768896 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-593064fe-eec1-4d23-8fc1-4a7a19d5ea13 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:35:55.769480 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-593064fe-eec1-4d23-8fc1-4a7a19d5ea13 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:35:55.769865 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-593064fe-eec1-4d23-8fc1-4a7a19d5ea13 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:35:55.770622 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-593064fe-eec1-4d23-8fc1-4a7a19d5ea13 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:35:55.771087 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-593064fe-eec1-4d23-8fc1-4a7a19d5ea13 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:35:55.771562 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-593064fe-eec1-4d23-8fc1-4a7a19d5ea13 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:35:55.789010 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-593064fe-eec1-4d23-8fc1-4a7a19d5ea13 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Getting quotas for project 0652fe65874b4606822aa7f261387bc8. Resources: {'ram', 'cores', 'instances'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:35:55.794816 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-593064fe-eec1-4d23-8fc1-4a7a19d5ea13 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Getting quotas for user 0f67ee6767314bfb9cc04ea9c0dafb4b and project 0652fe65874b4606822aa7f261387bc8. Resources: {'ram', 'cores', 'instances'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:35:55.807062 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-593064fe-eec1-4d23-8fc1-4a7a19d5ea13 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Going to run 1 instances... {{(pid=123596) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 19:35:55.810326 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-593064fe-eec1-4d23-8fc1-4a7a19d5ea13 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: c468edaa-bfd8-43c8-9a71-07a7d19b8a2b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e8943ec5-4038-4d4b-b9b9-2415a79f5243',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123596) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 19:35:55.854680 n-d-851028-13 devstack@n-api.service[123596]: ERROR oslo.messaging._drivers.impl_rabbit [None req-593064fe-eec1-4d23-8fc1-4a7a19d5ea13 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [6df3461f-a223-4d7a-9edf-e0d1ce49f6ad] AMQP server on 10.222.0.43:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 19:35:56.862940 n-d-851028-13 devstack@n-api.service[123596]: INFO oslo.messaging._drivers.impl_rabbit [None req-593064fe-eec1-4d23-8fc1-4a7a19d5ea13 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [6df3461f-a223-4d7a-9edf-e0d1ce49f6ad] Reconnected to AMQP server on 10.222.0.43:5672 via [amqp] client with port 47500. Oct 04 19:35:56.868174 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-593064fe-eec1-4d23-8fc1-4a7a19d5ea13 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.980481 Oct 04 19:35:56.869247 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3783/7197] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 19:35:54 2022] POST /compute/v2.1/servers => generated 406 bytes in 1982 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 19:35:56.880659 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-1f107a15-f433-4960-b8b7-11f2882f62bc tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:35:56.881315 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-1f107a15-f433-4960-b8b7-11f2882f62bc tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: c468edaa-bfd8-43c8-9a71-07a7d19b8a2b] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:35:56.937378 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-1f107a15-f433-4960-b8b7-11f2882f62bc tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f67ee6767314bfb9cc04ea9c0dafb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0652fe65874b4606822aa7f261387bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:35:56.945104 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-1f107a15-f433-4960-b8b7-11f2882f62bc tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "GET /compute/v2.1/servers/c468edaa-bfd8-43c8-9a71-07a7d19b8a2b" status: 200 len: 1239 microversion: 2.1 time: 0.068390 Oct 04 19:35:56.945862 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3415/7198] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:35:56 2022] GET /compute/v2.1/servers/c468edaa-bfd8-43c8-9a71-07a7d19b8a2b => generated 1239 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:35:57.969504 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-72fe8de6-4e9f-466e-a335-959d262cff7b tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:35:57.970418 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-72fe8de6-4e9f-466e-a335-959d262cff7b tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: c468edaa-bfd8-43c8-9a71-07a7d19b8a2b] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:35:57.977987 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-72fe8de6-4e9f-466e-a335-959d262cff7b tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:35:57.978576 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-72fe8de6-4e9f-466e-a335-959d262cff7b tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:35:57.979112 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-72fe8de6-4e9f-466e-a335-959d262cff7b tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:35:57.979838 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-72fe8de6-4e9f-466e-a335-959d262cff7b tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:35:57.980334 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-72fe8de6-4e9f-466e-a335-959d262cff7b tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:35:57.980788 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-72fe8de6-4e9f-466e-a335-959d262cff7b tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:35:58.043461 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-72fe8de6-4e9f-466e-a335-959d262cff7b tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f67ee6767314bfb9cc04ea9c0dafb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0652fe65874b4606822aa7f261387bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:35:58.051844 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-72fe8de6-4e9f-466e-a335-959d262cff7b tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "GET /compute/v2.1/servers/c468edaa-bfd8-43c8-9a71-07a7d19b8a2b" status: 200 len: 1297 microversion: 2.1 time: 0.087225 Oct 04 19:35:58.052429 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3784/7199] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:35:57 2022] GET /compute/v2.1/servers/c468edaa-bfd8-43c8-9a71-07a7d19b8a2b => generated 1297 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:35:59.077697 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-7ed50d68-5206-4970-86c8-3f5aa49f0243 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:35:59.078477 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-7ed50d68-5206-4970-86c8-3f5aa49f0243 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: c468edaa-bfd8-43c8-9a71-07a7d19b8a2b] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:35:59.085595 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7ed50d68-5206-4970-86c8-3f5aa49f0243 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:35:59.086102 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7ed50d68-5206-4970-86c8-3f5aa49f0243 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:35:59.086557 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7ed50d68-5206-4970-86c8-3f5aa49f0243 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:35:59.087283 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7ed50d68-5206-4970-86c8-3f5aa49f0243 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:35:59.087801 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7ed50d68-5206-4970-86c8-3f5aa49f0243 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:35:59.088639 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7ed50d68-5206-4970-86c8-3f5aa49f0243 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:35:59.273229 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-7ed50d68-5206-4970-86c8-3f5aa49f0243 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f67ee6767314bfb9cc04ea9c0dafb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0652fe65874b4606822aa7f261387bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:35:59.281508 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-7ed50d68-5206-4970-86c8-3f5aa49f0243 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "GET /compute/v2.1/servers/c468edaa-bfd8-43c8-9a71-07a7d19b8a2b" status: 200 len: 1365 microversion: 2.1 time: 0.208280 Oct 04 19:35:59.282091 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3416/7200] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:35:59 2022] GET /compute/v2.1/servers/c468edaa-bfd8-43c8-9a71-07a7d19b8a2b => generated 1365 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:35:59.316618 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-3f9af09f-8c77-4c59-93b8-48ceeeb0de73 req-773d4d1d-86ef-40f1-b3ec-93813eb8669a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c468edaa-bfd8-43c8-9a71-07a7d19b8a2b", "tag": "2d4f2693-925c-43ec-ad37-07c4f49bfab8"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:35:59.338487 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-3f9af09f-8c77-4c59-93b8-48ceeeb0de73 req-773d4d1d-86ef-40f1-b3ec-93813eb8669a service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:35:59.339308 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-3f9af09f-8c77-4c59-93b8-48ceeeb0de73 req-773d4d1d-86ef-40f1-b3ec-93813eb8669a service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:35:59.339758 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-3f9af09f-8c77-4c59-93b8-48ceeeb0de73 req-773d4d1d-86ef-40f1-b3ec-93813eb8669a service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:35:59.352264 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-3f9af09f-8c77-4c59-93b8-48ceeeb0de73 req-773d4d1d-86ef-40f1-b3ec-93813eb8669a service nova] Creating event network-changed:2d4f2693-925c-43ec-ad37-07c4f49bfab8 for instance c468edaa-bfd8-43c8-9a71-07a7d19b8a2b on n-h1-851028-13 Oct 04 19:35:59.357579 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-3f9af09f-8c77-4c59-93b8-48ceeeb0de73 req-773d4d1d-86ef-40f1-b3ec-93813eb8669a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045057 Oct 04 19:35:59.358184 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3785/7201] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:35:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:36:00.305492 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-447c7852-64d3-4a02-b0d4-e143ea7d10c3 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:36:00.306038 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-447c7852-64d3-4a02-b0d4-e143ea7d10c3 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: c468edaa-bfd8-43c8-9a71-07a7d19b8a2b] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:36:00.313583 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-447c7852-64d3-4a02-b0d4-e143ea7d10c3 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:00.314075 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-447c7852-64d3-4a02-b0d4-e143ea7d10c3 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:00.314549 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-447c7852-64d3-4a02-b0d4-e143ea7d10c3 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:00.315244 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-447c7852-64d3-4a02-b0d4-e143ea7d10c3 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:00.315703 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-447c7852-64d3-4a02-b0d4-e143ea7d10c3 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:00.316134 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-447c7852-64d3-4a02-b0d4-e143ea7d10c3 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:00.444361 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-447c7852-64d3-4a02-b0d4-e143ea7d10c3 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f67ee6767314bfb9cc04ea9c0dafb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0652fe65874b4606822aa7f261387bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:36:00.452295 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-447c7852-64d3-4a02-b0d4-e143ea7d10c3 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "GET /compute/v2.1/servers/c468edaa-bfd8-43c8-9a71-07a7d19b8a2b" status: 200 len: 1365 microversion: 2.1 time: 0.150860 Oct 04 19:36:00.452909 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3417/7202] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:36:00 2022] GET /compute/v2.1/servers/c468edaa-bfd8-43c8-9a71-07a7d19b8a2b => generated 1365 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:36:01.476400 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-70b54d4d-875b-4b7d-b043-362119063b0f tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:36:01.477148 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-70b54d4d-875b-4b7d-b043-362119063b0f tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: c468edaa-bfd8-43c8-9a71-07a7d19b8a2b] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:36:01.479965 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:36:01.486090 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-70b54d4d-875b-4b7d-b043-362119063b0f tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:01.486598 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-70b54d4d-875b-4b7d-b043-362119063b0f tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:01.487060 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-70b54d4d-875b-4b7d-b043-362119063b0f tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:01.487778 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-70b54d4d-875b-4b7d-b043-362119063b0f tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:01.488253 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-70b54d4d-875b-4b7d-b043-362119063b0f tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:01.488704 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-70b54d4d-875b-4b7d-b043-362119063b0f tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:01.619787 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-70b54d4d-875b-4b7d-b043-362119063b0f tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f67ee6767314bfb9cc04ea9c0dafb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0652fe65874b4606822aa7f261387bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:36:01.628238 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-70b54d4d-875b-4b7d-b043-362119063b0f tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "GET /compute/v2.1/servers/c468edaa-bfd8-43c8-9a71-07a7d19b8a2b" status: 200 len: 1365 microversion: 2.1 time: 0.156044 Oct 04 19:36:01.628819 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3786/7203] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:36:01 2022] GET /compute/v2.1/servers/c468edaa-bfd8-43c8-9a71-07a7d19b8a2b => generated 1365 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:36:02.651525 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-8a1337bb-ea1b-418a-8637-5ab4692eadd9 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:36:02.652158 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-8a1337bb-ea1b-418a-8637-5ab4692eadd9 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: c468edaa-bfd8-43c8-9a71-07a7d19b8a2b] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:36:02.655448 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_api:SELECT=47 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:36:02.662047 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8a1337bb-ea1b-418a-8637-5ab4692eadd9 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:02.662551 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8a1337bb-ea1b-418a-8637-5ab4692eadd9 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:02.663176 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8a1337bb-ea1b-418a-8637-5ab4692eadd9 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:02.663796 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8a1337bb-ea1b-418a-8637-5ab4692eadd9 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:02.664252 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8a1337bb-ea1b-418a-8637-5ab4692eadd9 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:02.664680 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8a1337bb-ea1b-418a-8637-5ab4692eadd9 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:02.805204 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-8a1337bb-ea1b-418a-8637-5ab4692eadd9 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f67ee6767314bfb9cc04ea9c0dafb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0652fe65874b4606822aa7f261387bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:36:02.813649 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-8a1337bb-ea1b-418a-8637-5ab4692eadd9 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "GET /compute/v2.1/servers/c468edaa-bfd8-43c8-9a71-07a7d19b8a2b" status: 200 len: 1365 microversion: 2.1 time: 0.166253 Oct 04 19:36:02.814223 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3418/7204] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:36:02 2022] GET /compute/v2.1/servers/c468edaa-bfd8-43c8-9a71-07a7d19b8a2b => generated 1365 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:36:03.838156 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-e2f5a9fe-6da1-46a4-8d07-30c4a4c6f715 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:36:03.838783 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-e2f5a9fe-6da1-46a4-8d07-30c4a4c6f715 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: c468edaa-bfd8-43c8-9a71-07a7d19b8a2b] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:36:03.846629 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e2f5a9fe-6da1-46a4-8d07-30c4a4c6f715 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:03.847127 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e2f5a9fe-6da1-46a4-8d07-30c4a4c6f715 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:03.847577 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e2f5a9fe-6da1-46a4-8d07-30c4a4c6f715 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:03.848278 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e2f5a9fe-6da1-46a4-8d07-30c4a4c6f715 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:03.848741 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e2f5a9fe-6da1-46a4-8d07-30c4a4c6f715 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:03.849203 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e2f5a9fe-6da1-46a4-8d07-30c4a4c6f715 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:03.979490 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-e2f5a9fe-6da1-46a4-8d07-30c4a4c6f715 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f67ee6767314bfb9cc04ea9c0dafb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0652fe65874b4606822aa7f261387bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:36:03.987259 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-e2f5a9fe-6da1-46a4-8d07-30c4a4c6f715 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "GET /compute/v2.1/servers/c468edaa-bfd8-43c8-9a71-07a7d19b8a2b" status: 200 len: 1365 microversion: 2.1 time: 0.152990 Oct 04 19:36:03.987836 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3787/7205] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:36:03 2022] GET /compute/v2.1/servers/c468edaa-bfd8-43c8-9a71-07a7d19b8a2b => generated 1365 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:36:04.300847 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-3836bf8a-247f-4232-9e55-4d3530b5c988 req-4d538a25-4c66-490d-bb11-2a47822e6e4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c468edaa-bfd8-43c8-9a71-07a7d19b8a2b", "name": "network-vif-plugged", "status": "completed", "tag": "2d4f2693-925c-43ec-ad37-07c4f49bfab8"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:36:04.313701 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-3836bf8a-247f-4232-9e55-4d3530b5c988 req-4d538a25-4c66-490d-bb11-2a47822e6e4a service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:04.314201 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-3836bf8a-247f-4232-9e55-4d3530b5c988 req-4d538a25-4c66-490d-bb11-2a47822e6e4a service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:04.314647 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-3836bf8a-247f-4232-9e55-4d3530b5c988 req-4d538a25-4c66-490d-bb11-2a47822e6e4a service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:04.326635 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-3836bf8a-247f-4232-9e55-4d3530b5c988 req-4d538a25-4c66-490d-bb11-2a47822e6e4a service nova] Creating event network-vif-plugged:2d4f2693-925c-43ec-ad37-07c4f49bfab8 for instance c468edaa-bfd8-43c8-9a71-07a7d19b8a2b on n-h1-851028-13 Oct 04 19:36:04.331763 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-3836bf8a-247f-4232-9e55-4d3530b5c988 req-4d538a25-4c66-490d-bb11-2a47822e6e4a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035042 Oct 04 19:36:04.332589 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3419/7206] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:36:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:36:05.010697 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-258f6685-47bb-40a4-b8bb-2e83217b58fb tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:36:05.011325 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-258f6685-47bb-40a4-b8bb-2e83217b58fb tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: c468edaa-bfd8-43c8-9a71-07a7d19b8a2b] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:36:05.018262 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-258f6685-47bb-40a4-b8bb-2e83217b58fb tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:05.018762 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-258f6685-47bb-40a4-b8bb-2e83217b58fb tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:05.019248 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-258f6685-47bb-40a4-b8bb-2e83217b58fb tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:05.020002 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-258f6685-47bb-40a4-b8bb-2e83217b58fb tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:05.020469 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-258f6685-47bb-40a4-b8bb-2e83217b58fb tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:05.020912 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-258f6685-47bb-40a4-b8bb-2e83217b58fb tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:05.152030 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-258f6685-47bb-40a4-b8bb-2e83217b58fb tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f67ee6767314bfb9cc04ea9c0dafb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0652fe65874b4606822aa7f261387bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:36:05.160348 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-258f6685-47bb-40a4-b8bb-2e83217b58fb tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "GET /compute/v2.1/servers/c468edaa-bfd8-43c8-9a71-07a7d19b8a2b" status: 200 len: 1365 microversion: 2.1 time: 0.153464 Oct 04 19:36:05.160934 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3788/7207] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:36:05 2022] GET /compute/v2.1/servers/c468edaa-bfd8-43c8-9a71-07a7d19b8a2b => generated 1365 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:36:06.185070 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-48c89002-ece3-4662-8474-22e040537004 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:36:06.185808 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-48c89002-ece3-4662-8474-22e040537004 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: c468edaa-bfd8-43c8-9a71-07a7d19b8a2b] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:36:06.194028 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-48c89002-ece3-4662-8474-22e040537004 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:06.194526 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-48c89002-ece3-4662-8474-22e040537004 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:06.194968 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-48c89002-ece3-4662-8474-22e040537004 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:06.195674 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-48c89002-ece3-4662-8474-22e040537004 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:06.196130 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-48c89002-ece3-4662-8474-22e040537004 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:06.196615 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-48c89002-ece3-4662-8474-22e040537004 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:06.330854 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-48c89002-ece3-4662-8474-22e040537004 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f67ee6767314bfb9cc04ea9c0dafb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0652fe65874b4606822aa7f261387bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:36:06.338677 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-48c89002-ece3-4662-8474-22e040537004 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "GET /compute/v2.1/servers/c468edaa-bfd8-43c8-9a71-07a7d19b8a2b" status: 200 len: 1552 microversion: 2.1 time: 0.158524 Oct 04 19:36:06.339242 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3420/7208] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:36:06 2022] GET /compute/v2.1/servers/c468edaa-bfd8-43c8-9a71-07a7d19b8a2b => generated 1552 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:36:06.363361 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-3426f8da-27d3-4be9-87b2-b289517e20cc tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:36:06.363907 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-3426f8da-27d3-4be9-87b2-b289517e20cc tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: c468edaa-bfd8-43c8-9a71-07a7d19b8a2b] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:36:06.365769 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=2 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:36:06.366565 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=6 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:36:06.373245 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3426f8da-27d3-4be9-87b2-b289517e20cc tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:06.373735 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3426f8da-27d3-4be9-87b2-b289517e20cc tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:06.374187 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3426f8da-27d3-4be9-87b2-b289517e20cc tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:06.374886 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3426f8da-27d3-4be9-87b2-b289517e20cc tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:06.375353 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3426f8da-27d3-4be9-87b2-b289517e20cc tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:06.375787 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3426f8da-27d3-4be9-87b2-b289517e20cc tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:06.452335 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-3426f8da-27d3-4be9-87b2-b289517e20cc tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "GET /compute/v2.1/servers/c468edaa-bfd8-43c8-9a71-07a7d19b8a2b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092927 Oct 04 19:36:06.452981 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3789/7209] 10.222.0.43 () {58 vars in 1275 bytes} [Tue Oct 4 19:36:06 2022] GET /compute/v2.1/servers/c468edaa-bfd8-43c8-9a71-07a7d19b8a2b/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:36:07.384235 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-dd262791-718b-4690-9b37-c4d032c13a31 req-f0dad15c-fe22-4c14-8b7d-19b9f63a0dd1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c468edaa-bfd8-43c8-9a71-07a7d19b8a2b", "tag": "2d4f2693-925c-43ec-ad37-07c4f49bfab8"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:36:07.389968 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=2 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:36:07.396441 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-dd262791-718b-4690-9b37-c4d032c13a31 req-f0dad15c-fe22-4c14-8b7d-19b9f63a0dd1 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:07.396928 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-dd262791-718b-4690-9b37-c4d032c13a31 req-f0dad15c-fe22-4c14-8b7d-19b9f63a0dd1 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:07.397399 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-dd262791-718b-4690-9b37-c4d032c13a31 req-f0dad15c-fe22-4c14-8b7d-19b9f63a0dd1 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:07.410607 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-dd262791-718b-4690-9b37-c4d032c13a31 req-f0dad15c-fe22-4c14-8b7d-19b9f63a0dd1 service nova] Creating event network-changed:2d4f2693-925c-43ec-ad37-07c4f49bfab8 for instance c468edaa-bfd8-43c8-9a71-07a7d19b8a2b on n-h1-851028-13 Oct 04 19:36:07.415727 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-dd262791-718b-4690-9b37-c4d032c13a31 req-f0dad15c-fe22-4c14-8b7d-19b9f63a0dd1 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035156 Oct 04 19:36:07.416340 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3421/7210] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:36:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:36:40.594603 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_api:SELECT=7 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:36:40.595526 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=45,nova_cell1:INSERT=1 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:36:40.596872 n-d-851028-13 devstack@n-api.service[123596]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 19:36:40.597030 n-d-851028-13 devstack@n-api.service[123596]: Tue Oct 4 19:36:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c468edaa-bfd8-43c8-9a71-07a7d19b8a2b/action (ip 10.222.0.43) !!! Oct 04 19:36:40.602321 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-db22ec06-7a0f-4bdb-84eb-524f0b0aafdc tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:36:40.604579 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-db22ec06-7a0f-4bdb-84eb-524f0b0aafdc tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: c468edaa-bfd8-43c8-9a71-07a7d19b8a2b] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:36:40.614930 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-db22ec06-7a0f-4bdb-84eb-524f0b0aafdc tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:40.615571 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-db22ec06-7a0f-4bdb-84eb-524f0b0aafdc tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:40.616073 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-db22ec06-7a0f-4bdb-84eb-524f0b0aafdc tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:40.616786 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-db22ec06-7a0f-4bdb-84eb-524f0b0aafdc tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:40.617278 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-db22ec06-7a0f-4bdb-84eb-524f0b0aafdc tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:40.617714 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-db22ec06-7a0f-4bdb-84eb-524f0b0aafdc tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:40.646268 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-db22ec06-7a0f-4bdb-84eb-524f0b0aafdc tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '0f67ee6767314bfb9cc04ea9c0dafb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0652fe65874b4606822aa7f261387bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:36:40.651630 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-db22ec06-7a0f-4bdb-84eb-524f0b0aafdc tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: c468edaa-bfd8-43c8-9a71-07a7d19b8a2b] Old instance type m1.heat2, new instance type m1.heat {{(pid=123596) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 04 19:36:40.658735 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-db22ec06-7a0f-4bdb-84eb-524f0b0aafdc tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Flavor limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:36:40.659167 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-db22ec06-7a0f-4bdb-84eb-524f0b0aafdc tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Image limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:36:40.659650 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-db22ec06-7a0f-4bdb-84eb-524f0b0aafdc tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Flavor pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:36:40.660076 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-db22ec06-7a0f-4bdb-84eb-524f0b0aafdc tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Image pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:36:40.660496 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-db22ec06-7a0f-4bdb-84eb-524f0b0aafdc tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:36:40.723944 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-db22ec06-7a0f-4bdb-84eb-524f0b0aafdc tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "POST /compute/v2.1/servers/c468edaa-bfd8-43c8-9a71-07a7d19b8a2b/action" status: 202 len: 0 microversion: 2.1 time: 0.131386 Oct 04 19:36:40.724756 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3790/7211] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 19:36:40 2022] POST /compute/v2.1/servers/c468edaa-bfd8-43c8-9a71-07a7d19b8a2b/action => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:36:40.731378 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_api:SELECT=7 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:36:40.732311 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=41 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:36:40.733394 n-d-851028-13 devstack@n-api.service[123595]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 19:36:40.733566 n-d-851028-13 devstack@n-api.service[123595]: Tue Oct 4 19:36:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c468edaa-bfd8-43c8-9a71-07a7d19b8a2b (ip 10.222.0.43) !!! Oct 04 19:36:40.738585 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-3674615c-d5d7-4ef3-8077-33feb456110b tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:36:40.739297 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-3674615c-d5d7-4ef3-8077-33feb456110b tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: c468edaa-bfd8-43c8-9a71-07a7d19b8a2b] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:36:40.748323 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3674615c-d5d7-4ef3-8077-33feb456110b tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:40.748899 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3674615c-d5d7-4ef3-8077-33feb456110b tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:40.749365 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3674615c-d5d7-4ef3-8077-33feb456110b tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:40.750184 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3674615c-d5d7-4ef3-8077-33feb456110b tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:40.750638 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3674615c-d5d7-4ef3-8077-33feb456110b tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:40.751067 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3674615c-d5d7-4ef3-8077-33feb456110b tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:40.885173 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-3674615c-d5d7-4ef3-8077-33feb456110b tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f67ee6767314bfb9cc04ea9c0dafb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0652fe65874b4606822aa7f261387bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:36:40.893562 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-3674615c-d5d7-4ef3-8077-33feb456110b tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "GET /compute/v2.1/servers/c468edaa-bfd8-43c8-9a71-07a7d19b8a2b" status: 200 len: 1679 microversion: 2.1 time: 0.164363 Oct 04 19:36:40.894238 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3422/7212] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:36:40 2022] GET /compute/v2.1/servers/c468edaa-bfd8-43c8-9a71-07a7d19b8a2b => generated 1679 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:36:41.917874 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-08952baf-eb21-4c3c-af4c-229891d6b4c2 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:36:41.918507 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-08952baf-eb21-4c3c-af4c-229891d6b4c2 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: c468edaa-bfd8-43c8-9a71-07a7d19b8a2b] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:36:41.925470 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-08952baf-eb21-4c3c-af4c-229891d6b4c2 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:41.925976 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-08952baf-eb21-4c3c-af4c-229891d6b4c2 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:41.926434 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-08952baf-eb21-4c3c-af4c-229891d6b4c2 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:41.927141 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-08952baf-eb21-4c3c-af4c-229891d6b4c2 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:41.927611 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-08952baf-eb21-4c3c-af4c-229891d6b4c2 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:41.928056 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-08952baf-eb21-4c3c-af4c-229891d6b4c2 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:42.076986 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-08952baf-eb21-4c3c-af4c-229891d6b4c2 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f67ee6767314bfb9cc04ea9c0dafb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0652fe65874b4606822aa7f261387bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:36:42.085363 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-08952baf-eb21-4c3c-af4c-229891d6b4c2 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "GET /compute/v2.1/servers/c468edaa-bfd8-43c8-9a71-07a7d19b8a2b" status: 200 len: 1679 microversion: 2.1 time: 0.172386 Oct 04 19:36:42.085946 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3791/7213] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:36:41 2022] GET /compute/v2.1/servers/c468edaa-bfd8-43c8-9a71-07a7d19b8a2b => generated 1679 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:36:43.108502 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-578f7f12-46c2-40ed-baef-706952f29694 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:36:43.109883 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-578f7f12-46c2-40ed-baef-706952f29694 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: c468edaa-bfd8-43c8-9a71-07a7d19b8a2b] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:36:43.116783 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-578f7f12-46c2-40ed-baef-706952f29694 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:43.117328 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-578f7f12-46c2-40ed-baef-706952f29694 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:43.117777 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-578f7f12-46c2-40ed-baef-706952f29694 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:43.118482 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-578f7f12-46c2-40ed-baef-706952f29694 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:43.118951 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-578f7f12-46c2-40ed-baef-706952f29694 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:43.119384 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-578f7f12-46c2-40ed-baef-706952f29694 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:43.246973 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-578f7f12-46c2-40ed-baef-706952f29694 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f67ee6767314bfb9cc04ea9c0dafb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0652fe65874b4606822aa7f261387bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:36:43.255142 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-578f7f12-46c2-40ed-baef-706952f29694 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "GET /compute/v2.1/servers/c468edaa-bfd8-43c8-9a71-07a7d19b8a2b" status: 200 len: 1684 microversion: 2.1 time: 0.150512 Oct 04 19:36:43.255731 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3423/7214] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:36:43 2022] GET /compute/v2.1/servers/c468edaa-bfd8-43c8-9a71-07a7d19b8a2b => generated 1684 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:36:44.279132 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-1b269de4-baa6-482c-8d86-f4b45eea47cd tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:36:44.279667 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-1b269de4-baa6-482c-8d86-f4b45eea47cd tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: c468edaa-bfd8-43c8-9a71-07a7d19b8a2b] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:36:44.286220 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1b269de4-baa6-482c-8d86-f4b45eea47cd tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:44.286727 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1b269de4-baa6-482c-8d86-f4b45eea47cd tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:44.287186 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1b269de4-baa6-482c-8d86-f4b45eea47cd tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:44.287899 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1b269de4-baa6-482c-8d86-f4b45eea47cd tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:44.288382 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1b269de4-baa6-482c-8d86-f4b45eea47cd tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:44.288831 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1b269de4-baa6-482c-8d86-f4b45eea47cd tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:44.419143 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-1b269de4-baa6-482c-8d86-f4b45eea47cd tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f67ee6767314bfb9cc04ea9c0dafb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0652fe65874b4606822aa7f261387bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:36:44.427164 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-1b269de4-baa6-482c-8d86-f4b45eea47cd tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "GET /compute/v2.1/servers/c468edaa-bfd8-43c8-9a71-07a7d19b8a2b" status: 200 len: 1684 microversion: 2.1 time: 0.152233 Oct 04 19:36:44.427754 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3792/7215] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:36:44 2022] GET /compute/v2.1/servers/c468edaa-bfd8-43c8-9a71-07a7d19b8a2b => generated 1684 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:36:45.452547 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-4d1b4750-9424-45ac-a395-f3e4fcb329fd tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:36:45.453190 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-4d1b4750-9424-45ac-a395-f3e4fcb329fd tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: c468edaa-bfd8-43c8-9a71-07a7d19b8a2b] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:36:45.460077 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4d1b4750-9424-45ac-a395-f3e4fcb329fd tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:45.460570 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4d1b4750-9424-45ac-a395-f3e4fcb329fd tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:45.461032 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4d1b4750-9424-45ac-a395-f3e4fcb329fd tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:45.461741 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4d1b4750-9424-45ac-a395-f3e4fcb329fd tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:45.462204 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4d1b4750-9424-45ac-a395-f3e4fcb329fd tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:45.462642 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4d1b4750-9424-45ac-a395-f3e4fcb329fd tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:45.595114 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-4d1b4750-9424-45ac-a395-f3e4fcb329fd tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f67ee6767314bfb9cc04ea9c0dafb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0652fe65874b4606822aa7f261387bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:36:45.602878 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-4d1b4750-9424-45ac-a395-f3e4fcb329fd tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "GET /compute/v2.1/servers/c468edaa-bfd8-43c8-9a71-07a7d19b8a2b" status: 200 len: 1684 microversion: 2.1 time: 0.154950 Oct 04 19:36:45.603442 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3424/7216] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:36:45 2022] GET /compute/v2.1/servers/c468edaa-bfd8-43c8-9a71-07a7d19b8a2b => generated 1684 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:36:46.625890 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-0746f5c4-18c2-42ce-8e87-71eb7e587dae tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:36:46.626521 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-0746f5c4-18c2-42ce-8e87-71eb7e587dae tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: c468edaa-bfd8-43c8-9a71-07a7d19b8a2b] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:36:46.632917 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0746f5c4-18c2-42ce-8e87-71eb7e587dae tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:46.633455 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0746f5c4-18c2-42ce-8e87-71eb7e587dae tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:46.633908 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0746f5c4-18c2-42ce-8e87-71eb7e587dae tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:46.634610 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0746f5c4-18c2-42ce-8e87-71eb7e587dae tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:46.635074 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0746f5c4-18c2-42ce-8e87-71eb7e587dae tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:46.635513 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0746f5c4-18c2-42ce-8e87-71eb7e587dae tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:46.767509 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-0746f5c4-18c2-42ce-8e87-71eb7e587dae tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f67ee6767314bfb9cc04ea9c0dafb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0652fe65874b4606822aa7f261387bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:36:46.775256 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-0746f5c4-18c2-42ce-8e87-71eb7e587dae tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "GET /compute/v2.1/servers/c468edaa-bfd8-43c8-9a71-07a7d19b8a2b" status: 200 len: 1684 microversion: 2.1 time: 0.153387 Oct 04 19:36:46.776170 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3793/7217] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:36:46 2022] GET /compute/v2.1/servers/c468edaa-bfd8-43c8-9a71-07a7d19b8a2b => generated 1684 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:36:47.800288 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-95228994-a766-4c0b-9935-03b1ae0650bb tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:36:47.800910 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-95228994-a766-4c0b-9935-03b1ae0650bb tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: c468edaa-bfd8-43c8-9a71-07a7d19b8a2b] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:36:47.807926 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-95228994-a766-4c0b-9935-03b1ae0650bb tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:47.808419 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-95228994-a766-4c0b-9935-03b1ae0650bb tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:47.808866 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-95228994-a766-4c0b-9935-03b1ae0650bb tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:47.810100 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-95228994-a766-4c0b-9935-03b1ae0650bb tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:47.810562 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-95228994-a766-4c0b-9935-03b1ae0650bb tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:47.811001 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-95228994-a766-4c0b-9935-03b1ae0650bb tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:47.940514 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-95228994-a766-4c0b-9935-03b1ae0650bb tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f67ee6767314bfb9cc04ea9c0dafb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0652fe65874b4606822aa7f261387bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:36:47.948407 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-95228994-a766-4c0b-9935-03b1ae0650bb tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "GET /compute/v2.1/servers/c468edaa-bfd8-43c8-9a71-07a7d19b8a2b" status: 200 len: 1684 microversion: 2.1 time: 0.152087 Oct 04 19:36:47.948975 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3425/7218] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:36:47 2022] GET /compute/v2.1/servers/c468edaa-bfd8-43c8-9a71-07a7d19b8a2b => generated 1684 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:36:48.972502 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-8613cfd6-4e73-4fdc-98cb-fa3740588350 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:36:48.973135 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-8613cfd6-4e73-4fdc-98cb-fa3740588350 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: c468edaa-bfd8-43c8-9a71-07a7d19b8a2b] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:36:48.980117 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8613cfd6-4e73-4fdc-98cb-fa3740588350 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:48.980616 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8613cfd6-4e73-4fdc-98cb-fa3740588350 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:48.981134 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8613cfd6-4e73-4fdc-98cb-fa3740588350 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:48.981844 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8613cfd6-4e73-4fdc-98cb-fa3740588350 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:48.982311 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8613cfd6-4e73-4fdc-98cb-fa3740588350 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:48.982748 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8613cfd6-4e73-4fdc-98cb-fa3740588350 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:49.116661 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-8613cfd6-4e73-4fdc-98cb-fa3740588350 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f67ee6767314bfb9cc04ea9c0dafb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0652fe65874b4606822aa7f261387bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:36:49.127138 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-8613cfd6-4e73-4fdc-98cb-fa3740588350 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "GET /compute/v2.1/servers/c468edaa-bfd8-43c8-9a71-07a7d19b8a2b" status: 200 len: 1684 microversion: 2.1 time: 0.158500 Oct 04 19:36:49.127713 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3794/7219] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:36:48 2022] GET /compute/v2.1/servers/c468edaa-bfd8-43c8-9a71-07a7d19b8a2b => generated 1684 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:36:50.150135 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-ba4c4e5d-f57e-4e17-8afe-e980d128200d tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:36:50.150752 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-ba4c4e5d-f57e-4e17-8afe-e980d128200d tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: c468edaa-bfd8-43c8-9a71-07a7d19b8a2b] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:36:50.158452 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ba4c4e5d-f57e-4e17-8afe-e980d128200d tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:50.158944 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ba4c4e5d-f57e-4e17-8afe-e980d128200d tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:50.159398 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ba4c4e5d-f57e-4e17-8afe-e980d128200d tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:50.160099 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ba4c4e5d-f57e-4e17-8afe-e980d128200d tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:50.160563 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ba4c4e5d-f57e-4e17-8afe-e980d128200d tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:50.161001 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ba4c4e5d-f57e-4e17-8afe-e980d128200d tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:50.296723 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-ba4c4e5d-f57e-4e17-8afe-e980d128200d tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f67ee6767314bfb9cc04ea9c0dafb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0652fe65874b4606822aa7f261387bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:36:50.307109 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-ba4c4e5d-f57e-4e17-8afe-e980d128200d tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "GET /compute/v2.1/servers/c468edaa-bfd8-43c8-9a71-07a7d19b8a2b" status: 200 len: 1684 microversion: 2.1 time: 0.161070 Oct 04 19:36:50.307617 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3426/7220] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:36:50 2022] GET /compute/v2.1/servers/c468edaa-bfd8-43c8-9a71-07a7d19b8a2b => generated 1684 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:36:51.329991 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-a0f70e0e-1662-4f5c-9153-51663cbc18a5 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:36:51.330746 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-a0f70e0e-1662-4f5c-9153-51663cbc18a5 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: c468edaa-bfd8-43c8-9a71-07a7d19b8a2b] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:36:51.337772 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a0f70e0e-1662-4f5c-9153-51663cbc18a5 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:51.338356 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a0f70e0e-1662-4f5c-9153-51663cbc18a5 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:51.338842 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a0f70e0e-1662-4f5c-9153-51663cbc18a5 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:51.339574 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a0f70e0e-1662-4f5c-9153-51663cbc18a5 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:51.340611 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a0f70e0e-1662-4f5c-9153-51663cbc18a5 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:51.341504 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a0f70e0e-1662-4f5c-9153-51663cbc18a5 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:51.477198 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-a0f70e0e-1662-4f5c-9153-51663cbc18a5 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f67ee6767314bfb9cc04ea9c0dafb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0652fe65874b4606822aa7f261387bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:36:51.485772 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-a0f70e0e-1662-4f5c-9153-51663cbc18a5 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "GET /compute/v2.1/servers/c468edaa-bfd8-43c8-9a71-07a7d19b8a2b" status: 200 len: 1684 microversion: 2.1 time: 0.159591 Oct 04 19:36:51.486351 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3795/7221] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:36:51 2022] GET /compute/v2.1/servers/c468edaa-bfd8-43c8-9a71-07a7d19b8a2b => generated 1684 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:36:52.508779 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-8f9947cf-cd85-4155-8624-ae010778b358 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:36:52.509421 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-8f9947cf-cd85-4155-8624-ae010778b358 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: c468edaa-bfd8-43c8-9a71-07a7d19b8a2b] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:36:52.516550 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8f9947cf-cd85-4155-8624-ae010778b358 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:52.517046 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8f9947cf-cd85-4155-8624-ae010778b358 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:52.517524 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8f9947cf-cd85-4155-8624-ae010778b358 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:52.518232 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8f9947cf-cd85-4155-8624-ae010778b358 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:52.518698 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8f9947cf-cd85-4155-8624-ae010778b358 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:52.519139 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8f9947cf-cd85-4155-8624-ae010778b358 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:52.650226 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-8f9947cf-cd85-4155-8624-ae010778b358 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f67ee6767314bfb9cc04ea9c0dafb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0652fe65874b4606822aa7f261387bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:36:52.658089 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-8f9947cf-cd85-4155-8624-ae010778b358 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "GET /compute/v2.1/servers/c468edaa-bfd8-43c8-9a71-07a7d19b8a2b" status: 200 len: 1684 microversion: 2.1 time: 0.153252 Oct 04 19:36:52.658675 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3427/7222] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:36:52 2022] GET /compute/v2.1/servers/c468edaa-bfd8-43c8-9a71-07a7d19b8a2b => generated 1684 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:36:53.681942 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-07b7f5cb-0d9b-4a08-b50f-c3a85346798b tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:36:53.682573 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-07b7f5cb-0d9b-4a08-b50f-c3a85346798b tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: c468edaa-bfd8-43c8-9a71-07a7d19b8a2b] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:36:53.689531 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-07b7f5cb-0d9b-4a08-b50f-c3a85346798b tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:53.690036 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-07b7f5cb-0d9b-4a08-b50f-c3a85346798b tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:53.690490 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-07b7f5cb-0d9b-4a08-b50f-c3a85346798b tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:53.691201 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-07b7f5cb-0d9b-4a08-b50f-c3a85346798b tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:53.691667 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-07b7f5cb-0d9b-4a08-b50f-c3a85346798b tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:53.692112 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-07b7f5cb-0d9b-4a08-b50f-c3a85346798b tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:53.821026 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-07b7f5cb-0d9b-4a08-b50f-c3a85346798b tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f67ee6767314bfb9cc04ea9c0dafb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0652fe65874b4606822aa7f261387bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:36:53.828797 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-07b7f5cb-0d9b-4a08-b50f-c3a85346798b tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "GET /compute/v2.1/servers/c468edaa-bfd8-43c8-9a71-07a7d19b8a2b" status: 200 len: 1684 microversion: 2.1 time: 0.150772 Oct 04 19:36:53.829411 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3796/7223] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:36:53 2022] GET /compute/v2.1/servers/c468edaa-bfd8-43c8-9a71-07a7d19b8a2b => generated 1684 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:36:54.853471 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-fe8a216c-d564-43fb-8aa6-320eed66ec97 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:36:54.854092 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-fe8a216c-d564-43fb-8aa6-320eed66ec97 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: c468edaa-bfd8-43c8-9a71-07a7d19b8a2b] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:36:54.861521 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fe8a216c-d564-43fb-8aa6-320eed66ec97 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:54.862014 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fe8a216c-d564-43fb-8aa6-320eed66ec97 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:54.862450 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fe8a216c-d564-43fb-8aa6-320eed66ec97 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:54.863153 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fe8a216c-d564-43fb-8aa6-320eed66ec97 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:54.863610 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fe8a216c-d564-43fb-8aa6-320eed66ec97 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:54.864041 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fe8a216c-d564-43fb-8aa6-320eed66ec97 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:54.948193 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-47cbada6-186b-4efb-abe9-bea7e64b44d5 req-174ef3aa-302e-4b97-8497-707a5be87535 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c468edaa-bfd8-43c8-9a71-07a7d19b8a2b", "name": "network-vif-unplugged", "status": "completed", "tag": "2d4f2693-925c-43ec-ad37-07c4f49bfab8"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:36:54.962109 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-47cbada6-186b-4efb-abe9-bea7e64b44d5 req-174ef3aa-302e-4b97-8497-707a5be87535 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:54.962614 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-47cbada6-186b-4efb-abe9-bea7e64b44d5 req-174ef3aa-302e-4b97-8497-707a5be87535 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:54.963064 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-47cbada6-186b-4efb-abe9-bea7e64b44d5 req-174ef3aa-302e-4b97-8497-707a5be87535 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:54.976380 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-47cbada6-186b-4efb-abe9-bea7e64b44d5 req-174ef3aa-302e-4b97-8497-707a5be87535 service nova] Creating event network-vif-unplugged:2d4f2693-925c-43ec-ad37-07c4f49bfab8 for instance c468edaa-bfd8-43c8-9a71-07a7d19b8a2b on n-h2-851028-13 Oct 04 19:36:54.982052 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [req-47cbada6-186b-4efb-abe9-bea7e64b44d5 req-174ef3aa-302e-4b97-8497-707a5be87535 service nova] Instance c468edaa-bfd8-43c8-9a71-07a7d19b8a2b is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851028-13', 'n-h2-851028-13'} {{(pid=123596) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 19:36:54.993288 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-47cbada6-186b-4efb-abe9-bea7e64b44d5 req-174ef3aa-302e-4b97-8497-707a5be87535 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048994 Oct 04 19:36:54.993908 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3797/7224] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:36:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:36:55.011490 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-fe8a216c-d564-43fb-8aa6-320eed66ec97 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f67ee6767314bfb9cc04ea9c0dafb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0652fe65874b4606822aa7f261387bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:36:55.020296 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-fe8a216c-d564-43fb-8aa6-320eed66ec97 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "GET /compute/v2.1/servers/c468edaa-bfd8-43c8-9a71-07a7d19b8a2b" status: 200 len: 1683 microversion: 2.1 time: 0.170778 Oct 04 19:36:55.020877 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3428/7225] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:36:54 2022] GET /compute/v2.1/servers/c468edaa-bfd8-43c8-9a71-07a7d19b8a2b => generated 1683 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:36:56.045263 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-b5ebaa21-0987-4d08-a87e-5b8ec993e290 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:36:56.046028 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-b5ebaa21-0987-4d08-a87e-5b8ec993e290 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: c468edaa-bfd8-43c8-9a71-07a7d19b8a2b] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:36:56.052327 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b5ebaa21-0987-4d08-a87e-5b8ec993e290 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:56.052825 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b5ebaa21-0987-4d08-a87e-5b8ec993e290 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:56.053311 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b5ebaa21-0987-4d08-a87e-5b8ec993e290 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:56.054025 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b5ebaa21-0987-4d08-a87e-5b8ec993e290 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:56.054493 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b5ebaa21-0987-4d08-a87e-5b8ec993e290 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:56.054938 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b5ebaa21-0987-4d08-a87e-5b8ec993e290 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:56.190925 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-b5ebaa21-0987-4d08-a87e-5b8ec993e290 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f67ee6767314bfb9cc04ea9c0dafb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0652fe65874b4606822aa7f261387bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:36:56.198840 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-b5ebaa21-0987-4d08-a87e-5b8ec993e290 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "GET /compute/v2.1/servers/c468edaa-bfd8-43c8-9a71-07a7d19b8a2b" status: 200 len: 1681 microversion: 2.1 time: 0.158615 Oct 04 19:36:56.199910 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3798/7226] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:36:56 2022] GET /compute/v2.1/servers/c468edaa-bfd8-43c8-9a71-07a7d19b8a2b => generated 1681 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:36:57.036028 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-6402b286-0f3d-4d6e-adcc-cdfffb5a53c1 req-4f51486a-4e18-4b88-9819-0fc86172689e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c468edaa-bfd8-43c8-9a71-07a7d19b8a2b", "tag": "2d4f2693-925c-43ec-ad37-07c4f49bfab8"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:36:57.047651 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-6402b286-0f3d-4d6e-adcc-cdfffb5a53c1 req-4f51486a-4e18-4b88-9819-0fc86172689e service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:57.048180 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-6402b286-0f3d-4d6e-adcc-cdfffb5a53c1 req-4f51486a-4e18-4b88-9819-0fc86172689e service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:57.049030 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-6402b286-0f3d-4d6e-adcc-cdfffb5a53c1 req-4f51486a-4e18-4b88-9819-0fc86172689e service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:57.062097 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-6402b286-0f3d-4d6e-adcc-cdfffb5a53c1 req-4f51486a-4e18-4b88-9819-0fc86172689e service nova] Creating event network-changed:2d4f2693-925c-43ec-ad37-07c4f49bfab8 for instance c468edaa-bfd8-43c8-9a71-07a7d19b8a2b on n-h2-851028-13 Oct 04 19:36:57.067984 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [req-6402b286-0f3d-4d6e-adcc-cdfffb5a53c1 req-4f51486a-4e18-4b88-9819-0fc86172689e service nova] Instance c468edaa-bfd8-43c8-9a71-07a7d19b8a2b is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851028-13', 'n-h2-851028-13'} {{(pid=123595) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 19:36:57.078881 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-6402b286-0f3d-4d6e-adcc-cdfffb5a53c1 req-4f51486a-4e18-4b88-9819-0fc86172689e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047045 Oct 04 19:36:57.079531 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3429/7227] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:36:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:36:57.225973 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-73b579c0-478b-499c-bb50-33f80dad9166 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:36:57.227032 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-73b579c0-478b-499c-bb50-33f80dad9166 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: c468edaa-bfd8-43c8-9a71-07a7d19b8a2b] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:36:57.234924 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-73b579c0-478b-499c-bb50-33f80dad9166 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:57.235593 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-73b579c0-478b-499c-bb50-33f80dad9166 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:57.236161 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-73b579c0-478b-499c-bb50-33f80dad9166 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:57.237277 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-73b579c0-478b-499c-bb50-33f80dad9166 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:57.237988 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-73b579c0-478b-499c-bb50-33f80dad9166 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:57.238654 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-73b579c0-478b-499c-bb50-33f80dad9166 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:57.431882 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-73b579c0-478b-499c-bb50-33f80dad9166 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f67ee6767314bfb9cc04ea9c0dafb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0652fe65874b4606822aa7f261387bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:36:57.442048 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-73b579c0-478b-499c-bb50-33f80dad9166 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "GET /compute/v2.1/servers/c468edaa-bfd8-43c8-9a71-07a7d19b8a2b" status: 200 len: 1681 microversion: 2.1 time: 0.220110 Oct 04 19:36:57.442653 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3799/7228] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:36:57 2022] GET /compute/v2.1/servers/c468edaa-bfd8-43c8-9a71-07a7d19b8a2b => generated 1681 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:36:58.466639 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-535b58cc-1e30-4cb9-bbd9-e69c36cd1f6a tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:36:58.467352 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-535b58cc-1e30-4cb9-bbd9-e69c36cd1f6a tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: c468edaa-bfd8-43c8-9a71-07a7d19b8a2b] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:36:58.474373 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-535b58cc-1e30-4cb9-bbd9-e69c36cd1f6a tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:58.474912 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-535b58cc-1e30-4cb9-bbd9-e69c36cd1f6a tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:58.475361 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-535b58cc-1e30-4cb9-bbd9-e69c36cd1f6a tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:58.476067 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-535b58cc-1e30-4cb9-bbd9-e69c36cd1f6a tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:58.476537 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-535b58cc-1e30-4cb9-bbd9-e69c36cd1f6a tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:58.476978 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-535b58cc-1e30-4cb9-bbd9-e69c36cd1f6a tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:58.610916 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-535b58cc-1e30-4cb9-bbd9-e69c36cd1f6a tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f67ee6767314bfb9cc04ea9c0dafb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0652fe65874b4606822aa7f261387bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:36:58.618972 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-535b58cc-1e30-4cb9-bbd9-e69c36cd1f6a tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "GET /compute/v2.1/servers/c468edaa-bfd8-43c8-9a71-07a7d19b8a2b" status: 200 len: 1678 microversion: 2.1 time: 0.157853 Oct 04 19:36:58.619558 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3430/7229] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:36:58 2022] GET /compute/v2.1/servers/c468edaa-bfd8-43c8-9a71-07a7d19b8a2b => generated 1678 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:36:58.642070 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-71687c44-5cb7-4ae4-8793-0e2155332b39 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:36:58.642638 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-71687c44-5cb7-4ae4-8793-0e2155332b39 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: c468edaa-bfd8-43c8-9a71-07a7d19b8a2b] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:36:58.649836 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-71687c44-5cb7-4ae4-8793-0e2155332b39 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:58.650351 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-71687c44-5cb7-4ae4-8793-0e2155332b39 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:58.650816 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-71687c44-5cb7-4ae4-8793-0e2155332b39 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:58.651538 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-71687c44-5cb7-4ae4-8793-0e2155332b39 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:58.652015 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-71687c44-5cb7-4ae4-8793-0e2155332b39 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:58.652551 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-71687c44-5cb7-4ae4-8793-0e2155332b39 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:58.693840 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-71687c44-5cb7-4ae4-8793-0e2155332b39 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:58.694769 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-71687c44-5cb7-4ae4-8793-0e2155332b39 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:58.694769 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-71687c44-5cb7-4ae4-8793-0e2155332b39 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:58.695532 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-71687c44-5cb7-4ae4-8793-0e2155332b39 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:58.696005 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-71687c44-5cb7-4ae4-8793-0e2155332b39 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:58.696454 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-71687c44-5cb7-4ae4-8793-0e2155332b39 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:58.717315 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-71687c44-5cb7-4ae4-8793-0e2155332b39 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Getting quotas for project 0652fe65874b4606822aa7f261387bc8. Resources: {'ram', 'cores'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:36:58.722507 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-71687c44-5cb7-4ae4-8793-0e2155332b39 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Getting quotas for user 0f67ee6767314bfb9cc04ea9c0dafb4b and project 0652fe65874b4606822aa7f261387bc8. Resources: {'ram', 'cores'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:36:58.825288 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-71687c44-5cb7-4ae4-8793-0e2155332b39 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "POST /compute/v2.1/servers/c468edaa-bfd8-43c8-9a71-07a7d19b8a2b/action" status: 202 len: 0 microversion: 2.1 time: 0.186970 Oct 04 19:36:58.825893 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3800/7230] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 19:36:58 2022] POST /compute/v2.1/servers/c468edaa-bfd8-43c8-9a71-07a7d19b8a2b/action => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:36:58.834298 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-2ed0b3d2-ab3b-4d6b-8a09-859b2a2e5a3a tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:36:58.834909 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-2ed0b3d2-ab3b-4d6b-8a09-859b2a2e5a3a tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: c468edaa-bfd8-43c8-9a71-07a7d19b8a2b] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:36:58.841690 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2ed0b3d2-ab3b-4d6b-8a09-859b2a2e5a3a tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:58.842202 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2ed0b3d2-ab3b-4d6b-8a09-859b2a2e5a3a tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:58.842634 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2ed0b3d2-ab3b-4d6b-8a09-859b2a2e5a3a tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:58.843331 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2ed0b3d2-ab3b-4d6b-8a09-859b2a2e5a3a tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:58.843974 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2ed0b3d2-ab3b-4d6b-8a09-859b2a2e5a3a tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:58.844432 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2ed0b3d2-ab3b-4d6b-8a09-859b2a2e5a3a tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:58.995219 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-2ed0b3d2-ab3b-4d6b-8a09-859b2a2e5a3a tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f67ee6767314bfb9cc04ea9c0dafb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0652fe65874b4606822aa7f261387bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:36:59.004044 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-2ed0b3d2-ab3b-4d6b-8a09-859b2a2e5a3a tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "GET /compute/v2.1/servers/c468edaa-bfd8-43c8-9a71-07a7d19b8a2b" status: 200 len: 1677 microversion: 2.1 time: 0.173731 Oct 04 19:36:59.004889 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3431/7231] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:36:58 2022] GET /compute/v2.1/servers/c468edaa-bfd8-43c8-9a71-07a7d19b8a2b => generated 1677 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:37:00.029189 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-7e360398-433e-4c1b-99a4-c45d2cf65c11 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:37:00.029940 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-7e360398-433e-4c1b-99a4-c45d2cf65c11 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: c468edaa-bfd8-43c8-9a71-07a7d19b8a2b] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:37:00.036272 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7e360398-433e-4c1b-99a4-c45d2cf65c11 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:37:00.036778 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7e360398-433e-4c1b-99a4-c45d2cf65c11 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:37:00.037275 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7e360398-433e-4c1b-99a4-c45d2cf65c11 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:37:00.037986 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7e360398-433e-4c1b-99a4-c45d2cf65c11 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:37:00.038456 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7e360398-433e-4c1b-99a4-c45d2cf65c11 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:37:00.038901 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7e360398-433e-4c1b-99a4-c45d2cf65c11 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:37:00.169036 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-7e360398-433e-4c1b-99a4-c45d2cf65c11 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f67ee6767314bfb9cc04ea9c0dafb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0652fe65874b4606822aa7f261387bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:37:00.176901 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-7e360398-433e-4c1b-99a4-c45d2cf65c11 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "GET /compute/v2.1/servers/c468edaa-bfd8-43c8-9a71-07a7d19b8a2b" status: 200 len: 1677 microversion: 2.1 time: 0.153515 Oct 04 19:37:00.177511 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3801/7232] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:37:00 2022] GET /compute/v2.1/servers/c468edaa-bfd8-43c8-9a71-07a7d19b8a2b => generated 1677 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:37:00.680732 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-35484fb6-5ec7-435f-9680-5deace6512e5 req-1ab4d32b-8494-417a-bffe-9ee2d2357ea2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c468edaa-bfd8-43c8-9a71-07a7d19b8a2b", "name": "network-vif-plugged", "status": "completed", "tag": "2d4f2693-925c-43ec-ad37-07c4f49bfab8"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:37:00.691727 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-35484fb6-5ec7-435f-9680-5deace6512e5 req-1ab4d32b-8494-417a-bffe-9ee2d2357ea2 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:37:00.692225 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-35484fb6-5ec7-435f-9680-5deace6512e5 req-1ab4d32b-8494-417a-bffe-9ee2d2357ea2 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:37:00.692671 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-35484fb6-5ec7-435f-9680-5deace6512e5 req-1ab4d32b-8494-417a-bffe-9ee2d2357ea2 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:37:00.705341 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-35484fb6-5ec7-435f-9680-5deace6512e5 req-1ab4d32b-8494-417a-bffe-9ee2d2357ea2 service nova] Creating event network-vif-plugged:2d4f2693-925c-43ec-ad37-07c4f49bfab8 for instance c468edaa-bfd8-43c8-9a71-07a7d19b8a2b on n-h2-851028-13 Oct 04 19:37:00.710939 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [req-35484fb6-5ec7-435f-9680-5deace6512e5 req-1ab4d32b-8494-417a-bffe-9ee2d2357ea2 service nova] Instance c468edaa-bfd8-43c8-9a71-07a7d19b8a2b is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851028-13', 'n-h2-851028-13'} {{(pid=123595) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 19:37:00.722878 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-35484fb6-5ec7-435f-9680-5deace6512e5 req-1ab4d32b-8494-417a-bffe-9ee2d2357ea2 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045898 Oct 04 19:37:00.723690 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3432/7233] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:37:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:37:01.200098 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-d2192752-dc3a-491d-a7bc-4bb1fada30cb tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:37:01.200638 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-d2192752-dc3a-491d-a7bc-4bb1fada30cb tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: c468edaa-bfd8-43c8-9a71-07a7d19b8a2b] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:37:01.209043 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d2192752-dc3a-491d-a7bc-4bb1fada30cb tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:37:01.209608 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d2192752-dc3a-491d-a7bc-4bb1fada30cb tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:37:01.210071 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d2192752-dc3a-491d-a7bc-4bb1fada30cb tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:37:01.210791 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d2192752-dc3a-491d-a7bc-4bb1fada30cb tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:37:01.211268 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d2192752-dc3a-491d-a7bc-4bb1fada30cb tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:37:01.211714 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d2192752-dc3a-491d-a7bc-4bb1fada30cb tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:37:01.230011 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:37:01.362743 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-d2192752-dc3a-491d-a7bc-4bb1fada30cb tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f67ee6767314bfb9cc04ea9c0dafb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0652fe65874b4606822aa7f261387bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:37:01.372354 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-d2192752-dc3a-491d-a7bc-4bb1fada30cb tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "GET /compute/v2.1/servers/c468edaa-bfd8-43c8-9a71-07a7d19b8a2b" status: 200 len: 1677 microversion: 2.1 time: 0.176491 Oct 04 19:37:01.373185 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3802/7234] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:37:01 2022] GET /compute/v2.1/servers/c468edaa-bfd8-43c8-9a71-07a7d19b8a2b => generated 1677 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:37:01.817516 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-e1d5dd7e-0271-45c2-846a-4f4c127d41b8 req-c5d65140-bfc1-4da0-b34c-606b7bf194f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c468edaa-bfd8-43c8-9a71-07a7d19b8a2b", "name": "network-vif-unplugged", "status": "completed", "tag": "2d4f2693-925c-43ec-ad37-07c4f49bfab8"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:37:01.828016 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-e1d5dd7e-0271-45c2-846a-4f4c127d41b8 req-c5d65140-bfc1-4da0-b34c-606b7bf194f7 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:37:01.828503 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-e1d5dd7e-0271-45c2-846a-4f4c127d41b8 req-c5d65140-bfc1-4da0-b34c-606b7bf194f7 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:37:01.829150 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-e1d5dd7e-0271-45c2-846a-4f4c127d41b8 req-c5d65140-bfc1-4da0-b34c-606b7bf194f7 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:37:01.844311 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-e1d5dd7e-0271-45c2-846a-4f4c127d41b8 req-c5d65140-bfc1-4da0-b34c-606b7bf194f7 service nova] Creating event network-vif-unplugged:2d4f2693-925c-43ec-ad37-07c4f49bfab8 for instance c468edaa-bfd8-43c8-9a71-07a7d19b8a2b on n-h1-851028-13 Oct 04 19:37:01.849901 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [req-e1d5dd7e-0271-45c2-846a-4f4c127d41b8 req-c5d65140-bfc1-4da0-b34c-606b7bf194f7 service nova] Instance c468edaa-bfd8-43c8-9a71-07a7d19b8a2b is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851028-13', 'n-h2-851028-13'} {{(pid=123595) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 19:37:01.861517 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-e1d5dd7e-0271-45c2-846a-4f4c127d41b8 req-c5d65140-bfc1-4da0-b34c-606b7bf194f7 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049200 Oct 04 19:37:01.862310 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3433/7235] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:37:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:37:02.396839 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-893a5d38-195a-4670-abc2-bf247a37f7ee tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:37:02.397506 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-893a5d38-195a-4670-abc2-bf247a37f7ee tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: c468edaa-bfd8-43c8-9a71-07a7d19b8a2b] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:37:02.405010 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-893a5d38-195a-4670-abc2-bf247a37f7ee tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:37:02.405548 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-893a5d38-195a-4670-abc2-bf247a37f7ee tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:37:02.406015 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-893a5d38-195a-4670-abc2-bf247a37f7ee tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:37:02.406738 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-893a5d38-195a-4670-abc2-bf247a37f7ee tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:37:02.407217 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-893a5d38-195a-4670-abc2-bf247a37f7ee tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:37:02.407670 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-893a5d38-195a-4670-abc2-bf247a37f7ee tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:37:02.537046 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-893a5d38-195a-4670-abc2-bf247a37f7ee tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f67ee6767314bfb9cc04ea9c0dafb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0652fe65874b4606822aa7f261387bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:37:02.544874 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-893a5d38-195a-4670-abc2-bf247a37f7ee tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "GET /compute/v2.1/servers/c468edaa-bfd8-43c8-9a71-07a7d19b8a2b" status: 200 len: 1677 microversion: 2.1 time: 0.151968 Oct 04 19:37:02.545478 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3803/7236] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:37:02 2022] GET /compute/v2.1/servers/c468edaa-bfd8-43c8-9a71-07a7d19b8a2b => generated 1677 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:37:03.569760 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-d2c6cf1d-cf3a-47cd-88de-4577a713bd11 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:37:03.570386 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-d2c6cf1d-cf3a-47cd-88de-4577a713bd11 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: c468edaa-bfd8-43c8-9a71-07a7d19b8a2b] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:37:03.576526 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d2c6cf1d-cf3a-47cd-88de-4577a713bd11 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:37:03.577010 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d2c6cf1d-cf3a-47cd-88de-4577a713bd11 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:37:03.577474 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d2c6cf1d-cf3a-47cd-88de-4577a713bd11 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:37:03.578157 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d2c6cf1d-cf3a-47cd-88de-4577a713bd11 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:37:03.578608 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d2c6cf1d-cf3a-47cd-88de-4577a713bd11 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:37:03.579032 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d2c6cf1d-cf3a-47cd-88de-4577a713bd11 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:37:03.706406 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-d2c6cf1d-cf3a-47cd-88de-4577a713bd11 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f67ee6767314bfb9cc04ea9c0dafb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0652fe65874b4606822aa7f261387bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:37:03.714157 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-d2c6cf1d-cf3a-47cd-88de-4577a713bd11 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "GET /compute/v2.1/servers/c468edaa-bfd8-43c8-9a71-07a7d19b8a2b" status: 200 len: 1677 microversion: 2.1 time: 0.149678 Oct 04 19:37:03.715358 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3434/7237] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:37:03 2022] GET /compute/v2.1/servers/c468edaa-bfd8-43c8-9a71-07a7d19b8a2b => generated 1677 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:37:03.896932 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-43c501c3-1983-411e-a28f-f3a608cfd68d req-25da58eb-8a7f-4d1c-80c5-39ea135f52f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c468edaa-bfd8-43c8-9a71-07a7d19b8a2b", "tag": "2d4f2693-925c-43ec-ad37-07c4f49bfab8"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:37:03.907763 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-43c501c3-1983-411e-a28f-f3a608cfd68d req-25da58eb-8a7f-4d1c-80c5-39ea135f52f0 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:37:03.908249 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-43c501c3-1983-411e-a28f-f3a608cfd68d req-25da58eb-8a7f-4d1c-80c5-39ea135f52f0 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:37:03.908688 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-43c501c3-1983-411e-a28f-f3a608cfd68d req-25da58eb-8a7f-4d1c-80c5-39ea135f52f0 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:37:03.919950 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-43c501c3-1983-411e-a28f-f3a608cfd68d req-25da58eb-8a7f-4d1c-80c5-39ea135f52f0 service nova] Creating event network-changed:2d4f2693-925c-43ec-ad37-07c4f49bfab8 for instance c468edaa-bfd8-43c8-9a71-07a7d19b8a2b on n-h1-851028-13 Oct 04 19:37:03.925136 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [req-43c501c3-1983-411e-a28f-f3a608cfd68d req-25da58eb-8a7f-4d1c-80c5-39ea135f52f0 service nova] Instance c468edaa-bfd8-43c8-9a71-07a7d19b8a2b is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851028-13', 'n-h2-851028-13'} {{(pid=123596) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 19:37:03.935782 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-43c501c3-1983-411e-a28f-f3a608cfd68d req-25da58eb-8a7f-4d1c-80c5-39ea135f52f0 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042498 Oct 04 19:37:03.936353 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3804/7238] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:37:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:37:04.737400 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-cd5b7258-b961-4799-a54e-e495a8d427f0 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:37:04.738013 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-cd5b7258-b961-4799-a54e-e495a8d427f0 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: c468edaa-bfd8-43c8-9a71-07a7d19b8a2b] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:37:04.745413 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cd5b7258-b961-4799-a54e-e495a8d427f0 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:37:04.745950 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cd5b7258-b961-4799-a54e-e495a8d427f0 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:37:04.746905 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cd5b7258-b961-4799-a54e-e495a8d427f0 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:37:04.747618 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cd5b7258-b961-4799-a54e-e495a8d427f0 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:37:04.748075 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cd5b7258-b961-4799-a54e-e495a8d427f0 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:37:04.748503 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cd5b7258-b961-4799-a54e-e495a8d427f0 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:37:05.137646 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-cd5b7258-b961-4799-a54e-e495a8d427f0 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f67ee6767314bfb9cc04ea9c0dafb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0652fe65874b4606822aa7f261387bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:37:05.145440 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-cd5b7258-b961-4799-a54e-e495a8d427f0 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "GET /compute/v2.1/servers/c468edaa-bfd8-43c8-9a71-07a7d19b8a2b" status: 200 len: 1670 microversion: 2.1 time: 0.412087 Oct 04 19:37:05.146028 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3435/7239] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:37:04 2022] GET /compute/v2.1/servers/c468edaa-bfd8-43c8-9a71-07a7d19b8a2b => generated 1670 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:37:05.169599 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-202faef5-725e-4b17-a509-aeda3115f84d tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:37:05.170316 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-202faef5-725e-4b17-a509-aeda3115f84d tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: c468edaa-bfd8-43c8-9a71-07a7d19b8a2b] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:37:05.176718 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-202faef5-725e-4b17-a509-aeda3115f84d tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:37:05.177255 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-202faef5-725e-4b17-a509-aeda3115f84d tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:37:05.177711 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-202faef5-725e-4b17-a509-aeda3115f84d tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:37:05.178419 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-202faef5-725e-4b17-a509-aeda3115f84d tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:37:05.178889 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-202faef5-725e-4b17-a509-aeda3115f84d tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:37:05.179332 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-202faef5-725e-4b17-a509-aeda3115f84d tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:37:05.310739 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-202faef5-725e-4b17-a509-aeda3115f84d tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f67ee6767314bfb9cc04ea9c0dafb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0652fe65874b4606822aa7f261387bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:37:05.318564 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-202faef5-725e-4b17-a509-aeda3115f84d tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "GET /compute/v2.1/servers/c468edaa-bfd8-43c8-9a71-07a7d19b8a2b" status: 200 len: 1670 microversion: 2.1 time: 0.154153 Oct 04 19:37:05.319153 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3805/7240] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:37:05 2022] GET /compute/v2.1/servers/c468edaa-bfd8-43c8-9a71-07a7d19b8a2b => generated 1670 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:37:05.341794 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-9b798450-53b6-4b93-9164-15dda9adc082 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:37:05.342414 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-9b798450-53b6-4b93-9164-15dda9adc082 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: c468edaa-bfd8-43c8-9a71-07a7d19b8a2b] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:37:05.348395 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9b798450-53b6-4b93-9164-15dda9adc082 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:37:05.348885 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9b798450-53b6-4b93-9164-15dda9adc082 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:37:05.349365 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9b798450-53b6-4b93-9164-15dda9adc082 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:37:05.350064 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9b798450-53b6-4b93-9164-15dda9adc082 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:37:05.350527 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9b798450-53b6-4b93-9164-15dda9adc082 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:37:05.350961 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9b798450-53b6-4b93-9164-15dda9adc082 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:37:05.476655 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-9b798450-53b6-4b93-9164-15dda9adc082 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f67ee6767314bfb9cc04ea9c0dafb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0652fe65874b4606822aa7f261387bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:37:05.484468 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-9b798450-53b6-4b93-9164-15dda9adc082 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "GET /compute/v2.1/servers/c468edaa-bfd8-43c8-9a71-07a7d19b8a2b" status: 200 len: 1670 microversion: 2.1 time: 0.147469 Oct 04 19:37:05.485051 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3436/7241] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:37:05 2022] GET /compute/v2.1/servers/c468edaa-bfd8-43c8-9a71-07a7d19b8a2b => generated 1670 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:37:05.506785 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-86213aea-7ccc-4708-98a8-f2a4a8ac6f28 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:37:05.507234 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-86213aea-7ccc-4708-98a8-f2a4a8ac6f28 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: c468edaa-bfd8-43c8-9a71-07a7d19b8a2b] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:37:05.513980 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-86213aea-7ccc-4708-98a8-f2a4a8ac6f28 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:37:05.514480 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-86213aea-7ccc-4708-98a8-f2a4a8ac6f28 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:37:05.514932 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-86213aea-7ccc-4708-98a8-f2a4a8ac6f28 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:37:05.515635 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-86213aea-7ccc-4708-98a8-f2a4a8ac6f28 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:37:05.516103 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-86213aea-7ccc-4708-98a8-f2a4a8ac6f28 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:37:05.516542 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-86213aea-7ccc-4708-98a8-f2a4a8ac6f28 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:37:05.543946 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-86213aea-7ccc-4708-98a8-f2a4a8ac6f28 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: c468edaa-bfd8-43c8-9a71-07a7d19b8a2b] Going to try to terminate instance {{(pid=123596) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 19:37:05.619535 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-86213aea-7ccc-4708-98a8-f2a4a8ac6f28 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "DELETE /compute/v2.1/servers/c468edaa-bfd8-43c8-9a71-07a7d19b8a2b" status: 204 len: 0 microversion: 2.1 time: 0.116287 Oct 04 19:37:05.620309 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3806/7242] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 19:37:05 2022] DELETE /compute/v2.1/servers/c468edaa-bfd8-43c8-9a71-07a7d19b8a2b => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:37:05.629068 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-5fc857c7-9227-4861-8308-810752de77f9 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:37:05.629700 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-5fc857c7-9227-4861-8308-810752de77f9 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: c468edaa-bfd8-43c8-9a71-07a7d19b8a2b] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:37:05.635700 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5fc857c7-9227-4861-8308-810752de77f9 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:37:05.636174 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5fc857c7-9227-4861-8308-810752de77f9 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:37:05.637340 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5fc857c7-9227-4861-8308-810752de77f9 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:37:05.638029 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5fc857c7-9227-4861-8308-810752de77f9 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:37:05.638479 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5fc857c7-9227-4861-8308-810752de77f9 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:37:05.638905 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5fc857c7-9227-4861-8308-810752de77f9 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:37:05.777677 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-5fc857c7-9227-4861-8308-810752de77f9 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f67ee6767314bfb9cc04ea9c0dafb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0652fe65874b4606822aa7f261387bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:37:05.785561 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-5fc857c7-9227-4861-8308-810752de77f9 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "GET /compute/v2.1/servers/c468edaa-bfd8-43c8-9a71-07a7d19b8a2b" status: 200 len: 1676 microversion: 2.1 time: 0.160347 Oct 04 19:37:05.786142 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3437/7243] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:37:05 2022] GET /compute/v2.1/servers/c468edaa-bfd8-43c8-9a71-07a7d19b8a2b => generated 1676 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:37:06.641942 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-d40f0788-4482-4881-b4e6-ccfe9506c14d req-d21e9e46-cd1c-4d8c-9f24-5315c06687d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c468edaa-bfd8-43c8-9a71-07a7d19b8a2b", "name": "network-vif-plugged", "status": "completed", "tag": "2d4f2693-925c-43ec-ad37-07c4f49bfab8"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:37:06.654996 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-d40f0788-4482-4881-b4e6-ccfe9506c14d req-d21e9e46-cd1c-4d8c-9f24-5315c06687d2 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:37:06.655499 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-d40f0788-4482-4881-b4e6-ccfe9506c14d req-d21e9e46-cd1c-4d8c-9f24-5315c06687d2 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:37:06.655949 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-d40f0788-4482-4881-b4e6-ccfe9506c14d req-d21e9e46-cd1c-4d8c-9f24-5315c06687d2 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:37:06.666873 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-d40f0788-4482-4881-b4e6-ccfe9506c14d req-d21e9e46-cd1c-4d8c-9f24-5315c06687d2 service nova] Creating event network-vif-plugged:2d4f2693-925c-43ec-ad37-07c4f49bfab8 for instance c468edaa-bfd8-43c8-9a71-07a7d19b8a2b on n-h1-851028-13 Oct 04 19:37:06.671650 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-d40f0788-4482-4881-b4e6-ccfe9506c14d req-d21e9e46-cd1c-4d8c-9f24-5315c06687d2 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033899 Oct 04 19:37:06.672255 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3807/7244] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:37:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:37:06.807820 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-cf7b36aa-1d0f-4cc0-957e-65cd7b4e4a58 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:37:06.809101 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-cf7b36aa-1d0f-4cc0-957e-65cd7b4e4a58 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: c468edaa-bfd8-43c8-9a71-07a7d19b8a2b] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:37:06.816177 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cf7b36aa-1d0f-4cc0-957e-65cd7b4e4a58 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:37:06.816665 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cf7b36aa-1d0f-4cc0-957e-65cd7b4e4a58 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:37:06.817125 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cf7b36aa-1d0f-4cc0-957e-65cd7b4e4a58 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:37:06.817830 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cf7b36aa-1d0f-4cc0-957e-65cd7b4e4a58 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:37:06.818295 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cf7b36aa-1d0f-4cc0-957e-65cd7b4e4a58 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:37:06.818732 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cf7b36aa-1d0f-4cc0-957e-65cd7b4e4a58 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:37:06.995660 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-cf7b36aa-1d0f-4cc0-957e-65cd7b4e4a58 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f67ee6767314bfb9cc04ea9c0dafb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0652fe65874b4606822aa7f261387bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:37:07.003669 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-cf7b36aa-1d0f-4cc0-957e-65cd7b4e4a58 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "GET /compute/v2.1/servers/c468edaa-bfd8-43c8-9a71-07a7d19b8a2b" status: 200 len: 1676 microversion: 2.1 time: 0.199786 Oct 04 19:37:07.004244 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3438/7245] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:37:06 2022] GET /compute/v2.1/servers/c468edaa-bfd8-43c8-9a71-07a7d19b8a2b => generated 1676 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:37:07.813169 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-bcf9285b-13a0-463f-a610-4cd49a713a88 req-39255da2-b5a0-4815-90c7-286f9b62bf55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c468edaa-bfd8-43c8-9a71-07a7d19b8a2b", "name": "network-vif-deleted", "tag": "2d4f2693-925c-43ec-ad37-07c4f49bfab8"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:37:07.822919 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-bcf9285b-13a0-463f-a610-4cd49a713a88 req-39255da2-b5a0-4815-90c7-286f9b62bf55 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:37:07.823426 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-bcf9285b-13a0-463f-a610-4cd49a713a88 req-39255da2-b5a0-4815-90c7-286f9b62bf55 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:37:07.823937 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-bcf9285b-13a0-463f-a610-4cd49a713a88 req-39255da2-b5a0-4815-90c7-286f9b62bf55 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:37:07.835891 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-bcf9285b-13a0-463f-a610-4cd49a713a88 req-39255da2-b5a0-4815-90c7-286f9b62bf55 service nova] Creating event network-vif-deleted:2d4f2693-925c-43ec-ad37-07c4f49bfab8 for instance c468edaa-bfd8-43c8-9a71-07a7d19b8a2b on n-h1-851028-13 Oct 04 19:37:07.841663 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-bcf9285b-13a0-463f-a610-4cd49a713a88 req-39255da2-b5a0-4815-90c7-286f9b62bf55 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033072 Oct 04 19:37:07.842280 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3808/7246] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:37:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:37:08.028013 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-05302b80-b0b0-4ddc-bb34-2fe4f3a9c6b6 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:37:08.028571 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-05302b80-b0b0-4ddc-bb34-2fe4f3a9c6b6 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: c468edaa-bfd8-43c8-9a71-07a7d19b8a2b] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:37:08.035365 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-05302b80-b0b0-4ddc-bb34-2fe4f3a9c6b6 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:37:08.035855 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-05302b80-b0b0-4ddc-bb34-2fe4f3a9c6b6 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:37:08.036300 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-05302b80-b0b0-4ddc-bb34-2fe4f3a9c6b6 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:37:08.037349 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-05302b80-b0b0-4ddc-bb34-2fe4f3a9c6b6 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:37:08.037806 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-05302b80-b0b0-4ddc-bb34-2fe4f3a9c6b6 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:37:08.038239 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-05302b80-b0b0-4ddc-bb34-2fe4f3a9c6b6 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:37:08.057759 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=100 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:37:08.073672 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-05302b80-b0b0-4ddc-bb34-2fe4f3a9c6b6 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:37:08.074179 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-05302b80-b0b0-4ddc-bb34-2fe4f3a9c6b6 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:37:08.074645 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-05302b80-b0b0-4ddc-bb34-2fe4f3a9c6b6 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:37:08.075244 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.objects.instance [None req-05302b80-b0b0-4ddc-bb34-2fe4f3a9c6b6 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lazy-loading 'fault' on Instance uuid c468edaa-bfd8-43c8-9a71-07a7d19b8a2b {{(pid=123595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 19:37:08.121037 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-05302b80-b0b0-4ddc-bb34-2fe4f3a9c6b6 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f67ee6767314bfb9cc04ea9c0dafb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0652fe65874b4606822aa7f261387bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:37:08.128962 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-05302b80-b0b0-4ddc-bb34-2fe4f3a9c6b6 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "GET /compute/v2.1/servers/c468edaa-bfd8-43c8-9a71-07a7d19b8a2b" status: 200 len: 1329 microversion: 2.1 time: 0.105838 Oct 04 19:37:08.129586 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3439/7247] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:37:08 2022] GET /compute/v2.1/servers/c468edaa-bfd8-43c8-9a71-07a7d19b8a2b => generated 1329 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:37:09.150269 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=3 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:37:09.155518 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-87e42aba-6193-49ec-ba19-42bb63fb54e3 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:37:09.156236 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-87e42aba-6193-49ec-ba19-42bb63fb54e3 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: c468edaa-bfd8-43c8-9a71-07a7d19b8a2b] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:37:09.162735 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-87e42aba-6193-49ec-ba19-42bb63fb54e3 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:37:09.163233 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-87e42aba-6193-49ec-ba19-42bb63fb54e3 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:37:09.163686 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-87e42aba-6193-49ec-ba19-42bb63fb54e3 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:37:09.164387 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-87e42aba-6193-49ec-ba19-42bb63fb54e3 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:37:09.164858 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-87e42aba-6193-49ec-ba19-42bb63fb54e3 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:37:09.165329 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-87e42aba-6193-49ec-ba19-42bb63fb54e3 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:37:09.178919 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-87e42aba-6193-49ec-ba19-42bb63fb54e3 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] HTTP exception thrown: Instance c468edaa-bfd8-43c8-9a71-07a7d19b8a2b could not be found. Oct 04 19:37:09.180512 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-87e42aba-6193-49ec-ba19-42bb63fb54e3 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Request method failure captured: Oct 04 19:37:09.180512 n-d-851028-13 devstack@n-api.service[123596]: request: GET /compute/v2.1/servers/c468edaa-bfd8-43c8-9a71-07a7d19b8a2b HTTP/1.1 Oct 04 19:37:09.180512 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 19:37:09.180512 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 19:37:09.180512 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 19:37:09.180512 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 19:37:09.180512 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 19:37:09.180512 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 19:37:09.180512 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 19:37:09.180512 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 19:37:09.180512 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPIqNPSW-jY_CXlvweXkAb59PzbD_M9ifcFUjpTbr3KbdOrHUB_aNtkTXlDq8uWp-Uz3LkN9Bpw8W-Ed2va8SU5LJbVHgy-uC1qVHJobUD1nv6xPfp-0ohneG8KzimTY76cYfXn9BJJ6sDEX25dNNYJgqA5GKr8Hn0LvuJeIH2g-v6U8 Oct 04 19:37:09.180512 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 19:37:09.180512 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 19:37:09.180512 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 19:37:09.180512 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 19:37:09.180512 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 19:37:09.180512 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 19:37:09.180512 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: 0652fe65874b4606822aa7f261387bc8 Oct 04 19:37:09.180512 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-ServerActionsTestJSON-1261889807 Oct 04 19:37:09.180512 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 19:37:09.180512 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 19:37:09.180512 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/0652fe65874b4606822aa7f261387bc8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_0652fe65874b4606822aa7f261387bc8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0652fe65874b4606822aa7f261387bc8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0652fe65874b4606822aa7f261387bc8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 19:37:09.180512 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-ServerActionsTestJSON-1261889807 Oct 04 19:37:09.180512 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: 0652fe65874b4606822aa7f261387bc8 Oct 04 19:37:09.180512 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-ServerActionsTestJSON-1261889807 Oct 04 19:37:09.180512 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-ServerActionsTestJSON-1261889807-project Oct 04 19:37:09.180512 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 19:37:09.180512 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 19:37:09.180512 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 0f67ee6767314bfb9cc04ea9c0dafb4b Oct 04 19:37:09.180512 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-ServerActionsTestJSON-1261889807-project Oct 04 19:37:09.180512 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 19:37:09.180512 n-d-851028-13 devstack@n-api.service[123596]: exception: Instance c468edaa-bfd8-43c8-9a71-07a7d19b8a2b could not be found. Oct 04 19:37:09.180512 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': 'c468edaa-bfd8-43c8-9a71-07a7d19b8a2b'} Oct 04 19:37:09.180512 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:37:09.180512 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:37:09.180512 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:37:09.180512 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:37:09.180512 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:37:09.180512 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:37:09.180512 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:37:09.180512 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:37:09.180512 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:37:09.180512 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:37:09.180512 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c468edaa-bfd8-43c8-9a71-07a7d19b8a2b could not be found. Oct 04 19:37:09.180512 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:37:09.180512 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:37:09.180512 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:37:09.180512 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:37:09.180512 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:37:09.180512 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:37:09.180512 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:37:09.180512 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:37:09.180512 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:37:09.180512 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:37:09.180512 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:37:09.180512 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:37:09.180512 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:37:09.180512 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:37:09.180512 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:37:09.180512 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:37:09.180512 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c468edaa-bfd8-43c8-9a71-07a7d19b8a2b could not be found. Oct 04 19:37:09.180512 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:37:09.180512 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:37:09.180512 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:37:09.186147 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:37:09.186147 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:37:09.186147 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:37:09.186147 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:37:09.186147 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:37:09.186147 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c468edaa-bfd8-43c8-9a71-07a7d19b8a2b could not be found. Oct 04 19:37:09.186147 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:37:09.186147 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-87e42aba-6193-49ec-ba19-42bb63fb54e3 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Returning 404 to user: Instance c468edaa-bfd8-43c8-9a71-07a7d19b8a2b could not be found. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:37:09.186147 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-87e42aba-6193-49ec-ba19-42bb63fb54e3 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "GET /compute/v2.1/servers/c468edaa-bfd8-43c8-9a71-07a7d19b8a2b" status: 404 len: 111 microversion: 2.1 time: 0.032726 Oct 04 19:37:09.186147 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3809/7248] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:37:09 2022] GET /compute/v2.1/servers/c468edaa-bfd8-43c8-9a71-07a7d19b8a2b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:37:09.198430 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-fb8ae275-8b69-4764-a884-11370d59fef1 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:37:09.199086 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-fb8ae275-8b69-4764-a884-11370d59fef1 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: c468edaa-bfd8-43c8-9a71-07a7d19b8a2b] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:37:09.206066 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fb8ae275-8b69-4764-a884-11370d59fef1 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:37:09.206562 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fb8ae275-8b69-4764-a884-11370d59fef1 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:37:09.207012 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fb8ae275-8b69-4764-a884-11370d59fef1 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:37:09.207712 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fb8ae275-8b69-4764-a884-11370d59fef1 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:37:09.208174 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fb8ae275-8b69-4764-a884-11370d59fef1 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:37:09.208619 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fb8ae275-8b69-4764-a884-11370d59fef1 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:37:09.222140 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-fb8ae275-8b69-4764-a884-11370d59fef1 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] HTTP exception thrown: Instance c468edaa-bfd8-43c8-9a71-07a7d19b8a2b could not be found. Oct 04 19:37:09.223779 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-fb8ae275-8b69-4764-a884-11370d59fef1 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Request method failure captured: Oct 04 19:37:09.223779 n-d-851028-13 devstack@n-api.service[123595]: request: GET /compute/v2.1/servers/c468edaa-bfd8-43c8-9a71-07a7d19b8a2b HTTP/1.1 Oct 04 19:37:09.223779 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 19:37:09.223779 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 19:37:09.223779 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 19:37:09.223779 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 0 Oct 04 19:37:09.223779 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 19:37:09.223779 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 19:37:09.223779 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 19:37:09.223779 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 19:37:09.223779 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPIqNPSW-jY_CXlvweXkAb59PzbD_M9ifcFUjpTbr3KbdOrHUB_aNtkTXlDq8uWp-Uz3LkN9Bpw8W-Ed2va8SU5LJbVHgy-uC1qVHJobUD1nv6xPfp-0ohneG8KzimTY76cYfXn9BJJ6sDEX25dNNYJgqA5GKr8Hn0LvuJeIH2g-v6U8 Oct 04 19:37:09.223779 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 19:37:09.223779 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 19:37:09.223779 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 19:37:09.223779 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 19:37:09.223779 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 19:37:09.223779 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 19:37:09.223779 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: 0652fe65874b4606822aa7f261387bc8 Oct 04 19:37:09.223779 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-ServerActionsTestJSON-1261889807 Oct 04 19:37:09.223779 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 19:37:09.223779 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 19:37:09.223779 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/0652fe65874b4606822aa7f261387bc8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_0652fe65874b4606822aa7f261387bc8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0652fe65874b4606822aa7f261387bc8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0652fe65874b4606822aa7f261387bc8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 19:37:09.223779 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-ServerActionsTestJSON-1261889807 Oct 04 19:37:09.223779 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: 0652fe65874b4606822aa7f261387bc8 Oct 04 19:37:09.223779 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-ServerActionsTestJSON-1261889807 Oct 04 19:37:09.223779 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-ServerActionsTestJSON-1261889807-project Oct 04 19:37:09.223779 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 19:37:09.223779 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 19:37:09.223779 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: 0f67ee6767314bfb9cc04ea9c0dafb4b Oct 04 19:37:09.223779 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-ServerActionsTestJSON-1261889807-project Oct 04 19:37:09.223779 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 19:37:09.223779 n-d-851028-13 devstack@n-api.service[123595]: exception: Instance c468edaa-bfd8-43c8-9a71-07a7d19b8a2b could not be found. Oct 04 19:37:09.223779 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': 'c468edaa-bfd8-43c8-9a71-07a7d19b8a2b'} Oct 04 19:37:09.223779 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:37:09.223779 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:37:09.223779 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:37:09.223779 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:37:09.223779 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:37:09.223779 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:37:09.223779 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:37:09.223779 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:37:09.223779 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:37:09.223779 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:37:09.223779 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c468edaa-bfd8-43c8-9a71-07a7d19b8a2b could not be found. Oct 04 19:37:09.223779 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:37:09.223779 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:37:09.223779 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:37:09.223779 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:37:09.223779 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:37:09.223779 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:37:09.223779 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:37:09.223779 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:37:09.223779 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:37:09.223779 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:37:09.223779 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:37:09.223779 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:37:09.223779 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:37:09.223779 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:37:09.223779 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:37:09.223779 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:37:09.223779 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c468edaa-bfd8-43c8-9a71-07a7d19b8a2b could not be found. Oct 04 19:37:09.223779 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:37:09.223779 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:37:09.223779 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:37:09.228270 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:37:09.228270 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:37:09.228270 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:37:09.228270 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:37:09.228270 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:37:09.228270 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c468edaa-bfd8-43c8-9a71-07a7d19b8a2b could not be found. Oct 04 19:37:09.228270 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:37:09.228270 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-fb8ae275-8b69-4764-a884-11370d59fef1 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Returning 404 to user: Instance c468edaa-bfd8-43c8-9a71-07a7d19b8a2b could not be found. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:37:09.228270 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-fb8ae275-8b69-4764-a884-11370d59fef1 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "GET /compute/v2.1/servers/c468edaa-bfd8-43c8-9a71-07a7d19b8a2b" status: 404 len: 111 microversion: 2.1 time: 0.030649 Oct 04 19:37:09.228270 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3440/7249] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:37:09 2022] GET /compute/v2.1/servers/c468edaa-bfd8-43c8-9a71-07a7d19b8a2b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:37:09.274331 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-67ff7d42-7685-4e88-a50c-77792db97e5b tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1075358235", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452", "networks": [{"uuid": "6c9a7653-1520-46af-adc6-2fa7ddb22865"}], "security_groups": [{"name": "tempest-securitygroup--1858182781"}], "key_name": "tempest-keypair-1677005794", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:37:09.377560 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.network.neutron [None req-67ff7d42-7685-4e88-a50c-77792db97e5b tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] validate_networks() for [('6c9a7653-1520-46af-adc6-2fa7ddb22865', None, None, None, None, None)] {{(pid=123596) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 19:37:09.739567 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-67ff7d42-7685-4e88-a50c-77792db97e5b tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Flavor limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:37:09.740010 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-67ff7d42-7685-4e88-a50c-77792db97e5b tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Image limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:37:09.740500 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-67ff7d42-7685-4e88-a50c-77792db97e5b tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Flavor pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:37:09.740927 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-67ff7d42-7685-4e88-a50c-77792db97e5b tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Image pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:37:09.741389 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-67ff7d42-7685-4e88-a50c-77792db97e5b tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:37:09.750242 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-67ff7d42-7685-4e88-a50c-77792db97e5b tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:37:09.750742 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-67ff7d42-7685-4e88-a50c-77792db97e5b tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:37:09.751196 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-67ff7d42-7685-4e88-a50c-77792db97e5b tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:37:09.751938 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-67ff7d42-7685-4e88-a50c-77792db97e5b tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:37:09.752407 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-67ff7d42-7685-4e88-a50c-77792db97e5b tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:37:09.752871 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-67ff7d42-7685-4e88-a50c-77792db97e5b tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:37:09.769779 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-67ff7d42-7685-4e88-a50c-77792db97e5b tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Getting quotas for project 0652fe65874b4606822aa7f261387bc8. Resources: {'ram', 'cores', 'instances'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:37:09.774999 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-67ff7d42-7685-4e88-a50c-77792db97e5b tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Getting quotas for user 0f67ee6767314bfb9cc04ea9c0dafb4b and project 0652fe65874b4606822aa7f261387bc8. Resources: {'ram', 'cores', 'instances'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:37:09.787886 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-67ff7d42-7685-4e88-a50c-77792db97e5b tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Going to run 1 instances... {{(pid=123596) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 19:37:09.790231 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-67ff7d42-7685-4e88-a50c-77792db97e5b tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: 90c30ac8-f581-4ee8-b40d-f752a9cd384e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e8943ec5-4038-4d4b-b9b9-2415a79f5243',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123596) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 19:37:09.836282 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-67ff7d42-7685-4e88-a50c-77792db97e5b tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.565743 Oct 04 19:37:09.836934 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3810/7250] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 19:37:09 2022] POST /compute/v2.1/servers => generated 406 bytes in 567 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 19:37:09.849004 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-37ed8487-1ae9-4138-b070-8558c8115f06 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:37:09.849659 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-37ed8487-1ae9-4138-b070-8558c8115f06 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: 90c30ac8-f581-4ee8-b40d-f752a9cd384e] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:37:09.902369 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-37ed8487-1ae9-4138-b070-8558c8115f06 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f67ee6767314bfb9cc04ea9c0dafb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0652fe65874b4606822aa7f261387bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:37:09.909446 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-37ed8487-1ae9-4138-b070-8558c8115f06 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "GET /compute/v2.1/servers/90c30ac8-f581-4ee8-b40d-f752a9cd384e" status: 200 len: 1239 microversion: 2.1 time: 0.064270 Oct 04 19:37:09.910035 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3441/7251] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:37:09 2022] GET /compute/v2.1/servers/90c30ac8-f581-4ee8-b40d-f752a9cd384e => generated 1239 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:37:10.934492 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-c1bc35b4-3dc2-4f29-bb1a-1ac815d8d469 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:37:10.935167 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-c1bc35b4-3dc2-4f29-bb1a-1ac815d8d469 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: 90c30ac8-f581-4ee8-b40d-f752a9cd384e] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:37:10.937809 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:37:10.943647 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c1bc35b4-3dc2-4f29-bb1a-1ac815d8d469 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:37:10.944149 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c1bc35b4-3dc2-4f29-bb1a-1ac815d8d469 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:37:10.944609 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c1bc35b4-3dc2-4f29-bb1a-1ac815d8d469 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:37:10.945344 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c1bc35b4-3dc2-4f29-bb1a-1ac815d8d469 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:37:10.945809 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c1bc35b4-3dc2-4f29-bb1a-1ac815d8d469 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:37:10.946245 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c1bc35b4-3dc2-4f29-bb1a-1ac815d8d469 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:37:11.310122 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-c1bc35b4-3dc2-4f29-bb1a-1ac815d8d469 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f67ee6767314bfb9cc04ea9c0dafb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0652fe65874b4606822aa7f261387bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:37:11.318024 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-c1bc35b4-3dc2-4f29-bb1a-1ac815d8d469 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "GET /compute/v2.1/servers/90c30ac8-f581-4ee8-b40d-f752a9cd384e" status: 200 len: 1297 microversion: 2.1 time: 0.389598 Oct 04 19:37:11.318669 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3811/7252] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:37:10 2022] GET /compute/v2.1/servers/90c30ac8-f581-4ee8-b40d-f752a9cd384e => generated 1297 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:37:12.342866 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-81c4557f-61c3-471a-8e89-72e712cd18ad tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:37:12.343492 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-81c4557f-61c3-471a-8e89-72e712cd18ad tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: 90c30ac8-f581-4ee8-b40d-f752a9cd384e] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:37:12.347235 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_api:SELECT=45 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:37:12.352195 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-81c4557f-61c3-471a-8e89-72e712cd18ad tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:37:12.352726 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-81c4557f-61c3-471a-8e89-72e712cd18ad tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:37:12.353201 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-81c4557f-61c3-471a-8e89-72e712cd18ad tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:37:12.353919 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-81c4557f-61c3-471a-8e89-72e712cd18ad tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:37:12.354385 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-81c4557f-61c3-471a-8e89-72e712cd18ad tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:37:12.355493 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-81c4557f-61c3-471a-8e89-72e712cd18ad tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:37:12.488186 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-81c4557f-61c3-471a-8e89-72e712cd18ad tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f67ee6767314bfb9cc04ea9c0dafb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0652fe65874b4606822aa7f261387bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:37:12.496612 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-81c4557f-61c3-471a-8e89-72e712cd18ad tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "GET /compute/v2.1/servers/90c30ac8-f581-4ee8-b40d-f752a9cd384e" status: 200 len: 1365 microversion: 2.1 time: 0.158423 Oct 04 19:37:12.497394 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3442/7253] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:37:12 2022] GET /compute/v2.1/servers/90c30ac8-f581-4ee8-b40d-f752a9cd384e => generated 1365 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:37:12.520680 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-0daa89f8-7328-4852-91c1-78d422704623 req-8439291d-5b5f-49b5-9114-2dc4b39d034a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90c30ac8-f581-4ee8-b40d-f752a9cd384e", "tag": "0187505e-b0e5-4e5d-9f1d-c19a718eeff3"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:37:12.533603 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-0daa89f8-7328-4852-91c1-78d422704623 req-8439291d-5b5f-49b5-9114-2dc4b39d034a service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:37:12.534359 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-0daa89f8-7328-4852-91c1-78d422704623 req-8439291d-5b5f-49b5-9114-2dc4b39d034a service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:37:12.534890 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-0daa89f8-7328-4852-91c1-78d422704623 req-8439291d-5b5f-49b5-9114-2dc4b39d034a service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:37:12.547091 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-0daa89f8-7328-4852-91c1-78d422704623 req-8439291d-5b5f-49b5-9114-2dc4b39d034a service nova] Creating event network-changed:0187505e-b0e5-4e5d-9f1d-c19a718eeff3 for instance 90c30ac8-f581-4ee8-b40d-f752a9cd384e on n-h2-851028-13 Oct 04 19:37:12.551927 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-0daa89f8-7328-4852-91c1-78d422704623 req-8439291d-5b5f-49b5-9114-2dc4b39d034a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035337 Oct 04 19:37:12.552631 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3812/7254] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:37:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:37:13.521724 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-2d7bee9f-e9d4-4add-b6ee-c34ce01b9187 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:37:13.522350 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-2d7bee9f-e9d4-4add-b6ee-c34ce01b9187 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: 90c30ac8-f581-4ee8-b40d-f752a9cd384e] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:37:13.529329 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2d7bee9f-e9d4-4add-b6ee-c34ce01b9187 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:37:13.529851 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2d7bee9f-e9d4-4add-b6ee-c34ce01b9187 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:37:13.530300 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2d7bee9f-e9d4-4add-b6ee-c34ce01b9187 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:37:13.531008 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2d7bee9f-e9d4-4add-b6ee-c34ce01b9187 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:37:13.531489 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2d7bee9f-e9d4-4add-b6ee-c34ce01b9187 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:37:13.532174 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2d7bee9f-e9d4-4add-b6ee-c34ce01b9187 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:37:13.664822 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-2d7bee9f-e9d4-4add-b6ee-c34ce01b9187 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f67ee6767314bfb9cc04ea9c0dafb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0652fe65874b4606822aa7f261387bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:37:13.673005 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-2d7bee9f-e9d4-4add-b6ee-c34ce01b9187 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "GET /compute/v2.1/servers/90c30ac8-f581-4ee8-b40d-f752a9cd384e" status: 200 len: 1365 microversion: 2.1 time: 0.155227 Oct 04 19:37:13.673615 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3443/7255] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:37:13 2022] GET /compute/v2.1/servers/90c30ac8-f581-4ee8-b40d-f752a9cd384e => generated 1365 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:37:14.698928 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f51abdc7-dcaa-42f3-b101-7e22bb8a33b9 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:37:14.699652 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-f51abdc7-dcaa-42f3-b101-7e22bb8a33b9 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: 90c30ac8-f581-4ee8-b40d-f752a9cd384e] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:37:14.705999 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f51abdc7-dcaa-42f3-b101-7e22bb8a33b9 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:37:14.706506 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f51abdc7-dcaa-42f3-b101-7e22bb8a33b9 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:37:14.706961 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f51abdc7-dcaa-42f3-b101-7e22bb8a33b9 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:37:14.707670 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f51abdc7-dcaa-42f3-b101-7e22bb8a33b9 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:37:14.708136 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f51abdc7-dcaa-42f3-b101-7e22bb8a33b9 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:37:14.708580 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f51abdc7-dcaa-42f3-b101-7e22bb8a33b9 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:37:14.842166 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-f51abdc7-dcaa-42f3-b101-7e22bb8a33b9 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f67ee6767314bfb9cc04ea9c0dafb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0652fe65874b4606822aa7f261387bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:37:14.850290 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-f51abdc7-dcaa-42f3-b101-7e22bb8a33b9 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "GET /compute/v2.1/servers/90c30ac8-f581-4ee8-b40d-f752a9cd384e" status: 200 len: 1365 microversion: 2.1 time: 0.157145 Oct 04 19:37:14.850868 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3813/7256] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:37:14 2022] GET /compute/v2.1/servers/90c30ac8-f581-4ee8-b40d-f752a9cd384e => generated 1365 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:37:15.873573 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-19144e04-596f-41cb-b2b3-93b091c41799 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:37:15.874192 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-19144e04-596f-41cb-b2b3-93b091c41799 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: 90c30ac8-f581-4ee8-b40d-f752a9cd384e] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:37:15.880998 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-19144e04-596f-41cb-b2b3-93b091c41799 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:37:15.881518 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-19144e04-596f-41cb-b2b3-93b091c41799 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:37:15.881963 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-19144e04-596f-41cb-b2b3-93b091c41799 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:37:15.882698 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-19144e04-596f-41cb-b2b3-93b091c41799 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:37:15.883161 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-19144e04-596f-41cb-b2b3-93b091c41799 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:37:15.883600 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-19144e04-596f-41cb-b2b3-93b091c41799 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:37:16.009788 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-19144e04-596f-41cb-b2b3-93b091c41799 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f67ee6767314bfb9cc04ea9c0dafb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0652fe65874b4606822aa7f261387bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:37:16.018075 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-19144e04-596f-41cb-b2b3-93b091c41799 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "GET /compute/v2.1/servers/90c30ac8-f581-4ee8-b40d-f752a9cd384e" status: 200 len: 1365 microversion: 2.1 time: 0.148448 Oct 04 19:37:16.018649 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3444/7257] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:37:15 2022] GET /compute/v2.1/servers/90c30ac8-f581-4ee8-b40d-f752a9cd384e => generated 1365 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:37:16.766780 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-602365ae-a9d0-43bb-8f43-a8dc9677ed67 req-12fee526-1065-4f87-b885-575222c0b8ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90c30ac8-f581-4ee8-b40d-f752a9cd384e", "name": "network-vif-plugged", "status": "completed", "tag": "0187505e-b0e5-4e5d-9f1d-c19a718eeff3"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:37:16.783131 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-602365ae-a9d0-43bb-8f43-a8dc9677ed67 req-12fee526-1065-4f87-b885-575222c0b8ef service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:37:16.783633 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-602365ae-a9d0-43bb-8f43-a8dc9677ed67 req-12fee526-1065-4f87-b885-575222c0b8ef service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:37:16.784111 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-602365ae-a9d0-43bb-8f43-a8dc9677ed67 req-12fee526-1065-4f87-b885-575222c0b8ef service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:37:16.796749 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-602365ae-a9d0-43bb-8f43-a8dc9677ed67 req-12fee526-1065-4f87-b885-575222c0b8ef service nova] Creating event network-vif-plugged:0187505e-b0e5-4e5d-9f1d-c19a718eeff3 for instance 90c30ac8-f581-4ee8-b40d-f752a9cd384e on n-h2-851028-13 Oct 04 19:37:16.801876 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-602365ae-a9d0-43bb-8f43-a8dc9677ed67 req-12fee526-1065-4f87-b885-575222c0b8ef service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038928 Oct 04 19:37:16.802860 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3814/7258] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:37:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:37:17.041316 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-7e5dea80-847d-40de-a291-48caa7b91bc2 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:37:17.042519 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-7e5dea80-847d-40de-a291-48caa7b91bc2 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: 90c30ac8-f581-4ee8-b40d-f752a9cd384e] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:37:17.049487 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7e5dea80-847d-40de-a291-48caa7b91bc2 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:37:17.049982 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7e5dea80-847d-40de-a291-48caa7b91bc2 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:37:17.050431 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7e5dea80-847d-40de-a291-48caa7b91bc2 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:37:17.051136 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7e5dea80-847d-40de-a291-48caa7b91bc2 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:37:17.051629 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7e5dea80-847d-40de-a291-48caa7b91bc2 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:37:17.052066 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7e5dea80-847d-40de-a291-48caa7b91bc2 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:37:17.186502 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-7e5dea80-847d-40de-a291-48caa7b91bc2 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f67ee6767314bfb9cc04ea9c0dafb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0652fe65874b4606822aa7f261387bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:37:17.194303 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-7e5dea80-847d-40de-a291-48caa7b91bc2 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "GET /compute/v2.1/servers/90c30ac8-f581-4ee8-b40d-f752a9cd384e" status: 200 len: 1365 microversion: 2.1 time: 0.156972 Oct 04 19:37:17.194881 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3445/7259] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:37:17 2022] GET /compute/v2.1/servers/90c30ac8-f581-4ee8-b40d-f752a9cd384e => generated 1365 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:37:18.219533 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-d59473eb-01d9-46b7-b29a-ae407f06712b tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:37:18.220257 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-d59473eb-01d9-46b7-b29a-ae407f06712b tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: 90c30ac8-f581-4ee8-b40d-f752a9cd384e] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:37:18.226569 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d59473eb-01d9-46b7-b29a-ae407f06712b tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:37:18.227073 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d59473eb-01d9-46b7-b29a-ae407f06712b tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:37:18.227563 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d59473eb-01d9-46b7-b29a-ae407f06712b tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:37:18.228269 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d59473eb-01d9-46b7-b29a-ae407f06712b tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:37:18.228739 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d59473eb-01d9-46b7-b29a-ae407f06712b tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:37:18.229699 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d59473eb-01d9-46b7-b29a-ae407f06712b tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:37:18.361023 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-d59473eb-01d9-46b7-b29a-ae407f06712b tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f67ee6767314bfb9cc04ea9c0dafb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0652fe65874b4606822aa7f261387bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:37:18.368854 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-d59473eb-01d9-46b7-b29a-ae407f06712b tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "GET /compute/v2.1/servers/90c30ac8-f581-4ee8-b40d-f752a9cd384e" status: 200 len: 1552 microversion: 2.1 time: 0.154729 Oct 04 19:37:18.369474 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3815/7260] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:37:18 2022] GET /compute/v2.1/servers/90c30ac8-f581-4ee8-b40d-f752a9cd384e => generated 1552 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:37:18.391378 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-92f2d983-0063-45ef-9b0a-f760b5d58a82 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:37:18.391880 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-92f2d983-0063-45ef-9b0a-f760b5d58a82 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: 90c30ac8-f581-4ee8-b40d-f752a9cd384e] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:37:18.398724 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-92f2d983-0063-45ef-9b0a-f760b5d58a82 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:37:18.399220 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-92f2d983-0063-45ef-9b0a-f760b5d58a82 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:37:18.399664 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-92f2d983-0063-45ef-9b0a-f760b5d58a82 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:37:18.400363 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-92f2d983-0063-45ef-9b0a-f760b5d58a82 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:37:18.400823 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-92f2d983-0063-45ef-9b0a-f760b5d58a82 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:37:18.401792 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-92f2d983-0063-45ef-9b0a-f760b5d58a82 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:37:18.484867 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-92f2d983-0063-45ef-9b0a-f760b5d58a82 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "GET /compute/v2.1/servers/90c30ac8-f581-4ee8-b40d-f752a9cd384e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.097287 Oct 04 19:37:18.485546 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3446/7261] 10.222.0.43 () {58 vars in 1275 bytes} [Tue Oct 4 19:37:18 2022] GET /compute/v2.1/servers/90c30ac8-f581-4ee8-b40d-f752a9cd384e/os-interface => generated 284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:37:19.426893 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-31ddc592-3258-41e7-b172-09f4d01b814d req-2b0b81f4-acad-4198-96bd-a42fc1265f98 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90c30ac8-f581-4ee8-b40d-f752a9cd384e", "tag": "0187505e-b0e5-4e5d-9f1d-c19a718eeff3"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:37:19.437963 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-31ddc592-3258-41e7-b172-09f4d01b814d req-2b0b81f4-acad-4198-96bd-a42fc1265f98 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:37:19.438545 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-31ddc592-3258-41e7-b172-09f4d01b814d req-2b0b81f4-acad-4198-96bd-a42fc1265f98 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:37:19.439007 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-31ddc592-3258-41e7-b172-09f4d01b814d req-2b0b81f4-acad-4198-96bd-a42fc1265f98 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:37:19.449929 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-31ddc592-3258-41e7-b172-09f4d01b814d req-2b0b81f4-acad-4198-96bd-a42fc1265f98 service nova] Creating event network-changed:0187505e-b0e5-4e5d-9f1d-c19a718eeff3 for instance 90c30ac8-f581-4ee8-b40d-f752a9cd384e on n-h2-851028-13 Oct 04 19:37:19.456343 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-31ddc592-3258-41e7-b172-09f4d01b814d req-2b0b81f4-acad-4198-96bd-a42fc1265f98 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033394 Oct 04 19:37:19.456955 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3816/7262] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:37:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:37:51.155191 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=2 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:37:51.156009 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_api:SELECT=9 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:37:51.156741 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=34 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:37:51.161099 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-a2b2cae8-6379-4f4d-8815-29c26e8d289a tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:37:51.161741 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-a2b2cae8-6379-4f4d-8815-29c26e8d289a tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: 90c30ac8-f581-4ee8-b40d-f752a9cd384e] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:37:51.169684 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a2b2cae8-6379-4f4d-8815-29c26e8d289a tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:37:51.170175 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a2b2cae8-6379-4f4d-8815-29c26e8d289a tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:37:51.170620 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a2b2cae8-6379-4f4d-8815-29c26e8d289a tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:37:51.171316 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a2b2cae8-6379-4f4d-8815-29c26e8d289a tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:37:51.171776 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a2b2cae8-6379-4f4d-8815-29c26e8d289a tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:37:51.172209 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a2b2cae8-6379-4f4d-8815-29c26e8d289a tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:37:51.303932 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-a2b2cae8-6379-4f4d-8815-29c26e8d289a tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f67ee6767314bfb9cc04ea9c0dafb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0652fe65874b4606822aa7f261387bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:37:51.311797 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-a2b2cae8-6379-4f4d-8815-29c26e8d289a tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "GET /compute/v2.1/servers/90c30ac8-f581-4ee8-b40d-f752a9cd384e" status: 200 len: 1670 microversion: 2.1 time: 0.158586 Oct 04 19:37:51.312378 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3447/7263] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:37:51 2022] GET /compute/v2.1/servers/90c30ac8-f581-4ee8-b40d-f752a9cd384e => generated 1670 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:37:51.331427 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=2 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:37:51.332212 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=6 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:37:51.334172 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_api:SELECT=11 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:37:51.334991 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:37:51.340641 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-1fd35779-f9b1-4931-811d-416ee0a9d6bc tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b83b8452-5635-41a5-9fb2-db4443927dce"}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:37:51.343061 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-1fd35779-f9b1-4931-811d-416ee0a9d6bc tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: 90c30ac8-f581-4ee8-b40d-f752a9cd384e] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:37:51.351250 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1fd35779-f9b1-4931-811d-416ee0a9d6bc tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:37:51.351753 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1fd35779-f9b1-4931-811d-416ee0a9d6bc tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:37:51.352205 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1fd35779-f9b1-4931-811d-416ee0a9d6bc tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:37:51.352914 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1fd35779-f9b1-4931-811d-416ee0a9d6bc tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:37:51.353403 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1fd35779-f9b1-4931-811d-416ee0a9d6bc tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:37:51.353846 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1fd35779-f9b1-4931-811d-416ee0a9d6bc tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:37:51.587076 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-1fd35779-f9b1-4931-811d-416ee0a9d6bc tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "POST /compute/v2.1/servers/90c30ac8-f581-4ee8-b40d-f752a9cd384e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.256283 Oct 04 19:37:51.587751 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3817/7264] 10.222.0.43 () {60 vars in 1323 bytes} [Tue Oct 4 19:37:51 2022] POST /compute/v2.1/servers/90c30ac8-f581-4ee8-b40d-f752a9cd384e/os-volume_attachments => generated 194 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:38:02.303213 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-68f40fc0-a009-499e-8b0a-39cb26704921 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:38:02.305587 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-68f40fc0-a009-499e-8b0a-39cb26704921 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: 90c30ac8-f581-4ee8-b40d-f752a9cd384e] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:38:02.307513 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_api:SELECT=2 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:38:02.308217 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=6 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:38:02.314399 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-68f40fc0-a009-499e-8b0a-39cb26704921 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:02.314891 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-68f40fc0-a009-499e-8b0a-39cb26704921 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:02.315329 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-68f40fc0-a009-499e-8b0a-39cb26704921 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:02.316031 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-68f40fc0-a009-499e-8b0a-39cb26704921 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:02.316487 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-68f40fc0-a009-499e-8b0a-39cb26704921 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:02.316917 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-68f40fc0-a009-499e-8b0a-39cb26704921 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:02.345951 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-68f40fc0-a009-499e-8b0a-39cb26704921 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '0f67ee6767314bfb9cc04ea9c0dafb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0652fe65874b4606822aa7f261387bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:38:02.354001 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-68f40fc0-a009-499e-8b0a-39cb26704921 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: 90c30ac8-f581-4ee8-b40d-f752a9cd384e] Old instance type m1.heat2, new instance type m1.heat {{(pid=123595) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 04 19:38:02.361187 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-68f40fc0-a009-499e-8b0a-39cb26704921 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Flavor limits 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:38:02.361610 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-68f40fc0-a009-499e-8b0a-39cb26704921 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Image limits 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:38:02.362087 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-68f40fc0-a009-499e-8b0a-39cb26704921 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Flavor pref 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:38:02.362498 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-68f40fc0-a009-499e-8b0a-39cb26704921 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Image pref 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:38:02.362904 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-68f40fc0-a009-499e-8b0a-39cb26704921 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:38:02.424856 n-d-851028-13 devstack@n-api.service[123595]: ERROR oslo.messaging._drivers.impl_rabbit [None req-68f40fc0-a009-499e-8b0a-39cb26704921 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [ad49b5de-7934-46fc-8e8f-373f91b0bcd2] AMQP server on 10.222.0.43:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 19:38:03.431054 n-d-851028-13 devstack@n-api.service[123595]: INFO oslo.messaging._drivers.impl_rabbit [None req-68f40fc0-a009-499e-8b0a-39cb26704921 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [ad49b5de-7934-46fc-8e8f-373f91b0bcd2] Reconnected to AMQP server on 10.222.0.43:5672 via [amqp] client with port 47774. Oct 04 19:38:03.434220 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-68f40fc0-a009-499e-8b0a-39cb26704921 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "POST /compute/v2.1/servers/90c30ac8-f581-4ee8-b40d-f752a9cd384e/action" status: 202 len: 0 microversion: 2.1 time: 1.135244 Oct 04 19:38:03.434849 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3448/7265] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 19:38:02 2022] POST /compute/v2.1/servers/90c30ac8-f581-4ee8-b40d-f752a9cd384e/action => generated 0 bytes in 1136 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:38:03.441077 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_api:SELECT=2 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:38:03.441925 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:38:03.446235 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-98d6a103-05ee-406b-a0c1-b905717ef0f0 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:38:03.446958 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-98d6a103-05ee-406b-a0c1-b905717ef0f0 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: 90c30ac8-f581-4ee8-b40d-f752a9cd384e] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:38:03.455041 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-98d6a103-05ee-406b-a0c1-b905717ef0f0 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:03.455551 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-98d6a103-05ee-406b-a0c1-b905717ef0f0 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:03.456014 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-98d6a103-05ee-406b-a0c1-b905717ef0f0 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:03.456730 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-98d6a103-05ee-406b-a0c1-b905717ef0f0 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:03.457256 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-98d6a103-05ee-406b-a0c1-b905717ef0f0 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:03.457753 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-98d6a103-05ee-406b-a0c1-b905717ef0f0 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:03.623335 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-98d6a103-05ee-406b-a0c1-b905717ef0f0 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f67ee6767314bfb9cc04ea9c0dafb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0652fe65874b4606822aa7f261387bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:38:03.631834 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-98d6a103-05ee-406b-a0c1-b905717ef0f0 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "GET /compute/v2.1/servers/90c30ac8-f581-4ee8-b40d-f752a9cd384e" status: 200 len: 1725 microversion: 2.1 time: 0.192434 Oct 04 19:38:03.632182 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3818/7266] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:38:03 2022] GET /compute/v2.1/servers/90c30ac8-f581-4ee8-b40d-f752a9cd384e => generated 1725 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:38:04.660828 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-ec289bba-ce07-46b1-bee3-1bfd71e1d0ac tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:38:04.661509 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-ec289bba-ce07-46b1-bee3-1bfd71e1d0ac tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: 90c30ac8-f581-4ee8-b40d-f752a9cd384e] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:38:04.669167 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ec289bba-ce07-46b1-bee3-1bfd71e1d0ac tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:04.670310 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ec289bba-ce07-46b1-bee3-1bfd71e1d0ac tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:04.670763 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ec289bba-ce07-46b1-bee3-1bfd71e1d0ac tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:04.671467 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ec289bba-ce07-46b1-bee3-1bfd71e1d0ac tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:04.671971 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ec289bba-ce07-46b1-bee3-1bfd71e1d0ac tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:04.672350 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ec289bba-ce07-46b1-bee3-1bfd71e1d0ac tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:04.814200 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-ec289bba-ce07-46b1-bee3-1bfd71e1d0ac tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f67ee6767314bfb9cc04ea9c0dafb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0652fe65874b4606822aa7f261387bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:38:04.829076 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-ec289bba-ce07-46b1-bee3-1bfd71e1d0ac tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "GET /compute/v2.1/servers/90c30ac8-f581-4ee8-b40d-f752a9cd384e" status: 200 len: 1725 microversion: 2.1 time: 0.176791 Oct 04 19:38:04.830155 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3449/7267] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:38:04 2022] GET /compute/v2.1/servers/90c30ac8-f581-4ee8-b40d-f752a9cd384e => generated 1725 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:38:05.853429 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-65250797-0817-414e-9594-6bd91f833168 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:38:05.854058 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-65250797-0817-414e-9594-6bd91f833168 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: 90c30ac8-f581-4ee8-b40d-f752a9cd384e] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:38:05.861090 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-65250797-0817-414e-9594-6bd91f833168 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:05.861622 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-65250797-0817-414e-9594-6bd91f833168 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:05.862080 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-65250797-0817-414e-9594-6bd91f833168 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:05.862793 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-65250797-0817-414e-9594-6bd91f833168 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:05.863258 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-65250797-0817-414e-9594-6bd91f833168 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:05.863700 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-65250797-0817-414e-9594-6bd91f833168 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:06.003149 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-65250797-0817-414e-9594-6bd91f833168 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f67ee6767314bfb9cc04ea9c0dafb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0652fe65874b4606822aa7f261387bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:38:06.011559 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-65250797-0817-414e-9594-6bd91f833168 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "GET /compute/v2.1/servers/90c30ac8-f581-4ee8-b40d-f752a9cd384e" status: 200 len: 1730 microversion: 2.1 time: 0.162035 Oct 04 19:38:06.012140 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3819/7268] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:38:05 2022] GET /compute/v2.1/servers/90c30ac8-f581-4ee8-b40d-f752a9cd384e => generated 1730 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:38:07.035937 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-88391363-87c0-48f8-b876-7ea47cab0eb7 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:38:07.036498 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-88391363-87c0-48f8-b876-7ea47cab0eb7 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: 90c30ac8-f581-4ee8-b40d-f752a9cd384e] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:38:07.043320 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-88391363-87c0-48f8-b876-7ea47cab0eb7 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:07.043829 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-88391363-87c0-48f8-b876-7ea47cab0eb7 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:07.044257 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-88391363-87c0-48f8-b876-7ea47cab0eb7 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:07.044985 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-88391363-87c0-48f8-b876-7ea47cab0eb7 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:07.045465 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-88391363-87c0-48f8-b876-7ea47cab0eb7 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:07.045923 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-88391363-87c0-48f8-b876-7ea47cab0eb7 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:07.172667 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-88391363-87c0-48f8-b876-7ea47cab0eb7 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f67ee6767314bfb9cc04ea9c0dafb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0652fe65874b4606822aa7f261387bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:38:07.180958 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-88391363-87c0-48f8-b876-7ea47cab0eb7 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "GET /compute/v2.1/servers/90c30ac8-f581-4ee8-b40d-f752a9cd384e" status: 200 len: 1730 microversion: 2.1 time: 0.149001 Oct 04 19:38:07.181572 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3450/7269] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:38:07 2022] GET /compute/v2.1/servers/90c30ac8-f581-4ee8-b40d-f752a9cd384e => generated 1730 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:38:08.204191 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-ec6acf1c-f45c-4926-a40f-267025ea1be9 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:38:08.204829 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-ec6acf1c-f45c-4926-a40f-267025ea1be9 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: 90c30ac8-f581-4ee8-b40d-f752a9cd384e] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:38:08.211773 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ec6acf1c-f45c-4926-a40f-267025ea1be9 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:08.212278 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ec6acf1c-f45c-4926-a40f-267025ea1be9 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:08.212738 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ec6acf1c-f45c-4926-a40f-267025ea1be9 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:08.213474 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ec6acf1c-f45c-4926-a40f-267025ea1be9 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:08.213952 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ec6acf1c-f45c-4926-a40f-267025ea1be9 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:08.214659 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ec6acf1c-f45c-4926-a40f-267025ea1be9 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:08.340955 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-ec6acf1c-f45c-4926-a40f-267025ea1be9 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f67ee6767314bfb9cc04ea9c0dafb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0652fe65874b4606822aa7f261387bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:38:08.349709 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-ec6acf1c-f45c-4926-a40f-267025ea1be9 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "GET /compute/v2.1/servers/90c30ac8-f581-4ee8-b40d-f752a9cd384e" status: 200 len: 1730 microversion: 2.1 time: 0.149438 Oct 04 19:38:08.350293 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3820/7270] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:38:08 2022] GET /compute/v2.1/servers/90c30ac8-f581-4ee8-b40d-f752a9cd384e => generated 1730 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:38:09.373934 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-26b00f09-afa1-4ad8-99b9-faa546b1590a tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:38:09.374552 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-26b00f09-afa1-4ad8-99b9-faa546b1590a tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: 90c30ac8-f581-4ee8-b40d-f752a9cd384e] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:38:09.381444 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-26b00f09-afa1-4ad8-99b9-faa546b1590a tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:09.381930 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-26b00f09-afa1-4ad8-99b9-faa546b1590a tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:09.382367 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-26b00f09-afa1-4ad8-99b9-faa546b1590a tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:09.383057 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-26b00f09-afa1-4ad8-99b9-faa546b1590a tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:09.383511 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-26b00f09-afa1-4ad8-99b9-faa546b1590a tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:09.383936 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-26b00f09-afa1-4ad8-99b9-faa546b1590a tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:09.514702 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-26b00f09-afa1-4ad8-99b9-faa546b1590a tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f67ee6767314bfb9cc04ea9c0dafb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0652fe65874b4606822aa7f261387bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:38:09.523086 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-26b00f09-afa1-4ad8-99b9-faa546b1590a tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "GET /compute/v2.1/servers/90c30ac8-f581-4ee8-b40d-f752a9cd384e" status: 200 len: 1730 microversion: 2.1 time: 0.153705 Oct 04 19:38:09.523683 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3451/7271] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:38:09 2022] GET /compute/v2.1/servers/90c30ac8-f581-4ee8-b40d-f752a9cd384e => generated 1730 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:38:10.547511 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-96bf871c-bcd7-43ba-9131-87b7b69f5e3f tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:38:10.548182 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-96bf871c-bcd7-43ba-9131-87b7b69f5e3f tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: 90c30ac8-f581-4ee8-b40d-f752a9cd384e] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:38:10.555893 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-96bf871c-bcd7-43ba-9131-87b7b69f5e3f tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:10.556400 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-96bf871c-bcd7-43ba-9131-87b7b69f5e3f tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:10.556854 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-96bf871c-bcd7-43ba-9131-87b7b69f5e3f tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:10.557603 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-96bf871c-bcd7-43ba-9131-87b7b69f5e3f tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:10.558083 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-96bf871c-bcd7-43ba-9131-87b7b69f5e3f tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:10.558528 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-96bf871c-bcd7-43ba-9131-87b7b69f5e3f tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:10.691728 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-96bf871c-bcd7-43ba-9131-87b7b69f5e3f tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f67ee6767314bfb9cc04ea9c0dafb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0652fe65874b4606822aa7f261387bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:38:10.700780 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-96bf871c-bcd7-43ba-9131-87b7b69f5e3f tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "GET /compute/v2.1/servers/90c30ac8-f581-4ee8-b40d-f752a9cd384e" status: 200 len: 1730 microversion: 2.1 time: 0.157332 Oct 04 19:38:10.701404 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3821/7272] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:38:10 2022] GET /compute/v2.1/servers/90c30ac8-f581-4ee8-b40d-f752a9cd384e => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:38:11.724045 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-3e5f48d3-5f7e-4a75-b29f-be4b21a76417 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:38:11.724616 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-3e5f48d3-5f7e-4a75-b29f-be4b21a76417 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: 90c30ac8-f581-4ee8-b40d-f752a9cd384e] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:38:11.731990 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3e5f48d3-5f7e-4a75-b29f-be4b21a76417 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:11.732491 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3e5f48d3-5f7e-4a75-b29f-be4b21a76417 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:11.732943 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3e5f48d3-5f7e-4a75-b29f-be4b21a76417 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:11.733673 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3e5f48d3-5f7e-4a75-b29f-be4b21a76417 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:11.734137 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3e5f48d3-5f7e-4a75-b29f-be4b21a76417 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:11.734574 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3e5f48d3-5f7e-4a75-b29f-be4b21a76417 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:11.864532 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-3e5f48d3-5f7e-4a75-b29f-be4b21a76417 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f67ee6767314bfb9cc04ea9c0dafb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0652fe65874b4606822aa7f261387bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:38:11.872786 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-3e5f48d3-5f7e-4a75-b29f-be4b21a76417 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "GET /compute/v2.1/servers/90c30ac8-f581-4ee8-b40d-f752a9cd384e" status: 200 len: 1730 microversion: 2.1 time: 0.152905 Oct 04 19:38:11.873393 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3452/7273] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:38:11 2022] GET /compute/v2.1/servers/90c30ac8-f581-4ee8-b40d-f752a9cd384e => generated 1730 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:38:12.895834 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f7225c87-0187-4b87-b006-d1710cb8ac20 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:38:12.896459 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-f7225c87-0187-4b87-b006-d1710cb8ac20 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: 90c30ac8-f581-4ee8-b40d-f752a9cd384e] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:38:12.903301 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f7225c87-0187-4b87-b006-d1710cb8ac20 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:12.903803 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f7225c87-0187-4b87-b006-d1710cb8ac20 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:12.904257 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f7225c87-0187-4b87-b006-d1710cb8ac20 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:12.904989 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f7225c87-0187-4b87-b006-d1710cb8ac20 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:12.905485 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f7225c87-0187-4b87-b006-d1710cb8ac20 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:12.905927 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f7225c87-0187-4b87-b006-d1710cb8ac20 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:13.035240 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-f7225c87-0187-4b87-b006-d1710cb8ac20 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f67ee6767314bfb9cc04ea9c0dafb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0652fe65874b4606822aa7f261387bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:38:13.043627 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-f7225c87-0187-4b87-b006-d1710cb8ac20 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "GET /compute/v2.1/servers/90c30ac8-f581-4ee8-b40d-f752a9cd384e" status: 200 len: 1730 microversion: 2.1 time: 0.151676 Oct 04 19:38:13.044697 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3822/7274] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:38:12 2022] GET /compute/v2.1/servers/90c30ac8-f581-4ee8-b40d-f752a9cd384e => generated 1730 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:38:14.067814 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-cfb204d5-9664-4fb6-a37b-cf047e6af559 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:38:14.068429 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-cfb204d5-9664-4fb6-a37b-cf047e6af559 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: 90c30ac8-f581-4ee8-b40d-f752a9cd384e] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:38:14.075654 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cfb204d5-9664-4fb6-a37b-cf047e6af559 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:14.076901 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cfb204d5-9664-4fb6-a37b-cf047e6af559 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:14.077054 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cfb204d5-9664-4fb6-a37b-cf047e6af559 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:14.077906 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cfb204d5-9664-4fb6-a37b-cf047e6af559 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:14.078414 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cfb204d5-9664-4fb6-a37b-cf047e6af559 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:14.078845 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cfb204d5-9664-4fb6-a37b-cf047e6af559 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:14.211309 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-cfb204d5-9664-4fb6-a37b-cf047e6af559 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f67ee6767314bfb9cc04ea9c0dafb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0652fe65874b4606822aa7f261387bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:38:14.219776 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-cfb204d5-9664-4fb6-a37b-cf047e6af559 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "GET /compute/v2.1/servers/90c30ac8-f581-4ee8-b40d-f752a9cd384e" status: 200 len: 1730 microversion: 2.1 time: 0.155864 Oct 04 19:38:14.220342 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3453/7275] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:38:14 2022] GET /compute/v2.1/servers/90c30ac8-f581-4ee8-b40d-f752a9cd384e => generated 1730 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:38:15.244697 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-93c0235d-1c15-411b-8b08-48b61d9b9586 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:38:15.245374 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-93c0235d-1c15-411b-8b08-48b61d9b9586 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: 90c30ac8-f581-4ee8-b40d-f752a9cd384e] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:38:15.252381 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-93c0235d-1c15-411b-8b08-48b61d9b9586 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:15.252887 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-93c0235d-1c15-411b-8b08-48b61d9b9586 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:15.253373 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-93c0235d-1c15-411b-8b08-48b61d9b9586 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:15.254082 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-93c0235d-1c15-411b-8b08-48b61d9b9586 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:15.254551 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-93c0235d-1c15-411b-8b08-48b61d9b9586 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:15.255028 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-93c0235d-1c15-411b-8b08-48b61d9b9586 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:15.382000 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-93c0235d-1c15-411b-8b08-48b61d9b9586 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f67ee6767314bfb9cc04ea9c0dafb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0652fe65874b4606822aa7f261387bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:38:15.390690 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-93c0235d-1c15-411b-8b08-48b61d9b9586 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "GET /compute/v2.1/servers/90c30ac8-f581-4ee8-b40d-f752a9cd384e" status: 200 len: 1730 microversion: 2.1 time: 0.150544 Oct 04 19:38:15.391259 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3823/7276] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:38:15 2022] GET /compute/v2.1/servers/90c30ac8-f581-4ee8-b40d-f752a9cd384e => generated 1730 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:38:16.413797 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-edfb6cde-4c04-4bde-9bbd-7a18befb4559 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:38:16.414419 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-edfb6cde-4c04-4bde-9bbd-7a18befb4559 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: 90c30ac8-f581-4ee8-b40d-f752a9cd384e] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:38:16.421938 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-edfb6cde-4c04-4bde-9bbd-7a18befb4559 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:16.422432 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-edfb6cde-4c04-4bde-9bbd-7a18befb4559 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:16.422869 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-edfb6cde-4c04-4bde-9bbd-7a18befb4559 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:16.423612 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-edfb6cde-4c04-4bde-9bbd-7a18befb4559 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:16.424161 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-edfb6cde-4c04-4bde-9bbd-7a18befb4559 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:16.424606 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-edfb6cde-4c04-4bde-9bbd-7a18befb4559 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:16.553395 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-edfb6cde-4c04-4bde-9bbd-7a18befb4559 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f67ee6767314bfb9cc04ea9c0dafb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0652fe65874b4606822aa7f261387bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:38:16.561556 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-edfb6cde-4c04-4bde-9bbd-7a18befb4559 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "GET /compute/v2.1/servers/90c30ac8-f581-4ee8-b40d-f752a9cd384e" status: 200 len: 1730 microversion: 2.1 time: 0.151634 Oct 04 19:38:16.562122 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3454/7277] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:38:16 2022] GET /compute/v2.1/servers/90c30ac8-f581-4ee8-b40d-f752a9cd384e => generated 1730 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:38:17.585136 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-2b61fb06-616e-47d6-93ba-39822a31a667 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:38:17.585817 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-2b61fb06-616e-47d6-93ba-39822a31a667 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: 90c30ac8-f581-4ee8-b40d-f752a9cd384e] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:38:17.592571 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2b61fb06-616e-47d6-93ba-39822a31a667 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:17.593076 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2b61fb06-616e-47d6-93ba-39822a31a667 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:17.593625 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2b61fb06-616e-47d6-93ba-39822a31a667 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:17.594334 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2b61fb06-616e-47d6-93ba-39822a31a667 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:17.594807 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2b61fb06-616e-47d6-93ba-39822a31a667 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:17.595253 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2b61fb06-616e-47d6-93ba-39822a31a667 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:17.727843 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-2b61fb06-616e-47d6-93ba-39822a31a667 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f67ee6767314bfb9cc04ea9c0dafb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0652fe65874b4606822aa7f261387bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:38:17.736803 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-2b61fb06-616e-47d6-93ba-39822a31a667 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "GET /compute/v2.1/servers/90c30ac8-f581-4ee8-b40d-f752a9cd384e" status: 200 len: 1730 microversion: 2.1 time: 0.155742 Oct 04 19:38:17.737408 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3824/7278] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:38:17 2022] GET /compute/v2.1/servers/90c30ac8-f581-4ee8-b40d-f752a9cd384e => generated 1730 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:38:18.760674 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-365bc93a-2151-4283-a10f-4921cf09eca6 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:38:18.761320 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-365bc93a-2151-4283-a10f-4921cf09eca6 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: 90c30ac8-f581-4ee8-b40d-f752a9cd384e] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:38:18.768743 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-365bc93a-2151-4283-a10f-4921cf09eca6 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:18.769258 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-365bc93a-2151-4283-a10f-4921cf09eca6 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:18.769705 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-365bc93a-2151-4283-a10f-4921cf09eca6 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:18.770400 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-365bc93a-2151-4283-a10f-4921cf09eca6 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:18.770864 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-365bc93a-2151-4283-a10f-4921cf09eca6 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:18.771297 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-365bc93a-2151-4283-a10f-4921cf09eca6 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:18.906225 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-365bc93a-2151-4283-a10f-4921cf09eca6 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f67ee6767314bfb9cc04ea9c0dafb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0652fe65874b4606822aa7f261387bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:38:18.914536 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-365bc93a-2151-4283-a10f-4921cf09eca6 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "GET /compute/v2.1/servers/90c30ac8-f581-4ee8-b40d-f752a9cd384e" status: 200 len: 1730 microversion: 2.1 time: 0.157806 Oct 04 19:38:18.915137 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3455/7279] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:38:18 2022] GET /compute/v2.1/servers/90c30ac8-f581-4ee8-b40d-f752a9cd384e => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:38:19.938532 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-03ab7576-fe87-45c8-a16c-27b9bcdd7ec0 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:38:19.939156 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-03ab7576-fe87-45c8-a16c-27b9bcdd7ec0 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: 90c30ac8-f581-4ee8-b40d-f752a9cd384e] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:38:19.946138 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-03ab7576-fe87-45c8-a16c-27b9bcdd7ec0 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:19.946633 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-03ab7576-fe87-45c8-a16c-27b9bcdd7ec0 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:19.947085 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-03ab7576-fe87-45c8-a16c-27b9bcdd7ec0 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:19.947782 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-03ab7576-fe87-45c8-a16c-27b9bcdd7ec0 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:19.948246 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-03ab7576-fe87-45c8-a16c-27b9bcdd7ec0 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:19.948684 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-03ab7576-fe87-45c8-a16c-27b9bcdd7ec0 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:20.078606 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-03ab7576-fe87-45c8-a16c-27b9bcdd7ec0 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f67ee6767314bfb9cc04ea9c0dafb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0652fe65874b4606822aa7f261387bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:38:20.086965 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-03ab7576-fe87-45c8-a16c-27b9bcdd7ec0 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "GET /compute/v2.1/servers/90c30ac8-f581-4ee8-b40d-f752a9cd384e" status: 200 len: 1730 microversion: 2.1 time: 0.152418 Oct 04 19:38:20.087537 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3825/7280] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:38:19 2022] GET /compute/v2.1/servers/90c30ac8-f581-4ee8-b40d-f752a9cd384e => generated 1730 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:38:21.110747 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-8d07a509-81a2-4c4f-a3d3-04c3d4357539 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:38:21.111371 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-8d07a509-81a2-4c4f-a3d3-04c3d4357539 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: 90c30ac8-f581-4ee8-b40d-f752a9cd384e] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:38:21.118995 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8d07a509-81a2-4c4f-a3d3-04c3d4357539 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:21.119528 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8d07a509-81a2-4c4f-a3d3-04c3d4357539 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:21.120019 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8d07a509-81a2-4c4f-a3d3-04c3d4357539 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:21.120785 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8d07a509-81a2-4c4f-a3d3-04c3d4357539 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:21.121279 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8d07a509-81a2-4c4f-a3d3-04c3d4357539 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:21.121765 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8d07a509-81a2-4c4f-a3d3-04c3d4357539 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:21.252599 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-8d07a509-81a2-4c4f-a3d3-04c3d4357539 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f67ee6767314bfb9cc04ea9c0dafb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0652fe65874b4606822aa7f261387bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:38:21.260828 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-8d07a509-81a2-4c4f-a3d3-04c3d4357539 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "GET /compute/v2.1/servers/90c30ac8-f581-4ee8-b40d-f752a9cd384e" status: 200 len: 1730 microversion: 2.1 time: 0.154604 Oct 04 19:38:21.261435 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3456/7281] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:38:21 2022] GET /compute/v2.1/servers/90c30ac8-f581-4ee8-b40d-f752a9cd384e => generated 1730 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:38:22.283759 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f760479a-a195-4a93-b274-52100299019f tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:38:22.284397 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-f760479a-a195-4a93-b274-52100299019f tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: 90c30ac8-f581-4ee8-b40d-f752a9cd384e] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:38:22.291984 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f760479a-a195-4a93-b274-52100299019f tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:22.292499 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f760479a-a195-4a93-b274-52100299019f tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:22.292960 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f760479a-a195-4a93-b274-52100299019f tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:22.293696 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f760479a-a195-4a93-b274-52100299019f tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:22.294170 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f760479a-a195-4a93-b274-52100299019f tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:22.294614 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f760479a-a195-4a93-b274-52100299019f tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:22.431824 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-f760479a-a195-4a93-b274-52100299019f tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f67ee6767314bfb9cc04ea9c0dafb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0652fe65874b4606822aa7f261387bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:38:22.441077 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-f760479a-a195-4a93-b274-52100299019f tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "GET /compute/v2.1/servers/90c30ac8-f581-4ee8-b40d-f752a9cd384e" status: 200 len: 1730 microversion: 2.1 time: 0.161191 Oct 04 19:38:22.441690 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3826/7282] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:38:22 2022] GET /compute/v2.1/servers/90c30ac8-f581-4ee8-b40d-f752a9cd384e => generated 1730 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:38:23.465083 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-cda39928-3352-464b-9a4d-1938cf8912bf tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:38:23.465640 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-cda39928-3352-464b-9a4d-1938cf8912bf tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: 90c30ac8-f581-4ee8-b40d-f752a9cd384e] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:38:23.473062 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cda39928-3352-464b-9a4d-1938cf8912bf tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:23.473585 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cda39928-3352-464b-9a4d-1938cf8912bf tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:23.474025 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cda39928-3352-464b-9a4d-1938cf8912bf tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:23.474721 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cda39928-3352-464b-9a4d-1938cf8912bf tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:23.475176 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cda39928-3352-464b-9a4d-1938cf8912bf tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:23.475604 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cda39928-3352-464b-9a4d-1938cf8912bf tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:23.604907 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-cda39928-3352-464b-9a4d-1938cf8912bf tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f67ee6767314bfb9cc04ea9c0dafb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0652fe65874b4606822aa7f261387bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:38:23.613371 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-cda39928-3352-464b-9a4d-1938cf8912bf tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "GET /compute/v2.1/servers/90c30ac8-f581-4ee8-b40d-f752a9cd384e" status: 200 len: 1730 microversion: 2.1 time: 0.152504 Oct 04 19:38:23.614014 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3457/7283] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:38:23 2022] GET /compute/v2.1/servers/90c30ac8-f581-4ee8-b40d-f752a9cd384e => generated 1730 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:38:24.615274 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-eb74f285-1a84-45aa-8d45-ab4a3f180318 req-0a66b266-3841-4f51-b02b-10b10a4af955 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90c30ac8-f581-4ee8-b40d-f752a9cd384e", "name": "network-vif-unplugged", "status": "completed", "tag": "0187505e-b0e5-4e5d-9f1d-c19a718eeff3"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:38:24.626421 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-eb74f285-1a84-45aa-8d45-ab4a3f180318 req-0a66b266-3841-4f51-b02b-10b10a4af955 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:24.626955 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-eb74f285-1a84-45aa-8d45-ab4a3f180318 req-0a66b266-3841-4f51-b02b-10b10a4af955 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:24.627403 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-eb74f285-1a84-45aa-8d45-ab4a3f180318 req-0a66b266-3841-4f51-b02b-10b10a4af955 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:24.636294 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-74cf9550-ce2b-417c-987b-aab1bdf1584e tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:38:24.637931 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-74cf9550-ce2b-417c-987b-aab1bdf1584e tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: 90c30ac8-f581-4ee8-b40d-f752a9cd384e] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:38:24.642388 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-eb74f285-1a84-45aa-8d45-ab4a3f180318 req-0a66b266-3841-4f51-b02b-10b10a4af955 service nova] Creating event network-vif-unplugged:0187505e-b0e5-4e5d-9f1d-c19a718eeff3 for instance 90c30ac8-f581-4ee8-b40d-f752a9cd384e on n-h1-851028-13 Oct 04 19:38:24.645642 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-74cf9550-ce2b-417c-987b-aab1bdf1584e tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:24.646497 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-74cf9550-ce2b-417c-987b-aab1bdf1584e tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:24.647153 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-74cf9550-ce2b-417c-987b-aab1bdf1584e tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:24.648116 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [req-eb74f285-1a84-45aa-8d45-ab4a3f180318 req-0a66b266-3841-4f51-b02b-10b10a4af955 service nova] Instance 90c30ac8-f581-4ee8-b40d-f752a9cd384e is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851028-13', 'n-h2-851028-13'} {{(pid=123596) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 19:38:24.648541 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-74cf9550-ce2b-417c-987b-aab1bdf1584e tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:24.649228 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-74cf9550-ce2b-417c-987b-aab1bdf1584e tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:24.649863 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-74cf9550-ce2b-417c-987b-aab1bdf1584e tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:24.661038 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-eb74f285-1a84-45aa-8d45-ab4a3f180318 req-0a66b266-3841-4f51-b02b-10b10a4af955 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049256 Oct 04 19:38:24.662001 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3827/7284] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:38:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:38:25.155016 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-74cf9550-ce2b-417c-987b-aab1bdf1584e tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f67ee6767314bfb9cc04ea9c0dafb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0652fe65874b4606822aa7f261387bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:38:25.163329 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-74cf9550-ce2b-417c-987b-aab1bdf1584e tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "GET /compute/v2.1/servers/90c30ac8-f581-4ee8-b40d-f752a9cd384e" status: 200 len: 1729 microversion: 2.1 time: 0.531153 Oct 04 19:38:25.163912 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3458/7285] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:38:24 2022] GET /compute/v2.1/servers/90c30ac8-f581-4ee8-b40d-f752a9cd384e => generated 1729 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:38:26.187876 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-a9dc791b-3b47-4396-9da5-eeeb26cfcc07 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:38:26.188598 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-a9dc791b-3b47-4396-9da5-eeeb26cfcc07 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: 90c30ac8-f581-4ee8-b40d-f752a9cd384e] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:38:26.195914 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a9dc791b-3b47-4396-9da5-eeeb26cfcc07 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:26.196443 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a9dc791b-3b47-4396-9da5-eeeb26cfcc07 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:26.196902 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a9dc791b-3b47-4396-9da5-eeeb26cfcc07 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:26.197645 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a9dc791b-3b47-4396-9da5-eeeb26cfcc07 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:26.198117 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a9dc791b-3b47-4396-9da5-eeeb26cfcc07 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:26.198563 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a9dc791b-3b47-4396-9da5-eeeb26cfcc07 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:26.335162 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-a9dc791b-3b47-4396-9da5-eeeb26cfcc07 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f67ee6767314bfb9cc04ea9c0dafb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0652fe65874b4606822aa7f261387bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:38:26.344279 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-a9dc791b-3b47-4396-9da5-eeeb26cfcc07 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "GET /compute/v2.1/servers/90c30ac8-f581-4ee8-b40d-f752a9cd384e" status: 200 len: 1727 microversion: 2.1 time: 0.160718 Oct 04 19:38:26.344872 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3828/7286] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:38:26 2022] GET /compute/v2.1/servers/90c30ac8-f581-4ee8-b40d-f752a9cd384e => generated 1727 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:38:26.689443 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-0db35e32-daa0-41b0-94d5-57870608166d req-c39ee4e8-2595-44ac-ac2d-1946ff289b3a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90c30ac8-f581-4ee8-b40d-f752a9cd384e", "tag": "0187505e-b0e5-4e5d-9f1d-c19a718eeff3"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:38:26.699604 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-0db35e32-daa0-41b0-94d5-57870608166d req-c39ee4e8-2595-44ac-ac2d-1946ff289b3a service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:26.700126 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-0db35e32-daa0-41b0-94d5-57870608166d req-c39ee4e8-2595-44ac-ac2d-1946ff289b3a service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:26.700573 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-0db35e32-daa0-41b0-94d5-57870608166d req-c39ee4e8-2595-44ac-ac2d-1946ff289b3a service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:26.712690 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-0db35e32-daa0-41b0-94d5-57870608166d req-c39ee4e8-2595-44ac-ac2d-1946ff289b3a service nova] Creating event network-changed:0187505e-b0e5-4e5d-9f1d-c19a718eeff3 for instance 90c30ac8-f581-4ee8-b40d-f752a9cd384e on n-h1-851028-13 Oct 04 19:38:26.719056 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [req-0db35e32-daa0-41b0-94d5-57870608166d req-c39ee4e8-2595-44ac-ac2d-1946ff289b3a service nova] Instance 90c30ac8-f581-4ee8-b40d-f752a9cd384e is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851028-13', 'n-h2-851028-13'} {{(pid=123595) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 19:38:26.730107 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-0db35e32-daa0-41b0-94d5-57870608166d req-c39ee4e8-2595-44ac-ac2d-1946ff289b3a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044491 Oct 04 19:38:26.730754 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3459/7287] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:38:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:38:27.368058 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-ba1f5b40-694b-4a9c-a884-44c3ce4505fd tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:38:27.369305 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-ba1f5b40-694b-4a9c-a884-44c3ce4505fd tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: 90c30ac8-f581-4ee8-b40d-f752a9cd384e] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:38:27.376526 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ba1f5b40-694b-4a9c-a884-44c3ce4505fd tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:27.377737 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ba1f5b40-694b-4a9c-a884-44c3ce4505fd tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:27.377737 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ba1f5b40-694b-4a9c-a884-44c3ce4505fd tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:27.378666 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ba1f5b40-694b-4a9c-a884-44c3ce4505fd tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:27.378994 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ba1f5b40-694b-4a9c-a884-44c3ce4505fd tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:27.379579 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ba1f5b40-694b-4a9c-a884-44c3ce4505fd tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:27.518037 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-ba1f5b40-694b-4a9c-a884-44c3ce4505fd tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f67ee6767314bfb9cc04ea9c0dafb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0652fe65874b4606822aa7f261387bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:38:27.526728 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-ba1f5b40-694b-4a9c-a884-44c3ce4505fd tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "GET /compute/v2.1/servers/90c30ac8-f581-4ee8-b40d-f752a9cd384e" status: 200 len: 1727 microversion: 2.1 time: 0.162694 Oct 04 19:38:27.527301 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3829/7288] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:38:27 2022] GET /compute/v2.1/servers/90c30ac8-f581-4ee8-b40d-f752a9cd384e => generated 1727 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:38:28.552262 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-2728dda2-3b08-406a-9a7c-400120776913 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:38:28.552879 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-2728dda2-3b08-406a-9a7c-400120776913 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: 90c30ac8-f581-4ee8-b40d-f752a9cd384e] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:38:28.559152 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2728dda2-3b08-406a-9a7c-400120776913 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:28.559648 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2728dda2-3b08-406a-9a7c-400120776913 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:28.560097 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2728dda2-3b08-406a-9a7c-400120776913 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:28.560800 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2728dda2-3b08-406a-9a7c-400120776913 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:28.561295 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2728dda2-3b08-406a-9a7c-400120776913 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:28.561735 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2728dda2-3b08-406a-9a7c-400120776913 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:28.696158 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-2728dda2-3b08-406a-9a7c-400120776913 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f67ee6767314bfb9cc04ea9c0dafb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0652fe65874b4606822aa7f261387bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:38:28.705137 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-2728dda2-3b08-406a-9a7c-400120776913 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "GET /compute/v2.1/servers/90c30ac8-f581-4ee8-b40d-f752a9cd384e" status: 200 len: 1727 microversion: 2.1 time: 0.158210 Oct 04 19:38:28.705717 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3460/7289] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:38:28 2022] GET /compute/v2.1/servers/90c30ac8-f581-4ee8-b40d-f752a9cd384e => generated 1727 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:38:29.729194 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-5931f2b3-b320-423f-aa95-81aa0b6a7829 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:38:29.729925 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-5931f2b3-b320-423f-aa95-81aa0b6a7829 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: 90c30ac8-f581-4ee8-b40d-f752a9cd384e] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:38:29.737484 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5931f2b3-b320-423f-aa95-81aa0b6a7829 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:29.738058 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5931f2b3-b320-423f-aa95-81aa0b6a7829 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:29.738584 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5931f2b3-b320-423f-aa95-81aa0b6a7829 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:29.739291 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5931f2b3-b320-423f-aa95-81aa0b6a7829 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:29.739759 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5931f2b3-b320-423f-aa95-81aa0b6a7829 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:29.740199 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5931f2b3-b320-423f-aa95-81aa0b6a7829 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:29.868582 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-5931f2b3-b320-423f-aa95-81aa0b6a7829 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f67ee6767314bfb9cc04ea9c0dafb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0652fe65874b4606822aa7f261387bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:38:29.876951 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-5931f2b3-b320-423f-aa95-81aa0b6a7829 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "GET /compute/v2.1/servers/90c30ac8-f581-4ee8-b40d-f752a9cd384e" status: 200 len: 1727 microversion: 2.1 time: 0.151764 Oct 04 19:38:29.877554 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3830/7290] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:38:29 2022] GET /compute/v2.1/servers/90c30ac8-f581-4ee8-b40d-f752a9cd384e => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:38:30.900248 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-d5ec54ea-d19b-4816-a5cb-083d5fe5ff4c tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:38:30.900874 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-d5ec54ea-d19b-4816-a5cb-083d5fe5ff4c tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: 90c30ac8-f581-4ee8-b40d-f752a9cd384e] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:38:30.907837 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d5ec54ea-d19b-4816-a5cb-083d5fe5ff4c tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:30.908339 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d5ec54ea-d19b-4816-a5cb-083d5fe5ff4c tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:30.908784 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d5ec54ea-d19b-4816-a5cb-083d5fe5ff4c tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:30.909511 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d5ec54ea-d19b-4816-a5cb-083d5fe5ff4c tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:30.909975 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d5ec54ea-d19b-4816-a5cb-083d5fe5ff4c tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:30.910441 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d5ec54ea-d19b-4816-a5cb-083d5fe5ff4c tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:31.040168 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-d5ec54ea-d19b-4816-a5cb-083d5fe5ff4c tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f67ee6767314bfb9cc04ea9c0dafb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0652fe65874b4606822aa7f261387bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:38:31.049154 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-d5ec54ea-d19b-4816-a5cb-083d5fe5ff4c tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "GET /compute/v2.1/servers/90c30ac8-f581-4ee8-b40d-f752a9cd384e" status: 200 len: 1727 microversion: 2.1 time: 0.152762 Oct 04 19:38:31.049751 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3461/7291] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:38:30 2022] GET /compute/v2.1/servers/90c30ac8-f581-4ee8-b40d-f752a9cd384e => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:38:32.072828 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-895c7d9d-d7ab-4d39-9fee-8855426e5ca6 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:38:32.073501 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-895c7d9d-d7ab-4d39-9fee-8855426e5ca6 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: 90c30ac8-f581-4ee8-b40d-f752a9cd384e] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:38:32.080374 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-895c7d9d-d7ab-4d39-9fee-8855426e5ca6 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:32.080880 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-895c7d9d-d7ab-4d39-9fee-8855426e5ca6 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:32.081365 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-895c7d9d-d7ab-4d39-9fee-8855426e5ca6 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:32.082075 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-895c7d9d-d7ab-4d39-9fee-8855426e5ca6 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:32.082553 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-895c7d9d-d7ab-4d39-9fee-8855426e5ca6 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:32.083001 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-895c7d9d-d7ab-4d39-9fee-8855426e5ca6 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:32.224537 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-895c7d9d-d7ab-4d39-9fee-8855426e5ca6 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f67ee6767314bfb9cc04ea9c0dafb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0652fe65874b4606822aa7f261387bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:38:32.233554 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-895c7d9d-d7ab-4d39-9fee-8855426e5ca6 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "GET /compute/v2.1/servers/90c30ac8-f581-4ee8-b40d-f752a9cd384e" status: 200 len: 1727 microversion: 2.1 time: 0.164653 Oct 04 19:38:32.234164 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3831/7292] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:38:32 2022] GET /compute/v2.1/servers/90c30ac8-f581-4ee8-b40d-f752a9cd384e => generated 1727 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:38:33.256494 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-1f1f72b0-ae77-4a71-a168-70837c814131 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:38:33.257133 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-1f1f72b0-ae77-4a71-a168-70837c814131 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: 90c30ac8-f581-4ee8-b40d-f752a9cd384e] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:38:33.259906 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_api:SELECT=33 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:38:33.265260 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1f1f72b0-ae77-4a71-a168-70837c814131 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:33.265740 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1f1f72b0-ae77-4a71-a168-70837c814131 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:33.266176 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1f1f72b0-ae77-4a71-a168-70837c814131 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:33.266866 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1f1f72b0-ae77-4a71-a168-70837c814131 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:33.267319 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1f1f72b0-ae77-4a71-a168-70837c814131 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:33.267745 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1f1f72b0-ae77-4a71-a168-70837c814131 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:33.270493 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:38:33.445343 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-1f1f72b0-ae77-4a71-a168-70837c814131 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f67ee6767314bfb9cc04ea9c0dafb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0652fe65874b4606822aa7f261387bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:38:33.453633 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-1f1f72b0-ae77-4a71-a168-70837c814131 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "GET /compute/v2.1/servers/90c30ac8-f581-4ee8-b40d-f752a9cd384e" status: 200 len: 1727 microversion: 2.1 time: 0.201007 Oct 04 19:38:33.454217 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3462/7293] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:38:33 2022] GET /compute/v2.1/servers/90c30ac8-f581-4ee8-b40d-f752a9cd384e => generated 1727 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:38:34.477798 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f00f5155-f338-4e15-ade4-48097b91e557 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:38:34.478468 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-f00f5155-f338-4e15-ade4-48097b91e557 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: 90c30ac8-f581-4ee8-b40d-f752a9cd384e] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:38:34.481316 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_api:SELECT=29 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:38:34.486622 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f00f5155-f338-4e15-ade4-48097b91e557 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:34.487129 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f00f5155-f338-4e15-ade4-48097b91e557 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:34.487592 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f00f5155-f338-4e15-ade4-48097b91e557 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:34.488303 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f00f5155-f338-4e15-ade4-48097b91e557 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:34.488779 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f00f5155-f338-4e15-ade4-48097b91e557 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:34.489330 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f00f5155-f338-4e15-ade4-48097b91e557 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:34.492102 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=83 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:38:34.620085 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-f00f5155-f338-4e15-ade4-48097b91e557 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f67ee6767314bfb9cc04ea9c0dafb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0652fe65874b4606822aa7f261387bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:38:34.628921 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-f00f5155-f338-4e15-ade4-48097b91e557 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "GET /compute/v2.1/servers/90c30ac8-f581-4ee8-b40d-f752a9cd384e" status: 200 len: 1727 microversion: 2.1 time: 0.155036 Oct 04 19:38:34.629561 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3832/7294] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:38:34 2022] GET /compute/v2.1/servers/90c30ac8-f581-4ee8-b40d-f752a9cd384e => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:38:35.652909 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-58a4b6ed-13bb-4b00-9c1d-1a1ce7b409b7 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:38:35.653470 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-58a4b6ed-13bb-4b00-9c1d-1a1ce7b409b7 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: 90c30ac8-f581-4ee8-b40d-f752a9cd384e] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:38:35.660912 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-58a4b6ed-13bb-4b00-9c1d-1a1ce7b409b7 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:35.661441 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-58a4b6ed-13bb-4b00-9c1d-1a1ce7b409b7 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:35.661881 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-58a4b6ed-13bb-4b00-9c1d-1a1ce7b409b7 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:35.662573 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-58a4b6ed-13bb-4b00-9c1d-1a1ce7b409b7 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:35.663060 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-58a4b6ed-13bb-4b00-9c1d-1a1ce7b409b7 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:35.663598 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-58a4b6ed-13bb-4b00-9c1d-1a1ce7b409b7 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:35.793231 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-58a4b6ed-13bb-4b00-9c1d-1a1ce7b409b7 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f67ee6767314bfb9cc04ea9c0dafb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0652fe65874b4606822aa7f261387bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:38:35.801524 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-58a4b6ed-13bb-4b00-9c1d-1a1ce7b409b7 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "GET /compute/v2.1/servers/90c30ac8-f581-4ee8-b40d-f752a9cd384e" status: 200 len: 1727 microversion: 2.1 time: 0.152674 Oct 04 19:38:35.802107 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3463/7295] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:38:35 2022] GET /compute/v2.1/servers/90c30ac8-f581-4ee8-b40d-f752a9cd384e => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:38:36.824695 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-e33f0ef3-bcf0-4863-b726-4e0385c99ffd tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:38:36.825360 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-e33f0ef3-bcf0-4863-b726-4e0385c99ffd tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: 90c30ac8-f581-4ee8-b40d-f752a9cd384e] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:38:36.832839 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e33f0ef3-bcf0-4863-b726-4e0385c99ffd tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:36.833395 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e33f0ef3-bcf0-4863-b726-4e0385c99ffd tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:36.833853 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e33f0ef3-bcf0-4863-b726-4e0385c99ffd tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:36.834560 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e33f0ef3-bcf0-4863-b726-4e0385c99ffd tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:36.835032 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e33f0ef3-bcf0-4863-b726-4e0385c99ffd tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:36.835478 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e33f0ef3-bcf0-4863-b726-4e0385c99ffd tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:36.968487 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-e33f0ef3-bcf0-4863-b726-4e0385c99ffd tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f67ee6767314bfb9cc04ea9c0dafb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0652fe65874b4606822aa7f261387bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:38:36.976897 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-e33f0ef3-bcf0-4863-b726-4e0385c99ffd tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "GET /compute/v2.1/servers/90c30ac8-f581-4ee8-b40d-f752a9cd384e" status: 200 len: 1727 microversion: 2.1 time: 0.156193 Oct 04 19:38:36.977544 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3833/7296] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:38:36 2022] GET /compute/v2.1/servers/90c30ac8-f581-4ee8-b40d-f752a9cd384e => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:38:37.999883 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-d750e3de-6b2b-4d29-807b-c58007f5e81b tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:38:38.000433 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-d750e3de-6b2b-4d29-807b-c58007f5e81b tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: 90c30ac8-f581-4ee8-b40d-f752a9cd384e] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:38:38.007432 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d750e3de-6b2b-4d29-807b-c58007f5e81b tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:38.007945 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d750e3de-6b2b-4d29-807b-c58007f5e81b tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:38.008391 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d750e3de-6b2b-4d29-807b-c58007f5e81b tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:38.009189 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d750e3de-6b2b-4d29-807b-c58007f5e81b tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:38.009588 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d750e3de-6b2b-4d29-807b-c58007f5e81b tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:38.010016 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d750e3de-6b2b-4d29-807b-c58007f5e81b tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:38.141585 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-d750e3de-6b2b-4d29-807b-c58007f5e81b tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f67ee6767314bfb9cc04ea9c0dafb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0652fe65874b4606822aa7f261387bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:38:38.149773 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-d750e3de-6b2b-4d29-807b-c58007f5e81b tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "GET /compute/v2.1/servers/90c30ac8-f581-4ee8-b40d-f752a9cd384e" status: 200 len: 1724 microversion: 2.1 time: 0.153885 Oct 04 19:38:38.150340 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3464/7297] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:38:37 2022] GET /compute/v2.1/servers/90c30ac8-f581-4ee8-b40d-f752a9cd384e => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:38:38.172773 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-e81d8bf4-cd22-46bb-9d4b-e83962ff2f26 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:38:38.173408 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-e81d8bf4-cd22-46bb-9d4b-e83962ff2f26 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: 90c30ac8-f581-4ee8-b40d-f752a9cd384e] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:38:38.180243 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e81d8bf4-cd22-46bb-9d4b-e83962ff2f26 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:38.180751 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e81d8bf4-cd22-46bb-9d4b-e83962ff2f26 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:38.181263 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e81d8bf4-cd22-46bb-9d4b-e83962ff2f26 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:38.181975 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e81d8bf4-cd22-46bb-9d4b-e83962ff2f26 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:38.182451 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e81d8bf4-cd22-46bb-9d4b-e83962ff2f26 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:38.182899 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e81d8bf4-cd22-46bb-9d4b-e83962ff2f26 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:38.222890 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e81d8bf4-cd22-46bb-9d4b-e83962ff2f26 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:38.223388 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e81d8bf4-cd22-46bb-9d4b-e83962ff2f26 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:38.223851 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e81d8bf4-cd22-46bb-9d4b-e83962ff2f26 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:38.224589 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e81d8bf4-cd22-46bb-9d4b-e83962ff2f26 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:38.225064 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e81d8bf4-cd22-46bb-9d4b-e83962ff2f26 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:38.225538 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e81d8bf4-cd22-46bb-9d4b-e83962ff2f26 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:38.245476 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-e81d8bf4-cd22-46bb-9d4b-e83962ff2f26 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Getting quotas for project 0652fe65874b4606822aa7f261387bc8. Resources: {'ram', 'cores'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:38:38.250710 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-e81d8bf4-cd22-46bb-9d4b-e83962ff2f26 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Getting quotas for user 0f67ee6767314bfb9cc04ea9c0dafb4b and project 0652fe65874b4606822aa7f261387bc8. Resources: {'ram', 'cores'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:38:38.349829 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-e81d8bf4-cd22-46bb-9d4b-e83962ff2f26 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "POST /compute/v2.1/servers/90c30ac8-f581-4ee8-b40d-f752a9cd384e/action" status: 202 len: 0 microversion: 2.1 time: 0.180744 Oct 04 19:38:38.350486 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3834/7298] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 19:38:38 2022] POST /compute/v2.1/servers/90c30ac8-f581-4ee8-b40d-f752a9cd384e/action => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:38:38.358797 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-b3b7b46f-7d67-47c9-af83-f3b2a5a6acf7 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:38:38.359449 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-b3b7b46f-7d67-47c9-af83-f3b2a5a6acf7 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: 90c30ac8-f581-4ee8-b40d-f752a9cd384e] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:38:38.365661 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b3b7b46f-7d67-47c9-af83-f3b2a5a6acf7 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:38.366143 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b3b7b46f-7d67-47c9-af83-f3b2a5a6acf7 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:38.366584 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b3b7b46f-7d67-47c9-af83-f3b2a5a6acf7 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:38.367275 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b3b7b46f-7d67-47c9-af83-f3b2a5a6acf7 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:38.367951 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b3b7b46f-7d67-47c9-af83-f3b2a5a6acf7 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:38.368146 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b3b7b46f-7d67-47c9-af83-f3b2a5a6acf7 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:38.569774 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-b3b7b46f-7d67-47c9-af83-f3b2a5a6acf7 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f67ee6767314bfb9cc04ea9c0dafb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0652fe65874b4606822aa7f261387bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:38:38.578709 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-b3b7b46f-7d67-47c9-af83-f3b2a5a6acf7 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "GET /compute/v2.1/servers/90c30ac8-f581-4ee8-b40d-f752a9cd384e" status: 200 len: 1723 microversion: 2.1 time: 0.223877 Oct 04 19:38:38.579479 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3465/7299] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:38:38 2022] GET /compute/v2.1/servers/90c30ac8-f581-4ee8-b40d-f752a9cd384e => generated 1723 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:38:39.603797 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-82aadb6d-e0b9-4830-af37-0f45eddefd17 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:38:39.604511 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-82aadb6d-e0b9-4830-af37-0f45eddefd17 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: 90c30ac8-f581-4ee8-b40d-f752a9cd384e] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:38:39.610889 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-82aadb6d-e0b9-4830-af37-0f45eddefd17 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:39.611387 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-82aadb6d-e0b9-4830-af37-0f45eddefd17 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:39.611840 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-82aadb6d-e0b9-4830-af37-0f45eddefd17 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:39.612548 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-82aadb6d-e0b9-4830-af37-0f45eddefd17 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:39.613018 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-82aadb6d-e0b9-4830-af37-0f45eddefd17 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:39.613496 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-82aadb6d-e0b9-4830-af37-0f45eddefd17 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:39.746107 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-82aadb6d-e0b9-4830-af37-0f45eddefd17 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f67ee6767314bfb9cc04ea9c0dafb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0652fe65874b4606822aa7f261387bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:38:39.754405 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-82aadb6d-e0b9-4830-af37-0f45eddefd17 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "GET /compute/v2.1/servers/90c30ac8-f581-4ee8-b40d-f752a9cd384e" status: 200 len: 1723 microversion: 2.1 time: 0.155781 Oct 04 19:38:39.754980 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3835/7300] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:38:39 2022] GET /compute/v2.1/servers/90c30ac8-f581-4ee8-b40d-f752a9cd384e => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:38:40.778252 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-86752e7b-af8d-4805-913b-47bf3d136490 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:38:40.778884 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-86752e7b-af8d-4805-913b-47bf3d136490 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: 90c30ac8-f581-4ee8-b40d-f752a9cd384e] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:38:40.786275 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-86752e7b-af8d-4805-913b-47bf3d136490 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:40.786765 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-86752e7b-af8d-4805-913b-47bf3d136490 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:40.787213 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-86752e7b-af8d-4805-913b-47bf3d136490 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:40.787914 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-86752e7b-af8d-4805-913b-47bf3d136490 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:40.788373 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-86752e7b-af8d-4805-913b-47bf3d136490 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:40.788806 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-86752e7b-af8d-4805-913b-47bf3d136490 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:40.918966 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-86752e7b-af8d-4805-913b-47bf3d136490 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f67ee6767314bfb9cc04ea9c0dafb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0652fe65874b4606822aa7f261387bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:38:40.928903 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-86752e7b-af8d-4805-913b-47bf3d136490 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "GET /compute/v2.1/servers/90c30ac8-f581-4ee8-b40d-f752a9cd384e" status: 200 len: 1723 microversion: 2.1 time: 0.154514 Oct 04 19:38:40.939670 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3466/7301] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:38:40 2022] GET /compute/v2.1/servers/90c30ac8-f581-4ee8-b40d-f752a9cd384e => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:38:41.077963 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-4cef6b91-cc5f-4e31-a505-1880801a76d1 req-e98633f3-a044-4902-9744-4a3398ecbfbf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90c30ac8-f581-4ee8-b40d-f752a9cd384e", "name": "network-vif-plugged", "status": "completed", "tag": "0187505e-b0e5-4e5d-9f1d-c19a718eeff3"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:38:41.090780 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-4cef6b91-cc5f-4e31-a505-1880801a76d1 req-e98633f3-a044-4902-9744-4a3398ecbfbf service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:41.091283 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-4cef6b91-cc5f-4e31-a505-1880801a76d1 req-e98633f3-a044-4902-9744-4a3398ecbfbf service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:41.091728 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-4cef6b91-cc5f-4e31-a505-1880801a76d1 req-e98633f3-a044-4902-9744-4a3398ecbfbf service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:41.105349 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-4cef6b91-cc5f-4e31-a505-1880801a76d1 req-e98633f3-a044-4902-9744-4a3398ecbfbf service nova] Creating event network-vif-plugged:0187505e-b0e5-4e5d-9f1d-c19a718eeff3 for instance 90c30ac8-f581-4ee8-b40d-f752a9cd384e on n-h1-851028-13 Oct 04 19:38:41.111255 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [req-4cef6b91-cc5f-4e31-a505-1880801a76d1 req-e98633f3-a044-4902-9744-4a3398ecbfbf service nova] Instance 90c30ac8-f581-4ee8-b40d-f752a9cd384e is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851028-13', 'n-h2-851028-13'} {{(pid=123596) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 19:38:41.122420 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-4cef6b91-cc5f-4e31-a505-1880801a76d1 req-e98633f3-a044-4902-9744-4a3398ecbfbf service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048618 Oct 04 19:38:41.123260 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3836/7302] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:38:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:38:41.955770 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-19ac1eb8-9da1-455e-879e-4440de89a448 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:38:41.956401 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-19ac1eb8-9da1-455e-879e-4440de89a448 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: 90c30ac8-f581-4ee8-b40d-f752a9cd384e] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:38:41.963746 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-19ac1eb8-9da1-455e-879e-4440de89a448 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:41.964436 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-19ac1eb8-9da1-455e-879e-4440de89a448 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:41.964961 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-19ac1eb8-9da1-455e-879e-4440de89a448 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:41.965764 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-19ac1eb8-9da1-455e-879e-4440de89a448 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:41.966232 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-19ac1eb8-9da1-455e-879e-4440de89a448 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:41.966670 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-19ac1eb8-9da1-455e-879e-4440de89a448 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:42.100819 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-19ac1eb8-9da1-455e-879e-4440de89a448 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f67ee6767314bfb9cc04ea9c0dafb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0652fe65874b4606822aa7f261387bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:38:42.109584 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-19ac1eb8-9da1-455e-879e-4440de89a448 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "GET /compute/v2.1/servers/90c30ac8-f581-4ee8-b40d-f752a9cd384e" status: 200 len: 1723 microversion: 2.1 time: 0.157799 Oct 04 19:38:42.110159 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3467/7303] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:38:41 2022] GET /compute/v2.1/servers/90c30ac8-f581-4ee8-b40d-f752a9cd384e => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:38:43.135353 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-b6306ee3-f7b7-4f76-a030-86c0dc67d485 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:38:43.136762 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-b6306ee3-f7b7-4f76-a030-86c0dc67d485 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: 90c30ac8-f581-4ee8-b40d-f752a9cd384e] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:38:43.143549 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b6306ee3-f7b7-4f76-a030-86c0dc67d485 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:43.144048 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b6306ee3-f7b7-4f76-a030-86c0dc67d485 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:43.144528 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b6306ee3-f7b7-4f76-a030-86c0dc67d485 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:43.145274 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b6306ee3-f7b7-4f76-a030-86c0dc67d485 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:43.145728 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b6306ee3-f7b7-4f76-a030-86c0dc67d485 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:43.146169 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b6306ee3-f7b7-4f76-a030-86c0dc67d485 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:43.281137 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-b6306ee3-f7b7-4f76-a030-86c0dc67d485 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f67ee6767314bfb9cc04ea9c0dafb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0652fe65874b4606822aa7f261387bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:38:43.289861 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-b6306ee3-f7b7-4f76-a030-86c0dc67d485 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "GET /compute/v2.1/servers/90c30ac8-f581-4ee8-b40d-f752a9cd384e" status: 200 len: 1723 microversion: 2.1 time: 0.159699 Oct 04 19:38:43.290438 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3837/7304] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:38:43 2022] GET /compute/v2.1/servers/90c30ac8-f581-4ee8-b40d-f752a9cd384e => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:38:43.926861 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-b93fd9ba-aacc-4f96-8d65-914d0ae96772 req-eff40c78-cfe1-4e60-891f-fc3f11e221b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90c30ac8-f581-4ee8-b40d-f752a9cd384e", "name": "network-vif-unplugged", "status": "completed", "tag": "0187505e-b0e5-4e5d-9f1d-c19a718eeff3"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:38:43.937773 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-b93fd9ba-aacc-4f96-8d65-914d0ae96772 req-eff40c78-cfe1-4e60-891f-fc3f11e221b3 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:43.938495 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-b93fd9ba-aacc-4f96-8d65-914d0ae96772 req-eff40c78-cfe1-4e60-891f-fc3f11e221b3 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:43.939094 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-b93fd9ba-aacc-4f96-8d65-914d0ae96772 req-eff40c78-cfe1-4e60-891f-fc3f11e221b3 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:43.955905 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-b93fd9ba-aacc-4f96-8d65-914d0ae96772 req-eff40c78-cfe1-4e60-891f-fc3f11e221b3 service nova] Creating event network-vif-unplugged:0187505e-b0e5-4e5d-9f1d-c19a718eeff3 for instance 90c30ac8-f581-4ee8-b40d-f752a9cd384e on n-h2-851028-13 Oct 04 19:38:43.962636 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [req-b93fd9ba-aacc-4f96-8d65-914d0ae96772 req-eff40c78-cfe1-4e60-891f-fc3f11e221b3 service nova] Instance 90c30ac8-f581-4ee8-b40d-f752a9cd384e is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851028-13', 'n-h2-851028-13'} {{(pid=123595) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 19:38:43.975810 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-b93fd9ba-aacc-4f96-8d65-914d0ae96772 req-eff40c78-cfe1-4e60-891f-fc3f11e221b3 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.115157 Oct 04 19:38:43.977382 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3468/7305] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:38:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:38:44.314052 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-12fdf2ea-9bd1-425e-af1b-426a711fe7ba tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:38:44.314718 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-12fdf2ea-9bd1-425e-af1b-426a711fe7ba tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: 90c30ac8-f581-4ee8-b40d-f752a9cd384e] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:38:44.321680 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-12fdf2ea-9bd1-425e-af1b-426a711fe7ba tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:44.322185 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-12fdf2ea-9bd1-425e-af1b-426a711fe7ba tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:44.322638 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-12fdf2ea-9bd1-425e-af1b-426a711fe7ba tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:44.323358 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-12fdf2ea-9bd1-425e-af1b-426a711fe7ba tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:44.323835 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-12fdf2ea-9bd1-425e-af1b-426a711fe7ba tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:44.324279 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-12fdf2ea-9bd1-425e-af1b-426a711fe7ba tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:44.543101 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-12fdf2ea-9bd1-425e-af1b-426a711fe7ba tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f67ee6767314bfb9cc04ea9c0dafb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0652fe65874b4606822aa7f261387bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:38:44.551394 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-12fdf2ea-9bd1-425e-af1b-426a711fe7ba tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "GET /compute/v2.1/servers/90c30ac8-f581-4ee8-b40d-f752a9cd384e" status: 200 len: 1723 microversion: 2.1 time: 0.241469 Oct 04 19:38:44.551980 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3838/7306] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:38:44 2022] GET /compute/v2.1/servers/90c30ac8-f581-4ee8-b40d-f752a9cd384e => generated 1723 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:38:45.576774 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-f4677823-2b7a-493d-93db-728ce6e78aab tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:38:45.577416 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-f4677823-2b7a-493d-93db-728ce6e78aab tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: 90c30ac8-f581-4ee8-b40d-f752a9cd384e] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:38:45.583654 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f4677823-2b7a-493d-93db-728ce6e78aab tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:45.584144 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f4677823-2b7a-493d-93db-728ce6e78aab tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:45.584591 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f4677823-2b7a-493d-93db-728ce6e78aab tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:45.585316 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f4677823-2b7a-493d-93db-728ce6e78aab tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:45.585777 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f4677823-2b7a-493d-93db-728ce6e78aab tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:45.586212 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f4677823-2b7a-493d-93db-728ce6e78aab tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:45.722417 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-f4677823-2b7a-493d-93db-728ce6e78aab tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f67ee6767314bfb9cc04ea9c0dafb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0652fe65874b4606822aa7f261387bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:38:45.730742 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-f4677823-2b7a-493d-93db-728ce6e78aab tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "GET /compute/v2.1/servers/90c30ac8-f581-4ee8-b40d-f752a9cd384e" status: 200 len: 1723 microversion: 2.1 time: 0.159310 Oct 04 19:38:45.731317 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3469/7307] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:38:45 2022] GET /compute/v2.1/servers/90c30ac8-f581-4ee8-b40d-f752a9cd384e => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:38:46.003498 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-2daa8fb6-826d-4262-91a8-851da635b266 req-7cf1e047-7a04-4516-8e50-eb079de0e7f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90c30ac8-f581-4ee8-b40d-f752a9cd384e", "tag": "0187505e-b0e5-4e5d-9f1d-c19a718eeff3"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:38:46.013567 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-2daa8fb6-826d-4262-91a8-851da635b266 req-7cf1e047-7a04-4516-8e50-eb079de0e7f4 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:46.014058 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-2daa8fb6-826d-4262-91a8-851da635b266 req-7cf1e047-7a04-4516-8e50-eb079de0e7f4 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:46.014505 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-2daa8fb6-826d-4262-91a8-851da635b266 req-7cf1e047-7a04-4516-8e50-eb079de0e7f4 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:46.025954 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-2daa8fb6-826d-4262-91a8-851da635b266 req-7cf1e047-7a04-4516-8e50-eb079de0e7f4 service nova] Creating event network-changed:0187505e-b0e5-4e5d-9f1d-c19a718eeff3 for instance 90c30ac8-f581-4ee8-b40d-f752a9cd384e on n-h2-851028-13 Oct 04 19:38:46.031694 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [req-2daa8fb6-826d-4262-91a8-851da635b266 req-7cf1e047-7a04-4516-8e50-eb079de0e7f4 service nova] Instance 90c30ac8-f581-4ee8-b40d-f752a9cd384e is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851028-13', 'n-h2-851028-13'} {{(pid=123596) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 19:38:46.042341 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-2daa8fb6-826d-4262-91a8-851da635b266 req-7cf1e047-7a04-4516-8e50-eb079de0e7f4 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042584 Oct 04 19:38:46.043149 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3839/7308] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:38:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:38:46.754664 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-31234e0f-cb67-4f2c-81ff-a1f486763726 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:38:46.755327 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-31234e0f-cb67-4f2c-81ff-a1f486763726 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: 90c30ac8-f581-4ee8-b40d-f752a9cd384e] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:38:46.762326 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-31234e0f-cb67-4f2c-81ff-a1f486763726 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:46.762890 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-31234e0f-cb67-4f2c-81ff-a1f486763726 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:46.763424 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-31234e0f-cb67-4f2c-81ff-a1f486763726 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:46.764190 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-31234e0f-cb67-4f2c-81ff-a1f486763726 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:46.764653 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-31234e0f-cb67-4f2c-81ff-a1f486763726 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:46.765082 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-31234e0f-cb67-4f2c-81ff-a1f486763726 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:46.897632 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-31234e0f-cb67-4f2c-81ff-a1f486763726 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f67ee6767314bfb9cc04ea9c0dafb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0652fe65874b4606822aa7f261387bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:38:46.906079 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-31234e0f-cb67-4f2c-81ff-a1f486763726 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "GET /compute/v2.1/servers/90c30ac8-f581-4ee8-b40d-f752a9cd384e" status: 200 len: 1723 microversion: 2.1 time: 0.155450 Oct 04 19:38:46.906668 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3470/7309] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:38:46 2022] GET /compute/v2.1/servers/90c30ac8-f581-4ee8-b40d-f752a9cd384e => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:38:47.931228 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-7964b24d-d6db-4554-b41a-ac0fe7884a0b tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:38:47.931937 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-7964b24d-d6db-4554-b41a-ac0fe7884a0b tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: 90c30ac8-f581-4ee8-b40d-f752a9cd384e] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:38:47.938218 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7964b24d-d6db-4554-b41a-ac0fe7884a0b tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:47.938738 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7964b24d-d6db-4554-b41a-ac0fe7884a0b tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:47.939192 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7964b24d-d6db-4554-b41a-ac0fe7884a0b tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:47.939893 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7964b24d-d6db-4554-b41a-ac0fe7884a0b tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:47.940356 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7964b24d-d6db-4554-b41a-ac0fe7884a0b tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:47.940791 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7964b24d-d6db-4554-b41a-ac0fe7884a0b tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:48.080625 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-7964b24d-d6db-4554-b41a-ac0fe7884a0b tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f67ee6767314bfb9cc04ea9c0dafb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0652fe65874b4606822aa7f261387bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:38:48.089443 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-7964b24d-d6db-4554-b41a-ac0fe7884a0b tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "GET /compute/v2.1/servers/90c30ac8-f581-4ee8-b40d-f752a9cd384e" status: 200 len: 1723 microversion: 2.1 time: 0.163385 Oct 04 19:38:48.090026 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3840/7310] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:38:47 2022] GET /compute/v2.1/servers/90c30ac8-f581-4ee8-b40d-f752a9cd384e => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:38:49.113351 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-8d3610e7-4cb2-4c83-8598-f58b0098f51d tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:38:49.113968 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-8d3610e7-4cb2-4c83-8598-f58b0098f51d tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: 90c30ac8-f581-4ee8-b40d-f752a9cd384e] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:38:49.120879 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8d3610e7-4cb2-4c83-8598-f58b0098f51d tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:49.121393 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8d3610e7-4cb2-4c83-8598-f58b0098f51d tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:49.121953 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8d3610e7-4cb2-4c83-8598-f58b0098f51d tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:49.122656 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8d3610e7-4cb2-4c83-8598-f58b0098f51d tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:49.123112 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8d3610e7-4cb2-4c83-8598-f58b0098f51d tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:49.124049 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8d3610e7-4cb2-4c83-8598-f58b0098f51d tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:49.260199 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-8d3610e7-4cb2-4c83-8598-f58b0098f51d tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f67ee6767314bfb9cc04ea9c0dafb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0652fe65874b4606822aa7f261387bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:38:49.268551 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-8d3610e7-4cb2-4c83-8598-f58b0098f51d tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "GET /compute/v2.1/servers/90c30ac8-f581-4ee8-b40d-f752a9cd384e" status: 200 len: 1723 microversion: 2.1 time: 0.159252 Oct 04 19:38:49.269148 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3471/7311] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:38:49 2022] GET /compute/v2.1/servers/90c30ac8-f581-4ee8-b40d-f752a9cd384e => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:38:50.291939 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-60bee98b-08bd-4c9f-ac04-9287810a3bab tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:38:50.292561 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-60bee98b-08bd-4c9f-ac04-9287810a3bab tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: 90c30ac8-f581-4ee8-b40d-f752a9cd384e] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:38:50.294575 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=3 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:38:50.300704 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-60bee98b-08bd-4c9f-ac04-9287810a3bab tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:50.301158 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-60bee98b-08bd-4c9f-ac04-9287810a3bab tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:50.301611 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-60bee98b-08bd-4c9f-ac04-9287810a3bab tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:50.302305 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-60bee98b-08bd-4c9f-ac04-9287810a3bab tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:50.302769 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-60bee98b-08bd-4c9f-ac04-9287810a3bab tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:50.303204 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-60bee98b-08bd-4c9f-ac04-9287810a3bab tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:50.435411 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-60bee98b-08bd-4c9f-ac04-9287810a3bab tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f67ee6767314bfb9cc04ea9c0dafb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0652fe65874b4606822aa7f261387bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:38:50.444797 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-60bee98b-08bd-4c9f-ac04-9287810a3bab tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "GET /compute/v2.1/servers/90c30ac8-f581-4ee8-b40d-f752a9cd384e" status: 200 len: 1723 microversion: 2.1 time: 0.156640 Oct 04 19:38:50.445468 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3841/7312] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:38:50 2022] GET /compute/v2.1/servers/90c30ac8-f581-4ee8-b40d-f752a9cd384e => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:38:51.470051 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-4f50c345-15b4-49df-bbe1-48e36e59760f tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:38:51.470712 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-4f50c345-15b4-49df-bbe1-48e36e59760f tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: 90c30ac8-f581-4ee8-b40d-f752a9cd384e] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:38:51.477766 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4f50c345-15b4-49df-bbe1-48e36e59760f tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:51.478261 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4f50c345-15b4-49df-bbe1-48e36e59760f tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:51.478704 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4f50c345-15b4-49df-bbe1-48e36e59760f tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:51.479408 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4f50c345-15b4-49df-bbe1-48e36e59760f tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:51.479867 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4f50c345-15b4-49df-bbe1-48e36e59760f tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:51.480303 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4f50c345-15b4-49df-bbe1-48e36e59760f tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:51.608404 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-4f50c345-15b4-49df-bbe1-48e36e59760f tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f67ee6767314bfb9cc04ea9c0dafb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0652fe65874b4606822aa7f261387bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:38:51.616742 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-4f50c345-15b4-49df-bbe1-48e36e59760f tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "GET /compute/v2.1/servers/90c30ac8-f581-4ee8-b40d-f752a9cd384e" status: 200 len: 1723 microversion: 2.1 time: 0.151196 Oct 04 19:38:51.617356 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3472/7313] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:38:51 2022] GET /compute/v2.1/servers/90c30ac8-f581-4ee8-b40d-f752a9cd384e => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:38:52.640252 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-0498a3ae-a5d4-46ad-95db-8fad502a7db7 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:38:52.640874 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-0498a3ae-a5d4-46ad-95db-8fad502a7db7 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: 90c30ac8-f581-4ee8-b40d-f752a9cd384e] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:38:52.647773 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0498a3ae-a5d4-46ad-95db-8fad502a7db7 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:52.648267 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0498a3ae-a5d4-46ad-95db-8fad502a7db7 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:52.648714 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0498a3ae-a5d4-46ad-95db-8fad502a7db7 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:52.649440 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0498a3ae-a5d4-46ad-95db-8fad502a7db7 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:52.649907 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0498a3ae-a5d4-46ad-95db-8fad502a7db7 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:52.650344 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0498a3ae-a5d4-46ad-95db-8fad502a7db7 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:52.782486 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-0498a3ae-a5d4-46ad-95db-8fad502a7db7 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f67ee6767314bfb9cc04ea9c0dafb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0652fe65874b4606822aa7f261387bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:38:52.790675 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-0498a3ae-a5d4-46ad-95db-8fad502a7db7 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "GET /compute/v2.1/servers/90c30ac8-f581-4ee8-b40d-f752a9cd384e" status: 200 len: 1723 microversion: 2.1 time: 0.154984 Oct 04 19:38:52.791245 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3842/7314] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:38:52 2022] GET /compute/v2.1/servers/90c30ac8-f581-4ee8-b40d-f752a9cd384e => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:38:53.814329 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-6e89193e-3c56-467e-99b2-0a4107a8d5a3 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:38:53.814868 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-6e89193e-3c56-467e-99b2-0a4107a8d5a3 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: 90c30ac8-f581-4ee8-b40d-f752a9cd384e] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:38:53.822026 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6e89193e-3c56-467e-99b2-0a4107a8d5a3 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:53.822618 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6e89193e-3c56-467e-99b2-0a4107a8d5a3 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:53.823131 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6e89193e-3c56-467e-99b2-0a4107a8d5a3 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:53.823937 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6e89193e-3c56-467e-99b2-0a4107a8d5a3 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:53.824395 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6e89193e-3c56-467e-99b2-0a4107a8d5a3 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:53.825319 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6e89193e-3c56-467e-99b2-0a4107a8d5a3 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:53.958540 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-6e89193e-3c56-467e-99b2-0a4107a8d5a3 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f67ee6767314bfb9cc04ea9c0dafb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0652fe65874b4606822aa7f261387bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:38:53.967553 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-6e89193e-3c56-467e-99b2-0a4107a8d5a3 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "GET /compute/v2.1/servers/90c30ac8-f581-4ee8-b40d-f752a9cd384e" status: 200 len: 1723 microversion: 2.1 time: 0.157777 Oct 04 19:38:53.968133 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3473/7315] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:38:53 2022] GET /compute/v2.1/servers/90c30ac8-f581-4ee8-b40d-f752a9cd384e => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:38:54.990664 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-37e2abb1-7b75-4dbd-895b-3b2a284a13b7 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:38:54.991320 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-37e2abb1-7b75-4dbd-895b-3b2a284a13b7 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: 90c30ac8-f581-4ee8-b40d-f752a9cd384e] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:38:54.998695 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-37e2abb1-7b75-4dbd-895b-3b2a284a13b7 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:54.999192 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-37e2abb1-7b75-4dbd-895b-3b2a284a13b7 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:54.999643 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-37e2abb1-7b75-4dbd-895b-3b2a284a13b7 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:55.000340 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-37e2abb1-7b75-4dbd-895b-3b2a284a13b7 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:55.000802 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-37e2abb1-7b75-4dbd-895b-3b2a284a13b7 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:55.001275 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-37e2abb1-7b75-4dbd-895b-3b2a284a13b7 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:55.136866 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-37e2abb1-7b75-4dbd-895b-3b2a284a13b7 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f67ee6767314bfb9cc04ea9c0dafb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0652fe65874b4606822aa7f261387bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:38:55.145543 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-37e2abb1-7b75-4dbd-895b-3b2a284a13b7 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "GET /compute/v2.1/servers/90c30ac8-f581-4ee8-b40d-f752a9cd384e" status: 200 len: 1723 microversion: 2.1 time: 0.158772 Oct 04 19:38:55.146119 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3843/7316] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:38:54 2022] GET /compute/v2.1/servers/90c30ac8-f581-4ee8-b40d-f752a9cd384e => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:38:56.168900 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-ce214a02-d9d3-4c55-8ea4-18199781e61d tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:38:56.169554 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-ce214a02-d9d3-4c55-8ea4-18199781e61d tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: 90c30ac8-f581-4ee8-b40d-f752a9cd384e] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:38:56.177040 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ce214a02-d9d3-4c55-8ea4-18199781e61d tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:56.177559 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ce214a02-d9d3-4c55-8ea4-18199781e61d tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:56.178011 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ce214a02-d9d3-4c55-8ea4-18199781e61d tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:56.178707 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ce214a02-d9d3-4c55-8ea4-18199781e61d tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:56.179174 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ce214a02-d9d3-4c55-8ea4-18199781e61d tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:56.179608 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ce214a02-d9d3-4c55-8ea4-18199781e61d tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:56.311036 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-ce214a02-d9d3-4c55-8ea4-18199781e61d tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f67ee6767314bfb9cc04ea9c0dafb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0652fe65874b4606822aa7f261387bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:38:56.319266 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-ce214a02-d9d3-4c55-8ea4-18199781e61d tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "GET /compute/v2.1/servers/90c30ac8-f581-4ee8-b40d-f752a9cd384e" status: 200 len: 1723 microversion: 2.1 time: 0.154329 Oct 04 19:38:56.319845 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3474/7317] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:38:56 2022] GET /compute/v2.1/servers/90c30ac8-f581-4ee8-b40d-f752a9cd384e => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:38:57.343382 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-0cf62ec2-012f-4025-bcc1-5ccb20d0d519 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:38:57.344088 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-0cf62ec2-012f-4025-bcc1-5ccb20d0d519 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: 90c30ac8-f581-4ee8-b40d-f752a9cd384e] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:38:57.351207 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0cf62ec2-012f-4025-bcc1-5ccb20d0d519 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:57.351713 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0cf62ec2-012f-4025-bcc1-5ccb20d0d519 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:57.352163 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0cf62ec2-012f-4025-bcc1-5ccb20d0d519 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:57.352866 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0cf62ec2-012f-4025-bcc1-5ccb20d0d519 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:57.353358 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0cf62ec2-012f-4025-bcc1-5ccb20d0d519 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:57.353794 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0cf62ec2-012f-4025-bcc1-5ccb20d0d519 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:57.480842 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-0cf62ec2-012f-4025-bcc1-5ccb20d0d519 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f67ee6767314bfb9cc04ea9c0dafb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0652fe65874b4606822aa7f261387bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:38:57.489789 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-0cf62ec2-012f-4025-bcc1-5ccb20d0d519 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "GET /compute/v2.1/servers/90c30ac8-f581-4ee8-b40d-f752a9cd384e" status: 200 len: 1716 microversion: 2.1 time: 0.150779 Oct 04 19:38:57.490365 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3844/7318] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:38:57 2022] GET /compute/v2.1/servers/90c30ac8-f581-4ee8-b40d-f752a9cd384e => generated 1716 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:38:57.512161 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-da8e6b45-5436-4418-a38a-15e3775ea089 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:38:57.512861 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-da8e6b45-5436-4418-a38a-15e3775ea089 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: 90c30ac8-f581-4ee8-b40d-f752a9cd384e] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:38:57.520223 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-da8e6b45-5436-4418-a38a-15e3775ea089 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:57.520710 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-da8e6b45-5436-4418-a38a-15e3775ea089 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:57.521177 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-da8e6b45-5436-4418-a38a-15e3775ea089 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:57.521880 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-da8e6b45-5436-4418-a38a-15e3775ea089 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:57.522335 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-da8e6b45-5436-4418-a38a-15e3775ea089 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:57.522766 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-da8e6b45-5436-4418-a38a-15e3775ea089 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:57.650832 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-da8e6b45-5436-4418-a38a-15e3775ea089 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f67ee6767314bfb9cc04ea9c0dafb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0652fe65874b4606822aa7f261387bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:38:57.660028 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-da8e6b45-5436-4418-a38a-15e3775ea089 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "GET /compute/v2.1/servers/90c30ac8-f581-4ee8-b40d-f752a9cd384e" status: 200 len: 1716 microversion: 2.1 time: 0.151813 Oct 04 19:38:57.660621 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3475/7319] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:38:57 2022] GET /compute/v2.1/servers/90c30ac8-f581-4ee8-b40d-f752a9cd384e => generated 1716 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:38:57.682076 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-e1e07abc-2ef1-4a7f-a58b-9920168d1e14 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:38:57.682762 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-e1e07abc-2ef1-4a7f-a58b-9920168d1e14 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: 90c30ac8-f581-4ee8-b40d-f752a9cd384e] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:38:57.688896 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e1e07abc-2ef1-4a7f-a58b-9920168d1e14 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:57.689439 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e1e07abc-2ef1-4a7f-a58b-9920168d1e14 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:57.689901 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e1e07abc-2ef1-4a7f-a58b-9920168d1e14 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:57.690612 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e1e07abc-2ef1-4a7f-a58b-9920168d1e14 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:57.691086 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e1e07abc-2ef1-4a7f-a58b-9920168d1e14 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:57.691566 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e1e07abc-2ef1-4a7f-a58b-9920168d1e14 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:57.821447 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-e1e07abc-2ef1-4a7f-a58b-9920168d1e14 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f67ee6767314bfb9cc04ea9c0dafb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0652fe65874b4606822aa7f261387bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:38:57.830222 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-e1e07abc-2ef1-4a7f-a58b-9920168d1e14 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "GET /compute/v2.1/servers/90c30ac8-f581-4ee8-b40d-f752a9cd384e" status: 200 len: 1716 microversion: 2.1 time: 0.151992 Oct 04 19:38:57.830798 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3845/7320] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:38:57 2022] GET /compute/v2.1/servers/90c30ac8-f581-4ee8-b40d-f752a9cd384e => generated 1716 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:38:57.853028 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-eea91128-89dd-47fd-99b1-2b84188619db tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:38:57.853491 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-eea91128-89dd-47fd-99b1-2b84188619db tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: 90c30ac8-f581-4ee8-b40d-f752a9cd384e] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:38:57.859383 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-eea91128-89dd-47fd-99b1-2b84188619db tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:57.859870 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-eea91128-89dd-47fd-99b1-2b84188619db tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:57.860306 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-eea91128-89dd-47fd-99b1-2b84188619db tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:57.860990 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-eea91128-89dd-47fd-99b1-2b84188619db tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:57.861475 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-eea91128-89dd-47fd-99b1-2b84188619db tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:57.861903 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-eea91128-89dd-47fd-99b1-2b84188619db tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:57.886514 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-eea91128-89dd-47fd-99b1-2b84188619db tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: 90c30ac8-f581-4ee8-b40d-f752a9cd384e] Going to try to terminate instance {{(pid=123595) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 19:38:57.963386 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-eea91128-89dd-47fd-99b1-2b84188619db tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "DELETE /compute/v2.1/servers/90c30ac8-f581-4ee8-b40d-f752a9cd384e" status: 204 len: 0 microversion: 2.1 time: 0.113690 Oct 04 19:38:57.963983 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3476/7321] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 19:38:57 2022] DELETE /compute/v2.1/servers/90c30ac8-f581-4ee8-b40d-f752a9cd384e => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:38:57.972635 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-aafa20d0-2fa9-48f7-97d4-8d95a8b58265 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:38:57.973287 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-aafa20d0-2fa9-48f7-97d4-8d95a8b58265 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: 90c30ac8-f581-4ee8-b40d-f752a9cd384e] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:38:57.979281 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-aafa20d0-2fa9-48f7-97d4-8d95a8b58265 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:57.979773 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-aafa20d0-2fa9-48f7-97d4-8d95a8b58265 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:57.980231 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-aafa20d0-2fa9-48f7-97d4-8d95a8b58265 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:57.980927 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-aafa20d0-2fa9-48f7-97d4-8d95a8b58265 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:57.981452 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-aafa20d0-2fa9-48f7-97d4-8d95a8b58265 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:57.981893 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-aafa20d0-2fa9-48f7-97d4-8d95a8b58265 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:57.996277 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:38:58.114193 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-aafa20d0-2fa9-48f7-97d4-8d95a8b58265 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f67ee6767314bfb9cc04ea9c0dafb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0652fe65874b4606822aa7f261387bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:38:58.122383 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-aafa20d0-2fa9-48f7-97d4-8d95a8b58265 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "GET /compute/v2.1/servers/90c30ac8-f581-4ee8-b40d-f752a9cd384e" status: 200 len: 1722 microversion: 2.1 time: 0.153893 Oct 04 19:38:58.123473 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3846/7322] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:38:57 2022] GET /compute/v2.1/servers/90c30ac8-f581-4ee8-b40d-f752a9cd384e => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:38:59.147790 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-0161dd7e-d889-4f73-a2b4-07b4820bf68a tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:38:59.148498 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-0161dd7e-d889-4f73-a2b4-07b4820bf68a tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: 90c30ac8-f581-4ee8-b40d-f752a9cd384e] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:38:59.155409 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0161dd7e-d889-4f73-a2b4-07b4820bf68a tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:59.155900 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0161dd7e-d889-4f73-a2b4-07b4820bf68a tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:59.156374 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0161dd7e-d889-4f73-a2b4-07b4820bf68a tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:59.157077 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0161dd7e-d889-4f73-a2b4-07b4820bf68a tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:59.157568 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0161dd7e-d889-4f73-a2b4-07b4820bf68a tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:59.158087 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0161dd7e-d889-4f73-a2b4-07b4820bf68a tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:59.174608 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:38:59.269445 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-41f04b9f-c6d1-40a4-b5bb-bede7bf721d3 req-8b82f4a5-bddb-4b35-996c-a6a5b2bdcf48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90c30ac8-f581-4ee8-b40d-f752a9cd384e", "name": "network-vif-plugged", "status": "completed", "tag": "0187505e-b0e5-4e5d-9f1d-c19a718eeff3"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:38:59.281776 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-41f04b9f-c6d1-40a4-b5bb-bede7bf721d3 req-8b82f4a5-bddb-4b35-996c-a6a5b2bdcf48 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:59.282286 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-41f04b9f-c6d1-40a4-b5bb-bede7bf721d3 req-8b82f4a5-bddb-4b35-996c-a6a5b2bdcf48 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:59.283534 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-41f04b9f-c6d1-40a4-b5bb-bede7bf721d3 req-8b82f4a5-bddb-4b35-996c-a6a5b2bdcf48 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:59.298036 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-41f04b9f-c6d1-40a4-b5bb-bede7bf721d3 req-8b82f4a5-bddb-4b35-996c-a6a5b2bdcf48 service nova] Creating event network-vif-plugged:0187505e-b0e5-4e5d-9f1d-c19a718eeff3 for instance 90c30ac8-f581-4ee8-b40d-f752a9cd384e on n-h2-851028-13 Oct 04 19:38:59.303128 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-41f04b9f-c6d1-40a4-b5bb-bede7bf721d3 req-8b82f4a5-bddb-4b35-996c-a6a5b2bdcf48 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037790 Oct 04 19:38:59.303745 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3847/7323] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:38:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:38:59.305311 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-0161dd7e-d889-4f73-a2b4-07b4820bf68a tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f67ee6767314bfb9cc04ea9c0dafb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0652fe65874b4606822aa7f261387bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:38:59.313746 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-0161dd7e-d889-4f73-a2b4-07b4820bf68a tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "GET /compute/v2.1/servers/90c30ac8-f581-4ee8-b40d-f752a9cd384e" status: 200 len: 1722 microversion: 2.1 time: 0.170214 Oct 04 19:38:59.314499 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3477/7324] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:38:59 2022] GET /compute/v2.1/servers/90c30ac8-f581-4ee8-b40d-f752a9cd384e => generated 1722 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:39:00.318273 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-381c7dad-608a-4362-bbf1-bac2036ecb27 req-9f6149fa-afbe-4ef6-91d9-43aabfa8fd83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90c30ac8-f581-4ee8-b40d-f752a9cd384e", "name": "network-vif-deleted", "tag": "0187505e-b0e5-4e5d-9f1d-c19a718eeff3"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:39:00.327912 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-381c7dad-608a-4362-bbf1-bac2036ecb27 req-9f6149fa-afbe-4ef6-91d9-43aabfa8fd83 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:00.328406 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-381c7dad-608a-4362-bbf1-bac2036ecb27 req-9f6149fa-afbe-4ef6-91d9-43aabfa8fd83 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:00.329069 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-381c7dad-608a-4362-bbf1-bac2036ecb27 req-9f6149fa-afbe-4ef6-91d9-43aabfa8fd83 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:00.337787 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-edd3cc5c-20e7-42b8-b49e-616408ff52c1 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:39:00.338667 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-edd3cc5c-20e7-42b8-b49e-616408ff52c1 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: 90c30ac8-f581-4ee8-b40d-f752a9cd384e] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:39:00.340951 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-381c7dad-608a-4362-bbf1-bac2036ecb27 req-9f6149fa-afbe-4ef6-91d9-43aabfa8fd83 service nova] Creating event network-vif-deleted:0187505e-b0e5-4e5d-9f1d-c19a718eeff3 for instance 90c30ac8-f581-4ee8-b40d-f752a9cd384e on n-h2-851028-13 Oct 04 19:39:00.346728 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-381c7dad-608a-4362-bbf1-bac2036ecb27 req-9f6149fa-afbe-4ef6-91d9-43aabfa8fd83 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033480 Oct 04 19:39:00.347278 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3848/7325] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:39:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:39:00.359580 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-edd3cc5c-20e7-42b8-b49e-616408ff52c1 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:00.360093 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-edd3cc5c-20e7-42b8-b49e-616408ff52c1 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:00.360543 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-edd3cc5c-20e7-42b8-b49e-616408ff52c1 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:00.361305 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-edd3cc5c-20e7-42b8-b49e-616408ff52c1 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:00.361954 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-edd3cc5c-20e7-42b8-b49e-616408ff52c1 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:00.362397 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-edd3cc5c-20e7-42b8-b49e-616408ff52c1 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:00.438708 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-edd3cc5c-20e7-42b8-b49e-616408ff52c1 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f67ee6767314bfb9cc04ea9c0dafb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0652fe65874b4606822aa7f261387bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:39:00.447886 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-edd3cc5c-20e7-42b8-b49e-616408ff52c1 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "GET /compute/v2.1/servers/90c30ac8-f581-4ee8-b40d-f752a9cd384e" status: 200 len: 1370 microversion: 2.1 time: 0.113952 Oct 04 19:39:00.457264 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3478/7326] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:39:00 2022] GET /compute/v2.1/servers/90c30ac8-f581-4ee8-b40d-f752a9cd384e => generated 1370 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:39:01.473833 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-49e7fb03-b706-4e3e-a8f6-47bd948a6d59 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:39:01.474486 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-49e7fb03-b706-4e3e-a8f6-47bd948a6d59 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: 90c30ac8-f581-4ee8-b40d-f752a9cd384e] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:39:01.480814 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-49e7fb03-b706-4e3e-a8f6-47bd948a6d59 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:01.481350 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-49e7fb03-b706-4e3e-a8f6-47bd948a6d59 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:01.481813 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-49e7fb03-b706-4e3e-a8f6-47bd948a6d59 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:01.483062 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-49e7fb03-b706-4e3e-a8f6-47bd948a6d59 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:01.483537 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-49e7fb03-b706-4e3e-a8f6-47bd948a6d59 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:01.483982 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-49e7fb03-b706-4e3e-a8f6-47bd948a6d59 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:01.547354 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-49e7fb03-b706-4e3e-a8f6-47bd948a6d59 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f67ee6767314bfb9cc04ea9c0dafb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0652fe65874b4606822aa7f261387bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:39:01.555735 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-49e7fb03-b706-4e3e-a8f6-47bd948a6d59 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "GET /compute/v2.1/servers/90c30ac8-f581-4ee8-b40d-f752a9cd384e" status: 200 len: 1370 microversion: 2.1 time: 0.087419 Oct 04 19:39:01.556312 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3849/7327] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:39:01 2022] GET /compute/v2.1/servers/90c30ac8-f581-4ee8-b40d-f752a9cd384e => generated 1370 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:39:02.580282 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-8c087e4c-8ccf-47a8-b076-6c5e38d5d588 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:39:02.580983 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-8c087e4c-8ccf-47a8-b076-6c5e38d5d588 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: 90c30ac8-f581-4ee8-b40d-f752a9cd384e] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:39:02.587933 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8c087e4c-8ccf-47a8-b076-6c5e38d5d588 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:02.588677 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8c087e4c-8ccf-47a8-b076-6c5e38d5d588 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:02.589147 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8c087e4c-8ccf-47a8-b076-6c5e38d5d588 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:02.589839 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8c087e4c-8ccf-47a8-b076-6c5e38d5d588 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:02.590295 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8c087e4c-8ccf-47a8-b076-6c5e38d5d588 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:02.590725 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8c087e4c-8ccf-47a8-b076-6c5e38d5d588 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:02.652559 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-8c087e4c-8ccf-47a8-b076-6c5e38d5d588 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f67ee6767314bfb9cc04ea9c0dafb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0652fe65874b4606822aa7f261387bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:39:02.660966 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-8c087e4c-8ccf-47a8-b076-6c5e38d5d588 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "GET /compute/v2.1/servers/90c30ac8-f581-4ee8-b40d-f752a9cd384e" status: 200 len: 1370 microversion: 2.1 time: 0.085242 Oct 04 19:39:02.661580 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3479/7328] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:39:02 2022] GET /compute/v2.1/servers/90c30ac8-f581-4ee8-b40d-f752a9cd384e => generated 1370 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:39:03.684119 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-77938395-da34-4e26-b36c-41b184c69a99 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:39:03.684692 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-77938395-da34-4e26-b36c-41b184c69a99 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: 90c30ac8-f581-4ee8-b40d-f752a9cd384e] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:39:03.691803 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-77938395-da34-4e26-b36c-41b184c69a99 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:03.692304 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-77938395-da34-4e26-b36c-41b184c69a99 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:03.692761 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-77938395-da34-4e26-b36c-41b184c69a99 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:03.693528 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-77938395-da34-4e26-b36c-41b184c69a99 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:03.694000 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-77938395-da34-4e26-b36c-41b184c69a99 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:03.694446 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-77938395-da34-4e26-b36c-41b184c69a99 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:03.755950 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-77938395-da34-4e26-b36c-41b184c69a99 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f67ee6767314bfb9cc04ea9c0dafb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0652fe65874b4606822aa7f261387bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:39:03.765093 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-77938395-da34-4e26-b36c-41b184c69a99 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "GET /compute/v2.1/servers/90c30ac8-f581-4ee8-b40d-f752a9cd384e" status: 200 len: 1370 microversion: 2.1 time: 0.084971 Oct 04 19:39:03.765735 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3850/7329] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:39:03 2022] GET /compute/v2.1/servers/90c30ac8-f581-4ee8-b40d-f752a9cd384e => generated 1370 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:39:04.788078 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-3a5a875b-dd3a-4772-8e4a-3be1a85a9228 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:39:04.788801 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-3a5a875b-dd3a-4772-8e4a-3be1a85a9228 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: 90c30ac8-f581-4ee8-b40d-f752a9cd384e] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:39:04.791821 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:39:04.797740 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3a5a875b-dd3a-4772-8e4a-3be1a85a9228 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:04.798232 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3a5a875b-dd3a-4772-8e4a-3be1a85a9228 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:04.798671 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3a5a875b-dd3a-4772-8e4a-3be1a85a9228 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:04.799370 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3a5a875b-dd3a-4772-8e4a-3be1a85a9228 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:04.799824 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3a5a875b-dd3a-4772-8e4a-3be1a85a9228 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:04.800246 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3a5a875b-dd3a-4772-8e4a-3be1a85a9228 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:04.835556 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3a5a875b-dd3a-4772-8e4a-3be1a85a9228 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:04.836054 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3a5a875b-dd3a-4772-8e4a-3be1a85a9228 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:04.836510 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3a5a875b-dd3a-4772-8e4a-3be1a85a9228 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:04.836951 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.objects.instance [None req-3a5a875b-dd3a-4772-8e4a-3be1a85a9228 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lazy-loading 'fault' on Instance uuid 90c30ac8-f581-4ee8-b40d-f752a9cd384e {{(pid=123595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 19:39:04.882286 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-3a5a875b-dd3a-4772-8e4a-3be1a85a9228 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f67ee6767314bfb9cc04ea9c0dafb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0652fe65874b4606822aa7f261387bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:39:04.889571 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-3a5a875b-dd3a-4772-8e4a-3be1a85a9228 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "GET /compute/v2.1/servers/90c30ac8-f581-4ee8-b40d-f752a9cd384e" status: 200 len: 1329 microversion: 2.1 time: 0.105369 Oct 04 19:39:04.890153 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3480/7330] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:39:04 2022] GET /compute/v2.1/servers/90c30ac8-f581-4ee8-b40d-f752a9cd384e => generated 1329 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:39:05.912724 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f8855211-3f72-46bd-81f0-76ead011785f tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:39:05.913392 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-f8855211-3f72-46bd-81f0-76ead011785f tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: 90c30ac8-f581-4ee8-b40d-f752a9cd384e] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:39:05.916277 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:39:05.922306 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f8855211-3f72-46bd-81f0-76ead011785f tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:05.922814 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f8855211-3f72-46bd-81f0-76ead011785f tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:05.923274 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f8855211-3f72-46bd-81f0-76ead011785f tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:05.923990 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f8855211-3f72-46bd-81f0-76ead011785f tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:05.924466 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f8855211-3f72-46bd-81f0-76ead011785f tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:05.925346 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f8855211-3f72-46bd-81f0-76ead011785f tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:05.941393 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-f8855211-3f72-46bd-81f0-76ead011785f tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] HTTP exception thrown: Instance 90c30ac8-f581-4ee8-b40d-f752a9cd384e could not be found. Oct 04 19:39:05.942984 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f8855211-3f72-46bd-81f0-76ead011785f tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Request method failure captured: Oct 04 19:39:05.942984 n-d-851028-13 devstack@n-api.service[123596]: request: GET /compute/v2.1/servers/90c30ac8-f581-4ee8-b40d-f752a9cd384e HTTP/1.1 Oct 04 19:39:05.942984 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 19:39:05.942984 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 19:39:05.942984 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 19:39:05.942984 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 19:39:05.942984 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 19:39:05.942984 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 19:39:05.942984 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 19:39:05.942984 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 19:39:05.942984 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPIqNPSW-jY_CXlvweXkAb59PzbD_M9ifcFUjpTbr3KbdOrHUB_aNtkTXlDq8uWp-Uz3LkN9Bpw8W-Ed2va8SU5LJbVHgy-uC1qVHJobUD1nv6xPfp-0ohneG8KzimTY76cYfXn9BJJ6sDEX25dNNYJgqA5GKr8Hn0LvuJeIH2g-v6U8 Oct 04 19:39:05.942984 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 19:39:05.942984 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 19:39:05.942984 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 19:39:05.942984 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 19:39:05.942984 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 19:39:05.942984 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 19:39:05.942984 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: 0652fe65874b4606822aa7f261387bc8 Oct 04 19:39:05.942984 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-ServerActionsTestJSON-1261889807 Oct 04 19:39:05.942984 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 19:39:05.942984 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 19:39:05.942984 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/0652fe65874b4606822aa7f261387bc8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_0652fe65874b4606822aa7f261387bc8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0652fe65874b4606822aa7f261387bc8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0652fe65874b4606822aa7f261387bc8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 19:39:05.942984 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-ServerActionsTestJSON-1261889807 Oct 04 19:39:05.942984 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: 0652fe65874b4606822aa7f261387bc8 Oct 04 19:39:05.942984 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-ServerActionsTestJSON-1261889807 Oct 04 19:39:05.942984 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-ServerActionsTestJSON-1261889807-project Oct 04 19:39:05.942984 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 19:39:05.942984 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 19:39:05.942984 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 0f67ee6767314bfb9cc04ea9c0dafb4b Oct 04 19:39:05.942984 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-ServerActionsTestJSON-1261889807-project Oct 04 19:39:05.942984 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 19:39:05.942984 n-d-851028-13 devstack@n-api.service[123596]: exception: Instance 90c30ac8-f581-4ee8-b40d-f752a9cd384e could not be found. Oct 04 19:39:05.942984 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': '90c30ac8-f581-4ee8-b40d-f752a9cd384e'} Oct 04 19:39:05.942984 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:39:05.942984 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:39:05.942984 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:39:05.942984 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:39:05.942984 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:39:05.942984 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:39:05.942984 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:39:05.942984 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:39:05.942984 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:39:05.942984 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:39:05.942984 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90c30ac8-f581-4ee8-b40d-f752a9cd384e could not be found. Oct 04 19:39:05.942984 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:39:05.942984 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:39:05.942984 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:39:05.942984 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:39:05.942984 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:39:05.942984 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:39:05.942984 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:39:05.942984 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:39:05.942984 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:39:05.942984 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:39:05.942984 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:39:05.942984 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:39:05.942984 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:39:05.942984 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:39:05.942984 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:39:05.942984 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:39:05.942984 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90c30ac8-f581-4ee8-b40d-f752a9cd384e could not be found. Oct 04 19:39:05.942984 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:39:05.942984 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:39:05.942984 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:39:05.947912 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:39:05.947912 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:39:05.947912 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:39:05.947912 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:39:05.947912 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:39:05.947912 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90c30ac8-f581-4ee8-b40d-f752a9cd384e could not be found. Oct 04 19:39:05.947912 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:39:05.947912 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f8855211-3f72-46bd-81f0-76ead011785f tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Returning 404 to user: Instance 90c30ac8-f581-4ee8-b40d-f752a9cd384e could not be found. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:39:05.947912 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-f8855211-3f72-46bd-81f0-76ead011785f tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "GET /compute/v2.1/servers/90c30ac8-f581-4ee8-b40d-f752a9cd384e" status: 404 len: 111 microversion: 2.1 time: 0.035772 Oct 04 19:39:05.947912 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3851/7331] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:39:05 2022] GET /compute/v2.1/servers/90c30ac8-f581-4ee8-b40d-f752a9cd384e => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:39:06.008727 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-59de65c7-8551-46a8-b751-1527d48753b7 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:39:06.011106 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-59de65c7-8551-46a8-b751-1527d48753b7 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: 90c30ac8-f581-4ee8-b40d-f752a9cd384e] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:39:06.017889 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-59de65c7-8551-46a8-b751-1527d48753b7 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:06.018381 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-59de65c7-8551-46a8-b751-1527d48753b7 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:06.018826 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-59de65c7-8551-46a8-b751-1527d48753b7 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:06.019527 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-59de65c7-8551-46a8-b751-1527d48753b7 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:06.019994 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-59de65c7-8551-46a8-b751-1527d48753b7 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:06.020427 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-59de65c7-8551-46a8-b751-1527d48753b7 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:06.032944 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-59de65c7-8551-46a8-b751-1527d48753b7 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] HTTP exception thrown: Instance 90c30ac8-f581-4ee8-b40d-f752a9cd384e could not be found. Oct 04 19:39:06.034684 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-59de65c7-8551-46a8-b751-1527d48753b7 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Request method failure captured: Oct 04 19:39:06.034684 n-d-851028-13 devstack@n-api.service[123595]: request: GET /compute/v2.1/servers/90c30ac8-f581-4ee8-b40d-f752a9cd384e/os-volume_attachments HTTP/1.1 Oct 04 19:39:06.034684 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 19:39:06.034684 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 19:39:06.034684 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 19:39:06.034684 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 0 Oct 04 19:39:06.034684 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 19:39:06.034684 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 19:39:06.034684 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 19:39:06.034684 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 19:39:06.034684 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPIqNPSW-jY_CXlvweXkAb59PzbD_M9ifcFUjpTbr3KbdOrHUB_aNtkTXlDq8uWp-Uz3LkN9Bpw8W-Ed2va8SU5LJbVHgy-uC1qVHJobUD1nv6xPfp-0ohneG8KzimTY76cYfXn9BJJ6sDEX25dNNYJgqA5GKr8Hn0LvuJeIH2g-v6U8 Oct 04 19:39:06.034684 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 19:39:06.034684 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 19:39:06.034684 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 19:39:06.034684 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 19:39:06.034684 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 19:39:06.034684 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 19:39:06.034684 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: 0652fe65874b4606822aa7f261387bc8 Oct 04 19:39:06.034684 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-ServerActionsTestJSON-1261889807 Oct 04 19:39:06.034684 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 19:39:06.034684 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 19:39:06.034684 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/0652fe65874b4606822aa7f261387bc8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_0652fe65874b4606822aa7f261387bc8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0652fe65874b4606822aa7f261387bc8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0652fe65874b4606822aa7f261387bc8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 19:39:06.034684 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-ServerActionsTestJSON-1261889807 Oct 04 19:39:06.034684 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: 0652fe65874b4606822aa7f261387bc8 Oct 04 19:39:06.034684 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-ServerActionsTestJSON-1261889807 Oct 04 19:39:06.034684 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-ServerActionsTestJSON-1261889807-project Oct 04 19:39:06.034684 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 19:39:06.034684 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 19:39:06.034684 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: 0f67ee6767314bfb9cc04ea9c0dafb4b Oct 04 19:39:06.034684 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-ServerActionsTestJSON-1261889807-project Oct 04 19:39:06.034684 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 19:39:06.034684 n-d-851028-13 devstack@n-api.service[123595]: exception: Instance 90c30ac8-f581-4ee8-b40d-f752a9cd384e could not be found. Oct 04 19:39:06.034684 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'server_id': '90c30ac8-f581-4ee8-b40d-f752a9cd384e'} Oct 04 19:39:06.034684 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:39:06.034684 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:39:06.034684 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:39:06.034684 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:39:06.034684 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:39:06.034684 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:39:06.034684 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:39:06.034684 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:39:06.034684 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:39:06.034684 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:39:06.034684 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90c30ac8-f581-4ee8-b40d-f752a9cd384e could not be found. Oct 04 19:39:06.034684 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:39:06.034684 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:39:06.034684 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:39:06.034684 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:39:06.034684 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:39:06.034684 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:39:06.034684 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:39:06.034684 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:39:06.034684 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:39:06.034684 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:39:06.034684 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 19:39:06.034684 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 19:39:06.034684 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 19:39:06.034684 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 19:39:06.034684 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 04 19:39:06.034684 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 04 19:39:06.034684 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:39:06.034684 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:39:06.039992 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90c30ac8-f581-4ee8-b40d-f752a9cd384e could not be found. Oct 04 19:39:06.039992 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:39:06.039992 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:39:06.039992 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:39:06.039992 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:39:06.039992 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:39:06.039992 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:39:06.039992 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:39:06.039992 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:39:06.039992 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90c30ac8-f581-4ee8-b40d-f752a9cd384e could not be found. Oct 04 19:39:06.039992 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:39:06.039992 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-59de65c7-8551-46a8-b751-1527d48753b7 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Returning 404 to user: Instance 90c30ac8-f581-4ee8-b40d-f752a9cd384e could not be found. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:39:06.039992 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-59de65c7-8551-46a8-b751-1527d48753b7 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "GET /compute/v2.1/servers/90c30ac8-f581-4ee8-b40d-f752a9cd384e/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.031368 Oct 04 19:39:06.039992 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3481/7332] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Oct 4 19:39:06 2022] GET /compute/v2.1/servers/90c30ac8-f581-4ee8-b40d-f752a9cd384e/os-volume_attachments => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:39:09.357498 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-a0e95c2c-afbe-448a-8c09-30a728e4fcc6 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:39:09.358048 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-a0e95c2c-afbe-448a-8c09-30a728e4fcc6 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: 90c30ac8-f581-4ee8-b40d-f752a9cd384e] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:39:09.365003 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a0e95c2c-afbe-448a-8c09-30a728e4fcc6 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:09.365539 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a0e95c2c-afbe-448a-8c09-30a728e4fcc6 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:09.365997 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a0e95c2c-afbe-448a-8c09-30a728e4fcc6 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:09.366703 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a0e95c2c-afbe-448a-8c09-30a728e4fcc6 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:09.367175 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a0e95c2c-afbe-448a-8c09-30a728e4fcc6 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:09.367620 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a0e95c2c-afbe-448a-8c09-30a728e4fcc6 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:09.381566 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-a0e95c2c-afbe-448a-8c09-30a728e4fcc6 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] HTTP exception thrown: Instance 90c30ac8-f581-4ee8-b40d-f752a9cd384e could not be found. Oct 04 19:39:09.383176 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-a0e95c2c-afbe-448a-8c09-30a728e4fcc6 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Request method failure captured: Oct 04 19:39:09.383176 n-d-851028-13 devstack@n-api.service[123596]: request: DELETE /compute/v2.1/servers/90c30ac8-f581-4ee8-b40d-f752a9cd384e HTTP/1.1 Oct 04 19:39:09.383176 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 19:39:09.383176 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 19:39:09.383176 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 19:39:09.383176 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 19:39:09.383176 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 19:39:09.383176 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 19:39:09.383176 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 19:39:09.383176 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 19:39:09.383176 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPIqNPSW-jY_CXlvweXkAb59PzbD_M9ifcFUjpTbr3KbdOrHUB_aNtkTXlDq8uWp-Uz3LkN9Bpw8W-Ed2va8SU5LJbVHgy-uC1qVHJobUD1nv6xPfp-0ohneG8KzimTY76cYfXn9BJJ6sDEX25dNNYJgqA5GKr8Hn0LvuJeIH2g-v6U8 Oct 04 19:39:09.383176 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 19:39:09.383176 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 19:39:09.383176 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 19:39:09.383176 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 19:39:09.383176 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 19:39:09.383176 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 19:39:09.383176 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: 0652fe65874b4606822aa7f261387bc8 Oct 04 19:39:09.383176 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-ServerActionsTestJSON-1261889807 Oct 04 19:39:09.383176 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 19:39:09.383176 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 19:39:09.383176 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/0652fe65874b4606822aa7f261387bc8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_0652fe65874b4606822aa7f261387bc8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0652fe65874b4606822aa7f261387bc8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0652fe65874b4606822aa7f261387bc8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 19:39:09.383176 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-ServerActionsTestJSON-1261889807 Oct 04 19:39:09.383176 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: 0652fe65874b4606822aa7f261387bc8 Oct 04 19:39:09.383176 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-ServerActionsTestJSON-1261889807 Oct 04 19:39:09.383176 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-ServerActionsTestJSON-1261889807-project Oct 04 19:39:09.383176 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 19:39:09.383176 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 19:39:09.383176 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 0f67ee6767314bfb9cc04ea9c0dafb4b Oct 04 19:39:09.383176 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-ServerActionsTestJSON-1261889807-project Oct 04 19:39:09.383176 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 19:39:09.383176 n-d-851028-13 devstack@n-api.service[123596]: exception: Instance 90c30ac8-f581-4ee8-b40d-f752a9cd384e could not be found. Oct 04 19:39:09.383176 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': '90c30ac8-f581-4ee8-b40d-f752a9cd384e'} Oct 04 19:39:09.383176 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:39:09.383176 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:39:09.383176 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:39:09.383176 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:39:09.383176 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:39:09.383176 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:39:09.383176 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:39:09.383176 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:39:09.383176 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:39:09.383176 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:39:09.383176 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90c30ac8-f581-4ee8-b40d-f752a9cd384e could not be found. Oct 04 19:39:09.383176 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:39:09.383176 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:39:09.383176 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:39:09.383176 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:39:09.383176 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:39:09.383176 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:39:09.383176 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:39:09.383176 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:39:09.383176 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:39:09.383176 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:39:09.383176 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 19:39:09.383176 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 19:39:09.383176 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 19:39:09.383176 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 19:39:09.383176 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:39:09.383176 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:39:09.383176 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:39:09.383176 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:39:09.388019 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90c30ac8-f581-4ee8-b40d-f752a9cd384e could not be found. Oct 04 19:39:09.388019 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:39:09.388019 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:39:09.388019 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:39:09.388019 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:39:09.388019 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:39:09.388019 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:39:09.388019 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:39:09.388019 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:39:09.388019 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90c30ac8-f581-4ee8-b40d-f752a9cd384e could not be found. Oct 04 19:39:09.388019 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:39:09.388019 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-a0e95c2c-afbe-448a-8c09-30a728e4fcc6 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Returning 404 to user: Instance 90c30ac8-f581-4ee8-b40d-f752a9cd384e could not be found. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:39:09.388019 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-a0e95c2c-afbe-448a-8c09-30a728e4fcc6 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "DELETE /compute/v2.1/servers/90c30ac8-f581-4ee8-b40d-f752a9cd384e" status: 404 len: 111 microversion: 2.1 time: 0.031774 Oct 04 19:39:09.388019 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3852/7333] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 19:39:09 2022] DELETE /compute/v2.1/servers/90c30ac8-f581-4ee8-b40d-f752a9cd384e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:39:09.393407 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-53b7eeed-2ef6-4ed3-91d3-3809562c43c0 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:39:09.394036 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-53b7eeed-2ef6-4ed3-91d3-3809562c43c0 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: 90c30ac8-f581-4ee8-b40d-f752a9cd384e] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:39:09.401590 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-53b7eeed-2ef6-4ed3-91d3-3809562c43c0 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:09.402161 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-53b7eeed-2ef6-4ed3-91d3-3809562c43c0 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:09.402604 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-53b7eeed-2ef6-4ed3-91d3-3809562c43c0 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:09.403319 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-53b7eeed-2ef6-4ed3-91d3-3809562c43c0 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:09.404277 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-53b7eeed-2ef6-4ed3-91d3-3809562c43c0 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:09.404707 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-53b7eeed-2ef6-4ed3-91d3-3809562c43c0 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:09.420101 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-53b7eeed-2ef6-4ed3-91d3-3809562c43c0 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] HTTP exception thrown: Instance 90c30ac8-f581-4ee8-b40d-f752a9cd384e could not be found. Oct 04 19:39:09.421725 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-53b7eeed-2ef6-4ed3-91d3-3809562c43c0 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Request method failure captured: Oct 04 19:39:09.421725 n-d-851028-13 devstack@n-api.service[123595]: request: GET /compute/v2.1/servers/90c30ac8-f581-4ee8-b40d-f752a9cd384e HTTP/1.1 Oct 04 19:39:09.421725 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 19:39:09.421725 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 19:39:09.421725 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 19:39:09.421725 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 0 Oct 04 19:39:09.421725 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 19:39:09.421725 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 19:39:09.421725 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 19:39:09.421725 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 19:39:09.421725 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPIqNPSW-jY_CXlvweXkAb59PzbD_M9ifcFUjpTbr3KbdOrHUB_aNtkTXlDq8uWp-Uz3LkN9Bpw8W-Ed2va8SU5LJbVHgy-uC1qVHJobUD1nv6xPfp-0ohneG8KzimTY76cYfXn9BJJ6sDEX25dNNYJgqA5GKr8Hn0LvuJeIH2g-v6U8 Oct 04 19:39:09.421725 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 19:39:09.421725 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 19:39:09.421725 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 19:39:09.421725 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 19:39:09.421725 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 19:39:09.421725 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 19:39:09.421725 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: 0652fe65874b4606822aa7f261387bc8 Oct 04 19:39:09.421725 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-ServerActionsTestJSON-1261889807 Oct 04 19:39:09.421725 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 19:39:09.421725 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 19:39:09.421725 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/0652fe65874b4606822aa7f261387bc8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_0652fe65874b4606822aa7f261387bc8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0652fe65874b4606822aa7f261387bc8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0652fe65874b4606822aa7f261387bc8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 19:39:09.421725 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-ServerActionsTestJSON-1261889807 Oct 04 19:39:09.421725 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: 0652fe65874b4606822aa7f261387bc8 Oct 04 19:39:09.421725 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-ServerActionsTestJSON-1261889807 Oct 04 19:39:09.421725 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-ServerActionsTestJSON-1261889807-project Oct 04 19:39:09.421725 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 19:39:09.421725 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 19:39:09.421725 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: 0f67ee6767314bfb9cc04ea9c0dafb4b Oct 04 19:39:09.421725 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-ServerActionsTestJSON-1261889807-project Oct 04 19:39:09.421725 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 19:39:09.421725 n-d-851028-13 devstack@n-api.service[123595]: exception: Instance 90c30ac8-f581-4ee8-b40d-f752a9cd384e could not be found. Oct 04 19:39:09.421725 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': '90c30ac8-f581-4ee8-b40d-f752a9cd384e'} Oct 04 19:39:09.421725 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:39:09.421725 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:39:09.421725 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:39:09.421725 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:39:09.421725 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:39:09.421725 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:39:09.421725 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:39:09.421725 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:39:09.421725 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:39:09.421725 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:39:09.421725 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90c30ac8-f581-4ee8-b40d-f752a9cd384e could not be found. Oct 04 19:39:09.421725 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:39:09.421725 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:39:09.421725 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:39:09.421725 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:39:09.421725 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:39:09.421725 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:39:09.421725 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:39:09.421725 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:39:09.421725 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:39:09.421725 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:39:09.421725 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:39:09.421725 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:39:09.421725 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:39:09.421725 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:39:09.421725 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:39:09.421725 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:39:09.421725 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90c30ac8-f581-4ee8-b40d-f752a9cd384e could not be found. Oct 04 19:39:09.421725 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:39:09.421725 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:39:09.421725 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:39:09.426424 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:39:09.426424 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:39:09.426424 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:39:09.426424 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:39:09.426424 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:39:09.426424 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90c30ac8-f581-4ee8-b40d-f752a9cd384e could not be found. Oct 04 19:39:09.426424 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:39:09.426424 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-53b7eeed-2ef6-4ed3-91d3-3809562c43c0 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Returning 404 to user: Instance 90c30ac8-f581-4ee8-b40d-f752a9cd384e could not be found. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:39:09.426424 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-53b7eeed-2ef6-4ed3-91d3-3809562c43c0 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "GET /compute/v2.1/servers/90c30ac8-f581-4ee8-b40d-f752a9cd384e" status: 404 len: 111 microversion: 2.1 time: 0.033775 Oct 04 19:39:09.427689 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3482/7334] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:39:09 2022] GET /compute/v2.1/servers/90c30ac8-f581-4ee8-b40d-f752a9cd384e => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:39:09.433618 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-0e82dfe2-6ba6-49be-b94d-e5c48ebbb6fa tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:39:09.434139 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-0e82dfe2-6ba6-49be-b94d-e5c48ebbb6fa tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: c468edaa-bfd8-43c8-9a71-07a7d19b8a2b] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:39:09.440793 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0e82dfe2-6ba6-49be-b94d-e5c48ebbb6fa tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:09.441330 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0e82dfe2-6ba6-49be-b94d-e5c48ebbb6fa tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:09.441786 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0e82dfe2-6ba6-49be-b94d-e5c48ebbb6fa tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:09.442506 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0e82dfe2-6ba6-49be-b94d-e5c48ebbb6fa tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:09.442977 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0e82dfe2-6ba6-49be-b94d-e5c48ebbb6fa tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:09.443422 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0e82dfe2-6ba6-49be-b94d-e5c48ebbb6fa tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:09.457939 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-0e82dfe2-6ba6-49be-b94d-e5c48ebbb6fa tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] HTTP exception thrown: Instance c468edaa-bfd8-43c8-9a71-07a7d19b8a2b could not be found. Oct 04 19:39:09.459525 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-0e82dfe2-6ba6-49be-b94d-e5c48ebbb6fa tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Request method failure captured: Oct 04 19:39:09.459525 n-d-851028-13 devstack@n-api.service[123596]: request: DELETE /compute/v2.1/servers/c468edaa-bfd8-43c8-9a71-07a7d19b8a2b HTTP/1.1 Oct 04 19:39:09.459525 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 19:39:09.459525 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 19:39:09.459525 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 19:39:09.459525 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 19:39:09.459525 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 19:39:09.459525 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 19:39:09.459525 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 19:39:09.459525 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 19:39:09.459525 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPIqNPSW-jY_CXlvweXkAb59PzbD_M9ifcFUjpTbr3KbdOrHUB_aNtkTXlDq8uWp-Uz3LkN9Bpw8W-Ed2va8SU5LJbVHgy-uC1qVHJobUD1nv6xPfp-0ohneG8KzimTY76cYfXn9BJJ6sDEX25dNNYJgqA5GKr8Hn0LvuJeIH2g-v6U8 Oct 04 19:39:09.459525 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 19:39:09.459525 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 19:39:09.459525 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 19:39:09.459525 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 19:39:09.459525 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 19:39:09.459525 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 19:39:09.459525 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: 0652fe65874b4606822aa7f261387bc8 Oct 04 19:39:09.459525 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-ServerActionsTestJSON-1261889807 Oct 04 19:39:09.459525 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 19:39:09.459525 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 19:39:09.459525 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/0652fe65874b4606822aa7f261387bc8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_0652fe65874b4606822aa7f261387bc8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0652fe65874b4606822aa7f261387bc8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0652fe65874b4606822aa7f261387bc8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 19:39:09.459525 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-ServerActionsTestJSON-1261889807 Oct 04 19:39:09.459525 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: 0652fe65874b4606822aa7f261387bc8 Oct 04 19:39:09.459525 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-ServerActionsTestJSON-1261889807 Oct 04 19:39:09.459525 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-ServerActionsTestJSON-1261889807-project Oct 04 19:39:09.459525 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 19:39:09.459525 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 19:39:09.459525 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 0f67ee6767314bfb9cc04ea9c0dafb4b Oct 04 19:39:09.459525 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-ServerActionsTestJSON-1261889807-project Oct 04 19:39:09.459525 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 19:39:09.459525 n-d-851028-13 devstack@n-api.service[123596]: exception: Instance c468edaa-bfd8-43c8-9a71-07a7d19b8a2b could not be found. Oct 04 19:39:09.459525 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': 'c468edaa-bfd8-43c8-9a71-07a7d19b8a2b'} Oct 04 19:39:09.459525 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:39:09.459525 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:39:09.459525 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:39:09.459525 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:39:09.459525 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:39:09.459525 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:39:09.459525 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:39:09.459525 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:39:09.459525 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:39:09.459525 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:39:09.459525 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c468edaa-bfd8-43c8-9a71-07a7d19b8a2b could not be found. Oct 04 19:39:09.459525 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:39:09.459525 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:39:09.459525 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:39:09.459525 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:39:09.459525 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:39:09.459525 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:39:09.459525 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:39:09.459525 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:39:09.459525 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:39:09.459525 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:39:09.459525 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 19:39:09.459525 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 19:39:09.459525 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 19:39:09.459525 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 19:39:09.459525 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:39:09.459525 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:39:09.459525 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:39:09.459525 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:39:09.467821 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c468edaa-bfd8-43c8-9a71-07a7d19b8a2b could not be found. Oct 04 19:39:09.467821 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:39:09.467821 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:39:09.467821 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:39:09.467821 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:39:09.467821 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:39:09.467821 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:39:09.467821 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:39:09.467821 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:39:09.467821 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c468edaa-bfd8-43c8-9a71-07a7d19b8a2b could not be found. Oct 04 19:39:09.467821 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:39:09.467821 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-0e82dfe2-6ba6-49be-b94d-e5c48ebbb6fa tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Returning 404 to user: Instance c468edaa-bfd8-43c8-9a71-07a7d19b8a2b could not be found. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:39:09.467821 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-0e82dfe2-6ba6-49be-b94d-e5c48ebbb6fa tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "DELETE /compute/v2.1/servers/c468edaa-bfd8-43c8-9a71-07a7d19b8a2b" status: 404 len: 111 microversion: 2.1 time: 0.031952 Oct 04 19:39:09.467821 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3853/7335] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 19:39:09 2022] DELETE /compute/v2.1/servers/c468edaa-bfd8-43c8-9a71-07a7d19b8a2b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:39:09.470299 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-11b98ec3-72ad-427d-a1b1-043bcd730bdc tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:39:09.470913 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-11b98ec3-72ad-427d-a1b1-043bcd730bdc tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: c468edaa-bfd8-43c8-9a71-07a7d19b8a2b] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:39:09.476895 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-11b98ec3-72ad-427d-a1b1-043bcd730bdc tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:09.477455 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-11b98ec3-72ad-427d-a1b1-043bcd730bdc tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:09.477898 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-11b98ec3-72ad-427d-a1b1-043bcd730bdc tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:09.478594 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-11b98ec3-72ad-427d-a1b1-043bcd730bdc tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:09.479057 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-11b98ec3-72ad-427d-a1b1-043bcd730bdc tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:09.479492 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-11b98ec3-72ad-427d-a1b1-043bcd730bdc tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:09.493136 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-11b98ec3-72ad-427d-a1b1-043bcd730bdc tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] HTTP exception thrown: Instance c468edaa-bfd8-43c8-9a71-07a7d19b8a2b could not be found. Oct 04 19:39:09.494663 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-11b98ec3-72ad-427d-a1b1-043bcd730bdc tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Request method failure captured: Oct 04 19:39:09.494663 n-d-851028-13 devstack@n-api.service[123595]: request: GET /compute/v2.1/servers/c468edaa-bfd8-43c8-9a71-07a7d19b8a2b HTTP/1.1 Oct 04 19:39:09.494663 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 19:39:09.494663 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 19:39:09.494663 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 19:39:09.494663 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 0 Oct 04 19:39:09.494663 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 19:39:09.494663 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 19:39:09.494663 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 19:39:09.494663 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 19:39:09.494663 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPIqNPSW-jY_CXlvweXkAb59PzbD_M9ifcFUjpTbr3KbdOrHUB_aNtkTXlDq8uWp-Uz3LkN9Bpw8W-Ed2va8SU5LJbVHgy-uC1qVHJobUD1nv6xPfp-0ohneG8KzimTY76cYfXn9BJJ6sDEX25dNNYJgqA5GKr8Hn0LvuJeIH2g-v6U8 Oct 04 19:39:09.494663 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 19:39:09.494663 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 19:39:09.494663 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 19:39:09.494663 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 19:39:09.494663 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 19:39:09.494663 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 19:39:09.494663 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: 0652fe65874b4606822aa7f261387bc8 Oct 04 19:39:09.494663 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-ServerActionsTestJSON-1261889807 Oct 04 19:39:09.494663 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 19:39:09.494663 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 19:39:09.494663 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/0652fe65874b4606822aa7f261387bc8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_0652fe65874b4606822aa7f261387bc8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0652fe65874b4606822aa7f261387bc8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0652fe65874b4606822aa7f261387bc8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 19:39:09.494663 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-ServerActionsTestJSON-1261889807 Oct 04 19:39:09.494663 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: 0652fe65874b4606822aa7f261387bc8 Oct 04 19:39:09.494663 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-ServerActionsTestJSON-1261889807 Oct 04 19:39:09.494663 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-ServerActionsTestJSON-1261889807-project Oct 04 19:39:09.494663 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 19:39:09.494663 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 19:39:09.494663 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: 0f67ee6767314bfb9cc04ea9c0dafb4b Oct 04 19:39:09.494663 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-ServerActionsTestJSON-1261889807-project Oct 04 19:39:09.494663 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 19:39:09.494663 n-d-851028-13 devstack@n-api.service[123595]: exception: Instance c468edaa-bfd8-43c8-9a71-07a7d19b8a2b could not be found. Oct 04 19:39:09.494663 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': 'c468edaa-bfd8-43c8-9a71-07a7d19b8a2b'} Oct 04 19:39:09.494663 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:39:09.494663 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:39:09.494663 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:39:09.494663 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:39:09.494663 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:39:09.494663 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:39:09.494663 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:39:09.494663 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:39:09.494663 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:39:09.494663 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:39:09.494663 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c468edaa-bfd8-43c8-9a71-07a7d19b8a2b could not be found. Oct 04 19:39:09.494663 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:39:09.494663 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:39:09.494663 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:39:09.494663 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:39:09.494663 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:39:09.494663 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:39:09.494663 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:39:09.494663 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:39:09.494663 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:39:09.494663 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:39:09.494663 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:39:09.494663 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:39:09.494663 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:39:09.494663 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:39:09.494663 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:39:09.494663 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:39:09.494663 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c468edaa-bfd8-43c8-9a71-07a7d19b8a2b could not be found. Oct 04 19:39:09.494663 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:39:09.494663 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:39:09.494663 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:39:09.498984 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:39:09.498984 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:39:09.498984 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:39:09.498984 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:39:09.498984 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:39:09.498984 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c468edaa-bfd8-43c8-9a71-07a7d19b8a2b could not be found. Oct 04 19:39:09.498984 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:39:09.498984 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-11b98ec3-72ad-427d-a1b1-043bcd730bdc tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Returning 404 to user: Instance c468edaa-bfd8-43c8-9a71-07a7d19b8a2b could not be found. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:39:09.498984 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-11b98ec3-72ad-427d-a1b1-043bcd730bdc tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "GET /compute/v2.1/servers/c468edaa-bfd8-43c8-9a71-07a7d19b8a2b" status: 404 len: 111 microversion: 2.1 time: 0.030129 Oct 04 19:39:09.498984 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3483/7336] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:39:09 2022] GET /compute/v2.1/servers/c468edaa-bfd8-43c8-9a71-07a7d19b8a2b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 19:39:09.504922 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-7550732a-94ea-4b09-b6b3-0d5753b3f06f tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:39:09.505533 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-7550732a-94ea-4b09-b6b3-0d5753b3f06f tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: aa080ff6-baae-4d71-aa99-37b55ab7f2ed] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:39:09.511895 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7550732a-94ea-4b09-b6b3-0d5753b3f06f tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:09.512469 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7550732a-94ea-4b09-b6b3-0d5753b3f06f tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:09.513574 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7550732a-94ea-4b09-b6b3-0d5753b3f06f tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:09.514351 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7550732a-94ea-4b09-b6b3-0d5753b3f06f tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:09.514895 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7550732a-94ea-4b09-b6b3-0d5753b3f06f tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:09.515410 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7550732a-94ea-4b09-b6b3-0d5753b3f06f tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:09.528970 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-7550732a-94ea-4b09-b6b3-0d5753b3f06f tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] HTTP exception thrown: Instance aa080ff6-baae-4d71-aa99-37b55ab7f2ed could not be found. Oct 04 19:39:09.530711 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-7550732a-94ea-4b09-b6b3-0d5753b3f06f tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Request method failure captured: Oct 04 19:39:09.530711 n-d-851028-13 devstack@n-api.service[123596]: request: DELETE /compute/v2.1/servers/aa080ff6-baae-4d71-aa99-37b55ab7f2ed HTTP/1.1 Oct 04 19:39:09.530711 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 19:39:09.530711 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 19:39:09.530711 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 19:39:09.530711 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 19:39:09.530711 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 19:39:09.530711 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 19:39:09.530711 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 19:39:09.530711 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 19:39:09.530711 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPIqNPSW-jY_CXlvweXkAb59PzbD_M9ifcFUjpTbr3KbdOrHUB_aNtkTXlDq8uWp-Uz3LkN9Bpw8W-Ed2va8SU5LJbVHgy-uC1qVHJobUD1nv6xPfp-0ohneG8KzimTY76cYfXn9BJJ6sDEX25dNNYJgqA5GKr8Hn0LvuJeIH2g-v6U8 Oct 04 19:39:09.530711 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 19:39:09.530711 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 19:39:09.530711 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 19:39:09.530711 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 19:39:09.530711 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 19:39:09.530711 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 19:39:09.530711 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: 0652fe65874b4606822aa7f261387bc8 Oct 04 19:39:09.530711 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-ServerActionsTestJSON-1261889807 Oct 04 19:39:09.530711 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 19:39:09.530711 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 19:39:09.530711 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/0652fe65874b4606822aa7f261387bc8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_0652fe65874b4606822aa7f261387bc8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0652fe65874b4606822aa7f261387bc8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0652fe65874b4606822aa7f261387bc8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 19:39:09.530711 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-ServerActionsTestJSON-1261889807 Oct 04 19:39:09.530711 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: 0652fe65874b4606822aa7f261387bc8 Oct 04 19:39:09.530711 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-ServerActionsTestJSON-1261889807 Oct 04 19:39:09.530711 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-ServerActionsTestJSON-1261889807-project Oct 04 19:39:09.530711 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 19:39:09.530711 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 19:39:09.530711 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 0f67ee6767314bfb9cc04ea9c0dafb4b Oct 04 19:39:09.530711 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-ServerActionsTestJSON-1261889807-project Oct 04 19:39:09.530711 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 19:39:09.530711 n-d-851028-13 devstack@n-api.service[123596]: exception: Instance aa080ff6-baae-4d71-aa99-37b55ab7f2ed could not be found. Oct 04 19:39:09.530711 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': 'aa080ff6-baae-4d71-aa99-37b55ab7f2ed'} Oct 04 19:39:09.530711 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:39:09.530711 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:39:09.530711 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:39:09.530711 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:39:09.530711 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:39:09.530711 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:39:09.530711 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:39:09.530711 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:39:09.530711 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:39:09.530711 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:39:09.530711 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa080ff6-baae-4d71-aa99-37b55ab7f2ed could not be found. Oct 04 19:39:09.530711 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:39:09.530711 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:39:09.530711 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:39:09.530711 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:39:09.530711 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:39:09.530711 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:39:09.530711 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:39:09.530711 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:39:09.530711 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:39:09.530711 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:39:09.530711 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 19:39:09.530711 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 19:39:09.530711 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 19:39:09.530711 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 19:39:09.530711 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:39:09.530711 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:39:09.530711 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:39:09.530711 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:39:09.535562 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa080ff6-baae-4d71-aa99-37b55ab7f2ed could not be found. Oct 04 19:39:09.535562 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:39:09.535562 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:39:09.535562 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:39:09.535562 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:39:09.535562 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:39:09.535562 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:39:09.535562 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:39:09.535562 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:39:09.535562 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa080ff6-baae-4d71-aa99-37b55ab7f2ed could not be found. Oct 04 19:39:09.535562 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:39:09.535562 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-7550732a-94ea-4b09-b6b3-0d5753b3f06f tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Returning 404 to user: Instance aa080ff6-baae-4d71-aa99-37b55ab7f2ed could not be found. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:39:09.535562 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-7550732a-94ea-4b09-b6b3-0d5753b3f06f tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "DELETE /compute/v2.1/servers/aa080ff6-baae-4d71-aa99-37b55ab7f2ed" status: 404 len: 111 microversion: 2.1 time: 0.031086 Oct 04 19:39:09.535562 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3854/7337] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 19:39:09 2022] DELETE /compute/v2.1/servers/aa080ff6-baae-4d71-aa99-37b55ab7f2ed => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:39:09.541635 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-b9a53394-af8e-4efd-b278-80d2ebe6c641 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:39:09.542254 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-b9a53394-af8e-4efd-b278-80d2ebe6c641 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: aa080ff6-baae-4d71-aa99-37b55ab7f2ed] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:39:09.548663 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b9a53394-af8e-4efd-b278-80d2ebe6c641 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:09.549178 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b9a53394-af8e-4efd-b278-80d2ebe6c641 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:09.549628 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b9a53394-af8e-4efd-b278-80d2ebe6c641 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:09.550324 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b9a53394-af8e-4efd-b278-80d2ebe6c641 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:09.550781 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b9a53394-af8e-4efd-b278-80d2ebe6c641 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:09.551213 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b9a53394-af8e-4efd-b278-80d2ebe6c641 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:09.564861 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-b9a53394-af8e-4efd-b278-80d2ebe6c641 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] HTTP exception thrown: Instance aa080ff6-baae-4d71-aa99-37b55ab7f2ed could not be found. Oct 04 19:39:09.566745 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-b9a53394-af8e-4efd-b278-80d2ebe6c641 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Request method failure captured: Oct 04 19:39:09.566745 n-d-851028-13 devstack@n-api.service[123595]: request: GET /compute/v2.1/servers/aa080ff6-baae-4d71-aa99-37b55ab7f2ed HTTP/1.1 Oct 04 19:39:09.566745 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 19:39:09.566745 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 19:39:09.566745 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 19:39:09.566745 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 0 Oct 04 19:39:09.566745 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 19:39:09.566745 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 19:39:09.566745 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 19:39:09.566745 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 19:39:09.566745 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPIqNPSW-jY_CXlvweXkAb59PzbD_M9ifcFUjpTbr3KbdOrHUB_aNtkTXlDq8uWp-Uz3LkN9Bpw8W-Ed2va8SU5LJbVHgy-uC1qVHJobUD1nv6xPfp-0ohneG8KzimTY76cYfXn9BJJ6sDEX25dNNYJgqA5GKr8Hn0LvuJeIH2g-v6U8 Oct 04 19:39:09.566745 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 19:39:09.566745 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 19:39:09.566745 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 19:39:09.566745 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 19:39:09.566745 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 19:39:09.566745 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 19:39:09.566745 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: 0652fe65874b4606822aa7f261387bc8 Oct 04 19:39:09.566745 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-ServerActionsTestJSON-1261889807 Oct 04 19:39:09.566745 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 19:39:09.566745 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 19:39:09.566745 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/0652fe65874b4606822aa7f261387bc8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_0652fe65874b4606822aa7f261387bc8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0652fe65874b4606822aa7f261387bc8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0652fe65874b4606822aa7f261387bc8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 19:39:09.566745 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-ServerActionsTestJSON-1261889807 Oct 04 19:39:09.566745 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: 0652fe65874b4606822aa7f261387bc8 Oct 04 19:39:09.566745 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-ServerActionsTestJSON-1261889807 Oct 04 19:39:09.566745 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-ServerActionsTestJSON-1261889807-project Oct 04 19:39:09.566745 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 19:39:09.566745 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 19:39:09.566745 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: 0f67ee6767314bfb9cc04ea9c0dafb4b Oct 04 19:39:09.566745 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-ServerActionsTestJSON-1261889807-project Oct 04 19:39:09.566745 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 19:39:09.566745 n-d-851028-13 devstack@n-api.service[123595]: exception: Instance aa080ff6-baae-4d71-aa99-37b55ab7f2ed could not be found. Oct 04 19:39:09.566745 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': 'aa080ff6-baae-4d71-aa99-37b55ab7f2ed'} Oct 04 19:39:09.566745 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:39:09.566745 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:39:09.566745 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:39:09.566745 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:39:09.566745 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:39:09.566745 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:39:09.566745 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:39:09.566745 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:39:09.566745 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:39:09.566745 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:39:09.566745 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa080ff6-baae-4d71-aa99-37b55ab7f2ed could not be found. Oct 04 19:39:09.566745 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:39:09.566745 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:39:09.566745 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:39:09.566745 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:39:09.566745 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:39:09.566745 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:39:09.566745 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:39:09.566745 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:39:09.566745 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:39:09.566745 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:39:09.566745 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:39:09.566745 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:39:09.566745 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:39:09.566745 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:39:09.566745 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:39:09.566745 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:39:09.566745 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa080ff6-baae-4d71-aa99-37b55ab7f2ed could not be found. Oct 04 19:39:09.566745 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:39:09.566745 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:39:09.566745 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:39:09.570681 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:39:09.570681 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:39:09.570681 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:39:09.570681 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:39:09.570681 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:39:09.570681 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa080ff6-baae-4d71-aa99-37b55ab7f2ed could not be found. Oct 04 19:39:09.570681 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:39:09.570681 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-b9a53394-af8e-4efd-b278-80d2ebe6c641 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Returning 404 to user: Instance aa080ff6-baae-4d71-aa99-37b55ab7f2ed could not be found. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:39:09.570681 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-b9a53394-af8e-4efd-b278-80d2ebe6c641 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "GET /compute/v2.1/servers/aa080ff6-baae-4d71-aa99-37b55ab7f2ed" status: 404 len: 111 microversion: 2.1 time: 0.030768 Oct 04 19:39:09.570681 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3484/7338] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:39:09 2022] GET /compute/v2.1/servers/aa080ff6-baae-4d71-aa99-37b55ab7f2ed => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:39:09.577419 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-1231a6ea-23b6-4ad0-a210-10b089c5abc4 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:39:09.577943 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-1231a6ea-23b6-4ad0-a210-10b089c5abc4 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: 8f69d18a-8407-4ab4-8f5c-5f23979b2ac6] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:39:09.584079 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1231a6ea-23b6-4ad0-a210-10b089c5abc4 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:09.584531 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1231a6ea-23b6-4ad0-a210-10b089c5abc4 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:09.584988 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1231a6ea-23b6-4ad0-a210-10b089c5abc4 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:09.585726 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1231a6ea-23b6-4ad0-a210-10b089c5abc4 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:09.586199 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1231a6ea-23b6-4ad0-a210-10b089c5abc4 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:09.586647 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1231a6ea-23b6-4ad0-a210-10b089c5abc4 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:09.601037 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-1231a6ea-23b6-4ad0-a210-10b089c5abc4 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] HTTP exception thrown: Instance 8f69d18a-8407-4ab4-8f5c-5f23979b2ac6 could not be found. Oct 04 19:39:09.602630 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-1231a6ea-23b6-4ad0-a210-10b089c5abc4 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Request method failure captured: Oct 04 19:39:09.602630 n-d-851028-13 devstack@n-api.service[123596]: request: DELETE /compute/v2.1/servers/8f69d18a-8407-4ab4-8f5c-5f23979b2ac6 HTTP/1.1 Oct 04 19:39:09.602630 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 19:39:09.602630 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 19:39:09.602630 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 19:39:09.602630 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 19:39:09.602630 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 19:39:09.602630 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 19:39:09.602630 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 19:39:09.602630 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 19:39:09.602630 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPIqNPSW-jY_CXlvweXkAb59PzbD_M9ifcFUjpTbr3KbdOrHUB_aNtkTXlDq8uWp-Uz3LkN9Bpw8W-Ed2va8SU5LJbVHgy-uC1qVHJobUD1nv6xPfp-0ohneG8KzimTY76cYfXn9BJJ6sDEX25dNNYJgqA5GKr8Hn0LvuJeIH2g-v6U8 Oct 04 19:39:09.602630 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 19:39:09.602630 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 19:39:09.602630 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 19:39:09.602630 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 19:39:09.602630 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 19:39:09.602630 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 19:39:09.602630 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: 0652fe65874b4606822aa7f261387bc8 Oct 04 19:39:09.602630 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-ServerActionsTestJSON-1261889807 Oct 04 19:39:09.602630 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 19:39:09.602630 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 19:39:09.602630 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/0652fe65874b4606822aa7f261387bc8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_0652fe65874b4606822aa7f261387bc8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0652fe65874b4606822aa7f261387bc8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0652fe65874b4606822aa7f261387bc8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 19:39:09.602630 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-ServerActionsTestJSON-1261889807 Oct 04 19:39:09.602630 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: 0652fe65874b4606822aa7f261387bc8 Oct 04 19:39:09.602630 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-ServerActionsTestJSON-1261889807 Oct 04 19:39:09.602630 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-ServerActionsTestJSON-1261889807-project Oct 04 19:39:09.602630 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 19:39:09.602630 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 19:39:09.602630 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 0f67ee6767314bfb9cc04ea9c0dafb4b Oct 04 19:39:09.602630 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-ServerActionsTestJSON-1261889807-project Oct 04 19:39:09.602630 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 19:39:09.602630 n-d-851028-13 devstack@n-api.service[123596]: exception: Instance 8f69d18a-8407-4ab4-8f5c-5f23979b2ac6 could not be found. Oct 04 19:39:09.602630 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': '8f69d18a-8407-4ab4-8f5c-5f23979b2ac6'} Oct 04 19:39:09.602630 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:39:09.602630 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:39:09.602630 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:39:09.602630 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:39:09.602630 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:39:09.602630 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:39:09.602630 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:39:09.602630 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:39:09.602630 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:39:09.602630 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:39:09.602630 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f69d18a-8407-4ab4-8f5c-5f23979b2ac6 could not be found. Oct 04 19:39:09.602630 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:39:09.602630 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:39:09.602630 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:39:09.602630 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:39:09.602630 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:39:09.602630 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:39:09.602630 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:39:09.602630 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:39:09.602630 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:39:09.602630 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:39:09.602630 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 19:39:09.602630 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 19:39:09.602630 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 19:39:09.602630 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 19:39:09.602630 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:39:09.602630 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:39:09.602630 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:39:09.602630 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:39:09.606578 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f69d18a-8407-4ab4-8f5c-5f23979b2ac6 could not be found. Oct 04 19:39:09.606578 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:39:09.606578 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:39:09.606578 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:39:09.606578 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:39:09.606578 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:39:09.606578 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:39:09.606578 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:39:09.606578 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:39:09.606578 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f69d18a-8407-4ab4-8f5c-5f23979b2ac6 could not be found. Oct 04 19:39:09.606578 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:39:09.606578 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-1231a6ea-23b6-4ad0-a210-10b089c5abc4 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Returning 404 to user: Instance 8f69d18a-8407-4ab4-8f5c-5f23979b2ac6 could not be found. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:39:09.606578 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-1231a6ea-23b6-4ad0-a210-10b089c5abc4 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "DELETE /compute/v2.1/servers/8f69d18a-8407-4ab4-8f5c-5f23979b2ac6" status: 404 len: 111 microversion: 2.1 time: 0.031065 Oct 04 19:39:09.606578 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3855/7339] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 19:39:09 2022] DELETE /compute/v2.1/servers/8f69d18a-8407-4ab4-8f5c-5f23979b2ac6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:39:09.612665 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-bb25f801-ab87-45b9-9401-fc24db77c19d tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:39:09.613340 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-bb25f801-ab87-45b9-9401-fc24db77c19d tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] [instance: 8f69d18a-8407-4ab4-8f5c-5f23979b2ac6] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:39:09.619403 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bb25f801-ab87-45b9-9401-fc24db77c19d tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:09.619896 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bb25f801-ab87-45b9-9401-fc24db77c19d tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:09.620343 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bb25f801-ab87-45b9-9401-fc24db77c19d tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:09.621048 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bb25f801-ab87-45b9-9401-fc24db77c19d tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:09.621536 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bb25f801-ab87-45b9-9401-fc24db77c19d tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:09.621967 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bb25f801-ab87-45b9-9401-fc24db77c19d tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:09.636179 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-bb25f801-ab87-45b9-9401-fc24db77c19d tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] HTTP exception thrown: Instance 8f69d18a-8407-4ab4-8f5c-5f23979b2ac6 could not be found. Oct 04 19:39:09.637760 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-bb25f801-ab87-45b9-9401-fc24db77c19d tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Request method failure captured: Oct 04 19:39:09.637760 n-d-851028-13 devstack@n-api.service[123595]: request: GET /compute/v2.1/servers/8f69d18a-8407-4ab4-8f5c-5f23979b2ac6 HTTP/1.1 Oct 04 19:39:09.637760 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 19:39:09.637760 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 19:39:09.637760 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 19:39:09.637760 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 0 Oct 04 19:39:09.637760 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 19:39:09.637760 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 19:39:09.637760 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 19:39:09.637760 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 19:39:09.637760 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPIqNPSW-jY_CXlvweXkAb59PzbD_M9ifcFUjpTbr3KbdOrHUB_aNtkTXlDq8uWp-Uz3LkN9Bpw8W-Ed2va8SU5LJbVHgy-uC1qVHJobUD1nv6xPfp-0ohneG8KzimTY76cYfXn9BJJ6sDEX25dNNYJgqA5GKr8Hn0LvuJeIH2g-v6U8 Oct 04 19:39:09.637760 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 19:39:09.637760 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 19:39:09.637760 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 19:39:09.637760 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 19:39:09.637760 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 19:39:09.637760 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 19:39:09.637760 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: 0652fe65874b4606822aa7f261387bc8 Oct 04 19:39:09.637760 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-ServerActionsTestJSON-1261889807 Oct 04 19:39:09.637760 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 19:39:09.637760 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 19:39:09.637760 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/0652fe65874b4606822aa7f261387bc8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_0652fe65874b4606822aa7f261387bc8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0652fe65874b4606822aa7f261387bc8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0652fe65874b4606822aa7f261387bc8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 19:39:09.637760 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-ServerActionsTestJSON-1261889807 Oct 04 19:39:09.637760 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: 0652fe65874b4606822aa7f261387bc8 Oct 04 19:39:09.637760 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-ServerActionsTestJSON-1261889807 Oct 04 19:39:09.637760 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-ServerActionsTestJSON-1261889807-project Oct 04 19:39:09.637760 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 19:39:09.637760 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 19:39:09.637760 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: 0f67ee6767314bfb9cc04ea9c0dafb4b Oct 04 19:39:09.637760 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-ServerActionsTestJSON-1261889807-project Oct 04 19:39:09.637760 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 19:39:09.637760 n-d-851028-13 devstack@n-api.service[123595]: exception: Instance 8f69d18a-8407-4ab4-8f5c-5f23979b2ac6 could not be found. Oct 04 19:39:09.637760 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': '8f69d18a-8407-4ab4-8f5c-5f23979b2ac6'} Oct 04 19:39:09.637760 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:39:09.637760 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:39:09.637760 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:39:09.637760 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:39:09.637760 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:39:09.637760 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:39:09.637760 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:39:09.637760 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:39:09.637760 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:39:09.637760 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:39:09.637760 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f69d18a-8407-4ab4-8f5c-5f23979b2ac6 could not be found. Oct 04 19:39:09.637760 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:39:09.637760 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:39:09.637760 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:39:09.637760 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:39:09.637760 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:39:09.637760 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:39:09.637760 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:39:09.637760 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:39:09.637760 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:39:09.637760 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:39:09.637760 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:39:09.637760 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:39:09.637760 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:39:09.637760 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:39:09.637760 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:39:09.637760 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:39:09.637760 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f69d18a-8407-4ab4-8f5c-5f23979b2ac6 could not be found. Oct 04 19:39:09.637760 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:39:09.637760 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:39:09.637760 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:39:09.642862 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:39:09.642862 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:39:09.642862 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:39:09.642862 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:39:09.642862 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:39:09.642862 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f69d18a-8407-4ab4-8f5c-5f23979b2ac6 could not be found. Oct 04 19:39:09.642862 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:39:09.642862 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-bb25f801-ab87-45b9-9401-fc24db77c19d tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Returning 404 to user: Instance 8f69d18a-8407-4ab4-8f5c-5f23979b2ac6 could not be found. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:39:09.642862 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-bb25f801-ab87-45b9-9401-fc24db77c19d tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "GET /compute/v2.1/servers/8f69d18a-8407-4ab4-8f5c-5f23979b2ac6" status: 404 len: 111 microversion: 2.1 time: 0.030995 Oct 04 19:39:09.642862 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3485/7340] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:39:09 2022] GET /compute/v2.1/servers/8f69d18a-8407-4ab4-8f5c-5f23979b2ac6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:39:09.648453 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-1756261b-bbc9-4625-a9d4-dd7fa6628883 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] Calling method '.version_select at 0x7fb21c58daf0>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:39:09.672755 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-1756261b-bbc9-4625-a9d4-dd7fa6628883 tempest-ServerActionsTestJSON-1261889807 tempest-ServerActionsTestJSON-1261889807-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1677005794" status: 202 len: 0 microversion: 2.1 time: 0.027946 Oct 04 19:39:09.673392 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3856/7341] 10.222.0.43 () {58 vars in 1221 bytes} [Tue Oct 4 19:39:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1677005794 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:39:19.135804 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-772d3b35-6185-4dfa-a700-102427cae154 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1998905628", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452", "networks": [{"uuid": "599ac7bb-d70c-4c68-baf9-1bfe7e6c05bd"}]}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:39:19.193187 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.network.neutron [None req-772d3b35-6185-4dfa-a700-102427cae154 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] validate_networks() for [('599ac7bb-d70c-4c68-baf9-1bfe7e6c05bd', None, None, None, None, None)] {{(pid=123595) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 19:39:19.626551 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=33 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:39:19.670828 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-772d3b35-6185-4dfa-a700-102427cae154 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Flavor limits 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:39:19.671257 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-772d3b35-6185-4dfa-a700-102427cae154 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Image limits 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:39:19.671731 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-772d3b35-6185-4dfa-a700-102427cae154 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Flavor pref 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:39:19.672143 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-772d3b35-6185-4dfa-a700-102427cae154 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Image pref 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:39:19.672557 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-772d3b35-6185-4dfa-a700-102427cae154 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:39:19.682329 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-772d3b35-6185-4dfa-a700-102427cae154 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:19.683011 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-772d3b35-6185-4dfa-a700-102427cae154 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:19.683481 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-772d3b35-6185-4dfa-a700-102427cae154 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:19.684729 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-772d3b35-6185-4dfa-a700-102427cae154 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:19.685224 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-772d3b35-6185-4dfa-a700-102427cae154 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:19.685658 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-772d3b35-6185-4dfa-a700-102427cae154 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:19.705534 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-772d3b35-6185-4dfa-a700-102427cae154 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Getting quotas for project 29dc28086df142998e726efe7f5649fa. Resources: {'ram', 'cores', 'instances'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:39:19.713612 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-772d3b35-6185-4dfa-a700-102427cae154 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Getting quotas for user 91c7a8ba3a634e8a8895fd82de1633ed and project 29dc28086df142998e726efe7f5649fa. Resources: {'ram', 'cores', 'instances'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:39:19.726464 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-772d3b35-6185-4dfa-a700-102427cae154 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Going to run 1 instances... {{(pid=123595) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 19:39:19.728786 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-772d3b35-6185-4dfa-a700-102427cae154 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] [instance: 4fd0aa73-4b6c-45fb-b5c8-6ce4df365c11] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e8943ec5-4038-4d4b-b9b9-2415a79f5243',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 19:39:19.777480 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-772d3b35-6185-4dfa-a700-102427cae154 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.774702 Oct 04 19:39:19.778529 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3486/7342] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 19:39:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 777 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 19:39:19.787865 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=29 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:39:19.790684 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_api:SELECT=12,nova_api:DELETE=1 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:39:19.799604 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-baf5d6c4-3ce0-4dfd-ba8f-b368e0775777 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:39:19.800622 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-baf5d6c4-3ce0-4dfd-ba8f-b368e0775777 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] [instance: 4fd0aa73-4b6c-45fb-b5c8-6ce4df365c11] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:39:19.879592 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-baf5d6c4-3ce0-4dfd-ba8f-b368e0775777 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c7a8ba3a634e8a8895fd82de1633ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29dc28086df142998e726efe7f5649fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:39:19.886948 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-baf5d6c4-3ce0-4dfd-ba8f-b368e0775777 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] 10.222.0.43 "GET /compute/v2.1/servers/4fd0aa73-4b6c-45fb-b5c8-6ce4df365c11" status: 200 len: 1217 microversion: 2.1 time: 0.100975 Oct 04 19:39:19.888160 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3857/7343] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:39:19 2022] GET /compute/v2.1/servers/4fd0aa73-4b6c-45fb-b5c8-6ce4df365c11 => generated 1217 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:39:20.910409 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-1b565d15-332f-46fb-8315-e58d5f29c502 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:39:20.911039 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-1b565d15-332f-46fb-8315-e58d5f29c502 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] [instance: 4fd0aa73-4b6c-45fb-b5c8-6ce4df365c11] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:39:20.968469 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-1b565d15-332f-46fb-8315-e58d5f29c502 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c7a8ba3a634e8a8895fd82de1633ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29dc28086df142998e726efe7f5649fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:39:20.976117 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-1b565d15-332f-46fb-8315-e58d5f29c502 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] 10.222.0.43 "GET /compute/v2.1/servers/4fd0aa73-4b6c-45fb-b5c8-6ce4df365c11" status: 200 len: 1217 microversion: 2.1 time: 0.069626 Oct 04 19:39:20.976633 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3487/7344] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:39:20 2022] GET /compute/v2.1/servers/4fd0aa73-4b6c-45fb-b5c8-6ce4df365c11 => generated 1217 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:39:21.999278 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-63f9b77b-952d-45e0-9dc4-a61f31677fc9 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:39:21.999959 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-63f9b77b-952d-45e0-9dc4-a61f31677fc9 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] [instance: 4fd0aa73-4b6c-45fb-b5c8-6ce4df365c11] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:39:22.079769 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-63f9b77b-952d-45e0-9dc4-a61f31677fc9 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c7a8ba3a634e8a8895fd82de1633ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29dc28086df142998e726efe7f5649fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:39:22.086827 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-63f9b77b-952d-45e0-9dc4-a61f31677fc9 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] 10.222.0.43 "GET /compute/v2.1/servers/4fd0aa73-4b6c-45fb-b5c8-6ce4df365c11" status: 200 len: 1217 microversion: 2.1 time: 0.091573 Oct 04 19:39:22.087382 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3858/7345] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:39:21 2022] GET /compute/v2.1/servers/4fd0aa73-4b6c-45fb-b5c8-6ce4df365c11 => generated 1217 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:39:23.111278 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-cf1ff2a6-368d-4a75-9e77-e73077ee2ad7 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:39:23.111892 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-cf1ff2a6-368d-4a75-9e77-e73077ee2ad7 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] [instance: 4fd0aa73-4b6c-45fb-b5c8-6ce4df365c11] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:39:23.163594 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-cf1ff2a6-368d-4a75-9e77-e73077ee2ad7 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c7a8ba3a634e8a8895fd82de1633ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29dc28086df142998e726efe7f5649fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:39:23.170301 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-cf1ff2a6-368d-4a75-9e77-e73077ee2ad7 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] 10.222.0.43 "GET /compute/v2.1/servers/4fd0aa73-4b6c-45fb-b5c8-6ce4df365c11" status: 200 len: 1217 microversion: 2.1 time: 0.062957 Oct 04 19:39:23.170864 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3488/7346] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:39:23 2022] GET /compute/v2.1/servers/4fd0aa73-4b6c-45fb-b5c8-6ce4df365c11 => generated 1217 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:39:24.191829 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-82699e91-a469-42cd-8493-e6045e806115 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:39:24.192454 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-82699e91-a469-42cd-8493-e6045e806115 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] [instance: 4fd0aa73-4b6c-45fb-b5c8-6ce4df365c11] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:39:24.200970 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-82699e91-a469-42cd-8493-e6045e806115 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:24.201516 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-82699e91-a469-42cd-8493-e6045e806115 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:24.201983 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-82699e91-a469-42cd-8493-e6045e806115 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:24.202714 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-82699e91-a469-42cd-8493-e6045e806115 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:24.203188 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-82699e91-a469-42cd-8493-e6045e806115 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:24.203640 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-82699e91-a469-42cd-8493-e6045e806115 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:24.264578 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-82699e91-a469-42cd-8493-e6045e806115 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c7a8ba3a634e8a8895fd82de1633ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29dc28086df142998e726efe7f5649fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:39:24.272259 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-82699e91-a469-42cd-8493-e6045e806115 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] 10.222.0.43 "GET /compute/v2.1/servers/4fd0aa73-4b6c-45fb-b5c8-6ce4df365c11" status: 200 len: 1221 microversion: 2.1 time: 0.084338 Oct 04 19:39:24.272828 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3859/7347] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:39:24 2022] GET /compute/v2.1/servers/4fd0aa73-4b6c-45fb-b5c8-6ce4df365c11 => generated 1221 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:39:25.295225 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-add6098a-fb8f-4550-86dd-da52d711c862 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:39:25.295681 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-add6098a-fb8f-4550-86dd-da52d711c862 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] [instance: 4fd0aa73-4b6c-45fb-b5c8-6ce4df365c11] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:39:25.303428 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-add6098a-fb8f-4550-86dd-da52d711c862 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:25.303927 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-add6098a-fb8f-4550-86dd-da52d711c862 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:25.304378 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-add6098a-fb8f-4550-86dd-da52d711c862 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:25.305088 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-add6098a-fb8f-4550-86dd-da52d711c862 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:25.305670 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-add6098a-fb8f-4550-86dd-da52d711c862 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:25.306113 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-add6098a-fb8f-4550-86dd-da52d711c862 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:25.378012 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-add6098a-fb8f-4550-86dd-da52d711c862 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c7a8ba3a634e8a8895fd82de1633ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29dc28086df142998e726efe7f5649fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:39:25.386490 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-add6098a-fb8f-4550-86dd-da52d711c862 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] 10.222.0.43 "GET /compute/v2.1/servers/4fd0aa73-4b6c-45fb-b5c8-6ce4df365c11" status: 200 len: 1275 microversion: 2.1 time: 0.095415 Oct 04 19:39:25.387985 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3489/7348] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:39:25 2022] GET /compute/v2.1/servers/4fd0aa73-4b6c-45fb-b5c8-6ce4df365c11 => generated 1275 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:39:26.300666 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-3ffd21dd-e692-437c-8f74-23dada422ed0 req-c9d66b79-1224-4648-b549-55591ce11b0e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4fd0aa73-4b6c-45fb-b5c8-6ce4df365c11", "tag": "e4d7dda0-eaf8-4f32-8cb1-95c5bf55e734"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:39:26.311687 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-3ffd21dd-e692-437c-8f74-23dada422ed0 req-c9d66b79-1224-4648-b549-55591ce11b0e service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:26.312280 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-3ffd21dd-e692-437c-8f74-23dada422ed0 req-c9d66b79-1224-4648-b549-55591ce11b0e service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:26.312803 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-3ffd21dd-e692-437c-8f74-23dada422ed0 req-c9d66b79-1224-4648-b549-55591ce11b0e service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:26.324387 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-3ffd21dd-e692-437c-8f74-23dada422ed0 req-c9d66b79-1224-4648-b549-55591ce11b0e service nova] Creating event network-changed:e4d7dda0-eaf8-4f32-8cb1-95c5bf55e734 for instance 4fd0aa73-4b6c-45fb-b5c8-6ce4df365c11 on n-h1-851028-13 Oct 04 19:39:26.330146 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-3ffd21dd-e692-437c-8f74-23dada422ed0 req-c9d66b79-1224-4648-b549-55591ce11b0e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033330 Oct 04 19:39:26.330760 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3860/7349] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:39:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:39:26.411304 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-a048e80e-cb54-40ed-a67b-b121e754ffe8 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:39:26.411945 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-a048e80e-cb54-40ed-a67b-b121e754ffe8 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] [instance: 4fd0aa73-4b6c-45fb-b5c8-6ce4df365c11] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:39:26.419111 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a048e80e-cb54-40ed-a67b-b121e754ffe8 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:26.419590 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a048e80e-cb54-40ed-a67b-b121e754ffe8 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:26.420030 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a048e80e-cb54-40ed-a67b-b121e754ffe8 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:26.420719 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a048e80e-cb54-40ed-a67b-b121e754ffe8 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:26.421196 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a048e80e-cb54-40ed-a67b-b121e754ffe8 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:26.421622 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a048e80e-cb54-40ed-a67b-b121e754ffe8 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:26.619963 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-a048e80e-cb54-40ed-a67b-b121e754ffe8 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c7a8ba3a634e8a8895fd82de1633ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29dc28086df142998e726efe7f5649fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:39:26.628797 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-a048e80e-cb54-40ed-a67b-b121e754ffe8 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] 10.222.0.43 "GET /compute/v2.1/servers/4fd0aa73-4b6c-45fb-b5c8-6ce4df365c11" status: 200 len: 1317 microversion: 2.1 time: 0.221344 Oct 04 19:39:26.629336 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3490/7350] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:39:26 2022] GET /compute/v2.1/servers/4fd0aa73-4b6c-45fb-b5c8-6ce4df365c11 => generated 1317 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:39:27.656091 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-905df3fe-7010-4567-8fbe-7a53ff988eff tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:39:27.656824 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-905df3fe-7010-4567-8fbe-7a53ff988eff tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] [instance: 4fd0aa73-4b6c-45fb-b5c8-6ce4df365c11] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:39:27.663417 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-905df3fe-7010-4567-8fbe-7a53ff988eff tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:27.663918 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-905df3fe-7010-4567-8fbe-7a53ff988eff tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:27.664368 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-905df3fe-7010-4567-8fbe-7a53ff988eff tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:27.665079 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-905df3fe-7010-4567-8fbe-7a53ff988eff tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:27.665573 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-905df3fe-7010-4567-8fbe-7a53ff988eff tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:27.666009 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-905df3fe-7010-4567-8fbe-7a53ff988eff tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:27.800511 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-905df3fe-7010-4567-8fbe-7a53ff988eff tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c7a8ba3a634e8a8895fd82de1633ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29dc28086df142998e726efe7f5649fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:39:27.808487 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-905df3fe-7010-4567-8fbe-7a53ff988eff tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] 10.222.0.43 "GET /compute/v2.1/servers/4fd0aa73-4b6c-45fb-b5c8-6ce4df365c11" status: 200 len: 1317 microversion: 2.1 time: 0.158194 Oct 04 19:39:27.809257 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3861/7351] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:39:27 2022] GET /compute/v2.1/servers/4fd0aa73-4b6c-45fb-b5c8-6ce4df365c11 => generated 1317 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:39:28.832119 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-51c95e96-97d9-40b6-b1aa-86671f601214 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:39:28.832748 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-51c95e96-97d9-40b6-b1aa-86671f601214 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] [instance: 4fd0aa73-4b6c-45fb-b5c8-6ce4df365c11] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:39:28.839203 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-51c95e96-97d9-40b6-b1aa-86671f601214 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:28.839694 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-51c95e96-97d9-40b6-b1aa-86671f601214 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:28.840138 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-51c95e96-97d9-40b6-b1aa-86671f601214 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:28.840839 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-51c95e96-97d9-40b6-b1aa-86671f601214 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:28.841337 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-51c95e96-97d9-40b6-b1aa-86671f601214 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:28.841774 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-51c95e96-97d9-40b6-b1aa-86671f601214 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:28.974921 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-51c95e96-97d9-40b6-b1aa-86671f601214 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c7a8ba3a634e8a8895fd82de1633ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29dc28086df142998e726efe7f5649fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:39:28.983070 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-51c95e96-97d9-40b6-b1aa-86671f601214 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] 10.222.0.43 "GET /compute/v2.1/servers/4fd0aa73-4b6c-45fb-b5c8-6ce4df365c11" status: 200 len: 1317 microversion: 2.1 time: 0.155302 Oct 04 19:39:28.983656 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3491/7352] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:39:28 2022] GET /compute/v2.1/servers/4fd0aa73-4b6c-45fb-b5c8-6ce4df365c11 => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:39:30.006546 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-fc7f6951-307c-4cf4-98dc-a5fd8d44a4dc tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:39:30.007205 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-fc7f6951-307c-4cf4-98dc-a5fd8d44a4dc tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] [instance: 4fd0aa73-4b6c-45fb-b5c8-6ce4df365c11] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:39:30.014192 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fc7f6951-307c-4cf4-98dc-a5fd8d44a4dc tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:30.014694 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fc7f6951-307c-4cf4-98dc-a5fd8d44a4dc tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:30.015152 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fc7f6951-307c-4cf4-98dc-a5fd8d44a4dc tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:30.015863 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fc7f6951-307c-4cf4-98dc-a5fd8d44a4dc tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:30.016337 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fc7f6951-307c-4cf4-98dc-a5fd8d44a4dc tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:30.016805 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fc7f6951-307c-4cf4-98dc-a5fd8d44a4dc tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:30.144157 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-fc7f6951-307c-4cf4-98dc-a5fd8d44a4dc tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c7a8ba3a634e8a8895fd82de1633ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29dc28086df142998e726efe7f5649fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:39:30.152054 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-fc7f6951-307c-4cf4-98dc-a5fd8d44a4dc tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] 10.222.0.43 "GET /compute/v2.1/servers/4fd0aa73-4b6c-45fb-b5c8-6ce4df365c11" status: 200 len: 1317 microversion: 2.1 time: 0.149586 Oct 04 19:39:30.153173 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3862/7353] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:39:30 2022] GET /compute/v2.1/servers/4fd0aa73-4b6c-45fb-b5c8-6ce4df365c11 => generated 1317 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:39:31.174872 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-93400412-9e36-481e-8fd5-1858e2954dc3 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:39:31.175506 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-93400412-9e36-481e-8fd5-1858e2954dc3 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] [instance: 4fd0aa73-4b6c-45fb-b5c8-6ce4df365c11] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:39:31.177482 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=2 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:39:31.184432 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-93400412-9e36-481e-8fd5-1858e2954dc3 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:31.184934 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-93400412-9e36-481e-8fd5-1858e2954dc3 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:31.185405 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-93400412-9e36-481e-8fd5-1858e2954dc3 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:31.186120 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-93400412-9e36-481e-8fd5-1858e2954dc3 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:31.186582 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-93400412-9e36-481e-8fd5-1858e2954dc3 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:31.187018 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-93400412-9e36-481e-8fd5-1858e2954dc3 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:31.264528 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-11aa7d98-63c1-4556-90a5-865f55a0a68c req-5075b8f9-8bf7-4d9e-b9b6-65649e8870e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fd0aa73-4b6c-45fb-b5c8-6ce4df365c11", "name": "network-vif-plugged", "status": "completed", "tag": "e4d7dda0-eaf8-4f32-8cb1-95c5bf55e734"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:39:31.276632 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-11aa7d98-63c1-4556-90a5-865f55a0a68c req-5075b8f9-8bf7-4d9e-b9b6-65649e8870e5 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:31.277082 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-11aa7d98-63c1-4556-90a5-865f55a0a68c req-5075b8f9-8bf7-4d9e-b9b6-65649e8870e5 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:31.277788 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-11aa7d98-63c1-4556-90a5-865f55a0a68c req-5075b8f9-8bf7-4d9e-b9b6-65649e8870e5 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:31.289940 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-11aa7d98-63c1-4556-90a5-865f55a0a68c req-5075b8f9-8bf7-4d9e-b9b6-65649e8870e5 service nova] Creating event network-vif-plugged:e4d7dda0-eaf8-4f32-8cb1-95c5bf55e734 for instance 4fd0aa73-4b6c-45fb-b5c8-6ce4df365c11 on n-h1-851028-13 Oct 04 19:39:31.295541 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-11aa7d98-63c1-4556-90a5-865f55a0a68c req-5075b8f9-8bf7-4d9e-b9b6-65649e8870e5 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035676 Oct 04 19:39:31.296322 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3863/7354] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:39:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:39:31.329958 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-93400412-9e36-481e-8fd5-1858e2954dc3 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c7a8ba3a634e8a8895fd82de1633ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29dc28086df142998e726efe7f5649fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:39:31.338188 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-93400412-9e36-481e-8fd5-1858e2954dc3 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] 10.222.0.43 "GET /compute/v2.1/servers/4fd0aa73-4b6c-45fb-b5c8-6ce4df365c11" status: 200 len: 1317 microversion: 2.1 time: 0.167144 Oct 04 19:39:31.338628 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3492/7355] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:39:31 2022] GET /compute/v2.1/servers/4fd0aa73-4b6c-45fb-b5c8-6ce4df365c11 => generated 1317 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:39:32.360448 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-704865bc-7dad-492c-9861-45a9968a013c tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:39:32.361197 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-704865bc-7dad-492c-9861-45a9968a013c tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] [instance: 4fd0aa73-4b6c-45fb-b5c8-6ce4df365c11] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:39:32.363194 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=4 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:39:32.370095 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-704865bc-7dad-492c-9861-45a9968a013c tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:32.370594 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-704865bc-7dad-492c-9861-45a9968a013c tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:32.371548 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-704865bc-7dad-492c-9861-45a9968a013c tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:32.372257 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-704865bc-7dad-492c-9861-45a9968a013c tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:32.372727 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-704865bc-7dad-492c-9861-45a9968a013c tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:32.373201 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-704865bc-7dad-492c-9861-45a9968a013c tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:32.505488 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-704865bc-7dad-492c-9861-45a9968a013c tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c7a8ba3a634e8a8895fd82de1633ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29dc28086df142998e726efe7f5649fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:39:32.514274 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-704865bc-7dad-492c-9861-45a9968a013c tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] 10.222.0.43 "GET /compute/v2.1/servers/4fd0aa73-4b6c-45fb-b5c8-6ce4df365c11" status: 200 len: 1317 microversion: 2.1 time: 0.157689 Oct 04 19:39:32.514869 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3864/7356] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:39:32 2022] GET /compute/v2.1/servers/4fd0aa73-4b6c-45fb-b5c8-6ce4df365c11 => generated 1317 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:39:33.536086 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-be7153f8-eea8-4d26-ad65-f3ff1d62f9c9 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:39:33.536697 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-be7153f8-eea8-4d26-ad65-f3ff1d62f9c9 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] [instance: 4fd0aa73-4b6c-45fb-b5c8-6ce4df365c11] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:39:33.539379 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=10 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:39:33.545404 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-be7153f8-eea8-4d26-ad65-f3ff1d62f9c9 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:33.545884 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-be7153f8-eea8-4d26-ad65-f3ff1d62f9c9 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:33.546332 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-be7153f8-eea8-4d26-ad65-f3ff1d62f9c9 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:33.547040 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-be7153f8-eea8-4d26-ad65-f3ff1d62f9c9 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:33.547511 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-be7153f8-eea8-4d26-ad65-f3ff1d62f9c9 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:33.547952 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-be7153f8-eea8-4d26-ad65-f3ff1d62f9c9 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:33.924269 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-be7153f8-eea8-4d26-ad65-f3ff1d62f9c9 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c7a8ba3a634e8a8895fd82de1633ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29dc28086df142998e726efe7f5649fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:39:33.932046 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-be7153f8-eea8-4d26-ad65-f3ff1d62f9c9 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] 10.222.0.43 "GET /compute/v2.1/servers/4fd0aa73-4b6c-45fb-b5c8-6ce4df365c11" status: 200 len: 1505 microversion: 2.1 time: 0.399985 Oct 04 19:39:33.932626 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3493/7357] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:39:33 2022] GET /compute/v2.1/servers/4fd0aa73-4b6c-45fb-b5c8-6ce4df365c11 => generated 1505 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:39:33.992632 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-11426c04-d09c-4f0e-a289-cacf01b609bd tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1985322335", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452", "networks": [{"uuid": "599ac7bb-d70c-4c68-baf9-1bfe7e6c05bd"}]}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:39:34.045195 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.network.neutron [None req-11426c04-d09c-4f0e-a289-cacf01b609bd tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] validate_networks() for [('599ac7bb-d70c-4c68-baf9-1bfe7e6c05bd', None, None, None, None, None)] {{(pid=123596) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 19:39:34.420724 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-11426c04-d09c-4f0e-a289-cacf01b609bd tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Flavor limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:39:34.421210 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-11426c04-d09c-4f0e-a289-cacf01b609bd tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Image limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:39:34.421711 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-11426c04-d09c-4f0e-a289-cacf01b609bd tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Flavor pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:39:34.422145 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-11426c04-d09c-4f0e-a289-cacf01b609bd tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Image pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:39:34.422574 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-11426c04-d09c-4f0e-a289-cacf01b609bd tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:39:34.431508 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-11426c04-d09c-4f0e-a289-cacf01b609bd tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:34.432009 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-11426c04-d09c-4f0e-a289-cacf01b609bd tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:34.432463 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-11426c04-d09c-4f0e-a289-cacf01b609bd tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:34.433235 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-11426c04-d09c-4f0e-a289-cacf01b609bd tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:34.433709 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-11426c04-d09c-4f0e-a289-cacf01b609bd tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:34.434150 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-11426c04-d09c-4f0e-a289-cacf01b609bd tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:34.451175 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-11426c04-d09c-4f0e-a289-cacf01b609bd tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Getting quotas for project 29dc28086df142998e726efe7f5649fa. Resources: {'ram', 'cores', 'instances'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:39:34.456440 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-11426c04-d09c-4f0e-a289-cacf01b609bd tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Getting quotas for user 91c7a8ba3a634e8a8895fd82de1633ed and project 29dc28086df142998e726efe7f5649fa. Resources: {'ram', 'cores', 'instances'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:39:34.469547 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-11426c04-d09c-4f0e-a289-cacf01b609bd tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Going to run 1 instances... {{(pid=123596) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 19:39:34.471835 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-11426c04-d09c-4f0e-a289-cacf01b609bd tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] [instance: b6e57542-d286-4c87-8cd1-a86a31c08e1a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e8943ec5-4038-4d4b-b9b9-2415a79f5243',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123596) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 19:39:34.516244 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-11426c04-d09c-4f0e-a289-cacf01b609bd tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.527549 Oct 04 19:39:34.516933 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3865/7358] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 19:39:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 529 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 19:39:34.528500 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-42c21174-a96c-4475-8518-13a3b7430642 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:39:34.529125 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-42c21174-a96c-4475-8518-13a3b7430642 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] [instance: b6e57542-d286-4c87-8cd1-a86a31c08e1a] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:39:34.584868 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-42c21174-a96c-4475-8518-13a3b7430642 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c7a8ba3a634e8a8895fd82de1633ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29dc28086df142998e726efe7f5649fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:39:34.592757 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-42c21174-a96c-4475-8518-13a3b7430642 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] 10.222.0.43 "GET /compute/v2.1/servers/b6e57542-d286-4c87-8cd1-a86a31c08e1a" status: 200 len: 1217 microversion: 2.1 time: 0.068782 Oct 04 19:39:34.593373 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3494/7359] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:39:34 2022] GET /compute/v2.1/servers/b6e57542-d286-4c87-8cd1-a86a31c08e1a => generated 1217 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:39:35.621252 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-c2d56132-067a-400f-9352-dd830cae07dd tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:39:35.622387 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-c2d56132-067a-400f-9352-dd830cae07dd tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] [instance: b6e57542-d286-4c87-8cd1-a86a31c08e1a] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:39:35.628389 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c2d56132-067a-400f-9352-dd830cae07dd tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:35.628926 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c2d56132-067a-400f-9352-dd830cae07dd tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:35.629407 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c2d56132-067a-400f-9352-dd830cae07dd tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:35.630135 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c2d56132-067a-400f-9352-dd830cae07dd tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:35.630611 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c2d56132-067a-400f-9352-dd830cae07dd tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:35.631121 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c2d56132-067a-400f-9352-dd830cae07dd tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:35.698135 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-c2d56132-067a-400f-9352-dd830cae07dd tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c7a8ba3a634e8a8895fd82de1633ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29dc28086df142998e726efe7f5649fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:39:35.707916 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-c2d56132-067a-400f-9352-dd830cae07dd tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] 10.222.0.43 "GET /compute/v2.1/servers/b6e57542-d286-4c87-8cd1-a86a31c08e1a" status: 200 len: 1275 microversion: 2.1 time: 0.096127 Oct 04 19:39:35.721131 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3866/7360] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:39:35 2022] GET /compute/v2.1/servers/b6e57542-d286-4c87-8cd1-a86a31c08e1a => generated 1275 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:39:36.732967 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-8fcd95eb-db4a-499d-9573-d96ccdaa2a19 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:39:36.733615 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-8fcd95eb-db4a-499d-9573-d96ccdaa2a19 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] [instance: b6e57542-d286-4c87-8cd1-a86a31c08e1a] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:39:36.737125 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:39:36.743097 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8fcd95eb-db4a-499d-9573-d96ccdaa2a19 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:36.743664 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8fcd95eb-db4a-499d-9573-d96ccdaa2a19 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:36.744106 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8fcd95eb-db4a-499d-9573-d96ccdaa2a19 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:36.744809 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8fcd95eb-db4a-499d-9573-d96ccdaa2a19 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:36.745294 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8fcd95eb-db4a-499d-9573-d96ccdaa2a19 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:36.745727 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8fcd95eb-db4a-499d-9573-d96ccdaa2a19 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:36.855886 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-4d6c13cc-c22f-4ea8-acb2-c3cc185dc647 req-88a51d79-8375-48a7-8f50-6609a73c4a3b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6e57542-d286-4c87-8cd1-a86a31c08e1a", "tag": "9e80e32d-4937-4b2b-9a5c-533594b20a9a"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:39:36.869298 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-4d6c13cc-c22f-4ea8-acb2-c3cc185dc647 req-88a51d79-8375-48a7-8f50-6609a73c4a3b service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:36.869955 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-4d6c13cc-c22f-4ea8-acb2-c3cc185dc647 req-88a51d79-8375-48a7-8f50-6609a73c4a3b service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:36.870524 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-4d6c13cc-c22f-4ea8-acb2-c3cc185dc647 req-88a51d79-8375-48a7-8f50-6609a73c4a3b service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:36.883538 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-8fcd95eb-db4a-499d-9573-d96ccdaa2a19 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c7a8ba3a634e8a8895fd82de1633ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29dc28086df142998e726efe7f5649fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:39:36.884879 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-4d6c13cc-c22f-4ea8-acb2-c3cc185dc647 req-88a51d79-8375-48a7-8f50-6609a73c4a3b service nova] Creating event network-changed:9e80e32d-4937-4b2b-9a5c-533594b20a9a for instance b6e57542-d286-4c87-8cd1-a86a31c08e1a on n-h2-851028-13 Oct 04 19:39:36.893405 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-4d6c13cc-c22f-4ea8-acb2-c3cc185dc647 req-88a51d79-8375-48a7-8f50-6609a73c4a3b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042444 Oct 04 19:39:36.893597 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-8fcd95eb-db4a-499d-9573-d96ccdaa2a19 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] 10.222.0.43 "GET /compute/v2.1/servers/b6e57542-d286-4c87-8cd1-a86a31c08e1a" status: 200 len: 1317 microversion: 2.1 time: 0.164360 Oct 04 19:39:36.894819 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3867/7361] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:39:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:39:36.895622 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3495/7362] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:39:36 2022] GET /compute/v2.1/servers/b6e57542-d286-4c87-8cd1-a86a31c08e1a => generated 1317 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:39:37.919480 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-cf079738-97e0-41c7-808a-803847765002 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:39:37.920240 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-cf079738-97e0-41c7-808a-803847765002 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] [instance: b6e57542-d286-4c87-8cd1-a86a31c08e1a] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:39:37.926467 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cf079738-97e0-41c7-808a-803847765002 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:37.926971 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cf079738-97e0-41c7-808a-803847765002 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:37.927437 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cf079738-97e0-41c7-808a-803847765002 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:37.928148 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cf079738-97e0-41c7-808a-803847765002 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:37.928624 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cf079738-97e0-41c7-808a-803847765002 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:37.929069 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cf079738-97e0-41c7-808a-803847765002 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:38.056793 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-cf079738-97e0-41c7-808a-803847765002 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c7a8ba3a634e8a8895fd82de1633ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29dc28086df142998e726efe7f5649fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:39:38.065555 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-cf079738-97e0-41c7-808a-803847765002 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] 10.222.0.43 "GET /compute/v2.1/servers/b6e57542-d286-4c87-8cd1-a86a31c08e1a" status: 200 len: 1317 microversion: 2.1 time: 0.151706 Oct 04 19:39:38.066202 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3868/7363] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:39:37 2022] GET /compute/v2.1/servers/b6e57542-d286-4c87-8cd1-a86a31c08e1a => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:39:39.091259 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-2425fca6-d7c9-47f0-9999-ffb6141127f7 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:39:39.091911 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-2425fca6-d7c9-47f0-9999-ffb6141127f7 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] [instance: b6e57542-d286-4c87-8cd1-a86a31c08e1a] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:39:39.098776 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2425fca6-d7c9-47f0-9999-ffb6141127f7 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:39.099295 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2425fca6-d7c9-47f0-9999-ffb6141127f7 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:39.099737 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2425fca6-d7c9-47f0-9999-ffb6141127f7 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:39.100432 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2425fca6-d7c9-47f0-9999-ffb6141127f7 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:39.100890 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2425fca6-d7c9-47f0-9999-ffb6141127f7 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:39.101359 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2425fca6-d7c9-47f0-9999-ffb6141127f7 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:39.229392 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-2425fca6-d7c9-47f0-9999-ffb6141127f7 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c7a8ba3a634e8a8895fd82de1633ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29dc28086df142998e726efe7f5649fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:39:39.237896 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-2425fca6-d7c9-47f0-9999-ffb6141127f7 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] 10.222.0.43 "GET /compute/v2.1/servers/b6e57542-d286-4c87-8cd1-a86a31c08e1a" status: 200 len: 1317 microversion: 2.1 time: 0.151331 Oct 04 19:39:39.238482 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3496/7364] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:39:39 2022] GET /compute/v2.1/servers/b6e57542-d286-4c87-8cd1-a86a31c08e1a => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:39:40.259862 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f1635c3a-4375-4628-9a93-7ee2a47e1510 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:39:40.260497 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-f1635c3a-4375-4628-9a93-7ee2a47e1510 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] [instance: b6e57542-d286-4c87-8cd1-a86a31c08e1a] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:39:40.267546 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f1635c3a-4375-4628-9a93-7ee2a47e1510 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:40.268056 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f1635c3a-4375-4628-9a93-7ee2a47e1510 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:40.268516 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f1635c3a-4375-4628-9a93-7ee2a47e1510 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:40.269256 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f1635c3a-4375-4628-9a93-7ee2a47e1510 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:40.269735 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f1635c3a-4375-4628-9a93-7ee2a47e1510 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:40.270183 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f1635c3a-4375-4628-9a93-7ee2a47e1510 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:40.396892 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-f1635c3a-4375-4628-9a93-7ee2a47e1510 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c7a8ba3a634e8a8895fd82de1633ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29dc28086df142998e726efe7f5649fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:39:40.405640 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-f1635c3a-4375-4628-9a93-7ee2a47e1510 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] 10.222.0.43 "GET /compute/v2.1/servers/b6e57542-d286-4c87-8cd1-a86a31c08e1a" status: 200 len: 1317 microversion: 2.1 time: 0.149632 Oct 04 19:39:40.406257 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3869/7365] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:39:40 2022] GET /compute/v2.1/servers/b6e57542-d286-4c87-8cd1-a86a31c08e1a => generated 1317 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:39:41.429396 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-dfe3a0cc-f6cb-4deb-aa21-b95e59c91ffe tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:39:41.431653 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-dfe3a0cc-f6cb-4deb-aa21-b95e59c91ffe tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] [instance: b6e57542-d286-4c87-8cd1-a86a31c08e1a] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:39:41.440194 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dfe3a0cc-f6cb-4deb-aa21-b95e59c91ffe tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:41.440961 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dfe3a0cc-f6cb-4deb-aa21-b95e59c91ffe tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:41.441590 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dfe3a0cc-f6cb-4deb-aa21-b95e59c91ffe tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:41.442393 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dfe3a0cc-f6cb-4deb-aa21-b95e59c91ffe tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:41.443065 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dfe3a0cc-f6cb-4deb-aa21-b95e59c91ffe tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:41.443614 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dfe3a0cc-f6cb-4deb-aa21-b95e59c91ffe tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:41.583290 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-dfe3a0cc-f6cb-4deb-aa21-b95e59c91ffe tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c7a8ba3a634e8a8895fd82de1633ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29dc28086df142998e726efe7f5649fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:39:41.591540 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-dfe3a0cc-f6cb-4deb-aa21-b95e59c91ffe tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] 10.222.0.43 "GET /compute/v2.1/servers/b6e57542-d286-4c87-8cd1-a86a31c08e1a" status: 200 len: 1317 microversion: 2.1 time: 0.166126 Oct 04 19:39:41.592503 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3497/7366] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:39:41 2022] GET /compute/v2.1/servers/b6e57542-d286-4c87-8cd1-a86a31c08e1a => generated 1317 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:39:41.598444 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-ccdb6145-3705-48e5-aa31-d9e54f4c2e91 req-9c904467-2b53-4fd9-a2f7-61a95713472a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6e57542-d286-4c87-8cd1-a86a31c08e1a", "name": "network-vif-plugged", "status": "completed", "tag": "9e80e32d-4937-4b2b-9a5c-533594b20a9a"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:39:41.609385 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-ccdb6145-3705-48e5-aa31-d9e54f4c2e91 req-9c904467-2b53-4fd9-a2f7-61a95713472a service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:41.610013 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-ccdb6145-3705-48e5-aa31-d9e54f4c2e91 req-9c904467-2b53-4fd9-a2f7-61a95713472a service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:41.610544 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-ccdb6145-3705-48e5-aa31-d9e54f4c2e91 req-9c904467-2b53-4fd9-a2f7-61a95713472a service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:41.622627 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-ccdb6145-3705-48e5-aa31-d9e54f4c2e91 req-9c904467-2b53-4fd9-a2f7-61a95713472a service nova] Creating event network-vif-plugged:9e80e32d-4937-4b2b-9a5c-533594b20a9a for instance b6e57542-d286-4c87-8cd1-a86a31c08e1a on n-h2-851028-13 Oct 04 19:39:41.627413 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-ccdb6145-3705-48e5-aa31-d9e54f4c2e91 req-9c904467-2b53-4fd9-a2f7-61a95713472a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033451 Oct 04 19:39:41.627999 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3870/7367] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:39:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:39:42.613847 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-4054ae90-2918-4e89-8bc0-d1227ac51a78 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:39:42.614468 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-4054ae90-2918-4e89-8bc0-d1227ac51a78 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] [instance: b6e57542-d286-4c87-8cd1-a86a31c08e1a] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:39:42.621388 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4054ae90-2918-4e89-8bc0-d1227ac51a78 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:42.622476 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4054ae90-2918-4e89-8bc0-d1227ac51a78 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:42.622916 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4054ae90-2918-4e89-8bc0-d1227ac51a78 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:42.623606 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4054ae90-2918-4e89-8bc0-d1227ac51a78 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:42.624067 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4054ae90-2918-4e89-8bc0-d1227ac51a78 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:42.624497 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4054ae90-2918-4e89-8bc0-d1227ac51a78 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:42.762273 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-4054ae90-2918-4e89-8bc0-d1227ac51a78 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c7a8ba3a634e8a8895fd82de1633ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29dc28086df142998e726efe7f5649fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:39:42.770344 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-4054ae90-2918-4e89-8bc0-d1227ac51a78 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] 10.222.0.43 "GET /compute/v2.1/servers/b6e57542-d286-4c87-8cd1-a86a31c08e1a" status: 200 len: 1317 microversion: 2.1 time: 0.160462 Oct 04 19:39:42.770946 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3498/7368] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:39:42 2022] GET /compute/v2.1/servers/b6e57542-d286-4c87-8cd1-a86a31c08e1a => generated 1317 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:39:43.794646 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-52dbd589-85ef-4b8a-bf80-c9c7ef05341b tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:39:43.795294 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-52dbd589-85ef-4b8a-bf80-c9c7ef05341b tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] [instance: b6e57542-d286-4c87-8cd1-a86a31c08e1a] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:39:43.801524 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-52dbd589-85ef-4b8a-bf80-c9c7ef05341b tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:43.802016 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-52dbd589-85ef-4b8a-bf80-c9c7ef05341b tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:43.802466 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-52dbd589-85ef-4b8a-bf80-c9c7ef05341b tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:43.803162 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-52dbd589-85ef-4b8a-bf80-c9c7ef05341b tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:43.803641 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-52dbd589-85ef-4b8a-bf80-c9c7ef05341b tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:43.804068 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-52dbd589-85ef-4b8a-bf80-c9c7ef05341b tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:43.939270 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-52dbd589-85ef-4b8a-bf80-c9c7ef05341b tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c7a8ba3a634e8a8895fd82de1633ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29dc28086df142998e726efe7f5649fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:39:43.947445 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-52dbd589-85ef-4b8a-bf80-c9c7ef05341b tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] 10.222.0.43 "GET /compute/v2.1/servers/b6e57542-d286-4c87-8cd1-a86a31c08e1a" status: 200 len: 1505 microversion: 2.1 time: 0.158143 Oct 04 19:39:43.948106 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3871/7369] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:39:43 2022] GET /compute/v2.1/servers/b6e57542-d286-4c87-8cd1-a86a31c08e1a => generated 1505 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:39:43.971617 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-1ccf40be-c9f0-47cb-8db8-a44124ab8727 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:39:43.972482 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-1ccf40be-c9f0-47cb-8db8-a44124ab8727 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] [instance: b6e57542-d286-4c87-8cd1-a86a31c08e1a] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:39:43.979514 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1ccf40be-c9f0-47cb-8db8-a44124ab8727 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:43.980006 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1ccf40be-c9f0-47cb-8db8-a44124ab8727 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:43.980456 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1ccf40be-c9f0-47cb-8db8-a44124ab8727 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:43.981733 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1ccf40be-c9f0-47cb-8db8-a44124ab8727 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:43.982193 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1ccf40be-c9f0-47cb-8db8-a44124ab8727 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:43.982629 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1ccf40be-c9f0-47cb-8db8-a44124ab8727 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:44.008913 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-1ccf40be-c9f0-47cb-8db8-a44124ab8727 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] [instance: b6e57542-d286-4c87-8cd1-a86a31c08e1a] Going to try to terminate instance {{(pid=123595) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 19:39:44.089483 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-1ccf40be-c9f0-47cb-8db8-a44124ab8727 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] 10.222.0.43 "DELETE /compute/v2.1/servers/b6e57542-d286-4c87-8cd1-a86a31c08e1a" status: 204 len: 0 microversion: 2.1 time: 0.122274 Oct 04 19:39:44.090388 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3499/7370] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 19:39:43 2022] DELETE /compute/v2.1/servers/b6e57542-d286-4c87-8cd1-a86a31c08e1a => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:39:44.098770 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-7ecd6a4a-3095-4983-97c6-644d08291a63 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:39:44.099637 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-7ecd6a4a-3095-4983-97c6-644d08291a63 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] [instance: b6e57542-d286-4c87-8cd1-a86a31c08e1a] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:39:44.106411 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7ecd6a4a-3095-4983-97c6-644d08291a63 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:44.106947 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7ecd6a4a-3095-4983-97c6-644d08291a63 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:44.107406 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7ecd6a4a-3095-4983-97c6-644d08291a63 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:44.108108 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7ecd6a4a-3095-4983-97c6-644d08291a63 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:44.108578 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7ecd6a4a-3095-4983-97c6-644d08291a63 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:44.109019 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7ecd6a4a-3095-4983-97c6-644d08291a63 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:44.239164 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-7ecd6a4a-3095-4983-97c6-644d08291a63 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c7a8ba3a634e8a8895fd82de1633ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29dc28086df142998e726efe7f5649fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:39:44.247112 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-7ecd6a4a-3095-4983-97c6-644d08291a63 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] 10.222.0.43 "GET /compute/v2.1/servers/b6e57542-d286-4c87-8cd1-a86a31c08e1a" status: 200 len: 1511 microversion: 2.1 time: 0.152250 Oct 04 19:39:44.248034 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3872/7371] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:39:44 2022] GET /compute/v2.1/servers/b6e57542-d286-4c87-8cd1-a86a31c08e1a => generated 1511 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:39:45.271562 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-d3e4da3f-be1b-4e25-8781-6938c8819f5b tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:39:45.272273 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-d3e4da3f-be1b-4e25-8781-6938c8819f5b tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] [instance: b6e57542-d286-4c87-8cd1-a86a31c08e1a] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:39:45.274265 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=2 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:39:45.281206 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d3e4da3f-be1b-4e25-8781-6938c8819f5b tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:45.281700 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d3e4da3f-be1b-4e25-8781-6938c8819f5b tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:45.282148 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d3e4da3f-be1b-4e25-8781-6938c8819f5b tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:45.282852 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d3e4da3f-be1b-4e25-8781-6938c8819f5b tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:45.283311 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d3e4da3f-be1b-4e25-8781-6938c8819f5b tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:45.283753 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d3e4da3f-be1b-4e25-8781-6938c8819f5b tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:45.556893 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-d3e4da3f-be1b-4e25-8781-6938c8819f5b tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c7a8ba3a634e8a8895fd82de1633ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29dc28086df142998e726efe7f5649fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:39:45.564906 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-d3e4da3f-be1b-4e25-8781-6938c8819f5b tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] 10.222.0.43 "GET /compute/v2.1/servers/b6e57542-d286-4c87-8cd1-a86a31c08e1a" status: 200 len: 1511 microversion: 2.1 time: 0.297603 Oct 04 19:39:45.565620 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3500/7372] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:39:45 2022] GET /compute/v2.1/servers/b6e57542-d286-4c87-8cd1-a86a31c08e1a => generated 1511 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:39:45.901859 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-f3a04d16-a96b-46ff-8fc6-afa6a25bce63 req-7b243264-c911-4cc8-953b-8bd16bdfea7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6e57542-d286-4c87-8cd1-a86a31c08e1a", "name": "network-vif-deleted", "tag": "9e80e32d-4937-4b2b-9a5c-533594b20a9a"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:39:45.907786 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=2 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:39:45.908996 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=6 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:39:45.917334 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-f3a04d16-a96b-46ff-8fc6-afa6a25bce63 req-7b243264-c911-4cc8-953b-8bd16bdfea7d service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:45.918140 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-f3a04d16-a96b-46ff-8fc6-afa6a25bce63 req-7b243264-c911-4cc8-953b-8bd16bdfea7d service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:45.918594 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-f3a04d16-a96b-46ff-8fc6-afa6a25bce63 req-7b243264-c911-4cc8-953b-8bd16bdfea7d service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:45.930605 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-f3a04d16-a96b-46ff-8fc6-afa6a25bce63 req-7b243264-c911-4cc8-953b-8bd16bdfea7d service nova] Creating event network-vif-deleted:9e80e32d-4937-4b2b-9a5c-533594b20a9a for instance b6e57542-d286-4c87-8cd1-a86a31c08e1a on n-h2-851028-13 Oct 04 19:39:45.938780 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-f3a04d16-a96b-46ff-8fc6-afa6a25bce63 req-7b243264-c911-4cc8-953b-8bd16bdfea7d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040763 Oct 04 19:39:45.939730 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3873/7373] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:39:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:39:46.588747 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-05109d3f-3a0c-44f9-9687-29a50aed63a6 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:39:46.589414 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-05109d3f-3a0c-44f9-9687-29a50aed63a6 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] [instance: b6e57542-d286-4c87-8cd1-a86a31c08e1a] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:39:46.596646 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-05109d3f-3a0c-44f9-9687-29a50aed63a6 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:46.597149 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-05109d3f-3a0c-44f9-9687-29a50aed63a6 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:46.597595 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-05109d3f-3a0c-44f9-9687-29a50aed63a6 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:46.598283 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-05109d3f-3a0c-44f9-9687-29a50aed63a6 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:46.598735 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-05109d3f-3a0c-44f9-9687-29a50aed63a6 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:46.599168 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-05109d3f-3a0c-44f9-9687-29a50aed63a6 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:46.613025 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-05109d3f-3a0c-44f9-9687-29a50aed63a6 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] HTTP exception thrown: Instance b6e57542-d286-4c87-8cd1-a86a31c08e1a could not be found. Oct 04 19:39:46.614689 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-05109d3f-3a0c-44f9-9687-29a50aed63a6 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Request method failure captured: Oct 04 19:39:46.614689 n-d-851028-13 devstack@n-api.service[123595]: request: GET /compute/v2.1/servers/b6e57542-d286-4c87-8cd1-a86a31c08e1a HTTP/1.1 Oct 04 19:39:46.614689 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 19:39:46.614689 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 19:39:46.614689 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 19:39:46.614689 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 0 Oct 04 19:39:46.614689 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 19:39:46.614689 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 19:39:46.614689 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 19:39:46.614689 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 19:39:46.614689 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPIvmvQSxyNOGrhwvt9RlI-_e7OA8aaNauJwsHUzIlDQqZlsbj7v0GUII20f6TeiewFJLMOUrlzZGnLFmSx422PmQpT4CMCc8FCmQTznW3a75vRCanes3Jn8MNL6qQWzKFXeA56hfFGkc5S7vRdTbmsjUv-j_qH4xaw71Ly7jDLMlpFw Oct 04 19:39:46.614689 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 19:39:46.614689 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 19:39:46.614689 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 19:39:46.614689 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 19:39:46.614689 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 19:39:46.614689 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 19:39:46.614689 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: 29dc28086df142998e726efe7f5649fa Oct 04 19:39:46.614689 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-ServersNegativeTestJSON-1092246068 Oct 04 19:39:46.614689 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 19:39:46.614689 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 19:39:46.614689 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/29dc28086df142998e726efe7f5649fa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_29dc28086df142998e726efe7f5649fa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/29dc28086df142998e726efe7f5649fa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/29dc28086df142998e726efe7f5649fa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 19:39:46.614689 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-ServersNegativeTestJSON-1092246068 Oct 04 19:39:46.614689 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: 29dc28086df142998e726efe7f5649fa Oct 04 19:39:46.614689 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1092246068 Oct 04 19:39:46.614689 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-ServersNegativeTestJSON-1092246068-project Oct 04 19:39:46.614689 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 19:39:46.614689 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 19:39:46.614689 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: 91c7a8ba3a634e8a8895fd82de1633ed Oct 04 19:39:46.614689 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-ServersNegativeTestJSON-1092246068-project Oct 04 19:39:46.614689 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 19:39:46.614689 n-d-851028-13 devstack@n-api.service[123595]: exception: Instance b6e57542-d286-4c87-8cd1-a86a31c08e1a could not be found. Oct 04 19:39:46.614689 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': 'b6e57542-d286-4c87-8cd1-a86a31c08e1a'} Oct 04 19:39:46.614689 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:39:46.614689 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:39:46.614689 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:39:46.614689 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:39:46.614689 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:39:46.614689 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:39:46.614689 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:39:46.614689 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:39:46.614689 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:39:46.614689 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:39:46.614689 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6e57542-d286-4c87-8cd1-a86a31c08e1a could not be found. Oct 04 19:39:46.614689 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:39:46.614689 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:39:46.614689 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:39:46.614689 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:39:46.614689 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:39:46.614689 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:39:46.614689 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:39:46.614689 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:39:46.614689 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:39:46.614689 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:39:46.614689 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:39:46.614689 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:39:46.614689 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:39:46.614689 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:39:46.614689 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:39:46.614689 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:39:46.614689 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6e57542-d286-4c87-8cd1-a86a31c08e1a could not be found. Oct 04 19:39:46.614689 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:39:46.614689 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:39:46.614689 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:39:46.620115 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:39:46.620115 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:39:46.620115 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:39:46.620115 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:39:46.620115 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:39:46.620115 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6e57542-d286-4c87-8cd1-a86a31c08e1a could not be found. Oct 04 19:39:46.620115 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:39:46.620115 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-05109d3f-3a0c-44f9-9687-29a50aed63a6 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Returning 404 to user: Instance b6e57542-d286-4c87-8cd1-a86a31c08e1a could not be found. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:39:46.620115 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-05109d3f-3a0c-44f9-9687-29a50aed63a6 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] 10.222.0.43 "GET /compute/v2.1/servers/b6e57542-d286-4c87-8cd1-a86a31c08e1a" status: 404 len: 111 microversion: 2.1 time: 0.031812 Oct 04 19:39:46.620115 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3501/7374] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:39:46 2022] GET /compute/v2.1/servers/b6e57542-d286-4c87-8cd1-a86a31c08e1a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:39:46.626362 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-4c07e288-17da-4a3c-b185-5daba560da76 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:39:46.627455 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-4c07e288-17da-4a3c-b185-5daba560da76 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] [instance: 4fd0aa73-4b6c-45fb-b5c8-6ce4df365c11] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:39:46.634012 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4c07e288-17da-4a3c-b185-5daba560da76 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:46.634545 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4c07e288-17da-4a3c-b185-5daba560da76 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:46.635009 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4c07e288-17da-4a3c-b185-5daba560da76 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:46.635757 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4c07e288-17da-4a3c-b185-5daba560da76 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:46.636236 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4c07e288-17da-4a3c-b185-5daba560da76 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:46.636681 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4c07e288-17da-4a3c-b185-5daba560da76 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:46.832113 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-4c07e288-17da-4a3c-b185-5daba560da76 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c7a8ba3a634e8a8895fd82de1633ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29dc28086df142998e726efe7f5649fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:39:46.840876 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-4c07e288-17da-4a3c-b185-5daba560da76 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] 10.222.0.43 "GET /compute/v2.1/servers/4fd0aa73-4b6c-45fb-b5c8-6ce4df365c11" status: 200 len: 1505 microversion: 2.1 time: 0.218835 Oct 04 19:39:46.841513 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3874/7375] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:39:46 2022] GET /compute/v2.1/servers/4fd0aa73-4b6c-45fb-b5c8-6ce4df365c11 => generated 1505 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:39:46.863505 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-1346877f-38ca-4f3c-a1cc-b1f2337f8923 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "452"}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:39:46.865965 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-1346877f-38ca-4f3c-a1cc-b1f2337f8923 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] [instance: 9964e6f0-3c58-45de-bed9-478fcc1fae77] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:39:46.871406 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-1346877f-38ca-4f3c-a1cc-b1f2337f8923 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] HTTP exception thrown: Instance 9964e6f0-3c58-45de-bed9-478fcc1fae77 could not be found. Oct 04 19:39:46.872953 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-1346877f-38ca-4f3c-a1cc-b1f2337f8923 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Request method failure captured: Oct 04 19:39:46.872953 n-d-851028-13 devstack@n-api.service[123595]: request: POST /compute/v2.1/servers/9964e6f0-3c58-45de-bed9-478fcc1fae77/action HTTP/1.1 Oct 04 19:39:46.872953 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 19:39:46.872953 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 19:39:46.872953 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 19:39:46.872953 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 32 Oct 04 19:39:46.872953 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 19:39:46.872953 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 19:39:46.872953 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 19:39:46.872953 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 19:39:46.872953 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPIvmvQSxyNOGrhwvt9RlI-_e7OA8aaNauJwsHUzIlDQqZlsbj7v0GUII20f6TeiewFJLMOUrlzZGnLFmSx422PmQpT4CMCc8FCmQTznW3a75vRCanes3Jn8MNL6qQWzKFXeA56hfFGkc5S7vRdTbmsjUv-j_qH4xaw71Ly7jDLMlpFw Oct 04 19:39:46.872953 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 19:39:46.872953 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 19:39:46.872953 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 19:39:46.872953 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 19:39:46.872953 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 19:39:46.872953 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 19:39:46.872953 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: 29dc28086df142998e726efe7f5649fa Oct 04 19:39:46.872953 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-ServersNegativeTestJSON-1092246068 Oct 04 19:39:46.872953 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 19:39:46.872953 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 19:39:46.872953 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/29dc28086df142998e726efe7f5649fa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_29dc28086df142998e726efe7f5649fa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/29dc28086df142998e726efe7f5649fa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/29dc28086df142998e726efe7f5649fa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 19:39:46.872953 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-ServersNegativeTestJSON-1092246068 Oct 04 19:39:46.872953 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: 29dc28086df142998e726efe7f5649fa Oct 04 19:39:46.872953 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1092246068 Oct 04 19:39:46.872953 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-ServersNegativeTestJSON-1092246068-project Oct 04 19:39:46.872953 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 19:39:46.872953 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 19:39:46.872953 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: 91c7a8ba3a634e8a8895fd82de1633ed Oct 04 19:39:46.872953 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-ServersNegativeTestJSON-1092246068-project Oct 04 19:39:46.872953 n-d-851028-13 devstack@n-api.service[123595]: Oct 04 19:39:46.872953 n-d-851028-13 devstack@n-api.service[123595]: {"resize": {"flavorRef": "452"}} Oct 04 19:39:46.872953 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 19:39:46.872953 n-d-851028-13 devstack@n-api.service[123595]: exception: Instance 9964e6f0-3c58-45de-bed9-478fcc1fae77 could not be found. Oct 04 19:39:46.872953 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': '9964e6f0-3c58-45de-bed9-478fcc1fae77', 'body': {'resize': {'flavorRef': '452'}}} Oct 04 19:39:46.872953 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:39:46.872953 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:39:46.872953 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:39:46.872953 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:39:46.872953 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:39:46.872953 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:39:46.872953 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 19:39:46.872953 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 19:39:46.872953 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9964e6f0-3c58-45de-bed9-478fcc1fae77 could not be found. Oct 04 19:39:46.872953 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:39:46.872953 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:39:46.872953 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:39:46.872953 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:39:46.872953 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:39:46.872953 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:39:46.872953 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:39:46.872953 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:39:46.872953 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:39:46.872953 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:39:46.872953 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 19:39:46.872953 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 19:39:46.872953 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 04 19:39:46.872953 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 04 19:39:46.872953 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1046, in _resize Oct 04 19:39:46.872953 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_id, Oct 04 19:39:46.872953 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:39:46.872953 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:39:46.872953 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:39:46.872953 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:39:46.877899 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9964e6f0-3c58-45de-bed9-478fcc1fae77 could not be found. Oct 04 19:39:46.877899 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:39:46.877899 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:39:46.877899 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:39:46.877899 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:39:46.877899 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:39:46.877899 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:39:46.877899 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:39:46.877899 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:39:46.877899 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9964e6f0-3c58-45de-bed9-478fcc1fae77 could not be found. Oct 04 19:39:46.877899 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:39:46.877899 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-1346877f-38ca-4f3c-a1cc-b1f2337f8923 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Returning 404 to user: Instance 9964e6f0-3c58-45de-bed9-478fcc1fae77 could not be found. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:39:46.877899 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-1346877f-38ca-4f3c-a1cc-b1f2337f8923 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] 10.222.0.43 "POST /compute/v2.1/servers/9964e6f0-3c58-45de-bed9-478fcc1fae77/action" status: 404 len: 111 microversion: 2.1 time: 0.014853 Oct 04 19:39:46.877899 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3502/7376] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 19:39:46 2022] POST /compute/v2.1/servers/9964e6f0-3c58-45de-bed9-478fcc1fae77/action => generated 111 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:39:46.882830 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-68ba32ce-286c-4f10-9d19-fec070718206 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:39:46.883501 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-68ba32ce-286c-4f10-9d19-fec070718206 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] [instance: 4fd0aa73-4b6c-45fb-b5c8-6ce4df365c11] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:39:46.889597 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-68ba32ce-286c-4f10-9d19-fec070718206 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:46.890136 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-68ba32ce-286c-4f10-9d19-fec070718206 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:46.890595 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-68ba32ce-286c-4f10-9d19-fec070718206 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:46.891313 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-68ba32ce-286c-4f10-9d19-fec070718206 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:46.891777 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-68ba32ce-286c-4f10-9d19-fec070718206 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:46.892221 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-68ba32ce-286c-4f10-9d19-fec070718206 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:47.023495 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-68ba32ce-286c-4f10-9d19-fec070718206 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c7a8ba3a634e8a8895fd82de1633ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29dc28086df142998e726efe7f5649fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:39:47.031870 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-68ba32ce-286c-4f10-9d19-fec070718206 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] 10.222.0.43 "GET /compute/v2.1/servers/4fd0aa73-4b6c-45fb-b5c8-6ce4df365c11" status: 200 len: 1505 microversion: 2.1 time: 0.152826 Oct 04 19:39:47.032434 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3875/7377] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:39:46 2022] GET /compute/v2.1/servers/4fd0aa73-4b6c-45fb-b5c8-6ce4df365c11 => generated 1505 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:39:47.054330 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-3cd48f76-085a-489c-a50b-f5bede700a6f tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:39:47.057539 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-3cd48f76-085a-489c-a50b-f5bede700a6f tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] [instance: 4fd0aa73-4b6c-45fb-b5c8-6ce4df365c11] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:39:47.064663 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3cd48f76-085a-489c-a50b-f5bede700a6f tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:47.065192 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3cd48f76-085a-489c-a50b-f5bede700a6f tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:47.065642 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3cd48f76-085a-489c-a50b-f5bede700a6f tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:47.066374 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3cd48f76-085a-489c-a50b-f5bede700a6f tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:47.066839 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3cd48f76-085a-489c-a50b-f5bede700a6f tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:47.067417 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3cd48f76-085a-489c-a50b-f5bede700a6f tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:47.198304 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-3cd48f76-085a-489c-a50b-f5bede700a6f tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c7a8ba3a634e8a8895fd82de1633ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29dc28086df142998e726efe7f5649fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:39:47.206171 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-3cd48f76-085a-489c-a50b-f5bede700a6f tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] 10.222.0.43 "GET /compute/v2.1/servers/4fd0aa73-4b6c-45fb-b5c8-6ce4df365c11" status: 200 len: 1505 microversion: 2.1 time: 0.155697 Oct 04 19:39:47.206751 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3503/7378] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:39:47 2022] GET /compute/v2.1/servers/4fd0aa73-4b6c-45fb-b5c8-6ce4df365c11 => generated 1505 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:39:47.228392 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-ef5ccf47-3aec-481f-8a2a-99b41e09f7f4 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "965918f3-dcfe-4a21-a258-b66b01fc0f34"}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:39:47.230706 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-ef5ccf47-3aec-481f-8a2a-99b41e09f7f4 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] [instance: 4fd0aa73-4b6c-45fb-b5c8-6ce4df365c11] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:39:47.237263 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ef5ccf47-3aec-481f-8a2a-99b41e09f7f4 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:47.237772 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ef5ccf47-3aec-481f-8a2a-99b41e09f7f4 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:47.238234 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ef5ccf47-3aec-481f-8a2a-99b41e09f7f4 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:47.238948 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ef5ccf47-3aec-481f-8a2a-99b41e09f7f4 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:47.239425 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ef5ccf47-3aec-481f-8a2a-99b41e09f7f4 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:47.239874 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ef5ccf47-3aec-481f-8a2a-99b41e09f7f4 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:47.267954 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-ef5ccf47-3aec-481f-8a2a-99b41e09f7f4 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '91c7a8ba3a634e8a8895fd82de1633ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29dc28086df142998e726efe7f5649fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:39:47.272711 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-ef5ccf47-3aec-481f-8a2a-99b41e09f7f4 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] HTTP exception thrown: Flavor 965918f3-dcfe-4a21-a258-b66b01fc0f34 could not be found. Oct 04 19:39:47.274631 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-ef5ccf47-3aec-481f-8a2a-99b41e09f7f4 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Request method failure captured: Oct 04 19:39:47.274631 n-d-851028-13 devstack@n-api.service[123596]: request: POST /compute/v2.1/servers/4fd0aa73-4b6c-45fb-b5c8-6ce4df365c11/action HTTP/1.1 Oct 04 19:39:47.274631 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 19:39:47.274631 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 19:39:47.274631 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 19:39:47.274631 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 65 Oct 04 19:39:47.274631 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 19:39:47.274631 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 19:39:47.274631 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 19:39:47.274631 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 19:39:47.274631 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPIvmvQSxyNOGrhwvt9RlI-_e7OA8aaNauJwsHUzIlDQqZlsbj7v0GUII20f6TeiewFJLMOUrlzZGnLFmSx422PmQpT4CMCc8FCmQTznW3a75vRCanes3Jn8MNL6qQWzKFXeA56hfFGkc5S7vRdTbmsjUv-j_qH4xaw71Ly7jDLMlpFw Oct 04 19:39:47.274631 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 19:39:47.274631 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 19:39:47.274631 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 19:39:47.274631 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 19:39:47.274631 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 19:39:47.274631 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 19:39:47.274631 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: 29dc28086df142998e726efe7f5649fa Oct 04 19:39:47.274631 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-ServersNegativeTestJSON-1092246068 Oct 04 19:39:47.274631 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 19:39:47.274631 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 19:39:47.274631 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/29dc28086df142998e726efe7f5649fa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_29dc28086df142998e726efe7f5649fa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/29dc28086df142998e726efe7f5649fa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/29dc28086df142998e726efe7f5649fa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 19:39:47.274631 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-ServersNegativeTestJSON-1092246068 Oct 04 19:39:47.274631 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: 29dc28086df142998e726efe7f5649fa Oct 04 19:39:47.274631 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1092246068 Oct 04 19:39:47.274631 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-ServersNegativeTestJSON-1092246068-project Oct 04 19:39:47.274631 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 19:39:47.274631 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 19:39:47.274631 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 91c7a8ba3a634e8a8895fd82de1633ed Oct 04 19:39:47.274631 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-ServersNegativeTestJSON-1092246068-project Oct 04 19:39:47.274631 n-d-851028-13 devstack@n-api.service[123596]: Oct 04 19:39:47.274631 n-d-851028-13 devstack@n-api.service[123596]: {"resize": {"flavorRef": "965918f3-dcfe-4a21-a258-b66b01fc0f34"}} Oct 04 19:39:47.274631 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 19:39:47.274631 n-d-851028-13 devstack@n-api.service[123596]: exception: Flavor 965918f3-dcfe-4a21-a258-b66b01fc0f34 could not be found. Oct 04 19:39:47.274631 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': '4fd0aa73-4b6c-45fb-b5c8-6ce4df365c11', 'body': {'resize': {'flavorRef': '965918f3-dcfe-4a21-a258-b66b01fc0f34'}}} Oct 04 19:39:47.274631 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:39:47.274631 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:39:47.274631 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 04 19:39:47.274631 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 04 19:39:47.274631 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 04 19:39:47.274631 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 19:39:47.274631 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 04 19:39:47.274631 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 04 19:39:47.274631 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 04 19:39:47.274631 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 04 19:39:47.274631 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 19:39:47.274631 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 19:39:47.274631 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 04 19:39:47.274631 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 19:39:47.274631 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 04 19:39:47.274631 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 19:39:47.274631 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4200, in resize Oct 04 19:39:47.274631 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi new_flavor = flavors.get_flavor_by_flavor_id( Oct 04 19:39:47.274631 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 04 19:39:47.274631 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 04 19:39:47.274631 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 19:39:47.274631 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 19:39:47.274631 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 04 19:39:47.274631 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 04 19:39:47.274631 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 04 19:39:47.274631 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:39:47.274631 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 04 19:39:47.278800 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 04 19:39:47.278800 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 965918f3-dcfe-4a21-a258-b66b01fc0f34 could not be found. Oct 04 19:39:47.278800 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:39:47.278800 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:39:47.278800 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:39:47.278800 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:39:47.278800 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:39:47.278800 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:39:47.278800 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:39:47.278800 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:39:47.278800 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:39:47.278800 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:39:47.278800 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 19:39:47.278800 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 19:39:47.278800 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 04 19:39:47.278800 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 04 19:39:47.278800 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1083, in _resize Oct 04 19:39:47.278800 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 04 19:39:47.278800 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 965918f3-dcfe-4a21-a258-b66b01fc0f34 could not be found. Oct 04 19:39:47.278800 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:39:47.278800 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:39:47.278800 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:39:47.278800 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:39:47.278800 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:39:47.278800 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:39:47.278800 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:39:47.278800 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:39:47.278800 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 965918f3-dcfe-4a21-a258-b66b01fc0f34 could not be found. Oct 04 19:39:47.278800 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:39:47.278800 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-ef5ccf47-3aec-481f-8a2a-99b41e09f7f4 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Returning 400 to user: Flavor 965918f3-dcfe-4a21-a258-b66b01fc0f34 could not be found. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:39:47.278800 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-ef5ccf47-3aec-481f-8a2a-99b41e09f7f4 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] 10.222.0.43 "POST /compute/v2.1/servers/4fd0aa73-4b6c-45fb-b5c8-6ce4df365c11/action" status: 400 len: 107 microversion: 2.1 time: 0.051643 Oct 04 19:39:47.278800 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3876/7379] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 19:39:47 2022] POST /compute/v2.1/servers/4fd0aa73-4b6c-45fb-b5c8-6ce4df365c11/action => generated 107 bytes in 53 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 19:39:47.284803 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-d0c3d536-3c16-489e-81a2-18845c9de4a8 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:39:47.285473 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-d0c3d536-3c16-489e-81a2-18845c9de4a8 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] [instance: 4fd0aa73-4b6c-45fb-b5c8-6ce4df365c11] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:39:47.291435 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d0c3d536-3c16-489e-81a2-18845c9de4a8 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:47.291915 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d0c3d536-3c16-489e-81a2-18845c9de4a8 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:47.292355 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d0c3d536-3c16-489e-81a2-18845c9de4a8 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:47.293045 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d0c3d536-3c16-489e-81a2-18845c9de4a8 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:47.293525 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d0c3d536-3c16-489e-81a2-18845c9de4a8 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:47.294436 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d0c3d536-3c16-489e-81a2-18845c9de4a8 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:47.420041 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-d0c3d536-3c16-489e-81a2-18845c9de4a8 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c7a8ba3a634e8a8895fd82de1633ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29dc28086df142998e726efe7f5649fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:39:47.427751 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-d0c3d536-3c16-489e-81a2-18845c9de4a8 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] 10.222.0.43 "GET /compute/v2.1/servers/4fd0aa73-4b6c-45fb-b5c8-6ce4df365c11" status: 200 len: 1505 microversion: 2.1 time: 0.146917 Oct 04 19:39:47.428323 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3504/7380] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:39:47 2022] GET /compute/v2.1/servers/4fd0aa73-4b6c-45fb-b5c8-6ce4df365c11 => generated 1505 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:39:47.450932 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-30786f74-c60a-4e78-9651-da36a5d2d7d4 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:39:47.451571 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-30786f74-c60a-4e78-9651-da36a5d2d7d4 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] [instance: 4fd0aa73-4b6c-45fb-b5c8-6ce4df365c11] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:39:47.457548 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-30786f74-c60a-4e78-9651-da36a5d2d7d4 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:47.458052 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-30786f74-c60a-4e78-9651-da36a5d2d7d4 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:47.458521 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-30786f74-c60a-4e78-9651-da36a5d2d7d4 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:47.459246 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-30786f74-c60a-4e78-9651-da36a5d2d7d4 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:47.459721 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-30786f74-c60a-4e78-9651-da36a5d2d7d4 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:47.460168 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-30786f74-c60a-4e78-9651-da36a5d2d7d4 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:47.592937 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-30786f74-c60a-4e78-9651-da36a5d2d7d4 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c7a8ba3a634e8a8895fd82de1633ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29dc28086df142998e726efe7f5649fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:39:47.600792 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-30786f74-c60a-4e78-9651-da36a5d2d7d4 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] 10.222.0.43 "GET /compute/v2.1/servers/4fd0aa73-4b6c-45fb-b5c8-6ce4df365c11" status: 200 len: 1505 microversion: 2.1 time: 0.153840 Oct 04 19:39:47.601402 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3877/7381] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:39:47 2022] GET /compute/v2.1/servers/4fd0aa73-4b6c-45fb-b5c8-6ce4df365c11 => generated 1505 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:39:47.623569 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-636f5898-d7ae-49ea-b7e3-cc0c9807ceff tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": ""}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:39:47.627148 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-636f5898-d7ae-49ea-b7e3-cc0c9807ceff tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Request method failure captured: Oct 04 19:39:47.627148 n-d-851028-13 devstack@n-api.service[123595]: request: POST /compute/v2.1/servers/4fd0aa73-4b6c-45fb-b5c8-6ce4df365c11/action HTTP/1.1 Oct 04 19:39:47.627148 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 19:39:47.627148 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 19:39:47.627148 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 19:39:47.627148 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 29 Oct 04 19:39:47.627148 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 19:39:47.627148 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 19:39:47.627148 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 19:39:47.627148 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 19:39:47.627148 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPIvmvQSxyNOGrhwvt9RlI-_e7OA8aaNauJwsHUzIlDQqZlsbj7v0GUII20f6TeiewFJLMOUrlzZGnLFmSx422PmQpT4CMCc8FCmQTznW3a75vRCanes3Jn8MNL6qQWzKFXeA56hfFGkc5S7vRdTbmsjUv-j_qH4xaw71Ly7jDLMlpFw Oct 04 19:39:47.627148 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 19:39:47.627148 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 19:39:47.627148 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 19:39:47.627148 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 19:39:47.627148 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 19:39:47.627148 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 19:39:47.627148 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: 29dc28086df142998e726efe7f5649fa Oct 04 19:39:47.627148 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-ServersNegativeTestJSON-1092246068 Oct 04 19:39:47.627148 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 19:39:47.627148 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 19:39:47.627148 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/29dc28086df142998e726efe7f5649fa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_29dc28086df142998e726efe7f5649fa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/29dc28086df142998e726efe7f5649fa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/29dc28086df142998e726efe7f5649fa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 19:39:47.627148 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-ServersNegativeTestJSON-1092246068 Oct 04 19:39:47.627148 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: 29dc28086df142998e726efe7f5649fa Oct 04 19:39:47.627148 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1092246068 Oct 04 19:39:47.627148 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-ServersNegativeTestJSON-1092246068-project Oct 04 19:39:47.627148 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 19:39:47.627148 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 19:39:47.627148 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: 91c7a8ba3a634e8a8895fd82de1633ed Oct 04 19:39:47.627148 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-ServersNegativeTestJSON-1092246068-project Oct 04 19:39:47.627148 n-d-851028-13 devstack@n-api.service[123595]: Oct 04 19:39:47.627148 n-d-851028-13 devstack@n-api.service[123595]: {"resize": {"flavorRef": ""}} Oct 04 19:39:47.627148 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 19:39:47.627148 n-d-851028-13 devstack@n-api.service[123595]: exception: Invalid input for field/attribute flavorRef. Value: . '' is too short Oct 04 19:39:47.627148 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': '4fd0aa73-4b6c-45fb-b5c8-6ce4df365c11', 'body': {'resize': {'flavorRef': ''}}} Oct 04 19:39:47.627148 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:39:47.627148 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:39:47.627148 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 19:39:47.627148 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 19:39:47.627148 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 19:39:47.627148 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise error Oct 04 19:39:47.627148 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 04 19:39:47.627148 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:39:47.627148 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['resize']['properties']['flavorRef']: Oct 04 19:39:47.627148 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi {'minLength': 1, 'type': ['string', 'integer']} Oct 04 19:39:47.627148 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:39:47.627148 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi On instance['resize']: Oct 04 19:39:47.627148 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi '' Oct 04 19:39:47.627148 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:39:47.627148 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:39:47.627148 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:39:47.627148 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:39:47.627148 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:39:47.627148 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:39:47.627148 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:39:47.627148 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:39:47.627148 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:39:47.627148 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:39:47.627148 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 19:39:47.627148 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 19:39:47.627148 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 19:39:47.627148 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 19:39:47.627148 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 19:39:47.627148 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 19:39:47.627148 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute flavorRef. Value: . '' is too short Oct 04 19:39:47.627148 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:39:47.627148 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:39:47.632474 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:39:47.632474 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:39:47.632474 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:39:47.632474 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:39:47.632474 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 19:39:47.632474 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 19:39:47.632474 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute flavorRef. Value: . '' is too short Oct 04 19:39:47.632474 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:39:47.632474 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-636f5898-d7ae-49ea-b7e3-cc0c9807ceff tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Returning 400 to user: Invalid input for field/attribute flavorRef. Value: . '' is too short {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:39:47.632474 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-636f5898-d7ae-49ea-b7e3-cc0c9807ceff tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] 10.222.0.43 "POST /compute/v2.1/servers/4fd0aa73-4b6c-45fb-b5c8-6ce4df365c11/action" status: 400 len: 113 microversion: 2.1 time: 0.008963 Oct 04 19:39:47.632474 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3505/7382] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 19:39:47 2022] POST /compute/v2.1/servers/4fd0aa73-4b6c-45fb-b5c8-6ce4df365c11/action => generated 113 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 19:39:47.636603 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-4635a7fb-560b-4f00-85d7-3a1644fc835a tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:39:47.637270 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-4635a7fb-560b-4f00-85d7-3a1644fc835a tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] [instance: 4fd0aa73-4b6c-45fb-b5c8-6ce4df365c11] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:39:47.643320 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4635a7fb-560b-4f00-85d7-3a1644fc835a tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:47.643829 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4635a7fb-560b-4f00-85d7-3a1644fc835a tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:47.644297 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4635a7fb-560b-4f00-85d7-3a1644fc835a tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:47.645011 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4635a7fb-560b-4f00-85d7-3a1644fc835a tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:47.645539 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4635a7fb-560b-4f00-85d7-3a1644fc835a tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:47.645991 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4635a7fb-560b-4f00-85d7-3a1644fc835a tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:47.777440 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-4635a7fb-560b-4f00-85d7-3a1644fc835a tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c7a8ba3a634e8a8895fd82de1633ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29dc28086df142998e726efe7f5649fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:39:47.785926 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-4635a7fb-560b-4f00-85d7-3a1644fc835a tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] 10.222.0.43 "GET /compute/v2.1/servers/4fd0aa73-4b6c-45fb-b5c8-6ce4df365c11" status: 200 len: 1505 microversion: 2.1 time: 0.153005 Oct 04 19:39:47.786511 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3878/7383] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:39:47 2022] GET /compute/v2.1/servers/4fd0aa73-4b6c-45fb-b5c8-6ce4df365c11 => generated 1505 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:39:47.812147 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-49070144-edc6-40aa-baaa-b7dd3aeb69a9 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:39:47.812778 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-49070144-edc6-40aa-baaa-b7dd3aeb69a9 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] [instance: b6e57542-d286-4c87-8cd1-a86a31c08e1a] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:39:47.820021 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-49070144-edc6-40aa-baaa-b7dd3aeb69a9 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:47.820515 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-49070144-edc6-40aa-baaa-b7dd3aeb69a9 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:47.820966 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-49070144-edc6-40aa-baaa-b7dd3aeb69a9 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:47.821700 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-49070144-edc6-40aa-baaa-b7dd3aeb69a9 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:47.822168 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-49070144-edc6-40aa-baaa-b7dd3aeb69a9 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:47.822643 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-49070144-edc6-40aa-baaa-b7dd3aeb69a9 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:47.836409 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-49070144-edc6-40aa-baaa-b7dd3aeb69a9 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] HTTP exception thrown: Instance b6e57542-d286-4c87-8cd1-a86a31c08e1a could not be found. Oct 04 19:39:47.838286 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-49070144-edc6-40aa-baaa-b7dd3aeb69a9 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Request method failure captured: Oct 04 19:39:47.838286 n-d-851028-13 devstack@n-api.service[123595]: request: DELETE /compute/v2.1/servers/b6e57542-d286-4c87-8cd1-a86a31c08e1a HTTP/1.1 Oct 04 19:39:47.838286 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 19:39:47.838286 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 19:39:47.838286 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 19:39:47.838286 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 0 Oct 04 19:39:47.838286 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 19:39:47.838286 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 19:39:47.838286 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 19:39:47.838286 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 19:39:47.838286 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPIvmvQSxyNOGrhwvt9RlI-_e7OA8aaNauJwsHUzIlDQqZlsbj7v0GUII20f6TeiewFJLMOUrlzZGnLFmSx422PmQpT4CMCc8FCmQTznW3a75vRCanes3Jn8MNL6qQWzKFXeA56hfFGkc5S7vRdTbmsjUv-j_qH4xaw71Ly7jDLMlpFw Oct 04 19:39:47.838286 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 19:39:47.838286 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 19:39:47.838286 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 19:39:47.838286 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 19:39:47.838286 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 19:39:47.838286 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 19:39:47.838286 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: 29dc28086df142998e726efe7f5649fa Oct 04 19:39:47.838286 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-ServersNegativeTestJSON-1092246068 Oct 04 19:39:47.838286 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 19:39:47.838286 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 19:39:47.838286 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/29dc28086df142998e726efe7f5649fa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_29dc28086df142998e726efe7f5649fa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/29dc28086df142998e726efe7f5649fa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/29dc28086df142998e726efe7f5649fa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 19:39:47.838286 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-ServersNegativeTestJSON-1092246068 Oct 04 19:39:47.838286 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: 29dc28086df142998e726efe7f5649fa Oct 04 19:39:47.838286 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1092246068 Oct 04 19:39:47.838286 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-ServersNegativeTestJSON-1092246068-project Oct 04 19:39:47.838286 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 19:39:47.838286 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 19:39:47.838286 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: 91c7a8ba3a634e8a8895fd82de1633ed Oct 04 19:39:47.838286 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-ServersNegativeTestJSON-1092246068-project Oct 04 19:39:47.838286 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 19:39:47.838286 n-d-851028-13 devstack@n-api.service[123595]: exception: Instance b6e57542-d286-4c87-8cd1-a86a31c08e1a could not be found. Oct 04 19:39:47.838286 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': 'b6e57542-d286-4c87-8cd1-a86a31c08e1a'} Oct 04 19:39:47.838286 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:39:47.838286 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:39:47.838286 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:39:47.838286 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:39:47.838286 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:39:47.838286 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:39:47.838286 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:39:47.838286 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:39:47.838286 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:39:47.838286 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:39:47.838286 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6e57542-d286-4c87-8cd1-a86a31c08e1a could not be found. Oct 04 19:39:47.838286 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:39:47.838286 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:39:47.838286 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:39:47.838286 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:39:47.838286 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:39:47.838286 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:39:47.838286 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:39:47.838286 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:39:47.838286 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:39:47.838286 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:39:47.838286 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 19:39:47.838286 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 19:39:47.838286 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 19:39:47.838286 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 19:39:47.838286 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:39:47.838286 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:39:47.838286 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:39:47.838286 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:39:47.843093 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6e57542-d286-4c87-8cd1-a86a31c08e1a could not be found. Oct 04 19:39:47.843093 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:39:47.843093 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:39:47.843093 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:39:47.843093 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:39:47.843093 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:39:47.843093 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:39:47.843093 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:39:47.843093 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:39:47.843093 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6e57542-d286-4c87-8cd1-a86a31c08e1a could not be found. Oct 04 19:39:47.843093 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:39:47.843093 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-49070144-edc6-40aa-baaa-b7dd3aeb69a9 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Returning 404 to user: Instance b6e57542-d286-4c87-8cd1-a86a31c08e1a could not be found. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:39:47.843093 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-49070144-edc6-40aa-baaa-b7dd3aeb69a9 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] 10.222.0.43 "DELETE /compute/v2.1/servers/b6e57542-d286-4c87-8cd1-a86a31c08e1a" status: 404 len: 111 microversion: 2.1 time: 0.032412 Oct 04 19:39:47.843093 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3506/7384] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 19:39:47 2022] DELETE /compute/v2.1/servers/b6e57542-d286-4c87-8cd1-a86a31c08e1a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:39:47.848833 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-bd72a4ad-3c48-4fc7-8ac0-50ffb5417663 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:39:47.849498 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-bd72a4ad-3c48-4fc7-8ac0-50ffb5417663 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] [instance: b6e57542-d286-4c87-8cd1-a86a31c08e1a] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:39:47.855510 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bd72a4ad-3c48-4fc7-8ac0-50ffb5417663 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:47.856016 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bd72a4ad-3c48-4fc7-8ac0-50ffb5417663 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:47.856515 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bd72a4ad-3c48-4fc7-8ac0-50ffb5417663 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:47.857305 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bd72a4ad-3c48-4fc7-8ac0-50ffb5417663 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:47.857783 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bd72a4ad-3c48-4fc7-8ac0-50ffb5417663 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:47.858231 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bd72a4ad-3c48-4fc7-8ac0-50ffb5417663 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:47.871606 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-bd72a4ad-3c48-4fc7-8ac0-50ffb5417663 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] HTTP exception thrown: Instance b6e57542-d286-4c87-8cd1-a86a31c08e1a could not be found. Oct 04 19:39:47.873314 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-bd72a4ad-3c48-4fc7-8ac0-50ffb5417663 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Request method failure captured: Oct 04 19:39:47.873314 n-d-851028-13 devstack@n-api.service[123596]: request: GET /compute/v2.1/servers/b6e57542-d286-4c87-8cd1-a86a31c08e1a HTTP/1.1 Oct 04 19:39:47.873314 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 19:39:47.873314 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 19:39:47.873314 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 19:39:47.873314 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 19:39:47.873314 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 19:39:47.873314 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 19:39:47.873314 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 19:39:47.873314 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 19:39:47.873314 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPIvmvQSxyNOGrhwvt9RlI-_e7OA8aaNauJwsHUzIlDQqZlsbj7v0GUII20f6TeiewFJLMOUrlzZGnLFmSx422PmQpT4CMCc8FCmQTznW3a75vRCanes3Jn8MNL6qQWzKFXeA56hfFGkc5S7vRdTbmsjUv-j_qH4xaw71Ly7jDLMlpFw Oct 04 19:39:47.873314 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 19:39:47.873314 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 19:39:47.873314 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 19:39:47.873314 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 19:39:47.873314 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 19:39:47.873314 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 19:39:47.873314 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: 29dc28086df142998e726efe7f5649fa Oct 04 19:39:47.873314 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-ServersNegativeTestJSON-1092246068 Oct 04 19:39:47.873314 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 19:39:47.873314 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 19:39:47.873314 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/29dc28086df142998e726efe7f5649fa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_29dc28086df142998e726efe7f5649fa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/29dc28086df142998e726efe7f5649fa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/29dc28086df142998e726efe7f5649fa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 19:39:47.873314 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-ServersNegativeTestJSON-1092246068 Oct 04 19:39:47.873314 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: 29dc28086df142998e726efe7f5649fa Oct 04 19:39:47.873314 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1092246068 Oct 04 19:39:47.873314 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-ServersNegativeTestJSON-1092246068-project Oct 04 19:39:47.873314 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 19:39:47.873314 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 19:39:47.873314 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 91c7a8ba3a634e8a8895fd82de1633ed Oct 04 19:39:47.873314 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-ServersNegativeTestJSON-1092246068-project Oct 04 19:39:47.873314 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 19:39:47.873314 n-d-851028-13 devstack@n-api.service[123596]: exception: Instance b6e57542-d286-4c87-8cd1-a86a31c08e1a could not be found. Oct 04 19:39:47.873314 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': 'b6e57542-d286-4c87-8cd1-a86a31c08e1a'} Oct 04 19:39:47.873314 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:39:47.873314 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:39:47.873314 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:39:47.873314 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:39:47.873314 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:39:47.873314 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:39:47.873314 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:39:47.873314 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:39:47.873314 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:39:47.873314 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:39:47.873314 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6e57542-d286-4c87-8cd1-a86a31c08e1a could not be found. Oct 04 19:39:47.873314 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:39:47.873314 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:39:47.873314 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:39:47.873314 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:39:47.873314 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:39:47.873314 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:39:47.873314 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:39:47.873314 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:39:47.873314 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:39:47.873314 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:39:47.873314 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:39:47.873314 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:39:47.873314 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:39:47.873314 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:39:47.873314 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:39:47.873314 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:39:47.873314 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6e57542-d286-4c87-8cd1-a86a31c08e1a could not be found. Oct 04 19:39:47.873314 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:39:47.873314 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:39:47.873314 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:39:47.877459 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:39:47.877459 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:39:47.877459 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:39:47.877459 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:39:47.877459 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:39:47.877459 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6e57542-d286-4c87-8cd1-a86a31c08e1a could not be found. Oct 04 19:39:47.877459 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:39:47.877459 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-bd72a4ad-3c48-4fc7-8ac0-50ffb5417663 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Returning 404 to user: Instance b6e57542-d286-4c87-8cd1-a86a31c08e1a could not be found. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:39:47.877459 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-bd72a4ad-3c48-4fc7-8ac0-50ffb5417663 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] 10.222.0.43 "GET /compute/v2.1/servers/b6e57542-d286-4c87-8cd1-a86a31c08e1a" status: 404 len: 111 microversion: 2.1 time: 0.029751 Oct 04 19:39:47.877459 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3879/7385] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:39:47 2022] GET /compute/v2.1/servers/b6e57542-d286-4c87-8cd1-a86a31c08e1a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:39:47.883307 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-a37fe915-0ffb-45d1-a0e4-2baccd72019f tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:39:47.883818 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-a37fe915-0ffb-45d1-a0e4-2baccd72019f tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] [instance: 4fd0aa73-4b6c-45fb-b5c8-6ce4df365c11] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:39:47.890310 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a37fe915-0ffb-45d1-a0e4-2baccd72019f tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:47.890804 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a37fe915-0ffb-45d1-a0e4-2baccd72019f tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:47.891247 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a37fe915-0ffb-45d1-a0e4-2baccd72019f tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:47.891947 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a37fe915-0ffb-45d1-a0e4-2baccd72019f tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:47.892410 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a37fe915-0ffb-45d1-a0e4-2baccd72019f tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:47.892848 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a37fe915-0ffb-45d1-a0e4-2baccd72019f tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:47.920868 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-a37fe915-0ffb-45d1-a0e4-2baccd72019f tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] [instance: 4fd0aa73-4b6c-45fb-b5c8-6ce4df365c11] Going to try to terminate instance {{(pid=123595) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 19:39:47.923581 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:39:47.996169 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-a37fe915-0ffb-45d1-a0e4-2baccd72019f tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] 10.222.0.43 "DELETE /compute/v2.1/servers/4fd0aa73-4b6c-45fb-b5c8-6ce4df365c11" status: 204 len: 0 microversion: 2.1 time: 0.116305 Oct 04 19:39:47.996878 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3507/7386] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 19:39:47 2022] DELETE /compute/v2.1/servers/4fd0aa73-4b6c-45fb-b5c8-6ce4df365c11 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:39:48.005697 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-45cf28ee-e60b-43c5-b2d1-01004dffa84f tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:39:48.006404 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-45cf28ee-e60b-43c5-b2d1-01004dffa84f tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] [instance: 4fd0aa73-4b6c-45fb-b5c8-6ce4df365c11] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:39:48.013944 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-45cf28ee-e60b-43c5-b2d1-01004dffa84f tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:48.014455 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-45cf28ee-e60b-43c5-b2d1-01004dffa84f tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:48.014917 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-45cf28ee-e60b-43c5-b2d1-01004dffa84f tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:48.015657 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-45cf28ee-e60b-43c5-b2d1-01004dffa84f tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:48.016137 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-45cf28ee-e60b-43c5-b2d1-01004dffa84f tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:48.016586 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-45cf28ee-e60b-43c5-b2d1-01004dffa84f tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:48.035404 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=100 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:39:48.146154 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-45cf28ee-e60b-43c5-b2d1-01004dffa84f tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c7a8ba3a634e8a8895fd82de1633ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29dc28086df142998e726efe7f5649fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:39:48.154041 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-45cf28ee-e60b-43c5-b2d1-01004dffa84f tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] 10.222.0.43 "GET /compute/v2.1/servers/4fd0aa73-4b6c-45fb-b5c8-6ce4df365c11" status: 200 len: 1511 microversion: 2.1 time: 0.152753 Oct 04 19:39:48.155051 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3880/7387] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:39:48 2022] GET /compute/v2.1/servers/4fd0aa73-4b6c-45fb-b5c8-6ce4df365c11 => generated 1511 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:39:49.180571 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-71e11bdc-cbc0-415b-b8f3-515be602d597 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:39:49.181326 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-71e11bdc-cbc0-415b-b8f3-515be602d597 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] [instance: 4fd0aa73-4b6c-45fb-b5c8-6ce4df365c11] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:39:49.188521 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-71e11bdc-cbc0-415b-b8f3-515be602d597 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:49.189081 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-71e11bdc-cbc0-415b-b8f3-515be602d597 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:49.189554 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-71e11bdc-cbc0-415b-b8f3-515be602d597 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:49.190272 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-71e11bdc-cbc0-415b-b8f3-515be602d597 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:49.190729 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-71e11bdc-cbc0-415b-b8f3-515be602d597 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:49.191164 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-71e11bdc-cbc0-415b-b8f3-515be602d597 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:49.323690 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-71e11bdc-cbc0-415b-b8f3-515be602d597 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c7a8ba3a634e8a8895fd82de1633ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29dc28086df142998e726efe7f5649fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:39:49.332028 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-71e11bdc-cbc0-415b-b8f3-515be602d597 tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] 10.222.0.43 "GET /compute/v2.1/servers/4fd0aa73-4b6c-45fb-b5c8-6ce4df365c11" status: 200 len: 1511 microversion: 2.1 time: 0.158227 Oct 04 19:39:49.332607 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3508/7388] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:39:49 2022] GET /compute/v2.1/servers/4fd0aa73-4b6c-45fb-b5c8-6ce4df365c11 => generated 1511 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:39:49.893814 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-64776308-ff81-437f-8edb-ddab6caa1c54 req-b45885a2-5201-4362-aef3-db80aeedc2c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fd0aa73-4b6c-45fb-b5c8-6ce4df365c11", "name": "network-vif-deleted", "tag": "e4d7dda0-eaf8-4f32-8cb1-95c5bf55e734"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:39:49.898906 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=3 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:39:49.906163 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-64776308-ff81-437f-8edb-ddab6caa1c54 req-b45885a2-5201-4362-aef3-db80aeedc2c0 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:49.906741 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-64776308-ff81-437f-8edb-ddab6caa1c54 req-b45885a2-5201-4362-aef3-db80aeedc2c0 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:49.907258 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-64776308-ff81-437f-8edb-ddab6caa1c54 req-b45885a2-5201-4362-aef3-db80aeedc2c0 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:49.922761 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-64776308-ff81-437f-8edb-ddab6caa1c54 req-b45885a2-5201-4362-aef3-db80aeedc2c0 service nova] Creating event network-vif-deleted:e4d7dda0-eaf8-4f32-8cb1-95c5bf55e734 for instance 4fd0aa73-4b6c-45fb-b5c8-6ce4df365c11 on n-h1-851028-13 Oct 04 19:39:49.929862 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-64776308-ff81-437f-8edb-ddab6caa1c54 req-b45885a2-5201-4362-aef3-db80aeedc2c0 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104037 Oct 04 19:39:49.930577 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3881/7389] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:39:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:39:50.356371 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-5086aafc-90b2-40b9-bbd5-da3dab829a1d tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:39:50.357042 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-5086aafc-90b2-40b9-bbd5-da3dab829a1d tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] [instance: 4fd0aa73-4b6c-45fb-b5c8-6ce4df365c11] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:39:50.363883 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5086aafc-90b2-40b9-bbd5-da3dab829a1d tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:50.364366 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5086aafc-90b2-40b9-bbd5-da3dab829a1d tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:50.364801 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5086aafc-90b2-40b9-bbd5-da3dab829a1d tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:50.365553 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5086aafc-90b2-40b9-bbd5-da3dab829a1d tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:50.366002 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5086aafc-90b2-40b9-bbd5-da3dab829a1d tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:50.366426 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5086aafc-90b2-40b9-bbd5-da3dab829a1d tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:50.380054 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-5086aafc-90b2-40b9-bbd5-da3dab829a1d tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] HTTP exception thrown: Instance 4fd0aa73-4b6c-45fb-b5c8-6ce4df365c11 could not be found. Oct 04 19:39:50.381718 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-5086aafc-90b2-40b9-bbd5-da3dab829a1d tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Request method failure captured: Oct 04 19:39:50.381718 n-d-851028-13 devstack@n-api.service[123595]: request: GET /compute/v2.1/servers/4fd0aa73-4b6c-45fb-b5c8-6ce4df365c11 HTTP/1.1 Oct 04 19:39:50.381718 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 19:39:50.381718 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 19:39:50.381718 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 19:39:50.381718 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 0 Oct 04 19:39:50.381718 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 19:39:50.381718 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 19:39:50.381718 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 19:39:50.381718 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 19:39:50.381718 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPIvmvQSxyNOGrhwvt9RlI-_e7OA8aaNauJwsHUzIlDQqZlsbj7v0GUII20f6TeiewFJLMOUrlzZGnLFmSx422PmQpT4CMCc8FCmQTznW3a75vRCanes3Jn8MNL6qQWzKFXeA56hfFGkc5S7vRdTbmsjUv-j_qH4xaw71Ly7jDLMlpFw Oct 04 19:39:50.381718 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 19:39:50.381718 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 19:39:50.381718 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 19:39:50.381718 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 19:39:50.381718 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 19:39:50.381718 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 19:39:50.381718 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: 29dc28086df142998e726efe7f5649fa Oct 04 19:39:50.381718 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-ServersNegativeTestJSON-1092246068 Oct 04 19:39:50.381718 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 19:39:50.381718 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 19:39:50.381718 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/29dc28086df142998e726efe7f5649fa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_29dc28086df142998e726efe7f5649fa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/29dc28086df142998e726efe7f5649fa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/29dc28086df142998e726efe7f5649fa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 19:39:50.381718 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-ServersNegativeTestJSON-1092246068 Oct 04 19:39:50.381718 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: 29dc28086df142998e726efe7f5649fa Oct 04 19:39:50.381718 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1092246068 Oct 04 19:39:50.381718 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-ServersNegativeTestJSON-1092246068-project Oct 04 19:39:50.381718 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 19:39:50.381718 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 19:39:50.381718 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: 91c7a8ba3a634e8a8895fd82de1633ed Oct 04 19:39:50.381718 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-ServersNegativeTestJSON-1092246068-project Oct 04 19:39:50.381718 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 19:39:50.381718 n-d-851028-13 devstack@n-api.service[123595]: exception: Instance 4fd0aa73-4b6c-45fb-b5c8-6ce4df365c11 could not be found. Oct 04 19:39:50.381718 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': '4fd0aa73-4b6c-45fb-b5c8-6ce4df365c11'} Oct 04 19:39:50.381718 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:39:50.381718 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:39:50.381718 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:39:50.381718 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:39:50.381718 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:39:50.381718 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:39:50.381718 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:39:50.381718 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:39:50.381718 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:39:50.381718 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:39:50.381718 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4fd0aa73-4b6c-45fb-b5c8-6ce4df365c11 could not be found. Oct 04 19:39:50.381718 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:39:50.381718 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:39:50.381718 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:39:50.381718 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:39:50.381718 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:39:50.381718 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:39:50.381718 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:39:50.381718 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:39:50.381718 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:39:50.381718 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:39:50.381718 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:39:50.381718 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:39:50.381718 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:39:50.381718 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:39:50.381718 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:39:50.381718 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:39:50.381718 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4fd0aa73-4b6c-45fb-b5c8-6ce4df365c11 could not be found. Oct 04 19:39:50.381718 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:39:50.381718 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:39:50.381718 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:39:50.390092 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:39:50.390092 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:39:50.390092 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:39:50.390092 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:39:50.390092 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:39:50.390092 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4fd0aa73-4b6c-45fb-b5c8-6ce4df365c11 could not be found. Oct 04 19:39:50.390092 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:39:50.390092 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-5086aafc-90b2-40b9-bbd5-da3dab829a1d tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] Returning 404 to user: Instance 4fd0aa73-4b6c-45fb-b5c8-6ce4df365c11 could not be found. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:39:50.390092 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-5086aafc-90b2-40b9-bbd5-da3dab829a1d tempest-ServersNegativeTestJSON-1092246068 tempest-ServersNegativeTestJSON-1092246068-project] 10.222.0.43 "GET /compute/v2.1/servers/4fd0aa73-4b6c-45fb-b5c8-6ce4df365c11" status: 404 len: 111 microversion: 2.1 time: 0.031217 Oct 04 19:39:50.390092 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3509/7390] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:39:50 2022] GET /compute/v2.1/servers/4fd0aa73-4b6c-45fb-b5c8-6ce4df365c11 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:40:21.488275 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=4 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:40:21.489778 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_api:SELECT=1 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:40:21.746433 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-08588f69-3b3a-4224-9f42-6b0ab257bdba tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Action: 'create', calling method: .version_select at 0x7fb21c598820>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1897534474", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF2Nd18VR4muWB+tVLVIamhjjAdJmXWGdAdLsGTt1uvvLleSZLQXixjFKr8gIuWPezNHIuk5c4gbzC7ZDTjGqFaSuisJAfocwLCh8z6K2zUnURRIwtzvqJgzgTS+zo6jEQ=="}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:40:21.763321 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-08588f69-3b3a-4224-9f42-6b0ab257bdba tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Getting quotas for project a14c17efe9404d6bb455d5dcc8b2c3c4. Resources: {'key_pairs'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:40:21.769428 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-08588f69-3b3a-4224-9f42-6b0ab257bdba tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Getting quotas for user fdd88e4643894b5dac67db4cb49c665b and project a14c17efe9404d6bb455d5dcc8b2c3c4. Resources: {'key_pairs'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:40:21.806040 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-08588f69-3b3a-4224-9f42-6b0ab257bdba tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.331857 Oct 04 19:40:21.806791 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3882/7391] 10.222.0.43 () {60 vars in 1159 bytes} [Tue Oct 4 19:40:21 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:40:21.874069 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-42bc8c99-7c75-4a0c-9dea-678d30c5e4d9 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1217702258", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1897534474", "networks": [{"uuid": "28c02d60-66d8-40f0-a6d3-89b685207981"}]}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:40:21.889707 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=2 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:40:21.893659 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:40:21.895216 n-d-851028-13 devstack@n-api.service[123595]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 19:40:21.895579 n-d-851028-13 devstack@n-api.service[123595]: Tue Oct 4 19:40:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.43) !!! Oct 04 19:40:21.951916 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.network.neutron [None req-42bc8c99-7c75-4a0c-9dea-678d30c5e4d9 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] validate_networks() for [('28c02d60-66d8-40f0-a6d3-89b685207981', None, None, None, None, None)] {{(pid=123595) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 19:40:22.339653 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-42bc8c99-7c75-4a0c-9dea-678d30c5e4d9 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Flavor limits 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:40:22.340117 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-42bc8c99-7c75-4a0c-9dea-678d30c5e4d9 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Image limits 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:40:22.340627 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-42bc8c99-7c75-4a0c-9dea-678d30c5e4d9 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Flavor pref 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:40:22.341066 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-42bc8c99-7c75-4a0c-9dea-678d30c5e4d9 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Image pref 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:40:22.341511 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-42bc8c99-7c75-4a0c-9dea-678d30c5e4d9 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:40:22.350364 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-42bc8c99-7c75-4a0c-9dea-678d30c5e4d9 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:22.350853 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-42bc8c99-7c75-4a0c-9dea-678d30c5e4d9 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:22.351295 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-42bc8c99-7c75-4a0c-9dea-678d30c5e4d9 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:22.352029 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-42bc8c99-7c75-4a0c-9dea-678d30c5e4d9 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:22.352491 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-42bc8c99-7c75-4a0c-9dea-678d30c5e4d9 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:22.352923 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-42bc8c99-7c75-4a0c-9dea-678d30c5e4d9 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:22.369456 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-42bc8c99-7c75-4a0c-9dea-678d30c5e4d9 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Getting quotas for project a14c17efe9404d6bb455d5dcc8b2c3c4. Resources: {'ram', 'cores', 'instances'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:40:22.375125 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-42bc8c99-7c75-4a0c-9dea-678d30c5e4d9 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Getting quotas for user fdd88e4643894b5dac67db4cb49c665b and project a14c17efe9404d6bb455d5dcc8b2c3c4. Resources: {'ram', 'cores', 'instances'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:40:22.388264 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-42bc8c99-7c75-4a0c-9dea-678d30c5e4d9 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Going to run 1 instances... {{(pid=123595) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 19:40:22.390649 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-42bc8c99-7c75-4a0c-9dea-678d30c5e4d9 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] [instance: afccf704-642d-4ef9-bccb-c6a74410be96] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e8943ec5-4038-4d4b-b9b9-2415a79f5243',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 19:40:22.438375 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-42bc8c99-7c75-4a0c-9dea-678d30c5e4d9 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.577645 Oct 04 19:40:22.438961 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3510/7392] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 19:40:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 580 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 19:40:22.450490 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-667e417e-0838-4401-9d8d-ac135c9ebd14 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:40:22.451239 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-667e417e-0838-4401-9d8d-ac135c9ebd14 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] [instance: afccf704-642d-4ef9-bccb-c6a74410be96] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:40:22.506630 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-667e417e-0838-4401-9d8d-ac135c9ebd14 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdd88e4643894b5dac67db4cb49c665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14c17efe9404d6bb455d5dcc8b2c3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:40:22.517330 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-667e417e-0838-4401-9d8d-ac135c9ebd14 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] 10.222.0.43 "GET /compute/v2.1/servers/afccf704-642d-4ef9-bccb-c6a74410be96" status: 200 len: 1263 microversion: 2.1 time: 0.071304 Oct 04 19:40:22.517907 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3883/7393] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:40:22 2022] GET /compute/v2.1/servers/afccf704-642d-4ef9-bccb-c6a74410be96 => generated 1263 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:40:23.541225 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-bb574b40-e690-4c82-8f8c-38b8473a1fd8 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:40:23.541958 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-bb574b40-e690-4c82-8f8c-38b8473a1fd8 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] [instance: afccf704-642d-4ef9-bccb-c6a74410be96] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:40:23.550511 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bb574b40-e690-4c82-8f8c-38b8473a1fd8 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:23.551116 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bb574b40-e690-4c82-8f8c-38b8473a1fd8 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:23.551928 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bb574b40-e690-4c82-8f8c-38b8473a1fd8 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:23.553250 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bb574b40-e690-4c82-8f8c-38b8473a1fd8 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:23.554346 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bb574b40-e690-4c82-8f8c-38b8473a1fd8 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:23.555108 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bb574b40-e690-4c82-8f8c-38b8473a1fd8 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:23.640702 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-bb574b40-e690-4c82-8f8c-38b8473a1fd8 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdd88e4643894b5dac67db4cb49c665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14c17efe9404d6bb455d5dcc8b2c3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:40:23.651841 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-bb574b40-e690-4c82-8f8c-38b8473a1fd8 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] 10.222.0.43 "GET /compute/v2.1/servers/afccf704-642d-4ef9-bccb-c6a74410be96" status: 200 len: 1315 microversion: 2.1 time: 0.115841 Oct 04 19:40:23.668596 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3511/7394] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:40:23 2022] GET /compute/v2.1/servers/afccf704-642d-4ef9-bccb-c6a74410be96 => generated 1315 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:40:24.675840 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-542a48d3-d917-4e4e-91fb-3c7142ca9a1e tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:40:24.676690 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-542a48d3-d917-4e4e-91fb-3c7142ca9a1e tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] [instance: afccf704-642d-4ef9-bccb-c6a74410be96] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:40:24.683883 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-542a48d3-d917-4e4e-91fb-3c7142ca9a1e tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:24.684536 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-542a48d3-d917-4e4e-91fb-3c7142ca9a1e tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:24.685052 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-542a48d3-d917-4e4e-91fb-3c7142ca9a1e tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:24.686205 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-542a48d3-d917-4e4e-91fb-3c7142ca9a1e tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:24.686376 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-542a48d3-d917-4e4e-91fb-3c7142ca9a1e tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:24.686999 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-542a48d3-d917-4e4e-91fb-3c7142ca9a1e tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:24.831722 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-542a48d3-d917-4e4e-91fb-3c7142ca9a1e tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdd88e4643894b5dac67db4cb49c665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14c17efe9404d6bb455d5dcc8b2c3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:40:24.841103 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-542a48d3-d917-4e4e-91fb-3c7142ca9a1e tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] 10.222.0.43 "GET /compute/v2.1/servers/afccf704-642d-4ef9-bccb-c6a74410be96" status: 200 len: 1363 microversion: 2.1 time: 0.168303 Oct 04 19:40:24.841728 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3884/7395] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:40:24 2022] GET /compute/v2.1/servers/afccf704-642d-4ef9-bccb-c6a74410be96 => generated 1363 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:40:25.231686 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-598840af-9872-455b-ab7f-4ac7cd2cb79e req-298e7f56-7156-4574-b8d6-485378f2799b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "afccf704-642d-4ef9-bccb-c6a74410be96", "tag": "a87fb5de-00e6-4f70-b3e4-6cb6e5361a8e"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:40:25.243842 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-598840af-9872-455b-ab7f-4ac7cd2cb79e req-298e7f56-7156-4574-b8d6-485378f2799b service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:25.244347 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-598840af-9872-455b-ab7f-4ac7cd2cb79e req-298e7f56-7156-4574-b8d6-485378f2799b service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:25.244789 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-598840af-9872-455b-ab7f-4ac7cd2cb79e req-298e7f56-7156-4574-b8d6-485378f2799b service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:25.263348 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-598840af-9872-455b-ab7f-4ac7cd2cb79e req-298e7f56-7156-4574-b8d6-485378f2799b service nova] Creating event network-changed:a87fb5de-00e6-4f70-b3e4-6cb6e5361a8e for instance afccf704-642d-4ef9-bccb-c6a74410be96 on n-h1-851028-13 Oct 04 19:40:25.269338 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-598840af-9872-455b-ab7f-4ac7cd2cb79e req-298e7f56-7156-4574-b8d6-485378f2799b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041767 Oct 04 19:40:25.271398 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3512/7396] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:40:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:40:25.865823 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f55e627e-992e-4965-94c8-86091519d258 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:40:25.866476 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-f55e627e-992e-4965-94c8-86091519d258 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] [instance: afccf704-642d-4ef9-bccb-c6a74410be96] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:40:25.873470 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f55e627e-992e-4965-94c8-86091519d258 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:25.873977 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f55e627e-992e-4965-94c8-86091519d258 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:25.874438 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f55e627e-992e-4965-94c8-86091519d258 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:25.875150 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f55e627e-992e-4965-94c8-86091519d258 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:25.875625 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f55e627e-992e-4965-94c8-86091519d258 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:25.876074 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f55e627e-992e-4965-94c8-86091519d258 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:26.005417 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-f55e627e-992e-4965-94c8-86091519d258 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdd88e4643894b5dac67db4cb49c665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14c17efe9404d6bb455d5dcc8b2c3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:40:26.013856 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-f55e627e-992e-4965-94c8-86091519d258 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] 10.222.0.43 "GET /compute/v2.1/servers/afccf704-642d-4ef9-bccb-c6a74410be96" status: 200 len: 1363 microversion: 2.1 time: 0.152018 Oct 04 19:40:26.014426 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3885/7397] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:40:25 2022] GET /compute/v2.1/servers/afccf704-642d-4ef9-bccb-c6a74410be96 => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:40:27.037487 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-9c86168c-76d5-44b5-b5f6-924921150bd1 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:40:27.038214 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-9c86168c-76d5-44b5-b5f6-924921150bd1 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] [instance: afccf704-642d-4ef9-bccb-c6a74410be96] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:40:27.045350 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9c86168c-76d5-44b5-b5f6-924921150bd1 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:27.045867 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9c86168c-76d5-44b5-b5f6-924921150bd1 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:27.046318 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9c86168c-76d5-44b5-b5f6-924921150bd1 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:27.047063 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9c86168c-76d5-44b5-b5f6-924921150bd1 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:27.047722 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9c86168c-76d5-44b5-b5f6-924921150bd1 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:27.048162 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9c86168c-76d5-44b5-b5f6-924921150bd1 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:27.178099 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-9c86168c-76d5-44b5-b5f6-924921150bd1 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdd88e4643894b5dac67db4cb49c665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14c17efe9404d6bb455d5dcc8b2c3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:40:27.185672 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-9c86168c-76d5-44b5-b5f6-924921150bd1 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] 10.222.0.43 "GET /compute/v2.1/servers/afccf704-642d-4ef9-bccb-c6a74410be96" status: 200 len: 1363 microversion: 2.1 time: 0.153470 Oct 04 19:40:27.186246 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3513/7398] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:40:27 2022] GET /compute/v2.1/servers/afccf704-642d-4ef9-bccb-c6a74410be96 => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:40:28.209045 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-c7e48fbb-8a3c-41a4-a029-83fce7b14c95 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:40:28.209711 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-c7e48fbb-8a3c-41a4-a029-83fce7b14c95 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] [instance: afccf704-642d-4ef9-bccb-c6a74410be96] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:40:28.217420 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c7e48fbb-8a3c-41a4-a029-83fce7b14c95 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:28.217918 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c7e48fbb-8a3c-41a4-a029-83fce7b14c95 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:28.218378 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c7e48fbb-8a3c-41a4-a029-83fce7b14c95 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:28.219084 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c7e48fbb-8a3c-41a4-a029-83fce7b14c95 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:28.219556 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c7e48fbb-8a3c-41a4-a029-83fce7b14c95 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:28.219998 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c7e48fbb-8a3c-41a4-a029-83fce7b14c95 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:28.347306 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-c7e48fbb-8a3c-41a4-a029-83fce7b14c95 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdd88e4643894b5dac67db4cb49c665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14c17efe9404d6bb455d5dcc8b2c3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:40:28.355053 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-c7e48fbb-8a3c-41a4-a029-83fce7b14c95 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] 10.222.0.43 "GET /compute/v2.1/servers/afccf704-642d-4ef9-bccb-c6a74410be96" status: 200 len: 1363 microversion: 2.1 time: 0.149892 Oct 04 19:40:28.355674 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3886/7399] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:40:28 2022] GET /compute/v2.1/servers/afccf704-642d-4ef9-bccb-c6a74410be96 => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:40:29.379052 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-5e065903-caf9-4267-9708-0a4e7b417955 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:40:29.380033 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-5e065903-caf9-4267-9708-0a4e7b417955 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] [instance: afccf704-642d-4ef9-bccb-c6a74410be96] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:40:29.386179 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5e065903-caf9-4267-9708-0a4e7b417955 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:29.386676 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5e065903-caf9-4267-9708-0a4e7b417955 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:29.387126 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5e065903-caf9-4267-9708-0a4e7b417955 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:29.387837 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5e065903-caf9-4267-9708-0a4e7b417955 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:29.388301 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5e065903-caf9-4267-9708-0a4e7b417955 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:29.388763 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5e065903-caf9-4267-9708-0a4e7b417955 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:29.524802 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-5e065903-caf9-4267-9708-0a4e7b417955 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdd88e4643894b5dac67db4cb49c665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14c17efe9404d6bb455d5dcc8b2c3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:40:29.536829 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-5e065903-caf9-4267-9708-0a4e7b417955 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] 10.222.0.43 "GET /compute/v2.1/servers/afccf704-642d-4ef9-bccb-c6a74410be96" status: 200 len: 1363 microversion: 2.1 time: 0.161505 Oct 04 19:40:29.537559 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3514/7400] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:40:29 2022] GET /compute/v2.1/servers/afccf704-642d-4ef9-bccb-c6a74410be96 => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:40:29.552092 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-28260d8d-a94f-4d9c-8fb9-8348290b2c43 req-10b2f311-6085-4c66-a122-3984f6f95682 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afccf704-642d-4ef9-bccb-c6a74410be96", "name": "network-vif-plugged", "status": "completed", "tag": "a87fb5de-00e6-4f70-b3e4-6cb6e5361a8e"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:40:29.563724 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-28260d8d-a94f-4d9c-8fb9-8348290b2c43 req-10b2f311-6085-4c66-a122-3984f6f95682 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:29.564230 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-28260d8d-a94f-4d9c-8fb9-8348290b2c43 req-10b2f311-6085-4c66-a122-3984f6f95682 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:29.564887 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-28260d8d-a94f-4d9c-8fb9-8348290b2c43 req-10b2f311-6085-4c66-a122-3984f6f95682 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:29.580296 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-28260d8d-a94f-4d9c-8fb9-8348290b2c43 req-10b2f311-6085-4c66-a122-3984f6f95682 service nova] Creating event network-vif-plugged:a87fb5de-00e6-4f70-b3e4-6cb6e5361a8e for instance afccf704-642d-4ef9-bccb-c6a74410be96 on n-h1-851028-13 Oct 04 19:40:29.587368 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-28260d8d-a94f-4d9c-8fb9-8348290b2c43 req-10b2f311-6085-4c66-a122-3984f6f95682 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038877 Oct 04 19:40:29.588090 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3887/7401] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:40:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:40:30.560496 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-caee91c9-6904-4c06-b3cc-c297b0245ec9 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:40:30.561134 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-caee91c9-6904-4c06-b3cc-c297b0245ec9 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] [instance: afccf704-642d-4ef9-bccb-c6a74410be96] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:40:30.567997 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-caee91c9-6904-4c06-b3cc-c297b0245ec9 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:30.568489 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-caee91c9-6904-4c06-b3cc-c297b0245ec9 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:30.568939 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-caee91c9-6904-4c06-b3cc-c297b0245ec9 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:30.569673 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-caee91c9-6904-4c06-b3cc-c297b0245ec9 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:30.570139 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-caee91c9-6904-4c06-b3cc-c297b0245ec9 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:30.570576 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-caee91c9-6904-4c06-b3cc-c297b0245ec9 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:30.707700 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-caee91c9-6904-4c06-b3cc-c297b0245ec9 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdd88e4643894b5dac67db4cb49c665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14c17efe9404d6bb455d5dcc8b2c3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:40:30.715685 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-caee91c9-6904-4c06-b3cc-c297b0245ec9 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] 10.222.0.43 "GET /compute/v2.1/servers/afccf704-642d-4ef9-bccb-c6a74410be96" status: 200 len: 1363 microversion: 2.1 time: 0.159740 Oct 04 19:40:30.716280 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3515/7402] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:40:30 2022] GET /compute/v2.1/servers/afccf704-642d-4ef9-bccb-c6a74410be96 => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:40:31.739940 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-fad29bd1-fd81-4bed-b77c-392c1620c81b tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:40:31.740619 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-fad29bd1-fd81-4bed-b77c-392c1620c81b tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] [instance: afccf704-642d-4ef9-bccb-c6a74410be96] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:40:31.747428 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fad29bd1-fd81-4bed-b77c-392c1620c81b tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:31.747920 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fad29bd1-fd81-4bed-b77c-392c1620c81b tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:31.748369 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fad29bd1-fd81-4bed-b77c-392c1620c81b tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:31.749064 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fad29bd1-fd81-4bed-b77c-392c1620c81b tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:31.749555 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fad29bd1-fd81-4bed-b77c-392c1620c81b tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:31.749992 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fad29bd1-fd81-4bed-b77c-392c1620c81b tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:31.889385 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-fad29bd1-fd81-4bed-b77c-392c1620c81b tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdd88e4643894b5dac67db4cb49c665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14c17efe9404d6bb455d5dcc8b2c3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:40:31.897045 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-fad29bd1-fd81-4bed-b77c-392c1620c81b tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] 10.222.0.43 "GET /compute/v2.1/servers/afccf704-642d-4ef9-bccb-c6a74410be96" status: 200 len: 1554 microversion: 2.1 time: 0.162406 Oct 04 19:40:31.898511 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3888/7403] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:40:31 2022] GET /compute/v2.1/servers/afccf704-642d-4ef9-bccb-c6a74410be96 => generated 1554 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:40:31.921000 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-09f08bb4-e662-48b2-a344-3b74efdbd3bd tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:40:31.921649 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-09f08bb4-e662-48b2-a344-3b74efdbd3bd tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] [instance: afccf704-642d-4ef9-bccb-c6a74410be96] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:40:31.928396 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-09f08bb4-e662-48b2-a344-3b74efdbd3bd tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:31.928883 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-09f08bb4-e662-48b2-a344-3b74efdbd3bd tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:31.929361 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-09f08bb4-e662-48b2-a344-3b74efdbd3bd tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:31.930062 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-09f08bb4-e662-48b2-a344-3b74efdbd3bd tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:31.930519 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-09f08bb4-e662-48b2-a344-3b74efdbd3bd tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:31.931038 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-09f08bb4-e662-48b2-a344-3b74efdbd3bd tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:32.060229 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-09f08bb4-e662-48b2-a344-3b74efdbd3bd tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdd88e4643894b5dac67db4cb49c665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14c17efe9404d6bb455d5dcc8b2c3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:40:32.067961 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-09f08bb4-e662-48b2-a344-3b74efdbd3bd tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] 10.222.0.43 "GET /compute/v2.1/servers/afccf704-642d-4ef9-bccb-c6a74410be96" status: 200 len: 1554 microversion: 2.1 time: 0.151461 Oct 04 19:40:32.068533 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3516/7404] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:40:31 2022] GET /compute/v2.1/servers/afccf704-642d-4ef9-bccb-c6a74410be96 => generated 1554 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:40:33.690619 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-fbce7441-0dfb-49fd-affc-bca70ccacd48 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "84f59930-2b40-4b19-8894-a4b8697deff9"}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:40:33.692974 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-fbce7441-0dfb-49fd-affc-bca70ccacd48 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] [instance: afccf704-642d-4ef9-bccb-c6a74410be96] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:40:33.694997 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=6 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:40:33.701249 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fbce7441-0dfb-49fd-affc-bca70ccacd48 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:33.701758 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fbce7441-0dfb-49fd-affc-bca70ccacd48 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:33.702218 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fbce7441-0dfb-49fd-affc-bca70ccacd48 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:33.702952 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fbce7441-0dfb-49fd-affc-bca70ccacd48 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:33.703426 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fbce7441-0dfb-49fd-affc-bca70ccacd48 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:33.703874 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fbce7441-0dfb-49fd-affc-bca70ccacd48 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:33.946754 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-fbce7441-0dfb-49fd-affc-bca70ccacd48 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] 10.222.0.43 "POST /compute/v2.1/servers/afccf704-642d-4ef9-bccb-c6a74410be96/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.259978 Oct 04 19:40:33.948084 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3889/7405] 10.222.0.43 () {60 vars in 1323 bytes} [Tue Oct 4 19:40:33 2022] POST /compute/v2.1/servers/afccf704-642d-4ef9-bccb-c6a74410be96/os-volume_attachments => generated 194 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:40:44.647655 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-0ee9adbf-7a8c-481e-aea4-630ea052fb7f tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:40:44.648196 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-0ee9adbf-7a8c-481e-aea4-630ea052fb7f tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] [instance: afccf704-642d-4ef9-bccb-c6a74410be96] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:40:44.650165 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=2 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:40:44.650831 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=6 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:40:44.653237 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:40:44.653773 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=34 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:40:44.660932 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0ee9adbf-7a8c-481e-aea4-630ea052fb7f tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:44.661455 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0ee9adbf-7a8c-481e-aea4-630ea052fb7f tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:44.661897 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0ee9adbf-7a8c-481e-aea4-630ea052fb7f tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:44.662594 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0ee9adbf-7a8c-481e-aea4-630ea052fb7f tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:44.663046 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0ee9adbf-7a8c-481e-aea4-630ea052fb7f tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:44.663472 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0ee9adbf-7a8c-481e-aea4-630ea052fb7f tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:44.742321 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.objects.instance [None req-0ee9adbf-7a8c-481e-aea4-630ea052fb7f tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lazy-loading 'services' on Instance uuid afccf704-642d-4ef9-bccb-c6a74410be96 {{(pid=123595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 19:40:44.815777 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-0ee9adbf-7a8c-481e-aea4-630ea052fb7f tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] 10.222.0.43 "DELETE /compute/v2.1/servers/afccf704-642d-4ef9-bccb-c6a74410be96/os-volume_attachments/84f59930-2b40-4b19-8894-a4b8697deff9" status: 202 len: 0 microversion: 2.1 time: 0.171943 Oct 04 19:40:44.816368 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3517/7406] 10.222.0.43 () {58 vars in 1416 bytes} [Tue Oct 4 19:40:44 2022] DELETE /compute/v2.1/servers/afccf704-642d-4ef9-bccb-c6a74410be96/os-volume_attachments/84f59930-2b40-4b19-8894-a4b8697deff9 => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:40:44.822882 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:40:44.823798 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=37,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:40:44.830294 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-c46fd6de-2e10-4c88-a490-3031ab4e139a tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:40:44.832676 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-c46fd6de-2e10-4c88-a490-3031ab4e139a tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] [instance: afccf704-642d-4ef9-bccb-c6a74410be96] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:40:44.842361 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c46fd6de-2e10-4c88-a490-3031ab4e139a tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:44.843033 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c46fd6de-2e10-4c88-a490-3031ab4e139a tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:44.843658 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c46fd6de-2e10-4c88-a490-3031ab4e139a tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:44.844618 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c46fd6de-2e10-4c88-a490-3031ab4e139a tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:44.845211 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c46fd6de-2e10-4c88-a490-3031ab4e139a tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:44.846400 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c46fd6de-2e10-4c88-a490-3031ab4e139a tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:44.879150 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-c46fd6de-2e10-4c88-a490-3031ab4e139a tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] 10.222.0.43 "GET /compute/v2.1/servers/afccf704-642d-4ef9-bccb-c6a74410be96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058192 Oct 04 19:40:44.879833 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3890/7407] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Oct 4 19:40:44 2022] GET /compute/v2.1/servers/afccf704-642d-4ef9-bccb-c6a74410be96/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:40:45.893821 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-c657940d-ca0c-48db-ba89-439a487114a7 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:40:45.896248 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-c657940d-ca0c-48db-ba89-439a487114a7 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] [instance: afccf704-642d-4ef9-bccb-c6a74410be96] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:40:45.903196 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c657940d-ca0c-48db-ba89-439a487114a7 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:45.903686 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c657940d-ca0c-48db-ba89-439a487114a7 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:45.904134 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c657940d-ca0c-48db-ba89-439a487114a7 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:45.904838 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c657940d-ca0c-48db-ba89-439a487114a7 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:45.905336 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c657940d-ca0c-48db-ba89-439a487114a7 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:45.905774 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c657940d-ca0c-48db-ba89-439a487114a7 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:45.935422 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-c657940d-ca0c-48db-ba89-439a487114a7 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] 10.222.0.43 "GET /compute/v2.1/servers/afccf704-642d-4ef9-bccb-c6a74410be96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046844 Oct 04 19:40:45.935991 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3518/7408] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Oct 4 19:40:45 2022] GET /compute/v2.1/servers/afccf704-642d-4ef9-bccb-c6a74410be96/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:40:46.948074 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-77c9db87-5955-4170-836b-b92e4ba0705a tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:40:46.951008 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-77c9db87-5955-4170-836b-b92e4ba0705a tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] [instance: afccf704-642d-4ef9-bccb-c6a74410be96] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:40:46.958022 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-77c9db87-5955-4170-836b-b92e4ba0705a tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:46.958605 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-77c9db87-5955-4170-836b-b92e4ba0705a tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:46.959071 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-77c9db87-5955-4170-836b-b92e4ba0705a tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:46.959780 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-77c9db87-5955-4170-836b-b92e4ba0705a tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:46.960250 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-77c9db87-5955-4170-836b-b92e4ba0705a tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:46.960949 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-77c9db87-5955-4170-836b-b92e4ba0705a tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:46.990518 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-77c9db87-5955-4170-836b-b92e4ba0705a tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] 10.222.0.43 "GET /compute/v2.1/servers/afccf704-642d-4ef9-bccb-c6a74410be96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046447 Oct 04 19:40:46.991096 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3891/7409] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Oct 4 19:40:46 2022] GET /compute/v2.1/servers/afccf704-642d-4ef9-bccb-c6a74410be96/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:40:48.002985 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-f2d997ee-b34a-4030-bf95-2de3511fe619 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:40:48.005343 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-f2d997ee-b34a-4030-bf95-2de3511fe619 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] [instance: afccf704-642d-4ef9-bccb-c6a74410be96] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:40:48.012366 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f2d997ee-b34a-4030-bf95-2de3511fe619 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:48.012856 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f2d997ee-b34a-4030-bf95-2de3511fe619 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:48.013341 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f2d997ee-b34a-4030-bf95-2de3511fe619 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:48.014045 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f2d997ee-b34a-4030-bf95-2de3511fe619 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:48.014509 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f2d997ee-b34a-4030-bf95-2de3511fe619 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:48.014946 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f2d997ee-b34a-4030-bf95-2de3511fe619 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:48.048536 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-f2d997ee-b34a-4030-bf95-2de3511fe619 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] 10.222.0.43 "GET /compute/v2.1/servers/afccf704-642d-4ef9-bccb-c6a74410be96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049555 Oct 04 19:40:48.049238 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3519/7410] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Oct 4 19:40:47 2022] GET /compute/v2.1/servers/afccf704-642d-4ef9-bccb-c6a74410be96/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:40:49.062188 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-88e0447a-8747-4d60-b219-9d487c0170db tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:40:49.064366 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-88e0447a-8747-4d60-b219-9d487c0170db tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] [instance: afccf704-642d-4ef9-bccb-c6a74410be96] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:40:49.071420 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-88e0447a-8747-4d60-b219-9d487c0170db tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:49.071920 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-88e0447a-8747-4d60-b219-9d487c0170db tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:49.072390 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-88e0447a-8747-4d60-b219-9d487c0170db tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:49.073091 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-88e0447a-8747-4d60-b219-9d487c0170db tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:49.073585 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-88e0447a-8747-4d60-b219-9d487c0170db tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:49.074031 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-88e0447a-8747-4d60-b219-9d487c0170db tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:49.105452 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-88e0447a-8747-4d60-b219-9d487c0170db tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] 10.222.0.43 "GET /compute/v2.1/servers/afccf704-642d-4ef9-bccb-c6a74410be96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047454 Oct 04 19:40:49.106024 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3892/7411] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Oct 4 19:40:49 2022] GET /compute/v2.1/servers/afccf704-642d-4ef9-bccb-c6a74410be96/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:40:50.118124 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-2d744805-c566-439f-9541-62276eb8c926 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:40:50.120864 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-2d744805-c566-439f-9541-62276eb8c926 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] [instance: afccf704-642d-4ef9-bccb-c6a74410be96] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:40:50.127709 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2d744805-c566-439f-9541-62276eb8c926 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:50.128202 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2d744805-c566-439f-9541-62276eb8c926 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:50.128652 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2d744805-c566-439f-9541-62276eb8c926 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:50.129383 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2d744805-c566-439f-9541-62276eb8c926 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:50.129849 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2d744805-c566-439f-9541-62276eb8c926 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:50.130284 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2d744805-c566-439f-9541-62276eb8c926 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:50.159825 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-2d744805-c566-439f-9541-62276eb8c926 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] 10.222.0.43 "GET /compute/v2.1/servers/afccf704-642d-4ef9-bccb-c6a74410be96/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045826 Oct 04 19:40:50.160379 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3520/7412] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Oct 4 19:40:50 2022] GET /compute/v2.1/servers/afccf704-642d-4ef9-bccb-c6a74410be96/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 19:40:50.171000 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-a78d5b5d-5897-4989-a233-f90fbaa8806b tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:40:50.171516 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-a78d5b5d-5897-4989-a233-f90fbaa8806b tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] [instance: afccf704-642d-4ef9-bccb-c6a74410be96] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:40:50.178416 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a78d5b5d-5897-4989-a233-f90fbaa8806b tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:50.178920 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a78d5b5d-5897-4989-a233-f90fbaa8806b tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:50.179369 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a78d5b5d-5897-4989-a233-f90fbaa8806b tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:50.180077 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a78d5b5d-5897-4989-a233-f90fbaa8806b tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:50.180541 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a78d5b5d-5897-4989-a233-f90fbaa8806b tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:50.180983 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a78d5b5d-5897-4989-a233-f90fbaa8806b tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:50.256906 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-a78d5b5d-5897-4989-a233-f90fbaa8806b tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] HTTP exception thrown: Instance afccf704-642d-4ef9-bccb-c6a74410be96 is not attached to volume 84f59930-2b40-4b19-8894-a4b8697deff9 Oct 04 19:40:50.262869 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-a78d5b5d-5897-4989-a233-f90fbaa8806b tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Request method failure captured: Oct 04 19:40:50.262869 n-d-851028-13 devstack@n-api.service[123596]: request: DELETE /compute/v2.1/servers/afccf704-642d-4ef9-bccb-c6a74410be96/os-volume_attachments/84f59930-2b40-4b19-8894-a4b8697deff9 HTTP/1.1 Oct 04 19:40:50.262869 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 19:40:50.262869 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 19:40:50.262869 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 19:40:50.262869 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 19:40:50.262869 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 19:40:50.262869 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 19:40:50.262869 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 19:40:50.262869 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 19:40:50.262869 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPIwgzYs4Qra3hBEV8yjoWKsOAEjSpqgTBwAVG3B_WdXGWjlSlsFSZK0zAWIYhYfyK9adIbntSb0OjMfzjP2rVmb8o93F7lb_vs4sYKuYVDdla1ygG_Vmlidd_igJmhLBbk5wMB6IaUMXeikg8dsZg9nDs1joViw1xmjsSf7IBIPIrRc Oct 04 19:40:50.262869 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 19:40:50.262869 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 19:40:50.262869 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 19:40:50.262869 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 19:40:50.262869 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 19:40:50.262869 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 19:40:50.262869 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: a14c17efe9404d6bb455d5dcc8b2c3c4 Oct 04 19:40:50.262869 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-TestEncryptedCinderVolumes-15666215 Oct 04 19:40:50.262869 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 19:40:50.262869 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 19:40:50.262869 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/a14c17efe9404d6bb455d5dcc8b2c3c4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_a14c17efe9404d6bb455d5dcc8b2c3c4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a14c17efe9404d6bb455d5dcc8b2c3c4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a14c17efe9404d6bb455d5dcc8b2c3c4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 19:40:50.262869 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-TestEncryptedCinderVolumes-15666215 Oct 04 19:40:50.262869 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: a14c17efe9404d6bb455d5dcc8b2c3c4 Oct 04 19:40:50.262869 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-15666215 Oct 04 19:40:50.262869 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-TestEncryptedCinderVolumes-15666215-project Oct 04 19:40:50.262869 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 19:40:50.262869 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 19:40:50.262869 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: fdd88e4643894b5dac67db4cb49c665b Oct 04 19:40:50.262869 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-TestEncryptedCinderVolumes-15666215-project Oct 04 19:40:50.262869 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 19:40:50.262869 n-d-851028-13 devstack@n-api.service[123596]: exception: Instance afccf704-642d-4ef9-bccb-c6a74410be96 is not attached to volume 84f59930-2b40-4b19-8894-a4b8697deff9 Oct 04 19:40:50.262869 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'server_id': 'afccf704-642d-4ef9-bccb-c6a74410be96', 'id': '84f59930-2b40-4b19-8894-a4b8697deff9'} Oct 04 19:40:50.262869 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:40:50.262869 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:40:50.262869 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 04 19:40:50.262869 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 04 19:40:50.262869 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 19:40:50.262869 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 19:40:50.262869 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 04 19:40:50.262869 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 04 19:40:50.262869 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 84f59930-2b40-4b19-8894-a4b8697deff9. Oct 04 19:40:50.262869 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:40:50.262869 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:40:50.262869 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:40:50.262869 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:40:50.262869 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:40:50.262869 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:40:50.262869 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:40:50.262869 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:40:50.262869 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:40:50.262869 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:40:50.262869 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 04 19:40:50.262869 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 04 19:40:50.262869 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance afccf704-642d-4ef9-bccb-c6a74410be96 is not attached to volume 84f59930-2b40-4b19-8894-a4b8697deff9 Oct 04 19:40:50.262869 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:40:50.262869 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:40:50.262869 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:40:50.262869 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:40:50.262869 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:40:50.262869 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:40:50.267282 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:40:50.267282 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:40:50.267282 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance afccf704-642d-4ef9-bccb-c6a74410be96 is not attached to volume 84f59930-2b40-4b19-8894-a4b8697deff9 Oct 04 19:40:50.267282 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:40:50.267282 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-a78d5b5d-5897-4989-a233-f90fbaa8806b tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Returning 404 to user: Instance afccf704-642d-4ef9-bccb-c6a74410be96 is not attached to volume 84f59930-2b40-4b19-8894-a4b8697deff9 {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:40:50.267282 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-a78d5b5d-5897-4989-a233-f90fbaa8806b tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] 10.222.0.43 "DELETE /compute/v2.1/servers/afccf704-642d-4ef9-bccb-c6a74410be96/os-volume_attachments/84f59930-2b40-4b19-8894-a4b8697deff9" status: 404 len: 154 microversion: 2.1 time: 0.097359 Oct 04 19:40:50.267282 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3893/7413] 10.222.0.43 () {58 vars in 1416 bytes} [Tue Oct 4 19:40:50 2022] DELETE /compute/v2.1/servers/afccf704-642d-4ef9-bccb-c6a74410be96/os-volume_attachments/84f59930-2b40-4b19-8894-a4b8697deff9 => generated 154 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:40:53.619091 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-252a3c1a-1ae1-4a64-8e8c-c318ec8b9c5a tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:40:53.619905 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-252a3c1a-1ae1-4a64-8e8c-c318ec8b9c5a tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] [instance: afccf704-642d-4ef9-bccb-c6a74410be96] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:40:53.630709 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-252a3c1a-1ae1-4a64-8e8c-c318ec8b9c5a tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:53.631456 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-252a3c1a-1ae1-4a64-8e8c-c318ec8b9c5a tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:53.632220 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-252a3c1a-1ae1-4a64-8e8c-c318ec8b9c5a tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:53.633364 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-252a3c1a-1ae1-4a64-8e8c-c318ec8b9c5a tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:53.634082 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-252a3c1a-1ae1-4a64-8e8c-c318ec8b9c5a tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:53.634533 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-252a3c1a-1ae1-4a64-8e8c-c318ec8b9c5a tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:53.672620 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-252a3c1a-1ae1-4a64-8e8c-c318ec8b9c5a tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] [instance: afccf704-642d-4ef9-bccb-c6a74410be96] Going to try to terminate instance {{(pid=123595) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 19:40:53.757317 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-252a3c1a-1ae1-4a64-8e8c-c318ec8b9c5a tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] 10.222.0.43 "DELETE /compute/v2.1/servers/afccf704-642d-4ef9-bccb-c6a74410be96" status: 204 len: 0 microversion: 2.1 time: 0.144160 Oct 04 19:40:53.761253 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3521/7414] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 19:40:53 2022] DELETE /compute/v2.1/servers/afccf704-642d-4ef9-bccb-c6a74410be96 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:40:53.766620 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-9d4a6975-b008-4248-b8fa-54b179d2d027 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:40:53.767329 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-9d4a6975-b008-4248-b8fa-54b179d2d027 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] [instance: afccf704-642d-4ef9-bccb-c6a74410be96] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:40:53.775214 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9d4a6975-b008-4248-b8fa-54b179d2d027 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:53.775956 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9d4a6975-b008-4248-b8fa-54b179d2d027 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:53.777048 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9d4a6975-b008-4248-b8fa-54b179d2d027 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:53.777858 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9d4a6975-b008-4248-b8fa-54b179d2d027 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:53.778398 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9d4a6975-b008-4248-b8fa-54b179d2d027 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:53.778910 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9d4a6975-b008-4248-b8fa-54b179d2d027 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:53.915252 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-9d4a6975-b008-4248-b8fa-54b179d2d027 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdd88e4643894b5dac67db4cb49c665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14c17efe9404d6bb455d5dcc8b2c3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:40:53.923945 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-9d4a6975-b008-4248-b8fa-54b179d2d027 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] 10.222.0.43 "GET /compute/v2.1/servers/afccf704-642d-4ef9-bccb-c6a74410be96" status: 200 len: 1560 microversion: 2.1 time: 0.161139 Oct 04 19:40:53.924524 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3894/7415] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:40:53 2022] GET /compute/v2.1/servers/afccf704-642d-4ef9-bccb-c6a74410be96 => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:40:54.947694 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-1e9530c3-ff13-4f04-8071-1dddaa2edf4d tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:40:54.948427 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-1e9530c3-ff13-4f04-8071-1dddaa2edf4d tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] [instance: afccf704-642d-4ef9-bccb-c6a74410be96] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:40:54.955403 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1e9530c3-ff13-4f04-8071-1dddaa2edf4d tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:54.955924 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1e9530c3-ff13-4f04-8071-1dddaa2edf4d tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:54.956373 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1e9530c3-ff13-4f04-8071-1dddaa2edf4d tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:54.957074 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1e9530c3-ff13-4f04-8071-1dddaa2edf4d tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:54.957561 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1e9530c3-ff13-4f04-8071-1dddaa2edf4d tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:54.957990 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1e9530c3-ff13-4f04-8071-1dddaa2edf4d tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:55.093467 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-1e9530c3-ff13-4f04-8071-1dddaa2edf4d tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdd88e4643894b5dac67db4cb49c665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14c17efe9404d6bb455d5dcc8b2c3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:40:55.101957 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-1e9530c3-ff13-4f04-8071-1dddaa2edf4d tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] 10.222.0.43 "GET /compute/v2.1/servers/afccf704-642d-4ef9-bccb-c6a74410be96" status: 200 len: 1560 microversion: 2.1 time: 0.158594 Oct 04 19:40:55.102540 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3522/7416] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:40:54 2022] GET /compute/v2.1/servers/afccf704-642d-4ef9-bccb-c6a74410be96 => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:40:55.946972 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-7d7db2d5-7629-4a3b-b35c-f1a3d605b396 req-2a0ca726-5b86-4c0a-bbd4-931c16f317b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afccf704-642d-4ef9-bccb-c6a74410be96", "name": "network-vif-deleted", "tag": "a87fb5de-00e6-4f70-b3e4-6cb6e5361a8e"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:40:55.965311 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-7d7db2d5-7629-4a3b-b35c-f1a3d605b396 req-2a0ca726-5b86-4c0a-bbd4-931c16f317b3 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:55.965831 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-7d7db2d5-7629-4a3b-b35c-f1a3d605b396 req-2a0ca726-5b86-4c0a-bbd4-931c16f317b3 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:55.966321 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-7d7db2d5-7629-4a3b-b35c-f1a3d605b396 req-2a0ca726-5b86-4c0a-bbd4-931c16f317b3 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:55.980456 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-7d7db2d5-7629-4a3b-b35c-f1a3d605b396 req-2a0ca726-5b86-4c0a-bbd4-931c16f317b3 service nova] Creating event network-vif-deleted:a87fb5de-00e6-4f70-b3e4-6cb6e5361a8e for instance afccf704-642d-4ef9-bccb-c6a74410be96 on n-h1-851028-13 Oct 04 19:40:55.987511 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-7d7db2d5-7629-4a3b-b35c-f1a3d605b396 req-2a0ca726-5b86-4c0a-bbd4-931c16f317b3 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044543 Oct 04 19:40:55.989237 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3895/7417] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:40:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:40:56.125027 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-0b8c604c-a0d6-4839-a42e-0418c7d16be6 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:40:56.125690 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-0b8c604c-a0d6-4839-a42e-0418c7d16be6 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] [instance: afccf704-642d-4ef9-bccb-c6a74410be96] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:40:56.132713 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0b8c604c-a0d6-4839-a42e-0418c7d16be6 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:56.133270 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0b8c604c-a0d6-4839-a42e-0418c7d16be6 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:56.133699 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0b8c604c-a0d6-4839-a42e-0418c7d16be6 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:56.134394 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0b8c604c-a0d6-4839-a42e-0418c7d16be6 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:56.134845 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0b8c604c-a0d6-4839-a42e-0418c7d16be6 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:56.135308 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0b8c604c-a0d6-4839-a42e-0418c7d16be6 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:56.167343 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0b8c604c-a0d6-4839-a42e-0418c7d16be6 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:56.167825 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0b8c604c-a0d6-4839-a42e-0418c7d16be6 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:56.168260 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0b8c604c-a0d6-4839-a42e-0418c7d16be6 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:56.168707 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.objects.instance [None req-0b8c604c-a0d6-4839-a42e-0418c7d16be6 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lazy-loading 'fault' on Instance uuid afccf704-642d-4ef9-bccb-c6a74410be96 {{(pid=123595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 19:40:56.209092 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-0b8c604c-a0d6-4839-a42e-0418c7d16be6 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdd88e4643894b5dac67db4cb49c665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14c17efe9404d6bb455d5dcc8b2c3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:40:56.216997 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-0b8c604c-a0d6-4839-a42e-0418c7d16be6 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] 10.222.0.43 "GET /compute/v2.1/servers/afccf704-642d-4ef9-bccb-c6a74410be96" status: 200 len: 1353 microversion: 2.1 time: 0.095899 Oct 04 19:40:56.217590 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3523/7418] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:40:56 2022] GET /compute/v2.1/servers/afccf704-642d-4ef9-bccb-c6a74410be96 => generated 1353 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:40:57.241508 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-c97e947f-5c00-44e2-be52-5961a5b06312 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:40:57.242261 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-c97e947f-5c00-44e2-be52-5961a5b06312 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] [instance: afccf704-642d-4ef9-bccb-c6a74410be96] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:40:57.248488 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c97e947f-5c00-44e2-be52-5961a5b06312 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:57.248994 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c97e947f-5c00-44e2-be52-5961a5b06312 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:57.249476 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c97e947f-5c00-44e2-be52-5961a5b06312 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:57.250187 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c97e947f-5c00-44e2-be52-5961a5b06312 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:57.250662 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c97e947f-5c00-44e2-be52-5961a5b06312 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:57.251109 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c97e947f-5c00-44e2-be52-5961a5b06312 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:57.264909 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-c97e947f-5c00-44e2-be52-5961a5b06312 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] HTTP exception thrown: Instance afccf704-642d-4ef9-bccb-c6a74410be96 could not be found. Oct 04 19:40:57.266550 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-c97e947f-5c00-44e2-be52-5961a5b06312 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Request method failure captured: Oct 04 19:40:57.266550 n-d-851028-13 devstack@n-api.service[123596]: request: GET /compute/v2.1/servers/afccf704-642d-4ef9-bccb-c6a74410be96 HTTP/1.1 Oct 04 19:40:57.266550 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 19:40:57.266550 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 19:40:57.266550 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 19:40:57.266550 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 19:40:57.266550 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 19:40:57.266550 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 19:40:57.266550 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 19:40:57.266550 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 19:40:57.266550 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPIwgzYs4Qra3hBEV8yjoWKsOAEjSpqgTBwAVG3B_WdXGWjlSlsFSZK0zAWIYhYfyK9adIbntSb0OjMfzjP2rVmb8o93F7lb_vs4sYKuYVDdla1ygG_Vmlidd_igJmhLBbk5wMB6IaUMXeikg8dsZg9nDs1joViw1xmjsSf7IBIPIrRc Oct 04 19:40:57.266550 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 19:40:57.266550 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 19:40:57.266550 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 19:40:57.266550 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 19:40:57.266550 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 19:40:57.266550 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 19:40:57.266550 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: a14c17efe9404d6bb455d5dcc8b2c3c4 Oct 04 19:40:57.266550 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-TestEncryptedCinderVolumes-15666215 Oct 04 19:40:57.266550 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 19:40:57.266550 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 19:40:57.266550 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/a14c17efe9404d6bb455d5dcc8b2c3c4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_a14c17efe9404d6bb455d5dcc8b2c3c4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a14c17efe9404d6bb455d5dcc8b2c3c4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a14c17efe9404d6bb455d5dcc8b2c3c4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 19:40:57.266550 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-TestEncryptedCinderVolumes-15666215 Oct 04 19:40:57.266550 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: a14c17efe9404d6bb455d5dcc8b2c3c4 Oct 04 19:40:57.266550 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-15666215 Oct 04 19:40:57.266550 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-TestEncryptedCinderVolumes-15666215-project Oct 04 19:40:57.266550 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 19:40:57.266550 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 19:40:57.266550 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: fdd88e4643894b5dac67db4cb49c665b Oct 04 19:40:57.266550 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-TestEncryptedCinderVolumes-15666215-project Oct 04 19:40:57.266550 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 19:40:57.266550 n-d-851028-13 devstack@n-api.service[123596]: exception: Instance afccf704-642d-4ef9-bccb-c6a74410be96 could not be found. Oct 04 19:40:57.266550 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': 'afccf704-642d-4ef9-bccb-c6a74410be96'} Oct 04 19:40:57.266550 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:40:57.266550 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:40:57.266550 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:40:57.266550 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:40:57.266550 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:40:57.266550 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:40:57.266550 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:40:57.266550 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:40:57.266550 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:40:57.266550 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:40:57.266550 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance afccf704-642d-4ef9-bccb-c6a74410be96 could not be found. Oct 04 19:40:57.266550 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:40:57.266550 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:40:57.266550 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:40:57.266550 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:40:57.266550 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:40:57.266550 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:40:57.266550 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:40:57.266550 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:40:57.266550 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:40:57.266550 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:40:57.266550 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:40:57.266550 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:40:57.266550 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:40:57.266550 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:40:57.266550 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:40:57.266550 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:40:57.266550 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance afccf704-642d-4ef9-bccb-c6a74410be96 could not be found. Oct 04 19:40:57.266550 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:40:57.266550 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:40:57.266550 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:40:57.271271 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:40:57.271271 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:40:57.271271 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:40:57.271271 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:40:57.271271 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:40:57.271271 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance afccf704-642d-4ef9-bccb-c6a74410be96 could not be found. Oct 04 19:40:57.271271 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:40:57.271271 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-c97e947f-5c00-44e2-be52-5961a5b06312 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Returning 404 to user: Instance afccf704-642d-4ef9-bccb-c6a74410be96 could not be found. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:40:57.271271 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-c97e947f-5c00-44e2-be52-5961a5b06312 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] 10.222.0.43 "GET /compute/v2.1/servers/afccf704-642d-4ef9-bccb-c6a74410be96" status: 404 len: 111 microversion: 2.1 time: 0.031721 Oct 04 19:40:57.271271 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3896/7419] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:40:57 2022] GET /compute/v2.1/servers/afccf704-642d-4ef9-bccb-c6a74410be96 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:40:57.277609 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-fe87e545-ee37-456b-8707-128da38d7726 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Calling method '.version_select at 0x7fb21f8f34c0>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:40:57.302156 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-fe87e545-ee37-456b-8707-128da38d7726 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1897534474" status: 202 len: 0 microversion: 2.1 time: 0.029088 Oct 04 19:40:57.302733 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3524/7420] 10.222.0.43 () {58 vars in 1278 bytes} [Tue Oct 4 19:40:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1897534474 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 19:40:57.319416 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-e83fbe41-923e-490b-bab9-a7c29ee45292 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Action: 'create', calling method: .version_select at 0x7fb21e5e6a60>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-788100401", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMk6sT0zfP3J2RHgpH+W1ZFQSDLt4T9Bm9N2brq4pyE+JcEnsdQDiQCgenl2lswq6xewlms8wO9Oog2b8y0toZVa2y9e/E7vLm2j3YRhEtBuuHMqp5RpHQ/eeABNuE27IQ=="}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:40:57.335155 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-e83fbe41-923e-490b-bab9-a7c29ee45292 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Getting quotas for project a14c17efe9404d6bb455d5dcc8b2c3c4. Resources: {'key_pairs'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:40:57.341848 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-e83fbe41-923e-490b-bab9-a7c29ee45292 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Getting quotas for user fdd88e4643894b5dac67db4cb49c665b and project a14c17efe9404d6bb455d5dcc8b2c3c4. Resources: {'key_pairs'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:40:57.364483 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-e83fbe41-923e-490b-bab9-a7c29ee45292 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.048949 Oct 04 19:40:57.365081 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3897/7421] 10.222.0.43 () {60 vars in 1159 bytes} [Tue Oct 4 19:40:57 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:40:57.414987 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-bec0871a-7a97-43c5-815b-ee4d96ddfee0 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1652101776", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-788100401", "networks": [{"uuid": "28c02d60-66d8-40f0-a6d3-89b685207981"}]}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:40:57.471327 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.network.neutron [None req-bec0871a-7a97-43c5-815b-ee4d96ddfee0 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] validate_networks() for [('28c02d60-66d8-40f0-a6d3-89b685207981', None, None, None, None, None)] {{(pid=123595) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 19:40:57.839959 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-bec0871a-7a97-43c5-815b-ee4d96ddfee0 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Flavor limits 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:40:57.840395 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-bec0871a-7a97-43c5-815b-ee4d96ddfee0 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Image limits 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:40:57.840920 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-bec0871a-7a97-43c5-815b-ee4d96ddfee0 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Flavor pref 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:40:57.841370 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-bec0871a-7a97-43c5-815b-ee4d96ddfee0 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Image pref 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:40:57.841798 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-bec0871a-7a97-43c5-815b-ee4d96ddfee0 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:40:57.850601 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bec0871a-7a97-43c5-815b-ee4d96ddfee0 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:57.851094 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bec0871a-7a97-43c5-815b-ee4d96ddfee0 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:57.851545 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bec0871a-7a97-43c5-815b-ee4d96ddfee0 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:57.852286 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bec0871a-7a97-43c5-815b-ee4d96ddfee0 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:57.852748 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bec0871a-7a97-43c5-815b-ee4d96ddfee0 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:57.853213 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bec0871a-7a97-43c5-815b-ee4d96ddfee0 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:57.871535 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-bec0871a-7a97-43c5-815b-ee4d96ddfee0 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Getting quotas for project a14c17efe9404d6bb455d5dcc8b2c3c4. Resources: {'ram', 'cores', 'instances'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:40:57.876732 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-bec0871a-7a97-43c5-815b-ee4d96ddfee0 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Getting quotas for user fdd88e4643894b5dac67db4cb49c665b and project a14c17efe9404d6bb455d5dcc8b2c3c4. Resources: {'ram', 'cores', 'instances'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:40:57.889279 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-bec0871a-7a97-43c5-815b-ee4d96ddfee0 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Going to run 1 instances... {{(pid=123595) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 19:40:57.891607 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-bec0871a-7a97-43c5-815b-ee4d96ddfee0 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] [instance: a4e3f797-f506-4c5e-ad79-2dbe8ccbd66d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e8943ec5-4038-4d4b-b9b9-2415a79f5243',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 19:40:57.940832 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-bec0871a-7a97-43c5-815b-ee4d96ddfee0 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.529461 Oct 04 19:40:57.941905 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3525/7422] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 19:40:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 531 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 19:40:57.953160 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-8379606e-7466-4924-ab5a-65176ce1db7b tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:40:57.953797 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-8379606e-7466-4924-ab5a-65176ce1db7b tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] [instance: a4e3f797-f506-4c5e-ad79-2dbe8ccbd66d] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:40:58.008868 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-8379606e-7466-4924-ab5a-65176ce1db7b tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdd88e4643894b5dac67db4cb49c665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14c17efe9404d6bb455d5dcc8b2c3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:40:58.015806 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-8379606e-7466-4924-ab5a-65176ce1db7b tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] 10.222.0.43 "GET /compute/v2.1/servers/a4e3f797-f506-4c5e-ad79-2dbe8ccbd66d" status: 200 len: 1262 microversion: 2.1 time: 0.066639 Oct 04 19:40:58.016377 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3898/7423] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:40:57 2022] GET /compute/v2.1/servers/a4e3f797-f506-4c5e-ad79-2dbe8ccbd66d => generated 1262 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:40:59.040082 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-5b341f9d-0db5-4949-a3fc-c5a101a5b0d1 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:40:59.040684 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-5b341f9d-0db5-4949-a3fc-c5a101a5b0d1 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] [instance: a4e3f797-f506-4c5e-ad79-2dbe8ccbd66d] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:40:59.056006 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5b341f9d-0db5-4949-a3fc-c5a101a5b0d1 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:59.056578 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5b341f9d-0db5-4949-a3fc-c5a101a5b0d1 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:59.057183 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5b341f9d-0db5-4949-a3fc-c5a101a5b0d1 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:59.058703 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5b341f9d-0db5-4949-a3fc-c5a101a5b0d1 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:59.059014 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5b341f9d-0db5-4949-a3fc-c5a101a5b0d1 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:59.059508 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5b341f9d-0db5-4949-a3fc-c5a101a5b0d1 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:59.125238 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-5b341f9d-0db5-4949-a3fc-c5a101a5b0d1 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdd88e4643894b5dac67db4cb49c665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14c17efe9404d6bb455d5dcc8b2c3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:40:59.133276 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-5b341f9d-0db5-4949-a3fc-c5a101a5b0d1 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] 10.222.0.43 "GET /compute/v2.1/servers/a4e3f797-f506-4c5e-ad79-2dbe8ccbd66d" status: 200 len: 1320 microversion: 2.1 time: 0.098539 Oct 04 19:40:59.134099 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3526/7424] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:40:59 2022] GET /compute/v2.1/servers/a4e3f797-f506-4c5e-ad79-2dbe8ccbd66d => generated 1320 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:41:00.156509 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-ffbadba2-2bc8-469a-8774-b4e612c10d32 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:41:00.157058 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-ffbadba2-2bc8-469a-8774-b4e612c10d32 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] [instance: a4e3f797-f506-4c5e-ad79-2dbe8ccbd66d] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:41:00.163879 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ffbadba2-2bc8-469a-8774-b4e612c10d32 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:00.164581 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ffbadba2-2bc8-469a-8774-b4e612c10d32 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:00.165042 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ffbadba2-2bc8-469a-8774-b4e612c10d32 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:00.165797 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ffbadba2-2bc8-469a-8774-b4e612c10d32 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:00.166269 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ffbadba2-2bc8-469a-8774-b4e612c10d32 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:00.167215 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ffbadba2-2bc8-469a-8774-b4e612c10d32 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:00.395448 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-ffbadba2-2bc8-469a-8774-b4e612c10d32 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdd88e4643894b5dac67db4cb49c665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14c17efe9404d6bb455d5dcc8b2c3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:41:00.406118 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-ffbadba2-2bc8-469a-8774-b4e612c10d32 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] 10.222.0.43 "GET /compute/v2.1/servers/a4e3f797-f506-4c5e-ad79-2dbe8ccbd66d" status: 200 len: 1362 microversion: 2.1 time: 0.253588 Oct 04 19:41:00.406790 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3899/7425] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:41:00 2022] GET /compute/v2.1/servers/a4e3f797-f506-4c5e-ad79-2dbe8ccbd66d => generated 1362 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:41:00.639070 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-04fbb724-660a-49bd-bd2c-75cbfcce4ac9 req-2c56692b-0808-4230-8f66-bc25cd7d86ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4e3f797-f506-4c5e-ad79-2dbe8ccbd66d", "tag": "5448a954-45c4-4019-ae97-bfa4ffbd7a49"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:41:00.649246 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-04fbb724-660a-49bd-bd2c-75cbfcce4ac9 req-2c56692b-0808-4230-8f66-bc25cd7d86ed service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:00.649743 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-04fbb724-660a-49bd-bd2c-75cbfcce4ac9 req-2c56692b-0808-4230-8f66-bc25cd7d86ed service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:00.650188 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-04fbb724-660a-49bd-bd2c-75cbfcce4ac9 req-2c56692b-0808-4230-8f66-bc25cd7d86ed service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:00.663769 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-04fbb724-660a-49bd-bd2c-75cbfcce4ac9 req-2c56692b-0808-4230-8f66-bc25cd7d86ed service nova] Creating event network-changed:5448a954-45c4-4019-ae97-bfa4ffbd7a49 for instance a4e3f797-f506-4c5e-ad79-2dbe8ccbd66d on n-h1-851028-13 Oct 04 19:41:00.669849 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-04fbb724-660a-49bd-bd2c-75cbfcce4ac9 req-2c56692b-0808-4230-8f66-bc25cd7d86ed service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035159 Oct 04 19:41:00.670467 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3527/7426] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:41:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:41:01.430548 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-2dc9ee01-4092-47b1-a48e-4733a92a68fd tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:41:01.431217 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-2dc9ee01-4092-47b1-a48e-4733a92a68fd tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] [instance: a4e3f797-f506-4c5e-ad79-2dbe8ccbd66d] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:41:01.439350 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2dc9ee01-4092-47b1-a48e-4733a92a68fd tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:01.440135 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2dc9ee01-4092-47b1-a48e-4733a92a68fd tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:01.441045 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2dc9ee01-4092-47b1-a48e-4733a92a68fd tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:01.442176 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2dc9ee01-4092-47b1-a48e-4733a92a68fd tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:01.442666 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2dc9ee01-4092-47b1-a48e-4733a92a68fd tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:01.443189 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2dc9ee01-4092-47b1-a48e-4733a92a68fd tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:01.577103 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-2dc9ee01-4092-47b1-a48e-4733a92a68fd tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdd88e4643894b5dac67db4cb49c665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14c17efe9404d6bb455d5dcc8b2c3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:41:01.585966 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-2dc9ee01-4092-47b1-a48e-4733a92a68fd tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] 10.222.0.43 "GET /compute/v2.1/servers/a4e3f797-f506-4c5e-ad79-2dbe8ccbd66d" status: 200 len: 1362 microversion: 2.1 time: 0.158986 Oct 04 19:41:01.586551 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3900/7427] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:41:01 2022] GET /compute/v2.1/servers/a4e3f797-f506-4c5e-ad79-2dbe8ccbd66d => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:41:02.611093 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-f09b17cf-d0b0-4778-954b-d07b22b6ec70 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:41:02.611818 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-f09b17cf-d0b0-4778-954b-d07b22b6ec70 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] [instance: a4e3f797-f506-4c5e-ad79-2dbe8ccbd66d] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:41:02.618414 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f09b17cf-d0b0-4778-954b-d07b22b6ec70 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:02.618920 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f09b17cf-d0b0-4778-954b-d07b22b6ec70 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:02.619370 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f09b17cf-d0b0-4778-954b-d07b22b6ec70 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:02.620711 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f09b17cf-d0b0-4778-954b-d07b22b6ec70 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:02.621199 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f09b17cf-d0b0-4778-954b-d07b22b6ec70 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:02.621643 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f09b17cf-d0b0-4778-954b-d07b22b6ec70 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:02.753413 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-f09b17cf-d0b0-4778-954b-d07b22b6ec70 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdd88e4643894b5dac67db4cb49c665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14c17efe9404d6bb455d5dcc8b2c3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:41:02.761101 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-f09b17cf-d0b0-4778-954b-d07b22b6ec70 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] 10.222.0.43 "GET /compute/v2.1/servers/a4e3f797-f506-4c5e-ad79-2dbe8ccbd66d" status: 200 len: 1362 microversion: 2.1 time: 0.155207 Oct 04 19:41:02.761699 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3528/7428] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:41:02 2022] GET /compute/v2.1/servers/a4e3f797-f506-4c5e-ad79-2dbe8ccbd66d => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:41:03.784018 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-8ee60869-8f29-46e9-bb8a-7b892d3b1c56 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:41:03.784650 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-8ee60869-8f29-46e9-bb8a-7b892d3b1c56 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] [instance: a4e3f797-f506-4c5e-ad79-2dbe8ccbd66d] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:41:03.792092 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8ee60869-8f29-46e9-bb8a-7b892d3b1c56 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:03.792597 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8ee60869-8f29-46e9-bb8a-7b892d3b1c56 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:03.793055 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8ee60869-8f29-46e9-bb8a-7b892d3b1c56 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:03.793791 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8ee60869-8f29-46e9-bb8a-7b892d3b1c56 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:03.794265 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8ee60869-8f29-46e9-bb8a-7b892d3b1c56 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:03.794713 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8ee60869-8f29-46e9-bb8a-7b892d3b1c56 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:03.923123 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-8ee60869-8f29-46e9-bb8a-7b892d3b1c56 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdd88e4643894b5dac67db4cb49c665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14c17efe9404d6bb455d5dcc8b2c3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:41:03.931113 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-8ee60869-8f29-46e9-bb8a-7b892d3b1c56 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] 10.222.0.43 "GET /compute/v2.1/servers/a4e3f797-f506-4c5e-ad79-2dbe8ccbd66d" status: 200 len: 1362 microversion: 2.1 time: 0.151079 Oct 04 19:41:03.931696 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3901/7429] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:41:03 2022] GET /compute/v2.1/servers/a4e3f797-f506-4c5e-ad79-2dbe8ccbd66d => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:41:04.954942 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-32e65600-c094-4add-97da-2a65214e9ab1 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:41:04.955561 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-32e65600-c094-4add-97da-2a65214e9ab1 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] [instance: a4e3f797-f506-4c5e-ad79-2dbe8ccbd66d] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:41:04.962746 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-32e65600-c094-4add-97da-2a65214e9ab1 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:04.963230 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-32e65600-c094-4add-97da-2a65214e9ab1 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:04.963706 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-32e65600-c094-4add-97da-2a65214e9ab1 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:04.964395 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-32e65600-c094-4add-97da-2a65214e9ab1 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:04.964855 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-32e65600-c094-4add-97da-2a65214e9ab1 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:04.965338 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-32e65600-c094-4add-97da-2a65214e9ab1 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:05.097917 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-32e65600-c094-4add-97da-2a65214e9ab1 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdd88e4643894b5dac67db4cb49c665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14c17efe9404d6bb455d5dcc8b2c3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:41:05.105580 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-32e65600-c094-4add-97da-2a65214e9ab1 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] 10.222.0.43 "GET /compute/v2.1/servers/a4e3f797-f506-4c5e-ad79-2dbe8ccbd66d" status: 200 len: 1362 microversion: 2.1 time: 0.154534 Oct 04 19:41:05.106154 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3529/7430] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:41:04 2022] GET /compute/v2.1/servers/a4e3f797-f506-4c5e-ad79-2dbe8ccbd66d => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:41:05.793689 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-6466ae89-11a6-42e7-9849-7714288dadeb req-bef700a7-a179-4718-9f76-4576b113d717 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4e3f797-f506-4c5e-ad79-2dbe8ccbd66d", "name": "network-vif-plugged", "status": "completed", "tag": "5448a954-45c4-4019-ae97-bfa4ffbd7a49"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:41:05.803360 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-6466ae89-11a6-42e7-9849-7714288dadeb req-bef700a7-a179-4718-9f76-4576b113d717 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:05.803864 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-6466ae89-11a6-42e7-9849-7714288dadeb req-bef700a7-a179-4718-9f76-4576b113d717 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:05.804318 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-6466ae89-11a6-42e7-9849-7714288dadeb req-bef700a7-a179-4718-9f76-4576b113d717 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:05.815691 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-6466ae89-11a6-42e7-9849-7714288dadeb req-bef700a7-a179-4718-9f76-4576b113d717 service nova] Creating event network-vif-plugged:5448a954-45c4-4019-ae97-bfa4ffbd7a49 for instance a4e3f797-f506-4c5e-ad79-2dbe8ccbd66d on n-h1-851028-13 Oct 04 19:41:05.821099 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-6466ae89-11a6-42e7-9849-7714288dadeb req-bef700a7-a179-4718-9f76-4576b113d717 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091534 Oct 04 19:41:05.821732 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3902/7431] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:41:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:41:06.127846 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-b0f0ee6e-f4d8-42c8-957d-78ad0c411256 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:41:06.128471 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-b0f0ee6e-f4d8-42c8-957d-78ad0c411256 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] [instance: a4e3f797-f506-4c5e-ad79-2dbe8ccbd66d] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:41:06.135884 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b0f0ee6e-f4d8-42c8-957d-78ad0c411256 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:06.136373 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b0f0ee6e-f4d8-42c8-957d-78ad0c411256 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:06.136821 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b0f0ee6e-f4d8-42c8-957d-78ad0c411256 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:06.137572 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b0f0ee6e-f4d8-42c8-957d-78ad0c411256 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:06.138038 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b0f0ee6e-f4d8-42c8-957d-78ad0c411256 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:06.138475 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b0f0ee6e-f4d8-42c8-957d-78ad0c411256 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:06.263689 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-b0f0ee6e-f4d8-42c8-957d-78ad0c411256 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdd88e4643894b5dac67db4cb49c665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14c17efe9404d6bb455d5dcc8b2c3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:41:06.271616 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-b0f0ee6e-f4d8-42c8-957d-78ad0c411256 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] 10.222.0.43 "GET /compute/v2.1/servers/a4e3f797-f506-4c5e-ad79-2dbe8ccbd66d" status: 200 len: 1362 microversion: 2.1 time: 0.147697 Oct 04 19:41:06.272193 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3530/7432] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:41:06 2022] GET /compute/v2.1/servers/a4e3f797-f506-4c5e-ad79-2dbe8ccbd66d => generated 1362 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:41:07.296586 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-937cba87-5eac-4656-b222-ff564031bc5c tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:41:07.297363 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-937cba87-5eac-4656-b222-ff564031bc5c tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] [instance: a4e3f797-f506-4c5e-ad79-2dbe8ccbd66d] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:41:07.303691 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-937cba87-5eac-4656-b222-ff564031bc5c tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:07.304139 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-937cba87-5eac-4656-b222-ff564031bc5c tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:07.304611 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-937cba87-5eac-4656-b222-ff564031bc5c tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:07.305352 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-937cba87-5eac-4656-b222-ff564031bc5c tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:07.305829 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-937cba87-5eac-4656-b222-ff564031bc5c tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:07.306282 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-937cba87-5eac-4656-b222-ff564031bc5c tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:07.437133 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-937cba87-5eac-4656-b222-ff564031bc5c tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdd88e4643894b5dac67db4cb49c665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14c17efe9404d6bb455d5dcc8b2c3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:41:07.445135 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-937cba87-5eac-4656-b222-ff564031bc5c tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] 10.222.0.43 "GET /compute/v2.1/servers/a4e3f797-f506-4c5e-ad79-2dbe8ccbd66d" status: 200 len: 1553 microversion: 2.1 time: 0.153761 Oct 04 19:41:07.445724 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3903/7433] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:41:07 2022] GET /compute/v2.1/servers/a4e3f797-f506-4c5e-ad79-2dbe8ccbd66d => generated 1553 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:41:07.468668 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-5eae8d8a-77f1-47ed-93fa-88cfd8327c37 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:41:07.469337 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-5eae8d8a-77f1-47ed-93fa-88cfd8327c37 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] [instance: a4e3f797-f506-4c5e-ad79-2dbe8ccbd66d] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:41:07.476362 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5eae8d8a-77f1-47ed-93fa-88cfd8327c37 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:07.476887 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5eae8d8a-77f1-47ed-93fa-88cfd8327c37 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:07.477358 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5eae8d8a-77f1-47ed-93fa-88cfd8327c37 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:07.478061 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5eae8d8a-77f1-47ed-93fa-88cfd8327c37 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:07.478522 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5eae8d8a-77f1-47ed-93fa-88cfd8327c37 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:07.478956 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5eae8d8a-77f1-47ed-93fa-88cfd8327c37 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:07.608215 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-5eae8d8a-77f1-47ed-93fa-88cfd8327c37 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdd88e4643894b5dac67db4cb49c665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14c17efe9404d6bb455d5dcc8b2c3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:41:07.616083 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-5eae8d8a-77f1-47ed-93fa-88cfd8327c37 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] 10.222.0.43 "GET /compute/v2.1/servers/a4e3f797-f506-4c5e-ad79-2dbe8ccbd66d" status: 200 len: 1553 microversion: 2.1 time: 0.151459 Oct 04 19:41:07.616684 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3531/7434] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:41:07 2022] GET /compute/v2.1/servers/a4e3f797-f506-4c5e-ad79-2dbe8ccbd66d => generated 1553 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:41:09.107211 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-2de335b6-224d-4e95-b510-ad8e8622439d tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f4ce9f64-a0ed-4057-b6bb-e6cc222d5680"}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:41:09.109721 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-2de335b6-224d-4e95-b510-ad8e8622439d tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] [instance: a4e3f797-f506-4c5e-ad79-2dbe8ccbd66d] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:41:09.112071 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=6 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:41:09.118468 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2de335b6-224d-4e95-b510-ad8e8622439d tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:09.118976 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2de335b6-224d-4e95-b510-ad8e8622439d tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:09.120103 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2de335b6-224d-4e95-b510-ad8e8622439d tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:09.120863 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2de335b6-224d-4e95-b510-ad8e8622439d tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:09.121371 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2de335b6-224d-4e95-b510-ad8e8622439d tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:09.121824 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2de335b6-224d-4e95-b510-ad8e8622439d tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:09.356479 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-2de335b6-224d-4e95-b510-ad8e8622439d tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] 10.222.0.43 "POST /compute/v2.1/servers/a4e3f797-f506-4c5e-ad79-2dbe8ccbd66d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.253586 Oct 04 19:41:09.357068 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3904/7435] 10.222.0.43 () {60 vars in 1323 bytes} [Tue Oct 4 19:41:09 2022] POST /compute/v2.1/servers/a4e3f797-f506-4c5e-ad79-2dbe8ccbd66d/os-volume_attachments => generated 194 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:41:20.058517 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-c3597181-9e1e-4112-b37b-6677d6d80e16 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:41:20.059020 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-c3597181-9e1e-4112-b37b-6677d6d80e16 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] [instance: a4e3f797-f506-4c5e-ad79-2dbe8ccbd66d] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:41:20.061024 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=2 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:41:20.061725 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=6 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:41:20.063479 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:41:20.064241 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=89,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:41:20.071464 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c3597181-9e1e-4112-b37b-6677d6d80e16 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:20.071963 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c3597181-9e1e-4112-b37b-6677d6d80e16 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:20.072412 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c3597181-9e1e-4112-b37b-6677d6d80e16 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:20.073148 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c3597181-9e1e-4112-b37b-6677d6d80e16 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:20.073614 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c3597181-9e1e-4112-b37b-6677d6d80e16 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:20.074051 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c3597181-9e1e-4112-b37b-6677d6d80e16 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:20.157301 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.objects.instance [None req-c3597181-9e1e-4112-b37b-6677d6d80e16 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lazy-loading 'services' on Instance uuid a4e3f797-f506-4c5e-ad79-2dbe8ccbd66d {{(pid=123595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 19:41:20.235336 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-c3597181-9e1e-4112-b37b-6677d6d80e16 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] 10.222.0.43 "DELETE /compute/v2.1/servers/a4e3f797-f506-4c5e-ad79-2dbe8ccbd66d/os-volume_attachments/f4ce9f64-a0ed-4057-b6bb-e6cc222d5680" status: 202 len: 0 microversion: 2.1 time: 0.180759 Oct 04 19:41:20.235979 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3532/7436] 10.222.0.43 () {58 vars in 1416 bytes} [Tue Oct 4 19:41:20 2022] DELETE /compute/v2.1/servers/a4e3f797-f506-4c5e-ad79-2dbe8ccbd66d/os-volume_attachments/f4ce9f64-a0ed-4057-b6bb-e6cc222d5680 => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 19:41:20.242386 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:41:20.243812 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:41:20.254232 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-90faf447-3933-4452-948d-1429c4468230 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:41:20.256960 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-90faf447-3933-4452-948d-1429c4468230 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] [instance: a4e3f797-f506-4c5e-ad79-2dbe8ccbd66d] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:41:20.265831 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-90faf447-3933-4452-948d-1429c4468230 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:20.266372 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-90faf447-3933-4452-948d-1429c4468230 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:20.266892 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-90faf447-3933-4452-948d-1429c4468230 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:20.267825 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-90faf447-3933-4452-948d-1429c4468230 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:20.268310 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-90faf447-3933-4452-948d-1429c4468230 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:20.268768 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-90faf447-3933-4452-948d-1429c4468230 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:20.304032 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-90faf447-3933-4452-948d-1429c4468230 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] 10.222.0.43 "GET /compute/v2.1/servers/a4e3f797-f506-4c5e-ad79-2dbe8ccbd66d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063545 Oct 04 19:41:20.304624 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3905/7437] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Oct 4 19:41:20 2022] GET /compute/v2.1/servers/a4e3f797-f506-4c5e-ad79-2dbe8ccbd66d/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:41:21.317443 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-520a6e15-a3fe-42a8-a2c3-9d762983c600 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:41:21.319785 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-520a6e15-a3fe-42a8-a2c3-9d762983c600 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] [instance: a4e3f797-f506-4c5e-ad79-2dbe8ccbd66d] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:41:21.326216 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-520a6e15-a3fe-42a8-a2c3-9d762983c600 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:21.326710 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-520a6e15-a3fe-42a8-a2c3-9d762983c600 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:21.327159 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-520a6e15-a3fe-42a8-a2c3-9d762983c600 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:21.327873 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-520a6e15-a3fe-42a8-a2c3-9d762983c600 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:21.328340 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-520a6e15-a3fe-42a8-a2c3-9d762983c600 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:21.328776 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-520a6e15-a3fe-42a8-a2c3-9d762983c600 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:21.362546 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-520a6e15-a3fe-42a8-a2c3-9d762983c600 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] 10.222.0.43 "GET /compute/v2.1/servers/a4e3f797-f506-4c5e-ad79-2dbe8ccbd66d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050337 Oct 04 19:41:21.363334 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3533/7438] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Oct 4 19:41:21 2022] GET /compute/v2.1/servers/a4e3f797-f506-4c5e-ad79-2dbe8ccbd66d/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:41:22.375851 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f10301e9-5cbe-444f-8ccd-b55b51759e42 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:41:22.378039 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-f10301e9-5cbe-444f-8ccd-b55b51759e42 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] [instance: a4e3f797-f506-4c5e-ad79-2dbe8ccbd66d] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:41:22.385010 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f10301e9-5cbe-444f-8ccd-b55b51759e42 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:22.385687 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f10301e9-5cbe-444f-8ccd-b55b51759e42 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:22.386725 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f10301e9-5cbe-444f-8ccd-b55b51759e42 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:22.387442 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f10301e9-5cbe-444f-8ccd-b55b51759e42 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:22.387918 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f10301e9-5cbe-444f-8ccd-b55b51759e42 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:22.388365 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f10301e9-5cbe-444f-8ccd-b55b51759e42 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:22.418658 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-f10301e9-5cbe-444f-8ccd-b55b51759e42 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] 10.222.0.43 "GET /compute/v2.1/servers/a4e3f797-f506-4c5e-ad79-2dbe8ccbd66d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046831 Oct 04 19:41:22.419232 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3906/7439] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Oct 4 19:41:22 2022] GET /compute/v2.1/servers/a4e3f797-f506-4c5e-ad79-2dbe8ccbd66d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:41:23.430105 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-5aaae596-4665-4d3e-b9aa-f8563d172325 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:41:23.432413 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-5aaae596-4665-4d3e-b9aa-f8563d172325 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] [instance: a4e3f797-f506-4c5e-ad79-2dbe8ccbd66d] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:41:23.439372 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5aaae596-4665-4d3e-b9aa-f8563d172325 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:23.439898 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5aaae596-4665-4d3e-b9aa-f8563d172325 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:23.440373 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5aaae596-4665-4d3e-b9aa-f8563d172325 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:23.441061 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5aaae596-4665-4d3e-b9aa-f8563d172325 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:23.441535 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5aaae596-4665-4d3e-b9aa-f8563d172325 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:23.441965 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5aaae596-4665-4d3e-b9aa-f8563d172325 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:23.472719 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-5aaae596-4665-4d3e-b9aa-f8563d172325 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] 10.222.0.43 "GET /compute/v2.1/servers/a4e3f797-f506-4c5e-ad79-2dbe8ccbd66d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046624 Oct 04 19:41:23.473318 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3534/7440] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Oct 4 19:41:23 2022] GET /compute/v2.1/servers/a4e3f797-f506-4c5e-ad79-2dbe8ccbd66d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:41:24.486036 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-8bb425a4-20dc-4f7b-ad6a-73293263f20e tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:41:24.488305 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-8bb425a4-20dc-4f7b-ad6a-73293263f20e tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] [instance: a4e3f797-f506-4c5e-ad79-2dbe8ccbd66d] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:41:24.495220 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8bb425a4-20dc-4f7b-ad6a-73293263f20e tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:24.495721 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8bb425a4-20dc-4f7b-ad6a-73293263f20e tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:24.496169 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8bb425a4-20dc-4f7b-ad6a-73293263f20e tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:24.496878 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8bb425a4-20dc-4f7b-ad6a-73293263f20e tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:24.497366 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8bb425a4-20dc-4f7b-ad6a-73293263f20e tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:24.497806 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8bb425a4-20dc-4f7b-ad6a-73293263f20e tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:24.527610 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-8bb425a4-20dc-4f7b-ad6a-73293263f20e tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] 10.222.0.43 "GET /compute/v2.1/servers/a4e3f797-f506-4c5e-ad79-2dbe8ccbd66d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045594 Oct 04 19:41:24.528171 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3907/7441] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Oct 4 19:41:24 2022] GET /compute/v2.1/servers/a4e3f797-f506-4c5e-ad79-2dbe8ccbd66d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:41:25.540045 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-273412a7-7bec-4583-8e89-87e30fd257d0 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:41:25.542827 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-273412a7-7bec-4583-8e89-87e30fd257d0 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] [instance: a4e3f797-f506-4c5e-ad79-2dbe8ccbd66d] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:41:25.550401 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-273412a7-7bec-4583-8e89-87e30fd257d0 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:25.550895 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-273412a7-7bec-4583-8e89-87e30fd257d0 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:25.551340 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-273412a7-7bec-4583-8e89-87e30fd257d0 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:25.552042 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-273412a7-7bec-4583-8e89-87e30fd257d0 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:25.552505 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-273412a7-7bec-4583-8e89-87e30fd257d0 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:25.553069 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-273412a7-7bec-4583-8e89-87e30fd257d0 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:25.583784 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-273412a7-7bec-4583-8e89-87e30fd257d0 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] 10.222.0.43 "GET /compute/v2.1/servers/a4e3f797-f506-4c5e-ad79-2dbe8ccbd66d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047774 Oct 04 19:41:25.584350 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3535/7442] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Oct 4 19:41:25 2022] GET /compute/v2.1/servers/a4e3f797-f506-4c5e-ad79-2dbe8ccbd66d/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 19:41:25.595638 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-a7014b1c-124e-46bf-b5f1-d5cc69b4e152 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:41:25.596157 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-a7014b1c-124e-46bf-b5f1-d5cc69b4e152 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] [instance: a4e3f797-f506-4c5e-ad79-2dbe8ccbd66d] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:41:25.603361 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a7014b1c-124e-46bf-b5f1-d5cc69b4e152 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:25.603863 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a7014b1c-124e-46bf-b5f1-d5cc69b4e152 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:25.604325 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a7014b1c-124e-46bf-b5f1-d5cc69b4e152 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:25.605596 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a7014b1c-124e-46bf-b5f1-d5cc69b4e152 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:25.606072 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a7014b1c-124e-46bf-b5f1-d5cc69b4e152 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:25.606522 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a7014b1c-124e-46bf-b5f1-d5cc69b4e152 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:25.682573 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-a7014b1c-124e-46bf-b5f1-d5cc69b4e152 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] HTTP exception thrown: Instance a4e3f797-f506-4c5e-ad79-2dbe8ccbd66d is not attached to volume f4ce9f64-a0ed-4057-b6bb-e6cc222d5680 Oct 04 19:41:25.684774 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-a7014b1c-124e-46bf-b5f1-d5cc69b4e152 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Request method failure captured: Oct 04 19:41:25.684774 n-d-851028-13 devstack@n-api.service[123596]: request: DELETE /compute/v2.1/servers/a4e3f797-f506-4c5e-ad79-2dbe8ccbd66d/os-volume_attachments/f4ce9f64-a0ed-4057-b6bb-e6cc222d5680 HTTP/1.1 Oct 04 19:41:25.684774 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 19:41:25.684774 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 19:41:25.684774 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 19:41:25.684774 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 19:41:25.684774 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 19:41:25.684774 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 19:41:25.684774 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 19:41:25.684774 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 19:41:25.684774 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPIwgzYs4Qra3hBEV8yjoWKsOAEjSpqgTBwAVG3B_WdXGWjlSlsFSZK0zAWIYhYfyK9adIbntSb0OjMfzjP2rVmb8o93F7lb_vs4sYKuYVDdla1ygG_Vmlidd_igJmhLBbk5wMB6IaUMXeikg8dsZg9nDs1joViw1xmjsSf7IBIPIrRc Oct 04 19:41:25.684774 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 19:41:25.684774 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 19:41:25.684774 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 19:41:25.684774 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 19:41:25.684774 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 19:41:25.684774 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 19:41:25.684774 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: a14c17efe9404d6bb455d5dcc8b2c3c4 Oct 04 19:41:25.684774 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-TestEncryptedCinderVolumes-15666215 Oct 04 19:41:25.684774 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 19:41:25.684774 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 19:41:25.684774 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/a14c17efe9404d6bb455d5dcc8b2c3c4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_a14c17efe9404d6bb455d5dcc8b2c3c4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a14c17efe9404d6bb455d5dcc8b2c3c4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a14c17efe9404d6bb455d5dcc8b2c3c4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 19:41:25.684774 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-TestEncryptedCinderVolumes-15666215 Oct 04 19:41:25.684774 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: a14c17efe9404d6bb455d5dcc8b2c3c4 Oct 04 19:41:25.684774 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-15666215 Oct 04 19:41:25.684774 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-TestEncryptedCinderVolumes-15666215-project Oct 04 19:41:25.684774 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 19:41:25.684774 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 19:41:25.684774 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: fdd88e4643894b5dac67db4cb49c665b Oct 04 19:41:25.684774 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-TestEncryptedCinderVolumes-15666215-project Oct 04 19:41:25.684774 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 19:41:25.684774 n-d-851028-13 devstack@n-api.service[123596]: exception: Instance a4e3f797-f506-4c5e-ad79-2dbe8ccbd66d is not attached to volume f4ce9f64-a0ed-4057-b6bb-e6cc222d5680 Oct 04 19:41:25.684774 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'server_id': 'a4e3f797-f506-4c5e-ad79-2dbe8ccbd66d', 'id': 'f4ce9f64-a0ed-4057-b6bb-e6cc222d5680'} Oct 04 19:41:25.684774 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:41:25.684774 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:41:25.684774 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 04 19:41:25.684774 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 04 19:41:25.684774 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 19:41:25.684774 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 19:41:25.684774 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 04 19:41:25.684774 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 04 19:41:25.684774 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id f4ce9f64-a0ed-4057-b6bb-e6cc222d5680. Oct 04 19:41:25.684774 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:41:25.684774 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:41:25.684774 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:41:25.684774 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:41:25.684774 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:41:25.684774 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:41:25.684774 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:41:25.684774 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:41:25.684774 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:41:25.684774 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:41:25.684774 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 04 19:41:25.684774 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 04 19:41:25.684774 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4e3f797-f506-4c5e-ad79-2dbe8ccbd66d is not attached to volume f4ce9f64-a0ed-4057-b6bb-e6cc222d5680 Oct 04 19:41:25.684774 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:41:25.684774 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:41:25.684774 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:41:25.684774 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:41:25.684774 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:41:25.684774 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:41:25.689689 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:41:25.689689 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:41:25.689689 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4e3f797-f506-4c5e-ad79-2dbe8ccbd66d is not attached to volume f4ce9f64-a0ed-4057-b6bb-e6cc222d5680 Oct 04 19:41:25.689689 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:41:25.689689 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-a7014b1c-124e-46bf-b5f1-d5cc69b4e152 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Returning 404 to user: Instance a4e3f797-f506-4c5e-ad79-2dbe8ccbd66d is not attached to volume f4ce9f64-a0ed-4057-b6bb-e6cc222d5680 {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:41:25.689689 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-a7014b1c-124e-46bf-b5f1-d5cc69b4e152 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] 10.222.0.43 "DELETE /compute/v2.1/servers/a4e3f797-f506-4c5e-ad79-2dbe8ccbd66d/os-volume_attachments/f4ce9f64-a0ed-4057-b6bb-e6cc222d5680" status: 404 len: 154 microversion: 2.1 time: 0.095040 Oct 04 19:41:25.689689 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3908/7443] 10.222.0.43 () {58 vars in 1416 bytes} [Tue Oct 4 19:41:25 2022] DELETE /compute/v2.1/servers/a4e3f797-f506-4c5e-ad79-2dbe8ccbd66d/os-volume_attachments/f4ce9f64-a0ed-4057-b6bb-e6cc222d5680 => generated 154 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:41:29.043056 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-1207dfb1-d1b1-4b3a-9b61-d3dbbcb467b3 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:41:29.044455 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-1207dfb1-d1b1-4b3a-9b61-d3dbbcb467b3 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] [instance: a4e3f797-f506-4c5e-ad79-2dbe8ccbd66d] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:41:29.051226 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1207dfb1-d1b1-4b3a-9b61-d3dbbcb467b3 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:29.051731 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1207dfb1-d1b1-4b3a-9b61-d3dbbcb467b3 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:29.052185 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1207dfb1-d1b1-4b3a-9b61-d3dbbcb467b3 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:29.052941 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1207dfb1-d1b1-4b3a-9b61-d3dbbcb467b3 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:29.053426 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1207dfb1-d1b1-4b3a-9b61-d3dbbcb467b3 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:29.053863 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1207dfb1-d1b1-4b3a-9b61-d3dbbcb467b3 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:29.082263 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-1207dfb1-d1b1-4b3a-9b61-d3dbbcb467b3 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] [instance: a4e3f797-f506-4c5e-ad79-2dbe8ccbd66d] Going to try to terminate instance {{(pid=123595) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 19:41:29.159628 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-1207dfb1-d1b1-4b3a-9b61-d3dbbcb467b3 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] 10.222.0.43 "DELETE /compute/v2.1/servers/a4e3f797-f506-4c5e-ad79-2dbe8ccbd66d" status: 204 len: 0 microversion: 2.1 time: 0.121155 Oct 04 19:41:29.160595 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3536/7444] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 19:41:29 2022] DELETE /compute/v2.1/servers/a4e3f797-f506-4c5e-ad79-2dbe8ccbd66d => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:41:29.169244 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-8259a4cc-a99e-4c8a-93b9-0293ea6013d0 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:41:29.169984 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-8259a4cc-a99e-4c8a-93b9-0293ea6013d0 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] [instance: a4e3f797-f506-4c5e-ad79-2dbe8ccbd66d] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:41:29.177621 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8259a4cc-a99e-4c8a-93b9-0293ea6013d0 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:29.178141 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8259a4cc-a99e-4c8a-93b9-0293ea6013d0 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:29.178660 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8259a4cc-a99e-4c8a-93b9-0293ea6013d0 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:29.179457 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8259a4cc-a99e-4c8a-93b9-0293ea6013d0 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:29.180007 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8259a4cc-a99e-4c8a-93b9-0293ea6013d0 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:29.180517 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8259a4cc-a99e-4c8a-93b9-0293ea6013d0 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:29.311895 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-8259a4cc-a99e-4c8a-93b9-0293ea6013d0 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdd88e4643894b5dac67db4cb49c665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14c17efe9404d6bb455d5dcc8b2c3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:41:29.319734 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-8259a4cc-a99e-4c8a-93b9-0293ea6013d0 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] 10.222.0.43 "GET /compute/v2.1/servers/a4e3f797-f506-4c5e-ad79-2dbe8ccbd66d" status: 200 len: 1559 microversion: 2.1 time: 0.155137 Oct 04 19:41:29.320515 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3909/7445] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:41:29 2022] GET /compute/v2.1/servers/a4e3f797-f506-4c5e-ad79-2dbe8ccbd66d => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:41:30.344103 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-bb8e4a2a-2861-4b77-8b72-f0af7869c92c tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:41:30.344852 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-bb8e4a2a-2861-4b77-8b72-f0af7869c92c tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] [instance: a4e3f797-f506-4c5e-ad79-2dbe8ccbd66d] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:41:30.352230 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bb8e4a2a-2861-4b77-8b72-f0af7869c92c tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:30.352718 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bb8e4a2a-2861-4b77-8b72-f0af7869c92c tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:30.353179 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bb8e4a2a-2861-4b77-8b72-f0af7869c92c tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:30.353877 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bb8e4a2a-2861-4b77-8b72-f0af7869c92c tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:30.354335 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bb8e4a2a-2861-4b77-8b72-f0af7869c92c tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:30.354772 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bb8e4a2a-2861-4b77-8b72-f0af7869c92c tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:30.488799 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-bb8e4a2a-2861-4b77-8b72-f0af7869c92c tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdd88e4643894b5dac67db4cb49c665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14c17efe9404d6bb455d5dcc8b2c3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:41:30.496841 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-bb8e4a2a-2861-4b77-8b72-f0af7869c92c tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] 10.222.0.43 "GET /compute/v2.1/servers/a4e3f797-f506-4c5e-ad79-2dbe8ccbd66d" status: 200 len: 1559 microversion: 2.1 time: 0.157502 Oct 04 19:41:30.497455 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3537/7446] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:41:30 2022] GET /compute/v2.1/servers/a4e3f797-f506-4c5e-ad79-2dbe8ccbd66d => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:41:31.346917 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-f95e0365-2fd2-4f77-8df9-69c8e143556e req-6dcdf98c-7d0d-4c13-9d3a-c3dd0727cfbe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4e3f797-f506-4c5e-ad79-2dbe8ccbd66d", "name": "network-vif-deleted", "tag": "5448a954-45c4-4019-ae97-bfa4ffbd7a49"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:41:31.357853 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-f95e0365-2fd2-4f77-8df9-69c8e143556e req-6dcdf98c-7d0d-4c13-9d3a-c3dd0727cfbe service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:31.358362 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-f95e0365-2fd2-4f77-8df9-69c8e143556e req-6dcdf98c-7d0d-4c13-9d3a-c3dd0727cfbe service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:31.358795 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-f95e0365-2fd2-4f77-8df9-69c8e143556e req-6dcdf98c-7d0d-4c13-9d3a-c3dd0727cfbe service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:31.371988 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-f95e0365-2fd2-4f77-8df9-69c8e143556e req-6dcdf98c-7d0d-4c13-9d3a-c3dd0727cfbe service nova] Creating event network-vif-deleted:5448a954-45c4-4019-ae97-bfa4ffbd7a49 for instance a4e3f797-f506-4c5e-ad79-2dbe8ccbd66d on n-h1-851028-13 Oct 04 19:41:31.377650 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-f95e0365-2fd2-4f77-8df9-69c8e143556e req-6dcdf98c-7d0d-4c13-9d3a-c3dd0727cfbe service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034238 Oct 04 19:41:31.378581 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3910/7447] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:41:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:41:31.519692 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-3612cd4f-6d4e-4a6d-81bf-dec1b38f016b tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:41:31.520315 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-3612cd4f-6d4e-4a6d-81bf-dec1b38f016b tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] [instance: a4e3f797-f506-4c5e-ad79-2dbe8ccbd66d] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:41:31.527133 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3612cd4f-6d4e-4a6d-81bf-dec1b38f016b tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:31.527620 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3612cd4f-6d4e-4a6d-81bf-dec1b38f016b tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:31.528058 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3612cd4f-6d4e-4a6d-81bf-dec1b38f016b tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:31.528755 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3612cd4f-6d4e-4a6d-81bf-dec1b38f016b tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:31.529237 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3612cd4f-6d4e-4a6d-81bf-dec1b38f016b tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:31.529672 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3612cd4f-6d4e-4a6d-81bf-dec1b38f016b tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:31.562593 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3612cd4f-6d4e-4a6d-81bf-dec1b38f016b tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:31.562998 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3612cd4f-6d4e-4a6d-81bf-dec1b38f016b tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:31.563445 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3612cd4f-6d4e-4a6d-81bf-dec1b38f016b tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:31.563903 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.objects.instance [None req-3612cd4f-6d4e-4a6d-81bf-dec1b38f016b tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lazy-loading 'fault' on Instance uuid a4e3f797-f506-4c5e-ad79-2dbe8ccbd66d {{(pid=123595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 19:41:31.603512 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-3612cd4f-6d4e-4a6d-81bf-dec1b38f016b tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdd88e4643894b5dac67db4cb49c665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14c17efe9404d6bb455d5dcc8b2c3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:41:31.611695 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-3612cd4f-6d4e-4a6d-81bf-dec1b38f016b tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] 10.222.0.43 "GET /compute/v2.1/servers/a4e3f797-f506-4c5e-ad79-2dbe8ccbd66d" status: 200 len: 1352 microversion: 2.1 time: 0.095916 Oct 04 19:41:31.612266 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3538/7448] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:41:31 2022] GET /compute/v2.1/servers/a4e3f797-f506-4c5e-ad79-2dbe8ccbd66d => generated 1352 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:41:32.637545 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-0c1856bd-75fa-43e2-97b1-7ce825dbb401 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:41:32.638272 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-0c1856bd-75fa-43e2-97b1-7ce825dbb401 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] [instance: a4e3f797-f506-4c5e-ad79-2dbe8ccbd66d] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:41:32.644576 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0c1856bd-75fa-43e2-97b1-7ce825dbb401 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:32.645080 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0c1856bd-75fa-43e2-97b1-7ce825dbb401 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:32.645565 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0c1856bd-75fa-43e2-97b1-7ce825dbb401 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:32.646276 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0c1856bd-75fa-43e2-97b1-7ce825dbb401 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:32.646750 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0c1856bd-75fa-43e2-97b1-7ce825dbb401 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:32.647197 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0c1856bd-75fa-43e2-97b1-7ce825dbb401 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:32.660422 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-0c1856bd-75fa-43e2-97b1-7ce825dbb401 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] HTTP exception thrown: Instance a4e3f797-f506-4c5e-ad79-2dbe8ccbd66d could not be found. Oct 04 19:41:32.662108 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-0c1856bd-75fa-43e2-97b1-7ce825dbb401 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Request method failure captured: Oct 04 19:41:32.662108 n-d-851028-13 devstack@n-api.service[123596]: request: GET /compute/v2.1/servers/a4e3f797-f506-4c5e-ad79-2dbe8ccbd66d HTTP/1.1 Oct 04 19:41:32.662108 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 19:41:32.662108 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 19:41:32.662108 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 19:41:32.662108 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 19:41:32.662108 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 19:41:32.662108 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 19:41:32.662108 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 19:41:32.662108 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 19:41:32.662108 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPIwgzYs4Qra3hBEV8yjoWKsOAEjSpqgTBwAVG3B_WdXGWjlSlsFSZK0zAWIYhYfyK9adIbntSb0OjMfzjP2rVmb8o93F7lb_vs4sYKuYVDdla1ygG_Vmlidd_igJmhLBbk5wMB6IaUMXeikg8dsZg9nDs1joViw1xmjsSf7IBIPIrRc Oct 04 19:41:32.662108 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 19:41:32.662108 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 19:41:32.662108 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 19:41:32.662108 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 19:41:32.662108 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 19:41:32.662108 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 19:41:32.662108 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: a14c17efe9404d6bb455d5dcc8b2c3c4 Oct 04 19:41:32.662108 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-TestEncryptedCinderVolumes-15666215 Oct 04 19:41:32.662108 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 19:41:32.662108 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 19:41:32.662108 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/a14c17efe9404d6bb455d5dcc8b2c3c4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_a14c17efe9404d6bb455d5dcc8b2c3c4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a14c17efe9404d6bb455d5dcc8b2c3c4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a14c17efe9404d6bb455d5dcc8b2c3c4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 19:41:32.662108 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-TestEncryptedCinderVolumes-15666215 Oct 04 19:41:32.662108 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: a14c17efe9404d6bb455d5dcc8b2c3c4 Oct 04 19:41:32.662108 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-15666215 Oct 04 19:41:32.662108 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-TestEncryptedCinderVolumes-15666215-project Oct 04 19:41:32.662108 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 19:41:32.662108 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 19:41:32.662108 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: fdd88e4643894b5dac67db4cb49c665b Oct 04 19:41:32.662108 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-TestEncryptedCinderVolumes-15666215-project Oct 04 19:41:32.662108 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 19:41:32.662108 n-d-851028-13 devstack@n-api.service[123596]: exception: Instance a4e3f797-f506-4c5e-ad79-2dbe8ccbd66d could not be found. Oct 04 19:41:32.662108 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': 'a4e3f797-f506-4c5e-ad79-2dbe8ccbd66d'} Oct 04 19:41:32.662108 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:41:32.662108 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:41:32.662108 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:41:32.662108 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:41:32.662108 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:41:32.662108 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:41:32.662108 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:41:32.662108 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:41:32.662108 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:41:32.662108 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:41:32.662108 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4e3f797-f506-4c5e-ad79-2dbe8ccbd66d could not be found. Oct 04 19:41:32.662108 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:41:32.662108 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:41:32.662108 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:41:32.662108 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:41:32.662108 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:41:32.662108 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:41:32.662108 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:41:32.662108 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:41:32.662108 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:41:32.662108 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:41:32.662108 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:41:32.662108 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:41:32.662108 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:41:32.662108 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:41:32.662108 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:41:32.662108 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:41:32.662108 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4e3f797-f506-4c5e-ad79-2dbe8ccbd66d could not be found. Oct 04 19:41:32.662108 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:41:32.662108 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:41:32.662108 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:41:32.666963 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:41:32.666963 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:41:32.666963 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:41:32.666963 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:41:32.666963 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:41:32.666963 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4e3f797-f506-4c5e-ad79-2dbe8ccbd66d could not be found. Oct 04 19:41:32.666963 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:41:32.666963 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-0c1856bd-75fa-43e2-97b1-7ce825dbb401 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Returning 404 to user: Instance a4e3f797-f506-4c5e-ad79-2dbe8ccbd66d could not be found. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:41:32.666963 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-0c1856bd-75fa-43e2-97b1-7ce825dbb401 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] 10.222.0.43 "GET /compute/v2.1/servers/a4e3f797-f506-4c5e-ad79-2dbe8ccbd66d" status: 404 len: 111 microversion: 2.1 time: 0.031902 Oct 04 19:41:32.667757 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3911/7449] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:41:32 2022] GET /compute/v2.1/servers/a4e3f797-f506-4c5e-ad79-2dbe8ccbd66d => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:41:32.672727 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-7512d8eb-6a25-45b1-8c36-894c955b06bc tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Calling method '.version_select at 0x7fb21f785040>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:41:32.692746 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-7512d8eb-6a25-45b1-8c36-894c955b06bc tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-788100401" status: 202 len: 0 microversion: 2.1 time: 0.023925 Oct 04 19:41:32.693354 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3539/7450] 10.222.0.43 () {58 vars in 1275 bytes} [Tue Oct 4 19:41:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-788100401 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:41:32.710902 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-c33da5e7-d662-4c77-9968-293ced81352f tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Action: 'create', calling method: .version_select at 0x7fb21c597af0>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1312867778", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC6ooDIklblOOD0F+HFlXXLLoN6hzcRCnZd2ncVTdQ4E8n8m+XmJ3w0ldsdplyw2gYIhm0nzv4rZC72pUq2UK+H5PZ43sB94nD2zEecZtkNQl/Twnq1JA/DZgxvWAoIEog=="}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:41:32.726133 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-c33da5e7-d662-4c77-9968-293ced81352f tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Getting quotas for project a14c17efe9404d6bb455d5dcc8b2c3c4. Resources: {'key_pairs'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:41:32.731895 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-c33da5e7-d662-4c77-9968-293ced81352f tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Getting quotas for user fdd88e4643894b5dac67db4cb49c665b and project a14c17efe9404d6bb455d5dcc8b2c3c4. Resources: {'key_pairs'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:41:32.754924 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-c33da5e7-d662-4c77-9968-293ced81352f tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.048137 Oct 04 19:41:32.755506 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3912/7451] 10.222.0.43 () {60 vars in 1159 bytes} [Tue Oct 4 19:41:32 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:41:32.804205 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-ce4b4f3c-b038-4a33-98b7-c26a02d22cca tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1185580070", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1312867778", "networks": [{"uuid": "28c02d60-66d8-40f0-a6d3-89b685207981"}]}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:41:32.857396 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.network.neutron [None req-ce4b4f3c-b038-4a33-98b7-c26a02d22cca tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] validate_networks() for [('28c02d60-66d8-40f0-a6d3-89b685207981', None, None, None, None, None)] {{(pid=123595) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 19:41:33.225409 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-ce4b4f3c-b038-4a33-98b7-c26a02d22cca tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Flavor limits 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:41:33.225836 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-ce4b4f3c-b038-4a33-98b7-c26a02d22cca tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Image limits 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:41:33.226309 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-ce4b4f3c-b038-4a33-98b7-c26a02d22cca tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Flavor pref 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:41:33.226720 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-ce4b4f3c-b038-4a33-98b7-c26a02d22cca tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Image pref 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:41:33.227139 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-ce4b4f3c-b038-4a33-98b7-c26a02d22cca tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:41:33.236419 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ce4b4f3c-b038-4a33-98b7-c26a02d22cca tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:33.236899 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ce4b4f3c-b038-4a33-98b7-c26a02d22cca tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:33.237370 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ce4b4f3c-b038-4a33-98b7-c26a02d22cca tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:33.238099 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ce4b4f3c-b038-4a33-98b7-c26a02d22cca tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:33.238552 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ce4b4f3c-b038-4a33-98b7-c26a02d22cca tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:33.239048 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ce4b4f3c-b038-4a33-98b7-c26a02d22cca tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:33.256467 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-ce4b4f3c-b038-4a33-98b7-c26a02d22cca tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Getting quotas for project a14c17efe9404d6bb455d5dcc8b2c3c4. Resources: {'ram', 'cores', 'instances'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:41:33.261729 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-ce4b4f3c-b038-4a33-98b7-c26a02d22cca tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Getting quotas for user fdd88e4643894b5dac67db4cb49c665b and project a14c17efe9404d6bb455d5dcc8b2c3c4. Resources: {'ram', 'cores', 'instances'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:41:33.273724 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-ce4b4f3c-b038-4a33-98b7-c26a02d22cca tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Going to run 1 instances... {{(pid=123595) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 19:41:33.276035 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-ce4b4f3c-b038-4a33-98b7-c26a02d22cca tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] [instance: a97a9916-89c1-4925-bc46-3231d74787f7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e8943ec5-4038-4d4b-b9b9-2415a79f5243',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 19:41:33.321772 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-ce4b4f3c-b038-4a33-98b7-c26a02d22cca tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.521482 Oct 04 19:41:33.322424 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3540/7452] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 19:41:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 523 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 19:41:33.333669 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-b0ab8eed-2f9f-4e9e-a763-baf4a925e746 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:41:33.334659 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-b0ab8eed-2f9f-4e9e-a763-baf4a925e746 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] [instance: a97a9916-89c1-4925-bc46-3231d74787f7] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:41:33.391576 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-b0ab8eed-2f9f-4e9e-a763-baf4a925e746 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdd88e4643894b5dac67db4cb49c665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14c17efe9404d6bb455d5dcc8b2c3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:41:33.398562 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-b0ab8eed-2f9f-4e9e-a763-baf4a925e746 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] 10.222.0.43 "GET /compute/v2.1/servers/a97a9916-89c1-4925-bc46-3231d74787f7" status: 200 len: 1263 microversion: 2.1 time: 0.068920 Oct 04 19:41:33.399131 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3913/7453] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:41:33 2022] GET /compute/v2.1/servers/a97a9916-89c1-4925-bc46-3231d74787f7 => generated 1263 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:41:34.422658 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-0f6f6bfb-44a3-41f6-a48a-dd823154073c tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:41:34.423276 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-0f6f6bfb-44a3-41f6-a48a-dd823154073c tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] [instance: a97a9916-89c1-4925-bc46-3231d74787f7] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:41:34.434547 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0f6f6bfb-44a3-41f6-a48a-dd823154073c tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:34.435048 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0f6f6bfb-44a3-41f6-a48a-dd823154073c tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:34.435491 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0f6f6bfb-44a3-41f6-a48a-dd823154073c tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:34.436206 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0f6f6bfb-44a3-41f6-a48a-dd823154073c tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:34.436670 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0f6f6bfb-44a3-41f6-a48a-dd823154073c tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:34.437291 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0f6f6bfb-44a3-41f6-a48a-dd823154073c tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:34.501038 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-0f6f6bfb-44a3-41f6-a48a-dd823154073c tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdd88e4643894b5dac67db4cb49c665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14c17efe9404d6bb455d5dcc8b2c3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:41:34.508994 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-0f6f6bfb-44a3-41f6-a48a-dd823154073c tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] 10.222.0.43 "GET /compute/v2.1/servers/a97a9916-89c1-4925-bc46-3231d74787f7" status: 200 len: 1321 microversion: 2.1 time: 0.091435 Oct 04 19:41:34.509633 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3541/7454] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:41:34 2022] GET /compute/v2.1/servers/a97a9916-89c1-4925-bc46-3231d74787f7 => generated 1321 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:41:35.531834 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-1e9c4d9e-5bd3-4b01-9b3c-a8b443917d4d tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:41:35.532459 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-1e9c4d9e-5bd3-4b01-9b3c-a8b443917d4d tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] [instance: a97a9916-89c1-4925-bc46-3231d74787f7] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:41:35.539285 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1e9c4d9e-5bd3-4b01-9b3c-a8b443917d4d tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:35.539783 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1e9c4d9e-5bd3-4b01-9b3c-a8b443917d4d tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:35.540232 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1e9c4d9e-5bd3-4b01-9b3c-a8b443917d4d tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:35.540931 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1e9c4d9e-5bd3-4b01-9b3c-a8b443917d4d tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:35.541432 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1e9c4d9e-5bd3-4b01-9b3c-a8b443917d4d tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:35.541870 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1e9c4d9e-5bd3-4b01-9b3c-a8b443917d4d tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:35.745669 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-1e9c4d9e-5bd3-4b01-9b3c-a8b443917d4d tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdd88e4643894b5dac67db4cb49c665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14c17efe9404d6bb455d5dcc8b2c3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:41:35.753733 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-1e9c4d9e-5bd3-4b01-9b3c-a8b443917d4d tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] 10.222.0.43 "GET /compute/v2.1/servers/a97a9916-89c1-4925-bc46-3231d74787f7" status: 200 len: 1363 microversion: 2.1 time: 0.225724 Oct 04 19:41:35.754311 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3914/7455] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:41:35 2022] GET /compute/v2.1/servers/a97a9916-89c1-4925-bc46-3231d74787f7 => generated 1363 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:41:35.781786 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-3f0ae126-0c8f-47fe-a646-0386c0688339 req-04c5ece1-a047-411a-939b-97796c424566 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a97a9916-89c1-4925-bc46-3231d74787f7", "tag": "cfc06dc7-950b-4ec1-8048-96b75d46de12"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:41:35.793695 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-3f0ae126-0c8f-47fe-a646-0386c0688339 req-04c5ece1-a047-411a-939b-97796c424566 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:35.794180 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-3f0ae126-0c8f-47fe-a646-0386c0688339 req-04c5ece1-a047-411a-939b-97796c424566 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:35.794620 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-3f0ae126-0c8f-47fe-a646-0386c0688339 req-04c5ece1-a047-411a-939b-97796c424566 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:35.806125 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-3f0ae126-0c8f-47fe-a646-0386c0688339 req-04c5ece1-a047-411a-939b-97796c424566 service nova] Creating event network-changed:cfc06dc7-950b-4ec1-8048-96b75d46de12 for instance a97a9916-89c1-4925-bc46-3231d74787f7 on n-h2-851028-13 Oct 04 19:41:35.810915 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-3f0ae126-0c8f-47fe-a646-0386c0688339 req-04c5ece1-a047-411a-939b-97796c424566 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033648 Oct 04 19:41:35.811535 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3542/7456] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:41:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:41:36.777020 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-e4bed0e2-4238-402a-889d-63a5aaede64a tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:41:36.777686 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-e4bed0e2-4238-402a-889d-63a5aaede64a tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] [instance: a97a9916-89c1-4925-bc46-3231d74787f7] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:41:36.784601 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e4bed0e2-4238-402a-889d-63a5aaede64a tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:36.785103 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e4bed0e2-4238-402a-889d-63a5aaede64a tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:36.785595 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e4bed0e2-4238-402a-889d-63a5aaede64a tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:36.786305 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e4bed0e2-4238-402a-889d-63a5aaede64a tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:36.786780 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e4bed0e2-4238-402a-889d-63a5aaede64a tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:36.787229 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e4bed0e2-4238-402a-889d-63a5aaede64a tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:36.919480 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-e4bed0e2-4238-402a-889d-63a5aaede64a tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdd88e4643894b5dac67db4cb49c665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14c17efe9404d6bb455d5dcc8b2c3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:41:36.927222 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-e4bed0e2-4238-402a-889d-63a5aaede64a tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] 10.222.0.43 "GET /compute/v2.1/servers/a97a9916-89c1-4925-bc46-3231d74787f7" status: 200 len: 1363 microversion: 2.1 time: 0.154216 Oct 04 19:41:36.927802 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3915/7457] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:41:36 2022] GET /compute/v2.1/servers/a97a9916-89c1-4925-bc46-3231d74787f7 => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:41:37.953026 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-54466a12-2364-4978-8fa0-e5737e5cba4b tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:41:37.953773 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-54466a12-2364-4978-8fa0-e5737e5cba4b tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] [instance: a97a9916-89c1-4925-bc46-3231d74787f7] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:41:37.960417 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-54466a12-2364-4978-8fa0-e5737e5cba4b tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:37.960906 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-54466a12-2364-4978-8fa0-e5737e5cba4b tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:37.961375 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-54466a12-2364-4978-8fa0-e5737e5cba4b tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:37.962080 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-54466a12-2364-4978-8fa0-e5737e5cba4b tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:37.962533 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-54466a12-2364-4978-8fa0-e5737e5cba4b tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:37.962960 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-54466a12-2364-4978-8fa0-e5737e5cba4b tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:38.098817 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-54466a12-2364-4978-8fa0-e5737e5cba4b tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdd88e4643894b5dac67db4cb49c665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14c17efe9404d6bb455d5dcc8b2c3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:41:38.106936 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-54466a12-2364-4978-8fa0-e5737e5cba4b tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] 10.222.0.43 "GET /compute/v2.1/servers/a97a9916-89c1-4925-bc46-3231d74787f7" status: 200 len: 1363 microversion: 2.1 time: 0.159793 Oct 04 19:41:38.107731 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3543/7458] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:41:37 2022] GET /compute/v2.1/servers/a97a9916-89c1-4925-bc46-3231d74787f7 => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:41:39.130447 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-dcfca7c2-7062-45b9-b4da-58a141ceae9c tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:41:39.131086 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-dcfca7c2-7062-45b9-b4da-58a141ceae9c tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] [instance: a97a9916-89c1-4925-bc46-3231d74787f7] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:41:39.138498 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dcfca7c2-7062-45b9-b4da-58a141ceae9c tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:39.139003 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dcfca7c2-7062-45b9-b4da-58a141ceae9c tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:39.139460 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dcfca7c2-7062-45b9-b4da-58a141ceae9c tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:39.140168 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dcfca7c2-7062-45b9-b4da-58a141ceae9c tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:39.140637 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dcfca7c2-7062-45b9-b4da-58a141ceae9c tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:39.141087 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dcfca7c2-7062-45b9-b4da-58a141ceae9c tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:39.267598 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-dcfca7c2-7062-45b9-b4da-58a141ceae9c tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdd88e4643894b5dac67db4cb49c665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14c17efe9404d6bb455d5dcc8b2c3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:41:39.275377 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-dcfca7c2-7062-45b9-b4da-58a141ceae9c tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] 10.222.0.43 "GET /compute/v2.1/servers/a97a9916-89c1-4925-bc46-3231d74787f7" status: 200 len: 1363 microversion: 2.1 time: 0.148881 Oct 04 19:41:39.275953 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3916/7459] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:41:39 2022] GET /compute/v2.1/servers/a97a9916-89c1-4925-bc46-3231d74787f7 => generated 1363 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:41:39.956172 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-4a8e843d-edcc-47f6-892a-045651c5463d req-655a9808-ffb3-4931-bfcd-59f8ca874a07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a97a9916-89c1-4925-bc46-3231d74787f7", "name": "network-vif-plugged", "status": "completed", "tag": "cfc06dc7-950b-4ec1-8048-96b75d46de12"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:41:39.968203 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-4a8e843d-edcc-47f6-892a-045651c5463d req-655a9808-ffb3-4931-bfcd-59f8ca874a07 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:39.968770 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-4a8e843d-edcc-47f6-892a-045651c5463d req-655a9808-ffb3-4931-bfcd-59f8ca874a07 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:39.969254 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-4a8e843d-edcc-47f6-892a-045651c5463d req-655a9808-ffb3-4931-bfcd-59f8ca874a07 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:39.981988 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-4a8e843d-edcc-47f6-892a-045651c5463d req-655a9808-ffb3-4931-bfcd-59f8ca874a07 service nova] Creating event network-vif-plugged:cfc06dc7-950b-4ec1-8048-96b75d46de12 for instance a97a9916-89c1-4925-bc46-3231d74787f7 on n-h2-851028-13 Oct 04 19:41:39.986858 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-4a8e843d-edcc-47f6-892a-045651c5463d req-655a9808-ffb3-4931-bfcd-59f8ca874a07 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034439 Oct 04 19:41:39.987681 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3544/7460] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:41:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:41:40.298716 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-4bcb1390-5731-4885-a9e1-febe06c904f5 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:41:40.299336 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-4bcb1390-5731-4885-a9e1-febe06c904f5 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] [instance: a97a9916-89c1-4925-bc46-3231d74787f7] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:41:40.306200 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4bcb1390-5731-4885-a9e1-febe06c904f5 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:40.306700 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4bcb1390-5731-4885-a9e1-febe06c904f5 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:40.307150 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4bcb1390-5731-4885-a9e1-febe06c904f5 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:40.308362 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4bcb1390-5731-4885-a9e1-febe06c904f5 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:40.308828 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4bcb1390-5731-4885-a9e1-febe06c904f5 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:40.309300 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4bcb1390-5731-4885-a9e1-febe06c904f5 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:40.439111 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-4bcb1390-5731-4885-a9e1-febe06c904f5 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdd88e4643894b5dac67db4cb49c665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14c17efe9404d6bb455d5dcc8b2c3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:41:40.447148 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-4bcb1390-5731-4885-a9e1-febe06c904f5 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] 10.222.0.43 "GET /compute/v2.1/servers/a97a9916-89c1-4925-bc46-3231d74787f7" status: 200 len: 1363 microversion: 2.1 time: 0.152338 Oct 04 19:41:40.447737 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3917/7461] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:41:40 2022] GET /compute/v2.1/servers/a97a9916-89c1-4925-bc46-3231d74787f7 => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:41:41.472734 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-db0abb58-157b-43d9-9542-43526995bcef tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:41:41.473468 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-db0abb58-157b-43d9-9542-43526995bcef tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] [instance: a97a9916-89c1-4925-bc46-3231d74787f7] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:41:41.480450 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-db0abb58-157b-43d9-9542-43526995bcef tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:41.480972 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-db0abb58-157b-43d9-9542-43526995bcef tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:41.481456 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-db0abb58-157b-43d9-9542-43526995bcef tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:41.482169 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-db0abb58-157b-43d9-9542-43526995bcef tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:41.482628 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-db0abb58-157b-43d9-9542-43526995bcef tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:41.483115 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-db0abb58-157b-43d9-9542-43526995bcef tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:41.611103 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-db0abb58-157b-43d9-9542-43526995bcef tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdd88e4643894b5dac67db4cb49c665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14c17efe9404d6bb455d5dcc8b2c3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:41:41.618831 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-db0abb58-157b-43d9-9542-43526995bcef tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] 10.222.0.43 "GET /compute/v2.1/servers/a97a9916-89c1-4925-bc46-3231d74787f7" status: 200 len: 1554 microversion: 2.1 time: 0.151288 Oct 04 19:41:41.619409 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3545/7462] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:41:41 2022] GET /compute/v2.1/servers/a97a9916-89c1-4925-bc46-3231d74787f7 => generated 1554 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:41:41.641778 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f96e551f-e353-4446-8c1e-282435d9a384 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:41:41.642414 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-f96e551f-e353-4446-8c1e-282435d9a384 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] [instance: a97a9916-89c1-4925-bc46-3231d74787f7] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:41:41.649425 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f96e551f-e353-4446-8c1e-282435d9a384 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:41.649928 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f96e551f-e353-4446-8c1e-282435d9a384 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:41.650387 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f96e551f-e353-4446-8c1e-282435d9a384 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:41.651101 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f96e551f-e353-4446-8c1e-282435d9a384 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:41.651575 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f96e551f-e353-4446-8c1e-282435d9a384 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:41.652024 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f96e551f-e353-4446-8c1e-282435d9a384 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:41.777718 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-f96e551f-e353-4446-8c1e-282435d9a384 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdd88e4643894b5dac67db4cb49c665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14c17efe9404d6bb455d5dcc8b2c3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:41:41.785460 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-f96e551f-e353-4446-8c1e-282435d9a384 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] 10.222.0.43 "GET /compute/v2.1/servers/a97a9916-89c1-4925-bc46-3231d74787f7" status: 200 len: 1554 microversion: 2.1 time: 0.147546 Oct 04 19:41:41.786044 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3918/7463] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:41:41 2022] GET /compute/v2.1/servers/a97a9916-89c1-4925-bc46-3231d74787f7 => generated 1554 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:41:43.286010 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-3be8417c-1708-4849-a91e-0eb14e61ca2d tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "224b79f8-2ce6-45ca-a8b6-6a67ab32c4d9"}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:41:43.288492 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-3be8417c-1708-4849-a91e-0eb14e61ca2d tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] [instance: a97a9916-89c1-4925-bc46-3231d74787f7] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:41:43.291253 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=2 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:41:43.291928 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=6 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:41:43.298441 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3be8417c-1708-4849-a91e-0eb14e61ca2d tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:43.298939 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3be8417c-1708-4849-a91e-0eb14e61ca2d tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:43.299390 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3be8417c-1708-4849-a91e-0eb14e61ca2d tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:43.300106 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3be8417c-1708-4849-a91e-0eb14e61ca2d tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:43.300569 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3be8417c-1708-4849-a91e-0eb14e61ca2d tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:43.301010 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3be8417c-1708-4849-a91e-0eb14e61ca2d tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:43.540594 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-3be8417c-1708-4849-a91e-0eb14e61ca2d tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] 10.222.0.43 "POST /compute/v2.1/servers/a97a9916-89c1-4925-bc46-3231d74787f7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.258087 Oct 04 19:41:43.541242 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3546/7464] 10.222.0.43 () {60 vars in 1323 bytes} [Tue Oct 4 19:41:43 2022] POST /compute/v2.1/servers/a97a9916-89c1-4925-bc46-3231d74787f7/os-volume_attachments => generated 194 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:41:54.242203 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-1f43dd18-de1a-4967-996a-2e6d76e30182 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:41:54.242749 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-1f43dd18-de1a-4967-996a-2e6d76e30182 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] [instance: a97a9916-89c1-4925-bc46-3231d74787f7] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:41:54.244746 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=6 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:41:54.245585 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:41:54.246251 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=64 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:41:54.253432 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1f43dd18-de1a-4967-996a-2e6d76e30182 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:54.253937 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1f43dd18-de1a-4967-996a-2e6d76e30182 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:54.254393 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1f43dd18-de1a-4967-996a-2e6d76e30182 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:54.255108 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1f43dd18-de1a-4967-996a-2e6d76e30182 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:54.255581 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1f43dd18-de1a-4967-996a-2e6d76e30182 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:54.256027 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1f43dd18-de1a-4967-996a-2e6d76e30182 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:54.335742 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.objects.instance [None req-1f43dd18-de1a-4967-996a-2e6d76e30182 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lazy-loading 'services' on Instance uuid a97a9916-89c1-4925-bc46-3231d74787f7 {{(pid=123596) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 19:41:54.407038 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-1f43dd18-de1a-4967-996a-2e6d76e30182 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] 10.222.0.43 "DELETE /compute/v2.1/servers/a97a9916-89c1-4925-bc46-3231d74787f7/os-volume_attachments/224b79f8-2ce6-45ca-a8b6-6a67ab32c4d9" status: 202 len: 0 microversion: 2.1 time: 0.168872 Oct 04 19:41:54.407876 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3919/7465] 10.222.0.43 () {58 vars in 1416 bytes} [Tue Oct 4 19:41:54 2022] DELETE /compute/v2.1/servers/a97a9916-89c1-4925-bc46-3231d74787f7/os-volume_attachments/224b79f8-2ce6-45ca-a8b6-6a67ab32c4d9 => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:41:54.416821 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-e059eaad-3e9b-40a6-b1a8-a43b28ec8fa6 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:41:54.419859 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-e059eaad-3e9b-40a6-b1a8-a43b28ec8fa6 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] [instance: a97a9916-89c1-4925-bc46-3231d74787f7] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:41:54.422796 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:41:54.423630 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:41:54.430086 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e059eaad-3e9b-40a6-b1a8-a43b28ec8fa6 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:54.430571 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e059eaad-3e9b-40a6-b1a8-a43b28ec8fa6 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:54.431054 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e059eaad-3e9b-40a6-b1a8-a43b28ec8fa6 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:54.431756 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e059eaad-3e9b-40a6-b1a8-a43b28ec8fa6 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:54.432212 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e059eaad-3e9b-40a6-b1a8-a43b28ec8fa6 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:54.432639 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e059eaad-3e9b-40a6-b1a8-a43b28ec8fa6 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:54.471664 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-e059eaad-3e9b-40a6-b1a8-a43b28ec8fa6 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] 10.222.0.43 "GET /compute/v2.1/servers/a97a9916-89c1-4925-bc46-3231d74787f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059100 Oct 04 19:41:54.472240 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3547/7466] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Oct 4 19:41:54 2022] GET /compute/v2.1/servers/a97a9916-89c1-4925-bc46-3231d74787f7/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:41:55.486217 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-17ea8539-ff6e-49bc-ab48-9d4e311ea201 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:41:55.488958 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-17ea8539-ff6e-49bc-ab48-9d4e311ea201 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] [instance: a97a9916-89c1-4925-bc46-3231d74787f7] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:41:55.496207 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-17ea8539-ff6e-49bc-ab48-9d4e311ea201 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:55.496714 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-17ea8539-ff6e-49bc-ab48-9d4e311ea201 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:55.497856 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-17ea8539-ff6e-49bc-ab48-9d4e311ea201 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:55.498615 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-17ea8539-ff6e-49bc-ab48-9d4e311ea201 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:55.499094 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-17ea8539-ff6e-49bc-ab48-9d4e311ea201 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:55.499545 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-17ea8539-ff6e-49bc-ab48-9d4e311ea201 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:55.800894 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-17ea8539-ff6e-49bc-ab48-9d4e311ea201 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] 10.222.0.43 "GET /compute/v2.1/servers/a97a9916-89c1-4925-bc46-3231d74787f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.320517 Oct 04 19:41:55.801567 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3920/7467] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Oct 4 19:41:55 2022] GET /compute/v2.1/servers/a97a9916-89c1-4925-bc46-3231d74787f7/os-volume_attachments => generated 197 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:41:56.814554 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-7e1168b8-b485-4cb6-ba35-b4e8886ba6c3 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:41:56.817712 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-7e1168b8-b485-4cb6-ba35-b4e8886ba6c3 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] [instance: a97a9916-89c1-4925-bc46-3231d74787f7] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:41:56.824588 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7e1168b8-b485-4cb6-ba35-b4e8886ba6c3 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:56.825743 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7e1168b8-b485-4cb6-ba35-b4e8886ba6c3 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:56.826190 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7e1168b8-b485-4cb6-ba35-b4e8886ba6c3 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:56.826913 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7e1168b8-b485-4cb6-ba35-b4e8886ba6c3 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:56.827383 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7e1168b8-b485-4cb6-ba35-b4e8886ba6c3 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:56.827818 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7e1168b8-b485-4cb6-ba35-b4e8886ba6c3 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:56.857469 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-7e1168b8-b485-4cb6-ba35-b4e8886ba6c3 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] 10.222.0.43 "GET /compute/v2.1/servers/a97a9916-89c1-4925-bc46-3231d74787f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047942 Oct 04 19:41:56.858050 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3548/7468] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Oct 4 19:41:56 2022] GET /compute/v2.1/servers/a97a9916-89c1-4925-bc46-3231d74787f7/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:41:57.870248 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f16464da-4a54-4e5e-9af4-0673d03a1853 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:41:57.873066 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-f16464da-4a54-4e5e-9af4-0673d03a1853 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] [instance: a97a9916-89c1-4925-bc46-3231d74787f7] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:41:57.880129 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f16464da-4a54-4e5e-9af4-0673d03a1853 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:57.880635 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f16464da-4a54-4e5e-9af4-0673d03a1853 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:57.881096 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f16464da-4a54-4e5e-9af4-0673d03a1853 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:57.881842 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f16464da-4a54-4e5e-9af4-0673d03a1853 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:57.882313 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f16464da-4a54-4e5e-9af4-0673d03a1853 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:57.882772 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f16464da-4a54-4e5e-9af4-0673d03a1853 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:57.912286 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-f16464da-4a54-4e5e-9af4-0673d03a1853 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] 10.222.0.43 "GET /compute/v2.1/servers/a97a9916-89c1-4925-bc46-3231d74787f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046507 Oct 04 19:41:57.912851 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3921/7469] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Oct 4 19:41:57 2022] GET /compute/v2.1/servers/a97a9916-89c1-4925-bc46-3231d74787f7/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:41:58.924063 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-2714f42d-b880-4644-98c7-0745d434a040 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:41:58.926313 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-2714f42d-b880-4644-98c7-0745d434a040 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] [instance: a97a9916-89c1-4925-bc46-3231d74787f7] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:41:58.934626 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2714f42d-b880-4644-98c7-0745d434a040 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:58.935288 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2714f42d-b880-4644-98c7-0745d434a040 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:58.935726 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2714f42d-b880-4644-98c7-0745d434a040 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:58.936564 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2714f42d-b880-4644-98c7-0745d434a040 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:58.937023 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2714f42d-b880-4644-98c7-0745d434a040 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:58.937482 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2714f42d-b880-4644-98c7-0745d434a040 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:58.971870 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-2714f42d-b880-4644-98c7-0745d434a040 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] 10.222.0.43 "GET /compute/v2.1/servers/a97a9916-89c1-4925-bc46-3231d74787f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051766 Oct 04 19:41:58.972465 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3549/7470] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Oct 4 19:41:58 2022] GET /compute/v2.1/servers/a97a9916-89c1-4925-bc46-3231d74787f7/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:41:59.984646 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-ea83471c-c5ee-4acd-abec-3bc6b6fec123 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:41:59.987230 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-ea83471c-c5ee-4acd-abec-3bc6b6fec123 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] [instance: a97a9916-89c1-4925-bc46-3231d74787f7] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:41:59.994237 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ea83471c-c5ee-4acd-abec-3bc6b6fec123 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:59.994742 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ea83471c-c5ee-4acd-abec-3bc6b6fec123 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:59.995201 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ea83471c-c5ee-4acd-abec-3bc6b6fec123 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:59.995951 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ea83471c-c5ee-4acd-abec-3bc6b6fec123 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:59.996423 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ea83471c-c5ee-4acd-abec-3bc6b6fec123 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:59.996868 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ea83471c-c5ee-4acd-abec-3bc6b6fec123 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:00.025687 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-ea83471c-c5ee-4acd-abec-3bc6b6fec123 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] 10.222.0.43 "GET /compute/v2.1/servers/a97a9916-89c1-4925-bc46-3231d74787f7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044985 Oct 04 19:42:00.026249 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3922/7471] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Oct 4 19:41:59 2022] GET /compute/v2.1/servers/a97a9916-89c1-4925-bc46-3231d74787f7/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 19:42:00.037638 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-107c85c8-5eb1-4526-9d3b-203f2be9d935 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:42:00.038134 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-107c85c8-5eb1-4526-9d3b-203f2be9d935 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] [instance: a97a9916-89c1-4925-bc46-3231d74787f7] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:42:00.044998 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-107c85c8-5eb1-4526-9d3b-203f2be9d935 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:00.045515 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-107c85c8-5eb1-4526-9d3b-203f2be9d935 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:00.045954 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-107c85c8-5eb1-4526-9d3b-203f2be9d935 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:00.046652 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-107c85c8-5eb1-4526-9d3b-203f2be9d935 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:00.047101 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-107c85c8-5eb1-4526-9d3b-203f2be9d935 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:00.047531 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-107c85c8-5eb1-4526-9d3b-203f2be9d935 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:00.126365 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-107c85c8-5eb1-4526-9d3b-203f2be9d935 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] HTTP exception thrown: Instance a97a9916-89c1-4925-bc46-3231d74787f7 is not attached to volume 224b79f8-2ce6-45ca-a8b6-6a67ab32c4d9 Oct 04 19:42:00.128296 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-107c85c8-5eb1-4526-9d3b-203f2be9d935 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Request method failure captured: Oct 04 19:42:00.128296 n-d-851028-13 devstack@n-api.service[123595]: request: DELETE /compute/v2.1/servers/a97a9916-89c1-4925-bc46-3231d74787f7/os-volume_attachments/224b79f8-2ce6-45ca-a8b6-6a67ab32c4d9 HTTP/1.1 Oct 04 19:42:00.128296 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 19:42:00.128296 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 19:42:00.128296 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 19:42:00.128296 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 0 Oct 04 19:42:00.128296 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 19:42:00.128296 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 19:42:00.128296 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 19:42:00.128296 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 19:42:00.128296 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPIwgzYs4Qra3hBEV8yjoWKsOAEjSpqgTBwAVG3B_WdXGWjlSlsFSZK0zAWIYhYfyK9adIbntSb0OjMfzjP2rVmb8o93F7lb_vs4sYKuYVDdla1ygG_Vmlidd_igJmhLBbk5wMB6IaUMXeikg8dsZg9nDs1joViw1xmjsSf7IBIPIrRc Oct 04 19:42:00.128296 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 19:42:00.128296 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 19:42:00.128296 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 19:42:00.128296 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 19:42:00.128296 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 19:42:00.128296 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 19:42:00.128296 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: a14c17efe9404d6bb455d5dcc8b2c3c4 Oct 04 19:42:00.128296 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-TestEncryptedCinderVolumes-15666215 Oct 04 19:42:00.128296 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 19:42:00.128296 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 19:42:00.128296 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/a14c17efe9404d6bb455d5dcc8b2c3c4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_a14c17efe9404d6bb455d5dcc8b2c3c4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a14c17efe9404d6bb455d5dcc8b2c3c4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a14c17efe9404d6bb455d5dcc8b2c3c4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 19:42:00.128296 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-TestEncryptedCinderVolumes-15666215 Oct 04 19:42:00.128296 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: a14c17efe9404d6bb455d5dcc8b2c3c4 Oct 04 19:42:00.128296 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-15666215 Oct 04 19:42:00.128296 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-TestEncryptedCinderVolumes-15666215-project Oct 04 19:42:00.128296 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 19:42:00.128296 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 19:42:00.128296 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: fdd88e4643894b5dac67db4cb49c665b Oct 04 19:42:00.128296 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-TestEncryptedCinderVolumes-15666215-project Oct 04 19:42:00.128296 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 19:42:00.128296 n-d-851028-13 devstack@n-api.service[123595]: exception: Instance a97a9916-89c1-4925-bc46-3231d74787f7 is not attached to volume 224b79f8-2ce6-45ca-a8b6-6a67ab32c4d9 Oct 04 19:42:00.128296 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'server_id': 'a97a9916-89c1-4925-bc46-3231d74787f7', 'id': '224b79f8-2ce6-45ca-a8b6-6a67ab32c4d9'} Oct 04 19:42:00.128296 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:42:00.128296 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:42:00.128296 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 04 19:42:00.128296 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 04 19:42:00.128296 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 19:42:00.128296 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 19:42:00.128296 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 04 19:42:00.128296 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 04 19:42:00.128296 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 224b79f8-2ce6-45ca-a8b6-6a67ab32c4d9. Oct 04 19:42:00.128296 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:42:00.128296 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:42:00.128296 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:42:00.128296 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:42:00.128296 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:42:00.128296 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:42:00.128296 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:42:00.128296 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:42:00.128296 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:42:00.128296 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:42:00.128296 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 04 19:42:00.128296 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 04 19:42:00.128296 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a97a9916-89c1-4925-bc46-3231d74787f7 is not attached to volume 224b79f8-2ce6-45ca-a8b6-6a67ab32c4d9 Oct 04 19:42:00.128296 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:42:00.128296 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:42:00.128296 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:42:00.128296 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:42:00.128296 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:42:00.128296 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:42:00.133159 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:42:00.133159 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:42:00.133159 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a97a9916-89c1-4925-bc46-3231d74787f7 is not attached to volume 224b79f8-2ce6-45ca-a8b6-6a67ab32c4d9 Oct 04 19:42:00.133159 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:42:00.133159 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-107c85c8-5eb1-4526-9d3b-203f2be9d935 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Returning 404 to user: Instance a97a9916-89c1-4925-bc46-3231d74787f7 is not attached to volume 224b79f8-2ce6-45ca-a8b6-6a67ab32c4d9 {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:42:00.133159 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-107c85c8-5eb1-4526-9d3b-203f2be9d935 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] 10.222.0.43 "DELETE /compute/v2.1/servers/a97a9916-89c1-4925-bc46-3231d74787f7/os-volume_attachments/224b79f8-2ce6-45ca-a8b6-6a67ab32c4d9" status: 404 len: 154 microversion: 2.1 time: 0.096154 Oct 04 19:42:00.133159 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3550/7472] 10.222.0.43 () {58 vars in 1416 bytes} [Tue Oct 4 19:42:00 2022] DELETE /compute/v2.1/servers/a97a9916-89c1-4925-bc46-3231d74787f7/os-volume_attachments/224b79f8-2ce6-45ca-a8b6-6a67ab32c4d9 => generated 154 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:42:03.487489 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-334f86f1-6944-4756-a4cc-a1986b89503d tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:42:03.488381 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-334f86f1-6944-4756-a4cc-a1986b89503d tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] [instance: a97a9916-89c1-4925-bc46-3231d74787f7] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:42:03.492164 n-d-851028-13 devstack@n-api.service[123596]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 19:42:03.492323 n-d-851028-13 devstack@n-api.service[123596]: Tue Oct 4 19:42:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a97a9916-89c1-4925-bc46-3231d74787f7 (ip 10.222.0.43) !!! Oct 04 19:42:03.504315 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-334f86f1-6944-4756-a4cc-a1986b89503d tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:03.505086 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-334f86f1-6944-4756-a4cc-a1986b89503d tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:03.505834 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-334f86f1-6944-4756-a4cc-a1986b89503d tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:03.506577 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-334f86f1-6944-4756-a4cc-a1986b89503d tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:03.507061 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-334f86f1-6944-4756-a4cc-a1986b89503d tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:03.507661 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-334f86f1-6944-4756-a4cc-a1986b89503d tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:03.534296 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-334f86f1-6944-4756-a4cc-a1986b89503d tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] [instance: a97a9916-89c1-4925-bc46-3231d74787f7] Going to try to terminate instance {{(pid=123596) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 19:42:03.611847 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-334f86f1-6944-4756-a4cc-a1986b89503d tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] 10.222.0.43 "DELETE /compute/v2.1/servers/a97a9916-89c1-4925-bc46-3231d74787f7" status: 204 len: 0 microversion: 2.1 time: 0.129812 Oct 04 19:42:03.612604 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3923/7473] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 19:42:03 2022] DELETE /compute/v2.1/servers/a97a9916-89c1-4925-bc46-3231d74787f7 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:42:03.622315 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-389513ed-bd49-4d80-afa8-73ee82bb74ac tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:42:03.622943 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-389513ed-bd49-4d80-afa8-73ee82bb74ac tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] [instance: a97a9916-89c1-4925-bc46-3231d74787f7] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:42:03.633244 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-389513ed-bd49-4d80-afa8-73ee82bb74ac tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:03.633752 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-389513ed-bd49-4d80-afa8-73ee82bb74ac tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:03.634202 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-389513ed-bd49-4d80-afa8-73ee82bb74ac tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:03.634920 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-389513ed-bd49-4d80-afa8-73ee82bb74ac tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:03.635384 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-389513ed-bd49-4d80-afa8-73ee82bb74ac tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:03.635825 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-389513ed-bd49-4d80-afa8-73ee82bb74ac tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:03.770415 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-389513ed-bd49-4d80-afa8-73ee82bb74ac tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdd88e4643894b5dac67db4cb49c665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14c17efe9404d6bb455d5dcc8b2c3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:42:03.778297 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-389513ed-bd49-4d80-afa8-73ee82bb74ac tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] 10.222.0.43 "GET /compute/v2.1/servers/a97a9916-89c1-4925-bc46-3231d74787f7" status: 200 len: 1560 microversion: 2.1 time: 0.161028 Oct 04 19:42:03.778875 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3551/7474] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:42:03 2022] GET /compute/v2.1/servers/a97a9916-89c1-4925-bc46-3231d74787f7 => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:42:04.802675 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-05458293-285c-4e09-b383-ec3c55bec800 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:42:04.803352 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-05458293-285c-4e09-b383-ec3c55bec800 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] [instance: a97a9916-89c1-4925-bc46-3231d74787f7] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:42:04.810835 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-05458293-285c-4e09-b383-ec3c55bec800 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:04.811337 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-05458293-285c-4e09-b383-ec3c55bec800 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:04.811794 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-05458293-285c-4e09-b383-ec3c55bec800 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:04.812504 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-05458293-285c-4e09-b383-ec3c55bec800 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:04.812976 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-05458293-285c-4e09-b383-ec3c55bec800 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:04.813452 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-05458293-285c-4e09-b383-ec3c55bec800 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:04.946169 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-05458293-285c-4e09-b383-ec3c55bec800 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdd88e4643894b5dac67db4cb49c665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14c17efe9404d6bb455d5dcc8b2c3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:42:04.954494 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-05458293-285c-4e09-b383-ec3c55bec800 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] 10.222.0.43 "GET /compute/v2.1/servers/a97a9916-89c1-4925-bc46-3231d74787f7" status: 200 len: 1560 microversion: 2.1 time: 0.156263 Oct 04 19:42:04.955076 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3924/7475] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:42:04 2022] GET /compute/v2.1/servers/a97a9916-89c1-4925-bc46-3231d74787f7 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:42:05.625475 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-769dad19-74ab-4b4d-b7b2-0b43424c1121 req-461c74e4-95c2-49d7-b3f6-6b268967b756 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a97a9916-89c1-4925-bc46-3231d74787f7", "name": "network-vif-deleted", "tag": "cfc06dc7-950b-4ec1-8048-96b75d46de12"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:42:05.638599 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-769dad19-74ab-4b4d-b7b2-0b43424c1121 req-461c74e4-95c2-49d7-b3f6-6b268967b756 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:05.639103 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-769dad19-74ab-4b4d-b7b2-0b43424c1121 req-461c74e4-95c2-49d7-b3f6-6b268967b756 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:05.639735 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-769dad19-74ab-4b4d-b7b2-0b43424c1121 req-461c74e4-95c2-49d7-b3f6-6b268967b756 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:05.654988 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-769dad19-74ab-4b4d-b7b2-0b43424c1121 req-461c74e4-95c2-49d7-b3f6-6b268967b756 service nova] Creating event network-vif-deleted:cfc06dc7-950b-4ec1-8048-96b75d46de12 for instance a97a9916-89c1-4925-bc46-3231d74787f7 on n-h2-851028-13 Oct 04 19:42:05.661168 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-769dad19-74ab-4b4d-b7b2-0b43424c1121 req-461c74e4-95c2-49d7-b3f6-6b268967b756 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038762 Oct 04 19:42:05.662738 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3552/7476] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:42:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:42:05.977838 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-68d0988f-0947-4922-9c42-774d445deabe tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:42:05.978410 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-68d0988f-0947-4922-9c42-774d445deabe tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] [instance: a97a9916-89c1-4925-bc46-3231d74787f7] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:42:05.985317 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-68d0988f-0947-4922-9c42-774d445deabe tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:05.985861 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-68d0988f-0947-4922-9c42-774d445deabe tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:05.986323 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-68d0988f-0947-4922-9c42-774d445deabe tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:05.987044 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-68d0988f-0947-4922-9c42-774d445deabe tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:05.987518 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-68d0988f-0947-4922-9c42-774d445deabe tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:05.987972 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-68d0988f-0947-4922-9c42-774d445deabe tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:06.022765 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-68d0988f-0947-4922-9c42-774d445deabe tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:06.023268 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-68d0988f-0947-4922-9c42-774d445deabe tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:06.023749 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-68d0988f-0947-4922-9c42-774d445deabe tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:06.024248 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.objects.instance [None req-68d0988f-0947-4922-9c42-774d445deabe tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lazy-loading 'fault' on Instance uuid a97a9916-89c1-4925-bc46-3231d74787f7 {{(pid=123596) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 19:42:06.070969 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-68d0988f-0947-4922-9c42-774d445deabe tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdd88e4643894b5dac67db4cb49c665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14c17efe9404d6bb455d5dcc8b2c3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:42:06.080590 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-68d0988f-0947-4922-9c42-774d445deabe tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] 10.222.0.43 "GET /compute/v2.1/servers/a97a9916-89c1-4925-bc46-3231d74787f7" status: 200 len: 1353 microversion: 2.1 time: 0.106634 Oct 04 19:42:06.081296 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3925/7477] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:42:05 2022] GET /compute/v2.1/servers/a97a9916-89c1-4925-bc46-3231d74787f7 => generated 1353 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:42:07.106642 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-7301f798-5ee5-42ae-af65-0fd101e131cd tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:42:07.107353 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-7301f798-5ee5-42ae-af65-0fd101e131cd tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] [instance: a97a9916-89c1-4925-bc46-3231d74787f7] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:42:07.114413 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7301f798-5ee5-42ae-af65-0fd101e131cd tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:07.114903 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7301f798-5ee5-42ae-af65-0fd101e131cd tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:07.115350 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7301f798-5ee5-42ae-af65-0fd101e131cd tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:07.116050 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7301f798-5ee5-42ae-af65-0fd101e131cd tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:07.116509 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7301f798-5ee5-42ae-af65-0fd101e131cd tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:07.116943 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7301f798-5ee5-42ae-af65-0fd101e131cd tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:07.130145 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-7301f798-5ee5-42ae-af65-0fd101e131cd tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] HTTP exception thrown: Instance a97a9916-89c1-4925-bc46-3231d74787f7 could not be found. Oct 04 19:42:07.131787 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-7301f798-5ee5-42ae-af65-0fd101e131cd tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Request method failure captured: Oct 04 19:42:07.131787 n-d-851028-13 devstack@n-api.service[123595]: request: GET /compute/v2.1/servers/a97a9916-89c1-4925-bc46-3231d74787f7 HTTP/1.1 Oct 04 19:42:07.131787 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 19:42:07.131787 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 19:42:07.131787 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 19:42:07.131787 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 0 Oct 04 19:42:07.131787 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 19:42:07.131787 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 19:42:07.131787 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 19:42:07.131787 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 19:42:07.131787 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPIwgzYs4Qra3hBEV8yjoWKsOAEjSpqgTBwAVG3B_WdXGWjlSlsFSZK0zAWIYhYfyK9adIbntSb0OjMfzjP2rVmb8o93F7lb_vs4sYKuYVDdla1ygG_Vmlidd_igJmhLBbk5wMB6IaUMXeikg8dsZg9nDs1joViw1xmjsSf7IBIPIrRc Oct 04 19:42:07.131787 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 19:42:07.131787 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 19:42:07.131787 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 19:42:07.131787 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 19:42:07.131787 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 19:42:07.131787 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 19:42:07.131787 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: a14c17efe9404d6bb455d5dcc8b2c3c4 Oct 04 19:42:07.131787 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-TestEncryptedCinderVolumes-15666215 Oct 04 19:42:07.131787 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 19:42:07.131787 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 19:42:07.131787 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/a14c17efe9404d6bb455d5dcc8b2c3c4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_a14c17efe9404d6bb455d5dcc8b2c3c4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a14c17efe9404d6bb455d5dcc8b2c3c4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a14c17efe9404d6bb455d5dcc8b2c3c4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 19:42:07.131787 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-TestEncryptedCinderVolumes-15666215 Oct 04 19:42:07.131787 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: a14c17efe9404d6bb455d5dcc8b2c3c4 Oct 04 19:42:07.131787 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-15666215 Oct 04 19:42:07.131787 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-TestEncryptedCinderVolumes-15666215-project Oct 04 19:42:07.131787 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 19:42:07.131787 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 19:42:07.131787 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: fdd88e4643894b5dac67db4cb49c665b Oct 04 19:42:07.131787 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-TestEncryptedCinderVolumes-15666215-project Oct 04 19:42:07.131787 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 19:42:07.131787 n-d-851028-13 devstack@n-api.service[123595]: exception: Instance a97a9916-89c1-4925-bc46-3231d74787f7 could not be found. Oct 04 19:42:07.131787 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': 'a97a9916-89c1-4925-bc46-3231d74787f7'} Oct 04 19:42:07.131787 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:42:07.131787 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:42:07.131787 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:42:07.131787 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:42:07.131787 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:42:07.131787 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:42:07.131787 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:42:07.131787 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:42:07.131787 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:42:07.131787 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:42:07.131787 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a97a9916-89c1-4925-bc46-3231d74787f7 could not be found. Oct 04 19:42:07.131787 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:42:07.131787 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:42:07.131787 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:42:07.131787 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:42:07.131787 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:42:07.131787 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:42:07.131787 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:42:07.131787 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:42:07.131787 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:42:07.131787 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:42:07.131787 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:42:07.131787 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:42:07.131787 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:42:07.131787 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:42:07.131787 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:42:07.131787 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:42:07.131787 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a97a9916-89c1-4925-bc46-3231d74787f7 could not be found. Oct 04 19:42:07.131787 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:42:07.131787 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:42:07.131787 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:42:07.136496 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:42:07.136496 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:42:07.136496 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:42:07.136496 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:42:07.136496 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:42:07.136496 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a97a9916-89c1-4925-bc46-3231d74787f7 could not be found. Oct 04 19:42:07.136496 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:42:07.136496 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-7301f798-5ee5-42ae-af65-0fd101e131cd tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Returning 404 to user: Instance a97a9916-89c1-4925-bc46-3231d74787f7 could not be found. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:42:07.136496 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-7301f798-5ee5-42ae-af65-0fd101e131cd tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] 10.222.0.43 "GET /compute/v2.1/servers/a97a9916-89c1-4925-bc46-3231d74787f7" status: 404 len: 111 microversion: 2.1 time: 0.031484 Oct 04 19:42:07.136496 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3553/7478] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:42:07 2022] GET /compute/v2.1/servers/a97a9916-89c1-4925-bc46-3231d74787f7 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:42:07.142124 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-d5d83334-7bf9-4eb8-a987-ffc73ffbbdc1 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] Calling method '.version_select at 0x7fb21eb36160>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:42:07.162362 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-d5d83334-7bf9-4eb8-a987-ffc73ffbbdc1 tempest-TestEncryptedCinderVolumes-15666215 tempest-TestEncryptedCinderVolumes-15666215-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1312867778" status: 202 len: 0 microversion: 2.1 time: 0.024041 Oct 04 19:42:07.162939 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3926/7479] 10.222.0.43 () {58 vars in 1278 bytes} [Tue Oct 4 19:42:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1312867778 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:42:33.772060 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-3ed53294-6af5-421c-815d-4cde7c091d97 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Action: 'create', calling method: .version_select at 0x7fb21fc545e0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-2026570325", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIWOBmXS+JZg6Hj2O+gD1ZR+r/UpFboejOXelTtrXd41aTtCfAVoe20LJatZC+TKc7Yr+Z6/WumjnpE7AXziAezQvXAWSjhUcWPWXVV7nqbxXoYI/JWflSW8KyB0LwAMKg=="}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:42:33.777635 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_api:SELECT=14 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:42:33.778303 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=34 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:42:33.790061 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-3ed53294-6af5-421c-815d-4cde7c091d97 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Getting quotas for project 5a9d9c6a533a41a592780f78c4ac7eaa. Resources: {'key_pairs'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:42:33.795697 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-3ed53294-6af5-421c-815d-4cde7c091d97 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Getting quotas for user 5daff488843949a7835ee0766d898dec and project 5a9d9c6a533a41a592780f78c4ac7eaa. Resources: {'key_pairs'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:42:33.817947 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-3ed53294-6af5-421c-815d-4cde7c091d97 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.050089 Oct 04 19:42:33.818543 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3554/7480] 10.222.0.43 () {60 vars in 1159 bytes} [Tue Oct 4 19:42:33 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:42:33.866776 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:42:33.867550 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:42:33.872157 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-76cd813b-2888-47a1-9ac4-72f1146563d3 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1003084272", "imageRef": "4935f132-6fb6-4746-a3df-60676168a070", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-2026570325", "networks": [{"uuid": "0c6ffad7-f5e6-4ae6-8f5e-7e39599d9639"}]}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:42:33.924687 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.network.neutron [None req-76cd813b-2888-47a1-9ac4-72f1146563d3 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] validate_networks() for [('0c6ffad7-f5e6-4ae6-8f5e-7e39599d9639', None, None, None, None, None)] {{(pid=123596) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 19:42:34.691451 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-76cd813b-2888-47a1-9ac4-72f1146563d3 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Flavor limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:42:34.691905 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-76cd813b-2888-47a1-9ac4-72f1146563d3 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Image limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:42:34.692466 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-76cd813b-2888-47a1-9ac4-72f1146563d3 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Flavor pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:42:34.693247 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-76cd813b-2888-47a1-9ac4-72f1146563d3 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Image pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:42:34.694040 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-76cd813b-2888-47a1-9ac4-72f1146563d3 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:42:34.703526 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-76cd813b-2888-47a1-9ac4-72f1146563d3 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:34.704052 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-76cd813b-2888-47a1-9ac4-72f1146563d3 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:34.704505 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-76cd813b-2888-47a1-9ac4-72f1146563d3 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:34.705292 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-76cd813b-2888-47a1-9ac4-72f1146563d3 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:34.705763 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-76cd813b-2888-47a1-9ac4-72f1146563d3 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:34.706205 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-76cd813b-2888-47a1-9ac4-72f1146563d3 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:34.723598 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-76cd813b-2888-47a1-9ac4-72f1146563d3 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Getting quotas for project 5a9d9c6a533a41a592780f78c4ac7eaa. Resources: {'ram', 'cores', 'instances'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:42:34.728839 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-76cd813b-2888-47a1-9ac4-72f1146563d3 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Getting quotas for user 5daff488843949a7835ee0766d898dec and project 5a9d9c6a533a41a592780f78c4ac7eaa. Resources: {'ram', 'cores', 'instances'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:42:34.741052 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-76cd813b-2888-47a1-9ac4-72f1146563d3 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Going to run 1 instances... {{(pid=123596) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 19:42:34.743352 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-76cd813b-2888-47a1-9ac4-72f1146563d3 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] [instance: 1e433ac8-ad92-4249-887c-9f8e86b308cf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4935f132-6fb6-4746-a3df-60676168a070',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123596) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 19:42:34.789909 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-76cd813b-2888-47a1-9ac4-72f1146563d3 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.925218 Oct 04 19:42:34.790647 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3927/7481] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 19:42:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 927 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 19:42:34.802680 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-32884ac8-1765-4fa2-86ca-71046884b020 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:42:34.803445 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-32884ac8-1765-4fa2-86ca-71046884b020 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] [instance: 1e433ac8-ad92-4249-887c-9f8e86b308cf] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:42:34.862264 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-32884ac8-1765-4fa2-86ca-71046884b020 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5daff488843949a7835ee0766d898dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9d9c6a533a41a592780f78c4ac7eaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:42:34.869448 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-32884ac8-1765-4fa2-86ca-71046884b020 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] 10.222.0.43 "GET /compute/v2.1/servers/1e433ac8-ad92-4249-887c-9f8e86b308cf" status: 200 len: 1259 microversion: 2.1 time: 0.071567 Oct 04 19:42:34.870519 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3555/7482] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:42:34 2022] GET /compute/v2.1/servers/1e433ac8-ad92-4249-887c-9f8e86b308cf => generated 1259 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:42:35.893577 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-e173bad3-c152-452b-a72d-7ae93c0b8b2b tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:42:35.894435 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-e173bad3-c152-452b-a72d-7ae93c0b8b2b tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] [instance: 1e433ac8-ad92-4249-887c-9f8e86b308cf] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:42:35.900594 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e173bad3-c152-452b-a72d-7ae93c0b8b2b tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:35.901881 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e173bad3-c152-452b-a72d-7ae93c0b8b2b tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:35.902339 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e173bad3-c152-452b-a72d-7ae93c0b8b2b tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:35.903056 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e173bad3-c152-452b-a72d-7ae93c0b8b2b tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:35.903532 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e173bad3-c152-452b-a72d-7ae93c0b8b2b tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:35.903970 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e173bad3-c152-452b-a72d-7ae93c0b8b2b tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:36.003884 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-e173bad3-c152-452b-a72d-7ae93c0b8b2b tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5daff488843949a7835ee0766d898dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9d9c6a533a41a592780f78c4ac7eaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:42:36.012834 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-e173bad3-c152-452b-a72d-7ae93c0b8b2b tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] 10.222.0.43 "GET /compute/v2.1/servers/1e433ac8-ad92-4249-887c-9f8e86b308cf" status: 200 len: 1319 microversion: 2.1 time: 0.124126 Oct 04 19:42:36.013458 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3928/7483] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:42:35 2022] GET /compute/v2.1/servers/1e433ac8-ad92-4249-887c-9f8e86b308cf => generated 1319 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:42:37.036871 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-17a3127d-6384-4965-bfa0-e45f6ccd8ef5 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:42:37.037510 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-17a3127d-6384-4965-bfa0-e45f6ccd8ef5 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] [instance: 1e433ac8-ad92-4249-887c-9f8e86b308cf] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:42:37.045503 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-17a3127d-6384-4965-bfa0-e45f6ccd8ef5 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:37.046007 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-17a3127d-6384-4965-bfa0-e45f6ccd8ef5 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:37.046467 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-17a3127d-6384-4965-bfa0-e45f6ccd8ef5 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:37.047193 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-17a3127d-6384-4965-bfa0-e45f6ccd8ef5 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:37.047658 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-17a3127d-6384-4965-bfa0-e45f6ccd8ef5 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:37.048099 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-17a3127d-6384-4965-bfa0-e45f6ccd8ef5 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:37.188668 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-17a3127d-6384-4965-bfa0-e45f6ccd8ef5 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5daff488843949a7835ee0766d898dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9d9c6a533a41a592780f78c4ac7eaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:42:37.196460 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-17a3127d-6384-4965-bfa0-e45f6ccd8ef5 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] 10.222.0.43 "GET /compute/v2.1/servers/1e433ac8-ad92-4249-887c-9f8e86b308cf" status: 200 len: 1359 microversion: 2.1 time: 0.163488 Oct 04 19:42:37.201155 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3556/7484] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:42:37 2022] GET /compute/v2.1/servers/1e433ac8-ad92-4249-887c-9f8e86b308cf => generated 1359 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:42:38.220425 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-4ee40a91-b7fc-4939-b0bc-7153e35a5df2 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:42:38.221093 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-4ee40a91-b7fc-4939-b0bc-7153e35a5df2 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] [instance: 1e433ac8-ad92-4249-887c-9f8e86b308cf] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:42:38.228178 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4ee40a91-b7fc-4939-b0bc-7153e35a5df2 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:38.228688 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4ee40a91-b7fc-4939-b0bc-7153e35a5df2 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:38.229732 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4ee40a91-b7fc-4939-b0bc-7153e35a5df2 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:38.230462 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4ee40a91-b7fc-4939-b0bc-7153e35a5df2 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:38.230940 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4ee40a91-b7fc-4939-b0bc-7153e35a5df2 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:38.231393 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4ee40a91-b7fc-4939-b0bc-7153e35a5df2 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:38.383574 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-4ee40a91-b7fc-4939-b0bc-7153e35a5df2 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5daff488843949a7835ee0766d898dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9d9c6a533a41a592780f78c4ac7eaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:42:38.392065 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-4ee40a91-b7fc-4939-b0bc-7153e35a5df2 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] 10.222.0.43 "GET /compute/v2.1/servers/1e433ac8-ad92-4249-887c-9f8e86b308cf" status: 200 len: 1359 microversion: 2.1 time: 0.175870 Oct 04 19:42:38.393880 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3929/7485] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:42:38 2022] GET /compute/v2.1/servers/1e433ac8-ad92-4249-887c-9f8e86b308cf => generated 1359 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:42:39.417121 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-c7070e11-3d88-4aa4-99c6-e5733fde92b8 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:42:39.417849 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-c7070e11-3d88-4aa4-99c6-e5733fde92b8 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] [instance: 1e433ac8-ad92-4249-887c-9f8e86b308cf] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:42:39.426132 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c7070e11-3d88-4aa4-99c6-e5733fde92b8 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:39.426627 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c7070e11-3d88-4aa4-99c6-e5733fde92b8 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:39.427074 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c7070e11-3d88-4aa4-99c6-e5733fde92b8 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:39.427845 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c7070e11-3d88-4aa4-99c6-e5733fde92b8 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:39.428308 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c7070e11-3d88-4aa4-99c6-e5733fde92b8 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:39.428746 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c7070e11-3d88-4aa4-99c6-e5733fde92b8 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:39.570900 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-c7070e11-3d88-4aa4-99c6-e5733fde92b8 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5daff488843949a7835ee0766d898dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9d9c6a533a41a592780f78c4ac7eaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:42:39.580495 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-c7070e11-3d88-4aa4-99c6-e5733fde92b8 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] 10.222.0.43 "GET /compute/v2.1/servers/1e433ac8-ad92-4249-887c-9f8e86b308cf" status: 200 len: 1359 microversion: 2.1 time: 0.168465 Oct 04 19:42:39.581122 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3557/7486] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:42:39 2022] GET /compute/v2.1/servers/1e433ac8-ad92-4249-887c-9f8e86b308cf => generated 1359 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:42:40.606279 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-e367ac27-66fd-4524-9fb0-d9fff93f48db tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:42:40.607036 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-e367ac27-66fd-4524-9fb0-d9fff93f48db tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] [instance: 1e433ac8-ad92-4249-887c-9f8e86b308cf] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:42:40.615003 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e367ac27-66fd-4524-9fb0-d9fff93f48db tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:40.615878 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e367ac27-66fd-4524-9fb0-d9fff93f48db tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:40.616542 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e367ac27-66fd-4524-9fb0-d9fff93f48db tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:40.617537 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e367ac27-66fd-4524-9fb0-d9fff93f48db tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:40.618009 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e367ac27-66fd-4524-9fb0-d9fff93f48db tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:40.618640 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e367ac27-66fd-4524-9fb0-d9fff93f48db tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:40.769123 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-e367ac27-66fd-4524-9fb0-d9fff93f48db tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5daff488843949a7835ee0766d898dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9d9c6a533a41a592780f78c4ac7eaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:42:40.778236 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-e367ac27-66fd-4524-9fb0-d9fff93f48db tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] 10.222.0.43 "GET /compute/v2.1/servers/1e433ac8-ad92-4249-887c-9f8e86b308cf" status: 200 len: 1359 microversion: 2.1 time: 0.175950 Oct 04 19:42:40.779063 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3930/7487] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:42:40 2022] GET /compute/v2.1/servers/1e433ac8-ad92-4249-887c-9f8e86b308cf => generated 1359 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:42:41.802547 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-d19dbdc9-5656-49be-9e04-5586aecc17b4 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:42:41.803195 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-d19dbdc9-5656-49be-9e04-5586aecc17b4 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] [instance: 1e433ac8-ad92-4249-887c-9f8e86b308cf] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:42:41.810858 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d19dbdc9-5656-49be-9e04-5586aecc17b4 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:41.811360 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d19dbdc9-5656-49be-9e04-5586aecc17b4 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:41.811811 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d19dbdc9-5656-49be-9e04-5586aecc17b4 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:41.812533 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d19dbdc9-5656-49be-9e04-5586aecc17b4 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:41.812999 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d19dbdc9-5656-49be-9e04-5586aecc17b4 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:41.813466 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d19dbdc9-5656-49be-9e04-5586aecc17b4 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:41.959497 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-d19dbdc9-5656-49be-9e04-5586aecc17b4 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5daff488843949a7835ee0766d898dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9d9c6a533a41a592780f78c4ac7eaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:42:41.968664 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-d19dbdc9-5656-49be-9e04-5586aecc17b4 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] 10.222.0.43 "GET /compute/v2.1/servers/1e433ac8-ad92-4249-887c-9f8e86b308cf" status: 200 len: 1359 microversion: 2.1 time: 0.170115 Oct 04 19:42:41.969482 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3558/7488] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:42:41 2022] GET /compute/v2.1/servers/1e433ac8-ad92-4249-887c-9f8e86b308cf => generated 1359 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:42:42.992333 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-e49a279a-9e0b-49f9-9242-1aad570a57ce tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:42:42.993282 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-e49a279a-9e0b-49f9-9242-1aad570a57ce tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] [instance: 1e433ac8-ad92-4249-887c-9f8e86b308cf] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:42:43.011495 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e49a279a-9e0b-49f9-9242-1aad570a57ce tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:43.012033 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e49a279a-9e0b-49f9-9242-1aad570a57ce tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:43.012474 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e49a279a-9e0b-49f9-9242-1aad570a57ce tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:43.013243 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e49a279a-9e0b-49f9-9242-1aad570a57ce tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:43.013716 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e49a279a-9e0b-49f9-9242-1aad570a57ce tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:43.014182 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e49a279a-9e0b-49f9-9242-1aad570a57ce tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:43.152508 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-e49a279a-9e0b-49f9-9242-1aad570a57ce tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5daff488843949a7835ee0766d898dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9d9c6a533a41a592780f78c4ac7eaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:42:43.161634 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-e49a279a-9e0b-49f9-9242-1aad570a57ce tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] 10.222.0.43 "GET /compute/v2.1/servers/1e433ac8-ad92-4249-887c-9f8e86b308cf" status: 200 len: 1359 microversion: 2.1 time: 0.173440 Oct 04 19:42:43.162216 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3931/7489] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:42:42 2022] GET /compute/v2.1/servers/1e433ac8-ad92-4249-887c-9f8e86b308cf => generated 1359 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:42:44.184184 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-5b447916-98c9-4529-ba9c-38f91a6be965 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:42:44.185926 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-5b447916-98c9-4529-ba9c-38f91a6be965 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] [instance: 1e433ac8-ad92-4249-887c-9f8e86b308cf] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:42:44.193849 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5b447916-98c9-4529-ba9c-38f91a6be965 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:44.194366 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5b447916-98c9-4529-ba9c-38f91a6be965 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:44.194815 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5b447916-98c9-4529-ba9c-38f91a6be965 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:44.195682 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5b447916-98c9-4529-ba9c-38f91a6be965 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:44.196381 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5b447916-98c9-4529-ba9c-38f91a6be965 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:44.196973 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5b447916-98c9-4529-ba9c-38f91a6be965 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:44.334937 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-5b447916-98c9-4529-ba9c-38f91a6be965 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5daff488843949a7835ee0766d898dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9d9c6a533a41a592780f78c4ac7eaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:42:44.344085 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-5b447916-98c9-4529-ba9c-38f91a6be965 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] 10.222.0.43 "GET /compute/v2.1/servers/1e433ac8-ad92-4249-887c-9f8e86b308cf" status: 200 len: 1359 microversion: 2.1 time: 0.164015 Oct 04 19:42:44.344966 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3559/7490] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:42:44 2022] GET /compute/v2.1/servers/1e433ac8-ad92-4249-887c-9f8e86b308cf => generated 1359 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:42:44.774779 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-33e18b0d-31a2-4d3a-8bba-03971aab7495 req-b74e788c-6de9-4be1-ae8c-c5c2e2e15aca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e433ac8-ad92-4249-887c-9f8e86b308cf", "tag": "105c261c-54e6-400b-af95-1a3d72286f57"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:42:44.783133 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=2 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:42:44.784144 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=6 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:42:44.788807 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-33e18b0d-31a2-4d3a-8bba-03971aab7495 req-b74e788c-6de9-4be1-ae8c-c5c2e2e15aca service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:44.789345 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-33e18b0d-31a2-4d3a-8bba-03971aab7495 req-b74e788c-6de9-4be1-ae8c-c5c2e2e15aca service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:44.789798 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-33e18b0d-31a2-4d3a-8bba-03971aab7495 req-b74e788c-6de9-4be1-ae8c-c5c2e2e15aca service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:44.802414 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-33e18b0d-31a2-4d3a-8bba-03971aab7495 req-b74e788c-6de9-4be1-ae8c-c5c2e2e15aca service nova] Creating event network-changed:105c261c-54e6-400b-af95-1a3d72286f57 for instance 1e433ac8-ad92-4249-887c-9f8e86b308cf on n-h1-851028-13 Oct 04 19:42:44.807808 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-33e18b0d-31a2-4d3a-8bba-03971aab7495 req-b74e788c-6de9-4be1-ae8c-c5c2e2e15aca service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036279 Oct 04 19:42:44.808437 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3932/7491] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:42:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:42:45.367408 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-ea0454f3-2c08-4026-83ea-23816c05cf51 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:42:45.367935 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-ea0454f3-2c08-4026-83ea-23816c05cf51 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] [instance: 1e433ac8-ad92-4249-887c-9f8e86b308cf] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:42:45.369931 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=6 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:42:45.376064 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ea0454f3-2c08-4026-83ea-23816c05cf51 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:45.376544 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ea0454f3-2c08-4026-83ea-23816c05cf51 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:45.376983 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ea0454f3-2c08-4026-83ea-23816c05cf51 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:45.377733 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ea0454f3-2c08-4026-83ea-23816c05cf51 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:45.378184 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ea0454f3-2c08-4026-83ea-23816c05cf51 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:45.378611 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ea0454f3-2c08-4026-83ea-23816c05cf51 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:45.508921 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-ea0454f3-2c08-4026-83ea-23816c05cf51 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5daff488843949a7835ee0766d898dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9d9c6a533a41a592780f78c4ac7eaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:42:45.517597 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-ea0454f3-2c08-4026-83ea-23816c05cf51 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] 10.222.0.43 "GET /compute/v2.1/servers/1e433ac8-ad92-4249-887c-9f8e86b308cf" status: 200 len: 1359 microversion: 2.1 time: 0.154105 Oct 04 19:42:45.518284 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3560/7492] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:42:45 2022] GET /compute/v2.1/servers/1e433ac8-ad92-4249-887c-9f8e86b308cf => generated 1359 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:42:46.543071 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-0c9c33f4-7f0b-48b7-8404-3fd4d57c195c tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:42:46.543793 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-0c9c33f4-7f0b-48b7-8404-3fd4d57c195c tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] [instance: 1e433ac8-ad92-4249-887c-9f8e86b308cf] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:42:46.550059 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0c9c33f4-7f0b-48b7-8404-3fd4d57c195c tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:46.550566 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0c9c33f4-7f0b-48b7-8404-3fd4d57c195c tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:46.551032 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0c9c33f4-7f0b-48b7-8404-3fd4d57c195c tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:46.551743 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0c9c33f4-7f0b-48b7-8404-3fd4d57c195c tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:46.552216 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0c9c33f4-7f0b-48b7-8404-3fd4d57c195c tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:46.552665 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0c9c33f4-7f0b-48b7-8404-3fd4d57c195c tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:46.689004 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-0c9c33f4-7f0b-48b7-8404-3fd4d57c195c tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5daff488843949a7835ee0766d898dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9d9c6a533a41a592780f78c4ac7eaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:42:46.696703 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-0c9c33f4-7f0b-48b7-8404-3fd4d57c195c tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] 10.222.0.43 "GET /compute/v2.1/servers/1e433ac8-ad92-4249-887c-9f8e86b308cf" status: 200 len: 1359 microversion: 2.1 time: 0.159415 Oct 04 19:42:46.697341 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3933/7493] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:42:46 2022] GET /compute/v2.1/servers/1e433ac8-ad92-4249-887c-9f8e86b308cf => generated 1359 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:42:47.719713 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-bdb457b1-29e3-4ead-a068-a0aab707da70 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:42:47.720338 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-bdb457b1-29e3-4ead-a068-a0aab707da70 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] [instance: 1e433ac8-ad92-4249-887c-9f8e86b308cf] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:42:47.727222 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bdb457b1-29e3-4ead-a068-a0aab707da70 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:47.727712 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bdb457b1-29e3-4ead-a068-a0aab707da70 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:47.728166 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bdb457b1-29e3-4ead-a068-a0aab707da70 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:47.728863 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bdb457b1-29e3-4ead-a068-a0aab707da70 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:47.729365 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bdb457b1-29e3-4ead-a068-a0aab707da70 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:47.729801 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bdb457b1-29e3-4ead-a068-a0aab707da70 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:47.856017 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-bdb457b1-29e3-4ead-a068-a0aab707da70 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5daff488843949a7835ee0766d898dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9d9c6a533a41a592780f78c4ac7eaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:42:47.863751 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-bdb457b1-29e3-4ead-a068-a0aab707da70 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] 10.222.0.43 "GET /compute/v2.1/servers/1e433ac8-ad92-4249-887c-9f8e86b308cf" status: 200 len: 1359 microversion: 2.1 time: 0.148078 Oct 04 19:42:47.864321 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3561/7494] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:42:47 2022] GET /compute/v2.1/servers/1e433ac8-ad92-4249-887c-9f8e86b308cf => generated 1359 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:42:48.886925 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-72d583a6-b261-4dc8-8933-cde9751b6ff2 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:42:48.887552 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-72d583a6-b261-4dc8-8933-cde9751b6ff2 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] [instance: 1e433ac8-ad92-4249-887c-9f8e86b308cf] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:42:48.895632 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-72d583a6-b261-4dc8-8933-cde9751b6ff2 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:48.897622 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-72d583a6-b261-4dc8-8933-cde9751b6ff2 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:48.897622 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-72d583a6-b261-4dc8-8933-cde9751b6ff2 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:48.897622 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-72d583a6-b261-4dc8-8933-cde9751b6ff2 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:48.897622 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-72d583a6-b261-4dc8-8933-cde9751b6ff2 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:48.898307 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-72d583a6-b261-4dc8-8933-cde9751b6ff2 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:49.038716 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-72d583a6-b261-4dc8-8933-cde9751b6ff2 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5daff488843949a7835ee0766d898dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9d9c6a533a41a592780f78c4ac7eaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:42:49.046506 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-72d583a6-b261-4dc8-8933-cde9751b6ff2 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] 10.222.0.43 "GET /compute/v2.1/servers/1e433ac8-ad92-4249-887c-9f8e86b308cf" status: 200 len: 1359 microversion: 2.1 time: 0.164061 Oct 04 19:42:49.047092 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3934/7495] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:42:48 2022] GET /compute/v2.1/servers/1e433ac8-ad92-4249-887c-9f8e86b308cf => generated 1359 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:42:50.069074 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-1707cad8-f795-4815-b0c8-f2afeb95f776 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:42:50.069727 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-1707cad8-f795-4815-b0c8-f2afeb95f776 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] [instance: 1e433ac8-ad92-4249-887c-9f8e86b308cf] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:42:50.077048 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1707cad8-f795-4815-b0c8-f2afeb95f776 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:50.077659 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1707cad8-f795-4815-b0c8-f2afeb95f776 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:50.078156 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1707cad8-f795-4815-b0c8-f2afeb95f776 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:50.078866 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1707cad8-f795-4815-b0c8-f2afeb95f776 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:50.079322 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1707cad8-f795-4815-b0c8-f2afeb95f776 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:50.079751 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1707cad8-f795-4815-b0c8-f2afeb95f776 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:50.164719 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-5373b872-dae2-459e-a056-5094d0b37cda req-016e8e53-5356-4657-bf53-cec199cc55f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e433ac8-ad92-4249-887c-9f8e86b308cf", "name": "network-vif-plugged", "status": "completed", "tag": "105c261c-54e6-400b-af95-1a3d72286f57"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:42:50.176092 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-5373b872-dae2-459e-a056-5094d0b37cda req-016e8e53-5356-4657-bf53-cec199cc55f3 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:50.176678 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-5373b872-dae2-459e-a056-5094d0b37cda req-016e8e53-5356-4657-bf53-cec199cc55f3 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:50.177456 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-5373b872-dae2-459e-a056-5094d0b37cda req-016e8e53-5356-4657-bf53-cec199cc55f3 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:50.188920 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-5373b872-dae2-459e-a056-5094d0b37cda req-016e8e53-5356-4657-bf53-cec199cc55f3 service nova] Creating event network-vif-plugged:105c261c-54e6-400b-af95-1a3d72286f57 for instance 1e433ac8-ad92-4249-887c-9f8e86b308cf on n-h1-851028-13 Oct 04 19:42:50.194054 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-5373b872-dae2-459e-a056-5094d0b37cda req-016e8e53-5356-4657-bf53-cec199cc55f3 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033658 Oct 04 19:42:50.194922 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3935/7496] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:42:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:42:50.212777 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-1707cad8-f795-4815-b0c8-f2afeb95f776 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5daff488843949a7835ee0766d898dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9d9c6a533a41a592780f78c4ac7eaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:42:50.221094 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-1707cad8-f795-4815-b0c8-f2afeb95f776 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] 10.222.0.43 "GET /compute/v2.1/servers/1e433ac8-ad92-4249-887c-9f8e86b308cf" status: 200 len: 1359 microversion: 2.1 time: 0.155894 Oct 04 19:42:50.221709 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3562/7497] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:42:50 2022] GET /compute/v2.1/servers/1e433ac8-ad92-4249-887c-9f8e86b308cf => generated 1359 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:42:51.246636 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-c52b4d4b-a854-4545-af79-d5007a9ae2e6 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:42:51.247383 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-c52b4d4b-a854-4545-af79-d5007a9ae2e6 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] [instance: 1e433ac8-ad92-4249-887c-9f8e86b308cf] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:42:51.253691 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c52b4d4b-a854-4545-af79-d5007a9ae2e6 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:51.254191 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c52b4d4b-a854-4545-af79-d5007a9ae2e6 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:51.254648 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c52b4d4b-a854-4545-af79-d5007a9ae2e6 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:51.255365 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c52b4d4b-a854-4545-af79-d5007a9ae2e6 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:51.255837 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c52b4d4b-a854-4545-af79-d5007a9ae2e6 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:51.256282 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c52b4d4b-a854-4545-af79-d5007a9ae2e6 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:51.394643 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-c52b4d4b-a854-4545-af79-d5007a9ae2e6 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5daff488843949a7835ee0766d898dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9d9c6a533a41a592780f78c4ac7eaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:42:51.403012 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-c52b4d4b-a854-4545-af79-d5007a9ae2e6 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] 10.222.0.43 "GET /compute/v2.1/servers/1e433ac8-ad92-4249-887c-9f8e86b308cf" status: 200 len: 1359 microversion: 2.1 time: 0.162144 Oct 04 19:42:51.403627 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3936/7498] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:42:51 2022] GET /compute/v2.1/servers/1e433ac8-ad92-4249-887c-9f8e86b308cf => generated 1359 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:42:52.426673 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-47765eae-b8e5-42f5-8c92-77c61c72dd01 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:42:52.427292 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-47765eae-b8e5-42f5-8c92-77c61c72dd01 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] [instance: 1e433ac8-ad92-4249-887c-9f8e86b308cf] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:42:52.434817 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-47765eae-b8e5-42f5-8c92-77c61c72dd01 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:52.435301 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-47765eae-b8e5-42f5-8c92-77c61c72dd01 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:52.436096 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-47765eae-b8e5-42f5-8c92-77c61c72dd01 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:52.436800 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-47765eae-b8e5-42f5-8c92-77c61c72dd01 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:52.437284 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-47765eae-b8e5-42f5-8c92-77c61c72dd01 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:52.437718 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-47765eae-b8e5-42f5-8c92-77c61c72dd01 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:52.573019 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-47765eae-b8e5-42f5-8c92-77c61c72dd01 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5daff488843949a7835ee0766d898dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9d9c6a533a41a592780f78c4ac7eaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:42:52.580726 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-47765eae-b8e5-42f5-8c92-77c61c72dd01 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] 10.222.0.43 "GET /compute/v2.1/servers/1e433ac8-ad92-4249-887c-9f8e86b308cf" status: 200 len: 1548 microversion: 2.1 time: 0.157998 Oct 04 19:42:52.581340 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3563/7499] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:42:52 2022] GET /compute/v2.1/servers/1e433ac8-ad92-4249-887c-9f8e86b308cf => generated 1548 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:42:52.602672 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f97a276d-3e73-46ae-b21f-48c09960ee31 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:42:52.603862 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-f97a276d-3e73-46ae-b21f-48c09960ee31 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] [instance: 1e433ac8-ad92-4249-887c-9f8e86b308cf] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:42:52.610705 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f97a276d-3e73-46ae-b21f-48c09960ee31 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:52.611211 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f97a276d-3e73-46ae-b21f-48c09960ee31 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:52.611671 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f97a276d-3e73-46ae-b21f-48c09960ee31 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:52.612382 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f97a276d-3e73-46ae-b21f-48c09960ee31 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:52.612857 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f97a276d-3e73-46ae-b21f-48c09960ee31 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:52.613347 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f97a276d-3e73-46ae-b21f-48c09960ee31 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:52.738654 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-f97a276d-3e73-46ae-b21f-48c09960ee31 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5daff488843949a7835ee0766d898dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9d9c6a533a41a592780f78c4ac7eaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:42:52.747095 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-f97a276d-3e73-46ae-b21f-48c09960ee31 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] 10.222.0.43 "GET /compute/v2.1/servers/1e433ac8-ad92-4249-887c-9f8e86b308cf" status: 200 len: 1548 microversion: 2.1 time: 0.148265 Oct 04 19:42:52.747677 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3937/7500] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:42:52 2022] GET /compute/v2.1/servers/1e433ac8-ad92-4249-887c-9f8e86b308cf => generated 1548 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:42:52.768626 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-546a9d9c-56fb-4211-b3e9-d6cf91ff36b5 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:42:52.773399 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-546a9d9c-56fb-4211-b3e9-d6cf91ff36b5 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5daff488843949a7835ee0766d898dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9d9c6a533a41a592780f78c4ac7eaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:42:52.774163 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-546a9d9c-56fb-4211-b3e9-d6cf91ff36b5 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Searching by: {'deleted': False, 'project_id': '5a9d9c6a533a41a592780f78c4ac7eaa'} {{(pid=123595) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 19:42:52.779896 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-546a9d9c-56fb-4211-b3e9-d6cf91ff36b5 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:52.780374 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-546a9d9c-56fb-4211-b3e9-d6cf91ff36b5 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:52.780808 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-546a9d9c-56fb-4211-b3e9-d6cf91ff36b5 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:52.781570 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-546a9d9c-56fb-4211-b3e9-d6cf91ff36b5 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:52.782018 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-546a9d9c-56fb-4211-b3e9-d6cf91ff36b5 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:52.782443 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-546a9d9c-56fb-4211-b3e9-d6cf91ff36b5 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:52.805724 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.multi_cell_list [None req-546a9d9c-56fb-4211-b3e9-d6cf91ff36b5 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=123595) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 19:42:52.831103 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-546a9d9c-56fb-4211-b3e9-d6cf91ff36b5 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] 10.222.0.43 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.066252 Oct 04 19:42:52.831681 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3564/7501] 10.222.0.43 () {58 vars in 1125 bytes} [Tue Oct 4 19:42:52 2022] GET /compute/v2.1/servers => generated 343 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:42:52.844093 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f9e72d84-bfa1-4a26-b22d-1cbf4c958d58 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:42:52.844732 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-f9e72d84-bfa1-4a26-b22d-1cbf4c958d58 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] [instance: 1e433ac8-ad92-4249-887c-9f8e86b308cf] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:42:52.850757 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f9e72d84-bfa1-4a26-b22d-1cbf4c958d58 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:52.851260 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f9e72d84-bfa1-4a26-b22d-1cbf4c958d58 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:52.851722 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f9e72d84-bfa1-4a26-b22d-1cbf4c958d58 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:52.852434 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f9e72d84-bfa1-4a26-b22d-1cbf4c958d58 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:52.852911 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f9e72d84-bfa1-4a26-b22d-1cbf4c958d58 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:52.854052 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f9e72d84-bfa1-4a26-b22d-1cbf4c958d58 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:52.980366 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-f9e72d84-bfa1-4a26-b22d-1cbf4c958d58 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5daff488843949a7835ee0766d898dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9d9c6a533a41a592780f78c4ac7eaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:42:52.988048 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-f9e72d84-bfa1-4a26-b22d-1cbf4c958d58 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] 10.222.0.43 "GET /compute/v2.1/servers/1e433ac8-ad92-4249-887c-9f8e86b308cf" status: 200 len: 1548 microversion: 2.1 time: 0.147873 Oct 04 19:42:52.988616 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3938/7502] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:42:52 2022] GET /compute/v2.1/servers/1e433ac8-ad92-4249-887c-9f8e86b308cf => generated 1548 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:42:54.528179 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-a89e464f-4f21-4e86-b1f1-a46c0aaff00e tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6facc759-534d-4d0b-8a58-b7ad7e1dd09e"}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:42:54.530584 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-a89e464f-4f21-4e86-b1f1-a46c0aaff00e tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] [instance: 1e433ac8-ad92-4249-887c-9f8e86b308cf] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:42:54.537366 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a89e464f-4f21-4e86-b1f1-a46c0aaff00e tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:54.537858 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a89e464f-4f21-4e86-b1f1-a46c0aaff00e tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:54.538306 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a89e464f-4f21-4e86-b1f1-a46c0aaff00e tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:54.539010 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a89e464f-4f21-4e86-b1f1-a46c0aaff00e tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:54.539478 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a89e464f-4f21-4e86-b1f1-a46c0aaff00e tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:54.539914 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a89e464f-4f21-4e86-b1f1-a46c0aaff00e tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:54.776975 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-a89e464f-4f21-4e86-b1f1-a46c0aaff00e tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] 10.222.0.43 "POST /compute/v2.1/servers/1e433ac8-ad92-4249-887c-9f8e86b308cf/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.253108 Oct 04 19:42:54.777783 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3565/7503] 10.222.0.43 () {60 vars in 1323 bytes} [Tue Oct 4 19:42:54 2022] POST /compute/v2.1/servers/1e433ac8-ad92-4249-887c-9f8e86b308cf/os-volume_attachments => generated 194 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:43:07.834833 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-da9bae77-50f1-424f-9850-2917ed0ec165 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:43:07.835489 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-da9bae77-50f1-424f-9850-2917ed0ec165 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] [instance: 1e433ac8-ad92-4249-887c-9f8e86b308cf] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:43:07.838602 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:43:07.839285 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=60 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:43:07.845080 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-da9bae77-50f1-424f-9850-2917ed0ec165 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:43:07.845596 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-da9bae77-50f1-424f-9850-2917ed0ec165 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:43:07.846046 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-da9bae77-50f1-424f-9850-2917ed0ec165 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:43:07.846747 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-da9bae77-50f1-424f-9850-2917ed0ec165 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:43:07.847213 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-da9bae77-50f1-424f-9850-2917ed0ec165 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:43:07.847652 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-da9bae77-50f1-424f-9850-2917ed0ec165 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:43:07.977484 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-da9bae77-50f1-424f-9850-2917ed0ec165 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5daff488843949a7835ee0766d898dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9d9c6a533a41a592780f78c4ac7eaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:43:07.985842 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-da9bae77-50f1-424f-9850-2917ed0ec165 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] 10.222.0.43 "GET /compute/v2.1/servers/1e433ac8-ad92-4249-887c-9f8e86b308cf" status: 200 len: 1594 microversion: 2.1 time: 0.155207 Oct 04 19:43:07.987032 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3939/7504] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:43:07 2022] GET /compute/v2.1/servers/1e433ac8-ad92-4249-887c-9f8e86b308cf => generated 1594 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:43:09.908502 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-6216fa16-bfa4-4600-ab62-6ca792f98a7a req-5c80a8e1-087c-4d7e-b652-ee12cb839de1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e433ac8-ad92-4249-887c-9f8e86b308cf", "tag": "105c261c-54e6-400b-af95-1a3d72286f57"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:43:09.915080 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=2 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:43:09.915995 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=1 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:43:09.917501 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:43:09.925665 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-6216fa16-bfa4-4600-ab62-6ca792f98a7a req-5c80a8e1-087c-4d7e-b652-ee12cb839de1 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:43:09.926270 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-6216fa16-bfa4-4600-ab62-6ca792f98a7a req-5c80a8e1-087c-4d7e-b652-ee12cb839de1 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:43:09.926786 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-6216fa16-bfa4-4600-ab62-6ca792f98a7a req-5c80a8e1-087c-4d7e-b652-ee12cb839de1 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:43:09.942872 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-6216fa16-bfa4-4600-ab62-6ca792f98a7a req-5c80a8e1-087c-4d7e-b652-ee12cb839de1 service nova] Creating event network-changed:105c261c-54e6-400b-af95-1a3d72286f57 for instance 1e433ac8-ad92-4249-887c-9f8e86b308cf on n-h1-851028-13 Oct 04 19:43:09.947713 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-6216fa16-bfa4-4600-ab62-6ca792f98a7a req-5c80a8e1-087c-4d7e-b652-ee12cb839de1 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043704 Oct 04 19:43:09.948839 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3566/7505] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:43:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:43:11.013820 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-d0d0aaf8-fae5-4b3c-a8b9-2dd25c2406ab tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1152015357"}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:43:11.014267 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-d0d0aaf8-fae5-4b3c-a8b9-2dd25c2406ab tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] [instance: 1e433ac8-ad92-4249-887c-9f8e86b308cf] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:43:11.028544 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d0d0aaf8-fae5-4b3c-a8b9-2dd25c2406ab tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:43:11.029092 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d0d0aaf8-fae5-4b3c-a8b9-2dd25c2406ab tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:43:11.029570 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d0d0aaf8-fae5-4b3c-a8b9-2dd25c2406ab tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:43:11.030296 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d0d0aaf8-fae5-4b3c-a8b9-2dd25c2406ab tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:43:11.030766 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d0d0aaf8-fae5-4b3c-a8b9-2dd25c2406ab tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:43:11.031214 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d0d0aaf8-fae5-4b3c-a8b9-2dd25c2406ab tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:43:11.157685 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.network.security_group_api [None req-d0d0aaf8-fae5-4b3c-a8b9-2dd25c2406ab tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Adding security group bc0b04fd-f6d4-4d88-9e24-b24dc69e47c7 to port 105c261c-54e6-400b-af95-1a3d72286f57 Oct 04 19:43:11.469639 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-d0d0aaf8-fae5-4b3c-a8b9-2dd25c2406ab tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] 10.222.0.43 "POST /compute/v2.1/servers/1e433ac8-ad92-4249-887c-9f8e86b308cf/action" status: 202 len: 0 microversion: 2.1 time: 0.460510 Oct 04 19:43:11.470775 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3940/7506] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 19:43:11 2022] POST /compute/v2.1/servers/1e433ac8-ad92-4249-887c-9f8e86b308cf/action => generated 0 bytes in 462 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:43:11.479496 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-f75d0f63-be31-4afc-8bb3-fb499ffb2f6d tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:43:11.480123 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-f75d0f63-be31-4afc-8bb3-fb499ffb2f6d tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] [instance: 1e433ac8-ad92-4249-887c-9f8e86b308cf] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:43:11.488517 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f75d0f63-be31-4afc-8bb3-fb499ffb2f6d tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:43:11.489005 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f75d0f63-be31-4afc-8bb3-fb499ffb2f6d tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:43:11.489477 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f75d0f63-be31-4afc-8bb3-fb499ffb2f6d tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:43:11.490171 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f75d0f63-be31-4afc-8bb3-fb499ffb2f6d tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:43:11.491135 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f75d0f63-be31-4afc-8bb3-fb499ffb2f6d tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:43:11.491561 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f75d0f63-be31-4afc-8bb3-fb499ffb2f6d tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:43:11.646159 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-f75d0f63-be31-4afc-8bb3-fb499ffb2f6d tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5daff488843949a7835ee0766d898dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9d9c6a533a41a592780f78c4ac7eaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:43:11.655010 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-f75d0f63-be31-4afc-8bb3-fb499ffb2f6d tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] 10.222.0.43 "GET /compute/v2.1/servers/1e433ac8-ad92-4249-887c-9f8e86b308cf" status: 200 len: 1760 microversion: 2.1 time: 0.180186 Oct 04 19:43:11.655598 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3567/7507] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:43:11 2022] GET /compute/v2.1/servers/1e433ac8-ad92-4249-887c-9f8e86b308cf => generated 1760 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:43:11.963338 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-bf9463a6-1e40-4577-9521-0bd6a693899c req-542ea550-4e06-4644-9568-ad3c5565e34b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e433ac8-ad92-4249-887c-9f8e86b308cf", "tag": "105c261c-54e6-400b-af95-1a3d72286f57"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:43:11.972766 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-bf9463a6-1e40-4577-9521-0bd6a693899c req-542ea550-4e06-4644-9568-ad3c5565e34b service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:43:11.973303 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-bf9463a6-1e40-4577-9521-0bd6a693899c req-542ea550-4e06-4644-9568-ad3c5565e34b service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:43:11.973759 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-bf9463a6-1e40-4577-9521-0bd6a693899c req-542ea550-4e06-4644-9568-ad3c5565e34b service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:43:11.985594 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-bf9463a6-1e40-4577-9521-0bd6a693899c req-542ea550-4e06-4644-9568-ad3c5565e34b service nova] Creating event network-changed:105c261c-54e6-400b-af95-1a3d72286f57 for instance 1e433ac8-ad92-4249-887c-9f8e86b308cf on n-h1-851028-13 Oct 04 19:43:11.990692 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-bf9463a6-1e40-4577-9521-0bd6a693899c req-542ea550-4e06-4644-9568-ad3c5565e34b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031201 Oct 04 19:43:11.991291 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3941/7508] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:43:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:44:50.751444 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_api:SELECT=4 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:44:50.752209 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=8 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:44:50.753380 n-d-851028-13 devstack@n-api.service[123595]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 19:44:50.753554 n-d-851028-13 devstack@n-api.service[123595]: Tue Oct 4 19:44:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1e433ac8-ad92-4249-887c-9f8e86b308cf/action (ip 10.222.0.43) !!! Oct 04 19:44:50.761831 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-596b57bd-d4e4-435e-a1bc-2c65d4bfe698 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:44:50.764094 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-596b57bd-d4e4-435e-a1bc-2c65d4bfe698 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] [instance: 1e433ac8-ad92-4249-887c-9f8e86b308cf] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:44:50.774217 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-596b57bd-d4e4-435e-a1bc-2c65d4bfe698 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:44:50.775384 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-596b57bd-d4e4-435e-a1bc-2c65d4bfe698 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:44:50.775856 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-596b57bd-d4e4-435e-a1bc-2c65d4bfe698 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:44:50.776561 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-596b57bd-d4e4-435e-a1bc-2c65d4bfe698 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:44:50.777016 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-596b57bd-d4e4-435e-a1bc-2c65d4bfe698 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:44:50.777478 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-596b57bd-d4e4-435e-a1bc-2c65d4bfe698 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:44:50.851316 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-596b57bd-d4e4-435e-a1bc-2c65d4bfe698 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] 10.222.0.43 "POST /compute/v2.1/servers/1e433ac8-ad92-4249-887c-9f8e86b308cf/action" status: 202 len: 0 microversion: 2.1 time: 0.101619 Oct 04 19:44:50.852177 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3568/7509] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 19:44:50 2022] POST /compute/v2.1/servers/1e433ac8-ad92-4249-887c-9f8e86b308cf/action => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:44:50.858410 n-d-851028-13 devstack@n-api.service[123596]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ced6bcbb-f7de-451e-861c-054aba6c81f5] AMQP server on 10.222.0.43:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Oct 04 19:44:50.859323 n-d-851028-13 devstack@n-api.service[123596]: ERROR oslo.messaging._drivers.impl_rabbit [-] [c592c758-2dc3-4024-92b0-c949515e0281] AMQP server on 10.222.0.43:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 19:44:50.860079 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_api:SELECT=6 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:44:50.860868 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=12 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:44:50.862373 n-d-851028-13 devstack@n-api.service[123596]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 04 19:44:50.862686 n-d-851028-13 devstack@n-api.service[123596]: Tue Oct 4 19:44:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1e433ac8-ad92-4249-887c-9f8e86b308cf (ip 10.222.0.43) !!! Oct 04 19:44:50.869307 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-85dfb560-eac6-4c74-b025-2de44b1a44c7 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:44:50.870029 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-85dfb560-eac6-4c74-b025-2de44b1a44c7 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] [instance: 1e433ac8-ad92-4249-887c-9f8e86b308cf] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:44:50.878727 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-85dfb560-eac6-4c74-b025-2de44b1a44c7 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:44:50.879227 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-85dfb560-eac6-4c74-b025-2de44b1a44c7 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:44:50.879710 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-85dfb560-eac6-4c74-b025-2de44b1a44c7 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:44:50.880419 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-85dfb560-eac6-4c74-b025-2de44b1a44c7 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:44:50.880892 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-85dfb560-eac6-4c74-b025-2de44b1a44c7 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:44:50.881358 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-85dfb560-eac6-4c74-b025-2de44b1a44c7 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:44:51.258788 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-85dfb560-eac6-4c74-b025-2de44b1a44c7 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5daff488843949a7835ee0766d898dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9d9c6a533a41a592780f78c4ac7eaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:44:51.267368 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-85dfb560-eac6-4c74-b025-2de44b1a44c7 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] 10.222.0.43 "GET /compute/v2.1/servers/1e433ac8-ad92-4249-887c-9f8e86b308cf" status: 200 len: 1762 microversion: 2.1 time: 0.410886 Oct 04 19:44:51.281129 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3942/7510] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:44:50 2022] GET /compute/v2.1/servers/1e433ac8-ad92-4249-887c-9f8e86b308cf => generated 1762 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:44:52.292710 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-f4872beb-7251-420a-9dfe-77db3c017ef5 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:44:52.294572 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-f4872beb-7251-420a-9dfe-77db3c017ef5 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] [instance: 1e433ac8-ad92-4249-887c-9f8e86b308cf] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:44:52.300819 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f4872beb-7251-420a-9dfe-77db3c017ef5 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:44:52.301288 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f4872beb-7251-420a-9dfe-77db3c017ef5 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:44:52.301731 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f4872beb-7251-420a-9dfe-77db3c017ef5 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:44:52.302428 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f4872beb-7251-420a-9dfe-77db3c017ef5 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:44:52.302884 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f4872beb-7251-420a-9dfe-77db3c017ef5 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:44:52.303312 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f4872beb-7251-420a-9dfe-77db3c017ef5 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:44:52.499248 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-f4872beb-7251-420a-9dfe-77db3c017ef5 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5daff488843949a7835ee0766d898dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9d9c6a533a41a592780f78c4ac7eaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:44:52.507440 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-f4872beb-7251-420a-9dfe-77db3c017ef5 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] 10.222.0.43 "GET /compute/v2.1/servers/1e433ac8-ad92-4249-887c-9f8e86b308cf" status: 200 len: 1760 microversion: 2.1 time: 0.220192 Oct 04 19:44:52.508011 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3569/7511] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:44:52 2022] GET /compute/v2.1/servers/1e433ac8-ad92-4249-887c-9f8e86b308cf => generated 1760 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:46:06.080695 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_api:SELECT=2 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:46:06.081500 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=6 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:46:06.085550 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-ba40dca3-b6dd-48f7-8b37-19994149b536 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1152015357"}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:46:06.086146 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-ba40dca3-b6dd-48f7-8b37-19994149b536 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] [instance: 1e433ac8-ad92-4249-887c-9f8e86b308cf] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:46:06.096592 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ba40dca3-b6dd-48f7-8b37-19994149b536 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:06.097098 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ba40dca3-b6dd-48f7-8b37-19994149b536 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:06.097588 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ba40dca3-b6dd-48f7-8b37-19994149b536 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:06.098305 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ba40dca3-b6dd-48f7-8b37-19994149b536 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:06.098786 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ba40dca3-b6dd-48f7-8b37-19994149b536 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:06.099234 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ba40dca3-b6dd-48f7-8b37-19994149b536 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:06.104001 n-d-851028-13 devstack@n-api.service[123596]: INFO oslo.messaging._drivers.impl_rabbit [-] [c592c758-2dc3-4024-92b0-c949515e0281] Reconnected to AMQP server on 10.222.0.43:5672 via [amqp] client with port 49296. Oct 04 19:46:06.106108 n-d-851028-13 devstack@n-api.service[123596]: INFO oslo.messaging._drivers.impl_rabbit [-] [ced6bcbb-f7de-451e-861c-054aba6c81f5] Reconnected to AMQP server on 10.222.0.43:5672 via [amqp] client with port 49294. Oct 04 19:46:06.231756 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.network.security_group_api [None req-ba40dca3-b6dd-48f7-8b37-19994149b536 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Removing security group bc0b04fd-f6d4-4d88-9e24-b24dc69e47c7 from port 105c261c-54e6-400b-af95-1a3d72286f57 Oct 04 19:46:06.530366 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-ba40dca3-b6dd-48f7-8b37-19994149b536 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] 10.222.0.43 "POST /compute/v2.1/servers/1e433ac8-ad92-4249-887c-9f8e86b308cf/action" status: 202 len: 0 microversion: 2.1 time: 0.452327 Oct 04 19:46:06.535814 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3943/7512] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 19:46:06 2022] POST /compute/v2.1/servers/1e433ac8-ad92-4249-887c-9f8e86b308cf/action => generated 0 bytes in 454 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:46:06.540666 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_api:SELECT=4 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:46:06.541592 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:46:06.639310 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-ecad726e-d20c-4e80-b1b6-5c50dd5c791b req-b93f6bc0-e194-469b-adb7-7f0880b15e5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e433ac8-ad92-4249-887c-9f8e86b308cf", "tag": "105c261c-54e6-400b-af95-1a3d72286f57"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:46:06.649746 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-ecad726e-d20c-4e80-b1b6-5c50dd5c791b req-b93f6bc0-e194-469b-adb7-7f0880b15e5e service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:06.650585 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-ecad726e-d20c-4e80-b1b6-5c50dd5c791b req-b93f6bc0-e194-469b-adb7-7f0880b15e5e service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:06.651185 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-ecad726e-d20c-4e80-b1b6-5c50dd5c791b req-b93f6bc0-e194-469b-adb7-7f0880b15e5e service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:06.663745 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-ecad726e-d20c-4e80-b1b6-5c50dd5c791b req-b93f6bc0-e194-469b-adb7-7f0880b15e5e service nova] Creating event network-changed:105c261c-54e6-400b-af95-1a3d72286f57 for instance 1e433ac8-ad92-4249-887c-9f8e86b308cf on n-h1-851028-13 Oct 04 19:46:06.669307 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-ecad726e-d20c-4e80-b1b6-5c50dd5c791b req-b93f6bc0-e194-469b-adb7-7f0880b15e5e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.130538 Oct 04 19:46:06.671098 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3570/7513] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:46:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:46:08.302893 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-7e912cc1-b579-4400-a59e-7245e296f2b1 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:46:08.303499 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-7e912cc1-b579-4400-a59e-7245e296f2b1 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] [instance: 1e433ac8-ad92-4249-887c-9f8e86b308cf] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:46:08.309965 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7e912cc1-b579-4400-a59e-7245e296f2b1 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:08.310476 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7e912cc1-b579-4400-a59e-7245e296f2b1 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:08.310935 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7e912cc1-b579-4400-a59e-7245e296f2b1 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:08.311650 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7e912cc1-b579-4400-a59e-7245e296f2b1 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:08.312296 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7e912cc1-b579-4400-a59e-7245e296f2b1 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:08.312747 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7e912cc1-b579-4400-a59e-7245e296f2b1 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:08.393988 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.objects.instance [None req-7e912cc1-b579-4400-a59e-7245e296f2b1 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lazy-loading 'services' on Instance uuid 1e433ac8-ad92-4249-887c-9f8e86b308cf {{(pid=123596) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 19:46:08.464624 n-d-851028-13 devstack@n-api.service[123596]: ERROR oslo.messaging._drivers.impl_rabbit [None req-7e912cc1-b579-4400-a59e-7245e296f2b1 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] [2ea5c7b0-d187-438b-b3d1-0931c59219c1] AMQP server on 10.222.0.43:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 19:46:08.686616 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-5cb0857f-3600-484b-8514-b41df8e47ccb req-221d5bc1-c4a9-40c3-81d5-b09a2dc881f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e433ac8-ad92-4249-887c-9f8e86b308cf", "tag": "105c261c-54e6-400b-af95-1a3d72286f57"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:46:08.696764 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-5cb0857f-3600-484b-8514-b41df8e47ccb req-221d5bc1-c4a9-40c3-81d5-b09a2dc881f6 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:08.697268 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-5cb0857f-3600-484b-8514-b41df8e47ccb req-221d5bc1-c4a9-40c3-81d5-b09a2dc881f6 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:08.697707 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-5cb0857f-3600-484b-8514-b41df8e47ccb req-221d5bc1-c4a9-40c3-81d5-b09a2dc881f6 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:08.708673 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-5cb0857f-3600-484b-8514-b41df8e47ccb req-221d5bc1-c4a9-40c3-81d5-b09a2dc881f6 service nova] Creating event network-changed:105c261c-54e6-400b-af95-1a3d72286f57 for instance 1e433ac8-ad92-4249-887c-9f8e86b308cf on n-h1-851028-13 Oct 04 19:46:08.713989 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-5cb0857f-3600-484b-8514-b41df8e47ccb req-221d5bc1-c4a9-40c3-81d5-b09a2dc881f6 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032310 Oct 04 19:46:08.714616 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3571/7514] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:46:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:46:09.472607 n-d-851028-13 devstack@n-api.service[123596]: INFO oslo.messaging._drivers.impl_rabbit [None req-7e912cc1-b579-4400-a59e-7245e296f2b1 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] [2ea5c7b0-d187-438b-b3d1-0931c59219c1] Reconnected to AMQP server on 10.222.0.43:5672 via [amqp] client with port 49326. Oct 04 19:46:09.476252 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-7e912cc1-b579-4400-a59e-7245e296f2b1 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] 10.222.0.43 "DELETE /compute/v2.1/servers/1e433ac8-ad92-4249-887c-9f8e86b308cf/os-volume_attachments/6facc759-534d-4d0b-8a58-b7ad7e1dd09e" status: 202 len: 0 microversion: 2.1 time: 1.178377 Oct 04 19:46:09.477402 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3944/7515] 10.222.0.43 () {58 vars in 1416 bytes} [Tue Oct 4 19:46:08 2022] DELETE /compute/v2.1/servers/1e433ac8-ad92-4249-887c-9f8e86b308cf/os-volume_attachments/6facc759-534d-4d0b-8a58-b7ad7e1dd09e => generated 0 bytes in 1180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:46:09.486274 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-36b73803-c8ec-46f6-99c5-cb062eb03604 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:46:09.488592 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-36b73803-c8ec-46f6-99c5-cb062eb03604 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] [instance: 1e433ac8-ad92-4249-887c-9f8e86b308cf] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:46:09.495894 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-36b73803-c8ec-46f6-99c5-cb062eb03604 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:09.496390 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-36b73803-c8ec-46f6-99c5-cb062eb03604 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:09.496852 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-36b73803-c8ec-46f6-99c5-cb062eb03604 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:09.497646 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-36b73803-c8ec-46f6-99c5-cb062eb03604 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:09.498093 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-36b73803-c8ec-46f6-99c5-cb062eb03604 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:09.498525 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-36b73803-c8ec-46f6-99c5-cb062eb03604 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:09.530787 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-36b73803-c8ec-46f6-99c5-cb062eb03604 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] 10.222.0.43 "GET /compute/v2.1/servers/1e433ac8-ad92-4249-887c-9f8e86b308cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048616 Oct 04 19:46:09.531343 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3572/7516] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Oct 4 19:46:09 2022] GET /compute/v2.1/servers/1e433ac8-ad92-4249-887c-9f8e86b308cf/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:46:10.544935 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-3cb57531-2150-426c-89ec-862c149d3ac6 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:46:10.547418 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-3cb57531-2150-426c-89ec-862c149d3ac6 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] [instance: 1e433ac8-ad92-4249-887c-9f8e86b308cf] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:46:10.554504 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3cb57531-2150-426c-89ec-862c149d3ac6 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:10.555048 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3cb57531-2150-426c-89ec-862c149d3ac6 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:10.555504 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3cb57531-2150-426c-89ec-862c149d3ac6 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:10.556242 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3cb57531-2150-426c-89ec-862c149d3ac6 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:10.556711 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3cb57531-2150-426c-89ec-862c149d3ac6 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:10.557247 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3cb57531-2150-426c-89ec-862c149d3ac6 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:10.587474 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-3cb57531-2150-426c-89ec-862c149d3ac6 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] 10.222.0.43 "GET /compute/v2.1/servers/1e433ac8-ad92-4249-887c-9f8e86b308cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047643 Oct 04 19:46:10.588046 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3945/7517] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Oct 4 19:46:10 2022] GET /compute/v2.1/servers/1e433ac8-ad92-4249-887c-9f8e86b308cf/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:46:11.600004 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-3c7557ef-6ed7-40fa-84ff-dc4469c63569 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:46:11.603017 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-3c7557ef-6ed7-40fa-84ff-dc4469c63569 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] [instance: 1e433ac8-ad92-4249-887c-9f8e86b308cf] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:46:11.609983 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3c7557ef-6ed7-40fa-84ff-dc4469c63569 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:11.610471 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3c7557ef-6ed7-40fa-84ff-dc4469c63569 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:11.610985 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3c7557ef-6ed7-40fa-84ff-dc4469c63569 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:11.611692 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3c7557ef-6ed7-40fa-84ff-dc4469c63569 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:11.612147 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3c7557ef-6ed7-40fa-84ff-dc4469c63569 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:11.612579 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3c7557ef-6ed7-40fa-84ff-dc4469c63569 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:11.641951 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-3c7557ef-6ed7-40fa-84ff-dc4469c63569 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] 10.222.0.43 "GET /compute/v2.1/servers/1e433ac8-ad92-4249-887c-9f8e86b308cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045902 Oct 04 19:46:11.642519 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3573/7518] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Oct 4 19:46:11 2022] GET /compute/v2.1/servers/1e433ac8-ad92-4249-887c-9f8e86b308cf/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:46:12.655839 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-4fec79bb-591c-4448-a3ac-36c390ebb32f tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:46:12.658168 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-4fec79bb-591c-4448-a3ac-36c390ebb32f tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] [instance: 1e433ac8-ad92-4249-887c-9f8e86b308cf] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:46:12.664994 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4fec79bb-591c-4448-a3ac-36c390ebb32f tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:12.665524 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4fec79bb-591c-4448-a3ac-36c390ebb32f tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:12.665977 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4fec79bb-591c-4448-a3ac-36c390ebb32f tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:12.666684 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4fec79bb-591c-4448-a3ac-36c390ebb32f tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:12.667162 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4fec79bb-591c-4448-a3ac-36c390ebb32f tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:12.667603 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4fec79bb-591c-4448-a3ac-36c390ebb32f tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:12.699021 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-4fec79bb-591c-4448-a3ac-36c390ebb32f tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] 10.222.0.43 "GET /compute/v2.1/servers/1e433ac8-ad92-4249-887c-9f8e86b308cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047176 Oct 04 19:46:12.699584 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3946/7519] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Oct 4 19:46:12 2022] GET /compute/v2.1/servers/1e433ac8-ad92-4249-887c-9f8e86b308cf/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:46:13.712294 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-8d7047ed-d5eb-4e56-9a50-80fffcc3ac99 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:46:13.714678 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-8d7047ed-d5eb-4e56-9a50-80fffcc3ac99 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] [instance: 1e433ac8-ad92-4249-887c-9f8e86b308cf] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:46:13.721871 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8d7047ed-d5eb-4e56-9a50-80fffcc3ac99 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:13.722364 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8d7047ed-d5eb-4e56-9a50-80fffcc3ac99 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:13.722809 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8d7047ed-d5eb-4e56-9a50-80fffcc3ac99 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:13.723514 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8d7047ed-d5eb-4e56-9a50-80fffcc3ac99 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:13.723968 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8d7047ed-d5eb-4e56-9a50-80fffcc3ac99 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:13.724506 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8d7047ed-d5eb-4e56-9a50-80fffcc3ac99 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:13.755112 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-8d7047ed-d5eb-4e56-9a50-80fffcc3ac99 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] 10.222.0.43 "GET /compute/v2.1/servers/1e433ac8-ad92-4249-887c-9f8e86b308cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047323 Oct 04 19:46:13.755692 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3574/7520] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Oct 4 19:46:13 2022] GET /compute/v2.1/servers/1e433ac8-ad92-4249-887c-9f8e86b308cf/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:46:14.767998 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-a6f39087-20be-4a75-a4a2-c6cfa48bc7fd tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:46:14.770197 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-a6f39087-20be-4a75-a4a2-c6cfa48bc7fd tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] [instance: 1e433ac8-ad92-4249-887c-9f8e86b308cf] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:46:14.776916 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a6f39087-20be-4a75-a4a2-c6cfa48bc7fd tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:14.777449 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a6f39087-20be-4a75-a4a2-c6cfa48bc7fd tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:14.777902 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a6f39087-20be-4a75-a4a2-c6cfa48bc7fd tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:14.778601 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a6f39087-20be-4a75-a4a2-c6cfa48bc7fd tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:14.779068 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a6f39087-20be-4a75-a4a2-c6cfa48bc7fd tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:14.779510 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a6f39087-20be-4a75-a4a2-c6cfa48bc7fd tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:14.808206 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-a6f39087-20be-4a75-a4a2-c6cfa48bc7fd tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] 10.222.0.43 "GET /compute/v2.1/servers/1e433ac8-ad92-4249-887c-9f8e86b308cf/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044433 Oct 04 19:46:14.808758 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3947/7521] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Oct 4 19:46:14 2022] GET /compute/v2.1/servers/1e433ac8-ad92-4249-887c-9f8e86b308cf/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 19:46:14.819374 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-c4d0633c-c61b-4fde-947b-e485aa0feecf tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:46:14.819907 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-c4d0633c-c61b-4fde-947b-e485aa0feecf tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] [instance: 1e433ac8-ad92-4249-887c-9f8e86b308cf] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:46:14.826748 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c4d0633c-c61b-4fde-947b-e485aa0feecf tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:14.827234 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c4d0633c-c61b-4fde-947b-e485aa0feecf tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:14.827933 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c4d0633c-c61b-4fde-947b-e485aa0feecf tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:14.828633 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c4d0633c-c61b-4fde-947b-e485aa0feecf tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:14.829093 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c4d0633c-c61b-4fde-947b-e485aa0feecf tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:14.829554 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c4d0633c-c61b-4fde-947b-e485aa0feecf tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:14.903409 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-c4d0633c-c61b-4fde-947b-e485aa0feecf tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] HTTP exception thrown: Instance 1e433ac8-ad92-4249-887c-9f8e86b308cf is not attached to volume 6facc759-534d-4d0b-8a58-b7ad7e1dd09e Oct 04 19:46:14.905032 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-c4d0633c-c61b-4fde-947b-e485aa0feecf tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Request method failure captured: Oct 04 19:46:14.905032 n-d-851028-13 devstack@n-api.service[123595]: request: DELETE /compute/v2.1/servers/1e433ac8-ad92-4249-887c-9f8e86b308cf/os-volume_attachments/6facc759-534d-4d0b-8a58-b7ad7e1dd09e HTTP/1.1 Oct 04 19:46:14.905032 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 19:46:14.905032 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 19:46:14.905032 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 19:46:14.905032 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 0 Oct 04 19:46:14.905032 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 19:46:14.905032 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 19:46:14.905032 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 19:46:14.905032 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 19:46:14.905032 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPIyaCPvrnZazHA-AWDBU5_jXTAlfBKg7tT3IVCiPxGZL16OPph0IoTzPSzzCCTjeJwv3pldgme8PXUI6GzUJh4r7N6MW6EJ34R_QZjbt6Tq2p403PfNs9jDNQ8aDqpsbBj6q6ytREF3X9HZEwcjWvIIq7bb1zbwajlY0-x-6OZLmQsI Oct 04 19:46:14.905032 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 19:46:14.905032 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 19:46:14.905032 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 19:46:14.905032 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 19:46:14.905032 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 19:46:14.905032 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 19:46:14.905032 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: 5a9d9c6a533a41a592780f78c4ac7eaa Oct 04 19:46:14.905032 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-TestMinimumBasicScenario-1367511627 Oct 04 19:46:14.905032 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 19:46:14.905032 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 19:46:14.905032 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/5a9d9c6a533a41a592780f78c4ac7eaa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_5a9d9c6a533a41a592780f78c4ac7eaa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5a9d9c6a533a41a592780f78c4ac7eaa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5a9d9c6a533a41a592780f78c4ac7eaa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 19:46:14.905032 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-TestMinimumBasicScenario-1367511627 Oct 04 19:46:14.905032 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: 5a9d9c6a533a41a592780f78c4ac7eaa Oct 04 19:46:14.905032 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1367511627 Oct 04 19:46:14.905032 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-TestMinimumBasicScenario-1367511627-project Oct 04 19:46:14.905032 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 19:46:14.905032 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 19:46:14.905032 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: 5daff488843949a7835ee0766d898dec Oct 04 19:46:14.905032 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-TestMinimumBasicScenario-1367511627-project Oct 04 19:46:14.905032 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 19:46:14.905032 n-d-851028-13 devstack@n-api.service[123595]: exception: Instance 1e433ac8-ad92-4249-887c-9f8e86b308cf is not attached to volume 6facc759-534d-4d0b-8a58-b7ad7e1dd09e Oct 04 19:46:14.905032 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'server_id': '1e433ac8-ad92-4249-887c-9f8e86b308cf', 'id': '6facc759-534d-4d0b-8a58-b7ad7e1dd09e'} Oct 04 19:46:14.905032 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:46:14.905032 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:46:14.905032 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 04 19:46:14.905032 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 04 19:46:14.905032 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 19:46:14.905032 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 19:46:14.905032 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 04 19:46:14.905032 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 04 19:46:14.905032 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 6facc759-534d-4d0b-8a58-b7ad7e1dd09e. Oct 04 19:46:14.905032 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:46:14.905032 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:46:14.905032 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:46:14.905032 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:46:14.905032 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:46:14.905032 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:46:14.905032 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:46:14.905032 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:46:14.905032 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:46:14.905032 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:46:14.905032 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 04 19:46:14.905032 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 04 19:46:14.905032 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e433ac8-ad92-4249-887c-9f8e86b308cf is not attached to volume 6facc759-534d-4d0b-8a58-b7ad7e1dd09e Oct 04 19:46:14.905032 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:46:14.905032 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:46:14.905032 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:46:14.905032 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:46:14.905032 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:46:14.905032 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:46:14.909730 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:46:14.909730 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:46:14.909730 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e433ac8-ad92-4249-887c-9f8e86b308cf is not attached to volume 6facc759-534d-4d0b-8a58-b7ad7e1dd09e Oct 04 19:46:14.909730 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:46:14.909730 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-c4d0633c-c61b-4fde-947b-e485aa0feecf tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Returning 404 to user: Instance 1e433ac8-ad92-4249-887c-9f8e86b308cf is not attached to volume 6facc759-534d-4d0b-8a58-b7ad7e1dd09e {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:46:14.909730 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-c4d0633c-c61b-4fde-947b-e485aa0feecf tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] 10.222.0.43 "DELETE /compute/v2.1/servers/1e433ac8-ad92-4249-887c-9f8e86b308cf/os-volume_attachments/6facc759-534d-4d0b-8a58-b7ad7e1dd09e" status: 404 len: 154 microversion: 2.1 time: 0.091269 Oct 04 19:46:14.909730 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3575/7522] 10.222.0.43 () {58 vars in 1416 bytes} [Tue Oct 4 19:46:14 2022] DELETE /compute/v2.1/servers/1e433ac8-ad92-4249-887c-9f8e86b308cf/os-volume_attachments/6facc759-534d-4d0b-8a58-b7ad7e1dd09e => generated 154 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:46:18.158624 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-5b32d269-ba66-448c-88f1-e5b2a3ac5bcf tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:46:18.159151 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-5b32d269-ba66-448c-88f1-e5b2a3ac5bcf tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] [instance: 1e433ac8-ad92-4249-887c-9f8e86b308cf] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:46:18.166863 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5b32d269-ba66-448c-88f1-e5b2a3ac5bcf tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:18.167376 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5b32d269-ba66-448c-88f1-e5b2a3ac5bcf tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:18.167841 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5b32d269-ba66-448c-88f1-e5b2a3ac5bcf tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:18.168559 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5b32d269-ba66-448c-88f1-e5b2a3ac5bcf tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:18.169040 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5b32d269-ba66-448c-88f1-e5b2a3ac5bcf tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:18.169523 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5b32d269-ba66-448c-88f1-e5b2a3ac5bcf tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:18.194054 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-5b32d269-ba66-448c-88f1-e5b2a3ac5bcf tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] [instance: 1e433ac8-ad92-4249-887c-9f8e86b308cf] Going to try to terminate instance {{(pid=123596) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 19:46:18.279589 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-5b32d269-ba66-448c-88f1-e5b2a3ac5bcf tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] 10.222.0.43 "DELETE /compute/v2.1/servers/1e433ac8-ad92-4249-887c-9f8e86b308cf" status: 204 len: 0 microversion: 2.1 time: 0.124464 Oct 04 19:46:18.280312 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3948/7523] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 19:46:18 2022] DELETE /compute/v2.1/servers/1e433ac8-ad92-4249-887c-9f8e86b308cf => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:46:18.290320 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-ff53f757-82f9-46fa-8804-b449c4428f6e tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:46:18.290950 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-ff53f757-82f9-46fa-8804-b449c4428f6e tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] [instance: 1e433ac8-ad92-4249-887c-9f8e86b308cf] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:46:18.298845 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ff53f757-82f9-46fa-8804-b449c4428f6e tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:18.299345 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ff53f757-82f9-46fa-8804-b449c4428f6e tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:18.299796 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ff53f757-82f9-46fa-8804-b449c4428f6e tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:18.300512 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ff53f757-82f9-46fa-8804-b449c4428f6e tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:18.300977 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ff53f757-82f9-46fa-8804-b449c4428f6e tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:18.301443 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ff53f757-82f9-46fa-8804-b449c4428f6e tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:18.439209 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-ff53f757-82f9-46fa-8804-b449c4428f6e tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5daff488843949a7835ee0766d898dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9d9c6a533a41a592780f78c4ac7eaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:46:18.447509 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-ff53f757-82f9-46fa-8804-b449c4428f6e tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] 10.222.0.43 "GET /compute/v2.1/servers/1e433ac8-ad92-4249-887c-9f8e86b308cf" status: 200 len: 1554 microversion: 2.1 time: 0.162730 Oct 04 19:46:18.448115 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3576/7524] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:46:18 2022] GET /compute/v2.1/servers/1e433ac8-ad92-4249-887c-9f8e86b308cf => generated 1554 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:46:19.472488 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-6a42dd5d-206a-4723-af88-44d33952f4ae tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:46:19.473151 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-6a42dd5d-206a-4723-af88-44d33952f4ae tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] [instance: 1e433ac8-ad92-4249-887c-9f8e86b308cf] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:46:19.480509 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6a42dd5d-206a-4723-af88-44d33952f4ae tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:19.481009 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6a42dd5d-206a-4723-af88-44d33952f4ae tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:19.481497 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6a42dd5d-206a-4723-af88-44d33952f4ae tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:19.482209 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6a42dd5d-206a-4723-af88-44d33952f4ae tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:19.482681 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6a42dd5d-206a-4723-af88-44d33952f4ae tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:19.483134 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6a42dd5d-206a-4723-af88-44d33952f4ae tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:19.611777 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-6a42dd5d-206a-4723-af88-44d33952f4ae tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5daff488843949a7835ee0766d898dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9d9c6a533a41a592780f78c4ac7eaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:46:19.619548 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-6a42dd5d-206a-4723-af88-44d33952f4ae tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] 10.222.0.43 "GET /compute/v2.1/servers/1e433ac8-ad92-4249-887c-9f8e86b308cf" status: 200 len: 1554 microversion: 2.1 time: 0.151440 Oct 04 19:46:19.620124 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3949/7525] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:46:19 2022] GET /compute/v2.1/servers/1e433ac8-ad92-4249-887c-9f8e86b308cf => generated 1554 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:46:20.405893 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-13d0d6c9-1bd2-4f1e-9fd3-00619c8351b1 req-cbb4be62-a1bf-4a3b-a3d6-6dc96beb56e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e433ac8-ad92-4249-887c-9f8e86b308cf", "name": "network-vif-deleted", "tag": "105c261c-54e6-400b-af95-1a3d72286f57"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:46:20.416653 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-13d0d6c9-1bd2-4f1e-9fd3-00619c8351b1 req-cbb4be62-a1bf-4a3b-a3d6-6dc96beb56e3 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:20.417141 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-13d0d6c9-1bd2-4f1e-9fd3-00619c8351b1 req-cbb4be62-a1bf-4a3b-a3d6-6dc96beb56e3 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:20.417639 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-13d0d6c9-1bd2-4f1e-9fd3-00619c8351b1 req-cbb4be62-a1bf-4a3b-a3d6-6dc96beb56e3 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:20.429886 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-13d0d6c9-1bd2-4f1e-9fd3-00619c8351b1 req-cbb4be62-a1bf-4a3b-a3d6-6dc96beb56e3 service nova] Creating event network-vif-deleted:105c261c-54e6-400b-af95-1a3d72286f57 for instance 1e433ac8-ad92-4249-887c-9f8e86b308cf on n-h1-851028-13 Oct 04 19:46:20.434979 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-13d0d6c9-1bd2-4f1e-9fd3-00619c8351b1 req-cbb4be62-a1bf-4a3b-a3d6-6dc96beb56e3 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032792 Oct 04 19:46:20.435583 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3577/7526] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:46:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:46:20.641957 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-12fbf2b1-fb1d-4c6a-bb11-3af24c89f99f tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:46:20.642567 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-12fbf2b1-fb1d-4c6a-bb11-3af24c89f99f tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] [instance: 1e433ac8-ad92-4249-887c-9f8e86b308cf] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:46:20.649481 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-12fbf2b1-fb1d-4c6a-bb11-3af24c89f99f tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:20.649993 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-12fbf2b1-fb1d-4c6a-bb11-3af24c89f99f tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:20.650457 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-12fbf2b1-fb1d-4c6a-bb11-3af24c89f99f tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:20.651178 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-12fbf2b1-fb1d-4c6a-bb11-3af24c89f99f tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:20.651654 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-12fbf2b1-fb1d-4c6a-bb11-3af24c89f99f tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:20.652106 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-12fbf2b1-fb1d-4c6a-bb11-3af24c89f99f tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:20.684496 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-12fbf2b1-fb1d-4c6a-bb11-3af24c89f99f tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:20.684934 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-12fbf2b1-fb1d-4c6a-bb11-3af24c89f99f tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:20.685431 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-12fbf2b1-fb1d-4c6a-bb11-3af24c89f99f tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:20.685905 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.objects.instance [None req-12fbf2b1-fb1d-4c6a-bb11-3af24c89f99f tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lazy-loading 'fault' on Instance uuid 1e433ac8-ad92-4249-887c-9f8e86b308cf {{(pid=123596) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 19:46:20.728640 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-12fbf2b1-fb1d-4c6a-bb11-3af24c89f99f tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5daff488843949a7835ee0766d898dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9d9c6a533a41a592780f78c4ac7eaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:46:20.736974 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-12fbf2b1-fb1d-4c6a-bb11-3af24c89f99f tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] 10.222.0.43 "GET /compute/v2.1/servers/1e433ac8-ad92-4249-887c-9f8e86b308cf" status: 200 len: 1349 microversion: 2.1 time: 0.098969 Oct 04 19:46:20.737610 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3950/7527] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:46:20 2022] GET /compute/v2.1/servers/1e433ac8-ad92-4249-887c-9f8e86b308cf => generated 1349 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:46:21.763404 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-e782d1a2-727d-46dd-a9a9-fec1c045120d tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:46:21.764113 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-e782d1a2-727d-46dd-a9a9-fec1c045120d tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] [instance: 1e433ac8-ad92-4249-887c-9f8e86b308cf] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:46:21.770318 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e782d1a2-727d-46dd-a9a9-fec1c045120d tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:21.770809 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e782d1a2-727d-46dd-a9a9-fec1c045120d tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:21.771265 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e782d1a2-727d-46dd-a9a9-fec1c045120d tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:21.771964 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e782d1a2-727d-46dd-a9a9-fec1c045120d tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:21.772426 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e782d1a2-727d-46dd-a9a9-fec1c045120d tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:21.772859 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e782d1a2-727d-46dd-a9a9-fec1c045120d tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:21.787062 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-e782d1a2-727d-46dd-a9a9-fec1c045120d tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] HTTP exception thrown: Instance 1e433ac8-ad92-4249-887c-9f8e86b308cf could not be found. Oct 04 19:46:21.788709 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-e782d1a2-727d-46dd-a9a9-fec1c045120d tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Request method failure captured: Oct 04 19:46:21.788709 n-d-851028-13 devstack@n-api.service[123595]: request: GET /compute/v2.1/servers/1e433ac8-ad92-4249-887c-9f8e86b308cf HTTP/1.1 Oct 04 19:46:21.788709 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 19:46:21.788709 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 19:46:21.788709 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 19:46:21.788709 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 0 Oct 04 19:46:21.788709 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 19:46:21.788709 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 19:46:21.788709 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 19:46:21.788709 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 19:46:21.788709 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPIyaCPvrnZazHA-AWDBU5_jXTAlfBKg7tT3IVCiPxGZL16OPph0IoTzPSzzCCTjeJwv3pldgme8PXUI6GzUJh4r7N6MW6EJ34R_QZjbt6Tq2p403PfNs9jDNQ8aDqpsbBj6q6ytREF3X9HZEwcjWvIIq7bb1zbwajlY0-x-6OZLmQsI Oct 04 19:46:21.788709 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 19:46:21.788709 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 19:46:21.788709 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 19:46:21.788709 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 19:46:21.788709 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 19:46:21.788709 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 19:46:21.788709 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: 5a9d9c6a533a41a592780f78c4ac7eaa Oct 04 19:46:21.788709 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-TestMinimumBasicScenario-1367511627 Oct 04 19:46:21.788709 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 19:46:21.788709 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 19:46:21.788709 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/5a9d9c6a533a41a592780f78c4ac7eaa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_5a9d9c6a533a41a592780f78c4ac7eaa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5a9d9c6a533a41a592780f78c4ac7eaa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5a9d9c6a533a41a592780f78c4ac7eaa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 19:46:21.788709 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-TestMinimumBasicScenario-1367511627 Oct 04 19:46:21.788709 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: 5a9d9c6a533a41a592780f78c4ac7eaa Oct 04 19:46:21.788709 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1367511627 Oct 04 19:46:21.788709 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-TestMinimumBasicScenario-1367511627-project Oct 04 19:46:21.788709 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 19:46:21.788709 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 19:46:21.788709 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: 5daff488843949a7835ee0766d898dec Oct 04 19:46:21.788709 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-TestMinimumBasicScenario-1367511627-project Oct 04 19:46:21.788709 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 19:46:21.788709 n-d-851028-13 devstack@n-api.service[123595]: exception: Instance 1e433ac8-ad92-4249-887c-9f8e86b308cf could not be found. Oct 04 19:46:21.788709 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': '1e433ac8-ad92-4249-887c-9f8e86b308cf'} Oct 04 19:46:21.788709 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:46:21.788709 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:46:21.788709 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:46:21.788709 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:46:21.788709 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:46:21.788709 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:46:21.788709 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:46:21.788709 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:46:21.788709 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:46:21.788709 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:46:21.788709 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e433ac8-ad92-4249-887c-9f8e86b308cf could not be found. Oct 04 19:46:21.788709 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:46:21.788709 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:46:21.788709 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:46:21.788709 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:46:21.788709 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:46:21.788709 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:46:21.788709 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:46:21.788709 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:46:21.788709 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:46:21.788709 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:46:21.788709 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:46:21.788709 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:46:21.788709 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:46:21.788709 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:46:21.788709 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:46:21.788709 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:46:21.788709 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e433ac8-ad92-4249-887c-9f8e86b308cf could not be found. Oct 04 19:46:21.788709 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:46:21.788709 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:46:21.788709 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:46:21.793746 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:46:21.793746 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:46:21.793746 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:46:21.793746 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:46:21.793746 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:46:21.793746 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e433ac8-ad92-4249-887c-9f8e86b308cf could not be found. Oct 04 19:46:21.793746 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:46:21.793746 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-e782d1a2-727d-46dd-a9a9-fec1c045120d tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Returning 404 to user: Instance 1e433ac8-ad92-4249-887c-9f8e86b308cf could not be found. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:46:21.793746 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-e782d1a2-727d-46dd-a9a9-fec1c045120d tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] 10.222.0.43 "GET /compute/v2.1/servers/1e433ac8-ad92-4249-887c-9f8e86b308cf" status: 404 len: 111 microversion: 2.1 time: 0.031955 Oct 04 19:46:21.793746 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3578/7528] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:46:21 2022] GET /compute/v2.1/servers/1e433ac8-ad92-4249-887c-9f8e86b308cf => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:46:21.798994 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f80a4db7-5317-4da4-9da4-3e06ce2160cb tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Calling method '.version_select at 0x7fb21c59a8b0>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:46:21.822563 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-f80a4db7-5317-4da4-9da4-3e06ce2160cb tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2026570325" status: 202 len: 0 microversion: 2.1 time: 0.027442 Oct 04 19:46:21.823140 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3951/7529] 10.222.0.43 () {58 vars in 1272 bytes} [Tue Oct 4 19:46:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2026570325 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:46:31.017071 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-41482bff-819a-4c5b-9caa-9896d01fa843 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Action: 'create', calling method: .version_select at 0x7fb21ec72280>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-459806083", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO6p87JaAUnMq+7EHQOjCOXAZ4dGVbtKZKZazQCzVslz/fnQ+z93lPjOrKBn2Od600abhL1wTobdXiJ12f+kVM9sgGgIeuP2PMHSctYI+iA8Rdiuwe2FtDmksM08Tm56+g=="}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:46:31.023033 n-d-851028-13 devstack@n-api.service[123595]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 19:46:31.023201 n-d-851028-13 devstack@n-api.service[123595]: Tue Oct 4 19:46:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.43) !!! Oct 04 19:46:31.037455 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-41482bff-819a-4c5b-9caa-9896d01fa843 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Getting quotas for project 5a9d9c6a533a41a592780f78c4ac7eaa. Resources: {'key_pairs'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:46:31.044210 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-41482bff-819a-4c5b-9caa-9896d01fa843 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Getting quotas for user 5daff488843949a7835ee0766d898dec and project 5a9d9c6a533a41a592780f78c4ac7eaa. Resources: {'key_pairs'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:46:31.074931 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-41482bff-819a-4c5b-9caa-9896d01fa843 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.062089 Oct 04 19:46:31.075540 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3579/7530] 10.222.0.43 () {60 vars in 1159 bytes} [Tue Oct 4 19:46:31 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:46:31.123921 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=59,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:46:31.124989 n-d-851028-13 devstack@n-api.service[123596]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 19:46:31.125147 n-d-851028-13 devstack@n-api.service[123596]: Tue Oct 4 19:46:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.43) !!! Oct 04 19:46:31.130883 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-6a1bbb24-d852-49fe-bc1b-27143f0d02dc tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-88207192", "imageRef": "4726f224-291b-4764-b9b4-ae3644fdbe0d", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-459806083", "networks": [{"uuid": "0c6ffad7-f5e6-4ae6-8f5e-7e39599d9639"}]}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:46:31.185969 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.network.neutron [None req-6a1bbb24-d852-49fe-bc1b-27143f0d02dc tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] validate_networks() for [('0c6ffad7-f5e6-4ae6-8f5e-7e39599d9639', None, None, None, None, None)] {{(pid=123596) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 19:46:31.566052 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-6a1bbb24-d852-49fe-bc1b-27143f0d02dc tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Flavor limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:46:31.566498 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-6a1bbb24-d852-49fe-bc1b-27143f0d02dc tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Image limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:46:31.566989 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-6a1bbb24-d852-49fe-bc1b-27143f0d02dc tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Flavor pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:46:31.567444 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-6a1bbb24-d852-49fe-bc1b-27143f0d02dc tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Image pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:46:31.567877 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-6a1bbb24-d852-49fe-bc1b-27143f0d02dc tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:46:31.576840 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6a1bbb24-d852-49fe-bc1b-27143f0d02dc tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:31.577633 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6a1bbb24-d852-49fe-bc1b-27143f0d02dc tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:31.578088 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6a1bbb24-d852-49fe-bc1b-27143f0d02dc tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:31.578841 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6a1bbb24-d852-49fe-bc1b-27143f0d02dc tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:31.579310 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6a1bbb24-d852-49fe-bc1b-27143f0d02dc tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:31.579753 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6a1bbb24-d852-49fe-bc1b-27143f0d02dc tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:31.596668 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-6a1bbb24-d852-49fe-bc1b-27143f0d02dc tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Getting quotas for project 5a9d9c6a533a41a592780f78c4ac7eaa. Resources: {'ram', 'cores', 'instances'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:46:31.602772 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-6a1bbb24-d852-49fe-bc1b-27143f0d02dc tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Getting quotas for user 5daff488843949a7835ee0766d898dec and project 5a9d9c6a533a41a592780f78c4ac7eaa. Resources: {'ram', 'cores', 'instances'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:46:31.615136 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-6a1bbb24-d852-49fe-bc1b-27143f0d02dc tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Going to run 1 instances... {{(pid=123596) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 19:46:31.617451 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-6a1bbb24-d852-49fe-bc1b-27143f0d02dc tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] [instance: 281c6d18-599b-4d33-b063-f7ec58a8c96e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4726f224-291b-4764-b9b4-ae3644fdbe0d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123596) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 19:46:31.663852 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-6a1bbb24-d852-49fe-bc1b-27143f0d02dc tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.541126 Oct 04 19:46:31.664525 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3952/7531] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 19:46:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 543 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 19:46:31.675621 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-246de69a-df53-4a2e-86d3-de90409d1a4d tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:46:31.676375 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-246de69a-df53-4a2e-86d3-de90409d1a4d tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] [instance: 281c6d18-599b-4d33-b063-f7ec58a8c96e] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:46:31.730504 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-246de69a-df53-4a2e-86d3-de90409d1a4d tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5daff488843949a7835ee0766d898dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9d9c6a533a41a592780f78c4ac7eaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:46:31.737608 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-246de69a-df53-4a2e-86d3-de90409d1a4d tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] 10.222.0.43 "GET /compute/v2.1/servers/281c6d18-599b-4d33-b063-f7ec58a8c96e" status: 200 len: 1256 microversion: 2.1 time: 0.065971 Oct 04 19:46:31.738183 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3580/7532] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:46:31 2022] GET /compute/v2.1/servers/281c6d18-599b-4d33-b063-f7ec58a8c96e => generated 1256 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:46:32.760184 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-04083f9b-30e7-4f06-b471-d8bfd91e0129 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:46:32.760964 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-04083f9b-30e7-4f06-b471-d8bfd91e0129 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] [instance: 281c6d18-599b-4d33-b063-f7ec58a8c96e] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:46:32.768823 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-04083f9b-30e7-4f06-b471-d8bfd91e0129 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:32.769613 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-04083f9b-30e7-4f06-b471-d8bfd91e0129 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:32.770394 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-04083f9b-30e7-4f06-b471-d8bfd91e0129 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:32.771420 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-04083f9b-30e7-4f06-b471-d8bfd91e0129 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:32.772088 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-04083f9b-30e7-4f06-b471-d8bfd91e0129 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:32.772814 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-04083f9b-30e7-4f06-b471-d8bfd91e0129 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:32.896926 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-04083f9b-30e7-4f06-b471-d8bfd91e0129 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5daff488843949a7835ee0766d898dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9d9c6a533a41a592780f78c4ac7eaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:46:32.909648 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-04083f9b-30e7-4f06-b471-d8bfd91e0129 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] 10.222.0.43 "GET /compute/v2.1/servers/281c6d18-599b-4d33-b063-f7ec58a8c96e" status: 200 len: 1326 microversion: 2.1 time: 0.150308 Oct 04 19:46:32.910286 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3953/7533] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:46:32 2022] GET /compute/v2.1/servers/281c6d18-599b-4d33-b063-f7ec58a8c96e => generated 1326 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:46:33.935534 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-99bbdd4a-ee83-4214-88bd-8f4662afe7bf tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:46:33.936218 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-99bbdd4a-ee83-4214-88bd-8f4662afe7bf tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] [instance: 281c6d18-599b-4d33-b063-f7ec58a8c96e] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:46:33.938182 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=38 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:46:33.945485 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-99bbdd4a-ee83-4214-88bd-8f4662afe7bf tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:33.945993 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-99bbdd4a-ee83-4214-88bd-8f4662afe7bf tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:33.946433 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-99bbdd4a-ee83-4214-88bd-8f4662afe7bf tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:33.947170 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-99bbdd4a-ee83-4214-88bd-8f4662afe7bf tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:33.947627 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-99bbdd4a-ee83-4214-88bd-8f4662afe7bf tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:33.948057 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-99bbdd4a-ee83-4214-88bd-8f4662afe7bf tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:34.083265 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-99bbdd4a-ee83-4214-88bd-8f4662afe7bf tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5daff488843949a7835ee0766d898dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9d9c6a533a41a592780f78c4ac7eaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:46:34.093700 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-99bbdd4a-ee83-4214-88bd-8f4662afe7bf tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] 10.222.0.43 "GET /compute/v2.1/servers/281c6d18-599b-4d33-b063-f7ec58a8c96e" status: 200 len: 1356 microversion: 2.1 time: 0.163365 Oct 04 19:46:34.099283 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3581/7534] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:46:33 2022] GET /compute/v2.1/servers/281c6d18-599b-4d33-b063-f7ec58a8c96e => generated 1356 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:46:35.118148 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-8296eebd-39ad-44f5-a9d2-9f9a0c56fa66 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:46:35.119092 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-8296eebd-39ad-44f5-a9d2-9f9a0c56fa66 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] [instance: 281c6d18-599b-4d33-b063-f7ec58a8c96e] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:46:35.126167 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8296eebd-39ad-44f5-a9d2-9f9a0c56fa66 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:35.126684 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8296eebd-39ad-44f5-a9d2-9f9a0c56fa66 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:35.127141 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8296eebd-39ad-44f5-a9d2-9f9a0c56fa66 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:35.127869 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8296eebd-39ad-44f5-a9d2-9f9a0c56fa66 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:35.128342 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8296eebd-39ad-44f5-a9d2-9f9a0c56fa66 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:35.128814 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8296eebd-39ad-44f5-a9d2-9f9a0c56fa66 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:35.273676 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-8296eebd-39ad-44f5-a9d2-9f9a0c56fa66 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5daff488843949a7835ee0766d898dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9d9c6a533a41a592780f78c4ac7eaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:46:35.281688 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-8296eebd-39ad-44f5-a9d2-9f9a0c56fa66 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] 10.222.0.43 "GET /compute/v2.1/servers/281c6d18-599b-4d33-b063-f7ec58a8c96e" status: 200 len: 1356 microversion: 2.1 time: 0.167502 Oct 04 19:46:35.282307 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3954/7535] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:46:35 2022] GET /compute/v2.1/servers/281c6d18-599b-4d33-b063-f7ec58a8c96e => generated 1356 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:46:36.303950 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-65643e7b-3ea8-4148-a0ce-bc729ced6201 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:46:36.304507 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-65643e7b-3ea8-4148-a0ce-bc729ced6201 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] [instance: 281c6d18-599b-4d33-b063-f7ec58a8c96e] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:46:36.311548 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-65643e7b-3ea8-4148-a0ce-bc729ced6201 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:36.312049 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-65643e7b-3ea8-4148-a0ce-bc729ced6201 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:36.312494 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-65643e7b-3ea8-4148-a0ce-bc729ced6201 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:36.313237 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-65643e7b-3ea8-4148-a0ce-bc729ced6201 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:36.313695 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-65643e7b-3ea8-4148-a0ce-bc729ced6201 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:36.314367 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-65643e7b-3ea8-4148-a0ce-bc729ced6201 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:36.462830 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-65643e7b-3ea8-4148-a0ce-bc729ced6201 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5daff488843949a7835ee0766d898dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9d9c6a533a41a592780f78c4ac7eaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:46:36.471758 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-65643e7b-3ea8-4148-a0ce-bc729ced6201 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] 10.222.0.43 "GET /compute/v2.1/servers/281c6d18-599b-4d33-b063-f7ec58a8c96e" status: 200 len: 1356 microversion: 2.1 time: 0.171711 Oct 04 19:46:36.472533 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3582/7536] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:46:36 2022] GET /compute/v2.1/servers/281c6d18-599b-4d33-b063-f7ec58a8c96e => generated 1356 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:46:37.507429 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-88b12eb7-9677-4179-8fb8-0171b3767fda tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:46:37.508101 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-88b12eb7-9677-4179-8fb8-0171b3767fda tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] [instance: 281c6d18-599b-4d33-b063-f7ec58a8c96e] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:46:37.511333 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:46:37.517777 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-88b12eb7-9677-4179-8fb8-0171b3767fda tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:37.518457 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-88b12eb7-9677-4179-8fb8-0171b3767fda tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:37.518997 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-88b12eb7-9677-4179-8fb8-0171b3767fda tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:37.519742 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-88b12eb7-9677-4179-8fb8-0171b3767fda tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:37.520217 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-88b12eb7-9677-4179-8fb8-0171b3767fda tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:37.520677 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-88b12eb7-9677-4179-8fb8-0171b3767fda tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:37.666807 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-88b12eb7-9677-4179-8fb8-0171b3767fda tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5daff488843949a7835ee0766d898dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9d9c6a533a41a592780f78c4ac7eaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:46:37.677272 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-88b12eb7-9677-4179-8fb8-0171b3767fda tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] 10.222.0.43 "GET /compute/v2.1/servers/281c6d18-599b-4d33-b063-f7ec58a8c96e" status: 200 len: 1356 microversion: 2.1 time: 0.180185 Oct 04 19:46:37.693088 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3955/7537] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:46:37 2022] GET /compute/v2.1/servers/281c6d18-599b-4d33-b063-f7ec58a8c96e => generated 1356 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:46:38.700557 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-3bcc1d55-3b61-41ab-9f3d-2605cfdbbef2 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:46:38.701282 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-3bcc1d55-3b61-41ab-9f3d-2605cfdbbef2 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] [instance: 281c6d18-599b-4d33-b063-f7ec58a8c96e] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:46:38.704140 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:46:38.710792 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3bcc1d55-3b61-41ab-9f3d-2605cfdbbef2 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:38.711286 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3bcc1d55-3b61-41ab-9f3d-2605cfdbbef2 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:38.711727 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3bcc1d55-3b61-41ab-9f3d-2605cfdbbef2 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:38.712434 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3bcc1d55-3b61-41ab-9f3d-2605cfdbbef2 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:38.712895 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3bcc1d55-3b61-41ab-9f3d-2605cfdbbef2 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:38.713363 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3bcc1d55-3b61-41ab-9f3d-2605cfdbbef2 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:38.857412 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-3bcc1d55-3b61-41ab-9f3d-2605cfdbbef2 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5daff488843949a7835ee0766d898dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9d9c6a533a41a592780f78c4ac7eaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:46:38.867545 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-3bcc1d55-3b61-41ab-9f3d-2605cfdbbef2 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] 10.222.0.43 "GET /compute/v2.1/servers/281c6d18-599b-4d33-b063-f7ec58a8c96e" status: 200 len: 1356 microversion: 2.1 time: 0.170866 Oct 04 19:46:38.868135 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3583/7538] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:46:38 2022] GET /compute/v2.1/servers/281c6d18-599b-4d33-b063-f7ec58a8c96e => generated 1356 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:46:39.891220 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-a557764c-c131-42d6-a065-d32093fa78f2 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:46:39.891819 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-a557764c-c131-42d6-a065-d32093fa78f2 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] [instance: 281c6d18-599b-4d33-b063-f7ec58a8c96e] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:46:39.898956 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a557764c-c131-42d6-a065-d32093fa78f2 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:39.899460 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a557764c-c131-42d6-a065-d32093fa78f2 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:39.899916 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a557764c-c131-42d6-a065-d32093fa78f2 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:39.900629 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a557764c-c131-42d6-a065-d32093fa78f2 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:39.901091 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a557764c-c131-42d6-a065-d32093fa78f2 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:39.901567 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a557764c-c131-42d6-a065-d32093fa78f2 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:40.037166 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-a557764c-c131-42d6-a065-d32093fa78f2 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5daff488843949a7835ee0766d898dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9d9c6a533a41a592780f78c4ac7eaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:46:40.046543 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-a557764c-c131-42d6-a065-d32093fa78f2 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] 10.222.0.43 "GET /compute/v2.1/servers/281c6d18-599b-4d33-b063-f7ec58a8c96e" status: 200 len: 1356 microversion: 2.1 time: 0.159400 Oct 04 19:46:40.047140 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3956/7539] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:46:39 2022] GET /compute/v2.1/servers/281c6d18-599b-4d33-b063-f7ec58a8c96e => generated 1356 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:46:41.070324 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-2b4acddf-8671-47d3-aa86-e1bfecf4fd87 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:46:41.070944 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-2b4acddf-8671-47d3-aa86-e1bfecf4fd87 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] [instance: 281c6d18-599b-4d33-b063-f7ec58a8c96e] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:46:41.078340 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2b4acddf-8671-47d3-aa86-e1bfecf4fd87 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:41.078834 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2b4acddf-8671-47d3-aa86-e1bfecf4fd87 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:41.079276 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2b4acddf-8671-47d3-aa86-e1bfecf4fd87 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:41.080015 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2b4acddf-8671-47d3-aa86-e1bfecf4fd87 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:41.080497 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2b4acddf-8671-47d3-aa86-e1bfecf4fd87 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:41.080976 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2b4acddf-8671-47d3-aa86-e1bfecf4fd87 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:41.213147 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-2b4acddf-8671-47d3-aa86-e1bfecf4fd87 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5daff488843949a7835ee0766d898dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9d9c6a533a41a592780f78c4ac7eaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:46:41.220902 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-2b4acddf-8671-47d3-aa86-e1bfecf4fd87 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] 10.222.0.43 "GET /compute/v2.1/servers/281c6d18-599b-4d33-b063-f7ec58a8c96e" status: 200 len: 1356 microversion: 2.1 time: 0.154485 Oct 04 19:46:41.221517 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3584/7540] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:46:41 2022] GET /compute/v2.1/servers/281c6d18-599b-4d33-b063-f7ec58a8c96e => generated 1356 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:46:41.556245 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-76c998c7-570b-428f-ad60-2aaa29daa483 req-3147181f-6e5f-4eaa-9531-27f46c55f95c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "281c6d18-599b-4d33-b063-f7ec58a8c96e", "tag": "a3d25985-26c5-4df1-b10d-8e522ad02e46"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:46:41.567062 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-76c998c7-570b-428f-ad60-2aaa29daa483 req-3147181f-6e5f-4eaa-9531-27f46c55f95c service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:41.567569 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-76c998c7-570b-428f-ad60-2aaa29daa483 req-3147181f-6e5f-4eaa-9531-27f46c55f95c service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:41.568027 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-76c998c7-570b-428f-ad60-2aaa29daa483 req-3147181f-6e5f-4eaa-9531-27f46c55f95c service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:41.579607 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-76c998c7-570b-428f-ad60-2aaa29daa483 req-3147181f-6e5f-4eaa-9531-27f46c55f95c service nova] Creating event network-changed:a3d25985-26c5-4df1-b10d-8e522ad02e46 for instance 281c6d18-599b-4d33-b063-f7ec58a8c96e on n-h2-851028-13 Oct 04 19:46:41.585466 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-76c998c7-570b-428f-ad60-2aaa29daa483 req-3147181f-6e5f-4eaa-9531-27f46c55f95c service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033391 Oct 04 19:46:41.586078 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3957/7541] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:46:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:46:42.244432 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-08a138f1-a193-474d-b6c7-59b0e96b73bc tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:46:42.245068 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-08a138f1-a193-474d-b6c7-59b0e96b73bc tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] [instance: 281c6d18-599b-4d33-b063-f7ec58a8c96e] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:46:42.246912 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=6 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:46:42.253801 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-08a138f1-a193-474d-b6c7-59b0e96b73bc tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:42.254291 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-08a138f1-a193-474d-b6c7-59b0e96b73bc tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:42.254735 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-08a138f1-a193-474d-b6c7-59b0e96b73bc tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:42.255448 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-08a138f1-a193-474d-b6c7-59b0e96b73bc tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:42.255917 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-08a138f1-a193-474d-b6c7-59b0e96b73bc tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:42.256942 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-08a138f1-a193-474d-b6c7-59b0e96b73bc tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:42.386260 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-08a138f1-a193-474d-b6c7-59b0e96b73bc tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5daff488843949a7835ee0766d898dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9d9c6a533a41a592780f78c4ac7eaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:46:42.393970 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-08a138f1-a193-474d-b6c7-59b0e96b73bc tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] 10.222.0.43 "GET /compute/v2.1/servers/281c6d18-599b-4d33-b063-f7ec58a8c96e" status: 200 len: 1356 microversion: 2.1 time: 0.154027 Oct 04 19:46:42.394563 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3585/7542] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:46:42 2022] GET /compute/v2.1/servers/281c6d18-599b-4d33-b063-f7ec58a8c96e => generated 1356 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:46:43.413458 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=2 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:46:43.414647 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=6 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:46:43.422221 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-0ba1632e-c6b6-4e51-8b94-dca70dde4df5 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:46:43.422942 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-0ba1632e-c6b6-4e51-8b94-dca70dde4df5 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] [instance: 281c6d18-599b-4d33-b063-f7ec58a8c96e] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:46:43.429823 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0ba1632e-c6b6-4e51-8b94-dca70dde4df5 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:43.430334 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0ba1632e-c6b6-4e51-8b94-dca70dde4df5 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:43.430787 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0ba1632e-c6b6-4e51-8b94-dca70dde4df5 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:43.431501 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0ba1632e-c6b6-4e51-8b94-dca70dde4df5 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:43.431969 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0ba1632e-c6b6-4e51-8b94-dca70dde4df5 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:43.432415 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0ba1632e-c6b6-4e51-8b94-dca70dde4df5 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:43.607310 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-0ba1632e-c6b6-4e51-8b94-dca70dde4df5 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5daff488843949a7835ee0766d898dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9d9c6a533a41a592780f78c4ac7eaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:46:43.615164 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-0ba1632e-c6b6-4e51-8b94-dca70dde4df5 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] 10.222.0.43 "GET /compute/v2.1/servers/281c6d18-599b-4d33-b063-f7ec58a8c96e" status: 200 len: 1356 microversion: 2.1 time: 0.202813 Oct 04 19:46:43.616249 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3958/7543] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:46:43 2022] GET /compute/v2.1/servers/281c6d18-599b-4d33-b063-f7ec58a8c96e => generated 1356 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:46:44.638993 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-d098862f-a2f9-4407-b5ec-e68f758af8db tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:46:44.639632 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-d098862f-a2f9-4407-b5ec-e68f758af8db tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] [instance: 281c6d18-599b-4d33-b063-f7ec58a8c96e] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:46:44.647336 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d098862f-a2f9-4407-b5ec-e68f758af8db tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:44.647966 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d098862f-a2f9-4407-b5ec-e68f758af8db tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:44.648278 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d098862f-a2f9-4407-b5ec-e68f758af8db tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:44.649005 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d098862f-a2f9-4407-b5ec-e68f758af8db tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:44.649492 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d098862f-a2f9-4407-b5ec-e68f758af8db tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:44.649931 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d098862f-a2f9-4407-b5ec-e68f758af8db tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:44.779435 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-d098862f-a2f9-4407-b5ec-e68f758af8db tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5daff488843949a7835ee0766d898dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9d9c6a533a41a592780f78c4ac7eaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:46:44.787066 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-d098862f-a2f9-4407-b5ec-e68f758af8db tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] 10.222.0.43 "GET /compute/v2.1/servers/281c6d18-599b-4d33-b063-f7ec58a8c96e" status: 200 len: 1356 microversion: 2.1 time: 0.152197 Oct 04 19:46:44.787654 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3586/7544] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:46:44 2022] GET /compute/v2.1/servers/281c6d18-599b-4d33-b063-f7ec58a8c96e => generated 1356 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:46:45.810086 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-09d3986b-1d02-43a5-a9e5-0808245418dd tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:46:45.810716 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-09d3986b-1d02-43a5-a9e5-0808245418dd tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] [instance: 281c6d18-599b-4d33-b063-f7ec58a8c96e] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:46:45.817638 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-09d3986b-1d02-43a5-a9e5-0808245418dd tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:45.818137 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-09d3986b-1d02-43a5-a9e5-0808245418dd tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:45.818617 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-09d3986b-1d02-43a5-a9e5-0808245418dd tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:45.819349 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-09d3986b-1d02-43a5-a9e5-0808245418dd tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:45.819820 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-09d3986b-1d02-43a5-a9e5-0808245418dd tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:45.820263 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-09d3986b-1d02-43a5-a9e5-0808245418dd tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:45.946294 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-09d3986b-1d02-43a5-a9e5-0808245418dd tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5daff488843949a7835ee0766d898dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9d9c6a533a41a592780f78c4ac7eaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:46:45.954314 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-09d3986b-1d02-43a5-a9e5-0808245418dd tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] 10.222.0.43 "GET /compute/v2.1/servers/281c6d18-599b-4d33-b063-f7ec58a8c96e" status: 200 len: 1356 microversion: 2.1 time: 0.148151 Oct 04 19:46:45.954894 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3959/7545] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:46:45 2022] GET /compute/v2.1/servers/281c6d18-599b-4d33-b063-f7ec58a8c96e => generated 1356 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:46:46.977741 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-44a500c8-b956-4493-8ae5-e10f34a1a5b7 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:46:46.978359 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-44a500c8-b956-4493-8ae5-e10f34a1a5b7 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] [instance: 281c6d18-599b-4d33-b063-f7ec58a8c96e] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:46:46.985186 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-44a500c8-b956-4493-8ae5-e10f34a1a5b7 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:46.985670 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-44a500c8-b956-4493-8ae5-e10f34a1a5b7 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:46.986112 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-44a500c8-b956-4493-8ae5-e10f34a1a5b7 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:46.986812 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-44a500c8-b956-4493-8ae5-e10f34a1a5b7 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:46.987269 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-44a500c8-b956-4493-8ae5-e10f34a1a5b7 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:46.987701 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-44a500c8-b956-4493-8ae5-e10f34a1a5b7 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:47.119167 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-44a500c8-b956-4493-8ae5-e10f34a1a5b7 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5daff488843949a7835ee0766d898dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9d9c6a533a41a592780f78c4ac7eaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:46:47.126853 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-44a500c8-b956-4493-8ae5-e10f34a1a5b7 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] 10.222.0.43 "GET /compute/v2.1/servers/281c6d18-599b-4d33-b063-f7ec58a8c96e" status: 200 len: 1356 microversion: 2.1 time: 0.153562 Oct 04 19:46:47.127424 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3587/7546] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:46:46 2022] GET /compute/v2.1/servers/281c6d18-599b-4d33-b063-f7ec58a8c96e => generated 1356 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:46:47.413578 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-51b2d0ed-5bc6-4e90-a470-e0bf57c88272 req-26674eae-8119-4d38-950c-7ed7aac0b10c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "281c6d18-599b-4d33-b063-f7ec58a8c96e", "name": "network-vif-plugged", "status": "completed", "tag": "a3d25985-26c5-4df1-b10d-8e522ad02e46"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:46:47.423257 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-51b2d0ed-5bc6-4e90-a470-e0bf57c88272 req-26674eae-8119-4d38-950c-7ed7aac0b10c service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:47.423751 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-51b2d0ed-5bc6-4e90-a470-e0bf57c88272 req-26674eae-8119-4d38-950c-7ed7aac0b10c service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:47.424202 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-51b2d0ed-5bc6-4e90-a470-e0bf57c88272 req-26674eae-8119-4d38-950c-7ed7aac0b10c service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:47.435404 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-51b2d0ed-5bc6-4e90-a470-e0bf57c88272 req-26674eae-8119-4d38-950c-7ed7aac0b10c service nova] Creating event network-vif-plugged:a3d25985-26c5-4df1-b10d-8e522ad02e46 for instance 281c6d18-599b-4d33-b063-f7ec58a8c96e on n-h2-851028-13 Oct 04 19:46:47.440705 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-51b2d0ed-5bc6-4e90-a470-e0bf57c88272 req-26674eae-8119-4d38-950c-7ed7aac0b10c service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094425 Oct 04 19:46:47.441349 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3960/7547] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:46:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:46:48.149656 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-c8c98828-dec2-4514-bce7-88d1206296fb tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:46:48.150267 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-c8c98828-dec2-4514-bce7-88d1206296fb tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] [instance: 281c6d18-599b-4d33-b063-f7ec58a8c96e] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:46:48.157058 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c8c98828-dec2-4514-bce7-88d1206296fb tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:48.157581 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c8c98828-dec2-4514-bce7-88d1206296fb tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:48.158033 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c8c98828-dec2-4514-bce7-88d1206296fb tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:48.158735 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c8c98828-dec2-4514-bce7-88d1206296fb tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:48.159198 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c8c98828-dec2-4514-bce7-88d1206296fb tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:48.159633 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c8c98828-dec2-4514-bce7-88d1206296fb tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:48.288048 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-c8c98828-dec2-4514-bce7-88d1206296fb tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5daff488843949a7835ee0766d898dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9d9c6a533a41a592780f78c4ac7eaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:46:48.295836 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-c8c98828-dec2-4514-bce7-88d1206296fb tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] 10.222.0.43 "GET /compute/v2.1/servers/281c6d18-599b-4d33-b063-f7ec58a8c96e" status: 200 len: 1356 microversion: 2.1 time: 0.150166 Oct 04 19:46:48.296416 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3588/7548] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:46:48 2022] GET /compute/v2.1/servers/281c6d18-599b-4d33-b063-f7ec58a8c96e => generated 1356 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:46:49.320367 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-ee61c7b2-5cdf-44cc-aa79-7f1756784336 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:46:49.321028 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-ee61c7b2-5cdf-44cc-aa79-7f1756784336 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] [instance: 281c6d18-599b-4d33-b063-f7ec58a8c96e] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:46:49.328461 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ee61c7b2-5cdf-44cc-aa79-7f1756784336 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:49.328961 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ee61c7b2-5cdf-44cc-aa79-7f1756784336 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:49.329449 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ee61c7b2-5cdf-44cc-aa79-7f1756784336 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:49.330159 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ee61c7b2-5cdf-44cc-aa79-7f1756784336 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:49.330656 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ee61c7b2-5cdf-44cc-aa79-7f1756784336 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:49.331102 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ee61c7b2-5cdf-44cc-aa79-7f1756784336 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:49.461048 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-ee61c7b2-5cdf-44cc-aa79-7f1756784336 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5daff488843949a7835ee0766d898dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9d9c6a533a41a592780f78c4ac7eaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:46:49.469001 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-ee61c7b2-5cdf-44cc-aa79-7f1756784336 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] 10.222.0.43 "GET /compute/v2.1/servers/281c6d18-599b-4d33-b063-f7ec58a8c96e" status: 200 len: 1546 microversion: 2.1 time: 0.153537 Oct 04 19:46:49.469673 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3961/7549] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:46:49 2022] GET /compute/v2.1/servers/281c6d18-599b-4d33-b063-f7ec58a8c96e => generated 1546 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:46:49.490985 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-34757550-42c0-4875-912a-c981263b501d tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:46:49.491638 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-34757550-42c0-4875-912a-c981263b501d tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] [instance: 281c6d18-599b-4d33-b063-f7ec58a8c96e] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:46:49.498550 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-34757550-42c0-4875-912a-c981263b501d tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:49.499036 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-34757550-42c0-4875-912a-c981263b501d tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:49.499480 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-34757550-42c0-4875-912a-c981263b501d tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:49.500174 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-34757550-42c0-4875-912a-c981263b501d tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:49.500629 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-34757550-42c0-4875-912a-c981263b501d tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:49.501058 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-34757550-42c0-4875-912a-c981263b501d tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:49.636078 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-34757550-42c0-4875-912a-c981263b501d tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5daff488843949a7835ee0766d898dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9d9c6a533a41a592780f78c4ac7eaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:46:49.643969 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-34757550-42c0-4875-912a-c981263b501d tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] 10.222.0.43 "GET /compute/v2.1/servers/281c6d18-599b-4d33-b063-f7ec58a8c96e" status: 200 len: 1546 microversion: 2.1 time: 0.156924 Oct 04 19:46:49.644539 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3589/7550] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:46:49 2022] GET /compute/v2.1/servers/281c6d18-599b-4d33-b063-f7ec58a8c96e => generated 1546 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:46:49.665585 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-86d37e0b-b88d-459b-bde3-a1d6626244db tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:46:49.670439 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-86d37e0b-b88d-459b-bde3-a1d6626244db tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5daff488843949a7835ee0766d898dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9d9c6a533a41a592780f78c4ac7eaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:46:49.671214 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-86d37e0b-b88d-459b-bde3-a1d6626244db tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Searching by: {'deleted': False, 'project_id': '5a9d9c6a533a41a592780f78c4ac7eaa'} {{(pid=123596) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 19:46:49.676525 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-86d37e0b-b88d-459b-bde3-a1d6626244db tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:49.677015 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-86d37e0b-b88d-459b-bde3-a1d6626244db tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:49.677498 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-86d37e0b-b88d-459b-bde3-a1d6626244db tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:49.678724 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-86d37e0b-b88d-459b-bde3-a1d6626244db tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:49.679191 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-86d37e0b-b88d-459b-bde3-a1d6626244db tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:49.679631 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-86d37e0b-b88d-459b-bde3-a1d6626244db tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:49.703934 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.multi_cell_list [None req-86d37e0b-b88d-459b-bde3-a1d6626244db tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=123596) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 19:46:49.729600 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-86d37e0b-b88d-459b-bde3-a1d6626244db tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] 10.222.0.43 "GET /compute/v2.1/servers" status: 200 len: 341 microversion: 2.1 time: 0.067866 Oct 04 19:46:49.730180 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3962/7551] 10.222.0.43 () {58 vars in 1125 bytes} [Tue Oct 4 19:46:49 2022] GET /compute/v2.1/servers => generated 341 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:46:49.742391 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-a0cd93f4-43ab-41a8-9ad6-984c2bee2c6f tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:46:49.743013 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-a0cd93f4-43ab-41a8-9ad6-984c2bee2c6f tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] [instance: 281c6d18-599b-4d33-b063-f7ec58a8c96e] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:46:49.748918 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a0cd93f4-43ab-41a8-9ad6-984c2bee2c6f tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:49.749444 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a0cd93f4-43ab-41a8-9ad6-984c2bee2c6f tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:49.749890 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a0cd93f4-43ab-41a8-9ad6-984c2bee2c6f tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:49.750584 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a0cd93f4-43ab-41a8-9ad6-984c2bee2c6f tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:49.751041 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a0cd93f4-43ab-41a8-9ad6-984c2bee2c6f tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:49.751472 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a0cd93f4-43ab-41a8-9ad6-984c2bee2c6f tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:49.877244 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-a0cd93f4-43ab-41a8-9ad6-984c2bee2c6f tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5daff488843949a7835ee0766d898dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9d9c6a533a41a592780f78c4ac7eaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:46:49.885666 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-a0cd93f4-43ab-41a8-9ad6-984c2bee2c6f tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] 10.222.0.43 "GET /compute/v2.1/servers/281c6d18-599b-4d33-b063-f7ec58a8c96e" status: 200 len: 1546 microversion: 2.1 time: 0.147636 Oct 04 19:46:49.886248 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3590/7552] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:46:49 2022] GET /compute/v2.1/servers/281c6d18-599b-4d33-b063-f7ec58a8c96e => generated 1546 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:46:51.393750 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-75d61dfc-31f8-4382-a31c-326f90e68371 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "db7e5b64-a01d-427a-80bf-76e6db958858"}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:46:51.396124 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-75d61dfc-31f8-4382-a31c-326f90e68371 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] [instance: 281c6d18-599b-4d33-b063-f7ec58a8c96e] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:46:51.402906 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-75d61dfc-31f8-4382-a31c-326f90e68371 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:51.403402 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-75d61dfc-31f8-4382-a31c-326f90e68371 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:51.403860 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-75d61dfc-31f8-4382-a31c-326f90e68371 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:51.404557 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-75d61dfc-31f8-4382-a31c-326f90e68371 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:51.405025 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-75d61dfc-31f8-4382-a31c-326f90e68371 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:51.405511 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-75d61dfc-31f8-4382-a31c-326f90e68371 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:51.646797 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-75d61dfc-31f8-4382-a31c-326f90e68371 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] 10.222.0.43 "POST /compute/v2.1/servers/281c6d18-599b-4d33-b063-f7ec58a8c96e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.256832 Oct 04 19:46:51.651831 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3963/7553] 10.222.0.43 () {60 vars in 1323 bytes} [Tue Oct 4 19:46:51 2022] POST /compute/v2.1/servers/281c6d18-599b-4d33-b063-f7ec58a8c96e/os-volume_attachments => generated 194 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:47:02.413422 n-d-851028-13 devstack@n-api.service[123595]: ERROR oslo.messaging._drivers.impl_rabbit [-] [457acf28-5277-4578-be2f-82b18e59b660] AMQP server on 10.222.0.43:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 04 19:47:02.417525 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-31d556d3-9f00-4060-8e8f-6dd40ae6a048 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:47:02.418142 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-31d556d3-9f00-4060-8e8f-6dd40ae6a048 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] [instance: 281c6d18-599b-4d33-b063-f7ec58a8c96e] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:47:02.420444 n-d-851028-13 devstack@n-api.service[123595]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b5b0be1f-cd68-4bfe-8e95-82ae6af61476] AMQP server on 10.222.0.43:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 04 19:47:02.421027 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_api:SELECT=15 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:47:02.421712 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=60 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:47:02.428039 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-31d556d3-9f00-4060-8e8f-6dd40ae6a048 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:47:02.428526 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-31d556d3-9f00-4060-8e8f-6dd40ae6a048 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:47:02.428973 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-31d556d3-9f00-4060-8e8f-6dd40ae6a048 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:47:02.429705 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-31d556d3-9f00-4060-8e8f-6dd40ae6a048 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:47:02.430167 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-31d556d3-9f00-4060-8e8f-6dd40ae6a048 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:47:02.430602 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-31d556d3-9f00-4060-8e8f-6dd40ae6a048 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:47:02.558583 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-31d556d3-9f00-4060-8e8f-6dd40ae6a048 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5daff488843949a7835ee0766d898dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9d9c6a533a41a592780f78c4ac7eaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:47:02.566864 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-31d556d3-9f00-4060-8e8f-6dd40ae6a048 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] 10.222.0.43 "GET /compute/v2.1/servers/281c6d18-599b-4d33-b063-f7ec58a8c96e" status: 200 len: 1592 microversion: 2.1 time: 0.154793 Oct 04 19:47:02.567438 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3591/7554] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:47:02 2022] GET /compute/v2.1/servers/281c6d18-599b-4d33-b063-f7ec58a8c96e => generated 1592 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:47:04.136354 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=2 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:47:04.137314 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_api:SELECT=17 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:47:04.138145 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:47:04.212170 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-59c8f6b5-e4bf-48b7-8c73-2fb807ac9d88 req-706608d1-05c5-490d-bc31-6b174c31e744 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "281c6d18-599b-4d33-b063-f7ec58a8c96e", "tag": "a3d25985-26c5-4df1-b10d-8e522ad02e46"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:47:04.238095 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-59c8f6b5-e4bf-48b7-8c73-2fb807ac9d88 req-706608d1-05c5-490d-bc31-6b174c31e744 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:47:04.238902 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-59c8f6b5-e4bf-48b7-8c73-2fb807ac9d88 req-706608d1-05c5-490d-bc31-6b174c31e744 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:47:04.239525 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-59c8f6b5-e4bf-48b7-8c73-2fb807ac9d88 req-706608d1-05c5-490d-bc31-6b174c31e744 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:47:04.253121 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-59c8f6b5-e4bf-48b7-8c73-2fb807ac9d88 req-706608d1-05c5-490d-bc31-6b174c31e744 service nova] Creating event network-changed:a3d25985-26c5-4df1-b10d-8e522ad02e46 for instance 281c6d18-599b-4d33-b063-f7ec58a8c96e on n-h2-851028-13 Oct 04 19:47:04.259195 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-59c8f6b5-e4bf-48b7-8c73-2fb807ac9d88 req-706608d1-05c5-490d-bc31-6b174c31e744 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.125027 Oct 04 19:47:04.261397 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3964/7555] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:47:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:47:05.263202 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-55cfaf50-9e2b-406b-86d1-30ee817a7039 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-19289245"}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:47:05.263767 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-55cfaf50-9e2b-406b-86d1-30ee817a7039 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] [instance: 281c6d18-599b-4d33-b063-f7ec58a8c96e] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:47:05.274047 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-55cfaf50-9e2b-406b-86d1-30ee817a7039 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:47:05.274804 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-55cfaf50-9e2b-406b-86d1-30ee817a7039 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:47:05.275291 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-55cfaf50-9e2b-406b-86d1-30ee817a7039 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:47:05.276009 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-55cfaf50-9e2b-406b-86d1-30ee817a7039 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:47:05.276467 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-55cfaf50-9e2b-406b-86d1-30ee817a7039 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:47:05.276904 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-55cfaf50-9e2b-406b-86d1-30ee817a7039 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:47:05.282924 n-d-851028-13 devstack@n-api.service[123595]: INFO oslo.messaging._drivers.impl_rabbit [-] [b5b0be1f-cd68-4bfe-8e95-82ae6af61476] Reconnected to AMQP server on 10.222.0.43:5672 via [amqp] client with port 49624. Oct 04 19:47:05.293604 n-d-851028-13 devstack@n-api.service[123595]: INFO oslo.messaging._drivers.impl_rabbit [-] [457acf28-5277-4578-be2f-82b18e59b660] Reconnected to AMQP server on 10.222.0.43:5672 via [amqp] client with port 49622. Oct 04 19:47:05.421000 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.network.security_group_api [None req-55cfaf50-9e2b-406b-86d1-30ee817a7039 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Adding security group d8495683-b0e8-4cdf-8a14-5daa443ed5a1 to port a3d25985-26c5-4df1-b10d-8e522ad02e46 Oct 04 19:47:05.737528 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-55cfaf50-9e2b-406b-86d1-30ee817a7039 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] 10.222.0.43 "POST /compute/v2.1/servers/281c6d18-599b-4d33-b063-f7ec58a8c96e/action" status: 202 len: 0 microversion: 2.1 time: 0.478873 Oct 04 19:47:05.748438 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-767a7649-7487-497a-98bb-9b19ee0dc58d tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:47:05.749137 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3592/7556] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 19:47:05 2022] POST /compute/v2.1/servers/281c6d18-599b-4d33-b063-f7ec58a8c96e/action => generated 0 bytes in 491 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:47:05.750097 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-767a7649-7487-497a-98bb-9b19ee0dc58d tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] [instance: 281c6d18-599b-4d33-b063-f7ec58a8c96e] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:47:05.756474 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-767a7649-7487-497a-98bb-9b19ee0dc58d tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:47:05.757244 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-767a7649-7487-497a-98bb-9b19ee0dc58d tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:47:05.757887 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-767a7649-7487-497a-98bb-9b19ee0dc58d tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:47:05.758606 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-767a7649-7487-497a-98bb-9b19ee0dc58d tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:47:05.759222 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-767a7649-7487-497a-98bb-9b19ee0dc58d tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:47:05.759883 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-767a7649-7487-497a-98bb-9b19ee0dc58d tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:47:05.909440 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-767a7649-7487-497a-98bb-9b19ee0dc58d tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5daff488843949a7835ee0766d898dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9d9c6a533a41a592780f78c4ac7eaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:47:05.922406 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-767a7649-7487-497a-98bb-9b19ee0dc58d tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] 10.222.0.43 "GET /compute/v2.1/servers/281c6d18-599b-4d33-b063-f7ec58a8c96e" status: 200 len: 1756 microversion: 2.1 time: 0.179464 Oct 04 19:47:05.923012 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3965/7557] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:47:05 2022] GET /compute/v2.1/servers/281c6d18-599b-4d33-b063-f7ec58a8c96e => generated 1756 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:47:06.277270 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-5008f153-6287-4c31-be98-81ba23fb6ff8 req-cacf43c6-4b97-464c-abaa-699593bda1eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "281c6d18-599b-4d33-b063-f7ec58a8c96e", "tag": "a3d25985-26c5-4df1-b10d-8e522ad02e46"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:47:06.288691 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-5008f153-6287-4c31-be98-81ba23fb6ff8 req-cacf43c6-4b97-464c-abaa-699593bda1eb service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:47:06.289211 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-5008f153-6287-4c31-be98-81ba23fb6ff8 req-cacf43c6-4b97-464c-abaa-699593bda1eb service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:47:06.289657 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-5008f153-6287-4c31-be98-81ba23fb6ff8 req-cacf43c6-4b97-464c-abaa-699593bda1eb service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:47:06.302619 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-5008f153-6287-4c31-be98-81ba23fb6ff8 req-cacf43c6-4b97-464c-abaa-699593bda1eb service nova] Creating event network-changed:a3d25985-26c5-4df1-b10d-8e522ad02e46 for instance 281c6d18-599b-4d33-b063-f7ec58a8c96e on n-h2-851028-13 Oct 04 19:47:06.307277 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-5008f153-6287-4c31-be98-81ba23fb6ff8 req-cacf43c6-4b97-464c-abaa-699593bda1eb service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034495 Oct 04 19:47:06.307933 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3593/7558] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:47:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:47:20.895010 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-80a160ed-68a3-484d-9dd9-0a204c3bf614 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:47:20.897374 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-80a160ed-68a3-484d-9dd9-0a204c3bf614 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] [instance: 281c6d18-599b-4d33-b063-f7ec58a8c96e] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:47:20.899929 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_api:SELECT=4 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:47:20.900601 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=8 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:47:20.906874 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-80a160ed-68a3-484d-9dd9-0a204c3bf614 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:47:20.907369 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-80a160ed-68a3-484d-9dd9-0a204c3bf614 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:47:20.907820 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-80a160ed-68a3-484d-9dd9-0a204c3bf614 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:47:20.908526 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-80a160ed-68a3-484d-9dd9-0a204c3bf614 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:47:20.908989 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-80a160ed-68a3-484d-9dd9-0a204c3bf614 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:47:20.909455 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-80a160ed-68a3-484d-9dd9-0a204c3bf614 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:47:20.982882 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-80a160ed-68a3-484d-9dd9-0a204c3bf614 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] 10.222.0.43 "POST /compute/v2.1/servers/281c6d18-599b-4d33-b063-f7ec58a8c96e/action" status: 202 len: 0 microversion: 2.1 time: 0.091876 Oct 04 19:47:20.983539 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3966/7559] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 19:47:20 2022] POST /compute/v2.1/servers/281c6d18-599b-4d33-b063-f7ec58a8c96e/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:47:20.989941 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_api:SELECT=6 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:47:20.990706 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=12 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:47:20.995806 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-62454474-f6be-4979-a0ad-95cb6ff29278 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:47:20.996544 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-62454474-f6be-4979-a0ad-95cb6ff29278 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] [instance: 281c6d18-599b-4d33-b063-f7ec58a8c96e] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:47:21.004270 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-62454474-f6be-4979-a0ad-95cb6ff29278 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:47:21.005064 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-62454474-f6be-4979-a0ad-95cb6ff29278 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:47:21.005740 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-62454474-f6be-4979-a0ad-95cb6ff29278 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:47:21.006453 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-62454474-f6be-4979-a0ad-95cb6ff29278 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:47:21.006921 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-62454474-f6be-4979-a0ad-95cb6ff29278 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:47:21.007515 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-62454474-f6be-4979-a0ad-95cb6ff29278 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:47:21.156843 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-62454474-f6be-4979-a0ad-95cb6ff29278 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5daff488843949a7835ee0766d898dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9d9c6a533a41a592780f78c4ac7eaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:47:21.165263 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-62454474-f6be-4979-a0ad-95cb6ff29278 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] 10.222.0.43 "GET /compute/v2.1/servers/281c6d18-599b-4d33-b063-f7ec58a8c96e" status: 200 len: 1748 microversion: 2.1 time: 0.177268 Oct 04 19:47:21.165840 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3594/7560] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:47:20 2022] GET /compute/v2.1/servers/281c6d18-599b-4d33-b063-f7ec58a8c96e => generated 1748 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:47:22.189556 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-e40e08c2-0107-4b62-8bd9-cf69501dac65 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:47:22.195050 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-e40e08c2-0107-4b62-8bd9-cf69501dac65 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] [instance: 281c6d18-599b-4d33-b063-f7ec58a8c96e] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:47:22.197146 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e40e08c2-0107-4b62-8bd9-cf69501dac65 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:47:22.197683 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e40e08c2-0107-4b62-8bd9-cf69501dac65 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:47:22.198149 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e40e08c2-0107-4b62-8bd9-cf69501dac65 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:47:22.199377 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e40e08c2-0107-4b62-8bd9-cf69501dac65 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:47:22.199852 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e40e08c2-0107-4b62-8bd9-cf69501dac65 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:47:22.200302 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e40e08c2-0107-4b62-8bd9-cf69501dac65 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:47:22.341288 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-e40e08c2-0107-4b62-8bd9-cf69501dac65 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5daff488843949a7835ee0766d898dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9d9c6a533a41a592780f78c4ac7eaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:47:22.349867 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-e40e08c2-0107-4b62-8bd9-cf69501dac65 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] 10.222.0.43 "GET /compute/v2.1/servers/281c6d18-599b-4d33-b063-f7ec58a8c96e" status: 200 len: 1753 microversion: 2.1 time: 0.165543 Oct 04 19:47:22.350451 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3967/7561] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:47:22 2022] GET /compute/v2.1/servers/281c6d18-599b-4d33-b063-f7ec58a8c96e => generated 1753 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:47:23.373380 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-dcb94aa6-7873-42b5-8d66-6379b35356ba tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:47:23.374005 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-dcb94aa6-7873-42b5-8d66-6379b35356ba tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] [instance: 281c6d18-599b-4d33-b063-f7ec58a8c96e] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:47:23.380830 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dcb94aa6-7873-42b5-8d66-6379b35356ba tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:47:23.381356 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dcb94aa6-7873-42b5-8d66-6379b35356ba tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:47:23.381805 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dcb94aa6-7873-42b5-8d66-6379b35356ba tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:47:23.382501 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dcb94aa6-7873-42b5-8d66-6379b35356ba tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:47:23.382958 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dcb94aa6-7873-42b5-8d66-6379b35356ba tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:47:23.383390 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-dcb94aa6-7873-42b5-8d66-6379b35356ba tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:47:23.525810 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-dcb94aa6-7873-42b5-8d66-6379b35356ba tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5daff488843949a7835ee0766d898dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9d9c6a533a41a592780f78c4ac7eaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:47:23.534593 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-dcb94aa6-7873-42b5-8d66-6379b35356ba tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] 10.222.0.43 "GET /compute/v2.1/servers/281c6d18-599b-4d33-b063-f7ec58a8c96e" status: 200 len: 1753 microversion: 2.1 time: 0.165158 Oct 04 19:47:23.535164 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3595/7562] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:47:23 2022] GET /compute/v2.1/servers/281c6d18-599b-4d33-b063-f7ec58a8c96e => generated 1753 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:47:24.603418 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-abd31a63-ce9d-495a-8b4a-5d1d3cf4450b tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:47:24.604070 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-abd31a63-ce9d-495a-8b4a-5d1d3cf4450b tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] [instance: 281c6d18-599b-4d33-b063-f7ec58a8c96e] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:47:24.610902 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-abd31a63-ce9d-495a-8b4a-5d1d3cf4450b tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:47:24.611403 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-abd31a63-ce9d-495a-8b4a-5d1d3cf4450b tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:47:24.611864 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-abd31a63-ce9d-495a-8b4a-5d1d3cf4450b tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:47:24.612573 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-abd31a63-ce9d-495a-8b4a-5d1d3cf4450b tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:47:24.613046 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-abd31a63-ce9d-495a-8b4a-5d1d3cf4450b tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:47:24.613526 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-abd31a63-ce9d-495a-8b4a-5d1d3cf4450b tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:47:24.753286 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-abd31a63-ce9d-495a-8b4a-5d1d3cf4450b tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5daff488843949a7835ee0766d898dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9d9c6a533a41a592780f78c4ac7eaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:47:24.761772 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-abd31a63-ce9d-495a-8b4a-5d1d3cf4450b tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] 10.222.0.43 "GET /compute/v2.1/servers/281c6d18-599b-4d33-b063-f7ec58a8c96e" status: 200 len: 1753 microversion: 2.1 time: 0.207407 Oct 04 19:47:24.762350 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3968/7563] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:47:24 2022] GET /compute/v2.1/servers/281c6d18-599b-4d33-b063-f7ec58a8c96e => generated 1753 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:47:25.785259 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-83f53deb-f122-41f3-a142-10688f170057 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:47:25.785881 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-83f53deb-f122-41f3-a142-10688f170057 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] [instance: 281c6d18-599b-4d33-b063-f7ec58a8c96e] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:47:25.793312 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-83f53deb-f122-41f3-a142-10688f170057 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:47:25.793796 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-83f53deb-f122-41f3-a142-10688f170057 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:47:25.794232 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-83f53deb-f122-41f3-a142-10688f170057 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:47:25.794919 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-83f53deb-f122-41f3-a142-10688f170057 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:47:25.795403 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-83f53deb-f122-41f3-a142-10688f170057 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:47:25.795832 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-83f53deb-f122-41f3-a142-10688f170057 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:47:25.937717 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-83f53deb-f122-41f3-a142-10688f170057 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5daff488843949a7835ee0766d898dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9d9c6a533a41a592780f78c4ac7eaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:47:25.945807 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-83f53deb-f122-41f3-a142-10688f170057 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] 10.222.0.43 "GET /compute/v2.1/servers/281c6d18-599b-4d33-b063-f7ec58a8c96e" status: 200 len: 1753 microversion: 2.1 time: 0.164472 Oct 04 19:47:25.946382 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3596/7564] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:47:25 2022] GET /compute/v2.1/servers/281c6d18-599b-4d33-b063-f7ec58a8c96e => generated 1753 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:47:26.970104 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-5a071f1a-07f0-47a2-866c-a886e7ac11a3 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:47:26.970731 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-5a071f1a-07f0-47a2-866c-a886e7ac11a3 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] [instance: 281c6d18-599b-4d33-b063-f7ec58a8c96e] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:47:26.977577 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5a071f1a-07f0-47a2-866c-a886e7ac11a3 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:47:26.978073 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5a071f1a-07f0-47a2-866c-a886e7ac11a3 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:47:26.978519 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5a071f1a-07f0-47a2-866c-a886e7ac11a3 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:47:26.979229 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5a071f1a-07f0-47a2-866c-a886e7ac11a3 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:47:26.979701 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5a071f1a-07f0-47a2-866c-a886e7ac11a3 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:47:26.980805 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5a071f1a-07f0-47a2-866c-a886e7ac11a3 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:47:27.126597 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-5a071f1a-07f0-47a2-866c-a886e7ac11a3 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5daff488843949a7835ee0766d898dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9d9c6a533a41a592780f78c4ac7eaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:47:27.135050 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-5a071f1a-07f0-47a2-866c-a886e7ac11a3 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] 10.222.0.43 "GET /compute/v2.1/servers/281c6d18-599b-4d33-b063-f7ec58a8c96e" status: 200 len: 1753 microversion: 2.1 time: 0.168817 Oct 04 19:47:27.135574 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3969/7565] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:47:26 2022] GET /compute/v2.1/servers/281c6d18-599b-4d33-b063-f7ec58a8c96e => generated 1753 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:47:28.157529 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-359a9fc1-a996-4532-b136-3d829a020977 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:47:28.158154 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-359a9fc1-a996-4532-b136-3d829a020977 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] [instance: 281c6d18-599b-4d33-b063-f7ec58a8c96e] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:47:28.164951 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-359a9fc1-a996-4532-b136-3d829a020977 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:47:28.165470 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-359a9fc1-a996-4532-b136-3d829a020977 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:47:28.165918 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-359a9fc1-a996-4532-b136-3d829a020977 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:47:28.166616 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-359a9fc1-a996-4532-b136-3d829a020977 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:47:28.167072 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-359a9fc1-a996-4532-b136-3d829a020977 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:47:28.168006 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-359a9fc1-a996-4532-b136-3d829a020977 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:47:28.311654 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-359a9fc1-a996-4532-b136-3d829a020977 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5daff488843949a7835ee0766d898dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9d9c6a533a41a592780f78c4ac7eaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:47:28.319906 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-359a9fc1-a996-4532-b136-3d829a020977 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] 10.222.0.43 "GET /compute/v2.1/servers/281c6d18-599b-4d33-b063-f7ec58a8c96e" status: 200 len: 1753 microversion: 2.1 time: 0.166285 Oct 04 19:47:28.320479 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3597/7566] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:47:28 2022] GET /compute/v2.1/servers/281c6d18-599b-4d33-b063-f7ec58a8c96e => generated 1753 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:47:29.343317 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-e227b7f8-5229-4057-aeb0-b8561196f202 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:47:29.343950 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-e227b7f8-5229-4057-aeb0-b8561196f202 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] [instance: 281c6d18-599b-4d33-b063-f7ec58a8c96e] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:47:29.351712 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e227b7f8-5229-4057-aeb0-b8561196f202 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:47:29.351889 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e227b7f8-5229-4057-aeb0-b8561196f202 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:47:29.352346 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e227b7f8-5229-4057-aeb0-b8561196f202 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:47:29.353070 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e227b7f8-5229-4057-aeb0-b8561196f202 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:47:29.353595 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e227b7f8-5229-4057-aeb0-b8561196f202 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:47:29.354049 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e227b7f8-5229-4057-aeb0-b8561196f202 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:47:29.496361 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-e227b7f8-5229-4057-aeb0-b8561196f202 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5daff488843949a7835ee0766d898dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9d9c6a533a41a592780f78c4ac7eaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:47:29.504771 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-e227b7f8-5229-4057-aeb0-b8561196f202 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] 10.222.0.43 "GET /compute/v2.1/servers/281c6d18-599b-4d33-b063-f7ec58a8c96e" status: 200 len: 1753 microversion: 2.1 time: 0.165490 Oct 04 19:47:29.505381 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3970/7567] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:47:29 2022] GET /compute/v2.1/servers/281c6d18-599b-4d33-b063-f7ec58a8c96e => generated 1753 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:47:30.529773 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-b927568d-f135-4135-ab32-47b32805065f tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:47:30.530385 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-b927568d-f135-4135-ab32-47b32805065f tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] [instance: 281c6d18-599b-4d33-b063-f7ec58a8c96e] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:47:30.537134 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b927568d-f135-4135-ab32-47b32805065f tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:47:30.537625 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b927568d-f135-4135-ab32-47b32805065f tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:47:30.538065 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b927568d-f135-4135-ab32-47b32805065f tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:47:30.538752 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b927568d-f135-4135-ab32-47b32805065f tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:47:30.539205 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b927568d-f135-4135-ab32-47b32805065f tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:47:30.539639 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b927568d-f135-4135-ab32-47b32805065f tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:47:30.683328 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-b927568d-f135-4135-ab32-47b32805065f tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5daff488843949a7835ee0766d898dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9d9c6a533a41a592780f78c4ac7eaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:47:30.692370 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-b927568d-f135-4135-ab32-47b32805065f tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] 10.222.0.43 "GET /compute/v2.1/servers/281c6d18-599b-4d33-b063-f7ec58a8c96e" status: 200 len: 1753 microversion: 2.1 time: 0.167224 Oct 04 19:47:30.692967 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3598/7568] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:47:30 2022] GET /compute/v2.1/servers/281c6d18-599b-4d33-b063-f7ec58a8c96e => generated 1753 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:47:31.715913 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-0cd5e099-4541-4f22-8676-008903961bf3 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:47:31.716575 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-0cd5e099-4541-4f22-8676-008903961bf3 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] [instance: 281c6d18-599b-4d33-b063-f7ec58a8c96e] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:47:31.723695 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0cd5e099-4541-4f22-8676-008903961bf3 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:47:31.724201 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0cd5e099-4541-4f22-8676-008903961bf3 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:47:31.724663 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0cd5e099-4541-4f22-8676-008903961bf3 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:47:31.725408 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0cd5e099-4541-4f22-8676-008903961bf3 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:47:31.725890 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0cd5e099-4541-4f22-8676-008903961bf3 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:47:31.726346 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0cd5e099-4541-4f22-8676-008903961bf3 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:47:31.872693 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-0cd5e099-4541-4f22-8676-008903961bf3 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5daff488843949a7835ee0766d898dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9d9c6a533a41a592780f78c4ac7eaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:47:31.881101 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-0cd5e099-4541-4f22-8676-008903961bf3 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] 10.222.0.43 "GET /compute/v2.1/servers/281c6d18-599b-4d33-b063-f7ec58a8c96e" status: 200 len: 1753 microversion: 2.1 time: 0.169197 Oct 04 19:47:31.881704 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3971/7569] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:47:31 2022] GET /compute/v2.1/servers/281c6d18-599b-4d33-b063-f7ec58a8c96e => generated 1753 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:47:32.905095 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-d9db8208-605e-470a-a78a-d6e25e2fce94 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:47:32.905655 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-d9db8208-605e-470a-a78a-d6e25e2fce94 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] [instance: 281c6d18-599b-4d33-b063-f7ec58a8c96e] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:47:32.912648 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d9db8208-605e-470a-a78a-d6e25e2fce94 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:47:32.913152 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d9db8208-605e-470a-a78a-d6e25e2fce94 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:47:32.913598 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d9db8208-605e-470a-a78a-d6e25e2fce94 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:47:32.914283 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d9db8208-605e-470a-a78a-d6e25e2fce94 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:47:32.914737 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d9db8208-605e-470a-a78a-d6e25e2fce94 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:47:32.915163 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d9db8208-605e-470a-a78a-d6e25e2fce94 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:47:33.056758 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-d9db8208-605e-470a-a78a-d6e25e2fce94 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5daff488843949a7835ee0766d898dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9d9c6a533a41a592780f78c4ac7eaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:47:33.065612 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-d9db8208-605e-470a-a78a-d6e25e2fce94 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] 10.222.0.43 "GET /compute/v2.1/servers/281c6d18-599b-4d33-b063-f7ec58a8c96e" status: 200 len: 1756 microversion: 2.1 time: 0.165119 Oct 04 19:47:33.066189 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3599/7570] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:47:32 2022] GET /compute/v2.1/servers/281c6d18-599b-4d33-b063-f7ec58a8c96e => generated 1756 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:48:05.271589 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-66036a9d-bb75-4f61-87f4-826851179f1d tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-19289245"}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:48:05.272175 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-66036a9d-bb75-4f61-87f4-826851179f1d tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] [instance: 281c6d18-599b-4d33-b063-f7ec58a8c96e] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:48:05.274684 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_api:SELECT=12 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:48:05.275479 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:48:05.281215 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-66036a9d-bb75-4f61-87f4-826851179f1d tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:48:05.281720 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-66036a9d-bb75-4f61-87f4-826851179f1d tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:48:05.282180 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-66036a9d-bb75-4f61-87f4-826851179f1d tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:48:05.282892 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-66036a9d-bb75-4f61-87f4-826851179f1d tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:48:05.283365 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-66036a9d-bb75-4f61-87f4-826851179f1d tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:48:05.283810 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-66036a9d-bb75-4f61-87f4-826851179f1d tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:48:05.411427 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.network.security_group_api [None req-66036a9d-bb75-4f61-87f4-826851179f1d tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Removing security group d8495683-b0e8-4cdf-8a14-5daa443ed5a1 from port a3d25985-26c5-4df1-b10d-8e522ad02e46 Oct 04 19:48:05.711772 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-66036a9d-bb75-4f61-87f4-826851179f1d tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] 10.222.0.43 "POST /compute/v2.1/servers/281c6d18-599b-4d33-b063-f7ec58a8c96e/action" status: 202 len: 0 microversion: 2.1 time: 0.443549 Oct 04 19:48:05.724214 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3972/7571] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 19:48:05 2022] POST /compute/v2.1/servers/281c6d18-599b-4d33-b063-f7ec58a8c96e/action => generated 0 bytes in 457 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:48:05.737479 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-d4ae4647-576d-4405-8ac5-31918f18ba81 req-da3826b4-e3c3-47f4-84f6-b5d0f1a6fae2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "281c6d18-599b-4d33-b063-f7ec58a8c96e", "tag": "a3d25985-26c5-4df1-b10d-8e522ad02e46"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:48:05.752046 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_api:SELECT=12 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:48:05.752734 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=36 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:48:05.754924 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-d4ae4647-576d-4405-8ac5-31918f18ba81 req-da3826b4-e3c3-47f4-84f6-b5d0f1a6fae2 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:48:05.755473 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-d4ae4647-576d-4405-8ac5-31918f18ba81 req-da3826b4-e3c3-47f4-84f6-b5d0f1a6fae2 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:48:05.755904 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-d4ae4647-576d-4405-8ac5-31918f18ba81 req-da3826b4-e3c3-47f4-84f6-b5d0f1a6fae2 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:48:05.790936 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-d4ae4647-576d-4405-8ac5-31918f18ba81 req-da3826b4-e3c3-47f4-84f6-b5d0f1a6fae2 service nova] Creating event network-changed:a3d25985-26c5-4df1-b10d-8e522ad02e46 for instance 281c6d18-599b-4d33-b063-f7ec58a8c96e on n-h2-851028-13 Oct 04 19:48:05.797489 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-d4ae4647-576d-4405-8ac5-31918f18ba81 req-da3826b4-e3c3-47f4-84f6-b5d0f1a6fae2 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063822 Oct 04 19:48:05.798197 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3600/7572] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:48:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:48:07.446140 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-61962c6b-b350-44aa-b36b-4e06292b5cce tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:48:07.447261 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-61962c6b-b350-44aa-b36b-4e06292b5cce tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] [instance: 281c6d18-599b-4d33-b063-f7ec58a8c96e] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:48:07.455586 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-61962c6b-b350-44aa-b36b-4e06292b5cce tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:48:07.456100 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-61962c6b-b350-44aa-b36b-4e06292b5cce tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:48:07.456566 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-61962c6b-b350-44aa-b36b-4e06292b5cce tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:48:07.457335 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-61962c6b-b350-44aa-b36b-4e06292b5cce tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:48:07.457813 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-61962c6b-b350-44aa-b36b-4e06292b5cce tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:48:07.458261 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-61962c6b-b350-44aa-b36b-4e06292b5cce tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:48:07.547748 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.objects.instance [None req-61962c6b-b350-44aa-b36b-4e06292b5cce tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lazy-loading 'services' on Instance uuid 281c6d18-599b-4d33-b063-f7ec58a8c96e {{(pid=123596) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 19:48:07.631899 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-61962c6b-b350-44aa-b36b-4e06292b5cce tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] 10.222.0.43 "DELETE /compute/v2.1/servers/281c6d18-599b-4d33-b063-f7ec58a8c96e/os-volume_attachments/db7e5b64-a01d-427a-80bf-76e6db958858" status: 202 len: 0 microversion: 2.1 time: 0.190009 Oct 04 19:48:07.636404 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3973/7573] 10.222.0.43 () {58 vars in 1416 bytes} [Tue Oct 4 19:48:07 2022] DELETE /compute/v2.1/servers/281c6d18-599b-4d33-b063-f7ec58a8c96e/os-volume_attachments/db7e5b64-a01d-427a-80bf-76e6db958858 => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:48:07.647574 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-6e865eb8-8204-49d8-8ea3-8699aef130b2 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:48:07.650471 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-6e865eb8-8204-49d8-8ea3-8699aef130b2 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] [instance: 281c6d18-599b-4d33-b063-f7ec58a8c96e] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:48:07.665812 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6e865eb8-8204-49d8-8ea3-8699aef130b2 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:48:07.666689 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6e865eb8-8204-49d8-8ea3-8699aef130b2 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:48:07.667318 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6e865eb8-8204-49d8-8ea3-8699aef130b2 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:48:07.668721 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6e865eb8-8204-49d8-8ea3-8699aef130b2 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:48:07.669373 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6e865eb8-8204-49d8-8ea3-8699aef130b2 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:48:07.669999 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6e865eb8-8204-49d8-8ea3-8699aef130b2 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:48:07.704472 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-6e865eb8-8204-49d8-8ea3-8699aef130b2 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] 10.222.0.43 "GET /compute/v2.1/servers/281c6d18-599b-4d33-b063-f7ec58a8c96e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061136 Oct 04 19:48:07.710010 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3601/7574] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Oct 4 19:48:07 2022] GET /compute/v2.1/servers/281c6d18-599b-4d33-b063-f7ec58a8c96e/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:48:07.815600 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-d067cbf6-577f-4d07-8cb8-1f6fd0a56826 req-bda0039f-b549-485d-b47e-d43e251cf074 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "281c6d18-599b-4d33-b063-f7ec58a8c96e", "tag": "a3d25985-26c5-4df1-b10d-8e522ad02e46"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:48:07.825687 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-d067cbf6-577f-4d07-8cb8-1f6fd0a56826 req-bda0039f-b549-485d-b47e-d43e251cf074 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:48:07.826242 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-d067cbf6-577f-4d07-8cb8-1f6fd0a56826 req-bda0039f-b549-485d-b47e-d43e251cf074 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:48:07.826797 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-d067cbf6-577f-4d07-8cb8-1f6fd0a56826 req-bda0039f-b549-485d-b47e-d43e251cf074 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:48:07.839545 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-d067cbf6-577f-4d07-8cb8-1f6fd0a56826 req-bda0039f-b549-485d-b47e-d43e251cf074 service nova] Creating event network-changed:a3d25985-26c5-4df1-b10d-8e522ad02e46 for instance 281c6d18-599b-4d33-b063-f7ec58a8c96e on n-h2-851028-13 Oct 04 19:48:07.844704 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-d067cbf6-577f-4d07-8cb8-1f6fd0a56826 req-bda0039f-b549-485d-b47e-d43e251cf074 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033377 Oct 04 19:48:07.845652 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3974/7575] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:48:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:48:08.717526 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-23482a49-d8e3-440a-a1b4-70993583a24f tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:48:08.719679 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-23482a49-d8e3-440a-a1b4-70993583a24f tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] [instance: 281c6d18-599b-4d33-b063-f7ec58a8c96e] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:48:08.726527 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-23482a49-d8e3-440a-a1b4-70993583a24f tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:48:08.727014 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-23482a49-d8e3-440a-a1b4-70993583a24f tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:48:08.727457 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-23482a49-d8e3-440a-a1b4-70993583a24f tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:48:08.728155 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-23482a49-d8e3-440a-a1b4-70993583a24f tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:48:08.728618 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-23482a49-d8e3-440a-a1b4-70993583a24f tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:48:08.729072 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-23482a49-d8e3-440a-a1b4-70993583a24f tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:48:08.758956 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-23482a49-d8e3-440a-a1b4-70993583a24f tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] 10.222.0.43 "GET /compute/v2.1/servers/281c6d18-599b-4d33-b063-f7ec58a8c96e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045573 Oct 04 19:48:08.759530 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3602/7576] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Oct 4 19:48:08 2022] GET /compute/v2.1/servers/281c6d18-599b-4d33-b063-f7ec58a8c96e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:48:09.772951 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-eea14bc6-de85-4ac8-89c8-aa67dd8f9090 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:48:09.775399 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-eea14bc6-de85-4ac8-89c8-aa67dd8f9090 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] [instance: 281c6d18-599b-4d33-b063-f7ec58a8c96e] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:48:09.781718 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-eea14bc6-de85-4ac8-89c8-aa67dd8f9090 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:48:09.782221 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-eea14bc6-de85-4ac8-89c8-aa67dd8f9090 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:48:09.782678 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-eea14bc6-de85-4ac8-89c8-aa67dd8f9090 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:48:09.783393 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-eea14bc6-de85-4ac8-89c8-aa67dd8f9090 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:48:09.783893 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-eea14bc6-de85-4ac8-89c8-aa67dd8f9090 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:48:09.784340 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-eea14bc6-de85-4ac8-89c8-aa67dd8f9090 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:48:09.814109 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-eea14bc6-de85-4ac8-89c8-aa67dd8f9090 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] 10.222.0.43 "GET /compute/v2.1/servers/281c6d18-599b-4d33-b063-f7ec58a8c96e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046367 Oct 04 19:48:09.814673 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3975/7577] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Oct 4 19:48:09 2022] GET /compute/v2.1/servers/281c6d18-599b-4d33-b063-f7ec58a8c96e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:48:10.827169 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-9a678726-3f98-4363-9c48-53774160f213 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:48:10.829692 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-9a678726-3f98-4363-9c48-53774160f213 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] [instance: 281c6d18-599b-4d33-b063-f7ec58a8c96e] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:48:10.836526 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9a678726-3f98-4363-9c48-53774160f213 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:48:10.837018 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9a678726-3f98-4363-9c48-53774160f213 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:48:10.837512 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9a678726-3f98-4363-9c48-53774160f213 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:48:10.838225 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9a678726-3f98-4363-9c48-53774160f213 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:48:10.838688 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9a678726-3f98-4363-9c48-53774160f213 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:48:10.839124 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9a678726-3f98-4363-9c48-53774160f213 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:48:10.869226 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-9a678726-3f98-4363-9c48-53774160f213 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] 10.222.0.43 "GET /compute/v2.1/servers/281c6d18-599b-4d33-b063-f7ec58a8c96e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046529 Oct 04 19:48:10.869803 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3603/7578] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Oct 4 19:48:10 2022] GET /compute/v2.1/servers/281c6d18-599b-4d33-b063-f7ec58a8c96e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:48:11.881856 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-0f3c4604-5436-4afe-872d-fe14c95ff341 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:48:11.884212 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-0f3c4604-5436-4afe-872d-fe14c95ff341 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] [instance: 281c6d18-599b-4d33-b063-f7ec58a8c96e] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:48:11.891980 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0f3c4604-5436-4afe-872d-fe14c95ff341 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:48:11.892485 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0f3c4604-5436-4afe-872d-fe14c95ff341 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:48:11.892948 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0f3c4604-5436-4afe-872d-fe14c95ff341 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:48:11.893699 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0f3c4604-5436-4afe-872d-fe14c95ff341 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:48:11.894171 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0f3c4604-5436-4afe-872d-fe14c95ff341 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:48:11.894619 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0f3c4604-5436-4afe-872d-fe14c95ff341 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:48:11.926766 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-0f3c4604-5436-4afe-872d-fe14c95ff341 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] 10.222.0.43 "GET /compute/v2.1/servers/281c6d18-599b-4d33-b063-f7ec58a8c96e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048990 Oct 04 19:48:11.927347 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3976/7579] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Oct 4 19:48:11 2022] GET /compute/v2.1/servers/281c6d18-599b-4d33-b063-f7ec58a8c96e/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:48:12.939407 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-bbfed06d-5015-4eb6-85fe-f31b46af64eb tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:48:12.941672 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-bbfed06d-5015-4eb6-85fe-f31b46af64eb tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] [instance: 281c6d18-599b-4d33-b063-f7ec58a8c96e] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:48:12.943913 n-d-851028-13 devstack@n-api.service[123595]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 19:48:12.944050 n-d-851028-13 devstack@n-api.service[123595]: Tue Oct 4 19:48:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/281c6d18-599b-4d33-b063-f7ec58a8c96e/os-volume_attachments (ip 10.222.0.43) !!! Oct 04 19:48:12.956713 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bbfed06d-5015-4eb6-85fe-f31b46af64eb tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:48:12.957241 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bbfed06d-5015-4eb6-85fe-f31b46af64eb tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:48:12.957690 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bbfed06d-5015-4eb6-85fe-f31b46af64eb tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:48:12.958393 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bbfed06d-5015-4eb6-85fe-f31b46af64eb tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:48:12.958854 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bbfed06d-5015-4eb6-85fe-f31b46af64eb tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:48:12.959314 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bbfed06d-5015-4eb6-85fe-f31b46af64eb tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:48:12.987683 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-bbfed06d-5015-4eb6-85fe-f31b46af64eb tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] 10.222.0.43 "GET /compute/v2.1/servers/281c6d18-599b-4d33-b063-f7ec58a8c96e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052369 Oct 04 19:48:12.988252 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3604/7580] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Oct 4 19:48:12 2022] GET /compute/v2.1/servers/281c6d18-599b-4d33-b063-f7ec58a8c96e/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 19:48:12.999482 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f4e21c04-cf88-4175-a5ef-7d57d1b6dda5 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:48:13.000000 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-f4e21c04-cf88-4175-a5ef-7d57d1b6dda5 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] [instance: 281c6d18-599b-4d33-b063-f7ec58a8c96e] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:48:13.006984 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f4e21c04-cf88-4175-a5ef-7d57d1b6dda5 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:48:13.007492 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f4e21c04-cf88-4175-a5ef-7d57d1b6dda5 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:48:13.007952 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f4e21c04-cf88-4175-a5ef-7d57d1b6dda5 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:48:13.008663 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f4e21c04-cf88-4175-a5ef-7d57d1b6dda5 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:48:13.009164 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f4e21c04-cf88-4175-a5ef-7d57d1b6dda5 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:48:13.009619 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f4e21c04-cf88-4175-a5ef-7d57d1b6dda5 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:48:13.085101 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-f4e21c04-cf88-4175-a5ef-7d57d1b6dda5 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] HTTP exception thrown: Instance 281c6d18-599b-4d33-b063-f7ec58a8c96e is not attached to volume db7e5b64-a01d-427a-80bf-76e6db958858 Oct 04 19:48:13.086792 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f4e21c04-cf88-4175-a5ef-7d57d1b6dda5 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Request method failure captured: Oct 04 19:48:13.086792 n-d-851028-13 devstack@n-api.service[123596]: request: DELETE /compute/v2.1/servers/281c6d18-599b-4d33-b063-f7ec58a8c96e/os-volume_attachments/db7e5b64-a01d-427a-80bf-76e6db958858 HTTP/1.1 Oct 04 19:48:13.086792 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 19:48:13.086792 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 19:48:13.086792 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 19:48:13.086792 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 19:48:13.086792 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 19:48:13.086792 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 19:48:13.086792 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 19:48:13.086792 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 19:48:13.086792 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPIyaCPvrnZazHA-AWDBU5_jXTAlfBKg7tT3IVCiPxGZL16OPph0IoTzPSzzCCTjeJwv3pldgme8PXUI6GzUJh4r7N6MW6EJ34R_QZjbt6Tq2p403PfNs9jDNQ8aDqpsbBj6q6ytREF3X9HZEwcjWvIIq7bb1zbwajlY0-x-6OZLmQsI Oct 04 19:48:13.086792 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 19:48:13.086792 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 19:48:13.086792 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 19:48:13.086792 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 19:48:13.086792 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 19:48:13.086792 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 19:48:13.086792 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: 5a9d9c6a533a41a592780f78c4ac7eaa Oct 04 19:48:13.086792 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-TestMinimumBasicScenario-1367511627 Oct 04 19:48:13.086792 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 19:48:13.086792 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 19:48:13.086792 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/5a9d9c6a533a41a592780f78c4ac7eaa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_5a9d9c6a533a41a592780f78c4ac7eaa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5a9d9c6a533a41a592780f78c4ac7eaa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5a9d9c6a533a41a592780f78c4ac7eaa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 19:48:13.086792 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-TestMinimumBasicScenario-1367511627 Oct 04 19:48:13.086792 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: 5a9d9c6a533a41a592780f78c4ac7eaa Oct 04 19:48:13.086792 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1367511627 Oct 04 19:48:13.086792 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-TestMinimumBasicScenario-1367511627-project Oct 04 19:48:13.086792 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 19:48:13.086792 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 19:48:13.086792 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 5daff488843949a7835ee0766d898dec Oct 04 19:48:13.086792 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-TestMinimumBasicScenario-1367511627-project Oct 04 19:48:13.086792 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 19:48:13.086792 n-d-851028-13 devstack@n-api.service[123596]: exception: Instance 281c6d18-599b-4d33-b063-f7ec58a8c96e is not attached to volume db7e5b64-a01d-427a-80bf-76e6db958858 Oct 04 19:48:13.086792 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'server_id': '281c6d18-599b-4d33-b063-f7ec58a8c96e', 'id': 'db7e5b64-a01d-427a-80bf-76e6db958858'} Oct 04 19:48:13.086792 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:48:13.086792 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:48:13.086792 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 04 19:48:13.086792 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 04 19:48:13.086792 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 19:48:13.086792 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 19:48:13.086792 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 04 19:48:13.086792 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 04 19:48:13.086792 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id db7e5b64-a01d-427a-80bf-76e6db958858. Oct 04 19:48:13.086792 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:48:13.086792 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:48:13.086792 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:48:13.086792 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:48:13.086792 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:48:13.086792 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:48:13.086792 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:48:13.086792 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:48:13.086792 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:48:13.086792 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:48:13.086792 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 04 19:48:13.086792 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 04 19:48:13.086792 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 281c6d18-599b-4d33-b063-f7ec58a8c96e is not attached to volume db7e5b64-a01d-427a-80bf-76e6db958858 Oct 04 19:48:13.086792 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:48:13.086792 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:48:13.086792 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:48:13.086792 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:48:13.086792 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:48:13.086792 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:48:13.091710 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:48:13.091710 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:48:13.091710 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 281c6d18-599b-4d33-b063-f7ec58a8c96e is not attached to volume db7e5b64-a01d-427a-80bf-76e6db958858 Oct 04 19:48:13.091710 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:48:13.091710 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f4e21c04-cf88-4175-a5ef-7d57d1b6dda5 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Returning 404 to user: Instance 281c6d18-599b-4d33-b063-f7ec58a8c96e is not attached to volume db7e5b64-a01d-427a-80bf-76e6db958858 {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:48:13.091710 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-f4e21c04-cf88-4175-a5ef-7d57d1b6dda5 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] 10.222.0.43 "DELETE /compute/v2.1/servers/281c6d18-599b-4d33-b063-f7ec58a8c96e/os-volume_attachments/db7e5b64-a01d-427a-80bf-76e6db958858" status: 404 len: 154 microversion: 2.1 time: 0.093343 Oct 04 19:48:13.091710 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3977/7581] 10.222.0.43 () {58 vars in 1416 bytes} [Tue Oct 4 19:48:12 2022] DELETE /compute/v2.1/servers/281c6d18-599b-4d33-b063-f7ec58a8c96e/os-volume_attachments/db7e5b64-a01d-427a-80bf-76e6db958858 => generated 154 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:48:16.339589 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-02cc3936-d6ae-4cd8-a09f-e9e66018f201 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:48:16.340720 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-02cc3936-d6ae-4cd8-a09f-e9e66018f201 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] [instance: 281c6d18-599b-4d33-b063-f7ec58a8c96e] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:48:16.347803 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-02cc3936-d6ae-4cd8-a09f-e9e66018f201 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:48:16.348297 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-02cc3936-d6ae-4cd8-a09f-e9e66018f201 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:48:16.348744 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-02cc3936-d6ae-4cd8-a09f-e9e66018f201 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:48:16.349482 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-02cc3936-d6ae-4cd8-a09f-e9e66018f201 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:48:16.349945 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-02cc3936-d6ae-4cd8-a09f-e9e66018f201 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:48:16.350386 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-02cc3936-d6ae-4cd8-a09f-e9e66018f201 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:48:16.377397 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-02cc3936-d6ae-4cd8-a09f-e9e66018f201 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] [instance: 281c6d18-599b-4d33-b063-f7ec58a8c96e] Going to try to terminate instance {{(pid=123595) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 19:48:16.458934 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-02cc3936-d6ae-4cd8-a09f-e9e66018f201 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] 10.222.0.43 "DELETE /compute/v2.1/servers/281c6d18-599b-4d33-b063-f7ec58a8c96e" status: 204 len: 0 microversion: 2.1 time: 0.123052 Oct 04 19:48:16.460493 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3605/7582] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 19:48:16 2022] DELETE /compute/v2.1/servers/281c6d18-599b-4d33-b063-f7ec58a8c96e => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:48:16.468022 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-0c8ee4ce-ac1b-49be-9102-943b5f203283 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:48:16.468651 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-0c8ee4ce-ac1b-49be-9102-943b5f203283 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] [instance: 281c6d18-599b-4d33-b063-f7ec58a8c96e] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:48:16.477674 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0c8ee4ce-ac1b-49be-9102-943b5f203283 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:48:16.478276 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0c8ee4ce-ac1b-49be-9102-943b5f203283 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:48:16.478877 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0c8ee4ce-ac1b-49be-9102-943b5f203283 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:48:16.479601 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0c8ee4ce-ac1b-49be-9102-943b5f203283 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:48:16.480077 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0c8ee4ce-ac1b-49be-9102-943b5f203283 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:48:16.480535 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0c8ee4ce-ac1b-49be-9102-943b5f203283 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:48:16.615653 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-0c8ee4ce-ac1b-49be-9102-943b5f203283 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5daff488843949a7835ee0766d898dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9d9c6a533a41a592780f78c4ac7eaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:48:16.624169 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-0c8ee4ce-ac1b-49be-9102-943b5f203283 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] 10.222.0.43 "GET /compute/v2.1/servers/281c6d18-599b-4d33-b063-f7ec58a8c96e" status: 200 len: 1552 microversion: 2.1 time: 0.160123 Oct 04 19:48:16.624742 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3978/7583] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:48:16 2022] GET /compute/v2.1/servers/281c6d18-599b-4d33-b063-f7ec58a8c96e => generated 1552 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:48:17.648455 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-ad586391-20c6-4d89-9432-2532229f0d59 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:48:17.649185 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-ad586391-20c6-4d89-9432-2532229f0d59 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] [instance: 281c6d18-599b-4d33-b063-f7ec58a8c96e] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:48:17.656522 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ad586391-20c6-4d89-9432-2532229f0d59 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:48:17.657002 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ad586391-20c6-4d89-9432-2532229f0d59 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:48:17.657532 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ad586391-20c6-4d89-9432-2532229f0d59 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:48:17.658219 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ad586391-20c6-4d89-9432-2532229f0d59 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:48:17.658673 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ad586391-20c6-4d89-9432-2532229f0d59 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:48:17.659099 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ad586391-20c6-4d89-9432-2532229f0d59 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:48:17.789436 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-ad586391-20c6-4d89-9432-2532229f0d59 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5daff488843949a7835ee0766d898dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9d9c6a533a41a592780f78c4ac7eaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:48:17.797239 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-ad586391-20c6-4d89-9432-2532229f0d59 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] 10.222.0.43 "GET /compute/v2.1/servers/281c6d18-599b-4d33-b063-f7ec58a8c96e" status: 200 len: 1552 microversion: 2.1 time: 0.153040 Oct 04 19:48:17.797844 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3606/7584] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:48:17 2022] GET /compute/v2.1/servers/281c6d18-599b-4d33-b063-f7ec58a8c96e => generated 1552 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:48:18.523304 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-c096dfef-03b4-4f7f-aff8-ba9eb0743cfc req-271e24fc-4643-4364-9a18-8521f2c78595 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "281c6d18-599b-4d33-b063-f7ec58a8c96e", "name": "network-vif-deleted", "tag": "a3d25985-26c5-4df1-b10d-8e522ad02e46"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:48:18.533914 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-c096dfef-03b4-4f7f-aff8-ba9eb0743cfc req-271e24fc-4643-4364-9a18-8521f2c78595 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:48:18.534442 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-c096dfef-03b4-4f7f-aff8-ba9eb0743cfc req-271e24fc-4643-4364-9a18-8521f2c78595 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:48:18.534888 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-c096dfef-03b4-4f7f-aff8-ba9eb0743cfc req-271e24fc-4643-4364-9a18-8521f2c78595 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:48:18.547379 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-c096dfef-03b4-4f7f-aff8-ba9eb0743cfc req-271e24fc-4643-4364-9a18-8521f2c78595 service nova] Creating event network-vif-deleted:a3d25985-26c5-4df1-b10d-8e522ad02e46 for instance 281c6d18-599b-4d33-b063-f7ec58a8c96e on n-h2-851028-13 Oct 04 19:48:18.552327 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-c096dfef-03b4-4f7f-aff8-ba9eb0743cfc req-271e24fc-4643-4364-9a18-8521f2c78595 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032894 Oct 04 19:48:18.552928 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3979/7585] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:48:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:48:18.820307 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-cfd143be-6451-4051-a44b-172eca85a7ec tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:48:18.821077 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-cfd143be-6451-4051-a44b-172eca85a7ec tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] [instance: 281c6d18-599b-4d33-b063-f7ec58a8c96e] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:48:18.828508 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cfd143be-6451-4051-a44b-172eca85a7ec tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:48:18.829001 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cfd143be-6451-4051-a44b-172eca85a7ec tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:48:18.829461 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cfd143be-6451-4051-a44b-172eca85a7ec tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:48:18.830176 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cfd143be-6451-4051-a44b-172eca85a7ec tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:48:18.830662 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cfd143be-6451-4051-a44b-172eca85a7ec tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:48:18.831127 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cfd143be-6451-4051-a44b-172eca85a7ec tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:48:18.864603 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cfd143be-6451-4051-a44b-172eca85a7ec tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:48:18.865098 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cfd143be-6451-4051-a44b-172eca85a7ec tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:48:18.865579 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cfd143be-6451-4051-a44b-172eca85a7ec tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:48:18.866039 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.objects.instance [None req-cfd143be-6451-4051-a44b-172eca85a7ec tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lazy-loading 'fault' on Instance uuid 281c6d18-599b-4d33-b063-f7ec58a8c96e {{(pid=123595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 19:48:18.908268 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-cfd143be-6451-4051-a44b-172eca85a7ec tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5daff488843949a7835ee0766d898dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9d9c6a533a41a592780f78c4ac7eaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:48:18.916410 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-cfd143be-6451-4051-a44b-172eca85a7ec tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] 10.222.0.43 "GET /compute/v2.1/servers/281c6d18-599b-4d33-b063-f7ec58a8c96e" status: 200 len: 1346 microversion: 2.1 time: 0.100137 Oct 04 19:48:18.917387 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3607/7586] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:48:18 2022] GET /compute/v2.1/servers/281c6d18-599b-4d33-b063-f7ec58a8c96e => generated 1346 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:48:19.943692 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-c21c0050-8c74-48aa-8328-91fe7dc56055 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:48:19.944326 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-c21c0050-8c74-48aa-8328-91fe7dc56055 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] [instance: 281c6d18-599b-4d33-b063-f7ec58a8c96e] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:48:19.951135 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c21c0050-8c74-48aa-8328-91fe7dc56055 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:48:19.951640 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c21c0050-8c74-48aa-8328-91fe7dc56055 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:48:19.952100 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c21c0050-8c74-48aa-8328-91fe7dc56055 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:48:19.952816 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c21c0050-8c74-48aa-8328-91fe7dc56055 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:48:19.953587 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c21c0050-8c74-48aa-8328-91fe7dc56055 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:48:19.954039 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c21c0050-8c74-48aa-8328-91fe7dc56055 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:48:19.967860 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-c21c0050-8c74-48aa-8328-91fe7dc56055 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] HTTP exception thrown: Instance 281c6d18-599b-4d33-b063-f7ec58a8c96e could not be found. Oct 04 19:48:19.969554 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-c21c0050-8c74-48aa-8328-91fe7dc56055 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Request method failure captured: Oct 04 19:48:19.969554 n-d-851028-13 devstack@n-api.service[123596]: request: GET /compute/v2.1/servers/281c6d18-599b-4d33-b063-f7ec58a8c96e HTTP/1.1 Oct 04 19:48:19.969554 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 19:48:19.969554 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 19:48:19.969554 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 19:48:19.969554 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 19:48:19.969554 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 19:48:19.969554 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 19:48:19.969554 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 19:48:19.969554 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 19:48:19.969554 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPIyaCPvrnZazHA-AWDBU5_jXTAlfBKg7tT3IVCiPxGZL16OPph0IoTzPSzzCCTjeJwv3pldgme8PXUI6GzUJh4r7N6MW6EJ34R_QZjbt6Tq2p403PfNs9jDNQ8aDqpsbBj6q6ytREF3X9HZEwcjWvIIq7bb1zbwajlY0-x-6OZLmQsI Oct 04 19:48:19.969554 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 19:48:19.969554 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 19:48:19.969554 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 19:48:19.969554 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 19:48:19.969554 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 19:48:19.969554 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 19:48:19.969554 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: 5a9d9c6a533a41a592780f78c4ac7eaa Oct 04 19:48:19.969554 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-TestMinimumBasicScenario-1367511627 Oct 04 19:48:19.969554 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 19:48:19.969554 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 19:48:19.969554 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/5a9d9c6a533a41a592780f78c4ac7eaa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_5a9d9c6a533a41a592780f78c4ac7eaa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5a9d9c6a533a41a592780f78c4ac7eaa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5a9d9c6a533a41a592780f78c4ac7eaa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 19:48:19.969554 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-TestMinimumBasicScenario-1367511627 Oct 04 19:48:19.969554 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: 5a9d9c6a533a41a592780f78c4ac7eaa Oct 04 19:48:19.969554 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1367511627 Oct 04 19:48:19.969554 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-TestMinimumBasicScenario-1367511627-project Oct 04 19:48:19.969554 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 19:48:19.969554 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 19:48:19.969554 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 5daff488843949a7835ee0766d898dec Oct 04 19:48:19.969554 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-TestMinimumBasicScenario-1367511627-project Oct 04 19:48:19.969554 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 19:48:19.969554 n-d-851028-13 devstack@n-api.service[123596]: exception: Instance 281c6d18-599b-4d33-b063-f7ec58a8c96e could not be found. Oct 04 19:48:19.969554 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': '281c6d18-599b-4d33-b063-f7ec58a8c96e'} Oct 04 19:48:19.969554 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:48:19.969554 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:48:19.969554 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:48:19.969554 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:48:19.969554 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:48:19.969554 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:48:19.969554 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:48:19.969554 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:48:19.969554 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:48:19.969554 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:48:19.969554 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 281c6d18-599b-4d33-b063-f7ec58a8c96e could not be found. Oct 04 19:48:19.969554 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:48:19.969554 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:48:19.969554 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:48:19.969554 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:48:19.969554 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:48:19.969554 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:48:19.969554 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:48:19.969554 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:48:19.969554 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:48:19.969554 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:48:19.969554 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:48:19.969554 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:48:19.969554 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:48:19.969554 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:48:19.969554 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:48:19.969554 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:48:19.969554 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 281c6d18-599b-4d33-b063-f7ec58a8c96e could not be found. Oct 04 19:48:19.969554 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:48:19.969554 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:48:19.969554 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:48:19.974451 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:48:19.974451 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:48:19.974451 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:48:19.974451 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:48:19.974451 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:48:19.974451 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 281c6d18-599b-4d33-b063-f7ec58a8c96e could not be found. Oct 04 19:48:19.974451 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:48:19.974451 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-c21c0050-8c74-48aa-8328-91fe7dc56055 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Returning 404 to user: Instance 281c6d18-599b-4d33-b063-f7ec58a8c96e could not be found. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:48:19.974451 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-c21c0050-8c74-48aa-8328-91fe7dc56055 tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] 10.222.0.43 "GET /compute/v2.1/servers/281c6d18-599b-4d33-b063-f7ec58a8c96e" status: 404 len: 111 microversion: 2.1 time: 0.032586 Oct 04 19:48:19.974451 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3980/7587] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:48:19 2022] GET /compute/v2.1/servers/281c6d18-599b-4d33-b063-f7ec58a8c96e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:48:19.979970 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-059cb2a2-c7a6-4a62-be4b-c5b6c40862bd tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] Calling method '.version_select at 0x7fb21ff624c0>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:48:20.000340 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-059cb2a2-c7a6-4a62-be4b-c5b6c40862bd tempest-TestMinimumBasicScenario-1367511627 tempest-TestMinimumBasicScenario-1367511627-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-459806083" status: 202 len: 0 microversion: 2.1 time: 0.024269 Oct 04 19:48:20.000924 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3608/7588] 10.222.0.43 () {58 vars in 1269 bytes} [Tue Oct 4 19:48:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-459806083 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 19:48:28.999732 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-80550dfd-fe54-4ad9-acc0-2fd15469981d tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Action: 'create', calling method: .version_select at 0x7fb21ea78f70>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1233752895", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAljTb6unHrRz3NPcsQYx1YB0Vf0swb2TkfDZKrvHIRsI3IgjxJymvH3JtcTs3+gIU2E/lQqIG0XmSS/I6aFeAcILA9swkXPFbekQ8YFCMUNt/jIj/hbDVMEURabViWpOw=="}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:48:29.018913 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-80550dfd-fe54-4ad9-acc0-2fd15469981d tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Getting quotas for project bc8cddf77e654ca7a88b55acca131a45. Resources: {'key_pairs'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:48:29.024359 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-80550dfd-fe54-4ad9-acc0-2fd15469981d tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Getting quotas for user 6c616f37f7714bdaaba2ae66226f37d8 and project bc8cddf77e654ca7a88b55acca131a45. Resources: {'key_pairs'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:48:29.050028 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-80550dfd-fe54-4ad9-acc0-2fd15469981d tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.211848 Oct 04 19:48:29.050647 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3981/7589] 10.222.0.43 () {60 vars in 1159 bytes} [Tue Oct 4 19:48:28 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:48:34.697437 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:48:34.698594 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:48:34.703963 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-70d06404-6d4e-4cc3-bad6-935c065878f9 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1855789933", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452", "networks": [{"uuid": "5149b584-eea7-4e28-8bb1-a020b217b0c8"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1233752895", "security_groups": [{"name": "tempest-secgroup-smoke-2104945902"}]}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:48:34.825605 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.network.neutron [None req-70d06404-6d4e-4cc3-bad6-935c065878f9 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] validate_networks() for [('5149b584-eea7-4e28-8bb1-a020b217b0c8', None, None, None, None, None)] {{(pid=123595) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 19:48:35.281176 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-70d06404-6d4e-4cc3-bad6-935c065878f9 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Flavor limits 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:48:35.281615 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-70d06404-6d4e-4cc3-bad6-935c065878f9 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Image limits 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:48:35.282130 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-70d06404-6d4e-4cc3-bad6-935c065878f9 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Flavor pref 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:48:35.282550 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-70d06404-6d4e-4cc3-bad6-935c065878f9 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Image pref 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:48:35.282971 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-70d06404-6d4e-4cc3-bad6-935c065878f9 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:48:35.291773 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-70d06404-6d4e-4cc3-bad6-935c065878f9 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:48:35.292264 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-70d06404-6d4e-4cc3-bad6-935c065878f9 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:48:35.292769 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-70d06404-6d4e-4cc3-bad6-935c065878f9 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:48:35.294041 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-70d06404-6d4e-4cc3-bad6-935c065878f9 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:48:35.294503 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-70d06404-6d4e-4cc3-bad6-935c065878f9 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:48:35.294937 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-70d06404-6d4e-4cc3-bad6-935c065878f9 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:48:35.312576 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-70d06404-6d4e-4cc3-bad6-935c065878f9 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Getting quotas for project bc8cddf77e654ca7a88b55acca131a45. Resources: {'ram', 'cores', 'instances'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:48:35.317999 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-70d06404-6d4e-4cc3-bad6-935c065878f9 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Getting quotas for user 6c616f37f7714bdaaba2ae66226f37d8 and project bc8cddf77e654ca7a88b55acca131a45. Resources: {'ram', 'cores', 'instances'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:48:35.330657 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-70d06404-6d4e-4cc3-bad6-935c065878f9 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Going to run 1 instances... {{(pid=123595) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 19:48:35.333033 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-70d06404-6d4e-4cc3-bad6-935c065878f9 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] [instance: 0cfacb1d-f8ae-4594-916e-0e9a1f38a29c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e8943ec5-4038-4d4b-b9b9-2415a79f5243',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 19:48:35.381219 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-70d06404-6d4e-4cc3-bad6-935c065878f9 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.685484 Oct 04 19:48:35.382897 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3609/7590] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 19:48:34 2022] POST /compute/v2.1/servers => generated 406 bytes in 688 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 19:48:35.392226 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=43,nova_cell1:INSERT=1 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:48:35.396288 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-95414601-5e0d-497b-9d29-1836ac9f21e2 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:48:35.397158 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-95414601-5e0d-497b-9d29-1836ac9f21e2 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] [instance: 0cfacb1d-f8ae-4594-916e-0e9a1f38a29c] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:48:35.402717 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=1 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:48:35.466788 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-95414601-5e0d-497b-9d29-1836ac9f21e2 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c616f37f7714bdaaba2ae66226f37d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8cddf77e654ca7a88b55acca131a45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:48:35.475655 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-95414601-5e0d-497b-9d29-1836ac9f21e2 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] 10.222.0.43 "GET /compute/v2.1/servers/0cfacb1d-f8ae-4594-916e-0e9a1f38a29c" status: 200 len: 1267 microversion: 2.1 time: 0.084934 Oct 04 19:48:35.476593 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3982/7591] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:48:35 2022] GET /compute/v2.1/servers/0cfacb1d-f8ae-4594-916e-0e9a1f38a29c => generated 1267 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:48:36.501541 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-c04ed0c8-edfc-4558-a71b-5744086ee9c2 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:48:36.502270 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-c04ed0c8-edfc-4558-a71b-5744086ee9c2 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] [instance: 0cfacb1d-f8ae-4594-916e-0e9a1f38a29c] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:48:36.510231 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c04ed0c8-edfc-4558-a71b-5744086ee9c2 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:48:36.510822 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c04ed0c8-edfc-4558-a71b-5744086ee9c2 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:48:36.511345 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c04ed0c8-edfc-4558-a71b-5744086ee9c2 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:48:36.512148 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c04ed0c8-edfc-4558-a71b-5744086ee9c2 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:48:36.512680 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c04ed0c8-edfc-4558-a71b-5744086ee9c2 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:48:36.513367 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c04ed0c8-edfc-4558-a71b-5744086ee9c2 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:48:36.579997 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-c04ed0c8-edfc-4558-a71b-5744086ee9c2 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c616f37f7714bdaaba2ae66226f37d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8cddf77e654ca7a88b55acca131a45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:48:36.593831 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-c04ed0c8-edfc-4558-a71b-5744086ee9c2 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] 10.222.0.43 "GET /compute/v2.1/servers/0cfacb1d-f8ae-4594-916e-0e9a1f38a29c" status: 200 len: 1319 microversion: 2.1 time: 0.097613 Oct 04 19:48:36.594466 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3610/7592] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:48:36 2022] GET /compute/v2.1/servers/0cfacb1d-f8ae-4594-916e-0e9a1f38a29c => generated 1319 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:48:37.619382 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-34fe23d0-8ce4-48a1-addb-b6fe0d9b69fa tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:48:37.620040 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-34fe23d0-8ce4-48a1-addb-b6fe0d9b69fa tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] [instance: 0cfacb1d-f8ae-4594-916e-0e9a1f38a29c] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:48:37.627719 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-34fe23d0-8ce4-48a1-addb-b6fe0d9b69fa tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:48:37.628221 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-34fe23d0-8ce4-48a1-addb-b6fe0d9b69fa tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:48:37.628676 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-34fe23d0-8ce4-48a1-addb-b6fe0d9b69fa tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:48:37.629493 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-34fe23d0-8ce4-48a1-addb-b6fe0d9b69fa tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:48:37.629962 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-34fe23d0-8ce4-48a1-addb-b6fe0d9b69fa tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:48:37.630403 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-34fe23d0-8ce4-48a1-addb-b6fe0d9b69fa tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:48:37.840596 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-34fe23d0-8ce4-48a1-addb-b6fe0d9b69fa tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c616f37f7714bdaaba2ae66226f37d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8cddf77e654ca7a88b55acca131a45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:48:37.852843 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-34fe23d0-8ce4-48a1-addb-b6fe0d9b69fa tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] 10.222.0.43 "GET /compute/v2.1/servers/0cfacb1d-f8ae-4594-916e-0e9a1f38a29c" status: 200 len: 1393 microversion: 2.1 time: 0.237189 Oct 04 19:48:37.853807 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3983/7593] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:48:37 2022] GET /compute/v2.1/servers/0cfacb1d-f8ae-4594-916e-0e9a1f38a29c => generated 1393 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:48:38.158049 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-aa21f9d3-03ab-4755-a3ff-717f23cbc694 req-06fa179d-b00c-43b0-abec-4e780432e9c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0cfacb1d-f8ae-4594-916e-0e9a1f38a29c", "tag": "f65b5808-7019-4a0c-8a31-91b36a2e66f8"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:48:38.169681 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-aa21f9d3-03ab-4755-a3ff-717f23cbc694 req-06fa179d-b00c-43b0-abec-4e780432e9c0 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:48:38.170290 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-aa21f9d3-03ab-4755-a3ff-717f23cbc694 req-06fa179d-b00c-43b0-abec-4e780432e9c0 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:48:38.170799 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-aa21f9d3-03ab-4755-a3ff-717f23cbc694 req-06fa179d-b00c-43b0-abec-4e780432e9c0 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:48:38.184415 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-aa21f9d3-03ab-4755-a3ff-717f23cbc694 req-06fa179d-b00c-43b0-abec-4e780432e9c0 service nova] Creating event network-changed:f65b5808-7019-4a0c-8a31-91b36a2e66f8 for instance 0cfacb1d-f8ae-4594-916e-0e9a1f38a29c on n-h1-851028-13 Oct 04 19:48:38.189368 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-aa21f9d3-03ab-4755-a3ff-717f23cbc694 req-06fa179d-b00c-43b0-abec-4e780432e9c0 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035474 Oct 04 19:48:38.189981 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3611/7594] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:48:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:48:38.880461 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-580312b3-8574-4e59-9581-59ca069c0a49 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:48:38.880992 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-580312b3-8574-4e59-9581-59ca069c0a49 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] [instance: 0cfacb1d-f8ae-4594-916e-0e9a1f38a29c] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:48:38.888450 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-580312b3-8574-4e59-9581-59ca069c0a49 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:48:38.888958 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-580312b3-8574-4e59-9581-59ca069c0a49 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:48:38.889454 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-580312b3-8574-4e59-9581-59ca069c0a49 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:48:38.890166 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-580312b3-8574-4e59-9581-59ca069c0a49 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:48:38.890640 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-580312b3-8574-4e59-9581-59ca069c0a49 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:48:38.891088 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-580312b3-8574-4e59-9581-59ca069c0a49 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:48:39.022884 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-580312b3-8574-4e59-9581-59ca069c0a49 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c616f37f7714bdaaba2ae66226f37d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8cddf77e654ca7a88b55acca131a45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:48:39.030887 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-580312b3-8574-4e59-9581-59ca069c0a49 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] 10.222.0.43 "GET /compute/v2.1/servers/0cfacb1d-f8ae-4594-916e-0e9a1f38a29c" status: 200 len: 1393 microversion: 2.1 time: 0.154485 Oct 04 19:48:39.031460 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3984/7595] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:48:38 2022] GET /compute/v2.1/servers/0cfacb1d-f8ae-4594-916e-0e9a1f38a29c => generated 1393 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:48:40.054022 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-6deee86e-e34e-427b-9b7e-7d28bddb7794 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:48:40.056309 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-6deee86e-e34e-427b-9b7e-7d28bddb7794 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] [instance: 0cfacb1d-f8ae-4594-916e-0e9a1f38a29c] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:48:40.062989 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6deee86e-e34e-427b-9b7e-7d28bddb7794 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:48:40.063484 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6deee86e-e34e-427b-9b7e-7d28bddb7794 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:48:40.063934 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6deee86e-e34e-427b-9b7e-7d28bddb7794 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:48:40.064642 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6deee86e-e34e-427b-9b7e-7d28bddb7794 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:48:40.065136 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6deee86e-e34e-427b-9b7e-7d28bddb7794 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:48:40.065568 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6deee86e-e34e-427b-9b7e-7d28bddb7794 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:48:40.202452 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-6deee86e-e34e-427b-9b7e-7d28bddb7794 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c616f37f7714bdaaba2ae66226f37d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8cddf77e654ca7a88b55acca131a45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:48:40.210960 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-6deee86e-e34e-427b-9b7e-7d28bddb7794 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] 10.222.0.43 "GET /compute/v2.1/servers/0cfacb1d-f8ae-4594-916e-0e9a1f38a29c" status: 200 len: 1393 microversion: 2.1 time: 0.161979 Oct 04 19:48:40.211552 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3612/7596] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:48:40 2022] GET /compute/v2.1/servers/0cfacb1d-f8ae-4594-916e-0e9a1f38a29c => generated 1393 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:48:41.233858 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-a36486f0-05f0-48d8-9ea8-f0515453f133 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:48:41.234523 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-a36486f0-05f0-48d8-9ea8-f0515453f133 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] [instance: 0cfacb1d-f8ae-4594-916e-0e9a1f38a29c] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:48:41.241543 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a36486f0-05f0-48d8-9ea8-f0515453f133 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:48:41.242060 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a36486f0-05f0-48d8-9ea8-f0515453f133 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:48:41.242519 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a36486f0-05f0-48d8-9ea8-f0515453f133 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:48:41.243232 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a36486f0-05f0-48d8-9ea8-f0515453f133 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:48:41.243706 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a36486f0-05f0-48d8-9ea8-f0515453f133 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:48:41.244156 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a36486f0-05f0-48d8-9ea8-f0515453f133 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:48:41.373778 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-a36486f0-05f0-48d8-9ea8-f0515453f133 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c616f37f7714bdaaba2ae66226f37d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8cddf77e654ca7a88b55acca131a45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:48:41.381366 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-a36486f0-05f0-48d8-9ea8-f0515453f133 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] 10.222.0.43 "GET /compute/v2.1/servers/0cfacb1d-f8ae-4594-916e-0e9a1f38a29c" status: 200 len: 1393 microversion: 2.1 time: 0.151455 Oct 04 19:48:41.381947 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3985/7597] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:48:41 2022] GET /compute/v2.1/servers/0cfacb1d-f8ae-4594-916e-0e9a1f38a29c => generated 1393 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:48:42.403838 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-cffd345f-f2ce-415d-b7e8-8536895e9b43 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:48:42.404498 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-cffd345f-f2ce-415d-b7e8-8536895e9b43 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] [instance: 0cfacb1d-f8ae-4594-916e-0e9a1f38a29c] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:48:42.411600 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cffd345f-f2ce-415d-b7e8-8536895e9b43 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:48:42.412096 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cffd345f-f2ce-415d-b7e8-8536895e9b43 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:48:42.412543 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cffd345f-f2ce-415d-b7e8-8536895e9b43 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:48:42.413284 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cffd345f-f2ce-415d-b7e8-8536895e9b43 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:48:42.413753 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cffd345f-f2ce-415d-b7e8-8536895e9b43 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:48:42.414191 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cffd345f-f2ce-415d-b7e8-8536895e9b43 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:48:42.550668 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-cffd345f-f2ce-415d-b7e8-8536895e9b43 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c616f37f7714bdaaba2ae66226f37d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8cddf77e654ca7a88b55acca131a45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:48:42.558382 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-cffd345f-f2ce-415d-b7e8-8536895e9b43 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] 10.222.0.43 "GET /compute/v2.1/servers/0cfacb1d-f8ae-4594-916e-0e9a1f38a29c" status: 200 len: 1393 microversion: 2.1 time: 0.158463 Oct 04 19:48:42.559527 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3613/7598] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:48:42 2022] GET /compute/v2.1/servers/0cfacb1d-f8ae-4594-916e-0e9a1f38a29c => generated 1393 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:48:43.582129 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-ae847f26-dd62-4e59-bffb-995f20e5c179 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:48:43.582764 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-ae847f26-dd62-4e59-bffb-995f20e5c179 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] [instance: 0cfacb1d-f8ae-4594-916e-0e9a1f38a29c] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:48:43.590234 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ae847f26-dd62-4e59-bffb-995f20e5c179 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:48:43.590746 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ae847f26-dd62-4e59-bffb-995f20e5c179 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:48:43.591204 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ae847f26-dd62-4e59-bffb-995f20e5c179 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:48:43.591921 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ae847f26-dd62-4e59-bffb-995f20e5c179 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:48:43.592397 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ae847f26-dd62-4e59-bffb-995f20e5c179 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:48:43.592845 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ae847f26-dd62-4e59-bffb-995f20e5c179 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:48:43.727846 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-ae847f26-dd62-4e59-bffb-995f20e5c179 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c616f37f7714bdaaba2ae66226f37d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8cddf77e654ca7a88b55acca131a45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:48:43.736276 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-ae847f26-dd62-4e59-bffb-995f20e5c179 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] 10.222.0.43 "GET /compute/v2.1/servers/0cfacb1d-f8ae-4594-916e-0e9a1f38a29c" status: 200 len: 1393 microversion: 2.1 time: 0.158406 Oct 04 19:48:43.736854 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3986/7599] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:48:43 2022] GET /compute/v2.1/servers/0cfacb1d-f8ae-4594-916e-0e9a1f38a29c => generated 1393 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:48:44.087976 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-f4901241-07c0-4922-9e2e-999112343975 req-4f82fdf3-e081-4926-8cbd-e9c59a73ca9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0cfacb1d-f8ae-4594-916e-0e9a1f38a29c", "name": "network-vif-plugged", "status": "completed", "tag": "f65b5808-7019-4a0c-8a31-91b36a2e66f8"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:48:44.099435 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-f4901241-07c0-4922-9e2e-999112343975 req-4f82fdf3-e081-4926-8cbd-e9c59a73ca9f service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:48:44.099708 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-f4901241-07c0-4922-9e2e-999112343975 req-4f82fdf3-e081-4926-8cbd-e9c59a73ca9f service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:48:44.100345 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-f4901241-07c0-4922-9e2e-999112343975 req-4f82fdf3-e081-4926-8cbd-e9c59a73ca9f service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:48:44.112051 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-f4901241-07c0-4922-9e2e-999112343975 req-4f82fdf3-e081-4926-8cbd-e9c59a73ca9f service nova] Creating event network-vif-plugged:f65b5808-7019-4a0c-8a31-91b36a2e66f8 for instance 0cfacb1d-f8ae-4594-916e-0e9a1f38a29c on n-h1-851028-13 Oct 04 19:48:44.117217 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-f4901241-07c0-4922-9e2e-999112343975 req-4f82fdf3-e081-4926-8cbd-e9c59a73ca9f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033289 Oct 04 19:48:44.117931 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3614/7600] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:48:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:48:44.759525 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-a75c3dd7-20c6-48c4-8317-42446e599634 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:48:44.760156 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-a75c3dd7-20c6-48c4-8317-42446e599634 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] [instance: 0cfacb1d-f8ae-4594-916e-0e9a1f38a29c] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:48:44.767067 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a75c3dd7-20c6-48c4-8317-42446e599634 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:48:44.767569 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a75c3dd7-20c6-48c4-8317-42446e599634 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:48:44.768023 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a75c3dd7-20c6-48c4-8317-42446e599634 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:48:44.768726 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a75c3dd7-20c6-48c4-8317-42446e599634 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:48:44.769227 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a75c3dd7-20c6-48c4-8317-42446e599634 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:48:44.769675 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a75c3dd7-20c6-48c4-8317-42446e599634 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:48:44.901919 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-a75c3dd7-20c6-48c4-8317-42446e599634 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c616f37f7714bdaaba2ae66226f37d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8cddf77e654ca7a88b55acca131a45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:48:44.910187 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-a75c3dd7-20c6-48c4-8317-42446e599634 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] 10.222.0.43 "GET /compute/v2.1/servers/0cfacb1d-f8ae-4594-916e-0e9a1f38a29c" status: 200 len: 1393 microversion: 2.1 time: 0.154595 Oct 04 19:48:44.910754 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3987/7601] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:48:44 2022] GET /compute/v2.1/servers/0cfacb1d-f8ae-4594-916e-0e9a1f38a29c => generated 1393 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:48:45.931333 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=2 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:48:45.932106 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=6 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:48:45.936653 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-97b3fc3f-f50b-4c18-a90f-b9c5dc33676c tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:48:45.937402 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-97b3fc3f-f50b-4c18-a90f-b9c5dc33676c tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] [instance: 0cfacb1d-f8ae-4594-916e-0e9a1f38a29c] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:48:45.944416 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-97b3fc3f-f50b-4c18-a90f-b9c5dc33676c tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:48:45.944905 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-97b3fc3f-f50b-4c18-a90f-b9c5dc33676c tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:48:45.945378 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-97b3fc3f-f50b-4c18-a90f-b9c5dc33676c tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:48:45.946074 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-97b3fc3f-f50b-4c18-a90f-b9c5dc33676c tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:48:45.946528 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-97b3fc3f-f50b-4c18-a90f-b9c5dc33676c tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:48:45.946963 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-97b3fc3f-f50b-4c18-a90f-b9c5dc33676c tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:48:46.080253 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-97b3fc3f-f50b-4c18-a90f-b9c5dc33676c tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c616f37f7714bdaaba2ae66226f37d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8cddf77e654ca7a88b55acca131a45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:48:46.088006 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-97b3fc3f-f50b-4c18-a90f-b9c5dc33676c tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] 10.222.0.43 "GET /compute/v2.1/servers/0cfacb1d-f8ae-4594-916e-0e9a1f38a29c" status: 200 len: 1565 microversion: 2.1 time: 0.158560 Oct 04 19:48:46.088578 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3615/7602] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:48:45 2022] GET /compute/v2.1/servers/0cfacb1d-f8ae-4594-916e-0e9a1f38a29c => generated 1565 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:48:46.110232 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-c22fa3c3-0962-4e50-ad04-1e8ee135d9f5 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:48:46.110869 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-c22fa3c3-0962-4e50-ad04-1e8ee135d9f5 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] [instance: 0cfacb1d-f8ae-4594-916e-0e9a1f38a29c] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:48:46.112745 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=6 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:48:46.119123 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c22fa3c3-0962-4e50-ad04-1e8ee135d9f5 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:48:46.119632 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c22fa3c3-0962-4e50-ad04-1e8ee135d9f5 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:48:46.120094 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c22fa3c3-0962-4e50-ad04-1e8ee135d9f5 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:48:46.120839 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c22fa3c3-0962-4e50-ad04-1e8ee135d9f5 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:48:46.121348 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c22fa3c3-0962-4e50-ad04-1e8ee135d9f5 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:48:46.121803 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c22fa3c3-0962-4e50-ad04-1e8ee135d9f5 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:48:46.256030 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-c22fa3c3-0962-4e50-ad04-1e8ee135d9f5 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c616f37f7714bdaaba2ae66226f37d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8cddf77e654ca7a88b55acca131a45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:48:46.263929 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-c22fa3c3-0962-4e50-ad04-1e8ee135d9f5 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] 10.222.0.43 "GET /compute/v2.1/servers/0cfacb1d-f8ae-4594-916e-0e9a1f38a29c" status: 200 len: 1565 microversion: 2.1 time: 0.158196 Oct 04 19:48:46.264526 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3988/7603] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:48:46 2022] GET /compute/v2.1/servers/0cfacb1d-f8ae-4594-916e-0e9a1f38a29c => generated 1565 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:48:47.828809 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-aa2c96d2-d799-412b-aa50-49ad7f2c4e90 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:48:47.829599 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-aa2c96d2-d799-412b-aa50-49ad7f2c4e90 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] [instance: 0cfacb1d-f8ae-4594-916e-0e9a1f38a29c] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:48:47.831105 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-6ab2cbb1-f900-45ff-aced-8c169985c917 req-f70117d3-f5f0-4511-a58f-b9ca1bbd6faa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0cfacb1d-f8ae-4594-916e-0e9a1f38a29c", "tag": "f65b5808-7019-4a0c-8a31-91b36a2e66f8"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:48:47.836443 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-aa2c96d2-d799-412b-aa50-49ad7f2c4e90 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:48:47.837238 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-aa2c96d2-d799-412b-aa50-49ad7f2c4e90 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:48:47.837755 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-aa2c96d2-d799-412b-aa50-49ad7f2c4e90 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:48:47.838743 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-aa2c96d2-d799-412b-aa50-49ad7f2c4e90 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:48:47.839393 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-aa2c96d2-d799-412b-aa50-49ad7f2c4e90 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:48:47.840026 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-aa2c96d2-d799-412b-aa50-49ad7f2c4e90 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:48:47.842208 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-6ab2cbb1-f900-45ff-aced-8c169985c917 req-f70117d3-f5f0-4511-a58f-b9ca1bbd6faa service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:48:47.842713 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-6ab2cbb1-f900-45ff-aced-8c169985c917 req-f70117d3-f5f0-4511-a58f-b9ca1bbd6faa service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:48:47.843418 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-6ab2cbb1-f900-45ff-aced-8c169985c917 req-f70117d3-f5f0-4511-a58f-b9ca1bbd6faa service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:48:47.855105 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-6ab2cbb1-f900-45ff-aced-8c169985c917 req-f70117d3-f5f0-4511-a58f-b9ca1bbd6faa service nova] Creating event network-changed:f65b5808-7019-4a0c-8a31-91b36a2e66f8 for instance 0cfacb1d-f8ae-4594-916e-0e9a1f38a29c on n-h1-851028-13 Oct 04 19:48:47.861367 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-6ab2cbb1-f900-45ff-aced-8c169985c917 req-f70117d3-f5f0-4511-a58f-b9ca1bbd6faa service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034357 Oct 04 19:48:47.862308 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3989/7604] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:48:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:48:47.991769 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-aa2c96d2-d799-412b-aa50-49ad7f2c4e90 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c616f37f7714bdaaba2ae66226f37d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8cddf77e654ca7a88b55acca131a45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:48:48.000390 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-aa2c96d2-d799-412b-aa50-49ad7f2c4e90 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] 10.222.0.43 "GET /compute/v2.1/servers/0cfacb1d-f8ae-4594-916e-0e9a1f38a29c" status: 200 len: 1565 microversion: 2.1 time: 0.176258 Oct 04 19:48:48.001771 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3616/7605] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:48:47 2022] GET /compute/v2.1/servers/0cfacb1d-f8ae-4594-916e-0e9a1f38a29c => generated 1565 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:49:11.309419 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_api:SELECT=17 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:49:11.310081 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=38 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:49:11.314456 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-be5fd24b-c4c3-4da7-b1bb-9dcbf3e9ed44 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:49:11.316806 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-be5fd24b-c4c3-4da7-b1bb-9dcbf3e9ed44 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] [instance: 0cfacb1d-f8ae-4594-916e-0e9a1f38a29c] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:49:11.323943 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-be5fd24b-c4c3-4da7-b1bb-9dcbf3e9ed44 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:49:11.324447 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-be5fd24b-c4c3-4da7-b1bb-9dcbf3e9ed44 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:49:11.324905 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-be5fd24b-c4c3-4da7-b1bb-9dcbf3e9ed44 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:49:11.325657 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-be5fd24b-c4c3-4da7-b1bb-9dcbf3e9ed44 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:49:11.326129 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-be5fd24b-c4c3-4da7-b1bb-9dcbf3e9ed44 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:49:11.326577 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-be5fd24b-c4c3-4da7-b1bb-9dcbf3e9ed44 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:49:11.375716 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-be5fd24b-c4c3-4da7-b1bb-9dcbf3e9ed44 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] 10.222.0.43 "POST /compute/v2.1/servers/0cfacb1d-f8ae-4594-916e-0e9a1f38a29c/action" status: 200 len: 24575 microversion: 2.1 time: 0.068363 Oct 04 19:49:11.376610 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3990/7606] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 19:49:11 2022] POST /compute/v2.1/servers/0cfacb1d-f8ae-4594-916e-0e9a1f38a29c/action => generated 24575 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 19:49:22.369762 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-0e0c9c56-7072-4b20-a6fc-abb0a7f3b944 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:49:22.370339 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-0e0c9c56-7072-4b20-a6fc-abb0a7f3b944 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] [instance: 0cfacb1d-f8ae-4594-916e-0e9a1f38a29c] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:49:22.372651 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:49:22.373377 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=36 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:49:22.380893 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0e0c9c56-7072-4b20-a6fc-abb0a7f3b944 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:49:22.381773 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0e0c9c56-7072-4b20-a6fc-abb0a7f3b944 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:49:22.382503 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0e0c9c56-7072-4b20-a6fc-abb0a7f3b944 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:49:22.383637 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0e0c9c56-7072-4b20-a6fc-abb0a7f3b944 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:49:22.384364 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0e0c9c56-7072-4b20-a6fc-abb0a7f3b944 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:49:22.385042 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0e0c9c56-7072-4b20-a6fc-abb0a7f3b944 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:49:22.453168 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-0e0c9c56-7072-4b20-a6fc-abb0a7f3b944 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] 10.222.0.43 "POST /compute/v2.1/servers/0cfacb1d-f8ae-4594-916e-0e9a1f38a29c/action" status: 202 len: 0 microversion: 2.1 time: 0.087211 Oct 04 19:49:22.454067 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3617/7607] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 19:49:22 2022] POST /compute/v2.1/servers/0cfacb1d-f8ae-4594-916e-0e9a1f38a29c/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:49:22.463683 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-3c1278e4-a68f-405f-8858-e32f6ce9f7e3 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:49:22.464409 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-3c1278e4-a68f-405f-8858-e32f6ce9f7e3 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] [instance: 0cfacb1d-f8ae-4594-916e-0e9a1f38a29c] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:49:22.468516 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_api:SELECT=2 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:49:22.469339 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=4 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:49:22.476224 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3c1278e4-a68f-405f-8858-e32f6ce9f7e3 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:49:22.476767 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3c1278e4-a68f-405f-8858-e32f6ce9f7e3 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:49:22.477259 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3c1278e4-a68f-405f-8858-e32f6ce9f7e3 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:49:22.478129 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3c1278e4-a68f-405f-8858-e32f6ce9f7e3 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:49:22.478716 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3c1278e4-a68f-405f-8858-e32f6ce9f7e3 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:49:22.479183 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3c1278e4-a68f-405f-8858-e32f6ce9f7e3 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:49:22.613415 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-3c1278e4-a68f-405f-8858-e32f6ce9f7e3 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c616f37f7714bdaaba2ae66226f37d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8cddf77e654ca7a88b55acca131a45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:49:22.621785 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-3c1278e4-a68f-405f-8858-e32f6ce9f7e3 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] 10.222.0.43 "GET /compute/v2.1/servers/0cfacb1d-f8ae-4594-916e-0e9a1f38a29c" status: 200 len: 1688 microversion: 2.1 time: 0.162375 Oct 04 19:49:22.622294 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3991/7608] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:49:22 2022] GET /compute/v2.1/servers/0cfacb1d-f8ae-4594-916e-0e9a1f38a29c => generated 1688 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:49:23.648018 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-860250fb-d20b-4598-bdaa-1d3295ceec0d tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:49:23.648713 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-860250fb-d20b-4598-bdaa-1d3295ceec0d tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] [instance: 0cfacb1d-f8ae-4594-916e-0e9a1f38a29c] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:49:23.656079 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-860250fb-d20b-4598-bdaa-1d3295ceec0d tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:49:23.656558 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-860250fb-d20b-4598-bdaa-1d3295ceec0d tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:49:23.656994 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-860250fb-d20b-4598-bdaa-1d3295ceec0d tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:49:23.658370 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-860250fb-d20b-4598-bdaa-1d3295ceec0d tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:49:23.658821 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-860250fb-d20b-4598-bdaa-1d3295ceec0d tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:49:23.659253 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-860250fb-d20b-4598-bdaa-1d3295ceec0d tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:49:23.795487 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-860250fb-d20b-4598-bdaa-1d3295ceec0d tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c616f37f7714bdaaba2ae66226f37d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8cddf77e654ca7a88b55acca131a45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:49:23.803105 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-860250fb-d20b-4598-bdaa-1d3295ceec0d tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] 10.222.0.43 "GET /compute/v2.1/servers/0cfacb1d-f8ae-4594-916e-0e9a1f38a29c" status: 200 len: 1668 microversion: 2.1 time: 0.159435 Oct 04 19:49:23.803669 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3618/7609] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:49:23 2022] GET /compute/v2.1/servers/0cfacb1d-f8ae-4594-916e-0e9a1f38a29c => generated 1668 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:49:24.897191 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-b2709835-8106-4efd-8c0c-3846bf10a7ba tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:49:24.899477 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-b2709835-8106-4efd-8c0c-3846bf10a7ba tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] [instance: 0cfacb1d-f8ae-4594-916e-0e9a1f38a29c] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:49:24.907829 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b2709835-8106-4efd-8c0c-3846bf10a7ba tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:49:24.908333 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b2709835-8106-4efd-8c0c-3846bf10a7ba tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:49:24.908790 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b2709835-8106-4efd-8c0c-3846bf10a7ba tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:49:24.909760 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b2709835-8106-4efd-8c0c-3846bf10a7ba tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:49:24.910244 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b2709835-8106-4efd-8c0c-3846bf10a7ba tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:49:24.910691 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b2709835-8106-4efd-8c0c-3846bf10a7ba tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:49:24.959227 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-b2709835-8106-4efd-8c0c-3846bf10a7ba tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] 10.222.0.43 "POST /compute/v2.1/servers/0cfacb1d-f8ae-4594-916e-0e9a1f38a29c/action" status: 200 len: 32649 microversion: 2.1 time: 0.066028 Oct 04 19:49:24.959852 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3992/7610] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 19:49:24 2022] POST /compute/v2.1/servers/0cfacb1d-f8ae-4594-916e-0e9a1f38a29c/action => generated 32649 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 19:49:24.972197 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-a414431c-33ed-4f32-b136-48641ec6a11c tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:49:24.972741 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-a414431c-33ed-4f32-b136-48641ec6a11c tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] [instance: 0cfacb1d-f8ae-4594-916e-0e9a1f38a29c] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:49:24.979576 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a414431c-33ed-4f32-b136-48641ec6a11c tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:49:24.980091 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a414431c-33ed-4f32-b136-48641ec6a11c tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:49:24.980533 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a414431c-33ed-4f32-b136-48641ec6a11c tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:49:24.981261 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a414431c-33ed-4f32-b136-48641ec6a11c tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:49:24.981776 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a414431c-33ed-4f32-b136-48641ec6a11c tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:49:24.982908 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a414431c-33ed-4f32-b136-48641ec6a11c tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:49:25.049831 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-a414431c-33ed-4f32-b136-48641ec6a11c tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] 10.222.0.43 "POST /compute/v2.1/servers/0cfacb1d-f8ae-4594-916e-0e9a1f38a29c/action" status: 202 len: 0 microversion: 2.1 time: 0.082018 Oct 04 19:49:25.050467 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3619/7611] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 19:49:24 2022] POST /compute/v2.1/servers/0cfacb1d-f8ae-4594-916e-0e9a1f38a29c/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:49:25.060187 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-868814d0-692f-44f5-9f1e-354ada27374a tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:49:25.061207 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-868814d0-692f-44f5-9f1e-354ada27374a tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] [instance: 0cfacb1d-f8ae-4594-916e-0e9a1f38a29c] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:49:25.069205 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-868814d0-692f-44f5-9f1e-354ada27374a tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:49:25.069710 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-868814d0-692f-44f5-9f1e-354ada27374a tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:49:25.070702 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-868814d0-692f-44f5-9f1e-354ada27374a tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:49:25.071444 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-868814d0-692f-44f5-9f1e-354ada27374a tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:49:25.071928 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-868814d0-692f-44f5-9f1e-354ada27374a tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:49:25.072588 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-868814d0-692f-44f5-9f1e-354ada27374a tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:49:25.207531 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-868814d0-692f-44f5-9f1e-354ada27374a tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c616f37f7714bdaaba2ae66226f37d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8cddf77e654ca7a88b55acca131a45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:49:25.216096 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-868814d0-692f-44f5-9f1e-354ada27374a tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] 10.222.0.43 "GET /compute/v2.1/servers/0cfacb1d-f8ae-4594-916e-0e9a1f38a29c" status: 200 len: 1675 microversion: 2.1 time: 0.161064 Oct 04 19:49:25.217067 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3993/7612] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:49:25 2022] GET /compute/v2.1/servers/0cfacb1d-f8ae-4594-916e-0e9a1f38a29c => generated 1675 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:49:26.241511 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-4497c3a1-774f-4864-8ef0-04a64c89f03f tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:49:26.242232 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-4497c3a1-774f-4864-8ef0-04a64c89f03f tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] [instance: 0cfacb1d-f8ae-4594-916e-0e9a1f38a29c] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:49:26.248459 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4497c3a1-774f-4864-8ef0-04a64c89f03f tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:49:26.248950 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4497c3a1-774f-4864-8ef0-04a64c89f03f tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:49:26.249432 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4497c3a1-774f-4864-8ef0-04a64c89f03f tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:49:26.250130 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4497c3a1-774f-4864-8ef0-04a64c89f03f tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:49:26.250594 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4497c3a1-774f-4864-8ef0-04a64c89f03f tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:49:26.251031 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4497c3a1-774f-4864-8ef0-04a64c89f03f tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:49:26.392839 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-4497c3a1-774f-4864-8ef0-04a64c89f03f tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c616f37f7714bdaaba2ae66226f37d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8cddf77e654ca7a88b55acca131a45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:49:26.400593 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-4497c3a1-774f-4864-8ef0-04a64c89f03f tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] 10.222.0.43 "GET /compute/v2.1/servers/0cfacb1d-f8ae-4594-916e-0e9a1f38a29c" status: 200 len: 1683 microversion: 2.1 time: 0.164323 Oct 04 19:49:26.401173 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3620/7613] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:49:26 2022] GET /compute/v2.1/servers/0cfacb1d-f8ae-4594-916e-0e9a1f38a29c => generated 1683 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:49:26.493070 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-a802da44-92f2-4cd8-b142-2651ff7ccf0d tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:49:26.495384 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-a802da44-92f2-4cd8-b142-2651ff7ccf0d tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] [instance: 0cfacb1d-f8ae-4594-916e-0e9a1f38a29c] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:49:26.503245 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a802da44-92f2-4cd8-b142-2651ff7ccf0d tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:49:26.503817 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a802da44-92f2-4cd8-b142-2651ff7ccf0d tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:49:26.504284 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a802da44-92f2-4cd8-b142-2651ff7ccf0d tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:49:26.504999 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a802da44-92f2-4cd8-b142-2651ff7ccf0d tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:49:26.505501 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a802da44-92f2-4cd8-b142-2651ff7ccf0d tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:49:26.505988 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a802da44-92f2-4cd8-b142-2651ff7ccf0d tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:49:26.554680 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-a802da44-92f2-4cd8-b142-2651ff7ccf0d tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] 10.222.0.43 "POST /compute/v2.1/servers/0cfacb1d-f8ae-4594-916e-0e9a1f38a29c/action" status: 200 len: 38416 microversion: 2.1 time: 0.065511 Oct 04 19:49:26.555327 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3994/7614] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 19:49:26 2022] POST /compute/v2.1/servers/0cfacb1d-f8ae-4594-916e-0e9a1f38a29c/action => generated 38416 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 19:49:27.524452 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-7192a978-71ad-4e45-a485-64c33bb74c17 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:49:27.524941 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-7192a978-71ad-4e45-a485-64c33bb74c17 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] [instance: 0cfacb1d-f8ae-4594-916e-0e9a1f38a29c] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:49:27.526996 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-9e6b86e5-9067-4813-b28e-b67fe49a0ea7 req-9a2d32cf-461d-4dc4-b15a-d56269551802 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0cfacb1d-f8ae-4594-916e-0e9a1f38a29c", "tag": "f65b5808-7019-4a0c-8a31-91b36a2e66f8"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:49:27.531876 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7192a978-71ad-4e45-a485-64c33bb74c17 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:49:27.533206 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7192a978-71ad-4e45-a485-64c33bb74c17 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:49:27.533654 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7192a978-71ad-4e45-a485-64c33bb74c17 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:49:27.534613 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7192a978-71ad-4e45-a485-64c33bb74c17 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:49:27.535143 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7192a978-71ad-4e45-a485-64c33bb74c17 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:49:27.535650 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7192a978-71ad-4e45-a485-64c33bb74c17 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:49:27.538820 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-9e6b86e5-9067-4813-b28e-b67fe49a0ea7 req-9a2d32cf-461d-4dc4-b15a-d56269551802 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:49:27.539334 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-9e6b86e5-9067-4813-b28e-b67fe49a0ea7 req-9a2d32cf-461d-4dc4-b15a-d56269551802 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:49:27.539793 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-9e6b86e5-9067-4813-b28e-b67fe49a0ea7 req-9a2d32cf-461d-4dc4-b15a-d56269551802 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:49:27.551950 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-9e6b86e5-9067-4813-b28e-b67fe49a0ea7 req-9a2d32cf-461d-4dc4-b15a-d56269551802 service nova] Creating event network-changed:f65b5808-7019-4a0c-8a31-91b36a2e66f8 for instance 0cfacb1d-f8ae-4594-916e-0e9a1f38a29c on n-h1-851028-13 Oct 04 19:49:27.557351 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-9e6b86e5-9067-4813-b28e-b67fe49a0ea7 req-9a2d32cf-461d-4dc4-b15a-d56269551802 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034530 Oct 04 19:49:27.558091 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3995/7615] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:49:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:49:27.564154 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-7192a978-71ad-4e45-a485-64c33bb74c17 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] [instance: 0cfacb1d-f8ae-4594-916e-0e9a1f38a29c] Going to try to terminate instance {{(pid=123595) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 19:49:27.650372 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-7192a978-71ad-4e45-a485-64c33bb74c17 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] 10.222.0.43 "DELETE /compute/v2.1/servers/0cfacb1d-f8ae-4594-916e-0e9a1f38a29c" status: 204 len: 0 microversion: 2.1 time: 0.129544 Oct 04 19:49:27.651365 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3621/7616] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 19:49:27 2022] DELETE /compute/v2.1/servers/0cfacb1d-f8ae-4594-916e-0e9a1f38a29c => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:49:27.661571 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f0919ef5-7386-45cf-964d-dcc52d0a1ee8 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:49:27.662637 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-f0919ef5-7386-45cf-964d-dcc52d0a1ee8 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] [instance: 0cfacb1d-f8ae-4594-916e-0e9a1f38a29c] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:49:27.669047 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f0919ef5-7386-45cf-964d-dcc52d0a1ee8 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:49:27.669606 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f0919ef5-7386-45cf-964d-dcc52d0a1ee8 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:49:27.670282 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f0919ef5-7386-45cf-964d-dcc52d0a1ee8 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:49:27.671011 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f0919ef5-7386-45cf-964d-dcc52d0a1ee8 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:49:27.671686 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f0919ef5-7386-45cf-964d-dcc52d0a1ee8 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:49:27.672143 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f0919ef5-7386-45cf-964d-dcc52d0a1ee8 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:49:27.835495 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-f0919ef5-7386-45cf-964d-dcc52d0a1ee8 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c616f37f7714bdaaba2ae66226f37d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8cddf77e654ca7a88b55acca131a45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:49:27.843621 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-f0919ef5-7386-45cf-964d-dcc52d0a1ee8 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] 10.222.0.43 "GET /compute/v2.1/servers/0cfacb1d-f8ae-4594-916e-0e9a1f38a29c" status: 200 len: 1689 microversion: 2.1 time: 0.187607 Oct 04 19:49:27.844198 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3996/7617] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:49:27 2022] GET /compute/v2.1/servers/0cfacb1d-f8ae-4594-916e-0e9a1f38a29c => generated 1689 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:49:28.869813 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-7cfc96ec-4138-4834-9ce1-0d5a5f79d812 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:49:28.870560 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-7cfc96ec-4138-4834-9ce1-0d5a5f79d812 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] [instance: 0cfacb1d-f8ae-4594-916e-0e9a1f38a29c] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:49:28.877492 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7cfc96ec-4138-4834-9ce1-0d5a5f79d812 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:49:28.878052 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7cfc96ec-4138-4834-9ce1-0d5a5f79d812 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:49:28.878504 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7cfc96ec-4138-4834-9ce1-0d5a5f79d812 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:49:28.879207 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7cfc96ec-4138-4834-9ce1-0d5a5f79d812 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:49:28.879670 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7cfc96ec-4138-4834-9ce1-0d5a5f79d812 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:49:28.880106 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7cfc96ec-4138-4834-9ce1-0d5a5f79d812 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:49:29.013536 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-7cfc96ec-4138-4834-9ce1-0d5a5f79d812 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c616f37f7714bdaaba2ae66226f37d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8cddf77e654ca7a88b55acca131a45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:49:29.022059 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-7cfc96ec-4138-4834-9ce1-0d5a5f79d812 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] 10.222.0.43 "GET /compute/v2.1/servers/0cfacb1d-f8ae-4594-916e-0e9a1f38a29c" status: 200 len: 1689 microversion: 2.1 time: 0.156525 Oct 04 19:49:29.022636 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3622/7618] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:49:28 2022] GET /compute/v2.1/servers/0cfacb1d-f8ae-4594-916e-0e9a1f38a29c => generated 1689 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:49:29.643921 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-545944ba-afd2-49e0-9610-260e8cd1eb44 req-3a288ca4-6dd8-4347-890e-633b534b1e2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0cfacb1d-f8ae-4594-916e-0e9a1f38a29c", "name": "network-vif-deleted", "tag": "f65b5808-7019-4a0c-8a31-91b36a2e66f8"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:49:29.654526 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-545944ba-afd2-49e0-9610-260e8cd1eb44 req-3a288ca4-6dd8-4347-890e-633b534b1e2a service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:49:29.655174 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-545944ba-afd2-49e0-9610-260e8cd1eb44 req-3a288ca4-6dd8-4347-890e-633b534b1e2a service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:49:29.655636 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-545944ba-afd2-49e0-9610-260e8cd1eb44 req-3a288ca4-6dd8-4347-890e-633b534b1e2a service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:49:29.667735 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-545944ba-afd2-49e0-9610-260e8cd1eb44 req-3a288ca4-6dd8-4347-890e-633b534b1e2a service nova] Creating event network-vif-deleted:f65b5808-7019-4a0c-8a31-91b36a2e66f8 for instance 0cfacb1d-f8ae-4594-916e-0e9a1f38a29c on n-h1-851028-13 Oct 04 19:49:29.673099 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-545944ba-afd2-49e0-9610-260e8cd1eb44 req-3a288ca4-6dd8-4347-890e-633b534b1e2a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032466 Oct 04 19:49:29.673726 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3997/7619] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:49:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:49:30.045058 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-09550497-452c-4cf9-96c9-aced0d1f5d28 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:49:30.046476 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-09550497-452c-4cf9-96c9-aced0d1f5d28 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] [instance: 0cfacb1d-f8ae-4594-916e-0e9a1f38a29c] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:49:30.056042 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-09550497-452c-4cf9-96c9-aced0d1f5d28 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:49:30.056766 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-09550497-452c-4cf9-96c9-aced0d1f5d28 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:49:30.057252 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-09550497-452c-4cf9-96c9-aced0d1f5d28 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:49:30.057979 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-09550497-452c-4cf9-96c9-aced0d1f5d28 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:49:30.058612 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-09550497-452c-4cf9-96c9-aced0d1f5d28 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:49:30.059229 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-09550497-452c-4cf9-96c9-aced0d1f5d28 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:49:30.092372 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-09550497-452c-4cf9-96c9-aced0d1f5d28 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:49:30.092858 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-09550497-452c-4cf9-96c9-aced0d1f5d28 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:49:30.093652 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-09550497-452c-4cf9-96c9-aced0d1f5d28 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:49:30.094114 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.objects.instance [None req-09550497-452c-4cf9-96c9-aced0d1f5d28 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lazy-loading 'fault' on Instance uuid 0cfacb1d-f8ae-4594-916e-0e9a1f38a29c {{(pid=123595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 19:49:30.137189 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-09550497-452c-4cf9-96c9-aced0d1f5d28 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c616f37f7714bdaaba2ae66226f37d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8cddf77e654ca7a88b55acca131a45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:49:30.145268 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-09550497-452c-4cf9-96c9-aced0d1f5d28 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] 10.222.0.43 "GET /compute/v2.1/servers/0cfacb1d-f8ae-4594-916e-0e9a1f38a29c" status: 200 len: 1357 microversion: 2.1 time: 0.104048 Oct 04 19:49:30.161236 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3623/7620] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:49:30 2022] GET /compute/v2.1/servers/0cfacb1d-f8ae-4594-916e-0e9a1f38a29c => generated 1357 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:49:31.171985 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-99229ec1-7850-415e-a322-8fcf8815ab4c tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:49:31.173248 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-99229ec1-7850-415e-a322-8fcf8815ab4c tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] [instance: 0cfacb1d-f8ae-4594-916e-0e9a1f38a29c] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:49:31.179453 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-99229ec1-7850-415e-a322-8fcf8815ab4c tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:49:31.179954 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-99229ec1-7850-415e-a322-8fcf8815ab4c tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:49:31.180412 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-99229ec1-7850-415e-a322-8fcf8815ab4c tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:49:31.181136 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-99229ec1-7850-415e-a322-8fcf8815ab4c tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:49:31.181616 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-99229ec1-7850-415e-a322-8fcf8815ab4c tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:49:31.182065 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-99229ec1-7850-415e-a322-8fcf8815ab4c tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:49:31.196052 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-99229ec1-7850-415e-a322-8fcf8815ab4c tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] HTTP exception thrown: Instance 0cfacb1d-f8ae-4594-916e-0e9a1f38a29c could not be found. Oct 04 19:49:31.197750 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-99229ec1-7850-415e-a322-8fcf8815ab4c tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Request method failure captured: Oct 04 19:49:31.197750 n-d-851028-13 devstack@n-api.service[123596]: request: GET /compute/v2.1/servers/0cfacb1d-f8ae-4594-916e-0e9a1f38a29c HTTP/1.1 Oct 04 19:49:31.197750 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 19:49:31.197750 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 19:49:31.197750 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 19:49:31.197750 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 19:49:31.197750 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 19:49:31.197750 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 19:49:31.197750 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 19:49:31.197750 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 19:49:31.197750 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPI4MZexuhXm6PsbDTE0mN_HzaWvpyBNcmZcptu-WN0BUo7VbC1tcPqUVzrRf31db8M0EWQ8d_sfA5FFL6AhajMMcCPlTBrfm9fKnWc8kbZzl3TY06xFuGGx0ZPCeDpUjJED_TcND6oWmolrrMBlfCNdyr-yMj_WCseJ7TPmrL_dgAc0 Oct 04 19:49:31.197750 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 19:49:31.197750 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 19:49:31.197750 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 19:49:31.197750 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 19:49:31.197750 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 19:49:31.197750 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 19:49:31.197750 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: bc8cddf77e654ca7a88b55acca131a45 Oct 04 19:49:31.197750 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-238299873 Oct 04 19:49:31.197750 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 19:49:31.197750 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 19:49:31.197750 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/bc8cddf77e654ca7a88b55acca131a45"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_bc8cddf77e654ca7a88b55acca131a45"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/bc8cddf77e654ca7a88b55acca131a45"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/bc8cddf77e654ca7a88b55acca131a45"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 19:49:31.197750 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-TestNetworkAdvancedServerOps-238299873 Oct 04 19:49:31.197750 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: bc8cddf77e654ca7a88b55acca131a45 Oct 04 19:49:31.197750 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-238299873 Oct 04 19:49:31.197750 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-TestNetworkAdvancedServerOps-238299873-project Oct 04 19:49:31.197750 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 19:49:31.197750 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 19:49:31.197750 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 6c616f37f7714bdaaba2ae66226f37d8 Oct 04 19:49:31.197750 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-TestNetworkAdvancedServerOps-238299873-project Oct 04 19:49:31.197750 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 19:49:31.197750 n-d-851028-13 devstack@n-api.service[123596]: exception: Instance 0cfacb1d-f8ae-4594-916e-0e9a1f38a29c could not be found. Oct 04 19:49:31.197750 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': '0cfacb1d-f8ae-4594-916e-0e9a1f38a29c'} Oct 04 19:49:31.197750 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:49:31.197750 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:49:31.197750 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:49:31.197750 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:49:31.197750 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:49:31.197750 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:49:31.197750 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:49:31.197750 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:49:31.197750 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:49:31.197750 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:49:31.197750 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0cfacb1d-f8ae-4594-916e-0e9a1f38a29c could not be found. Oct 04 19:49:31.197750 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:49:31.197750 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:49:31.197750 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:49:31.197750 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:49:31.197750 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:49:31.197750 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:49:31.197750 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:49:31.197750 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:49:31.197750 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:49:31.197750 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:49:31.197750 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:49:31.197750 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:49:31.197750 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:49:31.197750 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:49:31.197750 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:49:31.197750 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:49:31.197750 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0cfacb1d-f8ae-4594-916e-0e9a1f38a29c could not be found. Oct 04 19:49:31.197750 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:49:31.197750 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:49:31.202685 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:49:31.202685 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:49:31.202685 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:49:31.202685 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:49:31.202685 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:49:31.202685 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:49:31.202685 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0cfacb1d-f8ae-4594-916e-0e9a1f38a29c could not be found. Oct 04 19:49:31.202685 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:49:31.202685 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-99229ec1-7850-415e-a322-8fcf8815ab4c tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Returning 404 to user: Instance 0cfacb1d-f8ae-4594-916e-0e9a1f38a29c could not be found. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:49:31.202685 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-99229ec1-7850-415e-a322-8fcf8815ab4c tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] 10.222.0.43 "GET /compute/v2.1/servers/0cfacb1d-f8ae-4594-916e-0e9a1f38a29c" status: 404 len: 111 microversion: 2.1 time: 0.032365 Oct 04 19:49:31.202685 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3998/7621] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:49:31 2022] GET /compute/v2.1/servers/0cfacb1d-f8ae-4594-916e-0e9a1f38a29c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:49:34.471481 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-c7d96434-3783-474b-ae7c-e0a8fa52944b tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Calling method '.version_select at 0x7fb21efcbee0>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:49:34.496648 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-c7d96434-3783-474b-ae7c-e0a8fa52944b tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1233752895" status: 202 len: 0 microversion: 2.1 time: 0.029311 Oct 04 19:49:34.497249 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3624/7622] 10.222.0.43 () {58 vars in 1284 bytes} [Tue Oct 4 19:49:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1233752895 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:49:34.525517 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-b33c5937-bb8c-4d26-aea6-f563fdfd8e4c tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Action: 'create', calling method: .version_select at 0x7fb21ea80b80>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-861516933", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF5cAvrBuj5DL/U8rmAPJAOHifk0Blvs3tWnLRZ2nlKKwxe91ES3Z7b3+58bufEoc79Xk2I+jwKEOHPq9IkX36ezpgkgRds1TaHiyeTvV8HO5EMtkFCkWKM7UhxcEzYkww=="}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:49:34.542342 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-b33c5937-bb8c-4d26-aea6-f563fdfd8e4c tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Getting quotas for project bc8cddf77e654ca7a88b55acca131a45. Resources: {'key_pairs'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:49:34.549058 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-b33c5937-bb8c-4d26-aea6-f563fdfd8e4c tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Getting quotas for user 6c616f37f7714bdaaba2ae66226f37d8 and project bc8cddf77e654ca7a88b55acca131a45. Resources: {'key_pairs'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:49:34.573329 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-b33c5937-bb8c-4d26-aea6-f563fdfd8e4c tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.051737 Oct 04 19:49:34.574135 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 3999/7623] 10.222.0.43 () {60 vars in 1159 bytes} [Tue Oct 4 19:49:34 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:49:40.395210 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-efb72a35-0c84-454b-a0c1-f82ee125ec92 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1344831891", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452", "networks": [{"uuid": "c3990e53-fcc7-4cd8-ba7f-a854d1ee5079"}], "key_name": "tempest-TestNetworkAdvancedServerOps-861516933", "security_groups": [{"name": "tempest-secgroup-smoke-1436009065"}]}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:49:40.408285 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:49:40.534391 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.network.neutron [None req-efb72a35-0c84-454b-a0c1-f82ee125ec92 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] validate_networks() for [('c3990e53-fcc7-4cd8-ba7f-a854d1ee5079', None, None, None, None, None)] {{(pid=123595) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 19:49:40.968240 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-efb72a35-0c84-454b-a0c1-f82ee125ec92 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Flavor limits 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:49:40.968857 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-efb72a35-0c84-454b-a0c1-f82ee125ec92 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Image limits 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:49:40.969613 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-efb72a35-0c84-454b-a0c1-f82ee125ec92 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Flavor pref 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:49:40.970316 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-efb72a35-0c84-454b-a0c1-f82ee125ec92 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Image pref 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:49:40.971210 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-efb72a35-0c84-454b-a0c1-f82ee125ec92 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:49:40.982596 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-efb72a35-0c84-454b-a0c1-f82ee125ec92 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:49:40.983359 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-efb72a35-0c84-454b-a0c1-f82ee125ec92 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:49:40.983967 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-efb72a35-0c84-454b-a0c1-f82ee125ec92 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:49:40.984752 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-efb72a35-0c84-454b-a0c1-f82ee125ec92 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:49:40.985787 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-efb72a35-0c84-454b-a0c1-f82ee125ec92 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:49:40.986205 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-efb72a35-0c84-454b-a0c1-f82ee125ec92 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:49:41.007469 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-efb72a35-0c84-454b-a0c1-f82ee125ec92 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Getting quotas for project bc8cddf77e654ca7a88b55acca131a45. Resources: {'ram', 'cores', 'instances'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:49:41.014028 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-efb72a35-0c84-454b-a0c1-f82ee125ec92 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Getting quotas for user 6c616f37f7714bdaaba2ae66226f37d8 and project bc8cddf77e654ca7a88b55acca131a45. Resources: {'ram', 'cores', 'instances'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:49:41.039177 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-efb72a35-0c84-454b-a0c1-f82ee125ec92 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Going to run 1 instances... {{(pid=123595) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 19:49:41.047224 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-efb72a35-0c84-454b-a0c1-f82ee125ec92 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] [instance: 202cbdb0-650d-43d8-9dd2-3350885ccce5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e8943ec5-4038-4d4b-b9b9-2415a79f5243',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 19:49:41.105674 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-efb72a35-0c84-454b-a0c1-f82ee125ec92 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.715324 Oct 04 19:49:41.106347 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3625/7624] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 19:49:40 2022] POST /compute/v2.1/servers => generated 406 bytes in 717 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 19:49:41.119551 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-563a969f-9479-43fb-8694-9c2d29a9a2a4 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:49:41.120118 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-563a969f-9479-43fb-8694-9c2d29a9a2a4 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] [instance: 202cbdb0-650d-43d8-9dd2-3350885ccce5] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:49:41.179112 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-563a969f-9479-43fb-8694-9c2d29a9a2a4 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c616f37f7714bdaaba2ae66226f37d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8cddf77e654ca7a88b55acca131a45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:49:41.187231 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=32 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:49:41.190127 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-563a969f-9479-43fb-8694-9c2d29a9a2a4 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] 10.222.0.43 "GET /compute/v2.1/servers/202cbdb0-650d-43d8-9dd2-3350885ccce5" status: 200 len: 1266 microversion: 2.1 time: 0.075690 Oct 04 19:49:41.190718 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 4000/7625] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:49:41 2022] GET /compute/v2.1/servers/202cbdb0-650d-43d8-9dd2-3350885ccce5 => generated 1266 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:49:42.213743 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-9cc2b5c6-75b3-470c-9b0c-8894721a03a8 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:49:42.215142 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-9cc2b5c6-75b3-470c-9b0c-8894721a03a8 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] [instance: 202cbdb0-650d-43d8-9dd2-3350885ccce5] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:49:42.225000 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9cc2b5c6-75b3-470c-9b0c-8894721a03a8 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:49:42.225770 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9cc2b5c6-75b3-470c-9b0c-8894721a03a8 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:49:42.226389 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9cc2b5c6-75b3-470c-9b0c-8894721a03a8 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:49:42.227276 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9cc2b5c6-75b3-470c-9b0c-8894721a03a8 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:49:42.227909 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9cc2b5c6-75b3-470c-9b0c-8894721a03a8 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:49:42.228711 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9cc2b5c6-75b3-470c-9b0c-8894721a03a8 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:49:42.322143 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-9cc2b5c6-75b3-470c-9b0c-8894721a03a8 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c616f37f7714bdaaba2ae66226f37d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8cddf77e654ca7a88b55acca131a45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:49:42.332086 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-9cc2b5c6-75b3-470c-9b0c-8894721a03a8 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] 10.222.0.43 "GET /compute/v2.1/servers/202cbdb0-650d-43d8-9dd2-3350885ccce5" status: 200 len: 1326 microversion: 2.1 time: 0.122183 Oct 04 19:49:42.333319 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3626/7626] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:49:42 2022] GET /compute/v2.1/servers/202cbdb0-650d-43d8-9dd2-3350885ccce5 => generated 1326 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:49:43.356772 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-78f34129-0406-4186-9af2-6906fb778bee tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:49:43.358227 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-78f34129-0406-4186-9af2-6906fb778bee tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] [instance: 202cbdb0-650d-43d8-9dd2-3350885ccce5] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:49:43.368608 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-78f34129-0406-4186-9af2-6906fb778bee tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:49:43.369154 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-78f34129-0406-4186-9af2-6906fb778bee tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:49:43.369618 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-78f34129-0406-4186-9af2-6906fb778bee tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:49:43.370743 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-78f34129-0406-4186-9af2-6906fb778bee tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:49:43.371231 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-78f34129-0406-4186-9af2-6906fb778bee tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:49:43.371685 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-78f34129-0406-4186-9af2-6906fb778bee tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:49:43.554658 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-78f34129-0406-4186-9af2-6906fb778bee tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c616f37f7714bdaaba2ae66226f37d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8cddf77e654ca7a88b55acca131a45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:49:43.562792 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-78f34129-0406-4186-9af2-6906fb778bee tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] 10.222.0.43 "GET /compute/v2.1/servers/202cbdb0-650d-43d8-9dd2-3350885ccce5" status: 200 len: 1392 microversion: 2.1 time: 0.210937 Oct 04 19:49:43.567007 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 4001/7627] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:49:43 2022] GET /compute/v2.1/servers/202cbdb0-650d-43d8-9dd2-3350885ccce5 => generated 1392 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:49:43.781075 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-d55e6a47-42ea-4be4-af1a-ce17825ff341 req-905a387d-d13c-452d-9279-c8013dad005a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "202cbdb0-650d-43d8-9dd2-3350885ccce5", "tag": "c0b271e7-bd38-472f-9dfc-ffb5c31c93c7"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:49:43.811635 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-d55e6a47-42ea-4be4-af1a-ce17825ff341 req-905a387d-d13c-452d-9279-c8013dad005a service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:49:43.812574 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-d55e6a47-42ea-4be4-af1a-ce17825ff341 req-905a387d-d13c-452d-9279-c8013dad005a service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:49:43.813938 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-d55e6a47-42ea-4be4-af1a-ce17825ff341 req-905a387d-d13c-452d-9279-c8013dad005a service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:49:43.832860 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-d55e6a47-42ea-4be4-af1a-ce17825ff341 req-905a387d-d13c-452d-9279-c8013dad005a service nova] Creating event network-changed:c0b271e7-bd38-472f-9dfc-ffb5c31c93c7 for instance 202cbdb0-650d-43d8-9dd2-3350885ccce5 on n-h1-851028-13 Oct 04 19:49:43.838451 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-d55e6a47-42ea-4be4-af1a-ce17825ff341 req-905a387d-d13c-452d-9279-c8013dad005a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060710 Oct 04 19:49:43.839069 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3627/7628] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:49:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:49:44.591074 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-b956fcab-9757-471b-b10b-dfeb72e687d8 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:49:44.591954 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-b956fcab-9757-471b-b10b-dfeb72e687d8 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] [instance: 202cbdb0-650d-43d8-9dd2-3350885ccce5] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:49:44.599940 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b956fcab-9757-471b-b10b-dfeb72e687d8 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:49:44.600543 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b956fcab-9757-471b-b10b-dfeb72e687d8 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:49:44.601004 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b956fcab-9757-471b-b10b-dfeb72e687d8 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:49:44.601753 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b956fcab-9757-471b-b10b-dfeb72e687d8 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:49:44.602248 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b956fcab-9757-471b-b10b-dfeb72e687d8 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:49:44.602690 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b956fcab-9757-471b-b10b-dfeb72e687d8 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:49:44.731834 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-b956fcab-9757-471b-b10b-dfeb72e687d8 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c616f37f7714bdaaba2ae66226f37d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8cddf77e654ca7a88b55acca131a45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:49:44.739482 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-b956fcab-9757-471b-b10b-dfeb72e687d8 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] 10.222.0.43 "GET /compute/v2.1/servers/202cbdb0-650d-43d8-9dd2-3350885ccce5" status: 200 len: 1392 microversion: 2.1 time: 0.152454 Oct 04 19:49:44.740050 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 4002/7629] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:49:44 2022] GET /compute/v2.1/servers/202cbdb0-650d-43d8-9dd2-3350885ccce5 => generated 1392 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:49:45.762995 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-5127ce90-7a77-4538-b539-6ee10e68d331 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:49:45.763707 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-5127ce90-7a77-4538-b539-6ee10e68d331 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] [instance: 202cbdb0-650d-43d8-9dd2-3350885ccce5] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:49:45.770844 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5127ce90-7a77-4538-b539-6ee10e68d331 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:49:45.771339 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5127ce90-7a77-4538-b539-6ee10e68d331 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:49:45.771790 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5127ce90-7a77-4538-b539-6ee10e68d331 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:49:45.772497 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5127ce90-7a77-4538-b539-6ee10e68d331 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:49:45.772962 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5127ce90-7a77-4538-b539-6ee10e68d331 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:49:45.773425 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5127ce90-7a77-4538-b539-6ee10e68d331 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:49:45.910627 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-5127ce90-7a77-4538-b539-6ee10e68d331 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c616f37f7714bdaaba2ae66226f37d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8cddf77e654ca7a88b55acca131a45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:49:45.918461 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-5127ce90-7a77-4538-b539-6ee10e68d331 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] 10.222.0.43 "GET /compute/v2.1/servers/202cbdb0-650d-43d8-9dd2-3350885ccce5" status: 200 len: 1392 microversion: 2.1 time: 0.159728 Oct 04 19:49:45.919031 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3628/7630] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:49:45 2022] GET /compute/v2.1/servers/202cbdb0-650d-43d8-9dd2-3350885ccce5 => generated 1392 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:49:46.941294 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-0cb6c8ba-c3c4-4983-ae49-ff3ff27e36de tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:49:46.941924 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-0cb6c8ba-c3c4-4983-ae49-ff3ff27e36de tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] [instance: 202cbdb0-650d-43d8-9dd2-3350885ccce5] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:49:46.948837 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0cb6c8ba-c3c4-4983-ae49-ff3ff27e36de tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:49:46.949378 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0cb6c8ba-c3c4-4983-ae49-ff3ff27e36de tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:49:46.949855 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0cb6c8ba-c3c4-4983-ae49-ff3ff27e36de tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:49:46.950570 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0cb6c8ba-c3c4-4983-ae49-ff3ff27e36de tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:49:46.951042 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0cb6c8ba-c3c4-4983-ae49-ff3ff27e36de tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:49:46.951486 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0cb6c8ba-c3c4-4983-ae49-ff3ff27e36de tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:49:47.083741 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-0cb6c8ba-c3c4-4983-ae49-ff3ff27e36de tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c616f37f7714bdaaba2ae66226f37d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8cddf77e654ca7a88b55acca131a45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:49:47.091367 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-0cb6c8ba-c3c4-4983-ae49-ff3ff27e36de tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] 10.222.0.43 "GET /compute/v2.1/servers/202cbdb0-650d-43d8-9dd2-3350885ccce5" status: 200 len: 1392 microversion: 2.1 time: 0.154093 Oct 04 19:49:47.091933 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 4003/7631] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:49:46 2022] GET /compute/v2.1/servers/202cbdb0-650d-43d8-9dd2-3350885ccce5 => generated 1392 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:49:48.114655 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-d5b98f8e-85ac-4454-b7a9-e0a4b7d71547 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:49:48.115379 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-d5b98f8e-85ac-4454-b7a9-e0a4b7d71547 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] [instance: 202cbdb0-650d-43d8-9dd2-3350885ccce5] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:49:48.122297 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d5b98f8e-85ac-4454-b7a9-e0a4b7d71547 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:49:48.122790 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d5b98f8e-85ac-4454-b7a9-e0a4b7d71547 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:49:48.123240 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d5b98f8e-85ac-4454-b7a9-e0a4b7d71547 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:49:48.123940 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d5b98f8e-85ac-4454-b7a9-e0a4b7d71547 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:49:48.124406 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d5b98f8e-85ac-4454-b7a9-e0a4b7d71547 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:49:48.124848 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d5b98f8e-85ac-4454-b7a9-e0a4b7d71547 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:49:48.253663 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-d5b98f8e-85ac-4454-b7a9-e0a4b7d71547 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c616f37f7714bdaaba2ae66226f37d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8cddf77e654ca7a88b55acca131a45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:49:48.261575 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-d5b98f8e-85ac-4454-b7a9-e0a4b7d71547 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] 10.222.0.43 "GET /compute/v2.1/servers/202cbdb0-650d-43d8-9dd2-3350885ccce5" status: 200 len: 1392 microversion: 2.1 time: 0.151492 Oct 04 19:49:48.262136 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3629/7632] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:49:48 2022] GET /compute/v2.1/servers/202cbdb0-650d-43d8-9dd2-3350885ccce5 => generated 1392 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:49:49.284775 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-b2bb6d05-28a3-49fe-a129-6a050aa223f9 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:49:49.285337 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-b2bb6d05-28a3-49fe-a129-6a050aa223f9 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] [instance: 202cbdb0-650d-43d8-9dd2-3350885ccce5] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:49:49.292163 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b2bb6d05-28a3-49fe-a129-6a050aa223f9 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:49:49.292680 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b2bb6d05-28a3-49fe-a129-6a050aa223f9 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:49:49.293152 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b2bb6d05-28a3-49fe-a129-6a050aa223f9 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:49:49.293854 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b2bb6d05-28a3-49fe-a129-6a050aa223f9 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:49:49.294319 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b2bb6d05-28a3-49fe-a129-6a050aa223f9 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:49:49.294759 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b2bb6d05-28a3-49fe-a129-6a050aa223f9 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:49:49.431742 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-b2bb6d05-28a3-49fe-a129-6a050aa223f9 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c616f37f7714bdaaba2ae66226f37d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8cddf77e654ca7a88b55acca131a45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:49:49.439611 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-b2bb6d05-28a3-49fe-a129-6a050aa223f9 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] 10.222.0.43 "GET /compute/v2.1/servers/202cbdb0-650d-43d8-9dd2-3350885ccce5" status: 200 len: 1392 microversion: 2.1 time: 0.159335 Oct 04 19:49:49.440204 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 4004/7633] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:49:49 2022] GET /compute/v2.1/servers/202cbdb0-650d-43d8-9dd2-3350885ccce5 => generated 1392 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:49:50.377152 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-97e075cd-6230-4a39-b550-e61a9f28c58b req-768ada0f-060c-4a6b-8b75-b9230f648505 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "202cbdb0-650d-43d8-9dd2-3350885ccce5", "name": "network-vif-plugged", "status": "completed", "tag": "c0b271e7-bd38-472f-9dfc-ffb5c31c93c7"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:49:50.388085 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-97e075cd-6230-4a39-b550-e61a9f28c58b req-768ada0f-060c-4a6b-8b75-b9230f648505 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:49:50.388584 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-97e075cd-6230-4a39-b550-e61a9f28c58b req-768ada0f-060c-4a6b-8b75-b9230f648505 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:49:50.389024 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-97e075cd-6230-4a39-b550-e61a9f28c58b req-768ada0f-060c-4a6b-8b75-b9230f648505 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:49:50.400935 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-97e075cd-6230-4a39-b550-e61a9f28c58b req-768ada0f-060c-4a6b-8b75-b9230f648505 service nova] Creating event network-vif-plugged:c0b271e7-bd38-472f-9dfc-ffb5c31c93c7 for instance 202cbdb0-650d-43d8-9dd2-3350885ccce5 on n-h1-851028-13 Oct 04 19:49:50.405965 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-97e075cd-6230-4a39-b550-e61a9f28c58b req-768ada0f-060c-4a6b-8b75-b9230f648505 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033086 Oct 04 19:49:50.406598 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3630/7634] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:49:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:49:50.462206 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-6a0f45ad-5f18-48e3-bfd0-a81b0dc54eac tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:49:50.462838 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-6a0f45ad-5f18-48e3-bfd0-a81b0dc54eac tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] [instance: 202cbdb0-650d-43d8-9dd2-3350885ccce5] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:49:50.469648 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6a0f45ad-5f18-48e3-bfd0-a81b0dc54eac tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:49:50.470153 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6a0f45ad-5f18-48e3-bfd0-a81b0dc54eac tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:49:50.470619 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6a0f45ad-5f18-48e3-bfd0-a81b0dc54eac tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:49:50.471363 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6a0f45ad-5f18-48e3-bfd0-a81b0dc54eac tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:49:50.471836 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6a0f45ad-5f18-48e3-bfd0-a81b0dc54eac tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:49:50.472277 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6a0f45ad-5f18-48e3-bfd0-a81b0dc54eac tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:49:50.607737 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-6a0f45ad-5f18-48e3-bfd0-a81b0dc54eac tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c616f37f7714bdaaba2ae66226f37d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8cddf77e654ca7a88b55acca131a45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:49:50.616086 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-6a0f45ad-5f18-48e3-bfd0-a81b0dc54eac tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] 10.222.0.43 "GET /compute/v2.1/servers/202cbdb0-650d-43d8-9dd2-3350885ccce5" status: 200 len: 1392 microversion: 2.1 time: 0.157946 Oct 04 19:49:50.616658 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 4005/7635] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:49:50 2022] GET /compute/v2.1/servers/202cbdb0-650d-43d8-9dd2-3350885ccce5 => generated 1392 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:49:51.636952 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=2 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:49:51.637873 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=6 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:49:51.643474 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-93cf9be0-58a0-4d6b-b600-ebc92a51442c tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:49:51.644192 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-93cf9be0-58a0-4d6b-b600-ebc92a51442c tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] [instance: 202cbdb0-650d-43d8-9dd2-3350885ccce5] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:49:51.651361 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-93cf9be0-58a0-4d6b-b600-ebc92a51442c tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:49:51.651858 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-93cf9be0-58a0-4d6b-b600-ebc92a51442c tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:49:51.652331 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-93cf9be0-58a0-4d6b-b600-ebc92a51442c tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:49:51.653047 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-93cf9be0-58a0-4d6b-b600-ebc92a51442c tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:49:51.653537 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-93cf9be0-58a0-4d6b-b600-ebc92a51442c tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:49:51.653970 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-93cf9be0-58a0-4d6b-b600-ebc92a51442c tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:49:52.063734 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-93cf9be0-58a0-4d6b-b600-ebc92a51442c tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c616f37f7714bdaaba2ae66226f37d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8cddf77e654ca7a88b55acca131a45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:49:52.071829 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-93cf9be0-58a0-4d6b-b600-ebc92a51442c tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] 10.222.0.43 "GET /compute/v2.1/servers/202cbdb0-650d-43d8-9dd2-3350885ccce5" status: 200 len: 1392 microversion: 2.1 time: 0.435858 Oct 04 19:49:52.072408 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3631/7636] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:49:51 2022] GET /compute/v2.1/servers/202cbdb0-650d-43d8-9dd2-3350885ccce5 => generated 1392 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:49:53.094714 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-fd650247-18c7-4f48-8cb0-fd451e18fe9f tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:49:53.095384 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-fd650247-18c7-4f48-8cb0-fd451e18fe9f tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] [instance: 202cbdb0-650d-43d8-9dd2-3350885ccce5] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:49:53.097290 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=6 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:49:53.099249 n-d-851028-13 devstack@n-api.service[123596]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 19:49:53.099395 n-d-851028-13 devstack@n-api.service[123596]: Tue Oct 4 19:49:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/202cbdb0-650d-43d8-9dd2-3350885ccce5 (ip 10.222.0.43) !!! Oct 04 19:49:53.100302 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=1 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:49:53.109371 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fd650247-18c7-4f48-8cb0-fd451e18fe9f tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:49:53.109884 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fd650247-18c7-4f48-8cb0-fd451e18fe9f tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:49:53.110346 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fd650247-18c7-4f48-8cb0-fd451e18fe9f tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:49:53.111062 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fd650247-18c7-4f48-8cb0-fd451e18fe9f tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:49:53.111551 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fd650247-18c7-4f48-8cb0-fd451e18fe9f tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:49:53.111983 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-fd650247-18c7-4f48-8cb0-fd451e18fe9f tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:49:53.352360 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-fd650247-18c7-4f48-8cb0-fd451e18fe9f tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c616f37f7714bdaaba2ae66226f37d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8cddf77e654ca7a88b55acca131a45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:49:53.360155 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-fd650247-18c7-4f48-8cb0-fd451e18fe9f tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] 10.222.0.43 "GET /compute/v2.1/servers/202cbdb0-650d-43d8-9dd2-3350885ccce5" status: 200 len: 1564 microversion: 2.1 time: 0.269412 Oct 04 19:49:53.361263 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 4006/7637] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:49:53 2022] GET /compute/v2.1/servers/202cbdb0-650d-43d8-9dd2-3350885ccce5 => generated 1564 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:49:53.383208 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-16bac377-feea-46b8-b526-e507018395d5 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:49:53.383833 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-16bac377-feea-46b8-b526-e507018395d5 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] [instance: 202cbdb0-650d-43d8-9dd2-3350885ccce5] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:49:53.387086 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:49:53.393496 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-16bac377-feea-46b8-b526-e507018395d5 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:49:53.393988 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-16bac377-feea-46b8-b526-e507018395d5 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:49:53.394436 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-16bac377-feea-46b8-b526-e507018395d5 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:49:53.395145 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-16bac377-feea-46b8-b526-e507018395d5 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:49:53.395611 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-16bac377-feea-46b8-b526-e507018395d5 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:49:53.396046 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-16bac377-feea-46b8-b526-e507018395d5 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:49:53.583372 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-16bac377-feea-46b8-b526-e507018395d5 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c616f37f7714bdaaba2ae66226f37d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8cddf77e654ca7a88b55acca131a45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:49:53.591126 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-16bac377-feea-46b8-b526-e507018395d5 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] 10.222.0.43 "GET /compute/v2.1/servers/202cbdb0-650d-43d8-9dd2-3350885ccce5" status: 200 len: 1564 microversion: 2.1 time: 0.211926 Oct 04 19:49:53.591719 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3632/7638] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:49:53 2022] GET /compute/v2.1/servers/202cbdb0-650d-43d8-9dd2-3350885ccce5 => generated 1564 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:49:55.163065 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-223ad2bd-2c66-44ca-9a4e-b2c23252b089 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:49:55.164492 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-223ad2bd-2c66-44ca-9a4e-b2c23252b089 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] [instance: 202cbdb0-650d-43d8-9dd2-3350885ccce5] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:49:55.165199 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-8ad9ed59-f2c5-438f-a328-043fb7c29899 req-84916bd3-5c21-4a3d-8b8c-5e1a92284705 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "202cbdb0-650d-43d8-9dd2-3350885ccce5", "tag": "c0b271e7-bd38-472f-9dfc-ffb5c31c93c7"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:49:55.171785 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-223ad2bd-2c66-44ca-9a4e-b2c23252b089 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:49:55.172542 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-223ad2bd-2c66-44ca-9a4e-b2c23252b089 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:49:55.173690 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-223ad2bd-2c66-44ca-9a4e-b2c23252b089 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:49:55.174647 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-223ad2bd-2c66-44ca-9a4e-b2c23252b089 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:49:55.175116 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-223ad2bd-2c66-44ca-9a4e-b2c23252b089 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:49:55.175805 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-223ad2bd-2c66-44ca-9a4e-b2c23252b089 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:49:55.178436 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-8ad9ed59-f2c5-438f-a328-043fb7c29899 req-84916bd3-5c21-4a3d-8b8c-5e1a92284705 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:49:55.178928 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-8ad9ed59-f2c5-438f-a328-043fb7c29899 req-84916bd3-5c21-4a3d-8b8c-5e1a92284705 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:49:55.179372 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-8ad9ed59-f2c5-438f-a328-043fb7c29899 req-84916bd3-5c21-4a3d-8b8c-5e1a92284705 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:49:55.193363 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-8ad9ed59-f2c5-438f-a328-043fb7c29899 req-84916bd3-5c21-4a3d-8b8c-5e1a92284705 service nova] Creating event network-changed:c0b271e7-bd38-472f-9dfc-ffb5c31c93c7 for instance 202cbdb0-650d-43d8-9dd2-3350885ccce5 on n-h1-851028-13 Oct 04 19:49:55.198803 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-8ad9ed59-f2c5-438f-a328-043fb7c29899 req-84916bd3-5c21-4a3d-8b8c-5e1a92284705 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037531 Oct 04 19:49:55.199970 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3633/7639] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:49:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:49:55.323488 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-223ad2bd-2c66-44ca-9a4e-b2c23252b089 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c616f37f7714bdaaba2ae66226f37d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8cddf77e654ca7a88b55acca131a45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:49:55.336747 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-223ad2bd-2c66-44ca-9a4e-b2c23252b089 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] 10.222.0.43 "GET /compute/v2.1/servers/202cbdb0-650d-43d8-9dd2-3350885ccce5" status: 200 len: 1564 microversion: 2.1 time: 0.177552 Oct 04 19:49:55.337330 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 4007/7640] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:49:55 2022] GET /compute/v2.1/servers/202cbdb0-650d-43d8-9dd2-3350885ccce5 => generated 1564 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:50:16.578199 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_api:SELECT=3 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:50:16.579022 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=38 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:50:16.583984 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-81690cc1-d4f5-43a3-a44f-e1551d1ee09b tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:50:16.586295 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-81690cc1-d4f5-43a3-a44f-e1551d1ee09b tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] [instance: 202cbdb0-650d-43d8-9dd2-3350885ccce5] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:50:16.593471 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-81690cc1-d4f5-43a3-a44f-e1551d1ee09b tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:50:16.593962 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-81690cc1-d4f5-43a3-a44f-e1551d1ee09b tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:50:16.594933 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-81690cc1-d4f5-43a3-a44f-e1551d1ee09b tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:50:16.595633 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-81690cc1-d4f5-43a3-a44f-e1551d1ee09b tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:50:16.596091 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-81690cc1-d4f5-43a3-a44f-e1551d1ee09b tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:50:16.596534 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-81690cc1-d4f5-43a3-a44f-e1551d1ee09b tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:50:16.647770 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-81690cc1-d4f5-43a3-a44f-e1551d1ee09b tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] 10.222.0.43 "POST /compute/v2.1/servers/202cbdb0-650d-43d8-9dd2-3350885ccce5/action" status: 200 len: 24571 microversion: 2.1 time: 0.071265 Oct 04 19:50:16.654582 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3634/7641] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 19:50:16 2022] POST /compute/v2.1/servers/202cbdb0-650d-43d8-9dd2-3350885ccce5/action => generated 24571 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 19:50:27.376461 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-007a371f-0985-4e09-90e4-93f072319c49 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:50:27.378875 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-007a371f-0985-4e09-90e4-93f072319c49 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] [instance: 202cbdb0-650d-43d8-9dd2-3350885ccce5] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:50:27.381313 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_api:SELECT=3 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:50:27.382002 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=42 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:50:27.388148 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-007a371f-0985-4e09-90e4-93f072319c49 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:50:27.388660 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-007a371f-0985-4e09-90e4-93f072319c49 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:50:27.389139 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-007a371f-0985-4e09-90e4-93f072319c49 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:50:27.389867 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-007a371f-0985-4e09-90e4-93f072319c49 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:50:27.390346 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-007a371f-0985-4e09-90e4-93f072319c49 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:50:27.390797 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-007a371f-0985-4e09-90e4-93f072319c49 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:50:27.463553 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-007a371f-0985-4e09-90e4-93f072319c49 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] 10.222.0.43 "POST /compute/v2.1/servers/202cbdb0-650d-43d8-9dd2-3350885ccce5/action" status: 202 len: 0 microversion: 2.1 time: 0.090940 Oct 04 19:50:27.464328 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 4008/7642] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 19:50:27 2022] POST /compute/v2.1/servers/202cbdb0-650d-43d8-9dd2-3350885ccce5/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:50:27.473774 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-a66a3421-76f8-4b2e-924a-9e0ff1889095 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:50:27.474486 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-a66a3421-76f8-4b2e-924a-9e0ff1889095 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] [instance: 202cbdb0-650d-43d8-9dd2-3350885ccce5] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:50:27.480676 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_api:SELECT=2 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:50:27.481461 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=4 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:50:27.483818 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a66a3421-76f8-4b2e-924a-9e0ff1889095 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:50:27.484403 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a66a3421-76f8-4b2e-924a-9e0ff1889095 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:50:27.484883 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a66a3421-76f8-4b2e-924a-9e0ff1889095 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:50:27.485734 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a66a3421-76f8-4b2e-924a-9e0ff1889095 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:50:27.486172 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a66a3421-76f8-4b2e-924a-9e0ff1889095 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:50:27.486689 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a66a3421-76f8-4b2e-924a-9e0ff1889095 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:50:27.700591 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-a66a3421-76f8-4b2e-924a-9e0ff1889095 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c616f37f7714bdaaba2ae66226f37d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8cddf77e654ca7a88b55acca131a45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:50:27.709219 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-a66a3421-76f8-4b2e-924a-9e0ff1889095 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] 10.222.0.43 "GET /compute/v2.1/servers/202cbdb0-650d-43d8-9dd2-3350885ccce5" status: 200 len: 1675 microversion: 2.1 time: 0.240350 Oct 04 19:50:27.709804 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3635/7643] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:50:27 2022] GET /compute/v2.1/servers/202cbdb0-650d-43d8-9dd2-3350885ccce5 => generated 1675 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:50:28.736088 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-e39b076f-3ad4-4a3f-8ba0-f344a197f56a tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:50:28.737076 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-e39b076f-3ad4-4a3f-8ba0-f344a197f56a tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] [instance: 202cbdb0-650d-43d8-9dd2-3350885ccce5] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:50:28.743338 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e39b076f-3ad4-4a3f-8ba0-f344a197f56a tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:50:28.743841 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e39b076f-3ad4-4a3f-8ba0-f344a197f56a tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:50:28.744298 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e39b076f-3ad4-4a3f-8ba0-f344a197f56a tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:50:28.745006 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e39b076f-3ad4-4a3f-8ba0-f344a197f56a tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:50:28.745508 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e39b076f-3ad4-4a3f-8ba0-f344a197f56a tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:50:28.745955 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e39b076f-3ad4-4a3f-8ba0-f344a197f56a tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:50:28.877236 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-e39b076f-3ad4-4a3f-8ba0-f344a197f56a tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c616f37f7714bdaaba2ae66226f37d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8cddf77e654ca7a88b55acca131a45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:50:28.885016 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-e39b076f-3ad4-4a3f-8ba0-f344a197f56a tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] 10.222.0.43 "GET /compute/v2.1/servers/202cbdb0-650d-43d8-9dd2-3350885ccce5" status: 200 len: 1680 microversion: 2.1 time: 0.154470 Oct 04 19:50:28.885619 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 4009/7644] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:50:28 2022] GET /compute/v2.1/servers/202cbdb0-650d-43d8-9dd2-3350885ccce5 => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:50:29.908535 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-761cb0a7-f21d-4b72-94bd-9aa06096d104 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:50:29.909180 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-761cb0a7-f21d-4b72-94bd-9aa06096d104 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] [instance: 202cbdb0-650d-43d8-9dd2-3350885ccce5] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:50:29.916775 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-761cb0a7-f21d-4b72-94bd-9aa06096d104 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:50:29.917295 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-761cb0a7-f21d-4b72-94bd-9aa06096d104 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:50:29.917742 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-761cb0a7-f21d-4b72-94bd-9aa06096d104 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:50:29.918443 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-761cb0a7-f21d-4b72-94bd-9aa06096d104 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:50:29.918907 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-761cb0a7-f21d-4b72-94bd-9aa06096d104 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:50:29.919345 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-761cb0a7-f21d-4b72-94bd-9aa06096d104 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:50:30.052155 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-761cb0a7-f21d-4b72-94bd-9aa06096d104 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c616f37f7714bdaaba2ae66226f37d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8cddf77e654ca7a88b55acca131a45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:50:30.060091 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-761cb0a7-f21d-4b72-94bd-9aa06096d104 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] 10.222.0.43 "GET /compute/v2.1/servers/202cbdb0-650d-43d8-9dd2-3350885ccce5" status: 200 len: 1680 microversion: 2.1 time: 0.155964 Oct 04 19:50:30.060665 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3636/7645] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:50:29 2022] GET /compute/v2.1/servers/202cbdb0-650d-43d8-9dd2-3350885ccce5 => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:50:31.083558 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-9b2f356b-5c6a-4ebd-9517-ae7183bd8743 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:50:31.084193 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-9b2f356b-5c6a-4ebd-9517-ae7183bd8743 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] [instance: 202cbdb0-650d-43d8-9dd2-3350885ccce5] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:50:31.091231 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9b2f356b-5c6a-4ebd-9517-ae7183bd8743 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:50:31.091737 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9b2f356b-5c6a-4ebd-9517-ae7183bd8743 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:50:31.092203 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9b2f356b-5c6a-4ebd-9517-ae7183bd8743 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:50:31.092917 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9b2f356b-5c6a-4ebd-9517-ae7183bd8743 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:50:31.093413 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9b2f356b-5c6a-4ebd-9517-ae7183bd8743 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:50:31.093861 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9b2f356b-5c6a-4ebd-9517-ae7183bd8743 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:50:31.230892 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-9b2f356b-5c6a-4ebd-9517-ae7183bd8743 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c616f37f7714bdaaba2ae66226f37d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8cddf77e654ca7a88b55acca131a45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:50:31.239827 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-9b2f356b-5c6a-4ebd-9517-ae7183bd8743 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] 10.222.0.43 "GET /compute/v2.1/servers/202cbdb0-650d-43d8-9dd2-3350885ccce5" status: 200 len: 1680 microversion: 2.1 time: 0.160466 Oct 04 19:50:31.240395 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 4010/7646] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:50:31 2022] GET /compute/v2.1/servers/202cbdb0-650d-43d8-9dd2-3350885ccce5 => generated 1680 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:50:32.262964 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-60bf9402-b2ab-437d-82fe-0050f16f1192 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:50:32.263581 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-60bf9402-b2ab-437d-82fe-0050f16f1192 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] [instance: 202cbdb0-650d-43d8-9dd2-3350885ccce5] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:50:32.270940 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-60bf9402-b2ab-437d-82fe-0050f16f1192 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:50:32.271422 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-60bf9402-b2ab-437d-82fe-0050f16f1192 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:50:32.272119 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-60bf9402-b2ab-437d-82fe-0050f16f1192 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:50:32.272811 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-60bf9402-b2ab-437d-82fe-0050f16f1192 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:50:32.273299 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-60bf9402-b2ab-437d-82fe-0050f16f1192 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:50:32.273730 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-60bf9402-b2ab-437d-82fe-0050f16f1192 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:50:32.401650 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-60bf9402-b2ab-437d-82fe-0050f16f1192 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c616f37f7714bdaaba2ae66226f37d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8cddf77e654ca7a88b55acca131a45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:50:32.409441 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-60bf9402-b2ab-437d-82fe-0050f16f1192 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] 10.222.0.43 "GET /compute/v2.1/servers/202cbdb0-650d-43d8-9dd2-3350885ccce5" status: 200 len: 1680 microversion: 2.1 time: 0.150415 Oct 04 19:50:32.410007 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3637/7647] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:50:32 2022] GET /compute/v2.1/servers/202cbdb0-650d-43d8-9dd2-3350885ccce5 => generated 1680 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:50:33.432893 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-3caf64d0-abf5-4c07-b991-241cebafb909 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:50:33.433552 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-3caf64d0-abf5-4c07-b991-241cebafb909 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] [instance: 202cbdb0-650d-43d8-9dd2-3350885ccce5] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:50:33.440348 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3caf64d0-abf5-4c07-b991-241cebafb909 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:50:33.440849 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3caf64d0-abf5-4c07-b991-241cebafb909 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:50:33.441339 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3caf64d0-abf5-4c07-b991-241cebafb909 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:50:33.442052 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3caf64d0-abf5-4c07-b991-241cebafb909 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:50:33.442524 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3caf64d0-abf5-4c07-b991-241cebafb909 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:50:33.442974 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3caf64d0-abf5-4c07-b991-241cebafb909 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:50:33.575619 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-3caf64d0-abf5-4c07-b991-241cebafb909 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c616f37f7714bdaaba2ae66226f37d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8cddf77e654ca7a88b55acca131a45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:50:33.584380 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-3caf64d0-abf5-4c07-b991-241cebafb909 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] 10.222.0.43 "GET /compute/v2.1/servers/202cbdb0-650d-43d8-9dd2-3350885ccce5" status: 200 len: 1680 microversion: 2.1 time: 0.155437 Oct 04 19:50:33.584965 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 4011/7648] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:50:33 2022] GET /compute/v2.1/servers/202cbdb0-650d-43d8-9dd2-3350885ccce5 => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:50:34.607366 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-bdf151c6-f7fb-418c-8ab9-8b5559209807 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:50:34.607980 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-bdf151c6-f7fb-418c-8ab9-8b5559209807 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] [instance: 202cbdb0-650d-43d8-9dd2-3350885ccce5] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:50:34.615400 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bdf151c6-f7fb-418c-8ab9-8b5559209807 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:50:34.615875 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bdf151c6-f7fb-418c-8ab9-8b5559209807 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:50:34.616310 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bdf151c6-f7fb-418c-8ab9-8b5559209807 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:50:34.616997 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bdf151c6-f7fb-418c-8ab9-8b5559209807 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:50:34.617478 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bdf151c6-f7fb-418c-8ab9-8b5559209807 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:50:34.617900 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bdf151c6-f7fb-418c-8ab9-8b5559209807 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:50:34.748744 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-bdf151c6-f7fb-418c-8ab9-8b5559209807 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c616f37f7714bdaaba2ae66226f37d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8cddf77e654ca7a88b55acca131a45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:50:34.756496 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-bdf151c6-f7fb-418c-8ab9-8b5559209807 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] 10.222.0.43 "GET /compute/v2.1/servers/202cbdb0-650d-43d8-9dd2-3350885ccce5" status: 200 len: 1680 microversion: 2.1 time: 0.153125 Oct 04 19:50:34.757063 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3638/7649] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:50:34 2022] GET /compute/v2.1/servers/202cbdb0-650d-43d8-9dd2-3350885ccce5 => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:50:35.780494 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-de5de25a-b9b2-4c1a-9564-638484978f06 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:50:35.781145 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-de5de25a-b9b2-4c1a-9564-638484978f06 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] [instance: 202cbdb0-650d-43d8-9dd2-3350885ccce5] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:50:35.788031 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-de5de25a-b9b2-4c1a-9564-638484978f06 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:50:35.788533 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-de5de25a-b9b2-4c1a-9564-638484978f06 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:50:35.788990 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-de5de25a-b9b2-4c1a-9564-638484978f06 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:50:35.789728 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-de5de25a-b9b2-4c1a-9564-638484978f06 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:50:35.790203 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-de5de25a-b9b2-4c1a-9564-638484978f06 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:50:35.790649 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-de5de25a-b9b2-4c1a-9564-638484978f06 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:50:35.923426 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-de5de25a-b9b2-4c1a-9564-638484978f06 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c616f37f7714bdaaba2ae66226f37d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8cddf77e654ca7a88b55acca131a45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:50:35.931234 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-de5de25a-b9b2-4c1a-9564-638484978f06 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] 10.222.0.43 "GET /compute/v2.1/servers/202cbdb0-650d-43d8-9dd2-3350885ccce5" status: 200 len: 1680 microversion: 2.1 time: 0.154736 Oct 04 19:50:35.931803 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 4012/7650] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:50:35 2022] GET /compute/v2.1/servers/202cbdb0-650d-43d8-9dd2-3350885ccce5 => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:50:36.958674 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-711ea9e0-a5d7-4fde-b3bf-3923b1571290 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:50:36.959300 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-711ea9e0-a5d7-4fde-b3bf-3923b1571290 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] [instance: 202cbdb0-650d-43d8-9dd2-3350885ccce5] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:50:36.965803 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-711ea9e0-a5d7-4fde-b3bf-3923b1571290 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:50:36.966300 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-711ea9e0-a5d7-4fde-b3bf-3923b1571290 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:50:36.966816 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-711ea9e0-a5d7-4fde-b3bf-3923b1571290 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:50:36.967587 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-711ea9e0-a5d7-4fde-b3bf-3923b1571290 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:50:36.968121 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-711ea9e0-a5d7-4fde-b3bf-3923b1571290 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:50:36.968558 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-711ea9e0-a5d7-4fde-b3bf-3923b1571290 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:50:37.101738 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-711ea9e0-a5d7-4fde-b3bf-3923b1571290 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c616f37f7714bdaaba2ae66226f37d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8cddf77e654ca7a88b55acca131a45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:50:37.109514 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-711ea9e0-a5d7-4fde-b3bf-3923b1571290 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] 10.222.0.43 "GET /compute/v2.1/servers/202cbdb0-650d-43d8-9dd2-3350885ccce5" status: 200 len: 1680 microversion: 2.1 time: 0.155198 Oct 04 19:50:37.110103 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3639/7651] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:50:36 2022] GET /compute/v2.1/servers/202cbdb0-650d-43d8-9dd2-3350885ccce5 => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:50:38.131906 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-87ec4e3e-678a-4f37-8389-ea76598dc92f tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:50:38.132624 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-87ec4e3e-678a-4f37-8389-ea76598dc92f tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] [instance: 202cbdb0-650d-43d8-9dd2-3350885ccce5] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:50:38.139165 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-87ec4e3e-678a-4f37-8389-ea76598dc92f tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:50:38.139670 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-87ec4e3e-678a-4f37-8389-ea76598dc92f tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:50:38.140132 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-87ec4e3e-678a-4f37-8389-ea76598dc92f tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:50:38.140887 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-87ec4e3e-678a-4f37-8389-ea76598dc92f tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:50:38.141388 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-87ec4e3e-678a-4f37-8389-ea76598dc92f tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:50:38.141839 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-87ec4e3e-678a-4f37-8389-ea76598dc92f tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:50:38.272988 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-87ec4e3e-678a-4f37-8389-ea76598dc92f tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c616f37f7714bdaaba2ae66226f37d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8cddf77e654ca7a88b55acca131a45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:50:38.280787 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-87ec4e3e-678a-4f37-8389-ea76598dc92f tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] 10.222.0.43 "GET /compute/v2.1/servers/202cbdb0-650d-43d8-9dd2-3350885ccce5" status: 200 len: 1680 microversion: 2.1 time: 0.152861 Oct 04 19:50:38.281882 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 4013/7652] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:50:38 2022] GET /compute/v2.1/servers/202cbdb0-650d-43d8-9dd2-3350885ccce5 => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:50:39.304559 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-7a8529a8-a00f-41f5-a43a-97f5dcbb6974 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:50:39.305149 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-7a8529a8-a00f-41f5-a43a-97f5dcbb6974 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] [instance: 202cbdb0-650d-43d8-9dd2-3350885ccce5] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:50:39.312058 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7a8529a8-a00f-41f5-a43a-97f5dcbb6974 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:50:39.313148 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7a8529a8-a00f-41f5-a43a-97f5dcbb6974 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:50:39.313601 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7a8529a8-a00f-41f5-a43a-97f5dcbb6974 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:50:39.314299 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7a8529a8-a00f-41f5-a43a-97f5dcbb6974 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:50:39.314757 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7a8529a8-a00f-41f5-a43a-97f5dcbb6974 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:50:39.315187 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7a8529a8-a00f-41f5-a43a-97f5dcbb6974 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:50:39.444482 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-7a8529a8-a00f-41f5-a43a-97f5dcbb6974 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c616f37f7714bdaaba2ae66226f37d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8cddf77e654ca7a88b55acca131a45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:50:39.452202 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-7a8529a8-a00f-41f5-a43a-97f5dcbb6974 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] 10.222.0.43 "GET /compute/v2.1/servers/202cbdb0-650d-43d8-9dd2-3350885ccce5" status: 200 len: 1680 microversion: 2.1 time: 0.151696 Oct 04 19:50:39.453002 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3640/7653] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:50:39 2022] GET /compute/v2.1/servers/202cbdb0-650d-43d8-9dd2-3350885ccce5 => generated 1680 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:50:40.475968 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-176b7b3a-c109-41de-868b-46c7ab1969f4 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:50:40.476633 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-176b7b3a-c109-41de-868b-46c7ab1969f4 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] [instance: 202cbdb0-650d-43d8-9dd2-3350885ccce5] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:50:40.483569 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-176b7b3a-c109-41de-868b-46c7ab1969f4 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:50:40.484076 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-176b7b3a-c109-41de-868b-46c7ab1969f4 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:50:40.485154 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-176b7b3a-c109-41de-868b-46c7ab1969f4 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:50:40.485955 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-176b7b3a-c109-41de-868b-46c7ab1969f4 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:50:40.486448 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-176b7b3a-c109-41de-868b-46c7ab1969f4 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:50:40.487035 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-176b7b3a-c109-41de-868b-46c7ab1969f4 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:50:40.617504 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-176b7b3a-c109-41de-868b-46c7ab1969f4 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c616f37f7714bdaaba2ae66226f37d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8cddf77e654ca7a88b55acca131a45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:50:40.625351 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-176b7b3a-c109-41de-868b-46c7ab1969f4 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] 10.222.0.43 "GET /compute/v2.1/servers/202cbdb0-650d-43d8-9dd2-3350885ccce5" status: 200 len: 1680 microversion: 2.1 time: 0.153404 Oct 04 19:50:40.625926 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 4014/7654] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:50:40 2022] GET /compute/v2.1/servers/202cbdb0-650d-43d8-9dd2-3350885ccce5 => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:50:41.649179 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-5d02af0e-c445-42e1-856b-6229702b8218 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:50:41.649805 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-5d02af0e-c445-42e1-856b-6229702b8218 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] [instance: 202cbdb0-650d-43d8-9dd2-3350885ccce5] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:50:41.656672 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5d02af0e-c445-42e1-856b-6229702b8218 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:50:41.657195 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5d02af0e-c445-42e1-856b-6229702b8218 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:50:41.657642 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5d02af0e-c445-42e1-856b-6229702b8218 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:50:41.658339 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5d02af0e-c445-42e1-856b-6229702b8218 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:50:41.658801 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5d02af0e-c445-42e1-856b-6229702b8218 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:50:41.659234 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5d02af0e-c445-42e1-856b-6229702b8218 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:50:41.796141 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-5d02af0e-c445-42e1-856b-6229702b8218 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c616f37f7714bdaaba2ae66226f37d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8cddf77e654ca7a88b55acca131a45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:50:41.804562 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-5d02af0e-c445-42e1-856b-6229702b8218 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] 10.222.0.43 "GET /compute/v2.1/servers/202cbdb0-650d-43d8-9dd2-3350885ccce5" status: 200 len: 1680 microversion: 2.1 time: 0.159330 Oct 04 19:50:41.805151 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3641/7655] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:50:41 2022] GET /compute/v2.1/servers/202cbdb0-650d-43d8-9dd2-3350885ccce5 => generated 1680 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:50:42.828040 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-af01de16-04f5-4ed9-8621-2212c008e3a4 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:50:42.828691 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-af01de16-04f5-4ed9-8621-2212c008e3a4 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] [instance: 202cbdb0-650d-43d8-9dd2-3350885ccce5] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:50:42.836907 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-af01de16-04f5-4ed9-8621-2212c008e3a4 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:50:42.837448 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-af01de16-04f5-4ed9-8621-2212c008e3a4 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:50:42.837913 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-af01de16-04f5-4ed9-8621-2212c008e3a4 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:50:42.838637 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-af01de16-04f5-4ed9-8621-2212c008e3a4 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:50:42.839114 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-af01de16-04f5-4ed9-8621-2212c008e3a4 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:50:42.839565 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-af01de16-04f5-4ed9-8621-2212c008e3a4 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:50:42.968886 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-af01de16-04f5-4ed9-8621-2212c008e3a4 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c616f37f7714bdaaba2ae66226f37d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8cddf77e654ca7a88b55acca131a45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:50:42.976682 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-af01de16-04f5-4ed9-8621-2212c008e3a4 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] 10.222.0.43 "GET /compute/v2.1/servers/202cbdb0-650d-43d8-9dd2-3350885ccce5" status: 200 len: 1680 microversion: 2.1 time: 0.152722 Oct 04 19:50:42.977279 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 4015/7656] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:50:42 2022] GET /compute/v2.1/servers/202cbdb0-650d-43d8-9dd2-3350885ccce5 => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:50:44.000494 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-e67e6976-7c6b-48c0-ab4b-7c5f670844f4 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:50:44.001261 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-e67e6976-7c6b-48c0-ab4b-7c5f670844f4 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] [instance: 202cbdb0-650d-43d8-9dd2-3350885ccce5] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:50:44.008261 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e67e6976-7c6b-48c0-ab4b-7c5f670844f4 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:50:44.008686 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e67e6976-7c6b-48c0-ab4b-7c5f670844f4 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:50:44.009148 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e67e6976-7c6b-48c0-ab4b-7c5f670844f4 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:50:44.009853 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e67e6976-7c6b-48c0-ab4b-7c5f670844f4 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:50:44.010334 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e67e6976-7c6b-48c0-ab4b-7c5f670844f4 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:50:44.010769 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e67e6976-7c6b-48c0-ab4b-7c5f670844f4 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:50:44.142436 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-e67e6976-7c6b-48c0-ab4b-7c5f670844f4 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c616f37f7714bdaaba2ae66226f37d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8cddf77e654ca7a88b55acca131a45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:50:44.150350 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-e67e6976-7c6b-48c0-ab4b-7c5f670844f4 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] 10.222.0.43 "GET /compute/v2.1/servers/202cbdb0-650d-43d8-9dd2-3350885ccce5" status: 200 len: 1683 microversion: 2.1 time: 0.154440 Oct 04 19:50:44.150940 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3642/7657] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:50:43 2022] GET /compute/v2.1/servers/202cbdb0-650d-43d8-9dd2-3350885ccce5 => generated 1683 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:51:08.338489 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-499a47ca-dc5b-4975-a8a7-7b41f802cfad tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:51:08.340733 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-499a47ca-dc5b-4975-a8a7-7b41f802cfad tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] [instance: 202cbdb0-650d-43d8-9dd2-3350885ccce5] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:51:08.343806 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_api:SELECT=16 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:51:08.344493 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:51:08.350338 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-499a47ca-dc5b-4975-a8a7-7b41f802cfad tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:51:08.350851 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-499a47ca-dc5b-4975-a8a7-7b41f802cfad tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:51:08.351315 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-499a47ca-dc5b-4975-a8a7-7b41f802cfad tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:51:08.352040 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-499a47ca-dc5b-4975-a8a7-7b41f802cfad tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:51:08.352517 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-499a47ca-dc5b-4975-a8a7-7b41f802cfad tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:51:08.352965 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-499a47ca-dc5b-4975-a8a7-7b41f802cfad tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:51:08.410443 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-499a47ca-dc5b-4975-a8a7-7b41f802cfad tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] 10.222.0.43 "POST /compute/v2.1/servers/202cbdb0-650d-43d8-9dd2-3350885ccce5/action" status: 200 len: 69688 microversion: 2.1 time: 0.075833 Oct 04 19:51:08.411090 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 4016/7658] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 19:51:08 2022] POST /compute/v2.1/servers/202cbdb0-650d-43d8-9dd2-3350885ccce5/action => generated 69688 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 19:51:15.684770 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-7f77b036-899c-4593-ba48-217677818b7e tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:51:15.685374 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-7f77b036-899c-4593-ba48-217677818b7e tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] [instance: 202cbdb0-650d-43d8-9dd2-3350885ccce5] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:51:15.687417 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_api:SELECT=16 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:51:15.688118 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=48 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:51:15.688325 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-6f7f8fda-e213-426c-b010-5571e6bbf01e req-827843bf-dfe8-4e52-80c8-322c9521125b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "202cbdb0-650d-43d8-9dd2-3350885ccce5", "tag": "c0b271e7-bd38-472f-9dfc-ffb5c31c93c7"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:51:15.695186 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7f77b036-899c-4593-ba48-217677818b7e tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:51:15.695685 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7f77b036-899c-4593-ba48-217677818b7e tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:51:15.696127 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7f77b036-899c-4593-ba48-217677818b7e tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:51:15.696842 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7f77b036-899c-4593-ba48-217677818b7e tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:51:15.697779 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7f77b036-899c-4593-ba48-217677818b7e tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:51:15.697779 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7f77b036-899c-4593-ba48-217677818b7e tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:51:15.700403 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-6f7f8fda-e213-426c-b010-5571e6bbf01e req-827843bf-dfe8-4e52-80c8-322c9521125b service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:51:15.701025 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-6f7f8fda-e213-426c-b010-5571e6bbf01e req-827843bf-dfe8-4e52-80c8-322c9521125b service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:51:15.701941 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-6f7f8fda-e213-426c-b010-5571e6bbf01e req-827843bf-dfe8-4e52-80c8-322c9521125b service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:51:15.713602 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-6f7f8fda-e213-426c-b010-5571e6bbf01e req-827843bf-dfe8-4e52-80c8-322c9521125b service nova] Creating event network-changed:c0b271e7-bd38-472f-9dfc-ffb5c31c93c7 for instance 202cbdb0-650d-43d8-9dd2-3350885ccce5 on n-h1-851028-13 Oct 04 19:51:15.719490 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-6f7f8fda-e213-426c-b010-5571e6bbf01e req-827843bf-dfe8-4e52-80c8-322c9521125b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036175 Oct 04 19:51:15.720393 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 4017/7659] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:51:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:51:15.727544 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-7f77b036-899c-4593-ba48-217677818b7e tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] [instance: 202cbdb0-650d-43d8-9dd2-3350885ccce5] Going to try to terminate instance {{(pid=123595) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 19:51:15.817371 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-7f77b036-899c-4593-ba48-217677818b7e tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] 10.222.0.43 "DELETE /compute/v2.1/servers/202cbdb0-650d-43d8-9dd2-3350885ccce5" status: 204 len: 0 microversion: 2.1 time: 0.136711 Oct 04 19:51:15.818006 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3643/7660] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 19:51:15 2022] DELETE /compute/v2.1/servers/202cbdb0-650d-43d8-9dd2-3350885ccce5 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:51:15.827918 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-91c5c1b0-7ed4-4886-a82e-33bfcb759fa6 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:51:15.828789 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-91c5c1b0-7ed4-4886-a82e-33bfcb759fa6 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] [instance: 202cbdb0-650d-43d8-9dd2-3350885ccce5] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:51:15.840251 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-91c5c1b0-7ed4-4886-a82e-33bfcb759fa6 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:51:15.840864 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-91c5c1b0-7ed4-4886-a82e-33bfcb759fa6 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:51:15.841433 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-91c5c1b0-7ed4-4886-a82e-33bfcb759fa6 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:51:15.842382 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-91c5c1b0-7ed4-4886-a82e-33bfcb759fa6 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:51:15.842958 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-91c5c1b0-7ed4-4886-a82e-33bfcb759fa6 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:51:15.844181 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-91c5c1b0-7ed4-4886-a82e-33bfcb759fa6 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:51:15.992366 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-91c5c1b0-7ed4-4886-a82e-33bfcb759fa6 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c616f37f7714bdaaba2ae66226f37d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8cddf77e654ca7a88b55acca131a45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:51:16.000482 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-91c5c1b0-7ed4-4886-a82e-33bfcb759fa6 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] 10.222.0.43 "GET /compute/v2.1/servers/202cbdb0-650d-43d8-9dd2-3350885ccce5" status: 200 len: 1689 microversion: 2.1 time: 0.177603 Oct 04 19:51:16.001184 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 4018/7661] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:51:15 2022] GET /compute/v2.1/servers/202cbdb0-650d-43d8-9dd2-3350885ccce5 => generated 1689 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:51:17.025221 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-e072ed5e-33a1-41b4-88b1-69a41c441c8f tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:51:17.025829 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-e072ed5e-33a1-41b4-88b1-69a41c441c8f tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] [instance: 202cbdb0-650d-43d8-9dd2-3350885ccce5] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:51:17.033325 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e072ed5e-33a1-41b4-88b1-69a41c441c8f tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:51:17.033808 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e072ed5e-33a1-41b4-88b1-69a41c441c8f tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:51:17.034249 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e072ed5e-33a1-41b4-88b1-69a41c441c8f tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:51:17.034941 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e072ed5e-33a1-41b4-88b1-69a41c441c8f tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:51:17.035395 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e072ed5e-33a1-41b4-88b1-69a41c441c8f tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:51:17.035822 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e072ed5e-33a1-41b4-88b1-69a41c441c8f tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:51:17.232212 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-e072ed5e-33a1-41b4-88b1-69a41c441c8f tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c616f37f7714bdaaba2ae66226f37d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8cddf77e654ca7a88b55acca131a45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:51:17.240756 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-e072ed5e-33a1-41b4-88b1-69a41c441c8f tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] 10.222.0.43 "GET /compute/v2.1/servers/202cbdb0-650d-43d8-9dd2-3350885ccce5" status: 200 len: 1689 microversion: 2.1 time: 0.219848 Oct 04 19:51:17.241412 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3644/7662] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:51:17 2022] GET /compute/v2.1/servers/202cbdb0-650d-43d8-9dd2-3350885ccce5 => generated 1689 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:51:18.263815 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-3fa5af2b-9758-4585-817c-efd801efac03 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:51:18.264466 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-3fa5af2b-9758-4585-817c-efd801efac03 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] [instance: 202cbdb0-650d-43d8-9dd2-3350885ccce5] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:51:18.271735 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3fa5af2b-9758-4585-817c-efd801efac03 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:51:18.272232 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3fa5af2b-9758-4585-817c-efd801efac03 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:51:18.272673 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3fa5af2b-9758-4585-817c-efd801efac03 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:51:18.273403 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3fa5af2b-9758-4585-817c-efd801efac03 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:51:18.273865 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3fa5af2b-9758-4585-817c-efd801efac03 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:51:18.274297 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3fa5af2b-9758-4585-817c-efd801efac03 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:51:18.303171 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-5c18f524-6861-4822-9868-10ae50a39bdf req-62920c35-1d30-4c7c-9dde-5704aa1e8e70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "202cbdb0-650d-43d8-9dd2-3350885ccce5", "name": "network-vif-deleted", "tag": "c0b271e7-bd38-472f-9dfc-ffb5c31c93c7"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:51:18.313557 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-5c18f524-6861-4822-9868-10ae50a39bdf req-62920c35-1d30-4c7c-9dde-5704aa1e8e70 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:51:18.314058 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-5c18f524-6861-4822-9868-10ae50a39bdf req-62920c35-1d30-4c7c-9dde-5704aa1e8e70 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:51:18.314711 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-5c18f524-6861-4822-9868-10ae50a39bdf req-62920c35-1d30-4c7c-9dde-5704aa1e8e70 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:51:18.326667 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-5c18f524-6861-4822-9868-10ae50a39bdf req-62920c35-1d30-4c7c-9dde-5704aa1e8e70 service nova] Creating event network-vif-deleted:c0b271e7-bd38-472f-9dfc-ffb5c31c93c7 for instance 202cbdb0-650d-43d8-9dd2-3350885ccce5 on n-h1-851028-13 Oct 04 19:51:18.331913 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-5c18f524-6861-4822-9868-10ae50a39bdf req-62920c35-1d30-4c7c-9dde-5704aa1e8e70 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093297 Oct 04 19:51:18.332599 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 4019/7663] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:51:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:51:18.363376 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-3fa5af2b-9758-4585-817c-efd801efac03 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c616f37f7714bdaaba2ae66226f37d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8cddf77e654ca7a88b55acca131a45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:51:18.372264 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-3fa5af2b-9758-4585-817c-efd801efac03 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] 10.222.0.43 "GET /compute/v2.1/servers/202cbdb0-650d-43d8-9dd2-3350885ccce5" status: 200 len: 1351 microversion: 2.1 time: 0.112346 Oct 04 19:51:18.372874 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3645/7664] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:51:18 2022] GET /compute/v2.1/servers/202cbdb0-650d-43d8-9dd2-3350885ccce5 => generated 1351 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:51:19.396848 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-6960e833-1408-4ca5-af86-19d4adbf363f tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:51:19.397606 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-6960e833-1408-4ca5-af86-19d4adbf363f tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] [instance: 202cbdb0-650d-43d8-9dd2-3350885ccce5] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:51:19.403828 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6960e833-1408-4ca5-af86-19d4adbf363f tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:51:19.404331 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6960e833-1408-4ca5-af86-19d4adbf363f tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:51:19.404791 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6960e833-1408-4ca5-af86-19d4adbf363f tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:51:19.405548 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6960e833-1408-4ca5-af86-19d4adbf363f tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:51:19.406009 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6960e833-1408-4ca5-af86-19d4adbf363f tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:51:19.406456 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6960e833-1408-4ca5-af86-19d4adbf363f tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:51:19.419785 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-6960e833-1408-4ca5-af86-19d4adbf363f tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] HTTP exception thrown: Instance 202cbdb0-650d-43d8-9dd2-3350885ccce5 could not be found. Oct 04 19:51:19.421502 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-6960e833-1408-4ca5-af86-19d4adbf363f tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Request method failure captured: Oct 04 19:51:19.421502 n-d-851028-13 devstack@n-api.service[123596]: request: GET /compute/v2.1/servers/202cbdb0-650d-43d8-9dd2-3350885ccce5 HTTP/1.1 Oct 04 19:51:19.421502 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 19:51:19.421502 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 19:51:19.421502 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 19:51:19.421502 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 19:51:19.421502 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 19:51:19.421502 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 19:51:19.421502 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 19:51:19.421502 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 19:51:19.421502 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPI4MZexuhXm6PsbDTE0mN_HzaWvpyBNcmZcptu-WN0BUo7VbC1tcPqUVzrRf31db8M0EWQ8d_sfA5FFL6AhajMMcCPlTBrfm9fKnWc8kbZzl3TY06xFuGGx0ZPCeDpUjJED_TcND6oWmolrrMBlfCNdyr-yMj_WCseJ7TPmrL_dgAc0 Oct 04 19:51:19.421502 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 19:51:19.421502 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 19:51:19.421502 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 19:51:19.421502 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 19:51:19.421502 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 19:51:19.421502 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 19:51:19.421502 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: bc8cddf77e654ca7a88b55acca131a45 Oct 04 19:51:19.421502 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-238299873 Oct 04 19:51:19.421502 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 19:51:19.421502 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 19:51:19.421502 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/bc8cddf77e654ca7a88b55acca131a45"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_bc8cddf77e654ca7a88b55acca131a45"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/bc8cddf77e654ca7a88b55acca131a45"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/bc8cddf77e654ca7a88b55acca131a45"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 19:51:19.421502 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-TestNetworkAdvancedServerOps-238299873 Oct 04 19:51:19.421502 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: bc8cddf77e654ca7a88b55acca131a45 Oct 04 19:51:19.421502 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-238299873 Oct 04 19:51:19.421502 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-TestNetworkAdvancedServerOps-238299873-project Oct 04 19:51:19.421502 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 19:51:19.421502 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 19:51:19.421502 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 6c616f37f7714bdaaba2ae66226f37d8 Oct 04 19:51:19.421502 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-TestNetworkAdvancedServerOps-238299873-project Oct 04 19:51:19.421502 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 19:51:19.421502 n-d-851028-13 devstack@n-api.service[123596]: exception: Instance 202cbdb0-650d-43d8-9dd2-3350885ccce5 could not be found. Oct 04 19:51:19.421502 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': '202cbdb0-650d-43d8-9dd2-3350885ccce5'} Oct 04 19:51:19.421502 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:51:19.421502 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:51:19.421502 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:51:19.421502 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:51:19.421502 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:51:19.421502 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:51:19.421502 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:51:19.421502 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:51:19.421502 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:51:19.421502 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:51:19.421502 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 202cbdb0-650d-43d8-9dd2-3350885ccce5 could not be found. Oct 04 19:51:19.421502 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:51:19.421502 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:51:19.421502 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:51:19.421502 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:51:19.421502 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:51:19.421502 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:51:19.421502 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:51:19.421502 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:51:19.421502 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:51:19.421502 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:51:19.421502 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:51:19.421502 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:51:19.421502 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:51:19.421502 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:51:19.421502 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:51:19.421502 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:51:19.421502 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 202cbdb0-650d-43d8-9dd2-3350885ccce5 could not be found. Oct 04 19:51:19.421502 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:51:19.421502 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:51:19.426660 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:51:19.426660 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:51:19.426660 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:51:19.426660 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:51:19.426660 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:51:19.426660 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:51:19.426660 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 202cbdb0-650d-43d8-9dd2-3350885ccce5 could not be found. Oct 04 19:51:19.426660 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:51:19.426660 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-6960e833-1408-4ca5-af86-19d4adbf363f tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Returning 404 to user: Instance 202cbdb0-650d-43d8-9dd2-3350885ccce5 could not be found. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:51:19.426660 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-6960e833-1408-4ca5-af86-19d4adbf363f tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] 10.222.0.43 "GET /compute/v2.1/servers/202cbdb0-650d-43d8-9dd2-3350885ccce5" status: 404 len: 111 microversion: 2.1 time: 0.031377 Oct 04 19:51:19.426660 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 4020/7665] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:51:19 2022] GET /compute/v2.1/servers/202cbdb0-650d-43d8-9dd2-3350885ccce5 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:51:22.390698 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-9bc4efc2-41f1-4b85-9a93-e8b45c3fdfde tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Calling method '.version_select at 0x7fb21f020280>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:51:22.413542 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-9bc4efc2-41f1-4b85-9a93-e8b45c3fdfde tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-861516933" status: 202 len: 0 microversion: 2.1 time: 0.026725 Oct 04 19:51:22.414118 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3646/7666] 10.222.0.43 () {58 vars in 1281 bytes} [Tue Oct 4 19:51:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-861516933 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:51:22.443421 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-65146ea8-74da-4ed6-bd39-5fc08fc9c811 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Action: 'create', calling method: .version_select at 0x7fb21eae0e50>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-620380165", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNi7e7rWMWltKE6XCAZiX2CuqUc3C5KifoSRb7SBzNqtmL9ChS6ifrcPWFoRoAGBjqdxesAq3rEm+ewNlHh5/3g/ypur4xxTSlBWNmWgn/YtfiR+nZDt6Q5EKUQk4PeThQ=="}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:51:22.460179 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-65146ea8-74da-4ed6-bd39-5fc08fc9c811 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Getting quotas for project bc8cddf77e654ca7a88b55acca131a45. Resources: {'key_pairs'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:51:22.466195 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-65146ea8-74da-4ed6-bd39-5fc08fc9c811 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Getting quotas for user 6c616f37f7714bdaaba2ae66226f37d8 and project bc8cddf77e654ca7a88b55acca131a45. Resources: {'key_pairs'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:51:22.492525 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-65146ea8-74da-4ed6-bd39-5fc08fc9c811 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.052908 Oct 04 19:51:22.498819 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 4021/7667] 10.222.0.43 () {60 vars in 1159 bytes} [Tue Oct 4 19:51:22 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:51:28.064564 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-574fd3eb-7db3-453c-8dd3-3f0f789e05f7 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1975503815", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452", "networks": [{"uuid": "c00ce388-22b2-46a8-80c5-cd39c8164e8d"}], "key_name": "tempest-TestNetworkAdvancedServerOps-620380165", "security_groups": [{"name": "tempest-secgroup-smoke-1617268963"}]}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:51:28.201177 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.network.neutron [None req-574fd3eb-7db3-453c-8dd3-3f0f789e05f7 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] validate_networks() for [('c00ce388-22b2-46a8-80c5-cd39c8164e8d', None, None, None, None, None)] {{(pid=123595) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 19:51:28.368733 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:51:28.628857 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-574fd3eb-7db3-453c-8dd3-3f0f789e05f7 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Flavor limits 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:51:28.629326 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-574fd3eb-7db3-453c-8dd3-3f0f789e05f7 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Image limits 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:51:28.629843 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-574fd3eb-7db3-453c-8dd3-3f0f789e05f7 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Flavor pref 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:51:28.630260 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-574fd3eb-7db3-453c-8dd3-3f0f789e05f7 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Image pref 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:51:28.630695 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-574fd3eb-7db3-453c-8dd3-3f0f789e05f7 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:51:28.640069 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-574fd3eb-7db3-453c-8dd3-3f0f789e05f7 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:51:28.641152 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-574fd3eb-7db3-453c-8dd3-3f0f789e05f7 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:51:28.641601 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-574fd3eb-7db3-453c-8dd3-3f0f789e05f7 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:51:28.642344 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-574fd3eb-7db3-453c-8dd3-3f0f789e05f7 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:51:28.642837 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-574fd3eb-7db3-453c-8dd3-3f0f789e05f7 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:51:28.643269 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-574fd3eb-7db3-453c-8dd3-3f0f789e05f7 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:51:28.661793 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-574fd3eb-7db3-453c-8dd3-3f0f789e05f7 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Getting quotas for project bc8cddf77e654ca7a88b55acca131a45. Resources: {'ram', 'cores', 'instances'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:51:28.667541 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-574fd3eb-7db3-453c-8dd3-3f0f789e05f7 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Getting quotas for user 6c616f37f7714bdaaba2ae66226f37d8 and project bc8cddf77e654ca7a88b55acca131a45. Resources: {'ram', 'cores', 'instances'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:51:28.680717 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-574fd3eb-7db3-453c-8dd3-3f0f789e05f7 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Going to run 1 instances... {{(pid=123595) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 19:51:28.683111 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-574fd3eb-7db3-453c-8dd3-3f0f789e05f7 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] [instance: 22f7508e-cc15-48a0-94ca-03680fb0bdc0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e8943ec5-4038-4d4b-b9b9-2415a79f5243',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 19:51:28.733011 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-574fd3eb-7db3-453c-8dd3-3f0f789e05f7 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.673956 Oct 04 19:51:28.736478 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3647/7668] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 19:51:28 2022] POST /compute/v2.1/servers => generated 406 bytes in 679 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 19:51:28.746515 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-d0e65d7f-2b2a-4fe2-963f-dcc75dcb36b5 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:51:28.747856 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-d0e65d7f-2b2a-4fe2-963f-dcc75dcb36b5 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] [instance: 22f7508e-cc15-48a0-94ca-03680fb0bdc0] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:51:28.821534 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-d0e65d7f-2b2a-4fe2-963f-dcc75dcb36b5 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c616f37f7714bdaaba2ae66226f37d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8cddf77e654ca7a88b55acca131a45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:51:28.829492 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-d0e65d7f-2b2a-4fe2-963f-dcc75dcb36b5 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] 10.222.0.43 "GET /compute/v2.1/servers/22f7508e-cc15-48a0-94ca-03680fb0bdc0" status: 200 len: 1266 microversion: 2.1 time: 0.087691 Oct 04 19:51:28.830334 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 4022/7669] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:51:28 2022] GET /compute/v2.1/servers/22f7508e-cc15-48a0-94ca-03680fb0bdc0 => generated 1266 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:51:29.854094 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-712a3db7-f67d-4b92-a752-f91c1c60271b tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:51:29.854818 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-712a3db7-f67d-4b92-a752-f91c1c60271b tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] [instance: 22f7508e-cc15-48a0-94ca-03680fb0bdc0] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:51:29.863075 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-712a3db7-f67d-4b92-a752-f91c1c60271b tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:51:29.864648 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-712a3db7-f67d-4b92-a752-f91c1c60271b tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:51:29.865347 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-712a3db7-f67d-4b92-a752-f91c1c60271b tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:51:29.867291 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-712a3db7-f67d-4b92-a752-f91c1c60271b tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:51:29.868063 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-712a3db7-f67d-4b92-a752-f91c1c60271b tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:51:29.868690 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-712a3db7-f67d-4b92-a752-f91c1c60271b tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:51:29.953275 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-712a3db7-f67d-4b92-a752-f91c1c60271b tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c616f37f7714bdaaba2ae66226f37d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8cddf77e654ca7a88b55acca131a45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:51:29.962329 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-712a3db7-f67d-4b92-a752-f91c1c60271b tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] 10.222.0.43 "GET /compute/v2.1/servers/22f7508e-cc15-48a0-94ca-03680fb0bdc0" status: 200 len: 1336 microversion: 2.1 time: 0.113568 Oct 04 19:51:29.977495 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3648/7670] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:51:29 2022] GET /compute/v2.1/servers/22f7508e-cc15-48a0-94ca-03680fb0bdc0 => generated 1336 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:51:30.986865 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-0ce9d96b-49eb-4004-bd7f-b24e57859750 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:51:30.987491 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-0ce9d96b-49eb-4004-bd7f-b24e57859750 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] [instance: 22f7508e-cc15-48a0-94ca-03680fb0bdc0] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:51:30.989574 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=16 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:51:30.996727 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0ce9d96b-49eb-4004-bd7f-b24e57859750 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:51:30.997259 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0ce9d96b-49eb-4004-bd7f-b24e57859750 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:51:30.997931 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0ce9d96b-49eb-4004-bd7f-b24e57859750 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:51:30.998841 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0ce9d96b-49eb-4004-bd7f-b24e57859750 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:51:30.999482 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0ce9d96b-49eb-4004-bd7f-b24e57859750 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:51:30.999955 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0ce9d96b-49eb-4004-bd7f-b24e57859750 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:51:31.250069 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-0ce9d96b-49eb-4004-bd7f-b24e57859750 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c616f37f7714bdaaba2ae66226f37d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8cddf77e654ca7a88b55acca131a45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:51:31.258069 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-0ce9d96b-49eb-4004-bd7f-b24e57859750 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] 10.222.0.43 "GET /compute/v2.1/servers/22f7508e-cc15-48a0-94ca-03680fb0bdc0" status: 200 len: 1392 microversion: 2.1 time: 0.275769 Oct 04 19:51:31.258871 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 4023/7671] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:51:30 2022] GET /compute/v2.1/servers/22f7508e-cc15-48a0-94ca-03680fb0bdc0 => generated 1392 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:51:31.395570 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-ae0b5cb1-93b2-41ca-bd85-addab8450a9f req-06ecf049-8597-4b42-b3f2-eada65348354 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22f7508e-cc15-48a0-94ca-03680fb0bdc0", "tag": "0ee3e439-cee7-475b-b86f-2c49a9bce71e"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:51:31.408393 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-ae0b5cb1-93b2-41ca-bd85-addab8450a9f req-06ecf049-8597-4b42-b3f2-eada65348354 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:51:31.408974 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-ae0b5cb1-93b2-41ca-bd85-addab8450a9f req-06ecf049-8597-4b42-b3f2-eada65348354 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:51:31.409644 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-ae0b5cb1-93b2-41ca-bd85-addab8450a9f req-06ecf049-8597-4b42-b3f2-eada65348354 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:51:31.421406 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-ae0b5cb1-93b2-41ca-bd85-addab8450a9f req-06ecf049-8597-4b42-b3f2-eada65348354 service nova] Creating event network-changed:0ee3e439-cee7-475b-b86f-2c49a9bce71e for instance 22f7508e-cc15-48a0-94ca-03680fb0bdc0 on n-h1-851028-13 Oct 04 19:51:31.426256 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-ae0b5cb1-93b2-41ca-bd85-addab8450a9f req-06ecf049-8597-4b42-b3f2-eada65348354 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034619 Oct 04 19:51:31.427082 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3649/7672] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:51:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:51:32.282322 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-d3f9c9b1-fb21-4a33-8022-bf952a2f3191 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:51:32.282898 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-d3f9c9b1-fb21-4a33-8022-bf952a2f3191 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] [instance: 22f7508e-cc15-48a0-94ca-03680fb0bdc0] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:51:32.289871 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d3f9c9b1-fb21-4a33-8022-bf952a2f3191 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:51:32.290377 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d3f9c9b1-fb21-4a33-8022-bf952a2f3191 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:51:32.290836 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d3f9c9b1-fb21-4a33-8022-bf952a2f3191 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:51:32.291547 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d3f9c9b1-fb21-4a33-8022-bf952a2f3191 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:51:32.292021 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d3f9c9b1-fb21-4a33-8022-bf952a2f3191 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:51:32.292469 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d3f9c9b1-fb21-4a33-8022-bf952a2f3191 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:51:32.425718 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-d3f9c9b1-fb21-4a33-8022-bf952a2f3191 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c616f37f7714bdaaba2ae66226f37d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8cddf77e654ca7a88b55acca131a45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:51:32.433582 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-d3f9c9b1-fb21-4a33-8022-bf952a2f3191 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] 10.222.0.43 "GET /compute/v2.1/servers/22f7508e-cc15-48a0-94ca-03680fb0bdc0" status: 200 len: 1392 microversion: 2.1 time: 0.155188 Oct 04 19:51:32.434167 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 4024/7673] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:51:32 2022] GET /compute/v2.1/servers/22f7508e-cc15-48a0-94ca-03680fb0bdc0 => generated 1392 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:51:33.458982 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-a70ffe5d-1b01-45b7-ad0d-48ea5dba582b tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:51:33.459655 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-a70ffe5d-1b01-45b7-ad0d-48ea5dba582b tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] [instance: 22f7508e-cc15-48a0-94ca-03680fb0bdc0] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:51:33.466609 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a70ffe5d-1b01-45b7-ad0d-48ea5dba582b tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:51:33.467104 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a70ffe5d-1b01-45b7-ad0d-48ea5dba582b tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:51:33.467557 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a70ffe5d-1b01-45b7-ad0d-48ea5dba582b tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:51:33.468293 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a70ffe5d-1b01-45b7-ad0d-48ea5dba582b tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:51:33.468756 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a70ffe5d-1b01-45b7-ad0d-48ea5dba582b tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:51:33.469229 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a70ffe5d-1b01-45b7-ad0d-48ea5dba582b tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:51:33.599273 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-a70ffe5d-1b01-45b7-ad0d-48ea5dba582b tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c616f37f7714bdaaba2ae66226f37d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8cddf77e654ca7a88b55acca131a45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:51:33.607096 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-a70ffe5d-1b01-45b7-ad0d-48ea5dba582b tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] 10.222.0.43 "GET /compute/v2.1/servers/22f7508e-cc15-48a0-94ca-03680fb0bdc0" status: 200 len: 1392 microversion: 2.1 time: 0.154578 Oct 04 19:51:33.607667 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3650/7674] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:51:33 2022] GET /compute/v2.1/servers/22f7508e-cc15-48a0-94ca-03680fb0bdc0 => generated 1392 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:51:34.629732 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f8d50d53-6dd0-466c-810c-ebbac4d3b27d tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:51:34.630379 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-f8d50d53-6dd0-466c-810c-ebbac4d3b27d tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] [instance: 22f7508e-cc15-48a0-94ca-03680fb0bdc0] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:51:34.638022 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f8d50d53-6dd0-466c-810c-ebbac4d3b27d tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:51:34.638535 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f8d50d53-6dd0-466c-810c-ebbac4d3b27d tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:51:34.638998 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f8d50d53-6dd0-466c-810c-ebbac4d3b27d tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:51:34.639719 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f8d50d53-6dd0-466c-810c-ebbac4d3b27d tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:51:34.640198 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f8d50d53-6dd0-466c-810c-ebbac4d3b27d tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:51:34.640649 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f8d50d53-6dd0-466c-810c-ebbac4d3b27d tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:51:34.768313 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-f8d50d53-6dd0-466c-810c-ebbac4d3b27d tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c616f37f7714bdaaba2ae66226f37d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8cddf77e654ca7a88b55acca131a45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:51:34.776435 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-f8d50d53-6dd0-466c-810c-ebbac4d3b27d tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] 10.222.0.43 "GET /compute/v2.1/servers/22f7508e-cc15-48a0-94ca-03680fb0bdc0" status: 200 len: 1392 microversion: 2.1 time: 0.150702 Oct 04 19:51:34.777023 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 4025/7675] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:51:34 2022] GET /compute/v2.1/servers/22f7508e-cc15-48a0-94ca-03680fb0bdc0 => generated 1392 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:51:35.800254 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-435faec2-f5a5-4815-b300-9eea3ed4da73 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:51:35.800872 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-435faec2-f5a5-4815-b300-9eea3ed4da73 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] [instance: 22f7508e-cc15-48a0-94ca-03680fb0bdc0] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:51:35.807051 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-435faec2-f5a5-4815-b300-9eea3ed4da73 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:51:35.807534 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-435faec2-f5a5-4815-b300-9eea3ed4da73 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:51:35.807972 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-435faec2-f5a5-4815-b300-9eea3ed4da73 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:51:35.808700 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-435faec2-f5a5-4815-b300-9eea3ed4da73 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:51:35.809175 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-435faec2-f5a5-4815-b300-9eea3ed4da73 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:51:35.809606 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-435faec2-f5a5-4815-b300-9eea3ed4da73 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:51:35.937094 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-435faec2-f5a5-4815-b300-9eea3ed4da73 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c616f37f7714bdaaba2ae66226f37d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8cddf77e654ca7a88b55acca131a45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:51:35.945385 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-435faec2-f5a5-4815-b300-9eea3ed4da73 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] 10.222.0.43 "GET /compute/v2.1/servers/22f7508e-cc15-48a0-94ca-03680fb0bdc0" status: 200 len: 1392 microversion: 2.1 time: 0.149658 Oct 04 19:51:35.945950 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3651/7676] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:51:35 2022] GET /compute/v2.1/servers/22f7508e-cc15-48a0-94ca-03680fb0bdc0 => generated 1392 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:51:36.921824 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-adf185d0-0d01-45a8-8bcb-2ee71f31f578 req-720f496f-6f6a-44d2-a657-ec3c8470bdde service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22f7508e-cc15-48a0-94ca-03680fb0bdc0", "name": "network-vif-plugged", "status": "completed", "tag": "0ee3e439-cee7-475b-b86f-2c49a9bce71e"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:51:36.935581 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-adf185d0-0d01-45a8-8bcb-2ee71f31f578 req-720f496f-6f6a-44d2-a657-ec3c8470bdde service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:51:36.936091 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-adf185d0-0d01-45a8-8bcb-2ee71f31f578 req-720f496f-6f6a-44d2-a657-ec3c8470bdde service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:51:36.936548 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-adf185d0-0d01-45a8-8bcb-2ee71f31f578 req-720f496f-6f6a-44d2-a657-ec3c8470bdde service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:51:36.947857 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-adf185d0-0d01-45a8-8bcb-2ee71f31f578 req-720f496f-6f6a-44d2-a657-ec3c8470bdde service nova] Creating event network-vif-plugged:0ee3e439-cee7-475b-b86f-2c49a9bce71e for instance 22f7508e-cc15-48a0-94ca-03680fb0bdc0 on n-h1-851028-13 Oct 04 19:51:36.952935 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-adf185d0-0d01-45a8-8bcb-2ee71f31f578 req-720f496f-6f6a-44d2-a657-ec3c8470bdde service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034956 Oct 04 19:51:36.953763 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 4026/7677] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:51:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:51:36.968044 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-472b22f6-2138-46c4-b1d6-59950555fb47 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:51:36.975094 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-472b22f6-2138-46c4-b1d6-59950555fb47 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] [instance: 22f7508e-cc15-48a0-94ca-03680fb0bdc0] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:51:36.982179 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-472b22f6-2138-46c4-b1d6-59950555fb47 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:51:36.982670 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-472b22f6-2138-46c4-b1d6-59950555fb47 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:51:36.983116 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-472b22f6-2138-46c4-b1d6-59950555fb47 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:51:36.983824 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-472b22f6-2138-46c4-b1d6-59950555fb47 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:51:36.984456 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-472b22f6-2138-46c4-b1d6-59950555fb47 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:51:36.984883 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-472b22f6-2138-46c4-b1d6-59950555fb47 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:51:37.124227 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-472b22f6-2138-46c4-b1d6-59950555fb47 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c616f37f7714bdaaba2ae66226f37d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8cddf77e654ca7a88b55acca131a45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:51:37.131909 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-472b22f6-2138-46c4-b1d6-59950555fb47 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] 10.222.0.43 "GET /compute/v2.1/servers/22f7508e-cc15-48a0-94ca-03680fb0bdc0" status: 200 len: 1392 microversion: 2.1 time: 0.167813 Oct 04 19:51:37.132488 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3652/7678] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:51:36 2022] GET /compute/v2.1/servers/22f7508e-cc15-48a0-94ca-03680fb0bdc0 => generated 1392 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:51:38.155129 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-70307a3b-e202-4119-9218-a165820c9ab6 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:51:38.155856 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-70307a3b-e202-4119-9218-a165820c9ab6 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] [instance: 22f7508e-cc15-48a0-94ca-03680fb0bdc0] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:51:38.165493 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-70307a3b-e202-4119-9218-a165820c9ab6 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:51:38.166013 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-70307a3b-e202-4119-9218-a165820c9ab6 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:51:38.166483 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-70307a3b-e202-4119-9218-a165820c9ab6 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:51:38.167218 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-70307a3b-e202-4119-9218-a165820c9ab6 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:51:38.167698 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-70307a3b-e202-4119-9218-a165820c9ab6 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:51:38.168401 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-70307a3b-e202-4119-9218-a165820c9ab6 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:51:38.306253 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-70307a3b-e202-4119-9218-a165820c9ab6 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c616f37f7714bdaaba2ae66226f37d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8cddf77e654ca7a88b55acca131a45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:51:38.314145 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-70307a3b-e202-4119-9218-a165820c9ab6 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] 10.222.0.43 "GET /compute/v2.1/servers/22f7508e-cc15-48a0-94ca-03680fb0bdc0" status: 200 len: 1565 microversion: 2.1 time: 0.163323 Oct 04 19:51:38.314767 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 4027/7679] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:51:38 2022] GET /compute/v2.1/servers/22f7508e-cc15-48a0-94ca-03680fb0bdc0 => generated 1565 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:51:38.336811 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-6ae2fd58-99a6-4af8-bcd8-faf44af88ef6 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:51:38.337468 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-6ae2fd58-99a6-4af8-bcd8-faf44af88ef6 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] [instance: 22f7508e-cc15-48a0-94ca-03680fb0bdc0] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:51:38.344312 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6ae2fd58-99a6-4af8-bcd8-faf44af88ef6 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:51:38.344795 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6ae2fd58-99a6-4af8-bcd8-faf44af88ef6 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:51:38.345269 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6ae2fd58-99a6-4af8-bcd8-faf44af88ef6 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:51:38.346479 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6ae2fd58-99a6-4af8-bcd8-faf44af88ef6 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:51:38.346936 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6ae2fd58-99a6-4af8-bcd8-faf44af88ef6 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:51:38.347361 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6ae2fd58-99a6-4af8-bcd8-faf44af88ef6 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:51:38.484452 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-6ae2fd58-99a6-4af8-bcd8-faf44af88ef6 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c616f37f7714bdaaba2ae66226f37d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8cddf77e654ca7a88b55acca131a45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:51:38.492693 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-6ae2fd58-99a6-4af8-bcd8-faf44af88ef6 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] 10.222.0.43 "GET /compute/v2.1/servers/22f7508e-cc15-48a0-94ca-03680fb0bdc0" status: 200 len: 1565 microversion: 2.1 time: 0.159642 Oct 04 19:51:38.493319 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3653/7680] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:51:38 2022] GET /compute/v2.1/servers/22f7508e-cc15-48a0-94ca-03680fb0bdc0 => generated 1565 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:51:40.063761 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-df5c0858-470b-403c-8e38-7b63dcd1b038 req-cae68200-a7a6-4eab-b30c-e8f2fb204dd0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22f7508e-cc15-48a0-94ca-03680fb0bdc0", "tag": "0ee3e439-cee7-475b-b86f-2c49a9bce71e"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:51:40.068425 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-1ef0d3f1-f63d-40be-8b43-7cea1b48e862 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:51:40.069057 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-1ef0d3f1-f63d-40be-8b43-7cea1b48e862 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] [instance: 22f7508e-cc15-48a0-94ca-03680fb0bdc0] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:51:40.072106 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=6 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:51:40.073642 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=1 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:51:40.079410 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=2 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:51:40.080392 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=6 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:51:40.087607 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-df5c0858-470b-403c-8e38-7b63dcd1b038 req-cae68200-a7a6-4eab-b30c-e8f2fb204dd0 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:51:40.088087 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-df5c0858-470b-403c-8e38-7b63dcd1b038 req-cae68200-a7a6-4eab-b30c-e8f2fb204dd0 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:51:40.088515 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-df5c0858-470b-403c-8e38-7b63dcd1b038 req-cae68200-a7a6-4eab-b30c-e8f2fb204dd0 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:51:40.095373 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1ef0d3f1-f63d-40be-8b43-7cea1b48e862 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:51:40.096375 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1ef0d3f1-f63d-40be-8b43-7cea1b48e862 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:51:40.096833 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1ef0d3f1-f63d-40be-8b43-7cea1b48e862 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:51:40.097733 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1ef0d3f1-f63d-40be-8b43-7cea1b48e862 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:51:40.098201 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1ef0d3f1-f63d-40be-8b43-7cea1b48e862 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:51:40.098644 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1ef0d3f1-f63d-40be-8b43-7cea1b48e862 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:51:40.111229 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-df5c0858-470b-403c-8e38-7b63dcd1b038 req-cae68200-a7a6-4eab-b30c-e8f2fb204dd0 service nova] Creating event network-changed:0ee3e439-cee7-475b-b86f-2c49a9bce71e for instance 22f7508e-cc15-48a0-94ca-03680fb0bdc0 on n-h1-851028-13 Oct 04 19:51:40.117141 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-df5c0858-470b-403c-8e38-7b63dcd1b038 req-cae68200-a7a6-4eab-b30c-e8f2fb204dd0 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056908 Oct 04 19:51:40.117690 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3654/7681] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:51:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:51:40.652872 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-1ef0d3f1-f63d-40be-8b43-7cea1b48e862 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c616f37f7714bdaaba2ae66226f37d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8cddf77e654ca7a88b55acca131a45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:51:40.662657 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-1ef0d3f1-f63d-40be-8b43-7cea1b48e862 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] 10.222.0.43 "GET /compute/v2.1/servers/22f7508e-cc15-48a0-94ca-03680fb0bdc0" status: 200 len: 1565 microversion: 2.1 time: 0.605140 Oct 04 19:51:40.663253 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 4028/7682] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:51:40 2022] GET /compute/v2.1/servers/22f7508e-cc15-48a0-94ca-03680fb0bdc0 => generated 1565 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:52:03.949976 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:52:03.950844 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=36 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:52:03.954997 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-70de9bf8-c0fa-448c-a5a4-5252f8f4431b tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:52:03.957557 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-70de9bf8-c0fa-448c-a5a4-5252f8f4431b tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] [instance: 22f7508e-cc15-48a0-94ca-03680fb0bdc0] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:52:03.964885 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-70de9bf8-c0fa-448c-a5a4-5252f8f4431b tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:52:03.965399 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-70de9bf8-c0fa-448c-a5a4-5252f8f4431b tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:52:03.965844 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-70de9bf8-c0fa-448c-a5a4-5252f8f4431b tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:52:03.966546 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-70de9bf8-c0fa-448c-a5a4-5252f8f4431b tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:52:03.967007 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-70de9bf8-c0fa-448c-a5a4-5252f8f4431b tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:52:03.967443 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-70de9bf8-c0fa-448c-a5a4-5252f8f4431b tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:52:04.026517 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-70de9bf8-c0fa-448c-a5a4-5252f8f4431b tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] 10.222.0.43 "POST /compute/v2.1/servers/22f7508e-cc15-48a0-94ca-03680fb0bdc0/action" status: 200 len: 24571 microversion: 2.1 time: 0.078143 Oct 04 19:52:04.027442 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3655/7683] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 19:52:03 2022] POST /compute/v2.1/servers/22f7508e-cc15-48a0-94ca-03680fb0bdc0/action => generated 24571 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 19:52:15.055699 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-63f71828-525b-4ee4-b8e8-6dd7ee3081f3 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:52:15.058132 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-63f71828-525b-4ee4-b8e8-6dd7ee3081f3 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] [instance: 22f7508e-cc15-48a0-94ca-03680fb0bdc0] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:52:15.060757 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_api:SELECT=1 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:52:15.061466 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=32 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:52:15.067159 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-63f71828-525b-4ee4-b8e8-6dd7ee3081f3 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:52:15.067668 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-63f71828-525b-4ee4-b8e8-6dd7ee3081f3 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:52:15.068127 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-63f71828-525b-4ee4-b8e8-6dd7ee3081f3 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:52:15.068851 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-63f71828-525b-4ee4-b8e8-6dd7ee3081f3 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:52:15.069360 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-63f71828-525b-4ee4-b8e8-6dd7ee3081f3 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:52:15.069811 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-63f71828-525b-4ee4-b8e8-6dd7ee3081f3 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:52:15.169867 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-63f71828-525b-4ee4-b8e8-6dd7ee3081f3 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '6c616f37f7714bdaaba2ae66226f37d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8cddf77e654ca7a88b55acca131a45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:52:15.176053 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-63f71828-525b-4ee4-b8e8-6dd7ee3081f3 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] [instance: 22f7508e-cc15-48a0-94ca-03680fb0bdc0] Old instance type m1.heat2, new instance type m1.heat {{(pid=123596) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 04 19:52:15.183445 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-63f71828-525b-4ee4-b8e8-6dd7ee3081f3 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Flavor limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:52:15.183887 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-63f71828-525b-4ee4-b8e8-6dd7ee3081f3 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Image limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:52:15.184384 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-63f71828-525b-4ee4-b8e8-6dd7ee3081f3 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Flavor pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:52:15.184813 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-63f71828-525b-4ee4-b8e8-6dd7ee3081f3 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Image pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:52:15.185285 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-63f71828-525b-4ee4-b8e8-6dd7ee3081f3 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:52:15.251766 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-63f71828-525b-4ee4-b8e8-6dd7ee3081f3 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] 10.222.0.43 "POST /compute/v2.1/servers/22f7508e-cc15-48a0-94ca-03680fb0bdc0/action" status: 202 len: 0 microversion: 2.1 time: 0.200338 Oct 04 19:52:15.252589 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 4029/7684] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 19:52:15 2022] POST /compute/v2.1/servers/22f7508e-cc15-48a0-94ca-03680fb0bdc0/action => generated 0 bytes in 202 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:52:15.262611 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-586a8be7-b199-4a20-8a02-20ad6965a498 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:52:15.263885 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-586a8be7-b199-4a20-8a02-20ad6965a498 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] [instance: 22f7508e-cc15-48a0-94ca-03680fb0bdc0] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:52:15.266449 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=4 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:52:15.267329 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_api:SELECT=2 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:52:15.273333 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-586a8be7-b199-4a20-8a02-20ad6965a498 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:52:15.273825 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-586a8be7-b199-4a20-8a02-20ad6965a498 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:52:15.274271 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-586a8be7-b199-4a20-8a02-20ad6965a498 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:52:15.275002 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-586a8be7-b199-4a20-8a02-20ad6965a498 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:52:15.275482 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-586a8be7-b199-4a20-8a02-20ad6965a498 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:52:15.275898 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-586a8be7-b199-4a20-8a02-20ad6965a498 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:52:15.417666 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-586a8be7-b199-4a20-8a02-20ad6965a498 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c616f37f7714bdaaba2ae66226f37d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8cddf77e654ca7a88b55acca131a45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:52:15.425946 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-586a8be7-b199-4a20-8a02-20ad6965a498 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] 10.222.0.43 "GET /compute/v2.1/servers/22f7508e-cc15-48a0-94ca-03680fb0bdc0" status: 200 len: 1692 microversion: 2.1 time: 0.168989 Oct 04 19:52:15.426518 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3656/7685] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:52:15 2022] GET /compute/v2.1/servers/22f7508e-cc15-48a0-94ca-03680fb0bdc0 => generated 1692 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:52:16.451797 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-b13668f1-7ab7-4af6-8bce-788c2b936f91 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:52:16.452435 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-b13668f1-7ab7-4af6-8bce-788c2b936f91 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] [instance: 22f7508e-cc15-48a0-94ca-03680fb0bdc0] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:52:16.462349 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b13668f1-7ab7-4af6-8bce-788c2b936f91 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:52:16.462862 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b13668f1-7ab7-4af6-8bce-788c2b936f91 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:52:16.463323 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b13668f1-7ab7-4af6-8bce-788c2b936f91 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:52:16.464046 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b13668f1-7ab7-4af6-8bce-788c2b936f91 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:52:16.464520 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b13668f1-7ab7-4af6-8bce-788c2b936f91 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:52:16.464969 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b13668f1-7ab7-4af6-8bce-788c2b936f91 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:52:16.606006 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-b13668f1-7ab7-4af6-8bce-788c2b936f91 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c616f37f7714bdaaba2ae66226f37d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8cddf77e654ca7a88b55acca131a45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:52:16.613783 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-b13668f1-7ab7-4af6-8bce-788c2b936f91 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] 10.222.0.43 "GET /compute/v2.1/servers/22f7508e-cc15-48a0-94ca-03680fb0bdc0" status: 200 len: 1692 microversion: 2.1 time: 0.167178 Oct 04 19:52:16.614358 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 4030/7686] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:52:16 2022] GET /compute/v2.1/servers/22f7508e-cc15-48a0-94ca-03680fb0bdc0 => generated 1692 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:52:17.638361 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-4e03279a-55ee-4750-a306-20c35d95c693 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:52:17.638981 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-4e03279a-55ee-4750-a306-20c35d95c693 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] [instance: 22f7508e-cc15-48a0-94ca-03680fb0bdc0] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:52:17.645788 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4e03279a-55ee-4750-a306-20c35d95c693 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:52:17.646275 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4e03279a-55ee-4750-a306-20c35d95c693 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:52:17.646717 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4e03279a-55ee-4750-a306-20c35d95c693 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:52:17.647417 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4e03279a-55ee-4750-a306-20c35d95c693 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:52:17.647876 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4e03279a-55ee-4750-a306-20c35d95c693 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:52:17.648311 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4e03279a-55ee-4750-a306-20c35d95c693 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:52:17.776462 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-4e03279a-55ee-4750-a306-20c35d95c693 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c616f37f7714bdaaba2ae66226f37d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8cddf77e654ca7a88b55acca131a45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:52:17.784168 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-4e03279a-55ee-4750-a306-20c35d95c693 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] 10.222.0.43 "GET /compute/v2.1/servers/22f7508e-cc15-48a0-94ca-03680fb0bdc0" status: 200 len: 1697 microversion: 2.1 time: 0.149752 Oct 04 19:52:17.784742 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3657/7687] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:52:17 2022] GET /compute/v2.1/servers/22f7508e-cc15-48a0-94ca-03680fb0bdc0 => generated 1697 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:52:18.808215 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-768a681b-de40-4d52-81f7-d42968ce4116 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:52:18.808853 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-768a681b-de40-4d52-81f7-d42968ce4116 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] [instance: 22f7508e-cc15-48a0-94ca-03680fb0bdc0] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:52:18.815850 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-768a681b-de40-4d52-81f7-d42968ce4116 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:52:18.816355 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-768a681b-de40-4d52-81f7-d42968ce4116 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:52:18.816812 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-768a681b-de40-4d52-81f7-d42968ce4116 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:52:18.817546 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-768a681b-de40-4d52-81f7-d42968ce4116 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:52:18.818022 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-768a681b-de40-4d52-81f7-d42968ce4116 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:52:18.818471 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-768a681b-de40-4d52-81f7-d42968ce4116 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:52:18.950927 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-768a681b-de40-4d52-81f7-d42968ce4116 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c616f37f7714bdaaba2ae66226f37d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8cddf77e654ca7a88b55acca131a45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:52:18.959017 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-768a681b-de40-4d52-81f7-d42968ce4116 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] 10.222.0.43 "GET /compute/v2.1/servers/22f7508e-cc15-48a0-94ca-03680fb0bdc0" status: 200 len: 1697 microversion: 2.1 time: 0.155291 Oct 04 19:52:18.959591 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 4031/7688] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:52:18 2022] GET /compute/v2.1/servers/22f7508e-cc15-48a0-94ca-03680fb0bdc0 => generated 1697 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:52:19.982964 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-c141aa9c-dc57-4888-9e1a-28dc7b455ea3 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:52:19.983723 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-c141aa9c-dc57-4888-9e1a-28dc7b455ea3 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] [instance: 22f7508e-cc15-48a0-94ca-03680fb0bdc0] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:52:19.990245 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c141aa9c-dc57-4888-9e1a-28dc7b455ea3 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:52:19.991235 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c141aa9c-dc57-4888-9e1a-28dc7b455ea3 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:52:19.991674 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c141aa9c-dc57-4888-9e1a-28dc7b455ea3 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:52:19.992364 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c141aa9c-dc57-4888-9e1a-28dc7b455ea3 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:52:19.992813 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c141aa9c-dc57-4888-9e1a-28dc7b455ea3 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:52:19.993541 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c141aa9c-dc57-4888-9e1a-28dc7b455ea3 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:52:20.129996 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-c141aa9c-dc57-4888-9e1a-28dc7b455ea3 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c616f37f7714bdaaba2ae66226f37d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8cddf77e654ca7a88b55acca131a45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:52:20.138405 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-c141aa9c-dc57-4888-9e1a-28dc7b455ea3 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] 10.222.0.43 "GET /compute/v2.1/servers/22f7508e-cc15-48a0-94ca-03680fb0bdc0" status: 200 len: 1697 microversion: 2.1 time: 0.160185 Oct 04 19:52:20.138976 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3658/7689] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:52:19 2022] GET /compute/v2.1/servers/22f7508e-cc15-48a0-94ca-03680fb0bdc0 => generated 1697 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:52:21.160881 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-42884798-bb30-4980-a1f5-f7e624c3c69c tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:52:21.161549 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-42884798-bb30-4980-a1f5-f7e624c3c69c tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] [instance: 22f7508e-cc15-48a0-94ca-03680fb0bdc0] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:52:21.168481 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-42884798-bb30-4980-a1f5-f7e624c3c69c tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:52:21.168991 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-42884798-bb30-4980-a1f5-f7e624c3c69c tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:52:21.169488 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-42884798-bb30-4980-a1f5-f7e624c3c69c tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:52:21.170208 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-42884798-bb30-4980-a1f5-f7e624c3c69c tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:52:21.170686 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-42884798-bb30-4980-a1f5-f7e624c3c69c tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:52:21.171140 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-42884798-bb30-4980-a1f5-f7e624c3c69c tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:52:21.308851 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-42884798-bb30-4980-a1f5-f7e624c3c69c tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c616f37f7714bdaaba2ae66226f37d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8cddf77e654ca7a88b55acca131a45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:52:21.316705 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-42884798-bb30-4980-a1f5-f7e624c3c69c tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] 10.222.0.43 "GET /compute/v2.1/servers/22f7508e-cc15-48a0-94ca-03680fb0bdc0" status: 200 len: 1697 microversion: 2.1 time: 0.159742 Oct 04 19:52:21.317317 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 4032/7690] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:52:21 2022] GET /compute/v2.1/servers/22f7508e-cc15-48a0-94ca-03680fb0bdc0 => generated 1697 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:52:22.341526 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-3e6053cc-d94f-4c75-9e24-871579da4cc8 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:52:22.342140 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-3e6053cc-d94f-4c75-9e24-871579da4cc8 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] [instance: 22f7508e-cc15-48a0-94ca-03680fb0bdc0] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:52:22.348910 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3e6053cc-d94f-4c75-9e24-871579da4cc8 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:52:22.349430 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3e6053cc-d94f-4c75-9e24-871579da4cc8 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:52:22.349869 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3e6053cc-d94f-4c75-9e24-871579da4cc8 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:52:22.351320 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3e6053cc-d94f-4c75-9e24-871579da4cc8 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:52:22.351773 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3e6053cc-d94f-4c75-9e24-871579da4cc8 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:52:22.352197 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3e6053cc-d94f-4c75-9e24-871579da4cc8 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:52:22.480774 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-3e6053cc-d94f-4c75-9e24-871579da4cc8 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c616f37f7714bdaaba2ae66226f37d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8cddf77e654ca7a88b55acca131a45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:52:22.488495 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-3e6053cc-d94f-4c75-9e24-871579da4cc8 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] 10.222.0.43 "GET /compute/v2.1/servers/22f7508e-cc15-48a0-94ca-03680fb0bdc0" status: 200 len: 1697 microversion: 2.1 time: 0.150890 Oct 04 19:52:22.489069 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3659/7691] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:52:22 2022] GET /compute/v2.1/servers/22f7508e-cc15-48a0-94ca-03680fb0bdc0 => generated 1697 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:52:23.513222 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-456db900-cdeb-4b17-bb53-294aee6051d5 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:52:23.513853 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-456db900-cdeb-4b17-bb53-294aee6051d5 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] [instance: 22f7508e-cc15-48a0-94ca-03680fb0bdc0] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:52:23.520575 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-456db900-cdeb-4b17-bb53-294aee6051d5 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:52:23.521071 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-456db900-cdeb-4b17-bb53-294aee6051d5 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:52:23.521555 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-456db900-cdeb-4b17-bb53-294aee6051d5 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:52:23.522255 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-456db900-cdeb-4b17-bb53-294aee6051d5 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:52:23.522723 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-456db900-cdeb-4b17-bb53-294aee6051d5 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:52:23.523179 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-456db900-cdeb-4b17-bb53-294aee6051d5 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:52:23.653907 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-456db900-cdeb-4b17-bb53-294aee6051d5 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c616f37f7714bdaaba2ae66226f37d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8cddf77e654ca7a88b55acca131a45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:52:23.661609 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-456db900-cdeb-4b17-bb53-294aee6051d5 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] 10.222.0.43 "GET /compute/v2.1/servers/22f7508e-cc15-48a0-94ca-03680fb0bdc0" status: 200 len: 1697 microversion: 2.1 time: 0.152324 Oct 04 19:52:23.662174 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 4033/7692] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:52:23 2022] GET /compute/v2.1/servers/22f7508e-cc15-48a0-94ca-03680fb0bdc0 => generated 1697 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:52:24.685767 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-ac79fbaf-3ecb-4092-b1c5-3309a48c04e3 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:52:24.686410 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-ac79fbaf-3ecb-4092-b1c5-3309a48c04e3 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] [instance: 22f7508e-cc15-48a0-94ca-03680fb0bdc0] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:52:24.693300 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ac79fbaf-3ecb-4092-b1c5-3309a48c04e3 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:52:24.693790 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ac79fbaf-3ecb-4092-b1c5-3309a48c04e3 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:52:24.694234 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ac79fbaf-3ecb-4092-b1c5-3309a48c04e3 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:52:24.694937 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ac79fbaf-3ecb-4092-b1c5-3309a48c04e3 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:52:24.695397 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ac79fbaf-3ecb-4092-b1c5-3309a48c04e3 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:52:24.695828 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ac79fbaf-3ecb-4092-b1c5-3309a48c04e3 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:52:24.829704 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-ac79fbaf-3ecb-4092-b1c5-3309a48c04e3 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c616f37f7714bdaaba2ae66226f37d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8cddf77e654ca7a88b55acca131a45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:52:24.837675 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-ac79fbaf-3ecb-4092-b1c5-3309a48c04e3 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] 10.222.0.43 "GET /compute/v2.1/servers/22f7508e-cc15-48a0-94ca-03680fb0bdc0" status: 200 len: 1697 microversion: 2.1 time: 0.155856 Oct 04 19:52:24.838258 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3660/7693] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:52:24 2022] GET /compute/v2.1/servers/22f7508e-cc15-48a0-94ca-03680fb0bdc0 => generated 1697 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:52:25.861464 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f55aa901-06ce-4a78-ba92-98081f31cce1 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:52:25.862125 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-f55aa901-06ce-4a78-ba92-98081f31cce1 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] [instance: 22f7508e-cc15-48a0-94ca-03680fb0bdc0] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:52:25.869926 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f55aa901-06ce-4a78-ba92-98081f31cce1 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:52:25.870434 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f55aa901-06ce-4a78-ba92-98081f31cce1 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:52:25.870891 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f55aa901-06ce-4a78-ba92-98081f31cce1 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:52:25.871603 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f55aa901-06ce-4a78-ba92-98081f31cce1 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:52:25.872078 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f55aa901-06ce-4a78-ba92-98081f31cce1 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:52:25.872524 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f55aa901-06ce-4a78-ba92-98081f31cce1 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:52:26.007050 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-f55aa901-06ce-4a78-ba92-98081f31cce1 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c616f37f7714bdaaba2ae66226f37d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8cddf77e654ca7a88b55acca131a45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:52:26.014924 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-f55aa901-06ce-4a78-ba92-98081f31cce1 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] 10.222.0.43 "GET /compute/v2.1/servers/22f7508e-cc15-48a0-94ca-03680fb0bdc0" status: 200 len: 1697 microversion: 2.1 time: 0.157315 Oct 04 19:52:26.015504 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 4034/7694] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:52:25 2022] GET /compute/v2.1/servers/22f7508e-cc15-48a0-94ca-03680fb0bdc0 => generated 1697 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:52:27.037885 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-b541d047-d5b7-4f8a-b896-fc1b2a8d155b tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:52:27.038501 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-b541d047-d5b7-4f8a-b896-fc1b2a8d155b tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] [instance: 22f7508e-cc15-48a0-94ca-03680fb0bdc0] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:52:27.045818 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b541d047-d5b7-4f8a-b896-fc1b2a8d155b tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:52:27.046307 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b541d047-d5b7-4f8a-b896-fc1b2a8d155b tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:52:27.046746 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b541d047-d5b7-4f8a-b896-fc1b2a8d155b tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:52:27.047442 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b541d047-d5b7-4f8a-b896-fc1b2a8d155b tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:52:27.047899 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b541d047-d5b7-4f8a-b896-fc1b2a8d155b tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:52:27.048383 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b541d047-d5b7-4f8a-b896-fc1b2a8d155b tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:52:27.177480 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-b541d047-d5b7-4f8a-b896-fc1b2a8d155b tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c616f37f7714bdaaba2ae66226f37d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8cddf77e654ca7a88b55acca131a45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:52:27.185339 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-b541d047-d5b7-4f8a-b896-fc1b2a8d155b tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] 10.222.0.43 "GET /compute/v2.1/servers/22f7508e-cc15-48a0-94ca-03680fb0bdc0" status: 200 len: 1697 microversion: 2.1 time: 0.151369 Oct 04 19:52:27.185919 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3661/7695] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:52:27 2022] GET /compute/v2.1/servers/22f7508e-cc15-48a0-94ca-03680fb0bdc0 => generated 1697 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:52:28.209534 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-161c9b30-ebf0-4ced-8273-3cd75f6f372e tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:52:28.210172 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-161c9b30-ebf0-4ced-8273-3cd75f6f372e tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] [instance: 22f7508e-cc15-48a0-94ca-03680fb0bdc0] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:52:28.217639 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-161c9b30-ebf0-4ced-8273-3cd75f6f372e tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:52:28.218148 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-161c9b30-ebf0-4ced-8273-3cd75f6f372e tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:52:28.218608 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-161c9b30-ebf0-4ced-8273-3cd75f6f372e tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:52:28.219322 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-161c9b30-ebf0-4ced-8273-3cd75f6f372e tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:52:28.219804 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-161c9b30-ebf0-4ced-8273-3cd75f6f372e tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:52:28.220254 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-161c9b30-ebf0-4ced-8273-3cd75f6f372e tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:52:28.350383 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-161c9b30-ebf0-4ced-8273-3cd75f6f372e tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c616f37f7714bdaaba2ae66226f37d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8cddf77e654ca7a88b55acca131a45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:52:28.358769 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-161c9b30-ebf0-4ced-8273-3cd75f6f372e tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] 10.222.0.43 "GET /compute/v2.1/servers/22f7508e-cc15-48a0-94ca-03680fb0bdc0" status: 200 len: 1697 microversion: 2.1 time: 0.153452 Oct 04 19:52:28.359364 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 4035/7696] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:52:28 2022] GET /compute/v2.1/servers/22f7508e-cc15-48a0-94ca-03680fb0bdc0 => generated 1697 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:52:29.381986 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-ebb26a61-4114-45a8-aa5e-b5cec02d657f tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:52:29.382608 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-ebb26a61-4114-45a8-aa5e-b5cec02d657f tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] [instance: 22f7508e-cc15-48a0-94ca-03680fb0bdc0] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:52:29.389431 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ebb26a61-4114-45a8-aa5e-b5cec02d657f tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:52:29.389915 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ebb26a61-4114-45a8-aa5e-b5cec02d657f tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:52:29.390359 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ebb26a61-4114-45a8-aa5e-b5cec02d657f tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:52:29.391053 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ebb26a61-4114-45a8-aa5e-b5cec02d657f tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:52:29.391510 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ebb26a61-4114-45a8-aa5e-b5cec02d657f tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:52:29.391944 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ebb26a61-4114-45a8-aa5e-b5cec02d657f tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:52:29.525822 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-ebb26a61-4114-45a8-aa5e-b5cec02d657f tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c616f37f7714bdaaba2ae66226f37d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8cddf77e654ca7a88b55acca131a45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:52:29.533736 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-ebb26a61-4114-45a8-aa5e-b5cec02d657f tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] 10.222.0.43 "GET /compute/v2.1/servers/22f7508e-cc15-48a0-94ca-03680fb0bdc0" status: 200 len: 1697 microversion: 2.1 time: 0.155621 Oct 04 19:52:29.534315 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3662/7697] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:52:29 2022] GET /compute/v2.1/servers/22f7508e-cc15-48a0-94ca-03680fb0bdc0 => generated 1697 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:52:30.558024 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-97976396-0540-4ec2-9de6-3d70cb09cd73 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:52:30.558689 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-97976396-0540-4ec2-9de6-3d70cb09cd73 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] [instance: 22f7508e-cc15-48a0-94ca-03680fb0bdc0] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:52:30.565643 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-97976396-0540-4ec2-9de6-3d70cb09cd73 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:52:30.566147 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-97976396-0540-4ec2-9de6-3d70cb09cd73 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:52:30.566608 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-97976396-0540-4ec2-9de6-3d70cb09cd73 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:52:30.567320 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-97976396-0540-4ec2-9de6-3d70cb09cd73 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:52:30.567795 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-97976396-0540-4ec2-9de6-3d70cb09cd73 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:52:30.568240 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-97976396-0540-4ec2-9de6-3d70cb09cd73 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:52:30.700435 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-97976396-0540-4ec2-9de6-3d70cb09cd73 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c616f37f7714bdaaba2ae66226f37d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8cddf77e654ca7a88b55acca131a45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:52:30.708473 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-97976396-0540-4ec2-9de6-3d70cb09cd73 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] 10.222.0.43 "GET /compute/v2.1/servers/22f7508e-cc15-48a0-94ca-03680fb0bdc0" status: 200 len: 1697 microversion: 2.1 time: 0.154571 Oct 04 19:52:30.709047 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 4036/7698] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:52:30 2022] GET /compute/v2.1/servers/22f7508e-cc15-48a0-94ca-03680fb0bdc0 => generated 1697 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:52:31.733163 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-b3c99ba3-1503-4403-85cb-75097d499c3d tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:52:31.733788 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-b3c99ba3-1503-4403-85cb-75097d499c3d tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] [instance: 22f7508e-cc15-48a0-94ca-03680fb0bdc0] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:52:31.740664 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b3c99ba3-1503-4403-85cb-75097d499c3d tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:52:31.741186 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b3c99ba3-1503-4403-85cb-75097d499c3d tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:52:31.741631 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b3c99ba3-1503-4403-85cb-75097d499c3d tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:52:31.742335 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b3c99ba3-1503-4403-85cb-75097d499c3d tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:52:31.743424 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b3c99ba3-1503-4403-85cb-75097d499c3d tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:52:31.743858 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b3c99ba3-1503-4403-85cb-75097d499c3d tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:52:31.876359 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-b3c99ba3-1503-4403-85cb-75097d499c3d tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c616f37f7714bdaaba2ae66226f37d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8cddf77e654ca7a88b55acca131a45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:52:31.884405 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-b3c99ba3-1503-4403-85cb-75097d499c3d tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] 10.222.0.43 "GET /compute/v2.1/servers/22f7508e-cc15-48a0-94ca-03680fb0bdc0" status: 200 len: 1697 microversion: 2.1 time: 0.155258 Oct 04 19:52:31.885092 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3663/7699] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:52:31 2022] GET /compute/v2.1/servers/22f7508e-cc15-48a0-94ca-03680fb0bdc0 => generated 1697 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:52:32.909181 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-70297e7f-fb2f-4cd6-8a9c-5a8fa4478aba tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:52:32.909748 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-70297e7f-fb2f-4cd6-8a9c-5a8fa4478aba tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] [instance: 22f7508e-cc15-48a0-94ca-03680fb0bdc0] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:52:32.917204 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-70297e7f-fb2f-4cd6-8a9c-5a8fa4478aba tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:52:32.917712 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-70297e7f-fb2f-4cd6-8a9c-5a8fa4478aba tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:52:32.918172 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-70297e7f-fb2f-4cd6-8a9c-5a8fa4478aba tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:52:32.918917 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-70297e7f-fb2f-4cd6-8a9c-5a8fa4478aba tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:52:32.919388 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-70297e7f-fb2f-4cd6-8a9c-5a8fa4478aba tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:52:32.919836 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-70297e7f-fb2f-4cd6-8a9c-5a8fa4478aba tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:52:33.056277 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-70297e7f-fb2f-4cd6-8a9c-5a8fa4478aba tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c616f37f7714bdaaba2ae66226f37d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8cddf77e654ca7a88b55acca131a45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:52:33.064373 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-70297e7f-fb2f-4cd6-8a9c-5a8fa4478aba tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] 10.222.0.43 "GET /compute/v2.1/servers/22f7508e-cc15-48a0-94ca-03680fb0bdc0" status: 200 len: 1697 microversion: 2.1 time: 0.159322 Oct 04 19:52:33.064951 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 4037/7700] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:52:32 2022] GET /compute/v2.1/servers/22f7508e-cc15-48a0-94ca-03680fb0bdc0 => generated 1697 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:52:34.087806 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-eb16a69a-2207-4461-ad0d-a2284ce507ad tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:52:34.088433 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-eb16a69a-2207-4461-ad0d-a2284ce507ad tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] [instance: 22f7508e-cc15-48a0-94ca-03680fb0bdc0] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:52:34.095435 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-eb16a69a-2207-4461-ad0d-a2284ce507ad tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:52:34.095932 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-eb16a69a-2207-4461-ad0d-a2284ce507ad tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:52:34.096384 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-eb16a69a-2207-4461-ad0d-a2284ce507ad tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:52:34.097090 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-eb16a69a-2207-4461-ad0d-a2284ce507ad tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:52:34.097577 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-eb16a69a-2207-4461-ad0d-a2284ce507ad tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:52:34.098017 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-eb16a69a-2207-4461-ad0d-a2284ce507ad tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:52:34.232302 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-eb16a69a-2207-4461-ad0d-a2284ce507ad tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c616f37f7714bdaaba2ae66226f37d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8cddf77e654ca7a88b55acca131a45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:52:34.241173 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-eb16a69a-2207-4461-ad0d-a2284ce507ad tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] 10.222.0.43 "GET /compute/v2.1/servers/22f7508e-cc15-48a0-94ca-03680fb0bdc0" status: 200 len: 1697 microversion: 2.1 time: 0.157291 Oct 04 19:52:34.241799 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3664/7701] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:52:34 2022] GET /compute/v2.1/servers/22f7508e-cc15-48a0-94ca-03680fb0bdc0 => generated 1697 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:52:34.719399 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-60d03bc3-765d-46ce-936c-483189f3e644 req-fa583038-eda8-43b5-9388-362550dc4fc6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22f7508e-cc15-48a0-94ca-03680fb0bdc0", "name": "network-vif-unplugged", "status": "completed", "tag": "0ee3e439-cee7-475b-b86f-2c49a9bce71e"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:52:34.730604 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-60d03bc3-765d-46ce-936c-483189f3e644 req-fa583038-eda8-43b5-9388-362550dc4fc6 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:52:34.731184 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-60d03bc3-765d-46ce-936c-483189f3e644 req-fa583038-eda8-43b5-9388-362550dc4fc6 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:52:34.731732 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-60d03bc3-765d-46ce-936c-483189f3e644 req-fa583038-eda8-43b5-9388-362550dc4fc6 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:52:34.744489 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-60d03bc3-765d-46ce-936c-483189f3e644 req-fa583038-eda8-43b5-9388-362550dc4fc6 service nova] Creating event network-vif-unplugged:0ee3e439-cee7-475b-b86f-2c49a9bce71e for instance 22f7508e-cc15-48a0-94ca-03680fb0bdc0 on n-h2-851028-13 Oct 04 19:52:34.750336 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [req-60d03bc3-765d-46ce-936c-483189f3e644 req-fa583038-eda8-43b5-9388-362550dc4fc6 service nova] Instance 22f7508e-cc15-48a0-94ca-03680fb0bdc0 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851028-13', 'n-h2-851028-13'} {{(pid=123596) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 19:52:34.762132 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-60d03bc3-765d-46ce-936c-483189f3e644 req-fa583038-eda8-43b5-9388-362550dc4fc6 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046573 Oct 04 19:52:34.762753 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 4038/7702] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:52:34 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:52:35.264814 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-efebfe9e-c273-4190-9f60-e060bd2dffc1 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:52:35.265456 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-efebfe9e-c273-4190-9f60-e060bd2dffc1 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] [instance: 22f7508e-cc15-48a0-94ca-03680fb0bdc0] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:52:35.272219 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-efebfe9e-c273-4190-9f60-e060bd2dffc1 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:52:35.272699 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-efebfe9e-c273-4190-9f60-e060bd2dffc1 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:52:35.273159 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-efebfe9e-c273-4190-9f60-e060bd2dffc1 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:52:35.273860 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-efebfe9e-c273-4190-9f60-e060bd2dffc1 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:52:35.274314 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-efebfe9e-c273-4190-9f60-e060bd2dffc1 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:52:35.275357 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-efebfe9e-c273-4190-9f60-e060bd2dffc1 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:52:35.686886 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-efebfe9e-c273-4190-9f60-e060bd2dffc1 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c616f37f7714bdaaba2ae66226f37d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8cddf77e654ca7a88b55acca131a45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:52:35.694778 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-efebfe9e-c273-4190-9f60-e060bd2dffc1 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] 10.222.0.43 "GET /compute/v2.1/servers/22f7508e-cc15-48a0-94ca-03680fb0bdc0" status: 200 len: 1696 microversion: 2.1 time: 0.433958 Oct 04 19:52:35.695360 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3665/7703] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:52:35 2022] GET /compute/v2.1/servers/22f7508e-cc15-48a0-94ca-03680fb0bdc0 => generated 1696 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:52:36.720307 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-47b873a1-855f-446b-bd9f-2b1b6b6771b2 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:52:36.721048 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-47b873a1-855f-446b-bd9f-2b1b6b6771b2 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] [instance: 22f7508e-cc15-48a0-94ca-03680fb0bdc0] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:52:36.727665 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-47b873a1-855f-446b-bd9f-2b1b6b6771b2 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:52:36.728175 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-47b873a1-855f-446b-bd9f-2b1b6b6771b2 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:52:36.728629 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-47b873a1-855f-446b-bd9f-2b1b6b6771b2 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:52:36.729377 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-47b873a1-855f-446b-bd9f-2b1b6b6771b2 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:52:36.729845 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-47b873a1-855f-446b-bd9f-2b1b6b6771b2 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:52:36.730289 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-47b873a1-855f-446b-bd9f-2b1b6b6771b2 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:52:36.806840 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-131ec884-cd21-467e-89ea-ebdb71f94973 req-75b9b3e0-7410-42cd-bafb-8473f5588dd9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22f7508e-cc15-48a0-94ca-03680fb0bdc0", "tag": "0ee3e439-cee7-475b-b86f-2c49a9bce71e"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:52:36.817753 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-131ec884-cd21-467e-89ea-ebdb71f94973 req-75b9b3e0-7410-42cd-bafb-8473f5588dd9 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:52:36.818228 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-131ec884-cd21-467e-89ea-ebdb71f94973 req-75b9b3e0-7410-42cd-bafb-8473f5588dd9 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:52:36.818657 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-131ec884-cd21-467e-89ea-ebdb71f94973 req-75b9b3e0-7410-42cd-bafb-8473f5588dd9 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:52:36.830639 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-131ec884-cd21-467e-89ea-ebdb71f94973 req-75b9b3e0-7410-42cd-bafb-8473f5588dd9 service nova] Creating event network-changed:0ee3e439-cee7-475b-b86f-2c49a9bce71e for instance 22f7508e-cc15-48a0-94ca-03680fb0bdc0 on n-h2-851028-13 Oct 04 19:52:36.836081 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [req-131ec884-cd21-467e-89ea-ebdb71f94973 req-75b9b3e0-7410-42cd-bafb-8473f5588dd9 service nova] Instance 22f7508e-cc15-48a0-94ca-03680fb0bdc0 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851028-13', 'n-h2-851028-13'} {{(pid=123595) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 19:52:36.847626 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-131ec884-cd21-467e-89ea-ebdb71f94973 req-75b9b3e0-7410-42cd-bafb-8473f5588dd9 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044390 Oct 04 19:52:36.848253 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3666/7704] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:52:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:52:36.887545 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-47b873a1-855f-446b-bd9f-2b1b6b6771b2 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c616f37f7714bdaaba2ae66226f37d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8cddf77e654ca7a88b55acca131a45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:52:36.896431 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-47b873a1-855f-446b-bd9f-2b1b6b6771b2 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] 10.222.0.43 "GET /compute/v2.1/servers/22f7508e-cc15-48a0-94ca-03680fb0bdc0" status: 200 len: 1694 microversion: 2.1 time: 0.181239 Oct 04 19:52:36.897035 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 4039/7705] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:52:36 2022] GET /compute/v2.1/servers/22f7508e-cc15-48a0-94ca-03680fb0bdc0 => generated 1694 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:52:37.922659 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-eba17ee3-c26a-4fed-96c6-418c1fb47b23 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:52:37.923377 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-eba17ee3-c26a-4fed-96c6-418c1fb47b23 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] [instance: 22f7508e-cc15-48a0-94ca-03680fb0bdc0] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:52:37.929631 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-eba17ee3-c26a-4fed-96c6-418c1fb47b23 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:52:37.930128 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-eba17ee3-c26a-4fed-96c6-418c1fb47b23 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:52:37.930573 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-eba17ee3-c26a-4fed-96c6-418c1fb47b23 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:52:37.931272 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-eba17ee3-c26a-4fed-96c6-418c1fb47b23 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:52:37.931732 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-eba17ee3-c26a-4fed-96c6-418c1fb47b23 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:52:37.932167 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-eba17ee3-c26a-4fed-96c6-418c1fb47b23 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:52:38.069848 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-eba17ee3-c26a-4fed-96c6-418c1fb47b23 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c616f37f7714bdaaba2ae66226f37d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8cddf77e654ca7a88b55acca131a45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:52:38.078209 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-eba17ee3-c26a-4fed-96c6-418c1fb47b23 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] 10.222.0.43 "GET /compute/v2.1/servers/22f7508e-cc15-48a0-94ca-03680fb0bdc0" status: 200 len: 1691 microversion: 2.1 time: 0.161205 Oct 04 19:52:38.078832 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3667/7706] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:52:37 2022] GET /compute/v2.1/servers/22f7508e-cc15-48a0-94ca-03680fb0bdc0 => generated 1691 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:52:38.100699 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-097be9cd-42ec-4c4c-8710-1195e323ba4f tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:52:38.101303 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-097be9cd-42ec-4c4c-8710-1195e323ba4f tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] [instance: 22f7508e-cc15-48a0-94ca-03680fb0bdc0] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:52:38.108644 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-097be9cd-42ec-4c4c-8710-1195e323ba4f tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:52:38.109169 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-097be9cd-42ec-4c4c-8710-1195e323ba4f tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:52:38.109636 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-097be9cd-42ec-4c4c-8710-1195e323ba4f tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:52:38.110346 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-097be9cd-42ec-4c4c-8710-1195e323ba4f tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:52:38.110821 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-097be9cd-42ec-4c4c-8710-1195e323ba4f tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:52:38.111271 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-097be9cd-42ec-4c4c-8710-1195e323ba4f tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:52:38.168007 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-097be9cd-42ec-4c4c-8710-1195e323ba4f tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] 10.222.0.43 "POST /compute/v2.1/servers/22f7508e-cc15-48a0-94ca-03680fb0bdc0/action" status: 204 len: 0 microversion: 2.1 time: 0.071072 Oct 04 19:52:38.168754 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 4040/7707] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 19:52:38 2022] POST /compute/v2.1/servers/22f7508e-cc15-48a0-94ca-03680fb0bdc0/action => generated 0 bytes in 73 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:52:38.178269 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-852f6228-0982-42e8-a1dc-b40cefe104b1 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:52:38.179069 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-852f6228-0982-42e8-a1dc-b40cefe104b1 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] [instance: 22f7508e-cc15-48a0-94ca-03680fb0bdc0] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:52:38.186028 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-852f6228-0982-42e8-a1dc-b40cefe104b1 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:52:38.186669 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-852f6228-0982-42e8-a1dc-b40cefe104b1 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:52:38.187226 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-852f6228-0982-42e8-a1dc-b40cefe104b1 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:52:38.188034 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-852f6228-0982-42e8-a1dc-b40cefe104b1 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:52:38.188721 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-852f6228-0982-42e8-a1dc-b40cefe104b1 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:52:38.189694 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-852f6228-0982-42e8-a1dc-b40cefe104b1 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:52:38.335056 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-852f6228-0982-42e8-a1dc-b40cefe104b1 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c616f37f7714bdaaba2ae66226f37d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8cddf77e654ca7a88b55acca131a45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:52:38.343973 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-852f6228-0982-42e8-a1dc-b40cefe104b1 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] 10.222.0.43 "GET /compute/v2.1/servers/22f7508e-cc15-48a0-94ca-03680fb0bdc0" status: 200 len: 1691 microversion: 2.1 time: 0.169709 Oct 04 19:52:38.344558 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3668/7708] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:52:38 2022] GET /compute/v2.1/servers/22f7508e-cc15-48a0-94ca-03680fb0bdc0 => generated 1691 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:52:38.367638 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-0ffe9355-ee8f-449c-a829-ce301fe19da3 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:52:38.368361 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-0ffe9355-ee8f-449c-a829-ce301fe19da3 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] [instance: 22f7508e-cc15-48a0-94ca-03680fb0bdc0] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:52:38.375333 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0ffe9355-ee8f-449c-a829-ce301fe19da3 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:52:38.375844 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0ffe9355-ee8f-449c-a829-ce301fe19da3 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:52:38.376305 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0ffe9355-ee8f-449c-a829-ce301fe19da3 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:52:38.377089 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0ffe9355-ee8f-449c-a829-ce301fe19da3 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:52:38.377590 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0ffe9355-ee8f-449c-a829-ce301fe19da3 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:52:38.378039 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0ffe9355-ee8f-449c-a829-ce301fe19da3 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:52:38.913997 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-0ffe9355-ee8f-449c-a829-ce301fe19da3 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c616f37f7714bdaaba2ae66226f37d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8cddf77e654ca7a88b55acca131a45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:52:38.922709 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-0ffe9355-ee8f-449c-a829-ce301fe19da3 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] 10.222.0.43 "GET /compute/v2.1/servers/22f7508e-cc15-48a0-94ca-03680fb0bdc0" status: 200 len: 1691 microversion: 2.1 time: 0.559418 Oct 04 19:52:38.923303 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 4041/7709] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:52:38 2022] GET /compute/v2.1/servers/22f7508e-cc15-48a0-94ca-03680fb0bdc0 => generated 1691 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:52:39.946694 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-16bf602e-42f0-4bf1-84e5-97c15c933718 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:52:39.947336 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-16bf602e-42f0-4bf1-84e5-97c15c933718 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] [instance: 22f7508e-cc15-48a0-94ca-03680fb0bdc0] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:52:39.954123 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-16bf602e-42f0-4bf1-84e5-97c15c933718 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:52:39.954608 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-16bf602e-42f0-4bf1-84e5-97c15c933718 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:52:39.955051 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-16bf602e-42f0-4bf1-84e5-97c15c933718 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:52:39.956028 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-16bf602e-42f0-4bf1-84e5-97c15c933718 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:52:39.956481 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-16bf602e-42f0-4bf1-84e5-97c15c933718 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:52:39.956907 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-16bf602e-42f0-4bf1-84e5-97c15c933718 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:52:40.086701 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-16bf602e-42f0-4bf1-84e5-97c15c933718 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c616f37f7714bdaaba2ae66226f37d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8cddf77e654ca7a88b55acca131a45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:52:40.095129 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-16bf602e-42f0-4bf1-84e5-97c15c933718 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] 10.222.0.43 "GET /compute/v2.1/servers/22f7508e-cc15-48a0-94ca-03680fb0bdc0" status: 200 len: 1683 microversion: 2.1 time: 0.152359 Oct 04 19:52:40.095719 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3669/7710] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:52:39 2022] GET /compute/v2.1/servers/22f7508e-cc15-48a0-94ca-03680fb0bdc0 => generated 1683 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:52:41.087969 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-366ba11e-0336-42fb-9711-20c9a864216b req-ce82520e-7ff3-4acb-8980-43fc219e4712 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22f7508e-cc15-48a0-94ca-03680fb0bdc0", "name": "network-vif-plugged", "status": "completed", "tag": "0ee3e439-cee7-475b-b86f-2c49a9bce71e"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:52:41.098271 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-366ba11e-0336-42fb-9711-20c9a864216b req-ce82520e-7ff3-4acb-8980-43fc219e4712 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:52:41.099422 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-366ba11e-0336-42fb-9711-20c9a864216b req-ce82520e-7ff3-4acb-8980-43fc219e4712 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:52:41.099422 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-366ba11e-0336-42fb-9711-20c9a864216b req-ce82520e-7ff3-4acb-8980-43fc219e4712 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:52:41.110863 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-366ba11e-0336-42fb-9711-20c9a864216b req-ce82520e-7ff3-4acb-8980-43fc219e4712 service nova] Creating event network-vif-plugged:0ee3e439-cee7-475b-b86f-2c49a9bce71e for instance 22f7508e-cc15-48a0-94ca-03680fb0bdc0 on n-h2-851028-13 Oct 04 19:52:41.115901 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-366ba11e-0336-42fb-9711-20c9a864216b req-ce82520e-7ff3-4acb-8980-43fc219e4712 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087852 Oct 04 19:52:41.116524 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 4042/7711] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:52:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:53:02.270175 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-11fee962-6285-4605-9f84-45944b465d93 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:53:02.272582 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-11fee962-6285-4605-9f84-45944b465d93 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] [instance: 22f7508e-cc15-48a0-94ca-03680fb0bdc0] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:53:02.275652 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_api:SELECT=28 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:53:02.276342 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=82 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:53:02.282538 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-11fee962-6285-4605-9f84-45944b465d93 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:53:02.283032 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-11fee962-6285-4605-9f84-45944b465d93 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:53:02.283481 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-11fee962-6285-4605-9f84-45944b465d93 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:53:02.284192 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-11fee962-6285-4605-9f84-45944b465d93 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:53:02.284692 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-11fee962-6285-4605-9f84-45944b465d93 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:53:02.285163 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-11fee962-6285-4605-9f84-45944b465d93 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:53:02.336654 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-11fee962-6285-4605-9f84-45944b465d93 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] 10.222.0.43 "POST /compute/v2.1/servers/22f7508e-cc15-48a0-94ca-03680fb0bdc0/action" status: 200 len: 24576 microversion: 2.1 time: 0.070966 Oct 04 19:53:02.337392 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3670/7712] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 19:53:02 2022] POST /compute/v2.1/servers/22f7508e-cc15-48a0-94ca-03680fb0bdc0/action => generated 24576 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 19:53:09.370719 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_api:SELECT=32 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:53:09.372154 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:53:09.378953 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-dba28262-b95e-40c4-8659-97373c6dc3df tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:53:09.379652 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-dba28262-b95e-40c4-8659-97373c6dc3df tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] [instance: 22f7508e-cc15-48a0-94ca-03680fb0bdc0] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:53:09.388324 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dba28262-b95e-40c4-8659-97373c6dc3df tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:53:09.388908 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dba28262-b95e-40c4-8659-97373c6dc3df tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:53:09.389464 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dba28262-b95e-40c4-8659-97373c6dc3df tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:53:09.390266 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dba28262-b95e-40c4-8659-97373c6dc3df tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:53:09.391335 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dba28262-b95e-40c4-8659-97373c6dc3df tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:53:09.391871 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dba28262-b95e-40c4-8659-97373c6dc3df tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:53:09.420679 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-dba28262-b95e-40c4-8659-97373c6dc3df tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] [instance: 22f7508e-cc15-48a0-94ca-03680fb0bdc0] Going to try to terminate instance {{(pid=123596) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 19:53:09.440606 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-8bf62d6a-2e7f-4986-ac5e-63fd72f44125 req-3560ba7f-2a15-4e2c-852d-d6d269a8656d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22f7508e-cc15-48a0-94ca-03680fb0bdc0", "tag": "0ee3e439-cee7-475b-b86f-2c49a9bce71e"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:53:09.452098 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-8bf62d6a-2e7f-4986-ac5e-63fd72f44125 req-3560ba7f-2a15-4e2c-852d-d6d269a8656d service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:53:09.452768 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-8bf62d6a-2e7f-4986-ac5e-63fd72f44125 req-3560ba7f-2a15-4e2c-852d-d6d269a8656d service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:53:09.453156 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-8bf62d6a-2e7f-4986-ac5e-63fd72f44125 req-3560ba7f-2a15-4e2c-852d-d6d269a8656d service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:53:09.465615 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-8bf62d6a-2e7f-4986-ac5e-63fd72f44125 req-3560ba7f-2a15-4e2c-852d-d6d269a8656d service nova] Creating event network-changed:0ee3e439-cee7-475b-b86f-2c49a9bce71e for instance 22f7508e-cc15-48a0-94ca-03680fb0bdc0 on n-h2-851028-13 Oct 04 19:53:09.471441 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-8bf62d6a-2e7f-4986-ac5e-63fd72f44125 req-3560ba7f-2a15-4e2c-852d-d6d269a8656d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100915 Oct 04 19:53:09.472260 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3671/7713] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:53:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:53:09.508305 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-dba28262-b95e-40c4-8659-97373c6dc3df tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] 10.222.0.43 "DELETE /compute/v2.1/servers/22f7508e-cc15-48a0-94ca-03680fb0bdc0" status: 204 len: 0 microversion: 2.1 time: 0.139899 Oct 04 19:53:09.509679 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 4043/7714] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 19:53:09 2022] DELETE /compute/v2.1/servers/22f7508e-cc15-48a0-94ca-03680fb0bdc0 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:53:09.519296 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-b6f26739-9251-4081-b01d-63e53470e09c tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:53:09.520153 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-b6f26739-9251-4081-b01d-63e53470e09c tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] [instance: 22f7508e-cc15-48a0-94ca-03680fb0bdc0] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:53:09.527321 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b6f26739-9251-4081-b01d-63e53470e09c tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:53:09.528183 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b6f26739-9251-4081-b01d-63e53470e09c tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:53:09.528753 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b6f26739-9251-4081-b01d-63e53470e09c tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:53:09.529573 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b6f26739-9251-4081-b01d-63e53470e09c tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:53:09.530247 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b6f26739-9251-4081-b01d-63e53470e09c tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:53:09.530771 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b6f26739-9251-4081-b01d-63e53470e09c tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:53:09.672341 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-b6f26739-9251-4081-b01d-63e53470e09c tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c616f37f7714bdaaba2ae66226f37d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8cddf77e654ca7a88b55acca131a45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:53:09.680259 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-b6f26739-9251-4081-b01d-63e53470e09c tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] 10.222.0.43 "GET /compute/v2.1/servers/22f7508e-cc15-48a0-94ca-03680fb0bdc0" status: 200 len: 1689 microversion: 2.1 time: 0.165987 Oct 04 19:53:09.680836 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3672/7715] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:53:09 2022] GET /compute/v2.1/servers/22f7508e-cc15-48a0-94ca-03680fb0bdc0 => generated 1689 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:53:10.705083 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-5f738b7c-f9a1-4516-9bd7-e2905cb4b6c8 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:53:10.706106 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-5f738b7c-f9a1-4516-9bd7-e2905cb4b6c8 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] [instance: 22f7508e-cc15-48a0-94ca-03680fb0bdc0] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:53:10.712899 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5f738b7c-f9a1-4516-9bd7-e2905cb4b6c8 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:53:10.713435 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5f738b7c-f9a1-4516-9bd7-e2905cb4b6c8 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:53:10.713907 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5f738b7c-f9a1-4516-9bd7-e2905cb4b6c8 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:53:10.714648 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5f738b7c-f9a1-4516-9bd7-e2905cb4b6c8 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:53:10.715128 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5f738b7c-f9a1-4516-9bd7-e2905cb4b6c8 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:53:10.715582 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5f738b7c-f9a1-4516-9bd7-e2905cb4b6c8 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:53:10.937789 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-5f738b7c-f9a1-4516-9bd7-e2905cb4b6c8 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c616f37f7714bdaaba2ae66226f37d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8cddf77e654ca7a88b55acca131a45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:53:10.946667 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-5f738b7c-f9a1-4516-9bd7-e2905cb4b6c8 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] 10.222.0.43 "GET /compute/v2.1/servers/22f7508e-cc15-48a0-94ca-03680fb0bdc0" status: 200 len: 1689 microversion: 2.1 time: 0.246502 Oct 04 19:53:10.947258 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 4044/7716] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:53:10 2022] GET /compute/v2.1/servers/22f7508e-cc15-48a0-94ca-03680fb0bdc0 => generated 1689 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:53:11.486109 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-0becc65b-6f4b-4380-9372-e07215ed0532 req-ee06d74b-880f-48c3-94ca-6ec9fa162bc3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22f7508e-cc15-48a0-94ca-03680fb0bdc0", "name": "network-vif-deleted", "tag": "0ee3e439-cee7-475b-b86f-2c49a9bce71e"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:53:11.497593 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-0becc65b-6f4b-4380-9372-e07215ed0532 req-ee06d74b-880f-48c3-94ca-6ec9fa162bc3 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:53:11.498110 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-0becc65b-6f4b-4380-9372-e07215ed0532 req-ee06d74b-880f-48c3-94ca-6ec9fa162bc3 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:53:11.498594 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-0becc65b-6f4b-4380-9372-e07215ed0532 req-ee06d74b-880f-48c3-94ca-6ec9fa162bc3 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:53:11.510167 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-0becc65b-6f4b-4380-9372-e07215ed0532 req-ee06d74b-880f-48c3-94ca-6ec9fa162bc3 service nova] Creating event network-vif-deleted:0ee3e439-cee7-475b-b86f-2c49a9bce71e for instance 22f7508e-cc15-48a0-94ca-03680fb0bdc0 on n-h2-851028-13 Oct 04 19:53:11.515114 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-0becc65b-6f4b-4380-9372-e07215ed0532 req-ee06d74b-880f-48c3-94ca-6ec9fa162bc3 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032757 Oct 04 19:53:11.515992 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3673/7717] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:53:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:53:11.970530 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-cd6ba3e8-c13e-41c2-867a-39d81a656479 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:53:11.971198 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-cd6ba3e8-c13e-41c2-867a-39d81a656479 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] [instance: 22f7508e-cc15-48a0-94ca-03680fb0bdc0] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:53:11.978209 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cd6ba3e8-c13e-41c2-867a-39d81a656479 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:53:11.978654 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cd6ba3e8-c13e-41c2-867a-39d81a656479 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:53:11.979110 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cd6ba3e8-c13e-41c2-867a-39d81a656479 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:53:11.979821 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cd6ba3e8-c13e-41c2-867a-39d81a656479 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:53:11.980294 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cd6ba3e8-c13e-41c2-867a-39d81a656479 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:53:11.980742 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cd6ba3e8-c13e-41c2-867a-39d81a656479 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:53:11.994157 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-cd6ba3e8-c13e-41c2-867a-39d81a656479 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] HTTP exception thrown: Instance 22f7508e-cc15-48a0-94ca-03680fb0bdc0 could not be found. Oct 04 19:53:11.995848 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-cd6ba3e8-c13e-41c2-867a-39d81a656479 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Request method failure captured: Oct 04 19:53:11.995848 n-d-851028-13 devstack@n-api.service[123596]: request: GET /compute/v2.1/servers/22f7508e-cc15-48a0-94ca-03680fb0bdc0 HTTP/1.1 Oct 04 19:53:11.995848 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 19:53:11.995848 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 19:53:11.995848 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 19:53:11.995848 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 19:53:11.995848 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 19:53:11.995848 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 19:53:11.995848 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 19:53:11.995848 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 19:53:11.995848 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPI4MZexuhXm6PsbDTE0mN_HzaWvpyBNcmZcptu-WN0BUo7VbC1tcPqUVzrRf31db8M0EWQ8d_sfA5FFL6AhajMMcCPlTBrfm9fKnWc8kbZzl3TY06xFuGGx0ZPCeDpUjJED_TcND6oWmolrrMBlfCNdyr-yMj_WCseJ7TPmrL_dgAc0 Oct 04 19:53:11.995848 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 19:53:11.995848 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 19:53:11.995848 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 19:53:11.995848 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 19:53:11.995848 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 19:53:11.995848 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 19:53:11.995848 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: bc8cddf77e654ca7a88b55acca131a45 Oct 04 19:53:11.995848 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-238299873 Oct 04 19:53:11.995848 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 19:53:11.995848 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 19:53:11.995848 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/bc8cddf77e654ca7a88b55acca131a45"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_bc8cddf77e654ca7a88b55acca131a45"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/bc8cddf77e654ca7a88b55acca131a45"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/bc8cddf77e654ca7a88b55acca131a45"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 19:53:11.995848 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-TestNetworkAdvancedServerOps-238299873 Oct 04 19:53:11.995848 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: bc8cddf77e654ca7a88b55acca131a45 Oct 04 19:53:11.995848 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-238299873 Oct 04 19:53:11.995848 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-TestNetworkAdvancedServerOps-238299873-project Oct 04 19:53:11.995848 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 19:53:11.995848 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 19:53:11.995848 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 6c616f37f7714bdaaba2ae66226f37d8 Oct 04 19:53:11.995848 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-TestNetworkAdvancedServerOps-238299873-project Oct 04 19:53:11.995848 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 19:53:11.995848 n-d-851028-13 devstack@n-api.service[123596]: exception: Instance 22f7508e-cc15-48a0-94ca-03680fb0bdc0 could not be found. Oct 04 19:53:11.995848 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': '22f7508e-cc15-48a0-94ca-03680fb0bdc0'} Oct 04 19:53:11.995848 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:53:11.995848 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:53:11.995848 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:53:11.995848 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:53:11.995848 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:53:11.995848 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:53:11.995848 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:53:11.995848 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:53:11.995848 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:53:11.995848 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:53:11.995848 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22f7508e-cc15-48a0-94ca-03680fb0bdc0 could not be found. Oct 04 19:53:11.995848 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:53:11.995848 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:53:11.995848 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:53:11.995848 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:53:11.995848 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:53:11.995848 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:53:11.995848 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:53:11.995848 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:53:11.995848 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:53:11.995848 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:53:11.995848 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:53:11.995848 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:53:11.995848 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:53:11.995848 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:53:11.995848 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:53:11.995848 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:53:11.995848 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22f7508e-cc15-48a0-94ca-03680fb0bdc0 could not be found. Oct 04 19:53:11.995848 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:53:11.995848 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:53:12.001002 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:53:12.001002 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:53:12.001002 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:53:12.001002 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:53:12.001002 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:53:12.001002 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:53:12.001002 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22f7508e-cc15-48a0-94ca-03680fb0bdc0 could not be found. Oct 04 19:53:12.001002 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:53:12.001002 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-cd6ba3e8-c13e-41c2-867a-39d81a656479 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Returning 404 to user: Instance 22f7508e-cc15-48a0-94ca-03680fb0bdc0 could not be found. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:53:12.001002 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-cd6ba3e8-c13e-41c2-867a-39d81a656479 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] 10.222.0.43 "GET /compute/v2.1/servers/22f7508e-cc15-48a0-94ca-03680fb0bdc0" status: 404 len: 111 microversion: 2.1 time: 0.030708 Oct 04 19:53:12.001002 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 4045/7718] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:53:11 2022] GET /compute/v2.1/servers/22f7508e-cc15-48a0-94ca-03680fb0bdc0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:53:15.074368 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-8534d082-e779-482b-87d3-0720469195de tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Calling method '.version_select at 0x7fb21e6f6700>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:53:15.096942 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-8534d082-e779-482b-87d3-0720469195de tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-620380165" status: 202 len: 0 microversion: 2.1 time: 0.028828 Oct 04 19:53:15.097626 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3674/7719] 10.222.0.43 () {58 vars in 1281 bytes} [Tue Oct 4 19:53:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-620380165 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 19:53:15.129337 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-41fb4f8e-5584-4805-acd1-a28872c70926 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Action: 'create', calling method: .version_select at 0x7fb21ea605e0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1659333643", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJlLJvSnCV/clv1qs2aGVZHnRkOmQnrlBPS+AZiogXrqrKM4eGWnxfBh6x1MS3U/zAMHkJVezGbS8KILMKUGfKcn4eRy3a3BNwh6ijW6bPoUVd7ShsQABvrLC0pfGhPhGA=="}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:53:15.153825 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-41fb4f8e-5584-4805-acd1-a28872c70926 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Getting quotas for project bc8cddf77e654ca7a88b55acca131a45. Resources: {'key_pairs'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:53:15.162165 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-41fb4f8e-5584-4805-acd1-a28872c70926 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Getting quotas for user 6c616f37f7714bdaaba2ae66226f37d8 and project bc8cddf77e654ca7a88b55acca131a45. Resources: {'key_pairs'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:53:15.191102 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-41fb4f8e-5584-4805-acd1-a28872c70926 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.066854 Oct 04 19:53:15.191799 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 4046/7720] 10.222.0.43 () {60 vars in 1159 bytes} [Tue Oct 4 19:53:15 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:53:21.100264 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-3e1ec771-1c70-472a-b632-13eb37c16f01 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1301912120", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452", "networks": [{"uuid": "611f8593-e75e-435c-917a-823e12606929"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1659333643", "security_groups": [{"name": "tempest-secgroup-smoke-325371312"}]}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:53:21.242499 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.network.neutron [None req-3e1ec771-1c70-472a-b632-13eb37c16f01 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] validate_networks() for [('611f8593-e75e-435c-917a-823e12606929', None, None, None, None, None)] {{(pid=123595) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 19:53:21.504065 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=14 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:53:22.028169 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-3e1ec771-1c70-472a-b632-13eb37c16f01 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Flavor limits 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:53:22.028765 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-3e1ec771-1c70-472a-b632-13eb37c16f01 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Image limits 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:53:22.029496 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-3e1ec771-1c70-472a-b632-13eb37c16f01 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Flavor pref 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:53:22.030136 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-3e1ec771-1c70-472a-b632-13eb37c16f01 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Image pref 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:53:22.030624 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-3e1ec771-1c70-472a-b632-13eb37c16f01 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:53:22.040661 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3e1ec771-1c70-472a-b632-13eb37c16f01 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:53:22.041453 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3e1ec771-1c70-472a-b632-13eb37c16f01 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:53:22.049775 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3e1ec771-1c70-472a-b632-13eb37c16f01 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:53:22.050683 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3e1ec771-1c70-472a-b632-13eb37c16f01 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:53:22.051239 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3e1ec771-1c70-472a-b632-13eb37c16f01 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:53:22.051759 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3e1ec771-1c70-472a-b632-13eb37c16f01 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:53:22.076032 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-3e1ec771-1c70-472a-b632-13eb37c16f01 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Getting quotas for project bc8cddf77e654ca7a88b55acca131a45. Resources: {'ram', 'cores', 'instances'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:53:22.082053 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-3e1ec771-1c70-472a-b632-13eb37c16f01 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Getting quotas for user 6c616f37f7714bdaaba2ae66226f37d8 and project bc8cddf77e654ca7a88b55acca131a45. Resources: {'ram', 'cores', 'instances'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:53:22.098052 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-3e1ec771-1c70-472a-b632-13eb37c16f01 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Going to run 1 instances... {{(pid=123595) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 19:53:22.101094 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-3e1ec771-1c70-472a-b632-13eb37c16f01 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] [instance: 6d7b0924-928d-42bf-8a1c-cfa3fd7ba30d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e8943ec5-4038-4d4b-b9b9-2415a79f5243',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 19:53:22.164852 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-3e1ec771-1c70-472a-b632-13eb37c16f01 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.072101 Oct 04 19:53:22.165781 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3675/7721] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 19:53:21 2022] POST /compute/v2.1/servers => generated 405 bytes in 1074 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 19:53:22.175571 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:53:22.182611 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-fd7d6205-0623-43d7-9b7d-a27b1bf168c6 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:53:22.183507 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-fd7d6205-0623-43d7-9b7d-a27b1bf168c6 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] [instance: 6d7b0924-928d-42bf-8a1c-cfa3fd7ba30d] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:53:22.249819 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-fd7d6205-0623-43d7-9b7d-a27b1bf168c6 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c616f37f7714bdaaba2ae66226f37d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8cddf77e654ca7a88b55acca131a45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:53:22.260105 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-fd7d6205-0623-43d7-9b7d-a27b1bf168c6 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] 10.222.0.43 "GET /compute/v2.1/servers/6d7b0924-928d-42bf-8a1c-cfa3fd7ba30d" status: 200 len: 1267 microversion: 2.1 time: 0.087028 Oct 04 19:53:22.268678 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 4047/7722] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:53:22 2022] GET /compute/v2.1/servers/6d7b0924-928d-42bf-8a1c-cfa3fd7ba30d => generated 1267 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:53:23.289909 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-6126dbc5-dc25-46b9-a558-d7e6a9f94580 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:53:23.291128 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-6126dbc5-dc25-46b9-a558-d7e6a9f94580 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] [instance: 6d7b0924-928d-42bf-8a1c-cfa3fd7ba30d] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:53:23.311983 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6126dbc5-dc25-46b9-a558-d7e6a9f94580 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:53:23.314324 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6126dbc5-dc25-46b9-a558-d7e6a9f94580 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:53:23.315952 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6126dbc5-dc25-46b9-a558-d7e6a9f94580 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:53:23.318582 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6126dbc5-dc25-46b9-a558-d7e6a9f94580 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:53:23.320414 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6126dbc5-dc25-46b9-a558-d7e6a9f94580 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:53:23.321237 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6126dbc5-dc25-46b9-a558-d7e6a9f94580 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:53:23.457708 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-6126dbc5-dc25-46b9-a558-d7e6a9f94580 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c616f37f7714bdaaba2ae66226f37d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8cddf77e654ca7a88b55acca131a45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:53:23.471253 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-6126dbc5-dc25-46b9-a558-d7e6a9f94580 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] 10.222.0.43 "GET /compute/v2.1/servers/6d7b0924-928d-42bf-8a1c-cfa3fd7ba30d" status: 200 len: 1327 microversion: 2.1 time: 0.190285 Oct 04 19:53:23.473102 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3676/7723] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:53:23 2022] GET /compute/v2.1/servers/6d7b0924-928d-42bf-8a1c-cfa3fd7ba30d => generated 1327 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:53:24.514267 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-cff789c2-156a-4c09-8ed7-9e9749eadceb tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:53:24.515652 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-cff789c2-156a-4c09-8ed7-9e9749eadceb tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] [instance: 6d7b0924-928d-42bf-8a1c-cfa3fd7ba30d] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:53:24.524342 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cff789c2-156a-4c09-8ed7-9e9749eadceb tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:53:24.524863 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cff789c2-156a-4c09-8ed7-9e9749eadceb tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:53:24.525881 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cff789c2-156a-4c09-8ed7-9e9749eadceb tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:53:24.526635 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cff789c2-156a-4c09-8ed7-9e9749eadceb tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:53:24.527117 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cff789c2-156a-4c09-8ed7-9e9749eadceb tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:53:24.527894 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-cff789c2-156a-4c09-8ed7-9e9749eadceb tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:53:24.754230 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-cff789c2-156a-4c09-8ed7-9e9749eadceb tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c616f37f7714bdaaba2ae66226f37d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8cddf77e654ca7a88b55acca131a45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:53:24.762553 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-cff789c2-156a-4c09-8ed7-9e9749eadceb tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] 10.222.0.43 "GET /compute/v2.1/servers/6d7b0924-928d-42bf-8a1c-cfa3fd7ba30d" status: 200 len: 1392 microversion: 2.1 time: 0.253443 Oct 04 19:53:24.763179 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 4048/7724] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:53:24 2022] GET /compute/v2.1/servers/6d7b0924-928d-42bf-8a1c-cfa3fd7ba30d => generated 1392 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:53:25.083149 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-8fb6b066-895f-41ec-8b8c-b760dcd85222 req-9efc24cf-50ef-4298-88cb-f0a74dec6bb7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d7b0924-928d-42bf-8a1c-cfa3fd7ba30d", "tag": "b4dd3dab-1381-45f9-adf2-0233b29ab819"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:53:25.096295 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-8fb6b066-895f-41ec-8b8c-b760dcd85222 req-9efc24cf-50ef-4298-88cb-f0a74dec6bb7 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:53:25.096940 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-8fb6b066-895f-41ec-8b8c-b760dcd85222 req-9efc24cf-50ef-4298-88cb-f0a74dec6bb7 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:53:25.097426 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-8fb6b066-895f-41ec-8b8c-b760dcd85222 req-9efc24cf-50ef-4298-88cb-f0a74dec6bb7 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:53:25.111448 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-8fb6b066-895f-41ec-8b8c-b760dcd85222 req-9efc24cf-50ef-4298-88cb-f0a74dec6bb7 service nova] Creating event network-changed:b4dd3dab-1381-45f9-adf2-0233b29ab819 for instance 6d7b0924-928d-42bf-8a1c-cfa3fd7ba30d on n-h1-851028-13 Oct 04 19:53:25.116601 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-8fb6b066-895f-41ec-8b8c-b760dcd85222 req-9efc24cf-50ef-4298-88cb-f0a74dec6bb7 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037663 Oct 04 19:53:25.117702 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3677/7725] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:53:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:53:25.787884 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-b55530c2-1bb5-45a9-8c3e-af375688420d tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:53:25.788534 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-b55530c2-1bb5-45a9-8c3e-af375688420d tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] [instance: 6d7b0924-928d-42bf-8a1c-cfa3fd7ba30d] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:53:25.795900 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b55530c2-1bb5-45a9-8c3e-af375688420d tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:53:25.796416 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b55530c2-1bb5-45a9-8c3e-af375688420d tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:53:25.796886 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b55530c2-1bb5-45a9-8c3e-af375688420d tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:53:25.797703 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b55530c2-1bb5-45a9-8c3e-af375688420d tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:53:25.798209 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b55530c2-1bb5-45a9-8c3e-af375688420d tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:53:25.798664 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b55530c2-1bb5-45a9-8c3e-af375688420d tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:53:25.939313 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-b55530c2-1bb5-45a9-8c3e-af375688420d tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c616f37f7714bdaaba2ae66226f37d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8cddf77e654ca7a88b55acca131a45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:53:25.947274 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-b55530c2-1bb5-45a9-8c3e-af375688420d tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] 10.222.0.43 "GET /compute/v2.1/servers/6d7b0924-928d-42bf-8a1c-cfa3fd7ba30d" status: 200 len: 1392 microversion: 2.1 time: 0.163558 Oct 04 19:53:25.947875 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 4049/7726] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:53:25 2022] GET /compute/v2.1/servers/6d7b0924-928d-42bf-8a1c-cfa3fd7ba30d => generated 1392 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:53:26.971307 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-261603b2-53e5-446b-9f1a-f6b627fc6f0c tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:53:26.972021 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-261603b2-53e5-446b-9f1a-f6b627fc6f0c tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] [instance: 6d7b0924-928d-42bf-8a1c-cfa3fd7ba30d] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:53:26.979426 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-261603b2-53e5-446b-9f1a-f6b627fc6f0c tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:53:26.979922 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-261603b2-53e5-446b-9f1a-f6b627fc6f0c tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:53:26.980370 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-261603b2-53e5-446b-9f1a-f6b627fc6f0c tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:53:26.981072 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-261603b2-53e5-446b-9f1a-f6b627fc6f0c tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:53:26.981582 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-261603b2-53e5-446b-9f1a-f6b627fc6f0c tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:53:26.982021 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-261603b2-53e5-446b-9f1a-f6b627fc6f0c tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:53:27.115886 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-261603b2-53e5-446b-9f1a-f6b627fc6f0c tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c616f37f7714bdaaba2ae66226f37d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8cddf77e654ca7a88b55acca131a45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:53:27.123739 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-261603b2-53e5-446b-9f1a-f6b627fc6f0c tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] 10.222.0.43 "GET /compute/v2.1/servers/6d7b0924-928d-42bf-8a1c-cfa3fd7ba30d" status: 200 len: 1392 microversion: 2.1 time: 0.156812 Oct 04 19:53:27.124304 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3678/7727] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:53:26 2022] GET /compute/v2.1/servers/6d7b0924-928d-42bf-8a1c-cfa3fd7ba30d => generated 1392 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:53:28.147906 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-986b90b3-bea7-4037-b2de-aa29763f583a tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:53:28.148489 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-986b90b3-bea7-4037-b2de-aa29763f583a tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] [instance: 6d7b0924-928d-42bf-8a1c-cfa3fd7ba30d] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:53:28.155541 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-986b90b3-bea7-4037-b2de-aa29763f583a tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:53:28.156058 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-986b90b3-bea7-4037-b2de-aa29763f583a tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:53:28.159897 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-986b90b3-bea7-4037-b2de-aa29763f583a tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:53:28.160737 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-986b90b3-bea7-4037-b2de-aa29763f583a tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:53:28.161286 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-986b90b3-bea7-4037-b2de-aa29763f583a tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:53:28.162381 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-986b90b3-bea7-4037-b2de-aa29763f583a tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:53:28.312934 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-986b90b3-bea7-4037-b2de-aa29763f583a tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c616f37f7714bdaaba2ae66226f37d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8cddf77e654ca7a88b55acca131a45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:53:28.322447 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-986b90b3-bea7-4037-b2de-aa29763f583a tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] 10.222.0.43 "GET /compute/v2.1/servers/6d7b0924-928d-42bf-8a1c-cfa3fd7ba30d" status: 200 len: 1392 microversion: 2.1 time: 0.178599 Oct 04 19:53:28.323168 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 4050/7728] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:53:28 2022] GET /compute/v2.1/servers/6d7b0924-928d-42bf-8a1c-cfa3fd7ba30d => generated 1392 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:53:29.398031 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-8b10b176-7d72-4e29-b066-1e73eaa455a3 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:53:29.398659 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-8b10b176-7d72-4e29-b066-1e73eaa455a3 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] [instance: 6d7b0924-928d-42bf-8a1c-cfa3fd7ba30d] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:53:29.404946 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8b10b176-7d72-4e29-b066-1e73eaa455a3 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:53:29.405496 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8b10b176-7d72-4e29-b066-1e73eaa455a3 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:53:29.405954 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8b10b176-7d72-4e29-b066-1e73eaa455a3 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:53:29.406671 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8b10b176-7d72-4e29-b066-1e73eaa455a3 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:53:29.407135 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8b10b176-7d72-4e29-b066-1e73eaa455a3 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:53:29.407584 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8b10b176-7d72-4e29-b066-1e73eaa455a3 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:53:29.489274 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-58c2bc96-6218-4f7c-abcf-2f0b4b4ba4d9 req-44804438-e0df-45dc-8950-ebdf422e23f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d7b0924-928d-42bf-8a1c-cfa3fd7ba30d", "name": "network-vif-plugged", "status": "completed", "tag": "b4dd3dab-1381-45f9-adf2-0233b29ab819"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:53:29.505257 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-58c2bc96-6218-4f7c-abcf-2f0b4b4ba4d9 req-44804438-e0df-45dc-8950-ebdf422e23f9 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:53:29.505966 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-58c2bc96-6218-4f7c-abcf-2f0b4b4ba4d9 req-44804438-e0df-45dc-8950-ebdf422e23f9 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:53:29.506437 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-58c2bc96-6218-4f7c-abcf-2f0b4b4ba4d9 req-44804438-e0df-45dc-8950-ebdf422e23f9 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:53:29.518619 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-58c2bc96-6218-4f7c-abcf-2f0b4b4ba4d9 req-44804438-e0df-45dc-8950-ebdf422e23f9 service nova] Creating event network-vif-plugged:b4dd3dab-1381-45f9-adf2-0233b29ab819 for instance 6d7b0924-928d-42bf-8a1c-cfa3fd7ba30d on n-h1-851028-13 Oct 04 19:53:29.523883 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-58c2bc96-6218-4f7c-abcf-2f0b4b4ba4d9 req-44804438-e0df-45dc-8950-ebdf422e23f9 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039064 Oct 04 19:53:29.524786 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 4051/7729] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:53:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:53:29.569407 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-8b10b176-7d72-4e29-b066-1e73eaa455a3 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c616f37f7714bdaaba2ae66226f37d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8cddf77e654ca7a88b55acca131a45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:53:29.578251 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-8b10b176-7d72-4e29-b066-1e73eaa455a3 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] 10.222.0.43 "GET /compute/v2.1/servers/6d7b0924-928d-42bf-8a1c-cfa3fd7ba30d" status: 200 len: 1392 microversion: 2.1 time: 0.234183 Oct 04 19:53:29.578872 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3679/7730] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:53:29 2022] GET /compute/v2.1/servers/6d7b0924-928d-42bf-8a1c-cfa3fd7ba30d => generated 1392 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:53:30.603650 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-7ff14206-6ad9-4c2b-b05b-37cc7024e47c tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:53:30.604366 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-7ff14206-6ad9-4c2b-b05b-37cc7024e47c tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] [instance: 6d7b0924-928d-42bf-8a1c-cfa3fd7ba30d] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:53:30.613130 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7ff14206-6ad9-4c2b-b05b-37cc7024e47c tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:53:30.613641 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7ff14206-6ad9-4c2b-b05b-37cc7024e47c tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:53:30.614100 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7ff14206-6ad9-4c2b-b05b-37cc7024e47c tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:53:30.614818 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7ff14206-6ad9-4c2b-b05b-37cc7024e47c tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:53:30.615287 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7ff14206-6ad9-4c2b-b05b-37cc7024e47c tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:53:30.615731 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7ff14206-6ad9-4c2b-b05b-37cc7024e47c tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:53:30.751252 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-7ff14206-6ad9-4c2b-b05b-37cc7024e47c tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c616f37f7714bdaaba2ae66226f37d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8cddf77e654ca7a88b55acca131a45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:53:30.759604 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-7ff14206-6ad9-4c2b-b05b-37cc7024e47c tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] 10.222.0.43 "GET /compute/v2.1/servers/6d7b0924-928d-42bf-8a1c-cfa3fd7ba30d" status: 200 len: 1392 microversion: 2.1 time: 0.160155 Oct 04 19:53:30.760836 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 4052/7731] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:53:30 2022] GET /compute/v2.1/servers/6d7b0924-928d-42bf-8a1c-cfa3fd7ba30d => generated 1392 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:53:31.789829 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-eeb5379d-42c7-43a9-8f6f-48844e300f23 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:53:31.790429 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-eeb5379d-42c7-43a9-8f6f-48844e300f23 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] [instance: 6d7b0924-928d-42bf-8a1c-cfa3fd7ba30d] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:53:31.797909 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-eeb5379d-42c7-43a9-8f6f-48844e300f23 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:53:31.798403 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-eeb5379d-42c7-43a9-8f6f-48844e300f23 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:53:31.798845 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-eeb5379d-42c7-43a9-8f6f-48844e300f23 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:53:31.799544 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-eeb5379d-42c7-43a9-8f6f-48844e300f23 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:53:31.799999 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-eeb5379d-42c7-43a9-8f6f-48844e300f23 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:53:31.800429 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-eeb5379d-42c7-43a9-8f6f-48844e300f23 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:53:31.939037 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-eeb5379d-42c7-43a9-8f6f-48844e300f23 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c616f37f7714bdaaba2ae66226f37d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8cddf77e654ca7a88b55acca131a45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:53:31.946871 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-eeb5379d-42c7-43a9-8f6f-48844e300f23 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] 10.222.0.43 "GET /compute/v2.1/servers/6d7b0924-928d-42bf-8a1c-cfa3fd7ba30d" status: 200 len: 1564 microversion: 2.1 time: 0.161055 Oct 04 19:53:31.947452 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3680/7732] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:53:31 2022] GET /compute/v2.1/servers/6d7b0924-928d-42bf-8a1c-cfa3fd7ba30d => generated 1564 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:53:31.971505 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-7e3d2fbf-bcdf-41da-8895-299d469f94d6 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:53:31.972146 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-7e3d2fbf-bcdf-41da-8895-299d469f94d6 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] [instance: 6d7b0924-928d-42bf-8a1c-cfa3fd7ba30d] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:53:31.979175 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7e3d2fbf-bcdf-41da-8895-299d469f94d6 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:53:31.979687 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7e3d2fbf-bcdf-41da-8895-299d469f94d6 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:53:31.980154 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7e3d2fbf-bcdf-41da-8895-299d469f94d6 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:53:31.980882 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7e3d2fbf-bcdf-41da-8895-299d469f94d6 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:53:31.981387 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7e3d2fbf-bcdf-41da-8895-299d469f94d6 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:53:31.981837 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7e3d2fbf-bcdf-41da-8895-299d469f94d6 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:53:32.122615 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-7e3d2fbf-bcdf-41da-8895-299d469f94d6 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c616f37f7714bdaaba2ae66226f37d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8cddf77e654ca7a88b55acca131a45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:53:32.130568 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-7e3d2fbf-bcdf-41da-8895-299d469f94d6 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] 10.222.0.43 "GET /compute/v2.1/servers/6d7b0924-928d-42bf-8a1c-cfa3fd7ba30d" status: 200 len: 1564 microversion: 2.1 time: 0.163472 Oct 04 19:53:32.131150 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 4053/7733] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:53:31 2022] GET /compute/v2.1/servers/6d7b0924-928d-42bf-8a1c-cfa3fd7ba30d => generated 1564 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:53:33.811047 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-b0f002a2-34c0-4efa-b301-bf1bd4e1e260 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:53:33.811664 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-b0f002a2-34c0-4efa-b301-bf1bd4e1e260 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] [instance: 6d7b0924-928d-42bf-8a1c-cfa3fd7ba30d] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:53:33.815452 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=2 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:53:33.816279 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=6 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:53:33.816469 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-8ac97a68-f75f-4305-908c-5cf3a4e15118 req-d91ef2df-479f-4e30-a838-ffeccdef1c8c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d7b0924-928d-42bf-8a1c-cfa3fd7ba30d", "tag": "b4dd3dab-1381-45f9-adf2-0233b29ab819"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:53:33.817789 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_api:SELECT=37,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:53:33.822746 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b0f002a2-34c0-4efa-b301-bf1bd4e1e260 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:53:33.823240 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b0f002a2-34c0-4efa-b301-bf1bd4e1e260 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:53:33.823887 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b0f002a2-34c0-4efa-b301-bf1bd4e1e260 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:53:33.824811 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b0f002a2-34c0-4efa-b301-bf1bd4e1e260 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:53:33.825295 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b0f002a2-34c0-4efa-b301-bf1bd4e1e260 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:53:33.825915 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b0f002a2-34c0-4efa-b301-bf1bd4e1e260 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:53:33.826305 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=6 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:53:33.829627 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-8ac97a68-f75f-4305-908c-5cf3a4e15118 req-d91ef2df-479f-4e30-a838-ffeccdef1c8c service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:53:33.830661 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-8ac97a68-f75f-4305-908c-5cf3a4e15118 req-d91ef2df-479f-4e30-a838-ffeccdef1c8c service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:53:33.831188 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-8ac97a68-f75f-4305-908c-5cf3a4e15118 req-d91ef2df-479f-4e30-a838-ffeccdef1c8c service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:53:33.857802 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-8ac97a68-f75f-4305-908c-5cf3a4e15118 req-d91ef2df-479f-4e30-a838-ffeccdef1c8c service nova] Creating event network-changed:b4dd3dab-1381-45f9-adf2-0233b29ab819 for instance 6d7b0924-928d-42bf-8a1c-cfa3fd7ba30d on n-h1-851028-13 Oct 04 19:53:33.864212 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-8ac97a68-f75f-4305-908c-5cf3a4e15118 req-d91ef2df-479f-4e30-a838-ffeccdef1c8c service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053026 Oct 04 19:53:33.865002 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 4054/7734] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:53:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:53:33.973166 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-b0f002a2-34c0-4efa-b301-bf1bd4e1e260 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c616f37f7714bdaaba2ae66226f37d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8cddf77e654ca7a88b55acca131a45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:53:33.981028 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-b0f002a2-34c0-4efa-b301-bf1bd4e1e260 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] 10.222.0.43 "GET /compute/v2.1/servers/6d7b0924-928d-42bf-8a1c-cfa3fd7ba30d" status: 200 len: 1564 microversion: 2.1 time: 0.173743 Oct 04 19:53:33.981857 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3681/7735] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:53:33 2022] GET /compute/v2.1/servers/6d7b0924-928d-42bf-8a1c-cfa3fd7ba30d => generated 1564 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:53:55.229834 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:53:55.230662 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=34 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:53:55.235462 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-eef17a54-5961-42de-8c9f-31d1105c9349 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:53:55.237795 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-eef17a54-5961-42de-8c9f-31d1105c9349 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] [instance: 6d7b0924-928d-42bf-8a1c-cfa3fd7ba30d] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:53:55.245025 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-eef17a54-5961-42de-8c9f-31d1105c9349 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:53:55.245552 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-eef17a54-5961-42de-8c9f-31d1105c9349 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:53:55.246015 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-eef17a54-5961-42de-8c9f-31d1105c9349 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:53:55.246739 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-eef17a54-5961-42de-8c9f-31d1105c9349 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:53:55.247210 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-eef17a54-5961-42de-8c9f-31d1105c9349 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:53:55.247658 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-eef17a54-5961-42de-8c9f-31d1105c9349 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:53:55.300040 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-eef17a54-5961-42de-8c9f-31d1105c9349 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] 10.222.0.43 "POST /compute/v2.1/servers/6d7b0924-928d-42bf-8a1c-cfa3fd7ba30d/action" status: 200 len: 24568 microversion: 2.1 time: 0.071954 Oct 04 19:53:55.300620 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 4055/7736] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 19:53:55 2022] POST /compute/v2.1/servers/6d7b0924-928d-42bf-8a1c-cfa3fd7ba30d/action => generated 24568 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 19:54:06.402766 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-70449120-3afa-4fc6-86ca-2bc5ab1b41dc tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:54:06.405320 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_api:SELECT=1 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:54:06.406164 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=34 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:54:06.412228 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-70449120-3afa-4fc6-86ca-2bc5ab1b41dc tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:54:06.412726 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-70449120-3afa-4fc6-86ca-2bc5ab1b41dc tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:54:06.413193 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-70449120-3afa-4fc6-86ca-2bc5ab1b41dc tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:54:06.439578 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-70449120-3afa-4fc6-86ca-2bc5ab1b41dc tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] [instance: 6d7b0924-928d-42bf-8a1c-cfa3fd7ba30d] Going to try to stop instance {{(pid=123595) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 04 19:54:06.485130 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-70449120-3afa-4fc6-86ca-2bc5ab1b41dc tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] 10.222.0.43 "POST /compute/v2.1/servers/6d7b0924-928d-42bf-8a1c-cfa3fd7ba30d/action" status: 202 len: 0 microversion: 2.1 time: 0.086106 Oct 04 19:54:06.485998 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3682/7737] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 19:54:06 2022] POST /compute/v2.1/servers/6d7b0924-928d-42bf-8a1c-cfa3fd7ba30d/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:54:06.495769 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-58a1858c-928c-4d06-a3a7-d7c3a6b7b357 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:54:06.496512 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-58a1858c-928c-4d06-a3a7-d7c3a6b7b357 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] [instance: 6d7b0924-928d-42bf-8a1c-cfa3fd7ba30d] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:54:06.499138 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=4 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:54:06.500812 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_api:SELECT=2 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:54:06.509841 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-58a1858c-928c-4d06-a3a7-d7c3a6b7b357 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:54:06.510372 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-58a1858c-928c-4d06-a3a7-d7c3a6b7b357 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:54:06.510841 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-58a1858c-928c-4d06-a3a7-d7c3a6b7b357 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:54:06.511596 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-58a1858c-928c-4d06-a3a7-d7c3a6b7b357 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:54:06.512057 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-58a1858c-928c-4d06-a3a7-d7c3a6b7b357 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:54:06.512509 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-58a1858c-928c-4d06-a3a7-d7c3a6b7b357 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:54:06.655616 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-58a1858c-928c-4d06-a3a7-d7c3a6b7b357 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c616f37f7714bdaaba2ae66226f37d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8cddf77e654ca7a88b55acca131a45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:54:06.665040 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-58a1858c-928c-4d06-a3a7-d7c3a6b7b357 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] 10.222.0.43 "GET /compute/v2.1/servers/6d7b0924-928d-42bf-8a1c-cfa3fd7ba30d" status: 200 len: 1693 microversion: 2.1 time: 0.173348 Oct 04 19:54:06.665389 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 4056/7738] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:54:06 2022] GET /compute/v2.1/servers/6d7b0924-928d-42bf-8a1c-cfa3fd7ba30d => generated 1693 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:54:07.693365 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-959265b8-392b-4680-9952-6b96e46512ac tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:54:07.694072 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-959265b8-392b-4680-9952-6b96e46512ac tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] [instance: 6d7b0924-928d-42bf-8a1c-cfa3fd7ba30d] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:54:07.700552 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-959265b8-392b-4680-9952-6b96e46512ac tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:54:07.701041 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-959265b8-392b-4680-9952-6b96e46512ac tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:54:07.701503 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-959265b8-392b-4680-9952-6b96e46512ac tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:54:07.702201 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-959265b8-392b-4680-9952-6b96e46512ac tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:54:07.702701 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-959265b8-392b-4680-9952-6b96e46512ac tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:54:07.703129 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-959265b8-392b-4680-9952-6b96e46512ac tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:54:07.846727 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-959265b8-392b-4680-9952-6b96e46512ac tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c616f37f7714bdaaba2ae66226f37d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8cddf77e654ca7a88b55acca131a45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:54:07.856570 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-959265b8-392b-4680-9952-6b96e46512ac tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] 10.222.0.43 "GET /compute/v2.1/servers/6d7b0924-928d-42bf-8a1c-cfa3fd7ba30d" status: 200 len: 1693 microversion: 2.1 time: 0.168391 Oct 04 19:54:07.857213 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3683/7739] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:54:07 2022] GET /compute/v2.1/servers/6d7b0924-928d-42bf-8a1c-cfa3fd7ba30d => generated 1693 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:54:08.886540 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f2fb96af-d6cf-457b-bc59-858eb0c36d33 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:54:08.887292 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-f2fb96af-d6cf-457b-bc59-858eb0c36d33 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] [instance: 6d7b0924-928d-42bf-8a1c-cfa3fd7ba30d] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:54:08.899887 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f2fb96af-d6cf-457b-bc59-858eb0c36d33 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:54:08.900649 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f2fb96af-d6cf-457b-bc59-858eb0c36d33 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:54:08.901389 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f2fb96af-d6cf-457b-bc59-858eb0c36d33 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:54:08.902364 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f2fb96af-d6cf-457b-bc59-858eb0c36d33 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:54:08.902881 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f2fb96af-d6cf-457b-bc59-858eb0c36d33 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:54:08.903770 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f2fb96af-d6cf-457b-bc59-858eb0c36d33 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:54:09.052370 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-f2fb96af-d6cf-457b-bc59-858eb0c36d33 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c616f37f7714bdaaba2ae66226f37d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8cddf77e654ca7a88b55acca131a45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:54:09.060926 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-f2fb96af-d6cf-457b-bc59-858eb0c36d33 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] 10.222.0.43 "GET /compute/v2.1/servers/6d7b0924-928d-42bf-8a1c-cfa3fd7ba30d" status: 200 len: 1693 microversion: 2.1 time: 0.183147 Oct 04 19:54:09.065260 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 4057/7740] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:54:08 2022] GET /compute/v2.1/servers/6d7b0924-928d-42bf-8a1c-cfa3fd7ba30d => generated 1693 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:54:10.085134 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-40d5ae1b-e18c-46b3-bd61-6487292a3241 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:54:10.085770 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-40d5ae1b-e18c-46b3-bd61-6487292a3241 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] [instance: 6d7b0924-928d-42bf-8a1c-cfa3fd7ba30d] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:54:10.092600 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-40d5ae1b-e18c-46b3-bd61-6487292a3241 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:54:10.093122 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-40d5ae1b-e18c-46b3-bd61-6487292a3241 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:54:10.093576 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-40d5ae1b-e18c-46b3-bd61-6487292a3241 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:54:10.094296 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-40d5ae1b-e18c-46b3-bd61-6487292a3241 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:54:10.094752 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-40d5ae1b-e18c-46b3-bd61-6487292a3241 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:54:10.095184 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-40d5ae1b-e18c-46b3-bd61-6487292a3241 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:54:10.225931 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-40d5ae1b-e18c-46b3-bd61-6487292a3241 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c616f37f7714bdaaba2ae66226f37d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8cddf77e654ca7a88b55acca131a45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:54:10.234338 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-40d5ae1b-e18c-46b3-bd61-6487292a3241 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] 10.222.0.43 "GET /compute/v2.1/servers/6d7b0924-928d-42bf-8a1c-cfa3fd7ba30d" status: 200 len: 1693 microversion: 2.1 time: 0.152637 Oct 04 19:54:10.234923 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3684/7741] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:54:10 2022] GET /compute/v2.1/servers/6d7b0924-928d-42bf-8a1c-cfa3fd7ba30d => generated 1693 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:54:11.261694 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-17612852-d5e9-4313-8dd3-c8dced9f9adf tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:54:11.262328 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-17612852-d5e9-4313-8dd3-c8dced9f9adf tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] [instance: 6d7b0924-928d-42bf-8a1c-cfa3fd7ba30d] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:54:11.270317 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-17612852-d5e9-4313-8dd3-c8dced9f9adf tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:54:11.270830 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-17612852-d5e9-4313-8dd3-c8dced9f9adf tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:54:11.271437 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-17612852-d5e9-4313-8dd3-c8dced9f9adf tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:54:11.272255 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-17612852-d5e9-4313-8dd3-c8dced9f9adf tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:54:11.272742 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-17612852-d5e9-4313-8dd3-c8dced9f9adf tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:54:11.273221 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-17612852-d5e9-4313-8dd3-c8dced9f9adf tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:54:11.415776 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-17612852-d5e9-4313-8dd3-c8dced9f9adf tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c616f37f7714bdaaba2ae66226f37d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8cddf77e654ca7a88b55acca131a45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:54:11.423973 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-17612852-d5e9-4313-8dd3-c8dced9f9adf tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] 10.222.0.43 "GET /compute/v2.1/servers/6d7b0924-928d-42bf-8a1c-cfa3fd7ba30d" status: 200 len: 1693 microversion: 2.1 time: 0.166386 Oct 04 19:54:11.424568 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 4058/7742] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:54:11 2022] GET /compute/v2.1/servers/6d7b0924-928d-42bf-8a1c-cfa3fd7ba30d => generated 1693 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:54:12.448211 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-39717a23-ff6b-426c-9079-517a0890a26b tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:54:12.448874 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-39717a23-ff6b-426c-9079-517a0890a26b tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] [instance: 6d7b0924-928d-42bf-8a1c-cfa3fd7ba30d] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:54:12.456964 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-39717a23-ff6b-426c-9079-517a0890a26b tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:54:12.457535 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-39717a23-ff6b-426c-9079-517a0890a26b tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:54:12.458018 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-39717a23-ff6b-426c-9079-517a0890a26b tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:54:12.458764 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-39717a23-ff6b-426c-9079-517a0890a26b tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:54:12.459244 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-39717a23-ff6b-426c-9079-517a0890a26b tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:54:12.459711 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-39717a23-ff6b-426c-9079-517a0890a26b tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:54:12.599854 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-39717a23-ff6b-426c-9079-517a0890a26b tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c616f37f7714bdaaba2ae66226f37d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8cddf77e654ca7a88b55acca131a45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:54:12.607784 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-39717a23-ff6b-426c-9079-517a0890a26b tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] 10.222.0.43 "GET /compute/v2.1/servers/6d7b0924-928d-42bf-8a1c-cfa3fd7ba30d" status: 200 len: 1693 microversion: 2.1 time: 0.163791 Oct 04 19:54:12.608364 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3685/7743] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:54:12 2022] GET /compute/v2.1/servers/6d7b0924-928d-42bf-8a1c-cfa3fd7ba30d => generated 1693 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:54:13.630828 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-11c9bb09-389b-4cc4-97a6-d819141fa318 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:54:13.631454 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-11c9bb09-389b-4cc4-97a6-d819141fa318 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] [instance: 6d7b0924-928d-42bf-8a1c-cfa3fd7ba30d] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:54:13.638458 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-11c9bb09-389b-4cc4-97a6-d819141fa318 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:54:13.638963 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-11c9bb09-389b-4cc4-97a6-d819141fa318 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:54:13.639419 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-11c9bb09-389b-4cc4-97a6-d819141fa318 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:54:13.640136 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-11c9bb09-389b-4cc4-97a6-d819141fa318 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:54:13.640609 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-11c9bb09-389b-4cc4-97a6-d819141fa318 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:54:13.641050 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-11c9bb09-389b-4cc4-97a6-d819141fa318 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:54:13.798699 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-11c9bb09-389b-4cc4-97a6-d819141fa318 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c616f37f7714bdaaba2ae66226f37d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8cddf77e654ca7a88b55acca131a45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:54:13.807682 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-11c9bb09-389b-4cc4-97a6-d819141fa318 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] 10.222.0.43 "GET /compute/v2.1/servers/6d7b0924-928d-42bf-8a1c-cfa3fd7ba30d" status: 200 len: 1693 microversion: 2.1 time: 0.180776 Oct 04 19:54:13.808348 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 4059/7744] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:54:13 2022] GET /compute/v2.1/servers/6d7b0924-928d-42bf-8a1c-cfa3fd7ba30d => generated 1693 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:54:14.831183 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-2efcf99d-d599-4e86-b5e5-ffae218e23d0 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:54:14.831799 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-2efcf99d-d599-4e86-b5e5-ffae218e23d0 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] [instance: 6d7b0924-928d-42bf-8a1c-cfa3fd7ba30d] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:54:14.838658 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2efcf99d-d599-4e86-b5e5-ffae218e23d0 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:54:14.839143 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2efcf99d-d599-4e86-b5e5-ffae218e23d0 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:54:14.839581 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2efcf99d-d599-4e86-b5e5-ffae218e23d0 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:54:14.840276 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2efcf99d-d599-4e86-b5e5-ffae218e23d0 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:54:14.840733 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2efcf99d-d599-4e86-b5e5-ffae218e23d0 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:54:14.841196 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2efcf99d-d599-4e86-b5e5-ffae218e23d0 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:54:14.974986 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-2efcf99d-d599-4e86-b5e5-ffae218e23d0 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c616f37f7714bdaaba2ae66226f37d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8cddf77e654ca7a88b55acca131a45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:54:14.983049 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-2efcf99d-d599-4e86-b5e5-ffae218e23d0 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] 10.222.0.43 "GET /compute/v2.1/servers/6d7b0924-928d-42bf-8a1c-cfa3fd7ba30d" status: 200 len: 1693 microversion: 2.1 time: 0.156045 Oct 04 19:54:14.984119 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3686/7745] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:54:14 2022] GET /compute/v2.1/servers/6d7b0924-928d-42bf-8a1c-cfa3fd7ba30d => generated 1693 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:54:16.007674 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-5b2a06fa-52e6-4c69-b4bc-c6abcd61c389 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:54:16.008331 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-5b2a06fa-52e6-4c69-b4bc-c6abcd61c389 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] [instance: 6d7b0924-928d-42bf-8a1c-cfa3fd7ba30d] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:54:16.015991 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5b2a06fa-52e6-4c69-b4bc-c6abcd61c389 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:54:16.016500 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5b2a06fa-52e6-4c69-b4bc-c6abcd61c389 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:54:16.016956 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5b2a06fa-52e6-4c69-b4bc-c6abcd61c389 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:54:16.017708 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5b2a06fa-52e6-4c69-b4bc-c6abcd61c389 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:54:16.018182 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5b2a06fa-52e6-4c69-b4bc-c6abcd61c389 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:54:16.018624 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5b2a06fa-52e6-4c69-b4bc-c6abcd61c389 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:54:16.160710 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-5b2a06fa-52e6-4c69-b4bc-c6abcd61c389 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c616f37f7714bdaaba2ae66226f37d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8cddf77e654ca7a88b55acca131a45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:54:16.169049 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-5b2a06fa-52e6-4c69-b4bc-c6abcd61c389 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] 10.222.0.43 "GET /compute/v2.1/servers/6d7b0924-928d-42bf-8a1c-cfa3fd7ba30d" status: 200 len: 1693 microversion: 2.1 time: 0.165433 Oct 04 19:54:16.169676 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 4060/7746] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:54:16 2022] GET /compute/v2.1/servers/6d7b0924-928d-42bf-8a1c-cfa3fd7ba30d => generated 1693 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:54:17.197497 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-1bba4eea-f341-44ef-97d3-b6624db3c3f9 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:54:17.198165 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-1bba4eea-f341-44ef-97d3-b6624db3c3f9 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] [instance: 6d7b0924-928d-42bf-8a1c-cfa3fd7ba30d] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:54:17.206569 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1bba4eea-f341-44ef-97d3-b6624db3c3f9 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:54:17.207102 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1bba4eea-f341-44ef-97d3-b6624db3c3f9 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:54:17.207550 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1bba4eea-f341-44ef-97d3-b6624db3c3f9 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:54:17.208272 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1bba4eea-f341-44ef-97d3-b6624db3c3f9 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:54:17.208740 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1bba4eea-f341-44ef-97d3-b6624db3c3f9 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:54:17.209196 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1bba4eea-f341-44ef-97d3-b6624db3c3f9 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:54:17.350785 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-1bba4eea-f341-44ef-97d3-b6624db3c3f9 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c616f37f7714bdaaba2ae66226f37d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8cddf77e654ca7a88b55acca131a45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:54:17.358655 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-1bba4eea-f341-44ef-97d3-b6624db3c3f9 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] 10.222.0.43 "GET /compute/v2.1/servers/6d7b0924-928d-42bf-8a1c-cfa3fd7ba30d" status: 200 len: 1693 microversion: 2.1 time: 0.169702 Oct 04 19:54:17.359232 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3687/7747] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:54:17 2022] GET /compute/v2.1/servers/6d7b0924-928d-42bf-8a1c-cfa3fd7ba30d => generated 1693 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:54:18.386681 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-5bde55cc-3a1e-43b1-8cfd-a3e626c06faf tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:54:18.387494 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-5bde55cc-3a1e-43b1-8cfd-a3e626c06faf tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] [instance: 6d7b0924-928d-42bf-8a1c-cfa3fd7ba30d] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:54:18.395887 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5bde55cc-3a1e-43b1-8cfd-a3e626c06faf tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:54:18.396473 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5bde55cc-3a1e-43b1-8cfd-a3e626c06faf tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:54:18.396980 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5bde55cc-3a1e-43b1-8cfd-a3e626c06faf tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:54:18.397735 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5bde55cc-3a1e-43b1-8cfd-a3e626c06faf tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:54:18.398218 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5bde55cc-3a1e-43b1-8cfd-a3e626c06faf tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:54:18.398667 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5bde55cc-3a1e-43b1-8cfd-a3e626c06faf tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:54:18.537889 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-5bde55cc-3a1e-43b1-8cfd-a3e626c06faf tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c616f37f7714bdaaba2ae66226f37d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8cddf77e654ca7a88b55acca131a45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:54:18.545848 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-5bde55cc-3a1e-43b1-8cfd-a3e626c06faf tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] 10.222.0.43 "GET /compute/v2.1/servers/6d7b0924-928d-42bf-8a1c-cfa3fd7ba30d" status: 200 len: 1693 microversion: 2.1 time: 0.163719 Oct 04 19:54:18.546442 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 4061/7748] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:54:18 2022] GET /compute/v2.1/servers/6d7b0924-928d-42bf-8a1c-cfa3fd7ba30d => generated 1693 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:54:19.569747 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-ad7284da-837e-410c-a257-bbb98d1af37f tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:54:19.571014 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-ad7284da-837e-410c-a257-bbb98d1af37f tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] [instance: 6d7b0924-928d-42bf-8a1c-cfa3fd7ba30d] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:54:19.578611 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ad7284da-837e-410c-a257-bbb98d1af37f tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:54:19.579113 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ad7284da-837e-410c-a257-bbb98d1af37f tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:54:19.579560 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ad7284da-837e-410c-a257-bbb98d1af37f tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:54:19.580592 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ad7284da-837e-410c-a257-bbb98d1af37f tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:54:19.581043 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ad7284da-837e-410c-a257-bbb98d1af37f tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:54:19.581504 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ad7284da-837e-410c-a257-bbb98d1af37f tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:54:19.724679 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-ad7284da-837e-410c-a257-bbb98d1af37f tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c616f37f7714bdaaba2ae66226f37d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8cddf77e654ca7a88b55acca131a45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:54:19.732667 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-ad7284da-837e-410c-a257-bbb98d1af37f tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] 10.222.0.43 "GET /compute/v2.1/servers/6d7b0924-928d-42bf-8a1c-cfa3fd7ba30d" status: 200 len: 1693 microversion: 2.1 time: 0.166868 Oct 04 19:54:19.733287 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3688/7749] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:54:19 2022] GET /compute/v2.1/servers/6d7b0924-928d-42bf-8a1c-cfa3fd7ba30d => generated 1693 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:54:20.757890 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-6ab91d36-3397-47a6-a3c1-3fa88c778ce5 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:54:20.758648 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-6ab91d36-3397-47a6-a3c1-3fa88c778ce5 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] [instance: 6d7b0924-928d-42bf-8a1c-cfa3fd7ba30d] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:54:20.767220 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6ab91d36-3397-47a6-a3c1-3fa88c778ce5 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:54:20.767880 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6ab91d36-3397-47a6-a3c1-3fa88c778ce5 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:54:20.768436 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6ab91d36-3397-47a6-a3c1-3fa88c778ce5 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:54:20.769325 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6ab91d36-3397-47a6-a3c1-3fa88c778ce5 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:54:20.769947 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6ab91d36-3397-47a6-a3c1-3fa88c778ce5 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:54:20.770517 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6ab91d36-3397-47a6-a3c1-3fa88c778ce5 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:54:20.931661 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-6ab91d36-3397-47a6-a3c1-3fa88c778ce5 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c616f37f7714bdaaba2ae66226f37d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8cddf77e654ca7a88b55acca131a45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:54:20.941064 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-6ab91d36-3397-47a6-a3c1-3fa88c778ce5 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] 10.222.0.43 "GET /compute/v2.1/servers/6d7b0924-928d-42bf-8a1c-cfa3fd7ba30d" status: 200 len: 1693 microversion: 2.1 time: 0.188423 Oct 04 19:54:20.941721 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 4062/7750] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:54:20 2022] GET /compute/v2.1/servers/6d7b0924-928d-42bf-8a1c-cfa3fd7ba30d => generated 1693 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:54:21.966427 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-cd649da0-e111-4ff9-8b7c-fe357dca5ec0 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:54:21.966904 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-cd649da0-e111-4ff9-8b7c-fe357dca5ec0 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] [instance: 6d7b0924-928d-42bf-8a1c-cfa3fd7ba30d] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:54:21.974817 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cd649da0-e111-4ff9-8b7c-fe357dca5ec0 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:54:21.975329 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cd649da0-e111-4ff9-8b7c-fe357dca5ec0 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:54:21.975841 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cd649da0-e111-4ff9-8b7c-fe357dca5ec0 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:54:21.977198 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cd649da0-e111-4ff9-8b7c-fe357dca5ec0 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:54:21.977198 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cd649da0-e111-4ff9-8b7c-fe357dca5ec0 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:54:21.977575 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cd649da0-e111-4ff9-8b7c-fe357dca5ec0 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:54:22.126243 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-cd649da0-e111-4ff9-8b7c-fe357dca5ec0 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c616f37f7714bdaaba2ae66226f37d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8cddf77e654ca7a88b55acca131a45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:54:22.135298 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-cd649da0-e111-4ff9-8b7c-fe357dca5ec0 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] 10.222.0.43 "GET /compute/v2.1/servers/6d7b0924-928d-42bf-8a1c-cfa3fd7ba30d" status: 200 len: 1670 microversion: 2.1 time: 0.173389 Oct 04 19:54:22.135918 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3689/7751] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:54:21 2022] GET /compute/v2.1/servers/6d7b0924-928d-42bf-8a1c-cfa3fd7ba30d => generated 1670 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:54:23.238607 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-de6c2ebb-3747-4647-9d74-d964e01db6b8 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:54:23.241308 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-de6c2ebb-3747-4647-9d74-d964e01db6b8 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] [instance: 6d7b0924-928d-42bf-8a1c-cfa3fd7ba30d] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:54:23.250905 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-de6c2ebb-3747-4647-9d74-d964e01db6b8 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:54:23.251768 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-de6c2ebb-3747-4647-9d74-d964e01db6b8 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:54:23.252546 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-de6c2ebb-3747-4647-9d74-d964e01db6b8 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:54:23.253834 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-de6c2ebb-3747-4647-9d74-d964e01db6b8 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:54:23.254679 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-de6c2ebb-3747-4647-9d74-d964e01db6b8 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:54:23.255480 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-de6c2ebb-3747-4647-9d74-d964e01db6b8 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:54:23.318577 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-de6c2ebb-3747-4647-9d74-d964e01db6b8 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] 10.222.0.43 "POST /compute/v2.1/servers/6d7b0924-928d-42bf-8a1c-cfa3fd7ba30d/action" status: 200 len: 38434 microversion: 2.1 time: 0.084127 Oct 04 19:54:23.319636 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 4063/7752] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 19:54:23 2022] POST /compute/v2.1/servers/6d7b0924-928d-42bf-8a1c-cfa3fd7ba30d/action => generated 38434 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 19:54:23.332610 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-460b284b-ad72-4a51-8834-4aa376de95c4 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:54:23.339797 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-460b284b-ad72-4a51-8834-4aa376de95c4 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:54:23.340281 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-460b284b-ad72-4a51-8834-4aa376de95c4 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:54:23.340721 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-460b284b-ad72-4a51-8834-4aa376de95c4 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:54:23.365182 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-460b284b-ad72-4a51-8834-4aa376de95c4 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] [instance: 6d7b0924-928d-42bf-8a1c-cfa3fd7ba30d] Going to try to start instance {{(pid=123595) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 04 19:54:23.413658 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-460b284b-ad72-4a51-8834-4aa376de95c4 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] 10.222.0.43 "POST /compute/v2.1/servers/6d7b0924-928d-42bf-8a1c-cfa3fd7ba30d/action" status: 202 len: 0 microversion: 2.1 time: 0.085697 Oct 04 19:54:23.414274 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3690/7753] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 19:54:23 2022] POST /compute/v2.1/servers/6d7b0924-928d-42bf-8a1c-cfa3fd7ba30d/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 19:54:23.423786 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-017df987-aa68-4b41-9a40-442aa68543ee tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:54:23.424588 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-017df987-aa68-4b41-9a40-442aa68543ee tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] [instance: 6d7b0924-928d-42bf-8a1c-cfa3fd7ba30d] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:54:23.433662 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-017df987-aa68-4b41-9a40-442aa68543ee tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:54:23.434261 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-017df987-aa68-4b41-9a40-442aa68543ee tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:54:23.434768 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-017df987-aa68-4b41-9a40-442aa68543ee tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:54:23.435719 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-017df987-aa68-4b41-9a40-442aa68543ee tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:54:23.436350 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-017df987-aa68-4b41-9a40-442aa68543ee tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:54:23.436894 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-017df987-aa68-4b41-9a40-442aa68543ee tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:54:24.009283 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-017df987-aa68-4b41-9a40-442aa68543ee tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c616f37f7714bdaaba2ae66226f37d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8cddf77e654ca7a88b55acca131a45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:54:24.021644 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-017df987-aa68-4b41-9a40-442aa68543ee tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] 10.222.0.43 "GET /compute/v2.1/servers/6d7b0924-928d-42bf-8a1c-cfa3fd7ba30d" status: 200 len: 1679 microversion: 2.1 time: 0.601958 Oct 04 19:54:24.022529 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 4064/7754] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:54:23 2022] GET /compute/v2.1/servers/6d7b0924-928d-42bf-8a1c-cfa3fd7ba30d => generated 1679 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:54:25.048443 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-172b95ca-6703-4633-b4a0-634cd8ab13b2 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:54:25.049263 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-172b95ca-6703-4633-b4a0-634cd8ab13b2 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] [instance: 6d7b0924-928d-42bf-8a1c-cfa3fd7ba30d] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:54:25.056784 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-172b95ca-6703-4633-b4a0-634cd8ab13b2 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:54:25.057331 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-172b95ca-6703-4633-b4a0-634cd8ab13b2 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:54:25.057824 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-172b95ca-6703-4633-b4a0-634cd8ab13b2 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:54:25.058589 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-172b95ca-6703-4633-b4a0-634cd8ab13b2 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:54:25.059086 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-172b95ca-6703-4633-b4a0-634cd8ab13b2 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:54:25.059525 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-172b95ca-6703-4633-b4a0-634cd8ab13b2 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:54:25.201690 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-172b95ca-6703-4633-b4a0-634cd8ab13b2 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c616f37f7714bdaaba2ae66226f37d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8cddf77e654ca7a88b55acca131a45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:54:25.210171 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-172b95ca-6703-4633-b4a0-634cd8ab13b2 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] 10.222.0.43 "GET /compute/v2.1/servers/6d7b0924-928d-42bf-8a1c-cfa3fd7ba30d" status: 200 len: 1683 microversion: 2.1 time: 0.167456 Oct 04 19:54:25.210741 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3691/7755] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:54:25 2022] GET /compute/v2.1/servers/6d7b0924-928d-42bf-8a1c-cfa3fd7ba30d => generated 1683 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:54:49.430479 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-7e1ae72a-7b31-4927-9c2e-6fbc9ee095dd tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:54:49.432756 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-7e1ae72a-7b31-4927-9c2e-6fbc9ee095dd tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] [instance: 6d7b0924-928d-42bf-8a1c-cfa3fd7ba30d] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:54:49.435676 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_api:SELECT=18 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:54:49.436396 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=52 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:54:49.444067 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7e1ae72a-7b31-4927-9c2e-6fbc9ee095dd tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:54:49.444589 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7e1ae72a-7b31-4927-9c2e-6fbc9ee095dd tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:54:49.445054 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7e1ae72a-7b31-4927-9c2e-6fbc9ee095dd tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:54:49.445816 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7e1ae72a-7b31-4927-9c2e-6fbc9ee095dd tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:54:49.446303 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7e1ae72a-7b31-4927-9c2e-6fbc9ee095dd tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:54:49.446753 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7e1ae72a-7b31-4927-9c2e-6fbc9ee095dd tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:54:49.507654 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-7e1ae72a-7b31-4927-9c2e-6fbc9ee095dd tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] 10.222.0.43 "POST /compute/v2.1/servers/6d7b0924-928d-42bf-8a1c-cfa3fd7ba30d/action" status: 200 len: 62997 microversion: 2.1 time: 0.081258 Oct 04 19:54:49.508339 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 4065/7756] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 19:54:49 2022] POST /compute/v2.1/servers/6d7b0924-928d-42bf-8a1c-cfa3fd7ba30d/action => generated 62997 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 19:54:57.022742 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-a18f9ed1-5d99-4c44-9a70-972df7671d3e tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:54:57.023276 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-a18f9ed1-5d99-4c44-9a70-972df7671d3e tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] [instance: 6d7b0924-928d-42bf-8a1c-cfa3fd7ba30d] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:54:57.031309 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-dc0434fe-e307-4852-a1d6-2af00f31c7a7 req-113a5435-8c10-456c-ad61-5b8f0f9b88e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d7b0924-928d-42bf-8a1c-cfa3fd7ba30d", "tag": "b4dd3dab-1381-45f9-adf2-0233b29ab819"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:54:57.038408 n-d-851028-13 devstack@n-api.service[123596]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 19:54:57.038559 n-d-851028-13 devstack@n-api.service[123596]: Tue Oct 4 19:54:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.43) !!! Oct 04 19:54:57.045399 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_api:SELECT=20 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:54:57.046245 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:54:57.048458 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a18f9ed1-5d99-4c44-9a70-972df7671d3e tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:54:57.048955 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a18f9ed1-5d99-4c44-9a70-972df7671d3e tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:54:57.049429 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a18f9ed1-5d99-4c44-9a70-972df7671d3e tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:54:57.050139 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a18f9ed1-5d99-4c44-9a70-972df7671d3e tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:54:57.051167 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a18f9ed1-5d99-4c44-9a70-972df7671d3e tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:54:57.051167 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a18f9ed1-5d99-4c44-9a70-972df7671d3e tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:54:57.061549 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-dc0434fe-e307-4852-a1d6-2af00f31c7a7 req-113a5435-8c10-456c-ad61-5b8f0f9b88e9 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:54:57.062043 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-dc0434fe-e307-4852-a1d6-2af00f31c7a7 req-113a5435-8c10-456c-ad61-5b8f0f9b88e9 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:54:57.062496 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-dc0434fe-e307-4852-a1d6-2af00f31c7a7 req-113a5435-8c10-456c-ad61-5b8f0f9b88e9 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:54:57.091424 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-dc0434fe-e307-4852-a1d6-2af00f31c7a7 req-113a5435-8c10-456c-ad61-5b8f0f9b88e9 service nova] Creating event network-changed:b4dd3dab-1381-45f9-adf2-0233b29ab819 for instance 6d7b0924-928d-42bf-8a1c-cfa3fd7ba30d on n-h1-851028-13 Oct 04 19:54:57.094456 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-a18f9ed1-5d99-4c44-9a70-972df7671d3e tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] [instance: 6d7b0924-928d-42bf-8a1c-cfa3fd7ba30d] Going to try to terminate instance {{(pid=123595) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 19:54:57.096649 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-dc0434fe-e307-4852-a1d6-2af00f31c7a7 req-113a5435-8c10-456c-ad61-5b8f0f9b88e9 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070001 Oct 04 19:54:57.097751 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 4066/7757] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:54:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:54:57.187856 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-a18f9ed1-5d99-4c44-9a70-972df7671d3e tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] 10.222.0.43 "DELETE /compute/v2.1/servers/6d7b0924-928d-42bf-8a1c-cfa3fd7ba30d" status: 204 len: 0 microversion: 2.1 time: 0.168739 Oct 04 19:54:57.188463 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3692/7758] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 19:54:57 2022] DELETE /compute/v2.1/servers/6d7b0924-928d-42bf-8a1c-cfa3fd7ba30d => generated 0 bytes in 170 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:54:57.198304 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-7d9f5b6b-a13b-483b-a201-193f2453d357 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:54:57.199021 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-7d9f5b6b-a13b-483b-a201-193f2453d357 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] [instance: 6d7b0924-928d-42bf-8a1c-cfa3fd7ba30d] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:54:57.206686 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7d9f5b6b-a13b-483b-a201-193f2453d357 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:54:57.207507 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7d9f5b6b-a13b-483b-a201-193f2453d357 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:54:57.208138 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7d9f5b6b-a13b-483b-a201-193f2453d357 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:54:57.209073 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7d9f5b6b-a13b-483b-a201-193f2453d357 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:54:57.209763 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7d9f5b6b-a13b-483b-a201-193f2453d357 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:54:57.210402 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7d9f5b6b-a13b-483b-a201-193f2453d357 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:54:57.441848 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-7d9f5b6b-a13b-483b-a201-193f2453d357 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c616f37f7714bdaaba2ae66226f37d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8cddf77e654ca7a88b55acca131a45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:54:57.450265 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-7d9f5b6b-a13b-483b-a201-193f2453d357 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] 10.222.0.43 "GET /compute/v2.1/servers/6d7b0924-928d-42bf-8a1c-cfa3fd7ba30d" status: 200 len: 1689 microversion: 2.1 time: 0.257095 Oct 04 19:54:57.450878 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 4067/7759] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:54:57 2022] GET /compute/v2.1/servers/6d7b0924-928d-42bf-8a1c-cfa3fd7ba30d => generated 1689 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:54:58.475062 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-30aebf58-fd3b-4135-b86d-683f70d0888c tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:54:58.475818 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-30aebf58-fd3b-4135-b86d-683f70d0888c tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] [instance: 6d7b0924-928d-42bf-8a1c-cfa3fd7ba30d] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:54:58.482582 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-30aebf58-fd3b-4135-b86d-683f70d0888c tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:54:58.483071 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-30aebf58-fd3b-4135-b86d-683f70d0888c tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:54:58.483513 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-30aebf58-fd3b-4135-b86d-683f70d0888c tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:54:58.484239 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-30aebf58-fd3b-4135-b86d-683f70d0888c tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:54:58.484694 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-30aebf58-fd3b-4135-b86d-683f70d0888c tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:54:58.485296 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-30aebf58-fd3b-4135-b86d-683f70d0888c tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:54:58.676418 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-30aebf58-fd3b-4135-b86d-683f70d0888c tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c616f37f7714bdaaba2ae66226f37d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8cddf77e654ca7a88b55acca131a45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:54:58.684396 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-30aebf58-fd3b-4135-b86d-683f70d0888c tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] 10.222.0.43 "GET /compute/v2.1/servers/6d7b0924-928d-42bf-8a1c-cfa3fd7ba30d" status: 200 len: 1689 microversion: 2.1 time: 0.213598 Oct 04 19:54:58.684976 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3693/7760] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:54:58 2022] GET /compute/v2.1/servers/6d7b0924-928d-42bf-8a1c-cfa3fd7ba30d => generated 1689 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:54:59.242246 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-339f8b8b-5957-422e-8b7b-5156427edb1f req-82cc5c93-e828-4a15-b31e-221d52969afb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d7b0924-928d-42bf-8a1c-cfa3fd7ba30d", "name": "network-vif-deleted", "tag": "b4dd3dab-1381-45f9-adf2-0233b29ab819"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:54:59.253463 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-339f8b8b-5957-422e-8b7b-5156427edb1f req-82cc5c93-e828-4a15-b31e-221d52969afb service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:54:59.253964 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-339f8b8b-5957-422e-8b7b-5156427edb1f req-82cc5c93-e828-4a15-b31e-221d52969afb service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:54:59.254409 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-339f8b8b-5957-422e-8b7b-5156427edb1f req-82cc5c93-e828-4a15-b31e-221d52969afb service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:54:59.266279 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-339f8b8b-5957-422e-8b7b-5156427edb1f req-82cc5c93-e828-4a15-b31e-221d52969afb service nova] Creating event network-vif-deleted:b4dd3dab-1381-45f9-adf2-0233b29ab819 for instance 6d7b0924-928d-42bf-8a1c-cfa3fd7ba30d on n-h1-851028-13 Oct 04 19:54:59.273256 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-339f8b8b-5957-422e-8b7b-5156427edb1f req-82cc5c93-e828-4a15-b31e-221d52969afb service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034437 Oct 04 19:54:59.274167 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 4068/7761] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:54:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:54:59.709149 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-decf8259-30e2-4be6-a17d-769d735b5cf4 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:54:59.709789 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-decf8259-30e2-4be6-a17d-769d735b5cf4 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] [instance: 6d7b0924-928d-42bf-8a1c-cfa3fd7ba30d] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:54:59.716646 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-decf8259-30e2-4be6-a17d-769d735b5cf4 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:54:59.717816 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-decf8259-30e2-4be6-a17d-769d735b5cf4 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:54:59.718262 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-decf8259-30e2-4be6-a17d-769d735b5cf4 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:54:59.718970 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-decf8259-30e2-4be6-a17d-769d735b5cf4 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:54:59.719425 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-decf8259-30e2-4be6-a17d-769d735b5cf4 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:54:59.719910 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-decf8259-30e2-4be6-a17d-769d735b5cf4 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:54:59.757885 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-decf8259-30e2-4be6-a17d-769d735b5cf4 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:54:59.758394 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-decf8259-30e2-4be6-a17d-769d735b5cf4 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:54:59.758827 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-decf8259-30e2-4be6-a17d-769d735b5cf4 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:54:59.759284 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.objects.instance [None req-decf8259-30e2-4be6-a17d-769d735b5cf4 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lazy-loading 'fault' on Instance uuid 6d7b0924-928d-42bf-8a1c-cfa3fd7ba30d {{(pid=123595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 19:54:59.802174 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-decf8259-30e2-4be6-a17d-769d735b5cf4 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c616f37f7714bdaaba2ae66226f37d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8cddf77e654ca7a88b55acca131a45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:54:59.809284 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-decf8259-30e2-4be6-a17d-769d735b5cf4 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] 10.222.0.43 "GET /compute/v2.1/servers/6d7b0924-928d-42bf-8a1c-cfa3fd7ba30d" status: 200 len: 1357 microversion: 2.1 time: 0.104350 Oct 04 19:54:59.809853 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3694/7762] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:54:59 2022] GET /compute/v2.1/servers/6d7b0924-928d-42bf-8a1c-cfa3fd7ba30d => generated 1357 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:55:00.835657 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-8a15a979-95f5-4b88-b6a1-1ce209977af8 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:55:00.836373 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-8a15a979-95f5-4b88-b6a1-1ce209977af8 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] [instance: 6d7b0924-928d-42bf-8a1c-cfa3fd7ba30d] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:55:00.842763 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8a15a979-95f5-4b88-b6a1-1ce209977af8 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:55:00.843268 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8a15a979-95f5-4b88-b6a1-1ce209977af8 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:55:00.843755 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8a15a979-95f5-4b88-b6a1-1ce209977af8 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:55:00.844473 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8a15a979-95f5-4b88-b6a1-1ce209977af8 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:55:00.844945 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8a15a979-95f5-4b88-b6a1-1ce209977af8 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:55:00.845445 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8a15a979-95f5-4b88-b6a1-1ce209977af8 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:55:00.858778 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-8a15a979-95f5-4b88-b6a1-1ce209977af8 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] HTTP exception thrown: Instance 6d7b0924-928d-42bf-8a1c-cfa3fd7ba30d could not be found. Oct 04 19:55:00.860416 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-8a15a979-95f5-4b88-b6a1-1ce209977af8 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Request method failure captured: Oct 04 19:55:00.860416 n-d-851028-13 devstack@n-api.service[123596]: request: GET /compute/v2.1/servers/6d7b0924-928d-42bf-8a1c-cfa3fd7ba30d HTTP/1.1 Oct 04 19:55:00.860416 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 19:55:00.860416 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 19:55:00.860416 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 19:55:00.860416 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 19:55:00.860416 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 19:55:00.860416 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 19:55:00.860416 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 19:55:00.860416 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 19:55:00.860416 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPI4MZexuhXm6PsbDTE0mN_HzaWvpyBNcmZcptu-WN0BUo7VbC1tcPqUVzrRf31db8M0EWQ8d_sfA5FFL6AhajMMcCPlTBrfm9fKnWc8kbZzl3TY06xFuGGx0ZPCeDpUjJED_TcND6oWmolrrMBlfCNdyr-yMj_WCseJ7TPmrL_dgAc0 Oct 04 19:55:00.860416 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 19:55:00.860416 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 19:55:00.860416 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 19:55:00.860416 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 19:55:00.860416 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 19:55:00.860416 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 19:55:00.860416 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: bc8cddf77e654ca7a88b55acca131a45 Oct 04 19:55:00.860416 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-238299873 Oct 04 19:55:00.860416 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 19:55:00.860416 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 19:55:00.860416 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/bc8cddf77e654ca7a88b55acca131a45"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_bc8cddf77e654ca7a88b55acca131a45"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/bc8cddf77e654ca7a88b55acca131a45"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/bc8cddf77e654ca7a88b55acca131a45"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 19:55:00.860416 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-TestNetworkAdvancedServerOps-238299873 Oct 04 19:55:00.860416 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: bc8cddf77e654ca7a88b55acca131a45 Oct 04 19:55:00.860416 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-238299873 Oct 04 19:55:00.860416 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-TestNetworkAdvancedServerOps-238299873-project Oct 04 19:55:00.860416 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 19:55:00.860416 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 19:55:00.860416 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 6c616f37f7714bdaaba2ae66226f37d8 Oct 04 19:55:00.860416 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-TestNetworkAdvancedServerOps-238299873-project Oct 04 19:55:00.860416 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 19:55:00.860416 n-d-851028-13 devstack@n-api.service[123596]: exception: Instance 6d7b0924-928d-42bf-8a1c-cfa3fd7ba30d could not be found. Oct 04 19:55:00.860416 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': '6d7b0924-928d-42bf-8a1c-cfa3fd7ba30d'} Oct 04 19:55:00.860416 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:55:00.860416 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:55:00.860416 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:55:00.860416 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:55:00.860416 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:55:00.860416 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:55:00.860416 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:55:00.860416 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:55:00.860416 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:55:00.860416 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:55:00.860416 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d7b0924-928d-42bf-8a1c-cfa3fd7ba30d could not be found. Oct 04 19:55:00.860416 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:55:00.860416 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:55:00.860416 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:55:00.860416 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:55:00.860416 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:55:00.860416 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:55:00.860416 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:55:00.860416 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:55:00.860416 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:55:00.860416 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:55:00.860416 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:55:00.860416 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:55:00.860416 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:55:00.860416 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:55:00.860416 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:55:00.860416 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:55:00.860416 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d7b0924-928d-42bf-8a1c-cfa3fd7ba30d could not be found. Oct 04 19:55:00.860416 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:55:00.860416 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:55:00.865775 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:55:00.865775 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:55:00.865775 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:55:00.865775 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:55:00.865775 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:55:00.865775 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:55:00.865775 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d7b0924-928d-42bf-8a1c-cfa3fd7ba30d could not be found. Oct 04 19:55:00.865775 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 19:55:00.865775 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-8a15a979-95f5-4b88-b6a1-1ce209977af8 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Returning 404 to user: Instance 6d7b0924-928d-42bf-8a1c-cfa3fd7ba30d could not be found. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:55:00.865775 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-8a15a979-95f5-4b88-b6a1-1ce209977af8 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] 10.222.0.43 "GET /compute/v2.1/servers/6d7b0924-928d-42bf-8a1c-cfa3fd7ba30d" status: 404 len: 111 microversion: 2.1 time: 0.031830 Oct 04 19:55:00.865775 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 4069/7763] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:55:00 2022] GET /compute/v2.1/servers/6d7b0924-928d-42bf-8a1c-cfa3fd7ba30d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:55:04.387498 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-e5e0dd41-4786-4c32-8cf3-6fffb8337b77 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Calling method '.version_select at 0x7fb21ea6d550>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:55:04.418008 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-e5e0dd41-4786-4c32-8cf3-6fffb8337b77 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1659333643" status: 202 len: 0 microversion: 2.1 time: 0.038183 Oct 04 19:55:04.418992 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3695/7764] 10.222.0.43 () {58 vars in 1284 bytes} [Tue Oct 4 19:55:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1659333643 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 19:55:04.469516 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-d87ba4d5-3e36-411a-89e1-f587ae98f23c tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Action: 'create', calling method: .version_select at 0x7fb21eae0f70>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-441051819", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCvW6vatOckUFNNiVxddyuf1gJB49Qa+6tX9v4TcXJoDEEXvhw/O/ePvYKWjrHt+Yeazn1EzUdVgk9BuEZ2AEOUArT0CURbgP6zoVsBaiU+AjvGv53x9rNQ60h5Fg4ZOPg=="}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:55:04.498445 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-d87ba4d5-3e36-411a-89e1-f587ae98f23c tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Getting quotas for project bc8cddf77e654ca7a88b55acca131a45. Resources: {'key_pairs'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:55:04.505539 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-d87ba4d5-3e36-411a-89e1-f587ae98f23c tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Getting quotas for user 6c616f37f7714bdaaba2ae66226f37d8 and project bc8cddf77e654ca7a88b55acca131a45. Resources: {'key_pairs'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:55:04.549003 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-d87ba4d5-3e36-411a-89e1-f587ae98f23c tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.086171 Oct 04 19:55:04.552531 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 4070/7765] 10.222.0.43 () {60 vars in 1159 bytes} [Tue Oct 4 19:55:04 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:55:10.347403 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:55:10.351955 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-9ca2f715-cb7e-4347-bc8d-a3ddba2f3208 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1090575088", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452", "networks": [{"uuid": "1c97376e-8338-4d9c-b86f-a9a24b4bed39"}], "key_name": "tempest-TestNetworkAdvancedServerOps-441051819", "security_groups": [{"name": "tempest-secgroup-smoke-1809828326"}]}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:55:10.481722 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.network.neutron [None req-9ca2f715-cb7e-4347-bc8d-a3ddba2f3208 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] validate_networks() for [('1c97376e-8338-4d9c-b86f-a9a24b4bed39', None, None, None, None, None)] {{(pid=123595) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 19:55:10.942206 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-9ca2f715-cb7e-4347-bc8d-a3ddba2f3208 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Flavor limits 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:55:10.942843 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-9ca2f715-cb7e-4347-bc8d-a3ddba2f3208 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Image limits 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:55:10.943416 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-9ca2f715-cb7e-4347-bc8d-a3ddba2f3208 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Flavor pref 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:55:10.943794 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-9ca2f715-cb7e-4347-bc8d-a3ddba2f3208 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Image pref 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:55:10.944210 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-9ca2f715-cb7e-4347-bc8d-a3ddba2f3208 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:55:10.955415 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9ca2f715-cb7e-4347-bc8d-a3ddba2f3208 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:55:10.955415 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9ca2f715-cb7e-4347-bc8d-a3ddba2f3208 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:55:10.955665 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9ca2f715-cb7e-4347-bc8d-a3ddba2f3208 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:55:10.956672 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9ca2f715-cb7e-4347-bc8d-a3ddba2f3208 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:55:10.957146 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9ca2f715-cb7e-4347-bc8d-a3ddba2f3208 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:55:10.957740 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9ca2f715-cb7e-4347-bc8d-a3ddba2f3208 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:55:10.977172 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-9ca2f715-cb7e-4347-bc8d-a3ddba2f3208 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Getting quotas for project bc8cddf77e654ca7a88b55acca131a45. Resources: {'ram', 'cores', 'instances'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:55:10.982930 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-9ca2f715-cb7e-4347-bc8d-a3ddba2f3208 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Getting quotas for user 6c616f37f7714bdaaba2ae66226f37d8 and project bc8cddf77e654ca7a88b55acca131a45. Resources: {'ram', 'cores', 'instances'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:55:10.995903 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-9ca2f715-cb7e-4347-bc8d-a3ddba2f3208 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Going to run 1 instances... {{(pid=123595) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 19:55:10.998808 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-9ca2f715-cb7e-4347-bc8d-a3ddba2f3208 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] [instance: f84a518c-c10e-4141-ad6c-d3522cf4e4c1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e8943ec5-4038-4d4b-b9b9-2415a79f5243',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 19:55:11.050358 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-9ca2f715-cb7e-4347-bc8d-a3ddba2f3208 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.704971 Oct 04 19:55:11.057911 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3696/7766] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 19:55:10 2022] POST /compute/v2.1/servers => generated 406 bytes in 707 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 19:55:11.062205 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=16 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:55:11.067676 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-156c195a-6a19-44f4-82c6-c5223b5c6542 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:55:11.069029 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-156c195a-6a19-44f4-82c6-c5223b5c6542 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] [instance: f84a518c-c10e-4141-ad6c-d3522cf4e4c1] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:55:11.158563 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-156c195a-6a19-44f4-82c6-c5223b5c6542 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c616f37f7714bdaaba2ae66226f37d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8cddf77e654ca7a88b55acca131a45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:55:11.167585 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-156c195a-6a19-44f4-82c6-c5223b5c6542 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] 10.222.0.43 "GET /compute/v2.1/servers/f84a518c-c10e-4141-ad6c-d3522cf4e4c1" status: 200 len: 1266 microversion: 2.1 time: 0.107801 Oct 04 19:55:11.168489 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 4071/7767] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:55:11 2022] GET /compute/v2.1/servers/f84a518c-c10e-4141-ad6c-d3522cf4e4c1 => generated 1266 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:55:12.196514 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-afffcfa0-f2d0-47e6-a9fc-1e6fee5e6691 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:55:12.197662 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-afffcfa0-f2d0-47e6-a9fc-1e6fee5e6691 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] [instance: f84a518c-c10e-4141-ad6c-d3522cf4e4c1] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:55:12.204841 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-afffcfa0-f2d0-47e6-a9fc-1e6fee5e6691 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:55:12.205847 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-afffcfa0-f2d0-47e6-a9fc-1e6fee5e6691 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:55:12.206297 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-afffcfa0-f2d0-47e6-a9fc-1e6fee5e6691 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:55:12.207016 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-afffcfa0-f2d0-47e6-a9fc-1e6fee5e6691 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:55:12.207474 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-afffcfa0-f2d0-47e6-a9fc-1e6fee5e6691 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:55:12.207965 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-afffcfa0-f2d0-47e6-a9fc-1e6fee5e6691 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:55:12.311280 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-afffcfa0-f2d0-47e6-a9fc-1e6fee5e6691 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c616f37f7714bdaaba2ae66226f37d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8cddf77e654ca7a88b55acca131a45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:55:12.321336 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-afffcfa0-f2d0-47e6-a9fc-1e6fee5e6691 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] 10.222.0.43 "GET /compute/v2.1/servers/f84a518c-c10e-4141-ad6c-d3522cf4e4c1" status: 200 len: 1326 microversion: 2.1 time: 0.133274 Oct 04 19:55:12.323090 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3697/7768] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:55:12 2022] GET /compute/v2.1/servers/f84a518c-c10e-4141-ad6c-d3522cf4e4c1 => generated 1326 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:55:13.346882 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-51aa080f-4ee2-4afb-b23b-504ec4cf39c1 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:55:13.347431 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-51aa080f-4ee2-4afb-b23b-504ec4cf39c1 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] [instance: f84a518c-c10e-4141-ad6c-d3522cf4e4c1] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:55:13.355352 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-51aa080f-4ee2-4afb-b23b-504ec4cf39c1 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:55:13.356462 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-51aa080f-4ee2-4afb-b23b-504ec4cf39c1 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:55:13.357684 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-51aa080f-4ee2-4afb-b23b-504ec4cf39c1 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:55:13.360646 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-51aa080f-4ee2-4afb-b23b-504ec4cf39c1 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:55:13.361607 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-51aa080f-4ee2-4afb-b23b-504ec4cf39c1 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:55:13.362123 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-51aa080f-4ee2-4afb-b23b-504ec4cf39c1 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:55:13.529623 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-51aa080f-4ee2-4afb-b23b-504ec4cf39c1 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c616f37f7714bdaaba2ae66226f37d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8cddf77e654ca7a88b55acca131a45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:55:13.538157 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-51aa080f-4ee2-4afb-b23b-504ec4cf39c1 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] 10.222.0.43 "GET /compute/v2.1/servers/f84a518c-c10e-4141-ad6c-d3522cf4e4c1" status: 200 len: 1392 microversion: 2.1 time: 0.195211 Oct 04 19:55:13.539180 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 4072/7769] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:55:13 2022] GET /compute/v2.1/servers/f84a518c-c10e-4141-ad6c-d3522cf4e4c1 => generated 1392 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:55:13.942639 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-f45341ce-3786-4d5f-96d1-b36c38f377c9 req-cb26401c-f60a-4d3f-af30-7d05618dc5bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f84a518c-c10e-4141-ad6c-d3522cf4e4c1", "tag": "15cf1c8d-c856-428c-b73a-0a79be837e49"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:55:13.968560 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-f45341ce-3786-4d5f-96d1-b36c38f377c9 req-cb26401c-f60a-4d3f-af30-7d05618dc5bf service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:55:13.969056 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-f45341ce-3786-4d5f-96d1-b36c38f377c9 req-cb26401c-f60a-4d3f-af30-7d05618dc5bf service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:55:13.969526 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-f45341ce-3786-4d5f-96d1-b36c38f377c9 req-cb26401c-f60a-4d3f-af30-7d05618dc5bf service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:55:13.981219 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-f45341ce-3786-4d5f-96d1-b36c38f377c9 req-cb26401c-f60a-4d3f-af30-7d05618dc5bf service nova] Creating event network-changed:15cf1c8d-c856-428c-b73a-0a79be837e49 for instance f84a518c-c10e-4141-ad6c-d3522cf4e4c1 on n-h2-851028-13 Oct 04 19:55:13.991545 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-f45341ce-3786-4d5f-96d1-b36c38f377c9 req-cb26401c-f60a-4d3f-af30-7d05618dc5bf service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052950 Oct 04 19:55:13.991545 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3698/7770] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:55:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:55:14.567321 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-c70a023a-e5f4-4503-9974-09a073c32523 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:55:14.567896 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-c70a023a-e5f4-4503-9974-09a073c32523 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] [instance: f84a518c-c10e-4141-ad6c-d3522cf4e4c1] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:55:14.574868 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c70a023a-e5f4-4503-9974-09a073c32523 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:55:14.575378 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c70a023a-e5f4-4503-9974-09a073c32523 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:55:14.575836 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c70a023a-e5f4-4503-9974-09a073c32523 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:55:14.577136 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c70a023a-e5f4-4503-9974-09a073c32523 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:55:14.577637 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c70a023a-e5f4-4503-9974-09a073c32523 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:55:14.578094 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c70a023a-e5f4-4503-9974-09a073c32523 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:55:14.714157 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-c70a023a-e5f4-4503-9974-09a073c32523 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c616f37f7714bdaaba2ae66226f37d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8cddf77e654ca7a88b55acca131a45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:55:14.721882 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-c70a023a-e5f4-4503-9974-09a073c32523 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] 10.222.0.43 "GET /compute/v2.1/servers/f84a518c-c10e-4141-ad6c-d3522cf4e4c1" status: 200 len: 1392 microversion: 2.1 time: 0.158688 Oct 04 19:55:14.722446 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 4073/7771] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:55:14 2022] GET /compute/v2.1/servers/f84a518c-c10e-4141-ad6c-d3522cf4e4c1 => generated 1392 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:55:15.746688 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-90760302-096f-47a0-8425-39e8f50f1279 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:55:15.747420 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-90760302-096f-47a0-8425-39e8f50f1279 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] [instance: f84a518c-c10e-4141-ad6c-d3522cf4e4c1] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:55:15.754618 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-90760302-096f-47a0-8425-39e8f50f1279 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:55:15.755110 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-90760302-096f-47a0-8425-39e8f50f1279 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:55:15.755554 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-90760302-096f-47a0-8425-39e8f50f1279 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:55:15.756262 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-90760302-096f-47a0-8425-39e8f50f1279 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:55:15.756715 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-90760302-096f-47a0-8425-39e8f50f1279 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:55:15.757165 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-90760302-096f-47a0-8425-39e8f50f1279 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:55:15.888946 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-90760302-096f-47a0-8425-39e8f50f1279 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c616f37f7714bdaaba2ae66226f37d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8cddf77e654ca7a88b55acca131a45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:55:15.899676 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-90760302-096f-47a0-8425-39e8f50f1279 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] 10.222.0.43 "GET /compute/v2.1/servers/f84a518c-c10e-4141-ad6c-d3522cf4e4c1" status: 200 len: 1392 microversion: 2.1 time: 0.157790 Oct 04 19:55:15.900640 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3699/7772] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:55:15 2022] GET /compute/v2.1/servers/f84a518c-c10e-4141-ad6c-d3522cf4e4c1 => generated 1392 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:55:16.923997 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-a0beaffd-dfb4-42df-bd43-0e9c9c71a37b tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:55:16.924608 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-a0beaffd-dfb4-42df-bd43-0e9c9c71a37b tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] [instance: f84a518c-c10e-4141-ad6c-d3522cf4e4c1] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:55:16.931521 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a0beaffd-dfb4-42df-bd43-0e9c9c71a37b tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:55:16.932013 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a0beaffd-dfb4-42df-bd43-0e9c9c71a37b tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:55:16.932474 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a0beaffd-dfb4-42df-bd43-0e9c9c71a37b tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:55:16.933217 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a0beaffd-dfb4-42df-bd43-0e9c9c71a37b tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:55:16.933691 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a0beaffd-dfb4-42df-bd43-0e9c9c71a37b tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:55:16.934138 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a0beaffd-dfb4-42df-bd43-0e9c9c71a37b tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:55:17.074269 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-a0beaffd-dfb4-42df-bd43-0e9c9c71a37b tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c616f37f7714bdaaba2ae66226f37d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8cddf77e654ca7a88b55acca131a45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:55:17.082452 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-a0beaffd-dfb4-42df-bd43-0e9c9c71a37b tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] 10.222.0.43 "GET /compute/v2.1/servers/f84a518c-c10e-4141-ad6c-d3522cf4e4c1" status: 200 len: 1392 microversion: 2.1 time: 0.162879 Oct 04 19:55:17.083033 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 4074/7773] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:55:16 2022] GET /compute/v2.1/servers/f84a518c-c10e-4141-ad6c-d3522cf4e4c1 => generated 1392 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:55:18.105436 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-72e3ef28-8f00-435b-9b5c-d8a2b7032f29 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:55:18.106084 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-72e3ef28-8f00-435b-9b5c-d8a2b7032f29 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] [instance: f84a518c-c10e-4141-ad6c-d3522cf4e4c1] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:55:18.113511 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-72e3ef28-8f00-435b-9b5c-d8a2b7032f29 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:55:18.114003 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-72e3ef28-8f00-435b-9b5c-d8a2b7032f29 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:55:18.114456 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-72e3ef28-8f00-435b-9b5c-d8a2b7032f29 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:55:18.115172 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-72e3ef28-8f00-435b-9b5c-d8a2b7032f29 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:55:18.115632 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-72e3ef28-8f00-435b-9b5c-d8a2b7032f29 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:55:18.116068 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-72e3ef28-8f00-435b-9b5c-d8a2b7032f29 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:55:18.256404 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-72e3ef28-8f00-435b-9b5c-d8a2b7032f29 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c616f37f7714bdaaba2ae66226f37d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8cddf77e654ca7a88b55acca131a45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:55:18.264905 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-72e3ef28-8f00-435b-9b5c-d8a2b7032f29 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] 10.222.0.43 "GET /compute/v2.1/servers/f84a518c-c10e-4141-ad6c-d3522cf4e4c1" status: 200 len: 1392 microversion: 2.1 time: 0.163607 Oct 04 19:55:18.265511 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3700/7774] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:55:18 2022] GET /compute/v2.1/servers/f84a518c-c10e-4141-ad6c-d3522cf4e4c1 => generated 1392 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:55:19.288091 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-8a7f2392-1bff-4211-97dc-2110747df959 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:55:19.288737 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-8a7f2392-1bff-4211-97dc-2110747df959 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] [instance: f84a518c-c10e-4141-ad6c-d3522cf4e4c1] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:55:19.296020 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8a7f2392-1bff-4211-97dc-2110747df959 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:55:19.296512 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8a7f2392-1bff-4211-97dc-2110747df959 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:55:19.296977 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8a7f2392-1bff-4211-97dc-2110747df959 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:55:19.297735 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8a7f2392-1bff-4211-97dc-2110747df959 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:55:19.298212 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8a7f2392-1bff-4211-97dc-2110747df959 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:55:19.298664 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8a7f2392-1bff-4211-97dc-2110747df959 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:55:19.431605 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-8a7f2392-1bff-4211-97dc-2110747df959 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c616f37f7714bdaaba2ae66226f37d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8cddf77e654ca7a88b55acca131a45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:55:19.439488 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-8a7f2392-1bff-4211-97dc-2110747df959 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] 10.222.0.43 "GET /compute/v2.1/servers/f84a518c-c10e-4141-ad6c-d3522cf4e4c1" status: 200 len: 1392 microversion: 2.1 time: 0.155730 Oct 04 19:55:19.440065 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 4075/7775] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:55:19 2022] GET /compute/v2.1/servers/f84a518c-c10e-4141-ad6c-d3522cf4e4c1 => generated 1392 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:55:19.693474 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-6fec0e7b-68b0-4ec8-b7bd-21d96786a459 req-219b84bc-1283-49b6-80e1-580b187a8a41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f84a518c-c10e-4141-ad6c-d3522cf4e4c1", "name": "network-vif-plugged", "status": "completed", "tag": "15cf1c8d-c856-428c-b73a-0a79be837e49"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:55:19.705716 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-6fec0e7b-68b0-4ec8-b7bd-21d96786a459 req-219b84bc-1283-49b6-80e1-580b187a8a41 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:55:19.706565 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-6fec0e7b-68b0-4ec8-b7bd-21d96786a459 req-219b84bc-1283-49b6-80e1-580b187a8a41 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:55:19.707011 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-6fec0e7b-68b0-4ec8-b7bd-21d96786a459 req-219b84bc-1283-49b6-80e1-580b187a8a41 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:55:19.725888 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-6fec0e7b-68b0-4ec8-b7bd-21d96786a459 req-219b84bc-1283-49b6-80e1-580b187a8a41 service nova] Creating event network-vif-plugged:15cf1c8d-c856-428c-b73a-0a79be837e49 for instance f84a518c-c10e-4141-ad6c-d3522cf4e4c1 on n-h2-851028-13 Oct 04 19:55:19.730839 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-6fec0e7b-68b0-4ec8-b7bd-21d96786a459 req-219b84bc-1283-49b6-80e1-580b187a8a41 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041214 Oct 04 19:55:19.731436 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3701/7776] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:55:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:55:20.463148 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-685d8b99-2ede-4ff8-bb52-cc6bfd2a0c6a tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:55:20.463774 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-685d8b99-2ede-4ff8-bb52-cc6bfd2a0c6a tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] [instance: f84a518c-c10e-4141-ad6c-d3522cf4e4c1] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:55:20.466984 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=1 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:55:20.472599 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-685d8b99-2ede-4ff8-bb52-cc6bfd2a0c6a tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:55:20.473100 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-685d8b99-2ede-4ff8-bb52-cc6bfd2a0c6a tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:55:20.473894 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-685d8b99-2ede-4ff8-bb52-cc6bfd2a0c6a tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:55:20.474438 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-685d8b99-2ede-4ff8-bb52-cc6bfd2a0c6a tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:55:20.474912 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-685d8b99-2ede-4ff8-bb52-cc6bfd2a0c6a tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:55:20.475496 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-685d8b99-2ede-4ff8-bb52-cc6bfd2a0c6a tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:55:20.620592 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-685d8b99-2ede-4ff8-bb52-cc6bfd2a0c6a tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c616f37f7714bdaaba2ae66226f37d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8cddf77e654ca7a88b55acca131a45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:55:20.628584 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-685d8b99-2ede-4ff8-bb52-cc6bfd2a0c6a tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] 10.222.0.43 "GET /compute/v2.1/servers/f84a518c-c10e-4141-ad6c-d3522cf4e4c1" status: 200 len: 1392 microversion: 2.1 time: 0.169380 Oct 04 19:55:20.629208 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 4076/7777] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:55:20 2022] GET /compute/v2.1/servers/f84a518c-c10e-4141-ad6c-d3522cf4e4c1 => generated 1392 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:55:21.650095 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=2 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:55:21.650983 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=6 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:55:21.655718 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-f90e0c55-40f8-4cbe-89bd-08aff64e964f tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:55:21.656431 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-f90e0c55-40f8-4cbe-89bd-08aff64e964f tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] [instance: f84a518c-c10e-4141-ad6c-d3522cf4e4c1] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:55:21.663639 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f90e0c55-40f8-4cbe-89bd-08aff64e964f tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:55:21.664127 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f90e0c55-40f8-4cbe-89bd-08aff64e964f tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:55:21.664570 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f90e0c55-40f8-4cbe-89bd-08aff64e964f tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:55:21.665300 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f90e0c55-40f8-4cbe-89bd-08aff64e964f tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:55:21.665760 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f90e0c55-40f8-4cbe-89bd-08aff64e964f tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:55:21.666196 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f90e0c55-40f8-4cbe-89bd-08aff64e964f tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:55:21.803018 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-f90e0c55-40f8-4cbe-89bd-08aff64e964f tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c616f37f7714bdaaba2ae66226f37d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8cddf77e654ca7a88b55acca131a45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:55:21.812094 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-f90e0c55-40f8-4cbe-89bd-08aff64e964f tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] 10.222.0.43 "GET /compute/v2.1/servers/f84a518c-c10e-4141-ad6c-d3522cf4e4c1" status: 200 len: 1564 microversion: 2.1 time: 0.163696 Oct 04 19:55:21.812827 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3702/7778] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:55:21 2022] GET /compute/v2.1/servers/f84a518c-c10e-4141-ad6c-d3522cf4e4c1 => generated 1564 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:55:21.837037 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-ab6f2ce7-ab58-4625-bf37-f6b2b85b99c9 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:55:21.837742 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-ab6f2ce7-ab58-4625-bf37-f6b2b85b99c9 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] [instance: f84a518c-c10e-4141-ad6c-d3522cf4e4c1] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:55:21.839723 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=6 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:55:21.846920 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ab6f2ce7-ab58-4625-bf37-f6b2b85b99c9 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:55:21.847438 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ab6f2ce7-ab58-4625-bf37-f6b2b85b99c9 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:55:21.848093 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ab6f2ce7-ab58-4625-bf37-f6b2b85b99c9 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:55:21.848768 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ab6f2ce7-ab58-4625-bf37-f6b2b85b99c9 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:55:21.849279 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ab6f2ce7-ab58-4625-bf37-f6b2b85b99c9 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:55:21.849730 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ab6f2ce7-ab58-4625-bf37-f6b2b85b99c9 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:55:21.999667 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-ab6f2ce7-ab58-4625-bf37-f6b2b85b99c9 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c616f37f7714bdaaba2ae66226f37d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8cddf77e654ca7a88b55acca131a45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:55:22.011691 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-ab6f2ce7-ab58-4625-bf37-f6b2b85b99c9 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] 10.222.0.43 "GET /compute/v2.1/servers/f84a518c-c10e-4141-ad6c-d3522cf4e4c1" status: 200 len: 1564 microversion: 2.1 time: 0.178238 Oct 04 19:55:22.012714 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 4077/7779] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:55:21 2022] GET /compute/v2.1/servers/f84a518c-c10e-4141-ad6c-d3522cf4e4c1 => generated 1564 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:55:23.893420 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-2ae5e03c-9aef-471f-a479-900bb903f43c tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:55:23.894184 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-2ae5e03c-9aef-471f-a479-900bb903f43c tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] [instance: f84a518c-c10e-4141-ad6c-d3522cf4e4c1] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:55:23.894324 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-68e5e19a-d169-4e61-a7de-609e59974064 req-a880d1f8-d0bf-425d-99bc-af847fa833db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f84a518c-c10e-4141-ad6c-d3522cf4e4c1", "tag": "15cf1c8d-c856-428c-b73a-0a79be837e49"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:55:23.901994 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2ae5e03c-9aef-471f-a479-900bb903f43c tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:55:23.902493 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2ae5e03c-9aef-471f-a479-900bb903f43c tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:55:23.902940 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2ae5e03c-9aef-471f-a479-900bb903f43c tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:55:23.903798 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2ae5e03c-9aef-471f-a479-900bb903f43c tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:55:23.905037 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2ae5e03c-9aef-471f-a479-900bb903f43c tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:55:23.905640 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-68e5e19a-d169-4e61-a7de-609e59974064 req-a880d1f8-d0bf-425d-99bc-af847fa833db service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:55:23.906123 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-2ae5e03c-9aef-471f-a479-900bb903f43c tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:55:23.906261 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-68e5e19a-d169-4e61-a7de-609e59974064 req-a880d1f8-d0bf-425d-99bc-af847fa833db service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:55:23.906596 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-68e5e19a-d169-4e61-a7de-609e59974064 req-a880d1f8-d0bf-425d-99bc-af847fa833db service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:55:23.918413 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-68e5e19a-d169-4e61-a7de-609e59974064 req-a880d1f8-d0bf-425d-99bc-af847fa833db service nova] Creating event network-changed:15cf1c8d-c856-428c-b73a-0a79be837e49 for instance f84a518c-c10e-4141-ad6c-d3522cf4e4c1 on n-h2-851028-13 Oct 04 19:55:23.923942 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-68e5e19a-d169-4e61-a7de-609e59974064 req-a880d1f8-d0bf-425d-99bc-af847fa833db service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033262 Oct 04 19:55:23.924992 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 4078/7780] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:55:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:55:24.142412 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-2ae5e03c-9aef-471f-a479-900bb903f43c tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c616f37f7714bdaaba2ae66226f37d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8cddf77e654ca7a88b55acca131a45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:55:24.152082 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-2ae5e03c-9aef-471f-a479-900bb903f43c tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] 10.222.0.43 "GET /compute/v2.1/servers/f84a518c-c10e-4141-ad6c-d3522cf4e4c1" status: 200 len: 1564 microversion: 2.1 time: 0.264039 Oct 04 19:55:24.152691 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3703/7781] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:55:23 2022] GET /compute/v2.1/servers/f84a518c-c10e-4141-ad6c-d3522cf4e4c1 => generated 1564 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:55:47.418589 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-62600335-b695-4108-9f43-f53b5fd55f40 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:55:47.420969 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-62600335-b695-4108-9f43-f53b5fd55f40 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] [instance: f84a518c-c10e-4141-ad6c-d3522cf4e4c1] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:55:47.423244 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_api:SELECT=5 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:55:47.424129 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=38 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:55:47.431273 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-62600335-b695-4108-9f43-f53b5fd55f40 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:55:47.431886 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-62600335-b695-4108-9f43-f53b5fd55f40 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:55:47.432400 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-62600335-b695-4108-9f43-f53b5fd55f40 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:55:47.433308 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-62600335-b695-4108-9f43-f53b5fd55f40 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:55:47.433845 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-62600335-b695-4108-9f43-f53b5fd55f40 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:55:47.434827 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-62600335-b695-4108-9f43-f53b5fd55f40 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:55:47.490240 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-62600335-b695-4108-9f43-f53b5fd55f40 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] 10.222.0.43 "POST /compute/v2.1/servers/f84a518c-c10e-4141-ad6c-d3522cf4e4c1/action" status: 200 len: 24568 microversion: 2.1 time: 0.076213 Oct 04 19:55:47.490913 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 4079/7782] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 19:55:47 2022] POST /compute/v2.1/servers/f84a518c-c10e-4141-ad6c-d3522cf4e4c1/action => generated 24568 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 19:55:58.589794 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-33982cf9-ef44-448e-87e1-4a5489ce8f34 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:55:58.590930 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-33982cf9-ef44-448e-87e1-4a5489ce8f34 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] [instance: f84a518c-c10e-4141-ad6c-d3522cf4e4c1] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:55:58.593024 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:55:58.593725 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=36 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:55:58.600233 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-33982cf9-ef44-448e-87e1-4a5489ce8f34 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:55:58.600721 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-33982cf9-ef44-448e-87e1-4a5489ce8f34 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:55:58.601185 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-33982cf9-ef44-448e-87e1-4a5489ce8f34 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:55:58.601885 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-33982cf9-ef44-448e-87e1-4a5489ce8f34 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:55:58.602349 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-33982cf9-ef44-448e-87e1-4a5489ce8f34 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:55:58.602775 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-33982cf9-ef44-448e-87e1-4a5489ce8f34 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:55:58.627396 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.objects.instance [None req-33982cf9-ef44-448e-87e1-4a5489ce8f34 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lazy-loading 'flavor' on Instance uuid f84a518c-c10e-4141-ad6c-d3522cf4e4c1 {{(pid=123595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 19:55:58.691953 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-33982cf9-ef44-448e-87e1-4a5489ce8f34 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] 10.222.0.43 "POST /compute/v2.1/servers/f84a518c-c10e-4141-ad6c-d3522cf4e4c1/action" status: 202 len: 0 microversion: 2.1 time: 0.106192 Oct 04 19:55:58.692661 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3704/7783] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 19:55:58 2022] POST /compute/v2.1/servers/f84a518c-c10e-4141-ad6c-d3522cf4e4c1/action => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:55:58.701519 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-21a419df-83ff-4d86-882f-7ddc6b1dc03a tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:55:58.702246 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-21a419df-83ff-4d86-882f-7ddc6b1dc03a tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] [instance: f84a518c-c10e-4141-ad6c-d3522cf4e4c1] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:55:58.705527 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_api:SELECT=2 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:55:58.706223 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=4 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:55:58.712778 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-21a419df-83ff-4d86-882f-7ddc6b1dc03a tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:55:58.713334 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-21a419df-83ff-4d86-882f-7ddc6b1dc03a tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:55:58.713857 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-21a419df-83ff-4d86-882f-7ddc6b1dc03a tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:55:58.714808 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-21a419df-83ff-4d86-882f-7ddc6b1dc03a tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:55:58.715887 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-21a419df-83ff-4d86-882f-7ddc6b1dc03a tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:55:58.716347 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-21a419df-83ff-4d86-882f-7ddc6b1dc03a tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:55:58.854651 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-21a419df-83ff-4d86-882f-7ddc6b1dc03a tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c616f37f7714bdaaba2ae66226f37d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8cddf77e654ca7a88b55acca131a45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:55:58.863055 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-21a419df-83ff-4d86-882f-7ddc6b1dc03a tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] 10.222.0.43 "GET /compute/v2.1/servers/f84a518c-c10e-4141-ad6c-d3522cf4e4c1" status: 200 len: 1691 microversion: 2.1 time: 0.165900 Oct 04 19:55:58.863629 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 4080/7784] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:55:58 2022] GET /compute/v2.1/servers/f84a518c-c10e-4141-ad6c-d3522cf4e4c1 => generated 1691 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:55:59.888958 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-74d3c7f8-4c96-4baa-9ebe-3aa283c1567a tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:55:59.889716 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-74d3c7f8-4c96-4baa-9ebe-3aa283c1567a tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] [instance: f84a518c-c10e-4141-ad6c-d3522cf4e4c1] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:55:59.896004 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-74d3c7f8-4c96-4baa-9ebe-3aa283c1567a tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:55:59.896561 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-74d3c7f8-4c96-4baa-9ebe-3aa283c1567a tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:55:59.896943 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-74d3c7f8-4c96-4baa-9ebe-3aa283c1567a tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:55:59.897690 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-74d3c7f8-4c96-4baa-9ebe-3aa283c1567a tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:55:59.898153 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-74d3c7f8-4c96-4baa-9ebe-3aa283c1567a tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:55:59.898584 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-74d3c7f8-4c96-4baa-9ebe-3aa283c1567a tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:56:00.031240 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-74d3c7f8-4c96-4baa-9ebe-3aa283c1567a tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c616f37f7714bdaaba2ae66226f37d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8cddf77e654ca7a88b55acca131a45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:56:00.040454 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-74d3c7f8-4c96-4baa-9ebe-3aa283c1567a tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] 10.222.0.43 "GET /compute/v2.1/servers/f84a518c-c10e-4141-ad6c-d3522cf4e4c1" status: 200 len: 1674 microversion: 2.1 time: 0.156612 Oct 04 19:56:00.041042 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3705/7785] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:55:59 2022] GET /compute/v2.1/servers/f84a518c-c10e-4141-ad6c-d3522cf4e4c1 => generated 1674 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:56:01.135644 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-17267a77-e1ee-47dd-839f-bacf9b1a5c9a tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:56:01.138498 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-17267a77-e1ee-47dd-839f-bacf9b1a5c9a tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] [instance: f84a518c-c10e-4141-ad6c-d3522cf4e4c1] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:56:01.146457 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-17267a77-e1ee-47dd-839f-bacf9b1a5c9a tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:56:01.146963 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-17267a77-e1ee-47dd-839f-bacf9b1a5c9a tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:56:01.147423 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-17267a77-e1ee-47dd-839f-bacf9b1a5c9a tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:56:01.148136 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-17267a77-e1ee-47dd-839f-bacf9b1a5c9a tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:56:01.148610 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-17267a77-e1ee-47dd-839f-bacf9b1a5c9a tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:56:01.149060 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-17267a77-e1ee-47dd-839f-bacf9b1a5c9a tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:56:01.199494 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-17267a77-e1ee-47dd-839f-bacf9b1a5c9a tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] 10.222.0.43 "POST /compute/v2.1/servers/f84a518c-c10e-4141-ad6c-d3522cf4e4c1/action" status: 200 len: 38377 microversion: 2.1 time: 0.067656 Oct 04 19:56:01.200151 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 4081/7786] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 19:56:01 2022] POST /compute/v2.1/servers/f84a518c-c10e-4141-ad6c-d3522cf4e4c1/action => generated 38377 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 19:56:01.212652 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-446570ad-b06f-43f8-a7fa-741fb2ae2b9c tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:56:01.213222 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-446570ad-b06f-43f8-a7fa-741fb2ae2b9c tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] [instance: f84a518c-c10e-4141-ad6c-d3522cf4e4c1] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:56:01.220063 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-446570ad-b06f-43f8-a7fa-741fb2ae2b9c tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:56:01.220555 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-446570ad-b06f-43f8-a7fa-741fb2ae2b9c tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:56:01.221007 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-446570ad-b06f-43f8-a7fa-741fb2ae2b9c tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:56:01.221736 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-446570ad-b06f-43f8-a7fa-741fb2ae2b9c tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:56:01.222199 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-446570ad-b06f-43f8-a7fa-741fb2ae2b9c tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:56:01.222635 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-446570ad-b06f-43f8-a7fa-741fb2ae2b9c tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:56:01.291624 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-446570ad-b06f-43f8-a7fa-741fb2ae2b9c tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] 10.222.0.43 "POST /compute/v2.1/servers/f84a518c-c10e-4141-ad6c-d3522cf4e4c1/action" status: 202 len: 0 microversion: 2.1 time: 0.082685 Oct 04 19:56:01.292724 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3706/7787] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 19:56:01 2022] POST /compute/v2.1/servers/f84a518c-c10e-4141-ad6c-d3522cf4e4c1/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:56:01.303035 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-90bda6aa-a6c3-4bc9-a9a0-143c164b5618 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:56:01.303704 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-90bda6aa-a6c3-4bc9-a9a0-143c164b5618 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] [instance: f84a518c-c10e-4141-ad6c-d3522cf4e4c1] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:56:01.311923 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-90bda6aa-a6c3-4bc9-a9a0-143c164b5618 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:56:01.312576 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-90bda6aa-a6c3-4bc9-a9a0-143c164b5618 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:56:01.313032 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-90bda6aa-a6c3-4bc9-a9a0-143c164b5618 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:56:01.313804 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-90bda6aa-a6c3-4bc9-a9a0-143c164b5618 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:56:01.314269 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-90bda6aa-a6c3-4bc9-a9a0-143c164b5618 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:56:01.314722 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-90bda6aa-a6c3-4bc9-a9a0-143c164b5618 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:56:01.451990 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-90bda6aa-a6c3-4bc9-a9a0-143c164b5618 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c616f37f7714bdaaba2ae66226f37d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8cddf77e654ca7a88b55acca131a45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:56:01.460365 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-90bda6aa-a6c3-4bc9-a9a0-143c164b5618 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] 10.222.0.43 "GET /compute/v2.1/servers/f84a518c-c10e-4141-ad6c-d3522cf4e4c1" status: 200 len: 1680 microversion: 2.1 time: 0.162477 Oct 04 19:56:01.460948 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 4082/7788] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:56:01 2022] GET /compute/v2.1/servers/f84a518c-c10e-4141-ad6c-d3522cf4e4c1 => generated 1680 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:56:02.484436 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-82a1da90-6d07-404e-a62e-52d12bd20c77 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:56:02.485168 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-82a1da90-6d07-404e-a62e-52d12bd20c77 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] [instance: f84a518c-c10e-4141-ad6c-d3522cf4e4c1] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:56:02.492707 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-82a1da90-6d07-404e-a62e-52d12bd20c77 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:56:02.493228 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-82a1da90-6d07-404e-a62e-52d12bd20c77 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:56:02.493678 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-82a1da90-6d07-404e-a62e-52d12bd20c77 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:56:02.494388 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-82a1da90-6d07-404e-a62e-52d12bd20c77 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:56:02.494849 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-82a1da90-6d07-404e-a62e-52d12bd20c77 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:56:02.495282 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-82a1da90-6d07-404e-a62e-52d12bd20c77 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:56:02.632740 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-82a1da90-6d07-404e-a62e-52d12bd20c77 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c616f37f7714bdaaba2ae66226f37d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8cddf77e654ca7a88b55acca131a45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:56:02.641123 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-82a1da90-6d07-404e-a62e-52d12bd20c77 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] 10.222.0.43 "GET /compute/v2.1/servers/f84a518c-c10e-4141-ad6c-d3522cf4e4c1" status: 200 len: 1680 microversion: 2.1 time: 0.161007 Oct 04 19:56:02.641730 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3707/7789] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:56:02 2022] GET /compute/v2.1/servers/f84a518c-c10e-4141-ad6c-d3522cf4e4c1 => generated 1680 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:56:03.665235 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-1be3605e-4d44-48ee-b7aa-c015c71773e8 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:56:03.665910 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-1be3605e-4d44-48ee-b7aa-c015c71773e8 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] [instance: f84a518c-c10e-4141-ad6c-d3522cf4e4c1] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:56:03.673445 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1be3605e-4d44-48ee-b7aa-c015c71773e8 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:56:03.674100 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1be3605e-4d44-48ee-b7aa-c015c71773e8 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:56:03.674578 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1be3605e-4d44-48ee-b7aa-c015c71773e8 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:56:03.675299 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1be3605e-4d44-48ee-b7aa-c015c71773e8 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:56:03.675780 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1be3605e-4d44-48ee-b7aa-c015c71773e8 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:56:03.676231 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1be3605e-4d44-48ee-b7aa-c015c71773e8 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:56:03.812700 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-1be3605e-4d44-48ee-b7aa-c015c71773e8 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c616f37f7714bdaaba2ae66226f37d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8cddf77e654ca7a88b55acca131a45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:56:03.820568 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-1be3605e-4d44-48ee-b7aa-c015c71773e8 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] 10.222.0.43 "GET /compute/v2.1/servers/f84a518c-c10e-4141-ad6c-d3522cf4e4c1" status: 200 len: 1683 microversion: 2.1 time: 0.159459 Oct 04 19:56:03.821176 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 4083/7790] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:56:03 2022] GET /compute/v2.1/servers/f84a518c-c10e-4141-ad6c-d3522cf4e4c1 => generated 1683 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:56:03.921484 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-b4d3bba6-8b9a-40dd-9c02-2f63fb31e332 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:56:03.923706 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-b4d3bba6-8b9a-40dd-9c02-2f63fb31e332 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] [instance: f84a518c-c10e-4141-ad6c-d3522cf4e4c1] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:56:03.931584 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b4d3bba6-8b9a-40dd-9c02-2f63fb31e332 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:56:03.932238 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b4d3bba6-8b9a-40dd-9c02-2f63fb31e332 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:56:03.932564 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b4d3bba6-8b9a-40dd-9c02-2f63fb31e332 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:56:03.933430 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b4d3bba6-8b9a-40dd-9c02-2f63fb31e332 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:56:03.933818 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b4d3bba6-8b9a-40dd-9c02-2f63fb31e332 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:56:03.934265 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b4d3bba6-8b9a-40dd-9c02-2f63fb31e332 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:56:03.981478 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-b4d3bba6-8b9a-40dd-9c02-2f63fb31e332 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] 10.222.0.43 "POST /compute/v2.1/servers/f84a518c-c10e-4141-ad6c-d3522cf4e4c1/action" status: 200 len: 38377 microversion: 2.1 time: 0.063874 Oct 04 19:56:03.982120 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3708/7791] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 19:56:03 2022] POST /compute/v2.1/servers/f84a518c-c10e-4141-ad6c-d3522cf4e4c1/action => generated 38377 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 19:56:04.988162 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-74f91357-8a35-4ee3-b20d-10f441d2a9c8 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:56:04.988704 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-74f91357-8a35-4ee3-b20d-10f441d2a9c8 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] [instance: f84a518c-c10e-4141-ad6c-d3522cf4e4c1] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:56:04.990826 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-eff9f21f-7c6f-4d95-a262-a5a6c32bcc5b req-62ab7429-9a1d-44ce-91f5-0adb16ab29bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f84a518c-c10e-4141-ad6c-d3522cf4e4c1", "tag": "15cf1c8d-c856-428c-b73a-0a79be837e49"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:56:04.995805 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-74f91357-8a35-4ee3-b20d-10f441d2a9c8 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:56:04.996286 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-74f91357-8a35-4ee3-b20d-10f441d2a9c8 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:56:04.996751 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-74f91357-8a35-4ee3-b20d-10f441d2a9c8 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:56:04.997507 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-74f91357-8a35-4ee3-b20d-10f441d2a9c8 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:56:04.997993 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-74f91357-8a35-4ee3-b20d-10f441d2a9c8 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:56:04.998446 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-74f91357-8a35-4ee3-b20d-10f441d2a9c8 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:56:05.002933 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-eff9f21f-7c6f-4d95-a262-a5a6c32bcc5b req-62ab7429-9a1d-44ce-91f5-0adb16ab29bf service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:56:05.003854 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-eff9f21f-7c6f-4d95-a262-a5a6c32bcc5b req-62ab7429-9a1d-44ce-91f5-0adb16ab29bf service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:56:05.004299 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-eff9f21f-7c6f-4d95-a262-a5a6c32bcc5b req-62ab7429-9a1d-44ce-91f5-0adb16ab29bf service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:56:05.016966 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-eff9f21f-7c6f-4d95-a262-a5a6c32bcc5b req-62ab7429-9a1d-44ce-91f5-0adb16ab29bf service nova] Creating event network-changed:15cf1c8d-c856-428c-b73a-0a79be837e49 for instance f84a518c-c10e-4141-ad6c-d3522cf4e4c1 on n-h2-851028-13 Oct 04 19:56:05.022339 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-eff9f21f-7c6f-4d95-a262-a5a6c32bcc5b req-62ab7429-9a1d-44ce-91f5-0adb16ab29bf service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035787 Oct 04 19:56:05.023272 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3709/7792] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:56:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:56:05.025686 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-74f91357-8a35-4ee3-b20d-10f441d2a9c8 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] [instance: f84a518c-c10e-4141-ad6c-d3522cf4e4c1] Going to try to terminate instance {{(pid=123596) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 19:56:05.111675 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-74f91357-8a35-4ee3-b20d-10f441d2a9c8 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] 10.222.0.43 "DELETE /compute/v2.1/servers/f84a518c-c10e-4141-ad6c-d3522cf4e4c1" status: 204 len: 0 microversion: 2.1 time: 0.127414 Oct 04 19:56:05.115787 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 4084/7793] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 19:56:04 2022] DELETE /compute/v2.1/servers/f84a518c-c10e-4141-ad6c-d3522cf4e4c1 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:56:05.122974 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-5c1ce100-d2eb-466f-815c-c4e654397551 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:56:05.123702 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-5c1ce100-d2eb-466f-815c-c4e654397551 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] [instance: f84a518c-c10e-4141-ad6c-d3522cf4e4c1] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:56:05.129914 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5c1ce100-d2eb-466f-815c-c4e654397551 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:56:05.130414 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5c1ce100-d2eb-466f-815c-c4e654397551 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:56:05.130896 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5c1ce100-d2eb-466f-815c-c4e654397551 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:56:05.131912 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5c1ce100-d2eb-466f-815c-c4e654397551 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:56:05.132386 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5c1ce100-d2eb-466f-815c-c4e654397551 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:56:05.132826 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5c1ce100-d2eb-466f-815c-c4e654397551 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:56:05.291190 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-5c1ce100-d2eb-466f-815c-c4e654397551 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c616f37f7714bdaaba2ae66226f37d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8cddf77e654ca7a88b55acca131a45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:56:05.300800 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-5c1ce100-d2eb-466f-815c-c4e654397551 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] 10.222.0.43 "GET /compute/v2.1/servers/f84a518c-c10e-4141-ad6c-d3522cf4e4c1" status: 200 len: 1689 microversion: 2.1 time: 0.183087 Oct 04 19:56:05.301554 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3710/7794] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:56:05 2022] GET /compute/v2.1/servers/f84a518c-c10e-4141-ad6c-d3522cf4e4c1 => generated 1689 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:56:06.327542 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-1a24a34d-a39b-4d42-bc37-0763c31a05f3 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:56:06.328276 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-1a24a34d-a39b-4d42-bc37-0763c31a05f3 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] [instance: f84a518c-c10e-4141-ad6c-d3522cf4e4c1] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:56:06.335334 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1a24a34d-a39b-4d42-bc37-0763c31a05f3 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:56:06.335849 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1a24a34d-a39b-4d42-bc37-0763c31a05f3 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:56:06.336322 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1a24a34d-a39b-4d42-bc37-0763c31a05f3 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:56:06.337048 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1a24a34d-a39b-4d42-bc37-0763c31a05f3 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:56:06.337560 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1a24a34d-a39b-4d42-bc37-0763c31a05f3 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:56:06.338017 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-1a24a34d-a39b-4d42-bc37-0763c31a05f3 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:56:06.483220 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-1a24a34d-a39b-4d42-bc37-0763c31a05f3 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c616f37f7714bdaaba2ae66226f37d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8cddf77e654ca7a88b55acca131a45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:56:06.491179 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-1a24a34d-a39b-4d42-bc37-0763c31a05f3 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] 10.222.0.43 "GET /compute/v2.1/servers/f84a518c-c10e-4141-ad6c-d3522cf4e4c1" status: 200 len: 1689 microversion: 2.1 time: 0.168638 Oct 04 19:56:06.491760 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 4085/7795] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:56:06 2022] GET /compute/v2.1/servers/f84a518c-c10e-4141-ad6c-d3522cf4e4c1 => generated 1689 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:56:07.328133 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-c2c292f9-550e-48de-bc3a-907ef624eb56 req-08407d25-76a0-41e0-ab64-f42286c42b97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f84a518c-c10e-4141-ad6c-d3522cf4e4c1", "name": "network-vif-deleted", "tag": "15cf1c8d-c856-428c-b73a-0a79be837e49"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:56:07.340606 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-c2c292f9-550e-48de-bc3a-907ef624eb56 req-08407d25-76a0-41e0-ab64-f42286c42b97 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:56:07.341394 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-c2c292f9-550e-48de-bc3a-907ef624eb56 req-08407d25-76a0-41e0-ab64-f42286c42b97 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:56:07.341840 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-c2c292f9-550e-48de-bc3a-907ef624eb56 req-08407d25-76a0-41e0-ab64-f42286c42b97 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:56:07.356574 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-c2c292f9-550e-48de-bc3a-907ef624eb56 req-08407d25-76a0-41e0-ab64-f42286c42b97 service nova] Creating event network-vif-deleted:15cf1c8d-c856-428c-b73a-0a79be837e49 for instance f84a518c-c10e-4141-ad6c-d3522cf4e4c1 on n-h2-851028-13 Oct 04 19:56:07.361644 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-c2c292f9-550e-48de-bc3a-907ef624eb56 req-08407d25-76a0-41e0-ab64-f42286c42b97 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037766 Oct 04 19:56:07.362476 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3711/7796] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:56:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:56:07.516203 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-60f42ef1-db66-446f-998d-b4251774642a tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:56:07.516839 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-60f42ef1-db66-446f-998d-b4251774642a tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] [instance: f84a518c-c10e-4141-ad6c-d3522cf4e4c1] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:56:07.523661 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-60f42ef1-db66-446f-998d-b4251774642a tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:56:07.524158 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-60f42ef1-db66-446f-998d-b4251774642a tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:56:07.524609 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-60f42ef1-db66-446f-998d-b4251774642a tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:56:07.525354 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-60f42ef1-db66-446f-998d-b4251774642a tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:56:07.525823 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-60f42ef1-db66-446f-998d-b4251774642a tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:56:07.526262 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-60f42ef1-db66-446f-998d-b4251774642a tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:56:07.557512 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-60f42ef1-db66-446f-998d-b4251774642a tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:56:07.557929 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-60f42ef1-db66-446f-998d-b4251774642a tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:56:07.558865 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-60f42ef1-db66-446f-998d-b4251774642a tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:56:07.559331 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.objects.instance [None req-60f42ef1-db66-446f-998d-b4251774642a tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lazy-loading 'fault' on Instance uuid f84a518c-c10e-4141-ad6c-d3522cf4e4c1 {{(pid=123596) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 19:56:07.602324 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-60f42ef1-db66-446f-998d-b4251774642a tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c616f37f7714bdaaba2ae66226f37d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8cddf77e654ca7a88b55acca131a45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:56:07.610221 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-60f42ef1-db66-446f-998d-b4251774642a tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] 10.222.0.43 "GET /compute/v2.1/servers/f84a518c-c10e-4141-ad6c-d3522cf4e4c1" status: 200 len: 1356 microversion: 2.1 time: 0.098625 Oct 04 19:56:07.610789 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 4086/7797] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:56:07 2022] GET /compute/v2.1/servers/f84a518c-c10e-4141-ad6c-d3522cf4e4c1 => generated 1356 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:56:08.635755 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-307884d7-c264-4f38-b582-2e83f2f09521 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:56:08.636468 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-307884d7-c264-4f38-b582-2e83f2f09521 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] [instance: f84a518c-c10e-4141-ad6c-d3522cf4e4c1] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:56:08.643386 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-307884d7-c264-4f38-b582-2e83f2f09521 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:56:08.643881 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-307884d7-c264-4f38-b582-2e83f2f09521 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:56:08.644331 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-307884d7-c264-4f38-b582-2e83f2f09521 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:56:08.645471 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-307884d7-c264-4f38-b582-2e83f2f09521 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:56:08.645934 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-307884d7-c264-4f38-b582-2e83f2f09521 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:56:08.646373 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-307884d7-c264-4f38-b582-2e83f2f09521 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:56:08.659694 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-307884d7-c264-4f38-b582-2e83f2f09521 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] HTTP exception thrown: Instance f84a518c-c10e-4141-ad6c-d3522cf4e4c1 could not be found. Oct 04 19:56:08.661359 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-307884d7-c264-4f38-b582-2e83f2f09521 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Request method failure captured: Oct 04 19:56:08.661359 n-d-851028-13 devstack@n-api.service[123595]: request: GET /compute/v2.1/servers/f84a518c-c10e-4141-ad6c-d3522cf4e4c1 HTTP/1.1 Oct 04 19:56:08.661359 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 19:56:08.661359 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 19:56:08.661359 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 19:56:08.661359 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 0 Oct 04 19:56:08.661359 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 19:56:08.661359 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 19:56:08.661359 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 19:56:08.661359 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 19:56:08.661359 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPI4MZexuhXm6PsbDTE0mN_HzaWvpyBNcmZcptu-WN0BUo7VbC1tcPqUVzrRf31db8M0EWQ8d_sfA5FFL6AhajMMcCPlTBrfm9fKnWc8kbZzl3TY06xFuGGx0ZPCeDpUjJED_TcND6oWmolrrMBlfCNdyr-yMj_WCseJ7TPmrL_dgAc0 Oct 04 19:56:08.661359 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 19:56:08.661359 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 19:56:08.661359 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 19:56:08.661359 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 19:56:08.661359 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 19:56:08.661359 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 19:56:08.661359 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: bc8cddf77e654ca7a88b55acca131a45 Oct 04 19:56:08.661359 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-238299873 Oct 04 19:56:08.661359 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 19:56:08.661359 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 19:56:08.661359 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/bc8cddf77e654ca7a88b55acca131a45"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_bc8cddf77e654ca7a88b55acca131a45"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/bc8cddf77e654ca7a88b55acca131a45"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/bc8cddf77e654ca7a88b55acca131a45"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 19:56:08.661359 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-TestNetworkAdvancedServerOps-238299873 Oct 04 19:56:08.661359 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: bc8cddf77e654ca7a88b55acca131a45 Oct 04 19:56:08.661359 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-238299873 Oct 04 19:56:08.661359 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-TestNetworkAdvancedServerOps-238299873-project Oct 04 19:56:08.661359 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 19:56:08.661359 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 19:56:08.661359 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: 6c616f37f7714bdaaba2ae66226f37d8 Oct 04 19:56:08.661359 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-TestNetworkAdvancedServerOps-238299873-project Oct 04 19:56:08.661359 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 19:56:08.661359 n-d-851028-13 devstack@n-api.service[123595]: exception: Instance f84a518c-c10e-4141-ad6c-d3522cf4e4c1 could not be found. Oct 04 19:56:08.661359 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': 'f84a518c-c10e-4141-ad6c-d3522cf4e4c1'} Oct 04 19:56:08.661359 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:56:08.661359 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:56:08.661359 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:56:08.661359 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:56:08.661359 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:56:08.661359 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:56:08.661359 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:56:08.661359 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:56:08.661359 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:56:08.661359 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:56:08.661359 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f84a518c-c10e-4141-ad6c-d3522cf4e4c1 could not be found. Oct 04 19:56:08.661359 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:56:08.661359 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:56:08.661359 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:56:08.661359 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:56:08.661359 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:56:08.661359 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:56:08.661359 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:56:08.661359 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:56:08.661359 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:56:08.661359 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:56:08.661359 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:56:08.661359 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:56:08.661359 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:56:08.661359 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:56:08.661359 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:56:08.661359 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:56:08.661359 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f84a518c-c10e-4141-ad6c-d3522cf4e4c1 could not be found. Oct 04 19:56:08.661359 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:56:08.661359 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:56:08.666544 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:56:08.666544 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:56:08.666544 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:56:08.666544 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:56:08.666544 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:56:08.666544 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:56:08.666544 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f84a518c-c10e-4141-ad6c-d3522cf4e4c1 could not be found. Oct 04 19:56:08.666544 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 19:56:08.666544 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-307884d7-c264-4f38-b582-2e83f2f09521 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Returning 404 to user: Instance f84a518c-c10e-4141-ad6c-d3522cf4e4c1 could not be found. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:56:08.666544 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-307884d7-c264-4f38-b582-2e83f2f09521 tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] 10.222.0.43 "GET /compute/v2.1/servers/f84a518c-c10e-4141-ad6c-d3522cf4e4c1" status: 404 len: 111 microversion: 2.1 time: 0.032387 Oct 04 19:56:08.666544 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3712/7798] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:56:08 2022] GET /compute/v2.1/servers/f84a518c-c10e-4141-ad6c-d3522cf4e4c1 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:56:12.220001 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-b7e431d6-46c8-4b40-9d3c-c12f4eff518c tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] Calling method '.version_select at 0x7fb21ff07d30>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:56:12.245153 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-b7e431d6-46c8-4b40-9d3c-c12f4eff518c tempest-TestNetworkAdvancedServerOps-238299873 tempest-TestNetworkAdvancedServerOps-238299873-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-441051819" status: 202 len: 0 microversion: 2.1 time: 0.029331 Oct 04 19:56:12.245960 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 4087/7799] 10.222.0.43 () {58 vars in 1281 bytes} [Tue Oct 4 19:56:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-441051819 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:56:24.110071 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_api:SELECT=18 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:56:24.111500 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:56:24.387882 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-dbc13bfd-4d0b-45cc-97bf-f1463e5c7e51 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Action: 'create', calling method: .version_select at 0x7fb21e9621f0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1352277834", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP1Wt0qcCsAEfICm+pNKDbzZHo+LTFkDDifW1V/BEMdm2h3BLUGCuy7qHS8gkOqCwi3IM2QyfBlkFAIlrmzJuLyfVfp8na3l2Ug3sb1M/JpTjYS3qaZEmF+1JOzi1hZyZQ=="}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:56:24.419816 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-dbc13bfd-4d0b-45cc-97bf-f1463e5c7e51 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Getting quotas for project 3255c288051e48e08d94ede2bd6ba558. Resources: {'key_pairs'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:56:24.428996 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-dbc13bfd-4d0b-45cc-97bf-f1463e5c7e51 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Getting quotas for user 09cd9718357e4655b245403d0f7a8847 and project 3255c288051e48e08d94ede2bd6ba558. Resources: {'key_pairs'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:56:24.472581 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-dbc13bfd-4d0b-45cc-97bf-f1463e5c7e51 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.368404 Oct 04 19:56:24.473600 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3713/7800] 10.222.0.43 () {60 vars in 1159 bytes} [Tue Oct 4 19:56:24 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:56:25.635857 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:56:25.636824 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:56:25.641898 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-9f45520c-378e-48a4-9b2d-cf1d998312ed tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1076034040", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1352277834", "security_groups": [{"name": "tempest-secgroup-smoke-821505661"}], "networks": [{"uuid": "8cadccd2-89c9-43e6-97ab-926f8fdb277c"}]}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:56:25.754580 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.network.neutron [None req-9f45520c-378e-48a4-9b2d-cf1d998312ed tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] validate_networks() for [('8cadccd2-89c9-43e6-97ab-926f8fdb277c', None, None, None, None, None)] {{(pid=123596) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 19:56:26.174853 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-9f45520c-378e-48a4-9b2d-cf1d998312ed tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Flavor limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:56:26.175327 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-9f45520c-378e-48a4-9b2d-cf1d998312ed tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Image limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:56:26.175825 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-9f45520c-378e-48a4-9b2d-cf1d998312ed tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Flavor pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:56:26.176257 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-9f45520c-378e-48a4-9b2d-cf1d998312ed tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Image pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:56:26.176693 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-9f45520c-378e-48a4-9b2d-cf1d998312ed tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:56:26.187238 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9f45520c-378e-48a4-9b2d-cf1d998312ed tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:56:26.187738 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9f45520c-378e-48a4-9b2d-cf1d998312ed tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:56:26.188200 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9f45520c-378e-48a4-9b2d-cf1d998312ed tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:56:26.188964 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9f45520c-378e-48a4-9b2d-cf1d998312ed tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:56:26.189652 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9f45520c-378e-48a4-9b2d-cf1d998312ed tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:56:26.190149 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9f45520c-378e-48a4-9b2d-cf1d998312ed tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:56:26.212800 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-9f45520c-378e-48a4-9b2d-cf1d998312ed tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Getting quotas for project 3255c288051e48e08d94ede2bd6ba558. Resources: {'ram', 'cores', 'instances'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:56:26.220394 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-9f45520c-378e-48a4-9b2d-cf1d998312ed tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Getting quotas for user 09cd9718357e4655b245403d0f7a8847 and project 3255c288051e48e08d94ede2bd6ba558. Resources: {'ram', 'cores', 'instances'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:56:26.235594 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-9f45520c-378e-48a4-9b2d-cf1d998312ed tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Going to run 1 instances... {{(pid=123596) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 19:56:26.238436 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-9f45520c-378e-48a4-9b2d-cf1d998312ed tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] [instance: 41827212-e39f-4376-ae67-7154e775c2d8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e8943ec5-4038-4d4b-b9b9-2415a79f5243',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123596) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 19:56:26.294564 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-9f45520c-378e-48a4-9b2d-cf1d998312ed tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.660489 Oct 04 19:56:26.295247 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 4088/7801] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 19:56:25 2022] POST /compute/v2.1/servers => generated 405 bytes in 662 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 19:56:26.310654 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-da1c2697-a560-4737-8631-32566cb98d78 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:56:26.311984 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-da1c2697-a560-4737-8631-32566cb98d78 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] [instance: 41827212-e39f-4376-ae67-7154e775c2d8] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:56:26.393967 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-da1c2697-a560-4737-8631-32566cb98d78 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cd9718357e4655b245403d0f7a8847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255c288051e48e08d94ede2bd6ba558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:56:26.415014 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-da1c2697-a560-4737-8631-32566cb98d78 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] 10.222.0.43 "GET /compute/v2.1/servers/41827212-e39f-4376-ae67-7154e775c2d8" status: 200 len: 1247 microversion: 2.1 time: 0.111808 Oct 04 19:56:26.415632 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3714/7802] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:56:26 2022] GET /compute/v2.1/servers/41827212-e39f-4376-ae67-7154e775c2d8 => generated 1247 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:56:27.440787 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-a85ffd65-b4c9-42d6-897e-7ebf4dc027f3 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:56:27.441727 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-a85ffd65-b4c9-42d6-897e-7ebf4dc027f3 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] [instance: 41827212-e39f-4376-ae67-7154e775c2d8] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:56:27.450427 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a85ffd65-b4c9-42d6-897e-7ebf4dc027f3 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:56:27.451339 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a85ffd65-b4c9-42d6-897e-7ebf4dc027f3 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:56:27.451900 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a85ffd65-b4c9-42d6-897e-7ebf4dc027f3 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:56:27.452730 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a85ffd65-b4c9-42d6-897e-7ebf4dc027f3 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:56:27.453310 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a85ffd65-b4c9-42d6-897e-7ebf4dc027f3 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:56:27.453822 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a85ffd65-b4c9-42d6-897e-7ebf4dc027f3 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:56:27.559902 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-a85ffd65-b4c9-42d6-897e-7ebf4dc027f3 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cd9718357e4655b245403d0f7a8847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255c288051e48e08d94ede2bd6ba558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:56:27.571800 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-a85ffd65-b4c9-42d6-897e-7ebf4dc027f3 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] 10.222.0.43 "GET /compute/v2.1/servers/41827212-e39f-4376-ae67-7154e775c2d8" status: 200 len: 1299 microversion: 2.1 time: 0.135794 Oct 04 19:56:27.572400 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 4089/7803] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:56:27 2022] GET /compute/v2.1/servers/41827212-e39f-4376-ae67-7154e775c2d8 => generated 1299 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:56:28.602891 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-bc1316be-2f17-442d-80dc-c99e2fc23a7d tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:56:28.604312 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-bc1316be-2f17-442d-80dc-c99e2fc23a7d tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] [instance: 41827212-e39f-4376-ae67-7154e775c2d8] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:56:28.614790 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bc1316be-2f17-442d-80dc-c99e2fc23a7d tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:56:28.617439 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bc1316be-2f17-442d-80dc-c99e2fc23a7d tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:56:28.618067 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bc1316be-2f17-442d-80dc-c99e2fc23a7d tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:56:28.618910 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bc1316be-2f17-442d-80dc-c99e2fc23a7d tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:56:28.620115 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bc1316be-2f17-442d-80dc-c99e2fc23a7d tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:56:28.624244 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bc1316be-2f17-442d-80dc-c99e2fc23a7d tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:56:28.903020 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-bc1316be-2f17-442d-80dc-c99e2fc23a7d tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cd9718357e4655b245403d0f7a8847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255c288051e48e08d94ede2bd6ba558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:56:28.913204 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-bc1316be-2f17-442d-80dc-c99e2fc23a7d tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] 10.222.0.43 "GET /compute/v2.1/servers/41827212-e39f-4376-ae67-7154e775c2d8" status: 200 len: 1372 microversion: 2.1 time: 0.314535 Oct 04 19:56:28.925709 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3715/7804] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:56:28 2022] GET /compute/v2.1/servers/41827212-e39f-4376-ae67-7154e775c2d8 => generated 1372 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:56:29.491167 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-aa4f50f7-3307-4d27-bdda-facb0211dbc2 req-c5c0fe00-d2dd-47f7-a06b-8e143cabb8cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41827212-e39f-4376-ae67-7154e775c2d8", "tag": "eae6a7a5-92c6-429f-af33-9eb658b8a47a"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:56:29.502375 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-aa4f50f7-3307-4d27-bdda-facb0211dbc2 req-c5c0fe00-d2dd-47f7-a06b-8e143cabb8cb service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:56:29.502977 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-aa4f50f7-3307-4d27-bdda-facb0211dbc2 req-c5c0fe00-d2dd-47f7-a06b-8e143cabb8cb service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:56:29.504202 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-aa4f50f7-3307-4d27-bdda-facb0211dbc2 req-c5c0fe00-d2dd-47f7-a06b-8e143cabb8cb service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:56:29.517286 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-aa4f50f7-3307-4d27-bdda-facb0211dbc2 req-c5c0fe00-d2dd-47f7-a06b-8e143cabb8cb service nova] Creating event network-changed:eae6a7a5-92c6-429f-af33-9eb658b8a47a for instance 41827212-e39f-4376-ae67-7154e775c2d8 on n-h1-851028-13 Oct 04 19:56:29.522276 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-aa4f50f7-3307-4d27-bdda-facb0211dbc2 req-c5c0fe00-d2dd-47f7-a06b-8e143cabb8cb service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035196 Oct 04 19:56:29.523252 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 4090/7805] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:56:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:56:29.939635 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-cf22cb7a-59fd-42e2-8ab3-7d18618a714e tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:56:29.940333 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-cf22cb7a-59fd-42e2-8ab3-7d18618a714e tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] [instance: 41827212-e39f-4376-ae67-7154e775c2d8] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:56:29.947252 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cf22cb7a-59fd-42e2-8ab3-7d18618a714e tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:56:29.947748 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cf22cb7a-59fd-42e2-8ab3-7d18618a714e tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:56:29.948191 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cf22cb7a-59fd-42e2-8ab3-7d18618a714e tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:56:29.948894 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cf22cb7a-59fd-42e2-8ab3-7d18618a714e tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:56:29.949377 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cf22cb7a-59fd-42e2-8ab3-7d18618a714e tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:56:29.949805 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cf22cb7a-59fd-42e2-8ab3-7d18618a714e tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:56:30.088516 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-cf22cb7a-59fd-42e2-8ab3-7d18618a714e tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cd9718357e4655b245403d0f7a8847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255c288051e48e08d94ede2bd6ba558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:56:30.096768 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-cf22cb7a-59fd-42e2-8ab3-7d18618a714e tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] 10.222.0.43 "GET /compute/v2.1/servers/41827212-e39f-4376-ae67-7154e775c2d8" status: 200 len: 1372 microversion: 2.1 time: 0.161226 Oct 04 19:56:30.097362 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3716/7806] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:56:29 2022] GET /compute/v2.1/servers/41827212-e39f-4376-ae67-7154e775c2d8 => generated 1372 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:56:31.122231 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-ce607e79-e7a3-40bc-b675-784fd3b409aa tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:56:31.124011 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-ce607e79-e7a3-40bc-b675-784fd3b409aa tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] [instance: 41827212-e39f-4376-ae67-7154e775c2d8] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:56:31.131135 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ce607e79-e7a3-40bc-b675-784fd3b409aa tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:56:31.131639 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ce607e79-e7a3-40bc-b675-784fd3b409aa tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:56:31.132094 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ce607e79-e7a3-40bc-b675-784fd3b409aa tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:56:31.132818 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ce607e79-e7a3-40bc-b675-784fd3b409aa tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:56:31.133320 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ce607e79-e7a3-40bc-b675-784fd3b409aa tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:56:31.133762 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ce607e79-e7a3-40bc-b675-784fd3b409aa tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:56:31.273841 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-ce607e79-e7a3-40bc-b675-784fd3b409aa tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cd9718357e4655b245403d0f7a8847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255c288051e48e08d94ede2bd6ba558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:56:31.281884 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-ce607e79-e7a3-40bc-b675-784fd3b409aa tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] 10.222.0.43 "GET /compute/v2.1/servers/41827212-e39f-4376-ae67-7154e775c2d8" status: 200 len: 1372 microversion: 2.1 time: 0.165597 Oct 04 19:56:31.282474 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 4091/7807] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:56:31 2022] GET /compute/v2.1/servers/41827212-e39f-4376-ae67-7154e775c2d8 => generated 1372 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:56:32.305970 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-a434fd0f-c605-4911-878e-28f366fa4d67 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:56:32.306563 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-a434fd0f-c605-4911-878e-28f366fa4d67 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] [instance: 41827212-e39f-4376-ae67-7154e775c2d8] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:56:32.314674 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a434fd0f-c605-4911-878e-28f366fa4d67 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:56:32.315176 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a434fd0f-c605-4911-878e-28f366fa4d67 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:56:32.315626 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a434fd0f-c605-4911-878e-28f366fa4d67 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:56:32.316344 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a434fd0f-c605-4911-878e-28f366fa4d67 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:56:32.316828 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a434fd0f-c605-4911-878e-28f366fa4d67 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:56:32.317296 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a434fd0f-c605-4911-878e-28f366fa4d67 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:56:32.457984 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-a434fd0f-c605-4911-878e-28f366fa4d67 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cd9718357e4655b245403d0f7a8847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255c288051e48e08d94ede2bd6ba558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:56:32.465860 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-a434fd0f-c605-4911-878e-28f366fa4d67 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] 10.222.0.43 "GET /compute/v2.1/servers/41827212-e39f-4376-ae67-7154e775c2d8" status: 200 len: 1372 microversion: 2.1 time: 0.164014 Oct 04 19:56:32.466494 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3717/7808] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:56:32 2022] GET /compute/v2.1/servers/41827212-e39f-4376-ae67-7154e775c2d8 => generated 1372 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:56:33.488738 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-ad406ec2-a56c-4a69-905f-99f750bd9957 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:56:33.489401 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-ad406ec2-a56c-4a69-905f-99f750bd9957 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] [instance: 41827212-e39f-4376-ae67-7154e775c2d8] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:56:33.496391 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ad406ec2-a56c-4a69-905f-99f750bd9957 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:56:33.496905 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ad406ec2-a56c-4a69-905f-99f750bd9957 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:56:33.497400 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ad406ec2-a56c-4a69-905f-99f750bd9957 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:56:33.498120 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ad406ec2-a56c-4a69-905f-99f750bd9957 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:56:33.498602 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ad406ec2-a56c-4a69-905f-99f750bd9957 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:56:33.499050 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-ad406ec2-a56c-4a69-905f-99f750bd9957 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:56:33.630780 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-ad406ec2-a56c-4a69-905f-99f750bd9957 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cd9718357e4655b245403d0f7a8847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255c288051e48e08d94ede2bd6ba558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:56:33.639214 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-ad406ec2-a56c-4a69-905f-99f750bd9957 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] 10.222.0.43 "GET /compute/v2.1/servers/41827212-e39f-4376-ae67-7154e775c2d8" status: 200 len: 1372 microversion: 2.1 time: 0.154412 Oct 04 19:56:33.639812 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 4092/7809] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:56:33 2022] GET /compute/v2.1/servers/41827212-e39f-4376-ae67-7154e775c2d8 => generated 1372 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:56:34.360065 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-e7bac09e-5aaf-46fa-af54-5491cb141443 req-d1ba03f6-b50f-445e-9da8-438cb678219a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41827212-e39f-4376-ae67-7154e775c2d8", "name": "network-vif-plugged", "status": "completed", "tag": "eae6a7a5-92c6-429f-af33-9eb658b8a47a"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:56:34.371484 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-e7bac09e-5aaf-46fa-af54-5491cb141443 req-d1ba03f6-b50f-445e-9da8-438cb678219a service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:56:34.371969 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-e7bac09e-5aaf-46fa-af54-5491cb141443 req-d1ba03f6-b50f-445e-9da8-438cb678219a service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:56:34.372405 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-e7bac09e-5aaf-46fa-af54-5491cb141443 req-d1ba03f6-b50f-445e-9da8-438cb678219a service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:56:34.383991 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-e7bac09e-5aaf-46fa-af54-5491cb141443 req-d1ba03f6-b50f-445e-9da8-438cb678219a service nova] Creating event network-vif-plugged:eae6a7a5-92c6-429f-af33-9eb658b8a47a for instance 41827212-e39f-4376-ae67-7154e775c2d8 on n-h1-851028-13 Oct 04 19:56:34.389239 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-e7bac09e-5aaf-46fa-af54-5491cb141443 req-d1ba03f6-b50f-445e-9da8-438cb678219a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034397 Oct 04 19:56:34.389963 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3718/7810] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:56:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:56:34.663537 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-3f0c6029-c498-4e8d-bf11-b3608bcf755c tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:56:34.664170 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-3f0c6029-c498-4e8d-bf11-b3608bcf755c tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] [instance: 41827212-e39f-4376-ae67-7154e775c2d8] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:56:34.672203 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3f0c6029-c498-4e8d-bf11-b3608bcf755c tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:56:34.672718 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3f0c6029-c498-4e8d-bf11-b3608bcf755c tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:56:34.673208 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3f0c6029-c498-4e8d-bf11-b3608bcf755c tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:56:34.673940 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3f0c6029-c498-4e8d-bf11-b3608bcf755c tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:56:34.674426 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3f0c6029-c498-4e8d-bf11-b3608bcf755c tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:56:34.674879 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3f0c6029-c498-4e8d-bf11-b3608bcf755c tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:56:34.816023 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-3f0c6029-c498-4e8d-bf11-b3608bcf755c tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cd9718357e4655b245403d0f7a8847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255c288051e48e08d94ede2bd6ba558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:56:34.824071 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-3f0c6029-c498-4e8d-bf11-b3608bcf755c tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] 10.222.0.43 "GET /compute/v2.1/servers/41827212-e39f-4376-ae67-7154e775c2d8" status: 200 len: 1372 microversion: 2.1 time: 0.164485 Oct 04 19:56:34.824664 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 4093/7811] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:56:34 2022] GET /compute/v2.1/servers/41827212-e39f-4376-ae67-7154e775c2d8 => generated 1372 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:56:35.850398 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-aa6b13d3-b452-4829-a296-0d17599d2e02 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:56:35.851152 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-aa6b13d3-b452-4829-a296-0d17599d2e02 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] [instance: 41827212-e39f-4376-ae67-7154e775c2d8] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:56:35.857904 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-aa6b13d3-b452-4829-a296-0d17599d2e02 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:56:35.858389 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-aa6b13d3-b452-4829-a296-0d17599d2e02 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:56:35.858927 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-aa6b13d3-b452-4829-a296-0d17599d2e02 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:56:35.859597 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-aa6b13d3-b452-4829-a296-0d17599d2e02 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:56:35.860000 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-aa6b13d3-b452-4829-a296-0d17599d2e02 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:56:35.860428 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-aa6b13d3-b452-4829-a296-0d17599d2e02 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:56:35.999240 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-aa6b13d3-b452-4829-a296-0d17599d2e02 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cd9718357e4655b245403d0f7a8847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255c288051e48e08d94ede2bd6ba558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:56:36.007159 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-aa6b13d3-b452-4829-a296-0d17599d2e02 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] 10.222.0.43 "GET /compute/v2.1/servers/41827212-e39f-4376-ae67-7154e775c2d8" status: 200 len: 1553 microversion: 2.1 time: 0.162448 Oct 04 19:56:36.007738 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3719/7812] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:56:35 2022] GET /compute/v2.1/servers/41827212-e39f-4376-ae67-7154e775c2d8 => generated 1553 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:56:36.031170 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-44d8ea4b-6eda-48e8-8401-5de6fa81b87e tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:56:36.032112 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-44d8ea4b-6eda-48e8-8401-5de6fa81b87e tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] [instance: 41827212-e39f-4376-ae67-7154e775c2d8] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:56:36.039656 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-44d8ea4b-6eda-48e8-8401-5de6fa81b87e tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:56:36.040211 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-44d8ea4b-6eda-48e8-8401-5de6fa81b87e tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:56:36.040675 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-44d8ea4b-6eda-48e8-8401-5de6fa81b87e tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:56:36.041576 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-44d8ea4b-6eda-48e8-8401-5de6fa81b87e tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:56:36.042175 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-44d8ea4b-6eda-48e8-8401-5de6fa81b87e tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:56:36.042715 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-44d8ea4b-6eda-48e8-8401-5de6fa81b87e tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:56:36.199223 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-44d8ea4b-6eda-48e8-8401-5de6fa81b87e tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cd9718357e4655b245403d0f7a8847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255c288051e48e08d94ede2bd6ba558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:56:36.202076 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=2 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:56:36.211074 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-44d8ea4b-6eda-48e8-8401-5de6fa81b87e tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] 10.222.0.43 "GET /compute/v2.1/servers/41827212-e39f-4376-ae67-7154e775c2d8" status: 200 len: 1553 microversion: 2.1 time: 0.184594 Oct 04 19:56:36.212079 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 4094/7813] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:56:36 2022] GET /compute/v2.1/servers/41827212-e39f-4376-ae67-7154e775c2d8 => generated 1553 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:56:38.028413 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=6 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:56:38.095730 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-8a23b3c1-8b03-4558-a358-3c5873ddf485 req-f85b94cc-e0eb-49fb-b2a4-cb81a9c829ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41827212-e39f-4376-ae67-7154e775c2d8", "tag": "eae6a7a5-92c6-429f-af33-9eb658b8a47a"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:56:38.107920 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-8a23b3c1-8b03-4558-a358-3c5873ddf485 req-f85b94cc-e0eb-49fb-b2a4-cb81a9c829ea service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:56:38.108479 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-8a23b3c1-8b03-4558-a358-3c5873ddf485 req-f85b94cc-e0eb-49fb-b2a4-cb81a9c829ea service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:56:38.108951 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-8a23b3c1-8b03-4558-a358-3c5873ddf485 req-f85b94cc-e0eb-49fb-b2a4-cb81a9c829ea service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:56:38.123056 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-8a23b3c1-8b03-4558-a358-3c5873ddf485 req-f85b94cc-e0eb-49fb-b2a4-cb81a9c829ea service nova] Creating event network-changed:eae6a7a5-92c6-429f-af33-9eb658b8a47a for instance 41827212-e39f-4376-ae67-7154e775c2d8 on n-h1-851028-13 Oct 04 19:56:38.128329 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-8a23b3c1-8b03-4558-a358-3c5873ddf485 req-f85b94cc-e0eb-49fb-b2a4-cb81a9c829ea service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107295 Oct 04 19:56:38.128953 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3720/7814] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:56:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:58:33.357499 n-d-851028-13 devstack@n-api.service[123596]: ERROR oslo.messaging._drivers.impl_rabbit [-] [c592c758-2dc3-4024-92b0-c949515e0281] AMQP server on 10.222.0.43:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 04 19:58:33.358641 n-d-851028-13 devstack@n-api.service[123596]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ced6bcbb-f7de-451e-861c-054aba6c81f5] AMQP server on 10.222.0.43:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 04 19:58:33.359020 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=6 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:58:33.360944 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:58:33.361710 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=34 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:58:33.366558 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-86262978-67ff-4aac-b6bc-33ed8a2508c9 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:58:33.367103 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-86262978-67ff-4aac-b6bc-33ed8a2508c9 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] [instance: 41827212-e39f-4376-ae67-7154e775c2d8] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:58:33.375488 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-86262978-67ff-4aac-b6bc-33ed8a2508c9 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:58:33.376105 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-86262978-67ff-4aac-b6bc-33ed8a2508c9 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:58:33.376556 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-86262978-67ff-4aac-b6bc-33ed8a2508c9 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:58:33.377305 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-86262978-67ff-4aac-b6bc-33ed8a2508c9 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:58:33.377778 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-86262978-67ff-4aac-b6bc-33ed8a2508c9 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:58:33.378224 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-86262978-67ff-4aac-b6bc-33ed8a2508c9 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:58:33.403062 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.objects.instance [None req-86262978-67ff-4aac-b6bc-33ed8a2508c9 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lazy-loading 'flavor' on Instance uuid 41827212-e39f-4376-ae67-7154e775c2d8 {{(pid=123596) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 19:58:33.595259 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-86262978-67ff-4aac-b6bc-33ed8a2508c9 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] 10.222.0.43 "POST /compute/v2.1/servers/41827212-e39f-4376-ae67-7154e775c2d8/action" status: 202 len: 0 microversion: 2.1 time: 0.239376 Oct 04 19:58:33.595909 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 4095/7815] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 19:58:33 2022] POST /compute/v2.1/servers/41827212-e39f-4376-ae67-7154e775c2d8/action => generated 0 bytes in 242 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:58:33.602474 n-d-851028-13 devstack@n-api.service[123595]: ERROR oslo.messaging._drivers.impl_rabbit [-] [457acf28-5277-4578-be2f-82b18e59b660] AMQP server on 10.222.0.43:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 19:58:33.603711 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:58:33.604486 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=28 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:58:33.605824 n-d-851028-13 devstack@n-api.service[123595]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 19:58:33.606007 n-d-851028-13 devstack@n-api.service[123595]: Tue Oct 4 19:58:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/41827212-e39f-4376-ae67-7154e775c2d8 (ip 10.222.0.43) !!! Oct 04 19:58:33.607745 n-d-851028-13 devstack@n-api.service[123595]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 19:58:33.607745 n-d-851028-13 devstack@n-api.service[123595]: Tue Oct 4 19:58:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/41827212-e39f-4376-ae67-7154e775c2d8 (ip 10.222.0.43) !!! Oct 04 19:58:33.614223 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-7786a09f-74af-4fcd-b1af-9653d8811b6c tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:58:33.615111 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-7786a09f-74af-4fcd-b1af-9653d8811b6c tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] [instance: 41827212-e39f-4376-ae67-7154e775c2d8] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:58:33.625739 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7786a09f-74af-4fcd-b1af-9653d8811b6c tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:58:33.626238 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7786a09f-74af-4fcd-b1af-9653d8811b6c tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:58:33.626684 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7786a09f-74af-4fcd-b1af-9653d8811b6c tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:58:33.627398 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7786a09f-74af-4fcd-b1af-9653d8811b6c tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:58:33.627866 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7786a09f-74af-4fcd-b1af-9653d8811b6c tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:58:33.628292 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7786a09f-74af-4fcd-b1af-9653d8811b6c tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:58:33.768743 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-7786a09f-74af-4fcd-b1af-9653d8811b6c tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cd9718357e4655b245403d0f7a8847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255c288051e48e08d94ede2bd6ba558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:58:33.776669 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-7786a09f-74af-4fcd-b1af-9653d8811b6c tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] 10.222.0.43 "GET /compute/v2.1/servers/41827212-e39f-4376-ae67-7154e775c2d8" status: 200 len: 1678 microversion: 2.1 time: 0.176137 Oct 04 19:58:33.777276 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3721/7816] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:58:33 2022] GET /compute/v2.1/servers/41827212-e39f-4376-ae67-7154e775c2d8 => generated 1678 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:58:34.804744 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-be0e5e94-3a1a-46d9-8980-74e2c5f671a0 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:58:34.805434 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-be0e5e94-3a1a-46d9-8980-74e2c5f671a0 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] [instance: 41827212-e39f-4376-ae67-7154e775c2d8] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:58:34.817885 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-be0e5e94-3a1a-46d9-8980-74e2c5f671a0 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:58:34.818395 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-be0e5e94-3a1a-46d9-8980-74e2c5f671a0 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:58:34.818858 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-be0e5e94-3a1a-46d9-8980-74e2c5f671a0 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:58:34.819591 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-be0e5e94-3a1a-46d9-8980-74e2c5f671a0 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:58:34.820064 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-be0e5e94-3a1a-46d9-8980-74e2c5f671a0 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:58:34.820506 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-be0e5e94-3a1a-46d9-8980-74e2c5f671a0 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:58:34.824620 n-d-851028-13 devstack@n-api.service[123596]: INFO oslo.messaging._drivers.impl_rabbit [-] [ced6bcbb-f7de-451e-861c-054aba6c81f5] Reconnected to AMQP server on 10.222.0.43:5672 via [amqp] client with port 51072. Oct 04 19:58:34.827748 n-d-851028-13 devstack@n-api.service[123596]: INFO oslo.messaging._drivers.impl_rabbit [-] [c592c758-2dc3-4024-92b0-c949515e0281] Reconnected to AMQP server on 10.222.0.43:5672 via [amqp] client with port 51070. Oct 04 19:58:34.963313 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-be0e5e94-3a1a-46d9-8980-74e2c5f671a0 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cd9718357e4655b245403d0f7a8847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255c288051e48e08d94ede2bd6ba558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:58:34.971270 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-be0e5e94-3a1a-46d9-8980-74e2c5f671a0 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] 10.222.0.43 "GET /compute/v2.1/servers/41827212-e39f-4376-ae67-7154e775c2d8" status: 200 len: 1678 microversion: 2.1 time: 0.174986 Oct 04 19:58:34.971864 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 4096/7817] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:58:34 2022] GET /compute/v2.1/servers/41827212-e39f-4376-ae67-7154e775c2d8 => generated 1678 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:58:35.996325 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-11ab8ece-ae84-4b5e-a346-830defbd1ad8 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:58:35.996940 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-11ab8ece-ae84-4b5e-a346-830defbd1ad8 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] [instance: 41827212-e39f-4376-ae67-7154e775c2d8] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:58:36.004640 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-11ab8ece-ae84-4b5e-a346-830defbd1ad8 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:58:36.005148 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-11ab8ece-ae84-4b5e-a346-830defbd1ad8 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:58:36.005598 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-11ab8ece-ae84-4b5e-a346-830defbd1ad8 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:58:36.006309 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-11ab8ece-ae84-4b5e-a346-830defbd1ad8 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:58:36.006768 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-11ab8ece-ae84-4b5e-a346-830defbd1ad8 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:58:36.007232 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-11ab8ece-ae84-4b5e-a346-830defbd1ad8 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:58:36.014070 n-d-851028-13 devstack@n-api.service[123595]: INFO oslo.messaging._drivers.impl_rabbit [-] [457acf28-5277-4578-be2f-82b18e59b660] Reconnected to AMQP server on 10.222.0.43:5672 via [amqp] client with port 51078. Oct 04 19:58:36.146476 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-11ab8ece-ae84-4b5e-a346-830defbd1ad8 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cd9718357e4655b245403d0f7a8847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255c288051e48e08d94ede2bd6ba558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:58:36.154611 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-11ab8ece-ae84-4b5e-a346-830defbd1ad8 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] 10.222.0.43 "GET /compute/v2.1/servers/41827212-e39f-4376-ae67-7154e775c2d8" status: 200 len: 1678 microversion: 2.1 time: 0.163381 Oct 04 19:58:36.155369 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3722/7818] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:58:35 2022] GET /compute/v2.1/servers/41827212-e39f-4376-ae67-7154e775c2d8 => generated 1678 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:58:37.178836 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-616f70a1-78c8-4a0b-b5bb-9559436043be tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:58:37.179517 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-616f70a1-78c8-4a0b-b5bb-9559436043be tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] [instance: 41827212-e39f-4376-ae67-7154e775c2d8] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:58:37.186782 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-616f70a1-78c8-4a0b-b5bb-9559436043be tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:58:37.187291 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-616f70a1-78c8-4a0b-b5bb-9559436043be tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:58:37.187780 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-616f70a1-78c8-4a0b-b5bb-9559436043be tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:58:37.188512 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-616f70a1-78c8-4a0b-b5bb-9559436043be tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:58:37.189012 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-616f70a1-78c8-4a0b-b5bb-9559436043be tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:58:37.189497 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-616f70a1-78c8-4a0b-b5bb-9559436043be tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:58:37.341998 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-616f70a1-78c8-4a0b-b5bb-9559436043be tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cd9718357e4655b245403d0f7a8847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255c288051e48e08d94ede2bd6ba558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:58:37.349898 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-616f70a1-78c8-4a0b-b5bb-9559436043be tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] 10.222.0.43 "GET /compute/v2.1/servers/41827212-e39f-4376-ae67-7154e775c2d8" status: 200 len: 1678 microversion: 2.1 time: 0.175635 Oct 04 19:58:37.350476 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 4097/7819] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:58:37 2022] GET /compute/v2.1/servers/41827212-e39f-4376-ae67-7154e775c2d8 => generated 1678 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:58:38.373051 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-f7b94c35-7138-46fb-8763-3e6840bc0e4f tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:58:38.373787 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-f7b94c35-7138-46fb-8763-3e6840bc0e4f tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] [instance: 41827212-e39f-4376-ae67-7154e775c2d8] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:58:38.380696 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f7b94c35-7138-46fb-8763-3e6840bc0e4f tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:58:38.381214 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f7b94c35-7138-46fb-8763-3e6840bc0e4f tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:58:38.381662 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f7b94c35-7138-46fb-8763-3e6840bc0e4f tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:58:38.382375 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f7b94c35-7138-46fb-8763-3e6840bc0e4f tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:58:38.382831 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f7b94c35-7138-46fb-8763-3e6840bc0e4f tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:58:38.383262 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-f7b94c35-7138-46fb-8763-3e6840bc0e4f tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:58:38.517480 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-f7b94c35-7138-46fb-8763-3e6840bc0e4f tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cd9718357e4655b245403d0f7a8847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255c288051e48e08d94ede2bd6ba558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:58:38.527085 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-f7b94c35-7138-46fb-8763-3e6840bc0e4f tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] 10.222.0.43 "GET /compute/v2.1/servers/41827212-e39f-4376-ae67-7154e775c2d8" status: 200 len: 1678 microversion: 2.1 time: 0.157214 Oct 04 19:58:38.527689 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3723/7820] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:58:38 2022] GET /compute/v2.1/servers/41827212-e39f-4376-ae67-7154e775c2d8 => generated 1678 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:58:39.551124 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-9374ebcc-ad94-409c-adc4-c1ccb66beca0 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:58:39.551764 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-9374ebcc-ad94-409c-adc4-c1ccb66beca0 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] [instance: 41827212-e39f-4376-ae67-7154e775c2d8] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:58:39.559573 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9374ebcc-ad94-409c-adc4-c1ccb66beca0 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:58:39.560080 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9374ebcc-ad94-409c-adc4-c1ccb66beca0 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:58:39.560544 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9374ebcc-ad94-409c-adc4-c1ccb66beca0 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:58:39.561307 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9374ebcc-ad94-409c-adc4-c1ccb66beca0 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:58:39.561789 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9374ebcc-ad94-409c-adc4-c1ccb66beca0 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:58:39.562241 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-9374ebcc-ad94-409c-adc4-c1ccb66beca0 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:58:39.694802 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-9374ebcc-ad94-409c-adc4-c1ccb66beca0 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cd9718357e4655b245403d0f7a8847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255c288051e48e08d94ede2bd6ba558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:58:39.703075 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-9374ebcc-ad94-409c-adc4-c1ccb66beca0 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] 10.222.0.43 "GET /compute/v2.1/servers/41827212-e39f-4376-ae67-7154e775c2d8" status: 200 len: 1678 microversion: 2.1 time: 0.155980 Oct 04 19:58:39.703922 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 4098/7821] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:58:39 2022] GET /compute/v2.1/servers/41827212-e39f-4376-ae67-7154e775c2d8 => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:58:40.726794 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-a2fd478d-773a-49cc-8805-1afd0d3b6cf4 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:58:40.727348 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-a2fd478d-773a-49cc-8805-1afd0d3b6cf4 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] [instance: 41827212-e39f-4376-ae67-7154e775c2d8] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:58:40.734194 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a2fd478d-773a-49cc-8805-1afd0d3b6cf4 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:58:40.734673 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a2fd478d-773a-49cc-8805-1afd0d3b6cf4 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:58:40.735110 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a2fd478d-773a-49cc-8805-1afd0d3b6cf4 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:58:40.735805 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a2fd478d-773a-49cc-8805-1afd0d3b6cf4 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:58:40.736256 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a2fd478d-773a-49cc-8805-1afd0d3b6cf4 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:58:40.736681 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a2fd478d-773a-49cc-8805-1afd0d3b6cf4 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:58:40.871084 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-a2fd478d-773a-49cc-8805-1afd0d3b6cf4 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cd9718357e4655b245403d0f7a8847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255c288051e48e08d94ede2bd6ba558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:58:40.878881 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-a2fd478d-773a-49cc-8805-1afd0d3b6cf4 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] 10.222.0.43 "GET /compute/v2.1/servers/41827212-e39f-4376-ae67-7154e775c2d8" status: 200 len: 1678 microversion: 2.1 time: 0.156102 Oct 04 19:58:40.879598 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3724/7822] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:58:40 2022] GET /compute/v2.1/servers/41827212-e39f-4376-ae67-7154e775c2d8 => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:58:41.902691 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-802211be-c983-4151-83f4-aef8e0dc203c tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:58:41.903305 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-802211be-c983-4151-83f4-aef8e0dc203c tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] [instance: 41827212-e39f-4376-ae67-7154e775c2d8] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:58:41.910259 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-802211be-c983-4151-83f4-aef8e0dc203c tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:58:41.910758 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-802211be-c983-4151-83f4-aef8e0dc203c tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:58:41.911207 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-802211be-c983-4151-83f4-aef8e0dc203c tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:58:41.911914 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-802211be-c983-4151-83f4-aef8e0dc203c tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:58:41.912375 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-802211be-c983-4151-83f4-aef8e0dc203c tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:58:41.912810 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-802211be-c983-4151-83f4-aef8e0dc203c tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:58:42.071809 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-802211be-c983-4151-83f4-aef8e0dc203c tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cd9718357e4655b245403d0f7a8847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255c288051e48e08d94ede2bd6ba558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:58:42.082903 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-802211be-c983-4151-83f4-aef8e0dc203c tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] 10.222.0.43 "GET /compute/v2.1/servers/41827212-e39f-4376-ae67-7154e775c2d8" status: 200 len: 1678 microversion: 2.1 time: 0.184576 Oct 04 19:58:42.083540 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 4099/7823] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:58:41 2022] GET /compute/v2.1/servers/41827212-e39f-4376-ae67-7154e775c2d8 => generated 1678 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:58:43.108543 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-e1ef2969-7a33-4b43-8be8-c06dca69e4d6 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:58:43.109181 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-e1ef2969-7a33-4b43-8be8-c06dca69e4d6 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] [instance: 41827212-e39f-4376-ae67-7154e775c2d8] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:58:43.116104 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e1ef2969-7a33-4b43-8be8-c06dca69e4d6 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:58:43.116596 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e1ef2969-7a33-4b43-8be8-c06dca69e4d6 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:58:43.117036 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e1ef2969-7a33-4b43-8be8-c06dca69e4d6 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:58:43.117766 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e1ef2969-7a33-4b43-8be8-c06dca69e4d6 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:58:43.118225 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e1ef2969-7a33-4b43-8be8-c06dca69e4d6 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:58:43.118658 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e1ef2969-7a33-4b43-8be8-c06dca69e4d6 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:58:43.258050 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-e1ef2969-7a33-4b43-8be8-c06dca69e4d6 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cd9718357e4655b245403d0f7a8847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255c288051e48e08d94ede2bd6ba558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:58:43.266686 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-e1ef2969-7a33-4b43-8be8-c06dca69e4d6 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] 10.222.0.43 "GET /compute/v2.1/servers/41827212-e39f-4376-ae67-7154e775c2d8" status: 200 len: 1678 microversion: 2.1 time: 0.162606 Oct 04 19:58:43.267290 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3725/7824] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:58:43 2022] GET /compute/v2.1/servers/41827212-e39f-4376-ae67-7154e775c2d8 => generated 1678 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:58:44.293629 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-8625a8d8-2de3-4714-826c-62ba91aba14f tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:58:44.294448 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-8625a8d8-2de3-4714-826c-62ba91aba14f tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] [instance: 41827212-e39f-4376-ae67-7154e775c2d8] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:58:44.304476 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8625a8d8-2de3-4714-826c-62ba91aba14f tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:58:44.305067 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8625a8d8-2de3-4714-826c-62ba91aba14f tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:58:44.305625 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8625a8d8-2de3-4714-826c-62ba91aba14f tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:58:44.306401 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8625a8d8-2de3-4714-826c-62ba91aba14f tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:58:44.307034 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8625a8d8-2de3-4714-826c-62ba91aba14f tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:58:44.307561 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8625a8d8-2de3-4714-826c-62ba91aba14f tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:58:44.449964 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-8625a8d8-2de3-4714-826c-62ba91aba14f tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cd9718357e4655b245403d0f7a8847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255c288051e48e08d94ede2bd6ba558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:58:44.458830 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-8625a8d8-2de3-4714-826c-62ba91aba14f tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] 10.222.0.43 "GET /compute/v2.1/servers/41827212-e39f-4376-ae67-7154e775c2d8" status: 200 len: 1699 microversion: 2.1 time: 0.171793 Oct 04 19:58:44.459438 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 4100/7825] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:58:44 2022] GET /compute/v2.1/servers/41827212-e39f-4376-ae67-7154e775c2d8 => generated 1699 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:58:45.483567 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-e0d73c98-40b3-478f-bd91-61595a51e56e tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:58:45.484170 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-e0d73c98-40b3-478f-bd91-61595a51e56e tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] [instance: 41827212-e39f-4376-ae67-7154e775c2d8] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:58:45.491367 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e0d73c98-40b3-478f-bd91-61595a51e56e tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:58:45.491861 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e0d73c98-40b3-478f-bd91-61595a51e56e tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:58:45.492311 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e0d73c98-40b3-478f-bd91-61595a51e56e tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:58:45.493025 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e0d73c98-40b3-478f-bd91-61595a51e56e tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:58:45.493516 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e0d73c98-40b3-478f-bd91-61595a51e56e tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:58:45.493953 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e0d73c98-40b3-478f-bd91-61595a51e56e tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:58:45.635074 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-e0d73c98-40b3-478f-bd91-61595a51e56e tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cd9718357e4655b245403d0f7a8847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255c288051e48e08d94ede2bd6ba558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:58:45.642973 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-e0d73c98-40b3-478f-bd91-61595a51e56e tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] 10.222.0.43 "GET /compute/v2.1/servers/41827212-e39f-4376-ae67-7154e775c2d8" status: 200 len: 1699 microversion: 2.1 time: 0.163362 Oct 04 19:58:45.643559 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3726/7826] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:58:45 2022] GET /compute/v2.1/servers/41827212-e39f-4376-ae67-7154e775c2d8 => generated 1699 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:58:46.666184 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-906706ba-5345-4674-acc9-e225ee563a07 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:58:46.668039 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-906706ba-5345-4674-acc9-e225ee563a07 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] [instance: 41827212-e39f-4376-ae67-7154e775c2d8] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:58:46.675995 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-906706ba-5345-4674-acc9-e225ee563a07 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:58:46.676521 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-906706ba-5345-4674-acc9-e225ee563a07 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:58:46.676985 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-906706ba-5345-4674-acc9-e225ee563a07 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:58:46.677743 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-906706ba-5345-4674-acc9-e225ee563a07 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:58:46.678480 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-906706ba-5345-4674-acc9-e225ee563a07 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:58:46.678989 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-906706ba-5345-4674-acc9-e225ee563a07 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:58:46.852626 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-906706ba-5345-4674-acc9-e225ee563a07 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cd9718357e4655b245403d0f7a8847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255c288051e48e08d94ede2bd6ba558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:58:46.872838 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-906706ba-5345-4674-acc9-e225ee563a07 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] 10.222.0.43 "GET /compute/v2.1/servers/41827212-e39f-4376-ae67-7154e775c2d8" status: 200 len: 1694 microversion: 2.1 time: 0.210945 Oct 04 19:58:46.873946 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 4101/7827] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:58:46 2022] GET /compute/v2.1/servers/41827212-e39f-4376-ae67-7154e775c2d8 => generated 1694 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:58:47.085229 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-1a4a6411-efbc-40aa-b81d-1415b473c435 req-2463779f-1fa1-4915-92c9-fa4d33d43be5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41827212-e39f-4376-ae67-7154e775c2d8", "name": "network-vif-plugged", "status": "completed", "tag": "eae6a7a5-92c6-429f-af33-9eb658b8a47a"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:58:47.097843 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-1a4a6411-efbc-40aa-b81d-1415b473c435 req-2463779f-1fa1-4915-92c9-fa4d33d43be5 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:58:47.106144 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-1a4a6411-efbc-40aa-b81d-1415b473c435 req-2463779f-1fa1-4915-92c9-fa4d33d43be5 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:58:47.107071 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-1a4a6411-efbc-40aa-b81d-1415b473c435 req-2463779f-1fa1-4915-92c9-fa4d33d43be5 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:58:47.125831 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-1a4a6411-efbc-40aa-b81d-1415b473c435 req-2463779f-1fa1-4915-92c9-fa4d33d43be5 service nova] Creating event network-vif-plugged:eae6a7a5-92c6-429f-af33-9eb658b8a47a for instance 41827212-e39f-4376-ae67-7154e775c2d8 on n-h1-851028-13 Oct 04 19:58:47.129906 n-d-851028-13 devstack@n-api.service[123595]: ERROR oslo.messaging._drivers.impl_rabbit [req-1a4a6411-efbc-40aa-b81d-1415b473c435 req-2463779f-1fa1-4915-92c9-fa4d33d43be5 service nova] [af2268b8-811d-455d-bc5e-2fb7055e2395] AMQP server on 10.222.0.43:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 19:58:47.897555 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-c10c4ba4-07fe-4daa-b531-010d5f7fdd47 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:58:47.899107 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-c10c4ba4-07fe-4daa-b531-010d5f7fdd47 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] [instance: 41827212-e39f-4376-ae67-7154e775c2d8] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:58:47.907160 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c10c4ba4-07fe-4daa-b531-010d5f7fdd47 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:58:47.907755 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c10c4ba4-07fe-4daa-b531-010d5f7fdd47 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:58:47.908444 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c10c4ba4-07fe-4daa-b531-010d5f7fdd47 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:58:47.909588 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c10c4ba4-07fe-4daa-b531-010d5f7fdd47 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:58:47.910328 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c10c4ba4-07fe-4daa-b531-010d5f7fdd47 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:58:47.911037 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c10c4ba4-07fe-4daa-b531-010d5f7fdd47 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:58:48.080125 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-c10c4ba4-07fe-4daa-b531-010d5f7fdd47 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cd9718357e4655b245403d0f7a8847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255c288051e48e08d94ede2bd6ba558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:58:48.093495 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-c10c4ba4-07fe-4daa-b531-010d5f7fdd47 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] 10.222.0.43 "GET /compute/v2.1/servers/41827212-e39f-4376-ae67-7154e775c2d8" status: 200 len: 1694 microversion: 2.1 time: 0.199779 Oct 04 19:58:48.094253 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 4102/7828] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:58:47 2022] GET /compute/v2.1/servers/41827212-e39f-4376-ae67-7154e775c2d8 => generated 1694 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:58:48.139561 n-d-851028-13 devstack@n-api.service[123595]: INFO oslo.messaging._drivers.impl_rabbit [req-1a4a6411-efbc-40aa-b81d-1415b473c435 req-2463779f-1fa1-4915-92c9-fa4d33d43be5 service nova] [af2268b8-811d-455d-bc5e-2fb7055e2395] Reconnected to AMQP server on 10.222.0.43:5672 via [amqp] client with port 51132. Oct 04 19:58:48.144846 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-1a4a6411-efbc-40aa-b81d-1415b473c435 req-2463779f-1fa1-4915-92c9-fa4d33d43be5 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.167049 Oct 04 19:58:48.148341 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3727/7829] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:58:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:58:49.134203 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-272570ac-06a3-486d-aa8b-2b64148d9f6a tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:58:49.135524 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-272570ac-06a3-486d-aa8b-2b64148d9f6a tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] [instance: 41827212-e39f-4376-ae67-7154e775c2d8] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:58:49.152363 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-272570ac-06a3-486d-aa8b-2b64148d9f6a tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:58:49.152872 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-272570ac-06a3-486d-aa8b-2b64148d9f6a tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:58:49.153366 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-272570ac-06a3-486d-aa8b-2b64148d9f6a tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:58:49.154147 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-272570ac-06a3-486d-aa8b-2b64148d9f6a tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:58:49.154613 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-272570ac-06a3-486d-aa8b-2b64148d9f6a tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:58:49.155056 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-272570ac-06a3-486d-aa8b-2b64148d9f6a tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:58:49.300398 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-272570ac-06a3-486d-aa8b-2b64148d9f6a tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cd9718357e4655b245403d0f7a8847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255c288051e48e08d94ede2bd6ba558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:58:49.310251 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-272570ac-06a3-486d-aa8b-2b64148d9f6a tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] 10.222.0.43 "GET /compute/v2.1/servers/41827212-e39f-4376-ae67-7154e775c2d8" status: 200 len: 1694 microversion: 2.1 time: 0.190487 Oct 04 19:58:49.315513 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 4103/7830] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:58:49 2022] GET /compute/v2.1/servers/41827212-e39f-4376-ae67-7154e775c2d8 => generated 1694 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:58:50.335889 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-416c157e-28f2-4f44-9a02-639f00ae8871 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:58:50.337328 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-416c157e-28f2-4f44-9a02-639f00ae8871 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] [instance: 41827212-e39f-4376-ae67-7154e775c2d8] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:58:50.345023 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-416c157e-28f2-4f44-9a02-639f00ae8871 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:58:50.345899 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-416c157e-28f2-4f44-9a02-639f00ae8871 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:58:50.346415 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-416c157e-28f2-4f44-9a02-639f00ae8871 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:58:50.347235 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-416c157e-28f2-4f44-9a02-639f00ae8871 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:58:50.347756 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-416c157e-28f2-4f44-9a02-639f00ae8871 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:58:50.348256 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-416c157e-28f2-4f44-9a02-639f00ae8871 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:58:50.504624 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-416c157e-28f2-4f44-9a02-639f00ae8871 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cd9718357e4655b245403d0f7a8847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255c288051e48e08d94ede2bd6ba558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:58:50.513771 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-416c157e-28f2-4f44-9a02-639f00ae8871 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] 10.222.0.43 "GET /compute/v2.1/servers/41827212-e39f-4376-ae67-7154e775c2d8" status: 200 len: 1694 microversion: 2.1 time: 0.183209 Oct 04 19:58:50.520806 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3728/7831] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:58:50 2022] GET /compute/v2.1/servers/41827212-e39f-4376-ae67-7154e775c2d8 => generated 1694 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:58:51.546144 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-95ee2212-474d-47a2-8b0c-a2a77f21a1e9 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:58:51.548337 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-95ee2212-474d-47a2-8b0c-a2a77f21a1e9 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] [instance: 41827212-e39f-4376-ae67-7154e775c2d8] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:58:51.557804 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-95ee2212-474d-47a2-8b0c-a2a77f21a1e9 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:58:51.558329 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-95ee2212-474d-47a2-8b0c-a2a77f21a1e9 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:58:51.558791 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-95ee2212-474d-47a2-8b0c-a2a77f21a1e9 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:58:51.559528 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-95ee2212-474d-47a2-8b0c-a2a77f21a1e9 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:58:51.562122 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-95ee2212-474d-47a2-8b0c-a2a77f21a1e9 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:58:51.562122 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-95ee2212-474d-47a2-8b0c-a2a77f21a1e9 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:58:51.725040 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-95ee2212-474d-47a2-8b0c-a2a77f21a1e9 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cd9718357e4655b245403d0f7a8847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255c288051e48e08d94ede2bd6ba558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:58:51.734087 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-95ee2212-474d-47a2-8b0c-a2a77f21a1e9 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] 10.222.0.43 "GET /compute/v2.1/servers/41827212-e39f-4376-ae67-7154e775c2d8" status: 200 len: 1694 microversion: 2.1 time: 0.193627 Oct 04 19:58:51.734935 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 4104/7832] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:58:51 2022] GET /compute/v2.1/servers/41827212-e39f-4376-ae67-7154e775c2d8 => generated 1694 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:58:52.793493 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-a5e0e9bb-da15-4f75-b126-404d78acdd55 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:58:52.794976 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-a5e0e9bb-da15-4f75-b126-404d78acdd55 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] [instance: 41827212-e39f-4376-ae67-7154e775c2d8] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:58:52.802749 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a5e0e9bb-da15-4f75-b126-404d78acdd55 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:58:52.803240 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a5e0e9bb-da15-4f75-b126-404d78acdd55 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:58:52.803713 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a5e0e9bb-da15-4f75-b126-404d78acdd55 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:58:52.804479 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a5e0e9bb-da15-4f75-b126-404d78acdd55 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:58:52.804933 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a5e0e9bb-da15-4f75-b126-404d78acdd55 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:58:52.805396 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a5e0e9bb-da15-4f75-b126-404d78acdd55 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:58:52.968452 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-a5e0e9bb-da15-4f75-b126-404d78acdd55 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cd9718357e4655b245403d0f7a8847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255c288051e48e08d94ede2bd6ba558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:58:52.977195 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-a5e0e9bb-da15-4f75-b126-404d78acdd55 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] 10.222.0.43 "GET /compute/v2.1/servers/41827212-e39f-4376-ae67-7154e775c2d8" status: 200 len: 1694 microversion: 2.1 time: 0.189035 Oct 04 19:58:52.978107 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3729/7833] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:58:52 2022] GET /compute/v2.1/servers/41827212-e39f-4376-ae67-7154e775c2d8 => generated 1694 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:58:54.008345 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-811a69be-8b0e-471d-ad79-bb1ed978f82c tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:58:54.009215 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-811a69be-8b0e-471d-ad79-bb1ed978f82c tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] [instance: 41827212-e39f-4376-ae67-7154e775c2d8] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:58:54.016311 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-811a69be-8b0e-471d-ad79-bb1ed978f82c tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:58:54.016903 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-811a69be-8b0e-471d-ad79-bb1ed978f82c tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:58:54.017454 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-811a69be-8b0e-471d-ad79-bb1ed978f82c tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:58:54.018420 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-811a69be-8b0e-471d-ad79-bb1ed978f82c tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:58:54.019087 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-811a69be-8b0e-471d-ad79-bb1ed978f82c tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:58:54.019621 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-811a69be-8b0e-471d-ad79-bb1ed978f82c tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:58:54.177845 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-811a69be-8b0e-471d-ad79-bb1ed978f82c tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cd9718357e4655b245403d0f7a8847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255c288051e48e08d94ede2bd6ba558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:58:54.186727 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-811a69be-8b0e-471d-ad79-bb1ed978f82c tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] 10.222.0.43 "GET /compute/v2.1/servers/41827212-e39f-4376-ae67-7154e775c2d8" status: 200 len: 1694 microversion: 2.1 time: 0.189182 Oct 04 19:58:54.187450 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 4105/7834] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:58:53 2022] GET /compute/v2.1/servers/41827212-e39f-4376-ae67-7154e775c2d8 => generated 1694 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:58:55.212355 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-fa14e41c-f9de-4028-8193-2d52e65a032b tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:58:55.213414 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-fa14e41c-f9de-4028-8193-2d52e65a032b tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] [instance: 41827212-e39f-4376-ae67-7154e775c2d8] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:58:55.223504 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fa14e41c-f9de-4028-8193-2d52e65a032b tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:58:55.224129 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fa14e41c-f9de-4028-8193-2d52e65a032b tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:58:55.224687 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fa14e41c-f9de-4028-8193-2d52e65a032b tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:58:55.225653 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fa14e41c-f9de-4028-8193-2d52e65a032b tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:58:55.226250 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fa14e41c-f9de-4028-8193-2d52e65a032b tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:58:55.226872 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fa14e41c-f9de-4028-8193-2d52e65a032b tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:58:55.384259 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-fa14e41c-f9de-4028-8193-2d52e65a032b tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cd9718357e4655b245403d0f7a8847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255c288051e48e08d94ede2bd6ba558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:58:55.392170 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-fa14e41c-f9de-4028-8193-2d52e65a032b tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] 10.222.0.43 "GET /compute/v2.1/servers/41827212-e39f-4376-ae67-7154e775c2d8" status: 200 len: 1694 microversion: 2.1 time: 0.185376 Oct 04 19:58:55.392733 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3730/7835] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:58:55 2022] GET /compute/v2.1/servers/41827212-e39f-4376-ae67-7154e775c2d8 => generated 1694 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:58:56.417439 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-0af8434d-e888-48a5-9fb1-41e5d36da342 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:58:56.418225 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-0af8434d-e888-48a5-9fb1-41e5d36da342 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] [instance: 41827212-e39f-4376-ae67-7154e775c2d8] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:58:56.425264 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0af8434d-e888-48a5-9fb1-41e5d36da342 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:58:56.425789 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0af8434d-e888-48a5-9fb1-41e5d36da342 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:58:56.426246 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0af8434d-e888-48a5-9fb1-41e5d36da342 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:58:56.426979 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0af8434d-e888-48a5-9fb1-41e5d36da342 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:58:56.427460 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0af8434d-e888-48a5-9fb1-41e5d36da342 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:58:56.427912 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0af8434d-e888-48a5-9fb1-41e5d36da342 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:58:56.572903 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-0af8434d-e888-48a5-9fb1-41e5d36da342 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cd9718357e4655b245403d0f7a8847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255c288051e48e08d94ede2bd6ba558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:58:56.581555 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-0af8434d-e888-48a5-9fb1-41e5d36da342 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] 10.222.0.43 "GET /compute/v2.1/servers/41827212-e39f-4376-ae67-7154e775c2d8" status: 200 len: 1676 microversion: 2.1 time: 0.169326 Oct 04 19:58:56.582158 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 4106/7836] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:58:56 2022] GET /compute/v2.1/servers/41827212-e39f-4376-ae67-7154e775c2d8 => generated 1676 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:58:57.606073 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-df238d88-4e4d-4101-b845-ccd6938a31fd tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:58:57.606737 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-df238d88-4e4d-4101-b845-ccd6938a31fd tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] [instance: 41827212-e39f-4376-ae67-7154e775c2d8] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:58:57.614301 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-df238d88-4e4d-4101-b845-ccd6938a31fd tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:58:57.614803 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-df238d88-4e4d-4101-b845-ccd6938a31fd tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:58:57.615255 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-df238d88-4e4d-4101-b845-ccd6938a31fd tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:58:57.615992 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-df238d88-4e4d-4101-b845-ccd6938a31fd tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:58:57.616455 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-df238d88-4e4d-4101-b845-ccd6938a31fd tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:58:57.616892 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-df238d88-4e4d-4101-b845-ccd6938a31fd tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:58:57.762882 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-df238d88-4e4d-4101-b845-ccd6938a31fd tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cd9718357e4655b245403d0f7a8847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255c288051e48e08d94ede2bd6ba558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:58:57.771050 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-df238d88-4e4d-4101-b845-ccd6938a31fd tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] 10.222.0.43 "GET /compute/v2.1/servers/41827212-e39f-4376-ae67-7154e775c2d8" status: 200 len: 1676 microversion: 2.1 time: 0.169436 Oct 04 19:58:57.771665 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3731/7837] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:58:57 2022] GET /compute/v2.1/servers/41827212-e39f-4376-ae67-7154e775c2d8 => generated 1676 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:58:58.796111 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-88fa2440-b04e-4cd9-b621-95985a31dd8a tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:58:58.796702 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-88fa2440-b04e-4cd9-b621-95985a31dd8a tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] [instance: 41827212-e39f-4376-ae67-7154e775c2d8] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:58:58.804293 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-88fa2440-b04e-4cd9-b621-95985a31dd8a tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:58:58.805095 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-88fa2440-b04e-4cd9-b621-95985a31dd8a tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:58:58.805588 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-88fa2440-b04e-4cd9-b621-95985a31dd8a tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:58:58.806369 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-88fa2440-b04e-4cd9-b621-95985a31dd8a tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:58:58.806844 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-88fa2440-b04e-4cd9-b621-95985a31dd8a tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:58:58.807291 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-88fa2440-b04e-4cd9-b621-95985a31dd8a tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:58:58.950266 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-88fa2440-b04e-4cd9-b621-95985a31dd8a tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cd9718357e4655b245403d0f7a8847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255c288051e48e08d94ede2bd6ba558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:58:58.959091 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-88fa2440-b04e-4cd9-b621-95985a31dd8a tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] 10.222.0.43 "GET /compute/v2.1/servers/41827212-e39f-4376-ae67-7154e775c2d8" status: 200 len: 1619 microversion: 2.1 time: 0.167037 Oct 04 19:58:58.959704 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 4107/7838] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:58:58 2022] GET /compute/v2.1/servers/41827212-e39f-4376-ae67-7154e775c2d8 => generated 1619 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:58:58.978465 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-6c0730ec-1c2c-44ec-91ff-72fc6c32eadc req-6b0102fc-8649-4500-9dd4-51ce094d28e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41827212-e39f-4376-ae67-7154e775c2d8", "name": "network-vif-unplugged", "status": "completed", "tag": "eae6a7a5-92c6-429f-af33-9eb658b8a47a"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:58:58.990768 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-6c0730ec-1c2c-44ec-91ff-72fc6c32eadc req-6b0102fc-8649-4500-9dd4-51ce094d28e3 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:58:58.991867 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-6c0730ec-1c2c-44ec-91ff-72fc6c32eadc req-6b0102fc-8649-4500-9dd4-51ce094d28e3 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:58:58.992247 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-6c0730ec-1c2c-44ec-91ff-72fc6c32eadc req-6b0102fc-8649-4500-9dd4-51ce094d28e3 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:58:58.998190 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-036c76ca-3c71-4df8-be7c-823c1076734d tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:58:58.998823 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-036c76ca-3c71-4df8-be7c-823c1076734d tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] [instance: 41827212-e39f-4376-ae67-7154e775c2d8] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:58:59.006466 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-036c76ca-3c71-4df8-be7c-823c1076734d tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:58:59.006728 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.compute.server_external_events [req-6c0730ec-1c2c-44ec-91ff-72fc6c32eadc req-6b0102fc-8649-4500-9dd4-51ce094d28e3 service nova] Unable to find a host for instance 41827212-e39f-4376-ae67-7154e775c2d8. Dropping event network-vif-unplugged {{(pid=123595) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 04 19:58:59.007296 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-036c76ca-3c71-4df8-be7c-823c1076734d tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:58:59.007589 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-6c0730ec-1c2c-44ec-91ff-72fc6c32eadc req-6b0102fc-8649-4500-9dd4-51ce094d28e3 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.033148 Oct 04 19:58:59.007804 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-036c76ca-3c71-4df8-be7c-823c1076734d tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:58:59.008207 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3732/7839] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:58:58 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 34 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 04 19:58:59.008481 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-036c76ca-3c71-4df8-be7c-823c1076734d tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:58:59.008949 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-036c76ca-3c71-4df8-be7c-823c1076734d tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:58:59.009962 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-036c76ca-3c71-4df8-be7c-823c1076734d tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:58:59.111479 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-036c76ca-3c71-4df8-be7c-823c1076734d tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] [instance: 41827212-e39f-4376-ae67-7154e775c2d8] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=123596) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 04 19:58:59.163451 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:58:59.195219 n-d-851028-13 devstack@n-api.service[123596]: ERROR oslo.messaging._drivers.impl_rabbit [None req-036c76ca-3c71-4df8-be7c-823c1076734d tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] [6df3461f-a223-4d7a-9edf-e0d1ce49f6ad] AMQP server on 10.222.0.43:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 19:59:00.203036 n-d-851028-13 devstack@n-api.service[123596]: INFO oslo.messaging._drivers.impl_rabbit [None req-036c76ca-3c71-4df8-be7c-823c1076734d tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] [6df3461f-a223-4d7a-9edf-e0d1ce49f6ad] Reconnected to AMQP server on 10.222.0.43:5672 via [amqp] client with port 51180. Oct 04 19:59:00.207378 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-036c76ca-3c71-4df8-be7c-823c1076734d tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] 10.222.0.43 "POST /compute/v2.1/servers/41827212-e39f-4376-ae67-7154e775c2d8/action" status: 202 len: 0 microversion: 2.1 time: 1.216340 Oct 04 19:59:00.208047 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 4108/7840] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 19:58:58 2022] POST /compute/v2.1/servers/41827212-e39f-4376-ae67-7154e775c2d8/action => generated 0 bytes in 1218 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 19:59:00.218249 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-435a423a-848c-48a0-8dd1-c35a4a32c6d9 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:59:00.218957 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-435a423a-848c-48a0-8dd1-c35a4a32c6d9 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] [instance: 41827212-e39f-4376-ae67-7154e775c2d8] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:59:00.226077 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-435a423a-848c-48a0-8dd1-c35a4a32c6d9 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:59:00.226579 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-435a423a-848c-48a0-8dd1-c35a4a32c6d9 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:59:00.227019 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-435a423a-848c-48a0-8dd1-c35a4a32c6d9 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:59:00.227744 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-435a423a-848c-48a0-8dd1-c35a4a32c6d9 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:59:00.228775 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-435a423a-848c-48a0-8dd1-c35a4a32c6d9 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:59:00.229244 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-435a423a-848c-48a0-8dd1-c35a4a32c6d9 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:59:00.377001 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-435a423a-848c-48a0-8dd1-c35a4a32c6d9 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cd9718357e4655b245403d0f7a8847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255c288051e48e08d94ede2bd6ba558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:59:00.386680 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-435a423a-848c-48a0-8dd1-c35a4a32c6d9 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] 10.222.0.43 "GET /compute/v2.1/servers/41827212-e39f-4376-ae67-7154e775c2d8" status: 200 len: 1627 microversion: 2.1 time: 0.173859 Oct 04 19:59:00.387314 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3733/7841] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:59:00 2022] GET /compute/v2.1/servers/41827212-e39f-4376-ae67-7154e775c2d8 => generated 1627 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:59:01.417227 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-0a792171-a055-4c3f-afa2-bec8b29e7e1a tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:59:01.417852 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-0a792171-a055-4c3f-afa2-bec8b29e7e1a tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] [instance: 41827212-e39f-4376-ae67-7154e775c2d8] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:59:01.429735 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0a792171-a055-4c3f-afa2-bec8b29e7e1a tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:59:01.430667 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0a792171-a055-4c3f-afa2-bec8b29e7e1a tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:59:01.432086 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0a792171-a055-4c3f-afa2-bec8b29e7e1a tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:59:01.433497 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0a792171-a055-4c3f-afa2-bec8b29e7e1a tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:59:01.434422 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0a792171-a055-4c3f-afa2-bec8b29e7e1a tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:59:01.435651 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0a792171-a055-4c3f-afa2-bec8b29e7e1a tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:59:01.597195 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-0a792171-a055-4c3f-afa2-bec8b29e7e1a tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cd9718357e4655b245403d0f7a8847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255c288051e48e08d94ede2bd6ba558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:59:01.608146 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-0a792171-a055-4c3f-afa2-bec8b29e7e1a tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] 10.222.0.43 "GET /compute/v2.1/servers/41827212-e39f-4376-ae67-7154e775c2d8" status: 200 len: 1685 microversion: 2.1 time: 0.196313 Oct 04 19:59:01.608765 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 4109/7842] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:59:01 2022] GET /compute/v2.1/servers/41827212-e39f-4376-ae67-7154e775c2d8 => generated 1685 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:59:02.632986 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-5672120c-9498-4214-9809-8f8f27e46baa tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:59:02.633634 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-5672120c-9498-4214-9809-8f8f27e46baa tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] [instance: 41827212-e39f-4376-ae67-7154e775c2d8] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:59:02.641139 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5672120c-9498-4214-9809-8f8f27e46baa tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:59:02.641646 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5672120c-9498-4214-9809-8f8f27e46baa tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:59:02.642089 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5672120c-9498-4214-9809-8f8f27e46baa tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:59:02.642797 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5672120c-9498-4214-9809-8f8f27e46baa tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:59:02.643252 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5672120c-9498-4214-9809-8f8f27e46baa tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:59:02.643679 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5672120c-9498-4214-9809-8f8f27e46baa tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:59:02.790182 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-5672120c-9498-4214-9809-8f8f27e46baa tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cd9718357e4655b245403d0f7a8847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255c288051e48e08d94ede2bd6ba558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:59:02.800406 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-5672120c-9498-4214-9809-8f8f27e46baa tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] 10.222.0.43 "GET /compute/v2.1/servers/41827212-e39f-4376-ae67-7154e775c2d8" status: 200 len: 1685 microversion: 2.1 time: 0.171090 Oct 04 19:59:02.801265 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3734/7843] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:59:02 2022] GET /compute/v2.1/servers/41827212-e39f-4376-ae67-7154e775c2d8 => generated 1685 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:59:03.000135 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-5bab4a9a-6b65-4ed5-adc4-54ae35dd8746 req-4888a9b1-912f-4a5e-b0c3-8289ac4d9516 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41827212-e39f-4376-ae67-7154e775c2d8", "tag": "eae6a7a5-92c6-429f-af33-9eb658b8a47a"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:59:03.015655 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-5bab4a9a-6b65-4ed5-adc4-54ae35dd8746 req-4888a9b1-912f-4a5e-b0c3-8289ac4d9516 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:59:03.016136 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-5bab4a9a-6b65-4ed5-adc4-54ae35dd8746 req-4888a9b1-912f-4a5e-b0c3-8289ac4d9516 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:59:03.016584 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-5bab4a9a-6b65-4ed5-adc4-54ae35dd8746 req-4888a9b1-912f-4a5e-b0c3-8289ac4d9516 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:59:03.029663 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-5bab4a9a-6b65-4ed5-adc4-54ae35dd8746 req-4888a9b1-912f-4a5e-b0c3-8289ac4d9516 service nova] Creating event network-changed:eae6a7a5-92c6-429f-af33-9eb658b8a47a for instance 41827212-e39f-4376-ae67-7154e775c2d8 on n-h2-851028-13 Oct 04 19:59:03.036276 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-5bab4a9a-6b65-4ed5-adc4-54ae35dd8746 req-4888a9b1-912f-4a5e-b0c3-8289ac4d9516 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041859 Oct 04 19:59:03.037608 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 4110/7844] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:59:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:59:03.839355 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-beff0eaa-a519-4e14-a19f-05bab1a14d9e tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:59:03.839909 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-beff0eaa-a519-4e14-a19f-05bab1a14d9e tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] [instance: 41827212-e39f-4376-ae67-7154e775c2d8] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:59:03.843251 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_api:SELECT=29 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:59:03.849776 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-beff0eaa-a519-4e14-a19f-05bab1a14d9e tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:59:03.849776 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-beff0eaa-a519-4e14-a19f-05bab1a14d9e tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:59:03.852050 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-beff0eaa-a519-4e14-a19f-05bab1a14d9e tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:59:03.852050 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-beff0eaa-a519-4e14-a19f-05bab1a14d9e tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:59:03.852050 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-beff0eaa-a519-4e14-a19f-05bab1a14d9e tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:59:03.852718 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-beff0eaa-a519-4e14-a19f-05bab1a14d9e tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:59:03.855900 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=77 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:59:04.126986 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-beff0eaa-a519-4e14-a19f-05bab1a14d9e tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cd9718357e4655b245403d0f7a8847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255c288051e48e08d94ede2bd6ba558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:59:04.136932 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-beff0eaa-a519-4e14-a19f-05bab1a14d9e tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] 10.222.0.43 "GET /compute/v2.1/servers/41827212-e39f-4376-ae67-7154e775c2d8" status: 200 len: 1685 microversion: 2.1 time: 0.301738 Oct 04 19:59:04.153341 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3735/7845] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:59:03 2022] GET /compute/v2.1/servers/41827212-e39f-4376-ae67-7154e775c2d8 => generated 1685 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:59:05.166586 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-de3cb08c-cb84-4925-900e-e393c9745763 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:59:05.167450 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-de3cb08c-cb84-4925-900e-e393c9745763 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] [instance: 41827212-e39f-4376-ae67-7154e775c2d8] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:59:05.169515 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:59:05.175793 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-de3cb08c-cb84-4925-900e-e393c9745763 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:59:05.176314 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-de3cb08c-cb84-4925-900e-e393c9745763 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:59:05.176948 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-de3cb08c-cb84-4925-900e-e393c9745763 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:59:05.177722 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-de3cb08c-cb84-4925-900e-e393c9745763 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:59:05.178205 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-de3cb08c-cb84-4925-900e-e393c9745763 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:59:05.178657 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-de3cb08c-cb84-4925-900e-e393c9745763 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:59:05.342097 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-de3cb08c-cb84-4925-900e-e393c9745763 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cd9718357e4655b245403d0f7a8847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255c288051e48e08d94ede2bd6ba558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:59:05.351154 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-de3cb08c-cb84-4925-900e-e393c9745763 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] 10.222.0.43 "GET /compute/v2.1/servers/41827212-e39f-4376-ae67-7154e775c2d8" status: 200 len: 1685 microversion: 2.1 time: 0.191721 Oct 04 19:59:05.365794 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 4111/7846] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:59:05 2022] GET /compute/v2.1/servers/41827212-e39f-4376-ae67-7154e775c2d8 => generated 1685 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:59:06.375240 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-7270f63c-1b2f-4750-abda-f34b32d34b8f tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:59:06.375876 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-7270f63c-1b2f-4750-abda-f34b32d34b8f tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] [instance: 41827212-e39f-4376-ae67-7154e775c2d8] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:59:06.382843 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7270f63c-1b2f-4750-abda-f34b32d34b8f tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:59:06.383721 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7270f63c-1b2f-4750-abda-f34b32d34b8f tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:59:06.384924 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7270f63c-1b2f-4750-abda-f34b32d34b8f tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:59:06.385935 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7270f63c-1b2f-4750-abda-f34b32d34b8f tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:59:06.386636 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7270f63c-1b2f-4750-abda-f34b32d34b8f tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:59:06.387284 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-7270f63c-1b2f-4750-abda-f34b32d34b8f tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:59:06.583268 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-7270f63c-1b2f-4750-abda-f34b32d34b8f tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cd9718357e4655b245403d0f7a8847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255c288051e48e08d94ede2bd6ba558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:59:06.593348 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-7270f63c-1b2f-4750-abda-f34b32d34b8f tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] 10.222.0.43 "GET /compute/v2.1/servers/41827212-e39f-4376-ae67-7154e775c2d8" status: 200 len: 1685 microversion: 2.1 time: 0.222068 Oct 04 19:59:06.594252 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3736/7847] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:59:06 2022] GET /compute/v2.1/servers/41827212-e39f-4376-ae67-7154e775c2d8 => generated 1685 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:59:07.617080 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-83ae716b-9471-4ee2-b012-65ae5864f1e7 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:59:07.617764 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-83ae716b-9471-4ee2-b012-65ae5864f1e7 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] [instance: 41827212-e39f-4376-ae67-7154e775c2d8] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:59:07.626231 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-83ae716b-9471-4ee2-b012-65ae5864f1e7 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:59:07.626759 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-83ae716b-9471-4ee2-b012-65ae5864f1e7 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:59:07.629352 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-83ae716b-9471-4ee2-b012-65ae5864f1e7 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:59:07.629352 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-83ae716b-9471-4ee2-b012-65ae5864f1e7 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:59:07.629352 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-83ae716b-9471-4ee2-b012-65ae5864f1e7 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:59:07.629352 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-83ae716b-9471-4ee2-b012-65ae5864f1e7 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:59:07.791699 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-83ae716b-9471-4ee2-b012-65ae5864f1e7 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cd9718357e4655b245403d0f7a8847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255c288051e48e08d94ede2bd6ba558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:59:07.800444 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-83ae716b-9471-4ee2-b012-65ae5864f1e7 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] 10.222.0.43 "GET /compute/v2.1/servers/41827212-e39f-4376-ae67-7154e775c2d8" status: 200 len: 1685 microversion: 2.1 time: 0.187348 Oct 04 19:59:07.801265 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 4112/7848] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:59:07 2022] GET /compute/v2.1/servers/41827212-e39f-4376-ae67-7154e775c2d8 => generated 1685 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:59:08.830862 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-4a47bb83-2579-4053-b6c3-ee5613719eee tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:59:08.832781 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-4a47bb83-2579-4053-b6c3-ee5613719eee tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] [instance: 41827212-e39f-4376-ae67-7154e775c2d8] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:59:08.843884 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4a47bb83-2579-4053-b6c3-ee5613719eee tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:59:08.844616 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4a47bb83-2579-4053-b6c3-ee5613719eee tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:59:08.845323 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4a47bb83-2579-4053-b6c3-ee5613719eee tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:59:08.846430 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4a47bb83-2579-4053-b6c3-ee5613719eee tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:59:08.847138 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4a47bb83-2579-4053-b6c3-ee5613719eee tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:59:08.847791 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-4a47bb83-2579-4053-b6c3-ee5613719eee tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:59:09.051383 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-4a47bb83-2579-4053-b6c3-ee5613719eee tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cd9718357e4655b245403d0f7a8847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255c288051e48e08d94ede2bd6ba558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:59:09.066338 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-4a47bb83-2579-4053-b6c3-ee5613719eee tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] 10.222.0.43 "GET /compute/v2.1/servers/41827212-e39f-4376-ae67-7154e775c2d8" status: 200 len: 1685 microversion: 2.1 time: 0.242887 Oct 04 19:59:09.076214 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3737/7849] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:59:08 2022] GET /compute/v2.1/servers/41827212-e39f-4376-ae67-7154e775c2d8 => generated 1685 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:59:10.091657 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-c15668ed-024f-4754-997b-d3494303d9b1 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:59:10.093098 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-c15668ed-024f-4754-997b-d3494303d9b1 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] [instance: 41827212-e39f-4376-ae67-7154e775c2d8] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:59:10.102258 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c15668ed-024f-4754-997b-d3494303d9b1 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:59:10.103364 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c15668ed-024f-4754-997b-d3494303d9b1 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:59:10.103892 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c15668ed-024f-4754-997b-d3494303d9b1 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:59:10.104763 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c15668ed-024f-4754-997b-d3494303d9b1 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:59:10.105345 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c15668ed-024f-4754-997b-d3494303d9b1 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:59:10.105891 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c15668ed-024f-4754-997b-d3494303d9b1 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:59:10.266714 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-c15668ed-024f-4754-997b-d3494303d9b1 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cd9718357e4655b245403d0f7a8847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255c288051e48e08d94ede2bd6ba558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:59:10.276224 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-c15668ed-024f-4754-997b-d3494303d9b1 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] 10.222.0.43 "GET /compute/v2.1/servers/41827212-e39f-4376-ae67-7154e775c2d8" status: 200 len: 1685 microversion: 2.1 time: 0.188432 Oct 04 19:59:10.287258 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 4113/7850] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:59:10 2022] GET /compute/v2.1/servers/41827212-e39f-4376-ae67-7154e775c2d8 => generated 1685 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:59:11.302625 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-bb8c6da7-b7e1-4568-a7fb-afc9ff31591c tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:59:11.303236 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-bb8c6da7-b7e1-4568-a7fb-afc9ff31591c tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] [instance: 41827212-e39f-4376-ae67-7154e775c2d8] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:59:11.310879 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bb8c6da7-b7e1-4568-a7fb-afc9ff31591c tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:59:11.311369 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bb8c6da7-b7e1-4568-a7fb-afc9ff31591c tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:59:11.311815 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bb8c6da7-b7e1-4568-a7fb-afc9ff31591c tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:59:11.312523 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bb8c6da7-b7e1-4568-a7fb-afc9ff31591c tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:59:11.313420 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bb8c6da7-b7e1-4568-a7fb-afc9ff31591c tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:59:11.313420 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bb8c6da7-b7e1-4568-a7fb-afc9ff31591c tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:59:11.468735 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-bb8c6da7-b7e1-4568-a7fb-afc9ff31591c tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cd9718357e4655b245403d0f7a8847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255c288051e48e08d94ede2bd6ba558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:59:11.476859 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-bb8c6da7-b7e1-4568-a7fb-afc9ff31591c tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] 10.222.0.43 "GET /compute/v2.1/servers/41827212-e39f-4376-ae67-7154e775c2d8" status: 200 len: 1685 microversion: 2.1 time: 0.179016 Oct 04 19:59:11.477495 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3738/7851] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:59:11 2022] GET /compute/v2.1/servers/41827212-e39f-4376-ae67-7154e775c2d8 => generated 1685 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:59:12.501974 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-c5ce41e2-64c0-47a4-bad2-f7a4ae74db3e tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:59:12.502593 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-c5ce41e2-64c0-47a4-bad2-f7a4ae74db3e tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] [instance: 41827212-e39f-4376-ae67-7154e775c2d8] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:59:12.510776 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c5ce41e2-64c0-47a4-bad2-f7a4ae74db3e tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:59:12.511489 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c5ce41e2-64c0-47a4-bad2-f7a4ae74db3e tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:59:12.512079 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c5ce41e2-64c0-47a4-bad2-f7a4ae74db3e tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:59:12.513149 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c5ce41e2-64c0-47a4-bad2-f7a4ae74db3e tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:59:12.513619 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c5ce41e2-64c0-47a4-bad2-f7a4ae74db3e tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:59:12.514105 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-c5ce41e2-64c0-47a4-bad2-f7a4ae74db3e tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:59:12.684457 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-c5ce41e2-64c0-47a4-bad2-f7a4ae74db3e tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cd9718357e4655b245403d0f7a8847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255c288051e48e08d94ede2bd6ba558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:59:12.692354 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-c5ce41e2-64c0-47a4-bad2-f7a4ae74db3e tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] 10.222.0.43 "GET /compute/v2.1/servers/41827212-e39f-4376-ae67-7154e775c2d8" status: 200 len: 1685 microversion: 2.1 time: 0.194359 Oct 04 19:59:12.692989 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 4114/7852] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:59:12 2022] GET /compute/v2.1/servers/41827212-e39f-4376-ae67-7154e775c2d8 => generated 1685 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:59:13.716465 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-70563453-bc4b-45fa-89de-4ccf8b2f3fae tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:59:13.717060 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-70563453-bc4b-45fa-89de-4ccf8b2f3fae tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] [instance: 41827212-e39f-4376-ae67-7154e775c2d8] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:59:13.724008 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-70563453-bc4b-45fa-89de-4ccf8b2f3fae tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:59:13.724487 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-70563453-bc4b-45fa-89de-4ccf8b2f3fae tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:59:13.724920 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-70563453-bc4b-45fa-89de-4ccf8b2f3fae tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:59:13.725643 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-70563453-bc4b-45fa-89de-4ccf8b2f3fae tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:59:13.726092 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-70563453-bc4b-45fa-89de-4ccf8b2f3fae tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:59:13.726518 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-70563453-bc4b-45fa-89de-4ccf8b2f3fae tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:59:13.868678 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-70563453-bc4b-45fa-89de-4ccf8b2f3fae tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cd9718357e4655b245403d0f7a8847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255c288051e48e08d94ede2bd6ba558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:59:13.876906 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-70563453-bc4b-45fa-89de-4ccf8b2f3fae tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] 10.222.0.43 "GET /compute/v2.1/servers/41827212-e39f-4376-ae67-7154e775c2d8" status: 200 len: 1685 microversion: 2.1 time: 0.164821 Oct 04 19:59:13.877544 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3739/7853] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:59:13 2022] GET /compute/v2.1/servers/41827212-e39f-4376-ae67-7154e775c2d8 => generated 1685 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:59:14.900744 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-43c58377-ecc9-4c06-86aa-db5b61b96740 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:59:14.901514 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-43c58377-ecc9-4c06-86aa-db5b61b96740 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] [instance: 41827212-e39f-4376-ae67-7154e775c2d8] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:59:14.908592 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-43c58377-ecc9-4c06-86aa-db5b61b96740 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:59:14.909117 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-43c58377-ecc9-4c06-86aa-db5b61b96740 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:59:14.909597 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-43c58377-ecc9-4c06-86aa-db5b61b96740 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:59:14.910326 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-43c58377-ecc9-4c06-86aa-db5b61b96740 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:59:14.910802 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-43c58377-ecc9-4c06-86aa-db5b61b96740 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:59:14.911256 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-43c58377-ecc9-4c06-86aa-db5b61b96740 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:59:15.055495 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-43c58377-ecc9-4c06-86aa-db5b61b96740 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cd9718357e4655b245403d0f7a8847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255c288051e48e08d94ede2bd6ba558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:59:15.063654 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-43c58377-ecc9-4c06-86aa-db5b61b96740 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] 10.222.0.43 "GET /compute/v2.1/servers/41827212-e39f-4376-ae67-7154e775c2d8" status: 200 len: 1685 microversion: 2.1 time: 0.166878 Oct 04 19:59:15.064256 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 4115/7854] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:59:14 2022] GET /compute/v2.1/servers/41827212-e39f-4376-ae67-7154e775c2d8 => generated 1685 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:59:16.087731 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-8490410f-8adc-437f-b7fe-3b16fefe65eb tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:59:16.088360 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-8490410f-8adc-437f-b7fe-3b16fefe65eb tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] [instance: 41827212-e39f-4376-ae67-7154e775c2d8] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:59:16.095661 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8490410f-8adc-437f-b7fe-3b16fefe65eb tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:59:16.096162 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8490410f-8adc-437f-b7fe-3b16fefe65eb tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:59:16.096613 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8490410f-8adc-437f-b7fe-3b16fefe65eb tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:59:16.097355 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8490410f-8adc-437f-b7fe-3b16fefe65eb tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:59:16.097818 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8490410f-8adc-437f-b7fe-3b16fefe65eb tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:59:16.098254 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8490410f-8adc-437f-b7fe-3b16fefe65eb tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:59:16.239166 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-8490410f-8adc-437f-b7fe-3b16fefe65eb tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cd9718357e4655b245403d0f7a8847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255c288051e48e08d94ede2bd6ba558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:59:16.247722 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-8490410f-8adc-437f-b7fe-3b16fefe65eb tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] 10.222.0.43 "GET /compute/v2.1/servers/41827212-e39f-4376-ae67-7154e775c2d8" status: 200 len: 1685 microversion: 2.1 time: 0.163947 Oct 04 19:59:16.248310 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3740/7855] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:59:16 2022] GET /compute/v2.1/servers/41827212-e39f-4376-ae67-7154e775c2d8 => generated 1685 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:59:17.027500 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-23636ed7-0575-4006-9930-6f902e0d44cf req-2dce10fa-6f3e-4804-8434-0e1557007716 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41827212-e39f-4376-ae67-7154e775c2d8", "name": "network-vif-plugged", "status": "completed", "tag": "eae6a7a5-92c6-429f-af33-9eb658b8a47a"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:59:17.039482 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-23636ed7-0575-4006-9930-6f902e0d44cf req-2dce10fa-6f3e-4804-8434-0e1557007716 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:59:17.040280 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-23636ed7-0575-4006-9930-6f902e0d44cf req-2dce10fa-6f3e-4804-8434-0e1557007716 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:59:17.041587 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-23636ed7-0575-4006-9930-6f902e0d44cf req-2dce10fa-6f3e-4804-8434-0e1557007716 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:59:17.056185 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-23636ed7-0575-4006-9930-6f902e0d44cf req-2dce10fa-6f3e-4804-8434-0e1557007716 service nova] Creating event network-vif-plugged:eae6a7a5-92c6-429f-af33-9eb658b8a47a for instance 41827212-e39f-4376-ae67-7154e775c2d8 on n-h2-851028-13 Oct 04 19:59:17.062156 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-23636ed7-0575-4006-9930-6f902e0d44cf req-2dce10fa-6f3e-4804-8434-0e1557007716 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039140 Oct 04 19:59:17.062784 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 4116/7856] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 19:59:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:59:17.270935 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-b5601050-44d7-418b-9eaf-b41187683e58 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:59:17.271552 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-b5601050-44d7-418b-9eaf-b41187683e58 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] [instance: 41827212-e39f-4376-ae67-7154e775c2d8] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:59:17.278806 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b5601050-44d7-418b-9eaf-b41187683e58 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:59:17.281837 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b5601050-44d7-418b-9eaf-b41187683e58 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:59:17.281837 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b5601050-44d7-418b-9eaf-b41187683e58 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:59:17.281837 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b5601050-44d7-418b-9eaf-b41187683e58 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:59:17.281837 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b5601050-44d7-418b-9eaf-b41187683e58 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:59:17.281837 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b5601050-44d7-418b-9eaf-b41187683e58 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:59:17.440149 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-b5601050-44d7-418b-9eaf-b41187683e58 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cd9718357e4655b245403d0f7a8847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255c288051e48e08d94ede2bd6ba558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:59:17.448781 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-b5601050-44d7-418b-9eaf-b41187683e58 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] 10.222.0.43 "GET /compute/v2.1/servers/41827212-e39f-4376-ae67-7154e775c2d8" status: 200 len: 1685 microversion: 2.1 time: 0.181770 Oct 04 19:59:17.449401 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3741/7857] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:59:17 2022] GET /compute/v2.1/servers/41827212-e39f-4376-ae67-7154e775c2d8 => generated 1685 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:59:18.472774 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-bf892f5b-95db-4a5c-ade3-2fe7fffa8833 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:59:18.473558 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-bf892f5b-95db-4a5c-ade3-2fe7fffa8833 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] [instance: 41827212-e39f-4376-ae67-7154e775c2d8] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:59:18.481797 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bf892f5b-95db-4a5c-ade3-2fe7fffa8833 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:59:18.482314 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bf892f5b-95db-4a5c-ade3-2fe7fffa8833 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:59:18.482770 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bf892f5b-95db-4a5c-ade3-2fe7fffa8833 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:59:18.483687 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bf892f5b-95db-4a5c-ade3-2fe7fffa8833 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:59:18.484160 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bf892f5b-95db-4a5c-ade3-2fe7fffa8833 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:59:18.484603 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-bf892f5b-95db-4a5c-ade3-2fe7fffa8833 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:59:18.659117 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-bf892f5b-95db-4a5c-ade3-2fe7fffa8833 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cd9718357e4655b245403d0f7a8847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255c288051e48e08d94ede2bd6ba558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:59:18.668659 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-bf892f5b-95db-4a5c-ade3-2fe7fffa8833 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] 10.222.0.43 "GET /compute/v2.1/servers/41827212-e39f-4376-ae67-7154e775c2d8" status: 200 len: 1685 microversion: 2.1 time: 0.200068 Oct 04 19:59:18.677445 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 4117/7858] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:59:18 2022] GET /compute/v2.1/servers/41827212-e39f-4376-ae67-7154e775c2d8 => generated 1685 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:59:19.694028 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-175cd7d0-33aa-4a8f-9174-c9fe6518b79d tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:59:19.695031 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-175cd7d0-33aa-4a8f-9174-c9fe6518b79d tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] [instance: 41827212-e39f-4376-ae67-7154e775c2d8] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:59:19.703773 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-175cd7d0-33aa-4a8f-9174-c9fe6518b79d tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:59:19.704508 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-175cd7d0-33aa-4a8f-9174-c9fe6518b79d tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:59:19.705273 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-175cd7d0-33aa-4a8f-9174-c9fe6518b79d tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:59:19.706322 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-175cd7d0-33aa-4a8f-9174-c9fe6518b79d tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:59:19.707013 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-175cd7d0-33aa-4a8f-9174-c9fe6518b79d tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:59:19.707660 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-175cd7d0-33aa-4a8f-9174-c9fe6518b79d tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:59:19.842337 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-175cd7d0-33aa-4a8f-9174-c9fe6518b79d tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cd9718357e4655b245403d0f7a8847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255c288051e48e08d94ede2bd6ba558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:59:19.850058 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-175cd7d0-33aa-4a8f-9174-c9fe6518b79d tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] 10.222.0.43 "GET /compute/v2.1/servers/41827212-e39f-4376-ae67-7154e775c2d8" status: 200 len: 1672 microversion: 2.1 time: 0.161276 Oct 04 19:59:19.850637 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3742/7859] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 19:59:19 2022] GET /compute/v2.1/servers/41827212-e39f-4376-ae67-7154e775c2d8 => generated 1672 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:00:33.976543 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_api:SELECT=13 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:00:33.978059 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_api:SELECT=15 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:00:33.978505 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=47,nova_cell1:INSERT=1 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:00:33.978807 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=47 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:00:33.979958 n-d-851028-13 devstack@n-api.service[123596]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 20:00:33.980094 n-d-851028-13 devstack@n-api.service[123596]: Tue Oct 4 20:00:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/41827212-e39f-4376-ae67-7154e775c2d8 (ip 10.222.0.43) !!! Oct 04 20:00:33.983641 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-48ab2e73-776b-4b8a-adae-8229f8655487 req-ba8ff98f-42fb-457d-95b8-7234d23e6eeb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41827212-e39f-4376-ae67-7154e775c2d8", "tag": "eae6a7a5-92c6-429f-af33-9eb658b8a47a"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:00:33.989546 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-95dcaeca-3724-43b7-b19c-163a261324de tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:00:33.990484 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-95dcaeca-3724-43b7-b19c-163a261324de tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] [instance: 41827212-e39f-4376-ae67-7154e775c2d8] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:00:33.995119 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-48ab2e73-776b-4b8a-adae-8229f8655487 req-ba8ff98f-42fb-457d-95b8-7234d23e6eeb service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:00:33.995601 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-48ab2e73-776b-4b8a-adae-8229f8655487 req-ba8ff98f-42fb-457d-95b8-7234d23e6eeb service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:00:33.996046 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-48ab2e73-776b-4b8a-adae-8229f8655487 req-ba8ff98f-42fb-457d-95b8-7234d23e6eeb service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:00:34.005635 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-95dcaeca-3724-43b7-b19c-163a261324de tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:00:34.006925 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-95dcaeca-3724-43b7-b19c-163a261324de tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:00:34.007397 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-95dcaeca-3724-43b7-b19c-163a261324de tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:00:34.008138 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-95dcaeca-3724-43b7-b19c-163a261324de tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:00:34.008613 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-95dcaeca-3724-43b7-b19c-163a261324de tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:00:34.009062 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-95dcaeca-3724-43b7-b19c-163a261324de tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:00:34.009507 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-48ab2e73-776b-4b8a-adae-8229f8655487 req-ba8ff98f-42fb-457d-95b8-7234d23e6eeb service nova] Creating event network-changed:eae6a7a5-92c6-429f-af33-9eb658b8a47a for instance 41827212-e39f-4376-ae67-7154e775c2d8 on n-h2-851028-13 Oct 04 20:00:34.016189 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-48ab2e73-776b-4b8a-adae-8229f8655487 req-ba8ff98f-42fb-457d-95b8-7234d23e6eeb service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039674 Oct 04 20:00:34.017248 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3743/7860] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 20:00:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:00:34.036880 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-95dcaeca-3724-43b7-b19c-163a261324de tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] [instance: 41827212-e39f-4376-ae67-7154e775c2d8] Going to try to terminate instance {{(pid=123596) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:00:34.133599 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-95dcaeca-3724-43b7-b19c-163a261324de tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] 10.222.0.43 "DELETE /compute/v2.1/servers/41827212-e39f-4376-ae67-7154e775c2d8" status: 204 len: 0 microversion: 2.1 time: 0.159108 Oct 04 20:00:34.138155 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 4118/7861] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 20:00:33 2022] DELETE /compute/v2.1/servers/41827212-e39f-4376-ae67-7154e775c2d8 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:00:34.143913 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-d68ce03c-8e73-48aa-897d-92e8c8011cc1 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:00:34.144648 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-d68ce03c-8e73-48aa-897d-92e8c8011cc1 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] [instance: 41827212-e39f-4376-ae67-7154e775c2d8] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:00:34.151375 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d68ce03c-8e73-48aa-897d-92e8c8011cc1 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:00:34.151894 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d68ce03c-8e73-48aa-897d-92e8c8011cc1 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:00:34.152325 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d68ce03c-8e73-48aa-897d-92e8c8011cc1 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:00:34.153287 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d68ce03c-8e73-48aa-897d-92e8c8011cc1 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:00:34.153756 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d68ce03c-8e73-48aa-897d-92e8c8011cc1 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:00:34.154193 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d68ce03c-8e73-48aa-897d-92e8c8011cc1 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:00:34.436415 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-d68ce03c-8e73-48aa-897d-92e8c8011cc1 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cd9718357e4655b245403d0f7a8847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255c288051e48e08d94ede2bd6ba558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:00:34.444290 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-d68ce03c-8e73-48aa-897d-92e8c8011cc1 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] 10.222.0.43 "GET /compute/v2.1/servers/41827212-e39f-4376-ae67-7154e775c2d8" status: 200 len: 1678 microversion: 2.1 time: 0.304768 Oct 04 20:00:34.444894 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3744/7862] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 20:00:34 2022] GET /compute/v2.1/servers/41827212-e39f-4376-ae67-7154e775c2d8 => generated 1678 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:00:35.468792 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-a6a162cc-d124-4b8b-bf15-4bdac6a8f2c8 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:00:35.469552 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-a6a162cc-d124-4b8b-bf15-4bdac6a8f2c8 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] [instance: 41827212-e39f-4376-ae67-7154e775c2d8] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:00:35.475736 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a6a162cc-d124-4b8b-bf15-4bdac6a8f2c8 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:00:35.476244 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a6a162cc-d124-4b8b-bf15-4bdac6a8f2c8 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:00:35.476706 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a6a162cc-d124-4b8b-bf15-4bdac6a8f2c8 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:00:35.477450 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a6a162cc-d124-4b8b-bf15-4bdac6a8f2c8 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:00:35.477932 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a6a162cc-d124-4b8b-bf15-4bdac6a8f2c8 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:00:35.478381 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a6a162cc-d124-4b8b-bf15-4bdac6a8f2c8 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:00:35.716616 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-a6a162cc-d124-4b8b-bf15-4bdac6a8f2c8 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cd9718357e4655b245403d0f7a8847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255c288051e48e08d94ede2bd6ba558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:00:35.730092 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-a6a162cc-d124-4b8b-bf15-4bdac6a8f2c8 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] 10.222.0.43 "GET /compute/v2.1/servers/41827212-e39f-4376-ae67-7154e775c2d8" status: 200 len: 1678 microversion: 2.1 time: 0.265403 Oct 04 20:00:35.731221 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 4119/7863] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 20:00:35 2022] GET /compute/v2.1/servers/41827212-e39f-4376-ae67-7154e775c2d8 => generated 1678 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:00:36.096650 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-39f76431-cfff-4f11-9f27-6786f93c6f65 req-5b9f9bcf-caa1-4dfa-871c-217808b1d3c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41827212-e39f-4376-ae67-7154e775c2d8", "name": "network-vif-deleted", "tag": "eae6a7a5-92c6-429f-af33-9eb658b8a47a"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:00:36.107430 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-39f76431-cfff-4f11-9f27-6786f93c6f65 req-5b9f9bcf-caa1-4dfa-871c-217808b1d3c4 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:00:36.107924 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-39f76431-cfff-4f11-9f27-6786f93c6f65 req-5b9f9bcf-caa1-4dfa-871c-217808b1d3c4 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:00:36.108366 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-39f76431-cfff-4f11-9f27-6786f93c6f65 req-5b9f9bcf-caa1-4dfa-871c-217808b1d3c4 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:00:36.128368 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-39f76431-cfff-4f11-9f27-6786f93c6f65 req-5b9f9bcf-caa1-4dfa-871c-217808b1d3c4 service nova] Creating event network-vif-deleted:eae6a7a5-92c6-429f-af33-9eb658b8a47a for instance 41827212-e39f-4376-ae67-7154e775c2d8 on n-h2-851028-13 Oct 04 20:00:36.134441 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-39f76431-cfff-4f11-9f27-6786f93c6f65 req-5b9f9bcf-caa1-4dfa-871c-217808b1d3c4 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101865 Oct 04 20:00:36.135066 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3745/7864] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 20:00:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:00:36.754645 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f1f976d1-ca28-49fb-8508-644e748bf555 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:00:36.755291 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-f1f976d1-ca28-49fb-8508-644e748bf555 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] [instance: 41827212-e39f-4376-ae67-7154e775c2d8] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:00:36.763158 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f1f976d1-ca28-49fb-8508-644e748bf555 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:00:36.763665 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f1f976d1-ca28-49fb-8508-644e748bf555 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:00:36.764246 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f1f976d1-ca28-49fb-8508-644e748bf555 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:00:36.764971 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f1f976d1-ca28-49fb-8508-644e748bf555 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:00:36.765479 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f1f976d1-ca28-49fb-8508-644e748bf555 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:00:36.765934 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f1f976d1-ca28-49fb-8508-644e748bf555 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:00:36.779947 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-f1f976d1-ca28-49fb-8508-644e748bf555 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] HTTP exception thrown: Instance 41827212-e39f-4376-ae67-7154e775c2d8 could not be found. Oct 04 20:00:36.781686 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f1f976d1-ca28-49fb-8508-644e748bf555 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Request method failure captured: Oct 04 20:00:36.781686 n-d-851028-13 devstack@n-api.service[123596]: request: GET /compute/v2.1/servers/41827212-e39f-4376-ae67-7154e775c2d8 HTTP/1.1 Oct 04 20:00:36.781686 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 20:00:36.781686 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 20:00:36.781686 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 20:00:36.781686 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 20:00:36.781686 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 20:00:36.781686 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 20:00:36.781686 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 20:00:36.781686 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 20:00:36.781686 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPI_ikPt8-5DTXRTsB0GlyuNn0fIzsOgqWt-XPvrHYgcZFxB3oTrbwimQUZY3Dj5dugMDp68PEnUvTWXnj_lgepBI4B_cUPSYf2yLVRPM5q30O6A2ExbjwkDUr-e91lM_QwQI9PkquOyHpX-8Xzuol15qcrdJFWLkwA-nD4clPBq4bNo Oct 04 20:00:36.781686 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 20:00:36.781686 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 20:00:36.781686 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 20:00:36.781686 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 20:00:36.781686 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 20:00:36.781686 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 20:00:36.781686 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: 3255c288051e48e08d94ede2bd6ba558 Oct 04 20:00:36.781686 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-TestShelveInstance-1078371979 Oct 04 20:00:36.781686 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 20:00:36.781686 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 20:00:36.781686 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/3255c288051e48e08d94ede2bd6ba558"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_3255c288051e48e08d94ede2bd6ba558"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/3255c288051e48e08d94ede2bd6ba558"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/3255c288051e48e08d94ede2bd6ba558"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 20:00:36.781686 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-TestShelveInstance-1078371979 Oct 04 20:00:36.781686 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: 3255c288051e48e08d94ede2bd6ba558 Oct 04 20:00:36.781686 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-TestShelveInstance-1078371979 Oct 04 20:00:36.781686 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-TestShelveInstance-1078371979-project Oct 04 20:00:36.781686 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 20:00:36.781686 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 20:00:36.781686 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 09cd9718357e4655b245403d0f7a8847 Oct 04 20:00:36.781686 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-TestShelveInstance-1078371979-project Oct 04 20:00:36.781686 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 20:00:36.781686 n-d-851028-13 devstack@n-api.service[123596]: exception: Instance 41827212-e39f-4376-ae67-7154e775c2d8 could not be found. Oct 04 20:00:36.781686 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': '41827212-e39f-4376-ae67-7154e775c2d8'} Oct 04 20:00:36.781686 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:00:36.781686 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:00:36.781686 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:00:36.781686 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:00:36.781686 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:00:36.781686 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:00:36.781686 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:00:36.781686 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:00:36.781686 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:00:36.781686 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:00:36.781686 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 41827212-e39f-4376-ae67-7154e775c2d8 could not be found. Oct 04 20:00:36.781686 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 20:00:36.781686 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:00:36.781686 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 20:00:36.781686 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:00:36.781686 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:00:36.781686 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:00:36.781686 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:00:36.781686 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:00:36.781686 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:00:36.781686 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:00:36.781686 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:00:36.781686 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:00:36.781686 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:00:36.781686 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:00:36.781686 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:00:36.781686 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:00:36.781686 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41827212-e39f-4376-ae67-7154e775c2d8 could not be found. Oct 04 20:00:36.781686 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 20:00:36.781686 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:00:36.781686 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 20:00:36.787492 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:00:36.787492 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:00:36.787492 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:00:36.787492 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:00:36.787492 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:00:36.787492 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41827212-e39f-4376-ae67-7154e775c2d8 could not be found. Oct 04 20:00:36.787492 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 20:00:36.787492 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f1f976d1-ca28-49fb-8508-644e748bf555 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Returning 404 to user: Instance 41827212-e39f-4376-ae67-7154e775c2d8 could not be found. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:00:36.787492 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-f1f976d1-ca28-49fb-8508-644e748bf555 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] 10.222.0.43 "GET /compute/v2.1/servers/41827212-e39f-4376-ae67-7154e775c2d8" status: 404 len: 111 microversion: 2.1 time: 0.032512 Oct 04 20:00:36.787492 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 4120/7865] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 20:00:36 2022] GET /compute/v2.1/servers/41827212-e39f-4376-ae67-7154e775c2d8 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:00:36.955138 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-4a01f0c1-b711-48fb-883f-a1b565948a49 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Calling method '.version_select at 0x7fb21ec089d0>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:00:36.980653 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-4a01f0c1-b711-48fb-883f-a1b565948a49 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1352277834" status: 202 len: 0 microversion: 2.1 time: 0.029732 Oct 04 20:00:36.981609 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3746/7866] 10.222.0.43 () {58 vars in 1254 bytes} [Tue Oct 4 20:00:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1352277834 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:00:37.008693 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-232f2994-0e46-4374-8619-fb9c18de0d34 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Action: 'create', calling method: .version_select at 0x7fb21fd045e0>, body: {"keypair": {"name": "tempest-TestShelveInstance-929676904", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLBSoc9ZEXfD7Wbs6MctyhpdB7qUpROKl4MlbOCPZoEjrxOcaRQAED3NhiGd8bhIE86v6dCHtGuTqSWo48LMbWst7vdd1AGyY6j4nWhC3uOc+I7o9EgGvE8wiA1L51n2Ig=="}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:00:37.024873 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-232f2994-0e46-4374-8619-fb9c18de0d34 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Getting quotas for project 3255c288051e48e08d94ede2bd6ba558. Resources: {'key_pairs'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:00:37.030407 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-232f2994-0e46-4374-8619-fb9c18de0d34 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Getting quotas for user 09cd9718357e4655b245403d0f7a8847 and project 3255c288051e48e08d94ede2bd6ba558. Resources: {'key_pairs'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:00:37.064279 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-232f2994-0e46-4374-8619-fb9c18de0d34 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.063414 Oct 04 20:00:37.064892 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 4121/7867] 10.222.0.43 () {60 vars in 1159 bytes} [Tue Oct 4 20:00:36 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:00:54.404569 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-6d6194b4-ff79-41c6-b8b2-f0b3fcb83f47 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1797087114", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-929676904", "security_groups": [{"name": "tempest-secgroup-smoke-2032054068"}], "networks": [{"uuid": "8cadccd2-89c9-43e6-97ab-926f8fdb277c"}], "block_device_mapping_v2": [{"uuid": "f3c20219-348a-44e1-8965-79147e31d398", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:00:54.417094 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=10 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:00:54.417778 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:00:54.534165 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.network.neutron [None req-6d6194b4-ff79-41c6-b8b2-f0b3fcb83f47 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] validate_networks() for [('8cadccd2-89c9-43e6-97ab-926f8fdb277c', None, None, None, None, None)] {{(pid=123595) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:00:55.002573 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-6d6194b4-ff79-41c6-b8b2-f0b3fcb83f47 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Flavor limits 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:00:55.003002 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-6d6194b4-ff79-41c6-b8b2-f0b3fcb83f47 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Image limits 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:00:55.003478 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-6d6194b4-ff79-41c6-b8b2-f0b3fcb83f47 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Flavor pref 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:00:55.003887 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-6d6194b4-ff79-41c6-b8b2-f0b3fcb83f47 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Image pref 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:00:55.004301 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-6d6194b4-ff79-41c6-b8b2-f0b3fcb83f47 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:00:55.013118 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6d6194b4-ff79-41c6-b8b2-f0b3fcb83f47 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:00:55.013621 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6d6194b4-ff79-41c6-b8b2-f0b3fcb83f47 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:00:55.014058 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6d6194b4-ff79-41c6-b8b2-f0b3fcb83f47 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:00:55.014786 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6d6194b4-ff79-41c6-b8b2-f0b3fcb83f47 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:00:55.015240 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6d6194b4-ff79-41c6-b8b2-f0b3fcb83f47 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:00:55.015665 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6d6194b4-ff79-41c6-b8b2-f0b3fcb83f47 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:00:55.032366 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-6d6194b4-ff79-41c6-b8b2-f0b3fcb83f47 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Getting quotas for project 3255c288051e48e08d94ede2bd6ba558. Resources: {'ram', 'cores', 'instances'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:00:55.038184 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-6d6194b4-ff79-41c6-b8b2-f0b3fcb83f47 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Getting quotas for user 09cd9718357e4655b245403d0f7a8847 and project 3255c288051e48e08d94ede2bd6ba558. Resources: {'ram', 'cores', 'instances'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:00:55.097002 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-6d6194b4-ff79-41c6-b8b2-f0b3fcb83f47 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Going to run 1 instances... {{(pid=123595) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:00:55.099339 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-6d6194b4-ff79-41c6-b8b2-f0b3fcb83f47 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] [instance: 83924572-5b93-4971-a5c0-fefaa87464c1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f3c20219-348a-44e1-8965-79147e31d398',volume_size=None,volume_type=None)] {{(pid=123595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:00:55.238001 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-6d6194b4-ff79-41c6-b8b2-f0b3fcb83f47 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.837486 Oct 04 20:00:55.238663 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3747/7868] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 20:00:54 2022] POST /compute/v2.1/servers => generated 406 bytes in 839 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 20:00:55.248349 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:00:55.249073 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=4 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:00:55.249875 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:00:55.253859 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-a730d05e-6d5c-4a78-aeb7-7e93e42cdb9d tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:00:55.254428 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-a730d05e-6d5c-4a78-aeb7-7e93e42cdb9d tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] [instance: 83924572-5b93-4971-a5c0-fefaa87464c1] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:00:55.312978 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-a730d05e-6d5c-4a78-aeb7-7e93e42cdb9d tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cd9718357e4655b245403d0f7a8847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255c288051e48e08d94ede2bd6ba558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:00:55.321098 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-a730d05e-6d5c-4a78-aeb7-7e93e42cdb9d tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] 10.222.0.43 "GET /compute/v2.1/servers/83924572-5b93-4971-a5c0-fefaa87464c1" status: 200 len: 1088 microversion: 2.1 time: 0.074550 Oct 04 20:00:55.321942 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 4122/7869] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 20:00:55 2022] GET /compute/v2.1/servers/83924572-5b93-4971-a5c0-fefaa87464c1 => generated 1088 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:00:56.348346 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-fe362a0e-6595-43c5-b43d-30a6ceb7d980 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:00:56.348977 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-fe362a0e-6595-43c5-b43d-30a6ceb7d980 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] [instance: 83924572-5b93-4971-a5c0-fefaa87464c1] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:00:56.357149 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fe362a0e-6595-43c5-b43d-30a6ceb7d980 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:00:56.357927 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fe362a0e-6595-43c5-b43d-30a6ceb7d980 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:00:56.358373 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fe362a0e-6595-43c5-b43d-30a6ceb7d980 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:00:56.359083 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fe362a0e-6595-43c5-b43d-30a6ceb7d980 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:00:56.359540 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fe362a0e-6595-43c5-b43d-30a6ceb7d980 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:00:56.359976 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-fe362a0e-6595-43c5-b43d-30a6ceb7d980 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:00:56.459236 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-fe362a0e-6595-43c5-b43d-30a6ceb7d980 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cd9718357e4655b245403d0f7a8847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255c288051e48e08d94ede2bd6ba558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:00:56.469003 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-fe362a0e-6595-43c5-b43d-30a6ceb7d980 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] 10.222.0.43 "GET /compute/v2.1/servers/83924572-5b93-4971-a5c0-fefaa87464c1" status: 200 len: 1204 microversion: 2.1 time: 0.126583 Oct 04 20:00:56.469791 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3748/7870] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 20:00:56 2022] GET /compute/v2.1/servers/83924572-5b93-4971-a5c0-fefaa87464c1 => generated 1204 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:00:57.492531 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-8317d132-8a53-406c-9b93-d9777b77a095 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:00:57.493501 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-8317d132-8a53-406c-9b93-d9777b77a095 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] [instance: 83924572-5b93-4971-a5c0-fefaa87464c1] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:00:57.500586 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8317d132-8a53-406c-9b93-d9777b77a095 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:00:57.501252 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8317d132-8a53-406c-9b93-d9777b77a095 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:00:57.501823 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8317d132-8a53-406c-9b93-d9777b77a095 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:00:57.502644 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8317d132-8a53-406c-9b93-d9777b77a095 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:00:57.503269 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8317d132-8a53-406c-9b93-d9777b77a095 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:00:57.503811 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8317d132-8a53-406c-9b93-d9777b77a095 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:00:57.677889 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-8317d132-8a53-406c-9b93-d9777b77a095 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cd9718357e4655b245403d0f7a8847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255c288051e48e08d94ede2bd6ba558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:00:57.686450 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-8317d132-8a53-406c-9b93-d9777b77a095 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] 10.222.0.43 "GET /compute/v2.1/servers/83924572-5b93-4971-a5c0-fefaa87464c1" status: 200 len: 1272 microversion: 2.1 time: 0.198430 Oct 04 20:00:57.687041 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 4123/7871] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 20:00:57 2022] GET /compute/v2.1/servers/83924572-5b93-4971-a5c0-fefaa87464c1 => generated 1272 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:00:57.876010 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-579574df-a3c1-4eef-8975-8d992d95d293 req-f6148177-8939-4987-8269-2ac36f60881a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83924572-5b93-4971-a5c0-fefaa87464c1", "tag": "a35e5860-3275-4c95-a30a-e8ab1a881fb6"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:00:57.888410 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-579574df-a3c1-4eef-8975-8d992d95d293 req-f6148177-8939-4987-8269-2ac36f60881a service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:00:57.888904 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-579574df-a3c1-4eef-8975-8d992d95d293 req-f6148177-8939-4987-8269-2ac36f60881a service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:00:57.889477 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-579574df-a3c1-4eef-8975-8d992d95d293 req-f6148177-8939-4987-8269-2ac36f60881a service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:00:57.903773 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-579574df-a3c1-4eef-8975-8d992d95d293 req-f6148177-8939-4987-8269-2ac36f60881a service nova] Creating event network-changed:a35e5860-3275-4c95-a30a-e8ab1a881fb6 for instance 83924572-5b93-4971-a5c0-fefaa87464c1 on n-h1-851028-13 Oct 04 20:00:57.909709 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-579574df-a3c1-4eef-8975-8d992d95d293 req-f6148177-8939-4987-8269-2ac36f60881a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038983 Oct 04 20:00:57.911033 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3749/7872] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 20:00:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:00:58.722487 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-e218b7b5-035b-4745-a03e-808314b6972f tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:00:58.723065 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-e218b7b5-035b-4745-a03e-808314b6972f tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] [instance: 83924572-5b93-4971-a5c0-fefaa87464c1] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:00:58.731477 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e218b7b5-035b-4745-a03e-808314b6972f tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:00:58.731987 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e218b7b5-035b-4745-a03e-808314b6972f tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:00:58.732446 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e218b7b5-035b-4745-a03e-808314b6972f tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:00:58.733210 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e218b7b5-035b-4745-a03e-808314b6972f tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:00:58.733683 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e218b7b5-035b-4745-a03e-808314b6972f tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:00:58.734123 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e218b7b5-035b-4745-a03e-808314b6972f tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:00:58.886278 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-e218b7b5-035b-4745-a03e-808314b6972f tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cd9718357e4655b245403d0f7a8847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255c288051e48e08d94ede2bd6ba558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:00:58.894622 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-e218b7b5-035b-4745-a03e-808314b6972f tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] 10.222.0.43 "GET /compute/v2.1/servers/83924572-5b93-4971-a5c0-fefaa87464c1" status: 200 len: 1272 microversion: 2.1 time: 0.176269 Oct 04 20:00:58.895613 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 4124/7873] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 20:00:58 2022] GET /compute/v2.1/servers/83924572-5b93-4971-a5c0-fefaa87464c1 => generated 1272 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:00:59.920008 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-86b97486-44f3-4d3b-ba38-28bf4b0f484e tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:00:59.920656 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-86b97486-44f3-4d3b-ba38-28bf4b0f484e tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] [instance: 83924572-5b93-4971-a5c0-fefaa87464c1] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:00:59.927046 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-86b97486-44f3-4d3b-ba38-28bf4b0f484e tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:00:59.927540 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-86b97486-44f3-4d3b-ba38-28bf4b0f484e tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:00:59.928107 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-86b97486-44f3-4d3b-ba38-28bf4b0f484e tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:00:59.928853 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-86b97486-44f3-4d3b-ba38-28bf4b0f484e tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:00:59.929355 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-86b97486-44f3-4d3b-ba38-28bf4b0f484e tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:00:59.929791 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-86b97486-44f3-4d3b-ba38-28bf4b0f484e tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:01:00.077578 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-86b97486-44f3-4d3b-ba38-28bf4b0f484e tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cd9718357e4655b245403d0f7a8847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255c288051e48e08d94ede2bd6ba558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:01:00.086519 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-86b97486-44f3-4d3b-ba38-28bf4b0f484e tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] 10.222.0.43 "GET /compute/v2.1/servers/83924572-5b93-4971-a5c0-fefaa87464c1" status: 200 len: 1272 microversion: 2.1 time: 0.171780 Oct 04 20:01:00.087113 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3750/7874] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 20:00:59 2022] GET /compute/v2.1/servers/83924572-5b93-4971-a5c0-fefaa87464c1 => generated 1272 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:01:01.109554 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-2ba2d349-6d1a-47d4-b70a-3801d1bc389b tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:01:01.110457 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-2ba2d349-6d1a-47d4-b70a-3801d1bc389b tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] [instance: 83924572-5b93-4971-a5c0-fefaa87464c1] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:01:01.117764 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2ba2d349-6d1a-47d4-b70a-3801d1bc389b tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:01:01.118279 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2ba2d349-6d1a-47d4-b70a-3801d1bc389b tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:01:01.118743 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2ba2d349-6d1a-47d4-b70a-3801d1bc389b tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:01:01.119511 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2ba2d349-6d1a-47d4-b70a-3801d1bc389b tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:01:01.119984 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2ba2d349-6d1a-47d4-b70a-3801d1bc389b tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:01:01.120428 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2ba2d349-6d1a-47d4-b70a-3801d1bc389b tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:01:01.272617 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-2ba2d349-6d1a-47d4-b70a-3801d1bc389b tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cd9718357e4655b245403d0f7a8847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255c288051e48e08d94ede2bd6ba558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:01:01.280876 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-2ba2d349-6d1a-47d4-b70a-3801d1bc389b tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] 10.222.0.43 "GET /compute/v2.1/servers/83924572-5b93-4971-a5c0-fefaa87464c1" status: 200 len: 1272 microversion: 2.1 time: 0.175396 Oct 04 20:01:01.281500 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 4125/7875] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 20:01:01 2022] GET /compute/v2.1/servers/83924572-5b93-4971-a5c0-fefaa87464c1 => generated 1272 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:01:02.304451 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-8bd803d5-75fb-4be2-b1d3-cf3a99386742 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:01:02.305021 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-8bd803d5-75fb-4be2-b1d3-cf3a99386742 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] [instance: 83924572-5b93-4971-a5c0-fefaa87464c1] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:01:02.311951 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8bd803d5-75fb-4be2-b1d3-cf3a99386742 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:01:02.312444 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8bd803d5-75fb-4be2-b1d3-cf3a99386742 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:01:02.312891 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8bd803d5-75fb-4be2-b1d3-cf3a99386742 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:01:02.313628 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8bd803d5-75fb-4be2-b1d3-cf3a99386742 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:01:02.314088 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8bd803d5-75fb-4be2-b1d3-cf3a99386742 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:01:02.314517 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-8bd803d5-75fb-4be2-b1d3-cf3a99386742 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:01:02.452985 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-8bd803d5-75fb-4be2-b1d3-cf3a99386742 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cd9718357e4655b245403d0f7a8847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255c288051e48e08d94ede2bd6ba558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:01:02.462092 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-8bd803d5-75fb-4be2-b1d3-cf3a99386742 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] 10.222.0.43 "GET /compute/v2.1/servers/83924572-5b93-4971-a5c0-fefaa87464c1" status: 200 len: 1260 microversion: 2.1 time: 0.161619 Oct 04 20:01:02.462695 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3751/7876] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 20:01:02 2022] GET /compute/v2.1/servers/83924572-5b93-4971-a5c0-fefaa87464c1 => generated 1260 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:01:03.485454 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-0a2bc780-7a28-4e49-a0af-9b192ba39f4b tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:01:03.486094 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-0a2bc780-7a28-4e49-a0af-9b192ba39f4b tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] [instance: 83924572-5b93-4971-a5c0-fefaa87464c1] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:01:03.493563 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0a2bc780-7a28-4e49-a0af-9b192ba39f4b tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:01:03.494074 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0a2bc780-7a28-4e49-a0af-9b192ba39f4b tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:01:03.494536 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0a2bc780-7a28-4e49-a0af-9b192ba39f4b tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:01:03.495255 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0a2bc780-7a28-4e49-a0af-9b192ba39f4b tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:01:03.495734 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0a2bc780-7a28-4e49-a0af-9b192ba39f4b tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:01:03.496189 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0a2bc780-7a28-4e49-a0af-9b192ba39f4b tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:01:03.630269 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-0a2bc780-7a28-4e49-a0af-9b192ba39f4b tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cd9718357e4655b245403d0f7a8847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255c288051e48e08d94ede2bd6ba558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:01:03.638771 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-0a2bc780-7a28-4e49-a0af-9b192ba39f4b tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] 10.222.0.43 "GET /compute/v2.1/servers/83924572-5b93-4971-a5c0-fefaa87464c1" status: 200 len: 1260 microversion: 2.1 time: 0.157341 Oct 04 20:01:03.639350 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 4126/7877] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 20:01:03 2022] GET /compute/v2.1/servers/83924572-5b93-4971-a5c0-fefaa87464c1 => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:01:04.661502 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-b9594056-12c6-43d0-a3f1-c64c34f6e48c tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:01:04.662161 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-b9594056-12c6-43d0-a3f1-c64c34f6e48c tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] [instance: 83924572-5b93-4971-a5c0-fefaa87464c1] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:01:04.669605 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b9594056-12c6-43d0-a3f1-c64c34f6e48c tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:01:04.670098 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b9594056-12c6-43d0-a3f1-c64c34f6e48c tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:01:04.670546 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b9594056-12c6-43d0-a3f1-c64c34f6e48c tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:01:04.671244 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b9594056-12c6-43d0-a3f1-c64c34f6e48c tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:01:04.671705 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b9594056-12c6-43d0-a3f1-c64c34f6e48c tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:01:04.672138 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b9594056-12c6-43d0-a3f1-c64c34f6e48c tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:01:04.808155 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-b9594056-12c6-43d0-a3f1-c64c34f6e48c tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cd9718357e4655b245403d0f7a8847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255c288051e48e08d94ede2bd6ba558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:01:04.815931 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-b9594056-12c6-43d0-a3f1-c64c34f6e48c tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] 10.222.0.43 "GET /compute/v2.1/servers/83924572-5b93-4971-a5c0-fefaa87464c1" status: 200 len: 1260 microversion: 2.1 time: 0.158361 Oct 04 20:01:04.816519 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3752/7878] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 20:01:04 2022] GET /compute/v2.1/servers/83924572-5b93-4971-a5c0-fefaa87464c1 => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:01:05.839873 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-eecd5ad3-0976-4c20-846b-1fd8346d3e30 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:01:05.840548 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-eecd5ad3-0976-4c20-846b-1fd8346d3e30 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] [instance: 83924572-5b93-4971-a5c0-fefaa87464c1] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:01:05.842550 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=2 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:01:05.847888 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-eecd5ad3-0976-4c20-846b-1fd8346d3e30 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:01:05.848392 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-eecd5ad3-0976-4c20-846b-1fd8346d3e30 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:01:05.848851 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-eecd5ad3-0976-4c20-846b-1fd8346d3e30 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:01:05.849593 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-eecd5ad3-0976-4c20-846b-1fd8346d3e30 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:01:05.850652 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-eecd5ad3-0976-4c20-846b-1fd8346d3e30 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:01:05.851099 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-eecd5ad3-0976-4c20-846b-1fd8346d3e30 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:01:05.989577 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-eecd5ad3-0976-4c20-846b-1fd8346d3e30 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cd9718357e4655b245403d0f7a8847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255c288051e48e08d94ede2bd6ba558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:01:05.997496 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-eecd5ad3-0976-4c20-846b-1fd8346d3e30 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] 10.222.0.43 "GET /compute/v2.1/servers/83924572-5b93-4971-a5c0-fefaa87464c1" status: 200 len: 1260 microversion: 2.1 time: 0.161881 Oct 04 20:01:05.998100 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 4127/7879] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 20:01:05 2022] GET /compute/v2.1/servers/83924572-5b93-4971-a5c0-fefaa87464c1 => generated 1260 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:01:07.020296 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-09f7bb44-7d6b-436d-870f-0e6921b943d9 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:01:07.021043 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-09f7bb44-7d6b-436d-870f-0e6921b943d9 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] [instance: 83924572-5b93-4971-a5c0-fefaa87464c1] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:01:07.023533 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=2 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:01:07.024205 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=6 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:01:07.029993 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-09f7bb44-7d6b-436d-870f-0e6921b943d9 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:01:07.030485 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-09f7bb44-7d6b-436d-870f-0e6921b943d9 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:01:07.030926 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-09f7bb44-7d6b-436d-870f-0e6921b943d9 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:01:07.031635 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-09f7bb44-7d6b-436d-870f-0e6921b943d9 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:01:07.032077 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-09f7bb44-7d6b-436d-870f-0e6921b943d9 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:01:07.032506 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-09f7bb44-7d6b-436d-870f-0e6921b943d9 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:01:07.169768 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-09f7bb44-7d6b-436d-870f-0e6921b943d9 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cd9718357e4655b245403d0f7a8847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255c288051e48e08d94ede2bd6ba558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:01:07.177874 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-09f7bb44-7d6b-436d-870f-0e6921b943d9 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] 10.222.0.43 "GET /compute/v2.1/servers/83924572-5b93-4971-a5c0-fefaa87464c1" status: 200 len: 1260 microversion: 2.1 time: 0.161870 Oct 04 20:01:07.178463 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3753/7880] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 20:01:07 2022] GET /compute/v2.1/servers/83924572-5b93-4971-a5c0-fefaa87464c1 => generated 1260 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:01:08.200130 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-3829b048-fbce-4de7-88e8-ccf793ad14c8 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:01:08.200756 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-3829b048-fbce-4de7-88e8-ccf793ad14c8 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] [instance: 83924572-5b93-4971-a5c0-fefaa87464c1] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:01:08.207971 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3829b048-fbce-4de7-88e8-ccf793ad14c8 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:01:08.208581 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3829b048-fbce-4de7-88e8-ccf793ad14c8 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:01:08.209733 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3829b048-fbce-4de7-88e8-ccf793ad14c8 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:01:08.210452 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3829b048-fbce-4de7-88e8-ccf793ad14c8 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:01:08.210916 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3829b048-fbce-4de7-88e8-ccf793ad14c8 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:01:08.211353 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-3829b048-fbce-4de7-88e8-ccf793ad14c8 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:01:08.345470 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-3829b048-fbce-4de7-88e8-ccf793ad14c8 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cd9718357e4655b245403d0f7a8847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255c288051e48e08d94ede2bd6ba558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:01:08.353845 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-3829b048-fbce-4de7-88e8-ccf793ad14c8 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] 10.222.0.43 "GET /compute/v2.1/servers/83924572-5b93-4971-a5c0-fefaa87464c1" status: 200 len: 1260 microversion: 2.1 time: 0.157660 Oct 04 20:01:08.354439 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 4128/7881] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 20:01:08 2022] GET /compute/v2.1/servers/83924572-5b93-4971-a5c0-fefaa87464c1 => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:01:09.376318 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-cbeb2a72-1a6c-4bae-9da3-e3175c5dc793 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:01:09.376948 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-cbeb2a72-1a6c-4bae-9da3-e3175c5dc793 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] [instance: 83924572-5b93-4971-a5c0-fefaa87464c1] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:01:09.384170 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cbeb2a72-1a6c-4bae-9da3-e3175c5dc793 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:01:09.384667 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cbeb2a72-1a6c-4bae-9da3-e3175c5dc793 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:01:09.385131 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cbeb2a72-1a6c-4bae-9da3-e3175c5dc793 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:01:09.385838 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cbeb2a72-1a6c-4bae-9da3-e3175c5dc793 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:01:09.386299 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cbeb2a72-1a6c-4bae-9da3-e3175c5dc793 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:01:09.386739 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-cbeb2a72-1a6c-4bae-9da3-e3175c5dc793 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:01:09.524087 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-cbeb2a72-1a6c-4bae-9da3-e3175c5dc793 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cd9718357e4655b245403d0f7a8847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255c288051e48e08d94ede2bd6ba558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:01:09.532068 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-cbeb2a72-1a6c-4bae-9da3-e3175c5dc793 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] 10.222.0.43 "GET /compute/v2.1/servers/83924572-5b93-4971-a5c0-fefaa87464c1" status: 200 len: 1260 microversion: 2.1 time: 0.159671 Oct 04 20:01:09.532647 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3754/7882] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 20:01:09 2022] GET /compute/v2.1/servers/83924572-5b93-4971-a5c0-fefaa87464c1 => generated 1260 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:01:10.555652 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-954e6d8d-d59c-4c28-93b4-1049321e60a7 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:01:10.556290 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-954e6d8d-d59c-4c28-93b4-1049321e60a7 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] [instance: 83924572-5b93-4971-a5c0-fefaa87464c1] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:01:10.563234 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-954e6d8d-d59c-4c28-93b4-1049321e60a7 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:01:10.563735 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-954e6d8d-d59c-4c28-93b4-1049321e60a7 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:01:10.564192 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-954e6d8d-d59c-4c28-93b4-1049321e60a7 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:01:10.564907 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-954e6d8d-d59c-4c28-93b4-1049321e60a7 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:01:10.565406 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-954e6d8d-d59c-4c28-93b4-1049321e60a7 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:01:10.565848 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-954e6d8d-d59c-4c28-93b4-1049321e60a7 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:01:10.706529 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-954e6d8d-d59c-4c28-93b4-1049321e60a7 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cd9718357e4655b245403d0f7a8847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255c288051e48e08d94ede2bd6ba558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:01:10.714938 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-954e6d8d-d59c-4c28-93b4-1049321e60a7 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] 10.222.0.43 "GET /compute/v2.1/servers/83924572-5b93-4971-a5c0-fefaa87464c1" status: 200 len: 1260 microversion: 2.1 time: 0.163197 Oct 04 20:01:10.715519 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 4129/7883] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 20:01:10 2022] GET /compute/v2.1/servers/83924572-5b93-4971-a5c0-fefaa87464c1 => generated 1260 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:01:11.627011 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-a02777e1-e82f-47ad-863e-f59f0cdf7d53 req-efd405b9-40f1-4b48-af6e-b3f4359fdae7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83924572-5b93-4971-a5c0-fefaa87464c1", "name": "network-vif-plugged", "status": "completed", "tag": "a35e5860-3275-4c95-a30a-e8ab1a881fb6"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:01:11.645479 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-a02777e1-e82f-47ad-863e-f59f0cdf7d53 req-efd405b9-40f1-4b48-af6e-b3f4359fdae7 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:01:11.646646 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-a02777e1-e82f-47ad-863e-f59f0cdf7d53 req-efd405b9-40f1-4b48-af6e-b3f4359fdae7 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:01:11.647410 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-a02777e1-e82f-47ad-863e-f59f0cdf7d53 req-efd405b9-40f1-4b48-af6e-b3f4359fdae7 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:01:11.668938 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-a02777e1-e82f-47ad-863e-f59f0cdf7d53 req-efd405b9-40f1-4b48-af6e-b3f4359fdae7 service nova] Creating event network-vif-plugged:a35e5860-3275-4c95-a30a-e8ab1a881fb6 for instance 83924572-5b93-4971-a5c0-fefaa87464c1 on n-h1-851028-13 Oct 04 20:01:11.676599 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-a02777e1-e82f-47ad-863e-f59f0cdf7d53 req-efd405b9-40f1-4b48-af6e-b3f4359fdae7 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053794 Oct 04 20:01:11.677404 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3755/7884] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 20:01:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:01:11.737775 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-f230be32-1c92-40e2-acc8-10f34f2f71d7 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:01:11.738407 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-f230be32-1c92-40e2-acc8-10f34f2f71d7 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] [instance: 83924572-5b93-4971-a5c0-fefaa87464c1] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:01:11.746375 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f230be32-1c92-40e2-acc8-10f34f2f71d7 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:01:11.747833 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f230be32-1c92-40e2-acc8-10f34f2f71d7 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:01:11.747833 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f230be32-1c92-40e2-acc8-10f34f2f71d7 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:01:11.748191 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f230be32-1c92-40e2-acc8-10f34f2f71d7 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:01:11.748957 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f230be32-1c92-40e2-acc8-10f34f2f71d7 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:01:11.749814 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-f230be32-1c92-40e2-acc8-10f34f2f71d7 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:01:11.892748 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-f230be32-1c92-40e2-acc8-10f34f2f71d7 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cd9718357e4655b245403d0f7a8847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255c288051e48e08d94ede2bd6ba558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:01:11.901200 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-f230be32-1c92-40e2-acc8-10f34f2f71d7 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] 10.222.0.43 "GET /compute/v2.1/servers/83924572-5b93-4971-a5c0-fefaa87464c1" status: 200 len: 1260 microversion: 2.1 time: 0.167321 Oct 04 20:01:11.901775 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 4130/7885] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 20:01:11 2022] GET /compute/v2.1/servers/83924572-5b93-4971-a5c0-fefaa87464c1 => generated 1260 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:01:12.926046 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-b0dce875-ba60-4be1-b221-594879dc147c tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:01:12.926858 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-b0dce875-ba60-4be1-b221-594879dc147c tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] [instance: 83924572-5b93-4971-a5c0-fefaa87464c1] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:01:12.934070 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b0dce875-ba60-4be1-b221-594879dc147c tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:01:12.934551 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b0dce875-ba60-4be1-b221-594879dc147c tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:01:12.934987 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b0dce875-ba60-4be1-b221-594879dc147c tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:01:12.935684 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b0dce875-ba60-4be1-b221-594879dc147c tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:01:12.936134 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b0dce875-ba60-4be1-b221-594879dc147c tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:01:12.936558 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b0dce875-ba60-4be1-b221-594879dc147c tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:01:13.072303 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-b0dce875-ba60-4be1-b221-594879dc147c tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cd9718357e4655b245403d0f7a8847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255c288051e48e08d94ede2bd6ba558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:01:13.080512 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-b0dce875-ba60-4be1-b221-594879dc147c tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] 10.222.0.43 "GET /compute/v2.1/servers/83924572-5b93-4971-a5c0-fefaa87464c1" status: 200 len: 1442 microversion: 2.1 time: 0.160284 Oct 04 20:01:13.081150 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3756/7886] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 20:01:12 2022] GET /compute/v2.1/servers/83924572-5b93-4971-a5c0-fefaa87464c1 => generated 1442 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:01:13.103113 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-79fc6c8e-d3f2-45a1-92e0-4c45acac8003 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:01:13.103737 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-79fc6c8e-d3f2-45a1-92e0-4c45acac8003 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] [instance: 83924572-5b93-4971-a5c0-fefaa87464c1] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:01:13.110622 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-79fc6c8e-d3f2-45a1-92e0-4c45acac8003 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:01:13.111121 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-79fc6c8e-d3f2-45a1-92e0-4c45acac8003 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:01:13.111573 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-79fc6c8e-d3f2-45a1-92e0-4c45acac8003 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:01:13.112278 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-79fc6c8e-d3f2-45a1-92e0-4c45acac8003 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:01:13.112741 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-79fc6c8e-d3f2-45a1-92e0-4c45acac8003 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:01:13.113385 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-79fc6c8e-d3f2-45a1-92e0-4c45acac8003 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:01:13.247605 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-79fc6c8e-d3f2-45a1-92e0-4c45acac8003 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cd9718357e4655b245403d0f7a8847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255c288051e48e08d94ede2bd6ba558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:01:13.255476 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-79fc6c8e-d3f2-45a1-92e0-4c45acac8003 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] 10.222.0.43 "GET /compute/v2.1/servers/83924572-5b93-4971-a5c0-fefaa87464c1" status: 200 len: 1442 microversion: 2.1 time: 0.156722 Oct 04 20:01:13.256048 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 4131/7887] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 20:01:13 2022] GET /compute/v2.1/servers/83924572-5b93-4971-a5c0-fefaa87464c1 => generated 1442 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:01:15.219417 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-61df479a-5b8a-41a3-80b8-7f2abec4d1f4 req-c42b0a07-2248-4ead-86a6-fce3285e02d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83924572-5b93-4971-a5c0-fefaa87464c1", "tag": "a35e5860-3275-4c95-a30a-e8ab1a881fb6"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:01:15.233793 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-61df479a-5b8a-41a3-80b8-7f2abec4d1f4 req-c42b0a07-2248-4ead-86a6-fce3285e02d3 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:01:15.234541 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-61df479a-5b8a-41a3-80b8-7f2abec4d1f4 req-c42b0a07-2248-4ead-86a6-fce3285e02d3 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:01:15.235245 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-61df479a-5b8a-41a3-80b8-7f2abec4d1f4 req-c42b0a07-2248-4ead-86a6-fce3285e02d3 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:01:15.258399 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-61df479a-5b8a-41a3-80b8-7f2abec4d1f4 req-c42b0a07-2248-4ead-86a6-fce3285e02d3 service nova] Creating event network-changed:a35e5860-3275-4c95-a30a-e8ab1a881fb6 for instance 83924572-5b93-4971-a5c0-fefaa87464c1 on n-h1-851028-13 Oct 04 20:01:15.266947 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-61df479a-5b8a-41a3-80b8-7f2abec4d1f4 req-c42b0a07-2248-4ead-86a6-fce3285e02d3 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052579 Oct 04 20:01:15.267944 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3757/7888] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 20:01:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:03:12.973912 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_api:SELECT=22 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:03:12.974689 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=54 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:03:12.975925 n-d-851028-13 devstack@n-api.service[123596]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 04 20:03:12.976099 n-d-851028-13 devstack@n-api.service[123596]: Tue Oct 4 20:03:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/83924572-5b93-4971-a5c0-fefaa87464c1/action (ip 10.222.0.43) !!! Oct 04 20:03:12.977302 n-d-851028-13 devstack@n-api.service[123596]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 20:03:12.977455 n-d-851028-13 devstack@n-api.service[123596]: Tue Oct 4 20:03:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/83924572-5b93-4971-a5c0-fefaa87464c1/action (ip 10.222.0.43) !!! Oct 04 20:03:13.033175 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-b896244b-6ea4-4fb0-9123-5a63e85c6303 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:03:13.034294 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-b896244b-6ea4-4fb0-9123-5a63e85c6303 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] [instance: 83924572-5b93-4971-a5c0-fefaa87464c1] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:03:13.040658 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b896244b-6ea4-4fb0-9123-5a63e85c6303 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:03:13.041217 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b896244b-6ea4-4fb0-9123-5a63e85c6303 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:03:13.041685 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b896244b-6ea4-4fb0-9123-5a63e85c6303 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:03:13.042424 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b896244b-6ea4-4fb0-9123-5a63e85c6303 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:03:13.042904 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b896244b-6ea4-4fb0-9123-5a63e85c6303 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:03:13.043356 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b896244b-6ea4-4fb0-9123-5a63e85c6303 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:03:13.070156 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.objects.instance [None req-b896244b-6ea4-4fb0-9123-5a63e85c6303 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lazy-loading 'flavor' on Instance uuid 83924572-5b93-4971-a5c0-fefaa87464c1 {{(pid=123596) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:03:13.146935 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-b896244b-6ea4-4fb0-9123-5a63e85c6303 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] 10.222.0.43 "POST /compute/v2.1/servers/83924572-5b93-4971-a5c0-fefaa87464c1/action" status: 202 len: 0 microversion: 2.1 time: 0.179227 Oct 04 20:03:13.147566 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 4132/7889] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 20:03:12 2022] POST /compute/v2.1/servers/83924572-5b93-4971-a5c0-fefaa87464c1/action => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:03:13.154342 n-d-851028-13 devstack@n-api.service[123595]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b5b0be1f-cd68-4bfe-8e95-82ae6af61476] AMQP server on 10.222.0.43:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 20:03:13.155321 n-d-851028-13 devstack@n-api.service[123595]: ERROR oslo.messaging._drivers.impl_rabbit [-] [457acf28-5277-4578-be2f-82b18e59b660] AMQP server on 10.222.0.43:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Oct 04 20:03:13.156074 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:03:13.157048 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=50 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:03:13.164015 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-6b7adf81-1219-4c46-b8f6-855ed7df56c2 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:03:13.164731 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-6b7adf81-1219-4c46-b8f6-855ed7df56c2 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] [instance: 83924572-5b93-4971-a5c0-fefaa87464c1] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:03:13.173020 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6b7adf81-1219-4c46-b8f6-855ed7df56c2 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:03:13.173560 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6b7adf81-1219-4c46-b8f6-855ed7df56c2 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:03:13.174010 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6b7adf81-1219-4c46-b8f6-855ed7df56c2 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:03:13.175370 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6b7adf81-1219-4c46-b8f6-855ed7df56c2 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:03:13.175834 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6b7adf81-1219-4c46-b8f6-855ed7df56c2 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:03:13.176282 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-6b7adf81-1219-4c46-b8f6-855ed7df56c2 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:03:13.321398 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-6b7adf81-1219-4c46-b8f6-855ed7df56c2 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cd9718357e4655b245403d0f7a8847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255c288051e48e08d94ede2bd6ba558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:03:13.329680 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-6b7adf81-1219-4c46-b8f6-855ed7df56c2 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] 10.222.0.43 "GET /compute/v2.1/servers/83924572-5b93-4971-a5c0-fefaa87464c1" status: 200 len: 1566 microversion: 2.1 time: 0.177150 Oct 04 20:03:13.330263 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3758/7890] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 20:03:13 2022] GET /compute/v2.1/servers/83924572-5b93-4971-a5c0-fefaa87464c1 => generated 1566 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:03:14.355126 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-21136b7b-b427-4285-a185-eef4ec1faf5d tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:03:14.355852 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-21136b7b-b427-4285-a185-eef4ec1faf5d tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] [instance: 83924572-5b93-4971-a5c0-fefaa87464c1] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:03:14.363018 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-21136b7b-b427-4285-a185-eef4ec1faf5d tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:03:14.363525 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-21136b7b-b427-4285-a185-eef4ec1faf5d tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:03:14.363989 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-21136b7b-b427-4285-a185-eef4ec1faf5d tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:03:14.364711 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-21136b7b-b427-4285-a185-eef4ec1faf5d tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:03:14.365207 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-21136b7b-b427-4285-a185-eef4ec1faf5d tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:03:14.365654 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-21136b7b-b427-4285-a185-eef4ec1faf5d tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:03:14.509382 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-21136b7b-b427-4285-a185-eef4ec1faf5d tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cd9718357e4655b245403d0f7a8847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255c288051e48e08d94ede2bd6ba558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:03:14.517572 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-21136b7b-b427-4285-a185-eef4ec1faf5d tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] 10.222.0.43 "GET /compute/v2.1/servers/83924572-5b93-4971-a5c0-fefaa87464c1" status: 200 len: 1566 microversion: 2.1 time: 0.167800 Oct 04 20:03:14.518165 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 4133/7891] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 20:03:14 2022] GET /compute/v2.1/servers/83924572-5b93-4971-a5c0-fefaa87464c1 => generated 1566 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:03:15.541291 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-5c4cc3b4-3737-4f5b-bcb9-223fe91c8037 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:03:15.541954 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-5c4cc3b4-3737-4f5b-bcb9-223fe91c8037 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] [instance: 83924572-5b93-4971-a5c0-fefaa87464c1] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:03:15.555751 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5c4cc3b4-3737-4f5b-bcb9-223fe91c8037 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:03:15.556468 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5c4cc3b4-3737-4f5b-bcb9-223fe91c8037 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:03:15.556976 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5c4cc3b4-3737-4f5b-bcb9-223fe91c8037 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:03:15.557749 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5c4cc3b4-3737-4f5b-bcb9-223fe91c8037 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:03:15.558243 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5c4cc3b4-3737-4f5b-bcb9-223fe91c8037 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:03:15.558684 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-5c4cc3b4-3737-4f5b-bcb9-223fe91c8037 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:03:15.563248 n-d-851028-13 devstack@n-api.service[123595]: INFO oslo.messaging._drivers.impl_rabbit [-] [457acf28-5277-4578-be2f-82b18e59b660] Reconnected to AMQP server on 10.222.0.43:5672 via [amqp] client with port 51612. Oct 04 20:03:15.564079 n-d-851028-13 devstack@n-api.service[123595]: INFO oslo.messaging._drivers.impl_rabbit [-] [b5b0be1f-cd68-4bfe-8e95-82ae6af61476] Reconnected to AMQP server on 10.222.0.43:5672 via [amqp] client with port 51610. Oct 04 20:03:15.697664 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-5c4cc3b4-3737-4f5b-bcb9-223fe91c8037 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cd9718357e4655b245403d0f7a8847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255c288051e48e08d94ede2bd6ba558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:03:15.706020 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-5c4cc3b4-3737-4f5b-bcb9-223fe91c8037 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] 10.222.0.43 "GET /compute/v2.1/servers/83924572-5b93-4971-a5c0-fefaa87464c1" status: 200 len: 1566 microversion: 2.1 time: 0.168691 Oct 04 20:03:15.706612 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3759/7892] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 20:03:15 2022] GET /compute/v2.1/servers/83924572-5b93-4971-a5c0-fefaa87464c1 => generated 1566 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:03:16.729809 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-d45a0013-7696-4b12-97aa-7edbd5753969 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:03:16.730443 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-d45a0013-7696-4b12-97aa-7edbd5753969 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] [instance: 83924572-5b93-4971-a5c0-fefaa87464c1] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:03:16.737900 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d45a0013-7696-4b12-97aa-7edbd5753969 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:03:16.738419 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d45a0013-7696-4b12-97aa-7edbd5753969 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:03:16.738911 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d45a0013-7696-4b12-97aa-7edbd5753969 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:03:16.739645 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d45a0013-7696-4b12-97aa-7edbd5753969 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:03:16.740124 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d45a0013-7696-4b12-97aa-7edbd5753969 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:03:16.740575 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d45a0013-7696-4b12-97aa-7edbd5753969 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:03:16.879125 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-d45a0013-7696-4b12-97aa-7edbd5753969 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cd9718357e4655b245403d0f7a8847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255c288051e48e08d94ede2bd6ba558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:03:16.887163 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-d45a0013-7696-4b12-97aa-7edbd5753969 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] 10.222.0.43 "GET /compute/v2.1/servers/83924572-5b93-4971-a5c0-fefaa87464c1" status: 200 len: 1566 microversion: 2.1 time: 0.161285 Oct 04 20:03:16.887765 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 4134/7893] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 20:03:16 2022] GET /compute/v2.1/servers/83924572-5b93-4971-a5c0-fefaa87464c1 => generated 1566 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:03:17.911209 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-450a3daa-6e37-44d2-b958-29cd99f69ff9 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:03:17.911779 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-450a3daa-6e37-44d2-b958-29cd99f69ff9 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] [instance: 83924572-5b93-4971-a5c0-fefaa87464c1] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:03:17.918925 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-450a3daa-6e37-44d2-b958-29cd99f69ff9 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:03:17.919416 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-450a3daa-6e37-44d2-b958-29cd99f69ff9 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:03:17.919863 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-450a3daa-6e37-44d2-b958-29cd99f69ff9 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:03:17.920565 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-450a3daa-6e37-44d2-b958-29cd99f69ff9 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:03:17.921023 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-450a3daa-6e37-44d2-b958-29cd99f69ff9 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:03:17.921481 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-450a3daa-6e37-44d2-b958-29cd99f69ff9 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:03:18.068623 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-450a3daa-6e37-44d2-b958-29cd99f69ff9 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cd9718357e4655b245403d0f7a8847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255c288051e48e08d94ede2bd6ba558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:03:18.076857 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-450a3daa-6e37-44d2-b958-29cd99f69ff9 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] 10.222.0.43 "GET /compute/v2.1/servers/83924572-5b93-4971-a5c0-fefaa87464c1" status: 200 len: 1566 microversion: 2.1 time: 0.169696 Oct 04 20:03:18.077503 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3760/7894] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 20:03:17 2022] GET /compute/v2.1/servers/83924572-5b93-4971-a5c0-fefaa87464c1 => generated 1566 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:03:19.100207 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-8127b561-6d7a-4f9a-bb74-69b87d66d548 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:03:19.100831 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-8127b561-6d7a-4f9a-bb74-69b87d66d548 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] [instance: 83924572-5b93-4971-a5c0-fefaa87464c1] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:03:19.107718 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8127b561-6d7a-4f9a-bb74-69b87d66d548 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:03:19.108215 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8127b561-6d7a-4f9a-bb74-69b87d66d548 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:03:19.108668 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8127b561-6d7a-4f9a-bb74-69b87d66d548 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:03:19.109417 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8127b561-6d7a-4f9a-bb74-69b87d66d548 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:03:19.109887 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8127b561-6d7a-4f9a-bb74-69b87d66d548 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:03:19.110326 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8127b561-6d7a-4f9a-bb74-69b87d66d548 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:03:19.254067 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-8127b561-6d7a-4f9a-bb74-69b87d66d548 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cd9718357e4655b245403d0f7a8847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255c288051e48e08d94ede2bd6ba558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:03:19.262247 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-8127b561-6d7a-4f9a-bb74-69b87d66d548 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] 10.222.0.43 "GET /compute/v2.1/servers/83924572-5b93-4971-a5c0-fefaa87464c1" status: 200 len: 1566 microversion: 2.1 time: 0.165849 Oct 04 20:03:19.262876 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 4135/7895] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 20:03:19 2022] GET /compute/v2.1/servers/83924572-5b93-4971-a5c0-fefaa87464c1 => generated 1566 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:03:20.285519 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-50b73bb9-05c3-42b3-b674-4f23b80475ad tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:03:20.286139 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-50b73bb9-05c3-42b3-b674-4f23b80475ad tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] [instance: 83924572-5b93-4971-a5c0-fefaa87464c1] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:03:20.294263 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-50b73bb9-05c3-42b3-b674-4f23b80475ad tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:03:20.294759 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-50b73bb9-05c3-42b3-b674-4f23b80475ad tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:03:20.295205 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-50b73bb9-05c3-42b3-b674-4f23b80475ad tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:03:20.295955 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-50b73bb9-05c3-42b3-b674-4f23b80475ad tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:03:20.296418 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-50b73bb9-05c3-42b3-b674-4f23b80475ad tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:03:20.296856 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-50b73bb9-05c3-42b3-b674-4f23b80475ad tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:03:20.439130 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-50b73bb9-05c3-42b3-b674-4f23b80475ad tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cd9718357e4655b245403d0f7a8847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255c288051e48e08d94ede2bd6ba558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:03:20.447134 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-50b73bb9-05c3-42b3-b674-4f23b80475ad tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] 10.222.0.43 "GET /compute/v2.1/servers/83924572-5b93-4971-a5c0-fefaa87464c1" status: 200 len: 1566 microversion: 2.1 time: 0.165649 Oct 04 20:03:20.447716 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3761/7896] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 20:03:20 2022] GET /compute/v2.1/servers/83924572-5b93-4971-a5c0-fefaa87464c1 => generated 1566 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:03:21.471678 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-4e62e5b0-4d52-43e3-9dfa-41d2b707b911 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:03:21.472360 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-4e62e5b0-4d52-43e3-9dfa-41d2b707b911 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] [instance: 83924572-5b93-4971-a5c0-fefaa87464c1] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:03:21.479465 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4e62e5b0-4d52-43e3-9dfa-41d2b707b911 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:03:21.479976 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4e62e5b0-4d52-43e3-9dfa-41d2b707b911 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:03:21.480433 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4e62e5b0-4d52-43e3-9dfa-41d2b707b911 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:03:21.481182 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4e62e5b0-4d52-43e3-9dfa-41d2b707b911 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:03:21.481658 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4e62e5b0-4d52-43e3-9dfa-41d2b707b911 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:03:21.482104 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-4e62e5b0-4d52-43e3-9dfa-41d2b707b911 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:03:21.620930 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-4e62e5b0-4d52-43e3-9dfa-41d2b707b911 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cd9718357e4655b245403d0f7a8847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255c288051e48e08d94ede2bd6ba558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:03:21.629099 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-4e62e5b0-4d52-43e3-9dfa-41d2b707b911 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] 10.222.0.43 "GET /compute/v2.1/servers/83924572-5b93-4971-a5c0-fefaa87464c1" status: 200 len: 1566 microversion: 2.1 time: 0.161847 Oct 04 20:03:21.629718 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 4136/7897] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 20:03:21 2022] GET /compute/v2.1/servers/83924572-5b93-4971-a5c0-fefaa87464c1 => generated 1566 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:03:22.653351 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-19fb31b1-b6f4-4d16-9ca7-e64c19dfd0e3 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:03:22.654006 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-19fb31b1-b6f4-4d16-9ca7-e64c19dfd0e3 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] [instance: 83924572-5b93-4971-a5c0-fefaa87464c1] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:03:22.661842 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-19fb31b1-b6f4-4d16-9ca7-e64c19dfd0e3 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:03:22.662344 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-19fb31b1-b6f4-4d16-9ca7-e64c19dfd0e3 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:03:22.662791 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-19fb31b1-b6f4-4d16-9ca7-e64c19dfd0e3 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:03:22.663507 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-19fb31b1-b6f4-4d16-9ca7-e64c19dfd0e3 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:03:22.663970 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-19fb31b1-b6f4-4d16-9ca7-e64c19dfd0e3 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:03:22.664413 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-19fb31b1-b6f4-4d16-9ca7-e64c19dfd0e3 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:03:22.801052 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-19fb31b1-b6f4-4d16-9ca7-e64c19dfd0e3 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cd9718357e4655b245403d0f7a8847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255c288051e48e08d94ede2bd6ba558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:03:22.809060 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-19fb31b1-b6f4-4d16-9ca7-e64c19dfd0e3 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] 10.222.0.43 "GET /compute/v2.1/servers/83924572-5b93-4971-a5c0-fefaa87464c1" status: 200 len: 1566 microversion: 2.1 time: 0.159753 Oct 04 20:03:22.809670 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3762/7898] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 20:03:22 2022] GET /compute/v2.1/servers/83924572-5b93-4971-a5c0-fefaa87464c1 => generated 1566 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:03:23.832554 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-d52e5a17-ef37-4dff-b59f-c3d9a36b579e tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:03:23.833305 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-d52e5a17-ef37-4dff-b59f-c3d9a36b579e tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] [instance: 83924572-5b93-4971-a5c0-fefaa87464c1] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:03:23.840539 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d52e5a17-ef37-4dff-b59f-c3d9a36b579e tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:03:23.841045 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d52e5a17-ef37-4dff-b59f-c3d9a36b579e tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:03:23.841523 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d52e5a17-ef37-4dff-b59f-c3d9a36b579e tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:03:23.842245 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d52e5a17-ef37-4dff-b59f-c3d9a36b579e tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:03:23.842708 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d52e5a17-ef37-4dff-b59f-c3d9a36b579e tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:03:23.843146 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d52e5a17-ef37-4dff-b59f-c3d9a36b579e tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:03:23.989304 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-d52e5a17-ef37-4dff-b59f-c3d9a36b579e tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cd9718357e4655b245403d0f7a8847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255c288051e48e08d94ede2bd6ba558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:03:23.997440 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-d52e5a17-ef37-4dff-b59f-c3d9a36b579e tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] 10.222.0.43 "GET /compute/v2.1/servers/83924572-5b93-4971-a5c0-fefaa87464c1" status: 200 len: 1566 microversion: 2.1 time: 0.168881 Oct 04 20:03:23.998032 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 4137/7899] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 20:03:23 2022] GET /compute/v2.1/servers/83924572-5b93-4971-a5c0-fefaa87464c1 => generated 1566 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:03:25.022487 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-faf75151-64b2-4b67-8567-b8373c2964ba tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:03:25.023107 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-faf75151-64b2-4b67-8567-b8373c2964ba tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] [instance: 83924572-5b93-4971-a5c0-fefaa87464c1] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:03:25.030232 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-faf75151-64b2-4b67-8567-b8373c2964ba tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:03:25.030727 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-faf75151-64b2-4b67-8567-b8373c2964ba tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:03:25.031174 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-faf75151-64b2-4b67-8567-b8373c2964ba tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:03:25.031890 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-faf75151-64b2-4b67-8567-b8373c2964ba tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:03:25.032353 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-faf75151-64b2-4b67-8567-b8373c2964ba tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:03:25.032791 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-faf75151-64b2-4b67-8567-b8373c2964ba tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:03:25.172504 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-faf75151-64b2-4b67-8567-b8373c2964ba tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cd9718357e4655b245403d0f7a8847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255c288051e48e08d94ede2bd6ba558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:03:25.180506 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-faf75151-64b2-4b67-8567-b8373c2964ba tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] 10.222.0.43 "GET /compute/v2.1/servers/83924572-5b93-4971-a5c0-fefaa87464c1" status: 200 len: 1566 microversion: 2.1 time: 0.161975 Oct 04 20:03:25.181098 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3763/7900] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 20:03:25 2022] GET /compute/v2.1/servers/83924572-5b93-4971-a5c0-fefaa87464c1 => generated 1566 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:03:26.204611 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-16fbec35-3738-4be5-b022-24d1cab06b76 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:03:26.205829 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-16fbec35-3738-4be5-b022-24d1cab06b76 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] [instance: 83924572-5b93-4971-a5c0-fefaa87464c1] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:03:26.213285 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-16fbec35-3738-4be5-b022-24d1cab06b76 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:03:26.213818 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-16fbec35-3738-4be5-b022-24d1cab06b76 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:03:26.214289 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-16fbec35-3738-4be5-b022-24d1cab06b76 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:03:26.215021 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-16fbec35-3738-4be5-b022-24d1cab06b76 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:03:26.215499 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-16fbec35-3738-4be5-b022-24d1cab06b76 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:03:26.215954 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-16fbec35-3738-4be5-b022-24d1cab06b76 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:03:26.358380 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-16fbec35-3738-4be5-b022-24d1cab06b76 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cd9718357e4655b245403d0f7a8847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255c288051e48e08d94ede2bd6ba558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:03:26.366645 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-16fbec35-3738-4be5-b022-24d1cab06b76 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] 10.222.0.43 "GET /compute/v2.1/servers/83924572-5b93-4971-a5c0-fefaa87464c1" status: 200 len: 1566 microversion: 2.1 time: 0.166398 Oct 04 20:03:26.367242 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 4138/7901] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 20:03:26 2022] GET /compute/v2.1/servers/83924572-5b93-4971-a5c0-fefaa87464c1 => generated 1566 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:03:27.390403 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-612603ac-c66e-475e-aee9-bdf152adb8f8 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:03:27.391013 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-612603ac-c66e-475e-aee9-bdf152adb8f8 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] [instance: 83924572-5b93-4971-a5c0-fefaa87464c1] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:03:27.398006 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-612603ac-c66e-475e-aee9-bdf152adb8f8 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:03:27.398499 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-612603ac-c66e-475e-aee9-bdf152adb8f8 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:03:27.398946 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-612603ac-c66e-475e-aee9-bdf152adb8f8 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:03:27.399653 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-612603ac-c66e-475e-aee9-bdf152adb8f8 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:03:27.400111 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-612603ac-c66e-475e-aee9-bdf152adb8f8 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:03:27.400546 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-612603ac-c66e-475e-aee9-bdf152adb8f8 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:03:27.537451 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-612603ac-c66e-475e-aee9-bdf152adb8f8 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cd9718357e4655b245403d0f7a8847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255c288051e48e08d94ede2bd6ba558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:03:27.545607 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-612603ac-c66e-475e-aee9-bdf152adb8f8 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] 10.222.0.43 "GET /compute/v2.1/servers/83924572-5b93-4971-a5c0-fefaa87464c1" status: 200 len: 1567 microversion: 2.1 time: 0.159029 Oct 04 20:03:27.546200 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3764/7902] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 20:03:27 2022] GET /compute/v2.1/servers/83924572-5b93-4971-a5c0-fefaa87464c1 => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:03:27.569088 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-5612a8f7-8356-405b-80c3-50bb6ecbc0a3 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:03:27.569746 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-5612a8f7-8356-405b-80c3-50bb6ecbc0a3 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] [instance: 83924572-5b93-4971-a5c0-fefaa87464c1] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:03:27.577311 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5612a8f7-8356-405b-80c3-50bb6ecbc0a3 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:03:27.577828 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5612a8f7-8356-405b-80c3-50bb6ecbc0a3 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:03:27.578324 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5612a8f7-8356-405b-80c3-50bb6ecbc0a3 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:03:27.579061 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5612a8f7-8356-405b-80c3-50bb6ecbc0a3 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:03:27.579539 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5612a8f7-8356-405b-80c3-50bb6ecbc0a3 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:03:27.580494 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5612a8f7-8356-405b-80c3-50bb6ecbc0a3 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:03:27.616842 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-5612a8f7-8356-405b-80c3-50bb6ecbc0a3 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] [instance: 83924572-5b93-4971-a5c0-fefaa87464c1] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=123596) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 04 20:03:27.688401 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-5612a8f7-8356-405b-80c3-50bb6ecbc0a3 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] 10.222.0.43 "POST /compute/v2.1/servers/83924572-5b93-4971-a5c0-fefaa87464c1/action" status: 202 len: 0 microversion: 2.1 time: 0.123282 Oct 04 20:03:27.689368 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 4139/7903] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 20:03:27 2022] POST /compute/v2.1/servers/83924572-5b93-4971-a5c0-fefaa87464c1/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:03:27.697179 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-80ec9bf6-2d59-4cc6-81ee-27465cbb3b32 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:03:27.697916 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-80ec9bf6-2d59-4cc6-81ee-27465cbb3b32 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] [instance: 83924572-5b93-4971-a5c0-fefaa87464c1] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:03:27.705676 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-80ec9bf6-2d59-4cc6-81ee-27465cbb3b32 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:03:27.706167 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-80ec9bf6-2d59-4cc6-81ee-27465cbb3b32 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:03:27.706734 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-80ec9bf6-2d59-4cc6-81ee-27465cbb3b32 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:03:27.707314 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-80ec9bf6-2d59-4cc6-81ee-27465cbb3b32 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:03:27.707768 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-80ec9bf6-2d59-4cc6-81ee-27465cbb3b32 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:03:27.708193 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-80ec9bf6-2d59-4cc6-81ee-27465cbb3b32 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:03:27.900411 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-80ec9bf6-2d59-4cc6-81ee-27465cbb3b32 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cd9718357e4655b245403d0f7a8847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255c288051e48e08d94ede2bd6ba558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:03:27.909058 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-80ec9bf6-2d59-4cc6-81ee-27465cbb3b32 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] 10.222.0.43 "GET /compute/v2.1/servers/83924572-5b93-4971-a5c0-fefaa87464c1" status: 200 len: 1515 microversion: 2.1 time: 0.215746 Oct 04 20:03:27.909700 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3765/7904] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 20:03:27 2022] GET /compute/v2.1/servers/83924572-5b93-4971-a5c0-fefaa87464c1 => generated 1515 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:03:28.932801 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-97d459e2-0c9e-4a84-bc64-5f76b62b4232 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:03:28.933461 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-97d459e2-0c9e-4a84-bc64-5f76b62b4232 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] [instance: 83924572-5b93-4971-a5c0-fefaa87464c1] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:03:28.939644 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-97d459e2-0c9e-4a84-bc64-5f76b62b4232 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:03:28.940147 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-97d459e2-0c9e-4a84-bc64-5f76b62b4232 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:03:28.940600 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-97d459e2-0c9e-4a84-bc64-5f76b62b4232 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:03:28.941350 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-97d459e2-0c9e-4a84-bc64-5f76b62b4232 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:03:28.941815 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-97d459e2-0c9e-4a84-bc64-5f76b62b4232 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:03:28.942255 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-97d459e2-0c9e-4a84-bc64-5f76b62b4232 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:03:29.087573 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-97d459e2-0c9e-4a84-bc64-5f76b62b4232 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cd9718357e4655b245403d0f7a8847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255c288051e48e08d94ede2bd6ba558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:03:29.096669 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-97d459e2-0c9e-4a84-bc64-5f76b62b4232 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] 10.222.0.43 "GET /compute/v2.1/servers/83924572-5b93-4971-a5c0-fefaa87464c1" status: 200 len: 1517 microversion: 2.1 time: 0.168595 Oct 04 20:03:29.097293 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 4140/7905] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 20:03:28 2022] GET /compute/v2.1/servers/83924572-5b93-4971-a5c0-fefaa87464c1 => generated 1517 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:03:30.120407 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-0609bca8-dcf7-40b0-834d-ee3d6fc5b2a9 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:03:30.121434 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-0609bca8-dcf7-40b0-834d-ee3d6fc5b2a9 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] [instance: 83924572-5b93-4971-a5c0-fefaa87464c1] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:03:30.128873 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0609bca8-dcf7-40b0-834d-ee3d6fc5b2a9 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:03:30.129491 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0609bca8-dcf7-40b0-834d-ee3d6fc5b2a9 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:03:30.130017 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0609bca8-dcf7-40b0-834d-ee3d6fc5b2a9 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:03:30.130817 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0609bca8-dcf7-40b0-834d-ee3d6fc5b2a9 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:03:30.131491 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0609bca8-dcf7-40b0-834d-ee3d6fc5b2a9 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:03:30.132101 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-0609bca8-dcf7-40b0-834d-ee3d6fc5b2a9 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:03:30.183115 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-2b2e85bb-0f95-4395-b3e7-b173671fe8a2 req-b6678db6-762c-4769-bb75-9707463229ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83924572-5b93-4971-a5c0-fefaa87464c1", "name": "network-vif-unplugged", "status": "completed", "tag": "a35e5860-3275-4c95-a30a-e8ab1a881fb6"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:03:30.209454 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-2b2e85bb-0f95-4395-b3e7-b173671fe8a2 req-b6678db6-762c-4769-bb75-9707463229ad service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:03:30.209961 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-2b2e85bb-0f95-4395-b3e7-b173671fe8a2 req-b6678db6-762c-4769-bb75-9707463229ad service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:03:30.210419 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-2b2e85bb-0f95-4395-b3e7-b173671fe8a2 req-b6678db6-762c-4769-bb75-9707463229ad service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:03:30.232178 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.compute.server_external_events [req-2b2e85bb-0f95-4395-b3e7-b173671fe8a2 req-b6678db6-762c-4769-bb75-9707463229ad service nova] Unable to find a host for instance 83924572-5b93-4971-a5c0-fefaa87464c1. Dropping event network-vif-unplugged {{(pid=123596) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 04 20:03:30.233442 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-2b2e85bb-0f95-4395-b3e7-b173671fe8a2 req-b6678db6-762c-4769-bb75-9707463229ad service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.055551 Oct 04 20:03:30.234565 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 4141/7906] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 20:03:30 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 57 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Oct 04 20:03:30.308863 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-0609bca8-dcf7-40b0-834d-ee3d6fc5b2a9 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cd9718357e4655b245403d0f7a8847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255c288051e48e08d94ede2bd6ba558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:03:30.323077 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-0609bca8-dcf7-40b0-834d-ee3d6fc5b2a9 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] 10.222.0.43 "GET /compute/v2.1/servers/83924572-5b93-4971-a5c0-fefaa87464c1" status: 200 len: 1517 microversion: 2.1 time: 0.206219 Oct 04 20:03:30.324108 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3766/7907] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 20:03:30 2022] GET /compute/v2.1/servers/83924572-5b93-4971-a5c0-fefaa87464c1 => generated 1517 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:03:31.348049 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-e0f56c2e-fea8-43b1-b1bb-ac5803daa99b tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:03:31.348919 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-e0f56c2e-fea8-43b1-b1bb-ac5803daa99b tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] [instance: 83924572-5b93-4971-a5c0-fefaa87464c1] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:03:31.357345 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e0f56c2e-fea8-43b1-b1bb-ac5803daa99b tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:03:31.357860 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e0f56c2e-fea8-43b1-b1bb-ac5803daa99b tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:03:31.358323 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e0f56c2e-fea8-43b1-b1bb-ac5803daa99b tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:03:31.359063 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e0f56c2e-fea8-43b1-b1bb-ac5803daa99b tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:03:31.359538 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e0f56c2e-fea8-43b1-b1bb-ac5803daa99b tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:03:31.360029 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e0f56c2e-fea8-43b1-b1bb-ac5803daa99b tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:03:31.509707 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-e0f56c2e-fea8-43b1-b1bb-ac5803daa99b tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cd9718357e4655b245403d0f7a8847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255c288051e48e08d94ede2bd6ba558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:03:31.518851 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-e0f56c2e-fea8-43b1-b1bb-ac5803daa99b tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] 10.222.0.43 "GET /compute/v2.1/servers/83924572-5b93-4971-a5c0-fefaa87464c1" status: 200 len: 1517 microversion: 2.1 time: 0.174864 Oct 04 20:03:31.519484 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 4142/7908] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 20:03:31 2022] GET /compute/v2.1/servers/83924572-5b93-4971-a5c0-fefaa87464c1 => generated 1517 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:03:32.542684 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-e9642b5a-c62a-4759-a18c-a3657996a019 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:03:32.543240 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-e9642b5a-c62a-4759-a18c-a3657996a019 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] [instance: 83924572-5b93-4971-a5c0-fefaa87464c1] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:03:32.550312 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e9642b5a-c62a-4759-a18c-a3657996a019 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:03:32.550794 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e9642b5a-c62a-4759-a18c-a3657996a019 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:03:32.551238 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e9642b5a-c62a-4759-a18c-a3657996a019 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:03:32.551953 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e9642b5a-c62a-4759-a18c-a3657996a019 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:03:32.552402 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e9642b5a-c62a-4759-a18c-a3657996a019 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:03:32.552826 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-e9642b5a-c62a-4759-a18c-a3657996a019 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:03:32.696942 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-e9642b5a-c62a-4759-a18c-a3657996a019 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cd9718357e4655b245403d0f7a8847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255c288051e48e08d94ede2bd6ba558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:03:32.706169 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-e9642b5a-c62a-4759-a18c-a3657996a019 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] 10.222.0.43 "GET /compute/v2.1/servers/83924572-5b93-4971-a5c0-fefaa87464c1" status: 200 len: 1517 microversion: 2.1 time: 0.167462 Oct 04 20:03:32.706774 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3767/7909] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 20:03:32 2022] GET /compute/v2.1/servers/83924572-5b93-4971-a5c0-fefaa87464c1 => generated 1517 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:03:33.729651 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-76f3a8b9-33f3-40c1-864f-5b705643f56b tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:03:33.730304 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-76f3a8b9-33f3-40c1-864f-5b705643f56b tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] [instance: 83924572-5b93-4971-a5c0-fefaa87464c1] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:03:33.738723 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-76f3a8b9-33f3-40c1-864f-5b705643f56b tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:03:33.739871 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-76f3a8b9-33f3-40c1-864f-5b705643f56b tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:03:33.740357 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-76f3a8b9-33f3-40c1-864f-5b705643f56b tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:03:33.741133 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-76f3a8b9-33f3-40c1-864f-5b705643f56b tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:03:33.741641 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-76f3a8b9-33f3-40c1-864f-5b705643f56b tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:03:33.742098 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-76f3a8b9-33f3-40c1-864f-5b705643f56b tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:03:33.878959 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-76f3a8b9-33f3-40c1-864f-5b705643f56b tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cd9718357e4655b245403d0f7a8847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255c288051e48e08d94ede2bd6ba558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:03:33.887135 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-76f3a8b9-33f3-40c1-864f-5b705643f56b tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] 10.222.0.43 "GET /compute/v2.1/servers/83924572-5b93-4971-a5c0-fefaa87464c1" status: 200 len: 1573 microversion: 2.1 time: 0.161434 Oct 04 20:03:33.887732 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 4143/7910] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 20:03:33 2022] GET /compute/v2.1/servers/83924572-5b93-4971-a5c0-fefaa87464c1 => generated 1573 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:03:34.910739 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-51b9f949-4b80-4ef1-9c90-11ba081ba692 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:03:34.911294 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-51b9f949-4b80-4ef1-9c90-11ba081ba692 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] [instance: 83924572-5b93-4971-a5c0-fefaa87464c1] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:03:34.918419 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-51b9f949-4b80-4ef1-9c90-11ba081ba692 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:03:34.918914 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-51b9f949-4b80-4ef1-9c90-11ba081ba692 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:03:34.919364 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-51b9f949-4b80-4ef1-9c90-11ba081ba692 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:03:34.920190 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-51b9f949-4b80-4ef1-9c90-11ba081ba692 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:03:34.920656 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-51b9f949-4b80-4ef1-9c90-11ba081ba692 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:03:34.921093 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-51b9f949-4b80-4ef1-9c90-11ba081ba692 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:03:35.063822 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-51b9f949-4b80-4ef1-9c90-11ba081ba692 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cd9718357e4655b245403d0f7a8847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255c288051e48e08d94ede2bd6ba558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:03:35.072565 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-51b9f949-4b80-4ef1-9c90-11ba081ba692 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] 10.222.0.43 "GET /compute/v2.1/servers/83924572-5b93-4971-a5c0-fefaa87464c1" status: 200 len: 1573 microversion: 2.1 time: 0.165825 Oct 04 20:03:35.073176 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3768/7911] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 20:03:34 2022] GET /compute/v2.1/servers/83924572-5b93-4971-a5c0-fefaa87464c1 => generated 1573 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:03:36.096735 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-b151a9db-7fc2-4919-b392-8d7e4497dcfb tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:03:36.097393 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-b151a9db-7fc2-4919-b392-8d7e4497dcfb tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] [instance: 83924572-5b93-4971-a5c0-fefaa87464c1] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:03:36.103621 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b151a9db-7fc2-4919-b392-8d7e4497dcfb tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:03:36.104132 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b151a9db-7fc2-4919-b392-8d7e4497dcfb tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:03:36.104658 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b151a9db-7fc2-4919-b392-8d7e4497dcfb tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:03:36.105355 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b151a9db-7fc2-4919-b392-8d7e4497dcfb tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:03:36.105832 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b151a9db-7fc2-4919-b392-8d7e4497dcfb tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:03:36.106286 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b151a9db-7fc2-4919-b392-8d7e4497dcfb tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:03:36.248732 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-b151a9db-7fc2-4919-b392-8d7e4497dcfb tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cd9718357e4655b245403d0f7a8847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255c288051e48e08d94ede2bd6ba558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:03:36.256837 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-b151a9db-7fc2-4919-b392-8d7e4497dcfb tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] 10.222.0.43 "GET /compute/v2.1/servers/83924572-5b93-4971-a5c0-fefaa87464c1" status: 200 len: 1573 microversion: 2.1 time: 0.164773 Oct 04 20:03:36.257465 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 4144/7912] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 20:03:36 2022] GET /compute/v2.1/servers/83924572-5b93-4971-a5c0-fefaa87464c1 => generated 1573 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:03:37.280006 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-d3e83470-7220-45d8-91c3-e9dff01fae94 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:03:37.280622 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-d3e83470-7220-45d8-91c3-e9dff01fae94 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] [instance: 83924572-5b93-4971-a5c0-fefaa87464c1] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:03:37.287595 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d3e83470-7220-45d8-91c3-e9dff01fae94 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:03:37.288089 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d3e83470-7220-45d8-91c3-e9dff01fae94 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:03:37.288534 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d3e83470-7220-45d8-91c3-e9dff01fae94 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:03:37.291037 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d3e83470-7220-45d8-91c3-e9dff01fae94 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:03:37.291037 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d3e83470-7220-45d8-91c3-e9dff01fae94 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:03:37.291037 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d3e83470-7220-45d8-91c3-e9dff01fae94 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:03:37.434622 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-d3e83470-7220-45d8-91c3-e9dff01fae94 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cd9718357e4655b245403d0f7a8847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255c288051e48e08d94ede2bd6ba558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:03:37.443313 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-d3e83470-7220-45d8-91c3-e9dff01fae94 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] 10.222.0.43 "GET /compute/v2.1/servers/83924572-5b93-4971-a5c0-fefaa87464c1" status: 200 len: 1573 microversion: 2.1 time: 0.167246 Oct 04 20:03:37.443911 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3769/7913] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 20:03:37 2022] GET /compute/v2.1/servers/83924572-5b93-4971-a5c0-fefaa87464c1 => generated 1573 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:03:38.466895 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-a2c2ba8f-8e85-4bb4-8536-8c44b4c10fd5 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:03:38.467574 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-a2c2ba8f-8e85-4bb4-8536-8c44b4c10fd5 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] [instance: 83924572-5b93-4971-a5c0-fefaa87464c1] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:03:38.475446 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a2c2ba8f-8e85-4bb4-8536-8c44b4c10fd5 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:03:38.475963 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a2c2ba8f-8e85-4bb4-8536-8c44b4c10fd5 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:03:38.476425 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a2c2ba8f-8e85-4bb4-8536-8c44b4c10fd5 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:03:38.477204 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a2c2ba8f-8e85-4bb4-8536-8c44b4c10fd5 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:03:38.477687 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a2c2ba8f-8e85-4bb4-8536-8c44b4c10fd5 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:03:38.478137 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a2c2ba8f-8e85-4bb4-8536-8c44b4c10fd5 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:03:38.612119 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-a2c2ba8f-8e85-4bb4-8536-8c44b4c10fd5 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cd9718357e4655b245403d0f7a8847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255c288051e48e08d94ede2bd6ba558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:03:38.620281 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-a2c2ba8f-8e85-4bb4-8536-8c44b4c10fd5 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] 10.222.0.43 "GET /compute/v2.1/servers/83924572-5b93-4971-a5c0-fefaa87464c1" status: 200 len: 1573 microversion: 2.1 time: 0.157656 Oct 04 20:03:38.620912 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 4145/7914] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 20:03:38 2022] GET /compute/v2.1/servers/83924572-5b93-4971-a5c0-fefaa87464c1 => generated 1573 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:03:39.644605 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-b520f171-b53c-4491-8e84-bc08378c69fc tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:03:39.645283 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-b520f171-b53c-4491-8e84-bc08378c69fc tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] [instance: 83924572-5b93-4971-a5c0-fefaa87464c1] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:03:39.652494 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b520f171-b53c-4491-8e84-bc08378c69fc tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:03:39.652981 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b520f171-b53c-4491-8e84-bc08378c69fc tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:03:39.653449 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b520f171-b53c-4491-8e84-bc08378c69fc tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:03:39.654158 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b520f171-b53c-4491-8e84-bc08378c69fc tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:03:39.654617 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b520f171-b53c-4491-8e84-bc08378c69fc tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:03:39.655041 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b520f171-b53c-4491-8e84-bc08378c69fc tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:03:39.792560 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-b520f171-b53c-4491-8e84-bc08378c69fc tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cd9718357e4655b245403d0f7a8847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255c288051e48e08d94ede2bd6ba558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:03:39.800594 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-b520f171-b53c-4491-8e84-bc08378c69fc tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] 10.222.0.43 "GET /compute/v2.1/servers/83924572-5b93-4971-a5c0-fefaa87464c1" status: 200 len: 1573 microversion: 2.1 time: 0.160425 Oct 04 20:03:39.801205 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3770/7915] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 20:03:39 2022] GET /compute/v2.1/servers/83924572-5b93-4971-a5c0-fefaa87464c1 => generated 1573 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:03:40.824509 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-a7cfd32a-0433-4c27-9943-e9b8d0e6bef0 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:03:40.825154 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-a7cfd32a-0433-4c27-9943-e9b8d0e6bef0 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] [instance: 83924572-5b93-4971-a5c0-fefaa87464c1] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:03:40.832448 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a7cfd32a-0433-4c27-9943-e9b8d0e6bef0 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:03:40.832950 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a7cfd32a-0433-4c27-9943-e9b8d0e6bef0 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:03:40.833426 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a7cfd32a-0433-4c27-9943-e9b8d0e6bef0 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:03:40.834188 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a7cfd32a-0433-4c27-9943-e9b8d0e6bef0 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:03:40.834631 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a7cfd32a-0433-4c27-9943-e9b8d0e6bef0 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:03:40.835069 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a7cfd32a-0433-4c27-9943-e9b8d0e6bef0 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:03:40.839453 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:03:40.977607 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-a7cfd32a-0433-4c27-9943-e9b8d0e6bef0 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cd9718357e4655b245403d0f7a8847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255c288051e48e08d94ede2bd6ba558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:03:40.985871 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-a7cfd32a-0433-4c27-9943-e9b8d0e6bef0 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] 10.222.0.43 "GET /compute/v2.1/servers/83924572-5b93-4971-a5c0-fefaa87464c1" status: 200 len: 1573 microversion: 2.1 time: 0.165255 Oct 04 20:03:40.986466 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 4146/7916] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 20:03:40 2022] GET /compute/v2.1/servers/83924572-5b93-4971-a5c0-fefaa87464c1 => generated 1573 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:03:42.009123 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-b7b9070c-4249-4991-a110-62df1f62ef1d tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:03:42.009752 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-b7b9070c-4249-4991-a110-62df1f62ef1d tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] [instance: 83924572-5b93-4971-a5c0-fefaa87464c1] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:03:42.016645 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b7b9070c-4249-4991-a110-62df1f62ef1d tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:03:42.017153 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b7b9070c-4249-4991-a110-62df1f62ef1d tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:03:42.017595 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b7b9070c-4249-4991-a110-62df1f62ef1d tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:03:42.018793 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b7b9070c-4249-4991-a110-62df1f62ef1d tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:03:42.019247 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b7b9070c-4249-4991-a110-62df1f62ef1d tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:03:42.019674 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b7b9070c-4249-4991-a110-62df1f62ef1d tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:03:42.167717 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-b7b9070c-4249-4991-a110-62df1f62ef1d tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cd9718357e4655b245403d0f7a8847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255c288051e48e08d94ede2bd6ba558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:03:42.175896 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-b7b9070c-4249-4991-a110-62df1f62ef1d tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] 10.222.0.43 "GET /compute/v2.1/servers/83924572-5b93-4971-a5c0-fefaa87464c1" status: 200 len: 1573 microversion: 2.1 time: 0.170638 Oct 04 20:03:42.176975 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3771/7917] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 20:03:42 2022] GET /compute/v2.1/servers/83924572-5b93-4971-a5c0-fefaa87464c1 => generated 1573 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:03:43.199539 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-7643e169-04fb-4662-b523-1c483dfa1c32 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:03:43.200172 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-7643e169-04fb-4662-b523-1c483dfa1c32 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] [instance: 83924572-5b93-4971-a5c0-fefaa87464c1] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:03:43.203185 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:03:43.209320 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7643e169-04fb-4662-b523-1c483dfa1c32 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:03:43.209829 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7643e169-04fb-4662-b523-1c483dfa1c32 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:03:43.210283 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7643e169-04fb-4662-b523-1c483dfa1c32 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:03:43.211009 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7643e169-04fb-4662-b523-1c483dfa1c32 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:03:43.211480 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7643e169-04fb-4662-b523-1c483dfa1c32 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:03:43.211926 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-7643e169-04fb-4662-b523-1c483dfa1c32 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:03:43.353155 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-7643e169-04fb-4662-b523-1c483dfa1c32 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cd9718357e4655b245403d0f7a8847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255c288051e48e08d94ede2bd6ba558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:03:43.361631 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-7643e169-04fb-4662-b523-1c483dfa1c32 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] 10.222.0.43 "GET /compute/v2.1/servers/83924572-5b93-4971-a5c0-fefaa87464c1" status: 200 len: 1573 microversion: 2.1 time: 0.165908 Oct 04 20:03:43.371401 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 4147/7918] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 20:03:43 2022] GET /compute/v2.1/servers/83924572-5b93-4971-a5c0-fefaa87464c1 => generated 1573 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:03:44.274976 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-38402bd9-4d35-41e4-a4af-ee1c3b57c9d0 req-1c691a95-aece-43e8-a0ed-53eb3700413e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83924572-5b93-4971-a5c0-fefaa87464c1", "name": "network-vif-plugged", "status": "completed", "tag": "a35e5860-3275-4c95-a30a-e8ab1a881fb6"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:03:44.281454 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_api:SELECT=29 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:03:44.288588 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-38402bd9-4d35-41e4-a4af-ee1c3b57c9d0 req-1c691a95-aece-43e8-a0ed-53eb3700413e service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:03:44.289080 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-38402bd9-4d35-41e4-a4af-ee1c3b57c9d0 req-1c691a95-aece-43e8-a0ed-53eb3700413e service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:03:44.289552 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-38402bd9-4d35-41e4-a4af-ee1c3b57c9d0 req-1c691a95-aece-43e8-a0ed-53eb3700413e service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:03:44.292738 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=85 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:03:44.307033 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-38402bd9-4d35-41e4-a4af-ee1c3b57c9d0 req-1c691a95-aece-43e8-a0ed-53eb3700413e service nova] Creating event network-vif-plugged:a35e5860-3275-4c95-a30a-e8ab1a881fb6 for instance 83924572-5b93-4971-a5c0-fefaa87464c1 on n-h1-851028-13 Oct 04 20:03:44.313200 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-38402bd9-4d35-41e4-a4af-ee1c3b57c9d0 req-1c691a95-aece-43e8-a0ed-53eb3700413e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041893 Oct 04 20:03:44.313845 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3772/7919] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 20:03:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:03:44.392629 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-b36c2e6c-718e-4e92-96f2-1257159e68e9 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:03:44.394335 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-b36c2e6c-718e-4e92-96f2-1257159e68e9 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] [instance: 83924572-5b93-4971-a5c0-fefaa87464c1] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:03:44.401888 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b36c2e6c-718e-4e92-96f2-1257159e68e9 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:03:44.402401 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b36c2e6c-718e-4e92-96f2-1257159e68e9 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:03:44.403076 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b36c2e6c-718e-4e92-96f2-1257159e68e9 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:03:44.404033 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b36c2e6c-718e-4e92-96f2-1257159e68e9 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:03:44.404701 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b36c2e6c-718e-4e92-96f2-1257159e68e9 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:03:44.405192 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b36c2e6c-718e-4e92-96f2-1257159e68e9 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:03:44.567780 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-b36c2e6c-718e-4e92-96f2-1257159e68e9 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cd9718357e4655b245403d0f7a8847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255c288051e48e08d94ede2bd6ba558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:03:44.576151 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-b36c2e6c-718e-4e92-96f2-1257159e68e9 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] 10.222.0.43 "GET /compute/v2.1/servers/83924572-5b93-4971-a5c0-fefaa87464c1" status: 200 len: 1573 microversion: 2.1 time: 0.188996 Oct 04 20:03:44.576749 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 4148/7920] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 20:03:44 2022] GET /compute/v2.1/servers/83924572-5b93-4971-a5c0-fefaa87464c1 => generated 1573 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:03:45.602306 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-818b55f2-a32a-4f3b-8fae-8040100bad71 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:03:45.603011 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-818b55f2-a32a-4f3b-8fae-8040100bad71 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] [instance: 83924572-5b93-4971-a5c0-fefaa87464c1] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:03:45.609446 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-818b55f2-a32a-4f3b-8fae-8040100bad71 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:03:45.609935 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-818b55f2-a32a-4f3b-8fae-8040100bad71 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:03:45.610373 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-818b55f2-a32a-4f3b-8fae-8040100bad71 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:03:45.611073 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-818b55f2-a32a-4f3b-8fae-8040100bad71 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:03:45.611562 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-818b55f2-a32a-4f3b-8fae-8040100bad71 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:03:45.611987 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-818b55f2-a32a-4f3b-8fae-8040100bad71 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:03:45.748851 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-818b55f2-a32a-4f3b-8fae-8040100bad71 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cd9718357e4655b245403d0f7a8847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255c288051e48e08d94ede2bd6ba558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:03:45.756933 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-818b55f2-a32a-4f3b-8fae-8040100bad71 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] 10.222.0.43 "GET /compute/v2.1/servers/83924572-5b93-4971-a5c0-fefaa87464c1" status: 200 len: 1560 microversion: 2.1 time: 0.160006 Oct 04 20:03:45.757560 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3773/7921] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 20:03:45 2022] GET /compute/v2.1/servers/83924572-5b93-4971-a5c0-fefaa87464c1 => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:05:02.458051 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_api:SELECT=3 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:05:02.458824 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=16 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:05:02.459664 n-d-851028-13 devstack@n-api.service[123596]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 20:05:02.459796 n-d-851028-13 devstack@n-api.service[123596]: Tue Oct 4 20:05:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/83924572-5b93-4971-a5c0-fefaa87464c1 (ip 10.222.0.43) !!! Oct 04 20:05:02.464138 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_api:SELECT=3 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:05:02.465080 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=7 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:05:02.466167 n-d-851028-13 devstack@n-api.service[123595]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 20:05:02.466307 n-d-851028-13 devstack@n-api.service[123595]: Tue Oct 4 20:05:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.43) !!! Oct 04 20:05:02.470306 n-d-851028-13 devstack@n-api.service[123595]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 20:05:02.470464 n-d-851028-13 devstack@n-api.service[123595]: Tue Oct 4 20:05:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.43) !!! Oct 04 20:05:02.477243 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-6a8881ac-22ca-4827-b324-b62e43600721 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:05:02.478320 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-6a8881ac-22ca-4827-b324-b62e43600721 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] [instance: 83924572-5b93-4971-a5c0-fefaa87464c1] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:05:02.491545 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6a8881ac-22ca-4827-b324-b62e43600721 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:05:02.492201 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6a8881ac-22ca-4827-b324-b62e43600721 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:05:02.492669 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6a8881ac-22ca-4827-b324-b62e43600721 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:05:02.493369 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-719dc374-595e-44e5-b016-5d0a5be28ed4 req-28961ec3-5a39-4d0d-b378-ec94bbbde3c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83924572-5b93-4971-a5c0-fefaa87464c1", "tag": "a35e5860-3275-4c95-a30a-e8ab1a881fb6"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:05:02.493536 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6a8881ac-22ca-4827-b324-b62e43600721 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:05:02.494205 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6a8881ac-22ca-4827-b324-b62e43600721 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:05:02.494342 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6a8881ac-22ca-4827-b324-b62e43600721 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:05:02.505395 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-719dc374-595e-44e5-b016-5d0a5be28ed4 req-28961ec3-5a39-4d0d-b378-ec94bbbde3c3 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:05:02.505882 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-719dc374-595e-44e5-b016-5d0a5be28ed4 req-28961ec3-5a39-4d0d-b378-ec94bbbde3c3 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:05:02.506311 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-719dc374-595e-44e5-b016-5d0a5be28ed4 req-28961ec3-5a39-4d0d-b378-ec94bbbde3c3 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:05:02.517804 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-719dc374-595e-44e5-b016-5d0a5be28ed4 req-28961ec3-5a39-4d0d-b378-ec94bbbde3c3 service nova] Creating event network-changed:a35e5860-3275-4c95-a30a-e8ab1a881fb6 for instance 83924572-5b93-4971-a5c0-fefaa87464c1 on n-h1-851028-13 Oct 04 20:05:02.520726 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-6a8881ac-22ca-4827-b324-b62e43600721 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] [instance: 83924572-5b93-4971-a5c0-fefaa87464c1] Going to try to terminate instance {{(pid=123596) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:05:02.522941 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-719dc374-595e-44e5-b016-5d0a5be28ed4 req-28961ec3-5a39-4d0d-b378-ec94bbbde3c3 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060848 Oct 04 20:05:02.523559 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3774/7922] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 20:05:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:05:02.612954 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-6a8881ac-22ca-4827-b324-b62e43600721 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] 10.222.0.43 "DELETE /compute/v2.1/servers/83924572-5b93-4971-a5c0-fefaa87464c1" status: 204 len: 0 microversion: 2.1 time: 0.156746 Oct 04 20:05:02.614245 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 4149/7923] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 20:05:02 2022] DELETE /compute/v2.1/servers/83924572-5b93-4971-a5c0-fefaa87464c1 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:05:02.622914 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-eb89af33-3bc2-40f5-a667-472ad06a6102 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:05:02.624152 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-eb89af33-3bc2-40f5-a667-472ad06a6102 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] [instance: 83924572-5b93-4971-a5c0-fefaa87464c1] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:05:02.630870 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-eb89af33-3bc2-40f5-a667-472ad06a6102 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:05:02.631342 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-eb89af33-3bc2-40f5-a667-472ad06a6102 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:05:02.631841 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-eb89af33-3bc2-40f5-a667-472ad06a6102 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:05:02.632571 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-eb89af33-3bc2-40f5-a667-472ad06a6102 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:05:02.633026 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-eb89af33-3bc2-40f5-a667-472ad06a6102 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:05:02.633483 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-eb89af33-3bc2-40f5-a667-472ad06a6102 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:05:02.807004 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-eb89af33-3bc2-40f5-a667-472ad06a6102 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cd9718357e4655b245403d0f7a8847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255c288051e48e08d94ede2bd6ba558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:05:02.815622 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-eb89af33-3bc2-40f5-a667-472ad06a6102 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] 10.222.0.43 "GET /compute/v2.1/servers/83924572-5b93-4971-a5c0-fefaa87464c1" status: 200 len: 1566 microversion: 2.1 time: 0.196972 Oct 04 20:05:02.816853 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3775/7924] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 20:05:02 2022] GET /compute/v2.1/servers/83924572-5b93-4971-a5c0-fefaa87464c1 => generated 1566 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:05:03.840245 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-5de7ac89-29a6-4ad1-98f8-5892f7a48459 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:05:03.840962 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-5de7ac89-29a6-4ad1-98f8-5892f7a48459 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] [instance: 83924572-5b93-4971-a5c0-fefaa87464c1] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:05:03.847943 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5de7ac89-29a6-4ad1-98f8-5892f7a48459 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:05:03.848441 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5de7ac89-29a6-4ad1-98f8-5892f7a48459 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:05:03.848896 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5de7ac89-29a6-4ad1-98f8-5892f7a48459 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:05:03.849629 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5de7ac89-29a6-4ad1-98f8-5892f7a48459 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:05:03.850094 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5de7ac89-29a6-4ad1-98f8-5892f7a48459 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:05:03.850542 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5de7ac89-29a6-4ad1-98f8-5892f7a48459 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:05:03.982922 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-5de7ac89-29a6-4ad1-98f8-5892f7a48459 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cd9718357e4655b245403d0f7a8847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255c288051e48e08d94ede2bd6ba558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:05:03.990844 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-5de7ac89-29a6-4ad1-98f8-5892f7a48459 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] 10.222.0.43 "GET /compute/v2.1/servers/83924572-5b93-4971-a5c0-fefaa87464c1" status: 200 len: 1566 microversion: 2.1 time: 0.154906 Oct 04 20:05:03.991428 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 4150/7925] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 20:05:03 2022] GET /compute/v2.1/servers/83924572-5b93-4971-a5c0-fefaa87464c1 => generated 1566 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:05:04.640664 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-da213940-fd12-4c01-86ed-2afa04c89e09 req-e09aaada-8d5a-46fd-88f1-d5d2bd79b1d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83924572-5b93-4971-a5c0-fefaa87464c1", "name": "network-vif-deleted", "tag": "a35e5860-3275-4c95-a30a-e8ab1a881fb6"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:05:04.650068 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-da213940-fd12-4c01-86ed-2afa04c89e09 req-e09aaada-8d5a-46fd-88f1-d5d2bd79b1d5 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:05:04.650559 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-da213940-fd12-4c01-86ed-2afa04c89e09 req-e09aaada-8d5a-46fd-88f1-d5d2bd79b1d5 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:05:04.650996 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-da213940-fd12-4c01-86ed-2afa04c89e09 req-e09aaada-8d5a-46fd-88f1-d5d2bd79b1d5 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:05:04.664519 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-da213940-fd12-4c01-86ed-2afa04c89e09 req-e09aaada-8d5a-46fd-88f1-d5d2bd79b1d5 service nova] Creating event network-vif-deleted:a35e5860-3275-4c95-a30a-e8ab1a881fb6 for instance 83924572-5b93-4971-a5c0-fefaa87464c1 on n-h1-851028-13 Oct 04 20:05:04.670255 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-da213940-fd12-4c01-86ed-2afa04c89e09 req-e09aaada-8d5a-46fd-88f1-d5d2bd79b1d5 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105080 Oct 04 20:05:04.671510 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3776/7926] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 20:05:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:05:05.015396 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-0ae50f4d-eb71-4117-b186-a8a972cee228 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:05:05.016028 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-0ae50f4d-eb71-4117-b186-a8a972cee228 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] [instance: 83924572-5b93-4971-a5c0-fefaa87464c1] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:05:05.022342 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0ae50f4d-eb71-4117-b186-a8a972cee228 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:05:05.022851 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0ae50f4d-eb71-4117-b186-a8a972cee228 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:05:05.023315 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0ae50f4d-eb71-4117-b186-a8a972cee228 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:05:05.024030 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0ae50f4d-eb71-4117-b186-a8a972cee228 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:05:05.024506 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0ae50f4d-eb71-4117-b186-a8a972cee228 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:05:05.024960 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-0ae50f4d-eb71-4117-b186-a8a972cee228 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:05:05.094744 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-0ae50f4d-eb71-4117-b186-a8a972cee228 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cd9718357e4655b245403d0f7a8847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255c288051e48e08d94ede2bd6ba558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:05:05.102680 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-0ae50f4d-eb71-4117-b186-a8a972cee228 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] 10.222.0.43 "GET /compute/v2.1/servers/83924572-5b93-4971-a5c0-fefaa87464c1" status: 200 len: 1219 microversion: 2.1 time: 0.092037 Oct 04 20:05:05.103422 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 4151/7927] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 20:05:05 2022] GET /compute/v2.1/servers/83924572-5b93-4971-a5c0-fefaa87464c1 => generated 1219 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:05:06.126057 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-b728d061-af62-42a7-8dd6-05c1be86e983 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:05:06.126759 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-b728d061-af62-42a7-8dd6-05c1be86e983 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] [instance: 83924572-5b93-4971-a5c0-fefaa87464c1] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:05:06.134318 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b728d061-af62-42a7-8dd6-05c1be86e983 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:05:06.134810 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b728d061-af62-42a7-8dd6-05c1be86e983 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:05:06.135247 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b728d061-af62-42a7-8dd6-05c1be86e983 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:05:06.135959 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b728d061-af62-42a7-8dd6-05c1be86e983 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:05:06.136411 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b728d061-af62-42a7-8dd6-05c1be86e983 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:05:06.136834 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b728d061-af62-42a7-8dd6-05c1be86e983 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:05:06.203213 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-b728d061-af62-42a7-8dd6-05c1be86e983 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cd9718357e4655b245403d0f7a8847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255c288051e48e08d94ede2bd6ba558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:05:06.211367 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-b728d061-af62-42a7-8dd6-05c1be86e983 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] 10.222.0.43 "GET /compute/v2.1/servers/83924572-5b93-4971-a5c0-fefaa87464c1" status: 200 len: 1219 microversion: 2.1 time: 0.089286 Oct 04 20:05:06.211966 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3777/7928] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 20:05:06 2022] GET /compute/v2.1/servers/83924572-5b93-4971-a5c0-fefaa87464c1 => generated 1219 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:05:07.235387 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-adb75603-7765-42c7-ad5b-7cf3dac01fa1 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:05:07.235967 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-adb75603-7765-42c7-ad5b-7cf3dac01fa1 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] [instance: 83924572-5b93-4971-a5c0-fefaa87464c1] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:05:07.242920 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-adb75603-7765-42c7-ad5b-7cf3dac01fa1 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:05:07.243464 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-adb75603-7765-42c7-ad5b-7cf3dac01fa1 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:05:07.244090 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-adb75603-7765-42c7-ad5b-7cf3dac01fa1 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:05:07.244812 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-adb75603-7765-42c7-ad5b-7cf3dac01fa1 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:05:07.245327 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-adb75603-7765-42c7-ad5b-7cf3dac01fa1 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:05:07.245782 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-adb75603-7765-42c7-ad5b-7cf3dac01fa1 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:05:07.310028 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-adb75603-7765-42c7-ad5b-7cf3dac01fa1 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cd9718357e4655b245403d0f7a8847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255c288051e48e08d94ede2bd6ba558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:05:07.319551 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-adb75603-7765-42c7-ad5b-7cf3dac01fa1 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] 10.222.0.43 "GET /compute/v2.1/servers/83924572-5b93-4971-a5c0-fefaa87464c1" status: 200 len: 1219 microversion: 2.1 time: 0.088722 Oct 04 20:05:07.320324 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 4152/7929] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 20:05:07 2022] GET /compute/v2.1/servers/83924572-5b93-4971-a5c0-fefaa87464c1 => generated 1219 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:05:08.343004 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-1086b6c6-7b3a-4443-9f35-76f756a589d9 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:05:08.343622 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-1086b6c6-7b3a-4443-9f35-76f756a589d9 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] [instance: 83924572-5b93-4971-a5c0-fefaa87464c1] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:05:08.350510 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1086b6c6-7b3a-4443-9f35-76f756a589d9 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:05:08.350991 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1086b6c6-7b3a-4443-9f35-76f756a589d9 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:05:08.351427 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1086b6c6-7b3a-4443-9f35-76f756a589d9 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:05:08.352115 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1086b6c6-7b3a-4443-9f35-76f756a589d9 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:05:08.352566 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1086b6c6-7b3a-4443-9f35-76f756a589d9 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:05:08.352992 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1086b6c6-7b3a-4443-9f35-76f756a589d9 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:05:08.416458 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-1086b6c6-7b3a-4443-9f35-76f756a589d9 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cd9718357e4655b245403d0f7a8847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255c288051e48e08d94ede2bd6ba558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:05:08.424859 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-1086b6c6-7b3a-4443-9f35-76f756a589d9 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] 10.222.0.43 "GET /compute/v2.1/servers/83924572-5b93-4971-a5c0-fefaa87464c1" status: 200 len: 1219 microversion: 2.1 time: 0.086389 Oct 04 20:05:08.425469 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3778/7930] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 20:05:08 2022] GET /compute/v2.1/servers/83924572-5b93-4971-a5c0-fefaa87464c1 => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:05:09.446978 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-29277eec-3a78-4064-b689-8a6689361891 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:05:09.447618 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-29277eec-3a78-4064-b689-8a6689361891 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] [instance: 83924572-5b93-4971-a5c0-fefaa87464c1] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:05:09.455648 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-29277eec-3a78-4064-b689-8a6689361891 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:05:09.456156 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-29277eec-3a78-4064-b689-8a6689361891 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:05:09.456623 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-29277eec-3a78-4064-b689-8a6689361891 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:05:09.457375 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-29277eec-3a78-4064-b689-8a6689361891 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:05:09.457854 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-29277eec-3a78-4064-b689-8a6689361891 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:05:09.458301 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-29277eec-3a78-4064-b689-8a6689361891 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:05:09.473160 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.wsgi [None req-29277eec-3a78-4064-b689-8a6689361891 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] HTTP exception thrown: Instance 83924572-5b93-4971-a5c0-fefaa87464c1 could not be found. Oct 04 20:05:09.474911 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-29277eec-3a78-4064-b689-8a6689361891 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Request method failure captured: Oct 04 20:05:09.474911 n-d-851028-13 devstack@n-api.service[123596]: request: GET /compute/v2.1/servers/83924572-5b93-4971-a5c0-fefaa87464c1 HTTP/1.1 Oct 04 20:05:09.474911 n-d-851028-13 devstack@n-api.service[123596]: Accept: application/json Oct 04 20:05:09.474911 n-d-851028-13 devstack@n-api.service[123596]: Accept-Encoding: identity Oct 04 20:05:09.474911 n-d-851028-13 devstack@n-api.service[123596]: Connection: close Oct 04 20:05:09.474911 n-d-851028-13 devstack@n-api.service[123596]: Content-Length: 0 Oct 04 20:05:09.474911 n-d-851028-13 devstack@n-api.service[123596]: Content-Type: application/json Oct 04 20:05:09.474911 n-d-851028-13 devstack@n-api.service[123596]: Host: 10.222.0.43 Oct 04 20:05:09.474911 n-d-851028-13 devstack@n-api.service[123596]: Openstack-System-Scope: None Oct 04 20:05:09.474911 n-d-851028-13 devstack@n-api.service[123596]: User-Agent: python-urllib3/1.26.12 Oct 04 20:05:09.474911 n-d-851028-13 devstack@n-api.service[123596]: X-Auth-Token: gAAAAABjPI_ikPt8-5DTXRTsB0GlyuNn0fIzsOgqWt-XPvrHYgcZFxB3oTrbwimQUZY3Dj5dugMDp68PEnUvTWXnj_lgepBI4B_cUPSYf2yLVRPM5q30O6A2ExbjwkDUr-e91lM_QwQI9PkquOyHpX-8Xzuol15qcrdJFWLkwA-nD4clPBq4bNo Oct 04 20:05:09.474911 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Id: None Oct 04 20:05:09.474911 n-d-851028-13 devstack@n-api.service[123596]: X-Domain-Name: None Oct 04 20:05:09.474911 n-d-851028-13 devstack@n-api.service[123596]: X-Identity-Status: Confirmed Oct 04 20:05:09.474911 n-d-851028-13 devstack@n-api.service[123596]: X-Is-Admin-Project: True Oct 04 20:05:09.474911 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Id: default Oct 04 20:05:09.474911 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Domain-Name: Default Oct 04 20:05:09.474911 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Id: 3255c288051e48e08d94ede2bd6ba558 Oct 04 20:05:09.474911 n-d-851028-13 devstack@n-api.service[123596]: X-Project-Name: tempest-TestShelveInstance-1078371979 Oct 04 20:05:09.474911 n-d-851028-13 devstack@n-api.service[123596]: X-Role: member,reader Oct 04 20:05:09.474911 n-d-851028-13 devstack@n-api.service[123596]: X-Roles: member,reader Oct 04 20:05:09.474911 n-d-851028-13 devstack@n-api.service[123596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/3255c288051e48e08d94ede2bd6ba558"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_3255c288051e48e08d94ede2bd6ba558"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/3255c288051e48e08d94ede2bd6ba558"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/3255c288051e48e08d94ede2bd6ba558"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 20:05:09.474911 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant: tempest-TestShelveInstance-1078371979 Oct 04 20:05:09.474911 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Id: 3255c288051e48e08d94ede2bd6ba558 Oct 04 20:05:09.474911 n-d-851028-13 devstack@n-api.service[123596]: X-Tenant-Name: tempest-TestShelveInstance-1078371979 Oct 04 20:05:09.474911 n-d-851028-13 devstack@n-api.service[123596]: X-User: tempest-TestShelveInstance-1078371979-project Oct 04 20:05:09.474911 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Id: default Oct 04 20:05:09.474911 n-d-851028-13 devstack@n-api.service[123596]: X-User-Domain-Name: Default Oct 04 20:05:09.474911 n-d-851028-13 devstack@n-api.service[123596]: X-User-Id: 09cd9718357e4655b245403d0f7a8847 Oct 04 20:05:09.474911 n-d-851028-13 devstack@n-api.service[123596]: X-User-Name: tempest-TestShelveInstance-1078371979-project Oct 04 20:05:09.474911 n-d-851028-13 devstack@n-api.service[123596]: method: > Oct 04 20:05:09.474911 n-d-851028-13 devstack@n-api.service[123596]: exception: Instance 83924572-5b93-4971-a5c0-fefaa87464c1 could not be found. Oct 04 20:05:09.474911 n-d-851028-13 devstack@n-api.service[123596]: action_args: {'id': '83924572-5b93-4971-a5c0-fefaa87464c1'} Oct 04 20:05:09.474911 n-d-851028-13 devstack@n-api.service[123596]: {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:05:09.474911 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:05:09.474911 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:05:09.474911 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:05:09.474911 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:05:09.474911 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:05:09.474911 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:05:09.474911 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:05:09.474911 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:05:09.474911 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:05:09.474911 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 83924572-5b93-4971-a5c0-fefaa87464c1 could not be found. Oct 04 20:05:09.474911 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 20:05:09.474911 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:05:09.474911 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 20:05:09.474911 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:05:09.474911 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:05:09.474911 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:05:09.474911 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:05:09.474911 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:05:09.474911 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:05:09.474911 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:05:09.474911 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:05:09.474911 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:05:09.474911 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:05:09.474911 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:05:09.474911 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:05:09.474911 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:05:09.474911 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 83924572-5b93-4971-a5c0-fefaa87464c1 could not be found. Oct 04 20:05:09.474911 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 20:05:09.474911 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:05:09.474911 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 20:05:09.480423 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:05:09.480423 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:05:09.480423 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:05:09.480423 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:05:09.480423 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:05:09.480423 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 83924572-5b93-4971-a5c0-fefaa87464c1 could not be found. Oct 04 20:05:09.480423 n-d-851028-13 devstack@n-api.service[123596]: ERROR nova.api.openstack.wsgi Oct 04 20:05:09.480423 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-29277eec-3a78-4064-b689-8a6689361891 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Returning 404 to user: Instance 83924572-5b93-4971-a5c0-fefaa87464c1 could not be found. {{(pid=123596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:05:09.480423 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-29277eec-3a78-4064-b689-8a6689361891 tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] 10.222.0.43 "GET /compute/v2.1/servers/83924572-5b93-4971-a5c0-fefaa87464c1" status: 404 len: 111 microversion: 2.1 time: 0.033530 Oct 04 20:05:09.480423 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 4153/7931] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 20:05:09 2022] GET /compute/v2.1/servers/83924572-5b93-4971-a5c0-fefaa87464c1 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:05:09.645435 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-0328d567-572e-4416-841d-2f0fa630a58a tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] Calling method '.version_select at 0x7fb21ea1a280>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:05:09.671192 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-0328d567-572e-4416-841d-2f0fa630a58a tempest-TestShelveInstance-1078371979 tempest-TestShelveInstance-1078371979-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-929676904" status: 202 len: 0 microversion: 2.1 time: 0.029631 Oct 04 20:05:09.671952 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3779/7932] 10.222.0.43 () {58 vars in 1251 bytes} [Tue Oct 4 20:05:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-929676904 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:05:27.598854 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:05:27.599614 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:05:27.802826 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-be114008-b2a3-4458-9b1e-8847196676f9 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Action: 'create', calling method: .version_select at 0x7fb224110b80>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-353745904", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA7EJAC6Cmc7D6+9bws0H5Ts86agCkEkXrR0F4yaY33PXS3W2nTbVtiiyIm2c/ijZOqvbq4Z7wuX4jWMVmhDr7V43shw9VBzka98BgZuIxijFdq0egIxeSlgp7JPHKVhiQ=="}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:05:27.826820 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-be114008-b2a3-4458-9b1e-8847196676f9 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Getting quotas for project 1be6815aff7a416a8f668d2ac5d56693. Resources: {'key_pairs'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:05:27.835802 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-be114008-b2a3-4458-9b1e-8847196676f9 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Getting quotas for user 56cb8c6c599143389b0a4b9e55423155 and project 1be6815aff7a416a8f668d2ac5d56693. Resources: {'key_pairs'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:05:27.875761 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-be114008-b2a3-4458-9b1e-8847196676f9 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.282295 Oct 04 20:05:27.877278 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 4154/7933] 10.222.0.43 () {60 vars in 1159 bytes} [Tue Oct 4 20:05:27 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:05:29.050048 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=22 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:05:29.051109 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_api:SELECT=13,nova_api:DELETE=1 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:05:29.061490 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-d456c312-b7ef-46b1-a6bf-b79c98a16ee3 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-605590870", "imageRef": "e8943ec5-4038-4d4b-b9b9-2415a79f5243", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-353745904", "security_groups": [{"name": "tempest-secgroup-smoke-1044151799"}], "networks": [{"uuid": "948f7525-5263-4f46-b8a9-9c38feeb34a1"}]}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:05:29.218839 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.network.neutron [None req-d456c312-b7ef-46b1-a6bf-b79c98a16ee3 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] validate_networks() for [('948f7525-5263-4f46-b8a9-9c38feeb34a1', None, None, None, None, None)] {{(pid=123595) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:05:29.640443 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-d456c312-b7ef-46b1-a6bf-b79c98a16ee3 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Flavor limits 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:05:29.641044 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-d456c312-b7ef-46b1-a6bf-b79c98a16ee3 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Image limits 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:05:29.641838 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-d456c312-b7ef-46b1-a6bf-b79c98a16ee3 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Flavor pref 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:05:29.642348 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-d456c312-b7ef-46b1-a6bf-b79c98a16ee3 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Image pref 0:0:0 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:05:29.642999 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.virt.hardware [None req-d456c312-b7ef-46b1-a6bf-b79c98a16ee3 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:05:29.655312 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d456c312-b7ef-46b1-a6bf-b79c98a16ee3 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:05:29.656072 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d456c312-b7ef-46b1-a6bf-b79c98a16ee3 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:05:29.656735 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d456c312-b7ef-46b1-a6bf-b79c98a16ee3 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:05:29.657957 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d456c312-b7ef-46b1-a6bf-b79c98a16ee3 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:05:29.658474 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d456c312-b7ef-46b1-a6bf-b79c98a16ee3 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:05:29.658902 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-d456c312-b7ef-46b1-a6bf-b79c98a16ee3 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:05:29.681262 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-d456c312-b7ef-46b1-a6bf-b79c98a16ee3 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Getting quotas for project 1be6815aff7a416a8f668d2ac5d56693. Resources: {'ram', 'cores', 'instances'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:05:29.686926 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.quota [None req-d456c312-b7ef-46b1-a6bf-b79c98a16ee3 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Getting quotas for user 56cb8c6c599143389b0a4b9e55423155 and project 1be6815aff7a416a8f668d2ac5d56693. Resources: {'ram', 'cores', 'instances'} {{(pid=123595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:05:29.701494 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-d456c312-b7ef-46b1-a6bf-b79c98a16ee3 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Going to run 1 instances... {{(pid=123595) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:05:29.703859 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-d456c312-b7ef-46b1-a6bf-b79c98a16ee3 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] [instance: 9d6cb98b-15f6-4144-bcd7-e26bd005b380] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e8943ec5-4038-4d4b-b9b9-2415a79f5243',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:05:29.753249 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-d456c312-b7ef-46b1-a6bf-b79c98a16ee3 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.705728 Oct 04 20:05:29.753936 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3780/7934] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 20:05:29 2022] POST /compute/v2.1/servers => generated 406 bytes in 707 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 20:05:29.767096 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-acb69e56-c7cd-4398-b3f6-f3d4f30d690c tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:05:29.767746 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-acb69e56-c7cd-4398-b3f6-f3d4f30d690c tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] [instance: 9d6cb98b-15f6-4144-bcd7-e26bd005b380] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:05:29.846871 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-acb69e56-c7cd-4398-b3f6-f3d4f30d690c tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56cb8c6c599143389b0a4b9e55423155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be6815aff7a416a8f668d2ac5d56693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:05:29.854232 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-acb69e56-c7cd-4398-b3f6-f3d4f30d690c tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] 10.222.0.43 "GET /compute/v2.1/servers/9d6cb98b-15f6-4144-bcd7-e26bd005b380" status: 200 len: 1247 microversion: 2.1 time: 0.092736 Oct 04 20:05:29.855197 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 4155/7935] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 20:05:29 2022] GET /compute/v2.1/servers/9d6cb98b-15f6-4144-bcd7-e26bd005b380 => generated 1247 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:05:30.883934 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-170dbb5d-ca9f-47d6-86a4-001a52618d3c tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:05:30.884553 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-170dbb5d-ca9f-47d6-86a4-001a52618d3c tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] [instance: 9d6cb98b-15f6-4144-bcd7-e26bd005b380] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:05:30.904163 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-170dbb5d-ca9f-47d6-86a4-001a52618d3c tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:05:30.906413 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-170dbb5d-ca9f-47d6-86a4-001a52618d3c tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:05:30.906899 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-170dbb5d-ca9f-47d6-86a4-001a52618d3c tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:05:30.907815 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-170dbb5d-ca9f-47d6-86a4-001a52618d3c tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:05:30.908466 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-170dbb5d-ca9f-47d6-86a4-001a52618d3c tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:05:30.909384 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-170dbb5d-ca9f-47d6-86a4-001a52618d3c tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:05:30.987366 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-170dbb5d-ca9f-47d6-86a4-001a52618d3c tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56cb8c6c599143389b0a4b9e55423155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be6815aff7a416a8f668d2ac5d56693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:05:31.000317 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-170dbb5d-ca9f-47d6-86a4-001a52618d3c tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] 10.222.0.43 "GET /compute/v2.1/servers/9d6cb98b-15f6-4144-bcd7-e26bd005b380" status: 200 len: 1299 microversion: 2.1 time: 0.122511 Oct 04 20:05:31.017235 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3781/7936] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 20:05:30 2022] GET /compute/v2.1/servers/9d6cb98b-15f6-4144-bcd7-e26bd005b380 => generated 1299 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:05:32.030931 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-562b7c30-a244-4467-aa67-328b41196831 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:05:32.031625 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-562b7c30-a244-4467-aa67-328b41196831 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] [instance: 9d6cb98b-15f6-4144-bcd7-e26bd005b380] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:05:32.039699 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-562b7c30-a244-4467-aa67-328b41196831 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:05:32.040208 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-562b7c30-a244-4467-aa67-328b41196831 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:05:32.041196 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-562b7c30-a244-4467-aa67-328b41196831 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:05:32.042109 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-562b7c30-a244-4467-aa67-328b41196831 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:05:32.042766 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-562b7c30-a244-4467-aa67-328b41196831 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:05:32.043388 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-562b7c30-a244-4467-aa67-328b41196831 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:05:32.284074 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-562b7c30-a244-4467-aa67-328b41196831 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56cb8c6c599143389b0a4b9e55423155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be6815aff7a416a8f668d2ac5d56693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:05:32.293184 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-562b7c30-a244-4467-aa67-328b41196831 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] 10.222.0.43 "GET /compute/v2.1/servers/9d6cb98b-15f6-4144-bcd7-e26bd005b380" status: 200 len: 1373 microversion: 2.1 time: 0.267325 Oct 04 20:05:32.294045 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 4156/7937] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 20:05:32 2022] GET /compute/v2.1/servers/9d6cb98b-15f6-4144-bcd7-e26bd005b380 => generated 1373 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:05:32.573667 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-ed153b79-d10c-454f-b817-5e33e34de103 req-7032f5fb-ed79-41b6-9db0-18d8466fe289 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d6cb98b-15f6-4144-bcd7-e26bd005b380", "tag": "94427f5e-67ea-4f57-ac10-b594d9afe040"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:05:32.585472 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-ed153b79-d10c-454f-b817-5e33e34de103 req-7032f5fb-ed79-41b6-9db0-18d8466fe289 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:05:32.586069 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-ed153b79-d10c-454f-b817-5e33e34de103 req-7032f5fb-ed79-41b6-9db0-18d8466fe289 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:05:32.586552 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-ed153b79-d10c-454f-b817-5e33e34de103 req-7032f5fb-ed79-41b6-9db0-18d8466fe289 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:05:32.599520 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-ed153b79-d10c-454f-b817-5e33e34de103 req-7032f5fb-ed79-41b6-9db0-18d8466fe289 service nova] Creating event network-changed:94427f5e-67ea-4f57-ac10-b594d9afe040 for instance 9d6cb98b-15f6-4144-bcd7-e26bd005b380 on n-h1-851028-13 Oct 04 20:05:32.605469 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-ed153b79-d10c-454f-b817-5e33e34de103 req-7032f5fb-ed79-41b6-9db0-18d8466fe289 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036813 Oct 04 20:05:32.606282 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3782/7938] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 20:05:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:05:33.321333 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-07966ac9-9c75-4702-9c7f-d9077a1bde6e tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:05:33.322057 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-07966ac9-9c75-4702-9c7f-d9077a1bde6e tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] [instance: 9d6cb98b-15f6-4144-bcd7-e26bd005b380] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:05:33.329481 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-07966ac9-9c75-4702-9c7f-d9077a1bde6e tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:05:33.330004 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-07966ac9-9c75-4702-9c7f-d9077a1bde6e tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:05:33.330435 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-07966ac9-9c75-4702-9c7f-d9077a1bde6e tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:05:33.331148 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-07966ac9-9c75-4702-9c7f-d9077a1bde6e tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:05:33.331706 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-07966ac9-9c75-4702-9c7f-d9077a1bde6e tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:05:33.332042 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-07966ac9-9c75-4702-9c7f-d9077a1bde6e tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:05:33.471079 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-07966ac9-9c75-4702-9c7f-d9077a1bde6e tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56cb8c6c599143389b0a4b9e55423155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be6815aff7a416a8f668d2ac5d56693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:05:33.478907 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-07966ac9-9c75-4702-9c7f-d9077a1bde6e tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] 10.222.0.43 "GET /compute/v2.1/servers/9d6cb98b-15f6-4144-bcd7-e26bd005b380" status: 200 len: 1373 microversion: 2.1 time: 0.161694 Oct 04 20:05:33.479486 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 4157/7939] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 20:05:33 2022] GET /compute/v2.1/servers/9d6cb98b-15f6-4144-bcd7-e26bd005b380 => generated 1373 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:05:34.502898 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-bfae930f-7638-4e12-b692-4ed502cd642b tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:05:34.503678 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-bfae930f-7638-4e12-b692-4ed502cd642b tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] [instance: 9d6cb98b-15f6-4144-bcd7-e26bd005b380] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:05:34.509910 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bfae930f-7638-4e12-b692-4ed502cd642b tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:05:34.510400 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bfae930f-7638-4e12-b692-4ed502cd642b tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:05:34.510841 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bfae930f-7638-4e12-b692-4ed502cd642b tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:05:34.511545 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bfae930f-7638-4e12-b692-4ed502cd642b tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:05:34.512002 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bfae930f-7638-4e12-b692-4ed502cd642b tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:05:34.512450 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-bfae930f-7638-4e12-b692-4ed502cd642b tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:05:34.785957 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-bfae930f-7638-4e12-b692-4ed502cd642b tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56cb8c6c599143389b0a4b9e55423155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be6815aff7a416a8f668d2ac5d56693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:05:34.794074 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-bfae930f-7638-4e12-b692-4ed502cd642b tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] 10.222.0.43 "GET /compute/v2.1/servers/9d6cb98b-15f6-4144-bcd7-e26bd005b380" status: 200 len: 1373 microversion: 2.1 time: 0.296355 Oct 04 20:05:34.794665 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3783/7940] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 20:05:34 2022] GET /compute/v2.1/servers/9d6cb98b-15f6-4144-bcd7-e26bd005b380 => generated 1373 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:05:35.817069 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-a80ebaee-3407-4ad4-b57b-cc3c5618aa9a tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:05:35.817731 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-a80ebaee-3407-4ad4-b57b-cc3c5618aa9a tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] [instance: 9d6cb98b-15f6-4144-bcd7-e26bd005b380] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:05:35.824161 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a80ebaee-3407-4ad4-b57b-cc3c5618aa9a tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:05:35.824543 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a80ebaee-3407-4ad4-b57b-cc3c5618aa9a tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:05:35.825042 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a80ebaee-3407-4ad4-b57b-cc3c5618aa9a tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:05:35.825958 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a80ebaee-3407-4ad4-b57b-cc3c5618aa9a tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:05:35.826435 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a80ebaee-3407-4ad4-b57b-cc3c5618aa9a tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:05:35.826890 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a80ebaee-3407-4ad4-b57b-cc3c5618aa9a tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:05:36.012863 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-a80ebaee-3407-4ad4-b57b-cc3c5618aa9a tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56cb8c6c599143389b0a4b9e55423155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be6815aff7a416a8f668d2ac5d56693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:05:36.020885 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-a80ebaee-3407-4ad4-b57b-cc3c5618aa9a tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] 10.222.0.43 "GET /compute/v2.1/servers/9d6cb98b-15f6-4144-bcd7-e26bd005b380" status: 200 len: 1373 microversion: 2.1 time: 0.208051 Oct 04 20:05:36.021587 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 4158/7941] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 20:05:35 2022] GET /compute/v2.1/servers/9d6cb98b-15f6-4144-bcd7-e26bd005b380 => generated 1373 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:05:37.043227 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-da9dccc7-51fc-4a02-8567-6f8d0b97aaf4 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:05:37.045080 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-da9dccc7-51fc-4a02-8567-6f8d0b97aaf4 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] [instance: 9d6cb98b-15f6-4144-bcd7-e26bd005b380] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:05:37.052726 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-da9dccc7-51fc-4a02-8567-6f8d0b97aaf4 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:05:37.053259 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-da9dccc7-51fc-4a02-8567-6f8d0b97aaf4 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:05:37.053714 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-da9dccc7-51fc-4a02-8567-6f8d0b97aaf4 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:05:37.054438 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-da9dccc7-51fc-4a02-8567-6f8d0b97aaf4 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:05:37.054903 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-da9dccc7-51fc-4a02-8567-6f8d0b97aaf4 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:05:37.058313 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-da9dccc7-51fc-4a02-8567-6f8d0b97aaf4 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:05:37.191489 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-da9dccc7-51fc-4a02-8567-6f8d0b97aaf4 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56cb8c6c599143389b0a4b9e55423155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be6815aff7a416a8f668d2ac5d56693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:05:37.201516 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-da9dccc7-51fc-4a02-8567-6f8d0b97aaf4 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] 10.222.0.43 "GET /compute/v2.1/servers/9d6cb98b-15f6-4144-bcd7-e26bd005b380" status: 200 len: 1373 microversion: 2.1 time: 0.162190 Oct 04 20:05:37.202153 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3784/7942] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 20:05:37 2022] GET /compute/v2.1/servers/9d6cb98b-15f6-4144-bcd7-e26bd005b380 => generated 1373 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:05:38.226168 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-feb48d94-d311-4d6f-b41f-aab5223cba48 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:05:38.226887 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-feb48d94-d311-4d6f-b41f-aab5223cba48 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] [instance: 9d6cb98b-15f6-4144-bcd7-e26bd005b380] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:05:38.235314 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-feb48d94-d311-4d6f-b41f-aab5223cba48 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:05:38.235824 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-feb48d94-d311-4d6f-b41f-aab5223cba48 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:05:38.236280 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-feb48d94-d311-4d6f-b41f-aab5223cba48 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:05:38.237001 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-feb48d94-d311-4d6f-b41f-aab5223cba48 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:05:38.237503 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-feb48d94-d311-4d6f-b41f-aab5223cba48 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:05:38.237950 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-feb48d94-d311-4d6f-b41f-aab5223cba48 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:05:38.376272 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-feb48d94-d311-4d6f-b41f-aab5223cba48 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56cb8c6c599143389b0a4b9e55423155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be6815aff7a416a8f668d2ac5d56693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:05:38.384223 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-feb48d94-d311-4d6f-b41f-aab5223cba48 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] 10.222.0.43 "GET /compute/v2.1/servers/9d6cb98b-15f6-4144-bcd7-e26bd005b380" status: 200 len: 1373 microversion: 2.1 time: 0.162073 Oct 04 20:05:38.384800 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 4159/7943] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 20:05:38 2022] GET /compute/v2.1/servers/9d6cb98b-15f6-4144-bcd7-e26bd005b380 => generated 1373 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:05:38.891832 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-aabc9542-c7a1-4a29-a4ae-6aa4e3d04f95 req-5ffffb91-21e6-4e09-b976-df8bb0a2e6c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d6cb98b-15f6-4144-bcd7-e26bd005b380", "name": "network-vif-plugged", "status": "completed", "tag": "94427f5e-67ea-4f57-ac10-b594d9afe040"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:05:38.902721 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-aabc9542-c7a1-4a29-a4ae-6aa4e3d04f95 req-5ffffb91-21e6-4e09-b976-df8bb0a2e6c1 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:05:38.903100 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-aabc9542-c7a1-4a29-a4ae-6aa4e3d04f95 req-5ffffb91-21e6-4e09-b976-df8bb0a2e6c1 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:05:38.903605 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-aabc9542-c7a1-4a29-a4ae-6aa4e3d04f95 req-5ffffb91-21e6-4e09-b976-df8bb0a2e6c1 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:05:38.917741 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-aabc9542-c7a1-4a29-a4ae-6aa4e3d04f95 req-5ffffb91-21e6-4e09-b976-df8bb0a2e6c1 service nova] Creating event network-vif-plugged:94427f5e-67ea-4f57-ac10-b594d9afe040 for instance 9d6cb98b-15f6-4144-bcd7-e26bd005b380 on n-h1-851028-13 Oct 04 20:05:38.926532 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-aabc9542-c7a1-4a29-a4ae-6aa4e3d04f95 req-5ffffb91-21e6-4e09-b976-df8bb0a2e6c1 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106776 Oct 04 20:05:38.927147 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3785/7944] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 20:05:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:05:39.410249 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-d642bbc5-7623-4318-a0d8-f65c25330d08 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:05:39.411076 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-d642bbc5-7623-4318-a0d8-f65c25330d08 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] [instance: 9d6cb98b-15f6-4144-bcd7-e26bd005b380] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:05:39.420315 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d642bbc5-7623-4318-a0d8-f65c25330d08 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:05:39.420824 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d642bbc5-7623-4318-a0d8-f65c25330d08 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:05:39.421351 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d642bbc5-7623-4318-a0d8-f65c25330d08 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:05:39.422081 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d642bbc5-7623-4318-a0d8-f65c25330d08 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:05:39.422561 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d642bbc5-7623-4318-a0d8-f65c25330d08 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:05:39.423011 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-d642bbc5-7623-4318-a0d8-f65c25330d08 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:05:39.557618 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-d642bbc5-7623-4318-a0d8-f65c25330d08 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56cb8c6c599143389b0a4b9e55423155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be6815aff7a416a8f668d2ac5d56693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:05:39.565797 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-d642bbc5-7623-4318-a0d8-f65c25330d08 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] 10.222.0.43 "GET /compute/v2.1/servers/9d6cb98b-15f6-4144-bcd7-e26bd005b380" status: 200 len: 1373 microversion: 2.1 time: 0.160629 Oct 04 20:05:39.566385 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 4160/7945] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 20:05:39 2022] GET /compute/v2.1/servers/9d6cb98b-15f6-4144-bcd7-e26bd005b380 => generated 1373 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:05:40.591040 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-22c2f8f9-7ce1-45c7-8927-21b1699a3ed6 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:05:40.591784 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-22c2f8f9-7ce1-45c7-8927-21b1699a3ed6 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] [instance: 9d6cb98b-15f6-4144-bcd7-e26bd005b380] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:05:40.594878 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=2 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:05:40.595561 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=6 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:05:40.601168 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-22c2f8f9-7ce1-45c7-8927-21b1699a3ed6 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:05:40.601665 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-22c2f8f9-7ce1-45c7-8927-21b1699a3ed6 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:05:40.602106 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-22c2f8f9-7ce1-45c7-8927-21b1699a3ed6 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:05:40.602813 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-22c2f8f9-7ce1-45c7-8927-21b1699a3ed6 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:05:40.603276 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-22c2f8f9-7ce1-45c7-8927-21b1699a3ed6 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:05:40.603715 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-22c2f8f9-7ce1-45c7-8927-21b1699a3ed6 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:05:40.754882 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-22c2f8f9-7ce1-45c7-8927-21b1699a3ed6 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56cb8c6c599143389b0a4b9e55423155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be6815aff7a416a8f668d2ac5d56693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:05:40.763179 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-22c2f8f9-7ce1-45c7-8927-21b1699a3ed6 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] 10.222.0.43 "GET /compute/v2.1/servers/9d6cb98b-15f6-4144-bcd7-e26bd005b380" status: 200 len: 1558 microversion: 2.1 time: 0.176999 Oct 04 20:05:40.763761 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3786/7946] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 20:05:40 2022] GET /compute/v2.1/servers/9d6cb98b-15f6-4144-bcd7-e26bd005b380 => generated 1558 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:05:40.787475 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-04026150-fa47-4cfd-9030-dc2b941b85c0 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:05:40.788103 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-04026150-fa47-4cfd-9030-dc2b941b85c0 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] [instance: 9d6cb98b-15f6-4144-bcd7-e26bd005b380] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:05:40.790042 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=6 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:05:40.796869 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-04026150-fa47-4cfd-9030-dc2b941b85c0 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:05:40.797397 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-04026150-fa47-4cfd-9030-dc2b941b85c0 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:05:40.797845 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-04026150-fa47-4cfd-9030-dc2b941b85c0 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:05:40.798544 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-04026150-fa47-4cfd-9030-dc2b941b85c0 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:05:40.799007 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-04026150-fa47-4cfd-9030-dc2b941b85c0 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:05:40.799445 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-04026150-fa47-4cfd-9030-dc2b941b85c0 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:05:40.933708 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-04026150-fa47-4cfd-9030-dc2b941b85c0 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56cb8c6c599143389b0a4b9e55423155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be6815aff7a416a8f668d2ac5d56693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:05:40.942013 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-04026150-fa47-4cfd-9030-dc2b941b85c0 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] 10.222.0.43 "GET /compute/v2.1/servers/9d6cb98b-15f6-4144-bcd7-e26bd005b380" status: 200 len: 1558 microversion: 2.1 time: 0.158553 Oct 04 20:05:40.942588 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 4161/7947] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 20:05:40 2022] GET /compute/v2.1/servers/9d6cb98b-15f6-4144-bcd7-e26bd005b380 => generated 1558 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:05:42.742865 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-b6e35a84-d136-4dfe-9feb-1498b6a535a4 req-c62c01be-3a47-40a5-aee7-2e876575e718 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d6cb98b-15f6-4144-bcd7-e26bd005b380", "tag": "94427f5e-67ea-4f57-ac10-b594d9afe040"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:05:42.753210 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-b6e35a84-d136-4dfe-9feb-1498b6a535a4 req-c62c01be-3a47-40a5-aee7-2e876575e718 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:05:42.753764 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-b6e35a84-d136-4dfe-9feb-1498b6a535a4 req-c62c01be-3a47-40a5-aee7-2e876575e718 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:05:42.754199 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-b6e35a84-d136-4dfe-9feb-1498b6a535a4 req-c62c01be-3a47-40a5-aee7-2e876575e718 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:05:42.766081 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-b6e35a84-d136-4dfe-9feb-1498b6a535a4 req-c62c01be-3a47-40a5-aee7-2e876575e718 service nova] Creating event network-changed:94427f5e-67ea-4f57-ac10-b594d9afe040 for instance 9d6cb98b-15f6-4144-bcd7-e26bd005b380 on n-h1-851028-13 Oct 04 20:05:42.771547 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-b6e35a84-d136-4dfe-9feb-1498b6a535a4 req-c62c01be-3a47-40a5-aee7-2e876575e718 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032286 Oct 04 20:05:42.772252 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3787/7948] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 20:05:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:07:37.903560 n-d-851028-13 devstack@n-api.service[123596]: ERROR oslo.messaging._drivers.impl_rabbit [-] [c592c758-2dc3-4024-92b0-c949515e0281] AMQP server on 10.222.0.43:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 04 20:07:37.904493 n-d-851028-13 devstack@n-api.service[123596]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ced6bcbb-f7de-451e-861c-054aba6c81f5] AMQP server on 10.222.0.43:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 04 20:07:37.905325 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:07:37.906257 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=36 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:07:37.907053 n-d-851028-13 devstack@n-api.service[123596]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 20:07:37.907215 n-d-851028-13 devstack@n-api.service[123596]: Tue Oct 4 20:07:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9d6cb98b-15f6-4144-bcd7-e26bd005b380/action (ip 10.222.0.43) !!! Oct 04 20:07:37.908454 n-d-851028-13 devstack@n-api.service[123596]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 04 20:07:37.908594 n-d-851028-13 devstack@n-api.service[123596]: Tue Oct 4 20:07:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9d6cb98b-15f6-4144-bcd7-e26bd005b380/action (ip 10.222.0.43) !!! Oct 04 20:07:37.913868 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-6347a755-900b-488f-b5db-bab67b661d97 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-179253720"}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:07:37.916253 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-6347a755-900b-488f-b5db-bab67b661d97 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] [instance: 9d6cb98b-15f6-4144-bcd7-e26bd005b380] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:07:37.928980 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6347a755-900b-488f-b5db-bab67b661d97 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:07:37.929522 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6347a755-900b-488f-b5db-bab67b661d97 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:07:37.929989 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6347a755-900b-488f-b5db-bab67b661d97 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:07:37.930704 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6347a755-900b-488f-b5db-bab67b661d97 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:07:37.931178 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6347a755-900b-488f-b5db-bab67b661d97 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:07:37.931627 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-6347a755-900b-488f-b5db-bab67b661d97 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:07:38.137771 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-6347a755-900b-488f-b5db-bab67b661d97 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] 10.222.0.43 "POST /compute/v2.1/servers/9d6cb98b-15f6-4144-bcd7-e26bd005b380/action" status: 202 len: 0 microversion: 2.1 time: 0.235618 Oct 04 20:07:38.138428 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 4162/7949] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 20:07:37 2022] POST /compute/v2.1/servers/9d6cb98b-15f6-4144-bcd7-e26bd005b380/action => generated 0 bytes in 237 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Oct 04 20:07:43.460913 n-d-851028-13 devstack@n-api.service[123595]: ERROR oslo.messaging._drivers.impl_rabbit [-] [457acf28-5277-4578-be2f-82b18e59b660] AMQP server on 10.222.0.43:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 20:07:43.461829 n-d-851028-13 devstack@n-api.service[123595]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b5b0be1f-cd68-4bfe-8e95-82ae6af61476] AMQP server on 10.222.0.43:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 20:07:43.462456 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:07:43.463373 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=32 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:07:43.476900 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-d7ccbf56-c7eb-4b35-8fc6-93d105f7345b req-4d298340-e737-4ac5-9de3-c7fa656562ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d6cb98b-15f6-4144-bcd7-e26bd005b380", "name": "network-vif-plugged", "status": "completed", "tag": "94427f5e-67ea-4f57-ac10-b594d9afe040"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:07:43.502218 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-d7ccbf56-c7eb-4b35-8fc6-93d105f7345b req-4d298340-e737-4ac5-9de3-c7fa656562ab service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:07:43.503187 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-d7ccbf56-c7eb-4b35-8fc6-93d105f7345b req-4d298340-e737-4ac5-9de3-c7fa656562ab service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:07:43.503861 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-d7ccbf56-c7eb-4b35-8fc6-93d105f7345b req-4d298340-e737-4ac5-9de3-c7fa656562ab service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:07:43.516126 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-d7ccbf56-c7eb-4b35-8fc6-93d105f7345b req-4d298340-e737-4ac5-9de3-c7fa656562ab service nova] Creating event network-vif-plugged:94427f5e-67ea-4f57-ac10-b594d9afe040 for instance 9d6cb98b-15f6-4144-bcd7-e26bd005b380 on n-h1-851028-13 Oct 04 20:07:43.522156 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-d7ccbf56-c7eb-4b35-8fc6-93d105f7345b req-4d298340-e737-4ac5-9de3-c7fa656562ab service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063666 Oct 04 20:07:43.523373 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3788/7950] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 20:07:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:07:51.731182 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-2c1f4bd5-87fa-4f64-aacc-07d0e3843f68 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-964052341", "imageRef": "327856d6-80e3-4a19-bb1a-4542312b94bd", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-353745904", "security_groups": [{"name": "tempest-secgroup-smoke-1044151799"}], "networks": [{"uuid": "948f7525-5263-4f46-b8a9-9c38feeb34a1"}]}} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:07:51.742753 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_api:SELECT=2 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:07:51.743610 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:07:51.765705 n-d-851028-13 devstack@n-api.service[123596]: INFO oslo.messaging._drivers.impl_rabbit [-] [c592c758-2dc3-4024-92b0-c949515e0281] Reconnected to AMQP server on 10.222.0.43:5672 via [amqp] client with port 52100. Oct 04 20:07:51.771758 n-d-851028-13 devstack@n-api.service[123596]: INFO oslo.messaging._drivers.impl_rabbit [-] [ced6bcbb-f7de-451e-861c-054aba6c81f5] Reconnected to AMQP server on 10.222.0.43:5672 via [amqp] client with port 52102. Oct 04 20:07:51.848170 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.network.neutron [None req-2c1f4bd5-87fa-4f64-aacc-07d0e3843f68 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] validate_networks() for [('948f7525-5263-4f46-b8a9-9c38feeb34a1', None, None, None, None, None)] {{(pid=123596) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:07:52.283034 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-2c1f4bd5-87fa-4f64-aacc-07d0e3843f68 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Flavor limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:07:52.283967 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-2c1f4bd5-87fa-4f64-aacc-07d0e3843f68 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Image limits 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:07:52.284464 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-2c1f4bd5-87fa-4f64-aacc-07d0e3843f68 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Flavor pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:07:52.284889 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-2c1f4bd5-87fa-4f64-aacc-07d0e3843f68 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Image pref 0:0:0 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:07:52.285337 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.virt.hardware [None req-2c1f4bd5-87fa-4f64-aacc-07d0e3843f68 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:07:52.294162 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2c1f4bd5-87fa-4f64-aacc-07d0e3843f68 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:07:52.294656 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2c1f4bd5-87fa-4f64-aacc-07d0e3843f68 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:07:52.295104 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2c1f4bd5-87fa-4f64-aacc-07d0e3843f68 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:07:52.295842 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2c1f4bd5-87fa-4f64-aacc-07d0e3843f68 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:07:52.296309 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2c1f4bd5-87fa-4f64-aacc-07d0e3843f68 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:07:52.296745 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-2c1f4bd5-87fa-4f64-aacc-07d0e3843f68 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:07:52.315797 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-2c1f4bd5-87fa-4f64-aacc-07d0e3843f68 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Getting quotas for project 1be6815aff7a416a8f668d2ac5d56693. Resources: {'ram', 'cores', 'instances'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:07:52.323323 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.quota [None req-2c1f4bd5-87fa-4f64-aacc-07d0e3843f68 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Getting quotas for user 56cb8c6c599143389b0a4b9e55423155 and project 1be6815aff7a416a8f668d2ac5d56693. Resources: {'ram', 'cores', 'instances'} {{(pid=123596) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:07:52.338013 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-2c1f4bd5-87fa-4f64-aacc-07d0e3843f68 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Going to run 1 instances... {{(pid=123596) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:07:52.340581 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-2c1f4bd5-87fa-4f64-aacc-07d0e3843f68 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] [instance: 86b8e817-3451-44b4-a642-4de45a937ea0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='327856d6-80e3-4a19-bb1a-4542312b94bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123596) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:07:52.390255 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-2c1f4bd5-87fa-4f64-aacc-07d0e3843f68 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.663328 Oct 04 20:07:52.390859 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 4163/7951] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 20:07:51 2022] POST /compute/v2.1/servers => generated 406 bytes in 665 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 20:07:52.404205 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-ee412701-e154-4a97-b6d2-aafe9f77c4b9 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:07:52.405657 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-ee412701-e154-4a97-b6d2-aafe9f77c4b9 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] [instance: 86b8e817-3451-44b4-a642-4de45a937ea0] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:07:52.434316 n-d-851028-13 devstack@n-api.service[123595]: INFO oslo.messaging._drivers.impl_rabbit [-] [457acf28-5277-4578-be2f-82b18e59b660] Reconnected to AMQP server on 10.222.0.43:5672 via [amqp] client with port 52116. Oct 04 20:07:52.435150 n-d-851028-13 devstack@n-api.service[123595]: INFO oslo.messaging._drivers.impl_rabbit [-] [b5b0be1f-cd68-4bfe-8e95-82ae6af61476] Reconnected to AMQP server on 10.222.0.43:5672 via [amqp] client with port 52118. Oct 04 20:07:52.477392 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-ee412701-e154-4a97-b6d2-aafe9f77c4b9 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56cb8c6c599143389b0a4b9e55423155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be6815aff7a416a8f668d2ac5d56693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:07:52.489851 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-ee412701-e154-4a97-b6d2-aafe9f77c4b9 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] 10.222.0.43 "GET /compute/v2.1/servers/86b8e817-3451-44b4-a642-4de45a937ea0" status: 200 len: 1247 microversion: 2.1 time: 0.091068 Oct 04 20:07:52.490820 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3789/7952] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 20:07:52 2022] GET /compute/v2.1/servers/86b8e817-3451-44b4-a642-4de45a937ea0 => generated 1247 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:07:53.529533 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-03cdf852-1094-4112-9fcf-a04913a808b2 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:07:53.532547 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-03cdf852-1094-4112-9fcf-a04913a808b2 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] [instance: 86b8e817-3451-44b4-a642-4de45a937ea0] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:07:53.543762 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-03cdf852-1094-4112-9fcf-a04913a808b2 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:07:53.544961 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-03cdf852-1094-4112-9fcf-a04913a808b2 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:07:53.545593 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-03cdf852-1094-4112-9fcf-a04913a808b2 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:07:53.546819 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-03cdf852-1094-4112-9fcf-a04913a808b2 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:07:53.547639 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-03cdf852-1094-4112-9fcf-a04913a808b2 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:07:53.548217 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-03cdf852-1094-4112-9fcf-a04913a808b2 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:07:53.646010 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-03cdf852-1094-4112-9fcf-a04913a808b2 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56cb8c6c599143389b0a4b9e55423155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be6815aff7a416a8f668d2ac5d56693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:07:53.659240 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-03cdf852-1094-4112-9fcf-a04913a808b2 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] 10.222.0.43 "GET /compute/v2.1/servers/86b8e817-3451-44b4-a642-4de45a937ea0" status: 200 len: 1307 microversion: 2.1 time: 0.135431 Oct 04 20:07:53.659961 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 4164/7953] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 20:07:53 2022] GET /compute/v2.1/servers/86b8e817-3451-44b4-a642-4de45a937ea0 => generated 1307 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:07:54.684232 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-27aabb57-ea1b-4de1-b278-498e15c140a4 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:07:54.684999 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-27aabb57-ea1b-4de1-b278-498e15c140a4 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] [instance: 86b8e817-3451-44b4-a642-4de45a937ea0] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:07:54.687568 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=2 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:07:54.702910 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-27aabb57-ea1b-4de1-b278-498e15c140a4 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:07:54.703418 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-27aabb57-ea1b-4de1-b278-498e15c140a4 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:07:54.703869 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-27aabb57-ea1b-4de1-b278-498e15c140a4 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:07:54.704600 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-27aabb57-ea1b-4de1-b278-498e15c140a4 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:07:54.705384 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-27aabb57-ea1b-4de1-b278-498e15c140a4 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:07:54.705991 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-27aabb57-ea1b-4de1-b278-498e15c140a4 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:07:54.915464 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-27aabb57-ea1b-4de1-b278-498e15c140a4 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56cb8c6c599143389b0a4b9e55423155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be6815aff7a416a8f668d2ac5d56693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:07:54.926446 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-27aabb57-ea1b-4de1-b278-498e15c140a4 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] 10.222.0.43 "GET /compute/v2.1/servers/86b8e817-3451-44b4-a642-4de45a937ea0" status: 200 len: 1373 microversion: 2.1 time: 0.246053 Oct 04 20:07:54.935788 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3790/7954] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 20:07:54 2022] GET /compute/v2.1/servers/86b8e817-3451-44b4-a642-4de45a937ea0 => generated 1373 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:07:55.449666 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-65d197aa-6fc5-4a09-8fcc-acb7bc653c65 req-20184057-ace1-4911-89eb-c136bf7703fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d6cb98b-15f6-4144-bcd7-e26bd005b380", "name": "network-vif-unplugged", "status": "completed", "tag": "94427f5e-67ea-4f57-ac10-b594d9afe040"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:07:55.460876 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-65d197aa-6fc5-4a09-8fcc-acb7bc653c65 req-20184057-ace1-4911-89eb-c136bf7703fa service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:07:55.461580 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-65d197aa-6fc5-4a09-8fcc-acb7bc653c65 req-20184057-ace1-4911-89eb-c136bf7703fa service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:07:55.462176 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-65d197aa-6fc5-4a09-8fcc-acb7bc653c65 req-20184057-ace1-4911-89eb-c136bf7703fa service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:07:55.475321 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-65d197aa-6fc5-4a09-8fcc-acb7bc653c65 req-20184057-ace1-4911-89eb-c136bf7703fa service nova] Creating event network-vif-unplugged:94427f5e-67ea-4f57-ac10-b594d9afe040 for instance 9d6cb98b-15f6-4144-bcd7-e26bd005b380 on n-h1-851028-13 Oct 04 20:07:55.481009 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-65d197aa-6fc5-4a09-8fcc-acb7bc653c65 req-20184057-ace1-4911-89eb-c136bf7703fa service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035524 Oct 04 20:07:55.482193 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 4165/7955] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 20:07:55 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:07:55.959694 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-1e64b17a-6782-4f8f-96fb-877cbda96e2b tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:07:55.960339 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-1e64b17a-6782-4f8f-96fb-877cbda96e2b tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] [instance: 86b8e817-3451-44b4-a642-4de45a937ea0] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:07:55.967274 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1e64b17a-6782-4f8f-96fb-877cbda96e2b tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:07:55.967767 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1e64b17a-6782-4f8f-96fb-877cbda96e2b tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:07:55.968211 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1e64b17a-6782-4f8f-96fb-877cbda96e2b tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:07:55.968918 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1e64b17a-6782-4f8f-96fb-877cbda96e2b tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:07:55.969404 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1e64b17a-6782-4f8f-96fb-877cbda96e2b tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:07:55.969843 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-1e64b17a-6782-4f8f-96fb-877cbda96e2b tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:07:56.124656 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-1e64b17a-6782-4f8f-96fb-877cbda96e2b tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56cb8c6c599143389b0a4b9e55423155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be6815aff7a416a8f668d2ac5d56693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:07:56.133392 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-1e64b17a-6782-4f8f-96fb-877cbda96e2b tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] 10.222.0.43 "GET /compute/v2.1/servers/86b8e817-3451-44b4-a642-4de45a937ea0" status: 200 len: 1373 microversion: 2.1 time: 0.177809 Oct 04 20:07:56.134061 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3791/7956] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 20:07:55 2022] GET /compute/v2.1/servers/86b8e817-3451-44b4-a642-4de45a937ea0 => generated 1373 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:07:57.159906 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-a0584018-7a14-4fca-9261-f4351b2dd6c5 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:07:57.160803 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-a0584018-7a14-4fca-9261-f4351b2dd6c5 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] [instance: 86b8e817-3451-44b4-a642-4de45a937ea0] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:07:57.168332 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a0584018-7a14-4fca-9261-f4351b2dd6c5 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:07:57.169158 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a0584018-7a14-4fca-9261-f4351b2dd6c5 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:07:57.169661 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a0584018-7a14-4fca-9261-f4351b2dd6c5 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:07:57.170401 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a0584018-7a14-4fca-9261-f4351b2dd6c5 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:07:57.170881 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a0584018-7a14-4fca-9261-f4351b2dd6c5 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:07:57.171332 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a0584018-7a14-4fca-9261-f4351b2dd6c5 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:07:57.322097 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-a0584018-7a14-4fca-9261-f4351b2dd6c5 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56cb8c6c599143389b0a4b9e55423155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be6815aff7a416a8f668d2ac5d56693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:07:57.339771 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-a0584018-7a14-4fca-9261-f4351b2dd6c5 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] 10.222.0.43 "GET /compute/v2.1/servers/86b8e817-3451-44b4-a642-4de45a937ea0" status: 200 len: 1373 microversion: 2.1 time: 0.186262 Oct 04 20:07:57.340791 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 4166/7957] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 20:07:57 2022] GET /compute/v2.1/servers/86b8e817-3451-44b4-a642-4de45a937ea0 => generated 1373 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:07:58.364563 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-b3ae5749-1f22-4b00-a56b-fb246a93b981 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:07:58.365205 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-b3ae5749-1f22-4b00-a56b-fb246a93b981 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] [instance: 86b8e817-3451-44b4-a642-4de45a937ea0] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:07:58.372084 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b3ae5749-1f22-4b00-a56b-fb246a93b981 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:07:58.372570 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b3ae5749-1f22-4b00-a56b-fb246a93b981 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:07:58.373013 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b3ae5749-1f22-4b00-a56b-fb246a93b981 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:07:58.373737 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b3ae5749-1f22-4b00-a56b-fb246a93b981 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:07:58.374189 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b3ae5749-1f22-4b00-a56b-fb246a93b981 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:07:58.374616 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-b3ae5749-1f22-4b00-a56b-fb246a93b981 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:07:58.551662 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-b3ae5749-1f22-4b00-a56b-fb246a93b981 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56cb8c6c599143389b0a4b9e55423155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be6815aff7a416a8f668d2ac5d56693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:07:58.580825 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-b3ae5749-1f22-4b00-a56b-fb246a93b981 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] 10.222.0.43 "GET /compute/v2.1/servers/86b8e817-3451-44b4-a642-4de45a937ea0" status: 200 len: 1373 microversion: 2.1 time: 0.219784 Oct 04 20:07:58.596438 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3792/7958] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 20:07:58 2022] GET /compute/v2.1/servers/86b8e817-3451-44b4-a642-4de45a937ea0 => generated 1373 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:07:59.612296 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-40863696-9e4d-4e8a-80d6-9e3df2bf81d7 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:07:59.615075 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-40863696-9e4d-4e8a-80d6-9e3df2bf81d7 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] [instance: 86b8e817-3451-44b4-a642-4de45a937ea0] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:07:59.630771 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-40863696-9e4d-4e8a-80d6-9e3df2bf81d7 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:07:59.632926 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-40863696-9e4d-4e8a-80d6-9e3df2bf81d7 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:07:59.634439 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-40863696-9e4d-4e8a-80d6-9e3df2bf81d7 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:07:59.635977 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-40863696-9e4d-4e8a-80d6-9e3df2bf81d7 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:07:59.636802 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-40863696-9e4d-4e8a-80d6-9e3df2bf81d7 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:07:59.637588 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-40863696-9e4d-4e8a-80d6-9e3df2bf81d7 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:07:59.782337 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-40863696-9e4d-4e8a-80d6-9e3df2bf81d7 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56cb8c6c599143389b0a4b9e55423155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be6815aff7a416a8f668d2ac5d56693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:07:59.791355 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-40863696-9e4d-4e8a-80d6-9e3df2bf81d7 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] 10.222.0.43 "GET /compute/v2.1/servers/86b8e817-3451-44b4-a642-4de45a937ea0" status: 200 len: 1373 microversion: 2.1 time: 0.188958 Oct 04 20:07:59.793141 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 4167/7959] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 20:07:59 2022] GET /compute/v2.1/servers/86b8e817-3451-44b4-a642-4de45a937ea0 => generated 1373 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:08:00.837079 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-c26b38da-a474-4791-a6b9-f5635d6aff73 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:08:00.839017 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-c26b38da-a474-4791-a6b9-f5635d6aff73 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] [instance: 86b8e817-3451-44b4-a642-4de45a937ea0] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:08:00.854197 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c26b38da-a474-4791-a6b9-f5635d6aff73 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:08:00.855052 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c26b38da-a474-4791-a6b9-f5635d6aff73 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:08:00.855811 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c26b38da-a474-4791-a6b9-f5635d6aff73 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:08:00.856993 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c26b38da-a474-4791-a6b9-f5635d6aff73 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:08:00.857556 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c26b38da-a474-4791-a6b9-f5635d6aff73 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:08:00.858041 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-c26b38da-a474-4791-a6b9-f5635d6aff73 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:08:01.018866 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-c26b38da-a474-4791-a6b9-f5635d6aff73 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56cb8c6c599143389b0a4b9e55423155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be6815aff7a416a8f668d2ac5d56693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:08:01.027482 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-c26b38da-a474-4791-a6b9-f5635d6aff73 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] 10.222.0.43 "GET /compute/v2.1/servers/86b8e817-3451-44b4-a642-4de45a937ea0" status: 200 len: 1373 microversion: 2.1 time: 0.200547 Oct 04 20:08:01.028178 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3793/7960] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 20:08:00 2022] GET /compute/v2.1/servers/86b8e817-3451-44b4-a642-4de45a937ea0 => generated 1373 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:08:02.053276 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-8d5ad580-8819-4fb0-92eb-56f24afae9b5 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:08:02.053696 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-8d5ad580-8819-4fb0-92eb-56f24afae9b5 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] [instance: 86b8e817-3451-44b4-a642-4de45a937ea0] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:08:02.064104 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8d5ad580-8819-4fb0-92eb-56f24afae9b5 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:08:02.064866 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8d5ad580-8819-4fb0-92eb-56f24afae9b5 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:08:02.065336 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8d5ad580-8819-4fb0-92eb-56f24afae9b5 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:08:02.066084 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8d5ad580-8819-4fb0-92eb-56f24afae9b5 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:08:02.066565 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8d5ad580-8819-4fb0-92eb-56f24afae9b5 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:08:02.067017 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-8d5ad580-8819-4fb0-92eb-56f24afae9b5 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:08:02.305183 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=2 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:08:02.317344 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-8d5ad580-8819-4fb0-92eb-56f24afae9b5 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56cb8c6c599143389b0a4b9e55423155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be6815aff7a416a8f668d2ac5d56693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:08:02.325376 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-8d5ad580-8819-4fb0-92eb-56f24afae9b5 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] 10.222.0.43 "GET /compute/v2.1/servers/86b8e817-3451-44b4-a642-4de45a937ea0" status: 200 len: 1373 microversion: 2.1 time: 0.277016 Oct 04 20:08:02.325964 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 4168/7961] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 20:08:02 2022] GET /compute/v2.1/servers/86b8e817-3451-44b4-a642-4de45a937ea0 => generated 1373 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:08:03.348416 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-3f2896aa-9559-4c59-a2ab-bf9ca12bc794 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:08:03.349478 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-3f2896aa-9559-4c59-a2ab-bf9ca12bc794 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] [instance: 86b8e817-3451-44b4-a642-4de45a937ea0] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:08:03.352646 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell0:SELECT=2 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:08:03.359544 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3f2896aa-9559-4c59-a2ab-bf9ca12bc794 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:08:03.360047 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3f2896aa-9559-4c59-a2ab-bf9ca12bc794 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:08:03.360504 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3f2896aa-9559-4c59-a2ab-bf9ca12bc794 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:08:03.361751 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3f2896aa-9559-4c59-a2ab-bf9ca12bc794 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:08:03.362222 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3f2896aa-9559-4c59-a2ab-bf9ca12bc794 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:08:03.362655 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3f2896aa-9559-4c59-a2ab-bf9ca12bc794 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:08:03.568747 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-3f2896aa-9559-4c59-a2ab-bf9ca12bc794 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56cb8c6c599143389b0a4b9e55423155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be6815aff7a416a8f668d2ac5d56693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:08:03.577044 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-3f2896aa-9559-4c59-a2ab-bf9ca12bc794 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] 10.222.0.43 "GET /compute/v2.1/servers/86b8e817-3451-44b4-a642-4de45a937ea0" status: 200 len: 1373 microversion: 2.1 time: 0.232828 Oct 04 20:08:03.577683 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3794/7962] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 20:08:03 2022] GET /compute/v2.1/servers/86b8e817-3451-44b4-a642-4de45a937ea0 => generated 1373 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:08:03.687452 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell0:SELECT=6 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:08:03.762095 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-709d16e7-8693-4ca9-9570-81907d65e215 req-bf598edd-cfb8-4029-b485-bd82170fd4c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86b8e817-3451-44b4-a642-4de45a937ea0", "tag": "58120e84-4275-4b7e-bbd5-e76850e96fd3"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:08:03.772119 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-709d16e7-8693-4ca9-9570-81907d65e215 req-bf598edd-cfb8-4029-b485-bd82170fd4c2 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:08:03.773256 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-709d16e7-8693-4ca9-9570-81907d65e215 req-bf598edd-cfb8-4029-b485-bd82170fd4c2 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:08:03.773256 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-709d16e7-8693-4ca9-9570-81907d65e215 req-bf598edd-cfb8-4029-b485-bd82170fd4c2 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:08:03.785167 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-709d16e7-8693-4ca9-9570-81907d65e215 req-bf598edd-cfb8-4029-b485-bd82170fd4c2 service nova] Creating event network-changed:58120e84-4275-4b7e-bbd5-e76850e96fd3 for instance 86b8e817-3451-44b4-a642-4de45a937ea0 on n-h2-851028-13 Oct 04 20:08:03.790149 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-709d16e7-8693-4ca9-9570-81907d65e215 req-bf598edd-cfb8-4029-b485-bd82170fd4c2 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109284 Oct 04 20:08:03.790756 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 4169/7963] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 20:08:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:08:04.601640 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-ea16c9b5-9b71-44a7-bb29-0d229d4bddd0 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:08:04.602669 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-ea16c9b5-9b71-44a7-bb29-0d229d4bddd0 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] [instance: 86b8e817-3451-44b4-a642-4de45a937ea0] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:08:04.609701 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ea16c9b5-9b71-44a7-bb29-0d229d4bddd0 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:08:04.610185 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ea16c9b5-9b71-44a7-bb29-0d229d4bddd0 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:08:04.610629 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ea16c9b5-9b71-44a7-bb29-0d229d4bddd0 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:08:04.611321 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ea16c9b5-9b71-44a7-bb29-0d229d4bddd0 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:08:04.611779 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ea16c9b5-9b71-44a7-bb29-0d229d4bddd0 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:08:04.612211 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-ea16c9b5-9b71-44a7-bb29-0d229d4bddd0 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:08:04.753577 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-ea16c9b5-9b71-44a7-bb29-0d229d4bddd0 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56cb8c6c599143389b0a4b9e55423155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be6815aff7a416a8f668d2ac5d56693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:08:04.761357 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-ea16c9b5-9b71-44a7-bb29-0d229d4bddd0 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] 10.222.0.43 "GET /compute/v2.1/servers/86b8e817-3451-44b4-a642-4de45a937ea0" status: 200 len: 1373 microversion: 2.1 time: 0.163648 Oct 04 20:08:04.761948 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3795/7964] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 20:08:04 2022] GET /compute/v2.1/servers/86b8e817-3451-44b4-a642-4de45a937ea0 => generated 1373 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:08:05.786302 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-e1e3740e-cc97-4804-b927-87a5fdfba8d9 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:08:05.787327 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-e1e3740e-cc97-4804-b927-87a5fdfba8d9 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] [instance: 86b8e817-3451-44b4-a642-4de45a937ea0] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:08:05.794282 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e1e3740e-cc97-4804-b927-87a5fdfba8d9 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:08:05.794720 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e1e3740e-cc97-4804-b927-87a5fdfba8d9 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:08:05.795187 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e1e3740e-cc97-4804-b927-87a5fdfba8d9 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:08:05.795916 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e1e3740e-cc97-4804-b927-87a5fdfba8d9 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:08:05.796393 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e1e3740e-cc97-4804-b927-87a5fdfba8d9 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:08:05.796837 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-e1e3740e-cc97-4804-b927-87a5fdfba8d9 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:08:05.951055 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-e1e3740e-cc97-4804-b927-87a5fdfba8d9 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56cb8c6c599143389b0a4b9e55423155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be6815aff7a416a8f668d2ac5d56693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:08:05.962085 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-e1e3740e-cc97-4804-b927-87a5fdfba8d9 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] 10.222.0.43 "GET /compute/v2.1/servers/86b8e817-3451-44b4-a642-4de45a937ea0" status: 200 len: 1373 microversion: 2.1 time: 0.181369 Oct 04 20:08:05.962896 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 4170/7965] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 20:08:05 2022] GET /compute/v2.1/servers/86b8e817-3451-44b4-a642-4de45a937ea0 => generated 1373 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:08:06.989662 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-754764f6-225e-4127-bd97-9d7a943b6d26 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:08:06.990363 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-754764f6-225e-4127-bd97-9d7a943b6d26 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] [instance: 86b8e817-3451-44b4-a642-4de45a937ea0] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:08:06.998942 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-754764f6-225e-4127-bd97-9d7a943b6d26 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:08:06.999671 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-754764f6-225e-4127-bd97-9d7a943b6d26 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:08:07.000354 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-754764f6-225e-4127-bd97-9d7a943b6d26 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:08:07.001497 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-754764f6-225e-4127-bd97-9d7a943b6d26 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:08:07.001959 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-754764f6-225e-4127-bd97-9d7a943b6d26 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:08:07.002394 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-754764f6-225e-4127-bd97-9d7a943b6d26 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:08:07.145689 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-754764f6-225e-4127-bd97-9d7a943b6d26 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56cb8c6c599143389b0a4b9e55423155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be6815aff7a416a8f668d2ac5d56693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:08:07.153722 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-754764f6-225e-4127-bd97-9d7a943b6d26 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] 10.222.0.43 "GET /compute/v2.1/servers/86b8e817-3451-44b4-a642-4de45a937ea0" status: 200 len: 1373 microversion: 2.1 time: 0.170615 Oct 04 20:08:07.154314 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3796/7966] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 20:08:06 2022] GET /compute/v2.1/servers/86b8e817-3451-44b4-a642-4de45a937ea0 => generated 1373 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:08:07.457323 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-f7ffe0a1-419f-4e3b-8235-65be4c23761c req-17589f84-c320-45aa-b719-a8d628a6db18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86b8e817-3451-44b4-a642-4de45a937ea0", "name": "network-vif-plugged", "status": "completed", "tag": "58120e84-4275-4b7e-bbd5-e76850e96fd3"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:08:07.469104 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-f7ffe0a1-419f-4e3b-8235-65be4c23761c req-17589f84-c320-45aa-b719-a8d628a6db18 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:08:07.469635 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-f7ffe0a1-419f-4e3b-8235-65be4c23761c req-17589f84-c320-45aa-b719-a8d628a6db18 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:08:07.470089 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-f7ffe0a1-419f-4e3b-8235-65be4c23761c req-17589f84-c320-45aa-b719-a8d628a6db18 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:08:07.482933 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-f7ffe0a1-419f-4e3b-8235-65be4c23761c req-17589f84-c320-45aa-b719-a8d628a6db18 service nova] Creating event network-vif-plugged:58120e84-4275-4b7e-bbd5-e76850e96fd3 for instance 86b8e817-3451-44b4-a642-4de45a937ea0 on n-h2-851028-13 Oct 04 20:08:07.488537 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-f7ffe0a1-419f-4e3b-8235-65be4c23761c req-17589f84-c320-45aa-b719-a8d628a6db18 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035073 Oct 04 20:08:07.489461 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 4171/7967] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 20:08:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:08:08.176908 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-81e8f931-b846-4f0a-ac1d-03bdb456bcac tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:08:08.177566 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-81e8f931-b846-4f0a-ac1d-03bdb456bcac tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] [instance: 86b8e817-3451-44b4-a642-4de45a937ea0] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:08:08.184951 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-81e8f931-b846-4f0a-ac1d-03bdb456bcac tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:08:08.185482 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-81e8f931-b846-4f0a-ac1d-03bdb456bcac tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:08:08.185950 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-81e8f931-b846-4f0a-ac1d-03bdb456bcac tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:08:08.186658 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-81e8f931-b846-4f0a-ac1d-03bdb456bcac tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:08:08.187146 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-81e8f931-b846-4f0a-ac1d-03bdb456bcac tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:08:08.187581 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-81e8f931-b846-4f0a-ac1d-03bdb456bcac tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:08:08.321064 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-81e8f931-b846-4f0a-ac1d-03bdb456bcac tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56cb8c6c599143389b0a4b9e55423155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be6815aff7a416a8f668d2ac5d56693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:08:08.329444 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-81e8f931-b846-4f0a-ac1d-03bdb456bcac tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] 10.222.0.43 "GET /compute/v2.1/servers/86b8e817-3451-44b4-a642-4de45a937ea0" status: 200 len: 1373 microversion: 2.1 time: 0.156552 Oct 04 20:08:08.330615 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3797/7968] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 20:08:08 2022] GET /compute/v2.1/servers/86b8e817-3451-44b4-a642-4de45a937ea0 => generated 1373 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:08:09.353882 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-58afcb02-d2ae-40e3-bbed-52e52836a80c tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:08:09.354606 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-58afcb02-d2ae-40e3-bbed-52e52836a80c tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] [instance: 86b8e817-3451-44b4-a642-4de45a937ea0] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:08:09.361387 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-58afcb02-d2ae-40e3-bbed-52e52836a80c tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:08:09.361892 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-58afcb02-d2ae-40e3-bbed-52e52836a80c tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:08:09.362355 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-58afcb02-d2ae-40e3-bbed-52e52836a80c tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:08:09.363070 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-58afcb02-d2ae-40e3-bbed-52e52836a80c tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:08:09.363542 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-58afcb02-d2ae-40e3-bbed-52e52836a80c tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:08:09.363989 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-58afcb02-d2ae-40e3-bbed-52e52836a80c tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:08:09.503794 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-58afcb02-d2ae-40e3-bbed-52e52836a80c tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56cb8c6c599143389b0a4b9e55423155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be6815aff7a416a8f668d2ac5d56693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:08:09.511819 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-58afcb02-d2ae-40e3-bbed-52e52836a80c tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] 10.222.0.43 "GET /compute/v2.1/servers/86b8e817-3451-44b4-a642-4de45a937ea0" status: 200 len: 1559 microversion: 2.1 time: 0.163195 Oct 04 20:08:09.512408 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 4172/7969] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 20:08:09 2022] GET /compute/v2.1/servers/86b8e817-3451-44b4-a642-4de45a937ea0 => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:08:09.534645 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-9211ed09-42e2-49e1-8050-ddce3f3efb1d tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:08:09.535271 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-9211ed09-42e2-49e1-8050-ddce3f3efb1d tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] [instance: 86b8e817-3451-44b4-a642-4de45a937ea0] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:08:09.542376 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9211ed09-42e2-49e1-8050-ddce3f3efb1d tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:08:09.542870 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9211ed09-42e2-49e1-8050-ddce3f3efb1d tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:08:09.543317 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9211ed09-42e2-49e1-8050-ddce3f3efb1d tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:08:09.544021 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9211ed09-42e2-49e1-8050-ddce3f3efb1d tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:08:09.544517 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9211ed09-42e2-49e1-8050-ddce3f3efb1d tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:08:09.545033 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9211ed09-42e2-49e1-8050-ddce3f3efb1d tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:08:09.680808 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-9211ed09-42e2-49e1-8050-ddce3f3efb1d tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56cb8c6c599143389b0a4b9e55423155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be6815aff7a416a8f668d2ac5d56693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:08:09.688652 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-9211ed09-42e2-49e1-8050-ddce3f3efb1d tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] 10.222.0.43 "GET /compute/v2.1/servers/86b8e817-3451-44b4-a642-4de45a937ea0" status: 200 len: 1559 microversion: 2.1 time: 0.158641 Oct 04 20:08:09.689248 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3798/7970] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 20:08:09 2022] GET /compute/v2.1/servers/86b8e817-3451-44b4-a642-4de45a937ea0 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:08:11.656218 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-fa1cd18b-55fd-4b9d-89da-f88683ef0bb1 req-0f8725ac-34f4-4110-b629-7606f60b722a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86b8e817-3451-44b4-a642-4de45a937ea0", "tag": "58120e84-4275-4b7e-bbd5-e76850e96fd3"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:08:11.667150 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-fa1cd18b-55fd-4b9d-89da-f88683ef0bb1 req-0f8725ac-34f4-4110-b629-7606f60b722a service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:08:11.667740 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-fa1cd18b-55fd-4b9d-89da-f88683ef0bb1 req-0f8725ac-34f4-4110-b629-7606f60b722a service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:08:11.668266 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-fa1cd18b-55fd-4b9d-89da-f88683ef0bb1 req-0f8725ac-34f4-4110-b629-7606f60b722a service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:08:11.683383 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-fa1cd18b-55fd-4b9d-89da-f88683ef0bb1 req-0f8725ac-34f4-4110-b629-7606f60b722a service nova] Creating event network-changed:58120e84-4275-4b7e-bbd5-e76850e96fd3 for instance 86b8e817-3451-44b4-a642-4de45a937ea0 on n-h2-851028-13 Oct 04 20:08:11.691697 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-fa1cd18b-55fd-4b9d-89da-f88683ef0bb1 req-0f8725ac-34f4-4110-b629-7606f60b722a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039117 Oct 04 20:08:11.692585 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 4173/7971] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 20:08:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:09:39.038196 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_api:SELECT=24 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:09:39.038834 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=54 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:09:39.039634 n-d-851028-13 devstack@n-api.service[123595]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 20:09:39.039795 n-d-851028-13 devstack@n-api.service[123595]: Tue Oct 4 20:09:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/86b8e817-3451-44b4-a642-4de45a937ea0/action (ip 10.222.0.43) !!! Oct 04 20:09:39.041159 n-d-851028-13 devstack@n-api.service[123595]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 20:09:39.041290 n-d-851028-13 devstack@n-api.service[123595]: Tue Oct 4 20:09:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/86b8e817-3451-44b4-a642-4de45a937ea0/action (ip 10.222.0.43) !!! Oct 04 20:09:39.045865 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-55e125f2-d6ed-464c-8a27-1301d77dd7f3 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-1986487915"}} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:09:39.048188 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-55e125f2-d6ed-464c-8a27-1301d77dd7f3 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] [instance: 86b8e817-3451-44b4-a642-4de45a937ea0] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:09:39.058513 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-55e125f2-d6ed-464c-8a27-1301d77dd7f3 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:09:39.059005 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-55e125f2-d6ed-464c-8a27-1301d77dd7f3 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:09:39.059442 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-55e125f2-d6ed-464c-8a27-1301d77dd7f3 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:09:39.060142 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-55e125f2-d6ed-464c-8a27-1301d77dd7f3 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:09:39.060590 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-55e125f2-d6ed-464c-8a27-1301d77dd7f3 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:09:39.061015 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-55e125f2-d6ed-464c-8a27-1301d77dd7f3 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:09:39.277023 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-55e125f2-d6ed-464c-8a27-1301d77dd7f3 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] 10.222.0.43 "POST /compute/v2.1/servers/86b8e817-3451-44b4-a642-4de45a937ea0/action" status: 202 len: 0 microversion: 2.1 time: 0.240712 Oct 04 20:09:39.277717 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3799/7972] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 20:09:39 2022] POST /compute/v2.1/servers/86b8e817-3451-44b4-a642-4de45a937ea0/action => generated 0 bytes in 242 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 04 20:09:44.100866 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:09:44.101810 n-d-851028-13 devstack@n-api.service[123596]: DEBUG dbcounter [-] [123596] Writing DB stats nova_cell1:SELECT=46 {{(pid=123596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:09:44.102732 n-d-851028-13 devstack@n-api.service[123596]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 20:09:44.103047 n-d-851028-13 devstack@n-api.service[123596]: Tue Oct 4 20:09:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.43) !!! Oct 04 20:09:44.109814 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-130d8e4b-ad77-471e-9a49-7c41c6ba0b63 req-f09e6a17-7d31-4af6-8a54-c769a6e20f96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86b8e817-3451-44b4-a642-4de45a937ea0", "name": "network-vif-plugged", "status": "completed", "tag": "58120e84-4275-4b7e-bbd5-e76850e96fd3"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:09:44.151842 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-130d8e4b-ad77-471e-9a49-7c41c6ba0b63 req-f09e6a17-7d31-4af6-8a54-c769a6e20f96 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:09:44.152816 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-130d8e4b-ad77-471e-9a49-7c41c6ba0b63 req-f09e6a17-7d31-4af6-8a54-c769a6e20f96 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:09:44.153692 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-130d8e4b-ad77-471e-9a49-7c41c6ba0b63 req-f09e6a17-7d31-4af6-8a54-c769a6e20f96 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:09:44.167918 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-130d8e4b-ad77-471e-9a49-7c41c6ba0b63 req-f09e6a17-7d31-4af6-8a54-c769a6e20f96 service nova] Creating event network-vif-plugged:58120e84-4275-4b7e-bbd5-e76850e96fd3 for instance 86b8e817-3451-44b4-a642-4de45a937ea0 on n-h2-851028-13 Oct 04 20:09:44.180610 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-130d8e4b-ad77-471e-9a49-7c41c6ba0b63 req-f09e6a17-7d31-4af6-8a54-c769a6e20f96 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080769 Oct 04 20:09:44.181979 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 4174/7973] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 20:09:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:09:54.017414 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_api:SELECT=2 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:09:54.018844 n-d-851028-13 devstack@n-api.service[123595]: DEBUG dbcounter [-] [123595] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:09:54.023209 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-a1ca3298-1363-4db3-95af-b01b67d7a54e tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:09:54.024482 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-ce450ee3-75d3-4557-978e-eaa7c1b27ec3 req-28dc1497-5e3c-452c-846f-65cc98012bcc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86b8e817-3451-44b4-a642-4de45a937ea0", "tag": "58120e84-4275-4b7e-bbd5-e76850e96fd3"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:09:54.025952 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-a1ca3298-1363-4db3-95af-b01b67d7a54e tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] [instance: 86b8e817-3451-44b4-a642-4de45a937ea0] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:09:54.034609 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a1ca3298-1363-4db3-95af-b01b67d7a54e tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:09:54.035440 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a1ca3298-1363-4db3-95af-b01b67d7a54e tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:09:54.036137 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a1ca3298-1363-4db3-95af-b01b67d7a54e tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:09:54.036587 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-ce450ee3-75d3-4557-978e-eaa7c1b27ec3 req-28dc1497-5e3c-452c-846f-65cc98012bcc service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:09:54.036972 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a1ca3298-1363-4db3-95af-b01b67d7a54e tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:09:54.037148 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-ce450ee3-75d3-4557-978e-eaa7c1b27ec3 req-28dc1497-5e3c-452c-846f-65cc98012bcc service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:09:54.037581 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-ce450ee3-75d3-4557-978e-eaa7c1b27ec3 req-28dc1497-5e3c-452c-846f-65cc98012bcc service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:09:54.037862 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a1ca3298-1363-4db3-95af-b01b67d7a54e tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:09:54.038372 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-a1ca3298-1363-4db3-95af-b01b67d7a54e tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:09:54.049664 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-ce450ee3-75d3-4557-978e-eaa7c1b27ec3 req-28dc1497-5e3c-452c-846f-65cc98012bcc service nova] Creating event network-changed:58120e84-4275-4b7e-bbd5-e76850e96fd3 for instance 86b8e817-3451-44b4-a642-4de45a937ea0 on n-h2-851028-13 Oct 04 20:09:54.056434 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-ce450ee3-75d3-4557-978e-eaa7c1b27ec3 req-28dc1497-5e3c-452c-846f-65cc98012bcc service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037846 Oct 04 20:09:54.056434 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 4175/7974] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 20:09:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:09:54.078260 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-a1ca3298-1363-4db3-95af-b01b67d7a54e tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] [instance: 86b8e817-3451-44b4-a642-4de45a937ea0] Going to try to terminate instance {{(pid=123595) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:09:54.165486 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-a1ca3298-1363-4db3-95af-b01b67d7a54e tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] 10.222.0.43 "DELETE /compute/v2.1/servers/86b8e817-3451-44b4-a642-4de45a937ea0" status: 204 len: 0 microversion: 2.1 time: 0.150036 Oct 04 20:09:54.169480 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3800/7975] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 20:09:54 2022] DELETE /compute/v2.1/servers/86b8e817-3451-44b4-a642-4de45a937ea0 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:09:54.175852 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-dcb7ac38-1dc5-44b8-8b9a-22ac083f30c4 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:09:54.176624 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-dcb7ac38-1dc5-44b8-8b9a-22ac083f30c4 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] [instance: 86b8e817-3451-44b4-a642-4de45a937ea0] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:09:54.183017 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dcb7ac38-1dc5-44b8-8b9a-22ac083f30c4 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:09:54.183704 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dcb7ac38-1dc5-44b8-8b9a-22ac083f30c4 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:09:54.184165 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dcb7ac38-1dc5-44b8-8b9a-22ac083f30c4 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:09:54.184878 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dcb7ac38-1dc5-44b8-8b9a-22ac083f30c4 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:09:54.185888 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dcb7ac38-1dc5-44b8-8b9a-22ac083f30c4 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:09:54.186334 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-dcb7ac38-1dc5-44b8-8b9a-22ac083f30c4 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:09:54.329596 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-dcb7ac38-1dc5-44b8-8b9a-22ac083f30c4 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56cb8c6c599143389b0a4b9e55423155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be6815aff7a416a8f668d2ac5d56693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:09:54.337389 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-dcb7ac38-1dc5-44b8-8b9a-22ac083f30c4 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] 10.222.0.43 "GET /compute/v2.1/servers/86b8e817-3451-44b4-a642-4de45a937ea0" status: 200 len: 1684 microversion: 2.1 time: 0.166322 Oct 04 20:09:54.337977 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 4176/7976] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 20:09:54 2022] GET /compute/v2.1/servers/86b8e817-3451-44b4-a642-4de45a937ea0 => generated 1684 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:09:55.361484 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-9039e27d-169a-4815-884a-a083a75cf750 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:09:55.362190 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-9039e27d-169a-4815-884a-a083a75cf750 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] [instance: 86b8e817-3451-44b4-a642-4de45a937ea0] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:09:55.369100 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9039e27d-169a-4815-884a-a083a75cf750 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:09:55.369632 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9039e27d-169a-4815-884a-a083a75cf750 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:09:55.370076 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9039e27d-169a-4815-884a-a083a75cf750 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:09:55.370781 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9039e27d-169a-4815-884a-a083a75cf750 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:09:55.371338 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9039e27d-169a-4815-884a-a083a75cf750 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:09:55.371771 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-9039e27d-169a-4815-884a-a083a75cf750 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:09:55.577330 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-9039e27d-169a-4815-884a-a083a75cf750 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56cb8c6c599143389b0a4b9e55423155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be6815aff7a416a8f668d2ac5d56693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:09:55.585208 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-9039e27d-169a-4815-884a-a083a75cf750 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] 10.222.0.43 "GET /compute/v2.1/servers/86b8e817-3451-44b4-a642-4de45a937ea0" status: 200 len: 1684 microversion: 2.1 time: 0.228000 Oct 04 20:09:55.585804 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3801/7977] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 20:09:55 2022] GET /compute/v2.1/servers/86b8e817-3451-44b4-a642-4de45a937ea0 => generated 1684 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:09:56.047944 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [req-98a7f21f-4f92-4c2f-b395-69991977988c req-fa842d3a-4099-42a3-9031-8a1134e05c4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86b8e817-3451-44b4-a642-4de45a937ea0", "name": "network-vif-unplugged", "status": "completed", "tag": "58120e84-4275-4b7e-bbd5-e76850e96fd3"}]} {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:09:56.068594 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-98a7f21f-4f92-4c2f-b395-69991977988c req-fa842d3a-4099-42a3-9031-8a1134e05c4e service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:09:56.069186 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-98a7f21f-4f92-4c2f-b395-69991977988c req-fa842d3a-4099-42a3-9031-8a1134e05c4e service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:09:56.069951 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [req-98a7f21f-4f92-4c2f-b395-69991977988c req-fa842d3a-4099-42a3-9031-8a1134e05c4e service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:09:56.083327 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.compute.server_external_events [req-98a7f21f-4f92-4c2f-b395-69991977988c req-fa842d3a-4099-42a3-9031-8a1134e05c4e service nova] Creating event network-vif-unplugged:58120e84-4275-4b7e-bbd5-e76850e96fd3 for instance 86b8e817-3451-44b4-a642-4de45a937ea0 on n-h2-851028-13 Oct 04 20:09:56.090485 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [req-98a7f21f-4f92-4c2f-b395-69991977988c req-fa842d3a-4099-42a3-9031-8a1134e05c4e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.052780 Oct 04 20:09:56.091113 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 4177/7978] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 20:09:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:09:56.220278 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-349943ab-a139-40f7-a6a7-ce09ff860ad7 req-4f8fdc18-bfb7-4b9f-afc6-0ede6ab9765f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86b8e817-3451-44b4-a642-4de45a937ea0", "name": "network-vif-deleted", "tag": "58120e84-4275-4b7e-bbd5-e76850e96fd3"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:09:56.240890 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-349943ab-a139-40f7-a6a7-ce09ff860ad7 req-4f8fdc18-bfb7-4b9f-afc6-0ede6ab9765f service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:09:56.241724 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-349943ab-a139-40f7-a6a7-ce09ff860ad7 req-4f8fdc18-bfb7-4b9f-afc6-0ede6ab9765f service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:09:56.242326 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-349943ab-a139-40f7-a6a7-ce09ff860ad7 req-4f8fdc18-bfb7-4b9f-afc6-0ede6ab9765f service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:09:56.256736 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-349943ab-a139-40f7-a6a7-ce09ff860ad7 req-4f8fdc18-bfb7-4b9f-afc6-0ede6ab9765f service nova] Creating event network-vif-deleted:58120e84-4275-4b7e-bbd5-e76850e96fd3 for instance 86b8e817-3451-44b4-a642-4de45a937ea0 on n-h2-851028-13 Oct 04 20:09:56.263217 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-349943ab-a139-40f7-a6a7-ce09ff860ad7 req-4f8fdc18-bfb7-4b9f-afc6-0ede6ab9765f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046783 Oct 04 20:09:56.264152 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3802/7979] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 20:09:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:09:56.611060 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-a8e375fd-fb61-479e-bb2e-773ed329c91c tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:09:56.611796 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-a8e375fd-fb61-479e-bb2e-773ed329c91c tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] [instance: 86b8e817-3451-44b4-a642-4de45a937ea0] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:09:56.618790 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a8e375fd-fb61-479e-bb2e-773ed329c91c tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:09:56.619315 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a8e375fd-fb61-479e-bb2e-773ed329c91c tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:09:56.619794 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a8e375fd-fb61-479e-bb2e-773ed329c91c tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:09:56.620528 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a8e375fd-fb61-479e-bb2e-773ed329c91c tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:09:56.621010 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a8e375fd-fb61-479e-bb2e-773ed329c91c tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:09:56.621488 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a8e375fd-fb61-479e-bb2e-773ed329c91c tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:09:56.662298 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a8e375fd-fb61-479e-bb2e-773ed329c91c tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:09:56.662812 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a8e375fd-fb61-479e-bb2e-773ed329c91c tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:09:56.663275 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-a8e375fd-fb61-479e-bb2e-773ed329c91c tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:09:56.663756 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.objects.instance [None req-a8e375fd-fb61-479e-bb2e-773ed329c91c tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Lazy-loading 'fault' on Instance uuid 86b8e817-3451-44b4-a642-4de45a937ea0 {{(pid=123596) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:09:56.707993 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-a8e375fd-fb61-479e-bb2e-773ed329c91c tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56cb8c6c599143389b0a4b9e55423155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be6815aff7a416a8f668d2ac5d56693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:09:56.717031 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-a8e375fd-fb61-479e-bb2e-773ed329c91c tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] 10.222.0.43 "GET /compute/v2.1/servers/86b8e817-3451-44b4-a642-4de45a937ea0" status: 200 len: 1337 microversion: 2.1 time: 0.110401 Oct 04 20:09:56.717668 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 4178/7980] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 20:09:56 2022] GET /compute/v2.1/servers/86b8e817-3451-44b4-a642-4de45a937ea0 => generated 1337 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:09:57.742395 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-3dc8c3d7-042d-4556-bba1-10871ea6262a tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:09:57.743102 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-3dc8c3d7-042d-4556-bba1-10871ea6262a tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] [instance: 86b8e817-3451-44b4-a642-4de45a937ea0] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:09:57.750889 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3dc8c3d7-042d-4556-bba1-10871ea6262a tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:09:57.751376 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3dc8c3d7-042d-4556-bba1-10871ea6262a tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:09:57.751821 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3dc8c3d7-042d-4556-bba1-10871ea6262a tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:09:57.752525 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3dc8c3d7-042d-4556-bba1-10871ea6262a tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:09:57.752987 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3dc8c3d7-042d-4556-bba1-10871ea6262a tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:09:57.753447 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-3dc8c3d7-042d-4556-bba1-10871ea6262a tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:09:57.767023 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-3dc8c3d7-042d-4556-bba1-10871ea6262a tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] HTTP exception thrown: Instance 86b8e817-3451-44b4-a642-4de45a937ea0 could not be found. Oct 04 20:09:57.768738 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-3dc8c3d7-042d-4556-bba1-10871ea6262a tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Request method failure captured: Oct 04 20:09:57.768738 n-d-851028-13 devstack@n-api.service[123595]: request: GET /compute/v2.1/servers/86b8e817-3451-44b4-a642-4de45a937ea0 HTTP/1.1 Oct 04 20:09:57.768738 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 20:09:57.768738 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 20:09:57.768738 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 20:09:57.768738 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 0 Oct 04 20:09:57.768738 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 20:09:57.768738 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 20:09:57.768738 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 20:09:57.768738 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 20:09:57.768738 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPJICZuUjHU73D6dMdGDfCI0Hg2EvapEqa3GEGz8rV0zS8i-54FPqepexgg2m3Jk_hwbB0t7f95oACdZ84TtAiw2cMd93sizZl-KLTON_BdaIw91tsYSVwQh7tVeu-L88HORHCStOa0VqNgbV0PbnLufAmbzPV1BfUFw9FFJJ8mYqnUc Oct 04 20:09:57.768738 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 20:09:57.768738 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 20:09:57.768738 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 20:09:57.768738 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 20:09:57.768738 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 20:09:57.768738 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 20:09:57.768738 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: 1be6815aff7a416a8f668d2ac5d56693 Oct 04 20:09:57.768738 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-TestSnapshotPattern-169555681 Oct 04 20:09:57.768738 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 20:09:57.768738 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 20:09:57.768738 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/1be6815aff7a416a8f668d2ac5d56693"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_1be6815aff7a416a8f668d2ac5d56693"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1be6815aff7a416a8f668d2ac5d56693"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1be6815aff7a416a8f668d2ac5d56693"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 20:09:57.768738 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-TestSnapshotPattern-169555681 Oct 04 20:09:57.768738 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: 1be6815aff7a416a8f668d2ac5d56693 Oct 04 20:09:57.768738 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-TestSnapshotPattern-169555681 Oct 04 20:09:57.768738 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-TestSnapshotPattern-169555681-project Oct 04 20:09:57.768738 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 20:09:57.768738 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 20:09:57.768738 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: 56cb8c6c599143389b0a4b9e55423155 Oct 04 20:09:57.768738 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-TestSnapshotPattern-169555681-project Oct 04 20:09:57.768738 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 20:09:57.768738 n-d-851028-13 devstack@n-api.service[123595]: exception: Instance 86b8e817-3451-44b4-a642-4de45a937ea0 could not be found. Oct 04 20:09:57.768738 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': '86b8e817-3451-44b4-a642-4de45a937ea0'} Oct 04 20:09:57.768738 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:09:57.768738 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:09:57.768738 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:09:57.768738 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:09:57.768738 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:09:57.768738 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:09:57.768738 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:09:57.768738 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:09:57.768738 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:09:57.768738 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:09:57.768738 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86b8e817-3451-44b4-a642-4de45a937ea0 could not be found. Oct 04 20:09:57.768738 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 20:09:57.768738 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:09:57.768738 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 20:09:57.768738 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:09:57.768738 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:09:57.768738 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:09:57.768738 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:09:57.768738 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:09:57.768738 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:09:57.768738 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:09:57.768738 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:09:57.768738 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:09:57.768738 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:09:57.768738 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:09:57.768738 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:09:57.768738 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:09:57.768738 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86b8e817-3451-44b4-a642-4de45a937ea0 could not be found. Oct 04 20:09:57.768738 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 20:09:57.768738 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:09:57.768738 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 20:09:57.774390 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:09:57.774390 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:09:57.774390 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:09:57.774390 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:09:57.774390 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:09:57.774390 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86b8e817-3451-44b4-a642-4de45a937ea0 could not be found. Oct 04 20:09:57.774390 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 20:09:57.774390 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-3dc8c3d7-042d-4556-bba1-10871ea6262a tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Returning 404 to user: Instance 86b8e817-3451-44b4-a642-4de45a937ea0 could not be found. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:09:57.774390 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-3dc8c3d7-042d-4556-bba1-10871ea6262a tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] 10.222.0.43 "GET /compute/v2.1/servers/86b8e817-3451-44b4-a642-4de45a937ea0" status: 404 len: 111 microversion: 2.1 time: 0.032288 Oct 04 20:09:57.774390 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3803/7981] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 20:09:57 2022] GET /compute/v2.1/servers/86b8e817-3451-44b4-a642-4de45a937ea0 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:09:59.622233 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-eda2ae17-dfd3-4775-bf24-58c2946aed05 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:09:59.623148 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-eda2ae17-dfd3-4775-bf24-58c2946aed05 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] [instance: 9d6cb98b-15f6-4144-bcd7-e26bd005b380] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:09:59.623980 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-79f9f4e3-3ac6-4f50-97a4-337784180be4 req-2f9ab25c-ebbd-4b38-ab45-2a086c7e1df8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d6cb98b-15f6-4144-bcd7-e26bd005b380", "tag": "94427f5e-67ea-4f57-ac10-b594d9afe040"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:09:59.630935 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-eda2ae17-dfd3-4775-bf24-58c2946aed05 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:09:59.631539 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-eda2ae17-dfd3-4775-bf24-58c2946aed05 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:09:59.632038 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-eda2ae17-dfd3-4775-bf24-58c2946aed05 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:09:59.632768 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-eda2ae17-dfd3-4775-bf24-58c2946aed05 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:09:59.633292 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-eda2ae17-dfd3-4775-bf24-58c2946aed05 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:09:59.633789 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-eda2ae17-dfd3-4775-bf24-58c2946aed05 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:09:59.640412 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-79f9f4e3-3ac6-4f50-97a4-337784180be4 req-2f9ab25c-ebbd-4b38-ab45-2a086c7e1df8 service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:09:59.640931 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-79f9f4e3-3ac6-4f50-97a4-337784180be4 req-2f9ab25c-ebbd-4b38-ab45-2a086c7e1df8 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:09:59.641529 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-79f9f4e3-3ac6-4f50-97a4-337784180be4 req-2f9ab25c-ebbd-4b38-ab45-2a086c7e1df8 service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:09:59.652396 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-79f9f4e3-3ac6-4f50-97a4-337784180be4 req-2f9ab25c-ebbd-4b38-ab45-2a086c7e1df8 service nova] Creating event network-changed:94427f5e-67ea-4f57-ac10-b594d9afe040 for instance 9d6cb98b-15f6-4144-bcd7-e26bd005b380 on n-h1-851028-13 Oct 04 20:09:59.658264 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-79f9f4e3-3ac6-4f50-97a4-337784180be4 req-2f9ab25c-ebbd-4b38-ab45-2a086c7e1df8 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037987 Oct 04 20:09:59.658881 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3804/7982] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 20:09:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:09:59.660594 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-eda2ae17-dfd3-4775-bf24-58c2946aed05 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] [instance: 9d6cb98b-15f6-4144-bcd7-e26bd005b380] Going to try to terminate instance {{(pid=123596) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:09:59.750085 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-eda2ae17-dfd3-4775-bf24-58c2946aed05 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] 10.222.0.43 "DELETE /compute/v2.1/servers/9d6cb98b-15f6-4144-bcd7-e26bd005b380" status: 204 len: 0 microversion: 2.1 time: 0.131160 Oct 04 20:09:59.750686 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 4179/7983] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 20:09:59 2022] DELETE /compute/v2.1/servers/9d6cb98b-15f6-4144-bcd7-e26bd005b380 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:09:59.760705 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-025dc19a-4d41-49cb-8b3a-81feda749359 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:09:59.761768 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-025dc19a-4d41-49cb-8b3a-81feda749359 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] [instance: 9d6cb98b-15f6-4144-bcd7-e26bd005b380] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:09:59.768971 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-025dc19a-4d41-49cb-8b3a-81feda749359 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:09:59.769500 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-025dc19a-4d41-49cb-8b3a-81feda749359 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:09:59.770230 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-025dc19a-4d41-49cb-8b3a-81feda749359 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:09:59.771108 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-025dc19a-4d41-49cb-8b3a-81feda749359 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:09:59.771565 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-025dc19a-4d41-49cb-8b3a-81feda749359 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:09:59.772181 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-025dc19a-4d41-49cb-8b3a-81feda749359 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:09:59.913603 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.policy [None req-025dc19a-4d41-49cb-8b3a-81feda749359 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56cb8c6c599143389b0a4b9e55423155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be6815aff7a416a8f668d2ac5d56693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:09:59.921897 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-025dc19a-4d41-49cb-8b3a-81feda749359 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] 10.222.0.43 "GET /compute/v2.1/servers/9d6cb98b-15f6-4144-bcd7-e26bd005b380" status: 200 len: 1682 microversion: 2.1 time: 0.166190 Oct 04 20:09:59.922497 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3805/7984] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 20:09:59 2022] GET /compute/v2.1/servers/9d6cb98b-15f6-4144-bcd7-e26bd005b380 => generated 1682 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:10:00.947178 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-5e1f5b4c-220f-47cb-880e-5b24f154be00 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:10:00.947906 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-5e1f5b4c-220f-47cb-880e-5b24f154be00 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] [instance: 9d6cb98b-15f6-4144-bcd7-e26bd005b380] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:10:00.955034 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5e1f5b4c-220f-47cb-880e-5b24f154be00 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:10:00.955543 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5e1f5b4c-220f-47cb-880e-5b24f154be00 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:10:00.956004 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5e1f5b4c-220f-47cb-880e-5b24f154be00 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:10:00.956724 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5e1f5b4c-220f-47cb-880e-5b24f154be00 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:10:00.957232 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5e1f5b4c-220f-47cb-880e-5b24f154be00 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:10:00.957702 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-5e1f5b4c-220f-47cb-880e-5b24f154be00 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:10:01.139459 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-5e1f5b4c-220f-47cb-880e-5b24f154be00 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56cb8c6c599143389b0a4b9e55423155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be6815aff7a416a8f668d2ac5d56693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:10:01.148358 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-5e1f5b4c-220f-47cb-880e-5b24f154be00 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] 10.222.0.43 "GET /compute/v2.1/servers/9d6cb98b-15f6-4144-bcd7-e26bd005b380" status: 200 len: 1682 microversion: 2.1 time: 0.205718 Oct 04 20:10:01.148940 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 4180/7985] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 20:10:00 2022] GET /compute/v2.1/servers/9d6cb98b-15f6-4144-bcd7-e26bd005b380 => generated 1682 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:10:01.764729 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [req-35eb4815-bb11-4246-b1b6-5a0b27f94c45 req-b0c80f2d-cb25-4ef2-91a4-c6463b73555b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d6cb98b-15f6-4144-bcd7-e26bd005b380", "name": "network-vif-deleted", "tag": "94427f5e-67ea-4f57-ac10-b594d9afe040"}]} {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:10:01.776091 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-35eb4815-bb11-4246-b1b6-5a0b27f94c45 req-b0c80f2d-cb25-4ef2-91a4-c6463b73555b service nova] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:10:01.776578 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-35eb4815-bb11-4246-b1b6-5a0b27f94c45 req-b0c80f2d-cb25-4ef2-91a4-c6463b73555b service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:10:01.777012 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [req-35eb4815-bb11-4246-b1b6-5a0b27f94c45 req-b0c80f2d-cb25-4ef2-91a4-c6463b73555b service nova] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:10:01.789427 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.compute.server_external_events [req-35eb4815-bb11-4246-b1b6-5a0b27f94c45 req-b0c80f2d-cb25-4ef2-91a4-c6463b73555b service nova] Creating event network-vif-deleted:94427f5e-67ea-4f57-ac10-b594d9afe040 for instance 9d6cb98b-15f6-4144-bcd7-e26bd005b380 on n-h1-851028-13 Oct 04 20:10:01.794170 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [req-35eb4815-bb11-4246-b1b6-5a0b27f94c45 req-b0c80f2d-cb25-4ef2-91a4-c6463b73555b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034022 Oct 04 20:10:01.794778 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3806/7986] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 20:10:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:10:02.172385 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-b56a5386-88fb-4d11-8e06-305ce52b7387 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Calling method '>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:10:02.173004 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.compute.api [None req-b56a5386-88fb-4d11-8e06-305ce52b7387 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] [instance: 9d6cb98b-15f6-4144-bcd7-e26bd005b380] Fetching instance by UUID {{(pid=123596) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:10:02.182387 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b56a5386-88fb-4d11-8e06-305ce52b7387 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:10:02.182899 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b56a5386-88fb-4d11-8e06-305ce52b7387 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:10:02.183356 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b56a5386-88fb-4d11-8e06-305ce52b7387 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:10:02.184083 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b56a5386-88fb-4d11-8e06-305ce52b7387 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:10:02.184556 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b56a5386-88fb-4d11-8e06-305ce52b7387 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:10:02.186162 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b56a5386-88fb-4d11-8e06-305ce52b7387 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:10:02.222602 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b56a5386-88fb-4d11-8e06-305ce52b7387 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:10:02.223210 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b56a5386-88fb-4d11-8e06-305ce52b7387 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:10:02.223743 n-d-851028-13 devstack@n-api.service[123596]: DEBUG oslo_concurrency.lockutils [None req-b56a5386-88fb-4d11-8e06-305ce52b7387 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:10:02.224283 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.objects.instance [None req-b56a5386-88fb-4d11-8e06-305ce52b7387 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Lazy-loading 'fault' on Instance uuid 9d6cb98b-15f6-4144-bcd7-e26bd005b380 {{(pid=123596) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:10:02.268542 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.policy [None req-b56a5386-88fb-4d11-8e06-305ce52b7387 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56cb8c6c599143389b0a4b9e55423155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be6815aff7a416a8f668d2ac5d56693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123596) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:10:02.276327 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-b56a5386-88fb-4d11-8e06-305ce52b7387 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] 10.222.0.43 "GET /compute/v2.1/servers/9d6cb98b-15f6-4144-bcd7-e26bd005b380" status: 200 len: 1337 microversion: 2.1 time: 0.108494 Oct 04 20:10:02.280665 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 4181/7987] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 20:10:02 2022] GET /compute/v2.1/servers/9d6cb98b-15f6-4144-bcd7-e26bd005b380 => generated 1337 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:10:03.302892 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-933ff7e5-4baf-4b51-b1cf-f1080da93574 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Calling method '>' {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:10:03.303545 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.compute.api [None req-933ff7e5-4baf-4b51-b1cf-f1080da93574 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] [instance: 9d6cb98b-15f6-4144-bcd7-e26bd005b380] Fetching instance by UUID {{(pid=123595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:10:03.310504 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-933ff7e5-4baf-4b51-b1cf-f1080da93574 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:10:03.310999 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-933ff7e5-4baf-4b51-b1cf-f1080da93574 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:10:03.311442 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-933ff7e5-4baf-4b51-b1cf-f1080da93574 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:10:03.312150 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-933ff7e5-4baf-4b51-b1cf-f1080da93574 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Acquiring lock "66287c68-6a08-453f-953b-bd2446fe0d25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:10:03.312610 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-933ff7e5-4baf-4b51-b1cf-f1080da93574 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:10:03.313039 n-d-851028-13 devstack@n-api.service[123595]: DEBUG oslo_concurrency.lockutils [None req-933ff7e5-4baf-4b51-b1cf-f1080da93574 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Lock "66287c68-6a08-453f-953b-bd2446fe0d25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:10:03.329318 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.wsgi [None req-933ff7e5-4baf-4b51-b1cf-f1080da93574 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] HTTP exception thrown: Instance 9d6cb98b-15f6-4144-bcd7-e26bd005b380 could not be found. Oct 04 20:10:03.331081 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-933ff7e5-4baf-4b51-b1cf-f1080da93574 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Request method failure captured: Oct 04 20:10:03.331081 n-d-851028-13 devstack@n-api.service[123595]: request: GET /compute/v2.1/servers/9d6cb98b-15f6-4144-bcd7-e26bd005b380 HTTP/1.1 Oct 04 20:10:03.331081 n-d-851028-13 devstack@n-api.service[123595]: Accept: application/json Oct 04 20:10:03.331081 n-d-851028-13 devstack@n-api.service[123595]: Accept-Encoding: identity Oct 04 20:10:03.331081 n-d-851028-13 devstack@n-api.service[123595]: Connection: close Oct 04 20:10:03.331081 n-d-851028-13 devstack@n-api.service[123595]: Content-Length: 0 Oct 04 20:10:03.331081 n-d-851028-13 devstack@n-api.service[123595]: Content-Type: application/json Oct 04 20:10:03.331081 n-d-851028-13 devstack@n-api.service[123595]: Host: 10.222.0.43 Oct 04 20:10:03.331081 n-d-851028-13 devstack@n-api.service[123595]: Openstack-System-Scope: None Oct 04 20:10:03.331081 n-d-851028-13 devstack@n-api.service[123595]: User-Agent: python-urllib3/1.26.12 Oct 04 20:10:03.331081 n-d-851028-13 devstack@n-api.service[123595]: X-Auth-Token: gAAAAABjPJICZuUjHU73D6dMdGDfCI0Hg2EvapEqa3GEGz8rV0zS8i-54FPqepexgg2m3Jk_hwbB0t7f95oACdZ84TtAiw2cMd93sizZl-KLTON_BdaIw91tsYSVwQh7tVeu-L88HORHCStOa0VqNgbV0PbnLufAmbzPV1BfUFw9FFJJ8mYqnUc Oct 04 20:10:03.331081 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Id: None Oct 04 20:10:03.331081 n-d-851028-13 devstack@n-api.service[123595]: X-Domain-Name: None Oct 04 20:10:03.331081 n-d-851028-13 devstack@n-api.service[123595]: X-Identity-Status: Confirmed Oct 04 20:10:03.331081 n-d-851028-13 devstack@n-api.service[123595]: X-Is-Admin-Project: True Oct 04 20:10:03.331081 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Id: default Oct 04 20:10:03.331081 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Domain-Name: Default Oct 04 20:10:03.331081 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Id: 1be6815aff7a416a8f668d2ac5d56693 Oct 04 20:10:03.331081 n-d-851028-13 devstack@n-api.service[123595]: X-Project-Name: tempest-TestSnapshotPattern-169555681 Oct 04 20:10:03.331081 n-d-851028-13 devstack@n-api.service[123595]: X-Role: member,reader Oct 04 20:10:03.331081 n-d-851028-13 devstack@n-api.service[123595]: X-Roles: member,reader Oct 04 20:10:03.331081 n-d-851028-13 devstack@n-api.service[123595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/1be6815aff7a416a8f668d2ac5d56693"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_1be6815aff7a416a8f668d2ac5d56693"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1be6815aff7a416a8f668d2ac5d56693"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1be6815aff7a416a8f668d2ac5d56693"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Oct 04 20:10:03.331081 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant: tempest-TestSnapshotPattern-169555681 Oct 04 20:10:03.331081 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Id: 1be6815aff7a416a8f668d2ac5d56693 Oct 04 20:10:03.331081 n-d-851028-13 devstack@n-api.service[123595]: X-Tenant-Name: tempest-TestSnapshotPattern-169555681 Oct 04 20:10:03.331081 n-d-851028-13 devstack@n-api.service[123595]: X-User: tempest-TestSnapshotPattern-169555681-project Oct 04 20:10:03.331081 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Id: default Oct 04 20:10:03.331081 n-d-851028-13 devstack@n-api.service[123595]: X-User-Domain-Name: Default Oct 04 20:10:03.331081 n-d-851028-13 devstack@n-api.service[123595]: X-User-Id: 56cb8c6c599143389b0a4b9e55423155 Oct 04 20:10:03.331081 n-d-851028-13 devstack@n-api.service[123595]: X-User-Name: tempest-TestSnapshotPattern-169555681-project Oct 04 20:10:03.331081 n-d-851028-13 devstack@n-api.service[123595]: method: > Oct 04 20:10:03.331081 n-d-851028-13 devstack@n-api.service[123595]: exception: Instance 9d6cb98b-15f6-4144-bcd7-e26bd005b380 could not be found. Oct 04 20:10:03.331081 n-d-851028-13 devstack@n-api.service[123595]: action_args: {'id': '9d6cb98b-15f6-4144-bcd7-e26bd005b380'} Oct 04 20:10:03.331081 n-d-851028-13 devstack@n-api.service[123595]: {{(pid=123595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:10:03.331081 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:10:03.331081 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:10:03.331081 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:10:03.331081 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:10:03.331081 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:10:03.331081 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:10:03.331081 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:10:03.331081 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:10:03.331081 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:10:03.331081 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d6cb98b-15f6-4144-bcd7-e26bd005b380 could not be found. Oct 04 20:10:03.331081 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 20:10:03.331081 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:10:03.331081 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 20:10:03.331081 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:10:03.331081 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:10:03.331081 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:10:03.331081 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:10:03.331081 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:10:03.331081 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:10:03.331081 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:10:03.331081 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:10:03.331081 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:10:03.331081 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:10:03.331081 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:10:03.331081 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:10:03.331081 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:10:03.331081 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d6cb98b-15f6-4144-bcd7-e26bd005b380 could not be found. Oct 04 20:10:03.331081 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 20:10:03.331081 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:10:03.331081 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 20:10:03.336065 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:10:03.336065 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:10:03.336065 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:10:03.336065 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:10:03.336065 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:10:03.336065 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d6cb98b-15f6-4144-bcd7-e26bd005b380 could not be found. Oct 04 20:10:03.336065 n-d-851028-13 devstack@n-api.service[123595]: ERROR nova.api.openstack.wsgi Oct 04 20:10:03.336065 n-d-851028-13 devstack@n-api.service[123595]: DEBUG nova.api.openstack.wsgi [None req-933ff7e5-4baf-4b51-b1cf-f1080da93574 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Returning 404 to user: Instance 9d6cb98b-15f6-4144-bcd7-e26bd005b380 could not be found. {{(pid=123595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:10:03.336065 n-d-851028-13 devstack@n-api.service[123595]: INFO nova.api.openstack.requestlog [None req-933ff7e5-4baf-4b51-b1cf-f1080da93574 tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] 10.222.0.43 "GET /compute/v2.1/servers/9d6cb98b-15f6-4144-bcd7-e26bd005b380" status: 404 len: 111 microversion: 2.1 time: 0.034840 Oct 04 20:10:03.336065 n-d-851028-13 devstack@n-api.service[123595]: [pid: 123595|app: 0|req: 3807/7988] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 20:10:03 2022] GET /compute/v2.1/servers/9d6cb98b-15f6-4144-bcd7-e26bd005b380 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:10:03.494696 n-d-851028-13 devstack@n-api.service[123596]: DEBUG nova.api.openstack.wsgi [None req-e5c8c993-fb8a-43ce-8192-9196f5ad5f5d tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] Calling method '.version_select at 0x7fb21ec219d0>' {{(pid=123596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:10:03.519579 n-d-851028-13 devstack@n-api.service[123596]: INFO nova.api.openstack.requestlog [None req-e5c8c993-fb8a-43ce-8192-9196f5ad5f5d tempest-TestSnapshotPattern-169555681 tempest-TestSnapshotPattern-169555681-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-353745904" status: 202 len: 0 microversion: 2.1 time: 0.028728 Oct 04 20:10:03.520351 n-d-851028-13 devstack@n-api.service[123596]: [pid: 123596|app: 0|req: 4182/7989] 10.222.0.43 () {58 vars in 1254 bytes} [Tue Oct 4 20:10:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-353745904 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)